00010000:00010000:1.0:1651529333.317677:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c45b5d lrc: 4/0,0 mode: PR/PR res: [0x2b1a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab408 expref: 582 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.317683:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c45b5d lrc: 3/0,0 mode: PR/PR res: [0x2b1a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab408 expref: 581 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.317688:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c45b5d lrc: 0/0,0 mode: --/PR res: [0x2b1a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab408 expref: 581 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.317692:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.317692:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.317693:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000345d04ae/0x3234de053c4b95f lrc: 3/0,1 mode: PW/PW res: [0x2b1a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.317696:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000345d04ae/0x3234de053c4b95f lrc: 4/0,1 mode: PW/PW res: [0x2b1a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.317702:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.317707:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+579:41279:x1731746394366208:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 33us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.317709:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10880 00000100:00100000:1.0:1651529333.317713:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10882 00000100:00100000:1.0:1651529333.317715:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+578:41278:x1731746394366144:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.317717:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.317718:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e7b4db91/0x3234de053c46cb3 lrc: 4/0,0 mode: PR/PR res: [0x2b1a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afcc4 expref: 578 pid: 80277 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.317722:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e7b4db91/0x3234de053c46cb3 lrc: 3/0,0 mode: PR/PR res: [0x2b1a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afcc4 expref: 577 pid: 80277 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.317727:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7b4db91/0x3234de053c46cb3 lrc: 0/0,0 mode: --/PR res: [0x2b1a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afcc4 expref: 577 pid: 80277 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.317742:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.317743:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.317743:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007c5115ca/0x3234de053c4b958 lrc: 3/0,1 mode: PW/PW res: [0x2b1a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.317746:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c5115ca/0x3234de053c4b958 lrc: 4/0,1 mode: PW/PW res: [0x2b1a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.317755:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.317761:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+575:41278:x1731746394366144:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 46us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.317764:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10882 00010000:00010000:1.0:1651529333.317772:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ec9a9356/0x3234de053c4b935 lrc: 3/0,1 mode: PW/PW res: [0x2b19e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.317776:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec9a9356/0x3234de053c4b935 lrc: 3/0,1 mode: PW/PW res: [0x2b19e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.317779:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec9a9356/0x3234de053c4b935 lrc: 3/0,1 mode: PW/PW res: [0x2b19e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.317782:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec9a9356/0x3234de053c4b935 lrc: 2/0,0 mode: PW/PW res: [0x2b19e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.317830:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003ffbc5dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+800:39029:x1731745946265344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1779us (1889us total) trans 12885078149 rc 0/0 00000100:00100000:1.0:1651529333.317833:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208203 00000100:00100000:1.0:1651529333.317838:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394366336 00000100:00100000:1.0:1651529333.317847:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 208211 00000100:00100000:1.0:1651529333.317849:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+573:41279:x1731746394366336:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529333.317852:0:80278:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529333.317857:0:80278:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070653347/0x3234de053c4b96d lrc: 2/0,0 mode: --/PR res: [0x2b98c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2cc457 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529333.317868:0:80278:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b98c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529333.317873:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.317873:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.317875:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070653347/0x3234de053c4b96d lrc: 3/0,0 mode: PR/PR res: [0x2b98c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc457 expref: 574 pid: 80278 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.317880:0:80278:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000070653347/0x3234de053c4b96d lrc: 3/0,0 mode: PR/PR res: [0x2b98c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc457 expref: 574 pid: 80278 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.317883:0:80278:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000070653347, rc 0) 00000100:00100000:1.0:1651529333.317889:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+574:41279:x1731746394366336:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 39us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.317891:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 208211 00010000:00010000:1.0:1651529333.317898:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058d7a733/0x3234de053c4b94a lrc: 2/0,0 mode: PW/PW res: [0x2b1a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.317904:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000058d7a733 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.317905:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058d7a733/0x3234de053c4b94a lrc: 2/0,0 mode: PW/PW res: [0x2b1a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.317908:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058d7a733/0x3234de053c4b94a lrc: 3/0,0 mode: PW/PW res: [0x2b1a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.317912:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058d7a733/0x3234de053c4b94a lrc: 1/0,0 mode: --/PW res: [0x2b1a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.317914:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058d7a733/0x3234de053c4b94a lrc: 0/0,0 mode: --/PW res: [0x2b1a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.317920:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000345d04ae/0x3234de053c4b95f lrc: 3/0,1 mode: PW/PW res: [0x2b1a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.317923:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000345d04ae/0x3234de053c4b95f lrc: 3/0,1 mode: PW/PW res: [0x2b1a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.317926:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000345d04ae/0x3234de053c4b95f lrc: 3/0,1 mode: PW/PW res: [0x2b1a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.317929:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000345d04ae/0x3234de053c4b95f lrc: 2/0,0 mode: PW/PW res: [0x2b1a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.317972:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+800:39029:x1731745946265664:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1555us (1694us total) trans 12885078152 rc 0/0 00000100:00100000:1.0:1651529333.317975:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208209 00010000:00010000:1.0:1651529333.317983:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c4b951 lrc: 3/0,1 mode: PW/PW res: [0x2b1a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.317986:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c4b951 lrc: 3/0,1 mode: PW/PW res: [0x2b1a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.317989:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c4b951 lrc: 3/0,1 mode: PW/PW res: [0x2b1a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.317992:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c4b951 lrc: 2/0,0 mode: PW/PW res: [0x2b1a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.318025:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005914c920 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+800:39029:x1731745946265728:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1661us (1761us total) trans 12885078153 rc 0/0 00000100:00100000:1.0:1651529333.318028:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208208 00010000:00010000:1.0:1651529333.318035:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000052977309/0x3234de053c4b943 lrc: 3/0,1 mode: PW/PW res: [0x2b19f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.318038:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052977309/0x3234de053c4b943 lrc: 3/0,1 mode: PW/PW res: [0x2b19f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.318041:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052977309/0x3234de053c4b943 lrc: 3/0,1 mode: PW/PW res: [0x2b19f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.318044:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000052977309/0x3234de053c4b943 lrc: 2/0,0 mode: PW/PW res: [0x2b19f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.318075:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+800:39029:x1731745946265408:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1968us (2064us total) trans 12885078154 rc 0/0 00000100:00100000:1.0:1651529333.318078:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208205 00010000:00010000:1.0:1651529333.318085:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009be39b1e/0x3234de053c4b966 lrc: 2/0,0 mode: PW/PW res: [0x2b1a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.318088:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009be39b1e already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.318089:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009be39b1e/0x3234de053c4b966 lrc: 2/0,0 mode: PW/PW res: [0x2b1a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.318092:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009be39b1e/0x3234de053c4b966 lrc: 3/0,0 mode: PW/PW res: [0x2b1a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.318096:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009be39b1e/0x3234de053c4b966 lrc: 1/0,0 mode: --/PW res: [0x2b1a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.318099:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009be39b1e/0x3234de053c4b966 lrc: 0/0,0 mode: --/PW res: [0x2b1a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.318114:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.318530:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.318539:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.318545:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.318558:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946266560 00000100:00100000:1.0:1651529333.318567:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946266624 00000100:00100000:1.0:1651529333.318571:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208213 00000100:00100000:1.0:1651529333.318573:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+802:39030:x1731745946266560:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.318578:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176551 count 1 00010000:00010000:1.0:1651529333.318583:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e56573c/0x3234de053c4b97b lrc: 3/0,1 mode: --/PW res: [0x2b1a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.318588:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004d872ea8/0x3234de053c46972 lrc: 2/0,0 mode: PR/PR res: [0x2b1a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aedd6 expref: 574 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.318591:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.318591:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.318592:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e56573c/0x3234de053c4b97b lrc: 4/0,1 mode: --/PW res: [0x2b1a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.318618:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004d872ea8/0x3234de053c46972 lrc: 3/0,0 mode: PR/PR res: [0x2b1a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aedd6 expref: 574 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.318622:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004d872ea8/0x3234de053c46972 lrc: 4/0,0 mode: PR/PR res: [0x2b1a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aedd6 expref: 574 pid: 80277 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.318626:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ea0220b6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996913152:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.318637:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 000000007e004c12 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.318643:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208215 00000100:00100000:1.0:1651529333.318645:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+802:39030:x1731745946266496:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.318650:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176550 count 1 00010000:00010000:1.0:1651529333.318654:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c4b989 lrc: 3/0,1 mode: --/PW res: [0x2b1a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.318658:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002c7a6b64/0x3234de053c4390c lrc: 2/0,0 mode: PR/PR res: [0x2b1a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2989 expref: 574 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.318661:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.318662:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.318663:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c4b989 lrc: 4/0,1 mode: --/PW res: [0x2b1a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.318669:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002c7a6b64/0x3234de053c4390c lrc: 3/0,0 mode: PR/PR res: [0x2b1a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2989 expref: 574 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.318672:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002c7a6b64/0x3234de053c4390c lrc: 4/0,0 mode: PR/PR res: [0x2b1a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2989 expref: 574 pid: 72395 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.318676:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996913280:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.318683:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cfa1ca05 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.318695:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.318709:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.318723:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.318775:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.318786:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.318794:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.318801:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946266880 00000100:00100000:1.0:1651529333.318806:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394367040 00000100:00100000:1.0:1651529333.318809:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946267008 00000100:00100000:1.0:1651529333.318812:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208217 00000100:00100000:1.0:1651529333.318814:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+807:39030:x1731745946266816:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.318819:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176554 count 1 00010000:00010000:1.0:1651529333.318829:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c4b997 lrc: 3/0,1 mode: --/PW res: [0x2b1aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.318834:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a5ea7275/0x3234de053c44609 lrc: 2/0,0 mode: PR/PR res: [0x2b1aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5ee9 expref: 575 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.318837:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.318838:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.318839:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c4b997 lrc: 4/0,1 mode: --/PW res: [0x2b1aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.318845:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a5ea7275/0x3234de053c44609 lrc: 3/0,0 mode: PR/PR res: [0x2b1aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5ee9 expref: 575 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.318849:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a5ea7275/0x3234de053c44609 lrc: 4/0,0 mode: PR/PR res: [0x2b1aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5ee9 expref: 575 pid: 72395 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.318853:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996913408:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.318861:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c3caa148 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.318868:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208219 00000100:00100000:1.0:1651529333.318869:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+807:39030:x1731745946266880:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.318874:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176555 count 1 00010000:00010000:1.0:1651529333.318878:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008147181f/0x3234de053c4b9a5 lrc: 3/0,1 mode: --/PW res: [0x2b1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.318882:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b2da0c22/0x3234de053c4431c lrc: 2/0,0 mode: PR/PR res: [0x2b1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a529b expref: 575 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.318885:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.318886:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.318887:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008147181f/0x3234de053c4b9a5 lrc: 4/0,1 mode: --/PW res: [0x2b1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.318893:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b2da0c22/0x3234de053c4431c lrc: 3/0,0 mode: PR/PR res: [0x2b1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a529b expref: 576 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.318896:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b2da0c22/0x3234de053c4431c lrc: 4/0,0 mode: PR/PR res: [0x2b1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a529b expref: 576 pid: 72395 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.318900:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ef7d105 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996913536:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.318906:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a4eb401d going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.319288:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.319299:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996913280:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.319303:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c4b989 lrc: 3/0,1 mode: --/PW res: [0x2b1a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.319310:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ea0220b6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996913152:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.319313:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005e56573c/0x3234de053c4b97b lrc: 3/0,1 mode: --/PW res: [0x2b1a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.319332:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10884 00000100:00100000:1.0:1651529333.319334:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+576:41278:x1731746394367488:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.319337:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.319339:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a5772342/0x3234de053c43d8f lrc: 4/0,0 mode: PR/PR res: [0x2b1a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3b80 expref: 576 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.319345:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a5772342/0x3234de053c43d8f lrc: 3/0,0 mode: PR/PR res: [0x2b1a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3b80 expref: 576 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.319365:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5772342/0x3234de053c43d8f lrc: 0/0,0 mode: --/PR res: [0x2b1a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3b80 expref: 576 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.319369:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.319369:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.319370:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004bc816c1/0x3234de053c4b982 lrc: 3/0,1 mode: PW/PW res: [0x2b1a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.319373:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bc816c1/0x3234de053c4b982 lrc: 4/0,1 mode: PW/PW res: [0x2b1a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.319384:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.319394:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+575:41278:x1731746394367488:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 59us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.319396:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10884 00000100:00100000:1.0:1651529333.319411:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.319453:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529333.319488:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004bc816c1/0x3234de053c4b982 lrc: 2/0,0 mode: PW/PW res: [0x2b1a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.319492:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004bc816c1 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.319497:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004bc816c1/0x3234de053c4b982 lrc: 2/0,0 mode: PW/PW res: [0x2b1a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.319503:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004bc816c1/0x3234de053c4b982 lrc: 3/0,0 mode: PW/PW res: [0x2b1a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.319508:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004bc816c1/0x3234de053c4b982 lrc: 1/0,0 mode: --/PW res: [0x2b1a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.319511:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004bc816c1/0x3234de053c4b982 lrc: 0/0,0 mode: --/PW res: [0x2b1a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.319519:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10886 00000100:00100000:1.0:1651529333.319521:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+575:41279:x1731746394367552:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.319524:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.319526:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002c7a6b64/0x3234de053c4390c lrc: 4/0,0 mode: PR/PR res: [0x2b1a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2989 expref: 575 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.319536:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002c7a6b64/0x3234de053c4390c lrc: 3/0,0 mode: PR/PR res: [0x2b1a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2989 expref: 575 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.319545:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c7a6b64/0x3234de053c4390c lrc: 0/0,0 mode: --/PR res: [0x2b1a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2989 expref: 574 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.319549:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.319549:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.319550:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c4b989 lrc: 3/0,1 mode: PW/PW res: [0x2b1a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.319555:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c4b989 lrc: 4/0,1 mode: PW/PW res: [0x2b1a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.319561:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.319568:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+573:41279:x1731746394367552:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 47us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.319571:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10886 00010000:00010000:1.0:1651529333.319579:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c4b989 lrc: 3/0,1 mode: PW/PW res: [0x2b1a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.319582:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c4b989 lrc: 3/0,1 mode: PW/PW res: [0x2b1a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.319585:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c4b989 lrc: 3/0,1 mode: PW/PW res: [0x2b1a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.319588:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c4b989 lrc: 2/0,0 mode: PW/PW res: [0x2b1a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.319632:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+808:39030:x1731745946266496:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 986us (1092us total) trans 12885078158 rc 0/0 00000100:00100000:1.0:1651529333.319635:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208215 00010000:00010000:1.0:1651529333.319642:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005e56573c/0x3234de053c4b97b lrc: 3/0,1 mode: PW/PW res: [0x2b1a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.319645:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e56573c/0x3234de053c4b97b lrc: 3/0,1 mode: PW/PW res: [0x2b1a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.319648:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e56573c/0x3234de053c4b97b lrc: 3/0,1 mode: PW/PW res: [0x2b1a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.319651:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e56573c/0x3234de053c4b97b lrc: 2/0,0 mode: PW/PW res: [0x2b1a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.319687:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+808:39030:x1731745946266560:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1114us (1158us total) trans 12885078159 rc 0/0 00000100:00100000:1.0:1651529333.319690:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208213 00000100:00100000:1.0:1651529333.319724:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.319745:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.319791:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394367872 00010000:00010000:1.0:1651529333.319797:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000099324020/0x3234de053c44fd3 lrc: 4/0,0 mode: PR/PR res: [0x2b1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a84ba expref: 573 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.319805:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10887 00000100:00100000:1.0:1651529333.319807:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfc79d4e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+573:41279:x1731746394367872:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.319810:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.319811:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000099324020/0x3234de053c44fd3 lrc: 4/0,0 mode: PR/PR res: [0x2b1a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a84ba expref: 573 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.319815:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000099324020/0x3234de053c44fd3 lrc: 3/0,0 mode: PR/PR res: [0x2b1a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a84ba expref: 573 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.319820:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099324020/0x3234de053c44fd3 lrc: 0/0,0 mode: --/PR res: [0x2b1a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a84ba expref: 573 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.319824:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.319825:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.319826:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000090b66157/0x3234de053c4b990 lrc: 3/0,1 mode: PW/PW res: [0x2b1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.319829:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090b66157/0x3234de053c4b990 lrc: 4/0,1 mode: PW/PW res: [0x2b1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.319841:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.319850:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfc79d4e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+572:41279:x1731746394367872:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.319852:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10887 00000100:00100000:1.0:1651529333.319860:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946267136 00000100:00100000:1.0:1651529333.319865:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208222 00000100:00100000:1.0:1651529333.319873:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007fca8239 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+808:39029:x1731745946267136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.319878:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176558 count 1 00010000:00010000:1.0:1651529333.319882:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067a5ac39/0x3234de053c4b9ba lrc: 3/0,1 mode: --/PW res: [0x2b1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.319887:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006a3dc94e/0x3234de053c4457d lrc: 2/0,0 mode: PR/PR res: [0x2b1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5d0d expref: 571 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.319890:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.319890:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.319891:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067a5ac39/0x3234de053c4b9ba lrc: 4/0,1 mode: --/PW res: [0x2b1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.319900:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006a3dc94e/0x3234de053c4457d lrc: 3/0,0 mode: PR/PR res: [0x2b1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5d0d expref: 571 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.319904:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006a3dc94e/0x3234de053c4457d lrc: 4/0,0 mode: PR/PR res: [0x2b1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5d0d expref: 571 pid: 72395 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.319908:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009acffcb8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996913664:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.319916:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 000000007e004c12 going to sleep for 6 seconds 00010000:00010000:1.0:1651529333.319921:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090b66157/0x3234de053c4b990 lrc: 2/0,0 mode: PW/PW res: [0x2b1a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.319924:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000090b66157 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.319925:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090b66157/0x3234de053c4b990 lrc: 2/0,0 mode: PW/PW res: [0x2b1a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.319928:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090b66157/0x3234de053c4b990 lrc: 3/0,0 mode: PW/PW res: [0x2b1a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.319932:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090b66157/0x3234de053c4b990 lrc: 1/0,0 mode: --/PW res: [0x2b1a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.319935:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090b66157/0x3234de053c4b990 lrc: 0/0,0 mode: --/PW res: [0x2b1a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.319982:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.320036:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.320058:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.320064:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.320071:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.320078:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.320089:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996913408:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.320094:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c4b997 lrc: 3/0,1 mode: --/PW res: [0x2b1aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.320101:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208224 00000100:00100000:1.0:1651529333.320103:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+810:39029:x1731745946267200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.320108:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176559 count 1 00010000:00010000:1.0:1651529333.320113:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000376045ea/0x3234de053c4b9c8 lrc: 3/0,1 mode: --/PW res: [0x2b1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.320124:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d37ee464/0x3234de053c451bd lrc: 2/0,0 mode: PR/PR res: [0x2b1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8ca1 expref: 571 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.320127:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.320127:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.320128:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000376045ea/0x3234de053c4b9c8 lrc: 4/0,1 mode: --/PW res: [0x2b1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.320135:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d37ee464/0x3234de053c451bd lrc: 3/0,0 mode: PR/PR res: [0x2b1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8ca1 expref: 571 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.320138:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d37ee464/0x3234de053c451bd lrc: 4/0,0 mode: PR/PR res: [0x2b1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8ca1 expref: 572 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.320145:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006e255cae pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996913792:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.320154:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c3caa148 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.320161:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ef7d105 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996913536:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.320164:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008147181f/0x3234de053c4b9a5 lrc: 3/0,1 mode: --/PW res: [0x2b1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.320171:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10889 00000100:00100000:1.0:1651529333.320173:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+575:41279:x1731746394368128:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.320176:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.320177:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000016627d6e/0x3234de053c463c9 lrc: 4/0,0 mode: PR/PR res: [0x2b1ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad63d expref: 575 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.320181:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000016627d6e/0x3234de053c463c9 lrc: 3/0,0 mode: PR/PR res: [0x2b1ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad63d expref: 575 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.320187:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016627d6e/0x3234de053c463c9 lrc: 0/0,0 mode: --/PR res: [0x2b1ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad63d expref: 574 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.320190:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.320191:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.320192:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a2ca352a/0x3234de053c4b99e lrc: 3/0,1 mode: PW/PW res: [0x2b1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.320195:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2ca352a/0x3234de053c4b99e lrc: 4/0,1 mode: PW/PW res: [0x2b1ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.320211:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.320218:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+572:41279:x1731746394368128:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 45us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.320221:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10889 00000100:00100000:1.0:1651529333.320243:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10890 00000100:00100000:1.0:1651529333.320244:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+571:41278:x1731746394368192:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529333.320247:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.320249:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b2da0c22/0x3234de053c4431c lrc: 4/0,0 mode: PR/PR res: [0x2b1ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a529b expref: 571 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.320253:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b2da0c22/0x3234de053c4431c lrc: 3/0,0 mode: PR/PR res: [0x2b1ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a529b expref: 571 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.320258:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2da0c22/0x3234de053c4431c lrc: 0/0,0 mode: --/PR res: [0x2b1ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a529b expref: 571 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.320261:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.320262:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.320263:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008147181f/0x3234de053c4b9a5 lrc: 3/0,1 mode: PW/PW res: [0x2b1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.320266:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008147181f/0x3234de053c4b9a5 lrc: 4/0,1 mode: PW/PW res: [0x2b1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.320272:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.320278:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+569:41278:x1731746394368192:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.320281:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10890 00010000:00010000:1.0:1651529333.320287:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008147181f/0x3234de053c4b9a5 lrc: 3/0,1 mode: PW/PW res: [0x2b1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.320290:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008147181f/0x3234de053c4b9a5 lrc: 3/0,1 mode: PW/PW res: [0x2b1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.320293:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008147181f/0x3234de053c4b9a5 lrc: 3/0,1 mode: PW/PW res: [0x2b1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.320296:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008147181f/0x3234de053c4b9a5 lrc: 2/0,0 mode: PW/PW res: [0x2b1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.320339:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+811:39030:x1731745946266880:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1468us (1564us total) trans 12885078161 rc 0/0 00000100:00100000:1.0:1651529333.320342:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208219 00010000:00010000:1.0:1651529333.320349:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c4b997 lrc: 3/0,1 mode: PW/PW res: [0x2b1aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.320352:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c4b997 lrc: 3/0,1 mode: PW/PW res: [0x2b1aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.320355:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c4b997 lrc: 3/0,1 mode: PW/PW res: [0x2b1aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.320357:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c4b997 lrc: 2/0,0 mode: PW/PW res: [0x2b1aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.320393:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+811:39030:x1731745946266816:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1578us (1684us total) trans 12885078163 rc 0/0 00000100:00100000:1.0:1651529333.320396:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208217 00010000:00010000:1.0:1651529333.320403:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2ca352a/0x3234de053c4b99e lrc: 2/0,0 mode: PW/PW res: [0x2b1ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.320406:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a2ca352a already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.320407:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2ca352a/0x3234de053c4b99e lrc: 2/0,0 mode: PW/PW res: [0x2b1ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.320410:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2ca352a/0x3234de053c4b99e lrc: 3/0,0 mode: PW/PW res: [0x2b1ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.320414:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2ca352a/0x3234de053c4b99e lrc: 1/0,0 mode: --/PW res: [0x2b1ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.320417:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2ca352a/0x3234de053c4b99e lrc: 0/0,0 mode: --/PW res: [0x2b1ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.320444:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.320466:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529333.320567:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058990195/0x3234de053c4b9b3 lrc: 2/0,0 mode: PW/PW res: [0x2b1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.320572:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000058990195 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.320573:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058990195/0x3234de053c4b9b3 lrc: 2/0,0 mode: PW/PW res: [0x2b1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.320576:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058990195/0x3234de053c4b9b3 lrc: 3/0,0 mode: PW/PW res: [0x2b1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.320581:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058990195/0x3234de053c4b9b3 lrc: 1/0,0 mode: --/PW res: [0x2b1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.320583:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058990195/0x3234de053c4b9b3 lrc: 0/0,0 mode: --/PW res: [0x2b1ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.320594:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009acffcb8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996913664:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.320597:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000067a5ac39/0x3234de053c4b9ba lrc: 3/0,1 mode: --/PW res: [0x2b1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.320604:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394368384 00010000:00010000:1.0:1651529333.320609:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006a3dc94e/0x3234de053c4457d lrc: 4/0,0 mode: PR/PR res: [0x2b1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5d0d expref: 568 pid: 72395 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.320620:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10892 00000100:00100000:1.0:1651529333.320622:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+568:41278:x1731746394368384:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.320625:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.320626:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006a3dc94e/0x3234de053c4457d lrc: 4/0,0 mode: PR/PR res: [0x2b1ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5d0d expref: 568 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.320630:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006a3dc94e/0x3234de053c4457d lrc: 3/0,0 mode: PR/PR res: [0x2b1ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5d0d expref: 568 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.320637:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a3dc94e/0x3234de053c4457d lrc: 0/0,0 mode: --/PR res: [0x2b1ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5d0d expref: 568 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.320641:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.320642:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.320642:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000067a5ac39/0x3234de053c4b9ba lrc: 3/0,1 mode: PW/PW res: [0x2b1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.320645:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067a5ac39/0x3234de053c4b9ba lrc: 4/0,1 mode: PW/PW res: [0x2b1ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.320652:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.320660:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+567:41278:x1731746394368384:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 38us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.320662:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10892 00010000:00010000:1.0:1651529333.320668:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000067a5ac39/0x3234de053c4b9ba lrc: 3/0,1 mode: PW/PW res: [0x2b1ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.320671:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067a5ac39/0x3234de053c4b9ba lrc: 3/0,1 mode: PW/PW res: [0x2b1ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.320674:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067a5ac39/0x3234de053c4b9ba lrc: 3/0,1 mode: PW/PW res: [0x2b1ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.320677:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067a5ac39/0x3234de053c4b9ba lrc: 2/0,0 mode: PW/PW res: [0x2b1ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.320720:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007fca8239 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+812:39029:x1731745946267136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 847us (996us total) trans 12885078165 rc 0/0 00000100:00100000:1.0:1651529333.320723:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208222 00000100:00100000:1.0:1651529333.320928:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.320946:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.320953:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.320966:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.320975:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.320982:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946267904 00000100:00100000:1.0:1651529333.320990:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946268032 00000100:00100000:1.0:1651529333.320995:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946267968 00000100:00100000:1.0:1651529333.321001:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946268096 00000100:00100000:1.0:1651529333.321011:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208226 00000100:00100000:1.0:1651529333.321013:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+816:39029:x1731745946267904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.321018:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176562 count 1 00010000:00010000:1.0:1651529333.321024:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002310563/0x3234de053c4b9d6 lrc: 3/0,1 mode: --/PW res: [0x2b1b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.321028:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009f84133b/0x3234de053c46c20 lrc: 2/0,0 mode: PR/PR res: [0x2b1b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afa24 expref: 566 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.321031:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.321032:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.321033:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002310563/0x3234de053c4b9d6 lrc: 4/0,1 mode: --/PW res: [0x2b1b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.321039:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009f84133b/0x3234de053c46c20 lrc: 3/0,0 mode: PR/PR res: [0x2b1b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afa24 expref: 566 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.321043:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009f84133b/0x3234de053c46c20 lrc: 4/0,0 mode: PR/PR res: [0x2b1b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afa24 expref: 566 pid: 80277 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.321047:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996913920:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.321056:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cfa1ca05 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.321063:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208228 00000100:00100000:1.0:1651529333.321064:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+816:39029:x1731745946267968:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.321068:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176563 count 1 00010000:00010000:1.0:1651529333.321072:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4b9e4 lrc: 3/0,1 mode: --/PW res: [0x2b1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.321076:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005d4f6c06/0x3234de053c43952 lrc: 2/0,0 mode: PR/PR res: [0x2b1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2aa1 expref: 566 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.321079:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.321079:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.321080:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4b9e4 lrc: 4/0,1 mode: --/PW res: [0x2b1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.321086:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005d4f6c06/0x3234de053c43952 lrc: 3/0,0 mode: PR/PR res: [0x2b1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2aa1 expref: 566 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.321090:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005d4f6c06/0x3234de053c43952 lrc: 4/0,0 mode: PR/PR res: [0x2b1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2aa1 expref: 566 pid: 72395 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.321096:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d718cfe4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996914048:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.321103:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 0000000071742acc going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.321108:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208230 00000100:00100000:1.0:1651529333.321110:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+816:39030:x1731745946268160:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.321114:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176566 count 1 00010000:00010000:1.0:1651529333.321117:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ab96373/0x3234de053c4b9f2 lrc: 3/0,1 mode: --/PW res: [0x2b1b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.321121:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c43bd6 lrc: 2/0,0 mode: PR/PR res: [0x2b1b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a34e9 expref: 566 pid: 80278 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.321124:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.321124:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.321125:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ab96373/0x3234de053c4b9f2 lrc: 4/0,1 mode: --/PW res: [0x2b1b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.321131:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c43bd6 lrc: 3/0,0 mode: PR/PR res: [0x2b1b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a34e9 expref: 566 pid: 80278 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.321135:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c43bd6 lrc: 4/0,0 mode: PR/PR res: [0x2b1b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a34e9 expref: 566 pid: 80278 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.321138:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a130088 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996914176:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.321144:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 000000004698fefb going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.321236:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006e255cae pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996913792:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.321246:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000376045ea/0x3234de053c4b9c8 lrc: 3/0,1 mode: --/PW res: [0x2b1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.321721:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.321738:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.321749:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.321757:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394368832 00010000:00010000:1.0:1651529333.321762:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d37ee464/0x3234de053c451bd lrc: 4/0,0 mode: PR/PR res: [0x2b1af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8ca1 expref: 568 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.321775:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10893 00000100:00100000:1.0:1651529333.321777:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+569:41279:x1731746394368704:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529333.321780:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.321782:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c586dd32/0x3234de053c461fb lrc: 4/0,0 mode: PR/PR res: [0x2b1b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acf3d expref: 569 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.321786:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c586dd32/0x3234de053c461fb lrc: 3/0,0 mode: PR/PR res: [0x2b1b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acf3d expref: 569 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.321791:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c586dd32/0x3234de053c461fb lrc: 0/0,0 mode: --/PR res: [0x2b1b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acf3d expref: 569 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.321795:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.321796:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.321796:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d95da09e/0x3234de053c4b9c1 lrc: 3/0,1 mode: PW/PW res: [0x2b1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.321802:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d95da09e/0x3234de053c4b9c1 lrc: 4/0,1 mode: PW/PW res: [0x2b1b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.321815:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.321831:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+567:41279:x1731746394368704:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 53us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.321834:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10893 00010000:00010000:1.0:1651529333.321842:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000376045ea/0x3234de053c4b9c8 lrc: 3/0,1 mode: PW/PW res: [0x2b1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.321845:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000376045ea/0x3234de053c4b9c8 lrc: 3/0,1 mode: PW/PW res: [0x2b1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.321848:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000376045ea/0x3234de053c4b9c8 lrc: 3/0,1 mode: PW/PW res: [0x2b1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.321851:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000376045ea/0x3234de053c4b9c8 lrc: 2/0,0 mode: PW/PW res: [0x2b1af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.321897:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+817:39029:x1731745946267200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1793us (1861us total) trans 12885078166 rc 0/0 00000100:00100000:1.0:1651529333.321900:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208224 00010000:00010000:1.0:1651529333.321960:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006247fb8a/0x3234de053c4b9cf lrc: 2/0,0 mode: PW/PW res: [0x2b1b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.321968:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006247fb8a already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.321970:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006247fb8a/0x3234de053c4b9cf lrc: 2/0,0 mode: PW/PW res: [0x2b1b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.321973:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006247fb8a/0x3234de053c4b9cf lrc: 3/0,0 mode: PW/PW res: [0x2b1b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.321978:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006247fb8a/0x3234de053c4b9cf lrc: 1/0,0 mode: --/PW res: [0x2b1b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.321980:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006247fb8a/0x3234de053c4b9cf lrc: 0/0,0 mode: --/PW res: [0x2b1b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.322061:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.322070:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.322077:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.322140:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.322151:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.322162:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996913920:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.322167:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000002310563/0x3234de053c4b9d6 lrc: 3/0,1 mode: --/PW res: [0x2b1b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.322174:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d718cfe4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996914048:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.322177:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4b9e4 lrc: 3/0,1 mode: --/PW res: [0x2b1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.322183:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394369536 00010000:00010000:1.0:1651529333.322187:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009f84133b/0x3234de053c46c20 lrc: 4/0,0 mode: PR/PR res: [0x2b1b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afa24 expref: 564 pid: 80277 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.322200:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394369664 00010000:00010000:1.0:1651529333.322203:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005d4f6c06/0x3234de053c43952 lrc: 4/0,0 mode: PR/PR res: [0x2b1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2aa1 expref: 565 pid: 72395 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.322208:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394369600 00010000:00010000:1.0:1651529333.322210:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000392a99d/0x3234de053c43c07 lrc: 4/0,0 mode: PR/PR res: [0x2b1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a358a expref: 566 pid: 80278 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.322214:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10896 00000100:00100000:1.0:1651529333.322216:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+566:41279:x1731746394369536:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.322219:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.322220:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009f84133b/0x3234de053c46c20 lrc: 4/0,0 mode: PR/PR res: [0x2b1b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afa24 expref: 566 pid: 80277 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.322240:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009f84133b/0x3234de053c46c20 lrc: 3/0,0 mode: PR/PR res: [0x2b1b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afa24 expref: 566 pid: 80277 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.322246:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f84133b/0x3234de053c46c20 lrc: 0/0,0 mode: --/PR res: [0x2b1b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afa24 expref: 566 pid: 80277 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.322250:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.322251:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.322252:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000002310563/0x3234de053c4b9d6 lrc: 3/0,1 mode: PW/PW res: [0x2b1b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.322255:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002310563/0x3234de053c4b9d6 lrc: 4/0,1 mode: PW/PW res: [0x2b1b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.322274:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.322282:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+565:41279:x1731746394369536:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 66us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.322285:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10896 00000100:00100000:1.0:1651529333.322290:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10897 00000100:00100000:1.0:1651529333.322292:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+564:41279:x1731746394369664:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.322295:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.322296:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005d4f6c06/0x3234de053c43952 lrc: 4/0,0 mode: PR/PR res: [0x2b1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2aa1 expref: 564 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.322300:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005d4f6c06/0x3234de053c43952 lrc: 3/0,0 mode: PR/PR res: [0x2b1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2aa1 expref: 564 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.322304:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d4f6c06/0x3234de053c43952 lrc: 0/0,0 mode: --/PR res: [0x2b1b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2aa1 expref: 564 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.322308:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.322308:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.322309:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4b9e4 lrc: 3/0,1 mode: PW/PW res: [0x2b1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.322312:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4b9e4 lrc: 4/0,1 mode: PW/PW res: [0x2b1b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.322318:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.322322:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+563:41279:x1731746394369664:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 30us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.322325:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10897 00000100:00100000:1.0:1651529333.322329:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10898 00000100:00100000:1.0:1651529333.322330:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+562:41278:x1731746394369600:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529333.322333:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.322334:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000392a99d/0x3234de053c43c07 lrc: 4/0,0 mode: PR/PR res: [0x2b1b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a358a expref: 562 pid: 80278 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.322338:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000392a99d/0x3234de053c43c07 lrc: 3/0,0 mode: PR/PR res: [0x2b1b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a358a expref: 562 pid: 80278 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.322342:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000392a99d/0x3234de053c43c07 lrc: 0/0,0 mode: --/PR res: [0x2b1b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a358a expref: 562 pid: 80278 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.322345:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.322346:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.322346:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008a05bebd/0x3234de053c4b9dd lrc: 3/0,1 mode: PW/PW res: [0x2b1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.322349:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a05bebd/0x3234de053c4b9dd lrc: 4/0,1 mode: PW/PW res: [0x2b1b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.322359:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.322364:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+561:41278:x1731746394369600:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.322366:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10898 00000100:00100000:1.0:1651529333.322376:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a130088 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996914176:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.322380:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001ab96373/0x3234de053c4b9f2 lrc: 3/0,1 mode: --/PW res: [0x2b1b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.322386:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4b9e4 lrc: 3/0,1 mode: PW/PW res: [0x2b1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.322389:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4b9e4 lrc: 3/0,1 mode: PW/PW res: [0x2b1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.322392:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4b9e4 lrc: 3/0,1 mode: PW/PW res: [0x2b1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.322394:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4b9e4 lrc: 2/0,0 mode: PW/PW res: [0x2b1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.322433:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+819:39029:x1731745946267968:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1368us (1480us total) trans 12885078170 rc 0/0 00000100:00100000:1.0:1651529333.322436:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208228 00010000:00010000:1.0:1651529333.322443:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4b9e4 lrc: 2/0,0 mode: PW/PW res: [0x2b1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.322447:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007d2a92bc already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.322448:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4b9e4 lrc: 2/0,0 mode: PW/PW res: [0x2b1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.322451:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4b9e4 lrc: 3/0,0 mode: PW/PW res: [0x2b1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.322457:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4b9e4 lrc: 1/0,0 mode: --/PW res: [0x2b1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.322460:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4b9e4 lrc: 0/0,0 mode: --/PW res: [0x2b1b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.322466:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000002310563/0x3234de053c4b9d6 lrc: 3/0,1 mode: PW/PW res: [0x2b1b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.322469:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002310563/0x3234de053c4b9d6 lrc: 3/0,1 mode: PW/PW res: [0x2b1b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.322472:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002310563/0x3234de053c4b9d6 lrc: 3/0,1 mode: PW/PW res: [0x2b1b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.322475:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002310563/0x3234de053c4b9d6 lrc: 2/0,0 mode: PW/PW res: [0x2b1b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.322515:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+819:39029:x1731745946267904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1501us (1587us total) trans 12885078171 rc 0/0 00000100:00100000:1.0:1651529333.322518:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208226 00000100:00100000:1.0:1651529333.322533:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.322547:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.322571:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.322643:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394369792 00010000:00010000:1.0:1651529333.322648:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008619c536/0x3234de053c46225 lrc: 4/0,0 mode: PR/PR res: [0x2b1b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acf9f expref: 561 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.322656:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394369856 00010000:00010000:1.0:1651529333.322658:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c43bd6 lrc: 4/0,0 mode: PR/PR res: [0x2b1b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a34e9 expref: 562 pid: 80278 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.322668:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10899 00000100:00100000:1.0:1651529333.322669:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+562:41279:x1731746394369792:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.322672:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.322674:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008619c536/0x3234de053c46225 lrc: 4/0,0 mode: PR/PR res: [0x2b1b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acf9f expref: 562 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.322678:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008619c536/0x3234de053c46225 lrc: 3/0,0 mode: PR/PR res: [0x2b1b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acf9f expref: 562 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.322684:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008619c536/0x3234de053c46225 lrc: 0/0,0 mode: --/PR res: [0x2b1b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acf9f expref: 562 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.322687:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.322688:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.322689:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009c8ad646/0x3234de053c4b9eb lrc: 3/0,1 mode: PW/PW res: [0x2b1b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.322692:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c8ad646/0x3234de053c4b9eb lrc: 4/0,1 mode: PW/PW res: [0x2b1b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.322700:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.322709:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+561:41279:x1731746394369792:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 38us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.322712:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10899 00000100:00100000:1.0:1651529333.322719:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946268416 00000100:00100000:1.0:1651529333.322738:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208233 00000100:00100000:1.0:1651529333.322740:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+819:39030:x1731745946268416:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.322745:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176569 count 1 00010000:00010000:1.0:1651529333.322749:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f6c33eb/0x3234de053c4ba07 lrc: 3/0,1 mode: --/PW res: [0x2b1b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.322754:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000a146a8b/0x3234de053c45cfa lrc: 2/0,0 mode: PR/PR res: [0x2b1b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abaa6 expref: 558 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.322757:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.322757:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.322758:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f6c33eb/0x3234de053c4ba07 lrc: 4/0,1 mode: --/PW res: [0x2b1b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.322765:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000a146a8b/0x3234de053c45cfa lrc: 3/0,0 mode: PR/PR res: [0x2b1b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abaa6 expref: 558 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.322768:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000a146a8b/0x3234de053c45cfa lrc: 4/0,0 mode: PR/PR res: [0x2b1b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abaa6 expref: 558 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.322772:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d718cfe4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996914368:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.322781:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 000000004698fefb going to sleep for 6 seconds 00010000:00010000:1.0:1651529333.322786:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001ab96373/0x3234de053c4b9f2 lrc: 3/0,1 mode: PW/PW res: [0x2b1b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.322791:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ab96373/0x3234de053c4b9f2 lrc: 3/0,1 mode: PW/PW res: [0x2b1b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.322794:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ab96373/0x3234de053c4b9f2 lrc: 3/0,1 mode: PW/PW res: [0x2b1b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.322797:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ab96373/0x3234de053c4b9f2 lrc: 2/0,0 mode: PW/PW res: [0x2b1b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.322836:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+820:39030:x1731745946268160:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1725us (1861us total) trans 12885078173 rc 0/0 00000100:00100000:1.0:1651529333.322839:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208230 00000100:00100000:1.0:1651529333.322966:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.322974:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946268864 00000100:00100000:1.0:1651529333.322982:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208234 00000100:00100000:1.0:1651529333.322983:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad15c052 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+820:39030:x1731745946268864:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.322989:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176570 count 1 00010000:00010000:1.0:1651529333.322994:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000158a383a/0x3234de053c4ba0e lrc: 3/0,1 mode: --/PW res: [0x2b1ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.322998:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000891c04a6/0x3234de053c44bdc lrc: 2/0,0 mode: PR/PR res: [0x2b1ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a75f6 expref: 558 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.323001:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.323002:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.323003:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000158a383a/0x3234de053c4ba0e lrc: 4/0,1 mode: --/PW res: [0x2b1ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.323010:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000891c04a6/0x3234de053c44bdc lrc: 3/0,0 mode: PR/PR res: [0x2b1ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a75f6 expref: 558 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.323014:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000891c04a6/0x3234de053c44bdc lrc: 4/0,0 mode: PR/PR res: [0x2b1ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a75f6 expref: 558 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.323018:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996914432:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.323028:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cfa1ca05 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.323052:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.323086:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.323098:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946268992 00000100:00100000:1.0:1651529333.323111:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946268928 00000100:00100000:1.0:1651529333.323116:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208235 00000100:00100000:1.0:1651529333.323117:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+822:39030:x1731745946268992:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.323123:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176572 count 1 00010000:00010000:1.0:1651529333.323127:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a25596b/0x3234de053c4ba15 lrc: 3/0,1 mode: --/PW res: [0x2b1bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.323132:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cf6e14fb/0x3234de053c43bf9 lrc: 2/0,0 mode: PR/PR res: [0x2b1bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3567 expref: 558 pid: 80278 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.323135:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.323135:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.323136:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a25596b/0x3234de053c4ba15 lrc: 4/0,1 mode: --/PW res: [0x2b1bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.323145:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cf6e14fb/0x3234de053c43bf9 lrc: 3/0,0 mode: PR/PR res: [0x2b1bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3567 expref: 558 pid: 80278 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.323148:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cf6e14fb/0x3234de053c43bf9 lrc: 4/0,0 mode: PR/PR res: [0x2b1bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3567 expref: 558 pid: 80278 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.323152:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000999005e pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996914496:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.323161:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000567ee0ef going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.323193:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.323217:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.323258:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946269184 00000100:00100000:1.0:1651529333.323269:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208238 00000100:00100000:1.0:1651529333.323271:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+824:39030:x1731745946269184:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.323276:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176574 count 1 00010000:00010000:1.0:1651529333.323280:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4ba2a lrc: 3/0,1 mode: --/PW res: [0x2b1be:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.323285:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dcfaf2ba/0x3234de053c442cf lrc: 2/0,0 mode: PR/PR res: [0x2b1be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a51bb expref: 558 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.323288:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.323288:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.323295:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4ba2a lrc: 4/0,1 mode: --/PW res: [0x2b1be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.323302:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dcfaf2ba/0x3234de053c442cf lrc: 3/0,0 mode: PR/PR res: [0x2b1be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a51bb expref: 558 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.323306:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dcfaf2ba/0x3234de053c442cf lrc: 4/0,0 mode: PR/PR res: [0x2b1be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a51bb expref: 558 pid: 72395 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.323310:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000716b388d pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996914688:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.323318:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd96f074 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.323586:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.323593:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.323604:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.323613:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d718cfe4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996914368:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.323617:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005f6c33eb/0x3234de053c4ba07 lrc: 3/0,1 mode: --/PW res: [0x2b1b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.323629:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394370304 00010000:00010000:1.0:1651529333.323639:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000860760ad/0x3234de053c44ac4 lrc: 4/0,0 mode: PR/PR res: [0x2b1b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a723e expref: 561 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.323646:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10902 00000100:00100000:1.0:1651529333.323648:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+561:41278:x1731746394370496:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.323651:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.323653:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000a146a8b/0x3234de053c45cfa lrc: 4/0,0 mode: PR/PR res: [0x2b1b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abaa6 expref: 561 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.323656:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000a146a8b/0x3234de053c45cfa lrc: 3/0,0 mode: PR/PR res: [0x2b1b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abaa6 expref: 561 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.323665:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a146a8b/0x3234de053c45cfa lrc: 0/0,0 mode: --/PR res: [0x2b1b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abaa6 expref: 561 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.323669:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.323669:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.323670:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005f6c33eb/0x3234de053c4ba07 lrc: 3/0,1 mode: PW/PW res: [0x2b1b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.323673:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f6c33eb/0x3234de053c4ba07 lrc: 4/0,1 mode: PW/PW res: [0x2b1b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.323680:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.323695:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+559:41278:x1731746394370496:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 46us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.323697:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10902 00010000:00010000:1.0:1651529333.323705:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005f6c33eb/0x3234de053c4ba07 lrc: 3/0,1 mode: PW/PW res: [0x2b1b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.323708:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f6c33eb/0x3234de053c4ba07 lrc: 3/0,1 mode: PW/PW res: [0x2b1b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.323711:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f6c33eb/0x3234de053c4ba07 lrc: 3/0,1 mode: PW/PW res: [0x2b1b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.323714:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f6c33eb/0x3234de053c4ba07 lrc: 2/0,0 mode: PW/PW res: [0x2b1b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.323770:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+825:39030:x1731745946268416:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1030us (1237us total) trans 12885078174 rc 0/0 00000100:00100000:1.0:1651529333.323774:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208233 00000100:00100000:1.0:1651529333.323884:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996914432:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.323888:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000158a383a/0x3234de053c4ba0e lrc: 3/0,1 mode: --/PW res: [0x2b1ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.323900:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c45287a/0x3234de053c4b9f9 lrc: 2/0,0 mode: PW/PW res: [0x2b1b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.323903:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008c45287a already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.323904:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c45287a/0x3234de053c4b9f9 lrc: 2/0,0 mode: PW/PW res: [0x2b1b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.323907:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c45287a/0x3234de053c4b9f9 lrc: 3/0,0 mode: PW/PW res: [0x2b1b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.323912:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c45287a/0x3234de053c4b9f9 lrc: 1/0,0 mode: --/PW res: [0x2b1b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.323914:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c45287a/0x3234de053c4b9f9 lrc: 0/0,0 mode: --/PW res: [0x2b1b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.323919:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095fca58f/0x3234de053c4ba00 lrc: 2/0,0 mode: PW/PW res: [0x2b1b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.323924:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000095fca58f already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.323925:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095fca58f/0x3234de053c4ba00 lrc: 2/0,0 mode: PW/PW res: [0x2b1b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.323928:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095fca58f/0x3234de053c4ba00 lrc: 3/0,0 mode: PW/PW res: [0x2b1b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.323931:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095fca58f/0x3234de053c4ba00 lrc: 1/0,0 mode: --/PW res: [0x2b1b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.323933:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095fca58f/0x3234de053c4ba00 lrc: 0/0,0 mode: --/PW res: [0x2b1b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.324068:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.324080:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.324126:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208240 00000100:00100000:1.0:1651529333.324129:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+826:39030:x1731745946269440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.324135:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176575 count 1 00010000:00010000:1.0:1651529333.324139:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4ba38 lrc: 3/0,1 mode: --/PW res: [0x2b1bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.324143:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea8e6dc3/0x3234de053c44060 lrc: 2/0,0 mode: PR/PR res: [0x2b1bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a46c4 expref: 555 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.324147:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.324147:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.324148:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4ba38 lrc: 4/0,1 mode: --/PW res: [0x2b1bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.324155:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ea8e6dc3/0x3234de053c44060 lrc: 3/0,0 mode: PR/PR res: [0x2b1bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a46c4 expref: 555 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.324159:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ea8e6dc3/0x3234de053c44060 lrc: 4/0,0 mode: PR/PR res: [0x2b1bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a46c4 expref: 555 pid: 72395 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.324164:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a223a622 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996914816:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.324174:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cfa1ca05 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.324187:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.324291:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.324296:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.324309:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.324339:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.324346:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.324353:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.324383:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000999005e pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996914496:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.324388:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007a25596b/0x3234de053c4ba15 lrc: 3/0,1 mode: --/PW res: [0x2b1bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.324396:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000716b388d pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996914688:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.324398:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4ba2a lrc: 3/0,1 mode: --/PW res: [0x2b1be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.324404:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394371136 00010000:00010000:1.0:1651529333.324409:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c43c5b lrc: 4/0,0 mode: PR/PR res: [0x2b1bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3704 expref: 560 pid: 72395 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.324416:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10904 00000100:00100000:1.0:1651529333.324417:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+561:41279:x1731746394370688:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.324420:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.324422:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000891c04a6/0x3234de053c44bdc lrc: 4/0,0 mode: PR/PR res: [0x2b1ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a75f6 expref: 561 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.324425:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000891c04a6/0x3234de053c44bdc lrc: 3/0,0 mode: PR/PR res: [0x2b1ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a75f6 expref: 561 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.324431:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000891c04a6/0x3234de053c44bdc lrc: 0/0,0 mode: --/PR res: [0x2b1ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a75f6 expref: 561 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.324434:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.324435:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.324436:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000158a383a/0x3234de053c4ba0e lrc: 3/0,1 mode: PW/PW res: [0x2b1ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.324439:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000158a383a/0x3234de053c4ba0e lrc: 4/0,1 mode: PW/PW res: [0x2b1ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.324445:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.324460:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+559:41279:x1731746394370688:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.324464:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10904 00000100:00100000:1.0:1651529333.324469:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10907 00000100:00100000:1.0:1651529333.324471:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+557:41278:x1731746394371136:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.324474:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.324475:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c43c5b lrc: 4/0,0 mode: PR/PR res: [0x2b1bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3704 expref: 557 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.324479:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c43c5b lrc: 3/0,0 mode: PR/PR res: [0x2b1bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3704 expref: 557 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.324484:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c43c5b lrc: 0/0,0 mode: --/PR res: [0x2b1bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3704 expref: 556 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.324488:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.324488:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.324489:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c4ba23 lrc: 3/0,1 mode: PW/PW res: [0x2b1bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.324492:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c4ba23 lrc: 4/0,1 mode: PW/PW res: [0x2b1bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.324501:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.324507:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+555:41278:x1731746394371136:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.324510:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10907 00000100:00100000:1.0:1651529333.324514:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10908 00000100:00100000:1.0:1651529333.324516:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+554:41279:x1731746394371200:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.324518:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.324519:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dcfaf2ba/0x3234de053c442cf lrc: 4/0,0 mode: PR/PR res: [0x2b1be:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a51bb expref: 554 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.324523:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dcfaf2ba/0x3234de053c442cf lrc: 3/0,0 mode: PR/PR res: [0x2b1be:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a51bb expref: 554 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.324528:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcfaf2ba/0x3234de053c442cf lrc: 0/0,0 mode: --/PR res: [0x2b1be:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a51bb expref: 554 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.324531:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.324531:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.324532:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4ba2a lrc: 3/0,1 mode: PW/PW res: [0x2b1be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.324535:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4ba2a lrc: 4/0,1 mode: PW/PW res: [0x2b1be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.324541:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.324545:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+552:41279:x1731746394371200:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 29us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.324547:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10908 00010000:00010000:1.0:1651529333.324555:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000158a383a/0x3234de053c4ba0e lrc: 3/0,1 mode: PW/PW res: [0x2b1ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.324558:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000158a383a/0x3234de053c4ba0e lrc: 3/0,1 mode: PW/PW res: [0x2b1ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.324561:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000158a383a/0x3234de053c4ba0e lrc: 3/0,1 mode: PW/PW res: [0x2b1ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.324566:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000158a383a/0x3234de053c4ba0e lrc: 2/0,0 mode: PW/PW res: [0x2b1ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.324616:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad15c052 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+829:39030:x1731745946268864:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1632us (1651us total) trans 12885078178 rc 0/0 00000100:00100000:1.0:1651529333.324620:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208234 00010000:00010000:1.0:1651529333.324640:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4ba2a lrc: 3/0,1 mode: PW/PW res: [0x2b1be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.324643:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4ba2a lrc: 3/0,1 mode: PW/PW res: [0x2b1be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.324646:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4ba2a lrc: 3/0,1 mode: PW/PW res: [0x2b1be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.324649:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4ba2a lrc: 2/0,0 mode: PW/PW res: [0x2b1be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.324685:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+828:39030:x1731745946269184:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1413us (1474us total) trans 12885078179 rc 0/0 00000100:00100000:1.0:1651529333.324688:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208238 00010000:00010000:1.0:1651529333.324695:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c4ba23 lrc: 2/0,0 mode: PW/PW res: [0x2b1bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.324698:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000015737583 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.324699:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c4ba23 lrc: 2/0,0 mode: PW/PW res: [0x2b1bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.324702:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c4ba23 lrc: 3/0,0 mode: PW/PW res: [0x2b1bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.324707:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c4ba23 lrc: 1/0,0 mode: --/PW res: [0x2b1bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.324710:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c4ba23 lrc: 0/0,0 mode: --/PW res: [0x2b1bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.324715:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007a25596b/0x3234de053c4ba15 lrc: 3/0,1 mode: PW/PW res: [0x2b1bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.324718:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a25596b/0x3234de053c4ba15 lrc: 3/0,1 mode: PW/PW res: [0x2b1bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.324721:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a25596b/0x3234de053c4ba15 lrc: 3/0,1 mode: PW/PW res: [0x2b1bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.324724:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a25596b/0x3234de053c4ba15 lrc: 2/0,0 mode: PW/PW res: [0x2b1bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.324773:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+828:39030:x1731745946268992:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1654us (1721us total) trans 12885078181 rc 0/0 00000100:00100000:1.0:1651529333.324775:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208235 00000100:00100000:1.0:1651529333.324824:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.324859:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.324868:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.324945:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394371648 00010000:00010000:1.0:1651529333.324950:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ea8e6dc3/0x3234de053c44060 lrc: 5/0,0 mode: PR/PR res: [0x2b1bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a46c4 expref: 552 pid: 72395 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.324961:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394371712 00010000:00010000:1.0:1651529333.324963:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bdbb0967/0x3234de053c45a37 lrc: 4/0,0 mode: PR/PR res: [0x2b1c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aaf7e expref: 553 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.324968:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10909 00000100:00100000:1.0:1651529333.324970:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040f63b09 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+554:41278:x1731746394371648:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.324973:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.324974:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ea8e6dc3/0x3234de053c44060 lrc: 5/0,0 mode: PR/PR res: [0x2b1bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a46c4 expref: 554 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.324978:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ea8e6dc3/0x3234de053c44060 lrc: 4/0,0 mode: PR/PR res: [0x2b1bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a46c4 expref: 554 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.324984:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.324984:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.324985:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4ba38 lrc: 3/0,1 mode: PW/PW res: [0x2b1bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.324988:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4ba38 lrc: 4/0,1 mode: PW/PW res: [0x2b1bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.324993:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.325002:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040f63b09 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+554:41278:x1731746394371648:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 31us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.325004:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10909 00000100:00100000:1.0:1651529333.325013:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10911 00000100:00100000:1.0:1651529333.325015:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+552:41279:x1731746394371776:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.325017:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.325019:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000797bf7f3/0x3234de053c46cdd lrc: 4/0,0 mode: PR/PR res: [0x2b1c1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afdd5 expref: 552 pid: 80277 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.325023:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000797bf7f3/0x3234de053c46cdd lrc: 3/0,0 mode: PR/PR res: [0x2b1c1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afdd5 expref: 552 pid: 80277 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.325027:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000797bf7f3/0x3234de053c46cdd lrc: 0/0,0 mode: --/PR res: [0x2b1c1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afdd5 expref: 552 pid: 80277 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.325031:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.325031:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.325032:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c4ba3f lrc: 3/0,1 mode: PW/PW res: [0x2b1c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.325035:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c4ba3f lrc: 4/0,1 mode: PW/PW res: [0x2b1c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.325043:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.325049:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+550:41279:x1731746394371776:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 34us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.325052:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10911 00010000:00010000:1.0:1651529333.325069:0:80278:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea8e6dc3/0x3234de053c44060 lrc: 0/0,0 mode: --/PR res: [0x2b1bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a46c4 expref: 549 pid: 72395 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.325073:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a223a622 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996914816:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.325076:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4ba38 lrc: 3/0,1 mode: PW/PW res: [0x2b1bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.325080:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4ba38 lrc: 3/0,1 mode: PW/PW res: [0x2b1bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.325083:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4ba38 lrc: 3/0,1 mode: PW/PW res: [0x2b1bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.325086:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4ba38 lrc: 3/0,1 mode: PW/PW res: [0x2b1bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.325088:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4ba38 lrc: 2/0,0 mode: PW/PW res: [0x2b1bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.325131:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+828:39030:x1731745946269440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1001us (1050us total) trans 12885078183 rc 0/0 00000100:00100000:1.0:1651529333.325134:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208240 00000100:00100000:1.0:1651529333.325500:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.325511:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.325524:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946270208 00000100:00100000:1.0:1651529333.325532:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208243 00000100:00100000:1.0:1651529333.325534:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+829:39029:x1731745946270080:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.325539:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176579 count 1 00010000:00010000:1.0:1651529333.325544:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f2d383f/0x3234de053c4ba4d lrc: 3/0,1 mode: --/PW res: [0x2b1c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.325565:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000006893f6f/0x3234de053c43acc lrc: 2/0,0 mode: PR/PR res: [0x2b1c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a30b3 expref: 548 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.325569:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.325569:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.325570:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f2d383f/0x3234de053c4ba4d lrc: 4/0,1 mode: --/PW res: [0x2b1c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.325577:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000006893f6f/0x3234de053c43acc lrc: 3/0,0 mode: PR/PR res: [0x2b1c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a30b3 expref: 548 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.325581:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000006893f6f/0x3234de053c43acc lrc: 4/0,0 mode: PR/PR res: [0x2b1c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a30b3 expref: 548 pid: 72395 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.325585:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996914944:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.325597:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 0000000071742acc going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.325619:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.325649:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.325680:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.325687:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.325693:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.325723:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.325743:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946270016 00000100:00100000:1.0:1651529333.325752:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946270272 00000100:00100000:1.0:1651529333.325755:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946270400 00000100:00100000:1.0:1651529333.325760:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208247 00000100:00100000:1.0:1651529333.325762:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+835:39029:x1731745946270016:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.325767:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176578 count 1 00010000:00010000:1.0:1651529333.325771:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4ba69 lrc: 3/0,1 mode: --/PW res: [0x2b1c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.325776:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000039cf6408/0x3234de053c4513f lrc: 2/0,0 mode: PR/PR res: [0x2b1c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8ab0 expref: 548 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.325779:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.325780:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.325781:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4ba69 lrc: 4/0,1 mode: --/PW res: [0x2b1c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.325787:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000039cf6408/0x3234de053c4513f lrc: 3/0,0 mode: PR/PR res: [0x2b1c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8ab0 expref: 548 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.325791:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000039cf6408/0x3234de053c4513f lrc: 4/0,0 mode: PR/PR res: [0x2b1c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8ab0 expref: 548 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.325795:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006647e4ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996915200:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.325812:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000004ca54b8a going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.325818:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208249 00000100:00100000:1.0:1651529333.325820:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+835:39029:x1731745946270272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.325825:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176582 count 1 00010000:00010000:1.0:1651529333.325829:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4ba77 lrc: 3/0,1 mode: --/PW res: [0x2b1c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.325835:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000011522e38/0x3234de053c45e6d lrc: 2/0,0 mode: PR/PR res: [0x2b1c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac0bf expref: 548 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.325839:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.325839:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.325840:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4ba77 lrc: 4/0,1 mode: --/PW res: [0x2b1c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.325846:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000011522e38/0x3234de053c45e6d lrc: 3/0,0 mode: PR/PR res: [0x2b1c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac0bf expref: 548 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.325849:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000011522e38/0x3234de053c45e6d lrc: 4/0,0 mode: PR/PR res: [0x2b1c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac0bf expref: 548 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.325853:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000900b179f pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996915328:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.325860:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a4eb401d going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.326278:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.326286:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.326292:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.326305:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996914944:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.326310:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009f2d383f/0x3234de053c4ba4d lrc: 3/0,1 mode: --/PW res: [0x2b1c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.326317:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394372224 00010000:00010000:1.0:1651529333.326321:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000006893f6f/0x3234de053c43acc lrc: 4/0,0 mode: PR/PR res: [0x2b1c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a30b3 expref: 549 pid: 72395 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.326340:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394372352 00010000:00010000:1.0:1651529333.326343:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000193f79f5/0x3234de053c462b8 lrc: 4/0,0 mode: PR/PR res: [0x2b1c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad1f9 expref: 550 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.326348:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10912 00000100:00100000:1.0:1651529333.326350:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+551:41278:x1731746394372224:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529333.326353:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.326354:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000006893f6f/0x3234de053c43acc lrc: 4/0,0 mode: PR/PR res: [0x2b1c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a30b3 expref: 551 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.326358:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000006893f6f/0x3234de053c43acc lrc: 3/0,0 mode: PR/PR res: [0x2b1c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a30b3 expref: 551 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.326364:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006893f6f/0x3234de053c43acc lrc: 0/0,0 mode: --/PR res: [0x2b1c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a30b3 expref: 551 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.326368:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.326368:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.326369:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009f2d383f/0x3234de053c4ba4d lrc: 3/0,1 mode: PW/PW res: [0x2b1c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.326372:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f2d383f/0x3234de053c4ba4d lrc: 4/0,1 mode: PW/PW res: [0x2b1c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.326378:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.326387:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+549:41278:x1731746394372224:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.326389:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10912 00000100:00100000:1.0:1651529333.326394:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10914 00000100:00100000:1.0:1651529333.326396:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+548:41279:x1731746394372416:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529333.326398:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.326400:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a9dab47c/0x3234de053c43c46 lrc: 4/0,0 mode: PR/PR res: [0x2b1c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a36be expref: 548 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.326403:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a9dab47c/0x3234de053c43c46 lrc: 3/0,0 mode: PR/PR res: [0x2b1c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a36be expref: 547 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.326408:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9dab47c/0x3234de053c43c46 lrc: 0/0,0 mode: --/PR res: [0x2b1c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a36be expref: 547 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.326411:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.326412:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.326413:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007c5115ca/0x3234de053c4ba5b lrc: 3/0,1 mode: PW/PW res: [0x2b1c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.326415:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c5115ca/0x3234de053c4ba5b lrc: 4/0,1 mode: PW/PW res: [0x2b1c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.326428:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.326434:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+546:41279:x1731746394372416:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.326437:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10914 00010000:00010000:1.0:1651529333.326446:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c4ba54 lrc: 2/0,0 mode: PW/PW res: [0x2b1c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.326449:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000587473f4 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.326450:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c4ba54 lrc: 2/0,0 mode: PW/PW res: [0x2b1c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.326453:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c4ba54 lrc: 3/0,0 mode: PW/PW res: [0x2b1c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.326457:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c4ba54 lrc: 1/0,0 mode: --/PW res: [0x2b1c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.326460:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c4ba54 lrc: 0/0,0 mode: --/PW res: [0x2b1c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.326465:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009f2d383f/0x3234de053c4ba4d lrc: 3/0,1 mode: PW/PW res: [0x2b1c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.326468:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f2d383f/0x3234de053c4ba4d lrc: 3/0,1 mode: PW/PW res: [0x2b1c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.326471:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f2d383f/0x3234de053c4ba4d lrc: 3/0,1 mode: PW/PW res: [0x2b1c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.326474:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f2d383f/0x3234de053c4ba4d lrc: 2/0,0 mode: PW/PW res: [0x2b1c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.326518:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+837:39029:x1731745946270080:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 984us (1018us total) trans 12885078186 rc 0/0 00000100:00100000:1.0:1651529333.326521:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208243 00000100:00100000:1.0:1651529333.326607:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006647e4ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996915200:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.326611:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4ba69 lrc: 3/0,1 mode: --/PW res: [0x2b1c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.326808:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.326819:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.326827:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.326837:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946270912 00000100:00100000:1.0:1651529333.326844:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208252 00000100:00100000:1.0:1651529333.326846:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+838:39029:x1731745946270784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.326851:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176586 count 1 00010000:00010000:1.0:1651529333.326856:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4ba8c lrc: 3/0,1 mode: --/PW res: [0x2b1ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.326860:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004f8f4e03/0x3234de053c46d0e lrc: 2/0,0 mode: PR/PR res: [0x2b1ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afedf expref: 545 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.326863:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.326864:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.326865:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4ba8c lrc: 4/0,1 mode: --/PW res: [0x2b1ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.326872:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004f8f4e03/0x3234de053c46d0e lrc: 3/0,0 mode: PR/PR res: [0x2b1ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afedf expref: 545 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.326875:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004f8f4e03/0x3234de053c46d0e lrc: 4/0,0 mode: PR/PR res: [0x2b1ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afedf expref: 545 pid: 80277 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.326880:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000716b388d pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996915520:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.326896:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 0000000071742acc going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.327019:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.327028:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.327037:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000900b179f pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996915328:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.327047:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4ba77 lrc: 3/0,1 mode: --/PW res: [0x2b1c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.327054:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394372608 00010000:00010000:1.0:1651529333.327059:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000015abf2be/0x3234de053c44a46 lrc: 4/0,0 mode: PR/PR res: [0x2b1c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7069 expref: 546 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.327065:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394372672 00010000:00010000:1.0:1651529333.327068:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000039cf6408/0x3234de053c4513f lrc: 4/0,0 mode: PR/PR res: [0x2b1c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8ab0 expref: 547 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.327077:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10915 00000100:00100000:1.0:1651529333.327079:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+547:41278:x1731746394372608:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.327082:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.327083:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000015abf2be/0x3234de053c44a46 lrc: 4/0,0 mode: PR/PR res: [0x2b1c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7069 expref: 547 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.327087:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000015abf2be/0x3234de053c44a46 lrc: 3/0,0 mode: PR/PR res: [0x2b1c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7069 expref: 547 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.327095:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015abf2be/0x3234de053c44a46 lrc: 0/0,0 mode: --/PR res: [0x2b1c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7069 expref: 547 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.327099:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.327100:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.327101:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005086bd45/0x3234de053c4ba62 lrc: 3/0,1 mode: PW/PW res: [0x2b1c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.327104:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005086bd45/0x3234de053c4ba62 lrc: 4/0,1 mode: PW/PW res: [0x2b1c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.327112:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.327125:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+545:41278:x1731746394372608:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.327128:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10915 00010000:00010000:1.0:1651529333.327135:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4ba69 lrc: 3/0,1 mode: PW/PW res: [0x2b1c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.327138:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4ba69 lrc: 3/0,1 mode: PW/PW res: [0x2b1c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.327141:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4ba69 lrc: 3/0,1 mode: PW/PW res: [0x2b1c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.327144:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4ba69 lrc: 2/0,0 mode: PW/PW res: [0x2b1c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.327185:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+840:39029:x1731745946270016:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1422us (1505us total) trans 12885078188 rc 0/0 00000100:00100000:1.0:1651529333.327188:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208247 00010000:00010000:1.0:1651529333.327195:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4ba69 lrc: 2/0,0 mode: PW/PW res: [0x2b1c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.327198:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000041e6f70f already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.327200:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4ba69 lrc: 2/0,0 mode: PW/PW res: [0x2b1c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.327203:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4ba69 lrc: 3/0,0 mode: PW/PW res: [0x2b1c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.327207:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4ba69 lrc: 1/0,0 mode: --/PW res: [0x2b1c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.327210:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4ba69 lrc: 0/0,0 mode: --/PW res: [0x2b1c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.327259:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.327272:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.327287:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.327321:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.327353:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10918 00000100:00100000:1.0:1651529333.327356:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+545:41279:x1731746394372928:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.327366:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.327368:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000011522e38/0x3234de053c45e6d lrc: 4/0,0 mode: PR/PR res: [0x2b1c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac0bf expref: 544 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.327372:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000011522e38/0x3234de053c45e6d lrc: 3/0,0 mode: PR/PR res: [0x2b1c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac0bf expref: 544 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.327378:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011522e38/0x3234de053c45e6d lrc: 0/0,0 mode: --/PR res: [0x2b1c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac0bf expref: 544 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.327382:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.327382:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.327383:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4ba77 lrc: 3/0,1 mode: PW/PW res: [0x2b1c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.327386:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4ba77 lrc: 4/0,1 mode: PW/PW res: [0x2b1c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.327393:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.327400:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+543:41279:x1731746394372928:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 44us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.327402:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10918 00010000:00010000:1.0:1651529333.327409:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4ba77 lrc: 3/0,1 mode: PW/PW res: [0x2b1c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.327412:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4ba77 lrc: 3/0,1 mode: PW/PW res: [0x2b1c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.327418:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4ba77 lrc: 3/0,1 mode: PW/PW res: [0x2b1c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.327421:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4ba77 lrc: 2/0,0 mode: PW/PW res: [0x2b1c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.327463:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+839:39029:x1731745946270272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1642us (1769us total) trans 12885078190 rc 0/0 00000100:00100000:1.0:1651529333.327466:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208249 00000100:00100000:1.0:1651529333.327471:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394373312 00000100:00100000:1.0:1651529333.327478:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 208254 00000100:00100000:1.0:1651529333.327480:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+541:41279:x1731746394373312:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529333.327483:0:72397:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529333.327487:0:72397:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ab96373/0x3234de053c4ba9a lrc: 2/0,0 mode: --/PR res: [0x2b72f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2cc4f8 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529333.327492:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b72f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529333.327496:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.327497:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.327498:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ab96373/0x3234de053c4ba9a lrc: 3/0,0 mode: PR/PR res: [0x2b72f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc4f8 expref: 542 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.327544:0:72397:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001ab96373/0x3234de053c4ba9a lrc: 3/0,0 mode: PR/PR res: [0x2b72f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc4f8 expref: 542 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.327548:0:72397:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001ab96373, rc 0) 00000100:00100000:1.0:1651529333.327558:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+542:41279:x1731746394373312:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 77us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.327560:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 208254 00010000:00010000:1.0:1651529333.327568:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009be39b1e/0x3234de053c4ba70 lrc: 2/0,0 mode: PW/PW res: [0x2b1c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.327572:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009be39b1e already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.327573:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009be39b1e/0x3234de053c4ba70 lrc: 2/0,0 mode: PW/PW res: [0x2b1c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.327576:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009be39b1e/0x3234de053c4ba70 lrc: 3/0,0 mode: PW/PW res: [0x2b1c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.327580:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009be39b1e/0x3234de053c4ba70 lrc: 1/0,0 mode: --/PW res: [0x2b1c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.327583:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009be39b1e/0x3234de053c4ba70 lrc: 0/0,0 mode: --/PW res: [0x2b1c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.327587:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058d7a733/0x3234de053c4ba7e lrc: 3/0,0 mode: PW/PW res: [0x2b1c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.327590:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000058d7a733 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.327590:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058d7a733/0x3234de053c4ba7e lrc: 2/0,0 mode: PW/PW res: [0x2b1c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.327593:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058d7a733/0x3234de053c4ba7e lrc: 3/0,0 mode: PW/PW res: [0x2b1c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.327599:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058d7a733/0x3234de053c4ba7e lrc: 1/0,0 mode: --/PW res: [0x2b1c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.327602:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058d7a733/0x3234de053c4ba7e lrc: 0/0,0 mode: --/PW res: [0x2b1c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.327668:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.327694:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.327742:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.327772:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.327802:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.327818:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394373568 00010000:00010000:1.0:1651529333.327824:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004f8f4e03/0x3234de053c46d0e lrc: 5/0,0 mode: PR/PR res: [0x2b1ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afedf expref: 542 pid: 80277 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.327831:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394373632 00010000:00010000:1.0:1651529333.327833:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000d3e966a/0x3234de053c45751 lrc: 5/0,0 mode: PR/PR res: [0x2b1cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa376 expref: 543 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.327837:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394373696 00010000:00010000:1.0:1651529333.327839:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d1644b4c/0x3234de053c46dc4 lrc: 4/0,0 mode: PR/PR res: [0x2b1cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2b02c8 expref: 544 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.327844:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10920 00000100:00100000:1.0:1651529333.327846:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+544:41279:x1731746394373568:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.327848:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.327850:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004f8f4e03/0x3234de053c46d0e lrc: 5/0,0 mode: PR/PR res: [0x2b1ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afedf expref: 544 pid: 80277 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.327859:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004f8f4e03/0x3234de053c46d0e lrc: 4/0,0 mode: PR/PR res: [0x2b1ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afedf expref: 544 pid: 80277 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.327865:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.327866:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.327867:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4ba8c lrc: 3/0,1 mode: PW/PW res: [0x2b1ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.327870:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4ba8c lrc: 4/0,1 mode: PW/PW res: [0x2b1ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.327875:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.327881:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+544:41279:x1731746394373568:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 35us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.327884:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10920 00000100:00100000:1.0:1651529333.327888:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10922 00000100:00100000:1.0:1651529333.327890:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+543:41278:x1731746394373696:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.327893:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.327894:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d1644b4c/0x3234de053c46dc4 lrc: 4/0,0 mode: PR/PR res: [0x2b1cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2b02c8 expref: 543 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.327897:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d1644b4c/0x3234de053c46dc4 lrc: 3/0,0 mode: PR/PR res: [0x2b1cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2b02c8 expref: 542 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.327902:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1644b4c/0x3234de053c46dc4 lrc: 0/0,0 mode: --/PR res: [0x2b1cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2b02c8 expref: 542 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.327906:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.327906:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.327907:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000067a5ac39/0x3234de053c4ba93 lrc: 3/0,1 mode: PW/PW res: [0x2b1cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.327910:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067a5ac39/0x3234de053c4ba93 lrc: 4/0,1 mode: PW/PW res: [0x2b1cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.327919:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.327925:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+540:41278:x1731746394373696:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 34us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.327928:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10922 00010000:00010000:1.0:1651529333.327939:0:80278:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f8f4e03/0x3234de053c46d0e lrc: 0/0,0 mode: --/PR res: [0x2b1ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afedf expref: 539 pid: 80277 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.327943:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000716b388d pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996915520:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.327946:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4ba8c lrc: 3/0,1 mode: PW/PW res: [0x2b1ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.327950:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4ba8c lrc: 3/0,1 mode: PW/PW res: [0x2b1ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.327952:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4ba8c lrc: 3/0,1 mode: PW/PW res: [0x2b1ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.327955:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4ba8c lrc: 3/0,1 mode: PW/PW res: [0x2b1ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.327959:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4ba8c lrc: 2/0,0 mode: PW/PW res: [0x2b1ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.327998:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+841:39029:x1731745946270784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1151us (1179us total) trans 12885078194 rc 0/0 00000100:00100000:1.0:1651529333.328001:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208252 00000100:00100000:1.0:1651529333.328106:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.328145:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.328154:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.328160:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.328175:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946271552 00000100:00100000:1.0:1651529333.328182:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946271488 00000100:00100000:1.0:1651529333.328188:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208258 00000100:00100000:1.0:1651529333.328190:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ccd14f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+843:39030:x1731745946271552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.328195:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176593 count 1 00010000:00010000:1.0:1651529333.328206:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002310563/0x3234de053c4bab6 lrc: 3/0,1 mode: --/PW res: [0x2b1d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.328211:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004ad0fa64/0x3234de053c46589 lrc: 2/0,0 mode: PR/PR res: [0x2b1d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2addbb expref: 538 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.328214:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.328215:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.328216:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002310563/0x3234de053c4bab6 lrc: 4/0,1 mode: --/PW res: [0x2b1d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.328242:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004ad0fa64/0x3234de053c46589 lrc: 3/0,0 mode: PR/PR res: [0x2b1d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2addbb expref: 538 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.328246:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004ad0fa64/0x3234de053c46589 lrc: 4/0,0 mode: PR/PR res: [0x2b1d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2addbb expref: 538 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.328251:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd68fdd5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996915840:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.328260:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd96f074 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.328296:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394373952 00010000:00010000:1.0:1651529333.328301:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c44377 lrc: 5/0,0 mode: PR/PR res: [0x2b1ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a53d6 expref: 539 pid: 72395 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.328308:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10923 00000100:00100000:1.0:1651529333.328310:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8f0043c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+539:41278:x1731746394373952:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.328312:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.328314:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c44377 lrc: 5/0,0 mode: PR/PR res: [0x2b1ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a53d6 expref: 539 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.328317:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c44377 lrc: 4/0,0 mode: PR/PR res: [0x2b1ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a53d6 expref: 539 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.328323:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.328323:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.328324:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008147181f/0x3234de053c4baa1 lrc: 3/0,1 mode: PW/PW res: [0x2b1ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.328327:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008147181f/0x3234de053c4baa1 lrc: 4/0,1 mode: PW/PW res: [0x2b1ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.328335:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.328341:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8f0043c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+539:41278:x1731746394373952:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 30us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.328343:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10923 00000100:00100000:1.0:1651529333.328362:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.328383:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.328398:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.328454:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208261 00000100:00100000:1.0:1651529333.328456:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+846:39030:x1731745946271744:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.328461:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176595 count 1 00010000:00010000:1.0:1651529333.328466:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000376045ea/0x3234de053c4bacb lrc: 3/0,1 mode: --/PW res: [0x2b1d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.328470:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e0c2c8e0/0x3234de053c444a4 lrc: 2/0,0 mode: PR/PR res: [0x2b1d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5932 expref: 537 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.328473:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.328474:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.328475:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000376045ea/0x3234de053c4bacb lrc: 4/0,1 mode: --/PW res: [0x2b1d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.328481:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e0c2c8e0/0x3234de053c444a4 lrc: 3/0,0 mode: PR/PR res: [0x2b1d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5932 expref: 537 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.328491:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e0c2c8e0/0x3234de053c444a4 lrc: 4/0,0 mode: PR/PR res: [0x2b1d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5932 expref: 537 pid: 72395 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.328499:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d9cfef26 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996915968:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.328508:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c3caa148 going to sleep for 6 seconds 00010000:00010000:1.0:1651529333.328512:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008147181f/0x3234de053c4baa1 lrc: 2/0,0 mode: PW/PW res: [0x2b1ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.328516:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008147181f already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.328517:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008147181f/0x3234de053c4baa1 lrc: 2/0,0 mode: PW/PW res: [0x2b1ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.328520:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008147181f/0x3234de053c4baa1 lrc: 3/0,0 mode: PW/PW res: [0x2b1ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.328524:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008147181f/0x3234de053c4baa1 lrc: 1/0,0 mode: --/PW res: [0x2b1ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.328527:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008147181f/0x3234de053c4baa1 lrc: 0/0,0 mode: --/PW res: [0x2b1ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.328534:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208262 00000100:00100000:1.0:1651529333.328536:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+846:39029:x1731745946271936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.328540:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176596 count 1 00010000:00010000:1.0:1651529333.328544:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4bad2 lrc: 3/0,1 mode: --/PW res: [0x2b1d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.328548:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000aa989262/0x3234de053c44fbe lrc: 2/0,0 mode: PR/PR res: [0x2b1d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8466 expref: 537 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.328551:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.328552:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.328553:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4bad2 lrc: 4/0,1 mode: --/PW res: [0x2b1d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.328559:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000aa989262/0x3234de053c44fbe lrc: 3/0,0 mode: PR/PR res: [0x2b1d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8466 expref: 537 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.328562:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000aa989262/0x3234de053c44fbe lrc: 4/0,0 mode: PR/PR res: [0x2b1d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8466 expref: 537 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.328566:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a138afb6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996916096:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.328573:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000412e5d26 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.328603:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.328625:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.328662:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946272000 00000100:00100000:1.0:1651529333.328673:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208263 00000100:00100000:1.0:1651529333.328675:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+847:39029:x1731745946272000:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.328680:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176597 count 1 00010000:00010000:1.0:1651529333.328684:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a25596b/0x3234de053c4bad9 lrc: 3/0,1 mode: --/PW res: [0x2b1d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.328689:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e0e6728c/0x3234de053c437a7 lrc: 2/0,0 mode: PR/PR res: [0x2b1d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a24b9 expref: 537 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.328692:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.328693:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.328693:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a25596b/0x3234de053c4bad9 lrc: 4/0,1 mode: --/PW res: [0x2b1d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.328700:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e0e6728c/0x3234de053c437a7 lrc: 3/0,0 mode: PR/PR res: [0x2b1d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a24b9 expref: 537 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.328704:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e0e6728c/0x3234de053c437a7 lrc: 4/0,0 mode: PR/PR res: [0x2b1d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a24b9 expref: 537 pid: 80277 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.328708:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005912c4a3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996916160:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.328718:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 0000000053a0cffa going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.328723:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394374016 00010000:00010000:1.0:1651529333.328727:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c4438c lrc: 4/0,0 mode: PR/PR res: [0x2b1cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a543f expref: 538 pid: 72395 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.328744:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10924 00000100:00100000:1.0:1651529333.328745:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+538:41279:x1731746394374016:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.328748:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.328749:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c4438c lrc: 4/0,0 mode: PR/PR res: [0x2b1cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a543f expref: 538 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.328753:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c4438c lrc: 3/0,0 mode: PR/PR res: [0x2b1cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a543f expref: 538 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.328759:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c4438c lrc: 0/0,0 mode: --/PR res: [0x2b1cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a543f expref: 538 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.328765:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.328765:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.328766:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4baa8 lrc: 3/0,1 mode: PW/PW res: [0x2b1cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.328769:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4baa8 lrc: 4/0,1 mode: PW/PW res: [0x2b1cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.328778:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.328784:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+537:41279:x1731746394374016:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 38us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.328787:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10924 00000100:00100000:1.0:1651529333.328956:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.328972:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.328982:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.328990:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.328999:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd68fdd5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996915840:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.329004:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000002310563/0x3234de053c4bab6 lrc: 3/0,1 mode: --/PW res: [0x2b1d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.329011:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394374464 00010000:00010000:1.0:1651529333.329015:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000656a2f5f/0x3234de053c45be9 lrc: 4/0,0 mode: PR/PR res: [0x2b1d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab693 expref: 537 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.329025:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394374400 00010000:00010000:1.0:1651529333.329027:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c44d25 lrc: 4/0,0 mode: PR/PR res: [0x2b1cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7b52 expref: 538 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.329032:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394374528 00010000:00010000:1.0:1651529333.329034:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004ad0fa64/0x3234de053c46589 lrc: 4/0,0 mode: PR/PR res: [0x2b1d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2addbb expref: 539 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.329038:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10925 00000100:00100000:1.0:1651529333.329040:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+539:41278:x1731746394374464:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.329043:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.329044:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000656a2f5f/0x3234de053c45be9 lrc: 4/0,0 mode: PR/PR res: [0x2b1d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab693 expref: 539 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.329048:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000656a2f5f/0x3234de053c45be9 lrc: 3/0,0 mode: PR/PR res: [0x2b1d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab693 expref: 539 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.329059:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000656a2f5f/0x3234de053c45be9 lrc: 0/0,0 mode: --/PR res: [0x2b1d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab693 expref: 539 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.329063:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.329064:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.329065:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000028ae306d/0x3234de053c4babd lrc: 3/0,1 mode: PW/PW res: [0x2b1d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.329068:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028ae306d/0x3234de053c4babd lrc: 4/0,1 mode: PW/PW res: [0x2b1d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.329076:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.329083:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+538:41278:x1731746394374464:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 43us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.329086:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10925 00000100:00100000:1.0:1651529333.329091:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10927 00000100:00100000:1.0:1651529333.329093:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+536:41279:x1731746394374528:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.329095:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.329097:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004ad0fa64/0x3234de053c46589 lrc: 4/0,0 mode: PR/PR res: [0x2b1d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2addbb expref: 536 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.329101:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004ad0fa64/0x3234de053c46589 lrc: 3/0,0 mode: PR/PR res: [0x2b1d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2addbb expref: 536 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.329105:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ad0fa64/0x3234de053c46589 lrc: 0/0,0 mode: --/PR res: [0x2b1d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2addbb expref: 536 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.329109:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.329109:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.329110:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000002310563/0x3234de053c4bab6 lrc: 3/0,1 mode: PW/PW res: [0x2b1d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.329113:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002310563/0x3234de053c4bab6 lrc: 4/0,1 mode: PW/PW res: [0x2b1d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.329119:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.329124:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+534:41279:x1731746394374528:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 30us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.329126:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10927 00010000:00010000:1.0:1651529333.329133:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000002310563/0x3234de053c4bab6 lrc: 3/0,1 mode: PW/PW res: [0x2b1d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.329136:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002310563/0x3234de053c4bab6 lrc: 3/0,1 mode: PW/PW res: [0x2b1d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.329139:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002310563/0x3234de053c4bab6 lrc: 3/0,1 mode: PW/PW res: [0x2b1d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.329142:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002310563/0x3234de053c4bab6 lrc: 2/0,0 mode: PW/PW res: [0x2b1d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.329183:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ccd14f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+849:39030:x1731745946271552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 992us (1037us total) trans 12885078199 rc 0/0 00000100:00100000:1.0:1651529333.329186:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208258 00000100:00100000:1.0:1651529333.329352:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.329405:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.329415:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946272320 00000100:00100000:1.0:1651529333.329424:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208266 00000100:00100000:1.0:1651529333.329425:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+850:39029:x1731745946272320:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.329431:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176600 count 1 00010000:00010000:1.0:1651529333.329436:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4baee lrc: 3/0,1 mode: --/PW res: [0x2b1d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.329440:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006d7fa65b/0x3234de053c45ad8 lrc: 2/0,0 mode: PR/PR res: [0x2b1d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab1f4 expref: 533 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.329444:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.329444:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.329445:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4baee lrc: 4/0,1 mode: --/PW res: [0x2b1d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.329452:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006d7fa65b/0x3234de053c45ad8 lrc: 3/0,0 mode: PR/PR res: [0x2b1d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab1f4 expref: 533 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.329456:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006d7fa65b/0x3234de053c45ad8 lrc: 4/0,0 mode: PR/PR res: [0x2b1d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab1f4 expref: 533 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.329471:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cee35a0c pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996916352:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.329481:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f79d8146 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.329493:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.329572:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.329583:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.329613:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.329628:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d9cfef26 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996915968:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.329632:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000376045ea/0x3234de053c4bacb lrc: 3/0,1 mode: --/PW res: [0x2b1d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.329639:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a138afb6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996916096:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.329641:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4bad2 lrc: 3/0,1 mode: --/PW res: [0x2b1d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.329647:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394374656 00010000:00010000:1.0:1651529333.329652:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e0c2c8e0/0x3234de053c444a4 lrc: 4/0,0 mode: PR/PR res: [0x2b1d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5932 expref: 534 pid: 72395 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.329665:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394374848 00010000:00010000:1.0:1651529333.329668:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000789a23a9/0x3234de053c44a07 lrc: 4/0,0 mode: PR/PR res: [0x2b1d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6f90 expref: 535 pid: 72395 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.329673:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10928 00000100:00100000:1.0:1651529333.329675:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+536:41279:x1731746394374656:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.329678:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.329679:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e0c2c8e0/0x3234de053c444a4 lrc: 4/0,0 mode: PR/PR res: [0x2b1d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5932 expref: 536 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.329683:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e0c2c8e0/0x3234de053c444a4 lrc: 3/0,0 mode: PR/PR res: [0x2b1d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5932 expref: 536 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.329689:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0c2c8e0/0x3234de053c444a4 lrc: 0/0,0 mode: --/PR res: [0x2b1d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5932 expref: 536 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.329692:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.329693:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.329694:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000376045ea/0x3234de053c4bacb lrc: 3/0,1 mode: PW/PW res: [0x2b1d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.329697:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000376045ea/0x3234de053c4bacb lrc: 4/0,1 mode: PW/PW res: [0x2b1d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.329703:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.329712:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+534:41279:x1731746394374656:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.329715:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10928 00000100:00100000:1.0:1651529333.329719:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10930 00000100:00100000:1.0:1651529333.329721:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000496e37f3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+533:41279:x1731746394374976:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.329723:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.329724:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000aa989262/0x3234de053c44fbe lrc: 4/0,0 mode: PR/PR res: [0x2b1d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8466 expref: 532 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.329739:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000aa989262/0x3234de053c44fbe lrc: 3/0,0 mode: PR/PR res: [0x2b1d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8466 expref: 532 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.329744:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa989262/0x3234de053c44fbe lrc: 0/0,0 mode: --/PR res: [0x2b1d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8466 expref: 532 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.329748:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.329748:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.329749:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4bad2 lrc: 3/0,1 mode: PW/PW res: [0x2b1d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.329752:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4bad2 lrc: 4/0,1 mode: PW/PW res: [0x2b1d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.329764:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.329771:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000496e37f3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+531:41279:x1731746394374976:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 49us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.329773:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10930 00000100:00100000:1.0:1651529333.329788:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005912c4a3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996916160:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.329791:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007a25596b/0x3234de053c4bad9 lrc: 3/0,1 mode: --/PW res: [0x2b1d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.329797:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004496a02d/0x3234de053c4bac4 lrc: 2/0,0 mode: PW/PW res: [0x2b1d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.329800:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004496a02d already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.329801:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004496a02d/0x3234de053c4bac4 lrc: 2/0,0 mode: PW/PW res: [0x2b1d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.329804:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004496a02d/0x3234de053c4bac4 lrc: 3/0,0 mode: PW/PW res: [0x2b1d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.329808:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004496a02d/0x3234de053c4bac4 lrc: 1/0,0 mode: --/PW res: [0x2b1d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.329811:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004496a02d/0x3234de053c4bac4 lrc: 0/0,0 mode: --/PW res: [0x2b1d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.329816:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4bad2 lrc: 3/0,1 mode: PW/PW res: [0x2b1d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.329819:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4bad2 lrc: 3/0,1 mode: PW/PW res: [0x2b1d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.329822:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4bad2 lrc: 3/0,1 mode: PW/PW res: [0x2b1d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.329827:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4bad2 lrc: 2/0,0 mode: PW/PW res: [0x2b1d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.329874:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+852:39029:x1731745946271936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1338us (1476us total) trans 12885078202 rc 0/0 00000100:00100000:1.0:1651529333.329878:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208262 00010000:00010000:1.0:1651529333.329885:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000376045ea/0x3234de053c4bacb lrc: 3/0,1 mode: PW/PW res: [0x2b1d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.329888:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000376045ea/0x3234de053c4bacb lrc: 3/0,1 mode: PW/PW res: [0x2b1d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.329892:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000376045ea/0x3234de053c4bacb lrc: 3/0,1 mode: PW/PW res: [0x2b1d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.329894:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000376045ea/0x3234de053c4bacb lrc: 2/0,0 mode: PW/PW res: [0x2b1d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.329931:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+852:39030:x1731745946271744:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1475us (1555us total) trans 12885078203 rc 0/0 00000100:00100000:1.0:1651529333.329934:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208261 00000100:00100000:1.0:1651529333.329979:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.329990:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.330044:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394375168 00010000:00010000:1.0:1651529333.330050:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e6728c/0x3234de053c437a7 lrc: 4/0,0 mode: PR/PR res: [0x2b1d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a24b9 expref: 531 pid: 80277 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.330060:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394375296 00010000:00010000:1.0:1651529333.330062:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004813cce2/0x3234de053c4388e lrc: 4/0,0 mode: PR/PR res: [0x2b1d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a27a6 expref: 532 pid: 80278 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.330072:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10931 00000100:00100000:1.0:1651529333.330073:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+532:41278:x1731746394375168:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.330076:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.330078:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e0e6728c/0x3234de053c437a7 lrc: 4/0,0 mode: PR/PR res: [0x2b1d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a24b9 expref: 532 pid: 80277 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.330082:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e0e6728c/0x3234de053c437a7 lrc: 3/0,0 mode: PR/PR res: [0x2b1d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a24b9 expref: 532 pid: 80277 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.330087:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0e6728c/0x3234de053c437a7 lrc: 0/0,0 mode: --/PR res: [0x2b1d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a24b9 expref: 532 pid: 80277 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.330091:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.330091:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.330092:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007a25596b/0x3234de053c4bad9 lrc: 3/0,1 mode: PW/PW res: [0x2b1d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.330095:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a25596b/0x3234de053c4bad9 lrc: 4/0,1 mode: PW/PW res: [0x2b1d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.330101:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.330109:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+530:41278:x1731746394375168:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.330112:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10931 00010000:00010000:1.0:1651529333.330117:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007a25596b/0x3234de053c4bad9 lrc: 3/0,1 mode: PW/PW res: [0x2b1d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.330120:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a25596b/0x3234de053c4bad9 lrc: 3/0,1 mode: PW/PW res: [0x2b1d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.330123:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a25596b/0x3234de053c4bad9 lrc: 3/0,1 mode: PW/PW res: [0x2b1d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.330126:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a25596b/0x3234de053c4bad9 lrc: 2/0,0 mode: PW/PW res: [0x2b1d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.330163:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+852:39029:x1731745946272000:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1487us (1560us total) trans 12885078204 rc 0/0 00000100:00100000:1.0:1651529333.330165:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208263 00010000:00010000:1.0:1651529333.330172:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a25596b/0x3234de053c4bad9 lrc: 2/0,0 mode: PW/PW res: [0x2b1d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.330175:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a25596b already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.330176:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a25596b/0x3234de053c4bad9 lrc: 2/0,0 mode: PW/PW res: [0x2b1d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.330179:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a25596b/0x3234de053c4bad9 lrc: 3/0,0 mode: PW/PW res: [0x2b1d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.330183:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a25596b/0x3234de053c4bad9 lrc: 1/0,0 mode: --/PW res: [0x2b1d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.330186:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a25596b/0x3234de053c4bad9 lrc: 0/0,0 mode: --/PW res: [0x2b1d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.330191:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f423b01c/0x3234de053c4bae0 lrc: 2/0,0 mode: PW/PW res: [0x2b1d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.330193:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f423b01c already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.330194:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f423b01c/0x3234de053c4bae0 lrc: 2/0,0 mode: PW/PW res: [0x2b1d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.330197:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f423b01c/0x3234de053c4bae0 lrc: 3/0,0 mode: PW/PW res: [0x2b1d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.330200:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f423b01c/0x3234de053c4bae0 lrc: 1/0,0 mode: --/PW res: [0x2b1d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.330203:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f423b01c/0x3234de053c4bae0 lrc: 0/0,0 mode: --/PW res: [0x2b1d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.330254:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.330302:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.330357:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.330387:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.330396:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.330402:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.330413:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208270 00000100:00100000:1.0:1651529333.330415:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+854:39030:x1731745946272704:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.330422:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176604 count 1 00010000:00010000:1.0:1651529333.330426:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4bb0a lrc: 3/0,1 mode: --/PW res: [0x2b1dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.330431:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c443b6 lrc: 2/0,0 mode: PR/PR res: [0x2b1dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5511 expref: 528 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.330440:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.330441:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.330442:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4bb0a lrc: 4/0,1 mode: --/PW res: [0x2b1dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.330449:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c443b6 lrc: 3/0,0 mode: PR/PR res: [0x2b1dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5511 expref: 528 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.330452:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c443b6 lrc: 4/0,0 mode: PR/PR res: [0x2b1dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5511 expref: 528 pid: 72395 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.330457:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000900b179f pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996916608:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.330465:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 0000000018ebe812 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.330472:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cee35a0c pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996916352:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.330476:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4baee lrc: 3/0,1 mode: --/PW res: [0x2b1d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.330491:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394375744 00010000:00010000:1.0:1651529333.330496:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005b93642a/0x3234de053c4424a lrc: 4/0,0 mode: PR/PR res: [0x2b1d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4fd1 expref: 530 pid: 72395 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.330504:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10933 00000100:00100000:1.0:1651529333.330506:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+531:41278:x1731746394375680:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529333.330509:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.330510:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006d7fa65b/0x3234de053c45ad8 lrc: 4/0,0 mode: PR/PR res: [0x2b1d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab1f4 expref: 531 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.330514:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006d7fa65b/0x3234de053c45ad8 lrc: 3/0,0 mode: PR/PR res: [0x2b1d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab1f4 expref: 531 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.330519:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d7fa65b/0x3234de053c45ad8 lrc: 0/0,0 mode: --/PR res: [0x2b1d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab1f4 expref: 531 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.330522:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.330523:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.330524:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4baee lrc: 3/0,1 mode: PW/PW res: [0x2b1d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.330527:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4baee lrc: 4/0,1 mode: PW/PW res: [0x2b1d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.330533:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.330539:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+529:41278:x1731746394375680:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.330542:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10933 00000100:00100000:1.0:1651529333.330546:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10935 00000100:00100000:1.0:1651529333.330548:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+528:41279:x1731746394375616:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.330550:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.330552:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000042765ffe/0x3234de053c45c8a lrc: 4/0,0 mode: PR/PR res: [0x2b1d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab917 expref: 528 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.330556:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000042765ffe/0x3234de053c45c8a lrc: 3/0,0 mode: PR/PR res: [0x2b1d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab917 expref: 528 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.330560:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042765ffe/0x3234de053c45c8a lrc: 0/0,0 mode: --/PR res: [0x2b1d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab917 expref: 527 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.330563:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.330564:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.330564:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4bae7 lrc: 3/0,1 mode: PW/PW res: [0x2b1d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.330567:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4bae7 lrc: 4/0,1 mode: PW/PW res: [0x2b1d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.330577:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.330583:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+526:41279:x1731746394375616:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 34us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.330586:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10935 00010000:00010000:1.0:1651529333.330593:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4baee lrc: 3/0,1 mode: PW/PW res: [0x2b1d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.330596:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4baee lrc: 3/0,1 mode: PW/PW res: [0x2b1d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.330602:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4baee lrc: 3/0,1 mode: PW/PW res: [0x2b1d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.330605:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4baee lrc: 2/0,0 mode: PW/PW res: [0x2b1d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.330645:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+855:39029:x1731745946272320:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1218us (1240us total) trans 12885078207 rc 0/0 00000100:00100000:1.0:1651529333.330647:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208266 00000100:00100000:1.0:1651529333.330663:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.330692:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.330794:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208272 00000100:00100000:1.0:1651529333.330796:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+856:39030:x1731745946272768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.330802:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176605 count 1 00010000:00010000:1.0:1651529333.330812:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000158a383a/0x3234de053c4bb18 lrc: 3/0,1 mode: --/PW res: [0x2b1dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.330817:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9d052e8/0x3234de053c43879 lrc: 2/0,0 mode: PR/PR res: [0x2b1dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2744 expref: 525 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.330820:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.330821:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.330821:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000158a383a/0x3234de053c4bb18 lrc: 4/0,1 mode: --/PW res: [0x2b1dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.330829:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e9d052e8/0x3234de053c43879 lrc: 3/0,0 mode: PR/PR res: [0x2b1dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2744 expref: 525 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.330833:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e9d052e8/0x3234de053c43879 lrc: 4/0,0 mode: PR/PR res: [0x2b1dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2744 expref: 525 pid: 80277 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.330837:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cee35a0c pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996916736:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.330845:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000071742acc going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.330975:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.330982:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394376064 00010000:00010000:1.0:1651529333.330988:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b82195df/0x3234de053c44cc3 lrc: 4/0,0 mode: PR/PR res: [0x2b1db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a79ae expref: 526 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.331003:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10936 00000100:00100000:1.0:1651529333.331005:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+526:41279:x1731746394376064:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.331012:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.331014:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b82195df/0x3234de053c44cc3 lrc: 4/0,0 mode: PR/PR res: [0x2b1db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a79ae expref: 526 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.331018:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b82195df/0x3234de053c44cc3 lrc: 3/0,0 mode: PR/PR res: [0x2b1db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a79ae expref: 526 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.331024:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b82195df/0x3234de053c44cc3 lrc: 0/0,0 mode: --/PR res: [0x2b1db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a79ae expref: 526 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.331027:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.331028:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.331029:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000008d96b78/0x3234de053c4bafc lrc: 3/0,1 mode: PW/PW res: [0x2b1db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.331032:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008d96b78/0x3234de053c4bafc lrc: 4/0,1 mode: PW/PW res: [0x2b1db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.331042:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.331049:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+525:41279:x1731746394376064:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 43us (75us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.331051:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10936 00000100:00100000:1.0:1651529333.331090:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.331155:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.331175:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529333.331204:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008d96b78/0x3234de053c4bafc lrc: 2/0,0 mode: PW/PW res: [0x2b1db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.331208:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000008d96b78 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.331209:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008d96b78/0x3234de053c4bafc lrc: 2/0,0 mode: PW/PW res: [0x2b1db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.331213:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008d96b78/0x3234de053c4bafc lrc: 3/0,0 mode: PW/PW res: [0x2b1db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.331218:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008d96b78/0x3234de053c4bafc lrc: 1/0,0 mode: --/PW res: [0x2b1db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.331220:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008d96b78/0x3234de053c4bafc lrc: 0/0,0 mode: --/PW res: [0x2b1db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.331245:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208275 00000100:00100000:1.0:1651529333.331247:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+859:39030:x1731745946273280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.331252:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176609 count 1 00010000:00010000:1.0:1651529333.331261:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f6c33eb/0x3234de053c4bb2d lrc: 3/0,1 mode: --/PW res: [0x2b1e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.331266:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000035710251/0x3234de053c43841 lrc: 2/0,0 mode: PR/PR res: [0x2b1e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a26c6 expref: 524 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.331269:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.331270:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.331270:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f6c33eb/0x3234de053c4bb2d lrc: 4/0,1 mode: --/PW res: [0x2b1e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.331277:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000035710251/0x3234de053c43841 lrc: 3/0,0 mode: PR/PR res: [0x2b1e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a26c6 expref: 524 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.331281:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000035710251/0x3234de053c43841 lrc: 4/0,0 mode: PR/PR res: [0x2b1e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a26c6 expref: 524 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.331285:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000716b388d pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996916928:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.331294:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 0000000053a0cffa going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.331303:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000900b179f pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996916608:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.331306:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4bb0a lrc: 3/0,1 mode: --/PW res: [0x2b1dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.331323:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.331359:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946273472 00000100:00100000:1.0:1651529333.331371:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208276 00000100:00100000:1.0:1651529333.331372:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+860:39029:x1731745946273472:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.331377:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176610 count 1 00010000:00010000:1.0:1651529333.331381:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f2d383f/0x3234de053c4bb34 lrc: 3/0,1 mode: --/PW res: [0x2b1e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.331386:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b2e0184e/0x3234de053c44847 lrc: 2/0,0 mode: PR/PR res: [0x2b1e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a67fd expref: 524 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.331389:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.331390:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.331391:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f2d383f/0x3234de053c4bb34 lrc: 4/0,1 mode: --/PW res: [0x2b1e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.331397:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b2e0184e/0x3234de053c44847 lrc: 3/0,0 mode: PR/PR res: [0x2b1e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a67fd expref: 524 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.331400:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b2e0184e/0x3234de053c44847 lrc: 4/0,0 mode: PR/PR res: [0x2b1e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a67fd expref: 524 pid: 72395 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.331404:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000023afca5e pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996916992:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.331416:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd96f074 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.331663:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.331670:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.331676:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.331683:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.331695:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cee35a0c pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996916736:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.331699:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000158a383a/0x3234de053c4bb18 lrc: 3/0,1 mode: --/PW res: [0x2b1dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.331706:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394376192 00010000:00010000:1.0:1651529333.331711:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000071e195c9/0x3234de053c45b6b lrc: 4/0,0 mode: PR/PR res: [0x2b1da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab45c expref: 528 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.331719:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10938 00000100:00100000:1.0:1651529333.331721:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+528:41278:x1731746394376384:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.331724:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.331725:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e9d052e8/0x3234de053c43879 lrc: 4/0,0 mode: PR/PR res: [0x2b1dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2744 expref: 528 pid: 80277 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.331738:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e9d052e8/0x3234de053c43879 lrc: 3/0,0 mode: PR/PR res: [0x2b1dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2744 expref: 528 pid: 80277 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.331744:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9d052e8/0x3234de053c43879 lrc: 0/0,0 mode: --/PR res: [0x2b1dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2744 expref: 528 pid: 80277 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.331748:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.331749:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.331749:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000158a383a/0x3234de053c4bb18 lrc: 3/0,1 mode: PW/PW res: [0x2b1dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.331753:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000158a383a/0x3234de053c4bb18 lrc: 4/0,1 mode: PW/PW res: [0x2b1dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.331759:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.331777:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+526:41278:x1731746394376384:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 55us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.331780:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10938 00000100:00100000:1.0:1651529333.331786:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10940 00000100:00100000:1.0:1651529333.331788:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+524:41279:x1731746394376320:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529333.331791:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.331793:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f8e988a0/0x3234de053c43df8 lrc: 4/0,0 mode: PR/PR res: [0x2b1de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3d47 expref: 524 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.331796:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f8e988a0/0x3234de053c43df8 lrc: 3/0,0 mode: PR/PR res: [0x2b1de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3d47 expref: 524 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.331801:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8e988a0/0x3234de053c43df8 lrc: 0/0,0 mode: --/PR res: [0x2b1de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3d47 expref: 524 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.331805:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.331805:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.331806:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4bb11 lrc: 3/0,1 mode: PW/PW res: [0x2b1de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.331809:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4bb11 lrc: 4/0,1 mode: PW/PW res: [0x2b1de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.331819:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.331824:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+522:41279:x1731746394376320:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.331827:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10940 00010000:00010000:1.0:1651529333.331834:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4bb0a lrc: 3/0,1 mode: PW/PW res: [0x2b1dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.331838:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4bb0a lrc: 3/0,1 mode: PW/PW res: [0x2b1dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.331841:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4bb0a lrc: 3/0,1 mode: PW/PW res: [0x2b1dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.331844:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4bb0a lrc: 2/0,0 mode: PW/PW res: [0x2b1dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.331889:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+862:39030:x1731745946272704:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1473us (1532us total) trans 12885078210 rc 0/0 00000100:00100000:1.0:1651529333.331892:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208270 00010000:00010000:1.0:1651529333.331899:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000158a383a/0x3234de053c4bb18 lrc: 3/0,1 mode: PW/PW res: [0x2b1dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.331902:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000158a383a/0x3234de053c4bb18 lrc: 3/0,1 mode: PW/PW res: [0x2b1dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.331905:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000158a383a/0x3234de053c4bb18 lrc: 3/0,1 mode: PW/PW res: [0x2b1dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.331908:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000158a383a/0x3234de053c4bb18 lrc: 2/0,0 mode: PW/PW res: [0x2b1dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.331940:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+861:39030:x1731745946272768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1143us (1249us total) trans 12885078212 rc 0/0 00000100:00100000:1.0:1651529333.331945:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208272 00010000:00010000:1.0:1651529333.332029:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4bb11 lrc: 2/0,0 mode: PW/PW res: [0x2b1de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.332033:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b0e4295a already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.332034:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4bb11 lrc: 2/0,0 mode: PW/PW res: [0x2b1de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.332038:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4bb11 lrc: 3/0,0 mode: PW/PW res: [0x2b1de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.332043:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4bb11 lrc: 1/0,0 mode: --/PW res: [0x2b1de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.332045:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4bb11 lrc: 0/0,0 mode: --/PW res: [0x2b1de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.332263:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.332285:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.332314:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.332328:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.332337:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.332345:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.332352:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.332360:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.332368:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946273728 00000100:00100000:1.0:1651529333.332384:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946273856 00000100:00100000:1.0:1651529333.332389:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208278 00000100:00100000:1.0:1651529333.332391:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+864:39029:x1731745946273792:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.332398:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176613 count 1 00010000:00010000:1.0:1651529333.332403:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002310563/0x3234de053c4bb42 lrc: 3/0,1 mode: --/PW res: [0x2b1e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.332410:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000893c22d1/0x3234de053c438e2 lrc: 2/0,0 mode: PR/PR res: [0x2b1e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2927 expref: 520 pid: 80278 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.332414:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.332414:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.332415:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002310563/0x3234de053c4bb42 lrc: 4/0,1 mode: --/PW res: [0x2b1e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.332423:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000893c22d1/0x3234de053c438e2 lrc: 3/0,0 mode: PR/PR res: [0x2b1e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2927 expref: 520 pid: 80278 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.332427:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000893c22d1/0x3234de053c438e2 lrc: 4/0,0 mode: PR/PR res: [0x2b1e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2927 expref: 520 pid: 80278 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.332432:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ffb5d0a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996917184:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.332444:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8a0b704 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.332453:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000716b388d pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996916928:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.332457:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005f6c33eb/0x3234de053c4bb2d lrc: 3/0,1 mode: --/PW res: [0x2b1e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.332465:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000023afca5e pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996916992:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.332468:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009f2d383f/0x3234de053c4bb34 lrc: 3/0,1 mode: --/PW res: [0x2b1e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.332474:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394376704 00010000:00010000:1.0:1651529333.332479:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000070a27c05/0x3234de053c4534c lrc: 4/0,0 mode: PR/PR res: [0x2b1df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a92f2 expref: 521 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.332484:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394376896 00010000:00010000:1.0:1651529333.332487:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009d44ade1/0x3234de053c44863 lrc: 4/0,0 mode: PR/PR res: [0x2b1e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6843 expref: 522 pid: 72395 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.332491:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394377152 00010000:00010000:1.0:1651529333.332494:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b2e0184e/0x3234de053c44847 lrc: 4/0,0 mode: PR/PR res: [0x2b1e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a67fd expref: 524 pid: 72395 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.332506:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10941 00000100:00100000:1.0:1651529333.332508:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+524:41278:x1731746394376704:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.332511:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.332513:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000070a27c05/0x3234de053c4534c lrc: 4/0,0 mode: PR/PR res: [0x2b1df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a92f2 expref: 524 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.332517:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000070a27c05/0x3234de053c4534c lrc: 3/0,0 mode: PR/PR res: [0x2b1df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a92f2 expref: 524 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.332523:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070a27c05/0x3234de053c4534c lrc: 0/0,0 mode: --/PR res: [0x2b1df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a92f2 expref: 524 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.332539:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.332539:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.332540:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4bb1f lrc: 3/0,1 mode: PW/PW res: [0x2b1df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.332544:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4bb1f lrc: 4/0,1 mode: PW/PW res: [0x2b1df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.332553:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.332561:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+522:41278:x1731746394376704:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 53us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.332565:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10941 00000100:00100000:1.0:1651529333.332570:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10943 00000100:00100000:1.0:1651529333.332572:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082df86ec pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+521:41279:x1731746394377152:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529333.332574:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.332576:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b2e0184e/0x3234de053c44847 lrc: 4/0,0 mode: PR/PR res: [0x2b1e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a67fd expref: 521 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.332580:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b2e0184e/0x3234de053c44847 lrc: 3/0,0 mode: PR/PR res: [0x2b1e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a67fd expref: 520 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.332585:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2e0184e/0x3234de053c44847 lrc: 0/0,0 mode: --/PR res: [0x2b1e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a67fd expref: 520 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.332588:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.332589:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.332590:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009f2d383f/0x3234de053c4bb34 lrc: 3/0,1 mode: PW/PW res: [0x2b1e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.332593:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f2d383f/0x3234de053c4bb34 lrc: 4/0,1 mode: PW/PW res: [0x2b1e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.332599:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.332604:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082df86ec pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+518:41279:x1731746394377152:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.332607:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10943 00010000:00010000:1.0:1651529333.332619:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009f2d383f/0x3234de053c4bb34 lrc: 3/0,1 mode: PW/PW res: [0x2b1e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.332623:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f2d383f/0x3234de053c4bb34 lrc: 3/0,1 mode: PW/PW res: [0x2b1e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.332626:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f2d383f/0x3234de053c4bb34 lrc: 3/0,1 mode: PW/PW res: [0x2b1e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.332629:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f2d383f/0x3234de053c4bb34 lrc: 2/0,0 mode: PW/PW res: [0x2b1e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.332677:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+866:39029:x1731745946273472:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1304us (1354us total) trans 12885078214 rc 0/0 00000100:00100000:1.0:1651529333.332680:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208276 00010000:00010000:1.0:1651529333.332688:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005f6c33eb/0x3234de053c4bb2d lrc: 3/0,1 mode: PW/PW res: [0x2b1e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.332694:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f6c33eb/0x3234de053c4bb2d lrc: 3/0,1 mode: PW/PW res: [0x2b1e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.332697:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f6c33eb/0x3234de053c4bb2d lrc: 3/0,1 mode: PW/PW res: [0x2b1e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.332700:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f6c33eb/0x3234de053c4bb2d lrc: 2/0,0 mode: PW/PW res: [0x2b1e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.332744:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+865:39030:x1731745946273280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1496us (1569us total) trans 12885078216 rc 0/0 00000100:00100000:1.0:1651529333.332748:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208275 00000100:00100000:1.0:1651529333.332766:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529333.332892:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4bb1f lrc: 2/0,0 mode: PW/PW res: [0x2b1df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.332901:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008270dfe9 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.332902:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4bb1f lrc: 2/0,0 mode: PW/PW res: [0x2b1df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.332906:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4bb1f lrc: 3/0,0 mode: PW/PW res: [0x2b1df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.332911:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4bb1f lrc: 1/0,0 mode: --/PW res: [0x2b1df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.332916:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4bb1f lrc: 0/0,0 mode: --/PW res: [0x2b1df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.333063:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.333070:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946273920 00000100:00100000:1.0:1651529333.333081:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208282 00000100:00100000:1.0:1651529333.333083:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+865:39029:x1731745946273920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.333089:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176615 count 1 00010000:00010000:1.0:1651529333.333093:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4bb5e lrc: 3/0,1 mode: --/PW res: [0x2b1e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.333098:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c45926 lrc: 2/0,0 mode: PR/PR res: [0x2b1e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aac36 expref: 517 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.333102:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.333102:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.333103:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4bb5e lrc: 4/0,1 mode: --/PW res: [0x2b1e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.333110:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c45926 lrc: 3/0,0 mode: PR/PR res: [0x2b1e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aac36 expref: 517 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.333113:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c45926 lrc: 4/0,0 mode: PR/PR res: [0x2b1e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aac36 expref: 517 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.333118:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cee35a0c pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996917312:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.333130:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 000000007d8fabda going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.333286:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.333297:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.333306:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.333323:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208283 00000100:00100000:1.0:1651529333.333326:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+868:39029:x1731745946273984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.333331:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176616 count 1 00010000:00010000:1.0:1651529333.333336:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4bb65 lrc: 3/0,1 mode: --/PW res: [0x2b1e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.333340:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005b477773/0x3234de053c4500b lrc: 2/0,0 mode: PR/PR res: [0x2b1e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a855b expref: 517 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.333344:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.333344:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.333345:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4bb65 lrc: 4/0,1 mode: --/PW res: [0x2b1e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.333352:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005b477773/0x3234de053c4500b lrc: 3/0,0 mode: PR/PR res: [0x2b1e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a855b expref: 517 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.333355:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005b477773/0x3234de053c4500b lrc: 4/0,0 mode: PR/PR res: [0x2b1e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a855b expref: 517 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.333359:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000027e31dd1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996917376:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.333370:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd96f074 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.333525:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.333533:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.333541:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.333548:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.333564:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.333581:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ffb5d0a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996917184:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.333586:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000002310563/0x3234de053c4bb42 lrc: 3/0,1 mode: --/PW res: [0x2b1e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.333594:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10945 00000100:00100000:1.0:1651529333.333596:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+521:41278:x1731746394377728:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.333600:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.333602:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005bdaff4a/0x3234de053c43bdd lrc: 4/0,0 mode: PR/PR res: [0x2b1e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a34f7 expref: 521 pid: 80278 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.333605:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005bdaff4a/0x3234de053c43bdd lrc: 3/0,0 mode: PR/PR res: [0x2b1e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a34f7 expref: 521 pid: 80278 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.333612:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005bdaff4a/0x3234de053c43bdd lrc: 0/0,0 mode: --/PR res: [0x2b1e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a34f7 expref: 521 pid: 80278 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.333616:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.333616:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.333617:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4bb3b lrc: 3/0,1 mode: PW/PW res: [0x2b1e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.333620:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4bb3b lrc: 4/0,1 mode: PW/PW res: [0x2b1e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.333637:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.333651:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+519:41278:x1731746394377728:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 54us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.333654:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10945 00000100:00100000:1.0:1651529333.333661:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10948 00000100:00100000:1.0:1651529333.333663:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+517:41278:x1731746394377920:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.333666:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.333668:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d33d4a29/0x3234de053c4401a lrc: 4/0,0 mode: PR/PR res: [0x2b1e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a45ba expref: 517 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.333671:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d33d4a29/0x3234de053c4401a lrc: 3/0,0 mode: PR/PR res: [0x2b1e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a45ba expref: 517 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.333676:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d33d4a29/0x3234de053c4401a lrc: 0/0,0 mode: --/PR res: [0x2b1e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a45ba expref: 516 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.333680:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.333680:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.333681:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000062022a4b/0x3234de053c4bb50 lrc: 3/0,1 mode: PW/PW res: [0x2b1e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.333684:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062022a4b/0x3234de053c4bb50 lrc: 4/0,1 mode: PW/PW res: [0x2b1e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.333693:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.333699:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+515:41278:x1731746394377920:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 36us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.333702:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10948 00010000:00010000:1.0:1651529333.333710:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000002310563/0x3234de053c4bb42 lrc: 3/0,1 mode: PW/PW res: [0x2b1e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.333714:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002310563/0x3234de053c4bb42 lrc: 3/0,1 mode: PW/PW res: [0x2b1e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.333717:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002310563/0x3234de053c4bb42 lrc: 3/0,1 mode: PW/PW res: [0x2b1e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.333720:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002310563/0x3234de053c4bb42 lrc: 2/0,0 mode: PW/PW res: [0x2b1e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.333786:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+869:39029:x1731745946273792:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1395us (1500us total) trans 12885078219 rc 0/0 00000100:00100000:1.0:1651529333.333789:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208278 00010000:00010000:1.0:1651529333.333894:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062022a4b/0x3234de053c4bb50 lrc: 2/0,0 mode: PW/PW res: [0x2b1e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.333898:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000062022a4b already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.333899:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062022a4b/0x3234de053c4bb50 lrc: 2/0,0 mode: PW/PW res: [0x2b1e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.333902:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062022a4b/0x3234de053c4bb50 lrc: 3/0,0 mode: PW/PW res: [0x2b1e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.333907:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062022a4b/0x3234de053c4bb50 lrc: 1/0,0 mode: --/PW res: [0x2b1e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.333910:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062022a4b/0x3234de053c4bb50 lrc: 0/0,0 mode: --/PW res: [0x2b1e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.333989:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.334008:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cee35a0c pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996917312:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.334012:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4bb5e lrc: 3/0,1 mode: --/PW res: [0x2b1e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.334019:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000027e31dd1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996917376:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.334022:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4bb65 lrc: 3/0,1 mode: --/PW res: [0x2b1e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.334054:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.334089:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.334097:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946274752 00000100:00100000:1.0:1651529333.334104:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208288 00000100:00100000:1.0:1651529333.334106:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+870:39029:x1731745946274688:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.334112:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176619 count 1 00010000:00010000:1.0:1651529333.334123:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058d7a733/0x3234de053c4bb88 lrc: 3/0,1 mode: --/PW res: [0x2b1eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.334128:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000211fda54/0x3234de053c43edf lrc: 2/0,0 mode: PR/PR res: [0x2b1eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a40b9 expref: 515 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.334131:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.334132:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.334133:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058d7a733/0x3234de053c4bb88 lrc: 4/0,1 mode: --/PW res: [0x2b1eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.334140:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000211fda54/0x3234de053c43edf lrc: 3/0,0 mode: PR/PR res: [0x2b1eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a40b9 expref: 515 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.334143:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000211fda54/0x3234de053c43edf lrc: 4/0,0 mode: PR/PR res: [0x2b1eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a40b9 expref: 515 pid: 72395 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.334148:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996917568:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.334156:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 000000007d8fabda going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.334283:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.334291:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.334298:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394378304 00010000:00010000:1.0:1651529333.334304:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005b477773/0x3234de053c4500b lrc: 4/0,0 mode: PR/PR res: [0x2b1e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a855b expref: 516 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.334311:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394378560 00010000:00010000:1.0:1651529333.334313:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008014f71b/0x3234de053c45a30 lrc: 4/0,0 mode: PR/PR res: [0x2b1e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aaf77 expref: 517 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.334329:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10949 00000100:00100000:1.0:1651529333.334331:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+517:41278:x1731746394378304:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.334334:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.334336:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005b477773/0x3234de053c4500b lrc: 4/0,0 mode: PR/PR res: [0x2b1e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a855b expref: 517 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.334342:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005b477773/0x3234de053c4500b lrc: 3/0,0 mode: PR/PR res: [0x2b1e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a855b expref: 517 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.334348:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b477773/0x3234de053c4500b lrc: 0/0,0 mode: --/PR res: [0x2b1e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a855b expref: 517 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.334351:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.334352:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.334353:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4bb65 lrc: 3/0,1 mode: PW/PW res: [0x2b1e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.334356:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4bb65 lrc: 4/0,1 mode: PW/PW res: [0x2b1e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.334362:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.334369:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+515:41278:x1731746394378304:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 38us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.334372:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10949 00010000:00010000:1.0:1651529333.334379:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4bb65 lrc: 3/0,1 mode: PW/PW res: [0x2b1e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.334382:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4bb65 lrc: 3/0,1 mode: PW/PW res: [0x2b1e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.334385:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4bb65 lrc: 3/0,1 mode: PW/PW res: [0x2b1e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.334390:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4bb65 lrc: 2/0,0 mode: PW/PW res: [0x2b1e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.334443:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+872:39029:x1731745946273984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1117us (1157us total) trans 12885078222 rc 0/0 00000100:00100000:1.0:1651529333.334446:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208283 00010000:00010000:1.0:1651529333.334454:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4bb65 lrc: 2/0,0 mode: PW/PW res: [0x2b1e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.334457:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000828505cd already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.334458:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4bb65 lrc: 2/0,0 mode: PW/PW res: [0x2b1e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.334461:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4bb65 lrc: 3/0,0 mode: PW/PW res: [0x2b1e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.334466:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4bb65 lrc: 1/0,0 mode: --/PW res: [0x2b1e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.334469:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4bb65 lrc: 0/0,0 mode: --/PW res: [0x2b1e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.334503:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.334527:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.334542:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.334571:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.334619:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394378240 00010000:00010000:1.0:1651529333.334625:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c45926 lrc: 4/0,0 mode: PR/PR res: [0x2b1e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aac36 expref: 514 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.334638:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394378496 00010000:00010000:1.0:1651529333.334641:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000254546df/0x3234de053c45f9a lrc: 4/0,0 mode: PR/PR res: [0x2b1ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac50a expref: 515 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.334647:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10952 00000100:00100000:1.0:1651529333.334649:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+515:41279:x1731746394378496:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.334652:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.334653:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000254546df/0x3234de053c45f9a lrc: 4/0,0 mode: PR/PR res: [0x2b1ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac50a expref: 515 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.334657:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000254546df/0x3234de053c45f9a lrc: 3/0,0 mode: PR/PR res: [0x2b1ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac50a expref: 515 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.334663:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000254546df/0x3234de053c45f9a lrc: 0/0,0 mode: --/PR res: [0x2b1ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac50a expref: 514 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.334666:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.334667:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.334668:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001947a788/0x3234de053c4bb6c lrc: 3/0,1 mode: PW/PW res: [0x2b1ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.334671:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001947a788/0x3234de053c4bb6c lrc: 4/0,1 mode: PW/PW res: [0x2b1ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.334689:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.334696:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+512:41279:x1731746394378496:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 46us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.334699:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10952 00010000:00010000:1.0:1651529333.334706:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4bb5e lrc: 3/0,1 mode: PW/PW res: [0x2b1e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.334709:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4bb5e lrc: 3/0,1 mode: PW/PW res: [0x2b1e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.334712:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4bb5e lrc: 3/0,1 mode: PW/PW res: [0x2b1e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.334715:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4bb5e lrc: 2/0,0 mode: PW/PW res: [0x2b1e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.334773:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+874:39029:x1731745946273920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1689us (1710us total) trans 12885078224 rc 0/0 00000100:00100000:1.0:1651529333.334776:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208282 00010000:00010000:1.0:1651529333.334784:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4bb5e lrc: 2/0,0 mode: PW/PW res: [0x2b1e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.334787:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007d2a92bc already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.334788:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4bb5e lrc: 2/0,0 mode: PW/PW res: [0x2b1e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.334793:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4bb5e lrc: 3/0,0 mode: PW/PW res: [0x2b1e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.334798:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4bb5e lrc: 1/0,0 mode: --/PW res: [0x2b1e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.334801:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4bb5e lrc: 0/0,0 mode: --/PW res: [0x2b1e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.334816:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.334830:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.334897:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208293 00000100:00100000:1.0:1651529333.334899:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+874:39029:x1731745946274944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.334911:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176623 count 1 00010000:00010000:1.0:1651529333.334915:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009be39b1e/0x3234de053c4bbab lrc: 3/0,1 mode: --/PW res: [0x2b1ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.334920:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000061dc25ab/0x3234de053c445df lrc: 2/0,0 mode: PR/PR res: [0x2b1ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5e6b expref: 511 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.334923:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.334924:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.334925:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009be39b1e/0x3234de053c4bbab lrc: 4/0,1 mode: --/PW res: [0x2b1ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.334932:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000061dc25ab/0x3234de053c445df lrc: 3/0,0 mode: PR/PR res: [0x2b1ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5e6b expref: 511 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.334938:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000061dc25ab/0x3234de053c445df lrc: 4/0,0 mode: PR/PR res: [0x2b1ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5e6b expref: 511 pid: 72395 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.334942:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000007fba516 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996917824:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.334951:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 0000000018ebe812 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.335023:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.335030:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.335040:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.335052:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996917568:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.335062:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000058d7a733/0x3234de053c4bb88 lrc: 3/0,1 mode: --/PW res: [0x2b1eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.335069:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394379008 00010000:00010000:1.0:1651529333.335074:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000211fda54/0x3234de053c43edf lrc: 4/0,0 mode: PR/PR res: [0x2b1eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a40b9 expref: 513 pid: 72395 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.335081:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394379072 00010000:00010000:1.0:1651529333.335083:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000c517088/0x3234de053c446e2 lrc: 4/0,0 mode: PR/PR res: [0x2b1ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6231 expref: 515 pid: 72395 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.335092:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10953 00000100:00100000:1.0:1651529333.335094:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+515:41279:x1731746394379008:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.335097:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.335099:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000211fda54/0x3234de053c43edf lrc: 4/0,0 mode: PR/PR res: [0x2b1eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a40b9 expref: 515 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.335103:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000211fda54/0x3234de053c43edf lrc: 3/0,0 mode: PR/PR res: [0x2b1eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a40b9 expref: 515 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.335108:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000211fda54/0x3234de053c43edf lrc: 0/0,0 mode: --/PR res: [0x2b1eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a40b9 expref: 515 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.335112:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.335112:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.335113:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000058d7a733/0x3234de053c4bb88 lrc: 3/0,1 mode: PW/PW res: [0x2b1eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.335122:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058d7a733/0x3234de053c4bb88 lrc: 4/0,1 mode: PW/PW res: [0x2b1eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.335128:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.335135:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+513:41279:x1731746394379008:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.335138:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10953 00010000:00010000:1.0:1651529333.335146:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000058d7a733/0x3234de053c4bb88 lrc: 3/0,1 mode: PW/PW res: [0x2b1eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.335149:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058d7a733/0x3234de053c4bb88 lrc: 3/0,1 mode: PW/PW res: [0x2b1eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.335152:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058d7a733/0x3234de053c4bb88 lrc: 3/0,1 mode: PW/PW res: [0x2b1eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.335157:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058d7a733/0x3234de053c4bb88 lrc: 2/0,0 mode: PW/PW res: [0x2b1eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.335200:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+875:39029:x1731745946274688:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1093us (1146us total) trans 12885078226 rc 0/0 00000100:00100000:1.0:1651529333.335203:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208288 00000100:00100000:1.0:1651529333.335220:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.335290:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529333.335338:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4bb8f lrc: 2/0,0 mode: PW/PW res: [0x2b1ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.335342:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000016ff53ef already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.335343:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4bb8f lrc: 2/0,0 mode: PW/PW res: [0x2b1ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.335346:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4bb8f lrc: 3/0,0 mode: PW/PW res: [0x2b1ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.335357:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4bb8f lrc: 1/0,0 mode: --/PW res: [0x2b1ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.335359:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4bb8f lrc: 0/0,0 mode: --/PW res: [0x2b1ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.335368:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394379328 00010000:00010000:1.0:1651529333.335373:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c44101 lrc: 5/0,0 mode: PR/PR res: [0x2b1ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4a9f expref: 511 pid: 72395 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.335385:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10955 00000100:00100000:1.0:1651529333.335386:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+511:41278:x1731746394379328:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.335389:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.335391:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c44101 lrc: 4/0,0 mode: PR/PR res: [0x2b1ed:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4a9f expref: 511 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.335395:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c44101 lrc: 3/0,0 mode: PR/PR res: [0x2b1ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4a9f expref: 511 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.335400:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c44101 lrc: 0/0,0 mode: --/PR res: [0x2b1ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4a9f expref: 511 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.335403:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.335404:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.335405:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004b6e58d6/0x3234de053c4bb96 lrc: 3/0,1 mode: PW/PW res: [0x2b1ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.335408:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b6e58d6/0x3234de053c4bb96 lrc: 4/0,1 mode: PW/PW res: [0x2b1ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.335416:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.335423:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+510:41278:x1731746394379328:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.335426:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10955 00000100:00100000:1.0:1651529333.335458:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.335473:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.335525:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.335571:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.335579:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.335590:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.335597:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208297 00000100:00100000:1.0:1651529333.335599:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+878:39029:x1731745946275456:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.335605:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176627 count 1 00010000:00010000:1.0:1651529333.335610:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e21f640/0x3234de053c4bbc7 lrc: 3/0,1 mode: --/PW res: [0x2b1f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.335615:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000421ab11/0x3234de053c44bb9 lrc: 2/0,0 mode: PR/PR res: [0x2b1f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a75a2 expref: 509 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.335618:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.335618:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.335619:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e21f640/0x3234de053c4bbc7 lrc: 4/0,1 mode: --/PW res: [0x2b1f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.335633:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000421ab11/0x3234de053c44bb9 lrc: 3/0,0 mode: PR/PR res: [0x2b1f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a75a2 expref: 509 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.335637:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000421ab11/0x3234de053c44bb9 lrc: 4/0,0 mode: PR/PR res: [0x2b1f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a75a2 expref: 509 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.335641:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a573b31 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996918080:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.335650:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 000000007d8fabda going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.335659:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000007fba516 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996917824:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.335664:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009be39b1e/0x3234de053c4bbab lrc: 3/0,1 mode: --/PW res: [0x2b1ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.335671:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394379456 00010000:00010000:1.0:1651529333.335675:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000061dc25ab/0x3234de053c445df lrc: 4/0,0 mode: PR/PR res: [0x2b1ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5e6b expref: 510 pid: 72395 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.335682:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394379392 00010000:00010000:1.0:1651529333.335684:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ff3c900b/0x3234de053c46bfd lrc: 5/0,0 mode: PR/PR res: [0x2b1ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af92f expref: 511 pid: 80277 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.335688:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394379520 00010000:00010000:1.0:1651529333.335690:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fcc5c147/0x3234de053c447f3 lrc: 5/0,0 mode: PR/PR res: [0x2b1f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a66f3 expref: 512 pid: 72395 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.335695:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10956 00000100:00100000:1.0:1651529333.335696:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+512:41279:x1731746394379456:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.335699:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.335700:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000061dc25ab/0x3234de053c445df lrc: 4/0,0 mode: PR/PR res: [0x2b1ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5e6b expref: 512 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.335704:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000061dc25ab/0x3234de053c445df lrc: 3/0,0 mode: PR/PR res: [0x2b1ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5e6b expref: 512 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.335709:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061dc25ab/0x3234de053c445df lrc: 0/0,0 mode: --/PR res: [0x2b1ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5e6b expref: 512 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.335715:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.335715:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.335716:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009be39b1e/0x3234de053c4bbab lrc: 3/0,1 mode: PW/PW res: [0x2b1ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.335719:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009be39b1e/0x3234de053c4bbab lrc: 4/0,1 mode: PW/PW res: [0x2b1ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.335725:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.335744:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+511:41279:x1731746394379456:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 46us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.335747:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10956 00000100:00100000:1.0:1651529333.335753:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10958 00000100:00100000:1.0:1651529333.335754:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b9d7b776 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+510:41279:x1731746394379520:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.335757:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.335758:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fcc5c147/0x3234de053c447f3 lrc: 4/0,0 mode: PR/PR res: [0x2b1f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a66f3 expref: 510 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.335762:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fcc5c147/0x3234de053c447f3 lrc: 3/0,0 mode: PR/PR res: [0x2b1f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a66f3 expref: 510 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.335767:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcc5c147/0x3234de053c447f3 lrc: 0/0,0 mode: --/PR res: [0x2b1f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a66f3 expref: 510 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.335771:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.335772:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.335772:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002c03f4dd/0x3234de053c4bba4 lrc: 3/0,1 mode: PW/PW res: [0x2b1f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.335775:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c03f4dd/0x3234de053c4bba4 lrc: 4/0,1 mode: PW/PW res: [0x2b1f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.335784:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.335790:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b9d7b776 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+508:41279:x1731746394379520:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 35us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.335792:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10958 00010000:00010000:1.0:1651529333.335800:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009be39b1e/0x3234de053c4bbab lrc: 3/0,1 mode: PW/PW res: [0x2b1ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.335803:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009be39b1e/0x3234de053c4bbab lrc: 3/0,1 mode: PW/PW res: [0x2b1ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.335806:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009be39b1e/0x3234de053c4bbab lrc: 3/0,1 mode: PW/PW res: [0x2b1ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.335809:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009be39b1e/0x3234de053c4bbab lrc: 2/0,0 mode: PW/PW res: [0x2b1ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.335859:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+880:39029:x1731745946274944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 959us (1028us total) trans 12885078229 rc 0/0 00000100:00100000:1.0:1651529333.335862:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208293 00010000:00010000:1.0:1651529333.335869:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009be39b1e/0x3234de053c4bbab lrc: 2/0,0 mode: PW/PW res: [0x2b1ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.335875:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009be39b1e already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.335876:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009be39b1e/0x3234de053c4bbab lrc: 2/0,0 mode: PW/PW res: [0x2b1ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.335879:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009be39b1e/0x3234de053c4bbab lrc: 3/0,0 mode: PW/PW res: [0x2b1ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.335883:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009be39b1e/0x3234de053c4bbab lrc: 1/0,0 mode: --/PW res: [0x2b1ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.335886:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009be39b1e/0x3234de053c4bbab lrc: 0/0,0 mode: --/PW res: [0x2b1ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.335891:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c03f4dd/0x3234de053c4bba4 lrc: 2/0,0 mode: PW/PW res: [0x2b1f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.335893:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002c03f4dd already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.335894:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c03f4dd/0x3234de053c4bba4 lrc: 2/0,0 mode: PW/PW res: [0x2b1f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.335897:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c03f4dd/0x3234de053c4bba4 lrc: 3/0,0 mode: PW/PW res: [0x2b1f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.335900:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c03f4dd/0x3234de053c4bba4 lrc: 1/0,0 mode: --/PW res: [0x2b1f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.335902:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c03f4dd/0x3234de053c4bba4 lrc: 0/0,0 mode: --/PW res: [0x2b1f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.335917:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.336084:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.336128:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.336140:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.336149:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946275904 00000100:00100000:1.0:1651529333.336163:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946275968 00000100:00100000:1.0:1651529333.336169:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208300 00000100:00100000:1.0:1651529333.336171:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+881:39029:x1731745946275904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.336176:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176630 count 1 00010000:00010000:1.0:1651529333.336181:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005086bd45/0x3234de053c4bbdc lrc: 3/0,1 mode: --/PW res: [0x2b1f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.336186:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ccc12e16/0x3234de053c457c8 lrc: 2/0,0 mode: PR/PR res: [0x2b1f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa5e5 expref: 506 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.336189:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.336190:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.336190:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005086bd45/0x3234de053c4bbdc lrc: 4/0,1 mode: --/PW res: [0x2b1f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.336197:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ccc12e16/0x3234de053c457c8 lrc: 3/0,0 mode: PR/PR res: [0x2b1f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa5e5 expref: 506 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.336201:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ccc12e16/0x3234de053c457c8 lrc: 4/0,0 mode: PR/PR res: [0x2b1f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa5e5 expref: 506 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.336205:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000824ca843 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996918272:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.336214:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000499d0377 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.336243:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.336634:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.336795:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a573b31 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996918080:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.336800:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008e21f640/0x3234de053c4bbc7 lrc: 3/0,1 mode: --/PW res: [0x2b1f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.336838:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.336851:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.336858:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.336865:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.336872:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394380288 00010000:00010000:1.0:1651529333.336877:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000421ab11/0x3234de053c44bb9 lrc: 4/0,0 mode: PR/PR res: [0x2b1f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a75a2 expref: 507 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.336883:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394380544 00010000:00010000:1.0:1651529333.336886:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a0f055f1/0x3234de053c442c1 lrc: 4/0,0 mode: PR/PR res: [0x2b1f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5183 expref: 509 pid: 72395 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.336893:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10961 00000100:00100000:1.0:1651529333.336894:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+509:41279:x1731746394380288:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.336897:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.336899:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000421ab11/0x3234de053c44bb9 lrc: 4/0,0 mode: PR/PR res: [0x2b1f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a75a2 expref: 509 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.336902:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000421ab11/0x3234de053c44bb9 lrc: 3/0,0 mode: PR/PR res: [0x2b1f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a75a2 expref: 509 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.336908:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000421ab11/0x3234de053c44bb9 lrc: 0/0,0 mode: --/PR res: [0x2b1f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a75a2 expref: 508 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.336912:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.336913:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.336914:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008e21f640/0x3234de053c4bbc7 lrc: 3/0,1 mode: PW/PW res: [0x2b1f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.336917:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e21f640/0x3234de053c4bbc7 lrc: 4/0,1 mode: PW/PW res: [0x2b1f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.336923:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.336937:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+507:41279:x1731746394380288:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.336940:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10961 00000100:00100000:1.0:1651529333.336945:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10963 00000100:00100000:1.0:1651529333.336946:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+505:41279:x1731746394380544:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.336949:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.336951:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a0f055f1/0x3234de053c442c1 lrc: 4/0,0 mode: PR/PR res: [0x2b1f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5183 expref: 505 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.336954:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a0f055f1/0x3234de053c442c1 lrc: 3/0,0 mode: PR/PR res: [0x2b1f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5183 expref: 505 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.336959:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0f055f1/0x3234de053c442c1 lrc: 0/0,0 mode: --/PR res: [0x2b1f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5183 expref: 504 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.336965:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.336966:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.336967:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000876c3b77/0x3234de053c4bbd5 lrc: 3/0,1 mode: PW/PW res: [0x2b1f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.336970:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000876c3b77/0x3234de053c4bbd5 lrc: 4/0,1 mode: PW/PW res: [0x2b1f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.336979:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.336985:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+503:41279:x1731746394380544:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 38us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.336987:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10963 00010000:00010000:1.0:1651529333.336996:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008e21f640/0x3234de053c4bbc7 lrc: 3/0,1 mode: PW/PW res: [0x2b1f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.336999:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e21f640/0x3234de053c4bbc7 lrc: 3/0,1 mode: PW/PW res: [0x2b1f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.337002:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e21f640/0x3234de053c4bbc7 lrc: 3/0,1 mode: PW/PW res: [0x2b1f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.337004:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e21f640/0x3234de053c4bbc7 lrc: 2/0,0 mode: PW/PW res: [0x2b1f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.337060:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+884:39029:x1731745946275456:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1460us (1587us total) trans 12885078234 rc 0/0 00000100:00100000:1.0:1651529333.337063:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208297 00010000:00010000:1.0:1651529333.337071:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e21f640/0x3234de053c4bbc7 lrc: 2/0,0 mode: PW/PW res: [0x2b1f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.337074:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008e21f640 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.337076:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e21f640/0x3234de053c4bbc7 lrc: 2/0,0 mode: PW/PW res: [0x2b1f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.337078:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e21f640/0x3234de053c4bbc7 lrc: 3/0,0 mode: PW/PW res: [0x2b1f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.337083:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e21f640/0x3234de053c4bbc7 lrc: 1/0,0 mode: --/PW res: [0x2b1f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.337086:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e21f640/0x3234de053c4bbc7 lrc: 0/0,0 mode: --/PW res: [0x2b1f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.337161:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.337213:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.337221:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.337244:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.337261:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.337300:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000824ca843 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996918272:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.337305:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005086bd45/0x3234de053c4bbdc lrc: 3/0,1 mode: --/PW res: [0x2b1f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.337312:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394380800 00010000:00010000:1.0:1651529333.337317:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ccc12e16/0x3234de053c457c8 lrc: 4/0,0 mode: PR/PR res: [0x2b1f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa5e5 expref: 503 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.337325:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394380864 00010000:00010000:1.0:1651529333.337327:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000861e5c2b/0x3234de053c454d4 lrc: 4/0,0 mode: PR/PR res: [0x2b1f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a98b7 expref: 504 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.337331:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394380928 00010000:00010000:1.0:1651529333.337333:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004ac527af/0x3234de053c43a78 lrc: 4/0,0 mode: PR/PR res: [0x2b1f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2f1d expref: 505 pid: 72395 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.337337:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394380992 00010000:00010000:1.0:1651529333.337339:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000015c45f50/0x3234de053c4650b lrc: 5/0,0 mode: PR/PR res: [0x2b1f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2adba7 expref: 506 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.337344:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10964 00000100:00100000:1.0:1651529333.337345:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+506:41278:x1731746394380800:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.337348:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.337349:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ccc12e16/0x3234de053c457c8 lrc: 4/0,0 mode: PR/PR res: [0x2b1f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa5e5 expref: 506 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.337353:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ccc12e16/0x3234de053c457c8 lrc: 3/0,0 mode: PR/PR res: [0x2b1f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa5e5 expref: 506 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.337358:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ccc12e16/0x3234de053c457c8 lrc: 0/0,0 mode: --/PR res: [0x2b1f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa5e5 expref: 506 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.337362:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.337363:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.337364:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005086bd45/0x3234de053c4bbdc lrc: 3/0,1 mode: PW/PW res: [0x2b1f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.337367:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005086bd45/0x3234de053c4bbdc lrc: 4/0,1 mode: PW/PW res: [0x2b1f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.337373:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.337381:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+505:41278:x1731746394380800:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 35us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.337383:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10964 00000100:00100000:1.0:1651529333.337387:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10965 00000100:00100000:1.0:1651529333.337389:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de6bf351 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+504:41279:x1731746394380864:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.337391:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.337392:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000861e5c2b/0x3234de053c454d4 lrc: 4/0,0 mode: PR/PR res: [0x2b1f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a98b7 expref: 504 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.337396:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000861e5c2b/0x3234de053c454d4 lrc: 3/0,0 mode: PR/PR res: [0x2b1f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a98b7 expref: 504 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.337400:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000861e5c2b/0x3234de053c454d4 lrc: 0/0,0 mode: --/PR res: [0x2b1f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a98b7 expref: 504 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.337404:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.337404:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.337405:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e90f6a58/0x3234de053c4bbe3 lrc: 3/0,1 mode: PW/PW res: [0x2b1f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.337410:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e90f6a58/0x3234de053c4bbe3 lrc: 4/0,1 mode: PW/PW res: [0x2b1f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.337420:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.337426:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de6bf351 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+503:41279:x1731746394380864:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.337428:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10965 00000100:00100000:1.0:1651529333.337436:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10966 00000100:00100000:1.0:1651529333.337438:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+502:41278:x1731746394380928:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.337440:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.337442:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004ac527af/0x3234de053c43a78 lrc: 4/0,0 mode: PR/PR res: [0x2b1f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2f1d expref: 502 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.337445:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004ac527af/0x3234de053c43a78 lrc: 3/0,0 mode: PR/PR res: [0x2b1f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2f1d expref: 502 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.337450:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ac527af/0x3234de053c43a78 lrc: 0/0,0 mode: --/PR res: [0x2b1f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2f1d expref: 502 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.337453:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.337454:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.337455:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ed7a068d/0x3234de053c4bbea lrc: 3/0,1 mode: PW/PW res: [0x2b1f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.337458:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed7a068d/0x3234de053c4bbea lrc: 4/0,1 mode: PW/PW res: [0x2b1f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.337475:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.337481:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+501:41278:x1731746394380928:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.337484:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10966 00000100:00100000:1.0:1651529333.337488:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10967 00000100:00100000:1.0:1651529333.337489:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+500:41279:x1731746394380992:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.337492:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.337493:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000015c45f50/0x3234de053c4650b lrc: 4/0,0 mode: PR/PR res: [0x2b1f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2adba7 expref: 500 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.337497:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000015c45f50/0x3234de053c4650b lrc: 3/0,0 mode: PR/PR res: [0x2b1f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2adba7 expref: 500 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.337501:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015c45f50/0x3234de053c4650b lrc: 0/0,0 mode: --/PR res: [0x2b1f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2adba7 expref: 500 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.337505:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.337505:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.337506:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c4bbf1 lrc: 3/0,1 mode: PW/PW res: [0x2b1f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.337509:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c4bbf1 lrc: 4/0,1 mode: PW/PW res: [0x2b1f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.337518:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.337523:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+499:41279:x1731746394380992:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 33us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.337526:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10967 00010000:00010000:1.0:1651529333.337536:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e90f6a58/0x3234de053c4bbe3 lrc: 2/0,0 mode: PW/PW res: [0x2b1f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.337539:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e90f6a58 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.337540:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e90f6a58/0x3234de053c4bbe3 lrc: 2/0,0 mode: PW/PW res: [0x2b1f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.337543:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e90f6a58/0x3234de053c4bbe3 lrc: 3/0,0 mode: PW/PW res: [0x2b1f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.337547:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e90f6a58/0x3234de053c4bbe3 lrc: 1/0,0 mode: --/PW res: [0x2b1f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.337550:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e90f6a58/0x3234de053c4bbe3 lrc: 0/0,0 mode: --/PW res: [0x2b1f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.337554:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed7a068d/0x3234de053c4bbea lrc: 2/0,0 mode: PW/PW res: [0x2b1f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.337557:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ed7a068d already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.337558:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed7a068d/0x3234de053c4bbea lrc: 2/0,0 mode: PW/PW res: [0x2b1f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.337561:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed7a068d/0x3234de053c4bbea lrc: 3/0,0 mode: PW/PW res: [0x2b1f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.337566:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed7a068d/0x3234de053c4bbea lrc: 1/0,0 mode: --/PW res: [0x2b1f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.337569:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed7a068d/0x3234de053c4bbea lrc: 0/0,0 mode: --/PW res: [0x2b1f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.337574:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005086bd45/0x3234de053c4bbdc lrc: 3/0,1 mode: PW/PW res: [0x2b1f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.337577:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005086bd45/0x3234de053c4bbdc lrc: 3/0,1 mode: PW/PW res: [0x2b1f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.337580:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005086bd45/0x3234de053c4bbdc lrc: 3/0,1 mode: PW/PW res: [0x2b1f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.337582:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005086bd45/0x3234de053c4bbdc lrc: 2/0,0 mode: PW/PW res: [0x2b1f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.337633:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+885:39029:x1731745946275904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1461us (1510us total) trans 12885078239 rc 0/0 00000100:00100000:1.0:1651529333.337636:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208300 00010000:00010000:1.0:1651529333.337643:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005086bd45/0x3234de053c4bbdc lrc: 2/0,0 mode: PW/PW res: [0x2b1f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.337647:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005086bd45 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.337648:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005086bd45/0x3234de053c4bbdc lrc: 2/0,0 mode: PW/PW res: [0x2b1f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.337651:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005086bd45/0x3234de053c4bbdc lrc: 3/0,0 mode: PW/PW res: [0x2b1f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.337656:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005086bd45/0x3234de053c4bbdc lrc: 1/0,0 mode: --/PW res: [0x2b1f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.337658:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005086bd45/0x3234de053c4bbdc lrc: 0/0,0 mode: --/PW res: [0x2b1f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.337695:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.337709:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.337724:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.337805:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208306 00000100:00100000:1.0:1651529333.337807:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+886:39029:x1731745946276480:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.337813:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176636 count 1 00010000:00010000:1.0:1651529333.337818:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c5115ca/0x3234de053c4bc06 lrc: 3/0,1 mode: --/PW res: [0x2b1fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.337823:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000511d6dd/0x3234de053c44bab lrc: 2/0,0 mode: PR/PR res: [0x2b1fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7586 expref: 498 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.337826:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.337827:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.337828:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c5115ca/0x3234de053c4bc06 lrc: 4/0,1 mode: --/PW res: [0x2b1fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.337835:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000511d6dd/0x3234de053c44bab lrc: 3/0,0 mode: PR/PR res: [0x2b1fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7586 expref: 498 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.337839:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000511d6dd/0x3234de053c44bab lrc: 4/0,0 mode: PR/PR res: [0x2b1fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7586 expref: 498 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.337843:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004be0190 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996918592:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.337852:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aeda71fe going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.337972:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.337983:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.337991:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.338008:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.338023:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.338029:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946277120 00000100:00100000:1.0:1651529333.338036:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208309 00000100:00100000:1.0:1651529333.338037:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+891:39029:x1731745946276864:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.338042:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176637 count 1 00010000:00010000:1.0:1651529333.338047:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea8e6dc3/0x3234de053c4bc1b lrc: 3/0,1 mode: --/PW res: [0x2b1fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.338052:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d43a1a9c/0x3234de053c45337 lrc: 2/0,0 mode: PR/PR res: [0x2b1fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9290 expref: 498 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.338055:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.338055:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.338056:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea8e6dc3/0x3234de053c4bc1b lrc: 4/0,1 mode: --/PW res: [0x2b1fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.338062:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d43a1a9c/0x3234de053c45337 lrc: 3/0,0 mode: PR/PR res: [0x2b1fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9290 expref: 498 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.338073:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d43a1a9c/0x3234de053c45337 lrc: 4/0,0 mode: PR/PR res: [0x2b1fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9290 expref: 498 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.338078:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a573b31 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996918784:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.338087:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 000000007d8fabda going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.338093:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208311 00000100:00100000:1.0:1651529333.338095:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+891:39029:x1731745946276992:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.338099:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176639 count 1 00010000:00010000:1.0:1651529333.338103:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4bc29 lrc: 3/0,1 mode: --/PW res: [0x2b1ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.338107:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005d1f4c36/0x3234de053c45bf7 lrc: 2/0,0 mode: PR/PR res: [0x2b1ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab6c4 expref: 498 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.338110:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.338110:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.338111:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4bc29 lrc: 4/0,1 mode: --/PW res: [0x2b1ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.338117:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005d1f4c36/0x3234de053c45bf7 lrc: 3/0,0 mode: PR/PR res: [0x2b1ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab6c4 expref: 498 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.338120:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005d1f4c36/0x3234de053c45bf7 lrc: 4/0,0 mode: PR/PR res: [0x2b1ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab6c4 expref: 498 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.338127:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fc130417 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996918912:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.338134:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fe434b1c going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.338569:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.338578:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.338585:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.338595:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004be0190 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996918592:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.338599:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007c5115ca/0x3234de053c4bc06 lrc: 3/0,1 mode: --/PW res: [0x2b1fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.338615:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394381504 00010000:00010000:1.0:1651529333.338620:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000511d6dd/0x3234de053c44bab lrc: 4/0,0 mode: PR/PR res: [0x2b1fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7586 expref: 501 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.338626:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10969 00000100:00100000:1.0:1651529333.338628:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+501:41279:x1731746394381568:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.338631:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.338632:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fa21fdb3/0x3234de053c46321 lrc: 4/0,0 mode: PR/PR res: [0x2b1fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad3ce expref: 501 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.338636:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fa21fdb3/0x3234de053c46321 lrc: 3/0,0 mode: PR/PR res: [0x2b1fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad3ce expref: 501 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.338641:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa21fdb3/0x3234de053c46321 lrc: 0/0,0 mode: --/PR res: [0x2b1fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad3ce expref: 500 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.338648:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.338648:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.338649:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000079489ed7/0x3234de053c4bc0d lrc: 3/0,1 mode: PW/PW res: [0x2b1fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.338652:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079489ed7/0x3234de053c4bc0d lrc: 4/0,1 mode: PW/PW res: [0x2b1fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.338666:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.338673:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+498:41279:x1731746394381568:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 45us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.338676:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10969 00010000:00010000:1.0:1651529333.338745:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007c5115ca/0x3234de053c4bc06 lrc: 3/0,1 mode: PW/PW res: [0x2b1fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.338749:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c5115ca/0x3234de053c4bc06 lrc: 3/0,1 mode: PW/PW res: [0x2b1fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.338752:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c5115ca/0x3234de053c4bc06 lrc: 3/0,1 mode: PW/PW res: [0x2b1fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.338755:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c5115ca/0x3234de053c4bc06 lrc: 2/0,0 mode: PW/PW res: [0x2b1fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.338807:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+892:39029:x1731745946276480:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 999us (1097us total) trans 12885078242 rc 0/0 00000100:00100000:1.0:1651529333.338810:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208306 00000100:00100000:1.0:1651529333.339033:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.339044:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.339051:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946277376 00000100:00100000:1.0:1651529333.339066:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208313 00000100:00100000:1.0:1651529333.339068:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+892:39029:x1731745946277376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.339074:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176642 count 1 00010000:00010000:1.0:1651529333.339084:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062022a4b/0x3234de053c4bc37 lrc: 3/0,1 mode: --/PW res: [0x2b202:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.339089:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006fa3afd1/0x3234de053c45ab5 lrc: 2/0,0 mode: PR/PR res: [0x2b202:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab184 expref: 495 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.339092:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.339093:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.339093:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062022a4b/0x3234de053c4bc37 lrc: 4/0,1 mode: --/PW res: [0x2b202:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.339100:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006fa3afd1/0x3234de053c45ab5 lrc: 3/0,0 mode: PR/PR res: [0x2b202:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab184 expref: 495 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.339104:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006fa3afd1/0x3234de053c45ab5 lrc: 4/0,0 mode: PR/PR res: [0x2b202:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab184 expref: 495 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.339108:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c9f4ec84 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996919040:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.339117:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e5f43e7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.339196:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.339258:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.339268:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.339274:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.339282:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.339327:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.339336:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a573b31 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996918784:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.339340:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ea8e6dc3/0x3234de053c4bc1b lrc: 3/0,1 mode: --/PW res: [0x2b1fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.339349:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fc130417 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996918912:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.339352:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4bc29 lrc: 3/0,1 mode: --/PW res: [0x2b1ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.339358:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394382272 00010000:00010000:1.0:1651529333.339363:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005d1f4c36/0x3234de053c45bf7 lrc: 4/0,0 mode: PR/PR res: [0x2b1ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab6c4 expref: 499 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.339369:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10971 00000100:00100000:1.0:1651529333.339371:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+500:41279:x1731746394381888:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.339373:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.339375:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f6cd1dd7/0x3234de053c4572e lrc: 4/0,0 mode: PR/PR res: [0x2b1fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa28f expref: 500 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.339379:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f6cd1dd7/0x3234de053c4572e lrc: 3/0,0 mode: PR/PR res: [0x2b1fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa28f expref: 500 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.339385:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6cd1dd7/0x3234de053c4572e lrc: 0/0,0 mode: --/PR res: [0x2b1fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa28f expref: 500 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.339391:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.339392:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.339392:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000888c0789/0x3234de053c4bc14 lrc: 3/0,1 mode: PW/PW res: [0x2b1fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.339395:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000888c0789/0x3234de053c4bc14 lrc: 4/0,1 mode: PW/PW res: [0x2b1fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.339410:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.339424:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+498:41279:x1731746394381888:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 52us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.339427:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10971 00000100:00100000:1.0:1651529333.339436:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10974 00000100:00100000:1.0:1651529333.339438:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+496:41279:x1731746394382272:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.339441:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.339442:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005d1f4c36/0x3234de053c45bf7 lrc: 4/0,0 mode: PR/PR res: [0x2b1ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab6c4 expref: 496 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.339446:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005d1f4c36/0x3234de053c45bf7 lrc: 3/0,0 mode: PR/PR res: [0x2b1ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab6c4 expref: 495 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.339451:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d1f4c36/0x3234de053c45bf7 lrc: 0/0,0 mode: --/PR res: [0x2b1ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab6c4 expref: 495 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.339455:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.339456:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.339456:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4bc29 lrc: 3/0,1 mode: PW/PW res: [0x2b1ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.339459:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4bc29 lrc: 4/0,1 mode: PW/PW res: [0x2b1ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.339465:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.339471:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+493:41279:x1731746394382272:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 32us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.339473:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10974 00010000:00010000:1.0:1651529333.339480:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4bc29 lrc: 3/0,1 mode: PW/PW res: [0x2b1ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.339484:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4bc29 lrc: 3/0,1 mode: PW/PW res: [0x2b1ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.339487:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4bc29 lrc: 3/0,1 mode: PW/PW res: [0x2b1ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.339489:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4bc29 lrc: 2/0,0 mode: PW/PW res: [0x2b1ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.339539:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+895:39029:x1731745946276992:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1443us (1530us total) trans 12885078244 rc 0/0 00000100:00100000:1.0:1651529333.339542:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208311 00010000:00010000:1.0:1651529333.339549:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4bc29 lrc: 2/0,0 mode: PW/PW res: [0x2b1ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.339555:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000039e8f661 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.339556:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4bc29 lrc: 2/0,0 mode: PW/PW res: [0x2b1ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.339559:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4bc29 lrc: 3/0,0 mode: PW/PW res: [0x2b1ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.339563:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4bc29 lrc: 1/0,0 mode: --/PW res: [0x2b1ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.339566:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4bc29 lrc: 0/0,0 mode: --/PW res: [0x2b1ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.339571:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c4bc22 lrc: 2/0,0 mode: PW/PW res: [0x2b200:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.339573:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000b62c3c9 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.339574:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c4bc22 lrc: 2/0,0 mode: PW/PW res: [0x2b200:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.339577:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c4bc22 lrc: 3/0,0 mode: PW/PW res: [0x2b200:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.339580:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c4bc22 lrc: 1/0,0 mode: --/PW res: [0x2b200:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.339583:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c4bc22 lrc: 0/0,0 mode: --/PW res: [0x2b200:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.339588:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ea8e6dc3/0x3234de053c4bc1b lrc: 3/0,1 mode: PW/PW res: [0x2b1fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.339591:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea8e6dc3/0x3234de053c4bc1b lrc: 3/0,1 mode: PW/PW res: [0x2b1fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.339594:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea8e6dc3/0x3234de053c4bc1b lrc: 3/0,1 mode: PW/PW res: [0x2b1fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.339597:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea8e6dc3/0x3234de053c4bc1b lrc: 2/0,0 mode: PW/PW res: [0x2b1fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.339638:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+895:39029:x1731745946276864:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1600us (1655us total) trans 12885078246 rc 0/0 00000100:00100000:1.0:1651529333.339641:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208309 00000100:00100000:1.0:1651529333.339687:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.339698:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.339710:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.339796:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394382720 00010000:00010000:1.0:1651529333.339807:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008b96ee29/0x3234de053c45fe0 lrc: 5/0,0 mode: PR/PR res: [0x2b203:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac5f8 expref: 492 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.339815:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394382656 00010000:00010000:1.0:1651529333.339817:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006fa3afd1/0x3234de053c45ab5 lrc: 5/0,0 mode: PR/PR res: [0x2b202:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab184 expref: 493 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.339823:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10976 00000100:00100000:1.0:1651529333.339825:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+493:41278:x1731746394382720:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.339828:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.339829:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008b96ee29/0x3234de053c45fe0 lrc: 5/0,0 mode: PR/PR res: [0x2b203:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac5f8 expref: 493 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.339833:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008b96ee29/0x3234de053c45fe0 lrc: 4/0,0 mode: PR/PR res: [0x2b203:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac5f8 expref: 493 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.339838:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.339839:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.339840:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000083b7e42d/0x3234de053c4bc3e lrc: 3/0,1 mode: PW/PW res: [0x2b203:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.339843:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083b7e42d/0x3234de053c4bc3e lrc: 4/0,1 mode: PW/PW res: [0x2b203:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.339848:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.339856:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+493:41278:x1731746394382720:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 30us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.339859:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10976 00000100:00100000:1.0:1651529333.339863:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10977 00000100:00100000:1.0:1651529333.339864:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+492:41279:x1731746394382656:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.339867:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.339868:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006fa3afd1/0x3234de053c45ab5 lrc: 5/0,0 mode: PR/PR res: [0x2b202:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab184 expref: 492 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.339871:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006fa3afd1/0x3234de053c45ab5 lrc: 4/0,0 mode: PR/PR res: [0x2b202:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab184 expref: 492 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.339876:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.339877:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.339877:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000062022a4b/0x3234de053c4bc37 lrc: 3/0,1 mode: PW/PW res: [0x2b202:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.339880:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062022a4b/0x3234de053c4bc37 lrc: 4/0,1 mode: PW/PW res: [0x2b202:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.339884:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.339889:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+492:41279:x1731746394382656:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 24us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.339891:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10977 00010000:00010000:1.0:1651529333.339897:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000888c0789/0x3234de053c4bc14 lrc: 2/0,0 mode: PW/PW res: [0x2b1fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.339901:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000888c0789 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.339902:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000888c0789/0x3234de053c4bc14 lrc: 2/0,0 mode: PW/PW res: [0x2b1fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.339904:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000888c0789/0x3234de053c4bc14 lrc: 3/0,0 mode: PW/PW res: [0x2b1fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.339908:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000888c0789/0x3234de053c4bc14 lrc: 1/0,0 mode: --/PW res: [0x2b1fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.339911:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000888c0789/0x3234de053c4bc14 lrc: 0/0,0 mode: --/PW res: [0x2b1fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.339923:0:106695:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006fa3afd1/0x3234de053c45ab5 lrc: 0/0,0 mode: --/PR res: [0x2b202:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab184 expref: 490 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.339927:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c9f4ec84 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996919040:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.339930:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000062022a4b/0x3234de053c4bc37 lrc: 3/0,1 mode: PW/PW res: [0x2b202:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.339933:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000062022a4b/0x3234de053c4bc37 lrc: 3/0,1 mode: PW/PW res: [0x2b202:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.339936:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062022a4b/0x3234de053c4bc37 lrc: 3/0,1 mode: PW/PW res: [0x2b202:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.339939:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062022a4b/0x3234de053c4bc37 lrc: 3/0,1 mode: PW/PW res: [0x2b202:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.339942:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062022a4b/0x3234de053c4bc37 lrc: 2/0,0 mode: PW/PW res: [0x2b202:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.339986:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+895:39029:x1731745946277376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 917us (954us total) trans 12885078250 rc 0/0 00000100:00100000:1.0:1651529333.339989:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208313 00000100:00100000:1.0:1651529333.340137:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.340143:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946277888 00000100:00100000:1.0:1651529333.340156:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208317 00000100:00100000:1.0:1651529333.340157:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+895:39029:x1731745946277888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.340163:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176645 count 1 00010000:00010000:1.0:1651529333.340168:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4bc53 lrc: 3/0,1 mode: --/PW res: [0x2b205:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.340172:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b699c548/0x3234de053c464da lrc: 2/0,0 mode: PR/PR res: [0x2b205:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2adaf8 expref: 489 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.340176:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.340176:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.340177:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4bc53 lrc: 4/0,1 mode: --/PW res: [0x2b205:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.340184:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b699c548/0x3234de053c464da lrc: 3/0,0 mode: PR/PR res: [0x2b205:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2adaf8 expref: 489 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.340187:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b699c548/0x3234de053c464da lrc: 4/0,0 mode: PR/PR res: [0x2b205:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2adaf8 expref: 489 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.340191:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000075b025a pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996919232:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.340202:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e5f43e7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.340215:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.340286:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.340294:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.340307:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.340316:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.340324:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.340333:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.340344:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946277952 00000100:00100000:1.0:1651529333.340353:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946278016 00000100:00100000:1.0:1651529333.340358:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946278080 00000100:00100000:1.0:1651529333.340362:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946278144 00000100:00100000:1.0:1651529333.340364:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946278272 00000100:00100000:1.0:1651529333.340366:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946278208 00000100:00100000:1.0:1651529333.340369:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208318 00000100:00100000:1.0:1651529333.340371:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+901:39030:x1731745946277952:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.340382:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176646 count 1 00010000:00010000:1.0:1651529333.340386:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a37fa99/0x3234de053c4bc5a lrc: 3/0,1 mode: --/PW res: [0x2b206:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.340391:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000016869aa9/0x3234de053c44ca0 lrc: 2/0,0 mode: PR/PR res: [0x2b206:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7914 expref: 488 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.340394:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.340394:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.340395:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a37fa99/0x3234de053c4bc5a lrc: 4/0,1 mode: --/PW res: [0x2b206:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.340401:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000016869aa9/0x3234de053c44ca0 lrc: 3/0,0 mode: PR/PR res: [0x2b206:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7914 expref: 488 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.340405:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000016869aa9/0x3234de053c44ca0 lrc: 4/0,0 mode: PR/PR res: [0x2b206:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7914 expref: 488 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.340409:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000117fbeca pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996919296:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.340417:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 0000000018ebe812 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.340424:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208320 00000100:00100000:1.0:1651529333.340426:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+901:39029:x1731745946278080:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.340430:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176648 count 1 00010000:00010000:1.0:1651529333.340433:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4bc68 lrc: 3/0,1 mode: --/PW res: [0x2b208:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.340438:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004a899246/0x3234de053c43b51 lrc: 2/0,0 mode: PR/PR res: [0x2b208:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3288 expref: 488 pid: 80278 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.340441:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.340441:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.340442:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4bc68 lrc: 4/0,1 mode: --/PW res: [0x2b208:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.340447:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004a899246/0x3234de053c43b51 lrc: 3/0,0 mode: PR/PR res: [0x2b208:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3288 expref: 488 pid: 80278 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.340451:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004a899246/0x3234de053c43b51 lrc: 4/0,0 mode: PR/PR res: [0x2b208:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3288 expref: 488 pid: 80278 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.340455:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000824ca843 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996919424:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.340461:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.340466:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208322 00000100:00100000:1.0:1651529333.340468:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+901:39029:x1731745946278272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.340472:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176651 count 1 00010000:00010000:1.0:1651529333.340474:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4bc76 lrc: 3/0,1 mode: --/PW res: [0x2b20b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.340479:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001722859c/0x3234de053c4417f lrc: 2/0,0 mode: PR/PR res: [0x2b20b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4c90 expref: 488 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.340482:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.340482:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.340483:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4bc76 lrc: 4/0,1 mode: --/PW res: [0x2b20b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.340488:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001722859c/0x3234de053c4417f lrc: 3/0,0 mode: PR/PR res: [0x2b20b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4c90 expref: 488 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.340492:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001722859c/0x3234de053c4417f lrc: 4/0,0 mode: PR/PR res: [0x2b20b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4c90 expref: 488 pid: 72395 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.340496:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fc130417 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996919552:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.340501:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd96f074 going to sleep for 6 seconds 00010000:00010000:1.0:1651529333.340615:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088555a90/0x3234de053c4bc45 lrc: 2/0,0 mode: PW/PW res: [0x2b204:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.340620:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088555a90 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.340621:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088555a90/0x3234de053c4bc45 lrc: 2/0,0 mode: PW/PW res: [0x2b204:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.340624:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088555a90/0x3234de053c4bc45 lrc: 3/0,0 mode: PW/PW res: [0x2b204:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.340629:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088555a90/0x3234de053c4bc45 lrc: 1/0,0 mode: --/PW res: [0x2b204:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.340635:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088555a90/0x3234de053c4bc45 lrc: 0/0,0 mode: --/PW res: [0x2b204:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.340645:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000075b025a pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996919232:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.340648:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4bc53 lrc: 3/0,1 mode: --/PW res: [0x2b205:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.340676:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529333.340747:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4bc53 lrc: 3/0,1 mode: PW/PW res: [0x2b205:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.340751:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4bc53 lrc: 3/0,1 mode: PW/PW res: [0x2b205:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.340764:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4bc53 lrc: 3/0,1 mode: PW/PW res: [0x2b205:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.340767:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4bc53 lrc: 2/0,0 mode: PW/PW res: [0x2b205:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.340815:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+902:39029:x1731745946277888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 657us (679us total) trans 12885078252 rc 0/0 00000100:00100000:1.0:1651529333.340818:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208317 00000100:00100000:1.0:1651529333.340834:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.340897:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000117fbeca pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996919296:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.340903:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004a37fa99/0x3234de053c4bc5a lrc: 3/0,1 mode: --/PW res: [0x2b206:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.340910:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946278528 00000100:00100000:1.0:1651529333.340921:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208324 00000100:00100000:1.0:1651529333.340923:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000465868b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+902:39029:x1731745946278528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.340928:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176652 count 1 00010000:00010000:1.0:1651529333.340932:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4bc84 lrc: 3/0,1 mode: --/PW res: [0x2b20c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.340936:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba8240d8/0x3234de053c4531b lrc: 2/0,0 mode: PR/PR res: [0x2b20c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a923c expref: 487 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.340939:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.340940:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.340941:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4bc84 lrc: 4/0,1 mode: --/PW res: [0x2b20c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.340947:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ba8240d8/0x3234de053c4531b lrc: 3/0,0 mode: PR/PR res: [0x2b20c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a923c expref: 487 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.340950:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ba8240d8/0x3234de053c4531b lrc: 4/0,0 mode: PR/PR res: [0x2b20c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a923c expref: 487 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.340954:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000117fbeca pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996919680:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.340965:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000499d0377 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.341028:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.341571:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.341580:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.341586:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.341592:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.341598:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.341612:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.341627:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000824ca843 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996919424:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.341632:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4bc68 lrc: 3/0,1 mode: --/PW res: [0x2b208:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.341639:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fc130417 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996919552:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.341641:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4bc76 lrc: 3/0,1 mode: --/PW res: [0x2b20b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.341648:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10981 00000100:00100000:1.0:1651529333.341650:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+493:41279:x1731746394383552:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.341654:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.341655:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c439ad lrc: 4/0,0 mode: PR/PR res: [0x2b207:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2c3e expref: 493 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.341659:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c439ad lrc: 3/0,0 mode: PR/PR res: [0x2b207:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2c3e expref: 493 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.341665:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c439ad lrc: 0/0,0 mode: --/PR res: [0x2b207:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2c3e expref: 492 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.341671:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.341672:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.341680:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c4bc61 lrc: 3/0,1 mode: PW/PW res: [0x2b207:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.341683:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c4bc61 lrc: 4/0,1 mode: PW/PW res: [0x2b207:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.341697:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.341704:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+490:41279:x1731746394383552:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 54us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.341707:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10981 00000100:00100000:1.0:1651529333.341713:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10983 00000100:00100000:1.0:1651529333.341715:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+489:41278:x1731746394383872:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.341718:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.341719:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001722859c/0x3234de053c4417f lrc: 4/0,0 mode: PR/PR res: [0x2b20b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4c90 expref: 488 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.341723:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001722859c/0x3234de053c4417f lrc: 3/0,0 mode: PR/PR res: [0x2b20b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4c90 expref: 488 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.341728:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001722859c/0x3234de053c4417f lrc: 0/0,0 mode: --/PR res: [0x2b20b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4c90 expref: 488 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.341745:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.341746:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.341747:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4bc76 lrc: 3/0,1 mode: PW/PW res: [0x2b20b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.341750:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4bc76 lrc: 4/0,1 mode: PW/PW res: [0x2b20b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.341756:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.341762:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+486:41278:x1731746394383872:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 46us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.341764:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10983 00000100:00100000:1.0:1651529333.341769:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10985 00000100:00100000:1.0:1651529333.341771:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+484:41279:x1731746394383936:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.341773:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.341775:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c88eeba2/0x3234de053c45e74 lrc: 4/0,0 mode: PR/PR res: [0x2b20a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac0db expref: 484 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.341779:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c88eeba2/0x3234de053c45e74 lrc: 3/0,0 mode: PR/PR res: [0x2b20a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac0db expref: 484 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.341784:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c88eeba2/0x3234de053c45e74 lrc: 0/0,0 mode: --/PR res: [0x2b20a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac0db expref: 484 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.341787:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.341788:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.341788:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001f005b0e/0x3234de053c4bc7d lrc: 3/0,1 mode: PW/PW res: [0x2b20a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.341793:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f005b0e/0x3234de053c4bc7d lrc: 4/0,1 mode: PW/PW res: [0x2b20a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.341803:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.341808:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+482:41279:x1731746394383936:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 37us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.341811:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10985 00010000:00010000:1.0:1651529333.341819:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004a37fa99/0x3234de053c4bc5a lrc: 3/0,1 mode: PW/PW res: [0x2b206:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.341822:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a37fa99/0x3234de053c4bc5a lrc: 3/0,1 mode: PW/PW res: [0x2b206:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.341825:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a37fa99/0x3234de053c4bc5a lrc: 3/0,1 mode: PW/PW res: [0x2b206:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.341828:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a37fa99/0x3234de053c4bc5a lrc: 2/0,0 mode: PW/PW res: [0x2b206:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.341876:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+904:39030:x1731745946277952:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1504us (1595us total) trans 12885078254 rc 0/0 00000100:00100000:1.0:1651529333.341879:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208318 00010000:00010000:1.0:1651529333.341887:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a37fa99/0x3234de053c4bc5a lrc: 2/0,0 mode: PW/PW res: [0x2b206:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.341890:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004a37fa99 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.341891:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a37fa99/0x3234de053c4bc5a lrc: 2/0,0 mode: PW/PW res: [0x2b206:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.341894:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a37fa99/0x3234de053c4bc5a lrc: 3/0,0 mode: PW/PW res: [0x2b206:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.341899:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a37fa99/0x3234de053c4bc5a lrc: 1/0,0 mode: --/PW res: [0x2b206:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.341901:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a37fa99/0x3234de053c4bc5a lrc: 0/0,0 mode: --/PW res: [0x2b206:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.341907:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4bc76 lrc: 3/0,1 mode: PW/PW res: [0x2b20b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.341910:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4bc76 lrc: 3/0,1 mode: PW/PW res: [0x2b20b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.341913:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4bc76 lrc: 3/0,1 mode: PW/PW res: [0x2b20b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.341916:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4bc76 lrc: 2/0,0 mode: PW/PW res: [0x2b20b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.341957:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+905:39029:x1731745946278272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1489us (1633us total) trans 12885078256 rc 0/0 00000100:00100000:1.0:1651529333.341960:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208322 00010000:00010000:1.0:1651529333.341968:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4bc68 lrc: 3/0,1 mode: PW/PW res: [0x2b208:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.341971:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4bc68 lrc: 3/0,1 mode: PW/PW res: [0x2b208:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.341974:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4bc68 lrc: 3/0,1 mode: PW/PW res: [0x2b208:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.341977:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4bc68 lrc: 2/0,0 mode: PW/PW res: [0x2b208:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.342007:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+904:39029:x1731745946278080:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1580us (1700us total) trans 12885078257 rc 0/0 00000100:00100000:1.0:1651529333.342010:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208320 00000100:00100000:1.0:1651529333.342070:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.342081:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.342166:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394384448 00010000:00010000:1.0:1651529333.342172:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000003152710/0x3234de053c4589a lrc: 4/0,0 mode: PR/PR res: [0x2b20d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa9ab expref: 482 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.342180:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394384384 00010000:00010000:1.0:1651529333.342182:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ba8240d8/0x3234de053c4531b lrc: 5/0,0 mode: PR/PR res: [0x2b20c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a923c expref: 483 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.342192:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10986 00000100:00100000:1.0:1651529333.342193:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031e6b9e0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+483:41278:x1731746394384448:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.342196:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.342198:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000003152710/0x3234de053c4589a lrc: 4/0,0 mode: PR/PR res: [0x2b20d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa9ab expref: 483 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.342201:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000003152710/0x3234de053c4589a lrc: 3/0,0 mode: PR/PR res: [0x2b20d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa9ab expref: 483 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.342207:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003152710/0x3234de053c4589a lrc: 0/0,0 mode: --/PR res: [0x2b20d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa9ab expref: 483 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.342211:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.342211:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.342212:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c4bc8b lrc: 3/0,1 mode: PW/PW res: [0x2b20d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.342215:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c4bc8b lrc: 4/0,1 mode: PW/PW res: [0x2b20d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.342233:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.342243:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031e6b9e0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+482:41278:x1731746394384448:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 49us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.342245:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10986 00010000:00010000:1.0:1651529333.342267:0:72397:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba8240d8/0x3234de053c4531b lrc: 0/0,0 mode: --/PR res: [0x2b20c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a923c expref: 481 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.342272:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000117fbeca pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996919680:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.342275:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4bc84 lrc: 3/0,1 mode: PW/PW res: [0x2b20c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.342281:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4bc84 lrc: 3/0,1 mode: PW/PW res: [0x2b20c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.342284:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4bc84 lrc: 3/0,1 mode: PW/PW res: [0x2b20c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.342287:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4bc84 lrc: 3/0,1 mode: PW/PW res: [0x2b20c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.342290:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4bc84 lrc: 2/0,0 mode: PW/PW res: [0x2b20c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.342340:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000465868b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+905:39029:x1731745946278528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1416us (1506us total) trans 12885078259 rc 0/0 00000100:00100000:1.0:1651529333.342343:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208324 00010000:00010000:1.0:1651529333.342362:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c4bc8b lrc: 2/0,0 mode: PW/PW res: [0x2b20d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.342365:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000004c7843a already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.342366:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c4bc8b lrc: 2/0,0 mode: PW/PW res: [0x2b20d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.342369:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c4bc8b lrc: 3/0,0 mode: PW/PW res: [0x2b20d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.342374:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c4bc8b lrc: 1/0,0 mode: --/PW res: [0x2b20d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.342377:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c4bc8b lrc: 0/0,0 mode: --/PW res: [0x2b20d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.342393:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.342448:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394384640 00000100:00100000:1.0:1651529333.342459:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 208326 00000100:00100000:1.0:1651529333.342461:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+480:41278:x1731746394384640:12345-10.240.43.64@tcp:101:ll_agl_410261.0 00010000:00010000:1.0:1651529333.342465:0:72397:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529333.342469:0:72397:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008d96b78/0x3234de053c4bc92 lrc: 2/0,0 mode: --/PR res: [0x2b927:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2cc5e6 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529333.342474:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b927:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529333.342484:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.342485:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.342487:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008d96b78/0x3234de053c4bc92 lrc: 3/0,0 mode: PR/PR res: [0x2b927:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5e6 expref: 481 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.342491:0:72397:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000008d96b78/0x3234de053c4bc92 lrc: 3/0,0 mode: PR/PR res: [0x2b927:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5e6 expref: 481 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.342495:0:72397:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000008d96b78, rc 0) 00000100:00100000:1.0:1651529333.342503:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+481:41278:x1731746394384640:12345-10.240.43.64@tcp:101:ll_agl_410261.0 Request processed in 41us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.342505:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 208326 00000100:00100000:1.0:1651529333.342541:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.342569:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.342579:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.342588:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.342603:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.342609:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.342619:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.342625:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946278848 00000100:00100000:1.0:1651529333.342630:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946278976 00000100:00100000:1.0:1651529333.342633:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208327 00000100:00100000:1.0:1651529333.342635:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+909:39029:x1731745946278656:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.342655:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176654 count 1 00010000:00010000:1.0:1651529333.342659:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f423b01c/0x3234de053c4bca0 lrc: 3/0,1 mode: --/PW res: [0x2b20e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.342664:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008cf3b4c5/0x3234de053c44687 lrc: 2/0,0 mode: PR/PR res: [0x2b20e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a60fd expref: 481 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.342667:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.342668:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.342669:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f423b01c/0x3234de053c4bca0 lrc: 4/0,1 mode: --/PW res: [0x2b20e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.342676:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008cf3b4c5/0x3234de053c44687 lrc: 3/0,0 mode: PR/PR res: [0x2b20e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a60fd expref: 481 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.342679:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008cf3b4c5/0x3234de053c44687 lrc: 4/0,0 mode: PR/PR res: [0x2b20e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a60fd expref: 481 pid: 72395 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.342684:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006aa45e66 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996919872:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.342694:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000babe2d90 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.342701:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 208329 00000100:00100000:1.0:1651529333.342703:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+481:41278:x1731746394384704:12345-10.240.43.64@tcp:101:ll_agl_410261.0 00010000:00010000:1.0:1651529333.342706:0:80276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529333.342709:0:80276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001947a788/0x3234de053c4bca7 lrc: 2/0,0 mode: --/PR res: [0x2b514:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2cc5ed expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529333.342714:0:80276:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b514:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529333.342718:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.342718:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.342720:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001947a788/0x3234de053c4bca7 lrc: 3/0,0 mode: PR/PR res: [0x2b514:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5ed expref: 482 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.342724:0:80276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001947a788/0x3234de053c4bca7 lrc: 3/0,0 mode: PR/PR res: [0x2b514:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5ed expref: 482 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.342728:0:80276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001947a788, rc 0) 00000100:00100000:1.0:1651529333.342747:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+482:41278:x1731746394384704:12345-10.240.43.64@tcp:101:ll_agl_410261.0 Request processed in 43us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.342750:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 208329 00000100:00100000:1.0:1651529333.342755:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208331 00000100:00100000:1.0:1651529333.342757:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+909:39029:x1731745946278912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.342761:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176658 count 1 00010000:00010000:1.0:1651529333.342765:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4bcb5 lrc: 3/0,1 mode: --/PW res: [0x2b212:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.342769:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c44c4c lrc: 2/0,0 mode: PR/PR res: [0x2b212:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a77af expref: 481 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.342772:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.342773:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.342773:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4bcb5 lrc: 4/0,1 mode: --/PW res: [0x2b212:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.342780:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c44c4c lrc: 3/0,0 mode: PR/PR res: [0x2b212:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a77af expref: 481 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.342783:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c44c4c lrc: 4/0,0 mode: PR/PR res: [0x2b212:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a77af expref: 481 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.342787:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006e3eb319 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996920000:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.342794:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000007d8fabda going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.342800:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208333 00000100:00100000:1.0:1651529333.342802:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+909:39029:x1731745946278976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.342806:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176659 count 1 00010000:00010000:1.0:1651529333.342809:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a24dc11/0x3234de053c4bcc3 lrc: 3/0,1 mode: --/PW res: [0x2b213:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.342813:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004e503090/0x3234de053c43e8b lrc: 2/0,0 mode: PR/PR res: [0x2b213:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3faf expref: 481 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.342816:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.342817:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.342818:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a24dc11/0x3234de053c4bcc3 lrc: 4/0,1 mode: --/PW res: [0x2b213:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.342826:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004e503090/0x3234de053c43e8b lrc: 3/0,0 mode: PR/PR res: [0x2b213:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3faf expref: 481 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.342830:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004e503090/0x3234de053c43e8b lrc: 4/0,0 mode: PR/PR res: [0x2b213:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3faf expref: 481 pid: 72395 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.342834:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996920128:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.342839:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd96f074 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.342852:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.342866:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.342941:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208335 00000100:00100000:1.0:1651529333.342943:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+911:39029:x1731745946279552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.342948:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176661 count 1 00010000:00010000:1.0:1651529333.342952:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4bcd1 lrc: 3/0,1 mode: --/PW res: [0x2b215:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.342957:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000111401ed/0x3234de053c46398 lrc: 2/0,0 mode: PR/PR res: [0x2b215:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad5a3 expref: 481 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.342967:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.342968:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.342969:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4bcd1 lrc: 4/0,1 mode: --/PW res: [0x2b215:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.342981:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000111401ed/0x3234de053c46398 lrc: 3/0,0 mode: PR/PR res: [0x2b215:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad5a3 expref: 481 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.342987:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000111401ed/0x3234de053c46398 lrc: 4/0,0 mode: PR/PR res: [0x2b215:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad5a3 expref: 481 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.342991:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000097928145 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996920256:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.343000:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.343387:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.343396:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.343405:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.343411:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.343446:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006aa45e66 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996919872:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.343450:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f423b01c/0x3234de053c4bca0 lrc: 3/0,1 mode: --/PW res: [0x2b20e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.343458:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006e3eb319 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996920000:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.343460:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4bcb5 lrc: 3/0,1 mode: --/PW res: [0x2b212:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.343466:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394385024 00010000:00010000:1.0:1651529333.343471:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000073010b6c/0x3234de053c450c8 lrc: 4/0,0 mode: PR/PR res: [0x2b210:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a886b expref: 483 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.343477:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394385088 00010000:00010000:1.0:1651529333.343479:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c44c4c lrc: 4/0,0 mode: PR/PR res: [0x2b212:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a77af expref: 485 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.343487:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10989 00000100:00100000:1.0:1651529333.343488:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+485:41279:x1731746394385024:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.343491:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.343493:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 0000000073010b6c/0x3234de053c450c8 lrc: 4/0,0 mode: PR/PR res: [0x2b210:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a886b expref: 485 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.343496:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000073010b6c/0x3234de053c450c8 lrc: 3/0,0 mode: PR/PR res: [0x2b210:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a886b expref: 485 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.343502:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073010b6c/0x3234de053c450c8 lrc: 0/0,0 mode: --/PR res: [0x2b210:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a886b expref: 484 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.343506:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.343506:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.343507:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9cecf0c/0x3234de053c4bcae lrc: 3/0,1 mode: PW/PW res: [0x2b210:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.343510:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9cecf0c/0x3234de053c4bcae lrc: 4/0,1 mode: PW/PW res: [0x2b210:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.343527:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.343539:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+483:41279:x1731746394385024:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 50us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.343542:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10989 00000100:00100000:1.0:1651529333.343547:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10991 00000100:00100000:1.0:1651529333.343549:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+481:41278:x1731746394385088:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529333.343552:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.343553:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c44c4c lrc: 4/0,0 mode: PR/PR res: [0x2b212:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a77af expref: 481 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.343557:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c44c4c lrc: 3/0,0 mode: PR/PR res: [0x2b212:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a77af expref: 481 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.343562:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c44c4c lrc: 0/0,0 mode: --/PR res: [0x2b212:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a77af expref: 480 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.343565:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.343566:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.343567:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4bcb5 lrc: 3/0,1 mode: PW/PW res: [0x2b212:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.343569:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4bcb5 lrc: 4/0,1 mode: PW/PW res: [0x2b212:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.343575:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.343581:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+479:41278:x1731746394385088:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 31us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.343584:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10991 00000100:00100000:1.0:1651529333.343595:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996920128:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.343598:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009a24dc11/0x3234de053c4bcc3 lrc: 3/0,1 mode: --/PW res: [0x2b213:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.343603:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4bcb5 lrc: 3/0,1 mode: PW/PW res: [0x2b212:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.343606:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4bcb5 lrc: 3/0,1 mode: PW/PW res: [0x2b212:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.343609:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4bcb5 lrc: 3/0,1 mode: PW/PW res: [0x2b212:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.343612:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4bcb5 lrc: 2/0,0 mode: PW/PW res: [0x2b212:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.343664:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+912:39029:x1731745946278912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 906us (1060us total) trans 12885078262 rc 0/0 00000100:00100000:1.0:1651529333.343667:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208331 00010000:00010000:1.0:1651529333.343674:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f423b01c/0x3234de053c4bca0 lrc: 3/0,1 mode: PW/PW res: [0x2b20e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.343677:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f423b01c/0x3234de053c4bca0 lrc: 3/0,1 mode: PW/PW res: [0x2b20e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.343680:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f423b01c/0x3234de053c4bca0 lrc: 3/0,1 mode: PW/PW res: [0x2b20e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.343683:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f423b01c/0x3234de053c4bca0 lrc: 2/0,0 mode: PW/PW res: [0x2b20e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.343715:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+912:39029:x1731745946278656:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1079us (1174us total) trans 12885078263 rc 0/0 00000100:00100000:1.0:1651529333.343719:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208327 00000100:00100000:1.0:1651529333.343975:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.343989:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.343995:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.344004:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.344011:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.344016:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.344032:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.344042:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.344051:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.344060:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000097928145 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996920256:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.344065:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4bcd1 lrc: 3/0,1 mode: --/PW res: [0x2b215:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.344073:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208337 00000100:00100000:1.0:1651529333.344075:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+915:39029:x1731745946279680:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.344080:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176663 count 1 00010000:00010000:1.0:1651529333.344084:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4bcdf lrc: 3/0,1 mode: --/PW res: [0x2b217:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.344089:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000e50faad/0x3234de053c465cf lrc: 2/0,0 mode: PR/PR res: [0x2b217:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2adeef expref: 478 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.344092:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.344093:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.344093:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4bcdf lrc: 4/0,1 mode: --/PW res: [0x2b217:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.344100:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000e50faad/0x3234de053c465cf lrc: 3/0,0 mode: PR/PR res: [0x2b217:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2adeef expref: 478 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.344104:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000e50faad/0x3234de053c465cf lrc: 4/0,0 mode: PR/PR res: [0x2b217:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2adeef expref: 478 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.344116:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c9f4ec84 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996920384:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.344125:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.344130:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394385152 00010000:00010000:1.0:1651529333.344135:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007517a3b9/0x3234de053c460ab lrc: 4/0,0 mode: PR/PR res: [0x2b211:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac90f expref: 479 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.344140:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394385280 00010000:00010000:1.0:1651529333.344143:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004e503090/0x3234de053c43e8b lrc: 4/0,0 mode: PR/PR res: [0x2b213:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3faf expref: 480 pid: 72395 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.344147:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394385408 00010000:00010000:1.0:1651529333.344149:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009c307aec/0x3234de053c4447a lrc: 4/0,0 mode: PR/PR res: [0x2b214:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a587c expref: 481 pid: 72395 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.344153:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394385536 00010000:00010000:1.0:1651529333.344155:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000111401ed/0x3234de053c46398 lrc: 4/0,0 mode: PR/PR res: [0x2b215:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad5a3 expref: 482 pid: 106695 timeout: 20141 lvb_type: 1 00000100:00100000:1.0:1651529333.344159:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10992 00000100:00100000:1.0:1651529333.344161:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+482:41279:x1731746394385152:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.344164:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.344165:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 000000007517a3b9/0x3234de053c460ab lrc: 4/0,0 mode: PR/PR res: [0x2b211:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac90f expref: 482 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.344169:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007517a3b9/0x3234de053c460ab lrc: 3/0,0 mode: PR/PR res: [0x2b211:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac90f expref: 482 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.344174:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007517a3b9/0x3234de053c460ab lrc: 0/0,0 mode: --/PR res: [0x2b211:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac90f expref: 482 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.344178:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.344178:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.344179:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f88ef7eb/0x3234de053c4bcbc lrc: 3/0,1 mode: PW/PW res: [0x2b211:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.344182:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f88ef7eb/0x3234de053c4bcbc lrc: 4/0,1 mode: PW/PW res: [0x2b211:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.344194:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.344200:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+481:41279:x1731746394385152:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 39us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.344203:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10992 00000100:00100000:1.0:1651529333.344208:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10993 00000100:00100000:1.0:1651529333.344209:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d17e32b2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+480:41279:x1731746394385280:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.344212:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.344213:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 000000004e503090/0x3234de053c43e8b lrc: 4/0,0 mode: PR/PR res: [0x2b213:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3faf expref: 480 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.344219:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004e503090/0x3234de053c43e8b lrc: 3/0,0 mode: PR/PR res: [0x2b213:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3faf expref: 480 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.344235:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e503090/0x3234de053c43e8b lrc: 0/0,0 mode: --/PR res: [0x2b213:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3faf expref: 480 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.344247:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.344247:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.344248:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009a24dc11/0x3234de053c4bcc3 lrc: 3/0,1 mode: PW/PW res: [0x2b213:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.344251:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a24dc11/0x3234de053c4bcc3 lrc: 4/0,1 mode: PW/PW res: [0x2b213:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.344257:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.344263:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d17e32b2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+480:41279:x1731746394385280:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 53us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.344265:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10993 00000100:00100000:1.0:1651529333.344273:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10994 00000100:00100000:1.0:1651529333.344275:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+478:41279:x1731746394385408:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.344277:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.344279:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 000000009c307aec/0x3234de053c4447a lrc: 4/0,0 mode: PR/PR res: [0x2b214:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a587c expref: 478 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.344282:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009c307aec/0x3234de053c4447a lrc: 3/0,0 mode: PR/PR res: [0x2b214:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a587c expref: 478 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.344287:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c307aec/0x3234de053c4447a lrc: 0/0,0 mode: --/PR res: [0x2b214:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a587c expref: 478 pid: 72395 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.344291:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.344291:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.344292:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c4bcca lrc: 3/0,1 mode: PW/PW res: [0x2b214:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.344295:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c4bcca lrc: 4/0,1 mode: PW/PW res: [0x2b214:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.344304:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.344309:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+477:41279:x1731746394385408:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 34us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.344311:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10994 00000100:00100000:1.0:1651529333.344316:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10995 00000100:00100000:1.0:1651529333.344317:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+476:41279:x1731746394385536:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.344319:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.344321:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 00000000111401ed/0x3234de053c46398 lrc: 4/0,0 mode: PR/PR res: [0x2b215:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad5a3 expref: 476 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.344324:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000111401ed/0x3234de053c46398 lrc: 3/0,0 mode: PR/PR res: [0x2b215:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad5a3 expref: 476 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.344328:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000111401ed/0x3234de053c46398 lrc: 0/0,0 mode: --/PR res: [0x2b215:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad5a3 expref: 476 pid: 106695 timeout: 20141 lvb_type: 1 00010000:00010000:1.0:1651529333.344334:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.344335:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.344335:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4bcd1 lrc: 3/0,1 mode: PW/PW res: [0x2b215:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.344338:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4bcd1 lrc: 4/0,1 mode: PW/PW res: [0x2b215:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.344344:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.344348:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+475:41279:x1731746394385536:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 30us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.344350:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10995 00010000:00010000:1.0:1651529333.344359:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009a24dc11/0x3234de053c4bcc3 lrc: 3/0,1 mode: PW/PW res: [0x2b213:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.344362:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a24dc11/0x3234de053c4bcc3 lrc: 3/0,1 mode: PW/PW res: [0x2b213:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.344365:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a24dc11/0x3234de053c4bcc3 lrc: 3/0,1 mode: PW/PW res: [0x2b213:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.344368:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a24dc11/0x3234de053c4bcc3 lrc: 2/0,0 mode: PW/PW res: [0x2b213:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.344407:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+917:39029:x1731745946278976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1604us (1788us total) trans 12885078266 rc 0/0 00000100:00100000:1.0:1651529333.344410:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208333 00010000:00010000:1.0:1651529333.344417:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a24dc11/0x3234de053c4bcc3 lrc: 2/0,0 mode: PW/PW res: [0x2b213:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.344421:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009a24dc11 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.344422:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a24dc11/0x3234de053c4bcc3 lrc: 2/0,0 mode: PW/PW res: [0x2b213:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.344425:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a24dc11/0x3234de053c4bcc3 lrc: 3/0,0 mode: PW/PW res: [0x2b213:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.344429:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a24dc11/0x3234de053c4bcc3 lrc: 1/0,0 mode: --/PW res: [0x2b213:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.344432:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a24dc11/0x3234de053c4bcc3 lrc: 0/0,0 mode: --/PW res: [0x2b213:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.344438:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4bcd1 lrc: 3/0,1 mode: PW/PW res: [0x2b215:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.344441:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4bcd1 lrc: 3/0,1 mode: PW/PW res: [0x2b215:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.344444:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4bcd1 lrc: 3/0,1 mode: PW/PW res: [0x2b215:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.344447:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4bcd1 lrc: 2/0,0 mode: PW/PW res: [0x2b215:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.344486:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+916:39029:x1731745946279552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1542us (1619us total) trans 12885078268 rc 0/0 00000100:00100000:1.0:1651529333.344489:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208335 00000100:00100000:1.0:1651529333.344615:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.344623:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394386176 00000100:00100000:1.0:1651529333.344633:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 208341 00000100:00100000:1.0:1651529333.344635:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+475:41279:x1731746394386176:12345-10.240.43.64@tcp:101:ll_agl_410261.0 00010000:00010000:1.0:1651529333.344639:0:72397:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529333.344643:0:72397:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002310563/0x3234de053c4bcfb lrc: 2/0,0 mode: --/PR res: [0x2b521:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2cc610 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529333.344649:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b521:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529333.344653:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.344653:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.344655:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002310563/0x3234de053c4bcfb lrc: 3/0,0 mode: PR/PR res: [0x2b521:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc610 expref: 476 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.344660:0:72397:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000002310563/0x3234de053c4bcfb lrc: 3/0,0 mode: PR/PR res: [0x2b521:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc610 expref: 476 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.344663:0:72397:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000002310563, rc 0) 00000100:00100000:1.0:1651529333.344673:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+476:41279:x1731746394386176:12345-10.240.43.64@tcp:101:ll_agl_410261.0 Request processed in 37us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.344675:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 208341 00000100:00100000:1.0:1651529333.344853:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c9f4ec84 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996920384:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.344858:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4bcdf lrc: 3/0,1 mode: --/PW res: [0x2b217:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.344899:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.344929:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.344939:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.344946:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.344955:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946279872 00000100:00100000:1.0:1651529333.344970:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208342 00000100:00100000:1.0:1651529333.344972:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+919:39029:x1731745946279936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.344977:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176667 count 1 00010000:00010000:1.0:1651529333.344982:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f6c33eb/0x3234de053c4bd02 lrc: 3/0,1 mode: --/PW res: [0x2b21b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.344987:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000089184c32/0x3234de053c44f2b lrc: 2/0,0 mode: PR/PR res: [0x2b21b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8267 expref: 475 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.344990:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.344990:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.344991:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f6c33eb/0x3234de053c4bd02 lrc: 4/0,1 mode: --/PW res: [0x2b21b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.345004:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000089184c32/0x3234de053c44f2b lrc: 3/0,0 mode: PR/PR res: [0x2b21b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8267 expref: 475 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.345008:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000089184c32/0x3234de053c44f2b lrc: 4/0,0 mode: PR/PR res: [0x2b21b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8267 expref: 475 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.345012:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000050bbb886 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996920576:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.345022:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000499d0377 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.345028:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208344 00000100:00100000:1.0:1651529333.345030:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+919:39030:x1731745946279872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.345034:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176666 count 1 00010000:00010000:1.0:1651529333.345037:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f2d383f/0x3234de053c4bd10 lrc: 3/0,1 mode: --/PW res: [0x2b21a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.345041:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000098fbfd16/0x3234de053c4425f lrc: 2/0,0 mode: PR/PR res: [0x2b21a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5017 expref: 475 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.345045:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.345045:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.345046:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f2d383f/0x3234de053c4bd10 lrc: 4/0,1 mode: --/PW res: [0x2b21a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.345052:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000098fbfd16/0x3234de053c4425f lrc: 3/0,0 mode: PR/PR res: [0x2b21a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5017 expref: 475 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.345055:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000098fbfd16/0x3234de053c4425f lrc: 4/0,0 mode: PR/PR res: [0x2b21a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5017 expref: 475 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.345059:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007ac35c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996920704:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.345065:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e5f43e7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.345077:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.345095:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.345142:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10997 00000100:00100000:1.0:1651529333.345145:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+477:41278:x1731746394386368:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.345148:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.345150:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007b2ed404/0x3234de053c4656d lrc: 4/0,0 mode: PR/PR res: [0x2b219:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2add7c expref: 476 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.345154:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007b2ed404/0x3234de053c4656d lrc: 3/0,0 mode: PR/PR res: [0x2b219:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2add7c expref: 476 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.345160:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b2ed404/0x3234de053c4656d lrc: 0/0,0 mode: --/PR res: [0x2b219:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2add7c expref: 476 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.345164:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.345164:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.345165:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ad242558/0x3234de053c4bce6 lrc: 3/0,1 mode: PW/PW res: [0x2b219:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.345168:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad242558/0x3234de053c4bce6 lrc: 4/0,1 mode: PW/PW res: [0x2b219:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.345183:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.345191:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+474:41278:x1731746394386368:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 45us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.345193:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10997 00010000:00010000:1.0:1651529333.345250:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083b7e42d/0x3234de053c4bcd8 lrc: 2/0,0 mode: PW/PW res: [0x2b216:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.345254:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000083b7e42d already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.345255:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083b7e42d/0x3234de053c4bcd8 lrc: 2/0,0 mode: PW/PW res: [0x2b216:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.345269:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083b7e42d/0x3234de053c4bcd8 lrc: 3/0,0 mode: PW/PW res: [0x2b216:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.345275:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083b7e42d/0x3234de053c4bcd8 lrc: 1/0,0 mode: --/PW res: [0x2b216:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.345277:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083b7e42d/0x3234de053c4bcd8 lrc: 0/0,0 mode: --/PW res: [0x2b216:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.345377:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.345385:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.345391:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394386304 00010000:00010000:1.0:1651529333.345396:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000e50faad/0x3234de053c465cf lrc: 4/0,0 mode: PR/PR res: [0x2b217:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2adeef expref: 474 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.345403:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394386432 00010000:00010000:1.0:1651529333.345405:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fcf53214/0x3234de053c4660e lrc: 4/0,0 mode: PR/PR res: [0x2b218:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae04d expref: 475 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.345415:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10998 00000100:00100000:1.0:1651529333.345416:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+475:41279:x1731746394386304:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.345419:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.345421:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000e50faad/0x3234de053c465cf lrc: 4/0,0 mode: PR/PR res: [0x2b217:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2adeef expref: 475 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.345424:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000e50faad/0x3234de053c465cf lrc: 3/0,0 mode: PR/PR res: [0x2b217:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2adeef expref: 475 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.345430:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e50faad/0x3234de053c465cf lrc: 0/0,0 mode: --/PR res: [0x2b217:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2adeef expref: 475 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.345434:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.345434:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.345435:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4bcdf lrc: 3/0,1 mode: PW/PW res: [0x2b217:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.345438:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4bcdf lrc: 4/0,1 mode: PW/PW res: [0x2b217:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.345445:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.345452:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+473:41279:x1731746394386304:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 35us (76us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.345455:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10998 00010000:00010000:1.0:1651529333.345462:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4bcdf lrc: 3/0,1 mode: PW/PW res: [0x2b217:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.345465:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4bcdf lrc: 3/0,1 mode: PW/PW res: [0x2b217:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.345468:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4bcdf lrc: 3/0,1 mode: PW/PW res: [0x2b217:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.345471:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4bcdf lrc: 2/0,0 mode: PW/PW res: [0x2b217:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.345530:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+921:39029:x1731745946279680:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1454us (1540us total) trans 12885078271 rc 0/0 00000100:00100000:1.0:1651529333.345533:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208337 00010000:00010000:1.0:1651529333.345540:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4bcdf lrc: 2/0,0 mode: PW/PW res: [0x2b217:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.345543:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000828505cd already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.345544:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4bcdf lrc: 2/0,0 mode: PW/PW res: [0x2b217:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.345547:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4bcdf lrc: 3/0,0 mode: PW/PW res: [0x2b217:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.345551:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4bcdf lrc: 1/0,0 mode: --/PW res: [0x2b217:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.345554:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4bcdf lrc: 0/0,0 mode: --/PW res: [0x2b217:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.345558:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d33d4a29/0x3234de053c4bced lrc: 2/0,0 mode: PW/PW res: [0x2b218:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.345561:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d33d4a29 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.345562:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d33d4a29/0x3234de053c4bced lrc: 2/0,0 mode: PW/PW res: [0x2b218:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.345575:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d33d4a29/0x3234de053c4bced lrc: 3/0,0 mode: PW/PW res: [0x2b218:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.345579:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d33d4a29/0x3234de053c4bced lrc: 1/0,0 mode: --/PW res: [0x2b218:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.345582:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d33d4a29/0x3234de053c4bced lrc: 0/0,0 mode: --/PW res: [0x2b218:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.345597:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.345717:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.345727:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.345746:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.345767:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.345773:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.345786:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000050bbb886 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996920576:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.345791:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005f6c33eb/0x3234de053c4bd02 lrc: 3/0,1 mode: --/PW res: [0x2b21b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.345798:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007ac35c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996920704:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.345801:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009f2d383f/0x3234de053c4bd10 lrc: 3/0,1 mode: --/PW res: [0x2b21a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.345807:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11001 00000100:00100000:1.0:1651529333.345809:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+475:41278:x1731746394386816:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.345812:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.345814:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000098fbfd16/0x3234de053c4425f lrc: 4/0,0 mode: PR/PR res: [0x2b21a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5017 expref: 475 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.345818:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000098fbfd16/0x3234de053c4425f lrc: 3/0,0 mode: PR/PR res: [0x2b21a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5017 expref: 475 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.345823:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098fbfd16/0x3234de053c4425f lrc: 0/0,0 mode: --/PR res: [0x2b21a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5017 expref: 474 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.345827:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.345828:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.345829:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009f2d383f/0x3234de053c4bd10 lrc: 3/0,1 mode: PW/PW res: [0x2b21a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.345832:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f2d383f/0x3234de053c4bd10 lrc: 4/0,1 mode: PW/PW res: [0x2b21a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.345838:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.345865:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+473:41278:x1731746394386816:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 55us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.345868:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11001 00000100:00100000:1.0:1651529333.345873:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11002 00000100:00100000:1.0:1651529333.345875:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+471:41279:x1731746394386752:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.345878:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.345879:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000025bdc9fc/0x3234de053c44ca7 lrc: 4/0,0 mode: PR/PR res: [0x2b21d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7937 expref: 471 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.345886:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000025bdc9fc/0x3234de053c44ca7 lrc: 3/0,0 mode: PR/PR res: [0x2b21d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7937 expref: 471 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.345891:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025bdc9fc/0x3234de053c44ca7 lrc: 0/0,0 mode: --/PR res: [0x2b21d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7937 expref: 471 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.345894:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.345895:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.345895:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c4bd09 lrc: 3/0,1 mode: PW/PW res: [0x2b21d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.345899:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c4bd09 lrc: 4/0,1 mode: PW/PW res: [0x2b21d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.345908:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.345914:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+469:41279:x1731746394386752:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 38us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.345916:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11002 00010000:00010000:1.0:1651529333.345924:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009f2d383f/0x3234de053c4bd10 lrc: 3/0,1 mode: PW/PW res: [0x2b21a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.345927:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f2d383f/0x3234de053c4bd10 lrc: 3/0,1 mode: PW/PW res: [0x2b21a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.345930:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f2d383f/0x3234de053c4bd10 lrc: 3/0,1 mode: PW/PW res: [0x2b21a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.345935:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f2d383f/0x3234de053c4bd10 lrc: 2/0,0 mode: PW/PW res: [0x2b21a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.345977:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+921:39030:x1731745946279872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 946us (1048us total) trans 12885078273 rc 0/0 00000100:00100000:1.0:1651529333.345980:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208344 00000100:00100000:1.0:1651529333.345985:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946280192 00000100:00100000:1.0:1651529333.346002:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208347 00000100:00100000:1.0:1651529333.346003:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+921:39029:x1731745946280192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.346009:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176671 count 1 00010000:00010000:1.0:1651529333.346013:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000158a383a/0x3234de053c4bd25 lrc: 3/0,1 mode: --/PW res: [0x2b21f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.346018:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e0a98e9b/0x3234de053c459c7 lrc: 2/0,0 mode: PR/PR res: [0x2b21f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aae4a expref: 467 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.346021:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.346021:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.346022:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000158a383a/0x3234de053c4bd25 lrc: 4/0,1 mode: --/PW res: [0x2b21f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.346028:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e0a98e9b/0x3234de053c459c7 lrc: 3/0,0 mode: PR/PR res: [0x2b21f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aae4a expref: 467 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.346032:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e0a98e9b/0x3234de053c459c7 lrc: 4/0,0 mode: PR/PR res: [0x2b21f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aae4a expref: 467 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.346039:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000117fbeca pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996920896:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.346047:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e5f43e7 going to sleep for 6 seconds 00010000:00010000:1.0:1651529333.346052:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005f6c33eb/0x3234de053c4bd02 lrc: 3/0,1 mode: PW/PW res: [0x2b21b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.346055:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f6c33eb/0x3234de053c4bd02 lrc: 3/0,1 mode: PW/PW res: [0x2b21b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.346058:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f6c33eb/0x3234de053c4bd02 lrc: 3/0,1 mode: PW/PW res: [0x2b21b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.346061:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f6c33eb/0x3234de053c4bd02 lrc: 2/0,0 mode: PW/PW res: [0x2b21b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.346102:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+922:39029:x1731745946279936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1130us (1203us total) trans 12885078276 rc 0/0 00000100:00100000:1.0:1651529333.346105:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208342 00010000:00010000:1.0:1651529333.346113:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c4bd09 lrc: 2/0,0 mode: PW/PW res: [0x2b21d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.346116:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000b62c3c9 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.346117:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c4bd09 lrc: 2/0,0 mode: PW/PW res: [0x2b21d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.346120:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c4bd09 lrc: 3/0,0 mode: PW/PW res: [0x2b21d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.346125:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c4bd09 lrc: 1/0,0 mode: --/PW res: [0x2b21d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.346128:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c4bd09 lrc: 0/0,0 mode: --/PW res: [0x2b21d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.346143:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.346172:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.346190:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.346213:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.346340:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394387072 00010000:00010000:1.0:1651529333.346346:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000067aa0084/0x3234de053c45cad lrc: 5/0,0 mode: PR/PR res: [0x2b21e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab9b8 expref: 469 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.346357:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11004 00000100:00100000:1.0:1651529333.346359:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+470:41278:x1731746394387072:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.346363:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.346364:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000067aa0084/0x3234de053c45cad lrc: 5/0,0 mode: PR/PR res: [0x2b21e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab9b8 expref: 470 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.346368:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000067aa0084/0x3234de053c45cad lrc: 4/0,0 mode: PR/PR res: [0x2b21e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab9b8 expref: 470 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.346374:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.346374:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.346375:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000079489ed7/0x3234de053c4bd1e lrc: 3/0,1 mode: PW/PW res: [0x2b21e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.346384:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079489ed7/0x3234de053c4bd1e lrc: 4/0,1 mode: PW/PW res: [0x2b21e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.346390:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.346397:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+469:41278:x1731746394387072:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 37us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.346399:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11004 00000100:00100000:1.0:1651529333.346451:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.346475:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.346483:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.346513:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529333.346520:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079489ed7/0x3234de053c4bd1e lrc: 2/0,0 mode: PW/PW res: [0x2b21e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.346524:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000079489ed7 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.346525:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079489ed7/0x3234de053c4bd1e lrc: 2/0,0 mode: PW/PW res: [0x2b21e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.346528:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079489ed7/0x3234de053c4bd1e lrc: 3/0,0 mode: PW/PW res: [0x2b21e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.346533:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079489ed7/0x3234de053c4bd1e lrc: 1/0,0 mode: --/PW res: [0x2b21e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.346541:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079489ed7/0x3234de053c4bd1e lrc: 0/0,0 mode: --/PW res: [0x2b21e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.346552:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208352 00000100:00100000:1.0:1651529333.346554:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+927:39029:x1731745946280448:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.346559:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176675 count 1 00010000:00010000:1.0:1651529333.346563:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4bd48 lrc: 3/0,1 mode: --/PW res: [0x2b223:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.346567:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d7fdf0a9/0x3234de053c44e67 lrc: 2/0,0 mode: PR/PR res: [0x2b223:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7f49 expref: 467 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.346570:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.346571:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.346572:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4bd48 lrc: 4/0,1 mode: --/PW res: [0x2b223:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.346579:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d7fdf0a9/0x3234de053c44e67 lrc: 3/0,0 mode: PR/PR res: [0x2b223:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7f49 expref: 467 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.346582:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d7fdf0a9/0x3234de053c44e67 lrc: 4/0,0 mode: PR/PR res: [0x2b223:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7f49 expref: 467 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.346587:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000050bbb886 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996921152:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.346596:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000499d0377 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.346602:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208354 00000100:00100000:1.0:1651529333.346604:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+927:39029:x1731745946280576:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.346608:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176677 count 1 00010000:00010000:1.0:1651529333.346611:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4bd4f lrc: 3/0,1 mode: --/PW res: [0x2b225:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.346615:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000857f3009/0x3234de053c45559 lrc: 2/0,0 mode: PR/PR res: [0x2b225:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9b3b expref: 467 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.346618:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.346619:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.346619:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4bd4f lrc: 4/0,1 mode: --/PW res: [0x2b225:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.346625:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000857f3009/0x3234de053c45559 lrc: 3/0,0 mode: PR/PR res: [0x2b225:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9b3b expref: 467 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.346629:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000857f3009/0x3234de053c45559 lrc: 4/0,0 mode: PR/PR res: [0x2b225:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9b3b expref: 467 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.346633:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000054e3a257 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996921216:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.346638:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 000000007d8fabda going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.346651:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.346666:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.346770:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.346777:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.346785:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.346796:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000117fbeca pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996920896:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.346800:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000158a383a/0x3234de053c4bd25 lrc: 3/0,1 mode: --/PW res: [0x2b21f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.346809:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394387328 00010000:00010000:1.0:1651529333.346820:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001db46651/0x3234de053c44966 lrc: 5/0,0 mode: PR/PR res: [0x2b220:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6cb1 expref: 469 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.346826:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394387264 00010000:00010000:1.0:1651529333.346828:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e0a98e9b/0x3234de053c459c7 lrc: 4/0,0 mode: PR/PR res: [0x2b21f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aae4a expref: 470 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.346832:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394387392 00010000:00010000:1.0:1651529333.346834:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002a764502/0x3234de053c44d5d lrc: 4/0,0 mode: PR/PR res: [0x2b221:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7bfa expref: 471 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.346839:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11005 00000100:00100000:1.0:1651529333.346840:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+471:41279:x1731746394387328:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.346843:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.346844:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001db46651/0x3234de053c44966 lrc: 4/0,0 mode: PR/PR res: [0x2b220:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6cb1 expref: 471 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.346848:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001db46651/0x3234de053c44966 lrc: 3/0,0 mode: PR/PR res: [0x2b220:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6cb1 expref: 471 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.346854:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001db46651/0x3234de053c44966 lrc: 0/0,0 mode: --/PR res: [0x2b220:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6cb1 expref: 471 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.346858:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.346858:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.346859:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c4bd2c lrc: 3/0,1 mode: PW/PW res: [0x2b220:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.346862:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c4bd2c lrc: 4/0,1 mode: PW/PW res: [0x2b220:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.346872:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.346879:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+469:41279:x1731746394387328:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 38us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.346882:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11005 00000100:00100000:1.0:1651529333.346892:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11007 00000100:00100000:1.0:1651529333.346894:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea4c33b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+468:41278:x1731746394387392:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529333.346897:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.346898:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002a764502/0x3234de053c44d5d lrc: 4/0,0 mode: PR/PR res: [0x2b221:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7bfa expref: 468 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.346902:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002a764502/0x3234de053c44d5d lrc: 3/0,0 mode: PR/PR res: [0x2b221:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7bfa expref: 467 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.346907:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a764502/0x3234de053c44d5d lrc: 0/0,0 mode: --/PR res: [0x2b221:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7bfa expref: 467 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.346910:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.346911:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.346911:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000876c3b77/0x3234de053c4bd33 lrc: 3/0,1 mode: PW/PW res: [0x2b221:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.346917:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000876c3b77/0x3234de053c4bd33 lrc: 4/0,1 mode: PW/PW res: [0x2b221:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.346925:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.346931:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea4c33b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+466:41278:x1731746394387392:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.346933:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11007 00010000:00010000:1.0:1651529333.346945:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000158a383a/0x3234de053c4bd25 lrc: 3/0,1 mode: PW/PW res: [0x2b21f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.346948:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000158a383a/0x3234de053c4bd25 lrc: 3/0,1 mode: PW/PW res: [0x2b21f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.346951:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000158a383a/0x3234de053c4bd25 lrc: 3/0,1 mode: PW/PW res: [0x2b21f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.346954:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000158a383a/0x3234de053c4bd25 lrc: 2/0,0 mode: PW/PW res: [0x2b21f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.346997:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+929:39029:x1731745946280192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 993us (1223us total) trans 12885078279 rc 0/0 00000100:00100000:1.0:1651529333.347000:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208347 00010000:00010000:1.0:1651529333.347075:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000876c3b77/0x3234de053c4bd33 lrc: 2/0,0 mode: PW/PW res: [0x2b221:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.347079:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000876c3b77 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.347080:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000876c3b77/0x3234de053c4bd33 lrc: 2/0,0 mode: PW/PW res: [0x2b221:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.347083:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000876c3b77/0x3234de053c4bd33 lrc: 3/0,0 mode: PW/PW res: [0x2b221:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.347088:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000876c3b77/0x3234de053c4bd33 lrc: 1/0,0 mode: --/PW res: [0x2b221:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.347091:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000876c3b77/0x3234de053c4bd33 lrc: 0/0,0 mode: --/PW res: [0x2b221:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.347201:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.347212:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.347239:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946280704 00000100:00100000:1.0:1651529333.347248:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946280768 00000100:00100000:1.0:1651529333.347260:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208357 00000100:00100000:1.0:1651529333.347262:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+930:39029:x1731745946280704:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.347267:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176679 count 1 00010000:00010000:1.0:1651529333.347272:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000376045ea/0x3234de053c4bd6b lrc: 3/0,1 mode: --/PW res: [0x2b227:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.347276:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000adac6454/0x3234de053c444c7 lrc: 2/0,0 mode: PR/PR res: [0x2b227:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5994 expref: 465 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.347293:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.347294:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.347294:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000376045ea/0x3234de053c4bd6b lrc: 4/0,1 mode: --/PW res: [0x2b227:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.347305:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000adac6454/0x3234de053c444c7 lrc: 3/0,0 mode: PR/PR res: [0x2b227:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5994 expref: 465 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.347308:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000adac6454/0x3234de053c444c7 lrc: 4/0,0 mode: PR/PR res: [0x2b227:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5994 expref: 465 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.347312:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e124baf1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996921408:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.347321:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e5f43e7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.347371:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.347417:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.347424:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.347430:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.347437:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.347475:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.347484:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000050bbb886 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996921152:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.347489:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4bd48 lrc: 3/0,1 mode: --/PW res: [0x2b223:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.347495:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000054e3a257 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996921216:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.347498:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4bd4f lrc: 3/0,1 mode: --/PW res: [0x2b225:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.347504:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11008 00000100:00100000:1.0:1651529333.347506:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+470:41279:x1731746394387456:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.347510:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.347511:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c2e7fb2b/0x3234de053c43a63 lrc: 4/0,0 mode: PR/PR res: [0x2b222:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2e91 expref: 470 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.347515:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c2e7fb2b/0x3234de053c43a63 lrc: 3/0,0 mode: PR/PR res: [0x2b222:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2e91 expref: 470 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.347521:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2e7fb2b/0x3234de053c43a63 lrc: 0/0,0 mode: --/PR res: [0x2b222:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2e91 expref: 470 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.347525:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.347525:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.347526:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ed7a068d/0x3234de053c4bd41 lrc: 3/0,1 mode: PW/PW res: [0x2b222:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.347529:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed7a068d/0x3234de053c4bd41 lrc: 4/0,1 mode: PW/PW res: [0x2b222:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.347538:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.347552:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+468:41279:x1731746394387456:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 45us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.347555:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11008 00000100:00100000:1.0:1651529333.347561:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11010 00000100:00100000:1.0:1651529333.347563:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+467:41279:x1731746394387584:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.347565:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.347567:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000857f3009/0x3234de053c45559 lrc: 4/0,0 mode: PR/PR res: [0x2b225:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9b3b expref: 467 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.347574:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000857f3009/0x3234de053c45559 lrc: 3/0,0 mode: PR/PR res: [0x2b225:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9b3b expref: 467 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.347578:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000857f3009/0x3234de053c45559 lrc: 0/0,0 mode: --/PR res: [0x2b225:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9b3b expref: 466 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.347582:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.347582:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.347583:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4bd4f lrc: 3/0,1 mode: PW/PW res: [0x2b225:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.347586:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4bd4f lrc: 4/0,1 mode: PW/PW res: [0x2b225:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.347592:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.347597:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+464:41279:x1731746394387584:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 33us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.347599:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11010 00000100:00100000:1.0:1651529333.347603:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11012 00000100:00100000:1.0:1651529333.347605:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+463:41279:x1731746394387840:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.347607:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.347608:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000082b0fbe4/0x3234de053c46a59 lrc: 5/0,0 mode: PR/PR res: [0x2b226:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af195 expref: 463 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.347612:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000082b0fbe4/0x3234de053c46a59 lrc: 4/0,0 mode: PR/PR res: [0x2b226:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af195 expref: 463 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.347617:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.347617:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.347618:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e1d98a9c/0x3234de053c4bd64 lrc: 3/0,1 mode: PW/PW res: [0x2b226:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.347621:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1d98a9c/0x3234de053c4bd64 lrc: 4/0,1 mode: PW/PW res: [0x2b226:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.347624:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.347629:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+462:41279:x1731746394387840:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 23us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.347631:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11012 00010000:00010000:1.0:1651529333.347638:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4bd4f lrc: 3/0,1 mode: PW/PW res: [0x2b225:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.347641:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4bd4f lrc: 3/0,1 mode: PW/PW res: [0x2b225:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.347644:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4bd4f lrc: 3/0,1 mode: PW/PW res: [0x2b225:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.347647:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4bd4f lrc: 2/0,0 mode: PW/PW res: [0x2b225:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.347691:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+932:39029:x1731745946280576:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1086us (1177us total) trans 12885078282 rc 0/0 00000100:00100000:1.0:1651529333.347694:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208354 00010000:00010000:1.0:1651529333.347701:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4bd48 lrc: 3/0,1 mode: PW/PW res: [0x2b223:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.347705:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4bd48 lrc: 3/0,1 mode: PW/PW res: [0x2b223:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.347708:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4bd48 lrc: 3/0,1 mode: PW/PW res: [0x2b223:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.347710:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4bd48 lrc: 2/0,0 mode: PW/PW res: [0x2b223:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.347752:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+932:39029:x1731745946280448:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1198us (1283us total) trans 12885078283 rc 0/0 00000100:00100000:1.0:1651529333.347755:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208352 00000100:00100000:1.0:1651529333.347905:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e124baf1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996921408:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.347914:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000376045ea/0x3234de053c4bd6b lrc: 3/0,1 mode: --/PW res: [0x2b227:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.347955:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.347964:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.348000:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.348008:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394388032 00010000:00010000:1.0:1651529333.348013:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000adac6454/0x3234de053c444c7 lrc: 4/0,0 mode: PR/PR res: [0x2b227:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5994 expref: 461 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.348024:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394388096 00010000:00010000:1.0:1651529333.348027:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000089e57af8/0x3234de053c43dea lrc: 5/0,0 mode: PR/PR res: [0x2b228:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3cde expref: 462 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.348032:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394388160 00010000:00010000:1.0:1651529333.348034:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000966e90ab/0x3234de053c437d1 lrc: 5/0,0 mode: PR/PR res: [0x2b229:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2568 expref: 463 pid: 80281 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.348038:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11013 00000100:00100000:1.0:1651529333.348040:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+463:41278:x1731746394388032:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.348042:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.348044:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000adac6454/0x3234de053c444c7 lrc: 4/0,0 mode: PR/PR res: [0x2b227:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5994 expref: 463 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.348047:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000adac6454/0x3234de053c444c7 lrc: 3/0,0 mode: PR/PR res: [0x2b227:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5994 expref: 463 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.348053:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000adac6454/0x3234de053c444c7 lrc: 0/0,0 mode: --/PR res: [0x2b227:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5994 expref: 463 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.348056:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.348057:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.348058:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000376045ea/0x3234de053c4bd6b lrc: 3/0,1 mode: PW/PW res: [0x2b227:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.348061:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000376045ea/0x3234de053c4bd6b lrc: 4/0,1 mode: PW/PW res: [0x2b227:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.348068:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.348075:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+462:41278:x1731746394388032:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 35us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.348078:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11013 00000100:00100000:1.0:1651529333.348083:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11015 00000100:00100000:1.0:1651529333.348084:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+460:41278:x1731746394388160:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.348087:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.348088:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000966e90ab/0x3234de053c437d1 lrc: 4/0,0 mode: PR/PR res: [0x2b229:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2568 expref: 460 pid: 80281 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.348092:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000966e90ab/0x3234de053c437d1 lrc: 3/0,0 mode: PR/PR res: [0x2b229:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2568 expref: 460 pid: 80281 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.348096:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000966e90ab/0x3234de053c437d1 lrc: 0/0,0 mode: --/PR res: [0x2b229:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2568 expref: 460 pid: 80281 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.348100:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.348100:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.348101:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9cecf0c/0x3234de053c4bd79 lrc: 3/0,1 mode: PW/PW res: [0x2b229:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.348104:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9cecf0c/0x3234de053c4bd79 lrc: 4/0,1 mode: PW/PW res: [0x2b229:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.348112:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.348118:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+459:41278:x1731746394388160:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 33us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.348120:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11015 00010000:00010000:1.0:1651529333.348128:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000376045ea/0x3234de053c4bd6b lrc: 3/0,1 mode: PW/PW res: [0x2b227:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.348131:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000376045ea/0x3234de053c4bd6b lrc: 3/0,1 mode: PW/PW res: [0x2b227:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.348134:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000376045ea/0x3234de053c4bd6b lrc: 3/0,1 mode: PW/PW res: [0x2b227:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.348137:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000376045ea/0x3234de053c4bd6b lrc: 2/0,0 mode: PW/PW res: [0x2b227:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.348174:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+933:39029:x1731745946280704:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 911us (973us total) trans 12885078286 rc 0/0 00000100:00100000:1.0:1651529333.348177:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208357 00010000:00010000:1.0:1651529333.348184:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000376045ea/0x3234de053c4bd6b lrc: 2/0,0 mode: PW/PW res: [0x2b227:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.348187:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000376045ea already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.348188:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000376045ea/0x3234de053c4bd6b lrc: 2/0,0 mode: PW/PW res: [0x2b227:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.348191:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000376045ea/0x3234de053c4bd6b lrc: 3/0,0 mode: PW/PW res: [0x2b227:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.348195:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000376045ea/0x3234de053c4bd6b lrc: 1/0,0 mode: --/PW res: [0x2b227:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.348198:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000376045ea/0x3234de053c4bd6b lrc: 0/0,0 mode: --/PW res: [0x2b227:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.348252:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.348270:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.348281:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.348293:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.348326:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.348367:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208361 00000100:00100000:1.0:1651529333.348369:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+936:39030:x1731745946281024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.348375:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176684 count 1 00010000:00010000:1.0:1651529333.348380:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4bd87 lrc: 3/0,1 mode: --/PW res: [0x2b22c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.348384:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c43ccb lrc: 2/0,0 mode: PR/PR res: [0x2b22c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3893 expref: 457 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.348388:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.348388:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.348389:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4bd87 lrc: 4/0,1 mode: --/PW res: [0x2b22c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.348396:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c43ccb lrc: 3/0,0 mode: PR/PR res: [0x2b22c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3893 expref: 457 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.348399:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c43ccb lrc: 4/0,0 mode: PR/PR res: [0x2b22c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3893 expref: 457 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.348404:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e124baf1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996921664:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.348415:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.348421:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208362 00000100:00100000:1.0:1651529333.348423:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+936:39030:x1731745946280960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.348427:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176683 count 1 00010000:00010000:1.0:1651529333.348430:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4bd8e lrc: 3/0,1 mode: --/PW res: [0x2b22b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.348434:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb5b784a/0x3234de053c439b4 lrc: 2/0,0 mode: PR/PR res: [0x2b22b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2c61 expref: 457 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.348437:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.348438:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.348438:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4bd8e lrc: 4/0,1 mode: --/PW res: [0x2b22b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.348444:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eb5b784a/0x3234de053c439b4 lrc: 3/0,0 mode: PR/PR res: [0x2b22b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2c61 expref: 457 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.348448:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eb5b784a/0x3234de053c439b4 lrc: 4/0,0 mode: PR/PR res: [0x2b22b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2c61 expref: 457 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.348451:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005b3c5aba pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996921728:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.348457:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000499d0377 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.348463:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208364 00000100:00100000:1.0:1651529333.348465:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+936:39029:x1731745946281152:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.348469:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176686 count 1 00010000:00010000:1.0:1651529333.348472:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a25596b/0x3234de053c4bd9c lrc: 3/0,1 mode: --/PW res: [0x2b22e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.348476:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c4520a lrc: 2/0,0 mode: PR/PR res: [0x2b22e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8d9d expref: 457 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.348479:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.348480:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.348480:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a25596b/0x3234de053c4bd9c lrc: 4/0,1 mode: --/PW res: [0x2b22e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.348486:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c4520a lrc: 3/0,0 mode: PR/PR res: [0x2b22e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8d9d expref: 457 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.348490:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c4520a lrc: 4/0,0 mode: PR/PR res: [0x2b22e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8d9d expref: 457 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.348494:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004089c807 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996921856:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.348500:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e5f43e7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.348521:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.348571:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394388416 00000100:00100000:1.0:1651529333.348583:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 208365 00000100:00100000:1.0:1651529333.348585:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+458:41279:x1731746394388416:12345-10.240.43.64@tcp:101:ll_agl_410261.0 00010000:00010000:1.0:1651529333.348588:0:80276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529333.348592:0:80276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f6c33eb/0x3234de053c4bda3 lrc: 2/0,0 mode: --/PR res: [0x2b377:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2cc656 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529333.348598:0:80276:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b377:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529333.348602:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.348602:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.348604:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f6c33eb/0x3234de053c4bda3 lrc: 3/0,0 mode: PR/PR res: [0x2b377:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc656 expref: 459 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.348608:0:80276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005f6c33eb/0x3234de053c4bda3 lrc: 3/0,0 mode: PR/PR res: [0x2b377:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc656 expref: 459 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.348612:0:80276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005f6c33eb, rc 0) 00000100:00100000:1.0:1651529333.348622:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+459:41279:x1731746394388416:12345-10.240.43.64@tcp:101:ll_agl_410261.0 Request processed in 37us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.348625:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 208365 00000100:00100000:1.0:1651529333.348675:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.348683:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.348694:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.348703:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946281280 00000100:00100000:1.0:1651529333.348716:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208367 00000100:00100000:1.0:1651529333.348718:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+939:39029:x1731745946281344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.348723:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176689 count 1 00010000:00010000:1.0:1651529333.348727:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f2d383f/0x3234de053c4bdaa lrc: 3/0,1 mode: --/PW res: [0x2b231:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.348739:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001955af26/0x3234de053c4479f lrc: 2/0,0 mode: PR/PR res: [0x2b231:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a65b8 expref: 458 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.348742:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.348743:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.348744:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f2d383f/0x3234de053c4bdaa lrc: 4/0,1 mode: --/PW res: [0x2b231:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.348751:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001955af26/0x3234de053c4479f lrc: 3/0,0 mode: PR/PR res: [0x2b231:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a65b8 expref: 458 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.348754:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001955af26/0x3234de053c4479f lrc: 4/0,0 mode: PR/PR res: [0x2b231:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a65b8 expref: 458 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.348758:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a9b051f pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996921920:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.348769:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 0000000020dd7827 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.348832:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.349121:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.349131:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.349141:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e124baf1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996921664:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.349151:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4bd87 lrc: 3/0,1 mode: --/PW res: [0x2b22c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.349164:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005b3c5aba pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996921728:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.349166:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4bd8e lrc: 3/0,1 mode: --/PW res: [0x2b22b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.349172:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004089c807 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996921856:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.349174:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007a25596b/0x3234de053c4bd9c lrc: 3/0,1 mode: --/PW res: [0x2b22e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.349181:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11017 00000100:00100000:1.0:1651529333.349183:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+460:41278:x1731746394388736:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.349186:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.349188:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007398cbbc/0x3234de053c44067 lrc: 4/0,0 mode: PR/PR res: [0x2b22d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a46ee expref: 460 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.349191:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007398cbbc/0x3234de053c44067 lrc: 3/0,0 mode: PR/PR res: [0x2b22d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a46ee expref: 460 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.349203:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007398cbbc/0x3234de053c44067 lrc: 0/0,0 mode: --/PR res: [0x2b22d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a46ee expref: 459 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.349207:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.349208:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.349208:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c4bd95 lrc: 3/0,1 mode: PW/PW res: [0x2b22d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.349212:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c4bd95 lrc: 4/0,1 mode: PW/PW res: [0x2b22d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.349221:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.349237:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+458:41278:x1731746394388736:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 54us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.349240:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11017 00010000:00010000:1.0:1651529333.349266:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad242558/0x3234de053c4bd80 lrc: 2/0,0 mode: PW/PW res: [0x2b22a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.349270:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ad242558 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.349271:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad242558/0x3234de053c4bd80 lrc: 2/0,0 mode: PW/PW res: [0x2b22a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.349274:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad242558/0x3234de053c4bd80 lrc: 3/0,0 mode: PW/PW res: [0x2b22a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.349278:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad242558/0x3234de053c4bd80 lrc: 1/0,0 mode: --/PW res: [0x2b22a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.349281:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad242558/0x3234de053c4bd80 lrc: 0/0,0 mode: --/PW res: [0x2b22a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.349377:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.349386:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.349413:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.349421:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.349431:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.349437:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.349443:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394388544 00010000:00010000:1.0:1651529333.349448:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c43ccb lrc: 4/0,0 mode: PR/PR res: [0x2b22c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3893 expref: 458 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.349454:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394388672 00010000:00010000:1.0:1651529333.349456:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eb5b784a/0x3234de053c439b4 lrc: 4/0,0 mode: PR/PR res: [0x2b22b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2c61 expref: 459 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.349460:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394388800 00010000:00010000:1.0:1651529333.349462:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c4520a lrc: 4/0,0 mode: PR/PR res: [0x2b22e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8d9d expref: 460 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.349469:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394388992 00010000:00010000:1.0:1651529333.349472:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009e8582de/0x3234de053c45abc lrc: 4/0,0 mode: PR/PR res: [0x2b230:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab1a7 expref: 462 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.349477:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11018 00000100:00100000:1.0:1651529333.349478:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+463:41278:x1731746394388544:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529333.349481:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.349482:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c43ccb lrc: 4/0,0 mode: PR/PR res: [0x2b22c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3893 expref: 463 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.349486:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c43ccb lrc: 3/0,0 mode: PR/PR res: [0x2b22c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3893 expref: 463 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.349492:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c43ccb lrc: 0/0,0 mode: --/PR res: [0x2b22c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3893 expref: 463 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.349495:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.349496:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.349497:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4bd87 lrc: 3/0,1 mode: PW/PW res: [0x2b22c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.349500:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4bd87 lrc: 4/0,1 mode: PW/PW res: [0x2b22c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.349506:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.349520:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+462:41278:x1731746394388544:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.349523:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11018 00000100:00100000:1.0:1651529333.349528:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11020 00000100:00100000:1.0:1651529333.349529:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+460:41278:x1731746394388800:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529333.349532:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.349533:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c4520a lrc: 4/0,0 mode: PR/PR res: [0x2b22e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8d9d expref: 460 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.349537:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c4520a lrc: 3/0,0 mode: PR/PR res: [0x2b22e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8d9d expref: 460 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.349547:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c4520a lrc: 0/0,0 mode: --/PR res: [0x2b22e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8d9d expref: 460 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.349551:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.349552:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.349552:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007a25596b/0x3234de053c4bd9c lrc: 3/0,1 mode: PW/PW res: [0x2b22e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.349555:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a25596b/0x3234de053c4bd9c lrc: 4/0,1 mode: PW/PW res: [0x2b22e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.349561:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.349567:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+458:41278:x1731746394388800:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.349569:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11020 00000100:00100000:1.0:1651529333.349574:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11022 00000100:00100000:1.0:1651529333.349575:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+457:41278:x1731746394388992:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529333.349578:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.349579:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009e8582de/0x3234de053c45abc lrc: 4/0,0 mode: PR/PR res: [0x2b230:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab1a7 expref: 457 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.349582:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009e8582de/0x3234de053c45abc lrc: 3/0,0 mode: PR/PR res: [0x2b230:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab1a7 expref: 457 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.349588:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e8582de/0x3234de053c45abc lrc: 0/0,0 mode: --/PR res: [0x2b230:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab1a7 expref: 457 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.349591:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.349592:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.349592:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c4bdb8 lrc: 3/0,1 mode: PW/PW res: [0x2b230:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.349595:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c4bdb8 lrc: 4/0,1 mode: PW/PW res: [0x2b230:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.349605:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.349610:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+455:41278:x1731746394388992:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.349613:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11022 00010000:00010000:1.0:1651529333.349620:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4bd87 lrc: 3/0,1 mode: PW/PW res: [0x2b22c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.349623:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4bd87 lrc: 3/0,1 mode: PW/PW res: [0x2b22c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.349629:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4bd87 lrc: 3/0,1 mode: PW/PW res: [0x2b22c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.349632:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4bd87 lrc: 2/0,0 mode: PW/PW res: [0x2b22c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.349674:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+940:39030:x1731745946281024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1304us (1404us total) trans 12885078291 rc 0/0 00000100:00100000:1.0:1651529333.349677:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208361 00010000:00010000:1.0:1651529333.349684:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4bd8e lrc: 3/0,1 mode: PW/PW res: [0x2b22b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.349687:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4bd8e lrc: 3/0,1 mode: PW/PW res: [0x2b22b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.349698:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4bd8e lrc: 3/0,1 mode: PW/PW res: [0x2b22b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.349701:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4bd8e lrc: 2/0,0 mode: PW/PW res: [0x2b22b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.349750:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+940:39030:x1731745946280960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1326us (1469us total) trans 12885078293 rc 0/0 00000100:00100000:1.0:1651529333.349753:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208362 00010000:00010000:1.0:1651529333.349761:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007a25596b/0x3234de053c4bd9c lrc: 3/0,1 mode: PW/PW res: [0x2b22e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.349766:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a25596b/0x3234de053c4bd9c lrc: 3/0,1 mode: PW/PW res: [0x2b22e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.349769:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a25596b/0x3234de053c4bd9c lrc: 3/0,1 mode: PW/PW res: [0x2b22e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.349772:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a25596b/0x3234de053c4bd9c lrc: 2/0,0 mode: PW/PW res: [0x2b22e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.349809:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+940:39029:x1731745946281152:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1343us (1483us total) trans 12885078294 rc 0/0 00000100:00100000:1.0:1651529333.349811:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208364 00010000:00010000:1.0:1651529333.349823:0:80276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001955af26/0x3234de053c4479f lrc: 0/0,0 mode: --/PR res: [0x2b231:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a65b8 expref: 452 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.349827:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a9b051f pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996921920:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.349830:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009f2d383f/0x3234de053c4bdaa lrc: 3/0,1 mode: PW/PW res: [0x2b231:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.349833:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009f2d383f/0x3234de053c4bdaa lrc: 3/0,1 mode: PW/PW res: [0x2b231:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.349836:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f2d383f/0x3234de053c4bdaa lrc: 3/0,1 mode: PW/PW res: [0x2b231:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.349842:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f2d383f/0x3234de053c4bdaa lrc: 3/0,1 mode: PW/PW res: [0x2b231:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.349844:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f2d383f/0x3234de053c4bdaa lrc: 2/0,0 mode: PW/PW res: [0x2b231:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.349883:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+940:39029:x1731745946281344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1165us (1189us total) trans 12885078296 rc 0/0 00000100:00100000:1.0:1651529333.349886:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208367 00000100:00100000:1.0:1651529333.349922:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.349937:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.350059:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208371 00000100:00100000:1.0:1651529333.350061:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+941:39030:x1731745946281408:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.350067:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176690 count 1 00010000:00010000:1.0:1651529333.350072:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4bdcd lrc: 3/0,1 mode: --/PW res: [0x2b232:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.350077:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000abb748bc/0x3234de053c45e7b lrc: 2/0,0 mode: PR/PR res: [0x2b232:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac0f7 expref: 451 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.350080:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.350080:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.350081:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4bdcd lrc: 4/0,1 mode: --/PW res: [0x2b232:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.350088:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000abb748bc/0x3234de053c45e7b lrc: 3/0,0 mode: PR/PR res: [0x2b232:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac0f7 expref: 451 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.350092:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000abb748bc/0x3234de053c45e7b lrc: 4/0,0 mode: PR/PR res: [0x2b232:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac0f7 expref: 451 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.350096:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fc130417 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996922176:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.350107:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 0000000020dd7827 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.350150:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.350157:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394389184 00000100:00100000:1.0:1651529333.350164:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 208372 00000100:00100000:1.0:1651529333.350166:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+452:41279:x1731746394389184:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529333.350169:0:80276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529333.350174:0:80276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a24dc11/0x3234de053c4bdd4 lrc: 2/0,0 mode: --/PR res: [0x2baf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2cc66b expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529333.350186:0:80276:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2baf0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529333.350191:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.350191:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.350193:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a24dc11/0x3234de053c4bdd4 lrc: 3/0,0 mode: PR/PR res: [0x2baf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc66b expref: 453 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.350198:0:80276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009a24dc11/0x3234de053c4bdd4 lrc: 3/0,0 mode: PR/PR res: [0x2baf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc66b expref: 453 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.350202:0:80276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009a24dc11, rc 0) 00000100:00100000:1.0:1651529333.350209:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+453:41279:x1731746394389184:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 42us (60us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.350213:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 208372 00000100:00100000:1.0:1651529333.350243:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.350277:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.350285:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946281600 00000100:00100000:1.0:1651529333.350299:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946281536 00000100:00100000:1.0:1651529333.350303:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208373 00000100:00100000:1.0:1651529333.350305:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+943:39029:x1731745946281600:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.350310:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176693 count 1 00010000:00010000:1.0:1651529333.350314:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f423b01c/0x3234de053c4bddb lrc: 3/0,1 mode: --/PW res: [0x2b235:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.350319:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000028584103/0x3234de053c4514d lrc: 2/0,0 mode: PR/PR res: [0x2b235:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8af6 expref: 452 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.350322:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.350323:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.350323:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f423b01c/0x3234de053c4bddb lrc: 4/0,1 mode: --/PW res: [0x2b235:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.350330:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000028584103/0x3234de053c4514d lrc: 3/0,0 mode: PR/PR res: [0x2b235:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8af6 expref: 452 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.350333:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000028584103/0x3234de053c4514d lrc: 4/0,0 mode: PR/PR res: [0x2b235:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8af6 expref: 452 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.350337:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ebb53b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996922240:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.350346:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e5f43e7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.350375:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.350432:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.350444:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.350453:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.350462:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.350472:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208375 00000100:00100000:1.0:1651529333.350474:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+946:39029:x1731745946281664:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.350479:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176694 count 1 00010000:00010000:1.0:1651529333.350483:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4bde9 lrc: 3/0,1 mode: --/PW res: [0x2b236:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.350488:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008de0a3e5/0x3234de053c45950 lrc: 2/0,0 mode: PR/PR res: [0x2b236:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aaca6 expref: 452 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.350491:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.350492:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.350492:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4bde9 lrc: 4/0,1 mode: --/PW res: [0x2b236:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.350499:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008de0a3e5/0x3234de053c45950 lrc: 3/0,0 mode: PR/PR res: [0x2b236:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aaca6 expref: 452 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.350502:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008de0a3e5/0x3234de053c45950 lrc: 4/0,0 mode: PR/PR res: [0x2b236:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aaca6 expref: 452 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.350506:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000078a40aa9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996922368:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.350516:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a6b79b05 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.350523:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fc130417 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996922176:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.350527:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4bdcd lrc: 3/0,1 mode: --/PW res: [0x2b232:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.350533:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394389376 00010000:00010000:1.0:1651529333.350538:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000373b079/0x3234de053c46ac9 lrc: 4/0,0 mode: PR/PR res: [0x2b233:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af3ef expref: 453 pid: 80277 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.350544:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394389440 00010000:00010000:1.0:1651529333.350546:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000abb748bc/0x3234de053c45e7b lrc: 4/0,0 mode: PR/PR res: [0x2b232:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac0f7 expref: 454 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.350552:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11024 00000100:00100000:1.0:1651529333.350553:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+454:41278:x1731746394389376:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.350556:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.350557:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000373b079/0x3234de053c46ac9 lrc: 4/0,0 mode: PR/PR res: [0x2b233:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af3ef expref: 454 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.350561:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000373b079/0x3234de053c46ac9 lrc: 3/0,0 mode: PR/PR res: [0x2b233:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af3ef expref: 454 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.350566:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000373b079/0x3234de053c46ac9 lrc: 0/0,0 mode: --/PR res: [0x2b233:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af3ef expref: 454 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.350570:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.350571:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.350571:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001f005b0e/0x3234de053c4bdc6 lrc: 3/0,1 mode: PW/PW res: [0x2b233:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.350577:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f005b0e/0x3234de053c4bdc6 lrc: 4/0,1 mode: PW/PW res: [0x2b233:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.350586:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.350593:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+453:41278:x1731746394389376:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 39us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.350596:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11024 00000100:00100000:1.0:1651529333.350613:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.350644:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529333.350672:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4bdcd lrc: 3/0,1 mode: PW/PW res: [0x2b232:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.350681:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4bdcd lrc: 3/0,1 mode: PW/PW res: [0x2b232:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.350684:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4bdcd lrc: 3/0,1 mode: PW/PW res: [0x2b232:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.350687:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4bdcd lrc: 2/0,0 mode: PW/PW res: [0x2b232:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.350752:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+947:39030:x1731745946281408:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 689us (814us total) trans 12885078297 rc 0/0 00000100:00100000:1.0:1651529333.350755:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208371 00000100:00100000:1.0:1651529333.350760:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946281856 00000100:00100000:1.0:1651529333.350769:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208378 00000100:00100000:1.0:1651529333.350771:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+947:39029:x1731745946281856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.350776:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176697 count 1 00010000:00010000:1.0:1651529333.350780:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4bdfe lrc: 3/0,1 mode: --/PW res: [0x2b239:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.350785:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000186cbfea/0x3234de053c44705 lrc: 2/0,0 mode: PR/PR res: [0x2b239:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6311 expref: 450 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.350788:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.350788:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.350789:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4bdfe lrc: 4/0,1 mode: --/PW res: [0x2b239:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.350795:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000186cbfea/0x3234de053c44705 lrc: 3/0,0 mode: PR/PR res: [0x2b239:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6311 expref: 450 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.350799:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000186cbfea/0x3234de053c44705 lrc: 4/0,0 mode: PR/PR res: [0x2b239:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6311 expref: 450 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.350803:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fc130417 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996922560:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.350811:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 0000000071742acc going to sleep for 6 seconds 00010000:00010000:1.0:1651529333.350818:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f005b0e/0x3234de053c4bdc6 lrc: 2/0,0 mode: PW/PW res: [0x2b233:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.350821:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001f005b0e already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.350822:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f005b0e/0x3234de053c4bdc6 lrc: 2/0,0 mode: PW/PW res: [0x2b233:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.350827:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f005b0e/0x3234de053c4bdc6 lrc: 3/0,0 mode: PW/PW res: [0x2b233:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.350832:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f005b0e/0x3234de053c4bdc6 lrc: 1/0,0 mode: --/PW res: [0x2b233:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.350835:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f005b0e/0x3234de053c4bdc6 lrc: 0/0,0 mode: --/PW res: [0x2b233:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.350846:0:80278:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028584103/0x3234de053c4514d lrc: 0/0,0 mode: --/PR res: [0x2b235:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8af6 expref: 450 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.350849:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ebb53b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996922240:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.350853:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f423b01c/0x3234de053c4bddb lrc: 3/0,1 mode: PW/PW res: [0x2b235:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.350856:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f423b01c/0x3234de053c4bddb lrc: 3/0,1 mode: PW/PW res: [0x2b235:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.350858:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f423b01c/0x3234de053c4bddb lrc: 3/0,1 mode: PW/PW res: [0x2b235:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.350861:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f423b01c/0x3234de053c4bddb lrc: 3/0,1 mode: PW/PW res: [0x2b235:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.350864:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f423b01c/0x3234de053c4bddb lrc: 2/0,0 mode: PW/PW res: [0x2b235:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.350907:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+948:39029:x1731745946281600:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 601us (663us total) trans 12885078299 rc 0/0 00000100:00100000:1.0:1651529333.350910:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208373 00000100:00100000:1.0:1651529333.351124:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.351146:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.351178:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.351191:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.351198:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.351210:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000078a40aa9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996922368:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.351214:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4bde9 lrc: 3/0,1 mode: --/PW res: [0x2b236:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.351221:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394389824 00010000:00010000:1.0:1651529333.351246:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008de0a3e5/0x3234de053c45950 lrc: 4/0,0 mode: PR/PR res: [0x2b236:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aaca6 expref: 450 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.351256:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394389952 00010000:00010000:1.0:1651529333.351259:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bb2d6d77/0x3234de053c43c1c lrc: 4/0,0 mode: PR/PR res: [0x2b238:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a35c2 expref: 451 pid: 80278 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.351266:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11027 00000100:00100000:1.0:1651529333.351267:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+451:41278:x1731746394389824:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529333.351270:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.351271:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008de0a3e5/0x3234de053c45950 lrc: 4/0,0 mode: PR/PR res: [0x2b236:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aaca6 expref: 451 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.351278:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008de0a3e5/0x3234de053c45950 lrc: 3/0,0 mode: PR/PR res: [0x2b236:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aaca6 expref: 451 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.351283:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008de0a3e5/0x3234de053c45950 lrc: 0/0,0 mode: --/PR res: [0x2b236:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aaca6 expref: 451 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.351287:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.351288:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.351288:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4bde9 lrc: 3/0,1 mode: PW/PW res: [0x2b236:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.351292:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4bde9 lrc: 4/0,1 mode: PW/PW res: [0x2b236:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.351298:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.351304:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+450:41278:x1731746394389824:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.351307:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11027 00000100:00100000:1.0:1651529333.351311:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11028 00000100:00100000:1.0:1651529333.351313:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001cec52dd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+449:41278:x1731746394389952:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529333.351315:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.351316:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bb2d6d77/0x3234de053c43c1c lrc: 4/0,0 mode: PR/PR res: [0x2b238:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a35c2 expref: 449 pid: 80278 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.351320:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bb2d6d77/0x3234de053c43c1c lrc: 3/0,0 mode: PR/PR res: [0x2b238:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a35c2 expref: 449 pid: 80278 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.351325:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb2d6d77/0x3234de053c43c1c lrc: 0/0,0 mode: --/PR res: [0x2b238:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a35c2 expref: 449 pid: 80278 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.351328:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.351329:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.351329:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d33d4a29/0x3234de053c4bdf7 lrc: 3/0,1 mode: PW/PW res: [0x2b238:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.351332:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d33d4a29/0x3234de053c4bdf7 lrc: 4/0,1 mode: PW/PW res: [0x2b238:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.351340:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.351345:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001cec52dd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+448:41278:x1731746394389952:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.351348:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11028 00000100:00100000:1.0:1651529333.351360:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208381 00000100:00100000:1.0:1651529333.351361:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+950:39030:x1731745946282048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.351366:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176700 count 1 00010000:00010000:1.0:1651529333.351370:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a37fa99/0x3234de053c4be13 lrc: 3/0,1 mode: --/PW res: [0x2b23c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.351374:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ae7e587b/0x3234de053c4556e lrc: 2/0,0 mode: PR/PR res: [0x2b23c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9b81 expref: 447 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.351378:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.351378:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.351379:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a37fa99/0x3234de053c4be13 lrc: 4/0,1 mode: --/PW res: [0x2b23c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.351386:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ae7e587b/0x3234de053c4556e lrc: 3/0,0 mode: PR/PR res: [0x2b23c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9b81 expref: 447 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.351390:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ae7e587b/0x3234de053c4556e lrc: 4/0,0 mode: PR/PR res: [0x2b23c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9b81 expref: 447 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.351394:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001d1586f2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996922752:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.351401:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 0000000099c1da85 going to sleep for 6 seconds 00010000:00010000:1.0:1651529333.351410:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4bde9 lrc: 3/0,1 mode: PW/PW res: [0x2b236:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.351413:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4bde9 lrc: 3/0,1 mode: PW/PW res: [0x2b236:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.351416:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4bde9 lrc: 3/0,1 mode: PW/PW res: [0x2b236:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.351419:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4bde9 lrc: 2/0,0 mode: PW/PW res: [0x2b236:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.351458:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+951:39029:x1731745946281664:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 983us (1089us total) trans 12885078301 rc 0/0 00000100:00100000:1.0:1651529333.351461:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208375 00000100:00100000:1.0:1651529333.351472:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fc130417 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996922560:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.351477:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4bdfe lrc: 3/0,1 mode: --/PW res: [0x2b239:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.351490:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.351508:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.351533:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.351623:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11031 00000100:00100000:1.0:1651529333.351625:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+447:41278:x1731746394390016:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.351629:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.351631:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000186cbfea/0x3234de053c44705 lrc: 4/0,0 mode: PR/PR res: [0x2b239:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6311 expref: 446 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.351635:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000186cbfea/0x3234de053c44705 lrc: 3/0,0 mode: PR/PR res: [0x2b239:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6311 expref: 446 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.351641:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000186cbfea/0x3234de053c44705 lrc: 0/0,0 mode: --/PR res: [0x2b239:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6311 expref: 446 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.351645:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.351645:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.351646:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4bdfe lrc: 3/0,1 mode: PW/PW res: [0x2b239:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.351649:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4bdfe lrc: 4/0,1 mode: PW/PW res: [0x2b239:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.351656:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.351663:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+445:41278:x1731746394390016:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 37us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.351665:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11031 00010000:00010000:1.0:1651529333.351673:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4bdfe lrc: 3/0,1 mode: PW/PW res: [0x2b239:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.351676:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4bdfe lrc: 3/0,1 mode: PW/PW res: [0x2b239:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.351679:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4bdfe lrc: 3/0,1 mode: PW/PW res: [0x2b239:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.351682:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4bdfe lrc: 2/0,0 mode: PW/PW res: [0x2b239:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.351725:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+951:39029:x1731745946281856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 953us (1112us total) trans 12885078303 rc 0/0 00000100:00100000:1.0:1651529333.351728:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208378 00010000:00010000:1.0:1651529333.351788:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092b30684/0x3234de053c4bde2 lrc: 2/0,0 mode: PW/PW res: [0x2b234:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.351792:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000092b30684 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.351793:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092b30684/0x3234de053c4bde2 lrc: 2/0,0 mode: PW/PW res: [0x2b234:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.351796:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092b30684/0x3234de053c4bde2 lrc: 3/0,0 mode: PW/PW res: [0x2b234:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.351803:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092b30684/0x3234de053c4bde2 lrc: 1/0,0 mode: --/PW res: [0x2b234:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.351807:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092b30684/0x3234de053c4bde2 lrc: 0/0,0 mode: --/PW res: [0x2b234:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.352038:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.352054:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.352061:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.352073:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.352083:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.352091:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.352109:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.352117:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946282304 00000100:00100000:1.0:1651529333.352125:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946282240 00000100:00100000:1.0:1651529333.352128:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946282368 00000100:00100000:1.0:1651529333.352131:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208383 00000100:00100000:1.0:1651529333.352133:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+955:39029:x1731745946282112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.352138:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176701 count 1 00010000:00010000:1.0:1651529333.352143:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4be21 lrc: 3/0,1 mode: --/PW res: [0x2b23d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.352148:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c7a0670f/0x3234de053c46279 lrc: 2/0,0 mode: PR/PR res: [0x2b23d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad119 expref: 444 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.352157:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.352158:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.352159:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4be21 lrc: 4/0,1 mode: --/PW res: [0x2b23d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.352166:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c7a0670f/0x3234de053c46279 lrc: 3/0,0 mode: PR/PR res: [0x2b23d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad119 expref: 444 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.352170:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c7a0670f/0x3234de053c46279 lrc: 4/0,0 mode: PR/PR res: [0x2b23d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad119 expref: 444 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.352174:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e7f02909 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996922880:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.352183:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e5f43e7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.352190:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208385 00000100:00100000:1.0:1651529333.352191:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006a24970a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+955:39029:x1731745946282240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.352196:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176703 count 1 00010000:00010000:1.0:1651529333.352199:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4be2f lrc: 3/0,1 mode: --/PW res: [0x2b23f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.352204:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b3443fb0/0x3234de053c449a5 lrc: 2/0,0 mode: PR/PR res: [0x2b23f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6dec expref: 444 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.352207:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.352207:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.352208:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4be2f lrc: 4/0,1 mode: --/PW res: [0x2b23f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.352213:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b3443fb0/0x3234de053c449a5 lrc: 3/0,0 mode: PR/PR res: [0x2b23f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6dec expref: 444 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.352219:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b3443fb0/0x3234de053c449a5 lrc: 4/0,0 mode: PR/PR res: [0x2b23f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6dec expref: 444 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.352241:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004534b316 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996923008:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.352249:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f79d8146 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.352254:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394390272 00010000:00010000:1.0:1651529333.352259:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c473d13f/0x3234de053c43b35 lrc: 4/0,0 mode: PR/PR res: [0x2b23b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a320a expref: 445 pid: 80278 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.352266:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394390336 00010000:00010000:1.0:1651529333.352269:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003185e0fa/0x3234de053c45528 lrc: 4/0,0 mode: PR/PR res: [0x2b23a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9a0e expref: 446 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.352278:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11032 00000100:00100000:1.0:1651529333.352280:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+446:41278:x1731746394390272:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529333.352282:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.352284:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c473d13f/0x3234de053c43b35 lrc: 4/0,0 mode: PR/PR res: [0x2b23b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a320a expref: 446 pid: 80278 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.352288:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c473d13f/0x3234de053c43b35 lrc: 3/0,0 mode: PR/PR res: [0x2b23b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a320a expref: 446 pid: 80278 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.352293:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c473d13f/0x3234de053c43b35 lrc: 0/0,0 mode: --/PR res: [0x2b23b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a320a expref: 446 pid: 80278 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.352299:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.352300:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.352301:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000083b7e42d/0x3234de053c4be05 lrc: 3/0,1 mode: PW/PW res: [0x2b23b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.352304:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083b7e42d/0x3234de053c4be05 lrc: 4/0,1 mode: PW/PW res: [0x2b23b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.352312:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.352319:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+445:41278:x1731746394390272:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.352321:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11032 00000100:00100000:1.0:1651529333.352331:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001d1586f2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996922752:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.352335:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004a37fa99/0x3234de053c4be13 lrc: 3/0,1 mode: --/PW res: [0x2b23c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.352363:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.352562:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11034 00000100:00100000:1.0:1651529333.352564:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+443:41279:x1731746394390400:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.352568:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.352570:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ae7e587b/0x3234de053c4556e lrc: 4/0,0 mode: PR/PR res: [0x2b23c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9b81 expref: 443 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.352574:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ae7e587b/0x3234de053c4556e lrc: 3/0,0 mode: PR/PR res: [0x2b23c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9b81 expref: 443 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.352582:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae7e587b/0x3234de053c4556e lrc: 0/0,0 mode: --/PR res: [0x2b23c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9b81 expref: 443 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.352586:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.352587:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.352588:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004a37fa99/0x3234de053c4be13 lrc: 3/0,1 mode: PW/PW res: [0x2b23c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.352591:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a37fa99/0x3234de053c4be13 lrc: 4/0,1 mode: PW/PW res: [0x2b23c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.352597:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.352605:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+442:41279:x1731746394390400:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 41us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.352608:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11034 00010000:00010000:1.0:1651529333.352614:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004a37fa99/0x3234de053c4be13 lrc: 3/0,1 mode: PW/PW res: [0x2b23c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.352617:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a37fa99/0x3234de053c4be13 lrc: 3/0,1 mode: PW/PW res: [0x2b23c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.352620:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a37fa99/0x3234de053c4be13 lrc: 3/0,1 mode: PW/PW res: [0x2b23c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.352623:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a37fa99/0x3234de053c4be13 lrc: 2/0,0 mode: PW/PW res: [0x2b23c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.352667:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+956:39030:x1731745946282048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1305us (1469us total) trans 12885078307 rc 0/0 00000100:00100000:1.0:1651529333.352670:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208381 00010000:00010000:1.0:1651529333.352677:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a37fa99/0x3234de053c4be13 lrc: 2/0,0 mode: PW/PW res: [0x2b23c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.352680:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004a37fa99 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.352681:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a37fa99/0x3234de053c4be13 lrc: 2/0,0 mode: PW/PW res: [0x2b23c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.352684:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a37fa99/0x3234de053c4be13 lrc: 3/0,0 mode: PW/PW res: [0x2b23c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.352689:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a37fa99/0x3234de053c4be13 lrc: 1/0,0 mode: --/PW res: [0x2b23c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.352691:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a37fa99/0x3234de053c4be13 lrc: 0/0,0 mode: --/PW res: [0x2b23c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.352753:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.352783:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.352795:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946282496 00000100:00100000:1.0:1651529333.352805:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208388 00000100:00100000:1.0:1651529333.352806:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+957:39029:x1731745946282496:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.352812:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176707 count 1 00010000:00010000:1.0:1651529333.352816:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4be44 lrc: 3/0,1 mode: --/PW res: [0x2b243:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.352820:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001c973847/0x3234de053c43a39 lrc: 2/0,0 mode: PR/PR res: [0x2b243:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2e21 expref: 441 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.352824:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.352824:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.352825:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4be44 lrc: 4/0,1 mode: --/PW res: [0x2b243:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.352832:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001c973847/0x3234de053c43a39 lrc: 3/0,0 mode: PR/PR res: [0x2b243:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2e21 expref: 441 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.352835:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001c973847/0x3234de053c43a39 lrc: 4/0,0 mode: PR/PR res: [0x2b243:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2e21 expref: 441 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.352839:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000822949b3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996923200:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.352850:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000412e5d26 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.352912:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.352973:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e7f02909 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996922880:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.352977:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4be21 lrc: 3/0,1 mode: --/PW res: [0x2b23d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.352984:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004534b316 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996923008:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.352986:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4be2f lrc: 3/0,1 mode: --/PW res: [0x2b23f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.353037:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.353044:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.353058:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.353095:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.353104:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.353110:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394390656 00010000:00010000:1.0:1651529333.353115:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c44139 lrc: 4/0,0 mode: PR/PR res: [0x2b23e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4b47 expref: 445 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.353122:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11035 00000100:00100000:1.0:1651529333.353123:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000011803d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+446:41278:x1731746394390720:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.353126:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.353128:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c7a0670f/0x3234de053c46279 lrc: 4/0,0 mode: PR/PR res: [0x2b23d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad119 expref: 446 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.353131:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c7a0670f/0x3234de053c46279 lrc: 3/0,0 mode: PR/PR res: [0x2b23d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad119 expref: 446 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.353137:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7a0670f/0x3234de053c46279 lrc: 0/0,0 mode: --/PR res: [0x2b23d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad119 expref: 446 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.353140:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.353141:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.353142:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4be21 lrc: 3/0,1 mode: PW/PW res: [0x2b23d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.353147:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4be21 lrc: 4/0,1 mode: PW/PW res: [0x2b23d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.353154:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.353169:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000011803d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+444:41278:x1731746394390720:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 44us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.353171:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11035 00000100:00100000:1.0:1651529333.353181:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11038 00000100:00100000:1.0:1651529333.353183:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+442:41278:x1731746394390656:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.353186:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.353187:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c44139 lrc: 4/0,0 mode: PR/PR res: [0x2b23e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4b47 expref: 442 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.353191:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c44139 lrc: 3/0,0 mode: PR/PR res: [0x2b23e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4b47 expref: 442 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.353196:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c44139 lrc: 0/0,0 mode: --/PR res: [0x2b23e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4b47 expref: 441 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.353199:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.353200:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.353201:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000876c3b77/0x3234de053c4be1a lrc: 3/0,1 mode: PW/PW res: [0x2b23e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.353204:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000876c3b77/0x3234de053c4be1a lrc: 4/0,1 mode: PW/PW res: [0x2b23e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.353216:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.353233:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+439:41278:x1731746394390656:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 49us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.353241:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11038 00010000:00010000:1.0:1651529333.353251:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4be2f lrc: 3/0,1 mode: PW/PW res: [0x2b23f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.353254:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4be2f lrc: 3/0,1 mode: PW/PW res: [0x2b23f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.353257:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4be2f lrc: 3/0,1 mode: PW/PW res: [0x2b23f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.353260:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4be2f lrc: 2/0,0 mode: PW/PW res: [0x2b23f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.353303:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006a24970a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+959:39029:x1731745946282240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1111us (1212us total) trans 12885078308 rc 0/0 00000100:00100000:1.0:1651529333.353306:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208385 00010000:00010000:1.0:1651529333.353313:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4be21 lrc: 3/0,1 mode: PW/PW res: [0x2b23d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.353317:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4be21 lrc: 3/0,1 mode: PW/PW res: [0x2b23d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.353320:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4be21 lrc: 3/0,1 mode: PW/PW res: [0x2b23d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.353323:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4be21 lrc: 2/0,0 mode: PW/PW res: [0x2b23d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.353369:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+959:39029:x1731745946282112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1236us (1315us total) trans 12885078309 rc 0/0 00000100:00100000:1.0:1651529333.353372:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208383 00000100:00100000:1.0:1651529333.353418:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.353430:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.353460:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.353512:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529333.353560:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c4be28 lrc: 2/0,0 mode: PW/PW res: [0x2b240:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.353569:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009c763642 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.353570:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c4be28 lrc: 2/0,0 mode: PW/PW res: [0x2b240:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.353573:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c4be28 lrc: 3/0,0 mode: PW/PW res: [0x2b240:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.353578:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c4be28 lrc: 1/0,0 mode: --/PW res: [0x2b240:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.353581:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c4be28 lrc: 0/0,0 mode: --/PW res: [0x2b240:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.353587:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed7a068d/0x3234de053c4be36 lrc: 2/0,0 mode: PW/PW res: [0x2b241:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.353590:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ed7a068d already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.353591:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed7a068d/0x3234de053c4be36 lrc: 2/0,0 mode: PW/PW res: [0x2b241:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.353594:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed7a068d/0x3234de053c4be36 lrc: 3/0,0 mode: PW/PW res: [0x2b241:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.353603:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed7a068d/0x3234de053c4be36 lrc: 1/0,0 mode: --/PW res: [0x2b241:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.353606:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed7a068d/0x3234de053c4be36 lrc: 0/0,0 mode: --/PW res: [0x2b241:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.353613:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394391104 00010000:00010000:1.0:1651529333.353619:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ee557312/0x3234de053c445c3 lrc: 5/0,0 mode: PR/PR res: [0x2b242:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5e33 expref: 438 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.353625:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394391168 00010000:00010000:1.0:1651529333.353627:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001c973847/0x3234de053c43a39 lrc: 5/0,0 mode: PR/PR res: [0x2b243:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2e21 expref: 439 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.353632:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394391296 00010000:00010000:1.0:1651529333.353634:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bf272247/0x3234de053c45c1a lrc: 5/0,0 mode: PR/PR res: [0x2b244:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab734 expref: 440 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.353641:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11040 00000100:00100000:1.0:1651529333.353642:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+440:41278:x1731746394391104:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.353645:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.353646:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ee557312/0x3234de053c445c3 lrc: 5/0,0 mode: PR/PR res: [0x2b242:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5e33 expref: 440 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.353649:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ee557312/0x3234de053c445c3 lrc: 4/0,0 mode: PR/PR res: [0x2b242:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5e33 expref: 440 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.353655:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.353655:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.353656:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e1d98a9c/0x3234de053c4be3d lrc: 3/0,1 mode: PW/PW res: [0x2b242:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.353659:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1d98a9c/0x3234de053c4be3d lrc: 4/0,1 mode: PW/PW res: [0x2b242:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.353664:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.353670:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+440:41278:x1731746394391104:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 27us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.353673:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11040 00000100:00100000:1.0:1651529333.353677:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11041 00000100:00100000:1.0:1651529333.353678:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+439:41278:x1731746394391168:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.353680:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.353682:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001c973847/0x3234de053c43a39 lrc: 5/0,0 mode: PR/PR res: [0x2b243:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2e21 expref: 439 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.353685:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001c973847/0x3234de053c43a39 lrc: 4/0,0 mode: PR/PR res: [0x2b243:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2e21 expref: 439 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.353690:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.353690:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.353691:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4be44 lrc: 3/0,1 mode: PW/PW res: [0x2b243:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.353694:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4be44 lrc: 4/0,1 mode: PW/PW res: [0x2b243:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.353697:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.353702:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+439:41278:x1731746394391168:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 23us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.353704:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11041 00000100:00100000:1.0:1651529333.353707:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11042 00000100:00100000:1.0:1651529333.353709:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e75f071f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+438:41279:x1731746394391296:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.353711:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.353712:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bf272247/0x3234de053c45c1a lrc: 5/0,0 mode: PR/PR res: [0x2b244:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab734 expref: 438 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.353716:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bf272247/0x3234de053c45c1a lrc: 4/0,0 mode: PR/PR res: [0x2b244:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab734 expref: 438 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.353720:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.353720:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.353721:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e90f6a58/0x3234de053c4be4b lrc: 3/0,1 mode: PW/PW res: [0x2b244:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.353724:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e90f6a58/0x3234de053c4be4b lrc: 4/0,1 mode: PW/PW res: [0x2b244:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.353728:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.353743:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e75f071f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+438:41279:x1731746394391296:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 33us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.353745:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11042 00010000:00010000:1.0:1651529333.353760:0:80278:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c973847/0x3234de053c43a39 lrc: 0/0,0 mode: --/PR res: [0x2b243:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2e21 expref: 437 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.353764:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000822949b3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996923200:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.353768:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4be44 lrc: 3/0,1 mode: PW/PW res: [0x2b243:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.353771:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4be44 lrc: 3/0,1 mode: PW/PW res: [0x2b243:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.353774:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4be44 lrc: 3/0,1 mode: PW/PW res: [0x2b243:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.353777:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4be44 lrc: 3/0,1 mode: PW/PW res: [0x2b243:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.353780:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4be44 lrc: 2/0,0 mode: PW/PW res: [0x2b243:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.353832:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+960:39029:x1731745946282496:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1024us (1048us total) trans 12885078314 rc 0/0 00000100:00100000:1.0:1651529333.353835:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208388 00010000:00010000:1.0:1651529333.353844:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4be44 lrc: 2/0,0 mode: PW/PW res: [0x2b243:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.353848:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008270dfe9 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.353849:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4be44 lrc: 2/0,0 mode: PW/PW res: [0x2b243:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.353851:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4be44 lrc: 3/0,0 mode: PW/PW res: [0x2b243:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.353856:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4be44 lrc: 1/0,0 mode: --/PW res: [0x2b243:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.353859:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4be44 lrc: 0/0,0 mode: --/PW res: [0x2b243:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.353894:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.353909:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.353921:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.353933:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.354010:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946282752 00000100:00100000:1.0:1651529333.354018:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 208392 00000100:00100000:1.0:1651529333.354019:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+435:41279:x1731746394391360:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529333.354023:0:72397:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529333.354028:0:72397:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062022a4b/0x3234de053c4be60 lrc: 2/0,0 mode: --/PR res: [0x2b67c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2cc6b1 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529333.354033:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b67c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529333.354037:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.354038:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.354040:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062022a4b/0x3234de053c4be60 lrc: 3/0,0 mode: PR/PR res: [0x2b67c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6b1 expref: 436 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.354044:0:72397:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000062022a4b/0x3234de053c4be60 lrc: 3/0,0 mode: PR/PR res: [0x2b67c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6b1 expref: 436 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.354048:0:72397:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000062022a4b, rc 0) 00000100:00100000:1.0:1651529333.354055:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+436:41279:x1731746394391360:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 35us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.354058:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 208392 00000100:00100000:1.0:1651529333.354063:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208394 00000100:00100000:1.0:1651529333.354064:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+961:39029:x1731745946282752:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.354069:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176711 count 1 00010000:00010000:1.0:1651529333.354072:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4be6e lrc: 3/0,1 mode: --/PW res: [0x2b247:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.354076:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009f7dfa5a/0x3234de053c4577b lrc: 2/0,0 mode: PR/PR res: [0x2b247:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa487 expref: 435 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.354079:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.354080:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.354081:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4be6e lrc: 4/0,1 mode: --/PW res: [0x2b247:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.354087:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009f7dfa5a/0x3234de053c4577b lrc: 3/0,0 mode: PR/PR res: [0x2b247:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa487 expref: 435 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.354091:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009f7dfa5a/0x3234de053c4577b lrc: 4/0,0 mode: PR/PR res: [0x2b247:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa487 expref: 435 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.354095:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000533fe698 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996923456:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.354102:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000412e5d26 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.354271:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.354297:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.354305:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.354311:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.354322:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.354331:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946283008 00000100:00100000:1.0:1651529333.354340:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946283072 00000100:00100000:1.0:1651529333.354343:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946282944 00000100:00100000:1.0:1651529333.354346:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208395 00000100:00100000:1.0:1651529333.354348:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+966:39029:x1731745946282880:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.354353:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176713 count 1 00010000:00010000:1.0:1651529333.354358:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f423b01c/0x3234de053c4be75 lrc: 3/0,1 mode: --/PW res: [0x2b249:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.354362:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c443ee lrc: 2/0,0 mode: PR/PR res: [0x2b249:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a561b expref: 435 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.354368:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.354369:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.354369:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f423b01c/0x3234de053c4be75 lrc: 4/0,1 mode: --/PW res: [0x2b249:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.354376:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c443ee lrc: 3/0,0 mode: PR/PR res: [0x2b249:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a561b expref: 435 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.354379:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c443ee lrc: 4/0,0 mode: PR/PR res: [0x2b249:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a561b expref: 435 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.354383:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ebb53b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996923520:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.354394:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a4eb401d going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.354400:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208397 00000100:00100000:1.0:1651529333.354402:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+966:39030:x1731745946282816:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.354406:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176712 count 1 00010000:00010000:1.0:1651529333.354410:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c4be83 lrc: 3/0,1 mode: --/PW res: [0x2b248:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.354414:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a961ca3e/0x3234de053c45521 lrc: 2/0,0 mode: PR/PR res: [0x2b248:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9a07 expref: 435 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.354417:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.354418:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.354418:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c4be83 lrc: 4/0,1 mode: --/PW res: [0x2b248:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.354426:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a961ca3e/0x3234de053c45521 lrc: 3/0,0 mode: PR/PR res: [0x2b248:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9a07 expref: 435 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.354430:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a961ca3e/0x3234de053c45521 lrc: 4/0,0 mode: PR/PR res: [0x2b248:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9a07 expref: 435 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.354434:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f39ca9ea pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996923712:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.354440:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 0000000089d75f07 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.354446:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208399 00000100:00100000:1.0:1651529333.354447:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+966:39030:x1731745946282944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.354451:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176714 count 1 00010000:00010000:1.0:1651529333.354454:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c4be91 lrc: 3/0,1 mode: --/PW res: [0x2b24a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.354458:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b2d88630/0x3234de053c46582 lrc: 2/0,0 mode: PR/PR res: [0x2b24a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2addad expref: 435 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.354461:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.354461:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.354469:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c4be91 lrc: 4/0,1 mode: --/PW res: [0x2b24a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.354476:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b2d88630/0x3234de053c46582 lrc: 3/0,0 mode: PR/PR res: [0x2b24a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2addad expref: 435 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.354480:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b2d88630/0x3234de053c46582 lrc: 4/0,0 mode: PR/PR res: [0x2b24a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2addad expref: 435 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.354484:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996923776:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.354491:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 000000004ca54b8a going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.354552:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.354591:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.354620:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.354657:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.354665:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000533fe698 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996923456:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.354671:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4be6e lrc: 3/0,1 mode: --/PW res: [0x2b247:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.354677:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394391680 00010000:00010000:1.0:1651529333.354682:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000091968fa1/0x3234de053c46519 lrc: 4/0,0 mode: PR/PR res: [0x2b246:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2adc17 expref: 435 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.354688:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11045 00000100:00100000:1.0:1651529333.354697:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+435:41278:x1731746394391680:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529333.354704:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.354706:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000091968fa1/0x3234de053c46519 lrc: 4/0,0 mode: PR/PR res: [0x2b246:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2adc17 expref: 435 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.354710:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000091968fa1/0x3234de053c46519 lrc: 3/0,0 mode: PR/PR res: [0x2b246:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2adc17 expref: 434 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.354716:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091968fa1/0x3234de053c46519 lrc: 0/0,0 mode: --/PR res: [0x2b246:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2adc17 expref: 435 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.354720:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.354720:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.354721:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002a7b079b/0x3234de053c4be67 lrc: 3/0,1 mode: PW/PW res: [0x2b246:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.354724:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a7b079b/0x3234de053c4be67 lrc: 4/0,1 mode: PW/PW res: [0x2b246:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.354741:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.354748:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+434:41278:x1731746394391680:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 51us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.354751:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11045 00010000:00010000:1.0:1651529333.354760:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4be6e lrc: 3/0,1 mode: PW/PW res: [0x2b247:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.354763:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4be6e lrc: 3/0,1 mode: PW/PW res: [0x2b247:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.354766:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4be6e lrc: 3/0,1 mode: PW/PW res: [0x2b247:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.354769:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4be6e lrc: 2/0,0 mode: PW/PW res: [0x2b247:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.354811:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+967:39029:x1731745946282752:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 745us (877us total) trans 12885078316 rc 0/0 00000100:00100000:1.0:1651529333.354814:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208394 00010000:00010000:1.0:1651529333.354892:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a7b079b/0x3234de053c4be67 lrc: 2/0,0 mode: PW/PW res: [0x2b246:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.354896:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a7b079b already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.354897:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a7b079b/0x3234de053c4be67 lrc: 2/0,0 mode: PW/PW res: [0x2b246:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.354900:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a7b079b/0x3234de053c4be67 lrc: 3/0,0 mode: PW/PW res: [0x2b246:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.354905:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a7b079b/0x3234de053c4be67 lrc: 1/0,0 mode: --/PW res: [0x2b246:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.354908:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a7b079b/0x3234de053c4be67 lrc: 0/0,0 mode: --/PW res: [0x2b246:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.354913:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c4be59 lrc: 2/0,0 mode: PW/PW res: [0x2b245:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.354915:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000b62c3c9 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.354916:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c4be59 lrc: 2/0,0 mode: PW/PW res: [0x2b245:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.354919:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c4be59 lrc: 3/0,0 mode: PW/PW res: [0x2b245:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.354922:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c4be59 lrc: 1/0,0 mode: --/PW res: [0x2b245:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.354927:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c4be59 lrc: 0/0,0 mode: --/PW res: [0x2b245:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.355124:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.355157:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.355172:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.355188:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.355194:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.355200:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.355209:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.355256:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.355264:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ebb53b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996923520:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.355269:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f423b01c/0x3234de053c4be75 lrc: 3/0,1 mode: --/PW res: [0x2b249:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.355275:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f39ca9ea pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996923712:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.355278:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c4be83 lrc: 3/0,1 mode: --/PW res: [0x2b248:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.355285:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208403 00000100:00100000:1.0:1651529333.355287:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+969:39029:x1731745946283200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.355292:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176718 count 1 00010000:00010000:1.0:1651529333.355304:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000345d04ae/0x3234de053c4bead lrc: 3/0,1 mode: --/PW res: [0x2b24e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.355311:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f8b63594/0x3234de053c45074 lrc: 2/0,0 mode: PR/PR res: [0x2b24e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a86f8 expref: 434 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.355314:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.355315:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.355315:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000345d04ae/0x3234de053c4bead lrc: 4/0,1 mode: --/PW res: [0x2b24e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.355322:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f8b63594/0x3234de053c45074 lrc: 3/0,0 mode: PR/PR res: [0x2b24e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a86f8 expref: 435 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.355326:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f8b63594/0x3234de053c45074 lrc: 4/0,0 mode: PR/PR res: [0x2b24e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a86f8 expref: 436 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.355330:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ebb53b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996923968:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.355338:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 0000000089d75f07 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.355345:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996923776:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.355349:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c4be91 lrc: 3/0,1 mode: --/PW res: [0x2b24a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.355356:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11047 00000100:00100000:1.0:1651529333.355357:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+438:41278:x1731746394392064:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.355360:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.355362:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a961ca3e/0x3234de053c45521 lrc: 4/0,0 mode: PR/PR res: [0x2b248:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9a07 expref: 438 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.355368:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a961ca3e/0x3234de053c45521 lrc: 3/0,0 mode: PR/PR res: [0x2b248:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9a07 expref: 437 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.355373:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a961ca3e/0x3234de053c45521 lrc: 0/0,0 mode: --/PR res: [0x2b248:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9a07 expref: 437 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.355377:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.355378:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.355378:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c4be83 lrc: 3/0,1 mode: PW/PW res: [0x2b248:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.355381:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c4be83 lrc: 4/0,1 mode: PW/PW res: [0x2b248:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.355387:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.355393:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+436:41278:x1731746394392064:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.355395:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11047 00000100:00100000:1.0:1651529333.355401:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11048 00000100:00100000:1.0:1651529333.355402:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+435:41278:x1731746394392192:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.355405:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.355406:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000011c3e2c9/0x3234de053c46520 lrc: 4/0,0 mode: PR/PR res: [0x2b24c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2adc5d expref: 435 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.355410:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000011c3e2c9/0x3234de053c46520 lrc: 3/0,0 mode: PR/PR res: [0x2b24c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2adc5d expref: 434 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.355415:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011c3e2c9/0x3234de053c46520 lrc: 0/0,0 mode: --/PR res: [0x2b24c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2adc5d expref: 434 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.355418:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.355418:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.355419:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001f005b0e/0x3234de053c4be8a lrc: 3/0,1 mode: PW/PW res: [0x2b24c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.355422:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f005b0e/0x3234de053c4be8a lrc: 4/0,1 mode: PW/PW res: [0x2b24c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.355432:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.355438:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+432:41278:x1731746394392192:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 35us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.355440:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11048 00000100:00100000:1.0:1651529333.355445:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11050 00000100:00100000:1.0:1651529333.355447:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+431:41279:x1731746394392128:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.355449:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.355457:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b2d88630/0x3234de053c46582 lrc: 4/0,0 mode: PR/PR res: [0x2b24a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2addad expref: 431 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.355460:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b2d88630/0x3234de053c46582 lrc: 3/0,0 mode: PR/PR res: [0x2b24a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2addad expref: 431 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.355465:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2d88630/0x3234de053c46582 lrc: 0/0,0 mode: --/PR res: [0x2b24a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2addad expref: 430 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.355471:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.355472:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.355472:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c4be91 lrc: 3/0,1 mode: PW/PW res: [0x2b24a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.355475:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c4be91 lrc: 4/0,1 mode: PW/PW res: [0x2b24a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.355481:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.355486:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+429:41279:x1731746394392128:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 39us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.355489:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11050 00010000:00010000:1.0:1651529333.355498:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c4be83 lrc: 3/0,1 mode: PW/PW res: [0x2b248:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.355502:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c4be83 lrc: 3/0,1 mode: PW/PW res: [0x2b248:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.355505:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c4be83 lrc: 3/0,1 mode: PW/PW res: [0x2b248:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.355508:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c4be83 lrc: 2/0,0 mode: PW/PW res: [0x2b248:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.355546:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+970:39030:x1731745946282816:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1144us (1241us total) trans 12885078320 rc 0/0 00000100:00100000:1.0:1651529333.355550:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208397 00010000:00010000:1.0:1651529333.355557:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c4be83 lrc: 2/0,0 mode: PW/PW res: [0x2b248:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.355560:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000587473f4 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.355561:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c4be83 lrc: 2/0,0 mode: PW/PW res: [0x2b248:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.355564:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c4be83 lrc: 3/0,0 mode: PW/PW res: [0x2b248:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.355568:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c4be83 lrc: 1/0,0 mode: --/PW res: [0x2b248:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.355571:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c4be83 lrc: 0/0,0 mode: --/PW res: [0x2b248:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.355577:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c4be91 lrc: 3/0,1 mode: PW/PW res: [0x2b24a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.355580:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c4be91 lrc: 3/0,1 mode: PW/PW res: [0x2b24a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.355583:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c4be91 lrc: 3/0,1 mode: PW/PW res: [0x2b24a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.355586:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c4be91 lrc: 2/0,0 mode: PW/PW res: [0x2b24a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.355626:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+971:39030:x1731745946282944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1178us (1304us total) trans 12885078322 rc 0/0 00000100:00100000:1.0:1651529333.355630:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208399 00010000:00010000:1.0:1651529333.355636:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f423b01c/0x3234de053c4be75 lrc: 3/0,1 mode: PW/PW res: [0x2b249:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.355640:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f423b01c/0x3234de053c4be75 lrc: 3/0,1 mode: PW/PW res: [0x2b249:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.355643:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f423b01c/0x3234de053c4be75 lrc: 3/0,1 mode: PW/PW res: [0x2b249:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.355645:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f423b01c/0x3234de053c4be75 lrc: 2/0,0 mode: PW/PW res: [0x2b249:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.355681:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+970:39029:x1731745946282880:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1333us (1411us total) trans 12885078323 rc 0/0 00000100:00100000:1.0:1651529333.355684:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208395 00000100:00100000:1.0:1651529333.355700:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.355745:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.355841:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394392448 00010000:00010000:1.0:1651529333.355847:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006549e73a/0x3234de053c448c5 lrc: 4/0,0 mode: PR/PR res: [0x2b24d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a69e0 expref: 429 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.355855:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11051 00000100:00100000:1.0:1651529333.355857:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+429:41278:x1731746394392448:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.355860:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.355861:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006549e73a/0x3234de053c448c5 lrc: 4/0,0 mode: PR/PR res: [0x2b24d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a69e0 expref: 429 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.355865:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006549e73a/0x3234de053c448c5 lrc: 3/0,0 mode: PR/PR res: [0x2b24d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a69e0 expref: 429 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.355870:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006549e73a/0x3234de053c448c5 lrc: 0/0,0 mode: --/PR res: [0x2b24d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a69e0 expref: 429 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.355874:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.355875:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.355875:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c4be9f lrc: 3/0,1 mode: PW/PW res: [0x2b24d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.355878:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c4be9f lrc: 4/0,1 mode: PW/PW res: [0x2b24d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.355888:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.355897:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+428:41278:x1731746394392448:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 39us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.355900:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11051 00000100:00100000:1.0:1651529333.355912:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394392256 00000100:00100000:1.0:1651529333.355921:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 208404 00000100:00100000:1.0:1651529333.355922:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+428:41279:x1731746394392256:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529333.355926:0:80278:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529333.355930:0:80278:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052977309/0x3234de053c4beb4 lrc: 2/0,0 mode: --/PR res: [0x2b895:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2cc6cd expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529333.355935:0:80278:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b895:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529333.355939:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.355940:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.355942:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052977309/0x3234de053c4beb4 lrc: 3/0,0 mode: PR/PR res: [0x2b895:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6cd expref: 429 pid: 80278 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.355946:0:80278:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000052977309/0x3234de053c4beb4 lrc: 3/0,0 mode: PR/PR res: [0x2b895:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6cd expref: 429 pid: 80278 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.355950:0:80278:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000052977309, rc 0) 00000100:00100000:1.0:1651529333.355957:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+429:41279:x1731746394392256:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 33us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.355959:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 208404 00010000:00010000:1.0:1651529333.355966:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c4be9f lrc: 2/0,0 mode: PW/PW res: [0x2b24d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.355969:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e696ff9d already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.355970:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c4be9f lrc: 2/0,0 mode: PW/PW res: [0x2b24d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.355973:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c4be9f lrc: 3/0,0 mode: PW/PW res: [0x2b24d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.355977:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c4be9f lrc: 1/0,0 mode: --/PW res: [0x2b24d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.355980:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c4be9f lrc: 0/0,0 mode: --/PW res: [0x2b24d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.355996:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.356028:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.356064:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.356091:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.356107:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.356139:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208407 00000100:00100000:1.0:1651529333.356141:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+974:39029:x1731745946283392:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.356146:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176721 count 1 00010000:00010000:1.0:1651529333.356150:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c4bec9 lrc: 3/0,1 mode: --/PW res: [0x2b251:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.356155:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cc20db45/0x3234de053c452b2 lrc: 2/0,0 mode: PR/PR res: [0x2b251:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9036 expref: 428 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.356158:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.356159:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.356160:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c4bec9 lrc: 4/0,1 mode: --/PW res: [0x2b251:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.356167:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cc20db45/0x3234de053c452b2 lrc: 3/0,0 mode: PR/PR res: [0x2b251:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9036 expref: 428 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.356170:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cc20db45/0x3234de053c452b2 lrc: 4/0,0 mode: PR/PR res: [0x2b251:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9036 expref: 428 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.356181:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f39ca9ea pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996924160:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.356191:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000071742acc going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.356197:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208408 00000100:00100000:1.0:1651529333.356199:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+974:39030:x1731745946283584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.356203:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176724 count 1 00010000:00010000:1.0:1651529333.356207:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001722859c/0x3234de053c4bed0 lrc: 3/0,1 mode: --/PW res: [0x2b254:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.356211:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000ed2c637/0x3234de053c4657b lrc: 2/0,0 mode: PR/PR res: [0x2b254:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2add98 expref: 428 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.356214:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.356214:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.356215:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001722859c/0x3234de053c4bed0 lrc: 4/0,1 mode: --/PW res: [0x2b254:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.356221:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000ed2c637/0x3234de053c4657b lrc: 3/0,0 mode: PR/PR res: [0x2b254:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2add98 expref: 428 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.356240:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000ed2c637/0x3234de053c4657b lrc: 4/0,0 mode: PR/PR res: [0x2b254:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2add98 expref: 428 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.356244:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d9ef3c1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996924224:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.356252:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000004ca54b8a going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.356300:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.356352:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.356359:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.356400:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ebb53b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996923968:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.356405:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000345d04ae/0x3234de053c4bead lrc: 3/0,1 mode: --/PW res: [0x2b24e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.356413:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394392768 00010000:00010000:1.0:1651529333.356418:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000763ab05e/0x3234de053c45a5a lrc: 4/0,0 mode: PR/PR res: [0x2b24f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aafe7 expref: 429 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.356425:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394392704 00010000:00010000:1.0:1651529333.356427:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f8b63594/0x3234de053c45074 lrc: 4/0,0 mode: PR/PR res: [0x2b24e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a86f8 expref: 430 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.356441:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11052 00000100:00100000:1.0:1651529333.356443:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+430:41278:x1731746394392768:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.356445:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.356447:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000763ab05e/0x3234de053c45a5a lrc: 4/0,0 mode: PR/PR res: [0x2b24f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aafe7 expref: 430 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.356451:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000763ab05e/0x3234de053c45a5a lrc: 3/0,0 mode: PR/PR res: [0x2b24f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aafe7 expref: 430 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.356456:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000763ab05e/0x3234de053c45a5a lrc: 0/0,0 mode: --/PR res: [0x2b24f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aafe7 expref: 430 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.356460:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.356460:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.356461:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ad242558/0x3234de053c4bea6 lrc: 3/0,1 mode: PW/PW res: [0x2b24f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.356466:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad242558/0x3234de053c4bea6 lrc: 4/0,1 mode: PW/PW res: [0x2b24f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.356475:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.356488:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+428:41278:x1731746394392768:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 44us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.356491:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11052 00010000:00010000:1.0:1651529333.356499:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000345d04ae/0x3234de053c4bead lrc: 3/0,1 mode: PW/PW res: [0x2b24e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.356502:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000345d04ae/0x3234de053c4bead lrc: 3/0,1 mode: PW/PW res: [0x2b24e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.356505:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000345d04ae/0x3234de053c4bead lrc: 3/0,1 mode: PW/PW res: [0x2b24e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.356508:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000345d04ae/0x3234de053c4bead lrc: 2/0,0 mode: PW/PW res: [0x2b24e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.356551:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+977:39029:x1731745946283200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1263us (1379us total) trans 12885078325 rc 0/0 00000100:00100000:1.0:1651529333.356554:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208403 00000100:00100000:1.0:1651529333.356569:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529333.356697:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9cecf0c/0x3234de053c4bebb lrc: 2/0,0 mode: PW/PW res: [0x2b250:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.356704:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e9cecf0c already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.356705:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9cecf0c/0x3234de053c4bebb lrc: 2/0,0 mode: PW/PW res: [0x2b250:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.356708:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9cecf0c/0x3234de053c4bebb lrc: 3/0,0 mode: PW/PW res: [0x2b250:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.356713:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9cecf0c/0x3234de053c4bebb lrc: 1/0,0 mode: --/PW res: [0x2b250:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.356716:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9cecf0c/0x3234de053c4bebb lrc: 0/0,0 mode: --/PW res: [0x2b250:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.356785:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.356796:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.356876:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.356886:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.356894:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.356901:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208412 00000100:00100000:1.0:1651529333.356915:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+977:39030:x1731745946283712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.356921:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176726 count 1 00010000:00010000:1.0:1651529333.356926:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095fca58f/0x3234de053c4beec lrc: 3/0,1 mode: --/PW res: [0x2b256:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.356931:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b8d7c403/0x3234de053c46e0a lrc: 2/0,0 mode: PR/PR res: [0x2b256:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2b0434 expref: 425 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.356936:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.356937:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.356938:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095fca58f/0x3234de053c4beec lrc: 4/0,1 mode: --/PW res: [0x2b256:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.356945:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b8d7c403/0x3234de053c46e0a lrc: 3/0,0 mode: PR/PR res: [0x2b256:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2b0434 expref: 425 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.356948:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b8d7c403/0x3234de053c46e0a lrc: 4/0,0 mode: PR/PR res: [0x2b256:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2b0434 expref: 425 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.356952:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000086eaa330 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996924480:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.356961:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 0000000089d75f07 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.356969:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f39ca9ea pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996924160:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.356973:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c4bec9 lrc: 3/0,1 mode: --/PW res: [0x2b251:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.356980:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d9ef3c1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996924224:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.356982:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001722859c/0x3234de053c4bed0 lrc: 3/0,1 mode: --/PW res: [0x2b254:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.356988:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394392960 00010000:00010000:1.0:1651529333.356993:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cc20db45/0x3234de053c452b2 lrc: 4/0,0 mode: PR/PR res: [0x2b251:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9036 expref: 426 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.357002:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394392896 00010000:00010000:1.0:1651529333.357004:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c469e9 lrc: 4/0,0 mode: PR/PR res: [0x2b252:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af01b expref: 428 pid: 80277 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.357010:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11056 00000100:00100000:1.0:1651529333.357011:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de45c136 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+428:41278:x1731746394393152:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.357014:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.357015:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001de03565/0x3234de053c46aad lrc: 4/0,0 mode: PR/PR res: [0x2b253:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af363 expref: 428 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.357019:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001de03565/0x3234de053c46aad lrc: 3/0,0 mode: PR/PR res: [0x2b253:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af363 expref: 428 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.357024:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001de03565/0x3234de053c46aad lrc: 0/0,0 mode: --/PR res: [0x2b253:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af363 expref: 428 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.357028:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.357028:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.357029:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000083b7e42d/0x3234de053c4bed7 lrc: 3/0,1 mode: PW/PW res: [0x2b253:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.357032:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083b7e42d/0x3234de053c4bed7 lrc: 4/0,1 mode: PW/PW res: [0x2b253:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.357042:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.357057:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de45c136 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+426:41278:x1731746394393152:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 45us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.357060:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11056 00000100:00100000:1.0:1651529333.357071:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11057 00000100:00100000:1.0:1651529333.357073:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+425:41279:x1731746394392896:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.357075:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.357077:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c469e9 lrc: 4/0,0 mode: PR/PR res: [0x2b252:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af01b expref: 425 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.357081:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c469e9 lrc: 3/0,0 mode: PR/PR res: [0x2b252:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af01b expref: 424 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.357086:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c469e9 lrc: 0/0,0 mode: --/PR res: [0x2b252:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af01b expref: 424 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.357089:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.357090:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.357091:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c4bec2 lrc: 3/0,1 mode: PW/PW res: [0x2b252:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.357094:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c4bec2 lrc: 4/0,1 mode: PW/PW res: [0x2b252:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.357103:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.357109:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+423:41279:x1731746394392896:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.357111:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11057 00010000:00010000:1.0:1651529333.357119:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c4bec9 lrc: 3/0,1 mode: PW/PW res: [0x2b251:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.357123:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c4bec9 lrc: 3/0,1 mode: PW/PW res: [0x2b251:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.357126:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c4bec9 lrc: 3/0,1 mode: PW/PW res: [0x2b251:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.357128:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c4bec9 lrc: 2/0,0 mode: PW/PW res: [0x2b251:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.357171:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+978:39029:x1731745946283392:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1030us (1107us total) trans 12885078329 rc 0/0 00000100:00100000:1.0:1651529333.357174:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208407 00000100:00100000:1.0:1651529333.357189:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.357203:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.357240:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.357272:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.357333:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394393088 00010000:00010000:1.0:1651529333.357348:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000ed2c637/0x3234de053c4657b lrc: 4/0,0 mode: PR/PR res: [0x2b254:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2add98 expref: 423 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.357355:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394393216 00010000:00010000:1.0:1651529333.357358:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d9f9d8d6/0x3234de053c43eed lrc: 4/0,0 mode: PR/PR res: [0x2b255:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a40e3 expref: 425 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.357367:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11058 00000100:00100000:1.0:1651529333.357369:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+425:41279:x1731746394393088:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.357372:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.357373:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000ed2c637/0x3234de053c4657b lrc: 4/0,0 mode: PR/PR res: [0x2b254:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2add98 expref: 425 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.357377:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000ed2c637/0x3234de053c4657b lrc: 3/0,0 mode: PR/PR res: [0x2b254:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2add98 expref: 425 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.357382:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ed2c637/0x3234de053c4657b lrc: 0/0,0 mode: --/PR res: [0x2b254:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2add98 expref: 425 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.357386:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.357387:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.357387:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001722859c/0x3234de053c4bed0 lrc: 3/0,1 mode: PW/PW res: [0x2b254:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.357391:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001722859c/0x3234de053c4bed0 lrc: 4/0,1 mode: PW/PW res: [0x2b254:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.357397:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.357403:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+425:41279:x1731746394393088:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 34us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.357406:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11058 00000100:00100000:1.0:1651529333.357410:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11059 00000100:00100000:1.0:1651529333.357412:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+424:41279:x1731746394393216:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.357414:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.357415:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d9f9d8d6/0x3234de053c43eed lrc: 4/0,0 mode: PR/PR res: [0x2b255:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a40e3 expref: 424 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.357421:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d9f9d8d6/0x3234de053c43eed lrc: 3/0,0 mode: PR/PR res: [0x2b255:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a40e3 expref: 424 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.357426:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9f9d8d6/0x3234de053c43eed lrc: 0/0,0 mode: --/PR res: [0x2b255:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a40e3 expref: 423 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.357429:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.357430:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.357430:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c4bede lrc: 3/0,1 mode: PW/PW res: [0x2b255:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.357433:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c4bede lrc: 4/0,1 mode: PW/PW res: [0x2b255:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.357442:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.357447:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+422:41279:x1731746394393216:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 35us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.357450:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11059 00010000:00010000:1.0:1651529333.357456:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c4bec2 lrc: 2/0,0 mode: PW/PW res: [0x2b252:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.357459:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d1b07eb5 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.357460:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c4bec2 lrc: 2/0,0 mode: PW/PW res: [0x2b252:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.357463:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c4bec2 lrc: 3/0,0 mode: PW/PW res: [0x2b252:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.357467:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c4bec2 lrc: 1/0,0 mode: --/PW res: [0x2b252:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.357470:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c4bec2 lrc: 0/0,0 mode: --/PW res: [0x2b252:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.357474:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c4bede lrc: 2/0,0 mode: PW/PW res: [0x2b255:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.357477:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c9570753 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.357478:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c4bede lrc: 2/0,0 mode: PW/PW res: [0x2b255:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.357480:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c4bede lrc: 3/0,0 mode: PW/PW res: [0x2b255:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.357484:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c4bede lrc: 1/0,0 mode: --/PW res: [0x2b255:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.357486:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c4bede lrc: 0/0,0 mode: --/PW res: [0x2b255:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.357494:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001722859c/0x3234de053c4bed0 lrc: 3/0,1 mode: PW/PW res: [0x2b254:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.357497:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001722859c/0x3234de053c4bed0 lrc: 3/0,1 mode: PW/PW res: [0x2b254:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.357502:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001722859c/0x3234de053c4bed0 lrc: 3/0,1 mode: PW/PW res: [0x2b254:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.357505:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001722859c/0x3234de053c4bed0 lrc: 2/0,0 mode: PW/PW res: [0x2b254:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.357547:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+979:39030:x1731745946283584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1348us (1456us total) trans 12885078332 rc 0/0 00000100:00100000:1.0:1651529333.357550:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208408 00000100:00100000:1.0:1651529333.357586:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.357603:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.357642:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.357697:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.357705:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.357714:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000086eaa330 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996924480:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.357719:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000095fca58f/0x3234de053c4beec lrc: 3/0,1 mode: --/PW res: [0x2b256:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.357740:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394393600 00010000:00010000:1.0:1651529333.357745:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b31b1dc0/0x3234de053c43f79 lrc: 4/0,0 mode: PR/PR res: [0x2b257:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a42f0 expref: 422 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.357751:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394393664 00010000:00010000:1.0:1651529333.357754:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b8d7c403/0x3234de053c46e0a lrc: 4/0,0 mode: PR/PR res: [0x2b256:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2b0434 expref: 423 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.357765:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11060 00000100:00100000:1.0:1651529333.357767:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+423:41278:x1731746394393600:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.357770:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.357771:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b31b1dc0/0x3234de053c43f79 lrc: 4/0,0 mode: PR/PR res: [0x2b257:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a42f0 expref: 423 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.357775:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b31b1dc0/0x3234de053c43f79 lrc: 3/0,0 mode: PR/PR res: [0x2b257:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a42f0 expref: 423 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.357781:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b31b1dc0/0x3234de053c43f79 lrc: 0/0,0 mode: --/PR res: [0x2b257:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a42f0 expref: 423 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.357784:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.357785:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.357786:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d33d4a29/0x3234de053c4bee5 lrc: 3/0,1 mode: PW/PW res: [0x2b257:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.357789:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d33d4a29/0x3234de053c4bee5 lrc: 4/0,1 mode: PW/PW res: [0x2b257:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.357797:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.357804:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+422:41278:x1731746394393600:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.357806:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11060 00000100:00100000:1.0:1651529333.357810:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11061 00000100:00100000:1.0:1651529333.357812:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+421:41278:x1731746394393664:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.357815:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.357816:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b8d7c403/0x3234de053c46e0a lrc: 4/0,0 mode: PR/PR res: [0x2b256:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2b0434 expref: 421 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.357819:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b8d7c403/0x3234de053c46e0a lrc: 3/0,0 mode: PR/PR res: [0x2b256:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2b0434 expref: 421 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.357824:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8d7c403/0x3234de053c46e0a lrc: 0/0,0 mode: --/PR res: [0x2b256:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2b0434 expref: 421 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.357827:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.357827:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.357828:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000095fca58f/0x3234de053c4beec lrc: 3/0,1 mode: PW/PW res: [0x2b256:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.357831:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095fca58f/0x3234de053c4beec lrc: 4/0,1 mode: PW/PW res: [0x2b256:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.357837:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.357841:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+420:41278:x1731746394393664:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 29us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.357844:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11061 00010000:00010000:1.0:1651529333.357850:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000095fca58f/0x3234de053c4beec lrc: 3/0,1 mode: PW/PW res: [0x2b256:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.357854:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095fca58f/0x3234de053c4beec lrc: 3/0,1 mode: PW/PW res: [0x2b256:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.357859:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095fca58f/0x3234de053c4beec lrc: 3/0,1 mode: PW/PW res: [0x2b256:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.357862:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095fca58f/0x3234de053c4beec lrc: 2/0,0 mode: PW/PW res: [0x2b256:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.357899:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+982:39030:x1731745946283712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 984us (1103us total) trans 12885078333 rc 0/0 00000100:00100000:1.0:1651529333.357902:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208412 00010000:00010000:1.0:1651529333.357909:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095fca58f/0x3234de053c4beec lrc: 2/0,0 mode: PW/PW res: [0x2b256:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.357912:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000095fca58f already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.357913:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095fca58f/0x3234de053c4beec lrc: 2/0,0 mode: PW/PW res: [0x2b256:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.357916:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095fca58f/0x3234de053c4beec lrc: 3/0,0 mode: PW/PW res: [0x2b256:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.357921:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095fca58f/0x3234de053c4beec lrc: 1/0,0 mode: --/PW res: [0x2b256:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.357923:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095fca58f/0x3234de053c4beec lrc: 0/0,0 mode: --/PW res: [0x2b256:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.357927:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d33d4a29/0x3234de053c4bee5 lrc: 2/0,0 mode: PW/PW res: [0x2b257:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.357930:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d33d4a29 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.357931:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d33d4a29/0x3234de053c4bee5 lrc: 2/0,0 mode: PW/PW res: [0x2b257:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.357934:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d33d4a29/0x3234de053c4bee5 lrc: 3/0,0 mode: PW/PW res: [0x2b257:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.357937:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d33d4a29/0x3234de053c4bee5 lrc: 1/0,0 mode: --/PW res: [0x2b257:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.357939:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d33d4a29/0x3234de053c4bee5 lrc: 0/0,0 mode: --/PW res: [0x2b257:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.357954:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.357974:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.358049:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.358088:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394393728 00000100:00100000:1.0:1651529333.358096:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208419 00000100:00100000:1.0:1651529333.358097:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+983:39029:x1731745946284160:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.358103:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176733 count 1 00010000:00010000:1.0:1651529333.358107:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c45287a/0x3234de053c4bf1d lrc: 3/0,1 mode: --/PW res: [0x2b25d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.358111:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d6dcb33c/0x3234de053c467e3 lrc: 2/0,0 mode: PR/PR res: [0x2b25d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae75b expref: 420 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.358117:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.358118:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.358118:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c45287a/0x3234de053c4bf1d lrc: 4/0,1 mode: --/PW res: [0x2b25d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.358125:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d6dcb33c/0x3234de053c467e3 lrc: 3/0,0 mode: PR/PR res: [0x2b25d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae75b expref: 421 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.358128:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d6dcb33c/0x3234de053c467e3 lrc: 4/0,0 mode: PR/PR res: [0x2b25d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae75b expref: 421 pid: 80277 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.358133:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014f8af45 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996924864:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.358141:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 0000000089d75f07 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.358156:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.358219:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.358255:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.358269:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394393792 00010000:00010000:1.0:1651529333.358274:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a1d18c85/0x3234de053c45c6e lrc: 4/0,0 mode: PR/PR res: [0x2b258:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab892 expref: 421 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.358282:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11062 00000100:00100000:1.0:1651529333.358284:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+421:41278:x1731746394393792:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.358286:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.358288:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a1d18c85/0x3234de053c45c6e lrc: 4/0,0 mode: PR/PR res: [0x2b258:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab892 expref: 421 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.358294:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a1d18c85/0x3234de053c45c6e lrc: 3/0,0 mode: PR/PR res: [0x2b258:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab892 expref: 421 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.358300:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1d18c85/0x3234de053c45c6e lrc: 0/0,0 mode: --/PR res: [0x2b258:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab892 expref: 421 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.358303:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.358304:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.358304:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000092b30684/0x3234de053c4bef3 lrc: 3/0,1 mode: PW/PW res: [0x2b258:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.358308:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092b30684/0x3234de053c4bef3 lrc: 4/0,1 mode: PW/PW res: [0x2b258:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.358321:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.358329:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+420:41278:x1731746394393792:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 44us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.358331:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11062 00000100:00100000:1.0:1651529333.358341:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208422 00000100:00100000:1.0:1651529333.358343:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+985:39030:x1731745946284224:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.358348:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176734 count 1 00010000:00010000:1.0:1651529333.358352:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c8ad646/0x3234de053c4bf32 lrc: 3/0,1 mode: --/PW res: [0x2b25e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.358356:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e855406e/0x3234de053c446d4 lrc: 2/0,0 mode: PR/PR res: [0x2b25e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6215 expref: 419 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.358361:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.358362:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.358362:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c8ad646/0x3234de053c4bf32 lrc: 4/0,1 mode: --/PW res: [0x2b25e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.358369:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e855406e/0x3234de053c446d4 lrc: 3/0,0 mode: PR/PR res: [0x2b25e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6215 expref: 419 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.358372:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e855406e/0x3234de053c446d4 lrc: 4/0,0 mode: PR/PR res: [0x2b25e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6215 expref: 419 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.358376:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004a6776b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996924992:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.358384:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 0000000071742acc going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.358484:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.358493:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.358499:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.358515:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394393856 00010000:00010000:1.0:1651529333.358520:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008860425d/0x3234de053c44f9b lrc: 4/0,0 mode: PR/PR res: [0x2b25a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8412 expref: 420 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.358527:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394393984 00010000:00010000:1.0:1651529333.358530:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002a0b7e3a/0x3234de053c4624f lrc: 4/0,0 mode: PR/PR res: [0x2b25b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad063 expref: 421 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.358535:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11063 00000100:00100000:1.0:1651529333.358536:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005239dfe7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+422:41278:x1731746394393856:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.358539:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.358541:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008860425d/0x3234de053c44f9b lrc: 4/0,0 mode: PR/PR res: [0x2b25a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8412 expref: 422 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.358544:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008860425d/0x3234de053c44f9b lrc: 3/0,0 mode: PR/PR res: [0x2b25a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8412 expref: 422 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.358550:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008860425d/0x3234de053c44f9b lrc: 0/0,0 mode: --/PR res: [0x2b25a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8412 expref: 422 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.358559:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.358560:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.358561:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4bf01 lrc: 3/0,1 mode: PW/PW res: [0x2b25a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.358564:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4bf01 lrc: 4/0,1 mode: PW/PW res: [0x2b25a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.358573:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.358580:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005239dfe7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+421:41278:x1731746394393856:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 43us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.358583:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11063 00000100:00100000:1.0:1651529333.358591:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11065 00000100:00100000:1.0:1651529333.358593:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+419:41278:x1731746394393920:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.358596:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.358597:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000066556eb/0x3234de053c43ce0 lrc: 4/0,0 mode: PR/PR res: [0x2b259:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a38d9 expref: 419 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.358603:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000066556eb/0x3234de053c43ce0 lrc: 3/0,0 mode: PR/PR res: [0x2b259:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a38d9 expref: 419 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.358608:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000066556eb/0x3234de053c43ce0 lrc: 0/0,0 mode: --/PR res: [0x2b259:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a38d9 expref: 419 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.358612:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.358612:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.358613:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4bf08 lrc: 3/0,1 mode: PW/PW res: [0x2b259:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.358616:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4bf08 lrc: 4/0,1 mode: PW/PW res: [0x2b259:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.358624:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.358630:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+417:41278:x1731746394393920:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.358632:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11065 00000100:00100000:1.0:1651529333.358713:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.358750:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.358760:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014f8af45 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996924864:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.358770:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008c45287a/0x3234de053c4bf1d lrc: 3/0,1 mode: --/PW res: [0x2b25d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.358778:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004a6776b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996924992:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.358780:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009c8ad646/0x3234de053c4bf32 lrc: 3/0,1 mode: --/PW res: [0x2b25e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.358786:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394394240 00010000:00010000:1.0:1651529333.358791:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d6dcb33c/0x3234de053c467e3 lrc: 4/0,0 mode: PR/PR res: [0x2b25d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae75b expref: 417 pid: 80277 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.358797:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394394176 00010000:00010000:1.0:1651529333.358799:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c5926fe0/0x3234de053c46401 lrc: 4/0,0 mode: PR/PR res: [0x2b25c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad6ec expref: 418 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.358815:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11066 00000100:00100000:1.0:1651529333.358817:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+418:41279:x1731746394394240:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.358820:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.358821:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d6dcb33c/0x3234de053c467e3 lrc: 4/0,0 mode: PR/PR res: [0x2b25d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae75b expref: 418 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.358825:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d6dcb33c/0x3234de053c467e3 lrc: 3/0,0 mode: PR/PR res: [0x2b25d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae75b expref: 418 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.358830:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6dcb33c/0x3234de053c467e3 lrc: 0/0,0 mode: --/PR res: [0x2b25d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae75b expref: 418 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.358834:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.358835:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.358836:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008c45287a/0x3234de053c4bf1d lrc: 3/0,1 mode: PW/PW res: [0x2b25d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.358839:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c45287a/0x3234de053c4bf1d lrc: 4/0,1 mode: PW/PW res: [0x2b25d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.358845:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.358852:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+417:41279:x1731746394394240:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 34us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.358854:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11066 00000100:00100000:1.0:1651529333.358858:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11067 00000100:00100000:1.0:1651529333.358860:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+416:41279:x1731746394394176:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.358862:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.358864:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c5926fe0/0x3234de053c46401 lrc: 4/0,0 mode: PR/PR res: [0x2b25c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad6ec expref: 416 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.358867:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c5926fe0/0x3234de053c46401 lrc: 3/0,0 mode: PR/PR res: [0x2b25c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad6ec expref: 416 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.358871:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5926fe0/0x3234de053c46401 lrc: 0/0,0 mode: --/PR res: [0x2b25c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad6ec expref: 416 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.358875:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.358875:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.358876:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4bf16 lrc: 3/0,1 mode: PW/PW res: [0x2b25c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.358879:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4bf16 lrc: 4/0,1 mode: PW/PW res: [0x2b25c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.358888:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.358893:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+415:41279:x1731746394394176:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 33us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.358896:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11067 00010000:00010000:1.0:1651529333.358903:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4bf08 lrc: 2/0,0 mode: PW/PW res: [0x2b259:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.358906:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003aeb15a8 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.358907:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4bf08 lrc: 2/0,0 mode: PW/PW res: [0x2b259:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.358910:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4bf08 lrc: 3/0,0 mode: PW/PW res: [0x2b259:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.358914:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4bf08 lrc: 1/0,0 mode: --/PW res: [0x2b259:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.358917:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4bf08 lrc: 0/0,0 mode: --/PW res: [0x2b259:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.358921:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4bf01 lrc: 2/0,0 mode: PW/PW res: [0x2b25a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.358923:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db11c60d already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.358924:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4bf01 lrc: 2/0,0 mode: PW/PW res: [0x2b25a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.358927:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4bf01 lrc: 3/0,0 mode: PW/PW res: [0x2b25a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.358933:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4bf01 lrc: 1/0,0 mode: --/PW res: [0x2b25a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.358935:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4bf01 lrc: 0/0,0 mode: --/PW res: [0x2b25a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.358940:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008c45287a/0x3234de053c4bf1d lrc: 3/0,1 mode: PW/PW res: [0x2b25d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.358943:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c45287a/0x3234de053c4bf1d lrc: 3/0,1 mode: PW/PW res: [0x2b25d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.358946:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c45287a/0x3234de053c4bf1d lrc: 3/0,1 mode: PW/PW res: [0x2b25d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.358949:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c45287a/0x3234de053c4bf1d lrc: 2/0,0 mode: PW/PW res: [0x2b25d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.358993:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+986:39029:x1731745946284160:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 894us (1018us total) trans 12885078339 rc 0/0 00000100:00100000:1.0:1651529333.358996:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208419 00000100:00100000:1.0:1651529333.359036:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.359069:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.359083:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.359113:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.359146:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529333.359212:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4bf16 lrc: 2/0,0 mode: PW/PW res: [0x2b25c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.359216:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007d2a92bc already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.359217:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4bf16 lrc: 2/0,0 mode: PW/PW res: [0x2b25c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.359220:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4bf16 lrc: 3/0,0 mode: PW/PW res: [0x2b25c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.359242:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4bf16 lrc: 1/0,0 mode: --/PW res: [0x2b25c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.359245:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4bf16 lrc: 0/0,0 mode: --/PW res: [0x2b25c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.359253:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394394368 00010000:00010000:1.0:1651529333.359258:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e855406e/0x3234de053c446d4 lrc: 4/0,0 mode: PR/PR res: [0x2b25e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6215 expref: 417 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.359265:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394394304 00010000:00010000:1.0:1651529333.359267:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e71292e1/0x3234de053c43975 lrc: 5/0,0 mode: PR/PR res: [0x2b25f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2b11 expref: 418 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.359272:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11068 00000100:00100000:1.0:1651529333.359273:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+418:41278:x1731746394394368:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.359282:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.359284:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e855406e/0x3234de053c446d4 lrc: 4/0,0 mode: PR/PR res: [0x2b25e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6215 expref: 418 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.359288:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e855406e/0x3234de053c446d4 lrc: 3/0,0 mode: PR/PR res: [0x2b25e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6215 expref: 418 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.359293:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e855406e/0x3234de053c446d4 lrc: 0/0,0 mode: --/PR res: [0x2b25e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6215 expref: 417 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.359296:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.359297:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.359297:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009c8ad646/0x3234de053c4bf32 lrc: 3/0,1 mode: PW/PW res: [0x2b25e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.359300:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c8ad646/0x3234de053c4bf32 lrc: 4/0,1 mode: PW/PW res: [0x2b25e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.359306:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.359313:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+416:41278:x1731746394394368:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 39us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.359316:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11068 00010000:00010000:1.0:1651529333.359324:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009c8ad646/0x3234de053c4bf32 lrc: 3/0,1 mode: PW/PW res: [0x2b25e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.359327:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c8ad646/0x3234de053c4bf32 lrc: 3/0,1 mode: PW/PW res: [0x2b25e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.359330:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c8ad646/0x3234de053c4bf32 lrc: 3/0,1 mode: PW/PW res: [0x2b25e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.359335:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c8ad646/0x3234de053c4bf32 lrc: 2/0,0 mode: PW/PW res: [0x2b25e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.359378:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+988:39030:x1731745946284224:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1034us (1123us total) trans 12885078341 rc 0/0 00000100:00100000:1.0:1651529333.359381:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208422 00000100:00100000:1.0:1651529333.359417:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.359457:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.359518:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.359548:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.359558:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.359590:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.359599:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946284672 00000100:00100000:1.0:1651529333.359609:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946284608 00000100:00100000:1.0:1651529333.359616:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208427 00000100:00100000:1.0:1651529333.359617:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+991:39029:x1731745946284480:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.359623:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176738 count 1 00010000:00010000:1.0:1651529333.359627:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a05bebd/0x3234de053c4bf55 lrc: 3/0,1 mode: --/PW res: [0x2b262:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.359632:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009c96826c/0x3234de053c4582a lrc: 2/0,0 mode: PR/PR res: [0x2b262:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa7c8 expref: 413 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.359641:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.359642:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.359643:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a05bebd/0x3234de053c4bf55 lrc: 4/0,1 mode: --/PW res: [0x2b262:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.359652:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009c96826c/0x3234de053c4582a lrc: 3/0,0 mode: PR/PR res: [0x2b262:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa7c8 expref: 413 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.359656:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009c96826c/0x3234de053c4582a lrc: 4/0,0 mode: PR/PR res: [0x2b262:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa7c8 expref: 413 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.359660:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a925fbf6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996925248:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.359669:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000567ee0ef going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.359675:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208429 00000100:00100000:1.0:1651529333.359677:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+991:39030:x1731745946284608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.359681:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176740 count 1 00010000:00010000:1.0:1651529333.359685:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d95da09e/0x3234de053c4bf63 lrc: 3/0,1 mode: --/PW res: [0x2b264:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.359689:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c555b0eb/0x3234de053c45d7f lrc: 2/0,0 mode: PR/PR res: [0x2b264:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abcdd expref: 413 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.359692:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.359693:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.359694:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d95da09e/0x3234de053c4bf63 lrc: 4/0,1 mode: --/PW res: [0x2b264:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.359700:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c555b0eb/0x3234de053c45d7f lrc: 3/0,0 mode: PR/PR res: [0x2b264:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abcdd expref: 413 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.359703:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c555b0eb/0x3234de053c45d7f lrc: 4/0,0 mode: PR/PR res: [0x2b264:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abcdd expref: 413 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.359708:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d9ef3c1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996925376:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.359725:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000007e004c12 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.359741:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394394688 00010000:00010000:1.0:1651529333.359746:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000888fed6b/0x3234de053c43e29 lrc: 4/0,0 mode: PR/PR res: [0x2b261:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3e6d expref: 414 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.359755:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394394624 00010000:00010000:1.0:1651529333.359758:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c44124 lrc: 4/0,0 mode: PR/PR res: [0x2b260:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4b24 expref: 415 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.359765:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11071 00000100:00100000:1.0:1651529333.359767:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+415:41279:x1731746394394624:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.359770:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.359771:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c44124 lrc: 4/0,0 mode: PR/PR res: [0x2b260:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4b24 expref: 415 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.359775:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c44124 lrc: 3/0,0 mode: PR/PR res: [0x2b260:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4b24 expref: 415 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.359780:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c44124 lrc: 0/0,0 mode: --/PR res: [0x2b260:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4b24 expref: 415 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.359784:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.359784:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.359785:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4bf39 lrc: 3/0,1 mode: PW/PW res: [0x2b260:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.359788:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4bf39 lrc: 4/0,1 mode: PW/PW res: [0x2b260:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.359797:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.359806:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+413:41279:x1731746394394624:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 39us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.359810:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11071 00000100:00100000:1.0:1651529333.359829:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.359851:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.359931:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208431 00000100:00100000:1.0:1651529333.359933:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ea32140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+993:39029:x1731745946284800:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.359939:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176743 count 1 00010000:00010000:1.0:1651529333.359943:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006247fb8a/0x3234de053c4bf71 lrc: 3/0,1 mode: --/PW res: [0x2b267:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.359948:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002cac510f/0x3234de053c44f40 lrc: 2/0,0 mode: PR/PR res: [0x2b267:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a82bb expref: 411 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.359951:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.359952:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.359952:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006247fb8a/0x3234de053c4bf71 lrc: 4/0,1 mode: --/PW res: [0x2b267:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.359959:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002cac510f/0x3234de053c44f40 lrc: 3/0,0 mode: PR/PR res: [0x2b267:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a82bb expref: 411 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.359965:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002cac510f/0x3234de053c44f40 lrc: 4/0,0 mode: PR/PR res: [0x2b267:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a82bb expref: 411 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.359969:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007fca8239 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996925504:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.359984:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b52d0f36 going to sleep for 6 seconds 00010000:00010000:1.0:1651529333.359989:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4bf40 lrc: 2/0,0 mode: PW/PW res: [0x2b261:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.359993:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000828505cd already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.359994:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4bf40 lrc: 2/0,0 mode: PW/PW res: [0x2b261:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.359997:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4bf40 lrc: 3/0,0 mode: PW/PW res: [0x2b261:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.360001:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4bf40 lrc: 1/0,0 mode: --/PW res: [0x2b261:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.360004:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4bf40 lrc: 0/0,0 mode: --/PW res: [0x2b261:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.360008:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4bf39 lrc: 2/0,0 mode: PW/PW res: [0x2b260:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.360011:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054a30dd8 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.360012:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4bf39 lrc: 2/0,0 mode: PW/PW res: [0x2b260:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.360015:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4bf39 lrc: 3/0,0 mode: PW/PW res: [0x2b260:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.360018:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4bf39 lrc: 1/0,0 mode: --/PW res: [0x2b260:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.360021:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4bf39 lrc: 0/0,0 mode: --/PW res: [0x2b260:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.360034:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.360061:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.360138:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.360151:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394394944 00010000:00010000:1.0:1651529333.360162:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006027938c/0x3234de053c44c92 lrc: 4/0,0 mode: PR/PR res: [0x2b263:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7896 expref: 413 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.360169:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11072 00000100:00100000:1.0:1651529333.360171:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+413:41279:x1731746394394944:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529333.360174:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.360175:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006027938c/0x3234de053c44c92 lrc: 4/0,0 mode: PR/PR res: [0x2b263:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7896 expref: 413 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.360179:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006027938c/0x3234de053c44c92 lrc: 3/0,0 mode: PR/PR res: [0x2b263:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7896 expref: 413 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.360184:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006027938c/0x3234de053c44c92 lrc: 0/0,0 mode: --/PR res: [0x2b263:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7896 expref: 413 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.360188:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.360189:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.360189:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cc20db45/0x3234de053c4bf4e lrc: 3/0,1 mode: PW/PW res: [0x2b263:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.360192:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc20db45/0x3234de053c4bf4e lrc: 4/0,1 mode: PW/PW res: [0x2b263:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.360202:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.360216:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+412:41279:x1731746394394944:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 44us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.360219:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11072 00000100:00100000:1.0:1651529333.360336:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.360342:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.360349:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.360360:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a925fbf6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996925248:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.360371:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008a05bebd/0x3234de053c4bf55 lrc: 3/0,1 mode: --/PW res: [0x2b262:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.360379:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d9ef3c1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996925376:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.360382:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d95da09e/0x3234de053c4bf63 lrc: 3/0,1 mode: --/PW res: [0x2b264:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.360388:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394395072 00010000:00010000:1.0:1651529333.360392:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c83c6fc1/0x3234de053c44b81 lrc: 4/0,0 mode: PR/PR res: [0x2b265:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7508 expref: 412 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.360404:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394395008 00010000:00010000:1.0:1651529333.360407:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009c96826c/0x3234de053c4582a lrc: 4/0,0 mode: PR/PR res: [0x2b262:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa7c8 expref: 413 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.360412:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11073 00000100:00100000:1.0:1651529333.360414:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+414:41278:x1731746394395072:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.360416:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.360418:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c83c6fc1/0x3234de053c44b81 lrc: 4/0,0 mode: PR/PR res: [0x2b265:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7508 expref: 414 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.360421:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c83c6fc1/0x3234de053c44b81 lrc: 3/0,0 mode: PR/PR res: [0x2b265:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7508 expref: 414 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.360427:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c83c6fc1/0x3234de053c44b81 lrc: 0/0,0 mode: --/PR res: [0x2b265:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7508 expref: 414 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.360430:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.360431:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.360432:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4bf5c lrc: 3/0,1 mode: PW/PW res: [0x2b265:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.360435:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4bf5c lrc: 4/0,1 mode: PW/PW res: [0x2b265:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.360443:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.360450:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+413:41278:x1731746394395072:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 36us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.360453:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11073 00000100:00100000:1.0:1651529333.360458:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11075 00000100:00100000:1.0:1651529333.360459:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+411:41278:x1731746394395136:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.360462:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.360463:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c555b0eb/0x3234de053c45d7f lrc: 4/0,0 mode: PR/PR res: [0x2b264:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abcdd expref: 411 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.360467:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c555b0eb/0x3234de053c45d7f lrc: 3/0,0 mode: PR/PR res: [0x2b264:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abcdd expref: 411 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.360472:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c555b0eb/0x3234de053c45d7f lrc: 0/0,0 mode: --/PR res: [0x2b264:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abcdd expref: 411 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.360482:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.360483:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.360483:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d95da09e/0x3234de053c4bf63 lrc: 3/0,1 mode: PW/PW res: [0x2b264:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.360486:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d95da09e/0x3234de053c4bf63 lrc: 4/0,1 mode: PW/PW res: [0x2b264:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.360492:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.360497:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+409:41278:x1731746394395136:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 38us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.360500:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11075 00010000:00010000:1.0:1651529333.360507:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d95da09e/0x3234de053c4bf63 lrc: 3/0,1 mode: PW/PW res: [0x2b264:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.360516:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d95da09e/0x3234de053c4bf63 lrc: 3/0,1 mode: PW/PW res: [0x2b264:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.360520:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d95da09e/0x3234de053c4bf63 lrc: 3/0,1 mode: PW/PW res: [0x2b264:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.360522:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d95da09e/0x3234de053c4bf63 lrc: 2/0,0 mode: PW/PW res: [0x2b264:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.360566:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+995:39030:x1731745946284608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 888us (1008us total) trans 12885078347 rc 0/0 00000100:00100000:1.0:1651529333.360570:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208429 00010000:00010000:1.0:1651529333.360577:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4bf5c lrc: 2/0,0 mode: PW/PW res: [0x2b265:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.360581:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000041e6f70f already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.360582:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4bf5c lrc: 2/0,0 mode: PW/PW res: [0x2b265:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.360585:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4bf5c lrc: 3/0,0 mode: PW/PW res: [0x2b265:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.360589:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4bf5c lrc: 1/0,0 mode: --/PW res: [0x2b265:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.360592:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4bf5c lrc: 0/0,0 mode: --/PW res: [0x2b265:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.360598:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008a05bebd/0x3234de053c4bf55 lrc: 3/0,1 mode: PW/PW res: [0x2b262:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.360601:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a05bebd/0x3234de053c4bf55 lrc: 3/0,1 mode: PW/PW res: [0x2b262:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.360614:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a05bebd/0x3234de053c4bf55 lrc: 3/0,1 mode: PW/PW res: [0x2b262:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.360617:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a05bebd/0x3234de053c4bf55 lrc: 2/0,0 mode: PW/PW res: [0x2b262:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.360659:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+995:39029:x1731745946284480:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1041us (1203us total) trans 12885078348 rc 0/0 00000100:00100000:1.0:1651529333.360662:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208427 00000100:00100000:1.0:1651529333.360696:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.360723:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.360799:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.360808:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.360837:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.360848:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007fca8239 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996925504:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.360852:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006247fb8a/0x3234de053c4bf71 lrc: 3/0,1 mode: --/PW res: [0x2b267:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.360859:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394395392 00010000:00010000:1.0:1651529333.360864:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002cac510f/0x3234de053c44f40 lrc: 4/0,0 mode: PR/PR res: [0x2b267:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a82bb expref: 409 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.360874:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394395264 00010000:00010000:1.0:1651529333.360877:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c46210 lrc: 4/0,0 mode: PR/PR res: [0x2b266:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acf67 expref: 410 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.360882:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394395456 00010000:00010000:1.0:1651529333.360884:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000079615549/0x3234de053c45f54 lrc: 4/0,0 mode: PR/PR res: [0x2b268:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac423 expref: 411 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.360888:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11076 00000100:00100000:1.0:1651529333.360890:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+411:41278:x1731746394395392:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.360892:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.360894:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002cac510f/0x3234de053c44f40 lrc: 4/0,0 mode: PR/PR res: [0x2b267:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a82bb expref: 411 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.360897:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002cac510f/0x3234de053c44f40 lrc: 3/0,0 mode: PR/PR res: [0x2b267:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a82bb expref: 411 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.360903:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cac510f/0x3234de053c44f40 lrc: 0/0,0 mode: --/PR res: [0x2b267:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a82bb expref: 411 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.360906:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.360907:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.360908:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006247fb8a/0x3234de053c4bf71 lrc: 3/0,1 mode: PW/PW res: [0x2b267:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.360917:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006247fb8a/0x3234de053c4bf71 lrc: 4/0,1 mode: PW/PW res: [0x2b267:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.360924:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.360931:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+410:41278:x1731746394395392:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 41us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.360934:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11076 00000100:00100000:1.0:1651529333.360938:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11078 00000100:00100000:1.0:1651529333.360940:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+409:41278:x1731746394395456:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.360943:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.360944:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000079615549/0x3234de053c45f54 lrc: 4/0,0 mode: PR/PR res: [0x2b268:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac423 expref: 409 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.360948:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000079615549/0x3234de053c45f54 lrc: 3/0,0 mode: PR/PR res: [0x2b268:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac423 expref: 409 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.360952:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079615549/0x3234de053c45f54 lrc: 0/0,0 mode: --/PR res: [0x2b268:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac423 expref: 408 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.360956:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.360957:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.360957:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4bf7f lrc: 3/0,1 mode: PW/PW res: [0x2b268:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.360960:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4bf7f lrc: 4/0,1 mode: PW/PW res: [0x2b268:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.360970:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.360977:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+407:41278:x1731746394395456:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 36us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.360981:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11078 00010000:00010000:1.0:1651529333.360989:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006247fb8a/0x3234de053c4bf71 lrc: 3/0,1 mode: PW/PW res: [0x2b267:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.360992:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006247fb8a/0x3234de053c4bf71 lrc: 3/0,1 mode: PW/PW res: [0x2b267:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.360996:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006247fb8a/0x3234de053c4bf71 lrc: 3/0,1 mode: PW/PW res: [0x2b267:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.360998:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006247fb8a/0x3234de053c4bf71 lrc: 2/0,0 mode: PW/PW res: [0x2b267:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.361036:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ea32140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+998:39029:x1731745946284800:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1102us (1185us total) trans 12885078349 rc 0/0 00000100:00100000:1.0:1651529333.361039:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208431 00010000:00010000:1.0:1651529333.361046:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006247fb8a/0x3234de053c4bf71 lrc: 2/0,0 mode: PW/PW res: [0x2b267:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.361049:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006247fb8a already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.361050:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006247fb8a/0x3234de053c4bf71 lrc: 2/0,0 mode: PW/PW res: [0x2b267:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.361053:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006247fb8a/0x3234de053c4bf71 lrc: 3/0,0 mode: PW/PW res: [0x2b267:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.361057:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006247fb8a/0x3234de053c4bf71 lrc: 1/0,0 mode: --/PW res: [0x2b267:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.361060:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006247fb8a/0x3234de053c4bf71 lrc: 0/0,0 mode: --/PW res: [0x2b267:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.361064:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4bf6a lrc: 2/0,0 mode: PW/PW res: [0x2b266:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.361067:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cd6e2551 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.361068:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4bf6a lrc: 2/0,0 mode: PW/PW res: [0x2b266:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.361071:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4bf6a lrc: 3/0,0 mode: PW/PW res: [0x2b266:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.361074:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4bf6a lrc: 1/0,0 mode: --/PW res: [0x2b266:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.361076:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4bf6a lrc: 0/0,0 mode: --/PW res: [0x2b266:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.361111:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.361127:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.361139:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.361213:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946285120 00000100:00100000:1.0:1651529333.361245:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208438 00000100:00100000:1.0:1651529333.361247:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+999:39030:x1731745946285120:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.361252:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176748 count 1 00010000:00010000:1.0:1651529333.361257:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095fca58f/0x3234de053c4bfa2 lrc: 3/0,1 mode: --/PW res: [0x2b26c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.361262:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000023b8edfa/0x3234de053c44d9c lrc: 2/0,0 mode: PR/PR res: [0x2b26c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7cda expref: 405 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.361265:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.361266:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.361266:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095fca58f/0x3234de053c4bfa2 lrc: 4/0,1 mode: --/PW res: [0x2b26c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.361273:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000023b8edfa/0x3234de053c44d9c lrc: 3/0,0 mode: PR/PR res: [0x2b26c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7cda expref: 405 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.361277:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000023b8edfa/0x3234de053c44d9c lrc: 4/0,0 mode: PR/PR res: [0x2b26c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7cda expref: 405 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.361281:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006e3eb319 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996925888:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.361300:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b52d0f36 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.361410:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.361440:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394395776 00010000:00010000:1.0:1651529333.361451:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000001d33837/0x3234de053c45790 lrc: 4/0,0 mode: PR/PR res: [0x2b269:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa53d expref: 406 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.361462:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11079 00000100:00100000:1.0:1651529333.361464:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+406:41278:x1731746394395776:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.361467:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.361468:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000001d33837/0x3234de053c45790 lrc: 4/0,0 mode: PR/PR res: [0x2b269:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa53d expref: 406 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.361472:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000001d33837/0x3234de053c45790 lrc: 3/0,0 mode: PR/PR res: [0x2b269:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa53d expref: 406 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.361478:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001d33837/0x3234de053c45790 lrc: 0/0,0 mode: --/PR res: [0x2b269:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa53d expref: 406 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.361481:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.361482:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.361483:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4bf86 lrc: 3/0,1 mode: PW/PW res: [0x2b269:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.361486:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4bf86 lrc: 4/0,1 mode: PW/PW res: [0x2b269:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.361494:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.361502:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+405:41278:x1731746394395776:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 38us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.361505:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11079 00000100:00100000:1.0:1651529333.361537:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.361572:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.361600:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.361611:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946285248 00000100:00100000:1.0:1651529333.361620:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946285376 00000100:00100000:1.0:1651529333.361629:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208440 00000100:00100000:1.0:1651529333.361631:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1002:39030:x1731745946285248:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.361636:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176750 count 1 00010000:00010000:1.0:1651529333.361641:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001722859c/0x3234de053c4bfb0 lrc: 3/0,1 mode: --/PW res: [0x2b26e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.361645:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f852d1af/0x3234de053c45e20 lrc: 2/0,0 mode: PR/PR res: [0x2b26e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abf7d expref: 404 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.361648:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.361649:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.361650:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001722859c/0x3234de053c4bfb0 lrc: 4/0,1 mode: --/PW res: [0x2b26e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.361656:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f852d1af/0x3234de053c45e20 lrc: 3/0,0 mode: PR/PR res: [0x2b26e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abf7d expref: 404 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.361660:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f852d1af/0x3234de053c45e20 lrc: 4/0,0 mode: PR/PR res: [0x2b26e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abf7d expref: 404 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.361664:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007fca8239 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996926016:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.361673:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 000000004698fefb going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.361679:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208441 00000100:00100000:1.0:1651529333.361681:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1002:39030:x1731745946285376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.361685:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176752 count 1 00010000:00010000:1.0:1651529333.361688:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d33d4a29/0x3234de053c4bfb7 lrc: 3/0,1 mode: --/PW res: [0x2b270:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.361693:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c466e7 lrc: 2/0,0 mode: PR/PR res: [0x2b270:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae379 expref: 404 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.361698:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.361699:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.361699:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d33d4a29/0x3234de053c4bfb7 lrc: 4/0,1 mode: --/PW res: [0x2b270:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.361705:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c466e7 lrc: 3/0,0 mode: PR/PR res: [0x2b270:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae379 expref: 404 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.361708:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c466e7 lrc: 4/0,0 mode: PR/PR res: [0x2b270:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae379 expref: 404 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.361712:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f99b3c22 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996926080:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.361718:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000412e5d26 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.361774:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.361817:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.361824:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.361834:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.361841:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.361847:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946285440 00000100:00100000:1.0:1651529333.361857:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208442 00000100:00100000:1.0:1651529333.361859:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1003:39029:x1731745946285440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.361864:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176753 count 1 00010000:00010000:1.0:1651529333.361868:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083b7e42d/0x3234de053c4bfbe lrc: 3/0,1 mode: --/PW res: [0x2b271:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.361873:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b2dba29f/0x3234de053c4680d lrc: 2/0,0 mode: PR/PR res: [0x2b271:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae7f5 expref: 408 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.361876:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.361877:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.361878:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083b7e42d/0x3234de053c4bfbe lrc: 4/0,1 mode: --/PW res: [0x2b271:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.361884:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b2dba29f/0x3234de053c4680d lrc: 3/0,0 mode: PR/PR res: [0x2b271:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae7f5 expref: 408 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.361887:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b2dba29f/0x3234de053c4680d lrc: 4/0,0 mode: PR/PR res: [0x2b271:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae7f5 expref: 408 pid: 80277 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.361892:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000075e1000f pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996926144:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.361903:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000567ee0ef going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.361910:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006e3eb319 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996925888:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.361913:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000095fca58f/0x3234de053c4bfa2 lrc: 3/0,1 mode: --/PW res: [0x2b26c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.361920:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11082 00000100:00100000:1.0:1651529333.361922:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+406:41278:x1731746394395904:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.361925:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.361927:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dd1e7c0d/0x3234de053c44610 lrc: 4/0,0 mode: PR/PR res: [0x2b26b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5f13 expref: 406 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.361931:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dd1e7c0d/0x3234de053c44610 lrc: 3/0,0 mode: PR/PR res: [0x2b26b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5f13 expref: 406 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.361936:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd1e7c0d/0x3234de053c44610 lrc: 0/0,0 mode: --/PR res: [0x2b26b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5f13 expref: 405 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.361940:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.361941:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.361942:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4bf94 lrc: 3/0,1 mode: PW/PW res: [0x2b26b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.361944:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4bf94 lrc: 4/0,1 mode: PW/PW res: [0x2b26b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.361954:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.361961:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+403:41278:x1731746394395904:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 38us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.361965:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11082 00010000:00010000:1.0:1651529333.362036:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000095fca58f/0x3234de053c4bfa2 lrc: 3/0,1 mode: PW/PW res: [0x2b26c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.362040:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095fca58f/0x3234de053c4bfa2 lrc: 3/0,1 mode: PW/PW res: [0x2b26c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.362044:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095fca58f/0x3234de053c4bfa2 lrc: 3/0,1 mode: PW/PW res: [0x2b26c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.362046:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095fca58f/0x3234de053c4bfa2 lrc: 2/0,0 mode: PW/PW res: [0x2b26c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.362100:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1004:39030:x1731745946285120:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 852us (961us total) trans 12885078354 rc 0/0 00000100:00100000:1.0:1651529333.362104:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208438 00010000:00010000:1.0:1651529333.362111:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095fca58f/0x3234de053c4bfa2 lrc: 2/0,0 mode: PW/PW res: [0x2b26c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.362115:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000095fca58f already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.362116:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095fca58f/0x3234de053c4bfa2 lrc: 2/0,0 mode: PW/PW res: [0x2b26c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.362119:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095fca58f/0x3234de053c4bfa2 lrc: 3/0,0 mode: PW/PW res: [0x2b26c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.362123:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095fca58f/0x3234de053c4bfa2 lrc: 1/0,0 mode: --/PW res: [0x2b26c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.362126:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095fca58f/0x3234de053c4bfa2 lrc: 0/0,0 mode: --/PW res: [0x2b26c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.362264:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.362277:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.362283:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.362299:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007fca8239 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996926016:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.362304:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001722859c/0x3234de053c4bfb0 lrc: 3/0,1 mode: --/PW res: [0x2b26e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.362313:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f99b3c22 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996926080:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.362315:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d33d4a29/0x3234de053c4bfb7 lrc: 3/0,1 mode: --/PW res: [0x2b270:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.362321:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394396224 00010000:00010000:1.0:1651529333.362326:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f852d1af/0x3234de053c45e20 lrc: 4/0,0 mode: PR/PR res: [0x2b26e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abf7d expref: 401 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.362340:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394396160 00010000:00010000:1.0:1651529333.362343:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e0fcc05c/0x3234de053c43c77 lrc: 4/0,0 mode: PR/PR res: [0x2b26f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3766 expref: 402 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.362347:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394396352 00010000:00010000:1.0:1651529333.362349:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c466e7 lrc: 4/0,0 mode: PR/PR res: [0x2b270:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae379 expref: 403 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.362354:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11084 00000100:00100000:1.0:1651529333.362355:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bbd85ac9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+403:41278:x1731746394396224:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.362358:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.362359:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f852d1af/0x3234de053c45e20 lrc: 4/0,0 mode: PR/PR res: [0x2b26e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abf7d expref: 403 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.362368:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f852d1af/0x3234de053c45e20 lrc: 3/0,0 mode: PR/PR res: [0x2b26e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abf7d expref: 403 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.362377:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f852d1af/0x3234de053c45e20 lrc: 0/0,0 mode: --/PR res: [0x2b26e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abf7d expref: 403 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.362381:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.362381:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.362382:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001722859c/0x3234de053c4bfb0 lrc: 3/0,1 mode: PW/PW res: [0x2b26e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.362385:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001722859c/0x3234de053c4bfb0 lrc: 4/0,1 mode: PW/PW res: [0x2b26e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.362391:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.362399:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bbd85ac9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+402:41278:x1731746394396224:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 43us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.362401:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11084 00000100:00100000:1.0:1651529333.362410:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11086 00000100:00100000:1.0:1651529333.362412:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+401:41278:x1731746394396352:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.362414:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.362416:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c466e7 lrc: 4/0,0 mode: PR/PR res: [0x2b270:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae379 expref: 401 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.362419:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c466e7 lrc: 3/0,0 mode: PR/PR res: [0x2b270:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae379 expref: 401 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.362424:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c466e7 lrc: 0/0,0 mode: --/PR res: [0x2b270:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae379 expref: 400 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.362430:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.362431:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.362432:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d33d4a29/0x3234de053c4bfb7 lrc: 3/0,1 mode: PW/PW res: [0x2b270:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.362434:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d33d4a29/0x3234de053c4bfb7 lrc: 4/0,1 mode: PW/PW res: [0x2b270:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.362440:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.362445:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+398:41278:x1731746394396352:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 33us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.362447:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11086 00000100:00100000:1.0:1651529333.362457:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000075e1000f pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996926144:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.362460:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000083b7e42d/0x3234de053c4bfbe lrc: 3/0,1 mode: --/PW res: [0x2b271:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.362473:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea8e6dc3/0x3234de053c4bfa9 lrc: 2/0,0 mode: PW/PW res: [0x2b26f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.362477:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ea8e6dc3 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.362478:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea8e6dc3/0x3234de053c4bfa9 lrc: 2/0,0 mode: PW/PW res: [0x2b26f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.362481:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea8e6dc3/0x3234de053c4bfa9 lrc: 3/0,0 mode: PW/PW res: [0x2b26f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.362488:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea8e6dc3/0x3234de053c4bfa9 lrc: 1/0,0 mode: --/PW res: [0x2b26f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.362490:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea8e6dc3/0x3234de053c4bfa9 lrc: 0/0,0 mode: --/PW res: [0x2b26f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.362496:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d33d4a29/0x3234de053c4bfb7 lrc: 3/0,1 mode: PW/PW res: [0x2b270:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.362498:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d33d4a29/0x3234de053c4bfb7 lrc: 3/0,1 mode: PW/PW res: [0x2b270:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.362502:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d33d4a29/0x3234de053c4bfb7 lrc: 3/0,1 mode: PW/PW res: [0x2b270:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.362504:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d33d4a29/0x3234de053c4bfb7 lrc: 2/0,0 mode: PW/PW res: [0x2b270:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.362548:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1004:39030:x1731745946285376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 866us (947us total) trans 12885078358 rc 0/0 00000100:00100000:1.0:1651529333.362551:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208441 00010000:00010000:1.0:1651529333.362558:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001722859c/0x3234de053c4bfb0 lrc: 3/0,1 mode: PW/PW res: [0x2b26e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.362561:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001722859c/0x3234de053c4bfb0 lrc: 3/0,1 mode: PW/PW res: [0x2b26e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.362566:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001722859c/0x3234de053c4bfb0 lrc: 3/0,1 mode: PW/PW res: [0x2b26e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.362569:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001722859c/0x3234de053c4bfb0 lrc: 2/0,0 mode: PW/PW res: [0x2b26e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.362606:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1004:39030:x1731745946285248:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 975us (1034us total) trans 12885078359 rc 0/0 00000100:00100000:1.0:1651529333.362609:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208440 00000100:00100000:1.0:1651529333.362624:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.362657:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.362673:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.362682:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.362742:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394396480 00010000:00010000:1.0:1651529333.362748:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b2dba29f/0x3234de053c4680d lrc: 4/0,0 mode: PR/PR res: [0x2b271:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae7f5 expref: 398 pid: 80277 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.362756:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11087 00000100:00100000:1.0:1651529333.362758:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+398:41279:x1731746394396480:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.362766:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.362768:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b2dba29f/0x3234de053c4680d lrc: 4/0,0 mode: PR/PR res: [0x2b271:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae7f5 expref: 398 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.362772:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b2dba29f/0x3234de053c4680d lrc: 3/0,0 mode: PR/PR res: [0x2b271:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae7f5 expref: 398 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.362780:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2dba29f/0x3234de053c4680d lrc: 0/0,0 mode: --/PR res: [0x2b271:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae7f5 expref: 398 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.362784:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.362784:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.362785:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000083b7e42d/0x3234de053c4bfbe lrc: 3/0,1 mode: PW/PW res: [0x2b271:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.362788:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083b7e42d/0x3234de053c4bfbe lrc: 4/0,1 mode: PW/PW res: [0x2b271:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.362794:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.362801:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+397:41279:x1731746394396480:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.362803:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11087 00010000:00010000:1.0:1651529333.362810:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000083b7e42d/0x3234de053c4bfbe lrc: 3/0,1 mode: PW/PW res: [0x2b271:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.362813:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083b7e42d/0x3234de053c4bfbe lrc: 3/0,1 mode: PW/PW res: [0x2b271:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.362816:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083b7e42d/0x3234de053c4bfbe lrc: 3/0,1 mode: PW/PW res: [0x2b271:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.362819:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083b7e42d/0x3234de053c4bfbe lrc: 2/0,0 mode: PW/PW res: [0x2b271:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.362859:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1007:39029:x1731745946285440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 999us (1084us total) trans 12885078360 rc 0/0 00000100:00100000:1.0:1651529333.362862:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208442 00010000:00010000:1.0:1651529333.362868:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083b7e42d/0x3234de053c4bfbe lrc: 2/0,0 mode: PW/PW res: [0x2b271:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.362872:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000083b7e42d already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.362873:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083b7e42d/0x3234de053c4bfbe lrc: 2/0,0 mode: PW/PW res: [0x2b271:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.362876:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083b7e42d/0x3234de053c4bfbe lrc: 3/0,0 mode: PW/PW res: [0x2b271:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.362880:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083b7e42d/0x3234de053c4bfbe lrc: 1/0,0 mode: --/PW res: [0x2b271:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.362883:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083b7e42d/0x3234de053c4bfbe lrc: 0/0,0 mode: --/PW res: [0x2b271:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.362951:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.362975:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.362982:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.362992:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.363009:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946285824 00000100:00100000:1.0:1651529333.363019:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208447 00000100:00100000:1.0:1651529333.363021:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1010:39029:x1731745946285696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.363027:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176757 count 1 00010000:00010000:1.0:1651529333.363031:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad242558/0x3234de053c4bfe1 lrc: 3/0,1 mode: --/PW res: [0x2b275:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.363036:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004884fc72/0x3234de053c46e1f lrc: 2/0,0 mode: PR/PR res: [0x2b275:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2b047a expref: 396 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.363039:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.363040:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.363040:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad242558/0x3234de053c4bfe1 lrc: 4/0,1 mode: --/PW res: [0x2b275:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.363054:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004884fc72/0x3234de053c46e1f lrc: 3/0,0 mode: PR/PR res: [0x2b275:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2b047a expref: 396 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.363057:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004884fc72/0x3234de053c46e1f lrc: 4/0,0 mode: PR/PR res: [0x2b275:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2b047a expref: 396 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.363062:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a925fbf6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996926400:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.363071:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f9dac3f6 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.363077:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208448 00000100:00100000:1.0:1651529333.363079:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1010:39030:x1731745946285888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.363083:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176760 count 1 00010000:00010000:1.0:1651529333.363087:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f88ef7eb/0x3234de053c4bfe8 lrc: 3/0,1 mode: --/PW res: [0x2b278:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.363091:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff15605e/0x3234de053c4685a lrc: 2/0,0 mode: PR/PR res: [0x2b278:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae914 expref: 396 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.363094:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.363095:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.363096:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f88ef7eb/0x3234de053c4bfe8 lrc: 4/0,1 mode: --/PW res: [0x2b278:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.363101:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ff15605e/0x3234de053c4685a lrc: 3/0,0 mode: PR/PR res: [0x2b278:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae914 expref: 396 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.363105:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ff15605e/0x3234de053c4685a lrc: 4/0,0 mode: PR/PR res: [0x2b278:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae914 expref: 396 pid: 80277 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.363109:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f99b3c22 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996926528:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.363115:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 0000000057299e7f going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.363130:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.363269:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.363291:0:72397:0:(service.c:3189:ptlrpc_start_thread()) ost[0] started 11 min 3 max 80 00000100:00100000:1.0:1651529333.363295:0:72397:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost00_011' 00000100:00100000:1.0:1651529333.363659:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.363666:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.363676:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a925fbf6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996926400:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.363680:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ad242558/0x3234de053c4bfe1 lrc: 3/0,1 mode: --/PW res: [0x2b275:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.363687:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f99b3c22 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996926528:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.363690:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f88ef7eb/0x3234de053c4bfe8 lrc: 3/0,1 mode: --/PW res: [0x2b278:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.363695:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394396928 00010000:00010000:1.0:1651529333.363700:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a0ac138e/0x3234de053c44a7e lrc: 4/0,0 mode: PR/PR res: [0x2b273:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7149 expref: 398 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.363707:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394397056 00010000:00010000:1.0:1651529333.363709:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cc418822/0x3234de053c45dcc lrc: 5/0,0 mode: PR/PR res: [0x2b274:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abdd9 expref: 399 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.363718:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11088 00000100:00100000:1.0:1651529333.363720:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+399:41278:x1731746394396928:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.363723:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.363724:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a0ac138e/0x3234de053c44a7e lrc: 4/0,0 mode: PR/PR res: [0x2b273:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7149 expref: 399 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.363736:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a0ac138e/0x3234de053c44a7e lrc: 3/0,0 mode: PR/PR res: [0x2b273:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7149 expref: 399 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.363742:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0ac138e/0x3234de053c44a7e lrc: 0/0,0 mode: --/PR res: [0x2b273:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7149 expref: 399 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.363746:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.363747:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.363748:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007c5115ca/0x3234de053c4bfc5 lrc: 3/0,1 mode: PW/PW res: [0x2b273:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.363751:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c5115ca/0x3234de053c4bfc5 lrc: 4/0,1 mode: PW/PW res: [0x2b273:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.363760:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.363769:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+398:41278:x1731746394396928:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 48us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.363772:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11088 00000100:00100000:1.0:1651529333.363777:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11089 00000100:00100000:1.0:1651529333.363778:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+397:41278:x1731746394397056:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.363781:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.363782:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cc418822/0x3234de053c45dcc lrc: 5/0,0 mode: PR/PR res: [0x2b274:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abdd9 expref: 397 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.363786:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cc418822/0x3234de053c45dcc lrc: 4/0,0 mode: PR/PR res: [0x2b274:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abdd9 expref: 397 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.363791:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.363791:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.363792:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008e21f640/0x3234de053c4bfd3 lrc: 3/0,1 mode: PW/PW res: [0x2b274:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.363795:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e21f640/0x3234de053c4bfd3 lrc: 4/0,1 mode: PW/PW res: [0x2b274:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.363799:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.363803:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+397:41278:x1731746394397056:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 25us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.363806:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11089 00000100:00100000:1.0:1651529333.363850:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.363874:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.363882:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.363889:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.363894:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.363899:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.363905:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394397184 00010000:00010000:1.0:1651529333.363909:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000024e518f1/0x3234de053c44990 lrc: 5/0,0 mode: PR/PR res: [0x2b276:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6d98 expref: 397 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.363915:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394396992 00010000:00010000:1.0:1651529333.363917:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007dc159e9/0x3234de053c464a9 lrc: 4/0,0 mode: PR/PR res: [0x2b272:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ada65 expref: 398 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.363921:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394397312 00010000:00010000:1.0:1651529333.363923:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b128bba6/0x3234de053c44c5a lrc: 5/0,0 mode: PR/PR res: [0x2b277:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a77c4 expref: 399 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.363927:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394397120 00010000:00010000:1.0:1651529333.363929:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004884fc72/0x3234de053c46e1f lrc: 4/0,0 mode: PR/PR res: [0x2b275:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2b047a expref: 400 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.363932:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394397248 00010000:00010000:1.0:1651529333.363934:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ff15605e/0x3234de053c4685a lrc: 4/0,0 mode: PR/PR res: [0x2b278:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae914 expref: 401 pid: 80277 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.363938:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394397376 00010000:00010000:1.0:1651529333.363940:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001b452f61/0x3234de053c4482b lrc: 5/0,0 mode: PR/PR res: [0x2b279:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a67a9 expref: 402 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.363947:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11090 00000100:00100000:1.0:1651529333.363949:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+402:41278:x1731746394397184:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.363951:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.363952:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000024e518f1/0x3234de053c44990 lrc: 5/0,0 mode: PR/PR res: [0x2b276:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6d98 expref: 402 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.363956:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000024e518f1/0x3234de053c44990 lrc: 4/0,0 mode: PR/PR res: [0x2b276:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6d98 expref: 402 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.363962:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.363962:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.363963:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009be39b1e/0x3234de053c4bfda lrc: 3/0,1 mode: PW/PW res: [0x2b276:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.363966:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009be39b1e/0x3234de053c4bfda lrc: 4/0,1 mode: PW/PW res: [0x2b276:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.363971:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.363978:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+402:41278:x1731746394397184:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 29us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.363981:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11090 00000100:00100000:1.0:1651529333.363985:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11091 00000100:00100000:1.0:1651529333.363986:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ede49ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+401:41279:x1731746394396992:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529333.363988:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.363990:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007dc159e9/0x3234de053c464a9 lrc: 4/0,0 mode: PR/PR res: [0x2b272:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ada65 expref: 401 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.363993:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007dc159e9/0x3234de053c464a9 lrc: 3/0,0 mode: PR/PR res: [0x2b272:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ada65 expref: 401 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.363998:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007dc159e9/0x3234de053c464a9 lrc: 0/0,0 mode: --/PR res: [0x2b272:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ada65 expref: 401 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.364001:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.364002:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.364002:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005086bd45/0x3234de053c4bfcc lrc: 3/0,1 mode: PW/PW res: [0x2b272:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364005:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005086bd45/0x3234de053c4bfcc lrc: 4/0,1 mode: PW/PW res: [0x2b272:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364015:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.364020:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ede49ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+400:41279:x1731746394396992:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.364023:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11091 00000100:00100000:1.0:1651529333.364031:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11092 00000100:00100000:1.0:1651529333.364032:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+399:41278:x1731746394397312:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.364035:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.364036:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b128bba6/0x3234de053c44c5a lrc: 5/0,0 mode: PR/PR res: [0x2b277:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a77c4 expref: 399 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.364040:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b128bba6/0x3234de053c44c5a lrc: 4/0,0 mode: PR/PR res: [0x2b277:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a77c4 expref: 399 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.364044:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.364045:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.364046:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000058d7a733/0x3234de053c4bfef lrc: 3/0,1 mode: PW/PW res: [0x2b277:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364049:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058d7a733/0x3234de053c4bfef lrc: 4/0,1 mode: PW/PW res: [0x2b277:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364053:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.364057:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+398:41278:x1731746394397312:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 24us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.364059:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11092 00000100:00100000:1.0:1651529333.364062:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11093 00000100:00100000:1.0:1651529333.364064:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+397:41279:x1731746394397120:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529333.364066:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.364067:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004884fc72/0x3234de053c46e1f lrc: 4/0,0 mode: PR/PR res: [0x2b275:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2b047a expref: 397 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.364070:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004884fc72/0x3234de053c46e1f lrc: 3/0,0 mode: PR/PR res: [0x2b275:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2b047a expref: 397 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.364075:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004884fc72/0x3234de053c46e1f lrc: 0/0,0 mode: --/PR res: [0x2b275:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2b047a expref: 397 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.364079:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.364079:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.364080:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ad242558/0x3234de053c4bfe1 lrc: 3/0,1 mode: PW/PW res: [0x2b275:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364083:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad242558/0x3234de053c4bfe1 lrc: 4/0,1 mode: PW/PW res: [0x2b275:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364089:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.364093:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+396:41279:x1731746394397120:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 29us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.364095:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11093 00000100:00100000:1.0:1651529333.364099:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11094 00000100:00100000:1.0:1651529333.364100:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+395:41279:x1731746394397248:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529333.364102:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.364103:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ff15605e/0x3234de053c4685a lrc: 4/0,0 mode: PR/PR res: [0x2b278:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae914 expref: 395 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.364107:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ff15605e/0x3234de053c4685a lrc: 3/0,0 mode: PR/PR res: [0x2b278:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae914 expref: 395 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.364111:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff15605e/0x3234de053c4685a lrc: 0/0,0 mode: --/PR res: [0x2b278:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae914 expref: 395 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.364114:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.364115:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.364115:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f88ef7eb/0x3234de053c4bfe8 lrc: 3/0,1 mode: PW/PW res: [0x2b278:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364118:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f88ef7eb/0x3234de053c4bfe8 lrc: 4/0,1 mode: PW/PW res: [0x2b278:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364124:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.364128:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+393:41279:x1731746394397248:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 27us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.364130:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11094 00000100:00100000:1.0:1651529333.364134:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11095 00000100:00100000:1.0:1651529333.364135:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:41279:x1731746394397376:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529333.364137:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.364139:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001b452f61/0x3234de053c4482b lrc: 5/0,0 mode: PR/PR res: [0x2b279:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a67a9 expref: 392 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.364142:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001b452f61/0x3234de053c4482b lrc: 4/0,0 mode: PR/PR res: [0x2b279:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a67a9 expref: 392 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.364146:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.364147:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.364147:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf272247/0x3234de053c4bff6 lrc: 3/0,1 mode: PW/PW res: [0x2b279:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364150:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf272247/0x3234de053c4bff6 lrc: 4/0,1 mode: PW/PW res: [0x2b279:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364154:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.364158:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:41279:x1731746394397376:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 22us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.364160:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11095 00010000:00010000:1.0:1651529333.364166:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f88ef7eb/0x3234de053c4bfe8 lrc: 3/0,1 mode: PW/PW res: [0x2b278:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364169:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f88ef7eb/0x3234de053c4bfe8 lrc: 3/0,1 mode: PW/PW res: [0x2b278:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364173:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f88ef7eb/0x3234de053c4bfe8 lrc: 3/0,1 mode: PW/PW res: [0x2b278:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364175:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f88ef7eb/0x3234de053c4bfe8 lrc: 2/0,0 mode: PW/PW res: [0x2b278:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.364215:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1012:39030:x1731745946285888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1135us (1232us total) trans 12885078363 rc 0/0 00000100:00100000:1.0:1651529333.364218:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208448 00010000:00010000:1.0:1651529333.364243:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e21f640/0x3234de053c4bfd3 lrc: 2/0,0 mode: PW/PW res: [0x2b274:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364246:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008e21f640 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.364247:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e21f640/0x3234de053c4bfd3 lrc: 2/0,0 mode: PW/PW res: [0x2b274:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364250:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e21f640/0x3234de053c4bfd3 lrc: 3/0,0 mode: PW/PW res: [0x2b274:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364255:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e21f640/0x3234de053c4bfd3 lrc: 1/0,0 mode: --/PW res: [0x2b274:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364258:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e21f640/0x3234de053c4bfd3 lrc: 0/0,0 mode: --/PW res: [0x2b274:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364262:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009be39b1e/0x3234de053c4bfda lrc: 2/0,0 mode: PW/PW res: [0x2b276:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364265:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009be39b1e already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.364266:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009be39b1e/0x3234de053c4bfda lrc: 2/0,0 mode: PW/PW res: [0x2b276:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364269:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009be39b1e/0x3234de053c4bfda lrc: 3/0,0 mode: PW/PW res: [0x2b276:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364272:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009be39b1e/0x3234de053c4bfda lrc: 1/0,0 mode: --/PW res: [0x2b276:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364274:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009be39b1e/0x3234de053c4bfda lrc: 0/0,0 mode: --/PW res: [0x2b276:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364278:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f88ef7eb/0x3234de053c4bfe8 lrc: 2/0,0 mode: PW/PW res: [0x2b278:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364280:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f88ef7eb already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.364281:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f88ef7eb/0x3234de053c4bfe8 lrc: 2/0,0 mode: PW/PW res: [0x2b278:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364284:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f88ef7eb/0x3234de053c4bfe8 lrc: 3/0,0 mode: PW/PW res: [0x2b278:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364287:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f88ef7eb/0x3234de053c4bfe8 lrc: 1/0,0 mode: --/PW res: [0x2b278:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364289:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f88ef7eb/0x3234de053c4bfe8 lrc: 0/0,0 mode: --/PW res: [0x2b278:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364293:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058d7a733/0x3234de053c4bfef lrc: 2/0,0 mode: PW/PW res: [0x2b277:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364295:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000058d7a733 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.364296:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058d7a733/0x3234de053c4bfef lrc: 2/0,0 mode: PW/PW res: [0x2b277:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364299:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058d7a733/0x3234de053c4bfef lrc: 3/0,0 mode: PW/PW res: [0x2b277:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364302:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058d7a733/0x3234de053c4bfef lrc: 1/0,0 mode: --/PW res: [0x2b277:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364304:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058d7a733/0x3234de053c4bfef lrc: 0/0,0 mode: --/PW res: [0x2b277:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364312:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ad242558/0x3234de053c4bfe1 lrc: 3/0,1 mode: PW/PW res: [0x2b275:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364320:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad242558/0x3234de053c4bfe1 lrc: 3/0,1 mode: PW/PW res: [0x2b275:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364323:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad242558/0x3234de053c4bfe1 lrc: 3/0,1 mode: PW/PW res: [0x2b275:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364326:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad242558/0x3234de053c4bfe1 lrc: 2/0,0 mode: PW/PW res: [0x2b275:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.364362:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1012:39029:x1731745946285696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1340us (1393us total) trans 12885078366 rc 0/0 00000100:00100000:1.0:1651529333.364365:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208447 00010000:00010000:1.0:1651529333.364372:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf272247/0x3234de053c4bff6 lrc: 2/0,0 mode: PW/PW res: [0x2b279:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364375:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bf272247 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.364376:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf272247/0x3234de053c4bff6 lrc: 2/0,0 mode: PW/PW res: [0x2b279:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364379:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf272247/0x3234de053c4bff6 lrc: 3/0,0 mode: PW/PW res: [0x2b279:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364383:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf272247/0x3234de053c4bff6 lrc: 1/0,0 mode: --/PW res: [0x2b279:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364386:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf272247/0x3234de053c4bff6 lrc: 0/0,0 mode: --/PW res: [0x2b279:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364390:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad242558/0x3234de053c4bfe1 lrc: 2/0,0 mode: PW/PW res: [0x2b275:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364393:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ad242558 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.364394:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad242558/0x3234de053c4bfe1 lrc: 2/0,0 mode: PW/PW res: [0x2b275:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364397:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad242558/0x3234de053c4bfe1 lrc: 3/0,0 mode: PW/PW res: [0x2b275:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364400:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad242558/0x3234de053c4bfe1 lrc: 1/0,0 mode: --/PW res: [0x2b275:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364403:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad242558/0x3234de053c4bfe1 lrc: 0/0,0 mode: --/PW res: [0x2b275:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364406:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c5115ca/0x3234de053c4bfc5 lrc: 2/0,0 mode: PW/PW res: [0x2b273:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364408:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007c5115ca already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.364409:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c5115ca/0x3234de053c4bfc5 lrc: 2/0,0 mode: PW/PW res: [0x2b273:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364412:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c5115ca/0x3234de053c4bfc5 lrc: 3/0,0 mode: PW/PW res: [0x2b273:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364415:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c5115ca/0x3234de053c4bfc5 lrc: 1/0,0 mode: --/PW res: [0x2b273:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364417:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c5115ca/0x3234de053c4bfc5 lrc: 0/0,0 mode: --/PW res: [0x2b273:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364421:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005086bd45/0x3234de053c4bfcc lrc: 2/0,0 mode: PW/PW res: [0x2b272:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364424:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005086bd45 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.364425:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005086bd45/0x3234de053c4bfcc lrc: 2/0,0 mode: PW/PW res: [0x2b272:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364427:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005086bd45/0x3234de053c4bfcc lrc: 3/0,0 mode: PW/PW res: [0x2b272:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364430:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005086bd45/0x3234de053c4bfcc lrc: 1/0,0 mode: --/PW res: [0x2b272:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364433:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005086bd45/0x3234de053c4bfcc lrc: 0/0,0 mode: --/PW res: [0x2b272:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.364558:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.364658:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.364694:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.364705:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946286016 00000100:00100000:1.0:1651529333.364715:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208454 00000100:00100000:1.0:1651529333.364716:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1013:39030:x1731745946286016:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.364722:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176762 count 1 00010000:00010000:1.0:1651529333.364726:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f005b0e/0x3234de053c4c012 lrc: 3/0,1 mode: --/PW res: [0x2b27a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364739:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000269a3f0/0x3234de053c46a13 lrc: 2/0,0 mode: PR/PR res: [0x2b27a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af0ae expref: 390 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.364750:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.364751:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.364752:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f005b0e/0x3234de053c4c012 lrc: 4/0,1 mode: --/PW res: [0x2b27a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364760:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000269a3f0/0x3234de053c46a13 lrc: 3/0,0 mode: PR/PR res: [0x2b27a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af0ae expref: 390 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.364763:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000269a3f0/0x3234de053c46a13 lrc: 4/0,0 mode: PR/PR res: [0x2b27a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af0ae expref: 390 pid: 80277 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.364768:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d523a75 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996926784:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.364777:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000412e5d26 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.364819:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.364846:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.364856:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.364864:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.364871:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.364880:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.364889:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946286144 00000100:00100000:1.0:1651529333.364896:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946286336 00000100:00100000:1.0:1651529333.364902:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946286272 00000100:00100000:1.0:1651529333.364905:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946286464 00000100:00100000:1.0:1651529333.364907:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946286400 00000100:00100000:1.0:1651529333.364910:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208456 00000100:00100000:1.0:1651529333.364912:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1019:39030:x1731745946286144:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.364918:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176764 count 1 00010000:00010000:1.0:1651529333.364928:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c4c020 lrc: 3/0,1 mode: --/PW res: [0x2b27c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364933:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a3924c32/0x3234de053c4486a lrc: 2/0,0 mode: PR/PR res: [0x2b27c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6851 expref: 390 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.364936:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.364937:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.364938:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c4c020 lrc: 4/0,1 mode: --/PW res: [0x2b27c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364945:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a3924c32/0x3234de053c4486a lrc: 3/0,0 mode: PR/PR res: [0x2b27c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6851 expref: 390 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.364948:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a3924c32/0x3234de053c4486a lrc: 4/0,0 mode: PR/PR res: [0x2b27c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6851 expref: 390 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.364952:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ffb5d0a pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996926912:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.364961:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 0000000071742acc going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.364968:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208458 00000100:00100000:1.0:1651529333.364970:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1019:39030:x1731745946286272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.364974:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176766 count 1 00010000:00010000:1.0:1651529333.364977:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c4c02e lrc: 3/0,1 mode: --/PW res: [0x2b27e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364982:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000084459261/0x3234de053c44656 lrc: 2/0,0 mode: PR/PR res: [0x2b27e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6047 expref: 390 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.364985:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.364986:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.364986:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c4c02e lrc: 4/0,1 mode: --/PW res: [0x2b27e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.364992:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000084459261/0x3234de053c44656 lrc: 3/0,0 mode: PR/PR res: [0x2b27e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6047 expref: 390 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.364996:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000084459261/0x3234de053c44656 lrc: 4/0,0 mode: PR/PR res: [0x2b27e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6047 expref: 390 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.365000:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cee35a0c pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996927040:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.365006:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a5495eb going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.365011:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208460 00000100:00100000:1.0:1651529333.365013:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1019:39030:x1731745946286400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.365017:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176768 count 1 00010000:00010000:1.0:1651529333.365021:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9cecf0c/0x3234de053c4c03c lrc: 3/0,1 mode: --/PW res: [0x2b280:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.365025:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000034eb7dbd/0x3234de053c46638 lrc: 2/0,0 mode: PR/PR res: [0x2b280:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae0d9 expref: 390 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.365028:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.365028:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.365029:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9cecf0c/0x3234de053c4c03c lrc: 4/0,1 mode: --/PW res: [0x2b280:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.365037:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000034eb7dbd/0x3234de053c46638 lrc: 3/0,0 mode: PR/PR res: [0x2b280:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae0d9 expref: 390 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.365041:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000034eb7dbd/0x3234de053c46638 lrc: 4/0,0 mode: PR/PR res: [0x2b280:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae0d9 expref: 390 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.365045:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000028589556 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996927168:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.365050:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 0000000099c1da85 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.365144:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.365154:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.365162:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394397888 00010000:00010000:1.0:1651529333.365172:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000269a3f0/0x3234de053c46a13 lrc: 5/0,0 mode: PR/PR res: [0x2b27a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af0ae expref: 392 pid: 80277 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.365180:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11097 00000100:00100000:1.0:1651529333.365182:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:41278:x1731746394397888:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.365185:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.365186:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000269a3f0/0x3234de053c46a13 lrc: 5/0,0 mode: PR/PR res: [0x2b27a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af0ae expref: 392 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.365190:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000269a3f0/0x3234de053c46a13 lrc: 4/0,0 mode: PR/PR res: [0x2b27a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af0ae expref: 392 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.365195:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.365196:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.365197:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001f005b0e/0x3234de053c4c012 lrc: 3/0,1 mode: PW/PW res: [0x2b27a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.365200:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f005b0e/0x3234de053c4c012 lrc: 4/0,1 mode: PW/PW res: [0x2b27a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.365205:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.365221:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+390:41278:x1731746394397888:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 38us (66us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.365241:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11097 00010000:00010000:1.0:1651529333.365253:0:106695:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000269a3f0/0x3234de053c46a13 lrc: 0/0,0 mode: --/PR res: [0x2b27a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af0ae expref: 389 pid: 80277 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.365257:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d523a75 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996926784:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.365261:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001f005b0e/0x3234de053c4c012 lrc: 3/0,1 mode: PW/PW res: [0x2b27a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.365264:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001f005b0e/0x3234de053c4c012 lrc: 3/0,1 mode: PW/PW res: [0x2b27a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.365267:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f005b0e/0x3234de053c4c012 lrc: 3/0,1 mode: PW/PW res: [0x2b27a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.365270:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f005b0e/0x3234de053c4c012 lrc: 3/0,1 mode: PW/PW res: [0x2b27a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.365273:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f005b0e/0x3234de053c4c012 lrc: 2/0,0 mode: PW/PW res: [0x2b27a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.365326:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1020:39030:x1731745946286016:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 609us (632us total) trans 12885078370 rc 0/0 00000100:00100000:1.0:1651529333.365329:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208454 00010000:00010000:1.0:1651529333.365337:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f005b0e/0x3234de053c4c012 lrc: 2/0,0 mode: PW/PW res: [0x2b27a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.365341:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001f005b0e already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.365342:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f005b0e/0x3234de053c4c012 lrc: 2/0,0 mode: PW/PW res: [0x2b27a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.365345:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f005b0e/0x3234de053c4c012 lrc: 3/0,0 mode: PW/PW res: [0x2b27a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.365349:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f005b0e/0x3234de053c4c012 lrc: 1/0,0 mode: --/PW res: [0x2b27a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.365352:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f005b0e/0x3234de053c4c012 lrc: 0/0,0 mode: --/PW res: [0x2b27a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.365601:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.365613:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.365641:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.365648:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.365654:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.365660:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.365669:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.365675:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.365683:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ffb5d0a pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996926912:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.365688:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c4c020 lrc: 3/0,1 mode: --/PW res: [0x2b27c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.365695:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cee35a0c pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996927040:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.365703:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c4c02e lrc: 3/0,1 mode: --/PW res: [0x2b27e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.365710:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000028589556 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996927168:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.365713:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e9cecf0c/0x3234de053c4c03c lrc: 3/0,1 mode: --/PW res: [0x2b280:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.365719:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394398080 00010000:00010000:1.0:1651529333.365723:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a3924c32/0x3234de053c4486a lrc: 4/0,0 mode: PR/PR res: [0x2b27c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6851 expref: 389 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.365738:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394398208 00010000:00010000:1.0:1651529333.365741:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000084459261/0x3234de053c44656 lrc: 4/0,0 mode: PR/PR res: [0x2b27e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6047 expref: 390 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.365745:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394398336 00010000:00010000:1.0:1651529333.365747:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000034eb7dbd/0x3234de053c46638 lrc: 4/0,0 mode: PR/PR res: [0x2b280:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae0d9 expref: 391 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.365751:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394398016 00010000:00010000:1.0:1651529333.365753:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c44951 lrc: 4/0,0 mode: PR/PR res: [0x2b27d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6c48 expref: 392 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.365757:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394398144 00010000:00010000:1.0:1651529333.365759:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000969476e2/0x3234de053c45885 lrc: 4/0,0 mode: PR/PR res: [0x2b27f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa926 expref: 393 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.365763:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394398272 00010000:00010000:1.0:1651529333.365765:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006857dace/0x3234de053c43f10 lrc: 5/0,0 mode: PR/PR res: [0x2b281:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4168 expref: 394 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.365769:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11098 00000100:00100000:1.0:1651529333.365771:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050ef6a3e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+394:41278:x1731746394398080:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.365774:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.365775:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a3924c32/0x3234de053c4486a lrc: 4/0,0 mode: PR/PR res: [0x2b27c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6851 expref: 394 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.365778:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a3924c32/0x3234de053c4486a lrc: 3/0,0 mode: PR/PR res: [0x2b27c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6851 expref: 394 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.365784:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3924c32/0x3234de053c4486a lrc: 0/0,0 mode: --/PR res: [0x2b27c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6851 expref: 394 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.365788:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.365788:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.365789:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c4c020 lrc: 3/0,1 mode: PW/PW res: [0x2b27c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.365792:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c4c020 lrc: 4/0,1 mode: PW/PW res: [0x2b27c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.365800:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.365807:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050ef6a3e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+393:41278:x1731746394398080:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.365809:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11098 00000100:00100000:1.0:1651529333.365818:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11100 00000100:00100000:1.0:1651529333.365820:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+391:41278:x1731746394398336:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.365822:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.365831:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000034eb7dbd/0x3234de053c46638 lrc: 4/0,0 mode: PR/PR res: [0x2b280:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae0d9 expref: 391 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.365835:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000034eb7dbd/0x3234de053c46638 lrc: 3/0,0 mode: PR/PR res: [0x2b280:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae0d9 expref: 391 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.365839:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034eb7dbd/0x3234de053c46638 lrc: 0/0,0 mode: --/PR res: [0x2b280:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae0d9 expref: 390 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.365843:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.365843:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.365844:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9cecf0c/0x3234de053c4c03c lrc: 3/0,1 mode: PW/PW res: [0x2b280:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.365847:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9cecf0c/0x3234de053c4c03c lrc: 4/0,1 mode: PW/PW res: [0x2b280:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.365853:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.365859:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+388:41278:x1731746394398336:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 38us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.365861:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11100 00000100:00100000:1.0:1651529333.365866:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11102 00000100:00100000:1.0:1651529333.365868:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+387:41278:x1731746394398144:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529333.365870:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.365871:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000969476e2/0x3234de053c45885 lrc: 4/0,0 mode: PR/PR res: [0x2b27f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa926 expref: 387 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.365875:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000969476e2/0x3234de053c45885 lrc: 3/0,0 mode: PR/PR res: [0x2b27f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa926 expref: 387 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.365879:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000969476e2/0x3234de053c45885 lrc: 0/0,0 mode: --/PR res: [0x2b27f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa926 expref: 386 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.365883:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.365883:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.365884:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4c027 lrc: 3/0,1 mode: PW/PW res: [0x2b27f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.365887:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4c027 lrc: 4/0,1 mode: PW/PW res: [0x2b27f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.365896:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.365902:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+385:41278:x1731746394398144:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.365904:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11102 00010000:00010000:1.0:1651529333.365912:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e9cecf0c/0x3234de053c4c03c lrc: 3/0,1 mode: PW/PW res: [0x2b280:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.365915:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9cecf0c/0x3234de053c4c03c lrc: 3/0,1 mode: PW/PW res: [0x2b280:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.365918:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9cecf0c/0x3234de053c4c03c lrc: 3/0,1 mode: PW/PW res: [0x2b280:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.365921:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9cecf0c/0x3234de053c4c03c lrc: 2/0,0 mode: PW/PW res: [0x2b280:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.365963:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1023:39030:x1731745946286400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 949us (1082us total) trans 12885078371 rc 0/0 00000100:00100000:1.0:1651529333.365966:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208460 00010000:00010000:1.0:1651529333.365973:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c4c02e lrc: 3/0,1 mode: PW/PW res: [0x2b27e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.365976:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c4c02e lrc: 3/0,1 mode: PW/PW res: [0x2b27e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.365979:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c4c02e lrc: 3/0,1 mode: PW/PW res: [0x2b27e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.365982:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c4c02e lrc: 2/0,0 mode: PW/PW res: [0x2b27e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.366014:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1022:39030:x1731745946286272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1043us (1149us total) trans 12885078373 rc 0/0 00000100:00100000:1.0:1651529333.366018:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208458 00010000:00010000:1.0:1651529333.366025:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c4c02e lrc: 2/0,0 mode: PW/PW res: [0x2b27e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.366028:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d1b07eb5 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.366030:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c4c02e lrc: 2/0,0 mode: PW/PW res: [0x2b27e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.366033:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c4c02e lrc: 3/0,0 mode: PW/PW res: [0x2b27e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.366037:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c4c02e lrc: 1/0,0 mode: --/PW res: [0x2b27e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.366040:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c4c02e lrc: 0/0,0 mode: --/PW res: [0x2b27e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.366046:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c4c020 lrc: 3/0,1 mode: PW/PW res: [0x2b27c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.366049:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c4c020 lrc: 3/0,1 mode: PW/PW res: [0x2b27c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.366051:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c4c020 lrc: 3/0,1 mode: PW/PW res: [0x2b27c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.366054:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c4c020 lrc: 2/0,0 mode: PW/PW res: [0x2b27c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.366094:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1022:39030:x1731745946286144:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1181us (1247us total) trans 12885078375 rc 0/0 00000100:00100000:1.0:1651529333.366097:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208456 00000100:00100000:1.0:1651529333.366338:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.366349:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.366370:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.366379:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.366395:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.366421:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.366437:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946286976 00000100:00100000:1.0:1651529333.366443:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208463 00000100:00100000:1.0:1651529333.366445:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1026:39030:x1731745946286656:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.366463:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176772 count 1 00010000:00010000:1.0:1651529333.366468:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c4c051 lrc: 3/0,1 mode: --/PW res: [0x2b284:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.366473:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001d4e57f9/0x3234de053c46233 lrc: 2/0,0 mode: PR/PR res: [0x2b284:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acfc2 expref: 382 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.366476:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.366477:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.366477:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c4c051 lrc: 4/0,1 mode: --/PW res: [0x2b284:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.366484:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001d4e57f9/0x3234de053c46233 lrc: 3/0,0 mode: PR/PR res: [0x2b284:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acfc2 expref: 382 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.366490:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001d4e57f9/0x3234de053c46233 lrc: 4/0,0 mode: PR/PR res: [0x2b284:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acfc2 expref: 382 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.366494:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000913beefe pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996927360:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.366503:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000057299e7f going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.366509:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208465 00000100:00100000:1.0:1651529333.366511:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1027:39029:x1731745946286784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.366516:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176774 count 1 00010000:00010000:1.0:1651529333.366519:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092b30684/0x3234de053c4c05f lrc: 3/0,1 mode: --/PW res: [0x2b286:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.366523:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000641d90a7/0x3234de053c45655 lrc: 2/0,0 mode: PR/PR res: [0x2b286:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9e9f expref: 382 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.366526:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.366527:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.366527:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092b30684/0x3234de053c4c05f lrc: 4/0,1 mode: --/PW res: [0x2b286:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.366533:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000641d90a7/0x3234de053c45655 lrc: 3/0,0 mode: PR/PR res: [0x2b286:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9e9f expref: 382 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.366537:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000641d90a7/0x3234de053c45655 lrc: 4/0,0 mode: PR/PR res: [0x2b286:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9e9f expref: 382 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.366544:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005384a251 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996927488:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.366550:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cfa1ca05 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.366556:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208467 00000100:00100000:1.0:1651529333.366557:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1027:39029:x1731745946286976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.366561:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176777 count 1 00010000:00010000:1.0:1651529333.366564:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4c06d lrc: 3/0,1 mode: --/PW res: [0x2b289:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.366568:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003ced498b/0x3234de053c43e30 lrc: 2/0,0 mode: PR/PR res: [0x2b289:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3ea5 expref: 382 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.366572:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.366572:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.366573:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4c06d lrc: 4/0,1 mode: --/PW res: [0x2b289:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.366578:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003ced498b/0x3234de053c43e30 lrc: 3/0,0 mode: PR/PR res: [0x2b289:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3ea5 expref: 382 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.366582:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003ced498b/0x3234de053c43e30 lrc: 4/0,0 mode: PR/PR res: [0x2b289:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3ea5 expref: 382 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.366586:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000075e1000f pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996927616:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.366592:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000412e5d26 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.366604:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.366624:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.366637:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.366739:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11105 00000100:00100000:1.0:1651529333.366742:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cd5e5a1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+385:41279:x1731746394398656:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529333.366745:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.366747:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002620a844/0x3234de053c444c0 lrc: 4/0,0 mode: PR/PR res: [0x2b282:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5986 expref: 385 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.366752:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002620a844/0x3234de053c444c0 lrc: 3/0,0 mode: PR/PR res: [0x2b282:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5986 expref: 385 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.366758:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002620a844/0x3234de053c444c0 lrc: 0/0,0 mode: --/PR res: [0x2b282:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5986 expref: 385 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.366762:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.366763:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.366763:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000095fca58f/0x3234de053c4c04a lrc: 3/0,1 mode: PW/PW res: [0x2b282:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.366766:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095fca58f/0x3234de053c4c04a lrc: 4/0,1 mode: PW/PW res: [0x2b282:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.366780:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.366788:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cd5e5a1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+383:41279:x1731746394398656:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 46us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.366791:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11105 00010000:00010000:1.0:1651529333.366912:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007398cbbc/0x3234de053c4c043 lrc: 2/0,0 mode: PW/PW res: [0x2b283:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.366919:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007398cbbc already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.366920:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007398cbbc/0x3234de053c4c043 lrc: 2/0,0 mode: PW/PW res: [0x2b283:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.366923:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007398cbbc/0x3234de053c4c043 lrc: 3/0,0 mode: PW/PW res: [0x2b283:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.366928:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007398cbbc/0x3234de053c4c043 lrc: 1/0,0 mode: --/PW res: [0x2b283:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.366931:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007398cbbc/0x3234de053c4c043 lrc: 0/0,0 mode: --/PW res: [0x2b283:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.367053:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.367116:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.367169:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.367176:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.367205:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.367213:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.367242:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.367271:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000913beefe pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996927360:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.367276:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c4c051 lrc: 3/0,1 mode: --/PW res: [0x2b284:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.367284:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005384a251 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996927488:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.367287:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000092b30684/0x3234de053c4c05f lrc: 3/0,1 mode: --/PW res: [0x2b286:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.367294:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000075e1000f pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996927616:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.367296:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4c06d lrc: 3/0,1 mode: --/PW res: [0x2b289:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.367302:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394398848 00010000:00010000:1.0:1651529333.367307:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001d4e57f9/0x3234de053c46233 lrc: 4/0,0 mode: PR/PR res: [0x2b284:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acfc2 expref: 383 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.367312:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394399104 00010000:00010000:1.0:1651529333.367314:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003ced498b/0x3234de053c43e30 lrc: 4/0,0 mode: PR/PR res: [0x2b289:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3ea5 expref: 384 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.367319:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394399040 00010000:00010000:1.0:1651529333.367321:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000641d90a7/0x3234de053c45655 lrc: 4/0,0 mode: PR/PR res: [0x2b286:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9e9f expref: 386 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.367326:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11107 00000100:00100000:1.0:1651529333.367328:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+386:41278:x1731746394398976:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.367331:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.367332:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004268e3c4/0x3234de053c44aa1 lrc: 4/0,0 mode: PR/PR res: [0x2b287:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a71d5 expref: 386 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.367336:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004268e3c4/0x3234de053c44aa1 lrc: 3/0,0 mode: PR/PR res: [0x2b287:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a71d5 expref: 386 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.367342:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004268e3c4/0x3234de053c44aa1 lrc: 0/0,0 mode: --/PR res: [0x2b287:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a71d5 expref: 385 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.367346:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.367346:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.367347:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008a05bebd/0x3234de053c4c066 lrc: 3/0,1 mode: PW/PW res: [0x2b287:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.367350:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a05bebd/0x3234de053c4c066 lrc: 4/0,1 mode: PW/PW res: [0x2b287:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.367361:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.367368:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+384:41278:x1731746394398976:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.367371:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11107 00000100:00100000:1.0:1651529333.367376:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11108 00000100:00100000:1.0:1651529333.367384:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+383:41278:x1731746394399104:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.367387:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.367388:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003ced498b/0x3234de053c43e30 lrc: 4/0,0 mode: PR/PR res: [0x2b289:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3ea5 expref: 383 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.367392:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003ced498b/0x3234de053c43e30 lrc: 3/0,0 mode: PR/PR res: [0x2b289:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3ea5 expref: 383 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.367397:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ced498b/0x3234de053c43e30 lrc: 0/0,0 mode: --/PR res: [0x2b289:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3ea5 expref: 382 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.367403:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.367403:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.367404:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4c06d lrc: 3/0,1 mode: PW/PW res: [0x2b289:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.367407:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4c06d lrc: 4/0,1 mode: PW/PW res: [0x2b289:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.367413:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.367418:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+380:41278:x1731746394399104:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 34us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.367421:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11108 00000100:00100000:1.0:1651529333.367425:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11110 00000100:00100000:1.0:1651529333.367427:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+379:41278:x1731746394399040:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529333.367429:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.367430:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000641d90a7/0x3234de053c45655 lrc: 4/0,0 mode: PR/PR res: [0x2b286:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9e9f expref: 379 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.367434:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000641d90a7/0x3234de053c45655 lrc: 3/0,0 mode: PR/PR res: [0x2b286:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9e9f expref: 379 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.367438:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000641d90a7/0x3234de053c45655 lrc: 0/0,0 mode: --/PR res: [0x2b286:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9e9f expref: 378 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.367442:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.367442:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.367443:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000092b30684/0x3234de053c4c05f lrc: 3/0,1 mode: PW/PW res: [0x2b286:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.367446:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092b30684/0x3234de053c4c05f lrc: 4/0,1 mode: PW/PW res: [0x2b286:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.367451:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.367456:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+377:41278:x1731746394399040:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 29us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.367458:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11110 00010000:00010000:1.0:1651529333.367465:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4c06d lrc: 3/0,1 mode: PW/PW res: [0x2b289:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.367468:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4c06d lrc: 3/0,1 mode: PW/PW res: [0x2b289:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.367471:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4c06d lrc: 3/0,1 mode: PW/PW res: [0x2b289:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.367474:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4c06d lrc: 2/0,0 mode: PW/PW res: [0x2b289:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.367518:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1030:39029:x1731745946286976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 960us (1097us total) trans 12885078380 rc 0/0 00000100:00100000:1.0:1651529333.367521:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208467 00010000:00010000:1.0:1651529333.367528:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000092b30684/0x3234de053c4c05f lrc: 3/0,1 mode: PW/PW res: [0x2b286:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.367534:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092b30684/0x3234de053c4c05f lrc: 3/0,1 mode: PW/PW res: [0x2b286:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.367537:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092b30684/0x3234de053c4c05f lrc: 3/0,1 mode: PW/PW res: [0x2b286:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.367540:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092b30684/0x3234de053c4c05f lrc: 2/0,0 mode: PW/PW res: [0x2b286:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.367570:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1030:39029:x1731745946286784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1059us (1205us total) trans 12885078381 rc 0/0 00000100:00100000:1.0:1651529333.367573:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208465 00010000:00010000:1.0:1651529333.367580:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006247fb8a/0x3234de053c4c058 lrc: 2/0,0 mode: PW/PW res: [0x2b285:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.367583:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006247fb8a already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.367584:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006247fb8a/0x3234de053c4c058 lrc: 2/0,0 mode: PW/PW res: [0x2b285:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.367587:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006247fb8a/0x3234de053c4c058 lrc: 3/0,0 mode: PW/PW res: [0x2b285:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.367591:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006247fb8a/0x3234de053c4c058 lrc: 1/0,0 mode: --/PW res: [0x2b285:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.367594:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006247fb8a/0x3234de053c4c058 lrc: 0/0,0 mode: --/PW res: [0x2b285:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.367600:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c4c051 lrc: 3/0,1 mode: PW/PW res: [0x2b284:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.367603:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c4c051 lrc: 3/0,1 mode: PW/PW res: [0x2b284:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.367606:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c4c051 lrc: 3/0,1 mode: PW/PW res: [0x2b284:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.367608:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c4c051 lrc: 2/0,0 mode: PW/PW res: [0x2b284:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.367647:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1030:39030:x1731745946286656:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1201us (1309us total) trans 12885078383 rc 0/0 00000100:00100000:1.0:1651529333.367649:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208463 00000100:00100000:1.0:1651529333.367665:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.367796:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394399168 00010000:00010000:1.0:1651529333.367802:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002ba484f8/0x3234de053c45fa8 lrc: 4/0,0 mode: PR/PR res: [0x2b288:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac526 expref: 377 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.367809:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11111 00000100:00100000:1.0:1651529333.367811:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+377:41278:x1731746394399168:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529333.367813:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.367815:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002ba484f8/0x3234de053c45fa8 lrc: 4/0,0 mode: PR/PR res: [0x2b288:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac526 expref: 377 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.367821:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002ba484f8/0x3234de053c45fa8 lrc: 3/0,0 mode: PR/PR res: [0x2b288:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac526 expref: 377 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.367827:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ba484f8/0x3234de053c45fa8 lrc: 0/0,0 mode: --/PR res: [0x2b288:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac526 expref: 377 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.367830:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.367831:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.367831:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d95da09e/0x3234de053c4c074 lrc: 3/0,1 mode: PW/PW res: [0x2b288:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.367835:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d95da09e/0x3234de053c4c074 lrc: 4/0,1 mode: PW/PW res: [0x2b288:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.367844:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.367853:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+376:41278:x1731746394399168:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.367856:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11111 00010000:00010000:1.0:1651529333.367892:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d95da09e/0x3234de053c4c074 lrc: 2/0,0 mode: PW/PW res: [0x2b288:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.367896:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d95da09e already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.367898:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d95da09e/0x3234de053c4c074 lrc: 2/0,0 mode: PW/PW res: [0x2b288:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.367906:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d95da09e/0x3234de053c4c074 lrc: 3/0,0 mode: PW/PW res: [0x2b288:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.367911:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d95da09e/0x3234de053c4c074 lrc: 1/0,0 mode: --/PW res: [0x2b288:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.367914:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d95da09e/0x3234de053c4c074 lrc: 0/0,0 mode: --/PW res: [0x2b288:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.367958:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.368025:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.368031:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.368041:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.368049:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.368055:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946287232 00000100:00100000:1.0:1651529333.368064:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946287360 00000100:00100000:1.0:1651529333.368069:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946287296 00000100:00100000:1.0:1651529333.368072:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946287424 00000100:00100000:1.0:1651529333.368082:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208473 00000100:00100000:1.0:1651529333.368084:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1034:39029:x1731745946287232:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.368090:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176781 count 1 00010000:00010000:1.0:1651529333.368094:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4c097 lrc: 3/0,1 mode: --/PW res: [0x2b28d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.368114:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000892be50b/0x3234de053c4403d lrc: 2/0,0 mode: PR/PR res: [0x2b28d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4670 expref: 375 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.368117:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.368118:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.368118:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4c097 lrc: 4/0,1 mode: --/PW res: [0x2b28d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.368126:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000892be50b/0x3234de053c4403d lrc: 3/0,0 mode: PR/PR res: [0x2b28d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4670 expref: 375 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.368130:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000892be50b/0x3234de053c4403d lrc: 4/0,0 mode: PR/PR res: [0x2b28d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4670 expref: 375 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.368134:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003562cf4d pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996927936:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.368143:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000099c1da85 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.368150:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208475 00000100:00100000:1.0:1651529333.368151:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1034:39029:x1731745946287296:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.368156:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176782 count 1 00010000:00010000:1.0:1651529333.368160:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4c0a5 lrc: 3/0,1 mode: --/PW res: [0x2b28e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.368164:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c01403d2/0x3234de053c44d95 lrc: 2/0,0 mode: PR/PR res: [0x2b28e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7cd3 expref: 375 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.368167:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.368168:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.368168:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4c0a5 lrc: 4/0,1 mode: --/PW res: [0x2b28e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.368174:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c01403d2/0x3234de053c44d95 lrc: 3/0,0 mode: PR/PR res: [0x2b28e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7cd3 expref: 375 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.368177:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c01403d2/0x3234de053c44d95 lrc: 4/0,0 mode: PR/PR res: [0x2b28e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7cd3 expref: 375 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.368182:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006e255cae pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996928064:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.368188:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a4eb401d going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.368202:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.368254:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.368288:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.368323:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394399424 00010000:00010000:1.0:1651529333.368329:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000025c25dc7/0x3234de053c45c2f lrc: 4/0,0 mode: PR/PR res: [0x2b28a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab788 expref: 376 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.368336:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394399488 00010000:00010000:1.0:1651529333.368339:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c45218 lrc: 4/0,0 mode: PR/PR res: [0x2b28b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8dc7 expref: 377 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.368348:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11112 00000100:00100000:1.0:1651529333.368350:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ce633b1f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+377:41278:x1731746394399424:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.368353:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.368355:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000025c25dc7/0x3234de053c45c2f lrc: 4/0,0 mode: PR/PR res: [0x2b28a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab788 expref: 377 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.368358:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000025c25dc7/0x3234de053c45c2f lrc: 3/0,0 mode: PR/PR res: [0x2b28a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab788 expref: 377 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.368364:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025c25dc7/0x3234de053c45c2f lrc: 0/0,0 mode: --/PR res: [0x2b28a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab788 expref: 377 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.368370:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.368371:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.368372:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008c45287a/0x3234de053c4c082 lrc: 3/0,1 mode: PW/PW res: [0x2b28a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.368375:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c45287a/0x3234de053c4c082 lrc: 4/0,1 mode: PW/PW res: [0x2b28a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.368383:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.368392:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ce633b1f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+376:41278:x1731746394399424:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.368395:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11112 00000100:00100000:1.0:1651529333.368682:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.368741:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.368750:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.368756:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.368762:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.368840:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.368855:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003562cf4d pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996927936:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.368860:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4c097 lrc: 3/0,1 mode: --/PW res: [0x2b28d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.368867:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006e255cae pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996928064:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.368869:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4c0a5 lrc: 3/0,1 mode: --/PW res: [0x2b28e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.368879:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11115 00000100:00100000:1.0:1651529333.368881:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+377:41278:x1731746394399872:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529333.368884:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.368886:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002cc20fe9/0x3234de053c44f01 lrc: 4/0,0 mode: PR/PR res: [0x2b28f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a818e expref: 377 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.368889:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002cc20fe9/0x3234de053c44f01 lrc: 3/0,0 mode: PR/PR res: [0x2b28f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a818e expref: 377 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.368895:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cc20fe9/0x3234de053c44f01 lrc: 0/0,0 mode: --/PR res: [0x2b28f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a818e expref: 376 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.368899:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.368900:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.368901:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cc20db45/0x3234de053c4c09e lrc: 3/0,1 mode: PW/PW res: [0x2b28f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.368904:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc20db45/0x3234de053c4c09e lrc: 4/0,1 mode: PW/PW res: [0x2b28f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.368919:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.368931:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+375:41278:x1731746394399872:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 49us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.368933:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11115 00000100:00100000:1.0:1651529333.368939:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11117 00000100:00100000:1.0:1651529333.368941:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+373:41278:x1731746394399936:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.368944:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.368945:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c01403d2/0x3234de053c44d95 lrc: 4/0,0 mode: PR/PR res: [0x2b28e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7cd3 expref: 373 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.368949:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c01403d2/0x3234de053c44d95 lrc: 3/0,0 mode: PR/PR res: [0x2b28e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7cd3 expref: 373 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.368954:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c01403d2/0x3234de053c44d95 lrc: 0/0,0 mode: --/PR res: [0x2b28e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7cd3 expref: 373 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.368957:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.368957:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.368958:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4c0a5 lrc: 3/0,1 mode: PW/PW res: [0x2b28e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.368961:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4c0a5 lrc: 4/0,1 mode: PW/PW res: [0x2b28e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.368967:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.368972:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+372:41278:x1731746394399936:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 31us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.368984:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11117 00010000:00010000:1.0:1651529333.368991:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4c0a5 lrc: 3/0,1 mode: PW/PW res: [0x2b28e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.368995:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4c0a5 lrc: 3/0,1 mode: PW/PW res: [0x2b28e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.369007:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4c0a5 lrc: 3/0,1 mode: PW/PW res: [0x2b28e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.369010:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4c0a5 lrc: 2/0,0 mode: PW/PW res: [0x2b28e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.369051:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1038:39029:x1731745946287296:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 898us (1009us total) trans 12885078387 rc 0/0 00000100:00100000:1.0:1651529333.369053:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208475 00010000:00010000:1.0:1651529333.369061:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4c0a5 lrc: 2/0,0 mode: PW/PW res: [0x2b28e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.369064:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db11c60d already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.369065:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4c0a5 lrc: 2/0,0 mode: PW/PW res: [0x2b28e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.369068:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4c0a5 lrc: 3/0,0 mode: PW/PW res: [0x2b28e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.369073:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4c0a5 lrc: 1/0,0 mode: --/PW res: [0x2b28e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.369076:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4c0a5 lrc: 0/0,0 mode: --/PW res: [0x2b28e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.369081:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc20db45/0x3234de053c4c09e lrc: 2/0,0 mode: PW/PW res: [0x2b28f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.369084:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cc20db45 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.369085:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc20db45/0x3234de053c4c09e lrc: 2/0,0 mode: PW/PW res: [0x2b28f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.369088:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc20db45/0x3234de053c4c09e lrc: 3/0,0 mode: PW/PW res: [0x2b28f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.369091:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc20db45/0x3234de053c4c09e lrc: 1/0,0 mode: --/PW res: [0x2b28f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.369094:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc20db45/0x3234de053c4c09e lrc: 0/0,0 mode: --/PW res: [0x2b28f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.369099:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4c097 lrc: 3/0,1 mode: PW/PW res: [0x2b28d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.369101:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4c097 lrc: 3/0,1 mode: PW/PW res: [0x2b28d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.369104:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4c097 lrc: 3/0,1 mode: PW/PW res: [0x2b28d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.369107:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4c097 lrc: 2/0,0 mode: PW/PW res: [0x2b28d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.369155:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1038:39029:x1731745946287232:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1064us (1124us total) trans 12885078389 rc 0/0 00000100:00100000:1.0:1651529333.369159:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208473 00010000:00010000:1.0:1651529333.369165:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4c097 lrc: 2/0,0 mode: PW/PW res: [0x2b28d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.369168:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000039e8f661 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.369169:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4c097 lrc: 2/0,0 mode: PW/PW res: [0x2b28d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.369172:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4c097 lrc: 3/0,0 mode: PW/PW res: [0x2b28d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.369177:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4c097 lrc: 1/0,0 mode: --/PW res: [0x2b28d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.369179:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4c097 lrc: 0/0,0 mode: --/PW res: [0x2b28d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.369184:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4c090 lrc: 2/0,0 mode: PW/PW res: [0x2b28c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.369186:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000041e6f70f already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.369187:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4c090 lrc: 2/0,0 mode: PW/PW res: [0x2b28c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.369190:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4c090 lrc: 3/0,0 mode: PW/PW res: [0x2b28c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.369196:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4c090 lrc: 1/0,0 mode: --/PW res: [0x2b28c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.369198:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4c090 lrc: 0/0,0 mode: --/PW res: [0x2b28c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.369264:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.369277:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.369287:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.369371:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394400000 00010000:00010000:1.0:1651529333.369381:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006135f1f6/0x3234de053c4603b lrc: 4/0,0 mode: PR/PR res: [0x2b290:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac772 expref: 372 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.369389:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394400064 00010000:00010000:1.0:1651529333.369391:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008e578053/0x3234de053c459b9 lrc: 4/0,0 mode: PR/PR res: [0x2b291:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aae2e expref: 373 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.369408:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11118 00000100:00100000:1.0:1651529333.369409:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+372:41279:x1731746394400000:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.369413:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.369414:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006135f1f6/0x3234de053c4603b lrc: 4/0,0 mode: PR/PR res: [0x2b290:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac772 expref: 372 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.369418:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006135f1f6/0x3234de053c4603b lrc: 3/0,0 mode: PR/PR res: [0x2b290:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac772 expref: 372 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.369426:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006135f1f6/0x3234de053c4603b lrc: 0/0,0 mode: --/PR res: [0x2b290:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac772 expref: 372 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.369430:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.369431:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.369432:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4c0ac lrc: 3/0,1 mode: PW/PW res: [0x2b290:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.369435:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4c0ac lrc: 4/0,1 mode: PW/PW res: [0x2b290:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.369443:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.369450:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+371:41279:x1731746394400000:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 40us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.369453:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11118 00000100:00100000:1.0:1651529333.369470:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.369556:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.369563:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.369594:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.369625:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.369632:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946287744 00000100:00100000:1.0:1651529333.369638:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946287872 00000100:00100000:1.0:1651529333.369641:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946287680 00000100:00100000:1.0:1651529333.369649:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946287808 00000100:00100000:1.0:1651529333.369653:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208481 00000100:00100000:1.0:1651529333.369654:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1042:39029:x1731745946287744:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.369665:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176789 count 1 00010000:00010000:1.0:1651529333.369670:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4c0cf lrc: 3/0,1 mode: --/PW res: [0x2b295:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.369675:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000092235c1b/0x3234de053c442f2 lrc: 2/0,0 mode: PR/PR res: [0x2b295:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5201 expref: 367 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.369678:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.369678:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.369679:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4c0cf lrc: 4/0,1 mode: --/PW res: [0x2b295:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.369686:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000092235c1b/0x3234de053c442f2 lrc: 3/0,0 mode: PR/PR res: [0x2b295:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5201 expref: 367 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.369690:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000092235c1b/0x3234de053c442f2 lrc: 4/0,0 mode: PR/PR res: [0x2b295:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5201 expref: 367 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.369694:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000095d7eb1a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996928384:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.369703:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a6b79b05 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.369710:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208483 00000100:00100000:1.0:1651529333.369711:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1041:39030:x1731745946287680:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.369716:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176788 count 1 00010000:00010000:1.0:1651529333.369719:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4c0dd lrc: 3/0,1 mode: --/PW res: [0x2b294:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.369723:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f192428c/0x3234de053c456a9 lrc: 2/0,0 mode: PR/PR res: [0x2b294:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9fe1 expref: 367 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.369738:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.369739:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.369740:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4c0dd lrc: 4/0,1 mode: --/PW res: [0x2b294:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.369747:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f192428c/0x3234de053c456a9 lrc: 3/0,0 mode: PR/PR res: [0x2b294:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9fe1 expref: 367 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.369750:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f192428c/0x3234de053c456a9 lrc: 4/0,0 mode: PR/PR res: [0x2b294:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9fe1 expref: 367 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.369754:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000999005e pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996928512:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.369762:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 0000000020dd7827 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.369769:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208484 00000100:00100000:1.0:1651529333.369770:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1041:39030:x1731745946287808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.369775:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176790 count 1 00010000:00010000:1.0:1651529333.369778:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4c0e4 lrc: 3/0,1 mode: --/PW res: [0x2b296:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.369782:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e19889c9/0x3234de053c43c3f lrc: 2/0,0 mode: PR/PR res: [0x2b296:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a367f expref: 367 pid: 80278 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.369785:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.369786:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.369786:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4c0e4 lrc: 4/0,1 mode: --/PW res: [0x2b296:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.369795:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e19889c9/0x3234de053c43c3f lrc: 3/0,0 mode: PR/PR res: [0x2b296:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a367f expref: 367 pid: 80278 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.369798:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e19889c9/0x3234de053c43c3f lrc: 4/0,0 mode: PR/PR res: [0x2b296:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a367f expref: 367 pid: 80278 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.369802:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ba0b61e6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996928576:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.369808:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c3caa148 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.369863:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.369936:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11121 00000100:00100000:1.0:1651529333.369939:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+368:41279:x1731746394400384:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.369942:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.369944:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000170fa924/0x3234de053c467b2 lrc: 4/0,0 mode: PR/PR res: [0x2b293:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae6d6 expref: 368 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.369948:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000170fa924/0x3234de053c467b2 lrc: 3/0,0 mode: PR/PR res: [0x2b293:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae6d6 expref: 368 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.369954:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000170fa924/0x3234de053c467b2 lrc: 0/0,0 mode: --/PR res: [0x2b293:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae6d6 expref: 368 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.369958:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.369958:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.369959:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007a25596b/0x3234de053c4c0c1 lrc: 3/0,1 mode: PW/PW res: [0x2b293:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.369970:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a25596b/0x3234de053c4c0c1 lrc: 4/0,1 mode: PW/PW res: [0x2b293:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.369980:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.369989:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+367:41279:x1731746394400384:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 50us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.369991:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11121 00010000:00010000:1.0:1651529333.369999:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4c0ba lrc: 2/0,0 mode: PW/PW res: [0x2b292:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.370002:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007d2a92bc already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.370003:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4c0ba lrc: 2/0,0 mode: PW/PW res: [0x2b292:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.370006:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4c0ba lrc: 3/0,0 mode: PW/PW res: [0x2b292:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.370016:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4c0ba lrc: 1/0,0 mode: --/PW res: [0x2b292:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.370018:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4c0ba lrc: 0/0,0 mode: --/PW res: [0x2b292:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.370076:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.370109:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.370221:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.370244:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.370254:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.370264:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000095d7eb1a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996928384:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.370268:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4c0cf lrc: 3/0,1 mode: --/PW res: [0x2b295:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.370276:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000999005e pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996928512:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.370278:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4c0dd lrc: 3/0,1 mode: --/PW res: [0x2b294:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.370292:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394400640 00010000:00010000:1.0:1651529333.370297:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000092235c1b/0x3234de053c442f2 lrc: 4/0,0 mode: PR/PR res: [0x2b295:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5201 expref: 367 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.370303:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394400768 00010000:00010000:1.0:1651529333.370305:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000019f696fe/0x3234de053c439e5 lrc: 5/0,0 mode: PR/PR res: [0x2b297:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2d25 expref: 368 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.370309:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394400704 00010000:00010000:1.0:1651529333.370311:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f192428c/0x3234de053c456a9 lrc: 4/0,0 mode: PR/PR res: [0x2b294:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9fe1 expref: 369 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.370316:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11122 00000100:00100000:1.0:1651529333.370317:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+369:41278:x1731746394400640:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.370320:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.370321:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000092235c1b/0x3234de053c442f2 lrc: 4/0,0 mode: PR/PR res: [0x2b295:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5201 expref: 369 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.370325:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000092235c1b/0x3234de053c442f2 lrc: 3/0,0 mode: PR/PR res: [0x2b295:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5201 expref: 369 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.370331:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092235c1b/0x3234de053c442f2 lrc: 0/0,0 mode: --/PR res: [0x2b295:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5201 expref: 369 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.370343:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.370343:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.370344:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4c0cf lrc: 3/0,1 mode: PW/PW res: [0x2b295:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.370347:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4c0cf lrc: 4/0,1 mode: PW/PW res: [0x2b295:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.370354:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.370361:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+368:41278:x1731746394400640:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 43us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.370363:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11122 00000100:00100000:1.0:1651529333.370368:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11124 00000100:00100000:1.0:1651529333.370370:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+367:41278:x1731746394400704:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.370372:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.370374:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f192428c/0x3234de053c456a9 lrc: 4/0,0 mode: PR/PR res: [0x2b294:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9fe1 expref: 367 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.370378:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f192428c/0x3234de053c456a9 lrc: 3/0,0 mode: PR/PR res: [0x2b294:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9fe1 expref: 367 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.370383:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f192428c/0x3234de053c456a9 lrc: 0/0,0 mode: --/PR res: [0x2b294:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9fe1 expref: 367 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.370386:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.370387:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.370387:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4c0dd lrc: 3/0,1 mode: PW/PW res: [0x2b294:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.370390:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4c0dd lrc: 4/0,1 mode: PW/PW res: [0x2b294:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.370395:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.370399:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+365:41278:x1731746394400704:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 29us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.370402:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11124 00010000:00010000:1.0:1651529333.370407:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4c0dd lrc: 3/0,1 mode: PW/PW res: [0x2b294:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.370410:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4c0dd lrc: 3/0,1 mode: PW/PW res: [0x2b294:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.370413:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4c0dd lrc: 3/0,1 mode: PW/PW res: [0x2b294:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.370416:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4c0dd lrc: 2/0,0 mode: PW/PW res: [0x2b294:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.370469:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1045:39030:x1731745946287680:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 757us (886us total) trans 12885078395 rc 0/0 00000100:00100000:1.0:1651529333.370473:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208483 00010000:00010000:1.0:1651529333.370480:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4c0dd lrc: 2/0,0 mode: PW/PW res: [0x2b294:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.370483:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b0e4295a already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.370484:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4c0dd lrc: 2/0,0 mode: PW/PW res: [0x2b294:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.370487:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4c0dd lrc: 3/0,0 mode: PW/PW res: [0x2b294:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.370492:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4c0dd lrc: 1/0,0 mode: --/PW res: [0x2b294:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.370494:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4c0dd lrc: 0/0,0 mode: --/PW res: [0x2b294:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.370500:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4c0cf lrc: 3/0,1 mode: PW/PW res: [0x2b295:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.370503:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4c0cf lrc: 3/0,1 mode: PW/PW res: [0x2b295:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.370506:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4c0cf lrc: 3/0,1 mode: PW/PW res: [0x2b295:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.370509:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4c0cf lrc: 2/0,0 mode: PW/PW res: [0x2b295:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.370550:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1044:39029:x1731745946287744:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 895us (994us total) trans 12885078397 rc 0/0 00000100:00100000:1.0:1651529333.370553:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208481 00000100:00100000:1.0:1651529333.370581:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.370591:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.370600:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.370658:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.370694:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.370707:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ba0b61e6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996928576:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.370711:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4c0e4 lrc: 3/0,1 mode: --/PW res: [0x2b296:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.370718:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394400832 00010000:00010000:1.0:1651529333.370736:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e19889c9/0x3234de053c43c3f lrc: 4/0,0 mode: PR/PR res: [0x2b296:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a367f expref: 364 pid: 80278 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.370744:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394401088 00010000:00010000:1.0:1651529333.370747:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c44b18 lrc: 5/0,0 mode: PR/PR res: [0x2b299:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a738e expref: 366 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.370753:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11125 00000100:00100000:1.0:1651529333.370755:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+366:41278:x1731746394400832:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.370759:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.370760:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e19889c9/0x3234de053c43c3f lrc: 4/0,0 mode: PR/PR res: [0x2b296:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a367f expref: 366 pid: 80278 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.370764:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e19889c9/0x3234de053c43c3f lrc: 3/0,0 mode: PR/PR res: [0x2b296:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a367f expref: 366 pid: 80278 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.370769:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e19889c9/0x3234de053c43c3f lrc: 0/0,0 mode: --/PR res: [0x2b296:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a367f expref: 366 pid: 80278 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.370773:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.370773:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.370774:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4c0e4 lrc: 3/0,1 mode: PW/PW res: [0x2b296:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.370777:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4c0e4 lrc: 4/0,1 mode: PW/PW res: [0x2b296:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.370783:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.370790:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+365:41278:x1731746394400832:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.370793:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11125 00000100:00100000:1.0:1651529333.370797:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11126 00000100:00100000:1.0:1651529333.370799:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000f76b19f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+364:41279:x1731746394401088:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.370801:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.370802:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c44b18 lrc: 5/0,0 mode: PR/PR res: [0x2b299:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a738e expref: 364 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.370809:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c44b18 lrc: 4/0,0 mode: PR/PR res: [0x2b299:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a738e expref: 365 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.370813:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.370814:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.370814:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cc418822/0x3234de053c4c0eb lrc: 3/0,1 mode: PW/PW res: [0x2b299:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.370817:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc418822/0x3234de053c4c0eb lrc: 4/0,1 mode: PW/PW res: [0x2b299:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.370821:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.370827:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000f76b19f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+365:41279:x1731746394401088:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 28us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.370830:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11126 00010000:00010000:1.0:1651529333.370839:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4c0e4 lrc: 3/0,1 mode: PW/PW res: [0x2b296:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.370843:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4c0e4 lrc: 3/0,1 mode: PW/PW res: [0x2b296:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.370846:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4c0e4 lrc: 3/0,1 mode: PW/PW res: [0x2b296:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.370848:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4c0e4 lrc: 2/0,0 mode: PW/PW res: [0x2b296:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.370888:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1046:39030:x1731745946287808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1116us (1263us total) trans 12885078398 rc 0/0 00000100:00100000:1.0:1651529333.370891:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208484 00010000:00010000:1.0:1651529333.370898:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4c0e4 lrc: 2/0,0 mode: PW/PW res: [0x2b296:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.370901:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb5dc195 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.370902:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4c0e4 lrc: 2/0,0 mode: PW/PW res: [0x2b296:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.370905:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4c0e4 lrc: 3/0,0 mode: PW/PW res: [0x2b296:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.370910:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4c0e4 lrc: 1/0,0 mode: --/PW res: [0x2b296:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.370912:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4c0e4 lrc: 0/0,0 mode: --/PW res: [0x2b296:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.370917:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc418822/0x3234de053c4c0eb lrc: 3/0,0 mode: PW/PW res: [0x2b299:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.370919:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cc418822 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.370920:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc418822/0x3234de053c4c0eb lrc: 2/0,0 mode: PW/PW res: [0x2b299:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.370925:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc418822/0x3234de053c4c0eb lrc: 3/0,0 mode: PW/PW res: [0x2b299:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.370929:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc418822/0x3234de053c4c0eb lrc: 1/0,0 mode: --/PW res: [0x2b299:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.370931:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc418822/0x3234de053c4c0eb lrc: 0/0,0 mode: --/PW res: [0x2b299:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.370967:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.370996:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.371016:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.371052:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.371218:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11127 00000100:00100000:1.0:1651529333.371241:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+363:41279:x1731746394401152:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529333.371245:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.371247:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002f1e9710/0x3234de053c44a3f lrc: 4/0,0 mode: PR/PR res: [0x2b298:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a705b expref: 363 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.371251:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002f1e9710/0x3234de053c44a3f lrc: 3/0,0 mode: PR/PR res: [0x2b298:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a705b expref: 363 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.371257:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f1e9710/0x3234de053c44a3f lrc: 0/0,0 mode: --/PR res: [0x2b298:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a705b expref: 363 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.371263:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.371263:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.371264:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000915ac1d0/0x3234de053c4c0f2 lrc: 3/0,1 mode: PW/PW res: [0x2b298:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.371267:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000915ac1d0/0x3234de053c4c0f2 lrc: 4/0,1 mode: PW/PW res: [0x2b298:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.371276:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.371285:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+362:41279:x1731746394401152:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 64us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.371288:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11127 00000100:00100000:1.0:1651529333.371303:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.371340:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.371409:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208494 00000100:00100000:1.0:1651529333.371420:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1050:39030:x1731745946288448:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.371430:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176800 count 1 00010000:00010000:1.0:1651529333.371436:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4c12a lrc: 3/0,1 mode: --/PW res: [0x2b2a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.371443:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000035328d21/0x3234de053c469b8 lrc: 2/0,0 mode: PR/PR res: [0x2b2a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aef42 expref: 361 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.371448:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.371449:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.371450:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4c12a lrc: 4/0,1 mode: --/PW res: [0x2b2a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.371463:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000035328d21/0x3234de053c469b8 lrc: 3/0,0 mode: PR/PR res: [0x2b2a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aef42 expref: 361 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.371467:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000035328d21/0x3234de053c469b8 lrc: 4/0,0 mode: PR/PR res: [0x2b2a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aef42 expref: 361 pid: 80277 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.371472:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000076d5f96b pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996929152:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.371481:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e5f43e7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.371566:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.371581:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.371587:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.371595:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.371602:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.371616:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946288512 00000100:00100000:1.0:1651529333.371624:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208495 00000100:00100000:1.0:1651529333.371626:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1051:39029:x1731745946288512:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.371637:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176801 count 1 00010000:00010000:1.0:1651529333.371642:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4c131 lrc: 3/0,1 mode: --/PW res: [0x2b2a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.371646:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c777c4d5/0x3234de053c44ad2 lrc: 2/0,0 mode: PR/PR res: [0x2b2a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7284 expref: 361 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.371650:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.371650:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.371651:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4c131 lrc: 4/0,1 mode: --/PW res: [0x2b2a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.371658:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c777c4d5/0x3234de053c44ad2 lrc: 3/0,0 mode: PR/PR res: [0x2b2a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7284 expref: 362 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.371662:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c777c4d5/0x3234de053c44ad2 lrc: 4/0,0 mode: PR/PR res: [0x2b2a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7284 expref: 362 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.371666:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000095d7eb1a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996929216:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.371674:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c3caa148 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.371681:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11128 00000100:00100000:1.0:1651529333.371683:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+365:41278:x1731746394401408:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.371685:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.371687:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000060910c0/0x3234de053c467ea lrc: 4/0,0 mode: PR/PR res: [0x2b29c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae769 expref: 365 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.371691:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000060910c0/0x3234de053c467ea lrc: 3/0,0 mode: PR/PR res: [0x2b29c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae769 expref: 365 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.371696:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000060910c0/0x3234de053c467ea lrc: 0/0,0 mode: --/PR res: [0x2b29c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae769 expref: 365 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.371700:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.371701:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.371702:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003fd513db/0x3234de053c4c10e lrc: 3/0,1 mode: PW/PW res: [0x2b29c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.371707:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fd513db/0x3234de053c4c10e lrc: 4/0,1 mode: PW/PW res: [0x2b29c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.371718:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.371727:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+363:41278:x1731746394401408:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 44us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.371739:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11128 00000100:00100000:1.0:1651529333.371746:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11131 00000100:00100000:1.0:1651529333.371747:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+361:41278:x1731746394401472:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.371750:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.371752:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009b714b3b/0x3234de053c4485c lrc: 4/0,0 mode: PR/PR res: [0x2b29a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6835 expref: 361 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.371755:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009b714b3b/0x3234de053c4485c lrc: 3/0,0 mode: PR/PR res: [0x2b29a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6835 expref: 361 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.371760:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b714b3b/0x3234de053c4485c lrc: 0/0,0 mode: --/PR res: [0x2b29a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6835 expref: 361 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.371763:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.371764:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.371765:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000776a84f4/0x3234de053c4c100 lrc: 3/0,1 mode: PW/PW res: [0x2b29a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.371768:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000776a84f4/0x3234de053c4c100 lrc: 4/0,1 mode: PW/PW res: [0x2b29a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.371779:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.371784:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+359:41278:x1731746394401472:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 36us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.371787:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11131 00000100:00100000:1.0:1651529333.371803:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529333.371901:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7cb3d9d/0x3234de053c4c11c lrc: 2/0,0 mode: PW/PW res: [0x2b29e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.371905:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f7cb3d9d already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.371906:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7cb3d9d/0x3234de053c4c11c lrc: 2/0,0 mode: PW/PW res: [0x2b29e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.371910:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7cb3d9d/0x3234de053c4c11c lrc: 3/0,0 mode: PW/PW res: [0x2b29e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.371915:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7cb3d9d/0x3234de053c4c11c lrc: 1/0,0 mode: --/PW res: [0x2b29e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.371917:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7cb3d9d/0x3234de053c4c11c lrc: 0/0,0 mode: --/PW res: [0x2b29e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.371934:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000076d5f96b pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996929152:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.371938:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4c12a lrc: 3/0,1 mode: --/PW res: [0x2b2a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.372122:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.372159:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.372169:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.372175:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.372182:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.372193:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946288576 00000100:00100000:1.0:1651529333.372202:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394401856 00000100:00100000:1.0:1651529333.372207:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208497 00000100:00100000:1.0:1651529333.372208:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1053:39030:x1731745946288576:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.372213:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176802 count 1 00010000:00010000:1.0:1651529333.372237:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000656a2f5f/0x3234de053c4c13f lrc: 3/0,1 mode: --/PW res: [0x2b2a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.372242:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b388b573/0x3234de053c467b9 lrc: 2/0,0 mode: PR/PR res: [0x2b2a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae6eb expref: 357 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.372245:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.372246:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.372247:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000656a2f5f/0x3234de053c4c13f lrc: 4/0,1 mode: --/PW res: [0x2b2a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.372254:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b388b573/0x3234de053c467b9 lrc: 3/0,0 mode: PR/PR res: [0x2b2a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae6eb expref: 357 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.372257:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b388b573/0x3234de053c467b9 lrc: 4/0,0 mode: PR/PR res: [0x2b2a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae6eb expref: 357 pid: 80277 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.372261:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004a6776b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996929344:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.372270:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.372276:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394401728 00010000:00010000:1.0:1651529333.372281:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000035328d21/0x3234de053c469b8 lrc: 4/0,0 mode: PR/PR res: [0x2b2a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aef42 expref: 358 pid: 80277 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.372298:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394401664 00010000:00010000:1.0:1651529333.372302:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dd4e3e8c/0x3234de053c46853 lrc: 4/0,0 mode: PR/PR res: [0x2b29f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae8ff expref: 359 pid: 80277 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.372309:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11133 00000100:00100000:1.0:1651529333.372310:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000e855587 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+360:41279:x1731746394401728:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.372313:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.372315:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000035328d21/0x3234de053c469b8 lrc: 4/0,0 mode: PR/PR res: [0x2b2a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aef42 expref: 360 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.372318:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000035328d21/0x3234de053c469b8 lrc: 3/0,0 mode: PR/PR res: [0x2b2a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aef42 expref: 360 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.372324:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035328d21/0x3234de053c469b8 lrc: 0/0,0 mode: --/PR res: [0x2b2a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aef42 expref: 360 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.372327:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.372328:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.372329:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4c12a lrc: 3/0,1 mode: PW/PW res: [0x2b2a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.372332:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4c12a lrc: 4/0,1 mode: PW/PW res: [0x2b2a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.372340:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.372347:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000e855587 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+358:41279:x1731746394401728:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.372349:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11133 00000100:00100000:1.0:1651529333.372357:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11134 00000100:00100000:1.0:1651529333.372366:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+357:41278:x1731746394401664:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.372369:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.372370:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dd4e3e8c/0x3234de053c46853 lrc: 4/0,0 mode: PR/PR res: [0x2b29f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae8ff expref: 357 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.372374:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dd4e3e8c/0x3234de053c46853 lrc: 3/0,0 mode: PR/PR res: [0x2b29f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae8ff expref: 357 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.372379:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd4e3e8c/0x3234de053c46853 lrc: 0/0,0 mode: --/PR res: [0x2b29f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae8ff expref: 357 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.372382:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.372383:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.372384:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002537ce87/0x3234de053c4c123 lrc: 3/0,1 mode: PW/PW res: [0x2b29f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.372387:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002537ce87/0x3234de053c4c123 lrc: 4/0,1 mode: PW/PW res: [0x2b29f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.372396:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.372401:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+356:41278:x1731746394401664:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.372404:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11134 00010000:00010000:1.0:1651529333.372415:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4c12a lrc: 3/0,1 mode: PW/PW res: [0x2b2a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.372418:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4c12a lrc: 3/0,1 mode: PW/PW res: [0x2b2a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.372421:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4c12a lrc: 3/0,1 mode: PW/PW res: [0x2b2a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.372424:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4c12a lrc: 2/0,0 mode: PW/PW res: [0x2b2a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.372469:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1055:39030:x1731745946288448:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1057us (1130us total) trans 12885078405 rc 0/0 00000100:00100000:1.0:1651529333.372472:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208494 00010000:00010000:1.0:1651529333.372479:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003324f656/0x3234de053c4c115 lrc: 2/0,0 mode: PW/PW res: [0x2b29d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.372482:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003324f656 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.372483:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003324f656/0x3234de053c4c115 lrc: 2/0,0 mode: PW/PW res: [0x2b29d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.372486:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003324f656/0x3234de053c4c115 lrc: 3/0,0 mode: PW/PW res: [0x2b29d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.372491:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003324f656/0x3234de053c4c115 lrc: 1/0,0 mode: --/PW res: [0x2b29d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.372494:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003324f656/0x3234de053c4c115 lrc: 0/0,0 mode: --/PW res: [0x2b29d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.372498:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002537ce87/0x3234de053c4c123 lrc: 2/0,0 mode: PW/PW res: [0x2b29f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.372501:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002537ce87 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.372501:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002537ce87/0x3234de053c4c123 lrc: 2/0,0 mode: PW/PW res: [0x2b29f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.372505:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002537ce87/0x3234de053c4c123 lrc: 3/0,0 mode: PW/PW res: [0x2b29f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.372508:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002537ce87/0x3234de053c4c123 lrc: 1/0,0 mode: --/PW res: [0x2b29f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.372510:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002537ce87/0x3234de053c4c123 lrc: 0/0,0 mode: --/PW res: [0x2b29f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.372536:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.372553:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.372654:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000095d7eb1a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996929216:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.372658:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4c131 lrc: 3/0,1 mode: --/PW res: [0x2b2a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.372726:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4c131 lrc: 3/0,1 mode: PW/PW res: [0x2b2a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.372738:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4c131 lrc: 3/0,1 mode: PW/PW res: [0x2b2a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.372741:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4c131 lrc: 3/0,1 mode: PW/PW res: [0x2b2a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.372744:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4c131 lrc: 2/0,0 mode: PW/PW res: [0x2b2a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.372797:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1055:39029:x1731745946288512:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1170us (1231us total) trans 12885078408 rc 0/0 00000100:00100000:1.0:1651529333.372800:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208495 00000100:00100000:1.0:1651529333.372835:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.372862:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.372906:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.372914:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.372923:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946288960 00000100:00100000:1.0:1651529333.372931:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946288896 00000100:00100000:1.0:1651529333.372938:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208501 00000100:00100000:1.0:1651529333.372939:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1058:39029:x1731745946288768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.372945:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176805 count 1 00010000:00010000:1.0:1651529333.372949:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c03f4dd/0x3234de053c4c15b lrc: 3/0,1 mode: --/PW res: [0x2b2a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.372954:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ae5fa4ef/0x3234de053c44824 lrc: 2/0,0 mode: PR/PR res: [0x2b2a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a679b expref: 354 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.372966:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.372967:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.372967:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c03f4dd/0x3234de053c4c15b lrc: 4/0,1 mode: --/PW res: [0x2b2a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.372975:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ae5fa4ef/0x3234de053c44824 lrc: 3/0,0 mode: PR/PR res: [0x2b2a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a679b expref: 354 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.372978:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ae5fa4ef/0x3234de053c44824 lrc: 4/0,0 mode: PR/PR res: [0x2b2a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a679b expref: 354 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.372982:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c20a6e11 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996929536:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.372991:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 0000000053a0cffa going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.372998:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208503 00000100:00100000:1.0:1651529333.372999:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1058:39029:x1731745946288896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.373004:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176807 count 1 00010000:00010000:1.0:1651529333.373007:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b6e58d6/0x3234de053c4c169 lrc: 3/0,1 mode: --/PW res: [0x2b2a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.373012:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000003e92419/0x3234de053c4637c lrc: 2/0,0 mode: PR/PR res: [0x2b2a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad52c expref: 354 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.373015:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.373015:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.373016:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b6e58d6/0x3234de053c4c169 lrc: 4/0,1 mode: --/PW res: [0x2b2a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.373025:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000003e92419/0x3234de053c4637c lrc: 3/0,0 mode: PR/PR res: [0x2b2a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad52c expref: 354 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.373028:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000003e92419/0x3234de053c4637c lrc: 4/0,0 mode: PR/PR res: [0x2b2a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad52c expref: 354 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.373032:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000027c41311 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996929664:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.373039:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 0000000020dd7827 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.373096:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.373108:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.373146:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.373155:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004a6776b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996929344:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.373159:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000656a2f5f/0x3234de053c4c13f lrc: 3/0,1 mode: --/PW res: [0x2b2a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.373166:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394402368 00010000:00010000:1.0:1651529333.373171:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b388b573/0x3234de053c467b9 lrc: 4/0,0 mode: PR/PR res: [0x2b2a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae6eb expref: 356 pid: 80277 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.373184:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11137 00000100:00100000:1.0:1651529333.373186:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+356:41278:x1731746394402432:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.373189:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.373190:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004042fb39/0x3234de053c45807 lrc: 4/0,0 mode: PR/PR res: [0x2b2a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa704 expref: 356 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.373197:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004042fb39/0x3234de053c45807 lrc: 3/0,0 mode: PR/PR res: [0x2b2a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa704 expref: 355 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.373202:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004042fb39/0x3234de053c45807 lrc: 0/0,0 mode: --/PR res: [0x2b2a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa704 expref: 355 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.373206:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.373207:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.373207:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006c9c0f07/0x3234de053c4c14d lrc: 3/0,1 mode: PW/PW res: [0x2b2a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.373210:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c9c0f07/0x3234de053c4c14d lrc: 4/0,1 mode: PW/PW res: [0x2b2a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.373220:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.373243:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+354:41278:x1731746394402432:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 56us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.373246:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11137 00000100:00100000:1.0:1651529333.373262:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529333.373321:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000656a2f5f/0x3234de053c4c13f lrc: 3/0,1 mode: PW/PW res: [0x2b2a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.373326:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000656a2f5f/0x3234de053c4c13f lrc: 3/0,1 mode: PW/PW res: [0x2b2a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.373329:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000656a2f5f/0x3234de053c4c13f lrc: 3/0,1 mode: PW/PW res: [0x2b2a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.373332:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000656a2f5f/0x3234de053c4c13f lrc: 2/0,0 mode: PW/PW res: [0x2b2a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.373379:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1060:39030:x1731745946288576:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1169us (1219us total) trans 12885078409 rc 0/0 00000100:00100000:1.0:1651529333.373382:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208497 00010000:00010000:1.0:1651529333.373389:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000656a2f5f/0x3234de053c4c13f lrc: 2/0,0 mode: PW/PW res: [0x2b2a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.373393:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000656a2f5f already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.373394:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000656a2f5f/0x3234de053c4c13f lrc: 2/0,0 mode: PW/PW res: [0x2b2a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.373397:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000656a2f5f/0x3234de053c4c13f lrc: 3/0,0 mode: PW/PW res: [0x2b2a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.373401:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000656a2f5f/0x3234de053c4c13f lrc: 1/0,0 mode: --/PW res: [0x2b2a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.373404:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000656a2f5f/0x3234de053c4c13f lrc: 0/0,0 mode: --/PW res: [0x2b2a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.373409:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c57bbfeb/0x3234de053c4c138 lrc: 2/0,0 mode: PW/PW res: [0x2b2a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.373411:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c57bbfeb already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.373412:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c57bbfeb/0x3234de053c4c138 lrc: 2/0,0 mode: PW/PW res: [0x2b2a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.373415:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c57bbfeb/0x3234de053c4c138 lrc: 3/0,0 mode: PW/PW res: [0x2b2a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.373418:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c57bbfeb/0x3234de053c4c138 lrc: 1/0,0 mode: --/PW res: [0x2b2a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.373421:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c57bbfeb/0x3234de053c4c138 lrc: 0/0,0 mode: --/PW res: [0x2b2a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.373585:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.373597:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.373607:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c20a6e11 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996929536:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.373617:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002c03f4dd/0x3234de053c4c15b lrc: 3/0,1 mode: --/PW res: [0x2b2a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.373629:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000027c41311 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996929664:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.373631:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004b6e58d6/0x3234de053c4c169 lrc: 3/0,1 mode: --/PW res: [0x2b2a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.373638:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11140 00000100:00100000:1.0:1651529333.373640:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e29becaf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+353:41278:x1731746394402688:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.373643:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.373645:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000003e92419/0x3234de053c4637c lrc: 4/0,0 mode: PR/PR res: [0x2b2a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad52c expref: 352 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.373648:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000003e92419/0x3234de053c4637c lrc: 3/0,0 mode: PR/PR res: [0x2b2a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad52c expref: 352 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.373660:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003e92419/0x3234de053c4637c lrc: 0/0,0 mode: --/PR res: [0x2b2a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad52c expref: 352 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.373664:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.373664:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.373665:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004b6e58d6/0x3234de053c4c169 lrc: 3/0,1 mode: PW/PW res: [0x2b2a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.373673:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b6e58d6/0x3234de053c4c169 lrc: 4/0,1 mode: PW/PW res: [0x2b2a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.373679:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.373690:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e29becaf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+350:41278:x1731746394402688:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 50us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.373693:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11140 00010000:00010000:1.0:1651529333.373705:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004b6e58d6/0x3234de053c4c169 lrc: 3/0,1 mode: PW/PW res: [0x2b2a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.373708:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b6e58d6/0x3234de053c4c169 lrc: 3/0,1 mode: PW/PW res: [0x2b2a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.373711:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b6e58d6/0x3234de053c4c169 lrc: 3/0,1 mode: PW/PW res: [0x2b2a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.373717:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b6e58d6/0x3234de053c4c169 lrc: 2/0,0 mode: PW/PW res: [0x2b2a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.373769:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1060:39029:x1731745946288896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 769us (855us total) trans 12885078412 rc 0/0 00000100:00100000:1.0:1651529333.373772:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208503 00010000:00010000:1.0:1651529333.373780:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002c03f4dd/0x3234de053c4c15b lrc: 3/0,1 mode: PW/PW res: [0x2b2a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.373783:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c03f4dd/0x3234de053c4c15b lrc: 3/0,1 mode: PW/PW res: [0x2b2a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.373786:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c03f4dd/0x3234de053c4c15b lrc: 3/0,1 mode: PW/PW res: [0x2b2a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.373789:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c03f4dd/0x3234de053c4c15b lrc: 2/0,0 mode: PW/PW res: [0x2b2a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.373820:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1060:39029:x1731745946288768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 880us (958us total) trans 12885078413 rc 0/0 00000100:00100000:1.0:1651529333.373823:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208501 00010000:00010000:1.0:1651529333.373839:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c03f4dd/0x3234de053c4c15b lrc: 2/0,0 mode: PW/PW res: [0x2b2a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.373843:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002c03f4dd already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.373844:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c03f4dd/0x3234de053c4c15b lrc: 2/0,0 mode: PW/PW res: [0x2b2a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.373847:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c03f4dd/0x3234de053c4c15b lrc: 3/0,0 mode: PW/PW res: [0x2b2a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.373852:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c03f4dd/0x3234de053c4c15b lrc: 1/0,0 mode: --/PW res: [0x2b2a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.373854:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c03f4dd/0x3234de053c4c15b lrc: 0/0,0 mode: --/PW res: [0x2b2a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.373887:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.373902:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.373913:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.373940:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.373968:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.373986:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.373994:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394402496 00010000:00010000:1.0:1651529333.374004:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000010c92236/0x3234de053c45988 lrc: 4/0,0 mode: PR/PR res: [0x2b2a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aad5c expref: 350 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.374014:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394402624 00010000:00010000:1.0:1651529333.374016:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ce16cb2e/0x3234de053c4653c lrc: 4/0,0 mode: PR/PR res: [0x2b2a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2adcdb expref: 351 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.374021:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394402880 00010000:00010000:1.0:1651529333.374023:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b1848133/0x3234de053c456be lrc: 5/0,0 mode: PR/PR res: [0x2b2a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa051 expref: 352 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.374030:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11141 00000100:00100000:1.0:1651529333.374032:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+352:41279:x1731746394402496:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.374035:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.374036:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000010c92236/0x3234de053c45988 lrc: 4/0,0 mode: PR/PR res: [0x2b2a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aad5c expref: 352 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.374040:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000010c92236/0x3234de053c45988 lrc: 3/0,0 mode: PR/PR res: [0x2b2a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aad5c expref: 352 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.374045:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010c92236/0x3234de053c45988 lrc: 0/0,0 mode: --/PR res: [0x2b2a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aad5c expref: 352 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.374049:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.374049:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.374050:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f87a625c/0x3234de053c4c154 lrc: 3/0,1 mode: PW/PW res: [0x2b2a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.374053:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f87a625c/0x3234de053c4c154 lrc: 4/0,1 mode: PW/PW res: [0x2b2a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.374068:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.374075:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+351:41279:x1731746394402496:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 43us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.374078:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11141 00000100:00100000:1.0:1651529333.374083:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11142 00000100:00100000:1.0:1651529333.374084:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+350:41279:x1731746394402624:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.374087:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.374088:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ce16cb2e/0x3234de053c4653c lrc: 4/0,0 mode: PR/PR res: [0x2b2a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2adcdb expref: 350 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.374092:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ce16cb2e/0x3234de053c4653c lrc: 3/0,0 mode: PR/PR res: [0x2b2a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2adcdb expref: 350 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.374097:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce16cb2e/0x3234de053c4653c lrc: 0/0,0 mode: --/PR res: [0x2b2a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2adcdb expref: 350 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.374100:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.374100:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.374101:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d95da09e/0x3234de053c4c162 lrc: 3/0,1 mode: PW/PW res: [0x2b2a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.374104:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d95da09e/0x3234de053c4c162 lrc: 4/0,1 mode: PW/PW res: [0x2b2a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.374112:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.374117:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+349:41279:x1731746394402624:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 33us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.374120:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11142 00000100:00100000:1.0:1651529333.374124:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11143 00000100:00100000:1.0:1651529333.374125:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+348:41278:x1731746394402880:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.374127:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.374129:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b1848133/0x3234de053c456be lrc: 5/0,0 mode: PR/PR res: [0x2b2a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa051 expref: 348 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.374135:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b1848133/0x3234de053c456be lrc: 4/0,0 mode: PR/PR res: [0x2b2a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa051 expref: 348 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.374139:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.374140:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.374140:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008c45287a/0x3234de053c4c170 lrc: 3/0,1 mode: PW/PW res: [0x2b2a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.374143:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c45287a/0x3234de053c4c170 lrc: 4/0,1 mode: PW/PW res: [0x2b2a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.374147:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.374151:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+348:41278:x1731746394402880:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 25us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.374153:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11143 00000100:00100000:1.0:1651529333.374161:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208507 00000100:00100000:1.0:1651529333.374162:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1063:39030:x1731745946289216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.374167:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176812 count 1 00010000:00010000:1.0:1651529333.374171:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf272247/0x3234de053c4c185 lrc: 3/0,1 mode: --/PW res: [0x2b2ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.374175:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004906007b/0x3234de053c46861 lrc: 2/0,0 mode: PR/PR res: [0x2b2ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae93e expref: 347 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.374178:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.374179:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.374180:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf272247/0x3234de053c4c185 lrc: 4/0,1 mode: --/PW res: [0x2b2ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.374186:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004906007b/0x3234de053c46861 lrc: 3/0,0 mode: PR/PR res: [0x2b2ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae93e expref: 347 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.374190:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004906007b/0x3234de053c46861 lrc: 4/0,0 mode: PR/PR res: [0x2b2ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae93e expref: 347 pid: 80277 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.374194:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000078a40aa9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996929920:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.374202:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 0000000053a0cffa going to sleep for 6 seconds 00010000:00010000:1.0:1651529333.374343:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c45287a/0x3234de053c4c170 lrc: 3/0,0 mode: PW/PW res: [0x2b2a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.374348:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008c45287a already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.374349:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c45287a/0x3234de053c4c170 lrc: 3/0,0 mode: PW/PW res: [0x2b2a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.374352:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c45287a/0x3234de053c4c170 lrc: 4/0,0 mode: PW/PW res: [0x2b2a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.374357:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c45287a/0x3234de053c4c170 lrc: 1/0,0 mode: --/PW res: [0x2b2a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.374360:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c45287a/0x3234de053c4c170 lrc: 0/0,0 mode: --/PW res: [0x2b2a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.374454:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.374465:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.374486:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208509 00000100:00100000:1.0:1651529333.374489:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1064:39029:x1731745946289344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.374494:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176814 count 1 00010000:00010000:1.0:1651529333.374499:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4c18c lrc: 3/0,1 mode: --/PW res: [0x2b2ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.374504:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e27d2f36/0x3234de053c43a40 lrc: 2/0,0 mode: PR/PR res: [0x2b2ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2e2f expref: 346 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.374507:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.374507:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.374508:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4c18c lrc: 4/0,1 mode: --/PW res: [0x2b2ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.374515:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e27d2f36/0x3234de053c43a40 lrc: 3/0,0 mode: PR/PR res: [0x2b2ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2e2f expref: 346 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.374518:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e27d2f36/0x3234de053c43a40 lrc: 4/0,0 mode: PR/PR res: [0x2b2ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2e2f expref: 346 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.374529:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000086eaa330 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996929984:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.374539:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 0000000020dd7827 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.374550:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.374599:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.374638:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.374652:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.374661:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.374698:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208512 00000100:00100000:1.0:1651529333.374701:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1067:39029:x1731745946289536:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.374706:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176817 count 1 00010000:00010000:1.0:1651529333.374711:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4c1a8 lrc: 3/0,1 mode: --/PW res: [0x2b2b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.374715:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000df83e9c5/0x3234de053c46439 lrc: 2/0,0 mode: PR/PR res: [0x2b2b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad835 expref: 346 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.374719:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.374719:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.374720:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4c1a8 lrc: 4/0,1 mode: --/PW res: [0x2b2b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.374727:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000df83e9c5/0x3234de053c46439 lrc: 3/0,0 mode: PR/PR res: [0x2b2b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad835 expref: 346 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.374743:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000df83e9c5/0x3234de053c46439 lrc: 4/0,0 mode: PR/PR res: [0x2b2b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad835 expref: 346 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.374748:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000117fbeca pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996930240:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.374757:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c3caa148 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.374764:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394403136 00010000:00010000:1.0:1651529333.374769:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005407e3c7/0x3234de053c44a9a lrc: 5/0,0 mode: PR/PR res: [0x2b2aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a71b9 expref: 348 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.374783:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11145 00000100:00100000:1.0:1651529333.374785:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003ffbc5dc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+348:41278:x1731746394403136:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.374788:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.374789:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005407e3c7/0x3234de053c44a9a lrc: 5/0,0 mode: PR/PR res: [0x2b2aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a71b9 expref: 348 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.374793:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005407e3c7/0x3234de053c44a9a lrc: 4/0,0 mode: PR/PR res: [0x2b2aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a71b9 expref: 348 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.374800:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.374800:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.374801:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006247fb8a/0x3234de053c4c177 lrc: 3/0,1 mode: PW/PW res: [0x2b2aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.374804:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006247fb8a/0x3234de053c4c177 lrc: 4/0,1 mode: PW/PW res: [0x2b2aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.374809:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.374815:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003ffbc5dc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+347:41278:x1731746394403136:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 30us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.374817:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11145 00000100:00100000:1.0:1651529333.374827:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000078a40aa9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996929920:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.374830:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bf272247/0x3234de053c4c185 lrc: 3/0,1 mode: --/PW res: [0x2b2ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.374928:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000086eaa330 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996929984:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.374932:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4c18c lrc: 3/0,1 mode: --/PW res: [0x2b2ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.375081:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.375196:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.375204:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.375210:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.375216:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.375243:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.375248:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.375270:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.375307:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000117fbeca pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996930240:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.375311:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4c1a8 lrc: 3/0,1 mode: --/PW res: [0x2b2b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.375319:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394403328 00010000:00010000:1.0:1651529333.375323:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e27d2f36/0x3234de053c43a40 lrc: 4/0,0 mode: PR/PR res: [0x2b2ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2e2f expref: 345 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.375329:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394403520 00010000:00010000:1.0:1651529333.375331:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000020136d79/0x3234de053c461b5 lrc: 4/0,0 mode: PR/PR res: [0x2b2ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acdbc expref: 346 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.375342:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11146 00000100:00100000:1.0:1651529333.375343:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+346:41278:x1731746394403328:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.375346:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.375348:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e27d2f36/0x3234de053c43a40 lrc: 4/0,0 mode: PR/PR res: [0x2b2ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2e2f expref: 346 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.375354:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e27d2f36/0x3234de053c43a40 lrc: 3/0,0 mode: PR/PR res: [0x2b2ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2e2f expref: 346 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.375359:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e27d2f36/0x3234de053c43a40 lrc: 0/0,0 mode: --/PR res: [0x2b2ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2e2f expref: 347 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.375363:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.375363:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.375364:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4c18c lrc: 3/0,1 mode: PW/PW res: [0x2b2ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.375367:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4c18c lrc: 4/0,1 mode: PW/PW res: [0x2b2ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.375373:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.375380:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+349:41278:x1731746394403328:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 36us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.375382:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11146 00000100:00100000:1.0:1651529333.375387:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11148 00000100:00100000:1.0:1651529333.375389:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+348:41278:x1731746394403648:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.375391:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.375393:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000df83e9c5/0x3234de053c46439 lrc: 4/0,0 mode: PR/PR res: [0x2b2b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad835 expref: 348 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.375396:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000df83e9c5/0x3234de053c46439 lrc: 3/0,0 mode: PR/PR res: [0x2b2b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad835 expref: 348 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.375401:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df83e9c5/0x3234de053c46439 lrc: 0/0,0 mode: --/PR res: [0x2b2b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad835 expref: 348 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.375404:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.375405:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.375406:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4c1a8 lrc: 3/0,1 mode: PW/PW res: [0x2b2b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.375408:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4c1a8 lrc: 4/0,1 mode: PW/PW res: [0x2b2b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.375414:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.375421:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+346:41278:x1731746394403648:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 31us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.375424:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11148 00000100:00100000:1.0:1651529333.375429:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11149 00000100:00100000:1.0:1651529333.375430:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+344:41278:x1731746394403264:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.375432:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.375433:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004906007b/0x3234de053c46861 lrc: 4/0,0 mode: PR/PR res: [0x2b2ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae93e expref: 344 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.375437:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004906007b/0x3234de053c46861 lrc: 3/0,0 mode: PR/PR res: [0x2b2ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae93e expref: 344 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.375442:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004906007b/0x3234de053c46861 lrc: 0/0,0 mode: --/PR res: [0x2b2ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae93e expref: 344 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.375448:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.375448:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.375449:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf272247/0x3234de053c4c185 lrc: 3/0,1 mode: PW/PW res: [0x2b2ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.375452:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf272247/0x3234de053c4c185 lrc: 4/0,1 mode: PW/PW res: [0x2b2ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.375457:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.375461:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+342:41278:x1731746394403264:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 30us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.375464:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11149 00000100:00100000:1.0:1651529333.375468:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11151 00000100:00100000:1.0:1651529333.375469:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+340:41278:x1731746394403712:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.375471:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.375473:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d47b6709/0x3234de053c43ed1 lrc: 4/0,0 mode: PR/PR res: [0x2b2af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a409d expref: 340 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.375476:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d47b6709/0x3234de053c43ed1 lrc: 3/0,0 mode: PR/PR res: [0x2b2af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a409d expref: 340 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.375481:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d47b6709/0x3234de053c43ed1 lrc: 0/0,0 mode: --/PR res: [0x2b2af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a409d expref: 340 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.375484:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.375485:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.375485:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c473d13f/0x3234de053c4c1a1 lrc: 3/0,1 mode: PW/PW res: [0x2b2af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.375488:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c473d13f/0x3234de053c4c1a1 lrc: 4/0,1 mode: PW/PW res: [0x2b2af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.375504:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.375510:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+339:41278:x1731746394403712:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.375512:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11151 00010000:00010000:1.0:1651529333.375521:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4c18c lrc: 3/0,1 mode: PW/PW res: [0x2b2ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.375524:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4c18c lrc: 3/0,1 mode: PW/PW res: [0x2b2ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.375528:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4c18c lrc: 3/0,1 mode: PW/PW res: [0x2b2ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.375530:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4c18c lrc: 2/0,0 mode: PW/PW res: [0x2b2ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.375575:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1070:39029:x1731745946289344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1086us (1109us total) trans 12885078420 rc 0/0 00000100:00100000:1.0:1651529333.375578:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208509 00010000:00010000:1.0:1651529333.375585:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bf272247/0x3234de053c4c185 lrc: 3/0,1 mode: PW/PW res: [0x2b2ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.375591:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf272247/0x3234de053c4c185 lrc: 3/0,1 mode: PW/PW res: [0x2b2ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.375594:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf272247/0x3234de053c4c185 lrc: 3/0,1 mode: PW/PW res: [0x2b2ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.375596:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf272247/0x3234de053c4c185 lrc: 2/0,0 mode: PW/PW res: [0x2b2ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.375635:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1071:39030:x1731745946289216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1472us (1666us total) trans 12885078421 rc 0/0 00000100:00100000:1.0:1651529333.375638:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208507 00010000:00010000:1.0:1651529333.375644:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c473d13f/0x3234de053c4c1a1 lrc: 2/0,0 mode: PW/PW res: [0x2b2af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.375648:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c473d13f already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.375648:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c473d13f/0x3234de053c4c1a1 lrc: 2/0,0 mode: PW/PW res: [0x2b2af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.375651:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c473d13f/0x3234de053c4c1a1 lrc: 3/0,0 mode: PW/PW res: [0x2b2af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.375656:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c473d13f/0x3234de053c4c1a1 lrc: 1/0,0 mode: --/PW res: [0x2b2af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.375659:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c473d13f/0x3234de053c4c1a1 lrc: 0/0,0 mode: --/PW res: [0x2b2af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.375666:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4c1a8 lrc: 3/0,1 mode: PW/PW res: [0x2b2b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.375669:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4c1a8 lrc: 3/0,1 mode: PW/PW res: [0x2b2b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.375672:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4c1a8 lrc: 3/0,1 mode: PW/PW res: [0x2b2b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.375674:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4c1a8 lrc: 2/0,0 mode: PW/PW res: [0x2b2b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.375708:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1071:39029:x1731745946289536:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1007us (1070us total) trans 12885078423 rc 0/0 00000100:00100000:1.0:1651529333.375711:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208512 00010000:00010000:1.0:1651529333.375718:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4c1a8 lrc: 2/0,0 mode: PW/PW res: [0x2b2b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.375721:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054a30dd8 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.375722:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4c1a8 lrc: 2/0,0 mode: PW/PW res: [0x2b2b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.375725:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4c1a8 lrc: 3/0,0 mode: PW/PW res: [0x2b2b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.375738:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4c1a8 lrc: 1/0,0 mode: --/PW res: [0x2b2b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.375742:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4c1a8 lrc: 0/0,0 mode: --/PW res: [0x2b2b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.376175:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.376186:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.376193:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.376203:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.376213:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.376241:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.376273:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.376280:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.376286:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.376293:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394404032 00000100:00100000:1.0:1651529333.376299:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208516 00000100:00100000:1.0:1651529333.376301:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1075:39029:x1731745946289920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.376307:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176823 count 1 00010000:00010000:1.0:1651529333.376318:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4c1c4 lrc: 3/0,1 mode: --/PW res: [0x2b2b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.376323:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d840b819/0x3234de053c438f7 lrc: 2/0,0 mode: PR/PR res: [0x2b2b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2951 expref: 339 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.376326:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.376327:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.376327:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4c1c4 lrc: 4/0,1 mode: --/PW res: [0x2b2b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.376337:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d840b819/0x3234de053c438f7 lrc: 3/0,0 mode: PR/PR res: [0x2b2b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2951 expref: 339 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.376341:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d840b819/0x3234de053c438f7 lrc: 4/0,0 mode: PR/PR res: [0x2b2b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2951 expref: 339 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.376345:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006929eb96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996930496:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.376354:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 0000000053a0cffa going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.376361:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208518 00000100:00100000:1.0:1651529333.376363:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1075:39029:x1731745946289856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.376367:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176822 count 1 00010000:00010000:1.0:1651529333.376371:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4c1d2 lrc: 3/0,1 mode: --/PW res: [0x2b2b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.376375:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cf6fe39b/0x3234de053c437df lrc: 2/0,0 mode: PR/PR res: [0x2b2b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a25ae expref: 339 pid: 80278 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.376378:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.376379:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.376380:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4c1d2 lrc: 4/0,1 mode: --/PW res: [0x2b2b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.376386:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cf6fe39b/0x3234de053c437df lrc: 3/0,0 mode: PR/PR res: [0x2b2b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a25ae expref: 339 pid: 80278 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.376389:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cf6fe39b/0x3234de053c437df lrc: 4/0,0 mode: PR/PR res: [0x2b2b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a25ae expref: 339 pid: 80278 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.376393:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000078a40aa9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996930624:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.376400:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e5f43e7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.376406:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208520 00000100:00100000:1.0:1651529333.376407:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1075:39029:x1731745946289984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.376411:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176824 count 1 00010000:00010000:1.0:1651529333.376414:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4c1e0 lrc: 3/0,1 mode: --/PW res: [0x2b2b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.376418:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004fb962f5/0x3234de053c4587e lrc: 2/0,0 mode: PR/PR res: [0x2b2b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa918 expref: 339 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.376421:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.376422:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.376422:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4c1e0 lrc: 4/0,1 mode: --/PW res: [0x2b2b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.376428:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004fb962f5/0x3234de053c4587e lrc: 3/0,0 mode: PR/PR res: [0x2b2b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa918 expref: 339 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.376432:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004fb962f5/0x3234de053c4587e lrc: 4/0,0 mode: PR/PR res: [0x2b2b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa918 expref: 339 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.376436:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996930752:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.376442:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8a0b704 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.376450:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394404096 00010000:00010000:1.0:1651529333.376455:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000431bd54f/0x3234de053c44599 lrc: 4/0,0 mode: PR/PR res: [0x2b2b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5d99 expref: 341 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.376462:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394404160 00010000:00010000:1.0:1651529333.376464:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c45402 lrc: 5/0,0 mode: PR/PR res: [0x2b2b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a95df expref: 342 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.376475:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11152 00000100:00100000:1.0:1651529333.376477:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+341:41278:x1731746394404096:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529333.376480:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.376481:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000431bd54f/0x3234de053c44599 lrc: 4/0,0 mode: PR/PR res: [0x2b2b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5d99 expref: 341 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.376485:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000431bd54f/0x3234de053c44599 lrc: 3/0,0 mode: PR/PR res: [0x2b2b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5d99 expref: 341 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.376490:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000431bd54f/0x3234de053c44599 lrc: 0/0,0 mode: --/PR res: [0x2b2b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5d99 expref: 341 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.376494:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.376494:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.376495:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004a899246/0x3234de053c4c1af lrc: 3/0,1 mode: PW/PW res: [0x2b2b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.376498:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a899246/0x3234de053c4c1af lrc: 4/0,1 mode: PW/PW res: [0x2b2b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.376507:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.376514:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+340:41278:x1731746394404096:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.376516:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11152 00000100:00100000:1.0:1651529333.376533:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529333.376774:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a899246/0x3234de053c4c1af lrc: 2/0,0 mode: PW/PW res: [0x2b2b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.376779:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004a899246 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.376780:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a899246/0x3234de053c4c1af lrc: 2/0,0 mode: PW/PW res: [0x2b2b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.376783:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a899246/0x3234de053c4c1af lrc: 3/0,0 mode: PW/PW res: [0x2b2b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.376788:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a899246/0x3234de053c4c1af lrc: 1/0,0 mode: --/PW res: [0x2b2b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.376791:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a899246/0x3234de053c4c1af lrc: 0/0,0 mode: --/PW res: [0x2b2b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.376910:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.376989:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.377097:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.377106:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.377113:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.377122:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006929eb96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996930496:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.377132:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4c1c4 lrc: 3/0,1 mode: --/PW res: [0x2b2b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.377143:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000078a40aa9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996930624:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.377145:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4c1d2 lrc: 3/0,1 mode: --/PW res: [0x2b2b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.377151:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996930752:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.377153:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4c1e0 lrc: 3/0,1 mode: --/PW res: [0x2b2b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.377160:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394404544 00010000:00010000:1.0:1651529333.377164:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c44369 lrc: 4/0,0 mode: PR/PR res: [0x2b2b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a53c1 expref: 340 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.377179:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11154 00000100:00100000:1.0:1651529333.377180:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d8aeac5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+341:41278:x1731746394404416:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.377184:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.377185:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002de03da3/0x3234de053c46964 lrc: 4/0,0 mode: PR/PR res: [0x2b2b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aed58 expref: 341 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.377189:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002de03da3/0x3234de053c46964 lrc: 3/0,0 mode: PR/PR res: [0x2b2b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aed58 expref: 341 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.377195:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002de03da3/0x3234de053c46964 lrc: 0/0,0 mode: --/PR res: [0x2b2b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aed58 expref: 341 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.377201:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.377202:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.377203:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ebf7beea/0x3234de053c4c1bd lrc: 3/0,1 mode: PW/PW res: [0x2b2b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.377206:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebf7beea/0x3234de053c4c1bd lrc: 4/0,1 mode: PW/PW res: [0x2b2b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.377215:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.377243:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d8aeac5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+339:41278:x1731746394404416:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 61us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.377246:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11154 00000100:00100000:1.0:1651529333.377308:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.377349:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.377357:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.377372:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394404608 00010000:00010000:1.0:1651529333.377378:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cf6fe39b/0x3234de053c437df lrc: 4/0,0 mode: PR/PR res: [0x2b2b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a25ae expref: 336 pid: 80278 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.377398:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394404736 00010000:00010000:1.0:1651529333.377401:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004fb962f5/0x3234de053c4587e lrc: 4/0,0 mode: PR/PR res: [0x2b2b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa918 expref: 336 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.377406:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11159 00000100:00100000:1.0:1651529333.377408:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+336:41279:x1731746394404736:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.377410:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.377412:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004fb962f5/0x3234de053c4587e lrc: 4/0,0 mode: PR/PR res: [0x2b2b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa918 expref: 336 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.377416:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004fb962f5/0x3234de053c4587e lrc: 3/0,0 mode: PR/PR res: [0x2b2b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa918 expref: 336 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.377421:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004fb962f5/0x3234de053c4587e lrc: 0/0,0 mode: --/PR res: [0x2b2b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa918 expref: 335 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.377424:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.377425:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.377426:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4c1e0 lrc: 3/0,1 mode: PW/PW res: [0x2b2b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.377429:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4c1e0 lrc: 4/0,1 mode: PW/PW res: [0x2b2b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.377440:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.377448:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+333:41279:x1731746394404736:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 39us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.377450:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11159 00010000:00010000:1.0:1651529333.377458:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4c1c4 lrc: 3/0,1 mode: PW/PW res: [0x2b2b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.377461:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4c1c4 lrc: 3/0,1 mode: PW/PW res: [0x2b2b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.377464:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4c1c4 lrc: 3/0,1 mode: PW/PW res: [0x2b2b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.377468:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4c1c4 lrc: 2/0,0 mode: PW/PW res: [0x2b2b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.377514:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1079:39029:x1731745946289920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1212us (1328us total) trans 12885078428 rc 0/0 00000100:00100000:1.0:1651529333.377518:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208516 00010000:00010000:1.0:1651529333.377525:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4c1d2 lrc: 3/0,1 mode: PW/PW res: [0x2b2b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.377528:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4c1d2 lrc: 3/0,1 mode: PW/PW res: [0x2b2b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.377531:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4c1d2 lrc: 3/0,1 mode: PW/PW res: [0x2b2b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.377533:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4c1d2 lrc: 2/0,0 mode: PW/PW res: [0x2b2b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.377565:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1078:39029:x1731745946289856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1201us (1366us total) trans 12885078429 rc 0/0 00000100:00100000:1.0:1651529333.377567:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208518 00010000:00010000:1.0:1651529333.377573:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4c1e0 lrc: 3/0,1 mode: PW/PW res: [0x2b2b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.377576:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4c1e0 lrc: 3/0,1 mode: PW/PW res: [0x2b2b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.377582:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4c1e0 lrc: 3/0,1 mode: PW/PW res: [0x2b2b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.377585:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4c1e0 lrc: 2/0,0 mode: PW/PW res: [0x2b2b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.377623:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1079:39029:x1731745946289984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1215us (1382us total) trans 12885078431 rc 0/0 00000100:00100000:1.0:1651529333.377626:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208520 00010000:00010000:1.0:1651529333.377633:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000943c1249/0x3234de053c4c1cb lrc: 2/0,0 mode: PW/PW res: [0x2b2b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.377636:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000943c1249 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.377637:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000943c1249/0x3234de053c4c1cb lrc: 2/0,0 mode: PW/PW res: [0x2b2b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.377640:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000943c1249/0x3234de053c4c1cb lrc: 3/0,0 mode: PW/PW res: [0x2b2b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.377644:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000943c1249/0x3234de053c4c1cb lrc: 1/0,0 mode: --/PW res: [0x2b2b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.377647:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000943c1249/0x3234de053c4c1cb lrc: 0/0,0 mode: --/PW res: [0x2b2b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.377712:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.377723:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.377807:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394404992 00010000:00010000:1.0:1651529333.377818:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000053e0755a/0x3234de053c46122 lrc: 4/0,0 mode: PR/PR res: [0x2b2bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acb15 expref: 333 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.377826:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394405056 00010000:00010000:1.0:1651529333.377829:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008f63a015/0x3234de053c4391a lrc: 4/0,0 mode: PR/PR res: [0x2b2ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a29b3 expref: 334 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.377839:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11160 00000100:00100000:1.0:1651529333.377840:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+334:41278:x1731746394404992:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.377843:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.377845:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000053e0755a/0x3234de053c46122 lrc: 4/0,0 mode: PR/PR res: [0x2b2bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acb15 expref: 334 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.377849:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000053e0755a/0x3234de053c46122 lrc: 3/0,0 mode: PR/PR res: [0x2b2bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acb15 expref: 334 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.377854:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053e0755a/0x3234de053c46122 lrc: 0/0,0 mode: --/PR res: [0x2b2bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acb15 expref: 334 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.377858:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.377858:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.377859:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c7d5d09f/0x3234de053c4c1fc lrc: 3/0,1 mode: PW/PW res: [0x2b2bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.377862:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7d5d09f/0x3234de053c4c1fc lrc: 4/0,1 mode: PW/PW res: [0x2b2bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.377873:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.377882:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+332:41278:x1731746394404992:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 41us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.377885:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11160 00010000:00010000:1.0:1651529333.377892:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ebf7beea/0x3234de053c4c1bd lrc: 2/0,0 mode: PW/PW res: [0x2b2b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.377895:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ebf7beea already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.377896:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebf7beea/0x3234de053c4c1bd lrc: 2/0,0 mode: PW/PW res: [0x2b2b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.377899:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebf7beea/0x3234de053c4c1bd lrc: 3/0,0 mode: PW/PW res: [0x2b2b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.377903:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ebf7beea/0x3234de053c4c1bd lrc: 1/0,0 mode: --/PW res: [0x2b2b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.377905:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ebf7beea/0x3234de053c4c1bd lrc: 0/0,0 mode: --/PW res: [0x2b2b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.377951:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.377962:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.377971:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.377996:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.378004:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.378010:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.378029:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.378071:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 208525 00000100:00100000:1.0:1651529333.378073:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+331:41279:x1731746394405120:12345-10.240.43.64@tcp:101:ll_agl_410261.0 00010000:00010000:1.0:1651529333.378077:0:80278:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529333.378082:0:80278:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc20db45/0x3234de053c4c203 lrc: 2/0,0 mode: --/PR res: [0x2b5d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2cc871 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529333.378088:0:80278:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b5d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529333.378092:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.378093:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.378094:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc20db45/0x3234de053c4c203 lrc: 3/0,0 mode: PR/PR res: [0x2b5d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc871 expref: 332 pid: 80278 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.378099:0:80278:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cc20db45/0x3234de053c4c203 lrc: 3/0,0 mode: PR/PR res: [0x2b5d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc871 expref: 332 pid: 80278 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.378103:0:80278:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000cc20db45, rc 0) 00000100:00100000:1.0:1651529333.378112:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+332:41279:x1731746394405120:12345-10.240.43.64@tcp:101:ll_agl_410261.0 Request processed in 38us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.378115:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 208525 00000100:00100000:1.0:1651529333.378121:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208527 00000100:00100000:1.0:1651529333.378122:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1083:39030:x1731745946290368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.378127:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176830 count 1 00010000:00010000:1.0:1651529333.378130:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a25596b/0x3234de053c4c211 lrc: 3/0,1 mode: --/PW res: [0x2b2be:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.378135:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c007d871/0x3234de053c46615 lrc: 2/0,0 mode: PR/PR res: [0x2b2be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae05b expref: 331 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.378138:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.378139:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.378139:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a25596b/0x3234de053c4c211 lrc: 4/0,1 mode: --/PW res: [0x2b2be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.378146:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c007d871/0x3234de053c46615 lrc: 3/0,0 mode: PR/PR res: [0x2b2be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae05b expref: 331 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.378149:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c007d871/0x3234de053c46615 lrc: 4/0,0 mode: PR/PR res: [0x2b2be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae05b expref: 331 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.378154:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006026725b pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996931008:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.378162:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 0000000053a0cffa going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.378168:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208529 00000100:00100000:1.0:1651529333.378170:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1083:39030:x1731745946290496:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.378174:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176832 count 1 00010000:00010000:1.0:1651529333.378177:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b6e58d6/0x3234de053c4c21f lrc: 3/0,1 mode: --/PW res: [0x2b2c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.378182:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006ae8b3fa/0x3234de053c45d63 lrc: 2/0,0 mode: PR/PR res: [0x2b2c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abc19 expref: 331 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.378185:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.378185:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.378186:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b6e58d6/0x3234de053c4c21f lrc: 4/0,1 mode: --/PW res: [0x2b2c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.378194:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006ae8b3fa/0x3234de053c45d63 lrc: 3/0,0 mode: PR/PR res: [0x2b2c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abc19 expref: 331 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.378198:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006ae8b3fa/0x3234de053c45d63 lrc: 4/0,0 mode: PR/PR res: [0x2b2c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abc19 expref: 331 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.378202:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ac8dec6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996931136:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.378208:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 000000007d8fabda going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.378214:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208531 00000100:00100000:1.0:1651529333.378216:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1083:39029:x1731745946290560:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.378220:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176833 count 1 00010000:00010000:1.0:1651529333.378236:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c03f4dd/0x3234de053c4c22d lrc: 3/0,1 mode: --/PW res: [0x2b2c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.378246:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007b665cba/0x3234de053c44acb lrc: 2/0,0 mode: PR/PR res: [0x2b2c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7276 expref: 331 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.378249:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.378250:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.378251:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c03f4dd/0x3234de053c4c22d lrc: 4/0,1 mode: --/PW res: [0x2b2c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.378257:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007b665cba/0x3234de053c44acb lrc: 3/0,0 mode: PR/PR res: [0x2b2c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7276 expref: 331 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.378260:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007b665cba/0x3234de053c44acb lrc: 4/0,0 mode: PR/PR res: [0x2b2c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7276 expref: 331 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.378265:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fc130417 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996931264:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.378272:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd96f074 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.378423:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.378548:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.378555:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946290688 00000100:00100000:1.0:1651529333.378566:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208533 00000100:00100000:1.0:1651529333.378567:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1085:39029:x1731745946290688:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.378572:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176835 count 1 00010000:00010000:1.0:1651529333.378577:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4c23b lrc: 3/0,1 mode: --/PW res: [0x2b2c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.378581:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000013b4168/0x3234de053c468d1 lrc: 2/0,0 mode: PR/PR res: [0x2b2c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aeb1a expref: 331 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.378584:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.378585:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.378586:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4c23b lrc: 4/0,1 mode: --/PW res: [0x2b2c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.378592:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000013b4168/0x3234de053c468d1 lrc: 3/0,0 mode: PR/PR res: [0x2b2c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aeb1a expref: 331 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.378595:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000013b4168/0x3234de053c468d1 lrc: 4/0,0 mode: PR/PR res: [0x2b2c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aeb1a expref: 331 pid: 80277 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.378599:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c43262d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996931392:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.378610:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 0000000018ebe812 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.378768:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.378775:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.378785:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.378791:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.378798:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.378816:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006026725b pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996931008:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.378821:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007a25596b/0x3234de053c4c211 lrc: 3/0,1 mode: --/PW res: [0x2b2be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.378828:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ac8dec6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996931136:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.378831:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004b6e58d6/0x3234de053c4c21f lrc: 3/0,1 mode: --/PW res: [0x2b2c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.378837:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394405504 00010000:00010000:1.0:1651529333.378842:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000019aa9ad0/0x3234de053c4382c lrc: 4/0,0 mode: PR/PR res: [0x2b2bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2672 expref: 336 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.378848:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11163 00000100:00100000:1.0:1651529333.378849:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+336:41278:x1731746394405440:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.378852:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.378854:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cab2bcca/0x3234de053c44e4b lrc: 4/0,0 mode: PR/PR res: [0x2b2bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7f03 expref: 336 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.378857:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cab2bcca/0x3234de053c44e4b lrc: 3/0,0 mode: PR/PR res: [0x2b2bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7f03 expref: 336 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.378865:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cab2bcca/0x3234de053c44e4b lrc: 0/0,0 mode: --/PR res: [0x2b2bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7f03 expref: 336 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.378869:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.378870:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.378871:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000705cc353/0x3234de053c4c218 lrc: 3/0,1 mode: PW/PW res: [0x2b2bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.378874:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000705cc353/0x3234de053c4c218 lrc: 4/0,1 mode: PW/PW res: [0x2b2bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.378895:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.378904:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+334:41278:x1731746394405440:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 54us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.378907:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11163 00000100:00100000:1.0:1651529333.378912:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11164 00000100:00100000:1.0:1651529333.378914:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+333:41278:x1731746394405568:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.378916:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.378918:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006ae8b3fa/0x3234de053c45d63 lrc: 4/0,0 mode: PR/PR res: [0x2b2c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abc19 expref: 333 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.378921:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006ae8b3fa/0x3234de053c45d63 lrc: 3/0,0 mode: PR/PR res: [0x2b2c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abc19 expref: 333 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.378926:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ae8b3fa/0x3234de053c45d63 lrc: 0/0,0 mode: --/PR res: [0x2b2c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abc19 expref: 333 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.378932:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.378933:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.378934:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004b6e58d6/0x3234de053c4c21f lrc: 3/0,1 mode: PW/PW res: [0x2b2c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.378936:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b6e58d6/0x3234de053c4c21f lrc: 4/0,1 mode: PW/PW res: [0x2b2c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.378942:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.378947:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+331:41278:x1731746394405568:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 33us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.378950:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11164 00000100:00100000:1.0:1651529333.378954:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11166 00000100:00100000:1.0:1651529333.378955:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+329:41278:x1731746394405504:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.378957:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.378959:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000019aa9ad0/0x3234de053c4382c lrc: 4/0,0 mode: PR/PR res: [0x2b2bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2672 expref: 329 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.378969:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000019aa9ad0/0x3234de053c4382c lrc: 3/0,0 mode: PR/PR res: [0x2b2bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2672 expref: 329 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.378974:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019aa9ad0/0x3234de053c4382c lrc: 0/0,0 mode: --/PR res: [0x2b2bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2672 expref: 328 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.378978:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.378978:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.378979:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001722859c/0x3234de053c4c226 lrc: 3/0,1 mode: PW/PW res: [0x2b2bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.378982:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001722859c/0x3234de053c4c226 lrc: 4/0,1 mode: PW/PW res: [0x2b2bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.378990:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.378996:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+327:41278:x1731746394405504:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 40us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.378998:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11166 00000100:00100000:1.0:1651529333.379014:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fc130417 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996931264:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.379018:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002c03f4dd/0x3234de053c4c22d lrc: 3/0,1 mode: --/PW res: [0x2b2c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.379024:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000705cc353/0x3234de053c4c218 lrc: 2/0,0 mode: PW/PW res: [0x2b2bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.379027:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000705cc353 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.379028:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000705cc353/0x3234de053c4c218 lrc: 2/0,0 mode: PW/PW res: [0x2b2bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.379031:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000705cc353/0x3234de053c4c218 lrc: 3/0,0 mode: PW/PW res: [0x2b2bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.379035:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000705cc353/0x3234de053c4c218 lrc: 1/0,0 mode: --/PW res: [0x2b2bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.379040:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000705cc353/0x3234de053c4c218 lrc: 0/0,0 mode: --/PW res: [0x2b2bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.379045:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004b6e58d6/0x3234de053c4c21f lrc: 3/0,1 mode: PW/PW res: [0x2b2c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.379048:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b6e58d6/0x3234de053c4c21f lrc: 3/0,1 mode: PW/PW res: [0x2b2c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.379051:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b6e58d6/0x3234de053c4c21f lrc: 3/0,1 mode: PW/PW res: [0x2b2c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.379054:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b6e58d6/0x3234de053c4c21f lrc: 2/0,0 mode: PW/PW res: [0x2b2c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.379100:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1087:39030:x1731745946290496:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 929us (1095us total) trans 12885078436 rc 0/0 00000100:00100000:1.0:1651529333.379103:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208529 00010000:00010000:1.0:1651529333.379110:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007a25596b/0x3234de053c4c211 lrc: 3/0,1 mode: PW/PW res: [0x2b2be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.379114:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a25596b/0x3234de053c4c211 lrc: 3/0,1 mode: PW/PW res: [0x2b2be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.379117:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a25596b/0x3234de053c4c211 lrc: 3/0,1 mode: PW/PW res: [0x2b2be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.379122:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a25596b/0x3234de053c4c211 lrc: 2/0,0 mode: PW/PW res: [0x2b2be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.379154:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1086:39030:x1731745946290368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1031us (1183us total) trans 12885078438 rc 0/0 00000100:00100000:1.0:1651529333.379157:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208527 00000100:00100000:1.0:1651529333.379183:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.379194:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.379247:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.379331:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394405696 00010000:00010000:1.0:1651529333.379337:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c601ef5c/0x3234de053c4445e lrc: 4/0,0 mode: PR/PR res: [0x2b2c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a581a expref: 327 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.379347:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394405632 00010000:00010000:1.0:1651529333.379350:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007b665cba/0x3234de053c44acb lrc: 4/0,0 mode: PR/PR res: [0x2b2c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7276 expref: 328 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.379355:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11167 00000100:00100000:1.0:1651529333.379357:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+329:41278:x1731746394405696:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.379360:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.379361:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c601ef5c/0x3234de053c4445e lrc: 4/0,0 mode: PR/PR res: [0x2b2c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a581a expref: 329 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.379365:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c601ef5c/0x3234de053c4445e lrc: 3/0,0 mode: PR/PR res: [0x2b2c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a581a expref: 329 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.379373:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c601ef5c/0x3234de053c4445e lrc: 0/0,0 mode: --/PR res: [0x2b2c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a581a expref: 329 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.379377:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.379378:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.379379:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c83c6fc1/0x3234de053c4c234 lrc: 3/0,1 mode: PW/PW res: [0x2b2c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.379382:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c83c6fc1/0x3234de053c4c234 lrc: 4/0,1 mode: PW/PW res: [0x2b2c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.379390:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.379400:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+328:41278:x1731746394405696:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.379402:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11167 00000100:00100000:1.0:1651529333.379407:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11169 00000100:00100000:1.0:1651529333.379409:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+326:41278:x1731746394405760:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529333.379411:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.379413:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000013b4168/0x3234de053c468d1 lrc: 5/0,0 mode: PR/PR res: [0x2b2c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aeb1a expref: 326 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.379423:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000013b4168/0x3234de053c468d1 lrc: 4/0,0 mode: PR/PR res: [0x2b2c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aeb1a expref: 326 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.379428:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.379429:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.379430:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4c23b lrc: 3/0,1 mode: PW/PW res: [0x2b2c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.379433:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4c23b lrc: 4/0,1 mode: PW/PW res: [0x2b2c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.379437:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.379443:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+325:41278:x1731746394405760:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.379445:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11169 00010000:00010000:1.0:1651529333.379452:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002c03f4dd/0x3234de053c4c22d lrc: 3/0,1 mode: PW/PW res: [0x2b2c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.379456:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c03f4dd/0x3234de053c4c22d lrc: 3/0,1 mode: PW/PW res: [0x2b2c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.379459:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c03f4dd/0x3234de053c4c22d lrc: 3/0,1 mode: PW/PW res: [0x2b2c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.379461:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c03f4dd/0x3234de053c4c22d lrc: 2/0,0 mode: PW/PW res: [0x2b2c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.379504:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1087:39029:x1731745946290560:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1287us (1475us total) trans 12885078441 rc 0/0 00000100:00100000:1.0:1651529333.379507:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208531 00010000:00010000:1.0:1651529333.379514:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0c4b95b/0x3234de053c4c20a lrc: 2/0,0 mode: PW/PW res: [0x2b2bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.379517:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c0c4b95b already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.379518:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0c4b95b/0x3234de053c4c20a lrc: 2/0,0 mode: PW/PW res: [0x2b2bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.379521:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0c4b95b/0x3234de053c4c20a lrc: 3/0,0 mode: PW/PW res: [0x2b2bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.379526:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0c4b95b/0x3234de053c4c20a lrc: 1/0,0 mode: --/PW res: [0x2b2bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.379528:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0c4b95b/0x3234de053c4c20a lrc: 0/0,0 mode: --/PW res: [0x2b2bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.379534:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c03f4dd/0x3234de053c4c22d lrc: 2/0,0 mode: PW/PW res: [0x2b2c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.379537:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002c03f4dd already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.379537:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c03f4dd/0x3234de053c4c22d lrc: 2/0,0 mode: PW/PW res: [0x2b2c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.379540:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c03f4dd/0x3234de053c4c22d lrc: 3/0,0 mode: PW/PW res: [0x2b2c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.379543:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c03f4dd/0x3234de053c4c22d lrc: 1/0,0 mode: --/PW res: [0x2b2c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.379546:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c03f4dd/0x3234de053c4c22d lrc: 0/0,0 mode: --/PW res: [0x2b2c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.379555:0:80276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000013b4168/0x3234de053c468d1 lrc: 0/0,0 mode: --/PR res: [0x2b2c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aeb1a expref: 324 pid: 80277 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.379559:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c43262d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996931392:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.379562:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4c23b lrc: 3/0,1 mode: PW/PW res: [0x2b2c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.379565:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4c23b lrc: 3/0,1 mode: PW/PW res: [0x2b2c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.379568:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4c23b lrc: 3/0,1 mode: PW/PW res: [0x2b2c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.379571:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4c23b lrc: 3/0,1 mode: PW/PW res: [0x2b2c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.379574:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4c23b lrc: 2/0,0 mode: PW/PW res: [0x2b2c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.379616:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1086:39029:x1731745946290688:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1048us (1068us total) trans 12885078442 rc 0/0 00000100:00100000:1.0:1651529333.379619:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208533 00000100:00100000:1.0:1651529333.379689:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.379717:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.379754:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.379778:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.379785:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.379795:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.379804:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946290880 00000100:00100000:1.0:1651529333.379812:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946290944 00000100:00100000:1.0:1651529333.379815:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946291008 00000100:00100000:1.0:1651529333.379819:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208535 00000100:00100000:1.0:1651529333.379820:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1090:39029:x1731745946290752:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.379826:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176836 count 1 00010000:00010000:1.0:1651529333.379836:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000656a2f5f/0x3234de053c4c249 lrc: 3/0,1 mode: --/PW res: [0x2b2c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.379842:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004e049160/0x3234de053c448cc lrc: 2/0,0 mode: PR/PR res: [0x2b2c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6a0a expref: 324 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.379845:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.379845:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.379846:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000656a2f5f/0x3234de053c4c249 lrc: 4/0,1 mode: --/PW res: [0x2b2c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.379861:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004e049160/0x3234de053c448cc lrc: 3/0,0 mode: PR/PR res: [0x2b2c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6a0a expref: 324 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.379865:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004e049160/0x3234de053c448cc lrc: 4/0,0 mode: PR/PR res: [0x2b2c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6a0a expref: 324 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.379869:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006026725b pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996931520:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.379878:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000053a0cffa going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.379885:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208537 00000100:00100000:1.0:1651529333.379887:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1090:39030:x1731745946290880:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.379891:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176838 count 1 00010000:00010000:1.0:1651529333.379895:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf272247/0x3234de053c4c257 lrc: 3/0,1 mode: --/PW res: [0x2b2c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.379899:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000038e42ddb/0x3234de053c46ab4 lrc: 2/0,0 mode: PR/PR res: [0x2b2c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af39b expref: 325 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.379902:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.379903:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.379903:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf272247/0x3234de053c4c257 lrc: 4/0,1 mode: --/PW res: [0x2b2c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.379909:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000038e42ddb/0x3234de053c46ab4 lrc: 3/0,0 mode: PR/PR res: [0x2b2c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af39b expref: 325 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.379913:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000038e42ddb/0x3234de053c46ab4 lrc: 4/0,0 mode: PR/PR res: [0x2b2c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af39b expref: 325 pid: 80277 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.379917:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006731397d pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996931584:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.379923:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fb6c773d going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.379928:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208538 00000100:00100000:1.0:1651529333.379930:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1090:39029:x1731745946290944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.379934:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176839 count 1 00010000:00010000:1.0:1651529333.379937:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f87a625c/0x3234de053c4c25e lrc: 3/0,1 mode: --/PW res: [0x2b2c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.379941:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c44afc lrc: 2/0,0 mode: PR/PR res: [0x2b2c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a731e expref: 324 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.379947:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.379947:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.379948:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f87a625c/0x3234de053c4c25e lrc: 4/0,1 mode: --/PW res: [0x2b2c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.379953:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c44afc lrc: 3/0,0 mode: PR/PR res: [0x2b2c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a731e expref: 324 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.379956:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c44afc lrc: 4/0,0 mode: PR/PR res: [0x2b2c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a731e expref: 324 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.379960:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae466fbb pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996931648:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.379966:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aeda71fe going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.379980:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.379994:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.380003:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.380083:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208542 00000100:00100000:1.0:1651529333.380085:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1093:39029:x1731745946291200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.380091:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176843 count 1 00010000:00010000:1.0:1651529333.380095:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c9c0f07/0x3234de053c4c27a lrc: 3/0,1 mode: --/PW res: [0x2b2cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.380106:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000905f0208/0x3234de053c45f8c lrc: 2/0,0 mode: PR/PR res: [0x2b2cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac4ee expref: 324 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.380109:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.380110:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.380110:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c9c0f07/0x3234de053c4c27a lrc: 4/0,1 mode: --/PW res: [0x2b2cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.380118:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000905f0208/0x3234de053c45f8c lrc: 3/0,0 mode: PR/PR res: [0x2b2cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac4ee expref: 324 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.380121:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000905f0208/0x3234de053c45f8c lrc: 4/0,0 mode: PR/PR res: [0x2b2cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac4ee expref: 324 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.380125:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000edfe60d3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996931904:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.380133:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d09f5ee1 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.380487:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.380494:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.380501:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.380510:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006026725b pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996931520:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.380515:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000656a2f5f/0x3234de053c4c249 lrc: 3/0,1 mode: --/PW res: [0x2b2c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.380522:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006731397d pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996931584:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.380524:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bf272247/0x3234de053c4c257 lrc: 3/0,1 mode: --/PW res: [0x2b2c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.380530:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae466fbb pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996931648:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.380532:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f87a625c/0x3234de053c4c25e lrc: 3/0,1 mode: --/PW res: [0x2b2c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.380541:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394406208 00010000:00010000:1.0:1651529333.380545:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c2613351/0x3234de053c44ebb lrc: 4/0,0 mode: PR/PR res: [0x2b2c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a80bc expref: 325 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.380555:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394406336 00010000:00010000:1.0:1651529333.380558:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000038e42ddb/0x3234de053c46ab4 lrc: 4/0,0 mode: PR/PR res: [0x2b2c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af39b expref: 326 pid: 80277 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.380563:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11170 00000100:00100000:1.0:1651529333.380565:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+327:41278:x1731746394406208:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.380568:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.380569:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c2613351/0x3234de053c44ebb lrc: 4/0,0 mode: PR/PR res: [0x2b2c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a80bc expref: 327 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.380573:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c2613351/0x3234de053c44ebb lrc: 3/0,0 mode: PR/PR res: [0x2b2c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a80bc expref: 327 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.380578:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2613351/0x3234de053c44ebb lrc: 0/0,0 mode: --/PR res: [0x2b2c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a80bc expref: 327 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.380582:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.380582:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.380583:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002099d3d5/0x3234de053c4c242 lrc: 3/0,1 mode: PW/PW res: [0x2b2c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.380586:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002099d3d5/0x3234de053c4c242 lrc: 4/0,1 mode: PW/PW res: [0x2b2c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.380595:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.380604:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+325:41278:x1731746394406208:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 39us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.380607:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11170 00000100:00100000:1.0:1651529333.380618:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11172 00000100:00100000:1.0:1651529333.380620:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+324:41278:x1731746394406464:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.380623:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.380625:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c44afc lrc: 4/0,0 mode: PR/PR res: [0x2b2c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a731e expref: 324 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.380628:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c44afc lrc: 3/0,0 mode: PR/PR res: [0x2b2c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a731e expref: 323 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.380633:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c44afc lrc: 0/0,0 mode: --/PR res: [0x2b2c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a731e expref: 323 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.380636:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.380637:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.380638:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f87a625c/0x3234de053c4c25e lrc: 3/0,1 mode: PW/PW res: [0x2b2c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.380641:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f87a625c/0x3234de053c4c25e lrc: 4/0,1 mode: PW/PW res: [0x2b2c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.380646:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.380657:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+322:41278:x1731746394406464:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 37us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.380660:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11172 00010000:00010000:1.0:1651529333.380668:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bf272247/0x3234de053c4c257 lrc: 3/0,1 mode: PW/PW res: [0x2b2c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.380679:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf272247/0x3234de053c4c257 lrc: 3/0,1 mode: PW/PW res: [0x2b2c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.380682:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf272247/0x3234de053c4c257 lrc: 3/0,1 mode: PW/PW res: [0x2b2c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.380685:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf272247/0x3234de053c4c257 lrc: 2/0,0 mode: PW/PW res: [0x2b2c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.380726:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1094:39030:x1731745946290880:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 839us (948us total) trans 12885078444 rc 0/0 00000100:00100000:1.0:1651529333.380741:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208537 00010000:00010000:1.0:1651529333.380749:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf272247/0x3234de053c4c257 lrc: 2/0,0 mode: PW/PW res: [0x2b2c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.380752:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bf272247 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.380753:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf272247/0x3234de053c4c257 lrc: 2/0,0 mode: PW/PW res: [0x2b2c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.380756:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf272247/0x3234de053c4c257 lrc: 3/0,0 mode: PW/PW res: [0x2b2c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.380761:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf272247/0x3234de053c4c257 lrc: 1/0,0 mode: --/PW res: [0x2b2c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.380764:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf272247/0x3234de053c4c257 lrc: 0/0,0 mode: --/PW res: [0x2b2c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.380771:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f87a625c/0x3234de053c4c25e lrc: 3/0,1 mode: PW/PW res: [0x2b2c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.380773:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f87a625c/0x3234de053c4c25e lrc: 3/0,1 mode: PW/PW res: [0x2b2c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.380777:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f87a625c/0x3234de053c4c25e lrc: 3/0,1 mode: PW/PW res: [0x2b2c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.380779:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f87a625c/0x3234de053c4c25e lrc: 2/0,0 mode: PW/PW res: [0x2b2c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.380818:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1094:39029:x1731745946290944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 888us (1033us total) trans 12885078445 rc 0/0 00000100:00100000:1.0:1651529333.380821:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208538 00000100:00100000:1.0:1651529333.380836:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.380849:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.380860:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.380906:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.380934:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.380943:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.380949:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394406656 00010000:00010000:1.0:1651529333.380955:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000905f0208/0x3234de053c45f8c lrc: 5/0,0 mode: PR/PR res: [0x2b2cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac4ee expref: 326 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.380962:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11174 00000100:00100000:1.0:1651529333.380963:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+326:41279:x1731746394406400:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529333.380966:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.380968:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a73cb925/0x3234de053c4593b lrc: 4/0,0 mode: PR/PR res: [0x2b2c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aac60 expref: 325 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.380971:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a73cb925/0x3234de053c4593b lrc: 3/0,0 mode: PR/PR res: [0x2b2c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aac60 expref: 325 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.380984:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a73cb925/0x3234de053c4593b lrc: 0/0,0 mode: --/PR res: [0x2b2c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aac60 expref: 325 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.380992:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.380993:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.380994:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c4c265 lrc: 3/0,1 mode: PW/PW res: [0x2b2c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.380997:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c4c265 lrc: 4/0,1 mode: PW/PW res: [0x2b2c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.381007:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.381014:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+323:41279:x1731746394406400:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 50us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.381017:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11174 00000100:00100000:1.0:1651529333.381022:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11176 00000100:00100000:1.0:1651529333.381024:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+322:41278:x1731746394406592:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529333.381026:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.381027:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005a5881ba/0x3234de053c451cb lrc: 4/0,0 mode: PR/PR res: [0x2b2ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8ccb expref: 321 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.381031:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005a5881ba/0x3234de053c451cb lrc: 3/0,0 mode: PR/PR res: [0x2b2ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8ccb expref: 321 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.381037:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a5881ba/0x3234de053c451cb lrc: 0/0,0 mode: --/PR res: [0x2b2ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8ccb expref: 321 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.381040:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.381041:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.381042:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a1db1946/0x3234de053c4c273 lrc: 3/0,1 mode: PW/PW res: [0x2b2ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.381045:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1db1946/0x3234de053c4c273 lrc: 4/0,1 mode: PW/PW res: [0x2b2ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.381053:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.381059:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+319:41278:x1731746394406592:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.381061:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11176 00000100:00100000:1.0:1651529333.381072:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000edfe60d3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996931904:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.381076:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006c9c0f07/0x3234de053c4c27a lrc: 3/0,1 mode: --/PW res: [0x2b2cb:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.381087:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006c9c0f07/0x3234de053c4c27a lrc: 3/0,1 mode: PW/PW res: [0x2b2cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.381090:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c9c0f07/0x3234de053c4c27a lrc: 3/0,1 mode: PW/PW res: [0x2b2cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.381093:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c9c0f07/0x3234de053c4c27a lrc: 3/0,1 mode: PW/PW res: [0x2b2cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.381096:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c9c0f07/0x3234de053c4c27a lrc: 2/0,0 mode: PW/PW res: [0x2b2cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.381136:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1094:39029:x1731745946291200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1050us (1132us total) trans 12885078446 rc 0/0 00000100:00100000:1.0:1651529333.381139:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208542 00000100:00100000:1.0:1651529333.381151:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394406720 00000100:00100000:1.0:1651529333.381157:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 208543 00000100:00100000:1.0:1651529333.381159:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+317:41278:x1731746394406720:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529333.381162:0:80276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529333.381166:0:80276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c57bbfeb/0x3234de053c4c281 lrc: 2/0,0 mode: --/PR res: [0x2b42e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2cc89b expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529333.381171:0:80276:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b42e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529333.381175:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.381176:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.381177:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c57bbfeb/0x3234de053c4c281 lrc: 3/0,0 mode: PR/PR res: [0x2b42e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc89b expref: 318 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.381182:0:80276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c57bbfeb/0x3234de053c4c281 lrc: 3/0,0 mode: PR/PR res: [0x2b42e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc89b expref: 318 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.381186:0:80276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c57bbfeb, rc 0) 00000100:00100000:1.0:1651529333.381192:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+318:41278:x1731746394406720:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 33us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.381195:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 208543 00010000:00010000:1.0:1651529333.381202:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000656a2f5f/0x3234de053c4c249 lrc: 3/0,1 mode: PW/PW res: [0x2b2c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.381205:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000656a2f5f/0x3234de053c4c249 lrc: 3/0,1 mode: PW/PW res: [0x2b2c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.381208:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000656a2f5f/0x3234de053c4c249 lrc: 3/0,1 mode: PW/PW res: [0x2b2c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.381211:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000656a2f5f/0x3234de053c4c249 lrc: 2/0,0 mode: PW/PW res: [0x2b2c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.381263:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1094:39029:x1731745946290752:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1442us (1546us total) trans 12885078449 rc 0/0 00000100:00100000:1.0:1651529333.381266:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208535 00010000:00010000:1.0:1651529333.381286:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c9c0f07/0x3234de053c4c27a lrc: 2/0,0 mode: PW/PW res: [0x2b2cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.381289:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006c9c0f07 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.381290:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c9c0f07/0x3234de053c4c27a lrc: 2/0,0 mode: PW/PW res: [0x2b2cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.381293:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c9c0f07/0x3234de053c4c27a lrc: 3/0,0 mode: PW/PW res: [0x2b2cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.381298:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c9c0f07/0x3234de053c4c27a lrc: 1/0,0 mode: --/PW res: [0x2b2cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.381301:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c9c0f07/0x3234de053c4c27a lrc: 0/0,0 mode: --/PW res: [0x2b2cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.381305:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c4c265 lrc: 2/0,0 mode: PW/PW res: [0x2b2c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.381308:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000677ce99b already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.381309:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c4c265 lrc: 2/0,0 mode: PW/PW res: [0x2b2c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.381311:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c4c265 lrc: 3/0,0 mode: PW/PW res: [0x2b2c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.381314:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c4c265 lrc: 1/0,0 mode: --/PW res: [0x2b2c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.381317:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c4c265 lrc: 0/0,0 mode: --/PW res: [0x2b2c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.381320:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f21c5d6c/0x3234de053c4c26c lrc: 2/0,0 mode: PW/PW res: [0x2b2c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.381323:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f21c5d6c already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.381324:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f21c5d6c/0x3234de053c4c26c lrc: 2/0,0 mode: PW/PW res: [0x2b2c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.381327:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f21c5d6c/0x3234de053c4c26c lrc: 3/0,0 mode: PW/PW res: [0x2b2c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.381330:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f21c5d6c/0x3234de053c4c26c lrc: 1/0,0 mode: --/PW res: [0x2b2c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.381332:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f21c5d6c/0x3234de053c4c26c lrc: 0/0,0 mode: --/PW res: [0x2b2c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.381336:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a1db1946/0x3234de053c4c273 lrc: 2/0,0 mode: PW/PW res: [0x2b2ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.381338:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a1db1946 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.381339:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1db1946/0x3234de053c4c273 lrc: 2/0,0 mode: PW/PW res: [0x2b2ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.381342:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1db1946/0x3234de053c4c273 lrc: 3/0,0 mode: PW/PW res: [0x2b2ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.381345:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a1db1946/0x3234de053c4c273 lrc: 1/0,0 mode: --/PW res: [0x2b2ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.381347:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1db1946/0x3234de053c4c273 lrc: 0/0,0 mode: --/PW res: [0x2b2ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.381384:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.381398:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.381409:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.381523:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208546 00000100:00100000:1.0:1651529333.381525:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1096:39029:x1731745946291392:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.381531:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176846 count 1 00010000:00010000:1.0:1651529333.381535:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c0d3581/0x3234de053c4c296 lrc: 3/0,1 mode: --/PW res: [0x2b2ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.381540:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000cd0c9be/0x3234de053c447ec lrc: 2/0,0 mode: PR/PR res: [0x2b2ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a66d7 expref: 317 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.381543:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.381544:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.381545:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c0d3581/0x3234de053c4c296 lrc: 4/0,1 mode: --/PW res: [0x2b2ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.381558:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000cd0c9be/0x3234de053c447ec lrc: 3/0,0 mode: PR/PR res: [0x2b2ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a66d7 expref: 317 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.381562:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000cd0c9be/0x3234de053c447ec lrc: 4/0,0 mode: PR/PR res: [0x2b2ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a66d7 expref: 317 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.381566:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996932096:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.381576:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d09f5ee1 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.381591:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.381631:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.381639:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.381646:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946291456 00000100:00100000:1.0:1651529333.381656:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946291520 00000100:00100000:1.0:1651529333.381662:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208547 00000100:00100000:1.0:1651529333.381664:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1098:39029:x1731745946291456:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.381669:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176847 count 1 00010000:00010000:1.0:1651529333.381673:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fd513db/0x3234de053c4c29d lrc: 3/0,1 mode: --/PW res: [0x2b2cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.381678:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d90961be/0x3234de053c45a68 lrc: 2/0,0 mode: PR/PR res: [0x2b2cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab00a expref: 317 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.381681:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.381681:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.381682:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fd513db/0x3234de053c4c29d lrc: 4/0,1 mode: --/PW res: [0x2b2cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.381703:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d90961be/0x3234de053c45a68 lrc: 3/0,0 mode: PR/PR res: [0x2b2cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab00a expref: 317 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.381706:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d90961be/0x3234de053c45a68 lrc: 4/0,0 mode: PR/PR res: [0x2b2cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab00a expref: 317 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.381710:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ef7d105 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996932160:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.381719:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000053a0cffa going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.381726:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208549 00000100:00100000:1.0:1651529333.381727:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1099:39029:x1731745946291584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.381742:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176849 count 1 00010000:00010000:1.0:1651529333.381746:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002537ce87/0x3234de053c4c2ab lrc: 3/0,1 mode: --/PW res: [0x2b2d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.381750:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006c1791d6/0x3234de053c43d26 lrc: 2/0,0 mode: PR/PR res: [0x2b2d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3a1b expref: 317 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.381753:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.381754:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.381755:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002537ce87/0x3234de053c4c2ab lrc: 4/0,1 mode: --/PW res: [0x2b2d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.381761:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006c1791d6/0x3234de053c43d26 lrc: 3/0,0 mode: PR/PR res: [0x2b2d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3a1b expref: 317 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.381764:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006c1791d6/0x3234de053c43d26 lrc: 4/0,0 mode: PR/PR res: [0x2b2d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3a1b expref: 317 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.381768:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a4b486d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996932288:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.381776:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fe434b1c going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.381790:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.381827:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946291648 00000100:00100000:1.0:1651529333.381848:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208550 00000100:00100000:1.0:1651529333.381850:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1100:39029:x1731745946291648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.381854:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176850 count 1 00010000:00010000:1.0:1651529333.381859:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003324f656/0x3234de053c4c2b2 lrc: 3/0,1 mode: --/PW res: [0x2b2d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.381866:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003e829f12/0x3234de053c446cd lrc: 2/0,0 mode: PR/PR res: [0x2b2d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a61f9 expref: 317 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.381869:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.381869:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.381870:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003324f656/0x3234de053c4c2b2 lrc: 4/0,1 mode: --/PW res: [0x2b2d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.381877:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003e829f12/0x3234de053c446cd lrc: 3/0,0 mode: PR/PR res: [0x2b2d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a61f9 expref: 317 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.381880:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003e829f12/0x3234de053c446cd lrc: 4/0,0 mode: PR/PR res: [0x2b2d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a61f9 expref: 317 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.381884:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f2582a33 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996932352:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.381892:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 0000000018ebe812 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.381904:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.381947:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.381962:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394407104 00010000:00010000:1.0:1651529333.381968:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c44791 lrc: 4/0,0 mode: PR/PR res: [0x2b2cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6580 expref: 318 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.381978:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11178 00000100:00100000:1.0:1651529333.381980:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+318:41278:x1731746394407104:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.381982:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.381984:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c44791 lrc: 4/0,0 mode: PR/PR res: [0x2b2cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6580 expref: 318 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.381988:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c44791 lrc: 3/0,0 mode: PR/PR res: [0x2b2cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6580 expref: 318 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.381999:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c44791 lrc: 0/0,0 mode: --/PR res: [0x2b2cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6580 expref: 318 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.382003:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.382003:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.382004:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000092b1d4a6/0x3234de053c4c288 lrc: 3/0,1 mode: PW/PW res: [0x2b2cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.382007:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092b1d4a6/0x3234de053c4c288 lrc: 4/0,1 mode: PW/PW res: [0x2b2cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.382016:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.382023:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+317:41278:x1731746394407104:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 43us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.382026:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11178 00000100:00100000:1.0:1651529333.382036:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996932096:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.382040:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006c0d3581/0x3234de053c4c296 lrc: 3/0,1 mode: --/PW res: [0x2b2ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.382052:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.382077:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.382117:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394407232 00010000:00010000:1.0:1651529333.382123:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000cd0c9be/0x3234de053c447ec lrc: 4/0,0 mode: PR/PR res: [0x2b2ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a66d7 expref: 317 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.382129:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394407168 00010000:00010000:1.0:1651529333.382132:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a5fe7e98/0x3234de053c45d16 lrc: 4/0,0 mode: PR/PR res: [0x2b2cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abb40 expref: 318 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.382136:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11179 00000100:00100000:1.0:1651529333.382138:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+318:41278:x1731746394407232:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.382141:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.382142:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000cd0c9be/0x3234de053c447ec lrc: 4/0,0 mode: PR/PR res: [0x2b2ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a66d7 expref: 318 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.382146:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000cd0c9be/0x3234de053c447ec lrc: 3/0,0 mode: PR/PR res: [0x2b2ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a66d7 expref: 318 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.382151:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000cd0c9be/0x3234de053c447ec lrc: 0/0,0 mode: --/PR res: [0x2b2ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a66d7 expref: 318 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.382154:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.382155:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.382156:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006c0d3581/0x3234de053c4c296 lrc: 3/0,1 mode: PW/PW res: [0x2b2ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.382159:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c0d3581/0x3234de053c4c296 lrc: 4/0,1 mode: PW/PW res: [0x2b2ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.382165:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.382172:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+316:41278:x1731746394407232:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 33us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.382174:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11179 00010000:00010000:1.0:1651529333.382181:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006c0d3581/0x3234de053c4c296 lrc: 3/0,1 mode: PW/PW res: [0x2b2ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.382184:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c0d3581/0x3234de053c4c296 lrc: 3/0,1 mode: PW/PW res: [0x2b2ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.382187:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c0d3581/0x3234de053c4c296 lrc: 3/0,1 mode: PW/PW res: [0x2b2ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.382190:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c0d3581/0x3234de053c4c296 lrc: 2/0,0 mode: PW/PW res: [0x2b2ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.382254:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1102:39029:x1731745946291392:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 728us (845us total) trans 12885078452 rc 0/0 00000100:00100000:1.0:1651529333.382257:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208546 00010000:00010000:1.0:1651529333.382264:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c0d3581/0x3234de053c4c296 lrc: 2/0,0 mode: PW/PW res: [0x2b2ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.382267:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006c0d3581 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.382268:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c0d3581/0x3234de053c4c296 lrc: 2/0,0 mode: PW/PW res: [0x2b2ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.382271:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c0d3581/0x3234de053c4c296 lrc: 3/0,0 mode: PW/PW res: [0x2b2ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.382276:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c0d3581/0x3234de053c4c296 lrc: 1/0,0 mode: --/PW res: [0x2b2ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.382279:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c0d3581/0x3234de053c4c296 lrc: 0/0,0 mode: --/PW res: [0x2b2ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.382283:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091b8a26b/0x3234de053c4c28f lrc: 2/0,0 mode: PW/PW res: [0x2b2cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.382286:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000091b8a26b already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.382286:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091b8a26b/0x3234de053c4c28f lrc: 2/0,0 mode: PW/PW res: [0x2b2cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.382289:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091b8a26b/0x3234de053c4c28f lrc: 3/0,0 mode: PW/PW res: [0x2b2cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.382293:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091b8a26b/0x3234de053c4c28f lrc: 1/0,0 mode: --/PW res: [0x2b2cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.382295:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091b8a26b/0x3234de053c4c28f lrc: 0/0,0 mode: --/PW res: [0x2b2cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.382381:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.382410:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.382420:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.382427:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.382443:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ef7d105 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996932160:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.382447:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003fd513db/0x3234de053c4c29d lrc: 3/0,1 mode: --/PW res: [0x2b2cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.382457:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a4b486d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996932288:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.382460:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002537ce87/0x3234de053c4c2ab lrc: 3/0,1 mode: --/PW res: [0x2b2d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.382465:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f2582a33 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996932352:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.382468:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003324f656/0x3234de053c4c2b2 lrc: 3/0,1 mode: --/PW res: [0x2b2d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.382474:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11182 00000100:00100000:1.0:1651529333.382476:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a37852a8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+318:41278:x1731746394407488:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.382480:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.382481:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003e829f12/0x3234de053c446cd lrc: 4/0,0 mode: PR/PR res: [0x2b2d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a61f9 expref: 318 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.382485:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003e829f12/0x3234de053c446cd lrc: 3/0,0 mode: PR/PR res: [0x2b2d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a61f9 expref: 318 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.382492:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e829f12/0x3234de053c446cd lrc: 0/0,0 mode: --/PR res: [0x2b2d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a61f9 expref: 318 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.382495:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.382496:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.382497:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003324f656/0x3234de053c4c2b2 lrc: 3/0,1 mode: PW/PW res: [0x2b2d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.382502:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003324f656/0x3234de053c4c2b2 lrc: 4/0,1 mode: PW/PW res: [0x2b2d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.382514:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.382526:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a37852a8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+315:41278:x1731746394407488:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 49us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.382529:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11182 00000100:00100000:1.0:1651529333.382539:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11184 00000100:00100000:1.0:1651529333.382540:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+314:41278:x1731746394407424:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.382543:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.382545:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005cc676e8/0x3234de053c43db9 lrc: 4/0,0 mode: PR/PR res: [0x2b2d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3c21 expref: 314 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.382548:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005cc676e8/0x3234de053c43db9 lrc: 3/0,0 mode: PR/PR res: [0x2b2d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3c21 expref: 313 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.382554:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cc676e8/0x3234de053c43db9 lrc: 0/0,0 mode: --/PR res: [0x2b2d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3c21 expref: 313 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.382563:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.382564:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.382565:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000441232d4/0x3234de053c4c2a4 lrc: 3/0,1 mode: PW/PW res: [0x2b2d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.382568:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000441232d4/0x3234de053c4c2a4 lrc: 4/0,1 mode: PW/PW res: [0x2b2d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.382579:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.382585:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+312:41278:x1731746394407424:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 44us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.382588:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11184 00010000:00010000:1.0:1651529333.382595:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003324f656/0x3234de053c4c2b2 lrc: 3/0,1 mode: PW/PW res: [0x2b2d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.382598:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003324f656/0x3234de053c4c2b2 lrc: 3/0,1 mode: PW/PW res: [0x2b2d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.382601:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003324f656/0x3234de053c4c2b2 lrc: 3/0,1 mode: PW/PW res: [0x2b2d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.382604:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003324f656/0x3234de053c4c2b2 lrc: 2/0,0 mode: PW/PW res: [0x2b2d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.382652:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1103:39029:x1731745946291648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 801us (862us total) trans 12885078454 rc 0/0 00000100:00100000:1.0:1651529333.382655:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208550 00010000:00010000:1.0:1651529333.382662:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003324f656/0x3234de053c4c2b2 lrc: 2/0,0 mode: PW/PW res: [0x2b2d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.382665:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003324f656 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.382666:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003324f656/0x3234de053c4c2b2 lrc: 2/0,0 mode: PW/PW res: [0x2b2d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.382671:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003324f656/0x3234de053c4c2b2 lrc: 3/0,0 mode: PW/PW res: [0x2b2d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.382676:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003324f656/0x3234de053c4c2b2 lrc: 1/0,0 mode: --/PW res: [0x2b2d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.382679:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003324f656/0x3234de053c4c2b2 lrc: 0/0,0 mode: --/PW res: [0x2b2d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.382684:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002537ce87/0x3234de053c4c2ab lrc: 3/0,1 mode: PW/PW res: [0x2b2d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.382687:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002537ce87/0x3234de053c4c2ab lrc: 3/0,1 mode: PW/PW res: [0x2b2d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.382690:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002537ce87/0x3234de053c4c2ab lrc: 3/0,1 mode: PW/PW res: [0x2b2d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.382693:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002537ce87/0x3234de053c4c2ab lrc: 2/0,0 mode: PW/PW res: [0x2b2d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.382742:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1102:39029:x1731745946291584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1013us (1102us total) trans 12885078456 rc 0/0 00000100:00100000:1.0:1651529333.382745:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208549 00010000:00010000:1.0:1651529333.382752:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003fd513db/0x3234de053c4c29d lrc: 3/0,1 mode: PW/PW res: [0x2b2cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.382758:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fd513db/0x3234de053c4c29d lrc: 3/0,1 mode: PW/PW res: [0x2b2cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.382761:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fd513db/0x3234de053c4c29d lrc: 3/0,1 mode: PW/PW res: [0x2b2cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.382763:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003fd513db/0x3234de053c4c29d lrc: 2/0,0 mode: PW/PW res: [0x2b2cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.382796:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1102:39029:x1731745946291456:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1131us (1205us total) trans 12885078457 rc 0/0 00000100:00100000:1.0:1651529333.382799:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208547 00010000:00010000:1.0:1651529333.382805:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003fd513db/0x3234de053c4c29d lrc: 2/0,0 mode: PW/PW res: [0x2b2cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.382808:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003fd513db already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.382809:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003fd513db/0x3234de053c4c29d lrc: 2/0,0 mode: PW/PW res: [0x2b2cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.382812:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003fd513db/0x3234de053c4c29d lrc: 3/0,0 mode: PW/PW res: [0x2b2cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.382816:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003fd513db/0x3234de053c4c29d lrc: 1/0,0 mode: --/PW res: [0x2b2cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.382819:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fd513db/0x3234de053c4c29d lrc: 0/0,0 mode: --/PW res: [0x2b2cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.382854:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.382869:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.382880:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.382891:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.382954:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394407744 00010000:00010000:1.0:1651529333.382960:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000eec163c/0x3234de053c437ae lrc: 4/0,0 mode: PR/PR res: [0x2b2d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a24c0 expref: 311 pid: 80277 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.382977:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11185 00000100:00100000:1.0:1651529333.382979:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+311:41279:x1731746394407744:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.382982:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.382984:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000eec163c/0x3234de053c437ae lrc: 4/0,0 mode: PR/PR res: [0x2b2d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a24c0 expref: 311 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.382988:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000eec163c/0x3234de053c437ae lrc: 3/0,0 mode: PR/PR res: [0x2b2d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a24c0 expref: 311 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.382993:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000eec163c/0x3234de053c437ae lrc: 0/0,0 mode: --/PR res: [0x2b2d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a24c0 expref: 311 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.382997:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.382997:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.382998:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004df6544e/0x3234de053c4c2b9 lrc: 3/0,1 mode: PW/PW res: [0x2b2d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.383001:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004df6544e/0x3234de053c4c2b9 lrc: 4/0,1 mode: PW/PW res: [0x2b2d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.383011:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.383017:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+310:41279:x1731746394407744:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 37us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.383020:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11185 00000100:00100000:1.0:1651529333.383028:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208554 00000100:00100000:1.0:1651529333.383030:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1104:39030:x1731745946291904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.383034:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176854 count 1 00010000:00010000:1.0:1651529333.383038:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000776a84f4/0x3234de053c4c2ce lrc: 3/0,1 mode: --/PW res: [0x2b2d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.383043:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f2fd82a5/0x3234de053c438a3 lrc: 2/0,0 mode: PR/PR res: [0x2b2d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2808 expref: 309 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.383046:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.383046:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.383047:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000776a84f4/0x3234de053c4c2ce lrc: 4/0,1 mode: --/PW res: [0x2b2d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.383053:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f2fd82a5/0x3234de053c438a3 lrc: 3/0,0 mode: PR/PR res: [0x2b2d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2808 expref: 309 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.383057:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f2fd82a5/0x3234de053c438a3 lrc: 4/0,0 mode: PR/PR res: [0x2b2d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2808 expref: 309 pid: 80277 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.383061:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f2582a33 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996932608:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.383069:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000babe2d90 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.383143:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.383161:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.383176:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.383183:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.383189:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946292032 00000100:00100000:1.0:1651529333.383200:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208555 00000100:00100000:1.0:1651529333.383202:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1108:39029:x1731745946291968:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.383207:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176855 count 1 00010000:00010000:1.0:1651529333.383211:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000915ac1d0/0x3234de053c4c2d5 lrc: 3/0,1 mode: --/PW res: [0x2b2d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.383216:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a455296d/0x3234de053c4408a lrc: 2/0,0 mode: PR/PR res: [0x2b2d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a47c0 expref: 309 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.383219:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.383219:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.383220:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000915ac1d0/0x3234de053c4c2d5 lrc: 4/0,1 mode: --/PW res: [0x2b2d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.383241:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a455296d/0x3234de053c4408a lrc: 3/0,0 mode: PR/PR res: [0x2b2d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a47c0 expref: 309 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.383245:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a455296d/0x3234de053c4408a lrc: 4/0,0 mode: PR/PR res: [0x2b2d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a47c0 expref: 309 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.383249:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ef7d105 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996932672:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.383263:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 0000000018ebe812 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.383269:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208557 00000100:00100000:1.0:1651529333.383271:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1108:39030:x1731745946292032:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.383277:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176856 count 1 00010000:00010000:1.0:1651529333.383280:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7cb3d9d/0x3234de053c4c2e3 lrc: 3/0,1 mode: --/PW res: [0x2b2d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.383284:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fff466fa/0x3234de053c46ba9 lrc: 2/0,0 mode: PR/PR res: [0x2b2d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af817 expref: 309 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.383287:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.383288:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.383289:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7cb3d9d/0x3234de053c4c2e3 lrc: 4/0,1 mode: --/PW res: [0x2b2d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.383294:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fff466fa/0x3234de053c46ba9 lrc: 3/0,0 mode: PR/PR res: [0x2b2d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af817 expref: 309 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.383298:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fff466fa/0x3234de053c46ba9 lrc: 4/0,0 mode: PR/PR res: [0x2b2d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af817 expref: 309 pid: 80277 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.383302:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996932800:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.383308:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fe434b1c going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.383324:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.383464:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.383473:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.383481:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394408064 00010000:00010000:1.0:1651529333.383487:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000662594c3/0x3234de053c45870 lrc: 4/0,0 mode: PR/PR res: [0x2b2d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa8fc expref: 311 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.383503:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11187 00000100:00100000:1.0:1651529333.383504:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+311:41278:x1731746394408064:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.383508:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.383509:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000662594c3/0x3234de053c45870 lrc: 4/0,0 mode: PR/PR res: [0x2b2d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa8fc expref: 311 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.383513:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000662594c3/0x3234de053c45870 lrc: 3/0,0 mode: PR/PR res: [0x2b2d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa8fc expref: 311 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.383518:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000662594c3/0x3234de053c45870 lrc: 0/0,0 mode: --/PR res: [0x2b2d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa8fc expref: 310 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.383522:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.383523:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.383524:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c4c2c7 lrc: 3/0,1 mode: PW/PW res: [0x2b2d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.383527:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c4c2c7 lrc: 4/0,1 mode: PW/PW res: [0x2b2d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.383539:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.383547:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+308:41278:x1731746394408064:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (73us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.383550:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11187 00000100:00100000:1.0:1651529333.383658:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f2582a33 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996932608:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.383664:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000776a84f4/0x3234de053c4c2ce lrc: 3/0,1 mode: --/PW res: [0x2b2d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.383727:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000518200b6/0x3234de053c4c2c0 lrc: 2/0,0 mode: PW/PW res: [0x2b2d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.383738:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000518200b6 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.383744:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000518200b6/0x3234de053c4c2c0 lrc: 2/0,0 mode: PW/PW res: [0x2b2d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.383752:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000518200b6/0x3234de053c4c2c0 lrc: 3/0,0 mode: PW/PW res: [0x2b2d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.383757:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000518200b6/0x3234de053c4c2c0 lrc: 1/0,0 mode: --/PW res: [0x2b2d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.383760:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000518200b6/0x3234de053c4c2c0 lrc: 0/0,0 mode: --/PW res: [0x2b2d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.383770:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996932800:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.383773:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f7cb3d9d/0x3234de053c4c2e3 lrc: 3/0,1 mode: --/PW res: [0x2b2d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.383779:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ef7d105 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996932672:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.383782:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000915ac1d0/0x3234de053c4c2d5 lrc: 3/0,1 mode: --/PW res: [0x2b2d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.383844:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.383966:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.384080:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.384088:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.384111:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.384119:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.384128:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.384134:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.384140:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394408128 00010000:00010000:1.0:1651529333.384145:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f2fd82a5/0x3234de053c438a3 lrc: 4/0,0 mode: PR/PR res: [0x2b2d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2808 expref: 310 pid: 80277 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.384151:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394408384 00010000:00010000:1.0:1651529333.384154:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b30cefec/0x3234de053c45ec1 lrc: 4/0,0 mode: PR/PR res: [0x2b2da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac1d7 expref: 312 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.384159:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11188 00000100:00100000:1.0:1651529333.384160:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+313:41278:x1731746394408192:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.384163:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.384165:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a455296d/0x3234de053c4408a lrc: 4/0,0 mode: PR/PR res: [0x2b2d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a47c0 expref: 313 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.384169:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a455296d/0x3234de053c4408a lrc: 3/0,0 mode: PR/PR res: [0x2b2d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a47c0 expref: 313 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.384174:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a455296d/0x3234de053c4408a lrc: 0/0,0 mode: --/PR res: [0x2b2d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a47c0 expref: 313 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.384178:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.384179:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.384179:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000915ac1d0/0x3234de053c4c2d5 lrc: 3/0,1 mode: PW/PW res: [0x2b2d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.384182:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000915ac1d0/0x3234de053c4c2d5 lrc: 4/0,1 mode: PW/PW res: [0x2b2d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.384189:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.384197:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+311:41278:x1731746394408192:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 36us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.384200:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11188 00000100:00100000:1.0:1651529333.384205:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11190 00000100:00100000:1.0:1651529333.384207:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001e35645b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+309:41279:x1731746394408128:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.384210:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.384211:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f2fd82a5/0x3234de053c438a3 lrc: 4/0,0 mode: PR/PR res: [0x2b2d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2808 expref: 309 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.384215:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f2fd82a5/0x3234de053c438a3 lrc: 3/0,0 mode: PR/PR res: [0x2b2d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2808 expref: 309 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.384219:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2fd82a5/0x3234de053c438a3 lrc: 0/0,0 mode: --/PR res: [0x2b2d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2808 expref: 309 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.384241:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.384242:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.384243:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000776a84f4/0x3234de053c4c2ce lrc: 3/0,1 mode: PW/PW res: [0x2b2d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.384246:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000776a84f4/0x3234de053c4c2ce lrc: 4/0,1 mode: PW/PW res: [0x2b2d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.384252:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.384258:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001e35645b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+307:41279:x1731746394408128:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 51us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.384261:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11190 00000100:00100000:1.0:1651529333.384276:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11192 00000100:00100000:1.0:1651529333.384278:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+306:41278:x1731746394408384:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.384285:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.384287:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b30cefec/0x3234de053c45ec1 lrc: 4/0,0 mode: PR/PR res: [0x2b2da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac1d7 expref: 306 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.384291:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b30cefec/0x3234de053c45ec1 lrc: 3/0,0 mode: PR/PR res: [0x2b2da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac1d7 expref: 306 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.384296:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b30cefec/0x3234de053c45ec1 lrc: 0/0,0 mode: --/PR res: [0x2b2da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac1d7 expref: 306 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.384299:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.384300:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.384301:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4c2ea lrc: 3/0,1 mode: PW/PW res: [0x2b2da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.384306:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4c2ea lrc: 4/0,1 mode: PW/PW res: [0x2b2da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.384315:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.384321:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+304:41278:x1731746394408384:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 43us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.384324:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11192 00010000:00010000:1.0:1651529333.384332:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000915ac1d0/0x3234de053c4c2d5 lrc: 3/0,1 mode: PW/PW res: [0x2b2d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.384335:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000915ac1d0/0x3234de053c4c2d5 lrc: 3/0,1 mode: PW/PW res: [0x2b2d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.384338:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000915ac1d0/0x3234de053c4c2d5 lrc: 3/0,1 mode: PW/PW res: [0x2b2d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.384341:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000915ac1d0/0x3234de053c4c2d5 lrc: 2/0,0 mode: PW/PW res: [0x2b2d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.384384:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1112:39029:x1731745946291968:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1181us (1241us total) trans 12885078461 rc 0/0 00000100:00100000:1.0:1651529333.384387:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208555 00010000:00010000:1.0:1651529333.384394:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000776a84f4/0x3234de053c4c2ce lrc: 3/0,1 mode: PW/PW res: [0x2b2d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.384397:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000776a84f4/0x3234de053c4c2ce lrc: 3/0,1 mode: PW/PW res: [0x2b2d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.384400:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000776a84f4/0x3234de053c4c2ce lrc: 3/0,1 mode: PW/PW res: [0x2b2d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.384403:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000776a84f4/0x3234de053c4c2ce lrc: 2/0,0 mode: PW/PW res: [0x2b2d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.384435:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1112:39030:x1731745946291904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1404us (1543us total) trans 12885078463 rc 0/0 00000100:00100000:1.0:1651529333.384438:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208554 00010000:00010000:1.0:1651529333.384444:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f7cb3d9d/0x3234de053c4c2e3 lrc: 3/0,1 mode: PW/PW res: [0x2b2d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.384447:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7cb3d9d/0x3234de053c4c2e3 lrc: 3/0,1 mode: PW/PW res: [0x2b2d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.384450:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7cb3d9d/0x3234de053c4c2e3 lrc: 3/0,1 mode: PW/PW res: [0x2b2d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.384452:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7cb3d9d/0x3234de053c4c2e3 lrc: 2/0,0 mode: PW/PW res: [0x2b2d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.384480:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1112:39030:x1731745946292032:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1208us (1319us total) trans 12885078464 rc 0/0 00000100:00100000:1.0:1651529333.384483:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208557 00000100:00100000:1.0:1651529333.384547:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.384560:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529333.384652:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4c2f1 lrc: 2/0,0 mode: PW/PW res: [0x2b2db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.384656:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cd6e2551 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.384657:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4c2f1 lrc: 2/0,0 mode: PW/PW res: [0x2b2db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.384661:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4c2f1 lrc: 3/0,0 mode: PW/PW res: [0x2b2db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.384665:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4c2f1 lrc: 1/0,0 mode: --/PW res: [0x2b2db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.384668:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4c2f1 lrc: 0/0,0 mode: --/PW res: [0x2b2db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.384676:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11195 00000100:00100000:1.0:1651529333.384678:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+302:41278:x1731746394408704:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.384681:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.384689:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000052ea5946/0x3234de053c44b88 lrc: 4/0,0 mode: PR/PR res: [0x2b2dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7532 expref: 302 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.384693:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000052ea5946/0x3234de053c44b88 lrc: 3/0,0 mode: PR/PR res: [0x2b2dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7532 expref: 301 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.384701:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052ea5946/0x3234de053c44b88 lrc: 0/0,0 mode: --/PR res: [0x2b2dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7532 expref: 301 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.384707:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.384708:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.384709:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4c2ff lrc: 3/0,1 mode: PW/PW res: [0x2b2dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.384712:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4c2ff lrc: 4/0,1 mode: PW/PW res: [0x2b2dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.384721:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.384735:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+300:41278:x1731746394408704:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 50us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.384738:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11195 00000100:00100000:1.0:1651529333.384761:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.384835:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.384851:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.384869:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.384876:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.384885:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946292480 00000100:00100000:1.0:1651529333.384897:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946292544 00000100:00100000:1.0:1651529333.384903:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946292608 00000100:00100000:1.0:1651529333.384907:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946292672 00000100:00100000:1.0:1651529333.384913:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208564 00000100:00100000:1.0:1651529333.384915:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1116:39030:x1731745946292544:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.384920:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176864 count 1 00010000:00010000:1.0:1651529333.384925:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc418822/0x3234de053c4c314 lrc: 3/0,1 mode: --/PW res: [0x2b2e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.384932:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e5878ee7/0x3234de053c45d08 lrc: 2/0,0 mode: PR/PR res: [0x2b2e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abafa expref: 299 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.384935:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.384936:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.384937:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc418822/0x3234de053c4c314 lrc: 4/0,1 mode: --/PW res: [0x2b2e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.384943:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e5878ee7/0x3234de053c45d08 lrc: 3/0,0 mode: PR/PR res: [0x2b2e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abafa expref: 299 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.384947:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e5878ee7/0x3234de053c45d08 lrc: 4/0,0 mode: PR/PR res: [0x2b2e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abafa expref: 299 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.384951:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000117fbeca pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996933184:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.384959:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 0000000053a0cffa going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.384966:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208565 00000100:00100000:1.0:1651529333.384968:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d88281f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1116:39029:x1731745946292608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.384971:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176865 count 1 00010000:00010000:1.0:1651529333.384975:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4c31b lrc: 3/0,1 mode: --/PW res: [0x2b2e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.384979:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000046ed6f14/0x3234de053c44e6e lrc: 2/0,0 mode: PR/PR res: [0x2b2e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7f57 expref: 299 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.384982:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.384983:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.384983:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4c31b lrc: 4/0,1 mode: --/PW res: [0x2b2e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.384989:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000046ed6f14/0x3234de053c44e6e lrc: 3/0,0 mode: PR/PR res: [0x2b2e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7f57 expref: 299 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.384993:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000046ed6f14/0x3234de053c44e6e lrc: 4/0,0 mode: PR/PR res: [0x2b2e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7f57 expref: 299 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.384996:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000824ca843 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996933312:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.385002:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d09f5ee1 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.385017:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529333.385291:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4c2dc lrc: 2/0,0 mode: PW/PW res: [0x2b2d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.385296:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000041e6f70f already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.385297:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4c2dc lrc: 2/0,0 mode: PW/PW res: [0x2b2d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.385300:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4c2dc lrc: 3/0,0 mode: PW/PW res: [0x2b2d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.385305:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4c2dc lrc: 1/0,0 mode: --/PW res: [0x2b2d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.385308:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4c2dc lrc: 0/0,0 mode: --/PW res: [0x2b2d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.385350:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.385498:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.385507:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.385519:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000117fbeca pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996933184:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.385523:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cc418822/0x3234de053c4c314 lrc: 3/0,1 mode: --/PW res: [0x2b2e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.385530:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000824ca843 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996933312:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.385533:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4c31b lrc: 3/0,1 mode: --/PW res: [0x2b2e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.385539:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394409024 00010000:00010000:1.0:1651529333.385543:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000b8823b9/0x3234de053c4492e lrc: 4/0,0 mode: PR/PR res: [0x2b2de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6bca expref: 300 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.385551:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11196 00000100:00100000:1.0:1651529333.385553:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000461918a5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+300:41278:x1731746394409024:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.385555:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.385556:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000b8823b9/0x3234de053c4492e lrc: 4/0,0 mode: PR/PR res: [0x2b2de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6bca expref: 300 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.385560:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000b8823b9/0x3234de053c4492e lrc: 3/0,0 mode: PR/PR res: [0x2b2de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6bca expref: 300 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.385568:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b8823b9/0x3234de053c4492e lrc: 0/0,0 mode: --/PR res: [0x2b2de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6bca expref: 300 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.385572:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.385573:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.385574:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007a25596b/0x3234de053c4c306 lrc: 3/0,1 mode: PW/PW res: [0x2b2de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.385577:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a25596b/0x3234de053c4c306 lrc: 4/0,1 mode: PW/PW res: [0x2b2de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.385591:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.385598:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000461918a5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+299:41278:x1731746394409024:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 45us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.385601:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11196 00000100:00100000:1.0:1651529333.385659:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.385666:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.385693:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.385722:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.385740:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.385747:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394409088 00010000:00010000:1.0:1651529333.385752:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e5878ee7/0x3234de053c45d08 lrc: 4/0,0 mode: PR/PR res: [0x2b2e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abafa expref: 300 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.385758:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394409344 00010000:00010000:1.0:1651529333.385760:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003e145e11/0x3234de053c44108 lrc: 4/0,0 mode: PR/PR res: [0x2b2e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4aad expref: 303 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.385769:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11198 00000100:00100000:1.0:1651529333.385771:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+303:41279:x1731746394409088:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529333.385774:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.385775:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e5878ee7/0x3234de053c45d08 lrc: 4/0,0 mode: PR/PR res: [0x2b2e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abafa expref: 303 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.385779:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e5878ee7/0x3234de053c45d08 lrc: 3/0,0 mode: PR/PR res: [0x2b2e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abafa expref: 303 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.385784:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5878ee7/0x3234de053c45d08 lrc: 0/0,0 mode: --/PR res: [0x2b2e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abafa expref: 303 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.385788:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.385789:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.385789:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cc418822/0x3234de053c4c314 lrc: 3/0,1 mode: PW/PW res: [0x2b2e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.385793:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc418822/0x3234de053c4c314 lrc: 4/0,1 mode: PW/PW res: [0x2b2e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.385799:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.385814:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+300:41279:x1731746394409088:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.385818:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11198 00000100:00100000:1.0:1651529333.385823:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11200 00000100:00100000:1.0:1651529333.385824:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+299:41278:x1731746394409280:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.385827:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.385829:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bb568e6e/0x3234de053c46176 lrc: 4/0,0 mode: PR/PR res: [0x2b2e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acc42 expref: 299 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.385832:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bb568e6e/0x3234de053c46176 lrc: 3/0,0 mode: PR/PR res: [0x2b2e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acc42 expref: 299 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.385837:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb568e6e/0x3234de053c46176 lrc: 0/0,0 mode: --/PR res: [0x2b2e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acc42 expref: 298 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.385840:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.385841:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.385842:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c83c6fc1/0x3234de053c4c322 lrc: 3/0,1 mode: PW/PW res: [0x2b2e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.385845:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c83c6fc1/0x3234de053c4c322 lrc: 4/0,1 mode: PW/PW res: [0x2b2e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.385860:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.385866:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+296:41278:x1731746394409280:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 41us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.385869:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11200 00010000:00010000:1.0:1651529333.385878:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cc418822/0x3234de053c4c314 lrc: 3/0,1 mode: PW/PW res: [0x2b2e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.385881:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc418822/0x3234de053c4c314 lrc: 3/0,1 mode: PW/PW res: [0x2b2e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.385886:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc418822/0x3234de053c4c314 lrc: 3/0,1 mode: PW/PW res: [0x2b2e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.385889:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc418822/0x3234de053c4c314 lrc: 2/0,0 mode: PW/PW res: [0x2b2e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.385931:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1120:39030:x1731745946292544:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1016us (1080us total) trans 12885078470 rc 0/0 00000100:00100000:1.0:1651529333.385934:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208564 00010000:00010000:1.0:1651529333.385941:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4c31b lrc: 3/0,1 mode: PW/PW res: [0x2b2e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.385944:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4c31b lrc: 3/0,1 mode: PW/PW res: [0x2b2e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.385948:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4c31b lrc: 3/0,1 mode: PW/PW res: [0x2b2e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.385950:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4c31b lrc: 2/0,0 mode: PW/PW res: [0x2b2e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.385996:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d88281f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1121:39029:x1731745946292608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1027us (1127us total) trans 12885078472 rc 0/0 00000100:00100000:1.0:1651529333.385999:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208565 00010000:00010000:1.0:1651529333.386006:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c3bc1618/0x3234de053c4c329 lrc: 2/0,0 mode: PW/PW res: [0x2b2e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.386011:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c3bc1618 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.386013:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3bc1618/0x3234de053c4c329 lrc: 2/0,0 mode: PW/PW res: [0x2b2e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.386015:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3bc1618/0x3234de053c4c329 lrc: 3/0,0 mode: PW/PW res: [0x2b2e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.386020:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c3bc1618/0x3234de053c4c329 lrc: 1/0,0 mode: --/PW res: [0x2b2e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.386023:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3bc1618/0x3234de053c4c329 lrc: 0/0,0 mode: --/PW res: [0x2b2e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.386027:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4c31b lrc: 2/0,0 mode: PW/PW res: [0x2b2e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.386029:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000016ff53ef already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.386030:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4c31b lrc: 2/0,0 mode: PW/PW res: [0x2b2e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.386033:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4c31b lrc: 3/0,0 mode: PW/PW res: [0x2b2e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.386036:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4c31b lrc: 1/0,0 mode: --/PW res: [0x2b2e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.386038:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4c31b lrc: 0/0,0 mode: --/PW res: [0x2b2e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.386042:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4c30d lrc: 2/0,0 mode: PW/PW res: [0x2b2df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.386045:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000828505cd already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.386046:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4c30d lrc: 2/0,0 mode: PW/PW res: [0x2b2df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.386058:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4c30d lrc: 3/0,0 mode: PW/PW res: [0x2b2df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.386062:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4c30d lrc: 1/0,0 mode: --/PW res: [0x2b2df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.386064:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4c30d lrc: 0/0,0 mode: --/PW res: [0x2b2df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.386096:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.386119:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.386131:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.386213:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394409600 00010000:00010000:1.0:1651529333.386219:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006967343c/0x3234de053c45fe7 lrc: 5/0,0 mode: PR/PR res: [0x2b2e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac606 expref: 294 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.386249:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394409664 00010000:00010000:1.0:1651529333.386252:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007785087c/0x3234de053c45058 lrc: 5/0,0 mode: PR/PR res: [0x2b2e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a86a4 expref: 295 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.386261:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11202 00000100:00100000:1.0:1651529333.386263:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+295:41278:x1731746394409600:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.386266:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.386267:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006967343c/0x3234de053c45fe7 lrc: 5/0,0 mode: PR/PR res: [0x2b2e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac606 expref: 295 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.386271:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006967343c/0x3234de053c45fe7 lrc: 4/0,0 mode: PR/PR res: [0x2b2e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac606 expref: 295 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.386276:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.386277:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.386278:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c0c4b95b/0x3234de053c4c330 lrc: 3/0,1 mode: PW/PW res: [0x2b2e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.386281:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0c4b95b/0x3234de053c4c330 lrc: 4/0,1 mode: PW/PW res: [0x2b2e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.386291:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.386299:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+295:41278:x1731746394409600:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 36us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.386302:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11202 00000100:00100000:1.0:1651529333.386306:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11203 00000100:00100000:1.0:1651529333.386308:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f53a84c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+294:41278:x1731746394409664:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.386310:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.386312:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007785087c/0x3234de053c45058 lrc: 5/0,0 mode: PR/PR res: [0x2b2e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a86a4 expref: 294 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.386315:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007785087c/0x3234de053c45058 lrc: 4/0,0 mode: PR/PR res: [0x2b2e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a86a4 expref: 294 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.386320:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.386320:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.386321:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000705cc353/0x3234de053c4c337 lrc: 3/0,1 mode: PW/PW res: [0x2b2e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.386324:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000705cc353/0x3234de053c4c337 lrc: 4/0,1 mode: PW/PW res: [0x2b2e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.386328:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.386332:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f53a84c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+294:41278:x1731746394409664:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 23us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.386334:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11203 00000100:00100000:1.0:1651529333.386366:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.386404:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.386422:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.386480:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.386492:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.386499:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.386506:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946293056 00000100:00100000:1.0:1651529333.386518:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946293184 00000100:00100000:1.0:1651529333.386522:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 208572 00000100:00100000:1.0:1651529333.386524:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+293:41279:x1731746394409728:12345-10.240.43.64@tcp:101:ll_agl_410261.0 00010000:00010000:1.0:1651529333.386527:0:80278:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529333.386532:0:80278:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf272247/0x3234de053c4c34c lrc: 2/0,0 mode: --/PR res: [0x2b5de:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2cc8fd expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529333.386537:0:80278:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b5de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529333.386541:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.386542:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.386544:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf272247/0x3234de053c4c34c lrc: 3/0,0 mode: PR/PR res: [0x2b5de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc8fd expref: 294 pid: 80278 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.386548:0:80278:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bf272247/0x3234de053c4c34c lrc: 3/0,0 mode: PR/PR res: [0x2b5de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc8fd expref: 294 pid: 80278 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.386552:0:80278:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000bf272247, rc 0) 00000100:00100000:1.0:1651529333.386559:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+294:41279:x1731746394409728:12345-10.240.43.64@tcp:101:ll_agl_410261.0 Request processed in 35us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.386562:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 208572 00000100:00100000:1.0:1651529333.386566:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208574 00000100:00100000:1.0:1651529333.386568:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1124:39030:x1731745946293056:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.386572:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176872 count 1 00010000:00010000:1.0:1651529333.386575:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b6e58d6/0x3234de053c4c35a lrc: 3/0,1 mode: --/PW res: [0x2b2e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.386579:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000027d80491/0x3234de053c46073 lrc: 2/0,0 mode: PR/PR res: [0x2b2e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac84b expref: 293 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.386582:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.386583:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.386583:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b6e58d6/0x3234de053c4c35a lrc: 4/0,1 mode: --/PW res: [0x2b2e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.386600:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000027d80491/0x3234de053c46073 lrc: 3/0,0 mode: PR/PR res: [0x2b2e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac84b expref: 293 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.386604:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000027d80491/0x3234de053c46073 lrc: 4/0,0 mode: PR/PR res: [0x2b2e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac84b expref: 293 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.386608:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d523a75 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996933760:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.386616:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d09f5ee1 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.386623:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208575 00000100:00100000:1.0:1651529333.386624:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1124:39029:x1731745946293184:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.386629:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176874 count 1 00010000:00010000:1.0:1651529333.386632:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c03f4dd/0x3234de053c4c361 lrc: 3/0,1 mode: --/PW res: [0x2b2ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.386637:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004355d948/0x3234de053c45c4b lrc: 2/0,0 mode: PR/PR res: [0x2b2ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab7f8 expref: 293 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.386640:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.386640:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.386641:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c03f4dd/0x3234de053c4c361 lrc: 4/0,1 mode: --/PW res: [0x2b2ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.386647:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004355d948/0x3234de053c45c4b lrc: 3/0,0 mode: PR/PR res: [0x2b2ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab7f8 expref: 293 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.386650:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004355d948/0x3234de053c45c4b lrc: 4/0,0 mode: PR/PR res: [0x2b2ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab7f8 expref: 293 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.386654:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd68fdd5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996933888:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.386660:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 000000007d8fabda going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.386675:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.386696:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.386759:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946293248 00000100:00100000:1.0:1651529333.386770:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946293312 00000100:00100000:1.0:1651529333.386774:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208576 00000100:00100000:1.0:1651529333.386775:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1127:39029:x1731745946293248:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.386780:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176875 count 1 00010000:00010000:1.0:1651529333.386784:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000656a2f5f/0x3234de053c4c368 lrc: 3/0,1 mode: --/PW res: [0x2b2eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.386789:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004a74ee8f/0x3234de053c4598f lrc: 2/0,0 mode: PR/PR res: [0x2b2eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aad6a expref: 292 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.386792:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.386793:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.386793:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000656a2f5f/0x3234de053c4c368 lrc: 4/0,1 mode: --/PW res: [0x2b2eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.386799:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004a74ee8f/0x3234de053c4598f lrc: 3/0,0 mode: PR/PR res: [0x2b2eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aad6a expref: 292 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.386803:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004a74ee8f/0x3234de053c4598f lrc: 4/0,0 mode: PR/PR res: [0x2b2eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aad6a expref: 292 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.386810:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996933952:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.386825:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8a0b704 going to sleep for 6 seconds 00010000:00010000:1.0:1651529333.386963:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0c4b95b/0x3234de053c4c330 lrc: 2/0,0 mode: PW/PW res: [0x2b2e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.386967:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c0c4b95b already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.386968:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0c4b95b/0x3234de053c4c330 lrc: 2/0,0 mode: PW/PW res: [0x2b2e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.386972:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0c4b95b/0x3234de053c4c330 lrc: 3/0,0 mode: PW/PW res: [0x2b2e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.386977:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0c4b95b/0x3234de053c4c330 lrc: 1/0,0 mode: --/PW res: [0x2b2e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.386980:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0c4b95b/0x3234de053c4c330 lrc: 0/0,0 mode: --/PW res: [0x2b2e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.387038:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.387111:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.387140:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.387151:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.387160:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.387168:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.387207:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d523a75 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996933760:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.387213:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004b6e58d6/0x3234de053c4c35a lrc: 3/0,1 mode: --/PW res: [0x2b2e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.387220:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd68fdd5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996933888:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.387233:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002c03f4dd/0x3234de053c4c361 lrc: 3/0,1 mode: --/PW res: [0x2b2ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.387245:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394410048 00010000:00010000:1.0:1651529333.387250:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c43b58 lrc: 4/0,0 mode: PR/PR res: [0x2b2e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a32d5 expref: 292 pid: 80278 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.387255:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394410176 00010000:00010000:1.0:1651529333.387257:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004355d948/0x3234de053c45c4b lrc: 4/0,0 mode: PR/PR res: [0x2b2ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab7f8 expref: 293 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.387261:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394409984 00010000:00010000:1.0:1651529333.387269:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a4528e34/0x3234de053c4510e lrc: 4/0,0 mode: PR/PR res: [0x2b2e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a89e5 expref: 294 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.387275:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11205 00000100:00100000:1.0:1651529333.387277:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+295:41278:x1731746394410048:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.387279:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.387281:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c43b58 lrc: 4/0,0 mode: PR/PR res: [0x2b2e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a32d5 expref: 295 pid: 80278 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.387284:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c43b58 lrc: 3/0,0 mode: PR/PR res: [0x2b2e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a32d5 expref: 295 pid: 80278 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.387290:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c43b58 lrc: 0/0,0 mode: --/PR res: [0x2b2e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a32d5 expref: 295 pid: 80278 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.387294:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.387295:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.387296:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000578d2cb4/0x3234de053c4c353 lrc: 3/0,1 mode: PW/PW res: [0x2b2e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.387299:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000578d2cb4/0x3234de053c4c353 lrc: 4/0,1 mode: PW/PW res: [0x2b2e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.387309:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.387316:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+293:41278:x1731746394410048:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 39us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.387324:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11205 00000100:00100000:1.0:1651529333.387330:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11207 00000100:00100000:1.0:1651529333.387331:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+292:41278:x1731746394409984:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.387334:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.387336:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a4528e34/0x3234de053c4510e lrc: 4/0,0 mode: PR/PR res: [0x2b2e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a89e5 expref: 291 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.387340:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a4528e34/0x3234de053c4510e lrc: 3/0,0 mode: PR/PR res: [0x2b2e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a89e5 expref: 291 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.387345:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4528e34/0x3234de053c4510e lrc: 0/0,0 mode: --/PR res: [0x2b2e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a89e5 expref: 291 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.387351:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.387351:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.387352:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000049d9a625/0x3234de053c4c345 lrc: 3/0,1 mode: PW/PW res: [0x2b2e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.387355:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049d9a625/0x3234de053c4c345 lrc: 4/0,1 mode: PW/PW res: [0x2b2e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.387363:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.387369:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+290:41278:x1731746394409984:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 37us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.387371:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11207 00010000:00010000:1.0:1651529333.387383:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002c03f4dd/0x3234de053c4c361 lrc: 3/0,1 mode: PW/PW res: [0x2b2ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.387386:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c03f4dd/0x3234de053c4c361 lrc: 3/0,1 mode: PW/PW res: [0x2b2ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.387394:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c03f4dd/0x3234de053c4c361 lrc: 3/0,1 mode: PW/PW res: [0x2b2ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.387397:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c03f4dd/0x3234de053c4c361 lrc: 2/0,0 mode: PW/PW res: [0x2b2ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.387442:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1129:39029:x1731745946293184:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 816us (942us total) trans 12885078478 rc 0/0 00000100:00100000:1.0:1651529333.387445:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208575 00010000:00010000:1.0:1651529333.387452:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004b6e58d6/0x3234de053c4c35a lrc: 3/0,1 mode: PW/PW res: [0x2b2e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.387455:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b6e58d6/0x3234de053c4c35a lrc: 3/0,1 mode: PW/PW res: [0x2b2e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.387458:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b6e58d6/0x3234de053c4c35a lrc: 3/0,1 mode: PW/PW res: [0x2b2e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.387461:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b6e58d6/0x3234de053c4c35a lrc: 2/0,0 mode: PW/PW res: [0x2b2e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.387493:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1130:39030:x1731745946293056:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 924us (1013us total) trans 12885078479 rc 0/0 00000100:00100000:1.0:1651529333.387496:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208574 00010000:00010000:1.0:1651529333.387502:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000578d2cb4/0x3234de053c4c353 lrc: 2/0,0 mode: PW/PW res: [0x2b2e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.387505:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000578d2cb4 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.387506:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000578d2cb4/0x3234de053c4c353 lrc: 2/0,0 mode: PW/PW res: [0x2b2e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.387509:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000578d2cb4/0x3234de053c4c353 lrc: 3/0,0 mode: PW/PW res: [0x2b2e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.387513:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000578d2cb4/0x3234de053c4c353 lrc: 1/0,0 mode: --/PW res: [0x2b2e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.387518:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000578d2cb4/0x3234de053c4c353 lrc: 0/0,0 mode: --/PW res: [0x2b2e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.387522:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b6e58d6/0x3234de053c4c35a lrc: 2/0,0 mode: PW/PW res: [0x2b2e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.387525:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004b6e58d6 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.387526:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b6e58d6/0x3234de053c4c35a lrc: 2/0,0 mode: PW/PW res: [0x2b2e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.387529:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b6e58d6/0x3234de053c4c35a lrc: 3/0,0 mode: PW/PW res: [0x2b2e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.387532:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b6e58d6/0x3234de053c4c35a lrc: 1/0,0 mode: --/PW res: [0x2b2e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.387534:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b6e58d6/0x3234de053c4c35a lrc: 0/0,0 mode: --/PW res: [0x2b2e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.387597:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.387610:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.387623:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.387671:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.387756:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996933952:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.387760:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000656a2f5f/0x3234de053c4c368 lrc: 3/0,1 mode: --/PW res: [0x2b2eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.387771:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11210 00000100:00100000:1.0:1651529333.387773:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bbea9917 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+291:41278:x1731746394410240:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.387777:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.387778:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004a74ee8f/0x3234de053c4598f lrc: 4/0,0 mode: PR/PR res: [0x2b2eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aad6a expref: 290 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.387782:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004a74ee8f/0x3234de053c4598f lrc: 3/0,0 mode: PR/PR res: [0x2b2eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aad6a expref: 290 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.387787:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a74ee8f/0x3234de053c4598f lrc: 0/0,0 mode: --/PR res: [0x2b2eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aad6a expref: 290 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.387791:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.387792:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.387793:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000656a2f5f/0x3234de053c4c368 lrc: 3/0,1 mode: PW/PW res: [0x2b2eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.387796:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000656a2f5f/0x3234de053c4c368 lrc: 4/0,1 mode: PW/PW res: [0x2b2eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.387802:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.387809:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bbea9917 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+289:41278:x1731746394410240:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.387812:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11210 00000100:00100000:1.0:1651529333.387817:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11211 00000100:00100000:1.0:1651529333.387819:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+288:41279:x1731746394410560:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.387821:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.387823:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003d983b2a/0x3234de053c45505 lrc: 5/0,0 mode: PR/PR res: [0x2b2ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a99cf expref: 287 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.387826:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003d983b2a/0x3234de053c45505 lrc: 4/0,0 mode: PR/PR res: [0x2b2ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a99cf expref: 287 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.387832:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.387832:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.387833:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000943c1249/0x3234de053c4c376 lrc: 3/0,1 mode: PW/PW res: [0x2b2ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.387836:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000943c1249/0x3234de053c4c376 lrc: 4/0,1 mode: PW/PW res: [0x2b2ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.387840:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.387844:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+287:41279:x1731746394410560:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 25us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.387847:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11211 00010000:00010000:1.0:1651529333.387853:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000656a2f5f/0x3234de053c4c368 lrc: 3/0,1 mode: PW/PW res: [0x2b2eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.387856:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000656a2f5f/0x3234de053c4c368 lrc: 3/0,1 mode: PW/PW res: [0x2b2eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.387859:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000656a2f5f/0x3234de053c4c368 lrc: 3/0,1 mode: PW/PW res: [0x2b2eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.387864:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000656a2f5f/0x3234de053c4c368 lrc: 2/0,0 mode: PW/PW res: [0x2b2eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.387903:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1129:39029:x1731745946293248:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1126us (1228us total) trans 12885078483 rc 0/0 00000100:00100000:1.0:1651529333.387906:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208576 00010000:00010000:1.0:1651529333.387913:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000656a2f5f/0x3234de053c4c368 lrc: 2/0,0 mode: PW/PW res: [0x2b2eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.387916:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000656a2f5f already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.387917:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000656a2f5f/0x3234de053c4c368 lrc: 2/0,0 mode: PW/PW res: [0x2b2eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.387920:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000656a2f5f/0x3234de053c4c368 lrc: 3/0,0 mode: PW/PW res: [0x2b2eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.387924:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000656a2f5f/0x3234de053c4c368 lrc: 1/0,0 mode: --/PW res: [0x2b2eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.387927:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000656a2f5f/0x3234de053c4c368 lrc: 0/0,0 mode: --/PW res: [0x2b2eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.388080:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.388128:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.388138:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.388164:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.388211:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.388243:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394410752 00000100:00100000:1.0:1651529333.388255:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208583 00000100:00100000:1.0:1651529333.388257:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1132:39030:x1731745946293696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.388263:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176882 count 1 00010000:00010000:1.0:1651529333.388267:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b26b71e3/0x3234de053c4c399 lrc: 3/0,1 mode: --/PW res: [0x2b2f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.388272:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000022065871/0x3234de053c44c1b lrc: 2/0,0 mode: PR/PR res: [0x2b2f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7700 expref: 286 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.388276:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.388276:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.388277:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b26b71e3/0x3234de053c4c399 lrc: 4/0,1 mode: --/PW res: [0x2b2f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.388284:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000022065871/0x3234de053c44c1b lrc: 3/0,0 mode: PR/PR res: [0x2b2f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7700 expref: 286 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.388288:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000022065871/0x3234de053c44c1b lrc: 4/0,0 mode: PR/PR res: [0x2b2f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7700 expref: 286 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.388292:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000703c0db9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996934336:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.388302:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8a0b704 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.388309:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 208585 00000100:00100000:1.0:1651529333.388311:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+286:41278:x1731746394410752:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529333.388313:0:72397:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529333.388317:0:72397:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4c3a0 lrc: 2/0,0 mode: --/PR res: [0x2b462:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2cc920 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529333.388323:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b462:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529333.388326:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.388327:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.388329:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4c3a0 lrc: 3/0,0 mode: PR/PR res: [0x2b462:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc920 expref: 287 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.388333:0:72397:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4c3a0 lrc: 3/0,0 mode: PR/PR res: [0x2b462:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc920 expref: 287 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.388337:0:72397:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007d2a92bc, rc 0) 00000100:00100000:1.0:1651529333.388343:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+287:41278:x1731746394410752:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 32us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.388345:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 208585 00000100:00100000:1.0:1651529333.388405:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.388417:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.388426:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.388472:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.388478:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.388486:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394410816 00010000:00010000:1.0:1651529333.388492:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000039e11001/0x3234de053c45957 lrc: 5/0,0 mode: PR/PR res: [0x2b2ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aacb4 expref: 287 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.388506:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394410880 00010000:00010000:1.0:1651529333.388509:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e7c4a632/0x3234de053c45a3e lrc: 5/0,0 mode: PR/PR res: [0x2b2f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aaf8c expref: 288 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.388521:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11212 00000100:00100000:1.0:1651529333.388522:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+288:41279:x1731746394410816:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529333.388525:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.388527:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000039e11001/0x3234de053c45957 lrc: 5/0,0 mode: PR/PR res: [0x2b2ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aacb4 expref: 288 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.388531:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000039e11001/0x3234de053c45957 lrc: 4/0,0 mode: PR/PR res: [0x2b2ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aacb4 expref: 288 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.388537:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.388538:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.388539:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004a899246/0x3234de053c4c37d lrc: 3/0,1 mode: PW/PW res: [0x2b2ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.388542:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a899246/0x3234de053c4c37d lrc: 4/0,1 mode: PW/PW res: [0x2b2ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.388546:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.388553:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+288:41279:x1731746394410816:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 30us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.388556:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11212 00000100:00100000:1.0:1651529333.388560:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11213 00000100:00100000:1.0:1651529333.388561:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+287:41278:x1731746394410880:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.388563:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.388565:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e7c4a632/0x3234de053c45a3e lrc: 5/0,0 mode: PR/PR res: [0x2b2f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aaf8c expref: 287 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.388568:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e7c4a632/0x3234de053c45a3e lrc: 4/0,0 mode: PR/PR res: [0x2b2f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aaf8c expref: 287 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.388573:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.388573:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.388574:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e71292e1/0x3234de053c4c38b lrc: 3/0,1 mode: PW/PW res: [0x2b2f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.388577:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e71292e1/0x3234de053c4c38b lrc: 4/0,1 mode: PW/PW res: [0x2b2f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.388581:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.388585:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+286:41278:x1731746394410880:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 23us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.388587:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11213 00000100:00100000:1.0:1651529333.388595:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208588 00000100:00100000:1.0:1651529333.388597:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1135:39029:x1731745946293888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.388602:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176885 count 1 00010000:00010000:1.0:1651529333.388605:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4c3bc lrc: 3/0,1 mode: --/PW res: [0x2b2f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.388609:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c44c53 lrc: 2/0,0 mode: PR/PR res: [0x2b2f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a77b6 expref: 285 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.388612:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.388612:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.388613:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4c3bc lrc: 4/0,1 mode: --/PW res: [0x2b2f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.388620:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c44c53 lrc: 3/0,0 mode: PR/PR res: [0x2b2f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a77b6 expref: 285 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.388624:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c44c53 lrc: 4/0,0 mode: PR/PR res: [0x2b2f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a77b6 expref: 285 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.388628:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ac8dec6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996934592:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.388635:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fe434b1c going to sleep for 6 seconds 00010000:00010000:1.0:1651529333.388719:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e71292e1/0x3234de053c4c38b lrc: 2/0,0 mode: PW/PW res: [0x2b2f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.388723:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e71292e1 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.388724:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e71292e1/0x3234de053c4c38b lrc: 2/0,0 mode: PW/PW res: [0x2b2f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.388728:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e71292e1/0x3234de053c4c38b lrc: 3/0,0 mode: PW/PW res: [0x2b2f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.388741:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e71292e1/0x3234de053c4c38b lrc: 1/0,0 mode: --/PW res: [0x2b2f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.388744:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e71292e1/0x3234de053c4c38b lrc: 0/0,0 mode: --/PW res: [0x2b2f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.388813:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.388942:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.388956:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.388964:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.388973:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000703c0db9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996934336:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.388978:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b26b71e3/0x3234de053c4c399 lrc: 3/0,1 mode: --/PW res: [0x2b2f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.388985:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394411136 00010000:00010000:1.0:1651529333.388990:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000019ccdc0d/0x3234de053c461f4 lrc: 4/0,0 mode: PR/PR res: [0x2b2ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acf2f expref: 285 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.388996:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394411200 00010000:00010000:1.0:1651529333.388998:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000022065871/0x3234de053c44c1b lrc: 4/0,0 mode: PR/PR res: [0x2b2f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7700 expref: 286 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.389004:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11214 00000100:00100000:1.0:1651529333.389006:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+286:41278:x1731746394411136:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.389008:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.389010:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000019ccdc0d/0x3234de053c461f4 lrc: 4/0,0 mode: PR/PR res: [0x2b2ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acf2f expref: 286 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.389013:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000019ccdc0d/0x3234de053c461f4 lrc: 3/0,0 mode: PR/PR res: [0x2b2ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acf2f expref: 286 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.389025:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019ccdc0d/0x3234de053c461f4 lrc: 0/0,0 mode: --/PR res: [0x2b2ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acf2f expref: 286 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.389032:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.389032:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.389033:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003fd513db/0x3234de053c4c392 lrc: 3/0,1 mode: PW/PW res: [0x2b2ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.389036:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fd513db/0x3234de053c4c392 lrc: 4/0,1 mode: PW/PW res: [0x2b2ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.389046:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.389053:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+285:41278:x1731746394411136:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 46us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.389055:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11214 00010000:00010000:1.0:1651529333.389093:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b26b71e3/0x3234de053c4c399 lrc: 3/0,1 mode: PW/PW res: [0x2b2f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.389108:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b26b71e3/0x3234de053c4c399 lrc: 3/0,1 mode: PW/PW res: [0x2b2f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.389111:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b26b71e3/0x3234de053c4c399 lrc: 3/0,1 mode: PW/PW res: [0x2b2f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.389114:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b26b71e3/0x3234de053c4c399 lrc: 2/0,0 mode: PW/PW res: [0x2b2f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.389158:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1139:39030:x1731745946293696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 900us (1020us total) trans 12885078487 rc 0/0 00000100:00100000:1.0:1651529333.389161:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208583 00000100:00100000:1.0:1651529333.389266:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.389276:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.389282:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.389289:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.389301:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.389337:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ac8dec6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996934592:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.389343:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4c3bc lrc: 3/0,1 mode: --/PW res: [0x2b2f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.389349:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394411264 00010000:00010000:1.0:1651529333.389354:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000356fc356/0x3234de053c46106 lrc: 4/0,0 mode: PR/PR res: [0x2b2f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acaa5 expref: 283 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.389360:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394411328 00010000:00010000:1.0:1651529333.389362:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000027f7cb77/0x3234de053c46192 lrc: 4/0,0 mode: PR/PR res: [0x2b2f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acd3e expref: 285 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.389366:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394411456 00010000:00010000:1.0:1651529333.389368:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c44c53 lrc: 4/0,0 mode: PR/PR res: [0x2b2f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a77b6 expref: 286 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.389373:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11216 00000100:00100000:1.0:1651529333.389375:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+286:41278:x1731746394411264:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.389377:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.389379:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000356fc356/0x3234de053c46106 lrc: 4/0,0 mode: PR/PR res: [0x2b2f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acaa5 expref: 286 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.389385:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000356fc356/0x3234de053c46106 lrc: 3/0,0 mode: PR/PR res: [0x2b2f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acaa5 expref: 287 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.389391:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000356fc356/0x3234de053c46106 lrc: 0/0,0 mode: --/PR res: [0x2b2f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acaa5 expref: 287 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.389394:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.389395:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.389396:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f7cb3d9d/0x3234de053c4c3a7 lrc: 3/0,1 mode: PW/PW res: [0x2b2f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.389399:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7cb3d9d/0x3234de053c4c3a7 lrc: 4/0,1 mode: PW/PW res: [0x2b2f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.389409:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.389416:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+286:41278:x1731746394411264:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.389419:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11216 00000100:00100000:1.0:1651529333.389424:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11218 00000100:00100000:1.0:1651529333.389426:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d9169e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+284:41278:x1731746394411392:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.389428:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.389429:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c442a5 lrc: 4/0,0 mode: PR/PR res: [0x2b2f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a513d expref: 284 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.389433:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c442a5 lrc: 3/0,0 mode: PR/PR res: [0x2b2f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a513d expref: 284 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.389439:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c442a5 lrc: 0/0,0 mode: --/PR res: [0x2b2f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a513d expref: 284 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.389443:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.389443:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.389444:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000915ac1d0/0x3234de053c4c3b5 lrc: 3/0,1 mode: PW/PW res: [0x2b2f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.389447:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000915ac1d0/0x3234de053c4c3b5 lrc: 4/0,1 mode: PW/PW res: [0x2b2f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.389455:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.389461:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d9169e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+282:41278:x1731746394411392:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 35us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.389463:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11218 00000100:00100000:1.0:1651529333.389472:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11220 00000100:00100000:1.0:1651529333.389473:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+280:41279:x1731746394411520:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.389476:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.389477:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b2d92bf2/0x3234de053c45433 lrc: 5/0,0 mode: PR/PR res: [0x2b2f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a968e expref: 280 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.389481:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b2d92bf2/0x3234de053c45433 lrc: 4/0,0 mode: PR/PR res: [0x2b2f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a968e expref: 280 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.389493:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.389494:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.389495:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003324f656/0x3234de053c4c3c3 lrc: 3/0,1 mode: PW/PW res: [0x2b2f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.389498:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003324f656/0x3234de053c4c3c3 lrc: 4/0,1 mode: PW/PW res: [0x2b2f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.389502:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.389508:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+279:41279:x1731746394411520:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 34us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.389510:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11220 00010000:00010000:1.0:1651529333.389523:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4c3bc lrc: 3/0,1 mode: PW/PW res: [0x2b2f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.389526:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4c3bc lrc: 3/0,1 mode: PW/PW res: [0x2b2f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.389529:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4c3bc lrc: 3/0,1 mode: PW/PW res: [0x2b2f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.389532:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4c3bc lrc: 2/0,0 mode: PW/PW res: [0x2b2f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.389576:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1138:39029:x1731745946293888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 979us (1104us total) trans 12885078490 rc 0/0 00000100:00100000:1.0:1651529333.389579:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208588 00010000:00010000:1.0:1651529333.389587:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000776a84f4/0x3234de053c4c3ae lrc: 2/0,0 mode: PW/PW res: [0x2b2f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.389590:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000776a84f4 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.389591:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000776a84f4/0x3234de053c4c3ae lrc: 2/0,0 mode: PW/PW res: [0x2b2f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.389594:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000776a84f4/0x3234de053c4c3ae lrc: 3/0,0 mode: PW/PW res: [0x2b2f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.389599:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000776a84f4/0x3234de053c4c3ae lrc: 1/0,0 mode: --/PW res: [0x2b2f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.389601:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000776a84f4/0x3234de053c4c3ae lrc: 0/0,0 mode: --/PW res: [0x2b2f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.389606:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4c3bc lrc: 2/0,0 mode: PW/PW res: [0x2b2f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.389609:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cd6e2551 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.389609:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4c3bc lrc: 2/0,0 mode: PW/PW res: [0x2b2f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.389612:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4c3bc lrc: 3/0,0 mode: PW/PW res: [0x2b2f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.389615:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4c3bc lrc: 1/0,0 mode: --/PW res: [0x2b2f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.389618:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4c3bc lrc: 0/0,0 mode: --/PW res: [0x2b2f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.389633:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.389648:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.389671:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.389746:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394411584 00010000:00010000:1.0:1651529333.389752:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b3b7531a/0x3234de053c45d8d lrc: 4/0,0 mode: PR/PR res: [0x2b2f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abd07 expref: 279 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.389760:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11221 00000100:00100000:1.0:1651529333.389761:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+279:41279:x1731746394411584:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529333.389764:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.389765:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b3b7531a/0x3234de053c45d8d lrc: 4/0,0 mode: PR/PR res: [0x2b2f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abd07 expref: 279 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.389775:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b3b7531a/0x3234de053c45d8d lrc: 3/0,0 mode: PR/PR res: [0x2b2f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abd07 expref: 279 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.389781:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3b7531a/0x3234de053c45d8d lrc: 0/0,0 mode: --/PR res: [0x2b2f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abd07 expref: 279 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.389785:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.389785:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.389786:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002537ce87/0x3234de053c4c3ca lrc: 3/0,1 mode: PW/PW res: [0x2b2f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.389789:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002537ce87/0x3234de053c4c3ca lrc: 4/0,1 mode: PW/PW res: [0x2b2f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.389798:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.389805:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+278:41279:x1731746394411584:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 43us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.389808:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11221 00000100:00100000:1.0:1651529333.389818:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208592 00000100:00100000:1.0:1651529333.389819:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1139:39029:x1731745946294144:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.389824:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176889 count 1 00010000:00010000:1.0:1651529333.389828:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4c3d8 lrc: 3/0,1 mode: --/PW res: [0x2b2f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.389832:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c6649eef/0x3234de053c45c13 lrc: 2/0,0 mode: PR/PR res: [0x2b2f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab711 expref: 277 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.389835:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.389836:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.389836:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4c3d8 lrc: 4/0,1 mode: --/PW res: [0x2b2f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.389843:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c6649eef/0x3234de053c45c13 lrc: 3/0,0 mode: PR/PR res: [0x2b2f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab711 expref: 277 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.389846:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c6649eef/0x3234de053c45c13 lrc: 4/0,0 mode: PR/PR res: [0x2b2f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab711 expref: 277 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.389850:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003de40890 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996934848:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.389858:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fe434b1c going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.390137:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.390163:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.390175:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.390184:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.390192:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.390200:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.390208:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.390217:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946294272 00000100:00100000:1.0:1651529333.390241:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946294208 00000100:00100000:1.0:1651529333.390245:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946294400 00000100:00100000:1.0:1651529333.390247:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946294336 00000100:00100000:1.0:1651529333.390249:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946294464 00000100:00100000:1.0:1651529333.390251:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946294528 00000100:00100000:1.0:1651529333.390254:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208594 00000100:00100000:1.0:1651529333.390261:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1145:39029:x1731745946294272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.390267:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176891 count 1 00010000:00010000:1.0:1651529333.390271:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4c3e6 lrc: 3/0,1 mode: --/PW res: [0x2b2fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.390276:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000084321a20/0x3234de053c44759 lrc: 2/0,0 mode: PR/PR res: [0x2b2fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6468 expref: 277 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.390279:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.390280:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.390280:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4c3e6 lrc: 4/0,1 mode: --/PW res: [0x2b2fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.390287:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000084321a20/0x3234de053c44759 lrc: 3/0,0 mode: PR/PR res: [0x2b2fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6468 expref: 277 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.390290:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000084321a20/0x3234de053c44759 lrc: 4/0,0 mode: PR/PR res: [0x2b2fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6468 expref: 277 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.390297:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000fb8e412 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996934912:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.390306:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 0000000099c1da85 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.390312:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208596 00000100:00100000:1.0:1651529333.390314:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1145:39029:x1731745946294400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.390318:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176893 count 1 00010000:00010000:1.0:1651529333.390321:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4c3f4 lrc: 3/0,1 mode: --/PW res: [0x2b2fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.390326:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ecc067a7/0x3234de053c45ce5 lrc: 2/0,0 mode: PR/PR res: [0x2b2fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aba7c expref: 277 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.390329:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.390329:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.390330:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4c3f4 lrc: 4/0,1 mode: --/PW res: [0x2b2fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.390336:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ecc067a7/0x3234de053c45ce5 lrc: 3/0,0 mode: PR/PR res: [0x2b2fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aba7c expref: 277 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.390339:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ecc067a7/0x3234de053c45ce5 lrc: 4/0,0 mode: PR/PR res: [0x2b2fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aba7c expref: 277 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.390343:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005d2b5bb3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996935040:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.390349:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a4eb401d going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.390355:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208598 00000100:00100000:1.0:1651529333.390357:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1145:39030:x1731745946294464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.390360:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176894 count 1 00010000:00010000:1.0:1651529333.390363:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4c402 lrc: 3/0,1 mode: --/PW res: [0x2b2fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.390367:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000933c22d6/0x3234de053c4490b lrc: 2/0,0 mode: PR/PR res: [0x2b2fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6b37 expref: 277 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.390370:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.390371:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.390371:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4c402 lrc: 4/0,1 mode: --/PW res: [0x2b2fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.390377:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000933c22d6/0x3234de053c4490b lrc: 3/0,0 mode: PR/PR res: [0x2b2fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6b37 expref: 277 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.390381:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000933c22d6/0x3234de053c4490b lrc: 4/0,0 mode: PR/PR res: [0x2b2fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6b37 expref: 277 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.390385:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cee35a0c pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996935168:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.390391:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a6b79b05 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.390446:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.390456:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.390520:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003de40890 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996934848:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.390525:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4c3d8 lrc: 3/0,1 mode: --/PW res: [0x2b2f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.390534:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394411904 00010000:00010000:1.0:1651529333.390539:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000011253cb5/0x3234de053c43810 lrc: 4/0,0 mode: PR/PR res: [0x2b2f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a266b expref: 278 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.390546:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394411968 00010000:00010000:1.0:1651529333.390548:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c6649eef/0x3234de053c45c13 lrc: 4/0,0 mode: PR/PR res: [0x2b2f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab711 expref: 279 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.390558:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11222 00000100:00100000:1.0:1651529333.390560:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+279:41279:x1731746394411904:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.390563:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.390564:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000011253cb5/0x3234de053c43810 lrc: 4/0,0 mode: PR/PR res: [0x2b2f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a266b expref: 279 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.390568:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000011253cb5/0x3234de053c43810 lrc: 3/0,0 mode: PR/PR res: [0x2b2f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a266b expref: 279 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.390574:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011253cb5/0x3234de053c43810 lrc: 0/0,0 mode: --/PR res: [0x2b2f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a266b expref: 279 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.390578:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.390578:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.390579:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006c0d3581/0x3234de053c4c3d1 lrc: 3/0,1 mode: PW/PW res: [0x2b2f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.390582:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c0d3581/0x3234de053c4c3d1 lrc: 4/0,1 mode: PW/PW res: [0x2b2f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.390591:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.390600:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+277:41279:x1731746394411904:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 39us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.390608:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11222 00010000:00010000:1.0:1651529333.390616:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4c3d8 lrc: 3/0,1 mode: PW/PW res: [0x2b2f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.390619:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4c3d8 lrc: 3/0,1 mode: PW/PW res: [0x2b2f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.390622:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4c3d8 lrc: 3/0,1 mode: PW/PW res: [0x2b2f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.390625:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4c3d8 lrc: 2/0,0 mode: PW/PW res: [0x2b2f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.390664:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1147:39029:x1731745946294144:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 844us (993us total) trans 12885078495 rc 0/0 00000100:00100000:1.0:1651529333.390667:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208592 00010000:00010000:1.0:1651529333.390674:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4c3d8 lrc: 2/0,0 mode: PW/PW res: [0x2b2f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.390677:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008270dfe9 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.390678:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4c3d8 lrc: 2/0,0 mode: PW/PW res: [0x2b2f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.390683:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4c3d8 lrc: 3/0,0 mode: PW/PW res: [0x2b2f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.390688:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4c3d8 lrc: 1/0,0 mode: --/PW res: [0x2b2f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.390691:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4c3d8 lrc: 0/0,0 mode: --/PW res: [0x2b2f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.390917:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.390933:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.390956:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.390964:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.390970:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.390977:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.390983:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.390988:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.390996:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000fb8e412 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996934912:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.391001:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4c3e6 lrc: 3/0,1 mode: --/PW res: [0x2b2fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.391015:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005d2b5bb3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996935040:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.391018:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4c3f4 lrc: 3/0,1 mode: --/PW res: [0x2b2fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.391025:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cee35a0c pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996935168:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.391028:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4c402 lrc: 3/0,1 mode: --/PW res: [0x2b2fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.391034:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394412160 00010000:00010000:1.0:1651529333.391039:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000084321a20/0x3234de053c44759 lrc: 4/0,0 mode: PR/PR res: [0x2b2fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6468 expref: 276 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.391044:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11224 00000100:00100000:1.0:1651529333.391046:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b5574957 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+276:41278:x1731746394412160:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.391049:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.391050:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000084321a20/0x3234de053c44759 lrc: 4/0,0 mode: PR/PR res: [0x2b2fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6468 expref: 276 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.391053:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000084321a20/0x3234de053c44759 lrc: 3/0,0 mode: PR/PR res: [0x2b2fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6468 expref: 276 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.391059:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084321a20/0x3234de053c44759 lrc: 0/0,0 mode: --/PR res: [0x2b2fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6468 expref: 276 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.391063:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.391063:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.391064:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4c3e6 lrc: 3/0,1 mode: PW/PW res: [0x2b2fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.391067:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4c3e6 lrc: 4/0,1 mode: PW/PW res: [0x2b2fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.391076:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.391083:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b5574957 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+276:41278:x1731746394412160:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 36us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.391086:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11224 00000100:00100000:1.0:1651529333.391094:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394412224 00010000:00010000:1.0:1651529333.391097:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e4b5c5d1/0x3234de053c463a6 lrc: 4/0,0 mode: PR/PR res: [0x2b2fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ad5f0 expref: 277 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.391102:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394412480 00010000:00010000:1.0:1651529333.391104:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000737717cf/0x3234de053c455c2 lrc: 4/0,0 mode: PR/PR res: [0x2b2ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9c7d expref: 279 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.391110:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11226 00000100:00100000:1.0:1651529333.391111:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+279:41278:x1731746394412416:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.391114:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.391115:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000933c22d6/0x3234de053c4490b lrc: 4/0,0 mode: PR/PR res: [0x2b2fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6b37 expref: 279 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.391119:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000933c22d6/0x3234de053c4490b lrc: 3/0,0 mode: PR/PR res: [0x2b2fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6b37 expref: 279 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.391123:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000933c22d6/0x3234de053c4490b lrc: 0/0,0 mode: --/PR res: [0x2b2fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6b37 expref: 279 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.391127:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.391127:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.391128:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4c402 lrc: 3/0,1 mode: PW/PW res: [0x2b2fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.391131:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4c402 lrc: 4/0,1 mode: PW/PW res: [0x2b2fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.391143:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.391150:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+277:41278:x1731746394412416:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 38us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.391152:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11226 00000100:00100000:1.0:1651529333.391158:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11228 00000100:00100000:1.0:1651529333.391159:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+275:41278:x1731746394412352:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.391162:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.391163:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a0ad04d0/0x3234de053c439c2 lrc: 4/0,0 mode: PR/PR res: [0x2b2fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2c7d expref: 275 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.391167:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a0ad04d0/0x3234de053c439c2 lrc: 3/0,0 mode: PR/PR res: [0x2b2fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2c7d expref: 275 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.391172:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0ad04d0/0x3234de053c439c2 lrc: 0/0,0 mode: --/PR res: [0x2b2fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2c7d expref: 275 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.391175:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.391176:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.391177:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f87a625c/0x3234de053c4c3fb lrc: 3/0,1 mode: PW/PW res: [0x2b2fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.391182:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f87a625c/0x3234de053c4c3fb lrc: 4/0,1 mode: PW/PW res: [0x2b2fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.391191:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.391196:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+273:41278:x1731746394412352:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 37us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.391199:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11228 00000100:00100000:1.0:1651529333.391203:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11229 00000100:00100000:1.0:1651529333.391205:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+272:41278:x1731746394412480:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.391207:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.391209:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000737717cf/0x3234de053c455c2 lrc: 4/0,0 mode: PR/PR res: [0x2b2ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9c7d expref: 272 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.391212:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000737717cf/0x3234de053c455c2 lrc: 3/0,0 mode: PR/PR res: [0x2b2ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9c7d expref: 272 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.391217:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000737717cf/0x3234de053c455c2 lrc: 0/0,0 mode: --/PR res: [0x2b2ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9c7d expref: 272 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.391220:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.391221:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.391232:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c83c6fc1/0x3234de053c4c409 lrc: 3/0,1 mode: PW/PW res: [0x2b2ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.391240:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c83c6fc1/0x3234de053c4c409 lrc: 4/0,1 mode: PW/PW res: [0x2b2ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.391252:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.391258:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+270:41278:x1731746394412480:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 52us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.391261:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11229 00010000:00010000:1.0:1651529333.391271:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4c402 lrc: 3/0,1 mode: PW/PW res: [0x2b2fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.391274:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4c402 lrc: 3/0,1 mode: PW/PW res: [0x2b2fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.391277:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4c402 lrc: 3/0,1 mode: PW/PW res: [0x2b2fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.391280:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4c402 lrc: 2/0,0 mode: PW/PW res: [0x2b2fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.391322:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1148:39030:x1731745946294464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 964us (1121us total) trans 12885078498 rc 0/0 00000100:00100000:1.0:1651529333.391325:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208598 00010000:00010000:1.0:1651529333.391332:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4c3e6 lrc: 3/0,1 mode: PW/PW res: [0x2b2fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.391335:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4c3e6 lrc: 3/0,1 mode: PW/PW res: [0x2b2fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.391338:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4c3e6 lrc: 3/0,1 mode: PW/PW res: [0x2b2fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.391342:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4c3e6 lrc: 2/0,0 mode: PW/PW res: [0x2b2fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.391387:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1149:39029:x1731745946294272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1130us (1229us total) trans 12885078499 rc 0/0 00000100:00100000:1.0:1651529333.391390:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208594 00010000:00010000:1.0:1651529333.391397:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4c3e6 lrc: 2/0,0 mode: PW/PW res: [0x2b2fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.391400:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003aeb15a8 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.391401:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4c3e6 lrc: 2/0,0 mode: PW/PW res: [0x2b2fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.391404:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4c3e6 lrc: 3/0,0 mode: PW/PW res: [0x2b2fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.391408:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4c3e6 lrc: 1/0,0 mode: --/PW res: [0x2b2fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.391411:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4c3e6 lrc: 0/0,0 mode: --/PW res: [0x2b2fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.391417:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4c3f4 lrc: 3/0,1 mode: PW/PW res: [0x2b2fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.391420:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4c3f4 lrc: 3/0,1 mode: PW/PW res: [0x2b2fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.391423:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4c3f4 lrc: 3/0,1 mode: PW/PW res: [0x2b2fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.391426:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4c3f4 lrc: 2/0,0 mode: PW/PW res: [0x2b2fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.391473:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1149:39029:x1731745946294400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1158us (1288us total) trans 12885078501 rc 0/0 00000100:00100000:1.0:1651529333.391475:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208596 00010000:00010000:1.0:1651529333.391483:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4c3f4 lrc: 2/0,0 mode: PW/PW res: [0x2b2fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.391486:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb5dc195 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.391487:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4c3f4 lrc: 2/0,0 mode: PW/PW res: [0x2b2fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.391489:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4c3f4 lrc: 3/0,0 mode: PW/PW res: [0x2b2fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.391494:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4c3f4 lrc: 1/0,0 mode: --/PW res: [0x2b2fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.391497:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4c3f4 lrc: 0/0,0 mode: --/PW res: [0x2b2fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.391502:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc418822/0x3234de053c4c3ed lrc: 2/0,0 mode: PW/PW res: [0x2b2fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.391505:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cc418822 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.391505:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc418822/0x3234de053c4c3ed lrc: 2/0,0 mode: PW/PW res: [0x2b2fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.391508:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc418822/0x3234de053c4c3ed lrc: 3/0,0 mode: PW/PW res: [0x2b2fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.391511:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc418822/0x3234de053c4c3ed lrc: 1/0,0 mode: --/PW res: [0x2b2fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.391514:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc418822/0x3234de053c4c3ed lrc: 0/0,0 mode: --/PW res: [0x2b2fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.391528:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.391725:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.391740:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946294720 00000100:00100000:1.0:1651529333.391750:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208603 00000100:00100000:1.0:1651529333.391751:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1148:39029:x1731745946294720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.391757:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176898 count 1 00010000:00010000:1.0:1651529333.391761:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4c425 lrc: 3/0,1 mode: --/PW res: [0x2b302:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.391766:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006816963f/0x3234de053c44e98 lrc: 2/0,0 mode: PR/PR res: [0x2b302:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7fff expref: 270 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.391769:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.391770:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.391770:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4c425 lrc: 4/0,1 mode: --/PW res: [0x2b302:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.391777:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006816963f/0x3234de053c44e98 lrc: 3/0,0 mode: PR/PR res: [0x2b302:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7fff expref: 270 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.391781:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006816963f/0x3234de053c44e98 lrc: 4/0,0 mode: PR/PR res: [0x2b302:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7fff expref: 270 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.391785:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000043b7984f pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996935424:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.391796:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b7af823 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.391853:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.391863:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.391872:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.391887:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.391901:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.391913:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946294912 00000100:00100000:1.0:1651529333.391920:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208604 00000100:00100000:1.0:1651529333.391921:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1153:39029:x1731745946294784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.391932:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176899 count 1 00010000:00010000:1.0:1651529333.391936:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4c42c lrc: 3/0,1 mode: --/PW res: [0x2b303:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.391941:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf9a0d82/0x3234de053c46ca5 lrc: 2/0,0 mode: PR/PR res: [0x2b303:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afc8c expref: 270 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.391944:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.391945:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.391946:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4c42c lrc: 4/0,1 mode: --/PW res: [0x2b303:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.391952:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bf9a0d82/0x3234de053c46ca5 lrc: 3/0,0 mode: PR/PR res: [0x2b303:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afc8c expref: 270 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.391956:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bf9a0d82/0x3234de053c46ca5 lrc: 4/0,0 mode: PR/PR res: [0x2b303:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afc8c expref: 270 pid: 80277 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.391960:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ebb53b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996935488:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.391969:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a4eb401d going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.391975:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208606 00000100:00100000:1.0:1651529333.391977:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1153:39030:x1731745946294976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.391981:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176902 count 1 00010000:00010000:1.0:1651529333.391984:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4c43a lrc: 3/0,1 mode: --/PW res: [0x2b306:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.391988:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006f926d75/0x3234de053c43f72 lrc: 2/0,0 mode: PR/PR res: [0x2b306:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a42e2 expref: 270 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.391991:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.391992:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.391992:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4c43a lrc: 4/0,1 mode: --/PW res: [0x2b306:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.391998:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006f926d75/0x3234de053c43f72 lrc: 3/0,0 mode: PR/PR res: [0x2b306:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a42e2 expref: 270 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.392005:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006f926d75/0x3234de053c43f72 lrc: 4/0,0 mode: PR/PR res: [0x2b306:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a42e2 expref: 270 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.392008:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000533fe698 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996935616:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.392015:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 0000000099c1da85 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.392020:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208608 00000100:00100000:1.0:1651529333.392022:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1153:39030:x1731745946294912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.392026:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176901 count 1 00010000:00010000:1.0:1651529333.392029:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7d5d09f/0x3234de053c4c448 lrc: 3/0,1 mode: --/PW res: [0x2b305:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.392033:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002af24676/0x3234de053c44ae0 lrc: 2/0,0 mode: PR/PR res: [0x2b305:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a72a7 expref: 270 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.392036:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.392036:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.392037:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7d5d09f/0x3234de053c4c448 lrc: 4/0,1 mode: --/PW res: [0x2b305:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.392043:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002af24676/0x3234de053c44ae0 lrc: 3/0,0 mode: PR/PR res: [0x2b305:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a72a7 expref: 270 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.392046:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002af24676/0x3234de053c44ae0 lrc: 4/0,0 mode: PR/PR res: [0x2b305:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a72a7 expref: 270 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.392053:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ac8dec6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996935744:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.392059:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fe434b1c going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.392090:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.392151:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.392164:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.392191:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.392199:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394412928 00010000:00010000:1.0:1651529333.392204:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008acce999/0x3234de053c44e3d lrc: 4/0,0 mode: PR/PR res: [0x2b300:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7eee expref: 272 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.392215:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394413056 00010000:00010000:1.0:1651529333.392218:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006816963f/0x3234de053c44e98 lrc: 5/0,0 mode: PR/PR res: [0x2b302:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7fff expref: 273 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.392244:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11230 00000100:00100000:1.0:1651529333.392246:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+274:41278:x1731746394412928:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.392249:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.392250:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008acce999/0x3234de053c44e3d lrc: 4/0,0 mode: PR/PR res: [0x2b300:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7eee expref: 274 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.392254:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008acce999/0x3234de053c44e3d lrc: 3/0,0 mode: PR/PR res: [0x2b300:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7eee expref: 274 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.392260:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008acce999/0x3234de053c44e3d lrc: 0/0,0 mode: --/PR res: [0x2b300:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7eee expref: 274 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.392273:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.392273:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.392274:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c4c417 lrc: 3/0,1 mode: PW/PW res: [0x2b300:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.392277:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c4c417 lrc: 4/0,1 mode: PW/PW res: [0x2b300:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.392287:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.392295:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+273:41278:x1731746394412928:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 49us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.392298:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11230 00000100:00100000:1.0:1651529333.392303:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11232 00000100:00100000:1.0:1651529333.392305:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+272:41278:x1731746394412992:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.392307:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.392309:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001b209a0f/0x3234de053c46607 lrc: 4/0,0 mode: PR/PR res: [0x2b301:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae03f expref: 272 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.392313:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001b209a0f/0x3234de053c46607 lrc: 3/0,0 mode: PR/PR res: [0x2b301:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae03f expref: 272 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.392318:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b209a0f/0x3234de053c46607 lrc: 0/0,0 mode: --/PR res: [0x2b301:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae03f expref: 272 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.392322:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.392322:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.392323:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000052ea5946/0x3234de053c4c410 lrc: 3/0,1 mode: PW/PW res: [0x2b301:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.392326:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052ea5946/0x3234de053c4c410 lrc: 4/0,1 mode: PW/PW res: [0x2b301:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.392335:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.392340:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+270:41278:x1731746394412992:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 35us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.392343:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11232 00010000:00010000:1.0:1651529333.392356:0:72397:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006816963f/0x3234de053c44e98 lrc: 0/0,0 mode: --/PR res: [0x2b302:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7fff expref: 269 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.392360:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000043b7984f pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996935424:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.392364:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4c425 lrc: 3/0,1 mode: PW/PW res: [0x2b302:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.392367:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4c425 lrc: 3/0,1 mode: PW/PW res: [0x2b302:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.392370:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4c425 lrc: 3/0,1 mode: PW/PW res: [0x2b302:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.392373:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4c425 lrc: 3/0,1 mode: PW/PW res: [0x2b302:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.392375:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4c425 lrc: 2/0,0 mode: PW/PW res: [0x2b302:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.392419:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1154:39029:x1731745946294720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 667us (695us total) trans 12885078504 rc 0/0 00000100:00100000:1.0:1651529333.392422:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208603 00000100:00100000:1.0:1651529333.392518:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.392524:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.392530:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.392561:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529333.392571:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000052ea5946/0x3234de053c4c410 lrc: 2/0,0 mode: PW/PW res: [0x2b301:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.392575:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000052ea5946 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.392576:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000052ea5946/0x3234de053c4c410 lrc: 2/0,0 mode: PW/PW res: [0x2b301:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.392580:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000052ea5946/0x3234de053c4c410 lrc: 3/0,0 mode: PW/PW res: [0x2b301:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.392584:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000052ea5946/0x3234de053c4c410 lrc: 1/0,0 mode: --/PW res: [0x2b301:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.392587:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052ea5946/0x3234de053c4c410 lrc: 0/0,0 mode: --/PW res: [0x2b301:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.392597:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ebb53b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996935488:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.392601:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4c42c lrc: 3/0,1 mode: --/PW res: [0x2b303:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.392610:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000533fe698 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996935616:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.392612:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4c43a lrc: 3/0,1 mode: --/PW res: [0x2b306:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.392619:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11233 00000100:00100000:1.0:1651529333.392621:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+272:41278:x1731746394413184:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.392624:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.392626:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000011d5f1b1/0x3234de053c44d10 lrc: 4/0,0 mode: PR/PR res: [0x2b304:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7afe expref: 272 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.392629:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000011d5f1b1/0x3234de053c44d10 lrc: 3/0,0 mode: PR/PR res: [0x2b304:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7afe expref: 272 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.392634:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011d5f1b1/0x3234de053c44d10 lrc: 0/0,0 mode: --/PR res: [0x2b304:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7afe expref: 272 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.392645:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.392645:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.392646:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004df6544e/0x3234de053c4c433 lrc: 3/0,1 mode: PW/PW res: [0x2b304:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.392649:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004df6544e/0x3234de053c4c433 lrc: 4/0,1 mode: PW/PW res: [0x2b304:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.392658:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.392666:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+270:41278:x1731746394413184:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 44us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.392669:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11233 00000100:00100000:1.0:1651529333.392674:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11235 00000100:00100000:1.0:1651529333.392676:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+269:41278:x1731746394413120:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529333.392678:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.392680:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bf9a0d82/0x3234de053c46ca5 lrc: 4/0,0 mode: PR/PR res: [0x2b303:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afc8c expref: 269 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.392684:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bf9a0d82/0x3234de053c46ca5 lrc: 3/0,0 mode: PR/PR res: [0x2b303:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afc8c expref: 269 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.392689:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf9a0d82/0x3234de053c46ca5 lrc: 0/0,0 mode: --/PR res: [0x2b303:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2afc8c expref: 269 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.392692:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.392693:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.392694:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4c42c lrc: 3/0,1 mode: PW/PW res: [0x2b303:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.392697:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4c42c lrc: 4/0,1 mode: PW/PW res: [0x2b303:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.392703:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.392708:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+267:41278:x1731746394413120:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 31us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.392710:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11235 00010000:00010000:1.0:1651529333.392717:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4c42c lrc: 3/0,1 mode: PW/PW res: [0x2b303:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.392720:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4c42c lrc: 3/0,1 mode: PW/PW res: [0x2b303:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.392723:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4c42c lrc: 3/0,1 mode: PW/PW res: [0x2b303:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.392726:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4c42c lrc: 2/0,0 mode: PW/PW res: [0x2b303:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.392781:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1154:39029:x1731745946294784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 859us (934us total) trans 12885078506 rc 0/0 00000100:00100000:1.0:1651529333.392784:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208604 00010000:00010000:1.0:1651529333.392791:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4c43a lrc: 3/0,1 mode: PW/PW res: [0x2b306:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.392794:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4c43a lrc: 3/0,1 mode: PW/PW res: [0x2b306:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.392797:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4c43a lrc: 3/0,1 mode: PW/PW res: [0x2b306:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.392800:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4c43a lrc: 2/0,0 mode: PW/PW res: [0x2b306:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.392833:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1155:39030:x1731745946294976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 856us (961us total) trans 12885078508 rc 0/0 00000100:00100000:1.0:1651529333.392837:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208606 00010000:00010000:1.0:1651529333.392843:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000441232d4/0x3234de053c4c441 lrc: 2/0,0 mode: PW/PW res: [0x2b307:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.392847:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000441232d4 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.392848:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000441232d4/0x3234de053c4c441 lrc: 2/0,0 mode: PW/PW res: [0x2b307:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.392850:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000441232d4/0x3234de053c4c441 lrc: 3/0,0 mode: PW/PW res: [0x2b307:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.392855:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000441232d4/0x3234de053c4c441 lrc: 1/0,0 mode: --/PW res: [0x2b307:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.392858:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000441232d4/0x3234de053c4c441 lrc: 0/0,0 mode: --/PW res: [0x2b307:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.392893:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.392922:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.392939:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.392959:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.393053:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ac8dec6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996935744:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.393058:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c7d5d09f/0x3234de053c4c448 lrc: 3/0,1 mode: --/PW res: [0x2b305:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.393066:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208612 00000100:00100000:1.0:1651529333.393068:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1156:39029:x1731745946295232:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.393074:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176906 count 1 00010000:00010000:1.0:1651529333.393078:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e71292e1/0x3234de053c4c464 lrc: 3/0,1 mode: --/PW res: [0x2b30a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.393089:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d728c5bd/0x3234de053c45e97 lrc: 2/0,0 mode: PR/PR res: [0x2b30a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac13d expref: 264 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.393093:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.393093:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.393094:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e71292e1/0x3234de053c4c464 lrc: 4/0,1 mode: --/PW res: [0x2b30a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.393101:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d728c5bd/0x3234de053c45e97 lrc: 3/0,0 mode: PR/PR res: [0x2b30a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac13d expref: 264 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.393104:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d728c5bd/0x3234de053c45e97 lrc: 4/0,0 mode: PR/PR res: [0x2b30a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac13d expref: 264 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.393108:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cee35a0c pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996935936:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.393117:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fe434b1c going to sleep for 6 seconds 00010000:00010000:1.0:1651529333.393122:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004df6544e/0x3234de053c4c433 lrc: 2/0,0 mode: PW/PW res: [0x2b304:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.393125:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004df6544e already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.393126:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004df6544e/0x3234de053c4c433 lrc: 2/0,0 mode: PW/PW res: [0x2b304:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.393131:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004df6544e/0x3234de053c4c433 lrc: 3/0,0 mode: PW/PW res: [0x2b304:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.393136:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004df6544e/0x3234de053c4c433 lrc: 1/0,0 mode: --/PW res: [0x2b304:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.393139:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004df6544e/0x3234de053c4c433 lrc: 0/0,0 mode: --/PW res: [0x2b304:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.393147:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394413568 00010000:00010000:1.0:1651529333.393152:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002af24676/0x3234de053c44ae0 lrc: 4/0,0 mode: PR/PR res: [0x2b305:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a72a7 expref: 265 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.393164:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11237 00000100:00100000:1.0:1651529333.393166:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+265:41278:x1731746394413568:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529333.393169:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.393170:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002af24676/0x3234de053c44ae0 lrc: 4/0,0 mode: PR/PR res: [0x2b305:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a72a7 expref: 265 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.393174:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002af24676/0x3234de053c44ae0 lrc: 3/0,0 mode: PR/PR res: [0x2b305:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a72a7 expref: 265 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.393178:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002af24676/0x3234de053c44ae0 lrc: 0/0,0 mode: --/PR res: [0x2b305:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a72a7 expref: 265 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.393184:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.393185:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.393186:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c7d5d09f/0x3234de053c4c448 lrc: 3/0,1 mode: PW/PW res: [0x2b305:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.393189:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7d5d09f/0x3234de053c4c448 lrc: 4/0,1 mode: PW/PW res: [0x2b305:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.393195:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.393202:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+264:41278:x1731746394413568:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.393204:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11237 00010000:00010000:1.0:1651529333.393210:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c7d5d09f/0x3234de053c4c448 lrc: 3/0,1 mode: PW/PW res: [0x2b305:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.393213:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7d5d09f/0x3234de053c4c448 lrc: 3/0,1 mode: PW/PW res: [0x2b305:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.393216:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7d5d09f/0x3234de053c4c448 lrc: 3/0,1 mode: PW/PW res: [0x2b305:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.393219:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7d5d09f/0x3234de053c4c448 lrc: 2/0,0 mode: PW/PW res: [0x2b305:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.393275:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1157:39030:x1731745946294912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1253us (1374us total) trans 12885078510 rc 0/0 00000100:00100000:1.0:1651529333.393278:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208608 00000100:00100000:1.0:1651529333.393315:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.393330:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.393358:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.393411:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.393423:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.393433:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394413632 00000100:00100000:1.0:1651529333.393442:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946295360 00000100:00100000:1.0:1651529333.393445:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946295488 00000100:00100000:1.0:1651529333.393448:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208613 00000100:00100000:1.0:1651529333.393450:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1160:39030:x1731745946295296:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.393455:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176907 count 1 00010000:00010000:1.0:1651529333.393460:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000578d2cb4/0x3234de053c4c46b lrc: 3/0,1 mode: --/PW res: [0x2b30b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.393470:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c44b3b lrc: 2/0,0 mode: PR/PR res: [0x2b30b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a740c expref: 264 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.393474:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.393474:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.393475:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000578d2cb4/0x3234de053c4c46b lrc: 4/0,1 mode: --/PW res: [0x2b30b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.393482:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c44b3b lrc: 3/0,0 mode: PR/PR res: [0x2b30b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a740c expref: 264 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.393485:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c44b3b lrc: 4/0,0 mode: PR/PR res: [0x2b30b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a740c expref: 265 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.393489:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f7006631 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996936000:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.393498:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c3caa148 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.393505:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208615 00000100:00100000:1.0:1651529333.393507:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1160:39029:x1731745946295424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.393511:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176909 count 1 00010000:00010000:1.0:1651529333.393514:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000705cc353/0x3234de053c4c479 lrc: 3/0,1 mode: --/PW res: [0x2b30d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.393518:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d7a48337/0x3234de053c45b9c lrc: 2/0,0 mode: PR/PR res: [0x2b30d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab57b expref: 264 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.393521:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.393522:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.393522:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000705cc353/0x3234de053c4c479 lrc: 4/0,1 mode: --/PW res: [0x2b30d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.393528:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d7a48337/0x3234de053c45b9c lrc: 3/0,0 mode: PR/PR res: [0x2b30d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab57b expref: 264 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.393531:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d7a48337/0x3234de053c45b9c lrc: 4/0,0 mode: PR/PR res: [0x2b30d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab57b expref: 264 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.393535:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a925fbf6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996936064:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.393541:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b7af823 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.393547:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208617 00000100:00100000:1.0:1651529333.393548:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1160:39030:x1731745946295488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.393552:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176910 count 1 00010000:00010000:1.0:1651529333.393555:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c4c487 lrc: 3/0,1 mode: --/PW res: [0x2b30e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.393559:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c0588f4c/0x3234de053c46917 lrc: 2/0,0 mode: PR/PR res: [0x2b30e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aec2b expref: 264 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.393562:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.393563:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.393563:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c4c487 lrc: 4/0,1 mode: --/PW res: [0x2b30e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.393569:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c0588f4c/0x3234de053c46917 lrc: 3/0,0 mode: PR/PR res: [0x2b30e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aec2b expref: 264 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.393573:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c0588f4c/0x3234de053c46917 lrc: 4/0,0 mode: PR/PR res: [0x2b30e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aec2b expref: 264 pid: 80277 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.393577:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f99b3c22 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996936192:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.393583:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cfa1ca05 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.393594:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.393685:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.393694:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.393709:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cee35a0c pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996935936:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.393714:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e71292e1/0x3234de053c4c464 lrc: 3/0,1 mode: --/PW res: [0x2b30a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.393721:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394413824 00010000:00010000:1.0:1651529333.393726:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c53753be/0x3234de053c441be lrc: 4/0,0 mode: PR/PR res: [0x2b309:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4da8 expref: 265 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.393743:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394413952 00010000:00010000:1.0:1651529333.393747:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d728c5bd/0x3234de053c45e97 lrc: 4/0,0 mode: PR/PR res: [0x2b30a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac13d expref: 266 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.393752:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11238 00000100:00100000:1.0:1651529333.393754:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001743f524 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+266:41278:x1731746394413824:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.393757:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.393758:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c53753be/0x3234de053c441be lrc: 4/0,0 mode: PR/PR res: [0x2b309:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4da8 expref: 266 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.393762:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c53753be/0x3234de053c441be lrc: 3/0,0 mode: PR/PR res: [0x2b309:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4da8 expref: 266 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.393768:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c53753be/0x3234de053c441be lrc: 0/0,0 mode: --/PR res: [0x2b309:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4da8 expref: 266 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.393772:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.393772:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.393773:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000092b1d4a6/0x3234de053c4c456 lrc: 3/0,1 mode: PW/PW res: [0x2b309:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.393776:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092b1d4a6/0x3234de053c4c456 lrc: 4/0,1 mode: PW/PW res: [0x2b309:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.393786:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.393794:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001743f524 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+264:41278:x1731746394413824:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 39us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.393802:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11238 00010000:00010000:1.0:1651529333.393814:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e71292e1/0x3234de053c4c464 lrc: 3/0,1 mode: PW/PW res: [0x2b30a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.393818:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e71292e1/0x3234de053c4c464 lrc: 3/0,1 mode: PW/PW res: [0x2b30a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.393821:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e71292e1/0x3234de053c4c464 lrc: 3/0,1 mode: PW/PW res: [0x2b30a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.393823:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e71292e1/0x3234de053c4c464 lrc: 2/0,0 mode: PW/PW res: [0x2b30a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.393872:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1163:39029:x1731745946295232:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 802us (933us total) trans 12885078511 rc 0/0 00000100:00100000:1.0:1651529333.393875:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208612 00010000:00010000:1.0:1651529333.393882:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e71292e1/0x3234de053c4c464 lrc: 2/0,0 mode: PW/PW res: [0x2b30a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.393885:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e71292e1 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.393886:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e71292e1/0x3234de053c4c464 lrc: 2/0,0 mode: PW/PW res: [0x2b30a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.393889:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e71292e1/0x3234de053c4c464 lrc: 3/0,0 mode: PW/PW res: [0x2b30a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.393893:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e71292e1/0x3234de053c4c464 lrc: 1/0,0 mode: --/PW res: [0x2b30a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.393896:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e71292e1/0x3234de053c4c464 lrc: 0/0,0 mode: --/PW res: [0x2b30a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.393911:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.393989:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.394016:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.394030:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.394039:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f7006631 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996936000:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.394043:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000578d2cb4/0x3234de053c4c46b lrc: 3/0,1 mode: --/PW res: [0x2b30b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.394064:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a925fbf6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996936064:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.394067:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000705cc353/0x3234de053c4c479 lrc: 3/0,1 mode: --/PW res: [0x2b30d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.394074:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11241 00000100:00100000:1.0:1651529333.394076:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+266:41278:x1731746394414080:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529333.394080:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.394081:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d7a48337/0x3234de053c45b9c lrc: 4/0,0 mode: PR/PR res: [0x2b30d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab57b expref: 266 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.394085:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d7a48337/0x3234de053c45b9c lrc: 3/0,0 mode: PR/PR res: [0x2b30d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab57b expref: 266 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.394094:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7a48337/0x3234de053c45b9c lrc: 0/0,0 mode: --/PR res: [0x2b30d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab57b expref: 265 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.394098:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.394098:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.394099:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000705cc353/0x3234de053c4c479 lrc: 3/0,1 mode: PW/PW res: [0x2b30d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.394102:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000705cc353/0x3234de053c4c479 lrc: 4/0,1 mode: PW/PW res: [0x2b30d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.394108:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.394115:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+264:41278:x1731746394414080:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.394118:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11241 00000100:00100000:1.0:1651529333.394123:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11242 00000100:00100000:1.0:1651529333.394125:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+263:41279:x1731746394414016:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.394127:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.394128:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c44b3b lrc: 4/0,0 mode: PR/PR res: [0x2b30b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a740c expref: 263 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.394132:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c44b3b lrc: 3/0,0 mode: PR/PR res: [0x2b30b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a740c expref: 263 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.394137:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c44b3b lrc: 0/0,0 mode: --/PR res: [0x2b30b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a740c expref: 262 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.394143:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.394144:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.394145:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000578d2cb4/0x3234de053c4c46b lrc: 3/0,1 mode: PW/PW res: [0x2b30b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.394147:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000578d2cb4/0x3234de053c4c46b lrc: 4/0,1 mode: PW/PW res: [0x2b30b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.394153:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.394158:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+261:41279:x1731746394414016:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 32us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.394160:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11242 00010000:00010000:1.0:1651529333.394166:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000578d2cb4/0x3234de053c4c46b lrc: 3/0,1 mode: PW/PW res: [0x2b30b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.394169:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000578d2cb4/0x3234de053c4c46b lrc: 3/0,1 mode: PW/PW res: [0x2b30b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.394172:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000578d2cb4/0x3234de053c4c46b lrc: 3/0,1 mode: PW/PW res: [0x2b30b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.394175:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000578d2cb4/0x3234de053c4c46b lrc: 2/0,0 mode: PW/PW res: [0x2b30b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.394239:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1163:39030:x1731745946295296:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 784us (920us total) trans 12885078513 rc 0/0 00000100:00100000:1.0:1651529333.394243:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208613 00010000:00010000:1.0:1651529333.394251:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000705cc353/0x3234de053c4c479 lrc: 3/0,1 mode: PW/PW res: [0x2b30d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.394255:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000705cc353/0x3234de053c4c479 lrc: 3/0,1 mode: PW/PW res: [0x2b30d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.394258:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000705cc353/0x3234de053c4c479 lrc: 3/0,1 mode: PW/PW res: [0x2b30d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.394260:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000705cc353/0x3234de053c4c479 lrc: 2/0,0 mode: PW/PW res: [0x2b30d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.394301:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1162:39029:x1731745946295424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 794us (943us total) trans 12885078515 rc 0/0 00000100:00100000:1.0:1651529333.394304:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208615 00010000:00010000:1.0:1651529333.394312:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000705cc353/0x3234de053c4c479 lrc: 2/0,0 mode: PW/PW res: [0x2b30d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.394315:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000705cc353 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.394316:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000705cc353/0x3234de053c4c479 lrc: 2/0,0 mode: PW/PW res: [0x2b30d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.394319:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000705cc353/0x3234de053c4c479 lrc: 3/0,0 mode: PW/PW res: [0x2b30d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.394323:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000705cc353/0x3234de053c4c479 lrc: 1/0,0 mode: --/PW res: [0x2b30d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.394329:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000705cc353/0x3234de053c4c479 lrc: 0/0,0 mode: --/PW res: [0x2b30d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.394378:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.394388:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.394398:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.394442:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.394491:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f99b3c22 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996936192:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.394495:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c4c487 lrc: 3/0,1 mode: --/PW res: [0x2b30e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.394504:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394414208 00010000:00010000:1.0:1651529333.394509:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c0588f4c/0x3234de053c46917 lrc: 4/0,0 mode: PR/PR res: [0x2b30e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aec2b expref: 259 pid: 80277 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.394516:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394414336 00010000:00010000:1.0:1651529333.394518:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ec163e8e/0x3234de053c44403 lrc: 4/0,0 mode: PR/PR res: [0x2b30f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5684 expref: 260 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.394524:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11244 00000100:00100000:1.0:1651529333.394525:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+260:41278:x1731746394414208:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.394528:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.394529:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c0588f4c/0x3234de053c46917 lrc: 4/0,0 mode: PR/PR res: [0x2b30e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aec2b expref: 260 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.394536:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c0588f4c/0x3234de053c46917 lrc: 3/0,0 mode: PR/PR res: [0x2b30e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aec2b expref: 260 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.394541:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0588f4c/0x3234de053c46917 lrc: 0/0,0 mode: --/PR res: [0x2b30e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aec2b expref: 260 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.394545:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.394545:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.394546:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c4c487 lrc: 3/0,1 mode: PW/PW res: [0x2b30e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.394549:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c4c487 lrc: 4/0,1 mode: PW/PW res: [0x2b30e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.394555:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.394563:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+259:41278:x1731746394414208:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 36us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.394565:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11244 00000100:00100000:1.0:1651529333.394569:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11245 00000100:00100000:1.0:1651529333.394571:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005649b5c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+258:41278:x1731746394414336:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529333.394573:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.394574:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ec163e8e/0x3234de053c44403 lrc: 4/0,0 mode: PR/PR res: [0x2b30f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5684 expref: 258 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.394578:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ec163e8e/0x3234de053c44403 lrc: 3/0,0 mode: PR/PR res: [0x2b30f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5684 expref: 258 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.394583:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec163e8e/0x3234de053c44403 lrc: 0/0,0 mode: --/PR res: [0x2b30f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5684 expref: 258 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.394586:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.394586:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.394587:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002099d3d5/0x3234de053c4c48e lrc: 3/0,1 mode: PW/PW res: [0x2b30f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.394590:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002099d3d5/0x3234de053c4c48e lrc: 4/0,1 mode: PW/PW res: [0x2b30f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.394600:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.394605:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005649b5c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+257:41278:x1731746394414336:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.394608:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11245 00010000:00010000:1.0:1651529333.394618:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c4c487 lrc: 3/0,1 mode: PW/PW res: [0x2b30e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.394621:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c4c487 lrc: 3/0,1 mode: PW/PW res: [0x2b30e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.394624:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c4c487 lrc: 3/0,1 mode: PW/PW res: [0x2b30e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.394627:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c4c487 lrc: 2/0,0 mode: PW/PW res: [0x2b30e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.394668:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1164:39030:x1731745946295488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1119us (1245us total) trans 12885078518 rc 0/0 00000100:00100000:1.0:1651529333.394672:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208617 00010000:00010000:1.0:1651529333.394678:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c4c487 lrc: 2/0,0 mode: PW/PW res: [0x2b30e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.394682:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000011345842 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.394683:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c4c487 lrc: 2/0,0 mode: PW/PW res: [0x2b30e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.394686:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c4c487 lrc: 3/0,0 mode: PW/PW res: [0x2b30e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.394690:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c4c487 lrc: 1/0,0 mode: --/PW res: [0x2b30e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.394693:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c4c487 lrc: 0/0,0 mode: --/PW res: [0x2b30e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.394866:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.394881:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.394888:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.394918:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.394947:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.394956:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394414528 00010000:00010000:1.0:1651529333.394962:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d18e8744/0x3234de053c43aa2 lrc: 4/0,0 mode: PR/PR res: [0x2b311:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3012 expref: 257 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.394969:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11246 00000100:00100000:1.0:1651529333.394971:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+257:41278:x1731746394414528:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.394974:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.394975:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d18e8744/0x3234de053c43aa2 lrc: 4/0,0 mode: PR/PR res: [0x2b311:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3012 expref: 257 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.394979:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d18e8744/0x3234de053c43aa2 lrc: 3/0,0 mode: PR/PR res: [0x2b311:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3012 expref: 257 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.394984:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d18e8744/0x3234de053c43aa2 lrc: 0/0,0 mode: --/PR res: [0x2b311:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3012 expref: 257 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.394988:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.394988:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.394989:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001722859c/0x3234de053c4c495 lrc: 3/0,1 mode: PW/PW res: [0x2b311:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.394992:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001722859c/0x3234de053c4c495 lrc: 4/0,1 mode: PW/PW res: [0x2b311:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.395006:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.395013:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+256:41278:x1731746394414528:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.395016:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11246 00000100:00100000:1.0:1651529333.395024:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208622 00000100:00100000:1.0:1651529333.395025:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1167:39030:x1731745946295744:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.395030:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176914 count 1 00010000:00010000:1.0:1651529333.395034:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0c4b95b/0x3234de053c4c4aa lrc: 3/0,1 mode: --/PW res: [0x2b312:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.395038:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000041b8eb55/0x3234de053c4449d lrc: 2/0,0 mode: PR/PR res: [0x2b312:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5916 expref: 255 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.395041:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.395042:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.395043:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0c4b95b/0x3234de053c4c4aa lrc: 4/0,1 mode: --/PW res: [0x2b312:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.395058:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000041b8eb55/0x3234de053c4449d lrc: 3/0,0 mode: PR/PR res: [0x2b312:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5916 expref: 255 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.395062:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000041b8eb55/0x3234de053c4449d lrc: 4/0,0 mode: PR/PR res: [0x2b312:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5916 expref: 255 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.395066:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000117fbeca pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996936512:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.395075:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a4eb401d going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.395082:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208624 00000100:00100000:1.0:1651529333.395084:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1167:39029:x1731745946295936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.395089:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176917 count 1 00010000:00010000:1.0:1651529333.395092:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3bc1618/0x3234de053c4c4b8 lrc: 3/0,1 mode: --/PW res: [0x2b315:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.395096:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cb76f8f9/0x3234de053c460e3 lrc: 2/0,0 mode: PR/PR res: [0x2b315:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac9d3 expref: 255 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.395099:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.395100:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.395101:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3bc1618/0x3234de053c4c4b8 lrc: 4/0,1 mode: --/PW res: [0x2b315:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.395107:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cb76f8f9/0x3234de053c460e3 lrc: 3/0,0 mode: PR/PR res: [0x2b315:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac9d3 expref: 255 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.395110:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cb76f8f9/0x3234de053c460e3 lrc: 4/0,0 mode: PR/PR res: [0x2b315:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac9d3 expref: 255 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.395114:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fc130417 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996936640:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.395120:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b7af823 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.395135:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.395150:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.395164:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.395249:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.395261:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394414592 00010000:00010000:1.0:1651529333.395266:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007f407e6b/0x3234de053c46c04 lrc: 4/0,0 mode: PR/PR res: [0x2b310:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af96e expref: 256 pid: 80277 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.395280:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11247 00000100:00100000:1.0:1651529333.395282:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+256:41278:x1731746394414592:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.395285:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.395286:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007f407e6b/0x3234de053c46c04 lrc: 4/0,0 mode: PR/PR res: [0x2b310:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af96e expref: 256 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.395290:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007f407e6b/0x3234de053c46c04 lrc: 3/0,0 mode: PR/PR res: [0x2b310:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af96e expref: 256 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.395296:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f407e6b/0x3234de053c46c04 lrc: 0/0,0 mode: --/PR res: [0x2b310:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af96e expref: 257 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.395299:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.395300:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.395301:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000095fca58f/0x3234de053c4c49c lrc: 3/0,1 mode: PW/PW res: [0x2b310:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.395304:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095fca58f/0x3234de053c4c49c lrc: 4/0,1 mode: PW/PW res: [0x2b310:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.395313:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.395320:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+256:41278:x1731746394414592:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 38us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.395323:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11247 00000100:00100000:1.0:1651529333.395331:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 208627 00000100:00100000:1.0:1651529333.395332:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007fca8239 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+255:41279:x1731746394414656:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529333.395335:0:72397:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529333.395339:0:72397:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a899246/0x3234de053c4c4cd lrc: 2/0,0 mode: --/PR res: [0x2b554:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2cc997 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529333.395345:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b554:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529333.395348:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.395349:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.395351:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a899246/0x3234de053c4c4cd lrc: 3/0,0 mode: PR/PR res: [0x2b554:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc997 expref: 256 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.395355:0:72397:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004a899246/0x3234de053c4c4cd lrc: 3/0,0 mode: PR/PR res: [0x2b554:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc997 expref: 256 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.395359:0:72397:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004a899246, rc 0) 00000100:00100000:1.0:1651529333.395365:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007fca8239 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+256:41279:x1731746394414656:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 32us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.395367:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 208627 00000100:00100000:1.0:1651529333.395526:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.395559:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.395569:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000117fbeca pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996936512:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.395573:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c0c4b95b/0x3234de053c4c4aa lrc: 3/0,1 mode: --/PW res: [0x2b312:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.395580:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394414848 00010000:00010000:1.0:1651529333.395597:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c43bcf lrc: 5/0,0 mode: PR/PR res: [0x2b313:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a34cd expref: 256 pid: 80278 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.395605:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11248 00000100:00100000:1.0:1651529333.395606:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfc79d4e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+256:41278:x1731746394414848:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.395609:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.395610:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c43bcf lrc: 5/0,0 mode: PR/PR res: [0x2b313:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a34cd expref: 256 pid: 80278 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.395617:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c43bcf lrc: 4/0,0 mode: PR/PR res: [0x2b313:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a34cd expref: 256 pid: 80278 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.395623:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.395624:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.395625:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008c45287a/0x3234de053c4c4a3 lrc: 3/0,1 mode: PW/PW res: [0x2b313:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.395628:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c45287a/0x3234de053c4c4a3 lrc: 4/0,1 mode: PW/PW res: [0x2b313:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.395640:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.395647:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfc79d4e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+256:41278:x1731746394414848:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 40us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.395650:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11248 00000100:00100000:1.0:1651529333.395664:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.395680:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.395718:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.395752:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946296192 00000100:00100000:1.0:1651529333.395760:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208629 00000100:00100000:1.0:1651529333.395761:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1172:39030:x1731745946296192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.395772:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176921 count 1 00010000:00010000:1.0:1651529333.395777:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000943c1249/0x3234de053c4c4db lrc: 3/0,1 mode: --/PW res: [0x2b319:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.395782:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f81e8872/0x3234de053c45fee lrc: 2/0,0 mode: PR/PR res: [0x2b319:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac614 expref: 254 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.395788:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.395788:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.395789:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000943c1249/0x3234de053c4c4db lrc: 4/0,1 mode: --/PW res: [0x2b319:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.395796:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f81e8872/0x3234de053c45fee lrc: 3/0,0 mode: PR/PR res: [0x2b319:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac614 expref: 254 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.395799:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f81e8872/0x3234de053c45fee lrc: 4/0,0 mode: PR/PR res: [0x2b319:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac614 expref: 254 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.395803:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004972eb27 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996936896:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.395812:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cfa1ca05 going to sleep for 6 seconds 00010000:00010000:1.0:1651529333.395817:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c45287a/0x3234de053c4c4a3 lrc: 2/0,0 mode: PW/PW res: [0x2b313:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.395820:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008c45287a already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.395821:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c45287a/0x3234de053c4c4a3 lrc: 2/0,0 mode: PW/PW res: [0x2b313:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.395824:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c45287a/0x3234de053c4c4a3 lrc: 3/0,0 mode: PW/PW res: [0x2b313:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.395829:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c45287a/0x3234de053c4c4a3 lrc: 1/0,0 mode: --/PW res: [0x2b313:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.395834:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c45287a/0x3234de053c4c4a3 lrc: 0/0,0 mode: --/PW res: [0x2b313:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.395842:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fc130417 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996936640:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.395846:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c3bc1618/0x3234de053c4c4b8 lrc: 3/0,1 mode: --/PW res: [0x2b315:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.395853:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394414976 00010000:00010000:1.0:1651529333.395857:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000041b8eb55/0x3234de053c4449d lrc: 4/0,0 mode: PR/PR res: [0x2b312:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5916 expref: 255 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.395864:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394414912 00010000:00010000:1.0:1651529333.395866:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009cc50b67/0x3234de053c44633 lrc: 4/0,0 mode: PR/PR res: [0x2b314:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5fe5 expref: 256 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.395877:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11249 00000100:00100000:1.0:1651529333.395878:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005914c920 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+256:41278:x1731746394414976:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.395881:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.395882:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000041b8eb55/0x3234de053c4449d lrc: 4/0,0 mode: PR/PR res: [0x2b312:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5916 expref: 256 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.395886:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000041b8eb55/0x3234de053c4449d lrc: 3/0,0 mode: PR/PR res: [0x2b312:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5916 expref: 256 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.395892:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041b8eb55/0x3234de053c4449d lrc: 0/0,0 mode: --/PR res: [0x2b312:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5916 expref: 256 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.395896:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.395896:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.395897:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c0c4b95b/0x3234de053c4c4aa lrc: 3/0,1 mode: PW/PW res: [0x2b312:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.395900:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0c4b95b/0x3234de053c4c4aa lrc: 4/0,1 mode: PW/PW res: [0x2b312:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.395906:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.395913:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005914c920 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+254:41278:x1731746394414976:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 34us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.395915:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11249 00010000:00010000:1.0:1651529333.395922:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c0c4b95b/0x3234de053c4c4aa lrc: 3/0,1 mode: PW/PW res: [0x2b312:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.395925:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0c4b95b/0x3234de053c4c4aa lrc: 3/0,1 mode: PW/PW res: [0x2b312:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.395928:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0c4b95b/0x3234de053c4c4aa lrc: 3/0,1 mode: PW/PW res: [0x2b312:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.395931:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0c4b95b/0x3234de053c4c4aa lrc: 2/0,0 mode: PW/PW res: [0x2b312:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.395973:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1172:39030:x1731745946295744:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 947us (1085us total) trans 12885078522 rc 0/0 00000100:00100000:1.0:1651529333.395976:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208622 00000100:00100000:1.0:1651529333.395992:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.396007:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.396041:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.396055:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.396097:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394415040 00010000:00010000:1.0:1651529333.396103:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cb76f8f9/0x3234de053c460e3 lrc: 4/0,0 mode: PR/PR res: [0x2b315:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac9d3 expref: 254 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.396110:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394415104 00010000:00010000:1.0:1651529333.396112:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000019127e45/0x3234de053c45d5c lrc: 4/0,0 mode: PR/PR res: [0x2b316:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abbfd expref: 256 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.396116:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394415168 00010000:00010000:1.0:1651529333.396118:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c45203 lrc: 4/0,0 mode: PR/PR res: [0x2b317:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8d8f expref: 257 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.396123:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11251 00000100:00100000:1.0:1651529333.396125:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+257:41279:x1731746394415040:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.396127:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.396129:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cb76f8f9/0x3234de053c460e3 lrc: 4/0,0 mode: PR/PR res: [0x2b315:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac9d3 expref: 257 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.396132:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cb76f8f9/0x3234de053c460e3 lrc: 3/0,0 mode: PR/PR res: [0x2b315:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac9d3 expref: 257 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.396147:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb76f8f9/0x3234de053c460e3 lrc: 0/0,0 mode: --/PR res: [0x2b315:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac9d3 expref: 257 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.396154:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.396154:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.396155:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c3bc1618/0x3234de053c4c4b8 lrc: 3/0,1 mode: PW/PW res: [0x2b315:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.396158:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3bc1618/0x3234de053c4c4b8 lrc: 4/0,1 mode: PW/PW res: [0x2b315:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.396164:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.396171:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+255:41279:x1731746394415040:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 46us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.396174:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11251 00000100:00100000:1.0:1651529333.396179:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11253 00000100:00100000:1.0:1651529333.396180:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+254:41279:x1731746394415168:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.396183:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.396184:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c45203 lrc: 4/0,0 mode: PR/PR res: [0x2b317:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8d8f expref: 254 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.396188:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c45203 lrc: 3/0,0 mode: PR/PR res: [0x2b317:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8d8f expref: 254 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.396193:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c45203 lrc: 0/0,0 mode: --/PR res: [0x2b317:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8d8f expref: 253 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.396196:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.396197:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.396198:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d95da09e/0x3234de053c4c4c6 lrc: 3/0,1 mode: PW/PW res: [0x2b317:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.396200:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d95da09e/0x3234de053c4c4c6 lrc: 4/0,1 mode: PW/PW res: [0x2b317:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.396210:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.396216:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+252:41279:x1731746394415168:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 35us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.396218:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11253 00010000:00010000:1.0:1651529333.396242:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c3bc1618/0x3234de053c4c4b8 lrc: 3/0,1 mode: PW/PW res: [0x2b315:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.396246:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3bc1618/0x3234de053c4c4b8 lrc: 3/0,1 mode: PW/PW res: [0x2b315:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.396249:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3bc1618/0x3234de053c4c4b8 lrc: 3/0,1 mode: PW/PW res: [0x2b315:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.396251:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c3bc1618/0x3234de053c4c4b8 lrc: 2/0,0 mode: PW/PW res: [0x2b315:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.396291:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1173:39029:x1731745946295936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1206us (1344us total) trans 12885078524 rc 0/0 00000100:00100000:1.0:1651529333.396294:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208624 00010000:00010000:1.0:1651529333.396303:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c3bc1618/0x3234de053c4c4b8 lrc: 2/0,0 mode: PW/PW res: [0x2b315:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.396309:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c3bc1618 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.396310:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3bc1618/0x3234de053c4c4b8 lrc: 2/0,0 mode: PW/PW res: [0x2b315:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.396313:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3bc1618/0x3234de053c4c4b8 lrc: 3/0,0 mode: PW/PW res: [0x2b315:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.396317:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c3bc1618/0x3234de053c4c4b8 lrc: 1/0,0 mode: --/PW res: [0x2b315:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.396320:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3bc1618/0x3234de053c4c4b8 lrc: 0/0,0 mode: --/PW res: [0x2b315:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.396324:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d95da09e/0x3234de053c4c4c6 lrc: 2/0,0 mode: PW/PW res: [0x2b317:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.396327:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d95da09e already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.396327:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d95da09e/0x3234de053c4c4c6 lrc: 2/0,0 mode: PW/PW res: [0x2b317:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.396330:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d95da09e/0x3234de053c4c4c6 lrc: 3/0,0 mode: PW/PW res: [0x2b317:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.396333:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d95da09e/0x3234de053c4c4c6 lrc: 1/0,0 mode: --/PW res: [0x2b317:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.396336:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d95da09e/0x3234de053c4c4c6 lrc: 0/0,0 mode: --/PW res: [0x2b317:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.396389:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.396428:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.396443:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.396453:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.396500:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.396511:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394415424 00010000:00010000:1.0:1651529333.396517:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a35d6c44/0x3234de053c4602d lrc: 5/0,0 mode: PR/PR res: [0x2b318:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac748 expref: 251 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.396526:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394415488 00010000:00010000:1.0:1651529333.396528:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f81e8872/0x3234de053c45fee lrc: 5/0,0 mode: PR/PR res: [0x2b319:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac614 expref: 252 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.396535:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11254 00000100:00100000:1.0:1651529333.396536:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+252:41278:x1731746394415424:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.396544:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.396546:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a35d6c44/0x3234de053c4602d lrc: 5/0,0 mode: PR/PR res: [0x2b318:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac748 expref: 252 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.396550:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a35d6c44/0x3234de053c4602d lrc: 4/0,0 mode: PR/PR res: [0x2b318:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac748 expref: 252 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.396557:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.396557:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.396558:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c83c6fc1/0x3234de053c4c4d4 lrc: 3/0,1 mode: PW/PW res: [0x2b318:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.396569:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c83c6fc1/0x3234de053c4c4d4 lrc: 4/0,1 mode: PW/PW res: [0x2b318:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.396574:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.396581:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+252:41278:x1731746394415424:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 44us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.396583:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11254 00000100:00100000:1.0:1651529333.396588:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11255 00000100:00100000:1.0:1651529333.396589:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+251:41278:x1731746394415488:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.396592:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.396593:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f81e8872/0x3234de053c45fee lrc: 5/0,0 mode: PR/PR res: [0x2b319:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac614 expref: 251 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.396597:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f81e8872/0x3234de053c45fee lrc: 4/0,0 mode: PR/PR res: [0x2b319:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac614 expref: 251 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.396602:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.396602:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.396603:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000943c1249/0x3234de053c4c4db lrc: 3/0,1 mode: PW/PW res: [0x2b319:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.396606:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000943c1249/0x3234de053c4c4db lrc: 4/0,1 mode: PW/PW res: [0x2b319:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.396610:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.396614:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+251:41278:x1731746394415488:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 24us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.396617:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11255 00010000:00010000:1.0:1651529333.396625:0:80276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f81e8872/0x3234de053c45fee lrc: 0/0,0 mode: --/PR res: [0x2b319:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ac614 expref: 250 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.396629:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004972eb27 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996936896:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.396633:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000943c1249/0x3234de053c4c4db lrc: 3/0,1 mode: PW/PW res: [0x2b319:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.396636:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000943c1249/0x3234de053c4c4db lrc: 3/0,1 mode: PW/PW res: [0x2b319:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.396639:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000943c1249/0x3234de053c4c4db lrc: 3/0,1 mode: PW/PW res: [0x2b319:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.396642:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000943c1249/0x3234de053c4c4db lrc: 3/0,1 mode: PW/PW res: [0x2b319:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.396654:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000943c1249/0x3234de053c4c4db lrc: 2/0,0 mode: PW/PW res: [0x2b319:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.396695:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1175:39030:x1731745946296192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 933us (1015us total) trans 12885078527 rc 0/0 00000100:00100000:1.0:1651529333.396698:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208629 00000100:00100000:1.0:1651529333.396717:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.396741:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.396772:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.396793:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.396854:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 208635 00000100:00100000:1.0:1651529333.396856:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+249:41278:x1731746394415552:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529333.396860:0:72397:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529333.396865:0:72397:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ebf7beea/0x3234de053c4c505 lrc: 2/0,0 mode: --/PR res: [0x2b3ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2cc9b3 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529333.396870:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b3ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529333.396874:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.396875:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.396877:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebf7beea/0x3234de053c4c505 lrc: 3/0,0 mode: PR/PR res: [0x2b3ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc9b3 expref: 250 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.396888:0:72397:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ebf7beea/0x3234de053c4c505 lrc: 3/0,0 mode: PR/PR res: [0x2b3ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc9b3 expref: 250 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.396892:0:72397:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ebf7beea, rc 0) 00000100:00100000:1.0:1651529333.396900:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+250:41278:x1731746394415552:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 43us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.396902:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 208635 00000100:00100000:1.0:1651529333.396908:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208637 00000100:00100000:1.0:1651529333.396909:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1177:39030:x1731745946296512:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.396914:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176926 count 1 00010000:00010000:1.0:1651529333.396917:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049d9a625/0x3234de053c4c513 lrc: 3/0,1 mode: --/PW res: [0x2b31e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.396922:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005a2ef602/0x3234de053c45a76 lrc: 2/0,0 mode: PR/PR res: [0x2b31e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab042 expref: 249 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.396925:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.396926:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.396926:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049d9a625/0x3234de053c4c513 lrc: 4/0,1 mode: --/PW res: [0x2b31e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.396933:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005a2ef602/0x3234de053c45a76 lrc: 3/0,0 mode: PR/PR res: [0x2b31e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab042 expref: 249 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.396937:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005a2ef602/0x3234de053c45a76 lrc: 4/0,0 mode: PR/PR res: [0x2b31e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab042 expref: 249 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.396941:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a573b31 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996937280:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.396948:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a4eb401d going to sleep for 6 seconds 00010000:00010000:1.0:1651529333.396955:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c83c6fc1/0x3234de053c4c4d4 lrc: 2/0,0 mode: PW/PW res: [0x2b318:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.396959:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c83c6fc1 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.396960:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c83c6fc1/0x3234de053c4c4d4 lrc: 2/0,0 mode: PW/PW res: [0x2b318:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.396963:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c83c6fc1/0x3234de053c4c4d4 lrc: 3/0,0 mode: PW/PW res: [0x2b318:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.396967:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c83c6fc1/0x3234de053c4c4d4 lrc: 1/0,0 mode: --/PW res: [0x2b318:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.396972:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c83c6fc1/0x3234de053c4c4d4 lrc: 0/0,0 mode: --/PW res: [0x2b318:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.397123:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.397130:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.397136:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946296704 00000100:00100000:1.0:1651529333.397142:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946296640 00000100:00100000:1.0:1651529333.397149:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208638 00000100:00100000:1.0:1651529333.397151:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1179:39029:x1731745946296704:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.397156:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176929 count 1 00010000:00010000:1.0:1651529333.397161:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4c51a lrc: 3/0,1 mode: --/PW res: [0x2b321:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.397171:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003cd9e951/0x3234de053c46d1c lrc: 2/0,0 mode: PR/PR res: [0x2b321:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aff25 expref: 249 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.397175:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.397175:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.397176:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4c51a lrc: 4/0,1 mode: --/PW res: [0x2b321:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.397183:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003cd9e951/0x3234de053c46d1c lrc: 3/0,0 mode: PR/PR res: [0x2b321:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aff25 expref: 249 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.397186:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003cd9e951/0x3234de053c46d1c lrc: 4/0,0 mode: PR/PR res: [0x2b321:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aff25 expref: 249 pid: 80277 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.397193:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fc130417 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996937344:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.397203:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000412e5d26 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.397217:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.397260:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.397299:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.397314:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394415808 00010000:00010000:1.0:1651529333.397320:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d0394e1d/0x3234de053c458af lrc: 4/0,0 mode: PR/PR res: [0x2b31c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aa9ce expref: 251 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.397326:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11257 00000100:00100000:1.0:1651529333.397328:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+251:41278:x1731746394415872:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.397331:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.397332:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000db89c39d/0x3234de053c4458b lrc: 4/0,0 mode: PR/PR res: [0x2b31b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5d37 expref: 251 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.397336:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000db89c39d/0x3234de053c4458b lrc: 3/0,0 mode: PR/PR res: [0x2b31b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5d37 expref: 251 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.397342:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db89c39d/0x3234de053c4458b lrc: 0/0,0 mode: --/PR res: [0x2b31b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a5d37 expref: 251 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.397346:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.397346:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.397347:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000021332347/0x3234de053c4c4f7 lrc: 3/0,1 mode: PW/PW res: [0x2b31b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.397352:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021332347/0x3234de053c4c4f7 lrc: 4/0,1 mode: PW/PW res: [0x2b31b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.397363:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.397370:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+249:41278:x1731746394415872:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.397373:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11257 00000100:00100000:1.0:1651529333.397439:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.397452:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a573b31 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996937280:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.397457:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000049d9a625/0x3234de053c4c513 lrc: 3/0,1 mode: --/PW res: [0x2b31e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.397560:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.397568:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.397574:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394416000 00010000:00010000:1.0:1651529333.397578:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b866be3a/0x3234de053c46bf6 lrc: 4/0,0 mode: PR/PR res: [0x2b31f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af90c expref: 247 pid: 80277 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.397585:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394415936 00010000:00010000:1.0:1651529333.397587:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000029a7c39e/0x3234de053c437c3 lrc: 5/0,0 mode: PR/PR res: [0x2b31d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a256f expref: 248 pid: 80281 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.397591:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394416064 00010000:00010000:1.0:1651529333.397593:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005a2ef602/0x3234de053c45a76 lrc: 4/0,0 mode: PR/PR res: [0x2b31e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab042 expref: 249 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.397607:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11259 00000100:00100000:1.0:1651529333.397613:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000534d68d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+249:41278:x1731746394416000:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529333.397617:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.397618:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b866be3a/0x3234de053c46bf6 lrc: 4/0,0 mode: PR/PR res: [0x2b31f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af90c expref: 249 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.397622:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b866be3a/0x3234de053c46bf6 lrc: 3/0,0 mode: PR/PR res: [0x2b31f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af90c expref: 249 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.397627:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b866be3a/0x3234de053c46bf6 lrc: 0/0,0 mode: --/PR res: [0x2b31f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af90c expref: 249 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.397631:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.397631:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.397632:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000055c564af/0x3234de053c4c50c lrc: 3/0,1 mode: PW/PW res: [0x2b31f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.397635:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055c564af/0x3234de053c4c50c lrc: 4/0,1 mode: PW/PW res: [0x2b31f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.397645:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.397652:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000534d68d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+248:41278:x1731746394416000:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.397654:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11259 00000100:00100000:1.0:1651529333.397663:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11260 00000100:00100000:1.0:1651529333.397664:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+247:41279:x1731746394415936:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.397667:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.397668:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000029a7c39e/0x3234de053c437c3 lrc: 5/0,0 mode: PR/PR res: [0x2b31d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a256f expref: 247 pid: 80281 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.397672:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000029a7c39e/0x3234de053c437c3 lrc: 4/0,0 mode: PR/PR res: [0x2b31d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a256f expref: 247 pid: 80281 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.397676:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.397677:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.397677:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000071086493/0x3234de053c4c4fe lrc: 3/0,1 mode: PW/PW res: [0x2b31d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.397680:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071086493/0x3234de053c4c4fe lrc: 4/0,1 mode: PW/PW res: [0x2b31d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.397692:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.397697:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+247:41279:x1731746394415936:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 32us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.397699:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11260 00000100:00100000:1.0:1651529333.397703:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11261 00000100:00100000:1.0:1651529333.397705:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+246:41279:x1731746394416064:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.397707:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.397709:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005a2ef602/0x3234de053c45a76 lrc: 4/0,0 mode: PR/PR res: [0x2b31e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab042 expref: 246 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.397712:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005a2ef602/0x3234de053c45a76 lrc: 3/0,0 mode: PR/PR res: [0x2b31e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab042 expref: 246 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.397720:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a2ef602/0x3234de053c45a76 lrc: 0/0,0 mode: --/PR res: [0x2b31e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ab042 expref: 246 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.397724:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.397724:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.397725:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000049d9a625/0x3234de053c4c513 lrc: 3/0,1 mode: PW/PW res: [0x2b31e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.397728:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049d9a625/0x3234de053c4c513 lrc: 4/0,1 mode: PW/PW res: [0x2b31e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.397743:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.397749:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+245:41279:x1731746394416064:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 43us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.397752:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11261 00010000:00010000:1.0:1651529333.397759:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000055c564af/0x3234de053c4c50c lrc: 2/0,0 mode: PW/PW res: [0x2b31f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.397763:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000055c564af already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.397764:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000055c564af/0x3234de053c4c50c lrc: 2/0,0 mode: PW/PW res: [0x2b31f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.397767:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000055c564af/0x3234de053c4c50c lrc: 3/0,0 mode: PW/PW res: [0x2b31f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.397771:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000055c564af/0x3234de053c4c50c lrc: 1/0,0 mode: --/PW res: [0x2b31f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.397776:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055c564af/0x3234de053c4c50c lrc: 0/0,0 mode: --/PW res: [0x2b31f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.397780:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7827fc7/0x3234de053c4c4e9 lrc: 2/0,0 mode: PW/PW res: [0x2b31a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.397783:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d7827fc7 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.397784:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7827fc7/0x3234de053c4c4e9 lrc: 2/0,0 mode: PW/PW res: [0x2b31a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.397787:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7827fc7/0x3234de053c4c4e9 lrc: 3/0,0 mode: PW/PW res: [0x2b31a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.397790:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7827fc7/0x3234de053c4c4e9 lrc: 1/0,0 mode: --/PW res: [0x2b31a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.397792:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7827fc7/0x3234de053c4c4e9 lrc: 0/0,0 mode: --/PW res: [0x2b31a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.397798:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000049d9a625/0x3234de053c4c513 lrc: 3/0,1 mode: PW/PW res: [0x2b31e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.397801:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049d9a625/0x3234de053c4c513 lrc: 3/0,1 mode: PW/PW res: [0x2b31e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.397804:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049d9a625/0x3234de053c4c513 lrc: 3/0,1 mode: PW/PW res: [0x2b31e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.397807:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049d9a625/0x3234de053c4c513 lrc: 2/0,0 mode: PW/PW res: [0x2b31e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.397850:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1180:39030:x1731745946296512:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 940us (1057us total) trans 12885078533 rc 0/0 00000100:00100000:1.0:1651529333.397853:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208637 00000100:00100000:1.0:1651529333.397888:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.397903:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.397955:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.397970:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.398005:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fc130417 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996937344:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.398010:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4c51a lrc: 3/0,1 mode: --/PW res: [0x2b321:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.398022:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394416320 00010000:00010000:1.0:1651529333.398027:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003cd9e951/0x3234de053c46d1c lrc: 4/0,0 mode: PR/PR res: [0x2b321:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aff25 expref: 245 pid: 80277 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.398034:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394416384 00010000:00010000:1.0:1651529333.398036:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000094ace1de/0x3234de053c43c7e lrc: 5/0,0 mode: PR/PR res: [0x2b320:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3774 expref: 246 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.398041:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11262 00000100:00100000:1.0:1651529333.398043:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+246:41278:x1731746394416320:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529333.398046:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.398047:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003cd9e951/0x3234de053c46d1c lrc: 4/0,0 mode: PR/PR res: [0x2b321:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aff25 expref: 246 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.398051:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003cd9e951/0x3234de053c46d1c lrc: 3/0,0 mode: PR/PR res: [0x2b321:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aff25 expref: 246 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.398056:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003cd9e951/0x3234de053c46d1c lrc: 0/0,0 mode: --/PR res: [0x2b321:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aff25 expref: 246 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.398060:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.398060:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.398061:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4c51a lrc: 3/0,1 mode: PW/PW res: [0x2b321:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.398064:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4c51a lrc: 4/0,1 mode: PW/PW res: [0x2b321:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.398070:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.398077:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+245:41278:x1731746394416320:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.398079:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11262 00000100:00100000:1.0:1651529333.398083:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11263 00000100:00100000:1.0:1651529333.398084:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+244:41278:x1731746394416384:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.398086:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.398088:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000094ace1de/0x3234de053c43c7e lrc: 4/0,0 mode: PR/PR res: [0x2b320:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3774 expref: 244 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.398091:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000094ace1de/0x3234de053c43c7e lrc: 3/0,0 mode: PR/PR res: [0x2b320:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3774 expref: 244 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.398096:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094ace1de/0x3234de053c43c7e lrc: 0/0,0 mode: --/PR res: [0x2b320:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3774 expref: 244 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.398100:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.398100:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.398101:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f291cae5/0x3234de053c4c521 lrc: 3/0,1 mode: PW/PW res: [0x2b320:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.398104:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f291cae5/0x3234de053c4c521 lrc: 4/0,1 mode: PW/PW res: [0x2b320:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.398114:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.398119:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+243:41278:x1731746394416384:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 34us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.398121:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11263 00010000:00010000:1.0:1651529333.398128:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4c51a lrc: 3/0,1 mode: PW/PW res: [0x2b321:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.398131:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4c51a lrc: 3/0,1 mode: PW/PW res: [0x2b321:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.398134:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4c51a lrc: 3/0,1 mode: PW/PW res: [0x2b321:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.398137:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4c51a lrc: 2/0,0 mode: PW/PW res: [0x2b321:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.398178:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1182:39029:x1731745946296704:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1026us (1055us total) trans 12885078535 rc 0/0 00000100:00100000:1.0:1651529333.398181:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208638 00010000:00010000:1.0:1651529333.398188:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4c51a lrc: 2/0,0 mode: PW/PW res: [0x2b321:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.398191:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb5dc195 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.398192:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4c51a lrc: 2/0,0 mode: PW/PW res: [0x2b321:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.398195:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4c51a lrc: 3/0,0 mode: PW/PW res: [0x2b321:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.398199:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4c51a lrc: 1/0,0 mode: --/PW res: [0x2b321:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.398202:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4c51a lrc: 0/0,0 mode: --/PW res: [0x2b321:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.398256:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.398271:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.398286:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.398306:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.398336:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.398388:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208644 00000100:00100000:1.0:1651529333.398390:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1185:39029:x1731745946296960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.398396:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176933 count 1 00010000:00010000:1.0:1651529333.398401:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011d5f1b1/0x3234de053c4c544 lrc: 3/0,1 mode: --/PW res: [0x2b325:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.398406:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000088155288/0x3234de053c45583 lrc: 2/0,0 mode: PR/PR res: [0x2b325:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9bab expref: 242 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.398409:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.398410:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.398410:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011d5f1b1/0x3234de053c4c544 lrc: 4/0,1 mode: --/PW res: [0x2b325:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.398417:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000088155288/0x3234de053c45583 lrc: 3/0,0 mode: PR/PR res: [0x2b325:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9bab expref: 242 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.398421:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000088155288/0x3234de053c45583 lrc: 4/0,0 mode: PR/PR res: [0x2b325:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9bab expref: 242 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.398425:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000900b179f pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996937664:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.398444:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cfa1ca05 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.398450:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208646 00000100:00100000:1.0:1651529333.398452:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1185:39029:x1731745946297024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.398456:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176934 count 1 00010000:00010000:1.0:1651529333.398460:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4c552 lrc: 3/0,1 mode: --/PW res: [0x2b326:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.398464:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000480360d2/0x3234de053c46c12 lrc: 2/0,0 mode: PR/PR res: [0x2b326:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af9d0 expref: 242 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.398468:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.398468:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.398469:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4c552 lrc: 4/0,1 mode: --/PW res: [0x2b326:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.398475:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000480360d2/0x3234de053c46c12 lrc: 3/0,0 mode: PR/PR res: [0x2b326:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af9d0 expref: 242 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.398479:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000480360d2/0x3234de053c46c12 lrc: 4/0,0 mode: PR/PR res: [0x2b326:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af9d0 expref: 242 pid: 80277 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.398482:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005912c4a3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996937792:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.398490:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 000000004ca54b8a going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.398604:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.398618:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.398631:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946297152 00000100:00100000:1.0:1651529333.398641:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946297216 00000100:00100000:1.0:1651529333.398653:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208648 00000100:00100000:1.0:1651529333.398656:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1187:39029:x1731745946297216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.398661:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176937 count 1 00010000:00010000:1.0:1651529333.398665:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4c559 lrc: 3/0,1 mode: --/PW res: [0x2b329:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.398670:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b11923f6/0x3234de053c447a6 lrc: 2/0,0 mode: PR/PR res: [0x2b329:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a65c6 expref: 242 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.398689:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.398689:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.398690:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4c559 lrc: 4/0,1 mode: --/PW res: [0x2b329:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.398698:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b11923f6/0x3234de053c447a6 lrc: 3/0,0 mode: PR/PR res: [0x2b329:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a65c6 expref: 242 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.398701:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b11923f6/0x3234de053c447a6 lrc: 4/0,0 mode: PR/PR res: [0x2b329:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a65c6 expref: 242 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.398705:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000be0ace91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996937856:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.398716:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a4eb401d going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.398750:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.398781:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.398789:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394416640 00010000:00010000:1.0:1651529333.398795:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000477de781/0x3234de053c45663 lrc: 4/0,0 mode: PR/PR res: [0x2b322:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9ef3 expref: 243 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.398801:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394416704 00010000:00010000:1.0:1651529333.398804:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c43fe9 lrc: 4/0,0 mode: PR/PR res: [0x2b323:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a44cc expref: 244 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.398814:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11264 00000100:00100000:1.0:1651529333.398815:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+244:41278:x1731746394416640:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.398819:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.398821:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000477de781/0x3234de053c45663 lrc: 4/0,0 mode: PR/PR res: [0x2b322:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9ef3 expref: 244 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.398825:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000477de781/0x3234de053c45663 lrc: 3/0,0 mode: PR/PR res: [0x2b322:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9ef3 expref: 244 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.398830:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000477de781/0x3234de053c45663 lrc: 0/0,0 mode: --/PR res: [0x2b322:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9ef3 expref: 244 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.398834:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.398835:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.398835:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006685f816/0x3234de053c4c52f lrc: 3/0,1 mode: PW/PW res: [0x2b322:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.398838:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006685f816/0x3234de053c4c52f lrc: 4/0,1 mode: PW/PW res: [0x2b322:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.398847:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.398855:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+242:41278:x1731746394416640:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 39us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.398858:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11264 00010000:00010000:1.0:1651529333.398999:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006685f816/0x3234de053c4c52f lrc: 2/0,0 mode: PW/PW res: [0x2b322:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.399004:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006685f816 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.399005:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006685f816/0x3234de053c4c52f lrc: 2/0,0 mode: PW/PW res: [0x2b322:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.399008:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006685f816/0x3234de053c4c52f lrc: 3/0,0 mode: PW/PW res: [0x2b322:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.399014:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006685f816/0x3234de053c4c52f lrc: 1/0,0 mode: --/PW res: [0x2b322:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.399016:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006685f816/0x3234de053c4c52f lrc: 0/0,0 mode: --/PW res: [0x2b322:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.399113:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.399123:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.399132:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.399144:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000900b179f pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996937664:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.399149:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000011d5f1b1/0x3234de053c4c544 lrc: 3/0,1 mode: --/PW res: [0x2b325:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.399156:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005912c4a3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996937792:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.399164:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4c552 lrc: 3/0,1 mode: --/PW res: [0x2b326:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.399172:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11266 00000100:00100000:1.0:1651529333.399179:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c680c11 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+242:41278:x1731746394416768:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.399182:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.399184:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003319354a/0x3234de053c4622c lrc: 4/0,0 mode: PR/PR res: [0x2b324:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acfb4 expref: 242 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.399188:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003319354a/0x3234de053c4622c lrc: 3/0,0 mode: PR/PR res: [0x2b324:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acfb4 expref: 242 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.399194:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003319354a/0x3234de053c4622c lrc: 0/0,0 mode: --/PR res: [0x2b324:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2acfb4 expref: 242 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.399197:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.399198:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.399199:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b1296ccd/0x3234de053c4c53d lrc: 3/0,1 mode: PW/PW res: [0x2b324:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.399202:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1296ccd/0x3234de053c4c53d lrc: 4/0,1 mode: PW/PW res: [0x2b324:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.399211:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.399220:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c680c11 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+240:41278:x1731746394416768:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 41us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.399240:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11266 00000100:00100000:1.0:1651529333.399429:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.399441:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.399464:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.399472:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.399490:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.399496:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.399505:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.399517:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394416832 00010000:00010000:1.0:1651529333.399527:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000088155288/0x3234de053c45583 lrc: 4/0,0 mode: PR/PR res: [0x2b325:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9bab expref: 239 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.399534:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394416960 00010000:00010000:1.0:1651529333.399536:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000480360d2/0x3234de053c46c12 lrc: 4/0,0 mode: PR/PR res: [0x2b326:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af9d0 expref: 240 pid: 80277 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.399540:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394417152 00010000:00010000:1.0:1651529333.399542:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b11923f6/0x3234de053c447a6 lrc: 5/0,0 mode: PR/PR res: [0x2b329:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a65c6 expref: 241 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.399546:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394417216 00010000:00010000:1.0:1651529333.399548:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008a0ee77f/0x3234de053c4502e lrc: 5/0,0 mode: PR/PR res: [0x2b328:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a861f expref: 242 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.399552:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11268 00000100:00100000:1.0:1651529333.399554:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+243:41279:x1731746394416832:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.399556:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.399557:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000088155288/0x3234de053c45583 lrc: 4/0,0 mode: PR/PR res: [0x2b325:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9bab expref: 243 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.399561:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000088155288/0x3234de053c45583 lrc: 3/0,0 mode: PR/PR res: [0x2b325:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9bab expref: 243 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.399568:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088155288/0x3234de053c45583 lrc: 0/0,0 mode: --/PR res: [0x2b325:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a9bab expref: 243 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.399571:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.399572:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.399573:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000011d5f1b1/0x3234de053c4c544 lrc: 3/0,1 mode: PW/PW res: [0x2b325:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.399576:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011d5f1b1/0x3234de053c4c544 lrc: 4/0,1 mode: PW/PW res: [0x2b325:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.399582:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.399589:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+242:41279:x1731746394416832:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 35us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.399591:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11268 00000100:00100000:1.0:1651529333.399595:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11269 00000100:00100000:1.0:1651529333.399597:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+241:41279:x1731746394416960:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.399599:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.399601:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000480360d2/0x3234de053c46c12 lrc: 4/0,0 mode: PR/PR res: [0x2b326:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af9d0 expref: 241 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.399604:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000480360d2/0x3234de053c46c12 lrc: 3/0,0 mode: PR/PR res: [0x2b326:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af9d0 expref: 241 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.399609:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000480360d2/0x3234de053c46c12 lrc: 0/0,0 mode: --/PR res: [0x2b326:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af9d0 expref: 241 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.399612:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.399613:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.399613:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4c552 lrc: 3/0,1 mode: PW/PW res: [0x2b326:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.399619:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4c552 lrc: 4/0,1 mode: PW/PW res: [0x2b326:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.399624:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.399629:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+240:41279:x1731746394416960:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 31us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.399631:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11269 00000100:00100000:1.0:1651529333.399635:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11270 00000100:00100000:1.0:1651529333.399636:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+239:41278:x1731746394417152:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.399638:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.399640:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b11923f6/0x3234de053c447a6 lrc: 5/0,0 mode: PR/PR res: [0x2b329:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a65c6 expref: 239 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.399643:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b11923f6/0x3234de053c447a6 lrc: 4/0,0 mode: PR/PR res: [0x2b329:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a65c6 expref: 239 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.399648:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.399648:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.399649:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4c559 lrc: 3/0,1 mode: PW/PW res: [0x2b329:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.399652:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4c559 lrc: 4/0,1 mode: PW/PW res: [0x2b329:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.399656:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.399660:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+239:41278:x1731746394417152:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 23us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.399663:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11270 00000100:00100000:1.0:1651529333.399666:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11271 00000100:00100000:1.0:1651529333.399667:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+238:41278:x1731746394417216:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.399669:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.399671:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008a0ee77f/0x3234de053c4502e lrc: 5/0,0 mode: PR/PR res: [0x2b328:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a861f expref: 238 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.399674:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008a0ee77f/0x3234de053c4502e lrc: 4/0,0 mode: PR/PR res: [0x2b328:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a861f expref: 238 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.399679:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.399679:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.399680:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009693da4/0x3234de053c4c560 lrc: 3/0,1 mode: PW/PW res: [0x2b328:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.399683:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009693da4/0x3234de053c4c560 lrc: 4/0,1 mode: PW/PW res: [0x2b328:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.399687:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.399690:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+239:41278:x1731746394417216:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 22us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.399693:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11271 00010000:00010000:1.0:1651529333.399703:0:80276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b11923f6/0x3234de053c447a6 lrc: 0/0,0 mode: --/PR res: [0x2b329:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a65c6 expref: 238 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.399707:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000be0ace91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996937856:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.399710:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4c559 lrc: 3/0,1 mode: PW/PW res: [0x2b329:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.399714:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4c559 lrc: 3/0,1 mode: PW/PW res: [0x2b329:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.399716:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4c559 lrc: 3/0,1 mode: PW/PW res: [0x2b329:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.399719:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4c559 lrc: 3/0,1 mode: PW/PW res: [0x2b329:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.399722:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4c559 lrc: 2/0,0 mode: PW/PW res: [0x2b329:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.399774:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1191:39029:x1731745946297216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1118us (1155us total) trans 12885078541 rc 0/0 00000100:00100000:1.0:1651529333.399777:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208648 00010000:00010000:1.0:1651529333.399785:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000011d5f1b1/0x3234de053c4c544 lrc: 3/0,1 mode: PW/PW res: [0x2b325:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.399788:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011d5f1b1/0x3234de053c4c544 lrc: 3/0,1 mode: PW/PW res: [0x2b325:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.399791:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011d5f1b1/0x3234de053c4c544 lrc: 3/0,1 mode: PW/PW res: [0x2b325:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.399794:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011d5f1b1/0x3234de053c4c544 lrc: 2/0,0 mode: PW/PW res: [0x2b325:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.399834:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1191:39029:x1731745946296960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1443us (1548us total) trans 12885078543 rc 0/0 00000100:00100000:1.0:1651529333.399837:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208644 00010000:00010000:1.0:1651529333.399844:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4c552 lrc: 3/0,1 mode: PW/PW res: [0x2b326:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.399847:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4c552 lrc: 3/0,1 mode: PW/PW res: [0x2b326:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.399850:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4c552 lrc: 3/0,1 mode: PW/PW res: [0x2b326:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.399853:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4c552 lrc: 2/0,0 mode: PW/PW res: [0x2b326:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.399881:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1191:39029:x1731745946297024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1428us (1545us total) trans 12885078544 rc 0/0 00000100:00100000:1.0:1651529333.399883:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208646 00000100:00100000:1.0:1651529333.399925:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.400016:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529333.400077:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c45287a/0x3234de053c4c567 lrc: 2/0,0 mode: PW/PW res: [0x2b32a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.400081:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008c45287a already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.400082:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c45287a/0x3234de053c4c567 lrc: 2/0,0 mode: PW/PW res: [0x2b32a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.400093:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c45287a/0x3234de053c4c567 lrc: 3/0,0 mode: PW/PW res: [0x2b32a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.400099:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c45287a/0x3234de053c4c567 lrc: 1/0,0 mode: --/PW res: [0x2b32a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.400101:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c45287a/0x3234de053c4c567 lrc: 0/0,0 mode: --/PW res: [0x2b32a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.400183:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.400190:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.400199:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946297472 00000100:00100000:1.0:1651529333.400216:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946297600 00000100:00100000:1.0:1651529333.400238:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208654 00000100:00100000:1.0:1651529333.400240:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1192:39029:x1731745946297472:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.400246:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176941 count 1 00010000:00010000:1.0:1651529333.400251:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4c58a lrc: 3/0,1 mode: --/PW res: [0x2b32d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.400256:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000076f67c45/0x3234de053c46837 lrc: 2/0,0 mode: PR/PR res: [0x2b32d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae89d expref: 235 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.400259:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.400259:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.400260:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4c58a lrc: 4/0,1 mode: --/PW res: [0x2b32d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.400270:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000076f67c45/0x3234de053c46837 lrc: 3/0,0 mode: PR/PR res: [0x2b32d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae89d expref: 235 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.400274:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000076f67c45/0x3234de053c46837 lrc: 4/0,0 mode: PR/PR res: [0x2b32d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae89d expref: 235 pid: 80277 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.400278:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005912c4a3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996938176:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.400286:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 0000000089d75f07 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.400311:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.400367:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.400416:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.400427:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.400434:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946297664 00000100:00100000:1.0:1651529333.400440:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946297792 00000100:00100000:1.0:1651529333.400443:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208658 00000100:00100000:1.0:1651529333.400445:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1196:39030:x1731745946297664:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.400450:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176944 count 1 00010000:00010000:1.0:1651529333.400454:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4c5a6 lrc: 3/0,1 mode: --/PW res: [0x2b330:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.400459:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000438c1816/0x3234de053c45d40 lrc: 2/0,0 mode: PR/PR res: [0x2b330:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abbb0 expref: 235 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.400462:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.400463:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.400463:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4c5a6 lrc: 4/0,1 mode: --/PW res: [0x2b330:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.400470:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000438c1816/0x3234de053c45d40 lrc: 3/0,0 mode: PR/PR res: [0x2b330:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abbb0 expref: 235 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.400474:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000438c1816/0x3234de053c45d40 lrc: 4/0,0 mode: PR/PR res: [0x2b330:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abbb0 expref: 235 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.400486:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ee8cd7c9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996938432:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.400495:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 000000004ca54b8a going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.400508:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.400523:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.400587:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11274 00000100:00100000:1.0:1651529333.400590:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+237:41278:x1731746394417664:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.400593:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.400596:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c890f38f/0x3234de053c438d4 lrc: 4/0,0 mode: PR/PR res: [0x2b32c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a28e8 expref: 237 pid: 80278 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.400600:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c890f38f/0x3234de053c438d4 lrc: 3/0,0 mode: PR/PR res: [0x2b32c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a28e8 expref: 237 pid: 80278 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.400606:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c890f38f/0x3234de053c438d4 lrc: 0/0,0 mode: --/PR res: [0x2b32c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a28e8 expref: 236 pid: 80278 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.400610:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.400611:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.400611:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000095fca58f/0x3234de053c4c575 lrc: 3/0,1 mode: PW/PW res: [0x2b32c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.400615:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095fca58f/0x3234de053c4c575 lrc: 4/0,1 mode: PW/PW res: [0x2b32c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.400629:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.400637:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+234:41278:x1731746394417664:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 46us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.400639:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11274 00000100:00100000:1.0:1651529333.400874:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.400884:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.400893:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.400899:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.400917:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005912c4a3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996938176:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.400921:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4c58a lrc: 3/0,1 mode: --/PW res: [0x2b32d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.400928:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394417984 00010000:00010000:1.0:1651529333.400933:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000076576a1/0x3234de053c44efa lrc: 5/0,0 mode: PR/PR res: [0x2b32f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8172 expref: 234 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.400942:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394417920 00010000:00010000:1.0:1651529333.400944:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000076f67c45/0x3234de053c46837 lrc: 4/0,0 mode: PR/PR res: [0x2b32d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae89d expref: 235 pid: 80277 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.400949:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394418048 00010000:00010000:1.0:1651529333.400951:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000011a57b01/0x3234de053c46631 lrc: 5/0,0 mode: PR/PR res: [0x2b32e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae0af expref: 236 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.400958:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11275 00000100:00100000:1.0:1651529333.400960:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+236:41278:x1731746394417984:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.400962:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.400964:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000076576a1/0x3234de053c44efa lrc: 5/0,0 mode: PR/PR res: [0x2b32f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8172 expref: 236 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.400973:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000076576a1/0x3234de053c44efa lrc: 4/0,0 mode: PR/PR res: [0x2b32f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a8172 expref: 236 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.400980:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.400981:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.400982:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff3c900b/0x3234de053c4c591 lrc: 3/0,1 mode: PW/PW res: [0x2b32f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.400985:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff3c900b/0x3234de053c4c591 lrc: 4/0,1 mode: PW/PW res: [0x2b32f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.400990:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.400996:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+236:41278:x1731746394417984:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 36us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.400999:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11275 00000100:00100000:1.0:1651529333.401003:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11276 00000100:00100000:1.0:1651529333.401005:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+235:41278:x1731746394417920:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.401007:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.401008:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000076f67c45/0x3234de053c46837 lrc: 4/0,0 mode: PR/PR res: [0x2b32d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae89d expref: 235 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.401012:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000076f67c45/0x3234de053c46837 lrc: 3/0,0 mode: PR/PR res: [0x2b32d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae89d expref: 235 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.401017:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076f67c45/0x3234de053c46837 lrc: 0/0,0 mode: --/PR res: [0x2b32d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae89d expref: 234 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.401020:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.401021:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.401022:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4c58a lrc: 3/0,1 mode: PW/PW res: [0x2b32d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.401025:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4c58a lrc: 4/0,1 mode: PW/PW res: [0x2b32d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.401030:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.401035:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+233:41278:x1731746394417920:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 29us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.401037:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11276 00000100:00100000:1.0:1651529333.401040:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11277 00000100:00100000:1.0:1651529333.401042:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+232:41278:x1731746394418048:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.401044:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.401045:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000011a57b01/0x3234de053c46631 lrc: 4/0,0 mode: PR/PR res: [0x2b32e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae0af expref: 232 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.401058:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000011a57b01/0x3234de053c46631 lrc: 3/0,0 mode: PR/PR res: [0x2b32e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae0af expref: 232 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.401068:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011a57b01/0x3234de053c46631 lrc: 0/0,0 mode: --/PR res: [0x2b32e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae0af expref: 232 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.401072:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.401073:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.401073:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000073f23091/0x3234de053c4c598 lrc: 3/0,1 mode: PW/PW res: [0x2b32e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.401076:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073f23091/0x3234de053c4c598 lrc: 4/0,1 mode: PW/PW res: [0x2b32e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.401085:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.401091:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+231:41278:x1731746394418048:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 48us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.401093:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11277 00010000:00010000:1.0:1651529333.401101:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ff3c900b/0x3234de053c4c591 lrc: 2/0,0 mode: PW/PW res: [0x2b32f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.401104:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ff3c900b already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.401105:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff3c900b/0x3234de053c4c591 lrc: 2/0,0 mode: PW/PW res: [0x2b32f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.401108:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff3c900b/0x3234de053c4c591 lrc: 3/0,0 mode: PW/PW res: [0x2b32f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.401112:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ff3c900b/0x3234de053c4c591 lrc: 1/0,0 mode: --/PW res: [0x2b32f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.401117:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff3c900b/0x3234de053c4c591 lrc: 0/0,0 mode: --/PW res: [0x2b32f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.401123:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4c58a lrc: 3/0,1 mode: PW/PW res: [0x2b32d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.401126:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4c58a lrc: 3/0,1 mode: PW/PW res: [0x2b32d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.401129:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4c58a lrc: 3/0,1 mode: PW/PW res: [0x2b32d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.401132:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4c58a lrc: 2/0,0 mode: PW/PW res: [0x2b32d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.401184:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1199:39029:x1731745946297472:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 943us (1001us total) trans 12885078549 rc 0/0 00000100:00100000:1.0:1651529333.401187:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208654 00000100:00100000:1.0:1651529333.401215:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.401261:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.401270:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.401301:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.401337:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ee8cd7c9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996938432:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.401342:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4c5a6 lrc: 3/0,1 mode: --/PW res: [0x2b330:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.401354:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394418112 00010000:00010000:1.0:1651529333.401359:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d395ab24/0x3234de053c46749 lrc: 4/0,0 mode: PR/PR res: [0x2b331:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ae4f3 expref: 231 pid: 80277 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.401364:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394418176 00010000:00010000:1.0:1651529333.401366:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000438c1816/0x3234de053c45d40 lrc: 4/0,0 mode: PR/PR res: [0x2b330:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abbb0 expref: 232 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.401370:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394418240 00010000:00010000:1.0:1651529333.401372:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000567cc12e/0x3234de053c4495f lrc: 4/0,0 mode: PR/PR res: [0x2b332:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6c95 expref: 233 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.401387:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11279 00000100:00100000:1.0:1651529333.401389:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+233:41278:x1731746394418176:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529333.401392:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.401393:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000438c1816/0x3234de053c45d40 lrc: 4/0,0 mode: PR/PR res: [0x2b330:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abbb0 expref: 233 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.401397:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000438c1816/0x3234de053c45d40 lrc: 3/0,0 mode: PR/PR res: [0x2b330:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abbb0 expref: 233 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.401406:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000438c1816/0x3234de053c45d40 lrc: 0/0,0 mode: --/PR res: [0x2b330:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abbb0 expref: 233 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.401410:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.401411:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.401412:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4c5a6 lrc: 3/0,1 mode: PW/PW res: [0x2b330:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.401415:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4c5a6 lrc: 4/0,1 mode: PW/PW res: [0x2b330:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.401421:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.401428:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+231:41278:x1731746394418176:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.401430:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11279 00010000:00010000:1.0:1651529333.401437:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4c5a6 lrc: 3/0,1 mode: PW/PW res: [0x2b330:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.401441:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4c5a6 lrc: 3/0,1 mode: PW/PW res: [0x2b330:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.401444:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4c5a6 lrc: 3/0,1 mode: PW/PW res: [0x2b330:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.401446:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4c5a6 lrc: 2/0,0 mode: PW/PW res: [0x2b330:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.401484:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1199:39030:x1731745946297664:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1039us (1068us total) trans 12885078551 rc 0/0 00000100:00100000:1.0:1651529333.401487:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208658 00010000:00010000:1.0:1651529333.401493:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4c5a6 lrc: 2/0,0 mode: PW/PW res: [0x2b330:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.401499:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000db11c60d already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.401500:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4c5a6 lrc: 2/0,0 mode: PW/PW res: [0x2b330:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.401503:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4c5a6 lrc: 3/0,0 mode: PW/PW res: [0x2b330:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.401507:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4c5a6 lrc: 1/0,0 mode: --/PW res: [0x2b330:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.401510:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4c5a6 lrc: 0/0,0 mode: --/PW res: [0x2b330:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.401547:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.401584:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.401606:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.401642:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.401698:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208664 00000100:00100000:1.0:1651529333.401701:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1201:39029:x1731745946298112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.401707:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176951 count 1 00010000:00010000:1.0:1651529333.401717:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4c5d0 lrc: 3/0,1 mode: --/PW res: [0x2b337:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.401722:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c44116 lrc: 2/0,0 mode: PR/PR res: [0x2b337:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4af3 expref: 227 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.401728:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.401736:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.401737:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4c5d0 lrc: 4/0,1 mode: --/PW res: [0x2b337:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.401745:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c44116 lrc: 3/0,0 mode: PR/PR res: [0x2b337:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4af3 expref: 227 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.401749:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c44116 lrc: 4/0,0 mode: PR/PR res: [0x2b337:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4af3 expref: 227 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.401753:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000078f9a278 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996938816:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.401762:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b52d0f36 going to sleep for 6 seconds 00000100:00100000:1.0:1651529333.401770:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394418432 00010000:00010000:1.0:1651529333.401774:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000064e77e0b/0x3234de053c469e2 lrc: 5/0,0 mode: PR/PR res: [0x2b333:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af006 expref: 228 pid: 80277 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.401785:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11281 00000100:00100000:1.0:1651529333.401787:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+228:41279:x1731746394418432:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.401790:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.401791:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000064e77e0b/0x3234de053c469e2 lrc: 5/0,0 mode: PR/PR res: [0x2b333:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af006 expref: 228 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.401795:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000064e77e0b/0x3234de053c469e2 lrc: 4/0,0 mode: PR/PR res: [0x2b333:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af006 expref: 228 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.401803:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.401804:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.401804:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001deecd9c/0x3234de053c4c5b4 lrc: 3/0,1 mode: PW/PW res: [0x2b333:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.401807:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001deecd9c/0x3234de053c4c5b4 lrc: 4/0,1 mode: PW/PW res: [0x2b333:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.401812:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.401818:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+228:41279:x1731746394418432:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 30us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.401820:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11281 00000100:00100000:1.0:1651529333.401882:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.401903:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.401919:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946298176 00000100:00100000:1.0:1651529333.401925:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946298240 00000100:00100000:1.0:1651529333.401932:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 208665 00000100:00100000:1.0:1651529333.401933:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1203:39030:x1731745946298176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529333.401939:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176952 count 1 00010000:00010000:1.0:1651529333.401949:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a05bebd/0x3234de053c4c5d7 lrc: 3/0,1 mode: --/PW res: [0x2b338:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.401954:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000371f2e4/0x3234de053c46987 lrc: 2/0,0 mode: PR/PR res: [0x2b338:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aee4d expref: 226 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.401957:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.401957:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.401958:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a05bebd/0x3234de053c4c5d7 lrc: 4/0,1 mode: --/PW res: [0x2b338:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.401965:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000371f2e4/0x3234de053c46987 lrc: 3/0,0 mode: PR/PR res: [0x2b338:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aee4d expref: 226 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529333.401969:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000371f2e4/0x3234de053c46987 lrc: 4/0,0 mode: PR/PR res: [0x2b338:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aee4d expref: 226 pid: 80277 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.401973:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000999005e pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996938880:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529333.401987:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000089d75f07 going to sleep for 6 seconds 00010000:00010000:1.0:1651529333.401993:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001deecd9c/0x3234de053c4c5b4 lrc: 2/0,0 mode: PW/PW res: [0x2b333:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.401996:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001deecd9c already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.401997:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001deecd9c/0x3234de053c4c5b4 lrc: 2/0,0 mode: PW/PW res: [0x2b333:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.402000:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001deecd9c/0x3234de053c4c5b4 lrc: 3/0,0 mode: PW/PW res: [0x2b333:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.402005:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001deecd9c/0x3234de053c4c5b4 lrc: 1/0,0 mode: --/PW res: [0x2b333:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.402008:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001deecd9c/0x3234de053c4c5b4 lrc: 0/0,0 mode: --/PW res: [0x2b333:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.402022:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.402133:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.402157:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.402166:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000078f9a278 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996938816:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.402175:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4c5d0 lrc: 3/0,1 mode: --/PW res: [0x2b337:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.402188:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394418560 00010000:00010000:1.0:1651529333.402193:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000063f303c5/0x3234de053c44c6f lrc: 5/0,0 mode: PR/PR res: [0x2b334:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7834 expref: 227 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.402199:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394418688 00010000:00010000:1.0:1651529333.402202:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c44116 lrc: 4/0,0 mode: PR/PR res: [0x2b337:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a4af3 expref: 228 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.402206:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11282 00000100:00100000:1.0:1651529333.402208:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+228:41278:x1731746394418560:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.402210:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.402212:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000063f303c5/0x3234de053c44c6f lrc: 4/0,0 mode: PR/PR res: [0x2b334:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7834 expref: 228 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.402215:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000063f303c5/0x3234de053c44c6f lrc: 3/0,0 mode: PR/PR res: [0x2b334:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7834 expref: 228 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.402240:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063f303c5/0x3234de053c44c6f lrc: 0/0,0 mode: --/PR res: [0x2b334:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a7834 expref: 228 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.402244:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.402245:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.402246:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008aaf7843/0x3234de053c4c5bb lrc: 3/0,1 mode: PW/PW res: [0x2b334:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.402249:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008aaf7843/0x3234de053c4c5bb lrc: 4/0,1 mode: PW/PW res: [0x2b334:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.402258:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.402265:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+227:41278:x1731746394418560:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 56us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.402268:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11282 00000100:00100000:1.0:1651529333.402284:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529333.402329:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4c5d0 lrc: 3/0,1 mode: PW/PW res: [0x2b337:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.402334:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4c5d0 lrc: 3/0,1 mode: PW/PW res: [0x2b337:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.402337:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4c5d0 lrc: 3/0,1 mode: PW/PW res: [0x2b337:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.402340:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4c5d0 lrc: 2/0,0 mode: PW/PW res: [0x2b337:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.402392:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1206:39029:x1731745946298112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 690us (750us total) trans 12885078555 rc 0/0 00000100:00100000:1.0:1651529333.402395:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208664 00000100:00100000:1.0:1651529333.402409:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.402447:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.402481:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394418624 00010000:00010000:1.0:1651529333.402487:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ccaf8927/0x3234de053c468a0 lrc: 4/0,0 mode: PR/PR res: [0x2b336:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aea3a expref: 225 pid: 80277 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.402493:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394418752 00010000:00010000:1.0:1651529333.402496:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000402de11c/0x3234de053c4505f lrc: 4/0,0 mode: PR/PR res: [0x2b335:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a86b9 expref: 226 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.402501:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11284 00000100:00100000:1.0:1651529333.402503:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+226:41279:x1731746394418624:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.402506:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.402507:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ccaf8927/0x3234de053c468a0 lrc: 4/0,0 mode: PR/PR res: [0x2b336:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aea3a expref: 226 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.402511:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ccaf8927/0x3234de053c468a0 lrc: 3/0,0 mode: PR/PR res: [0x2b336:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aea3a expref: 226 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.402516:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ccaf8927/0x3234de053c468a0 lrc: 0/0,0 mode: --/PR res: [0x2b336:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aea3a expref: 226 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.402520:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.402520:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.402521:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004b467e4a/0x3234de053c4c5c2 lrc: 3/0,1 mode: PW/PW res: [0x2b336:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.402524:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b467e4a/0x3234de053c4c5c2 lrc: 4/0,1 mode: PW/PW res: [0x2b336:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.402537:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.402544:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+225:41279:x1731746394418624:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 41us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.402547:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11284 00000100:00100000:1.0:1651529333.402632:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.402644:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.402654:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.402678:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000999005e pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996938880:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529333.402682:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008a05bebd/0x3234de053c4c5d7 lrc: 3/0,1 mode: --/PW res: [0x2b338:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.402688:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081575d6c/0x3234de053c4c5c9 lrc: 2/0,0 mode: PW/PW res: [0x2b335:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.402691:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000081575d6c already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.402692:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081575d6c/0x3234de053c4c5c9 lrc: 2/0,0 mode: PW/PW res: [0x2b335:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.402695:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081575d6c/0x3234de053c4c5c9 lrc: 3/0,0 mode: PW/PW res: [0x2b335:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.402700:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081575d6c/0x3234de053c4c5c9 lrc: 1/0,0 mode: --/PW res: [0x2b335:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.402702:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081575d6c/0x3234de053c4c5c9 lrc: 0/0,0 mode: --/PW res: [0x2b335:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.402719:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394419008 00010000:00010000:1.0:1651529333.402724:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000371f2e4/0x3234de053c46987 lrc: 4/0,0 mode: PR/PR res: [0x2b338:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aee4d expref: 223 pid: 80277 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.402740:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394419072 00010000:00010000:1.0:1651529333.402743:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000165272de/0x3234de053c45dfd lrc: 5/0,0 mode: PR/PR res: [0x2b339:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abeff expref: 224 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.402749:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11286 00000100:00100000:1.0:1651529333.402751:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+224:41278:x1731746394419008:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529333.402754:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.402755:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000371f2e4/0x3234de053c46987 lrc: 4/0,0 mode: PR/PR res: [0x2b338:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aee4d expref: 224 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.402758:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000371f2e4/0x3234de053c46987 lrc: 3/0,0 mode: PR/PR res: [0x2b338:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aee4d expref: 224 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.402764:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000371f2e4/0x3234de053c46987 lrc: 0/0,0 mode: --/PR res: [0x2b338:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2aee4d expref: 224 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.402767:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.402768:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.402769:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008a05bebd/0x3234de053c4c5d7 lrc: 3/0,1 mode: PW/PW res: [0x2b338:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.402772:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a05bebd/0x3234de053c4c5d7 lrc: 4/0,1 mode: PW/PW res: [0x2b338:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.402778:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.402785:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+223:41278:x1731746394419008:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.402788:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11286 00000100:00100000:1.0:1651529333.402792:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11287 00000100:00100000:1.0:1651529333.402794:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000969ab41d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+222:41278:x1731746394419072:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529333.402796:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.402797:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000165272de/0x3234de053c45dfd lrc: 5/0,0 mode: PR/PR res: [0x2b339:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abeff expref: 222 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.402801:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000165272de/0x3234de053c45dfd lrc: 4/0,0 mode: PR/PR res: [0x2b339:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2abeff expref: 222 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.402805:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.402805:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.402806:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009211dffb/0x3234de053c4c5de lrc: 3/0,1 mode: PW/PW res: [0x2b339:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.402809:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009211dffb/0x3234de053c4c5de lrc: 4/0,1 mode: PW/PW res: [0x2b339:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.402813:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.402817:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000969ab41d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+222:41278:x1731746394419072:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 23us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.402819:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11287 00010000:00010000:1.0:1651529333.402829:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008a05bebd/0x3234de053c4c5d7 lrc: 3/0,1 mode: PW/PW res: [0x2b338:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.402833:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a05bebd/0x3234de053c4c5d7 lrc: 3/0,1 mode: PW/PW res: [0x2b338:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.402836:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a05bebd/0x3234de053c4c5d7 lrc: 3/0,1 mode: PW/PW res: [0x2b338:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.402838:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a05bebd/0x3234de053c4c5d7 lrc: 2/0,0 mode: PW/PW res: [0x2b338:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.402887:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1207:39030:x1731745946298176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 952us (1005us total) trans 12885078559 rc 0/0 00000100:00100000:1.0:1651529333.402890:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 208665 00000100:00100000:1.0:1651529333.402940:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.402952:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.402973:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.403038:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394419136 00010000:00010000:1.0:1651529333.403043:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c8cd6ea4/0x3234de053c46a60 lrc: 4/0,0 mode: PR/PR res: [0x2b33a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af1b1 expref: 221 pid: 80277 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.403050:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394419200 00010000:00010000:1.0:1651529333.403053:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004a1913b4/0x3234de053c43cc4 lrc: 5/0,0 mode: PR/PR res: [0x2b33b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3877 expref: 222 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.403057:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11288 00000100:00100000:1.0:1651529333.403059:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+222:41278:x1731746394419136:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529333.403062:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.403063:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c8cd6ea4/0x3234de053c46a60 lrc: 4/0,0 mode: PR/PR res: [0x2b33a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af1b1 expref: 222 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.403067:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c8cd6ea4/0x3234de053c46a60 lrc: 3/0,0 mode: PR/PR res: [0x2b33a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af1b1 expref: 222 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.403072:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8cd6ea4/0x3234de053c46a60 lrc: 0/0,0 mode: --/PR res: [0x2b33a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2af1b1 expref: 222 pid: 80277 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.403076:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.403076:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.403077:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000001ccd9b7/0x3234de053c4c5e5 lrc: 3/0,1 mode: PW/PW res: [0x2b33a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.403080:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001ccd9b7/0x3234de053c4c5e5 lrc: 4/0,1 mode: PW/PW res: [0x2b33a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.403090:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.403097:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+221:41278:x1731746394419136:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 37us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.403100:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11288 00000100:00100000:1.0:1651529333.403104:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11289 00000100:00100000:1.0:1651529333.403106:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+220:41279:x1731746394419200:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529333.403108:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.403110:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004a1913b4/0x3234de053c43cc4 lrc: 5/0,0 mode: PR/PR res: [0x2b33b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3877 expref: 220 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.403113:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004a1913b4/0x3234de053c43cc4 lrc: 4/0,0 mode: PR/PR res: [0x2b33b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a3877 expref: 220 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.403118:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.403119:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.403120:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a902d314/0x3234de053c4c5ec lrc: 3/0,1 mode: PW/PW res: [0x2b33b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.403123:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a902d314/0x3234de053c4c5ec lrc: 4/0,1 mode: PW/PW res: [0x2b33b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.403127:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.403131:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+220:41279:x1731746394419200:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 24us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.403133:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11289 00010000:00010000:1.0:1651529333.403139:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009211dffb/0x3234de053c4c5de lrc: 2/0,0 mode: PW/PW res: [0x2b339:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.403143:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009211dffb already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.403144:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009211dffb/0x3234de053c4c5de lrc: 2/0,0 mode: PW/PW res: [0x2b339:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.403147:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009211dffb/0x3234de053c4c5de lrc: 3/0,0 mode: PW/PW res: [0x2b339:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.403150:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009211dffb/0x3234de053c4c5de lrc: 1/0,0 mode: --/PW res: [0x2b339:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.403153:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009211dffb/0x3234de053c4c5de lrc: 0/0,0 mode: --/PW res: [0x2b339:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.403160:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001ccd9b7/0x3234de053c4c5e5 lrc: 2/0,0 mode: PW/PW res: [0x2b33a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.403163:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000001ccd9b7 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.403164:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001ccd9b7/0x3234de053c4c5e5 lrc: 2/0,0 mode: PW/PW res: [0x2b33a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.403167:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001ccd9b7/0x3234de053c4c5e5 lrc: 3/0,0 mode: PW/PW res: [0x2b33a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.403170:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001ccd9b7/0x3234de053c4c5e5 lrc: 1/0,0 mode: --/PW res: [0x2b33a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.403172:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001ccd9b7/0x3234de053c4c5e5 lrc: 0/0,0 mode: --/PW res: [0x2b33a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.403194:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529333.403264:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.403319:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394419264 00010000:00010000:1.0:1651529333.403325:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001282b8b4/0x3234de053c43a55 lrc: 4/0,0 mode: PR/PR res: [0x2b33c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2e75 expref: 219 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.403332:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11290 00000100:00100000:1.0:1651529333.403334:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+219:41279:x1731746394419264:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529333.403336:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.403338:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001282b8b4/0x3234de053c43a55 lrc: 4/0,0 mode: PR/PR res: [0x2b33c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2e75 expref: 219 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.403341:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001282b8b4/0x3234de053c43a55 lrc: 3/0,0 mode: PR/PR res: [0x2b33c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2e75 expref: 219 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.403347:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001282b8b4/0x3234de053c43a55 lrc: 0/0,0 mode: --/PR res: [0x2b33c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a2e75 expref: 219 pid: 72395 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.403350:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.403351:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.403352:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000087e237b3/0x3234de053c4c5f3 lrc: 3/0,1 mode: PW/PW res: [0x2b33c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.403355:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087e237b3/0x3234de053c4c5f3 lrc: 4/0,1 mode: PW/PW res: [0x2b33c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.403365:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.403374:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+218:41279:x1731746394419264:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 39us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.403376:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11290 00010000:00010000:1.0:1651529333.403436:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087e237b3/0x3234de053c4c5f3 lrc: 2/0,0 mode: PW/PW res: [0x2b33c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.403440:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000087e237b3 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529333.403441:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087e237b3/0x3234de053c4c5f3 lrc: 2/0,0 mode: PW/PW res: [0x2b33c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.403444:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087e237b3/0x3234de053c4c5f3 lrc: 3/0,0 mode: PW/PW res: [0x2b33c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.403450:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087e237b3/0x3234de053c4c5f3 lrc: 1/0,0 mode: --/PW res: [0x2b33c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.403453:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087e237b3/0x3234de053c4c5f3 lrc: 0/0,0 mode: --/PW res: [0x2b33c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529333.403652:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.403661:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.403668:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394419456 00010000:00010000:1.0:1651529333.403673:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000486f4d27/0x3234de053c4464f lrc: 4/0,0 mode: PR/PR res: [0x2b33d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2a6039 expref: 218 pid: 72395 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.403680:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746394419520 00010000:00010000:1.0:1651529333.403682:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000916e7340/0x3234de053c461e6 lrc: 4/0,0 mode: PR/PR res: [0x2b33e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ace8e expref: 219 pid: 106695 timeout: 20092 lvb_type: 1 00000100:00100000:1.0:1651529333.403688:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11292 00000100:00100000:1.0:1651529333.403689:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+219:41278:x1731746394419520:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529333.403692:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529333.403693:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000916e7340/0x3234de053c461e6 lrc: 4/0,0 mode: PR/PR res: [0x2b33e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ace8e expref: 219 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.403697:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000916e7340/0x3234de053c461e6 lrc: 3/0,0 mode: PR/PR res: [0x2b33e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ace8e expref: 219 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.403702:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000916e7340/0x3234de053c461e6 lrc: 0/0,0 mode: --/PR res: [0x2b33e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ace8e expref: 218 pid: 106695 timeout: 20092 lvb_type: 1 00010000:00010000:1.0:1651529333.403707:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.403707:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529333.403708:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c4c601 lrc: 3/0,1 mode: PW/PW res: [0x2b33e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.403711:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c4c601 lrc: 4/0,1 mode: PW/PW res: [0x2b33e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529333.403720:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529333.403741:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+217:41278:x1731746394419520:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 51us (79us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529333.403744:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11292 00000100:00100000:1.0:1651529333.403952:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.404510:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.405039:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.406438:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.408521:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.409909:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.410558:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.411905:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.413991:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.414666:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.415390:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.416075:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.418132:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.420927:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.421588:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.422289:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.423507:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.424903:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.426101:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.428046:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.428643:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.429267:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.430531:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.431348:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.434453:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.436358:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.437627:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.438992:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.440353:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.440883:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.441918:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.442446:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.444017:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.446045:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.446874:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.447640:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.448137:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.448607:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.449616:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.450627:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.451099:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.453681:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.455242:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.457239:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.458755:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.459748:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.461245:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.462137:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.463084:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.464104:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.464542:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.466031:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.466417:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.467922:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.468835:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.469791:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.470311:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.471236:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.474000:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.474515:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.475541:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.476081:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.476986:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.477527:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.478742:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.478975:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.479998:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.481445:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.481942:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.482442:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.482873:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.483929:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.485797:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.486295:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.487239:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.488676:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.489141:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.489634:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.490611:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.491596:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.492566:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.494022:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.494502:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.495427:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.495894:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.496832:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.497235:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.497790:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.498708:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.499084:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.499651:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.500070:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.501070:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.502099:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.503627:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.504038:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.504609:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.505014:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.506067:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.506426:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.507379:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.508290:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.508866:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.510669:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.511265:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.512241:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.512610:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.513567:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.514100:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.514686:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.515048:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.515671:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.516460:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.518272:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.518897:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.520770:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.523298:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.524559:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.526521:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.527749:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.528380:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.529645:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.531483:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.532685:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.537744:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.538375:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.538988:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.540213:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.541469:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.542683:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.544540:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.546366:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.546991:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.548783:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.551288:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.551916:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.553105:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.556112:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.557356:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.559777:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.560404:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.561009:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.561613:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.563543:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.564782:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.565407:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.566021:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.566623:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.567234:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.567831:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.568448:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.569067:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.569673:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.570297:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.573180:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.573655:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.574134:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.576008:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.577154:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.577662:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.578718:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.579861:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.580755:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.581790:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.582288:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.582782:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.583655:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.585068:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.586985:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.589073:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.589583:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.590977:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.592473:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.592967:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.593432:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.593931:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.594321:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.594762:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.595828:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.596428:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.597460:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.599047:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.599398:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.600023:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.600496:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.601061:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.601555:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.603449:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.603921:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.605934:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.607365:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.607751:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.608359:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.608702:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.609280:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.610118:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.611538:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.612112:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.613027:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.614401:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.618477:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.620774:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.621297:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.621678:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.622334:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.622676:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.624352:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.625720:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.626170:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.626742:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.628767:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.629699:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.630102:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.631058:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.632052:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.634144:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.634516:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.635081:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.636109:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.636995:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.639537:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.640176:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.641468:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.642725:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.643386:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.644005:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.644608:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.645263:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.645893:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.646509:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.649035:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.650947:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.654104:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.656016:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.656638:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.658474:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.659603:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.660230:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.660825:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.663287:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.663909:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.665134:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.665751:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.667598:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.668208:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.670056:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.671266:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.671904:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.674292:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.676498:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.677055:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.679945:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.682307:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.682623:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.684038:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.684533:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.685068:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.685994:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.686499:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.686836:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.687398:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.687745:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.688242:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.689136:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.689707:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.691163:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.693377:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.693927:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.694490:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.696312:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.697240:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.698270:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.699202:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.699696:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.700037:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.700556:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.701064:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.702058:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.702523:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.702966:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.703450:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.703920:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.705324:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.706252:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.706595:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.707128:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.707657:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.709084:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.709435:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.709996:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.710489:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.710956:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.711514:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.713356:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.714181:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.714688:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.715198:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.716934:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.717995:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.719897:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.720776:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.722161:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.723120:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.724497:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.724998:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.725834:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.726838:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.733338:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.733909:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.734744:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.735764:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.736398:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.737157:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.737669:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.738193:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.739585:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.740067:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.740473:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.740990:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.743314:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.743643:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.744197:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.744631:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.745206:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.747049:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.747885:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.748951:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.749378:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.750334:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.750719:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.752169:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.752693:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.752932:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.753948:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.756699:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.757247:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.757688:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.758033:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.758570:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.759565:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.760544:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.761020:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.761440:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.761735:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.762212:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.763192:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.763635:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.766035:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.766507:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.766952:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.768215:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.769301:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.769774:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.770219:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.772126:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.773573:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.773834:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.775201:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.775500:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.776044:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.776587:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.777092:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.777565:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.777991:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.778424:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.780745:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.782132:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.782637:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.783158:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.784038:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.785088:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.785505:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.786291:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.787776:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.788726:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.790027:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.790581:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.792542:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.796182:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.796389:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.796961:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.797219:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.797737:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.799720:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.801589:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.802064:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.803049:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.805110:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.805663:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.806109:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.806974:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.807499:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.808032:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.809479:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.810373:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.810931:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.811187:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.812198:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.812725:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.813725:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.815191:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.816925:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.818012:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.818547:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.819378:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.820837:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.821773:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.822854:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.823193:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.823764:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.824149:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.825517:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.826004:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.826495:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.827007:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.827506:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.828946:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.829496:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.829853:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.831362:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.831662:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.833042:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.834548:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.837475:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.837752:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.838405:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.840304:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.840950:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.841540:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.845270:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.847130:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.848371:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.851536:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.852253:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.853456:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.854869:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.857382:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.858064:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.858753:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.859434:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.860197:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.860759:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.861433:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.863339:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.864644:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.865287:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.867905:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.869194:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.869877:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.870510:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.871282:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.871795:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.873181:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.873850:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.875058:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.877168:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.877713:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.878409:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.884950:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.886155:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.886770:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.887440:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.888695:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.892431:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.893928:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.894915:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.896415:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.896752:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.897790:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.898198:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.898720:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.899279:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.901079:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.903051:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.903425:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.904958:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.905477:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.906442:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.907006:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.907927:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.909431:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.909994:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.910552:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.911655:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.912721:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.913239:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.914697:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.915183:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.916193:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.917695:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.919686:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.921156:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.922929:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.924648:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.925445:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.926017:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.926922:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.927450:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.928237:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.928951:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.929934:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.930441:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.930987:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.931374:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.931905:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.933415:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.933949:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.935417:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.936340:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.937243:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.938367:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.939620:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.940397:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.940938:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.942447:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.943003:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.943500:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.944502:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.945973:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.947420:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.947928:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.948466:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.949434:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.952990:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.954471:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.954891:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.955401:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.957035:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.957457:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.958395:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.958935:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.959337:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.959865:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.961379:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.962458:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.964440:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.965368:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.965873:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.966451:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.969261:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.969844:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.971118:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.971643:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.974542:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.975147:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.975770:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.978271:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.978978:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.979620:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.982167:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.982784:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.983530:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.984054:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.984665:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.986508:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.987144:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.987858:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.989060:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.989550:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.990175:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.990893:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.992061:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.992677:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.993327:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.993857:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.994508:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.996185:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.998715:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.999387:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529333.999972:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.000483:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.001205:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.001719:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.002373:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.003515:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.004179:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.005422:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.008344:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.008878:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.010669:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.011183:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.014944:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.015479:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.017235:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.017840:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.018466:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.019667:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.021901:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.022276:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.022829:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.023673:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.025114:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.026357:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.027592:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.029465:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.030877:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.031425:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.032047:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.032773:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.033494:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.034736:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.037097:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.039116:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.039757:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.042427:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.045018:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.047005:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.047536:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.048060:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.050130:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.050859:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.052857:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.053482:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.054181:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.054860:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.056251:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.060234:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.061772:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.062461:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.063868:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.064539:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.065863:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.066347:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.068602:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.069118:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.069820:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.070296:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.072026:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.073006:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.073737:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.074265:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.076010:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.078215:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.078899:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.080336:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.080861:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.081417:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.082736:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.082877:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.084946:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.085947:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.086454:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.087521:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.088599:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.089662:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.090070:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.090725:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.090858:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.092490:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.093656:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.094075:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.094590:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.095326:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.096076:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.096947:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.098009:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.098520:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.099060:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.099911:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.100418:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.101593:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.102069:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.102423:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.103517:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.104032:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.104957:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.105709:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.106439:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.107875:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.110019:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.110788:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.110905:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.111470:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.112489:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.113372:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.113920:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.114426:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.114951:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.115466:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.116454:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.118326:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.119395:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.120880:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.121383:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.121913:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.123187:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.123434:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.125656:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.125987:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.126676:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.129501:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.131974:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.132628:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.132935:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.134425:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.135115:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.135366:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.135901:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.136647:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.136895:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.137387:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.137904:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.139319:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.139830:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.140840:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.141519:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.141756:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.142289:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.143217:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.144454:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.145096:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.145606:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.147098:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.147608:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.148369:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.149033:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.150447:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.151728:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.152495:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.153964:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.156194:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.156953:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.157496:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.158433:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.158968:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.159690:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.161272:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.161455:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.164659:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.164888:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.166042:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.167306:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.167788:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.168240:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.169254:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.169777:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.170702:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.171557:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.173388:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.173515:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.174009:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.174520:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.175780:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.176426:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.177972:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.180019:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.180930:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.181418:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.181937:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.183706:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.183934:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.184471:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.184985:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.185790:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.186462:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.186993:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.188028:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.189913:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.190432:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.191965:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.192473:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.193220:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.193435:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.194002:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.194563:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.195932:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.198673:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.199009:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.199735:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.199962:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.200449:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.201142:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.202641:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.204495:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.205057:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.205454:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.206901:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.207605:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.208313:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.208790:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.210216:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.212125:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.212621:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.213650:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.214667:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.215190:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.216174:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.217196:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.217951:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.219105:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.220330:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.221124:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.222053:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.222556:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.223795:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.224828:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.226785:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.227417:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.227602:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.229190:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.230141:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.231036:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.232484:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.233654:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.234748:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.236754:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.239776:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.240661:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.241234:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.241619:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.242834:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.243050:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.243682:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.244090:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.246688:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.247637:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.248164:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.249101:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.249511:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.250684:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.250988:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.251548:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.253399:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.255838:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.256419:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.257777:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.258146:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.260055:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.260541:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.261062:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.261443:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.262360:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.263442:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.266532:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.268219:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.268433:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.268920:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.271023:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.272835:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.273336:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.273866:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.274739:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.275755:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.278619:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.279106:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.281496:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.282494:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.284385:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.285755:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.286683:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.288115:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.289064:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.289534:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.292672:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.293461:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.293911:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.294576:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.295336:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.296884:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.298066:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.298176:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.298695:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.302007:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.302977:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.303722:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.304442:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.305873:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.306403:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.306933:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.307663:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.307777:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.308339:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.309370:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.309904:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.310295:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.310796:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.311772:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.312318:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.314121:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.316494:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.317009:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.317552:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.317989:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.318514:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.318904:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.319951:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.320330:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.320886:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.321245:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.321757:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.322310:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.323601:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.324102:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.325515:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.327746:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.328899:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.329384:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.329880:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.330850:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.331355:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.332454:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.333399:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.333836:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.334665:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.337659:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.338143:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.340062:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.341548:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.341953:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.342515:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.343483:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.349658:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.350298:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.350935:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.352178:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.354191:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.354923:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.356174:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.359559:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.360185:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.360871:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.362152:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.363512:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.364168:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.365550:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.367517:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.368797:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.369456:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.370767:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.372693:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.374637:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.375364:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.376031:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.376528:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.377449:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.378006:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.379310:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.380627:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.381238:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.384516:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.389058:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.390355:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.391070:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.391688:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.392341:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.393663:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.394419:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.395088:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.395725:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.397053:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.399027:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.399694:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.400352:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.401056:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.405502:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.406912:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.408320:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.408958:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.409568:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.410212:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.410883:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.411538:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.412218:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.412917:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.413554:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.415574:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.416284:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.416888:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.418908:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.420243:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.420934:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.421607:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.422277:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.422946:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.423657:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.424414:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.426498:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.427194:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.428520:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.432845:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.433298:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.433854:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.435286:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.436590:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.437500:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.438042:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.438580:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.439993:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.440984:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.441467:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.442007:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.443399:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.444288:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.447687:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.448127:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.448777:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.449283:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.451876:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.454715:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.455188:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.455641:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.457032:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.459483:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.459863:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.460380:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.460866:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.464160:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.465522:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.465985:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.466488:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.466991:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.467849:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.470404:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.471426:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.472460:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.472958:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.473994:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.474520:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.475364:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.475932:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.477522:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.478974:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.480055:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.480404:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.481026:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.483517:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.484569:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.485151:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.485603:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.486177:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.489078:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.490057:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.490575:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.492041:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.492593:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.493251:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.495916:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.496525:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.497785:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.498440:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.501176:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.501867:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.503155:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.506514:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.507166:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.508437:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.509124:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.509758:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.510422:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.511066:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.512404:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.513038:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.513670:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.517674:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.518322:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.519016:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.519645:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.520308:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.520949:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.522218:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.522855:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.524181:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.526857:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.527524:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.530116:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.530658:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.531248:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.531804:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.533541:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.534086:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.534659:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.535218:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.538344:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.539004:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.540116:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.540740:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.543269:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.544384:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.545099:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.546212:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.547489:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.549236:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.552165:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.552745:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.553371:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.554568:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.556414:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.557009:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.558196:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.558795:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.559412:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.560616:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.561822:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.562432:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.563627:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.564238:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.564837:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.567331:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.568414:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.569754:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.571165:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.572131:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.574580:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.574911:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.575445:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.576843:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.577849:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.579316:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.579705:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.580635:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.581165:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.583509:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.584058:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.584420:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.585837:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.587751:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.588293:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.588606:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.589636:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.591043:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.592004:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.593378:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.593826:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.594361:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.596714:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.598021:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.599181:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.600666:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.602681:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.603302:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.603865:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.605149:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.605623:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.607500:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.608151:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.608784:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.609301:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.609998:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.611239:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.612419:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.614297:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.615565:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.616146:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.617204:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.619898:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.620477:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.620977:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.621599:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.623872:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.626627:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.630053:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.630634:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.631858:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.632985:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.633500:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.634100:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.634605:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.636336:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.636871:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.638496:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.642445:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.643525:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.644142:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.644714:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.645299:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.646417:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.646914:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.647506:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.648095:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.648590:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.649793:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.650887:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.651437:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.651976:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.652336:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.653414:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.653794:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.654728:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.655165:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.655681:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.656719:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.657574:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.658105:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.658619:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.658929:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.659974:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.660336:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.660795:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.661910:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.662571:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.663492:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.663603:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.664709:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.667883:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.668434:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.668698:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.669198:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.669745:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.671469:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.673912:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.675138:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.675999:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.676831:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.679533:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.681210:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.681379:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.681944:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.683144:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.683851:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.685990:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.686926:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.687571:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.688484:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.689177:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.690491:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.691157:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.691341:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.692005:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.693550:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.694637:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.695085:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.695526:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.696079:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.696262:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.696817:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.697995:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.699117:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.699250:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.699726:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.700244:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.702909:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.703032:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.703543:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.704439:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.706705:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.706938:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.707435:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.709403:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.710605:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.711885:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.712630:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.713371:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.715199:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.717178:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.717669:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.719041:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.720295:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.720476:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.721506:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.722211:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.722443:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.722958:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.724829:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.727422:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.728413:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.729060:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.730852:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.732761:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.733286:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.733509:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.734677:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.736077:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.736408:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.736960:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.738343:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.739279:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.739605:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.740129:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.740978:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.741510:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.742043:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.742384:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.742937:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.744362:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.745743:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.747186:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.747783:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.748406:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.749015:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.749608:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.751442:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.752070:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.756805:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.758017:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.762531:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.763011:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.764958:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.765714:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.766338:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.771923:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.773320:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.774487:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.775296:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.775939:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.777168:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.777654:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.779672:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.783726:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.785552:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.786137:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.786640:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.787176:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.787828:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.788355:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.789941:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.791096:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.791831:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.792917:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.793459:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.796293:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.797754:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.798255:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.800010:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.801824:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.802533:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.803627:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.804788:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.805961:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.807205:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.809080:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.809565:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.810303:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.810708:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.811206:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.812579:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.814248:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.815421:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.816023:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.817159:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.817662:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.818177:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.822809:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.825001:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.827381:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.828496:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.829846:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.831593:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.832804:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.833299:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.834497:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.834988:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.835671:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.836848:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.837386:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.837672:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.839065:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.841518:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.842303:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.844890:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.845652:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.848875:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.849660:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.850207:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.850934:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.851702:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.854264:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.855207:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.856015:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.857305:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.857798:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.858579:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.859063:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.860951:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.861910:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.862626:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.863952:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.864449:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.865240:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.868307:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.869478:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.870913:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.872057:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.872861:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.873487:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.874660:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.877014:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.879892:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.880438:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.881784:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.882877:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.883536:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.884100:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.884594:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.885848:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.887116:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.887628:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.890112:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.890593:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.892481:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.893665:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.894276:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.896097:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.896685:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.897316:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.898908:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.900292:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.900827:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.901337:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.901613:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.902106:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.903115:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.903645:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.908019:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.909436:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.909942:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.910473:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.912028:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.912524:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.913054:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.914507:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.916721:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.919316:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.919544:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.920614:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.922078:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.922303:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.924489:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.924715:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.925647:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.926419:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.926638:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.927185:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.927658:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.928091:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.929634:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.932330:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.932640:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.933257:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.934646:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.935108:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.935658:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.936888:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.937524:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.938890:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.940114:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.941549:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.942463:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.943909:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.944492:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.946820:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.947798:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.949830:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.953552:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.954610:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.955526:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.956597:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.958495:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.959909:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.960504:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.960670:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.961186:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.961708:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.962257:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.963326:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.963829:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.964758:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.965239:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.966007:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.968649:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.969099:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.969548:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.970012:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.970453:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.971926:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.972414:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.972659:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.973347:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.974203:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.975718:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.976177:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.977488:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.978584:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.979333:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.979986:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.980453:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.981281:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.982357:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.982797:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.985242:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.985662:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.986154:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.987043:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.987628:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.987994:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.988951:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.990040:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.991398:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.992331:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.993321:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.993752:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.994004:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.996088:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.996570:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.997537:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.998995:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529334.999454:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.004539:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.005018:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.005969:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.006445:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.006912:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.007373:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.008282:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.008724:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.009194:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.009658:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.010649:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.011568:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.012033:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.012517:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.012980:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.013900:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.014806:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.015849:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.016066:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.019161:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.021111:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.023575:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.026068:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.026664:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.026996:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.028217:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.028530:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.030506:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.031647:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.034118:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.035558:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.037067:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.037648:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.038593:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.040096:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.040620:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.041031:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.041988:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.042914:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.044399:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.044779:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.045707:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.047261:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.047589:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.050803:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.051044:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.052645:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.053129:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.054528:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.055479:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.057895:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.058195:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.058802:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.059131:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.060640:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.061977:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.063116:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.064067:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.064562:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.065406:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.066755:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.067322:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.067896:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.068138:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.068796:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.069282:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.069566:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.070213:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.070977:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.071566:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.072125:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.077123:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.077311:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.079411:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.080278:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.081177:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.081622:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.082423:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.084564:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.085736:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.087481:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.090300:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.091998:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.092781:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.092792:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.092799:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395029440 00000100:00100000:1.0:1651529335.092813:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210251 00000100:00100000:1.0:1651529335.092815:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1796:41279:x1731746395029440:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.092819:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.092825:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c45287a/0x3234de053c4f135 lrc: 2/0,0 mode: --/PR res: [0x2ba48:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7778 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.092832:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2ba48:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.092837:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.092838:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.092840:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c45287a/0x3234de053c4f135 lrc: 3/0,0 mode: PR/PR res: [0x2ba48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7778 expref: 1798 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.092845:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008c45287a/0x3234de053c4f135 lrc: 3/0,0 mode: PR/PR res: [0x2ba48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7778 expref: 1798 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.092849:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008c45287a, rc 0) 00000100:00100000:1.0:1651529335.092866:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1797:41279:x1731746395029440:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 50us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.092870:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210251 00000100:00100000:1.0:1651529335.094077:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.094085:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395030144 00000100:00100000:1.0:1651529335.094096:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210253 00000100:00100000:1.0:1651529335.094098:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1797:41279:x1731746395030144:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.094101:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.094105:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d95da09e/0x3234de053c4f143 lrc: 2/0,0 mode: --/PR res: [0x2ba7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d77a2 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.094113:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2ba7c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.094117:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.094118:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.094119:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d95da09e/0x3234de053c4f143 lrc: 3/0,0 mode: PR/PR res: [0x2ba7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77a2 expref: 1798 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.094123:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d95da09e/0x3234de053c4f143 lrc: 3/0,0 mode: PR/PR res: [0x2ba7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77a2 expref: 1798 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.094127:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d95da09e, rc 0) 00000100:00100000:1.0:1651529335.094141:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1798:41279:x1731746395030144:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 42us (64us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.094144:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210253 00000100:00100000:1.0:1651529335.096090:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.096097:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395031104 00000100:00100000:1.0:1651529335.096108:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210254 00000100:00100000:1.0:1651529335.096110:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1798:41278:x1731746395031104:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.096113:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.096117:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a05bebd/0x3234de053c4f14a lrc: 2/0,0 mode: --/PR res: [0x2b435:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d77da expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.096123:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b435:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.096127:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.096127:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.096129:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a05bebd/0x3234de053c4f14a lrc: 3/0,0 mode: PR/PR res: [0x2b435:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77da expref: 1799 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.096135:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008a05bebd/0x3234de053c4f14a lrc: 3/0,0 mode: PR/PR res: [0x2b435:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77da expref: 1799 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.096139:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008a05bebd, rc 0) 00000100:00100000:1.0:1651529335.096152:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1799:41278:x1731746395031104:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 42us (63us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.096155:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210254 00000100:00100000:1.0:1651529335.098628:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.098635:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395032128 00000100:00100000:1.0:1651529335.098646:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210255 00000100:00100000:1.0:1651529335.098647:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1799:41278:x1731746395032128:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.098651:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.098655:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006247fb8a/0x3234de053c4f151 lrc: 2/0,0 mode: --/PR res: [0x2b667:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7812 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.098660:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b667:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.098664:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.098665:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.098666:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006247fb8a/0x3234de053c4f151 lrc: 3/0,0 mode: PR/PR res: [0x2b667:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7812 expref: 1800 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.098670:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006247fb8a/0x3234de053c4f151 lrc: 3/0,0 mode: PR/PR res: [0x2b667:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7812 expref: 1800 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.098674:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006247fb8a, rc 0) 00000100:00100000:1.0:1651529335.098687:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1800:41278:x1731746395032128:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 39us (60us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.098690:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210255 00000100:00100000:1.0:1651529335.099121:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.099128:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395032256 00000100:00100000:1.0:1651529335.099139:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210256 00000100:00100000:1.0:1651529335.099141:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1800:41279:x1731746395032256:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.099144:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.099148:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095fca58f/0x3234de053c4f158 lrc: 2/0,0 mode: --/PR res: [0x2b80a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7819 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.099153:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b80a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.099157:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.099157:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.099159:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095fca58f/0x3234de053c4f158 lrc: 3/0,0 mode: PR/PR res: [0x2b80a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7819 expref: 1801 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.099163:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000095fca58f/0x3234de053c4f158 lrc: 3/0,0 mode: PR/PR res: [0x2b80a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7819 expref: 1801 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.099167:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000095fca58f, rc 0) 00000100:00100000:1.0:1651529335.099179:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1801:41279:x1731746395032256:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (59us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.099182:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210256 00000100:00100000:1.0:1651529335.099705:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.099712:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395032512 00000100:00100000:1.0:1651529335.099723:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210257 00000100:00100000:1.0:1651529335.099725:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1801:41279:x1731746395032512:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.099728:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.099741:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b866be3a/0x3234de053c4f15f lrc: 2/0,0 mode: --/PR res: [0x2b885:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7827 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.099746:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b885:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.099750:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.099751:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.099752:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b866be3a/0x3234de053c4f15f lrc: 3/0,0 mode: PR/PR res: [0x2b885:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7827 expref: 1802 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.099756:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b866be3a/0x3234de053c4f15f lrc: 3/0,0 mode: PR/PR res: [0x2b885:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7827 expref: 1802 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.099760:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b866be3a, rc 0) 00000100:00100000:1.0:1651529335.099773:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1802:41279:x1731746395032512:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 48us (69us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.099776:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210257 00000100:00100000:1.0:1651529335.100425:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.100432:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395032768 00000100:00100000:1.0:1651529335.100443:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210258 00000100:00100000:1.0:1651529335.100444:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1802:41278:x1731746395032768:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.100448:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.100451:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a902d314/0x3234de053c4f166 lrc: 2/0,0 mode: --/PR res: [0x2b5d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7835 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.100457:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b5d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.100460:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.100461:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.100462:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a902d314/0x3234de053c4f166 lrc: 3/0,0 mode: PR/PR res: [0x2b5d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7835 expref: 1803 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.100467:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a902d314/0x3234de053c4f166 lrc: 3/0,0 mode: PR/PR res: [0x2b5d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7835 expref: 1803 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.100470:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a902d314, rc 0) 00000100:00100000:1.0:1651529335.100483:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1803:41278:x1731746395032768:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (59us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.100486:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210258 00000100:00100000:1.0:1651529335.101427:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.101434:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395033216 00000100:00100000:1.0:1651529335.101445:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210259 00000100:00100000:1.0:1651529335.101446:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1803:41278:x1731746395033216:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.101450:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.101453:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087e237b3/0x3234de053c4f16d lrc: 2/0,0 mode: --/PR res: [0x2b9ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d784a expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.101458:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b9ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.101462:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.101462:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.101464:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087e237b3/0x3234de053c4f16d lrc: 3/0,0 mode: PR/PR res: [0x2b9ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d784a expref: 1804 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.101468:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000087e237b3/0x3234de053c4f16d lrc: 3/0,0 mode: PR/PR res: [0x2b9ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d784a expref: 1804 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.101474:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000087e237b3, rc 0) 00000100:00100000:1.0:1651529335.101487:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1804:41278:x1731746395033216:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 40us (60us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.101489:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210259 00000100:00100000:1.0:1651529335.102468:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.102475:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395033536 00000100:00100000:1.0:1651529335.102485:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210260 00000100:00100000:1.0:1651529335.102487:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1804:41278:x1731746395033536:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.102490:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.102494:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b467e4a/0x3234de053c4f174 lrc: 2/0,0 mode: --/PR res: [0x2b908:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d785f expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.102499:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b908:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.102502:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.102503:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.102504:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b467e4a/0x3234de053c4f174 lrc: 3/0,0 mode: PR/PR res: [0x2b908:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d785f expref: 1805 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.102509:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004b467e4a/0x3234de053c4f174 lrc: 3/0,0 mode: PR/PR res: [0x2b908:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d785f expref: 1805 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.102512:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004b467e4a, rc 0) 00000100:00100000:1.0:1651529335.102525:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1805:41278:x1731746395033536:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 37us (57us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.102528:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210260 00000100:00100000:1.0:1651529335.105352:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.105359:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395034752 00000100:00100000:1.0:1651529335.105370:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210261 00000100:00100000:1.0:1651529335.105371:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1805:41278:x1731746395034752:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.105374:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.105378:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008aaf7843/0x3234de053c4f17b lrc: 2/0,0 mode: --/PR res: [0x2bb06:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d789e expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.105383:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb06:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.105387:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.105388:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.105389:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008aaf7843/0x3234de053c4f17b lrc: 3/0,0 mode: PR/PR res: [0x2bb06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d789e expref: 1806 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.105394:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008aaf7843/0x3234de053c4f17b lrc: 3/0,0 mode: PR/PR res: [0x2bb06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d789e expref: 1806 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.105397:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008aaf7843, rc 0) 00000100:00100000:1.0:1651529335.105410:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1806:41278:x1731746395034752:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.105413:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210261 00000100:00100000:1.0:1651529335.109168:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.109175:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395036544 00000100:00100000:1.0:1651529335.109186:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210262 00000100:00100000:1.0:1651529335.109187:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1806:41278:x1731746395036544:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.109191:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.109194:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001ccd9b7/0x3234de053c4f182 lrc: 2/0,0 mode: --/PR res: [0x2b3ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7900 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.109200:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b3ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.109203:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.109204:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.109205:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001ccd9b7/0x3234de053c4f182 lrc: 3/0,0 mode: PR/PR res: [0x2b3ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7900 expref: 1807 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.109209:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000001ccd9b7/0x3234de053c4f182 lrc: 3/0,0 mode: PR/PR res: [0x2b3ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7900 expref: 1807 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.109213:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000001ccd9b7, rc 0) 00000100:00100000:1.0:1651529335.109241:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1807:41278:x1731746395036544:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 52us (73us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.109244:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210262 00000100:00100000:1.0:1651529335.110539:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.110546:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395037056 00000100:00100000:1.0:1651529335.110557:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210263 00000100:00100000:1.0:1651529335.110559:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1807:41279:x1731746395037056:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.110562:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.110566:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009211dffb/0x3234de053c4f189 lrc: 2/0,0 mode: --/PR res: [0x2b549:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d791c expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.110571:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b549:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.110574:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.110575:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.110576:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009211dffb/0x3234de053c4f189 lrc: 3/0,0 mode: PR/PR res: [0x2b549:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d791c expref: 1808 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.110583:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009211dffb/0x3234de053c4f189 lrc: 3/0,0 mode: PR/PR res: [0x2b549:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d791c expref: 1808 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.110587:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009211dffb, rc 0) 00000100:00100000:1.0:1651529335.110599:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1808:41279:x1731746395037056:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 40us (61us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.110602:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210263 00000100:00100000:1.0:1651529335.111357:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.111363:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395037568 00000100:00100000:1.0:1651529335.111374:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210264 00000100:00100000:1.0:1651529335.111376:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1808:41278:x1731746395037568:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.111379:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.111383:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000281e99c0/0x3234de053c4f190 lrc: 2/0,0 mode: --/PR res: [0x2b79f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7938 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.111388:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b79f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.111392:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.111393:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.111394:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000281e99c0/0x3234de053c4f190 lrc: 3/0,0 mode: PR/PR res: [0x2b79f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7938 expref: 1809 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.111398:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000281e99c0/0x3234de053c4f190 lrc: 3/0,0 mode: PR/PR res: [0x2b79f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7938 expref: 1809 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.111402:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000281e99c0, rc 0) 00000100:00100000:1.0:1651529335.111415:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1809:41278:x1731746395037568:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (59us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.111418:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210264 00000100:00100000:1.0:1651529335.112458:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.112465:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395038080 00000100:00100000:1.0:1651529335.112475:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210265 00000100:00100000:1.0:1651529335.112476:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1809:41278:x1731746395038080:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.112480:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.112484:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081575d6c/0x3234de053c4f197 lrc: 2/0,0 mode: --/PR res: [0x2b440:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7954 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.112488:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b440:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.112492:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.112493:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.112494:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081575d6c/0x3234de053c4f197 lrc: 3/0,0 mode: PR/PR res: [0x2b440:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7954 expref: 1810 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.112499:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000081575d6c/0x3234de053c4f197 lrc: 3/0,0 mode: PR/PR res: [0x2b440:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7954 expref: 1810 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.112502:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000081575d6c, rc 0) 00000100:00100000:1.0:1651529335.112515:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1810:41278:x1731746395038080:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.112518:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210265 00000100:00100000:1.0:1651529335.113010:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.113017:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395038336 00000100:00100000:1.0:1651529335.113027:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210266 00000100:00100000:1.0:1651529335.113029:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1810:41278:x1731746395038336:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.113032:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.113036:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6f87d2f/0x3234de053c4f19e lrc: 2/0,0 mode: --/PR res: [0x2b743:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7962 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.113041:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b743:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.113045:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.113045:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.113047:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6f87d2f/0x3234de053c4f19e lrc: 3/0,0 mode: PR/PR res: [0x2b743:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7962 expref: 1811 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.113051:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a6f87d2f/0x3234de053c4f19e lrc: 3/0,0 mode: PR/PR res: [0x2b743:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7962 expref: 1811 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.113055:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6f87d2f, rc 0) 00000100:00100000:1.0:1651529335.113067:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1811:41278:x1731746395038336:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.113070:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210266 00000100:00100000:1.0:1651529335.114099:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.114106:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395038848 00000100:00100000:1.0:1651529335.114117:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210267 00000100:00100000:1.0:1651529335.114118:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1811:41278:x1731746395038848:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.114122:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.114125:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001deecd9c/0x3234de053c4f1a5 lrc: 2/0,0 mode: --/PR res: [0x2ba93:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d797e expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.114130:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2ba93:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.114134:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.114134:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.114136:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001deecd9c/0x3234de053c4f1a5 lrc: 3/0,0 mode: PR/PR res: [0x2ba93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d797e expref: 1812 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.114140:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001deecd9c/0x3234de053c4f1a5 lrc: 3/0,0 mode: PR/PR res: [0x2ba93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d797e expref: 1812 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.114144:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001deecd9c, rc 0) 00000100:00100000:1.0:1651529335.114156:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1812:41278:x1731746395038848:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 37us (57us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.114159:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210267 00000100:00100000:1.0:1651529335.114601:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.114608:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395039104 00000100:00100000:1.0:1651529335.114618:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210268 00000100:00100000:1.0:1651529335.114620:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1812:41278:x1731746395039104:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.114623:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.114626:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073f23091/0x3234de053c4f1ac lrc: 2/0,0 mode: --/PR res: [0x2b50f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d798c expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.114631:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b50f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.114634:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.114635:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.114636:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073f23091/0x3234de053c4f1ac lrc: 3/0,0 mode: PR/PR res: [0x2b50f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d798c expref: 1813 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.114641:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000073f23091/0x3234de053c4f1ac lrc: 3/0,0 mode: PR/PR res: [0x2b50f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d798c expref: 1813 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.114647:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000073f23091, rc 0) 00000100:00100000:1.0:1651529335.114659:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1813:41278:x1731746395039104:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 39us (59us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.114662:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210268 00000100:00100000:1.0:1651529335.115166:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.115173:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395039360 00000100:00100000:1.0:1651529335.115183:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210269 00000100:00100000:1.0:1651529335.115185:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1813:41278:x1731746395039360:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.115188:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.115192:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff3c900b/0x3234de053c4f1b3 lrc: 2/0,0 mode: --/PR res: [0x2b62c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d799a expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.115197:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b62c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.115200:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.115201:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.115202:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff3c900b/0x3234de053c4f1b3 lrc: 3/0,0 mode: PR/PR res: [0x2b62c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d799a expref: 1814 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.115206:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ff3c900b/0x3234de053c4f1b3 lrc: 3/0,0 mode: PR/PR res: [0x2b62c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d799a expref: 1814 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.115210:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ff3c900b, rc 0) 00000100:00100000:1.0:1651529335.115233:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1814:41278:x1731746395039360:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 47us (67us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.115236:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210269 00000100:00100000:1.0:1651529335.115708:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.115716:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395039616 00000100:00100000:1.0:1651529335.115726:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210270 00000100:00100000:1.0:1651529335.115728:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1814:41278:x1731746395039616:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.115738:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.115743:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4f1ba lrc: 2/0,0 mode: --/PR res: [0x2b4d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d79a8 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.115747:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b4d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.115751:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.115751:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.115753:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4f1ba lrc: 3/0,0 mode: PR/PR res: [0x2b4d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d79a8 expref: 1815 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.115757:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4f1ba lrc: 3/0,0 mode: PR/PR res: [0x2b4d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d79a8 expref: 1815 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.115761:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000039e8f661, rc 0) 00000100:00100000:1.0:1651529335.115774:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1815:41278:x1731746395039616:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 46us (66us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.115777:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210270 00000100:00100000:1.0:1651529335.116262:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.116269:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395039872 00000100:00100000:1.0:1651529335.116280:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210271 00000100:00100000:1.0:1651529335.116281:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1815:41278:x1731746395039872:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.116284:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.116288:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4f1c1 lrc: 2/0,0 mode: --/PR res: [0x2b801:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d79b6 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.116293:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b801:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.116297:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.116297:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.116299:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4f1c1 lrc: 3/0,0 mode: PR/PR res: [0x2b801:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d79b6 expref: 1816 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.116303:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4f1c1 lrc: 3/0,0 mode: PR/PR res: [0x2b801:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d79b6 expref: 1816 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.116306:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db11c60d, rc 0) 00000100:00100000:1.0:1651529335.116319:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1816:41278:x1731746395039872:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 37us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.116322:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210271 00000100:00100000:1.0:1651529335.119339:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.119347:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395041344 00000100:00100000:1.0:1651529335.119357:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210272 00000100:00100000:1.0:1651529335.119359:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1816:41279:x1731746395041344:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.119362:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.119366:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4f1c8 lrc: 2/0,0 mode: --/PR res: [0x2b4ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7a0a expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.119371:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b4ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.119374:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.119375:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.119376:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4f1c8 lrc: 3/0,0 mode: PR/PR res: [0x2b4ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a0a expref: 1817 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.119383:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4f1c8 lrc: 3/0,0 mode: PR/PR res: [0x2b4ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a0a expref: 1817 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.119386:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008270dfe9, rc 0) 00000100:00100000:1.0:1651529335.119399:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1817:41279:x1731746395041344:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 40us (60us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.119402:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210272 00000100:00100000:1.0:1651529335.120983:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.120990:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395042112 00000100:00100000:1.0:1651529335.121000:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210273 00000100:00100000:1.0:1651529335.121002:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1817:41279:x1731746395042112:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.121005:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.121009:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4f1cf lrc: 2/0,0 mode: --/PR res: [0x2b82b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7a34 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.121014:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b82b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.121017:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.121018:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.121019:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4f1cf lrc: 3/0,0 mode: PR/PR res: [0x2b82b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a34 expref: 1818 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.121023:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4f1cf lrc: 3/0,0 mode: PR/PR res: [0x2b82b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a34 expref: 1818 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.121027:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b0e4295a, rc 0) 00000100:00100000:1.0:1651529335.121040:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1818:41279:x1731746395042112:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 37us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.121043:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210273 00000100:00100000:1.0:1651529335.122351:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.122358:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395042752 00000100:00100000:1.0:1651529335.122369:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210274 00000100:00100000:1.0:1651529335.122370:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1818:41278:x1731746395042752:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.122373:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.122382:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011d5f1b1/0x3234de053c4f1d6 lrc: 2/0,0 mode: --/PR res: [0x2b418:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7a57 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.122387:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b418:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.122391:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.122391:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.122393:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011d5f1b1/0x3234de053c4f1d6 lrc: 3/0,0 mode: PR/PR res: [0x2b418:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a57 expref: 1819 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.122397:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000011d5f1b1/0x3234de053c4f1d6 lrc: 3/0,0 mode: PR/PR res: [0x2b418:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a57 expref: 1819 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.122401:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000011d5f1b1, rc 0) 00000100:00100000:1.0:1651529335.122414:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1819:41278:x1731746395042752:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 43us (63us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.122416:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210274 00000100:00100000:1.0:1651529335.122955:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.122961:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395043072 00000100:00100000:1.0:1651529335.122972:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210275 00000100:00100000:1.0:1651529335.122974:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1819:41278:x1731746395043072:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.122977:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.122981:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4f1dd lrc: 2/0,0 mode: --/PR res: [0x2b950:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7a6c expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.122986:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b950:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.122989:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.122990:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.122991:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4f1dd lrc: 3/0,0 mode: PR/PR res: [0x2b950:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a6c expref: 1820 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.122995:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4f1dd lrc: 3/0,0 mode: PR/PR res: [0x2b950:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a6c expref: 1820 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.122999:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003aeb15a8, rc 0) 00000100:00100000:1.0:1651529335.123012:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1820:41278:x1731746395043072:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.123015:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210275 00000100:00100000:1.0:1651529335.123488:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.123495:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395043328 00000100:00100000:1.0:1651529335.123505:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210276 00000100:00100000:1.0:1651529335.123507:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1820:41279:x1731746395043328:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.123510:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.123514:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4f1e4 lrc: 2/0,0 mode: --/PR res: [0x2b67a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7a7a expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.123519:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b67a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.123523:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.123524:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.123525:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4f1e4 lrc: 3/0,0 mode: PR/PR res: [0x2b67a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a7a expref: 1821 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.123529:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4f1e4 lrc: 3/0,0 mode: PR/PR res: [0x2b67a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a7a expref: 1821 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.123533:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fb5dc195, rc 0) 00000100:00100000:1.0:1651529335.123546:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1821:41279:x1731746395043328:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (59us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.123549:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210276 00000100:00100000:1.0:1651529335.124146:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.124153:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395043648 00000100:00100000:1.0:1651529335.124164:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210277 00000100:00100000:1.0:1651529335.124166:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1821:41279:x1731746395043648:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.124169:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.124173:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d395ab24/0x3234de053c4f1eb lrc: 2/0,0 mode: --/PR res: [0x2bade:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7a8f expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.124178:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bade:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.124183:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.124183:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.124185:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d395ab24/0x3234de053c4f1eb lrc: 3/0,0 mode: PR/PR res: [0x2bade:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a8f expref: 1822 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.124189:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d395ab24/0x3234de053c4f1eb lrc: 3/0,0 mode: PR/PR res: [0x2bade:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a8f expref: 1822 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.124195:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d395ab24, rc 0) 00000100:00100000:1.0:1651529335.124208:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1822:41279:x1731746395043648:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 41us (62us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.124211:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210277 00000100:00100000:1.0:1651529335.124654:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.124661:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395043840 00000100:00100000:1.0:1651529335.124671:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210278 00000100:00100000:1.0:1651529335.124673:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1822:41278:x1731746395043840:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.124676:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.124680:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009693da4/0x3234de053c4f1f2 lrc: 2/0,0 mode: --/PR res: [0x2b7a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7a96 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.124685:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b7a1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.124688:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.124689:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.124691:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009693da4/0x3234de053c4f1f2 lrc: 3/0,0 mode: PR/PR res: [0x2b7a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a96 expref: 1823 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.124695:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000009693da4/0x3234de053c4f1f2 lrc: 3/0,0 mode: PR/PR res: [0x2b7a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a96 expref: 1823 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.124699:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000009693da4, rc 0) 00000100:00100000:1.0:1651529335.124711:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1823:41278:x1731746395043840:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 37us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.124714:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210278 00000100:00100000:1.0:1651529335.126199:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.126206:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395044480 00000100:00100000:1.0:1651529335.126217:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210279 00000100:00100000:1.0:1651529335.126219:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1823:41279:x1731746395044480:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.126232:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.126236:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1296ccd/0x3234de053c4f1f9 lrc: 2/0,0 mode: --/PR res: [0x2b953:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7ac0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.126241:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b953:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.126245:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.126246:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.126247:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1296ccd/0x3234de053c4f1f9 lrc: 3/0,0 mode: PR/PR res: [0x2b953:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ac0 expref: 1824 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.126252:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b1296ccd/0x3234de053c4f1f9 lrc: 3/0,0 mode: PR/PR res: [0x2b953:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ac0 expref: 1824 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.126255:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b1296ccd, rc 0) 00000100:00100000:1.0:1651529335.126268:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1824:41279:x1731746395044480:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 49us (70us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.126271:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210279 00000100:00100000:1.0:1651529335.127342:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.127349:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395044992 00000100:00100000:1.0:1651529335.127360:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210280 00000100:00100000:1.0:1651529335.127361:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1824:41279:x1731746395044992:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.127365:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.127368:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d1e5ded/0x3234de053c4f200 lrc: 2/0,0 mode: --/PR res: [0x2b8f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7adc expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.127373:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b8f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.127377:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.127377:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.127379:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d1e5ded/0x3234de053c4f200 lrc: 3/0,0 mode: PR/PR res: [0x2b8f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7adc expref: 1825 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.127383:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009d1e5ded/0x3234de053c4f200 lrc: 3/0,0 mode: PR/PR res: [0x2b8f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7adc expref: 1825 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.127386:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009d1e5ded, rc 0) 00000100:00100000:1.0:1651529335.127399:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1825:41279:x1731746395044992:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 37us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.127402:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210280 00000100:00100000:1.0:1651529335.127947:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.127954:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395045248 00000100:00100000:1.0:1651529335.127965:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210281 00000100:00100000:1.0:1651529335.127967:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085af61db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1825:41279:x1731746395045248:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.127970:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.127974:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000837ab3ca/0x3234de053c4f207 lrc: 2/0,0 mode: --/PR res: [0x2b774:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7aea expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.127979:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b774:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.127982:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.127983:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.127984:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000837ab3ca/0x3234de053c4f207 lrc: 3/0,0 mode: PR/PR res: [0x2b774:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7aea expref: 1826 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.127991:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000837ab3ca/0x3234de053c4f207 lrc: 3/0,0 mode: PR/PR res: [0x2b774:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7aea expref: 1826 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.127995:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000837ab3ca, rc 0) 00000100:00100000:1.0:1651529335.128008:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085af61db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1826:41279:x1731746395045248:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 40us (61us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.128010:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210281 00000100:00100000:1.0:1651529335.129182:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.129189:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395045760 00000100:00100000:1.0:1651529335.129200:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210282 00000100:00100000:1.0:1651529335.129202:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1826:41279:x1731746395045760:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.129205:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.129209:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f291cae5/0x3234de053c4f20e lrc: 2/0,0 mode: --/PR res: [0x2b89e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7b06 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.129214:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b89e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.129217:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.129218:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.129219:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f291cae5/0x3234de053c4f20e lrc: 3/0,0 mode: PR/PR res: [0x2b89e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b06 expref: 1827 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.129235:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f291cae5/0x3234de053c4f20e lrc: 3/0,0 mode: PR/PR res: [0x2b89e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b06 expref: 1827 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.129239:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f291cae5, rc 0) 00000100:00100000:1.0:1651529335.129253:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1827:41279:x1731746395045760:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 50us (71us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.129255:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210282 00000100:00100000:1.0:1651529335.129746:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.129754:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395046016 00000100:00100000:1.0:1651529335.129765:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210283 00000100:00100000:1.0:1651529335.129766:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1827:41279:x1731746395046016:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.129770:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.129773:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071086493/0x3234de053c4f215 lrc: 2/0,0 mode: --/PR res: [0x2b49b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7b14 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.129778:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b49b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.129782:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.129783:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.129784:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071086493/0x3234de053c4f215 lrc: 3/0,0 mode: PR/PR res: [0x2b49b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b14 expref: 1828 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.129788:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000071086493/0x3234de053c4f215 lrc: 3/0,0 mode: PR/PR res: [0x2b49b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b14 expref: 1828 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.129792:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000071086493, rc 0) 00000100:00100000:1.0:1651529335.129805:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1828:41279:x1731746395046016:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (59us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.129808:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210283 00000100:00100000:1.0:1651529335.130929:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.130936:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395046528 00000100:00100000:1.0:1651529335.130947:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210284 00000100:00100000:1.0:1651529335.130949:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1828:41279:x1731746395046528:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.130952:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.130956:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006685f816/0x3234de053c4f21c lrc: 2/0,0 mode: --/PR res: [0x2b959:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7b30 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.130961:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b959:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.130965:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.130965:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.130967:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006685f816/0x3234de053c4f21c lrc: 3/0,0 mode: PR/PR res: [0x2b959:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b30 expref: 1829 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.130971:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006685f816/0x3234de053c4f21c lrc: 3/0,0 mode: PR/PR res: [0x2b959:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b30 expref: 1829 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.130975:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006685f816, rc 0) 00000100:00100000:1.0:1651529335.130988:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1829:41279:x1731746395046528:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (59us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.130990:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210284 00000100:00100000:1.0:1651529335.132704:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.132711:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395047232 00000100:00100000:1.0:1651529335.132722:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210285 00000100:00100000:1.0:1651529335.132724:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1829:41279:x1731746395047232:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.132727:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.132737:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021332347/0x3234de053c4f223 lrc: 2/0,0 mode: --/PR res: [0x2b6aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7b53 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.132743:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b6aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.132746:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.132747:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.132748:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021332347/0x3234de053c4f223 lrc: 3/0,0 mode: PR/PR res: [0x2b6aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b53 expref: 1830 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.132753:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000021332347/0x3234de053c4f223 lrc: 3/0,0 mode: PR/PR res: [0x2b6aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b53 expref: 1830 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.132756:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000021332347, rc 0) 00000100:00100000:1.0:1651529335.132770:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1830:41279:x1731746395047232:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 45us (66us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.132772:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210285 00000100:00100000:1.0:1651529335.133906:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.133913:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395047744 00000100:00100000:1.0:1651529335.133924:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210286 00000100:00100000:1.0:1651529335.133926:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1830:41279:x1731746395047744:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.133929:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.133932:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004cd7979/0x3234de053c4f22a lrc: 2/0,0 mode: --/PR res: [0x2b55f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7b6f expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.133937:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b55f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.133941:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.133941:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.133943:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004cd7979/0x3234de053c4f22a lrc: 3/0,0 mode: PR/PR res: [0x2b55f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b6f expref: 1831 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.133947:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000004cd7979/0x3234de053c4f22a lrc: 3/0,0 mode: PR/PR res: [0x2b55f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b6f expref: 1831 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.133953:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000004cd7979, rc 0) 00000100:00100000:1.0:1651529335.133966:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1831:41279:x1731746395047744:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 39us (60us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.133968:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210286 00000100:00100000:1.0:1651529335.134505:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.134512:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395048000 00000100:00100000:1.0:1651529335.134522:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210287 00000100:00100000:1.0:1651529335.134524:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1831:41279:x1731746395048000:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.134527:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.134531:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7827fc7/0x3234de053c4f231 lrc: 2/0,0 mode: --/PR res: [0x2ba85:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7b7d expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.134536:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2ba85:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.134539:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.134540:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.134541:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7827fc7/0x3234de053c4f231 lrc: 3/0,0 mode: PR/PR res: [0x2ba85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b7d expref: 1832 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.134545:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d7827fc7/0x3234de053c4f231 lrc: 3/0,0 mode: PR/PR res: [0x2ba85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b7d expref: 1832 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.134549:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d7827fc7, rc 0) 00000100:00100000:1.0:1651529335.134562:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1832:41279:x1731746395048000:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 37us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.134565:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210287 00000100:00100000:1.0:1651529335.135800:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.135807:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395048512 00000100:00100000:1.0:1651529335.135817:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210288 00000100:00100000:1.0:1651529335.135819:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1832:41279:x1731746395048512:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.135822:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.135826:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055c564af/0x3234de053c4f238 lrc: 2/0,0 mode: --/PR res: [0x2b5b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7b99 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.135831:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b5b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.135834:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.135835:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.135836:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055c564af/0x3234de053c4f238 lrc: 3/0,0 mode: PR/PR res: [0x2b5b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b99 expref: 1833 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.135841:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000055c564af/0x3234de053c4f238 lrc: 3/0,0 mode: PR/PR res: [0x2b5b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b99 expref: 1833 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.135845:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000055c564af, rc 0) 00000100:00100000:1.0:1651529335.135857:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1833:41279:x1731746395048512:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.135860:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210288 00000100:00100000:1.0:1651529335.136480:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.136487:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395048768 00000100:00100000:1.0:1651529335.136498:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210289 00000100:00100000:1.0:1651529335.136500:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1833:41279:x1731746395048768:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.136503:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.136507:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049d9a625/0x3234de053c4f23f lrc: 2/0,0 mode: --/PR res: [0x2b5e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7ba7 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.136512:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b5e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.136516:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.136517:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.136518:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049d9a625/0x3234de053c4f23f lrc: 3/0,0 mode: PR/PR res: [0x2b5e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ba7 expref: 1834 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.136522:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000049d9a625/0x3234de053c4f23f lrc: 3/0,0 mode: PR/PR res: [0x2b5e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ba7 expref: 1834 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.136526:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000049d9a625, rc 0) 00000100:00100000:1.0:1651529335.136539:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1834:41279:x1731746395048768:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (59us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.136541:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210289 00000100:00100000:1.0:1651529335.139036:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.139044:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395049792 00000100:00100000:1.0:1651529335.139057:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210290 00000100:00100000:1.0:1651529335.139058:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1834:41279:x1731746395049792:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.139062:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.139066:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000943c1249/0x3234de053c4f246 lrc: 2/0,0 mode: --/PR res: [0x2b977:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7bdf expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.139071:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b977:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.139075:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.139075:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.139077:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000943c1249/0x3234de053c4f246 lrc: 3/0,0 mode: PR/PR res: [0x2b977:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7bdf expref: 1835 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.139083:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000943c1249/0x3234de053c4f246 lrc: 3/0,0 mode: PR/PR res: [0x2b977:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7bdf expref: 1835 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.139087:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000943c1249, rc 0) 00000100:00100000:1.0:1651529335.139100:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1835:41279:x1731746395049792:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 41us (65us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.139103:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210290 00000100:00100000:1.0:1651529335.139625:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.139632:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395050048 00000100:00100000:1.0:1651529335.139643:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210291 00000100:00100000:1.0:1651529335.139645:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008c9304ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1835:41279:x1731746395050048:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.139648:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.139652:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3bc1618/0x3234de053c4f24d lrc: 2/0,0 mode: --/PR res: [0x2b695:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7bed expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.139657:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b695:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.139660:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.139661:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.139662:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3bc1618/0x3234de053c4f24d lrc: 3/0,0 mode: PR/PR res: [0x2b695:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7bed expref: 1836 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.139667:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c3bc1618/0x3234de053c4f24d lrc: 3/0,0 mode: PR/PR res: [0x2b695:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7bed expref: 1836 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.139670:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c3bc1618, rc 0) 00000100:00100000:1.0:1651529335.139684:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008c9304ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1836:41279:x1731746395050048:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (59us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.139686:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210291 00000100:00100000:1.0:1651529335.140865:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.140873:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395050560 00000100:00100000:1.0:1651529335.140884:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210292 00000100:00100000:1.0:1651529335.140885:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1836:41279:x1731746395050560:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.140889:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.140892:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c4f254 lrc: 2/0,0 mode: --/PR res: [0x2b352:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7c09 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.140897:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b352:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.140901:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.140901:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.140903:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c4f254 lrc: 3/0,0 mode: PR/PR res: [0x2b352:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c09 expref: 1837 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.140907:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c4f254 lrc: 3/0,0 mode: PR/PR res: [0x2b352:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c09 expref: 1837 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.140911:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000011345842, rc 0) 00000100:00100000:1.0:1651529335.140924:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1837:41279:x1731746395050560:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (59us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.140926:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210292 00000100:00100000:1.0:1651529335.141499:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.141506:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395050816 00000100:00100000:1.0:1651529335.141517:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210293 00000100:00100000:1.0:1651529335.141518:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1837:41278:x1731746395050816:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.141521:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.141525:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000705cc353/0x3234de053c4f25b lrc: 2/0,0 mode: --/PR res: [0x2b70c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7c17 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.141530:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b70c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.141533:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.141534:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.141535:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000705cc353/0x3234de053c4f25b lrc: 3/0,0 mode: PR/PR res: [0x2b70c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c17 expref: 1838 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.141539:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000705cc353/0x3234de053c4f25b lrc: 3/0,0 mode: PR/PR res: [0x2b70c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c17 expref: 1838 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.141543:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000705cc353, rc 0) 00000100:00100000:1.0:1651529335.141556:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1838:41278:x1731746395050816:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 37us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.141559:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210293 00000100:00100000:1.0:1651529335.143294:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.143300:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395051648 00000100:00100000:1.0:1651529335.143311:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210294 00000100:00100000:1.0:1651529335.143313:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1838:41279:x1731746395051648:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.143316:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.143320:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0c4b95b/0x3234de053c4f262 lrc: 2/0,0 mode: --/PR res: [0x2bb08:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7c48 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.143325:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb08:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.143328:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.143329:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.143330:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0c4b95b/0x3234de053c4f262 lrc: 3/0,0 mode: PR/PR res: [0x2bb08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c48 expref: 1839 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.143334:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c0c4b95b/0x3234de053c4f262 lrc: 3/0,0 mode: PR/PR res: [0x2bb08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c48 expref: 1839 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.143338:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c0c4b95b, rc 0) 00000100:00100000:1.0:1651529335.143351:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1839:41279:x1731746395051648:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.143354:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210294 00000100:00100000:1.0:1651529335.147026:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.147033:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395053120 00000100:00100000:1.0:1651529335.147044:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210295 00000100:00100000:1.0:1651529335.147046:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1839:41279:x1731746395053120:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.147049:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.147053:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000578d2cb4/0x3234de053c4f269 lrc: 2/0,0 mode: --/PR res: [0x2b499:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7c95 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.147058:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b499:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.147061:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.147062:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.147063:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000578d2cb4/0x3234de053c4f269 lrc: 3/0,0 mode: PR/PR res: [0x2b499:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c95 expref: 1840 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.147067:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000578d2cb4/0x3234de053c4f269 lrc: 3/0,0 mode: PR/PR res: [0x2b499:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c95 expref: 1840 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.147073:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000578d2cb4, rc 0) 00000100:00100000:1.0:1651529335.147086:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1840:41279:x1731746395053120:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 40us (60us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.147089:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210295 00000100:00100000:1.0:1651529335.150657:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.150664:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395054656 00000100:00100000:1.0:1651529335.150675:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210296 00000100:00100000:1.0:1651529335.150676:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1840:41279:x1731746395054656:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.150680:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.150683:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7d5d09f/0x3234de053c4f270 lrc: 2/0,0 mode: --/PR res: [0x2b480:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7ce9 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.150688:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b480:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.150692:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.150692:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.150694:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7d5d09f/0x3234de053c4f270 lrc: 3/0,0 mode: PR/PR res: [0x2b480:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ce9 expref: 1841 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.150698:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c7d5d09f/0x3234de053c4f270 lrc: 3/0,0 mode: PR/PR res: [0x2b480:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ce9 expref: 1841 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.150702:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c7d5d09f, rc 0) 00000100:00100000:1.0:1651529335.150715:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1841:41279:x1731746395054656:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 37us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.150717:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210296 00000100:00100000:1.0:1651529335.151877:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.151885:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395055168 00000100:00100000:1.0:1651529335.151896:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210297 00000100:00100000:1.0:1651529335.151897:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1841:41279:x1731746395055168:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.151900:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.151904:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e71292e1/0x3234de053c4f277 lrc: 2/0,0 mode: --/PR res: [0x2ba70:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7d05 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.151909:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2ba70:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.151913:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.151913:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.151915:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e71292e1/0x3234de053c4f277 lrc: 3/0,0 mode: PR/PR res: [0x2ba70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d05 expref: 1842 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.151919:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e71292e1/0x3234de053c4f277 lrc: 3/0,0 mode: PR/PR res: [0x2ba70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d05 expref: 1842 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.151923:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e71292e1, rc 0) 00000100:00100000:1.0:1651529335.151935:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1842:41279:x1731746395055168:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 37us (59us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.151938:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210297 00000100:00100000:1.0:1651529335.152517:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.152524:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395055424 00000100:00100000:1.0:1651529335.152534:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210298 00000100:00100000:1.0:1651529335.152536:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1842:41278:x1731746395055424:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.152539:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.152544:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c83c6fc1/0x3234de053c4f27e lrc: 2/0,0 mode: --/PR res: [0x2b60d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7d13 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.152549:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b60d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.152552:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.152553:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.152554:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c83c6fc1/0x3234de053c4f27e lrc: 3/0,0 mode: PR/PR res: [0x2b60d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d13 expref: 1843 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.152558:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c83c6fc1/0x3234de053c4f27e lrc: 3/0,0 mode: PR/PR res: [0x2b60d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d13 expref: 1843 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.152562:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c83c6fc1, rc 0) 00000100:00100000:1.0:1651529335.152575:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1843:41278:x1731746395055424:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (59us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.152578:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210298 00000100:00100000:1.0:1651529335.153113:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.153120:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395055680 00000100:00100000:1.0:1651529335.153131:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210299 00000100:00100000:1.0:1651529335.153133:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1843:41279:x1731746395055680:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.153136:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.153140:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002099d3d5/0x3234de053c4f285 lrc: 2/0,0 mode: --/PR res: [0x2b7da:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7d21 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.153145:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b7da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.153148:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.153149:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.153151:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002099d3d5/0x3234de053c4f285 lrc: 3/0,0 mode: PR/PR res: [0x2b7da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d21 expref: 1844 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.153157:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002099d3d5/0x3234de053c4f285 lrc: 3/0,0 mode: PR/PR res: [0x2b7da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d21 expref: 1844 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.153161:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002099d3d5, rc 0) 00000100:00100000:1.0:1651529335.153173:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1844:41279:x1731746395055680:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 40us (60us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.153176:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210299 00000100:00100000:1.0:1651529335.153737:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.153745:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395055936 00000100:00100000:1.0:1651529335.153756:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210300 00000100:00100000:1.0:1651529335.153758:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1844:41278:x1731746395055936:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.153761:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.153765:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c4f28c lrc: 2/0,0 mode: --/PR res: [0x2b3fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7d2f expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.153770:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b3fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.153773:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.153774:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.153775:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c4f28c lrc: 3/0,0 mode: PR/PR res: [0x2b3fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d2f expref: 1845 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.153780:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c4f28c lrc: 3/0,0 mode: PR/PR res: [0x2b3fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d2f expref: 1845 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.153783:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000677ce99b, rc 0) 00000100:00100000:1.0:1651529335.153796:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1845:41278:x1731746395055936:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (66us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.153799:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210300 00000100:00100000:1.0:1651529335.154987:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.154994:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395056448 00000100:00100000:1.0:1651529335.155005:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210301 00000100:00100000:1.0:1651529335.155007:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1845:41278:x1731746395056448:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.155010:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.155014:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1db1946/0x3234de053c4f293 lrc: 2/0,0 mode: --/PR res: [0x2b86a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7d4b expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.155018:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b86a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.155022:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.155023:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.155024:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1db1946/0x3234de053c4f293 lrc: 3/0,0 mode: PR/PR res: [0x2b86a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d4b expref: 1846 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.155028:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a1db1946/0x3234de053c4f293 lrc: 3/0,0 mode: PR/PR res: [0x2b86a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d4b expref: 1846 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.155032:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a1db1946, rc 0) 00000100:00100000:1.0:1651529335.155045:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1846:41278:x1731746395056448:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 37us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.155047:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210301 00000100:00100000:1.0:1651529335.155576:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.155583:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395056704 00000100:00100000:1.0:1651529335.155594:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210302 00000100:00100000:1.0:1651529335.155596:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1846:41279:x1731746395056704:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.155599:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.155602:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092b1d4a6/0x3234de053c4f29a lrc: 2/0,0 mode: --/PR res: [0x2badc:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7d59 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.155607:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2badc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.155611:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.155611:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.155613:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092b1d4a6/0x3234de053c4f29a lrc: 3/0,0 mode: PR/PR res: [0x2badc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d59 expref: 1847 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.155617:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000092b1d4a6/0x3234de053c4f29a lrc: 3/0,0 mode: PR/PR res: [0x2badc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d59 expref: 1847 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.155621:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000092b1d4a6, rc 0) 00000100:00100000:1.0:1651529335.155634:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1847:41279:x1731746395056704:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 37us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.155636:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210302 00000100:00100000:1.0:1651529335.156178:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.156185:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395056960 00000100:00100000:1.0:1651529335.156196:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210303 00000100:00100000:1.0:1651529335.156198:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1847:41278:x1731746395056960:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.156201:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.156205:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c4f2a1 lrc: 2/0,0 mode: --/PR res: [0x2b3ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7d67 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.156210:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b3ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.156213:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.156214:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.156215:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c4f2a1 lrc: 3/0,0 mode: PR/PR res: [0x2b3ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d67 expref: 1848 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.156220:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c4f2a1 lrc: 3/0,0 mode: PR/PR res: [0x2b3ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d67 expref: 1848 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.156237:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e02d2a50, rc 0) 00000100:00100000:1.0:1651529335.156251:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1848:41278:x1731746395056960:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 52us (73us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.156254:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210303 00000100:00100000:1.0:1651529335.157458:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.157465:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395057472 00000100:00100000:1.0:1651529335.157476:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210304 00000100:00100000:1.0:1651529335.157477:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfc79d4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1848:41278:x1731746395057472:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.157481:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.157484:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c4f2a8 lrc: 2/0,0 mode: --/PR res: [0x2b3a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7d83 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.157489:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b3a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.157493:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.157493:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.157495:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c4f2a8 lrc: 3/0,0 mode: PR/PR res: [0x2b3a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d83 expref: 1849 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.157499:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c4f2a8 lrc: 3/0,0 mode: PR/PR res: [0x2b3a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d83 expref: 1849 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.157505:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000096a880d5, rc 0) 00000100:00100000:1.0:1651529335.157517:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfc79d4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1849:41278:x1731746395057472:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 39us (60us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.157520:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210304 00000100:00100000:1.0:1651529335.158667:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.158674:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395057984 00000100:00100000:1.0:1651529335.158685:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210305 00000100:00100000:1.0:1651529335.158687:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005914c920 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1849:41278:x1731746395057984:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.158690:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.158693:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004df6544e/0x3234de053c4f2af lrc: 2/0,0 mode: --/PR res: [0x2bb03:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7d9f expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.158698:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb03:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.158701:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.158702:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.158704:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004df6544e/0x3234de053c4f2af lrc: 3/0,0 mode: PR/PR res: [0x2bb03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d9f expref: 1850 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.158708:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004df6544e/0x3234de053c4f2af lrc: 3/0,0 mode: PR/PR res: [0x2bb03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d9f expref: 1850 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.158711:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004df6544e, rc 0) 00000100:00100000:1.0:1651529335.158724:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005914c920 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1850:41278:x1731746395057984:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 37us (57us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.158727:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210305 00000100:00100000:1.0:1651529335.159262:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.159269:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395058240 00000100:00100000:1.0:1651529335.159280:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210306 00000100:00100000:1.0:1651529335.159282:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007fca8239 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1850:41279:x1731746395058240:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.159285:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.159293:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000441232d4/0x3234de053c4f2b6 lrc: 2/0,0 mode: --/PR res: [0x2ba22:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7dad expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.159298:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2ba22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.159301:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.159302:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.159304:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000441232d4/0x3234de053c4f2b6 lrc: 3/0,0 mode: PR/PR res: [0x2ba22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7dad expref: 1851 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.159308:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000441232d4/0x3234de053c4f2b6 lrc: 3/0,0 mode: PR/PR res: [0x2ba22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7dad expref: 1851 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.159311:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000441232d4, rc 0) 00000100:00100000:1.0:1651529335.159325:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007fca8239 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1851:41279:x1731746395058240:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 42us (63us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.159328:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210306 00000100:00100000:1.0:1651529335.161722:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.161736:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395059264 00000100:00100000:1.0:1651529335.161747:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210307 00000100:00100000:1.0:1651529335.161749:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ea32140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1851:41279:x1731746395059264:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.161752:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.161756:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052ea5946/0x3234de053c4f2bd lrc: 2/0,0 mode: --/PR res: [0x2b778:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7de5 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.161761:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b778:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.161764:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.161765:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.161766:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052ea5946/0x3234de053c4f2bd lrc: 3/0,0 mode: PR/PR res: [0x2b778:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7de5 expref: 1852 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.161770:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000052ea5946/0x3234de053c4f2bd lrc: 3/0,0 mode: PR/PR res: [0x2b778:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7de5 expref: 1852 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.161774:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000052ea5946, rc 0) 00000100:00100000:1.0:1651529335.161787:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ea32140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1852:41279:x1731746395059264:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 37us (66us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.161790:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210307 00000100:00100000:1.0:1651529335.162322:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.162329:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395059520 00000100:00100000:1.0:1651529335.162340:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210308 00000100:00100000:1.0:1651529335.162342:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1852:41278:x1731746395059520:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.162345:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.162349:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000165272de/0x3234de053c4f2c4 lrc: 2/0,0 mode: --/PR res: [0x2b81e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7df3 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.162354:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b81e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.162357:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.162358:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.162359:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000165272de/0x3234de053c4f2c4 lrc: 3/0,0 mode: PR/PR res: [0x2b81e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7df3 expref: 1853 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.162366:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000165272de/0x3234de053c4f2c4 lrc: 3/0,0 mode: PR/PR res: [0x2b81e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7df3 expref: 1853 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.162369:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000165272de, rc 0) 00000100:00100000:1.0:1651529335.162382:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1853:41278:x1731746395059520:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 40us (61us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.162385:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210308 00000100:00100000:1.0:1651529335.162928:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.162935:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395059776 00000100:00100000:1.0:1651529335.162946:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210309 00000100:00100000:1.0:1651529335.162948:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1853:41279:x1731746395059776:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.162951:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.162955:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc418822/0x3234de053c4f2cb lrc: 2/0,0 mode: --/PR res: [0x2b8b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7e01 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.162960:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b8b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.162963:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.162964:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.162965:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc418822/0x3234de053c4f2cb lrc: 3/0,0 mode: PR/PR res: [0x2b8b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e01 expref: 1854 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.162969:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cc418822/0x3234de053c4f2cb lrc: 3/0,0 mode: PR/PR res: [0x2b8b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e01 expref: 1854 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.162973:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000cc418822, rc 0) 00000100:00100000:1.0:1651529335.162986:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1854:41279:x1731746395059776:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.162989:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210309 00000100:00100000:1.0:1651529335.164196:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.164203:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395060288 00000100:00100000:1.0:1651529335.164215:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210310 00000100:00100000:1.0:1651529335.164216:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1854:41279:x1731746395060288:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.164219:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.164233:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f87a625c/0x3234de053c4f2d2 lrc: 2/0,0 mode: --/PR res: [0x2b5a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7e1d expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.164238:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b5a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.164242:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.164243:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.164244:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f87a625c/0x3234de053c4f2d2 lrc: 3/0,0 mode: PR/PR res: [0x2b5a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e1d expref: 1855 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.164249:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f87a625c/0x3234de053c4f2d2 lrc: 3/0,0 mode: PR/PR res: [0x2b5a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e1d expref: 1855 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.164252:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f87a625c, rc 0) 00000100:00100000:1.0:1651529335.164265:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1855:41279:x1731746395060288:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 48us (69us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.164268:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210310 00000100:00100000:1.0:1651529335.164791:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.164798:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395060544 00000100:00100000:1.0:1651529335.164809:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210311 00000100:00100000:1.0:1651529335.164811:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1855:41278:x1731746395060544:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.164814:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.164817:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c0d3581/0x3234de053c4f2d9 lrc: 2/0,0 mode: --/PR res: [0x2ba4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7e2b expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.164822:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2ba4a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.164826:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.164826:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.164828:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c0d3581/0x3234de053c4f2d9 lrc: 3/0,0 mode: PR/PR res: [0x2ba4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e2b expref: 1856 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.164832:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006c0d3581/0x3234de053c4f2d9 lrc: 3/0,0 mode: PR/PR res: [0x2ba4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e2b expref: 1856 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.164836:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006c0d3581, rc 0) 00000100:00100000:1.0:1651529335.164849:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1856:41278:x1731746395060544:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 37us (59us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.164852:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210311 00000100:00100000:1.0:1651529335.167257:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.167264:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395061568 00000100:00100000:1.0:1651529335.167275:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210312 00000100:00100000:1.0:1651529335.167276:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1856:41278:x1731746395061568:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.167280:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.167283:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003324f656/0x3234de053c4f2e0 lrc: 2/0,0 mode: --/PR res: [0x2b8d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7e63 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.167289:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b8d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.167292:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.167293:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.167294:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003324f656/0x3234de053c4f2e0 lrc: 3/0,0 mode: PR/PR res: [0x2b8d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e63 expref: 1857 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.167298:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003324f656/0x3234de053c4f2e0 lrc: 3/0,0 mode: PR/PR res: [0x2b8d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e63 expref: 1857 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.167302:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003324f656, rc 0) 00000100:00100000:1.0:1651529335.167315:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1857:41278:x1731746395061568:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (59us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.167318:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210312 00000100:00100000:1.0:1651529335.167888:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.167895:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395061824 00000100:00100000:1.0:1651529335.167906:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210313 00000100:00100000:1.0:1651529335.167908:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1857:41279:x1731746395061824:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.167911:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.167918:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002537ce87/0x3234de053c4f2e7 lrc: 2/0,0 mode: --/PR res: [0x2b396:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7e71 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.167923:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b396:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.167926:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.167927:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.167929:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002537ce87/0x3234de053c4f2e7 lrc: 3/0,0 mode: PR/PR res: [0x2b396:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e71 expref: 1858 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.167933:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002537ce87/0x3234de053c4f2e7 lrc: 3/0,0 mode: PR/PR res: [0x2b396:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e71 expref: 1858 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.167939:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002537ce87, rc 0) 00000100:00100000:1.0:1651529335.167952:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1858:41279:x1731746395061824:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 44us (64us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.167955:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210313 00000100:00100000:1.0:1651529335.168520:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.168527:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395062080 00000100:00100000:1.0:1651529335.168538:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210314 00000100:00100000:1.0:1651529335.168540:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1858:41278:x1731746395062080:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.168543:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.168547:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000915ac1d0/0x3234de053c4f2ee lrc: 2/0,0 mode: --/PR res: [0x2b3b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7e7f expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.168552:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b3b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.168555:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.168556:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.168558:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000915ac1d0/0x3234de053c4f2ee lrc: 3/0,0 mode: PR/PR res: [0x2b3b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e7f expref: 1859 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.168562:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000915ac1d0/0x3234de053c4f2ee lrc: 3/0,0 mode: PR/PR res: [0x2b3b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e7f expref: 1859 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.168565:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000915ac1d0, rc 0) 00000100:00100000:1.0:1651529335.168578:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1859:41278:x1731746395062080:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 37us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.168581:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210314 00000100:00100000:1.0:1651529335.169118:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.169125:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395062336 00000100:00100000:1.0:1651529335.169136:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210315 00000100:00100000:1.0:1651529335.169138:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1859:41279:x1731746395062336:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.169141:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.169145:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7cb3d9d/0x3234de053c4f2f5 lrc: 2/0,0 mode: --/PR res: [0x2b96b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7e8d expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.169149:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b96b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.169153:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.169153:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.169155:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7cb3d9d/0x3234de053c4f2f5 lrc: 3/0,0 mode: PR/PR res: [0x2b96b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e8d expref: 1860 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.169159:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f7cb3d9d/0x3234de053c4f2f5 lrc: 3/0,0 mode: PR/PR res: [0x2b96b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e8d expref: 1860 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.169163:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f7cb3d9d, rc 0) 00000100:00100000:1.0:1651529335.169176:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1860:41279:x1731746395062336:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 37us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.169179:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210315 00000100:00100000:1.0:1651529335.169718:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.169725:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395062592 00000100:00100000:1.0:1651529335.169743:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210316 00000100:00100000:1.0:1651529335.169744:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1860:41278:x1731746395062592:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.169748:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.169751:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fd513db/0x3234de053c4f2fc lrc: 2/0,0 mode: --/PR res: [0x2b565:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7e9b expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.169756:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b565:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.169760:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.169760:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.169762:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fd513db/0x3234de053c4f2fc lrc: 3/0,0 mode: PR/PR res: [0x2b565:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e9b expref: 1861 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.169766:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003fd513db/0x3234de053c4f2fc lrc: 3/0,0 mode: PR/PR res: [0x2b565:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e9b expref: 1861 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.169770:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003fd513db, rc 0) 00000100:00100000:1.0:1651529335.169783:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1861:41278:x1731746395062592:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (65us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.169786:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210316 00000100:00100000:1.0:1651529335.171566:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.171573:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395063360 00000100:00100000:1.0:1651529335.171584:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210317 00000100:00100000:1.0:1651529335.171586:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1861:41279:x1731746395063360:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.171589:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.171592:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000776a84f4/0x3234de053c4f303 lrc: 2/0,0 mode: --/PR res: [0x2b73b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7ec5 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.171597:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b73b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.171601:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.171601:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.171603:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000776a84f4/0x3234de053c4f303 lrc: 3/0,0 mode: PR/PR res: [0x2b73b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ec5 expref: 1862 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.171609:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000776a84f4/0x3234de053c4f303 lrc: 3/0,0 mode: PR/PR res: [0x2b73b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ec5 expref: 1862 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.171613:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000776a84f4, rc 0) 00000100:00100000:1.0:1651529335.171626:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1862:41279:x1731746395063360:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 39us (60us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.171628:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210317 00000100:00100000:1.0:1651529335.172163:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.172170:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395063616 00000100:00100000:1.0:1651529335.172181:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210318 00000100:00100000:1.0:1651529335.172183:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1862:41278:x1731746395063616:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.172186:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.172190:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4f30a lrc: 2/0,0 mode: --/PR res: [0x2b6d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7ed3 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.172195:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b6d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.172198:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.172199:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.172200:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4f30a lrc: 3/0,0 mode: PR/PR res: [0x2b6d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ed3 expref: 1863 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.172204:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4f30a lrc: 3/0,0 mode: PR/PR res: [0x2b6d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ed3 expref: 1863 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.172208:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000016ff53ef, rc 0) 00000100:00100000:1.0:1651529335.172232:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1863:41278:x1731746395063616:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (59us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.172235:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210318 00000100:00100000:1.0:1651529335.172773:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.172780:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395063872 00000100:00100000:1.0:1651529335.172792:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210319 00000100:00100000:1.0:1651529335.172793:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1863:41279:x1731746395063872:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.172796:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.172800:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6649eef/0x3234de053c4f311 lrc: 2/0,0 mode: --/PR res: [0x2b9f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7ee1 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.172805:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b9f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.172808:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.172809:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.172810:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6649eef/0x3234de053c4f311 lrc: 3/0,0 mode: PR/PR res: [0x2b9f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ee1 expref: 1864 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.172815:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c6649eef/0x3234de053c4f311 lrc: 3/0,0 mode: PR/PR res: [0x2b9f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ee1 expref: 1864 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.172819:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c6649eef, rc 0) 00000100:00100000:1.0:1651529335.172831:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1864:41279:x1731746395063872:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 37us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.172834:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210319 00000100:00100000:1.0:1651529335.173401:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.173408:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395064128 00000100:00100000:1.0:1651529335.173419:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210320 00000100:00100000:1.0:1651529335.173421:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1864:41278:x1731746395064128:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.173424:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.173427:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c03f4dd/0x3234de053c4f318 lrc: 2/0,0 mode: --/PR res: [0x2b4d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7eef expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.173433:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b4d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.173436:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.173437:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.173438:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c03f4dd/0x3234de053c4f318 lrc: 3/0,0 mode: PR/PR res: [0x2b4d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7eef expref: 1865 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.173442:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002c03f4dd/0x3234de053c4f318 lrc: 3/0,0 mode: PR/PR res: [0x2b4d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7eef expref: 1865 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.173446:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002c03f4dd, rc 0) 00000100:00100000:1.0:1651529335.173459:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1865:41278:x1731746395064128:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (59us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.173462:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210320 00000100:00100000:1.0:1651529335.174032:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.174040:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395064384 00000100:00100000:1.0:1651529335.174051:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210321 00000100:00100000:1.0:1651529335.174052:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1865:41279:x1731746395064384:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.174056:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.174059:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000656a2f5f/0x3234de053c4f31f lrc: 2/0,0 mode: --/PR res: [0x2bb0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7efd expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.174064:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb0a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.174068:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.174068:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.174070:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000656a2f5f/0x3234de053c4f31f lrc: 3/0,0 mode: PR/PR res: [0x2bb0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7efd expref: 1866 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.174074:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000656a2f5f/0x3234de053c4f31f lrc: 3/0,0 mode: PR/PR res: [0x2bb0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7efd expref: 1866 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.174078:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000656a2f5f, rc 0) 00000100:00100000:1.0:1651529335.174091:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1866:41279:x1731746395064384:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 37us (59us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.174093:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210321 00000100:00100000:1.0:1651529335.174622:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.174629:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395064640 00000100:00100000:1.0:1651529335.174640:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210322 00000100:00100000:1.0:1651529335.174642:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1866:41278:x1731746395064640:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.174645:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.174649:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b6e58d6/0x3234de053c4f326 lrc: 2/0,0 mode: --/PR res: [0x2b520:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7f0b expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.174654:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b520:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.174657:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.174658:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.174660:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b6e58d6/0x3234de053c4f326 lrc: 3/0,0 mode: PR/PR res: [0x2b520:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f0b expref: 1867 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.174664:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004b6e58d6/0x3234de053c4f326 lrc: 3/0,0 mode: PR/PR res: [0x2b520:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f0b expref: 1867 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.174670:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004b6e58d6, rc 0) 00000100:00100000:1.0:1651529335.174682:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1867:41278:x1731746395064640:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 40us (61us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.174685:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210322 00000100:00100000:1.0:1651529335.175838:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.175846:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395065152 00000100:00100000:1.0:1651529335.175857:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210323 00000100:00100000:1.0:1651529335.175858:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1867:41278:x1731746395065152:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.175862:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.175865:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4f32d lrc: 2/0,0 mode: --/PR res: [0x2b486:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7f27 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.175870:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b486:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.175874:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.175874:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.175876:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4f32d lrc: 3/0,0 mode: PR/PR res: [0x2b486:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f27 expref: 1868 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.175880:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4f32d lrc: 3/0,0 mode: PR/PR res: [0x2b486:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f27 expref: 1868 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.175884:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000cd6e2551, rc 0) 00000100:00100000:1.0:1651529335.175896:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1868:41278:x1731746395065152:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 37us (59us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.175899:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210323 00000100:00100000:1.0:1651529335.177077:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.177084:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395065664 00000100:00100000:1.0:1651529335.177095:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210324 00000100:00100000:1.0:1651529335.177097:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1868:41278:x1731746395065664:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.177100:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.177104:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b26b71e3/0x3234de053c4f334 lrc: 2/0,0 mode: --/PR res: [0x2b739:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7f43 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.177109:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b739:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.177112:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.177112:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.177114:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b26b71e3/0x3234de053c4f334 lrc: 3/0,0 mode: PR/PR res: [0x2b739:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f43 expref: 1869 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.177118:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b26b71e3/0x3234de053c4f334 lrc: 3/0,0 mode: PR/PR res: [0x2b739:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f43 expref: 1869 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.177122:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b26b71e3, rc 0) 00000100:00100000:1.0:1651529335.177135:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1869:41278:x1731746395065664:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 37us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.177137:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210324 00000100:00100000:1.0:1651529335.179533:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.179540:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395066688 00000100:00100000:1.0:1651529335.179551:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210325 00000100:00100000:1.0:1651529335.179553:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1869:41278:x1731746395066688:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.179556:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.179559:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4f33b lrc: 2/0,0 mode: --/PR res: [0x2b8d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7f7b expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.179565:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b8d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.179568:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.179569:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.179570:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4f33b lrc: 3/0,0 mode: PR/PR res: [0x2b8d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f7b expref: 1870 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.179574:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4f33b lrc: 3/0,0 mode: PR/PR res: [0x2b8d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f7b expref: 1870 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.179578:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000828505cd, rc 0) 00000100:00100000:1.0:1651529335.179591:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1870:41278:x1731746395066688:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 37us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.179593:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210325 00000100:00100000:1.0:1651529335.183172:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.183179:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395068224 00000100:00100000:1.0:1651529335.183190:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210326 00000100:00100000:1.0:1651529335.183191:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1870:41278:x1731746395068224:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.183195:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.183198:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a25596b/0x3234de053c4f342 lrc: 2/0,0 mode: --/PR res: [0x2b633:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7fcf expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.183203:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b633:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.183207:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.183207:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.183209:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a25596b/0x3234de053c4f342 lrc: 3/0,0 mode: PR/PR res: [0x2b633:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7fcf expref: 1871 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.183215:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007a25596b/0x3234de053c4f342 lrc: 3/0,0 mode: PR/PR res: [0x2b633:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7fcf expref: 1871 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.183219:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007a25596b, rc 0) 00000100:00100000:1.0:1651529335.183243:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1871:41278:x1731746395068224:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 50us (71us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.183245:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210326 00000100:00100000:1.0:1651529335.184441:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.184448:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395068736 00000100:00100000:1.0:1651529335.184459:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210327 00000100:00100000:1.0:1651529335.184461:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1871:41278:x1731746395068736:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.184464:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.184468:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4f349 lrc: 2/0,0 mode: --/PR res: [0x2b899:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7feb expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.184473:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b899:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.184476:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.184476:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.184478:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4f349 lrc: 3/0,0 mode: PR/PR res: [0x2b899:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7feb expref: 1872 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.184482:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4f349 lrc: 3/0,0 mode: PR/PR res: [0x2b899:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7feb expref: 1872 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.184486:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054a30dd8, rc 0) 00000100:00100000:1.0:1651529335.184499:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1872:41278:x1731746395068736:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 37us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.184502:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210327 00000100:00100000:1.0:1651529335.185044:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.185051:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395068992 00000100:00100000:1.0:1651529335.185061:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210328 00000100:00100000:1.0:1651529335.185063:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1872:41279:x1731746395068992:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.185066:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.185070:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4f350 lrc: 2/0,0 mode: --/PR res: [0x2b592:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d7ff9 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.185075:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b592:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.185078:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.185079:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.185081:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4f350 lrc: 3/0,0 mode: PR/PR res: [0x2b592:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ff9 expref: 1873 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.185085:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4f350 lrc: 3/0,0 mode: PR/PR res: [0x2b592:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ff9 expref: 1873 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.185089:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000041e6f70f, rc 0) 00000100:00100000:1.0:1651529335.185101:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1873:41279:x1731746395068992:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 37us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.185104:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210328 00000100:00100000:1.0:1651529335.186245:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.186252:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395069504 00000100:00100000:1.0:1651529335.186262:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210329 00000100:00100000:1.0:1651529335.186264:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1873:41279:x1731746395069504:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.186267:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.186271:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c4f357 lrc: 2/0,0 mode: --/PR res: [0x2b5f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8015 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.186276:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b5f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.186279:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.186280:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.186281:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c4f357 lrc: 3/0,0 mode: PR/PR res: [0x2b5f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8015 expref: 1874 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.186286:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c4f357 lrc: 3/0,0 mode: PR/PR res: [0x2b5f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8015 expref: 1874 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.186289:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a706026, rc 0) 00000100:00100000:1.0:1651529335.186302:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1874:41279:x1731746395069504:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 37us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.186305:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210329 00000100:00100000:1.0:1651529335.186846:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.186853:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395069760 00000100:00100000:1.0:1651529335.186864:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210330 00000100:00100000:1.0:1651529335.186866:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1874:41278:x1731746395069760:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.186869:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.186873:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c4f35e lrc: 2/0,0 mode: --/PR res: [0x2b41a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8023 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.186878:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b41a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.186881:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.186882:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.186884:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c4f35e lrc: 3/0,0 mode: PR/PR res: [0x2b41a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8023 expref: 1875 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.186888:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c4f35e lrc: 3/0,0 mode: PR/PR res: [0x2b41a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8023 expref: 1875 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.186892:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e696ff9d, rc 0) 00000100:00100000:1.0:1651529335.186904:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1875:41278:x1731746395069760:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (59us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.186907:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210330 00000100:00100000:1.0:1651529335.188634:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.188641:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395070592 00000100:00100000:1.0:1651529335.188653:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210331 00000100:00100000:1.0:1651529335.188654:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1875:41279:x1731746395070592:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.188657:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.188661:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092b30684/0x3234de053c4f365 lrc: 2/0,0 mode: --/PR res: [0x2ba23:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8054 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.188666:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2ba23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.188669:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.188670:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.188671:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092b30684/0x3234de053c4f365 lrc: 3/0,0 mode: PR/PR res: [0x2ba23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8054 expref: 1876 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.188675:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000092b30684/0x3234de053c4f365 lrc: 3/0,0 mode: PR/PR res: [0x2ba23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8054 expref: 1876 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.188681:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000092b30684, rc 0) 00000100:00100000:1.0:1651529335.188694:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1876:41279:x1731746395070592:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 39us (61us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.188697:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210331 00000100:00100000:1.0:1651529335.189154:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.189161:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395070848 00000100:00100000:1.0:1651529335.189172:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210332 00000100:00100000:1.0:1651529335.189174:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1876:41278:x1731746395070848:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.189177:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.189180:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c4f36c lrc: 2/0,0 mode: --/PR res: [0x2b3e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8062 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.189186:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b3e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.189189:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.189189:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.189191:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c4f36c lrc: 3/0,0 mode: PR/PR res: [0x2b3e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8062 expref: 1877 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.189195:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c4f36c lrc: 3/0,0 mode: PR/PR res: [0x2b3e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8062 expref: 1877 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.189199:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c9570753, rc 0) 00000100:00100000:1.0:1651529335.189212:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1877:41278:x1731746395070848:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 37us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.189214:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210332 00000100:00100000:1.0:1651529335.190339:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.190346:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395071296 00000100:00100000:1.0:1651529335.190357:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210333 00000100:00100000:1.0:1651529335.190359:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1877:41278:x1731746395071296:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.190362:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.190365:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9cecf0c/0x3234de053c4f373 lrc: 2/0,0 mode: --/PR res: [0x2ba96:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8077 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.190370:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2ba96:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.190373:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.190374:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.190376:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9cecf0c/0x3234de053c4f373 lrc: 3/0,0 mode: PR/PR res: [0x2ba96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8077 expref: 1878 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.190380:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e9cecf0c/0x3234de053c4f373 lrc: 3/0,0 mode: PR/PR res: [0x2ba96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8077 expref: 1878 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.190384:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e9cecf0c, rc 0) 00000100:00100000:1.0:1651529335.190396:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1878:41278:x1731746395071296:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 37us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.190399:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210333 00000100:00100000:1.0:1651529335.192601:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.192608:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395072384 00000100:00100000:1.0:1651529335.192619:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210334 00000100:00100000:1.0:1651529335.192621:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1878:41278:x1731746395072384:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.192624:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.192631:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c4f37a lrc: 2/0,0 mode: --/PR res: [0x2b5ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d80b6 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.192636:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b5ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.192640:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.192640:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.192642:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c4f37a lrc: 3/0,0 mode: PR/PR res: [0x2b5ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80b6 expref: 1879 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.192646:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c4f37a lrc: 3/0,0 mode: PR/PR res: [0x2b5ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80b6 expref: 1879 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.192650:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d1b07eb5, rc 0) 00000100:00100000:1.0:1651529335.192663:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1879:41278:x1731746395072384:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 41us (62us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.192665:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210334 00000100:00100000:1.0:1651529335.193211:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.193219:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395072640 00000100:00100000:1.0:1651529335.193239:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210335 00000100:00100000:1.0:1651529335.193241:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1879:41279:x1731746395072640:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.193244:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.193248:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f005b0e/0x3234de053c4f381 lrc: 2/0,0 mode: --/PR res: [0x2ba03:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d80c4 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.193253:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2ba03:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.193256:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.193257:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.193258:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f005b0e/0x3234de053c4f381 lrc: 3/0,0 mode: PR/PR res: [0x2ba03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80c4 expref: 1880 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.193265:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001f005b0e/0x3234de053c4f381 lrc: 3/0,0 mode: PR/PR res: [0x2ba03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80c4 expref: 1880 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.193269:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001f005b0e, rc 0) 00000100:00100000:1.0:1651529335.193282:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1880:41279:x1731746395072640:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 40us (70us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.193284:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210335 00000100:00100000:1.0:1651529335.193753:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.193760:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395072896 00000100:00100000:1.0:1651529335.193771:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210336 00000100:00100000:1.0:1651529335.193773:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1880:41278:x1731746395072896:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.193776:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.193780:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad242558/0x3234de053c4f388 lrc: 2/0,0 mode: --/PR res: [0x2b786:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d80d2 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.193785:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b786:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.193788:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.193789:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.193790:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad242558/0x3234de053c4f388 lrc: 3/0,0 mode: PR/PR res: [0x2b786:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80d2 expref: 1881 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.193795:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ad242558/0x3234de053c4f388 lrc: 3/0,0 mode: PR/PR res: [0x2b786:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80d2 expref: 1881 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.193798:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ad242558, rc 0) 00000100:00100000:1.0:1651529335.193812:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1881:41278:x1731746395072896:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (59us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.193814:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210336 00000100:00100000:1.0:1651529335.194371:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.194378:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395073088 00000100:00100000:1.0:1651529335.194389:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210337 00000100:00100000:1.0:1651529335.194390:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1881:41279:x1731746395073088:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.194393:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.194397:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f88ef7eb/0x3234de053c4f38f lrc: 2/0,0 mode: --/PR res: [0x2b8fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d80d9 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.194402:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b8fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.194405:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.194406:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.194407:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f88ef7eb/0x3234de053c4f38f lrc: 3/0,0 mode: PR/PR res: [0x2b8fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80d9 expref: 1882 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.194412:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f88ef7eb/0x3234de053c4f38f lrc: 3/0,0 mode: PR/PR res: [0x2b8fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80d9 expref: 1882 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.194415:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f88ef7eb, rc 0) 00000100:00100000:1.0:1651529335.194428:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1882:41279:x1731746395073088:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 37us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.194431:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210337 00000100:00100000:1.0:1651529335.195557:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.195563:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395073664 00000100:00100000:1.0:1651529335.195574:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210338 00000100:00100000:1.0:1651529335.195576:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089bf9ab9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1882:41279:x1731746395073664:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.195579:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.195587:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d33d4a29/0x3234de053c4f396 lrc: 2/0,0 mode: --/PR res: [0x2b969:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d80fc expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.195592:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b969:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.195596:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.195597:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.195598:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d33d4a29/0x3234de053c4f396 lrc: 3/0,0 mode: PR/PR res: [0x2b969:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80fc expref: 1883 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.195603:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d33d4a29/0x3234de053c4f396 lrc: 3/0,0 mode: PR/PR res: [0x2b969:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80fc expref: 1883 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.195606:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d33d4a29, rc 0) 00000100:00100000:1.0:1651529335.195620:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089bf9ab9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1883:41279:x1731746395073664:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 43us (63us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.195622:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210338 00000100:00100000:1.0:1651529335.197258:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.197265:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395074432 00000100:00100000:1.0:1651529335.197276:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210339 00000100:00100000:1.0:1651529335.197277:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1883:41278:x1731746395074432:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.197281:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.197285:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083b7e42d/0x3234de053c4f39d lrc: 2/0,0 mode: --/PR res: [0x2b777:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8126 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.197290:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b777:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.197293:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.197294:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.197296:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083b7e42d/0x3234de053c4f39d lrc: 3/0,0 mode: PR/PR res: [0x2b777:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8126 expref: 1884 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.197300:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000083b7e42d/0x3234de053c4f39d lrc: 3/0,0 mode: PR/PR res: [0x2b777:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8126 expref: 1884 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.197304:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000083b7e42d, rc 0) 00000100:00100000:1.0:1651529335.197316:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1884:41278:x1731746395074432:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (59us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.197319:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210339 00000100:00100000:1.0:1651529335.197861:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.197868:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395074688 00000100:00100000:1.0:1651529335.197879:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210340 00000100:00100000:1.0:1651529335.197881:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1884:41279:x1731746395074688:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.197884:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.197888:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000892be50b/0x3234de053c4f3a4 lrc: 2/0,0 mode: --/PR res: [0x2b737:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8134 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.197893:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b737:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.197897:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.197897:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.197899:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000892be50b/0x3234de053c4f3a4 lrc: 3/0,0 mode: PR/PR res: [0x2b737:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8134 expref: 1885 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.197903:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000892be50b/0x3234de053c4f3a4 lrc: 3/0,0 mode: PR/PR res: [0x2b737:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8134 expref: 1885 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.197909:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000892be50b, rc 0) 00000100:00100000:1.0:1651529335.197922:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1885:41279:x1731746395074688:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 40us (61us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.197925:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210340 00000100:00100000:1.0:1651529335.198362:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.198369:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395074880 00000100:00100000:1.0:1651529335.198380:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210341 00000100:00100000:1.0:1651529335.198382:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1885:41278:x1731746395074880:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.198385:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.198389:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007398cbbc/0x3234de053c4f3ab lrc: 2/0,0 mode: --/PR res: [0x2b65d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d813b expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.198393:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b65d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.198397:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.198397:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.198399:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007398cbbc/0x3234de053c4f3ab lrc: 3/0,0 mode: PR/PR res: [0x2b65d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d813b expref: 1886 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.198403:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007398cbbc/0x3234de053c4f3ab lrc: 3/0,0 mode: PR/PR res: [0x2b65d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d813b expref: 1886 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.198407:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007398cbbc, rc 0) 00000100:00100000:1.0:1651529335.198420:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1886:41278:x1731746395074880:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 37us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.198423:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210341 00000100:00100000:1.0:1651529335.199583:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.199589:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395075392 00000100:00100000:1.0:1651529335.199600:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210342 00000100:00100000:1.0:1651529335.199602:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1886:41278:x1731746395075392:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.199605:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.199609:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005086bd45/0x3234de053c4f3b2 lrc: 2/0,0 mode: --/PR res: [0x2b5ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8157 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.199614:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b5ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.199618:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.199618:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.199620:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005086bd45/0x3234de053c4f3b2 lrc: 3/0,0 mode: PR/PR res: [0x2b5ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8157 expref: 1887 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.199624:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005086bd45/0x3234de053c4f3b2 lrc: 3/0,0 mode: PR/PR res: [0x2b5ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8157 expref: 1887 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.199628:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005086bd45, rc 0) 00000100:00100000:1.0:1651529335.199641:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1887:41278:x1731746395075392:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.199643:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210342 00000100:00100000:1.0:1651529335.200093:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.200100:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395075648 00000100:00100000:1.0:1651529335.200110:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210343 00000100:00100000:1.0:1651529335.200112:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1887:41279:x1731746395075648:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.200115:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.200119:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c5115ca/0x3234de053c4f3b9 lrc: 2/0,0 mode: --/PR res: [0x2b8ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8165 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.200124:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b8ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.200127:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.200128:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.200130:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c5115ca/0x3234de053c4f3b9 lrc: 3/0,0 mode: PR/PR res: [0x2b8ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8165 expref: 1888 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.200134:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007c5115ca/0x3234de053c4f3b9 lrc: 3/0,0 mode: PR/PR res: [0x2b8ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8165 expref: 1888 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.200137:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007c5115ca, rc 0) 00000100:00100000:1.0:1651529335.200150:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1888:41279:x1731746395075648:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.200153:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210343 00000100:00100000:1.0:1651529335.201952:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.201959:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395076480 00000100:00100000:1.0:1651529335.201970:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210344 00000100:00100000:1.0:1651529335.201972:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1888:41279:x1731746395076480:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.201975:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.201979:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058d7a733/0x3234de053c4f3c0 lrc: 2/0,0 mode: --/PR res: [0x2b53f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8196 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.201984:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b53f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.201987:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.201988:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.201990:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058d7a733/0x3234de053c4f3c0 lrc: 3/0,0 mode: PR/PR res: [0x2b53f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8196 expref: 1889 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.201996:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000058d7a733/0x3234de053c4f3c0 lrc: 3/0,0 mode: PR/PR res: [0x2b53f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8196 expref: 1889 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.202000:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000058d7a733, rc 0) 00000100:00100000:1.0:1651529335.202012:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1889:41279:x1731746395076480:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 40us (60us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.202015:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210344 00000100:00100000:1.0:1651529335.202474:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.202481:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395076736 00000100:00100000:1.0:1651529335.202492:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210345 00000100:00100000:1.0:1651529335.202494:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1889:41279:x1731746395076736:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.202497:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.202501:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009be39b1e/0x3234de053c4f3c7 lrc: 2/0,0 mode: --/PR res: [0x2b5cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d81a4 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.202506:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b5cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.202509:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.202510:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.202511:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009be39b1e/0x3234de053c4f3c7 lrc: 3/0,0 mode: PR/PR res: [0x2b5cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81a4 expref: 1890 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.202516:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009be39b1e/0x3234de053c4f3c7 lrc: 3/0,0 mode: PR/PR res: [0x2b5cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81a4 expref: 1890 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.202519:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009be39b1e, rc 0) 00000100:00100000:1.0:1651529335.202533:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1890:41279:x1731746395076736:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (59us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.202535:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210345 00000100:00100000:1.0:1651529335.203754:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.203761:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395077248 00000100:00100000:1.0:1651529335.203773:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210346 00000100:00100000:1.0:1651529335.203774:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085af61db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1890:41279:x1731746395077248:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.203778:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.203782:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e21f640/0x3234de053c4f3ce lrc: 2/0,0 mode: --/PR res: [0x2b564:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d81c0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.203787:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b564:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.203790:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.203791:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.203792:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e21f640/0x3234de053c4f3ce lrc: 3/0,0 mode: PR/PR res: [0x2b564:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81c0 expref: 1891 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.203796:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008e21f640/0x3234de053c4f3ce lrc: 3/0,0 mode: PR/PR res: [0x2b564:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81c0 expref: 1891 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.203800:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008e21f640, rc 0) 00000100:00100000:1.0:1651529335.203813:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085af61db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1891:41279:x1731746395077248:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (60us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.203816:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210346 00000100:00100000:1.0:1651529335.204894:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.204901:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395077760 00000100:00100000:1.0:1651529335.204912:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210347 00000100:00100000:1.0:1651529335.204914:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1891:41279:x1731746395077760:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.204917:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.204921:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea8e6dc3/0x3234de053c4f3d5 lrc: 2/0,0 mode: --/PR res: [0x2b72e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d81dc expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.204926:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b72e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.204929:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.204930:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.204931:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea8e6dc3/0x3234de053c4f3d5 lrc: 3/0,0 mode: PR/PR res: [0x2b72e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81dc expref: 1892 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.204936:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ea8e6dc3/0x3234de053c4f3d5 lrc: 3/0,0 mode: PR/PR res: [0x2b72e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81dc expref: 1892 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.204939:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ea8e6dc3, rc 0) 00000100:00100000:1.0:1651529335.204952:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1892:41279:x1731746395077760:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.204955:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210347 00000100:00100000:1.0:1651529335.205616:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.205623:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395078080 00000100:00100000:1.0:1651529335.205634:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210348 00000100:00100000:1.0:1651529335.205636:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1892:41278:x1731746395078080:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.205639:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.205643:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1848133/0x3234de053c4f3dc lrc: 2/0,0 mode: --/PR res: [0x2b701:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d81ea expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.205649:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b701:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.205652:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.205653:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.205654:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1848133/0x3234de053c4f3dc lrc: 3/0,0 mode: PR/PR res: [0x2b701:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81ea expref: 1893 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.205658:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b1848133/0x3234de053c4f3dc lrc: 3/0,0 mode: PR/PR res: [0x2b701:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81ea expref: 1893 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.205662:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b1848133, rc 0) 00000100:00100000:1.0:1651529335.205675:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1893:41278:x1731746395078080:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (59us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.205678:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210348 00000100:00100000:1.0:1651529335.207215:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.207230:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395078656 00000100:00100000:1.0:1651529335.207242:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210349 00000100:00100000:1.0:1651529335.207244:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1893:41279:x1731746395078656:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.207247:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.207251:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f192428c/0x3234de053c4f3e3 lrc: 2/0,0 mode: --/PR res: [0x2b601:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8206 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.207255:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b601:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.207259:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.207260:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.207261:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f192428c/0x3234de053c4f3e3 lrc: 3/0,0 mode: PR/PR res: [0x2b601:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8206 expref: 1894 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.207265:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f192428c/0x3234de053c4f3e3 lrc: 3/0,0 mode: PR/PR res: [0x2b601:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8206 expref: 1894 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.207271:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f192428c, rc 0) 00000100:00100000:1.0:1651529335.207284:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1894:41279:x1731746395078656:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 40us (70us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.207287:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210349 00000100:00100000:1.0:1651529335.208170:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.208177:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395079168 00000100:00100000:1.0:1651529335.208188:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210350 00000100:00100000:1.0:1651529335.208189:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1894:41278:x1731746395079168:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.208193:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.208196:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c4f3ea lrc: 2/0,0 mode: --/PR res: [0x2b69f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8222 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.208201:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b69f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.208204:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.208205:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.208207:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c4f3ea lrc: 3/0,0 mode: PR/PR res: [0x2b69f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8222 expref: 1895 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.208211:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c4f3ea lrc: 3/0,0 mode: PR/PR res: [0x2b69f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8222 expref: 1895 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.208214:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000015737583, rc 0) 00000100:00100000:1.0:1651529335.208240:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1895:41278:x1731746395079168:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 49us (70us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.208243:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210350 00000100:00100000:1.0:1651529335.208367:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.208374:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395079232 00000100:00100000:1.0:1651529335.208383:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210351 00000100:00100000:1.0:1651529335.208385:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1895:41279:x1731746395079232:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.208388:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.208392:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000345d04ae/0x3234de053c4f3f1 lrc: 2/0,0 mode: --/PR res: [0x2b67e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8229 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.208397:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b67e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.208400:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.208401:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.208402:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000345d04ae/0x3234de053c4f3f1 lrc: 3/0,0 mode: PR/PR res: [0x2b67e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8229 expref: 1896 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.208407:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000345d04ae/0x3234de053c4f3f1 lrc: 3/0,0 mode: PR/PR res: [0x2b67e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8229 expref: 1896 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.208410:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000345d04ae, rc 0) 00000100:00100000:1.0:1651529335.208421:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1896:41279:x1731746395079232:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 36us (55us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.208424:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210351 00000100:00100000:1.0:1651529335.208954:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.208961:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395079488 00000100:00100000:1.0:1651529335.208972:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210352 00000100:00100000:1.0:1651529335.208974:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1896:41279:x1731746395079488:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.208977:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.208981:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c4f3f8 lrc: 2/0,0 mode: --/PR res: [0x2b64c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8237 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.208986:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b64c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.208989:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.208990:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.208991:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c4f3f8 lrc: 3/0,0 mode: PR/PR res: [0x2b64c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8237 expref: 1897 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.208995:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c4f3f8 lrc: 3/0,0 mode: PR/PR res: [0x2b64c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8237 expref: 1897 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.208999:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c46cc6d, rc 0) 00000100:00100000:1.0:1651529335.209012:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1897:41279:x1731746395079488:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 37us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.209015:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210352 00000100:00100000:1.0:1651529335.211241:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.211248:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395080448 00000100:00100000:1.0:1651529335.211259:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210353 00000100:00100000:1.0:1651529335.211261:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1897:41279:x1731746395080448:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.211264:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.211267:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c4f3ff lrc: 2/0,0 mode: --/PR res: [0x2b827:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8268 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.211272:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b827:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.211275:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.211276:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.211278:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c4f3ff lrc: 3/0,0 mode: PR/PR res: [0x2b827:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8268 expref: 1898 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.211284:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c4f3ff lrc: 3/0,0 mode: PR/PR res: [0x2b827:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8268 expref: 1898 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.211288:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000587473f4, rc 0) 00000100:00100000:1.0:1651529335.211300:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1898:41279:x1731746395080448:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 39us (60us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.211303:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210353 00000100:00100000:1.0:1651529335.211402:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.211409:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395080640 00000100:00100000:1.0:1651529335.211418:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210354 00000100:00100000:1.0:1651529335.211420:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1898:41279:x1731746395080640:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.211423:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.211427:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008acce999/0x3234de053c4f406 lrc: 2/0,0 mode: --/PR res: [0x2b932:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8276 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.211432:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b932:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.211435:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.211436:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.211437:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008acce999/0x3234de053c4f406 lrc: 3/0,0 mode: PR/PR res: [0x2b932:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8276 expref: 1899 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.211442:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008acce999/0x3234de053c4f406 lrc: 3/0,0 mode: PR/PR res: [0x2b932:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8276 expref: 1899 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.211445:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008acce999, rc 0) 00000100:00100000:1.0:1651529335.211457:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1899:41279:x1731746395080640:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 36us (55us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.211459:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210354 00000100:00100000:1.0:1651529335.212583:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.212590:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395081024 00000100:00100000:1.0:1651529335.212601:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210355 00000100:00100000:1.0:1651529335.212603:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1899:41279:x1731746395081024:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.212606:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.212613:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cab2bcca/0x3234de053c4f40d lrc: 2/0,0 mode: --/PR res: [0x2b95e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d828b expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.212618:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b95e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.212622:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.212622:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.212624:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cab2bcca/0x3234de053c4f40d lrc: 3/0,0 mode: PR/PR res: [0x2b95e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d828b expref: 1900 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.212628:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cab2bcca/0x3234de053c4f40d lrc: 3/0,0 mode: PR/PR res: [0x2b95e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d828b expref: 1900 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.212632:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000cab2bcca, rc 0) 00000100:00100000:1.0:1651529335.212645:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1900:41279:x1731746395081024:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 41us (62us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.212647:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210355 00000100:00100000:1.0:1651529335.214052:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.214059:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395081728 00000100:00100000:1.0:1651529335.214070:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210356 00000100:00100000:1.0:1651529335.214072:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1900:41278:x1731746395081728:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.214075:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.214078:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1d98a9c/0x3234de053c4f414 lrc: 2/0,0 mode: --/PR res: [0x2b890:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d82ae expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.214083:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b890:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.214087:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.214087:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.214089:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1d98a9c/0x3234de053c4f414 lrc: 3/0,0 mode: PR/PR res: [0x2b890:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d82ae expref: 1901 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.214093:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e1d98a9c/0x3234de053c4f414 lrc: 3/0,0 mode: PR/PR res: [0x2b890:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d82ae expref: 1901 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.214097:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e1d98a9c, rc 0) 00000100:00100000:1.0:1651529335.214110:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1901:41278:x1731746395081728:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 37us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.214112:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210356 00000100:00100000:1.0:1651529335.219265:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.219272:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395083968 00000100:00100000:1.0:1651529335.219282:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210357 00000100:00100000:1.0:1651529335.219284:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1901:41278:x1731746395083968:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.219287:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.219291:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e90f6a58/0x3234de053c4f41b lrc: 2/0,0 mode: --/PR res: [0x2b753:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d832c expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.219296:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b753:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.219300:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.219301:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.219302:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e90f6a58/0x3234de053c4f41b lrc: 3/0,0 mode: PR/PR res: [0x2b753:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d832c expref: 1902 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.219306:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e90f6a58/0x3234de053c4f41b lrc: 3/0,0 mode: PR/PR res: [0x2b753:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d832c expref: 1902 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.219310:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e90f6a58, rc 0) 00000100:00100000:1.0:1651529335.219323:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1902:41278:x1731746395083968:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (59us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.219326:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210357 00000100:00100000:1.0:1651529335.222192:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.222199:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395085312 00000100:00100000:1.0:1651529335.222210:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210358 00000100:00100000:1.0:1651529335.222212:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1902:41279:x1731746395085312:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.222215:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.222218:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000876c3b77/0x3234de053c4f422 lrc: 2/0,0 mode: --/PR res: [0x2b3fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8372 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.222235:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b3fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.222239:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.222239:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.222241:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000876c3b77/0x3234de053c4f422 lrc: 3/0,0 mode: PR/PR res: [0x2b3fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8372 expref: 1903 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.222245:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000876c3b77/0x3234de053c4f422 lrc: 3/0,0 mode: PR/PR res: [0x2b3fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8372 expref: 1903 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.222251:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000876c3b77, rc 0) 00000100:00100000:1.0:1651529335.222265:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1903:41279:x1731746395085312:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 52us (73us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.222267:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210358 00000100:00100000:1.0:1651529335.222754:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.222762:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395085568 00000100:00100000:1.0:1651529335.222773:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210359 00000100:00100000:1.0:1651529335.222774:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1903:41279:x1731746395085568:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.222777:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.222781:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c4f429 lrc: 2/0,0 mode: --/PR res: [0x2b420:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8380 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.222786:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b420:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.222790:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.222790:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.222792:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c4f429 lrc: 3/0,0 mode: PR/PR res: [0x2b420:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8380 expref: 1904 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.222796:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c4f429 lrc: 3/0,0 mode: PR/PR res: [0x2b420:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8380 expref: 1904 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.222800:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000b62c3c9, rc 0) 00000100:00100000:1.0:1651529335.222813:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1904:41279:x1731746395085568:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (59us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.222815:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210359 00000100:00100000:1.0:1651529335.223276:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.223283:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395085824 00000100:00100000:1.0:1651529335.223294:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210360 00000100:00100000:1.0:1651529335.223296:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1904:41279:x1731746395085824:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.223299:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.223303:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a7b079b/0x3234de053c4f430 lrc: 2/0,0 mode: --/PR res: [0x2b491:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d838e expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.223308:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b491:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.223311:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.223312:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.223313:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a7b079b/0x3234de053c4f430 lrc: 3/0,0 mode: PR/PR res: [0x2b491:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d838e expref: 1905 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.223317:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002a7b079b/0x3234de053c4f430 lrc: 3/0,0 mode: PR/PR res: [0x2b491:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d838e expref: 1905 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.223321:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a7b079b, rc 0) 00000100:00100000:1.0:1651529335.223334:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1905:41279:x1731746395085824:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.223337:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210360 00000100:00100000:1.0:1651529335.224399:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.224405:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395086272 00000100:00100000:1.0:1651529335.224416:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210361 00000100:00100000:1.0:1651529335.224418:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1905:41278:x1731746395086272:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.224421:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.224425:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed7a068d/0x3234de053c4f437 lrc: 2/0,0 mode: --/PR res: [0x2b913:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d83aa expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.224430:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b913:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.224433:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.224434:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.224435:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed7a068d/0x3234de053c4f437 lrc: 3/0,0 mode: PR/PR res: [0x2b913:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83aa expref: 1906 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.224439:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ed7a068d/0x3234de053c4f437 lrc: 3/0,0 mode: PR/PR res: [0x2b913:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83aa expref: 1906 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.224443:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ed7a068d, rc 0) 00000100:00100000:1.0:1651529335.224456:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1906:41278:x1731746395086272:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 37us (57us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.224458:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210361 00000100:00100000:1.0:1651529335.225127:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.225134:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395086592 00000100:00100000:1.0:1651529335.225144:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210362 00000100:00100000:1.0:1651529335.225146:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfc79d4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1906:41279:x1731746395086592:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.225149:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.225154:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c4f43e lrc: 2/0,0 mode: --/PR res: [0x2b748:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d83b8 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.225158:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b748:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.225162:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.225163:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.225164:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c4f43e lrc: 3/0,0 mode: PR/PR res: [0x2b748:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83b8 expref: 1907 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.225170:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c4f43e lrc: 3/0,0 mode: PR/PR res: [0x2b748:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83b8 expref: 1907 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.225174:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009c763642, rc 0) 00000100:00100000:1.0:1651529335.225187:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfc79d4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1907:41279:x1731746395086592:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 40us (61us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.225189:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210362 00000100:00100000:1.0:1651529335.227323:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.227330:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395087488 00000100:00100000:1.0:1651529335.227340:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210363 00000100:00100000:1.0:1651529335.227342:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005914c920 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1907:41279:x1731746395087488:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.227345:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.227349:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c4f445 lrc: 2/0,0 mode: --/PR res: [0x2b7e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d83e9 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.227354:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b7e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.227358:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.227358:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.227360:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c4f445 lrc: 3/0,0 mode: PR/PR res: [0x2b7e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83e9 expref: 1908 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.227364:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c4f445 lrc: 3/0,0 mode: PR/PR res: [0x2b7e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83e9 expref: 1908 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.227368:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003c571c06, rc 0) 00000100:00100000:1.0:1651529335.227381:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005914c920 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1908:41279:x1731746395087488:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.227383:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210363 00000100:00100000:1.0:1651529335.227601:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.227608:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395087680 00000100:00100000:1.0:1651529335.227617:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210364 00000100:00100000:1.0:1651529335.227618:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007fca8239 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1908:41279:x1731746395087680:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.227621:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.227625:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e145e11/0x3234de053c4f44c lrc: 2/0,0 mode: --/PR res: [0x2baa8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d83f0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.227630:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2baa8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.227634:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.227634:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.227636:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e145e11/0x3234de053c4f44c lrc: 3/0,0 mode: PR/PR res: [0x2baa8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83f0 expref: 1909 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.227640:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003e145e11/0x3234de053c4f44c lrc: 3/0,0 mode: PR/PR res: [0x2baa8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83f0 expref: 1909 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.227644:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003e145e11, rc 0) 00000100:00100000:1.0:1651529335.227655:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007fca8239 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1909:41279:x1731746395087680:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 36us (55us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.227658:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210364 00000100:00100000:1.0:1651529335.228218:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.228239:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395087936 00000100:00100000:1.0:1651529335.228248:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210365 00000100:00100000:1.0:1651529335.228250:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ea32140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1909:41278:x1731746395087936:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.228253:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.228257:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099354594/0x3234de053c4f453 lrc: 2/0,0 mode: --/PR res: [0x2b51b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d83fe expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.228262:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b51b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.228265:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.228266:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.228267:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099354594/0x3234de053c4f453 lrc: 3/0,0 mode: PR/PR res: [0x2b51b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83fe expref: 1910 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.228272:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000099354594/0x3234de053c4f453 lrc: 3/0,0 mode: PR/PR res: [0x2b51b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83fe expref: 1910 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.228275:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000099354594, rc 0) 00000100:00100000:1.0:1651529335.228289:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ea32140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1910:41278:x1731746395087936:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (71us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.228291:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210365 00000100:00100000:1.0:1651529335.228771:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.228778:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395088192 00000100:00100000:1.0:1651529335.228788:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210366 00000100:00100000:1.0:1651529335.228790:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1910:41279:x1731746395088192:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.228793:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.228797:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c4f45a lrc: 2/0,0 mode: --/PR res: [0x2b783:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d840c expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.228802:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b783:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.228806:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.228807:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.228808:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c4f45a lrc: 3/0,0 mode: PR/PR res: [0x2b783:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d840c expref: 1911 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.228812:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c4f45a lrc: 3/0,0 mode: PR/PR res: [0x2b783:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d840c expref: 1911 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.228816:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a520645e, rc 0) 00000100:00100000:1.0:1651529335.228829:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1911:41279:x1731746395088192:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.228832:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210366 00000100:00100000:1.0:1651529335.229919:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.229926:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395088704 00000100:00100000:1.0:1651529335.229936:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210367 00000100:00100000:1.0:1651529335.229938:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1911:41278:x1731746395088704:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.229941:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.229945:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c4f461 lrc: 2/0,0 mode: --/PR res: [0x2b3d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8428 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.229950:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b3d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.229953:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.229954:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.229956:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c4f461 lrc: 3/0,0 mode: PR/PR res: [0x2b3d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8428 expref: 1912 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.229960:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c4f461 lrc: 3/0,0 mode: PR/PR res: [0x2b3d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8428 expref: 1912 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.229966:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d3d72adb, rc 0) 00000100:00100000:1.0:1651529335.229978:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1912:41278:x1731746395088704:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 40us (60us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.229981:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210367 00000100:00100000:1.0:1651529335.232142:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.232149:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395089728 00000100:00100000:1.0:1651529335.232160:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210368 00000100:00100000:1.0:1651529335.232162:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1912:41278:x1731746395089728:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.232165:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.232169:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c4f468 lrc: 2/0,0 mode: --/PR res: [0x2b6bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8460 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.232174:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b6bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.232178:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.232178:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.232180:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c4f468 lrc: 3/0,0 mode: PR/PR res: [0x2b6bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8460 expref: 1913 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.232184:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c4f468 lrc: 3/0,0 mode: PR/PR res: [0x2b6bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8460 expref: 1913 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.232188:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008288bff7, rc 0) 00000100:00100000:1.0:1651529335.232200:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1913:41278:x1731746395089728:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.232203:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210368 00000100:00100000:1.0:1651529335.233219:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.233241:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395090240 00000100:00100000:1.0:1651529335.233250:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210369 00000100:00100000:1.0:1651529335.233252:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1913:41278:x1731746395090240:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.233255:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.233259:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058990195/0x3234de053c4f46f lrc: 2/0,0 mode: --/PR res: [0x2b92d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d847c expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.233264:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b92d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.233268:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.233269:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.233270:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058990195/0x3234de053c4f46f lrc: 3/0,0 mode: PR/PR res: [0x2b92d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d847c expref: 1914 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.233274:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000058990195/0x3234de053c4f46f lrc: 3/0,0 mode: PR/PR res: [0x2b92d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d847c expref: 1914 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.233278:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000058990195, rc 0) 00000100:00100000:1.0:1651529335.233291:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1914:41278:x1731746395090240:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 39us (73us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.233294:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210369 00000100:00100000:1.0:1651529335.233752:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.233759:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395090496 00000100:00100000:1.0:1651529335.233770:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210370 00000100:00100000:1.0:1651529335.233772:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1914:41278:x1731746395090496:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.233775:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.233783:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2ca352a/0x3234de053c4f476 lrc: 2/0,0 mode: --/PR res: [0x2b8f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d848a expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.233788:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b8f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.233792:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.233792:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.233794:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2ca352a/0x3234de053c4f476 lrc: 3/0,0 mode: PR/PR res: [0x2b8f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d848a expref: 1915 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.233798:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a2ca352a/0x3234de053c4f476 lrc: 3/0,0 mode: PR/PR res: [0x2b8f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d848a expref: 1915 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.233802:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a2ca352a, rc 0) 00000100:00100000:1.0:1651529335.233815:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1915:41278:x1731746395090496:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 43us (64us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.233818:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210370 00000100:00100000:1.0:1651529335.235030:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.235037:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395091008 00000100:00100000:1.0:1651529335.235047:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210371 00000100:00100000:1.0:1651529335.235049:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1915:41278:x1731746395091008:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.235052:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.235056:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090b66157/0x3234de053c4f47d lrc: 2/0,0 mode: --/PR res: [0x2b962:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d84a6 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.235061:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b962:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.235064:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.235065:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.235067:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090b66157/0x3234de053c4f47d lrc: 3/0,0 mode: PR/PR res: [0x2b962:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84a6 expref: 1916 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.235073:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000090b66157/0x3234de053c4f47d lrc: 3/0,0 mode: PR/PR res: [0x2b962:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84a6 expref: 1916 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.235077:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000090b66157, rc 0) 00000100:00100000:1.0:1651529335.235089:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1916:41278:x1731746395091008:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 40us (60us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.235092:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210371 00000100:00100000:1.0:1651529335.235570:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.235577:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395091264 00000100:00100000:1.0:1651529335.235588:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210372 00000100:00100000:1.0:1651529335.235590:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1916:41278:x1731746395091264:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.235593:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.235597:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004bc816c1/0x3234de053c4f484 lrc: 2/0,0 mode: --/PR res: [0x2baef:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d84b4 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.235602:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2baef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.235606:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.235606:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.235608:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bc816c1/0x3234de053c4f484 lrc: 3/0,0 mode: PR/PR res: [0x2baef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84b4 expref: 1917 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.235612:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004bc816c1/0x3234de053c4f484 lrc: 3/0,0 mode: PR/PR res: [0x2baef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84b4 expref: 1917 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.235616:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004bc816c1, rc 0) 00000100:00100000:1.0:1651529335.235629:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1917:41278:x1731746395091264:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (59us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.235631:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210372 00000100:00100000:1.0:1651529335.236217:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.236235:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395091520 00000100:00100000:1.0:1651529335.236246:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210373 00000100:00100000:1.0:1651529335.236247:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1917:41278:x1731746395091520:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.236251:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.236258:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c4f48b lrc: 2/0,0 mode: --/PR res: [0x2b3d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d84c2 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.236263:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b3d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.236266:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.236267:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.236268:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c4f48b lrc: 3/0,0 mode: PR/PR res: [0x2b3d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84c2 expref: 1918 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.236272:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c4f48b lrc: 3/0,0 mode: PR/PR res: [0x2b3d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84c2 expref: 1918 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.236276:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006b93727a, rc 0) 00000100:00100000:1.0:1651529335.236290:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1918:41278:x1731746395091520:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 42us (73us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.236293:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210373 00000100:00100000:1.0:1651529335.236861:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.236868:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395091776 00000100:00100000:1.0:1651529335.236879:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210374 00000100:00100000:1.0:1651529335.236881:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1918:41278:x1731746395091776:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.236884:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.236888:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d5f5234/0x3234de053c4f492 lrc: 2/0,0 mode: --/PR res: [0x2b9be:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d84d0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.236893:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b9be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.236896:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.236897:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.236898:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d5f5234/0x3234de053c4f492 lrc: 3/0,0 mode: PR/PR res: [0x2b9be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84d0 expref: 1919 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.236902:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006d5f5234/0x3234de053c4f492 lrc: 3/0,0 mode: PR/PR res: [0x2b9be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84d0 expref: 1919 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.236906:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006d5f5234, rc 0) 00000100:00100000:1.0:1651529335.236919:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1919:41278:x1731746395091776:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.236922:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210374 00000100:00100000:1.0:1651529335.238478:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.238485:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395092544 00000100:00100000:1.0:1651529335.238496:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210375 00000100:00100000:1.0:1651529335.238498:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1919:41279:x1731746395092544:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.238501:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.238505:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c974c514/0x3234de053c4f499 lrc: 2/0,0 mode: --/PR res: [0x2bae0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d84fa expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.238510:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bae0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.238514:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.238515:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.238516:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c974c514/0x3234de053c4f499 lrc: 3/0,0 mode: PR/PR res: [0x2bae0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84fa expref: 1920 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.238520:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c974c514/0x3234de053c4f499 lrc: 3/0,0 mode: PR/PR res: [0x2bae0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84fa expref: 1920 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.238524:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c974c514, rc 0) 00000100:00100000:1.0:1651529335.238537:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1920:41279:x1731746395092544:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (59us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.238540:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210375 00000100:00100000:1.0:1651529335.240037:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.240043:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395093248 00000100:00100000:1.0:1651529335.240054:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210376 00000100:00100000:1.0:1651529335.240056:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1920:41278:x1731746395093248:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.240059:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.240067:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021be5e77/0x3234de053c4f4a0 lrc: 2/0,0 mode: --/PR res: [0x2b8c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8524 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.240072:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b8c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.240075:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.240076:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.240077:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021be5e77/0x3234de053c4f4a0 lrc: 3/0,0 mode: PR/PR res: [0x2b8c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8524 expref: 1921 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.240081:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000021be5e77/0x3234de053c4f4a0 lrc: 3/0,0 mode: PR/PR res: [0x2b8c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8524 expref: 1921 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.240087:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000021be5e77, rc 0) 00000100:00100000:1.0:1651529335.240101:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1921:41278:x1731746395093248:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 44us (64us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.240103:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210376 00000100:00100000:1.0:1651529335.240819:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.240826:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395093504 00000100:00100000:1.0:1651529335.240836:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210377 00000100:00100000:1.0:1651529335.240838:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1921:41279:x1731746395093504:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.240841:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.240845:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c4f4a7 lrc: 2/0,0 mode: --/PR res: [0x2b55c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8532 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.240850:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b55c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.240854:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.240855:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.240856:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c4f4a7 lrc: 3/0,0 mode: PR/PR res: [0x2b55c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8532 expref: 1922 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.240860:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c4f4a7 lrc: 3/0,0 mode: PR/PR res: [0x2b55c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8532 expref: 1922 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.240864:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000010b0a5e, rc 0) 00000100:00100000:1.0:1651529335.240877:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1922:41279:x1731746395093504:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (59us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.240880:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210377 00000100:00100000:1.0:1651529335.241240:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.241247:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395093760 00000100:00100000:1.0:1651529335.241258:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210378 00000100:00100000:1.0:1651529335.241260:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1922:41279:x1731746395093760:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.241263:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.241267:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d236605/0x3234de053c4f4ae lrc: 2/0,0 mode: --/PR res: [0x2baf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8540 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.241272:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2baf6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.241276:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.241276:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.241278:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d236605/0x3234de053c4f4ae lrc: 3/0,0 mode: PR/PR res: [0x2baf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8540 expref: 1923 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.241282:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009d236605/0x3234de053c4f4ae lrc: 3/0,0 mode: PR/PR res: [0x2baf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8540 expref: 1923 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.241286:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009d236605, rc 0) 00000100:00100000:1.0:1651529335.241299:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1923:41279:x1731746395093760:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (59us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.241301:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210378 00000100:00100000:1.0:1651529335.242638:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.242645:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395094464 00000100:00100000:1.0:1651529335.242656:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210379 00000100:00100000:1.0:1651529335.242657:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1923:41278:x1731746395094464:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.242661:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.242664:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023ef1563/0x3234de053c4f4b5 lrc: 2/0,0 mode: --/PR res: [0x2b974:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d856a expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.242669:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b974:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.242673:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.242673:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.242675:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023ef1563/0x3234de053c4f4b5 lrc: 3/0,0 mode: PR/PR res: [0x2b974:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d856a expref: 1924 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.242679:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000023ef1563/0x3234de053c4f4b5 lrc: 3/0,0 mode: PR/PR res: [0x2b974:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d856a expref: 1924 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.242683:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000023ef1563, rc 0) 00000100:00100000:1.0:1651529335.242696:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1924:41278:x1731746395094464:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 37us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.242698:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210379 00000100:00100000:1.0:1651529335.243736:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.243744:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395094976 00000100:00100000:1.0:1651529335.243757:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210380 00000100:00100000:1.0:1651529335.243759:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1924:41278:x1731746395094976:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.243762:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.243766:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052c5136b/0x3234de053c4f4bc lrc: 2/0,0 mode: --/PR res: [0x2b982:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8586 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.243771:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b982:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.243775:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.243775:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.243777:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052c5136b/0x3234de053c4f4bc lrc: 3/0,0 mode: PR/PR res: [0x2b982:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8586 expref: 1925 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.243783:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000052c5136b/0x3234de053c4f4bc lrc: 3/0,0 mode: PR/PR res: [0x2b982:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8586 expref: 1925 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.243787:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000052c5136b, rc 0) 00000100:00100000:1.0:1651529335.243800:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1925:41278:x1731746395094976:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 40us (71us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.243802:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210380 00000100:00100000:1.0:1651529335.244281:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.244288:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395095232 00000100:00100000:1.0:1651529335.244299:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210381 00000100:00100000:1.0:1651529335.244300:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1925:41278:x1731746395095232:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.244304:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.244308:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af9a238a/0x3234de053c4f4c3 lrc: 2/0,0 mode: --/PR res: [0x2b72b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8594 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.244313:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b72b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.244316:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.244317:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.244318:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af9a238a/0x3234de053c4f4c3 lrc: 3/0,0 mode: PR/PR res: [0x2b72b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8594 expref: 1926 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.244322:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000af9a238a/0x3234de053c4f4c3 lrc: 3/0,0 mode: PR/PR res: [0x2b72b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8594 expref: 1926 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.244326:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000af9a238a, rc 0) 00000100:00100000:1.0:1651529335.244339:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1926:41278:x1731746395095232:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (59us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.244342:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210381 00000100:00100000:1.0:1651529335.245956:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.245963:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395096000 00000100:00100000:1.0:1651529335.245973:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210382 00000100:00100000:1.0:1651529335.245975:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1926:41279:x1731746395096000:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.245978:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.245982:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c4f4ca lrc: 2/0,0 mode: --/PR res: [0x2b5ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d85be expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.245987:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b5ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.245990:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.245991:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.245992:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c4f4ca lrc: 3/0,0 mode: PR/PR res: [0x2b5ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85be expref: 1927 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.245997:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c4f4ca lrc: 3/0,0 mode: PR/PR res: [0x2b5ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85be expref: 1927 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.246000:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000035eaa2c8, rc 0) 00000100:00100000:1.0:1651529335.246013:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1927:41279:x1731746395096000:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 37us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.246016:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210382 00000100:00100000:1.0:1651529335.247268:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.247275:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395096640 00000100:00100000:1.0:1651529335.247286:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210383 00000100:00100000:1.0:1651529335.247288:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1927:41279:x1731746395096640:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.247291:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.247295:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f51a2e3/0x3234de053c4f4d1 lrc: 2/0,0 mode: --/PR res: [0x2b79c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d85e1 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.247300:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b79c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.247303:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.247304:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.247305:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f51a2e3/0x3234de053c4f4d1 lrc: 3/0,0 mode: PR/PR res: [0x2b79c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85e1 expref: 1928 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.247309:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003f51a2e3/0x3234de053c4f4d1 lrc: 3/0,0 mode: PR/PR res: [0x2b79c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85e1 expref: 1928 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.247313:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f51a2e3, rc 0) 00000100:00100000:1.0:1651529335.247326:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1928:41279:x1731746395096640:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 37us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.247329:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210383 00000100:00100000:1.0:1651529335.247498:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.247505:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395096704 00000100:00100000:1.0:1651529335.247514:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210384 00000100:00100000:1.0:1651529335.247516:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1928:41279:x1731746395096704:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.247519:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.247522:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1517c27/0x3234de053c4f4d8 lrc: 2/0,0 mode: --/PR res: [0x2b68a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d85e8 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.247527:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b68a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.247531:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.247532:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.247533:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1517c27/0x3234de053c4f4d8 lrc: 3/0,0 mode: PR/PR res: [0x2b68a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85e8 expref: 1929 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.247537:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a1517c27/0x3234de053c4f4d8 lrc: 3/0,0 mode: PR/PR res: [0x2b68a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85e8 expref: 1929 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.247541:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a1517c27, rc 0) 00000100:00100000:1.0:1651529335.247552:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1929:41279:x1731746395096704:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 36us (54us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.247555:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210384 00000100:00100000:1.0:1651529335.248889:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.248895:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395097280 00000100:00100000:1.0:1651529335.248906:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210385 00000100:00100000:1.0:1651529335.248908:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eabbd58a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1929:41279:x1731746395097280:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.248911:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.248915:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000648e877b/0x3234de053c4f4df lrc: 2/0,0 mode: --/PR res: [0x2b7ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d860b expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.248920:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b7ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.248923:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.248924:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.248925:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000648e877b/0x3234de053c4f4df lrc: 3/0,0 mode: PR/PR res: [0x2b7ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d860b expref: 1930 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.248930:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000648e877b/0x3234de053c4f4df lrc: 3/0,0 mode: PR/PR res: [0x2b7ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d860b expref: 1930 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.248935:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000648e877b, rc 0) 00000100:00100000:1.0:1651529335.248948:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eabbd58a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1930:41279:x1731746395097280:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 39us (60us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.248951:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210385 00000100:00100000:1.0:1651529335.250448:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.250455:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395097984 00000100:00100000:1.0:1651529335.250466:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210386 00000100:00100000:1.0:1651529335.250467:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1930:41278:x1731746395097984:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.250471:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.250474:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c4f4e6 lrc: 2/0,0 mode: --/PR res: [0x2b438:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d862e expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.250479:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b438:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.250483:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.250483:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.250485:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c4f4e6 lrc: 3/0,0 mode: PR/PR res: [0x2b438:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d862e expref: 1931 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.250489:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c4f4e6 lrc: 3/0,0 mode: PR/PR res: [0x2b438:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d862e expref: 1931 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.250493:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000022a9b983, rc 0) 00000100:00100000:1.0:1651529335.250506:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1931:41278:x1731746395097984:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 37us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.250508:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210386 00000100:00100000:1.0:1651529335.251979:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.251986:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395098688 00000100:00100000:1.0:1651529335.251997:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210387 00000100:00100000:1.0:1651529335.251998:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1931:41279:x1731746395098688:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.252001:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.252008:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000da10cee/0x3234de053c4f4ed lrc: 2/0,0 mode: --/PR res: [0x2b93c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8651 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.252013:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b93c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.252017:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.252017:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.252019:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000da10cee/0x3234de053c4f4ed lrc: 3/0,0 mode: PR/PR res: [0x2b93c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8651 expref: 1932 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.252023:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000da10cee/0x3234de053c4f4ed lrc: 3/0,0 mode: PR/PR res: [0x2b93c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8651 expref: 1932 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.252027:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000da10cee, rc 0) 00000100:00100000:1.0:1651529335.252040:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1932:41279:x1731746395098688:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 40us (61us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.252042:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210387 00000100:00100000:1.0:1651529335.252131:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.252137:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395098752 00000100:00100000:1.0:1651529335.252146:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210388 00000100:00100000:1.0:1651529335.252148:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1932:41278:x1731746395098752:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.252151:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.252155:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060dc727a/0x3234de053c4f4f4 lrc: 2/0,0 mode: --/PR res: [0x2b6b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8658 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.252165:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b6b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.252168:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.252169:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.252170:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060dc727a/0x3234de053c4f4f4 lrc: 3/0,0 mode: PR/PR res: [0x2b6b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8658 expref: 1933 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.252175:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000060dc727a/0x3234de053c4f4f4 lrc: 3/0,0 mode: PR/PR res: [0x2b6b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8658 expref: 1933 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.252178:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000060dc727a, rc 0) 00000100:00100000:1.0:1651529335.252189:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1933:41278:x1731746395098752:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 40us (59us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.252192:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210388 00000100:00100000:1.0:1651529335.253343:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.253350:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395099264 00000100:00100000:1.0:1651529335.253361:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210389 00000100:00100000:1.0:1651529335.253363:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1933:41279:x1731746395099264:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.253366:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.253369:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000185935fb/0x3234de053c4f4fb lrc: 2/0,0 mode: --/PR res: [0x2b436:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8674 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.253374:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b436:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.253378:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.253378:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.253380:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000185935fb/0x3234de053c4f4fb lrc: 3/0,0 mode: PR/PR res: [0x2b436:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8674 expref: 1934 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.253386:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000185935fb/0x3234de053c4f4fb lrc: 3/0,0 mode: PR/PR res: [0x2b436:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8674 expref: 1934 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.253390:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000185935fb, rc 0) 00000100:00100000:1.0:1651529335.253402:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1934:41279:x1731746395099264:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 39us (60us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.253405:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210389 00000100:00100000:1.0:1651529335.254446:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.254456:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395099776 00000100:00100000:1.0:1651529335.254471:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210390 00000100:00100000:1.0:1651529335.254473:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1934:41278:x1731746395099776:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.254477:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.254482:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8332865/0x3234de053c4f502 lrc: 2/0,0 mode: --/PR res: [0x2b732:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8690 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.254489:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b732:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.254493:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.254494:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.254496:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8332865/0x3234de053c4f502 lrc: 3/0,0 mode: PR/PR res: [0x2b732:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8690 expref: 1935 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.254501:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a8332865/0x3234de053c4f502 lrc: 3/0,0 mode: PR/PR res: [0x2b732:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8690 expref: 1935 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.254506:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a8332865, rc 0) 00000100:00100000:1.0:1651529335.254521:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1935:41278:x1731746395099776:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 48us (77us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.254525:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210390 00000100:00100000:1.0:1651529335.255351:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.255359:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395100224 00000100:00100000:1.0:1651529335.255372:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210391 00000100:00100000:1.0:1651529335.255373:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1935:41279:x1731746395100224:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.255377:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.255381:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e4b14da/0x3234de053c4f509 lrc: 2/0,0 mode: --/PR res: [0x2b535:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d86ac expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.255387:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b535:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.255391:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.255391:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.255393:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e4b14da/0x3234de053c4f509 lrc: 3/0,0 mode: PR/PR res: [0x2b535:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d86ac expref: 1936 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.255398:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002e4b14da/0x3234de053c4f509 lrc: 3/0,0 mode: PR/PR res: [0x2b535:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d86ac expref: 1936 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.255402:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002e4b14da, rc 0) 00000100:00100000:1.0:1651529335.255416:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1936:41279:x1731746395100224:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 41us (65us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.255419:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210391 00000100:00100000:1.0:1651529335.255918:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.255925:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395100480 00000100:00100000:1.0:1651529335.255937:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210392 00000100:00100000:1.0:1651529335.255939:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1936:41279:x1731746395100480:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.255942:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.255945:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060fa75d6/0x3234de053c4f510 lrc: 2/0,0 mode: --/PR res: [0x2bafb:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d86ba expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.255951:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bafb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.255954:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.255955:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.255957:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060fa75d6/0x3234de053c4f510 lrc: 3/0,0 mode: PR/PR res: [0x2bafb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d86ba expref: 1937 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.255961:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000060fa75d6/0x3234de053c4f510 lrc: 3/0,0 mode: PR/PR res: [0x2bafb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d86ba expref: 1937 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.255965:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000060fa75d6, rc 0) 00000100:00100000:1.0:1651529335.255979:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1937:41279:x1731746395100480:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 39us (61us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.255981:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210392 00000100:00100000:1.0:1651529335.257637:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.257658:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.257675:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395101312 00000100:00100000:1.0:1651529335.257686:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210393 00000100:00100000:1.0:1651529335.257687:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1938:41278:x1731746395101312:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:1.0:1651529335.257691:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529335.257694:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046fa391d/0x3234de053c4f517 lrc: 2/0,0 mode: --/PR res: [0x2b59a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d86eb expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529335.257702:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b59a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529335.257706:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.257706:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529335.257708:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046fa391d/0x3234de053c4f517 lrc: 3/0,0 mode: PR/PR res: [0x2b59a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d86eb expref: 1939 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.257712:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000046fa391d/0x3234de053c4f517 lrc: 3/0,0 mode: PR/PR res: [0x2b59a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d86eb expref: 1940 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529335.257716:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000046fa391d, rc 0) 00000100:00100000:1.0:1651529335.257728:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1940:41278:x1731746395101312:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 40us (70us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529335.257741:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210393 00000100:00100000:1.0:1651529335.259453:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.260040:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.260583:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.261123:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.262749:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.263580:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.264917:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.266240:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.267178:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529335.267846:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529335.267895:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.267896:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.267897:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0bb0de7/0x3234de053c4f564 lrc: 3/0,0 mode: PR/PR res: [0x2b85a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d87ee expref: 1949 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.267901:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b0bb0de7/0x3234de053c4f564 lrc: 3/0,0 mode: PR/PR res: [0x2b85a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d87ee expref: 1949 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.267905:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b0bb0de7, rc 0) 00000100:00100000:0.0:1651529335.267919:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1949:41278:x1731746395105984:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.267921:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210404 00000100:00100000:1.0:1651529335.269505:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.269526:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395106752 00000100:00100000:0.0:1651529335.269537:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210405 00000100:00100000:0.0:1651529335.269539:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1949:41278:x1731746395106752:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:0.0:1651529335.269542:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.269550:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba79f088/0x3234de053c4f56b lrc: 2/0,0 mode: --/PR res: [0x2b5b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8818 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.269555:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b5b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.269558:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.269559:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.269561:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba79f088/0x3234de053c4f56b lrc: 3/0,0 mode: PR/PR res: [0x2b5b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8818 expref: 1950 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.269565:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ba79f088/0x3234de053c4f56b lrc: 3/0,0 mode: PR/PR res: [0x2b5b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8818 expref: 1950 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.269568:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ba79f088, rc 0) 00000100:00100000:0.0:1651529335.269582:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1950:41278:x1731746395106752:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 43us (78us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.269585:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210405 00000100:00100000:1.0:1651529335.271942:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.271963:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395107776 00000100:00100000:0.0:1651529335.271975:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210406 00000100:00100000:0.0:1651529335.271976:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1950:41278:x1731746395107776:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:0.0:1651529335.271979:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.271983:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039586f31/0x3234de053c4f572 lrc: 2/0,0 mode: --/PR res: [0x2b375:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8850 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.271988:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b375:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.271992:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.271993:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.271994:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039586f31/0x3234de053c4f572 lrc: 3/0,0 mode: PR/PR res: [0x2b375:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8850 expref: 1951 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.271998:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000039586f31/0x3234de053c4f572 lrc: 3/0,0 mode: PR/PR res: [0x2b375:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8850 expref: 1951 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.272002:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000039586f31, rc 0) 00000100:00100000:0.0:1651529335.272015:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1951:41278:x1731746395107776:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.272018:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210406 00000100:00100000:1.0:1651529335.272692:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.272713:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395108032 00000100:00100000:0.0:1651529335.272724:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210407 00000100:00100000:0.0:1651529335.272725:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1951:41278:x1731746395108032:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:0.0:1651529335.272737:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.272740:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be2303ad/0x3234de053c4f579 lrc: 2/0,0 mode: --/PR res: [0x2b761:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d885e expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.272746:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b761:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.272749:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.272750:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.272751:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be2303ad/0x3234de053c4f579 lrc: 3/0,0 mode: PR/PR res: [0x2b761:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d885e expref: 1952 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.272755:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000be2303ad/0x3234de053c4f579 lrc: 3/0,0 mode: PR/PR res: [0x2b761:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d885e expref: 1952 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.272759:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000be2303ad, rc 0) 00000100:00100000:0.0:1651529335.272772:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1952:41278:x1731746395108032:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 46us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.272775:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210407 00000100:00100000:1.0:1651529335.273241:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.273262:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395108288 00000100:00100000:0.0:1651529335.273273:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210408 00000100:00100000:0.0:1651529335.273275:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1952:41279:x1731746395108288:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:0.0:1651529335.273278:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.273285:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a9f5e78/0x3234de053c4f580 lrc: 2/0,0 mode: --/PR res: [0x2b991:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d886c expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.273290:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b991:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.273293:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.273294:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.273296:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a9f5e78/0x3234de053c4f580 lrc: 3/0,0 mode: PR/PR res: [0x2b991:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d886c expref: 1953 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.273300:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000a9f5e78/0x3234de053c4f580 lrc: 3/0,0 mode: PR/PR res: [0x2b991:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d886c expref: 1953 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.273304:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000a9f5e78, rc 0) 00000100:00100000:0.0:1651529335.273318:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1953:41279:x1731746395108288:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 42us (77us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.273320:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210408 00000100:00100000:1.0:1651529335.274767:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.274788:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395108864 00000100:00100000:0.0:1651529335.274800:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210409 00000100:00100000:0.0:1651529335.274801:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1953:41279:x1731746395108864:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:0.0:1651529335.274805:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.274811:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030404887/0x3234de053c4f587 lrc: 2/0,0 mode: --/PR res: [0x2b776:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d888f expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.274816:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b776:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.274820:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.274820:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.274822:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030404887/0x3234de053c4f587 lrc: 3/0,0 mode: PR/PR res: [0x2b776:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d888f expref: 1954 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.274826:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000030404887/0x3234de053c4f587 lrc: 3/0,0 mode: PR/PR res: [0x2b776:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d888f expref: 1954 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.274830:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000030404887, rc 0) 00000100:00100000:0.0:1651529335.274844:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1954:41279:x1731746395108864:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 42us (78us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.274847:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210409 00000100:00100000:1.0:1651529335.276040:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.276064:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395109376 00000100:00100000:0.0:1651529335.276077:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210410 00000100:00100000:0.0:1651529335.276079:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1954:41279:x1731746395109376:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:0.0:1651529335.276083:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.276087:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7e8011e/0x3234de053c4f58e lrc: 2/0,0 mode: --/PR res: [0x2b5f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d88ab expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.276092:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b5f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.276096:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.276097:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.276099:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7e8011e/0x3234de053c4f58e lrc: 3/0,0 mode: PR/PR res: [0x2b5f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d88ab expref: 1955 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.276103:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a7e8011e/0x3234de053c4f58e lrc: 3/0,0 mode: PR/PR res: [0x2b5f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d88ab expref: 1955 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.276107:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a7e8011e, rc 0) 00000100:00100000:0.0:1651529335.276122:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1955:41279:x1731746395109376:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 42us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.276125:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210410 00000100:00100000:1.0:1651529335.276673:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.276694:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395109760 00000100:00100000:0.0:1651529335.276705:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210411 00000100:00100000:0.0:1651529335.276707:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1955:41278:x1731746395109760:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:0.0:1651529335.276711:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.276714:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f11baf3c/0x3234de053c4f595 lrc: 2/0,0 mode: --/PR res: [0x2b947:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d88c0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.276719:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b947:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.276723:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.276723:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.276725:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f11baf3c/0x3234de053c4f595 lrc: 3/0,0 mode: PR/PR res: [0x2b947:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d88c0 expref: 1956 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.276736:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f11baf3c/0x3234de053c4f595 lrc: 3/0,0 mode: PR/PR res: [0x2b947:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d88c0 expref: 1956 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.276740:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f11baf3c, rc 0) 00000100:00100000:0.0:1651529335.276754:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1956:41278:x1731746395109760:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 47us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.276757:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210411 00000100:00100000:1.0:1651529335.277739:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.277761:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395110208 00000100:00100000:0.0:1651529335.277773:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210412 00000100:00100000:0.0:1651529335.277774:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1956:41279:x1731746395110208:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:0.0:1651529335.277777:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.277781:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085fe1d35/0x3234de053c4f59c lrc: 2/0,0 mode: --/PR res: [0x2b6fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d88dc expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.277786:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b6fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.277789:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.277790:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.277791:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085fe1d35/0x3234de053c4f59c lrc: 3/0,0 mode: PR/PR res: [0x2b6fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d88dc expref: 1957 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.277796:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000085fe1d35/0x3234de053c4f59c lrc: 3/0,0 mode: PR/PR res: [0x2b6fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d88dc expref: 1957 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.277799:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000085fe1d35, rc 0) 00000100:00100000:0.0:1651529335.277813:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1957:41279:x1731746395110208:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.277816:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210412 00000100:00100000:1.0:1651529335.280061:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.280082:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395111104 00000100:00100000:0.0:1651529335.280093:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210413 00000100:00100000:0.0:1651529335.280095:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1957:41279:x1731746395111104:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:0.0:1651529335.280098:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.280106:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066ae2b40/0x3234de053c4f5a3 lrc: 2/0,0 mode: --/PR res: [0x2b4b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8906 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.280111:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b4b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.280114:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.280114:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.280116:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066ae2b40/0x3234de053c4f5a3 lrc: 3/0,0 mode: PR/PR res: [0x2b4b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8906 expref: 1958 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.280120:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000066ae2b40/0x3234de053c4f5a3 lrc: 3/0,0 mode: PR/PR res: [0x2b4b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8906 expref: 1958 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.280124:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000066ae2b40, rc 0) 00000100:00100000:0.0:1651529335.280138:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1958:41279:x1731746395111104:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 43us (78us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.280141:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210413 00000100:00100000:1.0:1651529335.280714:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.280740:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395111488 00000100:00100000:0.0:1651529335.280751:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210414 00000100:00100000:0.0:1651529335.280753:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1958:41279:x1731746395111488:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:0.0:1651529335.280756:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.280760:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004da4611f/0x3234de053c4f5aa lrc: 2/0,0 mode: --/PR res: [0x2b8aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8922 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.280765:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b8aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.280768:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.280769:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.280770:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004da4611f/0x3234de053c4f5aa lrc: 3/0,0 mode: PR/PR res: [0x2b8aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8922 expref: 1959 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.280775:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004da4611f/0x3234de053c4f5aa lrc: 3/0,0 mode: PR/PR res: [0x2b8aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8922 expref: 1959 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.280778:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004da4611f, rc 0) 00000100:00100000:0.0:1651529335.280792:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1959:41279:x1731746395111488:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (78us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.280795:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210414 00000100:00100000:1.0:1651529335.282043:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.282064:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395111936 00000100:00100000:0.0:1651529335.282076:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210415 00000100:00100000:0.0:1651529335.282077:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1959:41279:x1731746395111936:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:0.0:1651529335.282082:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.282085:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e489761b/0x3234de053c4f5b1 lrc: 2/0,0 mode: --/PR res: [0x2b99a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8937 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.282090:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b99a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.282093:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.282094:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.282096:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e489761b/0x3234de053c4f5b1 lrc: 3/0,0 mode: PR/PR res: [0x2b99a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8937 expref: 1960 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.282100:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e489761b/0x3234de053c4f5b1 lrc: 3/0,0 mode: PR/PR res: [0x2b99a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8937 expref: 1960 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.282103:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e489761b, rc 0) 00000100:00100000:0.0:1651529335.282117:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1960:41279:x1731746395111936:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 39us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.282120:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210415 00000100:00100000:1.0:1651529335.283571:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.283592:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395112640 00000100:00100000:0.0:1651529335.283603:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210416 00000100:00100000:0.0:1651529335.283605:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1960:41278:x1731746395112640:12345-10.240.43.64@tcp:101:ll_agl_410261.0 00010000:00010000:0.0:1651529335.283608:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.283612:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010ccc8bd/0x3234de053c4f5b8 lrc: 2/0,0 mode: --/PR res: [0x2b5b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d895a expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.283617:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b5b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.283620:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.283621:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.283622:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010ccc8bd/0x3234de053c4f5b8 lrc: 3/0,0 mode: PR/PR res: [0x2b5b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d895a expref: 1961 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.283626:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000010ccc8bd/0x3234de053c4f5b8 lrc: 3/0,0 mode: PR/PR res: [0x2b5b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d895a expref: 1961 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.283630:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010ccc8bd, rc 0) 00000100:00100000:0.0:1651529335.283644:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1961:41278:x1731746395112640:12345-10.240.43.64@tcp:101:ll_agl_410261.0 Request processed in 38us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.283646:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210416 00000100:00100000:1.0:1651529335.284718:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.284745:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395113152 00000100:00100000:0.0:1651529335.284756:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210417 00000100:00100000:0.0:1651529335.284758:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1961:41279:x1731746395113152:12345-10.240.43.64@tcp:101:ll_agl_410261.0 00010000:00010000:0.0:1651529335.284761:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.284765:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8a5f7a5/0x3234de053c4f5bf lrc: 2/0,0 mode: --/PR res: [0x2baf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8976 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.284769:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2baf1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.284773:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.284773:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.284775:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8a5f7a5/0x3234de053c4f5bf lrc: 3/0,0 mode: PR/PR res: [0x2baf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8976 expref: 1962 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.284779:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f8a5f7a5/0x3234de053c4f5bf lrc: 3/0,0 mode: PR/PR res: [0x2baf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8976 expref: 1962 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.284783:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f8a5f7a5, rc 0) 00000100:00100000:0.0:1651529335.284796:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1962:41279:x1731746395113152:12345-10.240.43.64@tcp:101:ll_agl_410261.0 Request processed in 38us (79us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.284799:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210417 00000100:00100000:1.0:1651529335.285894:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.285915:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395113664 00000100:00100000:0.0:1651529335.285926:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210418 00000100:00100000:0.0:1651529335.285928:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfc79d4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1962:41279:x1731746395113664:12345-10.240.43.64@tcp:101:ll_agl_410261.0 00010000:00010000:0.0:1651529335.285931:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.285934:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026a73983/0x3234de053c4f5c6 lrc: 2/0,0 mode: --/PR res: [0x2b555:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8992 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.285940:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b555:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.285943:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.285944:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.285945:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026a73983/0x3234de053c4f5c6 lrc: 3/0,0 mode: PR/PR res: [0x2b555:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8992 expref: 1963 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.285949:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000026a73983/0x3234de053c4f5c6 lrc: 3/0,0 mode: PR/PR res: [0x2b555:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8992 expref: 1963 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.285953:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000026a73983, rc 0) 00000100:00100000:0.0:1651529335.285967:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfc79d4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1963:41279:x1731746395113664:12345-10.240.43.64@tcp:101:ll_agl_410261.0 Request processed in 38us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.285969:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210418 00000100:00100000:1.0:1651529335.286448:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.286469:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395113920 00000100:00100000:0.0:1651529335.286480:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210419 00000100:00100000:0.0:1651529335.286482:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005914c920 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1963:41279:x1731746395113920:12345-10.240.43.64@tcp:101:ll_agl_410261.0 00010000:00010000:0.0:1651529335.286486:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.286490:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c961580f/0x3234de053c4f5cd lrc: 2/0,0 mode: --/PR res: [0x2b970:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d89a0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.286494:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b970:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.286498:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.286498:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.286500:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c961580f/0x3234de053c4f5cd lrc: 3/0,0 mode: PR/PR res: [0x2b970:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89a0 expref: 1964 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.286504:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c961580f/0x3234de053c4f5cd lrc: 3/0,0 mode: PR/PR res: [0x2b970:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89a0 expref: 1964 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.286508:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c961580f, rc 0) 00000100:00100000:0.0:1651529335.286521:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005914c920 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1964:41279:x1731746395113920:12345-10.240.43.64@tcp:101:ll_agl_410261.0 Request processed in 39us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.286524:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210419 00000100:00100000:1.0:1651529335.287540:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.287561:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395114432 00000100:00100000:0.0:1651529335.287572:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210420 00000100:00100000:0.0:1651529335.287574:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007fca8239 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1964:41279:x1731746395114432:12345-10.240.43.64@tcp:101:ll_agl_410261.0 00010000:00010000:0.0:1651529335.287577:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.287581:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0b79fe8/0x3234de053c4f5d4 lrc: 2/0,0 mode: --/PR res: [0x2b60f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d89bc expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.287585:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b60f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.287589:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.287590:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.287592:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0b79fe8/0x3234de053c4f5d4 lrc: 3/0,0 mode: PR/PR res: [0x2b60f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89bc expref: 1965 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.287596:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f0b79fe8/0x3234de053c4f5d4 lrc: 3/0,0 mode: PR/PR res: [0x2b60f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89bc expref: 1965 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.287600:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f0b79fe8, rc 0) 00000100:00100000:0.0:1651529335.287613:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007fca8239 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1965:41279:x1731746395114432:12345-10.240.43.64@tcp:101:ll_agl_410261.0 Request processed in 38us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.287616:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210420 00000100:00100000:1.0:1651529335.288188:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.288209:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395114688 00000100:00100000:0.0:1651529335.288220:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210421 00000100:00100000:0.0:1651529335.288231:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ea32140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1965:41278:x1731746395114688:12345-10.240.43.64@tcp:101:ll_agl_410261.0 00010000:00010000:0.0:1651529335.288234:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.288238:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010b94550/0x3234de053c4f5db lrc: 2/0,0 mode: --/PR res: [0x2b960:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d89ca expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.288243:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b960:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.288247:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.288247:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.288249:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010b94550/0x3234de053c4f5db lrc: 3/0,0 mode: PR/PR res: [0x2b960:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89ca expref: 1966 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.288253:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000010b94550/0x3234de053c4f5db lrc: 3/0,0 mode: PR/PR res: [0x2b960:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89ca expref: 1966 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.288257:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000010b94550, rc 0) 00000100:00100000:0.0:1651529335.288271:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ea32140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1966:41278:x1731746395114688:12345-10.240.43.64@tcp:101:ll_agl_410261.0 Request processed in 48us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.288273:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210421 00000100:00100000:1.0:1651529335.289299:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.289320:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395115200 00000100:00100000:0.0:1651529335.289331:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210422 00000100:00100000:0.0:1651529335.289333:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1966:41279:x1731746395115200:12345-10.240.43.64@tcp:101:ll_agl_410261.0 00010000:00010000:0.0:1651529335.289336:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.289340:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089734d80/0x3234de053c4f5e2 lrc: 2/0,0 mode: --/PR res: [0x2b87a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d89e6 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.289344:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b87a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.289348:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.289348:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.289350:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089734d80/0x3234de053c4f5e2 lrc: 3/0,0 mode: PR/PR res: [0x2b87a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89e6 expref: 1967 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.289354:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000089734d80/0x3234de053c4f5e2 lrc: 3/0,0 mode: PR/PR res: [0x2b87a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89e6 expref: 1967 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.289358:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000089734d80, rc 0) 00000100:00100000:0.0:1651529335.289371:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1967:41279:x1731746395115200:12345-10.240.43.64@tcp:101:ll_agl_410261.0 Request processed in 37us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.289374:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210422 00000100:00100000:1.0:1651529335.289877:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.289897:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395115456 00000100:00100000:0.0:1651529335.289909:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210423 00000100:00100000:0.0:1651529335.289910:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1967:41279:x1731746395115456:12345-10.240.43.64@tcp:101:ll_agl_410261.0 00010000:00010000:0.0:1651529335.289914:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.289921:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004616f2ef/0x3234de053c4f5e9 lrc: 2/0,0 mode: --/PR res: [0x2b70a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d89f4 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.289926:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b70a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.289929:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.289930:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.289931:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004616f2ef/0x3234de053c4f5e9 lrc: 3/0,0 mode: PR/PR res: [0x2b70a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89f4 expref: 1968 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.289935:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004616f2ef/0x3234de053c4f5e9 lrc: 3/0,0 mode: PR/PR res: [0x2b70a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89f4 expref: 1968 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.289939:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004616f2ef, rc 0) 00000100:00100000:0.0:1651529335.289953:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1968:41279:x1731746395115456:12345-10.240.43.64@tcp:101:ll_agl_410261.0 Request processed in 42us (77us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.289956:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210423 00000100:00100000:1.0:1651529335.291571:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.291590:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395116224 00000100:00100000:0.0:1651529335.291605:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210424 00000100:00100000:0.0:1651529335.291607:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1968:41279:x1731746395116224:12345-10.240.43.64@tcp:101:ll_agl_410261.0 00010000:00010000:0.0:1651529335.291610:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.291615:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc3a3cef/0x3234de053c4f5f0 lrc: 2/0,0 mode: --/PR res: [0x2b91e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8a1e expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.291620:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b91e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.291624:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.291624:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.291626:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc3a3cef/0x3234de053c4f5f0 lrc: 3/0,0 mode: PR/PR res: [0x2b91e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a1e expref: 1969 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.291631:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fc3a3cef/0x3234de053c4f5f0 lrc: 3/0,0 mode: PR/PR res: [0x2b91e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a1e expref: 1969 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.291634:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fc3a3cef, rc 0) 00000100:00100000:0.0:1651529335.291649:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1969:41279:x1731746395116224:12345-10.240.43.64@tcp:101:ll_agl_410261.0 Request processed in 42us (79us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.291652:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210424 00000100:00100000:1.0:1651529335.292698:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.292715:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395116736 00000100:00100000:0.0:1651529335.292728:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210425 00000100:00100000:0.0:1651529335.292736:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1969:41279:x1731746395116736:12345-10.240.43.64@tcp:101:ll_agl_410261.0 00010000:00010000:0.0:1651529335.292739:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.292743:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c4f5f7 lrc: 2/0,0 mode: --/PR res: [0x2b533:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8a3a expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.292748:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b533:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.292751:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.292752:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.292754:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c4f5f7 lrc: 3/0,0 mode: PR/PR res: [0x2b533:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a3a expref: 1970 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.292758:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c4f5f7 lrc: 3/0,0 mode: PR/PR res: [0x2b533:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a3a expref: 1970 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.292761:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008f8dd346, rc 0) 00000100:00100000:0.0:1651529335.292776:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1970:41279:x1731746395116736:12345-10.240.43.64@tcp:101:ll_agl_410261.0 Request processed in 45us (78us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.292778:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210425 00000100:00100000:1.0:1651529335.295138:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.295155:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395117696 00000100:00100000:0.0:1651529335.295168:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210426 00000100:00100000:0.0:1651529335.295169:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1970:41279:x1731746395117696:12345-10.240.43.64@tcp:101:ll_agl_410261.0 00010000:00010000:0.0:1651529335.295173:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.295176:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c4f5fe lrc: 2/0,0 mode: --/PR res: [0x2b511:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8a72 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.295181:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b511:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.295185:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.295185:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.295187:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c4f5fe lrc: 3/0,0 mode: PR/PR res: [0x2b511:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a72 expref: 1971 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.295191:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c4f5fe lrc: 3/0,0 mode: PR/PR res: [0x2b511:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a72 expref: 1971 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.295195:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000092d9e682, rc 0) 00000100:00100000:0.0:1651529335.295209:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1971:41279:x1731746395117696:12345-10.240.43.64@tcp:101:ll_agl_410261.0 Request processed in 39us (71us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.295211:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210426 00000100:00100000:1.0:1651529335.297037:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.297056:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395118400 00000100:00100000:0.0:1651529335.297069:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210427 00000100:00100000:0.0:1651529335.297071:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1971:41279:x1731746395118400:12345-10.240.43.64@tcp:101:ll_agl_410261.0 00010000:00010000:0.0:1651529335.297075:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.297079:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c4f605 lrc: 2/0,0 mode: --/PR res: [0x2b540:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8a9c expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.297084:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b540:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.297087:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.297088:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.297090:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c4f605 lrc: 3/0,0 mode: PR/PR res: [0x2b540:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a9c expref: 1972 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.297094:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c4f605 lrc: 3/0,0 mode: PR/PR res: [0x2b540:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a9c expref: 1972 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.297098:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000009bc967c, rc 0) 00000100:00100000:0.0:1651529335.297111:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1972:41279:x1731746395118400:12345-10.240.43.64@tcp:101:ll_agl_410261.0 Request processed in 39us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.297114:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210427 00000100:00100000:1.0:1651529335.299342:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.299358:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395119424 00000100:00100000:0.0:1651529335.299370:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210428 00000100:00100000:0.0:1651529335.299372:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1972:41279:x1731746395119424:12345-10.240.43.64@tcp:101:ll_agl_410261.0 00010000:00010000:0.0:1651529335.299375:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.299379:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7ddedfd/0x3234de053c4f60c lrc: 2/0,0 mode: --/PR res: [0x2b7b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8ad4 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.299384:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b7b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.299388:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.299389:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.299390:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7ddedfd/0x3234de053c4f60c lrc: 3/0,0 mode: PR/PR res: [0x2b7b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ad4 expref: 1973 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.299394:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a7ddedfd/0x3234de053c4f60c lrc: 3/0,0 mode: PR/PR res: [0x2b7b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ad4 expref: 1973 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.299398:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a7ddedfd, rc 0) 00000100:00100000:0.0:1651529335.299412:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1973:41279:x1731746395119424:12345-10.240.43.64@tcp:101:ll_agl_410261.0 Request processed in 39us (71us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.299414:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210428 00000100:00100000:1.0:1651529335.300485:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.300506:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395119936 00000100:00100000:0.0:1651529335.300518:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210429 00000100:00100000:0.0:1651529335.300519:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1973:41279:x1731746395119936:12345-10.240.43.64@tcp:101:ll_agl_410261.0 00010000:00010000:0.0:1651529335.300523:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.300530:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c4f613 lrc: 2/0,0 mode: --/PR res: [0x2b35c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8af0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.300535:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b35c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.300538:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.300539:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.300540:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c4f613 lrc: 3/0,0 mode: PR/PR res: [0x2b35c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8af0 expref: 1974 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.300545:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c4f613 lrc: 3/0,0 mode: PR/PR res: [0x2b35c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8af0 expref: 1974 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.300548:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003a73c8ff, rc 0) 00000100:00100000:0.0:1651529335.300563:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1974:41279:x1731746395119936:12345-10.240.43.64@tcp:101:ll_agl_410261.0 Request processed in 42us (78us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.300565:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210429 00000100:00100000:1.0:1651529335.301610:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.301631:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395120448 00000100:00100000:0.0:1651529335.301642:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210430 00000100:00100000:0.0:1651529335.301644:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1974:41279:x1731746395120448:12345-10.240.43.64@tcp:101:ll_agl_410261.0 00010000:00010000:0.0:1651529335.301647:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.301651:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c4f61a lrc: 2/0,0 mode: --/PR res: [0x2b541:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8b0c expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.301656:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b541:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.301659:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.301659:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.301661:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c4f61a lrc: 3/0,0 mode: PR/PR res: [0x2b541:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b0c expref: 1975 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.301665:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c4f61a lrc: 3/0,0 mode: PR/PR res: [0x2b541:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b0c expref: 1975 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.301669:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008cc70fcd, rc 0) 00000100:00100000:0.0:1651529335.301682:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1975:41279:x1731746395120448:12345-10.240.43.64@tcp:101:ll_agl_410261.0 Request processed in 38us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.301685:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210430 00000100:00100000:1.0:1651529335.303987:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.304004:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395121472 00000100:00100000:0.0:1651529335.304017:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210431 00000100:00100000:0.0:1651529335.304018:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1975:41279:x1731746395121472:12345-10.240.43.64@tcp:101:ll_agl_410261.0 00010000:00010000:0.0:1651529335.304023:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.304026:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c4f621 lrc: 2/0,0 mode: --/PR res: [0x2b385:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8b44 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.304031:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b385:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.304035:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.304036:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.304037:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c4f621 lrc: 3/0,0 mode: PR/PR res: [0x2b385:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b44 expref: 1976 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.304041:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c4f621 lrc: 3/0,0 mode: PR/PR res: [0x2b385:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b44 expref: 1976 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.304045:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054065c33, rc 0) 00000100:00100000:0.0:1651529335.304059:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1976:41279:x1731746395121472:12345-10.240.43.64@tcp:101:ll_agl_410261.0 Request processed in 39us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.304061:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210431 00000100:00100000:1.0:1651529335.305152:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.305169:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395121984 00000100:00100000:0.0:1651529335.305181:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210432 00000100:00100000:0.0:1651529335.305183:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000098b3c8df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1976:41279:x1731746395121984:12345-10.240.43.64@tcp:101:ll_agl_410261.0 00010000:00010000:0.0:1651529335.305186:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.305189:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c4f628 lrc: 2/0,0 mode: --/PR res: [0x2b4a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8b60 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.305194:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b4a0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.305197:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.305198:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.305200:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c4f628 lrc: 3/0,0 mode: PR/PR res: [0x2b4a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b60 expref: 1977 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.305204:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c4f628 lrc: 3/0,0 mode: PR/PR res: [0x2b4a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b60 expref: 1977 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.305208:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000356aa683, rc 0) 00000100:00100000:0.0:1651529335.305230:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000098b3c8df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1977:41279:x1731746395121984:12345-10.240.43.64@tcp:101:ll_agl_410261.0 Request processed in 38us (70us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.305233:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210432 00000100:00100000:1.0:1651529335.306139:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.306156:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395122368 00000100:00100000:0.0:1651529335.306168:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210433 00000100:00100000:0.0:1651529335.306170:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1977:41279:x1731746395122368:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:0.0:1651529335.306173:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.306176:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c4f62f lrc: 2/0,0 mode: --/PR res: [0x2b4f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8b7c expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.306181:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b4f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.306185:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.306186:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.306187:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c4f62f lrc: 3/0,0 mode: PR/PR res: [0x2b4f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b7c expref: 1978 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.306191:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c4f62f lrc: 3/0,0 mode: PR/PR res: [0x2b4f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b7c expref: 1978 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.306195:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009ad9989c, rc 0) 00000100:00100000:0.0:1651529335.306209:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1978:41279:x1731746395122368:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 39us (70us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.306212:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210433 00000100:00100000:1.0:1651529335.307605:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.307622:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395122944 00000100:00100000:0.0:1651529335.307634:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210434 00000100:00100000:0.0:1651529335.307636:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1978:41278:x1731746395122944:12345-10.240.43.64@tcp:101:ll_agl_410261.0 00010000:00010000:0.0:1651529335.307639:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.307643:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c4f636 lrc: 2/0,0 mode: --/PR res: [0x2b577:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8b98 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.307648:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b577:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.307651:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.307652:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.307654:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c4f636 lrc: 3/0,0 mode: PR/PR res: [0x2b577:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b98 expref: 1979 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.307658:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c4f636 lrc: 3/0,0 mode: PR/PR res: [0x2b577:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b98 expref: 1979 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.307662:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000017857b04, rc 0) 00000100:00100000:0.0:1651529335.307675:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1979:41278:x1731746395122944:12345-10.240.43.64@tcp:101:ll_agl_410261.0 Request processed in 38us (70us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.307678:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210434 00000100:00100000:1.0:1651529335.308045:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.308062:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395123072 00000100:00100000:0.0:1651529335.308074:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210435 00000100:00100000:0.0:1651529335.308075:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1979:41279:x1731746395123072:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:0.0:1651529335.308080:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.308083:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c4f63d lrc: 2/0,0 mode: --/PR res: [0x2b475:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8b9f expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.308088:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b475:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.308092:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.308092:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.308094:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c4f63d lrc: 3/0,0 mode: PR/PR res: [0x2b475:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b9f expref: 1980 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.308098:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c4f63d lrc: 3/0,0 mode: PR/PR res: [0x2b475:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b9f expref: 1980 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.308102:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d44dd5ea, rc 0) 00000100:00100000:0.0:1651529335.308115:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1980:41279:x1731746395123072:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 39us (70us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.308118:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210435 00000100:00100000:1.0:1651529335.309693:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.309715:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395123520 00000100:00100000:0.0:1651529335.309726:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210436 00000100:00100000:0.0:1651529335.309728:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1980:41279:x1731746395123520:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:0.0:1651529335.309739:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.309743:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c4f644 lrc: 2/0,0 mode: --/PR res: [0x2b596:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8bbb expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.309748:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b596:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.309751:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.309752:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.309754:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c4f644 lrc: 3/0,0 mode: PR/PR res: [0x2b596:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8bbb expref: 1981 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.309758:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c4f644 lrc: 3/0,0 mode: PR/PR res: [0x2b596:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8bbb expref: 1981 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.309761:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000048b51e47, rc 0) 00000100:00100000:0.0:1651529335.309775:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1981:41279:x1731746395123520:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 47us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.309778:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210436 00000100:00100000:1.0:1651529335.311636:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.311655:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395124416 00000100:00100000:0.0:1651529335.311667:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210437 00000100:00100000:0.0:1651529335.311668:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1981:41279:x1731746395124416:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:0.0:1651529335.311672:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.311682:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c4f64b lrc: 2/0,0 mode: --/PR res: [0x2b524:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8bec expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.311687:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b524:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.311690:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.311691:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.311693:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c4f64b lrc: 3/0,0 mode: PR/PR res: [0x2b524:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8bec expref: 1982 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.311697:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c4f64b lrc: 3/0,0 mode: PR/PR res: [0x2b524:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8bec expref: 1982 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.311700:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005d39750f, rc 0) 00000100:00100000:0.0:1651529335.311715:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1982:41279:x1731746395124416:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 46us (80us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.311718:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210437 00000100:00100000:1.0:1651529335.312665:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.312687:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395124800 00000100:00100000:0.0:1651529335.312698:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210438 00000100:00100000:0.0:1651529335.312700:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1982:41278:x1731746395124800:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:0.0:1651529335.312703:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.312707:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072a160c0/0x3234de053c4f652 lrc: 2/0,0 mode: --/PR res: [0x2b874:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8c08 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.312712:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b874:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.312715:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.312716:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.312717:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072a160c0/0x3234de053c4f652 lrc: 3/0,0 mode: PR/PR res: [0x2b874:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c08 expref: 1983 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.312721:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000072a160c0/0x3234de053c4f652 lrc: 3/0,0 mode: PR/PR res: [0x2b874:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c08 expref: 1983 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.312725:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000072a160c0, rc 0) 00000100:00100000:0.0:1651529335.312747:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1983:41278:x1731746395124800:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 46us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.312750:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210438 00000100:00100000:1.0:1651529335.314006:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.314023:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395125376 00000100:00100000:0.0:1651529335.314035:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210439 00000100:00100000:0.0:1651529335.314037:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1983:41278:x1731746395125376:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:0.0:1651529335.314041:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.314045:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c9dd8e6/0x3234de053c4f659 lrc: 2/0,0 mode: --/PR res: [0x2b68b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8c24 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.314050:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b68b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.314053:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.314054:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.314055:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c9dd8e6/0x3234de053c4f659 lrc: 3/0,0 mode: PR/PR res: [0x2b68b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c24 expref: 1984 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.314059:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006c9dd8e6/0x3234de053c4f659 lrc: 3/0,0 mode: PR/PR res: [0x2b68b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c24 expref: 1984 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.314063:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006c9dd8e6, rc 0) 00000100:00100000:0.0:1651529335.314076:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1984:41278:x1731746395125376:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 39us (71us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.314079:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210439 00000100:00100000:1.0:1651529335.314436:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.314446:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395125568 00000100:00100000:0.0:1651529335.314458:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210440 00000100:00100000:0.0:1651529335.314460:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1984:41279:x1731746395125568:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:0.0:1651529335.314463:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.314467:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001127aa81/0x3234de053c4f660 lrc: 2/0,0 mode: --/PR res: [0x2b89a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8c32 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.314472:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b89a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.314475:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.314476:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.314477:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001127aa81/0x3234de053c4f660 lrc: 3/0,0 mode: PR/PR res: [0x2b89a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c32 expref: 1985 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.314481:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001127aa81/0x3234de053c4f660 lrc: 3/0,0 mode: PR/PR res: [0x2b89a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c32 expref: 1985 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.314485:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001127aa81, rc 0) 00000100:00100000:0.0:1651529335.314498:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1985:41279:x1731746395125568:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (63us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.314501:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210440 00000100:00100000:1.0:1651529335.315698:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.315715:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395125952 00000100:00100000:0.0:1651529335.315727:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210441 00000100:00100000:0.0:1651529335.315729:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1985:41279:x1731746395125952:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:0.0:1651529335.315738:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.315742:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096ef4f27/0x3234de053c4f667 lrc: 2/0,0 mode: --/PR res: [0x2b99c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8c47 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.315747:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b99c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.315750:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.315751:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.315752:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096ef4f27/0x3234de053c4f667 lrc: 3/0,0 mode: PR/PR res: [0x2b99c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c47 expref: 1986 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.315756:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000096ef4f27/0x3234de053c4f667 lrc: 3/0,0 mode: PR/PR res: [0x2b99c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c47 expref: 1986 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.315760:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000096ef4f27, rc 0) 00000100:00100000:0.0:1651529335.315774:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1986:41279:x1731746395125952:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 45us (76us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.315777:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210441 00000100:00100000:1.0:1651529335.317670:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.317686:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395126848 00000100:00100000:0.0:1651529335.317699:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210442 00000100:00100000:0.0:1651529335.317700:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1986:41278:x1731746395126848:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:0.0:1651529335.317703:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.317707:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2bf14b4/0x3234de053c4f66e lrc: 2/0,0 mode: --/PR res: [0x2b716:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8c78 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.317712:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b716:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.317716:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.317716:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.317718:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2bf14b4/0x3234de053c4f66e lrc: 3/0,0 mode: PR/PR res: [0x2b716:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c78 expref: 1987 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.317722:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c2bf14b4/0x3234de053c4f66e lrc: 3/0,0 mode: PR/PR res: [0x2b716:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c78 expref: 1987 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.317726:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c2bf14b4, rc 0) 00000100:00100000:0.0:1651529335.317748:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1987:41278:x1731746395126848:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 46us (78us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.317750:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210442 00000100:00100000:1.0:1651529335.318148:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.318164:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395127104 00000100:00100000:0.0:1651529335.318176:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210443 00000100:00100000:0.0:1651529335.318177:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1987:41278:x1731746395127104:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:0.0:1651529335.318182:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.318186:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000cc6b103/0x3234de053c4f675 lrc: 2/0,0 mode: --/PR res: [0x2b8d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8c86 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.318190:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b8d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.318194:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.318194:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.318196:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000cc6b103/0x3234de053c4f675 lrc: 3/0,0 mode: PR/PR res: [0x2b8d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c86 expref: 1988 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.318200:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000cc6b103/0x3234de053c4f675 lrc: 3/0,0 mode: PR/PR res: [0x2b8d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c86 expref: 1988 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.318203:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000cc6b103, rc 0) 00000100:00100000:0.0:1651529335.318217:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1988:41278:x1731746395127104:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 39us (70us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.318220:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210443 00000100:00100000:1.0:1651529335.320336:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.320357:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395128064 00000100:00100000:0.0:1651529335.320368:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210444 00000100:00100000:0.0:1651529335.320369:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1988:41278:x1731746395128064:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:0.0:1651529335.320373:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.320376:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074d971f4/0x3234de053c4f67c lrc: 2/0,0 mode: --/PR res: [0x2b807:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8cbe expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.320381:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b807:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.320384:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.320385:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.320387:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074d971f4/0x3234de053c4f67c lrc: 3/0,0 mode: PR/PR res: [0x2b807:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8cbe expref: 1989 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.320391:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000074d971f4/0x3234de053c4f67c lrc: 3/0,0 mode: PR/PR res: [0x2b807:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8cbe expref: 1989 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.320395:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000074d971f4, rc 0) 00000100:00100000:0.0:1651529335.320408:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1989:41278:x1731746395128064:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.320411:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210444 00000100:00100000:1.0:1651529335.320771:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.320788:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395128320 00000100:00100000:0.0:1651529335.320799:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210445 00000100:00100000:0.0:1651529335.320801:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1989:41279:x1731746395128320:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:0.0:1651529335.320804:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.320812:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db5d109d/0x3234de053c4f683 lrc: 2/0,0 mode: --/PR res: [0x2b8c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8ccc expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.320817:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b8c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.320821:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.320821:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.320823:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db5d109d/0x3234de053c4f683 lrc: 3/0,0 mode: PR/PR res: [0x2b8c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ccc expref: 1990 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.320827:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000db5d109d/0x3234de053c4f683 lrc: 3/0,0 mode: PR/PR res: [0x2b8c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ccc expref: 1990 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.320831:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000db5d109d, rc 0) 00000100:00100000:0.0:1651529335.320845:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1990:41279:x1731746395128320:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 43us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.320848:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210445 00000100:00100000:1.0:1651529335.321607:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.321627:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395128768 00000100:00100000:0.0:1651529335.321638:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210446 00000100:00100000:0.0:1651529335.321640:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1990:41279:x1731746395128768:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:0.0:1651529335.321643:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.321646:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003330d891/0x3234de053c4f68a lrc: 2/0,0 mode: --/PR res: [0x2b758:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8ce8 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.321651:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b758:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.321655:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.321655:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.321657:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003330d891/0x3234de053c4f68a lrc: 3/0,0 mode: PR/PR res: [0x2b758:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ce8 expref: 1991 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.321661:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003330d891/0x3234de053c4f68a lrc: 3/0,0 mode: PR/PR res: [0x2b758:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ce8 expref: 1991 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.321664:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003330d891, rc 0) 00000100:00100000:0.0:1651529335.321678:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1991:41279:x1731746395128768:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.321681:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210446 00000100:00100000:1.0:1651529335.322152:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.322172:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395129024 00000100:00100000:0.0:1651529335.322183:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210447 00000100:00100000:0.0:1651529335.322185:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1991:41279:x1731746395129024:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:0.0:1651529335.322189:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.322193:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b00577e/0x3234de053c4f691 lrc: 2/0,0 mode: --/PR res: [0x2b3b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8cf6 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.322198:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b3b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.322201:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.322202:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.322203:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b00577e/0x3234de053c4f691 lrc: 3/0,0 mode: PR/PR res: [0x2b3b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8cf6 expref: 1992 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.322207:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004b00577e/0x3234de053c4f691 lrc: 3/0,0 mode: PR/PR res: [0x2b3b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8cf6 expref: 1992 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.322211:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004b00577e, rc 0) 00000100:00100000:0.0:1651529335.322234:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1992:41279:x1731746395129024:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 49us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.322237:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210447 00000100:00100000:1.0:1651529335.323117:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.323139:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395129280 00000100:00100000:0.0:1651529335.323150:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210448 00000100:00100000:0.0:1651529335.323152:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1992:41278:x1731746395129280:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:0.0:1651529335.323155:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.323159:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093685f3b/0x3234de053c4f698 lrc: 2/0,0 mode: --/PR res: [0x2b6e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8d04 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.323164:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b6e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.323167:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.323168:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.323169:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093685f3b/0x3234de053c4f698 lrc: 3/0,0 mode: PR/PR res: [0x2b6e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d04 expref: 1993 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.323174:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000093685f3b/0x3234de053c4f698 lrc: 3/0,0 mode: PR/PR res: [0x2b6e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d04 expref: 1993 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.323177:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000093685f3b, rc 0) 00000100:00100000:0.0:1651529335.323191:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1993:41278:x1731746395129280:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.323193:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210448 00000100:00100000:1.0:1651529335.325459:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.325476:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395130496 00000100:00100000:0.0:1651529335.325488:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210449 00000100:00100000:0.0:1651529335.325489:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1993:41278:x1731746395130496:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:0.0:1651529335.325493:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.325496:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b6f07f6/0x3234de053c4f69f lrc: 2/0,0 mode: --/PR res: [0x2b4b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8d4a expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.325501:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b4b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.325504:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.325505:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.325507:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b6f07f6/0x3234de053c4f69f lrc: 3/0,0 mode: PR/PR res: [0x2b4b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d4a expref: 1994 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.325511:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006b6f07f6/0x3234de053c4f69f lrc: 3/0,0 mode: PR/PR res: [0x2b4b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d4a expref: 1994 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.325514:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006b6f07f6, rc 0) 00000100:00100000:0.0:1651529335.325528:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1994:41278:x1731746395130496:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (69us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.325531:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210449 00000100:00100000:1.0:1651529335.327188:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.327204:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395131200 00000100:00100000:0.0:1651529335.327216:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210450 00000100:00100000:0.0:1651529335.327218:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1994:41278:x1731746395131200:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:0.0:1651529335.327231:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.327240:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ea2468b/0x3234de053c4f6a6 lrc: 2/0,0 mode: --/PR res: [0x2ba26:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8d74 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.327246:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2ba26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.327249:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.327250:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.327251:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ea2468b/0x3234de053c4f6a6 lrc: 3/0,0 mode: PR/PR res: [0x2ba26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d74 expref: 1995 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.327256:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004ea2468b/0x3234de053c4f6a6 lrc: 3/0,0 mode: PR/PR res: [0x2ba26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d74 expref: 1995 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.327259:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004ea2468b, rc 0) 00000100:00100000:0.0:1651529335.327273:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1995:41278:x1731746395131200:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 54us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.327276:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210450 00000100:00100000:1.0:1651529335.327642:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.327659:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395131392 00000100:00100000:0.0:1651529335.327671:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210451 00000100:00100000:0.0:1651529335.327672:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1995:41279:x1731746395131392:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:0.0:1651529335.327677:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.327683:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005bc4e419/0x3234de053c4f6ad lrc: 2/0,0 mode: --/PR res: [0x2b6c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8d82 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.327688:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b6c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.327691:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.327692:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.327694:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005bc4e419/0x3234de053c4f6ad lrc: 3/0,0 mode: PR/PR res: [0x2b6c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d82 expref: 1996 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.327698:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005bc4e419/0x3234de053c4f6ad lrc: 3/0,0 mode: PR/PR res: [0x2b6c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d82 expref: 1996 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.327702:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005bc4e419, rc 0) 00000100:00100000:0.0:1651529335.327715:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1996:41279:x1731746395131392:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 42us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.327718:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210451 00000100:00100000:1.0:1651529335.328399:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.328415:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395131712 00000100:00100000:0.0:1651529335.328426:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210452 00000100:00100000:0.0:1651529335.328428:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1996:41278:x1731746395131712:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:0.0:1651529335.328431:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.328435:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a2d126a/0x3234de053c4f6b4 lrc: 2/0,0 mode: --/PR res: [0x2b484:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8d90 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.328440:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b484:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.328443:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.328444:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.328445:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a2d126a/0x3234de053c4f6b4 lrc: 3/0,0 mode: PR/PR res: [0x2b484:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d90 expref: 1997 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.328450:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000a2d126a/0x3234de053c4f6b4 lrc: 3/0,0 mode: PR/PR res: [0x2b484:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d90 expref: 1997 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.328453:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000a2d126a, rc 0) 00000100:00100000:0.0:1651529335.328467:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1997:41278:x1731746395131712:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (69us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.328470:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210452 00000100:00100000:1.0:1651529335.329485:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.329502:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395132224 00000100:00100000:0.0:1651529335.329514:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210453 00000100:00100000:0.0:1651529335.329515:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1997:41278:x1731746395132224:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:0.0:1651529335.329518:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.329522:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001663c068/0x3234de053c4f6bb lrc: 2/0,0 mode: --/PR res: [0x2ba45:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8dac expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.329527:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2ba45:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.329530:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.329531:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.329533:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001663c068/0x3234de053c4f6bb lrc: 3/0,0 mode: PR/PR res: [0x2ba45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8dac expref: 1998 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.329537:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001663c068/0x3234de053c4f6bb lrc: 3/0,0 mode: PR/PR res: [0x2ba45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8dac expref: 1998 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.329540:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001663c068, rc 0) 00000100:00100000:0.0:1651529335.329554:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1998:41278:x1731746395132224:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (69us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.329557:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210453 00000100:00100000:1.0:1651529335.330123:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.330139:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395132480 00000100:00100000:0.0:1651529335.330151:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210454 00000100:00100000:0.0:1651529335.330153:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1998:41279:x1731746395132480:12345-10.240.43.64@tcp:101:ll_agl_410261.0 00010000:00010000:0.0:1651529335.330156:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.330159:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d4f86f7/0x3234de053c4f6c2 lrc: 2/0,0 mode: --/PR res: [0x2b853:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8dba expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.330164:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b853:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.330168:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.330168:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.330170:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d4f86f7/0x3234de053c4f6c2 lrc: 3/0,0 mode: PR/PR res: [0x2b853:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8dba expref: 1999 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.330174:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005d4f86f7/0x3234de053c4f6c2 lrc: 3/0,0 mode: PR/PR res: [0x2b853:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8dba expref: 1999 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.330178:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005d4f86f7, rc 0) 00000100:00100000:0.0:1651529335.330191:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1999:41279:x1731746395132480:12345-10.240.43.64@tcp:101:ll_agl_410261.0 Request processed in 37us (68us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.330194:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210454 00000100:00100000:1.0:1651529335.331218:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.331258:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395132992 00000100:00100000:0.0:1651529335.331267:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210455 00000100:00100000:0.0:1651529335.331269:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1999:41279:x1731746395132992:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:0.0:1651529335.331274:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.331277:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac93cd8e/0x3234de053c4f6c9 lrc: 2/0,0 mode: --/PR res: [0x2b501:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8dd6 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.331282:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b501:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.331285:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.331286:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.331287:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac93cd8e/0x3234de053c4f6c9 lrc: 3/0,0 mode: PR/PR res: [0x2b501:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8dd6 expref: 2000 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.331291:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ac93cd8e/0x3234de053c4f6c9 lrc: 3/0,0 mode: PR/PR res: [0x2b501:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8dd6 expref: 2000 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.331295:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ac93cd8e, rc 0) 00000100:00100000:0.0:1651529335.331309:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2000:41279:x1731746395132992:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 39us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.331311:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210455 00000100:00100000:1.0:1651529335.331767:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.331784:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395133248 00000100:00100000:0.0:1651529335.331796:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210456 00000100:00100000:0.0:1651529335.331798:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2000:41279:x1731746395133248:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:0.0:1651529335.331801:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.331804:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007104861f/0x3234de053c4f6d0 lrc: 2/0,0 mode: --/PR res: [0x2b7bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8de4 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.331809:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b7bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.331813:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.331813:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.331815:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007104861f/0x3234de053c4f6d0 lrc: 3/0,0 mode: PR/PR res: [0x2b7bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8de4 expref: 2001 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.331819:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007104861f/0x3234de053c4f6d0 lrc: 3/0,0 mode: PR/PR res: [0x2b7bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8de4 expref: 2001 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.331823:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007104861f, rc 0) 00000100:00100000:0.0:1651529335.331836:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2001:41279:x1731746395133248:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (70us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.331839:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210456 00000100:00100000:1.0:1651529335.333353:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.333374:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395133888 00000100:00100000:0.0:1651529335.333385:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210457 00000100:00100000:0.0:1651529335.333387:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2001:41278:x1731746395133888:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:0.0:1651529335.333390:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.333393:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009203d64e/0x3234de053c4f6d7 lrc: 2/0,0 mode: --/PR res: [0x2b61b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8e07 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.333399:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b61b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.333402:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.333403:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.333404:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009203d64e/0x3234de053c4f6d7 lrc: 3/0,0 mode: PR/PR res: [0x2b61b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8e07 expref: 2002 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.333408:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009203d64e/0x3234de053c4f6d7 lrc: 3/0,0 mode: PR/PR res: [0x2b61b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8e07 expref: 2002 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.333412:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009203d64e, rc 0) 00000100:00100000:0.0:1651529335.333426:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2002:41278:x1731746395133888:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.333429:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210457 00000100:00100000:1.0:1651529335.333723:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.333748:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395133952 00000100:00100000:0.0:1651529335.333759:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210458 00000100:00100000:0.0:1651529335.333761:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2002:41279:x1731746395133952:12345-10.240.43.64@tcp:101:ll_sa_410261.0 00010000:00010000:0.0:1651529335.333764:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.333768:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018c74a51/0x3234de053c4f6de lrc: 2/0,0 mode: --/PR res: [0x2b619:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8e0e expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.333773:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b619:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.333776:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.333777:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.333778:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018c74a51/0x3234de053c4f6de lrc: 3/0,0 mode: PR/PR res: [0x2b619:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8e0e expref: 2003 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.333782:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000018c74a51/0x3234de053c4f6de lrc: 3/0,0 mode: PR/PR res: [0x2b619:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8e0e expref: 2003 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.333786:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000018c74a51, rc 0) 00000100:00100000:0.0:1651529335.333799:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2003:41279:x1731746395133952:12345-10.240.43.64@tcp:101:ll_sa_410261.0 Request processed in 38us (77us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.333802:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210458 00000100:00100000:1.0:1651529335.334197:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.334218:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395134208 00000100:00100000:0.0:1651529335.334239:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210459 00000100:00100000:0.0:1651529335.334240:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2003:41279:x1731746395134208:12345-10.240.43.64@tcp:101:ll_agl_410261.0 00010000:00010000:0.0:1651529335.334245:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.334248:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e650250/0x3234de053c4f6e5 lrc: 2/0,0 mode: --/PR res: [0x2b95a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8e1c expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.334253:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b95a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.334257:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.334257:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.334259:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e650250/0x3234de053c4f6e5 lrc: 3/0,0 mode: PR/PR res: [0x2b95a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8e1c expref: 2004 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.334263:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009e650250/0x3234de053c4f6e5 lrc: 3/0,0 mode: PR/PR res: [0x2b95a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8e1c expref: 2004 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.334267:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009e650250, rc 0) 00000100:00100000:0.0:1651529335.334280:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2004:41279:x1731746395134208:12345-10.240.43.64@tcp:101:ll_agl_410261.0 Request processed in 39us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.334283:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210459 00000100:00100000:1.0:1651529335.334690:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529335.334706:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746395134400 00000100:00100000:0.0:1651529335.334718:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210460 00000100:00100000:0.0:1651529335.334720:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2004:41279:x1731746395134400:12345-10.240.43.64@tcp:101:ll_agl_410261.0 00010000:00010000:0.0:1651529335.334723:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529335.334726:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fcb879f/0x3234de053c4f6ec lrc: 2/0,0 mode: --/PR res: [0x2b3c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d8e23 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529335.334738:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2b3c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529335.334741:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.334742:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529335.334744:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fcb879f/0x3234de053c4f6ec lrc: 3/0,0 mode: PR/PR res: [0x2b3c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8e23 expref: 2005 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.334748:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009fcb879f/0x3234de053c4f6ec lrc: 3/0,0 mode: PR/PR res: [0x2b3c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8e23 expref: 2005 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529335.334751:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009fcb879f, rc 0) 00000100:00100000:0.0:1651529335.334765:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2005:41279:x1731746395134400:12345-10.240.43.64@tcp:101:ll_agl_410261.0 Request processed in 44us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529335.334767:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210460 00000100:00100000:1.0:1651529338.080150:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529338.080182:0:72398:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946298688 00000100:00100000:0.0:1651529338.080205:0:72398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 567 00000100:00100000:0.0:1651529338.080208:0:72398:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ccd14f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+1209:39030:x1731745946298688:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651529338.080237:0:72398:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8580544 pending 0 free 81328046080 avail 77157335040 00000100:00100000:0.0:1651529338.080267:0:72398:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ccd14f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+1209:39030:x1731745946298688:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 58us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529338.080271:0:72398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 567 00000400:00000080:1.0:1651529338.942889:0:156706:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651529338.942891:0:156706:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: ls -la time: 5 seconds 00000400:00000080:1.0:1651529339.262941:0:156760:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651529339.262943:0:156760:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: lru_size = 4006 00000400:00000080:1.0:1651529339.576116:0:156814:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651529339.576118:0:156814:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: ls -la is 28% faster with lru resize enabled 00000001:00080000:0.0:1651529339.668909:0:72382:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 12885078565 is committed 00000100:00100000:1.0:1651529342.176485:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529342.176913:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946324928 00000100:00100000:0.0:1651529342.176937:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 86 00000100:00100000:0.0:1651529342.176940:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946324928:12345-10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:0.0:1651529342.176976:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946324928:12345-10.240.43.61@tcp:400:kworker/u4:0.0 Request processed in 36us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529342.176980:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 86 00000400:00000080:0.0:1651529342.950668:0:157140:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651529342.950670:0:157140:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 124c: LRUR cancel very aged locks ========= 22:09:02 (1651529342) 00000100:00100000:1.0:1651529343.080515:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529343.080551:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529343.080577:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396187136 00000100:00100000:0.0:1651529343.080578:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396187200 00000100:00100000:1.0:1651529343.080603:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210461 00000100:00100000:1.0:1651529343.080606:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2006:41278:x1731746396187136:12345-10.240.43.64@tcp:101:ls.0 00000100:00100000:0.0:1651529343.080607:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210462 00000100:00100000:0.0:1651529343.080609:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2006:41278:x1731746396187200:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00010000:00010000:1.0:1651529343.080615:0:80279:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.080615:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529343.080627:0:80279:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004df86d30/0x3234de053c4f6f3 lrc: 2/0,0 mode: --/PR res: [0x2bb18:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9133 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529343.080627:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eeab415c/0x3234de053c4f6fa lrc: 2/0,0 mode: --/PR res: [0x2bb15:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d913a expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529343.080639:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:0.0:1651529343.080639:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529343.080648:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.080648:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529343.080649:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.080649:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529343.080653:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004df86d30/0x3234de053c4f6f3 lrc: 3/0,0 mode: PR/PR res: [0x2bb18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9133 expref: 2008 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.080653:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eeab415c/0x3234de053c4f6fa lrc: 3/0,0 mode: PR/PR res: [0x2bb15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d913a expref: 2008 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529343.080660:0:80279:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004df86d30/0x3234de053c4f6f3 lrc: 3/0,0 mode: PR/PR res: [0x2bb18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9133 expref: 2008 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.080660:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eeab415c/0x3234de053c4f6fa lrc: 3/0,0 mode: PR/PR res: [0x2bb15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d913a expref: 2008 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529343.080666:0:80279:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004df86d30, rc 0) 00010000:00010000:0.0:1651529343.080666:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000eeab415c, rc 0) 00000100:00100000:1.0:1651529343.080687:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2008:41278:x1731746396187136:12345-10.240.43.64@tcp:101:ls.0 Request processed in 81us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.080688:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2008:41278:x1731746396187200:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 78us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529343.080691:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210461 00000100:00100000:0.0:1651529343.080693:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210462 00000100:00100000:1.0:1651529343.082601:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529343.082610:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396188480 00000100:00100000:1.0:1651529343.082618:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210463 00000100:00100000:1.0:1651529343.082620:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2007:41279:x1731746396188480:12345-10.240.43.64@tcp:101:ll_agl_411480.0 00010000:00010000:1.0:1651529343.082624:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529343.082628:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000317be83e/0x3234de053c4f701 lrc: 2/0,0 mode: --/PR res: [0x2bb20:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d91b1 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529343.082634:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529343.082638:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529343.082639:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529343.082641:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000317be83e/0x3234de053c4f701 lrc: 3/0,0 mode: PR/PR res: [0x2bb20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91b1 expref: 2008 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529343.082646:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000317be83e/0x3234de053c4f701 lrc: 3/0,0 mode: PR/PR res: [0x2bb20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91b1 expref: 2008 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529343.082650:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000317be83e, rc 0) 00000100:00100000:1.0:1651529343.082660:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2008:41279:x1731746396188480:12345-10.240.43.64@tcp:101:ll_agl_411480.0 Request processed in 39us (59us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529343.082663:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210463 00000100:00100000:1.0:1651529343.083553:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529343.083561:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529343.083569:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529343.083580:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396188992 00000100:00100000:1.0:1651529343.083588:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396189056 00000100:00100000:0.0:1651529343.083591:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396189184 00000100:00100000:1.0:1651529343.083596:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210464 00000100:00100000:1.0:1651529343.083597:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2009:41278:x1731746396188992:12345-10.240.43.64@tcp:101:ll_agl_411480.0 00010000:00010000:1.0:1651529343.083601:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529343.083606:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9982452/0x3234de053c4f708 lrc: 2/0,0 mode: --/PR res: [0x2bb2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d91e2 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529343.083606:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210465 00000100:00100000:0.0:1651529343.083608:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2010:41278:x1731746396189056:12345-10.240.43.64@tcp:101:ll_agl_411480.0 00010000:00010000:0.0:1651529343.083612:0:156655:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00002000:00010000:1.0:1651529343.083614:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.083616:0:156655:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e65576dd/0x3234de053c4f70f lrc: 2/0,0 mode: --/PR res: [0x2bb1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d91e9 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529343.083618:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529343.083619:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529343.083621:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9982452/0x3234de053c4f708 lrc: 3/0,0 mode: PR/PR res: [0x2bb2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91e2 expref: 2011 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529343.083625:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f9982452/0x3234de053c4f708 lrc: 3/0,0 mode: PR/PR res: [0x2bb2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91e2 expref: 2011 pid: 151609 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1651529343.083625:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529343.083629:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f9982452, rc 0) 00010000:00010000:0.0:1651529343.083629:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.083630:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.083631:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e65576dd/0x3234de053c4f70f lrc: 3/0,0 mode: PR/PR res: [0x2bb1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91e9 expref: 2012 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.083636:0:156655:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e65576dd/0x3234de053c4f70f lrc: 3/0,0 mode: PR/PR res: [0x2bb1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91e9 expref: 2012 pid: 156655 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529343.083639:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2012:41278:x1731746396188992:12345-10.240.43.64@tcp:101:ll_agl_411480.0 Request processed in 41us (86us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529343.083640:0:156655:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e65576dd, rc 0) 00000100:00100000:1.0:1651529343.083642:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210464 00000100:00100000:1.0:1651529343.083647:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210466 00000100:00100000:1.0:1651529343.083649:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2011:41279:x1731746396189184:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00000100:00100000:0.0:1651529343.083649:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2011:41278:x1731746396189056:12345-10.240.43.64@tcp:101:ll_agl_411480.0 Request processed in 41us (88us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529343.083652:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00000100:00100000:0.0:1651529343.083652:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210465 00010000:00010000:1.0:1651529343.083659:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062067bd8/0x3234de053c4f716 lrc: 2/0,0 mode: --/PR res: [0x2bb3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d91f7 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529343.083664:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529343.083668:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529343.083668:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529343.083670:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062067bd8/0x3234de053c4f716 lrc: 3/0,0 mode: PR/PR res: [0x2bb3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91f7 expref: 2011 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529343.083674:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000062067bd8/0x3234de053c4f716 lrc: 3/0,0 mode: PR/PR res: [0x2bb3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91f7 expref: 2011 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529343.083678:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000062067bd8, rc 0) 00000100:00100000:1.0:1651529343.083684:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2011:41279:x1731746396189184:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 34us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529343.083686:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210466 00000100:00100000:0.0:1651529343.083716:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529343.083761:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396189312 00000100:00100000:1.0:1651529343.083771:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210467 00000100:00100000:1.0:1651529343.083772:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2011:41278:x1731746396189312:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00000100:00100000:0.0:1651529343.083773:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529343.083776:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529343.083780:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000adc29bfc/0x3234de053c4f71d lrc: 2/0,0 mode: --/PR res: [0x2bb2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9205 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529343.083781:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396189248 00002000:00010000:1.0:1651529343.083785:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529343.083789:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529343.083789:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210468 00010000:00010000:1.0:1651529343.083790:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529343.083790:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2013:41278:x1731746396189248:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00010000:00010000:1.0:1651529343.083791:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000adc29bfc/0x3234de053c4f71d lrc: 3/0,0 mode: PR/PR res: [0x2bb2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9205 expref: 2013 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.083794:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529343.083796:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000adc29bfc/0x3234de053c4f71d lrc: 3/0,0 mode: PR/PR res: [0x2bb2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9205 expref: 2013 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.083798:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f39df31/0x3234de053c4f724 lrc: 2/0,0 mode: --/PR res: [0x2bb12:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d91fe expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529343.083799:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000adc29bfc, rc 0) 00002000:00010000:0.0:1651529343.083804:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529343.083809:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2014:41278:x1731746396189312:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 36us (93us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529343.083809:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.083809:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529343.083811:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210467 00010000:00010000:0.0:1651529343.083811:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f39df31/0x3234de053c4f724 lrc: 3/0,0 mode: PR/PR res: [0x2bb12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91fe expref: 2014 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.083816:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003f39df31/0x3234de053c4f724 lrc: 3/0,0 mode: PR/PR res: [0x2bb12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91fe expref: 2013 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.083820:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f39df31, rc 0) 00000100:00100000:0.0:1651529343.083828:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2013:41278:x1731746396189248:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 37us (60us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.083830:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210468 00000100:00100000:0.0:1651529343.084480:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.084488:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396189888 00000100:00100000:0.0:1651529343.084495:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210469 00000100:00100000:0.0:1651529343.084496:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2013:41278:x1731746396189888:12345-10.240.43.64@tcp:101:ll_agl_411480.0 00010000:00010000:0.0:1651529343.084500:0:80279:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.084504:0:80279:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b740c8d9/0x3234de053c4f72b lrc: 2/0,0 mode: --/PR res: [0x2bb37:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d923d expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.084509:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.084513:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.084514:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.084516:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b740c8d9/0x3234de053c4f72b lrc: 3/0,0 mode: PR/PR res: [0x2bb37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d923d expref: 2014 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.084520:0:80279:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b740c8d9/0x3234de053c4f72b lrc: 3/0,0 mode: PR/PR res: [0x2bb37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d923d expref: 2014 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.084524:0:80279:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b740c8d9, rc 0) 00000100:00100000:0.0:1651529343.084539:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2014:41278:x1731746396189888:12345-10.240.43.64@tcp:101:ll_agl_411480.0 Request processed in 42us (60us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.084542:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210469 00000100:00100000:0.0:1651529343.085082:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.085089:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396190464 00000100:00100000:0.0:1651529343.085096:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210470 00000100:00100000:0.0:1651529343.085098:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2014:41278:x1731746396190464:12345-10.240.43.64@tcp:101:ll_agl_411480.0 00010000:00010000:0.0:1651529343.085101:0:80281:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.085109:0:80281:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0382f56/0x3234de053c4f732 lrc: 2/0,0 mode: --/PR res: [0x2bb28:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9275 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.085115:0:80281:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.085119:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.085119:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.085121:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0382f56/0x3234de053c4f732 lrc: 3/0,0 mode: PR/PR res: [0x2bb28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9275 expref: 2015 pid: 80281 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.085125:0:80281:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b0382f56/0x3234de053c4f732 lrc: 3/0,0 mode: PR/PR res: [0x2bb28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9275 expref: 2015 pid: 80281 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.085129:0:80281:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b0382f56, rc 0) 00000100:00100000:0.0:1651529343.085144:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2015:41278:x1731746396190464:12345-10.240.43.64@tcp:101:ll_agl_411480.0 Request processed in 45us (62us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.085146:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210470 00000100:00100000:0.0:1651529343.085828:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.085835:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396190848 00000100:00100000:0.0:1651529343.085841:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210471 00000100:00100000:0.0:1651529343.085843:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2015:41278:x1731746396190848:12345-10.240.43.64@tcp:101:ll_agl_411480.0 00010000:00010000:0.0:1651529343.085846:0:80279:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.085850:0:80279:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049d4bb9b/0x3234de053c4f739 lrc: 2/0,0 mode: --/PR res: [0x2bb29:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d929f expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.085855:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.085859:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.085860:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.085861:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049d4bb9b/0x3234de053c4f739 lrc: 3/0,0 mode: PR/PR res: [0x2bb29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d929f expref: 2016 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.085865:0:80279:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000049d4bb9b/0x3234de053c4f739 lrc: 3/0,0 mode: PR/PR res: [0x2bb29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d929f expref: 2016 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.085869:0:80279:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000049d4bb9b, rc 0) 00000100:00100000:0.0:1651529343.085883:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2016:41278:x1731746396190848:12345-10.240.43.64@tcp:101:ll_agl_411480.0 Request processed in 39us (56us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.085886:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210471 00000100:00100000:0.0:1651529343.086266:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.086273:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396191360 00000100:00100000:0.0:1651529343.086279:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210472 00000100:00100000:0.0:1651529343.086281:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2016:41278:x1731746396191360:12345-10.240.43.64@tcp:101:ll_agl_411480.0 00010000:00010000:0.0:1651529343.086284:0:80281:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.086288:0:80281:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c4f740 lrc: 2/0,0 mode: --/PR res: [0x2bb17:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d92d0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.086293:0:80281:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.086297:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.086298:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.086300:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c4f740 lrc: 3/0,0 mode: PR/PR res: [0x2bb17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92d0 expref: 2017 pid: 80281 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.086304:0:80281:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c4f740 lrc: 3/0,0 mode: PR/PR res: [0x2bb17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92d0 expref: 2017 pid: 80281 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.086307:0:80281:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001e943794, rc 0) 00000100:00100000:0.0:1651529343.086321:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2017:41278:x1731746396191360:12345-10.240.43.64@tcp:101:ll_agl_411480.0 Request processed in 40us (56us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.086324:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210472 00000100:00100000:0.0:1651529343.086386:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.086395:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.086400:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396191424 00000100:00100000:0.0:1651529343.086406:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396191552 00000100:00100000:0.0:1651529343.086416:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210473 00000100:00100000:0.0:1651529343.086417:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2018:41279:x1731746396191424:12345-10.240.43.64@tcp:101:ll_agl_411480.0 00010000:00010000:0.0:1651529343.086421:0:80281:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.086424:0:80281:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be333df1/0x3234de053c4f747 lrc: 2/0,0 mode: --/PR res: [0x2bb2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d92d7 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529343.086428:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210474 00002000:00010000:0.0:1651529343.086430:0:80281:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529343.086431:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2018:41279:x1731746396191552:12345-10.240.43.64@tcp:101:ll_agl_411480.0 00010000:00010000:0.0:1651529343.086433:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529343.086434:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.086434:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.086436:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be333df1/0x3234de053c4f747 lrc: 3/0,0 mode: PR/PR res: [0x2bb2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92d7 expref: 2019 pid: 80281 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529343.086438:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a638527a/0x3234de053c4f74e lrc: 2/0,0 mode: --/PR res: [0x2bb26:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d92e5 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529343.086443:0:80281:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000be333df1/0x3234de053c4f747 lrc: 3/0,0 mode: PR/PR res: [0x2bb2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92d7 expref: 2019 pid: 80281 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1651529343.086444:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.086446:0:80281:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000be333df1, rc 0) 00010000:00010000:1.0:1651529343.086447:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529343.086448:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529343.086449:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a638527a/0x3234de053c4f74e lrc: 3/0,0 mode: PR/PR res: [0x2bb26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92e5 expref: 2020 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529343.086454:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a638527a/0x3234de053c4f74e lrc: 3/0,0 mode: PR/PR res: [0x2bb26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92e5 expref: 2020 pid: 151609 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529343.086458:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2020:41279:x1731746396191424:12345-10.240.43.64@tcp:101:ll_agl_411480.0 Request processed in 40us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.086461:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210473 00010000:00010000:1.0:1651529343.086464:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a638527a, rc 0) 00000100:00100000:1.0:1651529343.086472:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2019:41279:x1731746396191552:12345-10.240.43.64@tcp:101:ll_agl_411480.0 Request processed in 41us (77us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529343.086475:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210474 00000100:00100000:0.0:1651529343.087358:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.087371:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.087378:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396191936 00000100:00100000:1.0:1651529343.087381:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396192000 00000100:00100000:0.0:1651529343.087384:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210475 00000100:00100000:0.0:1651529343.087386:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2020:41278:x1731746396191936:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00000100:00100000:1.0:1651529343.087392:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210476 00000100:00100000:1.0:1651529343.087394:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2020:41278:x1731746396192000:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00010000:00010000:0.0:1651529343.087395:0:80279:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529343.087397:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529343.087401:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070a6ad94/0x3234de053c4f755 lrc: 2/0,0 mode: --/PR res: [0x2bb2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d930f expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529343.087406:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529343.087410:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529343.087411:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529343.087412:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070a6ad94/0x3234de053c4f755 lrc: 3/0,0 mode: PR/PR res: [0x2bb2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d930f expref: 2021 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529343.087416:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000070a6ad94/0x3234de053c4f755 lrc: 3/0,0 mode: PR/PR res: [0x2bb2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d930f expref: 2021 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.087429:0:80279:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ead1500/0x3234de053c4f75c lrc: 2/0,0 mode: --/PR res: [0x2bb40:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9308 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529343.087434:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000070a6ad94, rc 0) 00002000:00010000:0.0:1651529343.087435:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.087439:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.087440:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.087442:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ead1500/0x3234de053c4f75c lrc: 3/0,0 mode: PR/PR res: [0x2bb40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9308 expref: 2022 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529343.087447:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2022:41278:x1731746396192000:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 52us (76us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529343.087450:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210476 00010000:00010000:0.0:1651529343.087453:0:80279:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008ead1500/0x3234de053c4f75c lrc: 3/0,0 mode: PR/PR res: [0x2bb40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9308 expref: 2021 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.087459:0:80279:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008ead1500, rc 0) 00000100:00100000:1.0:1651529343.087465:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.087468:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2021:41278:x1731746396191936:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 81us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.087471:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210475 00000100:00100000:0.0:1651529343.087476:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396192064 00000100:00100000:1.0:1651529343.087479:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.087489:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396192256 00000100:00100000:0.0:1651529343.087509:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210477 00000100:00100000:0.0:1651529343.087511:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2022:41279:x1731746396192064:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00000100:00100000:1.0:1651529343.087514:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529343.087514:0:80279:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.087524:0:80279:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c4f763 lrc: 2/0,0 mode: --/PR res: [0x2bb24:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9316 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529343.087526:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396192320 00002000:00010000:0.0:1651529343.087530:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529343.087535:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210478 00000100:00100000:1.0:1651529343.087537:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2024:41279:x1731746396192256:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00010000:00010000:0.0:1651529343.087538:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.087539:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529343.087540:0:106695:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.087541:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c4f763 lrc: 3/0,0 mode: PR/PR res: [0x2bb24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9316 expref: 2024 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.087545:0:80279:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c4f763 lrc: 3/0,0 mode: PR/PR res: [0x2bb24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9316 expref: 2024 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529343.087548:0:106695:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c2a9b2f/0x3234de053c4f76a lrc: 2/0,0 mode: --/PR res: [0x2bb35:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d932b expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529343.087549:0:80279:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007d55fe01, rc 0) 00002000:00010000:1.0:1651529343.087554:0:106695:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1651529343.087561:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2025:41279:x1731746396192064:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 49us (96us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529343.087564:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529343.087564:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210477 00010000:00010000:1.0:1651529343.087565:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529343.087567:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c2a9b2f/0x3234de053c4f76a lrc: 3/0,0 mode: PR/PR res: [0x2bb35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d932b expref: 2024 pid: 106695 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529343.087569:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210479 00000100:00100000:0.0:1651529343.087571:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050b3b776 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2024:41279:x1731746396192320:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00010000:00010000:1.0:1651529343.087572:0:106695:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005c2a9b2f/0x3234de053c4f76a lrc: 3/0,0 mode: PR/PR res: [0x2bb35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d932b expref: 2024 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.087574:0:80279:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529343.087576:0:106695:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005c2a9b2f, rc 0) 00010000:00010000:0.0:1651529343.087580:0:80279:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cab45436/0x3234de053c4f771 lrc: 2/0,0 mode: --/PR res: [0x2bb25:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9332 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529343.087584:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2024:41279:x1731746396192256:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 46us (105us total) trans 0 rc 0/0 00002000:00010000:0.0:1651529343.087585:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529343.087586:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210478 00010000:00010000:0.0:1651529343.087588:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.087589:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.087590:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cab45436/0x3234de053c4f771 lrc: 3/0,0 mode: PR/PR res: [0x2bb25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9332 expref: 2024 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.087594:0:80279:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cab45436/0x3234de053c4f771 lrc: 3/0,0 mode: PR/PR res: [0x2bb25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9332 expref: 2024 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.087598:0:80279:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000cab45436, rc 0) 00000100:00100000:0.0:1651529343.087604:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050b3b776 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2024:41279:x1731746396192320:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 33us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.087607:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210479 00000100:00100000:1.0:1651529343.088301:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529343.088310:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529343.088316:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396192640 00000100:00100000:1.0:1651529343.088328:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396192576 00000100:00100000:1.0:1651529343.088333:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210480 00000100:00100000:1.0:1651529343.088335:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2025:41279:x1731746396192640:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00010000:00010000:1.0:1651529343.088338:0:80280:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00000100:00100000:0.0:1651529343.088342:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210481 00000100:00100000:0.0:1651529343.088345:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2025:41279:x1731746396192576:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00010000:00010000:1.0:1651529343.088346:0:80280:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c5425fe/0x3234de053c4f778 lrc: 2/0,0 mode: --/PR res: [0x2bb1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d934e expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529343.088348:0:80279:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00002000:00010000:1.0:1651529343.088351:0:80280:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.088353:0:80279:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000990cd87d/0x3234de053c4f77f lrc: 2/0,0 mode: --/PR res: [0x2bb1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9347 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529343.088355:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529343.088356:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529343.088357:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c5425fe/0x3234de053c4f778 lrc: 3/0,0 mode: PR/PR res: [0x2bb1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d934e expref: 2026 pid: 80280 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1651529343.088358:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.088361:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529343.088362:0:80280:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001c5425fe/0x3234de053c4f778 lrc: 3/0,0 mode: PR/PR res: [0x2bb1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d934e expref: 2027 pid: 80280 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.088362:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.088364:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000990cd87d/0x3234de053c4f77f lrc: 3/0,0 mode: PR/PR res: [0x2bb1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9347 expref: 2027 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529343.088366:0:80280:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001c5425fe, rc 0) 00010000:00010000:0.0:1651529343.088368:0:80279:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000990cd87d/0x3234de053c4f77f lrc: 3/0,0 mode: PR/PR res: [0x2bb1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9347 expref: 2027 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.088372:0:80279:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000990cd87d, rc 0) 00000100:00100000:1.0:1651529343.088378:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2027:41279:x1731746396192640:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 42us (77us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529343.088381:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210480 00000100:00100000:0.0:1651529343.088387:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2026:41279:x1731746396192576:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 41us (77us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.088389:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210481 00000100:00100000:1.0:1651529343.089194:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.089215:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396193088 00000100:00100000:0.0:1651529343.089240:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210482 00000100:00100000:0.0:1651529343.089241:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2026:41279:x1731746396193088:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00010000:00010000:0.0:1651529343.089245:0:80279:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.089248:0:80279:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c1cdcb2/0x3234de053c4f786 lrc: 2/0,0 mode: --/PR res: [0x2bb1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9371 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.089253:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.089257:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.089257:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.089259:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c1cdcb2/0x3234de053c4f786 lrc: 3/0,0 mode: PR/PR res: [0x2bb1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9371 expref: 2027 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.089263:0:80279:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006c1cdcb2/0x3234de053c4f786 lrc: 3/0,0 mode: PR/PR res: [0x2bb1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9371 expref: 2027 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.089267:0:80279:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006c1cdcb2, rc 0) 00000100:00100000:0.0:1651529343.089281:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2027:41279:x1731746396193088:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 39us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.089284:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210482 00000100:00100000:1.0:1651529343.089653:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.089673:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396193280 00000100:00100000:0.0:1651529343.089685:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210483 00000100:00100000:0.0:1651529343.089686:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2027:41278:x1731746396193280:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00010000:00010000:0.0:1651529343.089690:0:80279:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.089693:0:80279:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fb54722/0x3234de053c4f78d lrc: 2/0,0 mode: --/PR res: [0x2bb36:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d937f expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.089698:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.089702:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.089702:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.089704:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fb54722/0x3234de053c4f78d lrc: 3/0,0 mode: PR/PR res: [0x2bb36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d937f expref: 2028 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.089708:0:80279:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003fb54722/0x3234de053c4f78d lrc: 3/0,0 mode: PR/PR res: [0x2bb36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d937f expref: 2028 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.089712:0:80279:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003fb54722, rc 0) 00000100:00100000:0.0:1651529343.089726:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2028:41278:x1731746396193280:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 39us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.089728:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210483 00000100:00100000:1.0:1651529343.090046:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.090067:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396193472 00000100:00100000:0.0:1651529343.090078:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210484 00000100:00100000:0.0:1651529343.090080:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2028:41278:x1731746396193472:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00010000:00010000:0.0:1651529343.090084:0:80279:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.090088:0:80279:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059de8c3d/0x3234de053c4f794 lrc: 2/0,0 mode: --/PR res: [0x2bb23:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d938d expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.090093:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.090097:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.090097:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.090099:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059de8c3d/0x3234de053c4f794 lrc: 3/0,0 mode: PR/PR res: [0x2bb23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d938d expref: 2029 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.090103:0:80279:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000059de8c3d/0x3234de053c4f794 lrc: 3/0,0 mode: PR/PR res: [0x2bb23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d938d expref: 2029 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.090106:0:80279:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000059de8c3d, rc 0) 00000100:00100000:0.0:1651529343.090120:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2029:41278:x1731746396193472:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 39us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.090123:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210484 00000100:00100000:1.0:1651529343.091012:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.091033:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396193856 00000100:00100000:0.0:1651529343.091044:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210485 00000100:00100000:0.0:1651529343.091046:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2029:41279:x1731746396193856:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00010000:00010000:0.0:1651529343.091049:0:80279:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.091053:0:80279:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007126e775/0x3234de053c4f79b lrc: 2/0,0 mode: --/PR res: [0x2bb34:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d93a9 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.091058:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.091061:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.091062:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.091064:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007126e775/0x3234de053c4f79b lrc: 3/0,0 mode: PR/PR res: [0x2bb34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93a9 expref: 2030 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.091068:0:80279:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007126e775/0x3234de053c4f79b lrc: 3/0,0 mode: PR/PR res: [0x2bb34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93a9 expref: 2030 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.091071:0:80279:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007126e775, rc 0) 00000100:00100000:0.0:1651529343.091085:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2030:41279:x1731746396193856:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 38us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.091088:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210485 00000100:00100000:1.0:1651529343.091500:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.091520:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396194048 00000100:00100000:0.0:1651529343.091532:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210486 00000100:00100000:0.0:1651529343.091533:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2030:41279:x1731746396194048:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00010000:00010000:0.0:1651529343.091536:0:80279:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.091544:0:80279:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067d657cd/0x3234de053c4f7a2 lrc: 2/0,0 mode: --/PR res: [0x2bb39:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d93b7 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.091550:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.091553:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.091554:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.091555:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067d657cd/0x3234de053c4f7a2 lrc: 3/0,0 mode: PR/PR res: [0x2bb39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93b7 expref: 2031 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.091559:0:80279:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000067d657cd/0x3234de053c4f7a2 lrc: 3/0,0 mode: PR/PR res: [0x2bb39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93b7 expref: 2031 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.091563:0:80279:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000067d657cd, rc 0) 00000100:00100000:0.0:1651529343.091577:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2031:41279:x1731746396194048:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 43us (78us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.091580:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210486 00000100:00100000:1.0:1651529343.093486:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.093507:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396194816 00000100:00100000:0.0:1651529343.093518:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210487 00000100:00100000:0.0:1651529343.093520:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2031:41279:x1731746396194816:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00010000:00010000:0.0:1651529343.093523:0:80279:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.093527:0:80279:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2ef532c/0x3234de053c4f7a9 lrc: 2/0,0 mode: --/PR res: [0x2bb3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d93ef expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.093532:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.093535:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.093536:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.093538:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2ef532c/0x3234de053c4f7a9 lrc: 3/0,0 mode: PR/PR res: [0x2bb3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93ef expref: 2032 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.093542:0:80279:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d2ef532c/0x3234de053c4f7a9 lrc: 3/0,0 mode: PR/PR res: [0x2bb3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93ef expref: 2032 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.093546:0:80279:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d2ef532c, rc 0) 00000100:00100000:0.0:1651529343.093559:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2032:41279:x1731746396194816:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 38us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.093562:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210487 00000100:00100000:1.0:1651529343.094472:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.094493:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396195200 00000100:00100000:0.0:1651529343.094504:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210488 00000100:00100000:0.0:1651529343.094506:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2032:41279:x1731746396195200:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00010000:00010000:0.0:1651529343.094510:0:80279:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.094517:0:80279:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c4f7b0 lrc: 2/0,0 mode: --/PR res: [0x2bb11:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d940b expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.094522:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.094525:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.094526:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.094528:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c4f7b0 lrc: 3/0,0 mode: PR/PR res: [0x2bb11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d940b expref: 2033 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.094532:0:80279:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c4f7b0 lrc: 3/0,0 mode: PR/PR res: [0x2bb11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d940b expref: 2033 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.094535:0:80279:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008393c644, rc 0) 00000100:00100000:0.0:1651529343.094549:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2033:41279:x1731746396195200:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 43us (77us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.094552:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210488 00000100:00100000:1.0:1651529343.094936:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.094956:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396195392 00000100:00100000:0.0:1651529343.094968:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210489 00000100:00100000:0.0:1651529343.094969:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2033:41278:x1731746396195392:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00010000:00010000:0.0:1651529343.094973:0:80279:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.094976:0:80279:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c4f7b7 lrc: 2/0,0 mode: --/PR res: [0x2bb1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9419 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.094981:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.094984:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.094985:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.094987:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c4f7b7 lrc: 3/0,0 mode: PR/PR res: [0x2bb1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9419 expref: 2034 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.094991:0:80279:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c4f7b7 lrc: 3/0,0 mode: PR/PR res: [0x2bb1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9419 expref: 2034 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.094995:0:80279:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008119f3a8, rc 0) 00000100:00100000:0.0:1651529343.095008:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2034:41278:x1731746396195392:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 38us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.095011:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210489 00000100:00100000:1.0:1651529343.095381:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.095402:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396195584 00000100:00100000:0.0:1651529343.095413:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210490 00000100:00100000:0.0:1651529343.095414:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2034:41278:x1731746396195584:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00010000:00010000:0.0:1651529343.095417:0:80279:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.095421:0:80279:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c4f7be lrc: 2/0,0 mode: --/PR res: [0x2bb30:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9427 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.095426:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.095430:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.095430:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.095432:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c4f7be lrc: 3/0,0 mode: PR/PR res: [0x2bb30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9427 expref: 2035 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.095436:0:80279:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c4f7be lrc: 3/0,0 mode: PR/PR res: [0x2bb30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9427 expref: 2035 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.095440:0:80279:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000d8e6a5e, rc 0) 00000100:00100000:0.0:1651529343.095454:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2035:41278:x1731746396195584:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 39us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.095456:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210490 00000100:00100000:1.0:1651529343.096781:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.096802:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396196160 00000100:00100000:0.0:1651529343.096813:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210491 00000100:00100000:0.0:1651529343.096815:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2035:41279:x1731746396196160:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00010000:00010000:0.0:1651529343.096818:0:80279:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.096822:0:80279:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c4f7c5 lrc: 2/0,0 mode: --/PR res: [0x2bb10:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9451 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.096827:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.096831:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.096831:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.096833:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c4f7c5 lrc: 3/0,0 mode: PR/PR res: [0x2bb10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9451 expref: 2036 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.096837:0:80279:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c4f7c5 lrc: 3/0,0 mode: PR/PR res: [0x2bb10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9451 expref: 2036 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.096841:0:80279:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e270377c, rc 0) 00000100:00100000:0.0:1651529343.096855:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2036:41279:x1731746396196160:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 39us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.096857:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210491 00000100:00100000:1.0:1651529343.097217:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.097238:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396196352 00000100:00100000:0.0:1651529343.097249:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210492 00000100:00100000:0.0:1651529343.097251:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2036:41278:x1731746396196352:12345-10.240.43.64@tcp:101:ll_agl_411480.0 00010000:00010000:0.0:1651529343.097255:0:80279:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.097259:0:80279:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c4f7cc lrc: 2/0,0 mode: --/PR res: [0x2bb31:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d945f expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.097264:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.097267:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.097268:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.097270:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c4f7cc lrc: 3/0,0 mode: PR/PR res: [0x2bb31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d945f expref: 2037 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.097274:0:80279:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c4f7cc lrc: 3/0,0 mode: PR/PR res: [0x2bb31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d945f expref: 2037 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.097277:0:80279:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002082f759, rc 0) 00000100:00100000:0.0:1651529343.097291:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2037:41278:x1731746396196352:12345-10.240.43.64@tcp:101:ll_agl_411480.0 Request processed in 39us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.097294:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210492 00000100:00100000:1.0:1651529343.097702:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.097723:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396196544 00000100:00100000:0.0:1651529343.097741:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210493 00000100:00100000:0.0:1651529343.097743:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2037:41279:x1731746396196544:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00010000:00010000:0.0:1651529343.097746:0:80279:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.097750:0:80279:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c4f7d3 lrc: 2/0,0 mode: --/PR res: [0x2bb13:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d946d expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.097755:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.097758:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.097759:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.097761:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c4f7d3 lrc: 3/0,0 mode: PR/PR res: [0x2bb13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d946d expref: 2038 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.097765:0:80279:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c4f7d3 lrc: 3/0,0 mode: PR/PR res: [0x2bb13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d946d expref: 2038 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.097768:0:80279:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000721302df, rc 0) 00000100:00100000:0.0:1651529343.097782:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2038:41279:x1731746396196544:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 39us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.097785:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210493 00000100:00100000:1.0:1651529343.098131:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.098151:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396196736 00000100:00100000:0.0:1651529343.098163:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210494 00000100:00100000:0.0:1651529343.098164:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2038:41279:x1731746396196736:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00010000:00010000:0.0:1651529343.098167:0:80279:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.098171:0:80279:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c4f7da lrc: 2/0,0 mode: --/PR res: [0x2bb33:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d947b expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.098176:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.098179:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.098180:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.098182:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c4f7da lrc: 3/0,0 mode: PR/PR res: [0x2bb33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d947b expref: 2039 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.098186:0:80279:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c4f7da lrc: 3/0,0 mode: PR/PR res: [0x2bb33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d947b expref: 2039 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.098189:0:80279:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000cb70d261, rc 0) 00000100:00100000:0.0:1651529343.098203:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2039:41279:x1731746396196736:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 38us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.098206:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210494 00000100:00100000:1.0:1651529343.099555:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.099576:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396197312 00000100:00100000:0.0:1651529343.099587:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210495 00000100:00100000:0.0:1651529343.099588:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2039:41279:x1731746396197312:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00010000:00010000:0.0:1651529343.099591:0:80279:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.099595:0:80279:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c4f7e1 lrc: 2/0,0 mode: --/PR res: [0x2bb0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d94a5 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.099600:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb0f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.099604:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.099604:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.099606:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c4f7e1 lrc: 3/0,0 mode: PR/PR res: [0x2bb0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94a5 expref: 2040 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.099610:0:80279:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c4f7e1 lrc: 3/0,0 mode: PR/PR res: [0x2bb0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94a5 expref: 2040 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.099614:0:80279:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000eca832be, rc 0) 00000100:00100000:0.0:1651529343.099627:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2040:41279:x1731746396197312:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 38us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.099630:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210495 00000100:00100000:1.0:1651529343.100021:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.100041:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396197504 00000100:00100000:0.0:1651529343.100053:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210496 00000100:00100000:0.0:1651529343.100054:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2040:41278:x1731746396197504:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00010000:00010000:0.0:1651529343.100058:0:80279:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.100062:0:80279:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c4f7e8 lrc: 2/0,0 mode: --/PR res: [0x2bb1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d94b3 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.100067:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.100070:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.100071:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.100073:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c4f7e8 lrc: 3/0,0 mode: PR/PR res: [0x2bb1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94b3 expref: 2041 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.100077:0:80279:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c4f7e8 lrc: 3/0,0 mode: PR/PR res: [0x2bb1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94b3 expref: 2041 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.100080:0:80279:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6999e11, rc 0) 00000100:00100000:0.0:1651529343.100094:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2041:41278:x1731746396197504:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 39us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.100097:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210496 00000100:00100000:1.0:1651529343.102328:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.102349:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396198464 00000100:00100000:0.0:1651529343.102360:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210497 00000100:00100000:0.0:1651529343.102362:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2041:41279:x1731746396198464:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00010000:00010000:0.0:1651529343.102365:0:80279:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.102369:0:80279:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c4f7ef lrc: 2/0,0 mode: --/PR res: [0x2bb3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d94f9 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.102374:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.102377:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.102378:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.102380:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c4f7ef lrc: 3/0,0 mode: PR/PR res: [0x2bb3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94f9 expref: 2042 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.102384:0:80279:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c4f7ef lrc: 3/0,0 mode: PR/PR res: [0x2bb3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94f9 expref: 2042 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.102387:0:80279:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b5173ced, rc 0) 00000100:00100000:0.0:1651529343.102401:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2042:41279:x1731746396198464:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 38us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.102404:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210497 00000100:00100000:1.0:1651529343.102823:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.102844:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396198656 00000100:00100000:0.0:1651529343.102855:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210498 00000100:00100000:0.0:1651529343.102856:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2042:41279:x1731746396198656:12345-10.240.43.64@tcp:101:ll_agl_411480.0 00010000:00010000:0.0:1651529343.102860:0:80279:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.102863:0:80279:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c4f7f6 lrc: 2/0,0 mode: --/PR res: [0x2bb19:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9507 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.102868:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.102871:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.102872:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.102874:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c4f7f6 lrc: 3/0,0 mode: PR/PR res: [0x2bb19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9507 expref: 2043 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.102878:0:80279:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c4f7f6 lrc: 3/0,0 mode: PR/PR res: [0x2bb19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9507 expref: 2043 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.102882:0:80279:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004926c34d, rc 0) 00000100:00100000:0.0:1651529343.102895:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2043:41279:x1731746396198656:12345-10.240.43.64@tcp:101:ll_agl_411480.0 Request processed in 38us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.102898:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210498 00000100:00100000:1.0:1651529343.103321:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.103342:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396198848 00000100:00100000:0.0:1651529343.103353:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210499 00000100:00100000:0.0:1651529343.103354:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2043:41278:x1731746396198848:12345-10.240.43.64@tcp:101:ll_agl_411480.0 00010000:00010000:0.0:1651529343.103357:0:80279:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.103361:0:80279:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c4f7fd lrc: 2/0,0 mode: --/PR res: [0x2bb21:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9515 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.103366:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.103370:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.103370:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.103372:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c4f7fd lrc: 3/0,0 mode: PR/PR res: [0x2bb21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9515 expref: 2044 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.103376:0:80279:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c4f7fd lrc: 3/0,0 mode: PR/PR res: [0x2bb21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9515 expref: 2044 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.103380:0:80279:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000092ad010c, rc 0) 00000100:00100000:0.0:1651529343.103393:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2044:41278:x1731746396198848:12345-10.240.43.64@tcp:101:ll_agl_411480.0 Request processed in 38us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.103396:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210499 00000100:00100000:1.0:1651529343.104367:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.104388:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396199296 00000100:00100000:0.0:1651529343.104399:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210500 00000100:00100000:0.0:1651529343.104401:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2044:41279:x1731746396199296:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00010000:00010000:0.0:1651529343.104405:0:80279:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.104409:0:80279:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c4f804 lrc: 2/0,0 mode: --/PR res: [0x2bb2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9538 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.104414:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.104417:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.104418:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.104420:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c4f804 lrc: 3/0,0 mode: PR/PR res: [0x2bb2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9538 expref: 2045 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.104424:0:80279:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c4f804 lrc: 3/0,0 mode: PR/PR res: [0x2bb2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9538 expref: 2045 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.104428:0:80279:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004cff9fc3, rc 0) 00000100:00100000:0.0:1651529343.104441:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2045:41279:x1731746396199296:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 40us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.104444:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210500 00000100:00100000:1.0:1651529343.108688:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.108707:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396200640 00000100:00100000:0.0:1651529343.108723:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210501 00000100:00100000:0.0:1651529343.108725:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2045:41278:x1731746396200640:12345-10.240.43.64@tcp:101:ll_agl_411480.0 00010000:00010000:0.0:1651529343.108729:0:80279:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.108744:0:80279:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c4f80b lrc: 2/0,0 mode: --/PR res: [0x2bb38:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d959a expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.108751:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.108755:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.108756:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.108758:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c4f80b lrc: 3/0,0 mode: PR/PR res: [0x2bb38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d959a expref: 2046 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.108763:0:80279:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c4f80b lrc: 3/0,0 mode: PR/PR res: [0x2bb38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d959a expref: 2046 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.108767:0:80279:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b1b8f74, rc 0) 00000100:00100000:0.0:1651529343.108783:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2046:41278:x1731746396200640:12345-10.240.43.64@tcp:101:ll_agl_411480.0 Request processed in 58us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.108787:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210501 00000100:00100000:1.0:1651529343.109312:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.109330:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396200832 00000100:00100000:0.0:1651529343.109343:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210502 00000100:00100000:0.0:1651529343.109345:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2046:41279:x1731746396200832:12345-10.240.43.64@tcp:101:ll_agl_411480.0 00010000:00010000:0.0:1651529343.109348:0:80279:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.109356:0:80279:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c4f812 lrc: 2/0,0 mode: --/PR res: [0x2bb3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d95a8 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.109362:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.109366:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.109366:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.109368:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c4f812 lrc: 3/0,0 mode: PR/PR res: [0x2bb3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95a8 expref: 2047 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.109372:0:80279:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c4f812 lrc: 3/0,0 mode: PR/PR res: [0x2bb3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95a8 expref: 2047 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.109376:0:80279:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000075f9ff9d, rc 0) 00000100:00100000:0.0:1651529343.109392:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2047:41279:x1731746396200832:12345-10.240.43.64@tcp:101:ll_agl_411480.0 Request processed in 46us (80us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.109395:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210502 00000100:00100000:1.0:1651529343.111147:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.111165:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396201408 00000100:00100000:0.0:1651529343.111178:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210503 00000100:00100000:0.0:1651529343.111180:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2047:41278:x1731746396201408:12345-10.240.43.64@tcp:101:ll_agl_411480.0 00010000:00010000:0.0:1651529343.111183:0:80279:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.111187:0:80279:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c4f819 lrc: 2/0,0 mode: --/PR res: [0x2bb14:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d95d2 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.111193:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.111197:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.111198:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.111199:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c4f819 lrc: 3/0,0 mode: PR/PR res: [0x2bb14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95d2 expref: 2048 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.111204:0:80279:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c4f819 lrc: 3/0,0 mode: PR/PR res: [0x2bb14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95d2 expref: 2048 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.111208:0:80279:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d2b9655c, rc 0) 00000100:00100000:0.0:1651529343.111237:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2048:41278:x1731746396201408:12345-10.240.43.64@tcp:101:ll_agl_411480.0 Request processed in 56us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.111240:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210503 00000100:00100000:1.0:1651529343.111732:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.111755:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396201600 00000100:00100000:0.0:1651529343.111767:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210504 00000100:00100000:0.0:1651529343.111769:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2048:41279:x1731746396201600:12345-10.240.43.64@tcp:101:ll_agl_411480.0 00010000:00010000:0.0:1651529343.111773:0:80279:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.111777:0:80279:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c4f820 lrc: 2/0,0 mode: --/PR res: [0x2bb27:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d95e0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.111782:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.111786:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.111786:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.111788:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c4f820 lrc: 3/0,0 mode: PR/PR res: [0x2bb27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95e0 expref: 2049 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.111792:0:80279:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c4f820 lrc: 3/0,0 mode: PR/PR res: [0x2bb27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95e0 expref: 2049 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.111796:0:80279:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002e24dea3, rc 0) 00000100:00100000:0.0:1651529343.111810:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2049:41279:x1731746396201600:12345-10.240.43.64@tcp:101:ll_agl_411480.0 Request processed in 40us (78us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.111813:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210504 00000100:00100000:1.0:1651529343.112610:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.112628:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396201792 00000100:00100000:0.0:1651529343.112641:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210505 00000100:00100000:0.0:1651529343.112642:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2049:41278:x1731746396201792:12345-10.240.43.64@tcp:101:ll_sa_411480.0 00010000:00010000:0.0:1651529343.112646:0:80279:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.112650:0:80279:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c4f827 lrc: 2/0,0 mode: --/PR res: [0x2bb16:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d95ee expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.112655:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.112658:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.112659:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.112661:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c4f827 lrc: 3/0,0 mode: PR/PR res: [0x2bb16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95ee expref: 2050 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.112665:0:80279:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c4f827 lrc: 3/0,0 mode: PR/PR res: [0x2bb16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95ee expref: 2050 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.112669:0:80279:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000045fe8361, rc 0) 00000100:00100000:0.0:1651529343.112683:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2050:41278:x1731746396201792:12345-10.240.43.64@tcp:101:ll_sa_411480.0 Request processed in 40us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.112686:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210505 00000100:00100000:1.0:1651529343.114503:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.114520:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396202368 00000100:00100000:0.0:1651529343.114533:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210506 00000100:00100000:0.0:1651529343.114535:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2050:41279:x1731746396202368:12345-10.240.43.64@tcp:101:ll_agl_411480.0 00010000:00010000:0.0:1651529343.114538:0:80279:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.114542:0:80279:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c4f82e lrc: 2/0,0 mode: --/PR res: [0x2bb32:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9618 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.114548:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.114551:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.114552:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.114554:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c4f82e lrc: 3/0,0 mode: PR/PR res: [0x2bb32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9618 expref: 2051 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.114558:0:80279:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c4f82e lrc: 3/0,0 mode: PR/PR res: [0x2bb32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9618 expref: 2051 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.114562:0:80279:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000294488b6, rc 0) 00000100:00100000:0.0:1651529343.114576:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2051:41279:x1731746396202368:12345-10.240.43.64@tcp:101:ll_agl_411480.0 Request processed in 41us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.114579:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210506 00000100:00100000:1.0:1651529343.115133:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.115149:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396202560 00000100:00100000:0.0:1651529343.115161:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210507 00000100:00100000:0.0:1651529343.115163:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2051:41278:x1731746396202560:12345-10.240.43.64@tcp:101:ll_agl_411480.0 00010000:00010000:0.0:1651529343.115166:0:80279:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.115170:0:80279:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c4f835 lrc: 2/0,0 mode: --/PR res: [0x2bb3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9626 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.115175:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.115178:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.115179:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.115181:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c4f835 lrc: 3/0,0 mode: PR/PR res: [0x2bb3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9626 expref: 2052 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.115185:0:80279:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c4f835 lrc: 3/0,0 mode: PR/PR res: [0x2bb3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9626 expref: 2052 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.115188:0:80279:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001b109cb1, rc 0) 00000100:00100000:0.0:1651529343.115202:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2052:41278:x1731746396202560:12345-10.240.43.64@tcp:101:ll_agl_411480.0 Request processed in 39us (70us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.115205:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210507 00000100:00100000:1.0:1651529343.115726:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.115752:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396202752 00000100:00100000:0.0:1651529343.115764:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210508 00000100:00100000:0.0:1651529343.115766:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2052:41279:x1731746396202752:12345-10.240.43.64@tcp:101:ll_agl_411480.0 00010000:00010000:0.0:1651529343.115770:0:80279:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.115774:0:80279:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c4f83c lrc: 2/0,0 mode: --/PR res: [0x2bb3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9634 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.115779:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.115783:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.115784:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.115786:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c4f83c lrc: 3/0,0 mode: PR/PR res: [0x2bb3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9634 expref: 2053 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.115790:0:80279:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c4f83c lrc: 3/0,0 mode: PR/PR res: [0x2bb3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9634 expref: 2053 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.115794:0:80279:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d52cc749, rc 0) 00000100:00100000:0.0:1651529343.115808:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2053:41279:x1731746396202752:12345-10.240.43.64@tcp:101:ll_agl_411480.0 Request processed in 41us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.115811:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210508 00000100:00100000:1.0:1651529343.116362:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.116383:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396202944 00000100:00100000:0.0:1651529343.116395:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210509 00000100:00100000:0.0:1651529343.116396:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2053:41279:x1731746396202944:12345-10.240.43.64@tcp:101:ll_agl_411480.0 00010000:00010000:0.0:1651529343.116399:0:80279:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.116403:0:80279:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c4f843 lrc: 2/0,0 mode: --/PR res: [0x2bb22:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9642 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.116408:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.116412:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.116413:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.116414:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c4f843 lrc: 3/0,0 mode: PR/PR res: [0x2bb22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9642 expref: 2054 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.116418:0:80279:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c4f843 lrc: 3/0,0 mode: PR/PR res: [0x2bb22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9642 expref: 2054 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.116422:0:80279:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000093b5c984, rc 0) 00000100:00100000:0.0:1651529343.116436:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2054:41279:x1731746396202944:12345-10.240.43.64@tcp:101:ll_agl_411480.0 Request processed in 39us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.116438:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210509 00000100:00100000:1.0:1651529343.119844:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529343.119865:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396204096 00000100:00100000:0.0:1651529343.119878:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210510 00000100:00100000:0.0:1651529343.119879:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2054:41279:x1731746396204096:12345-10.240.43.64@tcp:101:ll_agl_411480.0 00010000:00010000:0.0:1651529343.119883:0:80279:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529343.119890:0:80279:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c4f84a lrc: 2/0,0 mode: --/PR res: [0x2bb2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9696 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529343.119896:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529343.119899:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.119900:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529343.119902:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c4f84a lrc: 3/0,0 mode: PR/PR res: [0x2bb2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9696 expref: 2055 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.119906:0:80279:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c4f84a lrc: 3/0,0 mode: PR/PR res: [0x2bb2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9696 expref: 2055 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529343.119910:0:80279:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f616ea25, rc 0) 00000100:00100000:0.0:1651529343.119925:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2055:41279:x1731746396204096:12345-10.240.43.64@tcp:101:ll_agl_411480.0 Request processed in 45us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.119927:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210510 00000100:00100000:1.0:1651529343.200141:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529343.200165:0:72398:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946325120 00000100:00100000:0.0:1651529343.200180:0:72398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 568 00000100:00100000:0.0:1651529343.200182:0:72398:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003ffbc5dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946325120:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651529343.200192:0:72398:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8580544 pending 0 free 81328046080 avail 77157335040 00000100:00100000:0.0:1651529343.200209:0:72398:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003ffbc5dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946325120:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 27us (68us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529343.200212:0:72398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 568 00000100:00100000:1.0:1651529344.386262:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.386277:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.386285:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.386289:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946325248 00000100:00100000:1.0:1651529344.386292:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.386300:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.386309:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946325376 00000100:00100000:1.0:1651529344.386312:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.386321:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946325504 00000100:00100000:0.0:1651529344.386327:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946325632 00000100:00100000:1.0:1651529344.386331:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.386333:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946325312 00000100:00100000:0.0:1651529344.386344:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946325440 00000100:00100000:0.0:1651529344.386348:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946325568 00000100:00100000:1.0:1651529344.386350:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.386353:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210511 00000100:00100000:0.0:1651529344.386355:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946325248:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.386359:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946325696 00000100:00100000:1.0:1651529344.386368:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210512 00002000:00080000:0.0:1651529344.386369:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176959 count 1 00000100:00100000:1.0:1651529344.386371:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946325376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.386378:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176961 count 1 00010000:00010000:0.0:1651529344.386381:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4f851 lrc: 3/0,1 mode: --/PW res: [0x2b33f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.386385:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4f858 lrc: 3/0,1 mode: --/PW res: [0x2b341:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.386390:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002c653241/0x3234de053c4e327 lrc: 2/0,0 mode: PR/PR res: [0x2b33f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3db1 expref: 2054 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.386391:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000cd0c9be/0x3234de053c4de26 lrc: 2/0,0 mode: PR/PR res: [0x2b341:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d29a6 expref: 2054 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.386395:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.386395:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.386396:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.386396:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.386397:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4f858 lrc: 4/0,1 mode: --/PW res: [0x2b341:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.386397:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4f851 lrc: 4/0,1 mode: --/PW res: [0x2b33f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.386410:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000cd0c9be/0x3234de053c4de26 lrc: 3/0,0 mode: PR/PR res: [0x2b341:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d29a6 expref: 2054 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.386410:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002c653241/0x3234de053c4e327 lrc: 3/0,0 mode: PR/PR res: [0x2b33f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3db1 expref: 2054 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.386416:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002c653241/0x3234de053c4e327 lrc: 4/0,0 mode: PR/PR res: [0x2b33f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3db1 expref: 2054 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.386418:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000cd0c9be/0x3234de053c4de26 lrc: 4/0,0 mode: PR/PR res: [0x2b341:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d29a6 expref: 2054 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.386422:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a223a622 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996939456:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.386422:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996939520:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.386448:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a6b79b05 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.386448:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c8d20cf1 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.386455:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210513 00000100:00100000:1.0:1651529344.386457:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946325504:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.386462:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176963 count 1 00000100:00100000:0.0:1651529344.386463:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210514 00000100:00100000:0.0:1651529344.386465:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946325632:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.386466:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4f85f lrc: 3/0,1 mode: --/PW res: [0x2b343:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.386471:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4e113 lrc: 2/0,0 mode: PR/PR res: [0x2b343:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d34dc expref: 2054 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.386471:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176965 count 1 00010000:00010000:1.0:1651529344.386474:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.386474:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.386475:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4f85f lrc: 4/0,1 mode: --/PW res: [0x2b343:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.386476:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4f866 lrc: 3/0,1 mode: --/PW res: [0x2b345:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.386481:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000020b57374/0x3234de053c4a515 lrc: 2/0,0 mode: PR/PR res: [0x2b345:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbaef expref: 2054 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.386483:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4e113 lrc: 3/0,0 mode: PR/PR res: [0x2b343:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d34dc expref: 2054 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.386484:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.386484:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.386485:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4f866 lrc: 4/0,1 mode: --/PW res: [0x2b345:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.386486:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4e113 lrc: 4/0,0 mode: PR/PR res: [0x2b343:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d34dc expref: 2054 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.386492:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000020b57374/0x3234de053c4a515 lrc: 3/0,0 mode: PR/PR res: [0x2b345:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbaef expref: 2054 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.386493:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000065f5e47d pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996939584:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.386499:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000020b57374/0x3234de053c4a515 lrc: 4/0,0 mode: PR/PR res: [0x2b345:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbaef expref: 2054 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.386500:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 0000000071742acc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.386503:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996939648:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.386507:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210515 00000100:00100000:1.0:1651529344.386509:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946325312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.386511:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 000000007b78c9d8 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.386513:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176960 count 1 00010000:00010000:1.0:1651529344.386517:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4f86d lrc: 3/0,1 mode: --/PW res: [0x2b340:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.386518:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210516 00000100:00100000:0.0:1651529344.386520:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a13808c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946325440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.386522:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c4e079 lrc: 2/0,0 mode: PR/PR res: [0x2b340:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3297 expref: 2054 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.386525:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.386525:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:0.0:1651529344.386525:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176962 count 1 00010000:00010000:1.0:1651529344.386526:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4f86d lrc: 4/0,1 mode: --/PW res: [0x2b340:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.386528:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4f874 lrc: 3/0,1 mode: --/PW res: [0x2b342:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.386532:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c4e079 lrc: 3/0,0 mode: PR/PR res: [0x2b340:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3297 expref: 2054 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.386533:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006e783e5a/0x3234de053c4ca76 lrc: 2/0,0 mode: PR/PR res: [0x2b342:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb87 expref: 2054 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.386536:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c4e079 lrc: 4/0,0 mode: PR/PR res: [0x2b340:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3297 expref: 2054 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.386536:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.386537:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.386538:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4f874 lrc: 4/0,1 mode: --/PW res: [0x2b342:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.386540:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c9f4ec84 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996939712:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.386544:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006e783e5a/0x3234de053c4ca76 lrc: 3/0,0 mode: PR/PR res: [0x2b342:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb87 expref: 2054 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.386547:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 0000000018ebe812 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.386547:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006e783e5a/0x3234de053c4ca76 lrc: 4/0,0 mode: PR/PR res: [0x2b342:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb87 expref: 2054 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.386553:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210517 00000100:00100000:1.0:1651529344.386555:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946325568:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.386555:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996939776:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.386560:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176964 count 1 00000100:00100000:0.0:1651529344.386562:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 000000001ec7f4cb going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.386563:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4f87b lrc: 3/0,1 mode: --/PW res: [0x2b344:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.386568:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4f40cb6/0x3234de053c4ed8b lrc: 2/0,0 mode: PR/PR res: [0x2b344:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d68a6 expref: 2054 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.386568:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210518 00000100:00100000:0.0:1651529344.386570:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946325696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.386571:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.386571:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.386572:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4f87b lrc: 4/0,1 mode: --/PW res: [0x2b344:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.386575:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176966 count 1 00010000:00010000:1.0:1651529344.386578:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b4f40cb6/0x3234de053c4ed8b lrc: 3/0,0 mode: PR/PR res: [0x2b344:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d68a6 expref: 2054 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.386578:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4f882 lrc: 3/0,1 mode: --/PW res: [0x2b346:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.386581:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b4f40cb6/0x3234de053c4ed8b lrc: 4/0,0 mode: PR/PR res: [0x2b344:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d68a6 expref: 2054 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.386583:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c4eeaa lrc: 2/0,0 mode: PR/PR res: [0x2b346:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ca4 expref: 2054 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.386585:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bc420ca1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996939840:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.386586:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.386586:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.386587:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4f882 lrc: 4/0,1 mode: --/PW res: [0x2b346:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.386592:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8a0b704 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.386593:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c4eeaa lrc: 3/0,0 mode: PR/PR res: [0x2b346:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ca4 expref: 2054 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.386597:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c4eeaa lrc: 4/0,0 mode: PR/PR res: [0x2b346:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ca4 expref: 2054 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.386600:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009b8db73b pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996939904:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.386607:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000efb6ae52 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.387090:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c9f4ec84 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996939712:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.387091:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996939648:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.387097:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4f86d lrc: 3/0,1 mode: --/PW res: [0x2b340:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387097:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4f866 lrc: 3/0,1 mode: --/PW res: [0x2b345:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.387105:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000065f5e47d pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996939584:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.387106:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996939776:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.387108:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4f85f lrc: 3/0,1 mode: --/PW res: [0x2b343:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387109:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4f874 lrc: 3/0,1 mode: --/PW res: [0x2b342:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.387114:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bc420ca1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996939840:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.387115:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996939520:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.387117:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4f87b lrc: 3/0,1 mode: --/PW res: [0x2b344:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387118:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4f851 lrc: 3/0,1 mode: --/PW res: [0x2b33f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.387123:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a223a622 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996939456:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.387125:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4f858 lrc: 3/0,1 mode: --/PW res: [0x2b341:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.387281:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.387300:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.387307:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009b8db73b pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996939904:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.387308:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.387311:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4f882 lrc: 3/0,1 mode: --/PW res: [0x2b346:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.387315:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.387324:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.387329:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.387331:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396206400 00010000:00010000:0.0:1651529344.387338:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4e113 lrc: 4/0,0 mode: PR/PR res: [0x2b343:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d34dc expref: 2055 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.387346:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.387357:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396206528 00000100:00100000:1.0:1651529344.387360:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.387360:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000020b57374/0x3234de053c4a515 lrc: 4/0,0 mode: PR/PR res: [0x2b345:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbaef expref: 2056 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.387365:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396206720 00010000:00010000:0.0:1651529344.387367:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b4f40cb6/0x3234de053c4ed8b lrc: 4/0,0 mode: PR/PR res: [0x2b344:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d68a6 expref: 2057 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.387368:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396206336 00010000:00010000:1.0:1651529344.387374:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000cd0c9be/0x3234de053c4de26 lrc: 4/0,0 mode: PR/PR res: [0x2b341:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d29a6 expref: 2058 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.387375:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396206464 00010000:00010000:0.0:1651529344.387377:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002c653241/0x3234de053c4e327 lrc: 4/0,0 mode: PR/PR res: [0x2b33f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3db1 expref: 2059 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.387381:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396206592 00000100:00100000:1.0:1651529344.387382:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396206656 00010000:00010000:1.0:1651529344.387384:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006e783e5a/0x3234de053c4ca76 lrc: 4/0,0 mode: PR/PR res: [0x2b342:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb87 expref: 2061 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.387384:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c4e079 lrc: 4/0,0 mode: PR/PR res: [0x2b340:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3297 expref: 2061 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.387388:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396206784 00000100:00100000:1.0:1651529344.387390:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11293 00010000:00010000:0.0:1651529344.387390:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c4eeaa lrc: 4/0,0 mode: PR/PR res: [0x2b346:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ca4 expref: 2062 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.387392:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2062:41279:x1731746396206400:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.387395:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11294 00010000:00010000:1.0:1651529344.387396:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.387397:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de23fde4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2062:41279:x1731746396206528:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.387398:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4e113 lrc: 4/0,0 mode: PR/PR res: [0x2b343:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d34dc expref: 2062 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.387401:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.387402:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4e113 lrc: 3/0,0 mode: PR/PR res: [0x2b343:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d34dc expref: 2062 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.387402:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000020b57374/0x3234de053c4a515 lrc: 4/0,0 mode: PR/PR res: [0x2b345:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbaef expref: 2062 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.387406:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000020b57374/0x3234de053c4a515 lrc: 3/0,0 mode: PR/PR res: [0x2b345:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbaef expref: 2062 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.387412:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4e113 lrc: 0/0,0 mode: --/PR res: [0x2b343:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d34dc expref: 2062 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.387412:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020b57374/0x3234de053c4a515 lrc: 0/0,0 mode: --/PR res: [0x2b345:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbaef expref: 2062 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.387416:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.387416:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.387417:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.387417:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.387418:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4f85f lrc: 3/0,1 mode: PW/PW res: [0x2b343:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387418:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4f866 lrc: 3/0,1 mode: PW/PW res: [0x2b345:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387421:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4f866 lrc: 4/0,1 mode: PW/PW res: [0x2b345:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.387422:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4f85f lrc: 4/0,1 mode: PW/PW res: [0x2b343:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.387429:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.387429:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.387445:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de23fde4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2060:41279:x1731746396206528:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 47us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.387448:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2060:41279:x1731746396206400:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 55us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.387448:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11294 00000100:00100000:1.0:1651529344.387451:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11293 00000100:00100000:0.0:1651529344.387455:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11295 00000100:00100000:0.0:1651529344.387456:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2058:41279:x1731746396206720:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.387459:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.387461:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b4f40cb6/0x3234de053c4ed8b lrc: 4/0,0 mode: PR/PR res: [0x2b344:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d68a6 expref: 2058 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.387465:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11296 00010000:00010000:0.0:1651529344.387465:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b4f40cb6/0x3234de053c4ed8b lrc: 3/0,0 mode: PR/PR res: [0x2b344:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d68a6 expref: 2058 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.387467:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2058:41279:x1731746396206336:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.387470:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.387470:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4f40cb6/0x3234de053c4ed8b lrc: 0/0,0 mode: --/PR res: [0x2b344:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d68a6 expref: 2058 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.387471:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000cd0c9be/0x3234de053c4de26 lrc: 4/0,0 mode: PR/PR res: [0x2b341:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d29a6 expref: 2058 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.387473:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.387474:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.387475:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000cd0c9be/0x3234de053c4de26 lrc: 3/0,0 mode: PR/PR res: [0x2b341:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d29a6 expref: 2057 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.387475:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4f87b lrc: 3/0,1 mode: PW/PW res: [0x2b344:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387480:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4f87b lrc: 4/0,1 mode: PW/PW res: [0x2b344:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.387481:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000cd0c9be/0x3234de053c4de26 lrc: 0/0,0 mode: --/PR res: [0x2b341:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d29a6 expref: 2057 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.387484:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.387485:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.387485:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4f858 lrc: 3/0,1 mode: PW/PW res: [0x2b341:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387489:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.387495:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4f858 lrc: 4/0,1 mode: PW/PW res: [0x2b341:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.387495:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2056:41279:x1731746396206720:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.387498:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11295 00010000:00010000:1.0:1651529344.387501:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.387502:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11297 00000100:00100000:0.0:1651529344.387504:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2055:41279:x1731746396206464:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.387506:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.387507:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2055:41279:x1731746396206336:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 40us (192us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.387508:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002c653241/0x3234de053c4e327 lrc: 4/0,0 mode: PR/PR res: [0x2b33f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3db1 expref: 2055 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.387510:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11296 00010000:00010000:0.0:1651529344.387511:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002c653241/0x3234de053c4e327 lrc: 3/0,0 mode: PR/PR res: [0x2b33f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3db1 expref: 2055 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.387515:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11298 00010000:00010000:0.0:1651529344.387516:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c653241/0x3234de053c4e327 lrc: 0/0,0 mode: --/PR res: [0x2b33f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3db1 expref: 2054 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.387517:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2054:41279:x1731746396206592:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.387519:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.387519:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.387520:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c4e079 lrc: 4/0,0 mode: PR/PR res: [0x2b340:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3297 expref: 2053 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.387520:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.387521:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4f851 lrc: 3/0,1 mode: PW/PW res: [0x2b33f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.387524:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c4e079 lrc: 3/0,0 mode: PR/PR res: [0x2b340:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3297 expref: 2053 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.387524:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4f851 lrc: 4/0,1 mode: PW/PW res: [0x2b33f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.387529:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c4e079 lrc: 0/0,0 mode: --/PR res: [0x2b340:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3297 expref: 2053 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.387533:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.387533:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.387533:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.387534:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4f86d lrc: 3/0,1 mode: PW/PW res: [0x2b340:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.387537:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4f86d lrc: 4/0,1 mode: PW/PW res: [0x2b340:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.387538:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2052:41279:x1731746396206464:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.387541:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11297 00010000:00010000:1.0:1651529344.387542:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.387545:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11299 00000100:00100000:0.0:1651529344.387546:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2051:41279:x1731746396206656:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.387547:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2051:41279:x1731746396206592:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 30us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.387549:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11298 00010000:00010000:0.0:1651529344.387549:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.387550:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006e783e5a/0x3234de053c4ca76 lrc: 4/0,0 mode: PR/PR res: [0x2b342:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb87 expref: 2051 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.387553:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11300 00010000:00010000:0.0:1651529344.387554:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006e783e5a/0x3234de053c4ca76 lrc: 3/0,0 mode: PR/PR res: [0x2b342:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb87 expref: 2050 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.387555:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2050:41279:x1731746396206784:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.387557:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.387558:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c4eeaa lrc: 4/0,0 mode: PR/PR res: [0x2b346:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ca4 expref: 2050 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.387558:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e783e5a/0x3234de053c4ca76 lrc: 0/0,0 mode: --/PR res: [0x2b342:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb87 expref: 2050 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.387562:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c4eeaa lrc: 3/0,0 mode: PR/PR res: [0x2b346:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ca4 expref: 2049 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.387562:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.387562:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.387563:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4f874 lrc: 3/0,1 mode: PW/PW res: [0x2b342:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387565:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4f874 lrc: 4/0,1 mode: PW/PW res: [0x2b342:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.387567:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c4eeaa lrc: 0/0,0 mode: --/PR res: [0x2b346:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ca4 expref: 2049 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.387571:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.387573:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.387574:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.387574:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4f882 lrc: 3/0,1 mode: PW/PW res: [0x2b346:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.387576:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2048:41279:x1731746396206656:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 29us (230us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.387577:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4f882 lrc: 4/0,1 mode: PW/PW res: [0x2b346:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.387579:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11299 00010000:00010000:1.0:1651529344.387587:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.387592:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2047:41279:x1731746396206784:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.387594:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11300 00010000:00010000:0.0:1651529344.387596:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4f866 lrc: 3/0,1 mode: PW/PW res: [0x2b345:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387599:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4f866 lrc: 3/0,1 mode: PW/PW res: [0x2b345:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.387601:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4f85f lrc: 3/0,1 mode: PW/PW res: [0x2b343:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387603:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4f866 lrc: 3/0,1 mode: PW/PW res: [0x2b345:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.387604:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4f85f lrc: 3/0,1 mode: PW/PW res: [0x2b343:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387606:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4f866 lrc: 2/0,0 mode: PW/PW res: [0x2b345:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.387607:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4f85f lrc: 3/0,1 mode: PW/PW res: [0x2b343:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.387610:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4f85f lrc: 2/0,0 mode: PW/PW res: [0x2b343:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.387709:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:39030:x1731745946325504:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1251us (1424us total) trans 12885078567 rc 0/0 00000100:00100000:0.0:1651529344.387710:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:39030:x1731745946325632:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1243us (1417us total) trans 12885078566 rc 0/0 00000100:00100000:1.0:1651529344.387713:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210513 00000100:00100000:0.0:1651529344.387715:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210514 00010000:00010000:1.0:1651529344.387720:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4f86d lrc: 3/0,1 mode: PW/PW res: [0x2b340:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.387724:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4f86d lrc: 3/0,1 mode: PW/PW res: [0x2b340:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387724:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4f866 lrc: 2/0,0 mode: PW/PW res: [0x2b345:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.387727:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4f86d lrc: 3/0,1 mode: PW/PW res: [0x2b340:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387727:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e35b0bde already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.387729:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4f86d lrc: 2/0,0 mode: PW/PW res: [0x2b340:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387729:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4f866 lrc: 2/0,0 mode: PW/PW res: [0x2b345:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387733:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4f866 lrc: 3/0,0 mode: PW/PW res: [0x2b345:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387756:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4f866 lrc: 1/0,0 mode: --/PW res: [0x2b345:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387759:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4f866 lrc: 0/0,0 mode: --/PW res: [0x2b345:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387764:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4f85f lrc: 2/0,0 mode: PW/PW res: [0x2b343:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387767:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000040cd657 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.387768:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4f85f lrc: 2/0,0 mode: PW/PW res: [0x2b343:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387771:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4f85f lrc: 3/0,0 mode: PW/PW res: [0x2b343:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387774:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4f85f lrc: 1/0,0 mode: --/PW res: [0x2b343:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387777:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4f85f lrc: 0/0,0 mode: --/PW res: [0x2b343:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387781:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4f86d lrc: 2/0,0 mode: PW/PW res: [0x2b340:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387783:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000093dbd0d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.387784:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4f86d lrc: 2/0,0 mode: PW/PW res: [0x2b340:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.387787:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946325312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1277us (1487us total) trans 12885078568 rc 0/0 00010000:00010000:0.0:1651529344.387789:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4f86d lrc: 3/0,0 mode: PW/PW res: [0x2b340:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.387790:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210515 00010000:00010000:0.0:1651529344.387793:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4f86d lrc: 1/0,0 mode: --/PW res: [0x2b340:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387795:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4f86d lrc: 0/0,0 mode: --/PW res: [0x2b340:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.387797:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4f87b lrc: 3/0,1 mode: PW/PW res: [0x2b344:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.387800:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4f87b lrc: 3/0,1 mode: PW/PW res: [0x2b344:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.387803:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4f87b lrc: 3/0,1 mode: PW/PW res: [0x2b344:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387803:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4f874 lrc: 3/0,1 mode: PW/PW res: [0x2b342:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387805:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4f874 lrc: 3/0,1 mode: PW/PW res: [0x2b342:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.387806:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4f87b lrc: 2/0,0 mode: PW/PW res: [0x2b344:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387808:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4f874 lrc: 3/0,1 mode: PW/PW res: [0x2b342:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387811:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4f874 lrc: 2/0,0 mode: PW/PW res: [0x2b342:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.387848:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:39030:x1731745946325568:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1293us (1522us total) trans 12885078569 rc 0/0 00000100:00100000:1.0:1651529344.387851:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210517 00010000:00010000:1.0:1651529344.387858:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4f858 lrc: 3/0,1 mode: PW/PW res: [0x2b341:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.387859:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a13808c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946325440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1338us (1547us total) trans 12885078570 rc 0/0 00010000:00010000:1.0:1651529344.387861:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4f858 lrc: 3/0,1 mode: PW/PW res: [0x2b341:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.387863:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210516 00010000:00010000:1.0:1651529344.387864:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4f858 lrc: 3/0,1 mode: PW/PW res: [0x2b341:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.387867:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4f858 lrc: 2/0,0 mode: PW/PW res: [0x2b341:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387870:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4f87b lrc: 2/0,0 mode: PW/PW res: [0x2b344:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387883:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000579ed558 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.387884:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4f87b lrc: 2/0,0 mode: PW/PW res: [0x2b344:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387887:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4f87b lrc: 3/0,0 mode: PW/PW res: [0x2b344:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387892:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4f87b lrc: 1/0,0 mode: --/PW res: [0x2b344:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387895:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4f87b lrc: 0/0,0 mode: --/PW res: [0x2b344:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387899:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4f874 lrc: 2/0,0 mode: PW/PW res: [0x2b342:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387902:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b65e0a0d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.387903:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4f874 lrc: 2/0,0 mode: PW/PW res: [0x2b342:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387906:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4f874 lrc: 3/0,0 mode: PW/PW res: [0x2b342:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.387907:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946325376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1536us (1630us total) trans 12885078571 rc 0/0 00010000:00010000:0.0:1651529344.387909:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4f874 lrc: 1/0,0 mode: --/PW res: [0x2b342:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.387910:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210512 00010000:00010000:0.0:1651529344.387911:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4f874 lrc: 0/0,0 mode: --/PW res: [0x2b342:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387915:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4f858 lrc: 2/0,0 mode: PW/PW res: [0x2b341:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387918:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065c40e6a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.387919:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4f858 lrc: 2/0,0 mode: PW/PW res: [0x2b341:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387921:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4f858 lrc: 3/0,0 mode: PW/PW res: [0x2b341:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387925:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4f858 lrc: 1/0,0 mode: --/PW res: [0x2b341:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387927:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4f858 lrc: 0/0,0 mode: --/PW res: [0x2b341:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387934:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4f882 lrc: 3/0,1 mode: PW/PW res: [0x2b346:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387936:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4f882 lrc: 3/0,1 mode: PW/PW res: [0x2b346:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387939:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4f882 lrc: 3/0,1 mode: PW/PW res: [0x2b346:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.387942:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4f882 lrc: 2/0,0 mode: PW/PW res: [0x2b346:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.387981:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946325696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1411us (1631us total) trans 12885078572 rc 0/0 00000100:00100000:0.0:1651529344.387985:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210518 00010000:00010000:0.0:1651529344.387991:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4f882 lrc: 2/0,0 mode: PW/PW res: [0x2b346:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.388012:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003c5315da already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.388014:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4f882 lrc: 2/0,0 mode: PW/PW res: [0x2b346:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.388018:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4f851 lrc: 3/0,1 mode: PW/PW res: [0x2b33f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.388022:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4f851 lrc: 3/0,1 mode: PW/PW res: [0x2b33f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.388026:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4f851 lrc: 3/0,1 mode: PW/PW res: [0x2b33f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.388028:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4f851 lrc: 2/0,0 mode: PW/PW res: [0x2b33f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.388035:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4f882 lrc: 3/0,0 mode: PW/PW res: [0x2b346:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.388056:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4f882 lrc: 1/0,0 mode: --/PW res: [0x2b346:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.388059:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4f882 lrc: 0/0,0 mode: --/PW res: [0x2b346:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.388063:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4f851 lrc: 2/0,0 mode: PW/PW res: [0x2b33f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.388066:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000041a7efd7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.388067:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4f851 lrc: 2/0,0 mode: PW/PW res: [0x2b33f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.388072:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4f851 lrc: 3/0,0 mode: PW/PW res: [0x2b33f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.388076:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4f851 lrc: 1/0,0 mode: --/PW res: [0x2b33f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.388078:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946325248:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1722us (1819us total) trans 12885078573 rc 0/0 00010000:00010000:0.0:1651529344.388078:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4f851 lrc: 0/0,0 mode: --/PW res: [0x2b33f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.388081:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210511 00000100:00100000:1.0:1651529344.388246:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.388272:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.388283:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946326272 00000100:00100000:1.0:1651529344.388284:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.388291:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.388291:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946326336 00000100:00100000:0.0:1651529344.388298:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946326400 00000100:00100000:1.0:1651529344.388302:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.388302:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946326528 00000100:00100000:0.0:1651529344.388306:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946326656 00000100:00100000:1.0:1651529344.388309:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.388310:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210519 00000100:00100000:0.0:1651529344.388312:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+17:39030:x1731745946326272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.388316:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.388318:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176967 count 1 00000100:00100000:1.0:1651529344.388323:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946326464 00010000:00010000:0.0:1651529344.388323:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4f889 lrc: 3/0,1 mode: --/PW res: [0x2b347:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.388328:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c4ce97 lrc: 2/0,0 mode: PR/PR res: [0x2b347:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec66 expref: 2046 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.388329:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946326592 00010000:00010000:0.0:1651529344.388331:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.388332:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210520 00010000:00010000:0.0:1651529344.388332:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.388332:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4f889 lrc: 4/0,1 mode: --/PW res: [0x2b347:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.388334:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000650a05a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+19:39029:x1731745946326336:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.388340:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176968 count 1 00010000:00010000:1.0:1651529344.388345:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4f890 lrc: 3/0,1 mode: --/PW res: [0x2b348:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.388350:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c49ff1 lrc: 2/0,0 mode: PR/PR res: [0x2b348:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5a8 expref: 2046 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.388353:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.388354:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.388355:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4f890 lrc: 4/0,1 mode: --/PW res: [0x2b348:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.388371:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c4ce97 lrc: 3/0,0 mode: PR/PR res: [0x2b347:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec66 expref: 2046 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.388376:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c4ce97 lrc: 4/0,0 mode: PR/PR res: [0x2b347:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec66 expref: 2046 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.388377:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c49ff1 lrc: 3/0,0 mode: PR/PR res: [0x2b348:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5a8 expref: 2046 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.388380:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009b8db73b pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996939968:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.388382:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c49ff1 lrc: 4/0,0 mode: PR/PR res: [0x2b348:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5a8 expref: 2046 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.388386:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000027e31dd1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996940032:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.388395:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a52ee82 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.388401:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000018ebe812 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.388402:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210521 00000100:00100000:0.0:1651529344.388404:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+19:39030:x1731745946326400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.388408:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210522 00002000:00080000:0.0:1651529344.388409:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176969 count 1 00000100:00100000:1.0:1651529344.388410:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+19:39030:x1731745946326528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.388415:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176971 count 1 00010000:00010000:1.0:1651529344.388418:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c4f897 lrc: 3/0,1 mode: --/PW res: [0x2b34b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.388419:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011944736/0x3234de053c4f89e lrc: 3/0,1 mode: --/PW res: [0x2b349:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.388423:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005ec63a1b/0x3234de053c4e32e lrc: 2/0,0 mode: PR/PR res: [0x2b34b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3dbf expref: 2046 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.388424:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bd405bc5/0x3234de053c4e60d lrc: 2/0,0 mode: PR/PR res: [0x2b349:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d497a expref: 2046 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.388426:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.388426:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.388427:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c4f897 lrc: 4/0,1 mode: --/PW res: [0x2b34b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.388427:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.388428:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.388429:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011944736/0x3234de053c4f89e lrc: 4/0,1 mode: --/PW res: [0x2b349:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.388433:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005ec63a1b/0x3234de053c4e32e lrc: 3/0,0 mode: PR/PR res: [0x2b34b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3dbf expref: 2046 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.388435:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bd405bc5/0x3234de053c4e60d lrc: 3/0,0 mode: PR/PR res: [0x2b349:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d497a expref: 2046 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.388436:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005ec63a1b/0x3234de053c4e32e lrc: 4/0,0 mode: PR/PR res: [0x2b34b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3dbf expref: 2046 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.388439:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bd405bc5/0x3234de053c4e60d lrc: 4/0,0 mode: PR/PR res: [0x2b349:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d497a expref: 2046 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.388443:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004bb67ba4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996940096:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.388443:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996940160:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.388451:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c34c0cde going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.388452:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000499d0377 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.388457:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210523 00000100:00100000:1.0:1651529344.388459:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210524 00000100:00100000:0.0:1651529344.388459:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+19:39030:x1731745946326656:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.388461:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:39029:x1731745946326464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.388464:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176973 count 1 00002000:00080000:1.0:1651529344.388465:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176970 count 1 00010000:00010000:0.0:1651529344.388467:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c666882/0x3234de053c4f8a5 lrc: 3/0,1 mode: --/PW res: [0x2b34d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.388469:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c4f8ac lrc: 3/0,1 mode: --/PW res: [0x2b34a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.388472:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c4d829 lrc: 2/0,0 mode: PR/PR res: [0x2b34d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d11b2 expref: 2046 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.388473:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000090c3576a/0x3234de053c4de34 lrc: 2/0,0 mode: PR/PR res: [0x2b34a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d29c2 expref: 2046 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.388475:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.388476:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.388476:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.388476:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.388476:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c666882/0x3234de053c4f8a5 lrc: 4/0,1 mode: --/PW res: [0x2b34d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.388477:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c4f8ac lrc: 4/0,1 mode: --/PW res: [0x2b34a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.388482:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c4d829 lrc: 3/0,0 mode: PR/PR res: [0x2b34d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d11b2 expref: 2046 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.388483:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000090c3576a/0x3234de053c4de34 lrc: 3/0,0 mode: PR/PR res: [0x2b34a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d29c2 expref: 2046 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.388486:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000090c3576a/0x3234de053c4de34 lrc: 4/0,0 mode: PR/PR res: [0x2b34a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d29c2 expref: 2046 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.388486:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c4d829 lrc: 4/0,0 mode: PR/PR res: [0x2b34d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d11b2 expref: 2046 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.388490:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000078f9a278 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996940288:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.388490:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996940224:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.388496:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aac39cef going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.388498:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e5f43e7 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.388502:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210525 00000100:00100000:0.0:1651529344.388504:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+19:39029:x1731745946326592:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.388509:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176972 count 1 00010000:00010000:0.0:1651529344.388512:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f998e42c/0x3234de053c4f8b3 lrc: 3/0,1 mode: --/PW res: [0x2b34c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.388515:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.388516:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000411ac620/0x3234de053c4d861 lrc: 2/0,0 mode: PR/PR res: [0x2b34c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d127d expref: 2046 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.388519:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.388519:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.388520:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f998e42c/0x3234de053c4f8b3 lrc: 4/0,1 mode: --/PW res: [0x2b34c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.388526:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000411ac620/0x3234de053c4d861 lrc: 3/0,0 mode: PR/PR res: [0x2b34c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d127d expref: 2046 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.388529:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000411ac620/0x3234de053c4d861 lrc: 4/0,0 mode: PR/PR res: [0x2b34c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d127d expref: 2046 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.388533:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996940352:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.388539:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000382571b5 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.388545:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946326720 00000100:00100000:0.0:1651529344.388556:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210526 00000100:00100000:0.0:1651529344.388558:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+20:39029:x1731745946326720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.388562:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176974 count 1 00010000:00010000:0.0:1651529344.388566:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029d9f199/0x3234de053c4f8ba lrc: 3/0,1 mode: --/PW res: [0x2b34e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.388573:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004e8b8142/0x3234de053c4d8b5 lrc: 2/0,0 mode: PR/PR res: [0x2b34e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d13aa expref: 2046 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.388576:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.388576:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.388577:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029d9f199/0x3234de053c4f8ba lrc: 4/0,1 mode: --/PW res: [0x2b34e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.388583:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004e8b8142/0x3234de053c4d8b5 lrc: 3/0,0 mode: PR/PR res: [0x2b34e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d13aa expref: 2046 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.388586:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004e8b8142/0x3234de053c4d8b5 lrc: 4/0,0 mode: PR/PR res: [0x2b34e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d13aa expref: 2046 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.388590:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996940416:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.388597:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f9dd6aa3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.389036:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.389046:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996940224:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.389056:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.389067:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.389067:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002c666882/0x3234de053c4f8a5 lrc: 3/0,1 mode: --/PW res: [0x2b34d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.389075:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.389083:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.389086:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396207360 00010000:00010000:0.0:1651529344.389091:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c4ce97 lrc: 5/0,0 mode: PR/PR res: [0x2b347:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec66 expref: 2047 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.389106:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396207488 00010000:00010000:0.0:1651529344.389109:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bd405bc5/0x3234de053c4e60d lrc: 5/0,0 mode: PR/PR res: [0x2b349:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d497a expref: 2048 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.389110:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000027e31dd1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996940032:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.389114:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4f890 lrc: 3/0,1 mode: --/PW res: [0x2b348:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.389114:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396207616 00010000:00010000:0.0:1651529344.389116:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c4d829 lrc: 4/0,0 mode: PR/PR res: [0x2b34d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d11b2 expref: 2049 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.389120:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396207424 00000100:00100000:1.0:1651529344.389122:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004bb67ba4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996940096:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.389123:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c49ff1 lrc: 4/0,0 mode: PR/PR res: [0x2b348:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5a8 expref: 2050 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.389124:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c4f897 lrc: 3/0,1 mode: --/PW res: [0x2b34b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.389127:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396207552 00010000:00010000:0.0:1651529344.389129:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005ec63a1b/0x3234de053c4e32e lrc: 4/0,0 mode: PR/PR res: [0x2b34b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3dbf expref: 2051 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.389130:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000078f9a278 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996940288:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.389132:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c4f8ac lrc: 3/0,1 mode: --/PW res: [0x2b34a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.389133:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11301 00000100:00100000:0.0:1651529344.389135:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d46d0fc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2051:41279:x1731746396207360:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.389138:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.389139:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11302 00010000:00010000:0.0:1651529344.389139:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c4ce97 lrc: 5/0,0 mode: PR/PR res: [0x2b347:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec66 expref: 2051 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.389141:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2051:41278:x1731746396207488:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.389142:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c4ce97 lrc: 4/0,0 mode: PR/PR res: [0x2b347:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec66 expref: 2051 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.389145:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.389146:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bd405bc5/0x3234de053c4e60d lrc: 5/0,0 mode: PR/PR res: [0x2b349:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d497a expref: 2051 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.389149:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.389149:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.389150:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bd405bc5/0x3234de053c4e60d lrc: 4/0,0 mode: PR/PR res: [0x2b349:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d497a expref: 2051 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.389150:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4f889 lrc: 3/0,1 mode: PW/PW res: [0x2b347:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389156:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4f889 lrc: 4/0,1 mode: PW/PW res: [0x2b347:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.389159:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.389160:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.389160:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.389161:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000011944736/0x3234de053c4f89e lrc: 3/0,1 mode: PW/PW res: [0x2b349:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.389164:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011944736/0x3234de053c4f89e lrc: 4/0,1 mode: PW/PW res: [0x2b349:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.389169:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.389174:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d46d0fc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2051:41279:x1731746396207360:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 38us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.389177:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11301 00000100:00100000:1.0:1651529344.389182:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2051:41278:x1731746396207488:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 41us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.389215:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11302 00000100:00100000:0.0:1651529344.389218:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11303 00000100:00100000:0.0:1651529344.389220:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2049:41278:x1731746396207616:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.389221:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11304 00000100:00100000:1.0:1651529344.389233:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2049:41279:x1731746396207424:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.389235:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.389236:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.389237:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c4d829 lrc: 4/0,0 mode: PR/PR res: [0x2b34d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d11b2 expref: 2049 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.389238:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c49ff1 lrc: 4/0,0 mode: PR/PR res: [0x2b348:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5a8 expref: 2049 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.389241:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c4d829 lrc: 3/0,0 mode: PR/PR res: [0x2b34d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d11b2 expref: 2049 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.389242:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c49ff1 lrc: 3/0,0 mode: PR/PR res: [0x2b348:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5a8 expref: 2049 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.389246:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c4d829 lrc: 0/0,0 mode: --/PR res: [0x2b34d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d11b2 expref: 2049 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.389248:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c49ff1 lrc: 0/0,0 mode: --/PR res: [0x2b348:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5a8 expref: 2049 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.389250:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.389251:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.389252:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.389252:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.389252:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002c666882/0x3234de053c4f8a5 lrc: 3/0,1 mode: PW/PW res: [0x2b34d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.389253:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4f890 lrc: 3/0,1 mode: PW/PW res: [0x2b348:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389255:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c666882/0x3234de053c4f8a5 lrc: 4/0,1 mode: PW/PW res: [0x2b34d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.389256:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4f890 lrc: 4/0,1 mode: PW/PW res: [0x2b348:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.389263:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.389265:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.389269:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2047:41279:x1731746396207424:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.389271:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11304 00000100:00100000:0.0:1651529344.389272:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2047:41278:x1731746396207616:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 51us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.389275:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11303 00000100:00100000:1.0:1651529344.389276:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11305 00000100:00100000:1.0:1651529344.389278:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2045:41279:x1731746396207552:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.389280:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.389282:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005ec63a1b/0x3234de053c4e32e lrc: 4/0,0 mode: PR/PR res: [0x2b34b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3dbf expref: 2045 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.389285:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005ec63a1b/0x3234de053c4e32e lrc: 3/0,0 mode: PR/PR res: [0x2b34b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3dbf expref: 2045 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.389286:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996940352:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.389289:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f998e42c/0x3234de053c4f8b3 lrc: 3/0,1 mode: --/PW res: [0x2b34c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.389290:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ec63a1b/0x3234de053c4e32e lrc: 0/0,0 mode: --/PR res: [0x2b34b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3dbf expref: 2045 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.389293:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.389293:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.389294:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c4f897 lrc: 3/0,1 mode: PW/PW res: [0x2b34b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.389297:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c4f897 lrc: 4/0,1 mode: PW/PW res: [0x2b34b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389297:0:80280:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd405bc5/0x3234de053c4e60d lrc: 0/0,0 mode: --/PR res: [0x2b349:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d497a expref: 2044 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.389301:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996940160:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.389303:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.389303:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000011944736/0x3234de053c4f89e lrc: 3/0,1 mode: PW/PW res: [0x2b349:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389306:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000011944736/0x3234de053c4f89e lrc: 3/0,1 mode: PW/PW res: [0x2b349:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.389307:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2043:41279:x1731746396207552:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 29us (224us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.389309:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011944736/0x3234de053c4f89e lrc: 3/0,1 mode: PW/PW res: [0x2b349:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.389310:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11305 00010000:00010000:0.0:1651529344.389312:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011944736/0x3234de053c4f89e lrc: 3/0,1 mode: PW/PW res: [0x2b349:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389315:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011944736/0x3234de053c4f89e lrc: 2/0,0 mode: PW/PW res: [0x2b349:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.389316:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4f890 lrc: 3/0,1 mode: PW/PW res: [0x2b348:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.389319:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4f890 lrc: 3/0,1 mode: PW/PW res: [0x2b348:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.389322:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4f890 lrc: 3/0,1 mode: PW/PW res: [0x2b348:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.389325:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4f890 lrc: 2/0,0 mode: PW/PW res: [0x2b348:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.389368:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:39030:x1731745946326400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 963us (1083us total) trans 12885078574 rc 0/0 00000100:00100000:0.0:1651529344.389371:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210521 00000100:00100000:1.0:1651529344.389372:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000650a05a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:39029:x1731745946326336:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1037us (1100us total) trans 12885078575 rc 0/0 00000100:00100000:1.0:1651529344.389375:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210520 00010000:00010000:0.0:1651529344.389379:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011944736/0x3234de053c4f89e lrc: 2/0,0 mode: PW/PW res: [0x2b349:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.389382:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c4f897 lrc: 3/0,1 mode: PW/PW res: [0x2b34b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389382:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000011944736 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.389383:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011944736/0x3234de053c4f89e lrc: 2/0,0 mode: PW/PW res: [0x2b349:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.389385:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c4f897 lrc: 3/0,1 mode: PW/PW res: [0x2b34b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389386:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011944736/0x3234de053c4f89e lrc: 3/0,0 mode: PW/PW res: [0x2b349:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.389389:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c4f897 lrc: 3/0,1 mode: PW/PW res: [0x2b34b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389390:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011944736/0x3234de053c4f89e lrc: 1/0,0 mode: --/PW res: [0x2b349:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.389392:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c4f897 lrc: 2/0,0 mode: PW/PW res: [0x2b34b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389393:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011944736/0x3234de053c4f89e lrc: 0/0,0 mode: --/PW res: [0x2b349:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389398:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4f890 lrc: 2/0,0 mode: PW/PW res: [0x2b348:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389407:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000046d6c242 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.389408:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4f890 lrc: 2/0,0 mode: PW/PW res: [0x2b348:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389414:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4f890 lrc: 3/0,0 mode: PW/PW res: [0x2b348:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389418:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4f890 lrc: 1/0,0 mode: --/PW res: [0x2b348:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389420:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4f890 lrc: 0/0,0 mode: --/PW res: [0x2b348:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389424:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c4f897 lrc: 2/0,0 mode: PW/PW res: [0x2b34b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389427:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c8d9712a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.389427:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c4f897 lrc: 2/0,0 mode: PW/PW res: [0x2b34b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389430:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c4f897 lrc: 3/0,0 mode: PW/PW res: [0x2b34b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.389431:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:39030:x1731745946326528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1020us (1139us total) trans 12885078576 rc 0/0 00000100:00100000:1.0:1651529344.389433:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210522 00010000:00010000:0.0:1651529344.389433:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c4f897 lrc: 1/0,0 mode: --/PW res: [0x2b34b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389436:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c4f897 lrc: 0/0,0 mode: --/PW res: [0x2b34b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389443:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002c666882/0x3234de053c4f8a5 lrc: 3/0,1 mode: PW/PW res: [0x2b34d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389446:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c666882/0x3234de053c4f8a5 lrc: 3/0,1 mode: PW/PW res: [0x2b34d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.389447:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.389449:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c666882/0x3234de053c4f8a5 lrc: 3/0,1 mode: PW/PW res: [0x2b34d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389452:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c666882/0x3234de053c4f8a5 lrc: 2/0,0 mode: PW/PW res: [0x2b34d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.389461:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.389477:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.389505:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:39030:x1731745946326656:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1045us (1203us total) trans 12885078577 rc 0/0 00000100:00100000:0.0:1651529344.389508:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210523 00000100:00100000:0.0:1651529344.389516:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396207680 00010000:00010000:0.0:1651529344.389520:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000090c3576a/0x3234de053c4de34 lrc: 4/0,0 mode: PR/PR res: [0x2b34a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d29c2 expref: 2043 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.389527:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396207744 00010000:00010000:0.0:1651529344.389529:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000411ac620/0x3234de053c4d861 lrc: 4/0,0 mode: PR/PR res: [0x2b34c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d127d expref: 2044 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.389533:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396207808 00010000:00010000:0.0:1651529344.389535:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004e8b8142/0x3234de053c4d8b5 lrc: 5/0,0 mode: PR/PR res: [0x2b34e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d13aa expref: 2045 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.389540:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11306 00000100:00100000:0.0:1651529344.389542:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2045:41279:x1731746396207680:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.389545:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.389546:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000090c3576a/0x3234de053c4de34 lrc: 4/0,0 mode: PR/PR res: [0x2b34a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d29c2 expref: 2045 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.389550:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11307 00010000:00010000:0.0:1651529344.389550:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000090c3576a/0x3234de053c4de34 lrc: 3/0,0 mode: PR/PR res: [0x2b34a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d29c2 expref: 2045 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.389553:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2045:41278:x1731746396207744:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.389555:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090c3576a/0x3234de053c4de34 lrc: 0/0,0 mode: --/PR res: [0x2b34a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d29c2 expref: 2045 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.389556:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.389558:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000411ac620/0x3234de053c4d861 lrc: 4/0,0 mode: PR/PR res: [0x2b34c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d127d expref: 2044 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.389559:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.389559:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.389560:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c4f8ac lrc: 3/0,1 mode: PW/PW res: [0x2b34a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.389563:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000411ac620/0x3234de053c4d861 lrc: 3/0,0 mode: PR/PR res: [0x2b34c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d127d expref: 2044 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.389563:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c4f8ac lrc: 4/0,1 mode: PW/PW res: [0x2b34a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.389568:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000411ac620/0x3234de053c4d861 lrc: 0/0,0 mode: --/PR res: [0x2b34c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d127d expref: 2044 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.389575:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.389579:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.389580:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.389581:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f998e42c/0x3234de053c4f8b3 lrc: 3/0,1 mode: PW/PW res: [0x2b34c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.389584:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2043:41279:x1731746396207680:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.389587:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11306 00010000:00010000:1.0:1651529344.389591:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f998e42c/0x3234de053c4f8b3 lrc: 4/0,1 mode: PW/PW res: [0x2b34c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.389592:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11308 00000100:00100000:0.0:1651529344.389593:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1fb0a67 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2042:41279:x1731746396207808:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.389596:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.389597:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004e8b8142/0x3234de053c4d8b5 lrc: 5/0,0 mode: PR/PR res: [0x2b34e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d13aa expref: 2042 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.389600:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.389607:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2042:41278:x1731746396207744:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 54us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.389610:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11307 00010000:00010000:1.0:1651529344.389617:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c4f8ac lrc: 3/0,1 mode: PW/PW res: [0x2b34a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.389620:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c4f8ac lrc: 3/0,1 mode: PW/PW res: [0x2b34a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.389623:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c4f8ac lrc: 3/0,1 mode: PW/PW res: [0x2b34a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389625:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004e8b8142/0x3234de053c4d8b5 lrc: 4/0,0 mode: PR/PR res: [0x2b34e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d13aa expref: 2041 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.389626:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c4f8ac lrc: 2/0,0 mode: PW/PW res: [0x2b34a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389631:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.389631:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.389638:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000029d9f199/0x3234de053c4f8ba lrc: 3/0,1 mode: PW/PW res: [0x2b34e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389641:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029d9f199/0x3234de053c4f8ba lrc: 4/0,1 mode: PW/PW res: [0x2b34e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389646:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.389652:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1fb0a67 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2041:41279:x1731746396207808:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 58us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.389655:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11308 00010000:00010000:0.0:1651529344.389666:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c666882/0x3234de053c4f8a5 lrc: 2/0,0 mode: PW/PW res: [0x2b34d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.389668:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:39029:x1731745946326464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1206us (1358us total) trans 12885078578 rc 0/0 00010000:00010000:0.0:1651529344.389669:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002c666882 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.389670:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c666882/0x3234de053c4f8a5 lrc: 2/0,0 mode: PW/PW res: [0x2b34d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.389671:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210524 00010000:00010000:0.0:1651529344.389673:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c666882/0x3234de053c4f8a5 lrc: 3/0,0 mode: PW/PW res: [0x2b34d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389677:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c666882/0x3234de053c4f8a5 lrc: 1/0,0 mode: --/PW res: [0x2b34d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389693:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c666882/0x3234de053c4f8a5 lrc: 0/0,0 mode: --/PW res: [0x2b34d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389698:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c4f8ac lrc: 2/0,0 mode: PW/PW res: [0x2b34a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389701:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bfb594be already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.389702:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c4f8ac lrc: 2/0,0 mode: PW/PW res: [0x2b34a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389705:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c4f8ac lrc: 3/0,0 mode: PW/PW res: [0x2b34a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389708:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c4f8ac lrc: 1/0,0 mode: --/PW res: [0x2b34a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389711:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c4f8ac lrc: 0/0,0 mode: --/PW res: [0x2b34a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389719:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f998e42c/0x3234de053c4f8b3 lrc: 3/0,1 mode: PW/PW res: [0x2b34c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389722:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f998e42c/0x3234de053c4f8b3 lrc: 3/0,1 mode: PW/PW res: [0x2b34c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389724:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f998e42c/0x3234de053c4f8b3 lrc: 3/0,1 mode: PW/PW res: [0x2b34c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389728:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f998e42c/0x3234de053c4f8b3 lrc: 2/0,0 mode: PW/PW res: [0x2b34c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.389750:0:72396:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c4ce97 lrc: 0/0,0 mode: --/PR res: [0x2b347:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec66 expref: 2040 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.389755:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009b8db73b pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996939968:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.389759:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4f889 lrc: 3/0,1 mode: PW/PW res: [0x2b347:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.389763:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4f889 lrc: 3/0,1 mode: PW/PW res: [0x2b347:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.389765:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4f889 lrc: 3/0,1 mode: PW/PW res: [0x2b347:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.389768:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4f889 lrc: 3/0,1 mode: PW/PW res: [0x2b347:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.389771:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4f889 lrc: 2/0,0 mode: PW/PW res: [0x2b347:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.389811:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:39029:x1731745946326592:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1306us (1495us total) trans 12885078579 rc 0/0 00000100:00100000:0.0:1651529344.389815:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210525 00010000:00010000:0.0:1651529344.389822:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f998e42c/0x3234de053c4f8b3 lrc: 2/0,0 mode: PW/PW res: [0x2b34c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389825:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f998e42c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.389826:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f998e42c/0x3234de053c4f8b3 lrc: 2/0,0 mode: PW/PW res: [0x2b34c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.389828:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:39030:x1731745946326272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1515us (1582us total) trans 12885078580 rc 0/0 00010000:00010000:0.0:1651529344.389830:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f998e42c/0x3234de053c4f8b3 lrc: 3/0,0 mode: PW/PW res: [0x2b34c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.389831:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210519 00010000:00010000:0.0:1651529344.389845:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f998e42c/0x3234de053c4f8b3 lrc: 1/0,0 mode: --/PW res: [0x2b34c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389848:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f998e42c/0x3234de053c4f8b3 lrc: 0/0,0 mode: --/PW res: [0x2b34c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389852:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4f889 lrc: 2/0,0 mode: PW/PW res: [0x2b347:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389855:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002731c8d2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.389856:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4f889 lrc: 2/0,0 mode: PW/PW res: [0x2b347:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389859:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4f889 lrc: 3/0,0 mode: PW/PW res: [0x2b347:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389862:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4f889 lrc: 1/0,0 mode: --/PW res: [0x2b347:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389865:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4f889 lrc: 0/0,0 mode: --/PW res: [0x2b347:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389876:0:156655:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e8b8142/0x3234de053c4d8b5 lrc: 0/0,0 mode: --/PR res: [0x2b34e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d13aa expref: 2039 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.389880:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996940416:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.389883:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000029d9f199/0x3234de053c4f8ba lrc: 3/0,1 mode: PW/PW res: [0x2b34e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389886:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000029d9f199/0x3234de053c4f8ba lrc: 3/0,1 mode: PW/PW res: [0x2b34e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389889:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029d9f199/0x3234de053c4f8ba lrc: 3/0,1 mode: PW/PW res: [0x2b34e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389891:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029d9f199/0x3234de053c4f8ba lrc: 3/0,1 mode: PW/PW res: [0x2b34e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.389897:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.389897:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029d9f199/0x3234de053c4f8ba lrc: 2/0,0 mode: PW/PW res: [0x2b34e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.389911:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.389942:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946326784 00000100:00100000:0.0:1651529344.389950:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+22:39029:x1731745946326720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1391us (1434us total) trans 12885078581 rc 0/0 00000100:00100000:1.0:1651529344.389953:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946326848 00000100:00100000:1.0:1651529344.389961:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210527 00000100:00100000:1.0:1651529344.389963:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:39029:x1731745946326784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.389968:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176975 count 1 00000100:00100000:0.0:1651529344.389970:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210526 00010000:00010000:1.0:1651529344.389973:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c4f8c1 lrc: 3/0,1 mode: --/PW res: [0x2b34f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.389976:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210528 00000100:00100000:0.0:1651529344.389978:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+22:39029:x1731745946326848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.389981:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c4c7f9 lrc: 2/0,0 mode: PR/PR res: [0x2b34f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd20a expref: 2038 pid: 72396 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.389983:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176976 count 1 00010000:00010000:1.0:1651529344.389984:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.389985:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.389986:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c4f8c1 lrc: 4/0,1 mode: --/PW res: [0x2b34f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.389988:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029042143/0x3234de053c4f8c8 lrc: 3/0,1 mode: --/PW res: [0x2b350:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.389992:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c4c7f9 lrc: 3/0,0 mode: PR/PR res: [0x2b34f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd20a expref: 2038 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.389993:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fcfc3592/0x3234de053c4a9e5 lrc: 2/0,0 mode: PR/PR res: [0x2b350:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd42 expref: 2038 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.389996:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c4c7f9 lrc: 4/0,0 mode: PR/PR res: [0x2b34f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd20a expref: 2038 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.389996:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.389997:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.389998:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029042143/0x3234de053c4f8c8 lrc: 4/0,1 mode: --/PW res: [0x2b350:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.390001:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005cc6463a pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996940480:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.390004:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fcfc3592/0x3234de053c4a9e5 lrc: 3/0,0 mode: PR/PR res: [0x2b350:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd42 expref: 2038 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.390008:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fcfc3592/0x3234de053c4a9e5 lrc: 4/0,0 mode: PR/PR res: [0x2b350:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd42 expref: 2038 pid: 80276 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.390010:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000499d0377 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.390015:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996940544:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.390025:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b032d2f9 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.390030:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029d9f199/0x3234de053c4f8ba lrc: 2/0,0 mode: PW/PW res: [0x2b34e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.390033:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000029d9f199 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.390034:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029d9f199/0x3234de053c4f8ba lrc: 2/0,0 mode: PW/PW res: [0x2b34e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.390037:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029d9f199/0x3234de053c4f8ba lrc: 3/0,0 mode: PW/PW res: [0x2b34e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.390041:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029d9f199/0x3234de053c4f8ba lrc: 1/0,0 mode: --/PW res: [0x2b34e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.390042:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.390044:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029d9f199/0x3234de053c4f8ba lrc: 0/0,0 mode: --/PW res: [0x2b34e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.390051:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946326912 00000100:00100000:0.0:1651529344.390063:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210529 00000100:00100000:0.0:1651529344.390065:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:39030:x1731745946326912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.390070:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176977 count 1 00000100:00100000:1.0:1651529344.390078:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.390090:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fb5d1fe/0x3234de053c4f8cf lrc: 3/0,1 mode: --/PW res: [0x2b351:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.390092:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.390095:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c4e629 lrc: 2/0,0 mode: PR/PR res: [0x2b351:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d49c0 expref: 2038 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.390104:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.390105:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.390106:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fb5d1fe/0x3234de053c4f8cf lrc: 4/0,1 mode: --/PW res: [0x2b351:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.390113:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c4e629 lrc: 3/0,0 mode: PR/PR res: [0x2b351:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d49c0 expref: 2038 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.390116:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c4e629 lrc: 4/0,0 mode: PR/PR res: [0x2b351:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d49c0 expref: 2038 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.390120:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996940608:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.390123:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.390129:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c34c0cde going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.390132:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.390166:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946327040 00000100:00100000:1.0:1651529344.390171:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.390182:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946326976 00000100:00100000:0.0:1651529344.390185:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946327104 00000100:00100000:1.0:1651529344.390187:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946327168 00000100:00100000:0.0:1651529344.390187:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946327232 00000100:00100000:0.0:1651529344.390191:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210530 00000100:00100000:0.0:1651529344.390192:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:39030:x1731745946327040:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.390194:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210531 00000100:00100000:1.0:1651529344.390196:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:39030:x1731745946326976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.390198:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176979 count 1 00002000:00080000:1.0:1651529344.390201:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176978 count 1 00010000:00010000:0.0:1651529344.390202:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fca04eb2/0x3234de053c4f8d6 lrc: 3/0,1 mode: --/PW res: [0x2b353:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.390205:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c4f8dd lrc: 3/0,1 mode: --/PW res: [0x2b352:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.390207:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000822170bb/0x3234de053c4daad lrc: 2/0,0 mode: PR/PR res: [0x2b353:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1af0 expref: 2038 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.390210:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c4f254 lrc: 2/0,0 mode: PR/PR res: [0x2b352:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c09 expref: 2038 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.390213:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.390213:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.390213:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.390214:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.390214:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fca04eb2/0x3234de053c4f8d6 lrc: 4/0,1 mode: --/PW res: [0x2b353:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.390215:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c4f8dd lrc: 4/0,1 mode: --/PW res: [0x2b352:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.390220:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000822170bb/0x3234de053c4daad lrc: 3/0,0 mode: PR/PR res: [0x2b353:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1af0 expref: 2038 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.390238:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c4f254 lrc: 3/0,0 mode: PR/PR res: [0x2b352:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c09 expref: 2038 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.390241:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000822170bb/0x3234de053c4daad lrc: 4/0,0 mode: PR/PR res: [0x2b353:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1af0 expref: 2038 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.390242:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c4f254 lrc: 4/0,0 mode: PR/PR res: [0x2b352:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c09 expref: 2038 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.390246:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996940672:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.390247:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006e255cae pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996940736:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.390261:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000efb6ae52 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.390265:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d09f5ee1 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.390270:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210532 00000100:00100000:1.0:1651529344.390272:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210533 00000100:00100000:0.0:1651529344.390272:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:39030:x1731745946327104:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.390274:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:39030:x1731745946327232:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.390277:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176980 count 1 00002000:00080000:1.0:1651529344.390278:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176982 count 1 00010000:00010000:0.0:1651529344.390281:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cf8e3aa/0x3234de053c4f8e4 lrc: 3/0,1 mode: --/PW res: [0x2b354:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.390283:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c4f8eb lrc: 3/0,1 mode: --/PW res: [0x2b356:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.390285:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bc659cdc/0x3234de053c4d54a lrc: 2/0,0 mode: PR/PR res: [0x2b354:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0701 expref: 2038 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.390287:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009bb75065/0x3234de053c4d360 lrc: 2/0,0 mode: PR/PR res: [0x2b356:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff52 expref: 2038 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.390288:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.390289:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.390289:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cf8e3aa/0x3234de053c4f8e4 lrc: 4/0,1 mode: --/PW res: [0x2b354:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.390293:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.390293:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.390294:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c4f8eb lrc: 4/0,1 mode: --/PW res: [0x2b356:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.390298:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bc659cdc/0x3234de053c4d54a lrc: 3/0,0 mode: PR/PR res: [0x2b354:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0701 expref: 2038 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.390300:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009bb75065/0x3234de053c4d360 lrc: 3/0,0 mode: PR/PR res: [0x2b356:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff52 expref: 2038 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.390302:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bc659cdc/0x3234de053c4d54a lrc: 4/0,0 mode: PR/PR res: [0x2b354:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0701 expref: 2038 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.390304:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009bb75065/0x3234de053c4d360 lrc: 4/0,0 mode: PR/PR res: [0x2b356:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff52 expref: 2038 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.390306:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996940800:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.390307:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d9ef3c1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996940864:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.390313:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 0000000064b9c5f3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.390314:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000babe2d90 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.390320:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210534 00000100:00100000:1.0:1651529344.390322:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+28:39030:x1731745946327168:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.390326:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176981 count 1 00010000:00010000:1.0:1651529344.390329:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c4f8f2 lrc: 3/0,1 mode: --/PW res: [0x2b355:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.390333:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000008407968/0x3234de053c4d61c lrc: 2/0,0 mode: PR/PR res: [0x2b355:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a0a expref: 2038 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.390336:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.390337:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.390337:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c4f8f2 lrc: 4/0,1 mode: --/PW res: [0x2b355:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.390345:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000008407968/0x3234de053c4d61c lrc: 3/0,0 mode: PR/PR res: [0x2b355:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a0a expref: 2038 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.390349:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000008407968/0x3234de053c4d61c lrc: 4/0,0 mode: PR/PR res: [0x2b355:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a0a expref: 2038 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.390353:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002f363f4a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996940928:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.390359:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd96f074 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.390425:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.390433:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996940608:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.390438:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002fb5d1fe/0x3234de053c4f8cf lrc: 3/0,1 mode: --/PW res: [0x2b351:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.390445:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396207936 00010000:00010000:0.0:1651529344.390450:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c4e629 lrc: 4/0,0 mode: PR/PR res: [0x2b351:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d49c0 expref: 2039 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.390454:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.390464:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396207872 00010000:00010000:0.0:1651529344.390467:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c4c7f9 lrc: 5/0,0 mode: PR/PR res: [0x2b34f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd20a expref: 2040 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.390477:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11309 00000100:00100000:0.0:1651529344.390479:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2040:41279:x1731746396207936:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.390482:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.390483:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c4e629 lrc: 4/0,0 mode: PR/PR res: [0x2b351:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d49c0 expref: 2040 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.390487:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c4e629 lrc: 3/0,0 mode: PR/PR res: [0x2b351:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d49c0 expref: 2040 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.390490:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.390493:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c4e629 lrc: 0/0,0 mode: --/PR res: [0x2b351:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d49c0 expref: 2040 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.390496:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396208000 00010000:00010000:0.0:1651529344.390496:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.390497:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.390498:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002fb5d1fe/0x3234de053c4f8cf lrc: 3/0,1 mode: PW/PW res: [0x2b351:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.390501:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fb5d1fe/0x3234de053c4f8cf lrc: 4/0,1 mode: PW/PW res: [0x2b351:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.390502:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fcfc3592/0x3234de053c4a9e5 lrc: 5/0,0 mode: PR/PR res: [0x2b350:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd42 expref: 2040 pid: 80276 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.390508:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11310 00000100:00100000:1.0:1651529344.390510:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2040:41279:x1731746396207872:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.390513:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.390514:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c4c7f9 lrc: 5/0,0 mode: PR/PR res: [0x2b34f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd20a expref: 2040 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.390518:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c4c7f9 lrc: 4/0,0 mode: PR/PR res: [0x2b34f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd20a expref: 2040 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.390522:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.390524:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.390525:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.390526:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c4f8c1 lrc: 3/0,1 mode: PW/PW res: [0x2b34f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.390529:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c4f8c1 lrc: 4/0,1 mode: PW/PW res: [0x2b34f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.390535:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2040:41279:x1731746396207936:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 56us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.390539:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11309 00010000:00010000:1.0:1651529344.390540:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.390544:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11311 00000100:00100000:0.0:1651529344.390546:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2039:41279:x1731746396208000:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.390548:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2039:41279:x1731746396207872:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 37us (93us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.390548:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.390550:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11310 00010000:00010000:0.0:1651529344.390550:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fcfc3592/0x3234de053c4a9e5 lrc: 5/0,0 mode: PR/PR res: [0x2b350:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd42 expref: 2039 pid: 80276 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.390554:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fcfc3592/0x3234de053c4a9e5 lrc: 4/0,0 mode: PR/PR res: [0x2b350:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd42 expref: 2038 pid: 80276 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.390559:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.390560:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.390561:0:72396:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c4c7f9 lrc: 0/0,0 mode: --/PR res: [0x2b34f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd20a expref: 2038 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.390561:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000029042143/0x3234de053c4f8c8 lrc: 3/0,1 mode: PW/PW res: [0x2b350:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.390565:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005cc6463a pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996940480:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.390568:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c4f8c1 lrc: 3/0,1 mode: PW/PW res: [0x2b34f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.390572:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c4f8c1 lrc: 3/0,1 mode: PW/PW res: [0x2b34f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.390574:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c4f8c1 lrc: 3/0,1 mode: PW/PW res: [0x2b34f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.390575:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029042143/0x3234de053c4f8c8 lrc: 4/0,1 mode: PW/PW res: [0x2b350:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.390577:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c4f8c1 lrc: 3/0,1 mode: PW/PW res: [0x2b34f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.390580:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c4f8c1 lrc: 2/0,0 mode: PW/PW res: [0x2b34f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.390581:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.390606:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2037:41279:x1731746396208000:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 41us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.390610:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11311 00010000:00010000:0.0:1651529344.390618:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c4f8c1 lrc: 2/0,0 mode: PW/PW res: [0x2b34f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.390621:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6eb3f34 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.390622:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c4f8c1 lrc: 2/0,0 mode: PW/PW res: [0x2b34f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.390625:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c4f8c1 lrc: 3/0,0 mode: PW/PW res: [0x2b34f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.390626:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:39029:x1731745946326784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 662us (729us total) trans 12885078582 rc 0/0 00000100:00100000:1.0:1651529344.390629:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210527 00010000:00010000:0.0:1651529344.390629:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c4f8c1 lrc: 1/0,0 mode: --/PW res: [0x2b34f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.390632:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c4f8c1 lrc: 0/0,0 mode: --/PW res: [0x2b34f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.390641:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002fb5d1fe/0x3234de053c4f8cf lrc: 3/0,1 mode: PW/PW res: [0x2b351:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.390644:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fb5d1fe/0x3234de053c4f8cf lrc: 3/0,1 mode: PW/PW res: [0x2b351:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.390654:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fb5d1fe/0x3234de053c4f8cf lrc: 3/0,1 mode: PW/PW res: [0x2b351:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.390657:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002fb5d1fe/0x3234de053c4f8cf lrc: 2/0,0 mode: PW/PW res: [0x2b351:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.390699:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+29:39030:x1731745946326912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 633us (657us total) trans 12885078583 rc 0/0 00000100:00100000:0.0:1651529344.390702:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210529 00010000:00010000:0.0:1651529344.390709:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002fb5d1fe/0x3234de053c4f8cf lrc: 2/0,0 mode: PW/PW res: [0x2b351:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.390712:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002fb5d1fe already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.390713:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002fb5d1fe/0x3234de053c4f8cf lrc: 2/0,0 mode: PW/PW res: [0x2b351:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.390716:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002fb5d1fe/0x3234de053c4f8cf lrc: 3/0,0 mode: PW/PW res: [0x2b351:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.390720:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002fb5d1fe/0x3234de053c4f8cf lrc: 1/0,0 mode: --/PW res: [0x2b351:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.390724:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fb5d1fe/0x3234de053c4f8cf lrc: 0/0,0 mode: --/PW res: [0x2b351:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.390745:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006e255cae pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996940736:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.390746:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996940672:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.390749:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c4f8dd lrc: 3/0,1 mode: --/PW res: [0x2b352:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.390750:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fca04eb2/0x3234de053c4f8d6 lrc: 3/0,1 mode: --/PW res: [0x2b353:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.390758:0:156655:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcfc3592/0x3234de053c4a9e5 lrc: 0/0,0 mode: --/PR res: [0x2b350:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd42 expref: 2036 pid: 80276 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.390762:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996940544:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.390764:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000029042143/0x3234de053c4f8c8 lrc: 3/0,1 mode: PW/PW res: [0x2b350:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.390782:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000029042143/0x3234de053c4f8c8 lrc: 3/0,1 mode: PW/PW res: [0x2b350:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.390785:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029042143/0x3234de053c4f8c8 lrc: 3/0,1 mode: PW/PW res: [0x2b350:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.390788:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029042143/0x3234de053c4f8c8 lrc: 3/0,1 mode: PW/PW res: [0x2b350:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.390791:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029042143/0x3234de053c4f8c8 lrc: 2/0,0 mode: PW/PW res: [0x2b350:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.390870:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.390884:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.390899:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.390916:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+29:39029:x1731745946326848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 920us (987us total) trans 12885078584 rc 0/0 00000100:00100000:0.0:1651529344.390919:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210528 00000100:00100000:0.0:1651529344.390924:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946327808 00000100:00100000:0.0:1651529344.390934:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210535 00000100:00100000:1.0:1651529344.390936:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.390936:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+29:39030:x1731745946327808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.390941:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176983 count 1 00000100:00100000:1.0:1651529344.390944:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.390946:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072a6fef9/0x3234de053c4f8f9 lrc: 3/0,1 mode: --/PW res: [0x2b357:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.390955:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.390957:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c4ee95 lrc: 2/0,0 mode: PR/PR res: [0x2b357:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c42 expref: 2035 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.390960:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.390961:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.390961:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072a6fef9/0x3234de053c4f8f9 lrc: 4/0,1 mode: --/PW res: [0x2b357:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.390968:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c4ee95 lrc: 3/0,0 mode: PR/PR res: [0x2b357:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c42 expref: 2035 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.390972:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.390972:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c4ee95 lrc: 4/0,0 mode: PR/PR res: [0x2b357:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c42 expref: 2035 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.390976:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996940992:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.390986:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d9ef3c1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996940864:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.390991:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000efb6ae52 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.390996:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c4f8eb lrc: 3/0,1 mode: --/PW res: [0x2b356:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.390997:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396208064 00010000:00010000:0.0:1651529344.391002:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000822170bb/0x3234de053c4daad lrc: 4/0,0 mode: PR/PR res: [0x2b353:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1af0 expref: 2036 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.391004:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946327872 00000100:00100000:0.0:1651529344.391008:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396208128 00010000:00010000:0.0:1651529344.391010:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c4f254 lrc: 4/0,0 mode: PR/PR res: [0x2b352:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c09 expref: 2037 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.391014:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210536 00000100:00100000:1.0:1651529344.391016:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+30:39030:x1731745946327872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.391021:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176984 count 1 00010000:00010000:1.0:1651529344.391026:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c4f900 lrc: 3/0,1 mode: --/PW res: [0x2b358:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.391033:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000064149de3/0x3234de053c4cdf6 lrc: 2/0,0 mode: PR/PR res: [0x2b358:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce93a expref: 2037 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.391035:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396208192 00010000:00010000:1.0:1651529344.391036:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.391037:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.391037:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c4f900 lrc: 4/0,1 mode: --/PW res: [0x2b358:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391039:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bc659cdc/0x3234de053c4d54a lrc: 5/0,0 mode: PR/PR res: [0x2b354:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0701 expref: 2038 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.391043:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396208320 00010000:00010000:1.0:1651529344.391044:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000064149de3/0x3234de053c4cdf6 lrc: 3/0,0 mode: PR/PR res: [0x2b358:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce93a expref: 2039 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.391045:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000008407968/0x3234de053c4d61c lrc: 5/0,0 mode: PR/PR res: [0x2b355:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a0a expref: 2039 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.391047:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000064149de3/0x3234de053c4cdf6 lrc: 4/0,0 mode: PR/PR res: [0x2b358:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce93a expref: 2039 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.391049:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396208256 00010000:00010000:0.0:1651529344.391051:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009bb75065/0x3234de053c4d360 lrc: 4/0,0 mode: PR/PR res: [0x2b356:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff52 expref: 2040 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.391052:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ffb5d0a pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996941056:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.391056:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11312 00000100:00100000:0.0:1651529344.391057:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2040:41279:x1731746396208064:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.391060:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d09f5ee1 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.391060:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.391061:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000822170bb/0x3234de053c4daad lrc: 4/0,0 mode: PR/PR res: [0x2b353:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1af0 expref: 2040 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.391065:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000822170bb/0x3234de053c4daad lrc: 3/0,0 mode: PR/PR res: [0x2b353:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1af0 expref: 2040 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.391068:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002f363f4a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996940928:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.391071:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c4f8f2 lrc: 3/0,1 mode: --/PW res: [0x2b355:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391073:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000822170bb/0x3234de053c4daad lrc: 0/0,0 mode: --/PR res: [0x2b353:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1af0 expref: 2040 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.391077:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.391077:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.391078:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11313 00010000:00010000:0.0:1651529344.391078:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fca04eb2/0x3234de053c4f8d6 lrc: 3/0,1 mode: PW/PW res: [0x2b353:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.391080:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2039:41279:x1731746396208128:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.391081:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fca04eb2/0x3234de053c4f8d6 lrc: 4/0,1 mode: PW/PW res: [0x2b353:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.391083:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.391084:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c4f254 lrc: 4/0,0 mode: PR/PR res: [0x2b352:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c09 expref: 2039 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.391088:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.391091:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c4f254 lrc: 3/0,0 mode: PR/PR res: [0x2b352:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c09 expref: 2039 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.391095:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2039:41279:x1731746396208064:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 37us (226us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.391096:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c4f254 lrc: 0/0,0 mode: --/PR res: [0x2b352:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c09 expref: 2039 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.391098:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11312 00010000:00010000:1.0:1651529344.391100:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.391100:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.391101:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c4f8dd lrc: 3/0,1 mode: PW/PW res: [0x2b352:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.391102:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11314 00010000:00010000:1.0:1651529344.391104:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c4f8dd lrc: 4/0,1 mode: PW/PW res: [0x2b352:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.391104:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2037:41279:x1731746396208192:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.391106:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.391108:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bc659cdc/0x3234de053c4d54a lrc: 5/0,0 mode: PR/PR res: [0x2b354:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0701 expref: 2037 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.391110:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.391111:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bc659cdc/0x3234de053c4d54a lrc: 4/0,0 mode: PR/PR res: [0x2b354:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0701 expref: 2037 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.391116:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2037:41279:x1731746396208128:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 36us (217us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.391116:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.391116:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.391117:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004cf8e3aa/0x3234de053c4f8e4 lrc: 3/0,1 mode: PW/PW res: [0x2b354:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.391119:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11313 00010000:00010000:0.0:1651529344.391120:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cf8e3aa/0x3234de053c4f8e4 lrc: 4/0,1 mode: PW/PW res: [0x2b354:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.391124:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11315 00010000:00010000:0.0:1651529344.391124:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.391125:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000515bc9a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2036:41279:x1731746396208320:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.391128:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.391129:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000008407968/0x3234de053c4d61c lrc: 4/0,0 mode: PR/PR res: [0x2b355:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a0a expref: 2036 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.391129:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2036:41279:x1731746396208192:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 24us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.391131:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11314 00010000:00010000:1.0:1651529344.391133:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000008407968/0x3234de053c4d61c lrc: 3/0,0 mode: PR/PR res: [0x2b355:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a0a expref: 2035 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.391134:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11316 00000100:00100000:0.0:1651529344.391136:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2035:41279:x1731746396208256:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.391138:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008407968/0x3234de053c4d61c lrc: 0/0,0 mode: --/PR res: [0x2b355:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a0a expref: 2035 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.391138:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.391139:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009bb75065/0x3234de053c4d360 lrc: 4/0,0 mode: PR/PR res: [0x2b356:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff52 expref: 2035 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.391141:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.391142:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.391142:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c4f8f2 lrc: 3/0,1 mode: PW/PW res: [0x2b355:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391143:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009bb75065/0x3234de053c4d360 lrc: 3/0,0 mode: PR/PR res: [0x2b356:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff52 expref: 2034 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.391145:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c4f8f2 lrc: 4/0,1 mode: PW/PW res: [0x2b355:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391147:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009bb75065/0x3234de053c4d360 lrc: 0/0,0 mode: --/PR res: [0x2b356:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff52 expref: 2034 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.391151:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.391151:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.391152:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.391152:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c4f8eb lrc: 3/0,1 mode: PW/PW res: [0x2b356:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.391155:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000515bc9a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2033:41279:x1731746396208320:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 29us (200us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.391155:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c4f8eb lrc: 4/0,1 mode: PW/PW res: [0x2b356:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.391158:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11315 00010000:00010000:0.0:1651529344.391165:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.391171:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2032:41279:x1731746396208256:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (200us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.391174:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c4f8eb lrc: 3/0,1 mode: PW/PW res: [0x2b356:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.391174:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11316 00010000:00010000:1.0:1651529344.391177:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c4f8eb lrc: 3/0,1 mode: PW/PW res: [0x2b356:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.391180:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c4f8eb lrc: 3/0,1 mode: PW/PW res: [0x2b356:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391180:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029042143/0x3234de053c4f8c8 lrc: 2/0,0 mode: PW/PW res: [0x2b350:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.391183:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c4f8eb lrc: 2/0,0 mode: PW/PW res: [0x2b356:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391184:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000029042143 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.391185:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029042143/0x3234de053c4f8c8 lrc: 2/0,0 mode: PW/PW res: [0x2b350:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391188:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029042143/0x3234de053c4f8c8 lrc: 3/0,0 mode: PW/PW res: [0x2b350:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391191:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029042143/0x3234de053c4f8c8 lrc: 1/0,0 mode: --/PW res: [0x2b350:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391200:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029042143/0x3234de053c4f8c8 lrc: 0/0,0 mode: --/PW res: [0x2b350:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391204:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c4f8eb lrc: 2/0,0 mode: PW/PW res: [0x2b356:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391207:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b2d06199 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.391208:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c4f8eb lrc: 2/0,0 mode: PW/PW res: [0x2b356:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391213:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c4f8eb lrc: 3/0,0 mode: PW/PW res: [0x2b356:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391216:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c4f8eb lrc: 1/0,0 mode: --/PW res: [0x2b356:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391219:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c4f8eb lrc: 0/0,0 mode: --/PW res: [0x2b356:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.391246:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:39030:x1731745946327232:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 971us (1074us total) trans 12885078585 rc 0/0 00000100:00100000:1.0:1651529344.391249:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210533 00010000:00010000:0.0:1651529344.391250:0:80281:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc659cdc/0x3234de053c4d54a lrc: 0/0,0 mode: --/PR res: [0x2b354:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0701 expref: 2031 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.391254:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996940800:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.391256:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c4f8dd lrc: 3/0,1 mode: PW/PW res: [0x2b352:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391257:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004cf8e3aa/0x3234de053c4f8e4 lrc: 3/0,1 mode: PW/PW res: [0x2b354:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.391259:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c4f8dd lrc: 3/0,1 mode: PW/PW res: [0x2b352:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391261:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004cf8e3aa/0x3234de053c4f8e4 lrc: 3/0,1 mode: PW/PW res: [0x2b354:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.391262:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c4f8dd lrc: 3/0,1 mode: PW/PW res: [0x2b352:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391263:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004cf8e3aa/0x3234de053c4f8e4 lrc: 3/0,1 mode: PW/PW res: [0x2b354:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.391265:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c4f8dd lrc: 2/0,0 mode: PW/PW res: [0x2b352:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391266:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cf8e3aa/0x3234de053c4f8e4 lrc: 3/0,1 mode: PW/PW res: [0x2b354:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391269:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004cf8e3aa/0x3234de053c4f8e4 lrc: 2/0,0 mode: PW/PW res: [0x2b354:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.391306:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+32:39030:x1731745946326976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1109us (1213us total) trans 12885078586 rc 0/0 00000100:00100000:1.0:1651529344.391309:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210531 00010000:00010000:1.0:1651529344.391315:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c4f8f2 lrc: 3/0,1 mode: PW/PW res: [0x2b355:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.391315:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+31:39030:x1731745946327104:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1043us (1192us total) trans 12885078587 rc 0/0 00000100:00100000:0.0:1651529344.391318:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210532 00010000:00010000:1.0:1651529344.391319:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c4f8f2 lrc: 3/0,1 mode: PW/PW res: [0x2b355:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.391322:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c4f8f2 lrc: 3/0,1 mode: PW/PW res: [0x2b355:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391326:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c4f8dd lrc: 2/0,0 mode: PW/PW res: [0x2b352:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.391327:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c4f8f2 lrc: 2/0,0 mode: PW/PW res: [0x2b355:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391329:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dd394f60 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.391330:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c4f8dd lrc: 2/0,0 mode: PW/PW res: [0x2b352:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391333:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c4f8dd lrc: 3/0,0 mode: PW/PW res: [0x2b352:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391345:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c4f8dd lrc: 1/0,0 mode: --/PW res: [0x2b352:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391348:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c4f8dd lrc: 0/0,0 mode: --/PW res: [0x2b352:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391353:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004cf8e3aa/0x3234de053c4f8e4 lrc: 2/0,0 mode: PW/PW res: [0x2b354:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391356:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004cf8e3aa already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.391356:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004cf8e3aa/0x3234de053c4f8e4 lrc: 2/0,0 mode: PW/PW res: [0x2b354:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391362:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004cf8e3aa/0x3234de053c4f8e4 lrc: 3/0,0 mode: PW/PW res: [0x2b354:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391365:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004cf8e3aa/0x3234de053c4f8e4 lrc: 1/0,0 mode: --/PW res: [0x2b354:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.391366:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+31:39030:x1731745946327168:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1043us (1233us total) trans 12885078588 rc 0/0 00010000:00010000:0.0:1651529344.391367:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cf8e3aa/0x3234de053c4f8e4 lrc: 0/0,0 mode: --/PW res: [0x2b354:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.391369:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210534 00010000:00010000:0.0:1651529344.391371:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c4f8f2 lrc: 2/0,0 mode: PW/PW res: [0x2b355:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391373:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004f275b98 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.391374:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c4f8f2 lrc: 2/0,0 mode: PW/PW res: [0x2b355:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391377:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c4f8f2 lrc: 3/0,0 mode: PW/PW res: [0x2b355:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391380:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c4f8f2 lrc: 1/0,0 mode: --/PW res: [0x2b355:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391382:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c4f8f2 lrc: 0/0,0 mode: --/PW res: [0x2b355:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.391385:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.391388:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fca04eb2/0x3234de053c4f8d6 lrc: 3/0,1 mode: PW/PW res: [0x2b353:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391392:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fca04eb2/0x3234de053c4f8d6 lrc: 3/0,1 mode: PW/PW res: [0x2b353:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391395:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fca04eb2/0x3234de053c4f8d6 lrc: 3/0,1 mode: PW/PW res: [0x2b353:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391397:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fca04eb2/0x3234de053c4f8d6 lrc: 2/0,0 mode: PW/PW res: [0x2b353:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.391433:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:39030:x1731745946327040:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1240us (1356us total) trans 12885078589 rc 0/0 00000100:00100000:0.0:1651529344.391436:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210530 00000100:00100000:0.0:1651529344.391441:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946327936 00000100:00100000:0.0:1651529344.391452:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210537 00000100:00100000:0.0:1651529344.391454:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:39030:x1731745946327936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.391459:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176985 count 1 00010000:00010000:0.0:1651529344.391463:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000025f5152/0x3234de053c4f907 lrc: 3/0,1 mode: --/PW res: [0x2b359:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391468:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004273867c/0x3234de053c4d34b lrc: 2/0,0 mode: PR/PR res: [0x2b359:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfefe expref: 2030 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.391471:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.391472:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.391472:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000025f5152/0x3234de053c4f907 lrc: 4/0,1 mode: --/PW res: [0x2b359:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391481:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004273867c/0x3234de053c4d34b lrc: 3/0,0 mode: PR/PR res: [0x2b359:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfefe expref: 2030 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.391485:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004273867c/0x3234de053c4d34b lrc: 4/0,0 mode: PR/PR res: [0x2b359:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfefe expref: 2030 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.391489:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996941120:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.391531:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c29d18ba going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.391546:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fca04eb2/0x3234de053c4f8d6 lrc: 2/0,0 mode: PW/PW res: [0x2b353:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391550:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fca04eb2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.391551:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fca04eb2/0x3234de053c4f8d6 lrc: 2/0,0 mode: PW/PW res: [0x2b353:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391554:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fca04eb2/0x3234de053c4f8d6 lrc: 3/0,0 mode: PW/PW res: [0x2b353:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391559:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fca04eb2/0x3234de053c4f8d6 lrc: 1/0,0 mode: --/PW res: [0x2b353:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391561:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fca04eb2/0x3234de053c4f8d6 lrc: 0/0,0 mode: --/PW res: [0x2b353:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.391595:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996940992:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.391597:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.391600:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000072a6fef9/0x3234de053c4f8f9 lrc: 3/0,1 mode: --/PW res: [0x2b357:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.391605:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.391611:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946328064 00000100:00100000:1.0:1651529344.391617:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946328000 00000100:00100000:1.0:1651529344.391621:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210538 00000100:00100000:1.0:1651529344.391623:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+33:39030:x1731745946328064:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.391628:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176987 count 1 00010000:00010000:1.0:1651529344.391633:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4f90e lrc: 3/0,1 mode: --/PW res: [0x2b35b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.391638:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c4d09d lrc: 2/0,0 mode: PR/PR res: [0x2b35b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf43f expref: 2030 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.391641:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.391642:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.391643:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4f90e lrc: 4/0,1 mode: --/PW res: [0x2b35b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.391649:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c4d09d lrc: 3/0,0 mode: PR/PR res: [0x2b35b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf43f expref: 2030 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.391655:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c4d09d lrc: 4/0,0 mode: PR/PR res: [0x2b35b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf43f expref: 2030 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.391667:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cee35a0c pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996941184:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.391678:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a6b79b05 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.391694:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210539 00000100:00100000:1.0:1651529344.391696:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+33:39030:x1731745946328000:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.391701:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176986 count 1 00010000:00010000:1.0:1651529344.391705:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4f915 lrc: 3/0,1 mode: --/PW res: [0x2b35a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.391709:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000034d24763/0x3234de053c4c893 lrc: 2/0,0 mode: PR/PR res: [0x2b35a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd409 expref: 2030 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.391713:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.391713:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.391714:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4f915 lrc: 4/0,1 mode: --/PW res: [0x2b35a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.391720:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000034d24763/0x3234de053c4c893 lrc: 3/0,0 mode: PR/PR res: [0x2b35a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd409 expref: 2030 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.391723:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000034d24763/0x3234de053c4c893 lrc: 4/0,0 mode: PR/PR res: [0x2b35a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd409 expref: 2030 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.391730:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000075e1000f pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996941248:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.391749:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000499d0377 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.391782:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.391824:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.391834:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.391836:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946328192 00000100:00100000:1.0:1651529344.391843:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.391852:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946328128 00000100:00100000:1.0:1651529344.391855:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.391856:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946328256 00000100:00100000:0.0:1651529344.391871:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210540 00000100:00100000:1.0:1651529344.391872:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.391872:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+36:39030:x1731745946328192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.391882:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176989 count 1 00000100:00100000:1.0:1651529344.391883:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ffb5d0a pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996941056:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.391887:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c4f900 lrc: 3/0,1 mode: --/PW res: [0x2b358:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391887:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032623d9a/0x3234de053c4f91c lrc: 3/0,1 mode: --/PW res: [0x2b35d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391892:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c4d48d lrc: 2/0,0 mode: PR/PR res: [0x2b35d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0414 expref: 2030 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.391895:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210541 00010000:00010000:0.0:1651529344.391895:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.391896:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.391897:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:39030:x1731745946328128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.391897:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032623d9a/0x3234de053c4f91c lrc: 4/0,1 mode: --/PW res: [0x2b35d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.391902:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176988 count 1 00010000:00010000:0.0:1651529344.391903:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c4d48d lrc: 3/0,0 mode: PR/PR res: [0x2b35d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0414 expref: 2030 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.391906:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4f923 lrc: 3/0,1 mode: --/PW res: [0x2b35c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391907:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c4d48d lrc: 4/0,0 mode: PR/PR res: [0x2b35d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0414 expref: 2030 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.391910:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c4f613 lrc: 2/0,0 mode: PR/PR res: [0x2b35c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8af0 expref: 2030 pid: 156655 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.391911:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996941312:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.391913:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.391914:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.391915:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4f923 lrc: 4/0,1 mode: --/PW res: [0x2b35c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.391925:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 000000007b78c9d8 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.391930:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c4f613 lrc: 3/0,0 mode: PR/PR res: [0x2b35c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8af0 expref: 2030 pid: 156655 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.391932:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396208896 00010000:00010000:1.0:1651529344.391934:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c4f613 lrc: 4/0,0 mode: PR/PR res: [0x2b35c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8af0 expref: 2031 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.391937:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c4ee95 lrc: 4/0,0 mode: PR/PR res: [0x2b357:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c42 expref: 2031 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.391939:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d9ef3c1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996941376:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.391945:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396208960 00010000:00010000:0.0:1651529344.391948:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000064149de3/0x3234de053c4cdf6 lrc: 4/0,0 mode: PR/PR res: [0x2b358:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce93a expref: 2032 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.391952:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d09f5ee1 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.391952:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396209024 00010000:00010000:0.0:1651529344.391954:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004273867c/0x3234de053c4d34b lrc: 5/0,0 mode: PR/PR res: [0x2b359:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfefe expref: 2033 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.391958:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210542 00000100:00100000:0.0:1651529344.391959:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11317 00000100:00100000:1.0:1651529344.391960:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:39030:x1731745946328256:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.391961:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2033:41278:x1731746396208896:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.391963:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00080000:1.0:1651529344.391964:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176990 count 1 00010000:00010000:0.0:1651529344.391965:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c4ee95 lrc: 4/0,0 mode: PR/PR res: [0x2b357:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c42 expref: 2033 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.391968:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4f92a lrc: 3/0,1 mode: --/PW res: [0x2b35e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391968:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c4ee95 lrc: 3/0,0 mode: PR/PR res: [0x2b357:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c42 expref: 2033 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.391972:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c4e860 lrc: 2/0,0 mode: PR/PR res: [0x2b35e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5272 expref: 2033 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.391974:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c4ee95 lrc: 0/0,0 mode: --/PR res: [0x2b357:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c42 expref: 2033 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.391975:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.391976:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.391977:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4f92a lrc: 4/0,1 mode: --/PW res: [0x2b35e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.391978:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.391978:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.391979:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000072a6fef9/0x3234de053c4f8f9 lrc: 3/0,1 mode: PW/PW res: [0x2b357:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.391983:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c4e860 lrc: 3/0,0 mode: PR/PR res: [0x2b35e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5272 expref: 2032 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.391984:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072a6fef9/0x3234de053c4f8f9 lrc: 4/0,1 mode: PW/PW res: [0x2b357:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.391986:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c4e860 lrc: 4/0,0 mode: PR/PR res: [0x2b35e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5272 expref: 2032 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.391990:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ffb5d0a pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996941440:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.391991:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.391998:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2032:41278:x1731746396208896:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 36us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.391999:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aeda71fe going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.392000:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11317 00000100:00100000:1.0:1651529344.392043:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11318 00000100:00100000:1.0:1651529344.392045:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2031:41279:x1731746396208960:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.392046:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11319 00010000:00010000:1.0:1651529344.392048:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.392048:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2031:41279:x1731746396209024:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.392050:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000064149de3/0x3234de053c4cdf6 lrc: 4/0,0 mode: PR/PR res: [0x2b358:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce93a expref: 2031 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.392051:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.392053:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004273867c/0x3234de053c4d34b lrc: 5/0,0 mode: PR/PR res: [0x2b359:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfefe expref: 2031 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.392054:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000064149de3/0x3234de053c4cdf6 lrc: 3/0,0 mode: PR/PR res: [0x2b358:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce93a expref: 2031 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.392057:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004273867c/0x3234de053c4d34b lrc: 4/0,0 mode: PR/PR res: [0x2b359:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfefe expref: 2031 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.392059:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064149de3/0x3234de053c4cdf6 lrc: 0/0,0 mode: --/PR res: [0x2b358:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce93a expref: 2031 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.392063:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.392063:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.392063:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.392063:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.392064:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c4f900 lrc: 3/0,1 mode: PW/PW res: [0x2b358:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392064:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000025f5152/0x3234de053c4f907 lrc: 3/0,1 mode: PW/PW res: [0x2b359:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.392067:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c4f900 lrc: 4/0,1 mode: PW/PW res: [0x2b358:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392067:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000025f5152/0x3234de053c4f907 lrc: 4/0,1 mode: PW/PW res: [0x2b359:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392072:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.392074:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.392078:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2030:41279:x1731746396209024:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 30us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.392081:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2030:41279:x1731746396208960:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.392081:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11319 00000100:00100000:1.0:1651529344.392085:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11318 00010000:00010000:1.0:1651529344.392092:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c4f900 lrc: 3/0,1 mode: PW/PW res: [0x2b358:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392094:0:80280:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004273867c/0x3234de053c4d34b lrc: 0/0,0 mode: --/PR res: [0x2b359:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfefe expref: 2028 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.392095:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c4f900 lrc: 3/0,1 mode: PW/PW res: [0x2b358:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.392098:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c4f900 lrc: 3/0,1 mode: PW/PW res: [0x2b358:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.392098:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996941120:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.392101:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c4f900 lrc: 2/0,0 mode: PW/PW res: [0x2b358:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392101:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000025f5152/0x3234de053c4f907 lrc: 3/0,1 mode: PW/PW res: [0x2b359:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392105:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000025f5152/0x3234de053c4f907 lrc: 3/0,1 mode: PW/PW res: [0x2b359:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392114:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000025f5152/0x3234de053c4f907 lrc: 3/0,1 mode: PW/PW res: [0x2b359:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392118:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000025f5152/0x3234de053c4f907 lrc: 3/0,1 mode: PW/PW res: [0x2b359:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392121:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000025f5152/0x3234de053c4f907 lrc: 2/0,0 mode: PW/PW res: [0x2b359:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.392146:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+38:39030:x1731745946327872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1129us (1215us total) trans 12885078590 rc 0/0 00000100:00100000:1.0:1651529344.392149:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210536 00000100:00100000:0.0:1651529344.392164:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:39030:x1731745946327936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 709us (779us total) trans 12885078591 rc 0/0 00000100:00100000:0.0:1651529344.392167:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210537 00010000:00010000:0.0:1651529344.392174:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c4f900 lrc: 2/0,0 mode: PW/PW res: [0x2b358:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392180:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d5eeb0cd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.392181:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c4f900 lrc: 2/0,0 mode: PW/PW res: [0x2b358:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392184:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c4f900 lrc: 3/0,0 mode: PW/PW res: [0x2b358:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.392185:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.392188:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c4f900 lrc: 1/0,0 mode: --/PW res: [0x2b358:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392191:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c4f900 lrc: 0/0,0 mode: --/PW res: [0x2b358:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.392195:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.392195:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000025f5152/0x3234de053c4f907 lrc: 2/0,0 mode: PW/PW res: [0x2b359:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392198:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000025f5152 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.392206:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000025f5152/0x3234de053c4f907 lrc: 2/0,0 mode: PW/PW res: [0x2b359:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392209:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000025f5152/0x3234de053c4f907 lrc: 3/0,0 mode: PW/PW res: [0x2b359:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392213:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000025f5152/0x3234de053c4f907 lrc: 1/0,0 mode: --/PW res: [0x2b359:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392215:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000025f5152/0x3234de053c4f907 lrc: 0/0,0 mode: --/PW res: [0x2b359:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.392236:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396209088 00010000:00010000:0.0:1651529344.392241:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c4d09d lrc: 5/0,0 mode: PR/PR res: [0x2b35b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf43f expref: 2028 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.392248:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396209152 00010000:00010000:0.0:1651529344.392250:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000034d24763/0x3234de053c4c893 lrc: 5/0,0 mode: PR/PR res: [0x2b35a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd409 expref: 2029 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.392255:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11320 00000100:00100000:0.0:1651529344.392257:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2029:41279:x1731746396209088:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.392260:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.392261:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c4d09d lrc: 5/0,0 mode: PR/PR res: [0x2b35b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf43f expref: 2029 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.392265:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c4d09d lrc: 4/0,0 mode: PR/PR res: [0x2b35b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf43f expref: 2029 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.392270:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.392270:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.392271:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4f90e lrc: 3/0,1 mode: PW/PW res: [0x2b35b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392274:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4f90e lrc: 4/0,1 mode: PW/PW res: [0x2b35b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392279:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.392286:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2029:41279:x1731746396209088:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 28us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.392288:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11320 00000100:00100000:0.0:1651529344.392292:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11321 00000100:00100000:0.0:1651529344.392293:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2028:41278:x1731746396209152:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.392296:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.392297:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000034d24763/0x3234de053c4c893 lrc: 5/0,0 mode: PR/PR res: [0x2b35a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd409 expref: 2028 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.392300:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000034d24763/0x3234de053c4c893 lrc: 4/0,0 mode: PR/PR res: [0x2b35a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd409 expref: 2028 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.392305:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.392305:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.392306:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4f915 lrc: 3/0,1 mode: PW/PW res: [0x2b35a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392309:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4f915 lrc: 4/0,1 mode: PW/PW res: [0x2b35a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392313:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.392316:0:106695:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034d24763/0x3234de053c4c893 lrc: 0/0,0 mode: --/PR res: [0x2b35a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd409 expref: 2028 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.392326:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000075e1000f pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996941248:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.392330:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4f915 lrc: 3/0,1 mode: PW/PW res: [0x2b35a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.392334:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4f915 lrc: 3/0,1 mode: PW/PW res: [0x2b35a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.392337:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4f915 lrc: 3/0,1 mode: PW/PW res: [0x2b35a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.392337:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2027:41278:x1731746396209152:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 43us (142us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.392340:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4f915 lrc: 3/0,1 mode: PW/PW res: [0x2b35a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.392340:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11321 00010000:00010000:1.0:1651529344.392343:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4f915 lrc: 2/0,0 mode: PW/PW res: [0x2b35a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392349:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000072a6fef9/0x3234de053c4f8f9 lrc: 3/0,1 mode: PW/PW res: [0x2b357:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392358:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072a6fef9/0x3234de053c4f8f9 lrc: 3/0,1 mode: PW/PW res: [0x2b357:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392362:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072a6fef9/0x3234de053c4f8f9 lrc: 3/0,1 mode: PW/PW res: [0x2b357:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392365:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072a6fef9/0x3234de053c4f8f9 lrc: 2/0,0 mode: PW/PW res: [0x2b357:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.392386:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+38:39030:x1731745946328000:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 689us (781us total) trans 12885078592 rc 0/0 00000100:00100000:1.0:1651529344.392389:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210539 00010000:00010000:1.0:1651529344.392399:0:80277:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c4d09d lrc: 0/0,0 mode: --/PR res: [0x2b35b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf43f expref: 2026 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.392403:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cee35a0c pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996941184:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.392405:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+37:39030:x1731745946327808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1468us (1521us total) trans 12885078593 rc 0/0 00010000:00010000:1.0:1651529344.392406:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4f90e lrc: 3/0,1 mode: PW/PW res: [0x2b35b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.392409:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4f90e lrc: 3/0,1 mode: PW/PW res: [0x2b35b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.392412:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4f90e lrc: 3/0,1 mode: PW/PW res: [0x2b35b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.392418:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4f90e lrc: 3/0,1 mode: PW/PW res: [0x2b35b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.392421:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4f90e lrc: 2/0,0 mode: PW/PW res: [0x2b35b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.392425:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210535 00010000:00010000:0.0:1651529344.392437:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4f915 lrc: 2/0,0 mode: PW/PW res: [0x2b35a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392440:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000579ed558 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.392441:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4f915 lrc: 2/0,0 mode: PW/PW res: [0x2b35a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392445:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4f915 lrc: 3/0,0 mode: PW/PW res: [0x2b35a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392449:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4f915 lrc: 1/0,0 mode: --/PW res: [0x2b35a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392452:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4f915 lrc: 0/0,0 mode: --/PW res: [0x2b35a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392457:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072a6fef9/0x3234de053c4f8f9 lrc: 2/0,0 mode: PW/PW res: [0x2b357:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392460:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000072a6fef9 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.392460:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072a6fef9/0x3234de053c4f8f9 lrc: 2/0,0 mode: PW/PW res: [0x2b357:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.392461:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:39030:x1731745946328064:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 838us (864us total) trans 12885078594 rc 0/0 00010000:00010000:0.0:1651529344.392463:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072a6fef9/0x3234de053c4f8f9 lrc: 3/0,0 mode: PW/PW res: [0x2b357:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.392464:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210538 00010000:00010000:0.0:1651529344.392466:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072a6fef9/0x3234de053c4f8f9 lrc: 1/0,0 mode: --/PW res: [0x2b357:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392469:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072a6fef9/0x3234de053c4f8f9 lrc: 0/0,0 mode: --/PW res: [0x2b357:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392472:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4f90e lrc: 2/0,0 mode: PW/PW res: [0x2b35b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392475:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065c40e6a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.392475:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4f90e lrc: 2/0,0 mode: PW/PW res: [0x2b35b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392478:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4f90e lrc: 3/0,0 mode: PW/PW res: [0x2b35b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.392479:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.392481:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4f90e lrc: 1/0,0 mode: --/PW res: [0x2b35b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392483:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4f90e lrc: 0/0,0 mode: --/PW res: [0x2b35b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.392515:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.392537:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946328896 00000100:00100000:0.0:1651529344.392571:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946328832 00000100:00100000:0.0:1651529344.392578:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210543 00000100:00100000:0.0:1651529344.392579:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+38:39029:x1731745946328896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.392585:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176992 count 1 00000100:00100000:1.0:1651529344.392593:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.392600:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.392602:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007bce9af0/0x3234de053c4f931 lrc: 3/0,1 mode: --/PW res: [0x2b360:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.392611:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.392613:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c778ad9d/0x3234de053c4de57 lrc: 2/0,0 mode: PR/PR res: [0x2b360:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a16 expref: 2025 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.392621:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.392621:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.392622:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ffb5d0a pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996941440:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.392622:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007bce9af0/0x3234de053c4f931 lrc: 4/0,1 mode: --/PW res: [0x2b360:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.392626:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4f92a lrc: 3/0,1 mode: --/PW res: [0x2b35e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392630:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c778ad9d/0x3234de053c4de57 lrc: 3/0,0 mode: PR/PR res: [0x2b360:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a16 expref: 2025 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.392633:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d9ef3c1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996941376:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.392633:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c778ad9d/0x3234de053c4de57 lrc: 4/0,0 mode: PR/PR res: [0x2b360:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a16 expref: 2025 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.392636:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4f923 lrc: 3/0,1 mode: --/PW res: [0x2b35c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.392638:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996941504:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.392642:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210544 00000100:00100000:1.0:1651529344.392644:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+38:39029:x1731745946328832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.392652:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c8d20cf1 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.392657:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176991 count 1 00000100:00100000:0.0:1651529344.392659:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396209216 00010000:00010000:1.0:1651529344.392662:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c4f938 lrc: 3/0,1 mode: --/PW res: [0x2b35f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392663:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c4d48d lrc: 5/0,0 mode: PR/PR res: [0x2b35d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0414 expref: 2026 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.392666:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c4c655 lrc: 2/0,0 mode: PR/PR res: [0x2b35f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb2d expref: 2026 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.392669:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.392670:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.392670:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396209280 00010000:00010000:1.0:1651529344.392671:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c4f938 lrc: 4/0,1 mode: --/PW res: [0x2b35f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392673:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c4f613 lrc: 4/0,0 mode: PR/PR res: [0x2b35c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8af0 expref: 2027 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.392677:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c4c655 lrc: 3/0,0 mode: PR/PR res: [0x2b35f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb2d expref: 2027 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.392681:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c4c655 lrc: 4/0,0 mode: PR/PR res: [0x2b35f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb2d expref: 2027 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.392685:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ffb5d0a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996941568:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.392690:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396209344 00000100:00100000:1.0:1651529344.392693:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d09f5ee1 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.392694:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c4e860 lrc: 4/0,0 mode: PR/PR res: [0x2b35e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5272 expref: 2028 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.392699:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11322 00000100:00100000:0.0:1651529344.392701:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e392dfeb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2028:41279:x1731746396209216:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.392702:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11323 00000100:00100000:1.0:1651529344.392703:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2028:41278:x1731746396209280:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.392704:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.392705:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c4d48d lrc: 5/0,0 mode: PR/PR res: [0x2b35d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0414 expref: 2028 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.392706:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.392708:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c4f613 lrc: 4/0,0 mode: PR/PR res: [0x2b35c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8af0 expref: 2028 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.392709:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c4d48d lrc: 4/0,0 mode: PR/PR res: [0x2b35d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0414 expref: 2028 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.392712:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c4f613 lrc: 3/0,0 mode: PR/PR res: [0x2b35c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8af0 expref: 2028 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.392714:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.392715:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.392715:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000032623d9a/0x3234de053c4f91c lrc: 3/0,1 mode: PW/PW res: [0x2b35d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.392718:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c4f613 lrc: 0/0,0 mode: --/PR res: [0x2b35c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8af0 expref: 2028 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.392718:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032623d9a/0x3234de053c4f91c lrc: 4/0,1 mode: PW/PW res: [0x2b35d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.392722:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.392722:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.392723:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4f923 lrc: 3/0,1 mode: PW/PW res: [0x2b35c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392723:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.392726:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4f923 lrc: 4/0,1 mode: PW/PW res: [0x2b35c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.392730:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e392dfeb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2027:41279:x1731746396209216:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 29us (137us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.392732:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.392733:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11322 00000100:00100000:1.0:1651529344.392749:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2026:41278:x1731746396209280:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 45us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.392752:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11323 00000100:00100000:0.0:1651529344.392754:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11324 00000100:00100000:0.0:1651529344.392756:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2025:41278:x1731746396209344:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.392759:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.392760:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4f923 lrc: 3/0,1 mode: PW/PW res: [0x2b35c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392760:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c4e860 lrc: 4/0,0 mode: PR/PR res: [0x2b35e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5272 expref: 2025 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.392763:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4f923 lrc: 3/0,1 mode: PW/PW res: [0x2b35c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392764:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c4e860 lrc: 3/0,0 mode: PR/PR res: [0x2b35e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5272 expref: 2025 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.392766:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4f923 lrc: 3/0,1 mode: PW/PW res: [0x2b35c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.392769:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4f923 lrc: 2/0,0 mode: PW/PW res: [0x2b35c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392769:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c4e860 lrc: 0/0,0 mode: --/PR res: [0x2b35e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5272 expref: 2025 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.392773:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.392774:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.392775:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4f92a lrc: 3/0,1 mode: PW/PW res: [0x2b35e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392784:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4f92a lrc: 4/0,1 mode: PW/PW res: [0x2b35e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392794:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.392800:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2024:41278:x1731746396209344:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 43us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.392803:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11324 00010000:00010000:0.0:1651529344.392810:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4f923 lrc: 2/0,0 mode: PW/PW res: [0x2b35c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392813:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000093dbd0d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.392814:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4f923 lrc: 2/0,0 mode: PW/PW res: [0x2b35c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392817:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4f923 lrc: 3/0,0 mode: PW/PW res: [0x2b35c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.392821:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:39030:x1731745946328128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 924us (997us total) trans 12885078595 rc 0/0 00010000:00010000:0.0:1651529344.392821:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4f923 lrc: 1/0,0 mode: --/PW res: [0x2b35c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392823:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4f923 lrc: 0/0,0 mode: --/PW res: [0x2b35c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.392824:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210541 00010000:00010000:1.0:1651529344.392831:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4f92a lrc: 3/0,1 mode: PW/PW res: [0x2b35e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.392834:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4f92a lrc: 3/0,1 mode: PW/PW res: [0x2b35e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392834:0:80281:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c4d48d lrc: 0/0,0 mode: --/PR res: [0x2b35d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0414 expref: 2023 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.392837:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4f92a lrc: 3/0,1 mode: PW/PW res: [0x2b35e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.392838:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996941312:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.392840:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4f92a lrc: 2/0,0 mode: PW/PW res: [0x2b35e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392842:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000032623d9a/0x3234de053c4f91c lrc: 3/0,1 mode: PW/PW res: [0x2b35d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392845:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000032623d9a/0x3234de053c4f91c lrc: 3/0,1 mode: PW/PW res: [0x2b35d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392854:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032623d9a/0x3234de053c4f91c lrc: 3/0,1 mode: PW/PW res: [0x2b35d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392860:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032623d9a/0x3234de053c4f91c lrc: 3/0,1 mode: PW/PW res: [0x2b35d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392863:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032623d9a/0x3234de053c4f91c lrc: 2/0,0 mode: PW/PW res: [0x2b35d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.392881:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+39:39030:x1731745946328256:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 921us (1038us total) trans 12885078596 rc 0/0 00000100:00100000:1.0:1651529344.392884:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210542 00000100:00100000:0.0:1651529344.392904:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:39030:x1731745946328192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1030us (1122us total) trans 12885078597 rc 0/0 00000100:00100000:0.0:1651529344.392907:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210540 00010000:00010000:0.0:1651529344.392914:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4f92a lrc: 2/0,0 mode: PW/PW res: [0x2b35e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392917:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000040cd657 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.392918:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.392918:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4f92a lrc: 2/0,0 mode: PW/PW res: [0x2b35e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392921:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4f92a lrc: 3/0,0 mode: PW/PW res: [0x2b35e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392933:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4f92a lrc: 1/0,0 mode: --/PW res: [0x2b35e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.392936:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.392936:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4f92a lrc: 0/0,0 mode: --/PW res: [0x2b35e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392941:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032623d9a/0x3234de053c4f91c lrc: 2/0,0 mode: PW/PW res: [0x2b35d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392944:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032623d9a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.392945:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032623d9a/0x3234de053c4f91c lrc: 2/0,0 mode: PW/PW res: [0x2b35d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392947:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032623d9a/0x3234de053c4f91c lrc: 3/0,0 mode: PW/PW res: [0x2b35d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.392949:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.392950:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032623d9a/0x3234de053c4f91c lrc: 1/0,0 mode: --/PW res: [0x2b35d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392953:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032623d9a/0x3234de053c4f91c lrc: 0/0,0 mode: --/PW res: [0x2b35d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.392960:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946329024 00000100:00100000:0.0:1651529344.392969:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946328960 00000100:00100000:0.0:1651529344.392975:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946329088 00000100:00100000:0.0:1651529344.392979:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210545 00000100:00100000:0.0:1651529344.392980:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+41:39029:x1731745946329024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.392985:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176994 count 1 00010000:00010000:0.0:1651529344.392989:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037e784ed/0x3234de053c4f93f lrc: 3/0,1 mode: --/PW res: [0x2b362:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.392994:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c4f071 lrc: 2/0,0 mode: PR/PR res: [0x2b362:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d74ae expref: 2022 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.392997:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.392998:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.392998:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037e784ed/0x3234de053c4f93f lrc: 4/0,1 mode: --/PW res: [0x2b362:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393005:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c4f071 lrc: 3/0,0 mode: PR/PR res: [0x2b362:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d74ae expref: 2022 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.393009:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c4f071 lrc: 4/0,0 mode: PR/PR res: [0x2b362:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d74ae expref: 2022 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.393013:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996941632:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.393018:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210546 00000100:00100000:1.0:1651529344.393025:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+41:39029:x1731745946328960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.393031:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176993 count 1 00010000:00010000:1.0:1651529344.393036:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c4f946 lrc: 3/0,1 mode: --/PW res: [0x2b361:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.393042:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 0000000094c2f645 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.393047:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c4e0a3 lrc: 2/0,0 mode: PR/PR res: [0x2b361:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3315 expref: 2022 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.393050:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.393050:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210547 00010000:00010000:1.0:1651529344.393051:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.393052:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c4f946 lrc: 4/0,1 mode: --/PW res: [0x2b361:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.393052:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+41:39029:x1731745946329088:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.393057:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176995 count 1 00010000:00010000:1.0:1651529344.393059:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c4e0a3 lrc: 3/0,0 mode: PR/PR res: [0x2b361:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3315 expref: 2022 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.393061:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f28e787e/0x3234de053c4f94d lrc: 3/0,1 mode: --/PW res: [0x2b363:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.393062:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c4e0a3 lrc: 4/0,0 mode: PR/PR res: [0x2b361:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3315 expref: 2022 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.393066:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d9ef3c1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996941696:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.393066:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000011522e38/0x3234de053c4e2b7 lrc: 2/0,0 mode: PR/PR res: [0x2b363:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c0d expref: 2022 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.393069:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.393069:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.393070:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f28e787e/0x3234de053c4f94d lrc: 4/0,1 mode: --/PW res: [0x2b363:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.393075:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aeda71fe going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.393091:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000011522e38/0x3234de053c4e2b7 lrc: 3/0,0 mode: PR/PR res: [0x2b363:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c0d expref: 2022 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.393097:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000011522e38/0x3234de053c4e2b7 lrc: 4/0,0 mode: PR/PR res: [0x2b363:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c0d expref: 2022 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.393101:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996941760:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.393127:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e49f83de going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.393160:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.393171:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.393177:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.393184:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946329152 00000100:00100000:1.0:1651529344.393190:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946329280 00000100:00100000:1.0:1651529344.393198:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946329216 00000100:00100000:1.0:1651529344.393204:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210548 00000100:00100000:1.0:1651529344.393205:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+44:39029:x1731745946329152:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.393210:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176996 count 1 00000100:00100000:0.0:1651529344.393210:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210549 00000100:00100000:0.0:1651529344.393212:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d3f0e749 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+44:39029:x1731745946329280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.393215:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cd0c9be/0x3234de053c4f954 lrc: 3/0,1 mode: --/PW res: [0x2b364:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.393218:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176998 count 1 00010000:00010000:1.0:1651529344.393220:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c4db4e lrc: 2/0,0 mode: PR/PR res: [0x2b364:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d43 expref: 2022 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.393237:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.393237:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.393237:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4f95b lrc: 3/0,1 mode: --/PW res: [0x2b366:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.393238:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000cd0c9be/0x3234de053c4f954 lrc: 4/0,1 mode: --/PW res: [0x2b364:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393242:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000070346c06/0x3234de053c4d92c lrc: 2/0,0 mode: PR/PR res: [0x2b366:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d156a expref: 2022 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.393245:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c4db4e lrc: 3/0,0 mode: PR/PR res: [0x2b364:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d43 expref: 2022 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.393245:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.393246:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.393247:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4f95b lrc: 4/0,1 mode: --/PW res: [0x2b366:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.393249:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c4db4e lrc: 4/0,0 mode: PR/PR res: [0x2b364:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d43 expref: 2022 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.393253:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004a6776b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996941824:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.393254:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000070346c06/0x3234de053c4d92c lrc: 3/0,0 mode: PR/PR res: [0x2b366:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d156a expref: 2022 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.393257:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000070346c06/0x3234de053c4d92c lrc: 4/0,0 mode: PR/PR res: [0x2b366:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d156a expref: 2022 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.393263:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000499d0377 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.393264:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996941888:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.393269:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210550 00000100:00100000:1.0:1651529344.393271:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+44:39029:x1731745946329216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.393273:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000382571b5 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.393275:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176997 count 1 00010000:00010000:1.0:1651529344.393279:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4f962 lrc: 3/0,1 mode: --/PW res: [0x2b365:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.393283:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c4d5ac lrc: 2/0,0 mode: PR/PR res: [0x2b365:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0819 expref: 2022 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.393286:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.393287:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.393288:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4f962 lrc: 4/0,1 mode: --/PW res: [0x2b365:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.393294:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c4d5ac lrc: 3/0,0 mode: PR/PR res: [0x2b365:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0819 expref: 2022 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.393297:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c4d5ac lrc: 4/0,0 mode: PR/PR res: [0x2b365:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0819 expref: 2022 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.393301:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014f8af45 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996941952:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.393308:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000babe2d90 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.393432:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996941504:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.393446:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007bce9af0/0x3234de053c4f931 lrc: 3/0,1 mode: --/PW res: [0x2b360:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.393463:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996941632:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.393466:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000037e784ed/0x3234de053c4f93f lrc: 3/0,1 mode: --/PW res: [0x2b362:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.393477:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.393478:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996941760:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.393485:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.393485:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f28e787e/0x3234de053c4f94d lrc: 3/0,1 mode: --/PW res: [0x2b363:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.393493:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.393501:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.393504:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396209920 00000100:00100000:1.0:1651529344.393509:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.393517:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d9ef3c1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996941696:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.393524:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c778ad9d/0x3234de053c4de57 lrc: 4/0,0 mode: PR/PR res: [0x2b360:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a16 expref: 2023 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.393527:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c4f946 lrc: 3/0,1 mode: --/PW res: [0x2b361:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.393530:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396210048 00010000:00010000:0.0:1651529344.393533:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c4f071 lrc: 4/0,0 mode: PR/PR res: [0x2b362:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d74ae expref: 2024 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.393535:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ffb5d0a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996941568:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.393537:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c4f938 lrc: 3/0,1 mode: --/PW res: [0x2b35f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.393537:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396210176 00010000:00010000:0.0:1651529344.393539:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000011522e38/0x3234de053c4e2b7 lrc: 4/0,0 mode: PR/PR res: [0x2b363:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c0d expref: 2025 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.393543:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396209984 00000100:00100000:0.0:1651529344.393543:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396210112 00010000:00010000:0.0:1651529344.393546:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c4e0a3 lrc: 4/0,0 mode: PR/PR res: [0x2b361:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3315 expref: 2027 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.393548:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c4c655 lrc: 4/0,0 mode: PR/PR res: [0x2b35f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb2d expref: 2027 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.393550:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11325 00000100:00100000:0.0:1651529344.393552:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2027:41278:x1731746396209920:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.393554:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.393555:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11326 00010000:00010000:0.0:1651529344.393555:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c778ad9d/0x3234de053c4de57 lrc: 4/0,0 mode: PR/PR res: [0x2b360:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a16 expref: 2027 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.393556:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2027:41278:x1731746396210048:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.393559:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.393559:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c778ad9d/0x3234de053c4de57 lrc: 3/0,0 mode: PR/PR res: [0x2b360:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a16 expref: 2027 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.393561:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c4f071 lrc: 4/0,0 mode: PR/PR res: [0x2b362:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d74ae expref: 2027 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.393564:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c4f071 lrc: 3/0,0 mode: PR/PR res: [0x2b362:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d74ae expref: 2027 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.393565:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c778ad9d/0x3234de053c4de57 lrc: 0/0,0 mode: --/PR res: [0x2b360:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a16 expref: 2027 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.393569:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.393569:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.393570:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c4f071 lrc: 0/0,0 mode: --/PR res: [0x2b362:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d74ae expref: 2026 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.393570:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007bce9af0/0x3234de053c4f931 lrc: 3/0,1 mode: PW/PW res: [0x2b360:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393573:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007bce9af0/0x3234de053c4f931 lrc: 4/0,1 mode: PW/PW res: [0x2b360:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.393574:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.393574:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.393575:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000037e784ed/0x3234de053c4f93f lrc: 3/0,1 mode: PW/PW res: [0x2b362:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.393578:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037e784ed/0x3234de053c4f93f lrc: 4/0,1 mode: PW/PW res: [0x2b362:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393580:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.393589:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.393598:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2025:41278:x1731746396209920:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 45us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.393602:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2025:41278:x1731746396210048:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 45us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.393625:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11325 00000100:00100000:1.0:1651529344.393633:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11326 00000100:00100000:0.0:1651529344.393635:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11327 00000100:00100000:0.0:1651529344.393637:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2023:41278:x1731746396210176:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.393639:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11328 00010000:00010000:0.0:1651529344.393640:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.393641:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000db7aa2bf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2023:41279:x1731746396210112:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.393642:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000011522e38/0x3234de053c4e2b7 lrc: 4/0,0 mode: PR/PR res: [0x2b363:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c0d expref: 2023 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.393643:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.393645:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c4e0a3 lrc: 4/0,0 mode: PR/PR res: [0x2b361:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3315 expref: 2023 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.393646:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000011522e38/0x3234de053c4e2b7 lrc: 3/0,0 mode: PR/PR res: [0x2b363:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c0d expref: 2023 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.393649:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c4e0a3 lrc: 3/0,0 mode: PR/PR res: [0x2b361:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3315 expref: 2023 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.393652:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011522e38/0x3234de053c4e2b7 lrc: 0/0,0 mode: --/PR res: [0x2b363:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c0d expref: 2023 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.393654:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c4e0a3 lrc: 0/0,0 mode: --/PR res: [0x2b361:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3315 expref: 2023 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.393655:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.393656:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.393657:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f28e787e/0x3234de053c4f94d lrc: 3/0,1 mode: PW/PW res: [0x2b363:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.393658:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.393658:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.393659:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c4f946 lrc: 3/0,1 mode: PW/PW res: [0x2b361:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393660:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f28e787e/0x3234de053c4f94d lrc: 4/0,1 mode: PW/PW res: [0x2b363:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.393662:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c4f946 lrc: 4/0,1 mode: PW/PW res: [0x2b361:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393667:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.393668:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.393674:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2021:41278:x1731746396210176:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.393675:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000db7aa2bf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2021:41279:x1731746396210112:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 34us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.393676:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11327 00000100:00100000:1.0:1651529344.393678:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11328 00000100:00100000:0.0:1651529344.393681:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11329 00000100:00100000:0.0:1651529344.393683:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2019:41279:x1731746396209984:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.393685:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c4f946 lrc: 3/0,1 mode: PW/PW res: [0x2b361:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393685:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.393686:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c4c655 lrc: 4/0,0 mode: PR/PR res: [0x2b35f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb2d expref: 2019 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.393689:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c4f946 lrc: 3/0,1 mode: PW/PW res: [0x2b361:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393690:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c4c655 lrc: 3/0,0 mode: PR/PR res: [0x2b35f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb2d expref: 2019 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.393694:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c4f946 lrc: 3/0,1 mode: PW/PW res: [0x2b361:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393695:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c4c655 lrc: 0/0,0 mode: --/PR res: [0x2b35f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb2d expref: 2019 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.393697:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c4f946 lrc: 2/0,0 mode: PW/PW res: [0x2b361:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393698:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.393698:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.393699:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c4f938 lrc: 3/0,1 mode: PW/PW res: [0x2b35f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393702:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c4f938 lrc: 4/0,1 mode: PW/PW res: [0x2b35f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393717:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.393723:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2018:41279:x1731746396209984:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 40us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.393726:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11329 00010000:00010000:0.0:1651529344.393747:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c4f946 lrc: 2/0,0 mode: PW/PW res: [0x2b361:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393751:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000af20b5e7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.393752:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c4f946 lrc: 2/0,0 mode: PW/PW res: [0x2b361:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393755:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c4f946 lrc: 3/0,0 mode: PW/PW res: [0x2b361:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393759:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c4f946 lrc: 1/0,0 mode: --/PW res: [0x2b361:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.393760:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+45:39029:x1731745946328960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 733us (823us total) trans 12885078598 rc 0/0 00010000:00010000:0.0:1651529344.393762:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c4f946 lrc: 0/0,0 mode: --/PW res: [0x2b361:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.393763:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210546 00010000:00010000:1.0:1651529344.393770:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c4f938 lrc: 3/0,1 mode: PW/PW res: [0x2b35f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393770:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000037e784ed/0x3234de053c4f93f lrc: 3/0,1 mode: PW/PW res: [0x2b362:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.393773:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c4f938 lrc: 3/0,1 mode: PW/PW res: [0x2b35f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393773:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037e784ed/0x3234de053c4f93f lrc: 3/0,1 mode: PW/PW res: [0x2b362:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.393776:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c4f938 lrc: 3/0,1 mode: PW/PW res: [0x2b35f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393776:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037e784ed/0x3234de053c4f93f lrc: 3/0,1 mode: PW/PW res: [0x2b362:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393778:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037e784ed/0x3234de053c4f93f lrc: 2/0,0 mode: PW/PW res: [0x2b362:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.393779:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c4f938 lrc: 2/0,0 mode: PW/PW res: [0x2b35f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.393818:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+46:39029:x1731745946328832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1173us (1303us total) trans 12885078599 rc 0/0 00000100:00100000:1.0:1651529344.393820:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210544 00000100:00100000:0.0:1651529344.393829:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+45:39029:x1731745946329024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 847us (911us total) trans 12885078600 rc 0/0 00000100:00100000:0.0:1651529344.393832:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210545 00010000:00010000:0.0:1651529344.393847:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037e784ed/0x3234de053c4f93f lrc: 2/0,0 mode: PW/PW res: [0x2b362:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393853:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000037e784ed already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.393854:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037e784ed/0x3234de053c4f93f lrc: 2/0,0 mode: PW/PW res: [0x2b362:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393857:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037e784ed/0x3234de053c4f93f lrc: 3/0,0 mode: PW/PW res: [0x2b362:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393862:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037e784ed/0x3234de053c4f93f lrc: 1/0,0 mode: --/PW res: [0x2b362:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.393865:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.393865:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037e784ed/0x3234de053c4f93f lrc: 0/0,0 mode: --/PW res: [0x2b362:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393873:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c4f938 lrc: 2/0,0 mode: PW/PW res: [0x2b35f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.393876:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.393876:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002e1250c9 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.393877:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c4f938 lrc: 2/0,0 mode: PW/PW res: [0x2b35f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393885:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c4f938 lrc: 3/0,0 mode: PW/PW res: [0x2b35f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.393888:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.393888:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c4f938 lrc: 1/0,0 mode: --/PW res: [0x2b35f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393895:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c4f938 lrc: 0/0,0 mode: --/PW res: [0x2b35f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.393906:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996941888:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.393910:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4f95b lrc: 3/0,1 mode: --/PW res: [0x2b366:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.393916:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396210304 00010000:00010000:0.0:1651529344.393920:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c4db4e lrc: 5/0,0 mode: PR/PR res: [0x2b364:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d43 expref: 2018 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.393931:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396210240 00010000:00010000:0.0:1651529344.393934:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000070346c06/0x3234de053c4d92c lrc: 4/0,0 mode: PR/PR res: [0x2b366:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d156a expref: 2019 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.393938:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396210368 00010000:00010000:0.0:1651529344.393940:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c4d5ac lrc: 5/0,0 mode: PR/PR res: [0x2b365:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0819 expref: 2020 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.393945:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11330 00000100:00100000:1.0:1651529344.393946:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014f8af45 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996941952:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.393947:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2020:41278:x1731746396210304:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.393949:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.393950:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4f962 lrc: 3/0,1 mode: --/PW res: [0x2b365:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393950:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c4db4e lrc: 5/0,0 mode: PR/PR res: [0x2b364:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d43 expref: 2020 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.393954:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c4db4e lrc: 4/0,0 mode: PR/PR res: [0x2b364:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d43 expref: 2020 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.393957:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004a6776b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996941824:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.393960:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000cd0c9be/0x3234de053c4f954 lrc: 3/0,1 mode: --/PW res: [0x2b364:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.393962:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c4db4e lrc: 0/0,0 mode: --/PR res: [0x2b364:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d43 expref: 2020 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.393966:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11331 00010000:00010000:0.0:1651529344.393966:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.393967:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.393967:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000cd0c9be/0x3234de053c4f954 lrc: 3/0,1 mode: PW/PW res: [0x2b364:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.393968:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2019:41278:x1731746396210240:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.393970:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000cd0c9be/0x3234de053c4f954 lrc: 4/0,1 mode: PW/PW res: [0x2b364:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.393972:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.393973:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000070346c06/0x3234de053c4d92c lrc: 4/0,0 mode: PR/PR res: [0x2b366:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d156a expref: 2019 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.393979:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.393985:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000070346c06/0x3234de053c4d92c lrc: 3/0,0 mode: PR/PR res: [0x2b366:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d156a expref: 2019 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.394000:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070346c06/0x3234de053c4d92c lrc: 0/0,0 mode: --/PR res: [0x2b366:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d156a expref: 2019 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.394004:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.394004:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2018:41278:x1731746396210304:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 56us (139us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.394005:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.394005:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4f95b lrc: 3/0,1 mode: PW/PW res: [0x2b366:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.394007:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11330 00010000:00010000:1.0:1651529344.394008:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4f95b lrc: 4/0,1 mode: PW/PW res: [0x2b366:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.394012:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11332 00000100:00100000:0.0:1651529344.394014:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2017:41278:x1731746396210368:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.394018:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.394023:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.394025:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2017:41278:x1731746396210240:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 56us (148us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.394025:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c4d5ac lrc: 4/0,0 mode: PR/PR res: [0x2b365:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0819 expref: 2017 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.394028:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11331 00010000:00010000:0.0:1651529344.394029:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c4d5ac lrc: 3/0,0 mode: PR/PR res: [0x2b365:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0819 expref: 2017 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.394035:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000cd0c9be/0x3234de053c4f954 lrc: 3/0,1 mode: PW/PW res: [0x2b364:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.394035:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c4d5ac lrc: 0/0,0 mode: --/PR res: [0x2b365:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0819 expref: 2016 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.394038:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000cd0c9be/0x3234de053c4f954 lrc: 3/0,1 mode: PW/PW res: [0x2b364:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.394041:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cd0c9be/0x3234de053c4f954 lrc: 3/0,1 mode: PW/PW res: [0x2b364:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.394041:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.394042:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.394043:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4f962 lrc: 3/0,1 mode: PW/PW res: [0x2b365:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.394044:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000cd0c9be/0x3234de053c4f954 lrc: 2/0,0 mode: PW/PW res: [0x2b364:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.394046:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4f962 lrc: 4/0,1 mode: PW/PW res: [0x2b365:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.394059:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.394066:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2015:41278:x1731746396210368:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 52us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.394069:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11332 00010000:00010000:0.0:1651529344.394076:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000cd0c9be/0x3234de053c4f954 lrc: 2/0,0 mode: PW/PW res: [0x2b364:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.394079:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000cd0c9be already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.394080:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000cd0c9be/0x3234de053c4f954 lrc: 2/0,0 mode: PW/PW res: [0x2b364:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.394083:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000cd0c9be/0x3234de053c4f954 lrc: 3/0,0 mode: PW/PW res: [0x2b364:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.394087:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000cd0c9be/0x3234de053c4f954 lrc: 1/0,0 mode: --/PW res: [0x2b364:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.394089:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000cd0c9be/0x3234de053c4f954 lrc: 0/0,0 mode: --/PW res: [0x2b364:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.394092:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:39029:x1731745946329152:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 885us (932us total) trans 12885078601 rc 0/0 00000100:00100000:1.0:1651529344.394095:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210548 00010000:00010000:0.0:1651529344.394097:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4f95b lrc: 3/0,1 mode: PW/PW res: [0x2b366:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.394100:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4f95b lrc: 3/0,1 mode: PW/PW res: [0x2b366:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.394102:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4f962 lrc: 3/0,1 mode: PW/PW res: [0x2b365:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.394103:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4f95b lrc: 3/0,1 mode: PW/PW res: [0x2b366:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.394105:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4f962 lrc: 3/0,1 mode: PW/PW res: [0x2b365:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.394105:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4f95b lrc: 2/0,0 mode: PW/PW res: [0x2b366:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.394108:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4f962 lrc: 3/0,1 mode: PW/PW res: [0x2b365:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.394111:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4f962 lrc: 2/0,0 mode: PW/PW res: [0x2b365:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.394150:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+46:39029:x1731745946329216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 878us (972us total) trans 12885078602 rc 0/0 00000100:00100000:1.0:1651529344.394153:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210550 00000100:00100000:0.0:1651529344.394165:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d3f0e749 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+45:39029:x1731745946329280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 952us (993us total) trans 12885078603 rc 0/0 00000100:00100000:0.0:1651529344.394168:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210549 00010000:00010000:0.0:1651529344.394175:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4f95b lrc: 2/0,0 mode: PW/PW res: [0x2b366:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.394179:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000041a7efd7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.394179:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4f95b lrc: 2/0,0 mode: PW/PW res: [0x2b366:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.394182:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4f95b lrc: 3/0,0 mode: PW/PW res: [0x2b366:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.394186:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.394187:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4f95b lrc: 1/0,0 mode: --/PW res: [0x2b366:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.394197:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4f95b lrc: 0/0,0 mode: --/PW res: [0x2b366:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.394202:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4f962 lrc: 2/0,0 mode: PW/PW res: [0x2b365:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.394203:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.394204:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b3ecd1a6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.394205:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4f962 lrc: 2/0,0 mode: PW/PW res: [0x2b365:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.394208:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4f962 lrc: 3/0,0 mode: PW/PW res: [0x2b365:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.394211:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4f962 lrc: 1/0,0 mode: --/PW res: [0x2b365:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.394214:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4f962 lrc: 0/0,0 mode: --/PW res: [0x2b365:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.394215:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.394221:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946329792 00000100:00100000:0.0:1651529344.394246:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946329856 00000100:00100000:0.0:1651529344.394252:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946329920 00000100:00100000:0.0:1651529344.394256:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210551 00000100:00100000:0.0:1651529344.394258:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+47:39029:x1731745946329792:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.394263:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:176999 count 1 00010000:00010000:0.0:1651529344.394267:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4f969 lrc: 3/0,1 mode: --/PW res: [0x2b367:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.394272:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c151b720/0x3234de053c4ccad lrc: 2/0,0 mode: PR/PR res: [0x2b367:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce48d expref: 2014 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.394275:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.394276:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.394276:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4f969 lrc: 4/0,1 mode: --/PW res: [0x2b367:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.394283:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c151b720/0x3234de053c4ccad lrc: 3/0,0 mode: PR/PR res: [0x2b367:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce48d expref: 2014 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.394285:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210552 00000100:00100000:1.0:1651529344.394287:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+47:39030:x1731745946329856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.394287:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c151b720/0x3234de053c4ccad lrc: 4/0,0 mode: PR/PR res: [0x2b367:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce48d expref: 2014 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.394291:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996942016:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.394293:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177000 count 1 00010000:00010000:1.0:1651529344.394298:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c4f970 lrc: 3/0,1 mode: --/PW res: [0x2b368:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.394304:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 000000001ec7f4cb going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.394309:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c4ebb6 lrc: 2/0,0 mode: PR/PR res: [0x2b368:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6087 expref: 2014 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.394311:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f28e787e/0x3234de053c4f94d lrc: 3/0,1 mode: PW/PW res: [0x2b363:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.394312:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.394313:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.394314:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c4f970 lrc: 4/0,1 mode: --/PW res: [0x2b368:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.394315:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f28e787e/0x3234de053c4f94d lrc: 3/0,1 mode: PW/PW res: [0x2b363:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.394318:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f28e787e/0x3234de053c4f94d lrc: 3/0,1 mode: PW/PW res: [0x2b363:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.394320:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f28e787e/0x3234de053c4f94d lrc: 2/0,0 mode: PW/PW res: [0x2b363:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.394321:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c4ebb6 lrc: 3/0,0 mode: PR/PR res: [0x2b368:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6087 expref: 2014 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.394327:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c4ebb6 lrc: 4/0,0 mode: PR/PR res: [0x2b368:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6087 expref: 2014 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.394331:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000053ee5af1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996942080:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.394340:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd96f074 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.394346:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210553 00000100:00100000:1.0:1651529344.394348:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+47:39029:x1731745946329920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.394352:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177001 count 1 00010000:00010000:1.0:1651529344.394356:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e8b8142/0x3234de053c4f977 lrc: 3/0,1 mode: --/PW res: [0x2b369:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.394360:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001f3c2fb2/0x3234de053c4dc19 lrc: 2/0,0 mode: PR/PR res: [0x2b369:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d20d8 expref: 2014 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.394363:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.394364:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.394365:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e8b8142/0x3234de053c4f977 lrc: 4/0,1 mode: --/PW res: [0x2b369:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.394370:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001f3c2fb2/0x3234de053c4dc19 lrc: 3/0,0 mode: PR/PR res: [0x2b369:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d20d8 expref: 2014 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.394373:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001f3c2fb2/0x3234de053c4dc19 lrc: 4/0,0 mode: PR/PR res: [0x2b369:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d20d8 expref: 2014 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.394377:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+48:39029:x1731745946329088:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1324us (1428us total) trans 12885078604 rc 0/0 00000100:00100000:1.0:1651529344.394380:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cee35a0c pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996942144:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.394380:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210547 00000100:00100000:1.0:1651529344.394386:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 0000000018ebe812 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.394387:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f28e787e/0x3234de053c4f94d lrc: 2/0,0 mode: PW/PW res: [0x2b363:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.394391:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f28e787e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.394392:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f28e787e/0x3234de053c4f94d lrc: 2/0,0 mode: PW/PW res: [0x2b363:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.394395:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f28e787e/0x3234de053c4f94d lrc: 3/0,0 mode: PW/PW res: [0x2b363:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.394399:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f28e787e/0x3234de053c4f94d lrc: 1/0,0 mode: --/PW res: [0x2b363:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.394402:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f28e787e/0x3234de053c4f94d lrc: 0/0,0 mode: --/PW res: [0x2b363:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.394408:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007bce9af0/0x3234de053c4f931 lrc: 3/0,1 mode: PW/PW res: [0x2b360:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.394412:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007bce9af0/0x3234de053c4f931 lrc: 3/0,1 mode: PW/PW res: [0x2b360:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.394414:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007bce9af0/0x3234de053c4f931 lrc: 3/0,1 mode: PW/PW res: [0x2b360:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.394417:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007bce9af0/0x3234de053c4f931 lrc: 2/0,0 mode: PW/PW res: [0x2b360:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.394461:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.394472:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.394480:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.394486:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946330112 00000100:00100000:1.0:1651529344.394495:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946330048 00000100:00100000:0.0:1651529344.394504:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+50:39029:x1731745946328896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1924us (2024us total) trans 12885078605 rc 0/0 00000100:00100000:1.0:1651529344.394505:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946330176 00000100:00100000:0.0:1651529344.394507:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210543 00000100:00100000:1.0:1651529344.394512:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210554 00000100:00100000:1.0:1651529344.394513:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+50:39030:x1731745946330112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.394518:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177003 count 1 00010000:00010000:1.0:1651529344.394522:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000411ac620/0x3234de053c4f97e lrc: 3/0,1 mode: --/PW res: [0x2b36b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.394527:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001750092b/0x3234de053c4ed61 lrc: 2/0,0 mode: PR/PR res: [0x2b36b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d679c expref: 2014 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.394530:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.394531:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.394531:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000411ac620/0x3234de053c4f97e lrc: 4/0,1 mode: --/PW res: [0x2b36b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.394538:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001750092b/0x3234de053c4ed61 lrc: 3/0,0 mode: PR/PR res: [0x2b36b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d679c expref: 2014 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.394539:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210555 00010000:00010000:1.0:1651529344.394541:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001750092b/0x3234de053c4ed61 lrc: 4/0,0 mode: PR/PR res: [0x2b36b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d679c expref: 2014 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.394541:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+50:39029:x1731745946330048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.394545:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000913beefe pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996942208:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.394547:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177002 count 1 00010000:00010000:0.0:1651529344.394552:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4f985 lrc: 3/0,1 mode: --/PW res: [0x2b36a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.394553:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fb6c773d going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.394556:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c8ab2b49/0x3234de053c4f07f lrc: 2/0,0 mode: PR/PR res: [0x2b36a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d74e6 expref: 2014 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.394559:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.394560:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210556 00010000:00010000:0.0:1651529344.394560:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.394561:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+50:39029:x1731745946330176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.394561:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4f985 lrc: 4/0,1 mode: --/PW res: [0x2b36a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.394565:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177004 count 1 00010000:00010000:0.0:1651529344.394567:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c8ab2b49/0x3234de053c4f07f lrc: 3/0,0 mode: PR/PR res: [0x2b36a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d74e6 expref: 2014 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.394569:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c4f98c lrc: 3/0,1 mode: --/PW res: [0x2b36c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.394571:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c8ab2b49/0x3234de053c4f07f lrc: 4/0,0 mode: PR/PR res: [0x2b36a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d74e6 expref: 2014 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.394573:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000af439eec/0x3234de053c4dd46 lrc: 2/0,0 mode: PR/PR res: [0x2b36c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d263b expref: 2014 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.394576:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.394576:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.394577:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c4f98c lrc: 4/0,1 mode: --/PW res: [0x2b36c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.394578:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996942272:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.394583:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000af439eec/0x3234de053c4dd46 lrc: 3/0,0 mode: PR/PR res: [0x2b36c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d263b expref: 2014 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.394586:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000af439eec/0x3234de053c4dd46 lrc: 4/0,0 mode: PR/PR res: [0x2b36c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d263b expref: 2014 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.394586:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b032d2f9 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.394590:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000023afca5e pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996942336:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.394591:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007bce9af0/0x3234de053c4f931 lrc: 2/0,0 mode: PW/PW res: [0x2b360:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.394595:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007bce9af0 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.394596:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a6b79b05 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.394596:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007bce9af0/0x3234de053c4f931 lrc: 2/0,0 mode: PW/PW res: [0x2b360:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.394598:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007bce9af0/0x3234de053c4f931 lrc: 3/0,0 mode: PW/PW res: [0x2b360:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.394603:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007bce9af0/0x3234de053c4f931 lrc: 1/0,0 mode: --/PW res: [0x2b360:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.394605:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007bce9af0/0x3234de053c4f931 lrc: 0/0,0 mode: --/PW res: [0x2b360:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.394610:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.394624:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946330240 00000100:00100000:0.0:1651529344.394635:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210557 00000100:00100000:0.0:1651529344.394637:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+51:39030:x1731745946330240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.394642:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177005 count 1 00010000:00010000:0.0:1651529344.394645:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4f993 lrc: 3/0,1 mode: --/PW res: [0x2b36d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.394650:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bcdc8b9f/0x3234de053c4e5d5 lrc: 2/0,0 mode: PR/PR res: [0x2b36d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d48d9 expref: 2014 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.394653:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.394654:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.394654:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4f993 lrc: 4/0,1 mode: --/PW res: [0x2b36d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.394660:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bcdc8b9f/0x3234de053c4e5d5 lrc: 3/0,0 mode: PR/PR res: [0x2b36d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d48d9 expref: 2014 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.394663:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bcdc8b9f/0x3234de053c4e5d5 lrc: 4/0,0 mode: PR/PR res: [0x2b36d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d48d9 expref: 2014 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.394667:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996942400:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.394681:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c34c0cde going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.394783:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.394803:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946330368 00000100:00100000:0.0:1651529344.394819:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210558 00000100:00100000:0.0:1651529344.394821:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+52:39030:x1731745946330368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.394826:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177006 count 1 00010000:00010000:0.0:1651529344.394830:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4f99a lrc: 3/0,1 mode: --/PW res: [0x2b36e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.394834:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000fc3d0e3/0x3234de053c4c8ee lrc: 2/0,0 mode: PR/PR res: [0x2b36e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd53d expref: 2014 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.394838:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.394838:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.394839:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4f99a lrc: 4/0,1 mode: --/PW res: [0x2b36e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.394862:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000fc3d0e3/0x3234de053c4c8ee lrc: 3/0,0 mode: PR/PR res: [0x2b36e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd53d expref: 2014 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.394866:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000fc3d0e3/0x3234de053c4c8ee lrc: 4/0,0 mode: PR/PR res: [0x2b36e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd53d expref: 2014 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.394870:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996942464:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.394883:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000efb6ae52 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.394912:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996942016:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.394916:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4f969 lrc: 3/0,1 mode: --/PW res: [0x2b367:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.394942:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996942272:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.394946:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4f985 lrc: 3/0,1 mode: --/PW res: [0x2b36a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.394952:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cee35a0c pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996942144:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.394957:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004e8b8142/0x3234de053c4f977 lrc: 3/0,1 mode: --/PW res: [0x2b369:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.394964:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000053ee5af1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996942080:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.394966:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c4f970 lrc: 3/0,1 mode: --/PW res: [0x2b368:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.394972:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000023afca5e pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996942336:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.394975:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c4f98c lrc: 3/0,1 mode: --/PW res: [0x2b36c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.394980:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000913beefe pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996942208:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.394983:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000411ac620/0x3234de053c4f97e lrc: 3/0,1 mode: --/PW res: [0x2b36b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.395211:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.395220:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.395220:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996942400:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.395240:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.395250:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.395256:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4f993 lrc: 3/0,1 mode: --/PW res: [0x2b36d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.395268:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396210816 00010000:00010000:0.0:1651529344.395273:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c151b720/0x3234de053c4ccad lrc: 4/0,0 mode: PR/PR res: [0x2b367:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce48d expref: 2015 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.395276:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.395281:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396210944 00000100:00100000:1.0:1651529344.395282:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.395283:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c4ebb6 lrc: 4/0,0 mode: PR/PR res: [0x2b368:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6087 expref: 2016 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.395287:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.395288:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396211008 00010000:00010000:0.0:1651529344.395290:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001f3c2fb2/0x3234de053c4dc19 lrc: 4/0,0 mode: PR/PR res: [0x2b369:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d20d8 expref: 2017 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.395301:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396211072 00010000:00010000:1.0:1651529344.395307:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001750092b/0x3234de053c4ed61 lrc: 4/0,0 mode: PR/PR res: [0x2b36b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d679c expref: 2018 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.395319:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396211136 00000100:00100000:0.0:1651529344.395321:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396211200 00010000:00010000:1.0:1651529344.395323:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c8ab2b49/0x3234de053c4f07f lrc: 4/0,0 mode: PR/PR res: [0x2b36a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d74e6 expref: 2020 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.395325:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000af439eec/0x3234de053c4dd46 lrc: 4/0,0 mode: PR/PR res: [0x2b36c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d263b expref: 2020 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.395327:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396211264 00010000:00010000:1.0:1651529344.395330:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bcdc8b9f/0x3234de053c4e5d5 lrc: 4/0,0 mode: PR/PR res: [0x2b36d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d48d9 expref: 2021 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.395330:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11333 00000100:00100000:0.0:1651529344.395332:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2021:41278:x1731746396210816:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.395334:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.395335:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11334 00010000:00010000:0.0:1651529344.395336:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c151b720/0x3234de053c4ccad lrc: 4/0,0 mode: PR/PR res: [0x2b367:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce48d expref: 2021 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.395337:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2021:41278:x1731746396210944:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.395340:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.395340:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c151b720/0x3234de053c4ccad lrc: 3/0,0 mode: PR/PR res: [0x2b367:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce48d expref: 2021 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.395341:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c4ebb6 lrc: 4/0,0 mode: PR/PR res: [0x2b368:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6087 expref: 2021 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.395345:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c4ebb6 lrc: 3/0,0 mode: PR/PR res: [0x2b368:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6087 expref: 2021 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.395345:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c151b720/0x3234de053c4ccad lrc: 0/0,0 mode: --/PR res: [0x2b367:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce48d expref: 2021 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.395349:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.395350:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.395350:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4f969 lrc: 3/0,1 mode: PW/PW res: [0x2b367:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395351:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c4ebb6 lrc: 0/0,0 mode: --/PR res: [0x2b368:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6087 expref: 2020 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.395354:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4f969 lrc: 4/0,1 mode: PW/PW res: [0x2b367:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395355:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.395355:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.395356:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c4f970 lrc: 3/0,1 mode: PW/PW res: [0x2b368:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395359:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c4f970 lrc: 4/0,1 mode: PW/PW res: [0x2b368:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395360:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.395366:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.395372:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2019:41278:x1731746396210816:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 40us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.395375:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11333 00000100:00100000:1.0:1651529344.395379:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2018:41278:x1731746396210944:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.395380:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11335 00000100:00100000:1.0:1651529344.395382:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11334 00000100:00100000:0.0:1651529344.395382:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000066a4e147 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2018:41278:x1731746396211072:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.395384:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.395386:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001750092b/0x3234de053c4ed61 lrc: 4/0,0 mode: PR/PR res: [0x2b36b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d679c expref: 2017 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.395387:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11336 00000100:00100000:1.0:1651529344.395389:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2017:41279:x1731746396211008:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.395390:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001750092b/0x3234de053c4ed61 lrc: 3/0,0 mode: PR/PR res: [0x2b36b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d679c expref: 2017 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.395392:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.395393:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001f3c2fb2/0x3234de053c4dc19 lrc: 4/0,0 mode: PR/PR res: [0x2b369:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d20d8 expref: 2017 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.395395:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001750092b/0x3234de053c4ed61 lrc: 0/0,0 mode: --/PR res: [0x2b36b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d679c expref: 2017 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.395397:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001f3c2fb2/0x3234de053c4dc19 lrc: 3/0,0 mode: PR/PR res: [0x2b369:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d20d8 expref: 2017 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.395398:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.395398:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.395399:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000411ac620/0x3234de053c4f97e lrc: 3/0,1 mode: PW/PW res: [0x2b36b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395402:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f3c2fb2/0x3234de053c4dc19 lrc: 0/0,0 mode: --/PR res: [0x2b369:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d20d8 expref: 2016 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.395405:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.395405:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000411ac620/0x3234de053c4f97e lrc: 4/0,1 mode: PW/PW res: [0x2b36b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395406:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.395407:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004e8b8142/0x3234de053c4f977 lrc: 3/0,1 mode: PW/PW res: [0x2b369:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395410:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e8b8142/0x3234de053c4f977 lrc: 4/0,1 mode: PW/PW res: [0x2b369:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395412:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.395418:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000066a4e147 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2015:41278:x1731746396211072:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 36us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.395421:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11335 00010000:00010000:1.0:1651529344.395422:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.395425:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11337 00000100:00100000:0.0:1651529344.395427:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2014:41279:x1731746396211136:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.395428:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2014:41279:x1731746396211008:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (187us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.395429:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.395431:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11336 00010000:00010000:0.0:1651529344.395431:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c8ab2b49/0x3234de053c4f07f lrc: 4/0,0 mode: PR/PR res: [0x2b36a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d74e6 expref: 2014 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.395434:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c8ab2b49/0x3234de053c4f07f lrc: 3/0,0 mode: PR/PR res: [0x2b36a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d74e6 expref: 2013 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.395439:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11338 00010000:00010000:0.0:1651529344.395439:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8ab2b49/0x3234de053c4f07f lrc: 0/0,0 mode: --/PR res: [0x2b36a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d74e6 expref: 2013 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.395441:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2013:41278:x1731746396211200:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.395442:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.395443:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.395443:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.395443:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4f985 lrc: 3/0,1 mode: PW/PW res: [0x2b36a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395445:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000af439eec/0x3234de053c4dd46 lrc: 4/0,0 mode: PR/PR res: [0x2b36c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d263b expref: 2012 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.395446:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4f985 lrc: 4/0,1 mode: PW/PW res: [0x2b36a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395448:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000af439eec/0x3234de053c4dd46 lrc: 3/0,0 mode: PR/PR res: [0x2b36c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d263b expref: 2012 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.395453:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af439eec/0x3234de053c4dd46 lrc: 0/0,0 mode: --/PR res: [0x2b36c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d263b expref: 2012 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.395455:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.395456:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.395457:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.395458:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c4f98c lrc: 3/0,1 mode: PW/PW res: [0x2b36c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.395459:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2011:41279:x1731746396211136:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (191us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.395461:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c4f98c lrc: 4/0,1 mode: PW/PW res: [0x2b36c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.395462:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11337 00010000:00010000:1.0:1651529344.395466:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.395466:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11339 00000100:00100000:0.0:1651529344.395468:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2010:41279:x1731746396211264:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.395470:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.395471:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2010:41278:x1731746396211200:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 30us (189us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.395471:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bcdc8b9f/0x3234de053c4e5d5 lrc: 4/0,0 mode: PR/PR res: [0x2b36d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d48d9 expref: 2010 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.395473:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11338 00010000:00010000:0.0:1651529344.395475:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bcdc8b9f/0x3234de053c4e5d5 lrc: 3/0,0 mode: PR/PR res: [0x2b36d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d48d9 expref: 2010 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.395479:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004e8b8142/0x3234de053c4f977 lrc: 3/0,1 mode: PW/PW res: [0x2b369:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395479:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bcdc8b9f/0x3234de053c4e5d5 lrc: 0/0,0 mode: --/PR res: [0x2b36d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d48d9 expref: 2009 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.395483:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e8b8142/0x3234de053c4f977 lrc: 3/0,1 mode: PW/PW res: [0x2b369:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395483:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.395483:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.395484:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4f993 lrc: 3/0,1 mode: PW/PW res: [0x2b36d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395486:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e8b8142/0x3234de053c4f977 lrc: 3/0,1 mode: PW/PW res: [0x2b369:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395487:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4f993 lrc: 4/0,1 mode: PW/PW res: [0x2b36d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395488:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e8b8142/0x3234de053c4f977 lrc: 2/0,0 mode: PW/PW res: [0x2b369:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395492:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.395503:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2008:41279:x1731746396211264:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.395505:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11339 00010000:00010000:0.0:1651529344.395512:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e8b8142/0x3234de053c4f977 lrc: 2/0,0 mode: PW/PW res: [0x2b369:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395515:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004e8b8142 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.395516:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e8b8142/0x3234de053c4f977 lrc: 2/0,0 mode: PW/PW res: [0x2b369:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395519:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e8b8142/0x3234de053c4f977 lrc: 3/0,0 mode: PW/PW res: [0x2b369:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395523:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e8b8142/0x3234de053c4f977 lrc: 1/0,0 mode: --/PW res: [0x2b369:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395526:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e8b8142/0x3234de053c4f977 lrc: 0/0,0 mode: --/PW res: [0x2b369:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395532:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4f969 lrc: 3/0,1 mode: PW/PW res: [0x2b367:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.395534:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+53:39029:x1731745946329920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1185us (1319us total) trans 12885078606 rc 0/0 00010000:00010000:0.0:1651529344.395535:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4f969 lrc: 3/0,1 mode: PW/PW res: [0x2b367:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.395537:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210553 00010000:00010000:0.0:1651529344.395538:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4f969 lrc: 3/0,1 mode: PW/PW res: [0x2b367:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395541:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4f969 lrc: 2/0,0 mode: PW/PW res: [0x2b367:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395544:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c4f970 lrc: 3/0,1 mode: PW/PW res: [0x2b368:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395547:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c4f970 lrc: 3/0,1 mode: PW/PW res: [0x2b368:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395550:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c4f970 lrc: 3/0,1 mode: PW/PW res: [0x2b368:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395553:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c4f970 lrc: 2/0,0 mode: PW/PW res: [0x2b368:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.395590:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+54:39029:x1731745946329792:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1331us (1404us total) trans 12885078607 rc 0/0 00000100:00100000:1.0:1651529344.395592:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+54:39030:x1731745946329856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1304us (1388us total) trans 12885078608 rc 0/0 00000100:00100000:0.0:1651529344.395593:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210551 00000100:00100000:1.0:1651529344.395597:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210552 00010000:00010000:0.0:1651529344.395601:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4f969 lrc: 2/0,0 mode: PW/PW res: [0x2b367:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395603:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c4f98c lrc: 3/0,1 mode: PW/PW res: [0x2b36c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395604:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002731c8d2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.395605:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4f969 lrc: 2/0,0 mode: PW/PW res: [0x2b367:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395607:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c4f98c lrc: 3/0,1 mode: PW/PW res: [0x2b36c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395608:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4f969 lrc: 3/0,0 mode: PW/PW res: [0x2b367:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395610:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c4f98c lrc: 3/0,1 mode: PW/PW res: [0x2b36c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395612:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c4f98c lrc: 2/0,0 mode: PW/PW res: [0x2b36c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395612:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4f969 lrc: 1/0,0 mode: --/PW res: [0x2b367:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395615:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4f969 lrc: 0/0,0 mode: --/PW res: [0x2b367:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395626:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c4f970 lrc: 2/0,0 mode: PW/PW res: [0x2b368:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395630:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008208703f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.395630:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c4f970 lrc: 2/0,0 mode: PW/PW res: [0x2b368:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395636:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c4f970 lrc: 3/0,0 mode: PW/PW res: [0x2b368:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395639:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c4f970 lrc: 1/0,0 mode: --/PW res: [0x2b368:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395642:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c4f970 lrc: 0/0,0 mode: --/PW res: [0x2b368:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395645:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c4f98c lrc: 2/0,0 mode: PW/PW res: [0x2b36c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395648:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000594a1223 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.395649:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c4f98c lrc: 2/0,0 mode: PW/PW res: [0x2b36c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.395650:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+53:39029:x1731745946330176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1088us (1170us total) trans 12885078609 rc 0/0 00010000:00010000:0.0:1651529344.395651:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c4f98c lrc: 3/0,0 mode: PW/PW res: [0x2b36c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.395653:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210556 00010000:00010000:0.0:1651529344.395654:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c4f98c lrc: 1/0,0 mode: --/PW res: [0x2b36c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395657:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c4f98c lrc: 0/0,0 mode: --/PW res: [0x2b36c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395659:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000411ac620/0x3234de053c4f97e lrc: 3/0,1 mode: PW/PW res: [0x2b36b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395662:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000411ac620/0x3234de053c4f97e lrc: 3/0,1 mode: PW/PW res: [0x2b36b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395665:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000411ac620/0x3234de053c4f97e lrc: 3/0,1 mode: PW/PW res: [0x2b36b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.395667:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000411ac620/0x3234de053c4f97e lrc: 2/0,0 mode: PW/PW res: [0x2b36b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.395669:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996942464:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.395673:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4f99a lrc: 3/0,1 mode: --/PW res: [0x2b36e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395684:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000411ac620/0x3234de053c4f97e lrc: 2/0,0 mode: PW/PW res: [0x2b36b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395687:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000411ac620 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.395688:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000411ac620/0x3234de053c4f97e lrc: 2/0,0 mode: PW/PW res: [0x2b36b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395691:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000411ac620/0x3234de053c4f97e lrc: 3/0,0 mode: PW/PW res: [0x2b36b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395695:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000411ac620/0x3234de053c4f97e lrc: 1/0,0 mode: --/PW res: [0x2b36b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395697:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000411ac620/0x3234de053c4f97e lrc: 0/0,0 mode: --/PW res: [0x2b36b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395702:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4f993 lrc: 3/0,1 mode: PW/PW res: [0x2b36d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395705:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4f993 lrc: 3/0,1 mode: PW/PW res: [0x2b36d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.395706:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+53:39030:x1731745946330112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1192us (1251us total) trans 12885078610 rc 0/0 00010000:00010000:0.0:1651529344.395708:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4f993 lrc: 3/0,1 mode: PW/PW res: [0x2b36d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.395709:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210554 00010000:00010000:0.0:1651529344.395713:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4f993 lrc: 2/0,0 mode: PW/PW res: [0x2b36d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.395724:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.395769:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+53:39030:x1731745946330240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1130us (1158us total) trans 12885078611 rc 0/0 00000100:00100000:0.0:1651529344.395772:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210557 00010000:00010000:0.0:1651529344.395779:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4f993 lrc: 2/0,0 mode: PW/PW res: [0x2b36d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395782:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b65e0a0d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.395783:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4f993 lrc: 2/0,0 mode: PW/PW res: [0x2b36d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395786:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4f993 lrc: 3/0,0 mode: PW/PW res: [0x2b36d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395790:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4f993 lrc: 1/0,0 mode: --/PW res: [0x2b36d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395793:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4f993 lrc: 0/0,0 mode: --/PW res: [0x2b36d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.395800:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396211328 00010000:00010000:0.0:1651529344.395804:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000fc3d0e3/0x3234de053c4c8ee lrc: 4/0,0 mode: PR/PR res: [0x2b36e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd53d expref: 2008 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.395813:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11340 00000100:00100000:0.0:1651529344.395815:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2008:41279:x1731746396211328:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.395817:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.395819:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000fc3d0e3/0x3234de053c4c8ee lrc: 4/0,0 mode: PR/PR res: [0x2b36e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd53d expref: 2008 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.395841:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000fc3d0e3/0x3234de053c4c8ee lrc: 3/0,0 mode: PR/PR res: [0x2b36e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd53d expref: 2008 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.395847:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000fc3d0e3/0x3234de053c4c8ee lrc: 0/0,0 mode: --/PR res: [0x2b36e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd53d expref: 2008 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.395850:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.395851:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.395852:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4f99a lrc: 3/0,1 mode: PW/PW res: [0x2b36e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395855:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4f99a lrc: 4/0,1 mode: PW/PW res: [0x2b36e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395862:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.395887:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2007:41279:x1731746396211328:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 71us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.395890:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11340 00010000:00010000:0.0:1651529344.395897:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4f99a lrc: 3/0,1 mode: PW/PW res: [0x2b36e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395901:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4f99a lrc: 3/0,1 mode: PW/PW res: [0x2b36e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395904:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4f99a lrc: 3/0,1 mode: PW/PW res: [0x2b36e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395907:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4f99a lrc: 2/0,0 mode: PW/PW res: [0x2b36e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.395951:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+53:39030:x1731745946330368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1129us (1169us total) trans 12885078612 rc 0/0 00000100:00100000:0.0:1651529344.395954:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210558 00010000:00010000:0.0:1651529344.395961:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4f99a lrc: 2/0,0 mode: PW/PW res: [0x2b36e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395964:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e35b0bde already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.395965:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4f99a lrc: 2/0,0 mode: PW/PW res: [0x2b36e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395968:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4f99a lrc: 3/0,0 mode: PW/PW res: [0x2b36e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395972:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4f99a lrc: 1/0,0 mode: --/PW res: [0x2b36e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395975:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4f99a lrc: 0/0,0 mode: --/PW res: [0x2b36e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395981:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4f985 lrc: 3/0,1 mode: PW/PW res: [0x2b36a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395984:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4f985 lrc: 3/0,1 mode: PW/PW res: [0x2b36a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395987:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4f985 lrc: 3/0,1 mode: PW/PW res: [0x2b36a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.395990:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4f985 lrc: 2/0,0 mode: PW/PW res: [0x2b36a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.396067:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+53:39029:x1731745946330048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1524us (1594us total) trans 12885078613 rc 0/0 00000100:00100000:0.0:1651529344.396070:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210555 00010000:00010000:0.0:1651529344.396088:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4f985 lrc: 2/0,0 mode: PW/PW res: [0x2b36a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.396092:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003c5315da already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.396093:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4f985 lrc: 2/0,0 mode: PW/PW res: [0x2b36a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.396096:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4f985 lrc: 3/0,0 mode: PW/PW res: [0x2b36a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.396100:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.396100:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4f985 lrc: 1/0,0 mode: --/PW res: [0x2b36a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.396103:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4f985 lrc: 0/0,0 mode: --/PW res: [0x2b36a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.396110:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.396118:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.396126:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.396130:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946330752 00000100:00100000:1.0:1651529344.396134:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.396150:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946330880 00000100:00100000:0.0:1651529344.396156:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946330816 00000100:00100000:0.0:1651529344.396162:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946331072 00000100:00100000:0.0:1651529344.396167:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946331136 00000100:00100000:0.0:1651529344.396171:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210559 00000100:00100000:0.0:1651529344.396173:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+57:39029:x1731745946330752:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.396178:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177007 count 1 00000100:00100000:1.0:1651529344.396179:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.396183:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090c3576a/0x3234de053c4f9a1 lrc: 3/0,1 mode: --/PW res: [0x2b36f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.396188:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000206299e1/0x3234de053c4f112 lrc: 2/0,0 mode: PR/PR res: [0x2b36f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d76c2 expref: 2006 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.396189:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.396191:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.396192:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.396198:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090c3576a/0x3234de053c4f9a1 lrc: 4/0,1 mode: --/PW res: [0x2b36f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.396200:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946331200 00000100:00100000:1.0:1651529344.396205:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946331264 00000100:00100000:1.0:1651529344.396208:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210560 00000100:00100000:1.0:1651529344.396210:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+59:39030:x1731745946330880:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.396215:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177009 count 1 00010000:00010000:0.0:1651529344.396221:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000206299e1/0x3234de053c4f112 lrc: 3/0,0 mode: PR/PR res: [0x2b36f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d76c2 expref: 2006 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.396243:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c4f9a8 lrc: 3/0,1 mode: --/PW res: [0x2b371:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.396247:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000206299e1/0x3234de053c4f112 lrc: 4/0,0 mode: PR/PR res: [0x2b36f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d76c2 expref: 2006 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.396249:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007ce7109a/0x3234de053c4dd70 lrc: 2/0,0 mode: PR/PR res: [0x2b371:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d26f8 expref: 2006 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.396252:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.396252:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.396253:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c4f9a8 lrc: 4/0,1 mode: --/PW res: [0x2b371:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.396255:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996942528:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.396263:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007ce7109a/0x3234de053c4dd70 lrc: 3/0,0 mode: PR/PR res: [0x2b371:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d26f8 expref: 2006 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.396265:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 000000007b78c9d8 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.396267:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007ce7109a/0x3234de053c4dd70 lrc: 4/0,0 mode: PR/PR res: [0x2b371:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d26f8 expref: 2006 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.396272:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005fb0ec6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996942592:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.396272:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210561 00000100:00100000:0.0:1651529344.396273:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+59:39029:x1731745946330816:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.396278:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177008 count 1 00000100:00100000:1.0:1651529344.396281:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 0000000018ebe812 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.396282:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c4f9af lrc: 3/0,1 mode: --/PW res: [0x2b370:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.396287:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c4d40f lrc: 2/0,0 mode: PR/PR res: [0x2b370:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d020e expref: 2006 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.396288:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210562 00000100:00100000:1.0:1651529344.396289:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+59:39029:x1731745946331072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.396290:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.396290:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.396291:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c4f9af lrc: 4/0,1 mode: --/PW res: [0x2b370:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.396294:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177010 count 1 00010000:00010000:0.0:1651529344.396297:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c4d40f lrc: 3/0,0 mode: PR/PR res: [0x2b370:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d020e expref: 2006 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.396298:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c4f9b6 lrc: 3/0,1 mode: --/PW res: [0x2b372:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.396301:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c4d40f lrc: 4/0,0 mode: PR/PR res: [0x2b370:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d020e expref: 2006 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.396302:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a82b4949/0x3234de053c4ddc4 lrc: 2/0,0 mode: PR/PR res: [0x2b372:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2864 expref: 2006 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.396305:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.396305:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996942656:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.396306:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.396306:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c4f9b6 lrc: 4/0,1 mode: --/PW res: [0x2b372:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.396311:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aac39cef going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.396312:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a82b4949/0x3234de053c4ddc4 lrc: 3/0,0 mode: PR/PR res: [0x2b372:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2864 expref: 2006 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.396316:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a82b4949/0x3234de053c4ddc4 lrc: 4/0,0 mode: PR/PR res: [0x2b372:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2864 expref: 2006 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.396317:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210563 00000100:00100000:0.0:1651529344.396319:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+59:39030:x1731745946331136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.396320:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000064719963 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996942720:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.396323:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177011 count 1 00000100:00100000:1.0:1651529344.396326:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d09f5ee1 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.396326:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c4f9bd lrc: 3/0,1 mode: --/PW res: [0x2b373:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.396331:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000040de33f8/0x3234de053c4e312 lrc: 2/0,0 mode: PR/PR res: [0x2b373:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d5d expref: 2006 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.396332:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210564 00000100:00100000:1.0:1651529344.396333:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+59:39029:x1731745946331200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.396333:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.396334:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.396334:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c4f9bd lrc: 4/0,1 mode: --/PW res: [0x2b373:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.396338:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177012 count 1 00010000:00010000:0.0:1651529344.396340:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000040de33f8/0x3234de053c4e312 lrc: 3/0,0 mode: PR/PR res: [0x2b373:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d5d expref: 2006 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.396341:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034d24763/0x3234de053c4f9c4 lrc: 3/0,1 mode: --/PW res: [0x2b374:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.396344:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000040de33f8/0x3234de053c4e312 lrc: 4/0,0 mode: PR/PR res: [0x2b373:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d5d expref: 2006 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.396345:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c4d3fa lrc: 2/0,0 mode: PR/PR res: [0x2b374:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d01c8 expref: 2006 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.396347:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996942784:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.396348:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.396348:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.396349:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034d24763/0x3234de053c4f9c4 lrc: 4/0,1 mode: --/PW res: [0x2b374:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.396353:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 0000000094c2f645 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.396354:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c4d3fa lrc: 3/0,0 mode: PR/PR res: [0x2b374:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d01c8 expref: 2006 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.396358:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c4d3fa lrc: 4/0,0 mode: PR/PR res: [0x2b374:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d01c8 expref: 2006 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.396359:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210565 00000100:00100000:0.0:1651529344.396360:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+59:39029:x1731745946331264:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.396362:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000076d5f96b pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996942848:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.396364:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177013 count 1 00000100:00100000:1.0:1651529344.396368:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e5f43e7 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.396368:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c4f9cb lrc: 3/0,1 mode: --/PW res: [0x2b375:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.396375:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000039586f31/0x3234de053c4f572 lrc: 2/0,0 mode: PR/PR res: [0x2b375:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8850 expref: 2006 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.396377:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.396378:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.396378:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c4f9cb lrc: 4/0,1 mode: --/PW res: [0x2b375:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.396383:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.396384:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000039586f31/0x3234de053c4f572 lrc: 3/0,0 mode: PR/PR res: [0x2b375:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8850 expref: 2006 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.396387:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000039586f31/0x3234de053c4f572 lrc: 4/0,0 mode: PR/PR res: [0x2b375:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8850 expref: 2006 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.396391:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996942912:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.396398:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ff7757ae going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.396403:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946331328 00000100:00100000:0.0:1651529344.396413:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210566 00000100:00100000:0.0:1651529344.396415:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+60:39030:x1731745946331328:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.396419:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177014 count 1 00010000:00010000:0.0:1651529344.396423:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064149de3/0x3234de053c4f9d2 lrc: 3/0,1 mode: --/PW res: [0x2b376:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.396427:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d8e15fbe/0x3234de053c4e0f7 lrc: 2/0,0 mode: PR/PR res: [0x2b376:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d347a expref: 2006 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.396432:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.396433:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.396434:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064149de3/0x3234de053c4f9d2 lrc: 4/0,1 mode: --/PW res: [0x2b376:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.396439:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d8e15fbe/0x3234de053c4e0f7 lrc: 3/0,0 mode: PR/PR res: [0x2b376:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d347a expref: 2006 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.396443:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d8e15fbe/0x3234de053c4e0f7 lrc: 4/0,0 mode: PR/PR res: [0x2b376:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d347a expref: 2006 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.396462:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996942976:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.396477:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f9dd6aa3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.396710:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996942528:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.396715:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000090c3576a/0x3234de053c4f9a1 lrc: 3/0,1 mode: --/PW res: [0x2b36f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.396731:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005fb0ec6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996942592:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.396746:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c4f9a8 lrc: 3/0,1 mode: --/PW res: [0x2b371:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.396829:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996942656:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.396838:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c4f9af lrc: 3/0,1 mode: --/PW res: [0x2b370:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.396839:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000064719963 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996942720:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.396843:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c4f9b6 lrc: 3/0,1 mode: --/PW res: [0x2b372:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.396846:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996942784:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.396849:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c4f9bd lrc: 3/0,1 mode: --/PW res: [0x2b373:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.397055:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.397075:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996942912:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.397083:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.397092:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c4f9cb lrc: 3/0,1 mode: --/PW res: [0x2b375:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.397093:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.397102:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.397109:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396212032 00000100:00100000:1.0:1651529344.397110:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.397114:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007ce7109a/0x3234de053c4dd70 lrc: 4/0,0 mode: PR/PR res: [0x2b371:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d26f8 expref: 2007 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.397115:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.397120:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.397120:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396211968 00010000:00010000:0.0:1651529344.397122:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000206299e1/0x3234de053c4f112 lrc: 4/0,0 mode: PR/PR res: [0x2b36f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d76c2 expref: 2008 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.397126:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396212096 00010000:00010000:0.0:1651529344.397128:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c4d40f lrc: 4/0,0 mode: PR/PR res: [0x2b370:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d020e expref: 2009 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.397132:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396212160 00000100:00100000:1.0:1651529344.397134:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.397134:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000040de33f8/0x3234de053c4e312 lrc: 4/0,0 mode: PR/PR res: [0x2b373:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d5d expref: 2010 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.397138:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396212224 00010000:00010000:0.0:1651529344.397141:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a82b4949/0x3234de053c4ddc4 lrc: 4/0,0 mode: PR/PR res: [0x2b372:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2864 expref: 2011 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.397145:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396212352 00010000:00010000:0.0:1651529344.397146:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c4d3fa lrc: 5/0,0 mode: PR/PR res: [0x2b374:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d01c8 expref: 2012 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.397148:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000076d5f96b pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996942848:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.397151:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396212480 00010000:00010000:1.0:1651529344.397152:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000034d24763/0x3234de053c4f9c4 lrc: 3/0,1 mode: --/PW res: [0x2b374:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397153:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d8e15fbe/0x3234de053c4e0f7 lrc: 5/0,0 mode: PR/PR res: [0x2b376:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d347a expref: 2013 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.397156:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396212416 00010000:00010000:0.0:1651529344.397158:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000039586f31/0x3234de053c4f572 lrc: 4/0,0 mode: PR/PR res: [0x2b375:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8850 expref: 2014 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.397159:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11341 00000100:00100000:1.0:1651529344.397161:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2014:41279:x1731746396212032:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.397163:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11342 00000100:00100000:0.0:1651529344.397164:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2014:41279:x1731746396211968:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.397165:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.397167:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007ce7109a/0x3234de053c4dd70 lrc: 4/0,0 mode: PR/PR res: [0x2b371:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d26f8 expref: 2014 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.397168:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.397169:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000206299e1/0x3234de053c4f112 lrc: 4/0,0 mode: PR/PR res: [0x2b36f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d76c2 expref: 2014 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.397172:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000206299e1/0x3234de053c4f112 lrc: 3/0,0 mode: PR/PR res: [0x2b36f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d76c2 expref: 2014 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.397173:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007ce7109a/0x3234de053c4dd70 lrc: 3/0,0 mode: PR/PR res: [0x2b371:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d26f8 expref: 2014 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.397178:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000206299e1/0x3234de053c4f112 lrc: 0/0,0 mode: --/PR res: [0x2b36f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d76c2 expref: 2014 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.397179:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ce7109a/0x3234de053c4dd70 lrc: 0/0,0 mode: --/PR res: [0x2b371:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d26f8 expref: 2014 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.397182:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.397183:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.397183:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.397183:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000090c3576a/0x3234de053c4f9a1 lrc: 3/0,1 mode: PW/PW res: [0x2b36f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.397184:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.397184:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c4f9a8 lrc: 3/0,1 mode: PW/PW res: [0x2b371:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397187:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090c3576a/0x3234de053c4f9a1 lrc: 4/0,1 mode: PW/PW res: [0x2b36f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.397188:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c4f9a8 lrc: 4/0,1 mode: PW/PW res: [0x2b371:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.397194:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.397194:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.397202:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2012:41279:x1731746396212032:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.397203:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2012:41279:x1731746396211968:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 38us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.397205:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11341 00000100:00100000:0.0:1651529344.397207:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11342 00000100:00100000:1.0:1651529344.397211:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11343 00000100:00100000:1.0:1651529344.397213:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ccd58b65 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2010:41278:x1731746396212096:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.397213:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11344 00010000:00010000:1.0:1651529344.397215:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.397215:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2010:41279:x1731746396212160:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.397217:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c4d40f lrc: 4/0,0 mode: PR/PR res: [0x2b370:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d020e expref: 2010 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.397218:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.397219:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000040de33f8/0x3234de053c4e312 lrc: 4/0,0 mode: PR/PR res: [0x2b373:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d5d expref: 2010 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.397221:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c4d40f lrc: 3/0,0 mode: PR/PR res: [0x2b370:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d020e expref: 2010 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.397242:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000040de33f8/0x3234de053c4e312 lrc: 3/0,0 mode: PR/PR res: [0x2b373:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d5d expref: 2010 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.397243:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c4d40f lrc: 0/0,0 mode: --/PR res: [0x2b370:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d020e expref: 2010 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.397247:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.397247:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.397248:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c4f9af lrc: 3/0,1 mode: PW/PW res: [0x2b370:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397248:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040de33f8/0x3234de053c4e312 lrc: 0/0,0 mode: --/PR res: [0x2b373:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d5d expref: 2009 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.397251:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c4f9af lrc: 4/0,1 mode: PW/PW res: [0x2b370:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397251:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.397252:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.397253:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c4f9bd lrc: 3/0,1 mode: PW/PW res: [0x2b373:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397256:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c4f9bd lrc: 4/0,1 mode: PW/PW res: [0x2b373:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.397258:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.397265:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ccd58b65 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2008:41278:x1731746396212096:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 51us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.397267:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11343 00010000:00010000:0.0:1651529344.397267:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.397273:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2007:41279:x1731746396212160:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 58us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.397276:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11345 00000100:00100000:1.0:1651529344.397278:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2007:41278:x1731746396212224:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.397278:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11344 00010000:00010000:1.0:1651529344.397280:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.397282:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a82b4949/0x3234de053c4ddc4 lrc: 4/0,0 mode: PR/PR res: [0x2b372:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2864 expref: 2006 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.397283:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11346 00000100:00100000:0.0:1651529344.397284:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2006:41278:x1731746396212352:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.397286:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a82b4949/0x3234de053c4ddc4 lrc: 3/0,0 mode: PR/PR res: [0x2b372:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2864 expref: 2006 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.397287:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.397289:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c4d3fa lrc: 4/0,0 mode: PR/PR res: [0x2b374:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d01c8 expref: 2006 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.397291:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a82b4949/0x3234de053c4ddc4 lrc: 0/0,0 mode: --/PR res: [0x2b372:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2864 expref: 2006 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.397292:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c4d3fa lrc: 3/0,0 mode: PR/PR res: [0x2b374:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d01c8 expref: 2006 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.397297:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.397297:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.397297:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c4d3fa lrc: 0/0,0 mode: --/PR res: [0x2b374:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d01c8 expref: 2005 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.397298:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c4f9b6 lrc: 3/0,1 mode: PW/PW res: [0x2b372:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.397301:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c4f9b6 lrc: 4/0,1 mode: PW/PW res: [0x2b372:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397301:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.397301:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.397302:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000034d24763/0x3234de053c4f9c4 lrc: 3/0,1 mode: PW/PW res: [0x2b374:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397305:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034d24763/0x3234de053c4f9c4 lrc: 4/0,1 mode: PW/PW res: [0x2b374:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.397307:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.397311:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2004:41278:x1731746396212224:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (201us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.397314:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.397320:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11345 00000100:00100000:0.0:1651529344.397321:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2004:41278:x1731746396212352:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.397323:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11346 00000100:00100000:1.0:1651529344.397325:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11347 00000100:00100000:1.0:1651529344.397327:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2002:41278:x1731746396212480:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.397328:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11348 00010000:00010000:1.0:1651529344.397329:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.397329:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2002:41279:x1731746396212416:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.397331:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d8e15fbe/0x3234de053c4e0f7 lrc: 5/0,0 mode: PR/PR res: [0x2b376:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d347a expref: 2002 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.397332:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.397333:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000039586f31/0x3234de053c4f572 lrc: 4/0,0 mode: PR/PR res: [0x2b375:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8850 expref: 2002 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.397335:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d8e15fbe/0x3234de053c4e0f7 lrc: 4/0,0 mode: PR/PR res: [0x2b376:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d347a expref: 2002 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.397337:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000039586f31/0x3234de053c4f572 lrc: 3/0,0 mode: PR/PR res: [0x2b375:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8850 expref: 2002 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.397339:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.397340:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.397341:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000064149de3/0x3234de053c4f9d2 lrc: 3/0,1 mode: PW/PW res: [0x2b376:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397342:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039586f31/0x3234de053c4f572 lrc: 0/0,0 mode: --/PR res: [0x2b375:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8850 expref: 2002 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.397346:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064149de3/0x3234de053c4f9d2 lrc: 4/0,1 mode: PW/PW res: [0x2b376:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397346:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.397346:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.397347:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c4f9cb lrc: 3/0,1 mode: PW/PW res: [0x2b375:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.397350:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.397350:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c4f9cb lrc: 4/0,1 mode: PW/PW res: [0x2b375:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.397355:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2001:41278:x1731746396212480:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 28us (235us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.397356:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.397358:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11347 00000100:00100000:0.0:1651529344.397360:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2000:41279:x1731746396212416:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 30us (226us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.397363:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c4f9b6 lrc: 3/0,1 mode: PW/PW res: [0x2b372:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.397363:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11348 00010000:00010000:1.0:1651529344.397367:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c4f9b6 lrc: 3/0,1 mode: PW/PW res: [0x2b372:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.397370:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c4f9b6 lrc: 3/0,1 mode: PW/PW res: [0x2b372:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397371:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c4f9af lrc: 3/0,1 mode: PW/PW res: [0x2b370:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.397372:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c4f9b6 lrc: 2/0,0 mode: PW/PW res: [0x2b372:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397374:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c4f9af lrc: 3/0,1 mode: PW/PW res: [0x2b370:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397385:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c4f9af lrc: 3/0,1 mode: PW/PW res: [0x2b370:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397389:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c4f9af lrc: 2/0,0 mode: PW/PW res: [0x2b370:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.397419:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+62:39029:x1731745946331072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1129us (1292us total) trans 12885078614 rc 0/0 00000100:00100000:1.0:1651529344.397422:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210562 00010000:00010000:1.0:1651529344.397428:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000034d24763/0x3234de053c4f9c4 lrc: 3/0,1 mode: PW/PW res: [0x2b374:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.397429:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+61:39029:x1731745946330816:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1155us (1310us total) trans 12885078615 rc 0/0 00010000:00010000:1.0:1651529344.397431:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034d24763/0x3234de053c4f9c4 lrc: 3/0,1 mode: PW/PW res: [0x2b374:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.397432:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210561 00010000:00010000:1.0:1651529344.397435:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034d24763/0x3234de053c4f9c4 lrc: 3/0,1 mode: PW/PW res: [0x2b374:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.397438:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034d24763/0x3234de053c4f9c4 lrc: 2/0,0 mode: PW/PW res: [0x2b374:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397440:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c4f9b6 lrc: 2/0,0 mode: PW/PW res: [0x2b372:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397443:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000712b8830 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.397451:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c4f9b6 lrc: 2/0,0 mode: PW/PW res: [0x2b372:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397455:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c4f9b6 lrc: 3/0,0 mode: PW/PW res: [0x2b372:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397460:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c4f9b6 lrc: 1/0,0 mode: --/PW res: [0x2b372:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397462:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c4f9b6 lrc: 0/0,0 mode: --/PW res: [0x2b372:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397467:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c4f9af lrc: 2/0,0 mode: PW/PW res: [0x2b370:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397470:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ea00c64e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.397471:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c4f9af lrc: 2/0,0 mode: PW/PW res: [0x2b370:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397474:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c4f9af lrc: 3/0,0 mode: PW/PW res: [0x2b370:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397477:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c4f9af lrc: 1/0,0 mode: --/PW res: [0x2b370:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.397478:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+61:39029:x1731745946331200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1143us (1311us total) trans 12885078616 rc 0/0 00010000:00010000:0.0:1651529344.397479:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c4f9af lrc: 0/0,0 mode: --/PW res: [0x2b370:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.397480:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210564 00010000:00010000:0.0:1651529344.397484:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034d24763/0x3234de053c4f9c4 lrc: 2/0,0 mode: PW/PW res: [0x2b374:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.397487:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c4f9a8 lrc: 3/0,1 mode: PW/PW res: [0x2b371:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397487:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000034d24763 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.397488:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034d24763/0x3234de053c4f9c4 lrc: 2/0,0 mode: PW/PW res: [0x2b374:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.397490:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c4f9a8 lrc: 3/0,1 mode: PW/PW res: [0x2b371:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397490:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034d24763/0x3234de053c4f9c4 lrc: 3/0,0 mode: PW/PW res: [0x2b374:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.397493:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c4f9a8 lrc: 3/0,1 mode: PW/PW res: [0x2b371:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397493:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034d24763/0x3234de053c4f9c4 lrc: 1/0,0 mode: --/PW res: [0x2b374:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.397496:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c4f9a8 lrc: 2/0,0 mode: PW/PW res: [0x2b371:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397496:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034d24763/0x3234de053c4f9c4 lrc: 0/0,0 mode: --/PW res: [0x2b374:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397500:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c4f9a8 lrc: 2/0,0 mode: PW/PW res: [0x2b371:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397503:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003a73c8ff already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.397503:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c4f9a8 lrc: 2/0,0 mode: PW/PW res: [0x2b371:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397506:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c4f9a8 lrc: 3/0,0 mode: PW/PW res: [0x2b371:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397509:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c4f9a8 lrc: 1/0,0 mode: --/PW res: [0x2b371:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397512:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c4f9a8 lrc: 0/0,0 mode: --/PW res: [0x2b371:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397519:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c4f9bd lrc: 3/0,1 mode: PW/PW res: [0x2b373:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397522:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c4f9bd lrc: 3/0,1 mode: PW/PW res: [0x2b373:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.397525:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+61:39030:x1731745946330880:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1315us (1415us total) trans 12885078617 rc 0/0 00010000:00010000:0.0:1651529344.397525:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c4f9bd lrc: 3/0,1 mode: PW/PW res: [0x2b373:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397527:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c4f9bd lrc: 2/0,0 mode: PW/PW res: [0x2b373:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.397528:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210560 00000100:00100000:0.0:1651529344.397566:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+61:39030:x1731745946331136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1246us (1431us total) trans 12885078618 rc 0/0 00000100:00100000:0.0:1651529344.397569:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210563 00010000:00010000:0.0:1651529344.397576:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c4f9bd lrc: 2/0,0 mode: PW/PW res: [0x2b373:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397579:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003b0cd546 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.397580:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c4f9bd lrc: 2/0,0 mode: PW/PW res: [0x2b373:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397583:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c4f9bd lrc: 3/0,0 mode: PW/PW res: [0x2b373:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397587:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c4f9bd lrc: 1/0,0 mode: --/PW res: [0x2b373:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397590:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c4f9bd lrc: 0/0,0 mode: --/PW res: [0x2b373:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397597:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c4f9cb lrc: 3/0,1 mode: PW/PW res: [0x2b375:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397600:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c4f9cb lrc: 3/0,1 mode: PW/PW res: [0x2b375:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397603:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c4f9cb lrc: 3/0,1 mode: PW/PW res: [0x2b375:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397606:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c4f9cb lrc: 2/0,0 mode: PW/PW res: [0x2b375:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.397677:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+61:39029:x1731745946331264:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1315us (1487us total) trans 12885078619 rc 0/0 00000100:00100000:0.0:1651529344.397680:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210565 00010000:00010000:0.0:1651529344.397687:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c4f9cb lrc: 2/0,0 mode: PW/PW res: [0x2b375:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397690:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000f905106 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.397691:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c4f9cb lrc: 2/0,0 mode: PW/PW res: [0x2b375:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397694:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c4f9cb lrc: 3/0,0 mode: PW/PW res: [0x2b375:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397698:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c4f9cb lrc: 1/0,0 mode: --/PW res: [0x2b375:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397701:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c4f9cb lrc: 0/0,0 mode: --/PW res: [0x2b375:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397707:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000090c3576a/0x3234de053c4f9a1 lrc: 3/0,1 mode: PW/PW res: [0x2b36f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397710:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090c3576a/0x3234de053c4f9a1 lrc: 3/0,1 mode: PW/PW res: [0x2b36f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397713:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090c3576a/0x3234de053c4f9a1 lrc: 3/0,1 mode: PW/PW res: [0x2b36f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397716:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090c3576a/0x3234de053c4f9a1 lrc: 2/0,0 mode: PW/PW res: [0x2b36f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.397767:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+61:39029:x1731745946330752:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1592us (1667us total) trans 12885078620 rc 0/0 00000100:00100000:0.0:1651529344.397770:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210559 00010000:00010000:0.0:1651529344.397776:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090c3576a/0x3234de053c4f9a1 lrc: 2/0,0 mode: PW/PW res: [0x2b36f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397779:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000090c3576a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.397781:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090c3576a/0x3234de053c4f9a1 lrc: 2/0,0 mode: PW/PW res: [0x2b36f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397784:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090c3576a/0x3234de053c4f9a1 lrc: 3/0,0 mode: PW/PW res: [0x2b36f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397788:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090c3576a/0x3234de053c4f9a1 lrc: 1/0,0 mode: --/PW res: [0x2b36f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397791:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090c3576a/0x3234de053c4f9a1 lrc: 0/0,0 mode: --/PW res: [0x2b36f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397801:0:156655:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8e15fbe/0x3234de053c4e0f7 lrc: 0/0,0 mode: --/PR res: [0x2b376:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d347a expref: 1999 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.397804:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996942976:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.397808:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000064149de3/0x3234de053c4f9d2 lrc: 3/0,1 mode: PW/PW res: [0x2b376:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397811:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000064149de3/0x3234de053c4f9d2 lrc: 3/0,1 mode: PW/PW res: [0x2b376:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397830:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064149de3/0x3234de053c4f9d2 lrc: 3/0,1 mode: PW/PW res: [0x2b376:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397833:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064149de3/0x3234de053c4f9d2 lrc: 3/0,1 mode: PW/PW res: [0x2b376:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.397836:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000064149de3/0x3234de053c4f9d2 lrc: 2/0,0 mode: PW/PW res: [0x2b376:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.397879:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.397890:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.397925:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+61:39030:x1731745946331328:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1509us (1541us total) trans 12885078621 rc 0/0 00000100:00100000:0.0:1651529344.397928:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210566 00000100:00100000:0.0:1651529344.397933:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946331712 00000100:00100000:1.0:1651529344.397935:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.397949:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946331648 00000100:00100000:0.0:1651529344.397955:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946331776 00000100:00100000:0.0:1651529344.397960:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210567 00000100:00100000:0.0:1651529344.397961:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+63:39029:x1731745946331712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.397967:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177016 count 1 00010000:00010000:0.0:1651529344.397972:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcfc3592/0x3234de053c4f9d9 lrc: 3/0,1 mode: --/PW res: [0x2b378:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.397973:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.397977:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000013d9f24c/0x3234de053c4cc6e lrc: 2/0,0 mode: PR/PR res: [0x2b378:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce391 expref: 1998 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.397980:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.397980:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.397981:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.397981:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcfc3592/0x3234de053c4f9d9 lrc: 4/0,1 mode: --/PW res: [0x2b378:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.397987:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946332160 00010000:00010000:0.0:1651529344.397988:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000013d9f24c/0x3234de053c4cc6e lrc: 3/0,0 mode: PR/PR res: [0x2b378:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce391 expref: 1998 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.397992:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000013d9f24c/0x3234de053c4cc6e lrc: 4/0,0 mode: PR/PR res: [0x2b378:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce391 expref: 1998 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.397994:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946332096 00000100:00100000:0.0:1651529344.397996:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996943040:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.397998:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210568 00000100:00100000:1.0:1651529344.398000:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+65:39029:x1731745946331648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.398005:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177015 count 1 00010000:00010000:1.0:1651529344.398010:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008407968/0x3234de053c4f9e0 lrc: 3/0,1 mode: --/PW res: [0x2b377:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.398023:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005f6c33eb/0x3234de053c4bda3 lrc: 2/0,0 mode: PR/PR res: [0x2b377:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc656 expref: 1998 pid: 80276 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.398025:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c34c0cde going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.398026:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.398027:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.398027:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008407968/0x3234de053c4f9e0 lrc: 4/0,1 mode: --/PW res: [0x2b377:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.398033:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210569 00010000:00010000:1.0:1651529344.398034:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005f6c33eb/0x3234de053c4bda3 lrc: 3/0,0 mode: PR/PR res: [0x2b377:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc656 expref: 1998 pid: 80276 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.398035:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+65:39030:x1731745946331776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.398038:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005f6c33eb/0x3234de053c4bda3 lrc: 4/0,0 mode: PR/PR res: [0x2b377:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc656 expref: 1998 pid: 80276 timeout: 20103 lvb_type: 1 00002000:00080000:0.0:1651529344.398040:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177017 count 1 00000100:00100000:1.0:1651529344.398042:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085af61db pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996943104:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.398044:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000822170bb/0x3234de053c4f9e7 lrc: 3/0,1 mode: --/PW res: [0x2b379:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.398049:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c4db32 lrc: 2/0,0 mode: PR/PR res: [0x2b379:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ce8 expref: 1998 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.398051:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d09f5ee1 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.398054:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.398055:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.398055:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000822170bb/0x3234de053c4f9e7 lrc: 4/0,1 mode: --/PW res: [0x2b379:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.398058:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210570 00000100:00100000:1.0:1651529344.398060:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+65:39030:x1731745946332160:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.398062:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c4db32 lrc: 3/0,0 mode: PR/PR res: [0x2b379:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ce8 expref: 1998 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.398064:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177019 count 1 00010000:00010000:0.0:1651529344.398065:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c4db32 lrc: 4/0,0 mode: PR/PR res: [0x2b379:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ce8 expref: 1998 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.398068:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c4f9ee lrc: 3/0,1 mode: --/PW res: [0x2b37b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.398069:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996943168:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.398072:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000047d5dd29/0x3234de053c4d0b2 lrc: 2/0,0 mode: PR/PR res: [0x2b37b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf477 expref: 1998 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.398075:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.398076:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.398076:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c4f9ee lrc: 4/0,1 mode: --/PW res: [0x2b37b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.398076:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000efb6ae52 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.398082:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000047d5dd29/0x3234de053c4d0b2 lrc: 3/0,0 mode: PR/PR res: [0x2b37b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf477 expref: 1998 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.398086:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000047d5dd29/0x3234de053c4d0b2 lrc: 4/0,0 mode: PR/PR res: [0x2b37b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf477 expref: 1998 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.398090:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b4acf60d pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996943232:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.398095:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000064149de3/0x3234de053c4f9d2 lrc: 2/0,0 mode: PW/PW res: [0x2b376:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.398096:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000018ebe812 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.398099:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000064149de3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.398100:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000064149de3/0x3234de053c4f9d2 lrc: 2/0,0 mode: PW/PW res: [0x2b376:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.398101:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210571 00000100:00100000:1.0:1651529344.398103:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+65:39029:x1731745946332096:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.398103:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000064149de3/0x3234de053c4f9d2 lrc: 3/0,0 mode: PW/PW res: [0x2b376:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.398107:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177018 count 1 00010000:00010000:0.0:1651529344.398107:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000064149de3/0x3234de053c4f9d2 lrc: 1/0,0 mode: --/PW res: [0x2b376:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.398110:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c4f9f5 lrc: 3/0,1 mode: --/PW res: [0x2b37a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.398113:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064149de3/0x3234de053c4f9d2 lrc: 0/0,0 mode: --/PW res: [0x2b376:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.398117:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003dcc98c1/0x3234de053c4e366 lrc: 2/0,0 mode: PR/PR res: [0x2b37a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e91 expref: 1998 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.398120:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.398120:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.398121:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c4f9f5 lrc: 4/0,1 mode: --/PW res: [0x2b37a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.398126:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003dcc98c1/0x3234de053c4e366 lrc: 3/0,0 mode: PR/PR res: [0x2b37a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e91 expref: 1998 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.398130:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003dcc98c1/0x3234de053c4e366 lrc: 4/0,0 mode: PR/PR res: [0x2b37a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e91 expref: 1998 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.398133:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e124baf1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996943296:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.398139:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 0000000053a0cffa going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.398173:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.398187:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.398197:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.398208:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946332224 00000100:00100000:0.0:1651529344.398214:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946332288 00000100:00100000:0.0:1651529344.398218:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946332416 00000100:00100000:0.0:1651529344.398245:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210572 00000100:00100000:0.0:1651529344.398246:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+68:39029:x1731745946332224:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.398251:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177020 count 1 00010000:00010000:0.0:1651529344.398255:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4f9fc lrc: 3/0,1 mode: --/PW res: [0x2b37c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.398260:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000004e74ca/0x3234de053c4c8bd lrc: 2/0,0 mode: PR/PR res: [0x2b37c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd487 expref: 1998 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.398263:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.398263:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.398264:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4f9fc lrc: 4/0,1 mode: --/PW res: [0x2b37c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.398266:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210573 00000100:00100000:1.0:1651529344.398269:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+68:39030:x1731745946332288:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.398271:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000004e74ca/0x3234de053c4c8bd lrc: 3/0,0 mode: PR/PR res: [0x2b37c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd487 expref: 1998 pid: 72396 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.398274:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177021 count 1 00010000:00010000:0.0:1651529344.398274:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000004e74ca/0x3234de053c4c8bd lrc: 4/0,0 mode: PR/PR res: [0x2b37c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd487 expref: 1998 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.398278:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996943360:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.398279:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070346c06/0x3234de053c4fa03 lrc: 3/0,1 mode: --/PW res: [0x2b37d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.398284:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000087cc6968/0x3234de053c4ea6d lrc: 2/0,0 mode: PR/PR res: [0x2b37d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b47 expref: 1998 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.398287:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.398287:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.398288:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070346c06/0x3234de053c4fa03 lrc: 4/0,1 mode: --/PW res: [0x2b37d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.398301:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000087cc6968/0x3234de053c4ea6d lrc: 3/0,0 mode: PR/PR res: [0x2b37d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b47 expref: 1998 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.398305:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000087cc6968/0x3234de053c4ea6d lrc: 4/0,0 mode: PR/PR res: [0x2b37d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b47 expref: 1998 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.398306:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 0000000094c2f645 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.398309:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000034e35367 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996943424:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.398314:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210574 00000100:00100000:0.0:1651529344.398315:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+68:39030:x1731745946332416:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.398318:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 0000000071742acc going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.398320:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177022 count 1 00010000:00010000:0.0:1651529344.398324:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4fa0a lrc: 3/0,1 mode: --/PW res: [0x2b37e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.398329:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000006d9a191/0x3234de053c4ce27 lrc: 2/0,0 mode: PR/PR res: [0x2b37e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce9fe expref: 1998 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.398332:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.398332:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.398333:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4fa0a lrc: 4/0,1 mode: --/PW res: [0x2b37e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.398339:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000006d9a191/0x3234de053c4ce27 lrc: 3/0,0 mode: PR/PR res: [0x2b37e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce9fe expref: 1998 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.398342:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000006d9a191/0x3234de053c4ce27 lrc: 4/0,0 mode: PR/PR res: [0x2b37e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce9fe expref: 1998 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.398346:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996943488:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.398360:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b032d2f9 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.398541:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.398541:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996943040:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.398550:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fcfc3592/0x3234de053c4f9d9 lrc: 3/0,1 mode: --/PW res: [0x2b378:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.398560:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396212992 00010000:00010000:0.0:1651529344.398565:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000013d9f24c/0x3234de053c4cc6e lrc: 4/0,0 mode: PR/PR res: [0x2b378:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce391 expref: 1999 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.398591:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11349 00000100:00100000:0.0:1651529344.398593:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1999:41278:x1731746396212992:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.398596:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.398598:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000013d9f24c/0x3234de053c4cc6e lrc: 4/0,0 mode: PR/PR res: [0x2b378:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce391 expref: 1999 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.398602:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000013d9f24c/0x3234de053c4cc6e lrc: 3/0,0 mode: PR/PR res: [0x2b378:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce391 expref: 1999 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.398607:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013d9f24c/0x3234de053c4cc6e lrc: 0/0,0 mode: --/PR res: [0x2b378:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce391 expref: 1999 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.398611:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.398612:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.398613:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fcfc3592/0x3234de053c4f9d9 lrc: 3/0,1 mode: PW/PW res: [0x2b378:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.398616:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcfc3592/0x3234de053c4f9d9 lrc: 4/0,1 mode: PW/PW res: [0x2b378:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.398618:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085af61db pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996943104:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.398623:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000008407968/0x3234de053c4f9e0 lrc: 3/0,1 mode: --/PW res: [0x2b377:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.398638:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.398652:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1998:41278:x1731746396212992:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 59us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.398655:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11349 00000100:00100000:0.0:1651529344.398665:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996943168:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.398669:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000822170bb/0x3234de053c4f9e7 lrc: 3/0,1 mode: --/PW res: [0x2b379:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.398674:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fcfc3592/0x3234de053c4f9d9 lrc: 3/0,1 mode: PW/PW res: [0x2b378:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.398677:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcfc3592/0x3234de053c4f9d9 lrc: 3/0,1 mode: PW/PW res: [0x2b378:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.398681:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcfc3592/0x3234de053c4f9d9 lrc: 3/0,1 mode: PW/PW res: [0x2b378:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.398683:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fcfc3592/0x3234de053c4f9d9 lrc: 2/0,0 mode: PW/PW res: [0x2b378:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.398728:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+69:39029:x1731745946331712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 766us (849us total) trans 12885078622 rc 0/0 00000100:00100000:0.0:1651529344.398731:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210567 00010000:00010000:0.0:1651529344.398746:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fcfc3592/0x3234de053c4f9d9 lrc: 2/0,0 mode: PW/PW res: [0x2b378:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.398749:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fcfc3592 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.398750:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcfc3592/0x3234de053c4f9d9 lrc: 2/0,0 mode: PW/PW res: [0x2b378:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.398756:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcfc3592/0x3234de053c4f9d9 lrc: 3/0,0 mode: PW/PW res: [0x2b378:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.398760:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fcfc3592/0x3234de053c4f9d9 lrc: 1/0,0 mode: --/PW res: [0x2b378:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.398763:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcfc3592/0x3234de053c4f9d9 lrc: 0/0,0 mode: --/PW res: [0x2b378:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.398908:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.398922:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946332672 00000100:00100000:0.0:1651529344.398935:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210575 00000100:00100000:1.0:1651529344.398983:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.398984:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085af61db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+69:39030:x1731745946332672:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.399005:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:0.0:1651529344.399018:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177023 count 1 00010000:00010000:0.0:1651529344.399023:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c4fa11 lrc: 3/0,1 mode: --/PW res: [0x2b37f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399028:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007c830bc7/0x3234de053c49fb9 lrc: 2/0,0 mode: PR/PR res: [0x2b37f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb515 expref: 1997 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.399037:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.399038:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.399038:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c4fa11 lrc: 4/0,1 mode: --/PW res: [0x2b37f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.399043:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.399046:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007c830bc7/0x3234de053c49fb9 lrc: 3/0,0 mode: PR/PR res: [0x2b37f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb515 expref: 1997 pid: 72397 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.399053:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.399057:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007c830bc7/0x3234de053c49fb9 lrc: 4/0,0 mode: PR/PR res: [0x2b37f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb515 expref: 1997 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.399060:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.399061:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996943552:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.399065:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.399073:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b4acf60d pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996943232:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.399077:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000efb6ae52 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.399083:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c4f9ee lrc: 3/0,1 mode: --/PW res: [0x2b37b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.399083:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396213120 00000100:00100000:1.0:1651529344.399090:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e124baf1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996943296:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.399093:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c4f9f5 lrc: 3/0,1 mode: --/PW res: [0x2b37a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.399098:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000034e35367 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996943424:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.399101:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000070346c06/0x3234de053c4fa03 lrc: 3/0,1 mode: --/PW res: [0x2b37d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399104:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c4db32 lrc: 4/0,0 mode: PR/PR res: [0x2b379:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ce8 expref: 1998 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.399112:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396213056 00000100:00100000:1.0:1651529344.399113:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396213184 00010000:00010000:0.0:1651529344.399115:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005f6c33eb/0x3234de053c4bda3 lrc: 4/0,0 mode: PR/PR res: [0x2b377:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc656 expref: 2000 pid: 80276 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.399118:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000047d5dd29/0x3234de053c4d0b2 lrc: 4/0,0 mode: PR/PR res: [0x2b37b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf477 expref: 2000 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.399120:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396213248 00010000:00010000:0.0:1651529344.399122:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003dcc98c1/0x3234de053c4e366 lrc: 4/0,0 mode: PR/PR res: [0x2b37a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e91 expref: 2001 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.399123:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396213312 00010000:00010000:1.0:1651529344.399126:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000004e74ca/0x3234de053c4c8bd lrc: 5/0,0 mode: PR/PR res: [0x2b37c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd487 expref: 2002 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.399127:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396213376 00010000:00010000:0.0:1651529344.399129:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000087cc6968/0x3234de053c4ea6d lrc: 4/0,0 mode: PR/PR res: [0x2b37d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b47 expref: 2003 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.399131:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11350 00000100:00100000:1.0:1651529344.399133:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6d06412 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2003:41278:x1731746396213120:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.399134:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11351 00010000:00010000:1.0:1651529344.399136:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.399136:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2003:41278:x1731746396213056:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.399137:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c4db32 lrc: 4/0,0 mode: PR/PR res: [0x2b379:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ce8 expref: 2003 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.399139:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.399140:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005f6c33eb/0x3234de053c4bda3 lrc: 4/0,0 mode: PR/PR res: [0x2b377:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc656 expref: 2003 pid: 80276 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.399141:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c4db32 lrc: 3/0,0 mode: PR/PR res: [0x2b379:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ce8 expref: 2003 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.399144:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005f6c33eb/0x3234de053c4bda3 lrc: 3/0,0 mode: PR/PR res: [0x2b377:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc656 expref: 2003 pid: 80276 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.399147:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c4db32 lrc: 0/0,0 mode: --/PR res: [0x2b379:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ce8 expref: 2003 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.399150:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f6c33eb/0x3234de053c4bda3 lrc: 0/0,0 mode: --/PR res: [0x2b377:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc656 expref: 2003 pid: 80276 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.399151:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.399152:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.399153:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000822170bb/0x3234de053c4f9e7 lrc: 3/0,1 mode: PW/PW res: [0x2b379:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399153:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.399154:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.399155:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000822170bb/0x3234de053c4f9e7 lrc: 4/0,1 mode: PW/PW res: [0x2b379:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399155:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000008407968/0x3234de053c4f9e0 lrc: 3/0,1 mode: PW/PW res: [0x2b377:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399158:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008407968/0x3234de053c4f9e0 lrc: 4/0,1 mode: PW/PW res: [0x2b377:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.399165:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.399178:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6d06412 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2001:41278:x1731746396213120:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 44us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.399181:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11350 00010000:00010000:0.0:1651529344.399186:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.399190:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11352 00000100:00100000:1.0:1651529344.399192:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2000:41279:x1731746396213184:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.399194:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2000:41278:x1731746396213056:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 58us (189us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.399195:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.399196:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000047d5dd29/0x3234de053c4d0b2 lrc: 4/0,0 mode: PR/PR res: [0x2b37b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf477 expref: 2000 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.399197:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11351 00010000:00010000:1.0:1651529344.399200:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000047d5dd29/0x3234de053c4d0b2 lrc: 3/0,0 mode: PR/PR res: [0x2b37b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf477 expref: 1999 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.399202:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11353 00000100:00100000:0.0:1651529344.399204:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1999:41278:x1731746396213248:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.399205:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047d5dd29/0x3234de053c4d0b2 lrc: 0/0,0 mode: --/PR res: [0x2b37b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf477 expref: 1999 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.399206:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.399208:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003dcc98c1/0x3234de053c4e366 lrc: 4/0,0 mode: PR/PR res: [0x2b37a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e91 expref: 1999 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.399211:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.399212:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.399212:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003dcc98c1/0x3234de053c4e366 lrc: 3/0,0 mode: PR/PR res: [0x2b37a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e91 expref: 1998 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.399213:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c4f9ee lrc: 3/0,1 mode: PW/PW res: [0x2b37b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.399215:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c4f9ee lrc: 4/0,1 mode: PW/PW res: [0x2b37b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399217:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003dcc98c1/0x3234de053c4e366 lrc: 0/0,0 mode: --/PR res: [0x2b37a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e91 expref: 1998 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.399221:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.399236:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.399239:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.399240:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c4f9f5 lrc: 3/0,1 mode: PW/PW res: [0x2b37a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.399242:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1997:41279:x1731746396213184:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 49us (199us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.399243:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c4f9f5 lrc: 4/0,1 mode: PW/PW res: [0x2b37a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.399245:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11352 00010000:00010000:0.0:1651529344.399252:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.399256:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11354 00000100:00100000:1.0:1651529344.399258:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1996:41279:x1731746396213312:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.399259:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1996:41278:x1731746396213248:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 54us (206us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.399261:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.399262:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000004e74ca/0x3234de053c4c8bd lrc: 5/0,0 mode: PR/PR res: [0x2b37c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd487 expref: 1996 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.399262:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11353 00010000:00010000:1.0:1651529344.399266:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000004e74ca/0x3234de053c4c8bd lrc: 4/0,0 mode: PR/PR res: [0x2b37c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd487 expref: 1995 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.399266:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11355 00000100:00100000:0.0:1651529344.399268:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1995:41278:x1731746396213376:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.399271:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.399271:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.399272:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.399272:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000087cc6968/0x3234de053c4ea6d lrc: 4/0,0 mode: PR/PR res: [0x2b37d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b47 expref: 1995 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.399273:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4f9fc lrc: 3/0,1 mode: PW/PW res: [0x2b37c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399276:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000087cc6968/0x3234de053c4ea6d lrc: 3/0,0 mode: PR/PR res: [0x2b37d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b47 expref: 1995 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.399278:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4f9fc lrc: 4/0,1 mode: PW/PW res: [0x2b37c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399281:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087cc6968/0x3234de053c4ea6d lrc: 0/0,0 mode: --/PR res: [0x2b37d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b47 expref: 1995 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.399283:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.399287:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.399287:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.399288:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1994:41279:x1731746396213312:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 29us (228us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.399288:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000070346c06/0x3234de053c4fa03 lrc: 3/0,1 mode: PW/PW res: [0x2b37d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.399290:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11354 00010000:00010000:0.0:1651529344.399291:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070346c06/0x3234de053c4fa03 lrc: 4/0,1 mode: PW/PW res: [0x2b37d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.399296:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c4f9ee lrc: 3/0,1 mode: PW/PW res: [0x2b37b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399299:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.399304:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1993:41278:x1731746396213376:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (238us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.399306:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c4f9ee lrc: 3/0,1 mode: PW/PW res: [0x2b37b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.399307:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11355 00010000:00010000:1.0:1651529344.399309:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c4f9ee lrc: 3/0,1 mode: PW/PW res: [0x2b37b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.399312:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c4f9ee lrc: 2/0,0 mode: PW/PW res: [0x2b37b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399316:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000822170bb/0x3234de053c4f9e7 lrc: 3/0,1 mode: PW/PW res: [0x2b379:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399325:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000822170bb/0x3234de053c4f9e7 lrc: 3/0,1 mode: PW/PW res: [0x2b379:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399328:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000822170bb/0x3234de053c4f9e7 lrc: 3/0,1 mode: PW/PW res: [0x2b379:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399331:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000822170bb/0x3234de053c4f9e7 lrc: 2/0,0 mode: PW/PW res: [0x2b379:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.399356:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+71:39030:x1731745946332160:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1295us (1383us total) trans 12885078623 rc 0/0 00000100:00100000:1.0:1651529344.399359:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210570 00010000:00010000:1.0:1651529344.399366:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c4f9f5 lrc: 3/0,1 mode: PW/PW res: [0x2b37a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.399370:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c4f9f5 lrc: 3/0,1 mode: PW/PW res: [0x2b37a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.399372:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+70:39030:x1731745946331776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1336us (1437us total) trans 12885078624 rc 0/0 00010000:00010000:1.0:1651529344.399373:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c4f9f5 lrc: 3/0,1 mode: PW/PW res: [0x2b37a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.399375:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210569 00010000:00010000:1.0:1651529344.399376:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c4f9f5 lrc: 2/0,0 mode: PW/PW res: [0x2b37a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399392:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c4f9ee lrc: 2/0,0 mode: PW/PW res: [0x2b37b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399395:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000011345842 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.399396:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c4f9ee lrc: 2/0,0 mode: PW/PW res: [0x2b37b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399399:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c4f9ee lrc: 3/0,0 mode: PW/PW res: [0x2b37b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399404:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c4f9ee lrc: 1/0,0 mode: --/PW res: [0x2b37b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399407:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c4f9ee lrc: 0/0,0 mode: --/PW res: [0x2b37b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399411:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000822170bb/0x3234de053c4f9e7 lrc: 2/0,0 mode: PW/PW res: [0x2b379:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.399414:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+70:39029:x1731745946332096:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1310us (1433us total) trans 12885078625 rc 0/0 00010000:00010000:0.0:1651529344.399414:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000822170bb already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.399415:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000822170bb/0x3234de053c4f9e7 lrc: 2/0,0 mode: PW/PW res: [0x2b379:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.399416:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210571 00010000:00010000:0.0:1651529344.399418:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000822170bb/0x3234de053c4f9e7 lrc: 3/0,0 mode: PW/PW res: [0x2b379:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399421:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000822170bb/0x3234de053c4f9e7 lrc: 1/0,0 mode: --/PW res: [0x2b379:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.399423:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000008407968/0x3234de053c4f9e0 lrc: 3/0,1 mode: PW/PW res: [0x2b377:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.399426:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008407968/0x3234de053c4f9e0 lrc: 3/0,1 mode: PW/PW res: [0x2b377:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399426:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000822170bb/0x3234de053c4f9e7 lrc: 0/0,0 mode: --/PW res: [0x2b379:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.399429:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008407968/0x3234de053c4f9e0 lrc: 3/0,1 mode: PW/PW res: [0x2b377:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399429:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c4f9f5 lrc: 2/0,0 mode: PW/PW res: [0x2b37a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.399432:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008407968/0x3234de053c4f9e0 lrc: 2/0,0 mode: PW/PW res: [0x2b377:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399432:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2a53ada already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.399432:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c4f9f5 lrc: 2/0,0 mode: PW/PW res: [0x2b37a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399435:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c4f9f5 lrc: 3/0,0 mode: PW/PW res: [0x2b37a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399438:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c4f9f5 lrc: 1/0,0 mode: --/PW res: [0x2b37a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399440:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c4f9f5 lrc: 0/0,0 mode: --/PW res: [0x2b37a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399444:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008407968/0x3234de053c4f9e0 lrc: 2/0,0 mode: PW/PW res: [0x2b377:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399446:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000008407968 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.399447:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008407968/0x3234de053c4f9e0 lrc: 2/0,0 mode: PW/PW res: [0x2b377:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399452:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008407968/0x3234de053c4f9e0 lrc: 3/0,0 mode: PW/PW res: [0x2b377:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399455:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008407968/0x3234de053c4f9e0 lrc: 1/0,0 mode: --/PW res: [0x2b377:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399458:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008407968/0x3234de053c4f9e0 lrc: 0/0,0 mode: --/PW res: [0x2b377:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.399462:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+70:39029:x1731745946331648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1462us (1572us total) trans 12885078626 rc 0/0 00000100:00100000:1.0:1651529344.399465:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210568 00010000:00010000:1.0:1651529344.399471:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000070346c06/0x3234de053c4fa03 lrc: 3/0,1 mode: PW/PW res: [0x2b37d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399471:0:80280:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000004e74ca/0x3234de053c4c8bd lrc: 0/0,0 mode: --/PR res: [0x2b37c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd487 expref: 1992 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.399475:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996943360:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.399477:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070346c06/0x3234de053c4fa03 lrc: 3/0,1 mode: PW/PW res: [0x2b37d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399478:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4f9fc lrc: 3/0,1 mode: PW/PW res: [0x2b37c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.399480:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070346c06/0x3234de053c4fa03 lrc: 3/0,1 mode: PW/PW res: [0x2b37d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399481:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4f9fc lrc: 3/0,1 mode: PW/PW res: [0x2b37c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.399483:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070346c06/0x3234de053c4fa03 lrc: 2/0,0 mode: PW/PW res: [0x2b37d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399484:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4f9fc lrc: 3/0,1 mode: PW/PW res: [0x2b37c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399487:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4f9fc lrc: 3/0,1 mode: PW/PW res: [0x2b37c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399496:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4f9fc lrc: 2/0,0 mode: PW/PW res: [0x2b37c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.399520:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+71:39030:x1731745946332288:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1251us (1332us total) trans 12885078627 rc 0/0 00000100:00100000:1.0:1651529344.399522:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210573 00000100:00100000:0.0:1651529344.399535:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+70:39029:x1731745946332224:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1288us (1362us total) trans 12885078628 rc 0/0 00000100:00100000:0.0:1651529344.399538:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210572 00010000:00010000:0.0:1651529344.399552:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070346c06/0x3234de053c4fa03 lrc: 2/0,0 mode: PW/PW res: [0x2b37d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399555:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000070346c06 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.399556:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070346c06/0x3234de053c4fa03 lrc: 2/0,0 mode: PW/PW res: [0x2b37d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399559:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070346c06/0x3234de053c4fa03 lrc: 3/0,0 mode: PW/PW res: [0x2b37d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.399563:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.399563:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070346c06/0x3234de053c4fa03 lrc: 1/0,0 mode: --/PW res: [0x2b37d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399566:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070346c06/0x3234de053c4fa03 lrc: 0/0,0 mode: --/PW res: [0x2b37d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399576:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4f9fc lrc: 2/0,0 mode: PW/PW res: [0x2b37c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399579:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b3ecd1a6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.399580:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4f9fc lrc: 2/0,0 mode: PW/PW res: [0x2b37c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399585:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4f9fc lrc: 3/0,0 mode: PW/PW res: [0x2b37c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399588:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4f9fc lrc: 1/0,0 mode: --/PW res: [0x2b37c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399591:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4f9fc lrc: 0/0,0 mode: --/PW res: [0x2b37c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.399600:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996943488:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.399604:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4fa0a lrc: 3/0,1 mode: --/PW res: [0x2b37e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.399610:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396213440 00010000:00010000:0.0:1651529344.399614:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000006d9a191/0x3234de053c4ce27 lrc: 4/0,0 mode: PR/PR res: [0x2b37e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce9fe expref: 1992 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.399620:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11356 00000100:00100000:0.0:1651529344.399622:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1992:41279:x1731746396213440:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.399624:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.399626:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000006d9a191/0x3234de053c4ce27 lrc: 4/0,0 mode: PR/PR res: [0x2b37e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce9fe expref: 1992 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.399629:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000006d9a191/0x3234de053c4ce27 lrc: 3/0,0 mode: PR/PR res: [0x2b37e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce9fe expref: 1992 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.399636:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006d9a191/0x3234de053c4ce27 lrc: 0/0,0 mode: --/PR res: [0x2b37e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce9fe expref: 1992 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.399640:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.399641:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.399641:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4fa0a lrc: 3/0,1 mode: PW/PW res: [0x2b37e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399644:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4fa0a lrc: 4/0,1 mode: PW/PW res: [0x2b37e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399650:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.399677:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1991:41279:x1731746396213440:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 54us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.399680:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11356 00010000:00010000:0.0:1651529344.399687:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4fa0a lrc: 3/0,1 mode: PW/PW res: [0x2b37e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399691:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4fa0a lrc: 3/0,1 mode: PW/PW res: [0x2b37e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399694:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4fa0a lrc: 3/0,1 mode: PW/PW res: [0x2b37e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399696:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4fa0a lrc: 2/0,0 mode: PW/PW res: [0x2b37e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.399768:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+70:39030:x1731745946332416:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1451us (1570us total) trans 12885078629 rc 0/0 00000100:00100000:0.0:1651529344.399771:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210574 00010000:00010000:0.0:1651529344.399778:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4fa0a lrc: 2/0,0 mode: PW/PW res: [0x2b37e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399782:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000041a7efd7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.399783:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4fa0a lrc: 2/0,0 mode: PW/PW res: [0x2b37e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399786:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4fa0a lrc: 3/0,0 mode: PW/PW res: [0x2b37e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399790:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4fa0a lrc: 1/0,0 mode: --/PW res: [0x2b37e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.399793:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4fa0a lrc: 0/0,0 mode: --/PW res: [0x2b37e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.399874:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.399875:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996943552:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.399884:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c4fa11 lrc: 3/0,1 mode: --/PW res: [0x2b37f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.399902:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.399913:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.399919:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946332992 00000100:00100000:0.0:1651529344.399927:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946333056 00000100:00100000:0.0:1651529344.399931:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946333120 00000100:00100000:0.0:1651529344.399936:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210576 00000100:00100000:0.0:1651529344.399938:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+72:39029:x1731745946332992:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.399943:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177024 count 1 00000100:00100000:1.0:1651529344.399947:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.399948:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c4fa18 lrc: 3/0,1 mode: --/PW res: [0x2b380:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.399958:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.399959:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000610e679c/0x3234de053c4d1fb lrc: 2/0,0 mode: PR/PR res: [0x2b380:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf9c5 expref: 1990 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.399966:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.399968:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.399975:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.399988:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.399989:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c4fa18 lrc: 4/0,1 mode: --/PW res: [0x2b380:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.399997:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.399997:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000610e679c/0x3234de053c4d1fb lrc: 3/0,0 mode: PR/PR res: [0x2b380:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf9c5 expref: 1990 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.400001:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000610e679c/0x3234de053c4d1fb lrc: 4/0,0 mode: PR/PR res: [0x2b380:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf9c5 expref: 1990 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.400005:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946333184 00000100:00100000:0.0:1651529344.400005:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996943616:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.400011:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946333248 00000100:00100000:1.0:1651529344.400013:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946333312 00000100:00100000:1.0:1651529344.400015:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946333440 00000100:00100000:0.0:1651529344.400019:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 000000001ec7f4cb going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.400024:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210577 00000100:00100000:1.0:1651529344.400026:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+76:39030:x1731745946333056:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.400027:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210578 00000100:00100000:0.0:1651529344.400029:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001e283857 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+76:39029:x1731745946333120:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.400032:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177025 count 1 00002000:00080000:0.0:1651529344.400034:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177026 count 1 00010000:00010000:1.0:1651529344.400037:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c4fa1f lrc: 3/0,1 mode: --/PW res: [0x2b381:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400038:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c4fa26 lrc: 3/0,1 mode: --/PW res: [0x2b382:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.400042:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c4d129 lrc: 2/0,0 mode: PR/PR res: [0x2b381:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf64c expref: 1990 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.400045:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.400045:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c4cf15 lrc: 2/0,0 mode: PR/PR res: [0x2b382:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee26 expref: 1990 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.400046:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.400046:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c4fa1f lrc: 4/0,1 mode: --/PW res: [0x2b381:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400048:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.400048:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.400049:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c4fa26 lrc: 4/0,1 mode: --/PW res: [0x2b382:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.400053:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c4d129 lrc: 3/0,0 mode: PR/PR res: [0x2b381:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf64c expref: 1990 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.400055:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c4cf15 lrc: 3/0,0 mode: PR/PR res: [0x2b382:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee26 expref: 1990 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.400057:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c4d129 lrc: 4/0,0 mode: PR/PR res: [0x2b381:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf64c expref: 1990 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.400059:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c4cf15 lrc: 4/0,0 mode: PR/PR res: [0x2b382:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee26 expref: 1990 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.400062:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a573b31 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996943680:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.400063:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996943744:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.400071:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 0000000018ebe812 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.400073:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 0000000094c2f645 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.400078:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210579 00000100:00100000:0.0:1651529344.400078:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396213824 00000100:00100000:1.0:1651529344.400080:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+76:39030:x1731745946333184:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.400082:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007c830bc7/0x3234de053c49fb9 lrc: 4/0,0 mode: PR/PR res: [0x2b37f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb515 expref: 1991 pid: 72397 timeout: 20103 lvb_type: 1 00002000:00080000:1.0:1651529344.400084:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177027 count 1 00010000:00010000:1.0:1651529344.400087:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c4fa2d lrc: 3/0,1 mode: --/PW res: [0x2b383:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.400090:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11357 00010000:00010000:1.0:1651529344.400091:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c4ee02 lrc: 2/0,0 mode: PR/PR res: [0x2b383:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a35 expref: 1991 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.400092:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040f63b09 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1991:41278:x1731746396213824:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.400094:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.400095:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.400095:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.400096:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c4fa2d lrc: 4/0,1 mode: --/PW res: [0x2b383:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400096:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007c830bc7/0x3234de053c49fb9 lrc: 4/0,0 mode: PR/PR res: [0x2b37f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb515 expref: 1991 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.400102:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c4ee02 lrc: 3/0,0 mode: PR/PR res: [0x2b383:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a35 expref: 1991 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.400102:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007c830bc7/0x3234de053c49fb9 lrc: 3/0,0 mode: PR/PR res: [0x2b37f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb515 expref: 1991 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.400106:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c4ee02 lrc: 4/0,0 mode: PR/PR res: [0x2b383:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a35 expref: 1991 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.400107:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c830bc7/0x3234de053c49fb9 lrc: 0/0,0 mode: --/PR res: [0x2b37f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb515 expref: 1991 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.400109:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fc130417 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996943808:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.400111:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.400111:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.400112:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c4fa11 lrc: 3/0,1 mode: PW/PW res: [0x2b37f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400115:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c4fa11 lrc: 4/0,1 mode: PW/PW res: [0x2b37f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.400116:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d09f5ee1 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.400121:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210580 00010000:00010000:0.0:1651529344.400121:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.400123:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+76:39029:x1731745946333248:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.400127:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177028 count 1 00000100:00100000:0.0:1651529344.400127:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040f63b09 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1990:41278:x1731746396213824:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 35us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.400129:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11357 00010000:00010000:1.0:1651529344.400130:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4fa34 lrc: 3/0,1 mode: --/PW res: [0x2b384:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.400134:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007ecdd226/0x3234de053c4ac15 lrc: 2/0,0 mode: PR/PR res: [0x2b384:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe68 expref: 1989 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.400137:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.400138:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.400138:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4fa34 lrc: 4/0,1 mode: --/PW res: [0x2b384:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.400141:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210581 00000100:00100000:0.0:1651529344.400143:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+76:39030:x1731745946333312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.400146:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007ecdd226/0x3234de053c4ac15 lrc: 3/0,0 mode: PR/PR res: [0x2b384:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe68 expref: 1989 pid: 72397 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.400148:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177029 count 1 00010000:00010000:1.0:1651529344.400150:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007ecdd226/0x3234de053c4ac15 lrc: 4/0,0 mode: PR/PR res: [0x2b384:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe68 expref: 1989 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.400151:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c4fa3b lrc: 3/0,1 mode: --/PW res: [0x2b385:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.400153:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000055e03b4f pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996943872:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.400156:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c4f621 lrc: 2/0,0 mode: PR/PR res: [0x2b385:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b44 expref: 1989 pid: 156655 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.400159:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000567ee0ef going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.400161:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.400161:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.400162:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c4fa3b lrc: 4/0,1 mode: --/PW res: [0x2b385:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.400165:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210582 00000100:00100000:1.0:1651529344.400166:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+76:39030:x1731745946333440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.400168:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c4f621 lrc: 3/0,0 mode: PR/PR res: [0x2b385:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b44 expref: 1989 pid: 156655 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.400170:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177030 count 1 00010000:00010000:0.0:1651529344.400172:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c4f621 lrc: 4/0,0 mode: PR/PR res: [0x2b385:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b44 expref: 1989 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.400173:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4fa42 lrc: 3/0,1 mode: --/PW res: [0x2b386:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.400176:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996943936:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.400177:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000f9600f5/0x3234de053c4df99 lrc: 2/0,0 mode: PR/PR res: [0x2b386:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f5d expref: 1989 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.400180:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.400181:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.400181:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4fa42 lrc: 4/0,1 mode: --/PW res: [0x2b386:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.400183:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a52ee82 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.400187:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000f9600f5/0x3234de053c4df99 lrc: 3/0,0 mode: PR/PR res: [0x2b386:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f5d expref: 1989 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.400188:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c4fa11 lrc: 3/0,1 mode: PW/PW res: [0x2b37f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.400191:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000f9600f5/0x3234de053c4df99 lrc: 4/0,0 mode: PR/PR res: [0x2b386:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f5d expref: 1989 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.400191:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c4fa11 lrc: 3/0,1 mode: PW/PW res: [0x2b37f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400194:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c4fa11 lrc: 3/0,1 mode: PW/PW res: [0x2b37f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.400195:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000117fbeca pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996944000:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.400197:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c4fa11 lrc: 2/0,0 mode: PW/PW res: [0x2b37f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.400201:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8a0b704 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.400262:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085af61db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+77:39030:x1731745946332672:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1289us (1354us total) trans 12885078630 rc 0/0 00000100:00100000:0.0:1651529344.400265:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210575 00010000:00010000:0.0:1651529344.400273:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c4fa11 lrc: 2/0,0 mode: PW/PW res: [0x2b37f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400276:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d37a9fd1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.400278:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c4fa11 lrc: 2/0,0 mode: PW/PW res: [0x2b37f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400280:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c4fa11 lrc: 3/0,0 mode: PW/PW res: [0x2b37f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400285:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c4fa11 lrc: 1/0,0 mode: --/PW res: [0x2b37f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400288:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c4fa11 lrc: 0/0,0 mode: --/PW res: [0x2b37f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.400427:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996943616:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.400430:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.400431:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c4fa18 lrc: 3/0,1 mode: --/PW res: [0x2b380:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.400454:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946333504 00000100:00100000:0.0:1651529344.400479:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210583 00000100:00100000:0.0:1651529344.400481:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+77:39030:x1731745946333504:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.400495:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fc130417 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996943808:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.400499:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177031 count 1 00010000:00010000:0.0:1651529344.400504:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c4fa49 lrc: 3/0,1 mode: --/PW res: [0x2b387:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.400505:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c4fa2d lrc: 3/0,1 mode: --/PW res: [0x2b383:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400509:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000070dd06bd/0x3234de053c4e1ec lrc: 2/0,0 mode: PR/PR res: [0x2b387:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d38e8 expref: 1989 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.400512:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a573b31 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996943680:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.400512:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.400513:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.400514:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c4fa49 lrc: 4/0,1 mode: --/PW res: [0x2b387:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.400515:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c4fa1f lrc: 3/0,1 mode: --/PW res: [0x2b381:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.400520:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000055e03b4f pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996943872:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.400520:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000070dd06bd/0x3234de053c4e1ec lrc: 3/0,0 mode: PR/PR res: [0x2b387:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d38e8 expref: 1989 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.400523:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4fa34 lrc: 3/0,1 mode: --/PW res: [0x2b384:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400524:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000070dd06bd/0x3234de053c4e1ec lrc: 4/0,0 mode: PR/PR res: [0x2b387:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d38e8 expref: 1989 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.400528:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996944064:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.400537:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 0000000064b9c5f3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.400551:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996943744:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.400555:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c4fa26 lrc: 3/0,1 mode: --/PW res: [0x2b382:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.400561:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996943936:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.400564:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c4fa3b lrc: 3/0,1 mode: --/PW res: [0x2b385:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.400782:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.400792:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.400801:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.400808:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396214080 00000100:00100000:1.0:1651529344.400809:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.400814:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000610e679c/0x3234de053c4d1fb lrc: 4/0,0 mode: PR/PR res: [0x2b380:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf9c5 expref: 1990 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.400816:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.400820:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396214208 00000100:00100000:1.0:1651529344.400821:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.400823:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c4cf15 lrc: 4/0,0 mode: PR/PR res: [0x2b382:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee26 expref: 1991 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.400826:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.400827:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396214144 00010000:00010000:0.0:1651529344.400829:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c4d129 lrc: 4/0,0 mode: PR/PR res: [0x2b381:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf64c expref: 1992 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.400840:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000117fbeca pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996944000:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.400840:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396214336 00010000:00010000:0.0:1651529344.400843:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007ecdd226/0x3234de053c4ac15 lrc: 4/0,0 mode: PR/PR res: [0x2b384:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe68 expref: 1993 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.400844:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4fa42 lrc: 3/0,1 mode: --/PW res: [0x2b386:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.400847:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396214272 00010000:00010000:0.0:1651529344.400849:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c4ee02 lrc: 4/0,0 mode: PR/PR res: [0x2b383:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a35 expref: 1994 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.400851:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396214400 00000100:00100000:0.0:1651529344.400853:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396214528 00010000:00010000:1.0:1651529344.400856:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c4f621 lrc: 4/0,0 mode: PR/PR res: [0x2b385:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b44 expref: 1996 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.400856:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000f9600f5/0x3234de053c4df99 lrc: 4/0,0 mode: PR/PR res: [0x2b386:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f5d expref: 1996 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.400860:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11358 00000100:00100000:0.0:1651529344.400862:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1996:41279:x1731746396214080:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.400864:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11359 00010000:00010000:0.0:1651529344.400865:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.400866:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1996:41279:x1731746396214208:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.400866:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000610e679c/0x3234de053c4d1fb lrc: 4/0,0 mode: PR/PR res: [0x2b380:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf9c5 expref: 1996 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.400869:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.400870:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c4cf15 lrc: 4/0,0 mode: PR/PR res: [0x2b382:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee26 expref: 1996 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.400872:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000610e679c/0x3234de053c4d1fb lrc: 3/0,0 mode: PR/PR res: [0x2b380:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf9c5 expref: 1996 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.400874:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c4cf15 lrc: 3/0,0 mode: PR/PR res: [0x2b382:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee26 expref: 1996 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.400880:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c4cf15 lrc: 0/0,0 mode: --/PR res: [0x2b382:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee26 expref: 1996 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.400883:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.400884:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.400885:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c4fa26 lrc: 3/0,1 mode: PW/PW res: [0x2b382:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.400888:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c4fa26 lrc: 4/0,1 mode: PW/PW res: [0x2b382:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.400908:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.400910:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000610e679c/0x3234de053c4d1fb lrc: 0/0,0 mode: --/PR res: [0x2b380:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf9c5 expref: 1995 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.400914:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.400914:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.400915:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c4fa18 lrc: 3/0,1 mode: PW/PW res: [0x2b380:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.400918:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1994:41279:x1731746396214208:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 51us (125us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.400918:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c4fa18 lrc: 4/0,1 mode: PW/PW res: [0x2b380:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.400921:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11359 00010000:00010000:0.0:1651529344.400925:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.400926:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11360 00000100:00100000:1.0:1651529344.400928:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1993:41279:x1731746396214144:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.400930:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.400932:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c4d129 lrc: 4/0,0 mode: PR/PR res: [0x2b381:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf64c expref: 1993 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.400932:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1993:41279:x1731746396214080:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 70us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.400935:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11358 00010000:00010000:1.0:1651529344.400936:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c4d129 lrc: 3/0,0 mode: PR/PR res: [0x2b381:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf64c expref: 1993 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.400940:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11361 00010000:00010000:1.0:1651529344.400941:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c4d129 lrc: 0/0,0 mode: --/PR res: [0x2b381:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf64c expref: 1992 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.400942:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1992:41279:x1731746396214336:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.400944:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.400945:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.400945:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c4fa1f lrc: 3/0,1 mode: PW/PW res: [0x2b381:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400945:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.400946:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007ecdd226/0x3234de053c4ac15 lrc: 4/0,0 mode: PR/PR res: [0x2b384:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe68 expref: 1991 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.400949:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c4fa1f lrc: 4/0,1 mode: PW/PW res: [0x2b381:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400950:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007ecdd226/0x3234de053c4ac15 lrc: 3/0,0 mode: PR/PR res: [0x2b384:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe68 expref: 1991 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.400954:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.400955:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ecdd226/0x3234de053c4ac15 lrc: 0/0,0 mode: --/PR res: [0x2b384:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe68 expref: 1991 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.400958:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.400959:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1990:41279:x1731746396214144:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 31us (158us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.400959:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.400960:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4fa34 lrc: 3/0,1 mode: PW/PW res: [0x2b384:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.400962:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11360 00010000:00010000:0.0:1651529344.400962:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4fa34 lrc: 4/0,1 mode: PW/PW res: [0x2b384:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.400966:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11362 00000100:00100000:1.0:1651529344.400967:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1989:41278:x1731746396214272:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.400972:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.400976:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.400977:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1989:41279:x1731746396214336:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (168us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.400978:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c4ee02 lrc: 4/0,0 mode: PR/PR res: [0x2b383:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a35 expref: 1989 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.400980:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11361 00010000:00010000:1.0:1651529344.400982:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c4ee02 lrc: 3/0,0 mode: PR/PR res: [0x2b383:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a35 expref: 1989 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.400984:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11363 00000100:00100000:0.0:1651529344.400986:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a253639 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1988:41278:x1731746396214528:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.400987:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c4ee02 lrc: 0/0,0 mode: --/PR res: [0x2b383:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a35 expref: 1988 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.400988:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.400989:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000f9600f5/0x3234de053c4df99 lrc: 4/0,0 mode: PR/PR res: [0x2b386:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f5d expref: 1988 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.400990:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.400991:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.400991:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c4fa2d lrc: 3/0,1 mode: PW/PW res: [0x2b383:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400993:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000f9600f5/0x3234de053c4df99 lrc: 3/0,0 mode: PR/PR res: [0x2b386:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f5d expref: 1987 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.400994:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c4fa2d lrc: 4/0,1 mode: PW/PW res: [0x2b383:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.400998:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f9600f5/0x3234de053c4df99 lrc: 0/0,0 mode: --/PR res: [0x2b386:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f5d expref: 1987 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.401000:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.401004:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.401004:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.401005:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1986:41278:x1731746396214272:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 37us (189us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.401005:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4fa42 lrc: 3/0,1 mode: PW/PW res: [0x2b386:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.401007:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11362 00010000:00010000:0.0:1651529344.401008:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4fa42 lrc: 4/0,1 mode: PW/PW res: [0x2b386:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.401011:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11364 00000100:00100000:1.0:1651529344.401013:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1985:41278:x1731746396214400:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.401016:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.401021:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.401021:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a253639 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1985:41278:x1731746396214528:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 34us (195us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.401023:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c4f621 lrc: 4/0,0 mode: PR/PR res: [0x2b385:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b44 expref: 1985 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.401023:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11363 00010000:00010000:1.0:1651529344.401027:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c4f621 lrc: 3/0,0 mode: PR/PR res: [0x2b385:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b44 expref: 1984 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.401029:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c4fa26 lrc: 3/0,1 mode: PW/PW res: [0x2b382:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.401032:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c4f621 lrc: 0/0,0 mode: --/PR res: [0x2b385:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b44 expref: 1984 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.401032:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c4fa26 lrc: 3/0,1 mode: PW/PW res: [0x2b382:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.401035:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.401036:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.401036:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c4fa3b lrc: 3/0,1 mode: PW/PW res: [0x2b385:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401036:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c4fa26 lrc: 3/0,1 mode: PW/PW res: [0x2b382:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401038:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c4fa26 lrc: 2/0,0 mode: PW/PW res: [0x2b382:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.401039:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c4fa3b lrc: 4/0,1 mode: PW/PW res: [0x2b385:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.401048:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.401053:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1983:41278:x1731746396214400:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 39us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.401055:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11364 00010000:00010000:1.0:1651529344.401065:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c4fa2d lrc: 3/0,1 mode: PW/PW res: [0x2b383:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.401068:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c4fa2d lrc: 3/0,1 mode: PW/PW res: [0x2b383:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.401071:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c4fa2d lrc: 3/0,1 mode: PW/PW res: [0x2b383:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.401077:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c4fa2d lrc: 2/0,0 mode: PW/PW res: [0x2b383:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.401090:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001e283857 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+78:39029:x1731745946333120:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1054us (1170us total) trans 12885078631 rc 0/0 00000100:00100000:0.0:1651529344.401093:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210578 00010000:00010000:0.0:1651529344.401100:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c4fa26 lrc: 2/0,0 mode: PW/PW res: [0x2b382:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401104:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002e1250c9 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.401105:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c4fa26 lrc: 2/0,0 mode: PW/PW res: [0x2b382:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401108:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c4fa26 lrc: 3/0,0 mode: PW/PW res: [0x2b382:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401112:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c4fa26 lrc: 1/0,0 mode: --/PW res: [0x2b382:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401115:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c4fa26 lrc: 0/0,0 mode: --/PW res: [0x2b382:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401119:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c4fa2d lrc: 2/0,0 mode: PW/PW res: [0x2b383:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.401121:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+78:39030:x1731745946333184:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1040us (1162us total) trans 12885078632 rc 0/0 00010000:00010000:0.0:1651529344.401122:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000069f87339 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.401123:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c4fa2d lrc: 2/0,0 mode: PW/PW res: [0x2b383:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.401124:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210579 00010000:00010000:0.0:1651529344.401126:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c4fa2d lrc: 3/0,0 mode: PW/PW res: [0x2b383:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401129:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c4fa2d lrc: 1/0,0 mode: --/PW res: [0x2b383:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.401131:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c4fa1f lrc: 3/0,1 mode: PW/PW res: [0x2b381:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.401134:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c4fa1f lrc: 3/0,1 mode: PW/PW res: [0x2b381:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401134:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c4fa2d lrc: 0/0,0 mode: --/PW res: [0x2b383:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.401137:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c4fa1f lrc: 3/0,1 mode: PW/PW res: [0x2b381:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.401140:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c4fa1f lrc: 2/0,0 mode: PW/PW res: [0x2b381:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401141:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c4fa18 lrc: 3/0,1 mode: PW/PW res: [0x2b380:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401144:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c4fa18 lrc: 3/0,1 mode: PW/PW res: [0x2b380:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401152:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c4fa18 lrc: 3/0,1 mode: PW/PW res: [0x2b380:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401155:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c4fa18 lrc: 2/0,0 mode: PW/PW res: [0x2b380:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.401178:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+79:39030:x1731745946333056:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1151us (1282us total) trans 12885078633 rc 0/0 00000100:00100000:1.0:1651529344.401181:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210577 00010000:00010000:1.0:1651529344.401187:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4fa34 lrc: 3/0,1 mode: PW/PW res: [0x2b384:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.401190:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4fa34 lrc: 3/0,1 mode: PW/PW res: [0x2b384:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.401194:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+78:39029:x1731745946332992:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1255us (1320us total) trans 12885078634 rc 0/0 00010000:00010000:1.0:1651529344.401195:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4fa34 lrc: 3/0,1 mode: PW/PW res: [0x2b384:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.401197:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210576 00010000:00010000:1.0:1651529344.401198:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4fa34 lrc: 2/0,0 mode: PW/PW res: [0x2b384:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401242:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c4fa1f lrc: 2/0,0 mode: PW/PW res: [0x2b381:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401246:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002dcd6c4b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.401247:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c4fa1f lrc: 2/0,0 mode: PW/PW res: [0x2b381:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401250:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c4fa1f lrc: 3/0,0 mode: PW/PW res: [0x2b381:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.401251:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+78:39029:x1731745946333248:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1127us (1283us total) trans 12885078635 rc 0/0 00000100:00100000:1.0:1651529344.401254:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210580 00010000:00010000:0.0:1651529344.401255:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c4fa1f lrc: 1/0,0 mode: --/PW res: [0x2b381:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401258:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c4fa1f lrc: 0/0,0 mode: --/PW res: [0x2b381:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.401260:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4fa42 lrc: 3/0,1 mode: PW/PW res: [0x2b386:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.401263:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4fa42 lrc: 3/0,1 mode: PW/PW res: [0x2b386:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401263:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c4fa18 lrc: 2/0,0 mode: PW/PW res: [0x2b380:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401265:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000364b2cdc already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.401266:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4fa42 lrc: 3/0,1 mode: PW/PW res: [0x2b386:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401266:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c4fa18 lrc: 2/0,0 mode: PW/PW res: [0x2b380:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.401269:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4fa42 lrc: 2/0,0 mode: PW/PW res: [0x2b386:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401269:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c4fa18 lrc: 3/0,0 mode: PW/PW res: [0x2b380:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401272:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c4fa18 lrc: 1/0,0 mode: --/PW res: [0x2b380:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401275:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c4fa18 lrc: 0/0,0 mode: --/PW res: [0x2b380:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401278:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4fa34 lrc: 2/0,0 mode: PW/PW res: [0x2b384:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401281:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000040cd657 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.401281:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4fa34 lrc: 2/0,0 mode: PW/PW res: [0x2b384:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401284:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4fa34 lrc: 3/0,0 mode: PW/PW res: [0x2b384:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401287:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4fa34 lrc: 1/0,0 mode: --/PW res: [0x2b384:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401290:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4fa34 lrc: 0/0,0 mode: --/PW res: [0x2b384:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401293:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4fa42 lrc: 2/0,0 mode: PW/PW res: [0x2b386:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401296:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000093dbd0d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.401297:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4fa42 lrc: 2/0,0 mode: PW/PW res: [0x2b386:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.401299:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+78:39030:x1731745946333440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1132us (1307us total) trans 12885078636 rc 0/0 00010000:00010000:0.0:1651529344.401299:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4fa42 lrc: 3/0,0 mode: PW/PW res: [0x2b386:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.401302:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210582 00010000:00010000:0.0:1651529344.401302:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4fa42 lrc: 1/0,0 mode: --/PW res: [0x2b386:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401305:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4fa42 lrc: 0/0,0 mode: --/PW res: [0x2b386:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401314:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c4fa3b lrc: 3/0,1 mode: PW/PW res: [0x2b385:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.401317:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.401317:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c4fa3b lrc: 3/0,1 mode: PW/PW res: [0x2b385:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401320:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c4fa3b lrc: 3/0,1 mode: PW/PW res: [0x2b385:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401328:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c4fa3b lrc: 2/0,0 mode: PW/PW res: [0x2b385:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.401366:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+78:39030:x1731745946333312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1222us (1390us total) trans 12885078637 rc 0/0 00000100:00100000:0.0:1651529344.401369:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210581 00010000:00010000:0.0:1651529344.401376:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c4fa3b lrc: 2/0,0 mode: PW/PW res: [0x2b385:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401379:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f1b4c19f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.401380:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c4fa3b lrc: 2/0,0 mode: PW/PW res: [0x2b385:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401383:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c4fa3b lrc: 3/0,0 mode: PW/PW res: [0x2b385:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401387:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c4fa3b lrc: 1/0,0 mode: --/PW res: [0x2b385:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401390:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c4fa3b lrc: 0/0,0 mode: --/PW res: [0x2b385:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.401397:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396214592 00010000:00010000:0.0:1651529344.401401:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000070dd06bd/0x3234de053c4e1ec lrc: 5/0,0 mode: PR/PR res: [0x2b387:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d38e8 expref: 1983 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.401408:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11365 00000100:00100000:0.0:1651529344.401410:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1983:41279:x1731746396214592:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.401413:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.401414:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000070dd06bd/0x3234de053c4e1ec lrc: 5/0,0 mode: PR/PR res: [0x2b387:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d38e8 expref: 1983 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.401435:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000070dd06bd/0x3234de053c4e1ec lrc: 4/0,0 mode: PR/PR res: [0x2b387:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d38e8 expref: 1983 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.401441:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.401441:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.401442:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c4fa49 lrc: 3/0,1 mode: PW/PW res: [0x2b387:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401445:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c4fa49 lrc: 4/0,1 mode: PW/PW res: [0x2b387:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401450:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.401474:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1983:41279:x1731746396214592:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 52us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.401477:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11365 00010000:00010000:0.0:1651529344.401488:0:156655:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070dd06bd/0x3234de053c4e1ec lrc: 0/0,0 mode: --/PR res: [0x2b387:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d38e8 expref: 1982 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.401506:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996944064:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.401510:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c4fa49 lrc: 3/0,1 mode: PW/PW res: [0x2b387:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401513:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c4fa49 lrc: 3/0,1 mode: PW/PW res: [0x2b387:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401516:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c4fa49 lrc: 3/0,1 mode: PW/PW res: [0x2b387:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401519:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c4fa49 lrc: 3/0,1 mode: PW/PW res: [0x2b387:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401522:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c4fa49 lrc: 2/0,0 mode: PW/PW res: [0x2b387:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.401566:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+78:39030:x1731745946333504:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1084us (1136us total) trans 12885078638 rc 0/0 00000100:00100000:0.0:1651529344.401586:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210583 00010000:00010000:0.0:1651529344.401603:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c4fa49 lrc: 2/0,0 mode: PW/PW res: [0x2b387:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401607:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000af20b5e7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.401608:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c4fa49 lrc: 2/0,0 mode: PW/PW res: [0x2b387:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401613:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c4fa49 lrc: 3/0,0 mode: PW/PW res: [0x2b387:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.401618:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.401618:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c4fa49 lrc: 1/0,0 mode: --/PW res: [0x2b387:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401621:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c4fa49 lrc: 0/0,0 mode: --/PW res: [0x2b387:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.401629:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.401637:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.401638:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946334144 00000100:00100000:0.0:1651529344.401647:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946334080 00000100:00100000:1.0:1651529344.401649:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.401652:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946334272 00000100:00100000:0.0:1651529344.401657:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946334208 00000100:00100000:0.0:1651529344.401662:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210584 00000100:00100000:0.0:1651529344.401663:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+81:39029:x1731745946334144:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.401664:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210585 00000100:00100000:1.0:1651529344.401666:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+81:39030:x1731745946334080:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.401669:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177033 count 1 00002000:00080000:1.0:1651529344.401672:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177032 count 1 00010000:00010000:0.0:1651529344.401673:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039586f31/0x3234de053c4fa50 lrc: 3/0,1 mode: --/PW res: [0x2b389:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.401677:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4fa57 lrc: 3/0,1 mode: --/PW res: [0x2b388:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401678:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000662594c3/0x3234de053c4ccbb lrc: 2/0,0 mode: PR/PR res: [0x2b389:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce4c5 expref: 1981 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.401681:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.401681:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.401682:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eebe983a/0x3234de053c4e1d0 lrc: 2/0,0 mode: PR/PR res: [0x2b388:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3886 expref: 1981 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.401682:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039586f31/0x3234de053c4fa50 lrc: 4/0,1 mode: --/PW res: [0x2b389:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.401685:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.401686:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.401686:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4fa57 lrc: 4/0,1 mode: --/PW res: [0x2b388:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401688:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000662594c3/0x3234de053c4ccbb lrc: 3/0,0 mode: PR/PR res: [0x2b389:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce4c5 expref: 1981 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.401693:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eebe983a/0x3234de053c4e1d0 lrc: 3/0,0 mode: PR/PR res: [0x2b388:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3886 expref: 1981 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.401697:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eebe983a/0x3234de053c4e1d0 lrc: 4/0,0 mode: PR/PR res: [0x2b388:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3886 expref: 1981 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.401701:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000be0ace91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996944192:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.401712:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 0000000071742acc going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.401717:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210586 00010000:00010000:0.0:1651529344.401722:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000662594c3/0x3234de053c4ccbb lrc: 4/0,0 mode: PR/PR res: [0x2b389:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce4c5 expref: 1981 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.401728:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996944128:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.401742:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+81:39029:x1731745946334272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.401746:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000382571b5 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.401748:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177035 count 1 00010000:00010000:1.0:1651529344.401752:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4fa5e lrc: 3/0,1 mode: --/PW res: [0x2b38b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.401753:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210587 00000100:00100000:0.0:1651529344.401755:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+81:39030:x1731745946334208:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.401756:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c4e0bf lrc: 2/0,0 mode: PR/PR res: [0x2b38b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3369 expref: 1981 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.401760:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.401760:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:0.0:1651529344.401760:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177034 count 1 00010000:00010000:1.0:1651529344.401761:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4fa5e lrc: 4/0,1 mode: --/PW res: [0x2b38b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.401767:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c4e0bf lrc: 3/0,0 mode: PR/PR res: [0x2b38b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3369 expref: 1981 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.401770:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c4e0bf lrc: 4/0,0 mode: PR/PR res: [0x2b38b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3369 expref: 1981 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.401774:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004534b316 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996944256:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.401777:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c4fa65 lrc: 3/0,1 mode: --/PW res: [0x2b38a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.401782:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000499d0377 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.401782:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f3202904/0x3234de053c4b45e lrc: 2/0,0 mode: PR/PR res: [0x2b38a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc204 expref: 1981 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.401785:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.401786:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.401787:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c4fa65 lrc: 4/0,1 mode: --/PW res: [0x2b38a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401794:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f3202904/0x3234de053c4b45e lrc: 3/0,0 mode: PR/PR res: [0x2b38a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc204 expref: 1981 pid: 72395 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.401796:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.401797:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f3202904/0x3234de053c4b45e lrc: 4/0,0 mode: PR/PR res: [0x2b38a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc204 expref: 1981 pid: 72395 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.401804:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996944320:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.401809:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.401813:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c8d20cf1 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.401819:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.401819:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946334336 00000100:00100000:0.0:1651529344.401830:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946334464 00000100:00100000:0.0:1651529344.401835:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946334400 00000100:00100000:0.0:1651529344.401840:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210588 00000100:00100000:1.0:1651529344.401841:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.401842:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+84:39030:x1731745946334336:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.401847:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177036 count 1 00010000:00010000:0.0:1651529344.401851:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bcdc8b9f/0x3234de053c4fa6c lrc: 3/0,1 mode: --/PW res: [0x2b38c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401855:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000773eb1ef/0x3234de053c4ed53 lrc: 2/0,0 mode: PR/PR res: [0x2b38c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6748 expref: 1981 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.401858:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.401859:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.401859:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bcdc8b9f/0x3234de053c4fa6c lrc: 4/0,1 mode: --/PW res: [0x2b38c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.401865:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000773eb1ef/0x3234de053c4ed53 lrc: 3/0,0 mode: PR/PR res: [0x2b38c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6748 expref: 1981 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.401869:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000773eb1ef/0x3234de053c4ed53 lrc: 4/0,0 mode: PR/PR res: [0x2b38c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6748 expref: 1981 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.401872:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946334528 00000100:00100000:0.0:1651529344.401872:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996944384:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.401879:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210589 00000100:00100000:1.0:1651529344.401880:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+85:39030:x1731745946334464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.401885:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 000000007b78c9d8 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.401891:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210590 00002000:00080000:1.0:1651529344.401892:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177038 count 1 00000100:00100000:0.0:1651529344.401893:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+85:39029:x1731745946334400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.401896:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c4fa73 lrc: 3/0,1 mode: --/PW res: [0x2b38e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.401898:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177037 count 1 00010000:00010000:1.0:1651529344.401901:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000069e35989/0x3234de053c4a037 lrc: 2/0,0 mode: PR/PR res: [0x2b38e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb696 expref: 1981 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.401904:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.401905:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.401905:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c4fa73 lrc: 4/0,1 mode: --/PW res: [0x2b38e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.401912:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000069e35989/0x3234de053c4a037 lrc: 3/0,0 mode: PR/PR res: [0x2b38e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb696 expref: 1981 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.401915:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000069e35989/0x3234de053c4a037 lrc: 4/0,0 mode: PR/PR res: [0x2b38e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb696 expref: 1981 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.401915:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd405bc5/0x3234de053c4fa7a lrc: 3/0,1 mode: --/PW res: [0x2b38d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.401919:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a573b31 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996944448:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.401921:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c4c789 lrc: 2/0,0 mode: PR/PR res: [0x2b38d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd074 expref: 1981 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.401924:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.401924:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.401925:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd405bc5/0x3234de053c4fa7a lrc: 4/0,1 mode: --/PW res: [0x2b38d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.401927:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8a0b704 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.401932:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c4c789 lrc: 3/0,0 mode: PR/PR res: [0x2b38d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd074 expref: 1981 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.401934:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210591 00000100:00100000:1.0:1651529344.401935:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+85:39030:x1731745946334528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.401935:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c4c789 lrc: 4/0,0 mode: PR/PR res: [0x2b38d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd074 expref: 1981 pid: 72396 timeout: 20103 lvb_type: 1 00002000:00080000:1.0:1651529344.401939:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177039 count 1 00000100:00100000:0.0:1651529344.401939:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996944512:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.401942:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c4fa81 lrc: 3/0,1 mode: --/PW res: [0x2b38f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.401946:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f8e23e2b/0x3234de053c4de50 lrc: 2/0,0 mode: PR/PR res: [0x2b38f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a08 expref: 1981 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.401948:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000124f6b49 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.401950:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.401950:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.401951:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c4fa81 lrc: 4/0,1 mode: --/PW res: [0x2b38f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.401956:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f8e23e2b/0x3234de053c4de50 lrc: 3/0,0 mode: PR/PR res: [0x2b38f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a08 expref: 1981 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.401960:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f8e23e2b/0x3234de053c4de50 lrc: 4/0,0 mode: PR/PR res: [0x2b38f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a08 expref: 1981 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.401964:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000055e03b4f pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996944576:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.401970:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000567ee0ef going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.402133:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.402146:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396215168 00010000:00010000:0.0:1651529344.402151:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eebe983a/0x3234de053c4e1d0 lrc: 5/0,0 mode: PR/PR res: [0x2b388:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3886 expref: 1982 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.402155:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.402170:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396215232 00010000:00010000:0.0:1651529344.402174:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000662594c3/0x3234de053c4ccbb lrc: 5/0,0 mode: PR/PR res: [0x2b389:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce4c5 expref: 1983 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.402190:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004534b316 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996944256:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.402194:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4fa5e lrc: 3/0,1 mode: --/PW res: [0x2b38b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.402207:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000be0ace91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996944192:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.402207:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11366 00000100:00100000:0.0:1651529344.402209:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1983:41279:x1731746396215168:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.402210:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4fa57 lrc: 3/0,1 mode: --/PW res: [0x2b388:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402213:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.402214:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eebe983a/0x3234de053c4e1d0 lrc: 4/0,0 mode: PR/PR res: [0x2b388:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3886 expref: 1983 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.402216:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11367 00000100:00100000:1.0:1651529344.402218:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1983:41278:x1731746396215232:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.402218:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eebe983a/0x3234de053c4e1d0 lrc: 3/0,0 mode: PR/PR res: [0x2b388:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3886 expref: 1983 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.402236:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.402238:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000662594c3/0x3234de053c4ccbb lrc: 5/0,0 mode: PR/PR res: [0x2b389:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce4c5 expref: 1983 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.402242:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000662594c3/0x3234de053c4ccbb lrc: 4/0,0 mode: PR/PR res: [0x2b389:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce4c5 expref: 1983 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.402248:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.402248:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.402249:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000039586f31/0x3234de053c4fa50 lrc: 3/0,1 mode: PW/PW res: [0x2b389:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.402252:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039586f31/0x3234de053c4fa50 lrc: 4/0,1 mode: PW/PW res: [0x2b389:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402255:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eebe983a/0x3234de053c4e1d0 lrc: 0/0,0 mode: --/PR res: [0x2b388:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3886 expref: 1983 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.402257:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.402259:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.402259:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.402260:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4fa57 lrc: 3/0,1 mode: PW/PW res: [0x2b388:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402263:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4fa57 lrc: 4/0,1 mode: PW/PW res: [0x2b388:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.402266:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1982:41278:x1731746396215232:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 47us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.402269:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11367 00010000:00010000:0.0:1651529344.402273:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.402281:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4fa57 lrc: 3/0,1 mode: PW/PW res: [0x2b388:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.402281:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1981:41279:x1731746396215168:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 71us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.402284:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11366 00010000:00010000:1.0:1651529344.402285:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4fa57 lrc: 3/0,1 mode: PW/PW res: [0x2b388:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.402288:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4fa57 lrc: 3/0,1 mode: PW/PW res: [0x2b388:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.402293:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4fa57 lrc: 2/0,0 mode: PW/PW res: [0x2b388:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.402295:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996944320:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.402299:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c4fa65 lrc: 3/0,1 mode: --/PW res: [0x2b38a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402312:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4fa57 lrc: 2/0,0 mode: PW/PW res: [0x2b388:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402314:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065c40e6a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.402316:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4fa57 lrc: 2/0,0 mode: PW/PW res: [0x2b388:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402318:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4fa57 lrc: 3/0,0 mode: PW/PW res: [0x2b388:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402323:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4fa57 lrc: 1/0,0 mode: --/PW res: [0x2b388:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402325:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4fa57 lrc: 0/0,0 mode: --/PW res: [0x2b388:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402335:0:80281:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000662594c3/0x3234de053c4ccbb lrc: 0/0,0 mode: --/PR res: [0x2b389:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce4c5 expref: 1980 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.402338:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+86:39030:x1731745946334080:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 671us (709us total) trans 12885078639 rc 0/0 00000100:00100000:0.0:1651529344.402338:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996944128:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.402341:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210585 00010000:00010000:0.0:1651529344.402341:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000039586f31/0x3234de053c4fa50 lrc: 3/0,1 mode: PW/PW res: [0x2b389:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402344:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000039586f31/0x3234de053c4fa50 lrc: 3/0,1 mode: PW/PW res: [0x2b389:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402347:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039586f31/0x3234de053c4fa50 lrc: 3/0,1 mode: PW/PW res: [0x2b389:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402350:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039586f31/0x3234de053c4fa50 lrc: 3/0,1 mode: PW/PW res: [0x2b389:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402352:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039586f31/0x3234de053c4fa50 lrc: 2/0,0 mode: PW/PW res: [0x2b389:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.402428:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+86:39029:x1731745946334144:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 763us (810us total) trans 12885078640 rc 0/0 00000100:00100000:0.0:1651529344.402431:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210584 00010000:00010000:0.0:1651529344.402438:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039586f31/0x3234de053c4fa50 lrc: 2/0,0 mode: PW/PW res: [0x2b389:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402441:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000039586f31 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.402442:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039586f31/0x3234de053c4fa50 lrc: 2/0,0 mode: PW/PW res: [0x2b389:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402445:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039586f31/0x3234de053c4fa50 lrc: 3/0,0 mode: PW/PW res: [0x2b389:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402449:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039586f31/0x3234de053c4fa50 lrc: 1/0,0 mode: --/PW res: [0x2b389:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402452:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039586f31/0x3234de053c4fa50 lrc: 0/0,0 mode: --/PW res: [0x2b389:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.402462:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996944384:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.402465:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bcdc8b9f/0x3234de053c4fa6c lrc: 3/0,1 mode: --/PW res: [0x2b38c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.402466:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.402476:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.402484:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996944512:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.402487:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.402496:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.402503:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.402506:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bd405bc5/0x3234de053c4fa7a lrc: 3/0,1 mode: --/PW res: [0x2b38d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.402508:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.402514:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396215296 00000100:00100000:1.0:1651529344.402516:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000055e03b4f pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996944576:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.402518:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c4e0bf lrc: 4/0,0 mode: PR/PR res: [0x2b38b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3369 expref: 1980 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.402520:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c4fa81 lrc: 3/0,1 mode: --/PW res: [0x2b38f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.402524:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396215360 00010000:00010000:0.0:1651529344.402526:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f3202904/0x3234de053c4b45e lrc: 4/0,0 mode: PR/PR res: [0x2b38a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc204 expref: 1981 pid: 72395 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.402527:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a573b31 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996944448:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.402530:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c4fa73 lrc: 3/0,1 mode: --/PW res: [0x2b38e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.402530:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396215424 00010000:00010000:0.0:1651529344.402532:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000773eb1ef/0x3234de053c4ed53 lrc: 4/0,0 mode: PR/PR res: [0x2b38c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6748 expref: 1982 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.402536:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396215552 00000100:00100000:0.0:1651529344.402536:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396215488 00010000:00010000:0.0:1651529344.402555:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000069e35989/0x3234de053c4a037 lrc: 4/0,0 mode: PR/PR res: [0x2b38e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb696 expref: 1984 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.402558:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c4c789 lrc: 4/0,0 mode: PR/PR res: [0x2b38d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd074 expref: 1984 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.402563:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396215616 00000100:00100000:1.0:1651529344.402565:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11368 00000100:00100000:1.0:1651529344.402567:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1985:41279:x1731746396215296:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.402567:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f8e23e2b/0x3234de053c4de50 lrc: 4/0,0 mode: PR/PR res: [0x2b38f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a08 expref: 1985 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.402570:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.402571:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c4e0bf lrc: 4/0,0 mode: PR/PR res: [0x2b38b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3369 expref: 1985 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.402572:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11369 00000100:00100000:0.0:1651529344.402573:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1985:41279:x1731746396215360:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.402575:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c4e0bf lrc: 3/0,0 mode: PR/PR res: [0x2b38b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3369 expref: 1985 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.402576:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.402578:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f3202904/0x3234de053c4b45e lrc: 4/0,0 mode: PR/PR res: [0x2b38a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc204 expref: 1985 pid: 72395 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.402581:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c4e0bf lrc: 0/0,0 mode: --/PR res: [0x2b38b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3369 expref: 1985 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.402581:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f3202904/0x3234de053c4b45e lrc: 3/0,0 mode: PR/PR res: [0x2b38a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc204 expref: 1985 pid: 72395 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.402584:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.402585:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.402586:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4fa5e lrc: 3/0,1 mode: PW/PW res: [0x2b38b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.402589:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4fa5e lrc: 4/0,1 mode: PW/PW res: [0x2b38b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.402595:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.402597:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3202904/0x3234de053c4b45e lrc: 0/0,0 mode: --/PR res: [0x2b38a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc204 expref: 1984 pid: 72395 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.402601:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1983:41279:x1731746396215296:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 34us (136us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.402601:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.402602:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.402602:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c4fa65 lrc: 3/0,1 mode: PW/PW res: [0x2b38a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.402604:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11368 00010000:00010000:0.0:1651529344.402605:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c4fa65 lrc: 4/0,1 mode: PW/PW res: [0x2b38a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.402609:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11370 00000100:00100000:1.0:1651529344.402610:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1982:41278:x1731746396215424:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.402612:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.402613:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.402614:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000773eb1ef/0x3234de053c4ed53 lrc: 4/0,0 mode: PR/PR res: [0x2b38c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6748 expref: 1982 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.402618:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000773eb1ef/0x3234de053c4ed53 lrc: 3/0,0 mode: PR/PR res: [0x2b38c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6748 expref: 1982 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.402620:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1982:41279:x1731746396215360:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 46us (144us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.402623:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000773eb1ef/0x3234de053c4ed53 lrc: 0/0,0 mode: --/PR res: [0x2b38c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6748 expref: 1982 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.402623:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11369 00010000:00010000:1.0:1651529344.402626:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.402626:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.402627:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bcdc8b9f/0x3234de053c4fa6c lrc: 3/0,1 mode: PW/PW res: [0x2b38c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.402628:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11371 00010000:00010000:1.0:1651529344.402630:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bcdc8b9f/0x3234de053c4fa6c lrc: 4/0,1 mode: PW/PW res: [0x2b38c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.402630:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1980:41279:x1731746396215488:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.402632:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.402634:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000069e35989/0x3234de053c4a037 lrc: 4/0,0 mode: PR/PR res: [0x2b38e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb696 expref: 1980 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.402640:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.402644:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000069e35989/0x3234de053c4a037 lrc: 3/0,0 mode: PR/PR res: [0x2b38e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb696 expref: 1980 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.402646:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1980:41278:x1731746396215424:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 35us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.402648:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11370 00010000:00010000:0.0:1651529344.402650:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069e35989/0x3234de053c4a037 lrc: 0/0,0 mode: --/PR res: [0x2b38e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb696 expref: 1980 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.402653:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11372 00010000:00010000:0.0:1651529344.402653:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.402654:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8f0043c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1978:41278:x1731746396215552:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.402654:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.402654:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c4fa73 lrc: 3/0,1 mode: PW/PW res: [0x2b38e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.402656:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.402657:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c4fa73 lrc: 4/0,1 mode: PW/PW res: [0x2b38e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.402658:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c4c789 lrc: 4/0,0 mode: PR/PR res: [0x2b38d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd074 expref: 1978 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.402661:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c4c789 lrc: 3/0,0 mode: PR/PR res: [0x2b38d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd074 expref: 1978 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.402666:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.402672:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1978:41279:x1731746396215488:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (169us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.402673:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c4c789 lrc: 0/0,0 mode: --/PR res: [0x2b38d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd074 expref: 1978 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.402675:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11371 00010000:00010000:1.0:1651529344.402676:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.402677:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.402678:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bd405bc5/0x3234de053c4fa7a lrc: 3/0,1 mode: PW/PW res: [0x2b38d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.402679:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11373 00010000:00010000:1.0:1651529344.402681:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd405bc5/0x3234de053c4fa7a lrc: 4/0,1 mode: PW/PW res: [0x2b38d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.402681:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1976:41279:x1731746396215616:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.402684:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.402685:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f8e23e2b/0x3234de053c4de50 lrc: 4/0,0 mode: PR/PR res: [0x2b38f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a08 expref: 1976 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.402689:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.402695:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8f0043c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1976:41278:x1731746396215552:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 40us (199us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.402695:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f8e23e2b/0x3234de053c4de50 lrc: 3/0,0 mode: PR/PR res: [0x2b38f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a08 expref: 1976 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.402698:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11372 00010000:00010000:0.0:1651529344.402700:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8e23e2b/0x3234de053c4de50 lrc: 0/0,0 mode: --/PR res: [0x2b38f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a08 expref: 1975 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.402704:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.402704:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.402705:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c4fa81 lrc: 3/0,1 mode: PW/PW res: [0x2b38f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.402708:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4fa5e lrc: 3/0,1 mode: PW/PW res: [0x2b38b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402708:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c4fa81 lrc: 4/0,1 mode: PW/PW res: [0x2b38f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.402711:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4fa5e lrc: 3/0,1 mode: PW/PW res: [0x2b38b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402716:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.402720:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4fa5e lrc: 3/0,1 mode: PW/PW res: [0x2b38b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.402723:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4fa5e lrc: 2/0,0 mode: PW/PW res: [0x2b38b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.402723:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1974:41279:x1731746396215616:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 41us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.402725:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11373 00010000:00010000:0.0:1651529344.402746:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c4fa65 lrc: 3/0,1 mode: PW/PW res: [0x2b38a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402750:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c4fa65 lrc: 3/0,1 mode: PW/PW res: [0x2b38a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402755:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c4fa65 lrc: 3/0,1 mode: PW/PW res: [0x2b38a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402758:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c4fa65 lrc: 2/0,0 mode: PW/PW res: [0x2b38a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.402776:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+86:39029:x1731745946334272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1042us (1139us total) trans 12885078641 rc 0/0 00000100:00100000:1.0:1651529344.402779:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210586 00010000:00010000:1.0:1651529344.402787:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c4fa81 lrc: 3/0,1 mode: PW/PW res: [0x2b38f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.402790:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c4fa81 lrc: 3/0,1 mode: PW/PW res: [0x2b38f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.402793:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c4fa81 lrc: 3/0,1 mode: PW/PW res: [0x2b38f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.402796:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c4fa81 lrc: 2/0,0 mode: PW/PW res: [0x2b38f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.402797:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+86:39030:x1731745946334208:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1041us (1152us total) trans 12885078642 rc 0/0 00000100:00100000:0.0:1651529344.402800:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210587 00010000:00010000:0.0:1651529344.402814:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4fa5e lrc: 2/0,0 mode: PW/PW res: [0x2b38b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402818:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000579ed558 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.402819:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4fa5e lrc: 2/0,0 mode: PW/PW res: [0x2b38b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402822:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4fa5e lrc: 3/0,0 mode: PW/PW res: [0x2b38b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402826:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4fa5e lrc: 1/0,0 mode: --/PW res: [0x2b38b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402829:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4fa5e lrc: 0/0,0 mode: --/PW res: [0x2b38b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.402833:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+86:39030:x1731745946334528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 897us (992us total) trans 12885078643 rc 0/0 00010000:00010000:0.0:1651529344.402833:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c4fa65 lrc: 2/0,0 mode: PW/PW res: [0x2b38a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.402836:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210591 00010000:00010000:0.0:1651529344.402836:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003865e83e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.402837:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c4fa65 lrc: 2/0,0 mode: PW/PW res: [0x2b38a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402840:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c4fa65 lrc: 3/0,0 mode: PW/PW res: [0x2b38a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.402842:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c4fa73 lrc: 3/0,1 mode: PW/PW res: [0x2b38e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402843:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c4fa65 lrc: 1/0,0 mode: --/PW res: [0x2b38a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.402845:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c4fa73 lrc: 3/0,1 mode: PW/PW res: [0x2b38e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402845:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c4fa65 lrc: 0/0,0 mode: --/PW res: [0x2b38a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.402848:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c4fa73 lrc: 3/0,1 mode: PW/PW res: [0x2b38e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402851:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c4fa81 lrc: 2/0,0 mode: PW/PW res: [0x2b38f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.402854:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c4fa73 lrc: 2/0,0 mode: PW/PW res: [0x2b38e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402854:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004f275b98 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.402854:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c4fa81 lrc: 2/0,0 mode: PW/PW res: [0x2b38f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402857:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c4fa81 lrc: 3/0,0 mode: PW/PW res: [0x2b38f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402860:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c4fa81 lrc: 1/0,0 mode: --/PW res: [0x2b38f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402863:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c4fa81 lrc: 0/0,0 mode: --/PW res: [0x2b38f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402867:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c4fa73 lrc: 2/0,0 mode: PW/PW res: [0x2b38e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402869:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d5eeb0cd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.402870:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c4fa73 lrc: 2/0,0 mode: PW/PW res: [0x2b38e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402872:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c4fa73 lrc: 3/0,0 mode: PW/PW res: [0x2b38e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402875:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c4fa73 lrc: 1/0,0 mode: --/PW res: [0x2b38e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402878:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c4fa73 lrc: 0/0,0 mode: --/PW res: [0x2b38e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.402883:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+86:39030:x1731745946334464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1002us (1074us total) trans 12885078644 rc 0/0 00000100:00100000:1.0:1651529344.402886:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210589 00010000:00010000:0.0:1651529344.402886:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bcdc8b9f/0x3234de053c4fa6c lrc: 3/0,1 mode: PW/PW res: [0x2b38c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402889:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bcdc8b9f/0x3234de053c4fa6c lrc: 3/0,1 mode: PW/PW res: [0x2b38c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402891:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bcdc8b9f/0x3234de053c4fa6c lrc: 3/0,1 mode: PW/PW res: [0x2b38c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402894:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bcdc8b9f/0x3234de053c4fa6c lrc: 2/0,0 mode: PW/PW res: [0x2b38c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.402920:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.402932:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+86:39030:x1731745946334336:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1089us (1135us total) trans 12885078645 rc 0/0 00000100:00100000:1.0:1651529344.402935:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.402935:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210588 00000100:00100000:0.0:1651529344.402940:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946334848 00000100:00100000:0.0:1651529344.402946:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946334912 00000100:00100000:0.0:1651529344.402955:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210592 00000100:00100000:0.0:1651529344.402957:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+87:39030:x1731745946334848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.402962:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177040 count 1 00010000:00010000:0.0:1651529344.402967:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087cc6968/0x3234de053c4fa88 lrc: 3/0,1 mode: --/PW res: [0x2b390:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402971:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000133f5138/0x3234de053c4d313 lrc: 2/0,0 mode: PR/PR res: [0x2b390:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe48 expref: 1973 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.402974:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.402975:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.402976:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087cc6968/0x3234de053c4fa88 lrc: 4/0,1 mode: --/PW res: [0x2b390:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.402982:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000133f5138/0x3234de053c4d313 lrc: 3/0,0 mode: PR/PR res: [0x2b390:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe48 expref: 1973 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.402986:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000133f5138/0x3234de053c4d313 lrc: 4/0,0 mode: PR/PR res: [0x2b390:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe48 expref: 1973 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.402990:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996944640:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.402999:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c8d20cf1 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.403004:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bcdc8b9f/0x3234de053c4fa6c lrc: 2/0,0 mode: PW/PW res: [0x2b38c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403007:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bcdc8b9f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.403008:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bcdc8b9f/0x3234de053c4fa6c lrc: 2/0,0 mode: PW/PW res: [0x2b38c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403011:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bcdc8b9f/0x3234de053c4fa6c lrc: 3/0,0 mode: PW/PW res: [0x2b38c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403015:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bcdc8b9f/0x3234de053c4fa6c lrc: 1/0,0 mode: --/PW res: [0x2b38c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403018:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bcdc8b9f/0x3234de053c4fa6c lrc: 0/0,0 mode: --/PW res: [0x2b38c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.403024:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210593 00000100:00100000:0.0:1651529344.403045:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+87:39030:x1731745946334912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.403050:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177041 count 1 00010000:00010000:0.0:1651529344.403054:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020b57374/0x3234de053c4fa8f lrc: 3/0,1 mode: --/PW res: [0x2b391:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403059:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000df32da76/0x3234de053c4e898 lrc: 2/0,0 mode: PR/PR res: [0x2b391:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5352 expref: 1973 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.403062:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.403063:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.403063:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020b57374/0x3234de053c4fa8f lrc: 4/0,1 mode: --/PW res: [0x2b391:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403070:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000df32da76/0x3234de053c4e898 lrc: 3/0,0 mode: PR/PR res: [0x2b391:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5352 expref: 1973 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.403073:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000df32da76/0x3234de053c4e898 lrc: 4/0,0 mode: PR/PR res: [0x2b391:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5352 expref: 1973 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.403077:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996944704:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.403091:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000382571b5 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.403096:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bd405bc5/0x3234de053c4fa7a lrc: 3/0,1 mode: PW/PW res: [0x2b38d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403100:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd405bc5/0x3234de053c4fa7a lrc: 3/0,1 mode: PW/PW res: [0x2b38d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403103:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd405bc5/0x3234de053c4fa7a lrc: 3/0,1 mode: PW/PW res: [0x2b38d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403105:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd405bc5/0x3234de053c4fa7a lrc: 2/0,0 mode: PW/PW res: [0x2b38d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.403137:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.403144:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.403150:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946335232 00000100:00100000:1.0:1651529344.403157:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946335296 00000100:00100000:1.0:1651529344.403168:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210594 00000100:00100000:1.0:1651529344.403170:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+90:39030:x1731745946335232:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.403170:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+90:39029:x1731745946334400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1276us (1350us total) trans 12885078646 rc 0/0 00000100:00100000:0.0:1651529344.403173:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210590 00002000:00080000:1.0:1651529344.403175:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177042 count 1 00010000:00010000:1.0:1651529344.403180:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c4fa96 lrc: 3/0,1 mode: --/PW res: [0x2b392:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.403185:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007a89dd07/0x3234de053c4d677 lrc: 2/0,0 mode: PR/PR res: [0x2b392:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b61 expref: 1973 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.403188:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.403189:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.403189:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c4fa96 lrc: 4/0,1 mode: --/PW res: [0x2b392:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.403199:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210595 00000100:00100000:0.0:1651529344.403201:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+89:39029:x1731745946335296:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.403202:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007a89dd07/0x3234de053c4d677 lrc: 3/0,0 mode: PR/PR res: [0x2b392:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b61 expref: 1973 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.403206:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007a89dd07/0x3234de053c4d677 lrc: 4/0,0 mode: PR/PR res: [0x2b392:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b61 expref: 1973 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.403210:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000023afca5e pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996944768:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.403215:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177043 count 1 00000100:00100000:1.0:1651529344.403219:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000567ee0ef going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.403220:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4fa9d lrc: 3/0,1 mode: --/PW res: [0x2b393:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403259:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c4db9b lrc: 2/0,0 mode: PR/PR res: [0x2b393:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e7e expref: 1973 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.403263:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.403263:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.403264:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4fa9d lrc: 4/0,1 mode: --/PW res: [0x2b393:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.403267:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.403271:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c4db9b lrc: 3/0,0 mode: PR/PR res: [0x2b393:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e7e expref: 1973 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.403275:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c4db9b lrc: 4/0,0 mode: PR/PR res: [0x2b393:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e7e expref: 1973 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.403279:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996944832:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.403288:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ff7757ae going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.403295:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd405bc5/0x3234de053c4fa7a lrc: 2/0,0 mode: PW/PW res: [0x2b38d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403298:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bd405bc5 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.403312:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.403318:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd405bc5/0x3234de053c4fa7a lrc: 2/0,0 mode: PW/PW res: [0x2b38d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403324:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd405bc5/0x3234de053c4fa7a lrc: 3/0,0 mode: PW/PW res: [0x2b38d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403328:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd405bc5/0x3234de053c4fa7a lrc: 1/0,0 mode: --/PW res: [0x2b38d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403331:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd405bc5/0x3234de053c4fa7a lrc: 0/0,0 mode: --/PW res: [0x2b38d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.403347:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996944640:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.403349:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.403351:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000087cc6968/0x3234de053c4fa88 lrc: 3/0,1 mode: --/PW res: [0x2b390:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.403357:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.403358:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996944704:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.403366:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.403366:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000020b57374/0x3234de053c4fa8f lrc: 3/0,1 mode: --/PW res: [0x2b391:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.403375:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946335360 00000100:00100000:0.0:1651529344.403377:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396215936 00000100:00100000:1.0:1651529344.403381:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946335424 00010000:00010000:0.0:1651529344.403382:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000133f5138/0x3234de053c4d313 lrc: 4/0,0 mode: PR/PR res: [0x2b390:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe48 expref: 1974 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.403384:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946335488 00000100:00100000:1.0:1651529344.403388:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210596 00000100:00100000:0.0:1651529344.403388:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396216000 00000100:00100000:1.0:1651529344.403390:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+92:39030:x1731745946335360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.403395:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177044 count 1 00010000:00010000:1.0:1651529344.403399:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c4faa4 lrc: 3/0,1 mode: --/PW res: [0x2b394:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.403404:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e52c3e68/0x3234de053c4cbb1 lrc: 2/0,0 mode: PR/PR res: [0x2b394:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce096 expref: 1975 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.403409:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000df32da76/0x3234de053c4e898 lrc: 4/0,0 mode: PR/PR res: [0x2b391:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5352 expref: 1975 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.403413:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.403414:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.403418:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11374 00010000:00010000:1.0:1651529344.403419:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c4faa4 lrc: 4/0,1 mode: --/PW res: [0x2b394:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.403420:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1975:41278:x1731746396215936:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.403423:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.403425:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000133f5138/0x3234de053c4d313 lrc: 4/0,0 mode: PR/PR res: [0x2b390:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe48 expref: 1975 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.403428:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000133f5138/0x3234de053c4d313 lrc: 3/0,0 mode: PR/PR res: [0x2b390:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe48 expref: 1975 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.403429:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e52c3e68/0x3234de053c4cbb1 lrc: 3/0,0 mode: PR/PR res: [0x2b394:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce096 expref: 1975 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.403433:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e52c3e68/0x3234de053c4cbb1 lrc: 4/0,0 mode: PR/PR res: [0x2b394:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce096 expref: 1975 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.403434:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000133f5138/0x3234de053c4d313 lrc: 0/0,0 mode: --/PR res: [0x2b390:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe48 expref: 1975 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.403437:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000be0ace91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996944896:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.403437:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.403438:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.403439:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000087cc6968/0x3234de053c4fa88 lrc: 3/0,1 mode: PW/PW res: [0x2b390:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403442:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087cc6968/0x3234de053c4fa88 lrc: 4/0,1 mode: PW/PW res: [0x2b390:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.403445:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d09f5ee1 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.403448:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.403451:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210597 00000100:00100000:1.0:1651529344.403453:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+92:39029:x1731745946335424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.403456:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1974:41278:x1731746396215936:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 35us (99us total) trans 0 rc 0/0 00002000:00080000:1.0:1651529344.403457:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177045 count 1 00000100:00100000:0.0:1651529344.403458:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11374 00010000:00010000:1.0:1651529344.403460:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c4faab lrc: 3/0,1 mode: --/PW res: [0x2b395:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.403462:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11375 00000100:00100000:0.0:1651529344.403464:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1973:41278:x1731746396216000:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.403465:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba8f87a2/0x3234de053c4e3ac lrc: 2/0,0 mode: PR/PR res: [0x2b395:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3fc5 expref: 1973 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.403466:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.403468:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.403468:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.403468:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000df32da76/0x3234de053c4e898 lrc: 4/0,0 mode: PR/PR res: [0x2b391:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5352 expref: 1973 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.403469:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c4faab lrc: 4/0,1 mode: --/PW res: [0x2b395:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403472:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000df32da76/0x3234de053c4e898 lrc: 3/0,0 mode: PR/PR res: [0x2b391:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5352 expref: 1973 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.403474:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ba8f87a2/0x3234de053c4e3ac lrc: 3/0,0 mode: PR/PR res: [0x2b395:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3fc5 expref: 1973 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.403476:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df32da76/0x3234de053c4e898 lrc: 0/0,0 mode: --/PR res: [0x2b391:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5352 expref: 1973 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.403478:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ba8f87a2/0x3234de053c4e3ac lrc: 4/0,0 mode: PR/PR res: [0x2b395:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3fc5 expref: 1973 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.403479:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.403480:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.403480:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000020b57374/0x3234de053c4fa8f lrc: 3/0,1 mode: PW/PW res: [0x2b391:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.403482:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004534b316 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996944960:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.403483:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020b57374/0x3234de053c4fa8f lrc: 4/0,1 mode: PW/PW res: [0x2b391:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.403488:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 000000007e004c12 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.403489:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.403493:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210598 00000100:00100000:0.0:1651529344.403494:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1972:41278:x1731746396216000:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 29us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.403495:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+92:39030:x1731745946335488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.403496:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11375 00002000:00080000:1.0:1651529344.403499:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177046 count 1 00010000:00010000:0.0:1651529344.403501:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000020b57374/0x3234de053c4fa8f lrc: 3/0,1 mode: PW/PW res: [0x2b391:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.403502:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c4fab2 lrc: 3/0,1 mode: --/PW res: [0x2b396:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403504:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020b57374/0x3234de053c4fa8f lrc: 3/0,1 mode: PW/PW res: [0x2b391:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.403506:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002537ce87/0x3234de053c4f2e7 lrc: 2/0,0 mode: PR/PR res: [0x2b396:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e71 expref: 1971 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.403507:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020b57374/0x3234de053c4fa8f lrc: 3/0,1 mode: PW/PW res: [0x2b391:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.403509:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.403509:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.403510:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c4fab2 lrc: 4/0,1 mode: --/PW res: [0x2b396:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403512:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000020b57374/0x3234de053c4fa8f lrc: 2/0,0 mode: PW/PW res: [0x2b391:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.403516:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002537ce87/0x3234de053c4f2e7 lrc: 3/0,0 mode: PR/PR res: [0x2b396:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e71 expref: 1971 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.403519:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002537ce87/0x3234de053c4f2e7 lrc: 4/0,0 mode: PR/PR res: [0x2b396:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e71 expref: 1971 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.403523:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003de40890 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996945024:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.403529:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f9dac3f6 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.403544:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.403550:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+93:39030:x1731745946334912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 505us (614us total) trans 12885078647 rc 0/0 00000100:00100000:0.0:1651529344.403553:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210593 00000100:00100000:0.0:1651529344.403557:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946335552 00000100:00100000:0.0:1651529344.403567:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210599 00000100:00100000:0.0:1651529344.403568:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+93:39030:x1731745946335552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.403573:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177047 count 1 00010000:00010000:0.0:1651529344.403577:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4fab9 lrc: 3/0,1 mode: --/PW res: [0x2b397:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403582:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000069f47d6/0x3234de053c4c74a lrc: 2/0,0 mode: PR/PR res: [0x2b397:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf78 expref: 1971 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.403585:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.403586:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.403586:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4fab9 lrc: 4/0,1 mode: --/PW res: [0x2b397:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403593:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000069f47d6/0x3234de053c4c74a lrc: 3/0,0 mode: PR/PR res: [0x2b397:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf78 expref: 1971 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.403596:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000069f47d6/0x3234de053c4c74a lrc: 4/0,0 mode: PR/PR res: [0x2b397:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf78 expref: 1971 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.403626:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996945088:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.403635:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c8d20cf1 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.403641:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000020b57374/0x3234de053c4fa8f lrc: 2/0,0 mode: PW/PW res: [0x2b391:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403644:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000020b57374 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.403655:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000020b57374/0x3234de053c4fa8f lrc: 2/0,0 mode: PW/PW res: [0x2b391:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403659:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000020b57374/0x3234de053c4fa8f lrc: 3/0,0 mode: PW/PW res: [0x2b391:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403663:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000020b57374/0x3234de053c4fa8f lrc: 1/0,0 mode: --/PW res: [0x2b391:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403666:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020b57374/0x3234de053c4fa8f lrc: 0/0,0 mode: --/PW res: [0x2b391:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.403680:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.403681:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000087cc6968/0x3234de053c4fa88 lrc: 3/0,1 mode: PW/PW res: [0x2b390:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403689:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087cc6968/0x3234de053c4fa88 lrc: 3/0,1 mode: PW/PW res: [0x2b390:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.403690:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.403692:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087cc6968/0x3234de053c4fa88 lrc: 3/0,1 mode: PW/PW res: [0x2b390:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.403701:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000023afca5e pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996944768:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.403701:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087cc6968/0x3234de053c4fa88 lrc: 2/0,0 mode: PW/PW res: [0x2b390:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.403706:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c4fa96 lrc: 3/0,1 mode: --/PW res: [0x2b392:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.403742:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.403750:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946335616 00000100:00100000:1.0:1651529344.403757:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210600 00000100:00100000:1.0:1651529344.403758:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+95:39030:x1731745946335616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.403763:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177048 count 1 00000100:00100000:0.0:1651529344.403769:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+95:39030:x1731745946334848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 811us (849us total) trans 12885078648 rc 0/0 00010000:00010000:1.0:1651529344.403773:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c4fac0 lrc: 3/0,1 mode: --/PW res: [0x2b398:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.403773:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210592 00010000:00010000:1.0:1651529344.403778:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007c7e55f5/0x3234de053c4d8e6 lrc: 2/0,0 mode: PR/PR res: [0x2b398:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d148a expref: 1971 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.403780:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087cc6968/0x3234de053c4fa88 lrc: 2/0,0 mode: PW/PW res: [0x2b390:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.403781:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.403782:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.403782:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c4fac0 lrc: 4/0,1 mode: --/PW res: [0x2b398:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403784:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000087cc6968 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.403785:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087cc6968/0x3234de053c4fa88 lrc: 2/0,0 mode: PW/PW res: [0x2b390:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403788:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087cc6968/0x3234de053c4fa88 lrc: 3/0,0 mode: PW/PW res: [0x2b390:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.403789:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007c7e55f5/0x3234de053c4d8e6 lrc: 3/0,0 mode: PR/PR res: [0x2b398:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d148a expref: 1971 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.403792:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007c7e55f5/0x3234de053c4d8e6 lrc: 4/0,0 mode: PR/PR res: [0x2b398:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d148a expref: 1971 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.403792:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087cc6968/0x3234de053c4fa88 lrc: 1/0,0 mode: --/PW res: [0x2b390:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403795:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087cc6968/0x3234de053c4fa88 lrc: 0/0,0 mode: --/PW res: [0x2b390:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.403799:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000023afca5e pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996945152:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.403802:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396216256 00010000:00010000:0.0:1651529344.403806:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007a89dd07/0x3234de053c4d677 lrc: 4/0,0 mode: PR/PR res: [0x2b392:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b61 expref: 1972 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.403810:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fe434b1c going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.403817:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396216384 00010000:00010000:0.0:1651529344.403820:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c4db9b lrc: 5/0,0 mode: PR/PR res: [0x2b393:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e7e expref: 1973 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.403826:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11376 00000100:00100000:0.0:1651529344.403828:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1973:41279:x1731746396216256:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.403831:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.403832:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007a89dd07/0x3234de053c4d677 lrc: 4/0,0 mode: PR/PR res: [0x2b392:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b61 expref: 1973 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.403835:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007a89dd07/0x3234de053c4d677 lrc: 3/0,0 mode: PR/PR res: [0x2b392:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b61 expref: 1973 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.403840:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a89dd07/0x3234de053c4d677 lrc: 0/0,0 mode: --/PR res: [0x2b392:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b61 expref: 1973 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.403844:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.403844:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.403845:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c4fa96 lrc: 3/0,1 mode: PW/PW res: [0x2b392:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403848:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c4fa96 lrc: 4/0,1 mode: PW/PW res: [0x2b392:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403856:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.403868:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c4fa96 lrc: 3/0,1 mode: PW/PW res: [0x2b392:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.403872:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c4fa96 lrc: 3/0,1 mode: PW/PW res: [0x2b392:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.403875:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c4fa96 lrc: 3/0,1 mode: PW/PW res: [0x2b392:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.403882:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c4fa96 lrc: 2/0,0 mode: PW/PW res: [0x2b392:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.403896:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1972:41279:x1731746396216256:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 61us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.403910:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11376 00000100:00100000:0.0:1651529344.403915:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11377 00000100:00100000:0.0:1651529344.403916:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1971:41279:x1731746396216384:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.403919:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.403921:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c4db9b lrc: 5/0,0 mode: PR/PR res: [0x2b393:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e7e expref: 1971 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.403925:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c4db9b lrc: 4/0,0 mode: PR/PR res: [0x2b393:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e7e expref: 1971 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.403927:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+95:39030:x1731745946335232:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 756us (791us total) trans 12885078649 rc 0/0 00010000:00010000:0.0:1651529344.403930:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.403931:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210594 00010000:00010000:0.0:1651529344.403931:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.403931:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4fa9d lrc: 3/0,1 mode: PW/PW res: [0x2b393:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403935:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4fa9d lrc: 4/0,1 mode: PW/PW res: [0x2b393:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403939:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.403959:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1971:41279:x1731746396216384:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 29us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.403962:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11377 00010000:00010000:0.0:1651529344.403969:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c4fa96 lrc: 2/0,0 mode: PW/PW res: [0x2b392:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403973:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dd394f60 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.403974:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c4fa96 lrc: 2/0,0 mode: PW/PW res: [0x2b392:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403977:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c4fa96 lrc: 3/0,0 mode: PW/PW res: [0x2b392:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.403978:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.403981:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c4fa96 lrc: 1/0,0 mode: --/PW res: [0x2b392:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.403984:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c4fa96 lrc: 0/0,0 mode: --/PW res: [0x2b392:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.403992:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946335936 00000100:00100000:0.0:1651529344.404030:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210601 00000100:00100000:0.0:1651529344.404032:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+95:39030:x1731745946335936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.404052:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177049 count 1 00010000:00010000:0.0:1651529344.404056:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4fac7 lrc: 3/0,1 mode: --/PW res: [0x2b399:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404061:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000315faada/0x3234de053c4d0ab lrc: 2/0,0 mode: PR/PR res: [0x2b399:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf462 expref: 1970 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.404063:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.404064:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.404065:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.404065:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4fac7 lrc: 4/0,1 mode: --/PW res: [0x2b399:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.404073:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.404081:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.404083:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000315faada/0x3234de053c4d0ab lrc: 3/0,0 mode: PR/PR res: [0x2b399:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf462 expref: 1970 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.404099:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.404107:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000315faada/0x3234de053c4d0ab lrc: 4/0,0 mode: PR/PR res: [0x2b399:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf462 expref: 1970 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.404109:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.404118:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003de40890 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996945024:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.404127:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996945216:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.404128:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c4fab2 lrc: 3/0,1 mode: --/PW res: [0x2b396:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.404136:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004534b316 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996944960:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.404137:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a52ee82 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.404138:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c4faab lrc: 3/0,1 mode: --/PW res: [0x2b395:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.404145:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000be0ace91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996944896:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.404146:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996945088:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.404148:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c4faa4 lrc: 3/0,1 mode: --/PW res: [0x2b394:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404150:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4fab9 lrc: 3/0,1 mode: --/PW res: [0x2b397:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.404154:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396216448 00000100:00100000:0.0:1651529344.404156:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396216512 00010000:00010000:1.0:1651529344.404159:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e52c3e68/0x3234de053c4cbb1 lrc: 4/0,0 mode: PR/PR res: [0x2b394:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce096 expref: 1972 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.404161:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ba8f87a2/0x3234de053c4e3ac lrc: 4/0,0 mode: PR/PR res: [0x2b395:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3fc5 expref: 1972 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.404164:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396216576 00000100:00100000:0.0:1651529344.404166:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396216640 00010000:00010000:1.0:1651529344.404167:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002537ce87/0x3234de053c4f2e7 lrc: 4/0,0 mode: PR/PR res: [0x2b396:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e71 expref: 1974 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.404169:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000069f47d6/0x3234de053c4c74a lrc: 4/0,0 mode: PR/PR res: [0x2b397:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf78 expref: 1974 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.404171:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396216704 00010000:00010000:1.0:1651529344.404174:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007c7e55f5/0x3234de053c4d8e6 lrc: 5/0,0 mode: PR/PR res: [0x2b398:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d148a expref: 1975 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.404174:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11378 00000100:00100000:0.0:1651529344.404175:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000496e37f3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1975:41279:x1731746396216448:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.404178:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.404179:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11379 00010000:00010000:0.0:1651529344.404179:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e52c3e68/0x3234de053c4cbb1 lrc: 4/0,0 mode: PR/PR res: [0x2b394:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce096 expref: 1975 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.404181:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1975:41278:x1731746396216512:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.404183:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.404183:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e52c3e68/0x3234de053c4cbb1 lrc: 3/0,0 mode: PR/PR res: [0x2b394:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce096 expref: 1975 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.404185:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ba8f87a2/0x3234de053c4e3ac lrc: 4/0,0 mode: PR/PR res: [0x2b395:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3fc5 expref: 1975 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.404189:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ba8f87a2/0x3234de053c4e3ac lrc: 3/0,0 mode: PR/PR res: [0x2b395:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3fc5 expref: 1975 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.404189:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e52c3e68/0x3234de053c4cbb1 lrc: 0/0,0 mode: --/PR res: [0x2b394:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce096 expref: 1975 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.404192:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.404193:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.404194:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba8f87a2/0x3234de053c4e3ac lrc: 0/0,0 mode: --/PR res: [0x2b395:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3fc5 expref: 1974 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.404194:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c4faa4 lrc: 3/0,1 mode: PW/PW res: [0x2b394:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404197:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c4faa4 lrc: 4/0,1 mode: PW/PW res: [0x2b394:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.404198:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.404199:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.404199:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c4faab lrc: 3/0,1 mode: PW/PW res: [0x2b395:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.404203:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c4faab lrc: 4/0,1 mode: PW/PW res: [0x2b395:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404206:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.404212:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000496e37f3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1973:41279:x1731746396216448:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 37us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.404215:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11378 00010000:00010000:1.0:1651529344.404216:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.404242:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1972:41278:x1731746396216512:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 61us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.404245:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11379 00000100:00100000:0.0:1651529344.404248:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11380 00000100:00100000:0.0:1651529344.404250:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1971:41278:x1731746396216576:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.404251:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11381 00000100:00100000:1.0:1651529344.404252:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1971:41279:x1731746396216640:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.404253:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.404254:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002537ce87/0x3234de053c4f2e7 lrc: 4/0,0 mode: PR/PR res: [0x2b396:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e71 expref: 1971 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.404255:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.404257:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000069f47d6/0x3234de053c4c74a lrc: 4/0,0 mode: PR/PR res: [0x2b397:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf78 expref: 1971 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.404258:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002537ce87/0x3234de053c4f2e7 lrc: 3/0,0 mode: PR/PR res: [0x2b396:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e71 expref: 1971 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.404261:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000069f47d6/0x3234de053c4c74a lrc: 3/0,0 mode: PR/PR res: [0x2b397:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf78 expref: 1971 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.404263:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002537ce87/0x3234de053c4f2e7 lrc: 0/0,0 mode: --/PR res: [0x2b396:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e71 expref: 1971 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.404266:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000069f47d6/0x3234de053c4c74a lrc: 0/0,0 mode: --/PR res: [0x2b397:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf78 expref: 1971 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.404269:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.404270:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.404270:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.404270:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.404270:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c4fab2 lrc: 3/0,1 mode: PW/PW res: [0x2b396:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.404271:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4fab9 lrc: 3/0,1 mode: PW/PW res: [0x2b397:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404273:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c4fab2 lrc: 4/0,1 mode: PW/PW res: [0x2b396:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.404274:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4fab9 lrc: 4/0,1 mode: PW/PW res: [0x2b397:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404287:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.404288:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.404294:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1969:41278:x1731746396216576:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 44us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.404296:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1969:41279:x1731746396216640:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.404297:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11380 00000100:00100000:1.0:1651529344.404299:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11381 00000100:00100000:0.0:1651529344.404302:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11382 00000100:00100000:0.0:1651529344.404304:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1967:41278:x1731746396216704:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.404306:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.404307:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c4faab lrc: 3/0,1 mode: PW/PW res: [0x2b395:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404308:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007c7e55f5/0x3234de053c4d8e6 lrc: 5/0,0 mode: PR/PR res: [0x2b398:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d148a expref: 1967 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.404310:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c4faab lrc: 3/0,1 mode: PW/PW res: [0x2b395:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404311:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007c7e55f5/0x3234de053c4d8e6 lrc: 4/0,0 mode: PR/PR res: [0x2b398:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d148a expref: 1967 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.404313:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c4faab lrc: 3/0,1 mode: PW/PW res: [0x2b395:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.404316:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c4faab lrc: 2/0,0 mode: PW/PW res: [0x2b395:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404316:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.404317:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.404317:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c4fac0 lrc: 3/0,1 mode: PW/PW res: [0x2b398:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404323:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c4fac0 lrc: 4/0,1 mode: PW/PW res: [0x2b398:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404334:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.404339:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1967:41278:x1731746396216704:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 35us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.404342:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11382 00010000:00010000:0.0:1651529344.404349:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c4faab lrc: 2/0,0 mode: PW/PW res: [0x2b395:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404352:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6eb3f34 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.404353:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c4faab lrc: 2/0,0 mode: PW/PW res: [0x2b395:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404355:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c4faab lrc: 3/0,0 mode: PW/PW res: [0x2b395:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404359:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c4faab lrc: 1/0,0 mode: --/PW res: [0x2b395:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.404361:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+96:39029:x1731745946335424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 908us (1049us total) trans 12885078650 rc 0/0 00010000:00010000:0.0:1651529344.404362:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c4faab lrc: 0/0,0 mode: --/PW res: [0x2b395:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.404364:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210597 00010000:00010000:0.0:1651529344.404367:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4fab9 lrc: 3/0,1 mode: PW/PW res: [0x2b397:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404370:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4fab9 lrc: 3/0,1 mode: PW/PW res: [0x2b397:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.404371:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c4fab2 lrc: 3/0,1 mode: PW/PW res: [0x2b396:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404373:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4fab9 lrc: 3/0,1 mode: PW/PW res: [0x2b397:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.404375:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c4fab2 lrc: 3/0,1 mode: PW/PW res: [0x2b396:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404376:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4fab9 lrc: 2/0,0 mode: PW/PW res: [0x2b397:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.404378:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c4fab2 lrc: 3/0,1 mode: PW/PW res: [0x2b396:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.404380:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c4fab2 lrc: 2/0,0 mode: PW/PW res: [0x2b396:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.404417:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+97:39030:x1731745946335488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 921us (1068us total) trans 12885078651 rc 0/0 00000100:00100000:1.0:1651529344.404420:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210598 00000100:00100000:0.0:1651529344.404425:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+96:39030:x1731745946335552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 856us (881us total) trans 12885078652 rc 0/0 00010000:00010000:1.0:1651529344.404427:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c4faa4 lrc: 3/0,1 mode: PW/PW res: [0x2b394:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.404428:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210599 00010000:00010000:1.0:1651529344.404430:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c4faa4 lrc: 3/0,1 mode: PW/PW res: [0x2b394:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.404433:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c4faa4 lrc: 3/0,1 mode: PW/PW res: [0x2b394:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404436:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4fab9 lrc: 2/0,0 mode: PW/PW res: [0x2b397:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.404438:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c4faa4 lrc: 2/0,0 mode: PW/PW res: [0x2b394:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404439:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e35b0bde already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.404440:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4fab9 lrc: 2/0,0 mode: PW/PW res: [0x2b397:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404442:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4fab9 lrc: 3/0,0 mode: PW/PW res: [0x2b397:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404454:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4fab9 lrc: 1/0,0 mode: --/PW res: [0x2b397:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404457:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4fab9 lrc: 0/0,0 mode: --/PW res: [0x2b397:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404461:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c4fab2 lrc: 2/0,0 mode: PW/PW res: [0x2b396:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404464:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bfb594be already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.404465:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c4fab2 lrc: 2/0,0 mode: PW/PW res: [0x2b396:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404468:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c4fab2 lrc: 3/0,0 mode: PW/PW res: [0x2b396:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404471:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c4fab2 lrc: 1/0,0 mode: --/PW res: [0x2b396:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404474:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c4fab2 lrc: 0/0,0 mode: --/PW res: [0x2b396:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.404476:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+96:39030:x1731745946335360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1085us (1209us total) trans 12885078653 rc 0/0 00010000:00010000:0.0:1651529344.404477:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c4faa4 lrc: 2/0,0 mode: PW/PW res: [0x2b394:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.404479:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210596 00010000:00010000:0.0:1651529344.404479:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b2d06199 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.404480:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c4faa4 lrc: 2/0,0 mode: PW/PW res: [0x2b394:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404483:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c4faa4 lrc: 3/0,0 mode: PW/PW res: [0x2b394:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404486:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c4faa4 lrc: 1/0,0 mode: --/PW res: [0x2b394:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.404489:0:80279:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c7e55f5/0x3234de053c4d8e6 lrc: 0/0,0 mode: --/PR res: [0x2b398:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d148a expref: 1966 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.404489:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c4faa4 lrc: 0/0,0 mode: --/PW res: [0x2b394:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.404493:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000023afca5e pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996945152:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.404497:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c4fac0 lrc: 3/0,1 mode: PW/PW res: [0x2b398:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.404500:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c4fac0 lrc: 3/0,1 mode: PW/PW res: [0x2b398:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404501:0:80280:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c4db9b lrc: 0/0,0 mode: --/PR res: [0x2b393:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e7e expref: 1965 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.404502:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c4fac0 lrc: 3/0,1 mode: PW/PW res: [0x2b398:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.404505:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c4fac0 lrc: 3/0,1 mode: PW/PW res: [0x2b398:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.404505:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996944832:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.404508:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c4fac0 lrc: 2/0,0 mode: PW/PW res: [0x2b398:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404508:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4fa9d lrc: 3/0,1 mode: PW/PW res: [0x2b393:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404511:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4fa9d lrc: 3/0,1 mode: PW/PW res: [0x2b393:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404514:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4fa9d lrc: 3/0,1 mode: PW/PW res: [0x2b393:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404523:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4fa9d lrc: 3/0,1 mode: PW/PW res: [0x2b393:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404526:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4fa9d lrc: 2/0,0 mode: PW/PW res: [0x2b393:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.404546:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+97:39030:x1731745946335616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 787us (812us total) trans 12885078654 rc 0/0 00000100:00100000:1.0:1651529344.404549:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210600 00000100:00100000:1.0:1651529344.404565:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.404565:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+96:39029:x1731745946335296:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1363us (1420us total) trans 12885078655 rc 0/0 00000100:00100000:0.0:1651529344.404568:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210595 00000100:00100000:0.0:1651529344.404573:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946336128 00000100:00100000:0.0:1651529344.404584:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210602 00000100:00100000:0.0:1651529344.404586:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+96:39030:x1731745946336128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.404592:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177050 count 1 00010000:00010000:0.0:1651529344.404596:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4face lrc: 3/0,1 mode: --/PW res: [0x2b39a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404601:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000046cb20e/0x3234de053c4dbfd lrc: 2/0,0 mode: PR/PR res: [0x2b39a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2014 expref: 1964 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.404604:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.404604:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.404605:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4face lrc: 4/0,1 mode: --/PW res: [0x2b39a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404611:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000046cb20e/0x3234de053c4dbfd lrc: 3/0,0 mode: PR/PR res: [0x2b39a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2014 expref: 1964 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.404615:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000046cb20e/0x3234de053c4dbfd lrc: 4/0,0 mode: PR/PR res: [0x2b39a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2014 expref: 1964 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.404619:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996945280:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.404627:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b032d2f9 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.404632:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c4fac0 lrc: 2/0,0 mode: PW/PW res: [0x2b398:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404636:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c8d9712a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.404636:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c4fac0 lrc: 2/0,0 mode: PW/PW res: [0x2b398:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404639:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c4fac0 lrc: 3/0,0 mode: PW/PW res: [0x2b398:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404644:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c4fac0 lrc: 1/0,0 mode: --/PW res: [0x2b398:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404647:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c4fac0 lrc: 0/0,0 mode: --/PW res: [0x2b398:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404651:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4fa9d lrc: 2/0,0 mode: PW/PW res: [0x2b393:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404653:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003c5315da already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.404654:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4fa9d lrc: 2/0,0 mode: PW/PW res: [0x2b393:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404657:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4fa9d lrc: 3/0,0 mode: PW/PW res: [0x2b393:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404660:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4fa9d lrc: 1/0,0 mode: --/PW res: [0x2b393:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404663:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4fa9d lrc: 0/0,0 mode: --/PW res: [0x2b393:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.404857:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.404882:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.404887:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996945216:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.404890:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.404892:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4fac7 lrc: 3/0,1 mode: --/PW res: [0x2b399:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.404898:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.404906:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.404907:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946336320 00000100:00100000:1.0:1651529344.404913:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.404922:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946336448 00000100:00100000:0.0:1651529344.404926:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946336384 00000100:00100000:1.0:1651529344.404928:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946336576 00000100:00100000:0.0:1651529344.404931:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946336512 00000100:00100000:0.0:1651529344.404935:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946336640 00000100:00100000:0.0:1651529344.404939:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210603 00000100:00100000:1.0:1651529344.404941:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210604 00000100:00100000:0.0:1651529344.404941:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085af61db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+102:39029:x1731745946336320:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.404943:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+102:39029:x1731745946336448:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.404945:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177051 count 1 00002000:00080000:1.0:1651529344.404948:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177053 count 1 00010000:00010000:0.0:1651529344.404949:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4fad5 lrc: 3/0,1 mode: --/PW res: [0x2b39b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.404953:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4fadc lrc: 3/0,1 mode: --/PW res: [0x2b39d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404953:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef2c2c65/0x3234de053c4caa0 lrc: 2/0,0 mode: PR/PR res: [0x2b39b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc44 expref: 1964 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.404956:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.404957:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.404958:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c4d582 lrc: 2/0,0 mode: PR/PR res: [0x2b39d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d079b expref: 1964 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.404958:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4fad5 lrc: 4/0,1 mode: --/PW res: [0x2b39b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.404961:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.404961:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.404962:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4fadc lrc: 4/0,1 mode: --/PW res: [0x2b39d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.404964:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ef2c2c65/0x3234de053c4caa0 lrc: 3/0,0 mode: PR/PR res: [0x2b39b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc44 expref: 1964 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.404968:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ef2c2c65/0x3234de053c4caa0 lrc: 4/0,0 mode: PR/PR res: [0x2b39b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc44 expref: 1964 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.404969:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c4d582 lrc: 3/0,0 mode: PR/PR res: [0x2b39d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d079b expref: 1964 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.404972:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996945344:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.404973:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c4d582 lrc: 4/0,0 mode: PR/PR res: [0x2b39d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d079b expref: 1964 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.404977:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000064719963 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996945408:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.404985:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000007b78c9d8 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.404992:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210605 00000100:00100000:1.0:1651529344.404994:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fe434b1c going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.404994:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+102:39030:x1731745946336384:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.404998:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177052 count 1 00000100:00100000:1.0:1651529344.405000:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210606 00000100:00100000:1.0:1651529344.405002:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e8ce7f0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+102:39030:x1731745946336512:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.405002:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c4fae3 lrc: 3/0,1 mode: --/PW res: [0x2b39c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.405006:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177054 count 1 00010000:00010000:0.0:1651529344.405006:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000025b3903e/0x3234de053c4d3ec lrc: 2/0,0 mode: PR/PR res: [0x2b39c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0190 expref: 1964 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.405009:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.405010:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4faea lrc: 3/0,1 mode: --/PW res: [0x2b39e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405010:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.405010:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c4fae3 lrc: 4/0,1 mode: --/PW res: [0x2b39c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.405015:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004e049160/0x3234de053c4d36e lrc: 2/0,0 mode: PR/PR res: [0x2b39e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cffad expref: 1964 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.405016:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000025b3903e/0x3234de053c4d3ec lrc: 3/0,0 mode: PR/PR res: [0x2b39c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0190 expref: 1964 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.405017:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.405018:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.405019:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4faea lrc: 4/0,1 mode: --/PW res: [0x2b39e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405019:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000025b3903e/0x3234de053c4d3ec lrc: 4/0,0 mode: PR/PR res: [0x2b39c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0190 expref: 1964 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.405023:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996945472:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.405025:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004e049160/0x3234de053c4d36e lrc: 3/0,0 mode: PR/PR res: [0x2b39e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cffad expref: 1964 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.405028:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004e049160/0x3234de053c4d36e lrc: 4/0,0 mode: PR/PR res: [0x2b39e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cffad expref: 1964 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.405031:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c8d20cf1 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.405032:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000be0ace91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996945536:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.405036:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210607 00000100:00100000:0.0:1651529344.405038:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+102:39029:x1731745946336576:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.405039:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 0000000071742acc going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.405042:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177055 count 1 00000100:00100000:1.0:1651529344.405044:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210608 00010000:00010000:0.0:1651529344.405045:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c4faf1 lrc: 3/0,1 mode: --/PW res: [0x2b39f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.405046:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+102:39030:x1731745946336640:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.405050:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177056 count 1 00010000:00010000:0.0:1651529344.405052:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef082db0/0x3234de053c4e709 lrc: 2/0,0 mode: PR/PR res: [0x2b39f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d16 expref: 1964 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.405053:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4faf8 lrc: 3/0,1 mode: --/PW res: [0x2b3a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.405057:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c4c67f lrc: 2/0,0 mode: PR/PR res: [0x2b3a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccbe3 expref: 1964 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.405060:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.405061:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.405061:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4faf8 lrc: 4/0,1 mode: --/PW res: [0x2b3a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.405067:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c4c67f lrc: 3/0,0 mode: PR/PR res: [0x2b3a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccbe3 expref: 1964 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.405070:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c4c67f lrc: 4/0,0 mode: PR/PR res: [0x2b3a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccbe3 expref: 1964 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.405070:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.405070:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.405074:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004534b316 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996945600:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.405079:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c4faf1 lrc: 4/0,1 mode: --/PW res: [0x2b39f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.405080:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000018ebe812 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.405087:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ef082db0/0x3234de053c4e709 lrc: 3/0,0 mode: PR/PR res: [0x2b39f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d16 expref: 1964 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.405091:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ef082db0/0x3234de053c4e709 lrc: 4/0,0 mode: PR/PR res: [0x2b39f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d16 expref: 1964 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.405095:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996945664:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.405102:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aac39cef going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.405124:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996945280:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.405128:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4face lrc: 3/0,1 mode: --/PW res: [0x2b39a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.405129:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.405141:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.405142:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396217152 00010000:00010000:0.0:1651529344.405152:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000315faada/0x3234de053c4d0ab lrc: 4/0,0 mode: PR/PR res: [0x2b399:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf462 expref: 1965 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.405159:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396217344 00010000:00010000:0.0:1651529344.405161:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000046cb20e/0x3234de053c4dbfd lrc: 4/0,0 mode: PR/PR res: [0x2b39a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2014 expref: 1966 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.405171:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11383 00000100:00100000:0.0:1651529344.405172:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1966:41279:x1731746396217152:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.405175:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.405177:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000315faada/0x3234de053c4d0ab lrc: 4/0,0 mode: PR/PR res: [0x2b399:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf462 expref: 1966 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.405180:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000315faada/0x3234de053c4d0ab lrc: 3/0,0 mode: PR/PR res: [0x2b399:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf462 expref: 1966 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.405186:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000315faada/0x3234de053c4d0ab lrc: 0/0,0 mode: --/PR res: [0x2b399:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf462 expref: 1966 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.405189:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.405190:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.405191:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4fac7 lrc: 3/0,1 mode: PW/PW res: [0x2b399:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405194:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4fac7 lrc: 4/0,1 mode: PW/PW res: [0x2b399:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.405198:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11384 00000100:00100000:1.0:1651529344.405200:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1965:41278:x1731746396217344:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.405200:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.405204:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.405206:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000046cb20e/0x3234de053c4dbfd lrc: 4/0,0 mode: PR/PR res: [0x2b39a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2014 expref: 1965 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.405210:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1965:41279:x1731746396217152:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.405213:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11383 00010000:00010000:1.0:1651529344.405216:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000046cb20e/0x3234de053c4dbfd lrc: 3/0,0 mode: PR/PR res: [0x2b39a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2014 expref: 1964 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.405220:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4fac7 lrc: 3/0,1 mode: PW/PW res: [0x2b399:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.405234:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000046cb20e/0x3234de053c4dbfd lrc: 0/0,0 mode: --/PR res: [0x2b39a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2014 expref: 1964 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.405239:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.405239:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.405240:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4face lrc: 3/0,1 mode: PW/PW res: [0x2b39a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.405243:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4face lrc: 4/0,1 mode: PW/PW res: [0x2b39a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.405252:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.405258:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4fac7 lrc: 3/0,1 mode: PW/PW res: [0x2b399:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.405259:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1963:41278:x1731746396217344:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 59us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.405262:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11384 00010000:00010000:0.0:1651529344.405262:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4fac7 lrc: 3/0,1 mode: PW/PW res: [0x2b399:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405265:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4fac7 lrc: 2/0,0 mode: PW/PW res: [0x2b399:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.405310:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+103:39030:x1731745946335936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1277us (1331us total) trans 12885078656 rc 0/0 00000100:00100000:0.0:1651529344.405313:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210601 00010000:00010000:0.0:1651529344.405323:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4fac7 lrc: 2/0,0 mode: PW/PW res: [0x2b399:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405327:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b65e0a0d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.405328:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4fac7 lrc: 2/0,0 mode: PW/PW res: [0x2b399:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405331:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4fac7 lrc: 3/0,0 mode: PW/PW res: [0x2b399:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405335:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4fac7 lrc: 1/0,0 mode: --/PW res: [0x2b399:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405338:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4fac7 lrc: 0/0,0 mode: --/PW res: [0x2b399:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405344:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4face lrc: 3/0,1 mode: PW/PW res: [0x2b39a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405347:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4face lrc: 3/0,1 mode: PW/PW res: [0x2b39a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405349:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4face lrc: 3/0,1 mode: PW/PW res: [0x2b39a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405352:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4face lrc: 2/0,0 mode: PW/PW res: [0x2b39a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.405392:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+103:39030:x1731745946336128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 805us (827us total) trans 12885078657 rc 0/0 00000100:00100000:0.0:1651529344.405395:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210602 00010000:00010000:0.0:1651529344.405401:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4face lrc: 2/0,0 mode: PW/PW res: [0x2b39a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405404:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000041a7efd7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.405405:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4face lrc: 2/0,0 mode: PW/PW res: [0x2b39a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405408:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4face lrc: 3/0,0 mode: PW/PW res: [0x2b39a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405412:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4face lrc: 1/0,0 mode: --/PW res: [0x2b39a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405415:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4face lrc: 0/0,0 mode: --/PW res: [0x2b39a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.405472:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.405485:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996945344:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.405488:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.405489:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4fad5 lrc: 3/0,1 mode: --/PW res: [0x2b39b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.405499:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.405519:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396217408 00010000:00010000:0.0:1651529344.405533:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ef2c2c65/0x3234de053c4caa0 lrc: 4/0,0 mode: PR/PR res: [0x2b39b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc44 expref: 1963 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.405564:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000be0ace91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996945536:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.405570:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396217472 00010000:00010000:0.0:1651529344.405574:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c4d582 lrc: 5/0,0 mode: PR/PR res: [0x2b39d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d079b expref: 1964 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.405581:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4faea lrc: 3/0,1 mode: --/PW res: [0x2b39e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.405581:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11385 00000100:00100000:0.0:1651529344.405583:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d177f8a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1964:41279:x1731746396217408:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.405586:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.405587:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ef2c2c65/0x3234de053c4caa0 lrc: 4/0,0 mode: PR/PR res: [0x2b39b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc44 expref: 1964 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.405590:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004534b316 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996945600:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.405591:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ef2c2c65/0x3234de053c4caa0 lrc: 3/0,0 mode: PR/PR res: [0x2b39b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc44 expref: 1964 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.405593:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4faf8 lrc: 3/0,1 mode: --/PW res: [0x2b3a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405596:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef2c2c65/0x3234de053c4caa0 lrc: 0/0,0 mode: --/PR res: [0x2b39b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc44 expref: 1964 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.405599:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000064719963 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996945408:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.405600:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.405601:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4fadc lrc: 3/0,1 mode: --/PW res: [0x2b39d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405601:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.405602:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4fad5 lrc: 3/0,1 mode: PW/PW res: [0x2b39b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405605:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4fad5 lrc: 4/0,1 mode: PW/PW res: [0x2b39b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.405608:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11386 00000100:00100000:1.0:1651529344.405610:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1963:41278:x1731746396217472:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.405611:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.405613:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.405615:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c4d582 lrc: 4/0,0 mode: PR/PR res: [0x2b39d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d079b expref: 1963 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.405618:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c4d582 lrc: 3/0,0 mode: PR/PR res: [0x2b39d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d079b expref: 1963 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.405618:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d177f8a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1963:41279:x1731746396217408:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.405621:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11385 00010000:00010000:1.0:1651529344.405624:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c4d582 lrc: 0/0,0 mode: --/PR res: [0x2b39d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d079b expref: 1962 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.405628:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.405628:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.405629:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4fadc lrc: 3/0,1 mode: PW/PW res: [0x2b39d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.405632:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4fadc lrc: 4/0,1 mode: PW/PW res: [0x2b39d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405632:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4fad5 lrc: 3/0,1 mode: PW/PW res: [0x2b39b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405635:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4fad5 lrc: 3/0,1 mode: PW/PW res: [0x2b39b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405638:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4fad5 lrc: 3/0,1 mode: PW/PW res: [0x2b39b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.405641:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.405641:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4fad5 lrc: 2/0,0 mode: PW/PW res: [0x2b39b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.405648:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1961:41278:x1731746396217472:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 37us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.405650:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11386 00010000:00010000:1.0:1651529344.405657:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4fadc lrc: 3/0,1 mode: PW/PW res: [0x2b39d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.405660:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4fadc lrc: 3/0,1 mode: PW/PW res: [0x2b39d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.405664:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4fadc lrc: 3/0,1 mode: PW/PW res: [0x2b39d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.405666:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4fadc lrc: 2/0,0 mode: PW/PW res: [0x2b39d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.405702:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085af61db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+104:39029:x1731745946336320:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 761us (845us total) trans 12885078658 rc 0/0 00000100:00100000:0.0:1651529344.405705:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210603 00000100:00100000:0.0:1651529344.405711:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946336704 00000100:00100000:1.0:1651529344.405713:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+104:39029:x1731745946336448:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 769us (830us total) trans 12885078659 rc 0/0 00000100:00100000:1.0:1651529344.405716:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210604 00000100:00100000:0.0:1651529344.405718:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210609 00000100:00100000:0.0:1651529344.405719:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfc79d4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+103:39030:x1731745946336704:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.405724:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177057 count 1 00010000:00010000:0.0:1651529344.405728:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f9600f5/0x3234de053c4faff lrc: 3/0,1 mode: --/PW res: [0x2b3a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.405731:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.405733:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c4c7f2 lrc: 2/0,0 mode: PR/PR res: [0x2b3a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd1ee expref: 1960 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.405746:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.405747:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.405748:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f9600f5/0x3234de053c4faff lrc: 4/0,1 mode: --/PW res: [0x2b3a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405755:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c4c7f2 lrc: 3/0,0 mode: PR/PR res: [0x2b3a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd1ee expref: 1960 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.405759:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c4c7f2 lrc: 4/0,0 mode: PR/PR res: [0x2b3a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd1ee expref: 1960 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.405763:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996945728:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.405771:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000007b78c9d8 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.405773:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.405777:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4fad5 lrc: 2/0,0 mode: PW/PW res: [0x2b39b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405780:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002731c8d2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.405781:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4fad5 lrc: 2/0,0 mode: PW/PW res: [0x2b39b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405784:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4fad5 lrc: 3/0,0 mode: PW/PW res: [0x2b39b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.405789:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.405789:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4fad5 lrc: 1/0,0 mode: --/PW res: [0x2b39b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405791:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4fad5 lrc: 0/0,0 mode: --/PW res: [0x2b39b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405802:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4fadc lrc: 2/0,0 mode: PW/PW res: [0x2b39d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405805:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000046d6c242 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.405806:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4fadc lrc: 2/0,0 mode: PW/PW res: [0x2b39d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405809:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4fadc lrc: 3/0,0 mode: PW/PW res: [0x2b39d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405812:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4fadc lrc: 1/0,0 mode: --/PW res: [0x2b39d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405815:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4fadc lrc: 0/0,0 mode: --/PW res: [0x2b39d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.405818:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.405829:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396217536 00010000:00010000:0.0:1651529344.405834:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000025b3903e/0x3234de053c4d3ec lrc: 5/0,0 mode: PR/PR res: [0x2b39c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0190 expref: 1961 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.405839:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396217600 00010000:00010000:0.0:1651529344.405841:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004e049160/0x3234de053c4d36e lrc: 4/0,0 mode: PR/PR res: [0x2b39e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cffad expref: 1962 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.405845:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396217664 00000100:00100000:1.0:1651529344.405847:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.405848:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c4c67f lrc: 4/0,0 mode: PR/PR res: [0x2b3a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccbe3 expref: 1963 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.405852:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396217728 00000100:00100000:1.0:1651529344.405853:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946337024 00010000:00010000:0.0:1651529344.405854:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ef082db0/0x3234de053c4e709 lrc: 5/0,0 mode: PR/PR res: [0x2b39f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d16 expref: 1964 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.405858:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11387 00000100:00100000:1.0:1651529344.405860:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210610 00000100:00100000:0.0:1651529344.405860:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007fca8239 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1964:41279:x1731746396217536:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.405862:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005914c920 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+104:39030:x1731745946337024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.405862:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.405864:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000025b3903e/0x3234de053c4d3ec lrc: 5/0,0 mode: PR/PR res: [0x2b39c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0190 expref: 1964 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.405867:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000025b3903e/0x3234de053c4d3ec lrc: 4/0,0 mode: PR/PR res: [0x2b39c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0190 expref: 1964 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:1.0:1651529344.405868:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177058 count 1 00010000:00010000:1.0:1651529344.405872:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c4fb06 lrc: 3/0,1 mode: --/PW res: [0x2b3a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405872:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.405873:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.405873:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c4fae3 lrc: 3/0,1 mode: PW/PW res: [0x2b39c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.405877:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000027a1488/0x3234de053c4e9b0 lrc: 2/0,0 mode: PR/PR res: [0x2b3a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5829 expref: 1964 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.405879:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c4fae3 lrc: 4/0,1 mode: PW/PW res: [0x2b39c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.405880:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.405881:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.405882:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c4fb06 lrc: 4/0,1 mode: --/PW res: [0x2b3a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405883:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.405888:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000027a1488/0x3234de053c4e9b0 lrc: 3/0,0 mode: PR/PR res: [0x2b3a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5829 expref: 1964 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.405892:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000027a1488/0x3234de053c4e9b0 lrc: 4/0,0 mode: PR/PR res: [0x2b3a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5829 expref: 1964 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.405896:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007fca8239 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1964:41279:x1731746396217536:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 35us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.405898:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11387 00000100:00100000:1.0:1651529344.405903:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000be0ace91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996945792:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.405903:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11388 00000100:00100000:0.0:1651529344.405905:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ea32140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1963:41278:x1731746396217600:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.405907:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.405908:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004e049160/0x3234de053c4d36e lrc: 4/0,0 mode: PR/PR res: [0x2b39e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cffad expref: 1963 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.405912:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 0000000018ebe812 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.405912:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004e049160/0x3234de053c4d36e lrc: 3/0,0 mode: PR/PR res: [0x2b39e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cffad expref: 1963 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.405919:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11389 00000100:00100000:1.0:1651529344.405920:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1963:41279:x1731746396217664:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.405923:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.405925:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c4c67f lrc: 4/0,0 mode: PR/PR res: [0x2b3a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccbe3 expref: 1963 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.405931:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c4c67f lrc: 3/0,0 mode: PR/PR res: [0x2b3a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccbe3 expref: 1963 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.405933:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e049160/0x3234de053c4d36e lrc: 0/0,0 mode: --/PR res: [0x2b39e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cffad expref: 1963 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.405937:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c4c67f lrc: 0/0,0 mode: --/PR res: [0x2b3a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccbe3 expref: 1962 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.405937:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.405937:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.405938:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4faea lrc: 3/0,1 mode: PW/PW res: [0x2b39e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.405940:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.405941:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.405941:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4faea lrc: 4/0,1 mode: PW/PW res: [0x2b39e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.405942:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4faf8 lrc: 3/0,1 mode: PW/PW res: [0x2b3a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.405945:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4faf8 lrc: 4/0,1 mode: PW/PW res: [0x2b3a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405953:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.405959:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.405960:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ea32140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1961:41278:x1731746396217600:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 55us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.405963:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11388 00000100:00100000:1.0:1651529344.405965:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1960:41279:x1731746396217664:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 44us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.405967:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11390 00000100:00100000:0.0:1651529344.405969:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1960:41278:x1731746396217728:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.405970:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11389 00010000:00010000:0.0:1651529344.405972:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.405973:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ef082db0/0x3234de053c4e709 lrc: 5/0,0 mode: PR/PR res: [0x2b39f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d16 expref: 1959 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.405977:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4faea lrc: 3/0,1 mode: PW/PW res: [0x2b39e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405977:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ef082db0/0x3234de053c4e709 lrc: 4/0,0 mode: PR/PR res: [0x2b39f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d16 expref: 1959 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.405980:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4faea lrc: 3/0,1 mode: PW/PW res: [0x2b39e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405982:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.405982:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.405983:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4faea lrc: 3/0,1 mode: PW/PW res: [0x2b39e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405983:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c4faf1 lrc: 3/0,1 mode: PW/PW res: [0x2b39f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405986:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c4faf1 lrc: 4/0,1 mode: PW/PW res: [0x2b39f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.405988:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4faea lrc: 2/0,0 mode: PW/PW res: [0x2b39e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.405990:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.405994:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1959:41278:x1731746396217728:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 25us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.406003:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11390 00010000:00010000:0.0:1651529344.406009:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4faea lrc: 2/0,0 mode: PW/PW res: [0x2b39e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406013:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000093dbd0d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.406014:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4faea lrc: 2/0,0 mode: PW/PW res: [0x2b39e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406017:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4faea lrc: 3/0,0 mode: PW/PW res: [0x2b39e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406021:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4faea lrc: 1/0,0 mode: --/PW res: [0x2b39e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.406030:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e8ce7f0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+105:39030:x1731745946336512:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1028us (1124us total) trans 12885078660 rc 0/0 00000100:00100000:1.0:1651529344.406033:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210606 00010000:00010000:0.0:1651529344.406038:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4faea lrc: 0/0,0 mode: --/PW res: [0x2b39e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.406040:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4faf8 lrc: 3/0,1 mode: PW/PW res: [0x2b3a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.406043:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4faf8 lrc: 3/0,1 mode: PW/PW res: [0x2b3a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.406046:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4faf8 lrc: 3/0,1 mode: PW/PW res: [0x2b3a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.406049:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4faf8 lrc: 2/0,0 mode: PW/PW res: [0x2b3a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406051:0:151609:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025b3903e/0x3234de053c4d3ec lrc: 0/0,0 mode: --/PR res: [0x2b39c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0190 expref: 1958 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.406054:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996945472:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.406064:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c4fae3 lrc: 3/0,1 mode: PW/PW res: [0x2b39c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406067:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c4fae3 lrc: 3/0,1 mode: PW/PW res: [0x2b39c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406070:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c4fae3 lrc: 3/0,1 mode: PW/PW res: [0x2b39c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406076:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c4fae3 lrc: 3/0,1 mode: PW/PW res: [0x2b39c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406078:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c4fae3 lrc: 2/0,0 mode: PW/PW res: [0x2b39c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.406086:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+105:39030:x1731745946336640:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1039us (1173us total) trans 12885078661 rc 0/0 00000100:00100000:1.0:1651529344.406089:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210608 00000100:00100000:1.0:1651529344.406104:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.406119:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+105:39030:x1731745946336384:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1124us (1229us total) trans 12885078662 rc 0/0 00000100:00100000:0.0:1651529344.406130:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210605 00000100:00100000:1.0:1651529344.406131:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.406136:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946337280 00000100:00100000:1.0:1651529344.406141:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.406145:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946337344 00000100:00100000:0.0:1651529344.406155:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210611 00000100:00100000:0.0:1651529344.406157:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+106:39030:x1731745946337280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.406162:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177059 count 1 00010000:00010000:0.0:1651529344.406166:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000610e679c/0x3234de053c4fb0d lrc: 3/0,1 mode: --/PW res: [0x2b3a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406171:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000007f5d689/0x3234de053c4e9da lrc: 2/0,0 mode: PR/PR res: [0x2b3a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58ed expref: 1957 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.406174:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.406175:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.406175:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000610e679c/0x3234de053c4fb0d lrc: 4/0,1 mode: --/PW res: [0x2b3a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406182:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000007f5d689/0x3234de053c4e9da lrc: 3/0,0 mode: PR/PR res: [0x2b3a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58ed expref: 1957 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.406185:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000007f5d689/0x3234de053c4e9da lrc: 4/0,0 mode: PR/PR res: [0x2b3a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58ed expref: 1957 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.406190:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996945856:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.406204:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000124f6b49 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.406209:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4faf8 lrc: 2/0,0 mode: PW/PW res: [0x2b3a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406213:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000040cd657 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.406214:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4faf8 lrc: 2/0,0 mode: PW/PW res: [0x2b3a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406217:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4faf8 lrc: 3/0,0 mode: PW/PW res: [0x2b3a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.406219:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210612 00000100:00100000:1.0:1651529344.406243:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+106:39029:x1731745946337344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.406250:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177060 count 1 00010000:00010000:1.0:1651529344.406254:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c4fb14 lrc: 3/0,1 mode: --/PW res: [0x2b3a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406254:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4faf8 lrc: 1/0,0 mode: --/PW res: [0x2b3a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406258:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4faf8 lrc: 0/0,0 mode: --/PW res: [0x2b3a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.406259:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001afd79ee/0x3234de053c4e017 lrc: 2/0,0 mode: PR/PR res: [0x2b3a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3147 expref: 1957 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.406262:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.406262:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.406263:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c4fb14 lrc: 4/0,1 mode: --/PW res: [0x2b3a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.406270:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001afd79ee/0x3234de053c4e017 lrc: 3/0,0 mode: PR/PR res: [0x2b3a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3147 expref: 1957 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.406272:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c4fae3 lrc: 2/0,0 mode: PW/PW res: [0x2b39c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.406273:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001afd79ee/0x3234de053c4e017 lrc: 4/0,0 mode: PR/PR res: [0x2b3a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3147 expref: 1957 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.406275:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002dcd6c4b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.406276:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c4fae3 lrc: 2/0,0 mode: PW/PW res: [0x2b39c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.406277:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000703c0db9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996945920:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.406279:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c4fae3 lrc: 3/0,0 mode: PW/PW res: [0x2b39c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406283:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c4fae3 lrc: 1/0,0 mode: --/PW res: [0x2b39c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.406286:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 0000000071742acc going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.406286:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c4fae3 lrc: 0/0,0 mode: --/PW res: [0x2b39c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.406297:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996945728:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.406301:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000f9600f5/0x3234de053c4faff lrc: 3/0,1 mode: --/PW res: [0x2b3a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.406307:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396217792 00010000:00010000:0.0:1651529344.406312:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c4c7f2 lrc: 4/0,0 mode: PR/PR res: [0x2b3a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd1ee expref: 1958 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.406340:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11391 00000100:00100000:0.0:1651529344.406341:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1958:41279:x1731746396217792:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.406345:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.406346:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c4c7f2 lrc: 4/0,0 mode: PR/PR res: [0x2b3a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd1ee expref: 1958 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.406350:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c4c7f2 lrc: 3/0,0 mode: PR/PR res: [0x2b3a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd1ee expref: 1958 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.406358:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c4c7f2 lrc: 0/0,0 mode: --/PR res: [0x2b3a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd1ee expref: 1958 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.406361:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.406361:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.406362:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.406363:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000f9600f5/0x3234de053c4faff lrc: 3/0,1 mode: PW/PW res: [0x2b3a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406366:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f9600f5/0x3234de053c4faff lrc: 4/0,1 mode: PW/PW res: [0x2b3a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.406370:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.406373:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.406376:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.406384:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1957:41279:x1731746396217792:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.406386:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11391 00010000:00010000:0.0:1651529344.406403:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000f9600f5/0x3234de053c4faff lrc: 3/0,1 mode: PW/PW res: [0x2b3a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406407:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f9600f5/0x3234de053c4faff lrc: 3/0,1 mode: PW/PW res: [0x2b3a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406410:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f9600f5/0x3234de053c4faff lrc: 3/0,1 mode: PW/PW res: [0x2b3a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406413:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f9600f5/0x3234de053c4faff lrc: 2/0,0 mode: PW/PW res: [0x2b3a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.406421:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946337536 00000100:00100000:1.0:1651529344.406428:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946337472 00000100:00100000:1.0:1651529344.406432:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946337600 00000100:00100000:1.0:1651529344.406435:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210613 00000100:00100000:1.0:1651529344.406436:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+110:39030:x1731745946337536:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.406442:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177062 count 1 00010000:00010000:1.0:1651529344.406446:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c4fb1b lrc: 3/0,1 mode: --/PW res: [0x2b3a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.406450:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c4f2a8 lrc: 2/0,0 mode: PR/PR res: [0x2b3a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d83 expref: 1956 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.406454:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.406454:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.406455:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c4fb1b lrc: 4/0,1 mode: --/PW res: [0x2b3a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.406459:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfc79d4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+110:39030:x1731745946336704:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 739us (959us total) trans 12885078663 rc 0/0 00000100:00100000:0.0:1651529344.406463:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210609 00000100:00100000:0.0:1651529344.406468:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210614 00010000:00010000:1.0:1651529344.406469:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c4f2a8 lrc: 3/0,0 mode: PR/PR res: [0x2b3a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d83 expref: 1956 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.406470:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+109:39029:x1731745946337472:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.406473:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c4f2a8 lrc: 4/0,0 mode: PR/PR res: [0x2b3a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d83 expref: 1956 pid: 72396 timeout: 20103 lvb_type: 1 00002000:00080000:0.0:1651529344.406475:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177061 count 1 00000100:00100000:1.0:1651529344.406477:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007ac35c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996945984:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.406479:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bcdc8b9f/0x3234de053c4fb22 lrc: 3/0,1 mode: --/PW res: [0x2b3a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406484:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c4cdda lrc: 2/0,0 mode: PR/PR res: [0x2b3a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce8e6 expref: 1956 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.406485:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000089d75f07 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.406487:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.406487:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.406488:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bcdc8b9f/0x3234de053c4fb22 lrc: 4/0,1 mode: --/PW res: [0x2b3a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.406491:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210615 00000100:00100000:1.0:1651529344.406493:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+109:39029:x1731745946337600:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.406495:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c4cdda lrc: 3/0,0 mode: PR/PR res: [0x2b3a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce8e6 expref: 1956 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.406498:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177063 count 1 00010000:00010000:0.0:1651529344.406498:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c4cdda lrc: 4/0,0 mode: PR/PR res: [0x2b3a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce8e6 expref: 1956 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.406501:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c4fb29 lrc: 3/0,1 mode: --/PW res: [0x2b3a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.406502:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996946048:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.406506:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b33925b5/0x3234de053c4d76c lrc: 2/0,0 mode: PR/PR res: [0x2b3a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f4a expref: 1956 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.406509:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.406510:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.406510:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c4fb29 lrc: 4/0,1 mode: --/PW res: [0x2b3a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.406511:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a52ee82 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.406516:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b33925b5/0x3234de053c4d76c lrc: 3/0,0 mode: PR/PR res: [0x2b3a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f4a expref: 1956 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.406516:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f9600f5/0x3234de053c4faff lrc: 2/0,0 mode: PW/PW res: [0x2b3a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406519:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000f9600f5 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.406520:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b33925b5/0x3234de053c4d76c lrc: 4/0,0 mode: PR/PR res: [0x2b3a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f4a expref: 1956 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.406520:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f9600f5/0x3234de053c4faff lrc: 2/0,0 mode: PW/PW res: [0x2b3a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406523:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f9600f5/0x3234de053c4faff lrc: 3/0,0 mode: PW/PW res: [0x2b3a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.406524:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000050bbb886 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996946112:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.406527:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f9600f5/0x3234de053c4faff lrc: 1/0,0 mode: --/PW res: [0x2b3a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.406530:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.406530:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f9600f5/0x3234de053c4faff lrc: 0/0,0 mode: --/PW res: [0x2b3a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.406539:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000be0ace91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996945792:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.406541:0:156655:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef082db0/0x3234de053c4e709 lrc: 0/0,0 mode: --/PR res: [0x2b39f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d16 expref: 1956 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.406543:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c4fb06 lrc: 3/0,1 mode: --/PW res: [0x2b3a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.406544:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996945664:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.406548:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c4faf1 lrc: 3/0,1 mode: PW/PW res: [0x2b39f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406551:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c4faf1 lrc: 3/0,1 mode: PW/PW res: [0x2b39f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406553:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c4faf1 lrc: 3/0,1 mode: PW/PW res: [0x2b39f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406559:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c4faf1 lrc: 3/0,1 mode: PW/PW res: [0x2b39f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406576:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c4faf1 lrc: 2/0,0 mode: PW/PW res: [0x2b39f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.406635:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+110:39029:x1731745946336576:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1596us (1736us total) trans 12885078664 rc 0/0 00000100:00100000:1.0:1651529344.406637:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.406638:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210607 00000100:00100000:1.0:1651529344.406669:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.406679:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.406689:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.406689:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c4faf1 lrc: 2/0,0 mode: PW/PW res: [0x2b39f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406697:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000069f87339 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.406699:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c4faf1 lrc: 2/0,0 mode: PW/PW res: [0x2b39f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.406701:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000703c0db9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996945920:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.406702:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c4faf1 lrc: 3/0,0 mode: PW/PW res: [0x2b39f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.406705:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c4fb14 lrc: 3/0,1 mode: --/PW res: [0x2b3a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406706:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c4faf1 lrc: 1/0,0 mode: --/PW res: [0x2b39f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406709:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c4faf1 lrc: 0/0,0 mode: --/PW res: [0x2b39f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.406717:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396218176 00010000:00010000:0.0:1651529344.406722:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000027a1488/0x3234de053c4e9b0 lrc: 4/0,0 mode: PR/PR res: [0x2b3a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5829 expref: 1956 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.406732:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396218240 00000100:00100000:1.0:1651529344.406742:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396218304 00010000:00010000:0.0:1651529344.406742:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000007f5d689/0x3234de053c4e9da lrc: 5/0,0 mode: PR/PR res: [0x2b3a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58ed expref: 1957 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.406748:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001afd79ee/0x3234de053c4e017 lrc: 4/0,0 mode: PR/PR res: [0x2b3a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3147 expref: 1958 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.406748:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11392 00000100:00100000:0.0:1651529344.406749:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082df86ec pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1958:41279:x1731746396218176:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.406752:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.406754:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11393 00010000:00010000:0.0:1651529344.406754:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000027a1488/0x3234de053c4e9b0 lrc: 4/0,0 mode: PR/PR res: [0x2b3a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5829 expref: 1958 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.406756:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1958:41279:x1731746396218240:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.406758:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000027a1488/0x3234de053c4e9b0 lrc: 3/0,0 mode: PR/PR res: [0x2b3a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5829 expref: 1958 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.406759:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.406761:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000007f5d689/0x3234de053c4e9da lrc: 5/0,0 mode: PR/PR res: [0x2b3a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58ed expref: 1958 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.406763:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000027a1488/0x3234de053c4e9b0 lrc: 0/0,0 mode: --/PR res: [0x2b3a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5829 expref: 1958 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.406764:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000007f5d689/0x3234de053c4e9da lrc: 4/0,0 mode: PR/PR res: [0x2b3a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58ed expref: 1958 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.406766:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.406766:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.406767:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c4fb06 lrc: 3/0,1 mode: PW/PW res: [0x2b3a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.406770:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.406770:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c4fb06 lrc: 4/0,1 mode: PW/PW res: [0x2b3a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.406771:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.406771:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000610e679c/0x3234de053c4fb0d lrc: 3/0,1 mode: PW/PW res: [0x2b3a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.406774:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000610e679c/0x3234de053c4fb0d lrc: 4/0,1 mode: PW/PW res: [0x2b3a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406779:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.406785:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.406798:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1957:41279:x1731746396218240:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 41us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.406801:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11393 00000100:00100000:1.0:1651529344.406806:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11394 00000100:00100000:1.0:1651529344.406807:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1956:41278:x1731746396218304:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.406810:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.406811:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001afd79ee/0x3234de053c4e017 lrc: 4/0,0 mode: PR/PR res: [0x2b3a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3147 expref: 1956 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.406816:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082df86ec pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1956:41279:x1731746396218176:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 66us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.406820:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11392 00010000:00010000:1.0:1651529344.406829:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001afd79ee/0x3234de053c4e017 lrc: 3/0,0 mode: PR/PR res: [0x2b3a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3147 expref: 1955 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.406834:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001afd79ee/0x3234de053c4e017 lrc: 0/0,0 mode: --/PR res: [0x2b3a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3147 expref: 1955 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.406838:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.406839:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.406839:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c4fb14 lrc: 3/0,1 mode: PW/PW res: [0x2b3a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.406842:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c4fb14 lrc: 4/0,1 mode: PW/PW res: [0x2b3a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.406848:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.406850:0:151609:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007f5d689/0x3234de053c4e9da lrc: 0/0,0 mode: --/PR res: [0x2b3a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58ed expref: 1954 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.406854:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1954:41278:x1731746396218304:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 46us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.406855:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996945856:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.406856:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11394 00010000:00010000:0.0:1651529344.406859:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000610e679c/0x3234de053c4fb0d lrc: 3/0,1 mode: PW/PW res: [0x2b3a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.406862:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c4fb14 lrc: 3/0,1 mode: PW/PW res: [0x2b3a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406862:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000610e679c/0x3234de053c4fb0d lrc: 3/0,1 mode: PW/PW res: [0x2b3a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406865:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000610e679c/0x3234de053c4fb0d lrc: 3/0,1 mode: PW/PW res: [0x2b3a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.406866:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c4fb14 lrc: 3/0,1 mode: PW/PW res: [0x2b3a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406868:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000610e679c/0x3234de053c4fb0d lrc: 3/0,1 mode: PW/PW res: [0x2b3a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.406871:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c4fb14 lrc: 3/0,1 mode: PW/PW res: [0x2b3a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406871:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000610e679c/0x3234de053c4fb0d lrc: 2/0,0 mode: PW/PW res: [0x2b3a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.406874:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c4fb14 lrc: 2/0,0 mode: PW/PW res: [0x2b3a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.406919:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+111:39029:x1731745946337344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 675us (788us total) trans 12885078666 rc 0/0 00000100:00100000:1.0:1651529344.406922:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210612 00000100:00100000:1.0:1651529344.406927:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946337664 00000100:00100000:0.0:1651529344.406930:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+111:39030:x1731745946337280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 772us (826us total) trans 12885078665 rc 0/0 00000100:00100000:0.0:1651529344.406933:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210611 00000100:00100000:1.0:1651529344.406935:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210616 00000100:00100000:1.0:1651529344.406937:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+110:39030:x1731745946337664:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.406941:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177064 count 1 00010000:00010000:0.0:1651529344.406941:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000610e679c/0x3234de053c4fb0d lrc: 2/0,0 mode: PW/PW res: [0x2b3a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.406945:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c4fb30 lrc: 3/0,1 mode: --/PW res: [0x2b3a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406947:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000610e679c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.406948:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000610e679c/0x3234de053c4fb0d lrc: 2/0,0 mode: PW/PW res: [0x2b3a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.406950:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c4dfed lrc: 2/0,0 mode: PR/PR res: [0x2b3a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d30c9 expref: 1952 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.406951:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000610e679c/0x3234de053c4fb0d lrc: 3/0,0 mode: PW/PW res: [0x2b3a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.406953:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.406954:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.406955:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c4fb30 lrc: 4/0,1 mode: --/PW res: [0x2b3a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406955:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000610e679c/0x3234de053c4fb0d lrc: 1/0,0 mode: --/PW res: [0x2b3a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406958:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000610e679c/0x3234de053c4fb0d lrc: 0/0,0 mode: --/PW res: [0x2b3a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.406961:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c4dfed lrc: 3/0,0 mode: PR/PR res: [0x2b3a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d30c9 expref: 1952 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.406962:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c4fb14 lrc: 2/0,0 mode: PW/PW res: [0x2b3a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406965:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ee8bd35b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.406965:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c4fb14 lrc: 2/0,0 mode: PW/PW res: [0x2b3a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.406967:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c4dfed lrc: 4/0,0 mode: PR/PR res: [0x2b3a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d30c9 expref: 1952 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.406968:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c4fb14 lrc: 3/0,0 mode: PW/PW res: [0x2b3a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.406971:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005fb0ec6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996946176:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.406971:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c4fb14 lrc: 1/0,0 mode: --/PW res: [0x2b3a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.406974:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c4fb14 lrc: 0/0,0 mode: --/PW res: [0x2b3a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.406978:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 0000000018ebe812 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.406983:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c4fb06 lrc: 3/0,1 mode: PW/PW res: [0x2b3a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.406986:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c4fb06 lrc: 3/0,1 mode: PW/PW res: [0x2b3a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.406989:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c4fb06 lrc: 3/0,1 mode: PW/PW res: [0x2b3a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.406992:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c4fb06 lrc: 2/0,0 mode: PW/PW res: [0x2b3a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.407004:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c4fb06 lrc: 2/0,0 mode: PW/PW res: [0x2b3a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.407030:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000009ec9189 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.407031:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c4fb06 lrc: 2/0,0 mode: PW/PW res: [0x2b3a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.407034:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c4fb06 lrc: 3/0,0 mode: PW/PW res: [0x2b3a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.407039:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c4fb06 lrc: 1/0,0 mode: --/PW res: [0x2b3a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.407041:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c4fb06 lrc: 0/0,0 mode: --/PW res: [0x2b3a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.407043:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005914c920 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+111:39030:x1731745946337024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1179us (1311us total) trans 12885078667 rc 0/0 00000100:00100000:1.0:1651529344.407046:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210610 00000100:00100000:1.0:1651529344.407063:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.407087:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.407108:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996946048:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.407111:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bcdc8b9f/0x3234de053c4fb22 lrc: 3/0,1 mode: --/PW res: [0x2b3a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.407134:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.407143:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396218560 00010000:00010000:0.0:1651529344.407148:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c4f2a8 lrc: 5/0,0 mode: PR/PR res: [0x2b3a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d83 expref: 1953 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.407155:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396218624 00010000:00010000:0.0:1651529344.407158:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c4cdda lrc: 4/0,0 mode: PR/PR res: [0x2b3a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce8e6 expref: 1954 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.407163:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.407164:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11395 00000100:00100000:0.0:1651529344.407165:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1954:41279:x1731746396218560:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.407168:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.407169:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c4f2a8 lrc: 5/0,0 mode: PR/PR res: [0x2b3a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d83 expref: 1954 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.407172:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000050bbb886 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996946112:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.407176:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c4fb29 lrc: 3/0,1 mode: --/PW res: [0x2b3a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.407183:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007ac35c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996945984:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.407186:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c4fb1b lrc: 3/0,1 mode: --/PW res: [0x2b3a6:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.407187:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c4f2a8 lrc: 3/0,0 mode: PR/PR res: [0x2b3a6:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d83 expref: 1954 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.407193:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c4f2a8 lrc: 0/0,0 mode: --/PR res: [0x2b3a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d83 expref: 1954 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.407196:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396218688 00010000:00010000:0.0:1651529344.407197:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.407198:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.407199:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c4fb1b lrc: 3/0,1 mode: PW/PW res: [0x2b3a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.407201:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b33925b5/0x3234de053c4d76c lrc: 4/0,0 mode: PR/PR res: [0x2b3a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f4a expref: 1954 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.407202:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c4fb1b lrc: 4/0,1 mode: PW/PW res: [0x2b3a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.407206:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11396 00000100:00100000:1.0:1651529344.407208:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1954:41279:x1731746396218624:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.407212:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.407218:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.407220:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c4cdda lrc: 4/0,0 mode: PR/PR res: [0x2b3a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce8e6 expref: 1954 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.407235:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1954:41279:x1731746396218560:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 69us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.407238:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11395 00010000:00010000:1.0:1651529344.407244:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c4cdda lrc: 3/0,0 mode: PR/PR res: [0x2b3a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce8e6 expref: 1954 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.407248:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11397 00010000:00010000:1.0:1651529344.407250:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c4cdda lrc: 0/0,0 mode: --/PR res: [0x2b3a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce8e6 expref: 1953 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.407250:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1953:41279:x1731746396218688:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.407253:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.407254:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.407255:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.407255:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b33925b5/0x3234de053c4d76c lrc: 4/0,0 mode: PR/PR res: [0x2b3a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f4a expref: 1952 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.407256:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bcdc8b9f/0x3234de053c4fb22 lrc: 3/0,1 mode: PW/PW res: [0x2b3a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.407259:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bcdc8b9f/0x3234de053c4fb22 lrc: 4/0,1 mode: PW/PW res: [0x2b3a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.407259:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b33925b5/0x3234de053c4d76c lrc: 3/0,0 mode: PR/PR res: [0x2b3a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f4a expref: 1952 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.407264:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b33925b5/0x3234de053c4d76c lrc: 0/0,0 mode: --/PR res: [0x2b3a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f4a expref: 1952 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.407266:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.407273:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.407274:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1951:41279:x1731746396218624:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 65us (140us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.407274:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.407275:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c4fb29 lrc: 3/0,1 mode: PW/PW res: [0x2b3a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.407276:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11396 00010000:00010000:0.0:1651529344.407278:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c4fb29 lrc: 4/0,1 mode: PW/PW res: [0x2b3a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.407284:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c4fb1b lrc: 3/0,1 mode: PW/PW res: [0x2b3a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.407286:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.407293:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c4fb1b lrc: 3/0,1 mode: PW/PW res: [0x2b3a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.407293:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1950:41279:x1731746396218688:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.407295:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11397 00010000:00010000:1.0:1651529344.407296:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c4fb1b lrc: 3/0,1 mode: PW/PW res: [0x2b3a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.407298:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c4fb1b lrc: 2/0,0 mode: PW/PW res: [0x2b3a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.407314:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c4fb1b lrc: 2/0,0 mode: PW/PW res: [0x2b3a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.407317:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000005af6806 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.407318:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c4fb1b lrc: 2/0,0 mode: PW/PW res: [0x2b3a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.407321:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c4fb1b lrc: 3/0,0 mode: PW/PW res: [0x2b3a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.407326:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c4fb1b lrc: 1/0,0 mode: --/PW res: [0x2b3a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.407328:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c4fb1b lrc: 0/0,0 mode: --/PW res: [0x2b3a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.407339:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+111:39030:x1731745946337536:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 901us (978us total) trans 12885078668 rc 0/0 00000100:00100000:1.0:1651529344.407342:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210613 00000100:00100000:1.0:1651529344.407347:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946337728 00000100:00100000:1.0:1651529344.407354:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210617 00000100:00100000:1.0:1651529344.407355:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+111:39030:x1731745946337728:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.407360:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177065 count 1 00010000:00010000:0.0:1651529344.407361:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bcdc8b9f/0x3234de053c4fb22 lrc: 3/0,1 mode: PW/PW res: [0x2b3a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.407364:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047d5dd29/0x3234de053c4fb37 lrc: 3/0,1 mode: --/PW res: [0x2b3a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.407364:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bcdc8b9f/0x3234de053c4fb22 lrc: 3/0,1 mode: PW/PW res: [0x2b3a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.407367:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bcdc8b9f/0x3234de053c4fb22 lrc: 3/0,1 mode: PW/PW res: [0x2b3a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.407369:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001d4bb628/0x3234de053c4eb3f lrc: 2/0,0 mode: PR/PR res: [0x2b3a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e81 expref: 1949 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.407370:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bcdc8b9f/0x3234de053c4fb22 lrc: 2/0,0 mode: PW/PW res: [0x2b3a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.407372:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.407373:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.407373:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047d5dd29/0x3234de053c4fb37 lrc: 4/0,1 mode: --/PW res: [0x2b3a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.407380:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001d4bb628/0x3234de053c4eb3f lrc: 3/0,0 mode: PR/PR res: [0x2b3a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e81 expref: 1949 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.407383:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001d4bb628/0x3234de053c4eb3f lrc: 4/0,0 mode: PR/PR res: [0x2b3a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e81 expref: 1949 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.407387:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000be0ace91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996946240:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.407395:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.407400:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c4fb29 lrc: 3/0,1 mode: PW/PW res: [0x2b3a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.407403:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c4fb29 lrc: 3/0,1 mode: PW/PW res: [0x2b3a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.407406:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c4fb29 lrc: 3/0,1 mode: PW/PW res: [0x2b3a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.407408:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c4fb29 lrc: 2/0,0 mode: PW/PW res: [0x2b3a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.407411:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+112:39029:x1731745946337472:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 940us (1041us total) trans 12885078669 rc 0/0 00000100:00100000:0.0:1651529344.407414:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210614 00010000:00010000:0.0:1651529344.407428:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bcdc8b9f/0x3234de053c4fb22 lrc: 2/0,0 mode: PW/PW res: [0x2b3a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.407434:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bcdc8b9f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.407435:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bcdc8b9f/0x3234de053c4fb22 lrc: 2/0,0 mode: PW/PW res: [0x2b3a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.407438:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bcdc8b9f/0x3234de053c4fb22 lrc: 3/0,0 mode: PW/PW res: [0x2b3a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.407442:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bcdc8b9f/0x3234de053c4fb22 lrc: 1/0,0 mode: --/PW res: [0x2b3a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.407445:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bcdc8b9f/0x3234de053c4fb22 lrc: 0/0,0 mode: --/PW res: [0x2b3a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.407449:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c4fb29 lrc: 2/0,0 mode: PW/PW res: [0x2b3a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.407450:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+112:39029:x1731745946337600:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 956us (1073us total) trans 12885078670 rc 0/0 00010000:00010000:0.0:1651529344.407452:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ce532454 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.407453:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210615 00010000:00010000:0.0:1651529344.407453:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c4fb29 lrc: 2/0,0 mode: PW/PW res: [0x2b3a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.407455:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c4fb29 lrc: 3/0,0 mode: PW/PW res: [0x2b3a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.407459:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c4fb29 lrc: 1/0,0 mode: --/PW res: [0x2b3a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.407461:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c4fb29 lrc: 0/0,0 mode: --/PW res: [0x2b3a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.407501:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.407515:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.407524:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396218752 00000100:00100000:1.0:1651529344.407527:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.407529:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c4dfed lrc: 5/0,0 mode: PR/PR res: [0x2b3a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d30c9 expref: 1950 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.407536:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11398 00000100:00100000:0.0:1651529344.407538:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1950:41278:x1731746396218752:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.407539:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.407541:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.407542:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c4dfed lrc: 5/0,0 mode: PR/PR res: [0x2b3a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d30c9 expref: 1950 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.407545:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c4dfed lrc: 4/0,0 mode: PR/PR res: [0x2b3a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d30c9 expref: 1950 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.407551:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.407551:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.407552:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c4fb30 lrc: 3/0,1 mode: PW/PW res: [0x2b3a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.407555:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c4fb30 lrc: 4/0,1 mode: PW/PW res: [0x2b3a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.407560:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.407566:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1950:41278:x1731746396218752:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 28us (52us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.407569:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11398 00000100:00100000:1.0:1651529344.407597:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946338112 00000100:00100000:1.0:1651529344.407607:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946338048 00000100:00100000:1.0:1651529344.407612:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946338176 00000100:00100000:1.0:1651529344.407619:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210618 00000100:00100000:1.0:1651529344.407620:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+114:39029:x1731745946338112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.407625:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177067 count 1 00000100:00100000:0.0:1651529344.407629:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210619 00010000:00010000:1.0:1651529344.407630:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c4fb3e lrc: 3/0,1 mode: --/PW res: [0x2b3ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.407635:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e75f72f8/0x3234de053c4d0c7 lrc: 2/0,0 mode: PR/PR res: [0x2b3ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf4c4 expref: 1949 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.407638:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.407639:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.407639:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c4fb3e lrc: 4/0,1 mode: --/PW res: [0x2b3ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.407641:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+114:39030:x1731745946338048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.407646:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e75f72f8/0x3234de053c4d0c7 lrc: 3/0,0 mode: PR/PR res: [0x2b3ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf4c4 expref: 1949 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.407646:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177066 count 1 00010000:00010000:0.0:1651529344.407651:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3202904/0x3234de053c4fb45 lrc: 3/0,1 mode: --/PW res: [0x2b3aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.407652:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e75f72f8/0x3234de053c4d0c7 lrc: 4/0,0 mode: PR/PR res: [0x2b3ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf4c4 expref: 1949 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.407655:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a53669fa/0x3234de053c4daf3 lrc: 2/0,0 mode: PR/PR res: [0x2b3aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1be5 expref: 1949 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.407656:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a9b051f pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996946304:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.407659:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.407659:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.407660:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3202904/0x3234de053c4fb45 lrc: 4/0,1 mode: --/PW res: [0x2b3aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.407667:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 000000007d8fabda going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.407667:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a53669fa/0x3234de053c4daf3 lrc: 3/0,0 mode: PR/PR res: [0x2b3aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1be5 expref: 1949 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.407670:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a53669fa/0x3234de053c4daf3 lrc: 4/0,0 mode: PR/PR res: [0x2b3aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1be5 expref: 1949 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.407673:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210620 00000100:00100000:1.0:1651529344.407674:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+114:39030:x1731745946338176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.407675:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996946368:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.407678:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177068 count 1 00010000:00010000:1.0:1651529344.407682:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c4fb4c lrc: 3/0,1 mode: --/PW res: [0x2b3ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.407683:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a52ee82 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.407686:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c4c6b7 lrc: 2/0,0 mode: PR/PR res: [0x2b3ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cccdf expref: 1949 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.407689:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.407690:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.407690:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c4fb4c lrc: 4/0,1 mode: --/PW res: [0x2b3ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.407696:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c4c6b7 lrc: 3/0,0 mode: PR/PR res: [0x2b3ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cccdf expref: 1949 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.407700:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c4c6b7 lrc: 4/0,0 mode: PR/PR res: [0x2b3ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cccdf expref: 1949 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.407707:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000703c0db9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996946432:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.407713:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 0000000057299e7f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.407720:0:72396:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c4dfed lrc: 0/0,0 mode: --/PR res: [0x2b3a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d30c9 expref: 1949 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.407724:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005fb0ec6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996946176:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.407728:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c4fb30 lrc: 3/0,1 mode: PW/PW res: [0x2b3a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.407731:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c4fb30 lrc: 3/0,1 mode: PW/PW res: [0x2b3a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.407733:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c4fb30 lrc: 3/0,1 mode: PW/PW res: [0x2b3a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.407746:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c4fb30 lrc: 3/0,1 mode: PW/PW res: [0x2b3a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.407749:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c4fb30 lrc: 2/0,0 mode: PW/PW res: [0x2b3a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.407761:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c4fb30 lrc: 2/0,0 mode: PW/PW res: [0x2b3a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.407765:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000712b8830 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.407766:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c4fb30 lrc: 2/0,0 mode: PW/PW res: [0x2b3a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.407771:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c4fb30 lrc: 3/0,0 mode: PW/PW res: [0x2b3a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.407776:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c4fb30 lrc: 1/0,0 mode: --/PW res: [0x2b3a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.407779:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c4fb30 lrc: 0/0,0 mode: --/PW res: [0x2b3a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.407791:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+115:39030:x1731745946337664:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 853us (1101us total) trans 12885078671 rc 0/0 00000100:00100000:1.0:1651529344.407794:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210616 00000100:00100000:1.0:1651529344.407842:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.407874:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.407902:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.407912:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946338496 00000100:00100000:1.0:1651529344.407914:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000be0ace91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996946240:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.407918:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000047d5dd29/0x3234de053c4fb37 lrc: 3/0,1 mode: --/PW res: [0x2b3a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.407918:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946338432 00000100:00100000:0.0:1651529344.407922:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946338560 00000100:00100000:0.0:1651529344.407926:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210621 00000100:00100000:1.0:1651529344.407928:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210622 00000100:00100000:0.0:1651529344.407928:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+117:39029:x1731745946338496:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.407930:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+117:39030:x1731745946338432:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.407932:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177070 count 1 00002000:00080000:1.0:1651529344.407935:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177069 count 1 00010000:00010000:0.0:1651529344.407936:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000411ac620/0x3234de053c4fb53 lrc: 3/0,1 mode: --/PW res: [0x2b3ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.407939:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a82b4949/0x3234de053c4fb5a lrc: 3/0,1 mode: --/PW res: [0x2b3ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.407941:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000066374bf8/0x3234de053c4c942 lrc: 2/0,0 mode: PR/PR res: [0x2b3ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd68d expref: 1948 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.407943:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c4f2a1 lrc: 2/0,0 mode: PR/PR res: [0x2b3ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d67 expref: 1948 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.407944:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.407944:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.407945:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000411ac620/0x3234de053c4fb53 lrc: 4/0,1 mode: --/PW res: [0x2b3ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.407947:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.407947:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.407948:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a82b4949/0x3234de053c4fb5a lrc: 4/0,1 mode: --/PW res: [0x2b3ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.407954:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c4f2a1 lrc: 3/0,0 mode: PR/PR res: [0x2b3ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d67 expref: 1948 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.407957:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c4f2a1 lrc: 4/0,0 mode: PR/PR res: [0x2b3ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d67 expref: 1948 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.407961:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c43262d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996946496:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.407973:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000066374bf8/0x3234de053c4c942 lrc: 3/0,0 mode: PR/PR res: [0x2b3ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd68d expref: 1948 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.407977:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.407977:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000066374bf8/0x3234de053c4c942 lrc: 4/0,0 mode: PR/PR res: [0x2b3ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd68d expref: 1948 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.407982:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996946560:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.407983:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210623 00000100:00100000:1.0:1651529344.407985:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+117:39030:x1731745946338560:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.407989:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177071 count 1 00000100:00100000:0.0:1651529344.407991:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000382571b5 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.407993:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c4fb61 lrc: 3/0,1 mode: --/PW res: [0x2b3af:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.407997:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a5b283df/0x3234de053c4ee25 lrc: 2/0,0 mode: PR/PR res: [0x2b3af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6aac expref: 1948 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.408000:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.408001:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.408001:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c4fb61 lrc: 4/0,1 mode: --/PW res: [0x2b3af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.408007:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a5b283df/0x3234de053c4ee25 lrc: 3/0,0 mode: PR/PR res: [0x2b3af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6aac expref: 1948 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.408010:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a5b283df/0x3234de053c4ee25 lrc: 4/0,0 mode: PR/PR res: [0x2b3af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6aac expref: 1948 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.408014:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009acffcb8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996946624:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.408021:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 0000000071742acc going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.408033:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.408044:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946338688 00000100:00100000:0.0:1651529344.408051:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210624 00000100:00100000:0.0:1651529344.408053:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+118:39030:x1731745946338688:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.408057:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177072 count 1 00010000:00010000:0.0:1651529344.408061:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e8b8142/0x3234de053c4fb68 lrc: 3/0,1 mode: --/PW res: [0x2b3b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408065:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c4eee9 lrc: 2/0,0 mode: PR/PR res: [0x2b3b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d92 expref: 1948 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.408068:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.408069:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.408069:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e8b8142/0x3234de053c4fb68 lrc: 4/0,1 mode: --/PW res: [0x2b3b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408075:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c4eee9 lrc: 3/0,0 mode: PR/PR res: [0x2b3b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d92 expref: 1948 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.408079:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c4eee9 lrc: 4/0,0 mode: PR/PR res: [0x2b3b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d92 expref: 1948 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.408085:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996946688:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.408099:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 0000000094c2f645 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.408213:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.408247:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a9b051f pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996946304:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.408248:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396218816 00010000:00010000:1.0:1651529344.408252:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c4fb3e lrc: 3/0,1 mode: --/PW res: [0x2b3ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408254:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001d4bb628/0x3234de053c4eb3f lrc: 4/0,0 mode: PR/PR res: [0x2b3a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e81 expref: 1949 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.408261:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11399 00000100:00100000:0.0:1651529344.408263:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000619c18c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1949:41279:x1731746396218816:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.408266:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.408268:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001d4bb628/0x3234de053c4eb3f lrc: 4/0,0 mode: PR/PR res: [0x2b3a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e81 expref: 1949 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.408271:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001d4bb628/0x3234de053c4eb3f lrc: 3/0,0 mode: PR/PR res: [0x2b3a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e81 expref: 1949 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.408277:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d4bb628/0x3234de053c4eb3f lrc: 0/0,0 mode: --/PR res: [0x2b3a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e81 expref: 1949 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.408280:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.408281:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.408282:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000047d5dd29/0x3234de053c4fb37 lrc: 3/0,1 mode: PW/PW res: [0x2b3a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408285:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047d5dd29/0x3234de053c4fb37 lrc: 4/0,1 mode: PW/PW res: [0x2b3a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408297:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.408299:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000047d5dd29/0x3234de053c4fb37 lrc: 3/0,1 mode: PW/PW res: [0x2b3a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.408303:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047d5dd29/0x3234de053c4fb37 lrc: 3/0,1 mode: PW/PW res: [0x2b3a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.408307:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000619c18c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1948:41279:x1731746396218816:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 43us (94us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.408310:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047d5dd29/0x3234de053c4fb37 lrc: 3/0,1 mode: PW/PW res: [0x2b3a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.408310:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11399 00010000:00010000:1.0:1651529344.408313:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000047d5dd29/0x3234de053c4fb37 lrc: 2/0,0 mode: PW/PW res: [0x2b3a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408329:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000047d5dd29/0x3234de053c4fb37 lrc: 2/0,0 mode: PW/PW res: [0x2b3a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408333:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000047d5dd29 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.408334:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000047d5dd29/0x3234de053c4fb37 lrc: 2/0,0 mode: PW/PW res: [0x2b3a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408336:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000047d5dd29/0x3234de053c4fb37 lrc: 3/0,0 mode: PW/PW res: [0x2b3a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408341:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000047d5dd29/0x3234de053c4fb37 lrc: 1/0,0 mode: --/PW res: [0x2b3a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408343:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047d5dd29/0x3234de053c4fb37 lrc: 0/0,0 mode: --/PW res: [0x2b3a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.408353:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996946368:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.408357:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f3202904/0x3234de053c4fb45 lrc: 3/0,1 mode: --/PW res: [0x2b3aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.408358:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+119:39030:x1731745946337728:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1001us (1294us total) trans 12885078672 rc 0/0 00000100:00100000:1.0:1651529344.408361:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210617 00000100:00100000:1.0:1651529344.408458:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000703c0db9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996946432:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.408462:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c4fb4c lrc: 3/0,1 mode: --/PW res: [0x2b3ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.408519:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.408536:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396219328 00010000:00010000:0.0:1651529344.408541:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e75f72f8/0x3234de053c4d0c7 lrc: 4/0,0 mode: PR/PR res: [0x2b3ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf4c4 expref: 1948 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.408548:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.408549:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11400 00000100:00100000:0.0:1651529344.408551:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1948:41279:x1731746396219328:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.408559:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.408559:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.408560:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e75f72f8/0x3234de053c4d0c7 lrc: 4/0,0 mode: PR/PR res: [0x2b3ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf4c4 expref: 1948 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.408564:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e75f72f8/0x3234de053c4d0c7 lrc: 3/0,0 mode: PR/PR res: [0x2b3ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf4c4 expref: 1948 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.408566:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.408569:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e75f72f8/0x3234de053c4d0c7 lrc: 0/0,0 mode: --/PR res: [0x2b3ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf4c4 expref: 1948 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.408573:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.408573:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.408573:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.408574:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c4fb3e lrc: 3/0,1 mode: PW/PW res: [0x2b3ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408577:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c4fb3e lrc: 4/0,1 mode: PW/PW res: [0x2b3ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.408578:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.408582:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.408586:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.408594:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1947:41279:x1731746396219328:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.408613:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11400 00000100:00100000:0.0:1651529344.408618:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396219456 00010000:00010000:0.0:1651529344.408622:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a53669fa/0x3234de053c4daf3 lrc: 4/0,0 mode: PR/PR res: [0x2b3aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1be5 expref: 1947 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.408626:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.408627:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396219584 00010000:00010000:0.0:1651529344.408629:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c4f2a1 lrc: 5/0,0 mode: PR/PR res: [0x2b3ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d67 expref: 1948 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.408632:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c4fb3e lrc: 3/0,1 mode: PW/PW res: [0x2b3ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.408633:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396219520 00010000:00010000:1.0:1651529344.408635:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c4fb3e lrc: 3/0,1 mode: PW/PW res: [0x2b3ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408635:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c4c6b7 lrc: 4/0,0 mode: PR/PR res: [0x2b3ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cccdf expref: 1949 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.408639:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c4fb3e lrc: 3/0,1 mode: PW/PW res: [0x2b3ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.408639:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396219648 00010000:00010000:1.0:1651529344.408641:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c4fb3e lrc: 2/0,0 mode: PW/PW res: [0x2b3ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408641:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000066374bf8/0x3234de053c4c942 lrc: 5/0,0 mode: PR/PR res: [0x2b3ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd68d expref: 1950 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.408645:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396219712 00010000:00010000:0.0:1651529344.408647:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a5b283df/0x3234de053c4ee25 lrc: 5/0,0 mode: PR/PR res: [0x2b3af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6aac expref: 1951 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.408658:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396219776 00010000:00010000:0.0:1651529344.408661:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c4eee9 lrc: 5/0,0 mode: PR/PR res: [0x2b3b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d92 expref: 1952 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.408665:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11401 00000100:00100000:0.0:1651529344.408667:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1952:41279:x1731746396219456:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.408669:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.408670:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a53669fa/0x3234de053c4daf3 lrc: 4/0,0 mode: PR/PR res: [0x2b3aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1be5 expref: 1952 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.408676:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a53669fa/0x3234de053c4daf3 lrc: 3/0,0 mode: PR/PR res: [0x2b3aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1be5 expref: 1952 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.408682:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a53669fa/0x3234de053c4daf3 lrc: 0/0,0 mode: --/PR res: [0x2b3aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1be5 expref: 1952 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.408685:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.408685:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.408686:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+119:39029:x1731745946338112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1065us (1194us total) trans 12885078673 rc 0/0 00010000:00010000:0.0:1651529344.408686:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f3202904/0x3234de053c4fb45 lrc: 3/0,1 mode: PW/PW res: [0x2b3aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408689:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3202904/0x3234de053c4fb45 lrc: 4/0,1 mode: PW/PW res: [0x2b3aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.408690:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210618 00000100:00100000:1.0:1651529344.408695:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946338752 00010000:00010000:0.0:1651529344.408696:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.408704:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210625 00000100:00100000:1.0:1651529344.408706:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+119:39030:x1731745946338752:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.408710:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1951:41279:x1731746396219456:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (162us total) trans 0 rc 0/0 00002000:00080000:1.0:1651529344.408711:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177073 count 1 00000100:00100000:0.0:1651529344.408712:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11401 00010000:00010000:1.0:1651529344.408715:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c4fb6f lrc: 3/0,1 mode: --/PW res: [0x2b3b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.408717:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11402 00000100:00100000:0.0:1651529344.408718:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1950:41279:x1731746396219584:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.408720:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c4e6df lrc: 2/0,0 mode: PR/PR res: [0x2b3b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c44 expref: 1950 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.408721:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.408722:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c4f2a1 lrc: 5/0,0 mode: PR/PR res: [0x2b3ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d67 expref: 1950 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.408723:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.408724:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.408724:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c4fb6f lrc: 4/0,1 mode: --/PW res: [0x2b3b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408726:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c4f2a1 lrc: 4/0,0 mode: PR/PR res: [0x2b3ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d67 expref: 1950 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.408731:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c4e6df lrc: 3/0,0 mode: PR/PR res: [0x2b3b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c44 expref: 1950 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.408731:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.408732:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.408732:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a82b4949/0x3234de053c4fb5a lrc: 3/0,1 mode: PW/PW res: [0x2b3ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.408744:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c4e6df lrc: 4/0,0 mode: PR/PR res: [0x2b3b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c44 expref: 1950 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.408745:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a82b4949/0x3234de053c4fb5a lrc: 4/0,1 mode: PW/PW res: [0x2b3ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.408748:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004534b316 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996946752:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.408750:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.408756:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1950:41279:x1731746396219584:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 37us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.408758:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 0000000057299e7f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.408758:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11402 00000100:00100000:0.0:1651529344.408762:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11403 00000100:00100000:0.0:1651529344.408764:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1949:41279:x1731746396219520:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.408766:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.408767:0:72396:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c4f2a1 lrc: 0/0,0 mode: --/PR res: [0x2b3ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d67 expref: 1949 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.408767:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c4c6b7 lrc: 4/0,0 mode: PR/PR res: [0x2b3ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cccdf expref: 1949 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.408771:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c43262d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996946496:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.408771:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c4c6b7 lrc: 3/0,0 mode: PR/PR res: [0x2b3ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cccdf expref: 1948 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.408775:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a82b4949/0x3234de053c4fb5a lrc: 3/0,1 mode: PW/PW res: [0x2b3ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408776:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c4c6b7 lrc: 0/0,0 mode: --/PR res: [0x2b3ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cccdf expref: 1948 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.408778:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a82b4949/0x3234de053c4fb5a lrc: 3/0,1 mode: PW/PW res: [0x2b3ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408779:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.408779:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.408780:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c4fb4c lrc: 3/0,1 mode: PW/PW res: [0x2b3ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.408781:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a82b4949/0x3234de053c4fb5a lrc: 3/0,1 mode: PW/PW res: [0x2b3ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408783:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c4fb4c lrc: 4/0,1 mode: PW/PW res: [0x2b3ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.408784:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a82b4949/0x3234de053c4fb5a lrc: 3/0,1 mode: PW/PW res: [0x2b3ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.408789:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a82b4949/0x3234de053c4fb5a lrc: 2/0,0 mode: PW/PW res: [0x2b3ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408792:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.408797:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1947:41279:x1731746396219520:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 33us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.408800:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11403 00000100:00100000:0.0:1651529344.408810:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11404 00000100:00100000:0.0:1651529344.408811:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1946:41279:x1731746396219648:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.408814:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.408816:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000066374bf8/0x3234de053c4c942 lrc: 5/0,0 mode: PR/PR res: [0x2b3ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd68d expref: 1946 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.408819:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000066374bf8/0x3234de053c4c942 lrc: 4/0,0 mode: PR/PR res: [0x2b3ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd68d expref: 1946 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.408824:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.408824:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.408825:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000411ac620/0x3234de053c4fb53 lrc: 3/0,1 mode: PW/PW res: [0x2b3ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408828:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000411ac620/0x3234de053c4fb53 lrc: 4/0,1 mode: PW/PW res: [0x2b3ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408832:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.408838:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+120:39030:x1731745946338432:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 907us (963us total) trans 12885078674 rc 0/0 00000100:00100000:0.0:1651529344.408838:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1946:41279:x1731746396219648:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 26us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.408840:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11404 00000100:00100000:1.0:1651529344.408841:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210622 00000100:00100000:0.0:1651529344.408844:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11405 00000100:00100000:0.0:1651529344.408846:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1945:41278:x1731746396219712:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.408848:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c4fb4c lrc: 3/0,1 mode: PW/PW res: [0x2b3ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408848:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.408849:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a5b283df/0x3234de053c4ee25 lrc: 5/0,0 mode: PR/PR res: [0x2b3af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6aac expref: 1945 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.408851:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c4fb4c lrc: 3/0,1 mode: PW/PW res: [0x2b3ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408852:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a5b283df/0x3234de053c4ee25 lrc: 4/0,0 mode: PR/PR res: [0x2b3af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6aac expref: 1945 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.408854:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c4fb4c lrc: 3/0,1 mode: PW/PW res: [0x2b3ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408856:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.408857:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c4fb4c lrc: 2/0,0 mode: PW/PW res: [0x2b3ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408857:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.408857:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c4fb61 lrc: 3/0,1 mode: PW/PW res: [0x2b3af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408860:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c4fb61 lrc: 4/0,1 mode: PW/PW res: [0x2b3af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408870:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.408875:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1945:41278:x1731746396219712:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 29us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.408878:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11405 00000100:00100000:0.0:1651529344.408882:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11406 00000100:00100000:0.0:1651529344.408883:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b9d7b776 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1944:41279:x1731746396219776:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.408886:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.408887:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c4eee9 lrc: 5/0,0 mode: PR/PR res: [0x2b3b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d92 expref: 1944 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.408891:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c4eee9 lrc: 4/0,0 mode: PR/PR res: [0x2b3b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d92 expref: 1944 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.408894:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+120:39030:x1731745946338176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1219us (1355us total) trans 12885078675 rc 0/0 00010000:00010000:0.0:1651529344.408895:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.408895:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.408896:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004e8b8142/0x3234de053c4fb68 lrc: 3/0,1 mode: PW/PW res: [0x2b3b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.408897:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210620 00010000:00010000:0.0:1651529344.408899:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e8b8142/0x3234de053c4fb68 lrc: 4/0,1 mode: PW/PW res: [0x2b3b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408903:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.408908:0:80279:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5b283df/0x3234de053c4ee25 lrc: 0/0,0 mode: --/PR res: [0x2b3af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6aac expref: 1944 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.408908:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b9d7b776 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1944:41279:x1731746396219776:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 24us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.408910:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11406 00000100:00100000:1.0:1651529344.408912:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009acffcb8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996946624:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.408917:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c4fb61 lrc: 3/0,1 mode: PW/PW res: [0x2b3af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408919:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c4fb3e lrc: 2/0,0 mode: PW/PW res: [0x2b3ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.408920:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c4fb61 lrc: 3/0,1 mode: PW/PW res: [0x2b3af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408922:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000364b2cdc already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.408923:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c4fb61 lrc: 3/0,1 mode: PW/PW res: [0x2b3af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408923:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c4fb3e lrc: 2/0,0 mode: PW/PW res: [0x2b3ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.408926:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c4fb61 lrc: 3/0,1 mode: PW/PW res: [0x2b3af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408926:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c4fb3e lrc: 3/0,0 mode: PW/PW res: [0x2b3ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.408928:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c4fb61 lrc: 2/0,0 mode: PW/PW res: [0x2b3af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408930:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c4fb3e lrc: 1/0,0 mode: --/PW res: [0x2b3ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408933:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c4fb3e lrc: 0/0,0 mode: --/PW res: [0x2b3ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408937:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a82b4949/0x3234de053c4fb5a lrc: 2/0,0 mode: PW/PW res: [0x2b3ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408940:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a82b4949 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.408941:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a82b4949/0x3234de053c4fb5a lrc: 2/0,0 mode: PW/PW res: [0x2b3ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408943:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a82b4949/0x3234de053c4fb5a lrc: 3/0,0 mode: PW/PW res: [0x2b3ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408947:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a82b4949/0x3234de053c4fb5a lrc: 1/0,0 mode: --/PW res: [0x2b3ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408949:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a82b4949/0x3234de053c4fb5a lrc: 0/0,0 mode: --/PW res: [0x2b3ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408952:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c4fb4c lrc: 2/0,0 mode: PW/PW res: [0x2b3ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408955:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000011a71df9 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.408956:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c4fb4c lrc: 2/0,0 mode: PW/PW res: [0x2b3ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.408959:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+120:39030:x1731745946338560:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 973us (1057us total) trans 12885078676 rc 0/0 00010000:00010000:0.0:1651529344.408961:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c4fb4c lrc: 3/0,0 mode: PW/PW res: [0x2b3ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.408962:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210623 00010000:00010000:0.0:1651529344.408964:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c4fb4c lrc: 1/0,0 mode: --/PW res: [0x2b3ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408966:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c4fb4c lrc: 0/0,0 mode: --/PW res: [0x2b3ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408970:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c4fb61 lrc: 2/0,0 mode: PW/PW res: [0x2b3af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408973:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003865e83e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.408973:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c4fb61 lrc: 2/0,0 mode: PW/PW res: [0x2b3af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408976:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c4fb61 lrc: 3/0,0 mode: PW/PW res: [0x2b3af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408979:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c4fb61 lrc: 1/0,0 mode: --/PW res: [0x2b3af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408981:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c4fb61 lrc: 0/0,0 mode: --/PW res: [0x2b3af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408989:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f3202904/0x3234de053c4fb45 lrc: 3/0,1 mode: PW/PW res: [0x2b3aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408994:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3202904/0x3234de053c4fb45 lrc: 3/0,1 mode: PW/PW res: [0x2b3aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.408997:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3202904/0x3234de053c4fb45 lrc: 3/0,1 mode: PW/PW res: [0x2b3aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.409000:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3202904/0x3234de053c4fb45 lrc: 2/0,0 mode: PW/PW res: [0x2b3aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.409041:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+120:39030:x1731745946338048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1409us (1513us total) trans 12885078677 rc 0/0 00000100:00100000:0.0:1651529344.409044:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210619 00010000:00010000:0.0:1651529344.409051:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3202904/0x3234de053c4fb45 lrc: 2/0,0 mode: PW/PW res: [0x2b3aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.409054:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f3202904 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.409055:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3202904/0x3234de053c4fb45 lrc: 2/0,0 mode: PW/PW res: [0x2b3aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.409078:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3202904/0x3234de053c4fb45 lrc: 3/0,0 mode: PW/PW res: [0x2b3aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.409083:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3202904/0x3234de053c4fb45 lrc: 1/0,0 mode: --/PW res: [0x2b3aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.409086:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3202904/0x3234de053c4fb45 lrc: 0/0,0 mode: --/PW res: [0x2b3aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.409098:0:80280:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c4eee9 lrc: 0/0,0 mode: --/PR res: [0x2b3b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d92 expref: 1942 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.409102:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996946688:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.409105:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004e8b8142/0x3234de053c4fb68 lrc: 3/0,1 mode: PW/PW res: [0x2b3b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.409108:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004e8b8142/0x3234de053c4fb68 lrc: 3/0,1 mode: PW/PW res: [0x2b3b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.409111:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e8b8142/0x3234de053c4fb68 lrc: 3/0,1 mode: PW/PW res: [0x2b3b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.409114:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e8b8142/0x3234de053c4fb68 lrc: 3/0,1 mode: PW/PW res: [0x2b3b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.409117:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e8b8142/0x3234de053c4fb68 lrc: 2/0,0 mode: PW/PW res: [0x2b3b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.409176:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+120:39030:x1731745946338688:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1123us (1143us total) trans 12885078678 rc 0/0 00000100:00100000:0.0:1651529344.409179:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210624 00010000:00010000:0.0:1651529344.409186:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e8b8142/0x3234de053c4fb68 lrc: 2/0,0 mode: PW/PW res: [0x2b3b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.409190:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004e8b8142 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.409191:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e8b8142/0x3234de053c4fb68 lrc: 2/0,0 mode: PW/PW res: [0x2b3b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.409194:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e8b8142/0x3234de053c4fb68 lrc: 3/0,0 mode: PW/PW res: [0x2b3b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.409198:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e8b8142/0x3234de053c4fb68 lrc: 1/0,0 mode: --/PW res: [0x2b3b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.409201:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e8b8142/0x3234de053c4fb68 lrc: 0/0,0 mode: --/PW res: [0x2b3b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.409210:0:156655:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066374bf8/0x3234de053c4c942 lrc: 0/0,0 mode: --/PR res: [0x2b3ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd68d expref: 1941 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.409214:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996946560:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.409217:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000411ac620/0x3234de053c4fb53 lrc: 3/0,1 mode: PW/PW res: [0x2b3ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.409254:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000411ac620/0x3234de053c4fb53 lrc: 3/0,1 mode: PW/PW res: [0x2b3ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.409258:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000411ac620/0x3234de053c4fb53 lrc: 3/0,1 mode: PW/PW res: [0x2b3ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.409261:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000411ac620/0x3234de053c4fb53 lrc: 3/0,1 mode: PW/PW res: [0x2b3ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.409266:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000411ac620/0x3234de053c4fb53 lrc: 2/0,0 mode: PW/PW res: [0x2b3ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.409270:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.409283:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004534b316 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996946752:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.409287:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c4fb6f lrc: 3/0,1 mode: --/PW res: [0x2b3b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.409315:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+120:39029:x1731745946338496:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1386us (1481us total) trans 12885078679 rc 0/0 00000100:00100000:0.0:1651529344.409318:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210621 00010000:00010000:0.0:1651529344.409336:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000411ac620/0x3234de053c4fb53 lrc: 2/0,0 mode: PW/PW res: [0x2b3ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.409348:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000411ac620 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.409349:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000411ac620/0x3234de053c4fb53 lrc: 2/0,0 mode: PW/PW res: [0x2b3ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.409360:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.409361:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000411ac620/0x3234de053c4fb53 lrc: 3/0,0 mode: PW/PW res: [0x2b3ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.409371:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000411ac620/0x3234de053c4fb53 lrc: 1/0,0 mode: --/PW res: [0x2b3ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.409374:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000411ac620/0x3234de053c4fb53 lrc: 0/0,0 mode: --/PW res: [0x2b3ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.409377:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.409386:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.409388:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396219840 00000100:00100000:1.0:1651529344.409394:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.409401:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c4e6df lrc: 4/0,0 mode: PR/PR res: [0x2b3b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c44 expref: 1941 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.409403:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.409411:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946339072 00000100:00100000:1.0:1651529344.409417:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946339328 00000100:00100000:1.0:1651529344.409420:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946339456 00000100:00100000:1.0:1651529344.409423:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946339392 00000100:00100000:1.0:1651529344.409429:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946339520 00000100:00100000:1.0:1651529344.409433:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210626 00000100:00100000:1.0:1651529344.409435:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+124:39030:x1731745946339072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.409440:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177074 count 1 00000100:00100000:0.0:1651529344.409444:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11407 00000100:00100000:0.0:1651529344.409447:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1941:41279:x1731746396219840:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.409450:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.409452:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c4e6df lrc: 4/0,0 mode: PR/PR res: [0x2b3b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c44 expref: 1941 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.409457:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c7e55f5/0x3234de053c4fb76 lrc: 3/0,1 mode: --/PW res: [0x2b3b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.409462:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ae6df91b/0x3234de053c4df61 lrc: 2/0,0 mode: PR/PR res: [0x2b3b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ea7 expref: 1941 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.409465:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.409465:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c4e6df lrc: 3/0,0 mode: PR/PR res: [0x2b3b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c44 expref: 1941 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.409466:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.409467:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c7e55f5/0x3234de053c4fb76 lrc: 4/0,1 mode: --/PW res: [0x2b3b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.409471:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c4e6df lrc: 0/0,0 mode: --/PR res: [0x2b3b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c44 expref: 1941 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.409473:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ae6df91b/0x3234de053c4df61 lrc: 3/0,0 mode: PR/PR res: [0x2b3b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ea7 expref: 1941 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.409475:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.409476:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.409477:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ae6df91b/0x3234de053c4df61 lrc: 4/0,0 mode: PR/PR res: [0x2b3b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ea7 expref: 1940 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.409477:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c4fb6f lrc: 3/0,1 mode: PW/PW res: [0x2b3b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.409480:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c4fb6f lrc: 4/0,1 mode: PW/PW res: [0x2b3b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.409481:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c43262d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996946816:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.409489:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.409497:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 000000007d8fabda going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.409499:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1940:41279:x1731746396219840:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 52us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.409501:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11407 00000100:00100000:1.0:1651529344.409503:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210627 00000100:00100000:1.0:1651529344.409505:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+124:39029:x1731745946339328:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.409509:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177075 count 1 00000100:00100000:0.0:1651529344.409511:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210628 00000100:00100000:0.0:1651529344.409512:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+124:39030:x1731745946339456:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.409513:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000069f47d6/0x3234de053c4fb7d lrc: 3/0,1 mode: --/PW res: [0x2b3b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.409517:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c4dfd1 lrc: 2/0,0 mode: PR/PR res: [0x2b3b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3083 expref: 1939 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.409518:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177077 count 1 00010000:00010000:1.0:1651529344.409520:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.409521:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.409522:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000069f47d6/0x3234de053c4fb7d lrc: 4/0,1 mode: --/PW res: [0x2b3b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.409522:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000315faada/0x3234de053c4fb84 lrc: 3/0,1 mode: --/PW res: [0x2b3b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.409526:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000349fa4b1/0x3234de053c4d638 lrc: 2/0,0 mode: PR/PR res: [0x2b3b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a73 expref: 1939 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.409528:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c4dfd1 lrc: 3/0,0 mode: PR/PR res: [0x2b3b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3083 expref: 1939 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.409529:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.409530:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.409531:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c4dfd1 lrc: 4/0,0 mode: PR/PR res: [0x2b3b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3083 expref: 1939 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.409531:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000315faada/0x3234de053c4fb84 lrc: 4/0,1 mode: --/PW res: [0x2b3b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.409535:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ee8cd7c9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996946880:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.409537:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000349fa4b1/0x3234de053c4d638 lrc: 3/0,0 mode: PR/PR res: [0x2b3b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a73 expref: 1939 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.409541:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 0000000018ebe812 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.409541:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000349fa4b1/0x3234de053c4d638 lrc: 4/0,0 mode: PR/PR res: [0x2b3b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a73 expref: 1939 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.409545:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996946944:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.409546:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c4fb6f lrc: 3/0,1 mode: PW/PW res: [0x2b3b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.409549:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c4fb6f lrc: 3/0,1 mode: PW/PW res: [0x2b3b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.409552:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c4fb6f lrc: 3/0,1 mode: PW/PW res: [0x2b3b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.409553:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000124f6b49 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.409555:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c4fb6f lrc: 2/0,0 mode: PW/PW res: [0x2b3b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.409559:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210629 00000100:00100000:0.0:1651529344.409561:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+124:39029:x1731745946339392:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.409573:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177076 count 1 00010000:00010000:0.0:1651529344.409576:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c4fb8b lrc: 3/0,1 mode: --/PW res: [0x2b3b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.409583:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008cdb8783/0x3234de053c4f0a9 lrc: 2/0,0 mode: PR/PR res: [0x2b3b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d755d expref: 1939 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.409586:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.409587:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.409588:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c4fb8b lrc: 4/0,1 mode: --/PW res: [0x2b3b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.409593:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008cdb8783/0x3234de053c4f0a9 lrc: 3/0,0 mode: PR/PR res: [0x2b3b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d755d expref: 1939 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.409596:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008cdb8783/0x3234de053c4f0a9 lrc: 4/0,0 mode: PR/PR res: [0x2b3b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d755d expref: 1939 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.409598:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+125:39030:x1731745946338752:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 891us (1038us total) trans 12885078680 rc 0/0 00000100:00100000:0.0:1651529344.409600:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996947008:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.409601:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210625 00000100:00100000:1.0:1651529344.409606:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210630 00000100:00100000:0.0:1651529344.409607:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000382571b5 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.409608:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+124:39029:x1731745946339520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.409612:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177078 count 1 00010000:00010000:0.0:1651529344.409612:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c4fb6f lrc: 2/0,0 mode: PW/PW res: [0x2b3b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.409615:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000059e60bfb already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.409616:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba8f87a2/0x3234de053c4fb92 lrc: 3/0,1 mode: --/PW res: [0x2b3b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.409616:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c4fb6f lrc: 2/0,0 mode: PW/PW res: [0x2b3b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.409619:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c4fb6f lrc: 3/0,0 mode: PW/PW res: [0x2b3b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.409620:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009ce8a004/0x3234de053c4e335 lrc: 2/0,0 mode: PR/PR res: [0x2b3b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3dcd expref: 1939 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.409623:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.409623:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c4fb6f lrc: 1/0,0 mode: --/PW res: [0x2b3b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.409624:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.409625:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba8f87a2/0x3234de053c4fb92 lrc: 4/0,1 mode: --/PW res: [0x2b3b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.409626:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c4fb6f lrc: 0/0,0 mode: --/PW res: [0x2b3b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.409631:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009ce8a004/0x3234de053c4e335 lrc: 3/0,0 mode: PR/PR res: [0x2b3b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3dcd expref: 1939 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.409634:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009ce8a004/0x3234de053c4e335 lrc: 4/0,0 mode: PR/PR res: [0x2b3b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3dcd expref: 1939 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.409641:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000095d7eb1a pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996947072:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.409648:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 0000000020dd7827 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.409664:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.409678:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.409754:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946339648 00000100:00100000:1.0:1651529344.409761:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946339712 00000100:00100000:1.0:1651529344.409770:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210631 00000100:00100000:1.0:1651529344.409771:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+126:39029:x1731745946339648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.409775:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210632 00002000:00080000:1.0:1651529344.409777:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177079 count 1 00000100:00100000:0.0:1651529344.409777:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+126:39030:x1731745946339712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.409781:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ce7109a/0x3234de053c4fb99 lrc: 3/0,1 mode: --/PW res: [0x2b3b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.409782:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177080 count 1 00010000:00010000:0.0:1651529344.409785:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c4fba0 lrc: 3/0,1 mode: --/PW res: [0x2b3b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.409786:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004b00577e/0x3234de053c4f691 lrc: 2/0,0 mode: PR/PR res: [0x2b3b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8cf6 expref: 1939 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.409789:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.409789:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.409790:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ce7109a/0x3234de053c4fb99 lrc: 4/0,1 mode: --/PW res: [0x2b3b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.409790:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000915ac1d0/0x3234de053c4f2ee lrc: 2/0,0 mode: PR/PR res: [0x2b3b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e7f expref: 1939 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.409793:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.409793:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.409794:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c4fba0 lrc: 4/0,1 mode: --/PW res: [0x2b3b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.409796:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004b00577e/0x3234de053c4f691 lrc: 3/0,0 mode: PR/PR res: [0x2b3b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8cf6 expref: 1939 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.409800:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004b00577e/0x3234de053c4f691 lrc: 4/0,0 mode: PR/PR res: [0x2b3b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8cf6 expref: 1939 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.409801:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000915ac1d0/0x3234de053c4f2ee lrc: 3/0,0 mode: PR/PR res: [0x2b3b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e7f expref: 1939 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.409804:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000915ac1d0/0x3234de053c4f2ee lrc: 4/0,0 mode: PR/PR res: [0x2b3b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e7f expref: 1939 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.409807:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000999005e pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996947136:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.409817:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b52d0f36 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.409827:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996947200:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.409832:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.409836:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 0000000064b9c5f3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.409868:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946339776 00000100:00100000:1.0:1651529344.409876:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210633 00000100:00100000:1.0:1651529344.409878:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+127:39030:x1731745946339776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.409883:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177081 count 1 00010000:00010000:1.0:1651529344.409892:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af439eec/0x3234de053c4fba7 lrc: 3/0,1 mode: --/PW res: [0x2b3b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.409897:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c4cda9 lrc: 2/0,0 mode: PR/PR res: [0x2b3b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce85a expref: 1939 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.409900:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.409901:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.409901:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af439eec/0x3234de053c4fba7 lrc: 4/0,1 mode: --/PW res: [0x2b3b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.409908:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c4cda9 lrc: 3/0,0 mode: PR/PR res: [0x2b3b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce85a expref: 1939 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.409911:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c4cda9 lrc: 4/0,0 mode: PR/PR res: [0x2b3b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce85a expref: 1939 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.409915:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000065f5e47d pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996947264:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.409924:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b7af823 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.409969:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c43262d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996946816:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.409974:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007c7e55f5/0x3234de053c4fb76 lrc: 3/0,1 mode: --/PW res: [0x2b3b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.409997:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ee8cd7c9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996946880:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.410000:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000069f47d6/0x3234de053c4fb7d lrc: 3/0,1 mode: --/PW res: [0x2b3b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.410358:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000999005e pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996947136:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.410368:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007ce7109a/0x3234de053c4fb99 lrc: 3/0,1 mode: --/PW res: [0x2b3b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.410375:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000095d7eb1a pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996947072:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.410378:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ba8f87a2/0x3234de053c4fb92 lrc: 3/0,1 mode: --/PW res: [0x2b3b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.410379:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996946944:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.410384:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000315faada/0x3234de053c4fb84 lrc: 3/0,1 mode: --/PW res: [0x2b3b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.410402:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996947008:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.410416:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.410426:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.410434:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.410442:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.410444:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c4fb8b lrc: 3/0,1 mode: --/PW res: [0x2b3b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.410453:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396220288 00010000:00010000:0.0:1651529344.410458:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ae6df91b/0x3234de053c4df61 lrc: 4/0,0 mode: PR/PR res: [0x2b3b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ea7 expref: 1940 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.410463:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396220480 00000100:00100000:1.0:1651529344.410464:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.410465:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c4dfd1 lrc: 4/0,0 mode: PR/PR res: [0x2b3b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3083 expref: 1941 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.410470:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396220608 00000100:00100000:1.0:1651529344.410471:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.410472:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008cdb8783/0x3234de053c4f0a9 lrc: 4/0,0 mode: PR/PR res: [0x2b3b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d755d expref: 1942 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.410476:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.410476:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396220736 00010000:00010000:0.0:1651529344.410478:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004b00577e/0x3234de053c4f691 lrc: 4/0,0 mode: PR/PR res: [0x2b3b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8cf6 expref: 1943 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.410482:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396220544 00010000:00010000:0.0:1651529344.410484:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000349fa4b1/0x3234de053c4d638 lrc: 4/0,0 mode: PR/PR res: [0x2b3b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a73 expref: 1944 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.410486:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.410488:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396220672 00010000:00010000:0.0:1651529344.410490:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009ce8a004/0x3234de053c4e335 lrc: 4/0,0 mode: PR/PR res: [0x2b3b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3dcd expref: 1945 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.410494:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000065f5e47d pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996947264:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.410495:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396220800 00010000:00010000:1.0:1651529344.410497:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000af439eec/0x3234de053c4fba7 lrc: 3/0,1 mode: --/PW res: [0x2b3b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410497:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000915ac1d0/0x3234de053c4f2ee lrc: 5/0,0 mode: PR/PR res: [0x2b3b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e7f expref: 1946 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.410500:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396220864 00010000:00010000:0.0:1651529344.410502:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c4cda9 lrc: 4/0,0 mode: PR/PR res: [0x2b3b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce85a expref: 1947 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.410505:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11408 00000100:00100000:1.0:1651529344.410507:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1947:41278:x1731746396220288:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.410508:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11409 00000100:00100000:0.0:1651529344.410509:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1947:41278:x1731746396220480:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.410510:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.410512:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ae6df91b/0x3234de053c4df61 lrc: 4/0,0 mode: PR/PR res: [0x2b3b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ea7 expref: 1947 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.410512:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.410514:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c4dfd1 lrc: 4/0,0 mode: PR/PR res: [0x2b3b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3083 expref: 1947 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.410516:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ae6df91b/0x3234de053c4df61 lrc: 3/0,0 mode: PR/PR res: [0x2b3b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ea7 expref: 1947 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.410517:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c4dfd1 lrc: 3/0,0 mode: PR/PR res: [0x2b3b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3083 expref: 1947 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.410522:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae6df91b/0x3234de053c4df61 lrc: 0/0,0 mode: --/PR res: [0x2b3b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ea7 expref: 1947 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.410523:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c4dfd1 lrc: 0/0,0 mode: --/PR res: [0x2b3b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3083 expref: 1947 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.410526:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.410526:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.410526:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.410527:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007c7e55f5/0x3234de053c4fb76 lrc: 3/0,1 mode: PW/PW res: [0x2b3b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410527:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.410528:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000069f47d6/0x3234de053c4fb7d lrc: 3/0,1 mode: PW/PW res: [0x2b3b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.410531:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c7e55f5/0x3234de053c4fb76 lrc: 4/0,1 mode: PW/PW res: [0x2b3b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410533:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000069f47d6/0x3234de053c4fb7d lrc: 4/0,1 mode: PW/PW res: [0x2b3b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.410537:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.410544:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.410551:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1945:41278:x1731746396220288:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 44us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.410552:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1945:41278:x1731746396220480:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.410554:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11408 00000100:00100000:0.0:1651529344.410556:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11409 00000100:00100000:1.0:1651529344.410561:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11410 00000100:00100000:1.0:1651529344.410562:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1943:41278:x1731746396220608:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.410562:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11411 00000100:00100000:0.0:1651529344.410564:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1943:41278:x1731746396220736:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.410565:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.410566:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.410567:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008cdb8783/0x3234de053c4f0a9 lrc: 4/0,0 mode: PR/PR res: [0x2b3b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d755d expref: 1943 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.410568:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004b00577e/0x3234de053c4f691 lrc: 4/0,0 mode: PR/PR res: [0x2b3b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8cf6 expref: 1943 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.410571:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008cdb8783/0x3234de053c4f0a9 lrc: 3/0,0 mode: PR/PR res: [0x2b3b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d755d expref: 1943 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.410572:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004b00577e/0x3234de053c4f691 lrc: 3/0,0 mode: PR/PR res: [0x2b3b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8cf6 expref: 1943 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.410576:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008cdb8783/0x3234de053c4f0a9 lrc: 0/0,0 mode: --/PR res: [0x2b3b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d755d expref: 1943 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.410578:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b00577e/0x3234de053c4f691 lrc: 0/0,0 mode: --/PR res: [0x2b3b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8cf6 expref: 1943 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.410579:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.410579:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.410580:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c4fb8b lrc: 3/0,1 mode: PW/PW res: [0x2b3b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410582:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.410582:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.410583:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c4fb8b lrc: 4/0,1 mode: PW/PW res: [0x2b3b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410583:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007ce7109a/0x3234de053c4fb99 lrc: 3/0,1 mode: PW/PW res: [0x2b3b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410586:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ce7109a/0x3234de053c4fb99 lrc: 4/0,1 mode: PW/PW res: [0x2b3b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.410593:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.410599:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1941:41278:x1731746396220608:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.410601:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11410 00010000:00010000:0.0:1651529344.410604:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.410610:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1940:41278:x1731746396220736:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 45us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.410612:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11412 00000100:00100000:1.0:1651529344.410613:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1940:41279:x1731746396220544:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.410613:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11411 00010000:00010000:1.0:1651529344.410616:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.410618:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000349fa4b1/0x3234de053c4d638 lrc: 4/0,0 mode: PR/PR res: [0x2b3b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a73 expref: 1939 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.410618:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11413 00000100:00100000:0.0:1651529344.410620:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de6bf351 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1939:41279:x1731746396220672:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.410622:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000349fa4b1/0x3234de053c4d638 lrc: 3/0,0 mode: PR/PR res: [0x2b3b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a73 expref: 1939 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.410622:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.410624:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009ce8a004/0x3234de053c4e335 lrc: 4/0,0 mode: PR/PR res: [0x2b3b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3dcd expref: 1939 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.410626:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000349fa4b1/0x3234de053c4d638 lrc: 0/0,0 mode: --/PR res: [0x2b3b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a73 expref: 1939 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.410627:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009ce8a004/0x3234de053c4e335 lrc: 3/0,0 mode: PR/PR res: [0x2b3b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3dcd expref: 1939 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.410630:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.410630:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.410631:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000315faada/0x3234de053c4fb84 lrc: 3/0,1 mode: PW/PW res: [0x2b3b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410632:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ce8a004/0x3234de053c4e335 lrc: 0/0,0 mode: --/PR res: [0x2b3b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3dcd expref: 1938 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.410634:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000315faada/0x3234de053c4fb84 lrc: 4/0,1 mode: PW/PW res: [0x2b3b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410636:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.410636:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.410637:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba8f87a2/0x3234de053c4fb92 lrc: 3/0,1 mode: PW/PW res: [0x2b3b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410640:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba8f87a2/0x3234de053c4fb92 lrc: 4/0,1 mode: PW/PW res: [0x2b3b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.410643:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.410648:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1937:41279:x1731746396220544:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.410651:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11412 00010000:00010000:0.0:1651529344.410654:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.410660:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de6bf351 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1936:41279:x1731746396220672:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 39us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.410662:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11414 00000100:00100000:1.0:1651529344.410663:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1936:41279:x1731746396220800:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.410663:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11413 00010000:00010000:1.0:1651529344.410666:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.410668:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000915ac1d0/0x3234de053c4f2ee lrc: 5/0,0 mode: PR/PR res: [0x2b3b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e7f expref: 1935 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.410671:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000915ac1d0/0x3234de053c4f2ee lrc: 4/0,0 mode: PR/PR res: [0x2b3b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e7f expref: 1935 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.410671:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11415 00000100:00100000:0.0:1651529344.410673:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1935:41278:x1731746396220864:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.410676:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.410676:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.410677:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.410677:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c4fba0 lrc: 3/0,1 mode: PW/PW res: [0x2b3b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410677:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c4cda9 lrc: 4/0,0 mode: PR/PR res: [0x2b3b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce85a expref: 1935 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.410680:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c4fba0 lrc: 4/0,1 mode: PW/PW res: [0x2b3b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410681:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c4cda9 lrc: 3/0,0 mode: PR/PR res: [0x2b3b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce85a expref: 1935 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.410685:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.410686:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c4cda9 lrc: 0/0,0 mode: --/PR res: [0x2b3b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce85a expref: 1935 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.410689:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1934:41279:x1731746396220800:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 26us (213us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.410689:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.410690:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.410691:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000af439eec/0x3234de053c4fba7 lrc: 3/0,1 mode: PW/PW res: [0x2b3b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.410692:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11414 00010000:00010000:0.0:1651529344.410694:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af439eec/0x3234de053c4fba7 lrc: 4/0,1 mode: PW/PW res: [0x2b3b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.410698:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000069f47d6/0x3234de053c4fb7d lrc: 3/0,1 mode: PW/PW res: [0x2b3b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410702:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.410707:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000069f47d6/0x3234de053c4fb7d lrc: 3/0,1 mode: PW/PW res: [0x2b3b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.410707:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1933:41278:x1731746396220864:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 33us (221us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.410710:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000069f47d6/0x3234de053c4fb7d lrc: 3/0,1 mode: PW/PW res: [0x2b3b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.410710:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11415 00010000:00010000:1.0:1651529344.410713:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000069f47d6/0x3234de053c4fb7d lrc: 2/0,0 mode: PW/PW res: [0x2b3b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410717:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000315faada/0x3234de053c4fb84 lrc: 3/0,1 mode: PW/PW res: [0x2b3b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410726:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000315faada/0x3234de053c4fb84 lrc: 3/0,1 mode: PW/PW res: [0x2b3b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410729:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000315faada/0x3234de053c4fb84 lrc: 3/0,1 mode: PW/PW res: [0x2b3b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410732:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000315faada/0x3234de053c4fb84 lrc: 2/0,0 mode: PW/PW res: [0x2b3b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.410770:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+129:39029:x1731745946339328:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1264us (1392us total) trans 12885078681 rc 0/0 00000100:00100000:1.0:1651529344.410773:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210627 00010000:00010000:1.0:1651529344.410780:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ba8f87a2/0x3234de053c4fb92 lrc: 3/0,1 mode: PW/PW res: [0x2b3b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.410783:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba8f87a2/0x3234de053c4fb92 lrc: 3/0,1 mode: PW/PW res: [0x2b3b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.410785:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+128:39030:x1731745946339456:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1272us (1398us total) trans 12885078682 rc 0/0 00010000:00010000:1.0:1651529344.410786:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba8f87a2/0x3234de053c4fb92 lrc: 3/0,1 mode: PW/PW res: [0x2b3b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.410789:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba8f87a2/0x3234de053c4fb92 lrc: 2/0,0 mode: PW/PW res: [0x2b3b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.410789:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210628 00010000:00010000:0.0:1651529344.410805:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000069f47d6/0x3234de053c4fb7d lrc: 2/0,0 mode: PW/PW res: [0x2b3b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410808:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000069f47d6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.410809:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000069f47d6/0x3234de053c4fb7d lrc: 2/0,0 mode: PW/PW res: [0x2b3b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410812:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000069f47d6/0x3234de053c4fb7d lrc: 3/0,0 mode: PW/PW res: [0x2b3b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410817:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000069f47d6/0x3234de053c4fb7d lrc: 1/0,0 mode: --/PW res: [0x2b3b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410820:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000069f47d6/0x3234de053c4fb7d lrc: 0/0,0 mode: --/PW res: [0x2b3b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410825:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000315faada/0x3234de053c4fb84 lrc: 2/0,0 mode: PW/PW res: [0x2b3b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410827:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000315faada already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.410828:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000315faada/0x3234de053c4fb84 lrc: 2/0,0 mode: PW/PW res: [0x2b3b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.410829:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+128:39029:x1731745946339520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1220us (1425us total) trans 12885078683 rc 0/0 00010000:00010000:0.0:1651529344.410831:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000315faada/0x3234de053c4fb84 lrc: 3/0,0 mode: PW/PW res: [0x2b3b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.410832:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210630 00010000:00010000:0.0:1651529344.410834:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000315faada/0x3234de053c4fb84 lrc: 1/0,0 mode: --/PW res: [0x2b3b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410837:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000315faada/0x3234de053c4fb84 lrc: 0/0,0 mode: --/PW res: [0x2b3b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.410838:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007ce7109a/0x3234de053c4fb99 lrc: 3/0,1 mode: PW/PW res: [0x2b3b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410840:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba8f87a2/0x3234de053c4fb92 lrc: 2/0,0 mode: PW/PW res: [0x2b3b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.410841:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ce7109a/0x3234de053c4fb99 lrc: 3/0,1 mode: PW/PW res: [0x2b3b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410842:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba8f87a2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.410843:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba8f87a2/0x3234de053c4fb92 lrc: 2/0,0 mode: PW/PW res: [0x2b3b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.410844:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ce7109a/0x3234de053c4fb99 lrc: 3/0,1 mode: PW/PW res: [0x2b3b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410846:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba8f87a2/0x3234de053c4fb92 lrc: 3/0,0 mode: PW/PW res: [0x2b3b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.410847:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ce7109a/0x3234de053c4fb99 lrc: 2/0,0 mode: PW/PW res: [0x2b3b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410849:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba8f87a2/0x3234de053c4fb92 lrc: 1/0,0 mode: --/PW res: [0x2b3b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410852:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba8f87a2/0x3234de053c4fb92 lrc: 0/0,0 mode: --/PW res: [0x2b3b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410855:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ce7109a/0x3234de053c4fb99 lrc: 2/0,0 mode: PW/PW res: [0x2b3b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410858:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007ce7109a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.410858:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ce7109a/0x3234de053c4fb99 lrc: 2/0,0 mode: PW/PW res: [0x2b3b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410861:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ce7109a/0x3234de053c4fb99 lrc: 3/0,0 mode: PW/PW res: [0x2b3b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410864:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ce7109a/0x3234de053c4fb99 lrc: 1/0,0 mode: --/PW res: [0x2b3b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410867:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ce7109a/0x3234de053c4fb99 lrc: 0/0,0 mode: --/PW res: [0x2b3b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410874:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c4fb8b lrc: 3/0,1 mode: PW/PW res: [0x2b3b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.410876:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+128:39029:x1731745946339648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1103us (1212us total) trans 12885078684 rc 0/0 00010000:00010000:0.0:1651529344.410876:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c4fb8b lrc: 3/0,1 mode: PW/PW res: [0x2b3b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.410879:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210631 00010000:00010000:0.0:1651529344.410879:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c4fb8b lrc: 3/0,1 mode: PW/PW res: [0x2b3b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410882:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c4fb8b lrc: 2/0,0 mode: PW/PW res: [0x2b3b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.410885:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000af439eec/0x3234de053c4fba7 lrc: 3/0,1 mode: PW/PW res: [0x2b3b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.410888:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af439eec/0x3234de053c4fba7 lrc: 3/0,1 mode: PW/PW res: [0x2b3b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.410891:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af439eec/0x3234de053c4fba7 lrc: 3/0,1 mode: PW/PW res: [0x2b3b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.410894:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af439eec/0x3234de053c4fba7 lrc: 2/0,0 mode: PW/PW res: [0x2b3b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.410926:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+129:39029:x1731745946339392:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1364us (1531us total) trans 12885078685 rc 0/0 00000100:00100000:0.0:1651529344.410929:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210629 00000100:00100000:1.0:1651529344.410931:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+129:39030:x1731745946339776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1052us (1099us total) trans 12885078686 rc 0/0 00000100:00100000:1.0:1651529344.410934:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210633 00010000:00010000:0.0:1651529344.410936:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c4fb8b lrc: 2/0,0 mode: PW/PW res: [0x2b3b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410939:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000078e8c25c already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.410940:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007c7e55f5/0x3234de053c4fb76 lrc: 3/0,1 mode: PW/PW res: [0x2b3b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410940:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c4fb8b lrc: 2/0,0 mode: PW/PW res: [0x2b3b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.410943:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c7e55f5/0x3234de053c4fb76 lrc: 3/0,1 mode: PW/PW res: [0x2b3b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410943:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c4fb8b lrc: 3/0,0 mode: PW/PW res: [0x2b3b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.410946:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c7e55f5/0x3234de053c4fb76 lrc: 3/0,1 mode: PW/PW res: [0x2b3b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410947:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c4fb8b lrc: 1/0,0 mode: --/PW res: [0x2b3b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.410949:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c7e55f5/0x3234de053c4fb76 lrc: 2/0,0 mode: PW/PW res: [0x2b3b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410950:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c4fb8b lrc: 0/0,0 mode: --/PW res: [0x2b3b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410954:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af439eec/0x3234de053c4fba7 lrc: 2/0,0 mode: PW/PW res: [0x2b3b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410957:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000af439eec already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.410964:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af439eec/0x3234de053c4fba7 lrc: 2/0,0 mode: PW/PW res: [0x2b3b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410967:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af439eec/0x3234de053c4fba7 lrc: 3/0,0 mode: PW/PW res: [0x2b3b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410971:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af439eec/0x3234de053c4fba7 lrc: 1/0,0 mode: --/PW res: [0x2b3b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410973:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af439eec/0x3234de053c4fba7 lrc: 0/0,0 mode: --/PW res: [0x2b3b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410977:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c7e55f5/0x3234de053c4fb76 lrc: 2/0,0 mode: PW/PW res: [0x2b3b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410979:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007c7e55f5 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.410980:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c7e55f5/0x3234de053c4fb76 lrc: 2/0,0 mode: PW/PW res: [0x2b3b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410983:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c7e55f5/0x3234de053c4fb76 lrc: 3/0,0 mode: PW/PW res: [0x2b3b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.410986:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c7e55f5/0x3234de053c4fb76 lrc: 1/0,0 mode: --/PW res: [0x2b3b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.410988:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+128:39030:x1731745946339072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1552us (1628us total) trans 12885078687 rc 0/0 00010000:00010000:0.0:1651529344.410988:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c7e55f5/0x3234de053c4fb76 lrc: 0/0,0 mode: --/PW res: [0x2b3b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.410991:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210626 00010000:00010000:0.0:1651529344.411000:0:156655:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000915ac1d0/0x3234de053c4f2ee lrc: 0/0,0 mode: --/PR res: [0x2b3b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e7f expref: 1932 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.411004:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996947200:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.411008:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c4fba0 lrc: 3/0,1 mode: PW/PW res: [0x2b3b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.411011:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c4fba0 lrc: 3/0,1 mode: PW/PW res: [0x2b3b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.411014:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c4fba0 lrc: 3/0,1 mode: PW/PW res: [0x2b3b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.411016:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c4fba0 lrc: 3/0,1 mode: PW/PW res: [0x2b3b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.411019:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c4fba0 lrc: 2/0,0 mode: PW/PW res: [0x2b3b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.411054:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+128:39030:x1731745946339712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1277us (1375us total) trans 12885078688 rc 0/0 00000100:00100000:0.0:1651529344.411057:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210632 00010000:00010000:0.0:1651529344.411064:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c4fba0 lrc: 2/0,0 mode: PW/PW res: [0x2b3b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.411067:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000005a52f96 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.411068:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c4fba0 lrc: 2/0,0 mode: PW/PW res: [0x2b3b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.411073:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c4fba0 lrc: 3/0,0 mode: PW/PW res: [0x2b3b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.411078:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c4fba0 lrc: 1/0,0 mode: --/PW res: [0x2b3b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.411080:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c4fba0 lrc: 0/0,0 mode: --/PW res: [0x2b3b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.411351:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.411365:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946340352 00000100:00100000:1.0:1651529344.411368:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.411376:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946340480 00000100:00100000:0.0:1651529344.411382:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210634 00000100:00100000:1.0:1651529344.411383:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.411384:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a13808c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+129:39029:x1731745946340352:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.411389:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177082 count 1 00000100:00100000:1.0:1651529344.411390:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.411394:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b33925b5/0x3234de053c4fbae lrc: 3/0,1 mode: --/PW res: [0x2b3ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.411396:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.411399:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c4ce82 lrc: 2/0,0 mode: PR/PR res: [0x2b3ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec2e expref: 1931 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.411406:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.411408:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.411409:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.411410:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b33925b5/0x3234de053c4fbae lrc: 4/0,1 mode: --/PW res: [0x2b3ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.411412:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.411417:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c4ce82 lrc: 3/0,0 mode: PR/PR res: [0x2b3ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec2e expref: 1931 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.411419:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.411428:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946340416 00010000:00010000:0.0:1651529344.411429:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c4ce82 lrc: 4/0,0 mode: PR/PR res: [0x2b3ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec2e expref: 1931 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.411434:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996947328:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.411437:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946340544 00000100:00100000:1.0:1651529344.411441:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946340672 00000100:00100000:1.0:1651529344.411443:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946340800 00000100:00100000:1.0:1651529344.411445:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946340608 00000100:00100000:1.0:1651529344.411447:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946340736 00000100:00100000:1.0:1651529344.411450:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210635 00000100:00100000:0.0:1651529344.411453:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 000000007b78c9d8 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.411457:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+135:39030:x1731745946340480:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.411460:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210636 00000100:00100000:0.0:1651529344.411462:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009faff76b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+135:39029:x1731745946340416:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.411463:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177084 count 1 00002000:00080000:0.0:1651529344.411466:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177083 count 1 00010000:00010000:1.0:1651529344.411467:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001afd79ee/0x3234de053c4fbb5 lrc: 3/0,1 mode: --/PW res: [0x2b3bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.411470:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c4fbbc lrc: 3/0,1 mode: --/PW res: [0x2b3bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.411472:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f7f046d7/0x3234de053c4e1e5 lrc: 2/0,0 mode: PR/PR res: [0x2b3bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d38be expref: 1931 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.411474:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff2320b2/0x3234de053c4e710 lrc: 2/0,0 mode: PR/PR res: [0x2b3bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d32 expref: 1931 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.411475:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.411476:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.411477:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001afd79ee/0x3234de053c4fbb5 lrc: 4/0,1 mode: --/PW res: [0x2b3bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.411478:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.411478:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.411479:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c4fbbc lrc: 4/0,1 mode: --/PW res: [0x2b3bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.411485:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f7f046d7/0x3234de053c4e1e5 lrc: 3/0,0 mode: PR/PR res: [0x2b3bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d38be expref: 1931 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.411485:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ff2320b2/0x3234de053c4e710 lrc: 3/0,0 mode: PR/PR res: [0x2b3bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d32 expref: 1931 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.411488:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ff2320b2/0x3234de053c4e710 lrc: 4/0,0 mode: PR/PR res: [0x2b3bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d32 expref: 1931 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.411489:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f7f046d7/0x3234de053c4e1e5 lrc: 4/0,0 mode: PR/PR res: [0x2b3bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d38be expref: 1931 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.411493:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a130088 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996947392:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.411495:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996947456:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.411502:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 0000000020dd7827 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.411503:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f9dd6aa3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.411509:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210637 00000100:00100000:1.0:1651529344.411511:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+135:39029:x1731745946340544:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.411513:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210638 00002000:00080000:1.0:1651529344.411515:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177085 count 1 00000100:00100000:0.0:1651529344.411515:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+135:39029:x1731745946340672:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.411518:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c4fbc3 lrc: 3/0,1 mode: --/PW res: [0x2b3bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.411519:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177087 count 1 00010000:00010000:1.0:1651529344.411523:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c4f001 lrc: 2/0,0 mode: PR/PR res: [0x2b3bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d72a8 expref: 1931 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.411523:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c4fbca lrc: 3/0,1 mode: --/PW res: [0x2b3bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.411526:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.411526:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.411527:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c4fbc3 lrc: 4/0,1 mode: --/PW res: [0x2b3bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.411527:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005960f1ad/0x3234de053c4a030 lrc: 2/0,0 mode: PR/PR res: [0x2b3bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb67a expref: 1931 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.411530:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.411530:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.411531:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c4fbca lrc: 4/0,1 mode: --/PW res: [0x2b3bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.411533:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c4f001 lrc: 3/0,0 mode: PR/PR res: [0x2b3bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d72a8 expref: 1931 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.411537:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005960f1ad/0x3234de053c4a030 lrc: 3/0,0 mode: PR/PR res: [0x2b3bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb67a expref: 1931 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.411539:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c4f001 lrc: 4/0,0 mode: PR/PR res: [0x2b3bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d72a8 expref: 1931 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.411541:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005960f1ad/0x3234de053c4a030 lrc: 4/0,0 mode: PR/PR res: [0x2b3bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb67a expref: 1931 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.411543:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d718cfe4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996947520:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.411544:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996947584:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.411549:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b52d0f36 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.411551:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000124f6b49 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.411554:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210639 00000100:00100000:1.0:1651529344.411556:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+135:39029:x1731745946340800:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.411557:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210640 00000100:00100000:0.0:1651529344.411558:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+135:39030:x1731745946340608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.411559:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177089 count 1 00002000:00080000:0.0:1651529344.411562:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177086 count 1 00010000:00010000:1.0:1651529344.411563:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000046cb20e/0x3234de053c4fbd1 lrc: 3/0,1 mode: --/PW res: [0x2b3c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.411565:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c4fbd8 lrc: 3/0,1 mode: --/PW res: [0x2b3be:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.411567:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004d5eac2c/0x3234de053c4e5c0 lrc: 2/0,0 mode: PR/PR res: [0x2b3c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d48a1 expref: 1931 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.411570:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.411570:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.411570:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004ac46eec/0x3234de053c4ce20 lrc: 2/0,0 mode: PR/PR res: [0x2b3be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce9c6 expref: 1931 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.411571:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000046cb20e/0x3234de053c4fbd1 lrc: 4/0,1 mode: --/PW res: [0x2b3c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.411572:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.411573:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.411573:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c4fbd8 lrc: 4/0,1 mode: --/PW res: [0x2b3be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.411577:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004d5eac2c/0x3234de053c4e5c0 lrc: 3/0,0 mode: PR/PR res: [0x2b3c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d48a1 expref: 1931 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.411579:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004ac46eec/0x3234de053c4ce20 lrc: 3/0,0 mode: PR/PR res: [0x2b3be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce9c6 expref: 1931 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.411580:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004d5eac2c/0x3234de053c4e5c0 lrc: 4/0,0 mode: PR/PR res: [0x2b3c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d48a1 expref: 1931 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.411583:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004ac46eec/0x3234de053c4ce20 lrc: 4/0,0 mode: PR/PR res: [0x2b3be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce9c6 expref: 1931 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.411586:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996947712:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.411587:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000900b179f pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996947648:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.411592:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a52ee82 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.411593:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000018ebe812 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.411597:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210641 00000100:00100000:0.0:1651529344.411599:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+135:39030:x1731745946340736:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.411603:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177088 count 1 00010000:00010000:0.0:1651529344.411606:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000610e679c/0x3234de053c4fbdf lrc: 3/0,1 mode: --/PW res: [0x2b3c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.411612:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009acdc117/0x3234de053c4c9b2 lrc: 2/0,0 mode: PR/PR res: [0x2b3c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd8bd expref: 1931 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.411615:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.411615:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.411616:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000610e679c/0x3234de053c4fbdf lrc: 4/0,1 mode: --/PW res: [0x2b3c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.411621:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009acdc117/0x3234de053c4c9b2 lrc: 3/0,0 mode: PR/PR res: [0x2b3c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd8bd expref: 1931 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.411624:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009acdc117/0x3234de053c4c9b2 lrc: 4/0,0 mode: PR/PR res: [0x2b3c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd8bd expref: 1931 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.411628:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996947776:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.411637:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 000000001ec7f4cb going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.411871:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996947328:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.411875:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b33925b5/0x3234de053c4fbae lrc: 3/0,1 mode: --/PW res: [0x2b3ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.411893:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a130088 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996947392:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.411897:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001afd79ee/0x3234de053c4fbb5 lrc: 3/0,1 mode: --/PW res: [0x2b3bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.411941:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996947456:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.411944:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c4fbbc lrc: 3/0,1 mode: --/PW res: [0x2b3bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.411995:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996947584:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.411998:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c4fbca lrc: 3/0,1 mode: --/PW res: [0x2b3bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.412011:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996947712:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.412014:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d718cfe4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996947520:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.412014:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c4fbd8 lrc: 3/0,1 mode: --/PW res: [0x2b3be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.412018:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c4fbc3 lrc: 3/0,1 mode: --/PW res: [0x2b3bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.412025:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000900b179f pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996947648:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.412027:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000046cb20e/0x3234de053c4fbd1 lrc: 3/0,1 mode: --/PW res: [0x2b3c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.412292:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996947776:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.412293:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.412301:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000610e679c/0x3234de053c4fbdf lrc: 3/0,1 mode: --/PW res: [0x2b3c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.412302:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.412310:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.412319:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.412320:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396221312 00010000:00010000:0.0:1651529344.412325:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c4ce82 lrc: 4/0,0 mode: PR/PR res: [0x2b3ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec2e expref: 1932 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.412327:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.412331:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11416 00000100:00100000:1.0:1651529344.412332:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.412333:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1932:41279:x1731746396221312:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.412335:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.412337:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c4ce82 lrc: 4/0,0 mode: PR/PR res: [0x2b3ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec2e expref: 1932 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.412338:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.412341:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c4ce82 lrc: 3/0,0 mode: PR/PR res: [0x2b3ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec2e expref: 1932 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.412343:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.412346:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c4ce82 lrc: 0/0,0 mode: --/PR res: [0x2b3ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec2e expref: 1932 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.412349:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396221376 00010000:00010000:0.0:1651529344.412350:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.412351:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.412352:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b33925b5/0x3234de053c4fbae lrc: 3/0,1 mode: PW/PW res: [0x2b3ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.412354:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f7f046d7/0x3234de053c4e1e5 lrc: 4/0,0 mode: PR/PR res: [0x2b3bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d38be expref: 1932 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.412355:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b33925b5/0x3234de053c4fbae lrc: 4/0,1 mode: PW/PW res: [0x2b3ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.412361:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396221440 00010000:00010000:0.0:1651529344.412361:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.412363:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ff2320b2/0x3234de053c4e710 lrc: 4/0,0 mode: PR/PR res: [0x2b3bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d32 expref: 1933 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.412367:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396221568 00010000:00010000:1.0:1651529344.412369:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005960f1ad/0x3234de053c4a030 lrc: 4/0,0 mode: PR/PR res: [0x2b3bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb67a expref: 1934 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.412374:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1934:41279:x1731746396221312:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 41us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.412377:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11416 00000100:00100000:1.0:1651529344.412380:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396221696 00010000:00010000:1.0:1651529344.412383:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004d5eac2c/0x3234de053c4e5c0 lrc: 4/0,0 mode: PR/PR res: [0x2b3c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d48a1 expref: 1934 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.412383:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396221504 00010000:00010000:0.0:1651529344.412386:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c4f001 lrc: 4/0,0 mode: PR/PR res: [0x2b3bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d72a8 expref: 1935 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.412387:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396221632 00010000:00010000:1.0:1651529344.412390:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004ac46eec/0x3234de053c4ce20 lrc: 4/0,0 mode: PR/PR res: [0x2b3be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce9c6 expref: 1936 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.412391:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396221760 00010000:00010000:0.0:1651529344.412393:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009acdc117/0x3234de053c4c9b2 lrc: 4/0,0 mode: PR/PR res: [0x2b3c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd8bd expref: 1937 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.412395:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11417 00000100:00100000:1.0:1651529344.412396:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1937:41279:x1731746396221376:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.412399:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.412399:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11418 00010000:00010000:1.0:1651529344.412400:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f7f046d7/0x3234de053c4e1e5 lrc: 4/0,0 mode: PR/PR res: [0x2b3bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d38be expref: 1937 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.412400:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1937:41279:x1731746396221440:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.412403:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.412404:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f7f046d7/0x3234de053c4e1e5 lrc: 3/0,0 mode: PR/PR res: [0x2b3bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d38be expref: 1937 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.412404:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ff2320b2/0x3234de053c4e710 lrc: 4/0,0 mode: PR/PR res: [0x2b3bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d32 expref: 1937 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.412410:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7f046d7/0x3234de053c4e1e5 lrc: 0/0,0 mode: --/PR res: [0x2b3bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d38be expref: 1937 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.412410:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ff2320b2/0x3234de053c4e710 lrc: 3/0,0 mode: PR/PR res: [0x2b3bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d32 expref: 1937 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.412414:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.412415:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.412415:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff2320b2/0x3234de053c4e710 lrc: 0/0,0 mode: --/PR res: [0x2b3bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d32 expref: 1936 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.412416:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001afd79ee/0x3234de053c4fbb5 lrc: 3/0,1 mode: PW/PW res: [0x2b3bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.412419:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001afd79ee/0x3234de053c4fbb5 lrc: 4/0,1 mode: PW/PW res: [0x2b3bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412419:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.412419:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.412420:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c4fbbc lrc: 3/0,1 mode: PW/PW res: [0x2b3bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412423:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c4fbbc lrc: 4/0,1 mode: PW/PW res: [0x2b3bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.412425:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.412429:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.412432:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1935:41279:x1731746396221376:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 35us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.412435:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11417 00000100:00100000:0.0:1651529344.412435:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1935:41279:x1731746396221440:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 34us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.412437:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11418 00000100:00100000:1.0:1651529344.412440:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11419 00000100:00100000:1.0:1651529344.412441:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1933:41279:x1731746396221568:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.412442:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11420 00010000:00010000:1.0:1651529344.412443:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.412444:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000d49c4f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1933:41279:x1731746396221696:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.412445:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005960f1ad/0x3234de053c4a030 lrc: 4/0,0 mode: PR/PR res: [0x2b3bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb67a expref: 1933 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.412446:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.412447:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004d5eac2c/0x3234de053c4e5c0 lrc: 4/0,0 mode: PR/PR res: [0x2b3c1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d48a1 expref: 1933 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.412448:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005960f1ad/0x3234de053c4a030 lrc: 3/0,0 mode: PR/PR res: [0x2b3bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb67a expref: 1933 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.412451:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004d5eac2c/0x3234de053c4e5c0 lrc: 3/0,0 mode: PR/PR res: [0x2b3c1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d48a1 expref: 1933 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.412453:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005960f1ad/0x3234de053c4a030 lrc: 0/0,0 mode: --/PR res: [0x2b3bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb67a expref: 1933 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.412456:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.412456:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d5eac2c/0x3234de053c4e5c0 lrc: 0/0,0 mode: --/PR res: [0x2b3c1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d48a1 expref: 1932 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.412457:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.412458:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c4fbca lrc: 3/0,1 mode: PW/PW res: [0x2b3bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412459:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.412460:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.412461:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c4fbca lrc: 4/0,1 mode: PW/PW res: [0x2b3bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412461:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000046cb20e/0x3234de053c4fbd1 lrc: 3/0,1 mode: PW/PW res: [0x2b3c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412463:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000046cb20e/0x3234de053c4fbd1 lrc: 4/0,1 mode: PW/PW res: [0x2b3c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.412471:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.412478:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.412482:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1931:41279:x1731746396221568:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.412484:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11419 00000100:00100000:0.0:1651529344.412484:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000d49c4f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1931:41279:x1731746396221696:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.412487:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11420 00000100:00100000:1.0:1651529344.412489:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11421 00000100:00100000:1.0:1651529344.412490:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1929:41278:x1731746396221504:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.412493:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.412494:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c4f001 lrc: 4/0,0 mode: PR/PR res: [0x2b3bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d72a8 expref: 1929 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.412495:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11422 00000100:00100000:0.0:1651529344.412497:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1929:41278:x1731746396221632:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.412498:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c4f001 lrc: 3/0,0 mode: PR/PR res: [0x2b3bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d72a8 expref: 1929 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.412499:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.412501:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004ac46eec/0x3234de053c4ce20 lrc: 4/0,0 mode: PR/PR res: [0x2b3be:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce9c6 expref: 1929 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.412503:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c4f001 lrc: 0/0,0 mode: --/PR res: [0x2b3bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d72a8 expref: 1929 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.412504:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004ac46eec/0x3234de053c4ce20 lrc: 3/0,0 mode: PR/PR res: [0x2b3be:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce9c6 expref: 1929 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.412506:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.412507:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.412508:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c4fbc3 lrc: 3/0,1 mode: PW/PW res: [0x2b3bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412509:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ac46eec/0x3234de053c4ce20 lrc: 0/0,0 mode: --/PR res: [0x2b3be:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce9c6 expref: 1928 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.412513:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c4fbc3 lrc: 4/0,1 mode: PW/PW res: [0x2b3bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412515:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.412515:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.412516:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c4fbd8 lrc: 3/0,1 mode: PW/PW res: [0x2b3be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.412519:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.412519:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c4fbd8 lrc: 4/0,1 mode: PW/PW res: [0x2b3be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.412523:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1927:41278:x1731746396221504:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 32us (191us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.412525:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.412526:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11421 00000100:00100000:1.0:1651529344.412530:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11423 00000100:00100000:0.0:1651529344.412530:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1926:41278:x1731746396221632:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 32us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.412531:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1926:41278:x1731746396221760:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.412532:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11422 00010000:00010000:1.0:1651529344.412533:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.412535:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009acdc117/0x3234de053c4c9b2 lrc: 4/0,0 mode: PR/PR res: [0x2b3c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd8bd expref: 1925 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.412539:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009acdc117/0x3234de053c4c9b2 lrc: 3/0,0 mode: PR/PR res: [0x2b3c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd8bd expref: 1925 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.412539:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c4fbbc lrc: 3/0,1 mode: PW/PW res: [0x2b3bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412542:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c4fbbc lrc: 3/0,1 mode: PW/PW res: [0x2b3bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.412543:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009acdc117/0x3234de053c4c9b2 lrc: 0/0,0 mode: --/PR res: [0x2b3c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd8bd expref: 1925 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.412545:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c4fbbc lrc: 3/0,1 mode: PW/PW res: [0x2b3bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.412546:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.412547:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.412548:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000610e679c/0x3234de053c4fbdf lrc: 3/0,1 mode: PW/PW res: [0x2b3c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412548:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c4fbbc lrc: 2/0,0 mode: PW/PW res: [0x2b3bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.412551:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000610e679c/0x3234de053c4fbdf lrc: 4/0,1 mode: PW/PW res: [0x2b3c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.412562:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.412568:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1924:41278:x1731746396221760:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 36us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.412570:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11423 00010000:00010000:1.0:1651529344.412576:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c4fbc3 lrc: 3/0,1 mode: PW/PW res: [0x2b3bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.412580:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c4fbc3 lrc: 3/0,1 mode: PW/PW res: [0x2b3bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.412583:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c4fbc3 lrc: 3/0,1 mode: PW/PW res: [0x2b3bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.412586:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c4fbc3 lrc: 2/0,0 mode: PW/PW res: [0x2b3bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.412608:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009faff76b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+136:39029:x1731745946340416:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1145us (1225us total) trans 12885078689 rc 0/0 00000100:00100000:0.0:1651529344.412611:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210636 00010000:00010000:0.0:1651529344.412619:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c4fbbc lrc: 2/0,0 mode: PW/PW res: [0x2b3bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412622:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000096a880d5 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.412623:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c4fbbc lrc: 2/0,0 mode: PW/PW res: [0x2b3bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412626:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c4fbbc lrc: 3/0,0 mode: PW/PW res: [0x2b3bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412631:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c4fbbc lrc: 1/0,0 mode: --/PW res: [0x2b3bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412633:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c4fbbc lrc: 0/0,0 mode: --/PW res: [0x2b3bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.412637:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+136:39029:x1731745946340544:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1126us (1247us total) trans 12885078690 rc 0/0 00010000:00010000:0.0:1651529344.412637:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c4fbc3 lrc: 2/0,0 mode: PW/PW res: [0x2b3bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412640:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c8f63a78 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.412641:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210637 00010000:00010000:0.0:1651529344.412641:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c4fbc3 lrc: 2/0,0 mode: PW/PW res: [0x2b3bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412644:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c4fbc3 lrc: 3/0,0 mode: PW/PW res: [0x2b3bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412647:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c4fbc3 lrc: 1/0,0 mode: --/PW res: [0x2b3bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.412648:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001afd79ee/0x3234de053c4fbb5 lrc: 3/0,1 mode: PW/PW res: [0x2b3bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.412651:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001afd79ee/0x3234de053c4fbb5 lrc: 3/0,1 mode: PW/PW res: [0x2b3bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412652:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c4fbc3 lrc: 0/0,0 mode: --/PW res: [0x2b3bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.412654:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001afd79ee/0x3234de053c4fbb5 lrc: 3/0,1 mode: PW/PW res: [0x2b3bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.412657:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001afd79ee/0x3234de053c4fbb5 lrc: 2/0,0 mode: PW/PW res: [0x2b3bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412659:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c4fbd8 lrc: 3/0,1 mode: PW/PW res: [0x2b3be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412662:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c4fbd8 lrc: 3/0,1 mode: PW/PW res: [0x2b3be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412670:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c4fbd8 lrc: 3/0,1 mode: PW/PW res: [0x2b3be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412673:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c4fbd8 lrc: 2/0,0 mode: PW/PW res: [0x2b3be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.412696:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+137:39030:x1731745946340480:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1238us (1327us total) trans 12885078691 rc 0/0 00000100:00100000:1.0:1651529344.412699:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210635 00010000:00010000:1.0:1651529344.412705:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000046cb20e/0x3234de053c4fbd1 lrc: 3/0,1 mode: PW/PW res: [0x2b3c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.412708:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000046cb20e/0x3234de053c4fbd1 lrc: 3/0,1 mode: PW/PW res: [0x2b3c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.412710:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+136:39030:x1731745946340608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1151us (1297us total) trans 12885078692 rc 0/0 00010000:00010000:1.0:1651529344.412711:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000046cb20e/0x3234de053c4fbd1 lrc: 3/0,1 mode: PW/PW res: [0x2b3c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.412713:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210640 00010000:00010000:1.0:1651529344.412714:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000046cb20e/0x3234de053c4fbd1 lrc: 2/0,0 mode: PW/PW res: [0x2b3c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412729:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001afd79ee/0x3234de053c4fbb5 lrc: 2/0,0 mode: PW/PW res: [0x2b3bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412733:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001afd79ee already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.412743:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001afd79ee/0x3234de053c4fbb5 lrc: 2/0,0 mode: PW/PW res: [0x2b3bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412747:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001afd79ee/0x3234de053c4fbb5 lrc: 3/0,0 mode: PW/PW res: [0x2b3bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412752:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001afd79ee/0x3234de053c4fbb5 lrc: 1/0,0 mode: --/PW res: [0x2b3bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412755:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001afd79ee/0x3234de053c4fbb5 lrc: 0/0,0 mode: --/PW res: [0x2b3bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412759:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c4fbd8 lrc: 2/0,0 mode: PW/PW res: [0x2b3be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.412760:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+136:39029:x1731745946340800:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1203us (1353us total) trans 12885078693 rc 0/0 00010000:00010000:0.0:1651529344.412762:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ee8bd35b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.412762:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c4fbd8 lrc: 2/0,0 mode: PW/PW res: [0x2b3be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.412763:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210639 00010000:00010000:0.0:1651529344.412765:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c4fbd8 lrc: 3/0,0 mode: PW/PW res: [0x2b3be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412768:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c4fbd8 lrc: 1/0,0 mode: --/PW res: [0x2b3be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412771:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c4fbd8 lrc: 0/0,0 mode: --/PW res: [0x2b3be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412774:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000046cb20e/0x3234de053c4fbd1 lrc: 2/0,0 mode: PW/PW res: [0x2b3c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412777:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000046cb20e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.412777:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000046cb20e/0x3234de053c4fbd1 lrc: 2/0,0 mode: PW/PW res: [0x2b3c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412780:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000046cb20e/0x3234de053c4fbd1 lrc: 3/0,0 mode: PW/PW res: [0x2b3c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412784:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000046cb20e/0x3234de053c4fbd1 lrc: 1/0,0 mode: --/PW res: [0x2b3c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412786:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000046cb20e/0x3234de053c4fbd1 lrc: 0/0,0 mode: --/PW res: [0x2b3c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412793:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c4fbca lrc: 3/0,1 mode: PW/PW res: [0x2b3bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412796:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c4fbca lrc: 3/0,1 mode: PW/PW res: [0x2b3bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412799:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c4fbca lrc: 3/0,1 mode: PW/PW res: [0x2b3bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412801:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c4fbca lrc: 2/0,0 mode: PW/PW res: [0x2b3bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.412838:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+136:39029:x1731745946340672:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1322us (1441us total) trans 12885078694 rc 0/0 00000100:00100000:0.0:1651529344.412841:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210638 00010000:00010000:0.0:1651529344.412848:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c4fbca lrc: 2/0,0 mode: PW/PW res: [0x2b3bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412853:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000009ec9189 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.412854:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c4fbca lrc: 2/0,0 mode: PW/PW res: [0x2b3bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412857:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c4fbca lrc: 3/0,0 mode: PW/PW res: [0x2b3bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412861:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c4fbca lrc: 1/0,0 mode: --/PW res: [0x2b3bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412864:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c4fbca lrc: 0/0,0 mode: --/PW res: [0x2b3bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412869:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000610e679c/0x3234de053c4fbdf lrc: 3/0,1 mode: PW/PW res: [0x2b3c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412872:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000610e679c/0x3234de053c4fbdf lrc: 3/0,1 mode: PW/PW res: [0x2b3c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412875:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000610e679c/0x3234de053c4fbdf lrc: 3/0,1 mode: PW/PW res: [0x2b3c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412878:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000610e679c/0x3234de053c4fbdf lrc: 2/0,0 mode: PW/PW res: [0x2b3c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.412950:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+136:39030:x1731745946340736:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1350us (1530us total) trans 12885078695 rc 0/0 00000100:00100000:0.0:1651529344.412953:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210641 00010000:00010000:0.0:1651529344.412960:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000610e679c/0x3234de053c4fbdf lrc: 2/0,0 mode: PW/PW res: [0x2b3c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412964:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000610e679c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.412965:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000610e679c/0x3234de053c4fbdf lrc: 2/0,0 mode: PW/PW res: [0x2b3c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412968:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000610e679c/0x3234de053c4fbdf lrc: 3/0,0 mode: PW/PW res: [0x2b3c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412972:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000610e679c/0x3234de053c4fbdf lrc: 1/0,0 mode: --/PW res: [0x2b3c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412975:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000610e679c/0x3234de053c4fbdf lrc: 0/0,0 mode: --/PW res: [0x2b3c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412980:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b33925b5/0x3234de053c4fbae lrc: 3/0,1 mode: PW/PW res: [0x2b3ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412983:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b33925b5/0x3234de053c4fbae lrc: 3/0,1 mode: PW/PW res: [0x2b3ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412986:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b33925b5/0x3234de053c4fbae lrc: 3/0,1 mode: PW/PW res: [0x2b3ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.412989:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b33925b5/0x3234de053c4fbae lrc: 2/0,0 mode: PW/PW res: [0x2b3ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.413049:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a13808c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+136:39029:x1731745946340352:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1664us (1698us total) trans 12885078696 rc 0/0 00000100:00100000:0.0:1651529344.413053:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210634 00010000:00010000:0.0:1651529344.413073:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b33925b5/0x3234de053c4fbae lrc: 2/0,0 mode: PW/PW res: [0x2b3ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.413077:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b33925b5 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.413077:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b33925b5/0x3234de053c4fbae lrc: 2/0,0 mode: PW/PW res: [0x2b3ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.413080:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b33925b5/0x3234de053c4fbae lrc: 3/0,0 mode: PW/PW res: [0x2b3ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.413085:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b33925b5/0x3234de053c4fbae lrc: 1/0,0 mode: --/PW res: [0x2b3ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.413087:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b33925b5/0x3234de053c4fbae lrc: 0/0,0 mode: --/PW res: [0x2b3ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.413124:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.413135:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.413150:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946341440 00000100:00100000:0.0:1651529344.413157:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946341568 00000100:00100000:0.0:1651529344.413166:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210642 00000100:00100000:0.0:1651529344.413167:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+137:39029:x1731745946341440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.413171:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.413173:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177091 count 1 00000100:00100000:1.0:1651529344.413180:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.413183:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ecdd226/0x3234de053c4fbe6 lrc: 3/0,1 mode: --/PW res: [0x2b3c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.413187:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.413190:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009fcb879f/0x3234de053c4f6ec lrc: 2/0,0 mode: PR/PR res: [0x2b3c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8e23 expref: 1923 pid: 156655 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.413194:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.413194:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.413194:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.413195:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ecdd226/0x3234de053c4fbe6 lrc: 4/0,1 mode: --/PW res: [0x2b3c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.413203:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946341376 00010000:00010000:0.0:1651529344.413207:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009fcb879f/0x3234de053c4f6ec lrc: 3/0,0 mode: PR/PR res: [0x2b3c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8e23 expref: 1923 pid: 156655 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.413210:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946341504 00010000:00010000:0.0:1651529344.413211:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009fcb879f/0x3234de053c4f6ec lrc: 4/0,0 mode: PR/PR res: [0x2b3c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8e23 expref: 1923 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.413213:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946341632 00000100:00100000:1.0:1651529344.413216:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946341696 00000100:00100000:1.0:1651529344.413220:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210643 00000100:00100000:1.0:1651529344.413241:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+141:39029:x1731745946341568:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.413261:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177093 count 1 00000100:00100000:0.0:1651529344.413262:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996947840:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.413266:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f3c2fb2/0x3234de053c4fbed lrc: 3/0,1 mode: --/PW res: [0x2b3c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.413271:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1838eab/0x3234de053c4d1a0 lrc: 2/0,0 mode: PR/PR res: [0x2b3c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf805 expref: 1923 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.413276:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f9dd6aa3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.413279:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.413280:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.413281:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f3c2fb2/0x3234de053c4fbed lrc: 4/0,1 mode: --/PW res: [0x2b3c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.413283:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210644 00000100:00100000:0.0:1651529344.413285:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+141:39030:x1731745946341376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.413289:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f1838eab/0x3234de053c4d1a0 lrc: 3/0,0 mode: PR/PR res: [0x2b3c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf805 expref: 1923 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.413291:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177090 count 1 00010000:00010000:1.0:1651529344.413293:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f1838eab/0x3234de053c4d1a0 lrc: 4/0,0 mode: PR/PR res: [0x2b3c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf805 expref: 1923 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.413294:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004273867c/0x3234de053c4fbf4 lrc: 3/0,1 mode: --/PW res: [0x2b3c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.413297:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000057329b82 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996947904:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.413299:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a9e60cf2/0x3234de053c4e684 lrc: 2/0,0 mode: PR/PR res: [0x2b3c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4abc expref: 1923 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.413302:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.413303:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.413303:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004273867c/0x3234de053c4fbf4 lrc: 4/0,1 mode: --/PW res: [0x2b3c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.413307:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cfa1ca05 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.413310:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a9e60cf2/0x3234de053c4e684 lrc: 3/0,0 mode: PR/PR res: [0x2b3c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4abc expref: 1923 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.413313:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210645 00010000:00010000:0.0:1651529344.413314:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a9e60cf2/0x3234de053c4e684 lrc: 4/0,0 mode: PR/PR res: [0x2b3c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4abc expref: 1923 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.413315:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+141:39030:x1731745946341504:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.413318:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996947968:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.413320:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177092 count 1 00010000:00010000:1.0:1651529344.413324:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5b283df/0x3234de053c4fbfb lrc: 3/0,1 mode: --/PW res: [0x2b3c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.413325:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 000000007b78c9d8 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.413328:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008e578053/0x3234de053c4dcba lrc: 2/0,0 mode: PR/PR res: [0x2b3c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2332 expref: 1923 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.413331:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.413331:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.413331:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210646 00010000:00010000:1.0:1651529344.413332:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5b283df/0x3234de053c4fbfb lrc: 4/0,1 mode: --/PW res: [0x2b3c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.413333:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+141:39030:x1731745946341632:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.413337:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177094 count 1 00010000:00010000:1.0:1651529344.413338:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008e578053/0x3234de053c4dcba lrc: 3/0,0 mode: PR/PR res: [0x2b3c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2332 expref: 1923 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.413340:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bb75065/0x3234de053c4fc02 lrc: 3/0,1 mode: --/PW res: [0x2b3c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.413342:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008e578053/0x3234de053c4dcba lrc: 4/0,0 mode: PR/PR res: [0x2b3c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2332 expref: 1923 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.413344:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dce56518/0x3234de053c4dcd6 lrc: 2/0,0 mode: PR/PR res: [0x2b3c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23f6 expref: 1923 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.413346:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006aa45e66 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996948032:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.413347:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.413347:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.413348:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009bb75065/0x3234de053c4fc02 lrc: 4/0,1 mode: --/PW res: [0x2b3c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.413352:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000412e5d26 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.413354:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dce56518/0x3234de053c4dcd6 lrc: 3/0,0 mode: PR/PR res: [0x2b3c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23f6 expref: 1923 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.413357:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210647 00000100:00100000:1.0:1651529344.413359:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+141:39029:x1731745946341696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.413360:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dce56518/0x3234de053c4dcd6 lrc: 4/0,0 mode: PR/PR res: [0x2b3c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23f6 expref: 1923 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:1.0:1651529344.413363:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177095 count 1 00000100:00100000:0.0:1651529344.413363:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996948096:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.413366:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c4fc09 lrc: 3/0,1 mode: --/PW res: [0x2b3c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.413370:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c4d29c lrc: 2/0,0 mode: PR/PR res: [0x2b3c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc2d expref: 1923 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.413370:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c29d18ba going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.413374:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.413374:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.413375:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c4fc09 lrc: 4/0,1 mode: --/PW res: [0x2b3c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.413381:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c4d29c lrc: 3/0,0 mode: PR/PR res: [0x2b3c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc2d expref: 1923 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.413384:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c4d29c lrc: 4/0,0 mode: PR/PR res: [0x2b3c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc2d expref: 1923 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.413388:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bca72234 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996948160:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.413394:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 000000004ca54b8a going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.413408:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.413423:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.413489:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946341824 00000100:00100000:1.0:1651529344.413496:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946341760 00000100:00100000:1.0:1651529344.413501:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210648 00000100:00100000:1.0:1651529344.413502:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+143:39029:x1731745946341824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.413507:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177097 count 1 00010000:00010000:1.0:1651529344.413511:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c4fc10 lrc: 3/0,1 mode: --/PW res: [0x2b3c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.413516:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a5772342/0x3234de053c4cb80 lrc: 2/0,0 mode: PR/PR res: [0x2b3c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdfc4 expref: 1923 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.413521:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.413522:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.413523:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c4fc10 lrc: 4/0,1 mode: --/PW res: [0x2b3c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.413529:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a5772342/0x3234de053c4cb80 lrc: 3/0,0 mode: PR/PR res: [0x2b3c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdfc4 expref: 1923 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.413532:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a5772342/0x3234de053c4cb80 lrc: 4/0,0 mode: PR/PR res: [0x2b3c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdfc4 expref: 1923 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.413536:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000673bcbe2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996948224:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.413546:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f79d8146 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.413552:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210649 00000100:00100000:1.0:1651529344.413553:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+143:39029:x1731745946341760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.413558:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177096 count 1 00010000:00010000:1.0:1651529344.413561:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c4fc17 lrc: 3/0,1 mode: --/PW res: [0x2b3c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.413565:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c4c6a9 lrc: 2/0,0 mode: PR/PR res: [0x2b3c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc6f expref: 1923 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.413567:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.413568:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.413569:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c4fc17 lrc: 4/0,1 mode: --/PW res: [0x2b3c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.413577:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c4c6a9 lrc: 3/0,0 mode: PR/PR res: [0x2b3c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc6f expref: 1923 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.413580:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c4c6a9 lrc: 4/0,0 mode: PR/PR res: [0x2b3c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc6f expref: 1923 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.413584:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f39ca9ea pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996948288:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.413590:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 0000000071742acc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.413664:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996947840:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.413674:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000057329b82 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996947904:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.413674:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007ecdd226/0x3234de053c4fbe6 lrc: 3/0,1 mode: --/PW res: [0x2b3c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.413679:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001f3c2fb2/0x3234de053c4fbed lrc: 3/0,1 mode: --/PW res: [0x2b3c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.413682:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996947968:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.413684:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004273867c/0x3234de053c4fbf4 lrc: 3/0,1 mode: --/PW res: [0x2b3c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.413755:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006aa45e66 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996948032:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.413757:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996948096:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.413759:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a5b283df/0x3234de053c4fbfb lrc: 3/0,1 mode: --/PW res: [0x2b3c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.413761:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009bb75065/0x3234de053c4fc02 lrc: 3/0,1 mode: --/PW res: [0x2b3c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.414098:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.414108:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.414109:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396222400 00000100:00100000:1.0:1651529344.414115:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.414115:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f1838eab/0x3234de053c4d1a0 lrc: 4/0,0 mode: PR/PR res: [0x2b3c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf805 expref: 1924 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.414125:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.414128:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396222528 00000100:00100000:1.0:1651529344.414131:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.414131:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a9e60cf2/0x3234de053c4e684 lrc: 4/0,0 mode: PR/PR res: [0x2b3c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4abc expref: 1925 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.414138:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396222336 00010000:00010000:0.0:1651529344.414140:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009fcb879f/0x3234de053c4f6ec lrc: 4/0,0 mode: PR/PR res: [0x2b3c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8e23 expref: 1926 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.414144:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396222464 00010000:00010000:0.0:1651529344.414146:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008e578053/0x3234de053c4dcba lrc: 4/0,0 mode: PR/PR res: [0x2b3c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2332 expref: 1927 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.414147:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.414150:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396222592 00010000:00010000:0.0:1651529344.414151:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dce56518/0x3234de053c4dcd6 lrc: 4/0,0 mode: PR/PR res: [0x2b3c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23f6 expref: 1928 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.414152:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.414156:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396222656 00000100:00100000:1.0:1651529344.414158:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.414158:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c4d29c lrc: 5/0,0 mode: PR/PR res: [0x2b3c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc2d expref: 1929 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.414162:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396222720 00010000:00010000:0.0:1651529344.414164:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a5772342/0x3234de053c4cb80 lrc: 5/0,0 mode: PR/PR res: [0x2b3c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdfc4 expref: 1930 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.414166:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bca72234 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996948160:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.414168:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396222848 00010000:00010000:1.0:1651529344.414170:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c4fc09 lrc: 3/0,1 mode: --/PW res: [0x2b3c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414170:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c4c6a9 lrc: 5/0,0 mode: PR/PR res: [0x2b3c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc6f expref: 1931 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.414174:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11424 00000100:00100000:0.0:1651529344.414176:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1931:41278:x1731746396222400:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.414177:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f39ca9ea pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996948288:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.414179:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c4fc17 lrc: 3/0,1 mode: --/PW res: [0x2b3c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414180:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.414181:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f1838eab/0x3234de053c4d1a0 lrc: 4/0,0 mode: PR/PR res: [0x2b3c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf805 expref: 1931 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.414185:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000673bcbe2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996948224:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.414185:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f1838eab/0x3234de053c4d1a0 lrc: 3/0,0 mode: PR/PR res: [0x2b3c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf805 expref: 1931 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.414187:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c4fc10 lrc: 3/0,1 mode: --/PW res: [0x2b3c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414191:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1838eab/0x3234de053c4d1a0 lrc: 0/0,0 mode: --/PR res: [0x2b3c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf805 expref: 1931 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.414194:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11425 00010000:00010000:0.0:1651529344.414194:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.414195:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.414196:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1930:41278:x1731746396222528:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.414196:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001f3c2fb2/0x3234de053c4fbed lrc: 3/0,1 mode: PW/PW res: [0x2b3c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414199:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.414199:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f3c2fb2/0x3234de053c4fbed lrc: 4/0,1 mode: PW/PW res: [0x2b3c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414201:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a9e60cf2/0x3234de053c4e684 lrc: 4/0,0 mode: PR/PR res: [0x2b3c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4abc expref: 1930 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.414205:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a9e60cf2/0x3234de053c4e684 lrc: 3/0,0 mode: PR/PR res: [0x2b3c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4abc expref: 1930 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.414209:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.414220:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1930:41278:x1731746396222400:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 43us (123us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.414221:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9e60cf2/0x3234de053c4e684 lrc: 0/0,0 mode: --/PR res: [0x2b3c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4abc expref: 1930 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.414238:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.414238:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11424 00010000:00010000:1.0:1651529344.414239:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.414240:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004273867c/0x3234de053c4fbf4 lrc: 3/0,1 mode: PW/PW res: [0x2b3c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414243:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004273867c/0x3234de053c4fbf4 lrc: 4/0,1 mode: PW/PW res: [0x2b3c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.414243:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11426 00000100:00100000:0.0:1651529344.414245:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1928:41278:x1731746396222336:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.414248:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.414251:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.414255:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009fcb879f/0x3234de053c4f6ec lrc: 4/0,0 mode: PR/PR res: [0x2b3c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8e23 expref: 1928 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.414259:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1928:41278:x1731746396222528:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 62us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.414261:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11425 00010000:00010000:0.0:1651529344.414262:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009fcb879f/0x3234de053c4f6ec lrc: 3/0,0 mode: PR/PR res: [0x2b3c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8e23 expref: 1928 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.414267:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fcb879f/0x3234de053c4f6ec lrc: 0/0,0 mode: --/PR res: [0x2b3c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8e23 expref: 1927 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.414268:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11427 00000100:00100000:1.0:1651529344.414269:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7bfdb64 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1927:41278:x1731746396222464:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.414270:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.414271:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.414272:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.414272:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007ecdd226/0x3234de053c4fbe6 lrc: 3/0,1 mode: PW/PW res: [0x2b3c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414273:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008e578053/0x3234de053c4dcba lrc: 4/0,0 mode: PR/PR res: [0x2b3c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2332 expref: 1926 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.414275:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ecdd226/0x3234de053c4fbe6 lrc: 4/0,1 mode: PW/PW res: [0x2b3c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414277:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008e578053/0x3234de053c4dcba lrc: 3/0,0 mode: PR/PR res: [0x2b3c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2332 expref: 1926 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.414281:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.414282:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e578053/0x3234de053c4dcba lrc: 0/0,0 mode: --/PR res: [0x2b3c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2332 expref: 1926 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.414286:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.414286:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.414287:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a5b283df/0x3234de053c4fbfb lrc: 3/0,1 mode: PW/PW res: [0x2b3c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.414287:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1925:41278:x1731746396222336:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 41us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.414289:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11426 00010000:00010000:1.0:1651529344.414290:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5b283df/0x3234de053c4fbfb lrc: 4/0,1 mode: PW/PW res: [0x2b3c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.414294:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11428 00000100:00100000:0.0:1651529344.414295:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1924:41278:x1731746396222592:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.414296:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.414298:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.414299:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dce56518/0x3234de053c4dcd6 lrc: 4/0,0 mode: PR/PR res: [0x2b3c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23f6 expref: 1924 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.414301:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7bfdb64 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1924:41278:x1731746396222464:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 31us (176us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.414303:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dce56518/0x3234de053c4dcd6 lrc: 3/0,0 mode: PR/PR res: [0x2b3c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23f6 expref: 1924 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.414304:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11427 00010000:00010000:0.0:1651529344.414307:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dce56518/0x3234de053c4dcd6 lrc: 0/0,0 mode: --/PR res: [0x2b3c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23f6 expref: 1923 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.414311:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.414311:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.414312:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11429 00010000:00010000:0.0:1651529344.414312:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009bb75065/0x3234de053c4fc02 lrc: 3/0,1 mode: PW/PW res: [0x2b3c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.414314:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1922:41278:x1731746396222656:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.414315:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009bb75065/0x3234de053c4fc02 lrc: 4/0,1 mode: PW/PW res: [0x2b3c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414316:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.414318:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c4d29c lrc: 4/0,0 mode: PR/PR res: [0x2b3c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc2d expref: 1922 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.414320:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.414321:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c4d29c lrc: 3/0,0 mode: PR/PR res: [0x2b3c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc2d expref: 1922 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.414325:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1922:41278:x1731746396222592:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 29us (194us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.414326:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c4d29c lrc: 0/0,0 mode: --/PR res: [0x2b3c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc2d expref: 1922 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.414327:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11428 00010000:00010000:1.0:1651529344.414329:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.414330:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.414330:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c4fc09 lrc: 3/0,1 mode: PW/PW res: [0x2b3c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.414331:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11430 00000100:00100000:0.0:1651529344.414332:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1920:41279:x1731746396222720:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.414333:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c4fc09 lrc: 4/0,1 mode: PW/PW res: [0x2b3c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414335:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.414336:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a5772342/0x3234de053c4cb80 lrc: 4/0,0 mode: PR/PR res: [0x2b3c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdfc4 expref: 1920 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.414339:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.414339:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a5772342/0x3234de053c4cb80 lrc: 3/0,0 mode: PR/PR res: [0x2b3c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdfc4 expref: 1920 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.414343:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1920:41278:x1731746396222656:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 29us (196us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.414344:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5772342/0x3234de053c4cb80 lrc: 0/0,0 mode: --/PR res: [0x2b3c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdfc4 expref: 1920 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.414346:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11429 00010000:00010000:0.0:1651529344.414349:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.414350:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11431 00010000:00010000:0.0:1651529344.414350:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.414351:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1918:41279:x1731746396222848:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.414351:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c4fc10 lrc: 3/0,1 mode: PW/PW res: [0x2b3c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414353:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c4fc10 lrc: 4/0,1 mode: PW/PW res: [0x2b3c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414354:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.414355:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c4c6a9 lrc: 4/0,0 mode: PR/PR res: [0x2b3c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc6f expref: 1918 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.414359:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c4c6a9 lrc: 3/0,0 mode: PR/PR res: [0x2b3c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc6f expref: 1918 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.414363:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.414368:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1918:41279:x1731746396222720:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (216us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.414370:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c4c6a9 lrc: 0/0,0 mode: --/PR res: [0x2b3c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc6f expref: 1918 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.414370:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11430 00010000:00010000:1.0:1651529344.414374:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.414375:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.414375:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c4fc17 lrc: 3/0,1 mode: PW/PW res: [0x2b3c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414378:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c4fc17 lrc: 4/0,1 mode: PW/PW res: [0x2b3c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414381:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004273867c/0x3234de053c4fbf4 lrc: 3/0,1 mode: PW/PW res: [0x2b3c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414384:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.414384:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004273867c/0x3234de053c4fbf4 lrc: 3/0,1 mode: PW/PW res: [0x2b3c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414387:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004273867c/0x3234de053c4fbf4 lrc: 3/0,1 mode: PW/PW res: [0x2b3c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.414389:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1916:41279:x1731746396222848:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (231us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.414390:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004273867c/0x3234de053c4fbf4 lrc: 2/0,0 mode: PW/PW res: [0x2b3c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.414392:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11431 00010000:00010000:1.0:1651529344.414398:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001f3c2fb2/0x3234de053c4fbed lrc: 3/0,1 mode: PW/PW res: [0x2b3c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414402:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f3c2fb2/0x3234de053c4fbed lrc: 3/0,1 mode: PW/PW res: [0x2b3c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414405:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f3c2fb2/0x3234de053c4fbed lrc: 3/0,1 mode: PW/PW res: [0x2b3c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414408:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f3c2fb2/0x3234de053c4fbed lrc: 2/0,0 mode: PW/PW res: [0x2b3c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.414444:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+145:39030:x1731745946341376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1157us (1273us total) trans 12885078697 rc 0/0 00000100:00100000:0.0:1651529344.414447:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210644 00010000:00010000:0.0:1651529344.414455:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004273867c/0x3234de053c4fbf4 lrc: 2/0,0 mode: PW/PW res: [0x2b3c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414458:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004273867c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.414459:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004273867c/0x3234de053c4fbf4 lrc: 2/0,0 mode: PW/PW res: [0x2b3c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.414462:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+144:39029:x1731745946341568:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1239us (1326us total) trans 12885078698 rc 0/0 00010000:00010000:0.0:1651529344.414462:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004273867c/0x3234de053c4fbf4 lrc: 3/0,0 mode: PW/PW res: [0x2b3c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.414465:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210643 00010000:00010000:0.0:1651529344.414466:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004273867c/0x3234de053c4fbf4 lrc: 1/0,0 mode: --/PW res: [0x2b3c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414469:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004273867c/0x3234de053c4fbf4 lrc: 0/0,0 mode: --/PW res: [0x2b3c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414472:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a5b283df/0x3234de053c4fbfb lrc: 3/0,1 mode: PW/PW res: [0x2b3c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414474:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f3c2fb2/0x3234de053c4fbed lrc: 2/0,0 mode: PW/PW res: [0x2b3c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414475:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5b283df/0x3234de053c4fbfb lrc: 3/0,1 mode: PW/PW res: [0x2b3c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414476:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001f3c2fb2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.414477:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f3c2fb2/0x3234de053c4fbed lrc: 2/0,0 mode: PW/PW res: [0x2b3c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414478:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5b283df/0x3234de053c4fbfb lrc: 3/0,1 mode: PW/PW res: [0x2b3c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414480:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f3c2fb2/0x3234de053c4fbed lrc: 3/0,0 mode: PW/PW res: [0x2b3c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414481:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5b283df/0x3234de053c4fbfb lrc: 2/0,0 mode: PW/PW res: [0x2b3c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414483:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f3c2fb2/0x3234de053c4fbed lrc: 1/0,0 mode: --/PW res: [0x2b3c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414494:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f3c2fb2/0x3234de053c4fbed lrc: 0/0,0 mode: --/PW res: [0x2b3c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414498:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5b283df/0x3234de053c4fbfb lrc: 2/0,0 mode: PW/PW res: [0x2b3c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414501:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5b283df already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.414501:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5b283df/0x3234de053c4fbfb lrc: 2/0,0 mode: PW/PW res: [0x2b3c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414504:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5b283df/0x3234de053c4fbfb lrc: 3/0,0 mode: PW/PW res: [0x2b3c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414507:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5b283df/0x3234de053c4fbfb lrc: 1/0,0 mode: --/PW res: [0x2b3c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414510:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5b283df/0x3234de053c4fbfb lrc: 0/0,0 mode: --/PW res: [0x2b3c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414517:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009bb75065/0x3234de053c4fc02 lrc: 3/0,1 mode: PW/PW res: [0x2b3c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.414518:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+144:39030:x1731745946341504:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1202us (1337us total) trans 12885078699 rc 0/0 00010000:00010000:0.0:1651529344.414519:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009bb75065/0x3234de053c4fc02 lrc: 3/0,1 mode: PW/PW res: [0x2b3c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.414522:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210645 00010000:00010000:0.0:1651529344.414522:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bb75065/0x3234de053c4fc02 lrc: 3/0,1 mode: PW/PW res: [0x2b3c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414525:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009bb75065/0x3234de053c4fc02 lrc: 2/0,0 mode: PW/PW res: [0x2b3c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414529:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c4fc09 lrc: 3/0,1 mode: PW/PW res: [0x2b3c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414532:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c4fc09 lrc: 3/0,1 mode: PW/PW res: [0x2b3c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414535:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c4fc09 lrc: 3/0,1 mode: PW/PW res: [0x2b3c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414538:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c4fc09 lrc: 2/0,0 mode: PW/PW res: [0x2b3c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.414568:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+145:39030:x1731745946341632:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1234us (1380us total) trans 12885078700 rc 0/0 00000100:00100000:0.0:1651529344.414571:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210646 00000100:00100000:1.0:1651529344.414576:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+144:39029:x1731745946341696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1216us (1382us total) trans 12885078701 rc 0/0 00010000:00010000:0.0:1651529344.414578:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009bb75065/0x3234de053c4fc02 lrc: 2/0,0 mode: PW/PW res: [0x2b3c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.414579:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210647 00010000:00010000:0.0:1651529344.414582:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009bb75065 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.414583:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009bb75065/0x3234de053c4fc02 lrc: 2/0,0 mode: PW/PW res: [0x2b3c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414585:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009bb75065/0x3234de053c4fc02 lrc: 3/0,0 mode: PW/PW res: [0x2b3c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414586:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c4fc17 lrc: 3/0,1 mode: PW/PW res: [0x2b3c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414590:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c4fc17 lrc: 3/0,1 mode: PW/PW res: [0x2b3c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414590:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009bb75065/0x3234de053c4fc02 lrc: 1/0,0 mode: --/PW res: [0x2b3c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414592:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009bb75065/0x3234de053c4fc02 lrc: 0/0,0 mode: --/PW res: [0x2b3c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414593:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c4fc17 lrc: 3/0,1 mode: PW/PW res: [0x2b3c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414595:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c4fc17 lrc: 2/0,0 mode: PW/PW res: [0x2b3c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414596:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c4fc09 lrc: 2/0,0 mode: PW/PW res: [0x2b3c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414599:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e02d2a50 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.414600:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c4fc09 lrc: 2/0,0 mode: PW/PW res: [0x2b3c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414603:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c4fc09 lrc: 3/0,0 mode: PW/PW res: [0x2b3c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414613:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c4fc09 lrc: 1/0,0 mode: --/PW res: [0x2b3c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414616:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c4fc09 lrc: 0/0,0 mode: --/PW res: [0x2b3c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414620:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c4fc17 lrc: 2/0,0 mode: PW/PW res: [0x2b3c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414622:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000fe54815 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.414623:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c4fc17 lrc: 2/0,0 mode: PW/PW res: [0x2b3c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414625:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c4fc17 lrc: 3/0,0 mode: PW/PW res: [0x2b3c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414628:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c4fc17 lrc: 1/0,0 mode: --/PW res: [0x2b3c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414631:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c4fc17 lrc: 0/0,0 mode: --/PW res: [0x2b3c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.414632:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+144:39029:x1731745946341760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1078us (1209us total) trans 12885078702 rc 0/0 00000100:00100000:1.0:1651529344.414635:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210649 00010000:00010000:0.0:1651529344.414637:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007ecdd226/0x3234de053c4fbe6 lrc: 3/0,1 mode: PW/PW res: [0x2b3c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414641:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c4fc10 lrc: 3/0,1 mode: PW/PW res: [0x2b3c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414641:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ecdd226/0x3234de053c4fbe6 lrc: 3/0,1 mode: PW/PW res: [0x2b3c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414644:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ecdd226/0x3234de053c4fbe6 lrc: 3/0,1 mode: PW/PW res: [0x2b3c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414645:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c4fc10 lrc: 3/0,1 mode: PW/PW res: [0x2b3c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414646:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ecdd226/0x3234de053c4fbe6 lrc: 2/0,0 mode: PW/PW res: [0x2b3c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414648:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c4fc10 lrc: 3/0,1 mode: PW/PW res: [0x2b3c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.414650:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c4fc10 lrc: 2/0,0 mode: PW/PW res: [0x2b3c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.414688:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+145:39029:x1731745946341440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1520us (1565us total) trans 12885078703 rc 0/0 00000100:00100000:1.0:1651529344.414689:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+145:39029:x1731745946341824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1186us (1281us total) trans 12885078704 rc 0/0 00000100:00100000:0.0:1651529344.414691:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210642 00000100:00100000:1.0:1651529344.414693:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210648 00010000:00010000:0.0:1651529344.414698:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ecdd226/0x3234de053c4fbe6 lrc: 2/0,0 mode: PW/PW res: [0x2b3c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414701:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007ecdd226 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.414702:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ecdd226/0x3234de053c4fbe6 lrc: 2/0,0 mode: PW/PW res: [0x2b3c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414705:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ecdd226/0x3234de053c4fbe6 lrc: 3/0,0 mode: PW/PW res: [0x2b3c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414709:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ecdd226/0x3234de053c4fbe6 lrc: 1/0,0 mode: --/PW res: [0x2b3c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414712:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ecdd226/0x3234de053c4fbe6 lrc: 0/0,0 mode: --/PW res: [0x2b3c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414716:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c4fc10 lrc: 2/0,0 mode: PW/PW res: [0x2b3c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414719:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a0607df4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.414720:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c4fc10 lrc: 2/0,0 mode: PW/PW res: [0x2b3c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414722:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c4fc10 lrc: 3/0,0 mode: PW/PW res: [0x2b3c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414725:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c4fc10 lrc: 1/0,0 mode: --/PW res: [0x2b3c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.414728:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c4fc10 lrc: 0/0,0 mode: --/PW res: [0x2b3c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.415024:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.415032:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.415042:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.415044:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946342400 00000100:00100000:1.0:1651529344.415049:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.415061:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946342336 00000100:00100000:0.0:1651529344.415068:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946342528 00000100:00100000:1.0:1651529344.415072:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946342464 00000100:00100000:1.0:1651529344.415085:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210650 00000100:00100000:1.0:1651529344.415086:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+147:39030:x1731745946342400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.415090:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210651 00000100:00100000:0.0:1651529344.415092:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+147:39029:x1731745946342336:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.415093:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177099 count 1 00010000:00010000:1.0:1651529344.415098:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c4fc1e lrc: 3/0,1 mode: --/PW res: [0x2b3cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.415103:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005de6f336/0x3234de053c4cb41 lrc: 2/0,0 mode: PR/PR res: [0x2b3cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde89 expref: 1915 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.415106:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.415107:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.415108:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c4fc1e lrc: 4/0,1 mode: --/PW res: [0x2b3cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.415114:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005de6f336/0x3234de053c4cb41 lrc: 3/0,0 mode: PR/PR res: [0x2b3cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde89 expref: 1915 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.415126:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177098 count 1 00010000:00010000:1.0:1651529344.415127:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005de6f336/0x3234de053c4cb41 lrc: 4/0,0 mode: PR/PR res: [0x2b3cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde89 expref: 1915 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.415131:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f39ca9ea pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996948352:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.415131:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c4fc25 lrc: 3/0,1 mode: --/PW res: [0x2b3ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.415136:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c4ca84 lrc: 2/0,0 mode: PR/PR res: [0x2b3ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdbb8 expref: 1915 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.415142:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b7af823 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.415142:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.415143:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.415143:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c4fc25 lrc: 4/0,1 mode: --/PW res: [0x2b3ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.415148:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210652 00000100:00100000:1.0:1651529344.415150:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+147:39029:x1731745946342464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.415150:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c4ca84 lrc: 3/0,0 mode: PR/PR res: [0x2b3ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdbb8 expref: 1915 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.415154:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c4ca84 lrc: 4/0,0 mode: PR/PR res: [0x2b3ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdbb8 expref: 1915 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:1.0:1651529344.415155:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177100 count 1 00000100:00100000:0.0:1651529344.415158:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996948416:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.415159:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4fc2c lrc: 3/0,1 mode: --/PW res: [0x2b3cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.415163:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea0ab3e9/0x3234de053c4c8cb lrc: 2/0,0 mode: PR/PR res: [0x2b3cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd4c6 expref: 1915 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.415166:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.415167:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.415168:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4fc2c lrc: 4/0,1 mode: --/PW res: [0x2b3cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.415168:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f9dd6aa3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.415174:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ea0ab3e9/0x3234de053c4c8cb lrc: 3/0,0 mode: PR/PR res: [0x2b3cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd4c6 expref: 1915 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.415176:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210653 00010000:00010000:1.0:1651529344.415177:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ea0ab3e9/0x3234de053c4c8cb lrc: 4/0,0 mode: PR/PR res: [0x2b3cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd4c6 expref: 1915 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.415178:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+147:39030:x1731745946342528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.415181:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006aa45e66 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996948480:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.415182:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177101 count 1 00010000:00010000:0.0:1651529344.415185:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066374bf8/0x3234de053c4fc33 lrc: 3/0,1 mode: --/PW res: [0x2b3cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.415188:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 0000000018ebe812 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.415189:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c4ce3c lrc: 2/0,0 mode: PR/PR res: [0x2b3cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea6e expref: 1915 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.415192:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.415193:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.415194:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066374bf8/0x3234de053c4fc33 lrc: 4/0,1 mode: --/PW res: [0x2b3cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.415202:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.415202:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c4ce3c lrc: 3/0,0 mode: PR/PR res: [0x2b3cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea6e expref: 1915 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.415205:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c4ce3c lrc: 4/0,0 mode: PR/PR res: [0x2b3cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea6e expref: 1915 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.415209:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996948544:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.415215:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.415216:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c29d18ba going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.415240:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946342656 00000100:00100000:1.0:1651529344.415242:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.415251:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946342592 00000100:00100000:0.0:1651529344.415256:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946342720 00000100:00100000:0.0:1651529344.415261:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210654 00000100:00100000:0.0:1651529344.415262:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+150:39030:x1731745946342656:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.415265:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.415267:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177103 count 1 00010000:00010000:0.0:1651529344.415276:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c4fc3a lrc: 3/0,1 mode: --/PW res: [0x2b3cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.415281:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000021e675a0/0x3234de053c4d4f6 lrc: 2/0,0 mode: PR/PR res: [0x2b3cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0605 expref: 1915 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.415284:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.415285:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.415286:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c4fc3a lrc: 4/0,1 mode: --/PW res: [0x2b3cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.415292:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000021e675a0/0x3234de053c4d4f6 lrc: 3/0,0 mode: PR/PR res: [0x2b3cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0605 expref: 1915 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.415295:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000021e675a0/0x3234de053c4d4f6 lrc: 4/0,0 mode: PR/PR res: [0x2b3cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0605 expref: 1915 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.415299:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946342784 00000100:00100000:0.0:1651529344.415299:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996948608:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.415306:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210655 00000100:00100000:1.0:1651529344.415307:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+151:39029:x1731745946342592:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.415318:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177102 count 1 00010000:00010000:1.0:1651529344.415323:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8e15fbe/0x3234de053c4fc41 lrc: 3/0,1 mode: --/PW res: [0x2b3ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.415327:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000382571b5 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.415328:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000068c0d27c/0x3234de053c4df5a lrc: 2/0,0 mode: PR/PR res: [0x2b3ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e99 expref: 1915 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.415333:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.415334:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.415335:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8e15fbe/0x3234de053c4fc41 lrc: 4/0,1 mode: --/PW res: [0x2b3ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.415335:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210656 00000100:00100000:0.0:1651529344.415336:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+151:39029:x1731745946342720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.415341:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000068c0d27c/0x3234de053c4df5a lrc: 3/0,0 mode: PR/PR res: [0x2b3ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e99 expref: 1915 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.415341:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177104 count 1 00010000:00010000:1.0:1651529344.415345:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000068c0d27c/0x3234de053c4df5a lrc: 4/0,0 mode: PR/PR res: [0x2b3ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e99 expref: 1915 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.415345:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c7e55f5/0x3234de053c4fc48 lrc: 3/0,1 mode: --/PW res: [0x2b3d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.415349:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ffb5d0a pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996948672:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.415349:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002c3d6b55/0x3234de053c4ded5 lrc: 2/0,0 mode: PR/PR res: [0x2b3d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c54 expref: 1915 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.415352:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.415353:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.415354:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c7e55f5/0x3234de053c4fc48 lrc: 4/0,1 mode: --/PW res: [0x2b3d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.415358:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f79d8146 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.415360:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002c3d6b55/0x3234de053c4ded5 lrc: 3/0,0 mode: PR/PR res: [0x2b3d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c54 expref: 1915 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.415363:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002c3d6b55/0x3234de053c4ded5 lrc: 4/0,0 mode: PR/PR res: [0x2b3d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c54 expref: 1915 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.415364:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210657 00000100:00100000:1.0:1651529344.415366:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+151:39030:x1731745946342784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.415370:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177105 count 1 00000100:00100000:0.0:1651529344.415370:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996948736:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.415373:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c4fc4f lrc: 3/0,1 mode: --/PW res: [0x2b3d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.415378:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd3089ef/0x3234de053c4a236 lrc: 2/0,0 mode: PR/PR res: [0x2b3d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb96e expref: 1915 pid: 80277 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.415378:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b032d2f9 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.415381:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.415381:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.415382:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c4fc4f lrc: 4/0,1 mode: --/PW res: [0x2b3d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.415390:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dd3089ef/0x3234de053c4a236 lrc: 3/0,0 mode: PR/PR res: [0x2b3d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb96e expref: 1915 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.415394:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dd3089ef/0x3234de053c4a236 lrc: 4/0,0 mode: PR/PR res: [0x2b3d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb96e expref: 1915 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.415397:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cee35a0c pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996948800:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.415403:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 0000000071742acc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.415663:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996948416:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.415664:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.415668:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c4fc25 lrc: 3/0,1 mode: --/PW res: [0x2b3ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.415671:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.415680:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.415680:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996948544:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.415687:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000066374bf8/0x3234de053c4fc33 lrc: 3/0,1 mode: --/PW res: [0x2b3cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.415689:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.415700:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006aa45e66 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996948480:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.415700:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396223488 00010000:00010000:1.0:1651529344.415704:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4fc2c lrc: 3/0,1 mode: --/PW res: [0x2b3cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.415705:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005de6f336/0x3234de053c4cb41 lrc: 5/0,0 mode: PR/PR res: [0x2b3cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde89 expref: 1916 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.415710:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396223424 00000100:00100000:1.0:1651529344.415711:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f39ca9ea pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996948352:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.415712:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c4ca84 lrc: 4/0,0 mode: PR/PR res: [0x2b3ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdbb8 expref: 1917 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.415714:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c4fc1e lrc: 3/0,1 mode: --/PW res: [0x2b3cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.415716:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396223616 00010000:00010000:0.0:1651529344.415718:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ea0ab3e9/0x3234de053c4c8cb lrc: 4/0,0 mode: PR/PR res: [0x2b3cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd4c6 expref: 1918 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.415720:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396223552 00000100:00100000:0.0:1651529344.415723:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11432 00000100:00100000:0.0:1651529344.415724:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1919:41279:x1731746396223488:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.415725:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c4ce3c lrc: 4/0,0 mode: PR/PR res: [0x2b3cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea6e expref: 1919 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.415728:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.415730:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005de6f336/0x3234de053c4cb41 lrc: 4/0,0 mode: PR/PR res: [0x2b3cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde89 expref: 1919 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.415731:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11433 00000100:00100000:1.0:1651529344.415732:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1919:41278:x1731746396223424:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.415744:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005de6f336/0x3234de053c4cb41 lrc: 3/0,0 mode: PR/PR res: [0x2b3cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde89 expref: 1919 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.415746:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.415748:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c4ca84 lrc: 4/0,0 mode: PR/PR res: [0x2b3ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdbb8 expref: 1919 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.415751:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005de6f336/0x3234de053c4cb41 lrc: 0/0,0 mode: --/PR res: [0x2b3cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde89 expref: 1919 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.415752:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c4ca84 lrc: 3/0,0 mode: PR/PR res: [0x2b3ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdbb8 expref: 1919 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.415755:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.415755:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.415756:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c4fc1e lrc: 3/0,1 mode: PW/PW res: [0x2b3cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.415758:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c4ca84 lrc: 0/0,0 mode: --/PR res: [0x2b3ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdbb8 expref: 1918 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.415759:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c4fc1e lrc: 4/0,1 mode: PW/PW res: [0x2b3cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.415762:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.415762:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.415763:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c4fc25 lrc: 3/0,1 mode: PW/PW res: [0x2b3ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.415768:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.415772:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c4fc25 lrc: 4/0,1 mode: PW/PW res: [0x2b3ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.415779:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1917:41279:x1731746396223488:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 54us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.415782:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11432 00010000:00010000:1.0:1651529344.415786:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.415793:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11434 00000100:00100000:1.0:1651529344.415794:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1916:41278:x1731746396223424:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 61us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.415795:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031e6b9e0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1916:41279:x1731746396223616:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.415797:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11433 00000100:00100000:1.0:1651529344.415802:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11435 00000100:00100000:1.0:1651529344.415804:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1915:41278:x1731746396223552:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.415806:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.415808:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c4ce3c lrc: 4/0,0 mode: PR/PR res: [0x2b3cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea6e expref: 1915 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.415817:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c4ce3c lrc: 3/0,0 mode: PR/PR res: [0x2b3cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea6e expref: 1915 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.415823:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c4ce3c lrc: 0/0,0 mode: --/PR res: [0x2b3cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea6e expref: 1915 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.415826:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.415827:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.415827:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000066374bf8/0x3234de053c4fc33 lrc: 3/0,1 mode: PW/PW res: [0x2b3cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.415830:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066374bf8/0x3234de053c4fc33 lrc: 4/0,1 mode: PW/PW res: [0x2b3cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.415834:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.415836:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ea0ab3e9/0x3234de053c4c8cb lrc: 4/0,0 mode: PR/PR res: [0x2b3cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd4c6 expref: 1914 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.415845:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.415848:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ea0ab3e9/0x3234de053c4c8cb lrc: 3/0,0 mode: PR/PR res: [0x2b3cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd4c6 expref: 1914 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.415851:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1914:41278:x1731746396223552:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 46us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.415853:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11435 00010000:00010000:1.0:1651529344.415859:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c4fc1e lrc: 3/0,1 mode: PW/PW res: [0x2b3cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.415863:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c4fc1e lrc: 3/0,1 mode: PW/PW res: [0x2b3cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.415863:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea0ab3e9/0x3234de053c4c8cb lrc: 0/0,0 mode: --/PR res: [0x2b3cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd4c6 expref: 1913 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.415866:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c4fc1e lrc: 3/0,1 mode: PW/PW res: [0x2b3cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.415868:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.415868:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.415869:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4fc2c lrc: 3/0,1 mode: PW/PW res: [0x2b3cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.415871:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c4fc1e lrc: 2/0,0 mode: PW/PW res: [0x2b3cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.415872:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4fc2c lrc: 4/0,1 mode: PW/PW res: [0x2b3cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.415886:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.415893:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031e6b9e0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1912:41279:x1731746396223616:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 97us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.415896:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11434 00010000:00010000:0.0:1651529344.415907:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c4fc1e lrc: 2/0,0 mode: PW/PW res: [0x2b3cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.415911:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ef6f99f3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.415912:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c4fc1e lrc: 2/0,0 mode: PW/PW res: [0x2b3cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.415914:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c4fc1e lrc: 3/0,0 mode: PW/PW res: [0x2b3cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.415919:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c4fc1e lrc: 1/0,0 mode: --/PW res: [0x2b3cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.415920:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+152:39030:x1731745946342400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 833us (897us total) trans 12885078705 rc 0/0 00010000:00010000:0.0:1651529344.415922:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c4fc1e lrc: 0/0,0 mode: --/PW res: [0x2b3cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.415923:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210650 00010000:00010000:0.0:1651529344.415928:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000066374bf8/0x3234de053c4fc33 lrc: 3/0,1 mode: PW/PW res: [0x2b3cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.415930:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4fc2c lrc: 3/0,1 mode: PW/PW res: [0x2b3cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.415931:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066374bf8/0x3234de053c4fc33 lrc: 3/0,1 mode: PW/PW res: [0x2b3cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.415933:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4fc2c lrc: 3/0,1 mode: PW/PW res: [0x2b3cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.415934:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066374bf8/0x3234de053c4fc33 lrc: 3/0,1 mode: PW/PW res: [0x2b3cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.415937:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4fc2c lrc: 3/0,1 mode: PW/PW res: [0x2b3cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.415937:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066374bf8/0x3234de053c4fc33 lrc: 2/0,0 mode: PW/PW res: [0x2b3cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.415939:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4fc2c lrc: 2/0,0 mode: PW/PW res: [0x2b3cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.415977:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+153:39029:x1731745946342464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 826us (928us total) trans 12885078706 rc 0/0 00000100:00100000:1.0:1651529344.415980:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210652 00000100:00100000:0.0:1651529344.415986:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+152:39030:x1731745946342528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 807us (943us total) trans 12885078707 rc 0/0 00000100:00100000:0.0:1651529344.415989:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210653 00010000:00010000:0.0:1651529344.416017:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066374bf8/0x3234de053c4fc33 lrc: 2/0,0 mode: PW/PW res: [0x2b3cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416020:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000066374bf8 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.416021:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066374bf8/0x3234de053c4fc33 lrc: 2/0,0 mode: PW/PW res: [0x2b3cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.416022:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.416030:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066374bf8/0x3234de053c4fc33 lrc: 3/0,0 mode: PW/PW res: [0x2b3cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.416034:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.416035:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066374bf8/0x3234de053c4fc33 lrc: 1/0,0 mode: --/PW res: [0x2b3cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416042:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066374bf8/0x3234de053c4fc33 lrc: 0/0,0 mode: --/PW res: [0x2b3cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416051:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4fc2c lrc: 2/0,0 mode: PW/PW res: [0x2b3cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416054:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b3ecd1a6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.416055:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4fc2c lrc: 2/0,0 mode: PW/PW res: [0x2b3cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416058:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4fc2c lrc: 3/0,0 mode: PW/PW res: [0x2b3cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416061:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4fc2c lrc: 1/0,0 mode: --/PW res: [0x2b3cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416064:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4fc2c lrc: 0/0,0 mode: --/PW res: [0x2b3cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.416071:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396223680 00010000:00010000:0.0:1651529344.416077:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000021e675a0/0x3234de053c4d4f6 lrc: 5/0,0 mode: PR/PR res: [0x2b3cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0605 expref: 1912 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.416082:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.416091:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396223744 00010000:00010000:0.0:1651529344.416094:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000068c0d27c/0x3234de053c4df5a lrc: 5/0,0 mode: PR/PR res: [0x2b3ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e99 expref: 1913 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.416098:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396223808 00010000:00010000:0.0:1651529344.416100:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002c3d6b55/0x3234de053c4ded5 lrc: 5/0,0 mode: PR/PR res: [0x2b3d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c54 expref: 1914 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.416105:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11436 00000100:00100000:0.0:1651529344.416106:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1914:41279:x1731746396223680:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.416109:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.416110:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000021e675a0/0x3234de053c4d4f6 lrc: 5/0,0 mode: PR/PR res: [0x2b3cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0605 expref: 1914 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.416114:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000021e675a0/0x3234de053c4d4f6 lrc: 4/0,0 mode: PR/PR res: [0x2b3cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0605 expref: 1914 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.416117:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.416119:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.416126:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cee35a0c pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996948800:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.416130:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c4fc4f lrc: 3/0,1 mode: --/PW res: [0x2b3d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416132:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.416133:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c4fc3a lrc: 3/0,1 mode: PW/PW res: [0x2b3cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416136:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c4fc3a lrc: 4/0,1 mode: PW/PW res: [0x2b3cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.416137:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ffb5d0a pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996948672:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.416139:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d8e15fbe/0x3234de053c4fc41 lrc: 3/0,1 mode: --/PW res: [0x2b3ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416144:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.416145:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396223936 00010000:00010000:1.0:1651529344.416150:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dd3089ef/0x3234de053c4a236 lrc: 4/0,0 mode: PR/PR res: [0x2b3d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb96e expref: 1915 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.416157:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1915:41279:x1731746396223680:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 49us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.416161:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11436 00000100:00100000:1.0:1651529344.416163:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11437 00000100:00100000:1.0:1651529344.416165:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1914:41278:x1731746396223744:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.416166:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11438 00010000:00010000:1.0:1651529344.416168:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.416168:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1914:41279:x1731746396223808:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.416169:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000068c0d27c/0x3234de053c4df5a lrc: 4/0,0 mode: PR/PR res: [0x2b3ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e99 expref: 1914 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.416171:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.416172:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002c3d6b55/0x3234de053c4ded5 lrc: 5/0,0 mode: PR/PR res: [0x2b3d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c54 expref: 1914 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.416173:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000068c0d27c/0x3234de053c4df5a lrc: 3/0,0 mode: PR/PR res: [0x2b3ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e99 expref: 1914 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.416176:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002c3d6b55/0x3234de053c4ded5 lrc: 4/0,0 mode: PR/PR res: [0x2b3d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c54 expref: 1914 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.416179:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068c0d27c/0x3234de053c4df5a lrc: 0/0,0 mode: --/PR res: [0x2b3ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e99 expref: 1914 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.416181:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.416182:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.416182:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007c7e55f5/0x3234de053c4fc48 lrc: 3/0,1 mode: PW/PW res: [0x2b3d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.416183:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.416184:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.416185:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d8e15fbe/0x3234de053c4fc41 lrc: 3/0,1 mode: PW/PW res: [0x2b3ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416185:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c7e55f5/0x3234de053c4fc48 lrc: 4/0,1 mode: PW/PW res: [0x2b3d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.416188:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8e15fbe/0x3234de053c4fc41 lrc: 4/0,1 mode: PW/PW res: [0x2b3ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416189:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.416194:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.416194:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1913:41279:x1731746396223808:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 26us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.416196:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11438 00000100:00100000:1.0:1651529344.416201:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1912:41278:x1731746396223744:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.416203:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11437 00000100:00100000:1.0:1651529344.416208:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11439 00000100:00100000:1.0:1651529344.416210:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1911:41279:x1731746396223936:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.416212:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.416213:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dd3089ef/0x3234de053c4a236 lrc: 4/0,0 mode: PR/PR res: [0x2b3d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb96e expref: 1911 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.416217:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dd3089ef/0x3234de053c4a236 lrc: 3/0,0 mode: PR/PR res: [0x2b3d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb96e expref: 1911 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.416221:0:72395:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c3d6b55/0x3234de053c4ded5 lrc: 0/0,0 mode: --/PR res: [0x2b3d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c54 expref: 1911 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.416237:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd3089ef/0x3234de053c4a236 lrc: 0/0,0 mode: --/PR res: [0x2b3d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb96e expref: 1911 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.416241:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.416242:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.416242:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996948736:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.416243:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c4fc4f lrc: 3/0,1 mode: PW/PW res: [0x2b3d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.416246:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c4fc4f lrc: 4/0,1 mode: PW/PW res: [0x2b3d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416246:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007c7e55f5/0x3234de053c4fc48 lrc: 3/0,1 mode: PW/PW res: [0x2b3d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416250:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007c7e55f5/0x3234de053c4fc48 lrc: 3/0,1 mode: PW/PW res: [0x2b3d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416252:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c7e55f5/0x3234de053c4fc48 lrc: 3/0,1 mode: PW/PW res: [0x2b3d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.416255:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.416255:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c7e55f5/0x3234de053c4fc48 lrc: 3/0,1 mode: PW/PW res: [0x2b3d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416258:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c7e55f5/0x3234de053c4fc48 lrc: 2/0,0 mode: PW/PW res: [0x2b3d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.416261:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1909:41279:x1731746396223936:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 50us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.416263:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11439 00010000:00010000:1.0:1651529344.416269:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d8e15fbe/0x3234de053c4fc41 lrc: 3/0,1 mode: PW/PW res: [0x2b3ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.416272:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8e15fbe/0x3234de053c4fc41 lrc: 3/0,1 mode: PW/PW res: [0x2b3ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.416275:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8e15fbe/0x3234de053c4fc41 lrc: 3/0,1 mode: PW/PW res: [0x2b3ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.416278:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8e15fbe/0x3234de053c4fc41 lrc: 2/0,0 mode: PW/PW res: [0x2b3ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.416306:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+153:39029:x1731745946342720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 969us (1064us total) trans 12885078708 rc 0/0 00000100:00100000:0.0:1651529344.416310:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210656 00000100:00100000:1.0:1651529344.416319:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+152:39029:x1731745946342592:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1011us (1105us total) trans 12885078709 rc 0/0 00010000:00010000:0.0:1651529344.416319:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c7e55f5/0x3234de053c4fc48 lrc: 2/0,0 mode: PW/PW res: [0x2b3d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.416322:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210655 00010000:00010000:0.0:1651529344.416323:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007c7e55f5 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.416324:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c7e55f5/0x3234de053c4fc48 lrc: 2/0,0 mode: PW/PW res: [0x2b3d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416329:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c7e55f5/0x3234de053c4fc48 lrc: 3/0,0 mode: PW/PW res: [0x2b3d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.416330:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c4fc4f lrc: 3/0,1 mode: PW/PW res: [0x2b3d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.416333:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c4fc4f lrc: 3/0,1 mode: PW/PW res: [0x2b3d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416334:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c7e55f5/0x3234de053c4fc48 lrc: 1/0,0 mode: --/PW res: [0x2b3d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.416336:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c4fc4f lrc: 3/0,1 mode: PW/PW res: [0x2b3d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416336:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c7e55f5/0x3234de053c4fc48 lrc: 0/0,0 mode: --/PW res: [0x2b3d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.416339:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c4fc4f lrc: 2/0,0 mode: PW/PW res: [0x2b3d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416341:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8e15fbe/0x3234de053c4fc41 lrc: 2/0,0 mode: PW/PW res: [0x2b3ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416343:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d8e15fbe already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.416344:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8e15fbe/0x3234de053c4fc41 lrc: 2/0,0 mode: PW/PW res: [0x2b3ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416353:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8e15fbe/0x3234de053c4fc41 lrc: 3/0,0 mode: PW/PW res: [0x2b3ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416357:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8e15fbe/0x3234de053c4fc41 lrc: 1/0,0 mode: --/PW res: [0x2b3ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416360:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8e15fbe/0x3234de053c4fc41 lrc: 0/0,0 mode: --/PW res: [0x2b3ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416363:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c4fc4f lrc: 2/0,0 mode: PW/PW res: [0x2b3d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416368:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054065c33 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.416369:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c4fc4f lrc: 2/0,0 mode: PW/PW res: [0x2b3d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416372:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c4fc4f lrc: 3/0,0 mode: PW/PW res: [0x2b3d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.416375:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+152:39030:x1731745946342784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1008us (1110us total) trans 12885078710 rc 0/0 00010000:00010000:0.0:1651529344.416375:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c4fc4f lrc: 1/0,0 mode: --/PW res: [0x2b3d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416377:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c4fc4f lrc: 0/0,0 mode: --/PW res: [0x2b3d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.416378:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210657 00010000:00010000:0.0:1651529344.416389:0:80281:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021e675a0/0x3234de053c4d4f6 lrc: 0/0,0 mode: --/PR res: [0x2b3cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0605 expref: 1908 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.416392:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996948608:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.416395:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c4fc3a lrc: 3/0,1 mode: PW/PW res: [0x2b3cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416398:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c4fc3a lrc: 3/0,1 mode: PW/PW res: [0x2b3cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416401:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c4fc3a lrc: 3/0,1 mode: PW/PW res: [0x2b3cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416406:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c4fc3a lrc: 3/0,1 mode: PW/PW res: [0x2b3cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416409:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c4fc3a lrc: 2/0,0 mode: PW/PW res: [0x2b3cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.416412:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.416425:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.416436:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.416454:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+152:39030:x1731745946342656:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1190us (1252us total) trans 12885078711 rc 0/0 00000100:00100000:0.0:1651529344.416457:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210654 00000100:00100000:0.0:1651529344.416462:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946343424 00000100:00100000:0.0:1651529344.416467:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946343360 00000100:00100000:0.0:1651529344.416475:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946343488 00000100:00100000:0.0:1651529344.416481:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210658 00000100:00100000:0.0:1651529344.416482:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+154:39030:x1731745946343424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.416488:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177107 count 1 00010000:00010000:0.0:1651529344.416492:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af439eec/0x3234de053c4fc56 lrc: 3/0,1 mode: --/PW res: [0x2b3d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416497:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000186a4198/0x3234de053c4d0f8 lrc: 2/0,0 mode: PR/PR res: [0x2b3d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf56c expref: 1907 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.416500:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.416501:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.416501:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af439eec/0x3234de053c4fc56 lrc: 4/0,1 mode: --/PW res: [0x2b3d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.416504:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210659 00000100:00100000:1.0:1651529344.416506:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+154:39029:x1731745946343360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.416512:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177106 count 1 00010000:00010000:1.0:1651529344.416516:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c4fc5d lrc: 3/0,1 mode: --/PW res: [0x2b3d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.416521:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c4a37f lrc: 2/0,0 mode: PR/PR res: [0x2b3d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba16 expref: 1907 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.416524:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.416525:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.416526:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c4fc5d lrc: 4/0,1 mode: --/PW res: [0x2b3d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416526:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000186a4198/0x3234de053c4d0f8 lrc: 3/0,0 mode: PR/PR res: [0x2b3d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf56c expref: 1907 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.416530:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000186a4198/0x3234de053c4d0f8 lrc: 4/0,0 mode: PR/PR res: [0x2b3d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf56c expref: 1907 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.416533:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c4a37f lrc: 3/0,0 mode: PR/PR res: [0x2b3d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba16 expref: 1907 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.416534:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996948864:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.416539:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c4a37f lrc: 4/0,0 mode: PR/PR res: [0x2b3d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba16 expref: 1907 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.416543:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f39ca9ea pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996948928:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.416549:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b032d2f9 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.416555:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c4fc3a lrc: 2/0,0 mode: PW/PW res: [0x2b3cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.416558:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000004698fefb going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.416558:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000005a52f96 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.416559:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c4fc3a lrc: 2/0,0 mode: PW/PW res: [0x2b3cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416562:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c4fc3a lrc: 3/0,0 mode: PW/PW res: [0x2b3cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.416565:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210660 00000100:00100000:1.0:1651529344.416566:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+154:39029:x1731745946343488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.416566:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c4fc3a lrc: 1/0,0 mode: --/PW res: [0x2b3cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416569:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c4fc3a lrc: 0/0,0 mode: --/PW res: [0x2b3cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.416571:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177108 count 1 00010000:00010000:1.0:1651529344.416574:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c4fc64 lrc: 3/0,1 mode: --/PW res: [0x2b3d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416577:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c4fc25 lrc: 3/0,1 mode: PW/PW res: [0x2b3ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.416579:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c4eea3 lrc: 2/0,0 mode: PR/PR res: [0x2b3d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c7a expref: 1907 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.416580:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c4fc25 lrc: 3/0,1 mode: PW/PW res: [0x2b3ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.416582:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.416582:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.416583:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c4fc64 lrc: 4/0,1 mode: --/PW res: [0x2b3d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416585:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c4fc25 lrc: 3/0,1 mode: PW/PW res: [0x2b3ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416588:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c4fc25 lrc: 2/0,0 mode: PW/PW res: [0x2b3ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.416589:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c4eea3 lrc: 3/0,0 mode: PR/PR res: [0x2b3d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c7a expref: 1907 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.416592:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c4eea3 lrc: 4/0,0 mode: PR/PR res: [0x2b3d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c7a expref: 1907 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.416598:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006aa45e66 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996948992:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.416605:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f79d8146 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.416662:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+155:39029:x1731745946342336:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1569us (1630us total) trans 12885078712 rc 0/0 00000100:00100000:0.0:1651529344.416666:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210651 00010000:00010000:0.0:1651529344.416673:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c4fc25 lrc: 2/0,0 mode: PW/PW res: [0x2b3ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416676:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f27c804 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.416677:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.416677:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c4fc25 lrc: 2/0,0 mode: PW/PW res: [0x2b3ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416680:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c4fc25 lrc: 3/0,0 mode: PW/PW res: [0x2b3ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416690:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c4fc25 lrc: 1/0,0 mode: --/PW res: [0x2b3ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416693:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c4fc25 lrc: 0/0,0 mode: --/PW res: [0x2b3ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.416701:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946343744 00000100:00100000:0.0:1651529344.416710:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210661 00000100:00100000:0.0:1651529344.416712:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+155:39029:x1731745946343744:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.416713:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.416717:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177110 count 1 00000100:00100000:1.0:1651529344.416720:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.416721:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c4fc6b lrc: 3/0,1 mode: --/PW res: [0x2b3d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.416730:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.416731:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c88eeba2/0x3234de053c4e2be lrc: 2/0,0 mode: PR/PR res: [0x2b3d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c29 expref: 1907 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.416745:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.416746:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946343680 00010000:00010000:0.0:1651529344.416746:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.416746:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c4fc6b lrc: 4/0,1 mode: --/PW res: [0x2b3d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.416753:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946343872 00010000:00010000:0.0:1651529344.416754:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c88eeba2/0x3234de053c4e2be lrc: 3/0,0 mode: PR/PR res: [0x2b3d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c29 expref: 1907 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.416756:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946343808 00010000:00010000:0.0:1651529344.416757:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c88eeba2/0x3234de053c4e2be lrc: 4/0,0 mode: PR/PR res: [0x2b3d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c29 expref: 1907 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.416760:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210662 00000100:00100000:0.0:1651529344.416761:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996949056:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.416762:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+158:39030:x1731745946343680:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.416767:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177109 count 1 00010000:00010000:1.0:1651529344.416771:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c4fc72 lrc: 3/0,1 mode: --/PW res: [0x2b3d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.416775:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c29d18ba going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.416782:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c4f461 lrc: 2/0,0 mode: PR/PR res: [0x2b3d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8428 expref: 1907 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.416782:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210663 00000100:00100000:0.0:1651529344.416784:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+158:39029:x1731745946343872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.416785:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.416786:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.416787:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c4fc72 lrc: 4/0,1 mode: --/PW res: [0x2b3d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.416789:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177112 count 1 00010000:00010000:1.0:1651529344.416793:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c4f461 lrc: 3/0,0 mode: PR/PR res: [0x2b3d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8428 expref: 1907 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.416793:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ce7109a/0x3234de053c4fc79 lrc: 3/0,1 mode: --/PW res: [0x2b3d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.416799:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c4f461 lrc: 4/0,0 mode: PR/PR res: [0x2b3d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8428 expref: 1907 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.416799:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000069843204/0x3234de053c4edb5 lrc: 2/0,0 mode: PR/PR res: [0x2b3d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6940 expref: 1907 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.416802:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.416803:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000078f9a278 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996949120:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.416803:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.416804:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ce7109a/0x3234de053c4fc79 lrc: 4/0,1 mode: --/PW res: [0x2b3d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416810:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000069843204/0x3234de053c4edb5 lrc: 3/0,0 mode: PR/PR res: [0x2b3d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6940 expref: 1907 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.416812:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 0000000018ebe812 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.416813:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000069843204/0x3234de053c4edb5 lrc: 4/0,0 mode: PR/PR res: [0x2b3d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6940 expref: 1907 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.416817:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996949184:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.416818:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210664 00000100:00100000:1.0:1651529344.416820:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+158:39030:x1731745946343808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.416824:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177111 count 1 00010000:00010000:1.0:1651529344.416828:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c4fc80 lrc: 3/0,1 mode: --/PW res: [0x2b3d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.416832:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c4f48b lrc: 2/0,0 mode: PR/PR res: [0x2b3d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84c2 expref: 1907 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.416835:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.416835:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.416836:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c4fc80 lrc: 4/0,1 mode: --/PW res: [0x2b3d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.416840:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000efb6ae52 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.416842:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c4f48b lrc: 3/0,0 mode: PR/PR res: [0x2b3d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84c2 expref: 1907 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.416845:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c4f48b lrc: 4/0,0 mode: PR/PR res: [0x2b3d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84c2 expref: 1907 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.416852:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002c4168d4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996949248:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.416858:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 000000004ca54b8a going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.416875:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.416940:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996948864:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.416944:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000af439eec/0x3234de053c4fc56 lrc: 3/0,1 mode: --/PW res: [0x2b3d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.416950:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.416966:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.416971:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396224448 00000100:00100000:1.0:1651529344.416973:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.416975:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c4eea3 lrc: 5/0,0 mode: PR/PR res: [0x2b3d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c7a expref: 1908 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.416984:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f39ca9ea pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996948928:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.416988:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396224576 00010000:00010000:1.0:1651529344.416989:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c4fc5d lrc: 3/0,1 mode: --/PW res: [0x2b3d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.416991:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c4a37f lrc: 4/0,0 mode: PR/PR res: [0x2b3d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba16 expref: 1909 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.416995:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396224512 00000100:00100000:1.0:1651529344.416996:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006aa45e66 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996948992:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.416997:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000186a4198/0x3234de053c4d0f8 lrc: 4/0,0 mode: PR/PR res: [0x2b3d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf56c expref: 1910 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.416998:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c4fc64 lrc: 3/0,1 mode: --/PW res: [0x2b3d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.417002:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11440 00000100:00100000:0.0:1651529344.417003:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1910:41278:x1731746396224448:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.417004:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946343936 00010000:00010000:0.0:1651529344.417006:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.417007:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c4eea3 lrc: 4/0,0 mode: PR/PR res: [0x2b3d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c7a expref: 1910 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.417011:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210665 00010000:00010000:0.0:1651529344.417011:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c4eea3 lrc: 3/0,0 mode: PR/PR res: [0x2b3d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c7a expref: 1910 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.417012:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096d94b7b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+159:39029:x1731745946343936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.417016:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c4eea3 lrc: 0/0,0 mode: --/PR res: [0x2b3d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c7a expref: 1910 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:1.0:1651529344.417017:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177113 count 1 00010000:00010000:0.0:1651529344.417020:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.417020:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.417021:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c4fc87 lrc: 3/0,1 mode: --/PW res: [0x2b3d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417021:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c4fc64 lrc: 3/0,1 mode: PW/PW res: [0x2b3d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417024:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c4fc64 lrc: 4/0,1 mode: PW/PW res: [0x2b3d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.417025:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005480834d/0x3234de053c4dc04 lrc: 2/0,0 mode: PR/PR res: [0x2b3d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2030 expref: 1909 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.417031:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.417031:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.417038:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c4fc87 lrc: 4/0,1 mode: --/PW res: [0x2b3d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417048:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.417050:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005480834d/0x3234de053c4dc04 lrc: 3/0,0 mode: PR/PR res: [0x2b3d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2030 expref: 1909 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.417054:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005480834d/0x3234de053c4dc04 lrc: 4/0,0 mode: PR/PR res: [0x2b3d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2030 expref: 1909 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.417056:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1909:41278:x1731746396224448:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 52us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.417058:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002a957ba7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996949312:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.417059:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11440 00000100:00100000:0.0:1651529344.417064:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11441 00000100:00100000:1.0:1651529344.417066:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 000000004698fefb going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.417066:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d17e32b2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1908:41278:x1731746396224576:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.417068:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.417070:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c4fc64 lrc: 3/0,1 mode: PW/PW res: [0x2b3d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417070:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c4a37f lrc: 4/0,0 mode: PR/PR res: [0x2b3d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba16 expref: 1908 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.417073:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c4fc64 lrc: 3/0,1 mode: PW/PW res: [0x2b3d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.417077:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c4fc64 lrc: 3/0,1 mode: PW/PW res: [0x2b3d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.417079:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c4fc64 lrc: 2/0,0 mode: PW/PW res: [0x2b3d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417085:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c4a37f lrc: 3/0,0 mode: PR/PR res: [0x2b3d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba16 expref: 1908 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.417096:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c4a37f lrc: 0/0,0 mode: --/PR res: [0x2b3d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba16 expref: 1908 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.417100:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.417100:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.417101:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c4fc5d lrc: 3/0,1 mode: PW/PW res: [0x2b3d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417104:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c4fc5d lrc: 4/0,1 mode: PW/PW res: [0x2b3d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417113:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.417120:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d17e32b2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1907:41278:x1731746396224576:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 53us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.417122:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11441 00000100:00100000:1.0:1651529344.417130:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+160:39029:x1731745946343488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 563us (694us total) trans 12885078713 rc 0/0 00000100:00100000:0.0:1651529344.417130:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11442 00000100:00100000:0.0:1651529344.417132:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1906:41279:x1731746396224512:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.417134:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210660 00010000:00010000:1.0:1651529344.417141:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c4fc5d lrc: 3/0,1 mode: PW/PW res: [0x2b3d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.417144:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c4fc5d lrc: 3/0,1 mode: PW/PW res: [0x2b3d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417146:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.417147:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c4fc5d lrc: 3/0,1 mode: PW/PW res: [0x2b3d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417149:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000186a4198/0x3234de053c4d0f8 lrc: 4/0,0 mode: PR/PR res: [0x2b3d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf56c expref: 1906 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.417150:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c4fc5d lrc: 2/0,0 mode: PW/PW res: [0x2b3d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417152:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000186a4198/0x3234de053c4d0f8 lrc: 3/0,0 mode: PR/PR res: [0x2b3d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf56c expref: 1906 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.417163:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000186a4198/0x3234de053c4d0f8 lrc: 0/0,0 mode: --/PR res: [0x2b3d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf56c expref: 1906 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.417167:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.417168:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.417168:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000af439eec/0x3234de053c4fc56 lrc: 3/0,1 mode: PW/PW res: [0x2b3d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417172:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af439eec/0x3234de053c4fc56 lrc: 4/0,1 mode: PW/PW res: [0x2b3d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417177:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.417184:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1905:41279:x1731746396224512:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 51us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.417186:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11442 00000100:00100000:1.0:1651529344.417189:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+160:39029:x1731745946343360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 682us (764us total) trans 12885078714 rc 0/0 00000100:00100000:1.0:1651529344.417192:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210659 00010000:00010000:0.0:1651529344.417193:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c4fc64 lrc: 2/0,0 mode: PW/PW res: [0x2b3d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417208:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003b0cd546 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.417209:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c4fc64 lrc: 2/0,0 mode: PW/PW res: [0x2b3d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417212:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c4fc64 lrc: 3/0,0 mode: PW/PW res: [0x2b3d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417252:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c4fc64 lrc: 1/0,0 mode: --/PW res: [0x2b3d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417255:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c4fc64 lrc: 0/0,0 mode: --/PW res: [0x2b3d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.417258:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.417259:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c4fc5d lrc: 2/0,0 mode: PW/PW res: [0x2b3d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417262:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003a73c8ff already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.417263:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c4fc5d lrc: 2/0,0 mode: PW/PW res: [0x2b3d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417266:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c4fc5d lrc: 3/0,0 mode: PW/PW res: [0x2b3d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417269:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c4fc5d lrc: 1/0,0 mode: --/PW res: [0x2b3d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417271:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c4fc5d lrc: 0/0,0 mode: --/PW res: [0x2b3d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.417285:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396224640 00010000:00010000:0.0:1651529344.417290:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c88eeba2/0x3234de053c4e2be lrc: 5/0,0 mode: PR/PR res: [0x2b3d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c29 expref: 1905 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.417297:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11443 00000100:00100000:0.0:1651529344.417298:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1905:41278:x1731746396224640:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.417301:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.417302:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c88eeba2/0x3234de053c4e2be lrc: 5/0,0 mode: PR/PR res: [0x2b3d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c29 expref: 1905 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.417305:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.417306:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c88eeba2/0x3234de053c4e2be lrc: 4/0,0 mode: PR/PR res: [0x2b3d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c29 expref: 1905 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.417311:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.417311:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.417312:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c4fc6b lrc: 3/0,1 mode: PW/PW res: [0x2b3d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.417315:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.417315:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c4fc6b lrc: 4/0,1 mode: PW/PW res: [0x2b3d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417320:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.417326:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1905:41278:x1731746396224640:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 27us (69us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.417329:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11443 00000100:00100000:0.0:1651529344.417333:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396224704 00010000:00010000:0.0:1651529344.417335:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c4f461 lrc: 5/0,0 mode: PR/PR res: [0x2b3d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8428 expref: 1905 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.417342:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396224768 00010000:00010000:0.0:1651529344.417344:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000069843204/0x3234de053c4edb5 lrc: 5/0,0 mode: PR/PR res: [0x2b3d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6940 expref: 1906 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.417349:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11444 00000100:00100000:0.0:1651529344.417350:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1906:41279:x1731746396224704:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.417353:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.417354:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c4f461 lrc: 5/0,0 mode: PR/PR res: [0x2b3d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8428 expref: 1906 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.417357:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c4f461 lrc: 4/0,0 mode: PR/PR res: [0x2b3d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8428 expref: 1906 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.417361:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.417362:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.417363:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c4fc72 lrc: 3/0,1 mode: PW/PW res: [0x2b3d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417366:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c4fc72 lrc: 4/0,1 mode: PW/PW res: [0x2b3d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.417369:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002c4168d4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996949248:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.417370:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.417373:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c4fc80 lrc: 3/0,1 mode: --/PW res: [0x2b3d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.417380:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1906:41279:x1731746396224704:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 29us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.417382:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11444 00000100:00100000:0.0:1651529344.417387:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11445 00000100:00100000:0.0:1651529344.417388:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1905:41279:x1731746396224768:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.417391:0:80277:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c4f461 lrc: 0/0,0 mode: --/PR res: [0x2b3d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8428 expref: 1905 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.417391:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.417392:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000069843204/0x3234de053c4edb5 lrc: 5/0,0 mode: PR/PR res: [0x2b3d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6940 expref: 1905 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.417398:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000078f9a278 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996949120:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.417401:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c4fc72 lrc: 3/0,1 mode: PW/PW res: [0x2b3d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.417404:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c4fc72 lrc: 3/0,1 mode: PW/PW res: [0x2b3d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.417406:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c4fc72 lrc: 3/0,1 mode: PW/PW res: [0x2b3d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.417409:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c4fc72 lrc: 3/0,1 mode: PW/PW res: [0x2b3d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417410:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000069843204/0x3234de053c4edb5 lrc: 4/0,0 mode: PR/PR res: [0x2b3d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6940 expref: 1904 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.417412:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c4fc72 lrc: 2/0,0 mode: PW/PW res: [0x2b3d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417437:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.417438:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.417438:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007ce7109a/0x3234de053c4fc79 lrc: 3/0,1 mode: PW/PW res: [0x2b3d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417442:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ce7109a/0x3234de053c4fc79 lrc: 4/0,1 mode: PW/PW res: [0x2b3d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417446:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.417454:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+160:39030:x1731745946343680:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 691us (746us total) trans 12885078715 rc 0/0 00000100:00100000:0.0:1651529344.417454:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1904:41279:x1731746396224768:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 65us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.417457:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210662 00000100:00100000:0.0:1651529344.417457:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11445 00010000:00010000:0.0:1651529344.417463:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c4fc72 lrc: 2/0,0 mode: PW/PW res: [0x2b3d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417466:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001650e9dc already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.417467:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c4fc72 lrc: 2/0,0 mode: PW/PW res: [0x2b3d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417470:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c4fc72 lrc: 3/0,0 mode: PW/PW res: [0x2b3d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.417474:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.417475:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c4fc72 lrc: 1/0,0 mode: --/PW res: [0x2b3d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417478:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c4fc72 lrc: 0/0,0 mode: --/PW res: [0x2b3d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.417484:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396224832 00000100:00100000:1.0:1651529344.417488:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.417488:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c4f48b lrc: 4/0,0 mode: PR/PR res: [0x2b3d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84c2 expref: 1904 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.417494:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11446 00000100:00100000:0.0:1651529344.417496:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1904:41279:x1731746396224832:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.417498:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.417499:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c4f48b lrc: 4/0,0 mode: PR/PR res: [0x2b3d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84c2 expref: 1904 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.417503:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c4f48b lrc: 3/0,0 mode: PR/PR res: [0x2b3d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84c2 expref: 1904 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.417508:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c4f48b lrc: 0/0,0 mode: --/PR res: [0x2b3d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84c2 expref: 1904 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.417511:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.417511:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.417512:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c4fc80 lrc: 3/0,1 mode: PW/PW res: [0x2b3d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417517:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c4fc80 lrc: 4/0,1 mode: PW/PW res: [0x2b3d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417527:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.417539:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1903:41279:x1731746396224832:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 43us (66us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.417541:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.417542:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11446 00010000:00010000:0.0:1651529344.417552:0:72395:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069843204/0x3234de053c4edb5 lrc: 0/0,0 mode: --/PR res: [0x2b3d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6940 expref: 1902 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.417556:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996949184:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.417560:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007ce7109a/0x3234de053c4fc79 lrc: 3/0,1 mode: PW/PW res: [0x2b3d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.417561:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c4fc80 lrc: 3/0,1 mode: PW/PW res: [0x2b3d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417563:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007ce7109a/0x3234de053c4fc79 lrc: 3/0,1 mode: PW/PW res: [0x2b3d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.417571:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c4fc80 lrc: 3/0,1 mode: PW/PW res: [0x2b3d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.417575:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c4fc80 lrc: 3/0,1 mode: PW/PW res: [0x2b3d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.417578:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c4fc80 lrc: 2/0,0 mode: PW/PW res: [0x2b3d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417590:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ce7109a/0x3234de053c4fc79 lrc: 3/0,1 mode: PW/PW res: [0x2b3d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417594:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ce7109a/0x3234de053c4fc79 lrc: 3/0,1 mode: PW/PW res: [0x2b3d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417597:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ce7109a/0x3234de053c4fc79 lrc: 2/0,0 mode: PW/PW res: [0x2b3d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.417623:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+160:39030:x1731745946343808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 802us (892us total) trans 12885078716 rc 0/0 00000100:00100000:1.0:1651529344.417626:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210664 00000100:00100000:1.0:1651529344.417631:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946344384 00000100:00100000:1.0:1651529344.417637:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946344448 00000100:00100000:1.0:1651529344.417641:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210666 00000100:00100000:1.0:1651529344.417642:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+162:39029:x1731745946344384:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.417647:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177114 count 1 00010000:00010000:1.0:1651529344.417651:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009acdc117/0x3234de053c4fc8e lrc: 3/0,1 mode: --/PW res: [0x2b3da:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.417652:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+162:39029:x1731745946343872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 867us (931us total) trans 12885078717 rc 0/0 00000100:00100000:0.0:1651529344.417655:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210663 00010000:00010000:1.0:1651529344.417656:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005121546f/0x3234de053c4e128 lrc: 2/0,0 mode: PR/PR res: [0x2b3da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3530 expref: 1901 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.417659:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.417660:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.417660:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009acdc117/0x3234de053c4fc8e lrc: 4/0,1 mode: --/PW res: [0x2b3da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.417660:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210667 00000100:00100000:0.0:1651529344.417662:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+161:39030:x1731745946344448:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.417667:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005121546f/0x3234de053c4e128 lrc: 3/0,0 mode: PR/PR res: [0x2b3da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3530 expref: 1901 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.417667:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177115 count 1 00010000:00010000:1.0:1651529344.417671:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005121546f/0x3234de053c4e128 lrc: 4/0,0 mode: PR/PR res: [0x2b3da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3530 expref: 1901 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.417671:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dce56518/0x3234de053c4fc95 lrc: 3/0,1 mode: --/PW res: [0x2b3db:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.417675:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003562cf4d pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996949376:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.417676:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c4ce89 lrc: 2/0,0 mode: PR/PR res: [0x2b3db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec3c expref: 1901 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.417679:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.417679:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.417680:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dce56518/0x3234de053c4fc95 lrc: 4/0,1 mode: --/PW res: [0x2b3db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.417683:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 0000000018ebe812 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.417687:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c4ce89 lrc: 3/0,0 mode: PR/PR res: [0x2b3db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec3c expref: 1901 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.417690:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c4ce89 lrc: 4/0,0 mode: PR/PR res: [0x2b3db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec3c expref: 1901 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.417694:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996949440:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.417703:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000efb6ae52 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.417708:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c4fc80 lrc: 2/0,0 mode: PW/PW res: [0x2b3d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417712:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002e1250c9 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.417713:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.417713:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c4fc80 lrc: 2/0,0 mode: PW/PW res: [0x2b3d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417715:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c4fc80 lrc: 3/0,0 mode: PW/PW res: [0x2b3d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417720:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c4fc80 lrc: 1/0,0 mode: --/PW res: [0x2b3d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417723:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c4fc80 lrc: 0/0,0 mode: --/PW res: [0x2b3d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417726:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ce7109a/0x3234de053c4fc79 lrc: 2/0,0 mode: PW/PW res: [0x2b3d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417729:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007ce7109a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.417730:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ce7109a/0x3234de053c4fc79 lrc: 2/0,0 mode: PW/PW res: [0x2b3d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417733:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ce7109a/0x3234de053c4fc79 lrc: 3/0,0 mode: PW/PW res: [0x2b3d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417747:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ce7109a/0x3234de053c4fc79 lrc: 1/0,0 mode: --/PW res: [0x2b3d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417752:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ce7109a/0x3234de053c4fc79 lrc: 0/0,0 mode: --/PW res: [0x2b3d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417760:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000af439eec/0x3234de053c4fc56 lrc: 3/0,1 mode: PW/PW res: [0x2b3d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417763:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af439eec/0x3234de053c4fc56 lrc: 3/0,1 mode: PW/PW res: [0x2b3d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417766:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af439eec/0x3234de053c4fc56 lrc: 3/0,1 mode: PW/PW res: [0x2b3d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417769:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af439eec/0x3234de053c4fc56 lrc: 2/0,0 mode: PW/PW res: [0x2b3d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.417771:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946344512 00000100:00100000:1.0:1651529344.417779:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210668 00000100:00100000:1.0:1651529344.417780:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+162:39030:x1731745946344512:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.417785:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177116 count 1 00010000:00010000:1.0:1651529344.417790:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c4fc9c lrc: 3/0,1 mode: --/PW res: [0x2b3dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.417794:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000590bdfab/0x3234de053c4df84 lrc: 2/0,0 mode: PR/PR res: [0x2b3dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f33 expref: 1901 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.417797:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.417798:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.417799:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c4fc9c lrc: 4/0,1 mode: --/PW res: [0x2b3dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.417805:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000590bdfab/0x3234de053c4df84 lrc: 3/0,0 mode: PR/PR res: [0x2b3dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f33 expref: 1901 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.417811:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+163:39030:x1731745946343424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1327us (1399us total) trans 12885078718 rc 0/0 00000100:00100000:0.0:1651529344.417814:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210658 00010000:00010000:1.0:1651529344.417815:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000590bdfab/0x3234de053c4df84 lrc: 4/0,0 mode: PR/PR res: [0x2b3dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f33 expref: 1901 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.417821:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af439eec/0x3234de053c4fc56 lrc: 2/0,0 mode: PW/PW res: [0x2b3d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.417822:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f99b3c22 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996949504:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.417824:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000af439eec already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.417825:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af439eec/0x3234de053c4fc56 lrc: 2/0,0 mode: PW/PW res: [0x2b3d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417828:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af439eec/0x3234de053c4fc56 lrc: 3/0,0 mode: PW/PW res: [0x2b3d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.417831:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000412e5d26 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.417833:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af439eec/0x3234de053c4fc56 lrc: 1/0,0 mode: --/PW res: [0x2b3d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417836:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af439eec/0x3234de053c4fc56 lrc: 0/0,0 mode: --/PW res: [0x2b3d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.417840:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002a957ba7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996949312:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.417843:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c4fc87 lrc: 3/0,1 mode: --/PW res: [0x2b3d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417845:0:80280:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c88eeba2/0x3234de053c4e2be lrc: 0/0,0 mode: --/PR res: [0x2b3d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c29 expref: 1901 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.417862:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996949056:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.417866:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c4fc6b lrc: 3/0,1 mode: PW/PW res: [0x2b3d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417869:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c4fc6b lrc: 3/0,1 mode: PW/PW res: [0x2b3d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417872:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c4fc6b lrc: 3/0,1 mode: PW/PW res: [0x2b3d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417875:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c4fc6b lrc: 3/0,1 mode: PW/PW res: [0x2b3d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.417877:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c4fc6b lrc: 2/0,0 mode: PW/PW res: [0x2b3d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.417884:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.417916:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.417927:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946344640 00000100:00100000:1.0:1651529344.417933:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946344576 00000100:00100000:1.0:1651529344.417937:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210669 00000100:00100000:1.0:1651529344.417939:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+165:39029:x1731745946344640:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.417949:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177118 count 1 00000100:00100000:0.0:1651529344.417953:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+165:39029:x1731745946343744:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1239us (1275us total) trans 12885078719 rc 0/0 00010000:00010000:1.0:1651529344.417954:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000004e74ca/0x3234de053c4fca3 lrc: 3/0,1 mode: --/PW res: [0x2b3de:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.417956:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210661 00010000:00010000:1.0:1651529344.417959:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c4c7d6 lrc: 2/0,0 mode: PR/PR res: [0x2b3de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd19a expref: 1900 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.417961:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210670 00010000:00010000:1.0:1651529344.417962:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.417962:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.417963:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000004e74ca/0x3234de053c4fca3 lrc: 4/0,1 mode: --/PW res: [0x2b3de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.417969:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c4c7d6 lrc: 3/0,0 mode: PR/PR res: [0x2b3de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd19a expref: 1900 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.417975:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c4c7d6 lrc: 4/0,0 mode: PR/PR res: [0x2b3de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd19a expref: 1900 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.417976:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+164:39029:x1731745946344576:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.417979:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002a957ba7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996949568:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.417982:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177117 count 1 00010000:00010000:0.0:1651529344.417986:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fcb879f/0x3234de053c4fcaa lrc: 3/0,1 mode: --/PW res: [0x2b3dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.417987:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 0000000057299e7f going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.417991:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000557304be/0x3234de053c4d8df lrc: 2/0,0 mode: PR/PR res: [0x2b3dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1436 expref: 1900 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.417994:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.417995:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.417996:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fcb879f/0x3234de053c4fcaa lrc: 4/0,1 mode: --/PW res: [0x2b3dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.418001:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.418002:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000557304be/0x3234de053c4d8df lrc: 3/0,0 mode: PR/PR res: [0x2b3dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1436 expref: 1900 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.418023:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000557304be/0x3234de053c4d8df lrc: 4/0,0 mode: PR/PR res: [0x2b3dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1436 expref: 1900 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.418027:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996949632:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.418047:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a52ee82 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.418051:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.418052:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c4fc6b lrc: 2/0,0 mode: PW/PW res: [0x2b3d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418058:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000078e8c25c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.418059:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c4fc6b lrc: 2/0,0 mode: PW/PW res: [0x2b3d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418062:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c4fc6b lrc: 3/0,0 mode: PW/PW res: [0x2b3d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418066:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c4fc6b lrc: 1/0,0 mode: --/PW res: [0x2b3d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418069:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c4fc6b lrc: 0/0,0 mode: --/PW res: [0x2b3d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.418076:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396225024 00000100:00100000:1.0:1651529344.418088:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.418096:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005480834d/0x3234de053c4dc04 lrc: 4/0,0 mode: PR/PR res: [0x2b3d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2030 expref: 1901 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.418098:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.418109:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396225472 00000100:00100000:1.0:1651529344.418111:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946344832 00010000:00010000:0.0:1651529344.418112:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005121546f/0x3234de053c4e128 lrc: 5/0,0 mode: PR/PR res: [0x2b3da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3530 expref: 1902 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.418116:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396225536 00000100:00100000:1.0:1651529344.418118:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210671 00010000:00010000:0.0:1651529344.418119:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c4ce89 lrc: 5/0,0 mode: PR/PR res: [0x2b3db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec3c expref: 1903 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.418120:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+165:39030:x1731745946344832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.418123:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11447 00002000:00080000:1.0:1651529344.418125:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177119 count 1 00000100:00100000:0.0:1651529344.418125:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1903:41279:x1731746396225024:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.418129:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034d24763/0x3234de053c4fcb1 lrc: 3/0,1 mode: --/PW res: [0x2b3df:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.418134:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c4cf62 lrc: 2/0,0 mode: PR/PR res: [0x2b3df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef30 expref: 1903 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.418137:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.418137:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.418138:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034d24763/0x3234de053c4fcb1 lrc: 4/0,1 mode: --/PW res: [0x2b3df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.418144:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c4cf62 lrc: 3/0,0 mode: PR/PR res: [0x2b3df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef30 expref: 1903 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.418150:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c4cf62 lrc: 4/0,0 mode: PR/PR res: [0x2b3df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef30 expref: 1903 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.418159:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.418162:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005480834d/0x3234de053c4dc04 lrc: 4/0,0 mode: PR/PR res: [0x2b3d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2030 expref: 1903 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.418166:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005480834d/0x3234de053c4dc04 lrc: 3/0,0 mode: PR/PR res: [0x2b3d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2030 expref: 1903 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.418169:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002f363f4a pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996949696:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.418171:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005480834d/0x3234de053c4dc04 lrc: 0/0,0 mode: --/PR res: [0x2b3d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2030 expref: 1903 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.418174:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.418175:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.418176:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c4fc87 lrc: 3/0,1 mode: PW/PW res: [0x2b3d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.418178:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 000000007d8fabda going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.418186:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003562cf4d pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996949376:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.418189:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c4fc87 lrc: 4/0,1 mode: PW/PW res: [0x2b3d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.418190:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009acdc117/0x3234de053c4fc8e lrc: 3/0,1 mode: --/PW res: [0x2b3da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.418196:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f99b3c22 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996949504:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.418199:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.418205:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c4fc9c lrc: 3/0,1 mode: --/PW res: [0x2b3dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.418212:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11448 00000100:00100000:1.0:1651529344.418214:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071577dd8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1902:41278:x1731746396225472:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.418216:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1902:41279:x1731746396225024:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 90us (215us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.418217:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.418219:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005121546f/0x3234de053c4e128 lrc: 4/0,0 mode: PR/PR res: [0x2b3da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3530 expref: 1902 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.418219:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11447 00010000:00010000:1.0:1651529344.418237:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005121546f/0x3234de053c4e128 lrc: 3/0,0 mode: PR/PR res: [0x2b3da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3530 expref: 1901 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.418241:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11449 00000100:00100000:0.0:1651529344.418242:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1901:41278:x1731746396225536:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.418243:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005121546f/0x3234de053c4e128 lrc: 0/0,0 mode: --/PR res: [0x2b3da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3530 expref: 1901 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.418246:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.418247:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.418247:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.418248:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009acdc117/0x3234de053c4fc8e lrc: 3/0,1 mode: PW/PW res: [0x2b3da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418248:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c4ce89 lrc: 5/0,0 mode: PR/PR res: [0x2b3db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec3c expref: 1900 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.418251:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009acdc117/0x3234de053c4fc8e lrc: 4/0,1 mode: PW/PW res: [0x2b3da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.418257:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.418264:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071577dd8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1900:41278:x1731746396225472:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 49us (176us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.418264:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c4ce89 lrc: 4/0,0 mode: PR/PR res: [0x2b3db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec3c expref: 1900 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.418267:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11448 00010000:00010000:0.0:1651529344.418270:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.418270:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.418271:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dce56518/0x3234de053c4fc95 lrc: 3/0,1 mode: PW/PW res: [0x2b3db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418274:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dce56518/0x3234de053c4fc95 lrc: 4/0,1 mode: PW/PW res: [0x2b3db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.418277:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009acdc117/0x3234de053c4fc8e lrc: 3/0,1 mode: PW/PW res: [0x2b3da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.418281:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009acdc117/0x3234de053c4fc8e lrc: 3/0,1 mode: PW/PW res: [0x2b3da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.418284:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009acdc117/0x3234de053c4fc8e lrc: 3/0,1 mode: PW/PW res: [0x2b3da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.418286:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009acdc117/0x3234de053c4fc8e lrc: 2/0,0 mode: PW/PW res: [0x2b3da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418288:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.418301:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1899:41278:x1731746396225536:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 57us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.418304:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11449 00010000:00010000:0.0:1651529344.418313:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009acdc117/0x3234de053c4fc8e lrc: 2/0,0 mode: PW/PW res: [0x2b3da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418316:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009acdc117 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.418317:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009acdc117/0x3234de053c4fc8e lrc: 2/0,0 mode: PW/PW res: [0x2b3da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418320:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009acdc117/0x3234de053c4fc8e lrc: 3/0,0 mode: PW/PW res: [0x2b3da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418324:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009acdc117/0x3234de053c4fc8e lrc: 1/0,0 mode: --/PW res: [0x2b3da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.418328:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+166:39029:x1731745946344384:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 685us (840us total) trans 12885078720 rc 0/0 00010000:00010000:0.0:1651529344.418329:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009acdc117/0x3234de053c4fc8e lrc: 0/0,0 mode: --/PW res: [0x2b3da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.418331:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210666 00010000:00010000:1.0:1651529344.418338:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c4fc87 lrc: 3/0,1 mode: PW/PW res: [0x2b3d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418339:0:72395:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c4ce89 lrc: 0/0,0 mode: --/PR res: [0x2b3db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec3c expref: 1898 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.418341:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c4fc87 lrc: 3/0,1 mode: PW/PW res: [0x2b3d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.418343:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996949440:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.418345:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c4fc87 lrc: 3/0,1 mode: PW/PW res: [0x2b3d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418346:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dce56518/0x3234de053c4fc95 lrc: 3/0,1 mode: PW/PW res: [0x2b3db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.418347:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c4fc87 lrc: 2/0,0 mode: PW/PW res: [0x2b3d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418349:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dce56518/0x3234de053c4fc95 lrc: 3/0,1 mode: PW/PW res: [0x2b3db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418352:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dce56518/0x3234de053c4fc95 lrc: 3/0,1 mode: PW/PW res: [0x2b3db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418361:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dce56518/0x3234de053c4fc95 lrc: 3/0,1 mode: PW/PW res: [0x2b3db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418364:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dce56518/0x3234de053c4fc95 lrc: 2/0,0 mode: PW/PW res: [0x2b3db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.418384:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096d94b7b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+167:39029:x1731745946343936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1371us (1509us total) trans 12885078721 rc 0/0 00000100:00100000:1.0:1651529344.418387:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210665 00000100:00100000:0.0:1651529344.418406:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+166:39030:x1731745946344448:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 743us (865us total) trans 12885078722 rc 0/0 00000100:00100000:0.0:1651529344.418409:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210667 00000100:00100000:1.0:1651529344.418414:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.418416:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c4fc87 lrc: 2/0,0 mode: PW/PW res: [0x2b3d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418427:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000f905106 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.418428:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c4fc87 lrc: 2/0,0 mode: PW/PW res: [0x2b3d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418431:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c4fc87 lrc: 3/0,0 mode: PW/PW res: [0x2b3d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418436:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c4fc87 lrc: 1/0,0 mode: --/PW res: [0x2b3d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418438:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c4fc87 lrc: 0/0,0 mode: --/PW res: [0x2b3d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418443:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dce56518/0x3234de053c4fc95 lrc: 2/0,0 mode: PW/PW res: [0x2b3db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418446:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dce56518 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.418446:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dce56518/0x3234de053c4fc95 lrc: 2/0,0 mode: PW/PW res: [0x2b3db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418449:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dce56518/0x3234de053c4fc95 lrc: 3/0,0 mode: PW/PW res: [0x2b3db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.418450:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.418452:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dce56518/0x3234de053c4fc95 lrc: 1/0,0 mode: --/PW res: [0x2b3db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418462:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dce56518/0x3234de053c4fc95 lrc: 0/0,0 mode: --/PW res: [0x2b3db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.418469:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396225600 00010000:00010000:0.0:1651529344.418474:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000590bdfab/0x3234de053c4df84 lrc: 4/0,0 mode: PR/PR res: [0x2b3dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f33 expref: 1898 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.418486:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.418487:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11450 00000100:00100000:0.0:1651529344.418494:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1898:41279:x1731746396225600:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.418497:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.418498:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000590bdfab/0x3234de053c4df84 lrc: 4/0,0 mode: PR/PR res: [0x2b3dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f33 expref: 1898 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.418502:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000590bdfab/0x3234de053c4df84 lrc: 3/0,0 mode: PR/PR res: [0x2b3dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f33 expref: 1898 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.418506:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000590bdfab/0x3234de053c4df84 lrc: 0/0,0 mode: --/PR res: [0x2b3dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f33 expref: 1898 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.418510:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.418510:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.418511:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c4fc9c lrc: 3/0,1 mode: PW/PW res: [0x2b3dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418514:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c4fc9c lrc: 4/0,1 mode: PW/PW res: [0x2b3dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.418517:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.418526:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.418533:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1897:41279:x1731746396225600:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 43us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.418536:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11450 00000100:00100000:0.0:1651529344.418540:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396225664 00010000:00010000:0.0:1651529344.418543:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c4c7d6 lrc: 5/0,0 mode: PR/PR res: [0x2b3de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd19a expref: 1897 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.418548:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396225728 00010000:00010000:0.0:1651529344.418550:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000557304be/0x3234de053c4d8df lrc: 5/0,0 mode: PR/PR res: [0x2b3dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1436 expref: 1898 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.418567:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002a957ba7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996949568:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.418571:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000004e74ca/0x3234de053c4fca3 lrc: 3/0,1 mode: --/PW res: [0x2b3de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.418571:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11451 00000100:00100000:0.0:1651529344.418573:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1898:41279:x1731746396225664:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.418576:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.418577:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c4fc9c lrc: 3/0,1 mode: PW/PW res: [0x2b3dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418577:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c4c7d6 lrc: 4/0,0 mode: PR/PR res: [0x2b3de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd19a expref: 1898 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.418580:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c4fc9c lrc: 3/0,1 mode: PW/PW res: [0x2b3dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418581:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c4c7d6 lrc: 3/0,0 mode: PR/PR res: [0x2b3de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd19a expref: 1898 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.418586:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c4fc9c lrc: 3/0,1 mode: PW/PW res: [0x2b3dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418586:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c4c7d6 lrc: 0/0,0 mode: --/PR res: [0x2b3de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd19a expref: 1898 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.418588:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c4fc9c lrc: 2/0,0 mode: PW/PW res: [0x2b3dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418589:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.418590:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.418591:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000004e74ca/0x3234de053c4fca3 lrc: 3/0,1 mode: PW/PW res: [0x2b3de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418594:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000004e74ca/0x3234de053c4fca3 lrc: 4/0,1 mode: PW/PW res: [0x2b3de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418623:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.418633:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1897:41279:x1731746396225664:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 60us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.418636:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11451 00000100:00100000:0.0:1651529344.418641:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11452 00000100:00100000:1.0:1651529344.418642:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+166:39030:x1731745946344512:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 860us (928us total) trans 12885078723 rc 0/0 00000100:00100000:1.0:1651529344.418645:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210668 00000100:00100000:1.0:1651529344.418650:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946344896 00000100:00100000:0.0:1651529344.418655:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1896:41278:x1731746396225728:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.418656:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210672 00000100:00100000:1.0:1651529344.418658:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+166:39030:x1731745946344896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.418658:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.418660:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000557304be/0x3234de053c4d8df lrc: 5/0,0 mode: PR/PR res: [0x2b3dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1436 expref: 1896 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:1.0:1651529344.418663:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177120 count 1 00010000:00010000:0.0:1651529344.418663:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000557304be/0x3234de053c4d8df lrc: 4/0,0 mode: PR/PR res: [0x2b3dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1436 expref: 1896 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.418666:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ce8a004/0x3234de053c4fcb8 lrc: 3/0,1 mode: --/PW res: [0x2b3e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418668:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.418669:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.418670:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009fcb879f/0x3234de053c4fcaa lrc: 3/0,1 mode: PW/PW res: [0x2b3dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.418671:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007bbb621e/0x3234de053c4cc60 lrc: 2/0,0 mode: PR/PR res: [0x2b3e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce359 expref: 1896 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.418673:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fcb879f/0x3234de053c4fcaa lrc: 4/0,1 mode: PW/PW res: [0x2b3dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.418674:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.418675:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.418675:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ce8a004/0x3234de053c4fcb8 lrc: 4/0,1 mode: --/PW res: [0x2b3e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418677:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.418682:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007bbb621e/0x3234de053c4cc60 lrc: 3/0,0 mode: PR/PR res: [0x2b3e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce359 expref: 1896 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.418683:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1896:41278:x1731746396225728:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 28us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.418685:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11452 00010000:00010000:1.0:1651529344.418688:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007bbb621e/0x3234de053c4cc60 lrc: 4/0,0 mode: PR/PR res: [0x2b3e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce359 expref: 1895 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.418692:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006929eb96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996949760:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.418692:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c4fc9c lrc: 2/0,0 mode: PW/PW res: [0x2b3dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418695:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b96e362a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.418696:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c4fc9c lrc: 2/0,0 mode: PW/PW res: [0x2b3dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418699:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c4fc9c lrc: 3/0,0 mode: PW/PW res: [0x2b3dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.418700:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 0000000057299e7f going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.418702:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c4fc9c lrc: 1/0,0 mode: --/PW res: [0x2b3dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.418705:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000004e74ca/0x3234de053c4fca3 lrc: 3/0,1 mode: PW/PW res: [0x2b3de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418705:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c4fc9c lrc: 0/0,0 mode: --/PW res: [0x2b3dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.418708:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000004e74ca/0x3234de053c4fca3 lrc: 3/0,1 mode: PW/PW res: [0x2b3de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.418711:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000004e74ca/0x3234de053c4fca3 lrc: 3/0,1 mode: PW/PW res: [0x2b3de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.418713:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000004e74ca/0x3234de053c4fca3 lrc: 2/0,0 mode: PW/PW res: [0x2b3de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418717:0:80280:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000557304be/0x3234de053c4d8df lrc: 0/0,0 mode: --/PR res: [0x2b3dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1436 expref: 1895 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.418749:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996949632:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.418753:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009fcb879f/0x3234de053c4fcaa lrc: 3/0,1 mode: PW/PW res: [0x2b3dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418757:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009fcb879f/0x3234de053c4fcaa lrc: 3/0,1 mode: PW/PW res: [0x2b3dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418760:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fcb879f/0x3234de053c4fcaa lrc: 3/0,1 mode: PW/PW res: [0x2b3dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418763:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fcb879f/0x3234de053c4fcaa lrc: 3/0,1 mode: PW/PW res: [0x2b3dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.418764:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+167:39029:x1731745946344640:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 823us (879us total) trans 12885078724 rc 0/0 00010000:00010000:0.0:1651529344.418765:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009fcb879f/0x3234de053c4fcaa lrc: 2/0,0 mode: PW/PW res: [0x2b3dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.418767:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210669 00000100:00100000:1.0:1651529344.418802:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.418806:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+167:39029:x1731745946344576:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 830us (891us total) trans 12885078725 rc 0/0 00000100:00100000:0.0:1651529344.418809:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210670 00000100:00100000:0.0:1651529344.418815:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946345024 00000100:00100000:0.0:1651529344.418824:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210673 00000100:00100000:0.0:1651529344.418826:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+167:39029:x1731745946345024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.418831:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177122 count 1 00000100:00100000:1.0:1651529344.418833:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.418835:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b33925b5/0x3234de053c4fcbf lrc: 3/0,1 mode: --/PW res: [0x2b3e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.418846:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.418847:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c4d830 lrc: 2/0,0 mode: PR/PR res: [0x2b3e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d11c0 expref: 1894 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.418850:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.418851:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.418852:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b33925b5/0x3234de053c4fcbf lrc: 4/0,1 mode: --/PW res: [0x2b3e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.418856:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.418866:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c4d830 lrc: 3/0,0 mode: PR/PR res: [0x2b3e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d11c0 expref: 1894 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.418869:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c4d830 lrc: 4/0,0 mode: PR/PR res: [0x2b3e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d11c0 expref: 1894 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.418874:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996949824:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.418882:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000124f6b49 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.418887:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000004e74ca/0x3234de053c4fca3 lrc: 2/0,0 mode: PW/PW res: [0x2b3de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418890:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000004e74ca already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.418891:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000004e74ca/0x3234de053c4fca3 lrc: 2/0,0 mode: PW/PW res: [0x2b3de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418894:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000004e74ca/0x3234de053c4fca3 lrc: 3/0,0 mode: PW/PW res: [0x2b3de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418898:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000004e74ca/0x3234de053c4fca3 lrc: 1/0,0 mode: --/PW res: [0x2b3de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418901:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000004e74ca/0x3234de053c4fca3 lrc: 0/0,0 mode: --/PW res: [0x2b3de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418905:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009fcb879f/0x3234de053c4fcaa lrc: 2/0,0 mode: PW/PW res: [0x2b3dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418910:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009fcb879f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.418911:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009fcb879f/0x3234de053c4fcaa lrc: 2/0,0 mode: PW/PW res: [0x2b3dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418913:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009fcb879f/0x3234de053c4fcaa lrc: 3/0,0 mode: PW/PW res: [0x2b3dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418916:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009fcb879f/0x3234de053c4fcaa lrc: 1/0,0 mode: --/PW res: [0x2b3dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418919:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fcb879f/0x3234de053c4fcaa lrc: 0/0,0 mode: --/PW res: [0x2b3dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.418922:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002f363f4a pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996949696:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.418926:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000034d24763/0x3234de053c4fcb1 lrc: 3/0,1 mode: --/PW res: [0x2b3df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.418934:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946344960 00000100:00100000:1.0:1651529344.418940:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946345088 00000100:00100000:0.0:1651529344.418944:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210674 00000100:00100000:1.0:1651529344.418946:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210675 00000100:00100000:0.0:1651529344.418946:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+169:39030:x1731745946344960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.418948:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+169:39030:x1731745946345088:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.418953:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177123 count 1 00010000:00010000:1.0:1651529344.418956:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dcc98c1/0x3234de053c4fcc6 lrc: 3/0,1 mode: --/PW res: [0x2b3e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.418961:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005d412086/0x3234de053c4d192 lrc: 2/0,0 mode: PR/PR res: [0x2b3e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf7aa expref: 1894 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.418961:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177121 count 1 00010000:00010000:1.0:1651529344.418964:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.418965:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.418965:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dcc98c1/0x3234de053c4fcc6 lrc: 4/0,1 mode: --/PW res: [0x2b3e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418965:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000610e679c/0x3234de053c4fccd lrc: 3/0,1 mode: --/PW res: [0x2b3e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.418969:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c4c6cc lrc: 2/0,0 mode: PR/PR res: [0x2b3e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd33 expref: 1894 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.418972:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005d412086/0x3234de053c4d192 lrc: 3/0,0 mode: PR/PR res: [0x2b3e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf7aa expref: 1894 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.418972:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.418972:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.418973:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000610e679c/0x3234de053c4fccd lrc: 4/0,1 mode: --/PW res: [0x2b3e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.418975:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005d412086/0x3234de053c4d192 lrc: 4/0,0 mode: PR/PR res: [0x2b3e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf7aa expref: 1894 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.418979:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000037ac96ac pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996949888:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.418982:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c4c6cc lrc: 3/0,0 mode: PR/PR res: [0x2b3e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd33 expref: 1894 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.418986:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c4c6cc lrc: 4/0,0 mode: PR/PR res: [0x2b3e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd33 expref: 1894 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.418989:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f79d8146 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.418990:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996949952:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.418996:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396225792 00000100:00100000:0.0:1651529344.418998:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000efb6ae52 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.419000:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c4cf62 lrc: 4/0,0 mode: PR/PR res: [0x2b3df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef30 expref: 1895 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.419006:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11453 00000100:00100000:1.0:1651529344.419008:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1895:41279:x1731746396225792:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.419010:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.419012:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c4cf62 lrc: 4/0,0 mode: PR/PR res: [0x2b3df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef30 expref: 1895 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.419015:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c4cf62 lrc: 3/0,0 mode: PR/PR res: [0x2b3df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef30 expref: 1895 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.419020:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c4cf62 lrc: 0/0,0 mode: --/PR res: [0x2b3df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef30 expref: 1895 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.419024:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.419025:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.419026:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000034d24763/0x3234de053c4fcb1 lrc: 3/0,1 mode: PW/PW res: [0x2b3df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.419029:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034d24763/0x3234de053c4fcb1 lrc: 4/0,1 mode: PW/PW res: [0x2b3df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.419034:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.419040:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1894:41279:x1731746396225792:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.419043:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11453 00010000:00010000:1.0:1651529344.419048:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000034d24763/0x3234de053c4fcb1 lrc: 3/0,1 mode: PW/PW res: [0x2b3df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.419052:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034d24763/0x3234de053c4fcb1 lrc: 3/0,1 mode: PW/PW res: [0x2b3df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.419055:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034d24763/0x3234de053c4fcb1 lrc: 3/0,1 mode: PW/PW res: [0x2b3df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.419057:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034d24763/0x3234de053c4fcb1 lrc: 2/0,0 mode: PW/PW res: [0x2b3df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419069:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034d24763/0x3234de053c4fcb1 lrc: 2/0,0 mode: PW/PW res: [0x2b3df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419073:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000034d24763 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.419074:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034d24763/0x3234de053c4fcb1 lrc: 2/0,0 mode: PW/PW res: [0x2b3df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419077:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034d24763/0x3234de053c4fcb1 lrc: 3/0,0 mode: PW/PW res: [0x2b3df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419082:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034d24763/0x3234de053c4fcb1 lrc: 1/0,0 mode: --/PW res: [0x2b3df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419085:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034d24763/0x3234de053c4fcb1 lrc: 0/0,0 mode: --/PW res: [0x2b3df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.419099:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+170:39030:x1731745946344832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 979us (1048us total) trans 12885078726 rc 0/0 00000100:00100000:1.0:1651529344.419102:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210671 00000100:00100000:1.0:1651529344.419137:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.419178:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.419189:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.419216:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.419249:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.419250:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946345536 00000100:00100000:1.0:1651529344.419258:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946345600 00000100:00100000:1.0:1651529344.419264:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946345664 00000100:00100000:1.0:1651529344.419268:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210676 00000100:00100000:1.0:1651529344.419270:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+171:39030:x1731745946345600:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.419283:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210677 00000100:00100000:0.0:1651529344.419285:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+172:39029:x1731745946345664:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.419286:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177125 count 1 00010000:00010000:1.0:1651529344.419290:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ec63a1b/0x3234de053c4fcd4 lrc: 3/0,1 mode: --/PW res: [0x2b3e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.419290:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177126 count 1 00010000:00010000:0.0:1651529344.419294:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c3d6b55/0x3234de053c4fcdb lrc: 3/0,1 mode: --/PW res: [0x2b3e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.419297:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000051652053/0x3234de053c4eb46 lrc: 2/0,0 mode: PR/PR res: [0x2b3e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5eb2 expref: 1893 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.419298:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c4e095 lrc: 2/0,0 mode: PR/PR res: [0x2b3e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d32f9 expref: 1893 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.419300:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.419301:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.419302:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ec63a1b/0x3234de053c4fcd4 lrc: 4/0,1 mode: --/PW res: [0x2b3e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419302:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.419302:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.419303:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c3d6b55/0x3234de053c4fcdb lrc: 4/0,1 mode: --/PW res: [0x2b3e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.419308:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000051652053/0x3234de053c4eb46 lrc: 3/0,0 mode: PR/PR res: [0x2b3e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5eb2 expref: 1893 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.419309:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c4e095 lrc: 3/0,0 mode: PR/PR res: [0x2b3e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d32f9 expref: 1893 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.419311:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000051652053/0x3234de053c4eb46 lrc: 4/0,0 mode: PR/PR res: [0x2b3e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5eb2 expref: 1893 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.419313:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c4e095 lrc: 4/0,0 mode: PR/PR res: [0x2b3e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d32f9 expref: 1893 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.419316:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000673bcbe2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996950016:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.419317:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996950080:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.419325:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000412e5d26 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.419327:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 000000001ec7f4cb going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.419331:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210678 00000100:00100000:1.0:1651529344.419333:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+172:39029:x1731745946345536:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.419333:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396225984 00002000:00080000:1.0:1651529344.419337:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177124 count 1 00010000:00010000:0.0:1651529344.419337:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007bbb621e/0x3234de053c4cc60 lrc: 5/0,0 mode: PR/PR res: [0x2b3e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce359 expref: 1894 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.419340:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c653241/0x3234de053c4fce2 lrc: 3/0,1 mode: --/PW res: [0x2b3e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.419343:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396226112 00010000:00010000:1.0:1651529344.419344:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c4df0d lrc: 2/0,0 mode: PR/PR res: [0x2b3e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d65 expref: 1895 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.419346:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c4d830 lrc: 5/0,0 mode: PR/PR res: [0x2b3e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d11c0 expref: 1895 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.419347:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.419348:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.419349:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c653241/0x3234de053c4fce2 lrc: 4/0,1 mode: --/PW res: [0x2b3e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.419354:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11454 00010000:00010000:1.0:1651529344.419355:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c4df0d lrc: 3/0,0 mode: PR/PR res: [0x2b3e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d65 expref: 1895 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.419355:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1895:41278:x1731746396225984:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.419358:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c4df0d lrc: 4/0,0 mode: PR/PR res: [0x2b3e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d65 expref: 1895 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.419358:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.419359:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007bbb621e/0x3234de053c4cc60 lrc: 5/0,0 mode: PR/PR res: [0x2b3e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce359 expref: 1895 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.419362:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000057329b82 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996950144:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.419363:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007bbb621e/0x3234de053c4cc60 lrc: 4/0,0 mode: PR/PR res: [0x2b3e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce359 expref: 1895 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.419368:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 0000000018ebe812 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.419368:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.419368:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.419369:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009ce8a004/0x3234de053c4fcb8 lrc: 3/0,1 mode: PW/PW res: [0x2b3e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419372:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ce8a004/0x3234de053c4fcb8 lrc: 4/0,1 mode: PW/PW res: [0x2b3e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.419377:0:80277:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007bbb621e/0x3234de053c4cc60 lrc: 0/0,0 mode: --/PR res: [0x2b3e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce359 expref: 1895 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.419377:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.419381:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006929eb96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996949760:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.419382:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1894:41278:x1731746396225984:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 26us (193us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.419385:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009ce8a004/0x3234de053c4fcb8 lrc: 3/0,1 mode: PW/PW res: [0x2b3e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.419385:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11454 00010000:00010000:1.0:1651529344.419388:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009ce8a004/0x3234de053c4fcb8 lrc: 3/0,1 mode: PW/PW res: [0x2b3e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.419388:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11455 00010000:00010000:1.0:1651529344.419390:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ce8a004/0x3234de053c4fcb8 lrc: 3/0,1 mode: PW/PW res: [0x2b3e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.419390:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea4c33b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1893:41278:x1731746396226112:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.419393:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ce8a004/0x3234de053c4fcb8 lrc: 3/0,1 mode: PW/PW res: [0x2b3e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.419399:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ce8a004/0x3234de053c4fcb8 lrc: 2/0,0 mode: PW/PW res: [0x2b3e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419424:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.419426:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c4d830 lrc: 5/0,0 mode: PR/PR res: [0x2b3e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d11c0 expref: 1893 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.419431:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c4d830 lrc: 4/0,0 mode: PR/PR res: [0x2b3e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d11c0 expref: 1893 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.419436:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.419437:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.419437:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b33925b5/0x3234de053c4fcbf lrc: 3/0,1 mode: PW/PW res: [0x2b3e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419440:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b33925b5/0x3234de053c4fcbf lrc: 4/0,1 mode: PW/PW res: [0x2b3e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419445:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.419452:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+173:39030:x1731745946344896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 793us (1038us total) trans 12885078727 rc 0/0 00000100:00100000:0.0:1651529344.419452:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea4c33b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1893:41278:x1731746396226112:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 62us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.419455:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210672 00000100:00100000:0.0:1651529344.419455:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11455 00010000:00010000:0.0:1651529344.419466:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ce8a004/0x3234de053c4fcb8 lrc: 2/0,0 mode: PW/PW res: [0x2b3e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419470:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009ce8a004 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.419471:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ce8a004/0x3234de053c4fcb8 lrc: 2/0,0 mode: PW/PW res: [0x2b3e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.419472:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.419473:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ce8a004/0x3234de053c4fcb8 lrc: 3/0,0 mode: PW/PW res: [0x2b3e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419477:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ce8a004/0x3234de053c4fcb8 lrc: 1/0,0 mode: --/PW res: [0x2b3e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419482:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ce8a004/0x3234de053c4fcb8 lrc: 0/0,0 mode: --/PW res: [0x2b3e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419492:0:80280:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c4d830 lrc: 0/0,0 mode: --/PR res: [0x2b3e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d11c0 expref: 1892 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.419496:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996949824:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.419499:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b33925b5/0x3234de053c4fcbf lrc: 3/0,1 mode: PW/PW res: [0x2b3e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419502:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b33925b5/0x3234de053c4fcbf lrc: 3/0,1 mode: PW/PW res: [0x2b3e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419505:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b33925b5/0x3234de053c4fcbf lrc: 3/0,1 mode: PW/PW res: [0x2b3e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419508:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b33925b5/0x3234de053c4fcbf lrc: 3/0,1 mode: PW/PW res: [0x2b3e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419510:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b33925b5/0x3234de053c4fcbf lrc: 2/0,0 mode: PW/PW res: [0x2b3e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.419530:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.419563:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.419563:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+173:39029:x1731745946345024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 736us (761us total) trans 12885078728 rc 0/0 00000100:00100000:0.0:1651529344.419573:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210673 00000100:00100000:0.0:1651529344.419579:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946345728 00000100:00100000:0.0:1651529344.419588:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210679 00000100:00100000:0.0:1651529344.419590:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+173:39030:x1731745946345728:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.419595:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177127 count 1 00010000:00010000:0.0:1651529344.419599:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4fce9 lrc: 3/0,1 mode: --/PW res: [0x2b3e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419604:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c4f36c lrc: 2/0,0 mode: PR/PR res: [0x2b3e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8062 expref: 1891 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.419607:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.419607:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.419608:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4fce9 lrc: 4/0,1 mode: --/PW res: [0x2b3e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419614:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c4f36c lrc: 3/0,0 mode: PR/PR res: [0x2b3e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8062 expref: 1891 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.419618:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c4f36c lrc: 4/0,0 mode: PR/PR res: [0x2b3e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8062 expref: 1891 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.419619:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000037ac96ac pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996949888:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.419622:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996950208:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.419624:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003dcc98c1/0x3234de053c4fcc6 lrc: 3/0,1 mode: --/PW res: [0x2b3e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.419635:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000124f6b49 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.419657:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b33925b5/0x3234de053c4fcbf lrc: 2/0,0 mode: PW/PW res: [0x2b3e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419660:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b33925b5 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.419678:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b33925b5/0x3234de053c4fcbf lrc: 2/0,0 mode: PW/PW res: [0x2b3e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419682:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b33925b5/0x3234de053c4fcbf lrc: 3/0,0 mode: PW/PW res: [0x2b3e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419686:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b33925b5/0x3234de053c4fcbf lrc: 1/0,0 mode: --/PW res: [0x2b3e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.419688:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.419689:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b33925b5/0x3234de053c4fcbf lrc: 0/0,0 mode: --/PW res: [0x2b3e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.419695:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946345920 00000100:00100000:0.0:1651529344.419698:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396226176 00000100:00100000:1.0:1651529344.419701:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210680 00010000:00010000:0.0:1651529344.419702:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005d412086/0x3234de053c4d192 lrc: 4/0,0 mode: PR/PR res: [0x2b3e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf7aa expref: 1892 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.419703:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+174:39030:x1731745946345920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.419708:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177128 count 1 00000100:00100000:0.0:1651529344.419709:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396226240 00010000:00010000:0.0:1651529344.419711:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c4c6cc lrc: 5/0,0 mode: PR/PR res: [0x2b3e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd33 expref: 1893 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.419712:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c4fcf0 lrc: 3/0,1 mode: --/PW res: [0x2b3e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.419717:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dbb69211/0x3234de053c4edfb lrc: 2/0,0 mode: PR/PR res: [0x2b3e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a2e expref: 1893 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.419720:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11456 00000100:00100000:0.0:1651529344.419722:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1893:41279:x1731746396226176:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.419724:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.419726:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005d412086/0x3234de053c4d192 lrc: 4/0,0 mode: PR/PR res: [0x2b3e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf7aa expref: 1893 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.419727:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.419728:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.419728:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c4fcf0 lrc: 4/0,1 mode: --/PW res: [0x2b3e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419729:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005d412086/0x3234de053c4d192 lrc: 3/0,0 mode: PR/PR res: [0x2b3e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf7aa expref: 1893 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.419744:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dbb69211/0x3234de053c4edfb lrc: 3/0,0 mode: PR/PR res: [0x2b3e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a2e expref: 1893 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.419745:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d412086/0x3234de053c4d192 lrc: 0/0,0 mode: --/PR res: [0x2b3e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf7aa expref: 1893 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.419747:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dbb69211/0x3234de053c4edfb lrc: 4/0,0 mode: PR/PR res: [0x2b3e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a2e expref: 1893 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.419748:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.419749:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.419750:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003dcc98c1/0x3234de053c4fcc6 lrc: 3/0,1 mode: PW/PW res: [0x2b3e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.419752:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000027c41311 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996950272:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.419762:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 000000004ca54b8a going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.419769:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11457 00000100:00100000:1.0:1651529344.419771:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1892:41279:x1731746396226240:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.419774:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.419775:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c4c6cc lrc: 5/0,0 mode: PR/PR res: [0x2b3e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd33 expref: 1892 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.419778:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dcc98c1/0x3234de053c4fcc6 lrc: 4/0,1 mode: PW/PW res: [0x2b3e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419787:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.419795:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1892:41279:x1731746396226176:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 73us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.419798:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11456 00010000:00010000:1.0:1651529344.419800:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c4c6cc lrc: 4/0,0 mode: PR/PR res: [0x2b3e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd33 expref: 1892 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.419806:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.419806:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.419807:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000610e679c/0x3234de053c4fccd lrc: 3/0,1 mode: PW/PW res: [0x2b3e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.419810:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000610e679c/0x3234de053c4fccd lrc: 4/0,1 mode: PW/PW res: [0x2b3e1:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419810:0:72395:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c4c6cc lrc: 0/0,0 mode: --/PR res: [0x2b3e1:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd33 expref: 1891 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.419814:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996949952:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.419818:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.419818:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000610e679c/0x3234de053c4fccd lrc: 3/0,1 mode: PW/PW res: [0x2b3e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419821:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000610e679c/0x3234de053c4fccd lrc: 3/0,1 mode: PW/PW res: [0x2b3e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.419824:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1890:41279:x1731746396226240:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 53us (262us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.419824:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000610e679c/0x3234de053c4fccd lrc: 3/0,1 mode: PW/PW res: [0x2b3e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.419827:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11457 00010000:00010000:0.0:1651529344.419827:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000610e679c/0x3234de053c4fccd lrc: 3/0,1 mode: PW/PW res: [0x2b3e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419830:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000610e679c/0x3234de053c4fccd lrc: 2/0,0 mode: PW/PW res: [0x2b3e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.419834:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003dcc98c1/0x3234de053c4fcc6 lrc: 3/0,1 mode: PW/PW res: [0x2b3e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.419838:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003dcc98c1/0x3234de053c4fcc6 lrc: 3/0,1 mode: PW/PW res: [0x2b3e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.419841:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dcc98c1/0x3234de053c4fcc6 lrc: 3/0,1 mode: PW/PW res: [0x2b3e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.419843:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003dcc98c1/0x3234de053c4fcc6 lrc: 2/0,0 mode: PW/PW res: [0x2b3e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.419875:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+176:39030:x1731745946344960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 929us (1043us total) trans 12885078729 rc 0/0 00000100:00100000:0.0:1651529344.419878:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210674 00010000:00010000:0.0:1651529344.419886:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000610e679c/0x3234de053c4fccd lrc: 2/0,0 mode: PW/PW res: [0x2b3e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.419889:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+175:39030:x1731745946345088:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 940us (1032us total) trans 12885078730 rc 0/0 00010000:00010000:0.0:1651529344.419889:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000610e679c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.419890:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000610e679c/0x3234de053c4fccd lrc: 2/0,0 mode: PW/PW res: [0x2b3e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.419892:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210675 00010000:00010000:0.0:1651529344.419893:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000610e679c/0x3234de053c4fccd lrc: 3/0,0 mode: PW/PW res: [0x2b3e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419897:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000610e679c/0x3234de053c4fccd lrc: 1/0,0 mode: --/PW res: [0x2b3e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419900:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000610e679c/0x3234de053c4fccd lrc: 0/0,0 mode: --/PW res: [0x2b3e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.419907:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.419918:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003dcc98c1/0x3234de053c4fcc6 lrc: 2/0,0 mode: PW/PW res: [0x2b3e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419921:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003dcc98c1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.419922:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003dcc98c1/0x3234de053c4fcc6 lrc: 2/0,0 mode: PW/PW res: [0x2b3e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419924:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003dcc98c1/0x3234de053c4fcc6 lrc: 3/0,0 mode: PW/PW res: [0x2b3e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419928:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003dcc98c1/0x3234de053c4fcc6 lrc: 1/0,0 mode: --/PW res: [0x2b3e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.419930:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003dcc98c1/0x3234de053c4fcc6 lrc: 0/0,0 mode: --/PW res: [0x2b3e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.419973:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996950080:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.419977:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002c3d6b55/0x3234de053c4fcdb lrc: 3/0,1 mode: --/PW res: [0x2b3e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.419996:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000673bcbe2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996950016:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.420006:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005ec63a1b/0x3234de053c4fcd4 lrc: 3/0,1 mode: --/PW res: [0x2b3e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.420013:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946346048 00000100:00100000:1.0:1651529344.420023:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210681 00000100:00100000:1.0:1651529344.420025:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+175:39030:x1731745946346048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.420030:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177129 count 1 00010000:00010000:1.0:1651529344.420034:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e578053/0x3234de053c4fcf7 lrc: 3/0,1 mode: --/PW res: [0x2b3e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.420038:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e3eb2ea8/0x3234de053c4d4be lrc: 2/0,0 mode: PR/PR res: [0x2b3e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d04d8 expref: 1889 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.420041:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.420042:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.420043:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e578053/0x3234de053c4fcf7 lrc: 4/0,1 mode: --/PW res: [0x2b3e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.420049:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e3eb2ea8/0x3234de053c4d4be lrc: 3/0,0 mode: PR/PR res: [0x2b3e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d04d8 expref: 1889 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.420052:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e3eb2ea8/0x3234de053c4d4be lrc: 4/0,0 mode: PR/PR res: [0x2b3e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d04d8 expref: 1889 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.420056:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006929eb96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996950336:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.420065:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 000000004698fefb going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.420110:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.420123:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000057329b82 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996950144:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.420127:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002c653241/0x3234de053c4fce2 lrc: 3/0,1 mode: --/PW res: [0x2b3e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.420140:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946346112 00000100:00100000:0.0:1651529344.420149:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210682 00000100:00100000:0.0:1651529344.420151:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+176:39030:x1731745946346112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.420156:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177130 count 1 00000100:00100000:1.0:1651529344.420160:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.420160:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066374bf8/0x3234de053c4fcfe lrc: 3/0,1 mode: --/PW res: [0x2b3ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420165:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000707bb969/0x3234de053c4ec1f lrc: 2/0,0 mode: PR/PR res: [0x2b3ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d61f3 expref: 1889 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.420167:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946346176 00010000:00010000:0.0:1651529344.420170:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.420171:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.420172:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066374bf8/0x3234de053c4fcfe lrc: 4/0,1 mode: --/PW res: [0x2b3ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.420174:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210683 00000100:00100000:1.0:1651529344.420176:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+177:39029:x1731745946346176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.420178:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000707bb969/0x3234de053c4ec1f lrc: 3/0,0 mode: PR/PR res: [0x2b3ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d61f3 expref: 1889 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.420180:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177131 count 1 00010000:00010000:1.0:1651529344.420184:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4f40cb6/0x3234de053c4fd05 lrc: 3/0,1 mode: --/PW res: [0x2b3eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.420188:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000ff3021f/0x3234de053c4d7ea lrc: 2/0,0 mode: PR/PR res: [0x2b3eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d10f5 expref: 1889 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.420192:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.420192:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.420193:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4f40cb6/0x3234de053c4fd05 lrc: 4/0,1 mode: --/PW res: [0x2b3eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420196:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000707bb969/0x3234de053c4ec1f lrc: 4/0,0 mode: PR/PR res: [0x2b3ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d61f3 expref: 1889 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.420199:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000ff3021f/0x3234de053c4d7ea lrc: 3/0,0 mode: PR/PR res: [0x2b3eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d10f5 expref: 1889 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.420200:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996950400:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.420203:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000ff3021f/0x3234de053c4d7ea lrc: 4/0,0 mode: PR/PR res: [0x2b3eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d10f5 expref: 1889 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.420207:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002f77bb41 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996950464:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.420215:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000efb6ae52 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.420236:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 0000000057299e7f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.420296:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996950208:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.420297:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.420300:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4fce9 lrc: 3/0,1 mode: --/PW res: [0x2b3e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.420307:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.420313:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396226624 00000100:00100000:1.0:1651529344.420314:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.420322:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.420322:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000051652053/0x3234de053c4eb46 lrc: 4/0,0 mode: PR/PR res: [0x2b3e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5eb2 expref: 1890 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.420333:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396226752 00010000:00010000:0.0:1651529344.420335:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c4e095 lrc: 4/0,0 mode: PR/PR res: [0x2b3e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d32f9 expref: 1891 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.420336:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.420347:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006929eb96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996950336:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.420356:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008e578053/0x3234de053c4fcf7 lrc: 3/0,1 mode: --/PW res: [0x2b3e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.420359:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396226944 00010000:00010000:0.0:1651529344.420362:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c4f36c lrc: 4/0,0 mode: PR/PR res: [0x2b3e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8062 expref: 1892 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.420364:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000027c41311 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996950272:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.420366:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c4fcf0 lrc: 3/0,1 mode: --/PW res: [0x2b3e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.420366:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396226880 00010000:00010000:0.0:1651529344.420368:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c4df0d lrc: 4/0,0 mode: PR/PR res: [0x2b3e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d65 expref: 1893 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.420372:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396227008 00000100:00100000:0.0:1651529344.420373:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11458 00000100:00100000:0.0:1651529344.420374:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1894:41279:x1731746396226624:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.420377:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dbb69211/0x3234de053c4edfb lrc: 4/0,0 mode: PR/PR res: [0x2b3e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a2e expref: 1894 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.420377:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.420378:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000051652053/0x3234de053c4eb46 lrc: 4/0,0 mode: PR/PR res: [0x2b3e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5eb2 expref: 1894 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.420382:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000051652053/0x3234de053c4eb46 lrc: 3/0,0 mode: PR/PR res: [0x2b3e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5eb2 expref: 1894 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.420383:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11459 00000100:00100000:1.0:1651529344.420384:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1894:41278:x1731746396226752:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.420387:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.420388:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051652053/0x3234de053c4eb46 lrc: 0/0,0 mode: --/PR res: [0x2b3e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5eb2 expref: 1894 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.420389:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c4e095 lrc: 4/0,0 mode: PR/PR res: [0x2b3e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d32f9 expref: 1894 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.420391:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.420392:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c4e095 lrc: 3/0,0 mode: PR/PR res: [0x2b3e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d32f9 expref: 1893 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.420392:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.420393:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005ec63a1b/0x3234de053c4fcd4 lrc: 3/0,1 mode: PW/PW res: [0x2b3e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420396:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ec63a1b/0x3234de053c4fcd4 lrc: 4/0,1 mode: PW/PW res: [0x2b3e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.420398:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c4e095 lrc: 0/0,0 mode: --/PR res: [0x2b3e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d32f9 expref: 1893 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.420405:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.420412:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.420412:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1892:41279:x1731746396226624:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 37us (115us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.420413:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.420414:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002c3d6b55/0x3234de053c4fcdb lrc: 3/0,1 mode: PW/PW res: [0x2b3e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.420415:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11458 00010000:00010000:1.0:1651529344.420417:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c3d6b55/0x3234de053c4fcdb lrc: 4/0,1 mode: PW/PW res: [0x2b3e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.420420:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11460 00000100:00100000:0.0:1651529344.420421:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1891:41279:x1731746396226944:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.420426:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.420430:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.420432:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c4f36c lrc: 4/0,0 mode: PR/PR res: [0x2b3e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8062 expref: 1891 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.420433:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1891:41278:x1731746396226752:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 48us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.420436:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11459 00010000:00010000:0.0:1651529344.420436:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c4f36c lrc: 3/0,0 mode: PR/PR res: [0x2b3e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8062 expref: 1891 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.420441:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11461 00010000:00010000:0.0:1651529344.420441:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c4f36c lrc: 0/0,0 mode: --/PR res: [0x2b3e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8062 expref: 1890 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.420443:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1890:41278:x1731746396226880:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.420444:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.420445:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.420445:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.420446:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4fce9 lrc: 3/0,1 mode: PW/PW res: [0x2b3e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.420447:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c4df0d lrc: 4/0,0 mode: PR/PR res: [0x2b3e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d65 expref: 1889 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.420449:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4fce9 lrc: 4/0,1 mode: PW/PW res: [0x2b3e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.420451:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c4df0d lrc: 3/0,0 mode: PR/PR res: [0x2b3e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d65 expref: 1889 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.420455:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c4df0d lrc: 0/0,0 mode: --/PR res: [0x2b3e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d65 expref: 1889 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.420455:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.420459:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.420459:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.420460:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002c653241/0x3234de053c4fce2 lrc: 3/0,1 mode: PW/PW res: [0x2b3e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.420460:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1888:41279:x1731746396226944:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (146us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.420463:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c653241/0x3234de053c4fce2 lrc: 4/0,1 mode: PW/PW res: [0x2b3e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.420463:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11460 00000100:00100000:0.0:1651529344.420468:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11462 00010000:00010000:1.0:1651529344.420469:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.420469:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1a0028d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1887:41278:x1731746396227008:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.420471:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.420473:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dbb69211/0x3234de053c4edfb lrc: 4/0,0 mode: PR/PR res: [0x2b3e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a2e expref: 1887 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.420474:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1887:41278:x1731746396226880:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 30us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.420476:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11461 00010000:00010000:0.0:1651529344.420477:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dbb69211/0x3234de053c4edfb lrc: 3/0,0 mode: PR/PR res: [0x2b3e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a2e expref: 1887 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.420481:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002c653241/0x3234de053c4fce2 lrc: 3/0,1 mode: PW/PW res: [0x2b3e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420481:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dbb69211/0x3234de053c4edfb lrc: 0/0,0 mode: --/PR res: [0x2b3e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a2e expref: 1886 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.420484:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c653241/0x3234de053c4fce2 lrc: 3/0,1 mode: PW/PW res: [0x2b3e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420484:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.420484:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.420485:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c4fcf0 lrc: 3/0,1 mode: PW/PW res: [0x2b3e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.420487:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c653241/0x3234de053c4fce2 lrc: 3/0,1 mode: PW/PW res: [0x2b3e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420488:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c4fcf0 lrc: 4/0,1 mode: PW/PW res: [0x2b3e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.420490:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c653241/0x3234de053c4fce2 lrc: 2/0,0 mode: PW/PW res: [0x2b3e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420503:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.420521:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1a0028d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1885:41278:x1731746396227008:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 51us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.420524:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11462 00010000:00010000:0.0:1651529344.420535:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c653241/0x3234de053c4fce2 lrc: 2/0,0 mode: PW/PW res: [0x2b3e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.420536:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+178:39029:x1731745946345536:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1202us (1399us total) trans 12885078731 rc 0/0 00000100:00100000:1.0:1651529344.420539:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210678 00010000:00010000:0.0:1651529344.420539:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002c653241 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.420540:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c653241/0x3234de053c4fce2 lrc: 2/0,0 mode: PW/PW res: [0x2b3e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420543:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c653241/0x3234de053c4fce2 lrc: 3/0,0 mode: PW/PW res: [0x2b3e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.420546:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005ec63a1b/0x3234de053c4fcd4 lrc: 3/0,1 mode: PW/PW res: [0x2b3e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420547:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c653241/0x3234de053c4fce2 lrc: 1/0,0 mode: --/PW res: [0x2b3e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420550:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c653241/0x3234de053c4fce2 lrc: 0/0,0 mode: --/PW res: [0x2b3e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.420552:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ec63a1b/0x3234de053c4fcd4 lrc: 3/0,1 mode: PW/PW res: [0x2b3e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.420555:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ec63a1b/0x3234de053c4fcd4 lrc: 3/0,1 mode: PW/PW res: [0x2b3e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.420557:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ec63a1b/0x3234de053c4fcd4 lrc: 2/0,0 mode: PW/PW res: [0x2b3e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420557:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002c3d6b55/0x3234de053c4fcdb lrc: 3/0,1 mode: PW/PW res: [0x2b3e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420560:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c3d6b55/0x3234de053c4fcdb lrc: 3/0,1 mode: PW/PW res: [0x2b3e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420563:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c3d6b55/0x3234de053c4fcdb lrc: 3/0,1 mode: PW/PW res: [0x2b3e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420572:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c3d6b55/0x3234de053c4fcdb lrc: 2/0,0 mode: PW/PW res: [0x2b3e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.420595:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+179:39030:x1731745946345600:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1324us (1417us total) trans 12885078732 rc 0/0 00000100:00100000:1.0:1651529344.420598:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210676 00010000:00010000:1.0:1651529344.420604:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c4fcf0 lrc: 3/0,1 mode: PW/PW res: [0x2b3e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.420607:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c4fcf0 lrc: 3/0,1 mode: PW/PW res: [0x2b3e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.420610:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c4fcf0 lrc: 3/0,1 mode: PW/PW res: [0x2b3e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.420613:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c4fcf0 lrc: 2/0,0 mode: PW/PW res: [0x2b3e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.420613:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+178:39029:x1731745946345664:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1327us (1403us total) trans 12885078733 rc 0/0 00000100:00100000:0.0:1651529344.420616:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210677 00010000:00010000:0.0:1651529344.420631:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ec63a1b/0x3234de053c4fcd4 lrc: 2/0,0 mode: PW/PW res: [0x2b3e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420634:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005ec63a1b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.420635:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ec63a1b/0x3234de053c4fcd4 lrc: 2/0,0 mode: PW/PW res: [0x2b3e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420638:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ec63a1b/0x3234de053c4fcd4 lrc: 3/0,0 mode: PW/PW res: [0x2b3e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420643:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ec63a1b/0x3234de053c4fcd4 lrc: 1/0,0 mode: --/PW res: [0x2b3e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420646:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ec63a1b/0x3234de053c4fcd4 lrc: 0/0,0 mode: --/PW res: [0x2b3e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.420649:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+178:39030:x1731745946345920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 945us (962us total) trans 12885078734 rc 0/0 00010000:00010000:0.0:1651529344.420650:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c3d6b55/0x3234de053c4fcdb lrc: 2/0,0 mode: PW/PW res: [0x2b3e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420652:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002c3d6b55 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.420653:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c3d6b55/0x3234de053c4fcdb lrc: 2/0,0 mode: PW/PW res: [0x2b3e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.420654:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210680 00010000:00010000:0.0:1651529344.420656:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c3d6b55/0x3234de053c4fcdb lrc: 3/0,0 mode: PW/PW res: [0x2b3e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420659:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c3d6b55/0x3234de053c4fcdb lrc: 1/0,0 mode: --/PW res: [0x2b3e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420662:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c3d6b55/0x3234de053c4fcdb lrc: 0/0,0 mode: --/PW res: [0x2b3e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420665:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c4fcf0 lrc: 2/0,0 mode: PW/PW res: [0x2b3e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420668:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000491b5359 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.420669:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c4fcf0 lrc: 2/0,0 mode: PW/PW res: [0x2b3e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420671:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c4fcf0 lrc: 3/0,0 mode: PW/PW res: [0x2b3e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420674:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c4fcf0 lrc: 1/0,0 mode: --/PW res: [0x2b3e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420677:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c4fcf0 lrc: 0/0,0 mode: --/PW res: [0x2b3e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420683:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4fce9 lrc: 3/0,1 mode: PW/PW res: [0x2b3e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420686:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4fce9 lrc: 3/0,1 mode: PW/PW res: [0x2b3e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.420687:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.420689:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4fce9 lrc: 3/0,1 mode: PW/PW res: [0x2b3e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420696:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4fce9 lrc: 2/0,0 mode: PW/PW res: [0x2b3e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.420723:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.420743:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.420758:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+178:39030:x1731745946345728:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1167us (1286us total) trans 12885078735 rc 0/0 00000100:00100000:0.0:1651529344.420761:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210679 00010000:00010000:0.0:1651529344.420768:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4fce9 lrc: 2/0,0 mode: PW/PW res: [0x2b3e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420772:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b3ecd1a6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.420773:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4fce9 lrc: 2/0,0 mode: PW/PW res: [0x2b3e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420775:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4fce9 lrc: 3/0,0 mode: PW/PW res: [0x2b3e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420780:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4fce9 lrc: 1/0,0 mode: --/PW res: [0x2b3e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420782:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c4fce9 lrc: 0/0,0 mode: --/PW res: [0x2b3e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.420789:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396227072 00010000:00010000:0.0:1651529344.420793:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e3eb2ea8/0x3234de053c4d4be lrc: 4/0,0 mode: PR/PR res: [0x2b3e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d04d8 expref: 1885 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.420804:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396227136 00010000:00010000:0.0:1651529344.420807:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000707bb969/0x3234de053c4ec1f lrc: 5/0,0 mode: PR/PR res: [0x2b3ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d61f3 expref: 1886 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.420813:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396227264 00010000:00010000:0.0:1651529344.420815:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000ff3021f/0x3234de053c4d7ea lrc: 5/0,0 mode: PR/PR res: [0x2b3eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d10f5 expref: 1887 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.420820:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11463 00000100:00100000:0.0:1651529344.420821:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1887:41279:x1731746396227072:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.420824:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.420825:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e3eb2ea8/0x3234de053c4d4be lrc: 4/0,0 mode: PR/PR res: [0x2b3e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d04d8 expref: 1887 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.420829:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e3eb2ea8/0x3234de053c4d4be lrc: 3/0,0 mode: PR/PR res: [0x2b3e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d04d8 expref: 1887 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.420833:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002f77bb41 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996950464:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.420833:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3eb2ea8/0x3234de053c4d4be lrc: 0/0,0 mode: --/PR res: [0x2b3e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d04d8 expref: 1887 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.420838:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b4f40cb6/0x3234de053c4fd05 lrc: 3/0,1 mode: --/PW res: [0x2b3eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.420846:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11464 00000100:00100000:1.0:1651529344.420848:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1887:41279:x1731746396227136:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.420851:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.420853:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000707bb969/0x3234de053c4ec1f lrc: 5/0,0 mode: PR/PR res: [0x2b3ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d61f3 expref: 1887 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.420854:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.420855:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.420856:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008e578053/0x3234de053c4fcf7 lrc: 3/0,1 mode: PW/PW res: [0x2b3e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.420857:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000707bb969/0x3234de053c4ec1f lrc: 4/0,0 mode: PR/PR res: [0x2b3ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d61f3 expref: 1886 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.420859:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e578053/0x3234de053c4fcf7 lrc: 4/0,1 mode: PW/PW res: [0x2b3e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.420863:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.420863:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.420864:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000066374bf8/0x3234de053c4fcfe lrc: 3/0,1 mode: PW/PW res: [0x2b3ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420869:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.420874:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066374bf8/0x3234de053c4fcfe lrc: 4/0,1 mode: PW/PW res: [0x2b3ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.420880:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1886:41279:x1731746396227072:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 57us (192us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.420883:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.420883:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11463 00000100:00100000:0.0:1651529344.420888:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11465 00000100:00100000:0.0:1651529344.420889:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1885:41279:x1731746396227264:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.420890:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1885:41279:x1731746396227136:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (168us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.420892:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.420893:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11464 00010000:00010000:0.0:1651529344.420893:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000ff3021f/0x3234de053c4d7ea lrc: 4/0,0 mode: PR/PR res: [0x2b3eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d10f5 expref: 1885 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.420897:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000ff3021f/0x3234de053c4d7ea lrc: 3/0,0 mode: PR/PR res: [0x2b3eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d10f5 expref: 1884 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.420901:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008e578053/0x3234de053c4fcf7 lrc: 3/0,1 mode: PW/PW res: [0x2b3e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420903:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ff3021f/0x3234de053c4d7ea lrc: 0/0,0 mode: --/PR res: [0x2b3eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d10f5 expref: 1884 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.420904:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e578053/0x3234de053c4fcf7 lrc: 3/0,1 mode: PW/PW res: [0x2b3e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420906:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.420907:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e578053/0x3234de053c4fcf7 lrc: 3/0,1 mode: PW/PW res: [0x2b3e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420907:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.420907:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4f40cb6/0x3234de053c4fd05 lrc: 3/0,1 mode: PW/PW res: [0x2b3eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.420909:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e578053/0x3234de053c4fcf7 lrc: 2/0,0 mode: PW/PW res: [0x2b3e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420910:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4f40cb6/0x3234de053c4fd05 lrc: 4/0,1 mode: PW/PW res: [0x2b3eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420922:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.420928:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1883:41279:x1731746396227264:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 38us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.420930:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11465 00010000:00010000:0.0:1651529344.420937:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e578053/0x3234de053c4fcf7 lrc: 2/0,0 mode: PW/PW res: [0x2b3e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420940:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008e578053 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.420941:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e578053/0x3234de053c4fcf7 lrc: 2/0,0 mode: PW/PW res: [0x2b3e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420944:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e578053/0x3234de053c4fcf7 lrc: 3/0,0 mode: PW/PW res: [0x2b3e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420948:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e578053/0x3234de053c4fcf7 lrc: 1/0,0 mode: --/PW res: [0x2b3e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420950:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e578053/0x3234de053c4fcf7 lrc: 0/0,0 mode: --/PW res: [0x2b3e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.420954:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+178:39030:x1731745946346048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 929us (1047us total) trans 12885078736 rc 0/0 00000100:00100000:1.0:1651529344.420957:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210681 00010000:00010000:0.0:1651529344.420960:0:72395:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000707bb969/0x3234de053c4ec1f lrc: 0/0,0 mode: --/PR res: [0x2b3ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d61f3 expref: 1882 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.420963:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996950400:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.420964:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b4f40cb6/0x3234de053c4fd05 lrc: 3/0,1 mode: PW/PW res: [0x2b3eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.420967:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4f40cb6/0x3234de053c4fd05 lrc: 3/0,1 mode: PW/PW res: [0x2b3eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420967:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000066374bf8/0x3234de053c4fcfe lrc: 3/0,1 mode: PW/PW res: [0x2b3ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.420970:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4f40cb6/0x3234de053c4fd05 lrc: 3/0,1 mode: PW/PW res: [0x2b3eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420970:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000066374bf8/0x3234de053c4fcfe lrc: 3/0,1 mode: PW/PW res: [0x2b3ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.420972:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4f40cb6/0x3234de053c4fd05 lrc: 2/0,0 mode: PW/PW res: [0x2b3eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420973:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066374bf8/0x3234de053c4fcfe lrc: 3/0,1 mode: PW/PW res: [0x2b3ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420978:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066374bf8/0x3234de053c4fcfe lrc: 3/0,1 mode: PW/PW res: [0x2b3ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.420987:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066374bf8/0x3234de053c4fcfe lrc: 2/0,0 mode: PW/PW res: [0x2b3ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.421012:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+179:39029:x1731745946346176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 835us (852us total) trans 12885078737 rc 0/0 00000100:00100000:1.0:1651529344.421015:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210683 00000100:00100000:0.0:1651529344.421025:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+178:39030:x1731745946346112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 873us (915us total) trans 12885078738 rc 0/0 00000100:00100000:0.0:1651529344.421051:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210682 00000100:00100000:1.0:1651529344.421063:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.421067:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946346432 00000100:00100000:0.0:1651529344.421077:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210684 00000100:00100000:0.0:1651529344.421079:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+178:39029:x1731745946346432:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.421084:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177132 count 1 00010000:00010000:0.0:1651529344.421089:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c4fd0c lrc: 3/0,1 mode: --/PW res: [0x2b3ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.421094:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d1e9e4c0/0x3234de053c4f094 lrc: 2/0,0 mode: PR/PR res: [0x2b3ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d753a expref: 1881 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.421095:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.421097:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.421098:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.421104:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c4fd0c lrc: 4/0,1 mode: --/PW res: [0x2b3ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.421105:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.421112:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.421112:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d1e9e4c0/0x3234de053c4f094 lrc: 3/0,0 mode: PR/PR res: [0x2b3ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d753a expref: 1881 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.421121:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.421123:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d1e9e4c0/0x3234de053c4f094 lrc: 4/0,0 mode: PR/PR res: [0x2b3ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d753a expref: 1881 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.421127:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946346496 00000100:00100000:0.0:1651529344.421127:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996950528:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.421133:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946346816 00000100:00100000:1.0:1651529344.421139:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946346944 00000100:00100000:1.0:1651529344.421142:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946346880 00000100:00100000:1.0:1651529344.421146:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210685 00000100:00100000:1.0:1651529344.421147:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+182:39030:x1731745946346496:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.421153:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177133 count 1 00010000:00010000:1.0:1651529344.421157:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c4fd13 lrc: 3/0,1 mode: --/PW res: [0x2b3ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.421160:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000efb6ae52 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.421166:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4f40cb6/0x3234de053c4fd05 lrc: 2/0,0 mode: PW/PW res: [0x2b3eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.421168:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000001ccd9b7/0x3234de053c4f182 lrc: 2/0,0 mode: PR/PR res: [0x2b3ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7900 expref: 1881 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.421169:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b4f40cb6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.421170:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4f40cb6/0x3234de053c4fd05 lrc: 2/0,0 mode: PW/PW res: [0x2b3eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.421171:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.421172:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.421172:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c4fd13 lrc: 4/0,1 mode: --/PW res: [0x2b3ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.421173:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4f40cb6/0x3234de053c4fd05 lrc: 3/0,0 mode: PW/PW res: [0x2b3eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.421178:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4f40cb6/0x3234de053c4fd05 lrc: 1/0,0 mode: --/PW res: [0x2b3eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.421179:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000001ccd9b7/0x3234de053c4f182 lrc: 3/0,0 mode: PR/PR res: [0x2b3ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7900 expref: 1881 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.421181:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4f40cb6/0x3234de053c4fd05 lrc: 0/0,0 mode: --/PW res: [0x2b3eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.421183:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000001ccd9b7/0x3234de053c4f182 lrc: 4/0,0 mode: PR/PR res: [0x2b3ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7900 expref: 1881 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.421185:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066374bf8/0x3234de053c4fcfe lrc: 2/0,0 mode: PW/PW res: [0x2b3ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.421187:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000027c41311 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996950592:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.421188:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000066374bf8 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.421188:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066374bf8/0x3234de053c4fcfe lrc: 2/0,0 mode: PW/PW res: [0x2b3ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.421191:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066374bf8/0x3234de053c4fcfe lrc: 3/0,0 mode: PW/PW res: [0x2b3ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.421194:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066374bf8/0x3234de053c4fcfe lrc: 1/0,0 mode: --/PW res: [0x2b3ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.421196:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a5495eb going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.421197:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066374bf8/0x3234de053c4fcfe lrc: 0/0,0 mode: --/PW res: [0x2b3ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.421202:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210686 00000100:00100000:1.0:1651529344.421204:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+182:39029:x1731745946346816:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.421205:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210687 00000100:00100000:0.0:1651529344.421207:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+182:39029:x1731745946346944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.421208:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177134 count 1 00010000:00010000:1.0:1651529344.421211:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c4fd1a lrc: 3/0,1 mode: --/PW res: [0x2b3ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.421212:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177136 count 1 00010000:00010000:0.0:1651529344.421215:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea0ab3e9/0x3234de053c4fd21 lrc: 3/0,1 mode: --/PW res: [0x2b3f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.421216:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c4e1b4 lrc: 2/0,0 mode: PR/PR res: [0x2b3ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3824 expref: 1881 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.421219:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.421219:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.421219:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eec80574/0x3234de053c4eb2a lrc: 2/0,0 mode: PR/PR res: [0x2b3f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e57 expref: 1881 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.421220:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c4fd1a lrc: 4/0,1 mode: --/PW res: [0x2b3ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.421241:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c4e1b4 lrc: 3/0,0 mode: PR/PR res: [0x2b3ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3824 expref: 1881 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.421245:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c4e1b4 lrc: 4/0,0 mode: PR/PR res: [0x2b3ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3824 expref: 1881 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.421252:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006929eb96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996950656:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.421259:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000004698fefb going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.421268:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.421268:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.421269:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea0ab3e9/0x3234de053c4fd21 lrc: 4/0,1 mode: --/PW res: [0x2b3f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.421274:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210688 00000100:00100000:1.0:1651529344.421275:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+182:39029:x1731745946346880:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.421277:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eec80574/0x3234de053c4eb2a lrc: 3/0,0 mode: PR/PR res: [0x2b3f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e57 expref: 1881 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.421280:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177135 count 1 00010000:00010000:1.0:1651529344.421284:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e783e5a/0x3234de053c4fd28 lrc: 3/0,1 mode: --/PW res: [0x2b3ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.421288:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ebf7beea/0x3234de053c4c505 lrc: 2/0,0 mode: PR/PR res: [0x2b3ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc9b3 expref: 1881 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.421289:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eec80574/0x3234de053c4eb2a lrc: 4/0,0 mode: PR/PR res: [0x2b3f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e57 expref: 1881 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.421291:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.421292:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.421292:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e783e5a/0x3234de053c4fd28 lrc: 4/0,1 mode: --/PW res: [0x2b3ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.421295:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996950720:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.421298:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ebf7beea/0x3234de053c4c505 lrc: 3/0,0 mode: PR/PR res: [0x2b3ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc9b3 expref: 1881 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.421302:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ebf7beea/0x3234de053c4c505 lrc: 4/0,0 mode: PR/PR res: [0x2b3ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc9b3 expref: 1881 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.421306:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f99b3c22 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996950784:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.421306:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000124f6b49 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.421313:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b52d0f36 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.421327:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.421341:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.421350:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.421364:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946347136 00000100:00100000:0.0:1651529344.421376:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946347072 00000100:00100000:0.0:1651529344.421380:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210689 00000100:00100000:0.0:1651529344.421382:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+184:39030:x1731745946347136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.421387:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177138 count 1 00010000:00010000:0.0:1651529344.421392:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd3089ef/0x3234de053c4fd2f lrc: 3/0,1 mode: --/PW res: [0x2b3f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.421397:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000b169871/0x3234de053c4c7a5 lrc: 2/0,0 mode: PR/PR res: [0x2b3f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd100 expref: 1881 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.421400:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.421400:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.421401:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd3089ef/0x3234de053c4fd2f lrc: 4/0,1 mode: --/PW res: [0x2b3f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.421409:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946347200 00000100:00100000:1.0:1651529344.421420:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210690 00000100:00100000:1.0:1651529344.421422:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+185:39029:x1731745946347072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.421427:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177137 count 1 00010000:00010000:1.0:1651529344.421431:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c4fd36 lrc: 3/0,1 mode: --/PW res: [0x2b3f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.421432:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000b169871/0x3234de053c4c7a5 lrc: 3/0,0 mode: PR/PR res: [0x2b3f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd100 expref: 1881 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.421435:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d688ac01/0x3234de053c4cb72 lrc: 2/0,0 mode: PR/PR res: [0x2b3f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf2a expref: 1881 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.421435:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000b169871/0x3234de053c4c7a5 lrc: 4/0,0 mode: PR/PR res: [0x2b3f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd100 expref: 1881 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.421438:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.421439:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.421439:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996950848:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.421440:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c4fd36 lrc: 4/0,1 mode: --/PW res: [0x2b3f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.421446:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d688ac01/0x3234de053c4cb72 lrc: 3/0,0 mode: PR/PR res: [0x2b3f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf2a expref: 1881 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.421449:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d688ac01/0x3234de053c4cb72 lrc: 4/0,0 mode: PR/PR res: [0x2b3f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf2a expref: 1881 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.421455:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c8d20cf1 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.421460:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000095d7eb1a pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996950912:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.421462:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210691 00000100:00100000:0.0:1651529344.421464:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+185:39029:x1731745946347200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.421469:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.421469:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177139 count 1 00010000:00010000:0.0:1651529344.421473:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c4fd3d lrc: 3/0,1 mode: --/PW res: [0x2b3f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.421477:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e85ad79c/0x3234de053c4a9ec lrc: 2/0,0 mode: PR/PR res: [0x2b3f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd49 expref: 1881 pid: 80281 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.421480:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.421481:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.421481:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c4fd3d lrc: 4/0,1 mode: --/PW res: [0x2b3f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.421487:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e85ad79c/0x3234de053c4a9ec lrc: 3/0,0 mode: PR/PR res: [0x2b3f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd49 expref: 1881 pid: 80281 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.421491:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e85ad79c/0x3234de053c4a9ec lrc: 4/0,0 mode: PR/PR res: [0x2b3f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd49 expref: 1881 pid: 80281 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.421495:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996950976:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.421507:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000382571b5 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.421826:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006929eb96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996950656:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.421831:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c4fd1a lrc: 3/0,1 mode: --/PW res: [0x2b3ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.421838:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000027c41311 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996950592:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.421846:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996950528:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.421852:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c4fd13 lrc: 3/0,1 mode: --/PW res: [0x2b3ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.421852:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c4fd0c lrc: 3/0,1 mode: --/PW res: [0x2b3ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.421862:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.421864:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996950720:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.421872:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.421873:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ea0ab3e9/0x3234de053c4fd21 lrc: 3/0,1 mode: --/PW res: [0x2b3f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.421880:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.421889:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.421890:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396227520 00010000:00010000:0.0:1651529344.421896:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c4e1b4 lrc: 4/0,0 mode: PR/PR res: [0x2b3ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3824 expref: 1882 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.421907:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f99b3c22 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996950784:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.421908:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396227584 00010000:00010000:1.0:1651529344.421910:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006e783e5a/0x3234de053c4fd28 lrc: 3/0,1 mode: --/PW res: [0x2b3ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.421910:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d1e9e4c0/0x3234de053c4f094 lrc: 4/0,0 mode: PR/PR res: [0x2b3ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d753a expref: 1883 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.421915:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396227648 00000100:00100000:1.0:1651529344.421917:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396227712 00010000:00010000:0.0:1651529344.421917:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000001ccd9b7/0x3234de053c4f182 lrc: 4/0,0 mode: PR/PR res: [0x2b3ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7900 expref: 1884 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.421922:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eec80574/0x3234de053c4eb2a lrc: 4/0,0 mode: PR/PR res: [0x2b3f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e57 expref: 1885 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.421922:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11466 00000100:00100000:0.0:1651529344.421924:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1885:41278:x1731746396227520:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.421927:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.421928:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11467 00010000:00010000:0.0:1651529344.421928:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c4e1b4 lrc: 4/0,0 mode: PR/PR res: [0x2b3ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3824 expref: 1885 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.421930:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1885:41279:x1731746396227584:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.421931:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c4e1b4 lrc: 3/0,0 mode: PR/PR res: [0x2b3ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3824 expref: 1885 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.421932:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.421934:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d1e9e4c0/0x3234de053c4f094 lrc: 4/0,0 mode: PR/PR res: [0x2b3ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d753a expref: 1885 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.421938:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d1e9e4c0/0x3234de053c4f094 lrc: 3/0,0 mode: PR/PR res: [0x2b3ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d753a expref: 1885 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.421940:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c4e1b4 lrc: 0/0,0 mode: --/PR res: [0x2b3ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3824 expref: 1885 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.421944:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.421944:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.421945:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c4fd1a lrc: 3/0,1 mode: PW/PW res: [0x2b3ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.421946:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1e9e4c0/0x3234de053c4f094 lrc: 0/0,0 mode: --/PR res: [0x2b3ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d753a expref: 1884 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.421948:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c4fd1a lrc: 4/0,1 mode: PW/PW res: [0x2b3ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.421950:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.421951:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.421952:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c4fd0c lrc: 3/0,1 mode: PW/PW res: [0x2b3ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.421955:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c4fd0c lrc: 4/0,1 mode: PW/PW res: [0x2b3ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.421958:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.421969:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1883:41278:x1731746396227520:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 45us (107us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.421975:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.421977:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11466 00000100:00100000:0.0:1651529344.421982:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11468 00000100:00100000:1.0:1651529344.421983:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1882:41279:x1731746396227584:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 52us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.421984:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1882:41278:x1731746396227648:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.421986:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11467 00010000:00010000:0.0:1651529344.421987:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.421988:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000001ccd9b7/0x3234de053c4f182 lrc: 4/0,0 mode: PR/PR res: [0x2b3ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7900 expref: 1882 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.421991:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11469 00010000:00010000:0.0:1651529344.421992:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000001ccd9b7/0x3234de053c4f182 lrc: 3/0,0 mode: PR/PR res: [0x2b3ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7900 expref: 1881 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.421993:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012f61efb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1881:41279:x1731746396227712:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.421995:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.421997:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eec80574/0x3234de053c4eb2a lrc: 4/0,0 mode: PR/PR res: [0x2b3f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e57 expref: 1881 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.422000:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eec80574/0x3234de053c4eb2a lrc: 3/0,0 mode: PR/PR res: [0x2b3f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e57 expref: 1881 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.422005:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eec80574/0x3234de053c4eb2a lrc: 0/0,0 mode: --/PR res: [0x2b3f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e57 expref: 1881 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.422011:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.422012:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.422012:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea0ab3e9/0x3234de053c4fd21 lrc: 3/0,1 mode: PW/PW res: [0x2b3f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422015:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea0ab3e9/0x3234de053c4fd21 lrc: 4/0,1 mode: PW/PW res: [0x2b3f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422028:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001ccd9b7/0x3234de053c4f182 lrc: 0/0,0 mode: --/PR res: [0x2b3ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7900 expref: 1880 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.422036:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.422041:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.422041:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.422042:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012f61efb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1879:41279:x1731746396227712:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 48us (152us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.422042:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c4fd13 lrc: 3/0,1 mode: PW/PW res: [0x2b3ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.422044:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11469 00010000:00010000:0.0:1651529344.422045:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c4fd13 lrc: 4/0,1 mode: PW/PW res: [0x2b3ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422051:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c4fd1a lrc: 3/0,1 mode: PW/PW res: [0x2b3ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422054:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.422059:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c4fd1a lrc: 3/0,1 mode: PW/PW res: [0x2b3ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.422061:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1878:41278:x1731746396227648:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 77us (181us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.422063:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c4fd1a lrc: 3/0,1 mode: PW/PW res: [0x2b3ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.422064:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11468 00010000:00010000:1.0:1651529344.422065:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c4fd1a lrc: 2/0,0 mode: PW/PW res: [0x2b3ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422080:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c4fd1a lrc: 2/0,0 mode: PW/PW res: [0x2b3ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422084:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004ab50553 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.422085:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c4fd1a lrc: 2/0,0 mode: PW/PW res: [0x2b3ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422088:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c4fd1a lrc: 3/0,0 mode: PW/PW res: [0x2b3ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422092:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c4fd1a lrc: 1/0,0 mode: --/PW res: [0x2b3ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422095:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c4fd1a lrc: 0/0,0 mode: --/PW res: [0x2b3ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422103:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ea0ab3e9/0x3234de053c4fd21 lrc: 3/0,1 mode: PW/PW res: [0x2b3f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422106:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea0ab3e9/0x3234de053c4fd21 lrc: 3/0,1 mode: PW/PW res: [0x2b3f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.422108:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+186:39029:x1731745946346816:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 904us (1003us total) trans 12885078739 rc 0/0 00010000:00010000:0.0:1651529344.422109:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea0ab3e9/0x3234de053c4fd21 lrc: 3/0,1 mode: PW/PW res: [0x2b3f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.422111:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210686 00010000:00010000:0.0:1651529344.422112:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea0ab3e9/0x3234de053c4fd21 lrc: 2/0,0 mode: PW/PW res: [0x2b3f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422118:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c4fd13 lrc: 3/0,1 mode: PW/PW res: [0x2b3ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422122:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c4fd13 lrc: 3/0,1 mode: PW/PW res: [0x2b3ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422125:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c4fd13 lrc: 3/0,1 mode: PW/PW res: [0x2b3ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422127:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c4fd13 lrc: 2/0,0 mode: PW/PW res: [0x2b3ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.422160:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+187:39029:x1731745946346944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 952us (1047us total) trans 12885078740 rc 0/0 00000100:00100000:0.0:1651529344.422163:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210687 00000100:00100000:1.0:1651529344.422167:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+186:39030:x1731745946346496:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1018us (1072us total) trans 12885078741 rc 0/0 00000100:00100000:1.0:1651529344.422169:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210685 00010000:00010000:0.0:1651529344.422170:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea0ab3e9/0x3234de053c4fd21 lrc: 2/0,0 mode: PW/PW res: [0x2b3f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422174:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ea0ab3e9 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.422174:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea0ab3e9/0x3234de053c4fd21 lrc: 2/0,0 mode: PW/PW res: [0x2b3f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422177:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea0ab3e9/0x3234de053c4fd21 lrc: 3/0,0 mode: PW/PW res: [0x2b3f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422181:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea0ab3e9/0x3234de053c4fd21 lrc: 1/0,0 mode: --/PW res: [0x2b3f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422184:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea0ab3e9/0x3234de053c4fd21 lrc: 0/0,0 mode: --/PW res: [0x2b3f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422188:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c4fd13 lrc: 2/0,0 mode: PW/PW res: [0x2b3ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422191:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ea00c64e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.422192:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c4fd13 lrc: 2/0,0 mode: PW/PW res: [0x2b3ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422195:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c4fd13 lrc: 3/0,0 mode: PW/PW res: [0x2b3ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422205:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c4fd13 lrc: 1/0,0 mode: --/PW res: [0x2b3ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.422207:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.422208:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c4fd13 lrc: 0/0,0 mode: --/PW res: [0x2b3ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.422218:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.422239:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996950976:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.422243:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c4fd3d lrc: 3/0,1 mode: --/PW res: [0x2b3f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.422245:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.422252:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396227840 00000100:00100000:1.0:1651529344.422253:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.422256:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ebf7beea/0x3234de053c4c505 lrc: 4/0,0 mode: PR/PR res: [0x2b3ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc9b3 expref: 1878 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.422264:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396228096 00010000:00010000:0.0:1651529344.422266:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e85ad79c/0x3234de053c4a9ec lrc: 4/0,0 mode: PR/PR res: [0x2b3f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd49 expref: 1879 pid: 80281 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.422270:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396227904 00010000:00010000:0.0:1651529344.422272:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000b169871/0x3234de053c4c7a5 lrc: 5/0,0 mode: PR/PR res: [0x2b3f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd100 expref: 1880 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.422276:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396228032 00010000:00010000:0.0:1651529344.422278:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d688ac01/0x3234de053c4cb72 lrc: 5/0,0 mode: PR/PR res: [0x2b3f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf2a expref: 1881 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.422283:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11470 00000100:00100000:0.0:1651529344.422284:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1881:41279:x1731746396227840:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.422287:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.422288:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ebf7beea/0x3234de053c4c505 lrc: 4/0,0 mode: PR/PR res: [0x2b3ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc9b3 expref: 1881 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.422292:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ebf7beea/0x3234de053c4c505 lrc: 3/0,0 mode: PR/PR res: [0x2b3ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc9b3 expref: 1881 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.422297:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ebf7beea/0x3234de053c4c505 lrc: 0/0,0 mode: --/PR res: [0x2b3ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc9b3 expref: 1881 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.422299:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000095d7eb1a pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996950912:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.422301:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.422301:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.422302:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006e783e5a/0x3234de053c4fd28 lrc: 3/0,1 mode: PW/PW res: [0x2b3ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422303:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c4fd36 lrc: 3/0,1 mode: --/PW res: [0x2b3f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422305:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e783e5a/0x3234de053c4fd28 lrc: 4/0,1 mode: PW/PW res: [0x2b3ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.422311:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11471 00000100:00100000:1.0:1651529344.422313:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1880:41279:x1731746396228096:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.422317:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.422318:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e85ad79c/0x3234de053c4a9ec lrc: 4/0,0 mode: PR/PR res: [0x2b3f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd49 expref: 1880 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.422322:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e85ad79c/0x3234de053c4a9ec lrc: 3/0,0 mode: PR/PR res: [0x2b3f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd49 expref: 1880 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.422330:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.422334:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e85ad79c/0x3234de053c4a9ec lrc: 0/0,0 mode: --/PR res: [0x2b3f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd49 expref: 1880 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.422338:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.422339:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.422341:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1879:41279:x1731746396227840:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 56us (134us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.422344:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c4fd3d lrc: 3/0,1 mode: PW/PW res: [0x2b3f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.422344:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11470 00010000:00010000:1.0:1651529344.422347:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c4fd3d lrc: 4/0,1 mode: PW/PW res: [0x2b3f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.422349:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11472 00000100:00100000:0.0:1651529344.422351:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1878:41279:x1731746396227904:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.422354:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.422356:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.422361:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000b169871/0x3234de053c4c7a5 lrc: 5/0,0 mode: PR/PR res: [0x2b3f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd100 expref: 1878 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.422364:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1878:41279:x1731746396228096:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 50us (145us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.422365:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000b169871/0x3234de053c4c7a5 lrc: 4/0,0 mode: PR/PR res: [0x2b3f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd100 expref: 1878 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.422366:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11471 00010000:00010000:0.0:1651529344.422371:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.422371:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.422372:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11473 00010000:00010000:0.0:1651529344.422372:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd3089ef/0x3234de053c4fd2f lrc: 3/0,1 mode: PW/PW res: [0x2b3f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.422373:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1877:41279:x1731746396228032:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.422375:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd3089ef/0x3234de053c4fd2f lrc: 4/0,1 mode: PW/PW res: [0x2b3f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422376:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.422377:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d688ac01/0x3234de053c4cb72 lrc: 4/0,0 mode: PR/PR res: [0x2b3f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf2a expref: 1877 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.422379:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.422381:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d688ac01/0x3234de053c4cb72 lrc: 3/0,0 mode: PR/PR res: [0x2b3f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf2a expref: 1877 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.422386:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d688ac01/0x3234de053c4cb72 lrc: 0/0,0 mode: --/PR res: [0x2b3f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf2a expref: 1877 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.422390:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.422390:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.422391:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c4fd36 lrc: 3/0,1 mode: PW/PW res: [0x2b3f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422394:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c4fd36 lrc: 4/0,1 mode: PW/PW res: [0x2b3f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.422398:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1876:41279:x1731746396227904:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 46us (153us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.422400:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.422401:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11472 00000100:00100000:1.0:1651529344.422405:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1875:41279:x1731746396228032:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 31us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.422407:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11473 00010000:00010000:0.0:1651529344.422409:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c4fd3d lrc: 3/0,1 mode: PW/PW res: [0x2b3f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422412:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c4fd3d lrc: 3/0,1 mode: PW/PW res: [0x2b3f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422413:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006e783e5a/0x3234de053c4fd28 lrc: 3/0,1 mode: PW/PW res: [0x2b3ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422415:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c4fd3d lrc: 3/0,1 mode: PW/PW res: [0x2b3f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422416:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e783e5a/0x3234de053c4fd28 lrc: 3/0,1 mode: PW/PW res: [0x2b3ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422418:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c4fd3d lrc: 2/0,0 mode: PW/PW res: [0x2b3f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422419:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e783e5a/0x3234de053c4fd28 lrc: 3/0,1 mode: PW/PW res: [0x2b3ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422421:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e783e5a/0x3234de053c4fd28 lrc: 2/0,0 mode: PW/PW res: [0x2b3ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.422465:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+187:39029:x1731745946346880:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1189us (1344us total) trans 12885078742 rc 0/0 00000100:00100000:1.0:1651529344.422468:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210688 00010000:00010000:1.0:1651529344.422475:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c4fd36 lrc: 3/0,1 mode: PW/PW res: [0x2b3f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422478:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c4fd36 lrc: 3/0,1 mode: PW/PW res: [0x2b3f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.422480:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+186:39029:x1731745946347200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1015us (1129us total) trans 12885078743 rc 0/0 00010000:00010000:1.0:1651529344.422481:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c4fd36 lrc: 3/0,1 mode: PW/PW res: [0x2b3f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.422483:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210691 00010000:00010000:1.0:1651529344.422484:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c4fd36 lrc: 2/0,0 mode: PW/PW res: [0x2b3f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422499:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c4fd3d lrc: 2/0,0 mode: PW/PW res: [0x2b3f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422502:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000078e8c25c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.422503:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c4fd3d lrc: 2/0,0 mode: PW/PW res: [0x2b3f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422506:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c4fd3d lrc: 3/0,0 mode: PW/PW res: [0x2b3f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422514:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c4fd3d lrc: 1/0,0 mode: --/PW res: [0x2b3f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422516:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c4fd3d lrc: 0/0,0 mode: --/PW res: [0x2b3f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.422521:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+186:39029:x1731745946347072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1098us (1180us total) trans 12885078744 rc 0/0 00010000:00010000:0.0:1651529344.422521:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e783e5a/0x3234de053c4fd28 lrc: 2/0,0 mode: PW/PW res: [0x2b3ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422523:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006e783e5a already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.422524:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210690 00010000:00010000:0.0:1651529344.422524:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e783e5a/0x3234de053c4fd28 lrc: 2/0,0 mode: PW/PW res: [0x2b3ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422527:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e783e5a/0x3234de053c4fd28 lrc: 3/0,0 mode: PW/PW res: [0x2b3ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422530:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e783e5a/0x3234de053c4fd28 lrc: 1/0,0 mode: --/PW res: [0x2b3ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422533:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e783e5a/0x3234de053c4fd28 lrc: 0/0,0 mode: --/PW res: [0x2b3ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422536:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c4fd36 lrc: 2/0,0 mode: PW/PW res: [0x2b3f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422539:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d3d72adb already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.422540:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c4fd36 lrc: 2/0,0 mode: PW/PW res: [0x2b3f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422542:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c4fd36 lrc: 3/0,0 mode: PW/PW res: [0x2b3f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422546:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c4fd36 lrc: 1/0,0 mode: --/PW res: [0x2b3f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422548:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c4fd36 lrc: 0/0,0 mode: --/PW res: [0x2b3f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422555:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c4fd0c lrc: 3/0,1 mode: PW/PW res: [0x2b3ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.422558:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.422558:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c4fd0c lrc: 3/0,1 mode: PW/PW res: [0x2b3ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422561:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c4fd0c lrc: 3/0,1 mode: PW/PW res: [0x2b3ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422564:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c4fd0c lrc: 2/0,0 mode: PW/PW res: [0x2b3ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.422572:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.422588:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.422607:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+186:39029:x1731745946346432:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1526us (1544us total) trans 12885078745 rc 0/0 00000100:00100000:0.0:1651529344.422610:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210684 00000100:00100000:0.0:1651529344.422615:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946347520 00000100:00100000:0.0:1651529344.422625:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946347648 00000100:00100000:0.0:1651529344.422629:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946347584 00000100:00100000:0.0:1651529344.422636:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210692 00000100:00100000:0.0:1651529344.422637:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+188:39029:x1731745946347520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.422642:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177140 count 1 00010000:00010000:0.0:1651529344.422647:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4fd44 lrc: 3/0,1 mode: --/PW res: [0x2b3f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422651:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ad204608/0x3234de053c4d773 lrc: 2/0,0 mode: PR/PR res: [0x2b3f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f66 expref: 1874 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.422660:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210693 00000100:00100000:1.0:1651529344.422662:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+188:39030:x1731745946347648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.422668:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177142 count 1 00010000:00010000:1.0:1651529344.422672:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005960f1ad/0x3234de053c4fd4b lrc: 3/0,1 mode: --/PW res: [0x2b3f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422672:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.422673:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.422674:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4fd44 lrc: 4/0,1 mode: --/PW res: [0x2b3f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422677:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c4db16 lrc: 2/0,0 mode: PR/PR res: [0x2b3f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c6a expref: 1874 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.422680:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.422681:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.422682:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005960f1ad/0x3234de053c4fd4b lrc: 4/0,1 mode: --/PW res: [0x2b3f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422682:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ad204608/0x3234de053c4d773 lrc: 3/0,0 mode: PR/PR res: [0x2b3f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f66 expref: 1874 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.422686:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ad204608/0x3234de053c4d773 lrc: 4/0,0 mode: PR/PR res: [0x2b3f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f66 expref: 1874 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.422688:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c4db16 lrc: 3/0,0 mode: PR/PR res: [0x2b3f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c6a expref: 1874 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.422690:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996951040:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.422692:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c4db16 lrc: 4/0,0 mode: PR/PR res: [0x2b3f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c6a expref: 1874 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.422696:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009acffcb8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996951104:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.422705:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aac39cef going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.422710:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c4fd0c lrc: 2/0,0 mode: PW/PW res: [0x2b3ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.422712:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f79d8146 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.422713:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ef6f99f3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.422714:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c4fd0c lrc: 2/0,0 mode: PW/PW res: [0x2b3ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.422718:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210694 00010000:00010000:0.0:1651529344.422718:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c4fd0c lrc: 3/0,0 mode: PW/PW res: [0x2b3ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.422720:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b750793d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+188:39029:x1731745946347584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.422722:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c4fd0c lrc: 1/0,0 mode: --/PW res: [0x2b3ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.422724:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177141 count 1 00010000:00010000:0.0:1651529344.422725:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c4fd0c lrc: 0/0,0 mode: --/PW res: [0x2b3ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422728:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069e35989/0x3234de053c4fd52 lrc: 3/0,1 mode: --/PW res: [0x2b3f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422732:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d483ffab/0x3234de053c4b529 lrc: 2/0,0 mode: PR/PR res: [0x2b3f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc266 expref: 1874 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.422745:0:80280:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b169871/0x3234de053c4c7a5 lrc: 0/0,0 mode: --/PR res: [0x2b3f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd100 expref: 1874 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.422746:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.422747:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.422748:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069e35989/0x3234de053c4fd52 lrc: 4/0,1 mode: --/PW res: [0x2b3f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.422749:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996950848:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.422752:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dd3089ef/0x3234de053c4fd2f lrc: 3/0,1 mode: PW/PW res: [0x2b3f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422754:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d483ffab/0x3234de053c4b529 lrc: 3/0,0 mode: PR/PR res: [0x2b3f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc266 expref: 1873 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.422755:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dd3089ef/0x3234de053c4fd2f lrc: 3/0,1 mode: PW/PW res: [0x2b3f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422758:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d483ffab/0x3234de053c4b529 lrc: 4/0,0 mode: PR/PR res: [0x2b3f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc266 expref: 1873 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.422758:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd3089ef/0x3234de053c4fd2f lrc: 3/0,1 mode: PW/PW res: [0x2b3f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422761:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd3089ef/0x3234de053c4fd2f lrc: 3/0,1 mode: PW/PW res: [0x2b3f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.422762:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c43262d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996951168:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.422764:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd3089ef/0x3234de053c4fd2f lrc: 2/0,0 mode: PW/PW res: [0x2b3f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.422768:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.422813:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.422833:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+189:39030:x1731745946347136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1450us (1505us total) trans 12885078746 rc 0/0 00000100:00100000:0.0:1651529344.422836:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210689 00000100:00100000:1.0:1651529344.422838:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.422841:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946347712 00000100:00100000:0.0:1651529344.422847:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946347840 00000100:00100000:0.0:1651529344.422851:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210695 00000100:00100000:0.0:1651529344.422853:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+190:39029:x1731745946347712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.422858:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177143 count 1 00010000:00010000:0.0:1651529344.422862:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4fd59 lrc: 3/0,1 mode: --/PW res: [0x2b3f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.422865:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.422866:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008fb69f9f/0x3234de053c4c965 lrc: 2/0,0 mode: PR/PR res: [0x2b3f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd719 expref: 1873 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.422876:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.422877:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.422878:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.422879:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4fd59 lrc: 4/0,1 mode: --/PW res: [0x2b3f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.422884:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946347776 00010000:00010000:0.0:1651529344.422886:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008fb69f9f/0x3234de053c4c965 lrc: 3/0,0 mode: PR/PR res: [0x2b3f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd719 expref: 1873 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.422890:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946347904 00010000:00010000:0.0:1651529344.422890:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008fb69f9f/0x3234de053c4c965 lrc: 4/0,0 mode: PR/PR res: [0x2b3f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd719 expref: 1873 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.422894:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996951232:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.422897:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210696 00000100:00100000:1.0:1651529344.422899:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+192:39029:x1731745946347840:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.422904:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177145 count 1 00010000:00010000:1.0:1651529344.422908:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000662594c3/0x3234de053c4fd60 lrc: 3/0,1 mode: --/PW res: [0x2b3f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.422912:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 0000000064b9c5f3 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.422918:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd3089ef/0x3234de053c4fd2f lrc: 2/0,0 mode: PW/PW res: [0x2b3f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422919:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006769cf41/0x3234de053c4d5ba lrc: 2/0,0 mode: PR/PR res: [0x2b3f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0843 expref: 1873 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.422921:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dd3089ef already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.422922:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.422922:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd3089ef/0x3234de053c4fd2f lrc: 2/0,0 mode: PW/PW res: [0x2b3f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422923:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.422924:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000662594c3/0x3234de053c4fd60 lrc: 4/0,1 mode: --/PW res: [0x2b3f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422925:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd3089ef/0x3234de053c4fd2f lrc: 3/0,0 mode: PW/PW res: [0x2b3f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422930:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006769cf41/0x3234de053c4d5ba lrc: 3/0,0 mode: PR/PR res: [0x2b3f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0843 expref: 1873 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.422930:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd3089ef/0x3234de053c4fd2f lrc: 1/0,0 mode: --/PW res: [0x2b3f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422932:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd3089ef/0x3234de053c4fd2f lrc: 0/0,0 mode: --/PW res: [0x2b3f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422934:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006769cf41/0x3234de053c4d5ba lrc: 4/0,0 mode: PR/PR res: [0x2b3f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0843 expref: 1873 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.422938:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004be0190 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996951296:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.422940:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210697 00000100:00100000:0.0:1651529344.422942:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+192:39030:x1731745946347776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.422946:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b52d0f36 going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.422947:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177144 count 1 00010000:00010000:0.0:1651529344.422950:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4fd67 lrc: 3/0,1 mode: --/PW res: [0x2b3f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.422953:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210698 00000100:00100000:1.0:1651529344.422954:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+192:39030:x1731745946347904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.422954:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cb266188/0x3234de053c4eae4 lrc: 2/0,0 mode: PR/PR res: [0x2b3f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d4d expref: 1873 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.422957:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.422958:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1651529344.422959:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177146 count 1 00010000:00010000:0.0:1651529344.422959:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4fd67 lrc: 4/0,1 mode: --/PW res: [0x2b3f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.422962:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039586f31/0x3234de053c4fd6e lrc: 3/0,1 mode: --/PW res: [0x2b3fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.422965:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cb266188/0x3234de053c4eae4 lrc: 3/0,0 mode: PR/PR res: [0x2b3f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d4d expref: 1873 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.422967:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c4f28c lrc: 2/0,0 mode: PR/PR res: [0x2b3fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d2f expref: 1873 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.422969:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cb266188/0x3234de053c4eae4 lrc: 4/0,0 mode: PR/PR res: [0x2b3f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d4d expref: 1873 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.422970:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.422970:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.422971:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039586f31/0x3234de053c4fd6e lrc: 4/0,1 mode: --/PW res: [0x2b3fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.422973:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996951360:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.422976:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c4f28c lrc: 3/0,0 mode: PR/PR res: [0x2b3fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d2f expref: 1873 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.422980:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f9dd6aa3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.422982:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c4f28c lrc: 4/0,0 mode: PR/PR res: [0x2b3fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d2f expref: 1873 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.422986:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000050bbb886 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996951424:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.422992:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a5495eb going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.423069:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.423104:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996951040:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.423108:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4fd44 lrc: 3/0,1 mode: --/PW res: [0x2b3f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.423109:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.423118:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.423122:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396228608 00000100:00100000:1.0:1651529344.423126:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.423127:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c4db16 lrc: 5/0,0 mode: PR/PR res: [0x2b3f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c6a expref: 1874 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.423137:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009acffcb8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996951104:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.423142:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396228544 00010000:00010000:0.0:1651529344.423145:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ad204608/0x3234de053c4d773 lrc: 4/0,0 mode: PR/PR res: [0x2b3f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f66 expref: 1875 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.423146:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005960f1ad/0x3234de053c4fd4b lrc: 3/0,1 mode: --/PW res: [0x2b3f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.423154:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c43262d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996951168:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.423157:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000069e35989/0x3234de053c4fd52 lrc: 3/0,1 mode: --/PW res: [0x2b3f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.423167:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396228672 00000100:00100000:1.0:1651529344.423168:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946348160 00010000:00010000:0.0:1651529344.423170:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d483ffab/0x3234de053c4b529 lrc: 4/0,0 mode: PR/PR res: [0x2b3f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc266 expref: 1876 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.423175:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210699 00000100:00100000:1.0:1651529344.423177:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+193:39029:x1731745946348160:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.423178:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11474 00000100:00100000:0.0:1651529344.423180:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1876:41279:x1731746396228608:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00002000:00080000:1.0:1651529344.423181:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177147 count 1 00010000:00010000:0.0:1651529344.423182:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.423184:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c4db16 lrc: 4/0,0 mode: PR/PR res: [0x2b3f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c6a expref: 1876 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.423186:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c4fd75 lrc: 3/0,1 mode: --/PW res: [0x2b3fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423187:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c4db16 lrc: 3/0,0 mode: PR/PR res: [0x2b3f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c6a expref: 1876 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.423192:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004a35aa4a/0x3234de053c4cb4f lrc: 2/0,0 mode: PR/PR res: [0x2b3fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdeac expref: 1876 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.423193:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c4db16 lrc: 0/0,0 mode: --/PR res: [0x2b3f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c6a expref: 1876 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.423196:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.423196:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.423197:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c4fd75 lrc: 4/0,1 mode: --/PW res: [0x2b3fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423197:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.423197:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.423198:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005960f1ad/0x3234de053c4fd4b lrc: 3/0,1 mode: PW/PW res: [0x2b3f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423201:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005960f1ad/0x3234de053c4fd4b lrc: 4/0,1 mode: PW/PW res: [0x2b3f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.423203:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004a35aa4a/0x3234de053c4cb4f lrc: 3/0,0 mode: PR/PR res: [0x2b3fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdeac expref: 1875 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.423206:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004a35aa4a/0x3234de053c4cb4f lrc: 4/0,0 mode: PR/PR res: [0x2b3fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdeac expref: 1875 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.423210:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.423217:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1875:41279:x1731746396228608:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.423218:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996951488:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.423220:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11474 00000100:00100000:1.0:1651529344.423244:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f79d8146 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.423245:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11475 00000100:00100000:0.0:1651529344.423247:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1874:41279:x1731746396228544:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.423248:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005960f1ad/0x3234de053c4fd4b lrc: 3/0,1 mode: PW/PW res: [0x2b3f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423249:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.423251:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ad204608/0x3234de053c4d773 lrc: 4/0,0 mode: PR/PR res: [0x2b3f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f66 expref: 1874 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.423252:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005960f1ad/0x3234de053c4fd4b lrc: 3/0,1 mode: PW/PW res: [0x2b3f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.423255:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005960f1ad/0x3234de053c4fd4b lrc: 3/0,1 mode: PW/PW res: [0x2b3f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423255:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ad204608/0x3234de053c4d773 lrc: 3/0,0 mode: PR/PR res: [0x2b3f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f66 expref: 1874 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.423257:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005960f1ad/0x3234de053c4fd4b lrc: 2/0,0 mode: PW/PW res: [0x2b3f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423260:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad204608/0x3234de053c4d773 lrc: 0/0,0 mode: --/PR res: [0x2b3f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f66 expref: 1874 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.423263:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.423264:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.423270:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4fd44 lrc: 3/0,1 mode: PW/PW res: [0x2b3f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423274:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4fd44 lrc: 4/0,1 mode: PW/PW res: [0x2b3f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423280:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.423286:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1873:41279:x1731746396228544:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 39us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.423288:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11475 00000100:00100000:0.0:1651529344.423293:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11476 00000100:00100000:0.0:1651529344.423294:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001cec52dd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1872:41279:x1731746396228672:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.423297:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.423298:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d483ffab/0x3234de053c4b529 lrc: 4/0,0 mode: PR/PR res: [0x2b3f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc266 expref: 1872 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.423301:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+194:39030:x1731745946347648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 638us (729us total) trans 12885078747 rc 0/0 00010000:00010000:0.0:1651529344.423302:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d483ffab/0x3234de053c4b529 lrc: 3/0,0 mode: PR/PR res: [0x2b3f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc266 expref: 1872 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.423305:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210693 00010000:00010000:0.0:1651529344.423307:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d483ffab/0x3234de053c4b529 lrc: 0/0,0 mode: --/PR res: [0x2b3f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc266 expref: 1872 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.423310:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.423310:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.423311:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000069e35989/0x3234de053c4fd52 lrc: 3/0,1 mode: PW/PW res: [0x2b3f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423314:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069e35989/0x3234de053c4fd52 lrc: 4/0,1 mode: PW/PW res: [0x2b3f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423323:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.423372:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001cec52dd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1871:41279:x1731746396228672:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 76us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.423375:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11476 00010000:00010000:0.0:1651529344.423396:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005960f1ad/0x3234de053c4fd4b lrc: 2/0,0 mode: PW/PW res: [0x2b3f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423400:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005960f1ad already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.423401:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005960f1ad/0x3234de053c4fd4b lrc: 2/0,0 mode: PW/PW res: [0x2b3f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423404:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005960f1ad/0x3234de053c4fd4b lrc: 3/0,0 mode: PW/PW res: [0x2b3f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423409:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005960f1ad/0x3234de053c4fd4b lrc: 1/0,0 mode: --/PW res: [0x2b3f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423418:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005960f1ad/0x3234de053c4fd4b lrc: 0/0,0 mode: --/PW res: [0x2b3f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.423428:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996951360:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.423429:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.423431:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4fd67 lrc: 3/0,1 mode: --/PW res: [0x2b3f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.423443:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396228800 00010000:00010000:0.0:1651529344.423447:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008fb69f9f/0x3234de053c4c965 lrc: 5/0,0 mode: PR/PR res: [0x2b3f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd719 expref: 1871 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.423458:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11477 00000100:00100000:0.0:1651529344.423459:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1871:41279:x1731746396228800:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.423462:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.423463:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008fb69f9f/0x3234de053c4c965 lrc: 5/0,0 mode: PR/PR res: [0x2b3f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd719 expref: 1871 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.423464:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.423467:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008fb69f9f/0x3234de053c4c965 lrc: 4/0,0 mode: PR/PR res: [0x2b3f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd719 expref: 1871 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.423470:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.423472:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.423473:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.423474:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4fd59 lrc: 3/0,1 mode: PW/PW res: [0x2b3f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.423476:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.423477:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4fd59 lrc: 4/0,1 mode: PW/PW res: [0x2b3f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.423481:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000069e35989/0x3234de053c4fd52 lrc: 3/0,1 mode: PW/PW res: [0x2b3f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423481:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.423485:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069e35989/0x3234de053c4fd52 lrc: 3/0,1 mode: PW/PW res: [0x2b3f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.423488:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069e35989/0x3234de053c4fd52 lrc: 3/0,1 mode: PW/PW res: [0x2b3f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.423492:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1871:41279:x1731746396228800:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 32us (63us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.423494:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11477 00010000:00010000:1.0:1651529344.423496:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069e35989/0x3234de053c4fd52 lrc: 2/0,0 mode: PW/PW res: [0x2b3f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.423498:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396228864 00010000:00010000:0.0:1651529344.423502:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006769cf41/0x3234de053c4d5ba lrc: 5/0,0 mode: PR/PR res: [0x2b3f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0843 expref: 1871 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.423513:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396228928 00010000:00010000:0.0:1651529344.423516:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cb266188/0x3234de053c4eae4 lrc: 4/0,0 mode: PR/PR res: [0x2b3f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d4d expref: 1872 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.423520:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396228992 00010000:00010000:0.0:1651529344.423522:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c4f28c lrc: 5/0,0 mode: PR/PR res: [0x2b3fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d2f expref: 1873 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.423526:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11478 00000100:00100000:0.0:1651529344.423528:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1873:41279:x1731746396228864:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.423530:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.423531:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006769cf41/0x3234de053c4d5ba lrc: 5/0,0 mode: PR/PR res: [0x2b3f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0843 expref: 1873 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.423536:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b750793d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+194:39029:x1731745946347584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 815us (948us total) trans 12885078748 rc 0/0 00010000:00010000:0.0:1651529344.423537:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006769cf41/0x3234de053c4d5ba lrc: 4/0,0 mode: PR/PR res: [0x2b3f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0843 expref: 1873 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.423539:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210694 00010000:00010000:0.0:1651529344.423542:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.423542:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.423543:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000662594c3/0x3234de053c4fd60 lrc: 3/0,1 mode: PW/PW res: [0x2b3f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.423550:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000050bbb886 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996951424:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.423554:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000039586f31/0x3234de053c4fd6e lrc: 3/0,1 mode: --/PW res: [0x2b3fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423562:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000662594c3/0x3234de053c4fd60 lrc: 4/0,1 mode: PW/PW res: [0x2b3f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.423563:0:80278:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006769cf41/0x3234de053c4d5ba lrc: 0/0,0 mode: --/PR res: [0x2b3f9:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0843 expref: 1873 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.423567:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004be0190 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996951296:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.423567:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.423569:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000662594c3/0x3234de053c4fd60 lrc: 3/0,1 mode: PW/PW res: [0x2b3f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.423572:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000662594c3/0x3234de053c4fd60 lrc: 3/0,1 mode: PW/PW res: [0x2b3f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.423574:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1872:41279:x1731746396228864:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 45us (110us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.423575:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000662594c3/0x3234de053c4fd60 lrc: 3/0,1 mode: PW/PW res: [0x2b3f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.423576:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11478 00010000:00010000:1.0:1651529344.423578:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000662594c3/0x3234de053c4fd60 lrc: 3/0,1 mode: PW/PW res: [0x2b3f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.423581:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000662594c3/0x3234de053c4fd60 lrc: 2/0,0 mode: PW/PW res: [0x2b3f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.423581:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11479 00000100:00100000:0.0:1651529344.423582:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1871:41278:x1731746396228928:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.423585:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.423586:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cb266188/0x3234de053c4eae4 lrc: 4/0,0 mode: PR/PR res: [0x2b3f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d4d expref: 1871 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.423597:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cb266188/0x3234de053c4eae4 lrc: 3/0,0 mode: PR/PR res: [0x2b3f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d4d expref: 1871 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.423602:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb266188/0x3234de053c4eae4 lrc: 0/0,0 mode: --/PR res: [0x2b3f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d4d expref: 1871 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.423608:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.423609:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.423610:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4fd67 lrc: 3/0,1 mode: PW/PW res: [0x2b3f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423612:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4fd67 lrc: 4/0,1 mode: PW/PW res: [0x2b3f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.423619:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+194:39029:x1731745946347840:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 719us (787us total) trans 12885078749 rc 0/0 00000100:00100000:1.0:1651529344.423622:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210696 00000100:00100000:1.0:1651529344.423630:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11480 00000100:00100000:1.0:1651529344.423631:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1870:41279:x1731746396228992:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.423632:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.423636:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.423638:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c4f28c lrc: 4/0,0 mode: PR/PR res: [0x2b3fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d2f expref: 1870 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.423638:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1870:41278:x1731746396228928:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 55us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.423641:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11479 00010000:00010000:1.0:1651529344.423642:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c4f28c lrc: 3/0,0 mode: PR/PR res: [0x2b3fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d2f expref: 1870 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.423647:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c4f28c lrc: 0/0,0 mode: --/PR res: [0x2b3fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d2f expref: 1869 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.423648:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069e35989/0x3234de053c4fd52 lrc: 2/0,0 mode: PW/PW res: [0x2b3f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.423651:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.423651:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.423651:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000069e35989 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.423652:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000039586f31/0x3234de053c4fd6e lrc: 3/0,1 mode: PW/PW res: [0x2b3fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423652:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069e35989/0x3234de053c4fd52 lrc: 2/0,0 mode: PW/PW res: [0x2b3f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.423655:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039586f31/0x3234de053c4fd6e lrc: 4/0,1 mode: PW/PW res: [0x2b3fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423655:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069e35989/0x3234de053c4fd52 lrc: 3/0,0 mode: PW/PW res: [0x2b3f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423659:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069e35989/0x3234de053c4fd52 lrc: 1/0,0 mode: --/PW res: [0x2b3f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.423662:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.423662:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069e35989/0x3234de053c4fd52 lrc: 0/0,0 mode: --/PW res: [0x2b3f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.423667:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1868:41279:x1731746396228992:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (191us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.423668:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000662594c3/0x3234de053c4fd60 lrc: 2/0,0 mode: PW/PW res: [0x2b3f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.423670:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11480 00010000:00010000:0.0:1651529344.423671:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000662594c3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.423671:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000662594c3/0x3234de053c4fd60 lrc: 2/0,0 mode: PW/PW res: [0x2b3f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.423675:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000039586f31/0x3234de053c4fd6e lrc: 3/0,1 mode: PW/PW res: [0x2b3fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.423679:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039586f31/0x3234de053c4fd6e lrc: 3/0,1 mode: PW/PW res: [0x2b3fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.423684:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039586f31/0x3234de053c4fd6e lrc: 3/0,1 mode: PW/PW res: [0x2b3fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.423687:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039586f31/0x3234de053c4fd6e lrc: 2/0,0 mode: PW/PW res: [0x2b3fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423687:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000662594c3/0x3234de053c4fd60 lrc: 3/0,0 mode: PW/PW res: [0x2b3f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423692:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000662594c3/0x3234de053c4fd60 lrc: 1/0,0 mode: --/PW res: [0x2b3f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423700:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000662594c3/0x3234de053c4fd60 lrc: 0/0,0 mode: --/PW res: [0x2b3f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423705:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039586f31/0x3234de053c4fd6e lrc: 2/0,0 mode: PW/PW res: [0x2b3fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423707:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000039586f31 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.423708:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039586f31/0x3234de053c4fd6e lrc: 2/0,0 mode: PW/PW res: [0x2b3fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423711:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039586f31/0x3234de053c4fd6e lrc: 3/0,0 mode: PW/PW res: [0x2b3fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423714:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039586f31/0x3234de053c4fd6e lrc: 1/0,0 mode: --/PW res: [0x2b3fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423718:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039586f31/0x3234de053c4fd6e lrc: 0/0,0 mode: --/PW res: [0x2b3fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423724:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4fd67 lrc: 3/0,1 mode: PW/PW res: [0x2b3f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.423726:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+194:39030:x1731745946347904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 771us (850us total) trans 12885078750 rc 0/0 00010000:00010000:0.0:1651529344.423727:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4fd67 lrc: 3/0,1 mode: PW/PW res: [0x2b3f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.423729:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210698 00010000:00010000:0.0:1651529344.423730:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4fd67 lrc: 3/0,1 mode: PW/PW res: [0x2b3f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423733:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4fd67 lrc: 2/0,0 mode: PW/PW res: [0x2b3f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.423754:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.423784:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+194:39030:x1731745946347776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 841us (918us total) trans 12885078751 rc 0/0 00000100:00100000:0.0:1651529344.423787:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210697 00000100:00100000:1.0:1651529344.423788:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.423792:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946348416 00000100:00100000:0.0:1651529344.423802:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210700 00000100:00100000:0.0:1651529344.423804:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+194:39030:x1731745946348416:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.423809:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177148 count 1 00010000:00010000:0.0:1651529344.423813:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c4fd7c lrc: 3/0,1 mode: --/PW res: [0x2b3fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423818:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000876c3b77/0x3234de053c4f422 lrc: 2/0,0 mode: PR/PR res: [0x2b3fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8372 expref: 1867 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.423821:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.423822:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.423823:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c4fd7c lrc: 4/0,1 mode: --/PW res: [0x2b3fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423829:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000876c3b77/0x3234de053c4f422 lrc: 3/0,0 mode: PR/PR res: [0x2b3fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8372 expref: 1867 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.423832:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000876c3b77/0x3234de053c4f422 lrc: 4/0,0 mode: PR/PR res: [0x2b3fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8372 expref: 1867 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.423836:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996951552:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.423850:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f9dd6aa3 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.423856:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4fd67 lrc: 2/0,0 mode: PW/PW res: [0x2b3f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423859:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000046d6c242 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.423860:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4fd67 lrc: 2/0,0 mode: PW/PW res: [0x2b3f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.423863:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996951488:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.423863:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4fd67 lrc: 3/0,0 mode: PW/PW res: [0x2b3f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.423867:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c4fd75 lrc: 3/0,1 mode: --/PW res: [0x2b3fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423867:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4fd67 lrc: 1/0,0 mode: --/PW res: [0x2b3f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423872:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4fd67 lrc: 0/0,0 mode: --/PW res: [0x2b3f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.423874:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396229312 00010000:00010000:1.0:1651529344.423879:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004a35aa4a/0x3234de053c4cb4f lrc: 4/0,0 mode: PR/PR res: [0x2b3fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdeac expref: 1868 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.423879:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4fd44 lrc: 3/0,1 mode: PW/PW res: [0x2b3f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.423890:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11481 00000100:00100000:1.0:1651529344.423892:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1868:41278:x1731746396229312:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.423895:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.423896:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004a35aa4a/0x3234de053c4cb4f lrc: 4/0,0 mode: PR/PR res: [0x2b3fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdeac expref: 1868 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.423903:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004a35aa4a/0x3234de053c4cb4f lrc: 3/0,0 mode: PR/PR res: [0x2b3fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdeac expref: 1868 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.423905:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4fd44 lrc: 3/0,1 mode: PW/PW res: [0x2b3f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.423908:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a35aa4a/0x3234de053c4cb4f lrc: 0/0,0 mode: --/PR res: [0x2b3fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdeac expref: 1868 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.423909:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4fd44 lrc: 3/0,1 mode: PW/PW res: [0x2b3f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.423912:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.423912:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.423912:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4fd44 lrc: 2/0,0 mode: PW/PW res: [0x2b3f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.423913:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c4fd75 lrc: 3/0,1 mode: PW/PW res: [0x2b3fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.423916:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c4fd75 lrc: 4/0,1 mode: PW/PW res: [0x2b3fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.423922:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.423929:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1867:41278:x1731746396229312:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 36us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.423931:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11481 00010000:00010000:1.0:1651529344.423937:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c4fd75 lrc: 3/0,1 mode: PW/PW res: [0x2b3fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.423940:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c4fd75 lrc: 3/0,1 mode: PW/PW res: [0x2b3fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.423943:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c4fd75 lrc: 3/0,1 mode: PW/PW res: [0x2b3fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.423948:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c4fd75 lrc: 2/0,0 mode: PW/PW res: [0x2b3fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.423952:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+195:39029:x1731745946347520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1314us (1395us total) trans 12885078752 rc 0/0 00000100:00100000:0.0:1651529344.423963:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210692 00010000:00010000:0.0:1651529344.423984:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4fd44 lrc: 2/0,0 mode: PW/PW res: [0x2b3f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423987:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000040cd657 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.423988:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4fd44 lrc: 2/0,0 mode: PW/PW res: [0x2b3f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.423991:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+195:39029:x1731745946348160:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 814us (922us total) trans 12885078753 rc 0/0 00010000:00010000:0.0:1651529344.423991:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4fd44 lrc: 3/0,0 mode: PW/PW res: [0x2b3f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.423994:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210699 00010000:00010000:0.0:1651529344.423996:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4fd44 lrc: 1/0,0 mode: --/PW res: [0x2b3f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.423999:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4fd44 lrc: 0/0,0 mode: --/PW res: [0x2b3f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424003:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c4fd75 lrc: 2/0,0 mode: PW/PW res: [0x2b3fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424005:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005b1ee779 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.424006:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c4fd75 lrc: 2/0,0 mode: PW/PW res: [0x2b3fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424009:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c4fd75 lrc: 3/0,0 mode: PW/PW res: [0x2b3fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424012:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c4fd75 lrc: 1/0,0 mode: --/PW res: [0x2b3fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424015:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c4fd75 lrc: 0/0,0 mode: --/PW res: [0x2b3fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424042:0:80280:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008fb69f9f/0x3234de053c4c965 lrc: 0/0,0 mode: --/PR res: [0x2b3f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd719 expref: 1866 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.424061:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996951232:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.424064:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.424065:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4fd59 lrc: 3/0,1 mode: PW/PW res: [0x2b3f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424068:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4fd59 lrc: 3/0,1 mode: PW/PW res: [0x2b3f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424071:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4fd59 lrc: 3/0,1 mode: PW/PW res: [0x2b3f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424074:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4fd59 lrc: 3/0,1 mode: PW/PW res: [0x2b3f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424077:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4fd59 lrc: 2/0,0 mode: PW/PW res: [0x2b3f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.424081:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.424091:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.424098:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.424105:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946348608 00000100:00100000:1.0:1651529344.424111:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946348672 00000100:00100000:1.0:1651529344.424114:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946348736 00000100:00100000:1.0:1651529344.424117:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946348800 00000100:00100000:1.0:1651529344.424124:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210701 00000100:00100000:1.0:1651529344.424125:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+199:39029:x1731745946348608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.424131:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177149 count 1 00010000:00010000:1.0:1651529344.424135:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c4fd83 lrc: 3/0,1 mode: --/PW res: [0x2b3fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.424140:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006878ab38/0x3234de053c4ed30 lrc: 2/0,0 mode: PR/PR res: [0x2b3fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6684 expref: 1865 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.424150:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.424150:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.424150:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+199:39029:x1731745946347712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1296us (1337us total) trans 12885078754 rc 0/0 00010000:00010000:1.0:1651529344.424151:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c4fd83 lrc: 4/0,1 mode: --/PW res: [0x2b3fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.424153:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210695 00010000:00010000:1.0:1651529344.424161:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006878ab38/0x3234de053c4ed30 lrc: 3/0,0 mode: PR/PR res: [0x2b3fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6684 expref: 1865 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.424164:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006878ab38/0x3234de053c4ed30 lrc: 4/0,0 mode: PR/PR res: [0x2b3fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6684 expref: 1865 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.424168:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000050bbb886 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996951616:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.424172:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210702 00000100:00100000:0.0:1651529344.424174:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+198:39030:x1731745946348672:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.424177:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a5495eb going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.424180:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177150 count 1 00000100:00100000:1.0:1651529344.424183:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210703 00010000:00010000:0.0:1651529344.424184:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c4fd8a lrc: 3/0,1 mode: --/PW res: [0x2b3fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.424185:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+198:39029:x1731745946348736:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.424188:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cca8aba1/0x3234de053c4c735 lrc: 2/0,0 mode: PR/PR res: [0x2b3fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf08 expref: 1865 pid: 72396 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.424189:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177151 count 1 00010000:00010000:1.0:1651529344.424193:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c4fd91 lrc: 3/0,1 mode: --/PW res: [0x2b3ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424194:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.424195:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.424195:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c4fd8a lrc: 4/0,1 mode: --/PW res: [0x2b3fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.424197:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f6711731/0x3234de053c4c800 lrc: 2/0,0 mode: PR/PR res: [0x2b3ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd242 expref: 1865 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.424201:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.424201:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.424202:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c4fd91 lrc: 4/0,1 mode: --/PW res: [0x2b3ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424202:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cca8aba1/0x3234de053c4c735 lrc: 3/0,0 mode: PR/PR res: [0x2b3fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf08 expref: 1865 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.424205:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cca8aba1/0x3234de053c4c735 lrc: 4/0,0 mode: PR/PR res: [0x2b3fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf08 expref: 1865 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.424208:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f6711731/0x3234de053c4c800 lrc: 3/0,0 mode: PR/PR res: [0x2b3ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd242 expref: 1865 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.424210:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996951680:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.424211:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f6711731/0x3234de053c4c800 lrc: 4/0,0 mode: PR/PR res: [0x2b3ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd242 expref: 1865 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.424215:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dfc79d4e pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996951744:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.424218:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a52ee82 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.424237:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000004698fefb going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.424242:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4fd59 lrc: 2/0,0 mode: PW/PW res: [0x2b3f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.424243:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210704 00000100:00100000:1.0:1651529344.424245:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+198:39030:x1731745946348800:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.424246:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000093dbd0d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.424247:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4fd59 lrc: 2/0,0 mode: PW/PW res: [0x2b3f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.424249:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177152 count 1 00010000:00010000:0.0:1651529344.424250:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4fd59 lrc: 3/0,0 mode: PW/PW res: [0x2b3f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.424253:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7f046d7/0x3234de053c4fd98 lrc: 3/0,1 mode: --/PW res: [0x2b400:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424254:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4fd59 lrc: 1/0,0 mode: --/PW res: [0x2b3f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.424257:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000b3a47ca/0x3234de053c4d734 lrc: 2/0,0 mode: PR/PR res: [0x2b400:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e71 expref: 1865 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.424259:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4fd59 lrc: 0/0,0 mode: --/PW res: [0x2b3f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.424260:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.424261:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.424262:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7f046d7/0x3234de053c4fd98 lrc: 4/0,1 mode: --/PW res: [0x2b400:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.424267:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000b3a47ca/0x3234de053c4d734 lrc: 3/0,0 mode: PR/PR res: [0x2b400:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e71 expref: 1865 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.424270:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000b3a47ca/0x3234de053c4d734 lrc: 4/0,0 mode: PR/PR res: [0x2b400:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e71 expref: 1865 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.424274:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005914c920 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996951808:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.424281:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c3caa148 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.424306:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996951552:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.424310:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c4fd7c lrc: 3/0,1 mode: --/PW res: [0x2b3fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.424329:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.424352:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.424364:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396229376 00010000:00010000:0.0:1651529344.424369:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000876c3b77/0x3234de053c4f422 lrc: 4/0,0 mode: PR/PR res: [0x2b3fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8372 expref: 1866 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.424374:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.424377:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11482 00000100:00100000:0.0:1651529344.424378:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ea32140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1866:41278:x1731746396229376:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.424381:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.424382:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000876c3b77/0x3234de053c4f422 lrc: 4/0,0 mode: PR/PR res: [0x2b3fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8372 expref: 1866 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.424386:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000876c3b77/0x3234de053c4f422 lrc: 3/0,0 mode: PR/PR res: [0x2b3fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8372 expref: 1866 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.424391:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000876c3b77/0x3234de053c4f422 lrc: 0/0,0 mode: --/PR res: [0x2b3fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8372 expref: 1866 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.424394:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.424395:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.424396:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c4fd7c lrc: 3/0,1 mode: PW/PW res: [0x2b3fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424399:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c4fd7c lrc: 4/0,1 mode: PW/PW res: [0x2b3fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.424402:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946348928 00010000:00010000:0.0:1651529344.424405:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.424409:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946348864 00000100:00100000:1.0:1651529344.424420:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210705 00000100:00100000:0.0:1651529344.424420:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ea32140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1865:41278:x1731746396229376:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 41us (68us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.424422:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007fca8239 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+200:39030:x1731745946348928:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.424423:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11482 00002000:00080000:1.0:1651529344.424427:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177154 count 1 00010000:00010000:0.0:1651529344.424429:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c4fd7c lrc: 3/0,1 mode: PW/PW res: [0x2b3fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.424432:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eebe983a/0x3234de053c4fd9f lrc: 3/0,1 mode: --/PW res: [0x2b402:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424432:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c4fd7c lrc: 3/0,1 mode: PW/PW res: [0x2b3fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424435:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c4fd7c lrc: 3/0,1 mode: PW/PW res: [0x2b3fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.424436:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c1634cb6/0x3234de053c4e121 lrc: 2/0,0 mode: PR/PR res: [0x2b402:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3514 expref: 1864 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.424439:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.424440:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.424440:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eebe983a/0x3234de053c4fd9f lrc: 4/0,1 mode: --/PW res: [0x2b402:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.424447:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c1634cb6/0x3234de053c4e121 lrc: 3/0,0 mode: PR/PR res: [0x2b402:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3514 expref: 1864 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.424450:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c1634cb6/0x3234de053c4e121 lrc: 4/0,0 mode: PR/PR res: [0x2b402:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3514 expref: 1864 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.424454:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b0d9532a pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996951872:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.424456:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c4fd7c lrc: 2/0,0 mode: PW/PW res: [0x2b3fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.424463:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 0000000089d75f07 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.424469:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210706 00000100:00100000:1.0:1651529344.424471:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+200:39029:x1731745946348864:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.424475:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177153 count 1 00010000:00010000:1.0:1651529344.424478:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070dd06bd/0x3234de053c4fda6 lrc: 3/0,1 mode: --/PW res: [0x2b401:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.424482:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000674569e9/0x3234de053c4e7b1 lrc: 2/0,0 mode: PR/PR res: [0x2b401:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f54 expref: 1864 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.424485:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.424486:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.424487:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070dd06bd/0x3234de053c4fda6 lrc: 4/0,1 mode: --/PW res: [0x2b401:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.424492:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000674569e9/0x3234de053c4e7b1 lrc: 3/0,0 mode: PR/PR res: [0x2b401:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f54 expref: 1864 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.424495:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000674569e9/0x3234de053c4e7b1 lrc: 4/0,0 mode: PR/PR res: [0x2b401:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f54 expref: 1864 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.424496:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+201:39030:x1731745946348416:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 691us (742us total) trans 12885078755 rc 0/0 00000100:00100000:1.0:1651529344.424499:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000edfe60d3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996951936:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.424499:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210700 00000100:00100000:1.0:1651529344.424504:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000567ee0ef going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.424507:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c4fd7c lrc: 2/0,0 mode: PW/PW res: [0x2b3fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424510:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c8d9712a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.424511:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c4fd7c lrc: 2/0,0 mode: PW/PW res: [0x2b3fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424514:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c4fd7c lrc: 3/0,0 mode: PW/PW res: [0x2b3fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.424517:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.424519:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c4fd7c lrc: 1/0,0 mode: --/PW res: [0x2b3fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424521:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c4fd7c lrc: 0/0,0 mode: --/PW res: [0x2b3fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.424529:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946348992 00000100:00100000:0.0:1651529344.424535:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210707 00000100:00100000:0.0:1651529344.424537:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085af61db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+201:39029:x1731745946348992:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.424542:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177155 count 1 00010000:00010000:0.0:1651529344.424546:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c4fdad lrc: 3/0,1 mode: --/PW res: [0x2b403:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424550:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c4cc1a lrc: 2/0,0 mode: PR/PR res: [0x2b403:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce241 expref: 1864 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.424553:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.424554:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.424554:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c4fdad lrc: 4/0,1 mode: --/PW res: [0x2b403:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424561:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c4cc1a lrc: 3/0,0 mode: PR/PR res: [0x2b403:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce241 expref: 1864 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.424566:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c4cc1a lrc: 4/0,0 mode: PR/PR res: [0x2b403:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce241 expref: 1864 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.424570:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996952000:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.424616:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f9dd6aa3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.424656:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.424669:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000050bbb886 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996951616:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.424677:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996951680:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.424678:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c4fd83 lrc: 3/0,1 mode: --/PW res: [0x2b3fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424681:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c4fd8a lrc: 3/0,1 mode: --/PW res: [0x2b3fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.424700:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946349312 00000100:00100000:0.0:1651529344.424711:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210708 00000100:00100000:1.0:1651529344.424728:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dfc79d4e pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996951744:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.424728:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+202:39030:x1731745946349312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.424733:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c4fd91 lrc: 3/0,1 mode: --/PW res: [0x2b3ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.424733:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177156 count 1 00010000:00010000:0.0:1651529344.424744:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c4fdb4 lrc: 3/0,1 mode: --/PW res: [0x2b404:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424748:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c4ecff lrc: 2/0,0 mode: PR/PR res: [0x2b404:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d65ea expref: 1864 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.424749:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005914c920 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996951808:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.424751:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.424752:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f7f046d7/0x3234de053c4fd98 lrc: 3/0,1 mode: --/PW res: [0x2b400:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424752:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.424753:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c4fdb4 lrc: 4/0,1 mode: --/PW res: [0x2b404:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.424759:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c4ecff lrc: 3/0,0 mode: PR/PR res: [0x2b404:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d65ea expref: 1864 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.424763:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c4ecff lrc: 4/0,0 mode: PR/PR res: [0x2b404:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d65ea expref: 1864 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.424767:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996952064:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.424769:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b0d9532a pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996951872:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.424772:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eebe983a/0x3234de053c4fd9f lrc: 3/0,1 mode: --/PW res: [0x2b402:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.424780:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000064b9c5f3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.425040:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.425049:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.425057:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.425062:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996952000:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.425064:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.425071:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.425072:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c4fdad lrc: 3/0,1 mode: --/PW res: [0x2b403:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.425076:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.425080:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396229568 00000100:00100000:1.0:1651529344.425081:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.425085:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006878ab38/0x3234de053c4ed30 lrc: 4/0,0 mode: PR/PR res: [0x2b3fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6684 expref: 1865 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.425095:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396229696 00000100:00100000:1.0:1651529344.425096:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000edfe60d3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996951936:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.425098:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cca8aba1/0x3234de053c4c735 lrc: 4/0,0 mode: PR/PR res: [0x2b3fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf08 expref: 1866 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.425100:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000070dd06bd/0x3234de053c4fda6 lrc: 3/0,1 mode: --/PW res: [0x2b401:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.425107:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396229824 00010000:00010000:1.0:1651529344.425112:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f6711731/0x3234de053c4c800 lrc: 4/0,0 mode: PR/PR res: [0x2b3ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd242 expref: 1867 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.425120:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396229952 00010000:00010000:0.0:1651529344.425123:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c1634cb6/0x3234de053c4e121 lrc: 4/0,0 mode: PR/PR res: [0x2b402:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3514 expref: 1868 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.425127:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396229888 00000100:00100000:0.0:1651529344.425128:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396230080 00010000:00010000:1.0:1651529344.425130:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000b3a47ca/0x3234de053c4d734 lrc: 4/0,0 mode: PR/PR res: [0x2b400:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e71 expref: 1870 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.425130:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c4cc1a lrc: 4/0,0 mode: PR/PR res: [0x2b403:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce241 expref: 1870 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.425134:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396230016 00010000:00010000:1.0:1651529344.425137:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000674569e9/0x3234de053c4e7b1 lrc: 4/0,0 mode: PR/PR res: [0x2b401:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f54 expref: 1871 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.425138:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11483 00000100:00100000:0.0:1651529344.425140:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000011803d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1871:41278:x1731746396229568:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.425142:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11484 00000100:00100000:1.0:1651529344.425143:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1871:41278:x1731746396229696:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.425143:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.425144:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006878ab38/0x3234de053c4ed30 lrc: 4/0,0 mode: PR/PR res: [0x2b3fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6684 expref: 1871 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.425146:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.425147:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006878ab38/0x3234de053c4ed30 lrc: 3/0,0 mode: PR/PR res: [0x2b3fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6684 expref: 1871 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.425148:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cca8aba1/0x3234de053c4c735 lrc: 4/0,0 mode: PR/PR res: [0x2b3fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf08 expref: 1871 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.425151:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cca8aba1/0x3234de053c4c735 lrc: 3/0,0 mode: PR/PR res: [0x2b3fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf08 expref: 1871 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.425153:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006878ab38/0x3234de053c4ed30 lrc: 0/0,0 mode: --/PR res: [0x2b3fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6684 expref: 1871 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.425157:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cca8aba1/0x3234de053c4c735 lrc: 0/0,0 mode: --/PR res: [0x2b3fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf08 expref: 1870 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.425157:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.425157:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.425158:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c4fd83 lrc: 3/0,1 mode: PW/PW res: [0x2b3fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425161:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.425161:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.425161:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c4fd83 lrc: 4/0,1 mode: PW/PW res: [0x2b3fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425162:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c4fd8a lrc: 3/0,1 mode: PW/PW res: [0x2b3fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425165:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c4fd8a lrc: 4/0,1 mode: PW/PW res: [0x2b3fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425170:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.425183:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.425187:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000011803d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1869:41278:x1731746396229568:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 47us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.425190:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11483 00000100:00100000:1.0:1651529344.425191:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1869:41278:x1731746396229696:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 47us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.425194:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11484 00000100:00100000:1.0:1651529344.425200:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11485 00000100:00100000:1.0:1651529344.425201:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1867:41278:x1731746396229824:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.425202:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11486 00010000:00010000:1.0:1651529344.425204:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.425204:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1867:41278:x1731746396229952:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.425205:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f6711731/0x3234de053c4c800 lrc: 4/0,0 mode: PR/PR res: [0x2b3ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd242 expref: 1867 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.425206:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.425208:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c1634cb6/0x3234de053c4e121 lrc: 4/0,0 mode: PR/PR res: [0x2b402:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3514 expref: 1867 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.425209:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f6711731/0x3234de053c4c800 lrc: 3/0,0 mode: PR/PR res: [0x2b3ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd242 expref: 1867 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.425212:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c1634cb6/0x3234de053c4e121 lrc: 3/0,0 mode: PR/PR res: [0x2b402:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3514 expref: 1867 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.425214:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6711731/0x3234de053c4c800 lrc: 0/0,0 mode: --/PR res: [0x2b3ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd242 expref: 1867 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.425217:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1634cb6/0x3234de053c4e121 lrc: 0/0,0 mode: --/PR res: [0x2b402:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3514 expref: 1867 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.425218:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.425218:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.425219:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c4fd91 lrc: 3/0,1 mode: PW/PW res: [0x2b3ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425220:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.425221:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.425238:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c4fd91 lrc: 4/0,1 mode: PW/PW res: [0x2b3ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425242:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eebe983a/0x3234de053c4fd9f lrc: 3/0,1 mode: PW/PW res: [0x2b402:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425245:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.425246:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eebe983a/0x3234de053c4fd9f lrc: 4/0,1 mode: PW/PW res: [0x2b402:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.425251:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1865:41278:x1731746396229824:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 49us (193us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.425254:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.425259:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11485 00000100:00100000:0.0:1651529344.425261:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1865:41278:x1731746396229952:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 57us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.425263:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11486 00000100:00100000:1.0:1651529344.425265:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11487 00000100:00100000:1.0:1651529344.425267:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1863:41279:x1731746396229888:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.425269:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.425269:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11488 00000100:00100000:0.0:1651529344.425270:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1863:41278:x1731746396230080:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.425271:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000b3a47ca/0x3234de053c4d734 lrc: 4/0,0 mode: PR/PR res: [0x2b400:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e71 expref: 1863 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.425273:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.425275:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000b3a47ca/0x3234de053c4d734 lrc: 3/0,0 mode: PR/PR res: [0x2b400:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e71 expref: 1863 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.425275:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c4cc1a lrc: 4/0,0 mode: PR/PR res: [0x2b403:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce241 expref: 1863 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.425278:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c4cc1a lrc: 3/0,0 mode: PR/PR res: [0x2b403:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce241 expref: 1863 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.425279:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b3a47ca/0x3234de053c4d734 lrc: 0/0,0 mode: --/PR res: [0x2b400:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e71 expref: 1863 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.425283:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.425283:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c4cc1a lrc: 0/0,0 mode: --/PR res: [0x2b403:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce241 expref: 1862 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.425284:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.425284:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f7f046d7/0x3234de053c4fd98 lrc: 3/0,1 mode: PW/PW res: [0x2b400:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425286:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.425287:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7f046d7/0x3234de053c4fd98 lrc: 4/0,1 mode: PW/PW res: [0x2b400:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425287:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.425288:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c4fdad lrc: 3/0,1 mode: PW/PW res: [0x2b403:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425291:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c4fdad lrc: 4/0,1 mode: PW/PW res: [0x2b403:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425293:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.425297:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.425299:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1861:41279:x1731746396229888:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 31us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.425301:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11487 00000100:00100000:0.0:1651529344.425302:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1861:41278:x1731746396230080:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 31us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.425304:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11488 00000100:00100000:1.0:1651529344.425306:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11489 00000100:00100000:1.0:1651529344.425307:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1859:41279:x1731746396230016:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.425309:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.425311:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000674569e9/0x3234de053c4e7b1 lrc: 4/0,0 mode: PR/PR res: [0x2b401:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f54 expref: 1859 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.425313:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996952064:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.425314:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000674569e9/0x3234de053c4e7b1 lrc: 3/0,0 mode: PR/PR res: [0x2b401:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f54 expref: 1859 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.425316:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c4fdb4 lrc: 3/0,1 mode: --/PW res: [0x2b404:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425319:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000674569e9/0x3234de053c4e7b1 lrc: 0/0,0 mode: --/PR res: [0x2b401:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f54 expref: 1859 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.425322:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.425323:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.425323:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000070dd06bd/0x3234de053c4fda6 lrc: 3/0,1 mode: PW/PW res: [0x2b401:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425323:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c4fdad lrc: 3/0,1 mode: PW/PW res: [0x2b403:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425326:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070dd06bd/0x3234de053c4fda6 lrc: 4/0,1 mode: PW/PW res: [0x2b401:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425326:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c4fdad lrc: 3/0,1 mode: PW/PW res: [0x2b403:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425330:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c4fdad lrc: 3/0,1 mode: PW/PW res: [0x2b403:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425331:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.425333:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c4fdad lrc: 2/0,0 mode: PW/PW res: [0x2b403:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.425336:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1858:41279:x1731746396230016:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 28us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.425338:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11489 00010000:00010000:1.0:1651529344.425343:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c4fd91 lrc: 3/0,1 mode: PW/PW res: [0x2b3ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425347:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c4fd91 lrc: 3/0,1 mode: PW/PW res: [0x2b3ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425352:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c4fd91 lrc: 3/0,1 mode: PW/PW res: [0x2b3ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425355:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c4fd91 lrc: 2/0,0 mode: PW/PW res: [0x2b3ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.425382:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085af61db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+204:39029:x1731745946348992:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 844us (864us total) trans 12885078756 rc 0/0 00000100:00100000:0.0:1651529344.425385:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210707 00010000:00010000:0.0:1651529344.425392:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c4fdad lrc: 2/0,0 mode: PW/PW res: [0x2b403:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425395:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bfb594be already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.425396:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c4fdad lrc: 2/0,0 mode: PW/PW res: [0x2b403:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425399:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c4fdad lrc: 3/0,0 mode: PW/PW res: [0x2b403:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.425401:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+203:39029:x1731745946348736:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1215us (1309us total) trans 12885078757 rc 0/0 00010000:00010000:0.0:1651529344.425403:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c4fdad lrc: 1/0,0 mode: --/PW res: [0x2b403:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.425404:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210703 00010000:00010000:0.0:1651529344.425406:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c4fdad lrc: 0/0,0 mode: --/PW res: [0x2b403:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425410:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c4fd91 lrc: 2/0,0 mode: PW/PW res: [0x2b3ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425411:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f7f046d7/0x3234de053c4fd98 lrc: 3/0,1 mode: PW/PW res: [0x2b400:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425414:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7f046d7/0x3234de053c4fd98 lrc: 3/0,1 mode: PW/PW res: [0x2b400:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425414:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b9e4c5a0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.425414:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c4fd91 lrc: 2/0,0 mode: PW/PW res: [0x2b3ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425417:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7f046d7/0x3234de053c4fd98 lrc: 3/0,1 mode: PW/PW res: [0x2b400:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425417:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c4fd91 lrc: 3/0,0 mode: PW/PW res: [0x2b3ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425420:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7f046d7/0x3234de053c4fd98 lrc: 2/0,0 mode: PW/PW res: [0x2b400:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425420:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c4fd91 lrc: 1/0,0 mode: --/PW res: [0x2b3ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425423:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c4fd91 lrc: 0/0,0 mode: --/PW res: [0x2b3ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425433:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7f046d7/0x3234de053c4fd98 lrc: 2/0,0 mode: PW/PW res: [0x2b400:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425436:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f7f046d7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.425436:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7f046d7/0x3234de053c4fd98 lrc: 2/0,0 mode: PW/PW res: [0x2b400:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425439:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7f046d7/0x3234de053c4fd98 lrc: 3/0,0 mode: PW/PW res: [0x2b400:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425442:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7f046d7/0x3234de053c4fd98 lrc: 1/0,0 mode: --/PW res: [0x2b400:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425445:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7f046d7/0x3234de053c4fd98 lrc: 0/0,0 mode: --/PW res: [0x2b400:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425452:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c4fd8a lrc: 3/0,1 mode: PW/PW res: [0x2b3fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425455:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c4fd8a lrc: 3/0,1 mode: PW/PW res: [0x2b3fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.425456:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+203:39030:x1731745946348800:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1211us (1358us total) trans 12885078758 rc 0/0 00010000:00010000:0.0:1651529344.425458:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c4fd8a lrc: 3/0,1 mode: PW/PW res: [0x2b3fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.425459:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210704 00010000:00010000:0.0:1651529344.425461:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c4fd8a lrc: 2/0,0 mode: PW/PW res: [0x2b3fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425465:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000070dd06bd/0x3234de053c4fda6 lrc: 3/0,1 mode: PW/PW res: [0x2b401:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425471:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070dd06bd/0x3234de053c4fda6 lrc: 3/0,1 mode: PW/PW res: [0x2b401:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425474:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070dd06bd/0x3234de053c4fda6 lrc: 3/0,1 mode: PW/PW res: [0x2b401:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425476:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070dd06bd/0x3234de053c4fda6 lrc: 2/0,0 mode: PW/PW res: [0x2b401:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.425505:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+204:39030:x1731745946348672:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1330us (1424us total) trans 12885078759 rc 0/0 00000100:00100000:0.0:1651529344.425508:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210702 00000100:00100000:1.0:1651529344.425514:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+203:39029:x1731745946348864:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1042us (1140us total) trans 12885078760 rc 0/0 00010000:00010000:0.0:1651529344.425515:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c4fd8a lrc: 2/0,0 mode: PW/PW res: [0x2b3fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.425517:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210706 00010000:00010000:0.0:1651529344.425518:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b2d06199 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.425519:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c4fd8a lrc: 2/0,0 mode: PW/PW res: [0x2b3fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425522:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c4fd8a lrc: 3/0,0 mode: PW/PW res: [0x2b3fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425524:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eebe983a/0x3234de053c4fd9f lrc: 3/0,1 mode: PW/PW res: [0x2b402:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425526:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c4fd8a lrc: 1/0,0 mode: --/PW res: [0x2b3fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425527:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eebe983a/0x3234de053c4fd9f lrc: 3/0,1 mode: PW/PW res: [0x2b402:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425529:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c4fd8a lrc: 0/0,0 mode: --/PW res: [0x2b3fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425530:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eebe983a/0x3234de053c4fd9f lrc: 3/0,1 mode: PW/PW res: [0x2b402:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425533:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eebe983a/0x3234de053c4fd9f lrc: 2/0,0 mode: PW/PW res: [0x2b402:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425533:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070dd06bd/0x3234de053c4fda6 lrc: 2/0,0 mode: PW/PW res: [0x2b401:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425535:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000070dd06bd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.425536:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070dd06bd/0x3234de053c4fda6 lrc: 2/0,0 mode: PW/PW res: [0x2b401:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425545:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070dd06bd/0x3234de053c4fda6 lrc: 3/0,0 mode: PW/PW res: [0x2b401:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425549:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070dd06bd/0x3234de053c4fda6 lrc: 1/0,0 mode: --/PW res: [0x2b401:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425552:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070dd06bd/0x3234de053c4fda6 lrc: 0/0,0 mode: --/PW res: [0x2b401:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425555:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eebe983a/0x3234de053c4fd9f lrc: 2/0,0 mode: PW/PW res: [0x2b402:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425558:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eebe983a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.425559:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eebe983a/0x3234de053c4fd9f lrc: 2/0,0 mode: PW/PW res: [0x2b402:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425564:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eebe983a/0x3234de053c4fd9f lrc: 3/0,0 mode: PW/PW res: [0x2b402:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425567:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eebe983a/0x3234de053c4fd9f lrc: 1/0,0 mode: --/PW res: [0x2b402:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.425568:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007fca8239 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+203:39030:x1731745946348928:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1145us (1239us total) trans 12885078761 rc 0/0 00010000:00010000:0.0:1651529344.425570:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eebe983a/0x3234de053c4fd9f lrc: 0/0,0 mode: --/PW res: [0x2b402:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.425572:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210705 00010000:00010000:1.0:1651529344.425578:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c4fd83 lrc: 3/0,1 mode: PW/PW res: [0x2b3fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425582:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c4fd83 lrc: 3/0,1 mode: PW/PW res: [0x2b3fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425585:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c4fd83 lrc: 3/0,1 mode: PW/PW res: [0x2b3fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425587:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c4fd83 lrc: 2/0,0 mode: PW/PW res: [0x2b3fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425597:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c4fd83 lrc: 2/0,0 mode: PW/PW res: [0x2b3fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425600:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003266b888 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.425601:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c4fd83 lrc: 2/0,0 mode: PW/PW res: [0x2b3fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425604:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c4fd83 lrc: 3/0,0 mode: PW/PW res: [0x2b3fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425607:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c4fd83 lrc: 1/0,0 mode: --/PW res: [0x2b3fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425610:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c4fd83 lrc: 0/0,0 mode: --/PW res: [0x2b3fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.425625:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+203:39029:x1731745946348608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1499us (1561us total) trans 12885078762 rc 0/0 00000100:00100000:1.0:1651529344.425628:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210701 00000100:00100000:1.0:1651529344.425654:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.425819:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396230144 00010000:00010000:1.0:1651529344.425825:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c4ecff lrc: 4/0,0 mode: PR/PR res: [0x2b404:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d65ea expref: 1858 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.425837:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11490 00000100:00100000:1.0:1651529344.425839:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e75f071f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1858:41279:x1731746396230144:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.425842:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.425843:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c4ecff lrc: 4/0,0 mode: PR/PR res: [0x2b404:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d65ea expref: 1858 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.425849:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c4ecff lrc: 3/0,0 mode: PR/PR res: [0x2b404:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d65ea expref: 1858 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.425855:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c4ecff lrc: 0/0,0 mode: --/PR res: [0x2b404:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d65ea expref: 1858 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.425858:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.425859:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.425860:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c4fdb4 lrc: 3/0,1 mode: PW/PW res: [0x2b404:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425863:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c4fdb4 lrc: 4/0,1 mode: PW/PW res: [0x2b404:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.425871:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.425877:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c4fdb4 lrc: 3/0,1 mode: PW/PW res: [0x2b404:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.425880:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e75f071f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1857:41279:x1731746396230144:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.425883:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11490 00010000:00010000:0.0:1651529344.425884:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c4fdb4 lrc: 3/0,1 mode: PW/PW res: [0x2b404:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425887:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c4fdb4 lrc: 3/0,1 mode: PW/PW res: [0x2b404:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.425890:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c4fdb4 lrc: 2/0,0 mode: PW/PW res: [0x2b404:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.425939:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.425947:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.425960:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+203:39030:x1731745946349312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1231us (1303us total) trans 12885078763 rc 0/0 00000100:00100000:0.0:1651529344.425963:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210708 00000100:00100000:0.0:1651529344.425969:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946349632 00000100:00100000:0.0:1651529344.425977:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946349760 00000100:00100000:0.0:1651529344.425983:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210709 00000100:00100000:0.0:1651529344.425984:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+204:39029:x1731745946349632:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.425990:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177157 count 1 00000100:00100000:1.0:1651529344.425991:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.425994:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c4fdbb lrc: 3/0,1 mode: --/PW res: [0x2b405:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.425999:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.425999:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000060da8203/0x3234de053c4ccd0 lrc: 2/0,0 mode: PR/PR res: [0x2b405:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce527 expref: 1856 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.426002:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.426003:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.426003:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c4fdbb lrc: 4/0,1 mode: --/PW res: [0x2b405:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.426005:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946349696 00010000:00010000:0.0:1651529344.426011:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000060da8203/0x3234de053c4ccd0 lrc: 3/0,0 mode: PR/PR res: [0x2b405:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce527 expref: 1856 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.426015:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946349824 00000100:00100000:1.0:1651529344.426020:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210710 00000100:00100000:1.0:1651529344.426022:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+206:39029:x1731745946349760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.426022:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000060da8203/0x3234de053c4ccd0 lrc: 4/0,0 mode: PR/PR res: [0x2b405:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce527 expref: 1856 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.426026:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996952128:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.426029:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177159 count 1 00010000:00010000:1.0:1651529344.426034:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c4fdc2 lrc: 3/0,1 mode: --/PW res: [0x2b407:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.426038:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b1cdb9b9/0x3234de053c4b92e lrc: 2/0,0 mode: PR/PR res: [0x2b407:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc43b expref: 1856 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.426041:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.426042:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.426043:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c4fdc2 lrc: 4/0,1 mode: --/PW res: [0x2b407:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.426049:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b1cdb9b9/0x3234de053c4b92e lrc: 3/0,0 mode: PR/PR res: [0x2b407:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc43b expref: 1856 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.426053:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b1cdb9b9/0x3234de053c4b92e lrc: 4/0,0 mode: PR/PR res: [0x2b407:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc43b expref: 1856 pid: 151609 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.426064:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000064b9c5f3 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.426070:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c4fdb4 lrc: 2/0,0 mode: PW/PW res: [0x2b404:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.426071:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006731397d pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996952192:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.426073:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6eb3f34 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.426074:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c4fdb4 lrc: 2/0,0 mode: PW/PW res: [0x2b404:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426077:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c4fdb4 lrc: 3/0,0 mode: PW/PW res: [0x2b404:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.426081:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e5f43e7 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.426082:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c4fdb4 lrc: 1/0,0 mode: --/PW res: [0x2b404:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426085:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c4fdb4 lrc: 0/0,0 mode: --/PW res: [0x2b404:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.426087:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210711 00000100:00100000:1.0:1651529344.426089:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+206:39029:x1731745946349696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.426093:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177158 count 1 00000100:00100000:0.0:1651529344.426093:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210712 00000100:00100000:0.0:1651529344.426095:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+206:39029:x1731745946349824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.426097:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c4fdc9 lrc: 3/0,1 mode: --/PW res: [0x2b406:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.426100:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177160 count 1 00010000:00010000:1.0:1651529344.426102:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c4d2bf lrc: 2/0,0 mode: PR/PR res: [0x2b406:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfcf8 expref: 1856 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.426104:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c4fdd0 lrc: 3/0,1 mode: --/PW res: [0x2b408:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.426105:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.426106:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.426106:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c4fdc9 lrc: 4/0,1 mode: --/PW res: [0x2b406:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426108:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000128edb5c/0x3234de053c4b22e lrc: 2/0,0 mode: PR/PR res: [0x2b408:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc10f expref: 1856 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.426111:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.426112:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c4d2bf lrc: 3/0,0 mode: PR/PR res: [0x2b406:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfcf8 expref: 1856 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.426112:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.426112:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c4fdd0 lrc: 4/0,1 mode: --/PW res: [0x2b408:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.426115:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c4d2bf lrc: 4/0,0 mode: PR/PR res: [0x2b406:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfcf8 expref: 1856 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.426119:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000054e3a257 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996952256:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.426119:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000128edb5c/0x3234de053c4b22e lrc: 3/0,0 mode: PR/PR res: [0x2b408:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc10f expref: 1856 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.426122:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000128edb5c/0x3234de053c4b22e lrc: 4/0,0 mode: PR/PR res: [0x2b408:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc10f expref: 1856 pid: 106695 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.426125:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b52d0f36 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.426126:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996952320:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.426134:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 0000000094c2f645 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.426140:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.426158:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.426165:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946349952 00000100:00100000:1.0:1651529344.426168:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.426176:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946349888 00000100:00100000:0.0:1651529344.426182:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946350016 00000100:00100000:0.0:1651529344.426187:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210713 00000100:00100000:1.0:1651529344.426189:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.426189:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+209:39030:x1731745946349952:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.426199:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177162 count 1 00010000:00010000:0.0:1651529344.426203:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c4fdd7 lrc: 3/0,1 mode: --/PW res: [0x2b40a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426208:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ed1d2805/0x3234de053c4de9d lrc: 2/0,0 mode: PR/PR res: [0x2b40a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b27 expref: 1856 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.426211:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.426212:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.426212:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c4fdd7 lrc: 4/0,1 mode: --/PW res: [0x2b40a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426219:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ed1d2805/0x3234de053c4de9d lrc: 3/0,0 mode: PR/PR res: [0x2b40a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b27 expref: 1856 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.426235:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946350080 00010000:00010000:0.0:1651529344.426240:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ed1d2805/0x3234de053c4de9d lrc: 4/0,0 mode: PR/PR res: [0x2b40a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b27 expref: 1856 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.426245:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210714 00000100:00100000:1.0:1651529344.426247:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+210:39030:x1731745946349888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.426249:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996952384:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.426252:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177161 count 1 00010000:00010000:1.0:1651529344.426256:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c4fdde lrc: 3/0,1 mode: --/PW res: [0x2b409:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.426262:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ff7757ae going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.426266:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001b6258e0/0x3234de053c4e7d4 lrc: 2/0,0 mode: PR/PR res: [0x2b409:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4fd2 expref: 1856 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.426272:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.426272:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.426273:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c4fdde lrc: 4/0,1 mode: --/PW res: [0x2b409:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.426280:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001b6258e0/0x3234de053c4e7d4 lrc: 3/0,0 mode: PR/PR res: [0x2b409:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4fd2 expref: 1856 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.426283:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001b6258e0/0x3234de053c4e7d4 lrc: 4/0,0 mode: PR/PR res: [0x2b409:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4fd2 expref: 1856 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.426286:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210715 00000100:00100000:1.0:1651529344.426287:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dfc79d4e pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996952448:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.426288:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ea32140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+210:39029:x1731745946350016:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.426293:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177163 count 1 00000100:00100000:1.0:1651529344.426296:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c3caa148 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.426297:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4fde5 lrc: 3/0,1 mode: --/PW res: [0x2b40b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426301:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009698444d/0x3234de053c4d4c5 lrc: 2/0,0 mode: PR/PR res: [0x2b40b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d052c expref: 1856 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.426302:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210716 00000100:00100000:1.0:1651529344.426304:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005914c920 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+210:39030:x1731745946350080:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.426304:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.426305:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.426306:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4fde5 lrc: 4/0,1 mode: --/PW res: [0x2b40b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.426309:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177164 count 1 00010000:00010000:1.0:1651529344.426312:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c4fdec lrc: 3/0,1 mode: --/PW res: [0x2b40c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426312:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009698444d/0x3234de053c4d4c5 lrc: 3/0,0 mode: PR/PR res: [0x2b40b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d052c expref: 1856 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.426316:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000edd2ccd0/0x3234de053c4ce12 lrc: 2/0,0 mode: PR/PR res: [0x2b40c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce9aa expref: 1856 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.426316:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009698444d/0x3234de053c4d4c5 lrc: 4/0,0 mode: PR/PR res: [0x2b40b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d052c expref: 1856 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.426319:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.426320:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.426320:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c4fdec lrc: 4/0,1 mode: --/PW res: [0x2b40c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.426320:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996952512:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.426328:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000edd2ccd0/0x3234de053c4ce12 lrc: 3/0,0 mode: PR/PR res: [0x2b40c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce9aa expref: 1856 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.426328:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c29d18ba going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.426332:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000edd2ccd0/0x3234de053c4ce12 lrc: 4/0,0 mode: PR/PR res: [0x2b40c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce9aa expref: 1856 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.426336:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a9b051f pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996952576:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.426342:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 0000000089d75f07 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.426425:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006731397d pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996952192:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.426433:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996952128:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.426435:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c4fdc2 lrc: 3/0,1 mode: --/PW res: [0x2b407:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426438:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c4fdbb lrc: 3/0,1 mode: --/PW res: [0x2b405:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.426443:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000054e3a257 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996952256:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.426445:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c4fdc9 lrc: 3/0,1 mode: --/PW res: [0x2b406:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.426475:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996952320:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.426478:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c4fdd0 lrc: 3/0,1 mode: --/PW res: [0x2b408:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.426606:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.426614:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.426623:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.426632:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.426641:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396230784 00000100:00100000:0.0:1651529344.426646:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396230720 00010000:00010000:1.0:1651529344.426651:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b1cdb9b9/0x3234de053c4b92e lrc: 4/0,0 mode: PR/PR res: [0x2b407:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc43b expref: 1858 pid: 151609 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.426652:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000060da8203/0x3234de053c4ccd0 lrc: 4/0,0 mode: PR/PR res: [0x2b405:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce527 expref: 1858 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.426657:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396230912 00000100:00100000:0.0:1651529344.426658:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396230848 00010000:00010000:1.0:1651529344.426660:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000128edb5c/0x3234de053c4b22e lrc: 4/0,0 mode: PR/PR res: [0x2b408:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc10f expref: 1860 pid: 106695 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.426661:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c4d2bf lrc: 4/0,0 mode: PR/PR res: [0x2b406:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfcf8 expref: 1860 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.426665:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11491 00000100:00100000:1.0:1651529344.426667:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1860:41279:x1731746396230784:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.426668:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11492 00010000:00010000:1.0:1651529344.426670:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.426670:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1860:41278:x1731746396230720:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.426671:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b1cdb9b9/0x3234de053c4b92e lrc: 4/0,0 mode: PR/PR res: [0x2b407:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc43b expref: 1860 pid: 151609 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.426673:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.426675:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b1cdb9b9/0x3234de053c4b92e lrc: 3/0,0 mode: PR/PR res: [0x2b407:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc43b expref: 1860 pid: 151609 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.426680:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1cdb9b9/0x3234de053c4b92e lrc: 0/0,0 mode: --/PR res: [0x2b407:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc43b expref: 1860 pid: 151609 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.426684:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.426684:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.426684:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000060da8203/0x3234de053c4ccd0 lrc: 4/0,0 mode: PR/PR res: [0x2b405:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce527 expref: 1859 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.426685:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c4fdc2 lrc: 3/0,1 mode: PW/PW res: [0x2b407:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426688:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000060da8203/0x3234de053c4ccd0 lrc: 3/0,0 mode: PR/PR res: [0x2b405:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce527 expref: 1859 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.426689:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c4fdc2 lrc: 4/0,1 mode: PW/PW res: [0x2b407:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426694:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060da8203/0x3234de053c4ccd0 lrc: 0/0,0 mode: --/PR res: [0x2b405:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce527 expref: 1859 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.426695:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.426698:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.426698:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.426699:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c4fdbb lrc: 3/0,1 mode: PW/PW res: [0x2b405:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.426702:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1858:41279:x1731746396230784:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (97us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.426702:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c4fdbb lrc: 4/0,1 mode: PW/PW res: [0x2b405:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.426705:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11491 00000100:00100000:1.0:1651529344.426709:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11493 00000100:00100000:1.0:1651529344.426711:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1857:41279:x1731746396230912:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.426713:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.426714:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000128edb5c/0x3234de053c4b22e lrc: 4/0,0 mode: PR/PR res: [0x2b408:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc10f expref: 1857 pid: 106695 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.426718:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000128edb5c/0x3234de053c4b22e lrc: 3/0,0 mode: PR/PR res: [0x2b408:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc10f expref: 1857 pid: 106695 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.426721:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.426723:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000128edb5c/0x3234de053c4b22e lrc: 0/0,0 mode: --/PR res: [0x2b408:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc10f expref: 1857 pid: 106695 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.426726:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.426726:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.426727:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c4fdd0 lrc: 3/0,1 mode: PW/PW res: [0x2b408:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.426729:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1856:41278:x1731746396230720:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 58us (114us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.426730:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c4fdd0 lrc: 4/0,1 mode: PW/PW res: [0x2b408:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.426732:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11492 00000100:00100000:0.0:1651529344.426747:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11494 00010000:00010000:1.0:1651529344.426749:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.426754:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1855:41278:x1731746396230848:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.426755:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1855:41279:x1731746396230912:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 43us (132us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.426757:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.426758:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11493 00010000:00010000:0.0:1651529344.426759:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c4d2bf lrc: 4/0,0 mode: PR/PR res: [0x2b406:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfcf8 expref: 1855 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.426763:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c4d2bf lrc: 3/0,0 mode: PR/PR res: [0x2b406:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfcf8 expref: 1854 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.426765:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c4fdc2 lrc: 3/0,1 mode: PW/PW res: [0x2b407:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.426768:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c4fdc2 lrc: 3/0,1 mode: PW/PW res: [0x2b407:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426768:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c4d2bf lrc: 0/0,0 mode: --/PR res: [0x2b406:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfcf8 expref: 1854 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.426772:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.426772:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.426773:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c4fdc2 lrc: 3/0,1 mode: PW/PW res: [0x2b407:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426773:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c4fdc9 lrc: 3/0,1 mode: PW/PW res: [0x2b406:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.426776:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c4fdc2 lrc: 2/0,0 mode: PW/PW res: [0x2b407:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426776:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c4fdc9 lrc: 4/0,1 mode: PW/PW res: [0x2b406:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426789:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.426795:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1853:41278:x1731746396230848:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 40us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.426798:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11494 00010000:00010000:0.0:1651529344.426805:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c4fdc2 lrc: 2/0,0 mode: PW/PW res: [0x2b407:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426808:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000064bf7951 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.426809:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c4fdc2 lrc: 2/0,0 mode: PW/PW res: [0x2b407:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426812:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c4fdc2 lrc: 3/0,0 mode: PW/PW res: [0x2b407:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426816:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c4fdc2 lrc: 1/0,0 mode: --/PW res: [0x2b407:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426819:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c4fdc2 lrc: 0/0,0 mode: --/PW res: [0x2b407:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.426822:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+211:39029:x1731745946349760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 799us (874us total) trans 12885078764 rc 0/0 00000100:00100000:1.0:1651529344.426825:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210710 00010000:00010000:0.0:1651529344.426825:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c4fdbb lrc: 3/0,1 mode: PW/PW res: [0x2b405:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426828:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c4fdbb lrc: 3/0,1 mode: PW/PW res: [0x2b405:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426831:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c4fdbb lrc: 3/0,1 mode: PW/PW res: [0x2b405:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.426832:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c4fdc9 lrc: 3/0,1 mode: PW/PW res: [0x2b406:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426833:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c4fdbb lrc: 2/0,0 mode: PW/PW res: [0x2b405:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.426835:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c4fdc9 lrc: 3/0,1 mode: PW/PW res: [0x2b406:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.426838:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c4fdc9 lrc: 3/0,1 mode: PW/PW res: [0x2b406:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.426841:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c4fdc9 lrc: 2/0,0 mode: PW/PW res: [0x2b406:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.426880:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+212:39029:x1731745946349696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 790us (889us total) trans 12885078765 rc 0/0 00000100:00100000:1.0:1651529344.426883:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210711 00000100:00100000:0.0:1651529344.426894:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+211:39029:x1731745946349632:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 908us (954us total) trans 12885078766 rc 0/0 00000100:00100000:0.0:1651529344.426897:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210709 00010000:00010000:0.0:1651529344.426904:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c4fdbb lrc: 2/0,0 mode: PW/PW res: [0x2b405:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426910:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dd394f60 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.426911:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c4fdbb lrc: 2/0,0 mode: PW/PW res: [0x2b405:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426913:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c4fdbb lrc: 3/0,0 mode: PW/PW res: [0x2b405:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426925:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c4fdbb lrc: 1/0,0 mode: --/PW res: [0x2b405:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426928:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c4fdbb lrc: 0/0,0 mode: --/PW res: [0x2b405:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426932:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c4fdc9 lrc: 2/0,0 mode: PW/PW res: [0x2b406:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426935:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d9cfe902 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.426936:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c4fdc9 lrc: 2/0,0 mode: PW/PW res: [0x2b406:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426938:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c4fdc9 lrc: 3/0,0 mode: PW/PW res: [0x2b406:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.426939:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.426942:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c4fdc9 lrc: 1/0,0 mode: --/PW res: [0x2b406:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426949:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c4fdc9 lrc: 0/0,0 mode: --/PW res: [0x2b406:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.426952:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.426957:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396230976 00010000:00010000:0.0:1651529344.426961:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ed1d2805/0x3234de053c4de9d lrc: 5/0,0 mode: PR/PR res: [0x2b40a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b27 expref: 1853 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.426972:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396231040 00010000:00010000:0.0:1651529344.426974:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001b6258e0/0x3234de053c4e7d4 lrc: 5/0,0 mode: PR/PR res: [0x2b409:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4fd2 expref: 1854 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.426979:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11495 00000100:00100000:0.0:1651529344.426981:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1854:41279:x1731746396230976:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.426983:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.426984:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ed1d2805/0x3234de053c4de9d lrc: 5/0,0 mode: PR/PR res: [0x2b40a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b27 expref: 1854 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.426988:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ed1d2805/0x3234de053c4de9d lrc: 4/0,0 mode: PR/PR res: [0x2b40a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b27 expref: 1854 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.426993:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.426993:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.426994:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.426994:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c4fdd7 lrc: 3/0,1 mode: PW/PW res: [0x2b40a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.426997:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c4fdd7 lrc: 4/0,1 mode: PW/PW res: [0x2b40a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427002:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.427008:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1854:41279:x1731746396230976:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 27us (69us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.427010:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11495 00000100:00100000:0.0:1651529344.427014:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396231104 00010000:00010000:0.0:1651529344.427017:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009698444d/0x3234de053c4d4c5 lrc: 5/0,0 mode: PR/PR res: [0x2b40b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d052c expref: 1854 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.427020:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.427022:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11496 00000100:00100000:0.0:1651529344.427023:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1854:41278:x1731746396231040:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.427025:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.427027:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001b6258e0/0x3234de053c4e7d4 lrc: 5/0,0 mode: PR/PR res: [0x2b409:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4fd2 expref: 1854 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.427030:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001b6258e0/0x3234de053c4e7d4 lrc: 4/0,0 mode: PR/PR res: [0x2b409:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4fd2 expref: 1854 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.427034:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.427035:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.427036:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c4fdde lrc: 3/0,1 mode: PW/PW res: [0x2b409:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427050:0:72397:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b6258e0/0x3234de053c4e7d4 lrc: 0/0,0 mode: --/PR res: [0x2b409:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4fd2 expref: 1854 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.427054:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c4fdde lrc: 4/0,1 mode: PW/PW res: [0x2b409:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.427055:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dfc79d4e pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996952448:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.427059:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c4fdde lrc: 4/0,1 mode: PW/PW res: [0x2b409:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427060:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.427062:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c4fdde lrc: 3/0,1 mode: PW/PW res: [0x2b409:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427065:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c4fdde lrc: 3/0,1 mode: PW/PW res: [0x2b409:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427068:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c4fdde lrc: 3/0,1 mode: PW/PW res: [0x2b409:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.427071:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1853:41278:x1731746396231040:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 47us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.427074:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11496 00010000:00010000:1.0:1651529344.427076:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c4fdde lrc: 2/0,0 mode: PW/PW res: [0x2b409:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.427079:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396231168 00010000:00010000:0.0:1651529344.427088:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000edd2ccd0/0x3234de053c4ce12 lrc: 5/0,0 mode: PR/PR res: [0x2b40c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce9aa expref: 1853 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.427094:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11497 00000100:00100000:0.0:1651529344.427096:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000781af77d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1853:41278:x1731746396231104:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.427111:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.427112:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009698444d/0x3234de053c4d4c5 lrc: 5/0,0 mode: PR/PR res: [0x2b40b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d052c expref: 1853 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.427116:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+211:39030:x1731745946349888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 869us (958us total) trans 12885078767 rc 0/0 00010000:00010000:0.0:1651529344.427116:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009698444d/0x3234de053c4d4c5 lrc: 4/0,0 mode: PR/PR res: [0x2b40b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d052c expref: 1853 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.427120:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210714 00010000:00010000:0.0:1651529344.427121:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.427122:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.427123:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4fde5 lrc: 3/0,1 mode: PW/PW res: [0x2b40b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427126:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4fde5 lrc: 4/0,1 mode: PW/PW res: [0x2b40b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.427130:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a9b051f pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996952576:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.427134:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c4fdec lrc: 3/0,1 mode: --/PW res: [0x2b40c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427141:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.427143:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11498 00000100:00100000:1.0:1651529344.427145:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1853:41278:x1731746396231168:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.427147:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000781af77d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1853:41278:x1731746396231104:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 51us (153us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.427148:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.427149:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000edd2ccd0/0x3234de053c4ce12 lrc: 4/0,0 mode: PR/PR res: [0x2b40c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce9aa expref: 1853 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.427150:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11497 00010000:00010000:1.0:1651529344.427153:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000edd2ccd0/0x3234de053c4ce12 lrc: 3/0,0 mode: PR/PR res: [0x2b40c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce9aa expref: 1852 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.427159:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000edd2ccd0/0x3234de053c4ce12 lrc: 0/0,0 mode: --/PR res: [0x2b40c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce9aa expref: 1852 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.427163:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.427164:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.427164:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c4fdec lrc: 3/0,1 mode: PW/PW res: [0x2b40c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427167:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c4fdec lrc: 4/0,1 mode: PW/PW res: [0x2b40c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427172:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c4fdde lrc: 2/0,0 mode: PW/PW res: [0x2b409:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427174:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.427178:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c660975a already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.427179:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1851:41278:x1731746396231168:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (159us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.427179:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c4fdde lrc: 2/0,0 mode: PW/PW res: [0x2b409:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.427182:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11498 00010000:00010000:0.0:1651529344.427182:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c4fdde lrc: 3/0,0 mode: PW/PW res: [0x2b409:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427186:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c4fdde lrc: 1/0,0 mode: --/PW res: [0x2b409:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427188:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c4fdec lrc: 3/0,1 mode: PW/PW res: [0x2b40c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427189:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c4fdde lrc: 0/0,0 mode: --/PW res: [0x2b409:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427191:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c4fdec lrc: 3/0,1 mode: PW/PW res: [0x2b40c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427194:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c4fdec lrc: 3/0,1 mode: PW/PW res: [0x2b40c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427197:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c4fdec lrc: 2/0,0 mode: PW/PW res: [0x2b40c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427198:0:151609:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009698444d/0x3234de053c4d4c5 lrc: 0/0,0 mode: --/PR res: [0x2b40b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d052c expref: 1850 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.427202:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996952512:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.427211:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4fde5 lrc: 3/0,1 mode: PW/PW res: [0x2b40b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427215:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4fde5 lrc: 3/0,1 mode: PW/PW res: [0x2b40b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427218:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4fde5 lrc: 3/0,1 mode: PW/PW res: [0x2b40b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427245:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4fde5 lrc: 3/0,1 mode: PW/PW res: [0x2b40b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427248:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4fde5 lrc: 2/0,0 mode: PW/PW res: [0x2b40b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.427255:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005914c920 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+211:39030:x1731745946350080:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 950us (1066us total) trans 12885078768 rc 0/0 00000100:00100000:1.0:1651529344.427258:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210716 00000100:00100000:0.0:1651529344.427288:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ea32140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+211:39029:x1731745946350016:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 999us (1120us total) trans 12885078769 rc 0/0 00000100:00100000:1.0:1651529344.427291:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.427291:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210715 00000100:00100000:0.0:1651529344.427297:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946350720 00000100:00100000:0.0:1651529344.427307:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210717 00000100:00100000:0.0:1651529344.427308:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+211:39030:x1731745946350720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.427313:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.427314:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177166 count 1 00010000:00010000:0.0:1651529344.427325:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4fdf3 lrc: 3/0,1 mode: --/PW res: [0x2b40e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.427328:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.427330:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c4d2a3 lrc: 2/0,0 mode: PR/PR res: [0x2b40e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc3b expref: 1849 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.427333:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.427334:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.427334:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4fdf3 lrc: 4/0,1 mode: --/PW res: [0x2b40e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427341:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c4d2a3 lrc: 3/0,0 mode: PR/PR res: [0x2b40e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc3b expref: 1849 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.427347:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c4d2a3 lrc: 4/0,0 mode: PR/PR res: [0x2b40e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc3b expref: 1849 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.427351:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996952640:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.427360:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c29d18ba going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.427364:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c4fdec lrc: 2/0,0 mode: PW/PW res: [0x2b40c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427367:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d37a9fd1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.427369:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c4fdec lrc: 2/0,0 mode: PW/PW res: [0x2b40c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427371:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c4fdec lrc: 3/0,0 mode: PW/PW res: [0x2b40c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427376:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c4fdec lrc: 1/0,0 mode: --/PW res: [0x2b40c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427378:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c4fdec lrc: 0/0,0 mode: --/PW res: [0x2b40c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427382:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4fde5 lrc: 2/0,0 mode: PW/PW res: [0x2b40b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.427383:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946350656 00010000:00010000:0.0:1651529344.427385:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000579ed558 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.427386:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4fde5 lrc: 2/0,0 mode: PW/PW res: [0x2b40b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427389:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4fde5 lrc: 3/0,0 mode: PW/PW res: [0x2b40b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.427391:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946350784 00010000:00010000:0.0:1651529344.427392:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4fde5 lrc: 1/0,0 mode: --/PW res: [0x2b40b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.427395:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210718 00010000:00010000:0.0:1651529344.427395:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c4fde5 lrc: 0/0,0 mode: --/PW res: [0x2b40b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.427396:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+213:39030:x1731745946350656:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.427401:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177165 count 1 00010000:00010000:1.0:1651529344.427406:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006769cf41/0x3234de053c4fdfa lrc: 3/0,1 mode: --/PW res: [0x2b40d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427411:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008a562d62/0x3234de053c4d837 lrc: 2/0,0 mode: PR/PR res: [0x2b40d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d11dc expref: 1849 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.427416:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.427417:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.427418:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006769cf41/0x3234de053c4fdfa lrc: 4/0,1 mode: --/PW res: [0x2b40d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427424:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008a562d62/0x3234de053c4d837 lrc: 3/0,0 mode: PR/PR res: [0x2b40d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d11dc expref: 1849 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.427428:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008a562d62/0x3234de053c4d837 lrc: 4/0,0 mode: PR/PR res: [0x2b40d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d11dc expref: 1849 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.427430:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210719 00000100:00100000:1.0:1651529344.427432:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000533fe698 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996952704:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.427432:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+213:39030:x1731745946350784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.427438:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177167 count 1 00010000:00010000:0.0:1651529344.427441:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4fe01 lrc: 3/0,1 mode: --/PW res: [0x2b40f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.427442:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c3caa148 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.427445:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000085cf969e/0x3234de053c4d95d lrc: 2/0,0 mode: PR/PR res: [0x2b40f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d15f6 expref: 1849 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.427448:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.427449:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.427449:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4fe01 lrc: 4/0,1 mode: --/PW res: [0x2b40f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427456:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000085cf969e/0x3234de053c4d95d lrc: 3/0,0 mode: PR/PR res: [0x2b40f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d15f6 expref: 1849 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.427459:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000085cf969e/0x3234de053c4d95d lrc: 4/0,0 mode: PR/PR res: [0x2b40f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d15f6 expref: 1849 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.427464:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996952768:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.427478:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a52ee82 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.427484:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c4fdd0 lrc: 3/0,1 mode: PW/PW res: [0x2b408:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427487:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c4fdd0 lrc: 3/0,1 mode: PW/PW res: [0x2b408:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427491:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c4fdd0 lrc: 3/0,1 mode: PW/PW res: [0x2b408:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427493:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c4fdd0 lrc: 2/0,0 mode: PW/PW res: [0x2b408:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.427522:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.427547:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.427562:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.427568:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+214:39029:x1731745946349824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1473us (1569us total) trans 12885078770 rc 0/0 00000100:00100000:0.0:1651529344.427571:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210712 00000100:00100000:0.0:1651529344.427577:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946350912 00000100:00100000:0.0:1651529344.427587:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946350848 00000100:00100000:0.0:1651529344.427590:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946350976 00000100:00100000:0.0:1651529344.427595:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210720 00000100:00100000:0.0:1651529344.427597:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+216:39029:x1731745946350912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.427598:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210721 00000100:00100000:1.0:1651529344.427600:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+216:39029:x1731745946350848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.427602:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177169 count 1 00002000:00080000:1.0:1651529344.427606:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177168 count 1 00010000:00010000:0.0:1651529344.427606:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4fe08 lrc: 3/0,1 mode: --/PW res: [0x2b411:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427611:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c4fe0f lrc: 3/0,1 mode: --/PW res: [0x2b410:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427613:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c49f50 lrc: 2/0,0 mode: PR/PR res: [0x2b411:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb386 expref: 1849 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.427616:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000073a973b4/0x3234de053c4c76d lrc: 2/0,0 mode: PR/PR res: [0x2b410:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd004 expref: 1849 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.427616:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.427617:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.427617:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4fe08 lrc: 4/0,1 mode: --/PW res: [0x2b411:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427619:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.427619:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.427620:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c4fe0f lrc: 4/0,1 mode: --/PW res: [0x2b410:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427624:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c49f50 lrc: 3/0,0 mode: PR/PR res: [0x2b411:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb386 expref: 1849 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.427627:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000073a973b4/0x3234de053c4c76d lrc: 3/0,0 mode: PR/PR res: [0x2b410:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd004 expref: 1849 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.427631:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000073a973b4/0x3234de053c4c76d lrc: 4/0,0 mode: PR/PR res: [0x2b410:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd004 expref: 1849 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.427634:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000055e03b4f pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996952896:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.427642:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c49f50 lrc: 4/0,0 mode: PR/PR res: [0x2b411:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb386 expref: 1849 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.427645:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.427647:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996952832:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.427650:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210722 00000100:00100000:1.0:1651529344.427652:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+216:39029:x1731745946350976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.427656:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177170 count 1 00000100:00100000:0.0:1651529344.427657:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 0000000064b9c5f3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.427659:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c4fe16 lrc: 3/0,1 mode: --/PW res: [0x2b412:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427662:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c4fdd0 lrc: 2/0,0 mode: PW/PW res: [0x2b408:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427663:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002a764502/0x3234de053c4c885 lrc: 2/0,0 mode: PR/PR res: [0x2b412:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd3d8 expref: 1849 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.427665:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d5eeb0cd already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.427666:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.427666:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c4fdd0 lrc: 2/0,0 mode: PW/PW res: [0x2b408:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427667:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.427667:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c4fe16 lrc: 4/0,1 mode: --/PW res: [0x2b412:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427669:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c4fdd0 lrc: 3/0,0 mode: PW/PW res: [0x2b408:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427673:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002a764502/0x3234de053c4c885 lrc: 3/0,0 mode: PR/PR res: [0x2b412:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd3d8 expref: 1849 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.427674:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c4fdd0 lrc: 1/0,0 mode: --/PW res: [0x2b408:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427677:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c4fdd0 lrc: 0/0,0 mode: --/PW res: [0x2b408:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427679:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002a764502/0x3234de053c4c885 lrc: 4/0,0 mode: PR/PR res: [0x2b412:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd3d8 expref: 1849 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.427682:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000117fbeca pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996952960:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.427689:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e5f43e7 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.427710:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996952640:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.427712:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.427714:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4fdf3 lrc: 3/0,1 mode: --/PW res: [0x2b40e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.427729:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396231744 00000100:00100000:1.0:1651529344.427730:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.427755:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c4d2a3 lrc: 4/0,0 mode: PR/PR res: [0x2b40e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc3b expref: 1850 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.427767:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11499 00000100:00100000:0.0:1651529344.427768:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1850:41279:x1731746396231744:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.427771:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.427773:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c4d2a3 lrc: 4/0,0 mode: PR/PR res: [0x2b40e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc3b expref: 1850 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.427785:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c4d2a3 lrc: 3/0,0 mode: PR/PR res: [0x2b40e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc3b expref: 1850 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.427791:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c4d2a3 lrc: 0/0,0 mode: --/PR res: [0x2b40e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc3b expref: 1850 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.427795:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.427795:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.427796:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4fdf3 lrc: 3/0,1 mode: PW/PW res: [0x2b40e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427799:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4fdf3 lrc: 4/0,1 mode: PW/PW res: [0x2b40e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.427808:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.427817:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.427818:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.427826:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000533fe698 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996952704:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.427829:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1849:41279:x1731746396231744:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 60us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.427832:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11499 00010000:00010000:1.0:1651529344.427835:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006769cf41/0x3234de053c4fdfa lrc: 3/0,1 mode: --/PW res: [0x2b40d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.427837:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396231808 00010000:00010000:0.0:1651529344.427841:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008a562d62/0x3234de053c4d837 lrc: 4/0,0 mode: PR/PR res: [0x2b40d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d11dc expref: 1849 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.427843:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396231872 00000100:00100000:0.0:1651529344.427846:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11500 00000100:00100000:0.0:1651529344.427847:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1850:41279:x1731746396231808:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.427848:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000085cf969e/0x3234de053c4d95d lrc: 5/0,0 mode: PR/PR res: [0x2b40f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d15f6 expref: 1850 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.427850:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.427851:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008a562d62/0x3234de053c4d837 lrc: 4/0,0 mode: PR/PR res: [0x2b40d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d11dc expref: 1850 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.427854:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11501 00010000:00010000:0.0:1651529344.427854:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008a562d62/0x3234de053c4d837 lrc: 3/0,0 mode: PR/PR res: [0x2b40d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d11dc expref: 1850 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.427856:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1850:41278:x1731746396231872:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.427859:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.427859:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a562d62/0x3234de053c4d837 lrc: 0/0,0 mode: --/PR res: [0x2b40d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d11dc expref: 1850 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.427860:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000085cf969e/0x3234de053c4d95d lrc: 5/0,0 mode: PR/PR res: [0x2b40f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d15f6 expref: 1850 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.427863:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.427863:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.427864:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000085cf969e/0x3234de053c4d95d lrc: 4/0,0 mode: PR/PR res: [0x2b40f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d15f6 expref: 1849 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.427864:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006769cf41/0x3234de053c4fdfa lrc: 3/0,1 mode: PW/PW res: [0x2b40d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427867:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006769cf41/0x3234de053c4fdfa lrc: 4/0,1 mode: PW/PW res: [0x2b40d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427870:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.427870:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.427871:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4fe01 lrc: 3/0,1 mode: PW/PW res: [0x2b40f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427875:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.427880:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1849:41279:x1731746396231808:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 32us (73us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.427881:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4fe01 lrc: 4/0,1 mode: PW/PW res: [0x2b40f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.427883:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11500 00010000:00010000:1.0:1651529344.427886:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.427893:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1848:41278:x1731746396231872:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 36us (75us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.427893:0:106695:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085cf969e/0x3234de053c4d95d lrc: 0/0,0 mode: --/PR res: [0x2b40f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d15f6 expref: 1848 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.427895:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11501 00000100:00100000:0.0:1651529344.427897:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996952768:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.427900:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4fe01 lrc: 3/0,1 mode: PW/PW res: [0x2b40f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427902:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006769cf41/0x3234de053c4fdfa lrc: 3/0,1 mode: PW/PW res: [0x2b40d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427903:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4fe01 lrc: 3/0,1 mode: PW/PW res: [0x2b40f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427905:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006769cf41/0x3234de053c4fdfa lrc: 3/0,1 mode: PW/PW res: [0x2b40d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427906:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4fe01 lrc: 3/0,1 mode: PW/PW res: [0x2b40f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427908:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006769cf41/0x3234de053c4fdfa lrc: 3/0,1 mode: PW/PW res: [0x2b40d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427909:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4fe01 lrc: 3/0,1 mode: PW/PW res: [0x2b40f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427911:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006769cf41/0x3234de053c4fdfa lrc: 2/0,0 mode: PW/PW res: [0x2b40d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.427912:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4fe01 lrc: 2/0,0 mode: PW/PW res: [0x2b40f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.427953:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+218:39030:x1731745946350656:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 556us (640us total) trans 12885078771 rc 0/0 00000100:00100000:1.0:1651529344.427956:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210718 00000100:00100000:1.0:1651529344.427961:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946351040 00000100:00100000:0.0:1651529344.427961:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+217:39030:x1731745946350784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 528us (633us total) trans 12885078772 rc 0/0 00000100:00100000:0.0:1651529344.427964:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210719 00000100:00100000:1.0:1651529344.427970:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210723 00000100:00100000:1.0:1651529344.427971:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f412854c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+217:39030:x1731745946351040:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.427976:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177171 count 1 00010000:00010000:1.0:1651529344.427980:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c4fe1d lrc: 3/0,1 mode: --/PW res: [0x2b413:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427985:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ca72ee39/0x3234de053c4f13c lrc: 2/0,0 mode: PR/PR res: [0x2b413:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7786 expref: 1846 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.427988:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.427988:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.427989:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c4fe1d lrc: 4/0,1 mode: --/PW res: [0x2b413:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.427995:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ca72ee39/0x3234de053c4f13c lrc: 3/0,0 mode: PR/PR res: [0x2b413:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7786 expref: 1846 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.427999:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ca72ee39/0x3234de053c4f13c lrc: 4/0,0 mode: PR/PR res: [0x2b413:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7786 expref: 1846 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.428003:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000703c0db9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996953024:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.428009:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006769cf41/0x3234de053c4fdfa lrc: 2/0,0 mode: PW/PW res: [0x2b40d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428014:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006769cf41 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.428015:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006769cf41/0x3234de053c4fdfa lrc: 2/0,0 mode: PW/PW res: [0x2b40d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428018:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006769cf41/0x3234de053c4fdfa lrc: 3/0,0 mode: PW/PW res: [0x2b40d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.428021:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c3caa148 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.428023:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006769cf41/0x3234de053c4fdfa lrc: 1/0,0 mode: --/PW res: [0x2b40d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428025:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006769cf41/0x3234de053c4fdfa lrc: 0/0,0 mode: --/PW res: [0x2b40d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428030:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4fe01 lrc: 2/0,0 mode: PW/PW res: [0x2b40f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428032:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000040cd657 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.428033:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4fe01 lrc: 2/0,0 mode: PW/PW res: [0x2b40f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428038:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4fe01 lrc: 3/0,0 mode: PW/PW res: [0x2b40f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428042:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4fe01 lrc: 1/0,0 mode: --/PW res: [0x2b40f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428044:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c4fe01 lrc: 0/0,0 mode: --/PW res: [0x2b40f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428056:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4fdf3 lrc: 3/0,1 mode: PW/PW res: [0x2b40e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428059:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4fdf3 lrc: 3/0,1 mode: PW/PW res: [0x2b40e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428062:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4fdf3 lrc: 3/0,1 mode: PW/PW res: [0x2b40e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428064:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4fdf3 lrc: 2/0,0 mode: PW/PW res: [0x2b40e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.428065:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.428094:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.428109:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.428110:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+218:39030:x1731745946350720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 800us (818us total) trans 12885078773 rc 0/0 00000100:00100000:0.0:1651529344.428113:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210717 00010000:00010000:0.0:1651529344.428119:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4fdf3 lrc: 2/0,0 mode: PW/PW res: [0x2b40e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428125:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000093dbd0d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.428126:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4fdf3 lrc: 2/0,0 mode: PW/PW res: [0x2b40e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428129:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4fdf3 lrc: 3/0,0 mode: PW/PW res: [0x2b40e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428133:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4fdf3 lrc: 1/0,0 mode: --/PW res: [0x2b40e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428136:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c4fdf3 lrc: 0/0,0 mode: --/PW res: [0x2b40e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.428143:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396231936 00010000:00010000:0.0:1651529344.428147:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000073a973b4/0x3234de053c4c76d lrc: 5/0,0 mode: PR/PR res: [0x2b410:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd004 expref: 1847 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.428150:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000117fbeca pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996952960:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.428152:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396232064 00010000:00010000:0.0:1651529344.428154:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002a764502/0x3234de053c4c885 lrc: 4/0,0 mode: PR/PR res: [0x2b412:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd3d8 expref: 1848 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.428155:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c4fe16 lrc: 3/0,1 mode: --/PW res: [0x2b412:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.428158:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396232000 00010000:00010000:0.0:1651529344.428160:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c49f50 lrc: 5/0,0 mode: PR/PR res: [0x2b411:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb386 expref: 1849 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.428162:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000055e03b4f pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996952896:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.428165:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c4fe0f lrc: 3/0,1 mode: --/PW res: [0x2b410:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.428165:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11502 00000100:00100000:0.0:1651529344.428166:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1849:41279:x1731746396231936:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.428171:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11503 00000100:00100000:1.0:1651529344.428173:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1849:41279:x1731746396232064:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.428176:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.428178:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002a764502/0x3234de053c4c885 lrc: 4/0,0 mode: PR/PR res: [0x2b412:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd3d8 expref: 1849 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.428181:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002a764502/0x3234de053c4c885 lrc: 3/0,0 mode: PR/PR res: [0x2b412:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd3d8 expref: 1849 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.428185:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.428186:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a764502/0x3234de053c4c885 lrc: 0/0,0 mode: --/PR res: [0x2b412:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd3d8 expref: 1849 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.428187:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000073a973b4/0x3234de053c4c76d lrc: 4/0,0 mode: PR/PR res: [0x2b410:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd004 expref: 1849 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.428190:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.428190:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.428191:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c4fe16 lrc: 3/0,1 mode: PW/PW res: [0x2b412:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428191:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000073a973b4/0x3234de053c4c76d lrc: 3/0,0 mode: PR/PR res: [0x2b410:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd004 expref: 1848 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.428194:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c4fe16 lrc: 4/0,1 mode: PW/PW res: [0x2b412:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428197:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073a973b4/0x3234de053c4c76d lrc: 0/0,0 mode: --/PR res: [0x2b410:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd004 expref: 1848 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.428200:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.428200:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.428201:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.428202:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c4fe0f lrc: 3/0,1 mode: PW/PW res: [0x2b410:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428205:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c4fe0f lrc: 4/0,1 mode: PW/PW res: [0x2b410:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.428208:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1847:41279:x1731746396232064:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 34us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.428211:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11503 00010000:00010000:0.0:1651529344.428215:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.428238:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11504 00000100:00100000:1.0:1651529344.428240:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de45c136 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1846:41278:x1731746396232000:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.428243:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.428244:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c49f50 lrc: 5/0,0 mode: PR/PR res: [0x2b411:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb386 expref: 1846 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.428248:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c49f50 lrc: 4/0,0 mode: PR/PR res: [0x2b411:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb386 expref: 1846 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.428254:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.428254:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.428254:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1846:41279:x1731746396231936:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 86us (189us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.428255:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4fe08 lrc: 3/0,1 mode: PW/PW res: [0x2b411:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.428257:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11502 00010000:00010000:1.0:1651529344.428258:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4fe08 lrc: 4/0,1 mode: PW/PW res: [0x2b411:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.428262:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.428268:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de45c136 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1845:41278:x1731746396232000:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 28us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.428270:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11504 00010000:00010000:1.0:1651529344.428280:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c4fe16 lrc: 3/0,1 mode: PW/PW res: [0x2b412:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.428284:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c4fe16 lrc: 3/0,1 mode: PW/PW res: [0x2b412:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.428287:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c4fe16 lrc: 3/0,1 mode: PW/PW res: [0x2b412:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428287:0:72395:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c49f50 lrc: 0/0,0 mode: --/PR res: [0x2b411:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb386 expref: 1844 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.428290:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c4fe16 lrc: 2/0,0 mode: PW/PW res: [0x2b412:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.428291:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996952832:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.428295:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4fe08 lrc: 3/0,1 mode: PW/PW res: [0x2b411:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428305:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4fe08 lrc: 3/0,1 mode: PW/PW res: [0x2b411:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428308:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4fe08 lrc: 3/0,1 mode: PW/PW res: [0x2b411:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428311:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4fe08 lrc: 3/0,1 mode: PW/PW res: [0x2b411:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428313:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4fe08 lrc: 2/0,0 mode: PW/PW res: [0x2b411:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.428330:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+218:39029:x1731745946350976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 677us (767us total) trans 12885078774 rc 0/0 00000100:00100000:1.0:1651529344.428333:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210722 00010000:00010000:1.0:1651529344.428340:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c4fe0f lrc: 3/0,1 mode: PW/PW res: [0x2b410:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.428343:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c4fe0f lrc: 3/0,1 mode: PW/PW res: [0x2b410:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.428346:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c4fe0f lrc: 3/0,1 mode: PW/PW res: [0x2b410:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.428349:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c4fe0f lrc: 2/0,0 mode: PW/PW res: [0x2b410:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.428373:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+219:39029:x1731745946350912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 774us (851us total) trans 12885078775 rc 0/0 00000100:00100000:0.0:1651529344.428376:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210720 00010000:00010000:0.0:1651529344.428383:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c4fe16 lrc: 2/0,0 mode: PW/PW res: [0x2b412:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428386:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003c075ac0 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.428387:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+218:39029:x1731745946350848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 785us (839us total) trans 12885078776 rc 0/0 00010000:00010000:0.0:1651529344.428387:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c4fe16 lrc: 2/0,0 mode: PW/PW res: [0x2b412:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.428389:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210721 00010000:00010000:0.0:1651529344.428390:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c4fe16 lrc: 3/0,0 mode: PW/PW res: [0x2b412:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428395:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c4fe16 lrc: 1/0,0 mode: --/PW res: [0x2b412:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428398:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c4fe16 lrc: 0/0,0 mode: --/PW res: [0x2b412:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428402:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4fe08 lrc: 2/0,0 mode: PW/PW res: [0x2b411:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428405:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000046d6c242 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.428405:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4fe08 lrc: 2/0,0 mode: PW/PW res: [0x2b411:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428408:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4fe08 lrc: 3/0,0 mode: PW/PW res: [0x2b411:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428411:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4fe08 lrc: 1/0,0 mode: --/PW res: [0x2b411:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428414:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c4fe08 lrc: 0/0,0 mode: --/PW res: [0x2b411:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428417:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c4fe0f lrc: 2/0,0 mode: PW/PW res: [0x2b410:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428420:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008ac1e27e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.428421:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c4fe0f lrc: 2/0,0 mode: PW/PW res: [0x2b410:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.428423:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.428426:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c4fe0f lrc: 3/0,0 mode: PW/PW res: [0x2b410:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428429:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c4fe0f lrc: 1/0,0 mode: --/PW res: [0x2b410:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428432:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c4fe0f lrc: 0/0,0 mode: --/PW res: [0x2b410:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428441:0:80280:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed1d2805/0x3234de053c4de9d lrc: 0/0,0 mode: --/PR res: [0x2b40a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b27 expref: 1843 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.428445:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996952384:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.428447:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.428448:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c4fdd7 lrc: 3/0,1 mode: PW/PW res: [0x2b40a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428457:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c4fdd7 lrc: 3/0,1 mode: PW/PW res: [0x2b40a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428460:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c4fdd7 lrc: 3/0,1 mode: PW/PW res: [0x2b40a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.428462:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.428464:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c4fdd7 lrc: 3/0,1 mode: PW/PW res: [0x2b40a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428471:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c4fdd7 lrc: 2/0,0 mode: PW/PW res: [0x2b40a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.428475:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.428517:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+218:39030:x1731745946349952:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 2327us (2377us total) trans 12885078777 rc 0/0 00000100:00100000:0.0:1651529344.428520:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210713 00000100:00100000:1.0:1651529344.428523:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946351360 00000100:00100000:0.0:1651529344.428525:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946351424 00000100:00100000:1.0:1651529344.428533:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946351488 00000100:00100000:1.0:1651529344.428539:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210724 00000100:00100000:1.0:1651529344.428541:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+220:39030:x1731745946351360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.428541:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210725 00000100:00100000:0.0:1651529344.428543:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+220:39030:x1731745946351424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.428546:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177172 count 1 00010000:00010000:1.0:1651529344.428550:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c4fe24 lrc: 3/0,1 mode: --/PW res: [0x2b414:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.428555:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c559283b/0x3234de053c4f525 lrc: 2/0,0 mode: PR/PR res: [0x2b414:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d870e expref: 1842 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.428558:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.428559:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.428559:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c4fe24 lrc: 4/0,1 mode: --/PW res: [0x2b414:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.428562:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177173 count 1 00010000:00010000:1.0:1651529344.428566:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c559283b/0x3234de053c4f525 lrc: 3/0,0 mode: PR/PR res: [0x2b414:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d870e expref: 1842 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.428567:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4fe2b lrc: 3/0,1 mode: --/PW res: [0x2b415:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.428569:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c559283b/0x3234de053c4f525 lrc: 4/0,0 mode: PR/PR res: [0x2b414:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d870e expref: 1842 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.428572:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c4ec65 lrc: 2/0,0 mode: PR/PR res: [0x2b415:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6351 expref: 1842 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.428573:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a573b31 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996953088:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.428575:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.428575:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.428576:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4fe2b lrc: 4/0,1 mode: --/PW res: [0x2b415:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.428582:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b52d0f36 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.428583:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c4ec65 lrc: 3/0,0 mode: PR/PR res: [0x2b415:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6351 expref: 1842 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.428587:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c4ec65 lrc: 4/0,0 mode: PR/PR res: [0x2b415:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6351 expref: 1842 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.428589:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000703c0db9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996953024:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.428591:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996953152:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.428593:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c4fe1d lrc: 3/0,1 mode: --/PW res: [0x2b413:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.428600:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210726 00000100:00100000:0.0:1651529344.428600:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ff7757ae going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.428602:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+220:39029:x1731745946351488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.428605:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c4fdd7 lrc: 2/0,0 mode: PW/PW res: [0x2b40a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.428606:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177174 count 1 00010000:00010000:0.0:1651529344.428608:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004f275b98 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.428609:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c4fdd7 lrc: 2/0,0 mode: PW/PW res: [0x2b40a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.428610:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070346c06/0x3234de053c4fe32 lrc: 3/0,1 mode: --/PW res: [0x2b416:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428612:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c4fdd7 lrc: 3/0,0 mode: PW/PW res: [0x2b40a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.428614:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008c165c1a/0x3234de053c4dc97 lrc: 2/0,0 mode: PR/PR res: [0x2b416:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d22c2 expref: 1842 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.428616:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c4fdd7 lrc: 1/0,0 mode: --/PW res: [0x2b40a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.428617:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.428617:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.428618:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070346c06/0x3234de053c4fe32 lrc: 4/0,1 mode: --/PW res: [0x2b416:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428619:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c4fdd7 lrc: 0/0,0 mode: --/PW res: [0x2b40a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.428623:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008c165c1a/0x3234de053c4dc97 lrc: 3/0,0 mode: PR/PR res: [0x2b416:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d22c2 expref: 1842 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.428627:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008c165c1a/0x3234de053c4dc97 lrc: 4/0,0 mode: PR/PR res: [0x2b416:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d22c2 expref: 1842 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.428627:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396232128 00000100:00100000:1.0:1651529344.428631:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003de40890 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996953216:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.428632:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ca72ee39/0x3234de053c4f13c lrc: 4/0,0 mode: PR/PR res: [0x2b413:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7786 expref: 1843 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.428637:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c3caa148 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.428654:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11505 00000100:00100000:0.0:1651529344.428665:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1843:41279:x1731746396232128:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.428669:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.428670:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ca72ee39/0x3234de053c4f13c lrc: 4/0,0 mode: PR/PR res: [0x2b413:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7786 expref: 1843 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.428674:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ca72ee39/0x3234de053c4f13c lrc: 3/0,0 mode: PR/PR res: [0x2b413:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7786 expref: 1843 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.428680:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca72ee39/0x3234de053c4f13c lrc: 0/0,0 mode: --/PR res: [0x2b413:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7786 expref: 1843 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.428683:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.428684:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.428685:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c4fe1d lrc: 3/0,1 mode: PW/PW res: [0x2b413:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428688:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c4fe1d lrc: 4/0,1 mode: PW/PW res: [0x2b413:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.428689:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.428697:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.428705:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1842:41279:x1731746396232128:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 48us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.428707:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11505 00000100:00100000:1.0:1651529344.428709:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.428723:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946351872 00000100:00100000:1.0:1651529344.428724:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.428744:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946351808 00000100:00100000:0.0:1651529344.428750:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946351936 00000100:00100000:0.0:1651529344.428756:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210727 00000100:00100000:0.0:1651529344.428758:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+223:39030:x1731745946351872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.428763:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177176 count 1 00010000:00010000:0.0:1651529344.428767:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c4fe39 lrc: 3/0,1 mode: --/PW res: [0x2b418:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.428771:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210728 00010000:00010000:0.0:1651529344.428771:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000011d5f1b1/0x3234de053c4f1d6 lrc: 2/0,0 mode: PR/PR res: [0x2b418:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a57 expref: 1841 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.428773:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+223:39030:x1731745946351808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.428777:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1651529344.428778:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177175 count 1 00010000:00010000:0.0:1651529344.428778:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.428778:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c4fe39 lrc: 4/0,1 mode: --/PW res: [0x2b418:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.428783:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c4fe40 lrc: 3/0,1 mode: --/PW res: [0x2b417:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.428787:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000027cee4d4/0x3234de053c4ea3c lrc: 2/0,0 mode: PR/PR res: [0x2b417:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a4b expref: 1841 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.428791:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.428791:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.428792:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c4fe40 lrc: 4/0,1 mode: --/PW res: [0x2b417:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.428798:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000027cee4d4/0x3234de053c4ea3c lrc: 3/0,0 mode: PR/PR res: [0x2b417:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a4b expref: 1841 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.428805:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000011d5f1b1/0x3234de053c4f1d6 lrc: 3/0,0 mode: PR/PR res: [0x2b418:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a57 expref: 1841 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.428809:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000027cee4d4/0x3234de053c4ea3c lrc: 4/0,0 mode: PR/PR res: [0x2b417:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a4b expref: 1841 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.428809:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000011d5f1b1/0x3234de053c4f1d6 lrc: 4/0,0 mode: PR/PR res: [0x2b418:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a57 expref: 1841 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.428813:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000703c0db9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996953280:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.428813:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996953344:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.428822:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000567ee0ef going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.428824:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f9dd6aa3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.428828:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210729 00000100:00100000:1.0:1651529344.428829:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+223:39030:x1731745946351936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.428834:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177177 count 1 00010000:00010000:1.0:1651529344.428837:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c4fe47 lrc: 3/0,1 mode: --/PW res: [0x2b419:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.428844:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005af52cfa/0x3234de053c4eda7 lrc: 2/0,0 mode: PR/PR res: [0x2b419:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6924 expref: 1841 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.428847:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.428847:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.428848:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c4fe47 lrc: 4/0,1 mode: --/PW res: [0x2b419:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.428854:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005af52cfa/0x3234de053c4eda7 lrc: 3/0,0 mode: PR/PR res: [0x2b419:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6924 expref: 1841 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.428857:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005af52cfa/0x3234de053c4eda7 lrc: 4/0,0 mode: PR/PR res: [0x2b419:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6924 expref: 1841 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.428861:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dfc79d4e pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996953408:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.428867:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 000000004698fefb going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.428871:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c4fe1d lrc: 3/0,1 mode: PW/PW res: [0x2b413:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.428874:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c4fe1d lrc: 3/0,1 mode: PW/PW res: [0x2b413:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.428878:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c4fe1d lrc: 3/0,1 mode: PW/PW res: [0x2b413:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.428880:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c4fe1d lrc: 2/0,0 mode: PW/PW res: [0x2b413:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428893:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c4fe1d lrc: 2/0,0 mode: PW/PW res: [0x2b413:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428906:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000af20b5e7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.428907:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c4fe1d lrc: 2/0,0 mode: PW/PW res: [0x2b413:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428910:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c4fe1d lrc: 3/0,0 mode: PW/PW res: [0x2b413:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428915:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c4fe1d lrc: 1/0,0 mode: --/PW res: [0x2b413:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.428920:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c4fe1d lrc: 0/0,0 mode: --/PW res: [0x2b413:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.428924:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f412854c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+224:39030:x1731745946351040:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 952us (1193us total) trans 12885078778 rc 0/0 00000100:00100000:1.0:1651529344.428927:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210723 00000100:00100000:1.0:1651529344.428955:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.429020:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a573b31 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996953088:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.429024:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c4fe24 lrc: 3/0,1 mode: --/PW res: [0x2b414:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.429032:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946352000 00000100:00100000:1.0:1651529344.429039:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210730 00000100:00100000:1.0:1651529344.429041:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007fca8239 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+224:39030:x1731745946352000:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.429045:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177178 count 1 00010000:00010000:1.0:1651529344.429049:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c4fe4e lrc: 3/0,1 mode: --/PW res: [0x2b41a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429053:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c4f35e lrc: 2/0,0 mode: PR/PR res: [0x2b41a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8023 expref: 1841 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.429056:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.429057:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.429058:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c4fe4e lrc: 4/0,1 mode: --/PW res: [0x2b41a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429064:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c4f35e lrc: 3/0,0 mode: PR/PR res: [0x2b41a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8023 expref: 1841 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.429070:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c4f35e lrc: 4/0,0 mode: PR/PR res: [0x2b41a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8023 expref: 1841 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.429074:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005914c920 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996953472:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.429083:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000412e5d26 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.429176:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.429182:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946352064 00000100:00100000:1.0:1651529344.429195:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210731 00000100:00100000:1.0:1651529344.429197:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ea32140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+225:39030:x1731745946352064:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.429202:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177179 count 1 00010000:00010000:1.0:1651529344.429206:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c4fe55 lrc: 3/0,1 mode: --/PW res: [0x2b41b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429210:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003e008fd4/0x3234de053c4d6d2 lrc: 2/0,0 mode: PR/PR res: [0x2b41b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0cdb expref: 1841 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.429220:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.429220:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.429221:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c4fe55 lrc: 4/0,1 mode: --/PW res: [0x2b41b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429244:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003e008fd4/0x3234de053c4d6d2 lrc: 3/0,0 mode: PR/PR res: [0x2b41b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0cdb expref: 1841 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.429248:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003e008fd4/0x3234de053c4d6d2 lrc: 4/0,0 mode: PR/PR res: [0x2b41b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0cdb expref: 1841 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.429255:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000007fba516 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996953536:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.429265:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8a0b704 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.429314:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996953152:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.429318:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4fe2b lrc: 3/0,1 mode: --/PW res: [0x2b415:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.429330:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.429340:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.429340:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396232512 00000100:00100000:1.0:1651529344.429349:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.429350:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c559283b/0x3234de053c4f525 lrc: 4/0,0 mode: PR/PR res: [0x2b414:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d870e expref: 1842 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.429357:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396232640 00010000:00010000:0.0:1651529344.429360:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c4ec65 lrc: 4/0,0 mode: PR/PR res: [0x2b415:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6351 expref: 1843 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.429362:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000703c0db9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996953280:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.429364:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396232768 00010000:00010000:0.0:1651529344.429366:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008c165c1a/0x3234de053c4dc97 lrc: 5/0,0 mode: PR/PR res: [0x2b416:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d22c2 expref: 1844 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.429367:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c4fe40 lrc: 3/0,1 mode: --/PW res: [0x2b417:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.429370:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11506 00000100:00100000:0.0:1651529344.429372:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1844:41278:x1731746396232512:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.429374:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003de40890 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996953216:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.429374:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.429376:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000070346c06/0x3234de053c4fe32 lrc: 3/0,1 mode: --/PW res: [0x2b416:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429376:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c559283b/0x3234de053c4f525 lrc: 4/0,0 mode: PR/PR res: [0x2b414:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d870e expref: 1844 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.429382:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11507 00010000:00010000:0.0:1651529344.429382:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c559283b/0x3234de053c4f525 lrc: 3/0,0 mode: PR/PR res: [0x2b414:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d870e expref: 1844 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.429384:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1844:41278:x1731746396232640:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.429387:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.429388:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c559283b/0x3234de053c4f525 lrc: 0/0,0 mode: --/PR res: [0x2b414:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d870e expref: 1844 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.429389:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c4ec65 lrc: 4/0,0 mode: PR/PR res: [0x2b415:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6351 expref: 1844 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.429391:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.429392:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.429392:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c4fe24 lrc: 3/0,1 mode: PW/PW res: [0x2b414:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429393:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c4ec65 lrc: 3/0,0 mode: PR/PR res: [0x2b415:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6351 expref: 1843 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.429396:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c4fe24 lrc: 4/0,1 mode: PW/PW res: [0x2b414:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429399:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c4ec65 lrc: 0/0,0 mode: --/PR res: [0x2b415:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6351 expref: 1843 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.429403:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.429405:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.429410:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.429411:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4fe2b lrc: 3/0,1 mode: PW/PW res: [0x2b415:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.429416:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1842:41278:x1731746396232512:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 44us (86us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.429418:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4fe2b lrc: 4/0,1 mode: PW/PW res: [0x2b415:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.429419:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11506 00000100:00100000:0.0:1651529344.429423:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11508 00000100:00100000:0.0:1651529344.429425:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1841:41278:x1731746396232768:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.429428:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.429435:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1841:41278:x1731746396232640:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 50us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.429438:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11507 00010000:00010000:1.0:1651529344.429445:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c4fe24 lrc: 3/0,1 mode: PW/PW res: [0x2b414:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429448:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c4fe24 lrc: 3/0,1 mode: PW/PW res: [0x2b414:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429451:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c4fe24 lrc: 3/0,1 mode: PW/PW res: [0x2b414:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429454:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c4fe24 lrc: 2/0,0 mode: PW/PW res: [0x2b414:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429473:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.429475:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008c165c1a/0x3234de053c4dc97 lrc: 4/0,0 mode: PR/PR res: [0x2b416:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d22c2 expref: 1840 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.429479:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008c165c1a/0x3234de053c4dc97 lrc: 3/0,0 mode: PR/PR res: [0x2b416:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d22c2 expref: 1840 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.429484:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c165c1a/0x3234de053c4dc97 lrc: 0/0,0 mode: --/PR res: [0x2b416:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d22c2 expref: 1840 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.429488:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.429489:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.429489:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000070346c06/0x3234de053c4fe32 lrc: 3/0,1 mode: PW/PW res: [0x2b416:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429492:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070346c06/0x3234de053c4fe32 lrc: 4/0,1 mode: PW/PW res: [0x2b416:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429502:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.429511:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+226:39030:x1731745946351360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 969us (1087us total) trans 12885078779 rc 0/0 00000100:00100000:0.0:1651529344.429513:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1839:41278:x1731746396232768:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 87us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.429514:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210724 00000100:00100000:0.0:1651529344.429516:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11508 00010000:00010000:1.0:1651529344.429521:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000070346c06/0x3234de053c4fe32 lrc: 3/0,1 mode: PW/PW res: [0x2b416:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429523:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c4fe24 lrc: 2/0,0 mode: PW/PW res: [0x2b414:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429525:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070346c06/0x3234de053c4fe32 lrc: 3/0,1 mode: PW/PW res: [0x2b416:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429526:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f1b4c19f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.429527:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c4fe24 lrc: 2/0,0 mode: PW/PW res: [0x2b414:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429528:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070346c06/0x3234de053c4fe32 lrc: 3/0,1 mode: PW/PW res: [0x2b416:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429530:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070346c06/0x3234de053c4fe32 lrc: 2/0,0 mode: PW/PW res: [0x2b416:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429530:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c4fe24 lrc: 3/0,0 mode: PW/PW res: [0x2b414:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429534:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c4fe24 lrc: 1/0,0 mode: --/PW res: [0x2b414:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429557:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c4fe24 lrc: 0/0,0 mode: --/PW res: [0x2b414:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429562:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070346c06/0x3234de053c4fe32 lrc: 2/0,0 mode: PW/PW res: [0x2b416:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429564:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000070346c06 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.429565:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070346c06/0x3234de053c4fe32 lrc: 2/0,0 mode: PW/PW res: [0x2b416:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.429568:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+226:39029:x1731745946351488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 965us (1093us total) trans 12885078780 rc 0/0 00010000:00010000:0.0:1651529344.429568:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070346c06/0x3234de053c4fe32 lrc: 3/0,0 mode: PW/PW res: [0x2b416:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.429571:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210726 00010000:00010000:0.0:1651529344.429572:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070346c06/0x3234de053c4fe32 lrc: 1/0,0 mode: --/PW res: [0x2b416:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429574:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070346c06/0x3234de053c4fe32 lrc: 0/0,0 mode: --/PW res: [0x2b416:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429583:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4fe2b lrc: 3/0,1 mode: PW/PW res: [0x2b415:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429585:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4fe2b lrc: 3/0,1 mode: PW/PW res: [0x2b415:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.429599:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.429599:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4fe2b lrc: 3/0,1 mode: PW/PW res: [0x2b415:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429607:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4fe2b lrc: 2/0,0 mode: PW/PW res: [0x2b415:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.429612:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.429653:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+226:39030:x1731745946351424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1109us (1205us total) trans 12885078781 rc 0/0 00000100:00100000:0.0:1651529344.429656:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210725 00010000:00010000:0.0:1651529344.429663:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4fe2b lrc: 2/0,0 mode: PW/PW res: [0x2b415:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429666:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065c40e6a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.429667:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4fe2b lrc: 2/0,0 mode: PW/PW res: [0x2b415:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429670:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4fe2b lrc: 3/0,0 mode: PW/PW res: [0x2b415:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429674:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4fe2b lrc: 1/0,0 mode: --/PW res: [0x2b415:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429677:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c4fe2b lrc: 0/0,0 mode: --/PW res: [0x2b415:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.429686:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996953344:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.429689:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c4fe39 lrc: 3/0,1 mode: --/PW res: [0x2b418:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.429698:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396232896 00000100:00100000:1.0:1651529344.429700:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.429702:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000011d5f1b1/0x3234de053c4f1d6 lrc: 4/0,0 mode: PR/PR res: [0x2b418:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a57 expref: 1839 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.429711:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.429715:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396232960 00000100:00100000:1.0:1651529344.429718:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.429718:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000027cee4d4/0x3234de053c4ea3c lrc: 4/0,0 mode: PR/PR res: [0x2b417:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a4b expref: 1840 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.429726:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dfc79d4e pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996953408:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.429731:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c4fe47 lrc: 3/0,1 mode: --/PW res: [0x2b419:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.429747:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000007fba516 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996953536:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.429747:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396233024 00010000:00010000:1.0:1651529344.429750:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c4fe55 lrc: 3/0,1 mode: --/PW res: [0x2b41b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429750:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005af52cfa/0x3234de053c4eda7 lrc: 4/0,0 mode: PR/PR res: [0x2b419:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6924 expref: 1841 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.429755:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396233088 00010000:00010000:0.0:1651529344.429757:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c4f35e lrc: 5/0,0 mode: PR/PR res: [0x2b41a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8023 expref: 1842 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.429758:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005914c920 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996953472:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.429760:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c4fe4e lrc: 3/0,1 mode: --/PW res: [0x2b41a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.429761:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396233152 00010000:00010000:0.0:1651529344.429763:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003e008fd4/0x3234de053c4d6d2 lrc: 4/0,0 mode: PR/PR res: [0x2b41b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0cdb expref: 1843 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.429767:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11509 00000100:00100000:1.0:1651529344.429769:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1843:41279:x1731746396232896:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.429769:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11510 00000100:00100000:0.0:1651529344.429770:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1843:41279:x1731746396232960:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.429772:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.429773:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.429774:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000011d5f1b1/0x3234de053c4f1d6 lrc: 4/0,0 mode: PR/PR res: [0x2b418:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a57 expref: 1843 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.429774:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000027cee4d4/0x3234de053c4ea3c lrc: 4/0,0 mode: PR/PR res: [0x2b417:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a4b expref: 1843 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.429777:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000011d5f1b1/0x3234de053c4f1d6 lrc: 3/0,0 mode: PR/PR res: [0x2b418:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a57 expref: 1843 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.429781:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000027cee4d4/0x3234de053c4ea3c lrc: 3/0,0 mode: PR/PR res: [0x2b417:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a4b expref: 1843 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.429783:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011d5f1b1/0x3234de053c4f1d6 lrc: 0/0,0 mode: --/PR res: [0x2b418:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a57 expref: 1843 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.429786:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027cee4d4/0x3234de053c4ea3c lrc: 0/0,0 mode: --/PR res: [0x2b417:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a4b expref: 1843 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.429787:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.429788:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.429789:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c4fe39 lrc: 3/0,1 mode: PW/PW res: [0x2b418:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429792:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c4fe39 lrc: 4/0,1 mode: PW/PW res: [0x2b418:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429801:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.429811:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.429812:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.429813:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c4fe40 lrc: 3/0,1 mode: PW/PW res: [0x2b417:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.429815:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1841:41279:x1731746396232896:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 45us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.429818:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11509 00000100:00100000:1.0:1651529344.429823:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11511 00000100:00100000:1.0:1651529344.429825:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005239dfe7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1840:41279:x1731746396233024:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.429825:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c4fe40 lrc: 4/0,1 mode: PW/PW res: [0x2b417:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429828:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.429829:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005af52cfa/0x3234de053c4eda7 lrc: 4/0,0 mode: PR/PR res: [0x2b419:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6924 expref: 1840 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.429834:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.429839:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005af52cfa/0x3234de053c4eda7 lrc: 3/0,0 mode: PR/PR res: [0x2b419:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6924 expref: 1840 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.429842:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1840:41279:x1731746396232960:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 71us (230us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.429844:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005af52cfa/0x3234de053c4eda7 lrc: 0/0,0 mode: --/PR res: [0x2b419:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6924 expref: 1840 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.429845:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11510 00010000:00010000:1.0:1651529344.429848:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.429848:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.429849:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c4fe47 lrc: 3/0,1 mode: PW/PW res: [0x2b419:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.429850:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11512 00000100:00100000:0.0:1651529344.429851:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1838:41279:x1731746396233088:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.429852:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c4fe47 lrc: 4/0,1 mode: PW/PW res: [0x2b419:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429854:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.429855:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c4f35e lrc: 4/0,0 mode: PR/PR res: [0x2b41a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8023 expref: 1838 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.429858:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.429859:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c4f35e lrc: 3/0,0 mode: PR/PR res: [0x2b41a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8023 expref: 1838 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.429863:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005239dfe7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1838:41279:x1731746396233024:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 37us (163us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.429864:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c4f35e lrc: 0/0,0 mode: --/PR res: [0x2b41a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8023 expref: 1838 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.429866:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11511 00010000:00010000:0.0:1651529344.429868:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.429868:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.429869:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c4fe4e lrc: 3/0,1 mode: PW/PW res: [0x2b41a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429872:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c4fe4e lrc: 4/0,1 mode: PW/PW res: [0x2b41a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.429874:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11513 00000100:00100000:1.0:1651529344.429875:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1836:41279:x1731746396233152:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.429878:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.429881:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.429885:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003e008fd4/0x3234de053c4d6d2 lrc: 4/0,0 mode: PR/PR res: [0x2b41b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0cdb expref: 1836 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.429886:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1836:41279:x1731746396233088:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 34us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.429889:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11512 00010000:00010000:1.0:1651529344.429890:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003e008fd4/0x3234de053c4d6d2 lrc: 3/0,0 mode: PR/PR res: [0x2b41b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0cdb expref: 1836 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.429895:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e008fd4/0x3234de053c4d6d2 lrc: 0/0,0 mode: --/PR res: [0x2b41b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0cdb expref: 1835 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.429896:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c4fe39 lrc: 3/0,1 mode: PW/PW res: [0x2b418:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429898:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.429898:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.429899:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c4fe55 lrc: 3/0,1 mode: PW/PW res: [0x2b41b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429899:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c4fe39 lrc: 3/0,1 mode: PW/PW res: [0x2b418:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429902:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c4fe55 lrc: 4/0,1 mode: PW/PW res: [0x2b41b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429902:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c4fe39 lrc: 3/0,1 mode: PW/PW res: [0x2b418:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429904:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c4fe39 lrc: 2/0,0 mode: PW/PW res: [0x2b418:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429908:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.429913:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1834:41279:x1731746396233152:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 37us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.429915:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11513 00010000:00010000:1.0:1651529344.429922:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c4fe40 lrc: 3/0,1 mode: PW/PW res: [0x2b417:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429925:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c4fe40 lrc: 3/0,1 mode: PW/PW res: [0x2b417:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429928:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c4fe40 lrc: 3/0,1 mode: PW/PW res: [0x2b417:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429931:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c4fe40 lrc: 2/0,0 mode: PW/PW res: [0x2b417:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.429953:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+226:39030:x1731745946351872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1194us (1263us total) trans 12885078782 rc 0/0 00000100:00100000:0.0:1651529344.429956:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210727 00010000:00010000:0.0:1651529344.429963:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c4fe39 lrc: 2/0,0 mode: PW/PW res: [0x2b418:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429966:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005b1ee779 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.429967:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c4fe39 lrc: 2/0,0 mode: PW/PW res: [0x2b418:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429970:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c4fe39 lrc: 3/0,0 mode: PW/PW res: [0x2b418:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.429974:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+226:39030:x1731745946351808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1200us (1264us total) trans 12885078783 rc 0/0 00010000:00010000:0.0:1651529344.429974:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c4fe39 lrc: 1/0,0 mode: --/PW res: [0x2b418:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.429977:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210728 00010000:00010000:0.0:1651529344.429977:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c4fe39 lrc: 0/0,0 mode: --/PW res: [0x2b418:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429981:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c4fe40 lrc: 2/0,0 mode: PW/PW res: [0x2b417:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429984:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c4fe47 lrc: 3/0,1 mode: PW/PW res: [0x2b419:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429984:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000323a7bf8 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.429985:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c4fe40 lrc: 2/0,0 mode: PW/PW res: [0x2b417:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429987:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c4fe47 lrc: 3/0,1 mode: PW/PW res: [0x2b419:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429990:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c4fe47 lrc: 3/0,1 mode: PW/PW res: [0x2b419:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429990:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c4fe40 lrc: 3/0,0 mode: PW/PW res: [0x2b417:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.429993:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c4fe47 lrc: 2/0,0 mode: PW/PW res: [0x2b419:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429993:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c4fe40 lrc: 1/0,0 mode: --/PW res: [0x2b417:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.429996:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c4fe40 lrc: 0/0,0 mode: --/PW res: [0x2b417:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.430005:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c4fe47 lrc: 2/0,0 mode: PW/PW res: [0x2b419:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.430008:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000022a594ce already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.430009:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c4fe47 lrc: 2/0,0 mode: PW/PW res: [0x2b419:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.430012:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c4fe47 lrc: 3/0,0 mode: PW/PW res: [0x2b419:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.430015:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c4fe47 lrc: 1/0,0 mode: --/PW res: [0x2b419:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.430018:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c4fe47 lrc: 0/0,0 mode: --/PW res: [0x2b419:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.430029:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+226:39030:x1731745946351936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1199us (1304us total) trans 12885078784 rc 0/0 00000100:00100000:1.0:1651529344.430032:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210729 00010000:00010000:1.0:1651529344.430038:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c4fe55 lrc: 3/0,1 mode: PW/PW res: [0x2b41b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.430043:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c4fe55 lrc: 3/0,1 mode: PW/PW res: [0x2b41b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.430046:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c4fe55 lrc: 3/0,1 mode: PW/PW res: [0x2b41b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.430049:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c4fe55 lrc: 2/0,0 mode: PW/PW res: [0x2b41b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.430069:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c4fe55 lrc: 2/0,0 mode: PW/PW res: [0x2b41b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.430075:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2a53ada already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.430076:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c4fe55 lrc: 2/0,0 mode: PW/PW res: [0x2b41b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.430078:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c4fe55 lrc: 3/0,0 mode: PW/PW res: [0x2b41b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.430082:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c4fe55 lrc: 1/0,0 mode: --/PW res: [0x2b41b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.430085:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c4fe55 lrc: 0/0,0 mode: --/PW res: [0x2b41b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.430089:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ea32140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+226:39030:x1731745946352064:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 891us (913us total) trans 12885078785 rc 0/0 00000100:00100000:1.0:1651529344.430092:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210731 00010000:00010000:1.0:1651529344.430098:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c4fe4e lrc: 3/0,1 mode: PW/PW res: [0x2b41a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.430101:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c4fe4e lrc: 3/0,1 mode: PW/PW res: [0x2b41a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.430104:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c4fe4e lrc: 3/0,1 mode: PW/PW res: [0x2b41a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.430107:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c4fe4e lrc: 2/0,0 mode: PW/PW res: [0x2b41a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.430117:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c4fe4e lrc: 2/0,0 mode: PW/PW res: [0x2b41a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.430120:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d065f972 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.430121:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c4fe4e lrc: 2/0,0 mode: PW/PW res: [0x2b41a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.430124:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c4fe4e lrc: 3/0,0 mode: PW/PW res: [0x2b41a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.430127:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c4fe4e lrc: 1/0,0 mode: --/PW res: [0x2b41a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.430130:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c4fe4e lrc: 0/0,0 mode: --/PW res: [0x2b41a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.430141:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007fca8239 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+226:39030:x1731745946352000:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1100us (1186us total) trans 12885078786 rc 0/0 00000100:00100000:1.0:1651529344.430146:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210730 00000100:00100000:1.0:1651529344.430179:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.430193:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.430205:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.430276:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946352128 00000100:00100000:1.0:1651529344.430283:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946352192 00000100:00100000:1.0:1651529344.430290:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946352256 00000100:00100000:0.0:1651529344.430298:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210732 00000100:00100000:1.0:1651529344.430300:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210733 00000100:00100000:0.0:1651529344.430300:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+228:39030:x1731745946352128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.430302:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+228:39030:x1731745946352192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.430306:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177180 count 1 00002000:00080000:1.0:1651529344.430308:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177181 count 1 00010000:00010000:0.0:1651529344.430311:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c4fe5c lrc: 3/0,1 mode: --/PW res: [0x2b41c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.430312:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6711731/0x3234de053c4fe63 lrc: 3/0,1 mode: --/PW res: [0x2b41d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.430315:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000094a0ec28/0x3234de053c4b522 lrc: 2/0,0 mode: PR/PR res: [0x2b41c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc258 expref: 1833 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.430317:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c4d25d lrc: 2/0,0 mode: PR/PR res: [0x2b41d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfaeb expref: 1833 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.430318:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.430319:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.430320:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.430320:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c4fe5c lrc: 4/0,1 mode: --/PW res: [0x2b41c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.430321:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.430321:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6711731/0x3234de053c4fe63 lrc: 4/0,1 mode: --/PW res: [0x2b41d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.430328:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c4d25d lrc: 3/0,0 mode: PR/PR res: [0x2b41d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfaeb expref: 1833 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.430332:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c4d25d lrc: 4/0,0 mode: PR/PR res: [0x2b41d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfaeb expref: 1833 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.430336:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007ac35c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996953600:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.430344:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000094a0ec28/0x3234de053c4b522 lrc: 3/0,0 mode: PR/PR res: [0x2b41c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc258 expref: 1833 pid: 80277 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.430347:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8a0b704 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.430348:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000094a0ec28/0x3234de053c4b522 lrc: 4/0,0 mode: PR/PR res: [0x2b41c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc258 expref: 1833 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.430353:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210734 00000100:00100000:0.0:1651529344.430353:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996953664:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.430355:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+228:39030:x1731745946352256:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.430359:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177182 count 1 00010000:00010000:1.0:1651529344.430362:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c4fe6a lrc: 3/0,1 mode: --/PW res: [0x2b41e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.430362:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 0000000094c2f645 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.430366:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000021901d62/0x3234de053c4ec5e lrc: 2/0,0 mode: PR/PR res: [0x2b41e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d632e expref: 1833 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.430369:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.430370:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.430371:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c4fe6a lrc: 4/0,1 mode: --/PW res: [0x2b41e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.430376:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000021901d62/0x3234de053c4ec5e lrc: 3/0,0 mode: PR/PR res: [0x2b41e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d632e expref: 1833 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.430380:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000021901d62/0x3234de053c4ec5e lrc: 4/0,0 mode: PR/PR res: [0x2b41e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d632e expref: 1833 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.430383:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000703c0db9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996953728:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.430390:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 000000004698fefb going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.430458:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.430474:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.430481:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.430490:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.430491:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946352896 00000100:00100000:1.0:1651529344.430498:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.430508:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946353024 00000100:00100000:0.0:1651529344.430513:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946352832 00000100:00100000:1.0:1651529344.430514:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946352960 00000100:00100000:0.0:1651529344.430516:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946353088 00000100:00100000:1.0:1651529344.430525:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210735 00000100:00100000:1.0:1651529344.430527:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+233:39030:x1731745946352896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.430530:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210736 00000100:00100000:0.0:1651529344.430531:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+233:39030:x1731745946353024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.430532:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177184 count 1 00010000:00010000:1.0:1651529344.430536:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000674569e9/0x3234de053c4fe71 lrc: 3/0,1 mode: --/PW res: [0x2b420:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.430537:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177186 count 1 00010000:00010000:1.0:1651529344.430540:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c4f429 lrc: 2/0,0 mode: PR/PR res: [0x2b420:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8380 expref: 1833 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.430541:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eebe983a/0x3234de053c4fe78 lrc: 3/0,1 mode: --/PW res: [0x2b422:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.430543:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.430544:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.430545:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000674569e9/0x3234de053c4fe71 lrc: 4/0,1 mode: --/PW res: [0x2b420:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.430546:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c4ae14 lrc: 2/0,0 mode: PR/PR res: [0x2b422:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf25 expref: 1833 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.430549:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.430550:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.430550:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eebe983a/0x3234de053c4fe78 lrc: 4/0,1 mode: --/PW res: [0x2b422:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.430551:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c4f429 lrc: 3/0,0 mode: PR/PR res: [0x2b420:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8380 expref: 1833 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.430554:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c4f429 lrc: 4/0,0 mode: PR/PR res: [0x2b420:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8380 expref: 1833 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.430557:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c4ae14 lrc: 3/0,0 mode: PR/PR res: [0x2b422:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf25 expref: 1833 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.430558:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a573b31 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996953792:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.430560:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c4ae14 lrc: 4/0,0 mode: PR/PR res: [0x2b422:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf25 expref: 1833 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.430564:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996953856:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.430568:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.430573:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000124f6b49 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.430574:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210737 00000100:00100000:1.0:1651529344.430576:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005914c920 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+233:39030:x1731745946352832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.430580:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177183 count 1 00000100:00100000:0.0:1651529344.430580:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210738 00000100:00100000:0.0:1651529344.430582:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfc79d4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+233:39030:x1731745946352960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.430583:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b3a47ca/0x3234de053c4fe7f lrc: 3/0,1 mode: --/PW res: [0x2b41f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.430586:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177185 count 1 00010000:00010000:1.0:1651529344.430588:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d501883f/0x3234de053c4ef60 lrc: 2/0,0 mode: PR/PR res: [0x2b41f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f60 expref: 1833 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.430589:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070dd06bd/0x3234de053c4fe86 lrc: 3/0,1 mode: --/PW res: [0x2b421:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.430591:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.430591:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.430592:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b3a47ca/0x3234de053c4fe7f lrc: 4/0,1 mode: --/PW res: [0x2b41f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.430595:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006fa3afd1/0x3234de053c4e477 lrc: 2/0,0 mode: PR/PR res: [0x2b421:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42ff expref: 1833 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.430598:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d501883f/0x3234de053c4ef60 lrc: 3/0,0 mode: PR/PR res: [0x2b41f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f60 expref: 1833 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.430598:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.430599:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.430600:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070dd06bd/0x3234de053c4fe86 lrc: 4/0,1 mode: --/PW res: [0x2b421:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.430601:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d501883f/0x3234de053c4ef60 lrc: 4/0,0 mode: PR/PR res: [0x2b41f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f60 expref: 1833 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.430605:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000974b675b pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996953920:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.430605:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006fa3afd1/0x3234de053c4e477 lrc: 3/0,0 mode: PR/PR res: [0x2b421:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42ff expref: 1833 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.430609:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006fa3afd1/0x3234de053c4e477 lrc: 4/0,0 mode: PR/PR res: [0x2b421:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42ff expref: 1833 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.430611:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c3caa148 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.430613:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996953984:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.430617:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210739 00000100:00100000:1.0:1651529344.430618:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+233:39030:x1731745946353088:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.430619:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000efb6ae52 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.430623:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177187 count 1 00010000:00010000:1.0:1651529344.430626:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000349fa4b1/0x3234de053c4fe8d lrc: 3/0,1 mode: --/PW res: [0x2b423:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.430630:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fde56444/0x3234de053c4e75d lrc: 2/0,0 mode: PR/PR res: [0x2b423:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e58 expref: 1833 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.430636:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.430636:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.430637:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000349fa4b1/0x3234de053c4fe8d lrc: 4/0,1 mode: --/PW res: [0x2b423:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.430643:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fde56444/0x3234de053c4e75d lrc: 3/0,0 mode: PR/PR res: [0x2b423:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e58 expref: 1833 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.430646:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fde56444/0x3234de053c4e75d lrc: 4/0,0 mode: PR/PR res: [0x2b423:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e58 expref: 1833 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.430657:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000824ca843 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996954048:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.430664:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000567ee0ef going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.430717:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996953664:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.430721:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c4fe5c lrc: 3/0,1 mode: --/PW res: [0x2b41c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.430725:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.430744:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396233216 00010000:00010000:0.0:1651529344.430749:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c4d25d lrc: 5/0,0 mode: PR/PR res: [0x2b41d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfaeb expref: 1834 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.430757:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11514 00000100:00100000:0.0:1651529344.430759:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1834:41279:x1731746396233216:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.430761:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.430763:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.430763:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c4d25d lrc: 5/0,0 mode: PR/PR res: [0x2b41d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfaeb expref: 1834 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.430767:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c4d25d lrc: 4/0,0 mode: PR/PR res: [0x2b41d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfaeb expref: 1834 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.430772:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.430773:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.430774:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f6711731/0x3234de053c4fe63 lrc: 3/0,1 mode: PW/PW res: [0x2b41d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.430776:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6711731/0x3234de053c4fe63 lrc: 4/0,1 mode: PW/PW res: [0x2b41d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.430781:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.430788:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1834:41279:x1731746396233216:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 29us (64us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.430791:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11514 00000100:00100000:1.0:1651529344.430793:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.430804:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396233344 00010000:00010000:0.0:1651529344.430807:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000021901d62/0x3234de053c4ec5e lrc: 5/0,0 mode: PR/PR res: [0x2b41e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d632e expref: 1834 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.430812:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11515 00000100:00100000:0.0:1651529344.430814:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1834:41279:x1731746396233344:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.430816:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.430817:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000021901d62/0x3234de053c4ec5e lrc: 5/0,0 mode: PR/PR res: [0x2b41e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d632e expref: 1834 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.430825:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000703c0db9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996953728:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.430835:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000021901d62/0x3234de053c4ec5e lrc: 4/0,0 mode: PR/PR res: [0x2b41e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d632e expref: 1834 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.430839:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c4fe6a lrc: 3/0,1 mode: --/PW res: [0x2b41e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.430841:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021901d62/0x3234de053c4ec5e lrc: 0/0,0 mode: --/PR res: [0x2b41e:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d632e expref: 1834 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.430845:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.430846:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.430847:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c4fe6a lrc: 3/0,1 mode: PW/PW res: [0x2b41e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.430848:0:72396:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c4d25d lrc: 0/0,0 mode: --/PR res: [0x2b41d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfaeb expref: 1833 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.430850:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c4fe6a lrc: 4/0,1 mode: PW/PW res: [0x2b41e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.430852:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007ac35c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996953600:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.430854:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f6711731/0x3234de053c4fe63 lrc: 3/0,1 mode: PW/PW res: [0x2b41d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.430860:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.430862:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f6711731/0x3234de053c4fe63 lrc: 3/0,1 mode: PW/PW res: [0x2b41d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.430866:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6711731/0x3234de053c4fe63 lrc: 3/0,1 mode: PW/PW res: [0x2b41d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.430870:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1832:41279:x1731746396233344:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 55us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.430873:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11515 00000100:00100000:0.0:1651529344.430877:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396233280 00010000:00010000:1.0:1651529344.430878:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6711731/0x3234de053c4fe63 lrc: 3/0,1 mode: PW/PW res: [0x2b41d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.430881:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6711731/0x3234de053c4fe63 lrc: 2/0,0 mode: PW/PW res: [0x2b41d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.430881:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000094a0ec28/0x3234de053c4b522 lrc: 4/0,0 mode: PR/PR res: [0x2b41c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc258 expref: 1832 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.430886:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11516 00000100:00100000:0.0:1651529344.430893:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1832:41278:x1731746396233280:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.430896:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.430897:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000094a0ec28/0x3234de053c4b522 lrc: 4/0,0 mode: PR/PR res: [0x2b41c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc258 expref: 1832 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.430901:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000094a0ec28/0x3234de053c4b522 lrc: 3/0,0 mode: PR/PR res: [0x2b41c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc258 expref: 1832 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.430906:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094a0ec28/0x3234de053c4b522 lrc: 0/0,0 mode: --/PR res: [0x2b41c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc258 expref: 1832 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.430910:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.430910:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.430911:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c4fe5c lrc: 3/0,1 mode: PW/PW res: [0x2b41c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.430914:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c4fe5c lrc: 4/0,1 mode: PW/PW res: [0x2b41c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.430920:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.430924:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+234:39030:x1731745946352192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 621us (730us total) trans 12885078787 rc 0/0 00000100:00100000:0.0:1651529344.430925:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1831:41278:x1731746396233280:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.430927:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210733 00000100:00100000:0.0:1651529344.430928:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11516 00010000:00010000:1.0:1651529344.430934:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c4fe6a lrc: 3/0,1 mode: PW/PW res: [0x2b41e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.430934:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6711731/0x3234de053c4fe63 lrc: 2/0,0 mode: PW/PW res: [0x2b41d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.430937:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c4fe6a lrc: 3/0,1 mode: PW/PW res: [0x2b41e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.430937:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f6711731 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.430938:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6711731/0x3234de053c4fe63 lrc: 2/0,0 mode: PW/PW res: [0x2b41d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.430941:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c4fe6a lrc: 3/0,1 mode: PW/PW res: [0x2b41e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.430941:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6711731/0x3234de053c4fe63 lrc: 3/0,0 mode: PW/PW res: [0x2b41d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.430943:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c4fe6a lrc: 2/0,0 mode: PW/PW res: [0x2b41e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.430945:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6711731/0x3234de053c4fe63 lrc: 1/0,0 mode: --/PW res: [0x2b41d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.430947:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6711731/0x3234de053c4fe63 lrc: 0/0,0 mode: --/PW res: [0x2b41d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.430951:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c4fe6a lrc: 3/0,0 mode: PW/PW res: [0x2b41e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.430960:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000576f1f12 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.430961:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c4fe6a lrc: 2/0,0 mode: PW/PW res: [0x2b41e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.430964:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c4fe6a lrc: 3/0,0 mode: PW/PW res: [0x2b41e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.430982:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c4fe6a lrc: 1/0,0 mode: --/PW res: [0x2b41e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.430983:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+234:39030:x1731745946352256:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 627us (778us total) trans 12885078788 rc 0/0 00010000:00010000:0.0:1651529344.430985:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c4fe6a lrc: 0/0,0 mode: --/PW res: [0x2b41e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.430986:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210734 00010000:00010000:0.0:1651529344.430992:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c4fe5c lrc: 3/0,1 mode: PW/PW res: [0x2b41c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.430995:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c4fe5c lrc: 3/0,1 mode: PW/PW res: [0x2b41c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431001:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c4fe5c lrc: 3/0,1 mode: PW/PW res: [0x2b41c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431004:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c4fe5c lrc: 2/0,0 mode: PW/PW res: [0x2b41c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.431066:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+234:39030:x1731745946352128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 764us (886us total) trans 12885078789 rc 0/0 00000100:00100000:0.0:1651529344.431069:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210732 00000100:00100000:1.0:1651529344.431073:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a573b31 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996953792:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.431078:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000674569e9/0x3234de053c4fe71 lrc: 3/0,1 mode: --/PW res: [0x2b420:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431092:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c4fe5c lrc: 2/0,0 mode: PW/PW res: [0x2b41c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431095:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003266b888 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.431096:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c4fe5c lrc: 2/0,0 mode: PW/PW res: [0x2b41c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431099:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c4fe5c lrc: 3/0,0 mode: PW/PW res: [0x2b41c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431104:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c4fe5c lrc: 1/0,0 mode: --/PW res: [0x2b41c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431107:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c4fe5c lrc: 0/0,0 mode: --/PW res: [0x2b41c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.431119:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996953856:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.431123:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eebe983a/0x3234de053c4fe78 lrc: 3/0,1 mode: --/PW res: [0x2b422:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.431134:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000974b675b pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996953920:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.431138:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000b3a47ca/0x3234de053c4fe7f lrc: 3/0,1 mode: --/PW res: [0x2b41f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.431165:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996953984:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.431169:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000070dd06bd/0x3234de053c4fe86 lrc: 3/0,1 mode: --/PW res: [0x2b421:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.431202:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.431243:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946353152 00000100:00100000:1.0:1651529344.431249:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.431258:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946353216 00000100:00100000:0.0:1651529344.431265:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210740 00000100:00100000:0.0:1651529344.431267:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+235:39030:x1731745946353152:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.431270:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210741 00000100:00100000:1.0:1651529344.431272:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+235:39030:x1731745946353216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.431272:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177188 count 1 00002000:00080000:1.0:1651529344.431278:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177189 count 1 00010000:00010000:1.0:1651529344.431282:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008407968/0x3234de053c4fe94 lrc: 3/0,1 mode: --/PW res: [0x2b425:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431293:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c4def8 lrc: 2/0,0 mode: PR/PR res: [0x2b425:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d11 expref: 1830 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.431293:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c4fe9b lrc: 3/0,1 mode: --/PW res: [0x2b424:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431296:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.431296:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.431297:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008407968/0x3234de053c4fe94 lrc: 4/0,1 mode: --/PW res: [0x2b425:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431298:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c4cd86 lrc: 2/0,0 mode: PR/PR res: [0x2b424:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce806 expref: 1830 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.431301:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.431301:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.431302:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c4fe9b lrc: 4/0,1 mode: --/PW res: [0x2b424:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431304:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c4def8 lrc: 3/0,0 mode: PR/PR res: [0x2b425:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d11 expref: 1830 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.431308:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c4def8 lrc: 4/0,0 mode: PR/PR res: [0x2b425:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d11 expref: 1830 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.431309:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c4cd86 lrc: 3/0,0 mode: PR/PR res: [0x2b424:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce806 expref: 1830 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.431312:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ebb53b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996954112:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.431313:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c4cd86 lrc: 4/0,0 mode: PR/PR res: [0x2b424:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce806 expref: 1830 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.431317:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996954176:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.431322:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c3caa148 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.431327:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 0000000094c2f645 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.431336:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.431371:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946353280 00000100:00100000:1.0:1651529344.431379:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210742 00000100:00100000:1.0:1651529344.431380:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+236:39030:x1731745946353280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.431385:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177190 count 1 00010000:00010000:1.0:1651529344.431395:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b6258e0/0x3234de053c4fea2 lrc: 3/0,1 mode: --/PW res: [0x2b426:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431400:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e445b065/0x3234de053c4a06f lrc: 2/0,0 mode: PR/PR res: [0x2b426:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb784 expref: 1830 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.431403:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.431404:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.431405:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b6258e0/0x3234de053c4fea2 lrc: 4/0,1 mode: --/PW res: [0x2b426:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431411:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e445b065/0x3234de053c4a06f lrc: 3/0,0 mode: PR/PR res: [0x2b426:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb784 expref: 1830 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.431415:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e445b065/0x3234de053c4a06f lrc: 4/0,0 mode: PR/PR res: [0x2b426:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb784 expref: 1830 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.431419:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000703c0db9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996954240:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.431427:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000412e5d26 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.431486:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.431497:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.431497:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396233600 00000100:00100000:1.0:1651529344.431506:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.431507:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c4f429 lrc: 4/0,0 mode: PR/PR res: [0x2b420:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8380 expref: 1831 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.431513:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.431515:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396233728 00000100:00100000:1.0:1651529344.431518:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.431518:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c4ae14 lrc: 4/0,0 mode: PR/PR res: [0x2b422:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf25 expref: 1832 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.431522:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396233856 00000100:00100000:1.0:1651529344.431525:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000824ca843 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996954048:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.431525:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d501883f/0x3234de053c4ef60 lrc: 4/0,0 mode: PR/PR res: [0x2b41f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f60 expref: 1833 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.431529:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000349fa4b1/0x3234de053c4fe8d lrc: 3/0,1 mode: --/PW res: [0x2b423:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.431529:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396233984 00010000:00010000:0.0:1651529344.431531:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006fa3afd1/0x3234de053c4e477 lrc: 4/0,0 mode: PR/PR res: [0x2b421:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42ff expref: 1834 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.431535:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396234176 00000100:00100000:1.0:1651529344.431537:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11517 00010000:00010000:0.0:1651529344.431537:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fde56444/0x3234de053c4e75d lrc: 4/0,0 mode: PR/PR res: [0x2b423:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e58 expref: 1835 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.431539:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1835:41279:x1731746396233600:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.431542:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.431542:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11518 00000100:00100000:0.0:1651529344.431543:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d036941 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1835:41279:x1731746396233728:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.431544:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c4f429 lrc: 4/0,0 mode: PR/PR res: [0x2b420:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8380 expref: 1835 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.431546:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.431548:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c4f429 lrc: 3/0,0 mode: PR/PR res: [0x2b420:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8380 expref: 1835 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.431548:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c4ae14 lrc: 4/0,0 mode: PR/PR res: [0x2b422:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf25 expref: 1835 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.431551:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c4ae14 lrc: 3/0,0 mode: PR/PR res: [0x2b422:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf25 expref: 1835 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.431554:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c4f429 lrc: 0/0,0 mode: --/PR res: [0x2b420:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8380 expref: 1835 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.431557:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.431557:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c4ae14 lrc: 0/0,0 mode: --/PR res: [0x2b422:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf25 expref: 1835 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.431558:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.431559:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000674569e9/0x3234de053c4fe71 lrc: 3/0,1 mode: PW/PW res: [0x2b420:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431560:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.431561:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.431562:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000674569e9/0x3234de053c4fe71 lrc: 4/0,1 mode: PW/PW res: [0x2b420:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431562:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eebe983a/0x3234de053c4fe78 lrc: 3/0,1 mode: PW/PW res: [0x2b422:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431565:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eebe983a/0x3234de053c4fe78 lrc: 4/0,1 mode: PW/PW res: [0x2b422:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431568:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.431571:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.431575:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1833:41279:x1731746396233600:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.431578:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11517 00000100:00100000:0.0:1651529344.431578:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d036941 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1833:41279:x1731746396233728:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.431581:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11518 00000100:00100000:1.0:1651529344.431584:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11519 00000100:00100000:1.0:1651529344.431585:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1831:41279:x1731746396233856:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.431588:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.431589:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d501883f/0x3234de053c4ef60 lrc: 4/0,0 mode: PR/PR res: [0x2b41f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f60 expref: 1831 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.431590:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11520 00000100:00100000:0.0:1651529344.431592:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1831:41279:x1731746396233984:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.431593:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d501883f/0x3234de053c4ef60 lrc: 3/0,0 mode: PR/PR res: [0x2b41f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f60 expref: 1831 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.431594:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.431596:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006fa3afd1/0x3234de053c4e477 lrc: 4/0,0 mode: PR/PR res: [0x2b421:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42ff expref: 1831 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.431598:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d501883f/0x3234de053c4ef60 lrc: 0/0,0 mode: --/PR res: [0x2b41f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f60 expref: 1831 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.431599:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006fa3afd1/0x3234de053c4e477 lrc: 3/0,0 mode: PR/PR res: [0x2b421:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42ff expref: 1831 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.431601:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.431601:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.431602:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000b3a47ca/0x3234de053c4fe7f lrc: 3/0,1 mode: PW/PW res: [0x2b41f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431605:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b3a47ca/0x3234de053c4fe7f lrc: 4/0,1 mode: PW/PW res: [0x2b41f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431610:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.431615:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1830:41279:x1731746396233856:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 29us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.431617:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11519 00000100:00100000:1.0:1651529344.431621:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11521 00000100:00100000:1.0:1651529344.431622:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1829:41278:x1731746396234176:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.431625:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.431626:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fde56444/0x3234de053c4e75d lrc: 4/0,0 mode: PR/PR res: [0x2b423:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e58 expref: 1829 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.431631:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006fa3afd1/0x3234de053c4e477 lrc: 0/0,0 mode: --/PR res: [0x2b421:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42ff expref: 1829 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.431636:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.431636:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.431637:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000070dd06bd/0x3234de053c4fe86 lrc: 3/0,1 mode: PW/PW res: [0x2b421:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431638:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fde56444/0x3234de053c4e75d lrc: 3/0,0 mode: PR/PR res: [0x2b423:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e58 expref: 1829 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.431640:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070dd06bd/0x3234de053c4fe86 lrc: 4/0,1 mode: PW/PW res: [0x2b421:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431644:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fde56444/0x3234de053c4e75d lrc: 0/0,0 mode: --/PR res: [0x2b423:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e58 expref: 1828 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.431647:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.431648:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.431648:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.431649:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000349fa4b1/0x3234de053c4fe8d lrc: 3/0,1 mode: PW/PW res: [0x2b423:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431654:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000349fa4b1/0x3234de053c4fe8d lrc: 4/0,1 mode: PW/PW res: [0x2b423:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.431655:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1827:41279:x1731746396233984:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 62us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.431658:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11520 00010000:00010000:1.0:1651529344.431660:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.431664:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000070dd06bd/0x3234de053c4fe86 lrc: 3/0,1 mode: PW/PW res: [0x2b421:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.431666:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1826:41278:x1731746396234176:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 43us (148us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.431668:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070dd06bd/0x3234de053c4fe86 lrc: 3/0,1 mode: PW/PW res: [0x2b421:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.431669:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11521 00010000:00010000:0.0:1651529344.431671:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070dd06bd/0x3234de053c4fe86 lrc: 3/0,1 mode: PW/PW res: [0x2b421:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431673:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070dd06bd/0x3234de053c4fe86 lrc: 2/0,0 mode: PW/PW res: [0x2b421:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431675:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000674569e9/0x3234de053c4fe71 lrc: 3/0,1 mode: PW/PW res: [0x2b420:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431678:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000674569e9/0x3234de053c4fe71 lrc: 3/0,1 mode: PW/PW res: [0x2b420:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431681:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000674569e9/0x3234de053c4fe71 lrc: 3/0,1 mode: PW/PW res: [0x2b420:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431684:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000674569e9/0x3234de053c4fe71 lrc: 2/0,0 mode: PW/PW res: [0x2b420:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.431727:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+238:39030:x1731745946352896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1200us (1269us total) trans 12885078790 rc 0/0 00000100:00100000:1.0:1651529344.431730:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210735 00000100:00100000:0.0:1651529344.431744:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfc79d4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+237:39030:x1731745946352960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1152us (1244us total) trans 12885078791 rc 0/0 00010000:00010000:1.0:1651529344.431746:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000b3a47ca/0x3234de053c4fe7f lrc: 3/0,1 mode: PW/PW res: [0x2b41f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.431748:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210738 00010000:00010000:1.0:1651529344.431749:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b3a47ca/0x3234de053c4fe7f lrc: 3/0,1 mode: PW/PW res: [0x2b41f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431753:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b3a47ca/0x3234de053c4fe7f lrc: 3/0,1 mode: PW/PW res: [0x2b41f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431755:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b3a47ca/0x3234de053c4fe7f lrc: 2/0,0 mode: PW/PW res: [0x2b41f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431756:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070dd06bd/0x3234de053c4fe86 lrc: 2/0,0 mode: PW/PW res: [0x2b421:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431760:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000070dd06bd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.431761:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070dd06bd/0x3234de053c4fe86 lrc: 2/0,0 mode: PW/PW res: [0x2b421:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431775:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070dd06bd/0x3234de053c4fe86 lrc: 3/0,0 mode: PW/PW res: [0x2b421:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431780:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070dd06bd/0x3234de053c4fe86 lrc: 1/0,0 mode: --/PW res: [0x2b421:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431782:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070dd06bd/0x3234de053c4fe86 lrc: 0/0,0 mode: --/PW res: [0x2b421:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431787:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000674569e9/0x3234de053c4fe71 lrc: 2/0,0 mode: PW/PW res: [0x2b420:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431790:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000674569e9 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.431791:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000674569e9/0x3234de053c4fe71 lrc: 2/0,0 mode: PW/PW res: [0x2b420:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.431793:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005914c920 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+237:39030:x1731745946352832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1216us (1311us total) trans 12885078792 rc 0/0 00000100:00100000:1.0:1651529344.431795:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210737 00010000:00010000:0.0:1651529344.431796:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000674569e9/0x3234de053c4fe71 lrc: 3/0,0 mode: PW/PW res: [0x2b420:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431800:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000674569e9/0x3234de053c4fe71 lrc: 1/0,0 mode: --/PW res: [0x2b420:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431802:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000349fa4b1/0x3234de053c4fe8d lrc: 3/0,1 mode: PW/PW res: [0x2b423:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431802:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000674569e9/0x3234de053c4fe71 lrc: 0/0,0 mode: --/PW res: [0x2b420:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431805:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000349fa4b1/0x3234de053c4fe8d lrc: 3/0,1 mode: PW/PW res: [0x2b423:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431806:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b3a47ca/0x3234de053c4fe7f lrc: 2/0,0 mode: PW/PW res: [0x2b41f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431808:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000349fa4b1/0x3234de053c4fe8d lrc: 3/0,1 mode: PW/PW res: [0x2b423:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431808:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000b3a47ca already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.431809:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b3a47ca/0x3234de053c4fe7f lrc: 2/0,0 mode: PW/PW res: [0x2b41f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.431811:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000349fa4b1/0x3234de053c4fe8d lrc: 2/0,0 mode: PW/PW res: [0x2b423:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431811:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b3a47ca/0x3234de053c4fe7f lrc: 3/0,0 mode: PW/PW res: [0x2b41f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431815:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b3a47ca/0x3234de053c4fe7f lrc: 1/0,0 mode: --/PW res: [0x2b41f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431817:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b3a47ca/0x3234de053c4fe7f lrc: 0/0,0 mode: --/PW res: [0x2b41f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431820:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000349fa4b1/0x3234de053c4fe8d lrc: 2/0,0 mode: PW/PW res: [0x2b423:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431825:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000349fa4b1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.431826:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000349fa4b1/0x3234de053c4fe8d lrc: 2/0,0 mode: PW/PW res: [0x2b423:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431829:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000349fa4b1/0x3234de053c4fe8d lrc: 3/0,0 mode: PW/PW res: [0x2b423:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431832:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000349fa4b1/0x3234de053c4fe8d lrc: 1/0,0 mode: --/PW res: [0x2b423:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431834:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000349fa4b1/0x3234de053c4fe8d lrc: 0/0,0 mode: --/PW res: [0x2b423:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.431841:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+237:39030:x1731745946353088:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1222us (1343us total) trans 12885078793 rc 0/0 00010000:00010000:0.0:1651529344.431842:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eebe983a/0x3234de053c4fe78 lrc: 3/0,1 mode: PW/PW res: [0x2b422:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.431844:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210739 00010000:00010000:0.0:1651529344.431845:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eebe983a/0x3234de053c4fe78 lrc: 3/0,1 mode: PW/PW res: [0x2b422:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431848:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eebe983a/0x3234de053c4fe78 lrc: 3/0,1 mode: PW/PW res: [0x2b422:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431851:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eebe983a/0x3234de053c4fe78 lrc: 2/0,0 mode: PW/PW res: [0x2b422:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.431880:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.431892:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.431905:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+237:39030:x1731745946353024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1373us (1431us total) trans 12885078794 rc 0/0 00000100:00100000:0.0:1651529344.431909:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210736 00010000:00010000:0.0:1651529344.431916:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eebe983a/0x3234de053c4fe78 lrc: 2/0,0 mode: PW/PW res: [0x2b422:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431919:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eebe983a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.431920:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eebe983a/0x3234de053c4fe78 lrc: 2/0,0 mode: PW/PW res: [0x2b422:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431923:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eebe983a/0x3234de053c4fe78 lrc: 3/0,0 mode: PW/PW res: [0x2b422:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.431925:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.431927:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eebe983a/0x3234de053c4fe78 lrc: 1/0,0 mode: --/PW res: [0x2b422:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431930:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eebe983a/0x3234de053c4fe78 lrc: 0/0,0 mode: --/PW res: [0x2b422:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.431938:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396234240 00010000:00010000:0.0:1651529344.431942:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c4def8 lrc: 5/0,0 mode: PR/PR res: [0x2b425:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d11 expref: 1826 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.431948:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396234304 00010000:00010000:0.0:1651529344.431950:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c4cd86 lrc: 5/0,0 mode: PR/PR res: [0x2b424:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce806 expref: 1827 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.431955:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396234368 00010000:00010000:0.0:1651529344.431957:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e445b065/0x3234de053c4a06f lrc: 5/0,0 mode: PR/PR res: [0x2b426:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb784 expref: 1828 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.431962:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11522 00000100:00100000:0.0:1651529344.431964:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1828:41278:x1731746396234240:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.431966:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.431967:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c4def8 lrc: 5/0,0 mode: PR/PR res: [0x2b425:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d11 expref: 1828 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.431971:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c4def8 lrc: 4/0,0 mode: PR/PR res: [0x2b425:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d11 expref: 1828 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.431976:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.431976:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.431977:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000008407968/0x3234de053c4fe94 lrc: 3/0,1 mode: PW/PW res: [0x2b425:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431980:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008407968/0x3234de053c4fe94 lrc: 4/0,1 mode: PW/PW res: [0x2b425:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.431985:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.431990:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1828:41278:x1731746396234240:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 26us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.431993:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11522 00000100:00100000:0.0:1651529344.431996:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11523 00000100:00100000:0.0:1651529344.431998:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1827:41279:x1731746396234304:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.432000:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.432001:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c4cd86 lrc: 5/0,0 mode: PR/PR res: [0x2b424:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce806 expref: 1827 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.432005:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c4cd86 lrc: 4/0,0 mode: PR/PR res: [0x2b424:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce806 expref: 1827 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.432009:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.432010:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.432010:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c4fe9b lrc: 3/0,1 mode: PW/PW res: [0x2b424:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432013:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c4fe9b lrc: 4/0,1 mode: PW/PW res: [0x2b424:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.432030:0:80278:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c4def8 lrc: 0/0,0 mode: --/PR res: [0x2b425:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d11 expref: 1827 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.432034:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ebb53b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996954112:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.432038:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000008407968/0x3234de053c4fe94 lrc: 3/0,1 mode: PW/PW res: [0x2b425:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432038:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.432042:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000008407968/0x3234de053c4fe94 lrc: 3/0,1 mode: PW/PW res: [0x2b425:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.432044:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008407968/0x3234de053c4fe94 lrc: 3/0,1 mode: PW/PW res: [0x2b425:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.432051:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1826:41279:x1731746396234304:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 52us (158us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.432052:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008407968/0x3234de053c4fe94 lrc: 3/0,1 mode: PW/PW res: [0x2b425:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.432054:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11523 00010000:00010000:1.0:1651529344.432055:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008407968/0x3234de053c4fe94 lrc: 2/0,0 mode: PW/PW res: [0x2b425:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.432059:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11524 00000100:00100000:0.0:1651529344.432060:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1825:41279:x1731746396234368:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.432068:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.432070:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e445b065/0x3234de053c4a06f lrc: 5/0,0 mode: PR/PR res: [0x2b426:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb784 expref: 1825 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.432074:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e445b065/0x3234de053c4a06f lrc: 4/0,0 mode: PR/PR res: [0x2b426:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb784 expref: 1825 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.432079:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.432080:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.432081:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001b6258e0/0x3234de053c4fea2 lrc: 3/0,1 mode: PW/PW res: [0x2b426:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432084:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b6258e0/0x3234de053c4fea2 lrc: 4/0,1 mode: PW/PW res: [0x2b426:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432088:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.432093:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1825:41279:x1731746396234368:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 32us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.432095:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11524 00000100:00100000:1.0:1651529344.432096:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+237:39030:x1731745946353216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 823us (848us total) trans 12885078795 rc 0/0 00000100:00100000:1.0:1651529344.432099:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210741 00010000:00010000:0.0:1651529344.432101:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008407968/0x3234de053c4fe94 lrc: 2/0,0 mode: PW/PW res: [0x2b425:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432104:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000008407968 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.432105:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008407968/0x3234de053c4fe94 lrc: 2/0,0 mode: PW/PW res: [0x2b425:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432108:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008407968/0x3234de053c4fe94 lrc: 3/0,0 mode: PW/PW res: [0x2b425:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.432110:0:80279:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e445b065/0x3234de053c4a06f lrc: 0/0,0 mode: --/PR res: [0x2b426:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb784 expref: 1824 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.432112:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008407968/0x3234de053c4fe94 lrc: 1/0,0 mode: --/PW res: [0x2b425:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.432114:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000703c0db9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996954240:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.432114:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008407968/0x3234de053c4fe94 lrc: 0/0,0 mode: --/PW res: [0x2b425:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.432118:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001b6258e0/0x3234de053c4fea2 lrc: 3/0,1 mode: PW/PW res: [0x2b426:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.432121:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001b6258e0/0x3234de053c4fea2 lrc: 3/0,1 mode: PW/PW res: [0x2b426:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432123:0:156655:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c4cd86 lrc: 0/0,0 mode: --/PR res: [0x2b424:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce806 expref: 1823 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.432124:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b6258e0/0x3234de053c4fea2 lrc: 3/0,1 mode: PW/PW res: [0x2b426:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.432127:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b6258e0/0x3234de053c4fea2 lrc: 3/0,1 mode: PW/PW res: [0x2b426:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.432129:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b6258e0/0x3234de053c4fea2 lrc: 2/0,0 mode: PW/PW res: [0x2b426:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.432130:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996954176:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.432133:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c4fe9b lrc: 3/0,1 mode: PW/PW res: [0x2b424:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432143:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c4fe9b lrc: 3/0,1 mode: PW/PW res: [0x2b424:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432146:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c4fe9b lrc: 3/0,1 mode: PW/PW res: [0x2b424:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432149:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c4fe9b lrc: 3/0,1 mode: PW/PW res: [0x2b424:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432152:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c4fe9b lrc: 2/0,0 mode: PW/PW res: [0x2b424:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.432166:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+237:39030:x1731745946353280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 785us (830us total) trans 12885078796 rc 0/0 00000100:00100000:1.0:1651529344.432169:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210742 00000100:00100000:1.0:1651529344.432189:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.432216:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+237:39030:x1731745946353152:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 948us (1014us total) trans 12885078797 rc 0/0 00000100:00100000:0.0:1651529344.432219:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210740 00000100:00100000:1.0:1651529344.432236:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.432243:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946353664 00000100:00100000:0.0:1651529344.432249:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946353792 00000100:00100000:0.0:1651529344.432257:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210743 00000100:00100000:0.0:1651529344.432258:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+238:39030:x1731745946353664:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.432263:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177192 count 1 00010000:00010000:0.0:1651529344.432268:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7f046d7/0x3234de053c4fea9 lrc: 3/0,1 mode: --/PW res: [0x2b428:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432290:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c4ebe7 lrc: 2/0,0 mode: PR/PR res: [0x2b428:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6113 expref: 1822 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.432293:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.432294:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.432294:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7f046d7/0x3234de053c4fea9 lrc: 4/0,1 mode: --/PW res: [0x2b428:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.432296:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210744 00000100:00100000:1.0:1651529344.432298:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+238:39030:x1731745946353792:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.432302:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c4ebe7 lrc: 3/0,0 mode: PR/PR res: [0x2b428:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6113 expref: 1822 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.432304:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177194 count 1 00010000:00010000:0.0:1651529344.432306:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c4ebe7 lrc: 4/0,0 mode: PR/PR res: [0x2b428:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6113 expref: 1822 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.432308:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1cdb9b9/0x3234de053c4feb0 lrc: 3/0,1 mode: --/PW res: [0x2b42a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.432313:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f545d586/0x3234de053c4d8ae lrc: 2/0,0 mode: PR/PR res: [0x2b42a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1395 expref: 1822 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.432317:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.432317:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.432318:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1cdb9b9/0x3234de053c4feb0 lrc: 4/0,1 mode: --/PW res: [0x2b42a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.432325:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f545d586/0x3234de053c4d8ae lrc: 3/0,0 mode: PR/PR res: [0x2b42a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1395 expref: 1822 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.432328:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f545d586/0x3234de053c4d8ae lrc: 4/0,0 mode: PR/PR res: [0x2b42a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1395 expref: 1822 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.432330:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996954304:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.432332:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d523a75 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996954368:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.432340:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b032d2f9 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.432342:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.432348:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b6258e0/0x3234de053c4fea2 lrc: 2/0,0 mode: PW/PW res: [0x2b426:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432351:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001b6258e0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.432352:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b6258e0/0x3234de053c4fea2 lrc: 2/0,0 mode: PW/PW res: [0x2b426:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432355:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b6258e0/0x3234de053c4fea2 lrc: 3/0,0 mode: PW/PW res: [0x2b426:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432360:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b6258e0/0x3234de053c4fea2 lrc: 1/0,0 mode: --/PW res: [0x2b426:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432363:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b6258e0/0x3234de053c4fea2 lrc: 0/0,0 mode: --/PW res: [0x2b426:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432367:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c4fe9b lrc: 2/0,0 mode: PW/PW res: [0x2b424:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432370:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000064bf7951 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.432370:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c4fe9b lrc: 2/0,0 mode: PW/PW res: [0x2b424:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432373:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c4fe9b lrc: 3/0,0 mode: PW/PW res: [0x2b424:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.432376:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.432376:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c4fe9b lrc: 1/0,0 mode: --/PW res: [0x2b424:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432379:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c4fe9b lrc: 0/0,0 mode: --/PW res: [0x2b424:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.432388:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946353600 00000100:00100000:1.0:1651529344.432390:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.432400:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946353728 00000100:00100000:0.0:1651529344.432405:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210745 00000100:00100000:0.0:1651529344.432407:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+240:39030:x1731745946353600:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.432412:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177191 count 1 00000100:00100000:1.0:1651529344.432423:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.432439:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006769cf41/0x3234de053c4feb7 lrc: 3/0,1 mode: --/PW res: [0x2b427:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.432442:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.432446:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c4ce74 lrc: 2/0,0 mode: PR/PR res: [0x2b427:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cebf6 expref: 1822 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.432450:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.432450:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.432451:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006769cf41/0x3234de053c4feb7 lrc: 4/0,1 mode: --/PW res: [0x2b427:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.432455:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.432458:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c4ce74 lrc: 3/0,0 mode: PR/PR res: [0x2b427:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cebf6 expref: 1822 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.432465:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.432468:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c4ce74 lrc: 4/0,0 mode: PR/PR res: [0x2b427:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cebf6 expref: 1822 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.432474:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946353856 00000100:00100000:0.0:1651529344.432476:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996954432:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.432483:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946354176 00000100:00100000:1.0:1651529344.432485:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946354304 00000100:00100000:1.0:1651529344.432488:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946354240 00000100:00100000:1.0:1651529344.432491:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210746 00000100:00100000:1.0:1651529344.432492:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+244:39030:x1731745946353728:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.432495:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 000000007b78c9d8 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.432502:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210747 00002000:00080000:1.0:1651529344.432503:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177193 count 1 00000100:00100000:0.0:1651529344.432504:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+244:39030:x1731745946353856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.432508:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a53669fa/0x3234de053c4febe lrc: 3/0,1 mode: --/PW res: [0x2b429:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.432509:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177195 count 1 00010000:00010000:1.0:1651529344.432512:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005796db08/0x3234de053c4da21 lrc: 2/0,0 mode: PR/PR res: [0x2b429:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1906 expref: 1822 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.432513:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085cf969e/0x3234de053c4fec5 lrc: 3/0,1 mode: --/PW res: [0x2b42b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.432516:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.432516:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.432517:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a53669fa/0x3234de053c4febe lrc: 4/0,1 mode: --/PW res: [0x2b429:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432517:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000049a3f5ac/0x3234de053c4cffc lrc: 2/0,0 mode: PR/PR res: [0x2b42b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf128 expref: 1822 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.432520:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.432521:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.432522:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085cf969e/0x3234de053c4fec5 lrc: 4/0,1 mode: --/PW res: [0x2b42b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.432523:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005796db08/0x3234de053c4da21 lrc: 3/0,0 mode: PR/PR res: [0x2b429:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1906 expref: 1822 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.432527:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005796db08/0x3234de053c4da21 lrc: 4/0,0 mode: PR/PR res: [0x2b429:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1906 expref: 1822 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.432529:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000049a3f5ac/0x3234de053c4cffc lrc: 3/0,0 mode: PR/PR res: [0x2b42b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf128 expref: 1822 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.432531:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000824ca843 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996954496:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.432532:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000049a3f5ac/0x3234de053c4cffc lrc: 4/0,0 mode: PR/PR res: [0x2b42b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf128 expref: 1822 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.432536:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996954560:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.432539:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8a0b704 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.432543:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e49f83de going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.432546:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210748 00000100:00100000:1.0:1651529344.432547:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+244:39030:x1731745946354176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.432549:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210749 00000100:00100000:0.0:1651529344.432551:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+244:39030:x1731745946354304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.432552:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177196 count 1 00010000:00010000:1.0:1651529344.432555:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000822170bb/0x3234de053c4fecc lrc: 3/0,1 mode: --/PW res: [0x2b42c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.432555:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177198 count 1 00010000:00010000:0.0:1651529344.432558:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a562d62/0x3234de053c4fed3 lrc: 3/0,1 mode: --/PW res: [0x2b42e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.432559:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4eab03b/0x3234de053c4e04f lrc: 2/0,0 mode: PR/PR res: [0x2b42c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3227 expref: 1822 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.432562:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c57bbfeb/0x3234de053c4c281 lrc: 2/0,0 mode: PR/PR res: [0x2b42e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc89b expref: 1822 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.432565:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.432565:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.432565:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.432566:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000822170bb/0x3234de053c4fecc lrc: 4/0,1 mode: --/PW res: [0x2b42c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432566:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.432566:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a562d62/0x3234de053c4fed3 lrc: 4/0,1 mode: --/PW res: [0x2b42e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.432572:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b4eab03b/0x3234de053c4e04f lrc: 3/0,0 mode: PR/PR res: [0x2b42c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3227 expref: 1822 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.432572:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c57bbfeb/0x3234de053c4c281 lrc: 3/0,0 mode: PR/PR res: [0x2b42e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc89b expref: 1822 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.432575:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b4eab03b/0x3234de053c4e04f lrc: 4/0,0 mode: PR/PR res: [0x2b42c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3227 expref: 1822 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.432578:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c57bbfeb/0x3234de053c4c281 lrc: 4/0,0 mode: PR/PR res: [0x2b42e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc89b expref: 1822 pid: 80276 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.432579:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007c534a1e pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996954624:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.432582:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996954688:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.432585:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 000000004698fefb going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.432588:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c29d18ba going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.432590:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210750 00000100:00100000:1.0:1651529344.432592:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+244:39030:x1731745946354240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.432596:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177197 count 1 00010000:00010000:1.0:1651529344.432599:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000206299e1/0x3234de053c4feda lrc: 3/0,1 mode: --/PW res: [0x2b42d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.432604:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002264598a/0x3234de053c4a14f lrc: 2/0,0 mode: PR/PR res: [0x2b42d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb905 expref: 1822 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.432606:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.432607:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.432607:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000206299e1/0x3234de053c4feda lrc: 4/0,1 mode: --/PW res: [0x2b42d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.432616:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002264598a/0x3234de053c4a14f lrc: 3/0,0 mode: PR/PR res: [0x2b42d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb905 expref: 1822 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.432619:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002264598a/0x3234de053c4a14f lrc: 4/0,0 mode: PR/PR res: [0x2b42d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb905 expref: 1822 pid: 72395 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.432623:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005384a251 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996954752:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.432628:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f9dac3f6 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.432733:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996954304:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.432743:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.432751:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f7f046d7/0x3234de053c4fea9 lrc: 3/0,1 mode: --/PW res: [0x2b428:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.432754:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.432764:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d523a75 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996954368:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.432765:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396234624 00010000:00010000:1.0:1651529344.432769:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b1cdb9b9/0x3234de053c4feb0 lrc: 3/0,1 mode: --/PW res: [0x2b42a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432770:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c4ebe7 lrc: 4/0,0 mode: PR/PR res: [0x2b428:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6113 expref: 1823 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.432780:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396234688 00010000:00010000:0.0:1651529344.432783:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f545d586/0x3234de053c4d8ae lrc: 4/0,0 mode: PR/PR res: [0x2b42a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1395 expref: 1824 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.432785:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11525 00000100:00100000:1.0:1651529344.432787:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000091b9484 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1824:41279:x1731746396234624:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.432789:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11526 00010000:00010000:1.0:1651529344.432790:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.432791:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1824:41278:x1731746396234688:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.432792:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c4ebe7 lrc: 4/0,0 mode: PR/PR res: [0x2b428:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6113 expref: 1824 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.432794:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.432795:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f545d586/0x3234de053c4d8ae lrc: 4/0,0 mode: PR/PR res: [0x2b42a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1395 expref: 1824 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.432796:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c4ebe7 lrc: 3/0,0 mode: PR/PR res: [0x2b428:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6113 expref: 1824 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.432799:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f545d586/0x3234de053c4d8ae lrc: 3/0,0 mode: PR/PR res: [0x2b42a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1395 expref: 1824 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.432802:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c4ebe7 lrc: 0/0,0 mode: --/PR res: [0x2b428:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6113 expref: 1824 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.432805:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f545d586/0x3234de053c4d8ae lrc: 0/0,0 mode: --/PR res: [0x2b42a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1395 expref: 1823 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.432806:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.432806:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.432807:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f7f046d7/0x3234de053c4fea9 lrc: 3/0,1 mode: PW/PW res: [0x2b428:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432809:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.432809:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.432810:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7f046d7/0x3234de053c4fea9 lrc: 4/0,1 mode: PW/PW res: [0x2b428:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432810:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b1cdb9b9/0x3234de053c4feb0 lrc: 3/0,1 mode: PW/PW res: [0x2b42a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432813:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1cdb9b9/0x3234de053c4feb0 lrc: 4/0,1 mode: PW/PW res: [0x2b42a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.432819:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.432829:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.432835:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000091b9484 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1822:41279:x1731746396234624:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 47us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.432836:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1822:41278:x1731746396234688:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 45us (82us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.432838:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11525 00000100:00100000:0.0:1651529344.432840:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11526 00010000:00010000:1.0:1651529344.432849:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b1cdb9b9/0x3234de053c4feb0 lrc: 3/0,1 mode: PW/PW res: [0x2b42a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.432853:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1cdb9b9/0x3234de053c4feb0 lrc: 3/0,1 mode: PW/PW res: [0x2b42a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.432856:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1cdb9b9/0x3234de053c4feb0 lrc: 3/0,1 mode: PW/PW res: [0x2b42a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.432858:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b1cdb9b9/0x3234de053c4feb0 lrc: 2/0,0 mode: PW/PW res: [0x2b42a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432886:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f7f046d7/0x3234de053c4fea9 lrc: 3/0,1 mode: PW/PW res: [0x2b428:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432890:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7f046d7/0x3234de053c4fea9 lrc: 3/0,1 mode: PW/PW res: [0x2b428:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432901:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7f046d7/0x3234de053c4fea9 lrc: 3/0,1 mode: PW/PW res: [0x2b428:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432904:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7f046d7/0x3234de053c4fea9 lrc: 2/0,0 mode: PW/PW res: [0x2b428:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.432905:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+245:39030:x1731745946353792:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 606us (682us total) trans 12885078798 rc 0/0 00000100:00100000:1.0:1651529344.432907:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210744 00000100:00100000:0.0:1651529344.432962:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+245:39030:x1731745946353664:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 703us (772us total) trans 12885078799 rc 0/0 00000100:00100000:0.0:1651529344.432965:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210743 00010000:00010000:0.0:1651529344.432972:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b1cdb9b9/0x3234de053c4feb0 lrc: 2/0,0 mode: PW/PW res: [0x2b42a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432976:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b1cdb9b9 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.432977:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1cdb9b9/0x3234de053c4feb0 lrc: 2/0,0 mode: PW/PW res: [0x2b42a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432980:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1cdb9b9/0x3234de053c4feb0 lrc: 3/0,0 mode: PW/PW res: [0x2b42a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432996:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b1cdb9b9/0x3234de053c4feb0 lrc: 1/0,0 mode: --/PW res: [0x2b42a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.432999:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1cdb9b9/0x3234de053c4feb0 lrc: 0/0,0 mode: --/PW res: [0x2b42a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433003:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7f046d7/0x3234de053c4fea9 lrc: 2/0,0 mode: PW/PW res: [0x2b428:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433005:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f7f046d7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.433006:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7f046d7/0x3234de053c4fea9 lrc: 2/0,0 mode: PW/PW res: [0x2b428:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433012:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7f046d7/0x3234de053c4fea9 lrc: 3/0,0 mode: PW/PW res: [0x2b428:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433015:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7f046d7/0x3234de053c4fea9 lrc: 1/0,0 mode: --/PW res: [0x2b428:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433017:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7f046d7/0x3234de053c4fea9 lrc: 0/0,0 mode: --/PW res: [0x2b428:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.433027:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996954560:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.433031:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000085cf969e/0x3234de053c4fec5 lrc: 3/0,1 mode: --/PW res: [0x2b42b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.433043:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996954688:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.433046:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000824ca843 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996954496:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.433046:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008a562d62/0x3234de053c4fed3 lrc: 3/0,1 mode: --/PW res: [0x2b42e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.433051:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a53669fa/0x3234de053c4febe lrc: 3/0,1 mode: --/PW res: [0x2b429:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.433053:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996954432:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.433055:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006769cf41/0x3234de053c4feb7 lrc: 3/0,1 mode: --/PW res: [0x2b427:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.433058:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007c534a1e pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996954624:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.433061:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000822170bb/0x3234de053c4fecc lrc: 3/0,1 mode: --/PW res: [0x2b42c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.433066:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005384a251 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996954752:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.433069:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000206299e1/0x3234de053c4feda lrc: 3/0,1 mode: --/PW res: [0x2b42d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.433195:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.433213:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946354432 00000100:00100000:1.0:1651529344.433214:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.433241:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.433248:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946354560 00000100:00100000:0.0:1651529344.433256:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210751 00000100:00100000:0.0:1651529344.433257:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+246:39030:x1731745946354432:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.433259:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.433269:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:0.0:1651529344.433270:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177199 count 1 00000100:00100000:1.0:1651529344.433277:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.433279:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c4fee1 lrc: 3/0,1 mode: --/PW res: [0x2b42f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.433283:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.433284:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000029a4761a/0x3234de053c4ca92 lrc: 2/0,0 mode: PR/PR res: [0x2b42f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdbdb expref: 1820 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.433287:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.433287:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.433288:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c4fee1 lrc: 4/0,1 mode: --/PW res: [0x2b42f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.433289:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.433295:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210752 00010000:00010000:0.0:1651529344.433295:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000029a4761a/0x3234de053c4ca92 lrc: 3/0,0 mode: PR/PR res: [0x2b42f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdbdb expref: 1820 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.433297:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004544c2e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+246:39030:x1731745946354560:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.433298:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000029a4761a/0x3234de053c4ca92 lrc: 4/0,0 mode: PR/PR res: [0x2b42f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdbdb expref: 1820 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.433302:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996954816:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.433303:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177200 count 1 00010000:00010000:1.0:1651529344.433307:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca72ee39/0x3234de053c4fee8 lrc: 3/0,1 mode: --/PW res: [0x2b430:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.433314:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009f561add/0x3234de053c4e606 lrc: 2/0,0 mode: PR/PR res: [0x2b430:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4957 expref: 1820 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.433317:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e49f83de going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.433324:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.433324:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396235008 00010000:00010000:1.0:1651529344.433325:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.433325:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca72ee39/0x3234de053c4fee8 lrc: 4/0,1 mode: --/PW res: [0x2b430:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433329:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c4ce74 lrc: 4/0,0 mode: PR/PR res: [0x2b427:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cebf6 expref: 1821 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.433333:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009f561add/0x3234de053c4e606 lrc: 3/0,0 mode: PR/PR res: [0x2b430:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4957 expref: 1821 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.433334:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396235072 00010000:00010000:0.0:1651529344.433336:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005796db08/0x3234de053c4da21 lrc: 4/0,0 mode: PR/PR res: [0x2b429:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1906 expref: 1822 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.433337:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009f561add/0x3234de053c4e606 lrc: 4/0,0 mode: PR/PR res: [0x2b430:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4957 expref: 1822 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.433341:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bddc5ca7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996954880:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.433343:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396235136 00010000:00010000:0.0:1651529344.433345:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000049a3f5ac/0x3234de053c4cffc lrc: 4/0,0 mode: PR/PR res: [0x2b42b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf128 expref: 1823 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.433349:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396235200 00000100:00100000:1.0:1651529344.433350:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f9dac3f6 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.433351:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c57bbfeb/0x3234de053c4c281 lrc: 4/0,0 mode: PR/PR res: [0x2b42e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc89b expref: 1824 pid: 80276 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.433355:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396235264 00010000:00010000:0.0:1651529344.433356:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b4eab03b/0x3234de053c4e04f lrc: 4/0,0 mode: PR/PR res: [0x2b42c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3227 expref: 1825 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.433357:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396235328 00000100:00100000:0.0:1651529344.433361:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11527 00010000:00010000:1.0:1651529344.433362:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002264598a/0x3234de053c4a14f lrc: 4/0,0 mode: PR/PR res: [0x2b42d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb905 expref: 1826 pid: 72395 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.433362:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1826:41279:x1731746396235008:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.433365:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.433366:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c4ce74 lrc: 4/0,0 mode: PR/PR res: [0x2b427:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cebf6 expref: 1826 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.433368:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11528 00000100:00100000:1.0:1651529344.433370:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1826:41278:x1731746396235072:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.433370:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c4ce74 lrc: 3/0,0 mode: PR/PR res: [0x2b427:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cebf6 expref: 1826 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.433372:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.433374:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005796db08/0x3234de053c4da21 lrc: 4/0,0 mode: PR/PR res: [0x2b429:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1906 expref: 1826 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.433375:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c4ce74 lrc: 0/0,0 mode: --/PR res: [0x2b427:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cebf6 expref: 1826 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.433379:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.433380:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005796db08/0x3234de053c4da21 lrc: 3/0,0 mode: PR/PR res: [0x2b429:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1906 expref: 1825 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.433380:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.433381:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006769cf41/0x3234de053c4feb7 lrc: 3/0,1 mode: PW/PW res: [0x2b427:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433384:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006769cf41/0x3234de053c4feb7 lrc: 4/0,1 mode: PW/PW res: [0x2b427:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.433386:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005796db08/0x3234de053c4da21 lrc: 0/0,0 mode: --/PR res: [0x2b429:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1906 expref: 1825 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.433389:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.433390:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.433390:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.433391:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a53669fa/0x3234de053c4febe lrc: 3/0,1 mode: PW/PW res: [0x2b429:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.433394:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a53669fa/0x3234de053c4febe lrc: 4/0,1 mode: PW/PW res: [0x2b429:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.433396:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1824:41279:x1731746396235008:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.433399:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11527 00010000:00010000:1.0:1651529344.433400:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.433403:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11529 00000100:00100000:0.0:1651529344.433405:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1823:41279:x1731746396235136:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.433406:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1823:41278:x1731746396235072:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 36us (147us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.433407:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.433408:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000049a3f5ac/0x3234de053c4cffc lrc: 4/0,0 mode: PR/PR res: [0x2b42b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf128 expref: 1823 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.433409:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11528 00010000:00010000:0.0:1651529344.433412:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000049a3f5ac/0x3234de053c4cffc lrc: 3/0,0 mode: PR/PR res: [0x2b42b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf128 expref: 1822 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.433413:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11530 00000100:00100000:1.0:1651529344.433415:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1822:41278:x1731746396235200:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.433417:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.433417:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049a3f5ac/0x3234de053c4cffc lrc: 0/0,0 mode: --/PR res: [0x2b42b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf128 expref: 1822 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.433419:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c57bbfeb/0x3234de053c4c281 lrc: 4/0,0 mode: PR/PR res: [0x2b42e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc89b expref: 1822 pid: 80276 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.433420:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.433421:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.433421:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000085cf969e/0x3234de053c4fec5 lrc: 3/0,1 mode: PW/PW res: [0x2b42b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.433422:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c57bbfeb/0x3234de053c4c281 lrc: 3/0,0 mode: PR/PR res: [0x2b42e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc89b expref: 1821 pid: 80276 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.433427:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c57bbfeb/0x3234de053c4c281 lrc: 0/0,0 mode: --/PR res: [0x2b42e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc89b expref: 1821 pid: 80276 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.433427:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085cf969e/0x3234de053c4fec5 lrc: 4/0,1 mode: PW/PW res: [0x2b42b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.433430:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.433431:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.433431:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008a562d62/0x3234de053c4fed3 lrc: 3/0,1 mode: PW/PW res: [0x2b42e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433432:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.433434:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a562d62/0x3234de053c4fed3 lrc: 4/0,1 mode: PW/PW res: [0x2b42e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.433437:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1820:41279:x1731746396235136:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 31us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.433439:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11529 00010000:00010000:1.0:1651529344.433445:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.433451:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1819:41278:x1731746396235200:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.433452:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11531 00000100:00100000:1.0:1651529344.433453:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11530 00000100:00100000:0.0:1651529344.433454:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1819:41279:x1731746396235264:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.433456:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.433458:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11532 00010000:00010000:0.0:1651529344.433458:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b4eab03b/0x3234de053c4e04f lrc: 4/0,0 mode: PR/PR res: [0x2b42c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3227 expref: 1818 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.433459:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bbd85ac9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1818:41278:x1731746396235328:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.433461:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b4eab03b/0x3234de053c4e04f lrc: 3/0,0 mode: PR/PR res: [0x2b42c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3227 expref: 1818 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.433462:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.433463:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002264598a/0x3234de053c4a14f lrc: 4/0,0 mode: PR/PR res: [0x2b42d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb905 expref: 1818 pid: 72395 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.433466:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4eab03b/0x3234de053c4e04f lrc: 0/0,0 mode: --/PR res: [0x2b42c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3227 expref: 1818 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.433467:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002264598a/0x3234de053c4a14f lrc: 3/0,0 mode: PR/PR res: [0x2b42d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb905 expref: 1818 pid: 72395 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.433470:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.433470:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.433471:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002264598a/0x3234de053c4a14f lrc: 0/0,0 mode: --/PR res: [0x2b42d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb905 expref: 1817 pid: 72395 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.433471:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000822170bb/0x3234de053c4fecc lrc: 3/0,1 mode: PW/PW res: [0x2b42c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433474:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000822170bb/0x3234de053c4fecc lrc: 4/0,1 mode: PW/PW res: [0x2b42c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.433477:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.433478:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.433478:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000206299e1/0x3234de053c4feda lrc: 3/0,1 mode: PW/PW res: [0x2b42d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.433481:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000206299e1/0x3234de053c4feda lrc: 4/0,1 mode: PW/PW res: [0x2b42d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433486:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.433491:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1816:41279:x1731746396235264:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 37us (208us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.433493:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.433494:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11531 00000100:00100000:1.0:1651529344.433499:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bbd85ac9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1815:41278:x1731746396235328:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 39us (210us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.433500:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000085cf969e/0x3234de053c4fec5 lrc: 3/0,1 mode: PW/PW res: [0x2b42b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.433501:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11532 00010000:00010000:0.0:1651529344.433503:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085cf969e/0x3234de053c4fec5 lrc: 3/0,1 mode: PW/PW res: [0x2b42b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433506:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085cf969e/0x3234de053c4fec5 lrc: 3/0,1 mode: PW/PW res: [0x2b42b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433509:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085cf969e/0x3234de053c4fec5 lrc: 2/0,0 mode: PW/PW res: [0x2b42b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.433511:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a53669fa/0x3234de053c4febe lrc: 3/0,1 mode: PW/PW res: [0x2b429:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.433514:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a53669fa/0x3234de053c4febe lrc: 3/0,1 mode: PW/PW res: [0x2b429:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.433517:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a53669fa/0x3234de053c4febe lrc: 3/0,1 mode: PW/PW res: [0x2b429:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.433520:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a53669fa/0x3234de053c4febe lrc: 2/0,0 mode: PW/PW res: [0x2b429:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.433556:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+248:39030:x1731745946353856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1051us (1132us total) trans 12885078800 rc 0/0 00000100:00100000:0.0:1651529344.433559:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210747 00000100:00100000:1.0:1651529344.433564:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+247:39030:x1731745946353728:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1070us (1173us total) trans 12885078801 rc 0/0 00010000:00010000:0.0:1651529344.433566:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085cf969e/0x3234de053c4fec5 lrc: 2/0,0 mode: PW/PW res: [0x2b42b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.433567:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210746 00010000:00010000:0.0:1651529344.433569:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000085cf969e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.433570:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085cf969e/0x3234de053c4fec5 lrc: 2/0,0 mode: PW/PW res: [0x2b42b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.433574:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000822170bb/0x3234de053c4fecc lrc: 3/0,1 mode: PW/PW res: [0x2b42c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433575:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085cf969e/0x3234de053c4fec5 lrc: 3/0,0 mode: PW/PW res: [0x2b42b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.433577:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000822170bb/0x3234de053c4fecc lrc: 3/0,1 mode: PW/PW res: [0x2b42c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.433580:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000822170bb/0x3234de053c4fecc lrc: 3/0,1 mode: PW/PW res: [0x2b42c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433580:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085cf969e/0x3234de053c4fec5 lrc: 1/0,0 mode: --/PW res: [0x2b42b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433582:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085cf969e/0x3234de053c4fec5 lrc: 0/0,0 mode: --/PW res: [0x2b42b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.433583:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000822170bb/0x3234de053c4fecc lrc: 2/0,0 mode: PW/PW res: [0x2b42c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433587:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a53669fa/0x3234de053c4febe lrc: 2/0,0 mode: PW/PW res: [0x2b429:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433596:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a53669fa already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.433597:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a53669fa/0x3234de053c4febe lrc: 2/0,0 mode: PW/PW res: [0x2b429:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433600:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a53669fa/0x3234de053c4febe lrc: 3/0,0 mode: PW/PW res: [0x2b429:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433603:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a53669fa/0x3234de053c4febe lrc: 1/0,0 mode: --/PW res: [0x2b429:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433606:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a53669fa/0x3234de053c4febe lrc: 0/0,0 mode: --/PW res: [0x2b429:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433610:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000822170bb/0x3234de053c4fecc lrc: 2/0,0 mode: PW/PW res: [0x2b42c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433614:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000822170bb already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.433615:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000822170bb/0x3234de053c4fecc lrc: 2/0,0 mode: PW/PW res: [0x2b42c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433618:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000822170bb/0x3234de053c4fecc lrc: 3/0,0 mode: PW/PW res: [0x2b42c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.433620:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+247:39030:x1731745946354176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1072us (1178us total) trans 12885078802 rc 0/0 00010000:00010000:0.0:1651529344.433621:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000822170bb/0x3234de053c4fecc lrc: 1/0,0 mode: --/PW res: [0x2b42c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.433623:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210748 00010000:00010000:0.0:1651529344.433624:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000822170bb/0x3234de053c4fecc lrc: 0/0,0 mode: --/PW res: [0x2b42c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.433629:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000206299e1/0x3234de053c4feda lrc: 3/0,1 mode: PW/PW res: [0x2b42d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433630:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008a562d62/0x3234de053c4fed3 lrc: 3/0,1 mode: PW/PW res: [0x2b42e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.433632:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000206299e1/0x3234de053c4feda lrc: 3/0,1 mode: PW/PW res: [0x2b42d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433633:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a562d62/0x3234de053c4fed3 lrc: 3/0,1 mode: PW/PW res: [0x2b42e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.433636:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000206299e1/0x3234de053c4feda lrc: 3/0,1 mode: PW/PW res: [0x2b42d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433636:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a562d62/0x3234de053c4fed3 lrc: 3/0,1 mode: PW/PW res: [0x2b42e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.433638:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000206299e1/0x3234de053c4feda lrc: 2/0,0 mode: PW/PW res: [0x2b42d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433638:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a562d62/0x3234de053c4fed3 lrc: 2/0,0 mode: PW/PW res: [0x2b42e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.433674:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+248:39030:x1731745946354240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1081us (1208us total) trans 12885078803 rc 0/0 00000100:00100000:1.0:1651529344.433677:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210750 00000100:00100000:0.0:1651529344.433683:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+247:39030:x1731745946354304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1132us (1228us total) trans 12885078804 rc 0/0 00000100:00100000:0.0:1651529344.433687:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210749 00010000:00010000:0.0:1651529344.433694:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000206299e1/0x3234de053c4feda lrc: 2/0,0 mode: PW/PW res: [0x2b42d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433698:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000206299e1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.433699:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000206299e1/0x3234de053c4feda lrc: 2/0,0 mode: PW/PW res: [0x2b42d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433702:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000206299e1/0x3234de053c4feda lrc: 3/0,0 mode: PW/PW res: [0x2b42d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433706:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000206299e1/0x3234de053c4feda lrc: 1/0,0 mode: --/PW res: [0x2b42d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433709:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000206299e1/0x3234de053c4feda lrc: 0/0,0 mode: --/PW res: [0x2b42d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433713:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a562d62/0x3234de053c4fed3 lrc: 2/0,0 mode: PW/PW res: [0x2b42e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433716:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008a562d62 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.433716:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a562d62/0x3234de053c4fed3 lrc: 2/0,0 mode: PW/PW res: [0x2b42e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433719:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a562d62/0x3234de053c4fed3 lrc: 3/0,0 mode: PW/PW res: [0x2b42e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433725:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a562d62/0x3234de053c4fed3 lrc: 1/0,0 mode: --/PW res: [0x2b42e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433727:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a562d62/0x3234de053c4fed3 lrc: 0/0,0 mode: --/PW res: [0x2b42e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433744:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006769cf41/0x3234de053c4feb7 lrc: 3/0,1 mode: PW/PW res: [0x2b427:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433747:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006769cf41/0x3234de053c4feb7 lrc: 3/0,1 mode: PW/PW res: [0x2b427:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433750:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006769cf41/0x3234de053c4feb7 lrc: 3/0,1 mode: PW/PW res: [0x2b427:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433753:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006769cf41/0x3234de053c4feb7 lrc: 2/0,0 mode: PW/PW res: [0x2b427:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.433804:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+247:39030:x1731745946353600:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1396us (1428us total) trans 12885078805 rc 0/0 00000100:00100000:0.0:1651529344.433807:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210745 00010000:00010000:0.0:1651529344.433815:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006769cf41/0x3234de053c4feb7 lrc: 2/0,0 mode: PW/PW res: [0x2b427:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433819:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006769cf41 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.433820:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006769cf41/0x3234de053c4feb7 lrc: 2/0,0 mode: PW/PW res: [0x2b427:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433836:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006769cf41/0x3234de053c4feb7 lrc: 3/0,0 mode: PW/PW res: [0x2b427:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433841:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006769cf41/0x3234de053c4feb7 lrc: 1/0,0 mode: --/PW res: [0x2b427:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433844:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006769cf41/0x3234de053c4feb7 lrc: 0/0,0 mode: --/PW res: [0x2b427:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.433915:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.433925:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946354944 00000100:00100000:1.0:1651529344.433926:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.433939:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946355008 00000100:00100000:1.0:1651529344.433948:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210753 00000100:00100000:1.0:1651529344.433950:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+248:39030:x1731745946354944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.433950:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210754 00000100:00100000:0.0:1651529344.433952:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+248:39030:x1731745946355008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.433956:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177201 count 1 00002000:00080000:0.0:1651529344.433957:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177202 count 1 00010000:00010000:1.0:1651529344.433960:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011d5f1b1/0x3234de053c4feef lrc: 3/0,1 mode: --/PW res: [0x2b431:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433961:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c4fef6 lrc: 3/0,1 mode: --/PW res: [0x2b432:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.433965:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f169e171/0x3234de053c4eaac lrc: 2/0,0 mode: PR/PR res: [0x2b431:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c6d expref: 1814 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.433966:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001e4ec3ee/0x3234de053c4f0c5 lrc: 2/0,0 mode: PR/PR res: [0x2b432:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d759c expref: 1814 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.433968:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.433969:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.433969:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.433970:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011d5f1b1/0x3234de053c4feef lrc: 4/0,1 mode: --/PW res: [0x2b431:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.433970:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.433970:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c4fef6 lrc: 4/0,1 mode: --/PW res: [0x2b432:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.433976:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f169e171/0x3234de053c4eaac lrc: 3/0,0 mode: PR/PR res: [0x2b431:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c6d expref: 1814 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.433980:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f169e171/0x3234de053c4eaac lrc: 4/0,0 mode: PR/PR res: [0x2b431:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c6d expref: 1814 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.433984:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000028589556 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996954944:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.433994:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a5495eb going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.434012:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001e4ec3ee/0x3234de053c4f0c5 lrc: 3/0,0 mode: PR/PR res: [0x2b432:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d759c expref: 1814 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.434019:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001e4ec3ee/0x3234de053c4f0c5 lrc: 4/0,0 mode: PR/PR res: [0x2b432:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d759c expref: 1814 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.434021:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.434023:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996955008:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.434041:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000124f6b49 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.434048:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946355072 00000100:00100000:0.0:1651529344.434060:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210755 00000100:00100000:0.0:1651529344.434061:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+249:39030:x1731745946355072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.434063:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.434066:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177203 count 1 00010000:00010000:0.0:1651529344.434081:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c4fefd lrc: 3/0,1 mode: --/PW res: [0x2b433:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434085:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001e801c8a/0x3234de053c4d504 lrc: 2/0,0 mode: PR/PR res: [0x2b433:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0621 expref: 1814 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.434088:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.434089:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.434090:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c4fefd lrc: 4/0,1 mode: --/PW res: [0x2b433:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434101:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001e801c8a/0x3234de053c4d504 lrc: 3/0,0 mode: PR/PR res: [0x2b433:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0621 expref: 1814 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.434103:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.434105:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001e801c8a/0x3234de053c4d504 lrc: 4/0,0 mode: PR/PR res: [0x2b433:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0621 expref: 1814 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.434112:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996955072:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.434115:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.434120:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ff7757ae going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.434123:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.434125:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946355200 00000100:00100000:0.0:1651529344.434136:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946355136 00000100:00100000:0.0:1651529344.434140:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946355264 00000100:00100000:0.0:1651529344.434143:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210756 00000100:00100000:0.0:1651529344.434144:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+252:39030:x1731745946355200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.434149:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177205 count 1 00010000:00010000:0.0:1651529344.434152:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c4ff04 lrc: 3/0,1 mode: --/PW res: [0x2b435:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.434154:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.434157:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008a05bebd/0x3234de053c4f14a lrc: 2/0,0 mode: PR/PR res: [0x2b435:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77da expref: 1814 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.434166:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210757 00010000:00010000:0.0:1651529344.434166:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.434167:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.434167:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c4ff04 lrc: 4/0,1 mode: --/PW res: [0x2b435:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.434168:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+252:39030:x1731745946355136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.434174:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177204 count 1 00010000:00010000:0.0:1651529344.434174:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008a05bebd/0x3234de053c4f14a lrc: 3/0,0 mode: PR/PR res: [0x2b435:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77da expref: 1814 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.434177:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008a05bebd/0x3234de053c4f14a lrc: 4/0,0 mode: PR/PR res: [0x2b435:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77da expref: 1814 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.434178:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c4ff0b lrc: 3/0,1 mode: --/PW res: [0x2b434:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.434181:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996955136:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.434182:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c4cb02 lrc: 2/0,0 mode: PR/PR res: [0x2b434:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd9b expref: 1814 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.434185:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.434186:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.434187:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c4ff0b lrc: 4/0,1 mode: --/PW res: [0x2b434:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.434193:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aac39cef going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.434200:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c4cb02 lrc: 3/0,0 mode: PR/PR res: [0x2b434:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd9b expref: 1814 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.434200:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210758 00000100:00100000:0.0:1651529344.434202:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+252:39030:x1731745946355264:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.434203:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c4cb02 lrc: 4/0,0 mode: PR/PR res: [0x2b434:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd9b expref: 1814 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:0.0:1651529344.434206:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177206 count 1 00000100:00100000:1.0:1651529344.434208:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000012863683 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996955200:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.434210:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c4ff12 lrc: 3/0,1 mode: --/PW res: [0x2b436:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434214:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000185935fb/0x3234de053c4f4fb lrc: 2/0,0 mode: PR/PR res: [0x2b436:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8674 expref: 1814 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.434216:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c3caa148 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.434217:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.434218:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.434218:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c4ff12 lrc: 4/0,1 mode: --/PW res: [0x2b436:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.434241:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bddc5ca7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996954880:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.434245:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ca72ee39/0x3234de053c4fee8 lrc: 3/0,1 mode: --/PW res: [0x2b430:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434260:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000185935fb/0x3234de053c4f4fb lrc: 3/0,0 mode: PR/PR res: [0x2b436:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8674 expref: 1814 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.434264:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000185935fb/0x3234de053c4f4fb lrc: 4/0,0 mode: PR/PR res: [0x2b436:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8674 expref: 1814 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.434268:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996955264:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.434276:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000382571b5 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.434284:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396235520 00000100:00100000:1.0:1651529344.434285:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.434289:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000029a4761a/0x3234de053c4ca92 lrc: 5/0,0 mode: PR/PR res: [0x2b42f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdbdb expref: 1815 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.434298:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396235584 00010000:00010000:0.0:1651529344.434301:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009f561add/0x3234de053c4e606 lrc: 4/0,0 mode: PR/PR res: [0x2b430:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4957 expref: 1816 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.434305:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396235712 00010000:00010000:0.0:1651529344.434308:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f169e171/0x3234de053c4eaac lrc: 5/0,0 mode: PR/PR res: [0x2b431:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c6d expref: 1817 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.434312:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11533 00000100:00100000:0.0:1651529344.434314:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1817:41279:x1731746396235520:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.434317:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.434318:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000029a4761a/0x3234de053c4ca92 lrc: 5/0,0 mode: PR/PR res: [0x2b42f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdbdb expref: 1817 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.434322:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000029a4761a/0x3234de053c4ca92 lrc: 4/0,0 mode: PR/PR res: [0x2b42f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdbdb expref: 1817 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.434324:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000028589556 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996954944:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.434327:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.434328:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000011d5f1b1/0x3234de053c4feef lrc: 3/0,1 mode: --/PW res: [0x2b431:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434328:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.434328:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c4fee1 lrc: 3/0,1 mode: PW/PW res: [0x2b42f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.434337:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11534 00000100:00100000:1.0:1651529344.434338:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1817:41278:x1731746396235584:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.434342:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.434343:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009f561add/0x3234de053c4e606 lrc: 4/0,0 mode: PR/PR res: [0x2b430:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4957 expref: 1817 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.434352:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c4fee1 lrc: 4/0,1 mode: PW/PW res: [0x2b42f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.434353:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009f561add/0x3234de053c4e606 lrc: 3/0,0 mode: PR/PR res: [0x2b430:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4957 expref: 1817 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.434357:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.434359:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f561add/0x3234de053c4e606 lrc: 0/0,0 mode: --/PR res: [0x2b430:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4957 expref: 1817 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.434363:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.434364:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.434364:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ca72ee39/0x3234de053c4fee8 lrc: 3/0,1 mode: PW/PW res: [0x2b430:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.434364:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1816:41279:x1731746396235520:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 50us (241us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.434367:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca72ee39/0x3234de053c4fee8 lrc: 4/0,1 mode: PW/PW res: [0x2b430:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.434367:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11533 00000100:00100000:0.0:1651529344.434373:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11535 00010000:00010000:1.0:1651529344.434374:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.434374:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1815:41278:x1731746396235712:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.434377:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.434379:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f169e171/0x3234de053c4eaac lrc: 4/0,0 mode: PR/PR res: [0x2b431:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c6d expref: 1815 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.434381:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1815:41278:x1731746396235584:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (227us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.434382:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f169e171/0x3234de053c4eaac lrc: 3/0,0 mode: PR/PR res: [0x2b431:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c6d expref: 1815 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.434384:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11534 00010000:00010000:0.0:1651529344.434387:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f169e171/0x3234de053c4eaac lrc: 0/0,0 mode: --/PR res: [0x2b431:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c6d expref: 1814 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.434391:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ca72ee39/0x3234de053c4fee8 lrc: 3/0,1 mode: PW/PW res: [0x2b430:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.434394:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca72ee39/0x3234de053c4fee8 lrc: 3/0,1 mode: PW/PW res: [0x2b430:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.434397:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca72ee39/0x3234de053c4fee8 lrc: 3/0,1 mode: PW/PW res: [0x2b430:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.434400:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca72ee39/0x3234de053c4fee8 lrc: 2/0,0 mode: PW/PW res: [0x2b430:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434405:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.434406:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.434412:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000011d5f1b1/0x3234de053c4feef lrc: 3/0,1 mode: PW/PW res: [0x2b431:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434416:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011d5f1b1/0x3234de053c4feef lrc: 4/0,1 mode: PW/PW res: [0x2b431:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434425:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.434432:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1813:41278:x1731746396235712:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 57us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.434434:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11535 00000100:00100000:1.0:1651529344.434450:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004544c2e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+253:39030:x1731745946354560:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1153us (1209us total) trans 12885078806 rc 0/0 00010000:00010000:0.0:1651529344.434452:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca72ee39/0x3234de053c4fee8 lrc: 2/0,0 mode: PW/PW res: [0x2b430:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.434453:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210752 00010000:00010000:0.0:1651529344.434456:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ca72ee39 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.434457:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca72ee39/0x3234de053c4fee8 lrc: 2/0,0 mode: PW/PW res: [0x2b430:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434460:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca72ee39/0x3234de053c4fee8 lrc: 3/0,0 mode: PW/PW res: [0x2b430:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.434461:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000011d5f1b1/0x3234de053c4feef lrc: 3/0,1 mode: PW/PW res: [0x2b431:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.434464:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011d5f1b1/0x3234de053c4feef lrc: 3/0,1 mode: PW/PW res: [0x2b431:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434464:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca72ee39/0x3234de053c4fee8 lrc: 1/0,0 mode: --/PW res: [0x2b430:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.434467:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011d5f1b1/0x3234de053c4feef lrc: 3/0,1 mode: PW/PW res: [0x2b431:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.434470:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011d5f1b1/0x3234de053c4feef lrc: 2/0,0 mode: PW/PW res: [0x2b431:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434482:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca72ee39/0x3234de053c4fee8 lrc: 0/0,0 mode: --/PW res: [0x2b430:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434487:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011d5f1b1/0x3234de053c4feef lrc: 2/0,0 mode: PW/PW res: [0x2b431:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434490:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000011d5f1b1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.434491:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011d5f1b1/0x3234de053c4feef lrc: 2/0,0 mode: PW/PW res: [0x2b431:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434494:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011d5f1b1/0x3234de053c4feef lrc: 3/0,0 mode: PW/PW res: [0x2b431:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434497:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011d5f1b1/0x3234de053c4feef lrc: 1/0,0 mode: --/PW res: [0x2b431:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434502:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011d5f1b1/0x3234de053c4feef lrc: 0/0,0 mode: --/PW res: [0x2b431:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.434508:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+253:39030:x1731745946354944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 558us (594us total) trans 12885078807 rc 0/0 00000100:00100000:1.0:1651529344.434511:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210753 00010000:00010000:0.0:1651529344.434514:0:156655:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029a4761a/0x3234de053c4ca92 lrc: 0/0,0 mode: --/PR res: [0x2b42f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdbdb expref: 1812 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.434517:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996954816:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.434520:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c4fee1 lrc: 3/0,1 mode: PW/PW res: [0x2b42f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434523:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c4fee1 lrc: 3/0,1 mode: PW/PW res: [0x2b42f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434526:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c4fee1 lrc: 3/0,1 mode: PW/PW res: [0x2b42f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434535:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c4fee1 lrc: 3/0,1 mode: PW/PW res: [0x2b42f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434538:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c4fee1 lrc: 2/0,0 mode: PW/PW res: [0x2b42f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.434585:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+253:39030:x1731745946354432:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1327us (1390us total) trans 12885078808 rc 0/0 00000100:00100000:0.0:1651529344.434588:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210751 00010000:00010000:0.0:1651529344.434608:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c4fee1 lrc: 2/0,0 mode: PW/PW res: [0x2b42f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434612:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005b1ee779 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.434613:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c4fee1 lrc: 2/0,0 mode: PW/PW res: [0x2b42f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434616:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c4fee1 lrc: 3/0,0 mode: PW/PW res: [0x2b42f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434620:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c4fee1 lrc: 1/0,0 mode: --/PW res: [0x2b42f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434623:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c4fee1 lrc: 0/0,0 mode: --/PW res: [0x2b42f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.434632:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996955136:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.434634:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000012863683 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996955200:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.434635:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c4ff04 lrc: 3/0,1 mode: --/PW res: [0x2b435:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.434638:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c4ff0b lrc: 3/0,1 mode: --/PW res: [0x2b434:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.434642:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996955072:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.434645:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c4fefd lrc: 3/0,1 mode: --/PW res: [0x2b433:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.434652:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996955008:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.434672:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c4fef6 lrc: 3/0,1 mode: --/PW res: [0x2b432:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.434768:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.434780:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996955264:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.434787:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.434798:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c4ff12 lrc: 3/0,1 mode: --/PW res: [0x2b436:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.434801:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.434811:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.434811:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946355456 00000100:00100000:1.0:1651529344.434820:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.434827:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946355392 00000100:00100000:0.0:1651529344.434835:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210759 00000100:00100000:0.0:1651529344.434836:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+254:39030:x1731745946355456:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.434837:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.434841:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177208 count 1 00000100:00100000:1.0:1651529344.434845:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.434845:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027cee4d4/0x3234de053c4ff19 lrc: 3/0,1 mode: --/PW res: [0x2b438:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434850:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c4f4e6 lrc: 2/0,0 mode: PR/PR res: [0x2b438:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d862e expref: 1811 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.434853:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.434853:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.434853:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.434854:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027cee4d4/0x3234de053c4ff19 lrc: 4/0,1 mode: --/PW res: [0x2b438:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.434859:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946355520 00010000:00010000:0.0:1651529344.434860:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c4f4e6 lrc: 3/0,0 mode: PR/PR res: [0x2b438:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d862e expref: 1811 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.434863:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c4f4e6 lrc: 4/0,0 mode: PR/PR res: [0x2b438:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d862e expref: 1811 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.434867:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210760 00000100:00100000:1.0:1651529344.434868:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+255:39030:x1731745946355392:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.434870:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996955328:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.434874:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177207 count 1 00010000:00010000:1.0:1651529344.434878:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fc3d0e3/0x3234de053c4ff20 lrc: 3/0,1 mode: --/PW res: [0x2b437:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.434884:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 0000000076b354b3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.434890:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d0098f22/0x3234de053c4e144 lrc: 2/0,0 mode: PR/PR res: [0x2b437:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d35bc expref: 1811 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.434890:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396236288 00010000:00010000:1.0:1651529344.434894:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.434894:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.434895:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000fc3d0e3/0x3234de053c4ff20 lrc: 4/0,1 mode: --/PW res: [0x2b437:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434895:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000185935fb/0x3234de053c4f4fb lrc: 4/0,0 mode: PR/PR res: [0x2b436:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8674 expref: 1812 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.434900:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396235840 00010000:00010000:1.0:1651529344.434902:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d0098f22/0x3234de053c4e144 lrc: 3/0,0 mode: PR/PR res: [0x2b437:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d35bc expref: 1813 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.434903:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001e4ec3ee/0x3234de053c4f0c5 lrc: 4/0,0 mode: PR/PR res: [0x2b432:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d759c expref: 1813 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.434905:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d0098f22/0x3234de053c4e144 lrc: 4/0,0 mode: PR/PR res: [0x2b437:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d35bc expref: 1813 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.434907:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396235968 00010000:00010000:0.0:1651529344.434909:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001e801c8a/0x3234de053c4d504 lrc: 4/0,0 mode: PR/PR res: [0x2b433:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0621 expref: 1814 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.434910:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d9cfef26 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996955392:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.434913:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396236096 00010000:00010000:0.0:1651529344.434915:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008a05bebd/0x3234de053c4f14a lrc: 4/0,0 mode: PR/PR res: [0x2b435:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77da expref: 1815 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.434918:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a5495eb going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.434919:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396236224 00010000:00010000:0.0:1651529344.434921:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c4cb02 lrc: 4/0,0 mode: PR/PR res: [0x2b434:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd9b expref: 1816 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.434924:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210761 00000100:00100000:1.0:1651529344.434926:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+255:39030:x1731745946355520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.434926:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11536 00000100:00100000:0.0:1651529344.434927:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1816:41279:x1731746396236288:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.434930:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00080000:1.0:1651529344.434931:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177209 count 1 00010000:00010000:0.0:1651529344.434931:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000185935fb/0x3234de053c4f4fb lrc: 4/0,0 mode: PR/PR res: [0x2b436:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8674 expref: 1816 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.434934:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c4ff27 lrc: 3/0,1 mode: --/PW res: [0x2b439:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434935:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000185935fb/0x3234de053c4f4fb lrc: 3/0,0 mode: PR/PR res: [0x2b436:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8674 expref: 1816 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.434938:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000077695175/0x3234de053c4d9b8 lrc: 2/0,0 mode: PR/PR res: [0x2b439:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d177e expref: 1816 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.434940:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000185935fb/0x3234de053c4f4fb lrc: 0/0,0 mode: --/PR res: [0x2b436:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8674 expref: 1816 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.434941:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.434942:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.434943:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c4ff27 lrc: 4/0,1 mode: --/PW res: [0x2b439:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434943:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.434944:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.434945:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c4ff12 lrc: 3/0,1 mode: PW/PW res: [0x2b436:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434948:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c4ff12 lrc: 4/0,1 mode: PW/PW res: [0x2b436:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.434951:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000077695175/0x3234de053c4d9b8 lrc: 3/0,0 mode: PR/PR res: [0x2b439:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d177e expref: 1815 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.434954:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000077695175/0x3234de053c4d9b8 lrc: 4/0,0 mode: PR/PR res: [0x2b439:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d177e expref: 1815 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.434954:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.434958:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000034e35367 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996955456:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.434961:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1815:41279:x1731746396236288:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.434963:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11536 00000100:00100000:1.0:1651529344.434964:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f9dac3f6 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.434968:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11537 00000100:00100000:0.0:1651529344.434969:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1814:41278:x1731746396235840:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.434970:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11538 00010000:00010000:0.0:1651529344.434971:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.434972:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1814:41278:x1731746396235968:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.434973:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001e4ec3ee/0x3234de053c4f0c5 lrc: 4/0,0 mode: PR/PR res: [0x2b432:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d759c expref: 1814 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.434975:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.434976:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001e801c8a/0x3234de053c4d504 lrc: 4/0,0 mode: PR/PR res: [0x2b433:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0621 expref: 1814 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.434976:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001e4ec3ee/0x3234de053c4f0c5 lrc: 3/0,0 mode: PR/PR res: [0x2b432:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d759c expref: 1814 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.434980:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001e801c8a/0x3234de053c4d504 lrc: 3/0,0 mode: PR/PR res: [0x2b433:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0621 expref: 1814 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.434981:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e4ec3ee/0x3234de053c4f0c5 lrc: 0/0,0 mode: --/PR res: [0x2b432:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d759c expref: 1814 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.434984:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.434985:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.434986:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e801c8a/0x3234de053c4d504 lrc: 0/0,0 mode: --/PR res: [0x2b433:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0621 expref: 1813 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.434986:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c4fef6 lrc: 3/0,1 mode: PW/PW res: [0x2b432:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434988:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c4fef6 lrc: 4/0,1 mode: PW/PW res: [0x2b432:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.434989:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.434990:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.434991:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c4fefd lrc: 3/0,1 mode: PW/PW res: [0x2b433:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.434994:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.434996:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c4fefd lrc: 4/0,1 mode: PW/PW res: [0x2b433:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.434998:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1812:41278:x1731746396235840:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 28us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.435001:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11537 00010000:00010000:1.0:1651529344.435007:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.435011:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11539 00000100:00100000:1.0:1651529344.435013:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1811:41278:x1731746396235968:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.435013:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ede49ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1811:41278:x1731746396236096:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.435015:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.435016:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11538 00010000:00010000:0.0:1651529344.435017:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008a05bebd/0x3234de053c4f14a lrc: 4/0,0 mode: PR/PR res: [0x2b435:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77da expref: 1811 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.435021:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11540 00010000:00010000:0.0:1651529344.435021:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008a05bebd/0x3234de053c4f14a lrc: 3/0,0 mode: PR/PR res: [0x2b435:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77da expref: 1810 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.435023:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1810:41278:x1731746396236224:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.435025:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.435025:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a05bebd/0x3234de053c4f14a lrc: 0/0,0 mode: --/PR res: [0x2b435:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77da expref: 1810 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.435027:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c4cb02 lrc: 4/0,0 mode: PR/PR res: [0x2b434:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd9b expref: 1810 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.435030:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c4cb02 lrc: 3/0,0 mode: PR/PR res: [0x2b434:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd9b expref: 1810 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.435031:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.435032:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.435032:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c4ff04 lrc: 3/0,1 mode: PW/PW res: [0x2b435:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.435035:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c4cb02 lrc: 0/0,0 mode: --/PR res: [0x2b434:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd9b expref: 1809 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.435035:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c4ff04 lrc: 4/0,1 mode: PW/PW res: [0x2b435:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.435039:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.435040:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.435040:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c4ff0b lrc: 3/0,1 mode: PW/PW res: [0x2b434:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435041:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.435043:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c4ff0b lrc: 4/0,1 mode: PW/PW res: [0x2b434:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.435046:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ede49ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1808:41278:x1731746396236096:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.435049:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11539 00010000:00010000:1.0:1651529344.435052:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.435056:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1807:41278:x1731746396236224:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (203us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.435058:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c4ff12 lrc: 3/0,1 mode: PW/PW res: [0x2b436:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.435059:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11540 00010000:00010000:0.0:1651529344.435061:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c4ff12 lrc: 3/0,1 mode: PW/PW res: [0x2b436:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.435065:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c4ff0b lrc: 3/0,1 mode: PW/PW res: [0x2b434:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435065:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c4ff12 lrc: 3/0,1 mode: PW/PW res: [0x2b436:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435067:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c4ff12 lrc: 2/0,0 mode: PW/PW res: [0x2b436:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.435068:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c4ff0b lrc: 3/0,1 mode: PW/PW res: [0x2b434:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.435071:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c4ff0b lrc: 3/0,1 mode: PW/PW res: [0x2b434:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.435074:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c4ff0b lrc: 2/0,0 mode: PW/PW res: [0x2b434:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.435115:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+257:39030:x1731745946355264:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 912us (999us total) trans 12885078809 rc 0/0 00000100:00100000:1.0:1651529344.435117:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+257:39030:x1731745946355136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 949us (1014us total) trans 12885078810 rc 0/0 00000100:00100000:0.0:1651529344.435118:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210758 00000100:00100000:1.0:1651529344.435120:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210757 00010000:00010000:0.0:1651529344.435125:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c4ff12 lrc: 2/0,0 mode: PW/PW res: [0x2b436:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435128:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000323a7bf8 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.435129:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c4ff12 lrc: 2/0,0 mode: PW/PW res: [0x2b436:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435132:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c4ff12 lrc: 3/0,0 mode: PW/PW res: [0x2b436:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435136:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c4ff12 lrc: 1/0,0 mode: --/PW res: [0x2b436:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435139:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c4ff12 lrc: 0/0,0 mode: --/PW res: [0x2b436:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435144:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c4ff0b lrc: 2/0,0 mode: PW/PW res: [0x2b434:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435146:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ade4813a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.435147:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c4ff0b lrc: 2/0,0 mode: PW/PW res: [0x2b434:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435150:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c4ff0b lrc: 3/0,0 mode: PW/PW res: [0x2b434:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435153:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c4ff0b lrc: 1/0,0 mode: --/PW res: [0x2b434:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435158:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c4ff0b lrc: 0/0,0 mode: --/PW res: [0x2b434:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435163:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c4ff04 lrc: 3/0,1 mode: PW/PW res: [0x2b435:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435166:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c4ff04 lrc: 3/0,1 mode: PW/PW res: [0x2b435:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435169:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c4ff04 lrc: 3/0,1 mode: PW/PW res: [0x2b435:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435172:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c4ff04 lrc: 2/0,0 mode: PW/PW res: [0x2b435:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.435205:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+256:39030:x1731745946355200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1060us (1142us total) trans 12885078811 rc 0/0 00000100:00100000:0.0:1651529344.435208:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210756 00010000:00010000:0.0:1651529344.435214:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c4ff04 lrc: 2/0,0 mode: PW/PW res: [0x2b435:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435218:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000022a594ce already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.435219:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c4ff04 lrc: 2/0,0 mode: PW/PW res: [0x2b435:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435221:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c4ff04 lrc: 3/0,0 mode: PW/PW res: [0x2b435:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435273:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c4ff04 lrc: 1/0,0 mode: --/PW res: [0x2b435:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435276:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c4ff04 lrc: 0/0,0 mode: --/PW res: [0x2b435:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435289:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c4fefd lrc: 3/0,1 mode: PW/PW res: [0x2b433:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435292:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c4fefd lrc: 3/0,1 mode: PW/PW res: [0x2b433:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435295:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c4fefd lrc: 3/0,1 mode: PW/PW res: [0x2b433:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435298:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c4fefd lrc: 2/0,0 mode: PW/PW res: [0x2b433:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.435347:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.435366:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.435374:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946355776 00000100:00100000:1.0:1651529344.435383:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946356032 00000100:00100000:1.0:1651529344.435387:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210762 00000100:00100000:1.0:1651529344.435389:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+258:39030:x1731745946355776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.435393:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+258:39030:x1731745946355072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1331us (1373us total) trans 12885078812 rc 0/0 00000100:00100000:0.0:1651529344.435396:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210755 00002000:00080000:1.0:1651529344.435399:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177210 count 1 00000100:00100000:0.0:1651529344.435402:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210763 00010000:00010000:1.0:1651529344.435404:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e445b065/0x3234de053c4ff2e lrc: 3/0,1 mode: --/PW res: [0x2b43a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.435409:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006f0edbda/0x3234de053c4a18e lrc: 2/0,0 mode: PR/PR res: [0x2b43a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb921 expref: 1806 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.435412:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.435412:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.435413:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e445b065/0x3234de053c4ff2e lrc: 4/0,1 mode: --/PW res: [0x2b43a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.435416:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+257:39029:x1731745946356032:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.435420:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006f0edbda/0x3234de053c4a18e lrc: 3/0,0 mode: PR/PR res: [0x2b43a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb921 expref: 1806 pid: 80277 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.435421:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177211 count 1 00010000:00010000:1.0:1651529344.435423:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006f0edbda/0x3234de053c4a18e lrc: 4/0,0 mode: PR/PR res: [0x2b43a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb921 expref: 1806 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.435425:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008407968/0x3234de053c4ff35 lrc: 3/0,1 mode: --/PW res: [0x2b43b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.435427:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000012863683 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996955520:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.435430:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000035aeb0fb/0x3234de053c4ef3d lrc: 2/0,0 mode: PR/PR res: [0x2b43b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6efe expref: 1806 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.435433:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.435434:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.435435:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008407968/0x3234de053c4ff35 lrc: 4/0,1 mode: --/PW res: [0x2b43b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.435436:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.435463:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000035aeb0fb/0x3234de053c4ef3d lrc: 3/0,0 mode: PR/PR res: [0x2b43b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6efe expref: 1806 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.435467:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000035aeb0fb/0x3234de053c4ef3d lrc: 4/0,0 mode: PR/PR res: [0x2b43b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6efe expref: 1806 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.435471:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996955584:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.435481:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 000000000e7e66c4 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.435486:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c4fefd lrc: 2/0,0 mode: PW/PW res: [0x2b433:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435489:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2a53ada already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.435490:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c4fefd lrc: 2/0,0 mode: PW/PW res: [0x2b433:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435493:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c4fefd lrc: 3/0,0 mode: PW/PW res: [0x2b433:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.435496:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.435500:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c4fefd lrc: 1/0,0 mode: --/PW res: [0x2b433:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435503:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c4fefd lrc: 0/0,0 mode: --/PW res: [0x2b433:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.435510:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946356096 00000100:00100000:0.0:1651529344.435522:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210764 00000100:00100000:0.0:1651529344.435523:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+258:39029:x1731745946356096:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.435528:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177212 count 1 00010000:00010000:0.0:1651529344.435532:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000349fa4b1/0x3234de053c4ff3c lrc: 3/0,1 mode: --/PW res: [0x2b43c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435536:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c4e6a7 lrc: 2/0,0 mode: PR/PR res: [0x2b43c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b48 expref: 1806 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.435537:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.435539:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.435540:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.435540:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000349fa4b1/0x3234de053c4ff3c lrc: 4/0,1 mode: --/PW res: [0x2b43c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.435544:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.435546:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c4e6a7 lrc: 3/0,0 mode: PR/PR res: [0x2b43c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b48 expref: 1806 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.435555:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.435557:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c4e6a7 lrc: 4/0,0 mode: PR/PR res: [0x2b43c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b48 expref: 1806 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.435563:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000034e35367 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996955456:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.435564:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996955648:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.435567:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c4ff27 lrc: 3/0,1 mode: --/PW res: [0x2b439:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.435577:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c0dff858 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.435581:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d9cfef26 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996955392:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.435584:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000fc3d0e3/0x3234de053c4ff20 lrc: 3/0,1 mode: --/PW res: [0x2b437:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.435584:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396236480 00010000:00010000:0.0:1651529344.435589:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c4f4e6 lrc: 5/0,0 mode: PR/PR res: [0x2b438:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d862e expref: 1807 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.435592:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396236544 00000100:00100000:0.0:1651529344.435594:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396236608 00010000:00010000:1.0:1651529344.435596:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d0098f22/0x3234de053c4e144 lrc: 4/0,0 mode: PR/PR res: [0x2b437:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d35bc expref: 1809 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.435597:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000077695175/0x3234de053c4d9b8 lrc: 4/0,0 mode: PR/PR res: [0x2b439:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d177e expref: 1809 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.435602:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11541 00000100:00100000:1.0:1651529344.435604:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11542 00000100:00100000:0.0:1651529344.435604:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1809:41279:x1731746396236480:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.435606:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1809:41279:x1731746396236544:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.435606:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.435607:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c4f4e6 lrc: 5/0,0 mode: PR/PR res: [0x2b438:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d862e expref: 1809 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.435608:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.435610:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d0098f22/0x3234de053c4e144 lrc: 4/0,0 mode: PR/PR res: [0x2b437:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d35bc expref: 1809 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.435613:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d0098f22/0x3234de053c4e144 lrc: 3/0,0 mode: PR/PR res: [0x2b437:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d35bc expref: 1809 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.435619:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0098f22/0x3234de053c4e144 lrc: 0/0,0 mode: --/PR res: [0x2b437:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d35bc expref: 1809 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.435623:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.435623:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.435624:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000fc3d0e3/0x3234de053c4ff20 lrc: 3/0,1 mode: PW/PW res: [0x2b437:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435626:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c4f4e6 lrc: 4/0,0 mode: PR/PR res: [0x2b438:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d862e expref: 1808 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.435627:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000fc3d0e3/0x3234de053c4ff20 lrc: 4/0,1 mode: PW/PW res: [0x2b437:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435632:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.435633:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.435634:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000027cee4d4/0x3234de053c4ff19 lrc: 3/0,1 mode: PW/PW res: [0x2b438:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.435636:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.435637:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027cee4d4/0x3234de053c4ff19 lrc: 4/0,1 mode: PW/PW res: [0x2b438:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.435642:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1808:41279:x1731746396236544:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (98us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.435642:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.435645:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11542 00000100:00100000:1.0:1651529344.435649:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11543 00000100:00100000:0.0:1651529344.435649:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1807:41279:x1731746396236480:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 45us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.435651:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1807:41278:x1731746396236608:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.435652:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11541 00010000:00010000:1.0:1651529344.435653:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.435654:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000077695175/0x3234de053c4d9b8 lrc: 4/0,0 mode: PR/PR res: [0x2b439:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d177e expref: 1807 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.435658:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000077695175/0x3234de053c4d9b8 lrc: 3/0,0 mode: PR/PR res: [0x2b439:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d177e expref: 1806 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.435663:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077695175/0x3234de053c4d9b8 lrc: 0/0,0 mode: --/PR res: [0x2b439:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d177e expref: 1806 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.435665:0:72395:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c4f4e6 lrc: 0/0,0 mode: --/PR res: [0x2b438:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d862e expref: 1806 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.435666:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.435667:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.435667:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c4ff27 lrc: 3/0,1 mode: PW/PW res: [0x2b439:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.435669:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996955328:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.435670:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c4ff27 lrc: 4/0,1 mode: PW/PW res: [0x2b439:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435672:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000027cee4d4/0x3234de053c4ff19 lrc: 3/0,1 mode: PW/PW res: [0x2b438:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.435675:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.435675:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000027cee4d4/0x3234de053c4ff19 lrc: 3/0,1 mode: PW/PW res: [0x2b438:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435678:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027cee4d4/0x3234de053c4ff19 lrc: 3/0,1 mode: PW/PW res: [0x2b438:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.435680:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1804:41278:x1731746396236608:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 29us (125us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.435681:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027cee4d4/0x3234de053c4ff19 lrc: 3/0,1 mode: PW/PW res: [0x2b438:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.435683:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11543 00010000:00010000:0.0:1651529344.435684:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027cee4d4/0x3234de053c4ff19 lrc: 2/0,0 mode: PW/PW res: [0x2b438:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.435688:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c4ff27 lrc: 3/0,1 mode: PW/PW res: [0x2b439:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.435691:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c4ff27 lrc: 3/0,1 mode: PW/PW res: [0x2b439:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.435695:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c4ff27 lrc: 3/0,1 mode: PW/PW res: [0x2b439:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.435697:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c4ff27 lrc: 2/0,0 mode: PW/PW res: [0x2b439:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.435730:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+260:39030:x1731745946355456:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 893us (942us total) trans 12885078813 rc 0/0 00000100:00100000:0.0:1651529344.435744:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210759 00000100:00100000:1.0:1651529344.435751:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+259:39030:x1731745946355520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 824us (913us total) trans 12885078814 rc 0/0 00010000:00010000:0.0:1651529344.435752:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027cee4d4/0x3234de053c4ff19 lrc: 2/0,0 mode: PW/PW res: [0x2b438:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.435754:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210761 00010000:00010000:0.0:1651529344.435755:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027cee4d4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.435756:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027cee4d4/0x3234de053c4ff19 lrc: 2/0,0 mode: PW/PW res: [0x2b438:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435759:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027cee4d4/0x3234de053c4ff19 lrc: 3/0,0 mode: PW/PW res: [0x2b438:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.435761:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000fc3d0e3/0x3234de053c4ff20 lrc: 3/0,1 mode: PW/PW res: [0x2b437:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.435764:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000fc3d0e3/0x3234de053c4ff20 lrc: 3/0,1 mode: PW/PW res: [0x2b437:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435764:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027cee4d4/0x3234de053c4ff19 lrc: 1/0,0 mode: --/PW res: [0x2b438:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435767:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027cee4d4/0x3234de053c4ff19 lrc: 0/0,0 mode: --/PW res: [0x2b438:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.435768:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fc3d0e3/0x3234de053c4ff20 lrc: 3/0,1 mode: PW/PW res: [0x2b437:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.435770:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000fc3d0e3/0x3234de053c4ff20 lrc: 2/0,0 mode: PW/PW res: [0x2b437:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435771:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c4ff27 lrc: 2/0,0 mode: PW/PW res: [0x2b439:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435774:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008208703f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.435775:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c4ff27 lrc: 2/0,0 mode: PW/PW res: [0x2b439:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435777:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c4ff27 lrc: 3/0,0 mode: PW/PW res: [0x2b439:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435789:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c4ff27 lrc: 1/0,0 mode: --/PW res: [0x2b439:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435792:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c4ff27 lrc: 0/0,0 mode: --/PW res: [0x2b439:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435795:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000fc3d0e3/0x3234de053c4ff20 lrc: 2/0,0 mode: PW/PW res: [0x2b437:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435798:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000fc3d0e3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.435799:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000fc3d0e3/0x3234de053c4ff20 lrc: 2/0,0 mode: PW/PW res: [0x2b437:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435801:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000fc3d0e3/0x3234de053c4ff20 lrc: 3/0,0 mode: PW/PW res: [0x2b437:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435805:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000fc3d0e3/0x3234de053c4ff20 lrc: 1/0,0 mode: --/PW res: [0x2b437:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435807:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000fc3d0e3/0x3234de053c4ff20 lrc: 0/0,0 mode: --/PW res: [0x2b437:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.435809:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+259:39030:x1731745946355392:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 940us (998us total) trans 12885078815 rc 0/0 00000100:00100000:1.0:1651529344.435812:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210760 00010000:00010000:0.0:1651529344.435815:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c4fef6 lrc: 3/0,1 mode: PW/PW res: [0x2b432:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435817:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c4fef6 lrc: 3/0,1 mode: PW/PW res: [0x2b432:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435823:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c4fef6 lrc: 3/0,1 mode: PW/PW res: [0x2b432:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435825:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c4fef6 lrc: 2/0,0 mode: PW/PW res: [0x2b432:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.435827:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.435891:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+259:39030:x1731745946355008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1939us (1965us total) trans 12885078816 rc 0/0 00000100:00100000:0.0:1651529344.435894:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210754 00000100:00100000:0.0:1651529344.435899:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946356160 00000100:00100000:0.0:1651529344.435909:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210765 00000100:00100000:0.0:1651529344.435911:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+259:39029:x1731745946356160:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.435915:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177213 count 1 00010000:00010000:0.0:1651529344.435920:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b3a47ca/0x3234de053c4ff43 lrc: 3/0,1 mode: --/PW res: [0x2b43d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435931:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009e8582de/0x3234de053c4e47e lrc: 2/0,0 mode: PR/PR res: [0x2b43d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4329 expref: 1803 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.435935:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.435935:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.435936:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b3a47ca/0x3234de053c4ff43 lrc: 4/0,1 mode: --/PW res: [0x2b43d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435943:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009e8582de/0x3234de053c4e47e lrc: 3/0,0 mode: PR/PR res: [0x2b43d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4329 expref: 1803 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.435949:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.435949:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009e8582de/0x3234de053c4e47e lrc: 4/0,0 mode: PR/PR res: [0x2b43d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4329 expref: 1803 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.435958:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996955712:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.435967:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 0000000076b354b3 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.435972:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c4fef6 lrc: 2/0,0 mode: PW/PW res: [0x2b432:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435975:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d065f972 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.435976:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c4fef6 lrc: 2/0,0 mode: PW/PW res: [0x2b432:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.435979:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.435979:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c4fef6 lrc: 3/0,0 mode: PW/PW res: [0x2b432:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435983:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c4fef6 lrc: 1/0,0 mode: --/PW res: [0x2b432:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.435986:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c4fef6 lrc: 0/0,0 mode: --/PW res: [0x2b432:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.435994:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996955584:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.435998:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000008407968/0x3234de053c4ff35 lrc: 3/0,1 mode: --/PW res: [0x2b43b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.436011:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000012863683 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996955520:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.436015:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e445b065/0x3234de053c4ff2e lrc: 3/0,1 mode: --/PW res: [0x2b43a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.436024:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396236800 00000100:00100000:0.0:1651529344.436025:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396236928 00010000:00010000:1.0:1651529344.436029:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006f0edbda/0x3234de053c4a18e lrc: 4/0,0 mode: PR/PR res: [0x2b43a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb921 expref: 1805 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.436030:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000035aeb0fb/0x3234de053c4ef3d lrc: 4/0,0 mode: PR/PR res: [0x2b43b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6efe expref: 1805 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.436040:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11544 00000100:00100000:1.0:1651529344.436042:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1805:41279:x1731746396236800:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.436045:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.436046:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006f0edbda/0x3234de053c4a18e lrc: 4/0,0 mode: PR/PR res: [0x2b43a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb921 expref: 1805 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.436050:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006f0edbda/0x3234de053c4a18e lrc: 3/0,0 mode: PR/PR res: [0x2b43a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb921 expref: 1805 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.436055:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f0edbda/0x3234de053c4a18e lrc: 0/0,0 mode: --/PR res: [0x2b43a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb921 expref: 1805 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.436059:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.436059:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11545 00010000:00010000:1.0:1651529344.436060:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.436061:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e445b065/0x3234de053c4ff2e lrc: 3/0,1 mode: PW/PW res: [0x2b43a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.436061:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1804:41279:x1731746396236928:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.436064:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e445b065/0x3234de053c4ff2e lrc: 4/0,1 mode: PW/PW res: [0x2b43a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436065:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.436070:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.436085:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1804:41279:x1731746396236800:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (136us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.436085:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000035aeb0fb/0x3234de053c4ef3d lrc: 4/0,0 mode: PR/PR res: [0x2b43b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6efe expref: 1804 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.436088:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11544 00010000:00010000:0.0:1651529344.436090:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000035aeb0fb/0x3234de053c4ef3d lrc: 3/0,0 mode: PR/PR res: [0x2b43b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6efe expref: 1804 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.436094:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e445b065/0x3234de053c4ff2e lrc: 3/0,1 mode: PW/PW res: [0x2b43a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436095:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035aeb0fb/0x3234de053c4ef3d lrc: 0/0,0 mode: --/PR res: [0x2b43b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6efe expref: 1803 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.436097:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e445b065/0x3234de053c4ff2e lrc: 3/0,1 mode: PW/PW res: [0x2b43a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436098:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.436099:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.436100:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e445b065/0x3234de053c4ff2e lrc: 3/0,1 mode: PW/PW res: [0x2b43a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436100:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000008407968/0x3234de053c4ff35 lrc: 3/0,1 mode: PW/PW res: [0x2b43b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.436103:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e445b065/0x3234de053c4ff2e lrc: 2/0,0 mode: PW/PW res: [0x2b43a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436103:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008407968/0x3234de053c4ff35 lrc: 4/0,1 mode: PW/PW res: [0x2b43b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436116:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.436124:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1802:41279:x1731746396236928:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 62us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.436127:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11545 00010000:00010000:0.0:1651529344.436134:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e445b065/0x3234de053c4ff2e lrc: 2/0,0 mode: PW/PW res: [0x2b43a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436137:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e445b065 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.436143:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+260:39030:x1731745946355776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 754us (796us total) trans 12885078817 rc 0/0 00000100:00100000:1.0:1651529344.436146:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210762 00010000:00010000:0.0:1651529344.436150:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e445b065/0x3234de053c4ff2e lrc: 2/0,0 mode: PW/PW res: [0x2b43a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436154:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e445b065/0x3234de053c4ff2e lrc: 3/0,0 mode: PW/PW res: [0x2b43a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436159:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e445b065/0x3234de053c4ff2e lrc: 1/0,0 mode: --/PW res: [0x2b43a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436161:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e445b065/0x3234de053c4ff2e lrc: 0/0,0 mode: --/PW res: [0x2b43a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436168:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000008407968/0x3234de053c4ff35 lrc: 3/0,1 mode: PW/PW res: [0x2b43b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436171:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008407968/0x3234de053c4ff35 lrc: 3/0,1 mode: PW/PW res: [0x2b43b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436174:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008407968/0x3234de053c4ff35 lrc: 3/0,1 mode: PW/PW res: [0x2b43b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436177:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008407968/0x3234de053c4ff35 lrc: 2/0,0 mode: PW/PW res: [0x2b43b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.436180:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.436216:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.436261:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+260:39029:x1731745946356032:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 845us (894us total) trans 12885078818 rc 0/0 00000100:00100000:1.0:1651529344.436265:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.436265:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210763 00000100:00100000:0.0:1651529344.436277:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946356416 00000100:00100000:0.0:1651529344.436299:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946356352 00000100:00100000:1.0:1651529344.436302:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.436312:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946356544 00000100:00100000:1.0:1651529344.436320:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.436328:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.436333:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946356480 00000100:00100000:1.0:1651529344.436336:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210766 00000100:00100000:1.0:1651529344.436344:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+263:39029:x1731745946356416:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.436344:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210767 00002000:00080000:1.0:1651529344.436349:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177215 count 1 00010000:00010000:1.0:1651529344.436354:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fde56444/0x3234de053c4ff4a lrc: 3/0,1 mode: --/PW res: [0x2b43f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.436359:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+263:39029:x1731745946356352:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.436364:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000780bce72/0x3234de053c4d210 lrc: 2/0,0 mode: PR/PR res: [0x2b43f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf9ef expref: 1801 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.436365:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177214 count 1 00010000:00010000:1.0:1651529344.436368:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.436368:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.436369:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fde56444/0x3234de053c4ff4a lrc: 4/0,1 mode: --/PW res: [0x2b43f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436370:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4ff51 lrc: 3/0,1 mode: --/PW res: [0x2b43e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436374:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000127428a6/0x3234de053c4dd31 lrc: 2/0,0 mode: PR/PR res: [0x2b43e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d25d2 expref: 1801 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.436376:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000780bce72/0x3234de053c4d210 lrc: 3/0,0 mode: PR/PR res: [0x2b43f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf9ef expref: 1801 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.436378:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.436378:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.436379:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000780bce72/0x3234de053c4d210 lrc: 4/0,0 mode: PR/PR res: [0x2b43f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf9ef expref: 1801 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.436379:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4ff51 lrc: 4/0,1 mode: --/PW res: [0x2b43e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.436384:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005cc6463a pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996955776:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.436386:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000127428a6/0x3234de053c4dd31 lrc: 3/0,0 mode: PR/PR res: [0x2b43e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d25d2 expref: 1801 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.436389:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000127428a6/0x3234de053c4dd31 lrc: 4/0,0 mode: PR/PR res: [0x2b43e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d25d2 expref: 1801 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.436392:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 000000004698fefb going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.436396:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996955840:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.436399:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210768 00000100:00100000:1.0:1651529344.436401:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+263:39029:x1731745946356544:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.436405:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177217 count 1 00010000:00010000:1.0:1651529344.436409:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d501883f/0x3234de053c4ff58 lrc: 3/0,1 mode: --/PW res: [0x2b441:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.436413:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c4dfae lrc: 2/0,0 mode: PR/PR res: [0x2b441:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2fa3 expref: 1801 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.436416:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.436416:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.436417:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d501883f/0x3234de053c4ff58 lrc: 4/0,1 mode: --/PW res: [0x2b441:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.436423:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c4dfae lrc: 3/0,0 mode: PR/PR res: [0x2b441:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2fa3 expref: 1801 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.436429:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060852af0 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.436436:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c4dfae lrc: 4/0,0 mode: PR/PR res: [0x2b441:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2fa3 expref: 1801 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.436438:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008407968/0x3234de053c4ff35 lrc: 2/0,0 mode: PW/PW res: [0x2b43b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.436441:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000065f5e47d pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996955904:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.436441:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000008407968 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.436442:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008407968/0x3234de053c4ff35 lrc: 2/0,0 mode: PW/PW res: [0x2b43b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436445:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008407968/0x3234de053c4ff35 lrc: 3/0,0 mode: PW/PW res: [0x2b43b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.436448:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.436450:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008407968/0x3234de053c4ff35 lrc: 1/0,0 mode: --/PW res: [0x2b43b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436453:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008407968/0x3234de053c4ff35 lrc: 0/0,0 mode: --/PW res: [0x2b43b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.436454:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210769 00000100:00100000:1.0:1651529344.436456:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+263:39029:x1731745946356480:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.436460:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177216 count 1 00000100:00100000:0.0:1651529344.436463:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996955648:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.436464:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c4ff5f lrc: 3/0,1 mode: --/PW res: [0x2b440:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436467:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000349fa4b1/0x3234de053c4ff3c lrc: 3/0,1 mode: --/PW res: [0x2b43c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.436471:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000081575d6c/0x3234de053c4f197 lrc: 2/0,0 mode: PR/PR res: [0x2b440:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7954 expref: 1801 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.436473:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396237248 00010000:00010000:1.0:1651529344.436474:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.436474:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.436475:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c4ff5f lrc: 4/0,1 mode: --/PW res: [0x2b440:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436477:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c4e6a7 lrc: 4/0,0 mode: PR/PR res: [0x2b43c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b48 expref: 1802 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.436480:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000081575d6c/0x3234de053c4f197 lrc: 3/0,0 mode: PR/PR res: [0x2b440:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7954 expref: 1802 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.436484:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000081575d6c/0x3234de053c4f197 lrc: 4/0,0 mode: PR/PR res: [0x2b440:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7954 expref: 1802 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.436485:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396237376 00010000:00010000:0.0:1651529344.436487:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009e8582de/0x3234de053c4e47e lrc: 5/0,0 mode: PR/PR res: [0x2b43d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4329 expref: 1803 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.436488:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c9f4ec84 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996955968:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.436492:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11546 00000100:00100000:1.0:1651529344.436493:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c3caa148 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.436494:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050ef6a3e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1803:41278:x1731746396237248:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.436496:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.436498:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c4e6a7 lrc: 4/0,0 mode: PR/PR res: [0x2b43c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b48 expref: 1803 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.436501:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11547 00010000:00010000:0.0:1651529344.436501:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c4e6a7 lrc: 3/0,0 mode: PR/PR res: [0x2b43c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b48 expref: 1803 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.436502:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1803:41278:x1731746396237376:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.436505:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.436506:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c4e6a7 lrc: 0/0,0 mode: --/PR res: [0x2b43c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b48 expref: 1803 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.436507:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009e8582de/0x3234de053c4e47e lrc: 5/0,0 mode: PR/PR res: [0x2b43d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4329 expref: 1803 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.436509:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.436510:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.436511:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009e8582de/0x3234de053c4e47e lrc: 4/0,0 mode: PR/PR res: [0x2b43d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4329 expref: 1802 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.436511:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000349fa4b1/0x3234de053c4ff3c lrc: 3/0,1 mode: PW/PW res: [0x2b43c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436514:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000349fa4b1/0x3234de053c4ff3c lrc: 4/0,1 mode: PW/PW res: [0x2b43c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.436519:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.436520:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.436520:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000b3a47ca/0x3234de053c4ff43 lrc: 3/0,1 mode: PW/PW res: [0x2b43d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436520:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.436523:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b3a47ca/0x3234de053c4ff43 lrc: 4/0,1 mode: PW/PW res: [0x2b43d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.436527:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050ef6a3e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1802:41278:x1731746396237248:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (262us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.436528:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.436529:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11546 00000100:00100000:1.0:1651529344.436533:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1801:41278:x1731746396237376:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 30us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.436536:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11547 00010000:00010000:0.0:1651529344.436539:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000349fa4b1/0x3234de053c4ff3c lrc: 3/0,1 mode: PW/PW res: [0x2b43c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436542:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000349fa4b1/0x3234de053c4ff3c lrc: 3/0,1 mode: PW/PW res: [0x2b43c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436545:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000349fa4b1/0x3234de053c4ff3c lrc: 3/0,1 mode: PW/PW res: [0x2b43c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436548:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000349fa4b1/0x3234de053c4ff3c lrc: 2/0,0 mode: PW/PW res: [0x2b43c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.436550:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.436564:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.436585:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+264:39029:x1731745946356096:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1060us (1088us total) trans 12885078819 rc 0/0 00000100:00100000:0.0:1651529344.436588:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210764 00000100:00100000:0.0:1651529344.436592:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946356608 00000100:00100000:0.0:1651529344.436598:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946356672 00000100:00100000:0.0:1651529344.436606:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210770 00000100:00100000:0.0:1651529344.436607:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+265:39029:x1731745946356608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.436612:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177218 count 1 00010000:00010000:0.0:1651529344.436616:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4ff66 lrc: 3/0,1 mode: --/PW res: [0x2b442:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436620:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000042c8316b/0x3234de053c4cdc5 lrc: 2/0,0 mode: PR/PR res: [0x2b442:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce8bc expref: 1800 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.436626:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.436627:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.436627:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4ff66 lrc: 4/0,1 mode: --/PW res: [0x2b442:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436634:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000042c8316b/0x3234de053c4cdc5 lrc: 3/0,0 mode: PR/PR res: [0x2b442:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce8bc expref: 1800 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.436637:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000042c8316b/0x3234de053c4cdc5 lrc: 4/0,0 mode: PR/PR res: [0x2b442:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce8bc expref: 1800 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.436640:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210771 00000100:00100000:0.0:1651529344.436641:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996956032:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.436642:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+265:39030:x1731745946356672:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.436647:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177219 count 1 00000100:00100000:0.0:1651529344.436654:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c2b2b59c going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.436657:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebf7beea/0x3234de053c4ff6d lrc: 3/0,1 mode: --/PW res: [0x2b443:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436659:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000349fa4b1/0x3234de053c4ff3c lrc: 2/0,0 mode: PW/PW res: [0x2b43c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.436662:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008147181f/0x3234de053c4bb7a lrc: 2/0,0 mode: PR/PR res: [0x2b443:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc55a expref: 1800 pid: 80281 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.436662:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000349fa4b1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.436663:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000349fa4b1/0x3234de053c4ff3c lrc: 2/0,0 mode: PW/PW res: [0x2b43c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.436666:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.436666:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.436667:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebf7beea/0x3234de053c4ff6d lrc: 4/0,1 mode: --/PW res: [0x2b443:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.436676:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008147181f/0x3234de053c4bb7a lrc: 3/0,0 mode: PR/PR res: [0x2b443:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc55a expref: 1800 pid: 80281 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.436680:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008147181f/0x3234de053c4bb7a lrc: 4/0,0 mode: PR/PR res: [0x2b443:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc55a expref: 1800 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.436682:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000349fa4b1/0x3234de053c4ff3c lrc: 3/0,0 mode: PW/PW res: [0x2b43c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.436684:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000093ddaf92 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996956096:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.436687:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000349fa4b1/0x3234de053c4ff3c lrc: 1/0,0 mode: --/PW res: [0x2b43c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.436692:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a5495eb going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.436692:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000349fa4b1/0x3234de053c4ff3c lrc: 0/0,0 mode: --/PW res: [0x2b43c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436745:0:80280:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e8582de/0x3234de053c4e47e lrc: 0/0,0 mode: --/PR res: [0x2b43d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4329 expref: 1800 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.436749:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.436749:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996955712:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.436759:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000b3a47ca/0x3234de053c4ff43 lrc: 3/0,1 mode: PW/PW res: [0x2b43d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436767:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000b3a47ca/0x3234de053c4ff43 lrc: 3/0,1 mode: PW/PW res: [0x2b43d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.436769:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005cc6463a pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996955776:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.436769:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b3a47ca/0x3234de053c4ff43 lrc: 3/0,1 mode: PW/PW res: [0x2b43d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.436773:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fde56444/0x3234de053c4ff4a lrc: 3/0,1 mode: --/PW res: [0x2b43f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436773:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b3a47ca/0x3234de053c4ff43 lrc: 3/0,1 mode: PW/PW res: [0x2b43d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436775:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b3a47ca/0x3234de053c4ff43 lrc: 2/0,0 mode: PW/PW res: [0x2b43d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.436840:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000065f5e47d pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996955904:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.436844:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d501883f/0x3234de053c4ff58 lrc: 3/0,1 mode: --/PW res: [0x2b441:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.436849:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+266:39029:x1731745946356160:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 937us (1021us total) trans 12885078820 rc 0/0 00000100:00100000:0.0:1651529344.436852:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210765 00000100:00100000:1.0:1651529344.436857:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c9f4ec84 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996955968:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.436857:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946356864 00010000:00010000:1.0:1651529344.436860:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c4ff5f lrc: 3/0,1 mode: --/PW res: [0x2b440:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.436864:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210772 00000100:00100000:0.0:1651529344.436866:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a13808c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+266:39030:x1731745946356864:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.436870:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177220 count 1 00010000:00010000:0.0:1651529344.436874:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4ff74 lrc: 3/0,1 mode: --/PW res: [0x2b444:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436879:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000531c1876/0x3234de053c4c146 lrc: 2/0,0 mode: PR/PR res: [0x2b444:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc7fa expref: 1799 pid: 80280 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.436882:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.436883:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.436883:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4ff74 lrc: 4/0,1 mode: --/PW res: [0x2b444:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436890:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000531c1876/0x3234de053c4c146 lrc: 3/0,0 mode: PR/PR res: [0x2b444:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc7fa expref: 1799 pid: 80280 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.436893:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000531c1876/0x3234de053c4c146 lrc: 4/0,0 mode: PR/PR res: [0x2b444:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc7fa expref: 1799 pid: 80280 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.436897:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996956160:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.436911:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 0000000076b354b3 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.436916:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b3a47ca/0x3234de053c4ff43 lrc: 2/0,0 mode: PW/PW res: [0x2b43d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436920:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000b3a47ca already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.436921:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b3a47ca/0x3234de053c4ff43 lrc: 2/0,0 mode: PW/PW res: [0x2b43d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436924:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b3a47ca/0x3234de053c4ff43 lrc: 3/0,0 mode: PW/PW res: [0x2b43d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436929:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b3a47ca/0x3234de053c4ff43 lrc: 1/0,0 mode: --/PW res: [0x2b43d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.436931:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b3a47ca/0x3234de053c4ff43 lrc: 0/0,0 mode: --/PW res: [0x2b43d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.436941:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996955840:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.436944:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4ff51 lrc: 3/0,1 mode: --/PW res: [0x2b43e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.437050:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996956032:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.437054:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4ff66 lrc: 3/0,1 mode: --/PW res: [0x2b442:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.437057:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.437066:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.437067:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396237504 00000100:00100000:1.0:1651529344.437075:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.437077:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000127428a6/0x3234de053c4dd31 lrc: 4/0,0 mode: PR/PR res: [0x2b43e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d25d2 expref: 1800 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.437081:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.437089:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.437095:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.437102:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000093ddaf92 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996956096:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.437113:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396237632 00010000:00010000:1.0:1651529344.437115:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ebf7beea/0x3234de053c4ff6d lrc: 3/0,1 mode: --/PW res: [0x2b443:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437117:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000081575d6c/0x3234de053c4f197 lrc: 4/0,0 mode: PR/PR res: [0x2b440:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7954 expref: 1801 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.437122:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396237568 00000100:00100000:0.0:1651529344.437122:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396237440 00010000:00010000:0.0:1651529344.437124:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000780bce72/0x3234de053c4d210 lrc: 4/0,0 mode: PR/PR res: [0x2b43f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf9ef expref: 1803 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.437127:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c4dfae lrc: 4/0,0 mode: PR/PR res: [0x2b441:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2fa3 expref: 1803 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.437129:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396237696 00010000:00010000:0.0:1651529344.437131:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000042c8316b/0x3234de053c4cdc5 lrc: 4/0,0 mode: PR/PR res: [0x2b442:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce8bc expref: 1804 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.437133:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396237760 00010000:00010000:1.0:1651529344.437135:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008147181f/0x3234de053c4bb7a lrc: 4/0,0 mode: PR/PR res: [0x2b443:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc55a expref: 1805 pid: 80281 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.437136:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11548 00000100:00100000:0.0:1651529344.437137:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1805:41278:x1731746396237504:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.437140:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11549 00010000:00010000:0.0:1651529344.437140:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.437142:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1805:41278:x1731746396237632:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.437142:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000127428a6/0x3234de053c4dd31 lrc: 4/0,0 mode: PR/PR res: [0x2b43e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d25d2 expref: 1805 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.437145:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.437145:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000127428a6/0x3234de053c4dd31 lrc: 3/0,0 mode: PR/PR res: [0x2b43e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d25d2 expref: 1805 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.437146:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000081575d6c/0x3234de053c4f197 lrc: 4/0,0 mode: PR/PR res: [0x2b440:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7954 expref: 1805 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.437150:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000081575d6c/0x3234de053c4f197 lrc: 3/0,0 mode: PR/PR res: [0x2b440:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7954 expref: 1805 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.437151:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000127428a6/0x3234de053c4dd31 lrc: 0/0,0 mode: --/PR res: [0x2b43e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d25d2 expref: 1805 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.437155:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081575d6c/0x3234de053c4f197 lrc: 0/0,0 mode: --/PR res: [0x2b440:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7954 expref: 1804 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.437155:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.437156:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.437156:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4ff51 lrc: 3/0,1 mode: PW/PW res: [0x2b43e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437160:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4ff51 lrc: 4/0,1 mode: PW/PW res: [0x2b43e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.437162:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.437162:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.437163:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c4ff5f lrc: 3/0,1 mode: PW/PW res: [0x2b440:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.437166:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c4ff5f lrc: 4/0,1 mode: PW/PW res: [0x2b440:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437167:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.437172:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.437174:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1803:41278:x1731746396237504:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 36us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.437177:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11548 00000100:00100000:1.0:1651529344.437179:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1803:41278:x1731746396237632:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.437182:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11549 00000100:00100000:1.0:1651529344.437186:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11550 00000100:00100000:1.0:1651529344.437188:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1802:41279:x1731746396237440:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.437190:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.437192:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000780bce72/0x3234de053c4d210 lrc: 4/0,0 mode: PR/PR res: [0x2b43f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf9ef expref: 1801 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.437195:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000780bce72/0x3234de053c4d210 lrc: 3/0,0 mode: PR/PR res: [0x2b43f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf9ef expref: 1801 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.437195:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11551 00000100:00100000:0.0:1651529344.437197:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1801:41279:x1731746396237568:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.437200:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000780bce72/0x3234de053c4d210 lrc: 0/0,0 mode: --/PR res: [0x2b43f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf9ef expref: 1801 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.437200:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.437202:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c4dfae lrc: 4/0,0 mode: PR/PR res: [0x2b441:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2fa3 expref: 1801 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.437203:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.437204:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.437205:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fde56444/0x3234de053c4ff4a lrc: 3/0,1 mode: PW/PW res: [0x2b43f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437206:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c4dfae lrc: 3/0,0 mode: PR/PR res: [0x2b441:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2fa3 expref: 1800 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.437208:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fde56444/0x3234de053c4ff4a lrc: 4/0,1 mode: PW/PW res: [0x2b43f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437211:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c4dfae lrc: 0/0,0 mode: --/PR res: [0x2b441:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2fa3 expref: 1800 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.437213:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.437214:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.437215:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.437216:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d501883f/0x3234de053c4ff58 lrc: 3/0,1 mode: PW/PW res: [0x2b441:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.437217:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1799:41279:x1731746396237440:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 29us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.437219:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11550 00010000:00010000:0.0:1651529344.437219:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d501883f/0x3234de053c4ff58 lrc: 4/0,1 mode: PW/PW res: [0x2b441:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.437237:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11552 00000100:00100000:1.0:1651529344.437239:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1798:41279:x1731746396237696:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.437242:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.437243:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000042c8316b/0x3234de053c4cdc5 lrc: 4/0,0 mode: PR/PR res: [0x2b442:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce8bc expref: 1798 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.437246:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.437253:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000042c8316b/0x3234de053c4cdc5 lrc: 3/0,0 mode: PR/PR res: [0x2b442:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce8bc expref: 1798 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.437253:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1798:41279:x1731746396237568:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 56us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.437256:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11551 00010000:00010000:1.0:1651529344.437258:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042c8316b/0x3234de053c4cdc5 lrc: 0/0,0 mode: --/PR res: [0x2b442:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce8bc expref: 1798 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.437261:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.437262:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.437262:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11553 00010000:00010000:1.0:1651529344.437263:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4ff66 lrc: 3/0,1 mode: PW/PW res: [0x2b442:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.437264:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cd5e5a1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1796:41279:x1731746396237760:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.437266:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.437268:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4ff66 lrc: 4/0,1 mode: PW/PW res: [0x2b442:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437268:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008147181f/0x3234de053c4bb7a lrc: 4/0,0 mode: PR/PR res: [0x2b443:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc55a expref: 1796 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.437271:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008147181f/0x3234de053c4bb7a lrc: 3/0,0 mode: PR/PR res: [0x2b443:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc55a expref: 1796 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.437277:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.437283:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008147181f/0x3234de053c4bb7a lrc: 0/0,0 mode: --/PR res: [0x2b443:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc55a expref: 1796 pid: 80281 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.437284:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1796:41279:x1731746396237696:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 44us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.437286:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11552 00010000:00010000:0.0:1651529344.437287:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.437287:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.437288:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ebf7beea/0x3234de053c4ff6d lrc: 3/0,1 mode: PW/PW res: [0x2b443:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437291:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebf7beea/0x3234de053c4ff6d lrc: 4/0,1 mode: PW/PW res: [0x2b443:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.437293:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fde56444/0x3234de053c4ff4a lrc: 3/0,1 mode: PW/PW res: [0x2b43f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.437296:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fde56444/0x3234de053c4ff4a lrc: 3/0,1 mode: PW/PW res: [0x2b43f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437300:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.437305:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fde56444/0x3234de053c4ff4a lrc: 3/0,1 mode: PW/PW res: [0x2b43f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.437306:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cd5e5a1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1794:41279:x1731746396237760:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (211us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.437308:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fde56444/0x3234de053c4ff4a lrc: 2/0,0 mode: PW/PW res: [0x2b43f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.437309:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11553 00010000:00010000:0.0:1651529344.437324:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fde56444/0x3234de053c4ff4a lrc: 2/0,0 mode: PW/PW res: [0x2b43f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437328:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fde56444 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.437329:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fde56444/0x3234de053c4ff4a lrc: 2/0,0 mode: PW/PW res: [0x2b43f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437332:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fde56444/0x3234de053c4ff4a lrc: 3/0,0 mode: PW/PW res: [0x2b43f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437336:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fde56444/0x3234de053c4ff4a lrc: 1/0,0 mode: --/PW res: [0x2b43f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437339:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fde56444/0x3234de053c4ff4a lrc: 0/0,0 mode: --/PW res: [0x2b43f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437345:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4ff66 lrc: 3/0,1 mode: PW/PW res: [0x2b442:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437348:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4ff66 lrc: 3/0,1 mode: PW/PW res: [0x2b442:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.437350:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+267:39029:x1731745946356416:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1005us (1169us total) trans 12885078821 rc 0/0 00010000:00010000:0.0:1651529344.437351:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4ff66 lrc: 3/0,1 mode: PW/PW res: [0x2b442:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.437353:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210766 00010000:00010000:0.0:1651529344.437353:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4ff66 lrc: 2/0,0 mode: PW/PW res: [0x2b442:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.437360:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d501883f/0x3234de053c4ff58 lrc: 3/0,1 mode: PW/PW res: [0x2b441:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.437363:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d501883f/0x3234de053c4ff58 lrc: 3/0,1 mode: PW/PW res: [0x2b441:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.437366:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d501883f/0x3234de053c4ff58 lrc: 3/0,1 mode: PW/PW res: [0x2b441:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.437369:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d501883f/0x3234de053c4ff58 lrc: 2/0,0 mode: PW/PW res: [0x2b441:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.437399:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+268:39029:x1731745946356608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 791us (849us total) trans 12885078822 rc 0/0 00000100:00100000:0.0:1651529344.437402:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210770 00000100:00100000:1.0:1651529344.437408:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+267:39029:x1731745946356544:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1006us (1106us total) trans 12885078823 rc 0/0 00010000:00010000:0.0:1651529344.437409:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4ff66 lrc: 2/0,0 mode: PW/PW res: [0x2b442:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.437411:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210768 00010000:00010000:0.0:1651529344.437413:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000041a7efd7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.437414:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4ff66 lrc: 2/0,0 mode: PW/PW res: [0x2b442:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437417:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4ff66 lrc: 3/0,0 mode: PW/PW res: [0x2b442:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.437418:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ebf7beea/0x3234de053c4ff6d lrc: 3/0,1 mode: PW/PW res: [0x2b443:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.437421:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ebf7beea/0x3234de053c4ff6d lrc: 3/0,1 mode: PW/PW res: [0x2b443:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437421:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4ff66 lrc: 1/0,0 mode: --/PW res: [0x2b442:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.437424:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebf7beea/0x3234de053c4ff6d lrc: 3/0,1 mode: PW/PW res: [0x2b443:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437424:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c4ff66 lrc: 0/0,0 mode: --/PW res: [0x2b442:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.437426:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ebf7beea/0x3234de053c4ff6d lrc: 2/0,0 mode: PW/PW res: [0x2b443:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437427:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d501883f/0x3234de053c4ff58 lrc: 2/0,0 mode: PW/PW res: [0x2b441:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437430:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d501883f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.437431:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d501883f/0x3234de053c4ff58 lrc: 2/0,0 mode: PW/PW res: [0x2b441:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437440:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d501883f/0x3234de053c4ff58 lrc: 3/0,0 mode: PW/PW res: [0x2b441:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437444:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d501883f/0x3234de053c4ff58 lrc: 1/0,0 mode: --/PW res: [0x2b441:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437447:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d501883f/0x3234de053c4ff58 lrc: 0/0,0 mode: --/PW res: [0x2b441:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437451:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ebf7beea/0x3234de053c4ff6d lrc: 2/0,0 mode: PW/PW res: [0x2b443:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437454:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ebf7beea already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.437454:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebf7beea/0x3234de053c4ff6d lrc: 2/0,0 mode: PW/PW res: [0x2b443:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437457:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebf7beea/0x3234de053c4ff6d lrc: 3/0,0 mode: PW/PW res: [0x2b443:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437460:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ebf7beea/0x3234de053c4ff6d lrc: 1/0,0 mode: --/PW res: [0x2b443:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.437463:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+267:39030:x1731745946356672:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 821us (899us total) trans 12885078824 rc 0/0 00010000:00010000:0.0:1651529344.437463:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ebf7beea/0x3234de053c4ff6d lrc: 0/0,0 mode: --/PW res: [0x2b443:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.437466:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210771 00010000:00010000:0.0:1651529344.437469:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4ff51 lrc: 3/0,1 mode: PW/PW res: [0x2b43e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.437472:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c4ff5f lrc: 3/0,1 mode: PW/PW res: [0x2b440:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437472:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4ff51 lrc: 3/0,1 mode: PW/PW res: [0x2b43e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437475:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4ff51 lrc: 3/0,1 mode: PW/PW res: [0x2b43e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437477:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4ff51 lrc: 2/0,0 mode: PW/PW res: [0x2b43e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.437478:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c4ff5f lrc: 3/0,1 mode: PW/PW res: [0x2b440:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.437481:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c4ff5f lrc: 3/0,1 mode: PW/PW res: [0x2b440:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.437483:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c4ff5f lrc: 2/0,0 mode: PW/PW res: [0x2b440:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.437520:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+268:39029:x1731745946356352:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1160us (1304us total) trans 12885078825 rc 0/0 00000100:00100000:1.0:1651529344.437521:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+268:39029:x1731745946356480:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1064us (1201us total) trans 12885078826 rc 0/0 00000100:00100000:0.0:1651529344.437523:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210767 00000100:00100000:1.0:1651529344.437524:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210769 00010000:00010000:0.0:1651529344.437530:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4ff51 lrc: 2/0,0 mode: PW/PW res: [0x2b43e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437533:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002731c8d2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.437534:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4ff51 lrc: 2/0,0 mode: PW/PW res: [0x2b43e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437537:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4ff51 lrc: 3/0,0 mode: PW/PW res: [0x2b43e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.437540:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.437541:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4ff51 lrc: 1/0,0 mode: --/PW res: [0x2b43e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437544:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c4ff51 lrc: 0/0,0 mode: --/PW res: [0x2b43e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437548:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c4ff5f lrc: 2/0,0 mode: PW/PW res: [0x2b440:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437551:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000009c5cbe9 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.437552:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c4ff5f lrc: 2/0,0 mode: PW/PW res: [0x2b440:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437564:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c4ff5f lrc: 3/0,0 mode: PW/PW res: [0x2b440:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437568:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c4ff5f lrc: 1/0,0 mode: --/PW res: [0x2b440:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437570:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c4ff5f lrc: 0/0,0 mode: --/PW res: [0x2b440:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.437579:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.437582:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996956160:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.437591:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4ff74 lrc: 3/0,1 mode: --/PW res: [0x2b444:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.437598:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396237824 00010000:00010000:0.0:1651529344.437602:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000531c1876/0x3234de053c4c146 lrc: 4/0,0 mode: PR/PR res: [0x2b444:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc7fa expref: 1794 pid: 80280 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.437608:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11554 00000100:00100000:0.0:1651529344.437610:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1794:41279:x1731746396237824:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.437612:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.437614:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000531c1876/0x3234de053c4c146 lrc: 4/0,0 mode: PR/PR res: [0x2b444:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc7fa expref: 1794 pid: 80280 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.437617:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000531c1876/0x3234de053c4c146 lrc: 3/0,0 mode: PR/PR res: [0x2b444:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc7fa expref: 1794 pid: 80280 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.437625:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000531c1876/0x3234de053c4c146 lrc: 0/0,0 mode: --/PR res: [0x2b444:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc7fa expref: 1794 pid: 80280 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.437628:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.437629:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.437629:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4ff74 lrc: 3/0,1 mode: PW/PW res: [0x2b444:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437632:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4ff74 lrc: 4/0,1 mode: PW/PW res: [0x2b444:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437638:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.437645:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1793:41279:x1731746396237824:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 35us (67us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.437648:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11554 00010000:00010000:0.0:1651529344.437653:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4ff74 lrc: 3/0,1 mode: PW/PW res: [0x2b444:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437656:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4ff74 lrc: 3/0,1 mode: PW/PW res: [0x2b444:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437659:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4ff74 lrc: 3/0,1 mode: PW/PW res: [0x2b444:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437662:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4ff74 lrc: 2/0,0 mode: PW/PW res: [0x2b444:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.437692:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946356928 00000100:00100000:1.0:1651529344.437704:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210773 00000100:00100000:1.0:1651529344.437705:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+268:39030:x1731745946356928:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.437711:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177221 count 1 00010000:00010000:1.0:1651529344.437715:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c4ff7b lrc: 3/0,1 mode: --/PW res: [0x2b445:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.437720:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000de1a14c6/0x3234de053c4e99b lrc: 2/0,0 mode: PR/PR res: [0x2b445:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d57e3 expref: 1792 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.437723:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.437724:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.437725:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c4ff7b lrc: 4/0,1 mode: --/PW res: [0x2b445:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.437732:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000de1a14c6/0x3234de053c4e99b lrc: 3/0,0 mode: PR/PR res: [0x2b445:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d57e3 expref: 1792 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.437744:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000de1a14c6/0x3234de053c4e99b lrc: 4/0,0 mode: PR/PR res: [0x2b445:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d57e3 expref: 1792 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.437748:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005a17dd72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996956224:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.437754:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a13808c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+268:39030:x1731745946356864:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 887us (1005us total) trans 12885078827 rc 0/0 00000100:00100000:0.0:1651529344.437757:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210772 00000100:00100000:1.0:1651529344.437764:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000004698fefb going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.437765:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4ff74 lrc: 2/0,0 mode: PW/PW res: [0x2b444:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437769:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b65e0a0d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.437770:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4ff74 lrc: 2/0,0 mode: PW/PW res: [0x2b444:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437772:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4ff74 lrc: 3/0,0 mode: PW/PW res: [0x2b444:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437777:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4ff74 lrc: 1/0,0 mode: --/PW res: [0x2b444:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437803:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c4ff74 lrc: 0/0,0 mode: --/PW res: [0x2b444:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.437831:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.437841:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.437841:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946357440 00000100:00100000:1.0:1651529344.437850:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.437860:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946357568 00000100:00100000:1.0:1651529344.437865:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.437865:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946357376 00000100:00100000:0.0:1651529344.437869:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946357504 00000100:00100000:1.0:1651529344.437873:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.437874:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210774 00000100:00100000:0.0:1651529344.437875:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+271:39029:x1731745946357440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.437884:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946357632 00002000:00080000:0.0:1651529344.437885:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177223 count 1 00010000:00010000:0.0:1651529344.437889:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4ff82 lrc: 3/0,1 mode: --/PW res: [0x2b447:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.437892:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210775 00000100:00100000:1.0:1651529344.437893:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+272:39029:x1731745946357568:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.437894:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fccb00ae/0x3234de053c4d375 lrc: 2/0,0 mode: PR/PR res: [0x2b447:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cffde expref: 1792 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.437897:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1651529344.437898:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177225 count 1 00010000:00010000:0.0:1651529344.437898:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.437899:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4ff82 lrc: 4/0,1 mode: --/PW res: [0x2b447:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.437903:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5772342/0x3234de053c4ff89 lrc: 3/0,1 mode: --/PW res: [0x2b449:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.437905:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fccb00ae/0x3234de053c4d375 lrc: 3/0,0 mode: PR/PR res: [0x2b447:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cffde expref: 1792 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.437907:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006325442a/0x3234de053c4ec49 lrc: 2/0,0 mode: PR/PR res: [0x2b449:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6286 expref: 1792 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.437911:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.437911:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.437912:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5772342/0x3234de053c4ff89 lrc: 4/0,1 mode: --/PW res: [0x2b449:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.437919:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006325442a/0x3234de053c4ec49 lrc: 3/0,0 mode: PR/PR res: [0x2b449:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6286 expref: 1792 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.437923:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006325442a/0x3234de053c4ec49 lrc: 4/0,0 mode: PR/PR res: [0x2b449:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6286 expref: 1792 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.437931:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fccb00ae/0x3234de053c4d375 lrc: 4/0,0 mode: PR/PR res: [0x2b447:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cffde expref: 1792 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.437934:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d718cfe4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996956352:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.437942:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 000000007e004c12 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.437948:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210776 00000100:00100000:1.0:1651529344.437950:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+272:39029:x1731745946357376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.437954:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177222 count 1 00000100:00100000:0.0:1651529344.437959:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996956288:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.437966:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e52c3e68/0x3234de053c4ff90 lrc: 3/0,1 mode: --/PW res: [0x2b446:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.437969:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c2b2b59c going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.437971:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000068486c62/0x3234de053c4d9d4 lrc: 2/0,0 mode: PR/PR res: [0x2b446:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d17d2 expref: 1792 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.437974:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.437975:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.437976:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e52c3e68/0x3234de053c4ff90 lrc: 4/0,1 mode: --/PW res: [0x2b446:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.437977:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210777 00000100:00100000:0.0:1651529344.437978:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+272:39029:x1731745946357504:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.437982:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000068486c62/0x3234de053c4d9d4 lrc: 3/0,0 mode: PR/PR res: [0x2b446:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d17d2 expref: 1792 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.437983:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177224 count 1 00010000:00010000:0.0:1651529344.437987:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4ff97 lrc: 3/0,1 mode: --/PW res: [0x2b448:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.437988:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000068486c62/0x3234de053c4d9d4 lrc: 4/0,0 mode: PR/PR res: [0x2b446:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d17d2 expref: 1792 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.437992:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a130088 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996956416:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.437992:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c4e908 lrc: 2/0,0 mode: PR/PR res: [0x2b448:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d54b7 expref: 1792 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.437998:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.437998:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.437999:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d09f5ee1 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.437999:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4ff97 lrc: 4/0,1 mode: --/PW res: [0x2b448:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.438005:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210778 00010000:00010000:0.0:1651529344.438005:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c4e908 lrc: 3/0,0 mode: PR/PR res: [0x2b448:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d54b7 expref: 1792 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.438007:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+272:39029:x1731745946357632:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.438008:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c4e908 lrc: 4/0,0 mode: PR/PR res: [0x2b448:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d54b7 expref: 1792 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:1.0:1651529344.438011:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177226 count 1 00000100:00100000:0.0:1651529344.438012:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996956480:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.438015:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df32da76/0x3234de053c4ff9e lrc: 3/0,1 mode: --/PW res: [0x2b44a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.438019:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c4dffb lrc: 2/0,0 mode: PR/PR res: [0x2b44a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d30f3 expref: 1792 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.438019:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 0000000070e666f7 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.438022:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.438022:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.438023:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df32da76/0x3234de053c4ff9e lrc: 4/0,1 mode: --/PW res: [0x2b44a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.438029:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c4dffb lrc: 3/0,0 mode: PR/PR res: [0x2b44a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d30f3 expref: 1792 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.438032:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c4dffb lrc: 4/0,0 mode: PR/PR res: [0x2b44a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d30f3 expref: 1792 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.438039:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000076d5f96b pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996956544:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.438045:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 0000000053a0cffa going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.438069:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.438091:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.438104:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396238080 00010000:00010000:0.0:1651529344.438109:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000de1a14c6/0x3234de053c4e99b lrc: 5/0,0 mode: PR/PR res: [0x2b445:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d57e3 expref: 1793 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.438114:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.438122:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11555 00000100:00100000:0.0:1651529344.438124:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1793:41278:x1731746396238080:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.438127:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.438128:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000de1a14c6/0x3234de053c4e99b lrc: 5/0,0 mode: PR/PR res: [0x2b445:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d57e3 expref: 1793 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.438132:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000de1a14c6/0x3234de053c4e99b lrc: 4/0,0 mode: PR/PR res: [0x2b445:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d57e3 expref: 1793 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.438140:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.438141:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.438141:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c4ff7b lrc: 3/0,1 mode: PW/PW res: [0x2b445:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.438144:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c4ff7b lrc: 4/0,1 mode: PW/PW res: [0x2b445:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.438149:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.438160:0:80276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de1a14c6/0x3234de053c4e99b lrc: 0/0,0 mode: --/PR res: [0x2b445:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d57e3 expref: 1793 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.438166:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1793:41278:x1731746396238080:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (76us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.438169:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11555 00000100:00100000:1.0:1651529344.438171:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005a17dd72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996956224:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.438174:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c4ff7b lrc: 3/0,1 mode: PW/PW res: [0x2b445:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.438177:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946357696 00010000:00010000:1.0:1651529344.438178:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c4ff7b lrc: 3/0,1 mode: PW/PW res: [0x2b445:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.438180:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c4ff7b lrc: 3/0,1 mode: PW/PW res: [0x2b445:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.438182:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946357760 00010000:00010000:1.0:1651529344.438183:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c4ff7b lrc: 3/0,1 mode: PW/PW res: [0x2b445:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.438185:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210779 00010000:00010000:1.0:1651529344.438186:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c4ff7b lrc: 2/0,0 mode: PW/PW res: [0x2b445:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.438187:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+274:39030:x1731745946357696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.438191:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177227 count 1 00010000:00010000:0.0:1651529344.438201:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006769cf41/0x3234de053c4ffa5 lrc: 3/0,1 mode: --/PW res: [0x2b44b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.438205:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d8c6a7f2/0x3234de053c4b2c1 lrc: 2/0,0 mode: PR/PR res: [0x2b44b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc15c expref: 1791 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.438208:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.438209:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.438210:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006769cf41/0x3234de053c4ffa5 lrc: 4/0,1 mode: --/PW res: [0x2b44b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.438219:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d8c6a7f2/0x3234de053c4b2c1 lrc: 3/0,0 mode: PR/PR res: [0x2b44b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc15c expref: 1791 pid: 72395 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.438243:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+275:39030:x1731745946356928:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 536us (702us total) trans 12885078828 rc 0/0 00000100:00100000:1.0:1651529344.438246:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210773 00010000:00010000:0.0:1651529344.438247:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d8c6a7f2/0x3234de053c4b2c1 lrc: 4/0,0 mode: PR/PR res: [0x2b44b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc15c expref: 1791 pid: 72395 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.438252:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210780 00000100:00100000:0.0:1651529344.438252:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996956608:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.438254:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+274:39030:x1731745946357760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.438258:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177228 count 1 00010000:00010000:1.0:1651529344.438262:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005796db08/0x3234de053c4ffac lrc: 3/0,1 mode: --/PW res: [0x2b44c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.438262:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000abca413e going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.438267:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f9ee567c/0x3234de053c4e9cc lrc: 2/0,0 mode: PR/PR res: [0x2b44c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d587d expref: 1791 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.438267:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c4ff7b lrc: 2/0,0 mode: PW/PW res: [0x2b445:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.438270:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.438270:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.438270:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000011345842 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.438271:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005796db08/0x3234de053c4ffac lrc: 4/0,1 mode: --/PW res: [0x2b44c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.438271:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c4ff7b lrc: 2/0,0 mode: PW/PW res: [0x2b445:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.438274:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c4ff7b lrc: 3/0,0 mode: PW/PW res: [0x2b445:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.438277:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f9ee567c/0x3234de053c4e9cc lrc: 3/0,0 mode: PR/PR res: [0x2b44c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d587d expref: 1791 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.438279:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c4ff7b lrc: 1/0,0 mode: --/PW res: [0x2b445:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.438281:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f9ee567c/0x3234de053c4e9cc lrc: 4/0,0 mode: PR/PR res: [0x2b44c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d587d expref: 1791 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.438281:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c4ff7b lrc: 0/0,0 mode: --/PW res: [0x2b445:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.438285:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e7f02909 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996956672:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.438293:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.438374:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d718cfe4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996956352:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.438378:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a5772342/0x3234de053c4ff89 lrc: 3/0,1 mode: --/PW res: [0x2b449:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.438425:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996956288:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.438431:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4ff82 lrc: 3/0,1 mode: --/PW res: [0x2b447:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.438499:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.438521:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996956480:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.438525:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4ff97 lrc: 3/0,1 mode: --/PW res: [0x2b448:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.438542:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a130088 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996956416:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.438546:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e52c3e68/0x3234de053c4ff90 lrc: 3/0,1 mode: --/PW res: [0x2b446:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.438558:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000076d5f96b pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996956544:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.438561:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000df32da76/0x3234de053c4ff9e lrc: 3/0,1 mode: --/PW res: [0x2b44a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.438566:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946358016 00000100:00100000:1.0:1651529344.438577:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210781 00000100:00100000:1.0:1651529344.438578:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046772bfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+275:39029:x1731745946358016:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.438583:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177229 count 1 00010000:00010000:1.0:1651529344.438587:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020b57374/0x3234de053c4ffb3 lrc: 3/0,1 mode: --/PW res: [0x2b44d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.438591:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002ba484f8/0x3234de053c4d2e9 lrc: 2/0,0 mode: PR/PR res: [0x2b44d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd76 expref: 1791 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.438595:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.438595:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.438596:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020b57374/0x3234de053c4ffb3 lrc: 4/0,1 mode: --/PW res: [0x2b44d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.438602:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002ba484f8/0x3234de053c4d2e9 lrc: 3/0,0 mode: PR/PR res: [0x2b44d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd76 expref: 1791 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.438606:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002ba484f8/0x3234de053c4d2e9 lrc: 4/0,0 mode: PR/PR res: [0x2b44d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd76 expref: 1791 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.438610:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000076d5f96b pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996956736:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.438618:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d09f5ee1 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.438638:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996956608:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.438642:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006769cf41/0x3234de053c4ffa5 lrc: 3/0,1 mode: --/PW res: [0x2b44b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.438669:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e7f02909 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996956672:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.438673:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005796db08/0x3234de053c4ffac lrc: 3/0,1 mode: --/PW res: [0x2b44c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.438826:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.438838:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.438846:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.438854:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.438858:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396238464 00000100:00100000:1.0:1651529344.438862:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.438864:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006325442a/0x3234de053c4ec49 lrc: 4/0,0 mode: PR/PR res: [0x2b449:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6286 expref: 1792 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.438867:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.438869:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11556 00000100:00100000:0.0:1651529344.438871:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1792:41279:x1731746396238464:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.438872:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.438874:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.438876:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006325442a/0x3234de053c4ec49 lrc: 4/0,0 mode: PR/PR res: [0x2b449:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6286 expref: 1792 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.438879:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006325442a/0x3234de053c4ec49 lrc: 3/0,0 mode: PR/PR res: [0x2b449:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6286 expref: 1792 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.438883:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000076d5f96b pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996956736:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.438885:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006325442a/0x3234de053c4ec49 lrc: 0/0,0 mode: --/PR res: [0x2b449:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6286 expref: 1792 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.438887:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000020b57374/0x3234de053c4ffb3 lrc: 3/0,1 mode: --/PW res: [0x2b44d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.438889:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.438889:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.438890:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a5772342/0x3234de053c4ff89 lrc: 3/0,1 mode: PW/PW res: [0x2b449:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.438893:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396238592 00010000:00010000:1.0:1651529344.438898:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fccb00ae/0x3234de053c4d375 lrc: 4/0,0 mode: PR/PR res: [0x2b447:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cffde expref: 1792 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.438904:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396238720 00010000:00010000:0.0:1651529344.438910:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5772342/0x3234de053c4ff89 lrc: 4/0,1 mode: PW/PW res: [0x2b449:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.438912:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000068486c62/0x3234de053c4d9d4 lrc: 4/0,0 mode: PR/PR res: [0x2b446:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d17d2 expref: 1793 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.438918:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.438922:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396238784 00010000:00010000:1.0:1651529344.438925:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c4e908 lrc: 4/0,0 mode: PR/PR res: [0x2b448:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d54b7 expref: 1794 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.438929:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1794:41279:x1731746396238464:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 57us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.438932:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11556 00000100:00100000:1.0:1651529344.438935:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396238976 00010000:00010000:1.0:1651529344.438937:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d8c6a7f2/0x3234de053c4b2c1 lrc: 4/0,0 mode: PR/PR res: [0x2b44b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc15c expref: 1794 pid: 72395 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.438937:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396238912 00010000:00010000:0.0:1651529344.438941:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c4dffb lrc: 4/0,0 mode: PR/PR res: [0x2b44a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d30f3 expref: 1795 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.438942:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396239040 00010000:00010000:1.0:1651529344.438944:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f9ee567c/0x3234de053c4e9cc lrc: 4/0,0 mode: PR/PR res: [0x2b44c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d587d expref: 1796 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.438947:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11557 00000100:00100000:0.0:1651529344.438949:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1796:41279:x1731746396238592:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.438950:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11558 00000100:00100000:1.0:1651529344.438951:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1796:41279:x1731746396238720:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.438951:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.438952:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fccb00ae/0x3234de053c4d375 lrc: 4/0,0 mode: PR/PR res: [0x2b447:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cffde expref: 1796 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.438954:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.438956:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000068486c62/0x3234de053c4d9d4 lrc: 4/0,0 mode: PR/PR res: [0x2b446:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d17d2 expref: 1796 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.438956:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fccb00ae/0x3234de053c4d375 lrc: 3/0,0 mode: PR/PR res: [0x2b447:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cffde expref: 1796 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.438959:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000068486c62/0x3234de053c4d9d4 lrc: 3/0,0 mode: PR/PR res: [0x2b446:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d17d2 expref: 1796 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.438961:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fccb00ae/0x3234de053c4d375 lrc: 0/0,0 mode: --/PR res: [0x2b447:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cffde expref: 1796 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.438965:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068486c62/0x3234de053c4d9d4 lrc: 0/0,0 mode: --/PR res: [0x2b446:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d17d2 expref: 1795 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.438965:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.438965:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.438966:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4ff82 lrc: 3/0,1 mode: PW/PW res: [0x2b447:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.438969:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.438969:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4ff82 lrc: 4/0,1 mode: PW/PW res: [0x2b447:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.438970:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.438970:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e52c3e68/0x3234de053c4ff90 lrc: 3/0,1 mode: PW/PW res: [0x2b446:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.438974:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e52c3e68/0x3234de053c4ff90 lrc: 4/0,1 mode: PW/PW res: [0x2b446:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.438976:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.438980:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.438981:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1794:41279:x1731746396238592:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 32us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.438984:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11557 00000100:00100000:1.0:1651529344.438987:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1793:41279:x1731746396238720:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 35us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.438988:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11559 00000100:00100000:1.0:1651529344.438990:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11558 00000100:00100000:0.0:1651529344.438990:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1793:41278:x1731746396238784:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.438992:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.438993:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c4e908 lrc: 4/0,0 mode: PR/PR res: [0x2b448:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d54b7 expref: 1792 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.438994:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11560 00000100:00100000:1.0:1651529344.438996:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ce633b1f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1792:41279:x1731746396238976:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.438997:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c4e908 lrc: 3/0,0 mode: PR/PR res: [0x2b448:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d54b7 expref: 1792 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.438998:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.439000:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d8c6a7f2/0x3234de053c4b2c1 lrc: 4/0,0 mode: PR/PR res: [0x2b44b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc15c expref: 1792 pid: 72395 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.439002:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c4e908 lrc: 0/0,0 mode: --/PR res: [0x2b448:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d54b7 expref: 1792 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.439003:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d8c6a7f2/0x3234de053c4b2c1 lrc: 3/0,0 mode: PR/PR res: [0x2b44b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc15c expref: 1792 pid: 72395 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.439005:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.439005:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.439006:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4ff97 lrc: 3/0,1 mode: PW/PW res: [0x2b448:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.439008:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8c6a7f2/0x3234de053c4b2c1 lrc: 0/0,0 mode: --/PR res: [0x2b44b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc15c expref: 1791 pid: 72395 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.439009:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4ff97 lrc: 4/0,1 mode: PW/PW res: [0x2b448:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.439011:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.439011:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.439012:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006769cf41/0x3234de053c4ffa5 lrc: 3/0,1 mode: PW/PW res: [0x2b44b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439014:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.439017:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006769cf41/0x3234de053c4ffa5 lrc: 4/0,1 mode: PW/PW res: [0x2b44b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.439019:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1790:41278:x1731746396238784:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 29us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.439021:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11559 00010000:00010000:1.0:1651529344.439027:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.439032:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11561 00000100:00100000:1.0:1651529344.439033:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ce633b1f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1789:41279:x1731746396238976:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 36us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.439033:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1789:41278:x1731746396238912:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.439036:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11560 00010000:00010000:0.0:1651529344.439036:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.439038:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c4dffb lrc: 4/0,0 mode: PR/PR res: [0x2b44a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d30f3 expref: 1789 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.439041:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c4dffb lrc: 3/0,0 mode: PR/PR res: [0x2b44a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d30f3 expref: 1788 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.439044:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11562 00000100:00100000:1.0:1651529344.439046:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1788:41278:x1731746396239040:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.439046:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c4dffb lrc: 0/0,0 mode: --/PR res: [0x2b44a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d30f3 expref: 1788 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.439048:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.439049:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f9ee567c/0x3234de053c4e9cc lrc: 4/0,0 mode: PR/PR res: [0x2b44c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d587d expref: 1787 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.439050:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.439050:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.439051:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000df32da76/0x3234de053c4ff9e lrc: 3/0,1 mode: PW/PW res: [0x2b44a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.439053:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f9ee567c/0x3234de053c4e9cc lrc: 3/0,0 mode: PR/PR res: [0x2b44c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d587d expref: 1787 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.439056:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df32da76/0x3234de053c4ff9e lrc: 4/0,1 mode: PW/PW res: [0x2b44a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.439058:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9ee567c/0x3234de053c4e9cc lrc: 0/0,0 mode: --/PR res: [0x2b44c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d587d expref: 1787 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.439061:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.439062:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.439063:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005796db08/0x3234de053c4ffac lrc: 3/0,1 mode: PW/PW res: [0x2b44c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439065:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.439071:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1786:41278:x1731746396238912:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (204us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.439072:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005796db08/0x3234de053c4ffac lrc: 4/0,1 mode: PW/PW res: [0x2b44c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.439073:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11561 00010000:00010000:1.0:1651529344.439080:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.439080:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4ff97 lrc: 3/0,1 mode: PW/PW res: [0x2b448:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439083:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4ff97 lrc: 3/0,1 mode: PW/PW res: [0x2b448:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.439086:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1785:41278:x1731746396239040:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 39us (214us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.439087:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4ff97 lrc: 3/0,1 mode: PW/PW res: [0x2b448:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.439088:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11562 00010000:00010000:0.0:1651529344.439089:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4ff97 lrc: 2/0,0 mode: PW/PW res: [0x2b448:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.439095:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a5772342/0x3234de053c4ff89 lrc: 3/0,1 mode: PW/PW res: [0x2b449:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.439098:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5772342/0x3234de053c4ff89 lrc: 3/0,1 mode: PW/PW res: [0x2b449:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.439101:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5772342/0x3234de053c4ff89 lrc: 3/0,1 mode: PW/PW res: [0x2b449:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.439104:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5772342/0x3234de053c4ff89 lrc: 2/0,0 mode: PW/PW res: [0x2b449:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.439135:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+277:39029:x1731745946357504:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1156us (1270us total) trans 12885078829 rc 0/0 00000100:00100000:0.0:1651529344.439138:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210777 00010000:00010000:0.0:1651529344.439145:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4ff97 lrc: 2/0,0 mode: PW/PW res: [0x2b448:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.439147:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+276:39029:x1731745946357568:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1253us (1306us total) trans 12885078830 rc 0/0 00010000:00010000:0.0:1651529344.439148:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e35b0bde already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.439149:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4ff97 lrc: 2/0,0 mode: PW/PW res: [0x2b448:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.439150:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210775 00010000:00010000:0.0:1651529344.439152:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4ff97 lrc: 3/0,0 mode: PW/PW res: [0x2b448:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439157:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4ff97 lrc: 1/0,0 mode: --/PW res: [0x2b448:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.439158:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e52c3e68/0x3234de053c4ff90 lrc: 3/0,1 mode: PW/PW res: [0x2b446:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439160:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c4ff97 lrc: 0/0,0 mode: --/PW res: [0x2b448:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.439161:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e52c3e68/0x3234de053c4ff90 lrc: 3/0,1 mode: PW/PW res: [0x2b446:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.439164:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e52c3e68/0x3234de053c4ff90 lrc: 3/0,1 mode: PW/PW res: [0x2b446:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439164:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5772342/0x3234de053c4ff89 lrc: 2/0,0 mode: PW/PW res: [0x2b449:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439166:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5772342 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.439167:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e52c3e68/0x3234de053c4ff90 lrc: 2/0,0 mode: PW/PW res: [0x2b446:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439167:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5772342/0x3234de053c4ff89 lrc: 2/0,0 mode: PW/PW res: [0x2b449:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439170:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5772342/0x3234de053c4ff89 lrc: 3/0,0 mode: PW/PW res: [0x2b449:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439173:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5772342/0x3234de053c4ff89 lrc: 1/0,0 mode: --/PW res: [0x2b449:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439182:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5772342/0x3234de053c4ff89 lrc: 0/0,0 mode: --/PW res: [0x2b449:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439186:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e52c3e68/0x3234de053c4ff90 lrc: 2/0,0 mode: PW/PW res: [0x2b446:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439189:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e52c3e68 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.439190:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e52c3e68/0x3234de053c4ff90 lrc: 2/0,0 mode: PW/PW res: [0x2b446:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439193:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e52c3e68/0x3234de053c4ff90 lrc: 3/0,0 mode: PW/PW res: [0x2b446:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439196:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e52c3e68/0x3234de053c4ff90 lrc: 1/0,0 mode: --/PW res: [0x2b446:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439199:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e52c3e68/0x3234de053c4ff90 lrc: 0/0,0 mode: --/PW res: [0x2b446:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.439203:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+276:39029:x1731745946357376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1253us (1353us total) trans 12885078831 rc 0/0 00010000:00010000:0.0:1651529344.439205:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4ff82 lrc: 3/0,1 mode: PW/PW res: [0x2b447:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.439206:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210776 00010000:00010000:0.0:1651529344.439208:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4ff82 lrc: 3/0,1 mode: PW/PW res: [0x2b447:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439211:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4ff82 lrc: 3/0,1 mode: PW/PW res: [0x2b447:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.439212:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000df32da76/0x3234de053c4ff9e lrc: 3/0,1 mode: PW/PW res: [0x2b44a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439213:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4ff82 lrc: 2/0,0 mode: PW/PW res: [0x2b447:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.439215:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df32da76/0x3234de053c4ff9e lrc: 3/0,1 mode: PW/PW res: [0x2b44a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.439218:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df32da76/0x3234de053c4ff9e lrc: 3/0,1 mode: PW/PW res: [0x2b44a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.439221:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df32da76/0x3234de053c4ff9e lrc: 2/0,0 mode: PW/PW res: [0x2b44a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.439271:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+277:39029:x1731745946357440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1395us (1441us total) trans 12885078832 rc 0/0 00000100:00100000:1.0:1651529344.439274:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+277:39029:x1731745946357632:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1266us (1400us total) trans 12885078833 rc 0/0 00000100:00100000:0.0:1651529344.439275:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210774 00000100:00100000:1.0:1651529344.439276:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210778 00010000:00010000:1.0:1651529344.439283:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005796db08/0x3234de053c4ffac lrc: 3/0,1 mode: PW/PW res: [0x2b44c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439285:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4ff82 lrc: 2/0,0 mode: PW/PW res: [0x2b447:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.439287:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005796db08/0x3234de053c4ffac lrc: 3/0,1 mode: PW/PW res: [0x2b44c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439288:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003c5315da already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.439289:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4ff82 lrc: 2/0,0 mode: PW/PW res: [0x2b447:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.439292:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005796db08/0x3234de053c4ffac lrc: 3/0,1 mode: PW/PW res: [0x2b44c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439292:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4ff82 lrc: 3/0,0 mode: PW/PW res: [0x2b447:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.439295:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005796db08/0x3234de053c4ffac lrc: 2/0,0 mode: PW/PW res: [0x2b44c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439296:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4ff82 lrc: 1/0,0 mode: --/PW res: [0x2b447:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439299:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c4ff82 lrc: 0/0,0 mode: --/PW res: [0x2b447:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439310:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df32da76/0x3234de053c4ff9e lrc: 2/0,0 mode: PW/PW res: [0x2b44a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439313:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000df32da76 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.439314:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df32da76/0x3234de053c4ff9e lrc: 2/0,0 mode: PW/PW res: [0x2b44a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439317:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df32da76/0x3234de053c4ff9e lrc: 3/0,0 mode: PW/PW res: [0x2b44a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439322:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df32da76/0x3234de053c4ff9e lrc: 1/0,0 mode: --/PW res: [0x2b44a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439325:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df32da76/0x3234de053c4ff9e lrc: 0/0,0 mode: --/PW res: [0x2b44a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439329:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005796db08/0x3234de053c4ffac lrc: 2/0,0 mode: PW/PW res: [0x2b44c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.439331:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+276:39030:x1731745946357760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1077us (1218us total) trans 12885078834 rc 0/0 00010000:00010000:0.0:1651529344.439331:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005796db08 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.439332:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005796db08/0x3234de053c4ffac lrc: 2/0,0 mode: PW/PW res: [0x2b44c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.439334:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210780 00010000:00010000:0.0:1651529344.439335:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005796db08/0x3234de053c4ffac lrc: 3/0,0 mode: PW/PW res: [0x2b44c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439338:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005796db08/0x3234de053c4ffac lrc: 1/0,0 mode: --/PW res: [0x2b44c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439341:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005796db08/0x3234de053c4ffac lrc: 0/0,0 mode: --/PW res: [0x2b44c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439348:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006769cf41/0x3234de053c4ffa5 lrc: 3/0,1 mode: PW/PW res: [0x2b44b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439351:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006769cf41/0x3234de053c4ffa5 lrc: 3/0,1 mode: PW/PW res: [0x2b44b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439356:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006769cf41/0x3234de053c4ffa5 lrc: 3/0,1 mode: PW/PW res: [0x2b44b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439359:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006769cf41/0x3234de053c4ffa5 lrc: 2/0,0 mode: PW/PW res: [0x2b44b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.439361:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.439401:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+276:39030:x1731745946357696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1213us (1332us total) trans 12885078835 rc 0/0 00000100:00100000:0.0:1651529344.439404:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210779 00010000:00010000:0.0:1651529344.439411:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006769cf41/0x3234de053c4ffa5 lrc: 2/0,0 mode: PW/PW res: [0x2b44b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439414:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006769cf41 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.439415:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006769cf41/0x3234de053c4ffa5 lrc: 2/0,0 mode: PW/PW res: [0x2b44b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439418:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006769cf41/0x3234de053c4ffa5 lrc: 3/0,0 mode: PW/PW res: [0x2b44b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439422:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006769cf41/0x3234de053c4ffa5 lrc: 1/0,0 mode: --/PW res: [0x2b44b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439425:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006769cf41/0x3234de053c4ffa5 lrc: 0/0,0 mode: --/PW res: [0x2b44b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.439432:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396239104 00010000:00010000:0.0:1651529344.439436:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002ba484f8/0x3234de053c4d2e9 lrc: 4/0,0 mode: PR/PR res: [0x2b44d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd76 expref: 1785 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.439442:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11563 00000100:00100000:0.0:1651529344.439444:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1785:41278:x1731746396239104:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.439447:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.439448:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002ba484f8/0x3234de053c4d2e9 lrc: 4/0,0 mode: PR/PR res: [0x2b44d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd76 expref: 1785 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.439451:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002ba484f8/0x3234de053c4d2e9 lrc: 3/0,0 mode: PR/PR res: [0x2b44d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd76 expref: 1785 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.439456:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ba484f8/0x3234de053c4d2e9 lrc: 0/0,0 mode: --/PR res: [0x2b44d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd76 expref: 1785 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.439459:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.439460:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.439461:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000020b57374/0x3234de053c4ffb3 lrc: 3/0,1 mode: PW/PW res: [0x2b44d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439464:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020b57374/0x3234de053c4ffb3 lrc: 4/0,1 mode: PW/PW res: [0x2b44d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.439483:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000020b57374/0x3234de053c4ffb3 lrc: 4/0,1 mode: PW/PW res: [0x2b44d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.439487:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020b57374/0x3234de053c4ffb3 lrc: 4/0,1 mode: PW/PW res: [0x2b44d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.439490:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020b57374/0x3234de053c4ffb3 lrc: 4/0,1 mode: PW/PW res: [0x2b44d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.439493:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000020b57374/0x3234de053c4ffb3 lrc: 2/0,0 mode: PW/PW res: [0x2b44d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439494:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.439512:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1784:41278:x1731746396239104:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 67us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.439514:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11563 00010000:00010000:0.0:1651529344.439521:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000020b57374/0x3234de053c4ffb3 lrc: 2/0,0 mode: PW/PW res: [0x2b44d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439525:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000020b57374 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.439526:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000020b57374/0x3234de053c4ffb3 lrc: 2/0,0 mode: PW/PW res: [0x2b44d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439528:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000020b57374/0x3234de053c4ffb3 lrc: 3/0,0 mode: PW/PW res: [0x2b44d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439533:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000020b57374/0x3234de053c4ffb3 lrc: 1/0,0 mode: --/PW res: [0x2b44d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439536:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020b57374/0x3234de053c4ffb3 lrc: 0/0,0 mode: --/PW res: [0x2b44d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.439541:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046772bfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+276:39029:x1731745946358016:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 962us (1042us total) trans 12885078836 rc 0/0 00000100:00100000:1.0:1651529344.439544:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210781 00000100:00100000:1.0:1651529344.439626:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.439635:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.439645:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946358464 00000100:00100000:0.0:1651529344.439645:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946358592 00000100:00100000:0.0:1651529344.439655:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210782 00000100:00100000:0.0:1651529344.439656:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+277:39030:x1731745946358592:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.439661:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210783 00002000:00080000:0.0:1651529344.439662:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177231 count 1 00000100:00100000:1.0:1651529344.439663:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+277:39030:x1731745946358464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.439668:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177230 count 1 00010000:00010000:1.0:1651529344.439673:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087cc6968/0x3234de053c4ffba lrc: 3/0,1 mode: --/PW res: [0x2b44e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.439678:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d22678ca/0x3234de053c4e232 lrc: 2/0,0 mode: PR/PR res: [0x2b44e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a2a expref: 1783 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.439681:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.439681:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.439682:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087cc6968/0x3234de053c4ffba lrc: 4/0,1 mode: --/PW res: [0x2b44e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.439689:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d22678ca/0x3234de053c4e232 lrc: 3/0,0 mode: PR/PR res: [0x2b44e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a2a expref: 1783 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.439692:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d22678ca/0x3234de053c4e232 lrc: 4/0,0 mode: PR/PR res: [0x2b44e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a2a expref: 1783 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.439702:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000206299e1/0x3234de053c4ffc1 lrc: 3/0,1 mode: --/PW res: [0x2b44f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439707:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002ed0cf25/0x3234de053c4c838 lrc: 2/0,0 mode: PR/PR res: [0x2b44f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd306 expref: 1783 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.439708:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000900b179f pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996956800:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.439711:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.439711:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.439712:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000206299e1/0x3234de053c4ffc1 lrc: 4/0,1 mode: --/PW res: [0x2b44f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.439719:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f9dac3f6 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.439722:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002ed0cf25/0x3234de053c4c838 lrc: 3/0,0 mode: PR/PR res: [0x2b44f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd306 expref: 1783 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.439726:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002ed0cf25/0x3234de053c4c838 lrc: 4/0,0 mode: PR/PR res: [0x2b44f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd306 expref: 1783 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.439730:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996956864:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.439757:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.439759:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 000000003c8b0daf going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.439771:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.439800:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.439810:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.439811:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946358784 00000100:00100000:1.0:1651529344.439817:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.439828:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946358720 00000100:00100000:0.0:1651529344.439832:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946358912 00000100:00100000:1.0:1651529344.439834:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.439842:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946358848 00000100:00100000:1.0:1651529344.439844:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946358976 00000100:00100000:0.0:1651529344.439848:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946359040 00000100:00100000:0.0:1651529344.439852:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210784 00000100:00100000:0.0:1651529344.439854:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+283:39030:x1731745946358784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.439856:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210785 00000100:00100000:1.0:1651529344.439858:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+283:39030:x1731745946358720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.439859:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177233 count 1 00002000:00080000:1.0:1651529344.439863:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177232 count 1 00010000:00010000:0.0:1651529344.439863:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000822170bb/0x3234de053c4ffc8 lrc: 3/0,1 mode: --/PW res: [0x2b451:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.439867:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e008fd4/0x3234de053c4ffcf lrc: 3/0,1 mode: --/PW res: [0x2b450:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439868:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003722c3ae/0x3234de053c4ad81 lrc: 2/0,0 mode: PR/PR res: [0x2b451:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbeed expref: 1783 pid: 80280 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.439871:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.439871:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.439872:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000042828b5e/0x3234de053c4c9ea lrc: 2/0,0 mode: PR/PR res: [0x2b450:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd9ab expref: 1783 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.439872:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000822170bb/0x3234de053c4ffc8 lrc: 4/0,1 mode: --/PW res: [0x2b451:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.439875:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.439876:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.439876:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e008fd4/0x3234de053c4ffcf lrc: 4/0,1 mode: --/PW res: [0x2b450:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439881:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003722c3ae/0x3234de053c4ad81 lrc: 3/0,0 mode: PR/PR res: [0x2b451:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbeed expref: 1783 pid: 80280 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.439883:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000042828b5e/0x3234de053c4c9ea lrc: 3/0,0 mode: PR/PR res: [0x2b450:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd9ab expref: 1783 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.439885:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003722c3ae/0x3234de053c4ad81 lrc: 4/0,0 mode: PR/PR res: [0x2b451:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbeed expref: 1783 pid: 80280 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.439886:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000042828b5e/0x3234de053c4c9ea lrc: 4/0,0 mode: PR/PR res: [0x2b450:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd9ab expref: 1783 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.439889:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996956928:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.439891:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005fb0ec6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996956992:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.439901:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aac87b31 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.439907:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 000000004698fefb going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.439908:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210786 00000100:00100000:0.0:1651529344.439910:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+283:39030:x1731745946358912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.439913:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210787 00000100:00100000:1.0:1651529344.439915:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+283:39030:x1731745946358848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.439915:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177235 count 1 00010000:00010000:0.0:1651529344.439918:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a53669fa/0x3234de053c4ffd6 lrc: 3/0,1 mode: --/PW res: [0x2b453:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.439921:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177234 count 1 00010000:00010000:0.0:1651529344.439922:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000086ec1398/0x3234de053c4ebc4 lrc: 2/0,0 mode: PR/PR res: [0x2b453:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d60b1 expref: 1783 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.439924:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a89dd07/0x3234de053c4ffdd lrc: 3/0,1 mode: --/PW res: [0x2b452:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439925:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.439926:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.439927:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a53669fa/0x3234de053c4ffd6 lrc: 4/0,1 mode: --/PW res: [0x2b453:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.439928:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c139ced0/0x3234de053c4dafa lrc: 2/0,0 mode: PR/PR res: [0x2b452:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c32 expref: 1783 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.439931:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.439932:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.439932:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a89dd07/0x3234de053c4ffdd lrc: 4/0,1 mode: --/PW res: [0x2b452:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.439933:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000086ec1398/0x3234de053c4ebc4 lrc: 3/0,0 mode: PR/PR res: [0x2b453:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d60b1 expref: 1783 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.439936:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000086ec1398/0x3234de053c4ebc4 lrc: 4/0,0 mode: PR/PR res: [0x2b453:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d60b1 expref: 1783 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.439938:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c139ced0/0x3234de053c4dafa lrc: 3/0,0 mode: PR/PR res: [0x2b452:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c32 expref: 1783 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.439940:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996957056:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.439942:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c139ced0/0x3234de053c4dafa lrc: 4/0,0 mode: PR/PR res: [0x2b452:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c32 expref: 1783 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.439945:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000066de8c9f pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996957120:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.439952:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.439958:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210788 00000100:00100000:1.0:1651529344.439959:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+283:39029:x1731745946359040:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.439963:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177237 count 1 00010000:00010000:1.0:1651529344.439967:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000133f5138/0x3234de053c4ffe4 lrc: 3/0,1 mode: --/PW res: [0x2b455:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.439971:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004c8a102b/0x3234de053c4ef7c lrc: 2/0,0 mode: PR/PR res: [0x2b455:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7016 expref: 1783 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.439973:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a3b00cf3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.439974:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.439975:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.439975:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000133f5138/0x3234de053c4ffe4 lrc: 4/0,1 mode: --/PW res: [0x2b455:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.439981:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004c8a102b/0x3234de053c4ef7c lrc: 3/0,0 mode: PR/PR res: [0x2b455:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7016 expref: 1783 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.439981:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210789 00000100:00100000:0.0:1651529344.439982:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+283:39030:x1731745946358976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.439984:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004c8a102b/0x3234de053c4ef7c lrc: 4/0,0 mode: PR/PR res: [0x2b455:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7016 expref: 1783 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.439987:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000064719963 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996957184:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.439987:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177236 count 1 00010000:00010000:0.0:1651529344.439991:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049a3f5ac/0x3234de053c4ffeb lrc: 3/0,1 mode: --/PW res: [0x2b454:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.439994:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000babe2d90 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.439995:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b163d7c2/0x3234de053c4e58f lrc: 2/0,0 mode: PR/PR res: [0x2b454:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d47b3 expref: 1783 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.439998:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.439999:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.439999:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049a3f5ac/0x3234de053c4ffeb lrc: 4/0,1 mode: --/PW res: [0x2b454:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440005:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b163d7c2/0x3234de053c4e58f lrc: 3/0,0 mode: PR/PR res: [0x2b454:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d47b3 expref: 1783 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.440009:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b163d7c2/0x3234de053c4e58f lrc: 4/0,0 mode: PR/PR res: [0x2b454:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d47b3 expref: 1783 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.440013:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996957248:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.440020:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000076b354b3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.440087:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000900b179f pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996956800:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.440091:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000087cc6968/0x3234de053c4ffba lrc: 3/0,1 mode: --/PW res: [0x2b44e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.440268:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.440279:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396239552 00010000:00010000:0.0:1651529344.440290:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d22678ca/0x3234de053c4e232 lrc: 4/0,0 mode: PR/PR res: [0x2b44e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a2a expref: 1784 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.440297:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11564 00000100:00100000:0.0:1651529344.440299:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1784:41279:x1731746396239552:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.440302:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.440319:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d22678ca/0x3234de053c4e232 lrc: 4/0,0 mode: PR/PR res: [0x2b44e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a2a expref: 1784 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.440323:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d22678ca/0x3234de053c4e232 lrc: 3/0,0 mode: PR/PR res: [0x2b44e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a2a expref: 1784 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.440329:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d22678ca/0x3234de053c4e232 lrc: 0/0,0 mode: --/PR res: [0x2b44e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a2a expref: 1784 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.440354:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.440355:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.440356:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000087cc6968/0x3234de053c4ffba lrc: 3/0,1 mode: PW/PW res: [0x2b44e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440359:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087cc6968/0x3234de053c4ffba lrc: 4/0,1 mode: PW/PW res: [0x2b44e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440368:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.440371:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005fb0ec6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996956992:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.440375:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003e008fd4/0x3234de053c4ffcf lrc: 3/0,1 mode: --/PW res: [0x2b450:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.440379:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1783:41279:x1731746396239552:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 79us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.440382:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11564 00010000:00010000:1.0:1651529344.440385:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000087cc6968/0x3234de053c4ffba lrc: 3/0,1 mode: PW/PW res: [0x2b44e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.440390:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087cc6968/0x3234de053c4ffba lrc: 3/0,1 mode: PW/PW res: [0x2b44e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.440393:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996956928:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.440394:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087cc6968/0x3234de053c4ffba lrc: 3/0,1 mode: PW/PW res: [0x2b44e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.440396:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087cc6968/0x3234de053c4ffba lrc: 2/0,0 mode: PW/PW res: [0x2b44e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440397:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000822170bb/0x3234de053c4ffc8 lrc: 3/0,1 mode: --/PW res: [0x2b451:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.440413:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996956864:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.440416:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000206299e1/0x3234de053c4ffc1 lrc: 3/0,1 mode: --/PW res: [0x2b44f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440421:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087cc6968/0x3234de053c4ffba lrc: 2/0,0 mode: PW/PW res: [0x2b44e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440424:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000087cc6968 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.440425:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087cc6968/0x3234de053c4ffba lrc: 2/0,0 mode: PW/PW res: [0x2b44e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440428:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087cc6968/0x3234de053c4ffba lrc: 3/0,0 mode: PW/PW res: [0x2b44e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440432:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087cc6968/0x3234de053c4ffba lrc: 1/0,0 mode: --/PW res: [0x2b44e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440435:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087cc6968/0x3234de053c4ffba lrc: 0/0,0 mode: --/PW res: [0x2b44e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.440441:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+284:39030:x1731745946358464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 777us (815us total) trans 12885078837 rc 0/0 00000100:00100000:1.0:1651529344.440444:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210783 00000100:00100000:0.0:1651529344.440606:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996957056:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.440607:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.440615:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.440615:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a53669fa/0x3234de053c4ffd6 lrc: 3/0,1 mode: --/PW res: [0x2b453:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.440624:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.440629:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996957248:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.440631:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.440632:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000049a3f5ac/0x3234de053c4ffeb lrc: 3/0,1 mode: --/PW res: [0x2b454:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.440639:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.440644:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.440649:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.440662:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396239872 00000100:00100000:1.0:1651529344.440663:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.440666:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000042828b5e/0x3234de053c4c9ea lrc: 4/0,0 mode: PR/PR res: [0x2b450:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd9ab expref: 1783 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.440672:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396239680 00000100:00100000:1.0:1651529344.440673:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000066de8c9f pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996957120:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.440674:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002ed0cf25/0x3234de053c4c838 lrc: 4/0,0 mode: PR/PR res: [0x2b44f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd306 expref: 1784 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.440677:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007a89dd07/0x3234de053c4ffdd lrc: 3/0,1 mode: --/PW res: [0x2b452:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.440678:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396239808 00010000:00010000:0.0:1651529344.440680:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003722c3ae/0x3234de053c4ad81 lrc: 4/0,0 mode: PR/PR res: [0x2b451:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbeed expref: 1785 pid: 80280 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.440684:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000064719963 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996957184:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.440684:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396239936 00010000:00010000:0.0:1651529344.440686:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c139ced0/0x3234de053c4dafa lrc: 4/0,0 mode: PR/PR res: [0x2b452:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c32 expref: 1786 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.440687:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000133f5138/0x3234de053c4ffe4 lrc: 3/0,1 mode: --/PW res: [0x2b455:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.440690:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396240000 00010000:00010000:0.0:1651529344.440692:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000086ec1398/0x3234de053c4ebc4 lrc: 4/0,0 mode: PR/PR res: [0x2b453:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d60b1 expref: 1787 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.440693:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946359104 00000100:00100000:0.0:1651529344.440696:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396240128 00010000:00010000:0.0:1651529344.440698:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b163d7c2/0x3234de053c4e58f lrc: 4/0,0 mode: PR/PR res: [0x2b454:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d47b3 expref: 1788 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.440705:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210790 00000100:00100000:1.0:1651529344.440706:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+284:39029:x1731745946359104:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.440709:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396240064 00002000:00080000:1.0:1651529344.440711:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177238 count 1 00010000:00010000:0.0:1651529344.440712:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004c8a102b/0x3234de053c4ef7c lrc: 4/0,0 mode: PR/PR res: [0x2b455:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7016 expref: 1789 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.440716:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077695175/0x3234de053c4fff2 lrc: 3/0,1 mode: --/PW res: [0x2b456:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.440717:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11565 00000100:00100000:0.0:1651529344.440718:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1789:41279:x1731746396239872:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.440720:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009a42426c/0x3234de053c4d39f lrc: 2/0,0 mode: PR/PR res: [0x2b456:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0094 expref: 1789 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.440721:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.440722:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000042828b5e/0x3234de053c4c9ea lrc: 4/0,0 mode: PR/PR res: [0x2b450:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd9ab expref: 1789 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.440723:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.440724:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.440724:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077695175/0x3234de053c4fff2 lrc: 4/0,1 mode: --/PW res: [0x2b456:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440726:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000042828b5e/0x3234de053c4c9ea lrc: 3/0,0 mode: PR/PR res: [0x2b450:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd9ab expref: 1789 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.440731:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009a42426c/0x3234de053c4d39f lrc: 3/0,0 mode: PR/PR res: [0x2b456:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0094 expref: 1789 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.440731:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042828b5e/0x3234de053c4c9ea lrc: 0/0,0 mode: --/PR res: [0x2b450:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd9ab expref: 1789 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.440744:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009a42426c/0x3234de053c4d39f lrc: 4/0,0 mode: PR/PR res: [0x2b456:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0094 expref: 1788 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.440744:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.440745:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.440746:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003e008fd4/0x3234de053c4ffcf lrc: 3/0,1 mode: PW/PW res: [0x2b450:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.440748:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a13808c6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996957312:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.440749:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e008fd4/0x3234de053c4ffcf lrc: 4/0,1 mode: PW/PW res: [0x2b450:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440758:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.440764:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.440765:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1788:41279:x1731746396239872:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 46us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.440768:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11565 00010000:00010000:1.0:1651529344.440769:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003e008fd4/0x3234de053c4ffcf lrc: 3/0,1 mode: PW/PW res: [0x2b450:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.440772:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e008fd4/0x3234de053c4ffcf lrc: 3/0,1 mode: PW/PW res: [0x2b450:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.440773:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11566 00010000:00010000:1.0:1651529344.440775:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e008fd4/0x3234de053c4ffcf lrc: 3/0,1 mode: PW/PW res: [0x2b450:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.440775:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1787:41279:x1731746396239680:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.440777:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.440778:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e008fd4/0x3234de053c4ffcf lrc: 2/0,0 mode: PW/PW res: [0x2b450:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440779:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002ed0cf25/0x3234de053c4c838 lrc: 4/0,0 mode: PR/PR res: [0x2b44f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd306 expref: 1787 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.440782:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002ed0cf25/0x3234de053c4c838 lrc: 3/0,0 mode: PR/PR res: [0x2b44f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd306 expref: 1787 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.440794:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ed0cf25/0x3234de053c4c838 lrc: 0/0,0 mode: --/PR res: [0x2b44f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd306 expref: 1787 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.440797:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.440798:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.440799:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000206299e1/0x3234de053c4ffc1 lrc: 3/0,1 mode: PW/PW res: [0x2b44f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440801:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000206299e1/0x3234de053c4ffc1 lrc: 4/0,1 mode: PW/PW res: [0x2b44f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440807:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.440812:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1786:41279:x1731746396239680:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.440814:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11566 00000100:00100000:0.0:1651529344.440819:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11567 00000100:00100000:1.0:1651529344.440820:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+285:39030:x1731745946358720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 961us (1048us total) trans 12885078838 rc 0/0 00000100:00100000:0.0:1651529344.440820:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000039bebb6e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1785:41279:x1731746396239808:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.440823:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210785 00010000:00010000:0.0:1651529344.440823:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.440824:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003722c3ae/0x3234de053c4ad81 lrc: 4/0,0 mode: PR/PR res: [0x2b451:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbeed expref: 1785 pid: 80280 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.440827:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003722c3ae/0x3234de053c4ad81 lrc: 3/0,0 mode: PR/PR res: [0x2b451:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbeed expref: 1785 pid: 80280 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.440831:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11568 00010000:00010000:0.0:1651529344.440832:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003722c3ae/0x3234de053c4ad81 lrc: 0/0,0 mode: --/PR res: [0x2b451:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbeed expref: 1785 pid: 80280 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.440833:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1785:41279:x1731746396239936:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.440835:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.440835:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.440836:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000822170bb/0x3234de053c4ffc8 lrc: 3/0,1 mode: PW/PW res: [0x2b451:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.440837:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.440838:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c139ced0/0x3234de053c4dafa lrc: 4/0,0 mode: PR/PR res: [0x2b452:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c32 expref: 1784 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.440839:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000822170bb/0x3234de053c4ffc8 lrc: 4/0,1 mode: PW/PW res: [0x2b451:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.440842:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c139ced0/0x3234de053c4dafa lrc: 3/0,0 mode: PR/PR res: [0x2b452:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c32 expref: 1784 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.440844:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.440848:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c139ced0/0x3234de053c4dafa lrc: 0/0,0 mode: --/PR res: [0x2b452:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c32 expref: 1784 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.440849:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000039bebb6e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1784:41279:x1731746396239808:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 28us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.440851:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11567 00010000:00010000:1.0:1651529344.440852:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.440852:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.440853:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007a89dd07/0x3234de053c4ffdd lrc: 3/0,1 mode: PW/PW res: [0x2b452:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.440856:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a89dd07/0x3234de053c4ffdd lrc: 4/0,1 mode: PW/PW res: [0x2b452:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.440858:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11569 00000100:00100000:0.0:1651529344.440860:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1782:41279:x1731746396240000:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.440862:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.440863:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.440864:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000086ec1398/0x3234de053c4ebc4 lrc: 4/0,0 mode: PR/PR res: [0x2b453:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d60b1 expref: 1782 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.440867:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000086ec1398/0x3234de053c4ebc4 lrc: 3/0,0 mode: PR/PR res: [0x2b453:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d60b1 expref: 1782 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.440868:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1782:41279:x1731746396239936:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 34us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.440871:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11568 00010000:00010000:0.0:1651529344.440872:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086ec1398/0x3234de053c4ebc4 lrc: 0/0,0 mode: --/PR res: [0x2b453:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d60b1 expref: 1782 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.440875:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11570 00010000:00010000:0.0:1651529344.440875:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.440876:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.440876:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a53669fa/0x3234de053c4ffd6 lrc: 3/0,1 mode: PW/PW res: [0x2b453:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.440877:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1780:41279:x1731746396240128:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.440879:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.440879:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a53669fa/0x3234de053c4ffd6 lrc: 4/0,1 mode: PW/PW res: [0x2b453:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.440880:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b163d7c2/0x3234de053c4e58f lrc: 4/0,0 mode: PR/PR res: [0x2b454:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d47b3 expref: 1780 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.440884:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b163d7c2/0x3234de053c4e58f lrc: 3/0,0 mode: PR/PR res: [0x2b454:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d47b3 expref: 1780 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.440885:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.440889:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b163d7c2/0x3234de053c4e58f lrc: 0/0,0 mode: --/PR res: [0x2b454:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d47b3 expref: 1780 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.440889:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1780:41279:x1731746396240000:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 29us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.440891:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11569 00010000:00010000:1.0:1651529344.440892:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.440892:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.440893:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000049a3f5ac/0x3234de053c4ffeb lrc: 3/0,1 mode: PW/PW res: [0x2b454:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.440895:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11571 00000100:00100000:0.0:1651529344.440897:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1778:41279:x1731746396240064:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.440899:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049a3f5ac/0x3234de053c4ffeb lrc: 4/0,1 mode: PW/PW res: [0x2b454:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440899:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.440900:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004c8a102b/0x3234de053c4ef7c lrc: 4/0,0 mode: PR/PR res: [0x2b455:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7016 expref: 1778 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.440904:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004c8a102b/0x3234de053c4ef7c lrc: 3/0,0 mode: PR/PR res: [0x2b455:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7016 expref: 1778 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.440908:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.440913:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1778:41279:x1731746396240128:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 36us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.440916:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11570 00010000:00010000:0.0:1651529344.440916:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c8a102b/0x3234de053c4ef7c lrc: 0/0,0 mode: --/PR res: [0x2b455:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7016 expref: 1778 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.440920:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.440920:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.440921:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000133f5138/0x3234de053c4ffe4 lrc: 3/0,1 mode: PW/PW res: [0x2b455:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.440922:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007a89dd07/0x3234de053c4ffdd lrc: 3/0,1 mode: PW/PW res: [0x2b452:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440924:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000133f5138/0x3234de053c4ffe4 lrc: 4/0,1 mode: PW/PW res: [0x2b455:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.440925:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a89dd07/0x3234de053c4ffdd lrc: 3/0,1 mode: PW/PW res: [0x2b452:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.440928:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a89dd07/0x3234de053c4ffdd lrc: 3/0,1 mode: PW/PW res: [0x2b452:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440932:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.440937:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a89dd07/0x3234de053c4ffdd lrc: 2/0,0 mode: PW/PW res: [0x2b452:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.440938:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1776:41279:x1731746396240064:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.440940:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11571 00010000:00010000:0.0:1651529344.440953:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e008fd4/0x3234de053c4ffcf lrc: 2/0,0 mode: PW/PW res: [0x2b450:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440957:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003e008fd4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.440958:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e008fd4/0x3234de053c4ffcf lrc: 2/0,0 mode: PW/PW res: [0x2b450:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440961:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e008fd4/0x3234de053c4ffcf lrc: 3/0,0 mode: PW/PW res: [0x2b450:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440965:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e008fd4/0x3234de053c4ffcf lrc: 1/0,0 mode: --/PW res: [0x2b450:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440970:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e008fd4/0x3234de053c4ffcf lrc: 0/0,0 mode: --/PW res: [0x2b450:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440974:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a89dd07/0x3234de053c4ffdd lrc: 2/0,0 mode: PW/PW res: [0x2b452:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.440977:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+285:39030:x1731745946358848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1061us (1166us total) trans 12885078839 rc 0/0 00010000:00010000:0.0:1651529344.440977:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a89dd07 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.440977:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a89dd07/0x3234de053c4ffdd lrc: 2/0,0 mode: PW/PW res: [0x2b452:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.440980:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210787 00010000:00010000:0.0:1651529344.440980:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a89dd07/0x3234de053c4ffdd lrc: 3/0,0 mode: PW/PW res: [0x2b452:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440983:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a89dd07/0x3234de053c4ffdd lrc: 1/0,0 mode: --/PW res: [0x2b452:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.440986:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000133f5138/0x3234de053c4ffe4 lrc: 3/0,1 mode: PW/PW res: [0x2b455:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440986:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a89dd07/0x3234de053c4ffdd lrc: 0/0,0 mode: --/PW res: [0x2b452:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.440990:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000133f5138/0x3234de053c4ffe4 lrc: 3/0,1 mode: PW/PW res: [0x2b455:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440992:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a53669fa/0x3234de053c4ffd6 lrc: 3/0,1 mode: PW/PW res: [0x2b453:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.440993:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000133f5138/0x3234de053c4ffe4 lrc: 3/0,1 mode: PW/PW res: [0x2b455:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440995:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a53669fa/0x3234de053c4ffd6 lrc: 3/0,1 mode: PW/PW res: [0x2b453:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.440996:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000133f5138/0x3234de053c4ffe4 lrc: 2/0,0 mode: PW/PW res: [0x2b455:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.440997:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a53669fa/0x3234de053c4ffd6 lrc: 3/0,1 mode: PW/PW res: [0x2b453:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441000:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a53669fa/0x3234de053c4ffd6 lrc: 2/0,0 mode: PW/PW res: [0x2b453:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.441033:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+286:39029:x1731745946359040:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1073us (1199us total) trans 12885078840 rc 0/0 00000100:00100000:1.0:1651529344.441036:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210788 00000100:00100000:0.0:1651529344.441047:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+285:39030:x1731745946358912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1136us (1246us total) trans 12885078841 rc 0/0 00000100:00100000:0.0:1651529344.441050:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210786 00010000:00010000:0.0:1651529344.441058:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000133f5138/0x3234de053c4ffe4 lrc: 2/0,0 mode: PW/PW res: [0x2b455:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441061:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000133f5138 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.441062:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000133f5138/0x3234de053c4ffe4 lrc: 2/0,0 mode: PW/PW res: [0x2b455:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441065:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000133f5138/0x3234de053c4ffe4 lrc: 3/0,0 mode: PW/PW res: [0x2b455:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441069:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000133f5138/0x3234de053c4ffe4 lrc: 1/0,0 mode: --/PW res: [0x2b455:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441072:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000133f5138/0x3234de053c4ffe4 lrc: 0/0,0 mode: --/PW res: [0x2b455:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441076:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a53669fa/0x3234de053c4ffd6 lrc: 2/0,0 mode: PW/PW res: [0x2b453:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441079:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a53669fa already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.441080:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a53669fa/0x3234de053c4ffd6 lrc: 2/0,0 mode: PW/PW res: [0x2b453:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441083:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a53669fa/0x3234de053c4ffd6 lrc: 3/0,0 mode: PW/PW res: [0x2b453:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441086:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a53669fa/0x3234de053c4ffd6 lrc: 1/0,0 mode: --/PW res: [0x2b453:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441088:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a53669fa/0x3234de053c4ffd6 lrc: 0/0,0 mode: --/PW res: [0x2b453:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441094:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000049a3f5ac/0x3234de053c4ffeb lrc: 3/0,1 mode: PW/PW res: [0x2b454:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441097:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049a3f5ac/0x3234de053c4ffeb lrc: 3/0,1 mode: PW/PW res: [0x2b454:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441100:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049a3f5ac/0x3234de053c4ffeb lrc: 3/0,1 mode: PW/PW res: [0x2b454:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441102:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049a3f5ac/0x3234de053c4ffeb lrc: 2/0,0 mode: PW/PW res: [0x2b454:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.441157:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+285:39030:x1731745946358976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1174us (1339us total) trans 12885078842 rc 0/0 00000100:00100000:0.0:1651529344.441161:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210789 00010000:00010000:0.0:1651529344.441180:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049a3f5ac/0x3234de053c4ffeb lrc: 2/0,0 mode: PW/PW res: [0x2b454:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441184:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000049a3f5ac already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.441185:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049a3f5ac/0x3234de053c4ffeb lrc: 2/0,0 mode: PW/PW res: [0x2b454:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441188:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049a3f5ac/0x3234de053c4ffeb lrc: 3/0,0 mode: PW/PW res: [0x2b454:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441193:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049a3f5ac/0x3234de053c4ffeb lrc: 1/0,0 mode: --/PW res: [0x2b454:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441195:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049a3f5ac/0x3234de053c4ffeb lrc: 0/0,0 mode: --/PW res: [0x2b454:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441202:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000822170bb/0x3234de053c4ffc8 lrc: 3/0,1 mode: PW/PW res: [0x2b451:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441219:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000822170bb/0x3234de053c4ffc8 lrc: 3/0,1 mode: PW/PW res: [0x2b451:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441240:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000822170bb/0x3234de053c4ffc8 lrc: 3/0,1 mode: PW/PW res: [0x2b451:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441243:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000822170bb/0x3234de053c4ffc8 lrc: 2/0,0 mode: PW/PW res: [0x2b451:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.441248:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a13808c6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996957312:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.441253:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000077695175/0x3234de053c4fff2 lrc: 3/0,1 mode: --/PW res: [0x2b456:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.441285:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+285:39030:x1731745946358784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1430us (1527us total) trans 12885078843 rc 0/0 00000100:00100000:0.0:1651529344.441288:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210784 00010000:00010000:0.0:1651529344.441323:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000822170bb/0x3234de053c4ffc8 lrc: 2/0,0 mode: PW/PW res: [0x2b451:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441327:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000822170bb already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.441328:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000822170bb/0x3234de053c4ffc8 lrc: 2/0,0 mode: PW/PW res: [0x2b451:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441332:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000822170bb/0x3234de053c4ffc8 lrc: 3/0,0 mode: PW/PW res: [0x2b451:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441336:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000822170bb/0x3234de053c4ffc8 lrc: 1/0,0 mode: --/PW res: [0x2b451:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.441338:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.441339:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000822170bb/0x3234de053c4ffc8 lrc: 0/0,0 mode: --/PW res: [0x2b451:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.441354:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396240192 00000100:00100000:1.0:1651529344.441356:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.441363:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009a42426c/0x3234de053c4d39f lrc: 4/0,0 mode: PR/PR res: [0x2b456:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0094 expref: 1776 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.441374:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11572 00000100:00100000:0.0:1651529344.441375:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a13808c6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1776:41278:x1731746396240192:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.441402:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.441404:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009a42426c/0x3234de053c4d39f lrc: 4/0,0 mode: PR/PR res: [0x2b456:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0094 expref: 1776 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.441410:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009a42426c/0x3234de053c4d39f lrc: 3/0,0 mode: PR/PR res: [0x2b456:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0094 expref: 1776 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.441416:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.441416:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a42426c/0x3234de053c4d39f lrc: 0/0,0 mode: --/PR res: [0x2b456:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0094 expref: 1776 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.441419:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.441425:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.441426:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.441426:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000077695175/0x3234de053c4fff2 lrc: 3/0,1 mode: PW/PW res: [0x2b456:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441434:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077695175/0x3234de053c4fff2 lrc: 4/0,1 mode: PW/PW res: [0x2b456:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.441435:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.441444:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.441447:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.441458:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a13808c6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1775:41278:x1731746396240192:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 82us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.441475:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11572 00000100:00100000:0.0:1651529344.441483:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946359616 00000100:00100000:0.0:1651529344.441492:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946359872 00000100:00100000:1.0:1651529344.441494:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.441504:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946359744 00000100:00100000:0.0:1651529344.441511:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946359808 00000100:00100000:0.0:1651529344.441517:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946359936 00000100:00100000:0.0:1651529344.441520:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946360000 00000100:00100000:1.0:1651529344.441523:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210791 00000100:00100000:1.0:1651529344.441525:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+290:39029:x1731745946359616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.441525:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210792 00000100:00100000:0.0:1651529344.441527:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+290:39029:x1731745946359872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.441531:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177239 count 1 00002000:00080000:0.0:1651529344.441532:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177242 count 1 00010000:00010000:1.0:1651529344.441535:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0098f22/0x3234de053c4fff9 lrc: 3/0,1 mode: --/PW res: [0x2b457:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441537:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e445b065/0x3234de053c50000 lrc: 3/0,1 mode: --/PW res: [0x2b45a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.441542:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000431e46a9/0x3234de053c4e51f lrc: 2/0,0 mode: PR/PR res: [0x2b457:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4583 expref: 1774 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.441542:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea03f360/0x3234de053c4c95e lrc: 2/0,0 mode: PR/PR res: [0x2b45a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd6fd expref: 1774 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.441545:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.441545:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.441546:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.441546:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.441546:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e445b065/0x3234de053c50000 lrc: 4/0,1 mode: --/PW res: [0x2b45a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.441547:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0098f22/0x3234de053c4fff9 lrc: 4/0,1 mode: --/PW res: [0x2b457:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441553:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ea03f360/0x3234de053c4c95e lrc: 3/0,0 mode: PR/PR res: [0x2b45a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd6fd expref: 1774 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.441554:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000431e46a9/0x3234de053c4e51f lrc: 3/0,0 mode: PR/PR res: [0x2b457:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4583 expref: 1774 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.441557:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ea03f360/0x3234de053c4c95e lrc: 4/0,0 mode: PR/PR res: [0x2b45a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd6fd expref: 1774 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.441558:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000431e46a9/0x3234de053c4e51f lrc: 4/0,0 mode: PR/PR res: [0x2b457:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4583 expref: 1774 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.441561:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996957376:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.441562:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000822949b3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996957440:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.441574:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 0000000076b354b3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.441580:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.441581:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210793 00000100:00100000:0.0:1651529344.441583:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+290:39029:x1731745946359744:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.441586:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210794 00002000:00080000:0.0:1651529344.441587:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177240 count 1 00000100:00100000:1.0:1651529344.441588:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+290:39029:x1731745946359808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.441591:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035aeb0fb/0x3234de053c50007 lrc: 3/0,1 mode: --/PW res: [0x2b458:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.441593:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177241 count 1 00010000:00010000:0.0:1651529344.441595:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f64f7b54/0x3234de053c4cf9a lrc: 2/0,0 mode: PR/PR res: [0x2b458:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceffb expref: 1774 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.441596:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c5000e lrc: 3/0,1 mode: --/PW res: [0x2b459:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.441601:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c4eeb8 lrc: 2/0,0 mode: PR/PR res: [0x2b459:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6cdc expref: 1774 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.441601:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.441601:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.441602:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035aeb0fb/0x3234de053c50007 lrc: 4/0,1 mode: --/PW res: [0x2b458:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.441603:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.441604:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.441605:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c5000e lrc: 4/0,1 mode: --/PW res: [0x2b459:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441608:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f64f7b54/0x3234de053c4cf9a lrc: 3/0,0 mode: PR/PR res: [0x2b458:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceffb expref: 1774 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.441611:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c4eeb8 lrc: 3/0,0 mode: PR/PR res: [0x2b459:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6cdc expref: 1774 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.441611:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f64f7b54/0x3234de053c4cf9a lrc: 4/0,0 mode: PR/PR res: [0x2b458:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceffb expref: 1774 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.441615:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c4eeb8 lrc: 4/0,0 mode: PR/PR res: [0x2b459:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6cdc expref: 1774 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.441615:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996957504:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.441618:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000064719963 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996957568:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.441622:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 000000000e7e66c4 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.441625:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 0000000053a0cffa going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.441628:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210795 00000100:00100000:0.0:1651529344.441630:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+290:39029:x1731745946359936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.441631:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210796 00000100:00100000:1.0:1651529344.441633:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+290:39030:x1731745946360000:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.441633:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177243 count 1 00010000:00010000:0.0:1651529344.441636:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fc3d0e3/0x3234de053c50015 lrc: 3/0,1 mode: --/PW res: [0x2b45b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.441637:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177244 count 1 00010000:00010000:1.0:1651529344.441640:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006878ab38/0x3234de053c5001c lrc: 3/0,1 mode: --/PW res: [0x2b45c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441641:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008c816b20/0x3234de053c4ac5b lrc: 2/0,0 mode: PR/PR res: [0x2b45b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe84 expref: 1774 pid: 80281 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.441644:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b46893f6/0x3234de053c4c82a lrc: 2/0,0 mode: PR/PR res: [0x2b45c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd2ce expref: 1774 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.441644:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.441644:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.441645:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000fc3d0e3/0x3234de053c50015 lrc: 4/0,1 mode: --/PW res: [0x2b45b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.441647:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.441647:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.441648:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006878ab38/0x3234de053c5001c lrc: 4/0,1 mode: --/PW res: [0x2b45c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441652:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008c816b20/0x3234de053c4ac5b lrc: 3/0,0 mode: PR/PR res: [0x2b45b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe84 expref: 1774 pid: 80281 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.441654:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b46893f6/0x3234de053c4c82a lrc: 3/0,0 mode: PR/PR res: [0x2b45c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd2ce expref: 1774 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.441656:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008c816b20/0x3234de053c4ac5b lrc: 4/0,0 mode: PR/PR res: [0x2b45b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe84 expref: 1774 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.441659:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b46893f6/0x3234de053c4c82a lrc: 4/0,0 mode: PR/PR res: [0x2b45c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd2ce expref: 1774 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.441660:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996957632:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.441663:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000066de8c9f pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996957696:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.441666:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 000000000a4def41 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.441669:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 000000004698fefb going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.441673:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000206299e1/0x3234de053c4ffc1 lrc: 3/0,1 mode: PW/PW res: [0x2b44f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.441675:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000077695175/0x3234de053c4fff2 lrc: 3/0,1 mode: PW/PW res: [0x2b456:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441676:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000206299e1/0x3234de053c4ffc1 lrc: 3/0,1 mode: PW/PW res: [0x2b44f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.441678:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077695175/0x3234de053c4fff2 lrc: 3/0,1 mode: PW/PW res: [0x2b456:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441680:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000206299e1/0x3234de053c4ffc1 lrc: 3/0,1 mode: PW/PW res: [0x2b44f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.441682:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077695175/0x3234de053c4fff2 lrc: 3/0,1 mode: PW/PW res: [0x2b456:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441683:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000206299e1/0x3234de053c4ffc1 lrc: 2/0,0 mode: PW/PW res: [0x2b44f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.441684:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000077695175/0x3234de053c4fff2 lrc: 2/0,0 mode: PW/PW res: [0x2b456:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.441728:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+292:39029:x1731745946359104:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1020us (1064us total) trans 12885078844 rc 0/0 00000100:00100000:1.0:1651529344.441731:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210790 00000100:00100000:0.0:1651529344.441731:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+292:39030:x1731745946358592:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 2074us (2096us total) trans 12885078845 rc 0/0 00000100:00100000:0.0:1651529344.441744:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210782 00010000:00010000:0.0:1651529344.441753:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000206299e1/0x3234de053c4ffc1 lrc: 2/0,0 mode: PW/PW res: [0x2b44f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441758:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000206299e1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.441759:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000206299e1/0x3234de053c4ffc1 lrc: 2/0,0 mode: PW/PW res: [0x2b44f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441762:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000206299e1/0x3234de053c4ffc1 lrc: 3/0,0 mode: PW/PW res: [0x2b44f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441767:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000206299e1/0x3234de053c4ffc1 lrc: 1/0,0 mode: --/PW res: [0x2b44f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441770:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000206299e1/0x3234de053c4ffc1 lrc: 0/0,0 mode: --/PW res: [0x2b44f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441774:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000077695175/0x3234de053c4fff2 lrc: 2/0,0 mode: PW/PW res: [0x2b456:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441776:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000077695175 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.441777:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000077695175/0x3234de053c4fff2 lrc: 2/0,0 mode: PW/PW res: [0x2b456:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441780:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000077695175/0x3234de053c4fff2 lrc: 3/0,0 mode: PW/PW res: [0x2b456:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441783:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000077695175/0x3234de053c4fff2 lrc: 1/0,0 mode: --/PW res: [0x2b456:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.441786:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077695175/0x3234de053c4fff2 lrc: 0/0,0 mode: --/PW res: [0x2b456:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.441975:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.441986:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.441986:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946360128 00000100:00100000:0.0:1651529344.441996:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946360064 00000100:00100000:0.0:1651529344.442003:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210797 00000100:00100000:0.0:1651529344.442004:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+292:39029:x1731745946360128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.442007:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210798 00000100:00100000:1.0:1651529344.442009:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+292:39029:x1731745946360064:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.442010:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177246 count 1 00002000:00080000:1.0:1651529344.442014:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177245 count 1 00010000:00010000:0.0:1651529344.442014:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c50023 lrc: 3/0,1 mode: --/PW res: [0x2b45e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442018:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001f14837b/0x3234de053c4eb93 lrc: 2/0,0 mode: PR/PR res: [0x2b45e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5fc3 expref: 1774 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.442019:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000773eb1ef/0x3234de053c5002a lrc: 3/0,1 mode: --/PW res: [0x2b45d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442021:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.442022:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.442023:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c50023 lrc: 4/0,1 mode: --/PW res: [0x2b45e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.442024:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005e8ef8f3/0x3234de053c4c97a lrc: 2/0,0 mode: PR/PR res: [0x2b45d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd7a5 expref: 1774 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.442027:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.442028:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.442028:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000773eb1ef/0x3234de053c5002a lrc: 4/0,1 mode: --/PW res: [0x2b45d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442029:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001f14837b/0x3234de053c4eb93 lrc: 3/0,0 mode: PR/PR res: [0x2b45e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5fc3 expref: 1774 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.442032:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001f14837b/0x3234de053c4eb93 lrc: 4/0,0 mode: PR/PR res: [0x2b45e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5fc3 expref: 1774 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.442035:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005e8ef8f3/0x3234de053c4c97a lrc: 3/0,0 mode: PR/PR res: [0x2b45d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd7a5 expref: 1774 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.442037:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996957760:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.442039:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005e8ef8f3/0x3234de053c4c97a lrc: 4/0,0 mode: PR/PR res: [0x2b45d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd7a5 expref: 1774 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.442043:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006929eb96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996957824:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.442058:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000babe2d90 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.442078:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060852af0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.442112:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996957376:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.442116:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e445b065/0x3234de053c50000 lrc: 3/0,1 mode: --/PW res: [0x2b45a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.442140:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.442140:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996957504:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.442149:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.442159:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.442167:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000035aeb0fb/0x3234de053c50007 lrc: 3/0,1 mode: --/PW res: [0x2b458:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.442176:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396240576 00000100:00100000:1.0:1651529344.442178:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000064719963 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996957568:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.442180:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ea03f360/0x3234de053c4c95e lrc: 4/0,0 mode: PR/PR res: [0x2b45a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd6fd expref: 1775 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.442182:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c5000e lrc: 3/0,1 mode: --/PW res: [0x2b459:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.442190:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396240640 00010000:00010000:0.0:1651529344.442193:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000431e46a9/0x3234de053c4e51f lrc: 5/0,0 mode: PR/PR res: [0x2b457:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4583 expref: 1776 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.442196:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000822949b3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996957440:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.442197:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396240704 00010000:00010000:1.0:1651529344.442199:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d0098f22/0x3234de053c4fff9 lrc: 3/0,1 mode: --/PW res: [0x2b457:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442199:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f64f7b54/0x3234de053c4cf9a lrc: 4/0,0 mode: PR/PR res: [0x2b458:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceffb expref: 1777 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.442204:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11573 00000100:00100000:1.0:1651529344.442206:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11574 00000100:00100000:0.0:1651529344.442206:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1777:41278:x1731746396240576:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.442208:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000f76b19f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1777:41279:x1731746396240640:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.442209:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.442210:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ea03f360/0x3234de053c4c95e lrc: 4/0,0 mode: PR/PR res: [0x2b45a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd6fd expref: 1777 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.442212:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.442213:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000431e46a9/0x3234de053c4e51f lrc: 4/0,0 mode: PR/PR res: [0x2b457:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4583 expref: 1777 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.442213:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ea03f360/0x3234de053c4c95e lrc: 3/0,0 mode: PR/PR res: [0x2b45a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd6fd expref: 1777 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.442217:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000431e46a9/0x3234de053c4e51f lrc: 3/0,0 mode: PR/PR res: [0x2b457:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4583 expref: 1777 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.442242:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000431e46a9/0x3234de053c4e51f lrc: 0/0,0 mode: --/PR res: [0x2b457:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4583 expref: 1777 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.442246:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.442247:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.442248:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d0098f22/0x3234de053c4fff9 lrc: 3/0,1 mode: PW/PW res: [0x2b457:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.442251:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0098f22/0x3234de053c4fff9 lrc: 4/0,1 mode: PW/PW res: [0x2b457:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.442257:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.442264:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000f76b19f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1776:41279:x1731746396240640:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 55us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.442266:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11574 00010000:00010000:0.0:1651529344.442269:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea03f360/0x3234de053c4c95e lrc: 0/0,0 mode: --/PR res: [0x2b45a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd6fd expref: 1775 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.442272:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11575 00010000:00010000:0.0:1651529344.442273:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.442273:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.442274:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1774:41278:x1731746396240704:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.442274:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e445b065/0x3234de053c50000 lrc: 3/0,1 mode: PW/PW res: [0x2b45a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.442276:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.442277:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e445b065/0x3234de053c50000 lrc: 4/0,1 mode: PW/PW res: [0x2b45a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.442278:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f64f7b54/0x3234de053c4cf9a lrc: 4/0,0 mode: PR/PR res: [0x2b458:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceffb expref: 1774 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.442282:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f64f7b54/0x3234de053c4cf9a lrc: 3/0,0 mode: PR/PR res: [0x2b458:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceffb expref: 1774 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.442286:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f64f7b54/0x3234de053c4cf9a lrc: 0/0,0 mode: --/PR res: [0x2b458:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceffb expref: 1774 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.442290:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.442290:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.442291:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000035aeb0fb/0x3234de053c50007 lrc: 3/0,1 mode: PW/PW res: [0x2b458:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442293:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.442294:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035aeb0fb/0x3234de053c50007 lrc: 4/0,1 mode: PW/PW res: [0x2b458:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.442304:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.442307:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1773:41278:x1731746396240576:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 95us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.442309:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1773:41278:x1731746396240704:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.442310:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11573 00000100:00100000:1.0:1651529344.442312:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11575 00010000:00010000:1.0:1651529344.442318:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d0098f22/0x3234de053c4fff9 lrc: 3/0,1 mode: PW/PW res: [0x2b457:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.442321:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0098f22/0x3234de053c4fff9 lrc: 3/0,1 mode: PW/PW res: [0x2b457:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442322:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e445b065/0x3234de053c50000 lrc: 3/0,1 mode: PW/PW res: [0x2b45a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442325:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e445b065/0x3234de053c50000 lrc: 3/0,1 mode: PW/PW res: [0x2b45a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.442327:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0098f22/0x3234de053c4fff9 lrc: 3/0,1 mode: PW/PW res: [0x2b457:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442328:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e445b065/0x3234de053c50000 lrc: 3/0,1 mode: PW/PW res: [0x2b45a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.442330:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0098f22/0x3234de053c4fff9 lrc: 2/0,0 mode: PW/PW res: [0x2b457:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442331:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e445b065/0x3234de053c50000 lrc: 2/0,0 mode: PW/PW res: [0x2b45a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.442370:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+294:39029:x1731745946359616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 845us (1014us total) trans 12885078846 rc 0/0 00000100:00100000:1.0:1651529344.442373:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210791 00000100:00100000:0.0:1651529344.442379:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+293:39029:x1731745946359872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 851us (963us total) trans 12885078847 rc 0/0 00000100:00100000:0.0:1651529344.442382:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210792 00010000:00010000:0.0:1651529344.442389:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0098f22/0x3234de053c4fff9 lrc: 2/0,0 mode: PW/PW res: [0x2b457:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442393:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d0098f22 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.442394:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0098f22/0x3234de053c4fff9 lrc: 2/0,0 mode: PW/PW res: [0x2b457:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442397:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0098f22/0x3234de053c4fff9 lrc: 3/0,0 mode: PW/PW res: [0x2b457:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442402:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0098f22/0x3234de053c4fff9 lrc: 1/0,0 mode: --/PW res: [0x2b457:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442405:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0098f22/0x3234de053c4fff9 lrc: 0/0,0 mode: --/PW res: [0x2b457:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442415:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e445b065/0x3234de053c50000 lrc: 2/0,0 mode: PW/PW res: [0x2b45a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442418:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e445b065 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.442419:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e445b065/0x3234de053c50000 lrc: 2/0,0 mode: PW/PW res: [0x2b45a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442424:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e445b065/0x3234de053c50000 lrc: 3/0,0 mode: PW/PW res: [0x2b45a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442428:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e445b065/0x3234de053c50000 lrc: 1/0,0 mode: --/PW res: [0x2b45a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442431:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e445b065/0x3234de053c50000 lrc: 0/0,0 mode: --/PW res: [0x2b45a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442441:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000035aeb0fb/0x3234de053c50007 lrc: 3/0,1 mode: PW/PW res: [0x2b458:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442444:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035aeb0fb/0x3234de053c50007 lrc: 3/0,1 mode: PW/PW res: [0x2b458:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442447:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035aeb0fb/0x3234de053c50007 lrc: 3/0,1 mode: PW/PW res: [0x2b458:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442450:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035aeb0fb/0x3234de053c50007 lrc: 2/0,0 mode: PW/PW res: [0x2b458:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.442479:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000066de8c9f pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996957696:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.442483:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006878ab38/0x3234de053c5001c lrc: 3/0,1 mode: --/PW res: [0x2b45c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.442491:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+293:39029:x1731745946359744:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 907us (1064us total) trans 12885078848 rc 0/0 00000100:00100000:0.0:1651529344.442494:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210793 00000100:00100000:1.0:1651529344.442497:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006929eb96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996957824:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.442500:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000773eb1ef/0x3234de053c5002a lrc: 3/0,1 mode: --/PW res: [0x2b45d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442501:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035aeb0fb/0x3234de053c50007 lrc: 2/0,0 mode: PW/PW res: [0x2b458:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442507:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000035aeb0fb already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.442508:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035aeb0fb/0x3234de053c50007 lrc: 2/0,0 mode: PW/PW res: [0x2b458:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442510:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035aeb0fb/0x3234de053c50007 lrc: 3/0,0 mode: PW/PW res: [0x2b458:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442536:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035aeb0fb/0x3234de053c50007 lrc: 1/0,0 mode: --/PW res: [0x2b458:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442539:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035aeb0fb/0x3234de053c50007 lrc: 0/0,0 mode: --/PW res: [0x2b458:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.442546:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.442557:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.442564:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396240832 00010000:00010000:1.0:1651529344.442569:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c4eeb8 lrc: 4/0,0 mode: PR/PR res: [0x2b459:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6cdc expref: 1772 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.442575:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396240896 00010000:00010000:1.0:1651529344.442577:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008c816b20/0x3234de053c4ac5b lrc: 5/0,0 mode: PR/PR res: [0x2b45b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe84 expref: 1773 pid: 80281 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.442586:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996957632:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.442590:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000fc3d0e3/0x3234de053c50015 lrc: 3/0,1 mode: --/PW res: [0x2b45b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.442596:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11576 00000100:00100000:1.0:1651529344.442598:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1773:41278:x1731746396240832:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.442599:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11577 00010000:00010000:1.0:1651529344.442601:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.442601:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1773:41279:x1731746396240896:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.442602:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c4eeb8 lrc: 4/0,0 mode: PR/PR res: [0x2b459:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6cdc expref: 1773 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.442604:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.442606:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c4eeb8 lrc: 3/0,0 mode: PR/PR res: [0x2b459:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6cdc expref: 1773 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.442606:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008c816b20/0x3234de053c4ac5b lrc: 4/0,0 mode: PR/PR res: [0x2b45b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe84 expref: 1773 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.442610:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008c816b20/0x3234de053c4ac5b lrc: 3/0,0 mode: PR/PR res: [0x2b45b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe84 expref: 1773 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.442611:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c4eeb8 lrc: 0/0,0 mode: --/PR res: [0x2b459:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6cdc expref: 1773 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.442615:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.442616:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.442616:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c5000e lrc: 3/0,1 mode: PW/PW res: [0x2b459:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.442620:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c5000e lrc: 4/0,1 mode: PW/PW res: [0x2b459:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.442631:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.442635:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c816b20/0x3234de053c4ac5b lrc: 0/0,0 mode: --/PR res: [0x2b45b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe84 expref: 1772 pid: 80281 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.442638:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1772:41278:x1731746396240832:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 39us (92us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.442639:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.442639:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.442640:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000fc3d0e3/0x3234de053c50015 lrc: 3/0,1 mode: PW/PW res: [0x2b45b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.442641:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11576 00010000:00010000:0.0:1651529344.442643:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000fc3d0e3/0x3234de053c50015 lrc: 4/0,1 mode: PW/PW res: [0x2b45b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.442647:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c5000e lrc: 3/0,1 mode: PW/PW res: [0x2b459:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.442650:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c5000e lrc: 3/0,1 mode: PW/PW res: [0x2b459:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442650:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.442653:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c5000e lrc: 3/0,1 mode: PW/PW res: [0x2b459:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.442656:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c5000e lrc: 2/0,0 mode: PW/PW res: [0x2b459:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.442658:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1770:41279:x1731746396240896:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 56us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.442661:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11577 00010000:00010000:0.0:1651529344.442674:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c5000e lrc: 2/0,0 mode: PW/PW res: [0x2b459:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442688:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c78576a1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.442689:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c5000e lrc: 2/0,0 mode: PW/PW res: [0x2b459:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442693:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c5000e lrc: 3/0,0 mode: PW/PW res: [0x2b459:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.442697:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+293:39029:x1731745946359808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1108us (1261us total) trans 12885078849 rc 0/0 00010000:00010000:0.0:1651529344.442697:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c5000e lrc: 1/0,0 mode: --/PW res: [0x2b459:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.442699:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210794 00010000:00010000:0.0:1651529344.442702:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c5000e lrc: 0/0,0 mode: --/PW res: [0x2b459:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442709:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000fc3d0e3/0x3234de053c50015 lrc: 3/0,1 mode: PW/PW res: [0x2b45b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442712:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000fc3d0e3/0x3234de053c50015 lrc: 3/0,1 mode: PW/PW res: [0x2b45b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.442713:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.442715:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fc3d0e3/0x3234de053c50015 lrc: 3/0,1 mode: PW/PW res: [0x2b45b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442723:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000fc3d0e3/0x3234de053c50015 lrc: 2/0,0 mode: PW/PW res: [0x2b45b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.442756:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.442772:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+293:39029:x1731745946359936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1141us (1327us total) trans 12885078850 rc 0/0 00000100:00100000:0.0:1651529344.442775:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210795 00000100:00100000:0.0:1651529344.442780:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946360576 00000100:00100000:1.0:1651529344.442787:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.442787:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210799 00000100:00100000:0.0:1651529344.442789:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+293:39030:x1731745946360576:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.442794:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177248 count 1 00010000:00010000:0.0:1651529344.442798:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e52c3e68/0x3234de053c50031 lrc: 3/0,1 mode: --/PW res: [0x2b460:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442802:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000006156151/0x3234de053c4cb2c lrc: 2/0,0 mode: PR/PR res: [0x2b460:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde20 expref: 1769 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.442805:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.442806:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.442807:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e52c3e68/0x3234de053c50031 lrc: 4/0,1 mode: --/PW res: [0x2b460:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442813:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000006156151/0x3234de053c4cb2c lrc: 3/0,0 mode: PR/PR res: [0x2b460:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde20 expref: 1769 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.442814:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.442816:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000006156151/0x3234de053c4cb2c lrc: 4/0,0 mode: PR/PR res: [0x2b460:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde20 expref: 1769 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.442828:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996957888:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.442837:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 000000000a4def41 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.442842:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000fc3d0e3/0x3234de053c50015 lrc: 2/0,0 mode: PW/PW res: [0x2b45b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.442843:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.442845:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000fc3d0e3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.442846:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000fc3d0e3/0x3234de053c50015 lrc: 2/0,0 mode: PW/PW res: [0x2b45b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442849:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000fc3d0e3/0x3234de053c50015 lrc: 3/0,0 mode: PW/PW res: [0x2b45b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442854:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000fc3d0e3/0x3234de053c50015 lrc: 1/0,0 mode: --/PW res: [0x2b45b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.442859:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000fc3d0e3/0x3234de053c50015 lrc: 0/0,0 mode: --/PW res: [0x2b45b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.442870:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.442879:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946360512 00000100:00100000:0.0:1651529344.442883:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946360640 00000100:00100000:1.0:1651529344.442886:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210800 00000100:00100000:1.0:1651529344.442888:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+295:39030:x1731745946360512:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.442895:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210801 00000100:00100000:0.0:1651529344.442897:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+295:39030:x1731745946360640:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.442899:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177247 count 1 00010000:00010000:1.0:1651529344.442904:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001750092b/0x3234de053c50038 lrc: 3/0,1 mode: --/PW res: [0x2b45f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.442909:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c4e821 lrc: 2/0,0 mode: PR/PR res: [0x2b45f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d514c expref: 1769 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.442912:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.442913:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.442913:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001750092b/0x3234de053c50038 lrc: 4/0,1 mode: --/PW res: [0x2b45f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.442914:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177249 count 1 00010000:00010000:1.0:1651529344.442920:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c4e821 lrc: 3/0,0 mode: PR/PR res: [0x2b45f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d514c expref: 1769 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.442924:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c4e821 lrc: 4/0,0 mode: PR/PR res: [0x2b45f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d514c expref: 1769 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.442931:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5772342/0x3234de053c5003f lrc: 3/0,1 mode: --/PW res: [0x2b461:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.442933:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000076d5f96b pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996957952:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.442936:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ce366906/0x3234de053c4a5b6 lrc: 2/0,0 mode: PR/PR res: [0x2b461:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb4a expref: 1769 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.442939:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.442940:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.442940:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5772342/0x3234de053c5003f lrc: 4/0,1 mode: --/PW res: [0x2b461:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.442943:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.442947:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ce366906/0x3234de053c4a5b6 lrc: 3/0,0 mode: PR/PR res: [0x2b461:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb4a expref: 1769 pid: 106695 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.442950:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396241152 00010000:00010000:0.0:1651529344.442951:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ce366906/0x3234de053c4a5b6 lrc: 4/0,0 mode: PR/PR res: [0x2b461:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb4a expref: 1769 pid: 106695 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.442955:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001f14837b/0x3234de053c4eb93 lrc: 5/0,0 mode: PR/PR res: [0x2b45e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5fc3 expref: 1770 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.442955:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996958016:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.442960:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396241088 00010000:00010000:1.0:1651529344.442962:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b46893f6/0x3234de053c4c82a lrc: 4/0,0 mode: PR/PR res: [0x2b45c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd2ce expref: 1771 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.442964:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 0000000070e666f7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.442966:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396241216 00010000:00010000:1.0:1651529344.442968:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005e8ef8f3/0x3234de053c4c97a lrc: 4/0,0 mode: PR/PR res: [0x2b45d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd7a5 expref: 1772 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.442972:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11578 00000100:00100000:1.0:1651529344.442974:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1772:41279:x1731746396241152:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.442977:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.442978:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001f14837b/0x3234de053c4eb93 lrc: 5/0,0 mode: PR/PR res: [0x2b45e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5fc3 expref: 1772 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.442981:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001f14837b/0x3234de053c4eb93 lrc: 4/0,0 mode: PR/PR res: [0x2b45e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5fc3 expref: 1772 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.442987:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.442987:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.442988:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c50023 lrc: 3/0,1 mode: PW/PW res: [0x2b45e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.442991:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c50023 lrc: 4/0,1 mode: PW/PW res: [0x2b45e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.442996:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.442997:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11579 00000100:00100000:0.0:1651529344.442999:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1772:41278:x1731746396241088:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.443002:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.443004:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b46893f6/0x3234de053c4c82a lrc: 4/0,0 mode: PR/PR res: [0x2b45c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd2ce expref: 1772 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.443008:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b46893f6/0x3234de053c4c82a lrc: 3/0,0 mode: PR/PR res: [0x2b45c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd2ce expref: 1772 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.443012:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1772:41279:x1731746396241152:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (298us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.443014:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b46893f6/0x3234de053c4c82a lrc: 0/0,0 mode: --/PR res: [0x2b45c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd2ce expref: 1772 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.443015:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11578 00010000:00010000:0.0:1651529344.443017:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.443018:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.443019:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11580 00010000:00010000:0.0:1651529344.443019:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006878ab38/0x3234de053c5001c lrc: 3/0,1 mode: PW/PW res: [0x2b45c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.443021:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1770:41278:x1731746396241216:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.443022:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006878ab38/0x3234de053c5001c lrc: 4/0,1 mode: PW/PW res: [0x2b45c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.443023:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.443025:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005e8ef8f3/0x3234de053c4c97a lrc: 4/0,0 mode: PR/PR res: [0x2b45d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd7a5 expref: 1770 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.443029:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005e8ef8f3/0x3234de053c4c97a lrc: 3/0,0 mode: PR/PR res: [0x2b45d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd7a5 expref: 1770 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.443031:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.443040:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e8ef8f3/0x3234de053c4c97a lrc: 0/0,0 mode: --/PR res: [0x2b45d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd7a5 expref: 1770 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.443044:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.443045:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.443045:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000773eb1ef/0x3234de053c5002a lrc: 3/0,1 mode: PW/PW res: [0x2b45d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.443048:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000773eb1ef/0x3234de053c5002a lrc: 4/0,1 mode: PW/PW res: [0x2b45d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.443050:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1769:41278:x1731746396241088:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 50us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.443053:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11579 00010000:00010000:1.0:1651529344.443054:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.443060:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1768:41278:x1731746396241216:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 38us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.443062:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11580 00010000:00010000:0.0:1651529344.443066:0:80280:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f14837b/0x3234de053c4eb93 lrc: 0/0,0 mode: --/PR res: [0x2b45e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5fc3 expref: 1767 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.443069:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006878ab38/0x3234de053c5001c lrc: 3/0,1 mode: PW/PW res: [0x2b45c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.443070:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996957760:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.443072:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006878ab38/0x3234de053c5001c lrc: 3/0,1 mode: PW/PW res: [0x2b45c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443074:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c50023 lrc: 3/0,1 mode: PW/PW res: [0x2b45e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.443075:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006878ab38/0x3234de053c5001c lrc: 3/0,1 mode: PW/PW res: [0x2b45c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443077:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c50023 lrc: 3/0,1 mode: PW/PW res: [0x2b45e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.443078:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006878ab38/0x3234de053c5001c lrc: 2/0,0 mode: PW/PW res: [0x2b45c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443080:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c50023 lrc: 3/0,1 mode: PW/PW res: [0x2b45e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443083:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c50023 lrc: 3/0,1 mode: PW/PW res: [0x2b45e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443085:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c50023 lrc: 2/0,0 mode: PW/PW res: [0x2b45e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.443123:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+297:39030:x1731745946360000:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1489us (1634us total) trans 12885078851 rc 0/0 00000100:00100000:1.0:1651529344.443126:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210796 00000100:00100000:0.0:1651529344.443132:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+296:39029:x1731745946360128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1127us (1157us total) trans 12885078852 rc 0/0 00010000:00010000:1.0:1651529344.443133:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000773eb1ef/0x3234de053c5002a lrc: 3/0,1 mode: PW/PW res: [0x2b45d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.443135:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210797 00010000:00010000:1.0:1651529344.443136:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000773eb1ef/0x3234de053c5002a lrc: 3/0,1 mode: PW/PW res: [0x2b45d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.443139:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000773eb1ef/0x3234de053c5002a lrc: 3/0,1 mode: PW/PW res: [0x2b45d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.443142:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000773eb1ef/0x3234de053c5002a lrc: 2/0,0 mode: PW/PW res: [0x2b45d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443142:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006878ab38/0x3234de053c5001c lrc: 2/0,0 mode: PW/PW res: [0x2b45c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443146:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006878ab38 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.443146:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006878ab38/0x3234de053c5001c lrc: 2/0,0 mode: PW/PW res: [0x2b45c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443157:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006878ab38/0x3234de053c5001c lrc: 3/0,0 mode: PW/PW res: [0x2b45c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443164:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006878ab38/0x3234de053c5001c lrc: 1/0,0 mode: --/PW res: [0x2b45c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443167:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006878ab38/0x3234de053c5001c lrc: 0/0,0 mode: --/PW res: [0x2b45c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443171:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c50023 lrc: 2/0,0 mode: PW/PW res: [0x2b45e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443173:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008208703f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.443174:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c50023 lrc: 2/0,0 mode: PW/PW res: [0x2b45e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443177:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c50023 lrc: 3/0,0 mode: PW/PW res: [0x2b45e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.443179:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+296:39029:x1731745946360064:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1169us (1192us total) trans 12885078853 rc 0/0 00010000:00010000:0.0:1651529344.443180:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c50023 lrc: 1/0,0 mode: --/PW res: [0x2b45e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.443182:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210798 00010000:00010000:0.0:1651529344.443182:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c50023 lrc: 0/0,0 mode: --/PW res: [0x2b45e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443186:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000773eb1ef/0x3234de053c5002a lrc: 2/0,0 mode: PW/PW res: [0x2b45d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443188:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000773eb1ef already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.443189:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000773eb1ef/0x3234de053c5002a lrc: 2/0,0 mode: PW/PW res: [0x2b45d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443192:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000773eb1ef/0x3234de053c5002a lrc: 3/0,0 mode: PW/PW res: [0x2b45d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.443195:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.443195:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000773eb1ef/0x3234de053c5002a lrc: 1/0,0 mode: --/PW res: [0x2b45d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443198:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000773eb1ef/0x3234de053c5002a lrc: 0/0,0 mode: --/PW res: [0x2b45d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.443221:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996957888:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.443236:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.443243:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e52c3e68/0x3234de053c50031 lrc: 3/0,1 mode: --/PW res: [0x2b460:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.443250:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.443252:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946360704 00000100:00100000:0.0:1651529344.443261:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946360768 00000100:00100000:0.0:1651529344.443266:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210802 00000100:00100000:0.0:1651529344.443268:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+297:39030:x1731745946360704:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.443273:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177250 count 1 00010000:00010000:0.0:1651529344.443276:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50046 lrc: 3/0,1 mode: --/PW res: [0x2b462:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443281:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4c3a0 lrc: 2/0,0 mode: PR/PR res: [0x2b462:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc920 expref: 1766 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.443284:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.443285:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.443286:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50046 lrc: 4/0,1 mode: --/PW res: [0x2b462:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443292:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4c3a0 lrc: 3/0,0 mode: PR/PR res: [0x2b462:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc920 expref: 1766 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.443296:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4c3a0 lrc: 4/0,0 mode: PR/PR res: [0x2b462:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc920 expref: 1766 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.443300:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996958080:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.443313:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060852af0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.443325:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210803 00000100:00100000:1.0:1651529344.443327:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+297:39029:x1731745946360768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.443332:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177251 count 1 00010000:00010000:1.0:1651529344.443337:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068486c62/0x3234de053c5004d lrc: 3/0,1 mode: --/PW res: [0x2b463:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.443341:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e0a98e9b/0x3234de053c4dcc8 lrc: 2/0,0 mode: PR/PR res: [0x2b463:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d236a expref: 1766 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.443344:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.443345:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.443346:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068486c62/0x3234de053c5004d lrc: 4/0,1 mode: --/PW res: [0x2b463:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.443353:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e0a98e9b/0x3234de053c4dcc8 lrc: 3/0,0 mode: PR/PR res: [0x2b463:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d236a expref: 1766 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.443356:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e0a98e9b/0x3234de053c4dcc8 lrc: 4/0,0 mode: PR/PR res: [0x2b463:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d236a expref: 1766 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.443360:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002c4168d4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996958144:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.443369:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd96f074 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.443376:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396241408 00010000:00010000:1.0:1651529344.443380:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000006156151/0x3234de053c4cb2c lrc: 4/0,0 mode: PR/PR res: [0x2b460:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde20 expref: 1767 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.443393:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11581 00000100:00100000:1.0:1651529344.443395:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000e855587 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1767:41279:x1731746396241408:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.443397:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.443398:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000006156151/0x3234de053c4cb2c lrc: 4/0,0 mode: PR/PR res: [0x2b460:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde20 expref: 1767 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.443405:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000006156151/0x3234de053c4cb2c lrc: 3/0,0 mode: PR/PR res: [0x2b460:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde20 expref: 1767 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.443410:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006156151/0x3234de053c4cb2c lrc: 0/0,0 mode: --/PR res: [0x2b460:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde20 expref: 1767 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.443414:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.443415:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.443415:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e52c3e68/0x3234de053c50031 lrc: 3/0,1 mode: PW/PW res: [0x2b460:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.443419:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e52c3e68/0x3234de053c50031 lrc: 4/0,1 mode: PW/PW res: [0x2b460:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.443427:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.443433:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000e855587 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1766:41279:x1731746396241408:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 38us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.443436:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11581 00010000:00010000:0.0:1651529344.443436:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e52c3e68/0x3234de053c50031 lrc: 3/0,1 mode: PW/PW res: [0x2b460:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443440:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e52c3e68/0x3234de053c50031 lrc: 3/0,1 mode: PW/PW res: [0x2b460:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443443:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e52c3e68/0x3234de053c50031 lrc: 3/0,1 mode: PW/PW res: [0x2b460:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443445:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e52c3e68/0x3234de053c50031 lrc: 2/0,0 mode: PW/PW res: [0x2b460:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.443484:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.443541:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+298:39030:x1731745946360576:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 752us (785us total) trans 12885078854 rc 0/0 00000100:00100000:0.0:1651529344.443545:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210799 00000100:00100000:0.0:1651529344.443550:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946361152 00000100:00100000:1.0:1651529344.443551:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.443579:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946361280 00000100:00100000:1.0:1651529344.443596:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.443596:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210804 00000100:00100000:0.0:1651529344.443598:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+299:39029:x1731745946361152:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.443603:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.443603:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177253 count 1 00010000:00010000:0.0:1651529344.443607:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c50054 lrc: 3/0,1 mode: --/PW res: [0x2b465:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.443610:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.443612:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f81e8872/0x3234de053c4d2db lrc: 2/0,0 mode: PR/PR res: [0x2b465:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd5a expref: 1765 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.443629:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000076d5f96b pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996957952:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.443633:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001750092b/0x3234de053c50038 lrc: 3/0,1 mode: --/PW res: [0x2b45f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443642:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.443643:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.443644:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c50054 lrc: 4/0,1 mode: --/PW res: [0x2b465:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.443648:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946361088 00010000:00010000:0.0:1651529344.443652:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f81e8872/0x3234de053c4d2db lrc: 3/0,0 mode: PR/PR res: [0x2b465:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd5a expref: 1765 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.443658:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210805 00000100:00100000:1.0:1651529344.443660:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+300:39029:x1731745946361280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.443660:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f81e8872/0x3234de053c4d2db lrc: 4/0,0 mode: PR/PR res: [0x2b465:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd5a expref: 1765 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:1.0:1651529344.443665:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177254 count 1 00000100:00100000:0.0:1651529344.443665:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996958208:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.443669:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c5005b lrc: 3/0,1 mode: --/PW res: [0x2b466:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.443673:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c4cf70 lrc: 2/0,0 mode: PR/PR res: [0x2b466:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef4c expref: 1765 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.443674:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c2b2b59c going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.443676:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.443677:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.443678:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c5005b lrc: 4/0,1 mode: --/PW res: [0x2b466:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443679:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e52c3e68/0x3234de053c50031 lrc: 2/0,0 mode: PW/PW res: [0x2b460:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.443684:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c4cf70 lrc: 3/0,0 mode: PR/PR res: [0x2b466:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef4c expref: 1765 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.443687:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c4cf70 lrc: 4/0,0 mode: PR/PR res: [0x2b466:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef4c expref: 1765 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.443691:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014f8af45 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996958272:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.443700:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 0000000053a0cffa going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.443707:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210806 00010000:00010000:0.0:1651529344.443709:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e52c3e68 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.443710:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e52c3e68/0x3234de053c50031 lrc: 2/0,0 mode: PW/PW res: [0x2b460:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443715:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e52c3e68/0x3234de053c50031 lrc: 3/0,0 mode: PW/PW res: [0x2b460:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.443717:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+300:39029:x1731745946361088:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.443720:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e52c3e68/0x3234de053c50031 lrc: 1/0,0 mode: --/PW res: [0x2b460:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.443723:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177252 count 1 00010000:00010000:0.0:1651529344.443723:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e52c3e68/0x3234de053c50031 lrc: 0/0,0 mode: --/PW res: [0x2b460:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.443727:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c151b720/0x3234de053c50062 lrc: 3/0,1 mode: --/PW res: [0x2b464:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.443731:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000088993906/0x3234de053c4d3c2 lrc: 2/0,0 mode: PR/PR res: [0x2b464:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00f6 expref: 1765 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.443743:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.443743:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.443744:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c151b720/0x3234de053c50062 lrc: 4/0,1 mode: --/PW res: [0x2b464:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.443745:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996958016:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.443749:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a5772342/0x3234de053c5003f lrc: 3/0,1 mode: --/PW res: [0x2b461:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.443751:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000088993906/0x3234de053c4d3c2 lrc: 3/0,0 mode: PR/PR res: [0x2b464:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00f6 expref: 1765 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.443754:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000088993906/0x3234de053c4d3c2 lrc: 4/0,0 mode: PR/PR res: [0x2b464:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00f6 expref: 1765 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.443757:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396241664 00000100:00100000:1.0:1651529344.443758:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004a6776b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996958336:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.443761:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c4e821 lrc: 4/0,0 mode: PR/PR res: [0x2b45f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d514c expref: 1766 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.443765:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a6b79b05 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.443768:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396241728 00010000:00010000:0.0:1651529344.443770:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ce366906/0x3234de053c4a5b6 lrc: 4/0,0 mode: PR/PR res: [0x2b461:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb4a expref: 1767 pid: 106695 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.443774:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11582 00000100:00100000:1.0:1651529344.443776:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1767:41279:x1731746396241664:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.443778:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11583 00010000:00010000:1.0:1651529344.443779:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.443779:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1767:41278:x1731746396241728:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.443780:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c4e821 lrc: 4/0,0 mode: PR/PR res: [0x2b45f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d514c expref: 1767 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.443782:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.443783:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ce366906/0x3234de053c4a5b6 lrc: 4/0,0 mode: PR/PR res: [0x2b461:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb4a expref: 1767 pid: 106695 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.443784:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c4e821 lrc: 3/0,0 mode: PR/PR res: [0x2b45f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d514c expref: 1767 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.443787:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ce366906/0x3234de053c4a5b6 lrc: 3/0,0 mode: PR/PR res: [0x2b461:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb4a expref: 1767 pid: 106695 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.443790:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c4e821 lrc: 0/0,0 mode: --/PR res: [0x2b45f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d514c expref: 1767 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.443793:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce366906/0x3234de053c4a5b6 lrc: 0/0,0 mode: --/PR res: [0x2b461:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb4a expref: 1767 pid: 106695 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.443794:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.443794:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.443795:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001750092b/0x3234de053c50038 lrc: 3/0,1 mode: PW/PW res: [0x2b45f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443796:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.443797:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.443798:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001750092b/0x3234de053c50038 lrc: 4/0,1 mode: PW/PW res: [0x2b45f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443798:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a5772342/0x3234de053c5003f lrc: 3/0,1 mode: PW/PW res: [0x2b461:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443801:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5772342/0x3234de053c5003f lrc: 4/0,1 mode: PW/PW res: [0x2b461:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.443804:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.443807:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.443810:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1765:41279:x1731746396241664:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 33us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.443812:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11582 00000100:00100000:0.0:1651529344.443814:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1765:41278:x1731746396241728:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 34us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.443816:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11583 00010000:00010000:1.0:1651529344.443819:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001750092b/0x3234de053c50038 lrc: 3/0,1 mode: PW/PW res: [0x2b45f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.443822:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001750092b/0x3234de053c50038 lrc: 3/0,1 mode: PW/PW res: [0x2b45f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443822:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a5772342/0x3234de053c5003f lrc: 3/0,1 mode: PW/PW res: [0x2b461:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.443825:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001750092b/0x3234de053c50038 lrc: 3/0,1 mode: PW/PW res: [0x2b45f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443826:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5772342/0x3234de053c5003f lrc: 3/0,1 mode: PW/PW res: [0x2b461:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.443828:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001750092b/0x3234de053c50038 lrc: 2/0,0 mode: PW/PW res: [0x2b45f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443829:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5772342/0x3234de053c5003f lrc: 3/0,1 mode: PW/PW res: [0x2b461:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443834:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5772342/0x3234de053c5003f lrc: 2/0,0 mode: PW/PW res: [0x2b461:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.443872:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+302:39030:x1731745946360512:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 983us (1058us total) trans 12885078855 rc 0/0 00000100:00100000:1.0:1651529344.443875:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210800 00000100:00100000:0.0:1651529344.443880:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+301:39030:x1731745946360640:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 982us (1010us total) trans 12885078856 rc 0/0 00000100:00100000:0.0:1651529344.443883:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210801 00010000:00010000:0.0:1651529344.443890:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001750092b/0x3234de053c50038 lrc: 2/0,0 mode: PW/PW res: [0x2b45f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443894:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001750092b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.443895:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001750092b/0x3234de053c50038 lrc: 2/0,0 mode: PW/PW res: [0x2b45f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443898:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001750092b/0x3234de053c50038 lrc: 3/0,0 mode: PW/PW res: [0x2b45f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.443902:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.443902:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001750092b/0x3234de053c50038 lrc: 1/0,0 mode: --/PW res: [0x2b45f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443905:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001750092b/0x3234de053c50038 lrc: 0/0,0 mode: --/PW res: [0x2b45f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.443917:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.443917:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5772342/0x3234de053c5003f lrc: 2/0,0 mode: PW/PW res: [0x2b461:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443920:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5772342 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.443925:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5772342/0x3234de053c5003f lrc: 2/0,0 mode: PW/PW res: [0x2b461:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443928:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5772342/0x3234de053c5003f lrc: 3/0,0 mode: PW/PW res: [0x2b461:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443932:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5772342/0x3234de053c5003f lrc: 1/0,0 mode: --/PW res: [0x2b461:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443934:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5772342/0x3234de053c5003f lrc: 0/0,0 mode: --/PW res: [0x2b461:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.443941:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946361344 00000100:00100000:0.0:1651529344.443952:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210807 00000100:00100000:0.0:1651529344.443953:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+301:39030:x1731745946361344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.443956:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:0.0:1651529344.443958:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177255 count 1 00010000:00010000:0.0:1651529344.443962:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c50069 lrc: 3/0,1 mode: --/PW res: [0x2b467:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443966:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000089368d5b/0x3234de053c4da6e lrc: 2/0,0 mode: PR/PR res: [0x2b467:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a41 expref: 1763 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.443969:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.443969:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.443970:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c50069 lrc: 4/0,1 mode: --/PW res: [0x2b467:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.443976:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000089368d5b/0x3234de053c4da6e lrc: 3/0,0 mode: PR/PR res: [0x2b467:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a41 expref: 1763 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.443982:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000089368d5b/0x3234de053c4da6e lrc: 4/0,0 mode: PR/PR res: [0x2b467:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a41 expref: 1763 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.443986:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996958400:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.444000:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c0dff858 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.444006:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396241792 00000100:00100000:1.0:1651529344.444010:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002c4168d4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996958144:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.444011:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4c3a0 lrc: 5/0,0 mode: PR/PR res: [0x2b462:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc920 expref: 1764 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.444015:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000068486c62/0x3234de053c5004d lrc: 3/0,1 mode: --/PW res: [0x2b463:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.444016:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396241856 00010000:00010000:0.0:1651529344.444018:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e0a98e9b/0x3234de053c4dcc8 lrc: 4/0,0 mode: PR/PR res: [0x2b463:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d236a expref: 1765 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.444023:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11584 00000100:00100000:1.0:1651529344.444025:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11585 00000100:00100000:0.0:1651529344.444025:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1765:41279:x1731746396241792:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.444027:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1765:41278:x1731746396241856:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.444028:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.444029:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4c3a0 lrc: 5/0,0 mode: PR/PR res: [0x2b462:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc920 expref: 1765 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.444031:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.444032:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e0a98e9b/0x3234de053c4dcc8 lrc: 4/0,0 mode: PR/PR res: [0x2b463:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d236a expref: 1765 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.444036:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e0a98e9b/0x3234de053c4dcc8 lrc: 3/0,0 mode: PR/PR res: [0x2b463:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d236a expref: 1765 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.444042:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0a98e9b/0x3234de053c4dcc8 lrc: 0/0,0 mode: --/PR res: [0x2b463:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d236a expref: 1765 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.444046:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.444046:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.444047:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000068486c62/0x3234de053c5004d lrc: 3/0,1 mode: PW/PW res: [0x2b463:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.444050:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068486c62/0x3234de053c5004d lrc: 4/0,1 mode: PW/PW res: [0x2b463:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444050:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4c3a0 lrc: 4/0,0 mode: PR/PR res: [0x2b462:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc920 expref: 1764 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.444056:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.444056:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.444057:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.444058:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50046 lrc: 3/0,1 mode: PW/PW res: [0x2b462:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444061:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50046 lrc: 4/0,1 mode: PW/PW res: [0x2b462:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.444063:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1764:41278:x1731746396241856:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.444065:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11585 00010000:00010000:0.0:1651529344.444066:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.444071:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000068486c62/0x3234de053c5004d lrc: 3/0,1 mode: PW/PW res: [0x2b463:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.444073:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1763:41279:x1731746396241792:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 48us (156us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.444075:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068486c62/0x3234de053c5004d lrc: 3/0,1 mode: PW/PW res: [0x2b463:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.444076:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11584 00010000:00010000:1.0:1651529344.444078:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068486c62/0x3234de053c5004d lrc: 3/0,1 mode: PW/PW res: [0x2b463:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.444080:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068486c62/0x3234de053c5004d lrc: 2/0,0 mode: PW/PW res: [0x2b463:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444095:0:80280:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c4c3a0 lrc: 0/0,0 mode: --/PR res: [0x2b462:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc920 expref: 1762 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.444111:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996958080:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.444115:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50046 lrc: 3/0,1 mode: PW/PW res: [0x2b462:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444118:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50046 lrc: 3/0,1 mode: PW/PW res: [0x2b462:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444121:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50046 lrc: 3/0,1 mode: PW/PW res: [0x2b462:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.444124:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+302:39029:x1731745946360768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 796us (902us total) trans 12885078857 rc 0/0 00010000:00010000:0.0:1651529344.444124:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50046 lrc: 3/0,1 mode: PW/PW res: [0x2b462:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444126:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50046 lrc: 2/0,0 mode: PW/PW res: [0x2b462:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.444127:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210803 00000100:00100000:1.0:1651529344.444141:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.444175:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+302:39030:x1731745946360704:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 906us (979us total) trans 12885078858 rc 0/0 00000100:00100000:0.0:1651529344.444178:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210802 00000100:00100000:0.0:1651529344.444183:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946361664 00000100:00100000:1.0:1651529344.444187:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.444198:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946361600 00000100:00100000:0.0:1651529344.444204:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210808 00000100:00100000:0.0:1651529344.444206:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+303:39029:x1731745946361664:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.444211:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177257 count 1 00010000:00010000:0.0:1651529344.444215:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebf7beea/0x3234de053c50070 lrc: 3/0,1 mode: --/PW res: [0x2b469:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444219:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c4c624 lrc: 2/0,0 mode: PR/PR res: [0x2b469:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca93 expref: 1761 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.444259:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210809 00000100:00100000:1.0:1651529344.444261:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+303:39029:x1731745946361600:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.444261:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.444262:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.444263:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebf7beea/0x3234de053c50070 lrc: 4/0,1 mode: --/PW res: [0x2b469:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.444267:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177256 count 1 00010000:00010000:1.0:1651529344.444271:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a53669fa/0x3234de053c50077 lrc: 3/0,1 mode: --/PW res: [0x2b468:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444271:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c4c624 lrc: 3/0,0 mode: PR/PR res: [0x2b469:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca93 expref: 1761 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.444275:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c4c624 lrc: 4/0,0 mode: PR/PR res: [0x2b469:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca93 expref: 1761 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.444276:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005264ec88/0x3234de053c4e2c5 lrc: 2/0,0 mode: PR/PR res: [0x2b468:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c37 expref: 1761 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.444279:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.444279:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996958464:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.444280:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.444280:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a53669fa/0x3234de053c50077 lrc: 4/0,1 mode: --/PW res: [0x2b468:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.444287:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005264ec88/0x3234de053c4e2c5 lrc: 3/0,0 mode: PR/PR res: [0x2b468:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c37 expref: 1761 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.444291:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005264ec88/0x3234de053c4e2c5 lrc: 4/0,0 mode: PR/PR res: [0x2b468:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c37 expref: 1761 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.444295:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f99b3c22 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996958528:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.444312:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd96f074 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.444321:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aac87b31 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.444327:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068486c62/0x3234de053c5004d lrc: 2/0,0 mode: PW/PW res: [0x2b463:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444331:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000068486c62 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.444332:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068486c62/0x3234de053c5004d lrc: 2/0,0 mode: PW/PW res: [0x2b463:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444335:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068486c62/0x3234de053c5004d lrc: 3/0,0 mode: PW/PW res: [0x2b463:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444340:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068486c62/0x3234de053c5004d lrc: 1/0,0 mode: --/PW res: [0x2b463:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444354:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068486c62/0x3234de053c5004d lrc: 0/0,0 mode: --/PW res: [0x2b463:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444359:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50046 lrc: 2/0,0 mode: PW/PW res: [0x2b462:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444361:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dcd3e2d1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.444362:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50046 lrc: 2/0,0 mode: PW/PW res: [0x2b462:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444365:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50046 lrc: 3/0,0 mode: PW/PW res: [0x2b462:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444369:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50046 lrc: 1/0,0 mode: --/PW res: [0x2b462:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.444376:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.444381:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50046 lrc: 0/0,0 mode: --/PW res: [0x2b462:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.444404:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996958208:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.444407:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c50054 lrc: 3/0,1 mode: --/PW res: [0x2b465:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.444409:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.444416:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.444427:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.444434:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396242176 00000100:00100000:1.0:1651529344.444436:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.444444:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f81e8872/0x3234de053c4d2db lrc: 4/0,0 mode: PR/PR res: [0x2b465:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd5a expref: 1762 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.444455:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396242304 00010000:00010000:0.0:1651529344.444458:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000088993906/0x3234de053c4d3c2 lrc: 5/0,0 mode: PR/PR res: [0x2b464:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00f6 expref: 1763 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.444462:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396242240 00010000:00010000:0.0:1651529344.444464:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c4cf70 lrc: 5/0,0 mode: PR/PR res: [0x2b466:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef4c expref: 1764 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.444474:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014f8af45 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996958272:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.444474:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11586 00000100:00100000:0.0:1651529344.444476:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1764:41279:x1731746396242176:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.444479:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.444480:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c5005b lrc: 3/0,1 mode: --/PW res: [0x2b466:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444480:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f81e8872/0x3234de053c4d2db lrc: 4/0,0 mode: PR/PR res: [0x2b465:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd5a expref: 1764 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.444487:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004a6776b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996958336:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.444487:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f81e8872/0x3234de053c4d2db lrc: 3/0,0 mode: PR/PR res: [0x2b465:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd5a expref: 1764 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.444489:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c151b720/0x3234de053c50062 lrc: 3/0,1 mode: --/PW res: [0x2b464:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444492:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f81e8872/0x3234de053c4d2db lrc: 0/0,0 mode: --/PR res: [0x2b465:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd5a expref: 1764 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.444495:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946361728 00010000:00010000:0.0:1651529344.444495:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.444496:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.444497:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c50054 lrc: 3/0,1 mode: PW/PW res: [0x2b465:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444500:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c50054 lrc: 4/0,1 mode: PW/PW res: [0x2b465:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.444502:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946361792 00000100:00100000:1.0:1651529344.444509:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210810 00000100:00100000:1.0:1651529344.444511:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad15c052 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+305:39030:x1731745946361728:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.444513:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00080000:1.0:1651529344.444515:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177258 count 1 00010000:00010000:1.0:1651529344.444519:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c139ced0/0x3234de053c5007e lrc: 3/0,1 mode: --/PW res: [0x2b46a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.444524:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1763:41279:x1731746396242176:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 47us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.444527:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11586 00010000:00010000:1.0:1651529344.444530:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f156055d/0x3234de053c4e772 lrc: 2/0,0 mode: PR/PR res: [0x2b46a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e82 expref: 1762 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.444531:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11587 00010000:00010000:1.0:1651529344.444533:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.444533:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.444533:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1762:41279:x1731746396242304:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.444534:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c139ced0/0x3234de053c5007e lrc: 4/0,1 mode: --/PW res: [0x2b46a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444536:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.444537:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000088993906/0x3234de053c4d3c2 lrc: 4/0,0 mode: PR/PR res: [0x2b464:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00f6 expref: 1762 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.444541:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f156055d/0x3234de053c4e772 lrc: 3/0,0 mode: PR/PR res: [0x2b46a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e82 expref: 1762 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.444541:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000088993906/0x3234de053c4d3c2 lrc: 3/0,0 mode: PR/PR res: [0x2b464:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00f6 expref: 1762 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.444544:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f156055d/0x3234de053c4e772 lrc: 4/0,0 mode: PR/PR res: [0x2b46a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e82 expref: 1762 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.444546:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088993906/0x3234de053c4d3c2 lrc: 0/0,0 mode: --/PR res: [0x2b464:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00f6 expref: 1762 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.444549:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004a6776b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996958592:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.444549:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.444550:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.444551:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c151b720/0x3234de053c50062 lrc: 3/0,1 mode: PW/PW res: [0x2b464:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444553:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c151b720/0x3234de053c50062 lrc: 4/0,1 mode: PW/PW res: [0x2b464:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.444557:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000babe2d90 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.444561:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.444567:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1761:41279:x1731746396242304:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 33us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.444569:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11587 00000100:00100000:1.0:1651529344.444570:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210811 00000100:00100000:1.0:1651529344.444572:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+305:39029:x1731745946361792:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.444573:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11588 00000100:00100000:0.0:1651529344.444574:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e29becaf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1760:41278:x1731746396242240:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.444576:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00080000:1.0:1651529344.444577:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177259 count 1 00010000:00010000:0.0:1651529344.444578:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c4cf70 lrc: 4/0,0 mode: PR/PR res: [0x2b466:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef4c expref: 1760 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.444580:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f561add/0x3234de053c50085 lrc: 3/0,1 mode: --/PW res: [0x2b46b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444581:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c4cf70 lrc: 3/0,0 mode: PR/PR res: [0x2b466:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef4c expref: 1760 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.444585:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000215893d9/0x3234de053c4b362 lrc: 2/0,0 mode: PR/PR res: [0x2b46b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc194 expref: 1760 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.444586:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c4cf70 lrc: 0/0,0 mode: --/PR res: [0x2b466:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef4c expref: 1760 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.444588:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.444588:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.444589:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f561add/0x3234de053c50085 lrc: 4/0,1 mode: --/PW res: [0x2b46b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444591:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.444592:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.444593:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c5005b lrc: 3/0,1 mode: PW/PW res: [0x2b466:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.444595:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000215893d9/0x3234de053c4b362 lrc: 3/0,0 mode: PR/PR res: [0x2b46b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc194 expref: 1759 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.444595:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c5005b lrc: 4/0,1 mode: PW/PW res: [0x2b466:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.444598:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000215893d9/0x3234de053c4b362 lrc: 4/0,0 mode: PR/PR res: [0x2b46b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc194 expref: 1759 pid: 151609 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.444603:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.444607:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014f8af45 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996958656:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.444608:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e29becaf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1759:41278:x1731746396242240:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.444610:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11588 00000100:00100000:1.0:1651529344.444615:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fb6c773d going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.444619:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c151b720/0x3234de053c50062 lrc: 3/0,1 mode: PW/PW res: [0x2b464:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.444623:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c151b720/0x3234de053c50062 lrc: 3/0,1 mode: PW/PW res: [0x2b464:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.444623:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996958400:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.444626:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c151b720/0x3234de053c50062 lrc: 3/0,1 mode: PW/PW res: [0x2b464:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444627:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c50069 lrc: 3/0,1 mode: --/PW res: [0x2b467:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.444628:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c151b720/0x3234de053c50062 lrc: 2/0,0 mode: PW/PW res: [0x2b464:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444632:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c50054 lrc: 3/0,1 mode: PW/PW res: [0x2b465:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444658:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c50054 lrc: 3/0,1 mode: PW/PW res: [0x2b465:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444662:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c50054 lrc: 3/0,1 mode: PW/PW res: [0x2b465:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444665:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c50054 lrc: 2/0,0 mode: PW/PW res: [0x2b465:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.444671:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+306:39029:x1731745946361088:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 962us (1067us total) trans 12885078859 rc 0/0 00000100:00100000:1.0:1651529344.444674:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210806 00010000:00010000:1.0:1651529344.444681:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c5005b lrc: 3/0,1 mode: PW/PW res: [0x2b466:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.444684:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c5005b lrc: 3/0,1 mode: PW/PW res: [0x2b466:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.444687:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c5005b lrc: 3/0,1 mode: PW/PW res: [0x2b466:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.444690:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c5005b lrc: 2/0,0 mode: PW/PW res: [0x2b466:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.444722:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+307:39029:x1731745946361152:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1123us (1243us total) trans 12885078860 rc 0/0 00000100:00100000:0.0:1651529344.444725:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210804 00000100:00100000:1.0:1651529344.444727:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+307:39029:x1731745946361280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1066us (1176us total) trans 12885078861 rc 0/0 00000100:00100000:1.0:1651529344.444731:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210805 00010000:00010000:0.0:1651529344.444732:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c151b720/0x3234de053c50062 lrc: 2/0,0 mode: PW/PW res: [0x2b464:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444746:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c151b720 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.444747:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c151b720/0x3234de053c50062 lrc: 2/0,0 mode: PW/PW res: [0x2b464:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444750:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c151b720/0x3234de053c50062 lrc: 3/0,0 mode: PW/PW res: [0x2b464:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444755:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c151b720/0x3234de053c50062 lrc: 1/0,0 mode: --/PW res: [0x2b464:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444757:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c151b720/0x3234de053c50062 lrc: 0/0,0 mode: --/PW res: [0x2b464:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444762:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c50054 lrc: 2/0,0 mode: PW/PW res: [0x2b465:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444765:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000009c5cbe9 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.444766:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c50054 lrc: 2/0,0 mode: PW/PW res: [0x2b465:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444771:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c50054 lrc: 3/0,0 mode: PW/PW res: [0x2b465:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444774:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c50054 lrc: 1/0,0 mode: --/PW res: [0x2b465:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444776:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c50054 lrc: 0/0,0 mode: --/PW res: [0x2b465:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444780:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c5005b lrc: 2/0,0 mode: PW/PW res: [0x2b466:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444782:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000594a1223 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.444783:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c5005b lrc: 2/0,0 mode: PW/PW res: [0x2b466:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444786:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c5005b lrc: 3/0,0 mode: PW/PW res: [0x2b466:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444795:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c5005b lrc: 1/0,0 mode: --/PW res: [0x2b466:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444797:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c5005b lrc: 0/0,0 mode: --/PW res: [0x2b466:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.444800:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.444806:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396242496 00000100:00100000:1.0:1651529344.444810:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.444810:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000089368d5b/0x3234de053c4da6e lrc: 4/0,0 mode: PR/PR res: [0x2b467:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a41 expref: 1759 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.444822:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396242624 00000100:00100000:1.0:1651529344.444823:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.444825:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005264ec88/0x3234de053c4e2c5 lrc: 5/0,0 mode: PR/PR res: [0x2b468:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c37 expref: 1760 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.444829:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396242688 00010000:00010000:0.0:1651529344.444831:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c4c624 lrc: 5/0,0 mode: PR/PR res: [0x2b469:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca93 expref: 1761 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.444835:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11589 00000100:00100000:0.0:1651529344.444837:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1761:41278:x1731746396242496:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.444839:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.444841:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000089368d5b/0x3234de053c4da6e lrc: 4/0,0 mode: PR/PR res: [0x2b467:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a41 expref: 1761 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.444844:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000089368d5b/0x3234de053c4da6e lrc: 3/0,0 mode: PR/PR res: [0x2b467:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a41 expref: 1761 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.444849:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089368d5b/0x3234de053c4da6e lrc: 0/0,0 mode: --/PR res: [0x2b467:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a41 expref: 1761 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.444852:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.444853:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.444854:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c50069 lrc: 3/0,1 mode: PW/PW res: [0x2b467:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444859:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c50069 lrc: 4/0,1 mode: PW/PW res: [0x2b467:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444866:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.444878:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1760:41278:x1731746396242496:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 41us (79us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.444881:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11589 00000100:00100000:0.0:1651529344.444885:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11590 00000100:00100000:0.0:1651529344.444887:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1759:41278:x1731746396242624:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.444889:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.444891:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f99b3c22 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996958528:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.444896:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a53669fa/0x3234de053c50077 lrc: 3/0,1 mode: --/PW res: [0x2b468:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.444904:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11591 00010000:00010000:0.0:1651529344.444905:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005264ec88/0x3234de053c4e2c5 lrc: 4/0,0 mode: PR/PR res: [0x2b468:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c37 expref: 1759 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.444906:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1759:41279:x1731746396242688:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.444909:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.444909:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005264ec88/0x3234de053c4e2c5 lrc: 3/0,0 mode: PR/PR res: [0x2b468:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c37 expref: 1759 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.444911:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c4c624 lrc: 5/0,0 mode: PR/PR res: [0x2b469:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca93 expref: 1759 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.444915:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c4c624 lrc: 4/0,0 mode: PR/PR res: [0x2b469:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca93 expref: 1759 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.444915:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005264ec88/0x3234de053c4e2c5 lrc: 0/0,0 mode: --/PR res: [0x2b468:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c37 expref: 1759 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.444921:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.444922:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.444922:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ebf7beea/0x3234de053c50070 lrc: 3/0,1 mode: PW/PW res: [0x2b469:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.444925:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebf7beea/0x3234de053c50070 lrc: 4/0,1 mode: PW/PW res: [0x2b469:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444928:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.444929:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.444930:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.444930:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a53669fa/0x3234de053c50077 lrc: 3/0,1 mode: PW/PW res: [0x2b468:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444933:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a53669fa/0x3234de053c50077 lrc: 4/0,1 mode: PW/PW res: [0x2b468:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.444936:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1758:41279:x1731746396242688:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 30us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.444939:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11591 00010000:00010000:0.0:1651529344.444945:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.444952:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a53669fa/0x3234de053c50077 lrc: 3/0,1 mode: PW/PW res: [0x2b468:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.444952:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1757:41278:x1731746396242624:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 65us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.444955:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11590 00010000:00010000:1.0:1651529344.444956:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a53669fa/0x3234de053c50077 lrc: 3/0,1 mode: PW/PW res: [0x2b468:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.444959:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a53669fa/0x3234de053c50077 lrc: 3/0,1 mode: PW/PW res: [0x2b468:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.444961:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a53669fa/0x3234de053c50077 lrc: 2/0,0 mode: PW/PW res: [0x2b468:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444962:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c50069 lrc: 3/0,1 mode: PW/PW res: [0x2b467:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444965:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c50069 lrc: 3/0,1 mode: PW/PW res: [0x2b467:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444974:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c50069 lrc: 3/0,1 mode: PW/PW res: [0x2b467:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.444977:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c50069 lrc: 2/0,0 mode: PW/PW res: [0x2b467:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.445002:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+306:39029:x1731745946361600:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 741us (815us total) trans 12885078862 rc 0/0 00000100:00100000:1.0:1651529344.445005:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210809 00000100:00100000:0.0:1651529344.445038:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+306:39030:x1731745946361344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1084us (1136us total) trans 12885078863 rc 0/0 00000100:00100000:0.0:1651529344.445041:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210807 00010000:00010000:0.0:1651529344.445049:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a53669fa/0x3234de053c50077 lrc: 2/0,0 mode: PW/PW res: [0x2b468:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.445051:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.445052:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a53669fa already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.445053:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a53669fa/0x3234de053c50077 lrc: 2/0,0 mode: PW/PW res: [0x2b468:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445066:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a53669fa/0x3234de053c50077 lrc: 3/0,0 mode: PW/PW res: [0x2b468:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.445070:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.445071:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a53669fa/0x3234de053c50077 lrc: 1/0,0 mode: --/PW res: [0x2b468:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445073:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a53669fa/0x3234de053c50077 lrc: 0/0,0 mode: --/PW res: [0x2b468:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445077:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c50069 lrc: 2/0,0 mode: PW/PW res: [0x2b467:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445080:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000011345842 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.445081:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c50069 lrc: 2/0,0 mode: PW/PW res: [0x2b467:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445084:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c50069 lrc: 3/0,0 mode: PW/PW res: [0x2b467:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445086:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c50069 lrc: 1/0,0 mode: --/PW res: [0x2b467:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445089:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c50069 lrc: 0/0,0 mode: --/PW res: [0x2b467:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.445096:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.445096:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946362048 00000100:00100000:0.0:1651529344.445106:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946362176 00000100:00100000:0.0:1651529344.445110:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946362112 00000100:00100000:0.0:1651529344.445116:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210812 00000100:00100000:0.0:1651529344.445118:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+308:39029:x1731745946362048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.445123:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177260 count 1 00010000:00010000:0.0:1651529344.445126:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049a3f5ac/0x3234de053c5008c lrc: 3/0,1 mode: --/PW res: [0x2b46c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.445131:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004a6776b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996958592:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.445131:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008b96ee29/0x3234de053c4d2f0 lrc: 2/0,0 mode: PR/PR res: [0x2b46c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfdae expref: 1756 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.445134:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.445135:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c139ced0/0x3234de053c5007e lrc: 3/0,1 mode: --/PW res: [0x2b46a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445135:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.445135:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049a3f5ac/0x3234de053c5008c lrc: 4/0,1 mode: --/PW res: [0x2b46c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445142:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008b96ee29/0x3234de053c4d2f0 lrc: 3/0,0 mode: PR/PR res: [0x2b46c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfdae expref: 1756 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.445143:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210813 00000100:00100000:1.0:1651529344.445144:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+308:39029:x1731745946362176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.445145:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008b96ee29/0x3234de053c4d2f0 lrc: 4/0,0 mode: PR/PR res: [0x2b46c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfdae expref: 1756 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.445149:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996958720:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.445150:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177262 count 1 00010000:00010000:1.0:1651529344.445153:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bcdc8b9f/0x3234de053c50093 lrc: 3/0,1 mode: --/PW res: [0x2b46e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.445157:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000028cf56ee/0x3234de053c4cd39 lrc: 2/0,0 mode: PR/PR res: [0x2b46e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce6c4 expref: 1756 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.445163:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 0000000070e666f7 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.445167:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.445168:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.445168:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bcdc8b9f/0x3234de053c50093 lrc: 4/0,1 mode: --/PW res: [0x2b46e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.445169:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210814 00000100:00100000:0.0:1651529344.445171:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+308:39029:x1731745946362112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.445175:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177261 count 1 00010000:00010000:1.0:1651529344.445176:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000028cf56ee/0x3234de053c4cd39 lrc: 3/0,0 mode: PR/PR res: [0x2b46e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce6c4 expref: 1756 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.445179:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000028cf56ee/0x3234de053c4cd39 lrc: 4/0,0 mode: PR/PR res: [0x2b46e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce6c4 expref: 1756 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.445179:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a89dd07/0x3234de053c5009a lrc: 3/0,1 mode: --/PW res: [0x2b46d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.445183:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ee8cd7c9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996958784:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.445183:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e4af5857/0x3234de053c4deb2 lrc: 2/0,0 mode: PR/PR res: [0x2b46d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b74 expref: 1756 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.445186:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.445187:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.445187:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a89dd07/0x3234de053c5009a lrc: 4/0,1 mode: --/PW res: [0x2b46d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.445192:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000babe2d90 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.445207:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e4af5857/0x3234de053c4deb2 lrc: 3/0,0 mode: PR/PR res: [0x2b46d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b74 expref: 1756 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.445211:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e4af5857/0x3234de053c4deb2 lrc: 4/0,0 mode: PR/PR res: [0x2b46d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b74 expref: 1756 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.445252:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.445254:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996958848:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.445269:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c2b2b59c going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.445277:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396242816 00010000:00010000:0.0:1651529344.445281:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f156055d/0x3234de053c4e772 lrc: 4/0,0 mode: PR/PR res: [0x2b46a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e82 expref: 1757 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.445284:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.445303:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11592 00000100:00100000:0.0:1651529344.445305:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1757:41279:x1731746396242816:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.445308:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.445309:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f156055d/0x3234de053c4e772 lrc: 4/0,0 mode: PR/PR res: [0x2b46a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e82 expref: 1757 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.445316:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f156055d/0x3234de053c4e772 lrc: 3/0,0 mode: PR/PR res: [0x2b46a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e82 expref: 1757 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.445321:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f156055d/0x3234de053c4e772 lrc: 0/0,0 mode: --/PR res: [0x2b46a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e82 expref: 1757 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.445325:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.445325:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.445326:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c139ced0/0x3234de053c5007e lrc: 3/0,1 mode: PW/PW res: [0x2b46a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.445328:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.445329:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c139ced0/0x3234de053c5007e lrc: 4/0,1 mode: PW/PW res: [0x2b46a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.445334:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.445339:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.445346:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946362368 00000100:00100000:0.0:1651529344.445349:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1756:41279:x1731746396242816:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 43us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.445351:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11592 00000100:00100000:0.0:1651529344.445356:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396243072 00000100:00100000:1.0:1651529344.445357:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946362304 00010000:00010000:0.0:1651529344.445359:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000215893d9/0x3234de053c4b362 lrc: 5/0,0 mode: PR/PR res: [0x2b46b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc194 expref: 1756 pid: 151609 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.445365:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210815 00000100:00100000:1.0:1651529344.445366:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+310:39030:x1731745946362368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.445371:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177264 count 1 00000100:00100000:0.0:1651529344.445371:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11593 00000100:00100000:0.0:1651529344.445373:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1756:41279:x1731746396243072:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.445375:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.445376:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd405bc5/0x3234de053c500a1 lrc: 3/0,1 mode: --/PW res: [0x2b470:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445377:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000215893d9/0x3234de053c4b362 lrc: 5/0,0 mode: PR/PR res: [0x2b46b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc194 expref: 1756 pid: 151609 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.445380:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000018387e25/0x3234de053c4d21e lrc: 2/0,0 mode: PR/PR res: [0x2b470:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa0b expref: 1756 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.445381:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000215893d9/0x3234de053c4b362 lrc: 4/0,0 mode: PR/PR res: [0x2b46b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc194 expref: 1756 pid: 151609 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.445383:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.445384:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.445385:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd405bc5/0x3234de053c500a1 lrc: 4/0,1 mode: --/PW res: [0x2b470:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445385:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.445386:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.445387:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009f561add/0x3234de053c50085 lrc: 3/0,1 mode: PW/PW res: [0x2b46b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445390:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f561add/0x3234de053c50085 lrc: 4/0,1 mode: PW/PW res: [0x2b46b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.445391:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000018387e25/0x3234de053c4d21e lrc: 3/0,0 mode: PR/PR res: [0x2b470:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa0b expref: 1756 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.445394:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.445395:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000018387e25/0x3234de053c4d21e lrc: 4/0,0 mode: PR/PR res: [0x2b470:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa0b expref: 1756 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.445399:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a9e254e pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996958912:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.445399:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1756:41279:x1731746396243072:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 26us (65us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.445408:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f9dac3f6 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.445415:0:80278:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000215893d9/0x3234de053c4b362 lrc: 0/0,0 mode: --/PR res: [0x2b46b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc194 expref: 1756 pid: 151609 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.445416:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11593 00000100:00100000:1.0:1651529344.445419:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014f8af45 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996958656:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.445423:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009f561add/0x3234de053c50085 lrc: 3/0,1 mode: PW/PW res: [0x2b46b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.445425:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210816 00000100:00100000:0.0:1651529344.445426:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+310:39030:x1731745946362304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.445428:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009f561add/0x3234de053c50085 lrc: 3/0,1 mode: PW/PW res: [0x2b46b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.445431:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f561add/0x3234de053c50085 lrc: 3/0,1 mode: PW/PW res: [0x2b46b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.445431:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177263 count 1 00010000:00010000:1.0:1651529344.445434:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f561add/0x3234de053c50085 lrc: 3/0,1 mode: PW/PW res: [0x2b46b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445435:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e008fd4/0x3234de053c500a8 lrc: 3/0,1 mode: --/PW res: [0x2b46f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.445437:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f561add/0x3234de053c50085 lrc: 2/0,0 mode: PW/PW res: [0x2b46b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445439:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bff28571/0x3234de053c4ee41 lrc: 2/0,0 mode: PR/PR res: [0x2b46f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b2a expref: 1754 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.445442:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.445449:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.445450:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e008fd4/0x3234de053c500a8 lrc: 4/0,1 mode: --/PW res: [0x2b46f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445458:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bff28571/0x3234de053c4ee41 lrc: 3/0,0 mode: PR/PR res: [0x2b46f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b2a expref: 1754 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.445461:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bff28571/0x3234de053c4ee41 lrc: 4/0,0 mode: PR/PR res: [0x2b46f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b2a expref: 1754 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.445465:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996958976:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.445474:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a3b00cf3 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.445478:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f561add/0x3234de053c50085 lrc: 2/0,0 mode: PW/PW res: [0x2b46b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.445480:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+311:39029:x1731745946361792:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 907us (1071us total) trans 12885078864 rc 0/0 00010000:00010000:0.0:1651529344.445481:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009f561add already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.445482:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f561add/0x3234de053c50085 lrc: 2/0,0 mode: PW/PW res: [0x2b46b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.445483:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210811 00010000:00010000:0.0:1651529344.445485:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f561add/0x3234de053c50085 lrc: 3/0,0 mode: PW/PW res: [0x2b46b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445490:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f561add/0x3234de053c50085 lrc: 1/0,0 mode: --/PW res: [0x2b46b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.445491:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c139ced0/0x3234de053c5007e lrc: 3/0,1 mode: PW/PW res: [0x2b46a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445492:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f561add/0x3234de053c50085 lrc: 0/0,0 mode: --/PW res: [0x2b46b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.445494:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c139ced0/0x3234de053c5007e lrc: 3/0,1 mode: PW/PW res: [0x2b46a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.445497:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c139ced0/0x3234de053c5007e lrc: 3/0,1 mode: PW/PW res: [0x2b46a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.445500:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c139ced0/0x3234de053c5007e lrc: 2/0,0 mode: PW/PW res: [0x2b46a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445502:0:80280:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c4c624 lrc: 0/0,0 mode: --/PR res: [0x2b469:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca93 expref: 1754 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.445506:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996958464:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.445516:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ebf7beea/0x3234de053c50070 lrc: 3/0,1 mode: PW/PW res: [0x2b469:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445520:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ebf7beea/0x3234de053c50070 lrc: 3/0,1 mode: PW/PW res: [0x2b469:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445522:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ebf7beea/0x3234de053c50070 lrc: 3/0,1 mode: PW/PW res: [0x2b469:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445525:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebf7beea/0x3234de053c50070 lrc: 3/0,1 mode: PW/PW res: [0x2b469:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445528:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ebf7beea/0x3234de053c50070 lrc: 2/0,0 mode: PW/PW res: [0x2b469:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.445538:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad15c052 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+311:39030:x1731745946361728:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1026us (1162us total) trans 12885078865 rc 0/0 00000100:00100000:1.0:1651529344.445541:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210810 00000100:00100000:0.0:1651529344.445597:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+311:39029:x1731745946361664:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1390us (1455us total) trans 12885078866 rc 0/0 00000100:00100000:0.0:1651529344.445600:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210808 00000100:00100000:1.0:1651529344.445628:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.445628:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c139ced0/0x3234de053c5007e lrc: 2/0,0 mode: PW/PW res: [0x2b46a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445632:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c139ced0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.445633:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c139ced0/0x3234de053c5007e lrc: 2/0,0 mode: PW/PW res: [0x2b46a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.445638:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.445638:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c139ced0/0x3234de053c5007e lrc: 3/0,0 mode: PW/PW res: [0x2b46a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445647:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c139ced0/0x3234de053c5007e lrc: 1/0,0 mode: --/PW res: [0x2b46a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445650:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c139ced0/0x3234de053c5007e lrc: 0/0,0 mode: --/PW res: [0x2b46a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.445651:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.445658:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ebf7beea/0x3234de053c50070 lrc: 2/0,0 mode: PW/PW res: [0x2b469:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445661:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ebf7beea already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.445662:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebf7beea/0x3234de053c50070 lrc: 2/0,0 mode: PW/PW res: [0x2b469:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445665:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebf7beea/0x3234de053c50070 lrc: 3/0,0 mode: PW/PW res: [0x2b469:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445668:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ebf7beea/0x3234de053c50070 lrc: 1/0,0 mode: --/PW res: [0x2b469:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445670:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ebf7beea/0x3234de053c50070 lrc: 0/0,0 mode: --/PW res: [0x2b469:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.445681:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996958720:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.445685:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000049a3f5ac/0x3234de053c5008c lrc: 3/0,1 mode: --/PW res: [0x2b46c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.445691:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996958848:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.445694:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007a89dd07/0x3234de053c5009a lrc: 3/0,1 mode: --/PW res: [0x2b46d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.445697:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ee8cd7c9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996958784:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.445700:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396243200 00010000:00010000:1.0:1651529344.445702:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bcdc8b9f/0x3234de053c50093 lrc: 3/0,1 mode: --/PW res: [0x2b46e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445704:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000028cf56ee/0x3234de053c4cd39 lrc: 4/0,0 mode: PR/PR res: [0x2b46e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce6c4 expref: 1754 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.445709:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396243136 00000100:00100000:0.0:1651529344.445711:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396243328 00010000:00010000:0.0:1651529344.445713:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e4af5857/0x3234de053c4deb2 lrc: 4/0,0 mode: PR/PR res: [0x2b46d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b74 expref: 1756 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.445714:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008b96ee29/0x3234de053c4d2f0 lrc: 4/0,0 mode: PR/PR res: [0x2b46c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfdae expref: 1756 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.445718:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11594 00000100:00100000:0.0:1651529344.445746:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1756:41279:x1731746396243200:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.445748:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11595 00010000:00010000:0.0:1651529344.445749:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.445750:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1756:41279:x1731746396243328:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.445751:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000028cf56ee/0x3234de053c4cd39 lrc: 4/0,0 mode: PR/PR res: [0x2b46e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce6c4 expref: 1756 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.445753:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.445755:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e4af5857/0x3234de053c4deb2 lrc: 4/0,0 mode: PR/PR res: [0x2b46d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b74 expref: 1756 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.445755:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000028cf56ee/0x3234de053c4cd39 lrc: 3/0,0 mode: PR/PR res: [0x2b46e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce6c4 expref: 1756 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.445759:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e4af5857/0x3234de053c4deb2 lrc: 3/0,0 mode: PR/PR res: [0x2b46d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b74 expref: 1756 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.445760:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028cf56ee/0x3234de053c4cd39 lrc: 0/0,0 mode: --/PR res: [0x2b46e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce6c4 expref: 1756 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.445764:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4af5857/0x3234de053c4deb2 lrc: 0/0,0 mode: --/PR res: [0x2b46d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b74 expref: 1756 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.445767:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.445767:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.445768:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bcdc8b9f/0x3234de053c50093 lrc: 3/0,1 mode: PW/PW res: [0x2b46e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.445769:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.445769:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.445770:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007a89dd07/0x3234de053c5009a lrc: 3/0,1 mode: PW/PW res: [0x2b46d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445771:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bcdc8b9f/0x3234de053c50093 lrc: 4/0,1 mode: PW/PW res: [0x2b46e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.445773:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a89dd07/0x3234de053c5009a lrc: 4/0,1 mode: PW/PW res: [0x2b46d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445781:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.445789:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.445797:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1754:41279:x1731746396243200:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 51us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.445800:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11594 00000100:00100000:1.0:1651529344.445802:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1754:41279:x1731746396243328:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 51us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.445805:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11595 00000100:00100000:0.0:1651529344.445806:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11596 00000100:00100000:0.0:1651529344.445808:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e45eb301 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1752:41278:x1731746396243136:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.445811:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bcdc8b9f/0x3234de053c50093 lrc: 3/0,1 mode: PW/PW res: [0x2b46e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445811:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.445812:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008b96ee29/0x3234de053c4d2f0 lrc: 4/0,0 mode: PR/PR res: [0x2b46c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfdae expref: 1752 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.445814:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bcdc8b9f/0x3234de053c50093 lrc: 3/0,1 mode: PW/PW res: [0x2b46e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445816:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008b96ee29/0x3234de053c4d2f0 lrc: 3/0,0 mode: PR/PR res: [0x2b46c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfdae expref: 1752 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.445817:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bcdc8b9f/0x3234de053c50093 lrc: 3/0,1 mode: PW/PW res: [0x2b46e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.445820:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bcdc8b9f/0x3234de053c50093 lrc: 2/0,0 mode: PW/PW res: [0x2b46e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445821:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b96ee29/0x3234de053c4d2f0 lrc: 0/0,0 mode: --/PR res: [0x2b46c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfdae expref: 1752 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.445824:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.445825:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.445825:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000049a3f5ac/0x3234de053c5008c lrc: 3/0,1 mode: PW/PW res: [0x2b46c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445849:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049a3f5ac/0x3234de053c5008c lrc: 4/0,1 mode: PW/PW res: [0x2b46c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.445861:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+311:39029:x1731745946362176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 716us (791us total) trans 12885078867 rc 0/0 00000100:00100000:1.0:1651529344.445864:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210813 00010000:00010000:0.0:1651529344.445864:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.445871:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e45eb301 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1751:41278:x1731746396243136:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 63us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.445874:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11596 00010000:00010000:0.0:1651529344.445885:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bcdc8b9f/0x3234de053c50093 lrc: 2/0,0 mode: PW/PW res: [0x2b46e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445888:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bcdc8b9f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.445889:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bcdc8b9f/0x3234de053c50093 lrc: 2/0,0 mode: PW/PW res: [0x2b46e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445892:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bcdc8b9f/0x3234de053c50093 lrc: 3/0,0 mode: PW/PW res: [0x2b46e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445896:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bcdc8b9f/0x3234de053c50093 lrc: 1/0,0 mode: --/PW res: [0x2b46e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.445897:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.445899:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bcdc8b9f/0x3234de053c50093 lrc: 0/0,0 mode: --/PW res: [0x2b46e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445904:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000049a3f5ac/0x3234de053c5008c lrc: 3/0,1 mode: PW/PW res: [0x2b46c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445909:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049a3f5ac/0x3234de053c5008c lrc: 3/0,1 mode: PW/PW res: [0x2b46c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.445912:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.445912:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049a3f5ac/0x3234de053c5008c lrc: 3/0,1 mode: PW/PW res: [0x2b46c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.445915:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049a3f5ac/0x3234de053c5008c lrc: 2/0,0 mode: PW/PW res: [0x2b46c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.445943:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.445988:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+311:39029:x1731745946362048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 869us (943us total) trans 12885078868 rc 0/0 00000100:00100000:0.0:1651529344.446003:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210812 00000100:00100000:0.0:1651529344.446009:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946362688 00000100:00100000:0.0:1651529344.446018:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946362816 00000100:00100000:0.0:1651529344.446037:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946362752 00000100:00100000:0.0:1651529344.446044:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210817 00000100:00100000:0.0:1651529344.446045:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+313:39029:x1731745946362688:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.446050:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177265 count 1 00000100:00100000:1.0:1651529344.446051:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.446068:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210818 00000100:00100000:1.0:1651529344.446070:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+313:39029:x1731745946362816:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.446076:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177267 count 1 00010000:00010000:1.0:1651529344.446086:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e4ec3ee/0x3234de053c500b6 lrc: 3/0,1 mode: --/PW res: [0x2b473:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446086:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003722c3ae/0x3234de053c500af lrc: 3/0,1 mode: --/PW res: [0x2b471:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.446091:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c4e83d lrc: 2/0,0 mode: PR/PR res: [0x2b473:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5192 expref: 1750 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.446091:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ec163e8e/0x3234de053c4d7ce lrc: 2/0,0 mode: PR/PR res: [0x2b471:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d10a8 expref: 1750 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.446094:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.446094:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.446095:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.446095:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e4ec3ee/0x3234de053c500b6 lrc: 4/0,1 mode: --/PW res: [0x2b473:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446095:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.446096:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003722c3ae/0x3234de053c500af lrc: 4/0,1 mode: --/PW res: [0x2b471:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.446102:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c4e83d lrc: 3/0,0 mode: PR/PR res: [0x2b473:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5192 expref: 1750 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.446104:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ec163e8e/0x3234de053c4d7ce lrc: 3/0,0 mode: PR/PR res: [0x2b471:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d10a8 expref: 1750 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.446106:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c4e83d lrc: 4/0,0 mode: PR/PR res: [0x2b473:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5192 expref: 1750 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.446107:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ec163e8e/0x3234de053c4d7ce lrc: 4/0,0 mode: PR/PR res: [0x2b471:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d10a8 expref: 1750 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.446110:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ad6d0877 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996959040:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.446112:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996959104:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.446119:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a6b79b05 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.446121:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aac87b31 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.446126:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a9e254e pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996958912:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.446127:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049a3f5ac/0x3234de053c5008c lrc: 2/0,0 mode: PW/PW res: [0x2b46c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446130:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000049a3f5ac already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.446131:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bd405bc5/0x3234de053c500a1 lrc: 3/0,1 mode: --/PW res: [0x2b470:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446131:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049a3f5ac/0x3234de053c5008c lrc: 2/0,0 mode: PW/PW res: [0x2b46c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446134:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049a3f5ac/0x3234de053c5008c lrc: 3/0,0 mode: PW/PW res: [0x2b46c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.446138:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210819 00010000:00010000:0.0:1651529344.446138:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049a3f5ac/0x3234de053c5008c lrc: 1/0,0 mode: --/PW res: [0x2b46c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.446139:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+313:39029:x1731745946362752:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.446141:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049a3f5ac/0x3234de053c5008c lrc: 0/0,0 mode: --/PW res: [0x2b46c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.446144:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177266 count 1 00010000:00010000:1.0:1651529344.446147:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1e9e4c0/0x3234de053c500bd lrc: 3/0,1 mode: --/PW res: [0x2b472:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.446151:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fc130754/0x3234de053c4e565 lrc: 2/0,0 mode: PR/PR res: [0x2b472:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d469b expref: 1750 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.446154:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.446154:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.446155:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1e9e4c0/0x3234de053c500bd lrc: 4/0,1 mode: --/PW res: [0x2b472:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.446161:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fc130754/0x3234de053c4e565 lrc: 3/0,0 mode: PR/PR res: [0x2b472:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d469b expref: 1750 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.446163:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996958976:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.446164:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fc130754/0x3234de053c4e565 lrc: 4/0,0 mode: PR/PR res: [0x2b472:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d469b expref: 1750 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.446167:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003e008fd4/0x3234de053c500a8 lrc: 3/0,1 mode: --/PW res: [0x2b46f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.446168:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a9e254e pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996959168:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.446174:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007a89dd07/0x3234de053c5009a lrc: 3/0,1 mode: PW/PW res: [0x2b46d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.446175:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f9dac3f6 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.446177:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a89dd07/0x3234de053c5009a lrc: 3/0,1 mode: PW/PW res: [0x2b46d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446180:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a89dd07/0x3234de053c5009a lrc: 3/0,1 mode: PW/PW res: [0x2b46d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446182:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a89dd07/0x3234de053c5009a lrc: 2/0,0 mode: PW/PW res: [0x2b46d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.446201:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.446220:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+314:39029:x1731745946362112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1048us (1123us total) trans 12885078869 rc 0/0 00000100:00100000:0.0:1651529344.446244:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210814 00010000:00010000:0.0:1651529344.446251:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a89dd07/0x3234de053c5009a lrc: 2/0,0 mode: PW/PW res: [0x2b46d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.446253:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.446255:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007a89dd07 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.446256:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a89dd07/0x3234de053c5009a lrc: 2/0,0 mode: PW/PW res: [0x2b46d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446264:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a89dd07/0x3234de053c5009a lrc: 3/0,0 mode: PW/PW res: [0x2b46d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446271:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a89dd07/0x3234de053c5009a lrc: 1/0,0 mode: --/PW res: [0x2b46d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446274:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a89dd07/0x3234de053c5009a lrc: 0/0,0 mode: --/PW res: [0x2b46d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.446281:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946363008 00000100:00100000:0.0:1651529344.446292:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210820 00000100:00100000:0.0:1651529344.446293:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+314:39030:x1731745946363008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.446294:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.446298:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177268 count 1 00010000:00010000:0.0:1651529344.446302:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c500c4 lrc: 3/0,1 mode: --/PW res: [0x2b474:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446307:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002d483992/0x3234de053c4e485 lrc: 2/0,0 mode: PR/PR res: [0x2b474:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4368 expref: 1750 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.446310:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.446310:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.446311:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c500c4 lrc: 4/0,1 mode: --/PW res: [0x2b474:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446317:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002d483992/0x3234de053c4e485 lrc: 3/0,0 mode: PR/PR res: [0x2b474:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4368 expref: 1750 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.446321:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002d483992/0x3234de053c4e485 lrc: 4/0,0 mode: PR/PR res: [0x2b474:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4368 expref: 1750 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.446322:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946363136 00000100:00100000:0.0:1651529344.446327:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996959232:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.446330:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210821 00000100:00100000:1.0:1651529344.446332:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+315:39030:x1731745946363136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.446336:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177269 count 1 00000100:00100000:0.0:1651529344.446341:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a3b00cf3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.446346:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008cdb8783/0x3234de053c500cb lrc: 3/0,1 mode: --/PW res: [0x2b475:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.446347:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396243392 00010000:00010000:1.0:1651529344.446351:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c4f63d lrc: 2/0,0 mode: PR/PR res: [0x2b475:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b9f expref: 1751 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.446352:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000018387e25/0x3234de053c4d21e lrc: 4/0,0 mode: PR/PR res: [0x2b470:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa0b expref: 1751 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.446354:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.446354:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.446355:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008cdb8783/0x3234de053c500cb lrc: 4/0,1 mode: --/PW res: [0x2b475:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.446357:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396243520 00010000:00010000:0.0:1651529344.446360:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bff28571/0x3234de053c4ee41 lrc: 4/0,0 mode: PR/PR res: [0x2b46f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b2a expref: 1752 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.446362:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c4f63d lrc: 3/0,0 mode: PR/PR res: [0x2b475:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b9f expref: 1752 pid: 156655 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.446364:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11597 00010000:00010000:1.0:1651529344.446365:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c4f63d lrc: 4/0,0 mode: PR/PR res: [0x2b475:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b9f expref: 1752 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.446366:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1752:41278:x1731746396243392:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.446368:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.446369:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ee8cd7c9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996959296:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.446370:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000018387e25/0x3234de053c4d21e lrc: 4/0,0 mode: PR/PR res: [0x2b470:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa0b expref: 1752 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.446373:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000018387e25/0x3234de053c4d21e lrc: 3/0,0 mode: PR/PR res: [0x2b470:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa0b expref: 1752 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.446378:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fb6c773d going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.446379:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018387e25/0x3234de053c4d21e lrc: 0/0,0 mode: --/PR res: [0x2b470:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa0b expref: 1752 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.446382:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.446382:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.446383:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bd405bc5/0x3234de053c500a1 lrc: 3/0,1 mode: PW/PW res: [0x2b470:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.446386:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11598 00000100:00100000:1.0:1651529344.446387:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1751:41278:x1731746396243520:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.446387:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd405bc5/0x3234de053c500a1 lrc: 4/0,1 mode: PW/PW res: [0x2b470:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.446390:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.446392:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bff28571/0x3234de053c4ee41 lrc: 4/0,0 mode: PR/PR res: [0x2b46f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b2a expref: 1751 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.446395:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.446403:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bff28571/0x3234de053c4ee41 lrc: 3/0,0 mode: PR/PR res: [0x2b46f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b2a expref: 1751 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.446409:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bff28571/0x3234de053c4ee41 lrc: 0/0,0 mode: --/PR res: [0x2b46f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b2a expref: 1751 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.446412:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.446413:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.446414:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003e008fd4/0x3234de053c500a8 lrc: 3/0,1 mode: PW/PW res: [0x2b46f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.446417:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e008fd4/0x3234de053c500a8 lrc: 4/0,1 mode: PW/PW res: [0x2b46f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.446417:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1750:41278:x1731746396243392:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.446420:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11597 00010000:00010000:1.0:1651529344.446426:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.446432:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1749:41278:x1731746396243520:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 44us (231us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.446434:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003e008fd4/0x3234de053c500a8 lrc: 3/0,1 mode: PW/PW res: [0x2b46f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.446435:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11598 00010000:00010000:0.0:1651529344.446438:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e008fd4/0x3234de053c500a8 lrc: 3/0,1 mode: PW/PW res: [0x2b46f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446441:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e008fd4/0x3234de053c500a8 lrc: 3/0,1 mode: PW/PW res: [0x2b46f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.446443:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bd405bc5/0x3234de053c500a1 lrc: 3/0,1 mode: PW/PW res: [0x2b470:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446444:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e008fd4/0x3234de053c500a8 lrc: 2/0,0 mode: PW/PW res: [0x2b46f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.446446:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd405bc5/0x3234de053c500a1 lrc: 3/0,1 mode: PW/PW res: [0x2b470:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.446449:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd405bc5/0x3234de053c500a1 lrc: 3/0,1 mode: PW/PW res: [0x2b470:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.446452:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd405bc5/0x3234de053c500a1 lrc: 2/0,0 mode: PW/PW res: [0x2b470:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.446505:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+317:39030:x1731745946362368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1138us (1221us total) trans 12885078871 rc 0/0 00000100:00100000:1.0:1651529344.446508:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210815 00000100:00100000:0.0:1651529344.446514:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+316:39030:x1731745946362304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1076us (1176us total) trans 12885078870 rc 0/0 00000100:00100000:0.0:1651529344.446517:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210816 00000100:00100000:1.0:1651529344.446523:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.446525:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e008fd4/0x3234de053c500a8 lrc: 2/0,0 mode: PW/PW res: [0x2b46f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446534:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003e008fd4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.446535:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e008fd4/0x3234de053c500a8 lrc: 2/0,0 mode: PW/PW res: [0x2b46f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446538:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e008fd4/0x3234de053c500a8 lrc: 3/0,0 mode: PW/PW res: [0x2b46f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446543:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e008fd4/0x3234de053c500a8 lrc: 1/0,0 mode: --/PW res: [0x2b46f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446546:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e008fd4/0x3234de053c500a8 lrc: 0/0,0 mode: --/PW res: [0x2b46f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446550:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd405bc5/0x3234de053c500a1 lrc: 2/0,0 mode: PW/PW res: [0x2b470:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.446552:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.446553:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bd405bc5 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.446554:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd405bc5/0x3234de053c500a1 lrc: 2/0,0 mode: PW/PW res: [0x2b470:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446556:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd405bc5/0x3234de053c500a1 lrc: 3/0,0 mode: PW/PW res: [0x2b470:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446559:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd405bc5/0x3234de053c500a1 lrc: 1/0,0 mode: --/PW res: [0x2b470:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446562:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd405bc5/0x3234de053c500a1 lrc: 0/0,0 mode: --/PW res: [0x2b470:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.446569:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946363264 00000100:00100000:0.0:1651529344.446579:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210822 00000100:00100000:0.0:1651529344.446581:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+316:39030:x1731745946363264:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.446586:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177270 count 1 00010000:00010000:0.0:1651529344.446590:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000773eb1ef/0x3234de053c500d2 lrc: 3/0,1 mode: --/PW res: [0x2b476:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446594:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001328eb82/0x3234de053c4e1ad lrc: 2/0,0 mode: PR/PR res: [0x2b476:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d37de expref: 1748 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.446597:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.446603:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.446604:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000773eb1ef/0x3234de053c500d2 lrc: 4/0,1 mode: --/PW res: [0x2b476:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446611:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001328eb82/0x3234de053c4e1ad lrc: 3/0,0 mode: PR/PR res: [0x2b476:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d37de expref: 1748 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.446615:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001328eb82/0x3234de053c4e1ad lrc: 4/0,0 mode: PR/PR res: [0x2b476:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d37de expref: 1748 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.446619:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996959360:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.446633:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed830649 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.446636:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ad6d0877 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996959040:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.446640:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001e4ec3ee/0x3234de053c500b6 lrc: 3/0,1 mode: --/PW res: [0x2b473:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.446641:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996959104:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.446645:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003722c3ae/0x3234de053c500af lrc: 3/0,1 mode: --/PW res: [0x2b471:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.446648:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396243904 00010000:00010000:1.0:1651529344.446653:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c4e83d lrc: 4/0,0 mode: PR/PR res: [0x2b473:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5192 expref: 1749 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.446664:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11599 00000100:00100000:1.0:1651529344.446665:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1749:41278:x1731746396243904:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.446668:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.446670:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c4e83d lrc: 4/0,0 mode: PR/PR res: [0x2b473:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5192 expref: 1749 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.446673:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c4e83d lrc: 3/0,0 mode: PR/PR res: [0x2b473:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5192 expref: 1749 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.446681:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c4e83d lrc: 0/0,0 mode: --/PR res: [0x2b473:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5192 expref: 1749 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.446685:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.446686:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.446687:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001e4ec3ee/0x3234de053c500b6 lrc: 3/0,1 mode: PW/PW res: [0x2b473:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.446690:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e4ec3ee/0x3234de053c500b6 lrc: 4/0,1 mode: PW/PW res: [0x2b473:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.446696:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.446703:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1748:41278:x1731746396243904:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 37us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.446705:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11599 00010000:00010000:1.0:1651529344.446711:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001e4ec3ee/0x3234de053c500b6 lrc: 3/0,1 mode: PW/PW res: [0x2b473:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.446714:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e4ec3ee/0x3234de053c500b6 lrc: 3/0,1 mode: PW/PW res: [0x2b473:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.446717:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e4ec3ee/0x3234de053c500b6 lrc: 3/0,1 mode: PW/PW res: [0x2b473:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.446719:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e4ec3ee/0x3234de053c500b6 lrc: 2/0,0 mode: PW/PW res: [0x2b473:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446733:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e4ec3ee/0x3234de053c500b6 lrc: 2/0,0 mode: PW/PW res: [0x2b473:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446751:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e4ec3ee already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.446753:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e4ec3ee/0x3234de053c500b6 lrc: 2/0,0 mode: PW/PW res: [0x2b473:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446756:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e4ec3ee/0x3234de053c500b6 lrc: 3/0,0 mode: PW/PW res: [0x2b473:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446761:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e4ec3ee/0x3234de053c500b6 lrc: 1/0,0 mode: --/PW res: [0x2b473:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446763:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e4ec3ee/0x3234de053c500b6 lrc: 0/0,0 mode: --/PW res: [0x2b473:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.446771:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+317:39029:x1731745946362816:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 700us (859us total) trans 12885078872 rc 0/0 00000100:00100000:1.0:1651529344.446774:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210818 00000100:00100000:1.0:1651529344.446808:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.446823:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.446834:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946363392 00000100:00100000:0.0:1651529344.446871:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946363456 00000100:00100000:0.0:1651529344.446880:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210823 00000100:00100000:0.0:1651529344.446882:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+318:39029:x1731745946363392:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.446887:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177271 count 1 00010000:00010000:0.0:1651529344.446891:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006878ab38/0x3234de053c500d9 lrc: 3/0,1 mode: --/PW res: [0x2b477:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.446896:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.446896:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000005ae96ce/0x3234de053c4e717 lrc: 2/0,0 mode: PR/PR res: [0x2b477:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d6a expref: 1747 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.446899:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.446900:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.446900:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006878ab38/0x3234de053c500d9 lrc: 4/0,1 mode: --/PW res: [0x2b477:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.446907:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.446908:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000005ae96ce/0x3234de053c4e717 lrc: 3/0,0 mode: PR/PR res: [0x2b477:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d6a expref: 1747 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.446922:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000005ae96ce/0x3234de053c4e717 lrc: 4/0,0 mode: PR/PR res: [0x2b477:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d6a expref: 1747 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.446926:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996959424:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.446928:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210824 00000100:00100000:1.0:1651529344.446930:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+318:39029:x1731745946363456:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.446936:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177272 count 1 00010000:00010000:1.0:1651529344.446941:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8ab2b49/0x3234de053c500e0 lrc: 3/0,1 mode: --/PW res: [0x2b478:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.446951:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c49fa4 lrc: 2/0,0 mode: PR/PR res: [0x2b478:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb4eb expref: 1747 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.446955:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.446955:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.446956:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8ab2b49/0x3234de053c500e0 lrc: 4/0,1 mode: --/PW res: [0x2b478:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.446956:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c2b2b59c going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.446963:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c49fa4 lrc: 3/0,0 mode: PR/PR res: [0x2b478:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb4eb expref: 1747 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.446966:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c49fa4 lrc: 4/0,0 mode: PR/PR res: [0x2b478:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb4eb expref: 1747 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.446974:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000089d7f5d6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996959488:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.446977:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996959232:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.446982:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a6b79b05 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.446982:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c500c4 lrc: 3/0,1 mode: --/PW res: [0x2b474:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.446990:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396243968 00000100:00100000:1.0:1651529344.446991:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a9e254e pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996959168:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.446994:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d1e9e4c0/0x3234de053c500bd lrc: 3/0,1 mode: --/PW res: [0x2b472:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.446994:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ec163e8e/0x3234de053c4d7ce lrc: 4/0,0 mode: PR/PR res: [0x2b471:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d10a8 expref: 1748 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.447000:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ee8cd7c9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996959296:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.447001:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396244096 00010000:00010000:1.0:1651529344.447003:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008cdb8783/0x3234de053c500cb lrc: 3/0,1 mode: --/PW res: [0x2b475:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447003:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fc130754/0x3234de053c4e565 lrc: 4/0,0 mode: PR/PR res: [0x2b472:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d469b expref: 1749 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.447009:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11600 00000100:00100000:0.0:1651529344.447010:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1749:41279:x1731746396243968:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.447011:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11601 00000100:00100000:1.0:1651529344.447012:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1749:41279:x1731746396244096:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.447013:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.447014:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ec163e8e/0x3234de053c4d7ce lrc: 4/0,0 mode: PR/PR res: [0x2b471:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d10a8 expref: 1749 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.447015:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.447017:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fc130754/0x3234de053c4e565 lrc: 4/0,0 mode: PR/PR res: [0x2b472:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d469b expref: 1749 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.447018:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ec163e8e/0x3234de053c4d7ce lrc: 3/0,0 mode: PR/PR res: [0x2b471:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d10a8 expref: 1749 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.447020:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fc130754/0x3234de053c4e565 lrc: 3/0,0 mode: PR/PR res: [0x2b472:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d469b expref: 1749 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.447026:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc130754/0x3234de053c4e565 lrc: 0/0,0 mode: --/PR res: [0x2b472:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d469b expref: 1749 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.447030:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.447030:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.447031:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d1e9e4c0/0x3234de053c500bd lrc: 3/0,1 mode: PW/PW res: [0x2b472:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447034:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1e9e4c0/0x3234de053c500bd lrc: 4/0,1 mode: PW/PW res: [0x2b472:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447036:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec163e8e/0x3234de053c4d7ce lrc: 0/0,0 mode: --/PR res: [0x2b471:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d10a8 expref: 1748 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.447040:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.447040:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.447040:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.447041:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003722c3ae/0x3234de053c500af lrc: 3/0,1 mode: PW/PW res: [0x2b471:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447044:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003722c3ae/0x3234de053c500af lrc: 4/0,1 mode: PW/PW res: [0x2b471:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.447045:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1747:41279:x1731746396244096:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.447048:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11601 00010000:00010000:0.0:1651529344.447051:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.447054:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d1e9e4c0/0x3234de053c500bd lrc: 3/0,1 mode: PW/PW res: [0x2b472:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447057:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1e9e4c0/0x3234de053c500bd lrc: 3/0,1 mode: PW/PW res: [0x2b472:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447060:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1e9e4c0/0x3234de053c500bd lrc: 3/0,1 mode: PW/PW res: [0x2b472:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447063:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1e9e4c0/0x3234de053c500bd lrc: 2/0,0 mode: PW/PW res: [0x2b472:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.447069:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1746:41279:x1731746396243968:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 57us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.447077:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11600 00010000:00010000:0.0:1651529344.447084:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1e9e4c0/0x3234de053c500bd lrc: 2/0,0 mode: PW/PW res: [0x2b472:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447088:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d1e9e4c0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.447089:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1e9e4c0/0x3234de053c500bd lrc: 2/0,0 mode: PW/PW res: [0x2b472:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447092:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1e9e4c0/0x3234de053c500bd lrc: 3/0,0 mode: PW/PW res: [0x2b472:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447097:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1e9e4c0/0x3234de053c500bd lrc: 1/0,0 mode: --/PW res: [0x2b472:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447099:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1e9e4c0/0x3234de053c500bd lrc: 0/0,0 mode: --/PW res: [0x2b472:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447105:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003722c3ae/0x3234de053c500af lrc: 3/0,1 mode: PW/PW res: [0x2b471:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.447107:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+319:39029:x1731745946362752:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 967us (1164us total) trans 12885078873 rc 0/0 00010000:00010000:0.0:1651529344.447108:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003722c3ae/0x3234de053c500af lrc: 3/0,1 mode: PW/PW res: [0x2b471:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.447110:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210819 00010000:00010000:0.0:1651529344.447111:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003722c3ae/0x3234de053c500af lrc: 3/0,1 mode: PW/PW res: [0x2b471:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447114:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003722c3ae/0x3234de053c500af lrc: 2/0,0 mode: PW/PW res: [0x2b471:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.447145:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.447160:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+319:39029:x1731745946362688:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1113us (1262us total) trans 12885078874 rc 0/0 00000100:00100000:0.0:1651529344.447163:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210817 00010000:00010000:0.0:1651529344.447169:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003722c3ae/0x3234de053c500af lrc: 2/0,0 mode: PW/PW res: [0x2b471:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.447170:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.447173:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003722c3ae already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.447179:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003722c3ae/0x3234de053c500af lrc: 2/0,0 mode: PW/PW res: [0x2b471:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447182:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003722c3ae/0x3234de053c500af lrc: 3/0,0 mode: PW/PW res: [0x2b471:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.447184:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.447186:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003722c3ae/0x3234de053c500af lrc: 1/0,0 mode: --/PW res: [0x2b471:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447189:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003722c3ae/0x3234de053c500af lrc: 0/0,0 mode: --/PW res: [0x2b471:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.447196:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946363520 00000100:00100000:0.0:1651529344.447206:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210825 00000100:00100000:0.0:1651529344.447208:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+319:39030:x1731745946363520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.447213:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177273 count 1 00010000:00010000:0.0:1651529344.447217:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fc3d0e3/0x3234de053c500e7 lrc: 3/0,1 mode: --/PW res: [0x2b479:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447240:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000443c0ff5/0x3234de053c4a6a4 lrc: 2/0,0 mode: PR/PR res: [0x2b479:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbbc8 expref: 1745 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.447244:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.447245:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.447245:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000fc3d0e3/0x3234de053c500e7 lrc: 4/0,1 mode: --/PW res: [0x2b479:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.447246:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.447252:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000443c0ff5/0x3234de053c4a6a4 lrc: 3/0,0 mode: PR/PR res: [0x2b479:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbbc8 expref: 1745 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.447258:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000443c0ff5/0x3234de053c4a6a4 lrc: 4/0,0 mode: PR/PR res: [0x2b479:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbbc8 expref: 1745 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.447262:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996959552:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.447272:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396244224 00000100:00100000:0.0:1651529344.447277:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a3b00cf3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.447283:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002d483992/0x3234de053c4e485 lrc: 4/0,0 mode: PR/PR res: [0x2b474:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4368 expref: 1746 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.447287:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996959360:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.447290:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396244288 00010000:00010000:0.0:1651529344.447291:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000773eb1ef/0x3234de053c500d2 lrc: 3/0,1 mode: --/PW res: [0x2b476:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447292:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c4f63d lrc: 4/0,0 mode: PR/PR res: [0x2b475:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b9f expref: 1747 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.447296:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396244352 00010000:00010000:1.0:1651529344.447299:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001328eb82/0x3234de053c4e1ad lrc: 4/0,0 mode: PR/PR res: [0x2b476:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d37de expref: 1748 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.447299:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11602 00000100:00100000:0.0:1651529344.447301:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d8aeac5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1748:41279:x1731746396244224:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.447303:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11603 00010000:00010000:0.0:1651529344.447304:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.447305:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1748:41278:x1731746396244288:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.447308:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.447309:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c4f63d lrc: 4/0,0 mode: PR/PR res: [0x2b475:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b9f expref: 1748 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.447313:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c4f63d lrc: 3/0,0 mode: PR/PR res: [0x2b475:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b9f expref: 1748 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.447318:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c4f63d lrc: 0/0,0 mode: --/PR res: [0x2b475:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b9f expref: 1748 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.447320:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002d483992/0x3234de053c4e485 lrc: 4/0,0 mode: PR/PR res: [0x2b474:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4368 expref: 1748 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.447322:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.447322:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.447323:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008cdb8783/0x3234de053c500cb lrc: 3/0,1 mode: PW/PW res: [0x2b475:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447325:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002d483992/0x3234de053c4e485 lrc: 3/0,0 mode: PR/PR res: [0x2b474:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4368 expref: 1747 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.447326:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008cdb8783/0x3234de053c500cb lrc: 4/0,1 mode: PW/PW res: [0x2b475:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447330:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d483992/0x3234de053c4e485 lrc: 0/0,0 mode: --/PR res: [0x2b474:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4368 expref: 1747 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.447333:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.447334:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.447335:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.447336:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c500c4 lrc: 3/0,1 mode: PW/PW res: [0x2b474:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.447339:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1746:41278:x1731746396244288:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 34us (156us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.447339:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c500c4 lrc: 4/0,1 mode: PW/PW res: [0x2b474:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.447342:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11603 00000100:00100000:1.0:1651529344.447346:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11604 00010000:00010000:0.0:1651529344.447346:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.447347:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1745:41278:x1731746396244352:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.447350:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.447351:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001328eb82/0x3234de053c4e1ad lrc: 4/0,0 mode: PR/PR res: [0x2b476:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d37de expref: 1745 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.447353:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d8aeac5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1745:41279:x1731746396244224:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 52us (208us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.447355:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001328eb82/0x3234de053c4e1ad lrc: 3/0,0 mode: PR/PR res: [0x2b476:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d37de expref: 1745 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.447359:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001328eb82/0x3234de053c4e1ad lrc: 0/0,0 mode: --/PR res: [0x2b476:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d37de expref: 1745 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.447362:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.447363:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.447364:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000773eb1ef/0x3234de053c500d2 lrc: 3/0,1 mode: PW/PW res: [0x2b476:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447366:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000773eb1ef/0x3234de053c500d2 lrc: 4/0,1 mode: PW/PW res: [0x2b476:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.447370:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11602 00010000:00010000:1.0:1651529344.447379:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.447384:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1743:41278:x1731746396244352:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.447387:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11604 00010000:00010000:0.0:1651529344.447387:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000773eb1ef/0x3234de053c500d2 lrc: 3/0,1 mode: PW/PW res: [0x2b476:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447391:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000773eb1ef/0x3234de053c500d2 lrc: 3/0,1 mode: PW/PW res: [0x2b476:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447393:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008cdb8783/0x3234de053c500cb lrc: 3/0,1 mode: PW/PW res: [0x2b475:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447394:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000773eb1ef/0x3234de053c500d2 lrc: 3/0,1 mode: PW/PW res: [0x2b476:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447397:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008cdb8783/0x3234de053c500cb lrc: 3/0,1 mode: PW/PW res: [0x2b475:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447397:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000773eb1ef/0x3234de053c500d2 lrc: 2/0,0 mode: PW/PW res: [0x2b476:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447400:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008cdb8783/0x3234de053c500cb lrc: 3/0,1 mode: PW/PW res: [0x2b475:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447402:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008cdb8783/0x3234de053c500cb lrc: 2/0,0 mode: PW/PW res: [0x2b475:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.447441:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+321:39030:x1731745946363264:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 859us (917us total) trans 12885078875 rc 0/0 00000100:00100000:1.0:1651529344.447444:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+321:39030:x1731745946363136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1112us (1155us total) trans 12885078876 rc 0/0 00000100:00100000:0.0:1651529344.447444:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210822 00000100:00100000:1.0:1651529344.447447:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210821 00010000:00010000:0.0:1651529344.447451:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000773eb1ef/0x3234de053c500d2 lrc: 2/0,0 mode: PW/PW res: [0x2b476:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.447462:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.447470:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000773eb1ef already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.447471:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000773eb1ef/0x3234de053c500d2 lrc: 2/0,0 mode: PW/PW res: [0x2b476:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447474:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000773eb1ef/0x3234de053c500d2 lrc: 3/0,0 mode: PW/PW res: [0x2b476:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447479:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000773eb1ef/0x3234de053c500d2 lrc: 1/0,0 mode: --/PW res: [0x2b476:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.447480:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.447482:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000773eb1ef/0x3234de053c500d2 lrc: 0/0,0 mode: --/PW res: [0x2b476:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447492:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008cdb8783/0x3234de053c500cb lrc: 2/0,0 mode: PW/PW res: [0x2b475:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447509:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008cdb8783 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.447510:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008cdb8783/0x3234de053c500cb lrc: 2/0,0 mode: PW/PW res: [0x2b475:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447514:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008cdb8783/0x3234de053c500cb lrc: 3/0,0 mode: PW/PW res: [0x2b475:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447517:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008cdb8783/0x3234de053c500cb lrc: 1/0,0 mode: --/PW res: [0x2b475:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447520:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008cdb8783/0x3234de053c500cb lrc: 0/0,0 mode: --/PW res: [0x2b475:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.447529:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946363840 00000100:00100000:0.0:1651529344.447539:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946363776 00000100:00100000:0.0:1651529344.447546:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210826 00000100:00100000:1.0:1651529344.447547:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.447547:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+321:39029:x1731745946363840:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.447552:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177275 count 1 00010000:00010000:0.0:1651529344.447556:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c500ee lrc: 3/0,1 mode: --/PW res: [0x2b47b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447560:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000034eb7dbd/0x3234de053c4ccec lrc: 2/0,0 mode: PR/PR res: [0x2b47b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce5f2 expref: 1742 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.447563:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.447564:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.447564:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c500ee lrc: 4/0,1 mode: --/PW res: [0x2b47b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447571:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000034eb7dbd/0x3234de053c4ccec lrc: 3/0,0 mode: PR/PR res: [0x2b47b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce5f2 expref: 1742 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.447574:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.447574:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000034eb7dbd/0x3234de053c4ccec lrc: 4/0,0 mode: PR/PR res: [0x2b47b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce5f2 expref: 1742 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.447584:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996959616:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.447587:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000089d7f5d6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996959488:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.447591:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c8ab2b49/0x3234de053c500e0 lrc: 3/0,1 mode: --/PW res: [0x2b478:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.447599:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c0dff858 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.447604:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c500c4 lrc: 3/0,1 mode: PW/PW res: [0x2b474:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.447606:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210827 00010000:00010000:0.0:1651529344.447607:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c500c4 lrc: 3/0,1 mode: PW/PW res: [0x2b474:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.447608:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+321:39029:x1731745946363776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.447612:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c500c4 lrc: 3/0,1 mode: PW/PW res: [0x2b474:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.447613:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177274 count 1 00010000:00010000:0.0:1651529344.447615:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c500c4 lrc: 2/0,0 mode: PW/PW res: [0x2b474:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447617:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f64f7b54/0x3234de053c500f5 lrc: 3/0,1 mode: --/PW res: [0x2b47a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447622:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000051eb5c0f/0x3234de053c4de1f lrc: 2/0,0 mode: PR/PR res: [0x2b47a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2998 expref: 1742 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.447625:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.447626:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.447626:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f64f7b54/0x3234de053c500f5 lrc: 4/0,1 mode: --/PW res: [0x2b47a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447633:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000051eb5c0f/0x3234de053c4de1f lrc: 3/0,0 mode: PR/PR res: [0x2b47a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2998 expref: 1742 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.447636:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000051eb5c0f/0x3234de053c4de1f lrc: 4/0,0 mode: PR/PR res: [0x2b47a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2998 expref: 1742 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.447640:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005d3fb3ef pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996959680:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.447649:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a6b79b05 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.447656:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396244416 00010000:00010000:1.0:1651529344.447660:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000005ae96ce/0x3234de053c4e717 lrc: 5/0,0 mode: PR/PR res: [0x2b477:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d6a expref: 1743 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.447668:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396244544 00010000:00010000:1.0:1651529344.447670:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c49fa4 lrc: 4/0,0 mode: PR/PR res: [0x2b478:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb4eb expref: 1744 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.447675:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11605 00000100:00100000:1.0:1651529344.447676:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1744:41279:x1731746396244416:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.447679:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.447679:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+322:39030:x1731745946363008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1385us (1426us total) trans 12885078877 rc 0/0 00010000:00010000:1.0:1651529344.447680:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000005ae96ce/0x3234de053c4e717 lrc: 5/0,0 mode: PR/PR res: [0x2b477:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d6a expref: 1744 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.447682:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210820 00010000:00010000:1.0:1651529344.447684:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000005ae96ce/0x3234de053c4e717 lrc: 4/0,0 mode: PR/PR res: [0x2b477:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d6a expref: 1744 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.447689:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.447690:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.447690:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c500c4 lrc: 2/0,0 mode: PW/PW res: [0x2b474:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447691:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006878ab38/0x3234de053c500d9 lrc: 3/0,1 mode: PW/PW res: [0x2b477:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447693:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008208703f already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.447694:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006878ab38/0x3234de053c500d9 lrc: 4/0,1 mode: PW/PW res: [0x2b477:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447694:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c500c4 lrc: 2/0,0 mode: PW/PW res: [0x2b474:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447697:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c500c4 lrc: 3/0,0 mode: PW/PW res: [0x2b474:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447698:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.447702:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c500c4 lrc: 1/0,0 mode: --/PW res: [0x2b474:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.447703:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1744:41279:x1731746396244416:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 26us (166us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.447704:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008208703f/0x3234de053c500c4 lrc: 0/0,0 mode: --/PW res: [0x2b474:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.447706:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11605 00000100:00100000:1.0:1651529344.447709:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11606 00000100:00100000:1.0:1651529344.447711:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1743:41279:x1731746396244544:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.447713:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.447714:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c49fa4 lrc: 4/0,0 mode: PR/PR res: [0x2b478:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb4eb expref: 1743 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.447717:0:80280:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005ae96ce/0x3234de053c4e717 lrc: 0/0,0 mode: --/PR res: [0x2b477:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d6a expref: 1743 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.447718:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c49fa4 lrc: 3/0,0 mode: PR/PR res: [0x2b478:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb4eb expref: 1743 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.447721:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996959424:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.447722:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c49fa4 lrc: 0/0,0 mode: --/PR res: [0x2b478:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb4eb expref: 1742 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.447725:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.447725:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006878ab38/0x3234de053c500d9 lrc: 3/0,1 mode: PW/PW res: [0x2b477:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447726:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.447726:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c8ab2b49/0x3234de053c500e0 lrc: 3/0,1 mode: PW/PW res: [0x2b478:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447728:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006878ab38/0x3234de053c500d9 lrc: 3/0,1 mode: PW/PW res: [0x2b477:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447729:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8ab2b49/0x3234de053c500e0 lrc: 4/0,1 mode: PW/PW res: [0x2b478:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447745:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.447751:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1741:41279:x1731746396244544:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 39us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.447753:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11606 00010000:00010000:0.0:1651529344.447758:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006878ab38/0x3234de053c500d9 lrc: 3/0,1 mode: PW/PW res: [0x2b477:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447759:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c8ab2b49/0x3234de053c500e0 lrc: 3/0,1 mode: PW/PW res: [0x2b478:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447761:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006878ab38/0x3234de053c500d9 lrc: 3/0,1 mode: PW/PW res: [0x2b477:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447763:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8ab2b49/0x3234de053c500e0 lrc: 3/0,1 mode: PW/PW res: [0x2b478:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447764:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006878ab38/0x3234de053c500d9 lrc: 2/0,0 mode: PW/PW res: [0x2b477:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447768:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8ab2b49/0x3234de053c500e0 lrc: 3/0,1 mode: PW/PW res: [0x2b478:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447771:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8ab2b49/0x3234de053c500e0 lrc: 2/0,0 mode: PW/PW res: [0x2b478:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.447810:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+323:39029:x1731745946363392:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 927us (1002us total) trans 12885078878 rc 0/0 00000100:00100000:1.0:1651529344.447813:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+323:39029:x1731745946363456:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 882us (989us total) trans 12885078879 rc 0/0 00000100:00100000:0.0:1651529344.447813:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210823 00000100:00100000:1.0:1651529344.447816:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210824 00010000:00010000:0.0:1651529344.447820:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006878ab38/0x3234de053c500d9 lrc: 2/0,0 mode: PW/PW res: [0x2b477:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447823:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006878ab38 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.447824:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006878ab38/0x3234de053c500d9 lrc: 2/0,0 mode: PW/PW res: [0x2b477:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447830:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006878ab38/0x3234de053c500d9 lrc: 3/0,0 mode: PW/PW res: [0x2b477:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447834:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006878ab38/0x3234de053c500d9 lrc: 1/0,0 mode: --/PW res: [0x2b477:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447837:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006878ab38/0x3234de053c500d9 lrc: 0/0,0 mode: --/PW res: [0x2b477:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447841:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8ab2b49/0x3234de053c500e0 lrc: 2/0,0 mode: PW/PW res: [0x2b478:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447844:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c8ab2b49 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.447845:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8ab2b49/0x3234de053c500e0 lrc: 2/0,0 mode: PW/PW res: [0x2b478:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447847:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8ab2b49/0x3234de053c500e0 lrc: 3/0,0 mode: PW/PW res: [0x2b478:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.447850:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.447850:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8ab2b49/0x3234de053c500e0 lrc: 1/0,0 mode: --/PW res: [0x2b478:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447853:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8ab2b49/0x3234de053c500e0 lrc: 0/0,0 mode: --/PW res: [0x2b478:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.447877:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996959552:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.447878:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.447887:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000fc3d0e3/0x3234de053c500e7 lrc: 3/0,1 mode: --/PW res: [0x2b479:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.447891:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.447894:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946364032 00000100:00100000:0.0:1651529344.447900:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946364096 00000100:00100000:0.0:1651529344.447908:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210828 00000100:00100000:0.0:1651529344.447909:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+323:39030:x1731745946364032:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.447915:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177276 count 1 00010000:00010000:0.0:1651529344.447919:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9e60cf2/0x3234de053c500fc lrc: 3/0,1 mode: --/PW res: [0x2b47c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447923:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000077c0819/0x3234de053c4c84d lrc: 2/0,0 mode: PR/PR res: [0x2b47c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd35a expref: 1740 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.447926:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.447927:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.447928:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9e60cf2/0x3234de053c500fc lrc: 4/0,1 mode: --/PW res: [0x2b47c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.447934:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000077c0819/0x3234de053c4c84d lrc: 3/0,0 mode: PR/PR res: [0x2b47c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd35a expref: 1740 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.447937:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000077c0819/0x3234de053c4c84d lrc: 4/0,0 mode: PR/PR res: [0x2b47c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd35a expref: 1740 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.447940:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210829 00000100:00100000:0.0:1651529344.447941:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996959744:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.447942:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+323:39030:x1731745946364096:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.447948:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177277 count 1 00010000:00010000:1.0:1651529344.447958:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000431e46a9/0x3234de053c50103 lrc: 3/0,1 mode: --/PW res: [0x2b47d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.447964:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000008fba62e/0x3234de053c4d344 lrc: 2/0,0 mode: PR/PR res: [0x2b47d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfee9 expref: 1740 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.447967:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.447967:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.447968:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000431e46a9/0x3234de053c50103 lrc: 4/0,1 mode: --/PW res: [0x2b47d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.447968:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c2b2b59c going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.447978:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000008fba62e/0x3234de053c4d344 lrc: 3/0,0 mode: PR/PR res: [0x2b47d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfee9 expref: 1740 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.447982:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000008fba62e/0x3234de053c4d344 lrc: 4/0,0 mode: PR/PR res: [0x2b47d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfee9 expref: 1740 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.447986:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f39ca9ea pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996959808:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.447994:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd96f074 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.448001:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396244608 00010000:00010000:1.0:1651529344.448006:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000443c0ff5/0x3234de053c4a6a4 lrc: 4/0,0 mode: PR/PR res: [0x2b479:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbbc8 expref: 1741 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.448017:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11607 00000100:00100000:1.0:1651529344.448019:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1741:41278:x1731746396244608:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.448022:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.448023:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000443c0ff5/0x3234de053c4a6a4 lrc: 4/0,0 mode: PR/PR res: [0x2b479:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbbc8 expref: 1741 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.448027:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000443c0ff5/0x3234de053c4a6a4 lrc: 3/0,0 mode: PR/PR res: [0x2b479:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbbc8 expref: 1741 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.448032:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000443c0ff5/0x3234de053c4a6a4 lrc: 0/0,0 mode: --/PR res: [0x2b479:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbbc8 expref: 1741 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.448036:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.448036:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.448037:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000fc3d0e3/0x3234de053c500e7 lrc: 3/0,1 mode: PW/PW res: [0x2b479:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.448040:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000fc3d0e3/0x3234de053c500e7 lrc: 4/0,1 mode: PW/PW res: [0x2b479:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.448048:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.448050:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000fc3d0e3/0x3234de053c500e7 lrc: 3/0,1 mode: PW/PW res: [0x2b479:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.448054:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1740:41278:x1731746396244608:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.448057:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11607 00010000:00010000:0.0:1651529344.448064:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000fc3d0e3/0x3234de053c500e7 lrc: 3/0,1 mode: PW/PW res: [0x2b479:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448067:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fc3d0e3/0x3234de053c500e7 lrc: 3/0,1 mode: PW/PW res: [0x2b479:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448070:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000fc3d0e3/0x3234de053c500e7 lrc: 2/0,0 mode: PW/PW res: [0x2b479:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.448072:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.448111:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.448122:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946364416 00000100:00100000:1.0:1651529344.448129:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946364352 00000100:00100000:1.0:1651529344.448133:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210830 00000100:00100000:1.0:1651529344.448134:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+326:39030:x1731745946364416:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.448145:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177279 count 1 00010000:00010000:1.0:1651529344.448149:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9ee567c/0x3234de053c5010a lrc: 3/0,1 mode: --/PW res: [0x2b47f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.448149:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+326:39030:x1731745946363520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 939us (978us total) trans 12885078880 rc 0/0 00000100:00100000:0.0:1651529344.448152:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210825 00010000:00010000:1.0:1651529344.448154:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008cfeaf81/0x3234de053c4eef7 lrc: 2/0,0 mode: PR/PR res: [0x2b47f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e3a expref: 1739 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.448157:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.448157:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.448158:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9ee567c/0x3234de053c5010a lrc: 4/0,1 mode: --/PW res: [0x2b47f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.448158:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210831 00000100:00100000:0.0:1651529344.448159:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+325:39030:x1731745946364352:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.448164:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008cfeaf81/0x3234de053c4eef7 lrc: 3/0,0 mode: PR/PR res: [0x2b47f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e3a expref: 1739 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.448165:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177278 count 1 00010000:00010000:1.0:1651529344.448168:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008cfeaf81/0x3234de053c4eef7 lrc: 4/0,0 mode: PR/PR res: [0x2b47f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e3a expref: 1739 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.448169:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c50111 lrc: 3/0,1 mode: --/PW res: [0x2b47e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.448172:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000075e1000f pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996959872:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.448173:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000ed2c637/0x3234de053c4e3cf lrc: 2/0,0 mode: PR/PR res: [0x2b47e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4043 expref: 1739 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.448176:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.448177:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.448178:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c50111 lrc: 4/0,1 mode: --/PW res: [0x2b47e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.448181:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 000000004698fefb going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.448187:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000ed2c637/0x3234de053c4e3cf lrc: 3/0,0 mode: PR/PR res: [0x2b47e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4043 expref: 1739 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.448191:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000ed2c637/0x3234de053c4e3cf lrc: 4/0,0 mode: PR/PR res: [0x2b47e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4043 expref: 1739 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.448194:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.448195:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996959936:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.448203:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e7e12492 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.448208:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000fc3d0e3/0x3234de053c500e7 lrc: 2/0,0 mode: PW/PW res: [0x2b479:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448211:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000fc3d0e3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.448212:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000fc3d0e3/0x3234de053c500e7 lrc: 2/0,0 mode: PW/PW res: [0x2b479:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448215:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000fc3d0e3/0x3234de053c500e7 lrc: 3/0,0 mode: PW/PW res: [0x2b479:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448219:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000fc3d0e3/0x3234de053c500e7 lrc: 1/0,0 mode: --/PW res: [0x2b479:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448243:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000fc3d0e3/0x3234de053c500e7 lrc: 0/0,0 mode: --/PW res: [0x2b479:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.448251:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946364480 00000100:00100000:0.0:1651529344.448261:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210832 00000100:00100000:0.0:1651529344.448263:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+326:39029:x1731745946364480:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.448273:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177280 count 1 00010000:00010000:0.0:1651529344.448277:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c50118 lrc: 3/0,1 mode: --/PW res: [0x2b480:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448282:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c7d5d09f/0x3234de053c4f270 lrc: 2/0,0 mode: PR/PR res: [0x2b480:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ce9 expref: 1739 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.448285:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.448286:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.448286:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c50118 lrc: 4/0,1 mode: --/PW res: [0x2b480:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448293:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c7d5d09f/0x3234de053c4f270 lrc: 3/0,0 mode: PR/PR res: [0x2b480:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ce9 expref: 1739 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.448296:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c7d5d09f/0x3234de053c4f270 lrc: 4/0,0 mode: PR/PR res: [0x2b480:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ce9 expref: 1739 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.448300:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996960000:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.448303:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.448310:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 0000000070e666f7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.448312:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.448346:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996959616:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.448351:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005d3fb3ef pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996959680:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.448351:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c500ee lrc: 3/0,1 mode: --/PW res: [0x2b47b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.448356:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f64f7b54/0x3234de053c500f5 lrc: 3/0,1 mode: --/PW res: [0x2b47a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.448359:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396244928 00000100:00100000:1.0:1651529344.448363:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396244864 00010000:00010000:0.0:1651529344.448364:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000051eb5c0f/0x3234de053c4de1f lrc: 4/0,0 mode: PR/PR res: [0x2b47a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2998 expref: 1741 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.448367:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000034eb7dbd/0x3234de053c4ccec lrc: 4/0,0 mode: PR/PR res: [0x2b47b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce5f2 expref: 1741 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.448371:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11608 00000100:00100000:0.0:1651529344.448373:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1741:41278:x1731746396244928:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.448375:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.448380:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11609 00000100:00100000:1.0:1651529344.448382:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045c93b49 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1741:41279:x1731746396244864:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.448383:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000051eb5c0f/0x3234de053c4de1f lrc: 4/0,0 mode: PR/PR res: [0x2b47a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2998 expref: 1741 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.448384:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.448386:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000034eb7dbd/0x3234de053c4ccec lrc: 4/0,0 mode: PR/PR res: [0x2b47b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce5f2 expref: 1741 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.448386:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000051eb5c0f/0x3234de053c4de1f lrc: 3/0,0 mode: PR/PR res: [0x2b47a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2998 expref: 1741 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.448390:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000034eb7dbd/0x3234de053c4ccec lrc: 3/0,0 mode: PR/PR res: [0x2b47b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce5f2 expref: 1741 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.448392:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051eb5c0f/0x3234de053c4de1f lrc: 0/0,0 mode: --/PR res: [0x2b47a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2998 expref: 1741 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.448395:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.448396:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.448397:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f64f7b54/0x3234de053c500f5 lrc: 3/0,1 mode: PW/PW res: [0x2b47a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.448398:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034eb7dbd/0x3234de053c4ccec lrc: 0/0,0 mode: --/PR res: [0x2b47b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce5f2 expref: 1740 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.448400:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f64f7b54/0x3234de053c500f5 lrc: 4/0,1 mode: PW/PW res: [0x2b47a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.448402:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.448403:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.448404:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c500ee lrc: 3/0,1 mode: PW/PW res: [0x2b47b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448409:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.448412:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c500ee lrc: 4/0,1 mode: PW/PW res: [0x2b47b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.448416:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1739:41278:x1731746396244928:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 43us (114us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.448421:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.448424:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11608 00000100:00100000:1.0:1651529344.448428:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045c93b49 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1738:41279:x1731746396244864:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 46us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.448431:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11609 00010000:00010000:1.0:1651529344.448442:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f64f7b54/0x3234de053c500f5 lrc: 3/0,1 mode: PW/PW res: [0x2b47a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448444:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c500ee lrc: 3/0,1 mode: PW/PW res: [0x2b47b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.448445:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f64f7b54/0x3234de053c500f5 lrc: 3/0,1 mode: PW/PW res: [0x2b47a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.448448:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f64f7b54/0x3234de053c500f5 lrc: 3/0,1 mode: PW/PW res: [0x2b47a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448448:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c500ee lrc: 3/0,1 mode: PW/PW res: [0x2b47b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.448451:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f64f7b54/0x3234de053c500f5 lrc: 2/0,0 mode: PW/PW res: [0x2b47a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448451:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c500ee lrc: 3/0,1 mode: PW/PW res: [0x2b47b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448454:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c500ee lrc: 2/0,0 mode: PW/PW res: [0x2b47b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.448494:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+328:39029:x1731745946363776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 885us (1014us total) trans 12885078881 rc 0/0 00000100:00100000:1.0:1651529344.448497:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210827 00000100:00100000:0.0:1651529344.448504:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+327:39029:x1731745946363840:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 956us (1042us total) trans 12885078882 rc 0/0 00000100:00100000:0.0:1651529344.448508:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210826 00000100:00100000:1.0:1651529344.448513:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.448515:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f64f7b54/0x3234de053c500f5 lrc: 2/0,0 mode: PW/PW res: [0x2b47a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448526:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f64f7b54 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.448527:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f64f7b54/0x3234de053c500f5 lrc: 2/0,0 mode: PW/PW res: [0x2b47a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448530:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f64f7b54/0x3234de053c500f5 lrc: 3/0,0 mode: PW/PW res: [0x2b47a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448534:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f64f7b54/0x3234de053c500f5 lrc: 1/0,0 mode: --/PW res: [0x2b47a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448556:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f64f7b54/0x3234de053c500f5 lrc: 0/0,0 mode: --/PW res: [0x2b47a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448561:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c500ee lrc: 2/0,0 mode: PW/PW res: [0x2b47b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448564:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c78576a1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.448565:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c500ee lrc: 2/0,0 mode: PW/PW res: [0x2b47b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448567:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c500ee lrc: 3/0,0 mode: PW/PW res: [0x2b47b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448571:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c500ee lrc: 1/0,0 mode: --/PW res: [0x2b47b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448574:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c500ee lrc: 0/0,0 mode: --/PW res: [0x2b47b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.448581:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946364544 00000100:00100000:0.0:1651529344.448592:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210833 00000100:00100000:0.0:1651529344.448594:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+327:39029:x1731745946364544:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.448599:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177281 count 1 00010000:00010000:0.0:1651529344.448603:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089368d5b/0x3234de053c5011f lrc: 3/0,1 mode: --/PW res: [0x2b481:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.448605:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.448607:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a8e8757f/0x3234de053c4e02c lrc: 2/0,0 mode: PR/PR res: [0x2b481:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d31e1 expref: 1737 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.448616:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.448619:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.448619:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.448620:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089368d5b/0x3234de053c5011f lrc: 4/0,1 mode: --/PW res: [0x2b481:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448631:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a8e8757f/0x3234de053c4e02c lrc: 3/0,0 mode: PR/PR res: [0x2b481:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d31e1 expref: 1737 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.448639:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a8e8757f/0x3234de053c4e02c lrc: 4/0,0 mode: PR/PR res: [0x2b481:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d31e1 expref: 1737 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.448641:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f39ca9ea pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996959808:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.448644:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996960064:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.448645:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000431e46a9/0x3234de053c50103 lrc: 3/0,1 mode: --/PW res: [0x2b47d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.448653:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000075e1000f pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996959872:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.448655:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f9ee567c/0x3234de053c5010a lrc: 3/0,1 mode: --/PW res: [0x2b47f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.448658:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c0dff858 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.448666:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996959936:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.448668:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396244992 00010000:00010000:0.0:1651529344.448669:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c50111 lrc: 3/0,1 mode: --/PW res: [0x2b47e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.448673:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000077c0819/0x3234de053c4c84d lrc: 5/0,0 mode: PR/PR res: [0x2b47c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd35a expref: 1738 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.448676:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396245120 00000100:00100000:1.0:1651529344.448678:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11610 00000100:00100000:1.0:1651529344.448680:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1739:41278:x1731746396244992:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.448680:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000008fba62e/0x3234de053c4d344 lrc: 4/0,0 mode: PR/PR res: [0x2b47d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfee9 expref: 1739 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.448683:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.448684:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000077c0819/0x3234de053c4c84d lrc: 5/0,0 mode: PR/PR res: [0x2b47c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd35a expref: 1739 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.448686:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11611 00000100:00100000:0.0:1651529344.448688:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1739:41278:x1731746396245120:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.448690:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000077c0819/0x3234de053c4c84d lrc: 4/0,0 mode: PR/PR res: [0x2b47c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd35a expref: 1739 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.448690:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.448692:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000008fba62e/0x3234de053c4d344 lrc: 4/0,0 mode: PR/PR res: [0x2b47d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfee9 expref: 1739 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.448696:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.448697:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.448697:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a9e60cf2/0x3234de053c500fc lrc: 3/0,1 mode: PW/PW res: [0x2b47c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.448700:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9e60cf2/0x3234de053c500fc lrc: 4/0,1 mode: PW/PW res: [0x2b47c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.448705:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.448711:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1739:41278:x1731746396244992:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 31us (106us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.448713:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000008fba62e/0x3234de053c4d344 lrc: 3/0,0 mode: PR/PR res: [0x2b47d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfee9 expref: 1739 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.448714:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11610 00010000:00010000:0.0:1651529344.448719:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008fba62e/0x3234de053c4d344 lrc: 0/0,0 mode: --/PR res: [0x2b47d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfee9 expref: 1738 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.448723:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.448724:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.448724:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000431e46a9/0x3234de053c50103 lrc: 3/0,1 mode: PW/PW res: [0x2b47d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.448727:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.448728:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000431e46a9/0x3234de053c50103 lrc: 4/0,1 mode: PW/PW res: [0x2b47d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448745:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.448754:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1737:41278:x1731746396245120:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 65us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.448757:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.448757:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11611 00000100:00100000:0.0:1651529344.448762:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396245376 00010000:00010000:0.0:1651529344.448765:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008cfeaf81/0x3234de053c4eef7 lrc: 4/0,0 mode: PR/PR res: [0x2b47f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e3a expref: 1737 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.448767:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.448770:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396245440 00010000:00010000:0.0:1651529344.448772:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000ed2c637/0x3234de053c4e3cf lrc: 4/0,0 mode: PR/PR res: [0x2b47e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4043 expref: 1738 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.448777:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11612 00000100:00100000:0.0:1651529344.448778:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1738:41279:x1731746396245376:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.448781:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.448782:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008cfeaf81/0x3234de053c4eef7 lrc: 4/0,0 mode: PR/PR res: [0x2b47f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e3a expref: 1738 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.448785:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008cfeaf81/0x3234de053c4eef7 lrc: 3/0,0 mode: PR/PR res: [0x2b47f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e3a expref: 1738 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.448790:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008cfeaf81/0x3234de053c4eef7 lrc: 0/0,0 mode: --/PR res: [0x2b47f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e3a expref: 1738 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.448793:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.448794:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.448795:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f9ee567c/0x3234de053c5010a lrc: 3/0,1 mode: PW/PW res: [0x2b47f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.448796:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.448798:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9ee567c/0x3234de053c5010a lrc: 4/0,1 mode: PW/PW res: [0x2b47f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.448803:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.448806:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.448812:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1737:41279:x1731746396245376:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 33us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.448815:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11612 00000100:00100000:0.0:1651529344.448819:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396245504 00010000:00010000:0.0:1651529344.448821:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c7d5d09f/0x3234de053c4f270 lrc: 5/0,0 mode: PR/PR res: [0x2b480:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ce9 expref: 1737 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.448826:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11613 00000100:00100000:0.0:1651529344.448828:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1737:41279:x1731746396245440:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.448830:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.448831:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000ed2c637/0x3234de053c4e3cf lrc: 4/0,0 mode: PR/PR res: [0x2b47e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4043 expref: 1737 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.448834:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000ed2c637/0x3234de053c4e3cf lrc: 3/0,0 mode: PR/PR res: [0x2b47e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4043 expref: 1737 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.448836:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000431e46a9/0x3234de053c50103 lrc: 3/0,1 mode: PW/PW res: [0x2b47d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448838:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ed2c637/0x3234de053c4e3cf lrc: 0/0,0 mode: --/PR res: [0x2b47e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4043 expref: 1737 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.448840:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000431e46a9/0x3234de053c50103 lrc: 3/0,1 mode: PW/PW res: [0x2b47d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448842:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.448842:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.448843:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000431e46a9/0x3234de053c50103 lrc: 3/0,1 mode: PW/PW res: [0x2b47d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448843:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c50111 lrc: 3/0,1 mode: PW/PW res: [0x2b47e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.448846:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000431e46a9/0x3234de053c50103 lrc: 2/0,0 mode: PW/PW res: [0x2b47d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448846:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c50111 lrc: 4/0,1 mode: PW/PW res: [0x2b47e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448852:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.448868:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1736:41279:x1731746396245440:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 39us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.448870:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11613 00000100:00100000:0.0:1651529344.448874:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11614 00000100:00100000:0.0:1651529344.448876:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1735:41278:x1731746396245504:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.448878:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.448880:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c7d5d09f/0x3234de053c4f270 lrc: 5/0,0 mode: PR/PR res: [0x2b480:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ce9 expref: 1735 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.448884:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c7d5d09f/0x3234de053c4f270 lrc: 4/0,0 mode: PR/PR res: [0x2b480:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ce9 expref: 1735 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.448897:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+328:39030:x1731745946364096:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 954us (1018us total) trans 12885078883 rc 0/0 00000100:00100000:1.0:1651529344.448900:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210829 00010000:00010000:0.0:1651529344.448902:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.448903:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.448904:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c50118 lrc: 3/0,1 mode: PW/PW res: [0x2b480:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.448905:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946364800 00010000:00010000:0.0:1651529344.448907:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c50118 lrc: 4/0,1 mode: PW/PW res: [0x2b480:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.448911:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946364864 00000100:00100000:1.0:1651529344.448915:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210834 00000100:00100000:1.0:1651529344.448916:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+329:39030:x1731745946364800:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.448921:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177282 count 1 00010000:00010000:0.0:1651529344.448921:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.448925:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de1a14c6/0x3234de053c50126 lrc: 3/0,1 mode: --/PW res: [0x2b482:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.448927:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1735:41278:x1731746396245504:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 50us (123us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.448930:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e564c159/0x3234de053c4e493 lrc: 2/0,0 mode: PR/PR res: [0x2b482:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d437d expref: 1735 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.448930:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11614 00010000:00010000:1.0:1651529344.448933:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.448934:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.448934:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de1a14c6/0x3234de053c50126 lrc: 4/0,1 mode: --/PW res: [0x2b482:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448937:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000431e46a9/0x3234de053c50103 lrc: 2/0,0 mode: PW/PW res: [0x2b47d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448940:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000431e46a9 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.448941:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e564c159/0x3234de053c4e493 lrc: 3/0,0 mode: PR/PR res: [0x2b482:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d437d expref: 1734 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.448941:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000431e46a9/0x3234de053c50103 lrc: 2/0,0 mode: PW/PW res: [0x2b47d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.448944:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e564c159/0x3234de053c4e493 lrc: 4/0,0 mode: PR/PR res: [0x2b482:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d437d expref: 1734 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.448944:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000431e46a9/0x3234de053c50103 lrc: 3/0,0 mode: PW/PW res: [0x2b47d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.448948:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dff6a73d pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996960128:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.448948:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000431e46a9/0x3234de053c50103 lrc: 1/0,0 mode: --/PW res: [0x2b47d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448953:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000431e46a9/0x3234de053c50103 lrc: 0/0,0 mode: --/PW res: [0x2b47d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.448956:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a6b79b05 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.448959:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c50111 lrc: 3/0,1 mode: PW/PW res: [0x2b47e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.448963:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210835 00000100:00100000:1.0:1651529344.448964:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+329:39030:x1731745946364864:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.448968:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177283 count 1 00010000:00010000:1.0:1651529344.448971:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007f5d689/0x3234de053c5012d lrc: 3/0,1 mode: --/PW res: [0x2b483:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448974:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c50111 lrc: 3/0,1 mode: PW/PW res: [0x2b47e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.448976:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c4eecd lrc: 2/0,0 mode: PR/PR res: [0x2b483:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d30 expref: 1734 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.448977:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c50111 lrc: 3/0,1 mode: PW/PW res: [0x2b47e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.448978:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.448979:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.448979:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007f5d689/0x3234de053c5012d lrc: 4/0,1 mode: --/PW res: [0x2b483:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.448980:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c50111 lrc: 2/0,0 mode: PW/PW res: [0x2b47e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.448985:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c4eecd lrc: 3/0,0 mode: PR/PR res: [0x2b483:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d30 expref: 1734 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.448988:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c4eecd lrc: 4/0,0 mode: PR/PR res: [0x2b483:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d30 expref: 1734 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.448992:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006e3eb319 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996960192:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.448997:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aeda71fe going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.449002:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f9ee567c/0x3234de053c5010a lrc: 3/0,1 mode: PW/PW res: [0x2b47f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.449005:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9ee567c/0x3234de053c5010a lrc: 3/0,1 mode: PW/PW res: [0x2b47f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.449008:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9ee567c/0x3234de053c5010a lrc: 3/0,1 mode: PW/PW res: [0x2b47f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.449011:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9ee567c/0x3234de053c5010a lrc: 2/0,0 mode: PW/PW res: [0x2b47f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.449028:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+330:39030:x1731745946364352:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 867us (916us total) trans 12885078884 rc 0/0 00000100:00100000:0.0:1651529344.449031:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210831 00010000:00010000:0.0:1651529344.449038:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c50111 lrc: 2/0,0 mode: PW/PW res: [0x2b47e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449041:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000069f87339 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.449042:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c50111 lrc: 2/0,0 mode: PW/PW res: [0x2b47e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449045:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c50111 lrc: 3/0,0 mode: PW/PW res: [0x2b47e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449050:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c50111 lrc: 1/0,0 mode: --/PW res: [0x2b47e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449053:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c50111 lrc: 0/0,0 mode: --/PW res: [0x2b47e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.449054:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+330:39030:x1731745946364416:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 919us (982us total) trans 12885078885 rc 0/0 00000100:00100000:1.0:1651529344.449057:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210830 00010000:00010000:0.0:1651529344.449057:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9ee567c/0x3234de053c5010a lrc: 2/0,0 mode: PW/PW res: [0x2b47f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449059:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f9ee567c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.449060:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9ee567c/0x3234de053c5010a lrc: 2/0,0 mode: PW/PW res: [0x2b47f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449063:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9ee567c/0x3234de053c5010a lrc: 3/0,0 mode: PW/PW res: [0x2b47f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449066:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9ee567c/0x3234de053c5010a lrc: 1/0,0 mode: --/PW res: [0x2b47f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449069:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9ee567c/0x3234de053c5010a lrc: 0/0,0 mode: --/PW res: [0x2b47f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449085:0:156655:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7d5d09f/0x3234de053c4f270 lrc: 0/0,0 mode: --/PR res: [0x2b480:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ce9 expref: 1734 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.449088:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996960000:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.449092:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c50118 lrc: 3/0,1 mode: PW/PW res: [0x2b480:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449096:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c50118 lrc: 3/0,1 mode: PW/PW res: [0x2b480:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449098:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c50118 lrc: 3/0,1 mode: PW/PW res: [0x2b480:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.449099:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.449101:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c50118 lrc: 3/0,1 mode: PW/PW res: [0x2b480:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449109:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c50118 lrc: 2/0,0 mode: PW/PW res: [0x2b480:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.449145:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+330:39029:x1731745946364480:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 881us (950us total) trans 12885078886 rc 0/0 00000100:00100000:0.0:1651529344.449147:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210832 00010000:00010000:0.0:1651529344.449154:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c50118 lrc: 2/0,0 mode: PW/PW res: [0x2b480:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449157:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000011345842 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.449158:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c50118 lrc: 2/0,0 mode: PW/PW res: [0x2b480:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449161:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c50118 lrc: 3/0,0 mode: PW/PW res: [0x2b480:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449167:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c50118 lrc: 1/0,0 mode: --/PW res: [0x2b480:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449187:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011345842/0x3234de053c50118 lrc: 0/0,0 mode: --/PW res: [0x2b480:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.449208:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996960064:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.449213:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000089368d5b/0x3234de053c5011f lrc: 3/0,1 mode: --/PW res: [0x2b481:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.449220:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396245632 00010000:00010000:0.0:1651529344.449236:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a8e8757f/0x3234de053c4e02c lrc: 4/0,0 mode: PR/PR res: [0x2b481:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d31e1 expref: 1734 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.449246:0:80280:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000077c0819/0x3234de053c4c84d lrc: 0/0,0 mode: --/PR res: [0x2b47c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd35a expref: 1734 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.449252:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11615 00000100:00100000:0.0:1651529344.449254:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1734:41279:x1731746396245632:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.449256:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996959744:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.449257:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.449258:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a8e8757f/0x3234de053c4e02c lrc: 4/0,0 mode: PR/PR res: [0x2b481:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d31e1 expref: 1733 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.449260:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a9e60cf2/0x3234de053c500fc lrc: 3/0,1 mode: PW/PW res: [0x2b47c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449262:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a8e8757f/0x3234de053c4e02c lrc: 3/0,0 mode: PR/PR res: [0x2b481:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d31e1 expref: 1733 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.449264:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a9e60cf2/0x3234de053c500fc lrc: 3/0,1 mode: PW/PW res: [0x2b47c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.449266:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9e60cf2/0x3234de053c500fc lrc: 3/0,1 mode: PW/PW res: [0x2b47c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449267:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8e8757f/0x3234de053c4e02c lrc: 0/0,0 mode: --/PR res: [0x2b481:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d31e1 expref: 1733 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.449272:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9e60cf2/0x3234de053c500fc lrc: 3/0,1 mode: PW/PW res: [0x2b47c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449273:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.449274:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.449275:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9e60cf2/0x3234de053c500fc lrc: 2/0,0 mode: PW/PW res: [0x2b47c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449275:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000089368d5b/0x3234de053c5011f lrc: 3/0,1 mode: PW/PW res: [0x2b481:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449277:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089368d5b/0x3234de053c5011f lrc: 4/0,1 mode: PW/PW res: [0x2b481:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449288:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.449314:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1732:41279:x1731746396245632:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 59us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.449325:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11615 00000100:00100000:1.0:1651529344.449328:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+330:39030:x1731745946364032:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1418us (1478us total) trans 12885078887 rc 0/0 00000100:00100000:1.0:1651529344.449331:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210828 00010000:00010000:0.0:1651529344.449335:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9e60cf2/0x3234de053c500fc lrc: 2/0,0 mode: PW/PW res: [0x2b47c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449338:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a9e60cf2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.449339:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9e60cf2/0x3234de053c500fc lrc: 2/0,0 mode: PW/PW res: [0x2b47c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449342:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9e60cf2/0x3234de053c500fc lrc: 3/0,0 mode: PW/PW res: [0x2b47c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449346:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9e60cf2/0x3234de053c500fc lrc: 1/0,0 mode: --/PW res: [0x2b47c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449349:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9e60cf2/0x3234de053c500fc lrc: 0/0,0 mode: --/PW res: [0x2b47c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449372:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000089368d5b/0x3234de053c5011f lrc: 3/0,1 mode: PW/PW res: [0x2b481:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449383:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089368d5b/0x3234de053c5011f lrc: 3/0,1 mode: PW/PW res: [0x2b481:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449387:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089368d5b/0x3234de053c5011f lrc: 3/0,1 mode: PW/PW res: [0x2b481:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449389:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089368d5b/0x3234de053c5011f lrc: 2/0,0 mode: PW/PW res: [0x2b481:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.449407:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.449416:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.449426:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.449434:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+330:39029:x1731745946364544:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 839us (921us total) trans 12885078888 rc 0/0 00000100:00100000:1.0:1651529344.449436:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.449437:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210833 00000100:00100000:0.0:1651529344.449442:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946365056 00000100:00100000:0.0:1651529344.449451:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946365120 00000100:00100000:0.0:1651529344.449455:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946365184 00000100:00100000:0.0:1651529344.449460:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946365248 00000100:00100000:0.0:1651529344.449465:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210836 00000100:00100000:0.0:1651529344.449466:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+333:39030:x1731745946365056:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.449471:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177284 count 1 00000100:00100000:1.0:1651529344.449472:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006e3eb319 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996960192:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.449476:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c50134 lrc: 3/0,1 mode: --/PW res: [0x2b484:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.449477:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000007f5d689/0x3234de053c5012d lrc: 3/0,1 mode: --/PW res: [0x2b483:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449480:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000a2d126a/0x3234de053c4f6b4 lrc: 2/0,0 mode: PR/PR res: [0x2b484:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d90 expref: 1731 pid: 156655 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.449484:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210837 00000100:00100000:1.0:1651529344.449486:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+333:39029:x1731745946365120:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.449486:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.449486:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1651529344.449491:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177285 count 1 00010000:00010000:1.0:1651529344.449495:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000027a1488/0x3234de053c5013b lrc: 3/0,1 mode: --/PW res: [0x2b485:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.449500:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e92ebc3c/0x3234de053c4d41d lrc: 2/0,0 mode: PR/PR res: [0x2b485:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0246 expref: 1731 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.449501:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c50134 lrc: 4/0,1 mode: --/PW res: [0x2b484:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.449506:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.449506:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.449507:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000027a1488/0x3234de053c5013b lrc: 4/0,1 mode: --/PW res: [0x2b485:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449509:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000a2d126a/0x3234de053c4f6b4 lrc: 3/0,0 mode: PR/PR res: [0x2b484:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d90 expref: 1731 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.449513:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e92ebc3c/0x3234de053c4d41d lrc: 3/0,0 mode: PR/PR res: [0x2b485:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0246 expref: 1731 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.449513:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000a2d126a/0x3234de053c4f6b4 lrc: 4/0,0 mode: PR/PR res: [0x2b484:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d90 expref: 1731 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.449517:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e92ebc3c/0x3234de053c4d41d lrc: 4/0,0 mode: PR/PR res: [0x2b485:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0246 expref: 1731 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.449517:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996960256:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.449521:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000027e31dd1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996960320:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.449531:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e7e12492 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.449537:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aeda71fe going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.449537:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089368d5b/0x3234de053c5011f lrc: 2/0,0 mode: PW/PW res: [0x2b481:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449540:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000089368d5b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.449541:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089368d5b/0x3234de053c5011f lrc: 2/0,0 mode: PW/PW res: [0x2b481:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.449543:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210838 00010000:00010000:0.0:1651529344.449544:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089368d5b/0x3234de053c5011f lrc: 3/0,0 mode: PW/PW res: [0x2b481:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.449545:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+333:39030:x1731745946365184:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.449548:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089368d5b/0x3234de053c5011f lrc: 1/0,0 mode: --/PW res: [0x2b481:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.449549:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177286 count 1 00010000:00010000:1.0:1651529344.449553:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c50142 lrc: 3/0,1 mode: --/PW res: [0x2b486:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.449557:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4f32d lrc: 2/0,0 mode: PR/PR res: [0x2b486:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f27 expref: 1731 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.449560:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.449561:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.449562:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c50142 lrc: 4/0,1 mode: --/PW res: [0x2b486:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449567:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089368d5b/0x3234de053c5011f lrc: 0/0,0 mode: --/PW res: [0x2b481:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.449570:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4f32d lrc: 3/0,0 mode: PR/PR res: [0x2b486:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f27 expref: 1731 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.449573:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4f32d lrc: 4/0,0 mode: PR/PR res: [0x2b486:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f27 expref: 1731 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.449577:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004bb67ba4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996960384:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.449583:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 0000000053a0cffa going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.449586:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210839 00000100:00100000:0.0:1651529344.449588:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000950a0e43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+333:39030:x1731745946365248:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.449593:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dff6a73d pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996960128:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.449593:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177287 count 1 00010000:00010000:1.0:1651529344.449596:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000de1a14c6/0x3234de053c50126 lrc: 3/0,1 mode: --/PW res: [0x2b482:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449607:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c50149 lrc: 3/0,1 mode: --/PW res: [0x2b487:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.449610:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.449612:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c4cd63 lrc: 2/0,0 mode: PR/PR res: [0x2b487:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce796 expref: 1731 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.449615:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.449616:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.449616:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c50149 lrc: 4/0,1 mode: --/PW res: [0x2b487:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449623:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c4cd63 lrc: 3/0,0 mode: PR/PR res: [0x2b487:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce796 expref: 1731 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.449626:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c4cd63 lrc: 4/0,0 mode: PR/PR res: [0x2b487:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce796 expref: 1731 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.449631:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996960448:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.449639:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060852af0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.449645:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.449650:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946365504 00000100:00100000:1.0:1651529344.449657:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.449657:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210840 00000100:00100000:0.0:1651529344.449659:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+334:39029:x1731745946365504:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.449670:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177288 count 1 00000100:00100000:1.0:1651529344.449671:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.449674:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c151b720/0x3234de053c50150 lrc: 3/0,1 mode: --/PW res: [0x2b488:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449679:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a987057d/0x3234de053c4dfa0 lrc: 2/0,0 mode: PR/PR res: [0x2b488:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f79 expref: 1731 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.449682:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.449682:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.449683:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c151b720/0x3234de053c50150 lrc: 4/0,1 mode: --/PW res: [0x2b488:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449689:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a987057d/0x3234de053c4dfa0 lrc: 3/0,0 mode: PR/PR res: [0x2b488:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f79 expref: 1731 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.449692:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a987057d/0x3234de053c4dfa0 lrc: 4/0,0 mode: PR/PR res: [0x2b488:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f79 expref: 1731 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.449696:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996960512:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.449699:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396245760 00010000:00010000:1.0:1651529344.449705:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c4eecd lrc: 4/0,0 mode: PR/PR res: [0x2b483:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d30 expref: 1732 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.449710:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 000000000e7e66c4 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.449716:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946365568 00000100:00100000:1.0:1651529344.449718:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396245696 00010000:00010000:1.0:1651529344.449721:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e564c159/0x3234de053c4e493 lrc: 4/0,0 mode: PR/PR res: [0x2b482:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d437d expref: 1733 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.449725:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210841 00000100:00100000:0.0:1651529344.449726:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+335:39030:x1731745946365568:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.449730:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177289 count 1 00000100:00100000:1.0:1651529344.449742:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11616 00000100:00100000:1.0:1651529344.449744:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002017d1f9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1733:41279:x1731746396245760:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.449747:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.449749:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c4eecd lrc: 4/0,0 mode: PR/PR res: [0x2b483:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d30 expref: 1733 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.449753:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c4eecd lrc: 3/0,0 mode: PR/PR res: [0x2b483:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d30 expref: 1733 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.449758:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c4eecd lrc: 0/0,0 mode: --/PR res: [0x2b483:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d30 expref: 1733 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.449762:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.449762:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50157 lrc: 3/0,1 mode: --/PW res: [0x2b489:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.449763:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.449764:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000007f5d689/0x3234de053c5012d lrc: 3/0,1 mode: PW/PW res: [0x2b483:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.449767:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007f5d689/0x3234de053c5012d lrc: 4/0,1 mode: PW/PW res: [0x2b483:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449767:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000186984fa/0x3234de053c4ef91 lrc: 2/0,0 mode: PR/PR res: [0x2b489:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d70b0 expref: 1732 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.449771:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.449771:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.449772:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50157 lrc: 4/0,1 mode: --/PW res: [0x2b489:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.449773:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.449779:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000186984fa/0x3234de053c4ef91 lrc: 3/0,0 mode: PR/PR res: [0x2b489:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d70b0 expref: 1732 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.449780:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002017d1f9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1732:41279:x1731746396245760:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (170us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.449782:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000186984fa/0x3234de053c4ef91 lrc: 4/0,0 mode: PR/PR res: [0x2b489:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d70b0 expref: 1732 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.449783:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11616 00000100:00100000:0.0:1651529344.449786:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996960576:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.449791:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11617 00000100:00100000:1.0:1651529344.449793:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1731:41279:x1731746396245696:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.449795:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000abca413e going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.449796:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.449797:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e564c159/0x3234de053c4e493 lrc: 4/0,0 mode: PR/PR res: [0x2b482:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d437d expref: 1731 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.449801:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e564c159/0x3234de053c4e493 lrc: 3/0,0 mode: PR/PR res: [0x2b482:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d437d expref: 1731 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.449805:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e564c159/0x3234de053c4e493 lrc: 0/0,0 mode: --/PR res: [0x2b482:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d437d expref: 1731 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.449808:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.449809:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.449810:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000de1a14c6/0x3234de053c50126 lrc: 3/0,1 mode: PW/PW res: [0x2b482:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.449813:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de1a14c6/0x3234de053c50126 lrc: 4/0,1 mode: PW/PW res: [0x2b482:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.449818:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.449823:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1730:41279:x1731746396245696:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 29us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.449825:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11617 00010000:00010000:1.0:1651529344.449831:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000007f5d689/0x3234de053c5012d lrc: 3/0,1 mode: PW/PW res: [0x2b483:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.449834:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007f5d689/0x3234de053c5012d lrc: 3/0,1 mode: PW/PW res: [0x2b483:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.449838:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007f5d689/0x3234de053c5012d lrc: 3/0,1 mode: PW/PW res: [0x2b483:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.449843:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007f5d689/0x3234de053c5012d lrc: 2/0,0 mode: PW/PW res: [0x2b483:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449855:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007f5d689/0x3234de053c5012d lrc: 2/0,0 mode: PW/PW res: [0x2b483:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449858:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000007f5d689 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.449859:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007f5d689/0x3234de053c5012d lrc: 2/0,0 mode: PW/PW res: [0x2b483:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449863:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007f5d689/0x3234de053c5012d lrc: 3/0,0 mode: PW/PW res: [0x2b483:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449867:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007f5d689/0x3234de053c5012d lrc: 1/0,0 mode: --/PW res: [0x2b483:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449870:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007f5d689/0x3234de053c5012d lrc: 0/0,0 mode: --/PW res: [0x2b483:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.449885:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+336:39030:x1731745946364864:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 920us (1090us total) trans 12885078889 rc 0/0 00000100:00100000:1.0:1651529344.449888:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210835 00010000:00010000:1.0:1651529344.449895:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000de1a14c6/0x3234de053c50126 lrc: 3/0,1 mode: PW/PW res: [0x2b482:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.449898:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de1a14c6/0x3234de053c50126 lrc: 3/0,1 mode: PW/PW res: [0x2b482:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.449901:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de1a14c6/0x3234de053c50126 lrc: 3/0,1 mode: PW/PW res: [0x2b482:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.449904:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de1a14c6/0x3234de053c50126 lrc: 2/0,0 mode: PW/PW res: [0x2b482:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449914:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de1a14c6/0x3234de053c50126 lrc: 2/0,0 mode: PW/PW res: [0x2b482:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449917:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000de1a14c6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.449918:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de1a14c6/0x3234de053c50126 lrc: 2/0,0 mode: PW/PW res: [0x2b482:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449921:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de1a14c6/0x3234de053c50126 lrc: 3/0,0 mode: PW/PW res: [0x2b482:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449925:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de1a14c6/0x3234de053c50126 lrc: 1/0,0 mode: --/PW res: [0x2b482:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.449927:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de1a14c6/0x3234de053c50126 lrc: 0/0,0 mode: --/PW res: [0x2b482:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.449939:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+336:39030:x1731745946364800:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1022us (1182us total) trans 12885078890 rc 0/0 00000100:00100000:1.0:1651529344.449942:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210834 00000100:00100000:0.0:1651529344.449968:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996960256:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.449972:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c50134 lrc: 3/0,1 mode: --/PW res: [0x2b484:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.450091:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.450113:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000027e31dd1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996960320:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.450117:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000027a1488/0x3234de053c5013b lrc: 3/0,1 mode: --/PW res: [0x2b485:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.450124:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996960448:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.450132:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004bb67ba4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996960384:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.450135:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c50142 lrc: 3/0,1 mode: --/PW res: [0x2b486:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450141:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c50149 lrc: 3/0,1 mode: --/PW res: [0x2b487:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.450145:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396246208 00010000:00010000:1.0:1651529344.450150:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000a2d126a/0x3234de053c4f6b4 lrc: 4/0,0 mode: PR/PR res: [0x2b484:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d90 expref: 1730 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.450157:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11618 00000100:00100000:1.0:1651529344.450158:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1730:41278:x1731746396246208:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.450161:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.450162:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000a2d126a/0x3234de053c4f6b4 lrc: 4/0,0 mode: PR/PR res: [0x2b484:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d90 expref: 1730 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.450166:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000a2d126a/0x3234de053c4f6b4 lrc: 3/0,0 mode: PR/PR res: [0x2b484:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d90 expref: 1730 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.450171:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a2d126a/0x3234de053c4f6b4 lrc: 0/0,0 mode: --/PR res: [0x2b484:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d90 expref: 1730 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.450175:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.450176:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.450176:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c50134 lrc: 3/0,1 mode: PW/PW res: [0x2b484:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.450182:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c50134 lrc: 4/0,1 mode: PW/PW res: [0x2b484:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.450191:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.450194:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c50134 lrc: 3/0,1 mode: PW/PW res: [0x2b484:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450197:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c50134 lrc: 3/0,1 mode: PW/PW res: [0x2b484:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.450198:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1729:41278:x1731746396246208:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 39us (108us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.450200:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c50134 lrc: 3/0,1 mode: PW/PW res: [0x2b484:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.450201:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11618 00010000:00010000:0.0:1651529344.450203:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c50134 lrc: 2/0,0 mode: PW/PW res: [0x2b484:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.450245:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.450263:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+336:39030:x1731745946365056:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 796us (856us total) trans 12885078891 rc 0/0 00000100:00100000:0.0:1651529344.450266:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210836 00010000:00010000:0.0:1651529344.450274:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c50134 lrc: 2/0,0 mode: PW/PW res: [0x2b484:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450277:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000009c5cbe9 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.450278:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.450278:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c50134 lrc: 2/0,0 mode: PW/PW res: [0x2b484:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450281:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c50134 lrc: 3/0,0 mode: PW/PW res: [0x2b484:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450298:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c50134 lrc: 1/0,0 mode: --/PW res: [0x2b484:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450301:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c50134 lrc: 0/0,0 mode: --/PW res: [0x2b484:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.450308:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.450308:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946365632 00000100:00100000:0.0:1651529344.450319:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210842 00000100:00100000:0.0:1651529344.450320:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+336:39029:x1731745946365632:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.450322:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.450325:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177290 count 1 00000100:00100000:1.0:1651529344.450328:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.450329:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003722c3ae/0x3234de053c5015e lrc: 3/0,1 mode: --/PW res: [0x2b48a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.450343:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946365696 00000100:00100000:1.0:1651529344.450350:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210843 00000100:00100000:1.0:1651529344.450352:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+337:39030:x1731745946365696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.450361:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000aaa296ad/0x3234de053c4db86 lrc: 2/0,0 mode: PR/PR res: [0x2b48a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e23 expref: 1728 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.450363:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177291 count 1 00010000:00010000:0.0:1651529344.450364:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.450365:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.450366:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003722c3ae/0x3234de053c5015e lrc: 4/0,1 mode: --/PW res: [0x2b48a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.450367:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bff28571/0x3234de053c50165 lrc: 3/0,1 mode: --/PW res: [0x2b48b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.450372:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d60102b6/0x3234de053c4d750 lrc: 2/0,0 mode: PR/PR res: [0x2b48b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0eef expref: 1728 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.450373:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000aaa296ad/0x3234de053c4db86 lrc: 3/0,0 mode: PR/PR res: [0x2b48a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e23 expref: 1728 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.450376:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.450376:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.450377:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bff28571/0x3234de053c50165 lrc: 4/0,1 mode: --/PW res: [0x2b48b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450377:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000aaa296ad/0x3234de053c4db86 lrc: 4/0,0 mode: PR/PR res: [0x2b48a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e23 expref: 1728 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.450381:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996960640:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.450386:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d60102b6/0x3234de053c4d750 lrc: 3/0,0 mode: PR/PR res: [0x2b48b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0eef expref: 1728 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.450390:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d60102b6/0x3234de053c4d750 lrc: 4/0,0 mode: PR/PR res: [0x2b48b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0eef expref: 1728 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.450390:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060852af0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.450394:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bddc5ca7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996960704:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.450398:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996960512:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.450402:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c151b720/0x3234de053c50150 lrc: 3/0,1 mode: --/PW res: [0x2b488:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.450403:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aeda71fe going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.450408:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396246272 00000100:00100000:1.0:1651529344.450409:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396246400 00010000:00010000:0.0:1651529344.450412:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e92ebc3c/0x3234de053c4d41d lrc: 4/0,0 mode: PR/PR res: [0x2b485:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0246 expref: 1730 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.450414:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4f32d lrc: 4/0,0 mode: PR/PR res: [0x2b486:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f27 expref: 1730 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.450419:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396246528 00000100:00100000:1.0:1651529344.450420:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11619 00000100:00100000:1.0:1651529344.450421:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1731:41279:x1731746396246272:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.450422:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c4cd63 lrc: 4/0,0 mode: PR/PR res: [0x2b487:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce796 expref: 1731 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.450424:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.450425:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e92ebc3c/0x3234de053c4d41d lrc: 4/0,0 mode: PR/PR res: [0x2b485:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0246 expref: 1731 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.450427:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11620 00010000:00010000:1.0:1651529344.450429:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e92ebc3c/0x3234de053c4d41d lrc: 3/0,0 mode: PR/PR res: [0x2b485:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0246 expref: 1731 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.450429:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1731:41279:x1731746396246400:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.450431:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.450433:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4f32d lrc: 4/0,0 mode: PR/PR res: [0x2b486:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f27 expref: 1731 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.450435:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e92ebc3c/0x3234de053c4d41d lrc: 0/0,0 mode: --/PR res: [0x2b485:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0246 expref: 1731 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.450437:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4f32d lrc: 3/0,0 mode: PR/PR res: [0x2b486:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f27 expref: 1731 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.450438:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.450439:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.450440:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000027a1488/0x3234de053c5013b lrc: 3/0,1 mode: PW/PW res: [0x2b485:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450442:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c4f32d lrc: 0/0,0 mode: --/PR res: [0x2b486:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f27 expref: 1730 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.450443:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000027a1488/0x3234de053c5013b lrc: 4/0,1 mode: PW/PW res: [0x2b485:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450445:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.450446:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.450447:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c50142 lrc: 3/0,1 mode: PW/PW res: [0x2b486:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.450449:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.450450:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c50142 lrc: 4/0,1 mode: PW/PW res: [0x2b486:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.450455:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1729:41279:x1731746396246272:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 32us (232us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.450459:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.450464:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11619 00000100:00100000:0.0:1651529344.450466:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1729:41279:x1731746396246400:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.450469:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11620 00000100:00100000:1.0:1651529344.450470:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11621 00000100:00100000:1.0:1651529344.450472:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1727:41279:x1731746396246528:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.450475:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.450476:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c4cd63 lrc: 4/0,0 mode: PR/PR res: [0x2b487:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce796 expref: 1727 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.450480:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c4cd63 lrc: 3/0,0 mode: PR/PR res: [0x2b487:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce796 expref: 1727 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.450485:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c4cd63 lrc: 0/0,0 mode: --/PR res: [0x2b487:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce796 expref: 1727 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.450488:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.450489:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.450490:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c50149 lrc: 3/0,1 mode: PW/PW res: [0x2b487:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.450495:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c50149 lrc: 4/0,1 mode: PW/PW res: [0x2b487:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.450504:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.450510:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1726:41279:x1731746396246528:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 37us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.450513:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11621 00010000:00010000:0.0:1651529344.450513:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c50149 lrc: 3/0,1 mode: PW/PW res: [0x2b487:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450517:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c50149 lrc: 3/0,1 mode: PW/PW res: [0x2b487:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.450519:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c50142 lrc: 3/0,1 mode: PW/PW res: [0x2b486:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450520:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c50149 lrc: 3/0,1 mode: PW/PW res: [0x2b487:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.450522:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c50142 lrc: 3/0,1 mode: PW/PW res: [0x2b486:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450523:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c50149 lrc: 2/0,0 mode: PW/PW res: [0x2b487:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.450525:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c50142 lrc: 3/0,1 mode: PW/PW res: [0x2b486:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.450528:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c50142 lrc: 2/0,0 mode: PW/PW res: [0x2b486:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.450568:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+339:39030:x1731745946365184:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1022us (1142us total) trans 12885078893 rc 0/0 00000100:00100000:1.0:1651529344.450571:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210838 00000100:00100000:0.0:1651529344.450571:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000950a0e43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+339:39030:x1731745946365248:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 982us (1134us total) trans 12885078892 rc 0/0 00000100:00100000:0.0:1651529344.450574:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210839 00010000:00010000:1.0:1651529344.450578:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000027a1488/0x3234de053c5013b lrc: 3/0,1 mode: PW/PW res: [0x2b485:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.450581:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000027a1488/0x3234de053c5013b lrc: 3/0,1 mode: PW/PW res: [0x2b485:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450582:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c50149 lrc: 2/0,0 mode: PW/PW res: [0x2b487:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.450585:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000027a1488/0x3234de053c5013b lrc: 3/0,1 mode: PW/PW res: [0x2b485:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450585:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000594a1223 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.450586:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c50149 lrc: 2/0,0 mode: PW/PW res: [0x2b487:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.450587:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000027a1488/0x3234de053c5013b lrc: 2/0,0 mode: PW/PW res: [0x2b485:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450589:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c50149 lrc: 3/0,0 mode: PW/PW res: [0x2b487:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450600:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c50149 lrc: 1/0,0 mode: --/PW res: [0x2b487:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450603:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c50149 lrc: 0/0,0 mode: --/PW res: [0x2b487:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450608:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c50142 lrc: 2/0,0 mode: PW/PW res: [0x2b486:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450611:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002dcd6c4b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.450611:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c50142 lrc: 2/0,0 mode: PW/PW res: [0x2b486:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450614:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c50142 lrc: 3/0,0 mode: PW/PW res: [0x2b486:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450617:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c50142 lrc: 1/0,0 mode: --/PW res: [0x2b486:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450620:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c50142 lrc: 0/0,0 mode: --/PW res: [0x2b486:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450623:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000027a1488/0x3234de053c5013b lrc: 2/0,0 mode: PW/PW res: [0x2b485:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.450625:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+338:39029:x1731745946365120:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1138us (1209us total) trans 12885078894 rc 0/0 00010000:00010000:0.0:1651529344.450626:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000027a1488 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.450627:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000027a1488/0x3234de053c5013b lrc: 2/0,0 mode: PW/PW res: [0x2b485:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.450628:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210837 00010000:00010000:0.0:1651529344.450630:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000027a1488/0x3234de053c5013b lrc: 3/0,0 mode: PW/PW res: [0x2b485:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450633:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000027a1488/0x3234de053c5013b lrc: 1/0,0 mode: --/PW res: [0x2b485:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450635:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000027a1488/0x3234de053c5013b lrc: 0/0,0 mode: --/PW res: [0x2b485:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.450655:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.450669:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.450690:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996960576:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.450694:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.450694:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50157 lrc: 3/0,1 mode: --/PW res: [0x2b489:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.450763:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396246592 00010000:00010000:1.0:1651529344.450769:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a987057d/0x3234de053c4dfa0 lrc: 4/0,0 mode: PR/PR res: [0x2b488:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f79 expref: 1726 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.450779:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396246656 00010000:00010000:1.0:1651529344.450782:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000186984fa/0x3234de053c4ef91 lrc: 4/0,0 mode: PR/PR res: [0x2b489:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d70b0 expref: 1727 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.450790:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11622 00000100:00100000:1.0:1651529344.450792:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1727:41278:x1731746396246592:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.450795:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.450796:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a987057d/0x3234de053c4dfa0 lrc: 4/0,0 mode: PR/PR res: [0x2b488:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f79 expref: 1727 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.450799:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11623 00000100:00100000:0.0:1651529344.450801:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cd81e40c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1727:41279:x1731746396246656:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.450802:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a987057d/0x3234de053c4dfa0 lrc: 3/0,0 mode: PR/PR res: [0x2b488:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f79 expref: 1727 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.450804:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.450806:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000186984fa/0x3234de053c4ef91 lrc: 4/0,0 mode: PR/PR res: [0x2b489:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d70b0 expref: 1727 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.450808:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a987057d/0x3234de053c4dfa0 lrc: 0/0,0 mode: --/PR res: [0x2b488:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f79 expref: 1727 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.450812:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.450812:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.450813:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c151b720/0x3234de053c50150 lrc: 3/0,1 mode: PW/PW res: [0x2b488:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.450816:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c151b720/0x3234de053c50150 lrc: 4/0,1 mode: PW/PW res: [0x2b488:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450821:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000186984fa/0x3234de053c4ef91 lrc: 3/0,0 mode: PR/PR res: [0x2b489:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d70b0 expref: 1726 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.450824:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.450833:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1726:41278:x1731746396246592:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 41us (178us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.450835:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000186984fa/0x3234de053c4ef91 lrc: 0/0,0 mode: --/PR res: [0x2b489:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d70b0 expref: 1726 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.450836:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11622 00010000:00010000:0.0:1651529344.450839:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.450839:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.450840:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50157 lrc: 3/0,1 mode: PW/PW res: [0x2b489:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450843:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50157 lrc: 4/0,1 mode: PW/PW res: [0x2b489:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.450844:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946365760 00000100:00100000:1.0:1651529344.450849:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210844 00010000:00010000:0.0:1651529344.450849:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.450850:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+338:39029:x1731745946365760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.450855:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177292 count 1 00000100:00100000:0.0:1651529344.450857:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cd81e40c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1724:41279:x1731746396246656:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 56us (163us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.450859:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029a4761a/0x3234de053c5016c lrc: 3/0,1 mode: --/PW res: [0x2b48c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.450860:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11623 00010000:00010000:1.0:1651529344.450863:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dbc34506/0x3234de053c4d9e9 lrc: 2/0,0 mode: PR/PR res: [0x2b48c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1818 expref: 1723 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.450867:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.450867:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.450868:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029a4761a/0x3234de053c5016c lrc: 4/0,1 mode: --/PW res: [0x2b48c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450871:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50157 lrc: 3/0,1 mode: PW/PW res: [0x2b489:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.450874:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dbc34506/0x3234de053c4d9e9 lrc: 3/0,0 mode: PR/PR res: [0x2b48c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1818 expref: 1723 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.450874:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50157 lrc: 3/0,1 mode: PW/PW res: [0x2b489:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450877:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50157 lrc: 3/0,1 mode: PW/PW res: [0x2b489:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.450878:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dbc34506/0x3234de053c4d9e9 lrc: 4/0,0 mode: PR/PR res: [0x2b48c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1818 expref: 1723 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.450880:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50157 lrc: 2/0,0 mode: PW/PW res: [0x2b489:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.450882:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005d2b5bb3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996960768:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.450889:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a6b79b05 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.450957:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+339:39030:x1731745946365568:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1230us (1285us total) trans 12885078895 rc 0/0 00000100:00100000:0.0:1651529344.450960:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210841 00010000:00010000:0.0:1651529344.450967:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50157 lrc: 2/0,0 mode: PW/PW res: [0x2b489:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450970:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dcd3e2d1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.450971:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50157 lrc: 2/0,0 mode: PW/PW res: [0x2b489:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450974:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50157 lrc: 3/0,0 mode: PW/PW res: [0x2b489:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450979:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50157 lrc: 1/0,0 mode: --/PW res: [0x2b489:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.450982:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.450982:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50157 lrc: 0/0,0 mode: --/PW res: [0x2b489:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450994:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c151b720/0x3234de053c50150 lrc: 3/0,1 mode: PW/PW res: [0x2b488:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.450997:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c151b720/0x3234de053c50150 lrc: 3/0,1 mode: PW/PW res: [0x2b488:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.450999:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.451000:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c151b720/0x3234de053c50150 lrc: 3/0,1 mode: PW/PW res: [0x2b488:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.451003:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c151b720/0x3234de053c50150 lrc: 2/0,0 mode: PW/PW res: [0x2b488:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.451005:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.451016:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bddc5ca7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996960704:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.451020:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bff28571/0x3234de053c50165 lrc: 3/0,1 mode: --/PW res: [0x2b48b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.451027:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946366208 00000100:00100000:1.0:1651529344.451033:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946366272 00000100:00100000:1.0:1651529344.451036:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946366400 00000100:00100000:1.0:1651529344.451040:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210845 00000100:00100000:1.0:1651529344.451042:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+342:39030:x1731745946366208:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.451048:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177293 count 1 00010000:00010000:1.0:1651529344.451051:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef2c2c65/0x3234de053c50173 lrc: 3/0,1 mode: --/PW res: [0x2b48d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.451056:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e0dd8497/0x3234de053c4d4d3 lrc: 2/0,0 mode: PR/PR res: [0x2b48d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0564 expref: 1723 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.451059:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.451059:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.451060:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef2c2c65/0x3234de053c50173 lrc: 4/0,1 mode: --/PW res: [0x2b48d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.451073:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+342:39029:x1731745946365504:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1413us (1428us total) trans 12885078896 rc 0/0 00000100:00100000:0.0:1651529344.451076:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210840 00010000:00010000:1.0:1651529344.451081:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e0dd8497/0x3234de053c4d4d3 lrc: 3/0,0 mode: PR/PR res: [0x2b48d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0564 expref: 1723 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.451085:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e0dd8497/0x3234de053c4d4d3 lrc: 4/0,0 mode: PR/PR res: [0x2b48d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0564 expref: 1723 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.451089:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bddc5ca7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996960832:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.451093:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210846 00000100:00100000:0.0:1651529344.451095:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+341:39029:x1731745946366272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.451098:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a5495eb going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.451100:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177294 count 1 00000100:00100000:1.0:1651529344.451104:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210847 00010000:00010000:0.0:1651529344.451105:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1e9e4c0/0x3234de053c5017a lrc: 3/0,1 mode: --/PW res: [0x2b48e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.451106:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+341:39029:x1731745946366400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.451109:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001865dc5a/0x3234de053c4ee48 lrc: 2/0,0 mode: PR/PR res: [0x2b48e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b3f expref: 1723 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.451111:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177295 count 1 00010000:00010000:0.0:1651529344.451113:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.451113:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.451114:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a42426c/0x3234de053c50181 lrc: 3/0,1 mode: --/PW res: [0x2b48f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.451114:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1e9e4c0/0x3234de053c5017a lrc: 4/0,1 mode: --/PW res: [0x2b48e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.451119:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e7c4a632/0x3234de053c4dad0 lrc: 2/0,0 mode: PR/PR res: [0x2b48f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b8a expref: 1723 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.451121:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001865dc5a/0x3234de053c4ee48 lrc: 3/0,0 mode: PR/PR res: [0x2b48e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b3f expref: 1723 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.451122:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.451123:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.451123:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a42426c/0x3234de053c50181 lrc: 4/0,1 mode: --/PW res: [0x2b48f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.451124:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001865dc5a/0x3234de053c4ee48 lrc: 4/0,0 mode: PR/PR res: [0x2b48e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b3f expref: 1723 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.451129:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e7c4a632/0x3234de053c4dad0 lrc: 3/0,0 mode: PR/PR res: [0x2b48f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b8a expref: 1723 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.451131:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996960896:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.451132:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e7c4a632/0x3234de053c4dad0 lrc: 4/0,0 mode: PR/PR res: [0x2b48f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b8a expref: 1723 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.451136:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000075e1000f pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996960960:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.451140:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 000000003678d25f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.451143:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8a0b704 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.451145:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c151b720/0x3234de053c50150 lrc: 2/0,0 mode: PW/PW res: [0x2b488:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.451148:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c151b720 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.451149:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c151b720/0x3234de053c50150 lrc: 2/0,0 mode: PW/PW res: [0x2b488:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.451152:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c151b720/0x3234de053c50150 lrc: 3/0,0 mode: PW/PW res: [0x2b488:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.451156:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.451157:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c151b720/0x3234de053c50150 lrc: 1/0,0 mode: --/PW res: [0x2b488:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.451159:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c151b720/0x3234de053c50150 lrc: 0/0,0 mode: --/PW res: [0x2b488:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.451176:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396246720 00010000:00010000:0.0:1651529344.451181:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000aaa296ad/0x3234de053c4db86 lrc: 5/0,0 mode: PR/PR res: [0x2b48a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e23 expref: 1724 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.451192:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11624 00000100:00100000:0.0:1651529344.451194:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1724:41279:x1731746396246720:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.451197:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.451198:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000aaa296ad/0x3234de053c4db86 lrc: 5/0,0 mode: PR/PR res: [0x2b48a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e23 expref: 1724 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.451199:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.451202:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000aaa296ad/0x3234de053c4db86 lrc: 4/0,0 mode: PR/PR res: [0x2b48a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e23 expref: 1724 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.451212:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.451213:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.451214:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003722c3ae/0x3234de053c5015e lrc: 3/0,1 mode: PW/PW res: [0x2b48a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.451215:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.451217:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003722c3ae/0x3234de053c5015e lrc: 4/0,1 mode: PW/PW res: [0x2b48a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.451221:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.451244:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1724:41279:x1731746396246720:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 49us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.451246:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11624 00000100:00100000:0.0:1651529344.451251:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396246784 00010000:00010000:0.0:1651529344.451255:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d60102b6/0x3234de053c4d750 lrc: 4/0,0 mode: PR/PR res: [0x2b48b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0eef expref: 1724 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.451260:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11625 00000100:00100000:0.0:1651529344.451262:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1724:41279:x1731746396246784:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.451264:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.451265:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d60102b6/0x3234de053c4d750 lrc: 4/0,0 mode: PR/PR res: [0x2b48b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0eef expref: 1724 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.451272:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d60102b6/0x3234de053c4d750 lrc: 3/0,0 mode: PR/PR res: [0x2b48b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0eef expref: 1724 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.451276:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d60102b6/0x3234de053c4d750 lrc: 0/0,0 mode: --/PR res: [0x2b48b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0eef expref: 1724 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.451280:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.451280:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.451281:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bff28571/0x3234de053c50165 lrc: 3/0,1 mode: PW/PW res: [0x2b48b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.451284:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bff28571/0x3234de053c50165 lrc: 4/0,1 mode: PW/PW res: [0x2b48b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.451317:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.451324:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.451336:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1723:41279:x1731746396246784:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 74us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.451339:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11625 00000100:00100000:0.0:1651529344.451349:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946366528 00000100:00100000:0.0:1651529344.451357:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946366592 00010000:00010000:1.0:1651529344.451367:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bff28571/0x3234de053c50165 lrc: 3/0,1 mode: PW/PW res: [0x2b48b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.451371:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bff28571/0x3234de053c50165 lrc: 3/0,1 mode: PW/PW res: [0x2b48b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.451378:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210848 00010000:00010000:1.0:1651529344.451379:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bff28571/0x3234de053c50165 lrc: 3/0,1 mode: PW/PW res: [0x2b48b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.451380:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+343:39029:x1731745946366528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.451385:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bff28571/0x3234de053c50165 lrc: 2/0,0 mode: PW/PW res: [0x2b48b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.451385:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177296 count 1 00010000:00010000:0.0:1651529344.451389:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e4ec3ee/0x3234de053c50188 lrc: 3/0,1 mode: --/PW res: [0x2b490:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.451400:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000748ad336/0x3234de053c4e986 lrc: 2/0,0 mode: PR/PR res: [0x2b490:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d57b9 expref: 1722 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.451403:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.451404:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.451404:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e4ec3ee/0x3234de053c50188 lrc: 4/0,1 mode: --/PW res: [0x2b490:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.451411:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000748ad336/0x3234de053c4e986 lrc: 3/0,0 mode: PR/PR res: [0x2b490:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d57b9 expref: 1722 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.451414:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000748ad336/0x3234de053c4e986 lrc: 4/0,0 mode: PR/PR res: [0x2b490:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d57b9 expref: 1722 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.451418:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996961024:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.451427:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000070e666f7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.451430:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+344:39030:x1731745946365696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1077us (1107us total) trans 12885078897 rc 0/0 00010000:00010000:0.0:1651529344.451432:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bff28571/0x3234de053c50165 lrc: 2/0,0 mode: PW/PW res: [0x2b48b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.451433:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210843 00010000:00010000:0.0:1651529344.451435:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bff28571 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.451436:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bff28571/0x3234de053c50165 lrc: 2/0,0 mode: PW/PW res: [0x2b48b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.451438:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210849 00000100:00100000:1.0:1651529344.451439:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+343:39029:x1731745946366592:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.451439:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bff28571/0x3234de053c50165 lrc: 3/0,0 mode: PW/PW res: [0x2b48b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.451443:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bff28571/0x3234de053c50165 lrc: 1/0,0 mode: --/PW res: [0x2b48b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.451444:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177297 count 1 00010000:00010000:1.0:1651529344.451448:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fccb00ae/0x3234de053c5018f lrc: 3/0,1 mode: --/PW res: [0x2b491:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.451448:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bff28571/0x3234de053c50165 lrc: 0/0,0 mode: --/PW res: [0x2b48b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.451452:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002a7b079b/0x3234de053c4f430 lrc: 2/0,0 mode: PR/PR res: [0x2b491:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d838e expref: 1722 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.451455:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.451456:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.451457:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fccb00ae/0x3234de053c5018f lrc: 4/0,1 mode: --/PW res: [0x2b491:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.451458:0:72395:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aaa296ad/0x3234de053c4db86 lrc: 0/0,0 mode: --/PR res: [0x2b48a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e23 expref: 1722 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.451462:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996960640:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.451463:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002a7b079b/0x3234de053c4f430 lrc: 3/0,0 mode: PR/PR res: [0x2b491:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d838e expref: 1721 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.451465:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003722c3ae/0x3234de053c5015e lrc: 3/0,1 mode: PW/PW res: [0x2b48a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.451467:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002a7b079b/0x3234de053c4f430 lrc: 4/0,0 mode: PR/PR res: [0x2b491:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d838e expref: 1721 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.451468:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003722c3ae/0x3234de053c5015e lrc: 3/0,1 mode: PW/PW res: [0x2b48a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.451471:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003722c3ae/0x3234de053c5015e lrc: 3/0,1 mode: PW/PW res: [0x2b48a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.451474:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ba0b61e6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996961088:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.451474:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003722c3ae/0x3234de053c5015e lrc: 3/0,1 mode: PW/PW res: [0x2b48a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.451476:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003722c3ae/0x3234de053c5015e lrc: 2/0,0 mode: PW/PW res: [0x2b48a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.451481:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 0000000053a0cffa going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.451491:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005d2b5bb3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996960768:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.451494:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000029a4761a/0x3234de053c5016c lrc: 3/0,1 mode: --/PW res: [0x2b48c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.451514:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+344:39029:x1731745946365632:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1192us (1236us total) trans 12885078898 rc 0/0 00000100:00100000:0.0:1651529344.451517:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210842 00010000:00010000:0.0:1651529344.451524:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003722c3ae/0x3234de053c5015e lrc: 2/0,0 mode: PW/PW res: [0x2b48a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.451527:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003722c3ae already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.451528:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003722c3ae/0x3234de053c5015e lrc: 2/0,0 mode: PW/PW res: [0x2b48a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.451531:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003722c3ae/0x3234de053c5015e lrc: 3/0,0 mode: PW/PW res: [0x2b48a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.451535:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003722c3ae/0x3234de053c5015e lrc: 1/0,0 mode: --/PW res: [0x2b48a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.451538:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003722c3ae/0x3234de053c5015e lrc: 0/0,0 mode: --/PW res: [0x2b48a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.451561:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bddc5ca7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996960832:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.451565:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ef2c2c65/0x3234de053c50173 lrc: 3/0,1 mode: --/PW res: [0x2b48d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.451659:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996960896:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.451669:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.451682:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d1e9e4c0/0x3234de053c5017a lrc: 3/0,1 mode: --/PW res: [0x2b48e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.451684:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.451693:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.451702:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.451702:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396247104 00000100:00100000:1.0:1651529344.451708:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.451708:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dbc34506/0x3234de053c4d9e9 lrc: 4/0,0 mode: PR/PR res: [0x2b48c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1818 expref: 1722 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.451720:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.451727:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396247488 00000100:00100000:1.0:1651529344.451748:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.451751:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001865dc5a/0x3234de053c4ee48 lrc: 4/0,0 mode: PR/PR res: [0x2b48e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b3f expref: 1723 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.451760:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396247296 00000100:00100000:1.0:1651529344.451762:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.451762:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e0dd8497/0x3234de053c4d4d3 lrc: 4/0,0 mode: PR/PR res: [0x2b48d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0564 expref: 1724 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.451767:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396247552 00010000:00010000:0.0:1651529344.451769:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e7c4a632/0x3234de053c4dad0 lrc: 5/0,0 mode: PR/PR res: [0x2b48f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b8a expref: 1725 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.451773:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396247616 00010000:00010000:0.0:1651529344.451774:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000748ad336/0x3234de053c4e986 lrc: 5/0,0 mode: PR/PR res: [0x2b490:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d57b9 expref: 1726 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.451778:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396247680 00000100:00100000:1.0:1651529344.451779:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000075e1000f pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996960960:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.451780:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002a7b079b/0x3234de053c4f430 lrc: 5/0,0 mode: PR/PR res: [0x2b491:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d838e expref: 1727 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.451783:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009a42426c/0x3234de053c50181 lrc: 3/0,1 mode: --/PW res: [0x2b48f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.451785:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11626 00000100:00100000:0.0:1651529344.451786:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1727:41279:x1731746396247104:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.451789:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.451790:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946366656 00010000:00010000:0.0:1651529344.451791:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dbc34506/0x3234de053c4d9e9 lrc: 4/0,0 mode: PR/PR res: [0x2b48c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1818 expref: 1727 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.451794:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dbc34506/0x3234de053c4d9e9 lrc: 3/0,0 mode: PR/PR res: [0x2b48c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1818 expref: 1727 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.451797:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946366720 00010000:00010000:0.0:1651529344.451800:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dbc34506/0x3234de053c4d9e9 lrc: 0/0,0 mode: --/PR res: [0x2b48c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1818 expref: 1727 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.451806:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210850 00000100:00100000:1.0:1651529344.451807:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+345:39029:x1731745946366656:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.451810:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.451811:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1651529344.451812:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177298 count 1 00010000:00010000:0.0:1651529344.451812:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000029a4761a/0x3234de053c5016c lrc: 3/0,1 mode: PW/PW res: [0x2b48c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.451815:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029a4761a/0x3234de053c5016c lrc: 4/0,1 mode: PW/PW res: [0x2b48c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.451816:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e049160/0x3234de053c50196 lrc: 3/0,1 mode: --/PW res: [0x2b492:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.451821:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006b4eadd7/0x3234de053c4d53c lrc: 2/0,0 mode: PR/PR res: [0x2b492:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d06d7 expref: 1726 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.451824:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.451830:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.451830:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.451831:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e049160/0x3234de053c50196 lrc: 4/0,1 mode: --/PW res: [0x2b492:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.451835:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1726:41279:x1731746396247104:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 47us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.451837:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11626 00000100:00100000:0.0:1651529344.451842:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11627 00010000:00010000:1.0:1651529344.451843:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006b4eadd7/0x3234de053c4d53c lrc: 3/0,0 mode: PR/PR res: [0x2b492:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d06d7 expref: 1725 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.451844:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1725:41278:x1731746396247488:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.451846:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006b4eadd7/0x3234de053c4d53c lrc: 4/0,0 mode: PR/PR res: [0x2b492:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d06d7 expref: 1725 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.451846:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.451848:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001865dc5a/0x3234de053c4ee48 lrc: 4/0,0 mode: PR/PR res: [0x2b48e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b3f expref: 1725 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.451850:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000034e35367 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996961152:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.451852:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001865dc5a/0x3234de053c4ee48 lrc: 3/0,0 mode: PR/PR res: [0x2b48e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b3f expref: 1725 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.451856:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001865dc5a/0x3234de053c4ee48 lrc: 0/0,0 mode: --/PR res: [0x2b48e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b3f expref: 1725 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.451859:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a6b79b05 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.451860:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.451860:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.451861:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d1e9e4c0/0x3234de053c5017a lrc: 3/0,1 mode: PW/PW res: [0x2b48e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.451864:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1e9e4c0/0x3234de053c5017a lrc: 4/0,1 mode: PW/PW res: [0x2b48e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.451865:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210851 00000100:00100000:1.0:1651529344.451867:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+345:39030:x1731745946366720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.451870:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00080000:1.0:1651529344.451871:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177299 count 1 00010000:00010000:1.0:1651529344.451875:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088993906/0x3234de053c5019d lrc: 3/0,1 mode: --/PW res: [0x2b493:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.451875:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1724:41278:x1731746396247488:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 31us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.451878:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11627 00000100:00100000:0.0:1651529344.451881:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11628 00010000:00010000:1.0:1651529344.451882:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007249d40d/0x3234de053c4a833 lrc: 2/0,0 mode: PR/PR res: [0x2b493:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc85 expref: 1723 pid: 151609 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.451883:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1723:41279:x1731746396247296:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.451885:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.451885:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.451886:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.451886:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088993906/0x3234de053c5019d lrc: 4/0,1 mode: --/PW res: [0x2b493:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.451886:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e0dd8497/0x3234de053c4d4d3 lrc: 4/0,0 mode: PR/PR res: [0x2b48d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0564 expref: 1723 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.451890:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e0dd8497/0x3234de053c4d4d3 lrc: 3/0,0 mode: PR/PR res: [0x2b48d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0564 expref: 1723 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.451892:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007249d40d/0x3234de053c4a833 lrc: 3/0,0 mode: PR/PR res: [0x2b493:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc85 expref: 1723 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.451894:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0dd8497/0x3234de053c4d4d3 lrc: 0/0,0 mode: --/PR res: [0x2b48d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0564 expref: 1723 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.451895:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007249d40d/0x3234de053c4a833 lrc: 4/0,0 mode: PR/PR res: [0x2b493:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc85 expref: 1723 pid: 151609 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.451898:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.451898:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.451899:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd68fdd5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996961216:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.451899:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef2c2c65/0x3234de053c50173 lrc: 3/0,1 mode: PW/PW res: [0x2b48d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.451904:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef2c2c65/0x3234de053c50173 lrc: 4/0,1 mode: PW/PW res: [0x2b48d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.451905:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000567ee0ef going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.451912:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.451917:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1722:41279:x1731746396247296:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.451918:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ba0b61e6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996961088:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.451920:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11628 00010000:00010000:1.0:1651529344.451921:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fccb00ae/0x3234de053c5018f lrc: 3/0,1 mode: --/PW res: [0x2b491:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.451924:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11629 00000100:00100000:0.0:1651529344.451926:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1721:41279:x1731746396247552:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.451927:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ef2c2c65/0x3234de053c50173 lrc: 3/0,1 mode: PW/PW res: [0x2b48d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.451928:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.451929:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e7c4a632/0x3234de053c4dad0 lrc: 4/0,0 mode: PR/PR res: [0x2b48f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b8a expref: 1721 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.451930:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef2c2c65/0x3234de053c50173 lrc: 3/0,1 mode: PW/PW res: [0x2b48d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.451933:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e7c4a632/0x3234de053c4dad0 lrc: 3/0,0 mode: PR/PR res: [0x2b48f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b8a expref: 1721 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.451935:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef2c2c65/0x3234de053c50173 lrc: 3/0,1 mode: PW/PW res: [0x2b48d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.451937:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7c4a632/0x3234de053c4dad0 lrc: 0/0,0 mode: --/PR res: [0x2b48f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b8a expref: 1721 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.451938:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef2c2c65/0x3234de053c50173 lrc: 2/0,0 mode: PW/PW res: [0x2b48d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.451940:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.451941:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.451942:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009a42426c/0x3234de053c50181 lrc: 3/0,1 mode: PW/PW res: [0x2b48f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.451951:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a42426c/0x3234de053c50181 lrc: 4/0,1 mode: PW/PW res: [0x2b48f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.451962:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.451967:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1720:41279:x1731746396247552:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 41us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.451970:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11629 00000100:00100000:0.0:1651529344.451974:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11630 00000100:00100000:0.0:1651529344.451975:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a37852a8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1719:41279:x1731746396247616:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.451978:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.451979:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000748ad336/0x3234de053c4e986 lrc: 5/0,0 mode: PR/PR res: [0x2b490:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d57b9 expref: 1719 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.451983:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000748ad336/0x3234de053c4e986 lrc: 4/0,0 mode: PR/PR res: [0x2b490:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d57b9 expref: 1719 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.451986:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+346:39030:x1731745946366208:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 943us (1004us total) trans 12885078899 rc 0/0 00010000:00010000:0.0:1651529344.451987:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.451988:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.451988:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001e4ec3ee/0x3234de053c50188 lrc: 3/0,1 mode: PW/PW res: [0x2b490:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.451989:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210845 00010000:00010000:0.0:1651529344.451991:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e4ec3ee/0x3234de053c50188 lrc: 4/0,1 mode: PW/PW res: [0x2b490:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.451995:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.451996:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009a42426c/0x3234de053c50181 lrc: 3/0,1 mode: PW/PW res: [0x2b48f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.451999:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a42426c/0x3234de053c50181 lrc: 3/0,1 mode: PW/PW res: [0x2b48f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.452000:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a37852a8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1719:41279:x1731746396247616:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 24us (252us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.452002:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a42426c/0x3234de053c50181 lrc: 3/0,1 mode: PW/PW res: [0x2b48f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.452002:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11630 00010000:00010000:1.0:1651529344.452005:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a42426c/0x3234de053c50181 lrc: 2/0,0 mode: PW/PW res: [0x2b48f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.452009:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11631 00000100:00100000:0.0:1651529344.452011:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1718:41278:x1731746396247680:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.452019:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.452021:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002a7b079b/0x3234de053c4f430 lrc: 4/0,0 mode: PR/PR res: [0x2b491:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d838e expref: 1718 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.452024:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002a7b079b/0x3234de053c4f430 lrc: 3/0,0 mode: PR/PR res: [0x2b491:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d838e expref: 1718 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.452029:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a7b079b/0x3234de053c4f430 lrc: 0/0,0 mode: --/PR res: [0x2b491:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d838e expref: 1718 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.452033:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.452033:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.452034:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fccb00ae/0x3234de053c5018f lrc: 3/0,1 mode: PW/PW res: [0x2b491:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452037:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fccb00ae/0x3234de053c5018f lrc: 4/0,1 mode: PW/PW res: [0x2b491:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452045:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.452049:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+346:39029:x1731745946366400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 936us (1037us total) trans 12885078900 rc 0/0 00000100:00100000:0.0:1651529344.452051:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1717:41278:x1731746396247680:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 39us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.452053:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210847 00000100:00100000:0.0:1651529344.452053:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11631 00010000:00010000:1.0:1651529344.452059:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fccb00ae/0x3234de053c5018f lrc: 3/0,1 mode: PW/PW res: [0x2b491:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452060:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef2c2c65/0x3234de053c50173 lrc: 2/0,0 mode: PW/PW res: [0x2b48d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452064:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ef2c2c65 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.452065:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fccb00ae/0x3234de053c5018f lrc: 3/0,1 mode: PW/PW res: [0x2b491:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452065:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef2c2c65/0x3234de053c50173 lrc: 2/0,0 mode: PW/PW res: [0x2b48d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.452068:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fccb00ae/0x3234de053c5018f lrc: 3/0,1 mode: PW/PW res: [0x2b491:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452068:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef2c2c65/0x3234de053c50173 lrc: 3/0,0 mode: PW/PW res: [0x2b48d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.452071:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fccb00ae/0x3234de053c5018f lrc: 2/0,0 mode: PW/PW res: [0x2b491:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452072:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef2c2c65/0x3234de053c50173 lrc: 1/0,0 mode: --/PW res: [0x2b48d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452074:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef2c2c65/0x3234de053c50173 lrc: 0/0,0 mode: --/PW res: [0x2b48d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452084:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a42426c/0x3234de053c50181 lrc: 2/0,0 mode: PW/PW res: [0x2b48f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452087:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009a42426c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.452088:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a42426c/0x3234de053c50181 lrc: 2/0,0 mode: PW/PW res: [0x2b48f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452091:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a42426c/0x3234de053c50181 lrc: 3/0,0 mode: PW/PW res: [0x2b48f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452094:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a42426c/0x3234de053c50181 lrc: 1/0,0 mode: --/PW res: [0x2b48f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452097:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a42426c/0x3234de053c50181 lrc: 0/0,0 mode: --/PW res: [0x2b48f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452100:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fccb00ae/0x3234de053c5018f lrc: 2/0,0 mode: PW/PW res: [0x2b491:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452105:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fccb00ae already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.452106:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fccb00ae/0x3234de053c5018f lrc: 2/0,0 mode: PW/PW res: [0x2b491:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.452107:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+346:39029:x1731745946366592:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 667us (790us total) trans 12885078901 rc 0/0 00010000:00010000:0.0:1651529344.452108:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fccb00ae/0x3234de053c5018f lrc: 3/0,0 mode: PW/PW res: [0x2b491:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.452110:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210849 00010000:00010000:0.0:1651529344.452111:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fccb00ae/0x3234de053c5018f lrc: 1/0,0 mode: --/PW res: [0x2b491:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452114:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fccb00ae/0x3234de053c5018f lrc: 0/0,0 mode: --/PW res: [0x2b491:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.452118:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000029a4761a/0x3234de053c5016c lrc: 3/0,1 mode: PW/PW res: [0x2b48c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.452122:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029a4761a/0x3234de053c5016c lrc: 3/0,1 mode: PW/PW res: [0x2b48c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452124:0:106695:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000748ad336/0x3234de053c4e986 lrc: 0/0,0 mode: --/PR res: [0x2b490:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d57b9 expref: 1716 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.452125:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029a4761a/0x3234de053c5016c lrc: 3/0,1 mode: PW/PW res: [0x2b48c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.452127:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029a4761a/0x3234de053c5016c lrc: 2/0,0 mode: PW/PW res: [0x2b48c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.452128:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996961024:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.452131:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001e4ec3ee/0x3234de053c50188 lrc: 3/0,1 mode: PW/PW res: [0x2b490:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452139:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001e4ec3ee/0x3234de053c50188 lrc: 3/0,1 mode: PW/PW res: [0x2b490:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452142:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e4ec3ee/0x3234de053c50188 lrc: 3/0,1 mode: PW/PW res: [0x2b490:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452148:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e4ec3ee/0x3234de053c50188 lrc: 3/0,1 mode: PW/PW res: [0x2b490:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452151:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e4ec3ee/0x3234de053c50188 lrc: 2/0,0 mode: PW/PW res: [0x2b490:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.452164:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+346:39029:x1731745946365760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1313us (1495us total) trans 12885078902 rc 0/0 00000100:00100000:1.0:1651529344.452169:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210844 00000100:00100000:0.0:1651529344.452190:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+346:39029:x1731745946366528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 810us (991us total) trans 12885078903 rc 0/0 00000100:00100000:0.0:1651529344.452193:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210848 00010000:00010000:0.0:1651529344.452200:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029a4761a/0x3234de053c5016c lrc: 2/0,0 mode: PW/PW res: [0x2b48c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452203:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000029a4761a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.452204:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029a4761a/0x3234de053c5016c lrc: 2/0,0 mode: PW/PW res: [0x2b48c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452207:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029a4761a/0x3234de053c5016c lrc: 3/0,0 mode: PW/PW res: [0x2b48c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452211:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029a4761a/0x3234de053c5016c lrc: 1/0,0 mode: --/PW res: [0x2b48c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452214:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029a4761a/0x3234de053c5016c lrc: 0/0,0 mode: --/PW res: [0x2b48c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452218:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e4ec3ee/0x3234de053c50188 lrc: 2/0,0 mode: PW/PW res: [0x2b490:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452221:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e4ec3ee already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.452243:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e4ec3ee/0x3234de053c50188 lrc: 2/0,0 mode: PW/PW res: [0x2b490:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452247:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e4ec3ee/0x3234de053c50188 lrc: 3/0,0 mode: PW/PW res: [0x2b490:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452250:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e4ec3ee/0x3234de053c50188 lrc: 1/0,0 mode: --/PW res: [0x2b490:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452253:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e4ec3ee/0x3234de053c50188 lrc: 0/0,0 mode: --/PW res: [0x2b490:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452262:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d1e9e4c0/0x3234de053c5017a lrc: 3/0,1 mode: PW/PW res: [0x2b48e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452265:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1e9e4c0/0x3234de053c5017a lrc: 3/0,1 mode: PW/PW res: [0x2b48e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452268:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1e9e4c0/0x3234de053c5017a lrc: 3/0,1 mode: PW/PW res: [0x2b48e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452271:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1e9e4c0/0x3234de053c5017a lrc: 2/0,0 mode: PW/PW res: [0x2b48e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.452340:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+346:39029:x1731745946366272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1244us (1341us total) trans 12885078904 rc 0/0 00000100:00100000:0.0:1651529344.452343:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210846 00010000:00010000:0.0:1651529344.452351:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1e9e4c0/0x3234de053c5017a lrc: 2/0,0 mode: PW/PW res: [0x2b48e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452354:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d1e9e4c0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.452355:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1e9e4c0/0x3234de053c5017a lrc: 2/0,0 mode: PW/PW res: [0x2b48e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452358:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1e9e4c0/0x3234de053c5017a lrc: 3/0,0 mode: PW/PW res: [0x2b48e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452397:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1e9e4c0/0x3234de053c5017a lrc: 1/0,0 mode: --/PW res: [0x2b48e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452400:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1e9e4c0/0x3234de053c5017a lrc: 0/0,0 mode: --/PW res: [0x2b48e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.452406:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.452424:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.452435:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946366848 00000100:00100000:0.0:1651529344.452442:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946366784 00000100:00100000:0.0:1651529344.452446:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210852 00000100:00100000:0.0:1651529344.452448:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+347:39030:x1731745946366848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.452453:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177301 count 1 00000100:00100000:1.0:1651529344.452457:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000034e35367 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996961152:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.452457:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8ab2b49/0x3234de053c501a4 lrc: 3/0,1 mode: --/PW res: [0x2b495:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.452461:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004e049160/0x3234de053c50196 lrc: 3/0,1 mode: --/PW res: [0x2b492:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.452469:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd68fdd5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996961216:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.452471:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000088993906/0x3234de053c5019d lrc: 3/0,1 mode: --/PW res: [0x2b493:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.452500:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.452501:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000039cf6408/0x3234de053c4e415 lrc: 2/0,0 mode: PR/PR res: [0x2b495:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d414d expref: 1715 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.452516:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.452517:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.452517:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.452517:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8ab2b49/0x3234de053c501a4 lrc: 4/0,1 mode: --/PW res: [0x2b495:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.452526:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.452541:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000039cf6408/0x3234de053c4e415 lrc: 3/0,0 mode: PR/PR res: [0x2b495:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d414d expref: 1715 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.452543:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.452545:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000039cf6408/0x3234de053c4e415 lrc: 4/0,0 mode: PR/PR res: [0x2b495:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d414d expref: 1715 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.452549:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996961280:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.452559:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aac87b31 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.452560:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.452565:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946366976 00000100:00100000:0.0:1651529344.452575:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946366912 00000100:00100000:0.0:1651529344.452580:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946367040 00000100:00100000:0.0:1651529344.452585:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210853 00000100:00100000:0.0:1651529344.452587:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+350:39030:x1731745946366784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.452592:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177300 count 1 00010000:00010000:0.0:1651529344.452595:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008cdb8783/0x3234de053c501ab lrc: 3/0,1 mode: --/PW res: [0x2b494:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.452597:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.452600:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000090168046/0x3234de053c4ddbd lrc: 2/0,0 mode: PR/PR res: [0x2b494:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2856 expref: 1715 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.452603:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946367104 00010000:00010000:0.0:1651529344.452603:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.452604:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.452604:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008cdb8783/0x3234de053c501ab lrc: 4/0,1 mode: --/PW res: [0x2b494:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.452610:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210854 00010000:00010000:0.0:1651529344.452611:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000090168046/0x3234de053c4ddbd lrc: 3/0,0 mode: PR/PR res: [0x2b494:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2856 expref: 1715 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.452612:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+351:39030:x1731745946366976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.452614:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000090168046/0x3234de053c4ddbd lrc: 4/0,0 mode: PR/PR res: [0x2b494:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2856 expref: 1715 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:1.0:1651529344.452617:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177303 count 1 00000100:00100000:0.0:1651529344.452618:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996961344:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.452621:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025b3903e/0x3234de053c501b2 lrc: 3/0,1 mode: --/PW res: [0x2b497:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.452626:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c35066cf/0x3234de053c4d280 lrc: 2/0,0 mode: PR/PR res: [0x2b497:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb69 expref: 1715 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.452630:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000009370c1d going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.452637:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210855 00010000:00010000:1.0:1651529344.452639:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.452639:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+351:39030:x1731745946366912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.452640:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.452640:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025b3903e/0x3234de053c501b2 lrc: 4/0,1 mode: --/PW res: [0x2b497:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.452643:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177302 count 1 00010000:00010000:0.0:1651529344.452647:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9ee567c/0x3234de053c501b9 lrc: 3/0,1 mode: --/PW res: [0x2b496:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.452648:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c35066cf/0x3234de053c4d280 lrc: 3/0,0 mode: PR/PR res: [0x2b497:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb69 expref: 1715 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.452651:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e37edc36/0x3234de053c4d742 lrc: 2/0,0 mode: PR/PR res: [0x2b496:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e8d expref: 1715 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.452652:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c35066cf/0x3234de053c4d280 lrc: 4/0,0 mode: PR/PR res: [0x2b497:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb69 expref: 1715 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.452654:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.452655:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.452656:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000fb8e412 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996961408:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.452656:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9ee567c/0x3234de053c501b9 lrc: 4/0,1 mode: --/PW res: [0x2b496:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452661:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e37edc36/0x3234de053c4d742 lrc: 3/0,0 mode: PR/PR res: [0x2b496:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e8d expref: 1715 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.452664:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a6b79b05 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.452667:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e37edc36/0x3234de053c4d742 lrc: 4/0,0 mode: PR/PR res: [0x2b496:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e8d expref: 1715 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.452671:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210856 00000100:00100000:0.0:1651529344.452671:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996961472:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.452672:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+351:39030:x1731745946367040:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.452677:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177304 count 1 00000100:00100000:0.0:1651529344.452678:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 000000003678d25f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.452681:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051eb5c0f/0x3234de053c501c0 lrc: 3/0,1 mode: --/PW res: [0x2b498:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.452685:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003342140f/0x3234de053c4e4e7 lrc: 2/0,0 mode: PR/PR res: [0x2b498:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d44e9 expref: 1715 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.452688:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.452689:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.452689:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051eb5c0f/0x3234de053c501c0 lrc: 4/0,1 mode: --/PW res: [0x2b498:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.452697:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003342140f/0x3234de053c4e4e7 lrc: 3/0,0 mode: PR/PR res: [0x2b498:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d44e9 expref: 1715 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.452700:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210857 00010000:00010000:1.0:1651529344.452701:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003342140f/0x3234de053c4e4e7 lrc: 4/0,0 mode: PR/PR res: [0x2b498:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d44e9 expref: 1715 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.452702:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+351:39029:x1731745946367104:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.452704:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005d2b5bb3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996961536:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.452706:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177305 count 1 00000100:00100000:1.0:1651529344.452710:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd96f074 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.452710:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c501c7 lrc: 3/0,1 mode: --/PW res: [0x2b499:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452714:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000578d2cb4/0x3234de053c4f269 lrc: 2/0,0 mode: PR/PR res: [0x2b499:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c95 expref: 1715 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.452717:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396247808 00010000:00010000:0.0:1651529344.452717:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.452718:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.452719:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c501c7 lrc: 4/0,1 mode: --/PW res: [0x2b499:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.452721:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007249d40d/0x3234de053c4a833 lrc: 4/0,0 mode: PR/PR res: [0x2b493:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc85 expref: 1716 pid: 151609 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.452725:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000578d2cb4/0x3234de053c4f269 lrc: 3/0,0 mode: PR/PR res: [0x2b499:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c95 expref: 1716 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.452728:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396247744 00010000:00010000:0.0:1651529344.452728:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000578d2cb4/0x3234de053c4f269 lrc: 4/0,0 mode: PR/PR res: [0x2b499:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c95 expref: 1716 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.452730:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006b4eadd7/0x3234de053c4d53c lrc: 4/0,0 mode: PR/PR res: [0x2b492:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d06d7 expref: 1717 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.452749:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11632 00000100:00100000:1.0:1651529344.452751:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1717:41279:x1731746396247808:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.452751:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996961600:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.452754:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.452755:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007249d40d/0x3234de053c4a833 lrc: 4/0,0 mode: PR/PR res: [0x2b493:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc85 expref: 1717 pid: 151609 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.452759:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007249d40d/0x3234de053c4a833 lrc: 3/0,0 mode: PR/PR res: [0x2b493:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc85 expref: 1717 pid: 151609 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.452760:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed830649 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.452767:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11633 00010000:00010000:1.0:1651529344.452768:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007249d40d/0x3234de053c4a833 lrc: 0/0,0 mode: --/PR res: [0x2b493:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc85 expref: 1717 pid: 151609 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.452768:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1717:41278:x1731746396247744:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.452771:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.452772:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.452772:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.452773:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000088993906/0x3234de053c5019d lrc: 3/0,1 mode: PW/PW res: [0x2b493:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452773:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006b4eadd7/0x3234de053c4d53c lrc: 4/0,0 mode: PR/PR res: [0x2b492:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d06d7 expref: 1716 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.452776:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088993906/0x3234de053c5019d lrc: 4/0,1 mode: PW/PW res: [0x2b493:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452777:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006b4eadd7/0x3234de053c4d53c lrc: 3/0,0 mode: PR/PR res: [0x2b492:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d06d7 expref: 1716 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.452783:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.452783:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b4eadd7/0x3234de053c4d53c lrc: 0/0,0 mode: --/PR res: [0x2b492:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d06d7 expref: 1716 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.452786:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.452787:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.452788:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004e049160/0x3234de053c50196 lrc: 3/0,1 mode: PW/PW res: [0x2b492:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.452790:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1715:41279:x1731746396247808:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 38us (273us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.452791:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e049160/0x3234de053c50196 lrc: 4/0,1 mode: PW/PW res: [0x2b492:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.452792:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11632 00010000:00010000:1.0:1651529344.452798:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000088993906/0x3234de053c5019d lrc: 3/0,1 mode: PW/PW res: [0x2b493:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.452808:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088993906/0x3234de053c5019d lrc: 3/0,1 mode: PW/PW res: [0x2b493:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.452811:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088993906/0x3234de053c5019d lrc: 3/0,1 mode: PW/PW res: [0x2b493:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452813:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.452814:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088993906/0x3234de053c5019d lrc: 2/0,0 mode: PW/PW res: [0x2b493:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.452821:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1714:41278:x1731746396247744:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 51us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.452831:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11633 00010000:00010000:0.0:1651529344.452839:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088993906/0x3234de053c5019d lrc: 2/0,0 mode: PW/PW res: [0x2b493:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452842:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088993906 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.452843:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088993906/0x3234de053c5019d lrc: 2/0,0 mode: PW/PW res: [0x2b493:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452846:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088993906/0x3234de053c5019d lrc: 3/0,0 mode: PW/PW res: [0x2b493:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452851:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088993906/0x3234de053c5019d lrc: 1/0,0 mode: --/PW res: [0x2b493:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452853:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088993906/0x3234de053c5019d lrc: 0/0,0 mode: --/PW res: [0x2b493:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.452859:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+352:39030:x1731745946366720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 991us (1157us total) trans 12885078905 rc 0/0 00000100:00100000:1.0:1651529344.452862:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210851 00010000:00010000:1.0:1651529344.452869:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004e049160/0x3234de053c50196 lrc: 3/0,1 mode: PW/PW res: [0x2b492:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.452872:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e049160/0x3234de053c50196 lrc: 3/0,1 mode: PW/PW res: [0x2b492:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.452876:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e049160/0x3234de053c50196 lrc: 3/0,1 mode: PW/PW res: [0x2b492:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.452878:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e049160/0x3234de053c50196 lrc: 2/0,0 mode: PW/PW res: [0x2b492:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452889:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e049160/0x3234de053c50196 lrc: 2/0,0 mode: PW/PW res: [0x2b492:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452892:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004e049160 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.452893:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e049160/0x3234de053c50196 lrc: 2/0,0 mode: PW/PW res: [0x2b492:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452896:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e049160/0x3234de053c50196 lrc: 3/0,0 mode: PW/PW res: [0x2b492:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452902:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e049160/0x3234de053c50196 lrc: 1/0,0 mode: --/PW res: [0x2b492:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.452905:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e049160/0x3234de053c50196 lrc: 0/0,0 mode: --/PW res: [0x2b492:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.452913:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+352:39029:x1731745946366656:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1105us (1229us total) trans 12885078906 rc 0/0 00000100:00100000:1.0:1651529344.452916:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210850 00000100:00100000:0.0:1651529344.452942:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996961280:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.452945:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c8ab2b49/0x3234de053c501a4 lrc: 3/0,1 mode: --/PW res: [0x2b495:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.452957:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.453048:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396247872 00010000:00010000:1.0:1651529344.453054:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000039cf6408/0x3234de053c4e415 lrc: 4/0,0 mode: PR/PR res: [0x2b495:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d414d expref: 1714 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.453065:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11634 00000100:00100000:1.0:1651529344.453067:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1714:41279:x1731746396247872:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.453071:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.453072:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000039cf6408/0x3234de053c4e415 lrc: 4/0,0 mode: PR/PR res: [0x2b495:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d414d expref: 1714 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.453076:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000039cf6408/0x3234de053c4e415 lrc: 3/0,0 mode: PR/PR res: [0x2b495:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d414d expref: 1714 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.453082:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039cf6408/0x3234de053c4e415 lrc: 0/0,0 mode: --/PR res: [0x2b495:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d414d expref: 1714 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.453085:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.453086:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.453087:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c8ab2b49/0x3234de053c501a4 lrc: 3/0,1 mode: PW/PW res: [0x2b495:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.453090:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8ab2b49/0x3234de053c501a4 lrc: 4/0,1 mode: PW/PW res: [0x2b495:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.453098:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.453107:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1713:41279:x1731746396247872:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 39us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.453109:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11634 00010000:00010000:0.0:1651529344.453112:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c8ab2b49/0x3234de053c501a4 lrc: 3/0,1 mode: PW/PW res: [0x2b495:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.453116:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8ab2b49/0x3234de053c501a4 lrc: 3/0,1 mode: PW/PW res: [0x2b495:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.453124:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.453144:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8ab2b49/0x3234de053c501a4 lrc: 3/0,1 mode: PW/PW res: [0x2b495:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.453148:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8ab2b49/0x3234de053c501a4 lrc: 2/0,0 mode: PW/PW res: [0x2b495:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.453153:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.453190:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946367680 00000100:00100000:1.0:1651529344.453196:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946367744 00000100:00100000:1.0:1651529344.453203:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210858 00000100:00100000:1.0:1651529344.453205:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+354:39029:x1731745946367680:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.453215:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177306 count 1 00010000:00010000:1.0:1651529344.453220:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8e23e2b/0x3234de053c501ce lrc: 3/0,1 mode: --/PW res: [0x2b49a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.453239:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005d374aca/0x3234de053c4e9c5 lrc: 2/0,0 mode: PR/PR res: [0x2b49a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d586f expref: 1712 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.453242:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.453242:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.453243:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8e23e2b/0x3234de053c501ce lrc: 4/0,1 mode: --/PW res: [0x2b49a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.453246:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+354:39030:x1731745946366848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 797us (853us total) trans 12885078907 rc 0/0 00000100:00100000:0.0:1651529344.453249:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210852 00010000:00010000:1.0:1651529344.453250:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005d374aca/0x3234de053c4e9c5 lrc: 3/0,0 mode: PR/PR res: [0x2b49a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d586f expref: 1712 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.453254:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005d374aca/0x3234de053c4e9c5 lrc: 4/0,0 mode: PR/PR res: [0x2b49a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d586f expref: 1712 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.453255:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210859 00000100:00100000:0.0:1651529344.453256:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+353:39030:x1731745946367744:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.453258:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001d1586f2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996961664:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.453262:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177307 count 1 00000100:00100000:1.0:1651529344.453266:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c3caa148 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.453266:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000431e46a9/0x3234de053c501d5 lrc: 3/0,1 mode: --/PW res: [0x2b49b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.453274:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000fb8e412 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996961408:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.453277:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000025b3903e/0x3234de053c501b2 lrc: 3/0,1 mode: --/PW res: [0x2b497:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.453284:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000071086493/0x3234de053c4f215 lrc: 2/0,0 mode: PR/PR res: [0x2b49b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b14 expref: 1712 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.453287:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.453288:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.453289:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000431e46a9/0x3234de053c501d5 lrc: 4/0,1 mode: --/PW res: [0x2b49b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.453302:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000071086493/0x3234de053c4f215 lrc: 3/0,0 mode: PR/PR res: [0x2b49b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b14 expref: 1712 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.453305:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000071086493/0x3234de053c4f215 lrc: 4/0,0 mode: PR/PR res: [0x2b49b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b14 expref: 1712 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.453310:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996961728:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.453318:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 000000000d706dff going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.453326:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8ab2b49/0x3234de053c501a4 lrc: 2/0,0 mode: PW/PW res: [0x2b495:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.453329:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c8ab2b49 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.453330:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8ab2b49/0x3234de053c501a4 lrc: 2/0,0 mode: PW/PW res: [0x2b495:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.453335:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8ab2b49/0x3234de053c501a4 lrc: 3/0,0 mode: PW/PW res: [0x2b495:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.453340:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8ab2b49/0x3234de053c501a4 lrc: 1/0,0 mode: --/PW res: [0x2b495:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.453343:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8ab2b49/0x3234de053c501a4 lrc: 0/0,0 mode: --/PW res: [0x2b495:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.453359:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996961472:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.453362:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f9ee567c/0x3234de053c501b9 lrc: 3/0,1 mode: --/PW res: [0x2b496:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.453369:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996961344:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.453371:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008cdb8783/0x3234de053c501ab lrc: 3/0,1 mode: --/PW res: [0x2b494:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.453376:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005d2b5bb3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996961536:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.453377:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996961600:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.453380:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c501c7 lrc: 3/0,1 mode: --/PW res: [0x2b499:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.453381:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000051eb5c0f/0x3234de053c501c0 lrc: 3/0,1 mode: --/PW res: [0x2b498:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.453459:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.453470:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946367808 00000100:00100000:0.0:1651529344.453480:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210860 00000100:00100000:0.0:1651529344.453482:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+354:39029:x1731745946367808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.453488:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177308 count 1 00010000:00010000:0.0:1651529344.453492:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c501dc lrc: 3/0,1 mode: --/PW res: [0x2b49c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.453497:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f3e1d739/0x3234de053c4e53b lrc: 2/0,0 mode: PR/PR res: [0x2b49c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4601 expref: 1712 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.453500:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.453500:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.453501:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c501dc lrc: 4/0,1 mode: --/PW res: [0x2b49c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.453507:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f3e1d739/0x3234de053c4e53b lrc: 3/0,0 mode: PR/PR res: [0x2b49c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4601 expref: 1712 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.453511:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f3e1d739/0x3234de053c4e53b lrc: 4/0,0 mode: PR/PR res: [0x2b49c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4601 expref: 1712 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.453515:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996961792:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.453545:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.453556:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 0000000009370c1d going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.453576:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.453586:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396248000 00010000:00010000:0.0:1651529344.453591:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c35066cf/0x3234de053c4d280 lrc: 4/0,0 mode: PR/PR res: [0x2b497:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb69 expref: 1713 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.453598:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396248128 00010000:00010000:0.0:1651529344.453600:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e37edc36/0x3234de053c4d742 lrc: 4/0,0 mode: PR/PR res: [0x2b496:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e8d expref: 1714 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.453607:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.453616:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396247936 00010000:00010000:0.0:1651529344.453619:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000090168046/0x3234de053c4ddbd lrc: 4/0,0 mode: PR/PR res: [0x2b494:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2856 expref: 1715 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.453622:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.453623:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396248064 00010000:00010000:0.0:1651529344.453626:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003342140f/0x3234de053c4e4e7 lrc: 4/0,0 mode: PR/PR res: [0x2b498:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d44e9 expref: 1716 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.453628:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.453630:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396248192 00010000:00010000:0.0:1651529344.453632:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000578d2cb4/0x3234de053c4f269 lrc: 4/0,0 mode: PR/PR res: [0x2b499:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c95 expref: 1717 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.453634:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11635 00000100:00100000:1.0:1651529344.453636:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1717:41278:x1731746396248000:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.453637:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11636 00000100:00100000:0.0:1651529344.453638:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1717:41278:x1731746396248128:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.453639:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.453641:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c35066cf/0x3234de053c4d280 lrc: 4/0,0 mode: PR/PR res: [0x2b497:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb69 expref: 1717 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.453645:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c35066cf/0x3234de053c4d280 lrc: 3/0,0 mode: PR/PR res: [0x2b497:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb69 expref: 1717 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.453651:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c35066cf/0x3234de053c4d280 lrc: 0/0,0 mode: --/PR res: [0x2b497:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb69 expref: 1717 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.453659:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.453661:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.453661:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.453661:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e37edc36/0x3234de053c4d742 lrc: 4/0,0 mode: PR/PR res: [0x2b496:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e8d expref: 1716 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.453662:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000025b3903e/0x3234de053c501b2 lrc: 3/0,1 mode: PW/PW res: [0x2b497:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.453665:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025b3903e/0x3234de053c501b2 lrc: 4/0,1 mode: PW/PW res: [0x2b497:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.453665:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e37edc36/0x3234de053c4d742 lrc: 3/0,0 mode: PR/PR res: [0x2b496:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e8d expref: 1716 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.453670:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e37edc36/0x3234de053c4d742 lrc: 0/0,0 mode: --/PR res: [0x2b496:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e8d expref: 1716 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.453674:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.453674:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.453675:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.453675:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f9ee567c/0x3234de053c501b9 lrc: 3/0,1 mode: PW/PW res: [0x2b496:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.453679:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9ee567c/0x3234de053c501b9 lrc: 4/0,1 mode: PW/PW res: [0x2b496:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.453681:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1715:41278:x1731746396248000:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 45us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.453683:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11635 00010000:00010000:0.0:1651529344.453685:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.453689:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11637 00000100:00100000:1.0:1651529344.453691:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001e35645b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1714:41278:x1731746396247936:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.453692:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1714:41278:x1731746396248128:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 53us (122us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.453693:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.453695:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000090168046/0x3234de053c4ddbd lrc: 4/0,0 mode: PR/PR res: [0x2b494:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2856 expref: 1714 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.453695:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11636 00010000:00010000:1.0:1651529344.453699:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000090168046/0x3234de053c4ddbd lrc: 3/0,0 mode: PR/PR res: [0x2b494:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2856 expref: 1713 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.453700:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11638 00000100:00100000:0.0:1651529344.453702:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1713:41278:x1731746396248064:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.453704:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090168046/0x3234de053c4ddbd lrc: 0/0,0 mode: --/PR res: [0x2b494:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2856 expref: 1713 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.453704:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.453706:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003342140f/0x3234de053c4e4e7 lrc: 4/0,0 mode: PR/PR res: [0x2b498:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d44e9 expref: 1713 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.453707:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.453708:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.453708:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008cdb8783/0x3234de053c501ab lrc: 3/0,1 mode: PW/PW res: [0x2b494:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.453709:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003342140f/0x3234de053c4e4e7 lrc: 3/0,0 mode: PR/PR res: [0x2b498:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d44e9 expref: 1712 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.453711:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008cdb8783/0x3234de053c501ab lrc: 4/0,1 mode: PW/PW res: [0x2b494:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.453714:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003342140f/0x3234de053c4e4e7 lrc: 0/0,0 mode: --/PR res: [0x2b498:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d44e9 expref: 1712 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.453717:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.453718:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.453721:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.453726:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001e35645b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1711:41278:x1731746396247936:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (119us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.453726:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000051eb5c0f/0x3234de053c501c0 lrc: 3/0,1 mode: PW/PW res: [0x2b498:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.453729:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11637 00010000:00010000:0.0:1651529344.453731:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051eb5c0f/0x3234de053c501c0 lrc: 4/0,1 mode: PW/PW res: [0x2b498:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.453746:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11639 00010000:00010000:0.0:1651529344.453749:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.453754:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1710:41278:x1731746396248192:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.453755:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1710:41278:x1731746396248064:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 53us (133us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.453757:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.453758:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11638 00010000:00010000:1.0:1651529344.453759:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000578d2cb4/0x3234de053c4f269 lrc: 4/0,0 mode: PR/PR res: [0x2b499:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c95 expref: 1710 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.453762:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000578d2cb4/0x3234de053c4f269 lrc: 3/0,0 mode: PR/PR res: [0x2b499:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c95 expref: 1709 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.453765:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f9ee567c/0x3234de053c501b9 lrc: 3/0,1 mode: PW/PW res: [0x2b496:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.453768:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000578d2cb4/0x3234de053c4f269 lrc: 0/0,0 mode: --/PR res: [0x2b499:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c95 expref: 1709 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.453768:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9ee567c/0x3234de053c501b9 lrc: 3/0,1 mode: PW/PW res: [0x2b496:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.453771:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.453771:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9ee567c/0x3234de053c501b9 lrc: 3/0,1 mode: PW/PW res: [0x2b496:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.453772:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.453773:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c501c7 lrc: 3/0,1 mode: PW/PW res: [0x2b499:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.453774:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9ee567c/0x3234de053c501b9 lrc: 2/0,0 mode: PW/PW res: [0x2b496:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.453776:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c501c7 lrc: 4/0,1 mode: PW/PW res: [0x2b499:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.453785:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.453790:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1708:41278:x1731746396248192:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.453793:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11639 00010000:00010000:1.0:1651529344.453799:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000025b3903e/0x3234de053c501b2 lrc: 3/0,1 mode: PW/PW res: [0x2b497:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.453803:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025b3903e/0x3234de053c501b2 lrc: 3/0,1 mode: PW/PW res: [0x2b497:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.453806:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025b3903e/0x3234de053c501b2 lrc: 3/0,1 mode: PW/PW res: [0x2b497:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.453808:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025b3903e/0x3234de053c501b2 lrc: 2/0,0 mode: PW/PW res: [0x2b497:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.453825:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+355:39030:x1731745946366912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1185us (1298us total) trans 12885078908 rc 0/0 00000100:00100000:0.0:1651529344.453828:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210855 00010000:00010000:0.0:1651529344.453835:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9ee567c/0x3234de053c501b9 lrc: 2/0,0 mode: PW/PW res: [0x2b496:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.453838:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f9ee567c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.453839:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9ee567c/0x3234de053c501b9 lrc: 2/0,0 mode: PW/PW res: [0x2b496:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.453842:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9ee567c/0x3234de053c501b9 lrc: 3/0,0 mode: PW/PW res: [0x2b496:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.453847:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9ee567c/0x3234de053c501b9 lrc: 1/0,0 mode: --/PW res: [0x2b496:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.453849:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9ee567c/0x3234de053c501b9 lrc: 0/0,0 mode: --/PW res: [0x2b496:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.453850:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+355:39030:x1731745946366976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1238us (1350us total) trans 12885078909 rc 0/0 00000100:00100000:1.0:1651529344.453853:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210854 00010000:00010000:0.0:1651529344.453853:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025b3903e/0x3234de053c501b2 lrc: 2/0,0 mode: PW/PW res: [0x2b497:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.453856:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000025b3903e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.453857:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025b3903e/0x3234de053c501b2 lrc: 2/0,0 mode: PW/PW res: [0x2b497:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.453860:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025b3903e/0x3234de053c501b2 lrc: 3/0,0 mode: PW/PW res: [0x2b497:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.453861:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000051eb5c0f/0x3234de053c501c0 lrc: 3/0,1 mode: PW/PW res: [0x2b498:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.453863:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051eb5c0f/0x3234de053c501c0 lrc: 3/0,1 mode: PW/PW res: [0x2b498:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.453863:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025b3903e/0x3234de053c501b2 lrc: 1/0,0 mode: --/PW res: [0x2b497:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.453865:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025b3903e/0x3234de053c501b2 lrc: 0/0,0 mode: --/PW res: [0x2b497:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.453867:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051eb5c0f/0x3234de053c501c0 lrc: 3/0,1 mode: PW/PW res: [0x2b498:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.453869:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051eb5c0f/0x3234de053c501c0 lrc: 2/0,0 mode: PW/PW res: [0x2b498:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.453887:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051eb5c0f/0x3234de053c501c0 lrc: 2/0,0 mode: PW/PW res: [0x2b498:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.453891:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000051eb5c0f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.453892:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051eb5c0f/0x3234de053c501c0 lrc: 2/0,0 mode: PW/PW res: [0x2b498:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.453894:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051eb5c0f/0x3234de053c501c0 lrc: 3/0,0 mode: PW/PW res: [0x2b498:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.453898:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051eb5c0f/0x3234de053c501c0 lrc: 1/0,0 mode: --/PW res: [0x2b498:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.453901:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051eb5c0f/0x3234de053c501c0 lrc: 0/0,0 mode: --/PW res: [0x2b498:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.453905:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+355:39030:x1731745946367040:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1232us (1345us total) trans 12885078910 rc 0/0 00010000:00010000:0.0:1651529344.453908:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008cdb8783/0x3234de053c501ab lrc: 3/0,1 mode: PW/PW res: [0x2b494:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.453909:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210856 00010000:00010000:0.0:1651529344.453911:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008cdb8783/0x3234de053c501ab lrc: 3/0,1 mode: PW/PW res: [0x2b494:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.453914:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008cdb8783/0x3234de053c501ab lrc: 3/0,1 mode: PW/PW res: [0x2b494:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.453917:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008cdb8783/0x3234de053c501ab lrc: 2/0,0 mode: PW/PW res: [0x2b494:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.453953:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+355:39030:x1731745946366784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1365us (1528us total) trans 12885078911 rc 0/0 00000100:00100000:0.0:1651529344.453956:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210853 00000100:00100000:1.0:1651529344.453969:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.453970:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008cdb8783/0x3234de053c501ab lrc: 2/0,0 mode: PW/PW res: [0x2b494:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.453974:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008cdb8783 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.453975:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008cdb8783/0x3234de053c501ab lrc: 2/0,0 mode: PW/PW res: [0x2b494:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.453978:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.453978:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008cdb8783/0x3234de053c501ab lrc: 3/0,0 mode: PW/PW res: [0x2b494:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.453982:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008cdb8783/0x3234de053c501ab lrc: 1/0,0 mode: --/PW res: [0x2b494:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.453985:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008cdb8783/0x3234de053c501ab lrc: 0/0,0 mode: --/PW res: [0x2b494:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.453995:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c501c7 lrc: 3/0,1 mode: PW/PW res: [0x2b499:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.453997:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.453999:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c501c7 lrc: 3/0,1 mode: PW/PW res: [0x2b499:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454006:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c501c7 lrc: 3/0,1 mode: PW/PW res: [0x2b499:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454009:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c501c7 lrc: 2/0,0 mode: PW/PW res: [0x2b499:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.454043:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+355:39029:x1731745946367104:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1340us (1445us total) trans 12885078912 rc 0/0 00000100:00100000:0.0:1651529344.454046:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210857 00010000:00010000:0.0:1651529344.454052:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c501c7 lrc: 2/0,0 mode: PW/PW res: [0x2b499:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454056:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000069f87339 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.454057:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c501c7 lrc: 2/0,0 mode: PW/PW res: [0x2b499:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454059:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c501c7 lrc: 3/0,0 mode: PW/PW res: [0x2b499:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454064:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c501c7 lrc: 1/0,0 mode: --/PW res: [0x2b499:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454066:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069f87339/0x3234de053c501c7 lrc: 0/0,0 mode: --/PW res: [0x2b499:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.454076:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996961792:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.454078:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001d1586f2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996961664:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.454080:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c501dc lrc: 3/0,1 mode: --/PW res: [0x2b49c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.454082:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f8e23e2b/0x3234de053c501ce lrc: 3/0,1 mode: --/PW res: [0x2b49a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.454086:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396248576 00000100:00100000:1.0:1651529344.454090:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396248512 00010000:00010000:0.0:1651529344.454090:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000071086493/0x3234de053c4f215 lrc: 5/0,0 mode: PR/PR res: [0x2b49b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b14 expref: 1708 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.454095:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005d374aca/0x3234de053c4e9c5 lrc: 4/0,0 mode: PR/PR res: [0x2b49a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d586f expref: 1709 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.454097:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396248768 00000100:00100000:1.0:1651529344.454101:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11640 00000100:00100000:1.0:1651529344.454102:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1709:41279:x1731746396248576:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.454105:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.454106:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000071086493/0x3234de053c4f215 lrc: 5/0,0 mode: PR/PR res: [0x2b49b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b14 expref: 1709 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.454110:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000071086493/0x3234de053c4f215 lrc: 4/0,0 mode: PR/PR res: [0x2b49b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b14 expref: 1709 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.454115:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.454116:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.454117:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000431e46a9/0x3234de053c501d5 lrc: 3/0,1 mode: PW/PW res: [0x2b49b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454121:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f3e1d739/0x3234de053c4e53b lrc: 4/0,0 mode: PR/PR res: [0x2b49c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4601 expref: 1710 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.454122:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000431e46a9/0x3234de053c501d5 lrc: 4/0,1 mode: PW/PW res: [0x2b49b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.454126:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.454127:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11641 00000100:00100000:0.0:1651529344.454128:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1710:41279:x1731746396248512:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.454131:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.454133:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005d374aca/0x3234de053c4e9c5 lrc: 4/0,0 mode: PR/PR res: [0x2b49a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d586f expref: 1710 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.454135:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1710:41279:x1731746396248576:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 32us (166us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.454136:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005d374aca/0x3234de053c4e9c5 lrc: 3/0,0 mode: PR/PR res: [0x2b49a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d586f expref: 1710 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.454137:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11640 00000100:00100000:1.0:1651529344.454142:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11642 00010000:00010000:0.0:1651529344.454142:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d374aca/0x3234de053c4e9c5 lrc: 0/0,0 mode: --/PR res: [0x2b49a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d586f expref: 1709 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.454143:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1709:41278:x1731746396248768:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.454145:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.454145:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.454146:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.454147:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f3e1d739/0x3234de053c4e53b lrc: 4/0,0 mode: PR/PR res: [0x2b49c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4601 expref: 1708 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.454147:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f8e23e2b/0x3234de053c501ce lrc: 3/0,1 mode: PW/PW res: [0x2b49a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454150:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8e23e2b/0x3234de053c501ce lrc: 4/0,1 mode: PW/PW res: [0x2b49a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.454151:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f3e1d739/0x3234de053c4e53b lrc: 3/0,0 mode: PR/PR res: [0x2b49c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4601 expref: 1708 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.454155:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3e1d739/0x3234de053c4e53b lrc: 0/0,0 mode: --/PR res: [0x2b49c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4601 expref: 1708 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.454161:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.454166:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.454167:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.454168:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c501dc lrc: 3/0,1 mode: PW/PW res: [0x2b49c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.454168:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1707:41279:x1731746396248512:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 39us (189us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.454171:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c501dc lrc: 4/0,1 mode: PW/PW res: [0x2b49c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.454171:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11641 00010000:00010000:1.0:1651529344.454182:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.454187:0:156655:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071086493/0x3234de053c4f215 lrc: 0/0,0 mode: --/PR res: [0x2b49b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b14 expref: 1706 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.454188:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1706:41278:x1731746396248768:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 44us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.454191:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11642 00000100:00100000:0.0:1651529344.454191:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996961728:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.454195:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000431e46a9/0x3234de053c501d5 lrc: 3/0,1 mode: PW/PW res: [0x2b49b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.454197:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f8e23e2b/0x3234de053c501ce lrc: 3/0,1 mode: PW/PW res: [0x2b49a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454198:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000431e46a9/0x3234de053c501d5 lrc: 3/0,1 mode: PW/PW res: [0x2b49b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.454200:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8e23e2b/0x3234de053c501ce lrc: 3/0,1 mode: PW/PW res: [0x2b49a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454201:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000431e46a9/0x3234de053c501d5 lrc: 3/0,1 mode: PW/PW res: [0x2b49b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.454204:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8e23e2b/0x3234de053c501ce lrc: 3/0,1 mode: PW/PW res: [0x2b49a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454204:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000431e46a9/0x3234de053c501d5 lrc: 3/0,1 mode: PW/PW res: [0x2b49b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.454206:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8e23e2b/0x3234de053c501ce lrc: 2/0,0 mode: PW/PW res: [0x2b49a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454207:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000431e46a9/0x3234de053c501d5 lrc: 2/0,0 mode: PW/PW res: [0x2b49b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.454263:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+356:39029:x1731745946367680:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1057us (1138us total) trans 12885078913 rc 0/0 00000100:00100000:1.0:1651529344.454266:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210858 00000100:00100000:1.0:1651529344.454287:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.454301:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+355:39030:x1731745946367744:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1043us (1147us total) trans 12885078914 rc 0/0 00000100:00100000:0.0:1651529344.454304:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210859 00000100:00100000:0.0:1651529344.454309:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946368000 00000100:00100000:0.0:1651529344.454316:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210861 00000100:00100000:0.0:1651529344.454318:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+355:39030:x1731745946368000:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.454323:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177309 count 1 00010000:00010000:0.0:1651529344.454327:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c501e3 lrc: 3/0,1 mode: --/PW res: [0x2b49d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454331:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f372e4f0/0x3234de053c4e247 lrc: 2/0,0 mode: PR/PR res: [0x2b49d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a77 expref: 1704 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.454334:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.454334:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.454335:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.454336:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c501e3 lrc: 4/0,1 mode: --/PW res: [0x2b49d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.454349:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.454349:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f372e4f0/0x3234de053c4e247 lrc: 3/0,0 mode: PR/PR res: [0x2b49d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a77 expref: 1704 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.454353:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f372e4f0/0x3234de053c4e247 lrc: 4/0,0 mode: PR/PR res: [0x2b49d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a77 expref: 1704 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.454357:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996961856:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.454366:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c086aae3 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.454371:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8e23e2b/0x3234de053c501ce lrc: 2/0,0 mode: PW/PW res: [0x2b49a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454374:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f8e23e2b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.454375:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8e23e2b/0x3234de053c501ce lrc: 2/0,0 mode: PW/PW res: [0x2b49a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.454377:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.454378:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8e23e2b/0x3234de053c501ce lrc: 3/0,0 mode: PW/PW res: [0x2b49a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454383:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8e23e2b/0x3234de053c501ce lrc: 1/0,0 mode: --/PW res: [0x2b49a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454386:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8e23e2b/0x3234de053c501ce lrc: 0/0,0 mode: --/PW res: [0x2b49a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.454388:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.454390:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000431e46a9/0x3234de053c501d5 lrc: 2/0,0 mode: PW/PW res: [0x2b49b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454416:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000431e46a9 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.454417:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000431e46a9/0x3234de053c501d5 lrc: 2/0,0 mode: PW/PW res: [0x2b49b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.454418:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946368128 00010000:00010000:0.0:1651529344.454420:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000431e46a9/0x3234de053c501d5 lrc: 3/0,0 mode: PW/PW res: [0x2b49b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454424:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000431e46a9/0x3234de053c501d5 lrc: 1/0,0 mode: --/PW res: [0x2b49b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.454425:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946368064 00010000:00010000:0.0:1651529344.454426:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000431e46a9/0x3234de053c501d5 lrc: 0/0,0 mode: --/PW res: [0x2b49b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.454428:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946368256 00000100:00100000:1.0:1651529344.454432:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946368192 00000100:00100000:1.0:1651529344.454436:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210862 00000100:00100000:1.0:1651529344.454438:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+359:39030:x1731745946368128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.454438:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210863 00000100:00100000:0.0:1651529344.454440:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+359:39029:x1731745946368064:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.454443:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177311 count 1 00002000:00080000:0.0:1651529344.454446:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177310 count 1 00010000:00010000:1.0:1651529344.454447:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090c3576a/0x3234de053c501ea lrc: 3/0,1 mode: --/PW res: [0x2b49f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454449:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c501f1 lrc: 3/0,1 mode: --/PW res: [0x2b49e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.454452:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000025bdf1de/0x3234de053c4e208 lrc: 2/0,0 mode: PR/PR res: [0x2b49f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d394a expref: 1704 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.454455:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.454456:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.454457:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090c3576a/0x3234de053c501ea lrc: 4/0,1 mode: --/PW res: [0x2b49f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.454463:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000025bdf1de/0x3234de053c4e208 lrc: 3/0,0 mode: PR/PR res: [0x2b49f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d394a expref: 1704 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.454471:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d6df39da/0x3234de053c4d1d1 lrc: 2/0,0 mode: PR/PR res: [0x2b49e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf8f3 expref: 1704 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.454474:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000025bdf1de/0x3234de053c4e208 lrc: 4/0,0 mode: PR/PR res: [0x2b49f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d394a expref: 1704 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.454474:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.454474:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.454475:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c501f1 lrc: 4/0,1 mode: --/PW res: [0x2b49e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.454478:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dff6a73d pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996961920:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.454482:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d6df39da/0x3234de053c4d1d1 lrc: 3/0,0 mode: PR/PR res: [0x2b49e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf8f3 expref: 1704 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.454486:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d6df39da/0x3234de053c4d1d1 lrc: 4/0,0 mode: PR/PR res: [0x2b49e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf8f3 expref: 1704 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.454487:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000412e5d26 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.454490:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996961984:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.454494:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210864 00000100:00100000:1.0:1651529344.454495:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+359:39030:x1731745946368256:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.454499:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177313 count 1 00010000:00010000:1.0:1651529344.454503:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cd0c9be/0x3234de053c501f8 lrc: 3/0,1 mode: --/PW res: [0x2b4a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.454507:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002e85da3f/0x3234de053c4f05c lrc: 2/0,0 mode: PR/PR res: [0x2b4a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d744c expref: 1704 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.454510:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.454511:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.454511:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000cd0c9be/0x3234de053c501f8 lrc: 4/0,1 mode: --/PW res: [0x2b4a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.454520:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 000000000d706dff going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.454527:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002e85da3f/0x3234de053c4f05c lrc: 3/0,0 mode: PR/PR res: [0x2b4a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d744c expref: 1704 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.454528:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210865 00000100:00100000:0.0:1651529344.454530:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+359:39029:x1731745946368192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.454531:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002e85da3f/0x3234de053c4f05c lrc: 4/0,0 mode: PR/PR res: [0x2b4a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d744c expref: 1704 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.454535:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006e3eb319 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996962048:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.454542:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e5f43e7 going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.454549:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177312 count 1 00010000:00010000:0.0:1651529344.454554:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c151b720/0x3234de053c501ff lrc: 3/0,1 mode: --/PW res: [0x2b4a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.454558:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.454558:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c4f628 lrc: 2/0,0 mode: PR/PR res: [0x2b4a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b60 expref: 1704 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.454562:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.454562:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.454563:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c151b720/0x3234de053c501ff lrc: 4/0,1 mode: --/PW res: [0x2b4a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454569:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c4f628 lrc: 3/0,0 mode: PR/PR res: [0x2b4a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b60 expref: 1704 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.454573:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c4f628 lrc: 4/0,0 mode: PR/PR res: [0x2b4a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b60 expref: 1704 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.454585:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.454595:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996962112:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.454603:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a3b00cf3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.454610:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946368384 00000100:00100000:0.0:1651529344.454621:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946368448 00000100:00100000:1.0:1651529344.454623:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.454627:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210866 00000100:00100000:0.0:1651529344.454629:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+361:39029:x1731745946368384:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.454633:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177314 count 1 00010000:00010000:0.0:1651529344.454637:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c50206 lrc: 3/0,1 mode: --/PW res: [0x2b4a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454641:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b42ff306/0x3234de053c4d5c1 lrc: 2/0,0 mode: PR/PR res: [0x2b4a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0851 expref: 1704 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.454644:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.454645:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.454646:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c50206 lrc: 4/0,1 mode: --/PW res: [0x2b4a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454652:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b42ff306/0x3234de053c4d5c1 lrc: 3/0,0 mode: PR/PR res: [0x2b4a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0851 expref: 1704 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.454655:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b42ff306/0x3234de053c4d5c1 lrc: 4/0,0 mode: PR/PR res: [0x2b4a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0851 expref: 1704 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.454659:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210867 00000100:00100000:0.0:1651529344.454659:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996962176:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.454661:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+361:39029:x1731745946368448:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.454666:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177315 count 1 00000100:00100000:0.0:1651529344.454671:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000abca413e going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.454676:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c778ad9d/0x3234de053c5020d lrc: 3/0,1 mode: --/PW res: [0x2b4a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454676:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c501dc lrc: 3/0,1 mode: PW/PW res: [0x2b49c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454680:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c501dc lrc: 3/0,1 mode: PW/PW res: [0x2b49c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.454683:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f76e0566/0x3234de053c4d9db lrc: 2/0,0 mode: PR/PR res: [0x2b4a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d17e0 expref: 1704 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.454683:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c501dc lrc: 3/0,1 mode: PW/PW res: [0x2b49c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.454686:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.454687:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.454688:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c778ad9d/0x3234de053c5020d lrc: 4/0,1 mode: --/PW res: [0x2b4a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.454694:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f76e0566/0x3234de053c4d9db lrc: 3/0,0 mode: PR/PR res: [0x2b4a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d17e0 expref: 1704 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.454698:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f76e0566/0x3234de053c4d9db lrc: 4/0,0 mode: PR/PR res: [0x2b4a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d17e0 expref: 1704 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.454700:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c501dc lrc: 2/0,0 mode: PW/PW res: [0x2b49c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.454702:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001d1586f2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996962240:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.454710:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b52d0f36 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.454717:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396248960 00010000:00010000:1.0:1651529344.454721:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f372e4f0/0x3234de053c4e247 lrc: 5/0,0 mode: PR/PR res: [0x2b49d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a77 expref: 1705 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.454729:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11643 00000100:00100000:1.0:1651529344.454730:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1705:41278:x1731746396248960:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.454733:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.454743:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f372e4f0/0x3234de053c4e247 lrc: 5/0,0 mode: PR/PR res: [0x2b49d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a77 expref: 1705 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.454750:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f372e4f0/0x3234de053c4e247 lrc: 4/0,0 mode: PR/PR res: [0x2b49d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a77 expref: 1705 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.454751:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+362:39029:x1731745946367808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1268us (1291us total) trans 12885078915 rc 0/0 00000100:00100000:0.0:1651529344.454755:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210860 00010000:00010000:1.0:1651529344.454756:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.454756:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.454757:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c501e3 lrc: 3/0,1 mode: PW/PW res: [0x2b49d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.454760:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c501e3 lrc: 4/0,1 mode: PW/PW res: [0x2b49d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454762:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c501dc lrc: 2/0,0 mode: PW/PW res: [0x2b49c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.454765:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.454766:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c78576a1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.454767:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c501dc lrc: 2/0,0 mode: PW/PW res: [0x2b49c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454770:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c501dc lrc: 3/0,0 mode: PW/PW res: [0x2b49c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.454771:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1705:41278:x1731746396248960:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.454774:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11643 00010000:00010000:0.0:1651529344.454775:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c501dc lrc: 1/0,0 mode: --/PW res: [0x2b49c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454777:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c501dc lrc: 0/0,0 mode: --/PW res: [0x2b49c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454788:0:156655:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f372e4f0/0x3234de053c4e247 lrc: 0/0,0 mode: --/PR res: [0x2b49d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a77 expref: 1704 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.454792:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996961856:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.454796:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c501e3 lrc: 3/0,1 mode: PW/PW res: [0x2b49d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454799:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c501e3 lrc: 3/0,1 mode: PW/PW res: [0x2b49d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454802:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c501e3 lrc: 3/0,1 mode: PW/PW res: [0x2b49d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454805:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c501e3 lrc: 3/0,1 mode: PW/PW res: [0x2b49d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454807:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c501e3 lrc: 2/0,0 mode: PW/PW res: [0x2b49d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.454849:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+362:39030:x1731745946368000:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 530us (561us total) trans 12885078916 rc 0/0 00000100:00100000:0.0:1651529344.454852:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210861 00010000:00010000:0.0:1651529344.454858:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c501e3 lrc: 2/0,0 mode: PW/PW res: [0x2b49d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454862:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dcd3e2d1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.454863:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c501e3 lrc: 2/0,0 mode: PW/PW res: [0x2b49d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454866:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c501e3 lrc: 3/0,0 mode: PW/PW res: [0x2b49d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454870:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c501e3 lrc: 1/0,0 mode: --/PW res: [0x2b49d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.454873:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c501e3 lrc: 0/0,0 mode: --/PW res: [0x2b49d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.454945:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.454969:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946368832 00000100:00100000:1.0:1651529344.455001:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.455010:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.455024:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210868 00000100:00100000:0.0:1651529344.455025:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000021c6310b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+362:39029:x1731745946368832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.455029:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.455031:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177316 count 1 00000100:00100000:1.0:1651529344.455039:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.455040:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c50214 lrc: 3/0,1 mode: --/PW res: [0x2b4a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.455046:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.455063:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006f926d75/0x3234de053c4ca37 lrc: 2/0,0 mode: PR/PR res: [0x2b4a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda6f expref: 1703 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.455066:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.455071:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.455072:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c50214 lrc: 4/0,1 mode: --/PW res: [0x2b4a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455080:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006f926d75/0x3234de053c4ca37 lrc: 3/0,0 mode: PR/PR res: [0x2b4a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda6f expref: 1703 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.455083:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dff6a73d pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996961920:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.455084:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006f926d75/0x3234de053c4ca37 lrc: 4/0,0 mode: PR/PR res: [0x2b4a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda6f expref: 1703 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.455088:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000090c3576a/0x3234de053c501ea lrc: 3/0,1 mode: --/PW res: [0x2b49f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.455088:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996962304:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.455096:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006e3eb319 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996962048:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.455098:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000cd0c9be/0x3234de053c501f8 lrc: 3/0,1 mode: --/PW res: [0x2b4a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.455110:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396249088 00000100:00100000:0.0:1651529344.455114:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c086aae3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.455115:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002e85da3f/0x3234de053c4f05c lrc: 4/0,0 mode: PR/PR res: [0x2b4a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d744c expref: 1704 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.455120:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396249024 00010000:00010000:1.0:1651529344.455122:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000025bdf1de/0x3234de053c4e208 lrc: 4/0,0 mode: PR/PR res: [0x2b49f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d394a expref: 1705 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.455126:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396249152 00010000:00010000:1.0:1651529344.455128:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d6df39da/0x3234de053c4d1d1 lrc: 5/0,0 mode: PR/PR res: [0x2b49e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf8f3 expref: 1706 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.455132:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396249216 00000100:00100000:0.0:1651529344.455133:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996961984:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.455134:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c4f628 lrc: 5/0,0 mode: PR/PR res: [0x2b4a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b60 expref: 1707 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.455137:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c501f1 lrc: 3/0,1 mode: --/PW res: [0x2b49e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.455139:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11644 00000100:00100000:1.0:1651529344.455140:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000461918a5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1707:41279:x1731746396249088:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.455143:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.455144:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002e85da3f/0x3234de053c4f05c lrc: 4/0,0 mode: PR/PR res: [0x2b4a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d744c expref: 1707 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.455144:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996962112:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.455146:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c151b720/0x3234de053c501ff lrc: 3/0,1 mode: --/PW res: [0x2b4a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.455148:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002e85da3f/0x3234de053c4f05c lrc: 3/0,0 mode: PR/PR res: [0x2b4a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d744c expref: 1707 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.455152:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996962176:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.455154:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c50206 lrc: 3/0,1 mode: --/PW res: [0x2b4a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.455156:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e85da3f/0x3234de053c4f05c lrc: 0/0,0 mode: --/PR res: [0x2b4a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d744c expref: 1707 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.455160:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.455160:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.455161:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000cd0c9be/0x3234de053c501f8 lrc: 3/0,1 mode: PW/PW res: [0x2b4a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.455164:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000cd0c9be/0x3234de053c501f8 lrc: 4/0,1 mode: PW/PW res: [0x2b4a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.455170:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.455172:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11645 00000100:00100000:0.0:1651529344.455174:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1706:41279:x1731746396249024:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.455177:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000461918a5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1706:41279:x1731746396249088:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (176us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.455177:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.455179:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000025bdf1de/0x3234de053c4e208 lrc: 4/0,0 mode: PR/PR res: [0x2b49f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d394a expref: 1706 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.455180:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11644 00010000:00010000:0.0:1651529344.455183:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000025bdf1de/0x3234de053c4e208 lrc: 3/0,0 mode: PR/PR res: [0x2b49f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d394a expref: 1705 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.455188:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11646 00010000:00010000:0.0:1651529344.455188:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025bdf1de/0x3234de053c4e208 lrc: 0/0,0 mode: --/PR res: [0x2b49f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d394a expref: 1705 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.455189:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1705:41279:x1731746396249152:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.455192:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.455192:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.455192:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.455193:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d6df39da/0x3234de053c4d1d1 lrc: 4/0,0 mode: PR/PR res: [0x2b49e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf8f3 expref: 1704 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.455193:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000090c3576a/0x3234de053c501ea lrc: 3/0,1 mode: PW/PW res: [0x2b49f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455196:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090c3576a/0x3234de053c501ea lrc: 4/0,1 mode: PW/PW res: [0x2b49f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.455197:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d6df39da/0x3234de053c4d1d1 lrc: 3/0,0 mode: PR/PR res: [0x2b49e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf8f3 expref: 1704 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.455201:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6df39da/0x3234de053c4d1d1 lrc: 0/0,0 mode: --/PR res: [0x2b49e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf8f3 expref: 1704 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.455206:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.455213:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1704:41279:x1731746396249024:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 39us (203us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.455215:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.455216:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.455216:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c501f1 lrc: 3/0,1 mode: PW/PW res: [0x2b49e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.455216:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11645 00010000:00010000:1.0:1651529344.455219:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c501f1 lrc: 4/0,1 mode: PW/PW res: [0x2b49e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.455239:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11647 00010000:00010000:1.0:1651529344.455241:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.455245:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ea32140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1702:41279:x1731746396249216:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.455247:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1702:41279:x1731746396249152:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 57us (208us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.455248:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.455250:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11646 00010000:00010000:0.0:1651529344.455250:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c4f628 lrc: 4/0,0 mode: PR/PR res: [0x2b4a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b60 expref: 1702 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.455254:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c4f628 lrc: 3/0,0 mode: PR/PR res: [0x2b4a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b60 expref: 1701 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.455256:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000cd0c9be/0x3234de053c501f8 lrc: 3/0,1 mode: PW/PW res: [0x2b4a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455259:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c4f628 lrc: 0/0,0 mode: --/PR res: [0x2b4a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b60 expref: 1701 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.455260:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000cd0c9be/0x3234de053c501f8 lrc: 3/0,1 mode: PW/PW res: [0x2b4a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455262:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.455263:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cd0c9be/0x3234de053c501f8 lrc: 3/0,1 mode: PW/PW res: [0x2b4a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455263:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.455264:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c151b720/0x3234de053c501ff lrc: 3/0,1 mode: PW/PW res: [0x2b4a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.455265:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000cd0c9be/0x3234de053c501f8 lrc: 2/0,0 mode: PW/PW res: [0x2b4a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455267:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c151b720/0x3234de053c501ff lrc: 4/0,1 mode: PW/PW res: [0x2b4a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455279:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.455286:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ea32140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1700:41279:x1731746396249216:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 40us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.455288:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11647 00010000:00010000:0.0:1651529344.455297:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000cd0c9be/0x3234de053c501f8 lrc: 2/0,0 mode: PW/PW res: [0x2b4a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455301:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000cd0c9be already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.455302:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000cd0c9be/0x3234de053c501f8 lrc: 2/0,0 mode: PW/PW res: [0x2b4a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455305:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000cd0c9be/0x3234de053c501f8 lrc: 3/0,0 mode: PW/PW res: [0x2b4a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.455307:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+363:39030:x1731745946368256:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 811us (930us total) trans 12885078917 rc 0/0 00010000:00010000:0.0:1651529344.455309:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000cd0c9be/0x3234de053c501f8 lrc: 1/0,0 mode: --/PW res: [0x2b4a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.455310:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210864 00010000:00010000:0.0:1651529344.455312:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000cd0c9be/0x3234de053c501f8 lrc: 0/0,0 mode: --/PW res: [0x2b4a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.455315:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946368896 00010000:00010000:0.0:1651529344.455317:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c501f1 lrc: 3/0,1 mode: PW/PW res: [0x2b49e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455320:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c501f1 lrc: 3/0,1 mode: PW/PW res: [0x2b49e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.455322:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210869 00010000:00010000:0.0:1651529344.455323:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c501f1 lrc: 3/0,1 mode: PW/PW res: [0x2b49e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.455324:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+363:39029:x1731745946368896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.455326:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c501f1 lrc: 2/0,0 mode: PW/PW res: [0x2b49e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.455328:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177317 count 1 00010000:00010000:1.0:1651529344.455333:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005264ec88/0x3234de053c5021b lrc: 3/0,1 mode: --/PW res: [0x2b4a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.455337:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000059d45c45/0x3234de053c4edd8 lrc: 2/0,0 mode: PR/PR res: [0x2b4a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d69a2 expref: 1699 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.455340:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.455341:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.455342:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005264ec88/0x3234de053c5021b lrc: 4/0,1 mode: --/PW res: [0x2b4a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.455348:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000059d45c45/0x3234de053c4edd8 lrc: 3/0,0 mode: PR/PR res: [0x2b4a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d69a2 expref: 1699 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.455351:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000059d45c45/0x3234de053c4edd8 lrc: 4/0,0 mode: PR/PR res: [0x2b4a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d69a2 expref: 1699 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.455355:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007fca8239 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996962368:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.455364:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+364:39029:x1731745946368064:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 923us (1015us total) trans 12885078918 rc 0/0 00000100:00100000:1.0:1651529344.455365:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 0000000089d75f07 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.455367:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210863 00010000:00010000:1.0:1651529344.455370:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000090c3576a/0x3234de053c501ea lrc: 3/0,1 mode: PW/PW res: [0x2b49f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.455374:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090c3576a/0x3234de053c501ea lrc: 3/0,1 mode: PW/PW res: [0x2b49f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455374:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c501f1 lrc: 2/0,0 mode: PW/PW res: [0x2b49e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455377:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002dcd6c4b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.455378:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c501f1 lrc: 2/0,0 mode: PW/PW res: [0x2b49e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.455379:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090c3576a/0x3234de053c501ea lrc: 3/0,1 mode: PW/PW res: [0x2b49f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455381:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c501f1 lrc: 3/0,0 mode: PW/PW res: [0x2b49e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.455382:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090c3576a/0x3234de053c501ea lrc: 2/0,0 mode: PW/PW res: [0x2b49f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455385:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c501f1 lrc: 1/0,0 mode: --/PW res: [0x2b49e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455388:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002dcd6c4b/0x3234de053c501f1 lrc: 0/0,0 mode: --/PW res: [0x2b49e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455400:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090c3576a/0x3234de053c501ea lrc: 2/0,0 mode: PW/PW res: [0x2b49f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455403:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000090c3576a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.455404:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090c3576a/0x3234de053c501ea lrc: 2/0,0 mode: PW/PW res: [0x2b49f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455406:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090c3576a/0x3234de053c501ea lrc: 3/0,0 mode: PW/PW res: [0x2b49f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455410:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090c3576a/0x3234de053c501ea lrc: 1/0,0 mode: --/PW res: [0x2b49f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455412:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090c3576a/0x3234de053c501ea lrc: 0/0,0 mode: --/PW res: [0x2b49f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455418:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c151b720/0x3234de053c501ff lrc: 3/0,1 mode: PW/PW res: [0x2b4a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455421:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c151b720/0x3234de053c501ff lrc: 3/0,1 mode: PW/PW res: [0x2b4a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.455424:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+364:39030:x1731745946368128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 985us (1095us total) trans 12885078919 rc 0/0 00010000:00010000:0.0:1651529344.455424:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c151b720/0x3234de053c501ff lrc: 3/0,1 mode: PW/PW res: [0x2b4a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.455427:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210862 00010000:00010000:0.0:1651529344.455427:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c151b720/0x3234de053c501ff lrc: 2/0,0 mode: PW/PW res: [0x2b4a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.455443:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.455475:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+364:39029:x1731745946368192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 945us (1087us total) trans 12885078920 rc 0/0 00000100:00100000:0.0:1651529344.455479:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210865 00010000:00010000:0.0:1651529344.455485:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c151b720/0x3234de053c501ff lrc: 2/0,0 mode: PW/PW res: [0x2b4a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455489:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c151b720 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.455489:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c151b720/0x3234de053c501ff lrc: 2/0,0 mode: PW/PW res: [0x2b4a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455492:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c151b720/0x3234de053c501ff lrc: 3/0,0 mode: PW/PW res: [0x2b4a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.455493:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.455503:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c151b720/0x3234de053c501ff lrc: 1/0,0 mode: --/PW res: [0x2b4a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455506:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c151b720/0x3234de053c501ff lrc: 0/0,0 mode: --/PW res: [0x2b4a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.455515:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396249280 00010000:00010000:0.0:1651529344.455519:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b42ff306/0x3234de053c4d5c1 lrc: 4/0,0 mode: PR/PR res: [0x2b4a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0851 expref: 1700 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.455529:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396249408 00010000:00010000:0.0:1651529344.455532:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f76e0566/0x3234de053c4d9db lrc: 5/0,0 mode: PR/PR res: [0x2b4a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d17e0 expref: 1701 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.455537:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11648 00000100:00100000:0.0:1651529344.455539:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfc79d4e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1701:41279:x1731746396249280:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.455542:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.455543:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b42ff306/0x3234de053c4d5c1 lrc: 4/0,0 mode: PR/PR res: [0x2b4a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0851 expref: 1701 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.455547:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b42ff306/0x3234de053c4d5c1 lrc: 3/0,0 mode: PR/PR res: [0x2b4a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0851 expref: 1701 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.455551:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b42ff306/0x3234de053c4d5c1 lrc: 0/0,0 mode: --/PR res: [0x2b4a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0851 expref: 1701 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.455554:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.455555:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.455556:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c50206 lrc: 3/0,1 mode: PW/PW res: [0x2b4a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455559:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c50206 lrc: 4/0,1 mode: PW/PW res: [0x2b4a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455566:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.455577:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfc79d4e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1700:41279:x1731746396249280:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.455584:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001d1586f2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996962240:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.455588:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c778ad9d/0x3234de053c5020d lrc: 3/0,1 mode: --/PW res: [0x2b4a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.455594:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11648 00000100:00100000:1.0:1651529344.455596:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11649 00000100:00100000:1.0:1651529344.455598:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005914c920 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1699:41279:x1731746396249408:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.455602:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.455603:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f76e0566/0x3234de053c4d9db lrc: 4/0,0 mode: PR/PR res: [0x2b4a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d17e0 expref: 1699 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.455607:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f76e0566/0x3234de053c4d9db lrc: 3/0,0 mode: PR/PR res: [0x2b4a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d17e0 expref: 1699 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.455613:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c50206 lrc: 3/0,1 mode: PW/PW res: [0x2b4a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.455615:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f76e0566/0x3234de053c4d9db lrc: 0/0,0 mode: --/PR res: [0x2b4a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d17e0 expref: 1699 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.455617:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c50206 lrc: 3/0,1 mode: PW/PW res: [0x2b4a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.455618:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.455619:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.455620:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c778ad9d/0x3234de053c5020d lrc: 3/0,1 mode: PW/PW res: [0x2b4a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455620:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c50206 lrc: 3/0,1 mode: PW/PW res: [0x2b4a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455622:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c50206 lrc: 2/0,0 mode: PW/PW res: [0x2b4a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.455623:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c778ad9d/0x3234de053c5020d lrc: 4/0,1 mode: PW/PW res: [0x2b4a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.455629:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.455635:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005914c920 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1698:41279:x1731746396249408:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 36us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.455638:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11649 00010000:00010000:1.0:1651529344.455644:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c778ad9d/0x3234de053c5020d lrc: 3/0,1 mode: PW/PW res: [0x2b4a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.455647:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c778ad9d/0x3234de053c5020d lrc: 3/0,1 mode: PW/PW res: [0x2b4a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.455650:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c778ad9d/0x3234de053c5020d lrc: 3/0,1 mode: PW/PW res: [0x2b4a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.455653:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c778ad9d/0x3234de053c5020d lrc: 2/0,0 mode: PW/PW res: [0x2b4a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.455660:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+364:39029:x1731745946368384:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1030us (1101us total) trans 12885078921 rc 0/0 00000100:00100000:0.0:1651529344.455670:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210866 00010000:00010000:0.0:1651529344.455677:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c50206 lrc: 2/0,0 mode: PW/PW res: [0x2b4a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455693:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000594a1223 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.455695:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c50206 lrc: 2/0,0 mode: PW/PW res: [0x2b4a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455698:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c50206 lrc: 3/0,0 mode: PW/PW res: [0x2b4a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.455700:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+364:39029:x1731745946368448:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1038us (1115us total) trans 12885078922 rc 0/0 00010000:00010000:0.0:1651529344.455702:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c50206 lrc: 1/0,0 mode: --/PW res: [0x2b4a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.455703:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210867 00010000:00010000:0.0:1651529344.455715:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000594a1223/0x3234de053c50206 lrc: 0/0,0 mode: --/PW res: [0x2b4a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455720:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c778ad9d/0x3234de053c5020d lrc: 2/0,0 mode: PW/PW res: [0x2b4a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455723:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c778ad9d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.455724:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c778ad9d/0x3234de053c5020d lrc: 2/0,0 mode: PW/PW res: [0x2b4a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455726:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c778ad9d/0x3234de053c5020d lrc: 3/0,0 mode: PW/PW res: [0x2b4a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455730:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c778ad9d/0x3234de053c5020d lrc: 1/0,0 mode: --/PW res: [0x2b4a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455733:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c778ad9d/0x3234de053c5020d lrc: 0/0,0 mode: --/PW res: [0x2b4a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.455746:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.455761:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.455771:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946369024 00000100:00100000:1.0:1651529344.455775:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.455784:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946368960 00000100:00100000:0.0:1651529344.455804:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946369152 00000100:00100000:0.0:1651529344.455813:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210870 00000100:00100000:1.0:1651529344.455815:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.455815:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+366:39030:x1731745946369024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.455826:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177319 count 1 00010000:00010000:0.0:1651529344.455830:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000027a1488/0x3234de053c50222 lrc: 3/0,1 mode: --/PW res: [0x2b4a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455835:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c4cf69 lrc: 2/0,0 mode: PR/PR res: [0x2b4a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef37 expref: 1697 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.455838:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.455838:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.455839:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000027a1488/0x3234de053c50222 lrc: 4/0,1 mode: --/PW res: [0x2b4a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455845:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c4cf69 lrc: 3/0,0 mode: PR/PR res: [0x2b4a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef37 expref: 1697 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.455855:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c4cf69 lrc: 4/0,0 mode: PR/PR res: [0x2b4a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef37 expref: 1697 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.455859:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.455859:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996962432:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.455869:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.455874:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed830649 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.455880:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946369088 00000100:00100000:0.0:1651529344.455891:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210871 00000100:00100000:0.0:1651529344.455892:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+367:39029:x1731745946368960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.455897:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177318 count 1 00010000:00010000:0.0:1651529344.455900:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de1a14c6/0x3234de053c50229 lrc: 3/0,1 mode: --/PW res: [0x2b4a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.455904:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210872 00010000:00010000:0.0:1651529344.455905:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000033aa1808/0x3234de053c4ef44 lrc: 2/0,0 mode: PR/PR res: [0x2b4a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f0c expref: 1697 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.455906:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+367:39030:x1731745946369152:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.455908:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.455909:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.455909:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de1a14c6/0x3234de053c50229 lrc: 4/0,1 mode: --/PW res: [0x2b4a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.455912:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177321 count 1 00010000:00010000:0.0:1651529344.455915:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000033aa1808/0x3234de053c4ef44 lrc: 3/0,0 mode: PR/PR res: [0x2b4a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f0c expref: 1697 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.455916:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c88eeba2/0x3234de053c50230 lrc: 3/0,1 mode: --/PW res: [0x2b4a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.455918:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000033aa1808/0x3234de053c4ef44 lrc: 4/0,0 mode: PR/PR res: [0x2b4a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f0c expref: 1697 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.455921:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000023b8edfa/0x3234de053c4c87e lrc: 2/0,0 mode: PR/PR res: [0x2b4a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd3ca expref: 1697 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.455922:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996962496:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.455924:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.455925:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.455925:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c88eeba2/0x3234de053c50230 lrc: 4/0,1 mode: --/PW res: [0x2b4a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.455934:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 000000003c8b0daf going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.455938:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000023b8edfa/0x3234de053c4c87e lrc: 3/0,0 mode: PR/PR res: [0x2b4a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd3ca expref: 1697 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.455945:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000023b8edfa/0x3234de053c4c87e lrc: 4/0,0 mode: PR/PR res: [0x2b4a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd3ca expref: 1697 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.455950:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000057329b82 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996962560:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.455958:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b52d0f36 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.455960:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210873 00000100:00100000:0.0:1651529344.455962:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+367:39029:x1731745946369088:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.455967:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007fca8239 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996962368:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.455967:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177320 count 1 00010000:00010000:0.0:1651529344.455970:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007f5d689/0x3234de053c50237 lrc: 3/0,1 mode: --/PW res: [0x2b4a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.455971:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005264ec88/0x3234de053c5021b lrc: 3/0,1 mode: --/PW res: [0x2b4a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.455978:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396249920 00010000:00010000:1.0:1651529344.455982:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006f926d75/0x3234de053c4ca37 lrc: 5/0,0 mode: PR/PR res: [0x2b4a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda6f expref: 1698 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.455985:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c4e699 lrc: 2/0,0 mode: PR/PR res: [0x2b4a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4ae6 expref: 1698 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.455989:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396249984 00010000:00010000:1.0:1651529344.455991:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000059d45c45/0x3234de053c4edd8 lrc: 4/0,0 mode: PR/PR res: [0x2b4a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d69a2 expref: 1699 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.455991:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.455992:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.455993:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007f5d689/0x3234de053c50237 lrc: 4/0,1 mode: --/PW res: [0x2b4a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.456002:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11650 00000100:00100000:1.0:1651529344.456003:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1699:41278:x1731746396249920:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.456006:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.456006:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c4e699 lrc: 3/0,0 mode: PR/PR res: [0x2b4a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4ae6 expref: 1699 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.456007:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006f926d75/0x3234de053c4ca37 lrc: 5/0,0 mode: PR/PR res: [0x2b4a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda6f expref: 1699 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.456009:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c4e699 lrc: 4/0,0 mode: PR/PR res: [0x2b4a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4ae6 expref: 1699 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.456011:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006f926d75/0x3234de053c4ca37 lrc: 4/0,0 mode: PR/PR res: [0x2b4a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda6f expref: 1699 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.456014:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996962624:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.456017:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.456018:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.456019:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c50214 lrc: 3/0,1 mode: PW/PW res: [0x2b4a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.456022:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c50214 lrc: 4/0,1 mode: PW/PW res: [0x2b4a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.456022:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e7e12492 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.456026:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.456029:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11651 00000100:00100000:0.0:1651529344.456031:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f53a84c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1699:41279:x1731746396249984:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.456033:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1699:41278:x1731746396249920:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 29us (174us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.456033:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.456035:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11650 00010000:00010000:0.0:1651529344.456047:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000059d45c45/0x3234de053c4edd8 lrc: 4/0,0 mode: PR/PR res: [0x2b4a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d69a2 expref: 1699 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.456052:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000059d45c45/0x3234de053c4edd8 lrc: 3/0,0 mode: PR/PR res: [0x2b4a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d69a2 expref: 1698 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.456057:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059d45c45/0x3234de053c4edd8 lrc: 0/0,0 mode: --/PR res: [0x2b4a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d69a2 expref: 1698 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.456064:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.456064:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.456065:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005264ec88/0x3234de053c5021b lrc: 3/0,1 mode: PW/PW res: [0x2b4a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456068:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005264ec88/0x3234de053c5021b lrc: 4/0,1 mode: PW/PW res: [0x2b4a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.456069:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.456078:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.456085:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f53a84c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1697:41279:x1731746396249984:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 53us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.456087:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11651 00000100:00100000:1.0:1651529344.456102:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.456113:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996962432:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.456117:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000027a1488/0x3234de053c50222 lrc: 3/0,1 mode: --/PW res: [0x2b4a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.456118:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.456130:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946369216 00000100:00100000:0.0:1651529344.456138:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946369280 00000100:00100000:0.0:1651529344.456142:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210874 00000100:00100000:0.0:1651529344.456144:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+369:39029:x1731745946369216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.456149:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177322 count 1 00010000:00010000:0.0:1651529344.456153:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089368d5b/0x3234de053c5023e lrc: 3/0,1 mode: --/PW res: [0x2b4aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456157:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c4e6b5 lrc: 2/0,0 mode: PR/PR res: [0x2b4aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b6b expref: 1696 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.456163:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.456163:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.456164:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089368d5b/0x3234de053c5023e lrc: 4/0,1 mode: --/PW res: [0x2b4aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456170:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c4e6b5 lrc: 3/0,0 mode: PR/PR res: [0x2b4aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b6b expref: 1696 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.456173:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c4e6b5 lrc: 4/0,0 mode: PR/PR res: [0x2b4aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b6b expref: 1696 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.456175:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210875 00000100:00100000:1.0:1651529344.456177:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+369:39030:x1731745946369280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.456177:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996962688:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.456182:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177323 count 1 00010000:00010000:1.0:1651529344.456187:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040de33f8/0x3234de053c50245 lrc: 3/0,1 mode: --/PW res: [0x2b4ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.456190:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aac87b31 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.456196:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396250048 00010000:00010000:1.0:1651529344.456197:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000aab15112/0x3234de053c4ebfc lrc: 2/0,0 mode: PR/PR res: [0x2b4ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6183 expref: 1696 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.456200:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.456201:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.456202:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040de33f8/0x3234de053c50245 lrc: 4/0,1 mode: --/PW res: [0x2b4ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.456209:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000aab15112/0x3234de053c4ebfc lrc: 3/0,0 mode: PR/PR res: [0x2b4ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6183 expref: 1696 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.456213:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000aab15112/0x3234de053c4ebfc lrc: 4/0,0 mode: PR/PR res: [0x2b4ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6183 expref: 1697 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.456215:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c4cf69 lrc: 4/0,0 mode: PR/PR res: [0x2b4a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef37 expref: 1697 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.456217:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000075b025a pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996962752:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.456245:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 0000000089d75f07 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.456245:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11652 00000100:00100000:0.0:1651529344.456247:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1697:41279:x1731746396250048:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.456250:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005264ec88/0x3234de053c5021b lrc: 3/0,1 mode: PW/PW res: [0x2b4a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456250:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.456252:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c4cf69 lrc: 4/0,0 mode: PR/PR res: [0x2b4a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef37 expref: 1697 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.456254:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005264ec88/0x3234de053c5021b lrc: 3/0,1 mode: PW/PW res: [0x2b4a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456256:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c4cf69 lrc: 3/0,0 mode: PR/PR res: [0x2b4a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef37 expref: 1697 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.456257:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005264ec88/0x3234de053c5021b lrc: 3/0,1 mode: PW/PW res: [0x2b4a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.456259:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005264ec88/0x3234de053c5021b lrc: 2/0,0 mode: PW/PW res: [0x2b4a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456264:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c4cf69 lrc: 0/0,0 mode: --/PR res: [0x2b4a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef37 expref: 1697 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.456284:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.456285:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.456286:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000027a1488/0x3234de053c50222 lrc: 3/0,1 mode: PW/PW res: [0x2b4a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456289:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000027a1488/0x3234de053c50222 lrc: 4/0,1 mode: PW/PW res: [0x2b4a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456296:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.456301:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+370:39029:x1731745946368896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 976us (1272us total) trans 12885078923 rc 0/0 00000100:00100000:1.0:1651529344.456304:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210869 00000100:00100000:0.0:1651529344.456304:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1696:41279:x1731746396250048:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 56us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.456306:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11652 00010000:00010000:0.0:1651529344.456313:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005264ec88/0x3234de053c5021b lrc: 2/0,0 mode: PW/PW res: [0x2b4a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456332:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005264ec88 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.456333:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005264ec88/0x3234de053c5021b lrc: 2/0,0 mode: PW/PW res: [0x2b4a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456336:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005264ec88/0x3234de053c5021b lrc: 3/0,0 mode: PW/PW res: [0x2b4a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456341:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005264ec88/0x3234de053c5021b lrc: 1/0,0 mode: --/PW res: [0x2b4a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456346:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005264ec88/0x3234de053c5021b lrc: 0/0,0 mode: --/PW res: [0x2b4a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.456365:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996962496:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.456368:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000de1a14c6/0x3234de053c50229 lrc: 3/0,1 mode: --/PW res: [0x2b4a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456373:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000027a1488/0x3234de053c50222 lrc: 3/0,1 mode: PW/PW res: [0x2b4a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456376:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000027a1488/0x3234de053c50222 lrc: 3/0,1 mode: PW/PW res: [0x2b4a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456380:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000027a1488/0x3234de053c50222 lrc: 3/0,1 mode: PW/PW res: [0x2b4a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456382:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000027a1488/0x3234de053c50222 lrc: 2/0,0 mode: PW/PW res: [0x2b4a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.456417:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000057329b82 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996962560:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.456421:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c88eeba2/0x3234de053c50230 lrc: 3/0,1 mode: --/PW res: [0x2b4a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.456433:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+370:39030:x1731745946369024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 617us (687us total) trans 12885078924 rc 0/0 00000100:00100000:0.0:1651529344.456436:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210870 00010000:00010000:0.0:1651529344.456443:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000027a1488/0x3234de053c50222 lrc: 2/0,0 mode: PW/PW res: [0x2b4a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456447:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000027a1488 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.456448:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000027a1488/0x3234de053c50222 lrc: 2/0,0 mode: PW/PW res: [0x2b4a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456451:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000027a1488/0x3234de053c50222 lrc: 3/0,0 mode: PW/PW res: [0x2b4a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456455:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000027a1488/0x3234de053c50222 lrc: 1/0,0 mode: --/PW res: [0x2b4a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456458:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000027a1488/0x3234de053c50222 lrc: 0/0,0 mode: --/PW res: [0x2b4a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.456467:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996962624:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.456471:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000007f5d689/0x3234de053c50237 lrc: 3/0,1 mode: --/PW res: [0x2b4a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456478:0:156655:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f926d75/0x3234de053c4ca37 lrc: 0/0,0 mode: --/PR res: [0x2b4a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda6f expref: 1695 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.456482:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996962304:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.456501:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c50214 lrc: 3/0,1 mode: PW/PW res: [0x2b4a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456519:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c50214 lrc: 3/0,1 mode: PW/PW res: [0x2b4a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456529:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c50214 lrc: 3/0,1 mode: PW/PW res: [0x2b4a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456533:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c50214 lrc: 3/0,1 mode: PW/PW res: [0x2b4a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456536:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c50214 lrc: 2/0,0 mode: PW/PW res: [0x2b4a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.456539:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.456549:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.456556:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.456576:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000075b025a pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996962752:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.456580:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000040de33f8/0x3234de053c50245 lrc: 3/0,1 mode: --/PW res: [0x2b4ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.456592:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396250176 00010000:00010000:1.0:1651529344.456597:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000023b8edfa/0x3234de053c4c87e lrc: 4/0,0 mode: PR/PR res: [0x2b4a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd3ca expref: 1695 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.456604:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396250112 00010000:00010000:1.0:1651529344.456611:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000033aa1808/0x3234de053c4ef44 lrc: 4/0,0 mode: PR/PR res: [0x2b4a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f0c expref: 1696 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.456616:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396250240 00010000:00010000:1.0:1651529344.456618:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c4e699 lrc: 4/0,0 mode: PR/PR res: [0x2b4a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4ae6 expref: 1697 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.456620:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000021c6310b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+370:39029:x1731745946368832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1582us (1664us total) trans 12885078925 rc 0/0 00000100:00100000:1.0:1651529344.456623:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11653 00000100:00100000:0.0:1651529344.456623:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210868 00000100:00100000:1.0:1651529344.456625:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1697:41278:x1731746396250176:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.456627:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.456629:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000023b8edfa/0x3234de053c4c87e lrc: 4/0,0 mode: PR/PR res: [0x2b4a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd3ca expref: 1697 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.456635:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000023b8edfa/0x3234de053c4c87e lrc: 3/0,0 mode: PR/PR res: [0x2b4a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd3ca expref: 1697 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.456640:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023b8edfa/0x3234de053c4c87e lrc: 0/0,0 mode: --/PR res: [0x2b4a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd3ca expref: 1697 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.456644:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.456645:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.456645:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c88eeba2/0x3234de053c50230 lrc: 3/0,1 mode: PW/PW res: [0x2b4a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.456649:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c88eeba2/0x3234de053c50230 lrc: 4/0,1 mode: PW/PW res: [0x2b4a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.456655:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.456655:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c50214 lrc: 2/0,0 mode: PW/PW res: [0x2b4a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456659:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000009c5cbe9 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.456660:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c50214 lrc: 2/0,0 mode: PW/PW res: [0x2b4a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.456661:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1696:41278:x1731746396250176:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (123us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.456663:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c50214 lrc: 3/0,0 mode: PW/PW res: [0x2b4a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.456664:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11653 00000100:00100000:1.0:1651529344.456668:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11654 00010000:00010000:0.0:1651529344.456668:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c50214 lrc: 1/0,0 mode: --/PW res: [0x2b4a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.456670:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ea32140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1695:41279:x1731746396250112:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.456670:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c50214 lrc: 0/0,0 mode: --/PW res: [0x2b4a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.456672:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.456673:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000033aa1808/0x3234de053c4ef44 lrc: 4/0,0 mode: PR/PR res: [0x2b4a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f0c expref: 1695 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.456677:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000033aa1808/0x3234de053c4ef44 lrc: 3/0,0 mode: PR/PR res: [0x2b4a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f0c expref: 1695 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.456681:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033aa1808/0x3234de053c4ef44 lrc: 0/0,0 mode: --/PR res: [0x2b4a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f0c expref: 1695 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.456681:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996962688:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.456684:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000089368d5b/0x3234de053c5023e lrc: 3/0,1 mode: --/PW res: [0x2b4aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.456685:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.456685:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.456686:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000de1a14c6/0x3234de053c50229 lrc: 3/0,1 mode: PW/PW res: [0x2b4a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.456689:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de1a14c6/0x3234de053c50229 lrc: 4/0,1 mode: PW/PW res: [0x2b4a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.456691:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11655 00000100:00100000:0.0:1651529344.456693:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfc79d4e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1694:41279:x1731746396250240:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.456699:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.456703:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.456704:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ea32140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1694:41279:x1731746396250112:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (154us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.456705:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c4e699 lrc: 4/0,0 mode: PR/PR res: [0x2b4a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4ae6 expref: 1694 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.456706:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11654 00010000:00010000:0.0:1651529344.456709:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c4e699 lrc: 3/0,0 mode: PR/PR res: [0x2b4a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4ae6 expref: 1693 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.456712:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c88eeba2/0x3234de053c50230 lrc: 3/0,1 mode: PW/PW res: [0x2b4a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456714:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c4e699 lrc: 0/0,0 mode: --/PR res: [0x2b4a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4ae6 expref: 1693 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.456715:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c88eeba2/0x3234de053c50230 lrc: 3/0,1 mode: PW/PW res: [0x2b4a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456717:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.456718:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c88eeba2/0x3234de053c50230 lrc: 3/0,1 mode: PW/PW res: [0x2b4a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456718:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.456719:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000007f5d689/0x3234de053c50237 lrc: 3/0,1 mode: PW/PW res: [0x2b4a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.456721:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c88eeba2/0x3234de053c50230 lrc: 2/0,0 mode: PW/PW res: [0x2b4a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456722:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007f5d689/0x3234de053c50237 lrc: 4/0,1 mode: PW/PW res: [0x2b4a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456728:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.456749:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfc79d4e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1692:41279:x1731746396250240:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 55us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.456752:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11655 00010000:00010000:0.0:1651529344.456759:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c88eeba2/0x3234de053c50230 lrc: 2/0,0 mode: PW/PW res: [0x2b4a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456762:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c88eeba2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.456763:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c88eeba2/0x3234de053c50230 lrc: 2/0,0 mode: PW/PW res: [0x2b4a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456766:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c88eeba2/0x3234de053c50230 lrc: 3/0,0 mode: PW/PW res: [0x2b4a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456770:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c88eeba2/0x3234de053c50230 lrc: 1/0,0 mode: --/PW res: [0x2b4a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.456771:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+370:39030:x1731745946369152:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 865us (996us total) trans 12885078926 rc 0/0 00010000:00010000:0.0:1651529344.456773:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c88eeba2/0x3234de053c50230 lrc: 0/0,0 mode: --/PW res: [0x2b4a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.456775:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210872 00010000:00010000:0.0:1651529344.456779:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000de1a14c6/0x3234de053c50229 lrc: 3/0,1 mode: PW/PW res: [0x2b4a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456782:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de1a14c6/0x3234de053c50229 lrc: 3/0,1 mode: PW/PW res: [0x2b4a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456785:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de1a14c6/0x3234de053c50229 lrc: 3/0,1 mode: PW/PW res: [0x2b4a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456787:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de1a14c6/0x3234de053c50229 lrc: 2/0,0 mode: PW/PW res: [0x2b4a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.456790:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.456817:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.456825:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+370:39029:x1731745946368960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 931us (1064us total) trans 12885078927 rc 0/0 00000100:00100000:0.0:1651529344.456828:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210871 00000100:00100000:0.0:1651529344.456833:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946369856 00000100:00100000:0.0:1651529344.456840:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210876 00000100:00100000:0.0:1651529344.456841:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007fca8239 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+370:39029:x1731745946369856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.456846:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177324 count 1 00000100:00100000:1.0:1651529344.456847:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.456850:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088993906/0x3234de053c5024c lrc: 3/0,1 mode: --/PW res: [0x2b4ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456862:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006c1791d6/0x3234de053c4dbe8 lrc: 2/0,0 mode: PR/PR res: [0x2b4ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1fb2 expref: 1691 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.456866:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.456866:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.456867:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088993906/0x3234de053c5024c lrc: 4/0,1 mode: --/PW res: [0x2b4ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.456869:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.456879:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006c1791d6/0x3234de053c4dbe8 lrc: 3/0,0 mode: PR/PR res: [0x2b4ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1fb2 expref: 1691 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.456882:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006c1791d6/0x3234de053c4dbe8 lrc: 4/0,0 mode: PR/PR res: [0x2b4ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1fb2 expref: 1691 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.456886:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996962816:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.456895:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aac87b31 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.456900:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de1a14c6/0x3234de053c50229 lrc: 2/0,0 mode: PW/PW res: [0x2b4a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456905:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000de1a14c6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.456906:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de1a14c6/0x3234de053c50229 lrc: 2/0,0 mode: PW/PW res: [0x2b4a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456909:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de1a14c6/0x3234de053c50229 lrc: 3/0,0 mode: PW/PW res: [0x2b4a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456913:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de1a14c6/0x3234de053c50229 lrc: 1/0,0 mode: --/PW res: [0x2b4a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456916:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de1a14c6/0x3234de053c50229 lrc: 0/0,0 mode: --/PW res: [0x2b4a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456922:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000007f5d689/0x3234de053c50237 lrc: 3/0,1 mode: PW/PW res: [0x2b4a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.456924:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946369920 00010000:00010000:0.0:1651529344.456924:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007f5d689/0x3234de053c50237 lrc: 3/0,1 mode: PW/PW res: [0x2b4a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.456932:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210877 00000100:00100000:1.0:1651529344.456933:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+371:39030:x1731745946369920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.456938:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177325 count 1 00010000:00010000:1.0:1651529344.456943:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011522e38/0x3234de053c50253 lrc: 3/0,1 mode: --/PW res: [0x2b4ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456943:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007f5d689/0x3234de053c50237 lrc: 3/0,1 mode: PW/PW res: [0x2b4a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.456946:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007f5d689/0x3234de053c50237 lrc: 2/0,0 mode: PW/PW res: [0x2b4a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.456948:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000007e2f834/0x3234de053c4d86f lrc: 2/0,0 mode: PR/PR res: [0x2b4ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d12ae expref: 1691 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.456951:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.456952:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.456952:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011522e38/0x3234de053c50253 lrc: 4/0,1 mode: --/PW res: [0x2b4ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.456959:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000007e2f834/0x3234de053c4d86f lrc: 3/0,0 mode: PR/PR res: [0x2b4ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d12ae expref: 1691 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.456962:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000007e2f834/0x3234de053c4d86f lrc: 4/0,0 mode: PR/PR res: [0x2b4ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d12ae expref: 1691 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.456966:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000037ac96ac pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996962880:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.456977:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 0000000089d75f07 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.456982:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396250304 00010000:00010000:1.0:1651529344.456986:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c4e6b5 lrc: 4/0,0 mode: PR/PR res: [0x2b4aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b6b expref: 1692 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.456992:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396250368 00010000:00010000:1.0:1651529344.456994:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000aab15112/0x3234de053c4ebfc lrc: 4/0,0 mode: PR/PR res: [0x2b4ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6183 expref: 1693 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.456999:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11656 00000100:00100000:0.0:1651529344.456999:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+372:39029:x1731745946369088:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1036us (1189us total) trans 12885078928 rc 0/0 00000100:00100000:1.0:1651529344.457001:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005914c920 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1693:41279:x1731746396250304:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.457002:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210873 00010000:00010000:1.0:1651529344.457003:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.457004:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c4e6b5 lrc: 4/0,0 mode: PR/PR res: [0x2b4aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b6b expref: 1693 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.457008:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c4e6b5 lrc: 3/0,0 mode: PR/PR res: [0x2b4aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b6b expref: 1693 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.457010:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007f5d689/0x3234de053c50237 lrc: 2/0,0 mode: PW/PW res: [0x2b4a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.457013:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c4e6b5 lrc: 0/0,0 mode: --/PR res: [0x2b4aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b6b expref: 1693 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.457013:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000007f5d689 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.457014:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007f5d689/0x3234de053c50237 lrc: 2/0,0 mode: PW/PW res: [0x2b4a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.457016:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.457017:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.457017:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007f5d689/0x3234de053c50237 lrc: 3/0,0 mode: PW/PW res: [0x2b4a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.457018:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000089368d5b/0x3234de053c5023e lrc: 3/0,1 mode: PW/PW res: [0x2b4aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.457021:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089368d5b/0x3234de053c5023e lrc: 4/0,1 mode: PW/PW res: [0x2b4aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457021:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007f5d689/0x3234de053c50237 lrc: 1/0,0 mode: --/PW res: [0x2b4a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457024:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007f5d689/0x3234de053c50237 lrc: 0/0,0 mode: --/PW res: [0x2b4a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.457031:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.457038:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005914c920 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1692:41279:x1731746396250304:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 37us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.457040:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11656 00000100:00100000:1.0:1651529344.457045:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11657 00000100:00100000:1.0:1651529344.457047:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1691:41278:x1731746396250368:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.457049:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.457050:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000aab15112/0x3234de053c4ebfc lrc: 4/0,0 mode: PR/PR res: [0x2b4ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6183 expref: 1691 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.457054:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000aab15112/0x3234de053c4ebfc lrc: 3/0,0 mode: PR/PR res: [0x2b4ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6183 expref: 1691 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.457054:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000089368d5b/0x3234de053c5023e lrc: 3/0,1 mode: PW/PW res: [0x2b4aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.457058:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aab15112/0x3234de053c4ebfc lrc: 0/0,0 mode: --/PR res: [0x2b4ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6183 expref: 1691 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.457058:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089368d5b/0x3234de053c5023e lrc: 3/0,1 mode: PW/PW res: [0x2b4aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457061:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089368d5b/0x3234de053c5023e lrc: 3/0,1 mode: PW/PW res: [0x2b4aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.457062:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.457062:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.457063:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000040de33f8/0x3234de053c50245 lrc: 3/0,1 mode: PW/PW res: [0x2b4ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457063:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089368d5b/0x3234de053c5023e lrc: 2/0,0 mode: PW/PW res: [0x2b4aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.457066:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040de33f8/0x3234de053c50245 lrc: 4/0,1 mode: PW/PW res: [0x2b4ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.457074:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.457079:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1690:41278:x1731746396250368:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 31us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.457081:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11657 00010000:00010000:1.0:1651529344.457086:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000040de33f8/0x3234de053c50245 lrc: 3/0,1 mode: PW/PW res: [0x2b4ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.457089:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040de33f8/0x3234de053c50245 lrc: 3/0,1 mode: PW/PW res: [0x2b4ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.457092:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040de33f8/0x3234de053c50245 lrc: 3/0,1 mode: PW/PW res: [0x2b4ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.457095:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040de33f8/0x3234de053c50245 lrc: 2/0,0 mode: PW/PW res: [0x2b4ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.457099:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+372:39029:x1731745946369216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 954us (1030us total) trans 12885078929 rc 0/0 00000100:00100000:0.0:1651529344.457109:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210874 00010000:00010000:0.0:1651529344.457116:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089368d5b/0x3234de053c5023e lrc: 2/0,0 mode: PW/PW res: [0x2b4aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457119:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000089368d5b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.457120:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089368d5b/0x3234de053c5023e lrc: 2/0,0 mode: PW/PW res: [0x2b4aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457123:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089368d5b/0x3234de053c5023e lrc: 3/0,0 mode: PW/PW res: [0x2b4aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457128:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089368d5b/0x3234de053c5023e lrc: 1/0,0 mode: --/PW res: [0x2b4aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457130:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089368d5b/0x3234de053c5023e lrc: 0/0,0 mode: --/PW res: [0x2b4aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457135:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040de33f8/0x3234de053c50245 lrc: 2/0,0 mode: PW/PW res: [0x2b4ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457137:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000040de33f8 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.457138:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+372:39030:x1731745946369280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 960us (1036us total) trans 12885078930 rc 0/0 00010000:00010000:0.0:1651529344.457138:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040de33f8/0x3234de053c50245 lrc: 2/0,0 mode: PW/PW res: [0x2b4ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.457141:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210875 00010000:00010000:0.0:1651529344.457143:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040de33f8/0x3234de053c50245 lrc: 3/0,0 mode: PW/PW res: [0x2b4ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457147:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040de33f8/0x3234de053c50245 lrc: 1/0,0 mode: --/PW res: [0x2b4ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457149:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040de33f8/0x3234de053c50245 lrc: 0/0,0 mode: --/PW res: [0x2b4ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.457177:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.457187:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946369984 00000100:00100000:1.0:1651529344.457194:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.457210:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946370048 00000100:00100000:1.0:1651529344.457212:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.457239:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946370112 00000100:00100000:0.0:1651529344.457248:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210878 00000100:00100000:0.0:1651529344.457250:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+374:39029:x1731745946369984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.457255:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177326 count 1 00010000:00010000:0.0:1651529344.457259:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1e9e4c0/0x3234de053c5025a lrc: 3/0,1 mode: --/PW res: [0x2b4ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457264:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000035710251/0x3234de053c4da98 lrc: 2/0,0 mode: PR/PR res: [0x2b4ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ab8 expref: 1689 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.457267:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.457267:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.457268:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1e9e4c0/0x3234de053c5025a lrc: 4/0,1 mode: --/PW res: [0x2b4ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.457269:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.457281:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000035710251/0x3234de053c4da98 lrc: 3/0,0 mode: PR/PR res: [0x2b4ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ab8 expref: 1689 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.457285:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000035710251/0x3234de053c4da98 lrc: 4/0,0 mode: PR/PR res: [0x2b4ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ab8 expref: 1689 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.457289:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996962944:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.457298:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210879 00000100:00100000:1.0:1651529344.457300:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+374:39030:x1731745946370048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.457303:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c086aae3 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.457312:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177327 count 1 00000100:00100000:0.0:1651529344.457312:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210880 00000100:00100000:0.0:1651529344.457314:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+374:39029:x1731745946370112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.457316:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039cf6408/0x3234de053c50261 lrc: 3/0,1 mode: --/PW res: [0x2b4af:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.457319:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177328 count 1 00010000:00010000:1.0:1651529344.457321:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c4dfe6 lrc: 2/0,0 mode: PR/PR res: [0x2b4af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d30bb expref: 1689 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.457322:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e4ec3ee/0x3234de053c50268 lrc: 3/0,1 mode: --/PW res: [0x2b4b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.457324:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.457325:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.457325:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039cf6408/0x3234de053c50261 lrc: 4/0,1 mode: --/PW res: [0x2b4af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.457332:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c4dfe6 lrc: 3/0,0 mode: PR/PR res: [0x2b4af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d30bb expref: 1689 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.457336:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c4dfe6 lrc: 4/0,0 mode: PR/PR res: [0x2b4af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d30bb expref: 1689 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.457340:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000824ca843 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996963008:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.457341:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009071e7d8/0x3234de053c4ed3e lrc: 2/0,0 mode: PR/PR res: [0x2b4b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d66d8 expref: 1689 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.457344:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.457345:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.457345:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e4ec3ee/0x3234de053c50268 lrc: 4/0,1 mode: --/PW res: [0x2b4b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.457348:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f79d8146 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.457352:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009071e7d8/0x3234de053c4ed3e lrc: 3/0,0 mode: PR/PR res: [0x2b4b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d66d8 expref: 1689 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.457356:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009071e7d8/0x3234de053c4ed3e lrc: 4/0,0 mode: PR/PR res: [0x2b4b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d66d8 expref: 1689 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.457362:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996963072:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.457371:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e7e12492 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.457379:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996962816:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.457382:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000088993906/0x3234de053c5024c lrc: 3/0,1 mode: --/PW res: [0x2b4ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.457390:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396250624 00010000:00010000:0.0:1651529344.457394:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006c1791d6/0x3234de053c4dbe8 lrc: 4/0,0 mode: PR/PR res: [0x2b4ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1fb2 expref: 1690 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.457428:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11658 00000100:00100000:0.0:1651529344.457430:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bbea9917 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1690:41279:x1731746396250624:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.457434:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.457435:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006c1791d6/0x3234de053c4dbe8 lrc: 4/0,0 mode: PR/PR res: [0x2b4ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1fb2 expref: 1690 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.457439:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006c1791d6/0x3234de053c4dbe8 lrc: 3/0,0 mode: PR/PR res: [0x2b4ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1fb2 expref: 1690 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.457444:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.457445:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c1791d6/0x3234de053c4dbe8 lrc: 0/0,0 mode: --/PR res: [0x2b4ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1fb2 expref: 1690 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.457454:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.457455:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.457455:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.457456:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000088993906/0x3234de053c5024c lrc: 3/0,1 mode: PW/PW res: [0x2b4ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.457463:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.457463:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088993906/0x3234de053c5024c lrc: 4/0,1 mode: PW/PW res: [0x2b4ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.457470:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946370240 00010000:00010000:0.0:1651529344.457470:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.457477:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946370176 00000100:00100000:0.0:1651529344.457482:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bbea9917 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1689:41279:x1731746396250624:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 51us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.457484:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11658 00000100:00100000:1.0:1651529344.457487:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946370304 00000100:00100000:1.0:1651529344.457491:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210881 00000100:00100000:1.0:1651529344.457493:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+377:39029:x1731745946370240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.457496:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000088993906/0x3234de053c5024c lrc: 3/0,1 mode: PW/PW res: [0x2b4ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.457498:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177330 count 1 00010000:00010000:0.0:1651529344.457499:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088993906/0x3234de053c5024c lrc: 3/0,1 mode: PW/PW res: [0x2b4ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457502:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088993906/0x3234de053c5024c lrc: 3/0,1 mode: PW/PW res: [0x2b4ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.457503:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a82b4949/0x3234de053c5026f lrc: 3/0,1 mode: --/PW res: [0x2b4b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457505:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088993906/0x3234de053c5024c lrc: 2/0,0 mode: PW/PW res: [0x2b4ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.457507:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000050b4361a/0x3234de053c4b6cd lrc: 2/0,0 mode: PR/PR res: [0x2b4b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc323 expref: 1688 pid: 80278 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.457510:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.457511:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.457512:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a82b4949/0x3234de053c5026f lrc: 4/0,1 mode: --/PW res: [0x2b4b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.457518:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000050b4361a/0x3234de053c4b6cd lrc: 3/0,0 mode: PR/PR res: [0x2b4b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc323 expref: 1688 pid: 80278 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.457521:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000050b4361a/0x3234de053c4b6cd lrc: 4/0,0 mode: PR/PR res: [0x2b4b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc323 expref: 1688 pid: 80278 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.457525:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000533fe698 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996963136:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.457534:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 0000000057299e7f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.457540:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210882 00000100:00100000:1.0:1651529344.457542:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+378:39030:x1731745946370176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.457548:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007fca8239 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+378:39029:x1731745946369856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 705us (731us total) trans 12885078931 rc 0/0 00000100:00100000:0.0:1651529344.457551:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210876 00002000:00080000:1.0:1651529344.457553:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177329 count 1 00010000:00010000:1.0:1651529344.457557:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c50276 lrc: 3/0,1 mode: --/PW res: [0x2b4b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.457562:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000aab25d15/0x3234de053c4dc35 lrc: 2/0,0 mode: PR/PR res: [0x2b4b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2117 expref: 1688 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.457565:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.457565:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.457566:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c50276 lrc: 4/0,1 mode: --/PW res: [0x2b4b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.457571:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210883 00010000:00010000:1.0:1651529344.457572:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000aab25d15/0x3234de053c4dc35 lrc: 3/0,0 mode: PR/PR res: [0x2b4b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2117 expref: 1688 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.457573:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+377:39030:x1731745946370304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.457575:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000aab25d15/0x3234de053c4dc35 lrc: 4/0,0 mode: PR/PR res: [0x2b4b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2117 expref: 1688 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.457579:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003de40890 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996963200:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.457579:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177331 count 1 00010000:00010000:0.0:1651529344.457583:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000748ad336/0x3234de053c5027d lrc: 3/0,1 mode: --/PW res: [0x2b4b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.457586:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b7af823 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.457587:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003dbec785/0x3234de053c4f016 lrc: 2/0,0 mode: PR/PR res: [0x2b4b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d72fc expref: 1688 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.457591:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.457591:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.457592:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000748ad336/0x3234de053c5027d lrc: 4/0,1 mode: --/PW res: [0x2b4b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457599:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003dbec785/0x3234de053c4f016 lrc: 3/0,0 mode: PR/PR res: [0x2b4b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d72fc expref: 1688 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.457602:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003dbec785/0x3234de053c4f016 lrc: 4/0,0 mode: PR/PR res: [0x2b4b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d72fc expref: 1688 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.457606:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996963264:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.457650:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.457651:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000abca413e going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.457663:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088993906/0x3234de053c5024c lrc: 2/0,0 mode: PW/PW res: [0x2b4ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.457664:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.457668:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088993906 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.457669:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088993906/0x3234de053c5024c lrc: 2/0,0 mode: PW/PW res: [0x2b4ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457674:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088993906/0x3234de053c5024c lrc: 3/0,0 mode: PW/PW res: [0x2b4ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457687:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088993906/0x3234de053c5024c lrc: 1/0,0 mode: --/PW res: [0x2b4ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457691:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088993906/0x3234de053c5024c lrc: 0/0,0 mode: --/PW res: [0x2b4ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.457701:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000037ac96ac pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996962880:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.457705:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000011522e38/0x3234de053c50253 lrc: 3/0,1 mode: --/PW res: [0x2b4ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.457706:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396251072 00000100:00100000:1.0:1651529344.457713:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000824ca843 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996963008:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.457714:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000035710251/0x3234de053c4da98 lrc: 5/0,0 mode: PR/PR res: [0x2b4ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ab8 expref: 1689 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.457715:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000039cf6408/0x3234de053c50261 lrc: 3/0,1 mode: --/PW res: [0x2b4af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.457721:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396251008 00010000:00010000:1.0:1651529344.457726:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000007e2f834/0x3234de053c4d86f lrc: 4/0,0 mode: PR/PR res: [0x2b4ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d12ae expref: 1690 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.457733:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11659 00000100:00100000:1.0:1651529344.457745:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1690:41279:x1731746396251008:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.457748:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.457749:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000007e2f834/0x3234de053c4d86f lrc: 4/0,0 mode: PR/PR res: [0x2b4ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d12ae expref: 1690 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.457753:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000007e2f834/0x3234de053c4d86f lrc: 3/0,0 mode: PR/PR res: [0x2b4ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d12ae expref: 1690 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.457758:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007e2f834/0x3234de053c4d86f lrc: 0/0,0 mode: --/PR res: [0x2b4ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d12ae expref: 1690 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.457768:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.457769:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.457770:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000011522e38/0x3234de053c50253 lrc: 3/0,1 mode: PW/PW res: [0x2b4ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.457773:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011522e38/0x3234de053c50253 lrc: 4/0,1 mode: PW/PW res: [0x2b4ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.457779:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.457786:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1689:41279:x1731746396251008:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 41us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.457788:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11660 00000100:00100000:1.0:1651529344.457790:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11659 00000100:00100000:0.0:1651529344.457791:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1689:41278:x1731746396251072:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.457796:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.457797:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000011522e38/0x3234de053c50253 lrc: 3/0,1 mode: PW/PW res: [0x2b4ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457799:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000035710251/0x3234de053c4da98 lrc: 5/0,0 mode: PR/PR res: [0x2b4ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ab8 expref: 1688 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.457800:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011522e38/0x3234de053c50253 lrc: 3/0,1 mode: PW/PW res: [0x2b4ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.457803:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011522e38/0x3234de053c50253 lrc: 3/0,1 mode: PW/PW res: [0x2b4ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457805:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000035710251/0x3234de053c4da98 lrc: 4/0,0 mode: PR/PR res: [0x2b4ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ab8 expref: 1688 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.457806:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011522e38/0x3234de053c50253 lrc: 2/0,0 mode: PW/PW res: [0x2b4ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457823:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.457824:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.457825:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d1e9e4c0/0x3234de053c5025a lrc: 3/0,1 mode: PW/PW res: [0x2b4ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457830:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1e9e4c0/0x3234de053c5025a lrc: 4/0,1 mode: PW/PW res: [0x2b4ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457842:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.457849:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+378:39030:x1731745946369920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 915us (980us total) trans 12885078932 rc 0/0 00000100:00100000:1.0:1651529344.457852:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210877 00000100:00100000:0.0:1651529344.457853:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1688:41278:x1731746396251072:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 62us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.457858:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11660 00010000:00010000:0.0:1651529344.457868:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011522e38/0x3234de053c50253 lrc: 2/0,0 mode: PW/PW res: [0x2b4ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457879:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000011522e38 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.457880:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011522e38/0x3234de053c50253 lrc: 2/0,0 mode: PW/PW res: [0x2b4ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.457882:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.457883:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011522e38/0x3234de053c50253 lrc: 3/0,0 mode: PW/PW res: [0x2b4ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457888:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011522e38/0x3234de053c50253 lrc: 1/0,0 mode: --/PW res: [0x2b4ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457890:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011522e38/0x3234de053c50253 lrc: 0/0,0 mode: --/PW res: [0x2b4ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.457901:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996963072:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.457905:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001e4ec3ee/0x3234de053c50268 lrc: 3/0,1 mode: --/PW res: [0x2b4b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457912:0:156655:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035710251/0x3234de053c4da98 lrc: 0/0,0 mode: --/PR res: [0x2b4ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ab8 expref: 1687 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.457913:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.457924:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996962944:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.457927:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d1e9e4c0/0x3234de053c5025a lrc: 3/0,1 mode: PW/PW res: [0x2b4ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457930:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d1e9e4c0/0x3234de053c5025a lrc: 3/0,1 mode: PW/PW res: [0x2b4ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457932:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1e9e4c0/0x3234de053c5025a lrc: 3/0,1 mode: PW/PW res: [0x2b4ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457935:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1e9e4c0/0x3234de053c5025a lrc: 3/0,1 mode: PW/PW res: [0x2b4ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.457938:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1e9e4c0/0x3234de053c5025a lrc: 2/0,0 mode: PW/PW res: [0x2b4ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.457942:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.457953:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946370368 00000100:00100000:1.0:1651529344.457962:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210884 00000100:00100000:1.0:1651529344.457964:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+378:39030:x1731745946370368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.457969:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177332 count 1 00010000:00010000:1.0:1651529344.457973:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c50284 lrc: 3/0,1 mode: --/PW res: [0x2b4b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.457978:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000037767785/0x3234de053c4e518 lrc: 2/0,0 mode: PR/PR res: [0x2b4b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4575 expref: 1686 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.457981:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.457982:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.457983:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c50284 lrc: 4/0,1 mode: --/PW res: [0x2b4b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.457989:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000037767785/0x3234de053c4e518 lrc: 3/0,0 mode: PR/PR res: [0x2b4b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4575 expref: 1686 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.457993:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000037767785/0x3234de053c4e518 lrc: 4/0,0 mode: PR/PR res: [0x2b4b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4575 expref: 1686 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.458003:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029abc941 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996963328:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.458012:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f79d8146 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.458033:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+379:39029:x1731745946369984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 782us (856us total) trans 12885078933 rc 0/0 00000100:00100000:0.0:1651529344.458036:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210878 00010000:00010000:0.0:1651529344.458044:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1e9e4c0/0x3234de053c5025a lrc: 2/0,0 mode: PW/PW res: [0x2b4ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458048:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d1e9e4c0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.458049:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1e9e4c0/0x3234de053c5025a lrc: 2/0,0 mode: PW/PW res: [0x2b4ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458054:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1e9e4c0/0x3234de053c5025a lrc: 3/0,0 mode: PW/PW res: [0x2b4ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458058:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1e9e4c0/0x3234de053c5025a lrc: 1/0,0 mode: --/PW res: [0x2b4ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458061:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1e9e4c0/0x3234de053c5025a lrc: 0/0,0 mode: --/PW res: [0x2b4ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.458063:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.458077:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946370624 00000100:00100000:0.0:1651529344.458084:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210885 00000100:00100000:0.0:1651529344.458085:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+379:39029:x1731745946370624:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.458090:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177333 count 1 00010000:00010000:0.0:1651529344.458094:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e049160/0x3234de053c5028b lrc: 3/0,1 mode: --/PW res: [0x2b4b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458099:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c4cafb lrc: 2/0,0 mode: PR/PR res: [0x2b4b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd94 expref: 1686 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.458108:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.458108:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.458109:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.458109:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e049160/0x3234de053c5028b lrc: 4/0,1 mode: --/PW res: [0x2b4b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.458115:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.458116:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c4cafb lrc: 3/0,0 mode: PR/PR res: [0x2b4b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd94 expref: 1686 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.458122:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.458122:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c4cafb lrc: 4/0,0 mode: PR/PR res: [0x2b4b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd94 expref: 1686 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.458127:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996963392:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.458129:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003de40890 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996963200:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.458133:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c50276 lrc: 3/0,1 mode: --/PW res: [0x2b4b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.458141:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c086aae3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.458145:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396251200 00000100:00100000:0.0:1651529344.458149:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996963264:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.458150:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009071e7d8/0x3234de053c4ed3e lrc: 4/0,0 mode: PR/PR res: [0x2b4b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d66d8 expref: 1687 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.458153:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000748ad336/0x3234de053c5027d lrc: 3/0,1 mode: --/PW res: [0x2b4b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.458155:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396251136 00010000:00010000:1.0:1651529344.458157:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c4dfe6 lrc: 4/0,0 mode: PR/PR res: [0x2b4af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d30bb expref: 1688 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.458160:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396251264 00000100:00100000:1.0:1651529344.458164:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396251328 00010000:00010000:0.0:1651529344.458164:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000050b4361a/0x3234de053c4b6cd lrc: 5/0,0 mode: PR/PR res: [0x2b4b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc323 expref: 1689 pid: 80278 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.458166:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000aab25d15/0x3234de053c4dc35 lrc: 4/0,0 mode: PR/PR res: [0x2b4b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2117 expref: 1690 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.458170:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396251392 00010000:00010000:1.0:1651529344.458172:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003dbec785/0x3234de053c4f016 lrc: 4/0,0 mode: PR/PR res: [0x2b4b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d72fc expref: 1691 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.458176:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11661 00000100:00100000:1.0:1651529344.458178:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1691:41278:x1731746396251200:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.458181:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.458182:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009071e7d8/0x3234de053c4ed3e lrc: 4/0,0 mode: PR/PR res: [0x2b4b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d66d8 expref: 1691 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.458186:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009071e7d8/0x3234de053c4ed3e lrc: 3/0,0 mode: PR/PR res: [0x2b4b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d66d8 expref: 1691 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.458188:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11662 00010000:00010000:1.0:1651529344.458191:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009071e7d8/0x3234de053c4ed3e lrc: 0/0,0 mode: --/PR res: [0x2b4b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d66d8 expref: 1691 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.458195:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.458195:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.458196:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001e4ec3ee/0x3234de053c50268 lrc: 3/0,1 mode: PW/PW res: [0x2b4b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458199:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e4ec3ee/0x3234de053c50268 lrc: 4/0,1 mode: PW/PW res: [0x2b4b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.458199:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1690:41279:x1731746396251136:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.458203:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.458204:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c4dfe6 lrc: 4/0,0 mode: PR/PR res: [0x2b4af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d30bb expref: 1690 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.458210:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.458214:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c4dfe6 lrc: 3/0,0 mode: PR/PR res: [0x2b4af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d30bb expref: 1690 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.458217:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1690:41278:x1731746396251200:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.458220:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11661 00010000:00010000:0.0:1651529344.458220:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c4dfe6 lrc: 0/0,0 mode: --/PR res: [0x2b4af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d30bb expref: 1690 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.458239:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11663 00000100:00100000:1.0:1651529344.458241:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1689:41279:x1731746396251264:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.458244:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.458245:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.458246:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000050b4361a/0x3234de053c4b6cd lrc: 5/0,0 mode: PR/PR res: [0x2b4b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc323 expref: 1688 pid: 80278 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.458246:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.458247:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000039cf6408/0x3234de053c50261 lrc: 3/0,1 mode: PW/PW res: [0x2b4af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458250:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000050b4361a/0x3234de053c4b6cd lrc: 4/0,0 mode: PR/PR res: [0x2b4b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc323 expref: 1688 pid: 80278 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.458250:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039cf6408/0x3234de053c50261 lrc: 4/0,1 mode: PW/PW res: [0x2b4af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458254:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.458255:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.458256:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a82b4949/0x3234de053c5026f lrc: 3/0,1 mode: PW/PW res: [0x2b4b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458258:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.458265:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a82b4949/0x3234de053c5026f lrc: 4/0,1 mode: PW/PW res: [0x2b4b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.458266:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1688:41279:x1731746396251136:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 66us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.458269:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11662 00010000:00010000:1.0:1651529344.458270:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.458274:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11664 00000100:00100000:1.0:1651529344.458276:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1687:41279:x1731746396251264:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 34us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.458276:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1687:41279:x1731746396251328:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.458278:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11663 00010000:00010000:0.0:1651529344.458278:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.458280:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000aab25d15/0x3234de053c4dc35 lrc: 4/0,0 mode: PR/PR res: [0x2b4b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2117 expref: 1687 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.458283:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11665 00010000:00010000:0.0:1651529344.458284:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000aab25d15/0x3234de053c4dc35 lrc: 3/0,0 mode: PR/PR res: [0x2b4b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2117 expref: 1686 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.458285:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d9169e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1686:41279:x1731746396251392:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.458287:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.458289:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003dbec785/0x3234de053c4f016 lrc: 4/0,0 mode: PR/PR res: [0x2b4b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d72fc expref: 1686 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.458289:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aab25d15/0x3234de053c4dc35 lrc: 0/0,0 mode: --/PR res: [0x2b4b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2117 expref: 1686 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.458292:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003dbec785/0x3234de053c4f016 lrc: 3/0,0 mode: PR/PR res: [0x2b4b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d72fc expref: 1685 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.458292:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.458293:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.458294:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c50276 lrc: 3/0,1 mode: PW/PW res: [0x2b4b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458297:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003dbec785/0x3234de053c4f016 lrc: 0/0,0 mode: --/PR res: [0x2b4b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d72fc expref: 1685 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.458297:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c50276 lrc: 4/0,1 mode: PW/PW res: [0x2b4b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458301:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.458301:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.458302:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000748ad336/0x3234de053c5027d lrc: 3/0,1 mode: PW/PW res: [0x2b4b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458305:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.458310:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1684:41279:x1731746396251328:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 34us (195us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.458311:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000748ad336/0x3234de053c5027d lrc: 4/0,1 mode: PW/PW res: [0x2b4b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.458312:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11664 00010000:00010000:1.0:1651529344.458320:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.458326:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d9169e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1683:41279:x1731746396251392:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (204us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.458326:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001e4ec3ee/0x3234de053c50268 lrc: 3/0,1 mode: PW/PW res: [0x2b4b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.458328:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11665 00010000:00010000:0.0:1651529344.458329:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e4ec3ee/0x3234de053c50268 lrc: 3/0,1 mode: PW/PW res: [0x2b4b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458332:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e4ec3ee/0x3234de053c50268 lrc: 3/0,1 mode: PW/PW res: [0x2b4b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458335:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e4ec3ee/0x3234de053c50268 lrc: 2/0,0 mode: PW/PW res: [0x2b4b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458338:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000039cf6408/0x3234de053c50261 lrc: 3/0,1 mode: PW/PW res: [0x2b4af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458342:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039cf6408/0x3234de053c50261 lrc: 3/0,1 mode: PW/PW res: [0x2b4af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458347:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039cf6408/0x3234de053c50261 lrc: 3/0,1 mode: PW/PW res: [0x2b4af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458350:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039cf6408/0x3234de053c50261 lrc: 2/0,0 mode: PW/PW res: [0x2b4af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.458380:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+381:39029:x1731745946370112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1065us (1167us total) trans 12885078934 rc 0/0 00000100:00100000:0.0:1651529344.458383:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210880 00010000:00010000:0.0:1651529344.458390:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e4ec3ee/0x3234de053c50268 lrc: 2/0,0 mode: PW/PW res: [0x2b4b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.458392:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+380:39030:x1731745946370048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1092us (1198us total) trans 12885078935 rc 0/0 00000100:00100000:1.0:1651529344.458395:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210879 00010000:00010000:0.0:1651529344.458395:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e4ec3ee already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.458396:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e4ec3ee/0x3234de053c50268 lrc: 2/0,0 mode: PW/PW res: [0x2b4b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458399:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e4ec3ee/0x3234de053c50268 lrc: 3/0,0 mode: PW/PW res: [0x2b4b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458402:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c50276 lrc: 3/0,1 mode: PW/PW res: [0x2b4b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458403:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e4ec3ee/0x3234de053c50268 lrc: 1/0,0 mode: --/PW res: [0x2b4b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458405:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c50276 lrc: 3/0,1 mode: PW/PW res: [0x2b4b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458406:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e4ec3ee/0x3234de053c50268 lrc: 0/0,0 mode: --/PW res: [0x2b4b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458408:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c50276 lrc: 3/0,1 mode: PW/PW res: [0x2b4b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458410:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039cf6408/0x3234de053c50261 lrc: 2/0,0 mode: PW/PW res: [0x2b4af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458411:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c50276 lrc: 2/0,0 mode: PW/PW res: [0x2b4b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458413:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000039cf6408 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.458414:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039cf6408/0x3234de053c50261 lrc: 2/0,0 mode: PW/PW res: [0x2b4af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458417:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039cf6408/0x3234de053c50261 lrc: 3/0,0 mode: PW/PW res: [0x2b4af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458427:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039cf6408/0x3234de053c50261 lrc: 1/0,0 mode: --/PW res: [0x2b4af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458430:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039cf6408/0x3234de053c50261 lrc: 0/0,0 mode: --/PW res: [0x2b4af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458434:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c50276 lrc: 2/0,0 mode: PW/PW res: [0x2b4b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458437:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007f539dcd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.458437:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c50276 lrc: 2/0,0 mode: PW/PW res: [0x2b4b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458440:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c50276 lrc: 3/0,0 mode: PW/PW res: [0x2b4b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458443:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c50276 lrc: 1/0,0 mode: --/PW res: [0x2b4b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458445:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c50276 lrc: 0/0,0 mode: --/PW res: [0x2b4b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.458446:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+380:39030:x1731745946370176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 904us (991us total) trans 12885078936 rc 0/0 00000100:00100000:1.0:1651529344.458449:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210882 00010000:00010000:0.0:1651529344.458452:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000748ad336/0x3234de053c5027d lrc: 3/0,1 mode: PW/PW res: [0x2b4b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458455:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000748ad336/0x3234de053c5027d lrc: 3/0,1 mode: PW/PW res: [0x2b4b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458458:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000748ad336/0x3234de053c5027d lrc: 3/0,1 mode: PW/PW res: [0x2b4b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458460:0:80280:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050b4361a/0x3234de053c4b6cd lrc: 0/0,0 mode: --/PR res: [0x2b4b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc323 expref: 1682 pid: 80278 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.458461:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000748ad336/0x3234de053c5027d lrc: 2/0,0 mode: PW/PW res: [0x2b4b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.458466:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000533fe698 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996963136:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.458470:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a82b4949/0x3234de053c5026f lrc: 3/0,1 mode: PW/PW res: [0x2b4b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458473:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a82b4949/0x3234de053c5026f lrc: 3/0,1 mode: PW/PW res: [0x2b4b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458476:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a82b4949/0x3234de053c5026f lrc: 3/0,1 mode: PW/PW res: [0x2b4b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458478:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a82b4949/0x3234de053c5026f lrc: 3/0,1 mode: PW/PW res: [0x2b4b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458481:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a82b4949/0x3234de053c5026f lrc: 2/0,0 mode: PW/PW res: [0x2b4b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.458505:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+381:39030:x1731745946370304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 931us (1041us total) trans 12885078937 rc 0/0 00000100:00100000:0.0:1651529344.458508:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210883 00010000:00010000:0.0:1651529344.458515:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000748ad336/0x3234de053c5027d lrc: 2/0,0 mode: PW/PW res: [0x2b4b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458518:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000748ad336 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.458519:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+380:39029:x1731745946370240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1025us (1076us total) trans 12885078938 rc 0/0 00010000:00010000:0.0:1651529344.458519:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000748ad336/0x3234de053c5027d lrc: 2/0,0 mode: PW/PW res: [0x2b4b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.458522:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210881 00010000:00010000:0.0:1651529344.458522:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000748ad336/0x3234de053c5027d lrc: 3/0,0 mode: PW/PW res: [0x2b4b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458526:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000748ad336/0x3234de053c5027d lrc: 1/0,0 mode: --/PW res: [0x2b4b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458529:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000748ad336/0x3234de053c5027d lrc: 0/0,0 mode: --/PW res: [0x2b4b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458533:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a82b4949/0x3234de053c5026f lrc: 2/0,0 mode: PW/PW res: [0x2b4b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458536:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a82b4949 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.458537:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a82b4949/0x3234de053c5026f lrc: 2/0,0 mode: PW/PW res: [0x2b4b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458542:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a82b4949/0x3234de053c5026f lrc: 3/0,0 mode: PW/PW res: [0x2b4b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458546:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a82b4949/0x3234de053c5026f lrc: 1/0,0 mode: --/PW res: [0x2b4b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458548:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a82b4949/0x3234de053c5026f lrc: 0/0,0 mode: --/PW res: [0x2b4b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.458549:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.458556:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946370688 00000100:00100000:1.0:1651529344.458560:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.458562:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210886 00000100:00100000:0.0:1651529344.458564:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+380:39029:x1731745946370688:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.458575:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177334 count 1 00010000:00010000:0.0:1651529344.458579:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fccb00ae/0x3234de053c50292 lrc: 3/0,1 mode: --/PW res: [0x2b4b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458583:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001ffd5f73/0x3234de053c4e7db lrc: 2/0,0 mode: PR/PR res: [0x2b4b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d500a expref: 1681 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.458586:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.458587:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.458587:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fccb00ae/0x3234de053c50292 lrc: 4/0,1 mode: --/PW res: [0x2b4b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458594:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001ffd5f73/0x3234de053c4e7db lrc: 3/0,0 mode: PR/PR res: [0x2b4b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d500a expref: 1681 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.458600:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001ffd5f73/0x3234de053c4e7db lrc: 4/0,0 mode: PR/PR res: [0x2b4b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d500a expref: 1681 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.458604:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996963456:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.458613:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e7e12492 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.458619:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396251456 00010000:00010000:0.0:1651529344.458624:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000037767785/0x3234de053c4e518 lrc: 5/0,0 mode: PR/PR res: [0x2b4b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4575 expref: 1682 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.458636:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11666 00000100:00100000:0.0:1651529344.458637:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1682:41278:x1731746396251456:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.458640:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.458641:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000037767785/0x3234de053c4e518 lrc: 5/0,0 mode: PR/PR res: [0x2b4b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4575 expref: 1682 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.458645:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000037767785/0x3234de053c4e518 lrc: 4/0,0 mode: PR/PR res: [0x2b4b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4575 expref: 1682 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.458666:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.458667:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.458668:0:72396:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037767785/0x3234de053c4e518 lrc: 0/0,0 mode: --/PR res: [0x2b4b4:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4575 expref: 1682 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.458668:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c50284 lrc: 3/0,1 mode: PW/PW res: [0x2b4b4:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458671:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c50284 lrc: 4/0,1 mode: PW/PW res: [0x2b4b4:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.458673:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029abc941 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996963328:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.458677:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c50284 lrc: 4/0,1 mode: PW/PW res: [0x2b4b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458678:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.458680:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c50284 lrc: 3/0,1 mode: PW/PW res: [0x2b4b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458683:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c50284 lrc: 3/0,1 mode: PW/PW res: [0x2b4b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458686:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c50284 lrc: 3/0,1 mode: PW/PW res: [0x2b4b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.458691:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1681:41278:x1731746396251456:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 53us (130us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.458694:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c50284 lrc: 2/0,0 mode: PW/PW res: [0x2b4b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.458694:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11666 00010000:00010000:0.0:1651529344.458728:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c50284 lrc: 2/0,0 mode: PW/PW res: [0x2b4b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458732:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c8f63a78 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.458733:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c50284 lrc: 2/0,0 mode: PW/PW res: [0x2b4b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.458743:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+381:39030:x1731745946370368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 778us (860us total) trans 12885078939 rc 0/0 00000100:00100000:1.0:1651529344.458746:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210884 00010000:00010000:0.0:1651529344.458746:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c50284 lrc: 3/0,0 mode: PW/PW res: [0x2b4b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458751:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c50284 lrc: 1/0,0 mode: --/PW res: [0x2b4b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458753:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c50284 lrc: 0/0,0 mode: --/PW res: [0x2b4b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.458775:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996963392:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.458779:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004e049160/0x3234de053c5028b lrc: 3/0,1 mode: --/PW res: [0x2b4b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.458834:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.458842:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.458848:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.458857:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.458859:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946371072 00000100:00100000:1.0:1651529344.458864:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.458875:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946371136 00000100:00100000:1.0:1651529344.458879:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946371200 00000100:00100000:0.0:1651529344.458879:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946371264 00000100:00100000:0.0:1651529344.458885:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946371328 00000100:00100000:0.0:1651529344.458892:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210887 00000100:00100000:0.0:1651529344.458894:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+385:39030:x1731745946371072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.458898:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210888 00002000:00080000:0.0:1651529344.458899:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177335 count 1 00000100:00100000:1.0:1651529344.458900:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+385:39029:x1731745946371136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.458903:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a42426c/0x3234de053c50299 lrc: 3/0,1 mode: --/PW res: [0x2b4b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.458906:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177336 count 1 00010000:00010000:0.0:1651529344.458907:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006b6f07f6/0x3234de053c4f69f lrc: 2/0,0 mode: PR/PR res: [0x2b4b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d4a expref: 1680 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.458910:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c502a0 lrc: 3/0,1 mode: --/PW res: [0x2b4b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458910:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.458911:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.458912:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a42426c/0x3234de053c50299 lrc: 4/0,1 mode: --/PW res: [0x2b4b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458915:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003fd40bdd/0x3234de053c4d011 lrc: 2/0,0 mode: PR/PR res: [0x2b4b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf1a6 expref: 1680 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.458918:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.458918:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006b6f07f6/0x3234de053c4f69f lrc: 3/0,0 mode: PR/PR res: [0x2b4b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d4a expref: 1680 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.458919:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.458920:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c502a0 lrc: 4/0,1 mode: --/PW res: [0x2b4b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458921:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006b6f07f6/0x3234de053c4f69f lrc: 4/0,0 mode: PR/PR res: [0x2b4b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d4a expref: 1680 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.458925:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996963520:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.458926:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003fd40bdd/0x3234de053c4d011 lrc: 3/0,0 mode: PR/PR res: [0x2b4b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf1a6 expref: 1680 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.458930:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003fd40bdd/0x3234de053c4d011 lrc: 4/0,0 mode: PR/PR res: [0x2b4b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf1a6 expref: 1680 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.458934:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007ac35c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996963584:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.458952:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f79d8146 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.458955:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a3b00cf3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.458958:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210889 00000100:00100000:1.0:1651529344.458959:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+385:39029:x1731745946371264:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.458962:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210890 00002000:00080000:1.0:1651529344.458964:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177338 count 1 00000100:00100000:0.0:1651529344.458964:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+385:39030:x1731745946371328:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.458967:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e85da3f/0x3234de053c502a7 lrc: 3/0,1 mode: --/PW res: [0x2b4ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.458969:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177339 count 1 00010000:00010000:1.0:1651529344.458971:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4f1c8 lrc: 2/0,0 mode: PR/PR res: [0x2b4ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a0a expref: 1680 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.458973:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c502ae lrc: 3/0,1 mode: --/PW res: [0x2b4bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458977:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.458977:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c49f8f lrc: 2/0,0 mode: PR/PR res: [0x2b4bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb458 expref: 1680 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.458978:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.458978:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e85da3f/0x3234de053c502a7 lrc: 4/0,1 mode: --/PW res: [0x2b4ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.458980:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.458981:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.458982:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c502ae lrc: 4/0,1 mode: --/PW res: [0x2b4bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.458984:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4f1c8 lrc: 3/0,0 mode: PR/PR res: [0x2b4ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a0a expref: 1680 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.458987:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4f1c8 lrc: 4/0,0 mode: PR/PR res: [0x2b4ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a0a expref: 1680 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.458988:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c49f8f lrc: 3/0,0 mode: PR/PR res: [0x2b4bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb458 expref: 1680 pid: 106695 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.458991:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000703c0db9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996963648:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.458992:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c49f8f lrc: 4/0,0 mode: PR/PR res: [0x2b4bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb458 expref: 1680 pid: 106695 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.458996:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996963712:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.458998:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e5f43e7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.459003:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210891 00000100:00100000:0.0:1651529344.459003:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000070e666f7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.459005:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+385:39030:x1731745946371200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.459009:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177337 count 1 00010000:00010000:1.0:1651529344.459012:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000431e46a9/0x3234de053c502b5 lrc: 3/0,1 mode: --/PW res: [0x2b4b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459017:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000066ae2b40/0x3234de053c4f5a3 lrc: 2/0,0 mode: PR/PR res: [0x2b4b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8906 expref: 1680 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.459020:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.459020:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.459021:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000431e46a9/0x3234de053c502b5 lrc: 4/0,1 mode: --/PW res: [0x2b4b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459028:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000066ae2b40/0x3234de053c4f5a3 lrc: 3/0,0 mode: PR/PR res: [0x2b4b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8906 expref: 1680 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.459032:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000066ae2b40/0x3234de053c4f5a3 lrc: 4/0,0 mode: PR/PR res: [0x2b4b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8906 expref: 1680 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.459036:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996963776:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.459042:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 0000000057299e7f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.459057:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.459099:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.459120:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996963456:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.459124:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fccb00ae/0x3234de053c50292 lrc: 3/0,1 mode: --/PW res: [0x2b4b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.459138:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.459147:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396251712 00010000:00010000:0.0:1651529344.459152:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c4cafb lrc: 4/0,0 mode: PR/PR res: [0x2b4b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd94 expref: 1681 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.459172:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396251968 00000100:00100000:0.0:1651529344.459176:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11667 00010000:00010000:1.0:1651529344.459178:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001ffd5f73/0x3234de053c4e7db lrc: 4/0,0 mode: PR/PR res: [0x2b4b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d500a expref: 1682 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.459178:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1682:41278:x1731746396251712:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.459181:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.459182:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c4cafb lrc: 4/0,0 mode: PR/PR res: [0x2b4b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd94 expref: 1682 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.459189:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11668 00000100:00100000:1.0:1651529344.459191:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1682:41279:x1731746396251968:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.459193:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c4cafb lrc: 3/0,0 mode: PR/PR res: [0x2b4b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd94 expref: 1682 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.459194:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.459195:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001ffd5f73/0x3234de053c4e7db lrc: 4/0,0 mode: PR/PR res: [0x2b4b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d500a expref: 1682 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.459199:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001ffd5f73/0x3234de053c4e7db lrc: 3/0,0 mode: PR/PR res: [0x2b4b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d500a expref: 1682 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.459199:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c4cafb lrc: 0/0,0 mode: --/PR res: [0x2b4b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd94 expref: 1682 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.459203:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.459203:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.459204:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004e049160/0x3234de053c5028b lrc: 3/0,1 mode: PW/PW res: [0x2b4b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459205:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ffd5f73/0x3234de053c4e7db lrc: 0/0,0 mode: --/PR res: [0x2b4b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d500a expref: 1681 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.459207:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e049160/0x3234de053c5028b lrc: 4/0,1 mode: PW/PW res: [0x2b4b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459209:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.459209:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.459210:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fccb00ae/0x3234de053c50292 lrc: 3/0,1 mode: PW/PW res: [0x2b4b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459213:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fccb00ae/0x3234de053c50292 lrc: 4/0,1 mode: PW/PW res: [0x2b4b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459213:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.459238:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.459246:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1680:41279:x1731746396251968:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 55us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.459247:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1680:41278:x1731746396251712:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 68us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.459249:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11668 00000100:00100000:0.0:1651529344.459251:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11667 00000100:00100000:1.0:1651529344.459258:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946371392 00010000:00010000:0.0:1651529344.459260:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004e049160/0x3234de053c5028b lrc: 3/0,1 mode: PW/PW res: [0x2b4b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.459263:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210892 00010000:00010000:0.0:1651529344.459264:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e049160/0x3234de053c5028b lrc: 3/0,1 mode: PW/PW res: [0x2b4b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.459265:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+386:39029:x1731745946371392:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.459269:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177340 count 1 00010000:00010000:0.0:1651529344.459269:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e049160/0x3234de053c5028b lrc: 3/0,1 mode: PW/PW res: [0x2b4b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459272:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e049160/0x3234de053c5028b lrc: 2/0,0 mode: PW/PW res: [0x2b4b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459273:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3e1d739/0x3234de053c502bc lrc: 3/0,1 mode: --/PW res: [0x2b4bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459277:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005976006a/0x3234de053c4d527 lrc: 2/0,0 mode: PR/PR res: [0x2b4bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0691 expref: 1678 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.459281:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.459281:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.459282:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3e1d739/0x3234de053c502bc lrc: 4/0,1 mode: --/PW res: [0x2b4bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459291:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005976006a/0x3234de053c4d527 lrc: 3/0,0 mode: PR/PR res: [0x2b4bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0691 expref: 1678 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.459294:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005976006a/0x3234de053c4d527 lrc: 4/0,0 mode: PR/PR res: [0x2b4bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0691 expref: 1678 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.459298:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000974b675b pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996963840:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.459306:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 000000007d8fabda going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.459312:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+387:39029:x1731745946370624:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1225us (1249us total) trans 12885078940 rc 0/0 00000100:00100000:0.0:1651529344.459315:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210885 00010000:00010000:0.0:1651529344.459321:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e049160/0x3234de053c5028b lrc: 2/0,0 mode: PW/PW res: [0x2b4b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459325:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004e049160 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.459326:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e049160/0x3234de053c5028b lrc: 2/0,0 mode: PW/PW res: [0x2b4b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459328:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e049160/0x3234de053c5028b lrc: 3/0,0 mode: PW/PW res: [0x2b4b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459333:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e049160/0x3234de053c5028b lrc: 1/0,0 mode: --/PW res: [0x2b4b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459336:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e049160/0x3234de053c5028b lrc: 0/0,0 mode: --/PW res: [0x2b4b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459342:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fccb00ae/0x3234de053c50292 lrc: 3/0,1 mode: PW/PW res: [0x2b4b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459345:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fccb00ae/0x3234de053c50292 lrc: 3/0,1 mode: PW/PW res: [0x2b4b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459348:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fccb00ae/0x3234de053c50292 lrc: 3/0,1 mode: PW/PW res: [0x2b4b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459351:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fccb00ae/0x3234de053c50292 lrc: 2/0,0 mode: PW/PW res: [0x2b4b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.459390:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+387:39029:x1731745946370688:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 825us (841us total) trans 12885078941 rc 0/0 00000100:00100000:0.0:1651529344.459393:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210886 00010000:00010000:0.0:1651529344.459416:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fccb00ae/0x3234de053c50292 lrc: 2/0,0 mode: PW/PW res: [0x2b4b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459419:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fccb00ae already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.459420:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fccb00ae/0x3234de053c50292 lrc: 2/0,0 mode: PW/PW res: [0x2b4b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459423:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fccb00ae/0x3234de053c50292 lrc: 3/0,0 mode: PW/PW res: [0x2b4b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459428:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fccb00ae/0x3234de053c50292 lrc: 1/0,0 mode: --/PW res: [0x2b4b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459431:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fccb00ae/0x3234de053c50292 lrc: 0/0,0 mode: --/PW res: [0x2b4b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.459474:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.459485:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946371648 00000100:00100000:0.0:1651529344.459503:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210893 00000100:00100000:1.0:1651529344.459524:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.459532:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.459541:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+387:39029:x1731745946371648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.459547:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.459547:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177341 count 1 00010000:00010000:0.0:1651529344.459551:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c502c3 lrc: 3/0,1 mode: --/PW res: [0x2b4bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.459554:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.459556:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bb3755a2/0x3234de053c4ceba lrc: 2/0,0 mode: PR/PR res: [0x2b4bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cecc8 expref: 1678 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.459559:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.459559:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.459560:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c502c3 lrc: 4/0,1 mode: --/PW res: [0x2b4bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.459562:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.459569:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.459576:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007ac35c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996963584:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.459581:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c502a0 lrc: 3/0,1 mode: --/PW res: [0x2b4b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459591:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bb3755a2/0x3234de053c4ceba lrc: 3/0,0 mode: PR/PR res: [0x2b4bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cecc8 expref: 1678 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.459595:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bb3755a2/0x3234de053c4ceba lrc: 4/0,0 mode: PR/PR res: [0x2b4bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cecc8 expref: 1678 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.459599:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996963904:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.459602:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000703c0db9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996963648:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.459605:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002e85da3f/0x3234de053c502a7 lrc: 3/0,1 mode: --/PW res: [0x2b4ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.459609:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed830649 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.459612:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996963776:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.459616:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000431e46a9/0x3234de053c502b5 lrc: 3/0,1 mode: --/PW res: [0x2b4b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.459617:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996963712:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.459621:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c502ae lrc: 3/0,1 mode: --/PW res: [0x2b4bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.459622:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946371712 00000100:00100000:0.0:1651529344.459627:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996963520:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.459629:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210894 00000100:00100000:1.0:1651529344.459630:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+388:39029:x1731745946371712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.459630:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009a42426c/0x3234de053c50299 lrc: 3/0,1 mode: --/PW res: [0x2b4b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.459635:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177342 count 1 00000100:00100000:0.0:1651529344.459637:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396252160 00010000:00010000:1.0:1651529344.459639:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090168046/0x3234de053c502ca lrc: 3/0,1 mode: --/PW res: [0x2b4be:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459641:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003fd40bdd/0x3234de053c4d011 lrc: 4/0,0 mode: PR/PR res: [0x2b4b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf1a6 expref: 1679 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.459643:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008ce5f676/0x3234de053c4d0ce lrc: 2/0,0 mode: PR/PR res: [0x2b4be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf4e0 expref: 1679 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.459646:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.459647:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.459647:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396252288 00010000:00010000:1.0:1651529344.459648:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090168046/0x3234de053c502ca lrc: 4/0,1 mode: --/PW res: [0x2b4be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459649:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4f1c8 lrc: 4/0,0 mode: PR/PR res: [0x2b4ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a0a expref: 1680 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.459653:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396252224 00010000:00010000:1.0:1651529344.459654:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008ce5f676/0x3234de053c4d0ce lrc: 3/0,0 mode: PR/PR res: [0x2b4be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf4e0 expref: 1681 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.459655:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006b6f07f6/0x3234de053c4f69f lrc: 4/0,0 mode: PR/PR res: [0x2b4b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d4a expref: 1681 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.459657:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008ce5f676/0x3234de053c4d0ce lrc: 4/0,0 mode: PR/PR res: [0x2b4be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf4e0 expref: 1681 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.459659:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396252416 00010000:00010000:0.0:1651529344.459661:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000066ae2b40/0x3234de053c4f5a3 lrc: 4/0,0 mode: PR/PR res: [0x2b4b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8906 expref: 1682 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.459662:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e5997468 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996963968:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.459665:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396252352 00010000:00010000:0.0:1651529344.459667:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c49f8f lrc: 4/0,0 mode: PR/PR res: [0x2b4bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb458 expref: 1683 pid: 106695 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.459670:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e5f43e7 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.459672:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11669 00000100:00100000:0.0:1651529344.459673:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1683:41279:x1731746396252160:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.459676:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.459677:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11670 00010000:00010000:0.0:1651529344.459677:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003fd40bdd/0x3234de053c4d011 lrc: 4/0,0 mode: PR/PR res: [0x2b4b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf1a6 expref: 1683 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.459679:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1683:41279:x1731746396252288:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.459681:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003fd40bdd/0x3234de053c4d011 lrc: 3/0,0 mode: PR/PR res: [0x2b4b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf1a6 expref: 1683 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.459682:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.459683:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4f1c8 lrc: 4/0,0 mode: PR/PR res: [0x2b4ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a0a expref: 1683 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.459686:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fd40bdd/0x3234de053c4d011 lrc: 0/0,0 mode: --/PR res: [0x2b4b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf1a6 expref: 1683 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.459687:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4f1c8 lrc: 3/0,0 mode: PR/PR res: [0x2b4ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a0a expref: 1683 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.459690:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.459690:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.459691:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c502a0 lrc: 3/0,1 mode: PW/PW res: [0x2b4b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459693:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008270dfe9/0x3234de053c4f1c8 lrc: 0/0,0 mode: --/PR res: [0x2b4ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a0a expref: 1682 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.459694:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c502a0 lrc: 4/0,1 mode: PW/PW res: [0x2b4b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459696:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.459697:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.459698:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002e85da3f/0x3234de053c502a7 lrc: 3/0,1 mode: PW/PW res: [0x2b4ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459700:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e85da3f/0x3234de053c502a7 lrc: 4/0,1 mode: PW/PW res: [0x2b4ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459704:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.459711:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1681:41279:x1731746396252160:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 37us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.459713:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11669 00010000:00010000:1.0:1651529344.459714:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.459718:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11671 00000100:00100000:1.0:1651529344.459720:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1680:41279:x1731746396252288:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.459720:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085af61db pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1680:41278:x1731746396252224:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.459722:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.459723:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11670 00010000:00010000:0.0:1651529344.459724:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006b6f07f6/0x3234de053c4f69f lrc: 4/0,0 mode: PR/PR res: [0x2b4b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d4a expref: 1680 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.459729:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11672 00000100:00100000:1.0:1651529344.459730:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b5574957 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1679:41279:x1731746396252416:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.459730:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006b6f07f6/0x3234de053c4f69f lrc: 3/0,0 mode: PR/PR res: [0x2b4b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d4a expref: 1679 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.459733:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.459743:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000066ae2b40/0x3234de053c4f5a3 lrc: 4/0,0 mode: PR/PR res: [0x2b4b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8906 expref: 1679 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.459744:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b6f07f6/0x3234de053c4f69f lrc: 0/0,0 mode: --/PR res: [0x2b4b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d4a expref: 1679 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.459747:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000066ae2b40/0x3234de053c4f5a3 lrc: 3/0,0 mode: PR/PR res: [0x2b4b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8906 expref: 1678 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.459747:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.459748:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.459749:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009a42426c/0x3234de053c50299 lrc: 3/0,1 mode: PW/PW res: [0x2b4b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459752:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066ae2b40/0x3234de053c4f5a3 lrc: 0/0,0 mode: --/PR res: [0x2b4b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8906 expref: 1678 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.459752:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a42426c/0x3234de053c50299 lrc: 4/0,1 mode: PW/PW res: [0x2b4b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459755:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.459756:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.459757:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000431e46a9/0x3234de053c502b5 lrc: 3/0,1 mode: PW/PW res: [0x2b4b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459758:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.459760:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000431e46a9/0x3234de053c502b5 lrc: 4/0,1 mode: PW/PW res: [0x2b4b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.459764:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085af61db pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1677:41278:x1731746396252224:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 44us (210us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.459766:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.459767:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11671 00000100:00100000:0.0:1651529344.459771:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11673 00000100:00100000:1.0:1651529344.459772:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b5574957 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1676:41279:x1731746396252416:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.459773:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1676:41278:x1731746396252352:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.459774:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11672 00010000:00010000:0.0:1651529344.459775:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.459777:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c49f8f lrc: 4/0,0 mode: PR/PR res: [0x2b4bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb458 expref: 1675 pid: 106695 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.459780:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c49f8f lrc: 3/0,0 mode: PR/PR res: [0x2b4bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb458 expref: 1675 pid: 106695 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.459784:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000431e46a9/0x3234de053c502b5 lrc: 3/0,1 mode: PW/PW res: [0x2b4b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459785:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c49f8f lrc: 0/0,0 mode: --/PR res: [0x2b4bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb458 expref: 1675 pid: 106695 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.459787:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000431e46a9/0x3234de053c502b5 lrc: 3/0,1 mode: PW/PW res: [0x2b4b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459788:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.459789:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.459790:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000431e46a9/0x3234de053c502b5 lrc: 3/0,1 mode: PW/PW res: [0x2b4b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459790:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c502ae lrc: 3/0,1 mode: PW/PW res: [0x2b4bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459792:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c502ae lrc: 4/0,1 mode: PW/PW res: [0x2b4bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459795:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000431e46a9/0x3234de053c502b5 lrc: 2/0,0 mode: PW/PW res: [0x2b4b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459798:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.459810:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1674:41278:x1731746396252352:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 29us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.459813:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11673 00010000:00010000:0.0:1651529344.459820:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000431e46a9/0x3234de053c502b5 lrc: 2/0,0 mode: PW/PW res: [0x2b4b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459823:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000431e46a9 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.459824:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000431e46a9/0x3234de053c502b5 lrc: 2/0,0 mode: PW/PW res: [0x2b4b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459827:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000431e46a9/0x3234de053c502b5 lrc: 3/0,0 mode: PW/PW res: [0x2b4b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459831:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000431e46a9/0x3234de053c502b5 lrc: 1/0,0 mode: --/PW res: [0x2b4b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459836:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000431e46a9/0x3234de053c502b5 lrc: 0/0,0 mode: --/PW res: [0x2b4b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.459837:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+389:39030:x1731745946371200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 831us (989us total) trans 12885078942 rc 0/0 00000100:00100000:1.0:1651529344.459840:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210891 00010000:00010000:0.0:1651529344.459841:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c502ae lrc: 3/0,1 mode: PW/PW res: [0x2b4bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459844:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c502ae lrc: 3/0,1 mode: PW/PW res: [0x2b4bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459847:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c502a0 lrc: 3/0,1 mode: PW/PW res: [0x2b4b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459847:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c502ae lrc: 3/0,1 mode: PW/PW res: [0x2b4bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459850:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c502a0 lrc: 3/0,1 mode: PW/PW res: [0x2b4b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459850:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c502ae lrc: 2/0,0 mode: PW/PW res: [0x2b4bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459853:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c502a0 lrc: 3/0,1 mode: PW/PW res: [0x2b4b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459856:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c502a0 lrc: 2/0,0 mode: PW/PW res: [0x2b4b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.459893:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+390:39029:x1731745946371136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 992us (1050us total) trans 12885078943 rc 0/0 00000100:00100000:1.0:1651529344.459895:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210888 00000100:00100000:0.0:1651529344.459898:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+389:39030:x1731745946371328:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 933us (1033us total) trans 12885078944 rc 0/0 00000100:00100000:0.0:1651529344.459901:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210890 00010000:00010000:1.0:1651529344.459902:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002e85da3f/0x3234de053c502a7 lrc: 3/0,1 mode: PW/PW res: [0x2b4ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459905:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e85da3f/0x3234de053c502a7 lrc: 3/0,1 mode: PW/PW res: [0x2b4ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459909:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c502ae lrc: 2/0,0 mode: PW/PW res: [0x2b4bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.459910:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e85da3f/0x3234de053c502a7 lrc: 3/0,1 mode: PW/PW res: [0x2b4ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459912:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dcd3e2d1 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.459913:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e85da3f/0x3234de053c502a7 lrc: 2/0,0 mode: PW/PW res: [0x2b4ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459913:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c502ae lrc: 2/0,0 mode: PW/PW res: [0x2b4bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459916:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c502ae lrc: 3/0,0 mode: PW/PW res: [0x2b4bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459928:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c502ae lrc: 1/0,0 mode: --/PW res: [0x2b4bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459931:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c502ae lrc: 0/0,0 mode: --/PW res: [0x2b4bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459935:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c502a0 lrc: 2/0,0 mode: PW/PW res: [0x2b4b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459938:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ac1d189d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.459939:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c502a0 lrc: 2/0,0 mode: PW/PW res: [0x2b4b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459941:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c502a0 lrc: 3/0,0 mode: PW/PW res: [0x2b4b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459945:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c502a0 lrc: 1/0,0 mode: --/PW res: [0x2b4b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459947:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c502a0 lrc: 0/0,0 mode: --/PW res: [0x2b4b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.459950:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+389:39029:x1731745946371264:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 990us (1092us total) trans 12885078945 rc 0/0 00010000:00010000:0.0:1651529344.459950:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e85da3f/0x3234de053c502a7 lrc: 2/0,0 mode: PW/PW res: [0x2b4ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.459953:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210889 00010000:00010000:0.0:1651529344.459953:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002e85da3f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.459954:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e85da3f/0x3234de053c502a7 lrc: 2/0,0 mode: PW/PW res: [0x2b4ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459957:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e85da3f/0x3234de053c502a7 lrc: 3/0,0 mode: PW/PW res: [0x2b4ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459960:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e85da3f/0x3234de053c502a7 lrc: 1/0,0 mode: --/PW res: [0x2b4ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459962:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e85da3f/0x3234de053c502a7 lrc: 0/0,0 mode: --/PW res: [0x2b4ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459969:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009a42426c/0x3234de053c50299 lrc: 3/0,1 mode: PW/PW res: [0x2b4b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459971:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a42426c/0x3234de053c50299 lrc: 3/0,1 mode: PW/PW res: [0x2b4b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459974:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a42426c/0x3234de053c50299 lrc: 3/0,1 mode: PW/PW res: [0x2b4b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.459977:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a42426c/0x3234de053c50299 lrc: 2/0,0 mode: PW/PW res: [0x2b4b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.459980:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.460012:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+389:39030:x1731745946371072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1117us (1178us total) trans 12885078946 rc 0/0 00000100:00100000:0.0:1651529344.460015:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210887 00010000:00010000:0.0:1651529344.460022:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a42426c/0x3234de053c50299 lrc: 2/0,0 mode: PW/PW res: [0x2b4b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.460027:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009a42426c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.460028:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a42426c/0x3234de053c50299 lrc: 2/0,0 mode: PW/PW res: [0x2b4b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.460031:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a42426c/0x3234de053c50299 lrc: 3/0,0 mode: PW/PW res: [0x2b4b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.460035:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a42426c/0x3234de053c50299 lrc: 1/0,0 mode: --/PW res: [0x2b4b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.460038:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a42426c/0x3234de053c50299 lrc: 0/0,0 mode: --/PW res: [0x2b4b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.460044:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396252480 00010000:00010000:0.0:1651529344.460048:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005976006a/0x3234de053c4d527 lrc: 5/0,0 mode: PR/PR res: [0x2b4bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0691 expref: 1674 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.460055:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11674 00000100:00100000:0.0:1651529344.460056:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085af61db pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1674:41278:x1731746396252480:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.460059:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.460060:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005976006a/0x3234de053c4d527 lrc: 5/0,0 mode: PR/PR res: [0x2b4bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0691 expref: 1674 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.460064:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005976006a/0x3234de053c4d527 lrc: 4/0,0 mode: PR/PR res: [0x2b4bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0691 expref: 1674 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.460071:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.460072:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.460072:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f3e1d739/0x3234de053c502bc lrc: 3/0,1 mode: PW/PW res: [0x2b4bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.460075:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3e1d739/0x3234de053c502bc lrc: 4/0,1 mode: PW/PW res: [0x2b4bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.460079:0:80280:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005976006a/0x3234de053c4d527 lrc: 0/0,0 mode: --/PR res: [0x2b4bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0691 expref: 1674 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.460080:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.460084:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000974b675b pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996963840:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.460087:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f3e1d739/0x3234de053c502bc lrc: 3/0,1 mode: PW/PW res: [0x2b4bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.460091:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f3e1d739/0x3234de053c502bc lrc: 3/0,1 mode: PW/PW res: [0x2b4bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.460093:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3e1d739/0x3234de053c502bc lrc: 3/0,1 mode: PW/PW res: [0x2b4bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.460096:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3e1d739/0x3234de053c502bc lrc: 3/0,1 mode: PW/PW res: [0x2b4bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.460101:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3e1d739/0x3234de053c502bc lrc: 2/0,0 mode: PW/PW res: [0x2b4bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.460127:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085af61db pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1673:41278:x1731746396252480:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 69us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.460130:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11674 00010000:00010000:0.0:1651529344.460136:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3e1d739/0x3234de053c502bc lrc: 2/0,0 mode: PW/PW res: [0x2b4bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.460140:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f3e1d739 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.460141:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3e1d739/0x3234de053c502bc lrc: 2/0,0 mode: PW/PW res: [0x2b4bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.460150:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+389:39029:x1731745946371392:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 884us (1093us total) trans 12885078947 rc 0/0 00000100:00100000:1.0:1651529344.460153:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210892 00010000:00010000:0.0:1651529344.460155:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3e1d739/0x3234de053c502bc lrc: 3/0,0 mode: PW/PW res: [0x2b4bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.460160:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3e1d739/0x3234de053c502bc lrc: 1/0,0 mode: --/PW res: [0x2b4bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.460163:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3e1d739/0x3234de053c502bc lrc: 0/0,0 mode: --/PW res: [0x2b4bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.460191:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996963904:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.460195:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c502c3 lrc: 3/0,1 mode: --/PW res: [0x2b4bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.460215:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.460281:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.460292:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.460292:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946372096 00000100:00100000:1.0:1651529344.460302:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.460313:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946372160 00000100:00100000:0.0:1651529344.460320:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946372288 00000100:00100000:0.0:1651529344.460326:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210895 00000100:00100000:0.0:1651529344.460328:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+391:39030:x1731745946372096:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.460333:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177343 count 1 00000100:00100000:1.0:1651529344.460336:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.460338:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089368d5b/0x3234de053c502d1 lrc: 3/0,1 mode: --/PW res: [0x2b4bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.460352:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.460361:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f2079d39/0x3234de053c4e3ba lrc: 2/0,0 mode: PR/PR res: [0x2b4bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d400b expref: 1672 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.460363:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.460365:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.460365:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.460371:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089368d5b/0x3234de053c502d1 lrc: 4/0,1 mode: --/PW res: [0x2b4bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.460373:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.460379:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f2079d39/0x3234de053c4e3ba lrc: 3/0,0 mode: PR/PR res: [0x2b4bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d400b expref: 1672 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.460382:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e5997468 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996963968:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.460383:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f2079d39/0x3234de053c4e3ba lrc: 4/0,0 mode: PR/PR res: [0x2b4bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d400b expref: 1672 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.460387:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000090168046/0x3234de053c502ca lrc: 3/0,1 mode: --/PW res: [0x2b4be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.460390:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996964032:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.460393:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946372224 00000100:00100000:1.0:1651529344.460403:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946372352 00000100:00100000:1.0:1651529344.460410:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946372416 00000100:00100000:0.0:1651529344.460411:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060852af0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.460417:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210896 00000100:00100000:1.0:1651529344.460419:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+394:39030:x1731745946372160:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.460419:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210897 00000100:00100000:0.0:1651529344.460421:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000465868b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+394:39029:x1731745946372288:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.460424:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177344 count 1 00002000:00080000:0.0:1651529344.460426:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177346 count 1 00010000:00010000:1.0:1651529344.460428:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c502d8 lrc: 3/0,1 mode: --/PW res: [0x2b4c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.460430:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eec80574/0x3234de053c502df lrc: 3/0,1 mode: --/PW res: [0x2b4c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.460432:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cf51282c/0x3234de053c4cbcd lrc: 2/0,0 mode: PR/PR res: [0x2b4c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce106 expref: 1672 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.460435:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c4d574 lrc: 2/0,0 mode: PR/PR res: [0x2b4c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0763 expref: 1672 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.460436:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.460436:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.460437:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c502d8 lrc: 4/0,1 mode: --/PW res: [0x2b4c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.460438:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.460438:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.460439:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eec80574/0x3234de053c502df lrc: 4/0,1 mode: --/PW res: [0x2b4c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.460443:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cf51282c/0x3234de053c4cbcd lrc: 3/0,0 mode: PR/PR res: [0x2b4c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce106 expref: 1672 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.460445:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c4d574 lrc: 3/0,0 mode: PR/PR res: [0x2b4c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0763 expref: 1672 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.460447:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cf51282c/0x3234de053c4cbcd lrc: 4/0,0 mode: PR/PR res: [0x2b4c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce106 expref: 1672 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.460448:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c4d574 lrc: 4/0,0 mode: PR/PR res: [0x2b4c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0763 expref: 1672 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.460451:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e5997468 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996964096:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.460452:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996964160:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.460460:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b52d0f36 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.460462:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e7e12492 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.460467:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210898 00000100:00100000:1.0:1651529344.460469:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+394:39030:x1731745946372224:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.460469:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210899 00000100:00100000:0.0:1651529344.460471:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+394:39030:x1731745946372352:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.460473:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177345 count 1 00002000:00080000:0.0:1651529344.460475:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177347 count 1 00010000:00010000:1.0:1651529344.460476:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c35066cf/0x3234de053c502e6 lrc: 3/0,1 mode: --/PW res: [0x2b4c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.460478:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051652053/0x3234de053c502ed lrc: 3/0,1 mode: --/PW res: [0x2b4c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.460480:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c4e09c lrc: 2/0,0 mode: PR/PR res: [0x2b4c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3307 expref: 1672 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.460483:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.460483:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002c499a55/0x3234de053c4b418 lrc: 2/0,0 mode: PR/PR res: [0x2b4c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc1e8 expref: 1672 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.460484:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.460484:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c35066cf/0x3234de053c502e6 lrc: 4/0,1 mode: --/PW res: [0x2b4c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.460485:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.460486:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.460487:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051652053/0x3234de053c502ed lrc: 4/0,1 mode: --/PW res: [0x2b4c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.460490:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c4e09c lrc: 3/0,0 mode: PR/PR res: [0x2b4c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3307 expref: 1672 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.460492:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002c499a55/0x3234de053c4b418 lrc: 3/0,0 mode: PR/PR res: [0x2b4c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc1e8 expref: 1672 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.460494:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c4e09c lrc: 4/0,0 mode: PR/PR res: [0x2b4c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3307 expref: 1672 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.460496:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002c499a55/0x3234de053c4b418 lrc: 4/0,0 mode: PR/PR res: [0x2b4c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc1e8 expref: 1672 pid: 72395 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.460498:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006731397d pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996964224:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.460500:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996964288:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.460504:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f79d8146 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.460506:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a3b00cf3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.460510:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210900 00000100:00100000:1.0:1651529344.460511:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+394:39029:x1731745946372416:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.460514:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396252800 00002000:00080000:1.0:1651529344.460515:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177348 count 1 00010000:00010000:0.0:1651529344.460518:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008ce5f676/0x3234de053c4d0ce lrc: 4/0,0 mode: PR/PR res: [0x2b4be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf4e0 expref: 1673 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.460519:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c502f4 lrc: 3/0,1 mode: --/PW res: [0x2b4c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.460523:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a091a01a/0x3234de053c4c6b0 lrc: 2/0,0 mode: PR/PR res: [0x2b4c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cccb5 expref: 1673 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.460529:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396252736 00010000:00010000:0.0:1651529344.460532:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bb3755a2/0x3234de053c4ceba lrc: 4/0,0 mode: PR/PR res: [0x2b4bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cecc8 expref: 1674 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.460533:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.460533:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.460534:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c502f4 lrc: 4/0,1 mode: --/PW res: [0x2b4c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.460542:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11675 00000100:00100000:0.0:1651529344.460544:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1674:41279:x1731746396252800:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.460545:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a091a01a/0x3234de053c4c6b0 lrc: 3/0,0 mode: PR/PR res: [0x2b4c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cccb5 expref: 1674 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.460547:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.460548:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008ce5f676/0x3234de053c4d0ce lrc: 4/0,0 mode: PR/PR res: [0x2b4be:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf4e0 expref: 1674 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.460552:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a091a01a/0x3234de053c4c6b0 lrc: 4/0,0 mode: PR/PR res: [0x2b4c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cccb5 expref: 1674 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.460552:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008ce5f676/0x3234de053c4d0ce lrc: 3/0,0 mode: PR/PR res: [0x2b4be:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf4e0 expref: 1674 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.460556:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000974b675b pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996964352:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.460557:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ce5f676/0x3234de053c4d0ce lrc: 0/0,0 mode: --/PR res: [0x2b4be:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf4e0 expref: 1674 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.460561:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.460561:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.460562:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000090168046/0x3234de053c502ca lrc: 3/0,1 mode: PW/PW res: [0x2b4be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.460563:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b7af823 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.460565:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090168046/0x3234de053c502ca lrc: 4/0,1 mode: PW/PW res: [0x2b4be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.460570:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11676 00010000:00010000:0.0:1651529344.460573:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.460578:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1673:41278:x1731746396252736:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.460580:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1673:41279:x1731746396252800:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 35us (288us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.460581:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.460582:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bb3755a2/0x3234de053c4ceba lrc: 4/0,0 mode: PR/PR res: [0x2b4bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cecc8 expref: 1673 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.460583:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11675 00010000:00010000:1.0:1651529344.460587:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bb3755a2/0x3234de053c4ceba lrc: 3/0,0 mode: PR/PR res: [0x2b4bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cecc8 expref: 1672 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.460592:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb3755a2/0x3234de053c4ceba lrc: 0/0,0 mode: --/PR res: [0x2b4bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cecc8 expref: 1672 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.460596:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.460596:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.460597:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c502c3 lrc: 3/0,1 mode: PW/PW res: [0x2b4bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.460600:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c502c3 lrc: 4/0,1 mode: PW/PW res: [0x2b4bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.460612:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.460616:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c502c3 lrc: 3/0,1 mode: PW/PW res: [0x2b4bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.460618:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1671:41278:x1731746396252736:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 46us (282us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.460620:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c502c3 lrc: 3/0,1 mode: PW/PW res: [0x2b4bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.460621:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11676 00010000:00010000:0.0:1651529344.460623:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c502c3 lrc: 3/0,1 mode: PW/PW res: [0x2b4bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.460626:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c502c3 lrc: 2/0,0 mode: PW/PW res: [0x2b4bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.460628:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000090168046/0x3234de053c502ca lrc: 3/0,1 mode: PW/PW res: [0x2b4be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.460632:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090168046/0x3234de053c502ca lrc: 3/0,1 mode: PW/PW res: [0x2b4be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.460635:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090168046/0x3234de053c502ca lrc: 3/0,1 mode: PW/PW res: [0x2b4be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.460637:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090168046/0x3234de053c502ca lrc: 2/0,0 mode: PW/PW res: [0x2b4be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.460672:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+396:39029:x1731745946371648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1161us (1199us total) trans 12885078948 rc 0/0 00000100:00100000:0.0:1651529344.460676:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210893 00000100:00100000:1.0:1651529344.460679:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+395:39029:x1731745946371712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1048us (1132us total) trans 12885078949 rc 0/0 00000100:00100000:1.0:1651529344.460682:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210894 00010000:00010000:0.0:1651529344.460683:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c502c3 lrc: 2/0,0 mode: PW/PW res: [0x2b4bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.460686:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c78576a1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.460687:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c502c3 lrc: 2/0,0 mode: PW/PW res: [0x2b4bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.460690:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c502c3 lrc: 3/0,0 mode: PW/PW res: [0x2b4bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.460694:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c502c3 lrc: 1/0,0 mode: --/PW res: [0x2b4bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.460697:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c502c3 lrc: 0/0,0 mode: --/PW res: [0x2b4bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.460702:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090168046/0x3234de053c502ca lrc: 2/0,0 mode: PW/PW res: [0x2b4be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.460704:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000090168046 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.460705:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090168046/0x3234de053c502ca lrc: 2/0,0 mode: PW/PW res: [0x2b4be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.460708:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090168046/0x3234de053c502ca lrc: 3/0,0 mode: PW/PW res: [0x2b4be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.460711:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090168046/0x3234de053c502ca lrc: 1/0,0 mode: --/PW res: [0x2b4be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.460714:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090168046/0x3234de053c502ca lrc: 0/0,0 mode: --/PW res: [0x2b4be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.460846:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.460860:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.460874:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946372672 00000100:00100000:1.0:1651529344.460884:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946372736 00000100:00100000:1.0:1651529344.460888:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210901 00000100:00100000:1.0:1651529344.460890:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+396:39029:x1731745946372672:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.460891:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210902 00000100:00100000:0.0:1651529344.460893:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+396:39030:x1731745946372736:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.460895:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177349 count 1 00002000:00080000:0.0:1651529344.460899:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177350 count 1 00010000:00010000:1.0:1651529344.460900:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c502fb lrc: 3/0,1 mode: --/PW res: [0x2b4c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.460903:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d4bb628/0x3234de053c50302 lrc: 3/0,1 mode: --/PW res: [0x2b4c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.460905:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000070f3f156/0x3234de053c4da05 lrc: 2/0,0 mode: PR/PR res: [0x2b4c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d18b9 expref: 1670 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.460907:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000088155288/0x3234de053c4d535 lrc: 2/0,0 mode: PR/PR res: [0x2b4c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d06c9 expref: 1670 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.460908:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.460908:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.460909:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c502fb lrc: 4/0,1 mode: --/PW res: [0x2b4c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.460910:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.460911:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.460912:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d4bb628/0x3234de053c50302 lrc: 4/0,1 mode: --/PW res: [0x2b4c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.460916:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000070f3f156/0x3234de053c4da05 lrc: 3/0,0 mode: PR/PR res: [0x2b4c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d18b9 expref: 1670 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.460919:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000070f3f156/0x3234de053c4da05 lrc: 4/0,0 mode: PR/PR res: [0x2b4c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d18b9 expref: 1670 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.460919:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000088155288/0x3234de053c4d535 lrc: 3/0,0 mode: PR/PR res: [0x2b4c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d06c9 expref: 1670 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.460922:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000088155288/0x3234de053c4d535 lrc: 4/0,0 mode: PR/PR res: [0x2b4c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d06c9 expref: 1670 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.460923:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ebb53b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996964416:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.460927:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996964480:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.460934:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 0000000071742acc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.460936:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 000000003003c8b0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.461140:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996964032:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.461159:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.461166:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.461167:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000089368d5b/0x3234de053c502d1 lrc: 3/0,1 mode: --/PW res: [0x2b4bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.461174:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.461181:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996964160:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.461185:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eec80574/0x3234de053c502df lrc: 3/0,1 mode: --/PW res: [0x2b4c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.461196:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996964288:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.461199:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000051652053/0x3234de053c502ed lrc: 3/0,1 mode: --/PW res: [0x2b4c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.461205:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396253312 00010000:00010000:0.0:1651529344.461209:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c4d574 lrc: 4/0,0 mode: PR/PR res: [0x2b4c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0763 expref: 1671 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.461215:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e5997468 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996964096:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.461216:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396253184 00010000:00010000:0.0:1651529344.461218:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f2079d39/0x3234de053c4e3ba lrc: 4/0,0 mode: PR/PR res: [0x2b4bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d400b expref: 1672 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.461219:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c502d8 lrc: 3/0,1 mode: --/PW res: [0x2b4c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.461237:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396253248 00010000:00010000:0.0:1651529344.461241:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cf51282c/0x3234de053c4cbcd lrc: 4/0,0 mode: PR/PR res: [0x2b4c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce106 expref: 1673 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.461242:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006731397d pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996964224:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.461245:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c35066cf/0x3234de053c502e6 lrc: 3/0,1 mode: --/PW res: [0x2b4c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.461247:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11677 00000100:00100000:0.0:1651529344.461248:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1673:41279:x1731746396253312:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.461251:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000974b675b pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996964352:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.461251:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.461253:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c502f4 lrc: 3/0,1 mode: --/PW res: [0x2b4c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461253:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c4d574 lrc: 4/0,0 mode: PR/PR res: [0x2b4c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0763 expref: 1673 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.461256:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c4d574 lrc: 3/0,0 mode: PR/PR res: [0x2b4c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0763 expref: 1673 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.461260:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11678 00000100:00100000:1.0:1651529344.461262:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1673:41279:x1731746396253184:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.461262:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c4d574 lrc: 0/0,0 mode: --/PR res: [0x2b4c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0763 expref: 1673 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.461265:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.461265:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.461266:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.461267:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f2079d39/0x3234de053c4e3ba lrc: 4/0,0 mode: PR/PR res: [0x2b4bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d400b expref: 1672 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.461267:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eec80574/0x3234de053c502df lrc: 3/0,1 mode: PW/PW res: [0x2b4c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461270:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eec80574/0x3234de053c502df lrc: 4/0,1 mode: PW/PW res: [0x2b4c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.461271:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f2079d39/0x3234de053c4e3ba lrc: 3/0,0 mode: PR/PR res: [0x2b4bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d400b expref: 1672 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.461276:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2079d39/0x3234de053c4e3ba lrc: 0/0,0 mode: --/PR res: [0x2b4bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d400b expref: 1672 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.461276:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.461280:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.461281:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.461282:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000089368d5b/0x3234de053c502d1 lrc: 3/0,1 mode: PW/PW res: [0x2b4bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.461285:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089368d5b/0x3234de053c502d1 lrc: 4/0,1 mode: PW/PW res: [0x2b4bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.461289:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1671:41279:x1731746396253312:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.461292:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11677 00000100:00100000:0.0:1651529344.461297:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11679 00010000:00010000:1.0:1651529344.461300:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.461304:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e3dc394f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1670:41279:x1731746396253248:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.461307:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1670:41279:x1731746396253184:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 45us (140us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.461307:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.461309:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cf51282c/0x3234de053c4cbcd lrc: 4/0,0 mode: PR/PR res: [0x2b4c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce106 expref: 1670 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.461310:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11678 00010000:00010000:0.0:1651529344.461313:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cf51282c/0x3234de053c4cbcd lrc: 3/0,0 mode: PR/PR res: [0x2b4c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce106 expref: 1670 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.461317:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf51282c/0x3234de053c4cbcd lrc: 0/0,0 mode: --/PR res: [0x2b4c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce106 expref: 1669 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.461321:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.461321:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.461322:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c502d8 lrc: 3/0,1 mode: PW/PW res: [0x2b4c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461325:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c502d8 lrc: 4/0,1 mode: PW/PW res: [0x2b4c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461333:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.461339:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e3dc394f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1668:41279:x1731746396253248:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.461342:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11679 00010000:00010000:1.0:1651529344.461368:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c502d8 lrc: 3/0,1 mode: PW/PW res: [0x2b4c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.461376:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c502d8 lrc: 3/0,1 mode: PW/PW res: [0x2b4c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461376:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eec80574/0x3234de053c502df lrc: 3/0,1 mode: PW/PW res: [0x2b4c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.461380:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c502d8 lrc: 3/0,1 mode: PW/PW res: [0x2b4c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.461382:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c502d8 lrc: 2/0,0 mode: PW/PW res: [0x2b4c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461395:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eec80574/0x3234de053c502df lrc: 3/0,1 mode: PW/PW res: [0x2b4c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461399:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eec80574/0x3234de053c502df lrc: 3/0,1 mode: PW/PW res: [0x2b4c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461402:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eec80574/0x3234de053c502df lrc: 2/0,0 mode: PW/PW res: [0x2b4c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.461427:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+397:39030:x1731745946372160:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1007us (1151us total) trans 12885078950 rc 0/0 00000100:00100000:1.0:1651529344.461430:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210896 00000100:00100000:0.0:1651529344.461456:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000465868b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+397:39029:x1731745946372288:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1034us (1154us total) trans 12885078951 rc 0/0 00000100:00100000:0.0:1651529344.461459:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210897 00010000:00010000:0.0:1651529344.461467:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c502d8 lrc: 2/0,0 mode: PW/PW res: [0x2b4c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461470:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000009c5cbe9 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.461471:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c502d8 lrc: 2/0,0 mode: PW/PW res: [0x2b4c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461474:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c502d8 lrc: 3/0,0 mode: PW/PW res: [0x2b4c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.461475:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.461485:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c502d8 lrc: 1/0,0 mode: --/PW res: [0x2b4c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461489:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009c5cbe9/0x3234de053c502d8 lrc: 0/0,0 mode: --/PW res: [0x2b4c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461493:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eec80574/0x3234de053c502df lrc: 2/0,0 mode: PW/PW res: [0x2b4c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461495:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eec80574 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.461496:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eec80574/0x3234de053c502df lrc: 2/0,0 mode: PW/PW res: [0x2b4c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.461504:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.461512:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eec80574/0x3234de053c502df lrc: 3/0,0 mode: PW/PW res: [0x2b4c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.461514:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.461516:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eec80574/0x3234de053c502df lrc: 1/0,0 mode: --/PW res: [0x2b4c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461519:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eec80574/0x3234de053c502df lrc: 0/0,0 mode: --/PW res: [0x2b4c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.461520:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.461526:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000089368d5b/0x3234de053c502d1 lrc: 3/0,1 mode: PW/PW res: [0x2b4bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.461534:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.461534:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089368d5b/0x3234de053c502d1 lrc: 3/0,1 mode: PW/PW res: [0x2b4bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461537:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089368d5b/0x3234de053c502d1 lrc: 3/0,1 mode: PW/PW res: [0x2b4bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461540:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089368d5b/0x3234de053c502d1 lrc: 2/0,0 mode: PW/PW res: [0x2b4bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.461542:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ebb53b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996964416:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.461546:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c502fb lrc: 3/0,1 mode: --/PW res: [0x2b4c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.461552:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396253376 00010000:00010000:1.0:1651529344.461557:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c4e09c lrc: 4/0,0 mode: PR/PR res: [0x2b4c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3307 expref: 1668 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.461563:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396253504 00010000:00010000:1.0:1651529344.461565:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002c499a55/0x3234de053c4b418 lrc: 4/0,0 mode: PR/PR res: [0x2b4c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc1e8 expref: 1669 pid: 72395 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.461569:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396253632 00010000:00010000:1.0:1651529344.461571:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a091a01a/0x3234de053c4c6b0 lrc: 4/0,0 mode: PR/PR res: [0x2b4c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cccb5 expref: 1670 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.461575:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396253760 00010000:00010000:1.0:1651529344.461577:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000070f3f156/0x3234de053c4da05 lrc: 4/0,0 mode: PR/PR res: [0x2b4c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d18b9 expref: 1671 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.461583:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+397:39030:x1731745946372096:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1253us (1368us total) trans 12885078952 rc 0/0 00000100:00100000:0.0:1651529344.461586:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210895 00000100:00100000:1.0:1651529344.461588:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396253824 00010000:00010000:1.0:1651529344.461591:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000088155288/0x3234de053c4d535 lrc: 5/0,0 mode: PR/PR res: [0x2b4c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d06c9 expref: 1672 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.461595:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11680 00000100:00100000:1.0:1651529344.461597:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1672:41279:x1731746396253376:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.461600:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.461601:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c4e09c lrc: 4/0,0 mode: PR/PR res: [0x2b4c1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3307 expref: 1672 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.461604:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c4e09c lrc: 3/0,0 mode: PR/PR res: [0x2b4c1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3307 expref: 1672 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.461605:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089368d5b/0x3234de053c502d1 lrc: 2/0,0 mode: PW/PW res: [0x2b4bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461609:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000089368d5b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.461610:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089368d5b/0x3234de053c502d1 lrc: 2/0,0 mode: PW/PW res: [0x2b4bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.461613:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c4e09c lrc: 0/0,0 mode: --/PR res: [0x2b4c1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3307 expref: 1672 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.461613:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089368d5b/0x3234de053c502d1 lrc: 3/0,0 mode: PW/PW res: [0x2b4bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.461617:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.461617:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.461617:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089368d5b/0x3234de053c502d1 lrc: 1/0,0 mode: --/PW res: [0x2b4bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.461618:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c35066cf/0x3234de053c502e6 lrc: 3/0,1 mode: PW/PW res: [0x2b4c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461620:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089368d5b/0x3234de053c502d1 lrc: 0/0,0 mode: --/PW res: [0x2b4bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.461621:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c35066cf/0x3234de053c502e6 lrc: 4/0,1 mode: PW/PW res: [0x2b4c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.461627:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.461627:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11681 00000100:00100000:0.0:1651529344.461629:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1671:41279:x1731746396253504:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.461632:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.461634:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1671:41279:x1731746396253376:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 36us (160us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.461634:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002c499a55/0x3234de053c4b418 lrc: 4/0,0 mode: PR/PR res: [0x2b4c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc1e8 expref: 1671 pid: 72395 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.461637:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11680 00010000:00010000:0.0:1651529344.461638:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002c499a55/0x3234de053c4b418 lrc: 3/0,0 mode: PR/PR res: [0x2b4c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc1e8 expref: 1671 pid: 72395 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.461641:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11682 00000100:00100000:1.0:1651529344.461643:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1670:41279:x1731746396253632:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.461643:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c499a55/0x3234de053c4b418 lrc: 0/0,0 mode: --/PR res: [0x2b4c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc1e8 expref: 1670 pid: 72395 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.461645:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.461646:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a091a01a/0x3234de053c4c6b0 lrc: 4/0,0 mode: PR/PR res: [0x2b4c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cccb5 expref: 1669 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.461646:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.461647:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.461648:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000051652053/0x3234de053c502ed lrc: 3/0,1 mode: PW/PW res: [0x2b4c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.461650:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a091a01a/0x3234de053c4c6b0 lrc: 3/0,0 mode: PR/PR res: [0x2b4c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cccb5 expref: 1669 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.461650:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051652053/0x3234de053c502ed lrc: 4/0,1 mode: PW/PW res: [0x2b4c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.461654:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a091a01a/0x3234de053c4c6b0 lrc: 0/0,0 mode: --/PR res: [0x2b4c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cccb5 expref: 1669 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.461657:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.461660:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.461661:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.461661:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c502f4 lrc: 3/0,1 mode: PW/PW res: [0x2b4c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.461663:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1668:41279:x1731746396253504:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 33us (159us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.461664:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c502f4 lrc: 4/0,1 mode: PW/PW res: [0x2b4c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.461665:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11681 00010000:00010000:1.0:1651529344.461669:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.461670:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11683 00000100:00100000:0.0:1651529344.461672:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1667:41279:x1731746396253760:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.461674:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1667:41279:x1731746396253632:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 31us (160us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.461674:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.461675:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000070f3f156/0x3234de053c4da05 lrc: 4/0,0 mode: PR/PR res: [0x2b4c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d18b9 expref: 1667 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.461677:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11682 00010000:00010000:0.0:1651529344.461679:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000070f3f156/0x3234de053c4da05 lrc: 3/0,0 mode: PR/PR res: [0x2b4c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d18b9 expref: 1666 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.461680:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11684 00000100:00100000:1.0:1651529344.461682:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1666:41278:x1731746396253824:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.461684:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.461685:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000088155288/0x3234de053c4d535 lrc: 5/0,0 mode: PR/PR res: [0x2b4c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d06c9 expref: 1666 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.461689:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000088155288/0x3234de053c4d535 lrc: 4/0,0 mode: PR/PR res: [0x2b4c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d06c9 expref: 1666 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.461693:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.461694:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.461694:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001d4bb628/0x3234de053c50302 lrc: 3/0,1 mode: PW/PW res: [0x2b4c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.461699:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d4bb628/0x3234de053c50302 lrc: 4/0,1 mode: PW/PW res: [0x2b4c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461702:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070f3f156/0x3234de053c4da05 lrc: 0/0,0 mode: --/PR res: [0x2b4c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d18b9 expref: 1666 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.461703:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.461705:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.461706:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.461707:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1665:41278:x1731746396253824:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 25us (174us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.461707:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c502fb lrc: 3/0,1 mode: PW/PW res: [0x2b4c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.461709:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11684 00010000:00010000:0.0:1651529344.461710:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c502fb lrc: 4/0,1 mode: PW/PW res: [0x2b4c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.461714:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c35066cf/0x3234de053c502e6 lrc: 3/0,1 mode: PW/PW res: [0x2b4c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.461718:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c35066cf/0x3234de053c502e6 lrc: 3/0,1 mode: PW/PW res: [0x2b4c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.461721:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c35066cf/0x3234de053c502e6 lrc: 3/0,1 mode: PW/PW res: [0x2b4c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.461723:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c35066cf/0x3234de053c502e6 lrc: 2/0,0 mode: PW/PW res: [0x2b4c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461729:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.461748:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1664:41279:x1731746396253760:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 76us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.461752:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11683 00010000:00010000:0.0:1651529344.461759:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c35066cf/0x3234de053c502e6 lrc: 2/0,0 mode: PW/PW res: [0x2b4c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461762:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c35066cf already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.461763:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c35066cf/0x3234de053c502e6 lrc: 2/0,0 mode: PW/PW res: [0x2b4c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461766:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c35066cf/0x3234de053c502e6 lrc: 3/0,0 mode: PW/PW res: [0x2b4c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461770:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c35066cf/0x3234de053c502e6 lrc: 1/0,0 mode: --/PW res: [0x2b4c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461776:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c35066cf/0x3234de053c502e6 lrc: 0/0,0 mode: --/PW res: [0x2b4c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.461780:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+397:39030:x1731745946372224:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1310us (1427us total) trans 12885078953 rc 0/0 00010000:00010000:0.0:1651529344.461781:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000051652053/0x3234de053c502ed lrc: 3/0,1 mode: PW/PW res: [0x2b4c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.461783:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210898 00010000:00010000:0.0:1651529344.461784:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051652053/0x3234de053c502ed lrc: 3/0,1 mode: PW/PW res: [0x2b4c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461787:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051652053/0x3234de053c502ed lrc: 3/0,1 mode: PW/PW res: [0x2b4c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.461790:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c502f4 lrc: 3/0,1 mode: PW/PW res: [0x2b4c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461790:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051652053/0x3234de053c502ed lrc: 2/0,0 mode: PW/PW res: [0x2b4c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.461793:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c502f4 lrc: 3/0,1 mode: PW/PW res: [0x2b4c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.461796:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c502f4 lrc: 3/0,1 mode: PW/PW res: [0x2b4c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.461799:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c502f4 lrc: 2/0,0 mode: PW/PW res: [0x2b4c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.461837:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+398:39030:x1731745946372352:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1365us (1473us total) trans 12885078954 rc 0/0 00000100:00100000:0.0:1651529344.461840:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210899 00000100:00100000:1.0:1651529344.461841:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+398:39029:x1731745946372416:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1328us (1467us total) trans 12885078955 rc 0/0 00000100:00100000:1.0:1651529344.461844:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210900 00010000:00010000:0.0:1651529344.461847:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051652053/0x3234de053c502ed lrc: 2/0,0 mode: PW/PW res: [0x2b4c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461850:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000051652053 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.461851:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c502fb lrc: 3/0,1 mode: PW/PW res: [0x2b4c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461851:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051652053/0x3234de053c502ed lrc: 2/0,0 mode: PW/PW res: [0x2b4c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.461854:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c502fb lrc: 3/0,1 mode: PW/PW res: [0x2b4c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461854:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051652053/0x3234de053c502ed lrc: 3/0,0 mode: PW/PW res: [0x2b4c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.461857:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c502fb lrc: 3/0,1 mode: PW/PW res: [0x2b4c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461858:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051652053/0x3234de053c502ed lrc: 1/0,0 mode: --/PW res: [0x2b4c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.461860:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c502fb lrc: 2/0,0 mode: PW/PW res: [0x2b4c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461861:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051652053/0x3234de053c502ed lrc: 0/0,0 mode: --/PW res: [0x2b4c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461865:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c502f4 lrc: 2/0,0 mode: PW/PW res: [0x2b4c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461875:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008531b741 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.461876:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c502f4 lrc: 2/0,0 mode: PW/PW res: [0x2b4c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461879:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c502f4 lrc: 3/0,0 mode: PW/PW res: [0x2b4c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461882:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c502f4 lrc: 1/0,0 mode: --/PW res: [0x2b4c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461885:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c502f4 lrc: 0/0,0 mode: --/PW res: [0x2b4c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461888:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c502fb lrc: 2/0,0 mode: PW/PW res: [0x2b4c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461891:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000011a71df9 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.461891:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c502fb lrc: 2/0,0 mode: PW/PW res: [0x2b4c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461894:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c502fb lrc: 3/0,0 mode: PW/PW res: [0x2b4c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.461896:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+397:39029:x1731745946372672:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1005us (1050us total) trans 12885078956 rc 0/0 00000100:00100000:1.0:1651529344.461898:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210901 00010000:00010000:0.0:1651529344.461898:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c502fb lrc: 1/0,0 mode: --/PW res: [0x2b4c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461900:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c502fb lrc: 0/0,0 mode: --/PW res: [0x2b4c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461912:0:156655:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088155288/0x3234de053c4d535 lrc: 0/0,0 mode: --/PR res: [0x2b4c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d06c9 expref: 1663 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.461915:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996964480:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.461919:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001d4bb628/0x3234de053c50302 lrc: 3/0,1 mode: PW/PW res: [0x2b4c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461922:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001d4bb628/0x3234de053c50302 lrc: 3/0,1 mode: PW/PW res: [0x2b4c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461924:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d4bb628/0x3234de053c50302 lrc: 3/0,1 mode: PW/PW res: [0x2b4c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461928:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d4bb628/0x3234de053c50302 lrc: 3/0,1 mode: PW/PW res: [0x2b4c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.461930:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d4bb628/0x3234de053c50302 lrc: 2/0,0 mode: PW/PW res: [0x2b4c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.461933:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.461948:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.461965:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+397:39030:x1731745946372736:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1071us (1104us total) trans 12885078957 rc 0/0 00000100:00100000:0.0:1651529344.461968:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210902 00000100:00100000:0.0:1651529344.461973:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946372800 00000100:00100000:0.0:1651529344.461979:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946373056 00000100:00100000:0.0:1651529344.461989:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210903 00000100:00100000:0.0:1651529344.461990:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+398:39029:x1731745946372800:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.461995:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177351 count 1 00010000:00010000:0.0:1651529344.461999:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000443c0ff5/0x3234de053c50309 lrc: 3/0,1 mode: --/PW res: [0x2b4c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.462004:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c4e0b1 lrc: 2/0,0 mode: PR/PR res: [0x2b4c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3331 expref: 1662 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.462007:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.462008:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.462008:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000443c0ff5/0x3234de053c50309 lrc: 4/0,1 mode: --/PW res: [0x2b4c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.462015:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c4e0b1 lrc: 3/0,0 mode: PR/PR res: [0x2b4c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3331 expref: 1662 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.462019:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210904 00010000:00010000:0.0:1651529344.462019:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c4e0b1 lrc: 4/0,0 mode: PR/PR res: [0x2b4c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3331 expref: 1662 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.462021:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+398:39030:x1731745946373056:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.462023:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996964544:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.462027:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177352 count 1 00010000:00010000:1.0:1651529344.462031:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c50310 lrc: 3/0,1 mode: --/PW res: [0x2b4c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.462036:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 000000003c8b0daf going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.462042:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ecc067a7/0x3234de053c4d99c lrc: 2/0,0 mode: PR/PR res: [0x2b4c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d16e4 expref: 1662 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.462045:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.462046:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.462046:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c50310 lrc: 4/0,1 mode: --/PW res: [0x2b4c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.462054:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ecc067a7/0x3234de053c4d99c lrc: 3/0,0 mode: PR/PR res: [0x2b4c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d16e4 expref: 1662 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.462057:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ecc067a7/0x3234de053c4d99c lrc: 4/0,0 mode: PR/PR res: [0x2b4c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d16e4 expref: 1662 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.462058:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d4bb628/0x3234de053c50302 lrc: 2/0,0 mode: PW/PW res: [0x2b4c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.462061:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000055e03b4f pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996964608:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.462070:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 0000000057299e7f going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.462070:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001d4bb628 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.462072:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d4bb628/0x3234de053c50302 lrc: 2/0,0 mode: PW/PW res: [0x2b4c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.462075:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d4bb628/0x3234de053c50302 lrc: 3/0,0 mode: PW/PW res: [0x2b4c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.462079:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d4bb628/0x3234de053c50302 lrc: 1/0,0 mode: --/PW res: [0x2b4c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.462082:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d4bb628/0x3234de053c50302 lrc: 0/0,0 mode: --/PW res: [0x2b4c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.462264:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.462275:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946373184 00000100:00100000:1.0:1651529344.462282:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.462301:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.462310:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.462320:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946373248 00000100:00100000:0.0:1651529344.462327:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946373312 00000100:00100000:0.0:1651529344.462332:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946373376 00000100:00100000:0.0:1651529344.462336:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210905 00000100:00100000:0.0:1651529344.462338:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+402:39029:x1731745946373184:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.462343:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177353 count 1 00010000:00010000:0.0:1651529344.462347:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000315faada/0x3234de053c50317 lrc: 3/0,1 mode: --/PW res: [0x2b4c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.462356:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.462357:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006c4e361b/0x3234de053c4e8bb lrc: 2/0,0 mode: PR/PR res: [0x2b4c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d53b4 expref: 1662 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.462361:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.462361:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.462362:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000315faada/0x3234de053c50317 lrc: 4/0,1 mode: --/PW res: [0x2b4c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.462368:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.462369:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006c4e361b/0x3234de053c4e8bb lrc: 3/0,0 mode: PR/PR res: [0x2b4c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d53b4 expref: 1662 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.462376:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.462378:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006c4e361b/0x3234de053c4e8bb lrc: 4/0,0 mode: PR/PR res: [0x2b4c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d53b4 expref: 1662 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.462386:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.462386:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996964672:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.462393:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946373504 00000100:00100000:0.0:1651529344.462401:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 000000003678d25f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.462403:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946373440 00000100:00100000:0.0:1651529344.462407:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210906 00000100:00100000:1.0:1651529344.462409:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210907 00000100:00100000:0.0:1651529344.462409:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+404:39030:x1731745946373248:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.462411:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+404:39029:x1731745946373312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.462414:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177354 count 1 00002000:00080000:1.0:1651529344.462416:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177355 count 1 00010000:00010000:0.0:1651529344.462417:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e75f72f8/0x3234de053c5031e lrc: 3/0,1 mode: --/PW res: [0x2b4ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.462421:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037767785/0x3234de053c50325 lrc: 3/0,1 mode: --/PW res: [0x2b4cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.462421:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000099463d26/0x3234de053c4da2f lrc: 2/0,0 mode: PR/PR res: [0x2b4ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1937 expref: 1662 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.462424:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.462425:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4925414/0x3234de053c4b3b6 lrc: 2/0,0 mode: PR/PR res: [0x2b4cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc1b0 expref: 1662 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.462425:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.462426:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e75f72f8/0x3234de053c5031e lrc: 4/0,1 mode: --/PW res: [0x2b4ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.462428:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.462429:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.462430:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037767785/0x3234de053c50325 lrc: 4/0,1 mode: --/PW res: [0x2b4cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.462434:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000099463d26/0x3234de053c4da2f lrc: 3/0,0 mode: PR/PR res: [0x2b4ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1937 expref: 1662 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.462436:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b4925414/0x3234de053c4b3b6 lrc: 3/0,0 mode: PR/PR res: [0x2b4cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc1b0 expref: 1662 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.462438:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000099463d26/0x3234de053c4da2f lrc: 4/0,0 mode: PR/PR res: [0x2b4ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1937 expref: 1662 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.462440:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b4925414/0x3234de053c4b3b6 lrc: 4/0,0 mode: PR/PR res: [0x2b4cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc1b0 expref: 1662 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.462442:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996964736:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.462444:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000de0edbdc pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996964800:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.462448:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c086aae3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.462452:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a4eb401d going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.462454:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210908 00000100:00100000:0.0:1651529344.462455:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+404:39030:x1731745946373376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.462459:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210909 00002000:00080000:0.0:1651529344.462459:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177356 count 1 00000100:00100000:1.0:1651529344.462460:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+404:39030:x1731745946373504:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.462462:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047d5dd29/0x3234de053c5032c lrc: 3/0,1 mode: --/PW res: [0x2b4cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.462465:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177358 count 1 00010000:00010000:0.0:1651529344.462466:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff5cfa22/0x3234de053c4a0ca lrc: 2/0,0 mode: PR/PR res: [0x2b4cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb895 expref: 1662 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.462468:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c50333 lrc: 3/0,1 mode: --/PW res: [0x2b4ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.462469:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.462470:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.462470:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047d5dd29/0x3234de053c5032c lrc: 4/0,1 mode: --/PW res: [0x2b4cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.462473:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003dd9e9df/0x3234de053c4d0f1 lrc: 2/0,0 mode: PR/PR res: [0x2b4ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf542 expref: 1662 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.462476:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.462476:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.462476:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ff5cfa22/0x3234de053c4a0ca lrc: 3/0,0 mode: PR/PR res: [0x2b4cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb895 expref: 1662 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.462477:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c50333 lrc: 4/0,1 mode: --/PW res: [0x2b4ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.462480:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ff5cfa22/0x3234de053c4a0ca lrc: 4/0,0 mode: PR/PR res: [0x2b4cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb895 expref: 1662 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.462483:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003dd9e9df/0x3234de053c4d0f1 lrc: 3/0,0 mode: PR/PR res: [0x2b4ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf542 expref: 1662 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.462484:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996964864:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.462486:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003dd9e9df/0x3234de053c4d0f1 lrc: 4/0,0 mode: PR/PR res: [0x2b4ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf542 expref: 1662 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.462490:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b4acf60d pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996964928:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.462490:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e7e12492 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.462495:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210910 00000100:00100000:1.0:1651529344.462497:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f79d8146 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.462497:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+404:39030:x1731745946373440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.462501:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177357 count 1 00010000:00010000:0.0:1651529344.462504:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c5033a lrc: 3/0,1 mode: --/PW res: [0x2b4cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.462506:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000055e03b4f pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996964608:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.462508:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000080a87994/0x3234de053c4cf0e lrc: 2/0,0 mode: PR/PR res: [0x2b4cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee18 expref: 1662 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.462510:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c50310 lrc: 3/0,1 mode: --/PW res: [0x2b4c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.462511:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.462511:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.462512:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c5033a lrc: 4/0,1 mode: --/PW res: [0x2b4cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.462516:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396253888 00010000:00010000:0.0:1651529344.462517:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000080a87994/0x3234de053c4cf0e lrc: 3/0,0 mode: PR/PR res: [0x2b4cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee18 expref: 1663 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.462520:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c4e0b1 lrc: 5/0,0 mode: PR/PR res: [0x2b4c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3331 expref: 1663 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.462521:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000080a87994/0x3234de053c4cf0e lrc: 4/0,0 mode: PR/PR res: [0x2b4cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee18 expref: 1663 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.462524:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996964992:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.462534:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396253952 00010000:00010000:1.0:1651529344.462537:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ecc067a7/0x3234de053c4d99c lrc: 4/0,0 mode: PR/PR res: [0x2b4c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d16e4 expref: 1664 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.462537:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000003ad73843 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.462543:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11685 00000100:00100000:1.0:1651529344.462545:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1664:41279:x1731746396253888:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.462546:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11686 00010000:00010000:1.0:1651529344.462548:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.462548:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001743f524 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1664:41279:x1731746396253952:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.462549:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c4e0b1 lrc: 5/0,0 mode: PR/PR res: [0x2b4c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3331 expref: 1664 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.462551:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.462553:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c4e0b1 lrc: 4/0,0 mode: PR/PR res: [0x2b4c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3331 expref: 1664 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.462553:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ecc067a7/0x3234de053c4d99c lrc: 4/0,0 mode: PR/PR res: [0x2b4c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d16e4 expref: 1664 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.462557:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ecc067a7/0x3234de053c4d99c lrc: 3/0,0 mode: PR/PR res: [0x2b4c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d16e4 expref: 1664 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.462558:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.462559:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.462560:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000443c0ff5/0x3234de053c50309 lrc: 3/0,1 mode: PW/PW res: [0x2b4c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.462562:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ecc067a7/0x3234de053c4d99c lrc: 0/0,0 mode: --/PR res: [0x2b4c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d16e4 expref: 1664 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.462563:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000443c0ff5/0x3234de053c50309 lrc: 4/0,1 mode: PW/PW res: [0x2b4c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.462565:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.462566:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.462567:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.462567:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c50310 lrc: 3/0,1 mode: PW/PW res: [0x2b4c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.462570:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c50310 lrc: 4/0,1 mode: PW/PW res: [0x2b4c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.462574:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1663:41279:x1731746396253888:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 28us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.462577:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11685 00010000:00010000:0.0:1651529344.462580:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.462586:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001743f524 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1662:41279:x1731746396253952:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 38us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.462588:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11686 00010000:00010000:1.0:1651529344.462590:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c50310 lrc: 3/0,1 mode: PW/PW res: [0x2b4c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.462593:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c50310 lrc: 3/0,1 mode: PW/PW res: [0x2b4c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.462596:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c50310 lrc: 3/0,1 mode: PW/PW res: [0x2b4c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.462599:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c50310 lrc: 2/0,0 mode: PW/PW res: [0x2b4c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.462604:0:156655:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c4e0b1 lrc: 0/0,0 mode: --/PR res: [0x2b4c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3331 expref: 1661 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.462614:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996964544:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.462618:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000443c0ff5/0x3234de053c50309 lrc: 3/0,1 mode: PW/PW res: [0x2b4c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.462621:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000443c0ff5/0x3234de053c50309 lrc: 3/0,1 mode: PW/PW res: [0x2b4c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.462624:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000443c0ff5/0x3234de053c50309 lrc: 3/0,1 mode: PW/PW res: [0x2b4c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.462627:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000443c0ff5/0x3234de053c50309 lrc: 3/0,1 mode: PW/PW res: [0x2b4c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.462630:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000443c0ff5/0x3234de053c50309 lrc: 2/0,0 mode: PW/PW res: [0x2b4c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.462640:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+405:39030:x1731745946373056:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 619us (692us total) trans 12885078958 rc 0/0 00000100:00100000:1.0:1651529344.462643:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210904 00000100:00100000:0.0:1651529344.462670:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+405:39029:x1731745946372800:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 678us (737us total) trans 12885078959 rc 0/0 00000100:00100000:0.0:1651529344.462673:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210903 00010000:00010000:0.0:1651529344.462680:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c50310 lrc: 2/0,0 mode: PW/PW res: [0x2b4c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.462683:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000364b2cdc already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.462684:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c50310 lrc: 2/0,0 mode: PW/PW res: [0x2b4c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.462687:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c50310 lrc: 3/0,0 mode: PW/PW res: [0x2b4c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.462694:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c50310 lrc: 1/0,0 mode: --/PW res: [0x2b4c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.462697:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c50310 lrc: 0/0,0 mode: --/PW res: [0x2b4c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.462700:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000443c0ff5/0x3234de053c50309 lrc: 2/0,0 mode: PW/PW res: [0x2b4c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.462703:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000443c0ff5 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.462704:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000443c0ff5/0x3234de053c50309 lrc: 2/0,0 mode: PW/PW res: [0x2b4c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.462707:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000443c0ff5/0x3234de053c50309 lrc: 3/0,0 mode: PW/PW res: [0x2b4c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.462710:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000443c0ff5/0x3234de053c50309 lrc: 1/0,0 mode: --/PW res: [0x2b4c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.462712:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000443c0ff5/0x3234de053c50309 lrc: 0/0,0 mode: --/PW res: [0x2b4c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.462841:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.462852:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.462852:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946373888 00000100:00100000:1.0:1651529344.462859:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946373824 00000100:00100000:0.0:1651529344.462863:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210911 00000100:00100000:0.0:1651529344.462865:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085af61db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+406:39030:x1731745946373888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.462870:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177360 count 1 00000100:00100000:1.0:1651529344.462871:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210912 00000100:00100000:1.0:1651529344.462873:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+406:39030:x1731745946373824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.462874:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c50341 lrc: 3/0,1 mode: --/PW res: [0x2b4d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.462878:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177359 count 1 00010000:00010000:0.0:1651529344.462879:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000538b8b52/0x3234de053c4eefe lrc: 2/0,0 mode: PR/PR res: [0x2b4d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e56 expref: 1660 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.462882:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edd2ccd0/0x3234de053c50348 lrc: 3/0,1 mode: --/PW res: [0x2b4cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.462882:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.462883:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.462884:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c50341 lrc: 4/0,1 mode: --/PW res: [0x2b4d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.462887:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c4aaef lrc: 2/0,0 mode: PR/PR res: [0x2b4cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbdc0 expref: 1660 pid: 80278 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.462890:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.462890:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000538b8b52/0x3234de053c4eefe lrc: 3/0,0 mode: PR/PR res: [0x2b4d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e56 expref: 1660 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.462891:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.462892:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edd2ccd0/0x3234de053c50348 lrc: 4/0,1 mode: --/PW res: [0x2b4cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.462894:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000538b8b52/0x3234de053c4eefe lrc: 4/0,0 mode: PR/PR res: [0x2b4d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e56 expref: 1660 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.462898:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996965056:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.462899:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c4aaef lrc: 3/0,0 mode: PR/PR res: [0x2b4cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbdc0 expref: 1660 pid: 80278 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.462902:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c4aaef lrc: 4/0,0 mode: PR/PR res: [0x2b4cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbdc0 expref: 1660 pid: 80278 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.462907:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae466fbb pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996965120:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.462912:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 000000003c8b0daf going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.462922:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 0000000020dd7827 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.463109:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996964736:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.463113:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.463113:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e75f72f8/0x3234de053c5031e lrc: 3/0,1 mode: --/PW res: [0x2b4ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.463121:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996964672:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.463123:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000315faada/0x3234de053c50317 lrc: 3/0,1 mode: --/PW res: [0x2b4c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.463130:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.463139:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396254464 00000100:00100000:1.0:1651529344.463140:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.463150:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006c4e361b/0x3234de053c4e8bb lrc: 4/0,0 mode: PR/PR res: [0x2b4c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d53b4 expref: 1661 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.463151:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000de0edbdc pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996964800:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.463155:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000037767785/0x3234de053c50325 lrc: 3/0,1 mode: --/PW res: [0x2b4cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.463160:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396254528 00010000:00010000:0.0:1651529344.463163:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000099463d26/0x3234de053c4da2f lrc: 4/0,0 mode: PR/PR res: [0x2b4ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1937 expref: 1662 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.463167:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396254656 00000100:00100000:0.0:1651529344.463168:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11687 00000100:00100000:0.0:1651529344.463170:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1663:41279:x1731746396254464:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.463172:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b4925414/0x3234de053c4b3b6 lrc: 4/0,0 mode: PR/PR res: [0x2b4cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc1b0 expref: 1663 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.463173:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.463174:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006c4e361b/0x3234de053c4e8bb lrc: 4/0,0 mode: PR/PR res: [0x2b4c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d53b4 expref: 1663 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.463178:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11688 00010000:00010000:0.0:1651529344.463178:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006c4e361b/0x3234de053c4e8bb lrc: 3/0,0 mode: PR/PR res: [0x2b4c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d53b4 expref: 1663 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.463180:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1663:41278:x1731746396254528:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.463183:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.463183:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c4e361b/0x3234de053c4e8bb lrc: 0/0,0 mode: --/PR res: [0x2b4c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d53b4 expref: 1663 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.463184:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000099463d26/0x3234de053c4da2f lrc: 4/0,0 mode: PR/PR res: [0x2b4ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1937 expref: 1663 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.463186:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.463187:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.463188:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000099463d26/0x3234de053c4da2f lrc: 3/0,0 mode: PR/PR res: [0x2b4ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1937 expref: 1662 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.463188:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000315faada/0x3234de053c50317 lrc: 3/0,1 mode: PW/PW res: [0x2b4c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463191:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000315faada/0x3234de053c50317 lrc: 4/0,1 mode: PW/PW res: [0x2b4c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463194:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099463d26/0x3234de053c4da2f lrc: 0/0,0 mode: --/PR res: [0x2b4ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1937 expref: 1662 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.463197:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.463197:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.463198:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.463199:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e75f72f8/0x3234de053c5031e lrc: 3/0,1 mode: PW/PW res: [0x2b4ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463202:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e75f72f8/0x3234de053c5031e lrc: 4/0,1 mode: PW/PW res: [0x2b4ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.463209:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1661:41279:x1731746396254464:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 38us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.463211:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11687 00010000:00010000:1.0:1651529344.463217:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.463236:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11689 00000100:00100000:1.0:1651529344.463237:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1660:41278:x1731746396254528:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 56us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.463238:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1660:41278:x1731746396254656:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.463240:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11688 00010000:00010000:0.0:1651529344.463241:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.463260:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b4925414/0x3234de053c4b3b6 lrc: 4/0,0 mode: PR/PR res: [0x2b4cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc1b0 expref: 1659 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.463264:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b4925414/0x3234de053c4b3b6 lrc: 3/0,0 mode: PR/PR res: [0x2b4cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc1b0 expref: 1659 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.463269:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4925414/0x3234de053c4b3b6 lrc: 0/0,0 mode: --/PR res: [0x2b4cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc1b0 expref: 1659 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.463273:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.463273:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.463274:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000037767785/0x3234de053c50325 lrc: 3/0,1 mode: PW/PW res: [0x2b4cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463277:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037767785/0x3234de053c50325 lrc: 4/0,1 mode: PW/PW res: [0x2b4cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463295:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.463302:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1658:41278:x1731746396254656:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 64us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.463311:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11689 00010000:00010000:0.0:1651529344.463320:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e75f72f8/0x3234de053c5031e lrc: 3/0,1 mode: PW/PW res: [0x2b4ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463323:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e75f72f8/0x3234de053c5031e lrc: 3/0,1 mode: PW/PW res: [0x2b4ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463327:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e75f72f8/0x3234de053c5031e lrc: 3/0,1 mode: PW/PW res: [0x2b4ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463334:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e75f72f8/0x3234de053c5031e lrc: 2/0,0 mode: PW/PW res: [0x2b4ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.463336:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.463345:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.463353:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.463361:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b4acf60d pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996964928:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.463366:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c50333 lrc: 3/0,1 mode: --/PW res: [0x2b4ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463371:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000037767785/0x3234de053c50325 lrc: 3/0,1 mode: PW/PW res: [0x2b4cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463380:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037767785/0x3234de053c50325 lrc: 3/0,1 mode: PW/PW res: [0x2b4cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463383:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037767785/0x3234de053c50325 lrc: 3/0,1 mode: PW/PW res: [0x2b4cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463386:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037767785/0x3234de053c50325 lrc: 2/0,0 mode: PW/PW res: [0x2b4cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.463405:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+407:39030:x1731745946373248:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 995us (1122us total) trans 12885078960 rc 0/0 00000100:00100000:0.0:1651529344.463408:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210906 00010000:00010000:0.0:1651529344.463427:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e75f72f8/0x3234de053c5031e lrc: 2/0,0 mode: PW/PW res: [0x2b4ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.463430:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+407:39029:x1731745946373312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1018us (1129us total) trans 12885078961 rc 0/0 00010000:00010000:0.0:1651529344.463431:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e75f72f8 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.463432:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e75f72f8/0x3234de053c5031e lrc: 2/0,0 mode: PW/PW res: [0x2b4ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.463433:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210907 00010000:00010000:0.0:1651529344.463435:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e75f72f8/0x3234de053c5031e lrc: 3/0,0 mode: PW/PW res: [0x2b4ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463439:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e75f72f8/0x3234de053c5031e lrc: 1/0,0 mode: --/PW res: [0x2b4ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.463442:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396254720 00010000:00010000:0.0:1651529344.463442:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e75f72f8/0x3234de053c5031e lrc: 0/0,0 mode: --/PW res: [0x2b4ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463446:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003dd9e9df/0x3234de053c4d0f1 lrc: 4/0,0 mode: PR/PR res: [0x2b4ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf542 expref: 1658 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.463446:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037767785/0x3234de053c50325 lrc: 2/0,0 mode: PW/PW res: [0x2b4cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463449:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000037767785 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.463450:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037767785/0x3234de053c50325 lrc: 2/0,0 mode: PW/PW res: [0x2b4cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.463451:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396254848 00010000:00010000:1.0:1651529344.463453:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000080a87994/0x3234de053c4cf0e lrc: 5/0,0 mode: PR/PR res: [0x2b4cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee18 expref: 1659 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.463453:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037767785/0x3234de053c50325 lrc: 3/0,0 mode: PW/PW res: [0x2b4cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463456:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037767785/0x3234de053c50325 lrc: 1/0,0 mode: --/PW res: [0x2b4cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.463458:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396254784 00010000:00010000:0.0:1651529344.463458:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037767785/0x3234de053c50325 lrc: 0/0,0 mode: --/PW res: [0x2b4cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463460:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ff5cfa22/0x3234de053c4a0ca lrc: 5/0,0 mode: PR/PR res: [0x2b4cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb895 expref: 1660 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.463464:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11690 00000100:00100000:1.0:1651529344.463466:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1660:41279:x1731746396254720:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.463468:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.463468:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996964864:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.463470:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003dd9e9df/0x3234de053c4d0f1 lrc: 4/0,0 mode: PR/PR res: [0x2b4ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf542 expref: 1660 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.463472:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000047d5dd29/0x3234de053c5032c lrc: 3/0,1 mode: --/PW res: [0x2b4cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463473:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003dd9e9df/0x3234de053c4d0f1 lrc: 3/0,0 mode: PR/PR res: [0x2b4ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf542 expref: 1660 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.463478:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003dd9e9df/0x3234de053c4d0f1 lrc: 0/0,0 mode: --/PR res: [0x2b4ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf542 expref: 1660 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.463478:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996964992:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.463480:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c5033a lrc: 3/0,1 mode: --/PW res: [0x2b4cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463482:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.463482:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.463483:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c50333 lrc: 3/0,1 mode: PW/PW res: [0x2b4ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463485:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000315faada/0x3234de053c50317 lrc: 3/0,1 mode: PW/PW res: [0x2b4c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463486:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c50333 lrc: 4/0,1 mode: PW/PW res: [0x2b4ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463488:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000315faada/0x3234de053c50317 lrc: 3/0,1 mode: PW/PW res: [0x2b4c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463491:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000315faada/0x3234de053c50317 lrc: 3/0,1 mode: PW/PW res: [0x2b4c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463493:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.463493:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000315faada/0x3234de053c50317 lrc: 2/0,0 mode: PW/PW res: [0x2b4c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.463499:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1659:41279:x1731746396254720:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.463501:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11690 00000100:00100000:1.0:1651529344.463505:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11691 00000100:00100000:1.0:1651529344.463507:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1658:41279:x1731746396254848:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.463509:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.463510:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000080a87994/0x3234de053c4cf0e lrc: 4/0,0 mode: PR/PR res: [0x2b4cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee18 expref: 1658 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.463516:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000080a87994/0x3234de053c4cf0e lrc: 3/0,0 mode: PR/PR res: [0x2b4cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee18 expref: 1658 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.463521:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080a87994/0x3234de053c4cf0e lrc: 0/0,0 mode: --/PR res: [0x2b4cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee18 expref: 1658 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.463524:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.463525:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.463525:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c5033a lrc: 3/0,1 mode: PW/PW res: [0x2b4cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463528:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c5033a lrc: 4/0,1 mode: PW/PW res: [0x2b4cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463537:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.463550:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1657:41279:x1731746396254848:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 43us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.463550:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+407:39029:x1731745946373184:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1211us (1286us total) trans 12885078962 rc 0/0 00000100:00100000:1.0:1651529344.463553:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11691 00000100:00100000:0.0:1651529344.463554:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210905 00000100:00100000:1.0:1651529344.463557:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11692 00000100:00100000:1.0:1651529344.463558:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1656:41278:x1731746396254784:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.463560:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.463560:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000315faada/0x3234de053c50317 lrc: 2/0,0 mode: PW/PW res: [0x2b4c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463562:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ff5cfa22/0x3234de053c4a0ca lrc: 4/0,0 mode: PR/PR res: [0x2b4cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb895 expref: 1656 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.463564:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000315faada already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.463565:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ff5cfa22/0x3234de053c4a0ca lrc: 3/0,0 mode: PR/PR res: [0x2b4cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb895 expref: 1656 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.463565:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000315faada/0x3234de053c50317 lrc: 2/0,0 mode: PW/PW res: [0x2b4c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463568:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000315faada/0x3234de053c50317 lrc: 3/0,0 mode: PW/PW res: [0x2b4c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463570:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff5cfa22/0x3234de053c4a0ca lrc: 0/0,0 mode: --/PR res: [0x2b4cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb895 expref: 1656 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.463572:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000315faada/0x3234de053c50317 lrc: 1/0,0 mode: --/PW res: [0x2b4c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463573:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.463574:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.463574:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000047d5dd29/0x3234de053c5032c lrc: 3/0,1 mode: PW/PW res: [0x2b4cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463575:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000315faada/0x3234de053c50317 lrc: 0/0,0 mode: --/PW res: [0x2b4c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463577:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047d5dd29/0x3234de053c5032c lrc: 4/0,1 mode: PW/PW res: [0x2b4cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463581:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c5033a lrc: 3/0,1 mode: PW/PW res: [0x2b4cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463585:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.463590:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1655:41278:x1731746396254784:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 31us (237us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.463590:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c5033a lrc: 3/0,1 mode: PW/PW res: [0x2b4cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.463592:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11692 00010000:00010000:0.0:1651529344.463593:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c5033a lrc: 3/0,1 mode: PW/PW res: [0x2b4cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463596:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c5033a lrc: 2/0,0 mode: PW/PW res: [0x2b4cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463598:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c50333 lrc: 3/0,1 mode: PW/PW res: [0x2b4ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463600:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c50333 lrc: 3/0,1 mode: PW/PW res: [0x2b4ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463604:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c50333 lrc: 3/0,1 mode: PW/PW res: [0x2b4ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463606:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c50333 lrc: 2/0,0 mode: PW/PW res: [0x2b4ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.463638:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+408:39030:x1731745946373440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1139us (1269us total) trans 12885078963 rc 0/0 00000100:00100000:0.0:1651529344.463640:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210910 00010000:00010000:0.0:1651529344.463647:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c5033a lrc: 2/0,0 mode: PW/PW res: [0x2b4cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.463649:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+407:39030:x1731745946373504:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1188us (1293us total) trans 12885078964 rc 0/0 00010000:00010000:0.0:1651529344.463651:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000712b8830 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.463652:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210909 00010000:00010000:0.0:1651529344.463652:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c5033a lrc: 2/0,0 mode: PW/PW res: [0x2b4cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463654:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c5033a lrc: 3/0,0 mode: PW/PW res: [0x2b4cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463659:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c5033a lrc: 1/0,0 mode: --/PW res: [0x2b4cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463662:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c5033a lrc: 0/0,0 mode: --/PW res: [0x2b4cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463666:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c50333 lrc: 2/0,0 mode: PW/PW res: [0x2b4ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463668:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ce532454 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.463669:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c50333 lrc: 2/0,0 mode: PW/PW res: [0x2b4ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463672:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c50333 lrc: 3/0,0 mode: PW/PW res: [0x2b4ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463675:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c50333 lrc: 1/0,0 mode: --/PW res: [0x2b4ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463678:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c50333 lrc: 0/0,0 mode: --/PW res: [0x2b4ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463683:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000047d5dd29/0x3234de053c5032c lrc: 3/0,1 mode: PW/PW res: [0x2b4cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463686:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047d5dd29/0x3234de053c5032c lrc: 3/0,1 mode: PW/PW res: [0x2b4cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463698:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047d5dd29/0x3234de053c5032c lrc: 3/0,1 mode: PW/PW res: [0x2b4cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463701:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000047d5dd29/0x3234de053c5032c lrc: 2/0,0 mode: PW/PW res: [0x2b4cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.463702:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.463721:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.463745:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+407:39030:x1731745946373376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1289us (1434us total) trans 12885078965 rc 0/0 00000100:00100000:0.0:1651529344.463748:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210908 00010000:00010000:0.0:1651529344.463755:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000047d5dd29/0x3234de053c5032c lrc: 2/0,0 mode: PW/PW res: [0x2b4cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463758:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000047d5dd29 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.463759:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000047d5dd29/0x3234de053c5032c lrc: 2/0,0 mode: PW/PW res: [0x2b4cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463762:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000047d5dd29/0x3234de053c5032c lrc: 3/0,0 mode: PW/PW res: [0x2b4cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463767:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000047d5dd29/0x3234de053c5032c lrc: 1/0,0 mode: --/PW res: [0x2b4cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463769:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047d5dd29/0x3234de053c5032c lrc: 0/0,0 mode: --/PW res: [0x2b4cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.463776:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396254912 00010000:00010000:0.0:1651529344.463781:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000538b8b52/0x3234de053c4eefe lrc: 5/0,0 mode: PR/PR res: [0x2b4d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e56 expref: 1655 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.463786:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396254976 00010000:00010000:0.0:1651529344.463788:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c4aaef lrc: 5/0,0 mode: PR/PR res: [0x2b4cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbdc0 expref: 1656 pid: 80278 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.463792:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11693 00000100:00100000:1.0:1651529344.463794:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005649b5c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1656:41278:x1731746396254912:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.463795:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11694 00000100:00100000:0.0:1651529344.463796:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1656:41278:x1731746396254976:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.463798:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.463799:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.463800:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000538b8b52/0x3234de053c4eefe lrc: 5/0,0 mode: PR/PR res: [0x2b4d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e56 expref: 1656 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.463800:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c4aaef lrc: 5/0,0 mode: PR/PR res: [0x2b4cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbdc0 expref: 1656 pid: 80278 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.463804:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000538b8b52/0x3234de053c4eefe lrc: 4/0,0 mode: PR/PR res: [0x2b4d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e56 expref: 1656 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.463804:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c4aaef lrc: 4/0,0 mode: PR/PR res: [0x2b4cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbdc0 expref: 1656 pid: 80278 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.463809:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.463809:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.463810:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.463810:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000edd2ccd0/0x3234de053c50348 lrc: 3/0,1 mode: PW/PW res: [0x2b4cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463811:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.463812:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c50341 lrc: 3/0,1 mode: PW/PW res: [0x2b4d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463813:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edd2ccd0/0x3234de053c50348 lrc: 4/0,1 mode: PW/PW res: [0x2b4cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463815:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c50341 lrc: 4/0,1 mode: PW/PW res: [0x2b4d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463820:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.463828:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005649b5c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1656:41278:x1731746396254912:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 34us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.463831:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11693 00010000:00010000:0.0:1651529344.463835:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.463843:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1655:41278:x1731746396254976:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 45us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.463845:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11694 00010000:00010000:1.0:1651529344.463846:0:80280:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c4aaef lrc: 0/0,0 mode: --/PR res: [0x2b4cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbdc0 expref: 1655 pid: 80278 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.463850:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae466fbb pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996965120:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.463853:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000edd2ccd0/0x3234de053c50348 lrc: 3/0,1 mode: PW/PW res: [0x2b4cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463857:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000edd2ccd0/0x3234de053c50348 lrc: 3/0,1 mode: PW/PW res: [0x2b4cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463857:0:156655:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000538b8b52/0x3234de053c4eefe lrc: 0/0,0 mode: --/PR res: [0x2b4d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e56 expref: 1653 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.463859:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000edd2ccd0/0x3234de053c50348 lrc: 3/0,1 mode: PW/PW res: [0x2b4cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.463861:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996965056:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.463862:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edd2ccd0/0x3234de053c50348 lrc: 3/0,1 mode: PW/PW res: [0x2b4cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.463865:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000edd2ccd0/0x3234de053c50348 lrc: 2/0,0 mode: PW/PW res: [0x2b4cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463865:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c50341 lrc: 3/0,1 mode: PW/PW res: [0x2b4d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463868:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c50341 lrc: 3/0,1 mode: PW/PW res: [0x2b4d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463871:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c50341 lrc: 3/0,1 mode: PW/PW res: [0x2b4d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463881:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c50341 lrc: 3/0,1 mode: PW/PW res: [0x2b4d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463884:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c50341 lrc: 2/0,0 mode: PW/PW res: [0x2b4d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.463908:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+408:39030:x1731745946373824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1035us (1056us total) trans 12885078966 rc 0/0 00000100:00100000:1.0:1651529344.463911:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210912 00000100:00100000:0.0:1651529344.463922:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085af61db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+407:39030:x1731745946373888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1056us (1081us total) trans 12885078967 rc 0/0 00000100:00100000:0.0:1651529344.463925:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210911 00010000:00010000:0.0:1651529344.463932:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000edd2ccd0/0x3234de053c50348 lrc: 2/0,0 mode: PW/PW res: [0x2b4cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463935:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000edd2ccd0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.463936:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000edd2ccd0/0x3234de053c50348 lrc: 2/0,0 mode: PW/PW res: [0x2b4cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463939:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000edd2ccd0/0x3234de053c50348 lrc: 3/0,0 mode: PW/PW res: [0x2b4cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463944:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000edd2ccd0/0x3234de053c50348 lrc: 1/0,0 mode: --/PW res: [0x2b4cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463947:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000edd2ccd0/0x3234de053c50348 lrc: 0/0,0 mode: --/PW res: [0x2b4cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463951:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c50341 lrc: 2/0,0 mode: PW/PW res: [0x2b4d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463953:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000cfc1a54 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.463954:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c50341 lrc: 2/0,0 mode: PW/PW res: [0x2b4d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463957:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c50341 lrc: 3/0,0 mode: PW/PW res: [0x2b4d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463960:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c50341 lrc: 1/0,0 mode: --/PW res: [0x2b4d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.463963:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c50341 lrc: 0/0,0 mode: --/PW res: [0x2b4d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.464078:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.464089:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946374464 00000100:00100000:1.0:1651529344.464096:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.464107:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946374592 00000100:00100000:1.0:1651529344.464110:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.464122:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946374528 00000100:00100000:1.0:1651529344.464127:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.464127:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210913 00000100:00100000:0.0:1651529344.464129:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+409:39030:x1731745946374464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.464133:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.464134:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177361 count 1 00000100:00100000:1.0:1651529344.464143:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.464151:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946374656 00000100:00100000:1.0:1651529344.464157:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946374784 00000100:00100000:1.0:1651529344.464160:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946374720 00010000:00010000:0.0:1651529344.464168:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a82b4949/0x3234de053c5034f lrc: 3/0,1 mode: --/PW res: [0x2b4d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.464174:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002c03f4dd/0x3234de053c4f318 lrc: 2/0,0 mode: PR/PR res: [0x2b4d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7eef expref: 1652 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.464175:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210914 00000100:00100000:1.0:1651529344.464177:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+412:39029:x1731745946374592:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.464177:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.464177:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.464178:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a82b4949/0x3234de053c5034f lrc: 4/0,1 mode: --/PW res: [0x2b4d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.464183:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177363 count 1 00010000:00010000:0.0:1651529344.464185:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002c03f4dd/0x3234de053c4f318 lrc: 3/0,0 mode: PR/PR res: [0x2b4d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7eef expref: 1652 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.464187:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ac46eec/0x3234de053c50356 lrc: 3/0,1 mode: --/PW res: [0x2b4d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.464189:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002c03f4dd/0x3234de053c4f318 lrc: 4/0,0 mode: PR/PR res: [0x2b4d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7eef expref: 1652 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.464192:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c4eee2 lrc: 2/0,0 mode: PR/PR res: [0x2b4d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d84 expref: 1652 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.464193:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996965184:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.464195:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.464196:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.464196:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ac46eec/0x3234de053c50356 lrc: 4/0,1 mode: --/PW res: [0x2b4d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.464203:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c4eee2 lrc: 3/0,0 mode: PR/PR res: [0x2b4d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d84 expref: 1652 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.464207:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 000000003ad73843 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.464213:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c4eee2 lrc: 4/0,0 mode: PR/PR res: [0x2b4d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d84 expref: 1652 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.464214:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210915 00000100:00100000:0.0:1651529344.464216:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+412:39030:x1731745946374528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.464218:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000055e03b4f pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996965248:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.464240:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177362 count 1 00000100:00100000:1.0:1651529344.464243:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a4eb401d going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.464245:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090168046/0x3234de053c5035d lrc: 3/0,1 mode: --/PW res: [0x2b4d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.464250:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210916 00010000:00010000:0.0:1651529344.464250:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000067aa0084/0x3234de053c4d9c6 lrc: 2/0,0 mode: PR/PR res: [0x2b4d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d17a8 expref: 1652 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.464252:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+412:39030:x1731745946374656:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.464253:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.464253:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.464254:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090168046/0x3234de053c5035d lrc: 4/0,1 mode: --/PW res: [0x2b4d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.464257:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177364 count 1 00010000:00010000:1.0:1651529344.464261:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c830bc7/0x3234de053c50364 lrc: 3/0,1 mode: --/PW res: [0x2b4d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.464261:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000067aa0084/0x3234de053c4d9c6 lrc: 3/0,0 mode: PR/PR res: [0x2b4d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d17a8 expref: 1652 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.464264:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000067aa0084/0x3234de053c4d9c6 lrc: 4/0,0 mode: PR/PR res: [0x2b4d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d17a8 expref: 1652 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.464265:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4f1ba lrc: 2/0,0 mode: PR/PR res: [0x2b4d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d79a8 expref: 1652 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.464268:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.464268:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.464268:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996965312:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.464269:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c830bc7/0x3234de053c50364 lrc: 4/0,1 mode: --/PW res: [0x2b4d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.464275:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4f1ba lrc: 3/0,0 mode: PR/PR res: [0x2b4d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d79a8 expref: 1652 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.464276:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e7e12492 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.464279:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4f1ba lrc: 4/0,0 mode: PR/PR res: [0x2b4d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d79a8 expref: 1652 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.464283:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c43262d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996965376:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.464283:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210917 00000100:00100000:0.0:1651529344.464285:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+412:39030:x1731745946374784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.464289:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177366 count 1 00000100:00100000:1.0:1651529344.464290:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000499d0377 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.464292:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf51282c/0x3234de053c5036b lrc: 3/0,1 mode: --/PW res: [0x2b4d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.464295:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210918 00010000:00010000:0.0:1651529344.464296:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004998ae0c/0x3234de053c4c862 lrc: 2/0,0 mode: PR/PR res: [0x2b4d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd384 expref: 1652 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.464297:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+412:39030:x1731745946374720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.464301:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177365 count 1 00010000:00010000:0.0:1651529344.464302:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.464302:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.464303:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf51282c/0x3234de053c5036b lrc: 4/0,1 mode: --/PW res: [0x2b4d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.464304:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006d9a191/0x3234de053c50372 lrc: 3/0,1 mode: --/PW res: [0x2b4d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.464308:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006dc7d0fd/0x3234de053c4e795 lrc: 2/0,0 mode: PR/PR res: [0x2b4d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4edd expref: 1652 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.464309:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004998ae0c/0x3234de053c4c862 lrc: 3/0,0 mode: PR/PR res: [0x2b4d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd384 expref: 1652 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.464311:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.464312:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.464312:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004998ae0c/0x3234de053c4c862 lrc: 4/0,0 mode: PR/PR res: [0x2b4d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd384 expref: 1652 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.464313:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006d9a191/0x3234de053c50372 lrc: 4/0,1 mode: --/PW res: [0x2b4d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.464316:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996965440:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.464318:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006dc7d0fd/0x3234de053c4e795 lrc: 3/0,0 mode: PR/PR res: [0x2b4d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4edd expref: 1652 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.464322:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006dc7d0fd/0x3234de053c4e795 lrc: 4/0,0 mode: PR/PR res: [0x2b4d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4edd expref: 1652 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.464322:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a3b00cf3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.464325:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d6486d55 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996965504:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.464331:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f79d8146 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.464346:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.464360:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.464425:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946374848 00000100:00100000:1.0:1651529344.464433:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946374912 00000100:00100000:1.0:1651529344.464437:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210919 00000100:00100000:1.0:1651529344.464438:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+414:39029:x1731745946374848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.464443:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177367 count 1 00010000:00010000:1.0:1651529344.464447:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcfc3592/0x3234de053c50379 lrc: 3/0,1 mode: --/PW res: [0x2b4d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.464451:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000067750919/0x3234de053c4f00f lrc: 2/0,0 mode: PR/PR res: [0x2b4d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d72d2 expref: 1652 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.464457:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.464458:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.464458:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcfc3592/0x3234de053c50379 lrc: 4/0,1 mode: --/PW res: [0x2b4d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.464464:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000067750919/0x3234de053c4f00f lrc: 3/0,0 mode: PR/PR res: [0x2b4d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d72d2 expref: 1652 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.464468:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000067750919/0x3234de053c4f00f lrc: 4/0,0 mode: PR/PR res: [0x2b4d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d72d2 expref: 1652 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.464472:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009acffcb8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996965568:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.464482:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 0000000018ebe812 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.464487:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210920 00000100:00100000:1.0:1651529344.464489:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+414:39029:x1731745946374912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.464493:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177368 count 1 00010000:00010000:1.0:1651529344.464496:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064149de3/0x3234de053c50380 lrc: 3/0,1 mode: --/PW res: [0x2b4d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.464500:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000050f0d32a/0x3234de053c4c9c0 lrc: 2/0,0 mode: PR/PR res: [0x2b4d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd8e7 expref: 1652 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.464503:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.464503:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.464504:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064149de3/0x3234de053c50380 lrc: 4/0,1 mode: --/PW res: [0x2b4d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.464512:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000050f0d32a/0x3234de053c4c9c0 lrc: 3/0,0 mode: PR/PR res: [0x2b4d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd8e7 expref: 1652 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.464516:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000050f0d32a/0x3234de053c4c9c0 lrc: 4/0,0 mode: PR/PR res: [0x2b4d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd8e7 expref: 1652 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.464519:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007c534a1e pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996965632:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.464525:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b52d0f36 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.464723:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996965184:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.464727:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a82b4949/0x3234de053c5034f lrc: 3/0,1 mode: --/PW res: [0x2b4d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.464748:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000055e03b4f pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996965248:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.464752:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004ac46eec/0x3234de053c50356 lrc: 3/0,1 mode: --/PW res: [0x2b4d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.464782:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996965312:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.464785:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000090168046/0x3234de053c5035d lrc: 3/0,1 mode: --/PW res: [0x2b4d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.464800:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c43262d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996965376:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.464804:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007c830bc7/0x3234de053c50364 lrc: 3/0,1 mode: --/PW res: [0x2b4d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.464849:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996965440:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.464853:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cf51282c/0x3234de053c5036b lrc: 3/0,1 mode: --/PW res: [0x2b4d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.464907:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d6486d55 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996965504:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.464911:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000006d9a191/0x3234de053c50372 lrc: 3/0,1 mode: --/PW res: [0x2b4d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.464918:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009acffcb8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996965568:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.464921:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fcfc3592/0x3234de053c50379 lrc: 3/0,1 mode: --/PW res: [0x2b4d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.464929:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007c534a1e pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996965632:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.464931:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000064149de3/0x3234de053c50380 lrc: 3/0,1 mode: --/PW res: [0x2b4d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.465089:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.465107:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.465116:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.465123:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.465124:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396255616 00000100:00100000:1.0:1651529344.465129:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.465130:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002c03f4dd/0x3234de053c4f318 lrc: 4/0,0 mode: PR/PR res: [0x2b4d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7eef expref: 1653 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.465135:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.465137:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396255744 00010000:00010000:0.0:1651529344.465139:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4f1ba lrc: 4/0,0 mode: PR/PR res: [0x2b4d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d79a8 expref: 1654 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.465141:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.465144:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396255552 00010000:00010000:0.0:1651529344.465146:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c4eee2 lrc: 4/0,0 mode: PR/PR res: [0x2b4d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d84 expref: 1655 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.465150:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396255872 00010000:00010000:0.0:1651529344.465152:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006dc7d0fd/0x3234de053c4e795 lrc: 4/0,0 mode: PR/PR res: [0x2b4d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4edd expref: 1656 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.465154:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.465156:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396255680 00010000:00010000:0.0:1651529344.465158:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000067aa0084/0x3234de053c4d9c6 lrc: 4/0,0 mode: PR/PR res: [0x2b4d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d17a8 expref: 1657 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.465162:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396256000 00010000:00010000:0.0:1651529344.465164:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000050f0d32a/0x3234de053c4c9c0 lrc: 4/0,0 mode: PR/PR res: [0x2b4d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd8e7 expref: 1658 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.465167:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396255808 00000100:00100000:0.0:1651529344.465168:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396255936 00010000:00010000:0.0:1651529344.465170:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000067750919/0x3234de053c4f00f lrc: 4/0,0 mode: PR/PR res: [0x2b4d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d72d2 expref: 1660 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.465173:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004998ae0c/0x3234de053c4c862 lrc: 4/0,0 mode: PR/PR res: [0x2b4d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd384 expref: 1660 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.465177:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11695 00000100:00100000:0.0:1651529344.465179:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1660:41279:x1731746396255616:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.465181:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11696 00010000:00010000:0.0:1651529344.465182:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.465183:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1660:41279:x1731746396255744:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.465183:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002c03f4dd/0x3234de053c4f318 lrc: 4/0,0 mode: PR/PR res: [0x2b4d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7eef expref: 1660 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.465185:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.465187:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4f1ba lrc: 4/0,0 mode: PR/PR res: [0x2b4d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d79a8 expref: 1660 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.465187:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002c03f4dd/0x3234de053c4f318 lrc: 3/0,0 mode: PR/PR res: [0x2b4d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7eef expref: 1660 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.465190:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4f1ba lrc: 3/0,0 mode: PR/PR res: [0x2b4d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d79a8 expref: 1660 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.465192:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c03f4dd/0x3234de053c4f318 lrc: 0/0,0 mode: --/PR res: [0x2b4d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7eef expref: 1660 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.465196:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.465196:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.465197:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a82b4949/0x3234de053c5034f lrc: 3/0,1 mode: PW/PW res: [0x2b4d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.465199:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039e8f661/0x3234de053c4f1ba lrc: 0/0,0 mode: --/PR res: [0x2b4d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d79a8 expref: 1659 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.465200:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a82b4949/0x3234de053c5034f lrc: 4/0,1 mode: PW/PW res: [0x2b4d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.465203:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.465203:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.465204:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007c830bc7/0x3234de053c50364 lrc: 3/0,1 mode: PW/PW res: [0x2b4d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465207:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.465208:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c830bc7/0x3234de053c50364 lrc: 4/0,1 mode: PW/PW res: [0x2b4d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.465214:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.465220:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1658:41279:x1731746396255616:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.465233:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11695 00000100:00100000:1.0:1651529344.465241:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1657:41279:x1731746396255744:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 57us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.465243:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11697 00000100:00100000:1.0:1651529344.465246:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11696 00000100:00100000:0.0:1651529344.465246:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1657:41278:x1731746396255552:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.465249:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.465250:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c4eee2 lrc: 4/0,0 mode: PR/PR res: [0x2b4d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d84 expref: 1656 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.465251:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11698 00000100:00100000:1.0:1651529344.465253:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1656:41279:x1731746396255872:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.465254:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c4eee2 lrc: 3/0,0 mode: PR/PR res: [0x2b4d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d84 expref: 1656 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.465256:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.465257:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006dc7d0fd/0x3234de053c4e795 lrc: 4/0,0 mode: PR/PR res: [0x2b4d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4edd expref: 1656 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.465259:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c4eee2 lrc: 0/0,0 mode: --/PR res: [0x2b4d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d84 expref: 1656 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.465261:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006dc7d0fd/0x3234de053c4e795 lrc: 3/0,0 mode: PR/PR res: [0x2b4d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4edd expref: 1656 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.465262:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.465263:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.465264:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004ac46eec/0x3234de053c50356 lrc: 3/0,1 mode: PW/PW res: [0x2b4d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.465266:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006dc7d0fd/0x3234de053c4e795 lrc: 0/0,0 mode: --/PR res: [0x2b4d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4edd expref: 1655 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.465267:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ac46eec/0x3234de053c50356 lrc: 4/0,1 mode: PW/PW res: [0x2b4d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.465272:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.465273:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.465273:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000006d9a191/0x3234de053c50372 lrc: 3/0,1 mode: PW/PW res: [0x2b4d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465276:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.465282:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1654:41278:x1731746396255552:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (167us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.465283:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006d9a191/0x3234de053c50372 lrc: 4/0,1 mode: PW/PW res: [0x2b4d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.465285:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11697 00010000:00010000:1.0:1651529344.465289:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.465289:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11699 00000100:00100000:0.0:1651529344.465291:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1653:41278:x1731746396255680:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.465293:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.465294:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1653:41279:x1731746396255872:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (171us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.465295:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000067aa0084/0x3234de053c4d9c6 lrc: 4/0,0 mode: PR/PR res: [0x2b4d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d17a8 expref: 1653 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.465297:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11698 00010000:00010000:0.0:1651529344.465299:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000067aa0084/0x3234de053c4d9c6 lrc: 3/0,0 mode: PR/PR res: [0x2b4d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d17a8 expref: 1653 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.465302:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11700 00000100:00100000:1.0:1651529344.465303:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d696796e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1652:41279:x1731746396256000:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.465303:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067aa0084/0x3234de053c4d9c6 lrc: 0/0,0 mode: --/PR res: [0x2b4d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d17a8 expref: 1652 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.465306:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.465307:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000050f0d32a/0x3234de053c4c9c0 lrc: 4/0,0 mode: PR/PR res: [0x2b4d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd8e7 expref: 1651 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.465307:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.465307:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.465308:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000090168046/0x3234de053c5035d lrc: 3/0,1 mode: PW/PW res: [0x2b4d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.465311:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000050f0d32a/0x3234de053c4c9c0 lrc: 3/0,0 mode: PR/PR res: [0x2b4d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd8e7 expref: 1651 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.465311:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090168046/0x3234de053c5035d lrc: 4/0,1 mode: PW/PW res: [0x2b4d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.465315:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050f0d32a/0x3234de053c4c9c0 lrc: 0/0,0 mode: --/PR res: [0x2b4d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd8e7 expref: 1651 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.465317:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.465319:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.465319:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.465320:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000064149de3/0x3234de053c50380 lrc: 3/0,1 mode: PW/PW res: [0x2b4d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.465322:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1650:41278:x1731746396255680:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 30us (192us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.465323:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064149de3/0x3234de053c50380 lrc: 4/0,1 mode: PW/PW res: [0x2b4d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.465324:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11699 00010000:00010000:1.0:1651529344.465328:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.465328:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11701 00000100:00100000:0.0:1651529344.465329:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1649:41278:x1731746396255936:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.465332:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.465333:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d696796e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1649:41279:x1731746396256000:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 29us (197us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.465333:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000067750919/0x3234de053c4f00f lrc: 4/0,0 mode: PR/PR res: [0x2b4d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d72d2 expref: 1649 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.465335:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11700 00010000:00010000:0.0:1651529344.465337:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000067750919/0x3234de053c4f00f lrc: 3/0,0 mode: PR/PR res: [0x2b4d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d72d2 expref: 1649 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.465341:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067750919/0x3234de053c4f00f lrc: 0/0,0 mode: --/PR res: [0x2b4d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d72d2 expref: 1648 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.465342:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11702 00000100:00100000:1.0:1651529344.465344:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1648:41278:x1731746396255808:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.465345:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.465345:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.465346:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.465346:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fcfc3592/0x3234de053c50379 lrc: 3/0,1 mode: PW/PW res: [0x2b4d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.465348:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004998ae0c/0x3234de053c4c862 lrc: 4/0,0 mode: PR/PR res: [0x2b4d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd384 expref: 1647 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.465349:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcfc3592/0x3234de053c50379 lrc: 4/0,1 mode: PW/PW res: [0x2b4d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.465351:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004998ae0c/0x3234de053c4c862 lrc: 3/0,0 mode: PR/PR res: [0x2b4d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd384 expref: 1647 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.465357:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.465362:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004998ae0c/0x3234de053c4c862 lrc: 0/0,0 mode: --/PR res: [0x2b4d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd384 expref: 1647 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.465362:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1647:41278:x1731746396255936:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.465364:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11701 00010000:00010000:1.0:1651529344.465366:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.465366:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.465367:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cf51282c/0x3234de053c5036b lrc: 3/0,1 mode: PW/PW res: [0x2b4d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.465372:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf51282c/0x3234de053c5036b lrc: 4/0,1 mode: PW/PW res: [0x2b4d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465373:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000090168046/0x3234de053c5035d lrc: 3/0,1 mode: PW/PW res: [0x2b4d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465376:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090168046/0x3234de053c5035d lrc: 3/0,1 mode: PW/PW res: [0x2b4d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.465381:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.465385:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090168046/0x3234de053c5035d lrc: 3/0,1 mode: PW/PW res: [0x2b4d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.465387:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1645:41278:x1731746396255808:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (246us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.465388:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090168046/0x3234de053c5035d lrc: 2/0,0 mode: PW/PW res: [0x2b4d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.465389:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11702 00010000:00010000:1.0:1651529344.465396:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007c830bc7/0x3234de053c50364 lrc: 3/0,1 mode: PW/PW res: [0x2b4d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.465399:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c830bc7/0x3234de053c50364 lrc: 3/0,1 mode: PW/PW res: [0x2b4d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.465402:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c830bc7/0x3234de053c50364 lrc: 3/0,1 mode: PW/PW res: [0x2b4d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.465405:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c830bc7/0x3234de053c50364 lrc: 2/0,0 mode: PW/PW res: [0x2b4d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.465441:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+416:39030:x1731745946374528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1224us (1331us total) trans 12885078968 rc 0/0 00000100:00100000:0.0:1651529344.465445:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210915 00010000:00010000:0.0:1651529344.465452:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090168046/0x3234de053c5035d lrc: 2/0,0 mode: PW/PW res: [0x2b4d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465455:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000090168046 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.465457:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+415:39030:x1731745946374656:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1204us (1329us total) trans 12885078969 rc 0/0 00010000:00010000:0.0:1651529344.465457:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090168046/0x3234de053c5035d lrc: 2/0,0 mode: PW/PW res: [0x2b4d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465459:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090168046/0x3234de053c5035d lrc: 3/0,0 mode: PW/PW res: [0x2b4d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.465460:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210916 00010000:00010000:0.0:1651529344.465464:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090168046/0x3234de053c5035d lrc: 1/0,0 mode: --/PW res: [0x2b4d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.465467:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004ac46eec/0x3234de053c50356 lrc: 3/0,1 mode: PW/PW res: [0x2b4d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465467:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090168046/0x3234de053c5035d lrc: 0/0,0 mode: --/PW res: [0x2b4d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.465470:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ac46eec/0x3234de053c50356 lrc: 3/0,1 mode: PW/PW res: [0x2b4d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465471:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c830bc7/0x3234de053c50364 lrc: 2/0,0 mode: PW/PW res: [0x2b4d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.465473:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ac46eec/0x3234de053c50356 lrc: 3/0,1 mode: PW/PW res: [0x2b4d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465474:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007c830bc7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.465475:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c830bc7/0x3234de053c50364 lrc: 2/0,0 mode: PW/PW res: [0x2b4d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.465476:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ac46eec/0x3234de053c50356 lrc: 2/0,0 mode: PW/PW res: [0x2b4d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465480:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c830bc7/0x3234de053c50364 lrc: 3/0,0 mode: PW/PW res: [0x2b4d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465489:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c830bc7/0x3234de053c50364 lrc: 1/0,0 mode: --/PW res: [0x2b4d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465492:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c830bc7/0x3234de053c50364 lrc: 0/0,0 mode: --/PW res: [0x2b4d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465496:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ac46eec/0x3234de053c50356 lrc: 2/0,0 mode: PW/PW res: [0x2b4d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465498:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004ac46eec already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.465499:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ac46eec/0x3234de053c50356 lrc: 2/0,0 mode: PW/PW res: [0x2b4d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465502:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ac46eec/0x3234de053c50356 lrc: 3/0,0 mode: PW/PW res: [0x2b4d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465505:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ac46eec/0x3234de053c50356 lrc: 1/0,0 mode: --/PW res: [0x2b4d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465507:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ac46eec/0x3234de053c50356 lrc: 0/0,0 mode: --/PW res: [0x2b4d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.465513:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+415:39029:x1731745946374592:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1335us (1417us total) trans 12885078970 rc 0/0 00010000:00010000:0.0:1651529344.465514:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cf51282c/0x3234de053c5036b lrc: 3/0,1 mode: PW/PW res: [0x2b4d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.465516:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210914 00010000:00010000:0.0:1651529344.465519:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf51282c/0x3234de053c5036b lrc: 3/0,1 mode: PW/PW res: [0x2b4d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.465522:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000006d9a191/0x3234de053c50372 lrc: 3/0,1 mode: PW/PW res: [0x2b4d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465522:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf51282c/0x3234de053c5036b lrc: 3/0,1 mode: PW/PW res: [0x2b4d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.465525:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006d9a191/0x3234de053c50372 lrc: 3/0,1 mode: PW/PW res: [0x2b4d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465525:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf51282c/0x3234de053c5036b lrc: 2/0,0 mode: PW/PW res: [0x2b4d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.465528:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006d9a191/0x3234de053c50372 lrc: 3/0,1 mode: PW/PW res: [0x2b4d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.465531:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006d9a191/0x3234de053c50372 lrc: 2/0,0 mode: PW/PW res: [0x2b4d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.465569:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+416:39030:x1731745946374784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1284us (1435us total) trans 12885078971 rc 0/0 00000100:00100000:1.0:1651529344.465570:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+416:39030:x1731745946374720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1272us (1426us total) trans 12885078972 rc 0/0 00000100:00100000:0.0:1651529344.465572:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210917 00000100:00100000:1.0:1651529344.465574:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210918 00010000:00010000:0.0:1651529344.465579:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf51282c/0x3234de053c5036b lrc: 2/0,0 mode: PW/PW res: [0x2b4d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.465581:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000064149de3/0x3234de053c50380 lrc: 3/0,1 mode: PW/PW res: [0x2b4d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465582:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cf51282c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.465583:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf51282c/0x3234de053c5036b lrc: 2/0,0 mode: PW/PW res: [0x2b4d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.465586:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064149de3/0x3234de053c50380 lrc: 3/0,1 mode: PW/PW res: [0x2b4d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465586:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf51282c/0x3234de053c5036b lrc: 3/0,0 mode: PW/PW res: [0x2b4d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.465589:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064149de3/0x3234de053c50380 lrc: 3/0,1 mode: PW/PW res: [0x2b4d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465590:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf51282c/0x3234de053c5036b lrc: 1/0,0 mode: --/PW res: [0x2b4d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.465592:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000064149de3/0x3234de053c50380 lrc: 2/0,0 mode: PW/PW res: [0x2b4d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465593:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf51282c/0x3234de053c5036b lrc: 0/0,0 mode: --/PW res: [0x2b4d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465597:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006d9a191/0x3234de053c50372 lrc: 2/0,0 mode: PW/PW res: [0x2b4d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465607:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000006d9a191 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.465608:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006d9a191/0x3234de053c50372 lrc: 2/0,0 mode: PW/PW res: [0x2b4d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465610:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006d9a191/0x3234de053c50372 lrc: 3/0,0 mode: PW/PW res: [0x2b4d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465614:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006d9a191/0x3234de053c50372 lrc: 1/0,0 mode: --/PW res: [0x2b4d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465616:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006d9a191/0x3234de053c50372 lrc: 0/0,0 mode: --/PW res: [0x2b4d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465620:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000064149de3/0x3234de053c50380 lrc: 2/0,0 mode: PW/PW res: [0x2b4d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465622:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000064149de3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.465623:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000064149de3/0x3234de053c50380 lrc: 2/0,0 mode: PW/PW res: [0x2b4d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.465626:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+415:39029:x1731745946374912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1137us (1266us total) trans 12885078973 rc 0/0 00010000:00010000:0.0:1651529344.465626:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000064149de3/0x3234de053c50380 lrc: 3/0,0 mode: PW/PW res: [0x2b4d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.465629:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210920 00010000:00010000:0.0:1651529344.465629:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000064149de3/0x3234de053c50380 lrc: 1/0,0 mode: --/PW res: [0x2b4d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465632:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064149de3/0x3234de053c50380 lrc: 0/0,0 mode: --/PW res: [0x2b4d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.465635:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fcfc3592/0x3234de053c50379 lrc: 3/0,1 mode: PW/PW res: [0x2b4d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.465638:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcfc3592/0x3234de053c50379 lrc: 3/0,1 mode: PW/PW res: [0x2b4d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465639:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a82b4949/0x3234de053c5034f lrc: 3/0,1 mode: PW/PW res: [0x2b4d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.465641:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcfc3592/0x3234de053c50379 lrc: 3/0,1 mode: PW/PW res: [0x2b4d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465642:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a82b4949/0x3234de053c5034f lrc: 3/0,1 mode: PW/PW res: [0x2b4d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.465644:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fcfc3592/0x3234de053c50379 lrc: 2/0,0 mode: PW/PW res: [0x2b4d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465646:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a82b4949/0x3234de053c5034f lrc: 3/0,1 mode: PW/PW res: [0x2b4d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465648:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a82b4949/0x3234de053c5034f lrc: 2/0,0 mode: PW/PW res: [0x2b4d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.465678:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+416:39029:x1731745946374848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1239us (1332us total) trans 12885078974 rc 0/0 00000100:00100000:1.0:1651529344.465683:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210919 00000100:00100000:0.0:1651529344.465689:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+415:39030:x1731745946374464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1559us (1611us total) trans 12885078975 rc 0/0 00000100:00100000:0.0:1651529344.465692:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210913 00010000:00010000:0.0:1651529344.465699:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fcfc3592/0x3234de053c50379 lrc: 2/0,0 mode: PW/PW res: [0x2b4d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465702:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fcfc3592 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.465703:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcfc3592/0x3234de053c50379 lrc: 2/0,0 mode: PW/PW res: [0x2b4d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465706:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcfc3592/0x3234de053c50379 lrc: 3/0,0 mode: PW/PW res: [0x2b4d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465711:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fcfc3592/0x3234de053c50379 lrc: 1/0,0 mode: --/PW res: [0x2b4d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465713:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcfc3592/0x3234de053c50379 lrc: 0/0,0 mode: --/PW res: [0x2b4d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465717:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a82b4949/0x3234de053c5034f lrc: 2/0,0 mode: PW/PW res: [0x2b4d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465720:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a82b4949 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.465721:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a82b4949/0x3234de053c5034f lrc: 2/0,0 mode: PW/PW res: [0x2b4d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465724:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a82b4949/0x3234de053c5034f lrc: 3/0,0 mode: PW/PW res: [0x2b4d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465727:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a82b4949/0x3234de053c5034f lrc: 1/0,0 mode: --/PW res: [0x2b4d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.465729:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a82b4949/0x3234de053c5034f lrc: 0/0,0 mode: --/PW res: [0x2b4d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.465964:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.465974:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.465983:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946375552 00000100:00100000:0.0:1651529344.465994:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946375488 00000100:00100000:0.0:1651529344.465998:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210921 00000100:00100000:0.0:1651529344.466000:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+416:39030:x1731745946375552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.466003:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.466006:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177370 count 1 00000100:00100000:1.0:1651529344.466014:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.466017:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c50387 lrc: 3/0,1 mode: --/PW res: [0x2b4da:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.466021:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946375680 00010000:00010000:0.0:1651529344.466022:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000926c859f/0x3234de053c4ef1a lrc: 2/0,0 mode: PR/PR res: [0x2b4da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e9c expref: 1644 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.466025:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.466025:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.466026:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c50387 lrc: 4/0,1 mode: --/PW res: [0x2b4da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.466028:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946375616 00000100:00100000:1.0:1651529344.466034:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210922 00000100:00100000:1.0:1651529344.466036:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+418:39030:x1731745946375488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.466038:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000926c859f/0x3234de053c4ef1a lrc: 3/0,0 mode: PR/PR res: [0x2b4da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e9c expref: 1644 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.466042:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177369 count 1 00010000:00010000:0.0:1651529344.466042:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000926c859f/0x3234de053c4ef1a lrc: 4/0,0 mode: PR/PR res: [0x2b4da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e9c expref: 1644 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.466046:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066ae2b40/0x3234de053c5038e lrc: 3/0,1 mode: --/PW res: [0x2b4d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.466046:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996965696:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.466051:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000905f0208/0x3234de053c4dedc lrc: 2/0,0 mode: PR/PR res: [0x2b4d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c62 expref: 1644 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.466055:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.466055:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.466056:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066ae2b40/0x3234de053c5038e lrc: 4/0,1 mode: --/PW res: [0x2b4d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.466061:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 0000000009370c1d going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.466069:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000905f0208/0x3234de053c4dedc lrc: 3/0,0 mode: PR/PR res: [0x2b4d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c62 expref: 1644 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.466073:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000905f0208/0x3234de053c4dedc lrc: 4/0,0 mode: PR/PR res: [0x2b4d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c62 expref: 1644 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.466085:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000822949b3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996965760:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.466095:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 000000007d8fabda going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.466103:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210923 00000100:00100000:0.0:1651529344.466106:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+418:39030:x1731745946375680:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.466111:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177372 count 1 00000100:00100000:1.0:1651529344.466114:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210924 00010000:00010000:0.0:1651529344.466115:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ce5f676/0x3234de053c50395 lrc: 3/0,1 mode: --/PW res: [0x2b4dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.466116:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+418:39030:x1731745946375616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.466120:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009b8354b8/0x3234de053c4d3d0 lrc: 2/0,0 mode: PR/PR res: [0x2b4dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0112 expref: 1644 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.466121:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177371 count 1 00010000:00010000:0.0:1651529344.466123:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.466124:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.466124:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ce5f676/0x3234de053c50395 lrc: 4/0,1 mode: --/PW res: [0x2b4dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466125:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000186a4198/0x3234de053c5039c lrc: 3/0,1 mode: --/PW res: [0x2b4db:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466129:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ffbea262/0x3234de053c4ca22 lrc: 2/0,0 mode: PR/PR res: [0x2b4db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda45 expref: 1644 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.466131:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009b8354b8/0x3234de053c4d3d0 lrc: 3/0,0 mode: PR/PR res: [0x2b4dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0112 expref: 1644 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.466132:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.466133:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.466133:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000186a4198/0x3234de053c5039c lrc: 4/0,1 mode: --/PW res: [0x2b4db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466134:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009b8354b8/0x3234de053c4d3d0 lrc: 4/0,0 mode: PR/PR res: [0x2b4dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0112 expref: 1644 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.466138:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996965824:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.466139:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ffbea262/0x3234de053c4ca22 lrc: 3/0,0 mode: PR/PR res: [0x2b4db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda45 expref: 1644 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.466143:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ffbea262/0x3234de053c4ca22 lrc: 4/0,0 mode: PR/PR res: [0x2b4db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda45 expref: 1644 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.466147:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000076d5f96b pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996965888:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.466154:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 0000000057299e7f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.466159:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 000000000a4def41 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.466169:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.466179:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946375744 00000100:00100000:0.0:1651529344.466190:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210925 00000100:00100000:0.0:1651529344.466192:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+419:39029:x1731745946375744:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.466195:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.466197:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177373 count 1 00010000:00010000:0.0:1651529344.466201:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c503a3 lrc: 3/0,1 mode: --/PW res: [0x2b4dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466205:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004ad0fa64/0x3234de053c4e37b lrc: 2/0,0 mode: PR/PR res: [0x2b4dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ef3 expref: 1644 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.466206:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.466208:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.466209:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.466210:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c503a3 lrc: 4/0,1 mode: --/PW res: [0x2b4dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.466216:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.466216:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004ad0fa64/0x3234de053c4e37b lrc: 3/0,0 mode: PR/PR res: [0x2b4dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ef3 expref: 1644 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.466220:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004ad0fa64/0x3234de053c4e37b lrc: 4/0,0 mode: PR/PR res: [0x2b4dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ef3 expref: 1644 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.466244:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996965952:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.466252:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a3b00cf3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.466278:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946375808 00000100:00100000:1.0:1651529344.466286:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946375936 00000100:00100000:1.0:1651529344.466292:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946375872 00000100:00100000:1.0:1651529344.466299:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210926 00000100:00100000:1.0:1651529344.466300:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076ec8e72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+422:39030:x1731745946375808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.466305:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177374 count 1 00000100:00100000:0.0:1651529344.466305:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210927 00000100:00100000:0.0:1651529344.466307:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+422:39030:x1731745946375936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.466310:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c503aa lrc: 3/0,1 mode: --/PW res: [0x2b4de:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.466312:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177376 count 1 00010000:00010000:1.0:1651529344.466314:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000be4c8fe2/0x3234de053c4ddaf lrc: 2/0,0 mode: PR/PR res: [0x2b4de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d281e expref: 1644 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.466316:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000443c0ff5/0x3234de053c503b1 lrc: 3/0,1 mode: --/PW res: [0x2b4e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466317:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.466318:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.466319:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c503aa lrc: 4/0,1 mode: --/PW res: [0x2b4de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466321:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000def1c022/0x3234de053c4dd93 lrc: 2/0,0 mode: PR/PR res: [0x2b4e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d276f expref: 1644 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.466324:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.466325:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000be4c8fe2/0x3234de053c4ddaf lrc: 3/0,0 mode: PR/PR res: [0x2b4de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d281e expref: 1644 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.466325:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.466325:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000443c0ff5/0x3234de053c503b1 lrc: 4/0,1 mode: --/PW res: [0x2b4e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466329:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000be4c8fe2/0x3234de053c4ddaf lrc: 4/0,0 mode: PR/PR res: [0x2b4de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d281e expref: 1644 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.466332:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000def1c022/0x3234de053c4dd93 lrc: 3/0,0 mode: PR/PR res: [0x2b4e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d276f expref: 1644 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.466333:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009acffcb8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996966016:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.466335:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000def1c022/0x3234de053c4dd93 lrc: 4/0,0 mode: PR/PR res: [0x2b4e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d276f expref: 1644 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.466339:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996966080:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.466343:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000499d0377 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.466348:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 0000000070e666f7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.466349:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210928 00000100:00100000:1.0:1651529344.466351:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+422:39030:x1731745946375872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.466355:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177375 count 1 00010000:00010000:1.0:1651529344.466358:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce366906/0x3234de053c503b8 lrc: 3/0,1 mode: --/PW res: [0x2b4df:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466363:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b7b9262b/0x3234de053c4ce35 lrc: 2/0,0 mode: PR/PR res: [0x2b4df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea52 expref: 1644 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.466366:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.466366:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.466367:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce366906/0x3234de053c503b8 lrc: 4/0,1 mode: --/PW res: [0x2b4df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466372:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b7b9262b/0x3234de053c4ce35 lrc: 3/0,0 mode: PR/PR res: [0x2b4df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea52 expref: 1644 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.466376:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b7b9262b/0x3234de053c4ce35 lrc: 4/0,0 mode: PR/PR res: [0x2b4df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea52 expref: 1644 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.466380:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d6486d55 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996966144:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.466386:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a4eb401d going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.466566:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996965696:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.466589:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.466593:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c50387 lrc: 3/0,1 mode: --/PW res: [0x2b4da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.466597:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.466605:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.466609:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996965824:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.466611:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.466612:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008ce5f676/0x3234de053c50395 lrc: 3/0,1 mode: --/PW res: [0x2b4dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.466620:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.466623:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996965952:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.466633:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000076d5f96b pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996965888:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.466660:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c503a3 lrc: 3/0,1 mode: --/PW res: [0x2b4dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466661:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000186a4198/0x3234de053c5039c lrc: 3/0,1 mode: --/PW res: [0x2b4db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.466669:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396256576 00000100:00100000:1.0:1651529344.466670:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009acffcb8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996966016:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.466673:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c503aa lrc: 3/0,1 mode: --/PW res: [0x2b4de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.466679:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000822949b3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996965760:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.466681:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000066ae2b40/0x3234de053c5038e lrc: 3/0,1 mode: --/PW res: [0x2b4d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466685:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000926c859f/0x3234de053c4ef1a lrc: 4/0,0 mode: PR/PR res: [0x2b4da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e9c expref: 1645 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.466687:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396256704 00010000:00010000:1.0:1651529344.466692:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ffbea262/0x3234de053c4ca22 lrc: 4/0,0 mode: PR/PR res: [0x2b4db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda45 expref: 1646 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.466692:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396256832 00010000:00010000:0.0:1651529344.466694:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004ad0fa64/0x3234de053c4e37b lrc: 4/0,0 mode: PR/PR res: [0x2b4dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ef3 expref: 1647 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.466697:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396256640 00000100:00100000:0.0:1651529344.466699:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396256768 00010000:00010000:1.0:1651529344.466700:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000905f0208/0x3234de053c4dedc lrc: 4/0,0 mode: PR/PR res: [0x2b4d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c62 expref: 1648 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.466701:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009b8354b8/0x3234de053c4d3d0 lrc: 4/0,0 mode: PR/PR res: [0x2b4dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0112 expref: 1649 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.466705:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11703 00000100:00100000:1.0:1651529344.466707:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1649:41278:x1731746396256576:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.466708:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11704 00010000:00010000:1.0:1651529344.466709:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.466709:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1649:41278:x1731746396256704:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.466711:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000926c859f/0x3234de053c4ef1a lrc: 4/0,0 mode: PR/PR res: [0x2b4da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e9c expref: 1649 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.466712:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.466714:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ffbea262/0x3234de053c4ca22 lrc: 4/0,0 mode: PR/PR res: [0x2b4db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda45 expref: 1649 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.466715:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000926c859f/0x3234de053c4ef1a lrc: 3/0,0 mode: PR/PR res: [0x2b4da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e9c expref: 1649 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.466717:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ffbea262/0x3234de053c4ca22 lrc: 3/0,0 mode: PR/PR res: [0x2b4db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda45 expref: 1649 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.466721:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000926c859f/0x3234de053c4ef1a lrc: 0/0,0 mode: --/PR res: [0x2b4da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e9c expref: 1649 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.466723:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ffbea262/0x3234de053c4ca22 lrc: 0/0,0 mode: --/PR res: [0x2b4db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda45 expref: 1649 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.466724:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.466725:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.466726:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c50387 lrc: 3/0,1 mode: PW/PW res: [0x2b4da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466727:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.466727:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.466728:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000186a4198/0x3234de053c5039c lrc: 3/0,1 mode: PW/PW res: [0x2b4db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466729:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c50387 lrc: 4/0,1 mode: PW/PW res: [0x2b4da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466731:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000186a4198/0x3234de053c5039c lrc: 4/0,1 mode: PW/PW res: [0x2b4db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466747:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.466756:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.466763:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1647:41278:x1731746396256576:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 55us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.466764:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1647:41278:x1731746396256704:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 54us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.466766:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11703 00000100:00100000:0.0:1651529344.466768:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11704 00000100:00100000:1.0:1651529344.466771:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11705 00000100:00100000:1.0:1651529344.466773:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1645:41278:x1731746396256832:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.466773:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11706 00000100:00100000:0.0:1651529344.466775:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1645:41278:x1731746396256640:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.466776:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.466777:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004ad0fa64/0x3234de053c4e37b lrc: 4/0,0 mode: PR/PR res: [0x2b4dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ef3 expref: 1645 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.466778:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.466781:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004ad0fa64/0x3234de053c4e37b lrc: 3/0,0 mode: PR/PR res: [0x2b4dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ef3 expref: 1645 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.466786:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ad0fa64/0x3234de053c4e37b lrc: 0/0,0 mode: --/PR res: [0x2b4dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ef3 expref: 1645 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.466792:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.466792:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000905f0208/0x3234de053c4dedc lrc: 4/0,0 mode: PR/PR res: [0x2b4d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c62 expref: 1645 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.466793:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.466794:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c503a3 lrc: 3/0,1 mode: PW/PW res: [0x2b4dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466796:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000905f0208/0x3234de053c4dedc lrc: 3/0,0 mode: PR/PR res: [0x2b4d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c62 expref: 1644 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.466797:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c503a3 lrc: 4/0,1 mode: PW/PW res: [0x2b4dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466801:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000905f0208/0x3234de053c4dedc lrc: 0/0,0 mode: --/PR res: [0x2b4d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c62 expref: 1644 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.466806:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.466811:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.466811:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.466812:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1643:41278:x1731746396256832:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (206us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.466812:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000066ae2b40/0x3234de053c5038e lrc: 3/0,1 mode: PW/PW res: [0x2b4d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.466814:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11705 00010000:00010000:0.0:1651529344.466815:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066ae2b40/0x3234de053c5038e lrc: 4/0,1 mode: PW/PW res: [0x2b4d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.466819:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11707 00000100:00100000:1.0:1651529344.466821:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000534d68d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1642:41278:x1731746396256768:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.466824:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.466829:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.466831:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009b8354b8/0x3234de053c4d3d0 lrc: 4/0,0 mode: PR/PR res: [0x2b4dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0112 expref: 1642 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.466831:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1642:41278:x1731746396256640:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 55us (219us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.466834:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009b8354b8/0x3234de053c4d3d0 lrc: 3/0,0 mode: PR/PR res: [0x2b4dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0112 expref: 1642 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.466834:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11706 00010000:00010000:1.0:1651529344.466839:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b8354b8/0x3234de053c4d3d0 lrc: 0/0,0 mode: --/PR res: [0x2b4dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0112 expref: 1641 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.466841:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c503a3 lrc: 3/0,1 mode: PW/PW res: [0x2b4dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466843:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.466843:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.466844:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008ce5f676/0x3234de053c50395 lrc: 3/0,1 mode: PW/PW res: [0x2b4dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466844:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c503a3 lrc: 3/0,1 mode: PW/PW res: [0x2b4dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466847:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ce5f676/0x3234de053c50395 lrc: 4/0,1 mode: PW/PW res: [0x2b4dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466850:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c503a3 lrc: 3/0,1 mode: PW/PW res: [0x2b4dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466852:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c503a3 lrc: 2/0,0 mode: PW/PW res: [0x2b4dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466855:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.466861:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000534d68d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1640:41278:x1731746396256768:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 39us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.466863:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11707 00010000:00010000:1.0:1651529344.466873:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000066ae2b40/0x3234de053c5038e lrc: 3/0,1 mode: PW/PW res: [0x2b4d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466876:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066ae2b40/0x3234de053c5038e lrc: 3/0,1 mode: PW/PW res: [0x2b4d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466879:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066ae2b40/0x3234de053c5038e lrc: 3/0,1 mode: PW/PW res: [0x2b4d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466882:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066ae2b40/0x3234de053c5038e lrc: 2/0,0 mode: PW/PW res: [0x2b4d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.466905:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+424:39029:x1731745946375744:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 712us (736us total) trans 12885078976 rc 0/0 00000100:00100000:0.0:1651529344.466909:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210925 00010000:00010000:0.0:1651529344.466916:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c503a3 lrc: 2/0,0 mode: PW/PW res: [0x2b4dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466919:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dcd3e2d1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.466920:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c503a3 lrc: 2/0,0 mode: PW/PW res: [0x2b4dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.466923:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+423:39030:x1731745946375488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 886us (948us total) trans 12885078977 rc 0/0 00010000:00010000:0.0:1651529344.466923:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c503a3 lrc: 3/0,0 mode: PW/PW res: [0x2b4dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.466926:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210922 00010000:00010000:0.0:1651529344.466928:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c503a3 lrc: 1/0,0 mode: --/PW res: [0x2b4dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466931:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c503a3 lrc: 0/0,0 mode: --/PW res: [0x2b4dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466933:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000186a4198/0x3234de053c5039c lrc: 3/0,1 mode: PW/PW res: [0x2b4db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466935:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066ae2b40/0x3234de053c5038e lrc: 2/0,0 mode: PW/PW res: [0x2b4d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466938:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000066ae2b40 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.466939:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000186a4198/0x3234de053c5039c lrc: 3/0,1 mode: PW/PW res: [0x2b4db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466939:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066ae2b40/0x3234de053c5038e lrc: 2/0,0 mode: PW/PW res: [0x2b4d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466941:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066ae2b40/0x3234de053c5038e lrc: 3/0,0 mode: PW/PW res: [0x2b4d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466942:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000186a4198/0x3234de053c5039c lrc: 3/0,1 mode: PW/PW res: [0x2b4db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.466945:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000186a4198/0x3234de053c5039c lrc: 2/0,0 mode: PW/PW res: [0x2b4db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466945:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066ae2b40/0x3234de053c5038e lrc: 1/0,0 mode: --/PW res: [0x2b4d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466947:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066ae2b40/0x3234de053c5038e lrc: 0/0,0 mode: --/PW res: [0x2b4d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466951:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000186a4198/0x3234de053c5039c lrc: 3/0,0 mode: PW/PW res: [0x2b4db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466960:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000186a4198 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.466961:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000186a4198/0x3234de053c5039c lrc: 2/0,0 mode: PW/PW res: [0x2b4db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466963:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000186a4198/0x3234de053c5039c lrc: 3/0,0 mode: PW/PW res: [0x2b4db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466966:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000186a4198/0x3234de053c5039c lrc: 1/0,0 mode: --/PW res: [0x2b4db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466969:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000186a4198/0x3234de053c5039c lrc: 0/0,0 mode: --/PW res: [0x2b4db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466976:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008ce5f676/0x3234de053c50395 lrc: 3/0,1 mode: PW/PW res: [0x2b4dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.466979:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ce5f676/0x3234de053c50395 lrc: 3/0,1 mode: PW/PW res: [0x2b4dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.466980:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+423:39030:x1731745946375616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 864us (966us total) trans 12885078978 rc 0/0 00010000:00010000:0.0:1651529344.466982:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ce5f676/0x3234de053c50395 lrc: 3/0,1 mode: PW/PW res: [0x2b4dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.466983:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210924 00010000:00010000:0.0:1651529344.466985:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ce5f676/0x3234de053c50395 lrc: 2/0,0 mode: PW/PW res: [0x2b4dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.467018:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.467020:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+423:39030:x1731745946375680:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 914us (1028us total) trans 12885078979 rc 0/0 00000100:00100000:0.0:1651529344.467023:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210923 00010000:00010000:0.0:1651529344.467030:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ce5f676/0x3234de053c50395 lrc: 2/0,0 mode: PW/PW res: [0x2b4dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.467033:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008ce5f676 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.467034:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ce5f676/0x3234de053c50395 lrc: 2/0,0 mode: PW/PW res: [0x2b4dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.467044:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ce5f676/0x3234de053c50395 lrc: 3/0,0 mode: PW/PW res: [0x2b4dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.467048:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ce5f676/0x3234de053c50395 lrc: 1/0,0 mode: --/PW res: [0x2b4dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.467051:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ce5f676/0x3234de053c50395 lrc: 0/0,0 mode: --/PW res: [0x2b4dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.467053:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.467061:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996966080:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.467062:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.467070:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000443c0ff5/0x3234de053c503b1 lrc: 3/0,1 mode: --/PW res: [0x2b4e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.467077:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396256896 00010000:00010000:0.0:1651529344.467081:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000be4c8fe2/0x3234de053c4ddaf lrc: 4/0,0 mode: PR/PR res: [0x2b4de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d281e expref: 1640 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.467086:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396256960 00010000:00010000:0.0:1651529344.467088:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000def1c022/0x3234de053c4dd93 lrc: 4/0,0 mode: PR/PR res: [0x2b4e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d276f expref: 1641 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.467092:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396257024 00010000:00010000:0.0:1651529344.467094:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b7b9262b/0x3234de053c4ce35 lrc: 5/0,0 mode: PR/PR res: [0x2b4df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea52 expref: 1642 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.467099:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11708 00000100:00100000:0.0:1651529344.467100:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1642:41279:x1731746396256896:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.467103:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.467104:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000be4c8fe2/0x3234de053c4ddaf lrc: 4/0,0 mode: PR/PR res: [0x2b4de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d281e expref: 1642 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.467110:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000be4c8fe2/0x3234de053c4ddaf lrc: 3/0,0 mode: PR/PR res: [0x2b4de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d281e expref: 1642 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.467115:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be4c8fe2/0x3234de053c4ddaf lrc: 0/0,0 mode: --/PR res: [0x2b4de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d281e expref: 1642 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.467118:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.467119:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.467120:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c503aa lrc: 3/0,1 mode: PW/PW res: [0x2b4de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.467123:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c503aa lrc: 4/0,1 mode: PW/PW res: [0x2b4de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.467128:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d6486d55 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996966144:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.467133:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.467137:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ce366906/0x3234de053c503b8 lrc: 3/0,1 mode: --/PW res: [0x2b4df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.467143:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c503aa lrc: 3/0,1 mode: PW/PW res: [0x2b4de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.467146:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c503aa lrc: 3/0,1 mode: PW/PW res: [0x2b4de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.467149:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c503aa lrc: 3/0,1 mode: PW/PW res: [0x2b4de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.467153:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c503aa lrc: 2/0,0 mode: PW/PW res: [0x2b4de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.467173:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1641:41279:x1731746396256896:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 72us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.467176:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11708 00000100:00100000:0.0:1651529344.467181:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11709 00000100:00100000:0.0:1651529344.467183:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1640:41279:x1731746396256960:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.467186:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.467187:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000def1c022/0x3234de053c4dd93 lrc: 4/0,0 mode: PR/PR res: [0x2b4e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d276f expref: 1640 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.467191:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000def1c022/0x3234de053c4dd93 lrc: 3/0,0 mode: PR/PR res: [0x2b4e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d276f expref: 1640 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.467196:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000def1c022/0x3234de053c4dd93 lrc: 0/0,0 mode: --/PR res: [0x2b4e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d276f expref: 1640 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.467199:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076ec8e72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+423:39030:x1731745946375808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 897us (1004us total) trans 12885078980 rc 0/0 00010000:00010000:0.0:1651529344.467200:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.467201:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.467201:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000443c0ff5/0x3234de053c503b1 lrc: 3/0,1 mode: PW/PW res: [0x2b4e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.467202:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210926 00010000:00010000:0.0:1651529344.467204:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000443c0ff5/0x3234de053c503b1 lrc: 4/0,1 mode: PW/PW res: [0x2b4e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.467210:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11710 00010000:00010000:0.0:1651529344.467211:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.467212:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1639:41279:x1731746396257024:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.467215:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.467217:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b7b9262b/0x3234de053c4ce35 lrc: 4/0,0 mode: PR/PR res: [0x2b4df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea52 expref: 1639 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.467217:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1639:41279:x1731746396256960:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 33us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.467220:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11709 00010000:00010000:1.0:1651529344.467221:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b7b9262b/0x3234de053c4ce35 lrc: 3/0,0 mode: PR/PR res: [0x2b4df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea52 expref: 1639 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.467243:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7b9262b/0x3234de053c4ce35 lrc: 0/0,0 mode: --/PR res: [0x2b4df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea52 expref: 1638 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.467244:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c503aa lrc: 2/0,0 mode: PW/PW res: [0x2b4de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.467247:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.467247:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000005af6806 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.467248:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.467248:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ce366906/0x3234de053c503b8 lrc: 3/0,1 mode: PW/PW res: [0x2b4df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.467248:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c503aa lrc: 2/0,0 mode: PW/PW res: [0x2b4de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.467251:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce366906/0x3234de053c503b8 lrc: 4/0,1 mode: PW/PW res: [0x2b4df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.467251:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c503aa lrc: 3/0,0 mode: PW/PW res: [0x2b4de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.467255:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c503aa lrc: 1/0,0 mode: --/PW res: [0x2b4de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.467260:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.467267:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1637:41279:x1731746396257024:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 55us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.467270:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11710 00010000:00010000:0.0:1651529344.467274:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c503aa lrc: 0/0,0 mode: --/PW res: [0x2b4de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.467276:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ce366906/0x3234de053c503b8 lrc: 3/0,1 mode: PW/PW res: [0x2b4df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.467280:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce366906/0x3234de053c503b8 lrc: 3/0,1 mode: PW/PW res: [0x2b4df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.467283:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce366906/0x3234de053c503b8 lrc: 3/0,1 mode: PW/PW res: [0x2b4df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.467286:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce366906/0x3234de053c503b8 lrc: 2/0,0 mode: PW/PW res: [0x2b4df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.467291:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000443c0ff5/0x3234de053c503b1 lrc: 3/0,1 mode: PW/PW res: [0x2b4e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.467299:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000443c0ff5/0x3234de053c503b1 lrc: 3/0,1 mode: PW/PW res: [0x2b4e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.467302:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000443c0ff5/0x3234de053c503b1 lrc: 3/0,1 mode: PW/PW res: [0x2b4e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.467305:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000443c0ff5/0x3234de053c503b1 lrc: 2/0,0 mode: PW/PW res: [0x2b4e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.467324:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+423:39030:x1731745946375872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 972us (1107us total) trans 12885078981 rc 0/0 00000100:00100000:1.0:1651529344.467326:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210928 00000100:00100000:0.0:1651529344.467354:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+423:39030:x1731745946375936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1046us (1148us total) trans 12885078982 rc 0/0 00000100:00100000:0.0:1651529344.467357:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210927 00000100:00100000:1.0:1651529344.467362:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.467365:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce366906/0x3234de053c503b8 lrc: 2/0,0 mode: PW/PW res: [0x2b4df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.467375:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ce366906 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.467376:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce366906/0x3234de053c503b8 lrc: 2/0,0 mode: PW/PW res: [0x2b4df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.467379:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.467379:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce366906/0x3234de053c503b8 lrc: 3/0,0 mode: PW/PW res: [0x2b4df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.467384:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce366906/0x3234de053c503b8 lrc: 1/0,0 mode: --/PW res: [0x2b4df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.467386:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce366906/0x3234de053c503b8 lrc: 0/0,0 mode: --/PW res: [0x2b4df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.467390:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.467391:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000443c0ff5/0x3234de053c503b1 lrc: 2/0,0 mode: PW/PW res: [0x2b4e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.467393:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000443c0ff5 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.467394:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000443c0ff5/0x3234de053c503b1 lrc: 2/0,0 mode: PW/PW res: [0x2b4e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.467397:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000443c0ff5/0x3234de053c503b1 lrc: 3/0,0 mode: PW/PW res: [0x2b4e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.467399:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.467400:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000443c0ff5/0x3234de053c503b1 lrc: 1/0,0 mode: --/PW res: [0x2b4e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.467407:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000443c0ff5/0x3234de053c503b1 lrc: 0/0,0 mode: --/PW res: [0x2b4e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.467415:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946376512 00000100:00100000:0.0:1651529344.467424:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946376576 00000100:00100000:0.0:1651529344.467427:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946376640 00000100:00100000:0.0:1651529344.467431:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946376704 00000100:00100000:0.0:1651529344.467436:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210929 00000100:00100000:0.0:1651529344.467438:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+426:39030:x1731745946376512:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.467443:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177377 count 1 00010000:00010000:0.0:1651529344.467447:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c503bf lrc: 3/0,1 mode: --/PW res: [0x2b4e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.467452:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210930 00010000:00010000:0.0:1651529344.467452:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a6d30a2f/0x3234de053c4d1df lrc: 2/0,0 mode: PR/PR res: [0x2b4e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf947 expref: 1636 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.467454:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a13808c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+426:39030:x1731745946376576:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.467455:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.467455:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.467456:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c503bf lrc: 4/0,1 mode: --/PW res: [0x2b4e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.467461:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177378 count 1 00010000:00010000:0.0:1651529344.467463:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a6d30a2f/0x3234de053c4d1df lrc: 3/0,0 mode: PR/PR res: [0x2b4e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf947 expref: 1636 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.467465:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007bbb621e/0x3234de053c503c6 lrc: 3/0,1 mode: --/PW res: [0x2b4e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.467466:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a6d30a2f/0x3234de053c4d1df lrc: 4/0,0 mode: PR/PR res: [0x2b4e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf947 expref: 1636 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.467470:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d0ad467d/0x3234de053c4e462 lrc: 2/0,0 mode: PR/PR res: [0x2b4e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42a4 expref: 1636 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.467470:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996966208:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.467473:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.467474:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.467475:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007bbb621e/0x3234de053c503c6 lrc: 4/0,1 mode: --/PW res: [0x2b4e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.467482:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d0ad467d/0x3234de053c4e462 lrc: 3/0,0 mode: PR/PR res: [0x2b4e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42a4 expref: 1636 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.467492:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d0ad467d/0x3234de053c4e462 lrc: 4/0,0 mode: PR/PR res: [0x2b4e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42a4 expref: 1636 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.467496:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009acffcb8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996966272:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.467499:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 000000000d706dff going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.467505:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f79d8146 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.467507:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210931 00000100:00100000:0.0:1651529344.467508:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+426:39030:x1731745946376640:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.467512:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210932 00000100:00100000:1.0:1651529344.467513:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+426:39029:x1731745946376704:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.467514:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177379 count 1 00010000:00010000:0.0:1651529344.467517:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c503cd lrc: 3/0,1 mode: --/PW res: [0x2b4e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.467518:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177380 count 1 00010000:00010000:1.0:1651529344.467521:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013d9f24c/0x3234de053c503d4 lrc: 3/0,1 mode: --/PW res: [0x2b4e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.467524:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c4e859 lrc: 2/0,0 mode: PR/PR res: [0x2b4e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d523a expref: 1636 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.467526:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000062273051/0x3234de053c4e549 lrc: 2/0,0 mode: PR/PR res: [0x2b4e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d462b expref: 1636 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.467527:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.467528:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.467529:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.467529:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.467529:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c503cd lrc: 4/0,1 mode: --/PW res: [0x2b4e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.467530:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013d9f24c/0x3234de053c503d4 lrc: 4/0,1 mode: --/PW res: [0x2b4e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.467535:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c4e859 lrc: 3/0,0 mode: PR/PR res: [0x2b4e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d523a expref: 1636 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.467536:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000062273051/0x3234de053c4e549 lrc: 3/0,0 mode: PR/PR res: [0x2b4e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d462b expref: 1636 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.467539:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000062273051/0x3234de053c4e549 lrc: 4/0,0 mode: PR/PR res: [0x2b4e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d462b expref: 1636 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.467539:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c4e859 lrc: 4/0,0 mode: PR/PR res: [0x2b4e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d523a expref: 1636 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.467543:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005fb0ec6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996966400:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.467543:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996966336:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.467551:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c0dff858 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.467552:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b52d0f36 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.467557:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c50387 lrc: 3/0,1 mode: PW/PW res: [0x2b4da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.467560:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c50387 lrc: 3/0,1 mode: PW/PW res: [0x2b4da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.467563:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c50387 lrc: 3/0,1 mode: PW/PW res: [0x2b4da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.467566:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c50387 lrc: 2/0,0 mode: PW/PW res: [0x2b4da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.467622:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.467630:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.467637:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.467647:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+427:39030:x1731745946375552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1646us (1682us total) trans 12885078983 rc 0/0 00000100:00100000:0.0:1651529344.467650:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210921 00000100:00100000:0.0:1651529344.467668:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946376768 00000100:00100000:0.0:1651529344.467674:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946376832 00000100:00100000:1.0:1651529344.467675:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946376896 00000100:00100000:0.0:1651529344.467696:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210933 00000100:00100000:0.0:1651529344.467698:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+429:39029:x1731745946376768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.467702:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210934 00000100:00100000:1.0:1651529344.467703:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+429:39030:x1731745946376832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.467704:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177381 count 1 00002000:00080000:1.0:1651529344.467708:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177382 count 1 00010000:00010000:0.0:1651529344.467708:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c503db lrc: 3/0,1 mode: --/PW res: [0x2b4e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.467712:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088155288/0x3234de053c503e2 lrc: 3/0,1 mode: --/PW res: [0x2b4e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.467712:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000d38ed81/0x3234de053c4e6fb lrc: 2/0,0 mode: PR/PR res: [0x2b4e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4cec expref: 1636 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.467715:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.467716:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.467717:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000082ea9883/0x3234de053c4e167 lrc: 2/0,0 mode: PR/PR res: [0x2b4e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d369c expref: 1636 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.467717:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c503db lrc: 4/0,1 mode: --/PW res: [0x2b4e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.467723:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.467723:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.467723:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000d38ed81/0x3234de053c4e6fb lrc: 3/0,0 mode: PR/PR res: [0x2b4e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4cec expref: 1636 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.467724:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088155288/0x3234de053c503e2 lrc: 4/0,1 mode: --/PW res: [0x2b4e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.467727:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000d38ed81/0x3234de053c4e6fb lrc: 4/0,0 mode: PR/PR res: [0x2b4e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4cec expref: 1636 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.467730:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000082ea9883/0x3234de053c4e167 lrc: 3/0,0 mode: PR/PR res: [0x2b4e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d369c expref: 1636 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.467731:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996966464:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.467743:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000082ea9883/0x3234de053c4e167 lrc: 4/0,0 mode: PR/PR res: [0x2b4e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d369c expref: 1636 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.467747:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d28c414b pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996966528:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.467748:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 0000000009370c1d going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.467754:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c50387 lrc: 2/0,0 mode: PW/PW res: [0x2b4da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.467756:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cfa1ca05 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.467757:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c78576a1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.467758:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c50387 lrc: 2/0,0 mode: PW/PW res: [0x2b4da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.467761:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c50387 lrc: 3/0,0 mode: PW/PW res: [0x2b4da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.467763:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210935 00000100:00100000:1.0:1651529344.467765:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+429:39029:x1731745946376896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.467765:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c50387 lrc: 1/0,0 mode: --/PW res: [0x2b4da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.467768:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c50387 lrc: 0/0,0 mode: --/PW res: [0x2b4da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.467769:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177383 count 1 00010000:00010000:1.0:1651529344.467772:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005976006a/0x3234de053c503e9 lrc: 3/0,1 mode: --/PW res: [0x2b4e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.467777:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c4c640 lrc: 2/0,0 mode: PR/PR res: [0x2b4e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb03 expref: 1636 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.467780:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.467780:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.467781:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005976006a/0x3234de053c503e9 lrc: 4/0,1 mode: --/PW res: [0x2b4e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.467789:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c4c640 lrc: 3/0,0 mode: PR/PR res: [0x2b4e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb03 expref: 1636 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.467793:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c4c640 lrc: 4/0,0 mode: PR/PR res: [0x2b4e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb03 expref: 1636 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.467797:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000066de8c9f pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996966592:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.467802:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 0000000057299e7f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.467828:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996966208:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.467833:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.467833:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c503bf lrc: 3/0,1 mode: --/PW res: [0x2b4e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.467863:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946376960 00000100:00100000:1.0:1651529344.467871:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210936 00000100:00100000:1.0:1651529344.467873:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+430:39029:x1731745946376960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.467878:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177384 count 1 00010000:00010000:1.0:1651529344.467882:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b4eadd7/0x3234de053c503f0 lrc: 3/0,1 mode: --/PW res: [0x2b4e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.467886:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fbf1beb5/0x3234de053c4cf00 lrc: 2/0,0 mode: PR/PR res: [0x2b4e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cede0 expref: 1636 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.467889:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.467890:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.467891:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b4eadd7/0x3234de053c503f0 lrc: 4/0,1 mode: --/PW res: [0x2b4e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.467897:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fbf1beb5/0x3234de053c4cf00 lrc: 3/0,0 mode: PR/PR res: [0x2b4e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cede0 expref: 1636 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.467902:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fbf1beb5/0x3234de053c4cf00 lrc: 4/0,0 mode: PR/PR res: [0x2b4e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cede0 expref: 1636 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.467906:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004534b316 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996966656:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.467916:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 0000000099c1da85 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.468316:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.468326:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.468326:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996966336:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.468331:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c503cd lrc: 3/0,1 mode: --/PW res: [0x2b4e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.468332:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.468339:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.468339:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396257344 00010000:00010000:0.0:1651529344.468353:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a6d30a2f/0x3234de053c4d1df lrc: 4/0,0 mode: PR/PR res: [0x2b4e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf947 expref: 1637 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.468360:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396257472 00010000:00010000:0.0:1651529344.468362:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d0ad467d/0x3234de053c4e462 lrc: 5/0,0 mode: PR/PR res: [0x2b4e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42a4 expref: 1638 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.468364:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.468367:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396257536 00000100:00100000:1.0:1651529344.468369:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.468369:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c4e859 lrc: 4/0,0 mode: PR/PR res: [0x2b4e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d523a expref: 1639 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.468373:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396257728 00000100:00100000:1.0:1651529344.468374:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.468374:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000062273051/0x3234de053c4e549 lrc: 5/0,0 mode: PR/PR res: [0x2b4e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d462b expref: 1640 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.468378:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396257920 00000100:00100000:1.0:1651529344.468379:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.468380:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000082ea9883/0x3234de053c4e167 lrc: 5/0,0 mode: PR/PR res: [0x2b4e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d369c expref: 1641 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.468385:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396257856 00000100:00100000:1.0:1651529344.468387:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009acffcb8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996966272:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.468387:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000d38ed81/0x3234de053c4e6fb lrc: 5/0,0 mode: PR/PR res: [0x2b4e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4cec expref: 1642 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.468391:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396257984 00010000:00010000:1.0:1651529344.468392:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007bbb621e/0x3234de053c503c6 lrc: 3/0,1 mode: --/PW res: [0x2b4e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468393:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c4c640 lrc: 5/0,0 mode: PR/PR res: [0x2b4e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb03 expref: 1643 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.468396:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396258048 00000100:00100000:1.0:1651529344.468398:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005fb0ec6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996966400:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.468398:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fbf1beb5/0x3234de053c4cf00 lrc: 5/0,0 mode: PR/PR res: [0x2b4e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cede0 expref: 1644 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.468401:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000013d9f24c/0x3234de053c503d4 lrc: 3/0,1 mode: --/PW res: [0x2b4e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.468405:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11711 00000100:00100000:1.0:1651529344.468407:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000066de8c9f pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996966592:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.468407:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1644:41278:x1731746396257344:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.468409:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005976006a/0x3234de053c503e9 lrc: 3/0,1 mode: --/PW res: [0x2b4e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468410:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.468411:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a6d30a2f/0x3234de053c4d1df lrc: 4/0,0 mode: PR/PR res: [0x2b4e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf947 expref: 1644 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.468415:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a6d30a2f/0x3234de053c4d1df lrc: 3/0,0 mode: PR/PR res: [0x2b4e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf947 expref: 1644 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.468417:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d28c414b pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996966528:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.468419:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000088155288/0x3234de053c503e2 lrc: 3/0,1 mode: --/PW res: [0x2b4e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468421:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6d30a2f/0x3234de053c4d1df lrc: 0/0,0 mode: --/PR res: [0x2b4e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf947 expref: 1644 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.468424:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.468425:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.468426:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11712 00010000:00010000:0.0:1651529344.468426:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c503bf lrc: 3/0,1 mode: PW/PW res: [0x2b4e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.468428:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1643:41278:x1731746396257472:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.468429:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c503bf lrc: 4/0,1 mode: PW/PW res: [0x2b4e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468431:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.468433:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d0ad467d/0x3234de053c4e462 lrc: 4/0,0 mode: PR/PR res: [0x2b4e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42a4 expref: 1643 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.468435:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.468436:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d0ad467d/0x3234de053c4e462 lrc: 3/0,0 mode: PR/PR res: [0x2b4e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42a4 expref: 1643 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.468442:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0ad467d/0x3234de053c4e462 lrc: 0/0,0 mode: --/PR res: [0x2b4e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42a4 expref: 1643 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.468449:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1643:41278:x1731746396257344:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 41us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.468452:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11711 00010000:00010000:1.0:1651529344.468453:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.468454:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.468454:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007bbb621e/0x3234de053c503c6 lrc: 3/0,1 mode: PW/PW res: [0x2b4e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.468457:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11713 00010000:00010000:1.0:1651529344.468458:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007bbb621e/0x3234de053c503c6 lrc: 4/0,1 mode: PW/PW res: [0x2b4e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.468458:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1641:41279:x1731746396257536:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.468461:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.468463:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c4e859 lrc: 4/0,0 mode: PR/PR res: [0x2b4e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d523a expref: 1641 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.468464:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.468467:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c4e859 lrc: 3/0,0 mode: PR/PR res: [0x2b4e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d523a expref: 1641 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.468471:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1641:41278:x1731746396257472:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 43us (145us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.468472:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c4e859 lrc: 0/0,0 mode: --/PR res: [0x2b4e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d523a expref: 1641 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.468474:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11712 00010000:00010000:0.0:1651529344.468475:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.468476:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.468476:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c503cd lrc: 3/0,1 mode: PW/PW res: [0x2b4e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468479:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c503cd lrc: 4/0,1 mode: PW/PW res: [0x2b4e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.468480:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11714 00000100:00100000:1.0:1651529344.468482:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c680c11 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1639:41278:x1731746396257728:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.468484:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.468485:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.468486:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000062273051/0x3234de053c4e549 lrc: 4/0,0 mode: PR/PR res: [0x2b4e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d462b expref: 1639 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.468490:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000062273051/0x3234de053c4e549 lrc: 3/0,0 mode: PR/PR res: [0x2b4e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d462b expref: 1639 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.468491:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1639:41279:x1731746396257536:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (158us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.468494:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062273051/0x3234de053c4e549 lrc: 0/0,0 mode: --/PR res: [0x2b4e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d462b expref: 1639 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.468494:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11713 00010000:00010000:1.0:1651529344.468498:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.468498:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11715 00010000:00010000:1.0:1651529344.468499:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.468499:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000013d9f24c/0x3234de053c503d4 lrc: 3/0,1 mode: PW/PW res: [0x2b4e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.468499:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1637:41279:x1731746396257920:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.468502:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013d9f24c/0x3234de053c503d4 lrc: 4/0,1 mode: PW/PW res: [0x2b4e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468502:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.468503:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000082ea9883/0x3234de053c4e167 lrc: 4/0,0 mode: PR/PR res: [0x2b4e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d369c expref: 1637 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.468507:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.468507:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000082ea9883/0x3234de053c4e167 lrc: 3/0,0 mode: PR/PR res: [0x2b4e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d369c expref: 1637 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.468511:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082ea9883/0x3234de053c4e167 lrc: 0/0,0 mode: --/PR res: [0x2b4e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d369c expref: 1637 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.468512:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c680c11 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1637:41278:x1731746396257728:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 30us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.468514:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11714 00010000:00010000:0.0:1651529344.468514:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.468515:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.468516:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000088155288/0x3234de053c503e2 lrc: 3/0,1 mode: PW/PW res: [0x2b4e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468519:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088155288/0x3234de053c503e2 lrc: 4/0,1 mode: PW/PW res: [0x2b4e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.468522:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11716 00000100:00100000:1.0:1651529344.468524:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1635:41279:x1731746396257856:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.468527:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.468532:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1635:41279:x1731746396257920:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 32us (168us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.468534:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.468534:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11715 00010000:00010000:1.0:1651529344.468535:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000d38ed81/0x3234de053c4e6fb lrc: 5/0,0 mode: PR/PR res: [0x2b4e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4cec expref: 1635 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.468539:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000d38ed81/0x3234de053c4e6fb lrc: 4/0,0 mode: PR/PR res: [0x2b4e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4cec expref: 1634 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.468539:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11717 00000100:00100000:0.0:1651529344.468540:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1634:41278:x1731746396257984:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.468543:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.468544:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.468544:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c4c640 lrc: 4/0,0 mode: PR/PR res: [0x2b4e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb03 expref: 1634 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.468545:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.468546:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c503db lrc: 3/0,1 mode: PW/PW res: [0x2b4e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468548:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c4c640 lrc: 3/0,0 mode: PR/PR res: [0x2b4e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb03 expref: 1634 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.468549:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c503db lrc: 4/0,1 mode: PW/PW res: [0x2b4e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468553:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.468553:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c4c640 lrc: 0/0,0 mode: --/PR res: [0x2b4e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb03 expref: 1634 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.468556:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.468557:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.468557:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005976006a/0x3234de053c503e9 lrc: 3/0,1 mode: PW/PW res: [0x2b4e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.468558:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1633:41279:x1731746396257856:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 33us (189us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.468560:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005976006a/0x3234de053c503e9 lrc: 4/0,1 mode: PW/PW res: [0x2b4e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.468561:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11716 00000100:00100000:1.0:1651529344.468566:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11718 00010000:00010000:0.0:1651529344.468568:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.468573:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1632:41278:x1731746396257984:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 32us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.468574:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1632:41278:x1731746396258048:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.468575:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11717 00010000:00010000:1.0:1651529344.468577:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.468578:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fbf1beb5/0x3234de053c4cf00 lrc: 5/0,0 mode: PR/PR res: [0x2b4e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cede0 expref: 1631 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.468582:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c503bf lrc: 3/0,1 mode: PW/PW res: [0x2b4e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468584:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fbf1beb5/0x3234de053c4cf00 lrc: 4/0,0 mode: PR/PR res: [0x2b4e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cede0 expref: 1631 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.468585:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c503bf lrc: 3/0,1 mode: PW/PW res: [0x2b4e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468588:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c503bf lrc: 3/0,1 mode: PW/PW res: [0x2b4e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468589:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.468590:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.468590:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006b4eadd7/0x3234de053c503f0 lrc: 3/0,1 mode: PW/PW res: [0x2b4e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468590:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c503bf lrc: 2/0,0 mode: PW/PW res: [0x2b4e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468593:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b4eadd7/0x3234de053c503f0 lrc: 4/0,1 mode: PW/PW res: [0x2b4e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468597:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.468602:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1631:41278:x1731746396258048:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 28us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.468605:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11718 00010000:00010000:1.0:1651529344.468611:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000013d9f24c/0x3234de053c503d4 lrc: 3/0,1 mode: PW/PW res: [0x2b4e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468614:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013d9f24c/0x3234de053c503d4 lrc: 3/0,1 mode: PW/PW res: [0x2b4e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468617:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013d9f24c/0x3234de053c503d4 lrc: 3/0,1 mode: PW/PW res: [0x2b4e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468620:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000013d9f24c/0x3234de053c503d4 lrc: 2/0,0 mode: PW/PW res: [0x2b4e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.468644:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+431:39030:x1731745946376512:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1204us (1282us total) trans 12885078984 rc 0/0 00000100:00100000:0.0:1651529344.468647:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210929 00010000:00010000:0.0:1651529344.468654:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c503bf lrc: 2/0,0 mode: PW/PW res: [0x2b4e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468657:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000364b2cdc already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.468658:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c503bf lrc: 2/0,0 mode: PW/PW res: [0x2b4e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468661:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c503bf lrc: 3/0,0 mode: PW/PW res: [0x2b4e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468666:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c503bf lrc: 1/0,0 mode: --/PW res: [0x2b4e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468669:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c503bf lrc: 0/0,0 mode: --/PW res: [0x2b4e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468673:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000013d9f24c/0x3234de053c503d4 lrc: 2/0,0 mode: PW/PW res: [0x2b4e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.468674:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+431:39029:x1731745946376704:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1160us (1274us total) trans 12885078985 rc 0/0 00010000:00010000:0.0:1651529344.468676:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000013d9f24c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.468676:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000013d9f24c/0x3234de053c503d4 lrc: 2/0,0 mode: PW/PW res: [0x2b4e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.468677:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210932 00010000:00010000:0.0:1651529344.468682:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000013d9f24c/0x3234de053c503d4 lrc: 3/0,0 mode: PW/PW res: [0x2b4e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468684:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005976006a/0x3234de053c503e9 lrc: 3/0,1 mode: PW/PW res: [0x2b4e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468685:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000013d9f24c/0x3234de053c503d4 lrc: 1/0,0 mode: --/PW res: [0x2b4e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468688:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005976006a/0x3234de053c503e9 lrc: 3/0,1 mode: PW/PW res: [0x2b4e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468688:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013d9f24c/0x3234de053c503d4 lrc: 0/0,0 mode: --/PW res: [0x2b4e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468691:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005976006a/0x3234de053c503e9 lrc: 3/0,1 mode: PW/PW res: [0x2b4e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468693:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005976006a/0x3234de053c503e9 lrc: 2/0,0 mode: PW/PW res: [0x2b4e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468693:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c503cd lrc: 3/0,1 mode: PW/PW res: [0x2b4e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468696:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c503cd lrc: 3/0,1 mode: PW/PW res: [0x2b4e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468699:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c503cd lrc: 3/0,1 mode: PW/PW res: [0x2b4e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468707:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c503cd lrc: 2/0,0 mode: PW/PW res: [0x2b4e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.468732:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+432:39029:x1731745946376896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 967us (1095us total) trans 12885078986 rc 0/0 00000100:00100000:1.0:1651529344.468746:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210935 00010000:00010000:1.0:1651529344.468753:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007bbb621e/0x3234de053c503c6 lrc: 3/0,1 mode: PW/PW res: [0x2b4e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.468756:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+431:39030:x1731745946376640:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1246us (1365us total) trans 12885078987 rc 0/0 00010000:00010000:1.0:1651529344.468757:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007bbb621e/0x3234de053c503c6 lrc: 3/0,1 mode: PW/PW res: [0x2b4e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.468759:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210931 00010000:00010000:1.0:1651529344.468760:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007bbb621e/0x3234de053c503c6 lrc: 3/0,1 mode: PW/PW res: [0x2b4e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468765:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007bbb621e/0x3234de053c503c6 lrc: 2/0,0 mode: PW/PW res: [0x2b4e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468766:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005976006a/0x3234de053c503e9 lrc: 2/0,0 mode: PW/PW res: [0x2b4e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468777:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005976006a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.468779:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005976006a/0x3234de053c503e9 lrc: 2/0,0 mode: PW/PW res: [0x2b4e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468782:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005976006a/0x3234de053c503e9 lrc: 3/0,0 mode: PW/PW res: [0x2b4e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468787:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005976006a/0x3234de053c503e9 lrc: 1/0,0 mode: --/PW res: [0x2b4e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468789:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005976006a/0x3234de053c503e9 lrc: 0/0,0 mode: --/PW res: [0x2b4e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468794:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c503cd lrc: 2/0,0 mode: PW/PW res: [0x2b4e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468796:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000011a71df9 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.468797:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c503cd lrc: 2/0,0 mode: PW/PW res: [0x2b4e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468800:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c503cd lrc: 3/0,0 mode: PW/PW res: [0x2b4e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468803:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c503cd lrc: 1/0,0 mode: --/PW res: [0x2b4e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.468804:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a13808c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+431:39030:x1731745946376576:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1350us (1425us total) trans 12885078988 rc 0/0 00010000:00010000:0.0:1651529344.468805:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c503cd lrc: 0/0,0 mode: --/PW res: [0x2b4e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.468807:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210930 00010000:00010000:0.0:1651529344.468809:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007bbb621e/0x3234de053c503c6 lrc: 2/0,0 mode: PW/PW res: [0x2b4e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468812:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007bbb621e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.468813:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007bbb621e/0x3234de053c503c6 lrc: 2/0,0 mode: PW/PW res: [0x2b4e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468814:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000088155288/0x3234de053c503e2 lrc: 3/0,1 mode: PW/PW res: [0x2b4e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468815:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007bbb621e/0x3234de053c503c6 lrc: 3/0,0 mode: PW/PW res: [0x2b4e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468817:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088155288/0x3234de053c503e2 lrc: 3/0,1 mode: PW/PW res: [0x2b4e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468818:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007bbb621e/0x3234de053c503c6 lrc: 1/0,0 mode: --/PW res: [0x2b4e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468820:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088155288/0x3234de053c503e2 lrc: 3/0,1 mode: PW/PW res: [0x2b4e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468821:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007bbb621e/0x3234de053c503c6 lrc: 0/0,0 mode: --/PW res: [0x2b4e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468823:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088155288/0x3234de053c503e2 lrc: 2/0,0 mode: PW/PW res: [0x2b4e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468837:0:156655:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d38ed81/0x3234de053c4e6fb lrc: 0/0,0 mode: --/PR res: [0x2b4e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4cec expref: 1630 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.468841:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996966464:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.468844:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c503db lrc: 3/0,1 mode: PW/PW res: [0x2b4e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468847:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c503db lrc: 3/0,1 mode: PW/PW res: [0x2b4e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468852:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c503db lrc: 3/0,1 mode: PW/PW res: [0x2b4e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468855:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c503db lrc: 3/0,1 mode: PW/PW res: [0x2b4e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.468858:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+431:39030:x1731745946376832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1154us (1228us total) trans 12885078989 rc 0/0 00010000:00010000:0.0:1651529344.468858:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c503db lrc: 2/0,0 mode: PW/PW res: [0x2b4e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.468861:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210934 00010000:00010000:1.0:1651529344.468872:0:80280:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fbf1beb5/0x3234de053c4cf00 lrc: 0/0,0 mode: --/PR res: [0x2b4e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cede0 expref: 1629 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.468876:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004534b316 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996966656:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.468881:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006b4eadd7/0x3234de053c503f0 lrc: 3/0,1 mode: PW/PW res: [0x2b4e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468884:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006b4eadd7/0x3234de053c503f0 lrc: 3/0,1 mode: PW/PW res: [0x2b4e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468887:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b4eadd7/0x3234de053c503f0 lrc: 3/0,1 mode: PW/PW res: [0x2b4e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468890:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b4eadd7/0x3234de053c503f0 lrc: 3/0,1 mode: PW/PW res: [0x2b4e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.468893:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b4eadd7/0x3234de053c503f0 lrc: 2/0,0 mode: PW/PW res: [0x2b4e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.468894:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+431:39029:x1731745946376768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1195us (1277us total) trans 12885078990 rc 0/0 00000100:00100000:0.0:1651529344.468897:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210933 00010000:00010000:0.0:1651529344.468911:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088155288/0x3234de053c503e2 lrc: 2/0,0 mode: PW/PW res: [0x2b4e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468915:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088155288 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.468916:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088155288/0x3234de053c503e2 lrc: 2/0,0 mode: PW/PW res: [0x2b4e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468918:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088155288/0x3234de053c503e2 lrc: 3/0,0 mode: PW/PW res: [0x2b4e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468923:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088155288/0x3234de053c503e2 lrc: 1/0,0 mode: --/PW res: [0x2b4e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468925:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088155288/0x3234de053c503e2 lrc: 0/0,0 mode: --/PW res: [0x2b4e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468930:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c503db lrc: 2/0,0 mode: PW/PW res: [0x2b4e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.468932:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+431:39029:x1731745946376960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1058us (1099us total) trans 12885078991 rc 0/0 00010000:00010000:0.0:1651529344.468933:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008531b741 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.468933:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c503db lrc: 2/0,0 mode: PW/PW res: [0x2b4e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.468935:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210936 00010000:00010000:0.0:1651529344.468936:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c503db lrc: 3/0,0 mode: PW/PW res: [0x2b4e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468939:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c503db lrc: 1/0,0 mode: --/PW res: [0x2b4e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468942:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c503db lrc: 0/0,0 mode: --/PW res: [0x2b4e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468945:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b4eadd7/0x3234de053c503f0 lrc: 2/0,0 mode: PW/PW res: [0x2b4e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468948:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006b4eadd7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.468948:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b4eadd7/0x3234de053c503f0 lrc: 2/0,0 mode: PW/PW res: [0x2b4e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468951:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b4eadd7/0x3234de053c503f0 lrc: 3/0,0 mode: PW/PW res: [0x2b4e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468954:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b4eadd7/0x3234de053c503f0 lrc: 1/0,0 mode: --/PW res: [0x2b4e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.468957:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b4eadd7/0x3234de053c503f0 lrc: 0/0,0 mode: --/PW res: [0x2b4e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.469272:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.469280:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.469290:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.469290:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946377600 00000100:00100000:1.0:1651529344.469296:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.469312:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.469319:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946377536 00000100:00100000:0.0:1651529344.469326:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946377664 00000100:00100000:0.0:1651529344.469331:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946377728 00000100:00100000:0.0:1651529344.469336:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946377856 00000100:00100000:0.0:1651529344.469342:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210937 00000100:00100000:0.0:1651529344.469344:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+435:39030:x1731745946377600:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.469348:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.469349:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177386 count 1 00000100:00100000:1.0:1651529344.469358:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.469359:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c503f7 lrc: 3/0,1 mode: --/PW res: [0x2b4ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.469366:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.469369:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ecc380d3/0x3234de053c4c926 lrc: 2/0,0 mode: PR/PR res: [0x2b4ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd5e5 expref: 1628 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.469372:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.469373:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946377984 00010000:00010000:0.0:1651529344.469373:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.469374:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c503f7 lrc: 4/0,1 mode: --/PW res: [0x2b4ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.469378:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946377792 00000100:00100000:1.0:1651529344.469381:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946377920 00010000:00010000:0.0:1651529344.469381:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ecc380d3/0x3234de053c4c926 lrc: 3/0,0 mode: PR/PR res: [0x2b4ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd5e5 expref: 1628 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.469384:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210938 00010000:00010000:0.0:1651529344.469384:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ecc380d3/0x3234de053c4c926 lrc: 4/0,0 mode: PR/PR res: [0x2b4ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd5e5 expref: 1628 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.469386:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+438:39029:x1731745946377536:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.469391:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177385 count 1 00000100:00100000:0.0:1651529344.469391:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996966720:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.469396:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e801c8a/0x3234de053c503fe lrc: 3/0,1 mode: --/PW res: [0x2b4e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.469400:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002bb34145/0x3234de053c4c686 lrc: 2/0,0 mode: PR/PR res: [0x2b4e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccbff expref: 1628 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.469403:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.469404:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.469407:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 000000003c8b0daf going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.469412:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e801c8a/0x3234de053c503fe lrc: 4/0,1 mode: --/PW res: [0x2b4e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.469414:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210939 00000100:00100000:0.0:1651529344.469416:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+438:39029:x1731745946377664:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.469419:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002bb34145/0x3234de053c4c686 lrc: 3/0,0 mode: PR/PR res: [0x2b4e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccbff expref: 1628 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.469420:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177387 count 1 00010000:00010000:1.0:1651529344.469423:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002bb34145/0x3234de053c4c686 lrc: 4/0,0 mode: PR/PR res: [0x2b4e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccbff expref: 1628 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.469424:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edd2ccd0/0x3234de053c50405 lrc: 3/0,1 mode: --/PW res: [0x2b4eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.469428:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004534b316 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996966784:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.469428:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000061f4e9a0/0x3234de053c4e676 lrc: 2/0,0 mode: PR/PR res: [0x2b4eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a8b expref: 1628 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.469431:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.469432:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.469433:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edd2ccd0/0x3234de053c50405 lrc: 4/0,1 mode: --/PW res: [0x2b4eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.469436:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cfa1ca05 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.469439:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000061f4e9a0/0x3234de053c4e676 lrc: 3/0,0 mode: PR/PR res: [0x2b4eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a8b expref: 1628 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.469442:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000061f4e9a0/0x3234de053c4e676 lrc: 4/0,0 mode: PR/PR res: [0x2b4eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a8b expref: 1628 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.469443:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210940 00000100:00100000:1.0:1651529344.469445:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+438:39030:x1731745946377728:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.469446:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996966848:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.469449:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177388 count 1 00010000:00010000:1.0:1651529344.469452:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021e675a0/0x3234de053c5040c lrc: 3/0,1 mode: --/PW res: [0x2b4ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.469453:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 000000000a4def41 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.469457:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c4e0c6 lrc: 2/0,0 mode: PR/PR res: [0x2b4ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3385 expref: 1628 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.469459:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210941 00010000:00010000:1.0:1651529344.469460:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.469461:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.469461:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021e675a0/0x3234de053c5040c lrc: 4/0,1 mode: --/PW res: [0x2b4ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.469461:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+438:39030:x1731745946377856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.469465:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177390 count 1 00010000:00010000:1.0:1651529344.469467:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c4e0c6 lrc: 3/0,0 mode: PR/PR res: [0x2b4ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3385 expref: 1628 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.469468:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047d5dd29/0x3234de053c50413 lrc: 3/0,1 mode: --/PW res: [0x2b4ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.469470:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c4e0c6 lrc: 4/0,0 mode: PR/PR res: [0x2b4ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3385 expref: 1628 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.469472:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c4e072 lrc: 2/0,0 mode: PR/PR res: [0x2b4ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3289 expref: 1628 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.469474:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000be0ace91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996966912:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.469475:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.469476:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.469476:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047d5dd29/0x3234de053c50413 lrc: 4/0,1 mode: --/PW res: [0x2b4ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.469480:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 0000000057299e7f going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.469482:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c4e072 lrc: 3/0,0 mode: PR/PR res: [0x2b4ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3289 expref: 1628 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.469485:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c4e072 lrc: 4/0,0 mode: PR/PR res: [0x2b4ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3289 expref: 1628 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.469486:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210942 00000100:00100000:1.0:1651529344.469488:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+438:39030:x1731745946377984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.469489:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996966976:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.469492:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177392 count 1 00010000:00010000:1.0:1651529344.469495:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc659cdc/0x3234de053c5041a lrc: 3/0,1 mode: --/PW res: [0x2b4f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.469495:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c0dff858 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.469499:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d05ad66e/0x3234de053c4ca61 lrc: 2/0,0 mode: PR/PR res: [0x2b4f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb3a expref: 1628 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.469501:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210943 00010000:00010000:1.0:1651529344.469502:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.469502:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.469503:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc659cdc/0x3234de053c5041a lrc: 4/0,1 mode: --/PW res: [0x2b4f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.469503:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+438:39030:x1731745946377792:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.469506:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177389 count 1 00010000:00010000:1.0:1651529344.469509:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d05ad66e/0x3234de053c4ca61 lrc: 3/0,0 mode: PR/PR res: [0x2b4f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb3a expref: 1628 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.469509:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c50421 lrc: 3/0,1 mode: --/PW res: [0x2b4ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.469512:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d05ad66e/0x3234de053c4ca61 lrc: 4/0,0 mode: PR/PR res: [0x2b4f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb3a expref: 1628 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.469516:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d28c414b pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996967040:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.469516:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0efadcd/0x3234de053c4e11a lrc: 2/0,0 mode: PR/PR res: [0x2b4ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d34ea expref: 1628 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.469519:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.469519:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.469520:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c50421 lrc: 4/0,1 mode: --/PW res: [0x2b4ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.469522:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b52d0f36 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.469526:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a0efadcd/0x3234de053c4e11a lrc: 3/0,0 mode: PR/PR res: [0x2b4ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d34ea expref: 1628 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.469528:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210944 00000100:00100000:1.0:1651529344.469529:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+438:39030:x1731745946377920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.469529:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a0efadcd/0x3234de053c4e11a lrc: 4/0,0 mode: PR/PR res: [0x2b4ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d34ea expref: 1628 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:1.0:1651529344.469533:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177391 count 1 00000100:00100000:0.0:1651529344.469533:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996967104:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.469536:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c50428 lrc: 3/0,1 mode: --/PW res: [0x2b4ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.469539:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 0000000076b354b3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.469540:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002e7d8fec/0x3234de053c4d003 lrc: 2/0,0 mode: PR/PR res: [0x2b4ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf16e expref: 1628 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.469543:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.469543:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.469544:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c50428 lrc: 4/0,1 mode: --/PW res: [0x2b4ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.469549:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002e7d8fec/0x3234de053c4d003 lrc: 3/0,0 mode: PR/PR res: [0x2b4ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf16e expref: 1628 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.469555:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002e7d8fec/0x3234de053c4d003 lrc: 4/0,0 mode: PR/PR res: [0x2b4ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf16e expref: 1628 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.469559:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000066de8c9f pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996967168:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.469565:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f79d8146 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.469913:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996966720:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.469915:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.469922:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.469933:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004534b316 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996966784:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.469937:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c503f7 lrc: 3/0,1 mode: --/PW res: [0x2b4ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.469943:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001e801c8a/0x3234de053c503fe lrc: 3/0,1 mode: --/PW res: [0x2b4e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.469946:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396258624 00000100:00100000:1.0:1651529344.469950:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396258688 00010000:00010000:0.0:1651529344.469952:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ecc380d3/0x3234de053c4c926 lrc: 4/0,0 mode: PR/PR res: [0x2b4ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd5e5 expref: 1630 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.469955:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002bb34145/0x3234de053c4c686 lrc: 4/0,0 mode: PR/PR res: [0x2b4e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccbff expref: 1630 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.469961:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11719 00000100:00100000:0.0:1651529344.469963:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1630:41279:x1731746396258624:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.469966:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.469971:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11720 00000100:00100000:1.0:1651529344.469973:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1630:41279:x1731746396258688:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.469973:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ecc380d3/0x3234de053c4c926 lrc: 4/0,0 mode: PR/PR res: [0x2b4ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd5e5 expref: 1630 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.469976:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.469977:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002bb34145/0x3234de053c4c686 lrc: 4/0,0 mode: PR/PR res: [0x2b4e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccbff expref: 1630 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.469977:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ecc380d3/0x3234de053c4c926 lrc: 3/0,0 mode: PR/PR res: [0x2b4ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd5e5 expref: 1630 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.469981:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002bb34145/0x3234de053c4c686 lrc: 3/0,0 mode: PR/PR res: [0x2b4e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccbff expref: 1630 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.469989:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002bb34145/0x3234de053c4c686 lrc: 0/0,0 mode: --/PR res: [0x2b4e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccbff expref: 1630 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.469993:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.469993:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ecc380d3/0x3234de053c4c926 lrc: 0/0,0 mode: --/PR res: [0x2b4ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd5e5 expref: 1629 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.469994:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.469995:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001e801c8a/0x3234de053c503fe lrc: 3/0,1 mode: PW/PW res: [0x2b4e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.469997:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.469998:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e801c8a/0x3234de053c503fe lrc: 4/0,1 mode: PW/PW res: [0x2b4e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.469998:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.469999:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c503f7 lrc: 3/0,1 mode: PW/PW res: [0x2b4ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470002:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c503f7 lrc: 4/0,1 mode: PW/PW res: [0x2b4ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.470004:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.470008:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.470012:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1628:41279:x1731746396258688:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 38us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.470014:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11720 00000100:00100000:0.0:1651529344.470016:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1628:41279:x1731746396258624:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 52us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.470019:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11719 00010000:00010000:1.0:1651529344.470020:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001e801c8a/0x3234de053c503fe lrc: 3/0,1 mode: PW/PW res: [0x2b4e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.470023:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e801c8a/0x3234de053c503fe lrc: 3/0,1 mode: PW/PW res: [0x2b4e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.470026:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e801c8a/0x3234de053c503fe lrc: 3/0,1 mode: PW/PW res: [0x2b4e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470026:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c503f7 lrc: 3/0,1 mode: PW/PW res: [0x2b4ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.470029:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e801c8a/0x3234de053c503fe lrc: 2/0,0 mode: PW/PW res: [0x2b4e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470030:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c503f7 lrc: 3/0,1 mode: PW/PW res: [0x2b4ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470035:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c503f7 lrc: 3/0,1 mode: PW/PW res: [0x2b4ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470045:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c503f7 lrc: 2/0,0 mode: PW/PW res: [0x2b4ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.470073:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+439:39029:x1731745946377536:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 687us (792us total) trans 12885078992 rc 0/0 00000100:00100000:1.0:1651529344.470076:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210938 00000100:00100000:0.0:1651529344.470101:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+439:39030:x1731745946377600:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 755us (829us total) trans 12885078993 rc 0/0 00000100:00100000:0.0:1651529344.470104:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210937 00010000:00010000:0.0:1651529344.470112:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e801c8a/0x3234de053c503fe lrc: 2/0,0 mode: PW/PW res: [0x2b4e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470122:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e801c8a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.470123:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e801c8a/0x3234de053c503fe lrc: 2/0,0 mode: PW/PW res: [0x2b4e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470126:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e801c8a/0x3234de053c503fe lrc: 3/0,0 mode: PW/PW res: [0x2b4e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470131:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e801c8a/0x3234de053c503fe lrc: 1/0,0 mode: --/PW res: [0x2b4e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.470134:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.470134:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e801c8a/0x3234de053c503fe lrc: 0/0,0 mode: --/PW res: [0x2b4e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470138:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c503f7 lrc: 2/0,0 mode: PW/PW res: [0x2b4ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470141:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000cfc1a54 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.470142:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c503f7 lrc: 2/0,0 mode: PW/PW res: [0x2b4ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470145:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c503f7 lrc: 3/0,0 mode: PW/PW res: [0x2b4ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470148:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c503f7 lrc: 1/0,0 mode: --/PW res: [0x2b4ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470150:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c503f7 lrc: 0/0,0 mode: --/PW res: [0x2b4ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.470160:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996966848:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.470161:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.470164:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000edd2ccd0/0x3234de053c50405 lrc: 3/0,1 mode: --/PW res: [0x2b4eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.470176:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396258752 00010000:00010000:0.0:1651529344.470180:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000061f4e9a0/0x3234de053c4e676 lrc: 4/0,0 mode: PR/PR res: [0x2b4eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a8b expref: 1627 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.470186:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396258816 00010000:00010000:0.0:1651529344.470188:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c4e0c6 lrc: 5/0,0 mode: PR/PR res: [0x2b4ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3385 expref: 1628 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.470199:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000be0ace91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996966912:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.470203:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11721 00000100:00100000:0.0:1651529344.470205:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009f0728c5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1628:41279:x1731746396258752:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.470208:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000021e675a0/0x3234de053c5040c lrc: 3/0,1 mode: --/PW res: [0x2b4ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470208:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.470209:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000061f4e9a0/0x3234de053c4e676 lrc: 4/0,0 mode: PR/PR res: [0x2b4eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a8b expref: 1628 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.470213:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000061f4e9a0/0x3234de053c4e676 lrc: 3/0,0 mode: PR/PR res: [0x2b4eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a8b expref: 1628 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.470216:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11722 00000100:00100000:1.0:1651529344.470218:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1628:41279:x1731746396258816:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.470218:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061f4e9a0/0x3234de053c4e676 lrc: 0/0,0 mode: --/PR res: [0x2b4eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a8b expref: 1628 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.470221:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.470238:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c4e0c6 lrc: 4/0,0 mode: PR/PR res: [0x2b4ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3385 expref: 1627 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.470242:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c4e0c6 lrc: 3/0,0 mode: PR/PR res: [0x2b4ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3385 expref: 1627 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.470248:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c4e0c6 lrc: 0/0,0 mode: --/PR res: [0x2b4ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3385 expref: 1627 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.470258:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.470259:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.470259:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000021e675a0/0x3234de053c5040c lrc: 3/0,1 mode: PW/PW res: [0x2b4ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.470265:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021e675a0/0x3234de053c5040c lrc: 4/0,1 mode: PW/PW res: [0x2b4ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.470271:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.470277:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.470278:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.470279:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000edd2ccd0/0x3234de053c50405 lrc: 3/0,1 mode: PW/PW res: [0x2b4eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470282:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edd2ccd0/0x3234de053c50405 lrc: 4/0,1 mode: PW/PW res: [0x2b4eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.470286:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1626:41279:x1731746396258816:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 60us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.470289:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11722 00010000:00010000:0.0:1651529344.470290:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.470296:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000021e675a0/0x3234de053c5040c lrc: 3/0,1 mode: PW/PW res: [0x2b4ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.470298:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009f0728c5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1625:41279:x1731746396258752:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 92us (164us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.470299:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021e675a0/0x3234de053c5040c lrc: 3/0,1 mode: PW/PW res: [0x2b4ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.470301:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11721 00010000:00010000:1.0:1651529344.470302:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021e675a0/0x3234de053c5040c lrc: 3/0,1 mode: PW/PW res: [0x2b4ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.470305:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021e675a0/0x3234de053c5040c lrc: 2/0,0 mode: PW/PW res: [0x2b4ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470336:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000edd2ccd0/0x3234de053c50405 lrc: 3/0,1 mode: PW/PW res: [0x2b4eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470340:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000edd2ccd0/0x3234de053c50405 lrc: 3/0,1 mode: PW/PW res: [0x2b4eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470345:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edd2ccd0/0x3234de053c50405 lrc: 3/0,1 mode: PW/PW res: [0x2b4eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.470348:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+439:39030:x1731745946377728:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 902us (1051us total) trans 12885078994 rc 0/0 00010000:00010000:0.0:1651529344.470348:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000edd2ccd0/0x3234de053c50405 lrc: 2/0,0 mode: PW/PW res: [0x2b4eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.470351:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210940 00000100:00100000:1.0:1651529344.470377:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.470389:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+439:39029:x1731745946377664:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 972us (1099us total) trans 12885078995 rc 0/0 00000100:00100000:0.0:1651529344.470392:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210939 00000100:00100000:0.0:1651529344.470397:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946378560 00000100:00100000:0.0:1651529344.470403:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210945 00000100:00100000:0.0:1651529344.470405:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+439:39029:x1731745946378560:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.470410:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177393 count 1 00010000:00010000:0.0:1651529344.470421:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ce5f676/0x3234de053c5042f lrc: 3/0,1 mode: --/PW res: [0x2b4f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470426:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d840b819/0x3234de053c4cdef lrc: 2/0,0 mode: PR/PR res: [0x2b4f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce92c expref: 1624 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.470429:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.470430:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.470430:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ce5f676/0x3234de053c5042f lrc: 4/0,1 mode: --/PW res: [0x2b4f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.470436:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.470437:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d840b819/0x3234de053c4cdef lrc: 3/0,0 mode: PR/PR res: [0x2b4f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce92c expref: 1624 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.470443:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d840b819/0x3234de053c4cdef lrc: 4/0,0 mode: PR/PR res: [0x2b4f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce92c expref: 1624 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.470447:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996967232:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.470456:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 000000000a4def41 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.470461:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021e675a0/0x3234de053c5040c lrc: 2/0,0 mode: PW/PW res: [0x2b4ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470464:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000021e675a0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.470465:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021e675a0/0x3234de053c5040c lrc: 2/0,0 mode: PW/PW res: [0x2b4ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470468:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021e675a0/0x3234de053c5040c lrc: 3/0,0 mode: PW/PW res: [0x2b4ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470473:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021e675a0/0x3234de053c5040c lrc: 1/0,0 mode: --/PW res: [0x2b4ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470475:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021e675a0/0x3234de053c5040c lrc: 0/0,0 mode: --/PW res: [0x2b4ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470479:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000edd2ccd0/0x3234de053c50405 lrc: 2/0,0 mode: PW/PW res: [0x2b4eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.470491:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.470498:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.470498:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000edd2ccd0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.470499:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000edd2ccd0/0x3234de053c50405 lrc: 2/0,0 mode: PW/PW res: [0x2b4eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.470508:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.470508:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000edd2ccd0/0x3234de053c50405 lrc: 3/0,0 mode: PW/PW res: [0x2b4eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.470515:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.470521:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000edd2ccd0/0x3234de053c50405 lrc: 1/0,0 mode: --/PW res: [0x2b4eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.470523:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d28c414b pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996967040:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.470524:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000edd2ccd0/0x3234de053c50405 lrc: 0/0,0 mode: --/PW res: [0x2b4eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.470527:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bc659cdc/0x3234de053c5041a lrc: 3/0,1 mode: --/PW res: [0x2b4f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.470534:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000066de8c9f pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996967168:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.470536:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996966976:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.470537:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c50428 lrc: 3/0,1 mode: --/PW res: [0x2b4ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470539:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000047d5dd29/0x3234de053c50413 lrc: 3/0,1 mode: --/PW res: [0x2b4ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.470543:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946378624 00000100:00100000:0.0:1651529344.470546:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996967104:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.470550:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210946 00000100:00100000:1.0:1651529344.470551:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+440:39030:x1731745946378624:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.470556:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177394 count 1 00010000:00010000:0.0:1651529344.470565:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c50421 lrc: 3/0,1 mode: --/PW res: [0x2b4ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.470567:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080a87994/0x3234de053c50436 lrc: 3/0,1 mode: --/PW res: [0x2b4f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.470572:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002fe25cb3/0x3234de053c4dcb3 lrc: 2/0,0 mode: PR/PR res: [0x2b4f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2324 expref: 1624 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.470575:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.470576:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.470577:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080a87994/0x3234de053c50436 lrc: 4/0,1 mode: --/PW res: [0x2b4f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.470583:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002fe25cb3/0x3234de053c4dcb3 lrc: 3/0,0 mode: PR/PR res: [0x2b4f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2324 expref: 1624 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.470584:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396258880 00010000:00010000:1.0:1651529344.470589:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002fe25cb3/0x3234de053c4dcb3 lrc: 4/0,0 mode: PR/PR res: [0x2b4f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2324 expref: 1625 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.470589:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c4e072 lrc: 4/0,0 mode: PR/PR res: [0x2b4ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3289 expref: 1625 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.470594:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000999005e pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996967296:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.470594:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396259008 00010000:00010000:0.0:1651529344.470596:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a0efadcd/0x3234de053c4e11a lrc: 4/0,0 mode: PR/PR res: [0x2b4ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d34ea expref: 1626 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.470600:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396258944 00000100:00100000:1.0:1651529344.470602:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b52d0f36 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.470602:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d05ad66e/0x3234de053c4ca61 lrc: 4/0,0 mode: PR/PR res: [0x2b4f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb3a expref: 1627 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.470607:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396259072 00000100:00100000:1.0:1651529344.470609:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11723 00010000:00010000:0.0:1651529344.470609:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002e7d8fec/0x3234de053c4d003 lrc: 4/0,0 mode: PR/PR res: [0x2b4ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf16e expref: 1628 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.470611:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1628:41278:x1731746396258880:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.470614:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.470614:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11724 00010000:00010000:1.0:1651529344.470615:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c4e072 lrc: 4/0,0 mode: PR/PR res: [0x2b4ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3289 expref: 1628 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.470616:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1628:41278:x1731746396259008:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.470618:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.470619:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c4e072 lrc: 3/0,0 mode: PR/PR res: [0x2b4ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3289 expref: 1628 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.470620:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a0efadcd/0x3234de053c4e11a lrc: 4/0,0 mode: PR/PR res: [0x2b4ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d34ea expref: 1628 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.470623:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a0efadcd/0x3234de053c4e11a lrc: 3/0,0 mode: PR/PR res: [0x2b4ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d34ea expref: 1628 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.470625:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c4e072 lrc: 0/0,0 mode: --/PR res: [0x2b4ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3289 expref: 1628 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.470628:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.470629:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.470629:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0efadcd/0x3234de053c4e11a lrc: 0/0,0 mode: --/PR res: [0x2b4ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d34ea expref: 1627 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.470630:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000047d5dd29/0x3234de053c50413 lrc: 3/0,1 mode: PW/PW res: [0x2b4ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470632:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.470633:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047d5dd29/0x3234de053c50413 lrc: 4/0,1 mode: PW/PW res: [0x2b4ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470633:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.470634:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c50421 lrc: 3/0,1 mode: PW/PW res: [0x2b4ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470637:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c50421 lrc: 4/0,1 mode: PW/PW res: [0x2b4ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.470646:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.470651:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1626:41278:x1731746396258880:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (161us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.470651:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.470654:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11723 00000100:00100000:1.0:1651529344.470659:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11725 00000100:00100000:0.0:1651529344.470659:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1625:41278:x1731746396259008:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 43us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.470661:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1625:41279:x1731746396258944:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.470662:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11724 00010000:00010000:1.0:1651529344.470664:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.470665:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d05ad66e/0x3234de053c4ca61 lrc: 4/0,0 mode: PR/PR res: [0x2b4f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb3a expref: 1624 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.470667:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11726 00010000:00010000:1.0:1651529344.470669:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d05ad66e/0x3234de053c4ca61 lrc: 3/0,0 mode: PR/PR res: [0x2b4f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb3a expref: 1624 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.470669:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1624:41279:x1731746396259072:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.470671:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.470673:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002e7d8fec/0x3234de053c4d003 lrc: 4/0,0 mode: PR/PR res: [0x2b4ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf16e expref: 1624 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.470674:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d05ad66e/0x3234de053c4ca61 lrc: 0/0,0 mode: --/PR res: [0x2b4f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb3a expref: 1624 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.470676:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002e7d8fec/0x3234de053c4d003 lrc: 3/0,0 mode: PR/PR res: [0x2b4ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf16e expref: 1624 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.470677:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.470678:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.470678:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bc659cdc/0x3234de053c5041a lrc: 3/0,1 mode: PW/PW res: [0x2b4f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.470681:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc659cdc/0x3234de053c5041a lrc: 4/0,1 mode: PW/PW res: [0x2b4f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470682:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e7d8fec/0x3234de053c4d003 lrc: 0/0,0 mode: --/PR res: [0x2b4ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf16e expref: 1623 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.470685:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.470686:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.470686:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c50428 lrc: 3/0,1 mode: PW/PW res: [0x2b4ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.470687:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.470689:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c50428 lrc: 4/0,1 mode: PW/PW res: [0x2b4ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.470692:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1622:41279:x1731746396258944:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 30us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.470695:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11725 00010000:00010000:1.0:1651529344.470706:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c50428 lrc: 4/0,1 mode: PW/PW res: [0x2b4ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470708:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.470710:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c50428 lrc: 3/0,1 mode: PW/PW res: [0x2b4ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.470713:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c50428 lrc: 3/0,1 mode: PW/PW res: [0x2b4ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.470715:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c50428 lrc: 2/0,0 mode: PW/PW res: [0x2b4ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.470715:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1621:41279:x1731746396259072:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 45us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.470717:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11726 00010000:00010000:0.0:1651529344.470732:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c50428 lrc: 2/0,0 mode: PW/PW res: [0x2b4ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470744:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ce532454 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.470745:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c50428 lrc: 2/0,0 mode: PW/PW res: [0x2b4ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470748:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c50428 lrc: 3/0,0 mode: PW/PW res: [0x2b4ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470752:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c50428 lrc: 1/0,0 mode: --/PW res: [0x2b4ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470755:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c50428 lrc: 0/0,0 mode: --/PW res: [0x2b4ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470761:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000047d5dd29/0x3234de053c50413 lrc: 3/0,1 mode: PW/PW res: [0x2b4ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470764:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047d5dd29/0x3234de053c50413 lrc: 3/0,1 mode: PW/PW res: [0x2b4ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.470767:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+441:39030:x1731745946377920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1237us (1400us total) trans 12885078996 rc 0/0 00010000:00010000:0.0:1651529344.470767:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047d5dd29/0x3234de053c50413 lrc: 3/0,1 mode: PW/PW res: [0x2b4ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.470770:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210944 00010000:00010000:0.0:1651529344.470770:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000047d5dd29/0x3234de053c50413 lrc: 2/0,0 mode: PW/PW res: [0x2b4ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.470777:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bc659cdc/0x3234de053c5041a lrc: 3/0,1 mode: PW/PW res: [0x2b4f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.470780:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc659cdc/0x3234de053c5041a lrc: 3/0,1 mode: PW/PW res: [0x2b4f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.470783:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc659cdc/0x3234de053c5041a lrc: 3/0,1 mode: PW/PW res: [0x2b4f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.470786:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc659cdc/0x3234de053c5041a lrc: 2/0,0 mode: PW/PW res: [0x2b4f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.470816:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+442:39030:x1731745946377856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1353us (1503us total) trans 12885078997 rc 0/0 00000100:00100000:0.0:1651529344.470819:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210941 00010000:00010000:0.0:1651529344.470826:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000047d5dd29/0x3234de053c50413 lrc: 2/0,0 mode: PW/PW res: [0x2b4ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.470827:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+441:39030:x1731745946377984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1338us (1479us total) trans 12885078998 rc 0/0 00010000:00010000:0.0:1651529344.470829:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000047d5dd29 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.470830:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210942 00010000:00010000:0.0:1651529344.470830:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000047d5dd29/0x3234de053c50413 lrc: 2/0,0 mode: PW/PW res: [0x2b4ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470833:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000047d5dd29/0x3234de053c50413 lrc: 3/0,0 mode: PW/PW res: [0x2b4ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470837:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000047d5dd29/0x3234de053c50413 lrc: 1/0,0 mode: --/PW res: [0x2b4ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470840:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047d5dd29/0x3234de053c50413 lrc: 0/0,0 mode: --/PW res: [0x2b4ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470845:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc659cdc/0x3234de053c5041a lrc: 2/0,0 mode: PW/PW res: [0x2b4f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470847:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bc659cdc already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.470848:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc659cdc/0x3234de053c5041a lrc: 2/0,0 mode: PW/PW res: [0x2b4f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470851:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc659cdc/0x3234de053c5041a lrc: 3/0,0 mode: PW/PW res: [0x2b4f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470856:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc659cdc/0x3234de053c5041a lrc: 1/0,0 mode: --/PW res: [0x2b4f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470859:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc659cdc/0x3234de053c5041a lrc: 0/0,0 mode: --/PW res: [0x2b4f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470864:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c50421 lrc: 3/0,1 mode: PW/PW res: [0x2b4ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.470866:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.470867:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c50421 lrc: 3/0,1 mode: PW/PW res: [0x2b4ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470870:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c50421 lrc: 3/0,1 mode: PW/PW res: [0x2b4ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470873:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c50421 lrc: 2/0,0 mode: PW/PW res: [0x2b4ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.470894:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.470904:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.470916:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+441:39030:x1731745946377792:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1413us (1558us total) trans 12885078999 rc 0/0 00000100:00100000:0.0:1651529344.470919:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210943 00000100:00100000:0.0:1651529344.470924:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946378688 00000100:00100000:0.0:1651529344.470930:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946378752 00000100:00100000:0.0:1651529344.470939:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210947 00000100:00100000:0.0:1651529344.470941:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+442:39030:x1731745946378688:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.470946:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177395 count 1 00010000:00010000:0.0:1651529344.470950:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000315faada/0x3234de053c5043d lrc: 3/0,1 mode: --/PW res: [0x2b4f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470955:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000019aa9ad0/0x3234de053c4da83 lrc: 2/0,0 mode: PR/PR res: [0x2b4f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a8e expref: 1620 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.470958:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.470959:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.470960:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000315faada/0x3234de053c5043d lrc: 4/0,1 mode: --/PW res: [0x2b4f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.470966:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000019aa9ad0/0x3234de053c4da83 lrc: 3/0,0 mode: PR/PR res: [0x2b4f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a8e expref: 1620 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.470969:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000019aa9ad0/0x3234de053c4da83 lrc: 4/0,0 mode: PR/PR res: [0x2b4f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a8e expref: 1620 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.470973:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996967360:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.470986:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210948 00000100:00100000:1.0:1651529344.470988:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+442:39030:x1731745946378752:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.470994:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177396 count 1 00010000:00010000:1.0:1651529344.470998:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c50444 lrc: 3/0,1 mode: --/PW res: [0x2b4f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.471004:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c0dff858 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.471009:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000099324020/0x3234de053c4d44e lrc: 2/0,0 mode: PR/PR res: [0x2b4f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d02fc expref: 1620 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.471010:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c50421 lrc: 2/0,0 mode: PW/PW res: [0x2b4ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.471012:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.471013:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.471013:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c50444 lrc: 4/0,1 mode: --/PW res: [0x2b4f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471013:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000712b8830 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.471015:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c50421 lrc: 2/0,0 mode: PW/PW res: [0x2b4ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471018:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c50421 lrc: 3/0,0 mode: PW/PW res: [0x2b4ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.471021:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000099324020/0x3234de053c4d44e lrc: 3/0,0 mode: PR/PR res: [0x2b4f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d02fc expref: 1620 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.471024:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000099324020/0x3234de053c4d44e lrc: 4/0,0 mode: PR/PR res: [0x2b4f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d02fc expref: 1620 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.471031:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000066de8c9f pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996967424:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.471037:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c50421 lrc: 1/0,0 mode: --/PW res: [0x2b4ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.471040:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b7af823 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.471040:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000712b8830/0x3234de053c50421 lrc: 0/0,0 mode: --/PW res: [0x2b4ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.471046:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396259392 00000100:00100000:0.0:1651529344.471050:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996967232:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.471051:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d840b819/0x3234de053c4cdef lrc: 4/0,0 mode: PR/PR res: [0x2b4f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce92c expref: 1621 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.471053:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008ce5f676/0x3234de053c5042f lrc: 3/0,1 mode: --/PW res: [0x2b4f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.471063:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11727 00000100:00100000:1.0:1651529344.471065:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1621:41278:x1731746396259392:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.471068:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.471069:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d840b819/0x3234de053c4cdef lrc: 4/0,0 mode: PR/PR res: [0x2b4f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce92c expref: 1621 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.471073:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d840b819/0x3234de053c4cdef lrc: 3/0,0 mode: PR/PR res: [0x2b4f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce92c expref: 1621 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.471078:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d840b819/0x3234de053c4cdef lrc: 0/0,0 mode: --/PR res: [0x2b4f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce92c expref: 1621 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.471081:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.471082:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.471083:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008ce5f676/0x3234de053c5042f lrc: 3/0,1 mode: PW/PW res: [0x2b4f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.471086:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ce5f676/0x3234de053c5042f lrc: 4/0,1 mode: PW/PW res: [0x2b4f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.471096:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.471100:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008ce5f676/0x3234de053c5042f lrc: 3/0,1 mode: PW/PW res: [0x2b4f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.471103:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1620:41278:x1731746396259392:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (199us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.471104:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ce5f676/0x3234de053c5042f lrc: 3/0,1 mode: PW/PW res: [0x2b4f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.471105:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11727 00010000:00010000:0.0:1651529344.471107:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ce5f676/0x3234de053c5042f lrc: 3/0,1 mode: PW/PW res: [0x2b4f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471121:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ce5f676/0x3234de053c5042f lrc: 2/0,0 mode: PW/PW res: [0x2b4f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.471131:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.471165:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.471180:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+443:39029:x1731745946378560:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 774us (802us total) trans 12885079000 rc 0/0 00000100:00100000:0.0:1651529344.471183:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210945 00000100:00100000:0.0:1651529344.471189:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946378816 00000100:00100000:0.0:1651529344.471194:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946378880 00000100:00100000:1.0:1651529344.471196:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.471202:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210949 00000100:00100000:0.0:1651529344.471204:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+444:39030:x1731745946378816:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.471209:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177397 count 1 00010000:00010000:0.0:1651529344.471213:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e75f72f8/0x3234de053c5044b lrc: 3/0,1 mode: --/PW res: [0x2b4f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471217:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c4f62f lrc: 2/0,0 mode: PR/PR res: [0x2b4f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b7c expref: 1619 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.471221:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.471231:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.471232:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e75f72f8/0x3234de053c5044b lrc: 4/0,1 mode: --/PW res: [0x2b4f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471245:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c4f62f lrc: 3/0,0 mode: PR/PR res: [0x2b4f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b7c expref: 1619 pid: 156655 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.471246:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.471249:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c4f62f lrc: 4/0,0 mode: PR/PR res: [0x2b4f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b7c expref: 1619 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.471253:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996967488:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.471255:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.471264:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000999005e pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996967296:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.471267:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c086aae3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.471274:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000080a87994/0x3234de053c50436 lrc: 3/0,1 mode: --/PW res: [0x2b4f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471274:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ce5f676/0x3234de053c5042f lrc: 2/0,0 mode: PW/PW res: [0x2b4f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471278:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008ce5f676 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.471279:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ce5f676/0x3234de053c5042f lrc: 2/0,0 mode: PW/PW res: [0x2b4f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.471281:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946378944 00010000:00010000:0.0:1651529344.471282:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ce5f676/0x3234de053c5042f lrc: 3/0,0 mode: PW/PW res: [0x2b4f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.471287:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946379008 00010000:00010000:0.0:1651529344.471287:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ce5f676/0x3234de053c5042f lrc: 1/0,0 mode: --/PW res: [0x2b4f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471289:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ce5f676/0x3234de053c5042f lrc: 0/0,0 mode: --/PW res: [0x2b4f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.471295:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210950 00000100:00100000:1.0:1651529344.471296:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+446:39030:x1731745946378880:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.471302:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177398 count 1 00000100:00100000:0.0:1651529344.471303:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210951 00000100:00100000:0.0:1651529344.471305:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+446:39029:x1731745946378944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.471306:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000186a4198/0x3234de053c50452 lrc: 3/0,1 mode: --/PW res: [0x2b4f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.471310:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000348f59ea/0x3234de053c4cabc lrc: 2/0,0 mode: PR/PR res: [0x2b4f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdcde expref: 1619 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.471310:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177399 count 1 00010000:00010000:1.0:1651529344.471313:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.471314:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.471314:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066ae2b40/0x3234de053c50459 lrc: 3/0,1 mode: --/PW res: [0x2b4f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.471315:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000186a4198/0x3234de053c50452 lrc: 4/0,1 mode: --/PW res: [0x2b4f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471318:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c4d295 lrc: 2/0,0 mode: PR/PR res: [0x2b4f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc1f expref: 1619 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.471321:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000348f59ea/0x3234de053c4cabc lrc: 3/0,0 mode: PR/PR res: [0x2b4f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdcde expref: 1619 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.471321:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.471322:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.471323:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066ae2b40/0x3234de053c50459 lrc: 4/0,1 mode: --/PW res: [0x2b4f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.471325:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000348f59ea/0x3234de053c4cabc lrc: 4/0,0 mode: PR/PR res: [0x2b4f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdcde expref: 1619 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.471329:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d9cfef26 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996967552:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.471329:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c4d295 lrc: 3/0,0 mode: PR/PR res: [0x2b4f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc1f expref: 1619 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.471333:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c4d295 lrc: 4/0,0 mode: PR/PR res: [0x2b4f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc1f expref: 1619 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.471337:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 0000000057299e7f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.471344:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210952 00000100:00100000:1.0:1651529344.471345:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+446:39030:x1731745946379008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.471349:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177400 count 1 00010000:00010000:1.0:1651529344.471353:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dd9e9df/0x3234de053c50460 lrc: 3/0,1 mode: --/PW res: [0x2b4f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.471354:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996967616:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.471357:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008619c536/0x3234de053c4c797 lrc: 2/0,0 mode: PR/PR res: [0x2b4f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd09e expref: 1619 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.471360:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.471361:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.471361:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dd9e9df/0x3234de053c50460 lrc: 4/0,1 mode: --/PW res: [0x2b4f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.471363:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed830649 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.471367:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008619c536/0x3234de053c4c797 lrc: 3/0,0 mode: PR/PR res: [0x2b4f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd09e expref: 1619 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.471373:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008619c536/0x3234de053c4c797 lrc: 4/0,0 mode: PR/PR res: [0x2b4f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd09e expref: 1619 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.471376:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000027e31dd1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996967680:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.471382:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cfa1ca05 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.471389:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396259712 00010000:00010000:1.0:1651529344.471393:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002fe25cb3/0x3234de053c4dcb3 lrc: 4/0,0 mode: PR/PR res: [0x2b4f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2324 expref: 1620 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.471404:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11728 00000100:00100000:1.0:1651529344.471406:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bdd4fa38 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1620:41278:x1731746396259712:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.471408:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.471410:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002fe25cb3/0x3234de053c4dcb3 lrc: 4/0,0 mode: PR/PR res: [0x2b4f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2324 expref: 1620 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.471413:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002fe25cb3/0x3234de053c4dcb3 lrc: 3/0,0 mode: PR/PR res: [0x2b4f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2324 expref: 1620 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.471419:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fe25cb3/0x3234de053c4dcb3 lrc: 0/0,0 mode: --/PR res: [0x2b4f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2324 expref: 1620 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.471422:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.471423:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.471423:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000080a87994/0x3234de053c50436 lrc: 3/0,1 mode: PW/PW res: [0x2b4f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.471429:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080a87994/0x3234de053c50436 lrc: 4/0,1 mode: PW/PW res: [0x2b4f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.471435:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.471441:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bdd4fa38 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1619:41278:x1731746396259712:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 34us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.471443:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11728 00010000:00010000:1.0:1651529344.471453:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000080a87994/0x3234de053c50436 lrc: 3/0,1 mode: PW/PW res: [0x2b4f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.471456:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080a87994/0x3234de053c50436 lrc: 3/0,1 mode: PW/PW res: [0x2b4f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.471460:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080a87994/0x3234de053c50436 lrc: 3/0,1 mode: PW/PW res: [0x2b4f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.471462:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080a87994/0x3234de053c50436 lrc: 2/0,0 mode: PW/PW res: [0x2b4f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471472:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080a87994/0x3234de053c50436 lrc: 2/0,0 mode: PW/PW res: [0x2b4f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471476:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000080a87994 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.471477:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080a87994/0x3234de053c50436 lrc: 2/0,0 mode: PW/PW res: [0x2b4f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471480:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080a87994/0x3234de053c50436 lrc: 3/0,0 mode: PW/PW res: [0x2b4f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471485:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080a87994/0x3234de053c50436 lrc: 1/0,0 mode: --/PW res: [0x2b4f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471488:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080a87994/0x3234de053c50436 lrc: 0/0,0 mode: --/PW res: [0x2b4f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.471503:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+447:39030:x1731745946378624:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 950us (1067us total) trans 12885079001 rc 0/0 00000100:00100000:1.0:1651529344.471506:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210946 00000100:00100000:0.0:1651529344.471550:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996967360:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.471553:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000315faada/0x3234de053c5043d lrc: 3/0,1 mode: --/PW res: [0x2b4f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.471556:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.471595:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.471624:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.471633:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396259840 00010000:00010000:0.0:1651529344.471638:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000099324020/0x3234de053c4d44e lrc: 5/0,0 mode: PR/PR res: [0x2b4f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d02fc expref: 1619 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.471647:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396259776 00010000:00010000:0.0:1651529344.471649:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000019aa9ad0/0x3234de053c4da83 lrc: 4/0,0 mode: PR/PR res: [0x2b4f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a8e expref: 1620 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.471659:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11729 00000100:00100000:0.0:1651529344.471660:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1620:41279:x1731746396259840:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.471662:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000066de8c9f pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996967424:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.471663:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.471665:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000099324020/0x3234de053c4d44e lrc: 4/0,0 mode: PR/PR res: [0x2b4f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d02fc expref: 1620 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.471666:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c50444 lrc: 3/0,1 mode: --/PW res: [0x2b4f4:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471669:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000099324020/0x3234de053c4d44e lrc: 3/0,0 mode: PR/PR res: [0x2b4f4:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d02fc expref: 1620 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.471674:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099324020/0x3234de053c4d44e lrc: 0/0,0 mode: --/PR res: [0x2b4f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d02fc expref: 1620 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.471678:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11730 00010000:00010000:0.0:1651529344.471678:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.471680:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1619:41278:x1731746396259776:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.471683:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.471685:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000019aa9ad0/0x3234de053c4da83 lrc: 4/0,0 mode: PR/PR res: [0x2b4f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a8e expref: 1619 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.471689:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000019aa9ad0/0x3234de053c4da83 lrc: 3/0,0 mode: PR/PR res: [0x2b4f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a8e expref: 1619 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.471692:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.471693:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c50444 lrc: 3/0,1 mode: PW/PW res: [0x2b4f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.471695:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019aa9ad0/0x3234de053c4da83 lrc: 0/0,0 mode: --/PR res: [0x2b4f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a8e expref: 1619 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.471697:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c50444 lrc: 4/0,1 mode: PW/PW res: [0x2b4f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.471698:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.471699:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.471700:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000315faada/0x3234de053c5043d lrc: 3/0,1 mode: PW/PW res: [0x2b4f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.471703:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000315faada/0x3234de053c5043d lrc: 4/0,1 mode: PW/PW res: [0x2b4f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471706:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.471718:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.471731:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1618:41278:x1731746396259776:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 51us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.471742:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11730 00000100:00100000:0.0:1651529344.471742:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1618:41279:x1731746396259840:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 73us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.471746:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11729 00010000:00010000:1.0:1651529344.471750:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c50444 lrc: 3/0,1 mode: PW/PW res: [0x2b4f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.471753:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c50444 lrc: 3/0,1 mode: PW/PW res: [0x2b4f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471754:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000315faada/0x3234de053c5043d lrc: 3/0,1 mode: PW/PW res: [0x2b4f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.471756:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c50444 lrc: 3/0,1 mode: PW/PW res: [0x2b4f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471757:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000315faada/0x3234de053c5043d lrc: 3/0,1 mode: PW/PW res: [0x2b4f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.471759:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c50444 lrc: 2/0,0 mode: PW/PW res: [0x2b4f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471761:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000315faada/0x3234de053c5043d lrc: 3/0,1 mode: PW/PW res: [0x2b4f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471763:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000315faada/0x3234de053c5043d lrc: 2/0,0 mode: PW/PW res: [0x2b4f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.471802:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+448:39030:x1731745946378752:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 814us (908us total) trans 12885079002 rc 0/0 00000100:00100000:1.0:1651529344.471805:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210948 00000100:00100000:0.0:1651529344.471808:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+447:39030:x1731745946378688:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 866us (942us total) trans 12885079003 rc 0/0 00000100:00100000:1.0:1651529344.471810:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946379200 00000100:00100000:0.0:1651529344.471811:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210947 00000100:00100000:0.0:1651529344.471816:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210953 00000100:00100000:0.0:1651529344.471818:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+447:39030:x1731745946379200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.471822:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177401 count 1 00010000:00010000:0.0:1651529344.471826:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50467 lrc: 3/0,1 mode: --/PW res: [0x2b4f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.471831:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.471831:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cadb9e90/0x3234de053c4a1b8 lrc: 2/0,0 mode: PR/PR res: [0x2b4f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb936 expref: 1616 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.471834:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.471834:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.471835:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50467 lrc: 4/0,1 mode: --/PW res: [0x2b4f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471841:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cadb9e90/0x3234de053c4a1b8 lrc: 3/0,0 mode: PR/PR res: [0x2b4f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb936 expref: 1616 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.471845:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cadb9e90/0x3234de053c4a1b8 lrc: 4/0,0 mode: PR/PR res: [0x2b4f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb936 expref: 1616 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.471849:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996967744:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.471857:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 000000003678d25f going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.471862:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c50444 lrc: 2/0,0 mode: PW/PW res: [0x2b4f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471866:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000005af6806 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.471867:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c50444 lrc: 2/0,0 mode: PW/PW res: [0x2b4f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471870:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c50444 lrc: 3/0,0 mode: PW/PW res: [0x2b4f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471892:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c50444 lrc: 1/0,0 mode: --/PW res: [0x2b4f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471911:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c50444 lrc: 0/0,0 mode: --/PW res: [0x2b4f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471918:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000315faada/0x3234de053c5043d lrc: 2/0,0 mode: PW/PW res: [0x2b4f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471925:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000315faada already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.471926:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000315faada/0x3234de053c5043d lrc: 2/0,0 mode: PW/PW res: [0x2b4f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471929:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000315faada/0x3234de053c5043d lrc: 3/0,0 mode: PW/PW res: [0x2b4f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.471930:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.471933:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000315faada/0x3234de053c5043d lrc: 1/0,0 mode: --/PW res: [0x2b4f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471936:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000315faada/0x3234de053c5043d lrc: 0/0,0 mode: --/PW res: [0x2b4f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.471938:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.471950:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d9cfef26 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996967552:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.471952:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996967616:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.471955:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000186a4198/0x3234de053c50452 lrc: 3/0,1 mode: --/PW res: [0x2b4f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.471956:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000066ae2b40/0x3234de053c50459 lrc: 3/0,1 mode: --/PW res: [0x2b4f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.471961:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396259904 00000100:00100000:0.0:1651529344.471963:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996967488:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.471965:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000348f59ea/0x3234de053c4cabc lrc: 4/0,0 mode: PR/PR res: [0x2b4f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdcde expref: 1617 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.471965:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e75f72f8/0x3234de053c5044b lrc: 3/0,1 mode: --/PW res: [0x2b4f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.471972:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396260032 00000100:00100000:0.0:1651529344.471973:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11731 00010000:00010000:1.0:1651529344.471975:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c4d295 lrc: 4/0,0 mode: PR/PR res: [0x2b4f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc1f expref: 1618 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.471976:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1618:41278:x1731746396259904:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.471979:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.471980:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11732 00010000:00010000:0.0:1651529344.471980:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000348f59ea/0x3234de053c4cabc lrc: 4/0,0 mode: PR/PR res: [0x2b4f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdcde expref: 1618 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.471981:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1618:41278:x1731746396260032:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.471984:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.471984:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000348f59ea/0x3234de053c4cabc lrc: 3/0,0 mode: PR/PR res: [0x2b4f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdcde expref: 1618 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.471985:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c4d295 lrc: 4/0,0 mode: PR/PR res: [0x2b4f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc1f expref: 1618 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.471988:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000348f59ea/0x3234de053c4cabc lrc: 0/0,0 mode: --/PR res: [0x2b4f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdcde expref: 1618 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.471989:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c4d295 lrc: 3/0,0 mode: PR/PR res: [0x2b4f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc1f expref: 1618 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.471992:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.471992:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.471993:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000186a4198/0x3234de053c50452 lrc: 3/0,1 mode: PW/PW res: [0x2b4f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.471994:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c4d295 lrc: 0/0,0 mode: --/PR res: [0x2b4f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc1f expref: 1617 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.471998:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.471999:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.472000:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000066ae2b40/0x3234de053c50459 lrc: 3/0,1 mode: PW/PW res: [0x2b4f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.472003:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066ae2b40/0x3234de053c50459 lrc: 4/0,1 mode: PW/PW res: [0x2b4f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.472017:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.472020:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000186a4198/0x3234de053c50452 lrc: 4/0,1 mode: PW/PW res: [0x2b4f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.472024:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1616:41278:x1731746396260032:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (86us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.472029:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.472032:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11732 00000100:00100000:0.0:1651529344.472037:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1615:41278:x1731746396259904:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 61us (107us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.472038:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000186a4198/0x3234de053c50452 lrc: 3/0,1 mode: PW/PW res: [0x2b4f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.472040:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11731 00010000:00010000:1.0:1651529344.472042:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000186a4198/0x3234de053c50452 lrc: 3/0,1 mode: PW/PW res: [0x2b4f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.472045:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000186a4198/0x3234de053c50452 lrc: 3/0,1 mode: PW/PW res: [0x2b4f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.472047:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000186a4198/0x3234de053c50452 lrc: 2/0,0 mode: PW/PW res: [0x2b4f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472066:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000066ae2b40/0x3234de053c50459 lrc: 3/0,1 mode: PW/PW res: [0x2b4f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472070:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066ae2b40/0x3234de053c50459 lrc: 3/0,1 mode: PW/PW res: [0x2b4f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472075:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066ae2b40/0x3234de053c50459 lrc: 3/0,1 mode: PW/PW res: [0x2b4f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472078:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066ae2b40/0x3234de053c50459 lrc: 2/0,0 mode: PW/PW res: [0x2b4f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.472088:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+448:39030:x1731745946378880:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 791us (923us total) trans 12885079004 rc 0/0 00000100:00100000:1.0:1651529344.472091:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210950 00000100:00100000:1.0:1651529344.472095:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946379392 00000100:00100000:1.0:1651529344.472102:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210954 00000100:00100000:1.0:1651529344.472103:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+449:39029:x1731745946379392:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.472108:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177402 count 1 00010000:00010000:1.0:1651529344.472112:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c5046e lrc: 3/0,1 mode: --/PW res: [0x2b4fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.472116:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000f73e545/0x3234de053c4e581 lrc: 2/0,0 mode: PR/PR res: [0x2b4fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d477b expref: 1614 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.472117:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+449:39029:x1731745946378944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 811us (871us total) trans 12885079005 rc 0/0 00010000:00010000:1.0:1651529344.472119:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.472120:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.472120:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210951 00010000:00010000:1.0:1651529344.472121:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c5046e lrc: 4/0,1 mode: --/PW res: [0x2b4fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472127:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000186a4198/0x3234de053c50452 lrc: 2/0,0 mode: PW/PW res: [0x2b4f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.472129:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000f73e545/0x3234de053c4e581 lrc: 3/0,0 mode: PR/PR res: [0x2b4fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d477b expref: 1614 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.472130:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000186a4198 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.472131:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000186a4198/0x3234de053c50452 lrc: 2/0,0 mode: PW/PW res: [0x2b4f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.472133:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000f73e545/0x3234de053c4e581 lrc: 4/0,0 mode: PR/PR res: [0x2b4fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d477b expref: 1614 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.472134:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000186a4198/0x3234de053c50452 lrc: 3/0,0 mode: PW/PW res: [0x2b4f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.472137:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d9cfef26 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996967808:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.472139:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000186a4198/0x3234de053c50452 lrc: 1/0,0 mode: --/PW res: [0x2b4f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472141:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000186a4198/0x3234de053c50452 lrc: 0/0,0 mode: --/PW res: [0x2b4f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.472145:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 000000004ca54b8a going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.472145:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066ae2b40/0x3234de053c50459 lrc: 2/0,0 mode: PW/PW res: [0x2b4f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472148:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000066ae2b40 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.472149:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066ae2b40/0x3234de053c50459 lrc: 2/0,0 mode: PW/PW res: [0x2b4f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472152:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066ae2b40/0x3234de053c50459 lrc: 3/0,0 mode: PW/PW res: [0x2b4f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472155:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066ae2b40/0x3234de053c50459 lrc: 1/0,0 mode: --/PW res: [0x2b4f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472157:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066ae2b40/0x3234de053c50459 lrc: 0/0,0 mode: --/PW res: [0x2b4f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.472160:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.472172:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.472184:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396259968 00000100:00100000:1.0:1651529344.472188:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.472189:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c4f62f lrc: 4/0,0 mode: PR/PR res: [0x2b4f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b7c expref: 1615 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.472214:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11733 00000100:00100000:0.0:1651529344.472216:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1615:41279:x1731746396259968:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.472219:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.472221:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c4f62f lrc: 4/0,0 mode: PR/PR res: [0x2b4f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b7c expref: 1615 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.472245:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c4f62f lrc: 3/0,0 mode: PR/PR res: [0x2b4f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b7c expref: 1615 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.472253:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c4f62f lrc: 0/0,0 mode: --/PR res: [0x2b4f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b7c expref: 1615 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.472256:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.472257:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.472258:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e75f72f8/0x3234de053c5044b lrc: 3/0,1 mode: PW/PW res: [0x2b4f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472261:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e75f72f8/0x3234de053c5044b lrc: 4/0,1 mode: PW/PW res: [0x2b4f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472268:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.472275:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.472285:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.472285:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1614:41279:x1731746396259968:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 68us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.472288:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11733 00000100:00100000:0.0:1651529344.472293:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396260096 00010000:00010000:0.0:1651529344.472296:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008619c536/0x3234de053c4c797 lrc: 5/0,0 mode: PR/PR res: [0x2b4f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd09e expref: 1614 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.472301:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396260224 00010000:00010000:0.0:1651529344.472303:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cadb9e90/0x3234de053c4a1b8 lrc: 5/0,0 mode: PR/PR res: [0x2b4f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb936 expref: 1615 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.472308:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11734 00000100:00100000:0.0:1651529344.472309:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1615:41278:x1731746396260096:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.472311:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.472313:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008619c536/0x3234de053c4c797 lrc: 5/0,0 mode: PR/PR res: [0x2b4f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd09e expref: 1615 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.472314:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946379776 00010000:00010000:0.0:1651529344.472316:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008619c536/0x3234de053c4c797 lrc: 4/0,0 mode: PR/PR res: [0x2b4f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd09e expref: 1615 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.472324:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946379712 00010000:00010000:0.0:1651529344.472327:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.472327:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.472328:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003dd9e9df/0x3234de053c50460 lrc: 3/0,1 mode: PW/PW res: [0x2b4f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.472329:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210955 00000100:00100000:1.0:1651529344.472331:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006a24970a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+450:39030:x1731745946379776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.472336:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177404 count 1 00010000:00010000:1.0:1651529344.472340:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c50475 lrc: 3/0,1 mode: --/PW res: [0x2b4fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.472345:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e5da371a/0x3234de053c4cac3 lrc: 2/0,0 mode: PR/PR res: [0x2b4fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdcec expref: 1615 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.472350:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dd9e9df/0x3234de053c50460 lrc: 4/0,1 mode: PW/PW res: [0x2b4f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.472353:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.472354:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.472355:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c50475 lrc: 4/0,1 mode: --/PW res: [0x2b4fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.472362:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e5da371a/0x3234de053c4cac3 lrc: 3/0,0 mode: PR/PR res: [0x2b4fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdcec expref: 1615 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.472364:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.472366:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e5da371a/0x3234de053c4cac3 lrc: 4/0,0 mode: PR/PR res: [0x2b4fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdcec expref: 1615 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.472370:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005fb0ec6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996967872:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.472371:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1615:41278:x1731746396260096:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 61us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.472374:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11734 00000100:00100000:1.0:1651529344.472378:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8a0b704 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.472379:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11735 00000100:00100000:0.0:1651529344.472380:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000969ab41d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1614:41278:x1731746396260224:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.472383:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.472384:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cadb9e90/0x3234de053c4a1b8 lrc: 5/0,0 mode: PR/PR res: [0x2b4f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb936 expref: 1614 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.472385:0:80279:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008619c536/0x3234de053c4c797 lrc: 0/0,0 mode: --/PR res: [0x2b4f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd09e expref: 1614 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.472388:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cadb9e90/0x3234de053c4a1b8 lrc: 4/0,0 mode: PR/PR res: [0x2b4f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb936 expref: 1614 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.472390:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000027e31dd1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996967680:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.472393:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003dd9e9df/0x3234de053c50460 lrc: 3/0,1 mode: PW/PW res: [0x2b4f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472393:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.472394:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.472394:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50467 lrc: 3/0,1 mode: PW/PW res: [0x2b4f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.472396:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003dd9e9df/0x3234de053c50460 lrc: 3/0,1 mode: PW/PW res: [0x2b4f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472397:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50467 lrc: 4/0,1 mode: PW/PW res: [0x2b4f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.472399:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003dd9e9df/0x3234de053c50460 lrc: 3/0,1 mode: PW/PW res: [0x2b4f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.472402:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dd9e9df/0x3234de053c50460 lrc: 3/0,1 mode: PW/PW res: [0x2b4f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472402:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.472406:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000969ab41d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1613:41278:x1731746396260224:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 25us (121us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.472407:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003dd9e9df/0x3234de053c50460 lrc: 2/0,0 mode: PW/PW res: [0x2b4f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.472408:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11735 00010000:00010000:0.0:1651529344.472439:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003dd9e9df/0x3234de053c50460 lrc: 2/0,0 mode: PW/PW res: [0x2b4f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472443:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003dd9e9df already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.472450:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+451:39030:x1731745946379008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1104us (1195us total) trans 12885079006 rc 0/0 00000100:00100000:1.0:1651529344.472453:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210952 00010000:00010000:0.0:1651529344.472453:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003dd9e9df/0x3234de053c50460 lrc: 2/0,0 mode: PW/PW res: [0x2b4f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472457:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003dd9e9df/0x3234de053c50460 lrc: 3/0,0 mode: PW/PW res: [0x2b4f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.472458:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210956 00000100:00100000:1.0:1651529344.472460:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+450:39030:x1731745946379712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.472461:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003dd9e9df/0x3234de053c50460 lrc: 1/0,0 mode: --/PW res: [0x2b4f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472464:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003dd9e9df/0x3234de053c50460 lrc: 0/0,0 mode: --/PW res: [0x2b4f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.472465:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177403 count 1 00010000:00010000:1.0:1651529344.472468:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f6c33eb/0x3234de053c5047c lrc: 3/0,1 mode: --/PW res: [0x2b4fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472471:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e75f72f8/0x3234de053c5044b lrc: 3/0,1 mode: PW/PW res: [0x2b4f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.472472:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000561ebbe2/0x3234de053c4c93b lrc: 2/0,0 mode: PR/PR res: [0x2b4fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd663 expref: 1612 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.472476:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.472476:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.472476:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e75f72f8/0x3234de053c5044b lrc: 3/0,1 mode: PW/PW res: [0x2b4f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.472477:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f6c33eb/0x3234de053c5047c lrc: 4/0,1 mode: --/PW res: [0x2b4fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472479:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e75f72f8/0x3234de053c5044b lrc: 3/0,1 mode: PW/PW res: [0x2b4f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472482:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e75f72f8/0x3234de053c5044b lrc: 2/0,0 mode: PW/PW res: [0x2b4f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.472483:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000561ebbe2/0x3234de053c4c93b lrc: 3/0,0 mode: PR/PR res: [0x2b4fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd663 expref: 1612 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.472486:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000561ebbe2/0x3234de053c4c93b lrc: 4/0,0 mode: PR/PR res: [0x2b4fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd663 expref: 1612 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.472493:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000be0ace91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996967936:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.472500:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a4eb401d going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.472520:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+451:39030:x1731745946378816:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1315us (1389us total) trans 12885079007 rc 0/0 00000100:00100000:0.0:1651529344.472523:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210949 00010000:00010000:0.0:1651529344.472530:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e75f72f8/0x3234de053c5044b lrc: 2/0,0 mode: PW/PW res: [0x2b4f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472533:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e75f72f8 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.472534:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e75f72f8/0x3234de053c5044b lrc: 2/0,0 mode: PW/PW res: [0x2b4f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.472536:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.472537:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e75f72f8/0x3234de053c5044b lrc: 3/0,0 mode: PW/PW res: [0x2b4f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472548:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e75f72f8/0x3234de053c5044b lrc: 1/0,0 mode: --/PW res: [0x2b4f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472551:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e75f72f8/0x3234de053c5044b lrc: 0/0,0 mode: --/PW res: [0x2b4f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.472564:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.472572:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946379840 00000100:00100000:0.0:1651529344.472581:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946379904 00000100:00100000:0.0:1651529344.472587:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210957 00000100:00100000:0.0:1651529344.472589:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+452:39029:x1731745946379840:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.472594:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177405 count 1 00000100:00100000:1.0:1651529344.472598:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.472598:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b4eadd7/0x3234de053c50483 lrc: 3/0,1 mode: --/PW res: [0x2b4fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472603:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000036e3829a/0x3234de053c4cd24 lrc: 2/0,0 mode: PR/PR res: [0x2b4fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce68c expref: 1612 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.472606:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.472607:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.472607:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b4eadd7/0x3234de053c50483 lrc: 4/0,1 mode: --/PW res: [0x2b4fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472614:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000036e3829a/0x3234de053c4cd24 lrc: 3/0,0 mode: PR/PR res: [0x2b4fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce68c expref: 1612 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.472617:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000036e3829a/0x3234de053c4cd24 lrc: 4/0,0 mode: PR/PR res: [0x2b4fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce68c expref: 1612 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.472621:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996968000:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.472631:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c086aae3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.472637:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210958 00000100:00100000:0.0:1651529344.472639:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+452:39030:x1731745946379904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.472643:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177406 count 1 00010000:00010000:0.0:1651529344.472646:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088155288/0x3234de053c5048a lrc: 3/0,1 mode: --/PW res: [0x2b4fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472650:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000920e959f/0x3234de053c4eba8 lrc: 2/0,0 mode: PR/PR res: [0x2b4fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d605d expref: 1612 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.472653:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.472654:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.472654:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088155288/0x3234de053c5048a lrc: 4/0,1 mode: --/PW res: [0x2b4fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472660:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000920e959f/0x3234de053c4eba8 lrc: 3/0,0 mode: PR/PR res: [0x2b4fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d605d expref: 1612 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.472663:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000920e959f/0x3234de053c4eba8 lrc: 4/0,0 mode: PR/PR res: [0x2b4fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d605d expref: 1612 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.472664:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d9cfef26 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996967808:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.472667:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996968064:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.472668:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c5046e lrc: 3/0,1 mode: --/PW res: [0x2b4fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.472678:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c0dff858 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.472682:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396260608 00010000:00010000:1.0:1651529344.472687:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000f73e545/0x3234de053c4e581 lrc: 4/0,0 mode: PR/PR res: [0x2b4fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d477b expref: 1613 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.472695:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11736 00000100:00100000:1.0:1651529344.472696:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1613:41279:x1731746396260608:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.472699:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.472700:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000f73e545/0x3234de053c4e581 lrc: 4/0,0 mode: PR/PR res: [0x2b4fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d477b expref: 1613 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.472703:0:151609:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cadb9e90/0x3234de053c4a1b8 lrc: 0/0,0 mode: --/PR res: [0x2b4f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb936 expref: 1613 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.472704:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000f73e545/0x3234de053c4e581 lrc: 3/0,0 mode: PR/PR res: [0x2b4fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d477b expref: 1613 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.472707:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996967744:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.472710:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f73e545/0x3234de053c4e581 lrc: 0/0,0 mode: --/PR res: [0x2b4fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d477b expref: 1612 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.472710:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50467 lrc: 3/0,1 mode: PW/PW res: [0x2b4f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.472716:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.472716:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50467 lrc: 3/0,1 mode: PW/PW res: [0x2b4f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.472717:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.472717:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c5046e lrc: 3/0,1 mode: PW/PW res: [0x2b4fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472719:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50467 lrc: 3/0,1 mode: PW/PW res: [0x2b4f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.472720:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c5046e lrc: 4/0,1 mode: PW/PW res: [0x2b4fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472722:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50467 lrc: 3/0,1 mode: PW/PW res: [0x2b4f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472724:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50467 lrc: 2/0,0 mode: PW/PW res: [0x2b4f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.472726:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.472733:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1611:41279:x1731746396260608:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.472746:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11736 00010000:00010000:1.0:1651529344.472753:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c5046e lrc: 3/0,1 mode: PW/PW res: [0x2b4fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.472756:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c5046e lrc: 3/0,1 mode: PW/PW res: [0x2b4fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.472759:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c5046e lrc: 3/0,1 mode: PW/PW res: [0x2b4fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.472762:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c5046e lrc: 2/0,0 mode: PW/PW res: [0x2b4fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.472791:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+454:39030:x1731745946379200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 972us (1235us total) trans 12885079008 rc 0/0 00000100:00100000:0.0:1651529344.472794:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210953 00010000:00010000:0.0:1651529344.472802:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50467 lrc: 2/0,0 mode: PW/PW res: [0x2b4f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.472804:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+453:39029:x1731745946379392:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 699us (973us total) trans 12885079009 rc 0/0 00010000:00010000:0.0:1651529344.472805:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dcd3e2d1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.472806:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50467 lrc: 2/0,0 mode: PW/PW res: [0x2b4f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.472807:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210954 00010000:00010000:0.0:1651529344.472809:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50467 lrc: 3/0,0 mode: PW/PW res: [0x2b4f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472813:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50467 lrc: 1/0,0 mode: --/PW res: [0x2b4f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472816:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50467 lrc: 0/0,0 mode: --/PW res: [0x2b4f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472820:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c5046e lrc: 2/0,0 mode: PW/PW res: [0x2b4fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.472822:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.472823:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cd6e2551 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.472824:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c5046e lrc: 2/0,0 mode: PW/PW res: [0x2b4fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472826:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c5046e lrc: 3/0,0 mode: PW/PW res: [0x2b4fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472830:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c5046e lrc: 1/0,0 mode: --/PW res: [0x2b4fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472832:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c5046e lrc: 0/0,0 mode: --/PW res: [0x2b4fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.472837:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.472882:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946379968 00000100:00100000:1.0:1651529344.472892:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946380032 00000100:00100000:1.0:1651529344.472897:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210959 00000100:00100000:1.0:1651529344.472899:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+454:39029:x1731745946379968:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.472899:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210960 00000100:00100000:0.0:1651529344.472901:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+454:39030:x1731745946380032:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.472904:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177407 count 1 00002000:00080000:0.0:1651529344.472907:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177408 count 1 00010000:00010000:1.0:1651529344.472908:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbf1beb5/0x3234de053c50491 lrc: 3/0,1 mode: --/PW res: [0x2b4ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472910:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005976006a/0x3234de053c50498 lrc: 3/0,1 mode: --/PW res: [0x2b500:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.472913:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bc982a8f/0x3234de053c4ddfc lrc: 2/0,0 mode: PR/PR res: [0x2b4ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d28f0 expref: 1610 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.472914:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005c016e55/0x3234de053c4ceeb lrc: 2/0,0 mode: PR/PR res: [0x2b500:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced9a expref: 1610 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.472916:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.472917:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.472917:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fbf1beb5/0x3234de053c50491 lrc: 4/0,1 mode: --/PW res: [0x2b4ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.472917:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.472918:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.472919:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005976006a/0x3234de053c50498 lrc: 4/0,1 mode: --/PW res: [0x2b500:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.472924:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bc982a8f/0x3234de053c4ddfc lrc: 3/0,0 mode: PR/PR res: [0x2b4ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d28f0 expref: 1610 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.472925:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005c016e55/0x3234de053c4ceeb lrc: 3/0,0 mode: PR/PR res: [0x2b500:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced9a expref: 1610 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.472928:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bc982a8f/0x3234de053c4ddfc lrc: 4/0,0 mode: PR/PR res: [0x2b4ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d28f0 expref: 1610 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.472929:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005c016e55/0x3234de053c4ceeb lrc: 4/0,0 mode: PR/PR res: [0x2b500:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced9a expref: 1610 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.472932:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d523a75 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996968128:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.472942:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cfa1ca05 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.472950:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996968192:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.472969:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 000000003678d25f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.472998:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996968000:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.473014:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006b4eadd7/0x3234de053c50483 lrc: 3/0,1 mode: --/PW res: [0x2b4fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.473020:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.473027:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.473037:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.473045:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396260864 00010000:00010000:0.0:1651529344.473051:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000036e3829a/0x3234de053c4cd24 lrc: 4/0,0 mode: PR/PR res: [0x2b4fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce68c expref: 1611 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.473062:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396260800 00010000:00010000:0.0:1651529344.473064:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e5da371a/0x3234de053c4cac3 lrc: 5/0,0 mode: PR/PR res: [0x2b4fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdcec expref: 1612 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.473071:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11737 00000100:00100000:0.0:1651529344.473073:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1612:41279:x1731746396260864:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.473075:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.473082:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.473088:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.473089:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000036e3829a/0x3234de053c4cd24 lrc: 4/0,0 mode: PR/PR res: [0x2b4fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce68c expref: 1612 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.473098:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.473099:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000036e3829a/0x3234de053c4cd24 lrc: 3/0,0 mode: PR/PR res: [0x2b4fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce68c expref: 1612 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.473105:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036e3829a/0x3234de053c4cd24 lrc: 0/0,0 mode: --/PR res: [0x2b4fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce68c expref: 1612 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.473106:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005fb0ec6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996967872:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.473108:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.473109:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.473110:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c50475 lrc: 3/0,1 mode: --/PW res: [0x2b4fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473110:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006b4eadd7/0x3234de053c50483 lrc: 3/0,1 mode: PW/PW res: [0x2b4fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473113:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b4eadd7/0x3234de053c50483 lrc: 4/0,1 mode: PW/PW res: [0x2b4fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.473117:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000be0ace91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996967936:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.473118:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.473119:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005f6c33eb/0x3234de053c5047c lrc: 3/0,1 mode: --/PW res: [0x2b4fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.473125:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946380352 00000100:00100000:0.0:1651529344.473130:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1611:41279:x1731746396260864:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 57us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.473133:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11737 00000100:00100000:1.0:1651529344.473137:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946380416 00000100:00100000:0.0:1651529344.473138:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396260928 00000100:00100000:1.0:1651529344.473142:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210961 00010000:00010000:0.0:1651529344.473142:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000561ebbe2/0x3234de053c4c93b lrc: 4/0,0 mode: PR/PR res: [0x2b4fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd663 expref: 1611 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.473143:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+456:39030:x1731745946380352:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.473146:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396260992 00002000:00080000:1.0:1651529344.473148:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177409 count 1 00010000:00010000:0.0:1651529344.473149:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000920e959f/0x3234de053c4eba8 lrc: 5/0,0 mode: PR/PR res: [0x2b4fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d605d expref: 1612 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.473152:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c1791d6/0x3234de053c5049f lrc: 3/0,1 mode: --/PW res: [0x2b501:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.473153:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11738 00000100:00100000:0.0:1651529344.473155:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1612:41279:x1731746396260800:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.473156:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ac93cd8e/0x3234de053c4f6c9 lrc: 2/0,0 mode: PR/PR res: [0x2b501:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8dd6 expref: 1612 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.473157:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.473159:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e5da371a/0x3234de053c4cac3 lrc: 4/0,0 mode: PR/PR res: [0x2b4fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdcec expref: 1612 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.473160:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.473160:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.473161:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c1791d6/0x3234de053c5049f lrc: 4/0,1 mode: --/PW res: [0x2b501:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473162:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e5da371a/0x3234de053c4cac3 lrc: 3/0,0 mode: PR/PR res: [0x2b4fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdcec expref: 1612 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.473167:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5da371a/0x3234de053c4cac3 lrc: 0/0,0 mode: --/PR res: [0x2b4fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdcec expref: 1612 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.473170:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ac93cd8e/0x3234de053c4f6c9 lrc: 3/0,0 mode: PR/PR res: [0x2b501:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8dd6 expref: 1611 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.473170:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.473171:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.473171:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c50475 lrc: 3/0,1 mode: PW/PW res: [0x2b4fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.473174:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ac93cd8e/0x3234de053c4f6c9 lrc: 4/0,0 mode: PR/PR res: [0x2b501:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8dd6 expref: 1611 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.473174:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c50475 lrc: 4/0,1 mode: PW/PW res: [0x2b4fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.473178:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000be0ace91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996968256:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.473182:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.473192:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1611:41279:x1731746396260800:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.473193:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 0000000053a0cffa going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.473194:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11738 00000100:00100000:0.0:1651529344.473198:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11739 00000100:00100000:1.0:1651529344.473200:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210962 00000100:00100000:0.0:1651529344.473200:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1610:41279:x1731746396260928:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.473201:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+456:39030:x1731745946380416:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.473202:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.473203:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000561ebbe2/0x3234de053c4c93b lrc: 4/0,0 mode: PR/PR res: [0x2b4fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd663 expref: 1610 pid: 72396 timeout: 20103 lvb_type: 1 00002000:00080000:1.0:1651529344.473206:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177410 count 1 00010000:00010000:0.0:1651529344.473207:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000561ebbe2/0x3234de053c4c93b lrc: 3/0,0 mode: PR/PR res: [0x2b4fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd663 expref: 1610 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.473209:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005480834d/0x3234de053c504a6 lrc: 3/0,1 mode: --/PW res: [0x2b502:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473211:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000561ebbe2/0x3234de053c4c93b lrc: 0/0,0 mode: --/PR res: [0x2b4fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd663 expref: 1610 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.473213:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000014323a57/0x3234de053c4e9ef lrc: 2/0,0 mode: PR/PR res: [0x2b502:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d594f expref: 1610 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.473215:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.473216:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.473217:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.473217:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005480834d/0x3234de053c504a6 lrc: 4/0,1 mode: --/PW res: [0x2b502:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.473239:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000014323a57/0x3234de053c4e9ef lrc: 3/0,0 mode: PR/PR res: [0x2b502:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d594f expref: 1609 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.473242:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000014323a57/0x3234de053c4e9ef lrc: 4/0,0 mode: PR/PR res: [0x2b502:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d594f expref: 1609 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.473247:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005fb0ec6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996968320:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.473254:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd96f074 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.473254:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.473255:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005f6c33eb/0x3234de053c5047c lrc: 3/0,1 mode: PW/PW res: [0x2b4fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473259:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f6c33eb/0x3234de053c5047c lrc: 4/0,1 mode: PW/PW res: [0x2b4fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473269:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.473271:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c50475 lrc: 3/0,1 mode: PW/PW res: [0x2b4fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.473275:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c50475 lrc: 3/0,1 mode: PW/PW res: [0x2b4fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.473276:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1609:41279:x1731746396260928:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 76us (194us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.473278:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c50475 lrc: 3/0,1 mode: PW/PW res: [0x2b4fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.473279:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11739 00010000:00010000:1.0:1651529344.473281:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c50475 lrc: 2/0,0 mode: PW/PW res: [0x2b4fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.473284:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11740 00000100:00100000:0.0:1651529344.473286:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1608:41279:x1731746396260992:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.473295:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.473297:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000920e959f/0x3234de053c4eba8 lrc: 5/0,0 mode: PR/PR res: [0x2b4fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d605d expref: 1608 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.473301:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000920e959f/0x3234de053c4eba8 lrc: 4/0,0 mode: PR/PR res: [0x2b4fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d605d expref: 1608 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.473306:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.473307:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.473307:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000088155288/0x3234de053c5048a lrc: 3/0,1 mode: PW/PW res: [0x2b4fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473310:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088155288/0x3234de053c5048a lrc: 4/0,1 mode: PW/PW res: [0x2b4fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473315:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.473320:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1608:41279:x1731746396260992:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 33us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.473322:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11740 00000100:00100000:1.0:1651529344.473324:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006a24970a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+457:39030:x1731745946379776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 992us (1164us total) trans 12885079010 rc 0/0 00000100:00100000:1.0:1651529344.473327:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210955 00010000:00010000:0.0:1651529344.473331:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c50475 lrc: 2/0,0 mode: PW/PW res: [0x2b4fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473334:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007d2a92bc already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.473335:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c50475 lrc: 2/0,0 mode: PW/PW res: [0x2b4fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473338:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c50475 lrc: 3/0,0 mode: PW/PW res: [0x2b4fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473342:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c50475 lrc: 1/0,0 mode: --/PW res: [0x2b4fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.473346:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005f6c33eb/0x3234de053c5047c lrc: 3/0,1 mode: PW/PW res: [0x2b4fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473347:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d2a92bc/0x3234de053c50475 lrc: 0/0,0 mode: --/PW res: [0x2b4fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.473349:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f6c33eb/0x3234de053c5047c lrc: 3/0,1 mode: PW/PW res: [0x2b4fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.473352:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f6c33eb/0x3234de053c5047c lrc: 3/0,1 mode: PW/PW res: [0x2b4fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473356:0:106695:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000920e959f/0x3234de053c4eba8 lrc: 0/0,0 mode: --/PR res: [0x2b4fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d605d expref: 1607 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.473358:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f6c33eb/0x3234de053c5047c lrc: 2/0,0 mode: PW/PW res: [0x2b4fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.473359:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996968064:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.473363:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000088155288/0x3234de053c5048a lrc: 3/0,1 mode: PW/PW res: [0x2b4fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473372:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000088155288/0x3234de053c5048a lrc: 3/0,1 mode: PW/PW res: [0x2b4fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473375:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088155288/0x3234de053c5048a lrc: 3/0,1 mode: PW/PW res: [0x2b4fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473378:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088155288/0x3234de053c5048a lrc: 3/0,1 mode: PW/PW res: [0x2b4fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473381:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088155288/0x3234de053c5048a lrc: 2/0,0 mode: PW/PW res: [0x2b4fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.473395:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+457:39030:x1731745946379712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 934us (1207us total) trans 12885079011 rc 0/0 00000100:00100000:1.0:1651529344.473398:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210956 00000100:00100000:0.0:1651529344.473421:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+457:39030:x1731745946379904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 781us (857us total) trans 12885079012 rc 0/0 00000100:00100000:0.0:1651529344.473424:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210958 00000100:00100000:1.0:1651529344.473437:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.473439:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f6c33eb/0x3234de053c5047c lrc: 2/0,0 mode: PW/PW res: [0x2b4fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473442:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005f6c33eb already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.473443:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f6c33eb/0x3234de053c5047c lrc: 2/0,0 mode: PW/PW res: [0x2b4fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473446:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f6c33eb/0x3234de053c5047c lrc: 3/0,0 mode: PW/PW res: [0x2b4fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.473448:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.473451:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f6c33eb/0x3234de053c5047c lrc: 1/0,0 mode: --/PW res: [0x2b4fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473453:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f6c33eb/0x3234de053c5047c lrc: 0/0,0 mode: --/PW res: [0x2b4fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473458:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088155288/0x3234de053c5048a lrc: 2/0,0 mode: PW/PW res: [0x2b4fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473460:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088155288 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.473461:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088155288/0x3234de053c5048a lrc: 2/0,0 mode: PW/PW res: [0x2b4fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473464:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088155288/0x3234de053c5048a lrc: 3/0,0 mode: PW/PW res: [0x2b4fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473467:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088155288/0x3234de053c5048a lrc: 1/0,0 mode: --/PW res: [0x2b4fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473472:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088155288/0x3234de053c5048a lrc: 0/0,0 mode: --/PW res: [0x2b4fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473477:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006b4eadd7/0x3234de053c50483 lrc: 3/0,1 mode: PW/PW res: [0x2b4fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473480:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b4eadd7/0x3234de053c50483 lrc: 3/0,1 mode: PW/PW res: [0x2b4fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473483:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b4eadd7/0x3234de053c50483 lrc: 3/0,1 mode: PW/PW res: [0x2b4fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473486:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b4eadd7/0x3234de053c50483 lrc: 2/0,0 mode: PW/PW res: [0x2b4fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.473519:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d523a75 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996968128:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.473523:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fbf1beb5/0x3234de053c50491 lrc: 3/0,1 mode: --/PW res: [0x2b4ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.473531:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396261056 00010000:00010000:1.0:1651529344.473535:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bc982a8f/0x3234de053c4ddfc lrc: 4/0,0 mode: PR/PR res: [0x2b4ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d28f0 expref: 1607 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.473543:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+457:39029:x1731745946379840:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 953us (1007us total) trans 12885079013 rc 0/0 00000100:00100000:1.0:1651529344.473551:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396261120 00000100:00100000:0.0:1651529344.473552:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210957 00010000:00010000:1.0:1651529344.473555:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005c016e55/0x3234de053c4ceeb lrc: 5/0,0 mode: PR/PR res: [0x2b500:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced9a expref: 1608 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.473560:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11741 00000100:00100000:1.0:1651529344.473561:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1608:41278:x1731746396261056:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.473564:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.473565:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bc982a8f/0x3234de053c4ddfc lrc: 4/0,0 mode: PR/PR res: [0x2b4ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d28f0 expref: 1608 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.473570:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b4eadd7/0x3234de053c50483 lrc: 2/0,0 mode: PW/PW res: [0x2b4fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.473571:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bc982a8f/0x3234de053c4ddfc lrc: 3/0,0 mode: PR/PR res: [0x2b4ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d28f0 expref: 1608 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.473574:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006b4eadd7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.473575:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b4eadd7/0x3234de053c50483 lrc: 2/0,0 mode: PW/PW res: [0x2b4fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.473577:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc982a8f/0x3234de053c4ddfc lrc: 0/0,0 mode: --/PR res: [0x2b4ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d28f0 expref: 1608 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.473578:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b4eadd7/0x3234de053c50483 lrc: 3/0,0 mode: PW/PW res: [0x2b4fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.473581:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.473581:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.473582:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fbf1beb5/0x3234de053c50491 lrc: 3/0,1 mode: PW/PW res: [0x2b4ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473583:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b4eadd7/0x3234de053c50483 lrc: 1/0,0 mode: --/PW res: [0x2b4fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.473585:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fbf1beb5/0x3234de053c50491 lrc: 4/0,1 mode: PW/PW res: [0x2b4ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473586:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b4eadd7/0x3234de053c50483 lrc: 0/0,0 mode: --/PW res: [0x2b4fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.473591:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.473596:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996968192:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.473598:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1607:41278:x1731746396261056:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (162us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.473599:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005976006a/0x3234de053c50498 lrc: 3/0,1 mode: --/PW res: [0x2b500:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.473601:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11741 00000100:00100000:1.0:1651529344.473605:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11742 00000100:00100000:1.0:1651529344.473606:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de23fde4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1606:41279:x1731746396261120:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.473609:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.473610:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005c016e55/0x3234de053c4ceeb lrc: 4/0,0 mode: PR/PR res: [0x2b500:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced9a expref: 1606 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.473614:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005c016e55/0x3234de053c4ceeb lrc: 3/0,0 mode: PR/PR res: [0x2b500:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced9a expref: 1606 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.473618:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c016e55/0x3234de053c4ceeb lrc: 0/0,0 mode: --/PR res: [0x2b500:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced9a expref: 1606 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.473622:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.473622:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.473623:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005976006a/0x3234de053c50498 lrc: 3/0,1 mode: PW/PW res: [0x2b500:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.473626:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005976006a/0x3234de053c50498 lrc: 4/0,1 mode: PW/PW res: [0x2b500:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.473635:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.473638:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005976006a/0x3234de053c50498 lrc: 3/0,1 mode: PW/PW res: [0x2b500:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.473640:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de23fde4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1605:41279:x1731746396261120:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (192us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.473641:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005976006a/0x3234de053c50498 lrc: 3/0,1 mode: PW/PW res: [0x2b500:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.473642:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11742 00010000:00010000:0.0:1651529344.473645:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005976006a/0x3234de053c50498 lrc: 3/0,1 mode: PW/PW res: [0x2b500:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473647:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005976006a/0x3234de053c50498 lrc: 2/0,0 mode: PW/PW res: [0x2b500:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.473652:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fbf1beb5/0x3234de053c50491 lrc: 3/0,1 mode: PW/PW res: [0x2b4ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.473655:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fbf1beb5/0x3234de053c50491 lrc: 3/0,1 mode: PW/PW res: [0x2b4ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.473659:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbf1beb5/0x3234de053c50491 lrc: 3/0,1 mode: PW/PW res: [0x2b4ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.473661:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fbf1beb5/0x3234de053c50491 lrc: 2/0,0 mode: PW/PW res: [0x2b4ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.473692:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+458:39030:x1731745946380032:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 790us (855us total) trans 12885079014 rc 0/0 00000100:00100000:0.0:1651529344.473695:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210960 00010000:00010000:0.0:1651529344.473702:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005976006a/0x3234de053c50498 lrc: 2/0,0 mode: PW/PW res: [0x2b500:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.473704:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+457:39029:x1731745946379968:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 805us (881us total) trans 12885079015 rc 0/0 00010000:00010000:0.0:1651529344.473706:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005976006a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.473707:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005976006a/0x3234de053c50498 lrc: 2/0,0 mode: PW/PW res: [0x2b500:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.473708:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210959 00010000:00010000:0.0:1651529344.473710:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005976006a/0x3234de053c50498 lrc: 3/0,0 mode: PW/PW res: [0x2b500:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473714:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005976006a/0x3234de053c50498 lrc: 1/0,0 mode: --/PW res: [0x2b500:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473717:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005976006a/0x3234de053c50498 lrc: 0/0,0 mode: --/PW res: [0x2b500:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473721:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fbf1beb5/0x3234de053c50491 lrc: 2/0,0 mode: PW/PW res: [0x2b4ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473724:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fbf1beb5 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.473725:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbf1beb5/0x3234de053c50491 lrc: 2/0,0 mode: PW/PW res: [0x2b4ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473727:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbf1beb5/0x3234de053c50491 lrc: 3/0,0 mode: PW/PW res: [0x2b4ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473730:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fbf1beb5/0x3234de053c50491 lrc: 1/0,0 mode: --/PW res: [0x2b4ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473733:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fbf1beb5/0x3234de053c50491 lrc: 0/0,0 mode: --/PW res: [0x2b4ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.473748:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.473762:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.473773:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946380800 00000100:00100000:1.0:1651529344.473778:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.473787:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946380736 00000100:00100000:0.0:1651529344.473794:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946380864 00000100:00100000:0.0:1651529344.473798:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210963 00000100:00100000:0.0:1651529344.473800:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+459:39030:x1731745946380800:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.473805:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177412 count 1 00010000:00010000:0.0:1651529344.473809:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c504ad lrc: 3/0,1 mode: --/PW res: [0x2b504:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473814:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b937ade1/0x3234de053c4b633 lrc: 2/0,0 mode: PR/PR res: [0x2b504:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc2f2 expref: 1604 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.473817:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.473817:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.473818:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c504ad lrc: 4/0,1 mode: --/PW res: [0x2b504:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473825:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b937ade1/0x3234de053c4b633 lrc: 3/0,0 mode: PR/PR res: [0x2b504:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc2f2 expref: 1604 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.473828:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b937ade1/0x3234de053c4b633 lrc: 4/0,0 mode: PR/PR res: [0x2b504:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc2f2 expref: 1604 pid: 80276 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.473830:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210964 00000100:00100000:1.0:1651529344.473832:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+459:39029:x1731745946380736:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.473832:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996968384:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.473838:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177411 count 1 00010000:00010000:1.0:1651529344.473842:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f3c2fb2/0x3234de053c504b4 lrc: 3/0,1 mode: --/PW res: [0x2b503:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.473847:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000a146a8b/0x3234de053c4d17d lrc: 2/0,0 mode: PR/PR res: [0x2b503:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf748 expref: 1604 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.473850:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.473851:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.473852:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f3c2fb2/0x3234de053c504b4 lrc: 4/0,1 mode: --/PW res: [0x2b503:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.473865:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000a146a8b/0x3234de053c4d17d lrc: 3/0,0 mode: PR/PR res: [0x2b503:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf748 expref: 1604 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.473868:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000a146a8b/0x3234de053c4d17d lrc: 4/0,0 mode: PR/PR res: [0x2b503:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf748 expref: 1604 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.473875:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000064719963 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996968448:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.473880:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c0dff858 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.473884:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f79d8146 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.473887:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210965 00000100:00100000:0.0:1651529344.473889:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+459:39029:x1731745946380864:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.473894:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177413 count 1 00010000:00010000:0.0:1651529344.473897:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c504bb lrc: 3/0,1 mode: --/PW res: [0x2b505:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.473902:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001dd400cf/0x3234de053c4abba lrc: 2/0,0 mode: PR/PR res: [0x2b505:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe30 expref: 1604 pid: 80278 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.473905:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.473906:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.473906:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c504bb lrc: 4/0,1 mode: --/PW res: [0x2b505:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.473908:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.473913:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001dd400cf/0x3234de053c4abba lrc: 3/0,0 mode: PR/PR res: [0x2b505:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe30 expref: 1604 pid: 80278 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.473916:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001dd400cf/0x3234de053c4abba lrc: 4/0,0 mode: PR/PR res: [0x2b505:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe30 expref: 1604 pid: 80278 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.473920:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996968512:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.473928:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 000000003ad73843 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.473979:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.473990:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.473990:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946380992 00000100:00100000:0.0:1651529344.474000:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946380928 00000100:00100000:1.0:1651529344.474002:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.474011:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946381056 00000100:00100000:0.0:1651529344.474017:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210966 00000100:00100000:1.0:1651529344.474018:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000be0ace91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996968256:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.474018:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+462:39029:x1731745946380992:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.474022:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006c1791d6/0x3234de053c5049f lrc: 3/0,1 mode: --/PW res: [0x2b501:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.474023:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177415 count 1 00010000:00010000:0.0:1651529344.474027:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c504c2 lrc: 3/0,1 mode: --/PW res: [0x2b507:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.474029:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005fb0ec6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996968320:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.474031:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a9690ad5/0x3234de053c4a65e lrc: 2/0,0 mode: PR/PR res: [0x2b507:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb9e expref: 1604 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.474032:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005480834d/0x3234de053c504a6 lrc: 3/0,1 mode: --/PW res: [0x2b502:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474035:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.474035:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.474036:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c504c2 lrc: 4/0,1 mode: --/PW res: [0x2b507:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.474038:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210967 00000100:00100000:1.0:1651529344.474040:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+462:39030:x1731745946380928:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.474042:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a9690ad5/0x3234de053c4a65e lrc: 3/0,0 mode: PR/PR res: [0x2b507:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb9e expref: 1604 pid: 151609 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.474045:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177414 count 1 00010000:00010000:0.0:1651529344.474045:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a9690ad5/0x3234de053c4a65e lrc: 4/0,0 mode: PR/PR res: [0x2b507:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb9e expref: 1604 pid: 151609 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.474049:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000046cb20e/0x3234de053c504c9 lrc: 3/0,1 mode: --/PW res: [0x2b506:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.474049:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996968576:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.474053:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eec9ee19/0x3234de053c4e8d0 lrc: 2/0,0 mode: PR/PR res: [0x2b506:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d53de expref: 1604 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.474056:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.474057:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.474058:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000046cb20e/0x3234de053c504c9 lrc: 4/0,1 mode: --/PW res: [0x2b506:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.474062:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 0000000009370c1d going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.474068:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210968 00000100:00100000:0.0:1651529344.474070:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a13808c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+462:39030:x1731745946381056:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.474071:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eec9ee19/0x3234de053c4e8d0 lrc: 3/0,0 mode: PR/PR res: [0x2b506:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d53de expref: 1604 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.474074:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177416 count 1 00010000:00010000:1.0:1651529344.474075:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eec9ee19/0x3234de053c4e8d0 lrc: 4/0,0 mode: PR/PR res: [0x2b506:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d53de expref: 1604 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.474078:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c504d0 lrc: 3/0,1 mode: --/PW res: [0x2b508:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.474079:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a223a622 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996968640:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.474082:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000034653e4c/0x3234de053c4e216 lrc: 2/0,0 mode: PR/PR res: [0x2b508:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d39ac expref: 1604 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.474087:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd96f074 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.474088:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.474089:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.474089:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c504d0 lrc: 4/0,1 mode: --/PW res: [0x2b508:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.474094:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396261376 00010000:00010000:0.0:1651529344.474095:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000034653e4c/0x3234de053c4e216 lrc: 3/0,0 mode: PR/PR res: [0x2b508:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d39ac expref: 1605 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.474098:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ac93cd8e/0x3234de053c4f6c9 lrc: 4/0,0 mode: PR/PR res: [0x2b501:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8dd6 expref: 1605 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.474099:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000034653e4c/0x3234de053c4e216 lrc: 4/0,0 mode: PR/PR res: [0x2b508:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d39ac expref: 1605 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.474102:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996968704:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.474106:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11743 00000100:00100000:1.0:1651529344.474107:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1605:41278:x1731746396261376:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.474109:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060852af0 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.474110:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.474111:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ac93cd8e/0x3234de053c4f6c9 lrc: 4/0,0 mode: PR/PR res: [0x2b501:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8dd6 expref: 1605 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.474115:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ac93cd8e/0x3234de053c4f6c9 lrc: 3/0,0 mode: PR/PR res: [0x2b501:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8dd6 expref: 1605 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.474120:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac93cd8e/0x3234de053c4f6c9 lrc: 0/0,0 mode: --/PR res: [0x2b501:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8dd6 expref: 1605 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.474126:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.474127:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.474128:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006c1791d6/0x3234de053c5049f lrc: 3/0,1 mode: PW/PW res: [0x2b501:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474130:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c1791d6/0x3234de053c5049f lrc: 4/0,1 mode: PW/PW res: [0x2b501:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474136:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.474142:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1604:41278:x1731746396261376:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 34us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.474145:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11743 00010000:00010000:1.0:1651529344.474150:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006c1791d6/0x3234de053c5049f lrc: 3/0,1 mode: PW/PW res: [0x2b501:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474153:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c1791d6/0x3234de053c5049f lrc: 3/0,1 mode: PW/PW res: [0x2b501:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474156:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c1791d6/0x3234de053c5049f lrc: 3/0,1 mode: PW/PW res: [0x2b501:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474159:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c1791d6/0x3234de053c5049f lrc: 2/0,0 mode: PW/PW res: [0x2b501:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474171:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c1791d6/0x3234de053c5049f lrc: 2/0,0 mode: PW/PW res: [0x2b501:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474175:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006c1791d6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.474176:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c1791d6/0x3234de053c5049f lrc: 2/0,0 mode: PW/PW res: [0x2b501:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474179:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c1791d6/0x3234de053c5049f lrc: 3/0,0 mode: PW/PW res: [0x2b501:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474184:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c1791d6/0x3234de053c5049f lrc: 1/0,0 mode: --/PW res: [0x2b501:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474189:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c1791d6/0x3234de053c5049f lrc: 0/0,0 mode: --/PW res: [0x2b501:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.474201:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+463:39030:x1731745946380352:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1057us (1181us total) trans 12885079016 rc 0/0 00000100:00100000:1.0:1651529344.474204:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210961 00000100:00100000:1.0:1651529344.474220:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.474269:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996968384:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.474274:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c504ad lrc: 3/0,1 mode: --/PW res: [0x2b504:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.474284:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.474312:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996968512:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.474315:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c504bb lrc: 3/0,1 mode: --/PW res: [0x2b505:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.474331:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000064719963 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996968448:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.474335:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001f3c2fb2/0x3234de053c504b4 lrc: 3/0,1 mode: --/PW res: [0x2b503:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.474343:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396261504 00010000:00010000:1.0:1651529344.474347:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000014323a57/0x3234de053c4e9ef lrc: 4/0,0 mode: PR/PR res: [0x2b502:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d594f expref: 1604 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.474358:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396261824 00010000:00010000:1.0:1651529344.474360:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b937ade1/0x3234de053c4b633 lrc: 4/0,0 mode: PR/PR res: [0x2b504:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc2f2 expref: 1605 pid: 80276 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.474368:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11744 00000100:00100000:1.0:1651529344.474370:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1605:41279:x1731746396261504:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.474373:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.474374:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000014323a57/0x3234de053c4e9ef lrc: 4/0,0 mode: PR/PR res: [0x2b502:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d594f expref: 1605 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.474383:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000014323a57/0x3234de053c4e9ef lrc: 3/0,0 mode: PR/PR res: [0x2b502:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d594f expref: 1605 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.474389:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014323a57/0x3234de053c4e9ef lrc: 0/0,0 mode: --/PR res: [0x2b502:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d594f expref: 1605 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.474391:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11745 00010000:00010000:1.0:1651529344.474393:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.474394:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.474394:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1604:41278:x1731746396261824:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.474395:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005480834d/0x3234de053c504a6 lrc: 3/0,1 mode: PW/PW res: [0x2b502:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474398:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005480834d/0x3234de053c504a6 lrc: 4/0,1 mode: PW/PW res: [0x2b502:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474398:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.474399:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b937ade1/0x3234de053c4b633 lrc: 4/0,0 mode: PR/PR res: [0x2b504:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc2f2 expref: 1604 pid: 80276 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.474403:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b937ade1/0x3234de053c4b633 lrc: 3/0,0 mode: PR/PR res: [0x2b504:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc2f2 expref: 1604 pid: 80276 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.474404:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.474409:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b937ade1/0x3234de053c4b633 lrc: 0/0,0 mode: --/PR res: [0x2b504:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc2f2 expref: 1604 pid: 80276 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.474411:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1604:41279:x1731746396261504:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.474413:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11744 00010000:00010000:0.0:1651529344.474413:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.474413:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.474414:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c504ad lrc: 3/0,1 mode: PW/PW res: [0x2b504:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474419:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005480834d/0x3234de053c504a6 lrc: 3/0,1 mode: PW/PW res: [0x2b502:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474422:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005480834d/0x3234de053c504a6 lrc: 3/0,1 mode: PW/PW res: [0x2b502:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474425:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005480834d/0x3234de053c504a6 lrc: 3/0,1 mode: PW/PW res: [0x2b502:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474427:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c504ad lrc: 4/0,1 mode: PW/PW res: [0x2b504:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474428:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005480834d/0x3234de053c504a6 lrc: 2/0,0 mode: PW/PW res: [0x2b502:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474452:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.474460:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1602:41278:x1731746396261824:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 65us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.474463:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11745 00000100:00100000:1.0:1651529344.474468:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+463:39030:x1731745946380416:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1266us (1393us total) trans 12885079017 rc 0/0 00000100:00100000:1.0:1651529344.474471:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210962 00010000:00010000:0.0:1651529344.474471:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005480834d/0x3234de053c504a6 lrc: 2/0,0 mode: PW/PW res: [0x2b502:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474474:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005480834d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.474475:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005480834d/0x3234de053c504a6 lrc: 2/0,0 mode: PW/PW res: [0x2b502:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474478:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005480834d/0x3234de053c504a6 lrc: 3/0,0 mode: PW/PW res: [0x2b502:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474482:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005480834d/0x3234de053c504a6 lrc: 1/0,0 mode: --/PW res: [0x2b502:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474484:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005480834d/0x3234de053c504a6 lrc: 0/0,0 mode: --/PW res: [0x2b502:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.474486:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.474490:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c504ad lrc: 3/0,1 mode: PW/PW res: [0x2b504:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474495:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c504ad lrc: 3/0,1 mode: PW/PW res: [0x2b504:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474498:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c504ad lrc: 3/0,1 mode: PW/PW res: [0x2b504:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.474500:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.474500:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c504ad lrc: 2/0,0 mode: PW/PW res: [0x2b504:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.474531:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.474548:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+463:39030:x1731745946380800:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 747us (800us total) trans 12885079018 rc 0/0 00000100:00100000:0.0:1651529344.474551:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210963 00000100:00100000:0.0:1651529344.474556:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946381120 00000100:00100000:0.0:1651529344.474566:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210969 00000100:00100000:0.0:1651529344.474568:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+463:39030:x1731745946381120:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.474586:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177417 count 1 00000100:00100000:1.0:1651529344.474605:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.474615:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c504d7 lrc: 3/0,1 mode: --/PW res: [0x2b509:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474620:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008f9d07bd/0x3234de053c4ed76 lrc: 2/0,0 mode: PR/PR res: [0x2b509:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6852 expref: 1601 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.474623:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.474624:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.474625:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c504d7 lrc: 4/0,1 mode: --/PW res: [0x2b509:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.474631:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.474634:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008f9d07bd/0x3234de053c4ed76 lrc: 3/0,0 mode: PR/PR res: [0x2b509:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6852 expref: 1601 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.474638:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.474638:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008f9d07bd/0x3234de053c4ed76 lrc: 4/0,0 mode: PR/PR res: [0x2b509:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6852 expref: 1601 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.474642:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996968768:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.474647:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a223a622 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996968640:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.474651:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000046cb20e/0x3234de053c504c9 lrc: 3/0,1 mode: --/PW res: [0x2b506:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.474656:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 000000003ad73843 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.474662:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c504ad lrc: 2/0,0 mode: PW/PW res: [0x2b504:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.474664:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396261888 00010000:00010000:0.0:1651529344.474665:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008531b741 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.474666:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c504ad lrc: 2/0,0 mode: PW/PW res: [0x2b504:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474669:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001dd400cf/0x3234de053c4abba lrc: 4/0,0 mode: PR/PR res: [0x2b505:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe30 expref: 1602 pid: 80278 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.474669:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c504ad lrc: 3/0,0 mode: PW/PW res: [0x2b504:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474673:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c504ad lrc: 1/0,0 mode: --/PW res: [0x2b504:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.474674:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396261952 00010000:00010000:1.0:1651529344.474676:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000a146a8b/0x3234de053c4d17d lrc: 4/0,0 mode: PR/PR res: [0x2b503:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf748 expref: 1603 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.474680:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396262080 00010000:00010000:1.0:1651529344.474682:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eec9ee19/0x3234de053c4e8d0 lrc: 4/0,0 mode: PR/PR res: [0x2b506:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d53de expref: 1604 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.474686:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396262016 00010000:00010000:0.0:1651529344.474687:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c504ad lrc: 0/0,0 mode: --/PW res: [0x2b504:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474688:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a9690ad5/0x3234de053c4a65e lrc: 5/0,0 mode: PR/PR res: [0x2b507:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb9e expref: 1605 pid: 151609 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.474691:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396262144 00010000:00010000:1.0:1651529344.474693:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000034653e4c/0x3234de053c4e216 lrc: 5/0,0 mode: PR/PR res: [0x2b508:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d39ac expref: 1606 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.474698:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11746 00000100:00100000:0.0:1651529344.474698:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996968576:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.474700:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1606:41279:x1731746396261888:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.474703:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.474704:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001dd400cf/0x3234de053c4abba lrc: 4/0,0 mode: PR/PR res: [0x2b505:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe30 expref: 1606 pid: 80278 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.474707:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001dd400cf/0x3234de053c4abba lrc: 3/0,0 mode: PR/PR res: [0x2b505:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe30 expref: 1606 pid: 80278 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.474713:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001dd400cf/0x3234de053c4abba lrc: 0/0,0 mode: --/PR res: [0x2b505:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe30 expref: 1606 pid: 80278 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.474713:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c504c2 lrc: 3/0,1 mode: --/PW res: [0x2b507:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474716:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.474717:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.474718:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c504bb lrc: 3/0,1 mode: PW/PW res: [0x2b505:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474721:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c504bb lrc: 4/0,1 mode: PW/PW res: [0x2b505:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.474722:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11747 00000100:00100000:0.0:1651529344.474724:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1605:41279:x1731746396261952:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.474727:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.474731:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.474743:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000a146a8b/0x3234de053c4d17d lrc: 4/0,0 mode: PR/PR res: [0x2b503:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf748 expref: 1605 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.474746:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1605:41279:x1731746396261888:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 45us (260us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.474747:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000a146a8b/0x3234de053c4d17d lrc: 3/0,0 mode: PR/PR res: [0x2b503:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf748 expref: 1605 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.474749:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11746 00010000:00010000:0.0:1651529344.474752:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a146a8b/0x3234de053c4d17d lrc: 0/0,0 mode: --/PR res: [0x2b503:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf748 expref: 1604 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.474754:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11748 00000100:00100000:1.0:1651529344.474755:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1603:41278:x1731746396262080:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.474756:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.474756:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.474757:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001f3c2fb2/0x3234de053c504b4 lrc: 3/0,1 mode: PW/PW res: [0x2b503:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474758:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.474759:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eec9ee19/0x3234de053c4e8d0 lrc: 4/0,0 mode: PR/PR res: [0x2b506:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d53de expref: 1603 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.474760:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f3c2fb2/0x3234de053c504b4 lrc: 4/0,1 mode: PW/PW res: [0x2b503:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474763:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eec9ee19/0x3234de053c4e8d0 lrc: 3/0,0 mode: PR/PR res: [0x2b506:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d53de expref: 1603 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.474769:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.474775:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eec9ee19/0x3234de053c4e8d0 lrc: 0/0,0 mode: --/PR res: [0x2b506:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d53de expref: 1603 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.474776:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1603:41279:x1731746396261952:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 52us (246us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.474778:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.474779:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.474779:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11747 00010000:00010000:1.0:1651529344.474780:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000046cb20e/0x3234de053c504c9 lrc: 3/0,1 mode: PW/PW res: [0x2b506:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474783:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000046cb20e/0x3234de053c504c9 lrc: 4/0,1 mode: PW/PW res: [0x2b506:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.474785:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11749 00000100:00100000:0.0:1651529344.474787:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d46d0fc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1601:41278:x1731746396262016:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.474789:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.474789:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.474791:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a9690ad5/0x3234de053c4a65e lrc: 4/0,0 mode: PR/PR res: [0x2b507:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb9e expref: 1601 pid: 151609 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.474794:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1601:41278:x1731746396262080:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 38us (189us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.474795:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a9690ad5/0x3234de053c4a65e lrc: 3/0,0 mode: PR/PR res: [0x2b507:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb9e expref: 1601 pid: 151609 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.474796:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11748 00010000:00010000:0.0:1651529344.474799:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9690ad5/0x3234de053c4a65e lrc: 0/0,0 mode: --/PR res: [0x2b507:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb9e expref: 1600 pid: 151609 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.474801:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11750 00000100:00100000:1.0:1651529344.474803:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1599:41278:x1731746396262144:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.474803:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.474803:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.474804:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c504c2 lrc: 3/0,1 mode: PW/PW res: [0x2b507:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474805:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.474806:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000034653e4c/0x3234de053c4e216 lrc: 5/0,0 mode: PR/PR res: [0x2b508:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d39ac expref: 1599 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.474807:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c504c2 lrc: 4/0,1 mode: PW/PW res: [0x2b507:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474810:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000034653e4c/0x3234de053c4e216 lrc: 4/0,0 mode: PR/PR res: [0x2b508:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d39ac expref: 1599 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.474813:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.474815:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.474815:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.474816:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c504d0 lrc: 3/0,1 mode: PW/PW res: [0x2b508:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.474818:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d46d0fc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1599:41278:x1731746396262016:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 31us (194us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.474819:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c504d0 lrc: 4/0,1 mode: PW/PW res: [0x2b508:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.474820:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11749 00010000:00010000:1.0:1651529344.474823:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.474827:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1598:41278:x1731746396262144:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 24us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.474829:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11750 00010000:00010000:0.0:1651529344.474830:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c504bb lrc: 3/0,1 mode: PW/PW res: [0x2b505:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474834:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c504bb lrc: 3/0,1 mode: PW/PW res: [0x2b505:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474835:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001f3c2fb2/0x3234de053c504b4 lrc: 3/0,1 mode: PW/PW res: [0x2b503:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474837:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c504bb lrc: 3/0,1 mode: PW/PW res: [0x2b505:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474838:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f3c2fb2/0x3234de053c504b4 lrc: 3/0,1 mode: PW/PW res: [0x2b503:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474840:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c504bb lrc: 2/0,0 mode: PW/PW res: [0x2b505:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474841:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f3c2fb2/0x3234de053c504b4 lrc: 3/0,1 mode: PW/PW res: [0x2b503:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474844:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f3c2fb2/0x3234de053c504b4 lrc: 2/0,0 mode: PW/PW res: [0x2b503:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.474884:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+465:39029:x1731745946380864:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 994us (1105us total) trans 12885079019 rc 0/0 00000100:00100000:1.0:1651529344.474887:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+465:39029:x1731745946380736:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1054us (1124us total) trans 12885079020 rc 0/0 00000100:00100000:0.0:1651529344.474887:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210965 00000100:00100000:1.0:1651529344.474890:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210964 00010000:00010000:0.0:1651529344.474894:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c504bb lrc: 2/0,0 mode: PW/PW res: [0x2b505:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474897:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000046cb20e/0x3234de053c504c9 lrc: 3/0,1 mode: PW/PW res: [0x2b506:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474897:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000011a71df9 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.474898:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c504bb lrc: 2/0,0 mode: PW/PW res: [0x2b505:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474901:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000046cb20e/0x3234de053c504c9 lrc: 3/0,1 mode: PW/PW res: [0x2b506:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474901:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c504bb lrc: 3/0,0 mode: PW/PW res: [0x2b505:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474904:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000046cb20e/0x3234de053c504c9 lrc: 3/0,1 mode: PW/PW res: [0x2b506:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474905:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c504bb lrc: 1/0,0 mode: --/PW res: [0x2b505:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.474906:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000046cb20e/0x3234de053c504c9 lrc: 2/0,0 mode: PW/PW res: [0x2b506:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474908:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c504bb lrc: 0/0,0 mode: --/PW res: [0x2b505:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474912:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f3c2fb2/0x3234de053c504b4 lrc: 2/0,0 mode: PW/PW res: [0x2b503:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474922:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001f3c2fb2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.474923:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f3c2fb2/0x3234de053c504b4 lrc: 2/0,0 mode: PW/PW res: [0x2b503:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474926:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f3c2fb2/0x3234de053c504b4 lrc: 3/0,0 mode: PW/PW res: [0x2b503:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474929:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f3c2fb2/0x3234de053c504b4 lrc: 1/0,0 mode: --/PW res: [0x2b503:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474932:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f3c2fb2/0x3234de053c504b4 lrc: 0/0,0 mode: --/PW res: [0x2b503:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474935:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000046cb20e/0x3234de053c504c9 lrc: 2/0,0 mode: PW/PW res: [0x2b506:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474938:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000046cb20e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.474939:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000046cb20e/0x3234de053c504c9 lrc: 2/0,0 mode: PW/PW res: [0x2b506:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474941:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000046cb20e/0x3234de053c504c9 lrc: 3/0,0 mode: PW/PW res: [0x2b506:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.474942:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+464:39030:x1731745946380928:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 901us (952us total) trans 12885079021 rc 0/0 00010000:00010000:0.0:1651529344.474944:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000046cb20e/0x3234de053c504c9 lrc: 1/0,0 mode: --/PW res: [0x2b506:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.474945:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210967 00010000:00010000:0.0:1651529344.474947:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000046cb20e/0x3234de053c504c9 lrc: 0/0,0 mode: --/PW res: [0x2b506:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474954:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c504c2 lrc: 3/0,1 mode: PW/PW res: [0x2b507:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474957:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c504c2 lrc: 3/0,1 mode: PW/PW res: [0x2b507:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474960:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c504c2 lrc: 3/0,1 mode: PW/PW res: [0x2b507:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.474963:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c504c2 lrc: 2/0,0 mode: PW/PW res: [0x2b507:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.474980:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.474996:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.474998:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+464:39029:x1731745946380992:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 979us (1024us total) trans 12885079022 rc 0/0 00000100:00100000:0.0:1651529344.475001:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210966 00000100:00100000:0.0:1651529344.475006:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946381376 00000100:00100000:0.0:1651529344.475016:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946381440 00000100:00100000:0.0:1651529344.475021:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210970 00000100:00100000:0.0:1651529344.475023:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+465:39030:x1731745946381376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.475028:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177418 count 1 00010000:00010000:0.0:1651529344.475032:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c504de lrc: 3/0,1 mode: --/PW res: [0x2b50a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475036:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a98a31f9/0x3234de053c4d5f9 lrc: 2/0,0 mode: PR/PR res: [0x2b50a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0985 expref: 1597 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.475042:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.475043:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.475043:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c504de lrc: 4/0,1 mode: --/PW res: [0x2b50a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475050:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a98a31f9/0x3234de053c4d5f9 lrc: 3/0,0 mode: PR/PR res: [0x2b50a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0985 expref: 1597 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.475053:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a98a31f9/0x3234de053c4d5f9 lrc: 4/0,0 mode: PR/PR res: [0x2b50a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0985 expref: 1597 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.475057:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996968832:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.475066:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 0000000009370c1d going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.475071:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c504c2 lrc: 2/0,0 mode: PW/PW res: [0x2b507:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475074:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000364b2cdc already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.475075:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c504c2 lrc: 2/0,0 mode: PW/PW res: [0x2b507:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.475092:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210971 00000100:00100000:1.0:1651529344.475094:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+465:39030:x1731745946381440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.475099:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177419 count 1 00010000:00010000:1.0:1651529344.475104:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002264598a/0x3234de053c504e5 lrc: 3/0,1 mode: --/PW res: [0x2b50b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475109:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c504c2 lrc: 3/0,0 mode: PW/PW res: [0x2b507:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475114:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c504c2 lrc: 1/0,0 mode: --/PW res: [0x2b507:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.475115:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000055d85425/0x3234de053c4da1a lrc: 2/0,0 mode: PR/PR res: [0x2b50b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d18f8 expref: 1597 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.475119:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.475119:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.475119:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c504c2 lrc: 0/0,0 mode: --/PW res: [0x2b507:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.475120:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002264598a/0x3234de053c504e5 lrc: 4/0,1 mode: --/PW res: [0x2b50b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.475127:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000055d85425/0x3234de053c4da1a lrc: 3/0,0 mode: PR/PR res: [0x2b50b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d18f8 expref: 1597 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.475131:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000055d85425/0x3234de053c4da1a lrc: 4/0,0 mode: PR/PR res: [0x2b50b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d18f8 expref: 1597 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.475135:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006647e4ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996968896:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.475144:0:156655:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034653e4c/0x3234de053c4e216 lrc: 0/0,0 mode: --/PR res: [0x2b508:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d39ac expref: 1597 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.475146:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a6b79b05 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.475148:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996968704:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.475151:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c504d0 lrc: 3/0,1 mode: PW/PW res: [0x2b508:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475155:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c504d0 lrc: 3/0,1 mode: PW/PW res: [0x2b508:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475157:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c504d0 lrc: 3/0,1 mode: PW/PW res: [0x2b508:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475160:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c504d0 lrc: 3/0,1 mode: PW/PW res: [0x2b508:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475163:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c504d0 lrc: 2/0,0 mode: PW/PW res: [0x2b508:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.475245:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.475250:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a13808c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+466:39030:x1731745946381056:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1178us (1251us total) trans 12885079023 rc 0/0 00000100:00100000:0.0:1651529344.475253:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210968 00000100:00100000:0.0:1651529344.475259:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946381824 00000100:00100000:0.0:1651529344.475280:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210972 00000100:00100000:1.0:1651529344.475282:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.475282:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+466:39030:x1731745946381824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.475292:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.475293:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177420 count 1 00010000:00010000:0.0:1651529344.475298:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc659cdc/0x3234de053c504ec lrc: 3/0,1 mode: --/PW res: [0x2b50c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.475299:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.475303:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c4d2cd lrc: 2/0,0 mode: PR/PR res: [0x2b50c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd29 expref: 1596 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.475306:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946381888 00010000:00010000:0.0:1651529344.475306:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.475306:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.475307:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc659cdc/0x3234de053c504ec lrc: 4/0,1 mode: --/PW res: [0x2b50c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.475313:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946381952 00010000:00010000:0.0:1651529344.475314:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c4d2cd lrc: 3/0,0 mode: PR/PR res: [0x2b50c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd29 expref: 1596 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.475316:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946382016 00010000:00010000:0.0:1651529344.475317:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c4d2cd lrc: 4/0,0 mode: PR/PR res: [0x2b50c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd29 expref: 1596 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.475322:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210973 00000100:00100000:1.0:1651529344.475324:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+469:39029:x1731745946381888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.475327:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996968960:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.475329:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177421 count 1 00010000:00010000:1.0:1651529344.475333:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b169871/0x3234de053c504f3 lrc: 3/0,1 mode: --/PW res: [0x2b50d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.475338:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000041b8eb55/0x3234de053c4cb1e lrc: 2/0,0 mode: PR/PR res: [0x2b50d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cddda expref: 1596 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.475341:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.475342:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.475343:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b169871/0x3234de053c504f3 lrc: 4/0,1 mode: --/PW res: [0x2b50d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.475356:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000041b8eb55/0x3234de053c4cb1e lrc: 3/0,0 mode: PR/PR res: [0x2b50d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cddda expref: 1596 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.475360:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000041b8eb55/0x3234de053c4cb1e lrc: 4/0,0 mode: PR/PR res: [0x2b50d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cddda expref: 1596 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.475360:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060852af0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.475364:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000095d7eb1a pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996969024:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.475368:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c504d0 lrc: 2/0,0 mode: PW/PW res: [0x2b508:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.475372:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 0000000089d75f07 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.475372:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c78576a1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.475373:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c504d0 lrc: 2/0,0 mode: PW/PW res: [0x2b508:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.475378:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210974 00000100:00100000:1.0:1651529344.475380:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+469:39030:x1731745946381952:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.475384:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177422 count 1 00010000:00010000:1.0:1651529344.475387:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c504fa lrc: 3/0,1 mode: --/PW res: [0x2b50e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475388:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c504d0 lrc: 3/0,0 mode: PW/PW res: [0x2b508:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.475392:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002aadba27/0x3234de053c4c9c7 lrc: 2/0,0 mode: PR/PR res: [0x2b50e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd92d expref: 1596 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.475393:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c504d0 lrc: 1/0,0 mode: --/PW res: [0x2b508:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.475395:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.475395:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.475396:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c504fa lrc: 4/0,1 mode: --/PW res: [0x2b50e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475396:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c504d0 lrc: 0/0,0 mode: --/PW res: [0x2b508:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.475402:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002aadba27/0x3234de053c4c9c7 lrc: 3/0,0 mode: PR/PR res: [0x2b50e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd92d expref: 1596 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.475405:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210975 00000100:00100000:0.0:1651529344.475407:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+469:39029:x1731745946382016:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.475408:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002aadba27/0x3234de053c4c9c7 lrc: 4/0,0 mode: PR/PR res: [0x2b50e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd92d expref: 1596 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.475411:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f39ca9ea pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996969088:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.475411:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177423 count 1 00010000:00010000:0.0:1651529344.475415:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021e675a0/0x3234de053c50501 lrc: 3/0,1 mode: --/PW res: [0x2b50f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.475417:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fe434b1c going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.475419:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000073f23091/0x3234de053c4f1ac lrc: 2/0,0 mode: PR/PR res: [0x2b50f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d798c expref: 1596 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.475422:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.475422:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.475423:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021e675a0/0x3234de053c50501 lrc: 4/0,1 mode: --/PW res: [0x2b50f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475429:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000073f23091/0x3234de053c4f1ac lrc: 3/0,0 mode: PR/PR res: [0x2b50f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d798c expref: 1596 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.475433:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000073f23091/0x3234de053c4f1ac lrc: 4/0,0 mode: PR/PR res: [0x2b50f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d798c expref: 1596 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.475437:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996969152:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.475446:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c0dff858 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.475464:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996968768:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.475468:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.475468:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c504d7 lrc: 3/0,1 mode: --/PW res: [0x2b509:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.475480:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946382080 00000100:00100000:0.0:1651529344.475494:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210976 00000100:00100000:0.0:1651529344.475496:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+470:39029:x1731745946382080:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.475500:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177424 count 1 00010000:00010000:0.0:1651529344.475504:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e801c8a/0x3234de053c50508 lrc: 3/0,1 mode: --/PW res: [0x2b510:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475508:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000098fbfd16/0x3234de053c4e4bd lrc: 2/0,0 mode: PR/PR res: [0x2b510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d442c expref: 1596 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.475511:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.475512:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.475512:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e801c8a/0x3234de053c50508 lrc: 4/0,1 mode: --/PW res: [0x2b510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.475513:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.475523:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.475524:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000098fbfd16/0x3234de053c4e4bd lrc: 3/0,0 mode: PR/PR res: [0x2b510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d442c expref: 1596 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.475528:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000098fbfd16/0x3234de053c4e4bd lrc: 4/0,0 mode: PR/PR res: [0x2b510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d442c expref: 1596 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.475532:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996969216:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.475537:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006647e4ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996968896:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.475541:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002264598a/0x3234de053c504e5 lrc: 3/0,1 mode: --/PW res: [0x2b50b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.475555:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396262400 00010000:00010000:1.0:1651529344.475560:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008f9d07bd/0x3234de053c4ed76 lrc: 4/0,0 mode: PR/PR res: [0x2b509:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6852 expref: 1597 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.475560:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000070e666f7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.475566:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396262464 00010000:00010000:1.0:1651529344.475568:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a98a31f9/0x3234de053c4d5f9 lrc: 4/0,0 mode: PR/PR res: [0x2b50a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0985 expref: 1598 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.475568:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996968832:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.475572:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c504de lrc: 3/0,1 mode: --/PW res: [0x2b50a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.475578:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11751 00000100:00100000:1.0:1651529344.475579:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1598:41279:x1731746396262400:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.475582:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.475583:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008f9d07bd/0x3234de053c4ed76 lrc: 4/0,0 mode: PR/PR res: [0x2b509:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6852 expref: 1598 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.475586:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11752 00010000:00010000:1.0:1651529344.475587:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008f9d07bd/0x3234de053c4ed76 lrc: 3/0,0 mode: PR/PR res: [0x2b509:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6852 expref: 1598 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.475588:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1598:41278:x1731746396262464:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.475591:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.475593:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f9d07bd/0x3234de053c4ed76 lrc: 0/0,0 mode: --/PR res: [0x2b509:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6852 expref: 1598 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.475593:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a98a31f9/0x3234de053c4d5f9 lrc: 4/0,0 mode: PR/PR res: [0x2b50a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0985 expref: 1598 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.475596:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a98a31f9/0x3234de053c4d5f9 lrc: 3/0,0 mode: PR/PR res: [0x2b50a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0985 expref: 1597 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.475597:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.475597:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.475598:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c504d7 lrc: 3/0,1 mode: PW/PW res: [0x2b509:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.475601:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c504d7 lrc: 4/0,1 mode: PW/PW res: [0x2b509:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475602:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a98a31f9/0x3234de053c4d5f9 lrc: 0/0,0 mode: --/PR res: [0x2b50a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0985 expref: 1597 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.475606:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.475606:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.475607:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c504de lrc: 3/0,1 mode: PW/PW res: [0x2b50a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.475609:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.475616:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1596:41279:x1731746396262400:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (103us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.475616:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c504de lrc: 4/0,1 mode: PW/PW res: [0x2b50a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.475618:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11751 00010000:00010000:0.0:1651529344.475622:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.475629:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1595:41278:x1731746396262464:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 41us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.475632:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11752 00000100:00100000:1.0:1651529344.475634:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.475639:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396262528 00010000:00010000:0.0:1651529344.475642:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000055d85425/0x3234de053c4da1a lrc: 4/0,0 mode: PR/PR res: [0x2b50b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d18f8 expref: 1595 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.475653:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11753 00000100:00100000:0.0:1651529344.475655:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1595:41279:x1731746396262528:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.475658:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.475659:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000055d85425/0x3234de053c4da1a lrc: 4/0,0 mode: PR/PR res: [0x2b50b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d18f8 expref: 1595 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.475663:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000055d85425/0x3234de053c4da1a lrc: 3/0,0 mode: PR/PR res: [0x2b50b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d18f8 expref: 1595 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.475667:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055d85425/0x3234de053c4da1a lrc: 0/0,0 mode: --/PR res: [0x2b50b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d18f8 expref: 1595 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.475671:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.475671:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.475672:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002264598a/0x3234de053c504e5 lrc: 3/0,1 mode: PW/PW res: [0x2b50b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475675:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002264598a/0x3234de053c504e5 lrc: 4/0,1 mode: PW/PW res: [0x2b50b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475683:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.475686:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002264598a/0x3234de053c504e5 lrc: 3/0,1 mode: PW/PW res: [0x2b50b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.475692:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1594:41279:x1731746396262528:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 36us (58us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.475694:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11753 00010000:00010000:1.0:1651529344.475695:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002264598a/0x3234de053c504e5 lrc: 3/0,1 mode: PW/PW res: [0x2b50b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.475698:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002264598a/0x3234de053c504e5 lrc: 3/0,1 mode: PW/PW res: [0x2b50b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475700:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c504de lrc: 3/0,1 mode: PW/PW res: [0x2b50a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.475702:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002264598a/0x3234de053c504e5 lrc: 2/0,0 mode: PW/PW res: [0x2b50b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475704:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c504de lrc: 3/0,1 mode: PW/PW res: [0x2b50a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475707:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c504de lrc: 3/0,1 mode: PW/PW res: [0x2b50a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475715:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c504de lrc: 2/0,0 mode: PW/PW res: [0x2b50a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.475757:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+472:39030:x1731745946381440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 662us (761us total) trans 12885079024 rc 0/0 00000100:00100000:1.0:1651529344.475760:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210971 00000100:00100000:0.0:1651529344.475765:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+471:39030:x1731745946381376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 741us (784us total) trans 12885079025 rc 0/0 00000100:00100000:0.0:1651529344.475768:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210970 00010000:00010000:0.0:1651529344.475776:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002264598a/0x3234de053c504e5 lrc: 2/0,0 mode: PW/PW res: [0x2b50b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475779:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002264598a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.475780:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002264598a/0x3234de053c504e5 lrc: 2/0,0 mode: PW/PW res: [0x2b50b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475785:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002264598a/0x3234de053c504e5 lrc: 3/0,0 mode: PW/PW res: [0x2b50b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475790:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002264598a/0x3234de053c504e5 lrc: 1/0,0 mode: --/PW res: [0x2b50b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475793:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002264598a/0x3234de053c504e5 lrc: 0/0,0 mode: --/PW res: [0x2b50b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475797:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c504de lrc: 2/0,0 mode: PW/PW res: [0x2b50a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475799:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ce532454 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.475800:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c504de lrc: 2/0,0 mode: PW/PW res: [0x2b50a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475803:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c504de lrc: 3/0,0 mode: PW/PW res: [0x2b50a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475806:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c504de lrc: 1/0,0 mode: --/PW res: [0x2b50a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475809:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c504de lrc: 0/0,0 mode: --/PW res: [0x2b50a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475814:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c504d7 lrc: 3/0,1 mode: PW/PW res: [0x2b509:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475820:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c504d7 lrc: 3/0,1 mode: PW/PW res: [0x2b509:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475823:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c504d7 lrc: 3/0,1 mode: PW/PW res: [0x2b509:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475825:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c504d7 lrc: 2/0,0 mode: PW/PW res: [0x2b509:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.475863:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+471:39030:x1731745946381120:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1294us (1363us total) trans 12885079026 rc 0/0 00000100:00100000:0.0:1651529344.475866:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210969 00010000:00010000:0.0:1651529344.475873:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c504d7 lrc: 2/0,0 mode: PW/PW res: [0x2b509:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475903:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000cfc1a54 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.475904:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c504d7 lrc: 2/0,0 mode: PW/PW res: [0x2b509:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475907:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c504d7 lrc: 3/0,0 mode: PW/PW res: [0x2b509:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475923:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c504d7 lrc: 1/0,0 mode: --/PW res: [0x2b509:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475926:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c504d7 lrc: 0/0,0 mode: --/PW res: [0x2b509:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.475943:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.475951:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.475951:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996969152:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.475955:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000021e675a0/0x3234de053c50501 lrc: 3/0,1 mode: --/PW res: [0x2b50f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.475958:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.475962:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396262784 00010000:00010000:0.0:1651529344.475966:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000041b8eb55/0x3234de053c4cb1e lrc: 5/0,0 mode: PR/PR res: [0x2b50d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cddda expref: 1594 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.475969:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000095d7eb1a pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996969024:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.475972:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396262912 00010000:00010000:1.0:1651529344.475974:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000b169871/0x3234de053c504f3 lrc: 3/0,1 mode: --/PW res: [0x2b50d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.475974:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c4d2cd lrc: 5/0,0 mode: PR/PR res: [0x2b50c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd29 expref: 1595 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.475978:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396262976 00010000:00010000:0.0:1651529344.475980:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002aadba27/0x3234de053c4c9c7 lrc: 5/0,0 mode: PR/PR res: [0x2b50e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd92d expref: 1596 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.475981:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f39ca9ea pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996969088:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.475983:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c504fa lrc: 3/0,1 mode: --/PW res: [0x2b50e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.475984:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11754 00000100:00100000:0.0:1651529344.475986:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1596:41279:x1731746396262784:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.475989:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.475990:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11755 00010000:00010000:0.0:1651529344.475990:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000041b8eb55/0x3234de053c4cb1e lrc: 4/0,0 mode: PR/PR res: [0x2b50d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cddda expref: 1596 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.475992:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1596:41279:x1731746396262912:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.475993:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000041b8eb55/0x3234de053c4cb1e lrc: 3/0,0 mode: PR/PR res: [0x2b50d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cddda expref: 1596 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.475995:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.475997:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c4d2cd lrc: 5/0,0 mode: PR/PR res: [0x2b50c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd29 expref: 1596 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.476000:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c4d2cd lrc: 4/0,0 mode: PR/PR res: [0x2b50c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd29 expref: 1596 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.476006:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.476007:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.476008:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bc659cdc/0x3234de053c504ec lrc: 3/0,1 mode: PW/PW res: [0x2b50c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.476017:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc659cdc/0x3234de053c504ec lrc: 4/0,1 mode: PW/PW res: [0x2b50c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476019:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041b8eb55/0x3234de053c4cb1e lrc: 0/0,0 mode: --/PR res: [0x2b50d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cddda expref: 1596 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.476022:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.476035:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.476036:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.476037:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1595:41279:x1731746396262912:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 45us (86us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.476037:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000b169871/0x3234de053c504f3 lrc: 3/0,1 mode: PW/PW res: [0x2b50d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.476040:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11755 00010000:00010000:0.0:1651529344.476040:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b169871/0x3234de053c504f3 lrc: 4/0,1 mode: PW/PW res: [0x2b50d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.476045:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11756 00010000:00010000:0.0:1651529344.476048:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.476052:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1fb0a67 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1594:41278:x1731746396262976:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.476054:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.476056:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002aadba27/0x3234de053c4c9c7 lrc: 4/0,0 mode: PR/PR res: [0x2b50e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd92d expref: 1594 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.476060:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002aadba27/0x3234de053c4c9c7 lrc: 3/0,0 mode: PR/PR res: [0x2b50e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd92d expref: 1594 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.476064:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002aadba27/0x3234de053c4c9c7 lrc: 0/0,0 mode: --/PR res: [0x2b50e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd92d expref: 1594 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.476064:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1594:41279:x1731746396262784:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 77us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.476067:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11754 00010000:00010000:1.0:1651529344.476068:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.476068:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.476069:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c504fa lrc: 3/0,1 mode: PW/PW res: [0x2b50e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.476072:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c504fa lrc: 4/0,1 mode: PW/PW res: [0x2b50e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.476078:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.476083:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1fb0a67 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1592:41278:x1731746396262976:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.476086:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11756 00010000:00010000:0.0:1651529344.476089:0:156655:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c4d2cd lrc: 0/0,0 mode: --/PR res: [0x2b50c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd29 expref: 1591 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.476093:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996968960:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.476095:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c504fa lrc: 3/0,1 mode: PW/PW res: [0x2b50e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476096:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bc659cdc/0x3234de053c504ec lrc: 3/0,1 mode: PW/PW res: [0x2b50c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.476099:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c504fa lrc: 3/0,1 mode: PW/PW res: [0x2b50e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476100:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bc659cdc/0x3234de053c504ec lrc: 3/0,1 mode: PW/PW res: [0x2b50c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.476102:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c504fa lrc: 3/0,1 mode: PW/PW res: [0x2b50e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476102:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc659cdc/0x3234de053c504ec lrc: 3/0,1 mode: PW/PW res: [0x2b50c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.476104:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c504fa lrc: 2/0,0 mode: PW/PW res: [0x2b50e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476106:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc659cdc/0x3234de053c504ec lrc: 3/0,1 mode: PW/PW res: [0x2b50c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476109:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc659cdc/0x3234de053c504ec lrc: 2/0,0 mode: PW/PW res: [0x2b50c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.476147:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+472:39030:x1731745946381952:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 766us (855us total) trans 12885079027 rc 0/0 00000100:00100000:1.0:1651529344.476150:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210974 00000100:00100000:0.0:1651529344.476153:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+471:39030:x1731745946381824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 870us (908us total) trans 12885079028 rc 0/0 00010000:00010000:1.0:1651529344.476156:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000b169871/0x3234de053c504f3 lrc: 3/0,1 mode: PW/PW res: [0x2b50d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.476156:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210972 00010000:00010000:1.0:1651529344.476160:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b169871/0x3234de053c504f3 lrc: 3/0,1 mode: PW/PW res: [0x2b50d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.476163:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b169871/0x3234de053c504f3 lrc: 3/0,1 mode: PW/PW res: [0x2b50d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476163:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c504fa lrc: 2/0,0 mode: PW/PW res: [0x2b50e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.476166:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b169871/0x3234de053c504f3 lrc: 2/0,0 mode: PW/PW res: [0x2b50d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476166:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ee8bd35b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.476167:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c504fa lrc: 2/0,0 mode: PW/PW res: [0x2b50e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476170:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c504fa lrc: 3/0,0 mode: PW/PW res: [0x2b50e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476183:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c504fa lrc: 1/0,0 mode: --/PW res: [0x2b50e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476186:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c504fa lrc: 0/0,0 mode: --/PW res: [0x2b50e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476190:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc659cdc/0x3234de053c504ec lrc: 2/0,0 mode: PW/PW res: [0x2b50c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476193:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bc659cdc already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.476194:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc659cdc/0x3234de053c504ec lrc: 2/0,0 mode: PW/PW res: [0x2b50c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476196:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc659cdc/0x3234de053c504ec lrc: 3/0,0 mode: PW/PW res: [0x2b50c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476199:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc659cdc/0x3234de053c504ec lrc: 1/0,0 mode: --/PW res: [0x2b50c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476202:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc659cdc/0x3234de053c504ec lrc: 0/0,0 mode: --/PW res: [0x2b50c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.476204:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+471:39029:x1731745946381888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 879us (922us total) trans 12885079029 rc 0/0 00010000:00010000:0.0:1651529344.476205:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b169871/0x3234de053c504f3 lrc: 2/0,0 mode: PW/PW res: [0x2b50d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.476207:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210973 00010000:00010000:0.0:1651529344.476208:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000b169871 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.476208:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b169871/0x3234de053c504f3 lrc: 2/0,0 mode: PW/PW res: [0x2b50d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476211:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b169871/0x3234de053c504f3 lrc: 3/0,0 mode: PW/PW res: [0x2b50d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476214:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b169871/0x3234de053c504f3 lrc: 1/0,0 mode: --/PW res: [0x2b50d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476217:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b169871/0x3234de053c504f3 lrc: 0/0,0 mode: --/PW res: [0x2b50d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.476256:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.476269:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.476279:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.476289:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946382144 00000100:00100000:0.0:1651529344.476302:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946382272 00000100:00100000:0.0:1651529344.476307:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210977 00000100:00100000:0.0:1651529344.476308:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+472:39030:x1731745946382144:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.476309:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.476319:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177425 count 1 00010000:00010000:0.0:1651529344.476323:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c5050f lrc: 3/0,1 mode: --/PW res: [0x2b511:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476328:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c4f5fe lrc: 2/0,0 mode: PR/PR res: [0x2b511:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a72 expref: 1590 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.476331:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.476332:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.476333:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c5050f lrc: 4/0,1 mode: --/PW res: [0x2b511:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476339:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c4f5fe lrc: 3/0,0 mode: PR/PR res: [0x2b511:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a72 expref: 1590 pid: 156655 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.476340:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.476343:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c4f5fe lrc: 4/0,0 mode: PR/PR res: [0x2b511:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a72 expref: 1590 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.476347:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996969280:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.476356:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c0dff858 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.476363:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996969216:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.476367:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001e801c8a/0x3234de053c50508 lrc: 3/0,1 mode: --/PW res: [0x2b510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.476373:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946382464 00000100:00100000:0.0:1651529344.476384:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210978 00000100:00100000:0.0:1651529344.476386:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+473:39029:x1731745946382272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.476391:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177426 count 1 00000100:00100000:1.0:1651529344.476394:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210979 00010000:00010000:0.0:1651529344.476394:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50516 lrc: 3/0,1 mode: --/PW res: [0x2b512:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.476397:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+473:39029:x1731745946382464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.476398:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f8e988a0/0x3234de053c4c99d lrc: 2/0,0 mode: PR/PR res: [0x2b512:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd84d expref: 1590 pid: 72396 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.476403:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177427 count 1 00010000:00010000:1.0:1651529344.476407:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008619c536/0x3234de053c5051d lrc: 3/0,1 mode: --/PW res: [0x2b513:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.476412:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005b4b4ce3/0x3234de053c4d272 lrc: 2/0,0 mode: PR/PR res: [0x2b513:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb31 expref: 1590 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.476415:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.476416:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.476416:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008619c536/0x3234de053c5051d lrc: 4/0,1 mode: --/PW res: [0x2b513:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476417:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.476417:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.476418:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50516 lrc: 4/0,1 mode: --/PW res: [0x2b512:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.476424:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005b4b4ce3/0x3234de053c4d272 lrc: 3/0,0 mode: PR/PR res: [0x2b513:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb31 expref: 1590 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.476426:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f8e988a0/0x3234de053c4c99d lrc: 3/0,0 mode: PR/PR res: [0x2b512:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd84d expref: 1590 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.476428:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005b4b4ce3/0x3234de053c4d272 lrc: 4/0,0 mode: PR/PR res: [0x2b513:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb31 expref: 1590 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.476429:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f8e988a0/0x3234de053c4c99d lrc: 4/0,0 mode: PR/PR res: [0x2b512:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd84d expref: 1590 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.476432:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a138afb6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996969344:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.476433:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996969408:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.476443:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f79d8146 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.476449:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396263040 00010000:00010000:1.0:1651529344.476454:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000073f23091/0x3234de053c4f1ac lrc: 4/0,0 mode: PR/PR res: [0x2b50f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d798c expref: 1591 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.476466:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396263168 00010000:00010000:1.0:1651529344.476469:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000098fbfd16/0x3234de053c4e4bd lrc: 4/0,0 mode: PR/PR res: [0x2b510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d442c expref: 1592 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.476472:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 0000000009370c1d going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.476476:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11757 00000100:00100000:1.0:1651529344.476478:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1592:41279:x1731746396263040:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.476481:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.476482:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000073f23091/0x3234de053c4f1ac lrc: 4/0,0 mode: PR/PR res: [0x2b50f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d798c expref: 1592 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.476484:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11758 00010000:00010000:1.0:1651529344.476486:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000073f23091/0x3234de053c4f1ac lrc: 3/0,0 mode: PR/PR res: [0x2b50f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d798c expref: 1592 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.476486:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1592:41279:x1731746396263168:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.476490:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.476492:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000098fbfd16/0x3234de053c4e4bd lrc: 4/0,0 mode: PR/PR res: [0x2b510:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d442c expref: 1592 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.476494:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073f23091/0x3234de053c4f1ac lrc: 0/0,0 mode: --/PR res: [0x2b50f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d798c expref: 1592 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.476496:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000098fbfd16/0x3234de053c4e4bd lrc: 3/0,0 mode: PR/PR res: [0x2b510:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d442c expref: 1592 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.476498:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.476498:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.476499:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000021e675a0/0x3234de053c50501 lrc: 3/0,1 mode: PW/PW res: [0x2b50f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.476502:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021e675a0/0x3234de053c50501 lrc: 4/0,1 mode: PW/PW res: [0x2b50f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476502:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098fbfd16/0x3234de053c4e4bd lrc: 0/0,0 mode: --/PR res: [0x2b510:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d442c expref: 1591 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.476506:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.476506:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.476507:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001e801c8a/0x3234de053c50508 lrc: 3/0,1 mode: PW/PW res: [0x2b510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.476510:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.476517:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1590:41279:x1731746396263040:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.476519:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11757 00010000:00010000:0.0:1651529344.476529:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e801c8a/0x3234de053c50508 lrc: 4/0,1 mode: PW/PW res: [0x2b510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.476534:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.476549:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.476556:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1589:41279:x1731746396263168:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 70us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.476559:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11758 00010000:00010000:0.0:1651529344.476567:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000021e675a0/0x3234de053c50501 lrc: 3/0,1 mode: PW/PW res: [0x2b50f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.476570:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.476570:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021e675a0/0x3234de053c50501 lrc: 3/0,1 mode: PW/PW res: [0x2b50f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476575:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021e675a0/0x3234de053c50501 lrc: 3/0,1 mode: PW/PW res: [0x2b50f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476578:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021e675a0/0x3234de053c50501 lrc: 2/0,0 mode: PW/PW res: [0x2b50f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.476584:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.476612:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946382784 00000100:00100000:0.0:1651529344.476622:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+475:39029:x1731745946382016:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1215us (1322us total) trans 12885079030 rc 0/0 00000100:00100000:1.0:1651529344.476624:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946382848 00000100:00100000:0.0:1651529344.476625:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210975 00000100:00100000:1.0:1651529344.476628:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946382912 00000100:00100000:0.0:1651529344.476631:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210980 00000100:00100000:0.0:1651529344.476632:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+476:39029:x1731745946382784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.476633:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210981 00000100:00100000:1.0:1651529344.476634:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+476:39030:x1731745946382848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.476637:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177428 count 1 00002000:00080000:1.0:1651529344.476639:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177429 count 1 00010000:00010000:0.0:1651529344.476641:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066ae2b40/0x3234de053c50524 lrc: 3/0,1 mode: --/PW res: [0x2b514:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.476644:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8e8757f/0x3234de053c5052b lrc: 3/0,1 mode: --/PW res: [0x2b515:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476645:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001947a788/0x3234de053c4bca7 lrc: 2/0,0 mode: PR/PR res: [0x2b514:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5ed expref: 1588 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.476648:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.476649:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.476650:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066ae2b40/0x3234de053c50524 lrc: 4/0,1 mode: --/PW res: [0x2b514:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.476651:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001b6ece5d/0x3234de053c4d7d5 lrc: 2/0,0 mode: PR/PR res: [0x2b515:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d10b6 expref: 1588 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.476654:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.476655:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.476656:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8e8757f/0x3234de053c5052b lrc: 4/0,1 mode: --/PW res: [0x2b515:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476656:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001947a788/0x3234de053c4bca7 lrc: 3/0,0 mode: PR/PR res: [0x2b514:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5ed expref: 1588 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.476662:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001b6ece5d/0x3234de053c4d7d5 lrc: 3/0,0 mode: PR/PR res: [0x2b515:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d10b6 expref: 1588 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.476662:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001947a788/0x3234de053c4bca7 lrc: 4/0,0 mode: PR/PR res: [0x2b514:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5ed expref: 1588 pid: 80276 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.476665:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001b6ece5d/0x3234de053c4d7d5 lrc: 4/0,0 mode: PR/PR res: [0x2b515:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d10b6 expref: 1588 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.476670:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000095d7eb1a pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996969536:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.476678:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a5495eb going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.476681:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996969472:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.476684:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210982 00000100:00100000:1.0:1651529344.476686:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+476:39030:x1731745946382912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.476690:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177430 count 1 00000100:00100000:0.0:1651529344.476691:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000000e7e66c4 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.476693:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4eab03b/0x3234de053c50532 lrc: 3/0,1 mode: --/PW res: [0x2b516:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476696:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021e675a0/0x3234de053c50501 lrc: 2/0,0 mode: PW/PW res: [0x2b50f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.476697:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000003eeafce/0x3234de053c4d5dd lrc: 2/0,0 mode: PR/PR res: [0x2b516:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d08eb expref: 1588 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.476699:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000021e675a0 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.476700:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.476701:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.476701:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4eab03b/0x3234de053c50532 lrc: 4/0,1 mode: --/PW res: [0x2b516:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476701:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021e675a0/0x3234de053c50501 lrc: 2/0,0 mode: PW/PW res: [0x2b50f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476703:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021e675a0/0x3234de053c50501 lrc: 3/0,0 mode: PW/PW res: [0x2b50f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.476707:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000003eeafce/0x3234de053c4d5dd lrc: 3/0,0 mode: PR/PR res: [0x2b516:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d08eb expref: 1588 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.476708:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021e675a0/0x3234de053c50501 lrc: 1/0,0 mode: --/PW res: [0x2b50f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.476710:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000003eeafce/0x3234de053c4d5dd lrc: 4/0,0 mode: PR/PR res: [0x2b516:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d08eb expref: 1588 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.476711:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021e675a0/0x3234de053c50501 lrc: 0/0,0 mode: --/PW res: [0x2b50f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.476714:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006647e4ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996969600:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.476716:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001e801c8a/0x3234de053c50508 lrc: 3/0,1 mode: PW/PW res: [0x2b510:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476719:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e801c8a/0x3234de053c50508 lrc: 3/0,1 mode: PW/PW res: [0x2b510:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.476720:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c3caa148 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.476725:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e801c8a/0x3234de053c50508 lrc: 3/0,1 mode: PW/PW res: [0x2b510:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476727:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e801c8a/0x3234de053c50508 lrc: 2/0,0 mode: PW/PW res: [0x2b510:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.476776:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+477:39029:x1731745946382080:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1279us (1308us total) trans 12885079031 rc 0/0 00000100:00100000:0.0:1651529344.476779:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210976 00010000:00010000:0.0:1651529344.476786:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e801c8a/0x3234de053c50508 lrc: 2/0,0 mode: PW/PW res: [0x2b510:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476789:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e801c8a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.476790:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e801c8a/0x3234de053c50508 lrc: 2/0,0 mode: PW/PW res: [0x2b510:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476793:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e801c8a/0x3234de053c50508 lrc: 3/0,0 mode: PW/PW res: [0x2b510:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476797:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e801c8a/0x3234de053c50508 lrc: 1/0,0 mode: --/PW res: [0x2b510:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476800:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e801c8a/0x3234de053c50508 lrc: 0/0,0 mode: --/PW res: [0x2b510:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.476909:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.476911:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996969280:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.476921:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c5050f lrc: 3/0,1 mode: --/PW res: [0x2b511:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.476928:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946383040 00000100:00100000:0.0:1651529344.476935:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210983 00000100:00100000:0.0:1651529344.476937:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+477:39030:x1731745946383040:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.476941:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.476942:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177431 count 1 00010000:00010000:0.0:1651529344.476945:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dd9e9df/0x3234de053c50539 lrc: 3/0,1 mode: --/PW res: [0x2b517:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.476956:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.476956:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e70ce874/0x3234de053c4e382 lrc: 2/0,0 mode: PR/PR res: [0x2b517:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f01 expref: 1588 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.476963:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.476964:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.476964:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.476965:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dd9e9df/0x3234de053c50539 lrc: 4/0,1 mode: --/PW res: [0x2b517:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.476972:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.476990:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a138afb6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996969344:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.476994:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e70ce874/0x3234de053c4e382 lrc: 3/0,0 mode: PR/PR res: [0x2b517:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f01 expref: 1588 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.476995:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008619c536/0x3234de053c5051d lrc: 3/0,1 mode: --/PW res: [0x2b513:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.476998:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e70ce874/0x3234de053c4e382 lrc: 4/0,0 mode: PR/PR res: [0x2b517:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f01 expref: 1588 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.477002:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996969664:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.477003:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000095d7eb1a pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996969536:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.477005:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a8e8757f/0x3234de053c5052b lrc: 3/0,1 mode: --/PW res: [0x2b515:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.477011:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396263488 00000100:00100000:0.0:1651529344.477011:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 000000003ad73843 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.477016:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005b4b4ce3/0x3234de053c4d272 lrc: 4/0,0 mode: PR/PR res: [0x2b513:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb31 expref: 1589 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.477017:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946383104 00000100:00100000:1.0:1651529344.477022:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396263424 00010000:00010000:1.0:1651529344.477024:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c4f5fe lrc: 4/0,0 mode: PR/PR res: [0x2b511:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a72 expref: 1590 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.477028:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396263552 00010000:00010000:1.0:1651529344.477030:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f8e988a0/0x3234de053c4c99d lrc: 5/0,0 mode: PR/PR res: [0x2b512:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd84d expref: 1591 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.477040:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210984 00000100:00100000:1.0:1651529344.477041:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11759 00000100:00100000:0.0:1651529344.477041:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000123250a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+478:39030:x1731745946383104:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.477043:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1591:41278:x1731746396263488:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.477046:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00080000:0.0:1651529344.477046:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177432 count 1 00010000:00010000:1.0:1651529344.477047:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005b4b4ce3/0x3234de053c4d272 lrc: 4/0,0 mode: PR/PR res: [0x2b513:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb31 expref: 1591 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.477050:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000186a4198/0x3234de053c50540 lrc: 3/0,1 mode: --/PW res: [0x2b518:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.477051:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005b4b4ce3/0x3234de053c4d272 lrc: 3/0,0 mode: PR/PR res: [0x2b513:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb31 expref: 1591 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.477054:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000011a57b01/0x3234de053c4cce5 lrc: 2/0,0 mode: PR/PR res: [0x2b518:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce5ac expref: 1591 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.477056:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b4b4ce3/0x3234de053c4d272 lrc: 0/0,0 mode: --/PR res: [0x2b513:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb31 expref: 1591 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.477058:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.477058:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.477059:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000186a4198/0x3234de053c50540 lrc: 4/0,1 mode: --/PW res: [0x2b518:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.477060:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.477060:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.477061:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008619c536/0x3234de053c5051d lrc: 3/0,1 mode: PW/PW res: [0x2b513:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.477064:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008619c536/0x3234de053c5051d lrc: 4/0,1 mode: PW/PW res: [0x2b513:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477065:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000011a57b01/0x3234de053c4cce5 lrc: 3/0,0 mode: PR/PR res: [0x2b518:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce5ac expref: 1590 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.477069:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000011a57b01/0x3234de053c4cce5 lrc: 4/0,0 mode: PR/PR res: [0x2b518:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce5ac expref: 1590 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.477071:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.477073:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996969728:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.477077:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1590:41278:x1731746396263488:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.477080:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11759 00000100:00100000:0.0:1651529344.477081:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aac87b31 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.477085:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11760 00000100:00100000:1.0:1651529344.477086:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1589:41278:x1731746396263424:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.477088:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996969408:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.477089:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.477090:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c4f5fe lrc: 4/0,0 mode: PR/PR res: [0x2b511:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a72 expref: 1589 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.477092:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50516 lrc: 3/0,1 mode: --/PW res: [0x2b512:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.477094:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c4f5fe lrc: 3/0,0 mode: PR/PR res: [0x2b511:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a72 expref: 1589 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.477098:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c4f5fe lrc: 0/0,0 mode: --/PR res: [0x2b511:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a72 expref: 1589 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.477101:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.477102:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.477102:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c5050f lrc: 3/0,1 mode: PW/PW res: [0x2b511:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.477105:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c5050f lrc: 4/0,1 mode: PW/PW res: [0x2b511:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.477115:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.477119:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11761 00000100:00100000:1.0:1651529344.477120:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1588:41278:x1731746396263424:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 33us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.477122:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1588:41278:x1731746396263552:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.477123:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11760 00010000:00010000:0.0:1651529344.477125:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.477127:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f8e988a0/0x3234de053c4c99d lrc: 4/0,0 mode: PR/PR res: [0x2b512:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd84d expref: 1587 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.477130:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008619c536/0x3234de053c5051d lrc: 3/0,1 mode: PW/PW res: [0x2b513:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477131:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f8e988a0/0x3234de053c4c99d lrc: 3/0,0 mode: PR/PR res: [0x2b512:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd84d expref: 1587 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.477133:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008619c536/0x3234de053c5051d lrc: 3/0,1 mode: PW/PW res: [0x2b513:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.477136:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008619c536/0x3234de053c5051d lrc: 3/0,1 mode: PW/PW res: [0x2b513:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477136:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8e988a0/0x3234de053c4c99d lrc: 0/0,0 mode: --/PR res: [0x2b512:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd84d expref: 1587 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.477139:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008619c536/0x3234de053c5051d lrc: 2/0,0 mode: PW/PW res: [0x2b513:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477140:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.477140:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.477141:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50516 lrc: 3/0,1 mode: PW/PW res: [0x2b512:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477144:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50516 lrc: 4/0,1 mode: PW/PW res: [0x2b512:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477156:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.477162:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1586:41278:x1731746396263552:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.477165:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11761 00010000:00010000:0.0:1651529344.477173:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008619c536/0x3234de053c5051d lrc: 2/0,0 mode: PW/PW res: [0x2b513:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477176:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008619c536 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.477177:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008619c536/0x3234de053c5051d lrc: 2/0,0 mode: PW/PW res: [0x2b513:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477180:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008619c536/0x3234de053c5051d lrc: 3/0,0 mode: PW/PW res: [0x2b513:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.477181:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+479:39029:x1731745946382464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 784us (872us total) trans 12885079032 rc 0/0 00000100:00100000:1.0:1651529344.477184:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210979 00010000:00010000:0.0:1651529344.477184:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008619c536/0x3234de053c5051d lrc: 1/0,0 mode: --/PW res: [0x2b513:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477187:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008619c536/0x3234de053c5051d lrc: 0/0,0 mode: --/PW res: [0x2b513:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477192:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50516 lrc: 3/0,1 mode: PW/PW res: [0x2b512:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477195:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50516 lrc: 3/0,1 mode: PW/PW res: [0x2b512:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477198:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50516 lrc: 3/0,1 mode: PW/PW res: [0x2b512:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477201:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50516 lrc: 2/0,0 mode: PW/PW res: [0x2b512:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.477220:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.477264:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+479:39029:x1731745946382272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 877us (985us total) trans 12885079033 rc 0/0 00000100:00100000:0.0:1651529344.477267:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210978 00010000:00010000:0.0:1651529344.477276:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50516 lrc: 2/0,0 mode: PW/PW res: [0x2b512:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477282:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dcd3e2d1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.477283:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50516 lrc: 2/0,0 mode: PW/PW res: [0x2b512:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477286:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50516 lrc: 3/0,0 mode: PW/PW res: [0x2b512:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.477288:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.477290:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50516 lrc: 1/0,0 mode: --/PW res: [0x2b512:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477299:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcd3e2d1/0x3234de053c50516 lrc: 0/0,0 mode: --/PW res: [0x2b512:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.477309:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996969472:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.477312:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000066ae2b40/0x3234de053c50524 lrc: 3/0,1 mode: --/PW res: [0x2b514:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.477318:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.477318:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396263616 00010000:00010000:0.0:1651529344.477323:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001b6ece5d/0x3234de053c4d7d5 lrc: 4/0,0 mode: PR/PR res: [0x2b515:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d10b6 expref: 1586 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.477328:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396263680 00010000:00010000:0.0:1651529344.477330:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001947a788/0x3234de053c4bca7 lrc: 4/0,0 mode: PR/PR res: [0x2b514:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5ed expref: 1587 pid: 80276 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.477334:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396263744 00010000:00010000:0.0:1651529344.477336:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000003eeafce/0x3234de053c4d5dd lrc: 5/0,0 mode: PR/PR res: [0x2b516:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d08eb expref: 1588 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.477341:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11762 00000100:00100000:0.0:1651529344.477358:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1588:41279:x1731746396263616:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.477362:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.477363:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001b6ece5d/0x3234de053c4d7d5 lrc: 4/0,0 mode: PR/PR res: [0x2b515:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d10b6 expref: 1588 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.477366:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006647e4ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996969600:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.477367:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001b6ece5d/0x3234de053c4d7d5 lrc: 3/0,0 mode: PR/PR res: [0x2b515:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d10b6 expref: 1588 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.477370:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b4eab03b/0x3234de053c50532 lrc: 3/0,1 mode: --/PW res: [0x2b516:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477372:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b6ece5d/0x3234de053c4d7d5 lrc: 0/0,0 mode: --/PR res: [0x2b515:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d10b6 expref: 1588 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.477376:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.477377:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.477378:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a8e8757f/0x3234de053c5052b lrc: 3/0,1 mode: PW/PW res: [0x2b515:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.477379:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11763 00010000:00010000:0.0:1651529344.477380:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8e8757f/0x3234de053c5052b lrc: 4/0,1 mode: PW/PW res: [0x2b515:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.477381:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000515bc9a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1587:41279:x1731746396263680:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.477385:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.477387:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001947a788/0x3234de053c4bca7 lrc: 4/0,0 mode: PR/PR res: [0x2b514:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5ed expref: 1587 pid: 80276 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.477391:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.477396:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001947a788/0x3234de053c4bca7 lrc: 3/0,0 mode: PR/PR res: [0x2b514:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5ed expref: 1587 pid: 80276 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.477401:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1587:41279:x1731746396263616:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.477404:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11762 00010000:00010000:1.0:1651529344.477407:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001947a788/0x3234de053c4bca7 lrc: 0/0,0 mode: --/PR res: [0x2b514:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5ed expref: 1586 pid: 80276 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.477409:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11764 00010000:00010000:1.0:1651529344.477410:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.477411:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.477411:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1585:41279:x1731746396263744:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.477412:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000066ae2b40/0x3234de053c50524 lrc: 3/0,1 mode: PW/PW res: [0x2b514:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477414:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.477415:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066ae2b40/0x3234de053c50524 lrc: 4/0,1 mode: PW/PW res: [0x2b514:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477415:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000003eeafce/0x3234de053c4d5dd lrc: 4/0,0 mode: PR/PR res: [0x2b516:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d08eb expref: 1585 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.477419:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000003eeafce/0x3234de053c4d5dd lrc: 3/0,0 mode: PR/PR res: [0x2b516:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d08eb expref: 1585 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.477424:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.477430:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003eeafce/0x3234de053c4d5dd lrc: 0/0,0 mode: --/PR res: [0x2b516:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d08eb expref: 1585 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.477431:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000515bc9a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1585:41279:x1731746396263680:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 50us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.477434:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11763 00010000:00010000:0.0:1651529344.477434:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.477435:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.477445:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a8e8757f/0x3234de053c5052b lrc: 3/0,1 mode: PW/PW res: [0x2b515:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.477448:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8e8757f/0x3234de053c5052b lrc: 3/0,1 mode: PW/PW res: [0x2b515:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477448:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4eab03b/0x3234de053c50532 lrc: 3/0,1 mode: PW/PW res: [0x2b516:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477451:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4eab03b/0x3234de053c50532 lrc: 4/0,1 mode: PW/PW res: [0x2b516:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.477454:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8e8757f/0x3234de053c5052b lrc: 3/0,1 mode: PW/PW res: [0x2b515:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.477456:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8e8757f/0x3234de053c5052b lrc: 2/0,0 mode: PW/PW res: [0x2b515:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477461:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.477468:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1583:41279:x1731746396263744:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 56us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.477476:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11764 00010000:00010000:0.0:1651529344.477483:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8e8757f/0x3234de053c5052b lrc: 2/0,0 mode: PW/PW res: [0x2b515:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477486:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8e8757f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.477487:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8e8757f/0x3234de053c5052b lrc: 2/0,0 mode: PW/PW res: [0x2b515:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.477503:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+479:39030:x1731745946382848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 867us (941us total) trans 12885079034 rc 0/0 00010000:00010000:0.0:1651529344.477503:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8e8757f/0x3234de053c5052b lrc: 3/0,0 mode: PW/PW res: [0x2b515:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.477505:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210981 00010000:00010000:0.0:1651529344.477508:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8e8757f/0x3234de053c5052b lrc: 1/0,0 mode: --/PW res: [0x2b515:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477511:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8e8757f/0x3234de053c5052b lrc: 0/0,0 mode: --/PW res: [0x2b515:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.477512:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b4eab03b/0x3234de053c50532 lrc: 3/0,1 mode: PW/PW res: [0x2b516:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.477515:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4eab03b/0x3234de053c50532 lrc: 3/0,1 mode: PW/PW res: [0x2b516:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477517:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000066ae2b40/0x3234de053c50524 lrc: 3/0,1 mode: PW/PW res: [0x2b514:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.477518:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4eab03b/0x3234de053c50532 lrc: 3/0,1 mode: PW/PW res: [0x2b516:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477520:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066ae2b40/0x3234de053c50524 lrc: 3/0,1 mode: PW/PW res: [0x2b514:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.477521:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4eab03b/0x3234de053c50532 lrc: 2/0,0 mode: PW/PW res: [0x2b516:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477523:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066ae2b40/0x3234de053c50524 lrc: 3/0,1 mode: PW/PW res: [0x2b514:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477526:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066ae2b40/0x3234de053c50524 lrc: 2/0,0 mode: PW/PW res: [0x2b514:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.477558:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+480:39030:x1731745946382912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 871us (974us total) trans 12885079035 rc 0/0 00000100:00100000:1.0:1651529344.477561:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210982 00000100:00100000:0.0:1651529344.477570:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+479:39029:x1731745946382784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 936us (1036us total) trans 12885079036 rc 0/0 00000100:00100000:0.0:1651529344.477573:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210980 00000100:00100000:1.0:1651529344.477576:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.477581:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946383424 00000100:00100000:0.0:1651529344.477591:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210985 00000100:00100000:0.0:1651529344.477593:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+479:39029:x1731745946383424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.477598:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.477598:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177434 count 1 00010000:00010000:0.0:1651529344.477602:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c50547 lrc: 3/0,1 mode: --/PW res: [0x2b51a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477613:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007761a2e9/0x3234de053c4dc6d lrc: 2/0,0 mode: PR/PR res: [0x2b51a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d21f0 expref: 1582 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.477616:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.477617:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.477617:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c50547 lrc: 4/0,1 mode: --/PW res: [0x2b51a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477624:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007761a2e9/0x3234de053c4dc6d lrc: 3/0,0 mode: PR/PR res: [0x2b51a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d21f0 expref: 1582 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.477628:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007761a2e9/0x3234de053c4dc6d lrc: 4/0,0 mode: PR/PR res: [0x2b51a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d21f0 expref: 1582 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.477632:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996969792:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.477645:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000000e7e66c4 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.477648:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946383360 00010000:00010000:0.0:1651529344.477650:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4eab03b/0x3234de053c50532 lrc: 2/0,0 mode: PW/PW res: [0x2b516:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477654:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b4eab03b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.477655:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4eab03b/0x3234de053c50532 lrc: 2/0,0 mode: PW/PW res: [0x2b516:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.477656:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210986 00000100:00100000:1.0:1651529344.477658:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+480:39030:x1731745946383360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.477660:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4eab03b/0x3234de053c50532 lrc: 3/0,0 mode: PW/PW res: [0x2b516:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.477663:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177433 count 1 00010000:00010000:1.0:1651529344.477667:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001afd79ee/0x3234de053c5054e lrc: 3/0,1 mode: --/PW res: [0x2b519:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.477672:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002618bdb6/0x3234de053c4d24f lrc: 2/0,0 mode: PR/PR res: [0x2b519:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfacf expref: 1582 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.477675:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.477675:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.477676:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001afd79ee/0x3234de053c5054e lrc: 4/0,1 mode: --/PW res: [0x2b519:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.477683:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002618bdb6/0x3234de053c4d24f lrc: 3/0,0 mode: PR/PR res: [0x2b519:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfacf expref: 1582 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.477686:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002618bdb6/0x3234de053c4d24f lrc: 4/0,0 mode: PR/PR res: [0x2b519:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfacf expref: 1582 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.477688:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4eab03b/0x3234de053c50532 lrc: 1/0,0 mode: --/PW res: [0x2b516:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.477690:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002f77bb41 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996969856:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.477692:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4eab03b/0x3234de053c50532 lrc: 0/0,0 mode: --/PW res: [0x2b516:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477696:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066ae2b40/0x3234de053c50524 lrc: 2/0,0 mode: PW/PW res: [0x2b514:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.477699:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 0000000089d75f07 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.477699:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000066ae2b40 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.477700:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066ae2b40/0x3234de053c50524 lrc: 2/0,0 mode: PW/PW res: [0x2b514:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477703:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066ae2b40/0x3234de053c50524 lrc: 3/0,0 mode: PW/PW res: [0x2b514:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477706:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066ae2b40/0x3234de053c50524 lrc: 1/0,0 mode: --/PW res: [0x2b514:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477708:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066ae2b40/0x3234de053c50524 lrc: 0/0,0 mode: --/PW res: [0x2b514:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477717:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c5050f lrc: 3/0,1 mode: PW/PW res: [0x2b511:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477722:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c5050f lrc: 3/0,1 mode: PW/PW res: [0x2b511:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477725:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c5050f lrc: 3/0,1 mode: PW/PW res: [0x2b511:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477728:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c5050f lrc: 2/0,0 mode: PW/PW res: [0x2b511:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.477779:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.477803:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.477803:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+481:39030:x1731745946382144:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1493us (1546us total) trans 12885079037 rc 0/0 00000100:00100000:0.0:1651529344.477806:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210977 00000100:00100000:0.0:1651529344.477817:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946383488 00000100:00100000:0.0:1651529344.477827:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210987 00000100:00100000:0.0:1651529344.477828:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+481:39030:x1731745946383488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.477833:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177435 count 1 00010000:00010000:0.0:1651529344.477837:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099324020/0x3234de053c50555 lrc: 3/0,1 mode: --/PW res: [0x2b51b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.477839:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.477842:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000099354594/0x3234de053c4f453 lrc: 2/0,0 mode: PR/PR res: [0x2b51b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83fe expref: 1582 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.477845:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.477845:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.477846:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099324020/0x3234de053c50555 lrc: 4/0,1 mode: --/PW res: [0x2b51b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.477847:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.477854:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.477855:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000099354594/0x3234de053c4f453 lrc: 3/0,0 mode: PR/PR res: [0x2b51b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83fe expref: 1582 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.477859:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000099354594/0x3234de053c4f453 lrc: 4/0,0 mode: PR/PR res: [0x2b51b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83fe expref: 1582 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.477861:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946383552 00000100:00100000:0.0:1651529344.477863:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996969920:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.477867:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946383616 00000100:00100000:1.0:1651529344.477871:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210988 00000100:00100000:1.0:1651529344.477872:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+483:39029:x1731745946383552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.477876:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a3b00cf3 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.477881:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c5050f lrc: 2/0,0 mode: PW/PW res: [0x2b511:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.477884:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177436 count 1 00010000:00010000:0.0:1651529344.477885:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cd6e2551 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.477886:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c5050f lrc: 2/0,0 mode: PW/PW res: [0x2b511:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.477888:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f73e545/0x3234de053c5055c lrc: 3/0,1 mode: --/PW res: [0x2b51c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477888:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c5050f lrc: 3/0,0 mode: PW/PW res: [0x2b511:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.477893:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007d3a9bd4/0x3234de053c4cbe2 lrc: 2/0,0 mode: PR/PR res: [0x2b51c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce145 expref: 1582 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.477893:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c5050f lrc: 1/0,0 mode: --/PW res: [0x2b511:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.477896:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.477896:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.477896:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd6e2551/0x3234de053c5050f lrc: 0/0,0 mode: --/PW res: [0x2b511:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.477897:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f73e545/0x3234de053c5055c lrc: 4/0,1 mode: --/PW res: [0x2b51c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.477904:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007d3a9bd4/0x3234de053c4cbe2 lrc: 3/0,0 mode: PR/PR res: [0x2b51c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce145 expref: 1582 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.477905:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996969728:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.477907:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007d3a9bd4/0x3234de053c4cbe2 lrc: 4/0,0 mode: PR/PR res: [0x2b51c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce145 expref: 1582 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.477909:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000186a4198/0x3234de053c50540 lrc: 3/0,1 mode: --/PW res: [0x2b518:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.477911:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000fb8e412 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996969984:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.477916:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210989 00000100:00100000:0.0:1651529344.477918:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+483:39030:x1731745946383616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.477920:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a5495eb going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.477928:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396264128 00010000:00010000:1.0:1651529344.477932:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e70ce874/0x3234de053c4e382 lrc: 5/0,0 mode: PR/PR res: [0x2b517:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f01 expref: 1583 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.477946:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396264192 00010000:00010000:1.0:1651529344.477957:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000011a57b01/0x3234de053c4cce5 lrc: 4/0,0 mode: PR/PR res: [0x2b518:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce5ac expref: 1584 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:0.0:1651529344.477960:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177437 count 1 00010000:00010000:0.0:1651529344.477964:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080a87994/0x3234de053c50563 lrc: 3/0,1 mode: --/PW res: [0x2b51d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.477965:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11765 00000100:00100000:1.0:1651529344.477966:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1584:41279:x1731746396264128:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.477969:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.477969:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000deca3988/0x3234de053c4d8a0 lrc: 2/0,0 mode: PR/PR res: [0x2b51d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d134f expref: 1584 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.477970:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e70ce874/0x3234de053c4e382 lrc: 5/0,0 mode: PR/PR res: [0x2b517:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f01 expref: 1584 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.477972:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.477972:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.477973:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080a87994/0x3234de053c50563 lrc: 4/0,1 mode: --/PW res: [0x2b51d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.477974:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e70ce874/0x3234de053c4e382 lrc: 4/0,0 mode: PR/PR res: [0x2b517:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f01 expref: 1584 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.477979:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.477980:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.477980:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000deca3988/0x3234de053c4d8a0 lrc: 3/0,0 mode: PR/PR res: [0x2b51d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d134f expref: 1584 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.477981:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003dd9e9df/0x3234de053c50539 lrc: 3/0,1 mode: PW/PW res: [0x2b517:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.477983:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000deca3988/0x3234de053c4d8a0 lrc: 4/0,0 mode: PR/PR res: [0x2b51d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d134f expref: 1584 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.477984:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dd9e9df/0x3234de053c50539 lrc: 4/0,1 mode: PW/PW res: [0x2b517:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.477987:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996970048:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.477988:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.477995:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1584:41279:x1731746396264128:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 29us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.477997:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aac87b31 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.477998:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11765 00000100:00100000:1.0:1651529344.478002:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11766 00000100:00100000:1.0:1651529344.478004:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1583:41279:x1731746396264192:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.478005:0:151609:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e70ce874/0x3234de053c4e382 lrc: 0/0,0 mode: --/PR res: [0x2b517:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f01 expref: 1583 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.478006:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.478007:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000011a57b01/0x3234de053c4cce5 lrc: 4/0,0 mode: PR/PR res: [0x2b518:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce5ac expref: 1583 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.478010:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000011a57b01/0x3234de053c4cce5 lrc: 3/0,0 mode: PR/PR res: [0x2b518:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce5ac expref: 1583 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.478011:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996969664:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.478014:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011a57b01/0x3234de053c4cce5 lrc: 0/0,0 mode: --/PR res: [0x2b518:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce5ac expref: 1582 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.478014:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003dd9e9df/0x3234de053c50539 lrc: 3/0,1 mode: PW/PW res: [0x2b517:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478017:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003dd9e9df/0x3234de053c50539 lrc: 3/0,1 mode: PW/PW res: [0x2b517:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.478018:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.478018:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.478019:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000186a4198/0x3234de053c50540 lrc: 3/0,1 mode: PW/PW res: [0x2b518:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478020:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003dd9e9df/0x3234de053c50539 lrc: 3/0,1 mode: PW/PW res: [0x2b517:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.478022:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000186a4198/0x3234de053c50540 lrc: 4/0,1 mode: PW/PW res: [0x2b518:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478023:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dd9e9df/0x3234de053c50539 lrc: 3/0,1 mode: PW/PW res: [0x2b517:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478026:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003dd9e9df/0x3234de053c50539 lrc: 2/0,0 mode: PW/PW res: [0x2b517:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.478031:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.478037:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1581:41279:x1731746396264192:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 33us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.478039:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11766 00000100:00100000:1.0:1651529344.478069:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.478077:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+484:39030:x1731745946383040:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1140us (1169us total) trans 12885079038 rc 0/0 00000100:00100000:0.0:1651529344.478080:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210983 00000100:00100000:0.0:1651529344.478085:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946383680 00000100:00100000:0.0:1651529344.478096:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210990 00000100:00100000:0.0:1651529344.478097:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+484:39029:x1731745946383680:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.478102:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177438 count 1 00010000:00010000:0.0:1651529344.478106:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5056a lrc: 3/0,1 mode: --/PW res: [0x2b51e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.478112:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.478113:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c4d566 lrc: 2/0,0 mode: PR/PR res: [0x2b51e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0747 expref: 1580 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.478116:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.478117:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.478117:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5056a lrc: 4/0,1 mode: --/PW res: [0x2b51e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478123:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c4d566 lrc: 3/0,0 mode: PR/PR res: [0x2b51e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0747 expref: 1580 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.478127:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c4d566 lrc: 4/0,0 mode: PR/PR res: [0x2b51e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0747 expref: 1580 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.478131:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996970112:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.478141:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 000000003ad73843 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.478143:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.478146:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003dd9e9df/0x3234de053c50539 lrc: 2/0,0 mode: PW/PW res: [0x2b517:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478150:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003dd9e9df already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.478151:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003dd9e9df/0x3234de053c50539 lrc: 2/0,0 mode: PW/PW res: [0x2b517:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478153:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003dd9e9df/0x3234de053c50539 lrc: 3/0,0 mode: PW/PW res: [0x2b517:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478160:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003dd9e9df/0x3234de053c50539 lrc: 1/0,0 mode: --/PW res: [0x2b517:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478163:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003dd9e9df/0x3234de053c50539 lrc: 0/0,0 mode: --/PW res: [0x2b517:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.478172:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996969792:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.478175:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002f77bb41 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996969856:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.478175:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c50547 lrc: 3/0,1 mode: --/PW res: [0x2b51a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478179:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000186a4198/0x3234de053c50540 lrc: 3/0,1 mode: PW/PW res: [0x2b518:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.478181:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001afd79ee/0x3234de053c5054e lrc: 3/0,1 mode: --/PW res: [0x2b519:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478182:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000186a4198/0x3234de053c50540 lrc: 3/0,1 mode: PW/PW res: [0x2b518:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478186:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000186a4198/0x3234de053c50540 lrc: 3/0,1 mode: PW/PW res: [0x2b518:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478188:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000186a4198/0x3234de053c50540 lrc: 2/0,0 mode: PW/PW res: [0x2b518:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.478189:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396264384 00010000:00010000:1.0:1651529344.478193:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002618bdb6/0x3234de053c4d24f lrc: 4/0,0 mode: PR/PR res: [0x2b519:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfacf expref: 1581 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.478198:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396264320 00010000:00010000:1.0:1651529344.478201:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007761a2e9/0x3234de053c4dc6d lrc: 4/0,0 mode: PR/PR res: [0x2b51a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d21f0 expref: 1582 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.478205:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11767 00000100:00100000:1.0:1651529344.478207:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1582:41278:x1731746396264384:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.478209:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.478211:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002618bdb6/0x3234de053c4d24f lrc: 4/0,0 mode: PR/PR res: [0x2b519:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfacf expref: 1582 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.478214:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002618bdb6/0x3234de053c4d24f lrc: 3/0,0 mode: PR/PR res: [0x2b519:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfacf expref: 1582 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.478219:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002618bdb6/0x3234de053c4d24f lrc: 0/0,0 mode: --/PR res: [0x2b519:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfacf expref: 1582 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.478238:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.478239:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.478240:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001afd79ee/0x3234de053c5054e lrc: 3/0,1 mode: PW/PW res: [0x2b519:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.478251:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001afd79ee/0x3234de053c5054e lrc: 4/0,1 mode: PW/PW res: [0x2b519:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.478257:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.478264:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1581:41278:x1731746396264384:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 57us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.478267:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11767 00000100:00100000:1.0:1651529344.478272:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11768 00000100:00100000:1.0:1651529344.478273:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1580:41278:x1731746396264320:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.478276:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.478277:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007761a2e9/0x3234de053c4dc6d lrc: 4/0,0 mode: PR/PR res: [0x2b51a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d21f0 expref: 1580 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.478281:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007761a2e9/0x3234de053c4dc6d lrc: 3/0,0 mode: PR/PR res: [0x2b51a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d21f0 expref: 1580 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.478285:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007761a2e9/0x3234de053c4dc6d lrc: 0/0,0 mode: --/PR res: [0x2b51a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d21f0 expref: 1580 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.478289:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.478289:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.478289:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000123250a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+485:39030:x1731745946383104:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1247us (1347us total) trans 12885079039 rc 0/0 00010000:00010000:1.0:1651529344.478290:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c50547 lrc: 3/0,1 mode: PW/PW res: [0x2b51a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.478292:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210984 00010000:00010000:1.0:1651529344.478293:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c50547 lrc: 4/0,1 mode: PW/PW res: [0x2b51a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.478305:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.478311:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1579:41278:x1731746396264320:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 37us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.478313:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11768 00010000:00010000:1.0:1651529344.478319:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001afd79ee/0x3234de053c5054e lrc: 3/0,1 mode: PW/PW res: [0x2b519:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478320:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000186a4198/0x3234de053c50540 lrc: 2/0,0 mode: PW/PW res: [0x2b518:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.478322:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001afd79ee/0x3234de053c5054e lrc: 3/0,1 mode: PW/PW res: [0x2b519:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478324:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000186a4198 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.478325:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001afd79ee/0x3234de053c5054e lrc: 3/0,1 mode: PW/PW res: [0x2b519:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478326:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000186a4198/0x3234de053c50540 lrc: 2/0,0 mode: PW/PW res: [0x2b518:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.478328:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001afd79ee/0x3234de053c5054e lrc: 2/0,0 mode: PW/PW res: [0x2b519:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478328:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000186a4198/0x3234de053c50540 lrc: 3/0,0 mode: PW/PW res: [0x2b518:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478333:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000186a4198/0x3234de053c50540 lrc: 1/0,0 mode: --/PW res: [0x2b518:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478341:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000186a4198/0x3234de053c50540 lrc: 0/0,0 mode: --/PW res: [0x2b518:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478346:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001afd79ee/0x3234de053c5054e lrc: 2/0,0 mode: PW/PW res: [0x2b519:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478348:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001afd79ee already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.478349:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001afd79ee/0x3234de053c5054e lrc: 2/0,0 mode: PW/PW res: [0x2b519:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478352:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001afd79ee/0x3234de053c5054e lrc: 3/0,0 mode: PW/PW res: [0x2b519:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478355:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001afd79ee/0x3234de053c5054e lrc: 1/0,0 mode: --/PW res: [0x2b519:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478358:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001afd79ee/0x3234de053c5054e lrc: 0/0,0 mode: --/PW res: [0x2b519:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478364:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c50547 lrc: 3/0,1 mode: PW/PW res: [0x2b51a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478367:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c50547 lrc: 3/0,1 mode: PW/PW res: [0x2b51a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.478370:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+485:39030:x1731745946383360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 711us (771us total) trans 12885079040 rc 0/0 00010000:00010000:0.0:1651529344.478370:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c50547 lrc: 3/0,1 mode: PW/PW res: [0x2b51a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.478373:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210986 00010000:00010000:0.0:1651529344.478373:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c50547 lrc: 2/0,0 mode: PW/PW res: [0x2b51a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.478389:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.478429:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+485:39029:x1731745946383424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 834us (852us total) trans 12885079041 rc 0/0 00000100:00100000:0.0:1651529344.478441:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210985 00000100:00100000:0.0:1651529344.478447:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946383744 00000100:00100000:0.0:1651529344.478457:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210991 00000100:00100000:0.0:1651529344.478458:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+485:39029:x1731745946383744:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.478463:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177439 count 1 00010000:00010000:0.0:1651529344.478467:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50571 lrc: 3/0,1 mode: --/PW res: [0x2b51f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478478:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c4dee3 lrc: 2/0,0 mode: PR/PR res: [0x2b51f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c70 expref: 1578 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.478481:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.478482:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.478482:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50571 lrc: 4/0,1 mode: --/PW res: [0x2b51f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478489:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c4dee3 lrc: 3/0,0 mode: PR/PR res: [0x2b51f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c70 expref: 1578 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.478498:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c4dee3 lrc: 4/0,0 mode: PR/PR res: [0x2b51f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c70 expref: 1578 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.478502:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996970176:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.478503:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.478512:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e7e12492 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.478513:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.478516:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c50547 lrc: 2/0,0 mode: PW/PW res: [0x2b51a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478519:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000005af6806 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.478520:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c50547 lrc: 2/0,0 mode: PW/PW res: [0x2b51a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478523:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c50547 lrc: 3/0,0 mode: PW/PW res: [0x2b51a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478528:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c50547 lrc: 1/0,0 mode: --/PW res: [0x2b51a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478530:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005af6806/0x3234de053c50547 lrc: 0/0,0 mode: --/PW res: [0x2b51a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.478542:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.478547:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.478556:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000fb8e412 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996969984:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.478558:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996970048:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.478560:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000f73e545/0x3234de053c5055c lrc: 3/0,1 mode: --/PW res: [0x2b51c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478562:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000080a87994/0x3234de053c50563 lrc: 3/0,1 mode: --/PW res: [0x2b51d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.478568:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396264448 00000100:00100000:0.0:1651529344.478570:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996970112:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.478572:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5056a lrc: 3/0,1 mode: --/PW res: [0x2b51e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.478573:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000099354594/0x3234de053c4f453 lrc: 5/0,0 mode: PR/PR res: [0x2b51b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83fe expref: 1579 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.478579:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396264576 00000100:00100000:0.0:1651529344.478579:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396264512 00010000:00010000:1.0:1651529344.478581:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000deca3988/0x3234de053c4d8a0 lrc: 4/0,0 mode: PR/PR res: [0x2b51d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d134f expref: 1581 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.478583:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007d3a9bd4/0x3234de053c4cbe2 lrc: 4/0,0 mode: PR/PR res: [0x2b51c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce145 expref: 1581 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.478585:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396264640 00010000:00010000:1.0:1651529344.478588:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c4d566 lrc: 4/0,0 mode: PR/PR res: [0x2b51e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0747 expref: 1582 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.478589:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11769 00000100:00100000:0.0:1651529344.478591:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1582:41279:x1731746396264448:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.478593:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11770 00000100:00100000:1.0:1651529344.478594:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1582:41279:x1731746396264576:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.478594:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.478595:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000099354594/0x3234de053c4f453 lrc: 5/0,0 mode: PR/PR res: [0x2b51b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83fe expref: 1582 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.478597:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.478598:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000deca3988/0x3234de053c4d8a0 lrc: 4/0,0 mode: PR/PR res: [0x2b51d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d134f expref: 1582 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.478599:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000099354594/0x3234de053c4f453 lrc: 4/0,0 mode: PR/PR res: [0x2b51b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83fe expref: 1582 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.478602:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000deca3988/0x3234de053c4d8a0 lrc: 3/0,0 mode: PR/PR res: [0x2b51d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d134f expref: 1582 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.478604:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.478604:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.478605:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000099324020/0x3234de053c50555 lrc: 3/0,1 mode: PW/PW res: [0x2b51b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.478607:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000deca3988/0x3234de053c4d8a0 lrc: 0/0,0 mode: --/PR res: [0x2b51d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d134f expref: 1582 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.478610:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099324020/0x3234de053c50555 lrc: 4/0,1 mode: PW/PW res: [0x2b51b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.478611:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.478612:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.478613:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000080a87994/0x3234de053c50563 lrc: 3/0,1 mode: PW/PW res: [0x2b51d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478615:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.478616:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080a87994/0x3234de053c50563 lrc: 4/0,1 mode: PW/PW res: [0x2b51d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.478630:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.478631:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1581:41279:x1731746396264448:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 39us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.478634:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11769 00000100:00100000:1.0:1651529344.478637:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1580:41279:x1731746396264576:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.478640:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11771 00000100:00100000:1.0:1651529344.478641:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11770 00000100:00100000:0.0:1651529344.478641:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e392dfeb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1580:41279:x1731746396264512:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.478644:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.478646:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11772 00010000:00010000:0.0:1651529344.478646:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007d3a9bd4/0x3234de053c4cbe2 lrc: 4/0,0 mode: PR/PR res: [0x2b51c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce145 expref: 1579 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.478648:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1579:41279:x1731746396264640:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.478650:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.478650:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007d3a9bd4/0x3234de053c4cbe2 lrc: 3/0,0 mode: PR/PR res: [0x2b51c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce145 expref: 1579 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.478652:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c4d566 lrc: 4/0,0 mode: PR/PR res: [0x2b51e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0747 expref: 1579 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.478656:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c4d566 lrc: 3/0,0 mode: PR/PR res: [0x2b51e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0747 expref: 1579 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.478660:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c4d566 lrc: 0/0,0 mode: --/PR res: [0x2b51e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0747 expref: 1579 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.478663:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.478664:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.478665:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5056a lrc: 3/0,1 mode: PW/PW res: [0x2b51e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478669:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d3a9bd4/0x3234de053c4cbe2 lrc: 0/0,0 mode: --/PR res: [0x2b51c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce145 expref: 1578 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.478670:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5056a lrc: 4/0,1 mode: PW/PW res: [0x2b51e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478673:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.478673:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.478674:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000f73e545/0x3234de053c5055c lrc: 3/0,1 mode: PW/PW res: [0x2b51c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.478679:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.478683:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f73e545/0x3234de053c5055c lrc: 4/0,1 mode: PW/PW res: [0x2b51c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.478684:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1577:41279:x1731746396264640:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.478687:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11772 00010000:00010000:0.0:1651529344.478695:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.478701:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000f73e545/0x3234de053c5055c lrc: 3/0,1 mode: PW/PW res: [0x2b51c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.478702:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e392dfeb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1576:41279:x1731746396264512:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 60us (188us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.478705:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f73e545/0x3234de053c5055c lrc: 3/0,1 mode: PW/PW res: [0x2b51c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.478708:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f73e545/0x3234de053c5055c lrc: 3/0,1 mode: PW/PW res: [0x2b51c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.478711:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f73e545/0x3234de053c5055c lrc: 2/0,0 mode: PW/PW res: [0x2b51c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.478714:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11771 00010000:00010000:0.0:1651529344.478755:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f73e545/0x3234de053c5055c lrc: 2/0,0 mode: PW/PW res: [0x2b51c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478759:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000f73e545 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.478760:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f73e545/0x3234de053c5055c lrc: 2/0,0 mode: PW/PW res: [0x2b51c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.478761:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+486:39029:x1731745946383552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 888us (914us total) trans 12885079042 rc 0/0 00010000:00010000:0.0:1651529344.478763:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f73e545/0x3234de053c5055c lrc: 3/0,0 mode: PW/PW res: [0x2b51c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.478764:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210988 00010000:00010000:0.0:1651529344.478768:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f73e545/0x3234de053c5055c lrc: 1/0,0 mode: --/PW res: [0x2b51c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478771:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f73e545/0x3234de053c5055c lrc: 0/0,0 mode: --/PW res: [0x2b51c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478776:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000080a87994/0x3234de053c50563 lrc: 3/0,1 mode: PW/PW res: [0x2b51d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478779:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080a87994/0x3234de053c50563 lrc: 3/0,1 mode: PW/PW res: [0x2b51d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478788:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080a87994/0x3234de053c50563 lrc: 3/0,1 mode: PW/PW res: [0x2b51d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478792:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080a87994/0x3234de053c50563 lrc: 2/0,0 mode: PW/PW res: [0x2b51d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.478812:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.478830:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+486:39030:x1731745946383616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 911us (976us total) trans 12885079043 rc 0/0 00000100:00100000:0.0:1651529344.478833:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210989 00000100:00100000:0.0:1651529344.478837:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946384192 00000100:00100000:0.0:1651529344.478848:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210992 00000100:00100000:0.0:1651529344.478850:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+486:39029:x1731745946384192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.478855:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177440 count 1 00000100:00100000:1.0:1651529344.478858:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.478859:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50578 lrc: 3/0,1 mode: --/PW res: [0x2b520:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478870:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004b6e58d6/0x3234de053c4f326 lrc: 2/0,0 mode: PR/PR res: [0x2b520:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f0b expref: 1575 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.478872:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.478873:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.478874:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.478874:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50578 lrc: 4/0,1 mode: --/PW res: [0x2b520:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478881:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004b6e58d6/0x3234de053c4f326 lrc: 3/0,0 mode: PR/PR res: [0x2b520:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f0b expref: 1575 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.478884:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004b6e58d6/0x3234de053c4f326 lrc: 4/0,0 mode: PR/PR res: [0x2b520:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f0b expref: 1575 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.478891:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996970240:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.478900:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aac87b31 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.478902:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.478905:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080a87994/0x3234de053c50563 lrc: 2/0,0 mode: PW/PW res: [0x2b51d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478914:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000080a87994 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.478915:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080a87994/0x3234de053c50563 lrc: 2/0,0 mode: PW/PW res: [0x2b51d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.478918:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080a87994/0x3234de053c50563 lrc: 3/0,0 mode: PW/PW res: [0x2b51d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.478933:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946384256 00010000:00010000:0.0:1651529344.478937:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080a87994/0x3234de053c50563 lrc: 1/0,0 mode: --/PW res: [0x2b51d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.478940:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946384320 00010000:00010000:0.0:1651529344.478940:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080a87994/0x3234de053c50563 lrc: 0/0,0 mode: --/PW res: [0x2b51d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.478944:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210993 00000100:00100000:1.0:1651529344.478946:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+488:39030:x1731745946384256:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.478951:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177441 count 1 00000100:00100000:0.0:1651529344.478951:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996970176:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.478954:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50571 lrc: 3/0,1 mode: --/PW res: [0x2b51f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.478956:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc130754/0x3234de053c5057f lrc: 3/0,1 mode: --/PW res: [0x2b521:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.478960:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000002310563/0x3234de053c4bcfb lrc: 2/0,0 mode: PR/PR res: [0x2b521:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc610 expref: 1575 pid: 72397 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.478962:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210994 00010000:00010000:1.0:1651529344.478963:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.478963:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+488:39030:x1731745946384320:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.478964:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.478965:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc130754/0x3234de053c5057f lrc: 4/0,1 mode: --/PW res: [0x2b521:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.478969:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177442 count 1 00010000:00010000:1.0:1651529344.478971:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000002310563/0x3234de053c4bcfb lrc: 3/0,0 mode: PR/PR res: [0x2b521:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc610 expref: 1575 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.478975:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000002310563/0x3234de053c4bcfb lrc: 4/0,0 mode: PR/PR res: [0x2b521:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc610 expref: 1575 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.478979:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bddc5ca7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996970304:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.478994:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50586 lrc: 3/0,1 mode: --/PW res: [0x2b522:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.478997:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a6b79b05 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.478999:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003cd9155b/0x3234de053c4de18 lrc: 2/0,0 mode: PR/PR res: [0x2b522:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d298a expref: 1575 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.479002:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.479003:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.479003:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50586 lrc: 4/0,1 mode: --/PW res: [0x2b522:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479010:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003cd9155b/0x3234de053c4de18 lrc: 3/0,0 mode: PR/PR res: [0x2b522:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d298a expref: 1575 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.479014:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.479014:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003cd9155b/0x3234de053c4de18 lrc: 4/0,0 mode: PR/PR res: [0x2b522:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d298a expref: 1575 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.479018:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996970368:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.479049:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e7e12492 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.479055:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5056a lrc: 3/0,1 mode: PW/PW res: [0x2b51e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479058:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5056a lrc: 3/0,1 mode: PW/PW res: [0x2b51e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.479060:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.479061:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5056a lrc: 3/0,1 mode: PW/PW res: [0x2b51e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479064:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5056a lrc: 2/0,0 mode: PW/PW res: [0x2b51e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.479089:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946384384 00000100:00100000:1.0:1651529344.479095:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946384448 00000100:00100000:1.0:1651529344.479100:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210995 00000100:00100000:1.0:1651529344.479101:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+491:39029:x1731745946384384:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.479108:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+491:39029:x1731745946383680:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1009us (1039us total) trans 12885079044 rc 0/0 00000100:00100000:0.0:1651529344.479111:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210990 00002000:00080000:1.0:1651529344.479112:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177443 count 1 00010000:00010000:1.0:1651529344.479116:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b163d7c2/0x3234de053c5058d lrc: 3/0,1 mode: --/PW res: [0x2b523:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.479116:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210996 00000100:00100000:0.0:1651529344.479118:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+490:39029:x1731745946384448:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.479121:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000056925995/0x3234de053c4d65b lrc: 2/0,0 mode: PR/PR res: [0x2b523:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0af1 expref: 1575 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.479123:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177444 count 1 00010000:00010000:1.0:1651529344.479124:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.479125:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.479125:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b163d7c2/0x3234de053c5058d lrc: 4/0,1 mode: --/PW res: [0x2b523:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479127:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9690ad5/0x3234de053c50594 lrc: 3/0,1 mode: --/PW res: [0x2b524:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479131:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000056925995/0x3234de053c4d65b lrc: 3/0,0 mode: PR/PR res: [0x2b523:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0af1 expref: 1575 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.479132:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c4f64b lrc: 2/0,0 mode: PR/PR res: [0x2b524:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8bec expref: 1575 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.479135:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000056925995/0x3234de053c4d65b lrc: 4/0,0 mode: PR/PR res: [0x2b523:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0af1 expref: 1575 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.479139:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000059363096 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996970432:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.479147:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 000000007e004c12 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.479152:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.479152:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.479153:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9690ad5/0x3234de053c50594 lrc: 4/0,1 mode: --/PW res: [0x2b524:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479161:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c4f64b lrc: 3/0,0 mode: PR/PR res: [0x2b524:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8bec expref: 1575 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.479171:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c4f64b lrc: 4/0,0 mode: PR/PR res: [0x2b524:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8bec expref: 1575 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.479187:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996970496:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.479197:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c0dff858 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.479202:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5056a lrc: 2/0,0 mode: PW/PW res: [0x2b51e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479205:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000002904524 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.479206:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5056a lrc: 2/0,0 mode: PW/PW res: [0x2b51e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479209:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5056a lrc: 3/0,0 mode: PW/PW res: [0x2b51e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479213:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5056a lrc: 1/0,0 mode: --/PW res: [0x2b51e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479216:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5056a lrc: 0/0,0 mode: --/PW res: [0x2b51e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.479237:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996970240:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.479245:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50578 lrc: 3/0,1 mode: --/PW res: [0x2b520:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.479255:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396264832 00000100:00100000:1.0:1651529344.479256:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bddc5ca7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996970304:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.479260:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fc130754/0x3234de053c5057f lrc: 3/0,1 mode: --/PW res: [0x2b521:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479260:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c4dee3 lrc: 4/0,0 mode: PR/PR res: [0x2b51f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c70 expref: 1576 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.479271:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11773 00000100:00100000:1.0:1651529344.479273:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1576:41279:x1731746396264832:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.479277:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.479278:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c4dee3 lrc: 4/0,0 mode: PR/PR res: [0x2b51f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c70 expref: 1576 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.479282:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c4dee3 lrc: 3/0,0 mode: PR/PR res: [0x2b51f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c70 expref: 1576 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.479295:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c4dee3 lrc: 0/0,0 mode: --/PR res: [0x2b51f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c70 expref: 1576 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.479295:0:156655:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099354594/0x3234de053c4f453 lrc: 0/0,0 mode: --/PR res: [0x2b51b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83fe expref: 1576 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.479298:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.479299:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.479300:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50571 lrc: 3/0,1 mode: PW/PW res: [0x2b51f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.479300:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996969920:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.479303:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50571 lrc: 4/0,1 mode: PW/PW res: [0x2b51f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479303:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000099324020/0x3234de053c50555 lrc: 3/0,1 mode: PW/PW res: [0x2b51b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479307:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000099324020/0x3234de053c50555 lrc: 3/0,1 mode: PW/PW res: [0x2b51b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479309:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099324020/0x3234de053c50555 lrc: 3/0,1 mode: PW/PW res: [0x2b51b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479312:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.479318:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099324020/0x3234de053c50555 lrc: 3/0,1 mode: PW/PW res: [0x2b51b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.479320:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1574:41279:x1731746396264832:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 46us (468us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.479321:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099324020/0x3234de053c50555 lrc: 2/0,0 mode: PW/PW res: [0x2b51b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.479323:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11773 00000100:00100000:1.0:1651529344.479338:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.479359:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+491:39030:x1731745946383488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1530us (1561us total) trans 12885079045 rc 0/0 00000100:00100000:0.0:1651529344.479363:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210987 00000100:00100000:0.0:1651529344.479367:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946384512 00000100:00100000:0.0:1651529344.479378:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210997 00000100:00100000:0.0:1651529344.479379:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+491:39029:x1731745946384512:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.479384:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177445 count 1 00010000:00010000:0.0:1651529344.479388:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c5059b lrc: 3/0,1 mode: --/PW res: [0x2b525:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479393:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000747a922b/0x3234de053c4e20f lrc: 2/0,0 mode: PR/PR res: [0x2b525:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3990 expref: 1573 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.479396:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.479396:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.479397:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c5059b lrc: 4/0,1 mode: --/PW res: [0x2b525:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479404:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000747a922b/0x3234de053c4e20f lrc: 3/0,0 mode: PR/PR res: [0x2b525:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3990 expref: 1573 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.479407:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000747a922b/0x3234de053c4e20f lrc: 4/0,0 mode: PR/PR res: [0x2b525:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3990 expref: 1573 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.479411:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996970560:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.479424:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a3b00cf3 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.479429:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099324020/0x3234de053c50555 lrc: 2/0,0 mode: PW/PW res: [0x2b51b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479432:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000099324020 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.479433:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099324020/0x3234de053c50555 lrc: 2/0,0 mode: PW/PW res: [0x2b51b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479436:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099324020/0x3234de053c50555 lrc: 3/0,0 mode: PW/PW res: [0x2b51b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479441:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099324020/0x3234de053c50555 lrc: 1/0,0 mode: --/PW res: [0x2b51b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479444:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099324020/0x3234de053c50555 lrc: 0/0,0 mode: --/PW res: [0x2b51b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479449:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50571 lrc: 3/0,1 mode: PW/PW res: [0x2b51f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479452:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50571 lrc: 3/0,1 mode: PW/PW res: [0x2b51f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479455:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50571 lrc: 3/0,1 mode: PW/PW res: [0x2b51f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479480:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50571 lrc: 2/0,0 mode: PW/PW res: [0x2b51f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.479508:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.479523:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.479529:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.479539:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.479549:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396264960 00010000:00010000:1.0:1651529344.479554:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004b6e58d6/0x3234de053c4f326 lrc: 4/0,0 mode: PR/PR res: [0x2b520:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f0b expref: 1574 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.479566:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396265216 00010000:00010000:1.0:1651529344.479568:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000002310563/0x3234de053c4bcfb lrc: 4/0,0 mode: PR/PR res: [0x2b521:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc610 expref: 1575 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.479569:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+492:39029:x1731745946383744:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1110us (1179us total) trans 12885079046 rc 0/0 00000100:00100000:1.0:1651529344.479572:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396265344 00000100:00100000:0.0:1651529344.479572:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210991 00010000:00010000:1.0:1651529344.479574:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003cd9155b/0x3234de053c4de18 lrc: 5/0,0 mode: PR/PR res: [0x2b522:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d298a expref: 1576 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.479578:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946384704 00000100:00100000:1.0:1651529344.479579:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11774 00000100:00100000:1.0:1651529344.479580:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1576:41279:x1731746396264960:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.479583:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.479587:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210998 00010000:00010000:1.0:1651529344.479589:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004b6e58d6/0x3234de053c4f326 lrc: 4/0,0 mode: PR/PR res: [0x2b520:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f0b expref: 1576 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.479589:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+492:39029:x1731745946384704:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.479593:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004b6e58d6/0x3234de053c4f326 lrc: 3/0,0 mode: PR/PR res: [0x2b520:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f0b expref: 1576 pid: 72396 timeout: 20103 lvb_type: 1 00002000:00080000:0.0:1651529344.479594:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177446 count 1 00010000:00010000:0.0:1651529344.479598:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c505a2 lrc: 3/0,1 mode: --/PW res: [0x2b526:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479599:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b6e58d6/0x3234de053c4f326 lrc: 0/0,0 mode: --/PR res: [0x2b520:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f0b expref: 1576 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.479602:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.479603:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.479603:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50578 lrc: 3/0,1 mode: PW/PW res: [0x2b520:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479603:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bce33447/0x3234de053c4f08d lrc: 2/0,0 mode: PR/PR res: [0x2b526:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7510 expref: 1575 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.479609:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50578 lrc: 4/0,1 mode: PW/PW res: [0x2b520:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479618:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.479623:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.479624:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.479624:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c505a2 lrc: 4/0,1 mode: --/PW res: [0x2b526:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.479625:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1575:41279:x1731746396264960:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 44us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.479627:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11774 00000100:00100000:1.0:1651529344.479632:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11775 00010000:00010000:0.0:1651529344.479632:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bce33447/0x3234de053c4f08d lrc: 3/0,0 mode: PR/PR res: [0x2b526:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7510 expref: 1574 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.479634:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1574:41279:x1731746396265216:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.479636:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.479636:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bce33447/0x3234de053c4f08d lrc: 4/0,0 mode: PR/PR res: [0x2b526:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7510 expref: 1574 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.479637:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000002310563/0x3234de053c4bcfb lrc: 4/0,0 mode: PR/PR res: [0x2b521:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc610 expref: 1574 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.479640:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996970624:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.479641:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000002310563/0x3234de053c4bcfb lrc: 3/0,0 mode: PR/PR res: [0x2b521:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc610 expref: 1574 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.479646:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002310563/0x3234de053c4bcfb lrc: 0/0,0 mode: --/PR res: [0x2b521:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc610 expref: 1574 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.479649:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.479649:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000000e7e66c4 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.479650:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.479650:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fc130754/0x3234de053c5057f lrc: 3/0,1 mode: PW/PW res: [0x2b521:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479653:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc130754/0x3234de053c5057f lrc: 4/0,1 mode: PW/PW res: [0x2b521:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479654:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50571 lrc: 2/0,0 mode: PW/PW res: [0x2b51f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479657:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e0e037e6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.479658:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50571 lrc: 2/0,0 mode: PW/PW res: [0x2b51f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479661:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.479661:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50571 lrc: 3/0,0 mode: PW/PW res: [0x2b51f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479665:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50571 lrc: 1/0,0 mode: --/PW res: [0x2b51f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.479666:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1573:41279:x1731746396265216:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 32us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.479668:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11775 00010000:00010000:0.0:1651529344.479668:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50571 lrc: 0/0,0 mode: --/PW res: [0x2b51f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.479672:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11776 00000100:00100000:1.0:1651529344.479673:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1572:41279:x1731746396265344:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.479676:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.479677:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003cd9155b/0x3234de053c4de18 lrc: 4/0,0 mode: PR/PR res: [0x2b522:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d298a expref: 1572 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.479677:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996970368:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.479680:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50586 lrc: 3/0,1 mode: --/PW res: [0x2b522:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479681:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003cd9155b/0x3234de053c4de18 lrc: 3/0,0 mode: PR/PR res: [0x2b522:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d298a expref: 1572 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.479685:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003cd9155b/0x3234de053c4de18 lrc: 0/0,0 mode: --/PR res: [0x2b522:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d298a expref: 1572 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.479687:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50578 lrc: 3/0,1 mode: PW/PW res: [0x2b520:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479689:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.479689:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.479690:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50586 lrc: 3/0,1 mode: PW/PW res: [0x2b522:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479690:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50578 lrc: 3/0,1 mode: PW/PW res: [0x2b520:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479693:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50586 lrc: 4/0,1 mode: PW/PW res: [0x2b522:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479693:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50578 lrc: 3/0,1 mode: PW/PW res: [0x2b520:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479695:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50578 lrc: 2/0,0 mode: PW/PW res: [0x2b520:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479701:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.479706:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1571:41279:x1731746396265344:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 31us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.479708:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11776 00010000:00010000:1.0:1651529344.479714:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fc130754/0x3234de053c5057f lrc: 3/0,1 mode: PW/PW res: [0x2b521:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479718:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc130754/0x3234de053c5057f lrc: 3/0,1 mode: PW/PW res: [0x2b521:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479721:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc130754/0x3234de053c5057f lrc: 3/0,1 mode: PW/PW res: [0x2b521:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479723:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc130754/0x3234de053c5057f lrc: 2/0,0 mode: PW/PW res: [0x2b521:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.479772:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+494:39030:x1731745946384256:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 825us (900us total) trans 12885079047 rc 0/0 00000100:00100000:1.0:1651529344.479775:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210993 00000100:00100000:0.0:1651529344.479781:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+493:39029:x1731745946384192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 929us (976us total) trans 12885079048 rc 0/0 00000100:00100000:0.0:1651529344.479784:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210992 00010000:00010000:0.0:1651529344.479791:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50578 lrc: 2/0,0 mode: PW/PW res: [0x2b520:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479795:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000069f7ba22 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.479796:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50578 lrc: 2/0,0 mode: PW/PW res: [0x2b520:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479799:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50578 lrc: 3/0,0 mode: PW/PW res: [0x2b520:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479803:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50578 lrc: 1/0,0 mode: --/PW res: [0x2b520:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479806:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50578 lrc: 0/0,0 mode: --/PW res: [0x2b520:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479810:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc130754/0x3234de053c5057f lrc: 2/0,0 mode: PW/PW res: [0x2b521:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479813:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fc130754 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.479814:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc130754/0x3234de053c5057f lrc: 2/0,0 mode: PW/PW res: [0x2b521:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479816:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc130754/0x3234de053c5057f lrc: 3/0,0 mode: PW/PW res: [0x2b521:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479819:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc130754/0x3234de053c5057f lrc: 1/0,0 mode: --/PW res: [0x2b521:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479822:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc130754/0x3234de053c5057f lrc: 0/0,0 mode: --/PW res: [0x2b521:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.479834:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.479835:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50586 lrc: 3/0,1 mode: PW/PW res: [0x2b522:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479838:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50586 lrc: 3/0,1 mode: PW/PW res: [0x2b522:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479842:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50586 lrc: 3/0,1 mode: PW/PW res: [0x2b522:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.479844:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.479844:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50586 lrc: 2/0,0 mode: PW/PW res: [0x2b522:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.479880:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.479888:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+493:39030:x1731745946384320:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 924us (986us total) trans 12885079049 rc 0/0 00000100:00100000:0.0:1651529344.479891:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210994 00010000:00010000:0.0:1651529344.479898:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50586 lrc: 2/0,0 mode: PW/PW res: [0x2b522:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479901:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000048c07243 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.479902:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50586 lrc: 2/0,0 mode: PW/PW res: [0x2b522:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479904:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50586 lrc: 3/0,0 mode: PW/PW res: [0x2b522:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479908:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50586 lrc: 1/0,0 mode: --/PW res: [0x2b522:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479911:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50586 lrc: 0/0,0 mode: --/PW res: [0x2b522:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.479927:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000059363096 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996970432:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.479932:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b163d7c2/0x3234de053c5058d lrc: 3/0,1 mode: --/PW res: [0x2b523:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.479939:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396265472 00000100:00100000:0.0:1651529344.479939:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996970496:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.479943:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000056925995/0x3234de053c4d65b lrc: 4/0,0 mode: PR/PR res: [0x2b523:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0af1 expref: 1571 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.479943:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a9690ad5/0x3234de053c50594 lrc: 3/0,1 mode: --/PW res: [0x2b524:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.479951:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396265600 00000100:00100000:0.0:1651529344.479951:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396265536 00010000:00010000:1.0:1651529344.479953:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000747a922b/0x3234de053c4e20f lrc: 5/0,0 mode: PR/PR res: [0x2b525:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3990 expref: 1573 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.479956:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c4f64b lrc: 4/0,0 mode: PR/PR res: [0x2b524:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8bec expref: 1573 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.479958:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11777 00000100:00100000:1.0:1651529344.479960:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000db7aa2bf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1573:41279:x1731746396265472:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.479961:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11778 00010000:00010000:1.0:1651529344.479962:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.479963:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1573:41278:x1731746396265600:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.479964:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000056925995/0x3234de053c4d65b lrc: 4/0,0 mode: PR/PR res: [0x2b523:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0af1 expref: 1573 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.479966:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.479967:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000056925995/0x3234de053c4d65b lrc: 3/0,0 mode: PR/PR res: [0x2b523:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0af1 expref: 1573 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.479967:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000747a922b/0x3234de053c4e20f lrc: 5/0,0 mode: PR/PR res: [0x2b525:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3990 expref: 1573 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.479971:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000747a922b/0x3234de053c4e20f lrc: 4/0,0 mode: PR/PR res: [0x2b525:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3990 expref: 1573 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.479973:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056925995/0x3234de053c4d65b lrc: 0/0,0 mode: --/PR res: [0x2b523:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0af1 expref: 1573 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.479976:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.479976:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.479977:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.479977:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.479978:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b163d7c2/0x3234de053c5058d lrc: 3/0,1 mode: PW/PW res: [0x2b523:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479978:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c5059b lrc: 3/0,1 mode: PW/PW res: [0x2b525:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.479981:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b163d7c2/0x3234de053c5058d lrc: 4/0,1 mode: PW/PW res: [0x2b523:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479981:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c5059b lrc: 4/0,1 mode: PW/PW res: [0x2b525:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.479985:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.479987:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.479998:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1572:41278:x1731746396265600:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 35us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.480001:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11778 00000100:00100000:1.0:1651529344.480003:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000db7aa2bf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1572:41279:x1731746396265472:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 43us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.480006:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11779 00000100:00100000:1.0:1651529344.480008:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11777 00000100:00100000:0.0:1651529344.480008:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1571:41279:x1731746396265536:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.480011:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.480012:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c4f64b lrc: 4/0,0 mode: PR/PR res: [0x2b524:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8bec expref: 1570 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.480016:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c4f64b lrc: 3/0,0 mode: PR/PR res: [0x2b524:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8bec expref: 1570 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.480018:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b163d7c2/0x3234de053c5058d lrc: 3/0,1 mode: PW/PW res: [0x2b523:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.480020:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c4f64b lrc: 0/0,0 mode: --/PR res: [0x2b524:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8bec expref: 1570 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.480022:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b163d7c2/0x3234de053c5058d lrc: 3/0,1 mode: PW/PW res: [0x2b523:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.480024:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.480024:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.480025:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b163d7c2/0x3234de053c5058d lrc: 3/0,1 mode: PW/PW res: [0x2b523:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.480025:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a9690ad5/0x3234de053c50594 lrc: 3/0,1 mode: PW/PW res: [0x2b524:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.480027:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b163d7c2/0x3234de053c5058d lrc: 2/0,0 mode: PW/PW res: [0x2b523:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.480028:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9690ad5/0x3234de053c50594 lrc: 4/0,1 mode: PW/PW res: [0x2b524:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.480040:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.480046:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1569:41279:x1731746396265536:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 37us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.480048:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11779 00010000:00010000:0.0:1651529344.480055:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b163d7c2/0x3234de053c5058d lrc: 2/0,0 mode: PW/PW res: [0x2b523:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.480058:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b163d7c2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.480059:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b163d7c2/0x3234de053c5058d lrc: 2/0,0 mode: PW/PW res: [0x2b523:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.480070:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+493:39029:x1731745946384384:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 967us (1056us total) trans 12885079050 rc 0/0 00000100:00100000:1.0:1651529344.480073:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210995 00010000:00010000:0.0:1651529344.480079:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b163d7c2/0x3234de053c5058d lrc: 3/0,0 mode: PW/PW res: [0x2b523:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.480098:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b163d7c2/0x3234de053c5058d lrc: 1/0,0 mode: --/PW res: [0x2b523:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.480101:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b163d7c2/0x3234de053c5058d lrc: 0/0,0 mode: --/PW res: [0x2b523:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.480111:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996970624:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.480114:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c505a2 lrc: 3/0,1 mode: --/PW res: [0x2b526:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.480119:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a9690ad5/0x3234de053c50594 lrc: 3/0,1 mode: PW/PW res: [0x2b524:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.480120:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.480122:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9690ad5/0x3234de053c50594 lrc: 3/0,1 mode: PW/PW res: [0x2b524:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.480125:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9690ad5/0x3234de053c50594 lrc: 3/0,1 mode: PW/PW res: [0x2b524:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.480130:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9690ad5/0x3234de053c50594 lrc: 2/0,0 mode: PW/PW res: [0x2b524:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.480150:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.480161:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.480175:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+493:39029:x1731745946384448:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1056us (1114us total) trans 12885079051 rc 0/0 00000100:00100000:0.0:1651529344.480178:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210996 00000100:00100000:0.0:1651529344.480183:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946384768 00000100:00100000:0.0:1651529344.480188:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946384896 00000100:00100000:0.0:1651529344.480196:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 210999 00000100:00100000:0.0:1651529344.480198:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+494:39030:x1731745946384768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.480203:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177447 count 1 00010000:00010000:0.0:1651529344.480207:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c505a9 lrc: 3/0,1 mode: --/PW res: [0x2b527:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.480212:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008eb0a7f4/0x3234de053c4ee17 lrc: 2/0,0 mode: PR/PR res: [0x2b527:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a7b expref: 1568 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.480215:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.480216:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.480216:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c505a9 lrc: 4/0,1 mode: --/PW res: [0x2b527:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.480217:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.480240:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.480247:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946384832 00000100:00100000:1.0:1651529344.480253:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946384960 00010000:00010000:0.0:1651529344.480255:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008eb0a7f4/0x3234de053c4ee17 lrc: 3/0,0 mode: PR/PR res: [0x2b527:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a7b expref: 1568 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.480257:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211000 00000100:00100000:1.0:1651529344.480259:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+496:39030:x1731745946384896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.480259:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008eb0a7f4/0x3234de053c4ee17 lrc: 4/0,0 mode: PR/PR res: [0x2b527:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a7b expref: 1568 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:1.0:1651529344.480264:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177449 count 1 00000100:00100000:0.0:1651529344.480264:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996970688:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.480269:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d5eac2c/0x3234de053c505b0 lrc: 3/0,1 mode: --/PW res: [0x2b529:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.480273:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003a4fe8ca/0x3234de053c4ec42 lrc: 2/0,0 mode: PR/PR res: [0x2b529:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6271 expref: 1568 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.480278:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 000000003ad73843 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.480284:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.480284:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.480284:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9690ad5/0x3234de053c50594 lrc: 2/0,0 mode: PW/PW res: [0x2b524:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.480285:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d5eac2c/0x3234de053c505b0 lrc: 4/0,1 mode: --/PW res: [0x2b529:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.480287:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a9690ad5 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.480288:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9690ad5/0x3234de053c50594 lrc: 2/0,0 mode: PW/PW res: [0x2b524:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.480291:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9690ad5/0x3234de053c50594 lrc: 3/0,0 mode: PW/PW res: [0x2b524:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.480292:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003a4fe8ca/0x3234de053c4ec42 lrc: 3/0,0 mode: PR/PR res: [0x2b529:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6271 expref: 1568 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.480295:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9690ad5/0x3234de053c50594 lrc: 1/0,0 mode: --/PW res: [0x2b524:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.480296:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003a4fe8ca/0x3234de053c4ec42 lrc: 4/0,0 mode: PR/PR res: [0x2b529:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6271 expref: 1568 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.480298:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9690ad5/0x3234de053c50594 lrc: 0/0,0 mode: --/PW res: [0x2b524:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.480300:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005d3fb3ef pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996970752:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.480306:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211001 00000100:00100000:0.0:1651529344.480308:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+496:39030:x1731745946384832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.480309:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f9dac3f6 going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.480313:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177448 count 1 00000100:00100000:1.0:1651529344.480316:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211002 00000100:00100000:1.0:1651529344.480318:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+496:39030:x1731745946384960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.480322:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177450 count 1 00010000:00010000:1.0:1651529344.480326:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c505be lrc: 3/0,1 mode: --/PW res: [0x2b52a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.480329:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008619c536/0x3234de053c505b7 lrc: 3/0,1 mode: --/PW res: [0x2b528:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.480330:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004f625209/0x3234de053c4dca5 lrc: 2/0,0 mode: PR/PR res: [0x2b52a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2301 expref: 1568 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.480334:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b2e0184e/0x3234de053c4e17c lrc: 2/0,0 mode: PR/PR res: [0x2b528:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d36fe expref: 1568 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.480336:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.480337:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.480337:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c505be lrc: 4/0,1 mode: --/PW res: [0x2b52a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.480337:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.480338:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.480338:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008619c536/0x3234de053c505b7 lrc: 4/0,1 mode: --/PW res: [0x2b528:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.480343:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004f625209/0x3234de053c4dca5 lrc: 3/0,0 mode: PR/PR res: [0x2b52a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2301 expref: 1568 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.480345:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b2e0184e/0x3234de053c4e17c lrc: 3/0,0 mode: PR/PR res: [0x2b528:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d36fe expref: 1568 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.480346:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004f625209/0x3234de053c4dca5 lrc: 4/0,0 mode: PR/PR res: [0x2b52a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2301 expref: 1568 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.480349:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b2e0184e/0x3234de053c4e17c lrc: 4/0,0 mode: PR/PR res: [0x2b528:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d36fe expref: 1568 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.480350:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005d2b5bb3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996970816:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.480353:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996970880:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.480356:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 000000004698fefb going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.480361:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e7e12492 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.480363:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396265728 00010000:00010000:1.0:1651529344.480367:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bce33447/0x3234de053c4f08d lrc: 4/0,0 mode: PR/PR res: [0x2b526:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7510 expref: 1569 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.480371:0:156655:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000747a922b/0x3234de053c4e20f lrc: 0/0,0 mode: --/PR res: [0x2b525:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3990 expref: 1569 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.480379:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11780 00000100:00100000:1.0:1651529344.480381:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1568:41279:x1731746396265728:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.480382:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996970560:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.480384:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.480385:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bce33447/0x3234de053c4f08d lrc: 4/0,0 mode: PR/PR res: [0x2b526:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7510 expref: 1568 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.480386:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c5059b lrc: 3/0,1 mode: PW/PW res: [0x2b525:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.480389:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bce33447/0x3234de053c4f08d lrc: 3/0,0 mode: PR/PR res: [0x2b526:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7510 expref: 1568 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.480389:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c5059b lrc: 3/0,1 mode: PW/PW res: [0x2b525:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.480392:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c5059b lrc: 3/0,1 mode: PW/PW res: [0x2b525:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.480397:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bce33447/0x3234de053c4f08d lrc: 0/0,0 mode: --/PR res: [0x2b526:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7510 expref: 1568 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.480397:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c5059b lrc: 3/0,1 mode: PW/PW res: [0x2b525:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.480400:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c5059b lrc: 2/0,0 mode: PW/PW res: [0x2b525:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.480401:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.480402:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.480403:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c505a2 lrc: 3/0,1 mode: PW/PW res: [0x2b526:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.480406:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c505a2 lrc: 4/0,1 mode: PW/PW res: [0x2b526:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.480414:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.480420:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1567:41279:x1731746396265728:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 38us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.480423:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11780 00000100:00100000:1.0:1651529344.480438:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.480444:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+497:39029:x1731745946384512:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1063us (1105us total) trans 12885079052 rc 0/0 00000100:00100000:0.0:1651529344.480447:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210997 00000100:00100000:0.0:1651529344.480452:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946385408 00000100:00100000:0.0:1651529344.480458:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211003 00000100:00100000:0.0:1651529344.480460:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+497:39030:x1731745946385408:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.480464:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177451 count 1 00010000:00010000:0.0:1651529344.480468:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b169871/0x3234de053c505c5 lrc: 3/0,1 mode: --/PW res: [0x2b52b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.480487:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002b6259c5/0x3234de053c4dc0b lrc: 2/0,0 mode: PR/PR res: [0x2b52b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2068 expref: 1566 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.480491:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.480491:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.480492:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b169871/0x3234de053c505c5 lrc: 4/0,1 mode: --/PW res: [0x2b52b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.480499:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002b6259c5/0x3234de053c4dc0b lrc: 3/0,0 mode: PR/PR res: [0x2b52b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2068 expref: 1566 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.480500:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.480505:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002b6259c5/0x3234de053c4dc0b lrc: 4/0,0 mode: PR/PR res: [0x2b52b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2068 expref: 1566 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.480509:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996970944:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.480517:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a3b00cf3 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.480522:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c5059b lrc: 2/0,0 mode: PW/PW res: [0x2b525:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.480526:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000364b2cdc already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.480540:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c5059b lrc: 2/0,0 mode: PW/PW res: [0x2b525:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.480544:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c5059b lrc: 3/0,0 mode: PW/PW res: [0x2b525:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.480546:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946385536 00010000:00010000:0.0:1651529344.480549:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c5059b lrc: 1/0,0 mode: --/PW res: [0x2b525:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.480551:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c5059b lrc: 0/0,0 mode: --/PW res: [0x2b525:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.480553:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211004 00000100:00100000:1.0:1651529344.480555:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+498:39030:x1731745946385536:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.480559:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c505a2 lrc: 3/0,1 mode: PW/PW res: [0x2b526:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.480560:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177452 count 1 00010000:00010000:1.0:1651529344.480564:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbf1beb5/0x3234de053c505cc lrc: 3/0,1 mode: --/PW res: [0x2b52c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.480569:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f9ae0c20/0x3234de053c4ddb6 lrc: 2/0,0 mode: PR/PR res: [0x2b52c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2848 expref: 1566 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.480574:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.480575:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.480575:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fbf1beb5/0x3234de053c505cc lrc: 4/0,1 mode: --/PW res: [0x2b52c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.480581:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f9ae0c20/0x3234de053c4ddb6 lrc: 3/0,0 mode: PR/PR res: [0x2b52c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2848 expref: 1566 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.480588:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c505a2 lrc: 3/0,1 mode: PW/PW res: [0x2b526:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.480594:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c505a2 lrc: 3/0,1 mode: PW/PW res: [0x2b526:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.480597:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c505a2 lrc: 2/0,0 mode: PW/PW res: [0x2b526:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.480598:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f9ae0c20/0x3234de053c4ddb6 lrc: 4/0,0 mode: PR/PR res: [0x2b52c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2848 expref: 1566 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.480602:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004972eb27 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996971008:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.480612:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fb6c773d going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.480626:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.480635:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+499:39029:x1731745946384704:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1045us (1112us total) trans 12885079053 rc 0/0 00000100:00100000:0.0:1651529344.480638:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210998 00000100:00100000:0.0:1651529344.480643:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946385600 00000100:00100000:0.0:1651529344.480653:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211005 00000100:00100000:0.0:1651529344.480654:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+499:39029:x1731745946385600:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.480659:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177453 count 1 00010000:00010000:0.0:1651529344.480663:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c505d3 lrc: 3/0,1 mode: --/PW res: [0x2b52d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.480667:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000003e92419/0x3234de053c4d980 lrc: 2/0,0 mode: PR/PR res: [0x2b52d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1682 expref: 1566 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.480671:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.480671:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.480672:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c505d3 lrc: 4/0,1 mode: --/PW res: [0x2b52d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.480678:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000003e92419/0x3234de053c4d980 lrc: 3/0,0 mode: PR/PR res: [0x2b52d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1682 expref: 1566 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.480684:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000003e92419/0x3234de053c4d980 lrc: 4/0,0 mode: PR/PR res: [0x2b52d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1682 expref: 1566 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.480688:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996971072:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.480717:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000000d706dff going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.480723:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c505a2 lrc: 2/0,0 mode: PW/PW res: [0x2b526:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.480727:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000011a71df9 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.480728:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c505a2 lrc: 2/0,0 mode: PW/PW res: [0x2b526:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.480731:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c505a2 lrc: 3/0,0 mode: PW/PW res: [0x2b526:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.480742:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c505a2 lrc: 1/0,0 mode: --/PW res: [0x2b526:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.480745:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c505a2 lrc: 0/0,0 mode: --/PW res: [0x2b526:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.480817:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.480828:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946385664 00000100:00100000:0.0:1651529344.480839:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211006 00000100:00100000:0.0:1651529344.480841:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+500:39029:x1731745946385664:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.480846:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177454 count 1 00010000:00010000:0.0:1651529344.480850:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002264598a/0x3234de053c505da lrc: 3/0,1 mode: --/PW res: [0x2b52e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.480854:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d7225c96/0x3234de053c4e939 lrc: 2/0,0 mode: PR/PR res: [0x2b52e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d55f9 expref: 1566 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.480857:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.480858:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.480858:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002264598a/0x3234de053c505da lrc: 4/0,1 mode: --/PW res: [0x2b52e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.480865:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d7225c96/0x3234de053c4e939 lrc: 3/0,0 mode: PR/PR res: [0x2b52e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d55f9 expref: 1566 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.480868:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d7225c96/0x3234de053c4e939 lrc: 4/0,0 mode: PR/PR res: [0x2b52e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d55f9 expref: 1566 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.480872:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996971136:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.480886:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060852af0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.481098:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996970688:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.481103:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.481103:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c505a9 lrc: 3/0,1 mode: --/PW res: [0x2b527:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.481113:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.481117:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996970880:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.481119:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008619c536/0x3234de053c505b7 lrc: 3/0,1 mode: --/PW res: [0x2b528:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.481120:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.481129:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.481133:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396265984 00000100:00100000:1.0:1651529344.481135:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.481138:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003a4fe8ca/0x3234de053c4ec42 lrc: 5/0,0 mode: PR/PR res: [0x2b529:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6271 expref: 1567 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.481143:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396266112 00010000:00010000:0.0:1651529344.481145:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004f625209/0x3234de053c4dca5 lrc: 5/0,0 mode: PR/PR res: [0x2b52a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2301 expref: 1568 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.481150:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.481150:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396265920 00010000:00010000:0.0:1651529344.481152:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008eb0a7f4/0x3234de053c4ee17 lrc: 4/0,0 mode: PR/PR res: [0x2b527:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a7b expref: 1569 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.481167:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005d3fb3ef pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996970752:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.481172:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396266048 00010000:00010000:1.0:1651529344.481176:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004d5eac2c/0x3234de053c505b0 lrc: 3/0,1 mode: --/PW res: [0x2b529:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481176:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b2e0184e/0x3234de053c4e17c lrc: 4/0,0 mode: PR/PR res: [0x2b528:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d36fe expref: 1570 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.481182:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396266176 00000100:00100000:1.0:1651529344.481184:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005d2b5bb3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996970816:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.481184:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002b6259c5/0x3234de053c4dc0b lrc: 5/0,0 mode: PR/PR res: [0x2b52b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2068 expref: 1571 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.481187:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c505be lrc: 3/0,1 mode: --/PW res: [0x2b52a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.481188:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396266240 00010000:00010000:0.0:1651529344.481190:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f9ae0c20/0x3234de053c4ddb6 lrc: 5/0,0 mode: PR/PR res: [0x2b52c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2848 expref: 1572 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.481193:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004972eb27 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996971008:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.481194:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11781 00010000:00010000:1.0:1651529344.481195:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fbf1beb5/0x3234de053c505cc lrc: 3/0,1 mode: --/PW res: [0x2b52c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.481196:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1572:41279:x1731746396265984:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.481200:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.481201:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003a4fe8ca/0x3234de053c4ec42 lrc: 4/0,0 mode: PR/PR res: [0x2b529:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6271 expref: 1572 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.481202:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11782 00000100:00100000:1.0:1651529344.481204:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1572:41279:x1731746396266112:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.481207:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.481209:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004f625209/0x3234de053c4dca5 lrc: 4/0,0 mode: PR/PR res: [0x2b52a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2301 expref: 1572 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.481213:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004f625209/0x3234de053c4dca5 lrc: 3/0,0 mode: PR/PR res: [0x2b52a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2301 expref: 1572 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.481215:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003a4fe8ca/0x3234de053c4ec42 lrc: 3/0,0 mode: PR/PR res: [0x2b529:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6271 expref: 1572 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.481218:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f625209/0x3234de053c4dca5 lrc: 0/0,0 mode: --/PR res: [0x2b52a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2301 expref: 1572 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.481221:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a4fe8ca/0x3234de053c4ec42 lrc: 0/0,0 mode: --/PR res: [0x2b529:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6271 expref: 1571 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.481237:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.481237:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.481238:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c505be lrc: 3/0,1 mode: PW/PW res: [0x2b52a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.481242:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c505be lrc: 4/0,1 mode: PW/PW res: [0x2b52a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481242:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.481242:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.481243:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004d5eac2c/0x3234de053c505b0 lrc: 3/0,1 mode: PW/PW res: [0x2b529:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481247:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d5eac2c/0x3234de053c505b0 lrc: 4/0,1 mode: PW/PW res: [0x2b529:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.481251:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.481256:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.481265:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1570:41279:x1731746396266112:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 60us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.481265:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1570:41279:x1731746396265984:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 69us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.481268:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11782 00000100:00100000:0.0:1651529344.481269:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11781 00000100:00100000:1.0:1651529344.481274:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11783 00000100:00100000:1.0:1651529344.481275:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1568:41279:x1731746396265920:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.481275:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11784 00000100:00100000:0.0:1651529344.481277:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000066a4e147 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1568:41279:x1731746396266048:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.481278:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.481280:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008eb0a7f4/0x3234de053c4ee17 lrc: 4/0,0 mode: PR/PR res: [0x2b527:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a7b expref: 1568 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.481280:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.481282:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b2e0184e/0x3234de053c4e17c lrc: 4/0,0 mode: PR/PR res: [0x2b528:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d36fe expref: 1568 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.481284:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008eb0a7f4/0x3234de053c4ee17 lrc: 3/0,0 mode: PR/PR res: [0x2b527:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a7b expref: 1568 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.481288:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008eb0a7f4/0x3234de053c4ee17 lrc: 0/0,0 mode: --/PR res: [0x2b527:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a7b expref: 1568 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.481288:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b2e0184e/0x3234de053c4e17c lrc: 3/0,0 mode: PR/PR res: [0x2b528:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d36fe expref: 1568 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.481292:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.481292:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.481293:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c505a9 lrc: 3/0,1 mode: PW/PW res: [0x2b527:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481293:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2e0184e/0x3234de053c4e17c lrc: 0/0,0 mode: --/PR res: [0x2b528:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d36fe expref: 1567 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.481296:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c505a9 lrc: 4/0,1 mode: PW/PW res: [0x2b527:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481296:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.481296:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.481297:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008619c536/0x3234de053c505b7 lrc: 3/0,1 mode: PW/PW res: [0x2b528:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481300:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008619c536/0x3234de053c505b7 lrc: 4/0,1 mode: PW/PW res: [0x2b528:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.481305:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.481311:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1566:41279:x1731746396265920:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 35us (191us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.481312:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.481314:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11783 00000100:00100000:1.0:1651529344.481318:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11785 00000100:00100000:0.0:1651529344.481318:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000066a4e147 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1565:41279:x1731746396266048:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 40us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.481320:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1565:41279:x1731746396266176:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.481321:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11784 00010000:00010000:1.0:1651529344.481322:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.481324:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002b6259c5/0x3234de053c4dc0b lrc: 5/0,0 mode: PR/PR res: [0x2b52b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2068 expref: 1564 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.481327:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002b6259c5/0x3234de053c4dc0b lrc: 4/0,0 mode: PR/PR res: [0x2b52b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2068 expref: 1564 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.481329:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11786 00000100:00100000:0.0:1651529344.481331:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1564:41279:x1731746396266240:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.481332:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.481332:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.481333:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000b169871/0x3234de053c505c5 lrc: 3/0,1 mode: PW/PW res: [0x2b52b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481334:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.481335:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f9ae0c20/0x3234de053c4ddb6 lrc: 4/0,0 mode: PR/PR res: [0x2b52c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2848 expref: 1564 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.481336:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b169871/0x3234de053c505c5 lrc: 4/0,1 mode: PW/PW res: [0x2b52b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481339:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f9ae0c20/0x3234de053c4ddb6 lrc: 3/0,0 mode: PR/PR res: [0x2b52c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2848 expref: 1564 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.481340:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.481344:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1564:41279:x1731746396266176:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 24us (209us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.481344:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9ae0c20/0x3234de053c4ddb6 lrc: 0/0,0 mode: --/PR res: [0x2b52c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2848 expref: 1564 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.481347:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11785 00010000:00010000:0.0:1651529344.481347:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.481348:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.481349:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fbf1beb5/0x3234de053c505cc lrc: 3/0,1 mode: PW/PW res: [0x2b52c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481351:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fbf1beb5/0x3234de053c505cc lrc: 4/0,1 mode: PW/PW res: [0x2b52c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.481352:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c505be lrc: 3/0,1 mode: PW/PW res: [0x2b52a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.481356:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c505be lrc: 3/0,1 mode: PW/PW res: [0x2b52a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481361:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.481365:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c505be lrc: 3/0,1 mode: PW/PW res: [0x2b52a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.481367:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1562:41279:x1731746396266240:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 35us (216us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.481368:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c505be lrc: 2/0,0 mode: PW/PW res: [0x2b52a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.481369:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11786 00010000:00010000:0.0:1651529344.481385:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c505be lrc: 2/0,0 mode: PW/PW res: [0x2b52a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481389:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ce532454 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.481390:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c505be lrc: 2/0,0 mode: PW/PW res: [0x2b52a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481393:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c505be lrc: 3/0,0 mode: PW/PW res: [0x2b52a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481397:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c505be lrc: 1/0,0 mode: --/PW res: [0x2b52a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481402:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce532454/0x3234de053c505be lrc: 0/0,0 mode: --/PW res: [0x2b52a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481408:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008619c536/0x3234de053c505b7 lrc: 3/0,1 mode: PW/PW res: [0x2b528:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481410:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008619c536/0x3234de053c505b7 lrc: 3/0,1 mode: PW/PW res: [0x2b528:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.481413:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+501:39030:x1731745946384960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1094us (1172us total) trans 12885079054 rc 0/0 00010000:00010000:0.0:1651529344.481413:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008619c536/0x3234de053c505b7 lrc: 3/0,1 mode: PW/PW res: [0x2b528:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.481416:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211002 00010000:00010000:0.0:1651529344.481416:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008619c536/0x3234de053c505b7 lrc: 2/0,0 mode: PW/PW res: [0x2b528:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.481423:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fbf1beb5/0x3234de053c505cc lrc: 3/0,1 mode: PW/PW res: [0x2b52c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.481426:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fbf1beb5/0x3234de053c505cc lrc: 3/0,1 mode: PW/PW res: [0x2b52c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.481429:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbf1beb5/0x3234de053c505cc lrc: 3/0,1 mode: PW/PW res: [0x2b52c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.481431:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fbf1beb5/0x3234de053c505cc lrc: 2/0,0 mode: PW/PW res: [0x2b52c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.481462:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+502:39030:x1731745946384832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1153us (1245us total) trans 12885079055 rc 0/0 00000100:00100000:0.0:1651529344.481465:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211001 00000100:00100000:1.0:1651529344.481470:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+501:39030:x1731745946385536:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 914us (971us total) trans 12885079056 rc 0/0 00010000:00010000:0.0:1651529344.481472:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008619c536/0x3234de053c505b7 lrc: 2/0,0 mode: PW/PW res: [0x2b528:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.481473:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211004 00010000:00010000:0.0:1651529344.481475:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008619c536 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.481476:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008619c536/0x3234de053c505b7 lrc: 2/0,0 mode: PW/PW res: [0x2b528:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481479:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008619c536/0x3234de053c505b7 lrc: 3/0,0 mode: PW/PW res: [0x2b528:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.481480:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004d5eac2c/0x3234de053c505b0 lrc: 3/0,1 mode: PW/PW res: [0x2b529:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481484:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008619c536/0x3234de053c505b7 lrc: 1/0,0 mode: --/PW res: [0x2b528:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.481486:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d5eac2c/0x3234de053c505b0 lrc: 3/0,1 mode: PW/PW res: [0x2b529:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481487:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008619c536/0x3234de053c505b7 lrc: 0/0,0 mode: --/PW res: [0x2b528:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.481489:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d5eac2c/0x3234de053c505b0 lrc: 3/0,1 mode: PW/PW res: [0x2b529:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.481491:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d5eac2c/0x3234de053c505b0 lrc: 2/0,0 mode: PW/PW res: [0x2b529:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481491:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fbf1beb5/0x3234de053c505cc lrc: 2/0,0 mode: PW/PW res: [0x2b52c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481494:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fbf1beb5 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.481494:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbf1beb5/0x3234de053c505cc lrc: 2/0,0 mode: PW/PW res: [0x2b52c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481497:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbf1beb5/0x3234de053c505cc lrc: 3/0,0 mode: PW/PW res: [0x2b52c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481521:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fbf1beb5/0x3234de053c505cc lrc: 1/0,0 mode: --/PW res: [0x2b52c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481524:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fbf1beb5/0x3234de053c505cc lrc: 0/0,0 mode: --/PW res: [0x2b52c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.481527:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+501:39030:x1731745946384896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1268us (1366us total) trans 12885079057 rc 0/0 00010000:00010000:0.0:1651529344.481528:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d5eac2c/0x3234de053c505b0 lrc: 2/0,0 mode: PW/PW res: [0x2b529:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.481530:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211000 00010000:00010000:0.0:1651529344.481531:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004d5eac2c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.481532:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d5eac2c/0x3234de053c505b0 lrc: 2/0,0 mode: PW/PW res: [0x2b529:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481535:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d5eac2c/0x3234de053c505b0 lrc: 3/0,0 mode: PW/PW res: [0x2b529:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481538:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d5eac2c/0x3234de053c505b0 lrc: 1/0,0 mode: --/PW res: [0x2b529:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481541:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d5eac2c/0x3234de053c505b0 lrc: 0/0,0 mode: --/PW res: [0x2b529:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481548:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c505a9 lrc: 3/0,1 mode: PW/PW res: [0x2b527:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481551:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c505a9 lrc: 3/0,1 mode: PW/PW res: [0x2b527:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481553:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c505a9 lrc: 3/0,1 mode: PW/PW res: [0x2b527:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481556:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c505a9 lrc: 2/0,0 mode: PW/PW res: [0x2b527:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.481590:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.481600:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.481611:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+501:39030:x1731745946384768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1411us (1498us total) trans 12885079058 rc 0/0 00000100:00100000:0.0:1651529344.481614:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 210999 00010000:00010000:0.0:1651529344.481620:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c505a9 lrc: 2/0,0 mode: PW/PW res: [0x2b527:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481626:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008531b741 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.481627:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c505a9 lrc: 2/0,0 mode: PW/PW res: [0x2b527:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481630:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c505a9 lrc: 3/0,0 mode: PW/PW res: [0x2b527:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481634:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c505a9 lrc: 1/0,0 mode: --/PW res: [0x2b527:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481637:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008531b741/0x3234de053c505a9 lrc: 0/0,0 mode: --/PW res: [0x2b527:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.481646:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996971072:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.481650:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c505d3 lrc: 3/0,1 mode: --/PW res: [0x2b52d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.481657:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996971136:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.481659:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002264598a/0x3234de053c505da lrc: 3/0,1 mode: --/PW res: [0x2b52e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.481665:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396266368 00010000:00010000:0.0:1651529344.481669:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d7225c96/0x3234de053c4e939 lrc: 4/0,0 mode: PR/PR res: [0x2b52e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d55f9 expref: 1562 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.481682:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396266304 00010000:00010000:0.0:1651529344.481685:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000003e92419/0x3234de053c4d980 lrc: 4/0,0 mode: PR/PR res: [0x2b52d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1682 expref: 1563 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.481707:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11787 00000100:00100000:1.0:1651529344.481709:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1563:41279:x1731746396266368:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.481709:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11788 00000100:00100000:0.0:1651529344.481711:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1563:41278:x1731746396266304:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.481713:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.481714:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.481715:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d7225c96/0x3234de053c4e939 lrc: 4/0,0 mode: PR/PR res: [0x2b52e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d55f9 expref: 1563 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.481716:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000003e92419/0x3234de053c4d980 lrc: 4/0,0 mode: PR/PR res: [0x2b52d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1682 expref: 1563 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.481719:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d7225c96/0x3234de053c4e939 lrc: 3/0,0 mode: PR/PR res: [0x2b52e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d55f9 expref: 1563 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.481720:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000003e92419/0x3234de053c4d980 lrc: 3/0,0 mode: PR/PR res: [0x2b52d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1682 expref: 1563 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.481725:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7225c96/0x3234de053c4e939 lrc: 0/0,0 mode: --/PR res: [0x2b52e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d55f9 expref: 1563 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.481725:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003e92419/0x3234de053c4d980 lrc: 0/0,0 mode: --/PR res: [0x2b52d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1682 expref: 1563 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.481731:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.481732:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.481733:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002264598a/0x3234de053c505da lrc: 3/0,1 mode: PW/PW res: [0x2b52e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.481746:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002264598a/0x3234de053c505da lrc: 4/0,1 mode: PW/PW res: [0x2b52e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481748:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.481749:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.481750:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c505d3 lrc: 3/0,1 mode: PW/PW res: [0x2b52d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.481755:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.481759:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c505d3 lrc: 4/0,1 mode: PW/PW res: [0x2b52d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.481764:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1561:41279:x1731746396266368:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 55us (175us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.481766:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.481767:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11787 00000100:00100000:0.0:1651529344.481774:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1560:41278:x1731746396266304:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 63us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.481777:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11788 00010000:00010000:0.0:1651529344.481784:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c505d3 lrc: 3/0,1 mode: PW/PW res: [0x2b52d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481787:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c505d3 lrc: 3/0,1 mode: PW/PW res: [0x2b52d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481790:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c505d3 lrc: 3/0,1 mode: PW/PW res: [0x2b52d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481793:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c505d3 lrc: 2/0,0 mode: PW/PW res: [0x2b52d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.481853:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.481864:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.481871:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+501:39029:x1731745946385600:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1216us (1245us total) trans 12885079059 rc 0/0 00000100:00100000:0.0:1651529344.481874:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211005 00000100:00100000:0.0:1651529344.481879:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946385920 00000100:00100000:0.0:1651529344.481886:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946386048 00000100:00100000:0.0:1651529344.481891:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211007 00000100:00100000:0.0:1651529344.481893:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+502:39030:x1731745946385920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.481898:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177456 count 1 00010000:00010000:0.0:1651529344.481902:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c505e1 lrc: 3/0,1 mode: --/PW res: [0x2b530:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.481903:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.481907:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a04817cf/0x3234de053c4cf1c lrc: 2/0,0 mode: PR/PR res: [0x2b530:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee34 expref: 1559 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.481910:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.481912:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.481913:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.481913:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c505e1 lrc: 4/0,1 mode: --/PW res: [0x2b530:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.481916:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.481920:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a04817cf/0x3234de053c4cf1c lrc: 3/0,0 mode: PR/PR res: [0x2b530:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee34 expref: 1559 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.481923:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946385856 00010000:00010000:0.0:1651529344.481924:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a04817cf/0x3234de053c4cf1c lrc: 4/0,0 mode: PR/PR res: [0x2b530:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee34 expref: 1559 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.481928:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996971200:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.481929:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946385984 00000100:00100000:1.0:1651529344.481932:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946386112 00000100:00100000:1.0:1651529344.481935:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211008 00000100:00100000:1.0:1651529344.481937:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+505:39030:x1731745946386048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.481941:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000000e7e66c4 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.481946:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c505d3 lrc: 2/0,0 mode: PW/PW res: [0x2b52d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.481948:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177458 count 1 00010000:00010000:0.0:1651529344.481949:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ee8bd35b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.481951:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c505d3 lrc: 2/0,0 mode: PW/PW res: [0x2b52d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.481953:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c016e55/0x3234de053c505e8 lrc: 3/0,1 mode: --/PW res: [0x2b532:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481953:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c505d3 lrc: 3/0,0 mode: PW/PW res: [0x2b52d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.481958:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000934ba032/0x3234de053c4ca8b lrc: 2/0,0 mode: PR/PR res: [0x2b532:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdbc6 expref: 1559 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.481958:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c505d3 lrc: 1/0,0 mode: --/PW res: [0x2b52d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.481962:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.481962:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.481963:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c016e55/0x3234de053c505e8 lrc: 4/0,1 mode: --/PW res: [0x2b532:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481963:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee8bd35b/0x3234de053c505d3 lrc: 0/0,0 mode: --/PW res: [0x2b52d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.481969:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000934ba032/0x3234de053c4ca8b lrc: 3/0,0 mode: PR/PR res: [0x2b532:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdbc6 expref: 1559 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.481971:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211009 00010000:00010000:1.0:1651529344.481973:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000934ba032/0x3234de053c4ca8b lrc: 4/0,0 mode: PR/PR res: [0x2b532:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdbc6 expref: 1559 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.481973:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+505:39029:x1731745946385856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.481977:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000055e03b4f pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996971264:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.481977:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177455 count 1 00010000:00010000:0.0:1651529344.481980:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c505ef lrc: 3/0,1 mode: --/PW res: [0x2b52f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.481984:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000737717cf/0x3234de053c4cfd9 lrc: 2/0,0 mode: PR/PR res: [0x2b52f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf0e2 expref: 1559 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.481986:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 000000004698fefb going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.481987:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.481987:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.481988:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c505ef lrc: 4/0,1 mode: --/PW res: [0x2b52f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.481992:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211010 00010000:00010000:0.0:1651529344.481994:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000737717cf/0x3234de053c4cfd9 lrc: 3/0,0 mode: PR/PR res: [0x2b52f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf0e2 expref: 1559 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.481995:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+505:39029:x1731745946385984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.481999:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177457 count 1 00010000:00010000:1.0:1651529344.482002:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c505f6 lrc: 3/0,1 mode: --/PW res: [0x2b531:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.482006:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d6aab5fe/0x3234de053c4df45 lrc: 2/0,0 mode: PR/PR res: [0x2b531:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e37 expref: 1559 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.482009:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.482010:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.482011:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c505f6 lrc: 4/0,1 mode: --/PW res: [0x2b531:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482014:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000737717cf/0x3234de053c4cfd9 lrc: 4/0,0 mode: PR/PR res: [0x2b52f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf0e2 expref: 1559 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.482019:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d6aab5fe/0x3234de053c4df45 lrc: 3/0,0 mode: PR/PR res: [0x2b531:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e37 expref: 1559 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.482019:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996971328:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.482023:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d6aab5fe/0x3234de053c4df45 lrc: 4/0,0 mode: PR/PR res: [0x2b531:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e37 expref: 1559 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.482026:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000533fe698 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996971392:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.482028:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed830649 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.482033:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f9dac3f6 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.482033:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002264598a/0x3234de053c505da lrc: 3/0,1 mode: PW/PW res: [0x2b52e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482036:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002264598a/0x3234de053c505da lrc: 3/0,1 mode: PW/PW res: [0x2b52e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.482038:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211011 00010000:00010000:0.0:1651529344.482039:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002264598a/0x3234de053c505da lrc: 3/0,1 mode: PW/PW res: [0x2b52e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.482040:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+505:39029:x1731745946386112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.482042:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002264598a/0x3234de053c505da lrc: 2/0,0 mode: PW/PW res: [0x2b52e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.482043:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177459 count 1 00010000:00010000:1.0:1651529344.482046:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c505fd lrc: 3/0,1 mode: --/PW res: [0x2b533:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.482050:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c4f5f7 lrc: 2/0,0 mode: PR/PR res: [0x2b533:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a3a expref: 1559 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.482053:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.482054:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.482054:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c505fd lrc: 4/0,1 mode: --/PW res: [0x2b533:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.482060:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c4f5f7 lrc: 3/0,0 mode: PR/PR res: [0x2b533:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a3a expref: 1559 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.482063:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c4f5f7 lrc: 4/0,0 mode: PR/PR res: [0x2b533:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a3a expref: 1559 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.482067:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029abc941 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996971456:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.482073:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.482079:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+506:39029:x1731745946385664:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1237us (1261us total) trans 12885079060 rc 0/0 00000100:00100000:0.0:1651529344.482081:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211006 00000100:00100000:1.0:1651529344.482088:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.482088:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002264598a/0x3234de053c505da lrc: 2/0,0 mode: PW/PW res: [0x2b52e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482091:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002264598a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.482092:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002264598a/0x3234de053c505da lrc: 2/0,0 mode: PW/PW res: [0x2b52e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482103:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002264598a/0x3234de053c505da lrc: 3/0,0 mode: PW/PW res: [0x2b52e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482108:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002264598a/0x3234de053c505da lrc: 1/0,0 mode: --/PW res: [0x2b52e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482111:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002264598a/0x3234de053c505da lrc: 0/0,0 mode: --/PW res: [0x2b52e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.482118:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946386176 00000100:00100000:0.0:1651529344.482128:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211012 00000100:00100000:0.0:1651529344.482129:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+506:39030:x1731745946386176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.482134:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177460 count 1 00010000:00010000:0.0:1651529344.482138:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000046cb20e/0x3234de053c50604 lrc: 3/0,1 mode: --/PW res: [0x2b534:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482142:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c4cc28 lrc: 2/0,0 mode: PR/PR res: [0x2b534:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce26b expref: 1559 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.482145:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.482146:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.482147:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000046cb20e/0x3234de053c50604 lrc: 4/0,1 mode: --/PW res: [0x2b534:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482153:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c4cc28 lrc: 3/0,0 mode: PR/PR res: [0x2b534:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce26b expref: 1559 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.482156:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c4cc28 lrc: 4/0,0 mode: PR/PR res: [0x2b534:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce26b expref: 1559 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.482160:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996971520:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.482174:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c086aae3 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.482184:0:156655:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b6259c5/0x3234de053c4dc0b lrc: 0/0,0 mode: --/PR res: [0x2b52b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2068 expref: 1559 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.482207:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996970944:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.482211:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000b169871/0x3234de053c505c5 lrc: 3/0,1 mode: PW/PW res: [0x2b52b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482214:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000b169871/0x3234de053c505c5 lrc: 3/0,1 mode: PW/PW res: [0x2b52b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482250:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b169871/0x3234de053c505c5 lrc: 3/0,1 mode: PW/PW res: [0x2b52b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.482252:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.482254:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b169871/0x3234de053c505c5 lrc: 3/0,1 mode: PW/PW res: [0x2b52b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482262:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b169871/0x3234de053c505c5 lrc: 2/0,0 mode: PW/PW res: [0x2b52b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.482307:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+507:39030:x1731745946385408:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1846us (1868us total) trans 12885079061 rc 0/0 00000100:00100000:0.0:1651529344.482310:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211003 00000100:00100000:0.0:1651529344.482315:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946386240 00000100:00100000:0.0:1651529344.482323:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211013 00000100:00100000:0.0:1651529344.482325:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040ea0b53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+507:39029:x1731745946386240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.482330:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177461 count 1 00010000:00010000:0.0:1651529344.482334:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f3c2fb2/0x3234de053c5060b lrc: 3/0,1 mode: --/PW res: [0x2b535:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482341:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002e4b14da/0x3234de053c4f509 lrc: 2/0,0 mode: PR/PR res: [0x2b535:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d86ac expref: 1558 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.482344:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.482344:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.482345:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f3c2fb2/0x3234de053c5060b lrc: 4/0,1 mode: --/PW res: [0x2b535:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482351:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002e4b14da/0x3234de053c4f509 lrc: 3/0,0 mode: PR/PR res: [0x2b535:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d86ac expref: 1558 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.482355:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002e4b14da/0x3234de053c4f509 lrc: 4/0,0 mode: PR/PR res: [0x2b535:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d86ac expref: 1558 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.482359:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996971584:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.482372:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a3b00cf3 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.482377:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b169871/0x3234de053c505c5 lrc: 2/0,0 mode: PW/PW res: [0x2b52b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482381:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000b169871 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.482382:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b169871/0x3234de053c505c5 lrc: 2/0,0 mode: PW/PW res: [0x2b52b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482384:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b169871/0x3234de053c505c5 lrc: 3/0,0 mode: PW/PW res: [0x2b52b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482391:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b169871/0x3234de053c505c5 lrc: 1/0,0 mode: --/PW res: [0x2b52b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482394:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b169871/0x3234de053c505c5 lrc: 0/0,0 mode: --/PW res: [0x2b52b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.482481:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.482524:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946386496 00000100:00100000:0.0:1651529344.482535:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211014 00000100:00100000:0.0:1651529344.482536:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+508:39030:x1731745946386496:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.482541:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177462 count 1 00010000:00010000:0.0:1651529344.482545:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005480834d/0x3234de053c50612 lrc: 3/0,1 mode: --/PW res: [0x2b536:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482550:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e7a2d4e3/0x3234de053c4b584 lrc: 2/0,0 mode: PR/PR res: [0x2b536:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc29e expref: 1558 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.482553:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.482553:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.482554:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.482554:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005480834d/0x3234de053c50612 lrc: 4/0,1 mode: --/PW res: [0x2b536:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.482564:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.482571:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e7a2d4e3/0x3234de053c4b584 lrc: 3/0,0 mode: PR/PR res: [0x2b536:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc29e expref: 1558 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.482573:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.482574:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e7a2d4e3/0x3234de053c4b584 lrc: 4/0,0 mode: PR/PR res: [0x2b536:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc29e expref: 1558 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.482580:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.482581:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996971648:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.482587:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.482596:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 0000000076b354b3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.482601:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000055e03b4f pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996971264:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.482604:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996971200:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.482606:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005c016e55/0x3234de053c505e8 lrc: 3/0,1 mode: --/PW res: [0x2b532:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482608:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c505e1 lrc: 3/0,1 mode: --/PW res: [0x2b530:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.482613:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000533fe698 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996971392:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.482614:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996971328:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.482616:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c505f6 lrc: 3/0,1 mode: --/PW res: [0x2b531:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482617:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c505ef lrc: 3/0,1 mode: --/PW res: [0x2b52f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.482622:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029abc941 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996971456:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.482623:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396267008 00010000:00010000:1.0:1651529344.482624:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c505fd lrc: 3/0,1 mode: --/PW res: [0x2b533:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482627:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000737717cf/0x3234de053c4cfd9 lrc: 4/0,0 mode: PR/PR res: [0x2b52f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf0e2 expref: 1559 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.482630:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396267136 00000100:00100000:0.0:1651529344.482633:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396266944 00010000:00010000:1.0:1651529344.482635:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d6aab5fe/0x3234de053c4df45 lrc: 4/0,0 mode: PR/PR res: [0x2b531:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e37 expref: 1561 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.482635:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a04817cf/0x3234de053c4cf1c lrc: 4/0,0 mode: PR/PR res: [0x2b530:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee34 expref: 1561 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.482641:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396267072 00010000:00010000:1.0:1651529344.482643:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000934ba032/0x3234de053c4ca8b lrc: 4/0,0 mode: PR/PR res: [0x2b532:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdbc6 expref: 1562 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.482647:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396267200 00010000:00010000:1.0:1651529344.482649:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c4f5f7 lrc: 4/0,0 mode: PR/PR res: [0x2b533:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a3a expref: 1563 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.482654:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11789 00000100:00100000:1.0:1651529344.482655:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1563:41279:x1731746396267008:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.482658:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.482659:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000737717cf/0x3234de053c4cfd9 lrc: 4/0,0 mode: PR/PR res: [0x2b52f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf0e2 expref: 1563 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.482670:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11790 00000100:00100000:0.0:1651529344.482672:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1563:41279:x1731746396267136:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.482675:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.482676:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000737717cf/0x3234de053c4cfd9 lrc: 3/0,0 mode: PR/PR res: [0x2b52f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf0e2 expref: 1563 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.482677:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d6aab5fe/0x3234de053c4df45 lrc: 4/0,0 mode: PR/PR res: [0x2b531:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e37 expref: 1563 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.482682:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000737717cf/0x3234de053c4cfd9 lrc: 0/0,0 mode: --/PR res: [0x2b52f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf0e2 expref: 1563 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.482683:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d6aab5fe/0x3234de053c4df45 lrc: 3/0,0 mode: PR/PR res: [0x2b531:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e37 expref: 1563 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.482686:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.482687:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.482688:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c505ef lrc: 3/0,1 mode: PW/PW res: [0x2b52f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482689:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6aab5fe/0x3234de053c4df45 lrc: 0/0,0 mode: --/PR res: [0x2b531:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e37 expref: 1562 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.482691:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c505ef lrc: 4/0,1 mode: PW/PW res: [0x2b52f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482693:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.482693:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.482694:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c505f6 lrc: 3/0,1 mode: PW/PW res: [0x2b531:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482697:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c505f6 lrc: 4/0,1 mode: PW/PW res: [0x2b531:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.482701:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.482708:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1561:41279:x1731746396267008:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 52us (154us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.482712:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.482716:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11789 00000100:00100000:0.0:1651529344.482720:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1560:41279:x1731746396267136:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 48us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.482722:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11791 00000100:00100000:1.0:1651529344.482724:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1560:41279:x1731746396267072:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.482724:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11790 00010000:00010000:1.0:1651529344.482726:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.482728:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000934ba032/0x3234de053c4ca8b lrc: 4/0,0 mode: PR/PR res: [0x2b532:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdbc6 expref: 1559 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.482729:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11792 00000100:00100000:0.0:1651529344.482731:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1559:41279:x1731746396267200:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.482732:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000934ba032/0x3234de053c4ca8b lrc: 3/0,0 mode: PR/PR res: [0x2b532:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdbc6 expref: 1559 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.482733:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.482743:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c4f5f7 lrc: 4/0,0 mode: PR/PR res: [0x2b533:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a3a expref: 1559 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.482745:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000934ba032/0x3234de053c4ca8b lrc: 0/0,0 mode: --/PR res: [0x2b532:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdbc6 expref: 1559 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.482747:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c4f5f7 lrc: 3/0,0 mode: PR/PR res: [0x2b533:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a3a expref: 1559 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.482749:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.482749:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.482750:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005c016e55/0x3234de053c505e8 lrc: 3/0,1 mode: PW/PW res: [0x2b532:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482752:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c4f5f7 lrc: 0/0,0 mode: --/PR res: [0x2b533:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a3a expref: 1558 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.482753:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c016e55/0x3234de053c505e8 lrc: 4/0,1 mode: PW/PW res: [0x2b532:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482755:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.482756:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.482757:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c505fd lrc: 3/0,1 mode: PW/PW res: [0x2b533:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.482759:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.482760:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c505fd lrc: 4/0,1 mode: PW/PW res: [0x2b533:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.482766:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1557:41279:x1731746396267072:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 41us (185us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.482768:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.482774:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11791 00000100:00100000:0.0:1651529344.482774:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1557:41279:x1731746396267200:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 43us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.482777:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11792 00000100:00100000:1.0:1651529344.482779:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11793 00000100:00100000:1.0:1651529344.482781:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ccd58b65 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1555:41279:x1731746396266944:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.482783:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.482784:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c505ef lrc: 3/0,1 mode: PW/PW res: [0x2b52f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.482785:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a04817cf/0x3234de053c4cf1c lrc: 4/0,0 mode: PR/PR res: [0x2b530:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee34 expref: 1555 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.482787:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c505ef lrc: 3/0,1 mode: PW/PW res: [0x2b52f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.482789:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a04817cf/0x3234de053c4cf1c lrc: 3/0,0 mode: PR/PR res: [0x2b530:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee34 expref: 1555 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.482790:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c505ef lrc: 3/0,1 mode: PW/PW res: [0x2b52f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482793:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c505ef lrc: 2/0,0 mode: PW/PW res: [0x2b52f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.482794:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a04817cf/0x3234de053c4cf1c lrc: 0/0,0 mode: --/PR res: [0x2b530:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee34 expref: 1555 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.482797:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.482798:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.482799:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c505e1 lrc: 3/0,1 mode: PW/PW res: [0x2b530:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.482801:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c505e1 lrc: 4/0,1 mode: PW/PW res: [0x2b530:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.482810:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.482816:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ccd58b65 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1554:41279:x1731746396266944:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.482818:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11793 00010000:00010000:1.0:1651529344.482829:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c505fd lrc: 3/0,1 mode: PW/PW res: [0x2b533:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.482833:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c505fd lrc: 3/0,1 mode: PW/PW res: [0x2b533:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.482836:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c505fd lrc: 3/0,1 mode: PW/PW res: [0x2b533:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.482838:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c505fd lrc: 2/0,0 mode: PW/PW res: [0x2b533:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.482840:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+509:39029:x1731745946385856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 866us (937us total) trans 12885079062 rc 0/0 00000100:00100000:0.0:1651529344.482843:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211009 00010000:00010000:0.0:1651529344.482857:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c505ef lrc: 2/0,0 mode: PW/PW res: [0x2b52f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482860:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c78576a1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.482861:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c505ef lrc: 2/0,0 mode: PW/PW res: [0x2b52f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482864:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c505ef lrc: 3/0,0 mode: PW/PW res: [0x2b52f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482869:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c505ef lrc: 1/0,0 mode: --/PW res: [0x2b52f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482871:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c505ef lrc: 0/0,0 mode: --/PW res: [0x2b52f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482876:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c505fd lrc: 2/0,0 mode: PW/PW res: [0x2b533:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482878:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e02d2a50 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.482879:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c505fd lrc: 2/0,0 mode: PW/PW res: [0x2b533:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.482882:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+509:39029:x1731745946386112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 841us (965us total) trans 12885079063 rc 0/0 00010000:00010000:0.0:1651529344.482884:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c505fd lrc: 3/0,0 mode: PW/PW res: [0x2b533:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.482885:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211011 00010000:00010000:0.0:1651529344.482888:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c505fd lrc: 1/0,0 mode: --/PW res: [0x2b533:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482890:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c505fd lrc: 0/0,0 mode: --/PW res: [0x2b533:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.482892:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c505f6 lrc: 3/0,1 mode: PW/PW res: [0x2b531:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.482895:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c505f6 lrc: 3/0,1 mode: PW/PW res: [0x2b531:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482896:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c505e1 lrc: 3/0,1 mode: PW/PW res: [0x2b530:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.482898:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c505f6 lrc: 3/0,1 mode: PW/PW res: [0x2b531:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482898:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c505e1 lrc: 3/0,1 mode: PW/PW res: [0x2b530:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.482901:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c505f6 lrc: 2/0,0 mode: PW/PW res: [0x2b531:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482901:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c505e1 lrc: 3/0,1 mode: PW/PW res: [0x2b530:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482904:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c505e1 lrc: 2/0,0 mode: PW/PW res: [0x2b530:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.482938:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+510:39029:x1731745946385984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 943us (1028us total) trans 12885079064 rc 0/0 00000100:00100000:1.0:1651529344.482942:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211010 00000100:00100000:0.0:1651529344.482945:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+509:39030:x1731745946385920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1052us (1092us total) trans 12885079065 rc 0/0 00010000:00010000:1.0:1651529344.482949:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005c016e55/0x3234de053c505e8 lrc: 3/0,1 mode: PW/PW res: [0x2b532:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.482949:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211007 00010000:00010000:1.0:1651529344.482952:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c016e55/0x3234de053c505e8 lrc: 3/0,1 mode: PW/PW res: [0x2b532:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.482955:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c016e55/0x3234de053c505e8 lrc: 3/0,1 mode: PW/PW res: [0x2b532:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482956:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c505f6 lrc: 2/0,0 mode: PW/PW res: [0x2b531:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.482958:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c016e55/0x3234de053c505e8 lrc: 2/0,0 mode: PW/PW res: [0x2b532:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482961:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000677ce99b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.482962:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c505f6 lrc: 2/0,0 mode: PW/PW res: [0x2b531:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482972:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c505f6 lrc: 3/0,0 mode: PW/PW res: [0x2b531:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482977:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c505f6 lrc: 1/0,0 mode: --/PW res: [0x2b531:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482979:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c505f6 lrc: 0/0,0 mode: --/PW res: [0x2b531:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482984:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c505e1 lrc: 2/0,0 mode: PW/PW res: [0x2b530:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482986:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000cfc1a54 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.482987:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c505e1 lrc: 2/0,0 mode: PW/PW res: [0x2b530:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482990:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c505e1 lrc: 3/0,0 mode: PW/PW res: [0x2b530:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.482993:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c505e1 lrc: 1/0,0 mode: --/PW res: [0x2b530:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.482994:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+509:39030:x1731745946386048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1056us (1129us total) trans 12885079066 rc 0/0 00010000:00010000:0.0:1651529344.482995:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c505e1 lrc: 0/0,0 mode: --/PW res: [0x2b530:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.482996:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211008 00010000:00010000:0.0:1651529344.482999:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c016e55/0x3234de053c505e8 lrc: 2/0,0 mode: PW/PW res: [0x2b532:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483002:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005c016e55 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.483003:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c016e55/0x3234de053c505e8 lrc: 2/0,0 mode: PW/PW res: [0x2b532:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483005:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c016e55/0x3234de053c505e8 lrc: 3/0,0 mode: PW/PW res: [0x2b532:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483008:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c016e55/0x3234de053c505e8 lrc: 1/0,0 mode: --/PW res: [0x2b532:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483011:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c016e55/0x3234de053c505e8 lrc: 0/0,0 mode: --/PW res: [0x2b532:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.483026:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996971520:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.483035:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000046cb20e/0x3234de053c50604 lrc: 3/0,1 mode: --/PW res: [0x2b534:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.483037:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.483041:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396267264 00010000:00010000:0.0:1651529344.483046:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c4cc28 lrc: 4/0,0 mode: PR/PR res: [0x2b534:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce26b expref: 1554 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.483048:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.483053:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396267328 00010000:00010000:0.0:1651529344.483055:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002e4b14da/0x3234de053c4f509 lrc: 5/0,0 mode: PR/PR res: [0x2b535:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d86ac expref: 1555 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.483060:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11794 00000100:00100000:0.0:1651529344.483062:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1555:41279:x1731746396267264:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.483064:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.483065:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c4cc28 lrc: 4/0,0 mode: PR/PR res: [0x2b534:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce26b expref: 1555 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.483069:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c4cc28 lrc: 3/0,0 mode: PR/PR res: [0x2b534:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce26b expref: 1555 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.483074:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c4cc28 lrc: 0/0,0 mode: --/PR res: [0x2b534:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce26b expref: 1555 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.483077:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.483078:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.483079:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000046cb20e/0x3234de053c50604 lrc: 3/0,1 mode: PW/PW res: [0x2b534:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483082:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000046cb20e/0x3234de053c50604 lrc: 4/0,1 mode: PW/PW res: [0x2b534:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483088:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.483094:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1554:41279:x1731746396267264:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (58us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.483097:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11794 00000100:00100000:0.0:1651529344.483101:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11795 00000100:00100000:0.0:1651529344.483103:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1553:41279:x1731746396267328:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.483105:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.483106:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002e4b14da/0x3234de053c4f509 lrc: 5/0,0 mode: PR/PR res: [0x2b535:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d86ac expref: 1553 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.483109:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002e4b14da/0x3234de053c4f509 lrc: 4/0,0 mode: PR/PR res: [0x2b535:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d86ac expref: 1553 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.483114:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.483114:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.483115:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001f3c2fb2/0x3234de053c5060b lrc: 3/0,1 mode: PW/PW res: [0x2b535:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483118:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f3c2fb2/0x3234de053c5060b lrc: 4/0,1 mode: PW/PW res: [0x2b535:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483122:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.483126:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1553:41279:x1731746396267328:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 23us (78us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.483128:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11795 00010000:00010000:0.0:1651529344.483133:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000046cb20e/0x3234de053c50604 lrc: 3/0,1 mode: PW/PW res: [0x2b534:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483136:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000046cb20e/0x3234de053c50604 lrc: 3/0,1 mode: PW/PW res: [0x2b534:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483157:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000046cb20e/0x3234de053c50604 lrc: 3/0,1 mode: PW/PW res: [0x2b534:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483162:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000046cb20e/0x3234de053c50604 lrc: 2/0,0 mode: PW/PW res: [0x2b534:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.483206:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+509:39030:x1731745946386176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1076us (1118us total) trans 12885079067 rc 0/0 00000100:00100000:0.0:1651529344.483233:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211012 00010000:00010000:0.0:1651529344.483247:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000046cb20e/0x3234de053c50604 lrc: 2/0,0 mode: PW/PW res: [0x2b534:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483251:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000046cb20e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.483252:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000046cb20e/0x3234de053c50604 lrc: 2/0,0 mode: PW/PW res: [0x2b534:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483267:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000046cb20e/0x3234de053c50604 lrc: 3/0,0 mode: PW/PW res: [0x2b534:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483273:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000046cb20e/0x3234de053c50604 lrc: 1/0,0 mode: --/PW res: [0x2b534:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483276:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000046cb20e/0x3234de053c50604 lrc: 0/0,0 mode: --/PW res: [0x2b534:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483288:0:156655:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e4b14da/0x3234de053c4f509 lrc: 0/0,0 mode: --/PR res: [0x2b535:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d86ac expref: 1552 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.483291:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996971584:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.483295:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001f3c2fb2/0x3234de053c5060b lrc: 3/0,1 mode: PW/PW res: [0x2b535:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483298:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001f3c2fb2/0x3234de053c5060b lrc: 3/0,1 mode: PW/PW res: [0x2b535:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483301:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f3c2fb2/0x3234de053c5060b lrc: 3/0,1 mode: PW/PW res: [0x2b535:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483304:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f3c2fb2/0x3234de053c5060b lrc: 3/0,1 mode: PW/PW res: [0x2b535:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483306:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f3c2fb2/0x3234de053c5060b lrc: 2/0,0 mode: PW/PW res: [0x2b535:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.483370:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.483375:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040ea0b53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+509:39029:x1731745946386240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1049us (1123us total) trans 12885079068 rc 0/0 00000100:00100000:0.0:1651529344.483378:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211013 00000100:00100000:1.0:1651529344.483413:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.483413:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946386880 00000100:00100000:0.0:1651529344.483422:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946386944 00000100:00100000:1.0:1651529344.483425:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.483427:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946387072 00000100:00100000:0.0:1651529344.483434:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211015 00000100:00100000:0.0:1651529344.483435:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+511:39029:x1731745946386880:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.483437:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.483446:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.483446:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177463 count 1 00010000:00010000:0.0:1651529344.483450:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c1791d6/0x3234de053c50619 lrc: 3/0,1 mode: --/PW res: [0x2b537:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.483453:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.483455:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea4be947/0x3234de053c4e9e1 lrc: 2/0,0 mode: PR/PR res: [0x2b537:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58fb expref: 1551 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.483458:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.483459:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.483459:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c1791d6/0x3234de053c50619 lrc: 4/0,1 mode: --/PW res: [0x2b537:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.483460:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946387200 00010000:00010000:0.0:1651529344.483466:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ea4be947/0x3234de053c4e9e1 lrc: 3/0,0 mode: PR/PR res: [0x2b537:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58fb expref: 1551 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.483467:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946387136 00000100:00100000:1.0:1651529344.483469:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946387264 00010000:00010000:0.0:1651529344.483470:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ea4be947/0x3234de053c4e9e1 lrc: 4/0,0 mode: PR/PR res: [0x2b537:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58fb expref: 1551 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.483472:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211016 00000100:00100000:1.0:1651529344.483474:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+514:39030:x1731745946386944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.483474:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996971712:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.483480:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177464 count 1 00010000:00010000:1.0:1651529344.483484:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c50620 lrc: 3/0,1 mode: --/PW res: [0x2b538:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.483496:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000049a3c67c/0x3234de053c4e1de lrc: 2/0,0 mode: PR/PR res: [0x2b538:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d38a9 expref: 1551 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.483499:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.483500:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.483500:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c50620 lrc: 4/0,1 mode: --/PW res: [0x2b538:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.483501:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 0000000009370c1d going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.483507:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000049a3c67c/0x3234de053c4e1de lrc: 3/0,0 mode: PR/PR res: [0x2b538:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d38a9 expref: 1551 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.483511:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000049a3c67c/0x3234de053c4e1de lrc: 4/0,0 mode: PR/PR res: [0x2b538:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d38a9 expref: 1551 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.483515:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cee35a0c pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996971776:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.483524:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000babe2d90 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.483527:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f3c2fb2/0x3234de053c5060b lrc: 2/0,0 mode: PW/PW res: [0x2b535:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483531:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001f3c2fb2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.483532:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f3c2fb2/0x3234de053c5060b lrc: 2/0,0 mode: PW/PW res: [0x2b535:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483535:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f3c2fb2/0x3234de053c5060b lrc: 3/0,0 mode: PW/PW res: [0x2b535:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.483538:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211017 00000100:00100000:1.0:1651529344.483540:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+514:39030:x1731745946387072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.483540:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f3c2fb2/0x3234de053c5060b lrc: 1/0,0 mode: --/PW res: [0x2b535:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.483545:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177465 count 1 00010000:00010000:0.0:1651529344.483545:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f3c2fb2/0x3234de053c5060b lrc: 0/0,0 mode: --/PW res: [0x2b535:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.483549:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073a973b4/0x3234de053c50627 lrc: 3/0,1 mode: --/PW res: [0x2b539:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.483553:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211018 00000100:00100000:0.0:1651529344.483555:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+514:39030:x1731745946387200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.483556:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005cae39dc/0x3234de053c4f51e lrc: 2/0,0 mode: PR/PR res: [0x2b539:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d86e4 expref: 1551 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.483559:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:0.0:1651529344.483559:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177467 count 1 00010000:00010000:1.0:1651529344.483560:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.483561:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073a973b4/0x3234de053c50627 lrc: 4/0,1 mode: --/PW res: [0x2b539:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.483566:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005cae39dc/0x3234de053c4f51e lrc: 3/0,0 mode: PR/PR res: [0x2b539:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d86e4 expref: 1551 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.483570:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005cae39dc/0x3234de053c4f51e lrc: 4/0,0 mode: PR/PR res: [0x2b539:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d86e4 expref: 1551 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.483574:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000fb8e412 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996971840:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.483575:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5062e lrc: 3/0,1 mode: --/PW res: [0x2b53b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483580:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008860425d/0x3234de053c4d439 lrc: 2/0,0 mode: PR/PR res: [0x2b53b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d02c4 expref: 1551 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.483581:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a6b79b05 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.483583:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.483584:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.483585:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5062e lrc: 4/0,1 mode: --/PW res: [0x2b53b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.483586:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211019 00000100:00100000:1.0:1651529344.483588:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+514:39030:x1731745946387136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.483592:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177466 count 1 00010000:00010000:0.0:1651529344.483592:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008860425d/0x3234de053c4d439 lrc: 3/0,0 mode: PR/PR res: [0x2b53b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d02c4 expref: 1551 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.483595:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cca8aba1/0x3234de053c50635 lrc: 3/0,1 mode: --/PW res: [0x2b53a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483595:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008860425d/0x3234de053c4d439 lrc: 4/0,0 mode: PR/PR res: [0x2b53b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d02c4 expref: 1551 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.483599:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000056ce51ac/0x3234de053c4e105 lrc: 2/0,0 mode: PR/PR res: [0x2b53a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d34b2 expref: 1551 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.483599:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996971904:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.483602:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.483603:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.483604:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cca8aba1/0x3234de053c50635 lrc: 4/0,1 mode: --/PW res: [0x2b53a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.483608:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c086aae3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.483609:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000056ce51ac/0x3234de053c4e105 lrc: 3/0,0 mode: PR/PR res: [0x2b53a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d34b2 expref: 1551 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.483613:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000056ce51ac/0x3234de053c4e105 lrc: 4/0,0 mode: PR/PR res: [0x2b53a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d34b2 expref: 1551 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.483615:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211020 00000100:00100000:1.0:1651529344.483617:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bddc5ca7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996971968:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.483617:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+514:39029:x1731745946387264:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.483621:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177468 count 1 00000100:00100000:1.0:1651529344.483623:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 000000004698fefb going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.483625:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080a87994/0x3234de053c5063c lrc: 3/0,1 mode: --/PW res: [0x2b53c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483629:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007c970521/0x3234de053c4ea5f lrc: 2/0,0 mode: PR/PR res: [0x2b53c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ac9 expref: 1551 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.483632:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.483632:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.483633:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080a87994/0x3234de053c5063c lrc: 4/0,1 mode: --/PW res: [0x2b53c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483639:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007c970521/0x3234de053c4ea5f lrc: 3/0,0 mode: PR/PR res: [0x2b53c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ac9 expref: 1551 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.483650:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007c970521/0x3234de053c4ea5f lrc: 4/0,0 mode: PR/PR res: [0x2b53c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ac9 expref: 1551 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.483654:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996972032:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.483655:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.483662:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000abca413e going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.483667:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946387328 00000100:00100000:0.0:1651529344.483679:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211021 00000100:00100000:0.0:1651529344.483680:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+515:39029:x1731745946387328:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.483685:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177469 count 1 00010000:00010000:0.0:1651529344.483688:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f73e545/0x3234de053c50643 lrc: 3/0,1 mode: --/PW res: [0x2b53d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.483690:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.483700:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cb3b3ccc/0x3234de053c4e201 lrc: 2/0,0 mode: PR/PR res: [0x2b53d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3935 expref: 1551 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.483704:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.483704:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.483705:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f73e545/0x3234de053c50643 lrc: 4/0,1 mode: --/PW res: [0x2b53d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483711:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cb3b3ccc/0x3234de053c4e201 lrc: 3/0,0 mode: PR/PR res: [0x2b53d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3935 expref: 1551 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.483714:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cb3b3ccc/0x3234de053c4e201 lrc: 4/0,0 mode: PR/PR res: [0x2b53d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3935 expref: 1551 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.483718:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996972096:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.483726:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c2b2b59c going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.483733:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996971648:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.483747:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005480834d/0x3234de053c50612 lrc: 3/0,1 mode: --/PW res: [0x2b536:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.483754:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396267904 00010000:00010000:0.0:1651529344.483759:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e7a2d4e3/0x3234de053c4b584 lrc: 4/0,0 mode: PR/PR res: [0x2b536:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc29e expref: 1552 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.483769:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11796 00000100:00100000:0.0:1651529344.483771:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1552:41279:x1731746396267904:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.483774:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.483775:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e7a2d4e3/0x3234de053c4b584 lrc: 4/0,0 mode: PR/PR res: [0x2b536:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc29e expref: 1552 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.483779:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e7a2d4e3/0x3234de053c4b584 lrc: 3/0,0 mode: PR/PR res: [0x2b536:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc29e expref: 1552 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.483784:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7a2d4e3/0x3234de053c4b584 lrc: 0/0,0 mode: --/PR res: [0x2b536:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc29e expref: 1552 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.483788:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.483789:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.483789:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005480834d/0x3234de053c50612 lrc: 3/0,1 mode: PW/PW res: [0x2b536:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483792:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005480834d/0x3234de053c50612 lrc: 4/0,1 mode: PW/PW res: [0x2b536:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483799:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.483820:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1551:41279:x1731746396267904:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 48us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.483823:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11796 00010000:00010000:0.0:1651529344.483830:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005480834d/0x3234de053c50612 lrc: 3/0,1 mode: PW/PW res: [0x2b536:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483833:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005480834d/0x3234de053c50612 lrc: 3/0,1 mode: PW/PW res: [0x2b536:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483839:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005480834d/0x3234de053c50612 lrc: 3/0,1 mode: PW/PW res: [0x2b536:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483856:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005480834d/0x3234de053c50612 lrc: 2/0,0 mode: PW/PW res: [0x2b536:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.483925:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cee35a0c pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996971776:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.483930:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c50620 lrc: 3/0,1 mode: --/PW res: [0x2b538:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.483946:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+516:39030:x1731745946386496:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1409us (1465us total) trans 12885079069 rc 0/0 00000100:00100000:1.0:1651529344.483948:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000fb8e412 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996971840:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.483949:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211014 00010000:00010000:1.0:1651529344.483951:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000073a973b4/0x3234de053c50627 lrc: 3/0,1 mode: --/PW res: [0x2b539:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483965:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005480834d/0x3234de053c50612 lrc: 2/0,0 mode: PW/PW res: [0x2b536:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483969:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005480834d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.483970:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005480834d/0x3234de053c50612 lrc: 2/0,0 mode: PW/PW res: [0x2b536:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483973:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005480834d/0x3234de053c50612 lrc: 3/0,0 mode: PW/PW res: [0x2b536:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483993:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005480834d/0x3234de053c50612 lrc: 1/0,0 mode: --/PW res: [0x2b536:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.483996:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005480834d/0x3234de053c50612 lrc: 0/0,0 mode: --/PW res: [0x2b536:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.484007:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996971904:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.484011:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5062e lrc: 3/0,1 mode: --/PW res: [0x2b53b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.484017:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996971712:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.484020:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006c1791d6/0x3234de053c50619 lrc: 3/0,1 mode: --/PW res: [0x2b537:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.484033:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996972032:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.484035:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bddc5ca7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996971968:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.484036:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000080a87994/0x3234de053c5063c lrc: 3/0,1 mode: --/PW res: [0x2b53c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.484039:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cca8aba1/0x3234de053c50635 lrc: 3/0,1 mode: --/PW res: [0x2b53a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.484173:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.484187:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946387392 00000100:00100000:1.0:1651529344.484196:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.484204:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.484239:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211022 00000100:00100000:0.0:1651529344.484241:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+516:39030:x1731745946387392:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.484246:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177470 count 1 00010000:00010000:0.0:1651529344.484250:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b163d7c2/0x3234de053c5064a lrc: 3/0,1 mode: --/PW res: [0x2b53e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.484251:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.484255:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c4e080 lrc: 2/0,0 mode: PR/PR res: [0x2b53e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d32c1 expref: 1550 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.484258:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.484258:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.484258:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.484259:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b163d7c2/0x3234de053c5064a lrc: 4/0,1 mode: --/PW res: [0x2b53e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.484268:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.484272:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c4e080 lrc: 3/0,0 mode: PR/PR res: [0x2b53e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d32c1 expref: 1550 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.484273:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.484276:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c4e080 lrc: 4/0,0 mode: PR/PR res: [0x2b53e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d32c1 expref: 1550 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.484279:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.484280:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996972160:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.484285:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396267968 00010000:00010000:1.0:1651529344.484291:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ea4be947/0x3234de053c4e9e1 lrc: 4/0,0 mode: PR/PR res: [0x2b537:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58fb expref: 1551 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.484295:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 0000000009370c1d going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.484303:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396268032 00000100:00100000:0.0:1651529344.484303:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996972096:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.484306:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000049a3c67c/0x3234de053c4e1de lrc: 4/0,0 mode: PR/PR res: [0x2b538:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d38a9 expref: 1552 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.484306:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000f73e545/0x3234de053c50643 lrc: 3/0,1 mode: --/PW res: [0x2b53d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.484310:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396268096 00010000:00010000:1.0:1651529344.484312:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005cae39dc/0x3234de053c4f51e lrc: 4/0,0 mode: PR/PR res: [0x2b539:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d86e4 expref: 1553 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.484313:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396268160 00000100:00100000:1.0:1651529344.484316:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396268224 00010000:00010000:0.0:1651529344.484317:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008860425d/0x3234de053c4d439 lrc: 4/0,0 mode: PR/PR res: [0x2b53b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d02c4 expref: 1555 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.484318:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007c970521/0x3234de053c4ea5f lrc: 4/0,0 mode: PR/PR res: [0x2b53c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ac9 expref: 1555 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.484322:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396268288 00000100:00100000:0.0:1651529344.484323:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396268352 00010000:00010000:1.0:1651529344.484324:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000056ce51ac/0x3234de053c4e105 lrc: 4/0,0 mode: PR/PR res: [0x2b53a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d34b2 expref: 1557 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.484325:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cb3b3ccc/0x3234de053c4e201 lrc: 4/0,0 mode: PR/PR res: [0x2b53d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3935 expref: 1557 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.484329:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11797 00000100:00100000:1.0:1651529344.484331:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1557:41278:x1731746396267968:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.484332:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11798 00010000:00010000:1.0:1651529344.484334:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.484334:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6d06412 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1557:41279:x1731746396268032:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.484335:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ea4be947/0x3234de053c4e9e1 lrc: 4/0,0 mode: PR/PR res: [0x2b537:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58fb expref: 1557 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.484336:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.484338:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000049a3c67c/0x3234de053c4e1de lrc: 4/0,0 mode: PR/PR res: [0x2b538:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d38a9 expref: 1557 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.484339:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ea4be947/0x3234de053c4e9e1 lrc: 3/0,0 mode: PR/PR res: [0x2b537:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58fb expref: 1557 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.484342:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000049a3c67c/0x3234de053c4e1de lrc: 3/0,0 mode: PR/PR res: [0x2b538:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d38a9 expref: 1557 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.484345:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea4be947/0x3234de053c4e9e1 lrc: 0/0,0 mode: --/PR res: [0x2b537:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58fb expref: 1557 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.484347:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049a3c67c/0x3234de053c4e1de lrc: 0/0,0 mode: --/PR res: [0x2b538:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d38a9 expref: 1557 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.484348:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.484349:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.484350:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006c1791d6/0x3234de053c50619 lrc: 3/0,1 mode: PW/PW res: [0x2b537:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484351:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.484351:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.484352:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c50620 lrc: 3/0,1 mode: PW/PW res: [0x2b538:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.484353:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c1791d6/0x3234de053c50619 lrc: 4/0,1 mode: PW/PW res: [0x2b537:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484355:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c50620 lrc: 4/0,1 mode: PW/PW res: [0x2b538:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.484368:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.484370:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.484375:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1555:41278:x1731746396267968:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 44us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.484377:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6d06412 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1555:41279:x1731746396268032:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.484378:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11797 00000100:00100000:0.0:1651529344.484380:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11798 00000100:00100000:1.0:1651529344.484383:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11799 00000100:00100000:1.0:1651529344.484385:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1553:41278:x1731746396268096:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.484388:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.484389:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005cae39dc/0x3234de053c4f51e lrc: 4/0,0 mode: PR/PR res: [0x2b539:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d86e4 expref: 1553 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.484389:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11800 00000100:00100000:0.0:1651529344.484391:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1553:41279:x1731746396268160:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.484393:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.484395:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008860425d/0x3234de053c4d439 lrc: 4/0,0 mode: PR/PR res: [0x2b53b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d02c4 expref: 1553 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.484396:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005cae39dc/0x3234de053c4f51e lrc: 3/0,0 mode: PR/PR res: [0x2b539:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d86e4 expref: 1553 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.484399:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008860425d/0x3234de053c4d439 lrc: 3/0,0 mode: PR/PR res: [0x2b53b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d02c4 expref: 1553 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.484400:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cae39dc/0x3234de053c4f51e lrc: 0/0,0 mode: --/PR res: [0x2b539:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d86e4 expref: 1553 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.484404:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.484404:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.484404:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008860425d/0x3234de053c4d439 lrc: 0/0,0 mode: --/PR res: [0x2b53b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d02c4 expref: 1552 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.484405:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000073a973b4/0x3234de053c50627 lrc: 3/0,1 mode: PW/PW res: [0x2b539:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.484408:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073a973b4/0x3234de053c50627 lrc: 4/0,1 mode: PW/PW res: [0x2b539:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484410:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.484410:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.484411:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5062e lrc: 3/0,1 mode: PW/PW res: [0x2b53b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.484414:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.484414:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5062e lrc: 4/0,1 mode: PW/PW res: [0x2b53b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.484419:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1551:41278:x1731746396268096:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 33us (169us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.484420:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.484421:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11799 00000100:00100000:1.0:1651529344.484425:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11801 00000100:00100000:0.0:1651529344.484425:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1550:41279:x1731746396268160:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.484427:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1550:41278:x1731746396268224:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.484427:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11800 00010000:00010000:1.0:1651529344.484429:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.484430:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007c970521/0x3234de053c4ea5f lrc: 4/0,0 mode: PR/PR res: [0x2b53c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ac9 expref: 1549 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.484431:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11802 00000100:00100000:0.0:1651529344.484433:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1549:41279:x1731746396268288:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.484434:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007c970521/0x3234de053c4ea5f lrc: 3/0,0 mode: PR/PR res: [0x2b53c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ac9 expref: 1549 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.484435:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.484437:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000056ce51ac/0x3234de053c4e105 lrc: 4/0,0 mode: PR/PR res: [0x2b53a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d34b2 expref: 1549 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.484439:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c970521/0x3234de053c4ea5f lrc: 0/0,0 mode: --/PR res: [0x2b53c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ac9 expref: 1549 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.484440:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000056ce51ac/0x3234de053c4e105 lrc: 3/0,0 mode: PR/PR res: [0x2b53a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d34b2 expref: 1549 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.484442:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.484443:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.484443:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000080a87994/0x3234de053c5063c lrc: 3/0,1 mode: PW/PW res: [0x2b53c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484445:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056ce51ac/0x3234de053c4e105 lrc: 0/0,0 mode: --/PR res: [0x2b53a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d34b2 expref: 1548 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.484446:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080a87994/0x3234de053c5063c lrc: 4/0,1 mode: PW/PW res: [0x2b53c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484448:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.484449:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.484450:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cca8aba1/0x3234de053c50635 lrc: 3/0,1 mode: PW/PW res: [0x2b53a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.484455:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.484459:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cca8aba1/0x3234de053c50635 lrc: 4/0,1 mode: PW/PW res: [0x2b53a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.484460:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1547:41278:x1731746396268224:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.484463:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11801 00010000:00010000:0.0:1651529344.484468:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.484473:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11803 00000100:00100000:0.0:1651529344.484474:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1546:41279:x1731746396268288:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.484475:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1546:41278:x1731746396268352:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.484477:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11802 00010000:00010000:1.0:1651529344.484478:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.484479:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cb3b3ccc/0x3234de053c4e201 lrc: 4/0,0 mode: PR/PR res: [0x2b53d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3935 expref: 1545 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.484483:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cb3b3ccc/0x3234de053c4e201 lrc: 3/0,0 mode: PR/PR res: [0x2b53d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3935 expref: 1545 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.484483:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5062e lrc: 3/0,1 mode: PW/PW res: [0x2b53b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484486:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5062e lrc: 3/0,1 mode: PW/PW res: [0x2b53b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.484488:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb3b3ccc/0x3234de053c4e201 lrc: 0/0,0 mode: --/PR res: [0x2b53d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3935 expref: 1545 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.484490:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5062e lrc: 3/0,1 mode: PW/PW res: [0x2b53b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484492:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5062e lrc: 2/0,0 mode: PW/PW res: [0x2b53b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.484494:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.484494:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.484495:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000f73e545/0x3234de053c50643 lrc: 3/0,1 mode: PW/PW res: [0x2b53d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.484498:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f73e545/0x3234de053c50643 lrc: 4/0,1 mode: PW/PW res: [0x2b53d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.484506:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.484511:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1544:41278:x1731746396268352:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.484514:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11803 00010000:00010000:1.0:1651529344.484521:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000073a973b4/0x3234de053c50627 lrc: 3/0,1 mode: PW/PW res: [0x2b539:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.484524:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073a973b4/0x3234de053c50627 lrc: 3/0,1 mode: PW/PW res: [0x2b539:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.484527:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073a973b4/0x3234de053c50627 lrc: 3/0,1 mode: PW/PW res: [0x2b539:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.484530:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073a973b4/0x3234de053c50627 lrc: 2/0,0 mode: PW/PW res: [0x2b539:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.484545:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+517:39030:x1731745946387200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 989us (1108us total) trans 12885079070 rc 0/0 00000100:00100000:0.0:1651529344.484548:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211018 00010000:00010000:0.0:1651529344.484554:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5062e lrc: 2/0,0 mode: PW/PW res: [0x2b53b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484560:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000002904524 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.484561:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5062e lrc: 2/0,0 mode: PW/PW res: [0x2b53b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484564:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5062e lrc: 3/0,0 mode: PW/PW res: [0x2b53b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484568:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5062e lrc: 1/0,0 mode: --/PW res: [0x2b53b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484571:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5062e lrc: 0/0,0 mode: --/PW res: [0x2b53b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.484572:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+517:39030:x1731745946387072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1031us (1151us total) trans 12885079071 rc 0/0 00000100:00100000:1.0:1651529344.484575:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211017 00010000:00010000:0.0:1651529344.484575:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073a973b4/0x3234de053c50627 lrc: 2/0,0 mode: PW/PW res: [0x2b539:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484578:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000073a973b4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.484579:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073a973b4/0x3234de053c50627 lrc: 2/0,0 mode: PW/PW res: [0x2b539:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484582:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073a973b4/0x3234de053c50627 lrc: 3/0,0 mode: PW/PW res: [0x2b539:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.484583:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cca8aba1/0x3234de053c50635 lrc: 3/0,1 mode: PW/PW res: [0x2b53a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484585:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073a973b4/0x3234de053c50627 lrc: 1/0,0 mode: --/PW res: [0x2b539:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.484586:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cca8aba1/0x3234de053c50635 lrc: 3/0,1 mode: PW/PW res: [0x2b53a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484587:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073a973b4/0x3234de053c50627 lrc: 0/0,0 mode: --/PW res: [0x2b539:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.484589:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cca8aba1/0x3234de053c50635 lrc: 3/0,1 mode: PW/PW res: [0x2b53a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.484592:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cca8aba1/0x3234de053c50635 lrc: 2/0,0 mode: PW/PW res: [0x2b53a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484594:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000080a87994/0x3234de053c5063c lrc: 3/0,1 mode: PW/PW res: [0x2b53c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484596:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080a87994/0x3234de053c5063c lrc: 3/0,1 mode: PW/PW res: [0x2b53c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484605:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080a87994/0x3234de053c5063c lrc: 3/0,1 mode: PW/PW res: [0x2b53c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484608:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080a87994/0x3234de053c5063c lrc: 2/0,0 mode: PW/PW res: [0x2b53c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.484628:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+518:39030:x1731745946387136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1039us (1182us total) trans 12885079072 rc 0/0 00000100:00100000:1.0:1651529344.484631:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211019 00010000:00010000:1.0:1651529344.484637:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c50620 lrc: 3/0,1 mode: PW/PW res: [0x2b538:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.484640:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c50620 lrc: 3/0,1 mode: PW/PW res: [0x2b538:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.484643:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c50620 lrc: 3/0,1 mode: PW/PW res: [0x2b538:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.484644:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+517:39029:x1731745946387264:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1026us (1190us total) trans 12885079073 rc 0/0 00010000:00010000:1.0:1651529344.484646:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c50620 lrc: 2/0,0 mode: PW/PW res: [0x2b538:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.484647:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211020 00010000:00010000:0.0:1651529344.484662:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cca8aba1/0x3234de053c50635 lrc: 2/0,0 mode: PW/PW res: [0x2b53a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484666:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cca8aba1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.484667:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cca8aba1/0x3234de053c50635 lrc: 2/0,0 mode: PW/PW res: [0x2b53a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484669:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cca8aba1/0x3234de053c50635 lrc: 3/0,0 mode: PW/PW res: [0x2b53a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484674:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cca8aba1/0x3234de053c50635 lrc: 1/0,0 mode: --/PW res: [0x2b53a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484677:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cca8aba1/0x3234de053c50635 lrc: 0/0,0 mode: --/PW res: [0x2b53a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484681:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080a87994/0x3234de053c5063c lrc: 2/0,0 mode: PW/PW res: [0x2b53c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.484682:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+517:39030:x1731745946386944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1207us (1269us total) trans 12885079074 rc 0/0 00010000:00010000:0.0:1651529344.484684:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000080a87994 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.484685:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211016 00010000:00010000:0.0:1651529344.484685:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080a87994/0x3234de053c5063c lrc: 2/0,0 mode: PW/PW res: [0x2b53c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484688:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080a87994/0x3234de053c5063c lrc: 3/0,0 mode: PW/PW res: [0x2b53c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484691:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080a87994/0x3234de053c5063c lrc: 1/0,0 mode: --/PW res: [0x2b53c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484693:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080a87994/0x3234de053c5063c lrc: 0/0,0 mode: --/PW res: [0x2b53c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484697:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c50620 lrc: 2/0,0 mode: PW/PW res: [0x2b538:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484699:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000096a880d5 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.484700:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c50620 lrc: 2/0,0 mode: PW/PW res: [0x2b538:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484705:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c50620 lrc: 3/0,0 mode: PW/PW res: [0x2b538:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484708:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c50620 lrc: 1/0,0 mode: --/PW res: [0x2b538:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484711:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c50620 lrc: 0/0,0 mode: --/PW res: [0x2b538:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484717:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000f73e545/0x3234de053c50643 lrc: 3/0,1 mode: PW/PW res: [0x2b53d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484720:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f73e545/0x3234de053c50643 lrc: 3/0,1 mode: PW/PW res: [0x2b53d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484723:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f73e545/0x3234de053c50643 lrc: 3/0,1 mode: PW/PW res: [0x2b53d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484726:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f73e545/0x3234de053c50643 lrc: 2/0,0 mode: PW/PW res: [0x2b53d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.484769:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+517:39029:x1731745946387328:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1088us (1114us total) trans 12885079075 rc 0/0 00000100:00100000:0.0:1651529344.484772:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211021 00010000:00010000:0.0:1651529344.484779:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f73e545/0x3234de053c50643 lrc: 2/0,0 mode: PW/PW res: [0x2b53d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484785:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000f73e545 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.484798:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f73e545/0x3234de053c50643 lrc: 2/0,0 mode: PW/PW res: [0x2b53d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484802:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f73e545/0x3234de053c50643 lrc: 3/0,0 mode: PW/PW res: [0x2b53d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484807:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f73e545/0x3234de053c50643 lrc: 1/0,0 mode: --/PW res: [0x2b53d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484809:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f73e545/0x3234de053c50643 lrc: 0/0,0 mode: --/PW res: [0x2b53d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484817:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006c1791d6/0x3234de053c50619 lrc: 3/0,1 mode: PW/PW res: [0x2b537:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484820:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c1791d6/0x3234de053c50619 lrc: 3/0,1 mode: PW/PW res: [0x2b537:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484823:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c1791d6/0x3234de053c50619 lrc: 3/0,1 mode: PW/PW res: [0x2b537:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484826:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c1791d6/0x3234de053c50619 lrc: 2/0,0 mode: PW/PW res: [0x2b537:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.484883:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+517:39029:x1731745946386880:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1446us (1512us total) trans 12885079076 rc 0/0 00000100:00100000:0.0:1651529344.484886:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211015 00010000:00010000:0.0:1651529344.484893:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c1791d6/0x3234de053c50619 lrc: 2/0,0 mode: PW/PW res: [0x2b537:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484896:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006c1791d6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.484897:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c1791d6/0x3234de053c50619 lrc: 2/0,0 mode: PW/PW res: [0x2b537:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484900:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c1791d6/0x3234de053c50619 lrc: 3/0,0 mode: PW/PW res: [0x2b537:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484904:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c1791d6/0x3234de053c50619 lrc: 1/0,0 mode: --/PW res: [0x2b537:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.484907:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c1791d6/0x3234de053c50619 lrc: 0/0,0 mode: --/PW res: [0x2b537:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.485043:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.485071:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946387968 00000100:00100000:1.0:1651529344.485074:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.485088:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946387904 00000100:00100000:0.0:1651529344.485099:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211023 00000100:00100000:0.0:1651529344.485100:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+518:39030:x1731745946387968:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.485104:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.485106:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177472 count 1 00000100:00100000:1.0:1651529344.485113:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.485120:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.485125:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc130754/0x3234de053c50651 lrc: 3/0,1 mode: --/PW res: [0x2b540:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.485130:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c4f605 lrc: 2/0,0 mode: PR/PR res: [0x2b540:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a9c expref: 1543 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.485136:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.485136:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.485137:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc130754/0x3234de053c50651 lrc: 4/0,1 mode: --/PW res: [0x2b540:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.485141:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.485150:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c4f605 lrc: 3/0,0 mode: PR/PR res: [0x2b540:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a9c expref: 1543 pid: 156655 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.485152:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.485154:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c4f605 lrc: 4/0,0 mode: PR/PR res: [0x2b540:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a9c expref: 1543 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.485158:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996972224:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.485159:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946388096 00000100:00100000:1.0:1651529344.485165:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946388160 00000100:00100000:1.0:1651529344.485168:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946388224 00000100:00100000:1.0:1651529344.485171:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946388288 00000100:00100000:1.0:1651529344.485173:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946388352 00000100:00100000:1.0:1651529344.485183:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211024 00000100:00100000:0.0:1651529344.485183:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c2b2b59c going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.485184:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+523:39029:x1731745946387904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.485190:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177471 count 1 00000100:00100000:0.0:1651529344.485190:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211025 00000100:00100000:0.0:1651529344.485192:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+523:39029:x1731745946388096:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.485195:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000069f47d6/0x3234de053c50658 lrc: 3/0,1 mode: --/PW res: [0x2b53f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.485197:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177473 count 1 00010000:00010000:1.0:1651529344.485200:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000058d7a733/0x3234de053c4f3c0 lrc: 2/0,0 mode: PR/PR res: [0x2b53f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8196 expref: 1543 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.485201:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c5065f lrc: 3/0,1 mode: --/PW res: [0x2b541:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.485203:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.485203:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.485204:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000069f47d6/0x3234de053c50658 lrc: 4/0,1 mode: --/PW res: [0x2b53f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.485205:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c4f61a lrc: 2/0,0 mode: PR/PR res: [0x2b541:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b0c expref: 1543 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.485208:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.485209:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.485210:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c5065f lrc: 4/0,1 mode: --/PW res: [0x2b541:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.485211:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000058d7a733/0x3234de053c4f3c0 lrc: 3/0,0 mode: PR/PR res: [0x2b53f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8196 expref: 1543 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.485215:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000058d7a733/0x3234de053c4f3c0 lrc: 4/0,0 mode: PR/PR res: [0x2b53f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8196 expref: 1543 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.485218:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c4f61a lrc: 3/0,0 mode: PR/PR res: [0x2b541:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b0c expref: 1543 pid: 156655 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.485219:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000824ca843 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996972288:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.485239:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c4f61a lrc: 4/0,0 mode: PR/PR res: [0x2b541:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b0c expref: 1543 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.485242:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c3caa148 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.485244:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996972352:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.485249:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211026 00000100:00100000:1.0:1651529344.485250:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+523:39029:x1731745946388160:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.485253:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e7e12492 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.485255:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177474 count 1 00010000:00010000:1.0:1651529344.485259:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c50666 lrc: 3/0,1 mode: --/PW res: [0x2b542:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.485261:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211027 00010000:00010000:1.0:1651529344.485263:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002cb47f58/0x3234de053c4e5ab lrc: 2/0,0 mode: PR/PR res: [0x2b542:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4807 expref: 1543 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.485263:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+523:39030:x1731745946388224:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.485266:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.485267:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:0.0:1651529344.485267:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177475 count 1 00010000:00010000:1.0:1651529344.485268:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c50666 lrc: 4/0,1 mode: --/PW res: [0x2b542:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.485271:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c5066d lrc: 3/0,1 mode: --/PW res: [0x2b543:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.485274:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002cb47f58/0x3234de053c4e5ab lrc: 3/0,0 mode: PR/PR res: [0x2b542:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4807 expref: 1543 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.485275:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000068ac74b/0x3234de053c4dd2a lrc: 2/0,0 mode: PR/PR res: [0x2b543:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d259a expref: 1543 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.485277:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002cb47f58/0x3234de053c4e5ab lrc: 4/0,0 mode: PR/PR res: [0x2b542:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4807 expref: 1543 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.485278:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.485279:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.485279:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c5066d lrc: 4/0,1 mode: --/PW res: [0x2b543:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.485284:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029abc941 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996972416:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.485285:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000068ac74b/0x3234de053c4dd2a lrc: 3/0,0 mode: PR/PR res: [0x2b543:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d259a expref: 1543 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.485289:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000068ac74b/0x3234de053c4dd2a lrc: 4/0,0 mode: PR/PR res: [0x2b543:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d259a expref: 1543 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.485290:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d09f5ee1 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.485293:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996972480:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.485296:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211028 00000100:00100000:1.0:1651529344.485298:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+523:39030:x1731745946388288:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.485299:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000076b354b3 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.485301:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177476 count 1 00010000:00010000:1.0:1651529344.485304:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b6f07f6/0x3234de053c50674 lrc: 3/0,1 mode: --/PW res: [0x2b544:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.485305:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211029 00000100:00100000:0.0:1651529344.485307:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+523:39029:x1731745946388352:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.485308:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b5eb030a/0x3234de053c4d80d lrc: 2/0,0 mode: PR/PR res: [0x2b544:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d115e expref: 1543 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.485311:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:0.0:1651529344.485311:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177477 count 1 00010000:00010000:1.0:1651529344.485312:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.485312:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b6f07f6/0x3234de053c50674 lrc: 4/0,1 mode: --/PW res: [0x2b544:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.485314:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9690ad5/0x3234de053c5067b lrc: 3/0,1 mode: --/PW res: [0x2b545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.485318:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b5eb030a/0x3234de053c4d80d lrc: 3/0,0 mode: PR/PR res: [0x2b544:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d115e expref: 1543 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.485318:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009fa75d86/0x3234de053c4e7c6 lrc: 2/0,0 mode: PR/PR res: [0x2b545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4fb6 expref: 1543 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.485321:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.485321:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.485322:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b5eb030a/0x3234de053c4d80d lrc: 4/0,0 mode: PR/PR res: [0x2b544:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d115e expref: 1543 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.485322:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9690ad5/0x3234de053c5067b lrc: 4/0,1 mode: --/PW res: [0x2b545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.485325:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000533fe698 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996972544:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.485327:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009fa75d86/0x3234de053c4e7c6 lrc: 3/0,0 mode: PR/PR res: [0x2b545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4fb6 expref: 1543 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.485331:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f79d8146 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.485331:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009fa75d86/0x3234de053c4e7c6 lrc: 4/0,0 mode: PR/PR res: [0x2b545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4fb6 expref: 1543 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.485335:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996972608:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.485341:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 000000003c8b0daf going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.485348:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996972160:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.485352:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b163d7c2/0x3234de053c5064a lrc: 3/0,1 mode: --/PW res: [0x2b53e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.485358:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.485376:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396268800 00010000:00010000:0.0:1651529344.485381:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c4e080 lrc: 4/0,0 mode: PR/PR res: [0x2b53e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d32c1 expref: 1544 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.485391:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11804 00000100:00100000:0.0:1651529344.485393:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1544:41279:x1731746396268800:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.485396:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.485397:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c4e080 lrc: 4/0,0 mode: PR/PR res: [0x2b53e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d32c1 expref: 1544 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.485401:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c4e080 lrc: 3/0,0 mode: PR/PR res: [0x2b53e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d32c1 expref: 1544 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.485406:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c4e080 lrc: 0/0,0 mode: --/PR res: [0x2b53e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d32c1 expref: 1544 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.485410:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.485410:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.485411:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b163d7c2/0x3234de053c5064a lrc: 3/0,1 mode: PW/PW res: [0x2b53e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.485414:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b163d7c2/0x3234de053c5064a lrc: 4/0,1 mode: PW/PW res: [0x2b53e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.485423:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.485433:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1543:41279:x1731746396268800:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (76us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.485436:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11804 00010000:00010000:0.0:1651529344.485442:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b163d7c2/0x3234de053c5064a lrc: 3/0,1 mode: PW/PW res: [0x2b53e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.485445:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b163d7c2/0x3234de053c5064a lrc: 3/0,1 mode: PW/PW res: [0x2b53e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.485449:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b163d7c2/0x3234de053c5064a lrc: 3/0,1 mode: PW/PW res: [0x2b53e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.485451:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b163d7c2/0x3234de053c5064a lrc: 2/0,0 mode: PW/PW res: [0x2b53e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.485548:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+524:39030:x1731745946387392:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1306us (1374us total) trans 12885079077 rc 0/0 00000100:00100000:0.0:1651529344.485551:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211022 00010000:00010000:0.0:1651529344.485559:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b163d7c2/0x3234de053c5064a lrc: 2/0,0 mode: PW/PW res: [0x2b53e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.485562:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b163d7c2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.485563:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b163d7c2/0x3234de053c5064a lrc: 2/0,0 mode: PW/PW res: [0x2b53e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.485568:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b163d7c2/0x3234de053c5064a lrc: 3/0,0 mode: PW/PW res: [0x2b53e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.485573:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b163d7c2/0x3234de053c5064a lrc: 1/0,0 mode: --/PW res: [0x2b53e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.485576:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b163d7c2/0x3234de053c5064a lrc: 0/0,0 mode: --/PW res: [0x2b53e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.485586:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996972224:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.485589:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fc130754/0x3234de053c50651 lrc: 3/0,1 mode: --/PW res: [0x2b540:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.485598:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000824ca843 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996972288:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.485603:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000069f47d6/0x3234de053c50658 lrc: 3/0,1 mode: --/PW res: [0x2b53f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.485748:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.485759:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946388480 00000100:00100000:0.0:1651529344.485769:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211030 00000100:00100000:0.0:1651529344.485771:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+524:39029:x1731745946388480:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.485776:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177478 count 1 00010000:00010000:0.0:1651529344.485780:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50682 lrc: 3/0,1 mode: --/PW res: [0x2b546:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.485785:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002925c134/0x3234de053c4e255 lrc: 2/0,0 mode: PR/PR res: [0x2b546:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a93 expref: 1542 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.485788:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.485788:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.485789:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50682 lrc: 4/0,1 mode: --/PW res: [0x2b546:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.485796:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002925c134/0x3234de053c4e255 lrc: 3/0,0 mode: PR/PR res: [0x2b546:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a93 expref: 1542 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.485799:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002925c134/0x3234de053c4e255 lrc: 4/0,0 mode: PR/PR res: [0x2b546:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a93 expref: 1542 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.485831:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.485842:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996972672:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.485849:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.485868:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000abca413e going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.485876:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996972352:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.485880:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c5065f lrc: 3/0,1 mode: --/PW res: [0x2b541:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.485887:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396269120 00010000:00010000:0.0:1651529344.485891:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000058d7a733/0x3234de053c4f3c0 lrc: 4/0,0 mode: PR/PR res: [0x2b53f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8196 expref: 1543 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.485904:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396269056 00010000:00010000:0.0:1651529344.485907:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c4f605 lrc: 4/0,0 mode: PR/PR res: [0x2b540:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a9c expref: 1544 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.485918:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.485920:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396269248 00000100:00100000:1.0:1651529344.485923:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.485923:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002cb47f58/0x3234de053c4e5ab lrc: 5/0,0 mode: PR/PR res: [0x2b542:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4807 expref: 1545 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.485928:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.485928:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396269184 00010000:00010000:0.0:1651529344.485930:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c4f61a lrc: 4/0,0 mode: PR/PR res: [0x2b541:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b0c expref: 1546 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.485933:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.485935:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396269376 00010000:00010000:0.0:1651529344.485937:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b5eb030a/0x3234de053c4d80d lrc: 5/0,0 mode: PR/PR res: [0x2b544:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d115e expref: 1547 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.485938:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.485941:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396269312 00010000:00010000:0.0:1651529344.485943:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000068ac74b/0x3234de053c4dd2a lrc: 5/0,0 mode: PR/PR res: [0x2b543:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d259a expref: 1548 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.485944:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396269440 00000100:00100000:0.0:1651529344.485948:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11805 00010000:00010000:1.0:1651529344.485950:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009fa75d86/0x3234de053c4e7c6 lrc: 5/0,0 mode: PR/PR res: [0x2b545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4fb6 expref: 1549 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.485950:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040f63b09 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1549:41278:x1731746396269120:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.485953:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.485954:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000058d7a733/0x3234de053c4f3c0 lrc: 4/0,0 mode: PR/PR res: [0x2b53f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8196 expref: 1549 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.485957:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11806 00010000:00010000:0.0:1651529344.485958:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000058d7a733/0x3234de053c4f3c0 lrc: 3/0,0 mode: PR/PR res: [0x2b53f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8196 expref: 1549 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.485959:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1549:41278:x1731746396269056:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.485962:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.485963:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c4f605 lrc: 4/0,0 mode: PR/PR res: [0x2b540:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a9c expref: 1549 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.485963:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058d7a733/0x3234de053c4f3c0 lrc: 0/0,0 mode: --/PR res: [0x2b53f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8196 expref: 1549 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.485967:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c4f605 lrc: 3/0,0 mode: PR/PR res: [0x2b540:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a9c expref: 1548 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.485967:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.485967:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.485968:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000069f47d6/0x3234de053c50658 lrc: 3/0,1 mode: PW/PW res: [0x2b53f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.485972:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c4f605 lrc: 0/0,0 mode: --/PR res: [0x2b540:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a9c expref: 1548 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.485974:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000069f47d6/0x3234de053c50658 lrc: 4/0,1 mode: PW/PW res: [0x2b53f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.485979:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.485979:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.485980:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fc130754/0x3234de053c50651 lrc: 3/0,1 mode: PW/PW res: [0x2b540:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.485983:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.485990:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc130754/0x3234de053c50651 lrc: 4/0,1 mode: PW/PW res: [0x2b540:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.485993:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040f63b09 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1547:41278:x1731746396269120:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 43us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.485996:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11805 00010000:00010000:1.0:1651529344.486004:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.486012:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1546:41278:x1731746396269056:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 52us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.486015:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11806 00000100:00100000:1.0:1651529344.486021:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11807 00000100:00100000:1.0:1651529344.486023:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1545:41278:x1731746396269248:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.486024:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11808 00010000:00010000:1.0:1651529344.486025:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.486026:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1545:41279:x1731746396269184:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.486027:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002cb47f58/0x3234de053c4e5ab lrc: 5/0,0 mode: PR/PR res: [0x2b542:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4807 expref: 1545 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.486030:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.486031:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002cb47f58/0x3234de053c4e5ab lrc: 4/0,0 mode: PR/PR res: [0x2b542:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4807 expref: 1545 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.486031:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c4f61a lrc: 4/0,0 mode: PR/PR res: [0x2b541:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b0c expref: 1545 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.486035:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.486035:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c4f61a lrc: 3/0,0 mode: PR/PR res: [0x2b541:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b0c expref: 1545 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.486036:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.486036:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c50666 lrc: 3/0,1 mode: PW/PW res: [0x2b542:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486040:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c4f61a lrc: 0/0,0 mode: --/PR res: [0x2b541:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b0c expref: 1545 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.486042:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c50666 lrc: 4/0,1 mode: PW/PW res: [0x2b542:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486044:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.486044:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.486045:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c5065f lrc: 3/0,1 mode: PW/PW res: [0x2b541:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486046:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.486048:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c5065f lrc: 4/0,1 mode: PW/PW res: [0x2b541:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.486050:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1544:41278:x1731746396269248:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 27us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.486052:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11807 00000100:00100000:1.0:1651529344.486056:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11809 00000100:00100000:1.0:1651529344.486057:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1543:41278:x1731746396269376:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.486057:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.486060:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.486061:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b5eb030a/0x3234de053c4d80d lrc: 5/0,0 mode: PR/PR res: [0x2b544:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d115e expref: 1543 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.486063:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1543:41279:x1731746396269184:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (140us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.486064:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b5eb030a/0x3234de053c4d80d lrc: 4/0,0 mode: PR/PR res: [0x2b544:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d115e expref: 1543 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.486066:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11808 00010000:00010000:1.0:1651529344.486069:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.486069:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.486070:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006b6f07f6/0x3234de053c50674 lrc: 3/0,1 mode: PW/PW res: [0x2b544:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.486070:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11810 00000100:00100000:0.0:1651529344.486072:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1542:41279:x1731746396269312:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.486073:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b6f07f6/0x3234de053c50674 lrc: 4/0,1 mode: PW/PW res: [0x2b544:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486074:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.486076:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000068ac74b/0x3234de053c4dd2a lrc: 5/0,0 mode: PR/PR res: [0x2b543:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d259a expref: 1542 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.486077:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.486079:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000068ac74b/0x3234de053c4dd2a lrc: 4/0,0 mode: PR/PR res: [0x2b543:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d259a expref: 1542 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.486081:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1542:41278:x1731746396269376:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 23us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.486083:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11809 00010000:00010000:0.0:1651529344.486084:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.486084:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.486085:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c5066d lrc: 3/0,1 mode: PW/PW res: [0x2b543:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.486087:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11811 00010000:00010000:0.0:1651529344.486088:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c5066d lrc: 4/0,1 mode: PW/PW res: [0x2b543:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.486089:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1541:41279:x1731746396269440:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.486091:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.486092:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009fa75d86/0x3234de053c4e7c6 lrc: 5/0,0 mode: PR/PR res: [0x2b545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4fb6 expref: 1541 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.486092:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.486095:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009fa75d86/0x3234de053c4e7c6 lrc: 4/0,0 mode: PR/PR res: [0x2b545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4fb6 expref: 1541 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.486096:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1541:41279:x1731746396269312:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 24us (164us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.486100:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.486100:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.486101:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a9690ad5/0x3234de053c5067b lrc: 3/0,1 mode: PW/PW res: [0x2b545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486104:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9690ad5/0x3234de053c5067b lrc: 4/0,1 mode: PW/PW res: [0x2b545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486108:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.486112:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1541:41279:x1731746396269440:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 23us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.486112:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11810 00000100:00100000:1.0:1651529344.486114:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11811 00010000:00010000:0.0:1651529344.486119:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c5065f lrc: 3/0,1 mode: PW/PW res: [0x2b541:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486123:0:80277:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cb47f58/0x3234de053c4e5ab lrc: 0/0,0 mode: --/PR res: [0x2b542:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4807 expref: 1539 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.486123:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c5065f lrc: 3/0,1 mode: PW/PW res: [0x2b541:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486126:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c5065f lrc: 3/0,1 mode: PW/PW res: [0x2b541:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.486127:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029abc941 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996972416:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.486128:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c5065f lrc: 2/0,0 mode: PW/PW res: [0x2b541:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486130:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c50666 lrc: 3/0,1 mode: PW/PW res: [0x2b542:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486134:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c50666 lrc: 3/0,1 mode: PW/PW res: [0x2b542:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486136:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c50666 lrc: 3/0,1 mode: PW/PW res: [0x2b542:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486139:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c50666 lrc: 3/0,1 mode: PW/PW res: [0x2b542:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486142:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c50666 lrc: 2/0,0 mode: PW/PW res: [0x2b542:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.486174:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+526:39029:x1731745946388096:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 981us (1070us total) trans 12885079078 rc 0/0 00000100:00100000:0.0:1651529344.486177:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211025 00010000:00010000:0.0:1651529344.486184:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c5065f lrc: 2/0,0 mode: PW/PW res: [0x2b541:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.486187:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+525:39029:x1731745946388160:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 936us (1073us total) trans 12885079079 rc 0/0 00010000:00010000:0.0:1651529344.486187:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000011a71df9 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.486188:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c5065f lrc: 2/0,0 mode: PW/PW res: [0x2b541:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.486190:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211026 00010000:00010000:0.0:1651529344.486190:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c5065f lrc: 3/0,0 mode: PW/PW res: [0x2b541:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486195:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c5065f lrc: 1/0,0 mode: --/PW res: [0x2b541:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486198:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011a71df9/0x3234de053c5065f lrc: 0/0,0 mode: --/PW res: [0x2b541:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486202:0:80279:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5eb030a/0x3234de053c4d80d lrc: 0/0,0 mode: --/PR res: [0x2b544:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d115e expref: 1538 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.486202:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c50666 lrc: 2/0,0 mode: PW/PW res: [0x2b542:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.486205:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000533fe698 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996972544:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.486205:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005d39750f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.486206:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c50666 lrc: 2/0,0 mode: PW/PW res: [0x2b542:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486208:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c50666 lrc: 3/0,0 mode: PW/PW res: [0x2b542:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486209:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006b6f07f6/0x3234de053c50674 lrc: 3/0,1 mode: PW/PW res: [0x2b544:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486211:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c50666 lrc: 1/0,0 mode: --/PW res: [0x2b542:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486212:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006b6f07f6/0x3234de053c50674 lrc: 3/0,1 mode: PW/PW res: [0x2b544:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486214:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c50666 lrc: 0/0,0 mode: --/PW res: [0x2b542:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486217:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b6f07f6/0x3234de053c50674 lrc: 3/0,1 mode: PW/PW res: [0x2b544:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486220:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b6f07f6/0x3234de053c50674 lrc: 3/0,1 mode: PW/PW res: [0x2b544:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486243:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b6f07f6/0x3234de053c50674 lrc: 2/0,0 mode: PW/PW res: [0x2b544:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486246:0:106695:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000068ac74b/0x3234de053c4dd2a lrc: 0/0,0 mode: --/PR res: [0x2b543:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d259a expref: 1537 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.486255:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996972480:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.486259:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c5066d lrc: 3/0,1 mode: PW/PW res: [0x2b543:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486262:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c5066d lrc: 3/0,1 mode: PW/PW res: [0x2b543:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486267:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c5066d lrc: 3/0,1 mode: PW/PW res: [0x2b543:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486270:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c5066d lrc: 3/0,1 mode: PW/PW res: [0x2b543:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486273:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c5066d lrc: 2/0,0 mode: PW/PW res: [0x2b543:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.486282:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+525:39030:x1731745946388288:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 983us (1147us total) trans 12885079080 rc 0/0 00000100:00100000:1.0:1651529344.486285:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211028 00010000:00010000:1.0:1651529344.486292:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000069f47d6/0x3234de053c50658 lrc: 3/0,1 mode: PW/PW res: [0x2b53f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486295:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000069f47d6/0x3234de053c50658 lrc: 3/0,1 mode: PW/PW res: [0x2b53f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486298:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000069f47d6/0x3234de053c50658 lrc: 3/0,1 mode: PW/PW res: [0x2b53f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486301:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000069f47d6/0x3234de053c50658 lrc: 2/0,0 mode: PW/PW res: [0x2b53f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.486318:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+525:39030:x1731745946388224:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1054us (1197us total) trans 12885079081 rc 0/0 00000100:00100000:0.0:1651529344.486321:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211027 00010000:00010000:0.0:1651529344.486328:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b6f07f6/0x3234de053c50674 lrc: 2/0,0 mode: PW/PW res: [0x2b544:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486331:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006b6f07f6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.486332:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b6f07f6/0x3234de053c50674 lrc: 2/0,0 mode: PW/PW res: [0x2b544:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486334:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b6f07f6/0x3234de053c50674 lrc: 3/0,0 mode: PW/PW res: [0x2b544:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.486339:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+525:39029:x1731745946387904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1154us (1276us total) trans 12885079082 rc 0/0 00010000:00010000:0.0:1651529344.486339:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b6f07f6/0x3234de053c50674 lrc: 1/0,0 mode: --/PW res: [0x2b544:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486342:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b6f07f6/0x3234de053c50674 lrc: 0/0,0 mode: --/PW res: [0x2b544:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.486344:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211024 00010000:00010000:0.0:1651529344.486346:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c5066d lrc: 2/0,0 mode: PW/PW res: [0x2b543:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486349:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000364b2cdc already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.486350:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c5066d lrc: 2/0,0 mode: PW/PW res: [0x2b543:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486352:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c5066d lrc: 3/0,0 mode: PW/PW res: [0x2b543:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486355:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c5066d lrc: 1/0,0 mode: --/PW res: [0x2b543:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486358:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000364b2cdc/0x3234de053c5066d lrc: 0/0,0 mode: --/PW res: [0x2b543:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486367:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000069f47d6/0x3234de053c50658 lrc: 2/0,0 mode: PW/PW res: [0x2b53f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486370:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000069f47d6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.486371:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000069f47d6/0x3234de053c50658 lrc: 2/0,0 mode: PW/PW res: [0x2b53f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486373:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000069f47d6/0x3234de053c50658 lrc: 3/0,0 mode: PW/PW res: [0x2b53f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486377:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000069f47d6/0x3234de053c50658 lrc: 1/0,0 mode: --/PW res: [0x2b53f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486380:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000069f47d6/0x3234de053c50658 lrc: 0/0,0 mode: --/PW res: [0x2b53f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.486385:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.486390:0:80281:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fa75d86/0x3234de053c4e7c6 lrc: 0/0,0 mode: --/PR res: [0x2b545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4fb6 expref: 1536 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.486393:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996972608:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.486397:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a9690ad5/0x3234de053c5067b lrc: 3/0,1 mode: PW/PW res: [0x2b545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486400:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a9690ad5/0x3234de053c5067b lrc: 3/0,1 mode: PW/PW res: [0x2b545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486403:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9690ad5/0x3234de053c5067b lrc: 3/0,1 mode: PW/PW res: [0x2b545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486405:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9690ad5/0x3234de053c5067b lrc: 3/0,1 mode: PW/PW res: [0x2b545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486408:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9690ad5/0x3234de053c5067b lrc: 2/0,0 mode: PW/PW res: [0x2b545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.486443:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+525:39029:x1731745946388352:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1135us (1291us total) trans 12885079083 rc 0/0 00000100:00100000:0.0:1651529344.486446:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211029 00010000:00010000:0.0:1651529344.486452:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9690ad5/0x3234de053c5067b lrc: 2/0,0 mode: PW/PW res: [0x2b545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486456:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a9690ad5 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.486457:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9690ad5/0x3234de053c5067b lrc: 2/0,0 mode: PW/PW res: [0x2b545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486459:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9690ad5/0x3234de053c5067b lrc: 3/0,0 mode: PW/PW res: [0x2b545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486463:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9690ad5/0x3234de053c5067b lrc: 1/0,0 mode: --/PW res: [0x2b545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486466:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9690ad5/0x3234de053c5067b lrc: 0/0,0 mode: --/PW res: [0x2b545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.486475:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996972672:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.486497:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50682 lrc: 3/0,1 mode: --/PW res: [0x2b546:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.486499:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396269504 00010000:00010000:1.0:1651529344.486505:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002925c134/0x3234de053c4e255 lrc: 4/0,0 mode: PR/PR res: [0x2b546:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a93 expref: 1536 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.486505:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fc130754/0x3234de053c50651 lrc: 3/0,1 mode: PW/PW res: [0x2b540:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486508:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc130754/0x3234de053c50651 lrc: 3/0,1 mode: PW/PW res: [0x2b540:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486511:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc130754/0x3234de053c50651 lrc: 3/0,1 mode: PW/PW res: [0x2b540:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.486517:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11812 00000100:00100000:1.0:1651529344.486518:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a253639 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1536:41278:x1731746396269504:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.486521:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.486522:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc130754/0x3234de053c50651 lrc: 2/0,0 mode: PW/PW res: [0x2b540:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486523:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002925c134/0x3234de053c4e255 lrc: 4/0,0 mode: PR/PR res: [0x2b546:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a93 expref: 1536 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.486527:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002925c134/0x3234de053c4e255 lrc: 3/0,0 mode: PR/PR res: [0x2b546:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a93 expref: 1536 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.486532:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002925c134/0x3234de053c4e255 lrc: 0/0,0 mode: --/PR res: [0x2b546:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a93 expref: 1536 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.486536:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.486537:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.486537:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50682 lrc: 3/0,1 mode: PW/PW res: [0x2b546:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486541:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50682 lrc: 4/0,1 mode: PW/PW res: [0x2b546:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486549:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.486558:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a253639 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1535:41278:x1731746396269504:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 39us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.486561:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11812 00000100:00100000:0.0:1651529344.486577:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+525:39030:x1731745946387968:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1476us (1535us total) trans 12885079084 rc 0/0 00000100:00100000:0.0:1651529344.486580:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211023 00010000:00010000:0.0:1651529344.486587:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc130754/0x3234de053c50651 lrc: 2/0,0 mode: PW/PW res: [0x2b540:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486590:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fc130754 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.486592:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc130754/0x3234de053c50651 lrc: 2/0,0 mode: PW/PW res: [0x2b540:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486594:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc130754/0x3234de053c50651 lrc: 3/0,0 mode: PW/PW res: [0x2b540:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486599:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc130754/0x3234de053c50651 lrc: 1/0,0 mode: --/PW res: [0x2b540:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486601:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc130754/0x3234de053c50651 lrc: 0/0,0 mode: --/PW res: [0x2b540:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486607:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50682 lrc: 3/0,1 mode: PW/PW res: [0x2b546:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486610:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50682 lrc: 3/0,1 mode: PW/PW res: [0x2b546:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486613:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50682 lrc: 3/0,1 mode: PW/PW res: [0x2b546:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486616:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50682 lrc: 2/0,0 mode: PW/PW res: [0x2b546:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.486699:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+525:39029:x1731745946388480:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 927us (950us total) trans 12885079085 rc 0/0 00000100:00100000:0.0:1651529344.486702:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211030 00010000:00010000:0.0:1651529344.486709:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50682 lrc: 2/0,0 mode: PW/PW res: [0x2b546:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486712:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000048c07243 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.486713:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.486713:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50682 lrc: 2/0,0 mode: PW/PW res: [0x2b546:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486716:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50682 lrc: 3/0,0 mode: PW/PW res: [0x2b546:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486732:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50682 lrc: 1/0,0 mode: --/PW res: [0x2b546:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486743:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50682 lrc: 0/0,0 mode: --/PW res: [0x2b546:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.486749:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.486758:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946388992 00000100:00100000:1.0:1651529344.486760:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.486768:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.486779:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946389056 00000100:00100000:1.0:1651529344.486784:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.486787:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946389120 00000100:00100000:0.0:1651529344.486799:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946389184 00000100:00100000:0.0:1651529344.486806:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946389248 00000100:00100000:0.0:1651529344.486810:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211031 00000100:00100000:1.0:1651529344.486811:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.486811:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+529:39030:x1731745946388992:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.486819:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946389312 00000100:00100000:1.0:1651529344.486825:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211032 00000100:00100000:1.0:1651529344.486827:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+530:39029:x1731745946389056:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.486834:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177479 count 1 00002000:00080000:1.0:1651529344.486838:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177480 count 1 00010000:00010000:1.0:1651529344.486843:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b00577e/0x3234de053c50689 lrc: 3/0,1 mode: --/PW res: [0x2b548:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486848:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006816963f/0x3234de053c4d902 lrc: 2/0,0 mode: PR/PR res: [0x2b548:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1516 expref: 1534 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.486851:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.486852:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.486853:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b00577e/0x3234de053c50689 lrc: 4/0,1 mode: --/PW res: [0x2b548:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486858:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50690 lrc: 3/0,1 mode: --/PW res: [0x2b547:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486859:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006816963f/0x3234de053c4d902 lrc: 3/0,0 mode: PR/PR res: [0x2b548:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1516 expref: 1534 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.486864:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c4cf7e lrc: 2/0,0 mode: PR/PR res: [0x2b547:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef76 expref: 1534 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.486867:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.486868:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.486868:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50690 lrc: 4/0,1 mode: --/PW res: [0x2b547:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486871:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006816963f/0x3234de053c4d902 lrc: 4/0,0 mode: PR/PR res: [0x2b548:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1516 expref: 1534 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.486876:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000078a40aa9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996972736:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.486876:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c4cf7e lrc: 3/0,0 mode: PR/PR res: [0x2b547:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef76 expref: 1534 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.486879:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c4cf7e lrc: 4/0,0 mode: PR/PR res: [0x2b547:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef76 expref: 1534 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.486884:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996972800:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.486885:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f79d8146 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.486891:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211033 00000100:00100000:1.0:1651529344.486893:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+530:39030:x1731745946389120:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.486893:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 000000000d706dff going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.486898:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177481 count 1 00000100:00100000:0.0:1651529344.486900:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211034 00010000:00010000:1.0:1651529344.486901:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042c8316b/0x3234de053c50697 lrc: 3/0,1 mode: --/PW res: [0x2b549:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.486902:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+530:39029:x1731745946389184:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.486906:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009211dffb/0x3234de053c4f189 lrc: 2/0,0 mode: PR/PR res: [0x2b549:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d791c expref: 1534 pid: 72396 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.486908:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177482 count 1 00010000:00010000:1.0:1651529344.486909:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.486909:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.486910:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042c8316b/0x3234de053c50697 lrc: 4/0,1 mode: --/PW res: [0x2b549:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486911:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c5069e lrc: 3/0,1 mode: --/PW res: [0x2b54a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486915:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000076197ee9/0x3234de053c4e5b2 lrc: 2/0,0 mode: PR/PR res: [0x2b54a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4815 expref: 1534 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.486916:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009211dffb/0x3234de053c4f189 lrc: 3/0,0 mode: PR/PR res: [0x2b549:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d791c expref: 1534 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.486918:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.486919:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009211dffb/0x3234de053c4f189 lrc: 4/0,0 mode: PR/PR res: [0x2b549:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d791c expref: 1534 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.486919:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.486920:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c5069e lrc: 4/0,1 mode: --/PW res: [0x2b54a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.486923:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006929eb96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996972864:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.486926:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000076197ee9/0x3234de053c4e5b2 lrc: 3/0,0 mode: PR/PR res: [0x2b54a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4815 expref: 1534 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.486929:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000076197ee9/0x3234de053c4e5b2 lrc: 4/0,0 mode: PR/PR res: [0x2b54a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4815 expref: 1534 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.486930:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.486933:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996972928:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.486935:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211035 00000100:00100000:1.0:1651529344.486937:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+530:39030:x1731745946389248:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.486940:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aac87b31 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.486941:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177483 count 1 00010000:00010000:1.0:1651529344.486944:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c506a5 lrc: 3/0,1 mode: --/PW res: [0x2b54b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.486945:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211036 00000100:00100000:0.0:1651529344.486947:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+530:39029:x1731745946389312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.486948:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000643e16aa/0x3234de053c4adb2 lrc: 2/0,0 mode: PR/PR res: [0x2b54b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf02 expref: 1534 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.486951:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.486951:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:0.0:1651529344.486951:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177484 count 1 00010000:00010000:1.0:1651529344.486952:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c506a5 lrc: 4/0,1 mode: --/PW res: [0x2b54b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.486954:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c506ac lrc: 3/0,1 mode: --/PW res: [0x2b54c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.486958:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000643e16aa/0x3234de053c4adb2 lrc: 3/0,0 mode: PR/PR res: [0x2b54b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf02 expref: 1534 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.486958:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000080981043/0x3234de053c4efec lrc: 2/0,0 mode: PR/PR res: [0x2b54c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7246 expref: 1534 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.486961:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000643e16aa/0x3234de053c4adb2 lrc: 4/0,0 mode: PR/PR res: [0x2b54b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf02 expref: 1534 pid: 80276 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.486961:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.486962:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.486963:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c506ac lrc: 4/0,1 mode: --/PW res: [0x2b54c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.486965:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000027c41311 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996972992:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.486968:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000080981043/0x3234de053c4efec lrc: 3/0,0 mode: PR/PR res: [0x2b54c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7246 expref: 1534 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.486971:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d09f5ee1 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.486972:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000080981043/0x3234de053c4efec lrc: 4/0,0 mode: PR/PR res: [0x2b54c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7246 expref: 1534 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.486975:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996973056:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.486982:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e7e12492 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.486986:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.487000:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946389376 00000100:00100000:1.0:1651529344.487005:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.487016:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946389440 00000100:00100000:0.0:1651529344.487022:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211037 00000100:00100000:0.0:1651529344.487024:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+532:39030:x1731745946389376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.487028:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177485 count 1 00010000:00010000:0.0:1651529344.487032:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c506b3 lrc: 3/0,1 mode: --/PW res: [0x2b54d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.487036:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c051fb30/0x3234de053c4f086 lrc: 2/0,0 mode: PR/PR res: [0x2b54d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d74f4 expref: 1534 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.487039:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.487040:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.487041:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c506b3 lrc: 4/0,1 mode: --/PW res: [0x2b54d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.487047:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c051fb30/0x3234de053c4f086 lrc: 3/0,0 mode: PR/PR res: [0x2b54d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d74f4 expref: 1534 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.487050:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c051fb30/0x3234de053c4f086 lrc: 4/0,0 mode: PR/PR res: [0x2b54d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d74f4 expref: 1534 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.487054:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996973120:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.487062:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060852af0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.487068:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211038 00000100:00100000:0.0:1651529344.487069:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+532:39030:x1731745946389440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.487073:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177486 count 1 00010000:00010000:0.0:1651529344.487076:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c506ba lrc: 3/0,1 mode: --/PW res: [0x2b54e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.487097:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ec47e574/0x3234de053c4e779 lrc: 2/0,0 mode: PR/PR res: [0x2b54e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e90 expref: 1534 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.487100:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.487101:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.487102:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c506ba lrc: 4/0,1 mode: --/PW res: [0x2b54e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.487108:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ec47e574/0x3234de053c4e779 lrc: 3/0,0 mode: PR/PR res: [0x2b54e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e90 expref: 1534 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.487114:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ec47e574/0x3234de053c4e779 lrc: 4/0,0 mode: PR/PR res: [0x2b54e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e90 expref: 1534 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.487118:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996973184:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.487142:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c0dff858 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.487192:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000078a40aa9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996972736:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.487197:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004b00577e/0x3234de053c50689 lrc: 3/0,1 mode: --/PW res: [0x2b548:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.487248:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996972800:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.487253:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50690 lrc: 3/0,1 mode: --/PW res: [0x2b547:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.487603:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.487614:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996972928:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.487619:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c5069e lrc: 3/0,1 mode: --/PW res: [0x2b54a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.487626:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396270080 00000100:00100000:1.0:1651529344.487631:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.487631:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006816963f/0x3234de053c4d902 lrc: 4/0,0 mode: PR/PR res: [0x2b548:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1516 expref: 1535 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.487639:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.487648:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.487649:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396270144 00010000:00010000:0.0:1651529344.487652:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009211dffb/0x3234de053c4f189 lrc: 5/0,0 mode: PR/PR res: [0x2b549:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d791c expref: 1536 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.487653:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.487677:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396270208 00010000:00010000:0.0:1651529344.487679:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c4cf7e lrc: 4/0,0 mode: PR/PR res: [0x2b547:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef76 expref: 1537 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.487691:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.487692:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396270272 00010000:00010000:0.0:1651529344.487695:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000076197ee9/0x3234de053c4e5b2 lrc: 4/0,0 mode: PR/PR res: [0x2b54a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4815 expref: 1538 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.487696:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.487699:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396270336 00010000:00010000:0.0:1651529344.487701:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000643e16aa/0x3234de053c4adb2 lrc: 5/0,0 mode: PR/PR res: [0x2b54b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf02 expref: 1539 pid: 80276 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.487702:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.487705:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396270464 00010000:00010000:0.0:1651529344.487707:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c051fb30/0x3234de053c4f086 lrc: 5/0,0 mode: PR/PR res: [0x2b54d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d74f4 expref: 1540 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.487710:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006929eb96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996972864:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.487711:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396270400 00010000:00010000:0.0:1651529344.487713:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000080981043/0x3234de053c4efec lrc: 5/0,0 mode: PR/PR res: [0x2b54c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7246 expref: 1541 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.487714:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000042c8316b/0x3234de053c50697 lrc: 3/0,1 mode: --/PW res: [0x2b549:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.487717:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396270528 00010000:00010000:0.0:1651529344.487719:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ec47e574/0x3234de053c4e779 lrc: 5/0,0 mode: PR/PR res: [0x2b54e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e90 expref: 1542 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.487721:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000027c41311 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996972992:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.487723:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11813 00010000:00010000:1.0:1651529344.487724:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c506a5 lrc: 3/0,1 mode: --/PW res: [0x2b54b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.487725:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1542:41279:x1731746396270080:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.487728:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.487729:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006816963f/0x3234de053c4d902 lrc: 4/0,0 mode: PR/PR res: [0x2b548:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1516 expref: 1542 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.487730:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11814 00000100:00100000:1.0:1651529344.487732:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1542:41278:x1731746396270144:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.487745:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006816963f/0x3234de053c4d902 lrc: 3/0,0 mode: PR/PR res: [0x2b548:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1516 expref: 1542 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.487746:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.487748:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009211dffb/0x3234de053c4f189 lrc: 4/0,0 mode: PR/PR res: [0x2b549:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d791c expref: 1542 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.487752:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009211dffb/0x3234de053c4f189 lrc: 3/0,0 mode: PR/PR res: [0x2b549:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d791c expref: 1542 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.487752:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006816963f/0x3234de053c4d902 lrc: 0/0,0 mode: --/PR res: [0x2b548:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1516 expref: 1542 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.487755:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.487756:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.487757:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004b00577e/0x3234de053c50689 lrc: 3/0,1 mode: PW/PW res: [0x2b548:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.487760:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009211dffb/0x3234de053c4f189 lrc: 0/0,0 mode: --/PR res: [0x2b549:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d791c expref: 1541 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.487760:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b00577e/0x3234de053c50689 lrc: 4/0,1 mode: PW/PW res: [0x2b548:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.487764:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.487765:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.487766:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000042c8316b/0x3234de053c50697 lrc: 3/0,1 mode: PW/PW res: [0x2b549:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.487769:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.487774:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042c8316b/0x3234de053c50697 lrc: 4/0,1 mode: PW/PW res: [0x2b549:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.487780:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1540:41279:x1731746396270080:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 54us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.487783:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11813 00010000:00010000:1.0:1651529344.487784:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.487788:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11815 00000100:00100000:0.0:1651529344.487790:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1539:41279:x1731746396270208:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.487792:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1539:41278:x1731746396270144:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 59us (167us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.487792:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.487794:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11814 00010000:00010000:0.0:1651529344.487794:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c4cf7e lrc: 4/0,0 mode: PR/PR res: [0x2b547:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef76 expref: 1539 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.487798:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c4cf7e lrc: 3/0,0 mode: PR/PR res: [0x2b547:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef76 expref: 1538 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.487801:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11816 00000100:00100000:1.0:1651529344.487802:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1538:41278:x1731746396270272:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.487803:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c4cf7e lrc: 0/0,0 mode: --/PR res: [0x2b547:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef76 expref: 1538 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.487805:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.487806:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000076197ee9/0x3234de053c4e5b2 lrc: 4/0,0 mode: PR/PR res: [0x2b54a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4815 expref: 1537 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.487806:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.487807:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.487807:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50690 lrc: 3/0,1 mode: PW/PW res: [0x2b547:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.487810:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000076197ee9/0x3234de053c4e5b2 lrc: 3/0,0 mode: PR/PR res: [0x2b54a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4815 expref: 1537 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.487810:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50690 lrc: 4/0,1 mode: PW/PW res: [0x2b547:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.487815:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076197ee9/0x3234de053c4e5b2 lrc: 0/0,0 mode: --/PR res: [0x2b54a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4815 expref: 1537 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.487817:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.487821:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.487821:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.487822:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c5069e lrc: 3/0,1 mode: PW/PW res: [0x2b54a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.487822:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1536:41279:x1731746396270208:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 32us (183us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.487825:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c5069e lrc: 4/0,1 mode: PW/PW res: [0x2b54a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.487825:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11815 00000100:00100000:0.0:1651529344.487829:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11817 00000100:00100000:0.0:1651529344.487830:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1535:41279:x1731746396270336:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.487834:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.487839:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.487840:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1535:41278:x1731746396270272:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (192us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.487840:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000643e16aa/0x3234de053c4adb2 lrc: 4/0,0 mode: PR/PR res: [0x2b54b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf02 expref: 1535 pid: 80276 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.487843:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11816 00010000:00010000:0.0:1651529344.487844:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000643e16aa/0x3234de053c4adb2 lrc: 3/0,0 mode: PR/PR res: [0x2b54b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf02 expref: 1535 pid: 80276 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.487848:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11818 00000100:00100000:1.0:1651529344.487849:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1534:41279:x1731746396270464:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.487849:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000643e16aa/0x3234de053c4adb2 lrc: 0/0,0 mode: --/PR res: [0x2b54b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf02 expref: 1534 pid: 80276 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.487852:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.487853:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c051fb30/0x3234de053c4f086 lrc: 5/0,0 mode: PR/PR res: [0x2b54d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d74f4 expref: 1534 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.487855:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.487855:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.487856:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c506a5 lrc: 3/0,1 mode: PW/PW res: [0x2b54b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.487857:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c051fb30/0x3234de053c4f086 lrc: 4/0,0 mode: PR/PR res: [0x2b54d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d74f4 expref: 1533 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.487859:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c506a5 lrc: 4/0,1 mode: PW/PW res: [0x2b54b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.487861:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.487862:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.487862:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c506b3 lrc: 3/0,1 mode: PW/PW res: [0x2b54d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.487867:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.487873:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1533:41279:x1731746396270336:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (219us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.487874:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c506b3 lrc: 4/0,1 mode: PW/PW res: [0x2b54d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.487875:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11817 00010000:00010000:1.0:1651529344.487879:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.487880:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11819 00000100:00100000:0.0:1651529344.487881:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8f0043c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1532:41279:x1731746396270400:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.487883:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.487884:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1532:41279:x1731746396270464:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (194us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.487885:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000080981043/0x3234de053c4efec lrc: 5/0,0 mode: PR/PR res: [0x2b54c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7246 expref: 1532 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.487887:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11818 00010000:00010000:0.0:1651529344.487888:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000080981043/0x3234de053c4efec lrc: 4/0,0 mode: PR/PR res: [0x2b54c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7246 expref: 1532 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.487891:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11820 00000100:00100000:1.0:1651529344.487893:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1531:41279:x1731746396270528:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.487893:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.487893:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.487894:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c506ac lrc: 3/0,1 mode: PW/PW res: [0x2b54c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.487895:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.487896:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ec47e574/0x3234de053c4e779 lrc: 5/0,0 mode: PR/PR res: [0x2b54e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e90 expref: 1531 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.487899:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c506ac lrc: 4/0,1 mode: PW/PW res: [0x2b54c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.487900:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ec47e574/0x3234de053c4e779 lrc: 4/0,0 mode: PR/PR res: [0x2b54e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e90 expref: 1531 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.487903:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.487905:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.487905:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.487906:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c506ba lrc: 3/0,1 mode: PW/PW res: [0x2b54e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.487908:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c506ba lrc: 4/0,1 mode: PW/PW res: [0x2b54e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.487908:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8f0043c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1531:41279:x1731746396270400:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 26us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.487910:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11819 00010000:00010000:1.0:1651529344.487913:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.487917:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1530:41279:x1731746396270528:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 24us (215us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.487919:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c5069e lrc: 3/0,1 mode: PW/PW res: [0x2b54a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.487920:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11820 00010000:00010000:0.0:1651529344.487923:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c5069e lrc: 3/0,1 mode: PW/PW res: [0x2b54a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.487926:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004b00577e/0x3234de053c50689 lrc: 3/0,1 mode: PW/PW res: [0x2b548:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.487926:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c5069e lrc: 3/0,1 mode: PW/PW res: [0x2b54a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.487928:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c5069e lrc: 2/0,0 mode: PW/PW res: [0x2b54a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.487929:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b00577e/0x3234de053c50689 lrc: 3/0,1 mode: PW/PW res: [0x2b548:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.487932:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b00577e/0x3234de053c50689 lrc: 3/0,1 mode: PW/PW res: [0x2b548:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.487935:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b00577e/0x3234de053c50689 lrc: 2/0,0 mode: PW/PW res: [0x2b548:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.487981:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+534:39029:x1731745946389184:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1078us (1213us total) trans 12885079086 rc 0/0 00000100:00100000:0.0:1651529344.487984:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211034 00000100:00100000:1.0:1651529344.487987:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+533:39029:x1731745946389056:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1159us (1238us total) trans 12885079087 rc 0/0 00000100:00100000:1.0:1651529344.487990:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211032 00010000:00010000:0.0:1651529344.487992:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c5069e lrc: 2/0,0 mode: PW/PW res: [0x2b54a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.487995:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e0e037e6 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.487997:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c506a5 lrc: 3/0,1 mode: PW/PW res: [0x2b54b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.487997:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c5069e lrc: 2/0,0 mode: PW/PW res: [0x2b54a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488000:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c506a5 lrc: 3/0,1 mode: PW/PW res: [0x2b54b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488000:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c5069e lrc: 3/0,0 mode: PW/PW res: [0x2b54a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488003:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c506a5 lrc: 3/0,1 mode: PW/PW res: [0x2b54b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488004:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c5069e lrc: 1/0,0 mode: --/PW res: [0x2b54a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488006:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c506a5 lrc: 2/0,0 mode: PW/PW res: [0x2b54b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488007:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c5069e lrc: 0/0,0 mode: --/PW res: [0x2b54a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488011:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b00577e/0x3234de053c50689 lrc: 2/0,0 mode: PW/PW res: [0x2b548:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488014:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004b00577e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.488020:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b00577e/0x3234de053c50689 lrc: 2/0,0 mode: PW/PW res: [0x2b548:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488024:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b00577e/0x3234de053c50689 lrc: 3/0,0 mode: PW/PW res: [0x2b548:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488027:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b00577e/0x3234de053c50689 lrc: 1/0,0 mode: --/PW res: [0x2b548:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488030:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b00577e/0x3234de053c50689 lrc: 0/0,0 mode: --/PW res: [0x2b548:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488034:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c506a5 lrc: 2/0,0 mode: PW/PW res: [0x2b54b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488037:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000fe54815 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.488038:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c506a5 lrc: 2/0,0 mode: PW/PW res: [0x2b54b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488040:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c506a5 lrc: 3/0,0 mode: PW/PW res: [0x2b54b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488043:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c506a5 lrc: 1/0,0 mode: --/PW res: [0x2b54b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.488046:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+533:39030:x1731745946389248:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1108us (1262us total) trans 12885079088 rc 0/0 00010000:00010000:0.0:1651529344.488046:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c506a5 lrc: 0/0,0 mode: --/PW res: [0x2b54b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.488049:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211035 00010000:00010000:1.0:1651529344.488056:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000042c8316b/0x3234de053c50697 lrc: 3/0,1 mode: PW/PW res: [0x2b549:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488057:0:106695:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080981043/0x3234de053c4efec lrc: 0/0,0 mode: --/PR res: [0x2b54c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7246 expref: 1529 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.488059:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042c8316b/0x3234de053c50697 lrc: 3/0,1 mode: PW/PW res: [0x2b549:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.488060:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996973056:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.488062:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042c8316b/0x3234de053c50697 lrc: 3/0,1 mode: PW/PW res: [0x2b549:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488063:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c506ac lrc: 3/0,1 mode: PW/PW res: [0x2b54c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488065:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042c8316b/0x3234de053c50697 lrc: 2/0,0 mode: PW/PW res: [0x2b549:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488066:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c506ac lrc: 3/0,1 mode: PW/PW res: [0x2b54c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488069:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c506ac lrc: 3/0,1 mode: PW/PW res: [0x2b54c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488080:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c506ac lrc: 3/0,1 mode: PW/PW res: [0x2b54c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488083:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c506ac lrc: 2/0,0 mode: PW/PW res: [0x2b54c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.488101:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+534:39030:x1731745946389120:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1207us (1341us total) trans 12885079089 rc 0/0 00000100:00100000:1.0:1651529344.488104:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211033 00000100:00100000:0.0:1651529344.488120:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+533:39029:x1731745946389312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1172us (1309us total) trans 12885079090 rc 0/0 00000100:00100000:0.0:1651529344.488123:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211036 00010000:00010000:0.0:1651529344.488130:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042c8316b/0x3234de053c50697 lrc: 2/0,0 mode: PW/PW res: [0x2b549:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488133:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042c8316b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.488134:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042c8316b/0x3234de053c50697 lrc: 2/0,0 mode: PW/PW res: [0x2b549:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488137:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042c8316b/0x3234de053c50697 lrc: 3/0,0 mode: PW/PW res: [0x2b549:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488142:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042c8316b/0x3234de053c50697 lrc: 1/0,0 mode: --/PW res: [0x2b549:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488145:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042c8316b/0x3234de053c50697 lrc: 0/0,0 mode: --/PW res: [0x2b549:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488149:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c506ac lrc: 2/0,0 mode: PW/PW res: [0x2b54c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488152:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000677ce99b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.488152:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c506ac lrc: 2/0,0 mode: PW/PW res: [0x2b54c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488155:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c506ac lrc: 3/0,0 mode: PW/PW res: [0x2b54c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488158:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c506ac lrc: 1/0,0 mode: --/PW res: [0x2b54c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488161:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c506ac lrc: 0/0,0 mode: --/PW res: [0x2b54c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488169:0:80281:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec47e574/0x3234de053c4e779 lrc: 0/0,0 mode: --/PR res: [0x2b54e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e90 expref: 1528 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.488173:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996973184:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.488176:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c506ba lrc: 3/0,1 mode: PW/PW res: [0x2b54e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488179:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c506ba lrc: 3/0,1 mode: PW/PW res: [0x2b54e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488181:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c506ba lrc: 3/0,1 mode: PW/PW res: [0x2b54e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488187:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c506ba lrc: 3/0,1 mode: PW/PW res: [0x2b54e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488190:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c506ba lrc: 2/0,0 mode: PW/PW res: [0x2b54e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.488290:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+533:39030:x1731745946389440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1220us (1285us total) trans 12885079091 rc 0/0 00000100:00100000:0.0:1651529344.488293:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211038 00010000:00010000:0.0:1651529344.488304:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c506ba lrc: 2/0,0 mode: PW/PW res: [0x2b54e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488307:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000cfc1a54 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.488308:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c506ba lrc: 2/0,0 mode: PW/PW res: [0x2b54e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488311:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c506ba lrc: 3/0,0 mode: PW/PW res: [0x2b54e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488315:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c506ba lrc: 1/0,0 mode: --/PW res: [0x2b54e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488318:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000cfc1a54/0x3234de053c506ba lrc: 0/0,0 mode: --/PW res: [0x2b54e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488324:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50690 lrc: 3/0,1 mode: PW/PW res: [0x2b547:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488355:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50690 lrc: 3/0,1 mode: PW/PW res: [0x2b547:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488358:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50690 lrc: 3/0,1 mode: PW/PW res: [0x2b547:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488361:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50690 lrc: 2/0,0 mode: PW/PW res: [0x2b547:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.488364:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.488382:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.488391:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.488400:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.488406:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.488414:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+533:39030:x1731745946388992:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1602us (1707us total) trans 12885079092 rc 0/0 00000100:00100000:0.0:1651529344.488417:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211031 00000100:00100000:0.0:1651529344.488422:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946390016 00000100:00100000:0.0:1651529344.488428:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946390080 00000100:00100000:0.0:1651529344.488433:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946390144 00000100:00100000:0.0:1651529344.488436:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946390208 00000100:00100000:0.0:1651529344.488441:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946390272 00000100:00100000:0.0:1651529344.488447:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211039 00000100:00100000:0.0:1651529344.488449:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+537:39030:x1731745946390016:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.488454:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177487 count 1 00000100:00100000:1.0:1651529344.488456:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211040 00000100:00100000:1.0:1651529344.488458:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+537:39029:x1731745946390080:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.488458:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c506c1 lrc: 3/0,1 mode: --/PW res: [0x2b54f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.488466:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177488 count 1 00010000:00010000:1.0:1651529344.488471:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c506c8 lrc: 3/0,1 mode: --/PW res: [0x2b550:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488476:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000084a07220/0x3234de053c4d391 lrc: 2/0,0 mode: PR/PR res: [0x2b550:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d006a expref: 1527 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.488477:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c4c6e1 lrc: 2/0,0 mode: PR/PR res: [0x2b54f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd72 expref: 1527 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.488479:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.488479:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.488480:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c506c8 lrc: 4/0,1 mode: --/PW res: [0x2b550:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488487:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000084a07220/0x3234de053c4d391 lrc: 3/0,0 mode: PR/PR res: [0x2b550:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d006a expref: 1527 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.488494:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.488495:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.488495:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c506c1 lrc: 4/0,1 mode: --/PW res: [0x2b54f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488497:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000084a07220/0x3234de053c4d391 lrc: 4/0,0 mode: PR/PR res: [0x2b550:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d006a expref: 1527 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.488502:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e124baf1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996973248:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.488504:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c4c6e1 lrc: 3/0,0 mode: PR/PR res: [0x2b54f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd72 expref: 1527 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.488507:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c4c6e1 lrc: 4/0,0 mode: PR/PR res: [0x2b54f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd72 expref: 1527 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.488511:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d09f5ee1 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.488512:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996973312:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.488517:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211041 00000100:00100000:1.0:1651529344.488519:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085af61db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+537:39030:x1731745946390144:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.488521:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c086aae3 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.488523:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177489 count 1 00010000:00010000:0.0:1651529344.488526:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50690 lrc: 2/0,0 mode: PW/PW res: [0x2b547:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488527:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c506cf lrc: 3/0,1 mode: --/PW res: [0x2b551:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488529:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000069f7ba22 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.488530:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50690 lrc: 2/0,0 mode: PW/PW res: [0x2b547:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488531:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000564fa490/0x3234de053c4d62a lrc: 2/0,0 mode: PR/PR res: [0x2b551:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a2d expref: 1527 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.488533:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50690 lrc: 3/0,0 mode: PW/PW res: [0x2b547:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488534:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.488535:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.488536:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c506cf lrc: 4/0,1 mode: --/PW res: [0x2b551:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488538:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50690 lrc: 1/0,0 mode: --/PW res: [0x2b547:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488540:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50690 lrc: 0/0,0 mode: --/PW res: [0x2b547:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488542:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000564fa490/0x3234de053c4d62a lrc: 3/0,0 mode: PR/PR res: [0x2b551:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a2d expref: 1527 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.488545:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000564fa490/0x3234de053c4d62a lrc: 4/0,0 mode: PR/PR res: [0x2b551:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a2d expref: 1527 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.488549:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006731397d pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996973376:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.488550:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211042 00000100:00100000:0.0:1651529344.488552:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d1151437 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+537:39029:x1731745946390208:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.488555:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.488556:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177490 count 1 00010000:00010000:0.0:1651529344.488560:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c506d6 lrc: 3/0,1 mode: --/PW res: [0x2b552:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.488561:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211043 00000100:00100000:1.0:1651529344.488563:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+537:39030:x1731745946390272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.488564:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000156e97ce/0x3234de053c4e79c lrc: 2/0,0 mode: PR/PR res: [0x2b552:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4ef2 expref: 1527 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.488566:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177491 count 1 00010000:00010000:0.0:1651529344.488567:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.488567:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.488568:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c506d6 lrc: 4/0,1 mode: --/PW res: [0x2b552:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488570:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c506dd lrc: 3/0,1 mode: --/PW res: [0x2b553:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488574:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba0ceea2/0x3234de053c4ea20 lrc: 2/0,0 mode: PR/PR res: [0x2b553:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a05 expref: 1527 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.488574:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000156e97ce/0x3234de053c4e79c lrc: 3/0,0 mode: PR/PR res: [0x2b552:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4ef2 expref: 1527 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.488577:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.488577:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.488577:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000156e97ce/0x3234de053c4e79c lrc: 4/0,0 mode: PR/PR res: [0x2b552:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4ef2 expref: 1527 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.488578:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c506dd lrc: 4/0,1 mode: --/PW res: [0x2b553:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.488581:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996973440:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.488586:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ba0ceea2/0x3234de053c4ea20 lrc: 3/0,0 mode: PR/PR res: [0x2b553:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a05 expref: 1527 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.488588:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000003ad73843 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.488589:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ba0ceea2/0x3234de053c4ea20 lrc: 4/0,0 mode: PR/PR res: [0x2b553:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a05 expref: 1527 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.488593:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000de0edbdc pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996973504:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.488599:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f79d8146 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.488613:0:156655:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c051fb30/0x3234de053c4f086 lrc: 0/0,0 mode: --/PR res: [0x2b54d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d74f4 expref: 1527 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.488617:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996973120:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.488621:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c506b3 lrc: 3/0,1 mode: PW/PW res: [0x2b54d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488624:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c506b3 lrc: 3/0,1 mode: PW/PW res: [0x2b54d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488627:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c506b3 lrc: 3/0,1 mode: PW/PW res: [0x2b54d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488630:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c506b3 lrc: 3/0,1 mode: PW/PW res: [0x2b54d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488632:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c506b3 lrc: 2/0,0 mode: PW/PW res: [0x2b54d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.488634:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.488652:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.488687:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+538:39030:x1731745946389376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1662us (1701us total) trans 12885079093 rc 0/0 00000100:00100000:0.0:1651529344.488690:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211037 00000100:00100000:0.0:1651529344.488695:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946390336 00000100:00100000:0.0:1651529344.488702:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946390656 00000100:00100000:0.0:1651529344.488708:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211044 00000100:00100000:0.0:1651529344.488710:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+539:39030:x1731745946390336:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.488715:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177492 count 1 00010000:00010000:0.0:1651529344.488719:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cca8aba1/0x3234de053c506e4 lrc: 3/0,1 mode: --/PW res: [0x2b554:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488723:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004a899246/0x3234de053c4c4cd lrc: 2/0,0 mode: PR/PR res: [0x2b554:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc997 expref: 1526 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.488726:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.488727:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.488727:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cca8aba1/0x3234de053c506e4 lrc: 4/0,1 mode: --/PW res: [0x2b554:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488741:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004a899246/0x3234de053c4c4cd lrc: 3/0,0 mode: PR/PR res: [0x2b554:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc997 expref: 1526 pid: 72397 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.488749:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211045 00000100:00100000:1.0:1651529344.488751:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+539:39030:x1731745946390656:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.488756:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177493 count 1 00010000:00010000:1.0:1651529344.488760:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c506eb lrc: 3/0,1 mode: --/PW res: [0x2b555:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488760:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004a899246/0x3234de053c4c4cd lrc: 4/0,0 mode: PR/PR res: [0x2b554:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc997 expref: 1526 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.488765:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000026a73983/0x3234de053c4f5c6 lrc: 2/0,0 mode: PR/PR res: [0x2b555:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8992 expref: 1526 pid: 156655 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.488765:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996973568:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.488768:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.488769:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.488769:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c506eb lrc: 4/0,1 mode: --/PW res: [0x2b555:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488776:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000026a73983/0x3234de053c4f5c6 lrc: 3/0,0 mode: PR/PR res: [0x2b555:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8992 expref: 1526 pid: 156655 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.488780:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 000000003678d25f going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.488785:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c506b3 lrc: 2/0,0 mode: PW/PW res: [0x2b54d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.488788:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000026a73983/0x3234de053c4f5c6 lrc: 4/0,0 mode: PR/PR res: [0x2b555:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8992 expref: 1526 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.488789:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e02d2a50 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.488790:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c506b3 lrc: 2/0,0 mode: PW/PW res: [0x2b54d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.488792:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002a1f5cf2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996973632:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.488793:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c506b3 lrc: 3/0,0 mode: PW/PW res: [0x2b54d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488797:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c506b3 lrc: 1/0,0 mode: --/PW res: [0x2b54d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.488801:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c3caa148 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.488802:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e02d2a50/0x3234de053c506b3 lrc: 0/0,0 mode: --/PW res: [0x2b54d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.488906:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.488918:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946390720 00000100:00100000:0.0:1651529344.488926:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211046 00000100:00100000:0.0:1651529344.488927:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+540:39029:x1731745946390720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.488932:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177494 count 1 00010000:00010000:0.0:1651529344.488936:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073a973b4/0x3234de053c506f2 lrc: 3/0,1 mode: --/PW res: [0x2b556:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488941:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b36cca9f/0x3234de053c4db39 lrc: 2/0,0 mode: PR/PR res: [0x2b556:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1cf6 expref: 1526 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.488944:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.488944:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.488945:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073a973b4/0x3234de053c506f2 lrc: 4/0,1 mode: --/PW res: [0x2b556:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.488952:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b36cca9f/0x3234de053c4db39 lrc: 3/0,0 mode: PR/PR res: [0x2b556:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1cf6 expref: 1526 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.488955:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b36cca9f/0x3234de053c4db39 lrc: 4/0,0 mode: PR/PR res: [0x2b556:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1cf6 expref: 1526 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.488959:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996973696:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.488975:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 0000000009370c1d going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.489158:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996973440:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.489163:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c506d6 lrc: 3/0,1 mode: --/PW res: [0x2b552:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.489165:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.489170:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996973312:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.489173:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c506c1 lrc: 3/0,1 mode: --/PW res: [0x2b54f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.489181:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.489189:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.489195:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.489204:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.489204:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396271168 00010000:00010000:0.0:1651529344.489209:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c4c6e1 lrc: 4/0,0 mode: PR/PR res: [0x2b54f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd72 expref: 1527 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.489213:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e124baf1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996973248:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.489215:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396271104 00010000:00010000:0.0:1651529344.489217:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000084a07220/0x3234de053c4d391 lrc: 4/0,0 mode: PR/PR res: [0x2b550:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d006a expref: 1528 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.489218:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c506c8 lrc: 3/0,1 mode: --/PW res: [0x2b550:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.489239:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396271296 00000100:00100000:1.0:1651529344.489240:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006731397d pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996973376:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.489242:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c506cf lrc: 3/0,1 mode: --/PW res: [0x2b551:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489243:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ba0ceea2/0x3234de053c4ea20 lrc: 5/0,0 mode: PR/PR res: [0x2b553:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a05 expref: 1529 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.489248:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396271232 00000100:00100000:1.0:1651529344.489249:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000de0edbdc pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996973504:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.489250:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000564fa490/0x3234de053c4d62a lrc: 4/0,0 mode: PR/PR res: [0x2b551:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a2d expref: 1530 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.489251:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c506dd lrc: 3/0,1 mode: --/PW res: [0x2b553:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.489254:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396271360 00010000:00010000:0.0:1651529344.489256:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000156e97ce/0x3234de053c4e79c lrc: 4/0,0 mode: PR/PR res: [0x2b552:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4ef2 expref: 1531 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.489258:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11821 00000100:00100000:1.0:1651529344.489260:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1531:41278:x1731746396271168:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.489263:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.489264:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11822 00010000:00010000:1.0:1651529344.489265:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c4c6e1 lrc: 4/0,0 mode: PR/PR res: [0x2b54f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd72 expref: 1531 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.489266:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1531:41279:x1731746396271104:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.489269:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c4c6e1 lrc: 3/0,0 mode: PR/PR res: [0x2b54f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd72 expref: 1531 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.489269:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.489270:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000084a07220/0x3234de053c4d391 lrc: 4/0,0 mode: PR/PR res: [0x2b550:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d006a expref: 1531 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.489274:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c4c6e1 lrc: 0/0,0 mode: --/PR res: [0x2b54f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd72 expref: 1531 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.489274:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000084a07220/0x3234de053c4d391 lrc: 3/0,0 mode: PR/PR res: [0x2b550:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d006a expref: 1531 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.489278:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.489279:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.489279:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c506c1 lrc: 3/0,1 mode: PW/PW res: [0x2b54f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489280:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084a07220/0x3234de053c4d391 lrc: 0/0,0 mode: --/PR res: [0x2b550:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d006a expref: 1530 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.489283:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c506c1 lrc: 4/0,1 mode: PW/PW res: [0x2b54f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489283:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.489284:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.489284:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c506c8 lrc: 3/0,1 mode: PW/PW res: [0x2b550:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489287:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c506c8 lrc: 4/0,1 mode: PW/PW res: [0x2b550:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.489292:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.489301:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1529:41278:x1731746396271168:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 41us (137us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.489304:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.489309:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11821 00000100:00100000:0.0:1651529344.489311:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1529:41279:x1731746396271104:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 44us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.489314:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11822 00000100:00100000:1.0:1651529344.489315:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11823 00000100:00100000:1.0:1651529344.489317:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1527:41278:x1731746396271296:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.489319:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11824 00010000:00010000:1.0:1651529344.489320:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.489321:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ba0ceea2/0x3234de053c4ea20 lrc: 4/0,0 mode: PR/PR res: [0x2b553:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a05 expref: 1527 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.489321:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1527:41279:x1731746396271232:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.489323:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.489325:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ba0ceea2/0x3234de053c4ea20 lrc: 3/0,0 mode: PR/PR res: [0x2b553:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a05 expref: 1527 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.489325:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000564fa490/0x3234de053c4d62a lrc: 4/0,0 mode: PR/PR res: [0x2b551:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a2d expref: 1527 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.489329:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000564fa490/0x3234de053c4d62a lrc: 3/0,0 mode: PR/PR res: [0x2b551:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a2d expref: 1527 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.489330:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba0ceea2/0x3234de053c4ea20 lrc: 0/0,0 mode: --/PR res: [0x2b553:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a05 expref: 1527 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.489333:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.489333:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000564fa490/0x3234de053c4d62a lrc: 0/0,0 mode: --/PR res: [0x2b551:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a2d expref: 1526 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.489334:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.489335:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c506dd lrc: 3/0,1 mode: PW/PW res: [0x2b553:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489337:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.489337:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.489338:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c506dd lrc: 4/0,1 mode: PW/PW res: [0x2b553:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489338:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c506cf lrc: 3/0,1 mode: PW/PW res: [0x2b551:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489341:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c506cf lrc: 4/0,1 mode: PW/PW res: [0x2b551:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.489343:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.489349:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1525:41278:x1731746396271296:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 31us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.489357:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11823 00000100:00100000:1.0:1651529344.489362:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11825 00000100:00100000:1.0:1651529344.489364:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1524:41279:x1731746396271360:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.489366:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.489373:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000156e97ce/0x3234de053c4e79c lrc: 4/0,0 mode: PR/PR res: [0x2b552:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4ef2 expref: 1524 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.489377:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000156e97ce/0x3234de053c4e79c lrc: 3/0,0 mode: PR/PR res: [0x2b552:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4ef2 expref: 1524 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.489382:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000156e97ce/0x3234de053c4e79c lrc: 0/0,0 mode: --/PR res: [0x2b552:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4ef2 expref: 1524 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.489384:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.489385:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.489386:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.489392:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1523:41279:x1731746396271232:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 70us (197us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.489393:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c506d6 lrc: 3/0,1 mode: PW/PW res: [0x2b552:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.489395:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11824 00010000:00010000:1.0:1651529344.489396:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c506d6 lrc: 4/0,1 mode: PW/PW res: [0x2b552:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489403:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c506c1 lrc: 3/0,1 mode: PW/PW res: [0x2b54f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.489405:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.489411:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1522:41279:x1731746396271360:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 47us (207us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.489412:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c506c1 lrc: 3/0,1 mode: PW/PW res: [0x2b54f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.489414:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11825 00010000:00010000:0.0:1651529344.489418:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c506c1 lrc: 3/0,1 mode: PW/PW res: [0x2b54f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489420:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c506c1 lrc: 2/0,0 mode: PW/PW res: [0x2b54f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.489421:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c506dd lrc: 3/0,1 mode: PW/PW res: [0x2b553:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.489425:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c506dd lrc: 3/0,1 mode: PW/PW res: [0x2b553:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.489428:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c506dd lrc: 3/0,1 mode: PW/PW res: [0x2b553:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.489430:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c506dd lrc: 2/0,0 mode: PW/PW res: [0x2b553:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.489465:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+542:39030:x1731745946390016:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1015us (1101us total) trans 12885079094 rc 0/0 00000100:00100000:0.0:1651529344.489468:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211039 00010000:00010000:0.0:1651529344.489475:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c506c1 lrc: 2/0,0 mode: PW/PW res: [0x2b54f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.489478:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+541:39030:x1731745946390272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 915us (1071us total) trans 12885079095 rc 0/0 00010000:00010000:0.0:1651529344.489478:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c78576a1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.489479:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c506c1 lrc: 2/0,0 mode: PW/PW res: [0x2b54f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.489481:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211043 00010000:00010000:0.0:1651529344.489482:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c506c1 lrc: 3/0,0 mode: PW/PW res: [0x2b54f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489486:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c506c1 lrc: 1/0,0 mode: --/PW res: [0x2b54f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.489489:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c506cf lrc: 3/0,1 mode: PW/PW res: [0x2b551:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489489:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c78576a1/0x3234de053c506c1 lrc: 0/0,0 mode: --/PW res: [0x2b54f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.489492:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c506cf lrc: 3/0,1 mode: PW/PW res: [0x2b551:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489493:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c506dd lrc: 2/0,0 mode: PW/PW res: [0x2b553:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.489495:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c506cf lrc: 3/0,1 mode: PW/PW res: [0x2b551:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489496:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cdc65e28 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.489497:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c506dd lrc: 2/0,0 mode: PW/PW res: [0x2b553:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.489498:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c506cf lrc: 2/0,0 mode: PW/PW res: [0x2b551:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489500:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c506dd lrc: 3/0,0 mode: PW/PW res: [0x2b553:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489503:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c506dd lrc: 1/0,0 mode: --/PW res: [0x2b553:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489513:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c506dd lrc: 0/0,0 mode: --/PW res: [0x2b553:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489516:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c506cf lrc: 2/0,0 mode: PW/PW res: [0x2b551:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489519:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027456046 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.489520:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c506cf lrc: 2/0,0 mode: PW/PW res: [0x2b551:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489523:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c506cf lrc: 3/0,0 mode: PW/PW res: [0x2b551:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489526:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c506cf lrc: 1/0,0 mode: --/PW res: [0x2b551:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489529:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c506cf lrc: 0/0,0 mode: --/PW res: [0x2b551:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.489534:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085af61db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+541:39030:x1731745946390144:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1014us (1143us total) trans 12885079096 rc 0/0 00010000:00010000:0.0:1651529344.489536:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c506d6 lrc: 3/0,1 mode: PW/PW res: [0x2b552:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.489537:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211041 00010000:00010000:0.0:1651529344.489539:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c506d6 lrc: 3/0,1 mode: PW/PW res: [0x2b552:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489542:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c506d6 lrc: 3/0,1 mode: PW/PW res: [0x2b552:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.489544:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c506c8 lrc: 3/0,1 mode: PW/PW res: [0x2b550:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489544:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c506d6 lrc: 2/0,0 mode: PW/PW res: [0x2b552:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.489547:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c506c8 lrc: 3/0,1 mode: PW/PW res: [0x2b550:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.489550:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c506c8 lrc: 3/0,1 mode: PW/PW res: [0x2b550:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.489555:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c506c8 lrc: 2/0,0 mode: PW/PW res: [0x2b550:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.489588:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d1151437 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+542:39029:x1731745946390208:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1035us (1188us total) trans 12885079097 rc 0/0 00000100:00100000:0.0:1651529344.489591:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211042 00000100:00100000:1.0:1651529344.489593:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+541:39029:x1731745946390080:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1134us (1212us total) trans 12885079098 rc 0/0 00000100:00100000:1.0:1651529344.489596:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211040 00010000:00010000:0.0:1651529344.489598:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c506d6 lrc: 2/0,0 mode: PW/PW res: [0x2b552:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489601:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000096a880d5 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.489602:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c506d6 lrc: 2/0,0 mode: PW/PW res: [0x2b552:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489604:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c506d6 lrc: 3/0,0 mode: PW/PW res: [0x2b552:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489609:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c506d6 lrc: 1/0,0 mode: --/PW res: [0x2b552:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489612:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096a880d5/0x3234de053c506d6 lrc: 0/0,0 mode: --/PW res: [0x2b552:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489616:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c506c8 lrc: 2/0,0 mode: PW/PW res: [0x2b550:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489618:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a69b6f5e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.489619:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c506c8 lrc: 2/0,0 mode: PW/PW res: [0x2b550:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489622:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c506c8 lrc: 3/0,0 mode: PW/PW res: [0x2b550:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489631:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c506c8 lrc: 1/0,0 mode: --/PW res: [0x2b550:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489634:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c506c8 lrc: 0/0,0 mode: --/PW res: [0x2b550:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.489645:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996973568:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.489653:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cca8aba1/0x3234de053c506e4 lrc: 3/0,1 mode: --/PW res: [0x2b554:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.489655:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.489661:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996973696:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.489663:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000073a973b4/0x3234de053c506f2 lrc: 3/0,1 mode: --/PW res: [0x2b556:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.489664:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.489674:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.489748:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396271424 00010000:00010000:1.0:1651529344.489754:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004a899246/0x3234de053c4c4cd lrc: 4/0,0 mode: PR/PR res: [0x2b554:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc997 expref: 1522 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.489767:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396271488 00010000:00010000:1.0:1651529344.489770:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000026a73983/0x3234de053c4f5c6 lrc: 5/0,0 mode: PR/PR res: [0x2b555:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8992 expref: 1523 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.489774:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396271552 00010000:00010000:1.0:1651529344.489777:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b36cca9f/0x3234de053c4db39 lrc: 4/0,0 mode: PR/PR res: [0x2b556:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1cf6 expref: 1524 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.489778:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11826 00000100:00100000:0.0:1651529344.489780:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000496e37f3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1524:41279:x1731746396271424:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.489781:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11827 00000100:00100000:1.0:1651529344.489783:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1524:41279:x1731746396271488:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.489786:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.489787:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000026a73983/0x3234de053c4f5c6 lrc: 5/0,0 mode: PR/PR res: [0x2b555:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8992 expref: 1524 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.489791:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000026a73983/0x3234de053c4f5c6 lrc: 4/0,0 mode: PR/PR res: [0x2b555:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8992 expref: 1524 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.489796:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.489797:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.489798:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c506eb lrc: 3/0,1 mode: PW/PW res: [0x2b555:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489800:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.489801:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c506eb lrc: 4/0,1 mode: PW/PW res: [0x2b555:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489802:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004a899246/0x3234de053c4c4cd lrc: 4/0,0 mode: PR/PR res: [0x2b554:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc997 expref: 1524 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.489805:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.489806:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004a899246/0x3234de053c4c4cd lrc: 3/0,0 mode: PR/PR res: [0x2b554:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc997 expref: 1524 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.489812:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a899246/0x3234de053c4c4cd lrc: 0/0,0 mode: --/PR res: [0x2b554:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc997 expref: 1524 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.489815:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1524:41279:x1731746396271488:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 31us (150us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.489816:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.489816:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.489817:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11827 00010000:00010000:0.0:1651529344.489817:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cca8aba1/0x3234de053c506e4 lrc: 3/0,1 mode: PW/PW res: [0x2b554:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489820:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cca8aba1/0x3234de053c506e4 lrc: 4/0,1 mode: PW/PW res: [0x2b554:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.489821:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11828 00000100:00100000:1.0:1651529344.489823:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1522:41278:x1731746396271552:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.489825:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.489827:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b36cca9f/0x3234de053c4db39 lrc: 4/0,0 mode: PR/PR res: [0x2b556:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1cf6 expref: 1522 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.489827:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.489830:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b36cca9f/0x3234de053c4db39 lrc: 3/0,0 mode: PR/PR res: [0x2b556:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1cf6 expref: 1522 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.489834:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000496e37f3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1522:41279:x1731746396271424:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 54us (180us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.489835:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b36cca9f/0x3234de053c4db39 lrc: 0/0,0 mode: --/PR res: [0x2b556:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1cf6 expref: 1522 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.489837:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11826 00010000:00010000:1.0:1651529344.489841:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.489841:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.489842:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000073a973b4/0x3234de053c506f2 lrc: 3/0,1 mode: PW/PW res: [0x2b556:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.489845:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073a973b4/0x3234de053c506f2 lrc: 4/0,1 mode: PW/PW res: [0x2b556:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489848:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cca8aba1/0x3234de053c506e4 lrc: 3/0,1 mode: PW/PW res: [0x2b554:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.489853:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.489858:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cca8aba1/0x3234de053c506e4 lrc: 3/0,1 mode: PW/PW res: [0x2b554:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.489859:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1520:41278:x1731746396271552:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 35us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.489862:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11828 00010000:00010000:0.0:1651529344.489862:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cca8aba1/0x3234de053c506e4 lrc: 3/0,1 mode: PW/PW res: [0x2b554:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489864:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cca8aba1/0x3234de053c506e4 lrc: 2/0,0 mode: PW/PW res: [0x2b554:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.489871:0:72397:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026a73983/0x3234de053c4f5c6 lrc: 0/0,0 mode: --/PR res: [0x2b555:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8992 expref: 1519 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.489875:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002a1f5cf2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996973632:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.489879:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c506eb lrc: 3/0,1 mode: PW/PW res: [0x2b555:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.489882:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c506eb lrc: 3/0,1 mode: PW/PW res: [0x2b555:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.489885:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c506eb lrc: 3/0,1 mode: PW/PW res: [0x2b555:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.489888:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c506eb lrc: 3/0,1 mode: PW/PW res: [0x2b555:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.489891:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c506eb lrc: 2/0,0 mode: PW/PW res: [0x2b555:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.489909:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+541:39030:x1731745946390336:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1198us (1275us total) trans 12885079099 rc 0/0 00000100:00100000:0.0:1651529344.489912:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211044 00010000:00010000:0.0:1651529344.489918:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cca8aba1/0x3234de053c506e4 lrc: 2/0,0 mode: PW/PW res: [0x2b554:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489922:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cca8aba1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.489923:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cca8aba1/0x3234de053c506e4 lrc: 2/0,0 mode: PW/PW res: [0x2b554:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.489933:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+541:39030:x1731745946390656:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1181us (1280us total) trans 12885079100 rc 0/0 00000100:00100000:1.0:1651529344.489936:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211045 00010000:00010000:0.0:1651529344.489939:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cca8aba1/0x3234de053c506e4 lrc: 3/0,0 mode: PW/PW res: [0x2b554:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489952:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cca8aba1/0x3234de053c506e4 lrc: 1/0,0 mode: --/PW res: [0x2b554:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489955:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cca8aba1/0x3234de053c506e4 lrc: 0/0,0 mode: --/PW res: [0x2b554:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489960:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c506eb lrc: 2/0,0 mode: PW/PW res: [0x2b555:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489963:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eb50e2ae already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.489963:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c506eb lrc: 2/0,0 mode: PW/PW res: [0x2b555:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489966:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c506eb lrc: 3/0,0 mode: PW/PW res: [0x2b555:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489970:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c506eb lrc: 1/0,0 mode: --/PW res: [0x2b555:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489972:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c506eb lrc: 0/0,0 mode: --/PW res: [0x2b555:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.489974:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.489978:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000073a973b4/0x3234de053c506f2 lrc: 3/0,1 mode: PW/PW res: [0x2b556:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.489981:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073a973b4/0x3234de053c506f2 lrc: 3/0,1 mode: PW/PW res: [0x2b556:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.489987:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.490000:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073a973b4/0x3234de053c506f2 lrc: 3/0,1 mode: PW/PW res: [0x2b556:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.490003:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073a973b4/0x3234de053c506f2 lrc: 2/0,0 mode: PW/PW res: [0x2b556:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.490017:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.490029:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.490046:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+541:39029:x1731745946390720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1117us (1140us total) trans 12885079101 rc 0/0 00000100:00100000:0.0:1651529344.490049:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211046 00000100:00100000:0.0:1651529344.490054:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946391104 00000100:00100000:1.0:1651529344.490059:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.490069:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946391296 00000100:00100000:0.0:1651529344.490074:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946391232 00000100:00100000:0.0:1651529344.490077:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946391424 00000100:00100000:0.0:1651529344.490082:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946391360 00000100:00100000:0.0:1651529344.490088:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211047 00000100:00100000:0.0:1651529344.490089:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+545:39029:x1731745946391104:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.490094:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177495 count 1 00010000:00010000:0.0:1651529344.490099:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000069f47d6/0x3234de053c506f9 lrc: 3/0,1 mode: --/PW res: [0x2b557:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.490103:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000099ba179a/0x3234de053c4f039 lrc: 2/0,0 mode: PR/PR res: [0x2b557:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d73a4 expref: 1518 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.490106:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.490107:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.490108:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000069f47d6/0x3234de053c506f9 lrc: 4/0,1 mode: --/PW res: [0x2b557:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.490114:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000099ba179a/0x3234de053c4f039 lrc: 3/0,0 mode: PR/PR res: [0x2b557:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d73a4 expref: 1518 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.490118:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000099ba179a/0x3234de053c4f039 lrc: 4/0,0 mode: PR/PR res: [0x2b557:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d73a4 expref: 1518 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.490119:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211048 00000100:00100000:1.0:1651529344.490121:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+545:39030:x1731745946391296:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.490125:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996973760:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.490127:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177497 count 1 00010000:00010000:1.0:1651529344.490131:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50700 lrc: 3/0,1 mode: --/PW res: [0x2b559:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490136:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002d97c226/0x3234de053c4e2e1 lrc: 2/0,0 mode: PR/PR res: [0x2b559:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3cb5 expref: 1518 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.490139:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c2b2b59c going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.490146:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.490146:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.490147:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50700 lrc: 4/0,1 mode: --/PW res: [0x2b559:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490154:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002d97c226/0x3234de053c4e2e1 lrc: 3/0,0 mode: PR/PR res: [0x2b559:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3cb5 expref: 1518 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.490158:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073a973b4/0x3234de053c506f2 lrc: 2/0,0 mode: PW/PW res: [0x2b556:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490159:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002d97c226/0x3234de053c4e2e1 lrc: 4/0,0 mode: PR/PR res: [0x2b559:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3cb5 expref: 1518 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.490162:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000073a973b4 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.490163:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004be0190 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996973824:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.490163:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073a973b4/0x3234de053c506f2 lrc: 2/0,0 mode: PW/PW res: [0x2b556:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.490166:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073a973b4/0x3234de053c506f2 lrc: 3/0,0 mode: PW/PW res: [0x2b556:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.490170:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073a973b4/0x3234de053c506f2 lrc: 1/0,0 mode: --/PW res: [0x2b556:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.490172:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c3caa148 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.490178:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211049 00000100:00100000:1.0:1651529344.490179:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+545:39029:x1731745946391232:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.490183:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073a973b4/0x3234de053c506f2 lrc: 0/0,0 mode: --/PW res: [0x2b556:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.490184:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177496 count 1 00010000:00010000:1.0:1651529344.490187:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50707 lrc: 3/0,1 mode: --/PW res: [0x2b558:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490191:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a47eb378/0x3234de053c4c9a4 lrc: 2/0,0 mode: PR/PR res: [0x2b558:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd85b expref: 1518 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.490193:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211050 00010000:00010000:1.0:1651529344.490194:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.490195:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.490195:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+545:39030:x1731745946391424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.490196:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50707 lrc: 4/0,1 mode: --/PW res: [0x2b558:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490201:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a47eb378/0x3234de053c4c9a4 lrc: 3/0,0 mode: PR/PR res: [0x2b558:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd85b expref: 1518 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.490204:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a47eb378/0x3234de053c4c9a4 lrc: 4/0,0 mode: PR/PR res: [0x2b558:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd85b expref: 1518 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:0.0:1651529344.490210:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177499 count 1 00000100:00100000:1.0:1651529344.490211:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996973888:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.490215:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9690ad5/0x3234de053c5070e lrc: 3/0,1 mode: --/PW res: [0x2b55b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.490217:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d09f5ee1 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.490219:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008f2513dc/0x3234de053c4dc27 lrc: 2/0,0 mode: PR/PR res: [0x2b55b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d20f4 expref: 1518 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.490239:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211051 00000100:00100000:1.0:1651529344.490241:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+545:39030:x1731745946391360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.490245:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177498 count 1 00010000:00010000:1.0:1651529344.490249:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002925c134/0x3234de053c50715 lrc: 3/0,1 mode: --/PW res: [0x2b55a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.490251:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.490252:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.490252:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9690ad5/0x3234de053c5070e lrc: 4/0,1 mode: --/PW res: [0x2b55b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490253:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001f80e0db/0x3234de053c4e963 lrc: 2/0,0 mode: PR/PR res: [0x2b55a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d56d9 expref: 1518 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.490256:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.490257:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.490258:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002925c134/0x3234de053c50715 lrc: 4/0,1 mode: --/PW res: [0x2b55a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.490260:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008f2513dc/0x3234de053c4dc27 lrc: 3/0,0 mode: PR/PR res: [0x2b55b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d20f4 expref: 1518 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.490264:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001f80e0db/0x3234de053c4e963 lrc: 3/0,0 mode: PR/PR res: [0x2b55a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d56d9 expref: 1518 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.490264:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008f2513dc/0x3234de053c4dc27 lrc: 4/0,0 mode: PR/PR res: [0x2b55b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d20f4 expref: 1518 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.490267:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001f80e0db/0x3234de053c4e963 lrc: 4/0,0 mode: PR/PR res: [0x2b55a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d56d9 expref: 1518 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.490268:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996973952:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.490271:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000703c0db9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996974016:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.490277:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000076b354b3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.490279:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.490313:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.490324:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946391488 00000100:00100000:1.0:1651529344.490330:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.490334:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211052 00000100:00100000:0.0:1651529344.490336:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+546:39030:x1731745946391488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.490346:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177500 count 1 00000100:00100000:1.0:1651529344.490350:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.490351:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b6f07f6/0x3234de053c5071c lrc: 3/0,1 mode: --/PW res: [0x2b55c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.490355:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c4f4a7 lrc: 2/0,0 mode: PR/PR res: [0x2b55c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8532 expref: 1518 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.490358:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.490359:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.490360:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b6f07f6/0x3234de053c5071c lrc: 4/0,1 mode: --/PW res: [0x2b55c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.490366:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c4f4a7 lrc: 3/0,0 mode: PR/PR res: [0x2b55c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8532 expref: 1518 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.490370:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c4f4a7 lrc: 4/0,0 mode: PR/PR res: [0x2b55c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8532 expref: 1518 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.490374:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996974080:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.490387:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a3b00cf3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.490393:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946391616 00000100:00100000:1.0:1651529344.490397:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946391552 00000100:00100000:0.0:1651529344.490400:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211053 00000100:00100000:0.0:1651529344.490401:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+548:39029:x1731745946391616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.490405:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177502 count 1 00000100:00100000:1.0:1651529344.490406:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211054 00000100:00100000:1.0:1651529344.490408:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+548:39030:x1731745946391552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.490413:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177501 count 1 00010000:00010000:1.0:1651529344.490417:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000deca3988/0x3234de053c5072a lrc: 3/0,1 mode: --/PW res: [0x2b55d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490421:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000066b0bee0/0x3234de053c4d049 lrc: 2/0,0 mode: PR/PR res: [0x2b55d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf286 expref: 1518 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.490424:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.490424:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c50723 lrc: 3/0,1 mode: --/PW res: [0x2b55e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490425:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.490426:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000deca3988/0x3234de053c5072a lrc: 4/0,1 mode: --/PW res: [0x2b55d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.490429:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000020856454/0x3234de053c4ef13 lrc: 2/0,0 mode: PR/PR res: [0x2b55e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e80 expref: 1518 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.490432:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000066b0bee0/0x3234de053c4d049 lrc: 3/0,0 mode: PR/PR res: [0x2b55d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf286 expref: 1518 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.490432:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.490433:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.490434:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c50723 lrc: 4/0,1 mode: --/PW res: [0x2b55e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490435:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000066b0bee0/0x3234de053c4d049 lrc: 4/0,0 mode: PR/PR res: [0x2b55d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf286 expref: 1518 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.490439:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c20a6e11 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996974144:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.490441:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000020856454/0x3234de053c4ef13 lrc: 3/0,0 mode: PR/PR res: [0x2b55e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e80 expref: 1518 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.490447:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000020856454/0x3234de053c4ef13 lrc: 4/0,0 mode: PR/PR res: [0x2b55e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e80 expref: 1518 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.490448:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd96f074 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.490451:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996974208:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.490460:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 0000000070e666f7 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.490607:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996973760:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.490611:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000069f47d6/0x3234de053c506f9 lrc: 3/0,1 mode: --/PW res: [0x2b557:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.490629:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996973952:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.490632:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004be0190 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996973824:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.490632:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a9690ad5/0x3234de053c5070e lrc: 3/0,1 mode: --/PW res: [0x2b55b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.490637:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50700 lrc: 3/0,1 mode: --/PW res: [0x2b559:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.490644:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996973888:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.490647:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50707 lrc: 3/0,1 mode: --/PW res: [0x2b558:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.490933:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.490940:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.490941:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996974080:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.490945:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006b6f07f6/0x3234de053c5071c lrc: 3/0,1 mode: --/PW res: [0x2b55c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.490946:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.490952:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.490960:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396272256 00000100:00100000:1.0:1651529344.490961:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.490965:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002d97c226/0x3234de053c4e2e1 lrc: 4/0,0 mode: PR/PR res: [0x2b559:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3cb5 expref: 1519 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.490966:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.490971:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396272192 00010000:00010000:0.0:1651529344.490973:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000099ba179a/0x3234de053c4f039 lrc: 4/0,0 mode: PR/PR res: [0x2b557:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d73a4 expref: 1520 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.490978:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000703c0db9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996974016:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.490980:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396272384 00010000:00010000:1.0:1651529344.490982:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002925c134/0x3234de053c50715 lrc: 3/0,1 mode: --/PW res: [0x2b55a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.490982:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008f2513dc/0x3234de053c4dc27 lrc: 4/0,0 mode: PR/PR res: [0x2b55b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d20f4 expref: 1521 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.490986:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396272512 00010000:00010000:0.0:1651529344.490988:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c4f4a7 lrc: 4/0,0 mode: PR/PR res: [0x2b55c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8532 expref: 1522 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.490989:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396272320 00000100:00100000:0.0:1651529344.490992:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396272448 00010000:00010000:1.0:1651529344.490994:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a47eb378/0x3234de053c4c9a4 lrc: 4/0,0 mode: PR/PR res: [0x2b558:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd85b expref: 1524 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.490995:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001f80e0db/0x3234de053c4e963 lrc: 4/0,0 mode: PR/PR res: [0x2b55a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d56d9 expref: 1524 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.491000:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11829 00000100:00100000:1.0:1651529344.491002:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1524:41279:x1731746396272256:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.491004:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.491004:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11830 00010000:00010000:1.0:1651529344.491006:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002d97c226/0x3234de053c4e2e1 lrc: 4/0,0 mode: PR/PR res: [0x2b559:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3cb5 expref: 1524 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.491006:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1524:41279:x1731746396272192:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.491009:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.491010:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000099ba179a/0x3234de053c4f039 lrc: 4/0,0 mode: PR/PR res: [0x2b557:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d73a4 expref: 1524 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.491012:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002d97c226/0x3234de053c4e2e1 lrc: 3/0,0 mode: PR/PR res: [0x2b559:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3cb5 expref: 1524 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.491014:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000099ba179a/0x3234de053c4f039 lrc: 3/0,0 mode: PR/PR res: [0x2b557:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d73a4 expref: 1524 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.491018:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d97c226/0x3234de053c4e2e1 lrc: 0/0,0 mode: --/PR res: [0x2b559:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3cb5 expref: 1524 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.491021:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.491022:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.491023:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50700 lrc: 3/0,1 mode: PW/PW res: [0x2b559:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.491026:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50700 lrc: 4/0,1 mode: PW/PW res: [0x2b559:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.491032:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.491040:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1523:41279:x1731746396272256:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 37us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.491042:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11829 00010000:00010000:0.0:1651529344.491047:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099ba179a/0x3234de053c4f039 lrc: 0/0,0 mode: --/PR res: [0x2b557:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d73a4 expref: 1523 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.491051:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.491052:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.491053:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000069f47d6/0x3234de053c506f9 lrc: 3/0,1 mode: PW/PW res: [0x2b557:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491056:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000069f47d6/0x3234de053c506f9 lrc: 4/0,1 mode: PW/PW res: [0x2b557:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.491061:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11831 00000100:00100000:1.0:1651529344.491063:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1521:41279:x1731746396272384:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.491063:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.491066:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.491068:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008f2513dc/0x3234de053c4dc27 lrc: 4/0,0 mode: PR/PR res: [0x2b55b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d20f4 expref: 1521 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.491071:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008f2513dc/0x3234de053c4dc27 lrc: 3/0,0 mode: PR/PR res: [0x2b55b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d20f4 expref: 1521 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.491071:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1521:41279:x1731746396272192:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 64us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.491074:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11830 00010000:00010000:1.0:1651529344.491077:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f2513dc/0x3234de053c4dc27 lrc: 0/0,0 mode: --/PR res: [0x2b55b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d20f4 expref: 1520 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.491079:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11832 00010000:00010000:1.0:1651529344.491080:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.491081:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.491081:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a9690ad5/0x3234de053c5070e lrc: 3/0,1 mode: PW/PW res: [0x2b55b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.491081:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1519:41279:x1731746396272512:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.491084:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9690ad5/0x3234de053c5070e lrc: 4/0,1 mode: PW/PW res: [0x2b55b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491084:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.491085:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c4f4a7 lrc: 4/0,0 mode: PR/PR res: [0x2b55c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8532 expref: 1519 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.491089:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c4f4a7 lrc: 3/0,0 mode: PR/PR res: [0x2b55c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8532 expref: 1519 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.491093:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.491100:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1519:41279:x1731746396272384:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (153us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.491101:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c4f4a7 lrc: 0/0,0 mode: --/PR res: [0x2b55c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8532 expref: 1519 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.491102:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11831 00010000:00010000:0.0:1651529344.491105:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.491105:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.491106:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006b6f07f6/0x3234de053c5071c lrc: 3/0,1 mode: PW/PW res: [0x2b55c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.491107:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11833 00000100:00100000:1.0:1651529344.491108:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d177f8a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1517:41278:x1731746396272320:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.491111:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.491111:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b6f07f6/0x3234de053c5071c lrc: 4/0,1 mode: PW/PW res: [0x2b55c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.491112:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a47eb378/0x3234de053c4c9a4 lrc: 4/0,0 mode: PR/PR res: [0x2b558:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd85b expref: 1517 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.491116:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a47eb378/0x3234de053c4c9a4 lrc: 3/0,0 mode: PR/PR res: [0x2b558:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd85b expref: 1517 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.491117:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.491121:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a47eb378/0x3234de053c4c9a4 lrc: 0/0,0 mode: --/PR res: [0x2b558:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd85b expref: 1517 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.491123:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1517:41279:x1731746396272512:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 41us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.491125:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11832 00010000:00010000:1.0:1651529344.491126:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.491127:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.491128:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50707 lrc: 3/0,1 mode: PW/PW res: [0x2b558:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.491130:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50707 lrc: 4/0,1 mode: PW/PW res: [0x2b558:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.491130:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11834 00000100:00100000:0.0:1651529344.491131:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1515:41278:x1731746396272448:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.491133:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.491135:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001f80e0db/0x3234de053c4e963 lrc: 4/0,0 mode: PR/PR res: [0x2b55a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d56d9 expref: 1515 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.491137:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.491138:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001f80e0db/0x3234de053c4e963 lrc: 3/0,0 mode: PR/PR res: [0x2b55a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d56d9 expref: 1515 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.491141:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d177f8a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1515:41278:x1731746396272320:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 32us (180us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.491143:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f80e0db/0x3234de053c4e963 lrc: 0/0,0 mode: --/PR res: [0x2b55a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d56d9 expref: 1515 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.491144:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11833 00010000:00010000:0.0:1651529344.491146:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.491147:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.491147:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002925c134/0x3234de053c50715 lrc: 3/0,1 mode: PW/PW res: [0x2b55a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491150:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002925c134/0x3234de053c50715 lrc: 4/0,1 mode: PW/PW res: [0x2b55a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.491156:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c20a6e11 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996974144:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.491162:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.491166:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000deca3988/0x3234de053c5072a lrc: 3/0,1 mode: --/PW res: [0x2b55d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.491168:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1513:41278:x1731746396272448:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 36us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.491171:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11834 00010000:00010000:1.0:1651529344.491172:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50700 lrc: 3/0,1 mode: PW/PW res: [0x2b559:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.491175:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50700 lrc: 3/0,1 mode: PW/PW res: [0x2b559:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491177:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a9690ad5/0x3234de053c5070e lrc: 3/0,1 mode: PW/PW res: [0x2b55b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.491178:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50700 lrc: 3/0,1 mode: PW/PW res: [0x2b559:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491180:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9690ad5/0x3234de053c5070e lrc: 3/0,1 mode: PW/PW res: [0x2b55b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.491181:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50700 lrc: 2/0,0 mode: PW/PW res: [0x2b559:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491184:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9690ad5/0x3234de053c5070e lrc: 3/0,1 mode: PW/PW res: [0x2b55b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491186:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9690ad5/0x3234de053c5070e lrc: 2/0,0 mode: PW/PW res: [0x2b55b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.491239:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+550:39030:x1731745946391296:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1118us (1252us total) trans 12885079102 rc 0/0 00000100:00100000:1.0:1651529344.491243:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211048 00010000:00010000:1.0:1651529344.491249:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50707 lrc: 3/0,1 mode: PW/PW res: [0x2b558:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.491250:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+549:39030:x1731745946391424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1055us (1221us total) trans 12885079103 rc 0/0 00010000:00010000:1.0:1651529344.491253:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50707 lrc: 3/0,1 mode: PW/PW res: [0x2b558:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.491254:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211050 00010000:00010000:1.0:1651529344.491256:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50707 lrc: 3/0,1 mode: PW/PW res: [0x2b558:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.491259:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50707 lrc: 2/0,0 mode: PW/PW res: [0x2b558:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491261:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50700 lrc: 2/0,0 mode: PW/PW res: [0x2b559:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491264:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a0607df4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.491271:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50700 lrc: 2/0,0 mode: PW/PW res: [0x2b559:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491277:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50700 lrc: 3/0,0 mode: PW/PW res: [0x2b559:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491282:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50700 lrc: 1/0,0 mode: --/PW res: [0x2b559:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491285:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50700 lrc: 0/0,0 mode: --/PW res: [0x2b559:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491289:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9690ad5/0x3234de053c5070e lrc: 2/0,0 mode: PW/PW res: [0x2b55b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491292:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a9690ad5 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.491293:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9690ad5/0x3234de053c5070e lrc: 2/0,0 mode: PW/PW res: [0x2b55b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491295:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9690ad5/0x3234de053c5070e lrc: 3/0,0 mode: PW/PW res: [0x2b55b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.491297:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+549:39029:x1731745946391232:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1117us (1286us total) trans 12885079104 rc 0/0 00010000:00010000:0.0:1651529344.491298:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9690ad5/0x3234de053c5070e lrc: 1/0,0 mode: --/PW res: [0x2b55b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.491300:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211049 00010000:00010000:0.0:1651529344.491301:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9690ad5/0x3234de053c5070e lrc: 0/0,0 mode: --/PW res: [0x2b55b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491304:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50707 lrc: 2/0,0 mode: PW/PW res: [0x2b558:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.491307:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002925c134/0x3234de053c50715 lrc: 3/0,1 mode: PW/PW res: [0x2b55a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491307:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000734ecdfd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.491308:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50707 lrc: 2/0,0 mode: PW/PW res: [0x2b558:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.491310:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002925c134/0x3234de053c50715 lrc: 3/0,1 mode: PW/PW res: [0x2b55a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491311:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50707 lrc: 3/0,0 mode: PW/PW res: [0x2b558:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.491313:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002925c134/0x3234de053c50715 lrc: 3/0,1 mode: PW/PW res: [0x2b55a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491314:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50707 lrc: 1/0,0 mode: --/PW res: [0x2b558:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491316:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50707 lrc: 0/0,0 mode: --/PW res: [0x2b558:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.491319:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002925c134/0x3234de053c50715 lrc: 2/0,0 mode: PW/PW res: [0x2b55a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491323:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000069f47d6/0x3234de053c506f9 lrc: 3/0,1 mode: PW/PW res: [0x2b557:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491330:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000069f47d6/0x3234de053c506f9 lrc: 3/0,1 mode: PW/PW res: [0x2b557:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491333:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000069f47d6/0x3234de053c506f9 lrc: 3/0,1 mode: PW/PW res: [0x2b557:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491336:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000069f47d6/0x3234de053c506f9 lrc: 2/0,0 mode: PW/PW res: [0x2b557:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.491354:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+550:39030:x1731745946391360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1113us (1295us total) trans 12885079105 rc 0/0 00000100:00100000:1.0:1651529344.491357:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211051 00000100:00100000:0.0:1651529344.491380:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+549:39029:x1731745946391104:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1283us (1400us total) trans 12885079106 rc 0/0 00000100:00100000:0.0:1651529344.491384:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211047 00000100:00100000:1.0:1651529344.491386:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.491390:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002925c134/0x3234de053c50715 lrc: 2/0,0 mode: PW/PW res: [0x2b55a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491394:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002925c134 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.491395:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002925c134/0x3234de053c50715 lrc: 2/0,0 mode: PW/PW res: [0x2b55a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.491398:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.491398:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002925c134/0x3234de053c50715 lrc: 3/0,0 mode: PW/PW res: [0x2b55a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491407:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002925c134/0x3234de053c50715 lrc: 1/0,0 mode: --/PW res: [0x2b55a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491410:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002925c134/0x3234de053c50715 lrc: 0/0,0 mode: --/PW res: [0x2b55a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491414:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000069f47d6/0x3234de053c506f9 lrc: 2/0,0 mode: PW/PW res: [0x2b557:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491417:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000069f47d6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.491418:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000069f47d6/0x3234de053c506f9 lrc: 2/0,0 mode: PW/PW res: [0x2b557:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491421:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000069f47d6/0x3234de053c506f9 lrc: 3/0,0 mode: PW/PW res: [0x2b557:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491426:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000069f47d6/0x3234de053c506f9 lrc: 1/0,0 mode: --/PW res: [0x2b557:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491429:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000069f47d6/0x3234de053c506f9 lrc: 0/0,0 mode: --/PW res: [0x2b557:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.491439:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996974208:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.491443:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c50723 lrc: 3/0,1 mode: --/PW res: [0x2b55e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.491449:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396272640 00010000:00010000:0.0:1651529344.491453:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000066b0bee0/0x3234de053c4d049 lrc: 4/0,0 mode: PR/PR res: [0x2b55d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf286 expref: 1513 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.491463:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396272704 00010000:00010000:0.0:1651529344.491466:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000020856454/0x3234de053c4ef13 lrc: 4/0,0 mode: PR/PR res: [0x2b55e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e80 expref: 1514 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.491474:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11835 00000100:00100000:0.0:1651529344.491476:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1514:41279:x1731746396272640:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.491479:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.491480:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000066b0bee0/0x3234de053c4d049 lrc: 4/0,0 mode: PR/PR res: [0x2b55d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf286 expref: 1514 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.491499:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000066b0bee0/0x3234de053c4d049 lrc: 3/0,0 mode: PR/PR res: [0x2b55d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf286 expref: 1514 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.491505:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066b0bee0/0x3234de053c4d049 lrc: 0/0,0 mode: --/PR res: [0x2b55d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf286 expref: 1514 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.491509:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.491509:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.491510:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000deca3988/0x3234de053c5072a lrc: 3/0,1 mode: PW/PW res: [0x2b55d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491513:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000deca3988/0x3234de053c5072a lrc: 4/0,1 mode: PW/PW res: [0x2b55d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.491514:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11836 00000100:00100000:1.0:1651529344.491517:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1513:41278:x1731746396272704:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.491523:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.491525:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.491527:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000020856454/0x3234de053c4ef13 lrc: 4/0,0 mode: PR/PR res: [0x2b55e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e80 expref: 1513 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.491534:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1513:41279:x1731746396272640:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 57us (147us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.491536:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000020856454/0x3234de053c4ef13 lrc: 3/0,0 mode: PR/PR res: [0x2b55e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e80 expref: 1513 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.491537:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11835 00010000:00010000:1.0:1651529344.491543:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020856454/0x3234de053c4ef13 lrc: 0/0,0 mode: --/PR res: [0x2b55e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e80 expref: 1512 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.491544:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006b6f07f6/0x3234de053c5071c lrc: 3/0,1 mode: PW/PW res: [0x2b55c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.491546:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.491547:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.491547:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b6f07f6/0x3234de053c5071c lrc: 3/0,1 mode: PW/PW res: [0x2b55c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.491548:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c50723 lrc: 3/0,1 mode: PW/PW res: [0x2b55e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491550:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b6f07f6/0x3234de053c5071c lrc: 3/0,1 mode: PW/PW res: [0x2b55c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.491551:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c50723 lrc: 4/0,1 mode: PW/PW res: [0x2b55e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491552:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b6f07f6/0x3234de053c5071c lrc: 2/0,0 mode: PW/PW res: [0x2b55c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.491561:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.491568:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1511:41278:x1731746396272704:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 51us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.491571:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11836 00010000:00010000:1.0:1651529344.491578:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000deca3988/0x3234de053c5072a lrc: 3/0,1 mode: PW/PW res: [0x2b55d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.491581:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000deca3988/0x3234de053c5072a lrc: 3/0,1 mode: PW/PW res: [0x2b55d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.491584:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000deca3988/0x3234de053c5072a lrc: 3/0,1 mode: PW/PW res: [0x2b55d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.491587:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000deca3988/0x3234de053c5072a lrc: 2/0,0 mode: PW/PW res: [0x2b55d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.491626:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+550:39030:x1731745946391552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1218us (1296us total) trans 12885079107 rc 0/0 00000100:00100000:1.0:1651529344.491629:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211054 00000100:00100000:0.0:1651529344.491653:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+549:39030:x1731745946391488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1303us (1327us total) trans 12885079108 rc 0/0 00000100:00100000:0.0:1651529344.491656:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211052 00010000:00010000:0.0:1651529344.491663:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b6f07f6/0x3234de053c5071c lrc: 2/0,0 mode: PW/PW res: [0x2b55c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.491666:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.491667:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006b6f07f6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.491668:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b6f07f6/0x3234de053c5071c lrc: 2/0,0 mode: PW/PW res: [0x2b55c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491676:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b6f07f6/0x3234de053c5071c lrc: 3/0,0 mode: PW/PW res: [0x2b55c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491681:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b6f07f6/0x3234de053c5071c lrc: 1/0,0 mode: --/PW res: [0x2b55c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.491684:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.491684:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b6f07f6/0x3234de053c5071c lrc: 0/0,0 mode: --/PW res: [0x2b55c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491688:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000deca3988/0x3234de053c5072a lrc: 2/0,0 mode: PW/PW res: [0x2b55d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491691:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000deca3988 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.491692:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000deca3988/0x3234de053c5072a lrc: 2/0,0 mode: PW/PW res: [0x2b55d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.491694:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.491701:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000deca3988/0x3234de053c5072a lrc: 3/0,0 mode: PW/PW res: [0x2b55d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491705:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000deca3988/0x3234de053c5072a lrc: 1/0,0 mode: --/PW res: [0x2b55d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491708:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000deca3988/0x3234de053c5072a lrc: 0/0,0 mode: --/PW res: [0x2b55d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.491715:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946392192 00000100:00100000:0.0:1651529344.491725:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946392320 00000100:00100000:1.0:1651529344.491727:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.491745:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946392256 00000100:00100000:0.0:1651529344.491752:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946392384 00000100:00100000:0.0:1651529344.491757:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211055 00000100:00100000:0.0:1651529344.491759:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+552:39030:x1731745946392192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.491764:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177503 count 1 00010000:00010000:0.0:1651529344.491768:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b00577e/0x3234de053c50731 lrc: 3/0,1 mode: --/PW res: [0x2b55f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491773:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000004cd7979/0x3234de053c4f22a lrc: 2/0,0 mode: PR/PR res: [0x2b55f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b6f expref: 1510 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.491776:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.491776:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.491776:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.491777:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b00577e/0x3234de053c50731 lrc: 4/0,1 mode: --/PW res: [0x2b55f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.491784:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946392448 00010000:00010000:0.0:1651529344.491784:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000004cd7979/0x3234de053c4f22a lrc: 3/0,0 mode: PR/PR res: [0x2b55f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b6f expref: 1510 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.491788:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000004cd7979/0x3234de053c4f22a lrc: 4/0,0 mode: PR/PR res: [0x2b55f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b6f expref: 1510 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.491791:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211056 00000100:00100000:0.0:1651529344.491792:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996974272:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.491793:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+553:39030:x1731745946392320:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.491798:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177505 count 1 00010000:00010000:1.0:1651529344.491802:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007e2f834/0x3234de053c50738 lrc: 3/0,1 mode: --/PW res: [0x2b561:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.491806:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 000000000d706dff going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.491813:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211057 00010000:00010000:1.0:1651529344.491814:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000123a7d7f/0x3234de053c4da60 lrc: 2/0,0 mode: PR/PR res: [0x2b561:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d19f4 expref: 1510 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.491815:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+553:39030:x1731745946392256:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.491817:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.491818:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.491819:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007e2f834/0x3234de053c50738 lrc: 4/0,1 mode: --/PW res: [0x2b561:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.491820:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177504 count 1 00010000:00010000:0.0:1651529344.491823:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c5073f lrc: 3/0,1 mode: --/PW res: [0x2b560:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.491826:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000123a7d7f/0x3234de053c4da60 lrc: 3/0,0 mode: PR/PR res: [0x2b561:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d19f4 expref: 1510 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.491828:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000023e991dc/0x3234de053c4e64c lrc: 2/0,0 mode: PR/PR res: [0x2b560:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a22 expref: 1510 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.491829:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000123a7d7f/0x3234de053c4da60 lrc: 4/0,0 mode: PR/PR res: [0x2b561:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d19f4 expref: 1510 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.491831:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.491831:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.491832:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c5073f lrc: 4/0,1 mode: --/PW res: [0x2b560:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.491833:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996974336:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.491838:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000023e991dc/0x3234de053c4e64c lrc: 3/0,0 mode: PR/PR res: [0x2b560:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a22 expref: 1510 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.491841:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000023e991dc/0x3234de053c4e64c lrc: 4/0,0 mode: PR/PR res: [0x2b560:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a22 expref: 1510 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.491842:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd96f074 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.491848:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211058 00000100:00100000:0.0:1651529344.491848:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996974400:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.491850:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+553:39030:x1731745946392384:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.491854:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177506 count 1 00000100:00100000:0.0:1651529344.491855:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 0000000076b354b3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.491858:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f545d586/0x3234de053c50746 lrc: 3/0,1 mode: --/PW res: [0x2b562:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.491861:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211059 00000100:00100000:0.0:1651529344.491863:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+553:39029:x1731745946392448:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.491865:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a4a1a96c/0x3234de053c4e160 lrc: 2/0,0 mode: PR/PR res: [0x2b562:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3672 expref: 1510 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.491866:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177507 count 1 00010000:00010000:1.0:1651529344.491868:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.491869:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.491869:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f545d586/0x3234de053c50746 lrc: 4/0,1 mode: --/PW res: [0x2b562:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491870:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042c8316b/0x3234de053c5074d lrc: 3/0,1 mode: --/PW res: [0x2b563:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491874:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d5161cbb/0x3234de053c4f008 lrc: 2/0,0 mode: PR/PR res: [0x2b563:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d72b6 expref: 1510 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.491875:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a4a1a96c/0x3234de053c4e160 lrc: 3/0,0 mode: PR/PR res: [0x2b562:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3672 expref: 1510 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.491877:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.491878:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.491878:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042c8316b/0x3234de053c5074d lrc: 4/0,1 mode: --/PW res: [0x2b563:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.491879:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a4a1a96c/0x3234de053c4e160 lrc: 4/0,0 mode: PR/PR res: [0x2b562:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3672 expref: 1510 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.491882:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004be0190 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996974464:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.491884:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d5161cbb/0x3234de053c4f008 lrc: 3/0,0 mode: PR/PR res: [0x2b563:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d72b6 expref: 1510 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.491887:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d5161cbb/0x3234de053c4f008 lrc: 4/0,0 mode: PR/PR res: [0x2b563:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d72b6 expref: 1510 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.491889:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.491891:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996974528:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.491897:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed830649 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.491901:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c50723 lrc: 3/0,1 mode: PW/PW res: [0x2b55e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491905:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c50723 lrc: 3/0,1 mode: PW/PW res: [0x2b55e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491908:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c50723 lrc: 3/0,1 mode: PW/PW res: [0x2b55e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.491910:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c50723 lrc: 2/0,0 mode: PW/PW res: [0x2b55e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.491980:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+554:39029:x1731745946391616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1578us (1630us total) trans 12885079109 rc 0/0 00000100:00100000:0.0:1651529344.491984:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211053 00000100:00100000:1.0:1651529344.491989:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.491992:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c50723 lrc: 2/0,0 mode: PW/PW res: [0x2b55e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492001:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005d39750f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.492002:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c50723 lrc: 2/0,0 mode: PW/PW res: [0x2b55e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492005:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c50723 lrc: 3/0,0 mode: PW/PW res: [0x2b55e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492010:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c50723 lrc: 1/0,0 mode: --/PW res: [0x2b55e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492013:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c50723 lrc: 0/0,0 mode: --/PW res: [0x2b55e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.492020:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946392576 00000100:00100000:1.0:1651529344.492023:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.492034:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946392512 00000100:00100000:0.0:1651529344.492041:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211060 00000100:00100000:0.0:1651529344.492042:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+555:39030:x1731745946392576:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.492047:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211061 00002000:00080000:0.0:1651529344.492047:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177509 count 1 00000100:00100000:1.0:1651529344.492049:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+555:39029:x1731745946392512:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.492051:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c50754 lrc: 3/0,1 mode: --/PW res: [0x2b565:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.492054:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177508 count 1 00010000:00010000:0.0:1651529344.492055:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003fd513db/0x3234de053c4f2fc lrc: 2/0,0 mode: PR/PR res: [0x2b565:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e9b expref: 1510 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.492058:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.492059:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000411ac620/0x3234de053c5075b lrc: 3/0,1 mode: --/PW res: [0x2b564:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492059:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.492060:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c50754 lrc: 4/0,1 mode: --/PW res: [0x2b565:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.492063:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008e21f640/0x3234de053c4f3ce lrc: 2/0,0 mode: PR/PR res: [0x2b564:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81c0 expref: 1510 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.492066:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003fd513db/0x3234de053c4f2fc lrc: 3/0,0 mode: PR/PR res: [0x2b565:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e9b expref: 1510 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.492069:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.492070:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.492070:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000411ac620/0x3234de053c5075b lrc: 4/0,1 mode: --/PW res: [0x2b564:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492070:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003fd513db/0x3234de053c4f2fc lrc: 4/0,0 mode: PR/PR res: [0x2b565:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e9b expref: 1510 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.492074:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996974592:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.492077:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008e21f640/0x3234de053c4f3ce lrc: 3/0,0 mode: PR/PR res: [0x2b564:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81c0 expref: 1510 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.492080:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008e21f640/0x3234de053c4f3ce lrc: 4/0,0 mode: PR/PR res: [0x2b564:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81c0 expref: 1510 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.492087:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 000000003c8b0daf going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.492090:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000edfe60d3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996974656:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.492099:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d09f5ee1 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.492158:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.492165:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946392896 00000100:00100000:1.0:1651529344.492172:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211062 00000100:00100000:1.0:1651529344.492174:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+556:39029:x1731745946392896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.492179:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177510 count 1 00010000:00010000:1.0:1651529344.492183:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e8b8142/0x3234de053c50762 lrc: 3/0,1 mode: --/PW res: [0x2b566:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.492187:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb6a3f83/0x3234de053c4c88c lrc: 2/0,0 mode: PR/PR res: [0x2b566:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd3f4 expref: 1510 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.492190:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.492191:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.492192:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e8b8142/0x3234de053c50762 lrc: 4/0,1 mode: --/PW res: [0x2b566:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.492198:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eb6a3f83/0x3234de053c4c88c lrc: 3/0,0 mode: PR/PR res: [0x2b566:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd3f4 expref: 1510 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.492202:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eb6a3f83/0x3234de053c4c88c lrc: 4/0,0 mode: PR/PR res: [0x2b566:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd3f4 expref: 1510 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.492206:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085af61db pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996974720:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.492215:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000567ee0ef going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.492308:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996974272:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.492318:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004b00577e/0x3234de053c50731 lrc: 3/0,1 mode: --/PW res: [0x2b55f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.492325:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.492331:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.492331:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996974400:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.492333:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c5073f lrc: 3/0,1 mode: --/PW res: [0x2b560:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.492338:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.492339:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996974528:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.492342:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000042c8316b/0x3234de053c5074d lrc: 3/0,1 mode: --/PW res: [0x2b563:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.492344:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.492353:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.492354:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396273280 00010000:00010000:0.0:1651529344.492359:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000123a7d7f/0x3234de053c4da60 lrc: 5/0,0 mode: PR/PR res: [0x2b561:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d19f4 expref: 1511 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.492361:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996974336:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.492365:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396273216 00010000:00010000:1.0:1651529344.492366:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000007e2f834/0x3234de053c50738 lrc: 3/0,1 mode: --/PW res: [0x2b561:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492367:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000004cd7979/0x3234de053c4f22a lrc: 4/0,0 mode: PR/PR res: [0x2b55f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b6f expref: 1512 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.492371:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396273344 00000100:00100000:1.0:1651529344.492373:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004be0190 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996974464:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.492373:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000023e991dc/0x3234de053c4e64c lrc: 4/0,0 mode: PR/PR res: [0x2b560:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a22 expref: 1513 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.492375:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f545d586/0x3234de053c50746 lrc: 3/0,1 mode: --/PW res: [0x2b562:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.492377:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396273472 00010000:00010000:0.0:1651529344.492379:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d5161cbb/0x3234de053c4f008 lrc: 4/0,0 mode: PR/PR res: [0x2b563:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d72b6 expref: 1514 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.492381:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396273408 00000100:00100000:0.0:1651529344.492384:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11837 00000100:00100000:0.0:1651529344.492385:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1515:41279:x1731746396273280:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.492386:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a4a1a96c/0x3234de053c4e160 lrc: 4/0,0 mode: PR/PR res: [0x2b562:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3672 expref: 1515 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.492388:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.492390:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000123a7d7f/0x3234de053c4da60 lrc: 4/0,0 mode: PR/PR res: [0x2b561:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d19f4 expref: 1515 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.492393:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000123a7d7f/0x3234de053c4da60 lrc: 3/0,0 mode: PR/PR res: [0x2b561:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d19f4 expref: 1515 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.492394:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11838 00000100:00100000:1.0:1651529344.492396:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1515:41279:x1731746396273216:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.492399:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.492399:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000123a7d7f/0x3234de053c4da60 lrc: 0/0,0 mode: --/PR res: [0x2b561:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d19f4 expref: 1515 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.492400:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000004cd7979/0x3234de053c4f22a lrc: 4/0,0 mode: PR/PR res: [0x2b55f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b6f expref: 1515 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.492402:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.492403:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.492404:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000004cd7979/0x3234de053c4f22a lrc: 3/0,0 mode: PR/PR res: [0x2b55f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b6f expref: 1514 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.492404:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000007e2f834/0x3234de053c50738 lrc: 3/0,1 mode: PW/PW res: [0x2b561:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492407:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007e2f834/0x3234de053c50738 lrc: 4/0,1 mode: PW/PW res: [0x2b561:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.492410:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004cd7979/0x3234de053c4f22a lrc: 0/0,0 mode: --/PR res: [0x2b55f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b6f expref: 1514 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.492413:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.492414:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.492417:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.492422:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004b00577e/0x3234de053c50731 lrc: 3/0,1 mode: PW/PW res: [0x2b55f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.492427:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1513:41279:x1731746396273280:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (103us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.492429:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b00577e/0x3234de053c50731 lrc: 4/0,1 mode: PW/PW res: [0x2b55f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.492430:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11837 00000100:00100000:0.0:1651529344.492435:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11839 00000100:00100000:0.0:1651529344.492437:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1512:41279:x1731746396273344:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.492439:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.492445:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.492446:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1512:41279:x1731746396273216:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 49us (114us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.492447:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000023e991dc/0x3234de053c4e64c lrc: 4/0,0 mode: PR/PR res: [0x2b560:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a22 expref: 1512 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.492449:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11838 00010000:00010000:0.0:1651529344.492451:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000023e991dc/0x3234de053c4e64c lrc: 3/0,0 mode: PR/PR res: [0x2b560:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a22 expref: 1512 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.492454:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11840 00000100:00100000:1.0:1651529344.492456:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082df86ec pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1511:41278:x1731746396273472:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.492456:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023e991dc/0x3234de053c4e64c lrc: 0/0,0 mode: --/PR res: [0x2b560:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a22 expref: 1511 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.492459:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.492459:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.492459:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.492460:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d5161cbb/0x3234de053c4f008 lrc: 4/0,0 mode: PR/PR res: [0x2b563:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d72b6 expref: 1510 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.492460:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c5073f lrc: 3/0,1 mode: PW/PW res: [0x2b560:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492463:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c5073f lrc: 4/0,1 mode: PW/PW res: [0x2b560:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.492464:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d5161cbb/0x3234de053c4f008 lrc: 3/0,0 mode: PR/PR res: [0x2b563:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d72b6 expref: 1510 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.492469:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5161cbb/0x3234de053c4f008 lrc: 0/0,0 mode: --/PR res: [0x2b563:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d72b6 expref: 1510 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.492469:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.492472:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.492473:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.492474:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000042c8316b/0x3234de053c5074d lrc: 3/0,1 mode: PW/PW res: [0x2b563:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.492474:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1509:41279:x1731746396273344:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 37us (137us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.492476:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042c8316b/0x3234de053c5074d lrc: 4/0,1 mode: PW/PW res: [0x2b563:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.492477:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11839 00000100:00100000:0.0:1651529344.492481:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11841 00010000:00010000:1.0:1651529344.492484:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.492489:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1508:41279:x1731746396273408:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.492490:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082df86ec pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1508:41278:x1731746396273472:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (145us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.492491:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.492492:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11840 00010000:00010000:0.0:1651529344.492493:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a4a1a96c/0x3234de053c4e160 lrc: 4/0,0 mode: PR/PR res: [0x2b562:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3672 expref: 1508 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.492497:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a4a1a96c/0x3234de053c4e160 lrc: 3/0,0 mode: PR/PR res: [0x2b562:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3672 expref: 1507 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.492502:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4a1a96c/0x3234de053c4e160 lrc: 0/0,0 mode: --/PR res: [0x2b562:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3672 expref: 1507 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.492503:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000007e2f834/0x3234de053c50738 lrc: 3/0,1 mode: PW/PW res: [0x2b561:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492506:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.492506:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.492507:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007e2f834/0x3234de053c50738 lrc: 3/0,1 mode: PW/PW res: [0x2b561:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492507:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f545d586/0x3234de053c50746 lrc: 3/0,1 mode: PW/PW res: [0x2b562:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492510:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f545d586/0x3234de053c50746 lrc: 4/0,1 mode: PW/PW res: [0x2b562:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.492512:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007e2f834/0x3234de053c50738 lrc: 3/0,1 mode: PW/PW res: [0x2b561:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.492515:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007e2f834/0x3234de053c50738 lrc: 2/0,0 mode: PW/PW res: [0x2b561:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492557:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.492565:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1506:41279:x1731746396273408:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 81us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.492568:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11841 00000100:00100000:1.0:1651529344.492575:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+557:39030:x1731745946392320:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 781us (891us total) trans 12885079110 rc 0/0 00010000:00010000:0.0:1651529344.492576:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007e2f834/0x3234de053c50738 lrc: 2/0,0 mode: PW/PW res: [0x2b561:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.492578:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211056 00010000:00010000:0.0:1651529344.492579:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000007e2f834 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.492580:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007e2f834/0x3234de053c50738 lrc: 2/0,0 mode: PW/PW res: [0x2b561:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492583:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007e2f834/0x3234de053c50738 lrc: 3/0,0 mode: PW/PW res: [0x2b561:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.492585:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f545d586/0x3234de053c50746 lrc: 3/0,1 mode: PW/PW res: [0x2b562:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492587:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007e2f834/0x3234de053c50738 lrc: 1/0,0 mode: --/PW res: [0x2b561:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.492588:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f545d586/0x3234de053c50746 lrc: 3/0,1 mode: PW/PW res: [0x2b562:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.492592:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f545d586/0x3234de053c50746 lrc: 3/0,1 mode: PW/PW res: [0x2b562:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492592:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007e2f834/0x3234de053c50738 lrc: 0/0,0 mode: --/PW res: [0x2b561:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.492594:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f545d586/0x3234de053c50746 lrc: 2/0,0 mode: PW/PW res: [0x2b562:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492598:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c5073f lrc: 3/0,1 mode: PW/PW res: [0x2b560:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492600:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c5073f lrc: 3/0,1 mode: PW/PW res: [0x2b560:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492610:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c5073f lrc: 3/0,1 mode: PW/PW res: [0x2b560:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492613:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c5073f lrc: 2/0,0 mode: PW/PW res: [0x2b560:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.492634:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+558:39030:x1731745946392384:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 783us (912us total) trans 12885079111 rc 0/0 00000100:00100000:1.0:1651529344.492637:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211058 00000100:00100000:0.0:1651529344.492653:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+557:39030:x1731745946392256:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 837us (958us total) trans 12885079112 rc 0/0 00000100:00100000:0.0:1651529344.492664:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211057 00010000:00010000:0.0:1651529344.492671:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f545d586/0x3234de053c50746 lrc: 2/0,0 mode: PW/PW res: [0x2b562:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492674:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f545d586 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.492675:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f545d586/0x3234de053c50746 lrc: 2/0,0 mode: PW/PW res: [0x2b562:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492678:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f545d586/0x3234de053c50746 lrc: 3/0,0 mode: PW/PW res: [0x2b562:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.492682:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.492683:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f545d586/0x3234de053c50746 lrc: 1/0,0 mode: --/PW res: [0x2b562:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492685:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f545d586/0x3234de053c50746 lrc: 0/0,0 mode: --/PW res: [0x2b562:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492689:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c5073f lrc: 2/0,0 mode: PW/PW res: [0x2b560:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.492691:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.492692:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000677ce99b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.492693:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c5073f lrc: 2/0,0 mode: PW/PW res: [0x2b560:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492701:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c5073f lrc: 3/0,0 mode: PW/PW res: [0x2b560:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.492704:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.492705:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c5073f lrc: 1/0,0 mode: --/PW res: [0x2b560:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492707:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000677ce99b/0x3234de053c5073f lrc: 0/0,0 mode: --/PW res: [0x2b560:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492713:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000042c8316b/0x3234de053c5074d lrc: 3/0,1 mode: PW/PW res: [0x2b563:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492716:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042c8316b/0x3234de053c5074d lrc: 3/0,1 mode: PW/PW res: [0x2b563:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492721:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042c8316b/0x3234de053c5074d lrc: 3/0,1 mode: PW/PW res: [0x2b563:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492724:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042c8316b/0x3234de053c5074d lrc: 2/0,0 mode: PW/PW res: [0x2b563:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.492764:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000edfe60d3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996974656:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.492769:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000411ac620/0x3234de053c5075b lrc: 3/0,1 mode: --/PW res: [0x2b564:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.492774:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+557:39029:x1731745946392448:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 910us (998us total) trans 12885079113 rc 0/0 00000100:00100000:0.0:1651529344.492777:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211059 00000100:00100000:1.0:1651529344.492781:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396273536 00010000:00010000:0.0:1651529344.492784:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042c8316b/0x3234de053c5074d lrc: 2/0,0 mode: PW/PW res: [0x2b563:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.492786:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003fd513db/0x3234de053c4f2fc lrc: 5/0,0 mode: PR/PR res: [0x2b565:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e9b expref: 1506 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.492788:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042c8316b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.492789:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042c8316b/0x3234de053c5074d lrc: 2/0,0 mode: PW/PW res: [0x2b563:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.492793:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396273600 00010000:00010000:1.0:1651529344.492795:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008e21f640/0x3234de053c4f3ce lrc: 4/0,0 mode: PR/PR res: [0x2b564:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81c0 expref: 1507 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.492799:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396273728 00010000:00010000:1.0:1651529344.492801:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eb6a3f83/0x3234de053c4c88c lrc: 5/0,0 mode: PR/PR res: [0x2b566:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd3f4 expref: 1508 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.492805:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11842 00000100:00100000:1.0:1651529344.492807:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1508:41279:x1731746396273536:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.492807:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042c8316b/0x3234de053c5074d lrc: 3/0,0 mode: PW/PW res: [0x2b563:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.492809:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.492811:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003fd513db/0x3234de053c4f2fc lrc: 5/0,0 mode: PR/PR res: [0x2b565:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e9b expref: 1508 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.492812:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042c8316b/0x3234de053c5074d lrc: 1/0,0 mode: --/PW res: [0x2b563:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.492814:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003fd513db/0x3234de053c4f2fc lrc: 4/0,0 mode: PR/PR res: [0x2b565:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e9b expref: 1508 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.492820:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.492821:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.492822:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c50754 lrc: 3/0,1 mode: PW/PW res: [0x2b565:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492824:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042c8316b/0x3234de053c5074d lrc: 0/0,0 mode: --/PW res: [0x2b563:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.492825:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c50754 lrc: 4/0,1 mode: PW/PW res: [0x2b565:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.492829:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.492831:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004b00577e/0x3234de053c50731 lrc: 3/0,1 mode: PW/PW res: [0x2b55f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492834:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b00577e/0x3234de053c50731 lrc: 3/0,1 mode: PW/PW res: [0x2b55f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.492836:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1508:41279:x1731746396273536:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 28us (154us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.492837:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b00577e/0x3234de053c50731 lrc: 3/0,1 mode: PW/PW res: [0x2b55f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.492838:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11842 00010000:00010000:0.0:1651529344.492840:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b00577e/0x3234de053c50731 lrc: 2/0,0 mode: PW/PW res: [0x2b55f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.492842:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11843 00000100:00100000:1.0:1651529344.492844:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1507:41278:x1731746396273600:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.492846:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.492847:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008e21f640/0x3234de053c4f3ce lrc: 4/0,0 mode: PR/PR res: [0x2b564:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81c0 expref: 1507 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.492851:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008e21f640/0x3234de053c4f3ce lrc: 3/0,0 mode: PR/PR res: [0x2b564:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81c0 expref: 1507 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.492855:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e21f640/0x3234de053c4f3ce lrc: 0/0,0 mode: --/PR res: [0x2b564:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81c0 expref: 1507 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.492858:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.492859:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.492859:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000411ac620/0x3234de053c5075b lrc: 3/0,1 mode: PW/PW res: [0x2b564:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.492865:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000411ac620/0x3234de053c5075b lrc: 4/0,1 mode: PW/PW res: [0x2b564:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.492871:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.492875:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1506:41278:x1731746396273600:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 30us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.492877:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11843 00000100:00100000:0.0:1651529344.492879:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+557:39030:x1731745946392192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1119us (1212us total) trans 12885079114 rc 0/0 00000100:00100000:1.0:1651529344.492881:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11844 00000100:00100000:1.0:1651529344.492882:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1505:41278:x1731746396273728:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.492882:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211055 00010000:00010000:1.0:1651529344.492884:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.492885:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eb6a3f83/0x3234de053c4c88c lrc: 5/0,0 mode: PR/PR res: [0x2b566:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd3f4 expref: 1505 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.492888:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b00577e/0x3234de053c50731 lrc: 2/0,0 mode: PW/PW res: [0x2b55f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.492889:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eb6a3f83/0x3234de053c4c88c lrc: 4/0,0 mode: PR/PR res: [0x2b566:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd3f4 expref: 1505 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.492891:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004b00577e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.492892:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b00577e/0x3234de053c50731 lrc: 2/0,0 mode: PW/PW res: [0x2b55f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.492893:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.492894:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.492894:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004e8b8142/0x3234de053c50762 lrc: 3/0,1 mode: PW/PW res: [0x2b566:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492895:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b00577e/0x3234de053c50731 lrc: 3/0,0 mode: PW/PW res: [0x2b55f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.492897:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e8b8142/0x3234de053c50762 lrc: 4/0,1 mode: PW/PW res: [0x2b566:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492900:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b00577e/0x3234de053c50731 lrc: 1/0,0 mode: --/PW res: [0x2b55f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.492901:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.492902:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b00577e/0x3234de053c50731 lrc: 0/0,0 mode: --/PW res: [0x2b55f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.492905:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1505:41278:x1731746396273728:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 22us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.492908:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11844 00010000:00010000:0.0:1651529344.492912:0:151609:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fd513db/0x3234de053c4f2fc lrc: 0/0,0 mode: --/PR res: [0x2b565:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e9b expref: 1504 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.492915:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996974592:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.492916:0:80279:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb6a3f83/0x3234de053c4c88c lrc: 0/0,0 mode: --/PR res: [0x2b566:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd3f4 expref: 1503 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.492919:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085af61db pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996974720:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.492923:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004e8b8142/0x3234de053c50762 lrc: 3/0,1 mode: PW/PW res: [0x2b566:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.492926:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004e8b8142/0x3234de053c50762 lrc: 3/0,1 mode: PW/PW res: [0x2b566:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.492928:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e8b8142/0x3234de053c50762 lrc: 3/0,1 mode: PW/PW res: [0x2b566:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.492931:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e8b8142/0x3234de053c50762 lrc: 3/0,1 mode: PW/PW res: [0x2b566:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.492934:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e8b8142/0x3234de053c50762 lrc: 2/0,0 mode: PW/PW res: [0x2b566:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492935:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c50754 lrc: 3/0,1 mode: PW/PW res: [0x2b565:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492939:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c50754 lrc: 3/0,1 mode: PW/PW res: [0x2b565:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492947:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c50754 lrc: 3/0,1 mode: PW/PW res: [0x2b565:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492951:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c50754 lrc: 3/0,1 mode: PW/PW res: [0x2b565:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.492953:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c50754 lrc: 2/0,0 mode: PW/PW res: [0x2b565:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.492977:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+558:39029:x1731745946392896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 802us (818us total) trans 12885079115 rc 0/0 00000100:00100000:1.0:1651529344.492980:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211062 00010000:00010000:1.0:1651529344.492986:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000411ac620/0x3234de053c5075b lrc: 3/0,1 mode: PW/PW res: [0x2b564:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.492991:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+557:39030:x1731745946392576:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 947us (1002us total) trans 12885079116 rc 0/0 00010000:00010000:1.0:1651529344.492992:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000411ac620/0x3234de053c5075b lrc: 3/0,1 mode: PW/PW res: [0x2b564:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.492994:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211060 00010000:00010000:1.0:1651529344.492995:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000411ac620/0x3234de053c5075b lrc: 3/0,1 mode: PW/PW res: [0x2b564:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.492998:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000411ac620/0x3234de053c5075b lrc: 2/0,0 mode: PW/PW res: [0x2b564:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493001:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e8b8142/0x3234de053c50762 lrc: 2/0,0 mode: PW/PW res: [0x2b566:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493014:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004e8b8142 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.493015:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e8b8142/0x3234de053c50762 lrc: 2/0,0 mode: PW/PW res: [0x2b566:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493018:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e8b8142/0x3234de053c50762 lrc: 3/0,0 mode: PW/PW res: [0x2b566:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493023:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e8b8142/0x3234de053c50762 lrc: 1/0,0 mode: --/PW res: [0x2b566:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493025:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e8b8142/0x3234de053c50762 lrc: 0/0,0 mode: --/PW res: [0x2b566:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493030:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c50754 lrc: 2/0,0 mode: PW/PW res: [0x2b565:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493032:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000fe54815 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.493033:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c50754 lrc: 2/0,0 mode: PW/PW res: [0x2b565:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.493035:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+557:39029:x1731745946392512:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 986us (1011us total) trans 12885079117 rc 0/0 00010000:00010000:0.0:1651529344.493036:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c50754 lrc: 3/0,0 mode: PW/PW res: [0x2b565:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.493038:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211061 00010000:00010000:0.0:1651529344.493039:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c50754 lrc: 1/0,0 mode: --/PW res: [0x2b565:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493041:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c50754 lrc: 0/0,0 mode: --/PW res: [0x2b565:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493045:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000411ac620/0x3234de053c5075b lrc: 2/0,0 mode: PW/PW res: [0x2b564:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493048:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000411ac620 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.493048:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000411ac620/0x3234de053c5075b lrc: 2/0,0 mode: PW/PW res: [0x2b564:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493051:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000411ac620/0x3234de053c5075b lrc: 3/0,0 mode: PW/PW res: [0x2b564:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493054:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000411ac620/0x3234de053c5075b lrc: 1/0,0 mode: --/PW res: [0x2b564:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493056:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000411ac620/0x3234de053c5075b lrc: 0/0,0 mode: --/PW res: [0x2b564:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.493073:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.493087:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.493097:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946393152 00000100:00100000:1.0:1651529344.493102:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.493113:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946393280 00000100:00100000:0.0:1651529344.493117:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946393344 00000100:00100000:0.0:1651529344.493122:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211063 00000100:00100000:0.0:1651529344.493123:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085af61db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+559:39029:x1731745946393152:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.493128:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177511 count 1 00010000:00010000:0.0:1651529344.493132:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50769 lrc: 3/0,1 mode: --/PW res: [0x2b567:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493137:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c4d57b lrc: 2/0,0 mode: PR/PR res: [0x2b567:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0771 expref: 1502 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.493142:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.493143:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.493143:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50769 lrc: 4/0,1 mode: --/PW res: [0x2b567:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493150:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c4d57b lrc: 3/0,0 mode: PR/PR res: [0x2b567:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0771 expref: 1502 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.493154:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c4d57b lrc: 4/0,0 mode: PR/PR res: [0x2b567:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0771 expref: 1502 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.493158:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996974784:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.493174:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 000000003678d25f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.493178:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211064 00000100:00100000:1.0:1651529344.493180:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+559:39029:x1731745946393280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.493181:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211065 00000100:00100000:0.0:1651529344.493182:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+559:39030:x1731745946393344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.493186:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177512 count 1 00002000:00080000:0.0:1651529344.493187:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177513 count 1 00010000:00010000:1.0:1651529344.493191:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a146a8b/0x3234de053c50770 lrc: 3/0,1 mode: --/PW res: [0x2b568:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493191:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50777 lrc: 3/0,1 mode: --/PW res: [0x2b569:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493198:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0ad04d0/0x3234de053c4d088 lrc: 2/0,0 mode: PR/PR res: [0x2b568:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf3d6 expref: 1502 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.493201:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.493202:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.493203:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a146a8b/0x3234de053c50770 lrc: 4/0,1 mode: --/PW res: [0x2b568:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493210:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a0ad04d0/0x3234de053c4d088 lrc: 3/0,0 mode: PR/PR res: [0x2b568:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf3d6 expref: 1502 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.493212:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006e9afa88/0x3234de053c4de6c lrc: 2/0,0 mode: PR/PR res: [0x2b569:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a5c expref: 1502 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.493214:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a0ad04d0/0x3234de053c4d088 lrc: 4/0,0 mode: PR/PR res: [0x2b568:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf3d6 expref: 1502 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.493215:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.493216:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.493217:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50777 lrc: 4/0,1 mode: --/PW res: [0x2b569:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.493218:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005912c4a3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996974848:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.493243:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c3caa148 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.493246:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006e9afa88/0x3234de053c4de6c lrc: 3/0,0 mode: PR/PR res: [0x2b569:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a5c expref: 1502 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.493250:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006e9afa88/0x3234de053c4de6c lrc: 4/0,0 mode: PR/PR res: [0x2b569:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a5c expref: 1502 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.493254:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996974912:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.493262:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000000d706dff going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.493368:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.493379:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.493380:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946393472 00000100:00100000:1.0:1651529344.493388:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.493396:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946393536 00000100:00100000:0.0:1651529344.493401:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946393600 00000100:00100000:1.0:1651529344.493408:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.493408:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211066 00000100:00100000:0.0:1651529344.493409:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+562:39030:x1731745946393472:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.493419:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.493419:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177514 count 1 00010000:00010000:0.0:1651529344.493423:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c5077e lrc: 3/0,1 mode: --/PW res: [0x2b56a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.493426:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946393728 00010000:00010000:0.0:1651529344.493428:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c4dff4 lrc: 2/0,0 mode: PR/PR res: [0x2b56a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d30d7 expref: 1502 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.493431:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.493431:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.493432:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946393664 00010000:00010000:0.0:1651529344.493432:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c5077e lrc: 4/0,1 mode: --/PW res: [0x2b56a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.493436:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211067 00000100:00100000:1.0:1651529344.493437:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+564:39029:x1731745946393536:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.493439:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c4dff4 lrc: 3/0,0 mode: PR/PR res: [0x2b56a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d30d7 expref: 1502 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.493442:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177515 count 1 00010000:00010000:0.0:1651529344.493442:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c4dff4 lrc: 4/0,0 mode: PR/PR res: [0x2b56a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d30d7 expref: 1502 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.493446:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b937ade1/0x3234de053c50785 lrc: 3/0,1 mode: --/PW res: [0x2b56b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.493446:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996974976:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.493451:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b95fbd27/0x3234de053c4d8ed lrc: 2/0,0 mode: PR/PR res: [0x2b56b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d14d0 expref: 1502 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.493454:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.493455:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.493456:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b937ade1/0x3234de053c50785 lrc: 4/0,1 mode: --/PW res: [0x2b56b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.493460:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c0dff858 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.493467:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211068 00000100:00100000:0.0:1651529344.493469:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+564:39030:x1731745946393600:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.493470:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b95fbd27/0x3234de053c4d8ed lrc: 3/0,0 mode: PR/PR res: [0x2b56b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d14d0 expref: 1502 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.493473:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177516 count 1 00010000:00010000:1.0:1651529344.493474:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b95fbd27/0x3234de053c4d8ed lrc: 4/0,0 mode: PR/PR res: [0x2b56b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d14d0 expref: 1502 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.493476:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5078c lrc: 3/0,1 mode: --/PW res: [0x2b56c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.493478:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dfc79d4e pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996975040:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.493481:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007b46247a/0x3234de053c4d22c lrc: 2/0,0 mode: PR/PR res: [0x2b56c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa51 expref: 1502 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.493484:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.493484:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.493485:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5078c lrc: 4/0,1 mode: --/PW res: [0x2b56c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.493486:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd96f074 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.493491:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007b46247a/0x3234de053c4d22c lrc: 3/0,0 mode: PR/PR res: [0x2b56c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa51 expref: 1502 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.493492:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211069 00000100:00100000:1.0:1651529344.493494:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007fca8239 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+564:39030:x1731745946393728:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.493494:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007b46247a/0x3234de053c4d22c lrc: 4/0,0 mode: PR/PR res: [0x2b56c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa51 expref: 1502 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:1.0:1651529344.493498:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177518 count 1 00000100:00100000:0.0:1651529344.493501:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996975104:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.493502:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c499a55/0x3234de053c50793 lrc: 3/0,1 mode: --/PW res: [0x2b56e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493506:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000026f7366a/0x3234de053c4f04e lrc: 2/0,0 mode: PR/PR res: [0x2b56e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7430 expref: 1502 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.493508:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060852af0 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.493509:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.493510:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.493510:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c499a55/0x3234de053c50793 lrc: 4/0,1 mode: --/PW res: [0x2b56e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.493514:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211070 00000100:00100000:0.0:1651529344.493515:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ea32140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+564:39030:x1731745946393664:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.493516:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000026f7366a/0x3234de053c4f04e lrc: 3/0,0 mode: PR/PR res: [0x2b56e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7430 expref: 1502 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.493519:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177517 count 1 00010000:00010000:1.0:1651529344.493522:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000026f7366a/0x3234de053c4f04e lrc: 4/0,0 mode: PR/PR res: [0x2b56e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7430 expref: 1502 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.493526:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005914c920 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996975168:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.493532:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d09f5ee1 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.493549:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073a973b4/0x3234de053c5079a lrc: 3/0,1 mode: --/PW res: [0x2b56d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493554:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d846d847/0x3234de053c4e152 lrc: 2/0,0 mode: PR/PR res: [0x2b56d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d364f expref: 1502 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.493557:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.493557:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.493558:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073a973b4/0x3234de053c5079a lrc: 4/0,1 mode: --/PW res: [0x2b56d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493565:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d846d847/0x3234de053c4e152 lrc: 3/0,0 mode: PR/PR res: [0x2b56d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d364f expref: 1502 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.493568:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d846d847/0x3234de053c4e152 lrc: 4/0,0 mode: PR/PR res: [0x2b56d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d364f expref: 1502 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.493573:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996975232:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.493587:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 0000000070e666f7 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.493595:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996974784:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.493604:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50769 lrc: 3/0,1 mode: --/PW res: [0x2b567:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.493606:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.493617:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996974912:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.493620:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50777 lrc: 3/0,1 mode: --/PW res: [0x2b569:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.493626:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396274368 00010000:00010000:0.0:1651529344.493631:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a0ad04d0/0x3234de053c4d088 lrc: 5/0,0 mode: PR/PR res: [0x2b568:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf3d6 expref: 1503 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.493636:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.493646:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396274304 00010000:00010000:0.0:1651529344.493649:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c4d57b lrc: 4/0,0 mode: PR/PR res: [0x2b567:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0771 expref: 1504 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.493657:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11845 00000100:00100000:0.0:1651529344.493659:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1504:41278:x1731746396274368:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.493662:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.493663:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a0ad04d0/0x3234de053c4d088 lrc: 5/0,0 mode: PR/PR res: [0x2b568:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf3d6 expref: 1504 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.493667:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a0ad04d0/0x3234de053c4d088 lrc: 4/0,0 mode: PR/PR res: [0x2b568:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf3d6 expref: 1504 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.493672:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.493673:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.493673:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.493674:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000a146a8b/0x3234de053c50770 lrc: 3/0,1 mode: PW/PW res: [0x2b568:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493677:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a146a8b/0x3234de053c50770 lrc: 4/0,1 mode: PW/PW res: [0x2b568:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493681:0:80279:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0ad04d0/0x3234de053c4d088 lrc: 0/0,0 mode: --/PR res: [0x2b568:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf3d6 expref: 1504 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.493681:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.493686:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005912c4a3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996974848:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.493692:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1503:41278:x1731746396274368:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 32us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.493694:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11845 00010000:00010000:1.0:1651529344.493696:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000a146a8b/0x3234de053c50770 lrc: 3/0,1 mode: PW/PW res: [0x2b568:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493699:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000a146a8b/0x3234de053c50770 lrc: 3/0,1 mode: PW/PW res: [0x2b568:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493702:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a146a8b/0x3234de053c50770 lrc: 3/0,1 mode: PW/PW res: [0x2b568:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493705:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a146a8b/0x3234de053c50770 lrc: 3/0,1 mode: PW/PW res: [0x2b568:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493708:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a146a8b/0x3234de053c50770 lrc: 2/0,0 mode: PW/PW res: [0x2b568:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.493713:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396274432 00010000:00010000:0.0:1651529344.493723:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006e9afa88/0x3234de053c4de6c lrc: 4/0,0 mode: PR/PR res: [0x2b569:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a5c expref: 1503 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.493729:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11846 00000100:00100000:0.0:1651529344.493731:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1503:41278:x1731746396274304:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.493733:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.493743:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c4d57b lrc: 4/0,0 mode: PR/PR res: [0x2b567:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0771 expref: 1503 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.493747:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c4d57b lrc: 3/0,0 mode: PR/PR res: [0x2b567:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0771 expref: 1503 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.493752:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c4d57b lrc: 0/0,0 mode: --/PR res: [0x2b567:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0771 expref: 1503 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.493756:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.493757:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.493758:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50769 lrc: 3/0,1 mode: PW/PW res: [0x2b567:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.493760:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+565:39029:x1731745946393280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 580us (673us total) trans 12885079118 rc 0/0 00010000:00010000:0.0:1651529344.493761:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50769 lrc: 4/0,1 mode: PW/PW res: [0x2b567:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.493764:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211064 00010000:00010000:0.0:1651529344.493767:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.493772:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11847 00000100:00100000:1.0:1651529344.493774:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000619c18c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1502:41278:x1731746396274432:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.493774:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1502:41278:x1731746396274304:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.493776:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11846 00010000:00010000:1.0:1651529344.493777:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.493779:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006e9afa88/0x3234de053c4de6c lrc: 4/0,0 mode: PR/PR res: [0x2b569:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a5c expref: 1501 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.493783:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006e9afa88/0x3234de053c4de6c lrc: 3/0,0 mode: PR/PR res: [0x2b569:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a5c expref: 1501 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.493783:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a146a8b/0x3234de053c50770 lrc: 2/0,0 mode: PW/PW res: [0x2b568:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493786:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000a146a8b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.493787:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a146a8b/0x3234de053c50770 lrc: 2/0,0 mode: PW/PW res: [0x2b568:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493788:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e9afa88/0x3234de053c4de6c lrc: 0/0,0 mode: --/PR res: [0x2b569:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a5c expref: 1501 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.493790:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a146a8b/0x3234de053c50770 lrc: 3/0,0 mode: PW/PW res: [0x2b568:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493792:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.493793:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.493794:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50777 lrc: 3/0,1 mode: PW/PW res: [0x2b569:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493797:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50777 lrc: 4/0,1 mode: PW/PW res: [0x2b569:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493807:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.493812:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a146a8b/0x3234de053c50770 lrc: 1/0,0 mode: --/PW res: [0x2b568:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.493813:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000619c18c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1500:41278:x1731746396274432:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (140us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.493815:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a146a8b/0x3234de053c50770 lrc: 0/0,0 mode: --/PW res: [0x2b568:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.493818:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11847 00010000:00010000:0.0:1651529344.493830:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50777 lrc: 3/0,1 mode: PW/PW res: [0x2b569:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493836:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50777 lrc: 3/0,1 mode: PW/PW res: [0x2b569:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493844:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50777 lrc: 3/0,1 mode: PW/PW res: [0x2b569:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493847:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50777 lrc: 2/0,0 mode: PW/PW res: [0x2b569:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.493886:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+565:39030:x1731745946393344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 702us (784us total) trans 12885079119 rc 0/0 00000100:00100000:0.0:1651529344.493889:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211065 00010000:00010000:0.0:1651529344.493896:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50777 lrc: 2/0,0 mode: PW/PW res: [0x2b569:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493899:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000048c07243 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.493900:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50777 lrc: 2/0,0 mode: PW/PW res: [0x2b569:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493903:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50777 lrc: 3/0,0 mode: PW/PW res: [0x2b569:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493907:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50777 lrc: 1/0,0 mode: --/PW res: [0x2b569:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493910:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50777 lrc: 0/0,0 mode: --/PW res: [0x2b569:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.493920:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996974976:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.493923:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c5077e lrc: 3/0,1 mode: --/PW res: [0x2b56a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493928:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50769 lrc: 3/0,1 mode: PW/PW res: [0x2b567:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.493931:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dfc79d4e pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996975040:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.493931:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50769 lrc: 3/0,1 mode: PW/PW res: [0x2b567:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493934:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50769 lrc: 3/0,1 mode: PW/PW res: [0x2b567:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.493935:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b937ade1/0x3234de053c50785 lrc: 3/0,1 mode: --/PW res: [0x2b56b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.493937:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50769 lrc: 2/0,0 mode: PW/PW res: [0x2b567:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.494001:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085af61db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+565:39029:x1731745946393152:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 877us (928us total) trans 12885079120 rc 0/0 00000100:00100000:0.0:1651529344.494004:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211063 00010000:00010000:0.0:1651529344.494011:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50769 lrc: 2/0,0 mode: PW/PW res: [0x2b567:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.494014:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e0e037e6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.494015:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50769 lrc: 2/0,0 mode: PW/PW res: [0x2b567:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.494021:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50769 lrc: 3/0,0 mode: PW/PW res: [0x2b567:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.494025:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50769 lrc: 1/0,0 mode: --/PW res: [0x2b567:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.494028:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50769 lrc: 0/0,0 mode: --/PW res: [0x2b567:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.494083:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996975104:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.494088:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5078c lrc: 3/0,1 mode: --/PW res: [0x2b56c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.494096:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.494102:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.494115:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.494119:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996975232:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.494122:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000073a973b4/0x3234de053c5079a lrc: 3/0,1 mode: --/PW res: [0x2b56d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.494124:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.494133:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.494142:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.494142:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946393984 00000100:00100000:1.0:1651529344.494151:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.494155:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946394048 00000100:00100000:0.0:1651529344.494162:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211071 00000100:00100000:0.0:1651529344.494163:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000024fae69e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+566:39030:x1731745946393984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.494169:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005914c920 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996975168:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.494169:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177519 count 1 00010000:00010000:1.0:1651529344.494173:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002c499a55/0x3234de053c50793 lrc: 3/0,1 mode: --/PW res: [0x2b56e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.494173:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cca8aba1/0x3234de053c507a1 lrc: 3/0,1 mode: --/PW res: [0x2b56f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.494179:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d288bfff/0x3234de053c4ca4c lrc: 2/0,0 mode: PR/PR res: [0x2b56f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdad1 expref: 1499 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.494180:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396274560 00010000:00010000:0.0:1651529344.494182:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.494183:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.494184:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cca8aba1/0x3234de053c507a1 lrc: 4/0,1 mode: --/PW res: [0x2b56f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.494185:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c4dff4 lrc: 4/0,0 mode: PR/PR res: [0x2b56a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d30d7 expref: 1500 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.494190:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396274688 00010000:00010000:1.0:1651529344.494192:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007b46247a/0x3234de053c4d22c lrc: 4/0,0 mode: PR/PR res: [0x2b56c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa51 expref: 1501 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.494196:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396274816 00010000:00010000:1.0:1651529344.494198:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d846d847/0x3234de053c4e152 lrc: 4/0,0 mode: PR/PR res: [0x2b56d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d364f expref: 1502 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.494202:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396274624 00010000:00010000:1.0:1651529344.494204:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b95fbd27/0x3234de053c4d8ed lrc: 4/0,0 mode: PR/PR res: [0x2b56b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d14d0 expref: 1503 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.494208:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396274752 00010000:00010000:1.0:1651529344.494210:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000026f7366a/0x3234de053c4f04e lrc: 4/0,0 mode: PR/PR res: [0x2b56e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7430 expref: 1504 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.494218:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d288bfff/0x3234de053c4ca4c lrc: 3/0,0 mode: PR/PR res: [0x2b56f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdad1 expref: 1504 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.494233:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d288bfff/0x3234de053c4ca4c lrc: 4/0,0 mode: PR/PR res: [0x2b56f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdad1 expref: 1504 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.494242:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996975296:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.494244:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11848 00000100:00100000:1.0:1651529344.494246:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1504:41279:x1731746396274560:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.494249:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.494251:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c4dff4 lrc: 4/0,0 mode: PR/PR res: [0x2b56a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d30d7 expref: 1504 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.494252:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 000000000a4def41 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.494255:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c4dff4 lrc: 3/0,0 mode: PR/PR res: [0x2b56a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d30d7 expref: 1504 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.494261:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c4dff4 lrc: 0/0,0 mode: --/PR res: [0x2b56a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d30d7 expref: 1504 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.494261:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211072 00000100:00100000:0.0:1651529344.494263:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+566:39029:x1731745946394048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.494264:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.494265:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.494266:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c5077e lrc: 3/0,1 mode: PW/PW res: [0x2b56a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.494268:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177520 count 1 00010000:00010000:1.0:1651529344.494269:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c5077e lrc: 4/0,1 mode: PW/PW res: [0x2b56a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.494271:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c507a8 lrc: 3/0,1 mode: --/PW res: [0x2b570:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.494278:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.494282:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fc44198a/0x3234de053c4e805 lrc: 2/0,0 mode: PR/PR res: [0x2b570:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d50e3 expref: 1503 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.494285:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1503:41279:x1731746396274560:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 39us (190us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.494286:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.494287:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.494288:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11848 00010000:00010000:0.0:1651529344.494288:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c507a8 lrc: 4/0,1 mode: --/PW res: [0x2b570:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.494292:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11849 00000100:00100000:1.0:1651529344.494294:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1502:41279:x1731746396274688:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.494294:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fc44198a/0x3234de053c4e805 lrc: 3/0,0 mode: PR/PR res: [0x2b570:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d50e3 expref: 1502 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.494296:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.494298:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007b46247a/0x3234de053c4d22c lrc: 4/0,0 mode: PR/PR res: [0x2b56c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa51 expref: 1502 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.494298:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fc44198a/0x3234de053c4e805 lrc: 4/0,0 mode: PR/PR res: [0x2b570:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d50e3 expref: 1502 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.494301:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007b46247a/0x3234de053c4d22c lrc: 3/0,0 mode: PR/PR res: [0x2b56c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa51 expref: 1502 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.494302:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996975360:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.494306:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b46247a/0x3234de053c4d22c lrc: 0/0,0 mode: --/PR res: [0x2b56c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa51 expref: 1502 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.494309:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.494309:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c0dff858 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.494310:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.494311:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5078c lrc: 3/0,1 mode: PW/PW res: [0x2b56c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.494313:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5078c lrc: 4/0,1 mode: PW/PW res: [0x2b56c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.494314:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c5077e lrc: 3/0,1 mode: PW/PW res: [0x2b56a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.494317:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c5077e lrc: 3/0,1 mode: PW/PW res: [0x2b56a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.494322:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.494325:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c5077e lrc: 3/0,1 mode: PW/PW res: [0x2b56a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.494327:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1501:41279:x1731746396274688:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 32us (224us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.494328:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c5077e lrc: 2/0,0 mode: PW/PW res: [0x2b56a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.494329:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11849 00000100:00100000:1.0:1651529344.494333:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11850 00000100:00100000:1.0:1651529344.494335:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1500:41279:x1731746396274816:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.494337:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.494338:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d846d847/0x3234de053c4e152 lrc: 4/0,0 mode: PR/PR res: [0x2b56d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d364f expref: 1500 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.494342:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d846d847/0x3234de053c4e152 lrc: 3/0,0 mode: PR/PR res: [0x2b56d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d364f expref: 1500 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.494346:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d846d847/0x3234de053c4e152 lrc: 0/0,0 mode: --/PR res: [0x2b56d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d364f expref: 1500 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.494349:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.494350:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.494351:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000073a973b4/0x3234de053c5079a lrc: 3/0,1 mode: PW/PW res: [0x2b56d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.494354:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073a973b4/0x3234de053c5079a lrc: 4/0,1 mode: PW/PW res: [0x2b56d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.494361:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.494365:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1499:41279:x1731746396274816:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 30us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.494368:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11850 00000100:00100000:1.0:1651529344.494371:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11851 00000100:00100000:1.0:1651529344.494373:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1498:41279:x1731746396274624:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.494375:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.494375:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+567:39030:x1731745946393472:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 965us (1007us total) trans 12885079121 rc 0/0 00010000:00010000:1.0:1651529344.494377:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b95fbd27/0x3234de053c4d8ed lrc: 4/0,0 mode: PR/PR res: [0x2b56b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d14d0 expref: 1498 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.494378:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211066 00010000:00010000:1.0:1651529344.494380:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b95fbd27/0x3234de053c4d8ed lrc: 3/0,0 mode: PR/PR res: [0x2b56b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d14d0 expref: 1498 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.494384:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b95fbd27/0x3234de053c4d8ed lrc: 0/0,0 mode: --/PR res: [0x2b56b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d14d0 expref: 1498 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.494385:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c5077e lrc: 2/0,0 mode: PW/PW res: [0x2b56a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.494388:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.494388:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.494389:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b937ade1/0x3234de053c50785 lrc: 3/0,1 mode: PW/PW res: [0x2b56b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.494389:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000069f7ba22 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.494390:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c5077e lrc: 2/0,0 mode: PW/PW res: [0x2b56a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.494392:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b937ade1/0x3234de053c50785 lrc: 4/0,1 mode: PW/PW res: [0x2b56b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.494393:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c5077e lrc: 3/0,0 mode: PW/PW res: [0x2b56a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.494398:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.494398:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c5077e lrc: 1/0,0 mode: --/PW res: [0x2b56a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.494400:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c5077e lrc: 0/0,0 mode: --/PW res: [0x2b56a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.494402:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1497:41279:x1731746396274624:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 28us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.494404:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11851 00010000:00010000:0.0:1651529344.494406:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5078c lrc: 3/0,1 mode: PW/PW res: [0x2b56c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.494407:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11852 00000100:00100000:1.0:1651529344.494409:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1496:41279:x1731746396274752:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.494409:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5078c lrc: 3/0,1 mode: PW/PW res: [0x2b56c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.494411:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.494412:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000026f7366a/0x3234de053c4f04e lrc: 4/0,0 mode: PR/PR res: [0x2b56e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7430 expref: 1496 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.494412:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5078c lrc: 3/0,1 mode: PW/PW res: [0x2b56c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.494415:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5078c lrc: 2/0,0 mode: PW/PW res: [0x2b56c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.494416:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000026f7366a/0x3234de053c4f04e lrc: 3/0,0 mode: PR/PR res: [0x2b56e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7430 expref: 1496 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.494420:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026f7366a/0x3234de053c4f04e lrc: 0/0,0 mode: --/PR res: [0x2b56e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7430 expref: 1496 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.494423:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.494424:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.494424:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002c499a55/0x3234de053c50793 lrc: 3/0,1 mode: PW/PW res: [0x2b56e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.494427:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c499a55/0x3234de053c50793 lrc: 4/0,1 mode: PW/PW res: [0x2b56e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.494433:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.494437:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1495:41279:x1731746396274752:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 27us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.494439:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11852 00010000:00010000:1.0:1651529344.494446:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b937ade1/0x3234de053c50785 lrc: 3/0,1 mode: PW/PW res: [0x2b56b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.494448:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+567:39030:x1731745946393600:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 979us (1060us total) trans 12885079122 rc 0/0 00010000:00010000:1.0:1651529344.494449:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b937ade1/0x3234de053c50785 lrc: 3/0,1 mode: PW/PW res: [0x2b56b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.494452:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b937ade1/0x3234de053c50785 lrc: 3/0,1 mode: PW/PW res: [0x2b56b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.494452:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211068 00010000:00010000:1.0:1651529344.494458:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b937ade1/0x3234de053c50785 lrc: 2/0,0 mode: PW/PW res: [0x2b56b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.494458:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5078c lrc: 2/0,0 mode: PW/PW res: [0x2b56c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.494461:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000002904524 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.494462:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5078c lrc: 2/0,0 mode: PW/PW res: [0x2b56c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.494473:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5078c lrc: 3/0,0 mode: PW/PW res: [0x2b56c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.494477:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5078c lrc: 1/0,0 mode: --/PW res: [0x2b56c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.494480:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5078c lrc: 0/0,0 mode: --/PW res: [0x2b56c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.494484:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b937ade1/0x3234de053c50785 lrc: 2/0,0 mode: PW/PW res: [0x2b56b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.494487:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b937ade1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.494488:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b937ade1/0x3234de053c50785 lrc: 2/0,0 mode: PW/PW res: [0x2b56b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.494491:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b937ade1/0x3234de053c50785 lrc: 3/0,0 mode: PW/PW res: [0x2b56b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.494496:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b937ade1/0x3234de053c50785 lrc: 1/0,0 mode: --/PW res: [0x2b56b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.494499:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b937ade1/0x3234de053c50785 lrc: 0/0,0 mode: --/PW res: [0x2b56b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.494500:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+567:39029:x1731745946393536:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1062us (1121us total) trans 12885079123 rc 0/0 00000100:00100000:1.0:1651529344.494503:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211067 00010000:00010000:0.0:1651529344.494506:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000073a973b4/0x3234de053c5079a lrc: 3/0,1 mode: PW/PW res: [0x2b56d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.494509:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073a973b4/0x3234de053c5079a lrc: 3/0,1 mode: PW/PW res: [0x2b56d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.494510:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002c499a55/0x3234de053c50793 lrc: 3/0,1 mode: PW/PW res: [0x2b56e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.494512:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073a973b4/0x3234de053c5079a lrc: 3/0,1 mode: PW/PW res: [0x2b56d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.494514:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c499a55/0x3234de053c50793 lrc: 3/0,1 mode: PW/PW res: [0x2b56e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.494515:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073a973b4/0x3234de053c5079a lrc: 2/0,0 mode: PW/PW res: [0x2b56d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.494517:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c499a55/0x3234de053c50793 lrc: 3/0,1 mode: PW/PW res: [0x2b56e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.494519:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c499a55/0x3234de053c50793 lrc: 2/0,0 mode: PW/PW res: [0x2b56e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.494556:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ea32140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+568:39030:x1731745946393664:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1040us (1137us total) trans 12885079124 rc 0/0 00000100:00100000:1.0:1651529344.494557:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007fca8239 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+568:39030:x1731745946393728:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1063us (1157us total) trans 12885079125 rc 0/0 00000100:00100000:0.0:1651529344.494559:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211070 00000100:00100000:1.0:1651529344.494561:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211069 00010000:00010000:0.0:1651529344.494566:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073a973b4/0x3234de053c5079a lrc: 2/0,0 mode: PW/PW res: [0x2b56d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.494569:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000073a973b4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.494570:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073a973b4/0x3234de053c5079a lrc: 2/0,0 mode: PW/PW res: [0x2b56d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.494573:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073a973b4/0x3234de053c5079a lrc: 3/0,0 mode: PW/PW res: [0x2b56d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.494576:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.494577:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073a973b4/0x3234de053c5079a lrc: 1/0,0 mode: --/PW res: [0x2b56d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.494580:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073a973b4/0x3234de053c5079a lrc: 0/0,0 mode: --/PW res: [0x2b56d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.494584:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c499a55/0x3234de053c50793 lrc: 2/0,0 mode: PW/PW res: [0x2b56e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.494587:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002c499a55 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.494588:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c499a55/0x3234de053c50793 lrc: 2/0,0 mode: PW/PW res: [0x2b56e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.494591:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c499a55/0x3234de053c50793 lrc: 3/0,0 mode: PW/PW res: [0x2b56e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.494594:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c499a55/0x3234de053c50793 lrc: 1/0,0 mode: --/PW res: [0x2b56e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.494596:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c499a55/0x3234de053c50793 lrc: 0/0,0 mode: --/PW res: [0x2b56e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.494672:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946394304 00000100:00100000:1.0:1651529344.494683:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211073 00000100:00100000:1.0:1651529344.494685:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+567:39030:x1731745946394304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.494691:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177521 count 1 00010000:00010000:1.0:1651529344.494696:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d412086/0x3234de053c507af lrc: 3/0,1 mode: --/PW res: [0x2b571:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.494700:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c6f9b1ec/0x3234de053c4eb62 lrc: 2/0,0 mode: PR/PR res: [0x2b571:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5eff expref: 1494 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.494703:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.494704:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.494705:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d412086/0x3234de053c507af lrc: 4/0,1 mode: --/PW res: [0x2b571:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.494711:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c6f9b1ec/0x3234de053c4eb62 lrc: 3/0,0 mode: PR/PR res: [0x2b571:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5eff expref: 1494 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.494715:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c6f9b1ec/0x3234de053c4eb62 lrc: 4/0,0 mode: PR/PR res: [0x2b571:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5eff expref: 1494 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.494719:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000037ac96ac pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996975424:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.494730:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000412e5d26 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.494854:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.494865:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.494865:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946394496 00000100:00100000:1.0:1651529344.494872:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.494874:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946394624 00000100:00100000:1.0:1651529344.494878:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.494880:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946394560 00000100:00100000:0.0:1651529344.494885:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946394688 00000100:00100000:0.0:1651529344.494891:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211074 00000100:00100000:0.0:1651529344.494893:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+571:39030:x1731745946394496:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.494895:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.494899:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177522 count 1 00000100:00100000:1.0:1651529344.494902:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946394752 00010000:00010000:0.0:1651529344.494903:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c507b6 lrc: 3/0,1 mode: --/PW res: [0x2b572:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.494908:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211075 00010000:00010000:0.0:1651529344.494908:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b1258bfe/0x3234de053c4e397 lrc: 2/0,0 mode: PR/PR res: [0x2b572:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f63 expref: 1494 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.494910:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+572:39030:x1731745946394624:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.494911:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.494911:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.494912:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c507b6 lrc: 4/0,1 mode: --/PW res: [0x2b572:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.494915:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177524 count 1 00010000:00010000:1.0:1651529344.494919:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1838eab/0x3234de053c507bd lrc: 3/0,1 mode: --/PW res: [0x2b574:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.494919:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b1258bfe/0x3234de053c4e397 lrc: 3/0,0 mode: PR/PR res: [0x2b572:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f63 expref: 1494 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.494922:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b1258bfe/0x3234de053c4e397 lrc: 4/0,0 mode: PR/PR res: [0x2b572:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f63 expref: 1494 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.494924:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c4cc13 lrc: 2/0,0 mode: PR/PR res: [0x2b574:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce225 expref: 1494 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.494927:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.494928:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.494928:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1838eab/0x3234de053c507bd lrc: 4/0,1 mode: --/PW res: [0x2b574:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.494935:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c4cc13 lrc: 3/0,0 mode: PR/PR res: [0x2b574:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce225 expref: 1494 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.494945:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c4cc13 lrc: 4/0,0 mode: PR/PR res: [0x2b574:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce225 expref: 1494 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.494955:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e124baf1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996975552:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.494955:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996975488:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.494967:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c3caa148 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.494967:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 000000003003c8b0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.494972:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211076 00000100:00100000:1.0:1651529344.494974:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+572:39029:x1731745946394560:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.494975:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211077 00000100:00100000:0.0:1651529344.494976:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005914c920 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+572:39029:x1731745946394688:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.494978:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177523 count 1 00002000:00080000:0.0:1651529344.494981:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177525 count 1 00010000:00010000:1.0:1651529344.494982:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3202904/0x3234de053c507c4 lrc: 3/0,1 mode: --/PW res: [0x2b573:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.494985:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c507cb lrc: 3/0,1 mode: --/PW res: [0x2b575:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.494986:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a3918086/0x3234de053c4e30b lrc: 2/0,0 mode: PR/PR res: [0x2b573:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d25 expref: 1494 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.494989:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.494989:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c1f7c4df/0x3234de053c4a045 lrc: 2/0,0 mode: PR/PR res: [0x2b575:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb6ce expref: 1494 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.494990:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.494991:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3202904/0x3234de053c507c4 lrc: 4/0,1 mode: --/PW res: [0x2b573:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.494993:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.494993:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.494994:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c507cb lrc: 4/0,1 mode: --/PW res: [0x2b575:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.494996:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a3918086/0x3234de053c4e30b lrc: 3/0,0 mode: PR/PR res: [0x2b573:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d25 expref: 1494 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.494999:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a3918086/0x3234de053c4e30b lrc: 4/0,0 mode: PR/PR res: [0x2b573:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d25 expref: 1494 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.495000:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c1f7c4df/0x3234de053c4a045 lrc: 3/0,0 mode: PR/PR res: [0x2b575:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb6ce expref: 1494 pid: 72397 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.495003:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b0d9532a pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996975616:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.495004:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c1f7c4df/0x3234de053c4a045 lrc: 4/0,0 mode: PR/PR res: [0x2b575:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb6ce expref: 1494 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.495008:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996975680:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.495010:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd96f074 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.495014:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000076b354b3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.495015:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211078 00000100:00100000:1.0:1651529344.495017:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfc79d4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+572:39030:x1731745946394752:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.495021:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177526 count 1 00010000:00010000:1.0:1651529344.495024:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e92ebc3c/0x3234de053c507d2 lrc: 3/0,1 mode: --/PW res: [0x2b576:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495028:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c4ec34 lrc: 2/0,0 mode: PR/PR res: [0x2b576:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d625c expref: 1494 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.495031:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.495031:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.495032:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e92ebc3c/0x3234de053c507d2 lrc: 4/0,1 mode: --/PW res: [0x2b576:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495040:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c4ec34 lrc: 3/0,0 mode: PR/PR res: [0x2b576:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d625c expref: 1494 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.495044:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c4ec34 lrc: 4/0,0 mode: PR/PR res: [0x2b576:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d625c expref: 1494 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.495048:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000de0edbdc pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996975744:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.495054:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d09f5ee1 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.495078:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996975296:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.495082:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.495082:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cca8aba1/0x3234de053c507a1 lrc: 3/0,1 mode: --/PW res: [0x2b56f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.495120:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996975360:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.495123:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c507a8 lrc: 3/0,1 mode: --/PW res: [0x2b570:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.495169:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.495178:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396275136 00000100:00100000:1.0:1651529344.495180:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.495183:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d288bfff/0x3234de053c4ca4c lrc: 4/0,0 mode: PR/PR res: [0x2b56f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdad1 expref: 1495 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.495187:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396275328 00010000:00010000:1.0:1651529344.495193:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c6f9b1ec/0x3234de053c4eb62 lrc: 5/0,0 mode: PR/PR res: [0x2b571:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5eff expref: 1496 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.495208:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396275392 00010000:00010000:0.0:1651529344.495212:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fc44198a/0x3234de053c4e805 lrc: 4/0,0 mode: PR/PR res: [0x2b570:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d50e3 expref: 1497 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.495213:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11853 00000100:00100000:1.0:1651529344.495215:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1497:41279:x1731746396275136:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.495217:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11854 00010000:00010000:1.0:1651529344.495218:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.495219:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d288bfff/0x3234de053c4ca4c lrc: 4/0,0 mode: PR/PR res: [0x2b56f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdad1 expref: 1497 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.495219:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b9d7b776 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1497:41279:x1731746396275328:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.495237:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d288bfff/0x3234de053c4ca4c lrc: 3/0,0 mode: PR/PR res: [0x2b56f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdad1 expref: 1497 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.495239:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.495241:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c6f9b1ec/0x3234de053c4eb62 lrc: 5/0,0 mode: PR/PR res: [0x2b571:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5eff expref: 1497 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.495243:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d288bfff/0x3234de053c4ca4c lrc: 0/0,0 mode: --/PR res: [0x2b56f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdad1 expref: 1497 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.495245:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c6f9b1ec/0x3234de053c4eb62 lrc: 4/0,0 mode: PR/PR res: [0x2b571:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5eff expref: 1497 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.495247:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.495247:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.495248:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cca8aba1/0x3234de053c507a1 lrc: 3/0,1 mode: PW/PW res: [0x2b56f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495251:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cca8aba1/0x3234de053c507a1 lrc: 4/0,1 mode: PW/PW res: [0x2b56f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495251:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.495252:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.495252:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005d412086/0x3234de053c507af lrc: 3/0,1 mode: PW/PW res: [0x2b571:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495256:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d412086/0x3234de053c507af lrc: 4/0,1 mode: PW/PW res: [0x2b571:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495260:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.495266:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.495269:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1496:41279:x1731746396275136:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 53us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.495272:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11853 00000100:00100000:0.0:1651529344.495274:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b9d7b776 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1496:41279:x1731746396275328:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 54us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.495277:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11855 00000100:00100000:1.0:1651529344.495279:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1495:41278:x1731746396275392:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.495279:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11854 00010000:00010000:1.0:1651529344.495281:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.495283:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fc44198a/0x3234de053c4e805 lrc: 4/0,0 mode: PR/PR res: [0x2b570:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d50e3 expref: 1494 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.495287:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fc44198a/0x3234de053c4e805 lrc: 3/0,0 mode: PR/PR res: [0x2b570:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d50e3 expref: 1494 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.495290:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cca8aba1/0x3234de053c507a1 lrc: 3/0,1 mode: PW/PW res: [0x2b56f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495291:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc44198a/0x3234de053c4e805 lrc: 0/0,0 mode: --/PR res: [0x2b570:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d50e3 expref: 1494 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.495294:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cca8aba1/0x3234de053c507a1 lrc: 3/0,1 mode: PW/PW res: [0x2b56f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495295:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.495295:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.495296:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c507a8 lrc: 3/0,1 mode: PW/PW res: [0x2b570:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495297:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cca8aba1/0x3234de053c507a1 lrc: 3/0,1 mode: PW/PW res: [0x2b56f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495299:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c507a8 lrc: 4/0,1 mode: PW/PW res: [0x2b570:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495299:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cca8aba1/0x3234de053c507a1 lrc: 2/0,0 mode: PW/PW res: [0x2b56f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495307:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.495313:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1493:41278:x1731746396275392:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 34us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.495315:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11855 00010000:00010000:1.0:1651529344.495324:0:80277:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6f9b1ec/0x3234de053c4eb62 lrc: 0/0,0 mode: --/PR res: [0x2b571:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5eff expref: 1492 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.495328:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000037ac96ac pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996975424:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.495332:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005d412086/0x3234de053c507af lrc: 3/0,1 mode: PW/PW res: [0x2b571:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495335:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005d412086/0x3234de053c507af lrc: 3/0,1 mode: PW/PW res: [0x2b571:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495338:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d412086/0x3234de053c507af lrc: 3/0,1 mode: PW/PW res: [0x2b571:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495341:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d412086/0x3234de053c507af lrc: 3/0,1 mode: PW/PW res: [0x2b571:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495344:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d412086/0x3234de053c507af lrc: 2/0,0 mode: PW/PW res: [0x2b571:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.495366:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000024fae69e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+574:39030:x1731745946393984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1201us (1241us total) trans 12885079126 rc 0/0 00000100:00100000:0.0:1651529344.495378:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211071 00000100:00100000:1.0:1651529344.495386:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+573:39030:x1731745946394304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 701us (810us total) trans 12885079127 rc 0/0 00000100:00100000:1.0:1651529344.495390:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211073 00010000:00010000:0.0:1651529344.495408:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cca8aba1/0x3234de053c507a1 lrc: 2/0,0 mode: PW/PW res: [0x2b56f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495411:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cca8aba1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.495412:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cca8aba1/0x3234de053c507a1 lrc: 2/0,0 mode: PW/PW res: [0x2b56f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495415:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cca8aba1/0x3234de053c507a1 lrc: 3/0,0 mode: PW/PW res: [0x2b56f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495429:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cca8aba1/0x3234de053c507a1 lrc: 1/0,0 mode: --/PW res: [0x2b56f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495432:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cca8aba1/0x3234de053c507a1 lrc: 0/0,0 mode: --/PW res: [0x2b56f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495436:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d412086/0x3234de053c507af lrc: 2/0,0 mode: PW/PW res: [0x2b571:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495438:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005d412086 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.495439:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d412086/0x3234de053c507af lrc: 2/0,0 mode: PW/PW res: [0x2b571:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495442:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d412086/0x3234de053c507af lrc: 3/0,0 mode: PW/PW res: [0x2b571:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495445:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d412086/0x3234de053c507af lrc: 1/0,0 mode: --/PW res: [0x2b571:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495448:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d412086/0x3234de053c507af lrc: 0/0,0 mode: --/PW res: [0x2b571:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495454:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c507a8 lrc: 3/0,1 mode: PW/PW res: [0x2b570:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495457:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c507a8 lrc: 3/0,1 mode: PW/PW res: [0x2b570:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495462:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c507a8 lrc: 3/0,1 mode: PW/PW res: [0x2b570:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495465:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c507a8 lrc: 2/0,0 mode: PW/PW res: [0x2b570:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.495480:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b0d9532a pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996975616:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.495484:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f3202904/0x3234de053c507c4 lrc: 3/0,1 mode: --/PW res: [0x2b573:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.495491:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e124baf1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996975552:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.495493:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f1838eab/0x3234de053c507bd lrc: 3/0,1 mode: --/PW res: [0x2b574:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.495507:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+573:39029:x1731745946394048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1243us (1364us total) trans 12885079128 rc 0/0 00000100:00100000:0.0:1651529344.495510:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211072 00010000:00010000:0.0:1651529344.495516:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c507a8 lrc: 2/0,0 mode: PW/PW res: [0x2b570:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495520:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a69b6f5e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.495521:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c507a8 lrc: 2/0,0 mode: PW/PW res: [0x2b570:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495523:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c507a8 lrc: 3/0,0 mode: PW/PW res: [0x2b570:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495528:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c507a8 lrc: 1/0,0 mode: --/PW res: [0x2b570:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495531:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c507a8 lrc: 0/0,0 mode: --/PW res: [0x2b570:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.495540:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996975488:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.495544:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c507b6 lrc: 3/0,1 mode: --/PW res: [0x2b572:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.495615:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996975680:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.495616:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.495620:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c507cb lrc: 3/0,1 mode: --/PW res: [0x2b575:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.495624:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.495630:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.495636:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.495647:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396275648 00000100:00100000:1.0:1651529344.495651:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.495652:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b1258bfe/0x3234de053c4e397 lrc: 4/0,0 mode: PR/PR res: [0x2b572:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f63 expref: 1492 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.495662:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.495670:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000de0edbdc pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996975744:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.495674:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e92ebc3c/0x3234de053c507d2 lrc: 3/0,1 mode: --/PW res: [0x2b576:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.495688:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396275584 00010000:00010000:0.0:1651529344.495691:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c4cc13 lrc: 4/0,0 mode: PR/PR res: [0x2b574:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce225 expref: 1493 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.495696:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396275776 00000100:00100000:0.0:1651529344.495696:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396275712 00010000:00010000:0.0:1651529344.495698:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a3918086/0x3234de053c4e30b lrc: 4/0,0 mode: PR/PR res: [0x2b573:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d25 expref: 1495 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.495701:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c1f7c4df/0x3234de053c4a045 lrc: 4/0,0 mode: PR/PR res: [0x2b575:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb6ce expref: 1495 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.495702:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396275840 00010000:00010000:0.0:1651529344.495705:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c4ec34 lrc: 4/0,0 mode: PR/PR res: [0x2b576:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d625c expref: 1496 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.495709:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11856 00000100:00100000:1.0:1651529344.495711:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11857 00000100:00100000:0.0:1651529344.495711:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1496:41278:x1731746396275648:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.495713:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1496:41279:x1731746396275584:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.495714:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.495715:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b1258bfe/0x3234de053c4e397 lrc: 4/0,0 mode: PR/PR res: [0x2b572:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f63 expref: 1496 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.495716:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.495717:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c4cc13 lrc: 4/0,0 mode: PR/PR res: [0x2b574:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce225 expref: 1496 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.495719:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b1258bfe/0x3234de053c4e397 lrc: 3/0,0 mode: PR/PR res: [0x2b572:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f63 expref: 1496 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.495721:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c4cc13 lrc: 3/0,0 mode: PR/PR res: [0x2b574:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce225 expref: 1496 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.495724:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1258bfe/0x3234de053c4e397 lrc: 0/0,0 mode: --/PR res: [0x2b572:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f63 expref: 1496 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.495726:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c4cc13 lrc: 0/0,0 mode: --/PR res: [0x2b574:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce225 expref: 1496 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.495728:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.495728:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.495729:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c507b6 lrc: 3/0,1 mode: PW/PW res: [0x2b572:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495730:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.495730:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.495731:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1838eab/0x3234de053c507bd lrc: 3/0,1 mode: PW/PW res: [0x2b574:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495733:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c507b6 lrc: 4/0,1 mode: PW/PW res: [0x2b572:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495745:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1838eab/0x3234de053c507bd lrc: 4/0,1 mode: PW/PW res: [0x2b574:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495749:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.495752:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.495757:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1494:41278:x1731746396275648:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 46us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.495760:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1494:41279:x1731746396275584:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 46us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.495760:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11856 00000100:00100000:1.0:1651529344.495762:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11857 00000100:00100000:0.0:1651529344.495765:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11858 00000100:00100000:0.0:1651529344.495767:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1492:41279:x1731746396275712:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.495768:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11859 00010000:00010000:0.0:1651529344.495769:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.495770:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1492:41279:x1731746396275840:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.495771:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a3918086/0x3234de053c4e30b lrc: 4/0,0 mode: PR/PR res: [0x2b573:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d25 expref: 1492 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.495772:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.495774:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c4ec34 lrc: 4/0,0 mode: PR/PR res: [0x2b576:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d625c expref: 1492 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.495775:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a3918086/0x3234de053c4e30b lrc: 3/0,0 mode: PR/PR res: [0x2b573:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d25 expref: 1492 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.495777:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c4ec34 lrc: 3/0,0 mode: PR/PR res: [0x2b576:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d625c expref: 1492 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.495780:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3918086/0x3234de053c4e30b lrc: 0/0,0 mode: --/PR res: [0x2b573:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d25 expref: 1492 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.495782:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c4ec34 lrc: 0/0,0 mode: --/PR res: [0x2b576:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d625c expref: 1492 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.495783:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.495784:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.495785:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f3202904/0x3234de053c507c4 lrc: 3/0,1 mode: PW/PW res: [0x2b573:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495786:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.495786:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.495787:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e92ebc3c/0x3234de053c507d2 lrc: 3/0,1 mode: PW/PW res: [0x2b576:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495787:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3202904/0x3234de053c507c4 lrc: 4/0,1 mode: PW/PW res: [0x2b573:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495790:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e92ebc3c/0x3234de053c507d2 lrc: 4/0,1 mode: PW/PW res: [0x2b576:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495796:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.495802:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1490:41279:x1731746396275712:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 35us (166us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.495803:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.495804:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11858 00000100:00100000:0.0:1651529344.495808:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11860 00000100:00100000:1.0:1651529344.495809:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1489:41279:x1731746396275840:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 39us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.495810:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1489:41278:x1731746396275776:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.495812:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11859 00010000:00010000:0.0:1651529344.495813:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.495814:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c1f7c4df/0x3234de053c4a045 lrc: 4/0,0 mode: PR/PR res: [0x2b575:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb6ce expref: 1488 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.495818:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f1838eab/0x3234de053c507bd lrc: 3/0,1 mode: PW/PW res: [0x2b574:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495818:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c1f7c4df/0x3234de053c4a045 lrc: 3/0,0 mode: PR/PR res: [0x2b575:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb6ce expref: 1488 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.495821:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1838eab/0x3234de053c507bd lrc: 3/0,1 mode: PW/PW res: [0x2b574:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495822:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1f7c4df/0x3234de053c4a045 lrc: 0/0,0 mode: --/PR res: [0x2b575:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb6ce expref: 1488 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.495827:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1838eab/0x3234de053c507bd lrc: 3/0,1 mode: PW/PW res: [0x2b574:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495830:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1838eab/0x3234de053c507bd lrc: 2/0,0 mode: PW/PW res: [0x2b574:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495848:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.495848:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.495849:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c507cb lrc: 3/0,1 mode: PW/PW res: [0x2b575:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495852:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c507cb lrc: 4/0,1 mode: PW/PW res: [0x2b575:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495859:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.495865:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1487:41278:x1731746396275776:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 54us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.495867:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11860 00000100:00100000:1.0:1651529344.495874:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+573:39030:x1731745946394624:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 963us (1008us total) trans 12885079129 rc 0/0 00010000:00010000:0.0:1651529344.495874:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1838eab/0x3234de053c507bd lrc: 2/0,0 mode: PW/PW res: [0x2b574:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.495877:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211075 00010000:00010000:0.0:1651529344.495877:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f1838eab already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.495878:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1838eab/0x3234de053c507bd lrc: 2/0,0 mode: PW/PW res: [0x2b574:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.495881:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946394880 00010000:00010000:0.0:1651529344.495881:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1838eab/0x3234de053c507bd lrc: 3/0,0 mode: PW/PW res: [0x2b574:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495885:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1838eab/0x3234de053c507bd lrc: 1/0,0 mode: --/PW res: [0x2b574:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.495891:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211079 00000100:00100000:1.0:1651529344.495892:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+573:39030:x1731745946394880:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.495894:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1838eab/0x3234de053c507bd lrc: 0/0,0 mode: --/PW res: [0x2b574:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.495897:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177528 count 1 00010000:00010000:1.0:1651529344.495902:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c507d9 lrc: 3/0,1 mode: --/PW res: [0x2b578:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495903:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c507cb lrc: 3/0,1 mode: PW/PW res: [0x2b575:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495906:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a978ca31/0x3234de053c4df76 lrc: 2/0,0 mode: PR/PR res: [0x2b578:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f17 expref: 1486 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.495906:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c507cb lrc: 3/0,1 mode: PW/PW res: [0x2b575:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495909:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.495909:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c507cb lrc: 3/0,1 mode: PW/PW res: [0x2b575:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495910:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.495911:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c507d9 lrc: 4/0,1 mode: --/PW res: [0x2b578:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495911:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c507cb lrc: 2/0,0 mode: PW/PW res: [0x2b575:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495917:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a978ca31/0x3234de053c4df76 lrc: 3/0,0 mode: PR/PR res: [0x2b578:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f17 expref: 1486 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.495923:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a978ca31/0x3234de053c4df76 lrc: 4/0,0 mode: PR/PR res: [0x2b578:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f17 expref: 1486 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.495927:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005a17dd72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996975808:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.495936:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd96f074 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.495940:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f3202904/0x3234de053c507c4 lrc: 3/0,1 mode: PW/PW res: [0x2b573:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495944:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3202904/0x3234de053c507c4 lrc: 3/0,1 mode: PW/PW res: [0x2b573:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495947:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3202904/0x3234de053c507c4 lrc: 3/0,1 mode: PW/PW res: [0x2b573:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.495949:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3202904/0x3234de053c507c4 lrc: 2/0,0 mode: PW/PW res: [0x2b573:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.495949:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005914c920 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+574:39029:x1731745946394688:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 972us (1071us total) trans 12885079130 rc 0/0 00000100:00100000:0.0:1651529344.495952:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211077 00010000:00010000:0.0:1651529344.495967:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c507cb lrc: 2/0,0 mode: PW/PW res: [0x2b575:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495971:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027456046 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.495971:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c507cb lrc: 2/0,0 mode: PW/PW res: [0x2b575:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495974:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c507cb lrc: 3/0,0 mode: PW/PW res: [0x2b575:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495979:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c507cb lrc: 1/0,0 mode: --/PW res: [0x2b575:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495982:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c507cb lrc: 0/0,0 mode: --/PW res: [0x2b575:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495986:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3202904/0x3234de053c507c4 lrc: 2/0,0 mode: PW/PW res: [0x2b573:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495988:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f3202904 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.495989:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3202904/0x3234de053c507c4 lrc: 2/0,0 mode: PW/PW res: [0x2b573:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.495990:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+574:39029:x1731745946394560:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1015us (1118us total) trans 12885079131 rc 0/0 00010000:00010000:0.0:1651529344.495992:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3202904/0x3234de053c507c4 lrc: 3/0,0 mode: PW/PW res: [0x2b573:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.495993:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211076 00010000:00010000:0.0:1651529344.495995:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3202904/0x3234de053c507c4 lrc: 1/0,0 mode: --/PW res: [0x2b573:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.495998:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3202904/0x3234de053c507c4 lrc: 0/0,0 mode: --/PW res: [0x2b573:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.496001:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e92ebc3c/0x3234de053c507d2 lrc: 3/0,1 mode: PW/PW res: [0x2b576:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.496004:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e92ebc3c/0x3234de053c507d2 lrc: 3/0,1 mode: PW/PW res: [0x2b576:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496005:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c507b6 lrc: 3/0,1 mode: PW/PW res: [0x2b572:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496008:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c507b6 lrc: 3/0,1 mode: PW/PW res: [0x2b572:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.496009:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e92ebc3c/0x3234de053c507d2 lrc: 3/0,1 mode: PW/PW res: [0x2b576:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496011:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c507b6 lrc: 3/0,1 mode: PW/PW res: [0x2b572:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.496012:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e92ebc3c/0x3234de053c507d2 lrc: 2/0,0 mode: PW/PW res: [0x2b576:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496014:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c507b6 lrc: 2/0,0 mode: PW/PW res: [0x2b572:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.496049:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfc79d4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+575:39030:x1731745946394752:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1031us (1154us total) trans 12885079132 rc 0/0 00000100:00100000:1.0:1651529344.496051:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211078 00000100:00100000:0.0:1651529344.496057:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+574:39030:x1731745946394496:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1163us (1203us total) trans 12885079133 rc 0/0 00000100:00100000:0.0:1651529344.496060:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211074 00000100:00100000:1.0:1651529344.496066:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.496067:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e92ebc3c/0x3234de053c507d2 lrc: 2/0,0 mode: PW/PW res: [0x2b576:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496070:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e92ebc3c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.496077:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e92ebc3c/0x3234de053c507d2 lrc: 2/0,0 mode: PW/PW res: [0x2b576:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496081:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e92ebc3c/0x3234de053c507d2 lrc: 3/0,0 mode: PW/PW res: [0x2b576:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.496084:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.496085:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e92ebc3c/0x3234de053c507d2 lrc: 1/0,0 mode: --/PW res: [0x2b576:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496088:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e92ebc3c/0x3234de053c507d2 lrc: 0/0,0 mode: --/PW res: [0x2b576:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496092:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c507b6 lrc: 2/0,0 mode: PW/PW res: [0x2b572:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496094:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eb50e2ae already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.496095:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c507b6 lrc: 2/0,0 mode: PW/PW res: [0x2b572:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496098:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c507b6 lrc: 3/0,0 mode: PW/PW res: [0x2b572:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496101:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c507b6 lrc: 1/0,0 mode: --/PW res: [0x2b572:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496104:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c507b6 lrc: 0/0,0 mode: --/PW res: [0x2b572:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.496111:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946394816 00000100:00100000:0.0:1651529344.496116:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946395328 00000100:00100000:0.0:1651529344.496120:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211080 00000100:00100000:0.0:1651529344.496122:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a13808c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+575:39030:x1731745946394816:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.496127:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177527 count 1 00010000:00010000:0.0:1651529344.496130:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c507e0 lrc: 3/0,1 mode: --/PW res: [0x2b577:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496135:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c4f636 lrc: 2/0,0 mode: PR/PR res: [0x2b577:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b98 expref: 1486 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.496138:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.496138:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.496139:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c507e0 lrc: 4/0,1 mode: --/PW res: [0x2b577:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496146:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c4f636 lrc: 3/0,0 mode: PR/PR res: [0x2b577:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b98 expref: 1486 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.496149:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c4f636 lrc: 4/0,0 mode: PR/PR res: [0x2b577:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b98 expref: 1486 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.496153:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996975872:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.496180:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060852af0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.496188:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211081 00000100:00100000:0.0:1651529344.496189:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+575:39030:x1731745946395328:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.496194:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177529 count 1 00010000:00010000:0.0:1651529344.496198:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c507e7 lrc: 3/0,1 mode: --/PW res: [0x2b579:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496202:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c4c62b lrc: 2/0,0 mode: PR/PR res: [0x2b579:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccaaf expref: 1486 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.496205:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.496206:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.496206:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c507e7 lrc: 4/0,1 mode: --/PW res: [0x2b579:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496212:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c4c62b lrc: 3/0,0 mode: PR/PR res: [0x2b579:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccaaf expref: 1486 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.496216:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c4c62b lrc: 4/0,0 mode: PR/PR res: [0x2b579:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccaaf expref: 1486 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.496254:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996975936:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.496268:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 0000000076b354b3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.496322:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.496340:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946395520 00000100:00100000:0.0:1651529344.496350:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211082 00000100:00100000:1.0:1651529344.496351:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.496352:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+576:39030:x1731745946395520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.496358:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.496367:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.496373:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177530 count 1 00010000:00010000:0.0:1651529344.496378:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c507ee lrc: 3/0,1 mode: --/PW res: [0x2b57a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496388:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000070c61649/0x3234de053c4b377 lrc: 2/0,0 mode: PR/PR res: [0x2b57a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc1a2 expref: 1486 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.496392:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.496392:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.496393:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c507ee lrc: 4/0,1 mode: --/PW res: [0x2b57a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.496395:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.496400:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000070c61649/0x3234de053c4b377 lrc: 3/0,0 mode: PR/PR res: [0x2b57a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc1a2 expref: 1486 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.496403:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000070c61649/0x3234de053c4b377 lrc: 4/0,0 mode: PR/PR res: [0x2b57a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc1a2 expref: 1486 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.496406:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005a17dd72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996975808:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.496407:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996976000:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.496410:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c507d9 lrc: 3/0,1 mode: --/PW res: [0x2b578:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.496417:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946395584 00000100:00100000:0.0:1651529344.496421:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e7e12492 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.496438:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946395776 00000100:00100000:0.0:1651529344.496439:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946395648 00000100:00100000:1.0:1651529344.496442:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946395712 00000100:00100000:1.0:1651529344.496447:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211083 00000100:00100000:1.0:1651529344.496449:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+580:39029:x1731745946395584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.496449:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211084 00000100:00100000:0.0:1651529344.496451:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+580:39030:x1731745946395776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.496455:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177531 count 1 00002000:00080000:0.0:1651529344.496456:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177534 count 1 00010000:00010000:1.0:1651529344.496459:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c507f5 lrc: 3/0,1 mode: --/PW res: [0x2b57b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496459:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000deca3988/0x3234de053c507fc lrc: 3/0,1 mode: --/PW res: [0x2b57e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.496463:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1c88ce9/0x3234de053c4a51c lrc: 2/0,0 mode: PR/PR res: [0x2b57b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbafd expref: 1486 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.496464:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b089e50b/0x3234de053c4e470 lrc: 2/0,0 mode: PR/PR res: [0x2b57e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42f8 expref: 1486 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.496467:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.496467:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.496467:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.496468:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c507f5 lrc: 4/0,1 mode: --/PW res: [0x2b57b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496468:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.496468:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000deca3988/0x3234de053c507fc lrc: 4/0,1 mode: --/PW res: [0x2b57e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.496474:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f1c88ce9/0x3234de053c4a51c lrc: 3/0,0 mode: PR/PR res: [0x2b57b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbafd expref: 1486 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.496475:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b089e50b/0x3234de053c4e470 lrc: 3/0,0 mode: PR/PR res: [0x2b57e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42f8 expref: 1486 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.496478:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f1c88ce9/0x3234de053c4a51c lrc: 4/0,0 mode: PR/PR res: [0x2b57b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbafd expref: 1486 pid: 151609 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.496478:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b089e50b/0x3234de053c4e470 lrc: 4/0,0 mode: PR/PR res: [0x2b57e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42f8 expref: 1486 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.496482:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996976128:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.496483:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ee8cd7c9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996976064:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.496490:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 000000000e7e66c4 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.496492:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000412e5d26 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.496496:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211085 00000100:00100000:0.0:1651529344.496498:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+580:39030:x1731745946395648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.496499:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211086 00000100:00100000:1.0:1651529344.496501:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+580:39030:x1731745946395712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.496501:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177532 count 1 00010000:00010000:0.0:1651529344.496504:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c50803 lrc: 3/0,1 mode: --/PW res: [0x2b57c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.496505:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177533 count 1 00010000:00010000:1.0:1651529344.496508:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000068ac74b/0x3234de053c5080a lrc: 3/0,1 mode: --/PW res: [0x2b57d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496509:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005934995f/0x3234de053c4ce0b lrc: 2/0,0 mode: PR/PR res: [0x2b57c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce98e expref: 1486 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.496512:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.496512:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.496513:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c4a7f4 lrc: 2/0,0 mode: PR/PR res: [0x2b57d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc69 expref: 1486 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.496513:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c50803 lrc: 4/0,1 mode: --/PW res: [0x2b57c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.496516:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.496517:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.496517:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000068ac74b/0x3234de053c5080a lrc: 4/0,1 mode: --/PW res: [0x2b57d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496518:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005934995f/0x3234de053c4ce0b lrc: 3/0,0 mode: PR/PR res: [0x2b57c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce98e expref: 1486 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.496522:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005934995f/0x3234de053c4ce0b lrc: 4/0,0 mode: PR/PR res: [0x2b57c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce98e expref: 1486 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.496523:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c4a7f4 lrc: 3/0,0 mode: PR/PR res: [0x2b57d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc69 expref: 1486 pid: 72395 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.496525:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996976192:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.496527:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c4a7f4 lrc: 4/0,0 mode: PR/PR res: [0x2b57d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc69 expref: 1486 pid: 72395 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.496531:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005a17dd72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996976256:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.496532:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c2b2b59c going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.496537:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8a0b704 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.496539:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996975872:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.496542:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c507e0 lrc: 3/0,1 mode: --/PW res: [0x2b577:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.496562:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996975936:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.496565:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c507e7 lrc: 3/0,1 mode: --/PW res: [0x2b579:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.496729:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.496747:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.496754:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.496764:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396276096 00000100:00100000:0.0:1651529344.496765:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396276032 00010000:00010000:1.0:1651529344.496770:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c4f636 lrc: 4/0,0 mode: PR/PR res: [0x2b577:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b98 expref: 1488 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.496771:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a978ca31/0x3234de053c4df76 lrc: 4/0,0 mode: PR/PR res: [0x2b578:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f17 expref: 1488 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.496777:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396276160 00000100:00100000:0.0:1651529344.496778:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11861 00010000:00010000:1.0:1651529344.496779:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c4c62b lrc: 4/0,0 mode: PR/PR res: [0x2b579:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccaaf expref: 1489 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.496780:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de6bf351 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1489:41279:x1731746396276096:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.496782:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.496784:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11862 00010000:00010000:0.0:1651529344.496784:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c4f636 lrc: 4/0,0 mode: PR/PR res: [0x2b577:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b98 expref: 1489 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.496786:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1489:41279:x1731746396276032:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.496788:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c4f636 lrc: 3/0,0 mode: PR/PR res: [0x2b577:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b98 expref: 1489 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.496789:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.496790:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a978ca31/0x3234de053c4df76 lrc: 4/0,0 mode: PR/PR res: [0x2b578:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f17 expref: 1489 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.496793:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c4f636 lrc: 0/0,0 mode: --/PR res: [0x2b577:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8b98 expref: 1489 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.496794:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a978ca31/0x3234de053c4df76 lrc: 3/0,0 mode: PR/PR res: [0x2b578:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f17 expref: 1489 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.496797:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.496798:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.496799:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c507e0 lrc: 3/0,1 mode: PW/PW res: [0x2b577:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.496800:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a978ca31/0x3234de053c4df76 lrc: 0/0,0 mode: --/PR res: [0x2b578:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f17 expref: 1488 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.496802:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c507e0 lrc: 4/0,1 mode: PW/PW res: [0x2b577:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.496804:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.496804:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.496805:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c507d9 lrc: 3/0,1 mode: PW/PW res: [0x2b578:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.496808:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c507d9 lrc: 4/0,1 mode: PW/PW res: [0x2b578:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496809:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.496814:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.496822:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de6bf351 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1487:41279:x1731746396276096:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 41us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.496825:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11861 00000100:00100000:1.0:1651529344.496828:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1486:41279:x1731746396276032:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 41us (81us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.496831:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11862 00000100:00100000:0.0:1651529344.496834:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11863 00000100:00100000:0.0:1651529344.496836:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1485:41279:x1731746396276160:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.496839:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c507d9 lrc: 3/0,1 mode: PW/PW res: [0x2b578:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496839:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.496841:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c4c62b lrc: 4/0,0 mode: PR/PR res: [0x2b579:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccaaf expref: 1485 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.496843:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c507d9 lrc: 3/0,1 mode: PW/PW res: [0x2b578:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496844:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c4c62b lrc: 3/0,0 mode: PR/PR res: [0x2b579:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccaaf expref: 1485 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.496848:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c507d9 lrc: 3/0,1 mode: PW/PW res: [0x2b578:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496849:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c4c62b lrc: 0/0,0 mode: --/PR res: [0x2b579:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccaaf expref: 1485 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.496851:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c507d9 lrc: 2/0,0 mode: PW/PW res: [0x2b578:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496852:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.496853:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.496854:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c507e7 lrc: 3/0,1 mode: PW/PW res: [0x2b579:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496857:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c507e7 lrc: 4/0,1 mode: PW/PW res: [0x2b579:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496897:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.496905:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1484:41279:x1731746396276160:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 68us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.496908:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11863 00000100:00100000:1.0:1651529344.496910:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+581:39030:x1731745946394880:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1017us (1259us total) trans 12885079134 rc 0/0 00000100:00100000:1.0:1651529344.496913:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211079 00010000:00010000:0.0:1651529344.496915:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c507d9 lrc: 2/0,0 mode: PW/PW res: [0x2b578:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496918:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000059e60bfb already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.496919:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c507d9 lrc: 2/0,0 mode: PW/PW res: [0x2b578:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496922:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c507d9 lrc: 3/0,0 mode: PW/PW res: [0x2b578:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496927:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c507d9 lrc: 1/0,0 mode: --/PW res: [0x2b578:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496929:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c507d9 lrc: 0/0,0 mode: --/PW res: [0x2b578:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496942:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c507e7 lrc: 3/0,1 mode: PW/PW res: [0x2b579:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496945:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c507e7 lrc: 3/0,1 mode: PW/PW res: [0x2b579:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496948:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c507e7 lrc: 3/0,1 mode: PW/PW res: [0x2b579:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.496950:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c507e7 lrc: 2/0,0 mode: PW/PW res: [0x2b579:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.496994:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+581:39030:x1731745946395328:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 804us (910us total) trans 12885079135 rc 0/0 00000100:00100000:0.0:1651529344.496997:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211081 00010000:00010000:0.0:1651529344.497004:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c507e7 lrc: 2/0,0 mode: PW/PW res: [0x2b579:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497010:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a0607df4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.497011:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c507e7 lrc: 2/0,0 mode: PW/PW res: [0x2b579:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497014:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c507e7 lrc: 3/0,0 mode: PW/PW res: [0x2b579:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497018:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c507e7 lrc: 1/0,0 mode: --/PW res: [0x2b579:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497021:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c507e7 lrc: 0/0,0 mode: --/PW res: [0x2b579:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.497030:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996976000:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.497034:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c507ee lrc: 3/0,1 mode: --/PW res: [0x2b57a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497039:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c507e0 lrc: 3/0,1 mode: PW/PW res: [0x2b577:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497057:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c507e0 lrc: 3/0,1 mode: PW/PW res: [0x2b577:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497061:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c507e0 lrc: 3/0,1 mode: PW/PW res: [0x2b577:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497066:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c507e0 lrc: 2/0,0 mode: PW/PW res: [0x2b577:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.497131:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ee8cd7c9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996976064:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.497141:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c507f5 lrc: 3/0,1 mode: --/PW res: [0x2b57b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.497148:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005a17dd72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996976256:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.497151:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000068ac74b/0x3234de053c5080a lrc: 3/0,1 mode: --/PW res: [0x2b57d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.497163:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a13808c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+581:39030:x1731745946394816:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1039us (1096us total) trans 12885079136 rc 0/0 00000100:00100000:0.0:1651529344.497166:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211080 00010000:00010000:0.0:1651529344.497173:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c507e0 lrc: 2/0,0 mode: PW/PW res: [0x2b577:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497176:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000734ecdfd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.497177:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c507e0 lrc: 2/0,0 mode: PW/PW res: [0x2b577:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497180:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c507e0 lrc: 3/0,0 mode: PW/PW res: [0x2b577:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.497184:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.497185:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c507e0 lrc: 1/0,0 mode: --/PW res: [0x2b577:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497188:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c507e0 lrc: 0/0,0 mode: --/PW res: [0x2b577:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.497204:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996976128:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.497207:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000deca3988/0x3234de053c507fc lrc: 3/0,1 mode: --/PW res: [0x2b57e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.497216:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.497259:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996976192:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.497264:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c50803 lrc: 3/0,1 mode: --/PW res: [0x2b57c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.497266:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.497271:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946395968 00000100:00100000:0.0:1651529344.497280:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946396032 00000100:00100000:0.0:1651529344.497287:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211087 00000100:00100000:0.0:1651529344.497288:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+582:39029:x1731745946395968:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.497291:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:0.0:1651529344.497293:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177535 count 1 00000100:00100000:1.0:1651529344.497301:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.497303:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b00577e/0x3234de053c50811 lrc: 3/0,1 mode: --/PW res: [0x2b57f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.497307:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.497316:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.497326:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000d671244/0x3234de053c4aa8d lrc: 2/0,0 mode: PR/PR res: [0x2b57f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd96 expref: 1483 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.497327:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211088 00000100:00100000:1.0:1651529344.497329:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+582:39030:x1731745946396032:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.497330:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.497330:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.497331:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b00577e/0x3234de053c50811 lrc: 4/0,1 mode: --/PW res: [0x2b57f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.497335:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177536 count 1 00010000:00010000:0.0:1651529344.497338:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000d671244/0x3234de053c4aa8d lrc: 3/0,0 mode: PR/PR res: [0x2b57f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd96 expref: 1483 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.497339:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000127428a6/0x3234de053c50818 lrc: 3/0,1 mode: --/PW res: [0x2b580:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497341:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000d671244/0x3234de053c4aa8d lrc: 4/0,0 mode: PR/PR res: [0x2b57f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd96 expref: 1483 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.497344:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006609c41a/0x3234de053c4c981 lrc: 2/0,0 mode: PR/PR res: [0x2b580:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd7c1 expref: 1483 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.497348:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.497348:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.497348:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996976320:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.497349:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000127428a6/0x3234de053c50818 lrc: 4/0,1 mode: --/PW res: [0x2b580:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497356:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006609c41a/0x3234de053c4c981 lrc: 3/0,0 mode: PR/PR res: [0x2b580:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd7c1 expref: 1483 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.497359:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006609c41a/0x3234de053c4c981 lrc: 4/0,0 mode: PR/PR res: [0x2b580:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd7c1 expref: 1483 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.497362:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c086aae3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.497368:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396276608 00000100:00100000:1.0:1651529344.497370:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000913beefe pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996976384:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.497373:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000070c61649/0x3234de053c4b377 lrc: 4/0,0 mode: PR/PR res: [0x2b57a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc1a2 expref: 1484 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.497378:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396276736 00000100:00100000:1.0:1651529344.497379:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8a0b704 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.497380:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f1c88ce9/0x3234de053c4a51c lrc: 4/0,0 mode: PR/PR res: [0x2b57b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbafd expref: 1485 pid: 151609 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.497384:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396276864 00000100:00100000:1.0:1651529344.497385:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396276672 00010000:00010000:0.0:1651529344.497386:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005934995f/0x3234de053c4ce0b lrc: 4/0,0 mode: PR/PR res: [0x2b57c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce98e expref: 1487 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.497390:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b089e50b/0x3234de053c4e470 lrc: 4/0,0 mode: PR/PR res: [0x2b57e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42f8 expref: 1487 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.497390:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396276800 00010000:00010000:0.0:1651529344.497393:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c4a7f4 lrc: 4/0,0 mode: PR/PR res: [0x2b57d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc69 expref: 1488 pid: 72395 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.497397:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11864 00000100:00100000:1.0:1651529344.497399:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1488:41279:x1731746396276608:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.497399:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11865 00000100:00100000:0.0:1651529344.497400:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1488:41279:x1731746396276736:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.497402:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.497403:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.497404:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000070c61649/0x3234de053c4b377 lrc: 4/0,0 mode: PR/PR res: [0x2b57a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc1a2 expref: 1488 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.497404:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f1c88ce9/0x3234de053c4a51c lrc: 4/0,0 mode: PR/PR res: [0x2b57b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbafd expref: 1488 pid: 151609 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.497408:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000070c61649/0x3234de053c4b377 lrc: 3/0,0 mode: PR/PR res: [0x2b57a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc1a2 expref: 1488 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.497408:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f1c88ce9/0x3234de053c4a51c lrc: 3/0,0 mode: PR/PR res: [0x2b57b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbafd expref: 1488 pid: 151609 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.497413:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070c61649/0x3234de053c4b377 lrc: 0/0,0 mode: --/PR res: [0x2b57a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc1a2 expref: 1488 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.497414:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1c88ce9/0x3234de053c4a51c lrc: 0/0,0 mode: --/PR res: [0x2b57b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbafd expref: 1488 pid: 151609 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.497417:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.497417:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.497417:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.497418:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c507ee lrc: 3/0,1 mode: PW/PW res: [0x2b57a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497418:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.497419:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c507f5 lrc: 3/0,1 mode: PW/PW res: [0x2b57b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497421:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c507ee lrc: 4/0,1 mode: PW/PW res: [0x2b57a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497422:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c507f5 lrc: 4/0,1 mode: PW/PW res: [0x2b57b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497436:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.497438:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.497443:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1486:41279:x1731746396276608:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 43us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.497445:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11864 00000100:00100000:0.0:1651529344.497445:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1486:41279:x1731746396276736:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 44us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.497448:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11865 00000100:00100000:1.0:1651529344.497451:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11866 00000100:00100000:1.0:1651529344.497452:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1484:41279:x1731746396276864:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.497453:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11867 00010000:00010000:1.0:1651529344.497455:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.497455:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1484:41278:x1731746396276672:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.497456:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005934995f/0x3234de053c4ce0b lrc: 4/0,0 mode: PR/PR res: [0x2b57c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce98e expref: 1484 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.497457:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.497459:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b089e50b/0x3234de053c4e470 lrc: 4/0,0 mode: PR/PR res: [0x2b57e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42f8 expref: 1484 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.497462:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b089e50b/0x3234de053c4e470 lrc: 3/0,0 mode: PR/PR res: [0x2b57e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42f8 expref: 1484 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.497463:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005934995f/0x3234de053c4ce0b lrc: 3/0,0 mode: PR/PR res: [0x2b57c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce98e expref: 1484 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.497467:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b089e50b/0x3234de053c4e470 lrc: 0/0,0 mode: --/PR res: [0x2b57e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42f8 expref: 1484 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.497468:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005934995f/0x3234de053c4ce0b lrc: 0/0,0 mode: --/PR res: [0x2b57c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce98e expref: 1484 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.497471:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.497471:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.497472:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c50803 lrc: 3/0,1 mode: PW/PW res: [0x2b57c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497473:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.497473:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.497474:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000deca3988/0x3234de053c507fc lrc: 3/0,1 mode: PW/PW res: [0x2b57e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497475:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c50803 lrc: 4/0,1 mode: PW/PW res: [0x2b57c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497477:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000deca3988/0x3234de053c507fc lrc: 4/0,1 mode: PW/PW res: [0x2b57e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497484:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.497490:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1482:41279:x1731746396276864:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 37us (189us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.497490:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.497492:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11866 00000100:00100000:0.0:1651529344.497496:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1481:41278:x1731746396276672:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.497497:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11868 00000100:00100000:1.0:1651529344.497498:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000d49c4f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1481:41278:x1731746396276800:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.497498:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11867 00010000:00010000:1.0:1651529344.497501:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.497502:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c4a7f4 lrc: 4/0,0 mode: PR/PR res: [0x2b57d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc69 expref: 1480 pid: 72395 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.497505:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c4a7f4 lrc: 3/0,0 mode: PR/PR res: [0x2b57d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc69 expref: 1480 pid: 72395 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.497505:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000deca3988/0x3234de053c507fc lrc: 3/0,1 mode: PW/PW res: [0x2b57e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497508:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000deca3988/0x3234de053c507fc lrc: 3/0,1 mode: PW/PW res: [0x2b57e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497510:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c4a7f4 lrc: 0/0,0 mode: --/PR res: [0x2b57d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc69 expref: 1480 pid: 72395 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.497511:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000deca3988/0x3234de053c507fc lrc: 3/0,1 mode: PW/PW res: [0x2b57e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497514:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.497514:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.497514:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000deca3988/0x3234de053c507fc lrc: 2/0,0 mode: PW/PW res: [0x2b57e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497515:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000068ac74b/0x3234de053c5080a lrc: 3/0,1 mode: PW/PW res: [0x2b57d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497518:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000068ac74b/0x3234de053c5080a lrc: 4/0,1 mode: PW/PW res: [0x2b57d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497524:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.497528:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000d49c4f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1479:41278:x1731746396276800:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 29us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.497531:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11868 00010000:00010000:1.0:1651529344.497541:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c507f5 lrc: 3/0,1 mode: PW/PW res: [0x2b57b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497544:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c507f5 lrc: 3/0,1 mode: PW/PW res: [0x2b57b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497547:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c507f5 lrc: 3/0,1 mode: PW/PW res: [0x2b57b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497550:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c507f5 lrc: 2/0,0 mode: PW/PW res: [0x2b57b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.497553:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+583:39030:x1731745946395776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1101us (1185us total) trans 12885079137 rc 0/0 00000100:00100000:0.0:1651529344.497556:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211084 00010000:00010000:0.0:1651529344.497570:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000deca3988/0x3234de053c507fc lrc: 2/0,0 mode: PW/PW res: [0x2b57e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497573:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000deca3988 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.497574:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000deca3988/0x3234de053c507fc lrc: 2/0,0 mode: PW/PW res: [0x2b57e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497577:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000deca3988/0x3234de053c507fc lrc: 3/0,0 mode: PW/PW res: [0x2b57e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497582:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000deca3988/0x3234de053c507fc lrc: 1/0,0 mode: --/PW res: [0x2b57e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497585:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000deca3988/0x3234de053c507fc lrc: 0/0,0 mode: --/PW res: [0x2b57e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497589:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c507f5 lrc: 2/0,0 mode: PW/PW res: [0x2b57b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497592:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003865e83e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.497593:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c507f5 lrc: 2/0,0 mode: PW/PW res: [0x2b57b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.497595:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+583:39029:x1731745946395584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1145us (1248us total) trans 12885079138 rc 0/0 00010000:00010000:0.0:1651529344.497596:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c507f5 lrc: 3/0,0 mode: PW/PW res: [0x2b57b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.497598:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211083 00010000:00010000:0.0:1651529344.497599:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c507f5 lrc: 1/0,0 mode: --/PW res: [0x2b57b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497604:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c507f5 lrc: 0/0,0 mode: --/PW res: [0x2b57b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497605:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000068ac74b/0x3234de053c5080a lrc: 3/0,1 mode: PW/PW res: [0x2b57d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497608:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000068ac74b/0x3234de053c5080a lrc: 3/0,1 mode: PW/PW res: [0x2b57d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497610:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c50803 lrc: 3/0,1 mode: PW/PW res: [0x2b57c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497612:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000068ac74b/0x3234de053c5080a lrc: 3/0,1 mode: PW/PW res: [0x2b57d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497612:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c50803 lrc: 3/0,1 mode: PW/PW res: [0x2b57c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.497614:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000068ac74b/0x3234de053c5080a lrc: 2/0,0 mode: PW/PW res: [0x2b57d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497615:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c50803 lrc: 3/0,1 mode: PW/PW res: [0x2b57c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497618:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c50803 lrc: 2/0,0 mode: PW/PW res: [0x2b57c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.497651:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+584:39030:x1731745946395712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1150us (1256us total) trans 12885079139 rc 0/0 00000100:00100000:1.0:1651529344.497654:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211086 00000100:00100000:0.0:1651529344.497659:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+583:39030:x1731745946395648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1160us (1300us total) trans 12885079140 rc 0/0 00000100:00100000:0.0:1651529344.497662:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211085 00010000:00010000:0.0:1651529344.497669:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000068ac74b/0x3234de053c5080a lrc: 2/0,0 mode: PW/PW res: [0x2b57d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.497670:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.497672:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000068ac74b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.497673:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000068ac74b/0x3234de053c5080a lrc: 2/0,0 mode: PW/PW res: [0x2b57d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497683:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000068ac74b/0x3234de053c5080a lrc: 3/0,0 mode: PW/PW res: [0x2b57d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497688:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000068ac74b/0x3234de053c5080a lrc: 1/0,0 mode: --/PW res: [0x2b57d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497691:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000068ac74b/0x3234de053c5080a lrc: 0/0,0 mode: --/PW res: [0x2b57d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497695:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c50803 lrc: 2/0,0 mode: PW/PW res: [0x2b57c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497698:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005d39750f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.497698:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c50803 lrc: 2/0,0 mode: PW/PW res: [0x2b57c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497701:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c50803 lrc: 3/0,0 mode: PW/PW res: [0x2b57c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497704:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c50803 lrc: 1/0,0 mode: --/PW res: [0x2b57c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497707:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c50803 lrc: 0/0,0 mode: --/PW res: [0x2b57c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.497714:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946396096 00000100:00100000:0.0:1651529344.497724:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211089 00000100:00100000:0.0:1651529344.497726:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+583:39029:x1731745946396096:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.497730:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177537 count 1 00010000:00010000:0.0:1651529344.497742:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b6f07f6/0x3234de053c5081f lrc: 3/0,1 mode: --/PW res: [0x2b581:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497746:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009cc08160/0x3234de053c4eb69 lrc: 2/0,0 mode: PR/PR res: [0x2b581:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f0d expref: 1478 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.497750:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.497750:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.497751:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b6f07f6/0x3234de053c5081f lrc: 4/0,1 mode: --/PW res: [0x2b581:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497758:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009cc08160/0x3234de053c4eb69 lrc: 3/0,0 mode: PR/PR res: [0x2b581:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f0d expref: 1478 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.497761:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009cc08160/0x3234de053c4eb69 lrc: 4/0,0 mode: PR/PR res: [0x2b581:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f0d expref: 1478 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.497765:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996976448:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.497774:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 000000003678d25f going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.497779:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c507ee lrc: 3/0,1 mode: PW/PW res: [0x2b57a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497782:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c507ee lrc: 3/0,1 mode: PW/PW res: [0x2b57a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497785:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c507ee lrc: 3/0,1 mode: PW/PW res: [0x2b57a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497788:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c507ee lrc: 2/0,0 mode: PW/PW res: [0x2b57a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.497877:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+584:39030:x1731745946395520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1524us (1555us total) trans 12885079141 rc 0/0 00000100:00100000:0.0:1651529344.497880:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211082 00010000:00010000:0.0:1651529344.497904:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c507ee lrc: 2/0,0 mode: PW/PW res: [0x2b57a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497931:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cdc65e28 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.497932:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c507ee lrc: 2/0,0 mode: PW/PW res: [0x2b57a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497935:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c507ee lrc: 3/0,0 mode: PW/PW res: [0x2b57a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497940:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c507ee lrc: 1/0,0 mode: --/PW res: [0x2b57a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.497942:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c507ee lrc: 0/0,0 mode: --/PW res: [0x2b57a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.497946:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.497957:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.497960:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996976320:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.497963:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004b00577e/0x3234de053c50811 lrc: 3/0,1 mode: --/PW res: [0x2b57f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.497964:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.497970:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.497970:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946396608 00000100:00100000:0.0:1651529344.497985:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946396736 00000100:00100000:1.0:1651529344.497986:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000913beefe pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996976384:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.497990:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946396672 00000100:00100000:0.0:1651529344.497996:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946396800 00000100:00100000:0.0:1651529344.498002:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211090 00010000:00010000:1.0:1651529344.498003:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000127428a6/0x3234de053c50818 lrc: 3/0,1 mode: --/PW res: [0x2b580:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.498003:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+587:39030:x1731745946396608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.498008:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177538 count 1 00000100:00100000:1.0:1651529344.498012:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211091 00010000:00010000:0.0:1651529344.498012:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50826 lrc: 3/0,1 mode: --/PW res: [0x2b582:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.498013:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+587:39029:x1731745946396736:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.498016:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000015c2e928/0x3234de053c4a8e2 lrc: 2/0,0 mode: PR/PR res: [0x2b582:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbce0 expref: 1478 pid: 80281 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.498019:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177540 count 1 00010000:00010000:1.0:1651529344.498023:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af439eec/0x3234de053c5082d lrc: 3/0,1 mode: --/PW res: [0x2b584:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.498027:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000adf66056/0x3234de053c4e622 lrc: 2/0,0 mode: PR/PR res: [0x2b584:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d499d expref: 1478 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.498030:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.498031:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.498031:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af439eec/0x3234de053c5082d lrc: 4/0,1 mode: --/PW res: [0x2b584:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.498044:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000adf66056/0x3234de053c4e622 lrc: 3/0,0 mode: PR/PR res: [0x2b584:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d499d expref: 1478 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.498048:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000adf66056/0x3234de053c4e622 lrc: 4/0,0 mode: PR/PR res: [0x2b584:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d499d expref: 1478 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.498051:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.498051:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.498052:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000913beefe pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996976512:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.498052:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50826 lrc: 4/0,1 mode: --/PW res: [0x2b582:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.498061:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000015c2e928/0x3234de053c4a8e2 lrc: 3/0,0 mode: PR/PR res: [0x2b582:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbce0 expref: 1478 pid: 80281 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.498064:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000015c2e928/0x3234de053c4a8e2 lrc: 4/0,0 mode: PR/PR res: [0x2b582:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbce0 expref: 1478 pid: 80281 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.498068:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8a0b704 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.498069:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996976576:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.498074:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211092 00000100:00100000:1.0:1651529344.498076:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+587:39030:x1731745946396672:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.498078:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed830649 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.498081:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177539 count 1 00010000:00010000:1.0:1651529344.498085:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9ae0c20/0x3234de053c50834 lrc: 3/0,1 mode: --/PW res: [0x2b583:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.498085:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211093 00000100:00100000:0.0:1651529344.498087:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+587:39030:x1731745946396800:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.498089:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000062afab89/0x3234de053c4cc8a lrc: 2/0,0 mode: PR/PR res: [0x2b583:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce3f3 expref: 1478 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.498091:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177541 count 1 00010000:00010000:1.0:1651529344.498092:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.498093:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.498093:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9ae0c20/0x3234de053c50834 lrc: 4/0,1 mode: --/PW res: [0x2b583:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.498095:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c5083b lrc: 3/0,1 mode: --/PW res: [0x2b585:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.498099:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000062afab89/0x3234de053c4cc8a lrc: 3/0,0 mode: PR/PR res: [0x2b583:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce3f3 expref: 1478 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.498099:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c986e355/0x3234de053c4ed1b lrc: 2/0,0 mode: PR/PR res: [0x2b585:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d663e expref: 1478 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.498103:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000062afab89/0x3234de053c4cc8a lrc: 4/0,0 mode: PR/PR res: [0x2b583:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce3f3 expref: 1478 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.498103:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.498103:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.498104:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c5083b lrc: 4/0,1 mode: --/PW res: [0x2b585:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.498107:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004bb67ba4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996976640:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.498110:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c986e355/0x3234de053c4ed1b lrc: 3/0,0 mode: PR/PR res: [0x2b585:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d663e expref: 1478 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.498113:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000567ee0ef going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.498113:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c986e355/0x3234de053c4ed1b lrc: 4/0,0 mode: PR/PR res: [0x2b585:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d663e expref: 1478 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.498117:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996976704:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.498123:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000070e666f7 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.498158:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996976448:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.498162:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006b6f07f6/0x3234de053c5081f lrc: 3/0,1 mode: --/PW res: [0x2b581:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.498163:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.498176:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.498176:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946396864 00000100:00100000:0.0:1651529344.498186:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211094 00000100:00100000:0.0:1651529344.498188:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+588:39029:x1731745946396864:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.498193:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177542 count 1 00010000:00010000:0.0:1651529344.498197:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a146a8b/0x3234de053c50842 lrc: 3/0,1 mode: --/PW res: [0x2b586:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.498201:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000094bb6891/0x3234de053c4d4a9 lrc: 2/0,0 mode: PR/PR res: [0x2b586:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d04a0 expref: 1478 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.498204:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.498205:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.498205:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a146a8b/0x3234de053c50842 lrc: 4/0,1 mode: --/PW res: [0x2b586:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.498211:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000094bb6891/0x3234de053c4d4a9 lrc: 3/0,0 mode: PR/PR res: [0x2b586:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d04a0 expref: 1478 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.498213:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.498214:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000094bb6891/0x3234de053c4d4a9 lrc: 4/0,0 mode: PR/PR res: [0x2b586:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d04a0 expref: 1478 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.498218:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996976768:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.498221:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.498244:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396277120 00000100:00100000:0.0:1651529344.498248:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 000000003003c8b0 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.498255:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006609c41a/0x3234de053c4c981 lrc: 4/0,0 mode: PR/PR res: [0x2b580:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd7c1 expref: 1479 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.498265:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396277056 00010000:00010000:1.0:1651529344.498267:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000d671244/0x3234de053c4aa8d lrc: 4/0,0 mode: PR/PR res: [0x2b57f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd96 expref: 1480 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.498272:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396277184 00010000:00010000:1.0:1651529344.498274:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009cc08160/0x3234de053c4eb69 lrc: 4/0,0 mode: PR/PR res: [0x2b581:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f0d expref: 1481 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.498278:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11869 00000100:00100000:1.0:1651529344.498280:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1481:41279:x1731746396277120:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.498282:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.498282:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11870 00010000:00010000:1.0:1651529344.498284:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006609c41a/0x3234de053c4c981 lrc: 4/0,0 mode: PR/PR res: [0x2b580:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd7c1 expref: 1481 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.498285:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1481:41279:x1731746396277056:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.498287:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006609c41a/0x3234de053c4c981 lrc: 3/0,0 mode: PR/PR res: [0x2b580:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd7c1 expref: 1481 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.498288:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.498290:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000d671244/0x3234de053c4aa8d lrc: 4/0,0 mode: PR/PR res: [0x2b57f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd96 expref: 1481 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.498293:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006609c41a/0x3234de053c4c981 lrc: 0/0,0 mode: --/PR res: [0x2b580:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd7c1 expref: 1481 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.498295:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000d671244/0x3234de053c4aa8d lrc: 3/0,0 mode: PR/PR res: [0x2b57f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd96 expref: 1481 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.498297:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.498297:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.498298:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000127428a6/0x3234de053c50818 lrc: 3/0,1 mode: PW/PW res: [0x2b580:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.498301:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000127428a6/0x3234de053c50818 lrc: 4/0,1 mode: PW/PW res: [0x2b580:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.498303:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d671244/0x3234de053c4aa8d lrc: 0/0,0 mode: --/PR res: [0x2b57f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd96 expref: 1480 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.498307:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.498307:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.498308:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.498308:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004b00577e/0x3234de053c50811 lrc: 3/0,1 mode: PW/PW res: [0x2b57f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.498314:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1479:41279:x1731746396277120:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.498317:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11869 00000100:00100000:1.0:1651529344.498322:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11871 00000100:00100000:1.0:1651529344.498323:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1478:41279:x1731746396277184:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.498323:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b00577e/0x3234de053c50811 lrc: 4/0,1 mode: PW/PW res: [0x2b57f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.498326:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.498327:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009cc08160/0x3234de053c4eb69 lrc: 4/0,0 mode: PR/PR res: [0x2b581:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f0d expref: 1478 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.498330:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.498331:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009cc08160/0x3234de053c4eb69 lrc: 3/0,0 mode: PR/PR res: [0x2b581:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f0d expref: 1478 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.498335:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009cc08160/0x3234de053c4eb69 lrc: 0/0,0 mode: --/PR res: [0x2b581:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f0d expref: 1478 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.498338:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.498339:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.498340:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006b6f07f6/0x3234de053c5081f lrc: 3/0,1 mode: PW/PW res: [0x2b581:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.498343:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b6f07f6/0x3234de053c5081f lrc: 4/0,1 mode: PW/PW res: [0x2b581:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.498347:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1477:41279:x1731746396277056:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 61us (133us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.498351:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.498357:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1477:41279:x1731746396277184:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 33us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.498365:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11870 00000100:00100000:1.0:1651529344.498367:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11871 00010000:00010000:0.0:1651529344.498373:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004b00577e/0x3234de053c50811 lrc: 3/0,1 mode: PW/PW res: [0x2b57f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.498374:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000127428a6/0x3234de053c50818 lrc: 3/0,1 mode: PW/PW res: [0x2b580:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.498377:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000127428a6/0x3234de053c50818 lrc: 3/0,1 mode: PW/PW res: [0x2b580:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.498377:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b00577e/0x3234de053c50811 lrc: 3/0,1 mode: PW/PW res: [0x2b57f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.498380:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000127428a6/0x3234de053c50818 lrc: 3/0,1 mode: PW/PW res: [0x2b580:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.498380:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b00577e/0x3234de053c50811 lrc: 3/0,1 mode: PW/PW res: [0x2b57f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.498383:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000127428a6/0x3234de053c50818 lrc: 2/0,0 mode: PW/PW res: [0x2b580:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.498383:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b00577e/0x3234de053c50811 lrc: 2/0,0 mode: PW/PW res: [0x2b57f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.498423:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+590:39030:x1731745946396032:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1094us (1207us total) trans 12885079142 rc 0/0 00000100:00100000:1.0:1651529344.498426:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211088 00000100:00100000:0.0:1651529344.498432:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+589:39029:x1731745946395968:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1143us (1248us total) trans 12885079143 rc 0/0 00000100:00100000:0.0:1651529344.498435:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211087 00010000:00010000:0.0:1651529344.498443:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000127428a6/0x3234de053c50818 lrc: 2/0,0 mode: PW/PW res: [0x2b580:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.498446:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000127428a6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.498447:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000127428a6/0x3234de053c50818 lrc: 2/0,0 mode: PW/PW res: [0x2b580:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.498450:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000127428a6/0x3234de053c50818 lrc: 3/0,0 mode: PW/PW res: [0x2b580:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.498454:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000127428a6/0x3234de053c50818 lrc: 1/0,0 mode: --/PW res: [0x2b580:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.498464:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000127428a6/0x3234de053c50818 lrc: 0/0,0 mode: --/PW res: [0x2b580:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.498469:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b00577e/0x3234de053c50811 lrc: 2/0,0 mode: PW/PW res: [0x2b57f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.498471:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004b00577e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.498472:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b00577e/0x3234de053c50811 lrc: 2/0,0 mode: PW/PW res: [0x2b57f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.498477:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b00577e/0x3234de053c50811 lrc: 3/0,0 mode: PW/PW res: [0x2b57f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.498481:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b00577e/0x3234de053c50811 lrc: 1/0,0 mode: --/PW res: [0x2b57f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.498483:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b00577e/0x3234de053c50811 lrc: 0/0,0 mode: --/PW res: [0x2b57f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.498489:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006b6f07f6/0x3234de053c5081f lrc: 3/0,1 mode: PW/PW res: [0x2b581:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.498492:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b6f07f6/0x3234de053c5081f lrc: 3/0,1 mode: PW/PW res: [0x2b581:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.498494:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b6f07f6/0x3234de053c5081f lrc: 3/0,1 mode: PW/PW res: [0x2b581:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.498497:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b6f07f6/0x3234de053c5081f lrc: 2/0,0 mode: PW/PW res: [0x2b581:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.498527:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000913beefe pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996976512:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.498532:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000af439eec/0x3234de053c5082d lrc: 3/0,1 mode: --/PW res: [0x2b584:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.498538:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+589:39029:x1731745946396096:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 811us (868us total) trans 12885079144 rc 0/0 00000100:00100000:0.0:1651529344.498541:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211089 00000100:00100000:1.0:1651529344.498544:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004bb67ba4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996976640:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.498547:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f9ae0c20/0x3234de053c50834 lrc: 3/0,1 mode: --/PW res: [0x2b583:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.498548:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b6f07f6/0x3234de053c5081f lrc: 2/0,0 mode: PW/PW res: [0x2b581:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.498554:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006b6f07f6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.498555:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b6f07f6/0x3234de053c5081f lrc: 2/0,0 mode: PW/PW res: [0x2b581:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.498558:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b6f07f6/0x3234de053c5081f lrc: 3/0,0 mode: PW/PW res: [0x2b581:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.498562:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b6f07f6/0x3234de053c5081f lrc: 1/0,0 mode: --/PW res: [0x2b581:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.498565:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b6f07f6/0x3234de053c5081f lrc: 0/0,0 mode: --/PW res: [0x2b581:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.498575:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996976576:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.498578:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50826 lrc: 3/0,1 mode: --/PW res: [0x2b582:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.498673:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.498687:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996976704:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.498691:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c5083b lrc: 3/0,1 mode: --/PW res: [0x2b585:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.498700:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.498710:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946396992 00000100:00100000:1.0:1651529344.498717:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.498718:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211095 00000100:00100000:0.0:1651529344.498720:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+589:39029:x1731745946396992:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.498725:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177543 count 1 00010000:00010000:0.0:1651529344.498729:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c50849 lrc: 3/0,1 mode: --/PW res: [0x2b587:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.498732:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.498742:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001167a6a1/0x3234de053c4f02b lrc: 2/0,0 mode: PR/PR res: [0x2b587:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7365 expref: 1475 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.498746:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.498747:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.498748:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c50849 lrc: 4/0,1 mode: --/PW res: [0x2b587:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.498750:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.498754:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001167a6a1/0x3234de053c4f02b lrc: 3/0,0 mode: PR/PR res: [0x2b587:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7365 expref: 1475 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.498757:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.498758:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001167a6a1/0x3234de053c4f02b lrc: 4/0,0 mode: PR/PR res: [0x2b587:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7365 expref: 1475 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.498762:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996976832:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.498764:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.498777:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed830649 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.498789:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946397056 00000100:00100000:0.0:1651529344.498798:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946397120 00000100:00100000:0.0:1651529344.498805:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211096 00000100:00100000:0.0:1651529344.498806:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+591:39030:x1731745946397056:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.498811:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177544 count 1 00010000:00010000:0.0:1651529344.498815:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042c8316b/0x3234de053c50850 lrc: 3/0,1 mode: --/PW res: [0x2b588:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.498819:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e49b7254/0x3234de053c4df92 lrc: 2/0,0 mode: PR/PR res: [0x2b588:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f4f expref: 1475 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.498823:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211097 00000100:00100000:1.0:1651529344.498825:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+591:39029:x1731745946397120:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.498831:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177545 count 1 00010000:00010000:1.0:1651529344.498835:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000def1c022/0x3234de053c50857 lrc: 3/0,1 mode: --/PW res: [0x2b589:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.498842:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.498842:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.498843:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042c8316b/0x3234de053c50850 lrc: 4/0,1 mode: --/PW res: [0x2b588:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.498846:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008b9a0cb0/0x3234de053c4da8a lrc: 2/0,0 mode: PR/PR res: [0x2b589:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a9c expref: 1475 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.498849:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.498850:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.498851:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000def1c022/0x3234de053c50857 lrc: 4/0,1 mode: --/PW res: [0x2b589:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.498851:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e49b7254/0x3234de053c4df92 lrc: 3/0,0 mode: PR/PR res: [0x2b588:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f4f expref: 1475 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.498854:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e49b7254/0x3234de053c4df92 lrc: 4/0,0 mode: PR/PR res: [0x2b588:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f4f expref: 1475 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.498858:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008b9a0cb0/0x3234de053c4da8a lrc: 3/0,0 mode: PR/PR res: [0x2b589:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a9c expref: 1475 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.498858:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996976896:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.498861:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008b9a0cb0/0x3234de053c4da8a lrc: 4/0,0 mode: PR/PR res: [0x2b589:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a9c expref: 1475 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.498865:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004534b316 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996976960:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.498866:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000000a4def41 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.498872:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396277696 00000100:00100000:1.0:1651529344.498874:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000567ee0ef going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.498876:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000adf66056/0x3234de053c4e622 lrc: 4/0,0 mode: PR/PR res: [0x2b584:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d499d expref: 1476 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.498880:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396277824 00000100:00100000:0.0:1651529344.498882:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396277760 00010000:00010000:0.0:1651529344.498884:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000015c2e928/0x3234de053c4a8e2 lrc: 4/0,0 mode: PR/PR res: [0x2b582:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbce0 expref: 1478 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.498885:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000062afab89/0x3234de053c4cc8a lrc: 4/0,0 mode: PR/PR res: [0x2b583:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce3f3 expref: 1478 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.498888:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11872 00000100:00100000:0.0:1651529344.498889:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1478:41278:x1731746396277696:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.498892:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.498893:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396277888 00010000:00010000:1.0:1651529344.498895:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c986e355/0x3234de053c4ed1b lrc: 4/0,0 mode: PR/PR res: [0x2b585:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d663e expref: 1479 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.498900:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11873 00000100:00100000:1.0:1651529344.498902:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1479:41279:x1731746396277760:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.498904:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.498906:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000015c2e928/0x3234de053c4a8e2 lrc: 4/0,0 mode: PR/PR res: [0x2b582:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbce0 expref: 1479 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.498908:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000adf66056/0x3234de053c4e622 lrc: 4/0,0 mode: PR/PR res: [0x2b584:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d499d expref: 1479 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.498909:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000015c2e928/0x3234de053c4a8e2 lrc: 3/0,0 mode: PR/PR res: [0x2b582:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbce0 expref: 1479 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.498913:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000adf66056/0x3234de053c4e622 lrc: 3/0,0 mode: PR/PR res: [0x2b584:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d499d expref: 1479 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.498915:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015c2e928/0x3234de053c4a8e2 lrc: 0/0,0 mode: --/PR res: [0x2b582:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbce0 expref: 1479 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.498918:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.498918:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000adf66056/0x3234de053c4e622 lrc: 0/0,0 mode: --/PR res: [0x2b584:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d499d expref: 1478 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.498919:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.498920:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50826 lrc: 3/0,1 mode: PW/PW res: [0x2b582:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.498922:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.498923:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50826 lrc: 4/0,1 mode: PW/PW res: [0x2b582:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.498923:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.498924:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000af439eec/0x3234de053c5082d lrc: 3/0,1 mode: PW/PW res: [0x2b584:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.498927:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af439eec/0x3234de053c5082d lrc: 4/0,1 mode: PW/PW res: [0x2b584:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.498934:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.498940:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1477:41279:x1731746396277760:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 38us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.498943:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11873 00000100:00100000:1.0:1651529344.498948:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11874 00000100:00100000:1.0:1651529344.498949:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1476:41278:x1731746396277824:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.498952:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.498958:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.498960:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000062afab89/0x3234de053c4cc8a lrc: 4/0,0 mode: PR/PR res: [0x2b583:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce3f3 expref: 1476 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.498961:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1476:41278:x1731746396277696:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 70us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.498963:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11872 00010000:00010000:1.0:1651529344.498964:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000062afab89/0x3234de053c4cc8a lrc: 3/0,0 mode: PR/PR res: [0x2b583:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce3f3 expref: 1476 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.498968:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062afab89/0x3234de053c4cc8a lrc: 0/0,0 mode: --/PR res: [0x2b583:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce3f3 expref: 1475 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.498969:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11875 00000100:00100000:0.0:1651529344.498971:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7bfdb64 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1475:41279:x1731746396277888:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.498972:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.498973:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.498973:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f9ae0c20/0x3234de053c50834 lrc: 3/0,1 mode: PW/PW res: [0x2b583:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.498973:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.498975:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c986e355/0x3234de053c4ed1b lrc: 4/0,0 mode: PR/PR res: [0x2b585:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d663e expref: 1474 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.498976:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9ae0c20/0x3234de053c50834 lrc: 4/0,1 mode: PW/PW res: [0x2b583:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.498979:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c986e355/0x3234de053c4ed1b lrc: 3/0,0 mode: PR/PR res: [0x2b585:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d663e expref: 1474 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.498982:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.498984:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c986e355/0x3234de053c4ed1b lrc: 0/0,0 mode: --/PR res: [0x2b585:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d663e expref: 1474 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.498987:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1473:41278:x1731746396277824:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (255us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.498988:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.498988:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.498989:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c5083b lrc: 3/0,1 mode: PW/PW res: [0x2b585:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.498990:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11874 00010000:00010000:0.0:1651529344.498992:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c5083b lrc: 4/0,1 mode: PW/PW res: [0x2b585:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.498999:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000af439eec/0x3234de053c5082d lrc: 3/0,1 mode: PW/PW res: [0x2b584:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.498999:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.499002:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af439eec/0x3234de053c5082d lrc: 3/0,1 mode: PW/PW res: [0x2b584:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.499004:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7bfdb64 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1472:41279:x1731746396277888:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (240us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.499005:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af439eec/0x3234de053c5082d lrc: 3/0,1 mode: PW/PW res: [0x2b584:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.499006:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11875 00010000:00010000:1.0:1651529344.499008:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af439eec/0x3234de053c5082d lrc: 2/0,0 mode: PW/PW res: [0x2b584:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499024:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c5083b lrc: 3/0,1 mode: PW/PW res: [0x2b585:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499027:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c5083b lrc: 3/0,1 mode: PW/PW res: [0x2b585:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499030:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c5083b lrc: 3/0,1 mode: PW/PW res: [0x2b585:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499033:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c5083b lrc: 2/0,0 mode: PW/PW res: [0x2b585:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.499053:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+592:39029:x1731745946396736:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1039us (1095us total) trans 12885079145 rc 0/0 00000100:00100000:1.0:1651529344.499056:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211091 00010000:00010000:1.0:1651529344.499062:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f9ae0c20/0x3234de053c50834 lrc: 3/0,1 mode: PW/PW res: [0x2b583:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.499066:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9ae0c20/0x3234de053c50834 lrc: 3/0,1 mode: PW/PW res: [0x2b583:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.499069:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9ae0c20/0x3234de053c50834 lrc: 3/0,1 mode: PW/PW res: [0x2b583:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.499071:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9ae0c20/0x3234de053c50834 lrc: 2/0,0 mode: PW/PW res: [0x2b583:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.499076:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+592:39030:x1731745946396800:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 988us (1105us total) trans 12885079146 rc 0/0 00000100:00100000:0.0:1651529344.499086:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211093 00010000:00010000:0.0:1651529344.499093:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af439eec/0x3234de053c5082d lrc: 2/0,0 mode: PW/PW res: [0x2b584:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499097:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000af439eec already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.499098:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af439eec/0x3234de053c5082d lrc: 2/0,0 mode: PW/PW res: [0x2b584:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499101:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af439eec/0x3234de053c5082d lrc: 3/0,0 mode: PW/PW res: [0x2b584:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499105:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af439eec/0x3234de053c5082d lrc: 1/0,0 mode: --/PW res: [0x2b584:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.499108:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+592:39030:x1731745946396672:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1031us (1144us total) trans 12885079147 rc 0/0 00010000:00010000:0.0:1651529344.499108:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af439eec/0x3234de053c5082d lrc: 0/0,0 mode: --/PW res: [0x2b584:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499112:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c5083b lrc: 2/0,0 mode: PW/PW res: [0x2b585:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.499113:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211092 00010000:00010000:0.0:1651529344.499115:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000048c07243 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.499116:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c5083b lrc: 2/0,0 mode: PW/PW res: [0x2b585:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499121:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c5083b lrc: 3/0,0 mode: PW/PW res: [0x2b585:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499124:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c5083b lrc: 1/0,0 mode: --/PW res: [0x2b585:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499126:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c5083b lrc: 0/0,0 mode: --/PW res: [0x2b585:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.499128:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.499130:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9ae0c20/0x3234de053c50834 lrc: 2/0,0 mode: PW/PW res: [0x2b583:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499132:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f9ae0c20 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.499133:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9ae0c20/0x3234de053c50834 lrc: 2/0,0 mode: PW/PW res: [0x2b583:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499135:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9ae0c20/0x3234de053c50834 lrc: 3/0,0 mode: PW/PW res: [0x2b583:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499139:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9ae0c20/0x3234de053c50834 lrc: 1/0,0 mode: --/PW res: [0x2b583:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499141:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9ae0c20/0x3234de053c50834 lrc: 0/0,0 mode: --/PW res: [0x2b583:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.499158:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996976832:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.499163:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c50849 lrc: 3/0,1 mode: --/PW res: [0x2b587:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.499166:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.499168:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50826 lrc: 3/0,1 mode: PW/PW res: [0x2b582:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499176:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50826 lrc: 3/0,1 mode: PW/PW res: [0x2b582:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499179:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50826 lrc: 3/0,1 mode: PW/PW res: [0x2b582:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499182:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50826 lrc: 2/0,0 mode: PW/PW res: [0x2b582:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.499218:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+592:39030:x1731745946396608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1214us (1272us total) trans 12885079148 rc 0/0 00000100:00100000:0.0:1651529344.499221:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211090 00010000:00010000:0.0:1651529344.499274:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50826 lrc: 2/0,0 mode: PW/PW res: [0x2b582:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499287:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e0e037e6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.499289:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50826 lrc: 2/0,0 mode: PW/PW res: [0x2b582:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499292:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50826 lrc: 3/0,0 mode: PW/PW res: [0x2b582:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499299:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50826 lrc: 1/0,0 mode: --/PW res: [0x2b582:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499302:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50826 lrc: 0/0,0 mode: --/PW res: [0x2b582:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.499306:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396278016 00000100:00100000:0.0:1651529344.499311:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396278080 00010000:00010000:1.0:1651529344.499312:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000094bb6891/0x3234de053c4d4a9 lrc: 5/0,0 mode: PR/PR res: [0x2b586:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d04a0 expref: 1473 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.499315:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001167a6a1/0x3234de053c4f02b lrc: 4/0,0 mode: PR/PR res: [0x2b587:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7365 expref: 1473 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.499321:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11876 00000100:00100000:1.0:1651529344.499322:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1473:41278:x1731746396278016:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.499327:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11877 00010000:00010000:1.0:1651529344.499331:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.499333:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000094bb6891/0x3234de053c4d4a9 lrc: 5/0,0 mode: PR/PR res: [0x2b586:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d04a0 expref: 1473 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.499337:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000094bb6891/0x3234de053c4d4a9 lrc: 4/0,0 mode: PR/PR res: [0x2b586:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d04a0 expref: 1473 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.499341:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1473:41278:x1731746396278080:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.499342:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.499343:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.499344:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000a146a8b/0x3234de053c50842 lrc: 3/0,1 mode: PW/PW res: [0x2b586:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499344:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.499346:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001167a6a1/0x3234de053c4f02b lrc: 4/0,0 mode: PR/PR res: [0x2b587:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7365 expref: 1473 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.499347:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a146a8b/0x3234de053c50842 lrc: 4/0,1 mode: PW/PW res: [0x2b586:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.499352:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.499364:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001167a6a1/0x3234de053c4f02b lrc: 3/0,0 mode: PR/PR res: [0x2b587:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7365 expref: 1473 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.499366:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1473:41278:x1731746396278016:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 43us (238us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.499369:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001167a6a1/0x3234de053c4f02b lrc: 0/0,0 mode: --/PR res: [0x2b587:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7365 expref: 1473 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.499371:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11876 00010000:00010000:0.0:1651529344.499373:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.499374:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.499375:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c50849 lrc: 3/0,1 mode: PW/PW res: [0x2b587:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.499387:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.499391:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c50849 lrc: 4/0,1 mode: PW/PW res: [0x2b587:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499403:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.499411:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1471:41278:x1731746396278080:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 70us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.499414:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11877 00010000:00010000:0.0:1651529344.499421:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c50849 lrc: 3/0,1 mode: PW/PW res: [0x2b587:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499451:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c50849 lrc: 3/0,1 mode: PW/PW res: [0x2b587:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499455:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c50849 lrc: 3/0,1 mode: PW/PW res: [0x2b587:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499458:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c50849 lrc: 2/0,0 mode: PW/PW res: [0x2b587:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.499461:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.499470:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.499483:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004534b316 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996976960:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.499487:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000def1c022/0x3234de053c50857 lrc: 3/0,1 mode: --/PW res: [0x2b589:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.499493:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946397184 00000100:00100000:1.0:1651529344.499504:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946397312 00000100:00100000:1.0:1651529344.499507:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946397248 00000100:00100000:1.0:1651529344.499511:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211098 00000100:00100000:1.0:1651529344.499513:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+595:39030:x1731745946397184:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.499518:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177546 count 1 00010000:00010000:1.0:1651529344.499522:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be4c8fe2/0x3234de053c5085e lrc: 3/0,1 mode: --/PW res: [0x2b58a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.499526:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e0e6728c/0x3234de053c4d6bd lrc: 2/0,0 mode: PR/PR res: [0x2b58a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0cb1 expref: 1470 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.499529:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.499529:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.499530:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be4c8fe2/0x3234de053c5085e lrc: 4/0,1 mode: --/PW res: [0x2b58a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.499531:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+595:39029:x1731745946396992:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 810us (858us total) trans 12885079149 rc 0/0 00000100:00100000:0.0:1651529344.499534:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211095 00010000:00010000:1.0:1651529344.499536:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e0e6728c/0x3234de053c4d6bd lrc: 3/0,0 mode: PR/PR res: [0x2b58a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0cb1 expref: 1470 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.499543:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e0e6728c/0x3234de053c4d6bd lrc: 4/0,0 mode: PR/PR res: [0x2b58a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0cb1 expref: 1470 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.499547:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004534b316 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996977024:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.499552:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211099 00000100:00100000:0.0:1651529344.499554:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+594:39030:x1731745946397312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.499555:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b52d0f36 going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.499560:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177548 count 1 00000100:00100000:1.0:1651529344.499562:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211100 00000100:00100000:1.0:1651529344.499563:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000083ef9200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+594:39030:x1731745946397248:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.499564:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c50865 lrc: 3/0,1 mode: --/PW res: [0x2b58c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.499567:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177547 count 1 00010000:00010000:0.0:1651529344.499568:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d11dbc49/0x3234de053c4d853 lrc: 2/0,0 mode: PR/PR res: [0x2b58c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1268 expref: 1470 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.499571:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ce7109a/0x3234de053c5086c lrc: 3/0,1 mode: --/PW res: [0x2b58b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499572:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.499572:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.499573:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c50865 lrc: 4/0,1 mode: --/PW res: [0x2b58c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.499575:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dbc20a1f/0x3234de053c4e891 lrc: 2/0,0 mode: PR/PR res: [0x2b58b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5328 expref: 1470 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.499578:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.499579:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.499579:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ce7109a/0x3234de053c5086c lrc: 4/0,1 mode: --/PW res: [0x2b58b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499580:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d11dbc49/0x3234de053c4d853 lrc: 3/0,0 mode: PR/PR res: [0x2b58c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1268 expref: 1470 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.499583:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d11dbc49/0x3234de053c4d853 lrc: 4/0,0 mode: PR/PR res: [0x2b58c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1268 expref: 1470 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.499585:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dbc20a1f/0x3234de053c4e891 lrc: 3/0,0 mode: PR/PR res: [0x2b58b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5328 expref: 1470 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.499587:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996977088:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.499588:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dbc20a1f/0x3234de053c4e891 lrc: 4/0,0 mode: PR/PR res: [0x2b58b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5328 expref: 1470 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.499595:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d28c414b pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996977152:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.499596:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 0000000070e666f7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.499601:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 0000000057299e7f going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.499601:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c50849 lrc: 2/0,0 mode: PW/PW res: [0x2b587:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499604:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000fe54815 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.499605:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c50849 lrc: 2/0,0 mode: PW/PW res: [0x2b587:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499608:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c50849 lrc: 3/0,0 mode: PW/PW res: [0x2b587:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.499614:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.499615:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c50849 lrc: 1/0,0 mode: --/PW res: [0x2b587:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499618:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000fe54815/0x3234de053c50849 lrc: 0/0,0 mode: --/PW res: [0x2b587:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.499642:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996976896:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.499645:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000042c8316b/0x3234de053c50850 lrc: 3/0,1 mode: --/PW res: [0x2b588:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.499652:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.499652:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396278144 00010000:00010000:0.0:1651529344.499664:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e49b7254/0x3234de053c4df92 lrc: 4/0,0 mode: PR/PR res: [0x2b588:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f4f expref: 1471 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.499674:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11878 00000100:00100000:0.0:1651529344.499676:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1471:41279:x1731746396278144:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.499679:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.499680:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e49b7254/0x3234de053c4df92 lrc: 4/0,0 mode: PR/PR res: [0x2b588:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f4f expref: 1471 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.499684:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e49b7254/0x3234de053c4df92 lrc: 3/0,0 mode: PR/PR res: [0x2b588:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f4f expref: 1471 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.499688:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.499689:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e49b7254/0x3234de053c4df92 lrc: 0/0,0 mode: --/PR res: [0x2b588:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f4f expref: 1471 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.499695:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.499695:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.499696:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000042c8316b/0x3234de053c50850 lrc: 3/0,1 mode: PW/PW res: [0x2b588:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499699:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042c8316b/0x3234de053c50850 lrc: 4/0,1 mode: PW/PW res: [0x2b588:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499705:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.499715:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1470:41279:x1731746396278144:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 39us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.499718:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11878 00000100:00100000:0.0:1651529344.499723:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396278208 00010000:00010000:0.0:1651529344.499726:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008b9a0cb0/0x3234de053c4da8a lrc: 4/0,0 mode: PR/PR res: [0x2b589:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a9c expref: 1470 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.499742:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11879 00000100:00100000:0.0:1651529344.499744:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1470:41278:x1731746396278208:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.499747:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.499748:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008b9a0cb0/0x3234de053c4da8a lrc: 4/0,0 mode: PR/PR res: [0x2b589:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a9c expref: 1470 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.499751:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008b9a0cb0/0x3234de053c4da8a lrc: 3/0,0 mode: PR/PR res: [0x2b589:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a9c expref: 1470 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.499756:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b9a0cb0/0x3234de053c4da8a lrc: 0/0,0 mode: --/PR res: [0x2b589:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a9c expref: 1470 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.499760:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.499761:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.499761:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000def1c022/0x3234de053c50857 lrc: 3/0,1 mode: PW/PW res: [0x2b589:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499764:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000def1c022/0x3234de053c50857 lrc: 4/0,1 mode: PW/PW res: [0x2b589:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499772:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.499775:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000def1c022/0x3234de053c50857 lrc: 3/0,1 mode: PW/PW res: [0x2b589:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.499781:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1469:41278:x1731746396278208:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 37us (94us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.499784:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000def1c022/0x3234de053c50857 lrc: 3/0,1 mode: PW/PW res: [0x2b589:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.499787:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000def1c022/0x3234de053c50857 lrc: 3/0,1 mode: PW/PW res: [0x2b589:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.499790:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000def1c022/0x3234de053c50857 lrc: 2/0,0 mode: PW/PW res: [0x2b589:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.499813:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11879 00010000:00010000:0.0:1651529344.499820:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000def1c022/0x3234de053c50857 lrc: 2/0,0 mode: PW/PW res: [0x2b589:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499823:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000def1c022 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.499824:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000def1c022/0x3234de053c50857 lrc: 2/0,0 mode: PW/PW res: [0x2b589:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499827:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000def1c022/0x3234de053c50857 lrc: 3/0,0 mode: PW/PW res: [0x2b589:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499832:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000def1c022/0x3234de053c50857 lrc: 1/0,0 mode: --/PW res: [0x2b589:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499834:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000def1c022/0x3234de053c50857 lrc: 0/0,0 mode: --/PW res: [0x2b589:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.499837:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+595:39029:x1731745946397120:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1012us (1087us total) trans 12885079150 rc 0/0 00000100:00100000:1.0:1651529344.499840:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211097 00010000:00010000:0.0:1651529344.499842:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000042c8316b/0x3234de053c50850 lrc: 3/0,1 mode: PW/PW res: [0x2b588:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499845:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042c8316b/0x3234de053c50850 lrc: 3/0,1 mode: PW/PW res: [0x2b588:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.499846:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946397376 00010000:00010000:0.0:1651529344.499848:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042c8316b/0x3234de053c50850 lrc: 3/0,1 mode: PW/PW res: [0x2b588:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499851:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042c8316b/0x3234de053c50850 lrc: 2/0,0 mode: PW/PW res: [0x2b588:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.499856:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211101 00000100:00100000:1.0:1651529344.499858:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+595:39029:x1731745946397376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.499863:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177549 count 1 00010000:00010000:1.0:1651529344.499867:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50873 lrc: 3/0,1 mode: --/PW res: [0x2b58d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.499872:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ed010906/0x3234de053c4da4b lrc: 2/0,0 mode: PR/PR res: [0x2b58d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1992 expref: 1468 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.499875:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.499875:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.499876:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50873 lrc: 4/0,1 mode: --/PW res: [0x2b58d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.499883:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ed010906/0x3234de053c4da4b lrc: 3/0,0 mode: PR/PR res: [0x2b58d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1992 expref: 1468 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.499886:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ed010906/0x3234de053c4da4b lrc: 4/0,0 mode: PR/PR res: [0x2b58d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1992 expref: 1468 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.499890:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d6486d55 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996977216:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.499894:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+596:39030:x1731745946397056:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1087us (1177us total) trans 12885079151 rc 0/0 00000100:00100000:0.0:1651529344.499897:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211096 00000100:00100000:1.0:1651529344.499898:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 0000000018ebe812 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.499904:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042c8316b/0x3234de053c50850 lrc: 2/0,0 mode: PW/PW res: [0x2b588:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499907:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042c8316b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.499908:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042c8316b/0x3234de053c50850 lrc: 2/0,0 mode: PW/PW res: [0x2b588:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499911:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042c8316b/0x3234de053c50850 lrc: 3/0,0 mode: PW/PW res: [0x2b588:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.499912:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.499915:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042c8316b/0x3234de053c50850 lrc: 1/0,0 mode: --/PW res: [0x2b588:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499925:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042c8316b/0x3234de053c50850 lrc: 0/0,0 mode: --/PW res: [0x2b588:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.499932:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946397952 00000100:00100000:0.0:1651529344.499943:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211102 00000100:00100000:0.0:1651529344.499944:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+596:39029:x1731745946397952:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.499949:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177550 count 1 00010000:00010000:0.0:1651529344.499953:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e92ebc3c/0x3234de053c5087a lrc: 3/0,1 mode: --/PW res: [0x2b58e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499957:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009f5bb852/0x3234de053c4e4ee lrc: 2/0,0 mode: PR/PR res: [0x2b58e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d44f7 expref: 1468 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.499960:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.499961:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.499962:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e92ebc3c/0x3234de053c5087a lrc: 4/0,1 mode: --/PW res: [0x2b58e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.499989:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009f5bb852/0x3234de053c4e4ee lrc: 3/0,0 mode: PR/PR res: [0x2b58e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d44f7 expref: 1468 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.499993:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009f5bb852/0x3234de053c4e4ee lrc: 4/0,0 mode: PR/PR res: [0x2b58e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d44f7 expref: 1468 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.500005:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.500018:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996977280:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.500033:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 000000000a4def41 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.500043:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996977088:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.500044:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.500046:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c50865 lrc: 3/0,1 mode: --/PW res: [0x2b58c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500054:0:156655:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094bb6891/0x3234de053c4d4a9 lrc: 0/0,0 mode: --/PR res: [0x2b586:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d04a0 expref: 1468 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.500058:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996976768:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.500060:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000a146a8b/0x3234de053c50842 lrc: 3/0,1 mode: PW/PW res: [0x2b586:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500063:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000a146a8b/0x3234de053c50842 lrc: 3/0,1 mode: PW/PW res: [0x2b586:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500066:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a146a8b/0x3234de053c50842 lrc: 3/0,1 mode: PW/PW res: [0x2b586:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500069:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a146a8b/0x3234de053c50842 lrc: 3/0,1 mode: PW/PW res: [0x2b586:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500072:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a146a8b/0x3234de053c50842 lrc: 2/0,0 mode: PW/PW res: [0x2b586:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.500074:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.500084:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004534b316 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996977024:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.500088:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000be4c8fe2/0x3234de053c5085e lrc: 3/0,1 mode: --/PW res: [0x2b58a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.500095:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d28c414b pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996977152:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.500099:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007ce7109a/0x3234de053c5086c lrc: 3/0,1 mode: --/PW res: [0x2b58b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.500104:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396278272 00010000:00010000:1.0:1651529344.500116:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e6728c/0x3234de053c4d6bd lrc: 4/0,0 mode: PR/PR res: [0x2b58a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0cb1 expref: 1468 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.500123:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396278336 00010000:00010000:1.0:1651529344.500125:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d11dbc49/0x3234de053c4d853 lrc: 4/0,0 mode: PR/PR res: [0x2b58c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1268 expref: 1469 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.500129:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396278400 00010000:00010000:1.0:1651529344.500131:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dbc20a1f/0x3234de053c4e891 lrc: 4/0,0 mode: PR/PR res: [0x2b58b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5328 expref: 1470 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.500132:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+597:39029:x1731745946396864:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1942us (1968us total) trans 12885079152 rc 0/0 00000100:00100000:0.0:1651529344.500135:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211094 00000100:00100000:1.0:1651529344.500136:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11880 00000100:00100000:1.0:1651529344.500137:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1470:41279:x1731746396278272:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.500140:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.500141:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e0e6728c/0x3234de053c4d6bd lrc: 4/0,0 mode: PR/PR res: [0x2b58a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0cb1 expref: 1470 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.500142:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a146a8b/0x3234de053c50842 lrc: 2/0,0 mode: PW/PW res: [0x2b586:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.500145:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e0e6728c/0x3234de053c4d6bd lrc: 3/0,0 mode: PR/PR res: [0x2b58a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0cb1 expref: 1470 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.500146:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000a146a8b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.500147:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a146a8b/0x3234de053c50842 lrc: 2/0,0 mode: PW/PW res: [0x2b586:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.500150:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0e6728c/0x3234de053c4d6bd lrc: 0/0,0 mode: --/PR res: [0x2b58a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0cb1 expref: 1470 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.500150:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a146a8b/0x3234de053c50842 lrc: 3/0,0 mode: PW/PW res: [0x2b586:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500154:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a146a8b/0x3234de053c50842 lrc: 1/0,0 mode: --/PW res: [0x2b586:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.500156:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.500157:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.500157:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a146a8b/0x3234de053c50842 lrc: 0/0,0 mode: --/PW res: [0x2b586:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.500158:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000be4c8fe2/0x3234de053c5085e lrc: 3/0,1 mode: PW/PW res: [0x2b58a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.500161:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be4c8fe2/0x3234de053c5085e lrc: 4/0,1 mode: PW/PW res: [0x2b58a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.500164:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11881 00000100:00100000:0.0:1651529344.500166:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1469:41279:x1731746396278336:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.500167:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.500169:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.500171:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d11dbc49/0x3234de053c4d853 lrc: 4/0,0 mode: PR/PR res: [0x2b58c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1268 expref: 1469 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.500174:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1469:41279:x1731746396278272:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 36us (169us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.500174:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d11dbc49/0x3234de053c4d853 lrc: 3/0,0 mode: PR/PR res: [0x2b58c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1268 expref: 1469 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.500177:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11880 00010000:00010000:0.0:1651529344.500179:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d11dbc49/0x3234de053c4d853 lrc: 0/0,0 mode: --/PR res: [0x2b58c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1268 expref: 1468 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.500181:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11882 00000100:00100000:1.0:1651529344.500183:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031e6b9e0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1468:41279:x1731746396278400:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.500185:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.500185:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.500186:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dbc20a1f/0x3234de053c4e891 lrc: 4/0,0 mode: PR/PR res: [0x2b58b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5328 expref: 1467 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.500186:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.500186:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c50865 lrc: 3/0,1 mode: PW/PW res: [0x2b58c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500189:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c50865 lrc: 4/0,1 mode: PW/PW res: [0x2b58c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.500190:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dbc20a1f/0x3234de053c4e891 lrc: 3/0,0 mode: PR/PR res: [0x2b58b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5328 expref: 1467 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.500194:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dbc20a1f/0x3234de053c4e891 lrc: 0/0,0 mode: --/PR res: [0x2b58b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5328 expref: 1467 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.500195:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.500197:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.500198:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.500199:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007ce7109a/0x3234de053c5086c lrc: 3/0,1 mode: PW/PW res: [0x2b58b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.500202:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ce7109a/0x3234de053c5086c lrc: 4/0,1 mode: PW/PW res: [0x2b58b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.500202:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1466:41279:x1731746396278336:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 35us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.500204:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11881 00010000:00010000:1.0:1651529344.500207:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.500210:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c50865 lrc: 3/0,1 mode: PW/PW res: [0x2b58c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.500212:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031e6b9e0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1465:41279:x1731746396278400:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 29us (139us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.500213:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c50865 lrc: 3/0,1 mode: PW/PW res: [0x2b58c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.500214:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11882 00010000:00010000:0.0:1651529344.500216:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c50865 lrc: 3/0,1 mode: PW/PW res: [0x2b58c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500218:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c50865 lrc: 2/0,0 mode: PW/PW res: [0x2b58c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.500241:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007ce7109a/0x3234de053c5086c lrc: 3/0,1 mode: PW/PW res: [0x2b58b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.500245:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ce7109a/0x3234de053c5086c lrc: 3/0,1 mode: PW/PW res: [0x2b58b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.500248:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ce7109a/0x3234de053c5086c lrc: 3/0,1 mode: PW/PW res: [0x2b58b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.500251:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ce7109a/0x3234de053c5086c lrc: 2/0,0 mode: PW/PW res: [0x2b58b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.500278:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+598:39030:x1731745946397312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 723us (824us total) trans 12885079153 rc 0/0 00000100:00100000:0.0:1651529344.500281:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211099 00010000:00010000:0.0:1651529344.500290:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c50865 lrc: 2/0,0 mode: PW/PW res: [0x2b58c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.500293:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000083ef9200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+597:39030:x1731745946397248:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 729us (822us total) trans 12885079154 rc 0/0 00010000:00010000:0.0:1651529344.500294:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a69b6f5e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.500295:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c50865 lrc: 2/0,0 mode: PW/PW res: [0x2b58c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.500296:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211100 00010000:00010000:0.0:1651529344.500298:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c50865 lrc: 3/0,0 mode: PW/PW res: [0x2b58c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500302:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c50865 lrc: 1/0,0 mode: --/PW res: [0x2b58c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.500303:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000be4c8fe2/0x3234de053c5085e lrc: 3/0,1 mode: PW/PW res: [0x2b58a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500305:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a69b6f5e/0x3234de053c50865 lrc: 0/0,0 mode: --/PW res: [0x2b58c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.500309:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be4c8fe2/0x3234de053c5085e lrc: 3/0,1 mode: PW/PW res: [0x2b58a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500309:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ce7109a/0x3234de053c5086c lrc: 2/0,0 mode: PW/PW res: [0x2b58b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.500312:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be4c8fe2/0x3234de053c5085e lrc: 3/0,1 mode: PW/PW res: [0x2b58a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500312:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007ce7109a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.500313:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ce7109a/0x3234de053c5086c lrc: 2/0,0 mode: PW/PW res: [0x2b58b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.500315:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be4c8fe2/0x3234de053c5085e lrc: 2/0,0 mode: PW/PW res: [0x2b58a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500316:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ce7109a/0x3234de053c5086c lrc: 3/0,0 mode: PW/PW res: [0x2b58b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500319:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ce7109a/0x3234de053c5086c lrc: 1/0,0 mode: --/PW res: [0x2b58b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500330:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ce7109a/0x3234de053c5086c lrc: 0/0,0 mode: --/PW res: [0x2b58b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500334:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be4c8fe2/0x3234de053c5085e lrc: 2/0,0 mode: PW/PW res: [0x2b58a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500337:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000be4c8fe2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.500338:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be4c8fe2/0x3234de053c5085e lrc: 2/0,0 mode: PW/PW res: [0x2b58a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500341:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be4c8fe2/0x3234de053c5085e lrc: 3/0,0 mode: PW/PW res: [0x2b58a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500344:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be4c8fe2/0x3234de053c5085e lrc: 1/0,0 mode: --/PW res: [0x2b58a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500346:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be4c8fe2/0x3234de053c5085e lrc: 0/0,0 mode: --/PW res: [0x2b58a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.500351:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+597:39030:x1731745946397184:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 838us (964us total) trans 12885079155 rc 0/0 00000100:00100000:1.0:1651529344.500354:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211098 00000100:00100000:1.0:1651529344.500380:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.500394:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.500438:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996977280:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.500442:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e92ebc3c/0x3234de053c5087a lrc: 3/0,1 mode: --/PW res: [0x2b58e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.500456:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.500485:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.500512:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396278464 00010000:00010000:1.0:1651529344.500517:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ed010906/0x3234de053c4da4b lrc: 5/0,0 mode: PR/PR res: [0x2b58d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1992 expref: 1465 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.500525:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396278976 00010000:00010000:1.0:1651529344.500527:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009f5bb852/0x3234de053c4e4ee lrc: 4/0,0 mode: PR/PR res: [0x2b58e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d44f7 expref: 1466 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.500536:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11883 00000100:00100000:1.0:1651529344.500538:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1466:41278:x1731746396278464:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.500541:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.500542:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ed010906/0x3234de053c4da4b lrc: 5/0,0 mode: PR/PR res: [0x2b58d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1992 expref: 1466 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.500546:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ed010906/0x3234de053c4da4b lrc: 4/0,0 mode: PR/PR res: [0x2b58d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1992 expref: 1466 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.500552:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.500552:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.500552:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11884 00010000:00010000:1.0:1651529344.500553:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50873 lrc: 3/0,1 mode: PW/PW res: [0x2b58d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.500554:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1466:41278:x1731746396278976:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.500556:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50873 lrc: 4/0,1 mode: PW/PW res: [0x2b58d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500559:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.500561:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.500561:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009f5bb852/0x3234de053c4e4ee lrc: 4/0,0 mode: PR/PR res: [0x2b58e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d44f7 expref: 1466 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.500565:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009f5bb852/0x3234de053c4e4ee lrc: 3/0,0 mode: PR/PR res: [0x2b58e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d44f7 expref: 1466 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.500569:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1466:41278:x1731746396278464:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 31us (113us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.500570:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f5bb852/0x3234de053c4e4ee lrc: 0/0,0 mode: --/PR res: [0x2b58e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d44f7 expref: 1466 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.500572:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11883 00010000:00010000:0.0:1651529344.500574:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.500574:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.500575:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e92ebc3c/0x3234de053c5087a lrc: 3/0,1 mode: PW/PW res: [0x2b58e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.500578:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946398016 00010000:00010000:0.0:1651529344.500578:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e92ebc3c/0x3234de053c5087a lrc: 4/0,1 mode: PW/PW res: [0x2b58e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.500586:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946398080 00000100:00100000:1.0:1651529344.500589:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211103 00000100:00100000:1.0:1651529344.500591:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+598:39030:x1731745946398016:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.500593:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00080000:1.0:1651529344.500596:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177551 count 1 00010000:00010000:1.0:1651529344.500600:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50881 lrc: 3/0,1 mode: --/PW res: [0x2b58f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.500601:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1464:41278:x1731746396278976:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 46us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.500603:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11884 00010000:00010000:1.0:1651529344.500604:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000de7e3b54/0x3234de053c4d98e lrc: 2/0,0 mode: PR/PR res: [0x2b58f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d169e expref: 1464 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.500608:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.500608:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.500609:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50881 lrc: 4/0,1 mode: --/PW res: [0x2b58f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500610:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e92ebc3c/0x3234de053c5087a lrc: 3/0,1 mode: PW/PW res: [0x2b58e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500614:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e92ebc3c/0x3234de053c5087a lrc: 3/0,1 mode: PW/PW res: [0x2b58e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.500615:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000de7e3b54/0x3234de053c4d98e lrc: 3/0,0 mode: PR/PR res: [0x2b58f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d169e expref: 1463 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.500619:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000de7e3b54/0x3234de053c4d98e lrc: 4/0,0 mode: PR/PR res: [0x2b58f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d169e expref: 1463 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.500623:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000999005e pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996977344:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.500632:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 0000000057299e7f going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.500632:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e92ebc3c/0x3234de053c5087a lrc: 3/0,1 mode: PW/PW res: [0x2b58e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500635:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e92ebc3c/0x3234de053c5087a lrc: 2/0,0 mode: PW/PW res: [0x2b58e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.500639:0:80276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed010906/0x3234de053c4da4b lrc: 0/0,0 mode: --/PR res: [0x2b58d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1992 expref: 1463 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.500643:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d6486d55 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996977216:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.500647:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50873 lrc: 3/0,1 mode: PW/PW res: [0x2b58d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.500650:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50873 lrc: 3/0,1 mode: PW/PW res: [0x2b58d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.500653:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50873 lrc: 3/0,1 mode: PW/PW res: [0x2b58d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.500658:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50873 lrc: 3/0,1 mode: PW/PW res: [0x2b58d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.500661:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50873 lrc: 2/0,0 mode: PW/PW res: [0x2b58d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.500691:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+600:39029:x1731745946397952:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 746us (778us total) trans 12885079156 rc 0/0 00000100:00100000:0.0:1651529344.500694:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211102 00000100:00100000:0.0:1651529344.500699:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211104 00000100:00100000:0.0:1651529344.500701:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+599:39029:x1731745946398080:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.500703:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+599:39029:x1731745946397376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 844us (1051us total) trans 12885079157 rc 0/0 00002000:00080000:0.0:1651529344.500705:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177552 count 1 00000100:00100000:1.0:1651529344.500706:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211101 00010000:00010000:0.0:1651529344.500709:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3202904/0x3234de053c50888 lrc: 3/0,1 mode: --/PW res: [0x2b590:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500714:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f2323f96/0x3234de053c4d7ff lrc: 2/0,0 mode: PR/PR res: [0x2b590:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1134 expref: 1462 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.500717:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.500718:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.500718:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3202904/0x3234de053c50888 lrc: 4/0,1 mode: --/PW res: [0x2b590:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500725:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f2323f96/0x3234de053c4d7ff lrc: 3/0,0 mode: PR/PR res: [0x2b590:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1134 expref: 1462 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.500731:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f2323f96/0x3234de053c4d7ff lrc: 4/0,0 mode: PR/PR res: [0x2b590:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1134 expref: 1462 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.500745:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996977408:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.500748:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.500754:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000009370c1d going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.500759:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e92ebc3c/0x3234de053c5087a lrc: 2/0,0 mode: PW/PW res: [0x2b58e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.500763:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.500763:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e92ebc3c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.500764:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e92ebc3c/0x3234de053c5087a lrc: 2/0,0 mode: PW/PW res: [0x2b58e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500766:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e92ebc3c/0x3234de053c5087a lrc: 3/0,0 mode: PW/PW res: [0x2b58e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500771:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e92ebc3c/0x3234de053c5087a lrc: 1/0,0 mode: --/PW res: [0x2b58e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.500773:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.500774:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e92ebc3c/0x3234de053c5087a lrc: 0/0,0 mode: --/PW res: [0x2b58e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500785:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50873 lrc: 2/0,0 mode: PW/PW res: [0x2b58d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500788:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eb50e2ae already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.500789:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.500789:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50873 lrc: 2/0,0 mode: PW/PW res: [0x2b58d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500796:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50873 lrc: 3/0,0 mode: PW/PW res: [0x2b58d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500800:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50873 lrc: 1/0,0 mode: --/PW res: [0x2b58d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500803:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50873 lrc: 0/0,0 mode: --/PW res: [0x2b58d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.500811:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946398208 00000100:00100000:0.0:1651529344.500821:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946398144 00000100:00100000:0.0:1651529344.500827:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946398336 00000100:00100000:0.0:1651529344.500830:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946398272 00000100:00100000:0.0:1651529344.500835:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211105 00000100:00100000:0.0:1651529344.500837:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+602:39030:x1731745946398208:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.500842:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177554 count 1 00010000:00010000:0.0:1651529344.500845:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1838eab/0x3234de053c5088f lrc: 3/0,1 mode: --/PW res: [0x2b592:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500849:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4f350 lrc: 2/0,0 mode: PR/PR res: [0x2b592:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ff9 expref: 1462 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.500851:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211106 00010000:00010000:0.0:1651529344.500852:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.500853:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+602:39029:x1731745946398144:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.500853:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.500854:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1838eab/0x3234de053c5088f lrc: 4/0,1 mode: --/PW res: [0x2b592:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.500859:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177553 count 1 00010000:00010000:0.0:1651529344.500860:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4f350 lrc: 3/0,0 mode: PR/PR res: [0x2b592:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ff9 expref: 1462 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.500864:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50896 lrc: 3/0,1 mode: --/PW res: [0x2b591:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500864:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4f350 lrc: 4/0,0 mode: PR/PR res: [0x2b592:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ff9 expref: 1462 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.500868:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000062cde35a/0x3234de053c4eadd lrc: 2/0,0 mode: PR/PR res: [0x2b591:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d15 expref: 1462 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.500868:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996977472:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.500871:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.500872:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.500873:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50896 lrc: 4/0,1 mode: --/PW res: [0x2b591:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.500889:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000062cde35a/0x3234de053c4eadd lrc: 3/0,0 mode: PR/PR res: [0x2b591:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d15 expref: 1462 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.500893:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000062cde35a/0x3234de053c4eadd lrc: 4/0,0 mode: PR/PR res: [0x2b591:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d15 expref: 1462 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.500894:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c086aae3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.500897:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d6486d55 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996977536:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.500901:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211107 00000100:00100000:0.0:1651529344.500903:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+602:39030:x1731745946398336:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.500905:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 0000000099c1da85 going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.500908:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177556 count 1 00000100:00100000:1.0:1651529344.500912:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211108 00010000:00010000:0.0:1651529344.500912:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d412086/0x3234de053c5089d lrc: 3/0,1 mode: --/PW res: [0x2b594:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.500913:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+602:39030:x1731745946398272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.500917:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177555 count 1 00010000:00010000:1.0:1651529344.500921:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f9d07bd/0x3234de053c508a4 lrc: 3/0,1 mode: --/PW res: [0x2b593:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.500925:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000588363ba/0x3234de053c4cc98 lrc: 2/0,0 mode: PR/PR res: [0x2b593:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce439 expref: 1462 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.500928:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.500929:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.500930:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f9d07bd/0x3234de053c508a4 lrc: 4/0,1 mode: --/PW res: [0x2b593:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.500930:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ceb01ee8/0x3234de053c4e57a lrc: 2/0,0 mode: PR/PR res: [0x2b594:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d476d expref: 1462 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.500933:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.500934:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.500934:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d412086/0x3234de053c5089d lrc: 4/0,1 mode: --/PW res: [0x2b594:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.500935:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000588363ba/0x3234de053c4cc98 lrc: 3/0,0 mode: PR/PR res: [0x2b593:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce439 expref: 1462 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.500939:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000588363ba/0x3234de053c4cc98 lrc: 4/0,0 mode: PR/PR res: [0x2b593:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce439 expref: 1462 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.500943:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f39ca9ea pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996977600:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.500949:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 0000000018ebe812 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.500950:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ceb01ee8/0x3234de053c4e57a lrc: 3/0,0 mode: PR/PR res: [0x2b594:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d476d expref: 1462 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.500954:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ceb01ee8/0x3234de053c4e57a lrc: 4/0,0 mode: PR/PR res: [0x2b594:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d476d expref: 1462 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.500961:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996977664:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.500969:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed830649 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.500983:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.500994:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946398400 00000100:00100000:1.0:1651529344.501001:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.501001:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211109 00000100:00100000:0.0:1651529344.501003:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+603:39029:x1731745946398400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.501008:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177557 count 1 00010000:00010000:0.0:1651529344.501012:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c499a55/0x3234de053c508ab lrc: 3/0,1 mode: --/PW res: [0x2b595:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501016:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000867f4c4f/0x3234de053c4d14c lrc: 2/0,0 mode: PR/PR res: [0x2b595:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf6a7 expref: 1462 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.501019:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.501020:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.501020:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c499a55/0x3234de053c508ab lrc: 4/0,1 mode: --/PW res: [0x2b595:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501027:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000867f4c4f/0x3234de053c4d14c lrc: 3/0,0 mode: PR/PR res: [0x2b595:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf6a7 expref: 1462 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.501030:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000867f4c4f/0x3234de053c4d14c lrc: 4/0,0 mode: PR/PR res: [0x2b595:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf6a7 expref: 1462 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.501032:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946398464 00000100:00100000:0.0:1651529344.501034:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996977728:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.501040:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211110 00000100:00100000:1.0:1651529344.501042:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+604:39030:x1731745946398464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.501052:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177558 count 1 00010000:00010000:1.0:1651529344.501057:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005af52cfa/0x3234de053c508b2 lrc: 3/0,1 mode: --/PW res: [0x2b596:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.501059:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c0dff858 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.501061:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c4f644 lrc: 2/0,0 mode: PR/PR res: [0x2b596:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8bbb expref: 1462 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.501064:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.501065:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.501065:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005af52cfa/0x3234de053c508b2 lrc: 4/0,1 mode: --/PW res: [0x2b596:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.501072:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c4f644 lrc: 3/0,0 mode: PR/PR res: [0x2b596:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8bbb expref: 1462 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.501075:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c4f644 lrc: 4/0,0 mode: PR/PR res: [0x2b596:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8bbb expref: 1462 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.501079:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000076d5f96b pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996977792:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.501088:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000007d8fabda going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.501142:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996977408:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.501147:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f3202904/0x3234de053c50888 lrc: 3/0,1 mode: --/PW res: [0x2b590:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.501157:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.501166:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.501175:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000999005e pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996977344:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.501179:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50881 lrc: 3/0,1 mode: --/PW res: [0x2b58f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.501186:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396279104 00010000:00010000:1.0:1651529344.501190:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000de7e3b54/0x3234de053c4d98e lrc: 4/0,0 mode: PR/PR res: [0x2b58f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d169e expref: 1463 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.501207:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396279168 00000100:00100000:1.0:1651529344.501208:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11885 00000100:00100000:1.0:1651529344.501210:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1464:41278:x1731746396279104:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.501213:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.501213:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f2323f96/0x3234de053c4d7ff lrc: 4/0,0 mode: PR/PR res: [0x2b590:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1134 expref: 1464 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.501214:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000de7e3b54/0x3234de053c4d98e lrc: 4/0,0 mode: PR/PR res: [0x2b58f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d169e expref: 1464 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.501218:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000de7e3b54/0x3234de053c4d98e lrc: 3/0,0 mode: PR/PR res: [0x2b58f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d169e expref: 1464 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.501240:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de7e3b54/0x3234de053c4d98e lrc: 0/0,0 mode: --/PR res: [0x2b58f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d169e expref: 1464 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.501243:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11886 00010000:00010000:1.0:1651529344.501244:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.501245:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.501245:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1463:41279:x1731746396279168:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.501246:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50881 lrc: 3/0,1 mode: PW/PW res: [0x2b58f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501249:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.501250:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f2323f96/0x3234de053c4d7ff lrc: 4/0,0 mode: PR/PR res: [0x2b590:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1134 expref: 1463 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.501251:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50881 lrc: 4/0,1 mode: PW/PW res: [0x2b58f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501254:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f2323f96/0x3234de053c4d7ff lrc: 3/0,0 mode: PR/PR res: [0x2b590:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1134 expref: 1463 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.501257:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.501259:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2323f96/0x3234de053c4d7ff lrc: 0/0,0 mode: --/PR res: [0x2b590:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1134 expref: 1463 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.501263:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.501264:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1462:41278:x1731746396279104:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 54us (108us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.501264:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.501265:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f3202904/0x3234de053c50888 lrc: 3/0,1 mode: PW/PW res: [0x2b590:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.501267:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11885 00010000:00010000:0.0:1651529344.501268:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3202904/0x3234de053c50888 lrc: 4/0,1 mode: PW/PW res: [0x2b590:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.501274:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50881 lrc: 3/0,1 mode: PW/PW res: [0x2b58f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.501277:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50881 lrc: 3/0,1 mode: PW/PW res: [0x2b58f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501277:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.501280:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50881 lrc: 3/0,1 mode: PW/PW res: [0x2b58f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.501283:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50881 lrc: 2/0,0 mode: PW/PW res: [0x2b58f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.501284:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1461:41279:x1731746396279168:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 38us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.501287:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11886 00010000:00010000:0.0:1651529344.501300:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50881 lrc: 2/0,0 mode: PW/PW res: [0x2b58f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501303:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027456046 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.501304:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50881 lrc: 2/0,0 mode: PW/PW res: [0x2b58f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501307:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50881 lrc: 3/0,0 mode: PW/PW res: [0x2b58f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501311:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50881 lrc: 1/0,0 mode: --/PW res: [0x2b58f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501314:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50881 lrc: 0/0,0 mode: --/PW res: [0x2b58f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501319:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f3202904/0x3234de053c50888 lrc: 3/0,1 mode: PW/PW res: [0x2b590:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501323:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3202904/0x3234de053c50888 lrc: 3/0,1 mode: PW/PW res: [0x2b590:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.501325:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+605:39030:x1731745946398016:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 733us (945us total) trans 12885079158 rc 0/0 00000100:00100000:1.0:1651529344.501328:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211103 00010000:00010000:0.0:1651529344.501328:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3202904/0x3234de053c50888 lrc: 3/0,1 mode: PW/PW res: [0x2b590:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501331:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3202904/0x3234de053c50888 lrc: 2/0,0 mode: PW/PW res: [0x2b590:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.501376:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+605:39029:x1731745946398080:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 674us (982us total) trans 12885079159 rc 0/0 00000100:00100000:0.0:1651529344.501379:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211104 00010000:00010000:0.0:1651529344.501386:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3202904/0x3234de053c50888 lrc: 2/0,0 mode: PW/PW res: [0x2b590:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501389:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f3202904 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.501390:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3202904/0x3234de053c50888 lrc: 2/0,0 mode: PW/PW res: [0x2b590:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501409:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3202904/0x3234de053c50888 lrc: 3/0,0 mode: PW/PW res: [0x2b590:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.501418:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.501423:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3202904/0x3234de053c50888 lrc: 1/0,0 mode: --/PW res: [0x2b590:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501426:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3202904/0x3234de053c50888 lrc: 0/0,0 mode: --/PW res: [0x2b590:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.501448:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.501466:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996977472:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.501468:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.501470:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f1838eab/0x3234de053c5088f lrc: 3/0,1 mode: --/PW res: [0x2b592:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.501474:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.501477:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996977664:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.501480:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005d412086/0x3234de053c5089d lrc: 3/0,1 mode: --/PW res: [0x2b594:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.501481:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.501486:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996977728:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.501487:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.501488:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002c499a55/0x3234de053c508ab lrc: 3/0,1 mode: --/PW res: [0x2b595:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.501494:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396279232 00000100:00100000:1.0:1651529344.501495:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d6486d55 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996977536:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.501498:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4f350 lrc: 4/0,0 mode: PR/PR res: [0x2b592:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ff9 expref: 1461 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.501499:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50896 lrc: 3/0,1 mode: --/PW res: [0x2b591:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.501504:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396279296 00000100:00100000:1.0:1651529344.501506:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f39ca9ea pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996977600:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.501506:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000062cde35a/0x3234de053c4eadd lrc: 4/0,0 mode: PR/PR res: [0x2b591:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d15 expref: 1462 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.501508:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008f9d07bd/0x3234de053c508a4 lrc: 3/0,1 mode: --/PW res: [0x2b593:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.501510:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396279360 00010000:00010000:0.0:1651529344.501512:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000588363ba/0x3234de053c4cc98 lrc: 4/0,0 mode: PR/PR res: [0x2b593:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce439 expref: 1463 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.501514:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396279488 00000100:00100000:0.0:1651529344.501516:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396279424 00010000:00010000:1.0:1651529344.501519:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000867f4c4f/0x3234de053c4d14c lrc: 4/0,0 mode: PR/PR res: [0x2b595:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf6a7 expref: 1465 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.501519:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ceb01ee8/0x3234de053c4e57a lrc: 4/0,0 mode: PR/PR res: [0x2b594:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d476d expref: 1465 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.501524:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396279552 00000100:00100000:0.0:1651529344.501526:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11887 00010000:00010000:1.0:1651529344.501527:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c4f644 lrc: 5/0,0 mode: PR/PR res: [0x2b596:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8bbb expref: 1466 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.501528:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1466:41278:x1731746396279232:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.501530:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.501532:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11888 00010000:00010000:0.0:1651529344.501532:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4f350 lrc: 4/0,0 mode: PR/PR res: [0x2b592:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ff9 expref: 1466 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.501533:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1466:41278:x1731746396279296:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.501535:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4f350 lrc: 3/0,0 mode: PR/PR res: [0x2b592:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ff9 expref: 1466 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.501536:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.501538:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000062cde35a/0x3234de053c4eadd lrc: 4/0,0 mode: PR/PR res: [0x2b591:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d15 expref: 1466 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.501540:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041e6f70f/0x3234de053c4f350 lrc: 0/0,0 mode: --/PR res: [0x2b592:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ff9 expref: 1466 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.501541:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000062cde35a/0x3234de053c4eadd lrc: 3/0,0 mode: PR/PR res: [0x2b591:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d15 expref: 1466 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.501544:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.501545:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.501546:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1838eab/0x3234de053c5088f lrc: 3/0,1 mode: PW/PW res: [0x2b592:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501549:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1838eab/0x3234de053c5088f lrc: 4/0,1 mode: PW/PW res: [0x2b592:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.501550:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062cde35a/0x3234de053c4eadd lrc: 0/0,0 mode: --/PR res: [0x2b591:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d15 expref: 1465 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.501553:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.501554:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.501555:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50896 lrc: 3/0,1 mode: PW/PW res: [0x2b591:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501555:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.501558:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50896 lrc: 4/0,1 mode: PW/PW res: [0x2b591:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.501568:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1464:41278:x1731746396279232:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 39us (150us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.501570:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.501571:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11887 00000100:00100000:0.0:1651529344.501575:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11889 00000100:00100000:0.0:1651529344.501577:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d17e32b2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1463:41278:x1731746396279360:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.501578:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1463:41278:x1731746396279296:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 44us (130us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.501580:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.501581:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11888 00010000:00010000:0.0:1651529344.501582:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000588363ba/0x3234de053c4cc98 lrc: 4/0,0 mode: PR/PR res: [0x2b593:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce439 expref: 1463 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.501585:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000588363ba/0x3234de053c4cc98 lrc: 3/0,0 mode: PR/PR res: [0x2b593:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce439 expref: 1462 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.501586:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11890 00000100:00100000:1.0:1651529344.501588:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1462:41278:x1731746396279488:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.501590:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.501590:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000588363ba/0x3234de053c4cc98 lrc: 0/0,0 mode: --/PR res: [0x2b593:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce439 expref: 1462 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.501592:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000867f4c4f/0x3234de053c4d14c lrc: 4/0,0 mode: PR/PR res: [0x2b595:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf6a7 expref: 1462 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.501594:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.501594:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.501595:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000867f4c4f/0x3234de053c4d14c lrc: 3/0,0 mode: PR/PR res: [0x2b595:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf6a7 expref: 1461 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.501595:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008f9d07bd/0x3234de053c508a4 lrc: 3/0,1 mode: PW/PW res: [0x2b593:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.501600:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000867f4c4f/0x3234de053c4d14c lrc: 0/0,0 mode: --/PR res: [0x2b595:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf6a7 expref: 1461 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.501606:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.501607:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.501607:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002c499a55/0x3234de053c508ab lrc: 3/0,1 mode: PW/PW res: [0x2b595:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.501610:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c499a55/0x3234de053c508ab lrc: 4/0,1 mode: PW/PW res: [0x2b595:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501612:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f9d07bd/0x3234de053c508a4 lrc: 4/0,1 mode: PW/PW res: [0x2b593:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.501624:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.501626:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.501630:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1460:41278:x1731746396279488:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.501633:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11890 00000100:00100000:1.0:1651529344.501637:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11891 00000100:00100000:1.0:1651529344.501639:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1459:41278:x1731746396279424:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.501641:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.501642:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ceb01ee8/0x3234de053c4e57a lrc: 4/0,0 mode: PR/PR res: [0x2b594:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d476d expref: 1459 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.501643:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d17e32b2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1459:41278:x1731746396279360:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 65us (175us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.501646:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ceb01ee8/0x3234de053c4e57a lrc: 3/0,0 mode: PR/PR res: [0x2b594:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d476d expref: 1459 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.501646:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11889 00010000:00010000:1.0:1651529344.501651:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ceb01ee8/0x3234de053c4e57a lrc: 0/0,0 mode: --/PR res: [0x2b594:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d476d expref: 1458 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.501654:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.501655:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.501655:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005d412086/0x3234de053c5089d lrc: 3/0,1 mode: PW/PW res: [0x2b594:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.501656:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11892 00010000:00010000:1.0:1651529344.501658:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d412086/0x3234de053c5089d lrc: 4/0,1 mode: PW/PW res: [0x2b594:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.501658:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1457:41278:x1731746396279552:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.501660:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.501662:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c4f644 lrc: 5/0,0 mode: PR/PR res: [0x2b596:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8bbb expref: 1457 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.501667:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.501673:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1457:41278:x1731746396279424:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (191us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.501673:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c4f644 lrc: 4/0,0 mode: PR/PR res: [0x2b596:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8bbb expref: 1457 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.501675:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11891 00010000:00010000:0.0:1651529344.501678:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.501679:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.501680:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005af52cfa/0x3234de053c508b2 lrc: 3/0,1 mode: PW/PW res: [0x2b596:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501683:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005af52cfa/0x3234de053c508b2 lrc: 4/0,1 mode: PW/PW res: [0x2b596:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.501684:0:80276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c4f644 lrc: 0/0,0 mode: --/PR res: [0x2b596:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8bbb expref: 1456 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.501687:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.501688:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000076d5f96b pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996977792:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.501691:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005af52cfa/0x3234de053c508b2 lrc: 3/0,1 mode: PW/PW res: [0x2b596:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.501693:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1455:41278:x1731746396279552:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (206us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.501695:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005af52cfa/0x3234de053c508b2 lrc: 3/0,1 mode: PW/PW res: [0x2b596:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.501695:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11892 00010000:00010000:1.0:1651529344.501697:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005af52cfa/0x3234de053c508b2 lrc: 3/0,1 mode: PW/PW res: [0x2b596:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.501700:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005af52cfa/0x3234de053c508b2 lrc: 3/0,1 mode: PW/PW res: [0x2b596:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501702:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f1838eab/0x3234de053c5088f lrc: 3/0,1 mode: PW/PW res: [0x2b592:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.501703:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005af52cfa/0x3234de053c508b2 lrc: 2/0,0 mode: PW/PW res: [0x2b596:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501705:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1838eab/0x3234de053c5088f lrc: 3/0,1 mode: PW/PW res: [0x2b592:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501708:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1838eab/0x3234de053c5088f lrc: 3/0,1 mode: PW/PW res: [0x2b592:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501717:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1838eab/0x3234de053c5088f lrc: 2/0,0 mode: PW/PW res: [0x2b592:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.501755:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+606:39030:x1731745946398464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 712us (754us total) trans 12885079160 rc 0/0 00000100:00100000:1.0:1651529344.501758:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211110 00010000:00010000:1.0:1651529344.501765:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008f9d07bd/0x3234de053c508a4 lrc: 3/0,1 mode: PW/PW res: [0x2b593:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.501769:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f9d07bd/0x3234de053c508a4 lrc: 3/0,1 mode: PW/PW res: [0x2b593:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.501769:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+605:39030:x1731745946398208:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 931us (1022us total) trans 12885079161 rc 0/0 00010000:00010000:1.0:1651529344.501772:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f9d07bd/0x3234de053c508a4 lrc: 3/0,1 mode: PW/PW res: [0x2b593:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.501772:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211105 00010000:00010000:1.0:1651529344.501774:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f9d07bd/0x3234de053c508a4 lrc: 2/0,0 mode: PW/PW res: [0x2b593:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501788:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005af52cfa/0x3234de053c508b2 lrc: 2/0,0 mode: PW/PW res: [0x2b596:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501792:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005af52cfa already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.501793:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005af52cfa/0x3234de053c508b2 lrc: 2/0,0 mode: PW/PW res: [0x2b596:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501796:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005af52cfa/0x3234de053c508b2 lrc: 3/0,0 mode: PW/PW res: [0x2b596:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501801:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005af52cfa/0x3234de053c508b2 lrc: 1/0,0 mode: --/PW res: [0x2b596:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501803:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005af52cfa/0x3234de053c508b2 lrc: 0/0,0 mode: --/PW res: [0x2b596:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501808:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1838eab/0x3234de053c5088f lrc: 2/0,0 mode: PW/PW res: [0x2b592:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501811:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f1838eab already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.501811:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1838eab/0x3234de053c5088f lrc: 2/0,0 mode: PW/PW res: [0x2b592:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.501812:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+605:39030:x1731745946398272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 898us (1023us total) trans 12885079162 rc 0/0 00000100:00100000:1.0:1651529344.501815:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211108 00010000:00010000:0.0:1651529344.501816:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1838eab/0x3234de053c5088f lrc: 3/0,0 mode: PW/PW res: [0x2b592:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501820:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1838eab/0x3234de053c5088f lrc: 1/0,0 mode: --/PW res: [0x2b592:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.501822:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50896 lrc: 3/0,1 mode: PW/PW res: [0x2b591:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501822:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1838eab/0x3234de053c5088f lrc: 0/0,0 mode: --/PW res: [0x2b592:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.501825:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50896 lrc: 3/0,1 mode: PW/PW res: [0x2b591:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501826:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f9d07bd/0x3234de053c508a4 lrc: 2/0,0 mode: PW/PW res: [0x2b593:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.501828:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50896 lrc: 3/0,1 mode: PW/PW res: [0x2b591:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501828:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008f9d07bd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.501829:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f9d07bd/0x3234de053c508a4 lrc: 2/0,0 mode: PW/PW res: [0x2b593:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501831:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f9d07bd/0x3234de053c508a4 lrc: 3/0,0 mode: PW/PW res: [0x2b593:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.501833:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50896 lrc: 2/0,0 mode: PW/PW res: [0x2b591:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501835:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f9d07bd/0x3234de053c508a4 lrc: 1/0,0 mode: --/PW res: [0x2b593:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501837:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f9d07bd/0x3234de053c508a4 lrc: 0/0,0 mode: --/PW res: [0x2b593:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501841:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50896 lrc: 2/0,0 mode: PW/PW res: [0x2b591:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501846:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005d8a4887 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.501847:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50896 lrc: 2/0,0 mode: PW/PW res: [0x2b591:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501849:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50896 lrc: 3/0,0 mode: PW/PW res: [0x2b591:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501852:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50896 lrc: 1/0,0 mode: --/PW res: [0x2b591:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501855:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50896 lrc: 0/0,0 mode: --/PW res: [0x2b591:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.501861:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+605:39029:x1731745946398144:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1008us (1098us total) trans 12885079163 rc 0/0 00010000:00010000:0.0:1651529344.501861:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005d412086/0x3234de053c5089d lrc: 3/0,1 mode: PW/PW res: [0x2b594:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.501864:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211106 00010000:00010000:0.0:1651529344.501864:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d412086/0x3234de053c5089d lrc: 3/0,1 mode: PW/PW res: [0x2b594:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501867:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d412086/0x3234de053c5089d lrc: 3/0,1 mode: PW/PW res: [0x2b594:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501870:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d412086/0x3234de053c5089d lrc: 2/0,0 mode: PW/PW res: [0x2b594:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.501899:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.501905:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+605:39030:x1731745946398336:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1001us (1131us total) trans 12885079164 rc 0/0 00000100:00100000:0.0:1651529344.501908:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211107 00000100:00100000:0.0:1651529344.501913:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946399040 00000100:00100000:1.0:1651529344.501914:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.501920:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946399104 00000100:00100000:0.0:1651529344.501929:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211111 00000100:00100000:0.0:1651529344.501931:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+606:39029:x1731745946399040:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.501936:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177559 count 1 00010000:00010000:0.0:1651529344.501940:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b937ade1/0x3234de053c508b9 lrc: 3/0,1 mode: --/PW res: [0x2b597:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501945:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000071d5fc61/0x3234de053c4eacf lrc: 2/0,0 mode: PR/PR res: [0x2b597:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ccf expref: 1454 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.501948:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.501949:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.501949:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b937ade1/0x3234de053c508b9 lrc: 4/0,1 mode: --/PW res: [0x2b597:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501956:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000071d5fc61/0x3234de053c4eacf lrc: 3/0,0 mode: PR/PR res: [0x2b597:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ccf expref: 1454 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.501960:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000071d5fc61/0x3234de053c4eacf lrc: 4/0,0 mode: PR/PR res: [0x2b597:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ccf expref: 1454 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.501964:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996977856:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.501972:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c086aae3 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.501977:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d412086/0x3234de053c5089d lrc: 2/0,0 mode: PW/PW res: [0x2b594:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501982:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005d412086 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.501983:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d412086/0x3234de053c5089d lrc: 2/0,0 mode: PW/PW res: [0x2b594:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501986:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d412086/0x3234de053c5089d lrc: 3/0,0 mode: PW/PW res: [0x2b594:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501990:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d412086/0x3234de053c5089d lrc: 1/0,0 mode: --/PW res: [0x2b594:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.501993:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d412086/0x3234de053c5089d lrc: 0/0,0 mode: --/PW res: [0x2b594:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.502000:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211112 00000100:00100000:0.0:1651529344.502002:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+606:39030:x1731745946399104:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.502006:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177560 count 1 00010000:00010000:0.0:1651529344.502028:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c508c0 lrc: 3/0,1 mode: --/PW res: [0x2b598:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502033:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001851bb82/0x3234de053c4ed45 lrc: 2/0,0 mode: PR/PR res: [0x2b598:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6702 expref: 1454 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.502036:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.502037:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.502038:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c508c0 lrc: 4/0,1 mode: --/PW res: [0x2b598:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502047:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001851bb82/0x3234de053c4ed45 lrc: 3/0,0 mode: PR/PR res: [0x2b598:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6702 expref: 1454 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.502050:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001851bb82/0x3234de053c4ed45 lrc: 4/0,0 mode: PR/PR res: [0x2b598:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6702 expref: 1454 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.502054:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996977920:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.502068:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c0dff858 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.502073:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002c499a55/0x3234de053c508ab lrc: 3/0,1 mode: PW/PW res: [0x2b595:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502076:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c499a55/0x3234de053c508ab lrc: 3/0,1 mode: PW/PW res: [0x2b595:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502079:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c499a55/0x3234de053c508ab lrc: 3/0,1 mode: PW/PW res: [0x2b595:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502082:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c499a55/0x3234de053c508ab lrc: 2/0,0 mode: PW/PW res: [0x2b595:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.502150:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+607:39029:x1731745946398400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1145us (1166us total) trans 12885079165 rc 0/0 00000100:00100000:0.0:1651529344.502153:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211109 00010000:00010000:0.0:1651529344.502160:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c499a55/0x3234de053c508ab lrc: 2/0,0 mode: PW/PW res: [0x2b595:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.502165:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.502166:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002c499a55 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.502167:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c499a55/0x3234de053c508ab lrc: 2/0,0 mode: PW/PW res: [0x2b595:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502175:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c499a55/0x3234de053c508ab lrc: 3/0,0 mode: PW/PW res: [0x2b595:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502180:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c499a55/0x3234de053c508ab lrc: 1/0,0 mode: --/PW res: [0x2b595:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502183:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c499a55/0x3234de053c508ab lrc: 0/0,0 mode: --/PW res: [0x2b595:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.502190:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946399168 00000100:00100000:0.0:1651529344.502200:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211113 00000100:00100000:1.0:1651529344.502201:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.502208:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.502214:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.502214:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+607:39029:x1731745946399168:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.502235:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177561 count 1 00000100:00100000:1.0:1651529344.502239:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.502240:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000068ac74b/0x3234de053c508c7 lrc: 3/0,1 mode: --/PW res: [0x2b599:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502244:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e486287e/0x3234de053c4ac4d lrc: 2/0,0 mode: PR/PR res: [0x2b599:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe6f expref: 1454 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.502246:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946399232 00010000:00010000:0.0:1651529344.502247:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.502248:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.502249:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000068ac74b/0x3234de053c508c7 lrc: 4/0,1 mode: --/PW res: [0x2b599:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.502252:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946399296 00010000:00010000:0.0:1651529344.502256:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e486287e/0x3234de053c4ac4d lrc: 3/0,0 mode: PR/PR res: [0x2b599:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe6f expref: 1454 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.502259:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946399360 00000100:00100000:1.0:1651529344.502262:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946399424 00010000:00010000:0.0:1651529344.502265:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e486287e/0x3234de053c4ac4d lrc: 4/0,0 mode: PR/PR res: [0x2b599:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe6f expref: 1454 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.502266:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211114 00000100:00100000:1.0:1651529344.502267:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+611:39030:x1731745946399232:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.502269:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996977984:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.502273:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177562 count 1 00010000:00010000:1.0:1651529344.502278:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4f40cb6/0x3234de053c508ce lrc: 3/0,1 mode: --/PW res: [0x2b59a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.502283:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000046fa391d/0x3234de053c4f517 lrc: 2/0,0 mode: PR/PR res: [0x2b59a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d86eb expref: 1454 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.502292:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.502293:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.502294:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4f40cb6/0x3234de053c508ce lrc: 4/0,1 mode: --/PW res: [0x2b59a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.502297:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 000000000d706dff going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.502301:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000046fa391d/0x3234de053c4f517 lrc: 3/0,0 mode: PR/PR res: [0x2b59a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d86eb expref: 1454 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.502305:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000046fa391d/0x3234de053c4f517 lrc: 4/0,0 mode: PR/PR res: [0x2b59a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d86eb expref: 1454 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.502305:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211115 00000100:00100000:0.0:1651529344.502306:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+611:39029:x1731745946399296:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.502309:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f39ca9ea pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996978048:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.502311:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177563 count 1 00010000:00010000:0.0:1651529344.502315:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c508d5 lrc: 3/0,1 mode: --/PW res: [0x2b59b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.502318:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 0000000057299e7f going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.502319:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002257d771/0x3234de053c4ea0b lrc: 2/0,0 mode: PR/PR res: [0x2b59b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d59b1 expref: 1454 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.502322:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.502323:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.502324:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c508d5 lrc: 4/0,1 mode: --/PW res: [0x2b59b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.502325:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211116 00000100:00100000:1.0:1651529344.502326:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+611:39030:x1731745946399360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.502330:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002257d771/0x3234de053c4ea0b lrc: 3/0,0 mode: PR/PR res: [0x2b59b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d59b1 expref: 1454 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.502331:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177564 count 1 00010000:00010000:0.0:1651529344.502333:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002257d771/0x3234de053c4ea0b lrc: 4/0,0 mode: PR/PR res: [0x2b59b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d59b1 expref: 1454 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.502334:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069843204/0x3234de053c508dc lrc: 3/0,1 mode: --/PW res: [0x2b59c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.502337:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996978112:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.502339:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c4ce58 lrc: 2/0,0 mode: PR/PR res: [0x2b59c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceaec expref: 1454 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.502342:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.502342:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.502343:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069843204/0x3234de053c508dc lrc: 4/0,1 mode: --/PW res: [0x2b59c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.502345:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 000000003c8b0daf going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.502349:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c4ce58 lrc: 3/0,0 mode: PR/PR res: [0x2b59c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceaec expref: 1454 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.502351:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211117 00000100:00100000:0.0:1651529344.502353:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+611:39030:x1731745946399424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.502355:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c4ce58 lrc: 4/0,0 mode: PR/PR res: [0x2b59c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceaec expref: 1454 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:0.0:1651529344.502357:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177565 count 1 00000100:00100000:1.0:1651529344.502359:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003e8ef62e pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996978176:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.502359:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c508e3 lrc: 3/0,1 mode: --/PW res: [0x2b59d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502363:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000adac6454/0x3234de053c4d034 lrc: 2/0,0 mode: PR/PR res: [0x2b59d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf216 expref: 1454 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.502365:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 0000000020dd7827 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.502366:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.502367:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.502367:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c508e3 lrc: 4/0,1 mode: --/PW res: [0x2b59d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502373:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000adac6454/0x3234de053c4d034 lrc: 3/0,0 mode: PR/PR res: [0x2b59d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf216 expref: 1454 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.502380:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.502390:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000adac6454/0x3234de053c4d034 lrc: 4/0,0 mode: PR/PR res: [0x2b59d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf216 expref: 1454 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.502394:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996978240:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.502408:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 000000003678d25f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.502416:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996977856:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.502420:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b937ade1/0x3234de053c508b9 lrc: 3/0,1 mode: --/PW res: [0x2b597:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.502449:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946399488 00000100:00100000:1.0:1651529344.502463:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211118 00000100:00100000:1.0:1651529344.502464:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+612:39029:x1731745946399488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.502469:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177566 count 1 00010000:00010000:1.0:1651529344.502473:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c508ea lrc: 3/0,1 mode: --/PW res: [0x2b59e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.502478:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000071cfd59e/0x3234de053c4b5c3 lrc: 2/0,0 mode: PR/PR res: [0x2b59e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc2ba expref: 1454 pid: 80281 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.502481:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.502482:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.502482:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c508ea lrc: 4/0,1 mode: --/PW res: [0x2b59e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.502489:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000071cfd59e/0x3234de053c4b5c3 lrc: 3/0,0 mode: PR/PR res: [0x2b59e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc2ba expref: 1454 pid: 80281 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.502492:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000071cfd59e/0x3234de053c4b5c3 lrc: 4/0,0 mode: PR/PR res: [0x2b59e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc2ba expref: 1454 pid: 80281 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.502499:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000117fbeca pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996978304:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.502509:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 0000000099c1da85 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.502576:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.502577:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996977920:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.502581:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c508c0 lrc: 3/0,1 mode: --/PW res: [0x2b598:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.502583:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.502589:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396280128 00010000:00010000:1.0:1651529344.502595:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000071d5fc61/0x3234de053c4eacf lrc: 4/0,0 mode: PR/PR res: [0x2b597:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ccf expref: 1455 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.502604:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396280192 00010000:00010000:1.0:1651529344.502607:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001851bb82/0x3234de053c4ed45 lrc: 4/0,0 mode: PR/PR res: [0x2b598:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6702 expref: 1456 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.502608:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11893 00000100:00100000:0.0:1651529344.502610:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1456:41279:x1731746396280128:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.502613:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.502614:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11894 00000100:00100000:1.0:1651529344.502615:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1456:41278:x1731746396280192:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.502615:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000071d5fc61/0x3234de053c4eacf lrc: 4/0,0 mode: PR/PR res: [0x2b597:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ccf expref: 1456 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.502618:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.502619:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000071d5fc61/0x3234de053c4eacf lrc: 3/0,0 mode: PR/PR res: [0x2b597:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ccf expref: 1456 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.502620:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001851bb82/0x3234de053c4ed45 lrc: 4/0,0 mode: PR/PR res: [0x2b598:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6702 expref: 1456 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.502624:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001851bb82/0x3234de053c4ed45 lrc: 3/0,0 mode: PR/PR res: [0x2b598:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6702 expref: 1456 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.502624:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071d5fc61/0x3234de053c4eacf lrc: 0/0,0 mode: --/PR res: [0x2b597:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ccf expref: 1456 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.502628:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.502629:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001851bb82/0x3234de053c4ed45 lrc: 0/0,0 mode: --/PR res: [0x2b598:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6702 expref: 1455 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.502629:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.502629:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b937ade1/0x3234de053c508b9 lrc: 3/0,1 mode: PW/PW res: [0x2b597:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502632:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b937ade1/0x3234de053c508b9 lrc: 4/0,1 mode: PW/PW res: [0x2b597:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.502633:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.502634:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.502634:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c508c0 lrc: 3/0,1 mode: PW/PW res: [0x2b598:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.502638:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c508c0 lrc: 4/0,1 mode: PW/PW res: [0x2b598:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502641:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.502646:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.502655:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1454:41278:x1731746396280192:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 38us (71us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.502655:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1454:41279:x1731746396280128:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 44us (80us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.502657:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11894 00000100:00100000:0.0:1651529344.502659:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11893 00010000:00010000:0.0:1651529344.502666:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c508c0 lrc: 3/0,1 mode: PW/PW res: [0x2b598:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502670:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c508c0 lrc: 3/0,1 mode: PW/PW res: [0x2b598:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502673:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c508c0 lrc: 3/0,1 mode: PW/PW res: [0x2b598:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502675:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c508c0 lrc: 2/0,0 mode: PW/PW res: [0x2b598:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.502718:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+613:39030:x1731745946399104:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 715us (803us total) trans 12885079166 rc 0/0 00000100:00100000:0.0:1651529344.502721:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211112 00010000:00010000:0.0:1651529344.502728:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c508c0 lrc: 2/0,0 mode: PW/PW res: [0x2b598:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502731:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005d39750f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.502732:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c508c0 lrc: 2/0,0 mode: PW/PW res: [0x2b598:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502745:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c508c0 lrc: 3/0,0 mode: PW/PW res: [0x2b598:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502750:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c508c0 lrc: 1/0,0 mode: --/PW res: [0x2b598:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502752:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d39750f/0x3234de053c508c0 lrc: 0/0,0 mode: --/PW res: [0x2b598:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502759:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b937ade1/0x3234de053c508b9 lrc: 3/0,1 mode: PW/PW res: [0x2b597:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502762:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b937ade1/0x3234de053c508b9 lrc: 3/0,1 mode: PW/PW res: [0x2b597:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502765:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b937ade1/0x3234de053c508b9 lrc: 3/0,1 mode: PW/PW res: [0x2b597:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502767:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b937ade1/0x3234de053c508b9 lrc: 2/0,0 mode: PW/PW res: [0x2b597:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.502822:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+613:39029:x1731745946399040:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 876us (909us total) trans 12885079167 rc 0/0 00000100:00100000:0.0:1651529344.502825:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211111 00010000:00010000:0.0:1651529344.502832:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b937ade1/0x3234de053c508b9 lrc: 2/0,0 mode: PW/PW res: [0x2b597:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502837:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b937ade1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.502853:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b937ade1/0x3234de053c508b9 lrc: 2/0,0 mode: PW/PW res: [0x2b597:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502876:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b937ade1/0x3234de053c508b9 lrc: 3/0,0 mode: PW/PW res: [0x2b597:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502881:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b937ade1/0x3234de053c508b9 lrc: 1/0,0 mode: --/PW res: [0x2b597:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502903:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b937ade1/0x3234de053c508b9 lrc: 0/0,0 mode: --/PW res: [0x2b597:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.502917:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.502920:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996978112:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.502928:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c508d5 lrc: 3/0,1 mode: --/PW res: [0x2b59b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.502931:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.502939:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.502941:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946399552 00000100:00100000:1.0:1651529344.502946:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.502952:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.502958:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.502971:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211119 00000100:00100000:0.0:1651529344.502972:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+613:39030:x1731745946399552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.502973:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:0.0:1651529344.502978:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177567 count 1 00000100:00100000:1.0:1651529344.502980:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.502981:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c508f1 lrc: 3/0,1 mode: --/PW res: [0x2b59f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502986:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006fcdf095/0x3234de053c4d995 lrc: 2/0,0 mode: PR/PR res: [0x2b59f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d16b3 expref: 1452 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.502990:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f39ca9ea pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996978048:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.502991:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.502992:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.502993:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c508f1 lrc: 4/0,1 mode: --/PW res: [0x2b59f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.502995:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b4f40cb6/0x3234de053c508ce lrc: 3/0,1 mode: --/PW res: [0x2b59a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.502999:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006fcdf095/0x3234de053c4d995 lrc: 3/0,0 mode: PR/PR res: [0x2b59f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d16b3 expref: 1452 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.503001:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003e8ef62e pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996978176:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.503002:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006fcdf095/0x3234de053c4d995 lrc: 4/0,0 mode: PR/PR res: [0x2b59f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d16b3 expref: 1452 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.503004:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000069843204/0x3234de053c508dc lrc: 3/0,1 mode: --/PW res: [0x2b59c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.503006:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996978368:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.503010:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000117fbeca pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996978304:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.503013:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c508ea lrc: 3/0,1 mode: --/PW res: [0x2b59e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.503021:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 000000003003c8b0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.503024:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396280320 00000100:00100000:0.0:1651529344.503027:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946399616 00010000:00010000:1.0:1651529344.503029:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000046fa391d/0x3234de053c4f517 lrc: 4/0,0 mode: PR/PR res: [0x2b59a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d86eb expref: 1453 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.503036:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211120 00000100:00100000:0.0:1651529344.503037:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+614:39029:x1731745946399616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.503039:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396280256 00010000:00010000:1.0:1651529344.503042:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e486287e/0x3234de053c4ac4d lrc: 5/0,0 mode: PR/PR res: [0x2b599:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe6f expref: 1454 pid: 72396 timeout: 20103 lvb_type: 1 00002000:00080000:0.0:1651529344.503042:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177568 count 1 00010000:00010000:0.0:1651529344.503045:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c508f8 lrc: 3/0,1 mode: --/PW res: [0x2b5a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.503046:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396280384 00010000:00010000:1.0:1651529344.503048:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002257d771/0x3234de053c4ea0b lrc: 4/0,0 mode: PR/PR res: [0x2b59b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d59b1 expref: 1455 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.503050:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000186c25c6/0x3234de053c4cf23 lrc: 2/0,0 mode: PR/PR res: [0x2b5a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee50 expref: 1455 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.503052:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396280448 00010000:00010000:0.0:1651529344.503053:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.503053:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.503054:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c4ce58 lrc: 4/0,0 mode: PR/PR res: [0x2b59c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceaec expref: 1456 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.503054:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c508f8 lrc: 4/0,1 mode: --/PW res: [0x2b5a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.503057:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396280576 00010000:00010000:1.0:1651529344.503060:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000071cfd59e/0x3234de053c4b5c3 lrc: 4/0,0 mode: PR/PR res: [0x2b59e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc2ba expref: 1457 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.503061:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000186c25c6/0x3234de053c4cf23 lrc: 3/0,0 mode: PR/PR res: [0x2b5a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee50 expref: 1457 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.503064:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396280512 00010000:00010000:0.0:1651529344.503064:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000186c25c6/0x3234de053c4cf23 lrc: 4/0,0 mode: PR/PR res: [0x2b5a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee50 expref: 1458 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.503066:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000adac6454/0x3234de053c4d034 lrc: 5/0,0 mode: PR/PR res: [0x2b59d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf216 expref: 1458 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.503068:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996978432:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.503070:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11895 00000100:00100000:1.0:1651529344.503072:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1458:41279:x1731746396280320:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.503075:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.503075:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c0dff858 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.503076:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000046fa391d/0x3234de053c4f517 lrc: 4/0,0 mode: PR/PR res: [0x2b59a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d86eb expref: 1458 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.503079:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000046fa391d/0x3234de053c4f517 lrc: 3/0,0 mode: PR/PR res: [0x2b59a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d86eb expref: 1458 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.503082:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996978240:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.503085:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046fa391d/0x3234de053c4f517 lrc: 0/0,0 mode: --/PR res: [0x2b59a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d86eb expref: 1458 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.503085:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c508e3 lrc: 3/0,1 mode: --/PW res: [0x2b59d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.503088:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.503089:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.503090:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4f40cb6/0x3234de053c508ce lrc: 3/0,1 mode: PW/PW res: [0x2b59a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.503091:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996977984:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.503093:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4f40cb6/0x3234de053c508ce lrc: 4/0,1 mode: PW/PW res: [0x2b59a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503094:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000068ac74b/0x3234de053c508c7 lrc: 3/0,1 mode: --/PW res: [0x2b599:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.503099:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.503100:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11896 00000100:00100000:0.0:1651529344.503102:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071577dd8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1457:41279:x1731746396280256:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.503105:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.503106:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1457:41279:x1731746396280320:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 33us (175us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.503106:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e486287e/0x3234de053c4ac4d lrc: 4/0,0 mode: PR/PR res: [0x2b599:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe6f expref: 1457 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.503109:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11895 00010000:00010000:0.0:1651529344.503110:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e486287e/0x3234de053c4ac4d lrc: 3/0,0 mode: PR/PR res: [0x2b599:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe6f expref: 1457 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.503113:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11897 00000100:00100000:1.0:1651529344.503115:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1456:41279:x1731746396280384:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.503115:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e486287e/0x3234de053c4ac4d lrc: 0/0,0 mode: --/PR res: [0x2b599:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe6f expref: 1456 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.503117:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.503118:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002257d771/0x3234de053c4ea0b lrc: 4/0,0 mode: PR/PR res: [0x2b59b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d59b1 expref: 1456 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.503119:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.503119:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.503120:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000068ac74b/0x3234de053c508c7 lrc: 3/0,1 mode: PW/PW res: [0x2b599:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.503122:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002257d771/0x3234de053c4ea0b lrc: 3/0,0 mode: PR/PR res: [0x2b59b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d59b1 expref: 1455 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.503123:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000068ac74b/0x3234de053c508c7 lrc: 4/0,1 mode: PW/PW res: [0x2b599:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.503127:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002257d771/0x3234de053c4ea0b lrc: 0/0,0 mode: --/PR res: [0x2b59b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d59b1 expref: 1455 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.503129:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.503130:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.503130:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.503131:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c508d5 lrc: 3/0,1 mode: PW/PW res: [0x2b59b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.503134:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c508d5 lrc: 4/0,1 mode: PW/PW res: [0x2b59b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.503135:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071577dd8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1454:41279:x1731746396280256:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 32us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.503137:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11896 00010000:00010000:1.0:1651529344.503144:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.503149:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1453:41279:x1731746396280384:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 34us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.503152:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11897 00000100:00100000:0.0:1651529344.503154:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11898 00000100:00100000:1.0:1651529344.503156:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11899 00000100:00100000:0.0:1651529344.503156:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1452:41279:x1731746396280448:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.503158:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1452:41279:x1731746396280576:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.503159:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.503160:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.503161:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c4ce58 lrc: 4/0,0 mode: PR/PR res: [0x2b59c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceaec expref: 1452 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.503162:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000071cfd59e/0x3234de053c4b5c3 lrc: 4/0,0 mode: PR/PR res: [0x2b59e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc2ba expref: 1452 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.503164:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c4ce58 lrc: 3/0,0 mode: PR/PR res: [0x2b59c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceaec expref: 1452 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.503165:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000071cfd59e/0x3234de053c4b5c3 lrc: 3/0,0 mode: PR/PR res: [0x2b59e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc2ba expref: 1452 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.503169:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c4ce58 lrc: 0/0,0 mode: --/PR res: [0x2b59c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceaec expref: 1452 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.503170:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071cfd59e/0x3234de053c4b5c3 lrc: 0/0,0 mode: --/PR res: [0x2b59e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc2ba expref: 1452 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.503173:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.503174:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.503175:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c508ea lrc: 3/0,1 mode: PW/PW res: [0x2b59e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503175:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.503175:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.503176:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000069843204/0x3234de053c508dc lrc: 3/0,1 mode: PW/PW res: [0x2b59c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.503177:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c508ea lrc: 4/0,1 mode: PW/PW res: [0x2b59e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503179:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069843204/0x3234de053c508dc lrc: 4/0,1 mode: PW/PW res: [0x2b59c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.503183:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.503189:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.503194:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1450:41279:x1731746396280576:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.503194:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1450:41279:x1731746396280448:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 38us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.503196:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11899 00000100:00100000:0.0:1651529344.503198:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11898 00000100:00100000:1.0:1651529344.503201:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11900 00000100:00100000:1.0:1651529344.503202:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1448:41278:x1731746396280512:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.503204:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.503205:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000adac6454/0x3234de053c4d034 lrc: 4/0,0 mode: PR/PR res: [0x2b59d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf216 expref: 1448 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.503205:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c508d5 lrc: 3/0,1 mode: PW/PW res: [0x2b59b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503208:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c508d5 lrc: 3/0,1 mode: PW/PW res: [0x2b59b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.503209:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000adac6454/0x3234de053c4d034 lrc: 3/0,0 mode: PR/PR res: [0x2b59d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf216 expref: 1448 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.503211:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c508d5 lrc: 3/0,1 mode: PW/PW res: [0x2b59b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.503213:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000adac6454/0x3234de053c4d034 lrc: 0/0,0 mode: --/PR res: [0x2b59d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf216 expref: 1448 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.503214:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c508d5 lrc: 2/0,0 mode: PW/PW res: [0x2b59b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.503219:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.503220:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.503220:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c508e3 lrc: 3/0,1 mode: PW/PW res: [0x2b59d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.503238:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c508e3 lrc: 4/0,1 mode: PW/PW res: [0x2b59d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.503245:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.503251:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1447:41278:x1731746396280512:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 49us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.503254:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11900 00010000:00010000:1.0:1651529344.503262:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000069843204/0x3234de053c508dc lrc: 3/0,1 mode: PW/PW res: [0x2b59c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.503265:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069843204/0x3234de053c508dc lrc: 3/0,1 mode: PW/PW res: [0x2b59c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.503268:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069843204/0x3234de053c508dc lrc: 3/0,1 mode: PW/PW res: [0x2b59c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.503271:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069843204/0x3234de053c508dc lrc: 2/0,0 mode: PW/PW res: [0x2b59c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.503275:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+615:39029:x1731745946399296:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 968us (1067us total) trans 12885079168 rc 0/0 00000100:00100000:0.0:1651529344.503285:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211115 00010000:00010000:0.0:1651529344.503295:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c508d5 lrc: 2/0,0 mode: PW/PW res: [0x2b59b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503298:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cdc65e28 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.503299:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c508d5 lrc: 2/0,0 mode: PW/PW res: [0x2b59b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503302:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c508d5 lrc: 3/0,0 mode: PW/PW res: [0x2b59b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503307:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c508d5 lrc: 1/0,0 mode: --/PW res: [0x2b59b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503310:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c508d5 lrc: 0/0,0 mode: --/PW res: [0x2b59b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503314:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069843204/0x3234de053c508dc lrc: 2/0,0 mode: PW/PW res: [0x2b59c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.503315:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+615:39030:x1731745946399360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 987us (1100us total) trans 12885079169 rc 0/0 00010000:00010000:0.0:1651529344.503316:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000069843204 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.503317:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069843204/0x3234de053c508dc lrc: 2/0,0 mode: PW/PW res: [0x2b59c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.503318:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211116 00010000:00010000:0.0:1651529344.503320:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069843204/0x3234de053c508dc lrc: 3/0,0 mode: PW/PW res: [0x2b59c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503323:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069843204/0x3234de053c508dc lrc: 1/0,0 mode: --/PW res: [0x2b59c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.503325:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c508ea lrc: 3/0,1 mode: PW/PW res: [0x2b59e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.503328:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c508ea lrc: 3/0,1 mode: PW/PW res: [0x2b59e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503328:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069843204/0x3234de053c508dc lrc: 0/0,0 mode: --/PW res: [0x2b59c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.503331:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c508ea lrc: 3/0,1 mode: PW/PW res: [0x2b59e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.503334:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c508ea lrc: 2/0,0 mode: PW/PW res: [0x2b59e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503334:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c508e3 lrc: 3/0,1 mode: PW/PW res: [0x2b59d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503336:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c508e3 lrc: 3/0,1 mode: PW/PW res: [0x2b59d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503339:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c508e3 lrc: 3/0,1 mode: PW/PW res: [0x2b59d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503348:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c508e3 lrc: 2/0,0 mode: PW/PW res: [0x2b59d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.503370:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+616:39029:x1731745946399488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 905us (990us total) trans 12885079170 rc 0/0 00000100:00100000:1.0:1651529344.503373:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211118 00010000:00010000:1.0:1651529344.503379:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b4f40cb6/0x3234de053c508ce lrc: 3/0,1 mode: PW/PW res: [0x2b59a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.503382:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4f40cb6/0x3234de053c508ce lrc: 3/0,1 mode: PW/PW res: [0x2b59a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.503384:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+615:39030:x1731745946399424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1031us (1145us total) trans 12885079171 rc 0/0 00010000:00010000:1.0:1651529344.503385:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4f40cb6/0x3234de053c508ce lrc: 3/0,1 mode: PW/PW res: [0x2b59a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.503387:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211117 00010000:00010000:1.0:1651529344.503388:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4f40cb6/0x3234de053c508ce lrc: 2/0,0 mode: PW/PW res: [0x2b59a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503403:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c508ea lrc: 2/0,0 mode: PW/PW res: [0x2b59e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503406:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000010b0a5e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.503407:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c508ea lrc: 2/0,0 mode: PW/PW res: [0x2b59e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503410:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c508ea lrc: 3/0,0 mode: PW/PW res: [0x2b59e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503415:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c508ea lrc: 1/0,0 mode: --/PW res: [0x2b59e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503418:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c508ea lrc: 0/0,0 mode: --/PW res: [0x2b59e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503422:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c508e3 lrc: 2/0,0 mode: PW/PW res: [0x2b59d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.503423:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+615:39030:x1731745946399232:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1155us (1227us total) trans 12885079172 rc 0/0 00010000:00010000:0.0:1651529344.503425:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000734ecdfd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.503425:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c508e3 lrc: 2/0,0 mode: PW/PW res: [0x2b59d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.503427:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211114 00010000:00010000:0.0:1651529344.503428:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c508e3 lrc: 3/0,0 mode: PW/PW res: [0x2b59d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503431:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c508e3 lrc: 1/0,0 mode: --/PW res: [0x2b59d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503434:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c508e3 lrc: 0/0,0 mode: --/PW res: [0x2b59d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503437:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4f40cb6/0x3234de053c508ce lrc: 2/0,0 mode: PW/PW res: [0x2b59a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503440:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b4f40cb6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.503441:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4f40cb6/0x3234de053c508ce lrc: 2/0,0 mode: PW/PW res: [0x2b59a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503444:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4f40cb6/0x3234de053c508ce lrc: 3/0,0 mode: PW/PW res: [0x2b59a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503447:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4f40cb6/0x3234de053c508ce lrc: 1/0,0 mode: --/PW res: [0x2b59a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503449:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4f40cb6/0x3234de053c508ce lrc: 0/0,0 mode: --/PW res: [0x2b59a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503455:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000068ac74b/0x3234de053c508c7 lrc: 3/0,1 mode: PW/PW res: [0x2b599:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503458:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000068ac74b/0x3234de053c508c7 lrc: 3/0,1 mode: PW/PW res: [0x2b599:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503461:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000068ac74b/0x3234de053c508c7 lrc: 3/0,1 mode: PW/PW res: [0x2b599:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503464:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000068ac74b/0x3234de053c508c7 lrc: 2/0,0 mode: PW/PW res: [0x2b599:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.503499:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+615:39029:x1731745946399168:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1284us (1334us total) trans 12885079173 rc 0/0 00000100:00100000:0.0:1651529344.503501:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211113 00010000:00010000:0.0:1651529344.503508:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000068ac74b/0x3234de053c508c7 lrc: 2/0,0 mode: PW/PW res: [0x2b599:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503513:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000068ac74b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.503514:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000068ac74b/0x3234de053c508c7 lrc: 2/0,0 mode: PW/PW res: [0x2b599:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503517:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000068ac74b/0x3234de053c508c7 lrc: 3/0,0 mode: PW/PW res: [0x2b599:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503521:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000068ac74b/0x3234de053c508c7 lrc: 1/0,0 mode: --/PW res: [0x2b599:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503524:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000068ac74b/0x3234de053c508c7 lrc: 0/0,0 mode: --/PW res: [0x2b599:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.503629:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996978368:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.503638:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c508f1 lrc: 3/0,1 mode: --/PW res: [0x2b59f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.503646:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996978432:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.503648:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c508f8 lrc: 3/0,1 mode: --/PW res: [0x2b5a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.503694:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.503710:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.503710:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946400256 00000100:00100000:1.0:1651529344.503717:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.503717:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946400320 00000100:00100000:1.0:1651529344.503724:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.503750:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946400192 00000100:00100000:1.0:1651529344.503751:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.503757:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946400384 00000100:00100000:0.0:1651529344.503762:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946400512 00000100:00100000:0.0:1651529344.503768:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211121 00000100:00100000:0.0:1651529344.503770:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+619:39030:x1731745946400256:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.503774:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:0.0:1651529344.503775:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177570 count 1 00010000:00010000:0.0:1651529344.503779:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c508ff lrc: 3/0,1 mode: --/PW res: [0x2b5a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.503782:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.503784:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006d8276b9/0x3234de053c4eb4d lrc: 2/0,0 mode: PR/PR res: [0x2b5a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ec7 expref: 1446 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.503787:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.503788:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946400448 00010000:00010000:0.0:1651529344.503788:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.503788:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c508ff lrc: 4/0,1 mode: --/PW res: [0x2b5a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.503795:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211122 00000100:00100000:1.0:1651529344.503796:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+620:39029:x1731745946400320:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.503802:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177571 count 1 00010000:00010000:0.0:1651529344.503811:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006d8276b9/0x3234de053c4eb4d lrc: 3/0,0 mode: PR/PR res: [0x2b5a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ec7 expref: 1446 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.503812:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c50906 lrc: 3/0,1 mode: --/PW res: [0x2b5a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503815:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006d8276b9/0x3234de053c4eb4d lrc: 4/0,0 mode: PR/PR res: [0x2b5a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ec7 expref: 1446 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.503818:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000888fed6b/0x3234de053c4c98f lrc: 2/0,0 mode: PR/PR res: [0x2b5a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd7f9 expref: 1446 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.503819:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996978496:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.503821:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.503822:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.503822:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c50906 lrc: 4/0,1 mode: --/PW res: [0x2b5a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.503829:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000888fed6b/0x3234de053c4c98f lrc: 3/0,0 mode: PR/PR res: [0x2b5a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd7f9 expref: 1446 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.503829:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c086aae3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.503833:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000888fed6b/0x3234de053c4c98f lrc: 4/0,0 mode: PR/PR res: [0x2b5a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd7f9 expref: 1446 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.503836:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211123 00000100:00100000:1.0:1651529344.503838:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f39ca9ea pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996978560:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.503838:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+620:39030:x1731745946400192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.503842:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177569 count 1 00010000:00010000:0.0:1651529344.503846:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c5090d lrc: 3/0,1 mode: --/PW res: [0x2b5a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.503847:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e5f43e7 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.503852:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000053520ee/0x3234de053c4a39b lrc: 2/0,0 mode: PR/PR res: [0x2b5a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba24 expref: 1446 pid: 151609 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.503853:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211124 00000100:00100000:1.0:1651529344.503855:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+620:39030:x1731745946400384:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.503855:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.503856:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.503857:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c5090d lrc: 4/0,1 mode: --/PW res: [0x2b5a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.503860:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177572 count 1 00010000:00010000:1.0:1651529344.503863:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50914 lrc: 3/0,1 mode: --/PW res: [0x2b5a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503863:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000053520ee/0x3234de053c4a39b lrc: 3/0,0 mode: PR/PR res: [0x2b5a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba24 expref: 1446 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.503866:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000053520ee/0x3234de053c4a39b lrc: 4/0,0 mode: PR/PR res: [0x2b5a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba24 expref: 1446 pid: 151609 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.503867:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002de03da3/0x3234de053c4cd0f lrc: 2/0,0 mode: PR/PR res: [0x2b5a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce662 expref: 1446 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.503870:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.503870:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.503870:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996978624:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.503871:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50914 lrc: 4/0,1 mode: --/PW res: [0x2b5a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.503877:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002de03da3/0x3234de053c4cd0f lrc: 3/0,0 mode: PR/PR res: [0x2b5a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce662 expref: 1446 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.503877:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000070e666f7 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.503881:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002de03da3/0x3234de053c4cd0f lrc: 4/0,0 mode: PR/PR res: [0x2b5a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce662 expref: 1446 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.503882:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211125 00000100:00100000:0.0:1651529344.503884:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+620:39030:x1731745946400512:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.503885:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d9ef3c1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996978688:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.503888:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177574 count 1 00000100:00100000:1.0:1651529344.503891:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 0000000018ebe812 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.503891:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5091b lrc: 3/0,1 mode: --/PW res: [0x2b5a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503895:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000083c34805/0x3234de053c4c8fc lrc: 2/0,0 mode: PR/PR res: [0x2b5a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd56e expref: 1446 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.503896:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211126 00000100:00100000:1.0:1651529344.503898:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+620:39030:x1731745946400448:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.503898:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.503898:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.503899:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5091b lrc: 4/0,1 mode: --/PW res: [0x2b5a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.503902:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177573 count 1 00010000:00010000:1.0:1651529344.503905:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50922 lrc: 3/0,1 mode: --/PW res: [0x2b5a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503905:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000083c34805/0x3234de053c4c8fc lrc: 3/0,0 mode: PR/PR res: [0x2b5a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd56e expref: 1446 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.503908:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000083c34805/0x3234de053c4c8fc lrc: 4/0,0 mode: PR/PR res: [0x2b5a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd56e expref: 1446 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.503909:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003108b1d9/0x3234de053c4d9f0 lrc: 2/0,0 mode: PR/PR res: [0x2b5a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d186c expref: 1446 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.503912:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.503912:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996978752:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.503913:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.503913:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50922 lrc: 4/0,1 mode: --/PW res: [0x2b5a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.503918:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 0000000009370c1d going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.503919:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003108b1d9/0x3234de053c4d9f0 lrc: 3/0,0 mode: PR/PR res: [0x2b5a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d186c expref: 1446 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.503922:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003108b1d9/0x3234de053c4d9f0 lrc: 4/0,0 mode: PR/PR res: [0x2b5a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d186c expref: 1446 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.503926:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f7006631 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996978816:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.503932:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b52d0f36 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.503940:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396280704 00010000:00010000:1.0:1651529344.503944:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006fcdf095/0x3234de053c4d995 lrc: 4/0,0 mode: PR/PR res: [0x2b59f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d16b3 expref: 1447 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.503951:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11901 00000100:00100000:1.0:1651529344.503953:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1447:41279:x1731746396280704:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.503957:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.503958:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006fcdf095/0x3234de053c4d995 lrc: 4/0,0 mode: PR/PR res: [0x2b59f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d16b3 expref: 1447 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.503962:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006fcdf095/0x3234de053c4d995 lrc: 3/0,0 mode: PR/PR res: [0x2b59f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d16b3 expref: 1447 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.503967:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006fcdf095/0x3234de053c4d995 lrc: 0/0,0 mode: --/PR res: [0x2b59f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d16b3 expref: 1447 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.503971:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.503971:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.503972:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c508f1 lrc: 3/0,1 mode: PW/PW res: [0x2b59f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.503975:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c508f1 lrc: 4/0,1 mode: PW/PW res: [0x2b59f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.503986:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.503989:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c508f1 lrc: 3/0,1 mode: PW/PW res: [0x2b59f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.503992:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1446:41279:x1731746396280704:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 39us (219us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.503993:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c508f1 lrc: 3/0,1 mode: PW/PW res: [0x2b59f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.503995:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11901 00010000:00010000:0.0:1651529344.503996:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c508f1 lrc: 3/0,1 mode: PW/PW res: [0x2b59f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.503999:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c508f1 lrc: 2/0,0 mode: PW/PW res: [0x2b59f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.504020:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.504037:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+621:39030:x1731745946399552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1064us (1120us total) trans 12885079174 rc 0/0 00000100:00100000:0.0:1651529344.504040:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211119 00010000:00010000:0.0:1651529344.504047:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c508f1 lrc: 2/0,0 mode: PW/PW res: [0x2b59f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504051:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a0607df4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.504052:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c508f1 lrc: 2/0,0 mode: PW/PW res: [0x2b59f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504055:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c508f1 lrc: 3/0,0 mode: PW/PW res: [0x2b59f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504059:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c508f1 lrc: 1/0,0 mode: --/PW res: [0x2b59f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504062:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c508f1 lrc: 0/0,0 mode: --/PW res: [0x2b59f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.504116:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396280768 00010000:00010000:1.0:1651529344.504122:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000186c25c6/0x3234de053c4cf23 lrc: 4/0,0 mode: PR/PR res: [0x2b5a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee50 expref: 1446 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.504130:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11902 00000100:00100000:1.0:1651529344.504132:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1446:41278:x1731746396280768:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.504134:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.504135:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000186c25c6/0x3234de053c4cf23 lrc: 4/0,0 mode: PR/PR res: [0x2b5a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee50 expref: 1446 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.504139:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000186c25c6/0x3234de053c4cf23 lrc: 3/0,0 mode: PR/PR res: [0x2b5a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee50 expref: 1446 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.504144:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000186c25c6/0x3234de053c4cf23 lrc: 0/0,0 mode: --/PR res: [0x2b5a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cee50 expref: 1446 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.504148:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.504148:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.504149:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c508f8 lrc: 3/0,1 mode: PW/PW res: [0x2b5a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504152:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c508f8 lrc: 4/0,1 mode: PW/PW res: [0x2b5a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504162:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.504170:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1445:41278:x1731746396280768:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 38us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.504173:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11902 00010000:00010000:0.0:1651529344.504175:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c508f8 lrc: 3/0,1 mode: PW/PW res: [0x2b5a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504178:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c508f8 lrc: 3/0,1 mode: PW/PW res: [0x2b5a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504181:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c508f8 lrc: 3/0,1 mode: PW/PW res: [0x2b5a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504184:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c508f8 lrc: 2/0,0 mode: PW/PW res: [0x2b5a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.504188:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.504249:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c508f8 lrc: 2/0,0 mode: PW/PW res: [0x2b5a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504253:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003865e83e already unused, calling callback (0000000049fddea7) 00000100:00100000:0.0:1651529344.504257:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+621:39029:x1731745946399616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1218us (1276us total) trans 12885079175 rc 0/0 00010000:00010000:1.0:1651529344.504259:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c508f8 lrc: 2/0,0 mode: PW/PW res: [0x2b5a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.504260:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211120 00010000:00010000:1.0:1651529344.504263:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c508f8 lrc: 3/0,0 mode: PW/PW res: [0x2b5a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.504266:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946400640 00010000:00010000:1.0:1651529344.504267:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c508f8 lrc: 1/0,0 mode: --/PW res: [0x2b5a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504270:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003865e83e/0x3234de053c508f8 lrc: 0/0,0 mode: --/PW res: [0x2b5a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.504274:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211127 00000100:00100000:0.0:1651529344.504275:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+621:39029:x1731745946400640:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.504280:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177575 count 1 00010000:00010000:0.0:1651529344.504284:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50929 lrc: 3/0,1 mode: --/PW res: [0x2b5a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504289:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000041494a30/0x3234de053c4cadf lrc: 2/0,0 mode: PR/PR res: [0x2b5a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd24 expref: 1444 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.504292:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.504293:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.504293:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50929 lrc: 4/0,1 mode: --/PW res: [0x2b5a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504300:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000041494a30/0x3234de053c4cadf lrc: 3/0,0 mode: PR/PR res: [0x2b5a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd24 expref: 1444 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.504303:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000041494a30/0x3234de053c4cadf lrc: 4/0,0 mode: PR/PR res: [0x2b5a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd24 expref: 1444 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.504307:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996978880:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.504340:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000003c8b0daf going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.504360:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996978496:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.504364:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c508ff lrc: 3/0,1 mode: --/PW res: [0x2b5a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.504415:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.504425:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946400704 00000100:00100000:0.0:1651529344.504435:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211128 00000100:00100000:0.0:1651529344.504436:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+622:39029:x1731745946400704:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.504442:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177576 count 1 00010000:00010000:0.0:1651529344.504445:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50930 lrc: 3/0,1 mode: --/PW res: [0x2b5a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504450:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000ba57bba/0x3234de053c4e454 lrc: 2/0,0 mode: PR/PR res: [0x2b5a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d427a expref: 1444 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.504453:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.504453:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.504454:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50930 lrc: 4/0,1 mode: --/PW res: [0x2b5a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504460:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000ba57bba/0x3234de053c4e454 lrc: 3/0,0 mode: PR/PR res: [0x2b5a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d427a expref: 1444 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.504464:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000ba57bba/0x3234de053c4e454 lrc: 4/0,0 mode: PR/PR res: [0x2b5a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d427a expref: 1444 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.504468:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996978944:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.504481:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed830649 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.504634:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996978624:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.504638:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c5090d lrc: 3/0,1 mode: --/PW res: [0x2b5a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.504653:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996978752:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.504656:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5091b lrc: 3/0,1 mode: --/PW res: [0x2b5a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.504659:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.504666:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.504672:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.504678:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.504687:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.504687:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396281472 00000100:00100000:1.0:1651529344.504692:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.504692:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000888fed6b/0x3234de053c4c98f lrc: 5/0,0 mode: PR/PR res: [0x2b5a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd7f9 expref: 1445 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.504697:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396281600 00010000:00010000:0.0:1651529344.504705:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000083c34805/0x3234de053c4c8fc lrc: 4/0,0 mode: PR/PR res: [0x2b5a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd56e expref: 1446 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.504707:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f39ca9ea pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996978560:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.504710:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396281280 00010000:00010000:1.0:1651529344.504711:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c50906 lrc: 3/0,1 mode: --/PW res: [0x2b5a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504713:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006d8276b9/0x3234de053c4eb4d lrc: 4/0,0 mode: PR/PR res: [0x2b5a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ec7 expref: 1447 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.504717:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396281408 00000100:00100000:1.0:1651529344.504718:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d9ef3c1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996978688:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.504719:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000053520ee/0x3234de053c4a39b lrc: 4/0,0 mode: PR/PR res: [0x2b5a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba24 expref: 1448 pid: 151609 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.504721:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50914 lrc: 3/0,1 mode: --/PW res: [0x2b5a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.504729:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f7006631 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996978816:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.504732:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50922 lrc: 3/0,1 mode: --/PW res: [0x2b5a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.504746:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396281536 00000100:00100000:1.0:1651529344.504750:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396281664 00010000:00010000:0.0:1651529344.504750:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002de03da3/0x3234de053c4cd0f lrc: 4/0,0 mode: PR/PR res: [0x2b5a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce662 expref: 1449 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.504755:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003108b1d9/0x3234de053c4d9f0 lrc: 4/0,0 mode: PR/PR res: [0x2b5a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d186c expref: 1450 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.504755:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11903 00000100:00100000:0.0:1651529344.504757:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea4c33b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1450:41279:x1731746396281472:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.504760:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.504761:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000888fed6b/0x3234de053c4c98f lrc: 4/0,0 mode: PR/PR res: [0x2b5a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd7f9 expref: 1450 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.504762:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11904 00000100:00100000:1.0:1651529344.504763:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1450:41279:x1731746396281600:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.504765:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000888fed6b/0x3234de053c4c98f lrc: 3/0,0 mode: PR/PR res: [0x2b5a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd7f9 expref: 1450 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.504766:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.504768:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000083c34805/0x3234de053c4c8fc lrc: 4/0,0 mode: PR/PR res: [0x2b5a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd56e expref: 1450 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.504771:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000083c34805/0x3234de053c4c8fc lrc: 3/0,0 mode: PR/PR res: [0x2b5a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd56e expref: 1450 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.504771:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000888fed6b/0x3234de053c4c98f lrc: 0/0,0 mode: --/PR res: [0x2b5a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd7f9 expref: 1450 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.504775:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.504775:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.504776:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c50906 lrc: 3/0,1 mode: PW/PW res: [0x2b5a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504777:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083c34805/0x3234de053c4c8fc lrc: 0/0,0 mode: --/PR res: [0x2b5a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd56e expref: 1449 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.504779:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c50906 lrc: 4/0,1 mode: PW/PW res: [0x2b5a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504780:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.504781:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.504782:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5091b lrc: 3/0,1 mode: PW/PW res: [0x2b5a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504788:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.504794:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5091b lrc: 4/0,1 mode: PW/PW res: [0x2b5a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.504798:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea4c33b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1448:41279:x1731746396281472:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 41us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.504801:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11903 00010000:00010000:1.0:1651529344.504808:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.504816:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1447:41279:x1731746396281600:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 52us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.504817:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11905 00000100:00100000:1.0:1651529344.504819:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11904 00000100:00100000:0.0:1651529344.504819:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1447:41278:x1731746396281280:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.504822:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.504824:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006d8276b9/0x3234de053c4eb4d lrc: 4/0,0 mode: PR/PR res: [0x2b5a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ec7 expref: 1446 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.504825:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11906 00000100:00100000:1.0:1651529344.504826:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1446:41278:x1731746396281408:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.504829:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.504830:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000053520ee/0x3234de053c4a39b lrc: 4/0,0 mode: PR/PR res: [0x2b5a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba24 expref: 1446 pid: 151609 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.504831:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006d8276b9/0x3234de053c4eb4d lrc: 3/0,0 mode: PR/PR res: [0x2b5a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ec7 expref: 1446 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.504834:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000053520ee/0x3234de053c4a39b lrc: 3/0,0 mode: PR/PR res: [0x2b5a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba24 expref: 1446 pid: 151609 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.504835:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d8276b9/0x3234de053c4eb4d lrc: 0/0,0 mode: --/PR res: [0x2b5a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ec7 expref: 1446 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.504839:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000053520ee/0x3234de053c4a39b lrc: 0/0,0 mode: --/PR res: [0x2b5a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba24 expref: 1445 pid: 151609 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.504839:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.504839:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.504840:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c508ff lrc: 3/0,1 mode: PW/PW res: [0x2b5a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504843:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.504843:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.504843:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c508ff lrc: 4/0,1 mode: PW/PW res: [0x2b5a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504844:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c5090d lrc: 3/0,1 mode: PW/PW res: [0x2b5a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504847:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c5090d lrc: 4/0,1 mode: PW/PW res: [0x2b5a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504849:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.504855:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1444:41278:x1731746396281280:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 35us (182us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.504858:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.504863:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1444:41278:x1731746396281408:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 36us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.504863:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11905 00000100:00100000:1.0:1651529344.504866:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11906 00000100:00100000:0.0:1651529344.504868:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11907 00000100:00100000:0.0:1651529344.504870:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1442:41278:x1731746396281536:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.504871:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11908 00000100:00100000:1.0:1651529344.504872:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1442:41278:x1731746396281664:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.504872:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.504874:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002de03da3/0x3234de053c4cd0f lrc: 4/0,0 mode: PR/PR res: [0x2b5a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce662 expref: 1442 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.504875:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.504876:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003108b1d9/0x3234de053c4d9f0 lrc: 4/0,0 mode: PR/PR res: [0x2b5a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d186c expref: 1442 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.504877:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002de03da3/0x3234de053c4cd0f lrc: 3/0,0 mode: PR/PR res: [0x2b5a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce662 expref: 1442 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.504880:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003108b1d9/0x3234de053c4d9f0 lrc: 3/0,0 mode: PR/PR res: [0x2b5a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d186c expref: 1442 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.504882:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002de03da3/0x3234de053c4cd0f lrc: 0/0,0 mode: --/PR res: [0x2b5a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce662 expref: 1442 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.504884:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003108b1d9/0x3234de053c4d9f0 lrc: 0/0,0 mode: --/PR res: [0x2b5a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d186c expref: 1442 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.504886:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.504886:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.504887:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.504887:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50914 lrc: 3/0,1 mode: PW/PW res: [0x2b5a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504888:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.504889:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50922 lrc: 3/0,1 mode: PW/PW res: [0x2b5a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504890:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50914 lrc: 4/0,1 mode: PW/PW res: [0x2b5a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504892:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50922 lrc: 4/0,1 mode: PW/PW res: [0x2b5a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504899:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.504904:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1440:41278:x1731746396281536:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 34us (217us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.504905:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.504907:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11907 00000100:00100000:1.0:1651529344.504910:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1439:41278:x1731746396281664:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 37us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.504913:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11908 00010000:00010000:0.0:1651529344.504913:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c5090d lrc: 3/0,1 mode: PW/PW res: [0x2b5a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504917:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c5090d lrc: 3/0,1 mode: PW/PW res: [0x2b5a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504920:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50914 lrc: 3/0,1 mode: PW/PW res: [0x2b5a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504920:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c5090d lrc: 3/0,1 mode: PW/PW res: [0x2b5a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504922:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c5090d lrc: 2/0,0 mode: PW/PW res: [0x2b5a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504924:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50914 lrc: 3/0,1 mode: PW/PW res: [0x2b5a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504927:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50914 lrc: 3/0,1 mode: PW/PW res: [0x2b5a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504929:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50914 lrc: 2/0,0 mode: PW/PW res: [0x2b5a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.504970:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+624:39030:x1731745946400192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1131us (1252us total) trans 12885079176 rc 0/0 00000100:00100000:0.0:1651529344.504973:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211123 00000100:00100000:1.0:1651529344.504975:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+624:39030:x1731745946400384:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1119us (1251us total) trans 12885079177 rc 0/0 00000100:00100000:1.0:1651529344.504978:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211124 00010000:00010000:0.0:1651529344.504980:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c5090d lrc: 2/0,0 mode: PW/PW res: [0x2b5a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504984:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000085580035 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.504985:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c50906 lrc: 3/0,1 mode: PW/PW res: [0x2b5a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504985:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c5090d lrc: 2/0,0 mode: PW/PW res: [0x2b5a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504988:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c50906 lrc: 3/0,1 mode: PW/PW res: [0x2b5a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504988:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c5090d lrc: 3/0,0 mode: PW/PW res: [0x2b5a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504992:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c50906 lrc: 3/0,1 mode: PW/PW res: [0x2b5a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504992:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c5090d lrc: 1/0,0 mode: --/PW res: [0x2b5a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.504994:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c50906 lrc: 2/0,0 mode: PW/PW res: [0x2b5a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504995:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c5090d lrc: 0/0,0 mode: --/PW res: [0x2b5a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.504999:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50914 lrc: 2/0,0 mode: PW/PW res: [0x2b5a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.505002:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006b93727a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.505003:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50914 lrc: 2/0,0 mode: PW/PW res: [0x2b5a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.505008:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50914 lrc: 3/0,0 mode: PW/PW res: [0x2b5a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.505011:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50914 lrc: 1/0,0 mode: --/PW res: [0x2b5a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.505013:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50914 lrc: 0/0,0 mode: --/PW res: [0x2b5a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.505017:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c50906 lrc: 2/0,0 mode: PW/PW res: [0x2b5a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.505019:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000022a9b983 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.505020:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c50906 lrc: 2/0,0 mode: PW/PW res: [0x2b5a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.505023:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c50906 lrc: 3/0,0 mode: PW/PW res: [0x2b5a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.505026:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c50906 lrc: 1/0,0 mode: --/PW res: [0x2b5a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.505028:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+623:39029:x1731745946400320:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1231us (1317us total) trans 12885079178 rc 0/0 00010000:00010000:0.0:1651529344.505028:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c50906 lrc: 0/0,0 mode: --/PW res: [0x2b5a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.505031:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211122 00010000:00010000:1.0:1651529344.505037:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50922 lrc: 3/0,1 mode: PW/PW res: [0x2b5a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.505038:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996978880:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.505040:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50922 lrc: 3/0,1 mode: PW/PW res: [0x2b5a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.505042:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50929 lrc: 3/0,1 mode: --/PW res: [0x2b5a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.505043:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50922 lrc: 3/0,1 mode: PW/PW res: [0x2b5a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.505046:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50922 lrc: 2/0,0 mode: PW/PW res: [0x2b5a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.505047:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5091b lrc: 3/0,1 mode: PW/PW res: [0x2b5a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.505050:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5091b lrc: 3/0,1 mode: PW/PW res: [0x2b5a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.505061:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5091b lrc: 3/0,1 mode: PW/PW res: [0x2b5a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.505064:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5091b lrc: 2/0,0 mode: PW/PW res: [0x2b5a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.505080:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+623:39030:x1731745946400448:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1181us (1298us total) trans 12885079179 rc 0/0 00000100:00100000:1.0:1651529344.505083:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211126 00010000:00010000:1.0:1651529344.505090:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50922 lrc: 2/0,0 mode: PW/PW res: [0x2b5a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.505093:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000034aad4d already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.505094:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50922 lrc: 2/0,0 mode: PW/PW res: [0x2b5a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.505097:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50922 lrc: 3/0,0 mode: PW/PW res: [0x2b5a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.505101:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+623:39030:x1731745946400512:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1216us (1354us total) trans 12885079180 rc 0/0 00010000:00010000:1.0:1651529344.505102:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50922 lrc: 1/0,0 mode: --/PW res: [0x2b5a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.505104:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211125 00010000:00010000:1.0:1651529344.505105:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50922 lrc: 0/0,0 mode: --/PW res: [0x2b5a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.505109:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5091b lrc: 2/0,0 mode: PW/PW res: [0x2b5a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.505112:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000002904524 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.505112:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c508ff lrc: 3/0,1 mode: PW/PW res: [0x2b5a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.505113:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5091b lrc: 2/0,0 mode: PW/PW res: [0x2b5a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.505115:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5091b lrc: 3/0,0 mode: PW/PW res: [0x2b5a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.505115:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c508ff lrc: 3/0,1 mode: PW/PW res: [0x2b5a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.505118:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c508ff lrc: 3/0,1 mode: PW/PW res: [0x2b5a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.505119:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5091b lrc: 1/0,0 mode: --/PW res: [0x2b5a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.505121:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c5091b lrc: 0/0,0 mode: --/PW res: [0x2b5a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.505121:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c508ff lrc: 2/0,0 mode: PW/PW res: [0x2b5a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.505127:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c508ff lrc: 2/0,0 mode: PW/PW res: [0x2b5a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.505129:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000059e60bfb already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.505130:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c508ff lrc: 2/0,0 mode: PW/PW res: [0x2b5a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.505133:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c508ff lrc: 3/0,0 mode: PW/PW res: [0x2b5a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.505137:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c508ff lrc: 1/0,0 mode: --/PW res: [0x2b5a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.505139:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059e60bfb/0x3234de053c508ff lrc: 0/0,0 mode: --/PW res: [0x2b5a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.505153:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+623:39030:x1731745946400256:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1382us (1460us total) trans 12885079181 rc 0/0 00000100:00100000:0.0:1651529344.505164:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211121 00000100:00100000:1.0:1651529344.505170:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.505174:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996978944:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.505178:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50930 lrc: 3/0,1 mode: --/PW res: [0x2b5a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.505182:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.505268:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396281728 00010000:00010000:1.0:1651529344.505274:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000041494a30/0x3234de053c4cadf lrc: 4/0,0 mode: PR/PR res: [0x2b5a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd24 expref: 1439 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.505281:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396281792 00010000:00010000:1.0:1651529344.505283:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000ba57bba/0x3234de053c4e454 lrc: 4/0,0 mode: PR/PR res: [0x2b5a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d427a expref: 1440 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.505301:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11909 00000100:00100000:1.0:1651529344.505307:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1440:41279:x1731746396281728:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.505310:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.505311:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11910 00010000:00010000:1.0:1651529344.505312:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000041494a30/0x3234de053c4cadf lrc: 4/0,0 mode: PR/PR res: [0x2b5a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd24 expref: 1440 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.505313:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1a0028d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1440:41279:x1731746396281792:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.505316:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000041494a30/0x3234de053c4cadf lrc: 3/0,0 mode: PR/PR res: [0x2b5a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd24 expref: 1440 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.505317:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.505319:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000ba57bba/0x3234de053c4e454 lrc: 4/0,0 mode: PR/PR res: [0x2b5a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d427a expref: 1440 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.505322:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041494a30/0x3234de053c4cadf lrc: 0/0,0 mode: --/PR res: [0x2b5a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd24 expref: 1440 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.505323:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000ba57bba/0x3234de053c4e454 lrc: 3/0,0 mode: PR/PR res: [0x2b5a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d427a expref: 1440 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.505326:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.505326:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.505327:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50929 lrc: 3/0,1 mode: PW/PW res: [0x2b5a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.505330:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50929 lrc: 4/0,1 mode: PW/PW res: [0x2b5a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.505339:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.505349:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1439:41279:x1731746396281728:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 46us (179us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.505350:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ba57bba/0x3234de053c4e454 lrc: 0/0,0 mode: --/PR res: [0x2b5a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d427a expref: 1439 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.505351:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11909 00010000:00010000:0.0:1651529344.505354:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.505355:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.505356:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50930 lrc: 3/0,1 mode: PW/PW res: [0x2b5a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.505359:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50930 lrc: 4/0,1 mode: PW/PW res: [0x2b5a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.505366:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.505374:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1a0028d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1437:41279:x1731746396281792:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 61us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.505377:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11910 00010000:00010000:0.0:1651529344.505389:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50929 lrc: 3/0,1 mode: PW/PW res: [0x2b5a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.505392:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50929 lrc: 3/0,1 mode: PW/PW res: [0x2b5a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.505395:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50929 lrc: 3/0,1 mode: PW/PW res: [0x2b5a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.505398:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50929 lrc: 2/0,0 mode: PW/PW res: [0x2b5a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.505494:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+623:39029:x1731745946400640:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1218us (1306us total) trans 12885079182 rc 0/0 00000100:00100000:0.0:1651529344.505497:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211127 00010000:00010000:0.0:1651529344.505505:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50929 lrc: 2/0,0 mode: PW/PW res: [0x2b5a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.505508:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e0e037e6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.505509:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50929 lrc: 2/0,0 mode: PW/PW res: [0x2b5a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.505514:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50929 lrc: 3/0,0 mode: PW/PW res: [0x2b5a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.505519:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.505519:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50929 lrc: 1/0,0 mode: --/PW res: [0x2b5a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.505521:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50929 lrc: 0/0,0 mode: --/PW res: [0x2b5a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.505534:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946401280 00000100:00100000:0.0:1651529344.505541:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211129 00000100:00100000:0.0:1651529344.505542:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d88281f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+623:39030:x1731745946401280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.505548:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177577 count 1 00000100:00100000:1.0:1651529344.505550:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.505551:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50937 lrc: 3/0,1 mode: --/PW res: [0x2b5a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.505560:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.505562:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f87a625c/0x3234de053c4f2d2 lrc: 2/0,0 mode: PR/PR res: [0x2b5a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e1d expref: 1436 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.505565:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.505566:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.505567:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.505567:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50937 lrc: 4/0,1 mode: --/PW res: [0x2b5a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.505573:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.505573:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f87a625c/0x3234de053c4f2d2 lrc: 3/0,0 mode: PR/PR res: [0x2b5a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e1d expref: 1436 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.505580:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f87a625c/0x3234de053c4f2d2 lrc: 4/0,0 mode: PR/PR res: [0x2b5a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e1d expref: 1436 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.505581:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.505589:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996979008:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.505590:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946401408 00000100:00100000:1.0:1651529344.505596:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946401344 00000100:00100000:1.0:1651529344.505599:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946401472 00000100:00100000:0.0:1651529344.505603:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed830649 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.505610:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946401536 00000100:00100000:0.0:1651529344.505610:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946401600 00000100:00100000:1.0:1651529344.505615:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211130 00000100:00100000:1.0:1651529344.505617:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+628:39030:x1731745946401408:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.505617:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211131 00000100:00100000:0.0:1651529344.505619:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+628:39030:x1731745946401344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.505623:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177579 count 1 00002000:00080000:0.0:1651529344.505623:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177578 count 1 00010000:00010000:0.0:1651529344.505627:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c5093e lrc: 3/0,1 mode: --/PW res: [0x2b5aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.505628:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50945 lrc: 3/0,1 mode: --/PW res: [0x2b5ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.505631:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000006f8ecde/0x3234de053c4e14b lrc: 2/0,0 mode: PR/PR res: [0x2b5aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3602 expref: 1436 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.505633:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a961ca3e/0x3234de053c4d3b4 lrc: 2/0,0 mode: PR/PR res: [0x2b5ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00da expref: 1436 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.505636:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.505636:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.505637:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50945 lrc: 4/0,1 mode: --/PW res: [0x2b5ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.505644:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a961ca3e/0x3234de053c4d3b4 lrc: 3/0,0 mode: PR/PR res: [0x2b5ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00da expref: 1436 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.505648:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a961ca3e/0x3234de053c4d3b4 lrc: 4/0,0 mode: PR/PR res: [0x2b5ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00da expref: 1436 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.505649:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.505650:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.505651:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c5093e lrc: 4/0,1 mode: --/PW res: [0x2b5aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.505652:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004972eb27 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996979072:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.505659:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000006f8ecde/0x3234de053c4e14b lrc: 3/0,0 mode: PR/PR res: [0x2b5aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3602 expref: 1436 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.505661:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 0000000057299e7f going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.505663:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000006f8ecde/0x3234de053c4e14b lrc: 4/0,0 mode: PR/PR res: [0x2b5aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3602 expref: 1436 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.505667:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211132 00000100:00100000:1.0:1651529344.505669:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+628:39030:x1731745946401472:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.505670:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996979136:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.505673:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177580 count 1 00010000:00010000:1.0:1651529344.505676:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c5094c lrc: 3/0,1 mode: --/PW res: [0x2b5ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.505678:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 000000003678d25f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.505680:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c4f4ca lrc: 2/0,0 mode: PR/PR res: [0x2b5ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85be expref: 1436 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.505683:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50930 lrc: 3/0,1 mode: PW/PW res: [0x2b5a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.505684:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.505684:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.505685:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c5094c lrc: 4/0,1 mode: --/PW res: [0x2b5ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.505686:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50930 lrc: 3/0,1 mode: PW/PW res: [0x2b5a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.505689:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50930 lrc: 3/0,1 mode: PW/PW res: [0x2b5a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.505691:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c4f4ca lrc: 3/0,0 mode: PR/PR res: [0x2b5ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85be expref: 1436 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.505692:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50930 lrc: 2/0,0 mode: PW/PW res: [0x2b5a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.505694:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c4f4ca lrc: 4/0,0 mode: PR/PR res: [0x2b5ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85be expref: 1436 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.505698:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000088fa78f8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996979200:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.505713:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 0000000099c1da85 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.505719:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211133 00000100:00100000:1.0:1651529344.505721:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+629:39030:x1731745946401536:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.505725:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177581 count 1 00010000:00010000:1.0:1651529344.505728:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50953 lrc: 3/0,1 mode: --/PW res: [0x2b5ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.505733:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d2aafb48/0x3234de053c4eaeb lrc: 2/0,0 mode: PR/PR res: [0x2b5ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d5b expref: 1436 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.505742:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+629:39029:x1731745946400704:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1296us (1319us total) trans 12885079183 rc 0/0 00000100:00100000:0.0:1651529344.505745:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211128 00010000:00010000:1.0:1651529344.505746:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.505747:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.505747:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50953 lrc: 4/0,1 mode: --/PW res: [0x2b5ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.505750:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211134 00000100:00100000:0.0:1651529344.505752:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+628:39029:x1731745946401600:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.505757:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d2aafb48/0x3234de053c4eaeb lrc: 3/0,0 mode: PR/PR res: [0x2b5ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d5b expref: 1436 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.505757:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177582 count 1 00010000:00010000:1.0:1651529344.505760:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d2aafb48/0x3234de053c4eaeb lrc: 4/0,0 mode: PR/PR res: [0x2b5ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d5b expref: 1436 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.505761:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f9d07bd/0x3234de053c5095a lrc: 3/0,1 mode: --/PW res: [0x2b5ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.505764:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005cc6463a pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996979264:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.505765:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c4f37a lrc: 2/0,0 mode: PR/PR res: [0x2b5ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80b6 expref: 1436 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.505771:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b7af823 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.505771:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.505771:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.505772:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f9d07bd/0x3234de053c5095a lrc: 4/0,1 mode: --/PW res: [0x2b5ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.505778:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c4f37a lrc: 3/0,0 mode: PR/PR res: [0x2b5ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80b6 expref: 1436 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.505779:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50930 lrc: 2/0,0 mode: PW/PW res: [0x2b5a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.505782:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000048c07243 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.505782:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c4f37a lrc: 4/0,0 mode: PR/PR res: [0x2b5ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80b6 expref: 1436 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.505783:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50930 lrc: 2/0,0 mode: PW/PW res: [0x2b5a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.505786:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50930 lrc: 3/0,0 mode: PW/PW res: [0x2b5a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.505786:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996979328:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.505791:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50930 lrc: 1/0,0 mode: --/PW res: [0x2b5a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.505793:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50930 lrc: 0/0,0 mode: --/PW res: [0x2b5a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.505794:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c086aae3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.505808:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.505858:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946401664 00000100:00100000:0.0:1651529344.505866:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211135 00000100:00100000:0.0:1651529344.505868:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+629:39029:x1731745946401664:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.505873:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177583 count 1 00010000:00010000:0.0:1651529344.505877:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005af52cfa/0x3234de053c50961 lrc: 3/0,1 mode: --/PW res: [0x2b5af:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.505882:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000709def90/0x3234de053c4cca6 lrc: 2/0,0 mode: PR/PR res: [0x2b5af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce463 expref: 1436 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.505885:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.505885:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.505886:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005af52cfa/0x3234de053c50961 lrc: 4/0,1 mode: --/PW res: [0x2b5af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.505893:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000709def90/0x3234de053c4cca6 lrc: 3/0,0 mode: PR/PR res: [0x2b5af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce463 expref: 1436 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.505896:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000709def90/0x3234de053c4cca6 lrc: 4/0,0 mode: PR/PR res: [0x2b5af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce463 expref: 1436 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.505900:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996979392:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.505929:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 000000003ad73843 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.505961:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.505971:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946401728 00000100:00100000:0.0:1651529344.505982:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211136 00000100:00100000:0.0:1651529344.505983:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+630:39029:x1731745946401728:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.506003:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177584 count 1 00010000:00010000:0.0:1651529344.506008:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50968 lrc: 3/0,1 mode: --/PW res: [0x2b5b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506012:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba79f088/0x3234de053c4f56b lrc: 2/0,0 mode: PR/PR res: [0x2b5b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8818 expref: 1436 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.506015:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.506016:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.506017:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50968 lrc: 4/0,1 mode: --/PW res: [0x2b5b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506023:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ba79f088/0x3234de053c4f56b lrc: 3/0,0 mode: PR/PR res: [0x2b5b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8818 expref: 1436 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.506029:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ba79f088/0x3234de053c4f56b lrc: 4/0,0 mode: PR/PR res: [0x2b5b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8818 expref: 1436 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.506046:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996979456:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.506068:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c2b2b59c going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.506127:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996979008:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.506137:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50937 lrc: 3/0,1 mode: --/PW res: [0x2b5a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.506144:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996979136:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.506147:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004972eb27 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996979072:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.506147:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c5093e lrc: 3/0,1 mode: --/PW res: [0x2b5aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506152:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50945 lrc: 3/0,1 mode: --/PW res: [0x2b5ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.506159:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000088fa78f8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996979200:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.506161:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c5094c lrc: 3/0,1 mode: --/PW res: [0x2b5ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.506166:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005cc6463a pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996979264:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.506169:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50953 lrc: 3/0,1 mode: --/PW res: [0x2b5ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.506361:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.506368:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.506377:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396282368 00000100:00100000:0.0:1651529344.506377:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.506386:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.506393:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f87a625c/0x3234de053c4f2d2 lrc: 4/0,0 mode: PR/PR res: [0x2b5a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e1d expref: 1437 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.506393:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.506398:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.506399:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396282432 00010000:00010000:1.0:1651529344.506402:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a961ca3e/0x3234de053c4d3b4 lrc: 4/0,0 mode: PR/PR res: [0x2b5ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00da expref: 1438 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.506405:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.506406:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396282560 00010000:00010000:1.0:1651529344.506408:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c4f4ca lrc: 4/0,0 mode: PR/PR res: [0x2b5ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85be expref: 1439 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.506412:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396282496 00000100:00100000:0.0:1651529344.506412:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996979328:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.506414:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000006f8ecde/0x3234de053c4e14b lrc: 4/0,0 mode: PR/PR res: [0x2b5aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3602 expref: 1440 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.506417:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008f9d07bd/0x3234de053c5095a lrc: 3/0,1 mode: --/PW res: [0x2b5ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.506421:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396282688 00010000:00010000:1.0:1651529344.506423:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c4f37a lrc: 4/0,0 mode: PR/PR res: [0x2b5ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80b6 expref: 1441 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.506426:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996979392:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.506427:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396282624 00010000:00010000:0.0:1651529344.506428:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005af52cfa/0x3234de053c50961 lrc: 3/0,1 mode: --/PW res: [0x2b5af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506429:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d2aafb48/0x3234de053c4eaeb lrc: 4/0,0 mode: PR/PR res: [0x2b5ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d5b expref: 1442 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.506432:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396282752 00010000:00010000:1.0:1651529344.506434:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000709def90/0x3234de053c4cca6 lrc: 4/0,0 mode: PR/PR res: [0x2b5af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce463 expref: 1443 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.506435:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11911 00000100:00100000:1.0:1651529344.506439:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11912 00000100:00100000:1.0:1651529344.506440:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1443:41278:x1731746396282432:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.506443:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.506444:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a961ca3e/0x3234de053c4d3b4 lrc: 4/0,0 mode: PR/PR res: [0x2b5ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00da expref: 1443 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.506447:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a961ca3e/0x3234de053c4d3b4 lrc: 3/0,0 mode: PR/PR res: [0x2b5ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00da expref: 1443 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.506455:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1443:41279:x1731746396282368:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.506459:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a961ca3e/0x3234de053c4d3b4 lrc: 0/0,0 mode: --/PR res: [0x2b5ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00da expref: 1443 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.506459:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.506461:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f87a625c/0x3234de053c4f2d2 lrc: 4/0,0 mode: PR/PR res: [0x2b5a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e1d expref: 1443 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.506463:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.506464:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.506465:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50945 lrc: 3/0,1 mode: PW/PW res: [0x2b5ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506466:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f87a625c/0x3234de053c4f2d2 lrc: 3/0,0 mode: PR/PR res: [0x2b5a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e1d expref: 1442 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.506468:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50945 lrc: 4/0,1 mode: PW/PW res: [0x2b5ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506471:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f87a625c/0x3234de053c4f2d2 lrc: 0/0,0 mode: --/PR res: [0x2b5a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e1d expref: 1442 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.506474:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.506475:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.506476:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.506477:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50937 lrc: 3/0,1 mode: PW/PW res: [0x2b5a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506480:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50937 lrc: 4/0,1 mode: PW/PW res: [0x2b5a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.506486:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1441:41278:x1731746396282432:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 45us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.506489:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11912 00010000:00010000:0.0:1651529344.506491:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.506494:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11913 00000100:00100000:1.0:1651529344.506495:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1440:41278:x1731746396282560:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.506498:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.506499:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c4f4ca lrc: 4/0,0 mode: PR/PR res: [0x2b5ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85be expref: 1440 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.506499:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1440:41279:x1731746396282368:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 62us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.506502:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11911 00010000:00010000:1.0:1651529344.506503:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c4f4ca lrc: 3/0,0 mode: PR/PR res: [0x2b5ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85be expref: 1440 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.506508:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c4f4ca lrc: 0/0,0 mode: --/PR res: [0x2b5ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85be expref: 1439 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.506508:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11914 00000100:00100000:0.0:1651529344.506510:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1439:41279:x1731746396282496:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.506511:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.506512:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.506512:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.506513:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c5094c lrc: 3/0,1 mode: PW/PW res: [0x2b5ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506514:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000006f8ecde/0x3234de053c4e14b lrc: 4/0,0 mode: PR/PR res: [0x2b5aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3602 expref: 1438 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.506518:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c5094c lrc: 4/0,1 mode: PW/PW res: [0x2b5ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506518:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000006f8ecde/0x3234de053c4e14b lrc: 3/0,0 mode: PR/PR res: [0x2b5aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3602 expref: 1438 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.506523:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006f8ecde/0x3234de053c4e14b lrc: 0/0,0 mode: --/PR res: [0x2b5aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3602 expref: 1438 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.506524:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.506526:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.506527:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.506528:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c5093e lrc: 3/0,1 mode: PW/PW res: [0x2b5aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.506529:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1437:41278:x1731746396282560:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 34us (152us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.506530:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c5093e lrc: 4/0,1 mode: PW/PW res: [0x2b5aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.506532:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11913 00000100:00100000:1.0:1651529344.506536:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11915 00010000:00010000:0.0:1651529344.506536:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.506537:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1436:41278:x1731746396282688:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.506539:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.506541:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c4f37a lrc: 4/0,0 mode: PR/PR res: [0x2b5ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80b6 expref: 1436 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.506541:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1436:41279:x1731746396282496:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 30us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.506543:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11914 00010000:00010000:1.0:1651529344.506544:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c4f37a lrc: 3/0,0 mode: PR/PR res: [0x2b5ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80b6 expref: 1436 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.506548:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11916 00010000:00010000:1.0:1651529344.506549:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c4f37a lrc: 0/0,0 mode: --/PR res: [0x2b5ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80b6 expref: 1435 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.506549:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1435:41279:x1731746396282624:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.506551:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.506552:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.506553:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.506553:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008f9d07bd/0x3234de053c5095a lrc: 3/0,1 mode: PW/PW res: [0x2b5ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506553:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d2aafb48/0x3234de053c4eaeb lrc: 4/0,0 mode: PR/PR res: [0x2b5ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d5b expref: 1434 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.506556:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f9d07bd/0x3234de053c5095a lrc: 4/0,1 mode: PW/PW res: [0x2b5ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506556:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d2aafb48/0x3234de053c4eaeb lrc: 3/0,0 mode: PR/PR res: [0x2b5ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d5b expref: 1434 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.506561:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2aafb48/0x3234de053c4eaeb lrc: 0/0,0 mode: --/PR res: [0x2b5ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d5b expref: 1434 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.506564:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.506564:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.506567:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.506571:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50953 lrc: 3/0,1 mode: PW/PW res: [0x2b5ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.506572:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1433:41278:x1731746396282688:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 34us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.506575:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11915 00010000:00010000:0.0:1651529344.506575:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50953 lrc: 4/0,1 mode: PW/PW res: [0x2b5ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.506579:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11917 00000100:00100000:1.0:1651529344.506580:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012f61efb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1432:41279:x1731746396282752:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.506583:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.506589:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.506589:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1432:41279:x1731746396282624:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 39us (191us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.506590:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000709def90/0x3234de053c4cca6 lrc: 4/0,0 mode: PR/PR res: [0x2b5af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce463 expref: 1432 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.506591:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11916 00010000:00010000:1.0:1651529344.506594:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000709def90/0x3234de053c4cca6 lrc: 3/0,0 mode: PR/PR res: [0x2b5af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce463 expref: 1431 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.506598:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c5093e lrc: 3/0,1 mode: PW/PW res: [0x2b5aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506599:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000709def90/0x3234de053c4cca6 lrc: 0/0,0 mode: --/PR res: [0x2b5af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce463 expref: 1431 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.506601:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c5093e lrc: 3/0,1 mode: PW/PW res: [0x2b5aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506602:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.506603:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.506604:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005af52cfa/0x3234de053c50961 lrc: 3/0,1 mode: PW/PW res: [0x2b5af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506605:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c5093e lrc: 3/0,1 mode: PW/PW res: [0x2b5aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506607:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005af52cfa/0x3234de053c50961 lrc: 4/0,1 mode: PW/PW res: [0x2b5af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506608:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c5093e lrc: 2/0,0 mode: PW/PW res: [0x2b5aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506615:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.506620:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012f61efb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1430:41279:x1731746396282752:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 39us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.506623:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11917 00010000:00010000:1.0:1651529344.506634:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50953 lrc: 3/0,1 mode: PW/PW res: [0x2b5ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506638:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50953 lrc: 3/0,1 mode: PW/PW res: [0x2b5ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506641:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50953 lrc: 3/0,1 mode: PW/PW res: [0x2b5ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506643:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50953 lrc: 2/0,0 mode: PW/PW res: [0x2b5ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.506660:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+631:39030:x1731745946401344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1040us (1099us total) trans 12885079184 rc 0/0 00000100:00100000:0.0:1651529344.506663:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211131 00010000:00010000:0.0:1651529344.506670:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c5093e lrc: 2/0,0 mode: PW/PW res: [0x2b5aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506673:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000069f7ba22 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.506674:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c5093e lrc: 2/0,0 mode: PW/PW res: [0x2b5aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506677:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c5093e lrc: 3/0,0 mode: PW/PW res: [0x2b5aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506681:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c5093e lrc: 1/0,0 mode: --/PW res: [0x2b5aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506684:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c5093e lrc: 0/0,0 mode: --/PW res: [0x2b5aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.506686:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+631:39030:x1731745946401536:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 965us (1105us total) trans 12885079185 rc 0/0 00010000:00010000:0.0:1651529344.506689:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50953 lrc: 2/0,0 mode: PW/PW res: [0x2b5ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.506690:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211133 00010000:00010000:0.0:1651529344.506692:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003b0cd546 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.506693:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50953 lrc: 2/0,0 mode: PW/PW res: [0x2b5ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506695:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50953 lrc: 3/0,0 mode: PW/PW res: [0x2b5ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506696:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c5094c lrc: 3/0,1 mode: PW/PW res: [0x2b5ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506698:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50953 lrc: 1/0,0 mode: --/PW res: [0x2b5ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506699:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c5094c lrc: 3/0,1 mode: PW/PW res: [0x2b5ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506701:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50953 lrc: 0/0,0 mode: --/PW res: [0x2b5ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506702:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c5094c lrc: 3/0,1 mode: PW/PW res: [0x2b5ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506705:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c5094c lrc: 2/0,0 mode: PW/PW res: [0x2b5ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506706:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50937 lrc: 3/0,1 mode: PW/PW res: [0x2b5a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506709:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50937 lrc: 3/0,1 mode: PW/PW res: [0x2b5a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506712:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50937 lrc: 3/0,1 mode: PW/PW res: [0x2b5a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506715:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50937 lrc: 2/0,0 mode: PW/PW res: [0x2b5a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.506750:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+632:39030:x1731745946401472:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1080us (1182us total) trans 12885079186 rc 0/0 00000100:00100000:1.0:1651529344.506753:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211132 00010000:00010000:1.0:1651529344.506760:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50945 lrc: 3/0,1 mode: PW/PW res: [0x2b5ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.506762:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d88281f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+631:39030:x1731745946401280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1218us (1243us total) trans 12885079187 rc 0/0 00010000:00010000:1.0:1651529344.506763:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50945 lrc: 3/0,1 mode: PW/PW res: [0x2b5ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.506765:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211129 00010000:00010000:1.0:1651529344.506766:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50945 lrc: 3/0,1 mode: PW/PW res: [0x2b5ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506769:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50945 lrc: 2/0,0 mode: PW/PW res: [0x2b5ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506792:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c5094c lrc: 2/0,0 mode: PW/PW res: [0x2b5ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506796:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000827909ec already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.506797:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c5094c lrc: 2/0,0 mode: PW/PW res: [0x2b5ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506800:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c5094c lrc: 3/0,0 mode: PW/PW res: [0x2b5ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506804:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c5094c lrc: 1/0,0 mode: --/PW res: [0x2b5ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.506806:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+631:39030:x1731745946401408:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1189us (1256us total) trans 12885079188 rc 0/0 00010000:00010000:0.0:1651529344.506807:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c5094c lrc: 0/0,0 mode: --/PW res: [0x2b5ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.506809:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211130 00010000:00010000:0.0:1651529344.506811:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50937 lrc: 2/0,0 mode: PW/PW res: [0x2b5a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506814:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001d253066 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.506815:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50937 lrc: 2/0,0 mode: PW/PW res: [0x2b5a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506816:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50945 lrc: 2/0,0 mode: PW/PW res: [0x2b5ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506817:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50937 lrc: 3/0,0 mode: PW/PW res: [0x2b5a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506819:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d9ada8a3 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.506820:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50945 lrc: 2/0,0 mode: PW/PW res: [0x2b5ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506823:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50945 lrc: 3/0,0 mode: PW/PW res: [0x2b5ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506823:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50937 lrc: 1/0,0 mode: --/PW res: [0x2b5a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506826:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50937 lrc: 0/0,0 mode: --/PW res: [0x2b5a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506828:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50945 lrc: 1/0,0 mode: --/PW res: [0x2b5ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.506831:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50945 lrc: 0/0,0 mode: --/PW res: [0x2b5ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506831:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008f9d07bd/0x3234de053c5095a lrc: 3/0,1 mode: PW/PW res: [0x2b5ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506834:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f9d07bd/0x3234de053c5095a lrc: 3/0,1 mode: PW/PW res: [0x2b5ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506837:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f9d07bd/0x3234de053c5095a lrc: 3/0,1 mode: PW/PW res: [0x2b5ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506840:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f9d07bd/0x3234de053c5095a lrc: 2/0,0 mode: PW/PW res: [0x2b5ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.506872:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.506881:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+631:39029:x1731745946401600:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1128us (1308us total) trans 12885079189 rc 0/0 00000100:00100000:0.0:1651529344.506884:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211134 00010000:00010000:0.0:1651529344.506891:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f9d07bd/0x3234de053c5095a lrc: 2/0,0 mode: PW/PW res: [0x2b5ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506895:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008f9d07bd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.506896:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f9d07bd/0x3234de053c5095a lrc: 2/0,0 mode: PW/PW res: [0x2b5ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506899:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f9d07bd/0x3234de053c5095a lrc: 3/0,0 mode: PW/PW res: [0x2b5ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506903:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f9d07bd/0x3234de053c5095a lrc: 1/0,0 mode: --/PW res: [0x2b5ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506906:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f9d07bd/0x3234de053c5095a lrc: 0/0,0 mode: --/PW res: [0x2b5ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.506915:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996979456:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.506919:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50968 lrc: 3/0,1 mode: --/PW res: [0x2b5b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506924:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005af52cfa/0x3234de053c50961 lrc: 3/0,1 mode: PW/PW res: [0x2b5af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506927:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005af52cfa/0x3234de053c50961 lrc: 3/0,1 mode: PW/PW res: [0x2b5af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506930:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005af52cfa/0x3234de053c50961 lrc: 3/0,1 mode: PW/PW res: [0x2b5af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.506932:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005af52cfa/0x3234de053c50961 lrc: 2/0,0 mode: PW/PW res: [0x2b5af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.506966:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+631:39029:x1731745946401664:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1097us (1158us total) trans 12885079190 rc 0/0 00000100:00100000:0.0:1651529344.506969:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211135 00010000:00010000:0.0:1651529344.506998:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005af52cfa/0x3234de053c50961 lrc: 2/0,0 mode: PW/PW res: [0x2b5af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.507002:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005af52cfa already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.507015:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005af52cfa/0x3234de053c50961 lrc: 2/0,0 mode: PW/PW res: [0x2b5af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.507018:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005af52cfa/0x3234de053c50961 lrc: 3/0,0 mode: PW/PW res: [0x2b5af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.507020:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396282816 00010000:00010000:0.0:1651529344.507023:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005af52cfa/0x3234de053c50961 lrc: 1/0,0 mode: --/PW res: [0x2b5af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.507025:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005af52cfa/0x3234de053c50961 lrc: 0/0,0 mode: --/PW res: [0x2b5af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.507026:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ba79f088/0x3234de053c4f56b lrc: 4/0,0 mode: PR/PR res: [0x2b5b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8818 expref: 1430 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.507034:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11918 00000100:00100000:1.0:1651529344.507036:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1430:41279:x1731746396282816:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.507039:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.507040:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ba79f088/0x3234de053c4f56b lrc: 4/0,0 mode: PR/PR res: [0x2b5b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8818 expref: 1430 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.507044:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ba79f088/0x3234de053c4f56b lrc: 3/0,0 mode: PR/PR res: [0x2b5b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8818 expref: 1430 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.507049:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba79f088/0x3234de053c4f56b lrc: 0/0,0 mode: --/PR res: [0x2b5b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8818 expref: 1430 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.507053:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.507054:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.507054:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50968 lrc: 3/0,1 mode: PW/PW res: [0x2b5b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.507058:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50968 lrc: 4/0,1 mode: PW/PW res: [0x2b5b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.507068:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.507070:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50968 lrc: 3/0,1 mode: PW/PW res: [0x2b5b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.507074:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50968 lrc: 3/0,1 mode: PW/PW res: [0x2b5b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.507077:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1429:41279:x1731746396282816:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (205us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.507077:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50968 lrc: 3/0,1 mode: PW/PW res: [0x2b5b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.507079:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11918 00010000:00010000:0.0:1651529344.507080:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50968 lrc: 2/0,0 mode: PW/PW res: [0x2b5b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.507109:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50968 lrc: 2/0,0 mode: PW/PW res: [0x2b5b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.507118:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005d8a4887 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.507119:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50968 lrc: 2/0,0 mode: PW/PW res: [0x2b5b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.507122:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50968 lrc: 3/0,0 mode: PW/PW res: [0x2b5b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.507127:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50968 lrc: 1/0,0 mode: --/PW res: [0x2b5b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.507130:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50968 lrc: 0/0,0 mode: --/PW res: [0x2b5b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.507153:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+631:39029:x1731745946401728:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1169us (1192us total) trans 12885079191 rc 0/0 00000100:00100000:0.0:1651529344.507156:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211136 00000100:00100000:1.0:1651529344.507210:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.507220:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.507248:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946402304 00000100:00100000:0.0:1651529344.507255:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946402432 00000100:00100000:1.0:1651529344.507257:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.507268:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946402368 00000100:00100000:0.0:1651529344.507276:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211137 00000100:00100000:0.0:1651529344.507277:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+633:39030:x1731745946402304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.507278:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.507283:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177585 count 1 00000100:00100000:1.0:1651529344.507285:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.507288:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c5096f lrc: 3/0,1 mode: --/PW res: [0x2b5b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.507294:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.507302:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.507310:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.507311:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000010ccc8bd/0x3234de053c4f5b8 lrc: 2/0,0 mode: PR/PR res: [0x2b5b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d895a expref: 1428 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.507315:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.507315:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.507316:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c5096f lrc: 4/0,1 mode: --/PW res: [0x2b5b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.507317:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946402496 00000100:00100000:1.0:1651529344.507323:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946402560 00010000:00010000:0.0:1651529344.507323:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000010ccc8bd/0x3234de053c4f5b8 lrc: 3/0,0 mode: PR/PR res: [0x2b5b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d895a expref: 1428 pid: 156655 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.507325:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946402688 00000100:00100000:1.0:1651529344.507327:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946402624 00010000:00010000:0.0:1651529344.507327:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000010ccc8bd/0x3234de053c4f5b8 lrc: 4/0,0 mode: PR/PR res: [0x2b5b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d895a expref: 1428 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.507329:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946402752 00000100:00100000:1.0:1651529344.507332:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211138 00000100:00100000:1.0:1651529344.507334:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+638:39030:x1731745946402432:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.507334:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996979520:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.507339:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177587 count 1 00010000:00010000:1.0:1651529344.507344:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c50976 lrc: 3/0,1 mode: --/PW res: [0x2b5b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.507346:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c0dff858 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.507348:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cf9b9901/0x3234de053c4d07a lrc: 2/0,0 mode: PR/PR res: [0x2b5b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf366 expref: 1428 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.507352:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.507352:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.507352:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211139 00010000:00010000:1.0:1651529344.507353:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c50976 lrc: 4/0,1 mode: --/PW res: [0x2b5b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.507354:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+638:39030:x1731745946402368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.507358:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177586 count 1 00010000:00010000:1.0:1651529344.507360:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cf9b9901/0x3234de053c4d07a lrc: 3/0,0 mode: PR/PR res: [0x2b5b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf366 expref: 1428 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.507362:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c5097d lrc: 3/0,1 mode: --/PW res: [0x2b5b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.507363:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cf9b9901/0x3234de053c4d07a lrc: 4/0,0 mode: PR/PR res: [0x2b5b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf366 expref: 1428 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.507366:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c49fb2 lrc: 2/0,0 mode: PR/PR res: [0x2b5b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb50e expref: 1428 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.507369:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.507370:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000078f9a278 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996979584:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.507370:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.507370:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c5097d lrc: 4/0,1 mode: --/PW res: [0x2b5b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.507376:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c49fb2 lrc: 3/0,0 mode: PR/PR res: [0x2b5b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb50e expref: 1428 pid: 72397 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.507379:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 0000000057299e7f going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.507380:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c49fb2 lrc: 4/0,0 mode: PR/PR res: [0x2b5b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb50e expref: 1428 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.507384:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996979648:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.507385:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211140 00000100:00100000:1.0:1651529344.507387:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+638:39030:x1731745946402496:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.507390:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 000000000a4def41 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.507391:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177588 count 1 00010000:00010000:1.0:1651529344.507395:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c50984 lrc: 3/0,1 mode: --/PW res: [0x2b5b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.507396:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211141 00000100:00100000:0.0:1651529344.507398:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+638:39029:x1731745946402560:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.507399:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dc67b411/0x3234de053c4a01b lrc: 2/0,0 mode: PR/PR res: [0x2b5b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5fc expref: 1428 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.507402:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.507402:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:0.0:1651529344.507402:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177589 count 1 00010000:00010000:1.0:1651529344.507403:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c50984 lrc: 4/0,1 mode: --/PW res: [0x2b5b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.507405:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c5098b lrc: 3/0,1 mode: --/PW res: [0x2b5b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.507409:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dc67b411/0x3234de053c4a01b lrc: 3/0,0 mode: PR/PR res: [0x2b5b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5fc expref: 1428 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.507409:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009f2d383f/0x3234de053c4bf24 lrc: 2/0,0 mode: PR/PR res: [0x2b5b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc705 expref: 1428 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.507412:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dc67b411/0x3234de053c4a01b lrc: 4/0,0 mode: PR/PR res: [0x2b5b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5fc expref: 1428 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.507412:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.507412:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.507413:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c5098b lrc: 4/0,1 mode: --/PW res: [0x2b5b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.507416:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002a957ba7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996979712:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.507418:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009f2d383f/0x3234de053c4bf24 lrc: 3/0,0 mode: PR/PR res: [0x2b5b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc705 expref: 1428 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.507422:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009f2d383f/0x3234de053c4bf24 lrc: 4/0,0 mode: PR/PR res: [0x2b5b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc705 expref: 1428 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.507423:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 0000000099c1da85 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.507426:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996979776:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.507428:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211142 00000100:00100000:1.0:1651529344.507430:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+638:39030:x1731745946402688:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.507432:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000003ad73843 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.507434:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177591 count 1 00010000:00010000:1.0:1651529344.507437:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c50992 lrc: 3/0,1 mode: --/PW res: [0x2b5b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.507437:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211143 00000100:00100000:0.0:1651529344.507439:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+638:39030:x1731745946402624:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.507441:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000055c564af/0x3234de053c4f238 lrc: 2/0,0 mode: PR/PR res: [0x2b5b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b99 expref: 1428 pid: 72396 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.507443:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177590 count 1 00010000:00010000:1.0:1651529344.507444:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.507444:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.507445:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c50992 lrc: 4/0,1 mode: --/PW res: [0x2b5b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.507446:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50999 lrc: 3/0,1 mode: --/PW res: [0x2b5b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.507450:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000055c564af/0x3234de053c4f238 lrc: 3/0,0 mode: PR/PR res: [0x2b5b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b99 expref: 1428 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.507452:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000b4c7160/0x3234de053c4affe lrc: 2/0,0 mode: PR/PR res: [0x2b5b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc00c expref: 1428 pid: 80281 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.507454:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000055c564af/0x3234de053c4f238 lrc: 4/0,0 mode: PR/PR res: [0x2b5b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b99 expref: 1428 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.507455:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.507456:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.507456:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50999 lrc: 4/0,1 mode: --/PW res: [0x2b5b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.507458:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000089d7f5d6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996979840:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.507462:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000b4c7160/0x3234de053c4affe lrc: 3/0,0 mode: PR/PR res: [0x2b5b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc00c expref: 1428 pid: 80281 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.507464:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a4eb401d going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.507465:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000b4c7160/0x3234de053c4affe lrc: 4/0,0 mode: PR/PR res: [0x2b5b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc00c expref: 1428 pid: 80281 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.507469:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211144 00000100:00100000:0.0:1651529344.507469:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996979904:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.507471:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+638:39029:x1731745946402752:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.507475:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177592 count 1 00000100:00100000:0.0:1651529344.507475:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c086aae3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.507478:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c509a0 lrc: 3/0,1 mode: --/PW res: [0x2b5b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.507484:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c4ecf1 lrc: 2/0,0 mode: PR/PR res: [0x2b5b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d656c expref: 1428 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.507487:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.507488:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.507488:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c509a0 lrc: 4/0,1 mode: --/PW res: [0x2b5b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.507494:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c4ecf1 lrc: 3/0,0 mode: PR/PR res: [0x2b5b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d656c expref: 1428 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.507498:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c4ecf1 lrc: 4/0,0 mode: PR/PR res: [0x2b5b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d656c expref: 1428 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.507502:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000093ddaf92 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996979968:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.507521:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d09f5ee1 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.507689:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996979520:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.507694:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c5096f lrc: 3/0,1 mode: --/PW res: [0x2b5b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.507710:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000078f9a278 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996979584:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.507715:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c50976 lrc: 3/0,1 mode: --/PW res: [0x2b5b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.508028:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002a957ba7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996979712:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.508043:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c50984 lrc: 3/0,1 mode: --/PW res: [0x2b5b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.508044:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.508053:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.508061:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000089d7f5d6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996979840:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.508061:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.508068:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c50992 lrc: 3/0,1 mode: --/PW res: [0x2b5b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.508069:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.508075:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396283392 00000100:00100000:0.0:1651529344.508076:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.508080:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000010ccc8bd/0x3234de053c4f5b8 lrc: 4/0,0 mode: PR/PR res: [0x2b5b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d895a expref: 1429 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.508081:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.508086:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396283456 00000100:00100000:0.0:1651529344.508087:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.508088:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cf9b9901/0x3234de053c4d07a lrc: 4/0,0 mode: PR/PR res: [0x2b5b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf366 expref: 1430 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.508092:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396283584 00010000:00010000:1.0:1651529344.508094:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009f2d383f/0x3234de053c4bf24 lrc: 5/0,0 mode: PR/PR res: [0x2b5b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc705 expref: 1431 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.508095:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996979648:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.508098:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396283520 00010000:00010000:0.0:1651529344.508099:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c5097d lrc: 3/0,1 mode: --/PW res: [0x2b5b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.508100:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c49fb2 lrc: 4/0,0 mode: PR/PR res: [0x2b5b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb50e expref: 1432 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.508104:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396283648 00010000:00010000:1.0:1651529344.508106:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dc67b411/0x3234de053c4a01b lrc: 4/0,0 mode: PR/PR res: [0x2b5b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5fc expref: 1433 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.508106:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996979776:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.508109:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c5098b lrc: 3/0,1 mode: --/PW res: [0x2b5b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.508110:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396283712 00010000:00010000:1.0:1651529344.508112:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000055c564af/0x3234de053c4f238 lrc: 4/0,0 mode: PR/PR res: [0x2b5b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b99 expref: 1434 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.508114:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996979904:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.508115:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396283776 00010000:00010000:0.0:1651529344.508116:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50999 lrc: 3/0,1 mode: --/PW res: [0x2b5b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.508118:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000b4c7160/0x3234de053c4affe lrc: 4/0,0 mode: PR/PR res: [0x2b5b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc00c expref: 1435 pid: 80281 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.508128:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11919 00000100:00100000:1.0:1651529344.508129:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1435:41279:x1731746396283392:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.508132:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.508134:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000010ccc8bd/0x3234de053c4f5b8 lrc: 4/0,0 mode: PR/PR res: [0x2b5b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d895a expref: 1435 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.508142:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000010ccc8bd/0x3234de053c4f5b8 lrc: 3/0,0 mode: PR/PR res: [0x2b5b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d895a expref: 1435 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.508142:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11920 00000100:00100000:0.0:1651529344.508144:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1435:41279:x1731746396283456:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.508148:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.508149:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010ccc8bd/0x3234de053c4f5b8 lrc: 0/0,0 mode: --/PR res: [0x2b5b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d895a expref: 1435 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.508150:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cf9b9901/0x3234de053c4d07a lrc: 4/0,0 mode: PR/PR res: [0x2b5b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf366 expref: 1435 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.508152:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.508153:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.508154:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c5096f lrc: 3/0,1 mode: PW/PW res: [0x2b5b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508154:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cf9b9901/0x3234de053c4d07a lrc: 3/0,0 mode: PR/PR res: [0x2b5b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf366 expref: 1434 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.508157:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c5096f lrc: 4/0,1 mode: PW/PW res: [0x2b5b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508160:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf9b9901/0x3234de053c4d07a lrc: 0/0,0 mode: --/PR res: [0x2b5b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf366 expref: 1434 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.508166:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.508172:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.508173:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.508174:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c50976 lrc: 3/0,1 mode: PW/PW res: [0x2b5b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.508177:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1433:41279:x1731746396283392:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 47us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.508180:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11919 00010000:00010000:0.0:1651529344.508181:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c50976 lrc: 4/0,1 mode: PW/PW res: [0x2b5b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.508185:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11921 00000100:00100000:1.0:1651529344.508187:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1432:41278:x1731746396283584:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.508190:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.508195:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.508197:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009f2d383f/0x3234de053c4bf24 lrc: 4/0,0 mode: PR/PR res: [0x2b5b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc705 expref: 1432 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.508198:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1432:41279:x1731746396283456:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 54us (145us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.508200:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009f2d383f/0x3234de053c4bf24 lrc: 3/0,0 mode: PR/PR res: [0x2b5b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc705 expref: 1432 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.508201:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11920 00010000:00010000:1.0:1651529344.508205:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f2d383f/0x3234de053c4bf24 lrc: 0/0,0 mode: --/PR res: [0x2b5b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc705 expref: 1431 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.508207:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11922 00000100:00100000:0.0:1651529344.508208:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1431:41279:x1731746396283520:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.508209:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.508210:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.508210:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c5098b lrc: 3/0,1 mode: PW/PW res: [0x2b5b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508211:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.508212:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c49fb2 lrc: 4/0,0 mode: PR/PR res: [0x2b5b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb50e expref: 1430 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.508213:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c5098b lrc: 4/0,1 mode: PW/PW res: [0x2b5b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508216:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c49fb2 lrc: 3/0,0 mode: PR/PR res: [0x2b5b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb50e expref: 1430 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.508232:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.508239:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1430:41278:x1731746396283584:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 51us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.508242:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11921 00010000:00010000:0.0:1651529344.508244:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c49fb2 lrc: 0/0,0 mode: --/PR res: [0x2b5b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb50e expref: 1429 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.508246:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11923 00000100:00100000:1.0:1651529344.508248:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1428:41279:x1731746396283648:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.508248:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.508249:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.508250:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.508250:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c5097d lrc: 3/0,1 mode: PW/PW res: [0x2b5b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.508252:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dc67b411/0x3234de053c4a01b lrc: 4/0,0 mode: PR/PR res: [0x2b5b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5fc expref: 1428 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.508253:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c5097d lrc: 4/0,1 mode: PW/PW res: [0x2b5b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.508256:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dc67b411/0x3234de053c4a01b lrc: 3/0,0 mode: PR/PR res: [0x2b5b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5fc expref: 1428 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.508259:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.508260:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc67b411/0x3234de053c4a01b lrc: 0/0,0 mode: --/PR res: [0x2b5b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5fc expref: 1428 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.508264:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.508264:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.508265:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c50984 lrc: 3/0,1 mode: PW/PW res: [0x2b5b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.508265:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1427:41279:x1731746396283520:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 56us (195us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.508268:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c50984 lrc: 4/0,1 mode: PW/PW res: [0x2b5b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.508268:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11922 00000100:00100000:0.0:1651529344.508272:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11924 00010000:00010000:1.0:1651529344.508274:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.508274:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001cec52dd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1426:41278:x1731746396283712:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.508276:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.508278:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000055c564af/0x3234de053c4f238 lrc: 4/0,0 mode: PR/PR res: [0x2b5b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b99 expref: 1426 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.508279:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1426:41279:x1731746396283648:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 31us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.508281:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11923 00010000:00010000:0.0:1651529344.508281:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000055c564af/0x3234de053c4f238 lrc: 3/0,0 mode: PR/PR res: [0x2b5b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b99 expref: 1426 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.508285:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11925 00010000:00010000:0.0:1651529344.508286:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055c564af/0x3234de053c4f238 lrc: 0/0,0 mode: --/PR res: [0x2b5b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b99 expref: 1425 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.508287:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1425:41279:x1731746396283776:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.508289:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.508289:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.508290:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000b4c7160/0x3234de053c4affe lrc: 4/0,0 mode: PR/PR res: [0x2b5b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc00c expref: 1424 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.508290:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.508290:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c50992 lrc: 3/0,1 mode: PW/PW res: [0x2b5b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.508294:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000b4c7160/0x3234de053c4affe lrc: 3/0,0 mode: PR/PR res: [0x2b5b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc00c expref: 1424 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.508296:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c50992 lrc: 4/0,1 mode: PW/PW res: [0x2b5b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.508298:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b4c7160/0x3234de053c4affe lrc: 0/0,0 mode: --/PR res: [0x2b5b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc00c expref: 1424 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.508302:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.508302:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.508305:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.508309:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50999 lrc: 3/0,1 mode: PW/PW res: [0x2b5b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.508311:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001cec52dd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1423:41278:x1731746396283712:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 36us (230us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.508312:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50999 lrc: 4/0,1 mode: PW/PW res: [0x2b5b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.508313:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11924 00010000:00010000:1.0:1651529344.508320:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.508326:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1422:41279:x1731746396283776:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 39us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.508329:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11925 00010000:00010000:0.0:1651529344.508331:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c5097d lrc: 3/0,1 mode: PW/PW res: [0x2b5b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508335:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c5097d lrc: 3/0,1 mode: PW/PW res: [0x2b5b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.508336:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c50984 lrc: 3/0,1 mode: PW/PW res: [0x2b5b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508338:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c5097d lrc: 3/0,1 mode: PW/PW res: [0x2b5b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.508339:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c50984 lrc: 3/0,1 mode: PW/PW res: [0x2b5b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508341:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c5097d lrc: 2/0,0 mode: PW/PW res: [0x2b5b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.508343:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c50984 lrc: 3/0,1 mode: PW/PW res: [0x2b5b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.508345:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c50984 lrc: 2/0,0 mode: PW/PW res: [0x2b5b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.508389:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+640:39030:x1731745946402368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1035us (1139us total) trans 12885079192 rc 0/0 00000100:00100000:1.0:1651529344.508392:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+640:39030:x1731745946402496:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1004us (1118us total) trans 12885079193 rc 0/0 00000100:00100000:0.0:1651529344.508393:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211139 00000100:00100000:1.0:1651529344.508395:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211140 00010000:00010000:0.0:1651529344.508400:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c5097d lrc: 2/0,0 mode: PW/PW res: [0x2b5b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.508403:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c50976 lrc: 3/0,1 mode: PW/PW res: [0x2b5b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508403:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000734ecdfd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.508405:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c5097d lrc: 2/0,0 mode: PW/PW res: [0x2b5b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.508406:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c50976 lrc: 3/0,1 mode: PW/PW res: [0x2b5b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508408:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c5097d lrc: 3/0,0 mode: PW/PW res: [0x2b5b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.508409:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c50976 lrc: 3/0,1 mode: PW/PW res: [0x2b5b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.508412:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c50976 lrc: 2/0,0 mode: PW/PW res: [0x2b5b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508412:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c5097d lrc: 1/0,0 mode: --/PW res: [0x2b5b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508415:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c5097d lrc: 0/0,0 mode: --/PW res: [0x2b5b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508419:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c50984 lrc: 2/0,0 mode: PW/PW res: [0x2b5b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508422:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005531aaab already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.508423:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c50984 lrc: 2/0,0 mode: PW/PW res: [0x2b5b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508425:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c50984 lrc: 3/0,0 mode: PW/PW res: [0x2b5b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508428:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c50984 lrc: 1/0,0 mode: --/PW res: [0x2b5b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508431:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c50984 lrc: 0/0,0 mode: --/PW res: [0x2b5b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508434:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c50976 lrc: 2/0,0 mode: PW/PW res: [0x2b5b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508437:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000760c4860 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.508438:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c50976 lrc: 2/0,0 mode: PW/PW res: [0x2b5b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508441:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c50976 lrc: 3/0,0 mode: PW/PW res: [0x2b5b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.508443:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+639:39030:x1731745946402432:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1109us (1223us total) trans 12885079194 rc 0/0 00010000:00010000:0.0:1651529344.508444:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c50976 lrc: 1/0,0 mode: --/PW res: [0x2b5b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.508446:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211138 00010000:00010000:0.0:1651529344.508446:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c50976 lrc: 0/0,0 mode: --/PW res: [0x2b5b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.508452:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c50992 lrc: 3/0,1 mode: PW/PW res: [0x2b5b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508452:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c5098b lrc: 3/0,1 mode: PW/PW res: [0x2b5b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.508455:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c50992 lrc: 3/0,1 mode: PW/PW res: [0x2b5b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508455:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c5098b lrc: 3/0,1 mode: PW/PW res: [0x2b5b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.508458:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c50992 lrc: 3/0,1 mode: PW/PW res: [0x2b5b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508458:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c5098b lrc: 3/0,1 mode: PW/PW res: [0x2b5b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508460:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c5098b lrc: 2/0,0 mode: PW/PW res: [0x2b5b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.508464:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c50992 lrc: 2/0,0 mode: PW/PW res: [0x2b5b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.508500:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+640:39030:x1731745946402688:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1069us (1206us total) trans 12885079195 rc 0/0 00000100:00100000:1.0:1651529344.508503:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211142 00000100:00100000:0.0:1651529344.508505:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+640:39029:x1731745946402560:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1106us (1219us total) trans 12885079196 rc 0/0 00000100:00100000:0.0:1651529344.508508:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211141 00010000:00010000:1.0:1651529344.508509:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c5098b lrc: 2/0,0 mode: PW/PW res: [0x2b5b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.508512:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cdc65e28 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.508513:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c5098b lrc: 2/0,0 mode: PW/PW res: [0x2b5b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508515:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c50992 lrc: 2/0,0 mode: PW/PW res: [0x2b5b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.508516:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c5098b lrc: 3/0,0 mode: PW/PW res: [0x2b5b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508519:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007104c91e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.508520:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c50992 lrc: 2/0,0 mode: PW/PW res: [0x2b5b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.508521:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c5098b lrc: 1/0,0 mode: --/PW res: [0x2b5b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508522:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c50992 lrc: 3/0,0 mode: PW/PW res: [0x2b5b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.508524:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c5098b lrc: 0/0,0 mode: --/PW res: [0x2b5b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508527:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c50992 lrc: 1/0,0 mode: --/PW res: [0x2b5b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508530:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c50992 lrc: 0/0,0 mode: --/PW res: [0x2b5b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508536:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50999 lrc: 3/0,1 mode: PW/PW res: [0x2b5b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508539:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50999 lrc: 3/0,1 mode: PW/PW res: [0x2b5b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508542:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50999 lrc: 3/0,1 mode: PW/PW res: [0x2b5b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508545:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50999 lrc: 2/0,0 mode: PW/PW res: [0x2b5b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.508551:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.508585:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+639:39030:x1731745946402624:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1145us (1282us total) trans 12885079197 rc 0/0 00000100:00100000:0.0:1651529344.508588:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211143 00010000:00010000:0.0:1651529344.508594:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c5096f lrc: 3/0,1 mode: PW/PW res: [0x2b5b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508597:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c5096f lrc: 3/0,1 mode: PW/PW res: [0x2b5b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508601:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c5096f lrc: 3/0,1 mode: PW/PW res: [0x2b5b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508603:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c5096f lrc: 2/0,0 mode: PW/PW res: [0x2b5b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.508635:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+639:39030:x1731745946402304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1356us (1425us total) trans 12885079198 rc 0/0 00000100:00100000:0.0:1651529344.508637:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211137 00010000:00010000:0.0:1651529344.508657:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50999 lrc: 2/0,0 mode: PW/PW res: [0x2b5b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508661:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027456046 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.508662:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50999 lrc: 2/0,0 mode: PW/PW res: [0x2b5b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508665:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50999 lrc: 3/0,0 mode: PW/PW res: [0x2b5b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508670:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50999 lrc: 1/0,0 mode: --/PW res: [0x2b5b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508673:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50999 lrc: 0/0,0 mode: --/PW res: [0x2b5b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508677:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c5096f lrc: 2/0,0 mode: PW/PW res: [0x2b5b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508679:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a0607df4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.508680:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c5096f lrc: 2/0,0 mode: PW/PW res: [0x2b5b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508683:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c5096f lrc: 3/0,0 mode: PW/PW res: [0x2b5b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508686:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c5096f lrc: 1/0,0 mode: --/PW res: [0x2b5b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.508688:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c5096f lrc: 0/0,0 mode: --/PW res: [0x2b5b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.508715:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000093ddaf92 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996979968:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.508720:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c509a0 lrc: 3/0,1 mode: --/PW res: [0x2b5b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.508731:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396283840 00010000:00010000:1.0:1651529344.508746:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c4ecf1 lrc: 4/0,0 mode: PR/PR res: [0x2b5b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d656c expref: 1422 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.508755:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11926 00000100:00100000:1.0:1651529344.508757:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a13808c6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1422:41278:x1731746396283840:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.508759:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.508761:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c4ecf1 lrc: 4/0,0 mode: PR/PR res: [0x2b5b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d656c expref: 1422 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.508765:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c4ecf1 lrc: 3/0,0 mode: PR/PR res: [0x2b5b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d656c expref: 1422 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.508770:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c4ecf1 lrc: 0/0,0 mode: --/PR res: [0x2b5b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d656c expref: 1422 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.508774:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.508774:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.508775:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c509a0 lrc: 3/0,1 mode: PW/PW res: [0x2b5b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.508778:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c509a0 lrc: 4/0,1 mode: PW/PW res: [0x2b5b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.508784:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.508795:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a13808c6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1421:41278:x1731746396283840:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 38us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.508798:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11926 00010000:00010000:1.0:1651529344.508805:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c509a0 lrc: 3/0,1 mode: PW/PW res: [0x2b5b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.508808:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c509a0 lrc: 3/0,1 mode: PW/PW res: [0x2b5b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.508811:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c509a0 lrc: 3/0,1 mode: PW/PW res: [0x2b5b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.508819:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c509a0 lrc: 2/0,0 mode: PW/PW res: [0x2b5b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.508847:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.508877:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+639:39029:x1731745946402752:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1405us (1566us total) trans 12885079199 rc 0/0 00000100:00100000:1.0:1651529344.508880:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211144 00000100:00100000:0.0:1651529344.508883:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.508885:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946403328 00000100:00100000:1.0:1651529344.508893:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946403456 00000100:00100000:1.0:1651529344.508899:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211145 00000100:00100000:1.0:1651529344.508900:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+640:39030:x1731745946403328:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.508905:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177593 count 1 00010000:00010000:1.0:1651529344.508910:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c509a7 lrc: 3/0,1 mode: --/PW res: [0x2b5b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.508914:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000999dea9a/0x3234de053c4cd55 lrc: 2/0,0 mode: PR/PR res: [0x2b5b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce750 expref: 1420 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.508920:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.508921:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.508922:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c509a7 lrc: 4/0,1 mode: --/PW res: [0x2b5b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.508935:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000999dea9a/0x3234de053c4cd55 lrc: 3/0,0 mode: PR/PR res: [0x2b5b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce750 expref: 1420 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.508940:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000999dea9a/0x3234de053c4cd55 lrc: 4/0,0 mode: PR/PR res: [0x2b5b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce750 expref: 1420 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.508944:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000093ddaf92 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996980032:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.508946:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.508956:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.508964:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.508969:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8a0b704 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.508972:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.508983:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946403392 00000100:00100000:1.0:1651529344.508989:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946403520 00000100:00100000:0.0:1651529344.508996:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.509001:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946403584 00010000:00010000:0.0:1651529344.509003:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c509a0 lrc: 2/0,0 mode: PW/PW res: [0x2b5b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.509005:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946403712 00000100:00100000:1.0:1651529344.509007:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946403648 00010000:00010000:0.0:1651529344.509007:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000f905106 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.509008:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c509a0 lrc: 2/0,0 mode: PW/PW res: [0x2b5b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.509010:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211146 00010000:00010000:0.0:1651529344.509011:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c509a0 lrc: 3/0,0 mode: PW/PW res: [0x2b5b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.509012:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+645:39030:x1731745946403456:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.509016:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177595 count 1 00010000:00010000:0.0:1651529344.509016:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c509a0 lrc: 1/0,0 mode: --/PW res: [0x2b5b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509019:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c509a0 lrc: 0/0,0 mode: --/PW res: [0x2b5b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509020:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c509ae lrc: 3/0,1 mode: --/PW res: [0x2b5bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509025:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003a0df486/0x3234de053c4ea35 lrc: 2/0,0 mode: PR/PR res: [0x2b5bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a2f expref: 1420 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.509030:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.509031:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.509032:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c509ae lrc: 4/0,1 mode: --/PW res: [0x2b5bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509038:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003a0df486/0x3234de053c4ea35 lrc: 3/0,0 mode: PR/PR res: [0x2b5bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a2f expref: 1420 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.509041:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003a0df486/0x3234de053c4ea35 lrc: 4/0,0 mode: PR/PR res: [0x2b5bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a2f expref: 1420 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.509043:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211147 00000100:00100000:1.0:1651529344.509045:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a223a622 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996980096:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.509045:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+645:39030:x1731745946403392:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.509051:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177594 count 1 00000100:00100000:1.0:1651529344.509053:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f79d8146 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.509055:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c509b5 lrc: 3/0,1 mode: --/PW res: [0x2b5ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.509060:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211148 00010000:00010000:0.0:1651529344.509060:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fbf58437/0x3234de053c4dd69 lrc: 2/0,0 mode: PR/PR res: [0x2b5ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d26ea expref: 1420 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.509062:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+645:39029:x1731745946403520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.509063:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.509064:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.509064:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c509b5 lrc: 4/0,1 mode: --/PW res: [0x2b5ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.509066:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177596 count 1 00010000:00010000:1.0:1651529344.509069:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c509bc lrc: 3/0,1 mode: --/PW res: [0x2b5bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509072:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fbf58437/0x3234de053c4dd69 lrc: 3/0,0 mode: PR/PR res: [0x2b5ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d26ea expref: 1420 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.509073:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c3c46da9/0x3234de053c4e8d7 lrc: 2/0,0 mode: PR/PR res: [0x2b5bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5408 expref: 1420 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.509076:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.509076:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.509077:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c509bc lrc: 4/0,1 mode: --/PW res: [0x2b5bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509085:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c3c46da9/0x3234de053c4e8d7 lrc: 3/0,0 mode: PR/PR res: [0x2b5bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5408 expref: 1420 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.509089:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c3c46da9/0x3234de053c4e8d7 lrc: 4/0,0 mode: PR/PR res: [0x2b5bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5408 expref: 1420 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.509090:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fbf58437/0x3234de053c4dd69 lrc: 4/0,0 mode: PR/PR res: [0x2b5ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d26ea expref: 1420 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.509093:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005a17dd72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996980224:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.509094:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996980160:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.509099:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 000000004698fefb going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.509104:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211149 00000100:00100000:0.0:1651529344.509104:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aac87b31 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.509106:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+645:39030:x1731745946403584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.509109:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177597 count 1 00000100:00100000:0.0:1651529344.509111:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211150 00010000:00010000:1.0:1651529344.509113:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c509c3 lrc: 3/0,1 mode: --/PW res: [0x2b5bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.509113:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+645:39030:x1731745946403712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.509117:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a24af001/0x3234de053c4e033 lrc: 2/0,0 mode: PR/PR res: [0x2b5bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d31ef expref: 1420 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.509118:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177599 count 1 00010000:00010000:1.0:1651529344.509120:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.509120:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.509121:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c509c3 lrc: 4/0,1 mode: --/PW res: [0x2b5bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509122:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c509ca lrc: 3/0,1 mode: --/PW res: [0x2b5bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509126:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a24af001/0x3234de053c4e033 lrc: 3/0,0 mode: PR/PR res: [0x2b5bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d31ef expref: 1420 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.509126:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fcc5c147/0x3234de053c4de2d lrc: 2/0,0 mode: PR/PR res: [0x2b5bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d29b4 expref: 1420 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.509129:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.509130:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a24af001/0x3234de053c4e033 lrc: 4/0,0 mode: PR/PR res: [0x2b5bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d31ef expref: 1420 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.509130:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.509130:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c509ca lrc: 4/0,1 mode: --/PW res: [0x2b5bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.509134:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006647e4ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996980288:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.509137:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fcc5c147/0x3234de053c4de2d lrc: 3/0,0 mode: PR/PR res: [0x2b5bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d29b4 expref: 1420 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.509140:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aeda71fe going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.509143:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fcc5c147/0x3234de053c4de2d lrc: 4/0,0 mode: PR/PR res: [0x2b5bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d29b4 expref: 1420 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.509146:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211151 00000100:00100000:0.0:1651529344.509147:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996980352:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.509148:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+645:39030:x1731745946403648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.509151:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177598 count 1 00000100:00100000:0.0:1651529344.509153:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c2b2b59c going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.509154:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c509d1 lrc: 3/0,1 mode: --/PW res: [0x2b5be:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509159:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000014ad3847/0x3234de053c4ea74 lrc: 2/0,0 mode: PR/PR res: [0x2b5be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b7f expref: 1420 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.509161:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.509162:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.509162:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c509d1 lrc: 4/0,1 mode: --/PW res: [0x2b5be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509168:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000014ad3847/0x3234de053c4ea74 lrc: 3/0,0 mode: PR/PR res: [0x2b5be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b7f expref: 1420 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.509169:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.509172:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000014ad3847/0x3234de053c4ea74 lrc: 4/0,0 mode: PR/PR res: [0x2b5be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b7f expref: 1420 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.509175:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000089d7f5d6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996980416:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.509181:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000babe2d90 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.509186:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946403776 00000100:00100000:1.0:1651529344.509198:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211152 00000100:00100000:1.0:1651529344.509200:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+646:39029:x1731745946403776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.509244:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177600 count 1 00010000:00010000:1.0:1651529344.509249:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c509d8 lrc: 3/0,1 mode: --/PW res: [0x2b5c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509253:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b988deab/0x3234de053c4d478 lrc: 2/0,0 mode: PR/PR res: [0x2b5c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d03dc expref: 1420 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.509257:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.509257:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.509258:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c509d8 lrc: 4/0,1 mode: --/PW res: [0x2b5c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509264:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b988deab/0x3234de053c4d478 lrc: 3/0,0 mode: PR/PR res: [0x2b5c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d03dc expref: 1420 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.509267:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b988deab/0x3234de053c4d478 lrc: 4/0,0 mode: PR/PR res: [0x2b5c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d03dc expref: 1420 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.509271:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002a957ba7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996980480:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.509285:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f9dac3f6 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.509333:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000093ddaf92 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996980032:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.509338:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c509a7 lrc: 3/0,1 mode: --/PW res: [0x2b5b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.509342:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.509353:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396284416 00010000:00010000:1.0:1651529344.509362:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000999dea9a/0x3234de053c4cd55 lrc: 4/0,0 mode: PR/PR res: [0x2b5b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce750 expref: 1421 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.509370:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11927 00000100:00100000:1.0:1651529344.509372:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1421:41279:x1731746396284416:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.509374:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.509376:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000999dea9a/0x3234de053c4cd55 lrc: 4/0,0 mode: PR/PR res: [0x2b5b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce750 expref: 1421 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.509379:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000999dea9a/0x3234de053c4cd55 lrc: 3/0,0 mode: PR/PR res: [0x2b5b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce750 expref: 1421 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.509385:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000999dea9a/0x3234de053c4cd55 lrc: 0/0,0 mode: --/PR res: [0x2b5b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce750 expref: 1421 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.509388:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.509389:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.509390:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c509a7 lrc: 3/0,1 mode: PW/PW res: [0x2b5b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509393:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c509a7 lrc: 4/0,1 mode: PW/PW res: [0x2b5b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509399:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.509407:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1420:41279:x1731746396284416:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 34us (65us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.509409:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11927 00000100:00100000:1.0:1651529344.509417:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a223a622 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996980096:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.509421:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c509ae lrc: 3/0,1 mode: --/PW res: [0x2b5bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509426:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c509a7 lrc: 3/0,1 mode: PW/PW res: [0x2b5b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509429:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c509a7 lrc: 3/0,1 mode: PW/PW res: [0x2b5b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509432:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c509a7 lrc: 3/0,1 mode: PW/PW res: [0x2b5b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509435:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c509a7 lrc: 2/0,0 mode: PW/PW res: [0x2b5b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509449:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c509a7 lrc: 2/0,0 mode: PW/PW res: [0x2b5b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509454:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002e1250c9 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.509455:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c509a7 lrc: 2/0,0 mode: PW/PW res: [0x2b5b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509458:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c509a7 lrc: 3/0,0 mode: PW/PW res: [0x2b5b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509463:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c509a7 lrc: 1/0,0 mode: --/PW res: [0x2b5b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509466:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c509a7 lrc: 0/0,0 mode: --/PW res: [0x2b5b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.509485:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+647:39030:x1731745946403328:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 584us (639us total) trans 12885079200 rc 0/0 00000100:00100000:1.0:1651529344.509488:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211145 00000100:00100000:1.0:1651529344.509508:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005a17dd72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996980224:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.509512:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c509bc lrc: 3/0,1 mode: --/PW res: [0x2b5bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.509516:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.509530:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396284544 00010000:00010000:1.0:1651529344.509534:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c3c46da9/0x3234de053c4e8d7 lrc: 4/0,0 mode: PR/PR res: [0x2b5bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5408 expref: 1420 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.509541:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11928 00000100:00100000:1.0:1651529344.509549:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1420:41279:x1731746396284544:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.509551:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.509553:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.509554:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c3c46da9/0x3234de053c4e8d7 lrc: 4/0,0 mode: PR/PR res: [0x2b5bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5408 expref: 1420 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.509563:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c3c46da9/0x3234de053c4e8d7 lrc: 3/0,0 mode: PR/PR res: [0x2b5bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5408 expref: 1420 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.509567:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.509569:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3c46da9/0x3234de053c4e8d7 lrc: 0/0,0 mode: --/PR res: [0x2b5bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5408 expref: 1420 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.509572:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.509573:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.509573:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c509bc lrc: 3/0,1 mode: PW/PW res: [0x2b5bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509576:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c509bc lrc: 4/0,1 mode: PW/PW res: [0x2b5bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.509576:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996980160:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.509581:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c509b5 lrc: 3/0,1 mode: --/PW res: [0x2b5ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509582:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.509594:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1419:41279:x1731746396284544:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 50us (79us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.509597:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11928 00000100:00100000:1.0:1651529344.509602:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396284480 00010000:00010000:1.0:1651529344.509605:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003a0df486/0x3234de053c4ea35 lrc: 4/0,0 mode: PR/PR res: [0x2b5bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a2f expref: 1419 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.509610:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396284608 00010000:00010000:1.0:1651529344.509612:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fbf58437/0x3234de053c4dd69 lrc: 4/0,0 mode: PR/PR res: [0x2b5ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d26ea expref: 1420 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.509617:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11929 00000100:00100000:1.0:1651529344.509619:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11930 00000100:00100000:0.0:1651529344.509619:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1420:41278:x1731746396284480:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.509621:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1420:41278:x1731746396284608:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.509623:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.509623:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.509624:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fbf58437/0x3234de053c4dd69 lrc: 4/0,0 mode: PR/PR res: [0x2b5ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d26ea expref: 1420 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.509625:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003a0df486/0x3234de053c4ea35 lrc: 4/0,0 mode: PR/PR res: [0x2b5bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a2f expref: 1420 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.509628:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fbf58437/0x3234de053c4dd69 lrc: 3/0,0 mode: PR/PR res: [0x2b5ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d26ea expref: 1420 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.509629:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003a0df486/0x3234de053c4ea35 lrc: 3/0,0 mode: PR/PR res: [0x2b5bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a2f expref: 1420 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.509632:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fbf58437/0x3234de053c4dd69 lrc: 0/0,0 mode: --/PR res: [0x2b5ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d26ea expref: 1420 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.509635:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.509635:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a0df486/0x3234de053c4ea35 lrc: 0/0,0 mode: --/PR res: [0x2b5bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a2f expref: 1419 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.509636:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.509637:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c509b5 lrc: 3/0,1 mode: PW/PW res: [0x2b5ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509639:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.509639:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.509640:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c509b5 lrc: 4/0,1 mode: PW/PW res: [0x2b5ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509640:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c509ae lrc: 3/0,1 mode: PW/PW res: [0x2b5bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509643:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c509ae lrc: 4/0,1 mode: PW/PW res: [0x2b5bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509648:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.509653:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1418:41278:x1731746396284608:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 32us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.509656:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11930 00010000:00010000:0.0:1651529344.509659:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.509667:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c509ae lrc: 3/0,1 mode: PW/PW res: [0x2b5bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509671:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c509ae lrc: 3/0,1 mode: PW/PW res: [0x2b5bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509674:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c509ae lrc: 3/0,1 mode: PW/PW res: [0x2b5bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509676:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c509ae lrc: 2/0,0 mode: PW/PW res: [0x2b5bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.509678:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1417:41278:x1731746396284480:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 58us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.509684:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11929 00010000:00010000:0.0:1651529344.509692:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c509b5 lrc: 3/0,1 mode: PW/PW res: [0x2b5ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509695:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c509b5 lrc: 3/0,1 mode: PW/PW res: [0x2b5ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509699:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c509b5 lrc: 3/0,1 mode: PW/PW res: [0x2b5ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509701:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c509b5 lrc: 2/0,0 mode: PW/PW res: [0x2b5ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.509714:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+647:39030:x1731745946403456:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 702us (843us total) trans 12885079201 rc 0/0 00000100:00100000:1.0:1651529344.509717:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211146 00010000:00010000:1.0:1651529344.509724:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c509ae lrc: 2/0,0 mode: PW/PW res: [0x2b5bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509727:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001650e9dc already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.509728:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c509ae lrc: 2/0,0 mode: PW/PW res: [0x2b5bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509731:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c509ae lrc: 3/0,0 mode: PW/PW res: [0x2b5bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509745:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c509ae lrc: 1/0,0 mode: --/PW res: [0x2b5bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509748:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c509ae lrc: 0/0,0 mode: --/PW res: [0x2b5bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.509752:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+647:39030:x1731745946403392:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 707us (806us total) trans 12885079202 rc 0/0 00010000:00010000:1.0:1651529344.509753:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c509b5 lrc: 2/0,0 mode: PW/PW res: [0x2b5ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509756:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eb50e2ae already unused, calling callback (0000000049fddea7) 00000100:00100000:0.0:1651529344.509756:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211147 00010000:00010000:1.0:1651529344.509757:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c509b5 lrc: 2/0,0 mode: PW/PW res: [0x2b5ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509759:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c509b5 lrc: 3/0,0 mode: PW/PW res: [0x2b5ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509763:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c509b5 lrc: 1/0,0 mode: --/PW res: [0x2b5ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509765:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c509b5 lrc: 0/0,0 mode: --/PW res: [0x2b5ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509770:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c509bc lrc: 3/0,1 mode: PW/PW res: [0x2b5bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509778:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c509bc lrc: 3/0,1 mode: PW/PW res: [0x2b5bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509782:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c509bc lrc: 3/0,1 mode: PW/PW res: [0x2b5bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509784:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c509bc lrc: 2/0,0 mode: PW/PW res: [0x2b5bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.509815:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.509823:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+647:39029:x1731745946403520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 761us (867us total) trans 12885079203 rc 0/0 00000100:00100000:1.0:1651529344.509826:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211148 00000100:00100000:1.0:1651529344.509831:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946404160 00000100:00100000:1.0:1651529344.509847:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211153 00000100:00100000:1.0:1651529344.509849:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+647:39029:x1731745946404160:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.509859:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177601 count 1 00010000:00010000:1.0:1651529344.509863:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c509df lrc: 3/0,1 mode: --/PW res: [0x2b5c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509878:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f2c22fc3/0x3234de053c4ec0a lrc: 2/0,0 mode: PR/PR res: [0x2b5c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d61ad expref: 1416 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.509881:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.509882:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.509883:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c509df lrc: 4/0,1 mode: --/PW res: [0x2b5c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.509886:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.509894:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.509895:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f2c22fc3/0x3234de053c4ec0a lrc: 3/0,0 mode: PR/PR res: [0x2b5c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d61ad expref: 1416 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.509903:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.509904:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f2c22fc3/0x3234de053c4ec0a lrc: 4/0,0 mode: PR/PR res: [0x2b5c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d61ad expref: 1416 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.509908:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000078f9a278 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996980544:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.509908:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.509913:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c509bc lrc: 2/0,0 mode: PW/PW res: [0x2b5bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509917:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ae53a7c6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.509918:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c509bc lrc: 2/0,0 mode: PW/PW res: [0x2b5bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.509922:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d09f5ee1 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.509930:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c509bc lrc: 3/0,0 mode: PW/PW res: [0x2b5bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.509931:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006647e4ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996980288:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.509935:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c509c3 lrc: 3/0,1 mode: --/PW res: [0x2b5bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.509941:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000089d7f5d6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996980416:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.509944:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c509d1 lrc: 3/0,1 mode: --/PW res: [0x2b5be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.509947:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c509bc lrc: 1/0,0 mode: --/PW res: [0x2b5bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.509949:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002a957ba7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996980480:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.509950:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c509bc lrc: 0/0,0 mode: --/PW res: [0x2b5bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509952:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c509d8 lrc: 3/0,1 mode: --/PW res: [0x2b5c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.509958:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396284672 00010000:00010000:1.0:1651529344.509962:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a24af001/0x3234de053c4e033 lrc: 4/0,0 mode: PR/PR res: [0x2b5bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d31ef expref: 1417 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.509963:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996980352:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.509967:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396284800 00010000:00010000:0.0:1651529344.509967:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c509ca lrc: 3/0,1 mode: --/PW res: [0x2b5bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.509969:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000014ad3847/0x3234de053c4ea74 lrc: 4/0,0 mode: PR/PR res: [0x2b5be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b7f expref: 1418 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.509974:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396284864 00000100:00100000:0.0:1651529344.509974:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396284736 00010000:00010000:1.0:1651529344.509976:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b988deab/0x3234de053c4d478 lrc: 4/0,0 mode: PR/PR res: [0x2b5c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d03dc expref: 1420 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.509979:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fcc5c147/0x3234de053c4de2d lrc: 4/0,0 mode: PR/PR res: [0x2b5bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d29b4 expref: 1420 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.509981:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11931 00000100:00100000:1.0:1651529344.509982:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000011803d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1420:41279:x1731746396284672:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.509985:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11932 00010000:00010000:1.0:1651529344.509986:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.509987:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1420:41279:x1731746396284800:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.509988:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a24af001/0x3234de053c4e033 lrc: 4/0,0 mode: PR/PR res: [0x2b5bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d31ef expref: 1420 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.509990:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.509991:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a24af001/0x3234de053c4e033 lrc: 3/0,0 mode: PR/PR res: [0x2b5bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d31ef expref: 1420 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.509991:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000014ad3847/0x3234de053c4ea74 lrc: 4/0,0 mode: PR/PR res: [0x2b5be:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b7f expref: 1420 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.509995:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000014ad3847/0x3234de053c4ea74 lrc: 3/0,0 mode: PR/PR res: [0x2b5be:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b7f expref: 1420 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.509996:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a24af001/0x3234de053c4e033 lrc: 0/0,0 mode: --/PR res: [0x2b5bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d31ef expref: 1420 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.510000:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.510000:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.510001:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c509c3 lrc: 3/0,1 mode: PW/PW res: [0x2b5bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.510003:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014ad3847/0x3234de053c4ea74 lrc: 0/0,0 mode: --/PR res: [0x2b5be:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5b7f expref: 1419 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.510004:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c509c3 lrc: 4/0,1 mode: PW/PW res: [0x2b5bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.510006:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.510007:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.510008:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c509d1 lrc: 3/0,1 mode: PW/PW res: [0x2b5be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510010:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.510011:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c509d1 lrc: 4/0,1 mode: PW/PW res: [0x2b5be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.510016:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000011803d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1418:41279:x1731746396284672:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 33us (130us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.510022:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.510025:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11931 00000100:00100000:0.0:1651529344.510029:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1417:41279:x1731746396284800:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.510032:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11932 00000100:00100000:1.0:1651529344.510036:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11933 00000100:00100000:1.0:1651529344.510037:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1416:41279:x1731746396284864:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.510037:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11934 00000100:00100000:0.0:1651529344.510039:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1416:41279:x1731746396284736:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.510040:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.510041:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b988deab/0x3234de053c4d478 lrc: 4/0,0 mode: PR/PR res: [0x2b5c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d03dc expref: 1416 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.510042:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.510043:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fcc5c147/0x3234de053c4de2d lrc: 4/0,0 mode: PR/PR res: [0x2b5bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d29b4 expref: 1416 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.510047:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fcc5c147/0x3234de053c4de2d lrc: 3/0,0 mode: PR/PR res: [0x2b5bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d29b4 expref: 1416 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.510048:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b988deab/0x3234de053c4d478 lrc: 3/0,0 mode: PR/PR res: [0x2b5c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d03dc expref: 1416 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.510051:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcc5c147/0x3234de053c4de2d lrc: 0/0,0 mode: --/PR res: [0x2b5bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d29b4 expref: 1416 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.510053:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b988deab/0x3234de053c4d478 lrc: 0/0,0 mode: --/PR res: [0x2b5c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d03dc expref: 1416 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.510056:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.510056:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.510057:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c509d8 lrc: 3/0,1 mode: PW/PW res: [0x2b5c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.510057:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.510058:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.510059:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c509ca lrc: 3/0,1 mode: PW/PW res: [0x2b5bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510060:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c509d8 lrc: 4/0,1 mode: PW/PW res: [0x2b5c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510066:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.510071:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1414:41279:x1731746396284864:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 33us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.510074:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11933 00010000:00010000:0.0:1651529344.510075:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c509ca lrc: 4/0,1 mode: PW/PW res: [0x2b5bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510079:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c509d8 lrc: 3/0,1 mode: PW/PW res: [0x2b5c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510082:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c509d8 lrc: 3/0,1 mode: PW/PW res: [0x2b5c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.510083:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.510085:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c509d8 lrc: 3/0,1 mode: PW/PW res: [0x2b5c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510090:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c509d8 lrc: 2/0,0 mode: PW/PW res: [0x2b5c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.510104:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1413:41279:x1731746396284736:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 64us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.510107:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11934 00010000:00010000:0.0:1651529344.510114:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c509d8 lrc: 2/0,0 mode: PW/PW res: [0x2b5c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.510117:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dc65d2aa already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.510119:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c509d8 lrc: 2/0,0 mode: PW/PW res: [0x2b5c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.510121:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c509d8 lrc: 3/0,0 mode: PW/PW res: [0x2b5c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.510126:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c509d8 lrc: 1/0,0 mode: --/PW res: [0x2b5c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.510128:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c509d8 lrc: 0/0,0 mode: --/PW res: [0x2b5c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.510132:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+648:39029:x1731745946403776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 931us (963us total) trans 12885079204 rc 0/0 00000100:00100000:1.0:1651529344.510135:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211152 00010000:00010000:0.0:1651529344.510136:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c509ca lrc: 3/0,1 mode: PW/PW res: [0x2b5bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.510139:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c509ca lrc: 3/0,1 mode: PW/PW res: [0x2b5bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510141:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c509d1 lrc: 3/0,1 mode: PW/PW res: [0x2b5be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.510142:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c509ca lrc: 3/0,1 mode: PW/PW res: [0x2b5bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.510144:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c509ca lrc: 2/0,0 mode: PW/PW res: [0x2b5bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510145:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c509d1 lrc: 3/0,1 mode: PW/PW res: [0x2b5be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510148:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c509d1 lrc: 3/0,1 mode: PW/PW res: [0x2b5be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510150:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c509d1 lrc: 2/0,0 mode: PW/PW res: [0x2b5be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.510193:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+649:39030:x1731745946403712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1079us (1221us total) trans 12885079205 rc 0/0 00000100:00100000:1.0:1651529344.510196:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+649:39030:x1731745946403648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1047us (1199us total) trans 12885079206 rc 0/0 00000100:00100000:0.0:1651529344.510196:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211150 00000100:00100000:1.0:1651529344.510199:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211151 00010000:00010000:0.0:1651529344.510203:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c509ca lrc: 2/0,0 mode: PW/PW res: [0x2b5bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510206:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c509c3 lrc: 3/0,1 mode: PW/PW res: [0x2b5bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.510206:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000010b0a5e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.510207:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c509ca lrc: 2/0,0 mode: PW/PW res: [0x2b5bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510209:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c509c3 lrc: 3/0,1 mode: PW/PW res: [0x2b5bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.510210:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c509ca lrc: 3/0,0 mode: PW/PW res: [0x2b5bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.510214:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c509ca lrc: 1/0,0 mode: --/PW res: [0x2b5bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510215:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c509c3 lrc: 3/0,1 mode: PW/PW res: [0x2b5bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.510217:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c509ca lrc: 0/0,0 mode: --/PW res: [0x2b5bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510218:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c509c3 lrc: 2/0,0 mode: PW/PW res: [0x2b5bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.510221:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c509d1 lrc: 2/0,0 mode: PW/PW res: [0x2b5be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.510246:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cff76789 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.510247:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c509d1 lrc: 2/0,0 mode: PW/PW res: [0x2b5be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.510250:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c509d1 lrc: 3/0,0 mode: PW/PW res: [0x2b5be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.510254:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c509d1 lrc: 1/0,0 mode: --/PW res: [0x2b5be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.510256:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c509d1 lrc: 0/0,0 mode: --/PW res: [0x2b5be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.510261:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c509c3 lrc: 2/0,0 mode: PW/PW res: [0x2b5bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.510264:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2a2495 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.510265:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c509c3 lrc: 2/0,0 mode: PW/PW res: [0x2b5bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.510269:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+648:39030:x1731745946403584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1163us (1305us total) trans 12885079207 rc 0/0 00010000:00010000:0.0:1651529344.510270:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c509c3 lrc: 3/0,0 mode: PW/PW res: [0x2b5bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.510272:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211149 00010000:00010000:0.0:1651529344.510273:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c509c3 lrc: 1/0,0 mode: --/PW res: [0x2b5bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.510275:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c509c3 lrc: 0/0,0 mode: --/PW res: [0x2b5bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.510330:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.510353:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946404224 00000100:00100000:1.0:1651529344.510367:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211154 00000100:00100000:1.0:1651529344.510374:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+648:39030:x1731745946404224:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.510380:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177602 count 1 00010000:00010000:1.0:1651529344.510384:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c509e6 lrc: 3/0,1 mode: --/PW res: [0x2b5c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510389:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e62d422c/0x3234de053c4e446 lrc: 2/0,0 mode: PR/PR res: [0x2b5c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4242 expref: 1412 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.510392:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.510392:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.510393:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c509e6 lrc: 4/0,1 mode: --/PW res: [0x2b5c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510400:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e62d422c/0x3234de053c4e446 lrc: 3/0,0 mode: PR/PR res: [0x2b5c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4242 expref: 1412 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.510404:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e62d422c/0x3234de053c4e446 lrc: 4/0,0 mode: PR/PR res: [0x2b5c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4242 expref: 1412 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.510408:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000089d7f5d6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996980608:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.510422:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a4eb401d going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.510435:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.510452:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.510459:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946404288 00000100:00100000:1.0:1651529344.510468:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946404544 00000100:00100000:0.0:1651529344.510472:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211155 00000100:00100000:1.0:1651529344.510475:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211156 00000100:00100000:0.0:1651529344.510475:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+650:39029:x1731745946404288:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.510476:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+650:39030:x1731745946404544:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.510480:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177603 count 1 00002000:00080000:1.0:1651529344.510482:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177604 count 1 00010000:00010000:0.0:1651529344.510485:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c509ed lrc: 3/0,1 mode: --/PW res: [0x2b5c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510486:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c509f4 lrc: 3/0,1 mode: --/PW res: [0x2b5c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.510489:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d965a5a7/0x3234de053c4ed22 lrc: 2/0,0 mode: PR/PR res: [0x2b5c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d664c expref: 1412 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.510490:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000067d7e6f0/0x3234de053c4caed lrc: 2/0,0 mode: PR/PR res: [0x2b5c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd4e expref: 1412 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.510493:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.510493:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.510493:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.510494:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.510494:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c509ed lrc: 4/0,1 mode: --/PW res: [0x2b5c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510495:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c509f4 lrc: 4/0,1 mode: --/PW res: [0x2b5c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510501:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000067d7e6f0/0x3234de053c4caed lrc: 3/0,0 mode: PR/PR res: [0x2b5c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd4e expref: 1412 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.510506:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000067d7e6f0/0x3234de053c4caed lrc: 4/0,0 mode: PR/PR res: [0x2b5c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd4e expref: 1412 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.510510:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000086eaa330 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996980672:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.510518:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d965a5a7/0x3234de053c4ed22 lrc: 3/0,0 mode: PR/PR res: [0x2b5c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d664c expref: 1412 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.510520:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f9dac3f6 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.510530:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d965a5a7/0x3234de053c4ed22 lrc: 4/0,0 mode: PR/PR res: [0x2b5c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d664c expref: 1412 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.510535:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a925fbf6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996980736:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.510561:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c2b2b59c going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.510563:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.510575:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946404672 00000100:00100000:1.0:1651529344.510586:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211157 00000100:00100000:1.0:1651529344.510588:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+651:39029:x1731745946404672:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.510590:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529344.510593:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177606 count 1 00010000:00010000:1.0:1651529344.510597:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c509fb lrc: 3/0,1 mode: --/PW res: [0x2b5c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.510598:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.510608:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000796e2f49/0x3234de053c4c9ce lrc: 2/0,0 mode: PR/PR res: [0x2b5c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd949 expref: 1412 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.510608:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.510612:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.510612:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.510613:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c509fb lrc: 4/0,1 mode: --/PW res: [0x2b5c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.510615:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946404608 00010000:00010000:1.0:1651529344.510620:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000796e2f49/0x3234de053c4c9ce lrc: 3/0,0 mode: PR/PR res: [0x2b5c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd949 expref: 1412 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.510622:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946404736 00010000:00010000:1.0:1651529344.510623:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000796e2f49/0x3234de053c4c9ce lrc: 4/0,0 mode: PR/PR res: [0x2b5c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd949 expref: 1412 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.510625:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946404800 00000100:00100000:0.0:1651529344.510629:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211158 00000100:00100000:1.0:1651529344.510630:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a13808c6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996980800:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.510631:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f0d488f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+654:39029:x1731745946404608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.510636:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177605 count 1 00000100:00100000:1.0:1651529344.510638:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f79d8146 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.510640:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50a02 lrc: 3/0,1 mode: --/PW res: [0x2b5c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.510644:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211159 00010000:00010000:0.0:1651529344.510644:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f0d30d7f/0x3234de053c4c9ab lrc: 2/0,0 mode: PR/PR res: [0x2b5c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd885 expref: 1412 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.510646:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+654:39030:x1731745946404736:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.510648:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.510648:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.510649:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50a02 lrc: 4/0,1 mode: --/PW res: [0x2b5c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.510650:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177607 count 1 00010000:00010000:1.0:1651529344.510654:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50a09 lrc: 3/0,1 mode: --/PW res: [0x2b5c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.510656:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f0d30d7f/0x3234de053c4c9ab lrc: 3/0,0 mode: PR/PR res: [0x2b5c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd885 expref: 1412 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.510658:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000100428b/0x3234de053c4f0e1 lrc: 2/0,0 mode: PR/PR res: [0x2b5c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d75fe expref: 1412 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.510659:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f0d30d7f/0x3234de053c4c9ab lrc: 4/0,0 mode: PR/PR res: [0x2b5c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd885 expref: 1412 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.510661:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.510662:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.510662:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50a09 lrc: 4/0,1 mode: --/PW res: [0x2b5c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.510664:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002f77bb41 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996980864:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.510668:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000100428b/0x3234de053c4f0e1 lrc: 3/0,0 mode: PR/PR res: [0x2b5c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d75fe expref: 1412 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.510672:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000100428b/0x3234de053c4f0e1 lrc: 4/0,0 mode: PR/PR res: [0x2b5c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d75fe expref: 1412 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.510672:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000000a4def41 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.510676:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006647e4ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996980928:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.510678:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211160 00000100:00100000:0.0:1651529344.510680:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+654:39030:x1731745946404800:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.510682:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8a0b704 going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.510684:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177608 count 1 00010000:00010000:0.0:1651529344.510687:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50a10 lrc: 3/0,1 mode: --/PW res: [0x2b5c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.510690:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000078f9a278 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996980544:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.510693:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c509df lrc: 3/0,1 mode: --/PW res: [0x2b5c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.510705:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cb76f8f9/0x3234de053c4d73b lrc: 2/0,0 mode: PR/PR res: [0x2b5c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e7f expref: 1412 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.510714:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.510714:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.510715:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50a10 lrc: 4/0,1 mode: --/PW res: [0x2b5c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.510730:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cb76f8f9/0x3234de053c4d73b lrc: 3/0,0 mode: PR/PR res: [0x2b5c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e7f expref: 1412 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.510733:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cb76f8f9/0x3234de053c4d73b lrc: 4/0,0 mode: PR/PR res: [0x2b5c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e7f expref: 1412 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.510746:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005d3fb3ef pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996980992:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.510756:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c0dff858 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.510758:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.510775:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000089d7f5d6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996980608:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.510776:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.510783:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c509e6 lrc: 3/0,1 mode: --/PW res: [0x2b5c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.510791:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396285440 00010000:00010000:1.0:1651529344.510796:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f2c22fc3/0x3234de053c4ec0a lrc: 4/0,0 mode: PR/PR res: [0x2b5c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d61ad expref: 1413 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.510805:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396285504 00010000:00010000:1.0:1651529344.510809:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e62d422c/0x3234de053c4e446 lrc: 4/0,0 mode: PR/PR res: [0x2b5c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4242 expref: 1414 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.510810:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11935 00000100:00100000:0.0:1651529344.510812:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1414:41279:x1731746396285440:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.510815:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11936 00010000:00010000:0.0:1651529344.510815:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.510817:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1414:41278:x1731746396285504:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.510817:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f2c22fc3/0x3234de053c4ec0a lrc: 4/0,0 mode: PR/PR res: [0x2b5c1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d61ad expref: 1414 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.510820:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.510821:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e62d422c/0x3234de053c4e446 lrc: 4/0,0 mode: PR/PR res: [0x2b5c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4242 expref: 1414 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.510822:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f2c22fc3/0x3234de053c4ec0a lrc: 3/0,0 mode: PR/PR res: [0x2b5c1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d61ad expref: 1414 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.510825:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e62d422c/0x3234de053c4e446 lrc: 3/0,0 mode: PR/PR res: [0x2b5c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4242 expref: 1414 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.510828:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2c22fc3/0x3234de053c4ec0a lrc: 0/0,0 mode: --/PR res: [0x2b5c1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d61ad expref: 1414 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.510830:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e62d422c/0x3234de053c4e446 lrc: 0/0,0 mode: --/PR res: [0x2b5c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4242 expref: 1414 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.510832:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.510832:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.510833:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c509df lrc: 3/0,1 mode: PW/PW res: [0x2b5c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510834:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.510835:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.510836:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c509e6 lrc: 3/0,1 mode: PW/PW res: [0x2b5c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.510836:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c509df lrc: 4/0,1 mode: PW/PW res: [0x2b5c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510839:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c509e6 lrc: 4/0,1 mode: PW/PW res: [0x2b5c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.510846:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.510852:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.510852:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1412:41279:x1731746396285440:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 39us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.510855:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11935 00000100:00100000:1.0:1651529344.510859:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1411:41278:x1731746396285504:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 41us (83us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.510862:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11936 00010000:00010000:1.0:1651529344.510869:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c509df lrc: 3/0,1 mode: PW/PW res: [0x2b5c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510872:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c509df lrc: 3/0,1 mode: PW/PW res: [0x2b5c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510875:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c509df lrc: 3/0,1 mode: PW/PW res: [0x2b5c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510878:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c509df lrc: 2/0,0 mode: PW/PW res: [0x2b5c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.510923:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+655:39029:x1731745946404160:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1073us (1108us total) trans 12885079208 rc 0/0 00000100:00100000:1.0:1651529344.510926:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211153 00010000:00010000:1.0:1651529344.510934:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c509df lrc: 2/0,0 mode: PW/PW res: [0x2b5c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510937:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f27c804 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.510938:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c509df lrc: 2/0,0 mode: PW/PW res: [0x2b5c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510941:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c509df lrc: 3/0,0 mode: PW/PW res: [0x2b5c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510946:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c509df lrc: 1/0,0 mode: --/PW res: [0x2b5c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510949:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c509df lrc: 0/0,0 mode: --/PW res: [0x2b5c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510963:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c509e6 lrc: 3/0,1 mode: PW/PW res: [0x2b5c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510966:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c509e6 lrc: 3/0,1 mode: PW/PW res: [0x2b5c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510969:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c509e6 lrc: 3/0,1 mode: PW/PW res: [0x2b5c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.510972:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c509e6 lrc: 2/0,0 mode: PW/PW res: [0x2b5c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.510983:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c509e6 lrc: 2/0,0 mode: PW/PW res: [0x2b5c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.510988:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000034aad4d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.510989:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c509e6 lrc: 2/0,0 mode: PW/PW res: [0x2b5c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.510992:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c509e6 lrc: 3/0,0 mode: PW/PW res: [0x2b5c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.510997:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c509e6 lrc: 1/0,0 mode: --/PW res: [0x2b5c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.511000:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c509e6 lrc: 0/0,0 mode: --/PW res: [0x2b5c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.511016:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+655:39030:x1731745946404224:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 646us (686us total) trans 12885079209 rc 0/0 00000100:00100000:1.0:1651529344.511019:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211154 00000100:00100000:0.0:1651529344.511117:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.511140:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946404864 00000100:00100000:1.0:1651529344.511149:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211161 00000100:00100000:1.0:1651529344.511150:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+655:39030:x1731745946404864:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.511156:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177609 count 1 00010000:00010000:1.0:1651529344.511160:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50a17 lrc: 3/0,1 mode: --/PW res: [0x2b5c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.511164:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000072f10afd/0x3234de053c4e42a lrc: 2/0,0 mode: PR/PR res: [0x2b5c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d41e0 expref: 1410 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.511168:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.511168:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.511169:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50a17 lrc: 4/0,1 mode: --/PW res: [0x2b5c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.511176:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000072f10afd/0x3234de053c4e42a lrc: 3/0,0 mode: PR/PR res: [0x2b5c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d41e0 expref: 1410 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.511179:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000072f10afd/0x3234de053c4e42a lrc: 4/0,0 mode: PR/PR res: [0x2b5c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d41e0 expref: 1410 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.511183:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a223a622 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996981056:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.511194:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.511218:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.511279:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946404928 00000100:00100000:1.0:1651529344.511289:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211162 00000100:00100000:1.0:1651529344.511304:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+656:39029:x1731745946404928:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.511304:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a925fbf6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996980736:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.511309:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c509ed lrc: 3/0,1 mode: --/PW res: [0x2b5c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.511310:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177610 count 1 00010000:00010000:1.0:1651529344.511314:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50a1e lrc: 3/0,1 mode: --/PW res: [0x2b5ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.511319:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000058589413/0x3234de053c4a0d8 lrc: 2/0,0 mode: PR/PR res: [0x2b5ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb8b1 expref: 1410 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.511322:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.511323:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.511323:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50a1e lrc: 4/0,1 mode: --/PW res: [0x2b5ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.511330:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000058589413/0x3234de053c4a0d8 lrc: 3/0,0 mode: PR/PR res: [0x2b5ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb8b1 expref: 1410 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.511333:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000058589413/0x3234de053c4a0d8 lrc: 4/0,0 mode: PR/PR res: [0x2b5ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb8b1 expref: 1410 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.511337:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000089d7f5d6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996981120:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.511351:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 000000007e004c12 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.511359:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000086eaa330 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996980672:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.511364:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c509f4 lrc: 3/0,1 mode: --/PW res: [0x2b5c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.511391:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a13808c6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996980800:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.511394:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c509fb lrc: 3/0,1 mode: --/PW res: [0x2b5c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.511650:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006647e4ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996980928:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.511654:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50a09 lrc: 3/0,1 mode: --/PW res: [0x2b5c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.511655:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.511680:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396285568 00010000:00010000:1.0:1651529344.511685:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000067d7e6f0/0x3234de053c4caed lrc: 4/0,0 mode: PR/PR res: [0x2b5c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd4e expref: 1411 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.511693:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.511704:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.511705:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396285696 00010000:00010000:1.0:1651529344.511708:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000796e2f49/0x3234de053c4c9ce lrc: 4/0,0 mode: PR/PR res: [0x2b5c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd949 expref: 1412 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.511711:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.511712:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396285824 00010000:00010000:1.0:1651529344.511715:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000100428b/0x3234de053c4f0e1 lrc: 4/0,0 mode: PR/PR res: [0x2b5c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d75fe expref: 1413 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.511716:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.511719:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396285632 00010000:00010000:1.0:1651529344.511721:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d965a5a7/0x3234de053c4ed22 lrc: 4/0,0 mode: PR/PR res: [0x2b5c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d664c expref: 1414 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.511721:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.511725:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396285760 00010000:00010000:1.0:1651529344.511746:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f0d30d7f/0x3234de053c4c9ab lrc: 5/0,0 mode: PR/PR res: [0x2b5c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd885 expref: 1415 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.511746:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.511751:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396285888 00000100:00100000:0.0:1651529344.511752:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.511754:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cb76f8f9/0x3234de053c4d73b lrc: 5/0,0 mode: PR/PR res: [0x2b5c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e7f expref: 1416 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.511758:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396286016 00010000:00010000:1.0:1651529344.511760:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000058589413/0x3234de053c4a0d8 lrc: 5/0,0 mode: PR/PR res: [0x2b5ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb8b1 expref: 1417 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.511760:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002f77bb41 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996980864:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.511764:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396285952 00010000:00010000:0.0:1651529344.511765:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50a02 lrc: 3/0,1 mode: --/PW res: [0x2b5c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.511766:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000072f10afd/0x3234de053c4e42a lrc: 5/0,0 mode: PR/PR res: [0x2b5c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d41e0 expref: 1418 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.511770:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11937 00000100:00100000:1.0:1651529344.511772:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1418:41279:x1731746396285568:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.511772:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005d3fb3ef pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996980992:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.511774:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50a10 lrc: 3/0,1 mode: --/PW res: [0x2b5c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.511775:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.511776:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000067d7e6f0/0x3234de053c4caed lrc: 4/0,0 mode: PR/PR res: [0x2b5c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd4e expref: 1418 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.511780:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000067d7e6f0/0x3234de053c4caed lrc: 3/0,0 mode: PR/PR res: [0x2b5c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd4e expref: 1418 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.511781:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11938 00000100:00100000:0.0:1651529344.511783:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e75f071f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1418:41279:x1731746396285696:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.511785:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067d7e6f0/0x3234de053c4caed lrc: 0/0,0 mode: --/PR res: [0x2b5c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd4e expref: 1418 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.511786:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.511788:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000796e2f49/0x3234de053c4c9ce lrc: 4/0,0 mode: PR/PR res: [0x2b5c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd949 expref: 1418 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.511789:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.511789:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.511790:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c509f4 lrc: 3/0,1 mode: PW/PW res: [0x2b5c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.511791:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000796e2f49/0x3234de053c4c9ce lrc: 3/0,0 mode: PR/PR res: [0x2b5c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd949 expref: 1417 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.511796:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c509f4 lrc: 4/0,1 mode: PW/PW res: [0x2b5c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.511797:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000796e2f49/0x3234de053c4c9ce lrc: 0/0,0 mode: --/PR res: [0x2b5c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd949 expref: 1417 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.511801:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.511801:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.511802:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.511802:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c509fb lrc: 3/0,1 mode: PW/PW res: [0x2b5c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.511805:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c509fb lrc: 4/0,1 mode: PW/PW res: [0x2b5c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.511811:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1416:41279:x1731746396285568:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 38us (157us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.511814:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.511820:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11937 00000100:00100000:0.0:1651529344.511822:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e75f071f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1416:41279:x1731746396285696:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 39us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.511825:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11939 00000100:00100000:1.0:1651529344.511826:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1415:41279:x1731746396285824:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.511826:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11938 00010000:00010000:1.0:1651529344.511829:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.511831:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000100428b/0x3234de053c4f0e1 lrc: 4/0,0 mode: PR/PR res: [0x2b5c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d75fe expref: 1414 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.511835:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000100428b/0x3234de053c4f0e1 lrc: 3/0,0 mode: PR/PR res: [0x2b5c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d75fe expref: 1414 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.511836:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11940 00000100:00100000:0.0:1651529344.511838:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1414:41278:x1731746396285632:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.511839:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000100428b/0x3234de053c4f0e1 lrc: 0/0,0 mode: --/PR res: [0x2b5c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d75fe expref: 1414 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.511841:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.511842:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d965a5a7/0x3234de053c4ed22 lrc: 4/0,0 mode: PR/PR res: [0x2b5c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d664c expref: 1413 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.511843:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.511843:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.511844:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50a09 lrc: 3/0,1 mode: PW/PW res: [0x2b5c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.511846:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d965a5a7/0x3234de053c4ed22 lrc: 3/0,0 mode: PR/PR res: [0x2b5c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d664c expref: 1413 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.511847:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50a09 lrc: 4/0,1 mode: PW/PW res: [0x2b5c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.511851:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d965a5a7/0x3234de053c4ed22 lrc: 0/0,0 mode: --/PR res: [0x2b5c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d664c expref: 1413 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.511854:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.511855:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.511855:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.511856:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c509ed lrc: 3/0,1 mode: PW/PW res: [0x2b5c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.511859:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c509ed lrc: 4/0,1 mode: PW/PW res: [0x2b5c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.511861:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1412:41279:x1731746396285824:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 34us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.511863:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11939 00010000:00010000:0.0:1651529344.511864:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.511868:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11941 00000100:00100000:1.0:1651529344.511869:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1411:41278:x1731746396285760:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.511870:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1411:41278:x1731746396285632:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 31us (159us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.511871:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.511873:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f0d30d7f/0x3234de053c4c9ab lrc: 4/0,0 mode: PR/PR res: [0x2b5c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd885 expref: 1411 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.511873:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11940 00010000:00010000:1.0:1651529344.511876:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f0d30d7f/0x3234de053c4c9ab lrc: 3/0,0 mode: PR/PR res: [0x2b5c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd885 expref: 1410 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.511877:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11942 00000100:00100000:0.0:1651529344.511879:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1410:41278:x1731746396285888:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.511881:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0d30d7f/0x3234de053c4c9ab lrc: 0/0,0 mode: --/PR res: [0x2b5c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd885 expref: 1410 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.511881:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.511882:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cb76f8f9/0x3234de053c4d73b lrc: 4/0,0 mode: PR/PR res: [0x2b5c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e7f expref: 1410 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.511884:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.511885:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.511885:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50a02 lrc: 3/0,1 mode: PW/PW res: [0x2b5c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.511886:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cb76f8f9/0x3234de053c4d73b lrc: 3/0,0 mode: PR/PR res: [0x2b5c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e7f expref: 1409 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.511888:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50a02 lrc: 4/0,1 mode: PW/PW res: [0x2b5c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.511890:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb76f8f9/0x3234de053c4d73b lrc: 0/0,0 mode: --/PR res: [0x2b5c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e7f expref: 1409 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.511893:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.511894:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.511895:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50a10 lrc: 3/0,1 mode: PW/PW res: [0x2b5c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.511898:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.511903:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1408:41278:x1731746396285760:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (187us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.511905:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50a10 lrc: 4/0,1 mode: PW/PW res: [0x2b5c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.511906:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11941 00000100:00100000:1.0:1651529344.511910:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11943 00010000:00010000:0.0:1651529344.511911:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.511912:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1407:41278:x1731746396286016:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.511914:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.511915:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000058589413/0x3234de053c4a0d8 lrc: 5/0,0 mode: PR/PR res: [0x2b5ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb8b1 expref: 1407 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.511916:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1407:41278:x1731746396285888:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (195us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.511919:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000058589413/0x3234de053c4a0d8 lrc: 4/0,0 mode: PR/PR res: [0x2b5ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb8b1 expref: 1407 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.511919:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11942 00010000:00010000:1.0:1651529344.511923:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.511923:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11944 00010000:00010000:1.0:1651529344.511924:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.511924:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50a1e lrc: 3/0,1 mode: PW/PW res: [0x2b5ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.511925:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1406:41278:x1731746396285952:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.511927:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50a1e lrc: 4/0,1 mode: PW/PW res: [0x2b5ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.511927:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.511929:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000072f10afd/0x3234de053c4e42a lrc: 5/0,0 mode: PR/PR res: [0x2b5c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d41e0 expref: 1406 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.511932:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.511933:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000072f10afd/0x3234de053c4e42a lrc: 4/0,0 mode: PR/PR res: [0x2b5c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d41e0 expref: 1406 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.511936:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1406:41278:x1731746396286016:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 24us (190us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.511937:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.511938:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.511939:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11943 00010000:00010000:0.0:1651529344.511939:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50a17 lrc: 3/0,1 mode: PW/PW res: [0x2b5c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.511942:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50a17 lrc: 4/0,1 mode: PW/PW res: [0x2b5c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.511946:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c509f4 lrc: 3/0,1 mode: PW/PW res: [0x2b5c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.511946:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.511949:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c509f4 lrc: 3/0,1 mode: PW/PW res: [0x2b5c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.511950:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1405:41278:x1731746396285952:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 24us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.511952:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11944 00010000:00010000:1.0:1651529344.511953:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c509f4 lrc: 3/0,1 mode: PW/PW res: [0x2b5c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.511955:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c509f4 lrc: 2/0,0 mode: PW/PW res: [0x2b5c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.511958:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50a02 lrc: 3/0,1 mode: PW/PW res: [0x2b5c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.511961:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50a02 lrc: 3/0,1 mode: PW/PW res: [0x2b5c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.511971:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50a02 lrc: 3/0,1 mode: PW/PW res: [0x2b5c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.511974:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50a02 lrc: 2/0,0 mode: PW/PW res: [0x2b5c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.512010:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+658:39030:x1731745946404544:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1533us (1557us total) trans 12885079210 rc 0/0 00000100:00100000:1.0:1651529344.512013:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211156 00010000:00010000:1.0:1651529344.512021:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c509f4 lrc: 2/0,0 mode: PW/PW res: [0x2b5c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512024:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000be0f0b1c already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.512025:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c509f4 lrc: 2/0,0 mode: PW/PW res: [0x2b5c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512028:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c509f4 lrc: 3/0,0 mode: PW/PW res: [0x2b5c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.512029:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f0d488f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+657:39029:x1731745946404608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1397us (1439us total) trans 12885079211 rc 0/0 00000100:00100000:0.0:1651529344.512032:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211158 00010000:00010000:1.0:1651529344.512033:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c509f4 lrc: 1/0,0 mode: --/PW res: [0x2b5c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512036:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c509f4 lrc: 0/0,0 mode: --/PW res: [0x2b5c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512039:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50a02 lrc: 2/0,0 mode: PW/PW res: [0x2b5c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512043:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006b93727a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.512044:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50a02 lrc: 2/0,0 mode: PW/PW res: [0x2b5c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512045:0:80277:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072f10afd/0x3234de053c4e42a lrc: 0/0,0 mode: --/PR res: [0x2b5c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d41e0 expref: 1404 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.512047:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50a02 lrc: 3/0,0 mode: PW/PW res: [0x2b5c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.512049:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a223a622 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996981056:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.512051:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50a02 lrc: 1/0,0 mode: --/PW res: [0x2b5c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512053:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50a17 lrc: 3/0,1 mode: PW/PW res: [0x2b5c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512054:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50a02 lrc: 0/0,0 mode: --/PW res: [0x2b5c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512056:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50a17 lrc: 3/0,1 mode: PW/PW res: [0x2b5c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512058:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50a17 lrc: 3/0,1 mode: PW/PW res: [0x2b5c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512060:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50a10 lrc: 3/0,1 mode: PW/PW res: [0x2b5c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512061:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50a17 lrc: 3/0,1 mode: PW/PW res: [0x2b5c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512063:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50a10 lrc: 3/0,1 mode: PW/PW res: [0x2b5c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512064:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50a17 lrc: 2/0,0 mode: PW/PW res: [0x2b5c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512066:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50a10 lrc: 3/0,1 mode: PW/PW res: [0x2b5c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512069:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50a10 lrc: 2/0,0 mode: PW/PW res: [0x2b5c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.512110:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+658:39030:x1731745946404864:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 958us (993us total) trans 12885079212 rc 0/0 00000100:00100000:1.0:1651529344.512113:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211161 00000100:00100000:0.0:1651529344.512115:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+657:39030:x1731745946404800:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1435us (1507us total) trans 12885079213 rc 0/0 00000100:00100000:0.0:1651529344.512118:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211160 00010000:00010000:1.0:1651529344.512119:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c509fb lrc: 3/0,1 mode: PW/PW res: [0x2b5c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512122:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c509fb lrc: 3/0,1 mode: PW/PW res: [0x2b5c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512126:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50a17 lrc: 2/0,0 mode: PW/PW res: [0x2b5c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512128:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c509fb lrc: 3/0,1 mode: PW/PW res: [0x2b5c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512129:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000005a52f96 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.512130:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50a17 lrc: 2/0,0 mode: PW/PW res: [0x2b5c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512131:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c509fb lrc: 2/0,0 mode: PW/PW res: [0x2b5c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512133:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50a17 lrc: 3/0,0 mode: PW/PW res: [0x2b5c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512144:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50a17 lrc: 1/0,0 mode: --/PW res: [0x2b5c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512147:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50a17 lrc: 0/0,0 mode: --/PW res: [0x2b5c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512152:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50a10 lrc: 2/0,0 mode: PW/PW res: [0x2b5c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512155:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e0e037e6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.512156:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50a10 lrc: 2/0,0 mode: PW/PW res: [0x2b5c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512158:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50a10 lrc: 3/0,0 mode: PW/PW res: [0x2b5c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512162:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50a10 lrc: 1/0,0 mode: --/PW res: [0x2b5c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512164:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50a10 lrc: 0/0,0 mode: --/PW res: [0x2b5c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512168:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c509fb lrc: 2/0,0 mode: PW/PW res: [0x2b5c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.512169:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+657:39029:x1731745946404672:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1580us (1607us total) trans 12885079214 rc 0/0 00010000:00010000:0.0:1651529344.512170:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001630f6d1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.512171:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c509fb lrc: 2/0,0 mode: PW/PW res: [0x2b5c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.512172:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211157 00010000:00010000:0.0:1651529344.512174:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c509fb lrc: 3/0,0 mode: PW/PW res: [0x2b5c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512177:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c509fb lrc: 1/0,0 mode: --/PW res: [0x2b5c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512178:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50a09 lrc: 3/0,1 mode: PW/PW res: [0x2b5c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512179:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c509fb lrc: 0/0,0 mode: --/PW res: [0x2b5c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512181:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50a09 lrc: 3/0,1 mode: PW/PW res: [0x2b5c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512185:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50a09 lrc: 3/0,1 mode: PW/PW res: [0x2b5c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512185:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c509ed lrc: 3/0,1 mode: PW/PW res: [0x2b5c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512187:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50a09 lrc: 2/0,0 mode: PW/PW res: [0x2b5c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512188:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c509ed lrc: 3/0,1 mode: PW/PW res: [0x2b5c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512191:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c509ed lrc: 3/0,1 mode: PW/PW res: [0x2b5c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512199:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c509ed lrc: 2/0,0 mode: PW/PW res: [0x2b5c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.512238:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+658:39030:x1731745946404736:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1591us (1639us total) trans 12885079215 rc 0/0 00000100:00100000:1.0:1651529344.512241:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211159 00010000:00010000:1.0:1651529344.512251:0:72397:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058589413/0x3234de053c4a0d8 lrc: 0/0,0 mode: --/PR res: [0x2b5ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb8b1 expref: 1403 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.512253:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+657:39029:x1731745946404288:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1778us (1817us total) trans 12885079216 rc 0/0 00000100:00100000:0.0:1651529344.512256:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211155 00000100:00100000:1.0:1651529344.512257:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000089d7f5d6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996981120:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.512261:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50a1e lrc: 3/0,1 mode: PW/PW res: [0x2b5ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512264:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50a1e lrc: 3/0,1 mode: PW/PW res: [0x2b5ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512267:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50a1e lrc: 3/0,1 mode: PW/PW res: [0x2b5ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512270:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50a1e lrc: 3/0,1 mode: PW/PW res: [0x2b5ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512272:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50a1e lrc: 2/0,0 mode: PW/PW res: [0x2b5ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512278:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50a09 lrc: 2/0,0 mode: PW/PW res: [0x2b5c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512282:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006abc37e1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.512283:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50a09 lrc: 2/0,0 mode: PW/PW res: [0x2b5c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512285:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50a09 lrc: 3/0,0 mode: PW/PW res: [0x2b5c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512290:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50a09 lrc: 1/0,0 mode: --/PW res: [0x2b5c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512293:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50a09 lrc: 0/0,0 mode: --/PW res: [0x2b5c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512297:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c509ed lrc: 2/0,0 mode: PW/PW res: [0x2b5c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512300:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000022a9b983 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.512301:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c509ed lrc: 2/0,0 mode: PW/PW res: [0x2b5c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512303:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c509ed lrc: 3/0,0 mode: PW/PW res: [0x2b5c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512306:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c509ed lrc: 1/0,0 mode: --/PW res: [0x2b5c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.512308:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+657:39029:x1731745946404928:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1003us (1090us total) trans 12885079217 rc 0/0 00010000:00010000:0.0:1651529344.512309:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c509ed lrc: 0/0,0 mode: --/PW res: [0x2b5c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.512311:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211162 00010000:00010000:0.0:1651529344.512312:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50a1e lrc: 2/0,0 mode: PW/PW res: [0x2b5ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512315:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005d8a4887 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.512315:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50a1e lrc: 2/0,0 mode: PW/PW res: [0x2b5ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512318:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50a1e lrc: 3/0,0 mode: PW/PW res: [0x2b5ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512321:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50a1e lrc: 1/0,0 mode: --/PW res: [0x2b5ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512324:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50a1e lrc: 0/0,0 mode: --/PW res: [0x2b5ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.512694:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.512702:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.512712:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.512713:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946405504 00000100:00100000:1.0:1651529344.512718:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.512730:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946405632 00000100:00100000:0.0:1651529344.512742:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946405696 00000100:00100000:1.0:1651529344.512744:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.512747:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946405760 00000100:00100000:0.0:1651529344.512751:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946405888 00000100:00100000:1.0:1651529344.512752:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.512760:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946406016 00000100:00100000:1.0:1651529344.512762:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.512771:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946405952 00000100:00100000:0.0:1651529344.512775:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211163 00000100:00100000:0.0:1651529344.512776:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+663:39029:x1731745946405504:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.512777:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.512782:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177611 count 1 00000100:00100000:1.0:1651529344.512783:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946406080 00010000:00010000:0.0:1651529344.512787:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50a25 lrc: 3/0,1 mode: --/PW res: [0x2b5cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.512790:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211164 00000100:00100000:1.0:1651529344.512792:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+664:39030:x1731745946405632:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.512792:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009be39b1e/0x3234de053c4f3c7 lrc: 2/0,0 mode: PR/PR res: [0x2b5cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81a4 expref: 1402 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.512795:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.512796:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.512796:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50a25 lrc: 4/0,1 mode: --/PW res: [0x2b5cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.512797:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177612 count 1 00010000:00010000:1.0:1651529344.512802:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50a2c lrc: 3/0,1 mode: --/PW res: [0x2b5cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512803:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009be39b1e/0x3234de053c4f3c7 lrc: 3/0,0 mode: PR/PR res: [0x2b5cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81a4 expref: 1402 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.512807:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000000a38a72/0x3234de053c4ef75 lrc: 2/0,0 mode: PR/PR res: [0x2b5cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6fde expref: 1402 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.512807:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009be39b1e/0x3234de053c4f3c7 lrc: 4/0,0 mode: PR/PR res: [0x2b5cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81a4 expref: 1402 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.512810:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.512811:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.512811:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50a2c lrc: 4/0,1 mode: --/PW res: [0x2b5cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.512812:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000027c41311 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996981184:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.512818:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000000a38a72/0x3234de053c4ef75 lrc: 3/0,0 mode: PR/PR res: [0x2b5cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6fde expref: 1402 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.512822:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000000a38a72/0x3234de053c4ef75 lrc: 4/0,0 mode: PR/PR res: [0x2b5cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6fde expref: 1402 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.512824:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 0000000009370c1d going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.512826:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002a957ba7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996981248:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.512831:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211165 00000100:00100000:0.0:1651529344.512832:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+664:39029:x1731745946405696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.512835:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 000000007e004c12 going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.512837:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177613 count 1 00010000:00010000:0.0:1651529344.512840:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50a33 lrc: 3/0,1 mode: --/PW res: [0x2b5cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.512842:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211166 00000100:00100000:1.0:1651529344.512843:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+664:39030:x1731745946405760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.512844:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b316afed/0x3234de053c4e39e lrc: 2/0,0 mode: PR/PR res: [0x2b5cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3fa9 expref: 1402 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.512847:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.512847:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1651529344.512848:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177614 count 1 00010000:00010000:0.0:1651529344.512848:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50a33 lrc: 4/0,1 mode: --/PW res: [0x2b5cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512851:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50a3a lrc: 3/0,1 mode: --/PW res: [0x2b5ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512854:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b316afed/0x3234de053c4e39e lrc: 3/0,0 mode: PR/PR res: [0x2b5cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3fa9 expref: 1402 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.512856:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c4e84b lrc: 2/0,0 mode: PR/PR res: [0x2b5ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5210 expref: 1402 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.512858:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b316afed/0x3234de053c4e39e lrc: 4/0,0 mode: PR/PR res: [0x2b5cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3fa9 expref: 1402 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.512859:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.512859:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.512860:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50a3a lrc: 4/0,1 mode: --/PW res: [0x2b5ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.512862:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006929eb96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996981312:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.512866:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c4e84b lrc: 3/0,0 mode: PR/PR res: [0x2b5ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5210 expref: 1402 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.512868:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000abca413e going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.512869:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c4e84b lrc: 4/0,0 mode: PR/PR res: [0x2b5ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5210 expref: 1402 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.512873:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a223a622 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996981376:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.512874:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211167 00000100:00100000:0.0:1651529344.512876:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+664:39030:x1731745946405888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.512879:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fe434b1c going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.512879:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177615 count 1 00010000:00010000:0.0:1651529344.512882:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50a41 lrc: 3/0,1 mode: --/PW res: [0x2b5cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.512885:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211168 00000100:00100000:1.0:1651529344.512886:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+664:39030:x1731745946406016:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.512887:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009a79f739/0x3234de053c4eb77 lrc: 2/0,0 mode: PR/PR res: [0x2b5cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f6f expref: 1402 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.512890:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177617 count 1 00010000:00010000:0.0:1651529344.512890:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.512890:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.512891:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50a41 lrc: 4/0,1 mode: --/PW res: [0x2b5cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512893:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50a48 lrc: 3/0,1 mode: --/PW res: [0x2b5d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512897:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a8dde12a/0x3234de053c4e741 lrc: 2/0,0 mode: PR/PR res: [0x2b5d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4df6 expref: 1402 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.512897:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009a79f739/0x3234de053c4eb77 lrc: 3/0,0 mode: PR/PR res: [0x2b5cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f6f expref: 1402 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.512900:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.512900:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009a79f739/0x3234de053c4eb77 lrc: 4/0,0 mode: PR/PR res: [0x2b5cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f6f expref: 1402 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.512901:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.512902:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50a48 lrc: 4/0,1 mode: --/PW res: [0x2b5d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.512904:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c20a6e11 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996981440:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.512907:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a8dde12a/0x3234de053c4e741 lrc: 3/0,0 mode: PR/PR res: [0x2b5d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4df6 expref: 1402 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.512910:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a8dde12a/0x3234de053c4e741 lrc: 4/0,0 mode: PR/PR res: [0x2b5d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4df6 expref: 1402 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.512910:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 000000000e7e66c4 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.512914:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005a17dd72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996981504:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.512916:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211169 00000100:00100000:0.0:1651529344.512917:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+664:39030:x1731745946405952:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.512920:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cfa1ca05 going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.512921:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177616 count 1 00010000:00010000:0.0:1651529344.512924:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50a4f lrc: 3/0,1 mode: --/PW res: [0x2b5d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.512926:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211170 00000100:00100000:1.0:1651529344.512927:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+664:39030:x1731745946406080:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.512931:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177618 count 1 00010000:00010000:0.0:1651529344.512931:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001cdd444d/0x3234de053c4cff5 lrc: 2/0,0 mode: PR/PR res: [0x2b5d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf11a expref: 1402 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.512933:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.512934:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50a56 lrc: 3/0,1 mode: --/PW res: [0x2b5d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512934:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.512934:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50a4f lrc: 4/0,1 mode: --/PW res: [0x2b5d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.512938:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002f86d1dc/0x3234de053c4d972 lrc: 2/0,0 mode: PR/PR res: [0x2b5d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d164a expref: 1402 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.512940:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001cdd444d/0x3234de053c4cff5 lrc: 3/0,0 mode: PR/PR res: [0x2b5d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf11a expref: 1402 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.512941:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.512942:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.512942:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50a56 lrc: 4/0,1 mode: --/PW res: [0x2b5d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.512944:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001cdd444d/0x3234de053c4cff5 lrc: 4/0,0 mode: PR/PR res: [0x2b5d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf11a expref: 1402 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.512948:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f39ca9ea pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996981568:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.512950:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002f86d1dc/0x3234de053c4d972 lrc: 3/0,0 mode: PR/PR res: [0x2b5d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d164a expref: 1402 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.512954:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002f86d1dc/0x3234de053c4d972 lrc: 4/0,0 mode: PR/PR res: [0x2b5d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d164a expref: 1402 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.512954:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a3b00cf3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.512957:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006647e4ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996981632:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.512963:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.513200:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000027c41311 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996981184:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.513210:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50a25 lrc: 3/0,1 mode: --/PW res: [0x2b5cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.513211:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002a957ba7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996981248:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.513215:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50a2c lrc: 3/0,1 mode: --/PW res: [0x2b5cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.513218:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006929eb96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996981312:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.513221:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50a33 lrc: 3/0,1 mode: --/PW res: [0x2b5cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.513336:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.513344:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.513354:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.513355:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396286656 00000100:00100000:0.0:1651529344.513364:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396286592 00010000:00010000:1.0:1651529344.513367:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000000a38a72/0x3234de053c4ef75 lrc: 4/0,0 mode: PR/PR res: [0x2b5cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6fde expref: 1404 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.513370:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009be39b1e/0x3234de053c4f3c7 lrc: 4/0,0 mode: PR/PR res: [0x2b5cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81a4 expref: 1404 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.513374:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396286720 00000100:00100000:0.0:1651529344.513376:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11945 00010000:00010000:1.0:1651529344.513377:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b316afed/0x3234de053c4e39e lrc: 4/0,0 mode: PR/PR res: [0x2b5cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3fa9 expref: 1405 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.513378:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000781af77d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1405:41278:x1731746396286656:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.513381:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.513382:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11946 00000100:00100000:1.0:1651529344.513383:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1405:41279:x1731746396286592:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.513383:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000000a38a72/0x3234de053c4ef75 lrc: 4/0,0 mode: PR/PR res: [0x2b5cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6fde expref: 1405 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.513386:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000000a38a72/0x3234de053c4ef75 lrc: 3/0,0 mode: PR/PR res: [0x2b5cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6fde expref: 1405 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.513387:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.513388:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009be39b1e/0x3234de053c4f3c7 lrc: 4/0,0 mode: PR/PR res: [0x2b5cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81a4 expref: 1405 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.513392:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009be39b1e/0x3234de053c4f3c7 lrc: 3/0,0 mode: PR/PR res: [0x2b5cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81a4 expref: 1405 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.513392:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000a38a72/0x3234de053c4ef75 lrc: 0/0,0 mode: --/PR res: [0x2b5cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6fde expref: 1405 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.513396:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.513397:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.513398:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009be39b1e/0x3234de053c4f3c7 lrc: 0/0,0 mode: --/PR res: [0x2b5cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81a4 expref: 1404 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.513398:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50a2c lrc: 3/0,1 mode: PW/PW res: [0x2b5cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.513401:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.513401:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50a2c lrc: 4/0,1 mode: PW/PW res: [0x2b5cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.513402:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.513403:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50a25 lrc: 3/0,1 mode: PW/PW res: [0x2b5cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.513406:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50a25 lrc: 4/0,1 mode: PW/PW res: [0x2b5cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.513410:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.513424:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.513432:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1403:41279:x1731746396286592:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 48us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.513435:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11946 00000100:00100000:1.0:1651529344.513440:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11947 00000100:00100000:1.0:1651529344.513441:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1402:41279:x1731746396286720:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.513441:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000781af77d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1402:41278:x1731746396286656:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 62us (105us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.513444:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.513445:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b316afed/0x3234de053c4e39e lrc: 4/0,0 mode: PR/PR res: [0x2b5cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3fa9 expref: 1402 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.513445:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11945 00010000:00010000:1.0:1651529344.513449:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b316afed/0x3234de053c4e39e lrc: 3/0,0 mode: PR/PR res: [0x2b5cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3fa9 expref: 1401 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.513454:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b316afed/0x3234de053c4e39e lrc: 0/0,0 mode: --/PR res: [0x2b5cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3fa9 expref: 1401 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.513457:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.513458:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.513458:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50a33 lrc: 3/0,1 mode: PW/PW res: [0x2b5cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.513461:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50a33 lrc: 4/0,1 mode: PW/PW res: [0x2b5cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.513467:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50a25 lrc: 3/0,1 mode: PW/PW res: [0x2b5cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.513471:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.513476:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1400:41279:x1731746396286720:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (122us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.513476:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50a25 lrc: 3/0,1 mode: PW/PW res: [0x2b5cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.513479:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11947 00010000:00010000:0.0:1651529344.513479:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50a25 lrc: 3/0,1 mode: PW/PW res: [0x2b5cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.513482:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50a25 lrc: 2/0,0 mode: PW/PW res: [0x2b5cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.513487:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50a2c lrc: 3/0,1 mode: PW/PW res: [0x2b5cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.513495:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50a2c lrc: 3/0,1 mode: PW/PW res: [0x2b5cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.513499:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50a2c lrc: 3/0,1 mode: PW/PW res: [0x2b5cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.513501:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50a2c lrc: 2/0,0 mode: PW/PW res: [0x2b5cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.513533:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+666:39029:x1731745946405504:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 756us (840us total) trans 12885079218 rc 0/0 00000100:00100000:0.0:1651529344.513536:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211163 00000100:00100000:1.0:1651529344.513547:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+666:39030:x1731745946405632:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 755us (845us total) trans 12885079219 rc 0/0 00000100:00100000:1.0:1651529344.513550:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211164 00010000:00010000:1.0:1651529344.513558:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50a25 lrc: 2/0,0 mode: PW/PW res: [0x2b5cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.513561:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001d253066 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.513562:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50a25 lrc: 2/0,0 mode: PW/PW res: [0x2b5cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.513563:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50a2c lrc: 2/0,0 mode: PW/PW res: [0x2b5cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.513565:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50a25 lrc: 3/0,0 mode: PW/PW res: [0x2b5cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.513569:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000827909ec already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.513570:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50a25 lrc: 1/0,0 mode: --/PW res: [0x2b5cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.513570:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50a2c lrc: 2/0,0 mode: PW/PW res: [0x2b5cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.513573:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50a25 lrc: 0/0,0 mode: --/PW res: [0x2b5cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.513576:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50a2c lrc: 3/0,0 mode: PW/PW res: [0x2b5cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.513584:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50a2c lrc: 1/0,0 mode: --/PW res: [0x2b5cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.513588:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50a2c lrc: 0/0,0 mode: --/PW res: [0x2b5cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.513599:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50a33 lrc: 3/0,1 mode: PW/PW res: [0x2b5cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.513604:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50a33 lrc: 3/0,1 mode: PW/PW res: [0x2b5cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.513608:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50a33 lrc: 3/0,1 mode: PW/PW res: [0x2b5cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.513612:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.513613:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50a33 lrc: 2/0,0 mode: PW/PW res: [0x2b5cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.513658:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a223a622 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996981376:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.513662:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50a3a lrc: 3/0,1 mode: --/PW res: [0x2b5ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.513669:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396286912 00010000:00010000:1.0:1651529344.513674:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c4e84b lrc: 4/0,0 mode: PR/PR res: [0x2b5ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5210 expref: 1400 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.513687:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11948 00000100:00100000:0.0:1651529344.513687:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+665:39029:x1731745946405696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 853us (974us total) trans 12885079220 rc 0/0 00000100:00100000:1.0:1651529344.513689:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a13808c6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1400:41278:x1731746396286912:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.513692:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.513693:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211165 00010000:00010000:1.0:1651529344.513694:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c4e84b lrc: 4/0,0 mode: PR/PR res: [0x2b5ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5210 expref: 1400 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.513698:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c4e84b lrc: 3/0,0 mode: PR/PR res: [0x2b5ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5210 expref: 1400 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.513703:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c4e84b lrc: 0/0,0 mode: --/PR res: [0x2b5ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5210 expref: 1400 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.513704:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50a33 lrc: 2/0,0 mode: PW/PW res: [0x2b5cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.513707:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.513708:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.513709:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50a3a lrc: 3/0,1 mode: PW/PW res: [0x2b5ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.513710:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000069f7ba22 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.513712:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50a3a lrc: 4/0,1 mode: PW/PW res: [0x2b5ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.513712:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50a33 lrc: 2/0,0 mode: PW/PW res: [0x2b5cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.513717:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50a33 lrc: 3/0,0 mode: PW/PW res: [0x2b5cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.513718:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.513725:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a13808c6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1399:41278:x1731746396286912:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 35us (113us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.513725:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50a33 lrc: 1/0,0 mode: --/PW res: [0x2b5cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.513727:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11948 00010000:00010000:0.0:1651529344.513729:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50a33 lrc: 0/0,0 mode: --/PW res: [0x2b5cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.513743:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50a3a lrc: 3/0,1 mode: PW/PW res: [0x2b5ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.513747:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50a3a lrc: 3/0,1 mode: PW/PW res: [0x2b5ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.513750:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50a3a lrc: 3/0,1 mode: PW/PW res: [0x2b5ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.513753:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50a3a lrc: 2/0,0 mode: PW/PW res: [0x2b5ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.513804:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+665:39030:x1731745946405760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 959us (1085us total) trans 12885079221 rc 0/0 00000100:00100000:1.0:1651529344.513807:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211166 00010000:00010000:1.0:1651529344.513814:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50a3a lrc: 2/0,0 mode: PW/PW res: [0x2b5ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.513817:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003b0cd546 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.513818:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50a3a lrc: 2/0,0 mode: PW/PW res: [0x2b5ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.513821:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50a3a lrc: 3/0,0 mode: PW/PW res: [0x2b5ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.513834:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50a3a lrc: 1/0,0 mode: --/PW res: [0x2b5ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.513837:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50a3a lrc: 0/0,0 mode: --/PW res: [0x2b5ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.513873:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005a17dd72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996981504:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.513875:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.513877:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50a48 lrc: 3/0,1 mode: --/PW res: [0x2b5d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.513889:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946406528 00000100:00100000:0.0:1651529344.513890:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.513899:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946406592 00000100:00100000:1.0:1651529344.513903:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211171 00000100:00100000:1.0:1651529344.513905:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+666:39030:x1731745946406528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.513910:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177619 count 1 00010000:00010000:1.0:1651529344.513914:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c50a5d lrc: 3/0,1 mode: --/PW res: [0x2b5d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.513917:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.513919:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000577c0905/0x3234de053c4cd1d lrc: 2/0,0 mode: PR/PR res: [0x2b5d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce67e expref: 1398 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.513922:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.513922:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.513923:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c50a5d lrc: 4/0,1 mode: --/PW res: [0x2b5d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.513936:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000577c0905/0x3234de053c4cd1d lrc: 3/0,0 mode: PR/PR res: [0x2b5d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce67e expref: 1398 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.513939:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000577c0905/0x3234de053c4cd1d lrc: 4/0,0 mode: PR/PR res: [0x2b5d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce67e expref: 1398 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.513946:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005a17dd72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996981696:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.513956:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aeda71fe going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.513961:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396287040 00010000:00010000:1.0:1651529344.513966:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009a79f739/0x3234de053c4eb77 lrc: 5/0,0 mode: PR/PR res: [0x2b5cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f6f expref: 1399 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.513968:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.513987:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396287168 00010000:00010000:1.0:1651529344.513990:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a8dde12a/0x3234de053c4e741 lrc: 4/0,0 mode: PR/PR res: [0x2b5d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4df6 expref: 1400 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.514004:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11949 00000100:00100000:1.0:1651529344.514006:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1400:41279:x1731746396287040:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.514006:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.514009:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.514015:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009a79f739/0x3234de053c4eb77 lrc: 5/0,0 mode: PR/PR res: [0x2b5cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f6f expref: 1400 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.514017:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.514019:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009a79f739/0x3234de053c4eb77 lrc: 4/0,0 mode: PR/PR res: [0x2b5cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f6f expref: 1400 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.514023:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.514025:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.514025:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.514030:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50a41 lrc: 3/0,1 mode: PW/PW res: [0x2b5cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514038:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50a41 lrc: 4/0,1 mode: PW/PW res: [0x2b5cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.514040:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946406848 00010000:00010000:1.0:1651529344.514043:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.514047:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946406784 00000100:00100000:1.0:1651529344.514054:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1400:41279:x1731746396287040:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 48us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.514056:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211172 00000100:00100000:1.0:1651529344.514057:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11949 00000100:00100000:0.0:1651529344.514059:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+668:39029:x1731745946406592:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.514062:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396287296 00010000:00010000:1.0:1651529344.514065:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001cdd444d/0x3234de053c4cff5 lrc: 5/0,0 mode: PR/PR res: [0x2b5d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf11a expref: 1400 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:0.0:1651529344.514065:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177620 count 1 00010000:00010000:0.0:1651529344.514069:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50a64 lrc: 3/0,1 mode: --/PW res: [0x2b5d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.514070:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11950 00000100:00100000:1.0:1651529344.514072:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1400:41278:x1731746396287168:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.514074:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.514076:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a8dde12a/0x3234de053c4e741 lrc: 4/0,0 mode: PR/PR res: [0x2b5d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4df6 expref: 1400 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.514079:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a8dde12a/0x3234de053c4e741 lrc: 3/0,0 mode: PR/PR res: [0x2b5d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4df6 expref: 1400 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.514084:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8dde12a/0x3234de053c4e741 lrc: 0/0,0 mode: --/PR res: [0x2b5d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4df6 expref: 1400 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.514087:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.514088:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.514088:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50a48 lrc: 3/0,1 mode: PW/PW res: [0x2b5d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514089:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a902d314/0x3234de053c4f166 lrc: 2/0,0 mode: PR/PR res: [0x2b5d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7835 expref: 1399 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.514091:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50a48 lrc: 4/0,1 mode: PW/PW res: [0x2b5d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514092:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.514093:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.514093:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50a64 lrc: 4/0,1 mode: --/PW res: [0x2b5d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514098:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.514102:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a902d314/0x3234de053c4f166 lrc: 3/0,0 mode: PR/PR res: [0x2b5d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7835 expref: 1399 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.514103:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1399:41278:x1731746396287168:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 31us (136us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.514105:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a902d314/0x3234de053c4f166 lrc: 4/0,0 mode: PR/PR res: [0x2b5d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7835 expref: 1399 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.514106:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11950 00000100:00100000:1.0:1651529344.514109:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11951 00000100:00100000:0.0:1651529344.514110:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003e3f0f77 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996981760:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.514111:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1398:41278:x1731746396287296:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.514113:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.514114:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001cdd444d/0x3234de053c4cff5 lrc: 5/0,0 mode: PR/PR res: [0x2b5d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf11a expref: 1398 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.514118:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001cdd444d/0x3234de053c4cff5 lrc: 4/0,0 mode: PR/PR res: [0x2b5d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf11a expref: 1398 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.514119:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 0000000009370c1d going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.514122:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.514123:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.514123:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50a4f lrc: 3/0,1 mode: PW/PW res: [0x2b5d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514126:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50a4f lrc: 4/0,1 mode: PW/PW res: [0x2b5d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514127:0:106695:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a79f739/0x3234de053c4eb77 lrc: 0/0,0 mode: --/PR res: [0x2b5cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f6f expref: 1398 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.514130:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.514132:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c20a6e11 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996981440:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.514135:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1397:41278:x1731746396287296:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 23us (118us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.514135:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50a41 lrc: 3/0,1 mode: PW/PW res: [0x2b5cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.514137:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11951 00010000:00010000:0.0:1651529344.514138:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50a41 lrc: 3/0,1 mode: PW/PW res: [0x2b5cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514141:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50a41 lrc: 3/0,1 mode: PW/PW res: [0x2b5cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.514143:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211173 00010000:00010000:0.0:1651529344.514144:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50a41 lrc: 3/0,1 mode: PW/PW res: [0x2b5cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.514145:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+668:39029:x1731745946406848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.514147:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50a41 lrc: 2/0,0 mode: PW/PW res: [0x2b5cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.514149:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177622 count 1 00010000:00010000:1.0:1651529344.514153:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50a6b lrc: 3/0,1 mode: --/PW res: [0x2b5d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514157:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004645bf7f/0x3234de053c4eec6 lrc: 2/0,0 mode: PR/PR res: [0x2b5d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6cf1 expref: 1396 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.514160:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.514160:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.514161:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50a6b lrc: 4/0,1 mode: --/PW res: [0x2b5d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514167:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004645bf7f/0x3234de053c4eec6 lrc: 3/0,0 mode: PR/PR res: [0x2b5d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6cf1 expref: 1396 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.514171:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004645bf7f/0x3234de053c4eec6 lrc: 4/0,0 mode: PR/PR res: [0x2b5d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6cf1 expref: 1396 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.514174:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a223a622 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996981824:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.514182:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 0000000057299e7f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.514188:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211174 00000100:00100000:1.0:1651529344.514189:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+669:39030:x1731745946406784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.514193:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177621 count 1 00010000:00010000:1.0:1651529344.514196:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50a72 lrc: 3/0,1 mode: --/PW res: [0x2b5d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514203:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cc20db45/0x3234de053c4c203 lrc: 2/0,0 mode: PR/PR res: [0x2b5d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc871 expref: 1396 pid: 80278 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.514204:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+669:39030:x1731745946405888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1327us (1470us total) trans 12885079222 rc 0/0 00010000:00010000:1.0:1651529344.514206:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.514207:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.514207:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50a72 lrc: 4/0,1 mode: --/PW res: [0x2b5d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.514207:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211167 00010000:00010000:1.0:1651529344.514213:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cc20db45/0x3234de053c4c203 lrc: 3/0,0 mode: PR/PR res: [0x2b5d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc871 expref: 1396 pid: 80278 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.514215:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50a41 lrc: 2/0,0 mode: PW/PW res: [0x2b5cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514216:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cc20db45/0x3234de053c4c203 lrc: 4/0,0 mode: PR/PR res: [0x2b5d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc871 expref: 1396 pid: 80278 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.514219:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000048c07243 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.514220:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002a957ba7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996981888:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.514220:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50a41 lrc: 2/0,0 mode: PW/PW res: [0x2b5cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514241:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50a41 lrc: 3/0,0 mode: PW/PW res: [0x2b5cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.514243:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a6b79b05 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.514246:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50a41 lrc: 1/0,0 mode: --/PW res: [0x2b5cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514249:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50a41 lrc: 0/0,0 mode: --/PW res: [0x2b5cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.514250:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006647e4ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996981632:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.514255:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50a56 lrc: 3/0,1 mode: --/PW res: [0x2b5d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514261:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50a48 lrc: 3/0,1 mode: PW/PW res: [0x2b5d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514262:0:80281:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cdd444d/0x3234de053c4cff5 lrc: 0/0,0 mode: --/PR res: [0x2b5d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf11a expref: 1396 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.514264:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50a48 lrc: 3/0,1 mode: PW/PW res: [0x2b5d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.514265:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f39ca9ea pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996981568:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.514269:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50a48 lrc: 3/0,1 mode: PW/PW res: [0x2b5d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514269:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50a4f lrc: 3/0,1 mode: PW/PW res: [0x2b5d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514272:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50a48 lrc: 2/0,0 mode: PW/PW res: [0x2b5d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514275:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50a4f lrc: 3/0,1 mode: PW/PW res: [0x2b5d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514278:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50a4f lrc: 3/0,1 mode: PW/PW res: [0x2b5d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514286:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50a4f lrc: 3/0,1 mode: PW/PW res: [0x2b5d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514289:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50a4f lrc: 2/0,0 mode: PW/PW res: [0x2b5d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.514321:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+670:39030:x1731745946406016:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1433us (1567us total) trans 12885079223 rc 0/0 00000100:00100000:1.0:1651529344.514324:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211168 00010000:00010000:1.0:1651529344.514331:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50a48 lrc: 2/0,0 mode: PW/PW res: [0x2b5d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.514331:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+669:39030:x1731745946405952:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1413us (1569us total) trans 12885079224 rc 0/0 00010000:00010000:1.0:1651529344.514334:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d9ada8a3 already unused, calling callback (0000000049fddea7) 00000100:00100000:0.0:1651529344.514334:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211169 00010000:00010000:1.0:1651529344.514335:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50a48 lrc: 2/0,0 mode: PW/PW res: [0x2b5d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514338:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50a48 lrc: 3/0,0 mode: PW/PW res: [0x2b5d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514342:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50a4f lrc: 2/0,0 mode: PW/PW res: [0x2b5d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514343:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50a48 lrc: 1/0,0 mode: --/PW res: [0x2b5d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514346:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50a48 lrc: 0/0,0 mode: --/PW res: [0x2b5d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514346:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000002904524 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.514347:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50a4f lrc: 2/0,0 mode: PW/PW res: [0x2b5d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514350:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50a4f lrc: 3/0,0 mode: PW/PW res: [0x2b5d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514354:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50a4f lrc: 1/0,0 mode: --/PW res: [0x2b5d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514357:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50a4f lrc: 0/0,0 mode: --/PW res: [0x2b5d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.514362:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.514367:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396287488 00010000:00010000:0.0:1651529344.514372:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002f86d1dc/0x3234de053c4d972 lrc: 4/0,0 mode: PR/PR res: [0x2b5d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d164a expref: 1396 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.514382:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11952 00000100:00100000:0.0:1651529344.514384:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de45c136 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1396:41279:x1731746396287488:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.514387:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.514389:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002f86d1dc/0x3234de053c4d972 lrc: 4/0,0 mode: PR/PR res: [0x2b5d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d164a expref: 1396 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.514393:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002f86d1dc/0x3234de053c4d972 lrc: 3/0,0 mode: PR/PR res: [0x2b5d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d164a expref: 1396 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.514397:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f86d1dc/0x3234de053c4d972 lrc: 0/0,0 mode: --/PR res: [0x2b5d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d164a expref: 1396 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.514401:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.514401:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.514402:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50a56 lrc: 3/0,1 mode: PW/PW res: [0x2b5d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514405:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50a56 lrc: 4/0,1 mode: PW/PW res: [0x2b5d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.514406:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.514416:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.514423:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de45c136 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1395:41279:x1731746396287488:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 38us (61us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.514426:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11952 00000100:00100000:0.0:1651529344.514434:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396287616 00010000:00010000:0.0:1651529344.514438:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000577c0905/0x3234de053c4cd1d lrc: 5/0,0 mode: PR/PR res: [0x2b5d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce67e expref: 1395 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.514443:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11953 00000100:00100000:0.0:1651529344.514444:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1395:41278:x1731746396287616:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.514447:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.514448:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000577c0905/0x3234de053c4cd1d lrc: 5/0,0 mode: PR/PR res: [0x2b5d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce67e expref: 1395 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.514451:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000577c0905/0x3234de053c4cd1d lrc: 4/0,0 mode: PR/PR res: [0x2b5d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce67e expref: 1395 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.514456:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.514457:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.514457:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c50a5d lrc: 3/0,1 mode: PW/PW res: [0x2b5d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514460:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c50a5d lrc: 4/0,1 mode: PW/PW res: [0x2b5d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514464:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.514469:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1395:41278:x1731746396287616:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 24us (64us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.514472:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11953 00010000:00010000:1.0:1651529344.514517:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50a56 lrc: 3/0,1 mode: PW/PW res: [0x2b5d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514521:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50a56 lrc: 3/0,1 mode: PW/PW res: [0x2b5d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514524:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50a56 lrc: 3/0,1 mode: PW/PW res: [0x2b5d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514527:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50a56 lrc: 2/0,0 mode: PW/PW res: [0x2b5d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514539:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50a56 lrc: 2/0,0 mode: PW/PW res: [0x2b5d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514543:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000035eaa2c8 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.514544:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50a56 lrc: 2/0,0 mode: PW/PW res: [0x2b5d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514547:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50a56 lrc: 3/0,0 mode: PW/PW res: [0x2b5d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514551:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50a56 lrc: 1/0,0 mode: --/PW res: [0x2b5d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514554:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50a56 lrc: 0/0,0 mode: --/PW res: [0x2b5d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.514574:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+669:39030:x1731745946406080:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1646us (1797us total) trans 12885079225 rc 0/0 00000100:00100000:1.0:1651529344.514578:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211170 00010000:00010000:1.0:1651529344.514595:0:80278:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000577c0905/0x3234de053c4cd1d lrc: 0/0,0 mode: --/PR res: [0x2b5d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce67e expref: 1394 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.514600:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005a17dd72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996981696:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.514604:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c50a5d lrc: 3/0,1 mode: PW/PW res: [0x2b5d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514607:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c50a5d lrc: 3/0,1 mode: PW/PW res: [0x2b5d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.514616:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.514617:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c50a5d lrc: 3/0,1 mode: PW/PW res: [0x2b5d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514631:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c50a5d lrc: 3/0,1 mode: PW/PW res: [0x2b5d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514634:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c50a5d lrc: 2/0,0 mode: PW/PW res: [0x2b5d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.514648:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.514656:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.514669:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+669:39030:x1731745946406528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 763us (794us total) trans 12885079226 rc 0/0 00000100:00100000:1.0:1651529344.514672:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211171 00000100:00100000:1.0:1651529344.514677:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946407104 00000100:00100000:1.0:1651529344.514687:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946407232 00000100:00100000:1.0:1651529344.514692:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946407168 00000100:00100000:1.0:1651529344.514706:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211175 00000100:00100000:1.0:1651529344.514707:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+671:39030:x1731745946407104:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.514718:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177623 count 1 00010000:00010000:1.0:1651529344.514722:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50a79 lrc: 3/0,1 mode: --/PW res: [0x2b5d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514727:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000370a464d/0x3234de053c4dd23 lrc: 2/0,0 mode: PR/PR res: [0x2b5d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2577 expref: 1393 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.514730:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.514730:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.514731:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50a79 lrc: 4/0,1 mode: --/PW res: [0x2b5d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.514756:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.514764:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000370a464d/0x3234de053c4dd23 lrc: 3/0,0 mode: PR/PR res: [0x2b5d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2577 expref: 1393 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.514768:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003e3f0f77 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996981760:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.514769:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000370a464d/0x3234de053c4dd23 lrc: 4/0,0 mode: PR/PR res: [0x2b5d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2577 expref: 1393 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.514773:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005a17dd72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996981952:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.514773:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50a64 lrc: 3/0,1 mode: --/PW res: [0x2b5d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.514780:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946407296 00000100:00100000:1.0:1651529344.514787:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.514794:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211176 00000100:00100000:1.0:1651529344.514796:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+672:39029:x1731745946407232:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.514796:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211177 00000100:00100000:0.0:1651529344.514798:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+672:39030:x1731745946407168:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.514801:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177625 count 1 00002000:00080000:0.0:1651529344.514804:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177624 count 1 00010000:00010000:1.0:1651529344.514805:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50a80 lrc: 3/0,1 mode: --/PW res: [0x2b5d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514809:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005ba7c8c9/0x3234de053c4bbf8 lrc: 2/0,0 mode: PR/PR res: [0x2b5d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc58b expref: 1393 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.514812:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.514813:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.514813:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50a80 lrc: 4/0,1 mode: --/PW res: [0x2b5d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514819:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005ba7c8c9/0x3234de053c4bbf8 lrc: 3/0,0 mode: PR/PR res: [0x2b5d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc58b expref: 1393 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.514820:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50a87 lrc: 3/0,1 mode: --/PW res: [0x2b5d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514822:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005ba7c8c9/0x3234de053c4bbf8 lrc: 4/0,0 mode: PR/PR res: [0x2b5d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc58b expref: 1393 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.514825:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c4e08e lrc: 2/0,0 mode: PR/PR res: [0x2b5d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d32eb expref: 1393 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.514828:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.514829:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a13808c6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996982016:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.514829:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.514830:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50a87 lrc: 4/0,1 mode: --/PW res: [0x2b5d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.514836:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f9dac3f6 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.514837:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c4e08e lrc: 3/0,0 mode: PR/PR res: [0x2b5d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d32eb expref: 1393 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.514840:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c50a5d lrc: 2/0,0 mode: PW/PW res: [0x2b5d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514840:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c4e08e lrc: 4/0,0 mode: PR/PR res: [0x2b5d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d32eb expref: 1393 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.514843:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000010b0a5e already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.514844:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c50a5d lrc: 2/0,0 mode: PW/PW res: [0x2b5d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.514844:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d718cfe4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996982080:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.514847:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c50a5d lrc: 3/0,0 mode: PW/PW res: [0x2b5d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514851:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c50a5d lrc: 1/0,0 mode: --/PW res: [0x2b5d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.514854:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c50a5d lrc: 0/0,0 mode: --/PW res: [0x2b5d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.514854:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed830649 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.514863:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a223a622 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996981824:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.514866:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50a6b lrc: 3/0,1 mode: --/PW res: [0x2b5d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.514873:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002a957ba7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996981888:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.514875:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50a72 lrc: 3/0,1 mode: --/PW res: [0x2b5d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.514886:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211178 00000100:00100000:0.0:1651529344.514888:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+672:39029:x1731745946407296:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.514893:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177626 count 1 00010000:00010000:0.0:1651529344.514897:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50a8e lrc: 3/0,1 mode: --/PW res: [0x2b5da:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514904:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b2d92bf2/0x3234de053c4da44 lrc: 2/0,0 mode: PR/PR res: [0x2b5da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d197d expref: 1393 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.514906:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.514907:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.514908:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.514909:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50a8e lrc: 4/0,1 mode: --/PW res: [0x2b5da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514920:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b2d92bf2/0x3234de053c4da44 lrc: 3/0,0 mode: PR/PR res: [0x2b5da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d197d expref: 1393 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.514922:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.514926:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b2d92bf2/0x3234de053c4da44 lrc: 4/0,0 mode: PR/PR res: [0x2b5da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d197d expref: 1393 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.514931:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.514933:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fe004e2b pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996982144:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.514946:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a3b00cf3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.514954:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946407360 00000100:00100000:0.0:1651529344.514966:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211179 00000100:00100000:0.0:1651529344.514967:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+673:39029:x1731745946407360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.514972:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177627 count 1 00010000:00010000:0.0:1651529344.514976:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50a95 lrc: 3/0,1 mode: --/PW res: [0x2b5db:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.514980:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000077f05843/0x3234de053c4eac8 lrc: 2/0,0 mode: PR/PR res: [0x2b5db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5cb3 expref: 1393 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.514982:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.514986:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.514987:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.514987:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50a95 lrc: 4/0,1 mode: --/PW res: [0x2b5db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.514991:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396287872 00010000:00010000:0.0:1651529344.514994:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000077f05843/0x3234de053c4eac8 lrc: 3/0,0 mode: PR/PR res: [0x2b5db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5cb3 expref: 1394 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.514996:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004645bf7f/0x3234de053c4eec6 lrc: 4/0,0 mode: PR/PR res: [0x2b5d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6cf1 expref: 1394 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.514997:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000077f05843/0x3234de053c4eac8 lrc: 4/0,0 mode: PR/PR res: [0x2b5db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5cb3 expref: 1394 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.515008:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396287808 00010000:00010000:1.0:1651529344.515011:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a902d314/0x3234de053c4f166 lrc: 4/0,0 mode: PR/PR res: [0x2b5d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7835 expref: 1395 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.515015:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396287936 00010000:00010000:1.0:1651529344.515017:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cc20db45/0x3234de053c4c203 lrc: 4/0,0 mode: PR/PR res: [0x2b5d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc871 expref: 1396 pid: 80278 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.515021:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11954 00000100:00100000:1.0:1651529344.515023:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1396:41279:x1731746396287872:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.515025:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003e3f0f77 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996982208:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.515026:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.515027:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004645bf7f/0x3234de053c4eec6 lrc: 4/0,0 mode: PR/PR res: [0x2b5d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6cf1 expref: 1396 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.515030:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004645bf7f/0x3234de053c4eec6 lrc: 3/0,0 mode: PR/PR res: [0x2b5d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6cf1 expref: 1396 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.515036:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004645bf7f/0x3234de053c4eec6 lrc: 0/0,0 mode: --/PR res: [0x2b5d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6cf1 expref: 1396 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.515039:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 000000000e7e66c4 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.515046:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.515047:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.515047:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50a6b lrc: 3/0,1 mode: PW/PW res: [0x2b5d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.515048:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11955 00000100:00100000:0.0:1651529344.515050:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1395:41279:x1731746396287808:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.515051:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50a6b lrc: 4/0,1 mode: PW/PW res: [0x2b5d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.515053:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.515055:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a902d314/0x3234de053c4f166 lrc: 4/0,0 mode: PR/PR res: [0x2b5d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7835 expref: 1395 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.515057:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.515059:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a902d314/0x3234de053c4f166 lrc: 3/0,0 mode: PR/PR res: [0x2b5d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7835 expref: 1395 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.515064:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1395:41279:x1731746396287872:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (158us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.515065:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a902d314/0x3234de053c4f166 lrc: 0/0,0 mode: --/PR res: [0x2b5d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7835 expref: 1395 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.515066:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11954 00000100:00100000:1.0:1651529344.515071:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11956 00010000:00010000:0.0:1651529344.515071:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.515071:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.515072:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50a64 lrc: 3/0,1 mode: PW/PW res: [0x2b5d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.515073:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1393:41279:x1731746396287936:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.515075:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.515075:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50a64 lrc: 4/0,1 mode: PW/PW res: [0x2b5d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515077:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cc20db45/0x3234de053c4c203 lrc: 4/0,0 mode: PR/PR res: [0x2b5d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc871 expref: 1393 pid: 80278 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.515080:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cc20db45/0x3234de053c4c203 lrc: 3/0,0 mode: PR/PR res: [0x2b5d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc871 expref: 1393 pid: 80278 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.515085:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc20db45/0x3234de053c4c203 lrc: 0/0,0 mode: --/PR res: [0x2b5d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc871 expref: 1393 pid: 80278 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.515088:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.515089:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.515090:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50a72 lrc: 3/0,1 mode: PW/PW res: [0x2b5d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515093:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50a72 lrc: 4/0,1 mode: PW/PW res: [0x2b5d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.515096:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.515098:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.515104:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1392:41279:x1731746396287936:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 30us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.515106:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11956 00010000:00010000:1.0:1651529344.515111:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50a6b lrc: 3/0,1 mode: PW/PW res: [0x2b5d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515114:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50a6b lrc: 3/0,1 mode: PW/PW res: [0x2b5d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.515114:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1391:41279:x1731746396287808:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 53us (172us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.515117:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50a6b lrc: 3/0,1 mode: PW/PW res: [0x2b5d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.515117:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11955 00010000:00010000:1.0:1651529344.515120:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50a6b lrc: 2/0,0 mode: PW/PW res: [0x2b5d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.515125:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50a64 lrc: 3/0,1 mode: PW/PW res: [0x2b5d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.515143:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50a64 lrc: 3/0,1 mode: PW/PW res: [0x2b5d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.515147:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50a64 lrc: 3/0,1 mode: PW/PW res: [0x2b5d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.515150:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50a64 lrc: 2/0,0 mode: PW/PW res: [0x2b5d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.515162:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+674:39029:x1731745946406848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1016us (1156us total) trans 12885079227 rc 0/0 00000100:00100000:1.0:1651529344.515165:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211173 00010000:00010000:1.0:1651529344.515171:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50a72 lrc: 3/0,1 mode: PW/PW res: [0x2b5d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515177:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50a72 lrc: 3/0,1 mode: PW/PW res: [0x2b5d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515180:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50a72 lrc: 3/0,1 mode: PW/PW res: [0x2b5d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515183:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50a72 lrc: 2/0,0 mode: PW/PW res: [0x2b5d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.515192:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+674:39029:x1731745946406592:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1133us (1301us total) trans 12885079228 rc 0/0 00000100:00100000:0.0:1651529344.515196:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211172 00010000:00010000:0.0:1651529344.515203:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50a6b lrc: 2/0,0 mode: PW/PW res: [0x2b5d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.515207:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a0607df4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.515208:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50a6b lrc: 2/0,0 mode: PW/PW res: [0x2b5d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.515211:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50a6b lrc: 3/0,0 mode: PW/PW res: [0x2b5d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.515215:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50a6b lrc: 1/0,0 mode: --/PW res: [0x2b5d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.515216:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+674:39030:x1731745946406784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1026us (1192us total) trans 12885079229 rc 0/0 00000100:00100000:1.0:1651529344.515218:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211174 00010000:00010000:0.0:1651529344.515218:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50a6b lrc: 0/0,0 mode: --/PW res: [0x2b5d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515238:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50a64 lrc: 2/0,0 mode: PW/PW res: [0x2b5d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515241:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000085580035 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.515242:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50a64 lrc: 2/0,0 mode: PW/PW res: [0x2b5d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515245:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50a64 lrc: 3/0,0 mode: PW/PW res: [0x2b5d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515250:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50a64 lrc: 1/0,0 mode: --/PW res: [0x2b5d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515253:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50a64 lrc: 0/0,0 mode: --/PW res: [0x2b5d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.515253:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50a72 lrc: 2/0,0 mode: PW/PW res: [0x2b5d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.515265:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027456046 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.515267:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50a72 lrc: 2/0,0 mode: PW/PW res: [0x2b5d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.515270:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50a72 lrc: 3/0,0 mode: PW/PW res: [0x2b5d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.515274:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50a72 lrc: 1/0,0 mode: --/PW res: [0x2b5d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.515279:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50a72 lrc: 0/0,0 mode: --/PW res: [0x2b5d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.515310:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005a17dd72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996981952:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.515319:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50a79 lrc: 3/0,1 mode: --/PW res: [0x2b5d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.515326:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a13808c6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996982016:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.515329:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50a80 lrc: 3/0,1 mode: --/PW res: [0x2b5d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.515351:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.515368:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fe004e2b pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996982144:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.515373:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50a8e lrc: 3/0,1 mode: --/PW res: [0x2b5da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.515380:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d718cfe4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996982080:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.515386:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396288064 00010000:00010000:1.0:1651529344.515392:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000370a464d/0x3234de053c4dd23 lrc: 4/0,0 mode: PR/PR res: [0x2b5d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2577 expref: 1391 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.515398:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50a87 lrc: 3/0,1 mode: --/PW res: [0x2b5d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.515400:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11957 00000100:00100000:1.0:1651529344.515402:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1391:41278:x1731746396288064:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.515405:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.515406:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000370a464d/0x3234de053c4dd23 lrc: 4/0,0 mode: PR/PR res: [0x2b5d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2577 expref: 1391 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.515410:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000370a464d/0x3234de053c4dd23 lrc: 3/0,0 mode: PR/PR res: [0x2b5d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2577 expref: 1391 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.515411:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.515415:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000370a464d/0x3234de053c4dd23 lrc: 0/0,0 mode: --/PR res: [0x2b5d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2577 expref: 1391 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.515419:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.515421:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.515422:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.515423:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50a79 lrc: 3/0,1 mode: PW/PW res: [0x2b5d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.515431:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.515432:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50a79 lrc: 4/0,1 mode: PW/PW res: [0x2b5d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.515437:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396288192 00010000:00010000:1.0:1651529344.515438:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.515442:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c4e08e lrc: 4/0,0 mode: PR/PR res: [0x2b5d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d32eb expref: 1391 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.515446:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1391:41278:x1731746396288064:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 44us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.515447:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396288128 00000100:00100000:1.0:1651529344.515449:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11957 00010000:00010000:0.0:1651529344.515449:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005ba7c8c9/0x3234de053c4bbf8 lrc: 4/0,0 mode: PR/PR res: [0x2b5d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc58b expref: 1392 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.515454:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396288256 00000100:00100000:0.0:1651529344.515455:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11958 00000100:00100000:0.0:1651529344.515456:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1392:41278:x1731746396288192:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.515457:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b2d92bf2/0x3234de053c4da44 lrc: 4/0,0 mode: PR/PR res: [0x2b5da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d197d expref: 1392 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.515459:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.515461:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c4e08e lrc: 4/0,0 mode: PR/PR res: [0x2b5d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d32eb expref: 1392 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.515462:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11959 00000100:00100000:1.0:1651529344.515464:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005239dfe7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1392:41278:x1731746396288128:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.515464:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c4e08e lrc: 3/0,0 mode: PR/PR res: [0x2b5d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d32eb expref: 1392 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.515466:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.515468:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005ba7c8c9/0x3234de053c4bbf8 lrc: 4/0,0 mode: PR/PR res: [0x2b5d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc58b expref: 1392 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.515470:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c4e08e lrc: 0/0,0 mode: --/PR res: [0x2b5d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d32eb expref: 1392 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.515472:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005ba7c8c9/0x3234de053c4bbf8 lrc: 3/0,0 mode: PR/PR res: [0x2b5d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc58b expref: 1392 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.515473:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.515474:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.515475:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50a87 lrc: 3/0,1 mode: PW/PW res: [0x2b5d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515476:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ba7c8c9/0x3234de053c4bbf8 lrc: 0/0,0 mode: --/PR res: [0x2b5d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc58b expref: 1391 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.515478:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50a87 lrc: 4/0,1 mode: PW/PW res: [0x2b5d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515480:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.515481:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.515481:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50a80 lrc: 3/0,1 mode: PW/PW res: [0x2b5d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515484:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50a80 lrc: 4/0,1 mode: PW/PW res: [0x2b5d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515490:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.515500:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005239dfe7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1390:41278:x1731746396288128:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (80us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.515500:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.515502:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11959 00000100:00100000:1.0:1651529344.515507:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11960 00000100:00100000:1.0:1651529344.515508:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1389:41278:x1731746396288256:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.515508:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1389:41278:x1731746396288192:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 51us (96us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.515511:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.515511:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11958 00010000:00010000:1.0:1651529344.515512:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b2d92bf2/0x3234de053c4da44 lrc: 4/0,0 mode: PR/PR res: [0x2b5da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d197d expref: 1389 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.515516:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b2d92bf2/0x3234de053c4da44 lrc: 3/0,0 mode: PR/PR res: [0x2b5da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d197d expref: 1388 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.515520:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2d92bf2/0x3234de053c4da44 lrc: 0/0,0 mode: --/PR res: [0x2b5da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d197d expref: 1388 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.515522:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50a87 lrc: 3/0,1 mode: PW/PW res: [0x2b5d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515524:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.515524:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.515525:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50a8e lrc: 3/0,1 mode: PW/PW res: [0x2b5da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.515525:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50a87 lrc: 3/0,1 mode: PW/PW res: [0x2b5d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515528:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50a8e lrc: 4/0,1 mode: PW/PW res: [0x2b5da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.515531:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50a87 lrc: 3/0,1 mode: PW/PW res: [0x2b5d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.515534:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50a87 lrc: 2/0,0 mode: PW/PW res: [0x2b5d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515536:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.515542:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1387:41278:x1731746396288256:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.515544:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11960 00010000:00010000:1.0:1651529344.515557:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50a80 lrc: 3/0,1 mode: PW/PW res: [0x2b5d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515560:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50a80 lrc: 3/0,1 mode: PW/PW res: [0x2b5d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515563:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50a80 lrc: 3/0,1 mode: PW/PW res: [0x2b5d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515566:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50a80 lrc: 2/0,0 mode: PW/PW res: [0x2b5d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.515590:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+675:39030:x1731745946407168:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 791us (933us total) trans 12885079230 rc 0/0 00000100:00100000:0.0:1651529344.515593:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211177 00010000:00010000:0.0:1651529344.515600:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50a87 lrc: 2/0,0 mode: PW/PW res: [0x2b5d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.515603:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2a2495 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.515604:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50a87 lrc: 2/0,0 mode: PW/PW res: [0x2b5d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.515607:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50a87 lrc: 3/0,0 mode: PW/PW res: [0x2b5d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.515608:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+674:39029:x1731745946407232:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 811us (959us total) trans 12885079231 rc 0/0 00000100:00100000:1.0:1651529344.515610:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211176 00010000:00010000:0.0:1651529344.515612:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50a87 lrc: 1/0,0 mode: --/PW res: [0x2b5d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.515615:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50a87 lrc: 0/0,0 mode: --/PW res: [0x2b5d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515617:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50a80 lrc: 2/0,0 mode: PW/PW res: [0x2b5d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.515620:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50a8e lrc: 3/0,1 mode: PW/PW res: [0x2b5da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515623:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000734ecdfd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.515623:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50a8e lrc: 3/0,1 mode: PW/PW res: [0x2b5da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515624:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50a80 lrc: 2/0,0 mode: PW/PW res: [0x2b5d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.515626:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50a8e lrc: 3/0,1 mode: PW/PW res: [0x2b5da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515627:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50a80 lrc: 3/0,0 mode: PW/PW res: [0x2b5d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.515629:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50a8e lrc: 2/0,0 mode: PW/PW res: [0x2b5da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515631:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50a80 lrc: 1/0,0 mode: --/PW res: [0x2b5d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515634:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50a80 lrc: 0/0,0 mode: --/PW res: [0x2b5d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515638:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50a8e lrc: 2/0,0 mode: PW/PW res: [0x2b5da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515641:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cff76789 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.515642:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50a8e lrc: 2/0,0 mode: PW/PW res: [0x2b5da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515645:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50a8e lrc: 3/0,0 mode: PW/PW res: [0x2b5da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515648:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50a8e lrc: 1/0,0 mode: --/PW res: [0x2b5da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515650:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50a8e lrc: 0/0,0 mode: --/PW res: [0x2b5da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515656:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50a79 lrc: 3/0,1 mode: PW/PW res: [0x2b5d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515659:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50a79 lrc: 3/0,1 mode: PW/PW res: [0x2b5d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515662:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50a79 lrc: 3/0,1 mode: PW/PW res: [0x2b5d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515664:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50a79 lrc: 2/0,0 mode: PW/PW res: [0x2b5d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.515688:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+675:39029:x1731745946407296:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 799us (932us total) trans 12885079232 rc 0/0 00000100:00100000:0.0:1651529344.515691:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211178 00010000:00010000:0.0:1651529344.515698:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50a79 lrc: 2/0,0 mode: PW/PW res: [0x2b5d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.515701:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eb50e2ae already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.515702:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+674:39030:x1731745946407104:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 994us (1087us total) trans 12885079233 rc 0/0 00010000:00010000:0.0:1651529344.515702:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50a79 lrc: 2/0,0 mode: PW/PW res: [0x2b5d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.515705:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211175 00010000:00010000:0.0:1651529344.515705:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50a79 lrc: 3/0,0 mode: PW/PW res: [0x2b5d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.515709:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50a79 lrc: 1/0,0 mode: --/PW res: [0x2b5d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.515712:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50a79 lrc: 0/0,0 mode: --/PW res: [0x2b5d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.515750:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.515763:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946407744 00000100:00100000:0.0:1651529344.515765:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.515779:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946407808 00000100:00100000:1.0:1651529344.515787:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211180 00000100:00100000:1.0:1651529344.515788:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+675:39030:x1731745946407744:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.515793:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177628 count 1 00010000:00010000:1.0:1651529344.515798:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50a9c lrc: 3/0,1 mode: --/PW res: [0x2b5dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.515806:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.515814:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c4e828 lrc: 2/0,0 mode: PR/PR res: [0x2b5dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5168 expref: 1386 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.515817:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946407872 00010000:00010000:1.0:1651529344.515821:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.515821:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.515822:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50a9c lrc: 4/0,1 mode: --/PW res: [0x2b5dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.515824:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211181 00000100:00100000:0.0:1651529344.515826:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+676:39030:x1731745946407808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.515829:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c4e828 lrc: 3/0,0 mode: PR/PR res: [0x2b5dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5168 expref: 1386 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.515832:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c4e828 lrc: 4/0,0 mode: PR/PR res: [0x2b5dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5168 expref: 1386 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:0.0:1651529344.515832:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177629 count 1 00000100:00100000:1.0:1651529344.515837:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003e8ef62e pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996982272:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.515851:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f9dac3f6 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.515855:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50aa3 lrc: 3/0,1 mode: --/PW res: [0x2b5dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.515858:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211182 00000100:00100000:1.0:1651529344.515859:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+676:39030:x1731745946407872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.515860:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c4cf46 lrc: 2/0,0 mode: PR/PR res: [0x2b5dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceedc expref: 1386 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.515863:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1651529344.515864:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177630 count 1 00010000:00010000:0.0:1651529344.515864:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.515865:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50aa3 lrc: 4/0,1 mode: --/PW res: [0x2b5dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515868:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50aaa lrc: 3/0,1 mode: --/PW res: [0x2b5de:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.515872:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf272247/0x3234de053c4c34c lrc: 2/0,0 mode: PR/PR res: [0x2b5de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc8fd expref: 1386 pid: 80278 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.515872:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c4cf46 lrc: 3/0,0 mode: PR/PR res: [0x2b5dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceedc expref: 1386 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.515876:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.515876:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.515876:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c4cf46 lrc: 4/0,0 mode: PR/PR res: [0x2b5dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceedc expref: 1386 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.515877:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50aaa lrc: 4/0,1 mode: --/PW res: [0x2b5de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.515880:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006929eb96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996982336:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.515886:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bf272247/0x3234de053c4c34c lrc: 3/0,0 mode: PR/PR res: [0x2b5de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc8fd expref: 1386 pid: 80278 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.515889:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bf272247/0x3234de053c4c34c lrc: 4/0,0 mode: PR/PR res: [0x2b5de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc8fd expref: 1386 pid: 80278 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.515890:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed830649 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.515893:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000086eaa330 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996982400:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.515899:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003e3f0f77 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996982208:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.515901:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.515903:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50a95 lrc: 3/0,1 mode: --/PW res: [0x2b5db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.515923:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.515980:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396288640 00010000:00010000:1.0:1651529344.515986:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000077f05843/0x3234de053c4eac8 lrc: 4/0,0 mode: PR/PR res: [0x2b5db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5cb3 expref: 1387 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.515994:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11961 00000100:00100000:1.0:1651529344.515996:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1387:41279:x1731746396288640:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.515998:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.516000:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000077f05843/0x3234de053c4eac8 lrc: 4/0,0 mode: PR/PR res: [0x2b5db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5cb3 expref: 1387 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.516003:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000077f05843/0x3234de053c4eac8 lrc: 3/0,0 mode: PR/PR res: [0x2b5db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5cb3 expref: 1387 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.516009:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077f05843/0x3234de053c4eac8 lrc: 0/0,0 mode: --/PR res: [0x2b5db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5cb3 expref: 1387 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.516012:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.516013:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.516014:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50a95 lrc: 3/0,1 mode: PW/PW res: [0x2b5db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.516017:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50a95 lrc: 4/0,1 mode: PW/PW res: [0x2b5db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.516027:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.516030:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50a95 lrc: 3/0,1 mode: PW/PW res: [0x2b5db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516034:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50a95 lrc: 3/0,1 mode: PW/PW res: [0x2b5db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.516037:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1386:41279:x1731746396288640:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.516040:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11961 00010000:00010000:0.0:1651529344.516043:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50a95 lrc: 3/0,1 mode: PW/PW res: [0x2b5db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516046:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50a95 lrc: 2/0,0 mode: PW/PW res: [0x2b5db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.516059:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50a95 lrc: 2/0,0 mode: PW/PW res: [0x2b5db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.516062:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dc65d2aa already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.516063:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50a95 lrc: 2/0,0 mode: PW/PW res: [0x2b5db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.516066:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50a95 lrc: 3/0,0 mode: PW/PW res: [0x2b5db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.516071:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50a95 lrc: 1/0,0 mode: --/PW res: [0x2b5db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.516074:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50a95 lrc: 0/0,0 mode: --/PW res: [0x2b5db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.516103:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.516125:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+677:39029:x1731745946407360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1156us (1203us total) trans 12885079234 rc 0/0 00000100:00100000:0.0:1651529344.516128:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211179 00000100:00100000:0.0:1651529344.516134:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946408000 00000100:00100000:0.0:1651529344.516144:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211183 00000100:00100000:0.0:1651529344.516146:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+677:39029:x1731745946408000:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.516151:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177631 count 1 00010000:00010000:0.0:1651529344.516156:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c50ab1 lrc: 3/0,1 mode: --/PW res: [0x2b5df:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516160:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e600099f/0x3234de053c4c69b lrc: 2/0,0 mode: PR/PR res: [0x2b5df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc45 expref: 1385 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.516164:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.516164:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.516165:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c50ab1 lrc: 4/0,1 mode: --/PW res: [0x2b5df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.516169:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.516172:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e600099f/0x3234de053c4c69b lrc: 3/0,0 mode: PR/PR res: [0x2b5df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc45 expref: 1385 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.516182:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e600099f/0x3234de053c4c69b lrc: 4/0,0 mode: PR/PR res: [0x2b5df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc45 expref: 1385 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.516186:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c20a6e11 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996982464:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.516196:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 000000000e7e66c4 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.516200:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.516204:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946408064 00000100:00100000:0.0:1651529344.516210:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946408128 00000100:00100000:0.0:1651529344.516214:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211184 00000100:00100000:0.0:1651529344.516215:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+679:39030:x1731745946408064:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.516220:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177632 count 1 00000100:00100000:1.0:1651529344.516249:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.516250:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50ab8 lrc: 3/0,1 mode: --/PW res: [0x2b5e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516256:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005444a41d/0x3234de053c4a084 lrc: 2/0,0 mode: PR/PR res: [0x2b5e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7d8 expref: 1385 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.516259:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.516259:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.516260:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50ab8 lrc: 4/0,1 mode: --/PW res: [0x2b5e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.516273:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.516282:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005444a41d/0x3234de053c4a084 lrc: 3/0,0 mode: PR/PR res: [0x2b5e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7d8 expref: 1385 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.516286:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005444a41d/0x3234de053c4a084 lrc: 4/0,0 mode: PR/PR res: [0x2b5e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7d8 expref: 1385 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.516290:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003e3f0f77 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996982528:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.516298:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a3b00cf3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.516301:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.516321:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006929eb96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996982336:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.516325:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50aa3 lrc: 3/0,1 mode: --/PW res: [0x2b5dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.516332:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.516333:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946408192 00000100:00100000:0.0:1651529344.516344:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211185 00000100:00100000:0.0:1651529344.516346:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+680:39029:x1731745946408128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.516349:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.516350:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177633 count 1 00010000:00010000:0.0:1651529344.516354:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c50abf lrc: 3/0,1 mode: --/PW res: [0x2b5e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.516356:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946408256 00010000:00010000:0.0:1651529344.516359:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000064e26837/0x3234de053c4d956 lrc: 2/0,0 mode: PR/PR res: [0x2b5e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d15e8 expref: 1385 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.516362:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211186 00010000:00010000:0.0:1651529344.516362:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.516362:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.516363:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c50abf lrc: 4/0,1 mode: --/PW res: [0x2b5e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.516364:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+681:39030:x1731745946408192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.516369:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000064e26837/0x3234de053c4d956 lrc: 3/0,0 mode: PR/PR res: [0x2b5e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d15e8 expref: 1385 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.516370:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177634 count 1 00010000:00010000:0.0:1651529344.516373:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000064e26837/0x3234de053c4d956 lrc: 4/0,0 mode: PR/PR res: [0x2b5e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d15e8 expref: 1385 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.516374:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50ac6 lrc: 3/0,1 mode: --/PW res: [0x2b5e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.516379:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009e600d3e/0x3234de053c4d209 lrc: 2/0,0 mode: PR/PR res: [0x2b5e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf9e1 expref: 1385 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.516382:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.516383:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.516383:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50ac6 lrc: 4/0,1 mode: --/PW res: [0x2b5e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.516396:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006929eb96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996982592:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.516397:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009e600d3e/0x3234de053c4d209 lrc: 3/0,0 mode: PR/PR res: [0x2b5e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf9e1 expref: 1385 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.516401:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009e600d3e/0x3234de053c4d209 lrc: 4/0,0 mode: PR/PR res: [0x2b5e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf9e1 expref: 1385 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.516405:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004089c807 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996982656:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.516405:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 000000003ad73843 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.516414:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a6b79b05 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.516423:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211187 00000100:00100000:0.0:1651529344.516425:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059df4489 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+681:39030:x1731745946408256:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.516431:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000086eaa330 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996982400:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.516431:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177635 count 1 00010000:00010000:1.0:1651529344.516435:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50aaa lrc: 3/0,1 mode: --/PW res: [0x2b5de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.516441:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396288896 00010000:00010000:0.0:1651529344.516443:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50acd lrc: 3/0,1 mode: --/PW res: [0x2b5e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.516445:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c4e828 lrc: 5/0,0 mode: PR/PR res: [0x2b5dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5168 expref: 1386 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.516448:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002d6aea49/0x3234de053c4ca68 lrc: 2/0,0 mode: PR/PR res: [0x2b5e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb4f expref: 1386 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.516451:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.516452:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.516456:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396288960 00010000:00010000:0.0:1651529344.516458:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50acd lrc: 4/0,1 mode: --/PW res: [0x2b5e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.516459:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c4cf46 lrc: 4/0,0 mode: PR/PR res: [0x2b5dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceedc expref: 1387 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.516463:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396289024 00010000:00010000:1.0:1651529344.516465:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bf272247/0x3234de053c4c34c lrc: 4/0,0 mode: PR/PR res: [0x2b5de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc8fd expref: 1388 pid: 80278 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.516466:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002d6aea49/0x3234de053c4ca68 lrc: 3/0,0 mode: PR/PR res: [0x2b5e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb4f expref: 1388 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.516470:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11962 00000100:00100000:1.0:1651529344.516471:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a13808c6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1388:41279:x1731746396288896:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.516472:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002d6aea49/0x3234de053c4ca68 lrc: 4/0,0 mode: PR/PR res: [0x2b5e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb4f expref: 1388 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.516474:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.516476:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c4e828 lrc: 5/0,0 mode: PR/PR res: [0x2b5dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5168 expref: 1388 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.516476:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996982720:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.516479:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c4e828 lrc: 4/0,0 mode: PR/PR res: [0x2b5dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5168 expref: 1388 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.516484:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c0dff858 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.516485:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.516485:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.516486:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50a9c lrc: 3/0,1 mode: PW/PW res: [0x2b5dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.516489:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50a9c lrc: 4/0,1 mode: PW/PW res: [0x2b5dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.516491:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11963 00000100:00100000:0.0:1651529344.516493:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1388:41278:x1731746396288960:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.516494:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.516496:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.516498:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c4cf46 lrc: 4/0,0 mode: PR/PR res: [0x2b5dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceedc expref: 1388 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.516500:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a13808c6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1388:41279:x1731746396288896:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 28us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.516502:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11962 00010000:00010000:0.0:1651529344.516502:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c4cf46 lrc: 3/0,0 mode: PR/PR res: [0x2b5dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceedc expref: 1388 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.516506:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11964 00000100:00100000:1.0:1651529344.516508:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1387:41279:x1731746396289024:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.516510:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.516511:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bf272247/0x3234de053c4c34c lrc: 4/0,0 mode: PR/PR res: [0x2b5de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc8fd expref: 1387 pid: 80278 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.516515:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bf272247/0x3234de053c4c34c lrc: 3/0,0 mode: PR/PR res: [0x2b5de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc8fd expref: 1387 pid: 80278 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.516519:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf272247/0x3234de053c4c34c lrc: 0/0,0 mode: --/PR res: [0x2b5de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc8fd expref: 1387 pid: 80278 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.516521:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c4cf46 lrc: 0/0,0 mode: --/PR res: [0x2b5dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceedc expref: 1387 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.516523:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.516523:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.516524:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50aaa lrc: 3/0,1 mode: PW/PW res: [0x2b5de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516525:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.516525:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.516526:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50aa3 lrc: 3/0,1 mode: PW/PW res: [0x2b5dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.516529:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50aaa lrc: 4/0,1 mode: PW/PW res: [0x2b5de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516529:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50aa3 lrc: 4/0,1 mode: PW/PW res: [0x2b5dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.516535:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.516539:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1385:41279:x1731746396289024:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 31us (208us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.516539:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.516542:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11964 00000100:00100000:0.0:1651529344.516546:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1384:41278:x1731746396288960:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 53us (252us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.516548:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50aaa lrc: 3/0,1 mode: PW/PW res: [0x2b5de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.516549:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11963 00010000:00010000:1.0:1651529344.516552:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50aaa lrc: 3/0,1 mode: PW/PW res: [0x2b5de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.516554:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50aaa lrc: 3/0,1 mode: PW/PW res: [0x2b5de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516556:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50aa3 lrc: 3/0,1 mode: PW/PW res: [0x2b5dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.516557:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50aaa lrc: 2/0,0 mode: PW/PW res: [0x2b5de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516559:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50aa3 lrc: 3/0,1 mode: PW/PW res: [0x2b5dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516563:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50aa3 lrc: 3/0,1 mode: PW/PW res: [0x2b5dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516572:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50aa3 lrc: 2/0,0 mode: PW/PW res: [0x2b5dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.516599:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+683:39030:x1731745946407872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 739us (793us total) trans 12885079235 rc 0/0 00000100:00100000:1.0:1651529344.516602:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211182 00000100:00100000:0.0:1651529344.516611:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+682:39030:x1731745946407808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 784us (846us total) trans 12885079236 rc 0/0 00010000:00010000:1.0:1651529344.516613:0:80278:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c4e828 lrc: 0/0,0 mode: --/PR res: [0x2b5dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5168 expref: 1383 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.516614:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211181 00000100:00100000:1.0:1651529344.516617:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003e8ef62e pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996982272:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.516620:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50a9c lrc: 3/0,1 mode: PW/PW res: [0x2b5dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516622:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50aaa lrc: 2/0,0 mode: PW/PW res: [0x2b5de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.516624:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50a9c lrc: 3/0,1 mode: PW/PW res: [0x2b5dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516625:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000048b51e47 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.516626:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50a9c lrc: 3/0,1 mode: PW/PW res: [0x2b5dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516626:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50aaa lrc: 2/0,0 mode: PW/PW res: [0x2b5de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.516629:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50a9c lrc: 3/0,1 mode: PW/PW res: [0x2b5dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516631:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50aaa lrc: 3/0,0 mode: PW/PW res: [0x2b5de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.516632:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50a9c lrc: 2/0,0 mode: PW/PW res: [0x2b5dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516636:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50aaa lrc: 1/0,0 mode: --/PW res: [0x2b5de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516639:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50aaa lrc: 0/0,0 mode: --/PW res: [0x2b5de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516643:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50aa3 lrc: 2/0,0 mode: PW/PW res: [0x2b5dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516646:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e0e037e6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.516647:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50aa3 lrc: 2/0,0 mode: PW/PW res: [0x2b5dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516649:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50aa3 lrc: 3/0,0 mode: PW/PW res: [0x2b5dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516652:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50aa3 lrc: 1/0,0 mode: --/PW res: [0x2b5dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516655:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50aa3 lrc: 0/0,0 mode: --/PW res: [0x2b5dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516658:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50a9c lrc: 2/0,0 mode: PW/PW res: [0x2b5dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516661:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cdc65e28 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.516662:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50a9c lrc: 2/0,0 mode: PW/PW res: [0x2b5dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.516665:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+682:39030:x1731745946407744:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 876us (916us total) trans 12885079237 rc 0/0 00010000:00010000:0.0:1651529344.516665:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50a9c lrc: 3/0,0 mode: PW/PW res: [0x2b5dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.516668:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211180 00010000:00010000:0.0:1651529344.516668:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50a9c lrc: 1/0,0 mode: --/PW res: [0x2b5dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516670:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50a9c lrc: 0/0,0 mode: --/PW res: [0x2b5dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.516722:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c20a6e11 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996982464:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.516727:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c50ab1 lrc: 3/0,1 mode: --/PW res: [0x2b5df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.516748:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.516764:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003e3f0f77 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996982528:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.516768:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50ab8 lrc: 3/0,1 mode: --/PW res: [0x2b5e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.516790:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396289088 00000100:00100000:0.0:1651529344.516791:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.516797:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e600099f/0x3234de053c4c69b lrc: 4/0,0 mode: PR/PR res: [0x2b5df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc45 expref: 1383 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.516798:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396289152 00000100:00100000:1.0:1651529344.516804:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11965 00000100:00100000:1.0:1651529344.516806:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1383:41278:x1731746396289088:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.516809:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.516810:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e600099f/0x3234de053c4c69b lrc: 4/0,0 mode: PR/PR res: [0x2b5df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc45 expref: 1383 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.516816:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e600099f/0x3234de053c4c69b lrc: 3/0,0 mode: PR/PR res: [0x2b5df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc45 expref: 1384 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.516817:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005444a41d/0x3234de053c4a084 lrc: 4/0,0 mode: PR/PR res: [0x2b5e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7d8 expref: 1384 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.516822:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e600099f/0x3234de053c4c69b lrc: 0/0,0 mode: --/PR res: [0x2b5df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc45 expref: 1384 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.516829:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11966 00000100:00100000:0.0:1651529344.516831:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d036941 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1383:41278:x1731746396289152:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.516832:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.516833:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.516834:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c50ab1 lrc: 3/0,1 mode: PW/PW res: [0x2b5df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516834:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.516836:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005444a41d/0x3234de053c4a084 lrc: 4/0,0 mode: PR/PR res: [0x2b5e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7d8 expref: 1383 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.516837:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c50ab1 lrc: 4/0,1 mode: PW/PW res: [0x2b5df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516839:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005444a41d/0x3234de053c4a084 lrc: 3/0,0 mode: PR/PR res: [0x2b5e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7d8 expref: 1383 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.516846:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.516851:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005444a41d/0x3234de053c4a084 lrc: 0/0,0 mode: --/PR res: [0x2b5e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7d8 expref: 1383 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.516853:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1383:41278:x1731746396289088:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 47us (106us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.516855:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.516855:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.516856:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11965 00010000:00010000:0.0:1651529344.516856:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50ab8 lrc: 3/0,1 mode: PW/PW res: [0x2b5e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516859:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50ab8 lrc: 4/0,1 mode: PW/PW res: [0x2b5e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516865:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.516873:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d036941 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1381:41278:x1731746396289152:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 41us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.516875:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11966 00010000:00010000:0.0:1651529344.516886:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50ab8 lrc: 3/0,1 mode: PW/PW res: [0x2b5e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516889:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50ab8 lrc: 3/0,1 mode: PW/PW res: [0x2b5e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516893:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50ab8 lrc: 3/0,1 mode: PW/PW res: [0x2b5e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.516895:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50ab8 lrc: 2/0,0 mode: PW/PW res: [0x2b5e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.516999:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+682:39030:x1731745946408064:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 782us (834us total) trans 12885079238 rc 0/0 00000100:00100000:0.0:1651529344.517002:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211184 00010000:00010000:0.0:1651529344.517009:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50ab8 lrc: 2/0,0 mode: PW/PW res: [0x2b5e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517013:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000005a52f96 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.517014:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50ab8 lrc: 2/0,0 mode: PW/PW res: [0x2b5e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.517017:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.517017:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50ab8 lrc: 3/0,0 mode: PW/PW res: [0x2b5e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517027:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50ab8 lrc: 1/0,0 mode: --/PW res: [0x2b5e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517031:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50ab8 lrc: 0/0,0 mode: --/PW res: [0x2b5e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.517039:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946408832 00000100:00100000:0.0:1651529344.517049:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211188 00000100:00100000:0.0:1651529344.517051:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+682:39030:x1731745946408832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.517061:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177636 count 1 00000100:00100000:1.0:1651529344.517062:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.517070:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50ad4 lrc: 3/0,1 mode: --/PW res: [0x2b5e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517075:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c7308f91/0x3234de053c4d7c7 lrc: 2/0,0 mode: PR/PR res: [0x2b5e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d109a expref: 1380 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.517076:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.517078:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.517079:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.517080:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50ad4 lrc: 4/0,1 mode: --/PW res: [0x2b5e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.517090:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946408896 00010000:00010000:0.0:1651529344.517091:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c7308f91/0x3234de053c4d7c7 lrc: 3/0,0 mode: PR/PR res: [0x2b5e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d109a expref: 1380 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.517095:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c7308f91/0x3234de053c4d7c7 lrc: 4/0,0 mode: PR/PR res: [0x2b5e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d109a expref: 1380 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.517097:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946408960 00000100:00100000:0.0:1651529344.517099:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996982784:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.517103:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211189 00000100:00100000:1.0:1651529344.517105:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+684:39029:x1731745946408896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.517110:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177637 count 1 00000100:00100000:0.0:1651529344.517117:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a3b00cf3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.517121:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50adb lrc: 3/0,1 mode: --/PW res: [0x2b5e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.517124:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211190 00010000:00010000:1.0:1651529344.517126:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bfb26db5/0x3234de053c4ee09 lrc: 2/0,0 mode: PR/PR res: [0x2b5e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a66 expref: 1380 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.517126:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+684:39030:x1731745946408960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.517129:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.517130:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.517131:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50adb lrc: 4/0,1 mode: --/PW res: [0x2b5e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.517132:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177638 count 1 00010000:00010000:0.0:1651529344.517136:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c50ae2 lrc: 3/0,1 mode: --/PW res: [0x2b5e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517137:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bfb26db5/0x3234de053c4ee09 lrc: 3/0,0 mode: PR/PR res: [0x2b5e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a66 expref: 1380 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.517141:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bfb26db5/0x3234de053c4ee09 lrc: 4/0,0 mode: PR/PR res: [0x2b5e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a66 expref: 1380 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.517145:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007ac35c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996982848:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.517154:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 000000004698fefb going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.517161:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004089c807 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996982656:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.517165:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50ac6 lrc: 3/0,1 mode: --/PW res: [0x2b5e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517168:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c0588f4c/0x3234de053c4d0d5 lrc: 2/0,0 mode: PR/PR res: [0x2b5e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf4ee expref: 1380 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.517171:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.517172:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.517173:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c50ae2 lrc: 4/0,1 mode: --/PW res: [0x2b5e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517180:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c0588f4c/0x3234de053c4d0d5 lrc: 3/0,0 mode: PR/PR res: [0x2b5e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf4ee expref: 1380 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.517184:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c0588f4c/0x3234de053c4d0d5 lrc: 4/0,0 mode: PR/PR res: [0x2b5e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf4ee expref: 1380 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.517188:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dfef64e7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996982912:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.517191:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.517196:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 000000000e7e66c4 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.517204:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006929eb96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996982592:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.517206:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.517208:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c50abf lrc: 3/0,1 mode: --/PW res: [0x2b5e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.517234:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996982720:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.517237:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50acd lrc: 3/0,1 mode: --/PW res: [0x2b5e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517249:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c50ab1 lrc: 3/0,1 mode: PW/PW res: [0x2b5df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517252:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c50ab1 lrc: 3/0,1 mode: PW/PW res: [0x2b5df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.517255:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.517255:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c50ab1 lrc: 3/0,1 mode: PW/PW res: [0x2b5df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517258:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c50ab1 lrc: 2/0,0 mode: PW/PW res: [0x2b5df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.517263:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.517277:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946409024 00000100:00100000:1.0:1651529344.517284:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211191 00000100:00100000:1.0:1651529344.517286:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+686:39029:x1731745946409024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.517291:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177639 count 1 00010000:00010000:1.0:1651529344.517295:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50ae9 lrc: 3/0,1 mode: --/PW res: [0x2b5e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517300:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009327070b/0x3234de053c4d9cd lrc: 2/0,0 mode: PR/PR res: [0x2b5e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d17c4 expref: 1380 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.517303:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.517306:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+686:39029:x1731745946408000:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1159us (1203us total) trans 12885079239 rc 0/0 00010000:00010000:1.0:1651529344.517309:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.517309:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211183 00010000:00010000:1.0:1651529344.517310:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50ae9 lrc: 4/0,1 mode: --/PW res: [0x2b5e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517317:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009327070b/0x3234de053c4d9cd lrc: 3/0,0 mode: PR/PR res: [0x2b5e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d17c4 expref: 1380 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.517319:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396289216 00010000:00010000:1.0:1651529344.517321:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009327070b/0x3234de053c4d9cd lrc: 4/0,0 mode: PR/PR res: [0x2b5e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d17c4 expref: 1381 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.517324:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000064e26837/0x3234de053c4d956 lrc: 4/0,0 mode: PR/PR res: [0x2b5e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d15e8 expref: 1381 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.517325:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996982976:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.517332:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396289344 00010000:00010000:0.0:1651529344.517335:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002d6aea49/0x3234de053c4ca68 lrc: 4/0,0 mode: PR/PR res: [0x2b5e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb4f expref: 1382 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.517339:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.517339:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396289280 00010000:00010000:0.0:1651529344.517341:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009e600d3e/0x3234de053c4d209 lrc: 4/0,0 mode: PR/PR res: [0x2b5e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf9e1 expref: 1383 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.517345:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11967 00000100:00100000:1.0:1651529344.517347:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1383:41278:x1731746396289216:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.517349:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11968 00010000:00010000:1.0:1651529344.517350:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.517350:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1383:41278:x1731746396289344:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.517352:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000064e26837/0x3234de053c4d956 lrc: 4/0,0 mode: PR/PR res: [0x2b5e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d15e8 expref: 1383 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.517353:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.517355:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002d6aea49/0x3234de053c4ca68 lrc: 4/0,0 mode: PR/PR res: [0x2b5e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb4f expref: 1383 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.517358:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000064e26837/0x3234de053c4d956 lrc: 3/0,0 mode: PR/PR res: [0x2b5e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d15e8 expref: 1383 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.517358:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002d6aea49/0x3234de053c4ca68 lrc: 3/0,0 mode: PR/PR res: [0x2b5e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb4f expref: 1383 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.517364:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064e26837/0x3234de053c4d956 lrc: 0/0,0 mode: --/PR res: [0x2b5e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d15e8 expref: 1383 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.517364:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d6aea49/0x3234de053c4ca68 lrc: 0/0,0 mode: --/PR res: [0x2b5e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb4f expref: 1383 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.517367:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.517368:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.517368:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c50abf lrc: 3/0,1 mode: PW/PW res: [0x2b5e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517368:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.517368:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.517369:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50acd lrc: 3/0,1 mode: PW/PW res: [0x2b5e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517372:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c50abf lrc: 4/0,1 mode: PW/PW res: [0x2b5e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517372:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50acd lrc: 4/0,1 mode: PW/PW res: [0x2b5e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517379:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.517382:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.517387:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1381:41278:x1731746396289216:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 40us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.517390:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11967 00000100:00100000:1.0:1651529344.517395:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11969 00000100:00100000:1.0:1651529344.517397:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1380:41278:x1731746396289280:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.517400:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.517401:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009e600d3e/0x3234de053c4d209 lrc: 4/0,0 mode: PR/PR res: [0x2b5e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf9e1 expref: 1380 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.517405:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009e600d3e/0x3234de053c4d209 lrc: 3/0,0 mode: PR/PR res: [0x2b5e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf9e1 expref: 1380 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.517407:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1380:41278:x1731746396289344:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 55us (151us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.517410:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e600d3e/0x3234de053c4d209 lrc: 0/0,0 mode: --/PR res: [0x2b5e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf9e1 expref: 1380 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.517410:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11968 00010000:00010000:1.0:1651529344.517413:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.517414:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.517414:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50ac6 lrc: 3/0,1 mode: PW/PW res: [0x2b5e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517417:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50ac6 lrc: 4/0,1 mode: PW/PW res: [0x2b5e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517417:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c50abf lrc: 3/0,1 mode: PW/PW res: [0x2b5e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517423:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.517428:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1378:41278:x1731746396289280:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 30us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.517430:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11969 00010000:00010000:0.0:1651529344.517432:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c50abf lrc: 3/0,1 mode: PW/PW res: [0x2b5e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517435:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c50abf lrc: 3/0,1 mode: PW/PW res: [0x2b5e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517436:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c50ab1 lrc: 2/0,0 mode: PW/PW res: [0x2b5df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517438:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c50abf lrc: 2/0,0 mode: PW/PW res: [0x2b5e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517439:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001630f6d1 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.517440:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c50ab1 lrc: 2/0,0 mode: PW/PW res: [0x2b5df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517443:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c50ab1 lrc: 3/0,0 mode: PW/PW res: [0x2b5df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517447:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c50ab1 lrc: 1/0,0 mode: --/PW res: [0x2b5df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517453:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c50ab1 lrc: 0/0,0 mode: --/PW res: [0x2b5df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517457:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c50abf lrc: 2/0,0 mode: PW/PW res: [0x2b5e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517459:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000be0f0b1c already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.517460:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c50abf lrc: 2/0,0 mode: PW/PW res: [0x2b5e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517463:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c50abf lrc: 3/0,0 mode: PW/PW res: [0x2b5e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517466:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c50abf lrc: 1/0,0 mode: --/PW res: [0x2b5e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517469:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c50abf lrc: 0/0,0 mode: --/PW res: [0x2b5e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517475:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50ac6 lrc: 3/0,1 mode: PW/PW res: [0x2b5e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.517475:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+686:39029:x1731745946408128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1128us (1275us total) trans 12885079240 rc 0/0 00010000:00010000:1.0:1651529344.517477:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50ac6 lrc: 3/0,1 mode: PW/PW res: [0x2b5e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.517478:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211185 00010000:00010000:1.0:1651529344.517480:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50ac6 lrc: 3/0,1 mode: PW/PW res: [0x2b5e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517483:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50ac6 lrc: 2/0,0 mode: PW/PW res: [0x2b5e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517485:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50acd lrc: 3/0,1 mode: PW/PW res: [0x2b5e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517489:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50acd lrc: 3/0,1 mode: PW/PW res: [0x2b5e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517499:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50acd lrc: 3/0,1 mode: PW/PW res: [0x2b5e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517502:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50acd lrc: 2/0,0 mode: PW/PW res: [0x2b5e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.517535:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+687:39030:x1731745946408192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1169us (1285us total) trans 12885079241 rc 0/0 00000100:00100000:1.0:1651529344.517538:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211186 00010000:00010000:1.0:1651529344.517545:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50ac6 lrc: 2/0,0 mode: PW/PW res: [0x2b5e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517548:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000017857b04 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.517549:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50ac6 lrc: 2/0,0 mode: PW/PW res: [0x2b5e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517552:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50ac6 lrc: 3/0,0 mode: PW/PW res: [0x2b5e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.517555:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059df4489 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+686:39030:x1731745946408256:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1128us (1205us total) trans 12885079242 rc 0/0 00010000:00010000:1.0:1651529344.517556:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50ac6 lrc: 1/0,0 mode: --/PW res: [0x2b5e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517559:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50ac6 lrc: 0/0,0 mode: --/PW res: [0x2b5e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.517559:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211187 00010000:00010000:1.0:1651529344.517563:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50acd lrc: 2/0,0 mode: PW/PW res: [0x2b5e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517566:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006b93727a already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.517567:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50acd lrc: 2/0,0 mode: PW/PW res: [0x2b5e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517570:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50acd lrc: 3/0,0 mode: PW/PW res: [0x2b5e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517573:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50acd lrc: 1/0,0 mode: --/PW res: [0x2b5e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517576:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50acd lrc: 0/0,0 mode: --/PW res: [0x2b5e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.517622:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996982784:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.517627:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50ad4 lrc: 3/0,1 mode: --/PW res: [0x2b5e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.517659:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007ac35c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996982848:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.517663:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.517664:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50adb lrc: 3/0,1 mode: --/PW res: [0x2b5e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.517672:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.517681:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.517690:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dfef64e7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996982912:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.517694:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c50ae2 lrc: 3/0,1 mode: --/PW res: [0x2b5e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.517701:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396289984 00010000:00010000:1.0:1651529344.517707:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c7308f91/0x3234de053c4d7c7 lrc: 4/0,0 mode: PR/PR res: [0x2b5e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d109a expref: 1378 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.517716:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396289920 00010000:00010000:1.0:1651529344.517719:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bfb26db5/0x3234de053c4ee09 lrc: 4/0,0 mode: PR/PR res: [0x2b5e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a66 expref: 1379 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.517724:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396290048 00010000:00010000:1.0:1651529344.517726:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c0588f4c/0x3234de053c4d0d5 lrc: 4/0,0 mode: PR/PR res: [0x2b5e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf4ee expref: 1380 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.517733:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11970 00000100:00100000:1.0:1651529344.517744:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1380:41278:x1731746396289984:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.517745:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11971 00010000:00010000:1.0:1651529344.517747:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.517747:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1380:41278:x1731746396289920:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.517748:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c7308f91/0x3234de053c4d7c7 lrc: 4/0,0 mode: PR/PR res: [0x2b5e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d109a expref: 1380 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.517750:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.517752:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c7308f91/0x3234de053c4d7c7 lrc: 3/0,0 mode: PR/PR res: [0x2b5e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d109a expref: 1380 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.517752:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bfb26db5/0x3234de053c4ee09 lrc: 4/0,0 mode: PR/PR res: [0x2b5e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a66 expref: 1380 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.517756:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bfb26db5/0x3234de053c4ee09 lrc: 3/0,0 mode: PR/PR res: [0x2b5e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a66 expref: 1380 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.517758:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7308f91/0x3234de053c4d7c7 lrc: 0/0,0 mode: --/PR res: [0x2b5e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d109a expref: 1380 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.517762:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.517762:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.517762:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfb26db5/0x3234de053c4ee09 lrc: 0/0,0 mode: --/PR res: [0x2b5e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a66 expref: 1379 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.517763:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50ad4 lrc: 3/0,1 mode: PW/PW res: [0x2b5e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517766:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.517766:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.517767:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50ad4 lrc: 4/0,1 mode: PW/PW res: [0x2b5e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517767:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50adb lrc: 3/0,1 mode: PW/PW res: [0x2b5e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517770:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50adb lrc: 4/0,1 mode: PW/PW res: [0x2b5e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517775:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.517783:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1378:41278:x1731746396289984:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 38us (120us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.517785:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.517791:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11970 00000100:00100000:0.0:1651529344.517793:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1378:41278:x1731746396289920:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 45us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.517795:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11971 00000100:00100000:1.0:1651529344.517797:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11972 00000100:00100000:1.0:1651529344.517799:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1376:41278:x1731746396290048:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.517802:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.517803:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c0588f4c/0x3234de053c4d0d5 lrc: 4/0,0 mode: PR/PR res: [0x2b5e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf4ee expref: 1376 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.517803:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50ad4 lrc: 3/0,1 mode: PW/PW res: [0x2b5e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517806:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50ad4 lrc: 3/0,1 mode: PW/PW res: [0x2b5e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517807:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c0588f4c/0x3234de053c4d0d5 lrc: 3/0,0 mode: PR/PR res: [0x2b5e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf4ee expref: 1376 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.517810:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50ad4 lrc: 3/0,1 mode: PW/PW res: [0x2b5e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517812:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0588f4c/0x3234de053c4d0d5 lrc: 0/0,0 mode: --/PR res: [0x2b5e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf4ee expref: 1376 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.517815:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.517816:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.517817:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c50ae2 lrc: 3/0,1 mode: PW/PW res: [0x2b5e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517820:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c50ae2 lrc: 4/0,1 mode: PW/PW res: [0x2b5e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517829:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.517831:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50ad4 lrc: 2/0,0 mode: PW/PW res: [0x2b5e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.517834:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1375:41278:x1731746396290048:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.517837:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11972 00010000:00010000:1.0:1651529344.517844:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50adb lrc: 3/0,1 mode: PW/PW res: [0x2b5e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517847:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50adb lrc: 3/0,1 mode: PW/PW res: [0x2b5e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517853:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50adb lrc: 3/0,1 mode: PW/PW res: [0x2b5e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.517856:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50adb lrc: 2/0,0 mode: PW/PW res: [0x2b5e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.517886:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+687:39030:x1731745946408832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 835us (870us total) trans 12885079243 rc 0/0 00000100:00100000:0.0:1651529344.517890:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211188 00000100:00100000:1.0:1651529344.517897:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+686:39029:x1731745946408896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 791us (835us total) trans 12885079244 rc 0/0 00010000:00010000:0.0:1651529344.517897:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50ad4 lrc: 2/0,0 mode: PW/PW res: [0x2b5e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.517900:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211189 00010000:00010000:0.0:1651529344.517903:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000034aad4d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.517904:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50ad4 lrc: 2/0,0 mode: PW/PW res: [0x2b5e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517907:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50ad4 lrc: 3/0,0 mode: PW/PW res: [0x2b5e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517914:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50ad4 lrc: 1/0,0 mode: --/PW res: [0x2b5e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517918:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50ad4 lrc: 0/0,0 mode: --/PW res: [0x2b5e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517926:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50adb lrc: 2/0,0 mode: PW/PW res: [0x2b5e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517931:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008cc70fcd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.517933:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50adb lrc: 2/0,0 mode: PW/PW res: [0x2b5e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.517938:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.517938:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50adb lrc: 3/0,0 mode: PW/PW res: [0x2b5e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517944:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50adb lrc: 1/0,0 mode: --/PW res: [0x2b5e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.517949:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50adb lrc: 0/0,0 mode: --/PW res: [0x2b5e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.517952:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.517965:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.517977:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946409088 00000100:00100000:0.0:1651529344.517987:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946409152 00000100:00100000:0.0:1651529344.517991:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946409216 00000100:00100000:0.0:1651529344.517998:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211192 00000100:00100000:0.0:1651529344.517999:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+688:39030:x1731745946409088:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.518003:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.518005:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177640 count 1 00010000:00010000:0.0:1651529344.518014:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c50af0 lrc: 3/0,1 mode: --/PW res: [0x2b5e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.518019:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c4d590 lrc: 2/0,0 mode: PR/PR res: [0x2b5e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d07e1 expref: 1374 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.518022:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.518023:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.518024:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c50af0 lrc: 4/0,1 mode: --/PW res: [0x2b5e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.518031:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c4d590 lrc: 3/0,0 mode: PR/PR res: [0x2b5e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d07e1 expref: 1374 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.518034:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c4d590 lrc: 4/0,0 mode: PR/PR res: [0x2b5e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d07e1 expref: 1374 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.518038:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dfef64e7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996983040:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.518049:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946409280 00000100:00100000:0.0:1651529344.518053:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e7e12492 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.518058:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c50ae2 lrc: 3/0,1 mode: PW/PW res: [0x2b5e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.518065:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211193 00010000:00010000:0.0:1651529344.518066:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c50ae2 lrc: 3/0,1 mode: PW/PW res: [0x2b5e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.518067:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+689:39029:x1731745946409152:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.518070:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c50ae2 lrc: 3/0,1 mode: PW/PW res: [0x2b5e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.518072:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177641 count 1 00010000:00010000:0.0:1651529344.518072:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c50ae2 lrc: 2/0,0 mode: PW/PW res: [0x2b5e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.518076:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50af7 lrc: 3/0,1 mode: --/PW res: [0x2b5e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.518086:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000049d9a625/0x3234de053c4f23f lrc: 2/0,0 mode: PR/PR res: [0x2b5e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ba7 expref: 1374 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.518090:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.518090:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.518091:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50af7 lrc: 4/0,1 mode: --/PW res: [0x2b5e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.518098:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000049d9a625/0x3234de053c4f23f lrc: 3/0,0 mode: PR/PR res: [0x2b5e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ba7 expref: 1374 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.518102:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000049d9a625/0x3234de053c4f23f lrc: 4/0,0 mode: PR/PR res: [0x2b5e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ba7 expref: 1374 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.518106:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d6486d55 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996983104:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.518115:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e5f43e7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.518121:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211194 00000100:00100000:1.0:1651529344.518123:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+690:39030:x1731745946409216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.518127:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177642 count 1 00010000:00010000:1.0:1651529344.518131:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50afe lrc: 3/0,1 mode: --/PW res: [0x2b5ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.518133:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+690:39030:x1731745946408960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1006us (1056us total) trans 12885079245 rc 0/0 00010000:00010000:1.0:1651529344.518135:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb5b784a/0x3234de053c4d096 lrc: 2/0,0 mode: PR/PR res: [0x2b5ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf400 expref: 1374 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.518136:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211190 00010000:00010000:1.0:1651529344.518138:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.518139:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.518139:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50afe lrc: 4/0,1 mode: --/PW res: [0x2b5ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.518142:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211195 00000100:00100000:0.0:1651529344.518143:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+689:39030:x1731745946409280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.518145:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eb5b784a/0x3234de053c4d096 lrc: 3/0,0 mode: PR/PR res: [0x2b5ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf400 expref: 1374 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.518148:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eb5b784a/0x3234de053c4d096 lrc: 4/0,0 mode: PR/PR res: [0x2b5ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf400 expref: 1374 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:0.0:1651529344.518148:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177643 count 1 00000100:00100000:1.0:1651529344.518152:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c43262d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996983168:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.518152:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c50b05 lrc: 3/0,1 mode: --/PW res: [0x2b5eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.518156:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ae6425a0/0x3234de053c4ccfa lrc: 2/0,0 mode: PR/PR res: [0x2b5eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce62a expref: 1374 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.518158:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 000000004698fefb going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.518163:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c50ae2 lrc: 2/0,0 mode: PW/PW res: [0x2b5e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.518166:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ae53a7c6 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.518167:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c50ae2 lrc: 2/0,0 mode: PW/PW res: [0x2b5e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.518170:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c50ae2 lrc: 3/0,0 mode: PW/PW res: [0x2b5e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.518174:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c50ae2 lrc: 1/0,0 mode: --/PW res: [0x2b5e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.518177:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c50ae2 lrc: 0/0,0 mode: --/PW res: [0x2b5e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.518178:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.518178:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.518179:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c50b05 lrc: 4/0,1 mode: --/PW res: [0x2b5eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.518189:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ae6425a0/0x3234de053c4ccfa lrc: 3/0,0 mode: PR/PR res: [0x2b5eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce62a expref: 1374 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.518193:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ae6425a0/0x3234de053c4ccfa lrc: 4/0,0 mode: PR/PR res: [0x2b5eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce62a expref: 1374 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.518197:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996983232:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.518204:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.518206:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c0dff858 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.518214:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946409344 00000100:00100000:0.0:1651529344.518244:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211196 00000100:00100000:0.0:1651529344.518245:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+690:39030:x1731745946409344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.518250:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177644 count 1 00010000:00010000:0.0:1651529344.518254:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c50b0c lrc: 3/0,1 mode: --/PW res: [0x2b5ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.518259:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000079ac541b/0x3234de053c4a4f9 lrc: 2/0,0 mode: PR/PR res: [0x2b5ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbae1 expref: 1374 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.518262:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.518262:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.518263:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.518263:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c50b0c lrc: 4/0,1 mode: --/PW res: [0x2b5ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.518269:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000079ac541b/0x3234de053c4a4f9 lrc: 3/0,0 mode: PR/PR res: [0x2b5ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbae1 expref: 1374 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.518276:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000079ac541b/0x3234de053c4a4f9 lrc: 4/0,0 mode: PR/PR res: [0x2b5ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbae1 expref: 1374 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.518279:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006026725b pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996983296:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.518293:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 000000000a4def41 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.518299:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946409408 00000100:00100000:1.0:1651529344.518301:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996982976:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.518304:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211197 00010000:00010000:1.0:1651529344.518305:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50ae9 lrc: 3/0,1 mode: --/PW res: [0x2b5e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.518306:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+691:39029:x1731745946409408:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.518310:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177645 count 1 00010000:00010000:0.0:1651529344.518326:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c50b13 lrc: 3/0,1 mode: --/PW res: [0x2b5ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.518330:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008869e457/0x3234de053c4d321 lrc: 2/0,0 mode: PR/PR res: [0x2b5ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe72 expref: 1374 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.518334:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.518334:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.518346:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c50b13 lrc: 4/0,1 mode: --/PW res: [0x2b5ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.518349:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.518354:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008869e457/0x3234de053c4d321 lrc: 3/0,0 mode: PR/PR res: [0x2b5ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe72 expref: 1374 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.518357:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396290112 00010000:00010000:0.0:1651529344.518357:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008869e457/0x3234de053c4d321 lrc: 4/0,0 mode: PR/PR res: [0x2b5ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe72 expref: 1374 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.518362:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009327070b/0x3234de053c4d9cd lrc: 4/0,0 mode: PR/PR res: [0x2b5e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d17c4 expref: 1375 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.518364:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009b8db73b pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996983360:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.518369:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11973 00000100:00100000:1.0:1651529344.518371:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000091b9484 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1375:41279:x1731746396290112:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.518374:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.518375:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009327070b/0x3234de053c4d9cd lrc: 4/0,0 mode: PR/PR res: [0x2b5e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d17c4 expref: 1375 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.518385:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009327070b/0x3234de053c4d9cd lrc: 3/0,0 mode: PR/PR res: [0x2b5e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d17c4 expref: 1375 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.518389:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000abca413e going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.518391:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009327070b/0x3234de053c4d9cd lrc: 0/0,0 mode: --/PR res: [0x2b5e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d17c4 expref: 1375 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.518395:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.518396:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.518397:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50ae9 lrc: 3/0,1 mode: PW/PW res: [0x2b5e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.518400:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50ae9 lrc: 4/0,1 mode: PW/PW res: [0x2b5e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.518405:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.518406:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.518412:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000091b9484 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1374:41279:x1731746396290112:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (64us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.518415:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11973 00010000:00010000:1.0:1651529344.518426:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50ae9 lrc: 3/0,1 mode: PW/PW res: [0x2b5e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.518429:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50ae9 lrc: 3/0,1 mode: PW/PW res: [0x2b5e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.518434:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946409984 00010000:00010000:1.0:1651529344.518441:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50ae9 lrc: 3/0,1 mode: PW/PW res: [0x2b5e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.518442:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211198 00010000:00010000:1.0:1651529344.518443:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50ae9 lrc: 2/0,0 mode: PW/PW res: [0x2b5e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.518443:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+692:39030:x1731745946409984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.518473:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177646 count 1 00010000:00010000:0.0:1651529344.518477:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c50b1a lrc: 3/0,1 mode: --/PW res: [0x2b5ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.518482:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000079615549/0x3234de053c4dea4 lrc: 2/0,0 mode: PR/PR res: [0x2b5ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b4a expref: 1373 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.518485:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.518486:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+693:39029:x1731745946409024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1199us (1295us total) trans 12885079246 rc 0/0 00010000:00010000:0.0:1651529344.518486:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.518486:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c50b1a lrc: 4/0,1 mode: --/PW res: [0x2b5ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.518489:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211191 00010000:00010000:0.0:1651529344.518493:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000079615549/0x3234de053c4dea4 lrc: 3/0,0 mode: PR/PR res: [0x2b5ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b4a expref: 1373 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.518496:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000079615549/0x3234de053c4dea4 lrc: 4/0,0 mode: PR/PR res: [0x2b5ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b4a expref: 1373 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.518519:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996983424:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.518530:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 000000003c8b0daf going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.518535:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50ae9 lrc: 2/0,0 mode: PW/PW res: [0x2b5e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.518538:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000009bc967c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.518539:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50ae9 lrc: 2/0,0 mode: PW/PW res: [0x2b5e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.518542:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50ae9 lrc: 3/0,0 mode: PW/PW res: [0x2b5e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.518547:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50ae9 lrc: 1/0,0 mode: --/PW res: [0x2b5e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.518550:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50ae9 lrc: 0/0,0 mode: --/PW res: [0x2b5e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.518558:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dfef64e7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996983040:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.518562:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c50af0 lrc: 3/0,1 mode: --/PW res: [0x2b5e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.518573:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996983232:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.518583:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c50b05 lrc: 3/0,1 mode: --/PW res: [0x2b5eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.518584:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d6486d55 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996983104:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.518589:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50af7 lrc: 3/0,1 mode: --/PW res: [0x2b5e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.518590:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006026725b pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996983296:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.518594:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c50b0c lrc: 3/0,1 mode: --/PW res: [0x2b5ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.518596:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c43262d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996983168:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.518598:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50afe lrc: 3/0,1 mode: --/PW res: [0x2b5ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.518642:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.518649:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946410048 00000100:00100000:0.0:1651529344.518660:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211199 00000100:00100000:0.0:1651529344.518661:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+693:39029:x1731745946410048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.518666:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177647 count 1 00010000:00010000:0.0:1651529344.518670:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c50b21 lrc: 3/0,1 mode: --/PW res: [0x2b5ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.518675:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000e60de6b/0x3234de053c4d4b7 lrc: 2/0,0 mode: PR/PR res: [0x2b5ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d04ca expref: 1373 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.518678:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.518679:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.518679:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c50b21 lrc: 4/0,1 mode: --/PW res: [0x2b5ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.518686:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000e60de6b/0x3234de053c4d4b7 lrc: 3/0,0 mode: PR/PR res: [0x2b5ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d04ca expref: 1373 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.518689:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000e60de6b/0x3234de053c4d4b7 lrc: 4/0,0 mode: PR/PR res: [0x2b5ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d04ca expref: 1373 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.518693:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996983488:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.518706:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c0dff858 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.518806:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.518817:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396290176 00000100:00100000:0.0:1651529344.518818:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.518828:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c4d590 lrc: 4/0,0 mode: PR/PR res: [0x2b5e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d07e1 expref: 1374 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.518838:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396290304 00010000:00010000:1.0:1651529344.518840:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eb5b784a/0x3234de053c4d096 lrc: 4/0,0 mode: PR/PR res: [0x2b5ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf400 expref: 1375 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.518859:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11974 00000100:00100000:1.0:1651529344.518860:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1375:41279:x1731746396290176:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.518864:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.518865:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c4d590 lrc: 4/0,0 mode: PR/PR res: [0x2b5e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d07e1 expref: 1375 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.518869:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c4d590 lrc: 3/0,0 mode: PR/PR res: [0x2b5e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d07e1 expref: 1375 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.518872:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009b8db73b pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996983360:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.518875:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c4d590 lrc: 0/0,0 mode: --/PR res: [0x2b5e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d07e1 expref: 1375 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.518877:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c50b13 lrc: 3/0,1 mode: --/PW res: [0x2b5ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.518878:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.518879:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.518880:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c50af0 lrc: 3/0,1 mode: PW/PW res: [0x2b5e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.518883:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c50af0 lrc: 4/0,1 mode: PW/PW res: [0x2b5e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.518886:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11975 00000100:00100000:0.0:1651529344.518888:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1374:41279:x1731746396290304:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.518892:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.518897:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.518899:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eb5b784a/0x3234de053c4d096 lrc: 4/0,0 mode: PR/PR res: [0x2b5ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf400 expref: 1374 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.518903:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1374:41279:x1731746396290176:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.518906:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11974 00010000:00010000:0.0:1651529344.518908:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eb5b784a/0x3234de053c4d096 lrc: 3/0,0 mode: PR/PR res: [0x2b5ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf400 expref: 1374 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.518916:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb5b784a/0x3234de053c4d096 lrc: 0/0,0 mode: --/PR res: [0x2b5ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf400 expref: 1373 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.518921:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.518923:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.518924:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.518926:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50afe lrc: 3/0,1 mode: PW/PW res: [0x2b5ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.518931:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50afe lrc: 4/0,1 mode: PW/PW res: [0x2b5ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.518946:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.518960:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.518961:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1372:41279:x1731746396290304:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 73us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.518965:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11975 00000100:00100000:0.0:1651529344.518971:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396290432 00010000:00010000:0.0:1651529344.518975:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000079ac541b/0x3234de053c4a4f9 lrc: 4/0,0 mode: PR/PR res: [0x2b5ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbae1 expref: 1372 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.518995:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.518999:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396290624 00000100:00100000:1.0:1651529344.519001:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.519003:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008869e457/0x3234de053c4d321 lrc: 4/0,0 mode: PR/PR res: [0x2b5ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe72 expref: 1373 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.519008:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396290240 00000100:00100000:1.0:1651529344.519020:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.519026:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.519032:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50afe lrc: 3/0,1 mode: PW/PW res: [0x2b5ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519032:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000049d9a625/0x3234de053c4f23f lrc: 4/0,0 mode: PR/PR res: [0x2b5e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ba7 expref: 1374 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.519036:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50afe lrc: 3/0,1 mode: PW/PW res: [0x2b5ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.519038:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396290368 00010000:00010000:1.0:1651529344.519040:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50afe lrc: 3/0,1 mode: PW/PW res: [0x2b5ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519040:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ae6425a0/0x3234de053c4ccfa lrc: 4/0,0 mode: PR/PR res: [0x2b5eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce62a expref: 1375 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.519042:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50afe lrc: 2/0,0 mode: PW/PW res: [0x2b5ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.519044:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396290752 00010000:00010000:0.0:1651529344.519046:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000079615549/0x3234de053c4dea4 lrc: 5/0,0 mode: PR/PR res: [0x2b5ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b4a expref: 1376 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.519057:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396290816 00010000:00010000:0.0:1651529344.519060:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000e60de6b/0x3234de053c4d4b7 lrc: 5/0,0 mode: PR/PR res: [0x2b5ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d04ca expref: 1377 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.519065:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11976 00000100:00100000:0.0:1651529344.519066:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1377:41279:x1731746396290432:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.519069:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.519071:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000079ac541b/0x3234de053c4a4f9 lrc: 4/0,0 mode: PR/PR res: [0x2b5ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbae1 expref: 1377 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.519074:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000079ac541b/0x3234de053c4a4f9 lrc: 3/0,0 mode: PR/PR res: [0x2b5ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbae1 expref: 1377 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.519080:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079ac541b/0x3234de053c4a4f9 lrc: 0/0,0 mode: --/PR res: [0x2b5ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbae1 expref: 1377 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.519083:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.519084:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.519085:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c50b0c lrc: 3/0,1 mode: PW/PW res: [0x2b5ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.519087:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+694:39030:x1731745946409216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 963us (1121us total) trans 12885079247 rc 0/0 00010000:00010000:0.0:1651529344.519088:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c50b0c lrc: 4/0,1 mode: PW/PW res: [0x2b5ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.519090:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211194 00010000:00010000:0.0:1651529344.519095:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.519098:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11977 00000100:00100000:1.0:1651529344.519100:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1376:41279:x1731746396290624:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.519102:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1376:41279:x1731746396290432:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (180us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.519103:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.519104:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11976 00010000:00010000:1.0:1651529344.519105:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008869e457/0x3234de053c4d321 lrc: 4/0,0 mode: PR/PR res: [0x2b5ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe72 expref: 1376 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.519109:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008869e457/0x3234de053c4d321 lrc: 3/0,0 mode: PR/PR res: [0x2b5ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe72 expref: 1375 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.519109:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11978 00000100:00100000:0.0:1651529344.519110:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1375:41278:x1731746396290240:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.519113:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.519114:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008869e457/0x3234de053c4d321 lrc: 0/0,0 mode: --/PR res: [0x2b5ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe72 expref: 1375 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.519114:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000049d9a625/0x3234de053c4f23f lrc: 4/0,0 mode: PR/PR res: [0x2b5e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ba7 expref: 1375 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.519118:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.519119:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.519120:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c50b13 lrc: 3/0,1 mode: PW/PW res: [0x2b5ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519121:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000049d9a625/0x3234de053c4f23f lrc: 3/0,0 mode: PR/PR res: [0x2b5e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ba7 expref: 1374 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.519123:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c50b13 lrc: 4/0,1 mode: PW/PW res: [0x2b5ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519125:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049d9a625/0x3234de053c4f23f lrc: 0/0,0 mode: --/PR res: [0x2b5e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ba7 expref: 1374 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.519128:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.519129:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.519132:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.519136:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50af7 lrc: 3/0,1 mode: PW/PW res: [0x2b5e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.519138:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1373:41279:x1731746396290624:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (179us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.519140:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50af7 lrc: 4/0,1 mode: PW/PW res: [0x2b5e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.519141:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11977 00000100:00100000:1.0:1651529344.519146:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11979 00010000:00010000:0.0:1651529344.519149:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.519154:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1372:41278:x1731746396290368:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.519155:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1372:41278:x1731746396290240:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 44us (160us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.519157:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.519157:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11978 00010000:00010000:1.0:1651529344.519159:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ae6425a0/0x3234de053c4ccfa lrc: 4/0,0 mode: PR/PR res: [0x2b5eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce62a expref: 1372 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.519162:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11980 00010000:00010000:1.0:1651529344.519163:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ae6425a0/0x3234de053c4ccfa lrc: 3/0,0 mode: PR/PR res: [0x2b5eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce62a expref: 1371 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.519163:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bbd85ac9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1371:41278:x1731746396290752:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.519166:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.519167:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000079615549/0x3234de053c4dea4 lrc: 5/0,0 mode: PR/PR res: [0x2b5ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b4a expref: 1371 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.519168:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae6425a0/0x3234de053c4ccfa lrc: 0/0,0 mode: --/PR res: [0x2b5eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce62a expref: 1371 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.519171:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.519171:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000079615549/0x3234de053c4dea4 lrc: 4/0,0 mode: PR/PR res: [0x2b5ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b4a expref: 1371 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.519172:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.519173:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c50b05 lrc: 3/0,1 mode: PW/PW res: [0x2b5eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.519175:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c50b05 lrc: 4/0,1 mode: PW/PW res: [0x2b5eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519176:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.519176:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.519177:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c50b1a lrc: 3/0,1 mode: PW/PW res: [0x2b5ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519180:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c50b1a lrc: 4/0,1 mode: PW/PW res: [0x2b5ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.519184:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.519190:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1370:41278:x1731746396290368:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (188us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.519191:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.519192:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11979 00000100:00100000:0.0:1651529344.519196:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bbd85ac9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1369:41278:x1731746396290752:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 32us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.519197:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11981 00000100:00100000:1.0:1651529344.519199:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1369:41278:x1731746396290816:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.519199:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11980 00010000:00010000:1.0:1651529344.519201:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.519202:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000e60de6b/0x3234de053c4d4b7 lrc: 5/0,0 mode: PR/PR res: [0x2b5ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d04ca expref: 1368 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.519206:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000e60de6b/0x3234de053c4d4b7 lrc: 4/0,0 mode: PR/PR res: [0x2b5ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d04ca expref: 1368 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.519210:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50afe lrc: 2/0,0 mode: PW/PW res: [0x2b5ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.519211:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.519211:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.519212:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c50b21 lrc: 3/0,1 mode: PW/PW res: [0x2b5ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519213:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000092d9e682 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.519214:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50afe lrc: 2/0,0 mode: PW/PW res: [0x2b5ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.519215:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c50b21 lrc: 4/0,1 mode: PW/PW res: [0x2b5ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519217:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50afe lrc: 3/0,0 mode: PW/PW res: [0x2b5ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.519219:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.519221:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50afe lrc: 1/0,0 mode: --/PW res: [0x2b5ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.519239:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1368:41278:x1731746396290816:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 39us (213us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.519240:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50afe lrc: 0/0,0 mode: --/PW res: [0x2b5ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.519242:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11981 00010000:00010000:1.0:1651529344.519248:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50af7 lrc: 3/0,1 mode: PW/PW res: [0x2b5e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.519251:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50af7 lrc: 3/0,1 mode: PW/PW res: [0x2b5e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519251:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c50af0 lrc: 3/0,1 mode: PW/PW res: [0x2b5e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.519254:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50af7 lrc: 3/0,1 mode: PW/PW res: [0x2b5e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519254:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c50af0 lrc: 3/0,1 mode: PW/PW res: [0x2b5e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.519257:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50af7 lrc: 2/0,0 mode: PW/PW res: [0x2b5e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519257:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c50af0 lrc: 3/0,1 mode: PW/PW res: [0x2b5e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519260:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c50af0 lrc: 2/0,0 mode: PW/PW res: [0x2b5e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.519293:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+695:39029:x1731745946409152:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1225us (1341us total) trans 12885079248 rc 0/0 00000100:00100000:1.0:1651529344.519296:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211193 00010000:00010000:1.0:1651529344.519302:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50af7 lrc: 2/0,0 mode: PW/PW res: [0x2b5e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.519302:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+694:39030:x1731745946409088:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1302us (1364us total) trans 12885079249 rc 0/0 00010000:00010000:1.0:1651529344.519305:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008f8dd346 already unused, calling callback (0000000049fddea7) 00000100:00100000:0.0:1651529344.519305:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211192 00010000:00010000:1.0:1651529344.519307:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50af7 lrc: 2/0,0 mode: PW/PW res: [0x2b5e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.519310:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50af7 lrc: 3/0,0 mode: PW/PW res: [0x2b5e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519313:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c50af0 lrc: 2/0,0 mode: PW/PW res: [0x2b5e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.519314:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50af7 lrc: 1/0,0 mode: --/PW res: [0x2b5e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519316:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002e1250c9 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.519317:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50af7 lrc: 0/0,0 mode: --/PW res: [0x2b5e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519317:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c50af0 lrc: 2/0,0 mode: PW/PW res: [0x2b5e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519320:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c50af0 lrc: 3/0,0 mode: PW/PW res: [0x2b5e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519324:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c50af0 lrc: 1/0,0 mode: --/PW res: [0x2b5e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519327:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c50af0 lrc: 0/0,0 mode: --/PW res: [0x2b5e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519333:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c50b05 lrc: 3/0,1 mode: PW/PW res: [0x2b5eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519336:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c50b05 lrc: 3/0,1 mode: PW/PW res: [0x2b5eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519339:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c50b05 lrc: 3/0,1 mode: PW/PW res: [0x2b5eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519342:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c50b05 lrc: 2/0,0 mode: PW/PW res: [0x2b5eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.519374:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+694:39030:x1731745946409280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1230us (1371us total) trans 12885079250 rc 0/0 00000100:00100000:0.0:1651529344.519377:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211195 00010000:00010000:0.0:1651529344.519383:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c50b05 lrc: 2/0,0 mode: PW/PW res: [0x2b5eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519386:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000f905106 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.519387:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c50b05 lrc: 2/0,0 mode: PW/PW res: [0x2b5eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519390:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c50b05 lrc: 3/0,0 mode: PW/PW res: [0x2b5eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519395:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c50b05 lrc: 1/0,0 mode: --/PW res: [0x2b5eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519414:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c50b05 lrc: 0/0,0 mode: --/PW res: [0x2b5eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519422:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c50b0c lrc: 3/0,1 mode: PW/PW res: [0x2b5ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519425:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c50b0c lrc: 3/0,1 mode: PW/PW res: [0x2b5ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519428:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c50b0c lrc: 3/0,1 mode: PW/PW res: [0x2b5ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519430:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c50b0c lrc: 2/0,0 mode: PW/PW res: [0x2b5ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.519442:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c50b0c lrc: 3/0,0 mode: PW/PW res: [0x2b5ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.519446:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007104c91e already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.519447:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c50b0c lrc: 3/0,0 mode: PW/PW res: [0x2b5ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.519451:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c50b0c lrc: 3/0,0 mode: PW/PW res: [0x2b5ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.519455:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c50b0c lrc: 1/0,0 mode: --/PW res: [0x2b5ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.519458:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c50b0c lrc: 0/0,0 mode: --/PW res: [0x2b5ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.519485:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+694:39030:x1731745946409344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1239us (1281us total) trans 12885079251 rc 0/0 00000100:00100000:0.0:1651529344.519488:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211196 00010000:00010000:0.0:1651529344.519496:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c50b13 lrc: 3/0,1 mode: PW/PW res: [0x2b5ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519499:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c50b13 lrc: 3/0,1 mode: PW/PW res: [0x2b5ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519504:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c50b13 lrc: 3/0,1 mode: PW/PW res: [0x2b5ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519507:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c50b13 lrc: 2/0,0 mode: PW/PW res: [0x2b5ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.519567:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.519582:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+694:39029:x1731745946409408:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1275us (1318us total) trans 12885079252 rc 0/0 00000100:00100000:1.0:1651529344.519585:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.519585:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211197 00000100:00100000:0.0:1651529344.519595:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946410368 00000100:00100000:0.0:1651529344.519600:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946410304 00000100:00100000:0.0:1651529344.519607:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211200 00000100:00100000:0.0:1651529344.519609:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+695:39030:x1731745946410368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.519614:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177649 count 1 00000100:00100000:1.0:1651529344.519618:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.519619:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50b28 lrc: 3/0,1 mode: --/PW res: [0x2b5f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519623:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c4cf77 lrc: 2/0,0 mode: PR/PR res: [0x2b5f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef68 expref: 1367 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.519627:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.519634:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946410432 00010000:00010000:0.0:1651529344.519643:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.519644:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.519645:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50b28 lrc: 4/0,1 mode: --/PW res: [0x2b5f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.519647:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946410496 00000100:00100000:1.0:1651529344.519652:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211201 00010000:00010000:0.0:1651529344.519653:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c4cf77 lrc: 3/0,0 mode: PR/PR res: [0x2b5f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef68 expref: 1367 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.519654:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+697:39029:x1731745946410304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.519657:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c4cf77 lrc: 4/0,0 mode: PR/PR res: [0x2b5f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef68 expref: 1367 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:1.0:1651529344.519659:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177648 count 1 00000100:00100000:0.0:1651529344.519661:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dfef64e7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996983552:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.519664:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50b2f lrc: 3/0,1 mode: --/PW res: [0x2b5f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.519668:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000040e86ed1/0x3234de053c4db8d lrc: 2/0,0 mode: PR/PR res: [0x2b5f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e46 expref: 1367 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.519670:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060852af0 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.519671:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.519672:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.519673:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50b2f lrc: 4/0,1 mode: --/PW res: [0x2b5f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519675:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c50b13 lrc: 2/0,0 mode: PW/PW res: [0x2b5ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519679:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001650e9dc already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.519680:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000040e86ed1/0x3234de053c4db8d lrc: 3/0,0 mode: PR/PR res: [0x2b5f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e46 expref: 1367 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.519680:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c50b13 lrc: 2/0,0 mode: PW/PW res: [0x2b5ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.519683:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000040e86ed1/0x3234de053c4db8d lrc: 4/0,0 mode: PR/PR res: [0x2b5f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e46 expref: 1367 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.519683:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c50b13 lrc: 3/0,0 mode: PW/PW res: [0x2b5ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519687:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c50b13 lrc: 1/0,0 mode: --/PW res: [0x2b5ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.519688:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dfc79d4e pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996983616:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.519690:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c50b13 lrc: 0/0,0 mode: --/PW res: [0x2b5ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.519697:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.519697:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211202 00000100:00100000:0.0:1651529344.519699:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+697:39029:x1731745946410432:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.519703:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211203 00000100:00100000:1.0:1651529344.519705:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005914c920 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+697:39030:x1731745946410496:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.519709:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177651 count 1 00010000:00010000:1.0:1651529344.519712:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50b36 lrc: 3/0,1 mode: --/PW res: [0x2b5f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.519716:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c4f357 lrc: 2/0,0 mode: PR/PR res: [0x2b5f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8015 expref: 1367 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.519719:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.519720:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.519720:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50b36 lrc: 4/0,1 mode: --/PW res: [0x2b5f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.519726:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c4f357 lrc: 3/0,0 mode: PR/PR res: [0x2b5f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8015 expref: 1367 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.519729:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c4f357 lrc: 4/0,0 mode: PR/PR res: [0x2b5f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8015 expref: 1367 pid: 72396 timeout: 20103 lvb_type: 1 00002000:00080000:0.0:1651529344.519730:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177650 count 1 00010000:00010000:0.0:1651529344.519741:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50b3d lrc: 3/0,1 mode: --/PW res: [0x2b5f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519746:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000082ae5d42/0x3234de053c4d2fe lrc: 2/0,0 mode: PR/PR res: [0x2b5f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfdf4 expref: 1367 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.519749:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.519750:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.519751:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50b3d lrc: 4/0,1 mode: --/PW res: [0x2b5f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.519752:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005ea32140 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996983680:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.519758:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000082ae5d42/0x3234de053c4d2fe lrc: 3/0,0 mode: PR/PR res: [0x2b5f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfdf4 expref: 1367 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.519760:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a5495eb going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.519761:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000082ae5d42/0x3234de053c4d2fe lrc: 4/0,0 mode: PR/PR res: [0x2b5f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfdf4 expref: 1367 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.519765:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a4b486d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996983744:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.519774:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 0000000076b354b3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.519777:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.519781:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946410560 00000100:00100000:0.0:1651529344.519793:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211204 00000100:00100000:0.0:1651529344.519794:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007fca8239 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+698:39029:x1731745946410560:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.519799:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177652 count 1 00000100:00100000:1.0:1651529344.519801:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.519803:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50b44 lrc: 3/0,1 mode: --/PW res: [0x2b5f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519807:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a7e8011e/0x3234de053c4f58e lrc: 2/0,0 mode: PR/PR res: [0x2b5f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d88ab expref: 1367 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.519812:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.519813:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.519813:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50b44 lrc: 4/0,1 mode: --/PW res: [0x2b5f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519819:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a7e8011e/0x3234de053c4f58e lrc: 3/0,0 mode: PR/PR res: [0x2b5f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d88ab expref: 1367 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.519823:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a7e8011e/0x3234de053c4f58e lrc: 4/0,0 mode: PR/PR res: [0x2b5f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d88ab expref: 1367 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.519826:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009b8db73b pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996983808:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.519835:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946410624 00000100:00100000:0.0:1651529344.519839:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000abca413e going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.519851:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211205 00000100:00100000:1.0:1651529344.519853:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+699:39029:x1731745946410624:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.519854:0:80281:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e60de6b/0x3234de053c4d4b7 lrc: 0/0,0 mode: --/PR res: [0x2b5ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d04ca expref: 1367 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:1.0:1651529344.519858:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177653 count 1 00010000:00010000:1.0:1651529344.519862:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50b4b lrc: 3/0,1 mode: --/PW res: [0x2b5f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.519866:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002b1677ad/0x3234de053c4d7ab lrc: 2/0,0 mode: PR/PR res: [0x2b5f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1038 expref: 1367 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.519870:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.519870:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.519871:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50b4b lrc: 4/0,1 mode: --/PW res: [0x2b5f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.519872:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996983488:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.519876:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c50b21 lrc: 3/0,1 mode: PW/PW res: [0x2b5ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.519878:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002b1677ad/0x3234de053c4d7ab lrc: 3/0,0 mode: PR/PR res: [0x2b5f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1038 expref: 1366 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.519879:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c50b21 lrc: 3/0,1 mode: PW/PW res: [0x2b5ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.519881:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002b1677ad/0x3234de053c4d7ab lrc: 4/0,0 mode: PR/PR res: [0x2b5f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1038 expref: 1366 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.519882:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c50b21 lrc: 3/0,1 mode: PW/PW res: [0x2b5ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.519885:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bca72234 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996983872:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.519887:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c50b21 lrc: 3/0,1 mode: PW/PW res: [0x2b5ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519890:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c50b21 lrc: 2/0,0 mode: PW/PW res: [0x2b5ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.519893:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 0000000099c1da85 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.519935:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+700:39029:x1731745946410048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1273us (1293us total) trans 12885079253 rc 0/0 00000100:00100000:0.0:1651529344.519938:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211199 00010000:00010000:0.0:1651529344.519945:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c50b21 lrc: 2/0,0 mode: PW/PW res: [0x2b5ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519949:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005531aaab already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.519950:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c50b21 lrc: 2/0,0 mode: PW/PW res: [0x2b5ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519972:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c50b21 lrc: 3/0,0 mode: PW/PW res: [0x2b5ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519992:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c50b21 lrc: 1/0,0 mode: --/PW res: [0x2b5ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.519995:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c50b21 lrc: 0/0,0 mode: --/PW res: [0x2b5ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.520006:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dfef64e7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996983552:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.520010:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50b28 lrc: 3/0,1 mode: --/PW res: [0x2b5f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.520012:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dfc79d4e pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996983616:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.520017:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50b2f lrc: 3/0,1 mode: --/PW res: [0x2b5f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520017:0:156655:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079615549/0x3234de053c4dea4 lrc: 0/0,0 mode: --/PR res: [0x2b5ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b4a expref: 1366 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.520021:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996983424:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.520023:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c50b1a lrc: 3/0,1 mode: PW/PW res: [0x2b5ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520026:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c50b1a lrc: 3/0,1 mode: PW/PW res: [0x2b5ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520029:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c50b1a lrc: 3/0,1 mode: PW/PW res: [0x2b5ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520032:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c50b1a lrc: 3/0,1 mode: PW/PW res: [0x2b5ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520034:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c50b1a lrc: 2/0,0 mode: PW/PW res: [0x2b5ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.520046:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c50b1a lrc: 2/0,0 mode: PW/PW res: [0x2b5ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.520049:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000760c4860 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.520050:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c50b1a lrc: 2/0,0 mode: PW/PW res: [0x2b5ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.520054:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c50b1a lrc: 3/0,0 mode: PW/PW res: [0x2b5ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.520059:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c50b1a lrc: 1/0,0 mode: --/PW res: [0x2b5ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.520061:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c50b1a lrc: 0/0,0 mode: --/PW res: [0x2b5ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.520079:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+700:39030:x1731745946409984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1635us (1674us total) trans 12885079254 rc 0/0 00000100:00100000:0.0:1651529344.520082:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211198 00000100:00100000:0.0:1651529344.520119:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.520126:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946410688 00000100:00100000:0.0:1651529344.520132:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211206 00000100:00100000:0.0:1651529344.520134:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+700:39029:x1731745946410688:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.520139:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177654 count 1 00010000:00010000:0.0:1651529344.520144:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50b52 lrc: 3/0,1 mode: --/PW res: [0x2b5f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520148:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000031f35bc4/0x3234de053c4d7f1 lrc: 2/0,0 mode: PR/PR res: [0x2b5f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1111 expref: 1365 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.520151:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.520152:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.520153:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50b52 lrc: 4/0,1 mode: --/PW res: [0x2b5f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520159:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000031f35bc4/0x3234de053c4d7f1 lrc: 3/0,0 mode: PR/PR res: [0x2b5f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1111 expref: 1365 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.520163:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000031f35bc4/0x3234de053c4d7f1 lrc: 4/0,0 mode: PR/PR res: [0x2b5f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1111 expref: 1365 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.520167:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dfef64e7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996983936:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.520182:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 000000003c8b0daf going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.520272:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a4b486d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996983744:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.520273:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.520281:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50b3d lrc: 3/0,1 mode: --/PW res: [0x2b5f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.520288:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.520289:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009b8db73b pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996983808:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.520295:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.520303:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.520304:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50b44 lrc: 3/0,1 mode: --/PW res: [0x2b5f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.520309:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.520316:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946411008 00000100:00100000:1.0:1651529344.520317:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.520324:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211207 00000100:00100000:1.0:1651529344.520325:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005ea32140 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996983680:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.520326:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+701:39029:x1731745946411008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.520329:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50b36 lrc: 3/0,1 mode: --/PW res: [0x2b5f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.520331:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177655 count 1 00010000:00010000:0.0:1651529344.520334:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50b59 lrc: 3/0,1 mode: --/PW res: [0x2b5f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.520336:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bca72234 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996983872:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.520338:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003978e409/0x3234de053c49f65 lrc: 2/0,0 mode: PR/PR res: [0x2b5f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb3b7 expref: 1365 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.520339:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50b4b lrc: 3/0,1 mode: --/PW res: [0x2b5f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520341:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.520342:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.520343:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50b59 lrc: 4/0,1 mode: --/PW res: [0x2b5f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.520344:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396291392 00010000:00010000:1.0:1651529344.520349:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000040e86ed1/0x3234de053c4db8d lrc: 4/0,0 mode: PR/PR res: [0x2b5f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e46 expref: 1366 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.520349:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003978e409/0x3234de053c49f65 lrc: 3/0,0 mode: PR/PR res: [0x2b5f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb3b7 expref: 1366 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.520353:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003978e409/0x3234de053c49f65 lrc: 4/0,0 mode: PR/PR res: [0x2b5f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb3b7 expref: 1366 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.520355:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396291520 00010000:00010000:1.0:1651529344.520357:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000082ae5d42/0x3234de053c4d2fe lrc: 4/0,0 mode: PR/PR res: [0x2b5f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfdf4 expref: 1367 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.520357:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009b8db73b pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996984000:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.520361:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396291328 00010000:00010000:1.0:1651529344.520363:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c4cf77 lrc: 4/0,0 mode: PR/PR res: [0x2b5f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef68 expref: 1368 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.520367:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396291648 00000100:00100000:0.0:1651529344.520372:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 0000000076b354b3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.520376:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002b1677ad/0x3234de053c4d7ab lrc: 4/0,0 mode: PR/PR res: [0x2b5f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1038 expref: 1369 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.520379:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396291456 00000100:00100000:1.0:1651529344.520382:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11982 00000100:00100000:1.0:1651529344.520383:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1370:41278:x1731746396291392:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.520384:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c4f357 lrc: 4/0,0 mode: PR/PR res: [0x2b5f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8015 expref: 1370 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.520386:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.520388:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000040e86ed1/0x3234de053c4db8d lrc: 4/0,0 mode: PR/PR res: [0x2b5f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e46 expref: 1370 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.520390:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11983 00010000:00010000:1.0:1651529344.520392:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000040e86ed1/0x3234de053c4db8d lrc: 3/0,0 mode: PR/PR res: [0x2b5f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e46 expref: 1370 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.520397:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040e86ed1/0x3234de053c4db8d lrc: 0/0,0 mode: --/PR res: [0x2b5f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e46 expref: 1370 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.520400:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.520401:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.520402:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50b2f lrc: 3/0,1 mode: PW/PW res: [0x2b5f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.520405:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50b2f lrc: 4/0,1 mode: PW/PW res: [0x2b5f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.520411:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.520414:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1369:41278:x1731746396291520:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.520418:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.520420:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000082ae5d42/0x3234de053c4d2fe lrc: 4/0,0 mode: PR/PR res: [0x2b5f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfdf4 expref: 1369 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.520424:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000082ae5d42/0x3234de053c4d2fe lrc: 3/0,0 mode: PR/PR res: [0x2b5f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfdf4 expref: 1369 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.520427:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1369:41278:x1731746396291392:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.520429:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11982 00010000:00010000:0.0:1651529344.520430:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082ae5d42/0x3234de053c4d2fe lrc: 0/0,0 mode: --/PR res: [0x2b5f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfdf4 expref: 1369 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.520433:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.520434:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11984 00010000:00010000:0.0:1651529344.520434:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.520435:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50b3d lrc: 3/0,1 mode: PW/PW res: [0x2b5f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.520436:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1367:41279:x1731746396291328:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.520438:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.520438:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50b3d lrc: 4/0,1 mode: PW/PW res: [0x2b5f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.520440:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c4cf77 lrc: 4/0,0 mode: PR/PR res: [0x2b5f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef68 expref: 1367 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.520444:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c4cf77 lrc: 3/0,0 mode: PR/PR res: [0x2b5f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef68 expref: 1367 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.520445:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.520449:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c4cf77 lrc: 0/0,0 mode: --/PR res: [0x2b5f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef68 expref: 1367 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.520452:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.520452:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1366:41278:x1731746396291520:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 60us (157us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.520453:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.520454:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50b28 lrc: 3/0,1 mode: PW/PW res: [0x2b5f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.520455:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11983 00010000:00010000:1.0:1651529344.520459:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50b28 lrc: 4/0,1 mode: PW/PW res: [0x2b5f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.520461:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11985 00000100:00100000:0.0:1651529344.520463:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1365:41278:x1731746396291648:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.520465:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.520468:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.520474:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1365:41279:x1731746396291328:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 38us (171us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.520474:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002b1677ad/0x3234de053c4d7ab lrc: 4/0,0 mode: PR/PR res: [0x2b5f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1038 expref: 1365 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.520476:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11984 00010000:00010000:0.0:1651529344.520477:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002b1677ad/0x3234de053c4d7ab lrc: 3/0,0 mode: PR/PR res: [0x2b5f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1038 expref: 1365 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.520481:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11986 00000100:00100000:1.0:1651529344.520483:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1364:41279:x1731746396291456:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.520483:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b1677ad/0x3234de053c4d7ab lrc: 0/0,0 mode: --/PR res: [0x2b5f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1038 expref: 1364 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.520485:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.520486:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.520486:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.520487:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c4f357 lrc: 4/0,0 mode: PR/PR res: [0x2b5f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8015 expref: 1363 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.520487:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50b4b lrc: 3/0,1 mode: PW/PW res: [0x2b5f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.520490:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c4f357 lrc: 3/0,0 mode: PR/PR res: [0x2b5f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8015 expref: 1363 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.520490:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50b4b lrc: 4/0,1 mode: PW/PW res: [0x2b5f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.520495:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c4f357 lrc: 0/0,0 mode: --/PR res: [0x2b5f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8015 expref: 1363 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.520499:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.520505:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.520505:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1362:41278:x1731746396291648:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (196us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.520506:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.520506:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50b36 lrc: 3/0,1 mode: PW/PW res: [0x2b5f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.520508:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11985 00010000:00010000:1.0:1651529344.520509:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50b36 lrc: 4/0,1 mode: PW/PW res: [0x2b5f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520515:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50b3d lrc: 3/0,1 mode: PW/PW res: [0x2b5f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.520518:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.520518:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50b3d lrc: 3/0,1 mode: PW/PW res: [0x2b5f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.520523:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1361:41279:x1731746396291456:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 40us (205us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.520524:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50b3d lrc: 3/0,1 mode: PW/PW res: [0x2b5f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.520526:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11986 00010000:00010000:0.0:1651529344.520527:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50b3d lrc: 2/0,0 mode: PW/PW res: [0x2b5f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.520533:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50b2f lrc: 3/0,1 mode: PW/PW res: [0x2b5f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.520536:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50b2f lrc: 3/0,1 mode: PW/PW res: [0x2b5f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.520539:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50b2f lrc: 3/0,1 mode: PW/PW res: [0x2b5f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.520542:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50b2f lrc: 2/0,0 mode: PW/PW res: [0x2b5f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.520574:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+703:39029:x1731745946410432:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 874us (956us total) trans 12885079255 rc 0/0 00000100:00100000:0.0:1651529344.520577:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211202 00010000:00010000:0.0:1651529344.520584:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50b3d lrc: 2/0,0 mode: PW/PW res: [0x2b5f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.520585:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+702:39029:x1731745946410304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 930us (1000us total) trans 12885079256 rc 0/0 00010000:00010000:0.0:1651529344.520587:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000048c07243 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.520588:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211201 00010000:00010000:0.0:1651529344.520588:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50b3d lrc: 2/0,0 mode: PW/PW res: [0x2b5f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520591:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50b3d lrc: 3/0,0 mode: PW/PW res: [0x2b5f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.520595:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50b4b lrc: 3/0,1 mode: PW/PW res: [0x2b5f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520596:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50b3d lrc: 1/0,0 mode: --/PW res: [0x2b5f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.520598:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50b4b lrc: 3/0,1 mode: PW/PW res: [0x2b5f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520598:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50b3d lrc: 0/0,0 mode: --/PW res: [0x2b5f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.520601:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50b4b lrc: 3/0,1 mode: PW/PW res: [0x2b5f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520603:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50b2f lrc: 2/0,0 mode: PW/PW res: [0x2b5f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.520604:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50b4b lrc: 2/0,0 mode: PW/PW res: [0x2b5f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520606:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009ad9989c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.520606:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50b2f lrc: 2/0,0 mode: PW/PW res: [0x2b5f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520609:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50b2f lrc: 3/0,0 mode: PW/PW res: [0x2b5f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520612:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50b2f lrc: 1/0,0 mode: --/PW res: [0x2b5f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520615:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50b2f lrc: 0/0,0 mode: --/PW res: [0x2b5f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520618:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50b4b lrc: 2/0,0 mode: PW/PW res: [0x2b5f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520621:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d44dd5ea already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.520622:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50b4b lrc: 2/0,0 mode: PW/PW res: [0x2b5f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520624:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50b4b lrc: 3/0,0 mode: PW/PW res: [0x2b5f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520627:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50b4b lrc: 1/0,0 mode: --/PW res: [0x2b5f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520630:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50b4b lrc: 0/0,0 mode: --/PW res: [0x2b5f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.520636:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+702:39029:x1731745946410624:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 782us (835us total) trans 12885079257 rc 0/0 00010000:00010000:0.0:1651529344.520636:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50b28 lrc: 3/0,1 mode: PW/PW res: [0x2b5f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.520639:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211205 00010000:00010000:0.0:1651529344.520639:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50b28 lrc: 3/0,1 mode: PW/PW res: [0x2b5f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520642:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50b28 lrc: 3/0,1 mode: PW/PW res: [0x2b5f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520644:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50b28 lrc: 2/0,0 mode: PW/PW res: [0x2b5f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.520646:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50b36 lrc: 3/0,1 mode: PW/PW res: [0x2b5f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.520649:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50b36 lrc: 3/0,1 mode: PW/PW res: [0x2b5f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.520652:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50b36 lrc: 3/0,1 mode: PW/PW res: [0x2b5f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.520655:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50b36 lrc: 2/0,0 mode: PW/PW res: [0x2b5f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.520688:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+703:39030:x1731745946410368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1078us (1126us total) trans 12885079258 rc 0/0 00000100:00100000:0.0:1651529344.520691:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211200 00000100:00100000:1.0:1651529344.520692:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005914c920 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+703:39030:x1731745946410496:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 986us (1065us total) trans 12885079259 rc 0/0 00000100:00100000:1.0:1651529344.520695:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211203 00010000:00010000:0.0:1651529344.520698:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50b28 lrc: 2/0,0 mode: PW/PW res: [0x2b5f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520701:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001d253066 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.520702:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50b28 lrc: 2/0,0 mode: PW/PW res: [0x2b5f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520705:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50b28 lrc: 3/0,0 mode: PW/PW res: [0x2b5f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520709:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50b28 lrc: 1/0,0 mode: --/PW res: [0x2b5f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.520711:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.520712:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50b28 lrc: 0/0,0 mode: --/PW res: [0x2b5f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520716:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50b36 lrc: 2/0,0 mode: PW/PW res: [0x2b5f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520719:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000356aa683 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.520719:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50b36 lrc: 2/0,0 mode: PW/PW res: [0x2b5f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520722:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50b36 lrc: 3/0,0 mode: PW/PW res: [0x2b5f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520726:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50b36 lrc: 1/0,0 mode: --/PW res: [0x2b5f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520743:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50b36 lrc: 0/0,0 mode: --/PW res: [0x2b5f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.520746:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.520755:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dfef64e7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996983936:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.520758:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50b52 lrc: 3/0,1 mode: --/PW res: [0x2b5f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.520787:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396291584 00010000:00010000:1.0:1651529344.520814:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a7e8011e/0x3234de053c4f58e lrc: 4/0,0 mode: PR/PR res: [0x2b5f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d88ab expref: 1361 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.520825:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396291776 00010000:00010000:1.0:1651529344.520829:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000031f35bc4/0x3234de053c4d7f1 lrc: 4/0,0 mode: PR/PR res: [0x2b5f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1111 expref: 1362 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.520838:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11987 00000100:00100000:1.0:1651529344.520839:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ede49ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1362:41279:x1731746396291584:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.520842:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.520844:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a7e8011e/0x3234de053c4f58e lrc: 4/0,0 mode: PR/PR res: [0x2b5f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d88ab expref: 1362 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.520847:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a7e8011e/0x3234de053c4f58e lrc: 3/0,0 mode: PR/PR res: [0x2b5f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d88ab expref: 1362 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.520853:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7e8011e/0x3234de053c4f58e lrc: 0/0,0 mode: --/PR res: [0x2b5f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d88ab expref: 1362 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.520857:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.520857:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.520858:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50b44 lrc: 3/0,1 mode: PW/PW res: [0x2b5f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.520860:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11988 00010000:00010000:1.0:1651529344.520861:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50b44 lrc: 4/0,1 mode: PW/PW res: [0x2b5f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.520862:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1361:41278:x1731746396291776:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.520869:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.520873:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.520875:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000031f35bc4/0x3234de053c4d7f1 lrc: 4/0,0 mode: PR/PR res: [0x2b5f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1111 expref: 1361 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.520879:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ede49ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1361:41279:x1731746396291584:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 38us (168us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.520879:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000031f35bc4/0x3234de053c4d7f1 lrc: 3/0,0 mode: PR/PR res: [0x2b5f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1111 expref: 1361 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.520882:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11987 00010000:00010000:0.0:1651529344.520885:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031f35bc4/0x3234de053c4d7f1 lrc: 0/0,0 mode: --/PR res: [0x2b5f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1111 expref: 1360 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.520889:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.520890:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.520890:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50b52 lrc: 3/0,1 mode: PW/PW res: [0x2b5f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520893:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50b52 lrc: 4/0,1 mode: PW/PW res: [0x2b5f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520900:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.520907:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1359:41278:x1731746396291776:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 45us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.520910:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11988 00010000:00010000:0.0:1651529344.520917:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50b44 lrc: 3/0,1 mode: PW/PW res: [0x2b5f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520920:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50b44 lrc: 3/0,1 mode: PW/PW res: [0x2b5f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520926:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50b44 lrc: 3/0,1 mode: PW/PW res: [0x2b5f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.520929:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50b44 lrc: 2/0,0 mode: PW/PW res: [0x2b5f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.520940:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50b44 lrc: 2/0,0 mode: PW/PW res: [0x2b5f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.520944:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000069f7ba22 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.520945:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50b44 lrc: 2/0,0 mode: PW/PW res: [0x2b5f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.520949:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50b44 lrc: 3/0,0 mode: PW/PW res: [0x2b5f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.520953:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50b44 lrc: 1/0,0 mode: --/PW res: [0x2b5f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.520956:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50b44 lrc: 0/0,0 mode: --/PW res: [0x2b5f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.520999:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007fca8239 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+702:39029:x1731745946410560:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1203us (1221us total) trans 12885079260 rc 0/0 00000100:00100000:0.0:1651529344.521002:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211204 00010000:00010000:0.0:1651529344.521009:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50b52 lrc: 3/0,1 mode: PW/PW res: [0x2b5f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.521012:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50b52 lrc: 3/0,1 mode: PW/PW res: [0x2b5f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.521015:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50b52 lrc: 3/0,1 mode: PW/PW res: [0x2b5f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.521023:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.521037:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50b52 lrc: 2/0,0 mode: PW/PW res: [0x2b5f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.521054:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.521062:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.521071:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.521078:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.521079:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+702:39029:x1731745946410688:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 944us (960us total) trans 12885079261 rc 0/0 00000100:00100000:0.0:1651529344.521082:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211206 00000100:00100000:0.0:1651529344.521087:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946411392 00000100:00100000:0.0:1651529344.521093:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946411520 00000100:00100000:0.0:1651529344.521097:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211208 00000100:00100000:0.0:1651529344.521098:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+703:39030:x1731745946411392:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.521103:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177657 count 1 00000100:00100000:1.0:1651529344.521104:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946411328 00010000:00010000:0.0:1651529344.521107:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50b60 lrc: 3/0,1 mode: --/PW res: [0x2b5f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.521111:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946411456 00010000:00010000:0.0:1651529344.521112:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000004350674/0x3234de053c4ef52 lrc: 2/0,0 mode: PR/PR res: [0x2b5f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f28 expref: 1358 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.521114:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946411584 00010000:00010000:0.0:1651529344.521115:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.521116:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.521116:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50b60 lrc: 4/0,1 mode: --/PW res: [0x2b5f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.521118:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211209 00000100:00100000:1.0:1651529344.521120:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+706:39030:x1731745946411520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.521126:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177659 count 1 00010000:00010000:1.0:1651529344.521131:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50b67 lrc: 3/0,1 mode: --/PW res: [0x2b5fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521142:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000055480488/0x3234de053c4dcdd lrc: 2/0,0 mode: PR/PR res: [0x2b5fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23fd expref: 1358 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.521145:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.521146:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.521146:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50b67 lrc: 4/0,1 mode: --/PW res: [0x2b5fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.521147:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000004350674/0x3234de053c4ef52 lrc: 3/0,0 mode: PR/PR res: [0x2b5f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f28 expref: 1358 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.521151:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000004350674/0x3234de053c4ef52 lrc: 4/0,0 mode: PR/PR res: [0x2b5f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f28 expref: 1358 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.521154:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000055480488/0x3234de053c4dcdd lrc: 3/0,0 mode: PR/PR res: [0x2b5fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23fd expref: 1358 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.521155:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dfef64e7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996984064:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.521157:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000055480488/0x3234de053c4dcdd lrc: 4/0,0 mode: PR/PR res: [0x2b5fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23fd expref: 1358 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.521162:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006e3eb319 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996984128:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.521163:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 000000003c8b0daf going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.521171:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000412e5d26 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.521177:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211210 00000100:00100000:1.0:1651529344.521179:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+706:39030:x1731745946411328:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.521182:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50b52 lrc: 2/0,0 mode: PW/PW res: [0x2b5f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.521183:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177656 count 1 00010000:00010000:0.0:1651529344.521185:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003b0cd546 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.521186:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50b52 lrc: 2/0,0 mode: PW/PW res: [0x2b5f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521187:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50b6e lrc: 3/0,1 mode: --/PW res: [0x2b5f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521191:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e8fe7f95/0x3234de053c4effa lrc: 2/0,0 mode: PR/PR res: [0x2b5f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d727e expref: 1358 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.521192:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50b52 lrc: 3/0,0 mode: PW/PW res: [0x2b5f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521194:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.521195:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.521196:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50b6e lrc: 4/0,1 mode: --/PW res: [0x2b5f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.521196:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50b52 lrc: 1/0,0 mode: --/PW res: [0x2b5f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.521199:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50b52 lrc: 0/0,0 mode: --/PW res: [0x2b5f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521201:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e8fe7f95/0x3234de053c4effa lrc: 3/0,0 mode: PR/PR res: [0x2b5f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d727e expref: 1358 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.521205:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e8fe7f95/0x3234de053c4effa lrc: 4/0,0 mode: PR/PR res: [0x2b5f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d727e expref: 1358 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.521208:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ad6d0877 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996984192:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.521208:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211211 00000100:00100000:0.0:1651529344.521210:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+706:39030:x1731745946411456:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.521215:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c3caa148 going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.521215:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177658 count 1 00000100:00100000:1.0:1651529344.521220:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211212 00000100:00100000:1.0:1651529344.521238:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+706:39030:x1731745946411584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.521243:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177660 count 1 00010000:00010000:1.0:1651529344.521246:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50b75 lrc: 3/0,1 mode: --/PW res: [0x2b5fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.521247:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50b7c lrc: 3/0,1 mode: --/PW res: [0x2b5fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521251:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004a37fa99/0x3234de053c4befa lrc: 2/0,0 mode: PR/PR res: [0x2b5fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6f0 expref: 1358 pid: 80281 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.521252:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000d53dc4d/0x3234de053c4d416 lrc: 2/0,0 mode: PR/PR res: [0x2b5fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0238 expref: 1358 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.521254:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.521254:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.521255:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50b75 lrc: 4/0,1 mode: --/PW res: [0x2b5fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.521255:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.521256:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.521257:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50b7c lrc: 4/0,1 mode: --/PW res: [0x2b5fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521264:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004a37fa99/0x3234de053c4befa lrc: 3/0,0 mode: PR/PR res: [0x2b5fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6f0 expref: 1358 pid: 80281 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.521264:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000d53dc4d/0x3234de053c4d416 lrc: 3/0,0 mode: PR/PR res: [0x2b5fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0238 expref: 1358 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.521267:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000d53dc4d/0x3234de053c4d416 lrc: 4/0,0 mode: PR/PR res: [0x2b5fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0238 expref: 1358 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.521268:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004a37fa99/0x3234de053c4befa lrc: 4/0,0 mode: PR/PR res: [0x2b5fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6f0 expref: 1358 pid: 80281 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.521272:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000075b025a pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996984320:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.521272:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a4b486d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996984256:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.521279:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b7af823 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.521281:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aac87b31 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.521310:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.521323:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.521335:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.521359:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009b8db73b pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996984000:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.521363:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50b59 lrc: 3/0,1 mode: --/PW res: [0x2b5f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.521370:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946411648 00000100:00100000:0.0:1651529344.521377:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946411712 00000100:00100000:0.0:1651529344.521385:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211213 00000100:00100000:0.0:1651529344.521387:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+708:39029:x1731745946411648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.521389:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211214 00000100:00100000:1.0:1651529344.521391:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ea32140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+708:39029:x1731745946411712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.521392:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177661 count 1 00002000:00080000:1.0:1651529344.521396:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177662 count 1 00010000:00010000:0.0:1651529344.521396:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50b83 lrc: 3/0,1 mode: --/PW res: [0x2b5fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521401:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50b8a lrc: 3/0,1 mode: --/PW res: [0x2b5fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521405:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000041f92a8a/0x3234de053c4ee6b lrc: 2/0,0 mode: PR/PR res: [0x2b5fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ba8 expref: 1358 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.521408:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.521409:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.521410:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50b8a lrc: 4/0,1 mode: --/PW res: [0x2b5fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.521415:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c4ecc7 lrc: 2/0,0 mode: PR/PR res: [0x2b5fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d650a expref: 1358 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.521416:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000041f92a8a/0x3234de053c4ee6b lrc: 3/0,0 mode: PR/PR res: [0x2b5fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ba8 expref: 1358 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.521418:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.521419:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.521420:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50b83 lrc: 4/0,1 mode: --/PW res: [0x2b5fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521422:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000041f92a8a/0x3234de053c4ee6b lrc: 4/0,0 mode: PR/PR res: [0x2b5fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ba8 expref: 1358 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.521426:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dfc79d4e pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996984384:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.521427:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c4ecc7 lrc: 3/0,0 mode: PR/PR res: [0x2b5fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d650a expref: 1358 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.521433:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c4ecc7 lrc: 4/0,0 mode: PR/PR res: [0x2b5fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d650a expref: 1358 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.521437:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b52d0f36 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.521437:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009b8db73b pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996984448:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.521446:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 000000008dd99533 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.521453:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396292224 00010000:00010000:0.0:1651529344.521458:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003978e409/0x3234de053c49f65 lrc: 4/0,0 mode: PR/PR res: [0x2b5f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb3b7 expref: 1359 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.521469:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11989 00000100:00100000:0.0:1651529344.521471:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1359:41279:x1731746396292224:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.521474:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.521476:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003978e409/0x3234de053c49f65 lrc: 4/0,0 mode: PR/PR res: [0x2b5f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb3b7 expref: 1359 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.521479:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003978e409/0x3234de053c49f65 lrc: 3/0,0 mode: PR/PR res: [0x2b5f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb3b7 expref: 1359 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.521485:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003978e409/0x3234de053c49f65 lrc: 0/0,0 mode: --/PR res: [0x2b5f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb3b7 expref: 1359 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.521488:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.521489:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.521489:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50b59 lrc: 3/0,1 mode: PW/PW res: [0x2b5f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.521495:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50b59 lrc: 4/0,1 mode: PW/PW res: [0x2b5f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.521501:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.521509:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1358:41279:x1731746396292224:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.521512:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11989 00010000:00010000:0.0:1651529344.521517:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50b59 lrc: 3/0,1 mode: PW/PW res: [0x2b5f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.521520:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50b59 lrc: 3/0,1 mode: PW/PW res: [0x2b5f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.521523:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50b59 lrc: 3/0,1 mode: PW/PW res: [0x2b5f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.521526:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50b59 lrc: 2/0,0 mode: PW/PW res: [0x2b5f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.521571:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+709:39029:x1731745946411008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1245us (1299us total) trans 12885079262 rc 0/0 00000100:00100000:0.0:1651529344.521574:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211207 00010000:00010000:0.0:1651529344.521581:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50b59 lrc: 2/0,0 mode: PW/PW res: [0x2b5f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.521584:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eb2009d7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.521586:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50b59 lrc: 2/0,0 mode: PW/PW res: [0x2b5f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.521589:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50b59 lrc: 3/0,0 mode: PW/PW res: [0x2b5f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.521593:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50b59 lrc: 1/0,0 mode: --/PW res: [0x2b5f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.521596:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50b59 lrc: 0/0,0 mode: --/PW res: [0x2b5f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.521743:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006e3eb319 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996984128:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.521747:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50b67 lrc: 3/0,1 mode: --/PW res: [0x2b5fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.521756:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ad6d0877 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996984192:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.521758:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50b6e lrc: 3/0,1 mode: --/PW res: [0x2b5f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.521760:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.521764:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000075b025a pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996984320:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.521766:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50b75 lrc: 3/0,1 mode: --/PW res: [0x2b5fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.521785:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.521794:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.521795:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.521813:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396292352 00010000:00010000:1.0:1651529344.521818:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000004350674/0x3234de053c4ef52 lrc: 5/0,0 mode: PR/PR res: [0x2b5f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f28 expref: 1358 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.521818:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.521829:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396292480 00000100:00100000:0.0:1651529344.521829:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.521832:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e8fe7f95/0x3234de053c4effa lrc: 4/0,0 mode: PR/PR res: [0x2b5f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d727e expref: 1359 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.521843:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396292608 00010000:00010000:1.0:1651529344.521845:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000d53dc4d/0x3234de053c4d416 lrc: 5/0,0 mode: PR/PR res: [0x2b5fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0238 expref: 1360 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.521850:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396292416 00010000:00010000:1.0:1651529344.521858:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000055480488/0x3234de053c4dcdd lrc: 4/0,0 mode: PR/PR res: [0x2b5fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23fd expref: 1361 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.521858:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a4b486d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996984256:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.521862:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50b7c lrc: 3/0,1 mode: --/PW res: [0x2b5fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.521864:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396292544 00010000:00010000:1.0:1651529344.521866:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004a37fa99/0x3234de053c4befa lrc: 4/0,0 mode: PR/PR res: [0x2b5fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6f0 expref: 1362 pid: 80281 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.521869:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946412032 00000100:00100000:1.0:1651529344.521871:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11990 00000100:00100000:1.0:1651529344.521873:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1362:41279:x1731746396292352:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.521876:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.521876:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211215 00010000:00010000:1.0:1651529344.521877:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000004350674/0x3234de053c4ef52 lrc: 5/0,0 mode: PR/PR res: [0x2b5f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f28 expref: 1362 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.521878:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+709:39030:x1731745946412032:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.521881:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000004350674/0x3234de053c4ef52 lrc: 4/0,0 mode: PR/PR res: [0x2b5f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f28 expref: 1362 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:0.0:1651529344.521883:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177663 count 1 00010000:00010000:1.0:1651529344.521886:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.521887:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.521887:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50b91 lrc: 3/0,1 mode: --/PW res: [0x2b5ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521888:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50b60 lrc: 3/0,1 mode: PW/PW res: [0x2b5f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521893:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50b60 lrc: 4/0,1 mode: PW/PW res: [0x2b5f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.521894:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005086bd45/0x3234de053c4f3b2 lrc: 2/0,0 mode: PR/PR res: [0x2b5ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8157 expref: 1362 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.521897:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.521898:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.521898:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.521898:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50b91 lrc: 4/0,1 mode: --/PW res: [0x2b5ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.521905:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005086bd45/0x3234de053c4f3b2 lrc: 3/0,0 mode: PR/PR res: [0x2b5ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8157 expref: 1362 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.521907:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1362:41279:x1731746396292352:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 34us (147us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.521909:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005086bd45/0x3234de053c4f3b2 lrc: 4/0,0 mode: PR/PR res: [0x2b5ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8157 expref: 1362 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.521910:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11990 00000100:00100000:1.0:1651529344.521914:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11991 00000100:00100000:1.0:1651529344.521916:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1361:41279:x1731746396292480:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.521916:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a4b486d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996984512:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.521918:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.521920:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e8fe7f95/0x3234de053c4effa lrc: 4/0,0 mode: PR/PR res: [0x2b5f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d727e expref: 1361 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.521923:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e8fe7f95/0x3234de053c4effa lrc: 3/0,0 mode: PR/PR res: [0x2b5f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d727e expref: 1361 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.521928:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8fe7f95/0x3234de053c4effa lrc: 0/0,0 mode: --/PR res: [0x2b5f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d727e expref: 1361 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.521930:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000abca413e going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.521931:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.521931:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.521932:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50b6e lrc: 3/0,1 mode: PW/PW res: [0x2b5f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521935:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50b6e lrc: 4/0,1 mode: PW/PW res: [0x2b5f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521943:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.521943:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009b8db73b pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996984448:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.521947:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1360:41279:x1731746396292480:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 31us (162us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.521948:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50b83 lrc: 3/0,1 mode: --/PW res: [0x2b5fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.521950:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11991 00000100:00100000:1.0:1651529344.521953:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11992 00000100:00100000:1.0:1651529344.521955:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1359:41279:x1731746396292608:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.521957:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.521958:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000d53dc4d/0x3234de053c4d416 lrc: 4/0,0 mode: PR/PR res: [0x2b5fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0238 expref: 1359 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.521961:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000d53dc4d/0x3234de053c4d416 lrc: 3/0,0 mode: PR/PR res: [0x2b5fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0238 expref: 1359 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.521966:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d53dc4d/0x3234de053c4d416 lrc: 0/0,0 mode: --/PR res: [0x2b5fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0238 expref: 1359 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.521969:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.521970:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.521970:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50b7c lrc: 3/0,1 mode: PW/PW res: [0x2b5fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521973:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50b7c lrc: 4/0,1 mode: PW/PW res: [0x2b5fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521983:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.521987:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1358:41279:x1731746396292608:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 32us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.521990:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11992 00010000:00010000:0.0:1651529344.521990:0:156655:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004350674/0x3234de053c4ef52 lrc: 0/0,0 mode: --/PR res: [0x2b5f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f28 expref: 1358 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.521994:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11993 00000100:00100000:0.0:1651529344.521995:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dfef64e7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996984064:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.521996:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1356:41278:x1731746396292416:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.521998:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.521998:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50b60 lrc: 3/0,1 mode: PW/PW res: [0x2b5f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.521999:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000055480488/0x3234de053c4dcdd lrc: 4/0,0 mode: PR/PR res: [0x2b5fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23fd expref: 1356 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.522002:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50b60 lrc: 3/0,1 mode: PW/PW res: [0x2b5f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522003:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000055480488/0x3234de053c4dcdd lrc: 3/0,0 mode: PR/PR res: [0x2b5fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23fd expref: 1356 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.522004:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50b60 lrc: 3/0,1 mode: PW/PW res: [0x2b5f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522008:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055480488/0x3234de053c4dcdd lrc: 0/0,0 mode: --/PR res: [0x2b5fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23fd expref: 1356 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.522008:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50b60 lrc: 3/0,1 mode: PW/PW res: [0x2b5f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522010:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50b60 lrc: 2/0,0 mode: PW/PW res: [0x2b5f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522011:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.522011:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.522012:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50b67 lrc: 3/0,1 mode: PW/PW res: [0x2b5fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522015:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50b67 lrc: 4/0,1 mode: PW/PW res: [0x2b5fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522027:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.522032:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1355:41278:x1731746396292416:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.522034:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11993 00000100:00100000:1.0:1651529344.522038:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11994 00000100:00100000:1.0:1651529344.522040:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050ef6a3e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1354:41278:x1731746396292544:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.522042:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.522043:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004a37fa99/0x3234de053c4befa lrc: 4/0,0 mode: PR/PR res: [0x2b5fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6f0 expref: 1354 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.522047:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004a37fa99/0x3234de053c4befa lrc: 3/0,0 mode: PR/PR res: [0x2b5fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6f0 expref: 1354 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.522051:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a37fa99/0x3234de053c4befa lrc: 0/0,0 mode: --/PR res: [0x2b5fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6f0 expref: 1354 pid: 80281 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.522054:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+710:39030:x1731745946411392:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 955us (1031us total) trans 12885079263 rc 0/0 00010000:00010000:1.0:1651529344.522055:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.522055:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.522056:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50b75 lrc: 3/0,1 mode: PW/PW res: [0x2b5fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.522057:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211208 00010000:00010000:1.0:1651529344.522059:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50b75 lrc: 4/0,1 mode: PW/PW res: [0x2b5fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522064:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.522065:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50b7c lrc: 3/0,1 mode: PW/PW res: [0x2b5fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522068:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50b7c lrc: 3/0,1 mode: PW/PW res: [0x2b5fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.522069:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050ef6a3e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1353:41278:x1731746396292544:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 28us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.522071:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11994 00010000:00010000:0.0:1651529344.522071:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50b7c lrc: 3/0,1 mode: PW/PW res: [0x2b5fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522074:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50b7c lrc: 2/0,0 mode: PW/PW res: [0x2b5fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.522083:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dfc79d4e pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996984384:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.522087:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50b8a lrc: 3/0,1 mode: --/PW res: [0x2b5fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522095:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50b6e lrc: 3/0,1 mode: PW/PW res: [0x2b5f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522098:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50b6e lrc: 3/0,1 mode: PW/PW res: [0x2b5f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522101:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50b6e lrc: 3/0,1 mode: PW/PW res: [0x2b5f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522103:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50b6e lrc: 2/0,0 mode: PW/PW res: [0x2b5f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.522110:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+710:39030:x1731745946411456:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 899us (1038us total) trans 12885079264 rc 0/0 00000100:00100000:0.0:1651529344.522120:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211211 00010000:00010000:0.0:1651529344.522127:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50b60 lrc: 2/0,0 mode: PW/PW res: [0x2b5f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522131:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000827909ec already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.522132:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50b60 lrc: 2/0,0 mode: PW/PW res: [0x2b5f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522135:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50b60 lrc: 3/0,0 mode: PW/PW res: [0x2b5f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522139:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50b60 lrc: 1/0,0 mode: --/PW res: [0x2b5f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522142:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50b60 lrc: 0/0,0 mode: --/PW res: [0x2b5f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522147:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50b7c lrc: 2/0,0 mode: PW/PW res: [0x2b5fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.522148:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+710:39030:x1731745946411328:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 969us (1086us total) trans 12885079265 rc 0/0 00010000:00010000:0.0:1651529344.522149:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009880d77c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.522150:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50b7c lrc: 2/0,0 mode: PW/PW res: [0x2b5fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.522151:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211210 00010000:00010000:0.0:1651529344.522155:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50b7c lrc: 3/0,0 mode: PW/PW res: [0x2b5fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522159:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50b6e lrc: 2/0,0 mode: PW/PW res: [0x2b5f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522159:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50b7c lrc: 1/0,0 mode: --/PW res: [0x2b5fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522161:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50b7c lrc: 0/0,0 mode: --/PW res: [0x2b5fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522162:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054065c33 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.522163:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50b6e lrc: 2/0,0 mode: PW/PW res: [0x2b5f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522166:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50b6e lrc: 3/0,0 mode: PW/PW res: [0x2b5f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522170:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50b6e lrc: 1/0,0 mode: --/PW res: [0x2b5f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522173:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50b6e lrc: 0/0,0 mode: --/PW res: [0x2b5f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.522176:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.522179:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50b75 lrc: 3/0,1 mode: PW/PW res: [0x2b5fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522182:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50b75 lrc: 3/0,1 mode: PW/PW res: [0x2b5fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522185:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50b75 lrc: 3/0,1 mode: PW/PW res: [0x2b5fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522188:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50b75 lrc: 2/0,0 mode: PW/PW res: [0x2b5fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.522191:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.522257:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+710:39030:x1731745946411584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1034us (1178us total) trans 12885079266 rc 0/0 00000100:00100000:1.0:1651529344.522260:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211212 00000100:00100000:1.0:1651529344.522286:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396292672 00010000:00010000:1.0:1651529344.522296:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000041f92a8a/0x3234de053c4ee6b lrc: 4/0,0 mode: PR/PR res: [0x2b5fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ba8 expref: 1353 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.522300:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50b75 lrc: 2/0,0 mode: PW/PW res: [0x2b5fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.522304:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396292736 00010000:00010000:0.0:1651529344.522305:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000048b51e47 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.522306:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c4ecc7 lrc: 4/0,0 mode: PR/PR res: [0x2b5fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d650a expref: 1354 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.522306:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50b75 lrc: 2/0,0 mode: PW/PW res: [0x2b5fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522308:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50b75 lrc: 3/0,0 mode: PW/PW res: [0x2b5fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.522311:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11995 00000100:00100000:1.0:1651529344.522313:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1354:41279:x1731746396292672:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.522313:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50b75 lrc: 1/0,0 mode: --/PW res: [0x2b5fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522315:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.522316:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000041f92a8a/0x3234de053c4ee6b lrc: 4/0,0 mode: PR/PR res: [0x2b5fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ba8 expref: 1354 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.522316:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50b75 lrc: 0/0,0 mode: --/PW res: [0x2b5fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522320:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000041f92a8a/0x3234de053c4ee6b lrc: 3/0,0 mode: PR/PR res: [0x2b5fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ba8 expref: 1354 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.522325:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041f92a8a/0x3234de053c4ee6b lrc: 0/0,0 mode: --/PR res: [0x2b5fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ba8 expref: 1354 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.522326:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11996 00000100:00100000:0.0:1651529344.522328:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1354:41279:x1731746396292736:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.522329:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.522329:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.522330:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50b8a lrc: 3/0,1 mode: PW/PW res: [0x2b5fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522332:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.522333:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50b8a lrc: 4/0,1 mode: PW/PW res: [0x2b5fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522334:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c4ecc7 lrc: 4/0,0 mode: PR/PR res: [0x2b5fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d650a expref: 1353 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.522338:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c4ecc7 lrc: 3/0,0 mode: PR/PR res: [0x2b5fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d650a expref: 1353 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.522340:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.522342:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c4ecc7 lrc: 0/0,0 mode: --/PR res: [0x2b5fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d650a expref: 1353 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.522346:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.522347:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.522348:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50b83 lrc: 3/0,1 mode: PW/PW res: [0x2b5fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.522351:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1352:41279:x1731746396292672:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.522354:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11995 00010000:00010000:1.0:1651529344.522360:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50b8a lrc: 3/0,1 mode: PW/PW res: [0x2b5fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522363:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50b8a lrc: 3/0,1 mode: PW/PW res: [0x2b5fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522369:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50b8a lrc: 3/0,1 mode: PW/PW res: [0x2b5fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522371:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50b8a lrc: 2/0,0 mode: PW/PW res: [0x2b5fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522371:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50b83 lrc: 4/0,1 mode: PW/PW res: [0x2b5fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522384:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.522392:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1351:41279:x1731746396292736:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 64us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.522395:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11996 00010000:00010000:0.0:1651529344.522403:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50b8a lrc: 2/0,0 mode: PW/PW res: [0x2b5fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522408:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e0e037e6 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.522409:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ea32140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+710:39029:x1731745946411712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1018us (1075us total) trans 12885079267 rc 0/0 00010000:00010000:0.0:1651529344.522409:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50b8a lrc: 2/0,0 mode: PW/PW res: [0x2b5fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.522412:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211214 00010000:00010000:0.0:1651529344.522412:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50b8a lrc: 3/0,0 mode: PW/PW res: [0x2b5fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522416:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50b8a lrc: 1/0,0 mode: --/PW res: [0x2b5fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522419:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50b67 lrc: 3/0,1 mode: PW/PW res: [0x2b5fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522422:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50b67 lrc: 3/0,1 mode: PW/PW res: [0x2b5fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522425:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50b67 lrc: 3/0,1 mode: PW/PW res: [0x2b5fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522428:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50b67 lrc: 2/0,0 mode: PW/PW res: [0x2b5fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522442:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50b8a lrc: 0/0,0 mode: --/PW res: [0x2b5fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522455:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50b67 lrc: 2/0,0 mode: PW/PW res: [0x2b5fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522457:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003a73c8ff already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.522458:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50b67 lrc: 2/0,0 mode: PW/PW res: [0x2b5fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.522459:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+710:39030:x1731745946411520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1339us (1405us total) trans 12885079268 rc 0/0 00010000:00010000:0.0:1651529344.522461:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50b67 lrc: 3/0,0 mode: PW/PW res: [0x2b5fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.522462:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211209 00010000:00010000:0.0:1651529344.522465:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50b67 lrc: 1/0,0 mode: --/PW res: [0x2b5fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522468:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50b67 lrc: 0/0,0 mode: --/PW res: [0x2b5fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522474:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50b83 lrc: 3/0,1 mode: PW/PW res: [0x2b5fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522477:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50b83 lrc: 3/0,1 mode: PW/PW res: [0x2b5fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522480:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50b83 lrc: 3/0,1 mode: PW/PW res: [0x2b5fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522483:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50b83 lrc: 2/0,0 mode: PW/PW res: [0x2b5fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.522499:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.522529:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+710:39029:x1731745946411648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1141us (1206us total) trans 12885079269 rc 0/0 00000100:00100000:0.0:1651529344.522532:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211213 00000100:00100000:1.0:1651529344.522533:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.522539:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946412288 00000100:00100000:0.0:1651529344.522565:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946412352 00000100:00100000:1.0:1651529344.522568:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.522574:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211216 00000100:00100000:0.0:1651529344.522575:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000607f68ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+711:39030:x1731745946412288:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.522580:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177664 count 1 00010000:00010000:0.0:1651529344.522585:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50b98 lrc: 3/0,1 mode: --/PW res: [0x2b600:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.522586:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.522595:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003df63e66/0x3234de053c4e5ff lrc: 2/0,0 mode: PR/PR res: [0x2b600:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d493b expref: 1350 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.522601:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.522602:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.522602:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50b98 lrc: 4/0,1 mode: --/PW res: [0x2b600:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522610:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003df63e66/0x3234de053c4e5ff lrc: 3/0,0 mode: PR/PR res: [0x2b600:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d493b expref: 1350 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.522613:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003df63e66/0x3234de053c4e5ff lrc: 4/0,0 mode: PR/PR res: [0x2b600:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d493b expref: 1350 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.522617:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996984576:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.522618:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.522628:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946412416 00000100:00100000:0.0:1651529344.522639:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 000000003c8b0daf going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.522640:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946412480 00000100:00100000:1.0:1651529344.522647:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211217 00010000:00010000:0.0:1651529344.522648:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50b83 lrc: 2/0,0 mode: PW/PW res: [0x2b5fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.522649:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+713:39029:x1731745946412352:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.522654:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177665 count 1 00010000:00010000:1.0:1651529344.522659:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50b9f lrc: 3/0,1 mode: --/PW res: [0x2b601:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522663:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f192428c/0x3234de053c4f3e3 lrc: 2/0,0 mode: PR/PR res: [0x2b601:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8206 expref: 1350 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.522665:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d9ada8a3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.522666:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50b83 lrc: 2/0,0 mode: PW/PW res: [0x2b5fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522667:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.522667:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.522668:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50b9f lrc: 4/0,1 mode: --/PW res: [0x2b601:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522669:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50b83 lrc: 3/0,0 mode: PW/PW res: [0x2b5fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522674:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50b83 lrc: 1/0,0 mode: --/PW res: [0x2b5fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522675:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f192428c/0x3234de053c4f3e3 lrc: 3/0,0 mode: PR/PR res: [0x2b601:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8206 expref: 1350 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.522678:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f192428c/0x3234de053c4f3e3 lrc: 4/0,0 mode: PR/PR res: [0x2b601:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8206 expref: 1350 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.522679:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50b83 lrc: 0/0,0 mode: --/PW res: [0x2b5fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.522682:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000703c0db9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996984640:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.522688:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211218 00000100:00100000:0.0:1651529344.522690:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+713:39030:x1731745946412416:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.522691:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 000000007d8fabda going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.522695:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177666 count 1 00000100:00100000:1.0:1651529344.522698:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211219 00010000:00010000:0.0:1651529344.522698:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50ba6 lrc: 3/0,1 mode: --/PW res: [0x2b602:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.522700:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfc79d4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+713:39029:x1731745946412480:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.522703:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000038b82db3/0x3234de053c4dc7b lrc: 2/0,0 mode: PR/PR res: [0x2b602:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d220c expref: 1350 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.522704:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177667 count 1 00010000:00010000:0.0:1651529344.522706:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.522706:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.522707:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50bad lrc: 3/0,1 mode: --/PW res: [0x2b603:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522707:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50ba6 lrc: 4/0,1 mode: --/PW res: [0x2b602:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522712:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cd0e6a75/0x3234de053c4ee9c lrc: 2/0,0 mode: PR/PR res: [0x2b603:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c5e expref: 1350 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.522713:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000038b82db3/0x3234de053c4dc7b lrc: 3/0,0 mode: PR/PR res: [0x2b602:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d220c expref: 1350 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.522714:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.522715:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.522715:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50bad lrc: 4/0,1 mode: --/PW res: [0x2b603:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522717:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000038b82db3/0x3234de053c4dc7b lrc: 4/0,0 mode: PR/PR res: [0x2b602:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d220c expref: 1350 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.522721:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996984704:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.522722:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cd0e6a75/0x3234de053c4ee9c lrc: 3/0,0 mode: PR/PR res: [0x2b603:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c5e expref: 1350 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.522726:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cd0e6a75/0x3234de053c4ee9c lrc: 4/0,0 mode: PR/PR res: [0x2b603:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c5e expref: 1350 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.522729:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000de0edbdc pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996984768:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.522729:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000008dd99533 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.522744:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000567ee0ef going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.522748:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a4b486d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996984512:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.522752:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396293312 00010000:00010000:0.0:1651529344.522752:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50b91 lrc: 3/0,1 mode: --/PW res: [0x2b5ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522757:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005086bd45/0x3234de053c4f3b2 lrc: 4/0,0 mode: PR/PR res: [0x2b5ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8157 expref: 1351 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.522764:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11997 00000100:00100000:1.0:1651529344.522766:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1351:41278:x1731746396293312:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.522770:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.522771:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005086bd45/0x3234de053c4f3b2 lrc: 4/0,0 mode: PR/PR res: [0x2b5ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8157 expref: 1351 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.522774:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005086bd45/0x3234de053c4f3b2 lrc: 3/0,0 mode: PR/PR res: [0x2b5ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8157 expref: 1351 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.522780:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005086bd45/0x3234de053c4f3b2 lrc: 0/0,0 mode: --/PR res: [0x2b5ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8157 expref: 1351 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.522783:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.522784:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.522785:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50b91 lrc: 3/0,1 mode: PW/PW res: [0x2b5ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522788:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50b91 lrc: 4/0,1 mode: PW/PW res: [0x2b5ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.522799:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.522806:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.522813:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1350:41278:x1731746396293312:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 47us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.522816:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11997 00000100:00100000:0.0:1651529344.522818:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.522828:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.522838:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50b91 lrc: 3/0,1 mode: PW/PW res: [0x2b5ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522842:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50b91 lrc: 3/0,1 mode: PW/PW res: [0x2b5ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522845:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50b91 lrc: 3/0,1 mode: PW/PW res: [0x2b5ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522848:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50b91 lrc: 2/0,0 mode: PW/PW res: [0x2b5ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.522880:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946412608 00000100:00100000:1.0:1651529344.522887:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211220 00000100:00100000:1.0:1651529344.522888:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+715:39029:x1731745946412608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.522893:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177668 count 1 00010000:00010000:1.0:1651529344.522897:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c50bb4 lrc: 3/0,1 mode: --/PW res: [0x2b604:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522902:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d728c5bd/0x3234de053c4c81c lrc: 2/0,0 mode: PR/PR res: [0x2b604:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd2a4 expref: 1349 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.522905:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.522906:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.522907:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c50bb4 lrc: 4/0,1 mode: --/PW res: [0x2b604:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.522908:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+715:39030:x1731745946412032:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1029us (1113us total) trans 12885079270 rc 0/0 00000100:00100000:0.0:1651529344.522912:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211215 00010000:00010000:1.0:1651529344.522913:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d728c5bd/0x3234de053c4c81c lrc: 3/0,0 mode: PR/PR res: [0x2b604:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd2a4 expref: 1349 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.522916:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d728c5bd/0x3234de053c4c81c lrc: 4/0,0 mode: PR/PR res: [0x2b604:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd2a4 expref: 1349 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.522917:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946412672 00000100:00100000:1.0:1651529344.522920:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e124baf1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996984832:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.522923:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946412736 00000100:00100000:0.0:1651529344.522931:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211221 00000100:00100000:0.0:1651529344.522933:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+716:39030:x1731745946412672:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.522937:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c3caa148 going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.522938:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177669 count 1 00010000:00010000:1.0:1651529344.522942:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50b91 lrc: 2/0,0 mode: PW/PW res: [0x2b5ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522942:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50bbb lrc: 3/0,1 mode: --/PW res: [0x2b605:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522945:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cdc65e28 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.522946:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50b91 lrc: 2/0,0 mode: PW/PW res: [0x2b5ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522947:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c4c6c5 lrc: 2/0,0 mode: PR/PR res: [0x2b605:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd17 expref: 1349 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.522949:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50b91 lrc: 3/0,0 mode: PW/PW res: [0x2b5ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522950:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.522951:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.522952:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50bbb lrc: 4/0,1 mode: --/PW res: [0x2b605:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522954:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50b91 lrc: 1/0,0 mode: --/PW res: [0x2b5ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522957:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50b91 lrc: 0/0,0 mode: --/PW res: [0x2b5ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.522958:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c4c6c5 lrc: 3/0,0 mode: PR/PR res: [0x2b605:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd17 expref: 1349 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.522962:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c4c6c5 lrc: 4/0,0 mode: PR/PR res: [0x2b605:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd17 expref: 1349 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.522964:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211222 00000100:00100000:1.0:1651529344.522966:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+716:39029:x1731745946412736:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.522966:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c43262d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996984896:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.522970:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177670 count 1 00010000:00010000:1.0:1651529344.522973:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004645bf7f/0x3234de053c50bc2 lrc: 3/0,1 mode: --/PW res: [0x2b606:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.522975:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000504ef660 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.522977:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c7e7b73f/0x3234de053c4e064 lrc: 2/0,0 mode: PR/PR res: [0x2b606:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3251 expref: 1349 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.522980:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.522981:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.522982:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004645bf7f/0x3234de053c50bc2 lrc: 4/0,1 mode: --/PW res: [0x2b606:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.522988:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c7e7b73f/0x3234de053c4e064 lrc: 3/0,0 mode: PR/PR res: [0x2b606:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3251 expref: 1349 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.522991:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c7e7b73f/0x3234de053c4e064 lrc: 4/0,0 mode: PR/PR res: [0x2b606:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3251 expref: 1349 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.522995:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b0d9532a pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996984960:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.523012:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b7af823 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.523070:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996984576:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.523074:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50b98 lrc: 3/0,1 mode: --/PW res: [0x2b600:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.523084:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996984704:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.523087:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000703c0db9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996984640:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.523087:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50ba6 lrc: 3/0,1 mode: --/PW res: [0x2b602:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.523092:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50b9f lrc: 3/0,1 mode: --/PW res: [0x2b601:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.523146:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.523157:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946413056 00000100:00100000:1.0:1651529344.523167:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211223 00000100:00100000:1.0:1651529344.523168:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+717:39029:x1731745946413056:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.523173:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177671 count 1 00010000:00010000:1.0:1651529344.523177:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50bc9 lrc: 3/0,1 mode: --/PW res: [0x2b607:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.523181:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000065135a2e/0x3234de053c4de0a lrc: 2/0,0 mode: PR/PR res: [0x2b607:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d292f expref: 1349 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.523184:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.523185:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.523186:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50bc9 lrc: 4/0,1 mode: --/PW res: [0x2b607:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.523192:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000065135a2e/0x3234de053c4de0a lrc: 3/0,0 mode: PR/PR res: [0x2b607:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d292f expref: 1349 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.523195:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000065135a2e/0x3234de053c4de0a lrc: 4/0,0 mode: PR/PR res: [0x2b607:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d292f expref: 1349 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.523199:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e5997468 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996985024:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.523210:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd96f074 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.523311:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000de0edbdc pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996984768:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.523311:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.523321:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50bad lrc: 3/0,1 mode: --/PW res: [0x2b603:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.523328:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396293376 00010000:00010000:1.0:1651529344.523333:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003df63e66/0x3234de053c4e5ff lrc: 4/0,0 mode: PR/PR res: [0x2b600:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d493b expref: 1350 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.523340:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11998 00000100:00100000:1.0:1651529344.523342:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1350:41279:x1731746396293376:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.523344:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.523346:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003df63e66/0x3234de053c4e5ff lrc: 4/0,0 mode: PR/PR res: [0x2b600:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d493b expref: 1350 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.523349:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003df63e66/0x3234de053c4e5ff lrc: 3/0,0 mode: PR/PR res: [0x2b600:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d493b expref: 1350 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.523354:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003df63e66/0x3234de053c4e5ff lrc: 0/0,0 mode: --/PR res: [0x2b600:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d493b expref: 1350 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.523358:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.523359:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.523359:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50b98 lrc: 3/0,1 mode: PW/PW res: [0x2b600:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.523362:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50b98 lrc: 4/0,1 mode: PW/PW res: [0x2b600:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.523386:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.523390:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50b98 lrc: 3/0,1 mode: PW/PW res: [0x2b600:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.523394:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50b98 lrc: 3/0,1 mode: PW/PW res: [0x2b600:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.523396:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1349:41279:x1731746396293376:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 54us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.523399:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11998 00010000:00010000:0.0:1651529344.523402:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50b98 lrc: 3/0,1 mode: PW/PW res: [0x2b600:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.523405:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50b98 lrc: 2/0,0 mode: PW/PW res: [0x2b600:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.523414:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.523448:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.523448:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000607f68ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+718:39030:x1731745946412288:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 872us (949us total) trans 12885079271 rc 0/0 00000100:00100000:0.0:1651529344.523451:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211216 00010000:00010000:0.0:1651529344.523470:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50b98 lrc: 2/0,0 mode: PW/PW res: [0x2b600:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.523474:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eb50e2ae already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.523475:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50b98 lrc: 2/0,0 mode: PW/PW res: [0x2b600:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.523478:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.523506:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e124baf1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996984832:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.523511:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50b98 lrc: 3/0,0 mode: PW/PW res: [0x2b600:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.523515:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c50bb4 lrc: 3/0,1 mode: --/PW res: [0x2b604:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.523523:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b0d9532a pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996984960:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.523525:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50b98 lrc: 1/0,0 mode: --/PW res: [0x2b600:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.523526:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004645bf7f/0x3234de053c50bc2 lrc: 3/0,1 mode: --/PW res: [0x2b606:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.523530:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50b98 lrc: 0/0,0 mode: --/PW res: [0x2b600:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.523531:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396293440 00010000:00010000:1.0:1651529344.523535:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f192428c/0x3234de053c4f3e3 lrc: 4/0,0 mode: PR/PR res: [0x2b601:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8206 expref: 1349 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.523541:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396293504 00000100:00100000:0.0:1651529344.523542:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c43262d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996984896:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.523543:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000038b82db3/0x3234de053c4dc7b lrc: 4/0,0 mode: PR/PR res: [0x2b602:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d220c expref: 1350 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.523545:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50bbb lrc: 3/0,1 mode: --/PW res: [0x2b605:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.523548:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396293568 00010000:00010000:1.0:1651529344.523550:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cd0e6a75/0x3234de053c4ee9c lrc: 4/0,0 mode: PR/PR res: [0x2b603:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c5e expref: 1351 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.523552:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11999 00000100:00100000:0.0:1651529344.523554:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1351:41278:x1731746396293440:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.523555:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12000 00000100:00100000:1.0:1651529344.523557:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1351:41279:x1731746396293504:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.523558:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.523560:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.523560:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f192428c/0x3234de053c4f3e3 lrc: 4/0,0 mode: PR/PR res: [0x2b601:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8206 expref: 1351 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.523561:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000038b82db3/0x3234de053c4dc7b lrc: 4/0,0 mode: PR/PR res: [0x2b602:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d220c expref: 1351 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.523563:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f192428c/0x3234de053c4f3e3 lrc: 3/0,0 mode: PR/PR res: [0x2b601:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8206 expref: 1351 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.523565:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000038b82db3/0x3234de053c4dc7b lrc: 3/0,0 mode: PR/PR res: [0x2b602:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d220c expref: 1351 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.523568:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f192428c/0x3234de053c4f3e3 lrc: 0/0,0 mode: --/PR res: [0x2b601:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8206 expref: 1351 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.523570:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038b82db3/0x3234de053c4dc7b lrc: 0/0,0 mode: --/PR res: [0x2b602:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d220c expref: 1351 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.523572:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.523573:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.523573:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.523574:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.523574:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50b9f lrc: 3/0,1 mode: PW/PW res: [0x2b601:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.523575:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50ba6 lrc: 3/0,1 mode: PW/PW res: [0x2b602:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.523577:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50b9f lrc: 4/0,1 mode: PW/PW res: [0x2b601:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.523578:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50ba6 lrc: 4/0,1 mode: PW/PW res: [0x2b602:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.523591:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.523591:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.523599:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1349:41279:x1731746396293504:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 41us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.523601:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12000 00000100:00100000:1.0:1651529344.523606:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12001 00000100:00100000:1.0:1651529344.523608:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cd5e5a1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1348:41278:x1731746396293568:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.523610:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.523611:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cd0e6a75/0x3234de053c4ee9c lrc: 4/0,0 mode: PR/PR res: [0x2b603:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c5e expref: 1348 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.523614:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1348:41278:x1731746396293440:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 59us (200us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.523615:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cd0e6a75/0x3234de053c4ee9c lrc: 3/0,0 mode: PR/PR res: [0x2b603:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c5e expref: 1348 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.523618:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11999 00010000:00010000:1.0:1651529344.523620:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd0e6a75/0x3234de053c4ee9c lrc: 0/0,0 mode: --/PR res: [0x2b603:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c5e expref: 1348 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.523623:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.523624:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.523625:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50bad lrc: 3/0,1 mode: PW/PW res: [0x2b603:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.523625:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50ba6 lrc: 3/0,1 mode: PW/PW res: [0x2b602:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.523627:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50bad lrc: 4/0,1 mode: PW/PW res: [0x2b603:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.523629:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50ba6 lrc: 3/0,1 mode: PW/PW res: [0x2b602:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.523632:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50ba6 lrc: 3/0,1 mode: PW/PW res: [0x2b602:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.523633:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.523635:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50ba6 lrc: 2/0,0 mode: PW/PW res: [0x2b602:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.523638:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cd5e5a1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1346:41278:x1731746396293568:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 30us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.523640:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12001 00010000:00010000:1.0:1651529344.523650:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50b9f lrc: 3/0,1 mode: PW/PW res: [0x2b601:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.523653:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50b9f lrc: 3/0,1 mode: PW/PW res: [0x2b601:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.523658:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50b9f lrc: 3/0,1 mode: PW/PW res: [0x2b601:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.523661:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50b9f lrc: 2/0,0 mode: PW/PW res: [0x2b601:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.523690:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+719:39030:x1731745946412416:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 999us (1104us total) trans 12885079272 rc 0/0 00000100:00100000:0.0:1651529344.523693:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211218 00010000:00010000:0.0:1651529344.523700:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50ba6 lrc: 2/0,0 mode: PW/PW res: [0x2b602:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.523701:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+718:39029:x1731745946412352:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1051us (1167us total) trans 12885079273 rc 0/0 00010000:00010000:0.0:1651529344.523703:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027456046 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.523704:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211217 00010000:00010000:0.0:1651529344.523704:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50ba6 lrc: 2/0,0 mode: PW/PW res: [0x2b602:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.523710:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50ba6 lrc: 3/0,0 mode: PW/PW res: [0x2b602:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.523711:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50b9f lrc: 2/0,0 mode: PW/PW res: [0x2b601:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.523714:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000002904524 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.523714:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50ba6 lrc: 1/0,0 mode: --/PW res: [0x2b602:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.523715:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50b9f lrc: 2/0,0 mode: PW/PW res: [0x2b601:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.523717:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50ba6 lrc: 0/0,0 mode: --/PW res: [0x2b602:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.523718:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50b9f lrc: 3/0,0 mode: PW/PW res: [0x2b601:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.523722:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50b9f lrc: 1/0,0 mode: --/PW res: [0x2b601:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.523725:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50b9f lrc: 0/0,0 mode: --/PW res: [0x2b601:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.523731:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50bad lrc: 3/0,1 mode: PW/PW res: [0x2b603:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.523749:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50bad lrc: 3/0,1 mode: PW/PW res: [0x2b603:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.523750:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.523753:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50bad lrc: 3/0,1 mode: PW/PW res: [0x2b603:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.523761:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50bad lrc: 2/0,0 mode: PW/PW res: [0x2b603:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.523775:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.523789:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.523814:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.523821:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfc79d4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+718:39029:x1731745946412480:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1112us (1195us total) trans 12885079274 rc 0/0 00000100:00100000:1.0:1651529344.523824:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211219 00000100:00100000:1.0:1651529344.523829:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946413184 00000100:00100000:1.0:1651529344.523857:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211224 00000100:00100000:1.0:1651529344.523859:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+718:39029:x1731745946413184:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.523860:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:1.0:1651529344.523864:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177672 count 1 00010000:00010000:0.0:1651529344.523865:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50bad lrc: 2/0,0 mode: PW/PW res: [0x2b603:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.523869:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50bd0 lrc: 3/0,1 mode: --/PW res: [0x2b608:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.523869:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000085580035 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.523870:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50bad lrc: 2/0,0 mode: PW/PW res: [0x2b603:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.523873:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000033b3aab/0x3234de053c4dbda lrc: 2/0,0 mode: PR/PR res: [0x2b608:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f6c expref: 1345 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.523873:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50bad lrc: 3/0,0 mode: PW/PW res: [0x2b603:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.523877:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.523877:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.523878:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50bd0 lrc: 4/0,1 mode: --/PW res: [0x2b608:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.523878:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50bad lrc: 1/0,0 mode: --/PW res: [0x2b603:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.523887:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000033b3aab/0x3234de053c4dbda lrc: 3/0,0 mode: PR/PR res: [0x2b608:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f6c expref: 1345 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.523890:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000033b3aab/0x3234de053c4dbda lrc: 4/0,0 mode: PR/PR res: [0x2b608:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f6c expref: 1345 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.523894:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae466fbb pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996985088:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.523898:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50bad lrc: 0/0,0 mode: --/PW res: [0x2b603:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.523909:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000567ee0ef going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.523912:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396293696 00000100:00100000:1.0:1651529344.523916:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396293760 00010000:00010000:0.0:1651529344.523918:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d728c5bd/0x3234de053c4c81c lrc: 4/0,0 mode: PR/PR res: [0x2b604:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd2a4 expref: 1347 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.523920:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c4c6c5 lrc: 4/0,0 mode: PR/PR res: [0x2b605:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd17 expref: 1347 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.523923:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396293824 00010000:00010000:0.0:1651529344.523925:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c7e7b73f/0x3234de053c4e064 lrc: 4/0,0 mode: PR/PR res: [0x2b606:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3251 expref: 1348 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.523926:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396293888 00010000:00010000:1.0:1651529344.523928:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000065135a2e/0x3234de053c4de0a lrc: 5/0,0 mode: PR/PR res: [0x2b607:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d292f expref: 1349 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.523931:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12002 00000100:00100000:0.0:1651529344.523933:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1349:41278:x1731746396293696:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.523934:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12003 00000100:00100000:1.0:1651529344.523935:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1349:41279:x1731746396293760:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.523935:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.523937:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d728c5bd/0x3234de053c4c81c lrc: 4/0,0 mode: PR/PR res: [0x2b604:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd2a4 expref: 1349 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.523938:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.523939:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c4c6c5 lrc: 4/0,0 mode: PR/PR res: [0x2b605:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd17 expref: 1349 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.523941:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d728c5bd/0x3234de053c4c81c lrc: 3/0,0 mode: PR/PR res: [0x2b604:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd2a4 expref: 1349 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.523943:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c4c6c5 lrc: 3/0,0 mode: PR/PR res: [0x2b605:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd17 expref: 1349 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.523945:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d728c5bd/0x3234de053c4c81c lrc: 0/0,0 mode: --/PR res: [0x2b604:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd2a4 expref: 1349 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.523949:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.523950:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.523950:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c50bb4 lrc: 3/0,1 mode: PW/PW res: [0x2b604:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.523951:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c4c6c5 lrc: 0/0,0 mode: --/PR res: [0x2b605:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd17 expref: 1348 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.523954:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.523954:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c50bb4 lrc: 4/0,1 mode: PW/PW res: [0x2b604:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.523955:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.523956:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50bbb lrc: 3/0,1 mode: PW/PW res: [0x2b605:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.523959:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50bbb lrc: 4/0,1 mode: PW/PW res: [0x2b605:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.523964:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.523973:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.523977:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1347:41278:x1731746396293696:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 38us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.523980:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1347:41279:x1731746396293760:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 44us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.523980:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12002 00000100:00100000:1.0:1651529344.523983:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12003 00000100:00100000:0.0:1651529344.523985:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12004 00000100:00100000:0.0:1651529344.523987:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1345:41278:x1731746396293824:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.523988:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12005 00010000:00010000:0.0:1651529344.523989:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.523990:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1345:41278:x1731746396293888:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.523991:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c7e7b73f/0x3234de053c4e064 lrc: 4/0,0 mode: PR/PR res: [0x2b606:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3251 expref: 1345 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.523992:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.523993:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000065135a2e/0x3234de053c4de0a lrc: 5/0,0 mode: PR/PR res: [0x2b607:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d292f expref: 1345 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.523997:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000065135a2e/0x3234de053c4de0a lrc: 4/0,0 mode: PR/PR res: [0x2b607:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d292f expref: 1345 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.524001:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.524002:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.524003:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50bc9 lrc: 3/0,1 mode: PW/PW res: [0x2b607:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524006:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50bc9 lrc: 4/0,1 mode: PW/PW res: [0x2b607:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524008:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c7e7b73f/0x3234de053c4e064 lrc: 3/0,0 mode: PR/PR res: [0x2b606:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3251 expref: 1345 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.524010:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.524014:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1345:41278:x1731746396293888:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 24us (154us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.524014:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7e7b73f/0x3234de053c4e064 lrc: 0/0,0 mode: --/PR res: [0x2b606:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3251 expref: 1345 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.524016:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12005 00010000:00010000:0.0:1651529344.524017:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.524018:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.524019:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004645bf7f/0x3234de053c50bc2 lrc: 3/0,1 mode: PW/PW res: [0x2b606:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524022:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004645bf7f/0x3234de053c50bc2 lrc: 4/0,1 mode: PW/PW res: [0x2b606:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524025:0:72397:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065135a2e/0x3234de053c4de0a lrc: 0/0,0 mode: --/PR res: [0x2b607:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d292f expref: 1343 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.524028:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e5997468 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996985024:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.524034:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.524038:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50bc9 lrc: 3/0,1 mode: PW/PW res: [0x2b607:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524041:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50bc9 lrc: 3/0,1 mode: PW/PW res: [0x2b607:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.524041:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1342:41278:x1731746396293824:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 54us (227us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.524044:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50bc9 lrc: 3/0,1 mode: PW/PW res: [0x2b607:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.524044:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12004 00010000:00010000:1.0:1651529344.524047:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50bc9 lrc: 3/0,1 mode: PW/PW res: [0x2b607:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524050:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50bc9 lrc: 2/0,0 mode: PW/PW res: [0x2b607:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524051:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50bbb lrc: 3/0,1 mode: PW/PW res: [0x2b605:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524054:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50bbb lrc: 3/0,1 mode: PW/PW res: [0x2b605:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524058:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50bbb lrc: 3/0,1 mode: PW/PW res: [0x2b605:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524066:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50bbb lrc: 2/0,0 mode: PW/PW res: [0x2b605:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.524099:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+720:39029:x1731745946413056:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 930us (953us total) trans 12885079275 rc 0/0 00000100:00100000:1.0:1651529344.524103:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211223 00000100:00100000:0.0:1651529344.524108:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+719:39030:x1731745946412672:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1174us (1290us total) trans 12885079276 rc 0/0 00010000:00010000:1.0:1651529344.524110:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004645bf7f/0x3234de053c50bc2 lrc: 3/0,1 mode: PW/PW res: [0x2b606:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.524111:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211221 00010000:00010000:1.0:1651529344.524113:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004645bf7f/0x3234de053c50bc2 lrc: 3/0,1 mode: PW/PW res: [0x2b606:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524116:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004645bf7f/0x3234de053c50bc2 lrc: 3/0,1 mode: PW/PW res: [0x2b606:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524118:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50bc9 lrc: 2/0,0 mode: PW/PW res: [0x2b607:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524119:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004645bf7f/0x3234de053c50bc2 lrc: 2/0,0 mode: PW/PW res: [0x2b606:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524122:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2a2495 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.524123:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50bc9 lrc: 2/0,0 mode: PW/PW res: [0x2b607:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524135:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50bc9 lrc: 3/0,0 mode: PW/PW res: [0x2b607:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524140:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50bc9 lrc: 1/0,0 mode: --/PW res: [0x2b607:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524142:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50bc9 lrc: 0/0,0 mode: --/PW res: [0x2b607:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524147:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50bbb lrc: 2/0,0 mode: PW/PW res: [0x2b605:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524149:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a0607df4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.524150:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50bbb lrc: 2/0,0 mode: PW/PW res: [0x2b605:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524153:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50bbb lrc: 3/0,0 mode: PW/PW res: [0x2b605:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524156:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50bbb lrc: 1/0,0 mode: --/PW res: [0x2b605:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.524157:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+719:39029:x1731745946412736:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1190us (1328us total) trans 12885079277 rc 0/0 00010000:00010000:0.0:1651529344.524158:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50bbb lrc: 0/0,0 mode: --/PW res: [0x2b605:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.524160:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211222 00010000:00010000:0.0:1651529344.524162:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004645bf7f/0x3234de053c50bc2 lrc: 2/0,0 mode: PW/PW res: [0x2b606:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524165:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004645bf7f already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.524166:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c50bb4 lrc: 3/0,1 mode: PW/PW res: [0x2b604:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524166:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004645bf7f/0x3234de053c50bc2 lrc: 2/0,0 mode: PW/PW res: [0x2b606:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524168:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004645bf7f/0x3234de053c50bc2 lrc: 3/0,0 mode: PW/PW res: [0x2b606:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524169:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c50bb4 lrc: 3/0,1 mode: PW/PW res: [0x2b604:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524171:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004645bf7f/0x3234de053c50bc2 lrc: 1/0,0 mode: --/PW res: [0x2b606:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524172:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c50bb4 lrc: 3/0,1 mode: PW/PW res: [0x2b604:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524174:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004645bf7f/0x3234de053c50bc2 lrc: 0/0,0 mode: --/PW res: [0x2b606:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524177:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c50bb4 lrc: 2/0,0 mode: PW/PW res: [0x2b604:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.524205:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.524221:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.524251:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+719:39029:x1731745946412608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1362us (1452us total) trans 12885079278 rc 0/0 00000100:00100000:1.0:1651529344.524254:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211220 00000100:00100000:0.0:1651529344.524254:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.524267:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946413376 00000100:00100000:1.0:1651529344.524275:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946413440 00000100:00100000:1.0:1651529344.524278:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946413504 00000100:00100000:1.0:1651529344.524291:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211225 00000100:00100000:1.0:1651529344.524292:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+721:39029:x1731745946413376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.524297:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177673 count 1 00010000:00010000:1.0:1651529344.524301:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50bd7 lrc: 3/0,1 mode: --/PW res: [0x2b609:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524311:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002cac510f/0x3234de053c4c92d lrc: 2/0,0 mode: PR/PR res: [0x2b609:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd60f expref: 1341 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.524313:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c50bb4 lrc: 2/0,0 mode: PW/PW res: [0x2b604:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524317:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ae53a7c6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.524318:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c50bb4 lrc: 2/0,0 mode: PW/PW res: [0x2b604:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524321:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c50bb4 lrc: 3/0,0 mode: PW/PW res: [0x2b604:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524326:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c50bb4 lrc: 1/0,0 mode: --/PW res: [0x2b604:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524329:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c50bb4 lrc: 0/0,0 mode: --/PW res: [0x2b604:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524333:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.524338:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.524339:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50bd7 lrc: 4/0,1 mode: --/PW res: [0x2b609:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524347:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002cac510f/0x3234de053c4c92d lrc: 3/0,0 mode: PR/PR res: [0x2b609:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd60f expref: 1341 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.524351:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002cac510f/0x3234de053c4c92d lrc: 4/0,0 mode: PR/PR res: [0x2b609:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd60f expref: 1341 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.524351:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211226 00000100:00100000:0.0:1651529344.524352:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+721:39030:x1731745946413440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.524355:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e5997468 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996985152:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.524358:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177674 count 1 00000100:00100000:1.0:1651529344.524369:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 0000000020dd7827 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.524378:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211227 00000100:00100000:1.0:1651529344.524379:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+721:39030:x1731745946413504:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.524379:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50bde lrc: 3/0,1 mode: --/PW res: [0x2b60a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.524384:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177675 count 1 00010000:00010000:0.0:1651529344.524385:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c4dfc3 lrc: 2/0,0 mode: PR/PR res: [0x2b60a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3067 expref: 1341 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.524388:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50be5 lrc: 3/0,1 mode: --/PW res: [0x2b60b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524388:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.524389:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.524389:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50bde lrc: 4/0,1 mode: --/PW res: [0x2b60a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524392:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b19bfe47/0x3234de053c4ec8f lrc: 2/0,0 mode: PR/PR res: [0x2b60b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d63e4 expref: 1341 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.524395:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.524396:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.524397:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50be5 lrc: 4/0,1 mode: --/PW res: [0x2b60b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524397:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c4dfc3 lrc: 3/0,0 mode: PR/PR res: [0x2b60a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3067 expref: 1341 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.524401:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c4dfc3 lrc: 4/0,0 mode: PR/PR res: [0x2b60a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3067 expref: 1341 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.524403:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b19bfe47/0x3234de053c4ec8f lrc: 3/0,0 mode: PR/PR res: [0x2b60b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d63e4 expref: 1341 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.524405:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c43262d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996985216:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.524406:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b19bfe47/0x3234de053c4ec8f lrc: 4/0,0 mode: PR/PR res: [0x2b60b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d63e4 expref: 1341 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.524410:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000de0edbdc pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996985280:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.524414:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aac87b31 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.524417:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c3caa148 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.524529:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae466fbb pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996985088:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.524534:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50bd0 lrc: 3/0,1 mode: --/PW res: [0x2b608:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.524556:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.524566:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.524574:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.524575:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.524583:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946413568 00000100:00100000:0.0:1651529344.524583:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.524593:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946413696 00000100:00100000:1.0:1651529344.524599:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946413632 00000100:00100000:1.0:1651529344.524602:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946413760 00000100:00100000:0.0:1651529344.524610:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211228 00000100:00100000:1.0:1651529344.524612:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211229 00000100:00100000:0.0:1651529344.524612:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+725:39030:x1731745946413568:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.524614:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+725:39030:x1731745946413696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.524618:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177676 count 1 00002000:00080000:1.0:1651529344.524619:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177678 count 1 00010000:00010000:0.0:1651529344.524622:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50bec lrc: 3/0,1 mode: --/PW res: [0x2b60c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524623:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c50bf3 lrc: 3/0,1 mode: --/PW res: [0x2b60e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524627:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd3acf42/0x3234de053c4e01e lrc: 2/0,0 mode: PR/PR res: [0x2b60c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d31a9 expref: 1341 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.524628:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c668d004/0x3234de053c4d70a lrc: 2/0,0 mode: PR/PR res: [0x2b60e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0dc9 expref: 1341 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.524630:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.524631:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.524631:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.524631:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.524632:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c50bf3 lrc: 4/0,1 mode: --/PW res: [0x2b60e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524632:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50bec lrc: 4/0,1 mode: --/PW res: [0x2b60c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524639:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c668d004/0x3234de053c4d70a lrc: 3/0,0 mode: PR/PR res: [0x2b60e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0dc9 expref: 1341 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.524639:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fd3acf42/0x3234de053c4e01e lrc: 3/0,0 mode: PR/PR res: [0x2b60c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d31a9 expref: 1341 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.524642:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c668d004/0x3234de053c4d70a lrc: 4/0,0 mode: PR/PR res: [0x2b60e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0dc9 expref: 1341 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.524642:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fd3acf42/0x3234de053c4e01e lrc: 4/0,0 mode: PR/PR res: [0x2b60c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d31a9 expref: 1341 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.524647:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007fca8239 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996985408:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.524649:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b0d9532a pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996985344:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.524661:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 0000000076b354b3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.524666:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a6b79b05 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.524668:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211230 00000100:00100000:0.0:1651529344.524670:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+725:39029:x1731745946413632:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.524672:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211231 00000100:00100000:1.0:1651529344.524674:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005914c920 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+725:39029:x1731745946413760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.524675:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177677 count 1 00002000:00080000:1.0:1651529344.524678:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177679 count 1 00010000:00010000:0.0:1651529344.524679:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50bfa lrc: 3/0,1 mode: --/PW res: [0x2b60d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524682:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c50c01 lrc: 3/0,1 mode: --/PW res: [0x2b60f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524684:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c83c6fc1/0x3234de053c4f27e lrc: 2/0,0 mode: PR/PR res: [0x2b60d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d13 expref: 1341 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.524686:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f0b79fe8/0x3234de053c4f5d4 lrc: 2/0,0 mode: PR/PR res: [0x2b60f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89bc expref: 1341 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.524687:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.524687:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.524688:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50bfa lrc: 4/0,1 mode: --/PW res: [0x2b60d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524689:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.524690:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.524690:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c50c01 lrc: 4/0,1 mode: --/PW res: [0x2b60f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524694:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c83c6fc1/0x3234de053c4f27e lrc: 3/0,0 mode: PR/PR res: [0x2b60d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d13 expref: 1341 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.524696:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f0b79fe8/0x3234de053c4f5d4 lrc: 3/0,0 mode: PR/PR res: [0x2b60f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89bc expref: 1341 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.524697:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c83c6fc1/0x3234de053c4f27e lrc: 4/0,0 mode: PR/PR res: [0x2b60d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d13 expref: 1341 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.524700:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f0b79fe8/0x3234de053c4f5d4 lrc: 4/0,0 mode: PR/PR res: [0x2b60f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89bc expref: 1341 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.524701:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005ea32140 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996985472:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.524704:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e124baf1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996985536:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.524708:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000504ef660 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.524711:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.524716:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396294272 00010000:00010000:1.0:1651529344.524720:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000033b3aab/0x3234de053c4dbda lrc: 4/0,0 mode: PR/PR res: [0x2b608:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f6c expref: 1342 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.524727:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12006 00000100:00100000:1.0:1651529344.524729:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1342:41278:x1731746396294272:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.524731:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.524733:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000033b3aab/0x3234de053c4dbda lrc: 4/0,0 mode: PR/PR res: [0x2b608:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f6c expref: 1342 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.524746:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000033b3aab/0x3234de053c4dbda lrc: 3/0,0 mode: PR/PR res: [0x2b608:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f6c expref: 1342 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.524752:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000033b3aab/0x3234de053c4dbda lrc: 0/0,0 mode: --/PR res: [0x2b608:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f6c expref: 1342 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.524756:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.524756:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.524757:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50bd0 lrc: 3/0,1 mode: PW/PW res: [0x2b608:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524760:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50bd0 lrc: 4/0,1 mode: PW/PW res: [0x2b608:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524767:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.524773:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1341:41278:x1731746396294272:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 44us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.524776:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12006 00010000:00010000:1.0:1651529344.524782:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50bd0 lrc: 3/0,1 mode: PW/PW res: [0x2b608:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524786:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50bd0 lrc: 3/0,1 mode: PW/PW res: [0x2b608:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524789:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50bd0 lrc: 3/0,1 mode: PW/PW res: [0x2b608:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524791:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50bd0 lrc: 2/0,0 mode: PW/PW res: [0x2b608:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524821:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50bd0 lrc: 2/0,0 mode: PW/PW res: [0x2b608:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524825:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dc65d2aa already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.524834:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+726:39029:x1731745946413184:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 974us (1058us total) trans 12885079279 rc 0/0 00010000:00010000:0.0:1651529344.524835:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50bd0 lrc: 2/0,0 mode: PW/PW res: [0x2b608:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.524836:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211224 00010000:00010000:0.0:1651529344.524839:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50bd0 lrc: 3/0,0 mode: PW/PW res: [0x2b608:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524844:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50bd0 lrc: 1/0,0 mode: --/PW res: [0x2b608:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524847:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50bd0 lrc: 0/0,0 mode: --/PW res: [0x2b608:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.524918:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c43262d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996985216:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.524919:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.524923:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50bde lrc: 3/0,1 mode: --/PW res: [0x2b60a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.524927:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.524938:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.524947:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396294400 00000100:00100000:1.0:1651529344.524949:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000de0edbdc pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996985280:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.524953:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50be5 lrc: 3/0,1 mode: --/PW res: [0x2b60b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.524953:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002cac510f/0x3234de053c4c92d lrc: 5/0,0 mode: PR/PR res: [0x2b609:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd60f expref: 1341 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.524963:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396294528 00010000:00010000:0.0:1651529344.524966:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c4dfc3 lrc: 4/0,0 mode: PR/PR res: [0x2b60a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3067 expref: 1342 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.524968:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396294592 00000100:00100000:0.0:1651529344.524971:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12007 00010000:00010000:1.0:1651529344.524973:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b19bfe47/0x3234de053c4ec8f lrc: 4/0,0 mode: PR/PR res: [0x2b60b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d63e4 expref: 1343 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.524973:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1343:41279:x1731746396294400:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.524976:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.524977:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002cac510f/0x3234de053c4c92d lrc: 5/0,0 mode: PR/PR res: [0x2b609:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd60f expref: 1343 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.524979:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12008 00010000:00010000:0.0:1651529344.524980:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002cac510f/0x3234de053c4c92d lrc: 4/0,0 mode: PR/PR res: [0x2b609:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd60f expref: 1343 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.524981:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ce633b1f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1343:41278:x1731746396294528:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.524985:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.524986:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.524987:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c4dfc3 lrc: 4/0,0 mode: PR/PR res: [0x2b60a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3067 expref: 1343 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.524987:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.524988:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50bd7 lrc: 3/0,1 mode: PW/PW res: [0x2b609:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524990:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c4dfc3 lrc: 3/0,0 mode: PR/PR res: [0x2b60a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3067 expref: 1343 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.524991:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50bd7 lrc: 4/0,1 mode: PW/PW res: [0x2b609:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.524996:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c4dfc3 lrc: 0/0,0 mode: --/PR res: [0x2b60a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3067 expref: 1343 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.524996:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.524999:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.525000:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.525001:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50bde lrc: 3/0,1 mode: PW/PW res: [0x2b60a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.525002:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1342:41279:x1731746396294400:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 29us (84us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.525004:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50bde lrc: 4/0,1 mode: PW/PW res: [0x2b60a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.525005:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12007 00000100:00100000:0.0:1651529344.525009:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12009 00010000:00010000:1.0:1651529344.525013:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.525021:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ce633b1f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1341:41278:x1731746396294528:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 39us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.525023:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12008 00000100:00100000:0.0:1651529344.525036:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1340:41279:x1731746396294592:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.525040:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.525042:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b19bfe47/0x3234de053c4ec8f lrc: 4/0,0 mode: PR/PR res: [0x2b60b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d63e4 expref: 1340 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.525044:0:80278:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cac510f/0x3234de053c4c92d lrc: 0/0,0 mode: --/PR res: [0x2b609:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd60f expref: 1340 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.525046:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b19bfe47/0x3234de053c4ec8f lrc: 3/0,0 mode: PR/PR res: [0x2b60b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d63e4 expref: 1340 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.525048:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e5997468 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996985152:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.525051:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50bd7 lrc: 3/0,1 mode: PW/PW res: [0x2b609:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525051:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b19bfe47/0x3234de053c4ec8f lrc: 0/0,0 mode: --/PR res: [0x2b60b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d63e4 expref: 1339 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.525055:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50bd7 lrc: 3/0,1 mode: PW/PW res: [0x2b609:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525055:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.525056:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.525057:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50bd7 lrc: 3/0,1 mode: PW/PW res: [0x2b609:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525057:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50be5 lrc: 3/0,1 mode: PW/PW res: [0x2b60b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.525060:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50bd7 lrc: 3/0,1 mode: PW/PW res: [0x2b609:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525060:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50be5 lrc: 4/0,1 mode: PW/PW res: [0x2b60b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.525063:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50bd7 lrc: 2/0,0 mode: PW/PW res: [0x2b609:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525068:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.525080:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1338:41279:x1731746396294592:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 63us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.525083:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12009 00010000:00010000:0.0:1651529344.525090:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50bd7 lrc: 2/0,0 mode: PW/PW res: [0x2b609:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525093:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cff76789 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.525094:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50bd7 lrc: 2/0,0 mode: PW/PW res: [0x2b609:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525097:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50bd7 lrc: 3/0,0 mode: PW/PW res: [0x2b609:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525101:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50bd7 lrc: 1/0,0 mode: --/PW res: [0x2b609:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525104:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50bd7 lrc: 0/0,0 mode: --/PW res: [0x2b609:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.525109:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+726:39029:x1731745946413376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 816us (904us total) trans 12885079280 rc 0/0 00010000:00010000:0.0:1651529344.525109:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50bde lrc: 3/0,1 mode: PW/PW res: [0x2b60a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.525112:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211225 00010000:00010000:0.0:1651529344.525114:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50bde lrc: 3/0,1 mode: PW/PW res: [0x2b60a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525117:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50bde lrc: 3/0,1 mode: PW/PW res: [0x2b60a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.525118:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50be5 lrc: 3/0,1 mode: PW/PW res: [0x2b60b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525120:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50bde lrc: 2/0,0 mode: PW/PW res: [0x2b60a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.525121:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50be5 lrc: 3/0,1 mode: PW/PW res: [0x2b60b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.525124:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50be5 lrc: 3/0,1 mode: PW/PW res: [0x2b60b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.525134:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50be5 lrc: 2/0,0 mode: PW/PW res: [0x2b60b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.525171:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+727:39030:x1731745946413440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 818us (950us total) trans 12885079281 rc 0/0 00000100:00100000:0.0:1651529344.525174:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211226 00000100:00100000:1.0:1651529344.525176:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+727:39030:x1731745946413504:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 796us (922us total) trans 12885079282 rc 0/0 00000100:00100000:1.0:1651529344.525179:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211227 00010000:00010000:0.0:1651529344.525182:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50bde lrc: 2/0,0 mode: PW/PW res: [0x2b60a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525185:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000734ecdfd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.525186:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50bde lrc: 2/0,0 mode: PW/PW res: [0x2b60a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.525187:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50be5 lrc: 2/0,0 mode: PW/PW res: [0x2b60b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525188:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50bde lrc: 3/0,0 mode: PW/PW res: [0x2b60a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.525190:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f27c804 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.525191:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50be5 lrc: 2/0,0 mode: PW/PW res: [0x2b60b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525193:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50bde lrc: 1/0,0 mode: --/PW res: [0x2b60a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.525194:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50be5 lrc: 3/0,0 mode: PW/PW res: [0x2b60b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525196:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50bde lrc: 0/0,0 mode: --/PW res: [0x2b60a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.525199:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50be5 lrc: 1/0,0 mode: --/PW res: [0x2b60b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.525202:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50be5 lrc: 0/0,0 mode: --/PW res: [0x2b60b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.525217:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.525281:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946414208 00000100:00100000:1.0:1651529344.525291:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211232 00000100:00100000:1.0:1651529344.525292:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+726:39029:x1731745946414208:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.525298:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177680 count 1 00010000:00010000:1.0:1651529344.525302:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c50c08 lrc: 3/0,1 mode: --/PW res: [0x2b610:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.525307:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c4ecf8 lrc: 2/0,0 mode: PR/PR res: [0x2b610:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6596 expref: 1337 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.525310:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.525311:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.525311:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c50c08 lrc: 4/0,1 mode: --/PW res: [0x2b610:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.525318:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c4ecf8 lrc: 3/0,0 mode: PR/PR res: [0x2b610:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6596 expref: 1337 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.525321:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c4ecf8 lrc: 4/0,0 mode: PR/PR res: [0x2b610:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6596 expref: 1337 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.525325:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae466fbb pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996985600:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.525339:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000412e5d26 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.525439:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.525449:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946414400 00000100:00100000:0.0:1651529344.525459:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211233 00000100:00100000:0.0:1651529344.525461:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+727:39029:x1731745946414400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.525466:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177681 count 1 00010000:00010000:0.0:1651529344.525471:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50c0f lrc: 3/0,1 mode: --/PW res: [0x2b611:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525499:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c4d2d4 lrc: 2/0,0 mode: PR/PR res: [0x2b611:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd4c expref: 1337 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.525502:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.525503:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.525504:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50c0f lrc: 4/0,1 mode: --/PW res: [0x2b611:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525512:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c4d2d4 lrc: 3/0,0 mode: PR/PR res: [0x2b611:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd4c expref: 1337 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.525515:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c4d2d4 lrc: 4/0,0 mode: PR/PR res: [0x2b611:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd4c expref: 1337 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.525520:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c43262d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996985664:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.525533:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000003c8b0daf going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.525541:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.525548:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.525553:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946414528 00000100:00100000:1.0:1651529344.525569:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946414464 00000100:00100000:1.0:1651529344.525574:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211234 00000100:00100000:1.0:1651529344.525575:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+729:39029:x1731745946414528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.525576:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211235 00000100:00100000:0.0:1651529344.525578:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+729:39030:x1731745946414464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.525580:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177683 count 1 00010000:00010000:1.0:1651529344.525584:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c50c16 lrc: 3/0,1 mode: --/PW res: [0x2b613:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.525585:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177682 count 1 00010000:00010000:0.0:1651529344.525589:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50c1d lrc: 3/0,1 mode: --/PW res: [0x2b612:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.525591:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a3ae24c2/0x3234de053c4b4b9 lrc: 2/0,0 mode: PR/PR res: [0x2b613:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc22e expref: 1337 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.525594:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.525594:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c4e813 lrc: 2/0,0 mode: PR/PR res: [0x2b612:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5122 expref: 1337 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.525595:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.525596:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c50c16 lrc: 4/0,1 mode: --/PW res: [0x2b613:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525597:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.525597:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.525598:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50c1d lrc: 4/0,1 mode: --/PW res: [0x2b612:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.525602:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a3ae24c2/0x3234de053c4b4b9 lrc: 3/0,0 mode: PR/PR res: [0x2b613:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc22e expref: 1337 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.525605:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a3ae24c2/0x3234de053c4b4b9 lrc: 4/0,0 mode: PR/PR res: [0x2b613:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc22e expref: 1337 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.525605:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c4e813 lrc: 3/0,0 mode: PR/PR res: [0x2b612:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5122 expref: 1337 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.525608:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c4e813 lrc: 4/0,0 mode: PR/PR res: [0x2b612:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5122 expref: 1337 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.525609:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000edfe60d3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996985728:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.525612:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ad6d0877 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996985792:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.525620:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 0000000053a0cffa going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.525633:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 0000000049203969 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.525751:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b0d9532a pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996985344:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.525756:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c50bf3 lrc: 3/0,1 mode: --/PW res: [0x2b60e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.525788:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e124baf1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996985536:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.525791:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c50c01 lrc: 3/0,1 mode: --/PW res: [0x2b60f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.525796:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.525798:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae466fbb pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996985600:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.525801:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c50c08 lrc: 3/0,1 mode: --/PW res: [0x2b610:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.525813:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396295104 00010000:00010000:1.0:1651529344.525819:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c668d004/0x3234de053c4d70a lrc: 4/0,0 mode: PR/PR res: [0x2b60e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0dc9 expref: 1338 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.525823:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.525830:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.525838:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396295040 00000100:00100000:0.0:1651529344.525839:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.525841:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fd3acf42/0x3234de053c4e01e lrc: 5/0,0 mode: PR/PR res: [0x2b60c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d31a9 expref: 1339 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.525844:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.525847:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396295232 00010000:00010000:1.0:1651529344.525849:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f0b79fe8/0x3234de053c4f5d4 lrc: 4/0,0 mode: PR/PR res: [0x2b60f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89bc expref: 1340 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.525853:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396295168 00000100:00100000:0.0:1651529344.525854:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.525855:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c83c6fc1/0x3234de053c4f27e lrc: 5/0,0 mode: PR/PR res: [0x2b60d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d13 expref: 1341 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.525859:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396295296 00010000:00010000:1.0:1651529344.525860:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c4ecf8 lrc: 4/0,0 mode: PR/PR res: [0x2b610:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6596 expref: 1342 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.525862:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c43262d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996985664:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.525864:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12010 00000100:00100000:1.0:1651529344.525866:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1342:41278:x1731746396295104:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.525868:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50c0f lrc: 3/0,1 mode: --/PW res: [0x2b611:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.525869:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.525870:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c668d004/0x3234de053c4d70a lrc: 4/0,0 mode: PR/PR res: [0x2b60e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0dc9 expref: 1342 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.525874:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c668d004/0x3234de053c4d70a lrc: 3/0,0 mode: PR/PR res: [0x2b60e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0dc9 expref: 1342 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.525875:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005ea32140 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996985472:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.525878:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50bfa lrc: 3/0,1 mode: --/PW res: [0x2b60d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.525879:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c668d004/0x3234de053c4d70a lrc: 0/0,0 mode: --/PR res: [0x2b60e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0dc9 expref: 1342 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.525883:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.525884:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.525884:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c50bf3 lrc: 3/0,1 mode: PW/PW res: [0x2b60e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.525884:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007fca8239 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996985408:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.525886:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50bec lrc: 3/0,1 mode: --/PW res: [0x2b60c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.525887:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c50bf3 lrc: 4/0,1 mode: PW/PW res: [0x2b60e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.525892:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396295360 00010000:00010000:1.0:1651529344.525894:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.525897:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c4d2d4 lrc: 4/0,0 mode: PR/PR res: [0x2b611:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd4c expref: 1342 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.525902:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1342:41278:x1731746396295104:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 35us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.525903:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12011 00000100:00100000:0.0:1651529344.525904:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1342:41279:x1731746396295040:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.525905:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12010 00010000:00010000:0.0:1651529344.525907:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.525909:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12012 00010000:00010000:0.0:1651529344.525909:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fd3acf42/0x3234de053c4e01e lrc: 4/0,0 mode: PR/PR res: [0x2b60c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d31a9 expref: 1341 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.525911:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1341:41278:x1731746396295232:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.525913:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.525914:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f0b79fe8/0x3234de053c4f5d4 lrc: 4/0,0 mode: PR/PR res: [0x2b60f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89bc expref: 1341 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.525918:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f0b79fe8/0x3234de053c4f5d4 lrc: 3/0,0 mode: PR/PR res: [0x2b60f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89bc expref: 1341 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.525922:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0b79fe8/0x3234de053c4f5d4 lrc: 0/0,0 mode: --/PR res: [0x2b60f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89bc expref: 1341 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.525926:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.525927:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.525927:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c50c01 lrc: 3/0,1 mode: PW/PW res: [0x2b60f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525928:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fd3acf42/0x3234de053c4e01e lrc: 3/0,0 mode: PR/PR res: [0x2b60c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d31a9 expref: 1340 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.525930:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c50c01 lrc: 4/0,1 mode: PW/PW res: [0x2b60f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.525935:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.525935:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd3acf42/0x3234de053c4e01e lrc: 0/0,0 mode: --/PR res: [0x2b60c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d31a9 expref: 1340 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.525939:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1339:41278:x1731746396295232:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 28us (109us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.525939:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.525939:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.525940:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50bec lrc: 3/0,1 mode: PW/PW res: [0x2b60c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.525942:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12012 00010000:00010000:0.0:1651529344.525943:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50bec lrc: 4/0,1 mode: PW/PW res: [0x2b60c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.525945:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12013 00000100:00100000:1.0:1651529344.525947:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1338:41279:x1731746396295168:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.525949:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.525950:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c83c6fc1/0x3234de053c4f27e lrc: 4/0,0 mode: PR/PR res: [0x2b60d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d13 expref: 1338 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.525953:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c83c6fc1/0x3234de053c4f27e lrc: 3/0,0 mode: PR/PR res: [0x2b60d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d13 expref: 1338 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.525958:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c83c6fc1/0x3234de053c4f27e lrc: 0/0,0 mode: --/PR res: [0x2b60d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d13 expref: 1338 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.525963:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.525964:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.525965:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50bfa lrc: 3/0,1 mode: PW/PW res: [0x2b60d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.525970:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.525976:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50bfa lrc: 4/0,1 mode: PW/PW res: [0x2b60d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.525978:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1337:41279:x1731746396295040:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 73us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.525981:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12011 00010000:00010000:1.0:1651529344.525985:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.525991:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1336:41279:x1731746396295168:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 44us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.525992:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12014 00000100:00100000:1.0:1651529344.525994:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12013 00000100:00100000:0.0:1651529344.525994:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1336:41279:x1731746396295296:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.525997:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.525999:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12015 00010000:00010000:0.0:1651529344.525999:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c4ecf8 lrc: 4/0,0 mode: PR/PR res: [0x2b610:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6596 expref: 1335 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.526001:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000039bebb6e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1335:41278:x1731746396295360:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.526003:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.526003:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c4ecf8 lrc: 3/0,0 mode: PR/PR res: [0x2b610:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6596 expref: 1335 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.526005:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c4d2d4 lrc: 4/0,0 mode: PR/PR res: [0x2b611:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd4c expref: 1335 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.526008:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c4d2d4 lrc: 3/0,0 mode: PR/PR res: [0x2b611:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd4c expref: 1335 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.526008:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c4ecf8 lrc: 0/0,0 mode: --/PR res: [0x2b610:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6596 expref: 1335 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.526011:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.526012:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.526013:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c4d2d4 lrc: 0/0,0 mode: --/PR res: [0x2b611:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd4c expref: 1334 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.526013:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c50c08 lrc: 3/0,1 mode: PW/PW res: [0x2b610:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526016:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c50c08 lrc: 4/0,1 mode: PW/PW res: [0x2b610:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.526017:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.526017:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.526018:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50c0f lrc: 3/0,1 mode: PW/PW res: [0x2b611:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.526021:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50c0f lrc: 4/0,1 mode: PW/PW res: [0x2b611:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526025:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.526031:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1333:41279:x1731746396295296:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.526034:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12014 00010000:00010000:1.0:1651529344.526036:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.526041:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000039bebb6e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1333:41278:x1731746396295360:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 40us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.526044:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12015 00010000:00010000:0.0:1651529344.526045:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50c0f lrc: 3/0,1 mode: PW/PW res: [0x2b611:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526048:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50c0f lrc: 3/0,1 mode: PW/PW res: [0x2b611:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526052:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50c0f lrc: 3/0,1 mode: PW/PW res: [0x2b611:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526054:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50c0f lrc: 2/0,0 mode: PW/PW res: [0x2b611:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.526055:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c50c08 lrc: 3/0,1 mode: PW/PW res: [0x2b610:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.526058:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c50c08 lrc: 3/0,1 mode: PW/PW res: [0x2b610:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.526062:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c50c08 lrc: 3/0,1 mode: PW/PW res: [0x2b610:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.526064:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c50c08 lrc: 2/0,0 mode: PW/PW res: [0x2b610:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.526100:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+731:39029:x1731745946414400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 638us (662us total) trans 12885079283 rc 0/0 00000100:00100000:0.0:1651529344.526103:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211233 00000100:00100000:1.0:1651529344.526107:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+730:39029:x1731745946414208:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 814us (890us total) trans 12885079284 rc 0/0 00000100:00100000:1.0:1651529344.526110:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211232 00010000:00010000:0.0:1651529344.526110:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50c0f lrc: 2/0,0 mode: PW/PW res: [0x2b611:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526116:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001d253066 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.526117:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c50c01 lrc: 3/0,1 mode: PW/PW res: [0x2b60f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526117:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50c0f lrc: 2/0,0 mode: PW/PW res: [0x2b611:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526120:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50c0f lrc: 3/0,0 mode: PW/PW res: [0x2b611:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.526123:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c50c01 lrc: 3/0,1 mode: PW/PW res: [0x2b60f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526124:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50c0f lrc: 1/0,0 mode: --/PW res: [0x2b611:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.526126:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c50c01 lrc: 3/0,1 mode: PW/PW res: [0x2b60f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526127:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50c0f lrc: 0/0,0 mode: --/PW res: [0x2b611:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.526128:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c50c01 lrc: 2/0,0 mode: PW/PW res: [0x2b60f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526131:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c50c08 lrc: 2/0,0 mode: PW/PW res: [0x2b610:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526133:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000f905106 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.526134:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c50c08 lrc: 2/0,0 mode: PW/PW res: [0x2b610:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526137:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c50c08 lrc: 3/0,0 mode: PW/PW res: [0x2b610:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526140:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c50c08 lrc: 1/0,0 mode: --/PW res: [0x2b610:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526143:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c50c08 lrc: 0/0,0 mode: --/PW res: [0x2b610:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526147:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c50c01 lrc: 2/0,0 mode: PW/PW res: [0x2b60f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526149:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001650e9dc already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.526150:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c50c01 lrc: 2/0,0 mode: PW/PW res: [0x2b60f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526153:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c50c01 lrc: 3/0,0 mode: PW/PW res: [0x2b60f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526156:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c50c01 lrc: 1/0,0 mode: --/PW res: [0x2b60f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526158:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c50c01 lrc: 0/0,0 mode: --/PW res: [0x2b60f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.526159:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005914c920 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+730:39029:x1731745946413760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1484us (1576us total) trans 12885079285 rc 0/0 00000100:00100000:1.0:1651529344.526162:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211231 00010000:00010000:0.0:1651529344.526164:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50bfa lrc: 3/0,1 mode: PW/PW res: [0x2b60d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526167:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50bfa lrc: 3/0,1 mode: PW/PW res: [0x2b60d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.526169:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c50bf3 lrc: 3/0,1 mode: PW/PW res: [0x2b60e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526170:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50bfa lrc: 3/0,1 mode: PW/PW res: [0x2b60d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.526172:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c50bf3 lrc: 3/0,1 mode: PW/PW res: [0x2b60e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526173:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50bfa lrc: 2/0,0 mode: PW/PW res: [0x2b60d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.526175:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c50bf3 lrc: 3/0,1 mode: PW/PW res: [0x2b60e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.526177:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c50bf3 lrc: 2/0,0 mode: PW/PW res: [0x2b60e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.526216:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+731:39029:x1731745946413632:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1546us (1642us total) trans 12885079286 rc 0/0 00000100:00100000:1.0:1651529344.526217:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+731:39030:x1731745946413696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1603us (1651us total) trans 12885079287 rc 0/0 00000100:00100000:0.0:1651529344.526219:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211230 00000100:00100000:1.0:1651529344.526239:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211229 00010000:00010000:0.0:1651529344.526244:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50bfa lrc: 2/0,0 mode: PW/PW res: [0x2b60d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526247:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000069f7ba22 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.526248:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50bfa lrc: 2/0,0 mode: PW/PW res: [0x2b60d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526251:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50bfa lrc: 3/0,0 mode: PW/PW res: [0x2b60d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526256:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50bfa lrc: 1/0,0 mode: --/PW res: [0x2b60d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526258:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50bfa lrc: 0/0,0 mode: --/PW res: [0x2b60d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526262:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c50bf3 lrc: 2/0,0 mode: PW/PW res: [0x2b60e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526265:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005531aaab already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.526266:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c50bf3 lrc: 2/0,0 mode: PW/PW res: [0x2b60e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.526277:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.526277:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c50bf3 lrc: 3/0,0 mode: PW/PW res: [0x2b60e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526281:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c50bf3 lrc: 1/0,0 mode: --/PW res: [0x2b60e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526283:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c50bf3 lrc: 0/0,0 mode: --/PW res: [0x2b60e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.526288:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.526289:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50bec lrc: 3/0,1 mode: PW/PW res: [0x2b60c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526292:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50bec lrc: 3/0,1 mode: PW/PW res: [0x2b60c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526295:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50bec lrc: 3/0,1 mode: PW/PW res: [0x2b60c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526297:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50bec lrc: 2/0,0 mode: PW/PW res: [0x2b60c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.526335:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+730:39030:x1731745946413568:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1723us (1780us total) trans 12885079288 rc 0/0 00000100:00100000:0.0:1651529344.526339:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211228 00000100:00100000:0.0:1651529344.526349:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ad6d0877 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996985792:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.526353:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50c1d lrc: 3/0,1 mode: --/PW res: [0x2b612:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.526379:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396295424 00010000:00010000:1.0:1651529344.526385:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a3ae24c2/0x3234de053c4b4b9 lrc: 5/0,0 mode: PR/PR res: [0x2b613:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc22e expref: 1332 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.526393:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396295488 00010000:00010000:1.0:1651529344.526395:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c4e813 lrc: 4/0,0 mode: PR/PR res: [0x2b612:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5122 expref: 1333 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.526405:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12016 00000100:00100000:1.0:1651529344.526406:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1333:41279:x1731746396295424:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.526409:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.526411:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a3ae24c2/0x3234de053c4b4b9 lrc: 5/0,0 mode: PR/PR res: [0x2b613:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc22e expref: 1333 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.526413:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12017 00010000:00010000:1.0:1651529344.526415:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a3ae24c2/0x3234de053c4b4b9 lrc: 4/0,0 mode: PR/PR res: [0x2b613:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc22e expref: 1333 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.526415:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1333:41278:x1731746396295488:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.526419:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.526420:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.526420:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c4e813 lrc: 4/0,0 mode: PR/PR res: [0x2b612:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5122 expref: 1333 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.526421:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.526421:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c50c16 lrc: 3/0,1 mode: PW/PW res: [0x2b613:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.526424:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c50c16 lrc: 4/0,1 mode: PW/PW res: [0x2b613:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.526431:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.526442:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1333:41279:x1731746396295424:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 35us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.526445:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12016 00010000:00010000:0.0:1651529344.526448:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c4e813 lrc: 3/0,0 mode: PR/PR res: [0x2b612:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5122 expref: 1332 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.526452:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50bec lrc: 2/0,0 mode: PW/PW res: [0x2b60c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.526455:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005d8a4887 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.526456:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50bec lrc: 2/0,0 mode: PW/PW res: [0x2b60c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.526459:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50bec lrc: 3/0,0 mode: PW/PW res: [0x2b60c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526459:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c4e813 lrc: 0/0,0 mode: --/PR res: [0x2b612:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5122 expref: 1332 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.526464:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50bec lrc: 1/0,0 mode: --/PW res: [0x2b60c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.526466:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50bec lrc: 0/0,0 mode: --/PW res: [0x2b60c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.526476:0:80278:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3ae24c2/0x3234de053c4b4b9 lrc: 0/0,0 mode: --/PR res: [0x2b613:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc22e expref: 1332 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.526479:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000edfe60d3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996985728:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.526489:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c50c16 lrc: 3/0,1 mode: PW/PW res: [0x2b613:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526489:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.526490:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.526492:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50c1d lrc: 3/0,1 mode: PW/PW res: [0x2b612:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.526495:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c50c16 lrc: 3/0,1 mode: PW/PW res: [0x2b613:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.526497:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c50c16 lrc: 3/0,1 mode: PW/PW res: [0x2b613:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526497:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50c1d lrc: 4/0,1 mode: PW/PW res: [0x2b612:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.526500:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c50c16 lrc: 3/0,1 mode: PW/PW res: [0x2b613:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.526503:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c50c16 lrc: 2/0,0 mode: PW/PW res: [0x2b613:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526517:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.526530:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1330:41278:x1731746396295488:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 113us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.526536:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12017 00000100:00100000:1.0:1651529344.526546:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+730:39029:x1731745946414528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 970us (1006us total) trans 12885079289 rc 0/0 00000100:00100000:1.0:1651529344.526549:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211234 00010000:00010000:0.0:1651529344.526577:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c50c16 lrc: 2/0,0 mode: PW/PW res: [0x2b613:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526581:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002e1250c9 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.526582:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c50c16 lrc: 2/0,0 mode: PW/PW res: [0x2b613:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526585:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c50c16 lrc: 3/0,0 mode: PW/PW res: [0x2b613:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.526586:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.526591:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c50c16 lrc: 1/0,0 mode: --/PW res: [0x2b613:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526593:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c50c16 lrc: 0/0,0 mode: --/PW res: [0x2b613:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.526600:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.526600:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50c1d lrc: 3/0,1 mode: PW/PW res: [0x2b612:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526603:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50c1d lrc: 3/0,1 mode: PW/PW res: [0x2b612:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526617:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50c1d lrc: 3/0,1 mode: PW/PW res: [0x2b612:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526620:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50c1d lrc: 2/0,0 mode: PW/PW res: [0x2b612:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.526631:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.526659:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.526661:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+730:39030:x1731745946414464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1082us (1113us total) trans 12885079290 rc 0/0 00000100:00100000:0.0:1651529344.526673:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211235 00000100:00100000:0.0:1651529344.526678:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946415040 00000100:00100000:0.0:1651529344.526688:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946414976 00000100:00100000:0.0:1651529344.526693:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946415168 00000100:00100000:1.0:1651529344.526697:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.526697:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946415104 00000100:00100000:0.0:1651529344.526701:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946415296 00000100:00100000:0.0:1651529344.526705:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211236 00000100:00100000:1.0:1651529344.526706:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.526707:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+734:39029:x1731745946415040:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.526713:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946415232 00000100:00100000:1.0:1651529344.526719:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211237 00000100:00100000:1.0:1651529344.526721:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+735:39030:x1731745946414976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.526726:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177684 count 1 00002000:00080000:0.0:1651529344.526727:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177685 count 1 00010000:00010000:1.0:1651529344.526731:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c50c24 lrc: 3/0,1 mode: --/PW res: [0x2b614:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526732:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50c2b lrc: 3/0,1 mode: --/PW res: [0x2b615:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.526746:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000087aa8a9/0x3234de053c4cad8 lrc: 2/0,0 mode: PR/PR res: [0x2b614:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd16 expref: 1329 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.526749:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.526750:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.526750:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c50c24 lrc: 4/0,1 mode: --/PW res: [0x2b614:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526759:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000127a914c/0x3234de053c4e29b lrc: 2/0,0 mode: PR/PR res: [0x2b615:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3bd5 expref: 1329 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.526762:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.526763:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000087aa8a9/0x3234de053c4cad8 lrc: 3/0,0 mode: PR/PR res: [0x2b614:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd16 expref: 1329 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.526763:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.526764:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50c2b lrc: 4/0,1 mode: --/PW res: [0x2b615:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.526767:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000087aa8a9/0x3234de053c4cad8 lrc: 4/0,0 mode: PR/PR res: [0x2b614:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd16 expref: 1329 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.526771:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996985856:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.526772:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000127a914c/0x3234de053c4e29b lrc: 3/0,0 mode: PR/PR res: [0x2b615:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3bd5 expref: 1329 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.526775:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000127a914c/0x3234de053c4e29b lrc: 4/0,0 mode: PR/PR res: [0x2b615:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3bd5 expref: 1329 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.526780:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 0000000053a0cffa going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.526780:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ad6d0877 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996985920:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.526786:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211238 00000100:00100000:1.0:1651529344.526788:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+735:39029:x1731745946415168:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.526791:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060852af0 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.526792:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177687 count 1 00010000:00010000:1.0:1651529344.526796:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c50c32 lrc: 3/0,1 mode: --/PW res: [0x2b617:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526797:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50c1d lrc: 2/0,0 mode: PW/PW res: [0x2b612:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.526800:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000695e6e5e/0x3234de053c4efc9 lrc: 2/0,0 mode: PR/PR res: [0x2b617:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d71d6 expref: 1329 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.526800:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000048c07243 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.526801:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50c1d lrc: 2/0,0 mode: PW/PW res: [0x2b612:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.526803:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.526804:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.526804:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50c1d lrc: 3/0,0 mode: PW/PW res: [0x2b612:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.526805:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c50c32 lrc: 4/0,1 mode: --/PW res: [0x2b617:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526808:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50c1d lrc: 1/0,0 mode: --/PW res: [0x2b612:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.526810:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000695e6e5e/0x3234de053c4efc9 lrc: 3/0,0 mode: PR/PR res: [0x2b617:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d71d6 expref: 1329 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.526811:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50c1d lrc: 0/0,0 mode: --/PW res: [0x2b612:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.526814:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000695e6e5e/0x3234de053c4efc9 lrc: 4/0,0 mode: PR/PR res: [0x2b617:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d71d6 expref: 1329 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.526818:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996985984:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.526824:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 0000000071742acc going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.526829:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211239 00000100:00100000:1.0:1651529344.526831:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085af61db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+735:39030:x1731745946415104:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.526835:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177686 count 1 00010000:00010000:1.0:1651529344.526838:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50c39 lrc: 3/0,1 mode: --/PW res: [0x2b616:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.526842:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008fe2031b/0x3234de053c4c639 lrc: 2/0,0 mode: PR/PR res: [0x2b616:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccad9 expref: 1329 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.526843:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211240 00000100:00100000:0.0:1651529344.526845:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+735:39029:x1731745946415296:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.526850:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177689 count 1 00010000:00010000:0.0:1651529344.526854:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50c40 lrc: 3/0,1 mode: --/PW res: [0x2b619:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.526855:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.526855:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.526856:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50c39 lrc: 4/0,1 mode: --/PW res: [0x2b616:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.526859:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000018c74a51/0x3234de053c4f6de lrc: 2/0,0 mode: PR/PR res: [0x2b619:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8e0e expref: 1329 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.526862:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008fe2031b/0x3234de053c4c639 lrc: 3/0,0 mode: PR/PR res: [0x2b616:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccad9 expref: 1329 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.526862:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.526863:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.526863:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50c40 lrc: 4/0,1 mode: --/PW res: [0x2b619:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.526868:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008fe2031b/0x3234de053c4c639 lrc: 4/0,0 mode: PR/PR res: [0x2b616:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccad9 expref: 1329 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.526870:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000018c74a51/0x3234de053c4f6de lrc: 3/0,0 mode: PR/PR res: [0x2b619:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8e0e expref: 1329 pid: 156655 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.526872:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996986048:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.526874:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000018c74a51/0x3234de053c4f6de lrc: 4/0,0 mode: PR/PR res: [0x2b619:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8e0e expref: 1329 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.526878:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd96f074 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.526878:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000673bcbe2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996986112:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.526884:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211241 00000100:00100000:1.0:1651529344.526886:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+735:39030:x1731745946415232:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.526887:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000000a4def41 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.526890:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177688 count 1 00010000:00010000:1.0:1651529344.526894:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056ce51ac/0x3234de053c50c47 lrc: 3/0,1 mode: --/PW res: [0x2b618:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.526898:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007e9c67e9/0x3234de053c4cc7c lrc: 2/0,0 mode: PR/PR res: [0x2b618:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce3d7 expref: 1329 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.526901:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.526902:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.526902:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056ce51ac/0x3234de053c50c47 lrc: 4/0,1 mode: --/PW res: [0x2b618:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.526904:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.526908:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007e9c67e9/0x3234de053c4cc7c lrc: 3/0,0 mode: PR/PR res: [0x2b618:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce3d7 expref: 1329 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.526911:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007e9c67e9/0x3234de053c4cc7c lrc: 4/0,0 mode: PR/PR res: [0x2b618:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce3d7 expref: 1329 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.526918:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000007fba516 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996986176:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.526924:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 000000004698fefb going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.526928:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.526932:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946415360 00000100:00100000:1.0:1651529344.526943:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946415424 00000100:00100000:1.0:1651529344.526949:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211242 00000100:00100000:1.0:1651529344.526951:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+737:39029:x1731745946415360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.526956:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177690 count 1 00010000:00010000:1.0:1651529344.526959:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0efadcd/0x3234de053c50c4e lrc: 3/0,1 mode: --/PW res: [0x2b61a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.526963:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d8c4e5e5/0x3234de053c4ed4c lrc: 2/0,0 mode: PR/PR res: [0x2b61a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d671e expref: 1329 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.526966:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.526967:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.526968:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0efadcd/0x3234de053c50c4e lrc: 4/0,1 mode: --/PW res: [0x2b61a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.526973:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d8c4e5e5/0x3234de053c4ed4c lrc: 3/0,0 mode: PR/PR res: [0x2b61a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d671e expref: 1329 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.526976:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d8c4e5e5/0x3234de053c4ed4c lrc: 4/0,0 mode: PR/PR res: [0x2b61a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d671e expref: 1329 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.526980:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005b3c5aba pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996986240:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.526989:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211243 00000100:00100000:0.0:1651529344.526991:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+737:39030:x1731745946415424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.526997:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177691 count 1 00010000:00010000:0.0:1651529344.527002:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50c55 lrc: 3/0,1 mode: --/PW res: [0x2b61b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527006:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009203d64e/0x3234de053c4f6d7 lrc: 2/0,0 mode: PR/PR res: [0x2b61b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8e07 expref: 1329 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.527009:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.527010:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.527011:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50c55 lrc: 4/0,1 mode: --/PW res: [0x2b61b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.527021:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a5495eb going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.527039:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009203d64e/0x3234de053c4f6d7 lrc: 3/0,0 mode: PR/PR res: [0x2b61b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8e07 expref: 1329 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.527043:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009203d64e/0x3234de053c4f6d7 lrc: 4/0,0 mode: PR/PR res: [0x2b61b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8e07 expref: 1329 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.527048:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a9e254e pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996986304:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.527062:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c0dff858 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.527561:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996985856:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.527566:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c50c24 lrc: 3/0,1 mode: --/PW res: [0x2b614:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.527566:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.527572:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.527574:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996986048:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.527581:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50c39 lrc: 3/0,1 mode: --/PW res: [0x2b616:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.527581:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.527588:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.527596:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996985984:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.527599:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c50c32 lrc: 3/0,1 mode: --/PW res: [0x2b617:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.527600:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.527606:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000007fba516 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996986176:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.527606:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.527608:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000056ce51ac/0x3234de053c50c47 lrc: 3/0,1 mode: --/PW res: [0x2b618:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.527611:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.527614:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005b3c5aba pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996986240:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.527616:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a0efadcd/0x3234de053c50c4e lrc: 3/0,1 mode: --/PW res: [0x2b61a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.527616:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.527622:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396296064 00000100:00100000:0.0:1651529344.527624:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000673bcbe2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996986112:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.527627:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000127a914c/0x3234de053c4e29b lrc: 5/0,0 mode: PR/PR res: [0x2b615:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3bd5 expref: 1330 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.527629:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50c40 lrc: 3/0,1 mode: --/PW res: [0x2b619:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.527635:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396296192 00000100:00100000:0.0:1651529344.527636:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a9e254e pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996986304:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.527637:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000695e6e5e/0x3234de053c4efc9 lrc: 4/0,0 mode: PR/PR res: [0x2b617:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d71d6 expref: 1331 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.527638:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50c55 lrc: 3/0,1 mode: --/PW res: [0x2b61b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.527641:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396296320 00010000:00010000:1.0:1651529344.527643:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000018c74a51/0x3234de053c4f6de lrc: 4/0,0 mode: PR/PR res: [0x2b619:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8e0e expref: 1332 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.527644:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ad6d0877 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996985920:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.527647:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396296000 00010000:00010000:0.0:1651529344.527647:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50c2b lrc: 3/0,1 mode: --/PW res: [0x2b615:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.527649:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000087aa8a9/0x3234de053c4cad8 lrc: 4/0,0 mode: PR/PR res: [0x2b614:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd16 expref: 1333 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.527653:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396296384 00000100:00100000:0.0:1651529344.527653:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396296256 00010000:00010000:1.0:1651529344.527655:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007e9c67e9/0x3234de053c4cc7c lrc: 4/0,0 mode: PR/PR res: [0x2b618:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce3d7 expref: 1335 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.527658:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008fe2031b/0x3234de053c4c639 lrc: 4/0,0 mode: PR/PR res: [0x2b616:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccad9 expref: 1335 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.527659:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396296512 00010000:00010000:1.0:1651529344.527661:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d8c4e5e5/0x3234de053c4ed4c lrc: 4/0,0 mode: PR/PR res: [0x2b61a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d671e expref: 1336 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.527664:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396296640 00010000:00010000:0.0:1651529344.527666:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009203d64e/0x3234de053c4f6d7 lrc: 4/0,0 mode: PR/PR res: [0x2b61b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8e07 expref: 1337 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.527667:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12018 00000100:00100000:1.0:1651529344.527668:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1337:41279:x1731746396296064:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.527671:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.527671:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12019 00010000:00010000:1.0:1651529344.527672:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000127a914c/0x3234de053c4e29b lrc: 4/0,0 mode: PR/PR res: [0x2b615:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3bd5 expref: 1337 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.527673:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1337:41279:x1731746396296192:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.527676:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.527678:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000127a914c/0x3234de053c4e29b lrc: 3/0,0 mode: PR/PR res: [0x2b615:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3bd5 expref: 1337 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.527678:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000695e6e5e/0x3234de053c4efc9 lrc: 4/0,0 mode: PR/PR res: [0x2b617:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d71d6 expref: 1337 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.527681:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000695e6e5e/0x3234de053c4efc9 lrc: 3/0,0 mode: PR/PR res: [0x2b617:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d71d6 expref: 1337 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.527684:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000127a914c/0x3234de053c4e29b lrc: 0/0,0 mode: --/PR res: [0x2b615:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3bd5 expref: 1337 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.527687:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000695e6e5e/0x3234de053c4efc9 lrc: 0/0,0 mode: --/PR res: [0x2b617:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d71d6 expref: 1336 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.527688:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.527688:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.527689:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50c2b lrc: 3/0,1 mode: PW/PW res: [0x2b615:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527691:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.527692:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50c2b lrc: 4/0,1 mode: PW/PW res: [0x2b615:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527692:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.527692:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c50c32 lrc: 3/0,1 mode: PW/PW res: [0x2b617:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527698:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c50c32 lrc: 4/0,1 mode: PW/PW res: [0x2b617:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.527703:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.527713:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1335:41279:x1731746396296064:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 44us (147us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.527715:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.527720:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12018 00000100:00100000:0.0:1651529344.527723:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1335:41279:x1731746396296192:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 49us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.527726:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12020 00000100:00100000:1.0:1651529344.527727:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1334:41279:x1731746396296320:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.527727:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12019 00010000:00010000:1.0:1651529344.527730:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.527732:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000018c74a51/0x3234de053c4f6de lrc: 4/0,0 mode: PR/PR res: [0x2b619:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8e0e expref: 1333 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.527733:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12021 00000100:00100000:0.0:1651529344.527744:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1333:41279:x1731746396296000:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.527745:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000018c74a51/0x3234de053c4f6de lrc: 3/0,0 mode: PR/PR res: [0x2b619:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8e0e expref: 1333 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.527747:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.527748:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000087aa8a9/0x3234de053c4cad8 lrc: 4/0,0 mode: PR/PR res: [0x2b614:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd16 expref: 1333 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.527750:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018c74a51/0x3234de053c4f6de lrc: 0/0,0 mode: --/PR res: [0x2b619:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8e0e expref: 1333 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.527752:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000087aa8a9/0x3234de053c4cad8 lrc: 3/0,0 mode: PR/PR res: [0x2b614:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd16 expref: 1333 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.527754:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.527755:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.527755:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50c40 lrc: 3/0,1 mode: PW/PW res: [0x2b619:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.527758:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50c40 lrc: 4/0,1 mode: PW/PW res: [0x2b619:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527758:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000087aa8a9/0x3234de053c4cad8 lrc: 0/0,0 mode: --/PR res: [0x2b614:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd16 expref: 1332 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.527761:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.527762:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.527763:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c50c24 lrc: 3/0,1 mode: PW/PW res: [0x2b614:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.527767:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.527772:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c50c24 lrc: 4/0,1 mode: PW/PW res: [0x2b614:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.527773:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1331:41279:x1731746396296320:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 45us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.527776:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12020 00000100:00100000:1.0:1651529344.527780:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12022 00010000:00010000:0.0:1651529344.527784:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.527788:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007fca8239 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1330:41279:x1731746396296384:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.527790:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1330:41279:x1731746396296000:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 46us (202us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.527791:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.527793:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007e9c67e9/0x3234de053c4cc7c lrc: 4/0,0 mode: PR/PR res: [0x2b618:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce3d7 expref: 1330 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.527793:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12021 00010000:00010000:1.0:1651529344.527796:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007e9c67e9/0x3234de053c4cc7c lrc: 3/0,0 mode: PR/PR res: [0x2b618:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce3d7 expref: 1329 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.527798:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12023 00000100:00100000:0.0:1651529344.527800:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000f76b19f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1329:41279:x1731746396296256:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.527801:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e9c67e9/0x3234de053c4cc7c lrc: 0/0,0 mode: --/PR res: [0x2b618:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce3d7 expref: 1329 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.527802:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.527804:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008fe2031b/0x3234de053c4c639 lrc: 4/0,0 mode: PR/PR res: [0x2b616:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccad9 expref: 1329 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.527807:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.527807:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008fe2031b/0x3234de053c4c639 lrc: 3/0,0 mode: PR/PR res: [0x2b616:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccad9 expref: 1328 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.527808:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.527809:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000056ce51ac/0x3234de053c50c47 lrc: 3/0,1 mode: PW/PW res: [0x2b618:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.527811:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056ce51ac/0x3234de053c50c47 lrc: 4/0,1 mode: PW/PW res: [0x2b618:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527812:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008fe2031b/0x3234de053c4c639 lrc: 0/0,0 mode: --/PR res: [0x2b616:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccad9 expref: 1328 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.527816:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.527816:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.527817:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.527817:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50c39 lrc: 3/0,1 mode: PW/PW res: [0x2b616:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527820:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50c39 lrc: 4/0,1 mode: PW/PW res: [0x2b616:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.527822:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007fca8239 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1327:41279:x1731746396296384:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 40us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.527825:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12022 00010000:00010000:0.0:1651529344.527828:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.527833:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000f76b19f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1326:41279:x1731746396296256:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 33us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.527835:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12024 00000100:00100000:1.0:1651529344.527837:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ea32140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1326:41279:x1731746396296512:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.527837:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12023 00010000:00010000:1.0:1651529344.527839:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.527841:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d8c4e5e5/0x3234de053c4ed4c lrc: 4/0,0 mode: PR/PR res: [0x2b61a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d671e expref: 1325 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.527845:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d8c4e5e5/0x3234de053c4ed4c lrc: 3/0,0 mode: PR/PR res: [0x2b61a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d671e expref: 1325 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.527845:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12025 00000100:00100000:0.0:1651529344.527846:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1325:41279:x1731746396296640:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.527849:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8c4e5e5/0x3234de053c4ed4c lrc: 0/0,0 mode: --/PR res: [0x2b61a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d671e expref: 1325 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.527849:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.527850:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009203d64e/0x3234de053c4f6d7 lrc: 4/0,0 mode: PR/PR res: [0x2b61b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8e07 expref: 1325 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.527853:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.527853:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.527854:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0efadcd/0x3234de053c50c4e lrc: 3/0,1 mode: PW/PW res: [0x2b61a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527854:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009203d64e/0x3234de053c4f6d7 lrc: 3/0,0 mode: PR/PR res: [0x2b61b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8e07 expref: 1324 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.527857:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0efadcd/0x3234de053c50c4e lrc: 4/0,1 mode: PW/PW res: [0x2b61a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527859:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009203d64e/0x3234de053c4f6d7 lrc: 0/0,0 mode: --/PR res: [0x2b61b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8e07 expref: 1324 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.527862:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.527863:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.527863:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.527863:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50c55 lrc: 3/0,1 mode: PW/PW res: [0x2b61b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527866:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50c55 lrc: 4/0,1 mode: PW/PW res: [0x2b61b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.527868:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ea32140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1323:41279:x1731746396296512:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 30us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.527870:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12024 00010000:00010000:0.0:1651529344.527872:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.527877:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a0efadcd/0x3234de053c50c4e lrc: 3/0,1 mode: PW/PW res: [0x2b61a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.527877:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1322:41279:x1731746396296640:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 31us (261us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.527880:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0efadcd/0x3234de053c50c4e lrc: 3/0,1 mode: PW/PW res: [0x2b61a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.527880:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12025 00010000:00010000:1.0:1651529344.527883:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0efadcd/0x3234de053c50c4e lrc: 3/0,1 mode: PW/PW res: [0x2b61a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.527886:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0efadcd/0x3234de053c50c4e lrc: 2/0,0 mode: PW/PW res: [0x2b61a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527886:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50c40 lrc: 3/0,1 mode: PW/PW res: [0x2b619:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527889:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50c40 lrc: 3/0,1 mode: PW/PW res: [0x2b619:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527892:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50c40 lrc: 3/0,1 mode: PW/PW res: [0x2b619:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527895:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50c40 lrc: 2/0,0 mode: PW/PW res: [0x2b619:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.527932:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+739:39029:x1731745946415360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 980us (1028us total) trans 12885079291 rc 0/0 00000100:00100000:1.0:1651529344.527935:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211242 00010000:00010000:1.0:1651529344.527943:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0efadcd/0x3234de053c50c4e lrc: 2/0,0 mode: PW/PW res: [0x2b61a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.527948:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a0efadcd already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.527950:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0efadcd/0x3234de053c50c4e lrc: 2/0,0 mode: PW/PW res: [0x2b61a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.527952:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0efadcd/0x3234de053c50c4e lrc: 3/0,0 mode: PW/PW res: [0x2b61a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.527957:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0efadcd/0x3234de053c50c4e lrc: 1/0,0 mode: --/PW res: [0x2b61a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.527958:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+738:39029:x1731745946415296:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1112us (1260us total) trans 12885079292 rc 0/0 00010000:00010000:1.0:1651529344.527960:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0efadcd/0x3234de053c50c4e lrc: 0/0,0 mode: --/PW res: [0x2b61a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.527961:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211240 00010000:00010000:1.0:1651529344.527964:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50c40 lrc: 2/0,0 mode: PW/PW res: [0x2b619:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.527967:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003a73c8ff already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.527968:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50c40 lrc: 2/0,0 mode: PW/PW res: [0x2b619:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.527970:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50c40 lrc: 3/0,0 mode: PW/PW res: [0x2b619:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527970:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50c55 lrc: 3/0,1 mode: PW/PW res: [0x2b61b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.527974:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50c40 lrc: 1/0,0 mode: --/PW res: [0x2b619:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527974:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50c55 lrc: 3/0,1 mode: PW/PW res: [0x2b61b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.527976:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50c40 lrc: 0/0,0 mode: --/PW res: [0x2b619:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527977:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50c55 lrc: 3/0,1 mode: PW/PW res: [0x2b61b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.527979:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50c55 lrc: 2/0,0 mode: PW/PW res: [0x2b61b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.527982:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000056ce51ac/0x3234de053c50c47 lrc: 3/0,1 mode: PW/PW res: [0x2b618:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.527985:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056ce51ac/0x3234de053c50c47 lrc: 3/0,1 mode: PW/PW res: [0x2b618:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.527988:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056ce51ac/0x3234de053c50c47 lrc: 3/0,1 mode: PW/PW res: [0x2b618:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.527991:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056ce51ac/0x3234de053c50c47 lrc: 2/0,0 mode: PW/PW res: [0x2b618:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.528025:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+739:39030:x1731745946415424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1032us (1098us total) trans 12885079293 rc 0/0 00000100:00100000:1.0:1651529344.528028:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+739:39030:x1731745946415232:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1141us (1322us total) trans 12885079294 rc 0/0 00000100:00100000:0.0:1651529344.528030:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211243 00000100:00100000:1.0:1651529344.528031:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211241 00010000:00010000:0.0:1651529344.528037:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50c55 lrc: 2/0,0 mode: PW/PW res: [0x2b61b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.528039:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c50c32 lrc: 3/0,1 mode: PW/PW res: [0x2b617:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528040:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000048b51e47 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.528041:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50c55 lrc: 2/0,0 mode: PW/PW res: [0x2b61b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.528042:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c50c32 lrc: 3/0,1 mode: PW/PW res: [0x2b617:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528044:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50c55 lrc: 3/0,0 mode: PW/PW res: [0x2b61b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.528045:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c50c32 lrc: 3/0,1 mode: PW/PW res: [0x2b617:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.528047:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c50c32 lrc: 2/0,0 mode: PW/PW res: [0x2b617:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528049:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50c55 lrc: 1/0,0 mode: --/PW res: [0x2b61b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528052:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50c55 lrc: 0/0,0 mode: --/PW res: [0x2b61b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528056:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056ce51ac/0x3234de053c50c47 lrc: 2/0,0 mode: PW/PW res: [0x2b618:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528059:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000056ce51ac already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.528059:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056ce51ac/0x3234de053c50c47 lrc: 2/0,0 mode: PW/PW res: [0x2b618:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528062:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056ce51ac/0x3234de053c50c47 lrc: 3/0,0 mode: PW/PW res: [0x2b618:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528068:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056ce51ac/0x3234de053c50c47 lrc: 1/0,0 mode: --/PW res: [0x2b618:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528071:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056ce51ac/0x3234de053c50c47 lrc: 0/0,0 mode: --/PW res: [0x2b618:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528074:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c50c32 lrc: 2/0,0 mode: PW/PW res: [0x2b617:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528077:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007104c91e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.528077:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c50c32 lrc: 2/0,0 mode: PW/PW res: [0x2b617:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528080:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c50c32 lrc: 3/0,0 mode: PW/PW res: [0x2b617:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.528081:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+738:39029:x1731745946415168:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1292us (1450us total) trans 12885079295 rc 0/0 00010000:00010000:0.0:1651529344.528083:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c50c32 lrc: 1/0,0 mode: --/PW res: [0x2b617:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.528084:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211238 00010000:00010000:0.0:1651529344.528086:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c50c32 lrc: 0/0,0 mode: --/PW res: [0x2b617:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.528090:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50c39 lrc: 3/0,1 mode: PW/PW res: [0x2b616:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528091:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50c2b lrc: 3/0,1 mode: PW/PW res: [0x2b615:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.528093:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50c39 lrc: 3/0,1 mode: PW/PW res: [0x2b616:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528094:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50c2b lrc: 3/0,1 mode: PW/PW res: [0x2b615:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.528096:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50c39 lrc: 3/0,1 mode: PW/PW res: [0x2b616:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.528099:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50c39 lrc: 2/0,0 mode: PW/PW res: [0x2b616:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528099:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50c2b lrc: 3/0,1 mode: PW/PW res: [0x2b615:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528102:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50c2b lrc: 2/0,0 mode: PW/PW res: [0x2b615:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.528135:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085af61db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+739:39030:x1731745946415104:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1303us (1476us total) trans 12885079296 rc 0/0 00000100:00100000:1.0:1651529344.528138:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211239 00010000:00010000:1.0:1651529344.528144:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c50c24 lrc: 3/0,1 mode: PW/PW res: [0x2b614:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.528145:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+738:39029:x1731745946415040:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1437us (1559us total) trans 12885079297 rc 0/0 00010000:00010000:1.0:1651529344.528147:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c50c24 lrc: 3/0,1 mode: PW/PW res: [0x2b614:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.528148:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211236 00010000:00010000:1.0:1651529344.528150:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c50c24 lrc: 3/0,1 mode: PW/PW res: [0x2b614:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.528155:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c50c24 lrc: 2/0,0 mode: PW/PW res: [0x2b614:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528155:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50c39 lrc: 2/0,0 mode: PW/PW res: [0x2b616:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528158:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cdc65e28 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.528159:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50c39 lrc: 2/0,0 mode: PW/PW res: [0x2b616:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528162:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50c39 lrc: 3/0,0 mode: PW/PW res: [0x2b616:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528166:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50c39 lrc: 1/0,0 mode: --/PW res: [0x2b616:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528169:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50c39 lrc: 0/0,0 mode: --/PW res: [0x2b616:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528173:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50c2b lrc: 2/0,0 mode: PW/PW res: [0x2b615:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528176:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e0e037e6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.528177:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50c2b lrc: 2/0,0 mode: PW/PW res: [0x2b615:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528180:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50c2b lrc: 3/0,0 mode: PW/PW res: [0x2b615:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528183:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50c2b lrc: 1/0,0 mode: --/PW res: [0x2b615:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.528184:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+738:39030:x1731745946414976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1463us (1584us total) trans 12885079298 rc 0/0 00010000:00010000:0.0:1651529344.528186:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50c2b lrc: 0/0,0 mode: --/PW res: [0x2b615:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.528187:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211237 00010000:00010000:0.0:1651529344.528189:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c50c24 lrc: 2/0,0 mode: PW/PW res: [0x2b614:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528192:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000760c4860 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.528192:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c50c24 lrc: 2/0,0 mode: PW/PW res: [0x2b614:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528195:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c50c24 lrc: 3/0,0 mode: PW/PW res: [0x2b614:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528198:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c50c24 lrc: 1/0,0 mode: --/PW res: [0x2b614:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528200:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c50c24 lrc: 0/0,0 mode: --/PW res: [0x2b614:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.528402:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.528422:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.528433:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946416128 00000100:00100000:0.0:1651529344.528434:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946416192 00000100:00100000:1.0:1651529344.528440:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211244 00000100:00100000:0.0:1651529344.528446:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211245 00000100:00100000:1.0:1651529344.528447:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+739:39030:x1731745946416128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.528448:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000683df145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+739:39030:x1731745946416192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.528453:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177692 count 1 00002000:00080000:0.0:1651529344.528454:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177693 count 1 00010000:00010000:1.0:1651529344.528458:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1634cb6/0x3234de053c50c5c lrc: 3/0,1 mode: --/PW res: [0x2b61c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528458:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50c63 lrc: 3/0,1 mode: --/PW res: [0x2b61d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.528463:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000082b0fbe4/0x3234de053c4d1ae lrc: 2/0,0 mode: PR/PR res: [0x2b61c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf83d expref: 1321 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.528463:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000033984e72/0x3234de053c4a2fa lrc: 2/0,0 mode: PR/PR res: [0x2b61d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb9d0 expref: 1321 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.528466:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.528466:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.528466:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.528467:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1634cb6/0x3234de053c50c5c lrc: 4/0,1 mode: --/PW res: [0x2b61c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528467:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.528468:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50c63 lrc: 4/0,1 mode: --/PW res: [0x2b61d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.528474:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000082b0fbe4/0x3234de053c4d1ae lrc: 3/0,0 mode: PR/PR res: [0x2b61c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf83d expref: 1321 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.528480:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000082b0fbe4/0x3234de053c4d1ae lrc: 4/0,0 mode: PR/PR res: [0x2b61c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf83d expref: 1321 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.528485:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000007fba516 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996986368:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.528496:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a6b79b05 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.528505:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000033984e72/0x3234de053c4a2fa lrc: 3/0,0 mode: PR/PR res: [0x2b61d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb9d0 expref: 1321 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.528517:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000033984e72/0x3234de053c4a2fa lrc: 4/0,0 mode: PR/PR res: [0x2b61d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb9d0 expref: 1321 pid: 106695 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.528522:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000054e3a257 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996986432:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.528532:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b81e4a0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.528533:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.528541:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.528547:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.528553:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.528568:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946416320 00000100:00100000:1.0:1651529344.528569:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.528579:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.528583:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946416256 00000100:00100000:1.0:1651529344.528593:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946416384 00000100:00100000:0.0:1651529344.528595:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946416448 00000100:00100000:1.0:1651529344.528602:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946416512 00000100:00100000:0.0:1651529344.528609:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946416576 00000100:00100000:1.0:1651529344.528611:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211246 00000100:00100000:1.0:1651529344.528613:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+745:39029:x1731745946416320:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.528614:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211247 00000100:00100000:0.0:1651529344.528616:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+745:39030:x1731745946416256:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.528618:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177695 count 1 00002000:00080000:0.0:1651529344.528621:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177694 count 1 00010000:00010000:1.0:1651529344.528623:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c50c6a lrc: 3/0,1 mode: --/PW res: [0x2b61f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528625:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50c71 lrc: 3/0,1 mode: --/PW res: [0x2b61e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.528627:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff100ff0/0x3234de053c4ce19 lrc: 2/0,0 mode: PR/PR res: [0x2b61f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce9b8 expref: 1321 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.528630:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.528630:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000db89c39d/0x3234de053c4cc44 lrc: 2/0,0 mode: PR/PR res: [0x2b61e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce2a3 expref: 1321 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.528631:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.528632:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c50c6a lrc: 4/0,1 mode: --/PW res: [0x2b61f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528633:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.528634:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.528634:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50c71 lrc: 4/0,1 mode: --/PW res: [0x2b61e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.528641:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ff100ff0/0x3234de053c4ce19 lrc: 3/0,0 mode: PR/PR res: [0x2b61f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce9b8 expref: 1321 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.528641:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000db89c39d/0x3234de053c4cc44 lrc: 3/0,0 mode: PR/PR res: [0x2b61e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce2a3 expref: 1321 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.528645:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ff100ff0/0x3234de053c4ce19 lrc: 4/0,0 mode: PR/PR res: [0x2b61f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce9b8 expref: 1321 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.528645:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000db89c39d/0x3234de053c4cc44 lrc: 4/0,0 mode: PR/PR res: [0x2b61e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce2a3 expref: 1321 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.528649:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a9b051f pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996986496:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.528649:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae466fbb pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996986560:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.528663:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 0000000071742acc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.528668:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed830649 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.528670:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211248 00000100:00100000:1.0:1651529344.528671:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+745:39030:x1731745946416384:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.528674:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211249 00002000:00080000:1.0:1651529344.528676:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177696 count 1 00000100:00100000:0.0:1651529344.528676:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+745:39030:x1731745946416448:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.528679:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005121546f/0x3234de053c50c78 lrc: 3/0,1 mode: --/PW res: [0x2b620:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.528681:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177697 count 1 00010000:00010000:1.0:1651529344.528684:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b3443fb0/0x3234de053c4d4e1 lrc: 2/0,0 mode: PR/PR res: [0x2b620:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d05b1 expref: 1321 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.528684:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50c7f lrc: 3/0,1 mode: --/PW res: [0x2b621:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.528687:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.528687:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.528688:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005121546f/0x3234de053c50c78 lrc: 4/0,1 mode: --/PW res: [0x2b620:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528688:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006095ec8a/0x3234de053c4cc67 lrc: 2/0,0 mode: PR/PR res: [0x2b621:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce383 expref: 1321 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.528691:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.528692:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.528693:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50c7f lrc: 4/0,1 mode: --/PW res: [0x2b621:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.528694:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b3443fb0/0x3234de053c4d4e1 lrc: 3/0,0 mode: PR/PR res: [0x2b620:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d05b1 expref: 1321 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.528698:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b3443fb0/0x3234de053c4d4e1 lrc: 4/0,0 mode: PR/PR res: [0x2b620:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d05b1 expref: 1321 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.528699:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006095ec8a/0x3234de053c4cc67 lrc: 3/0,0 mode: PR/PR res: [0x2b621:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce383 expref: 1321 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.528702:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996986624:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.528702:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006095ec8a/0x3234de053c4cc67 lrc: 4/0,0 mode: PR/PR res: [0x2b621:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce383 expref: 1321 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.528706:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006aa45e66 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996986688:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.528708:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a5495eb going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.528713:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000003ad73843 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.528714:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211250 00000100:00100000:1.0:1651529344.528715:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+745:39030:x1731745946416512:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.528719:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177698 count 1 00000100:00100000:0.0:1651529344.528719:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211251 00000100:00100000:0.0:1651529344.528721:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+745:39030:x1731745946416576:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.528722:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8e15fbe/0x3234de053c50c86 lrc: 3/0,1 mode: --/PW res: [0x2b622:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.528725:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177699 count 1 00010000:00010000:1.0:1651529344.528726:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000072d3aeed/0x3234de053c4dc89 lrc: 2/0,0 mode: PR/PR res: [0x2b622:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d228a expref: 1321 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.528729:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.528730:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.528730:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8e15fbe/0x3234de053c50c86 lrc: 4/0,1 mode: --/PW res: [0x2b622:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.528745:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000072d3aeed/0x3234de053c4dc89 lrc: 3/0,0 mode: PR/PR res: [0x2b622:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d228a expref: 1321 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.528749:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000072d3aeed/0x3234de053c4dc89 lrc: 4/0,0 mode: PR/PR res: [0x2b622:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d228a expref: 1321 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.528753:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000703c0db9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996986752:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.528758:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50c8d lrc: 3/0,1 mode: --/PW res: [0x2b623:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528763:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000564fae6d/0x3234de053c4d081 lrc: 2/0,0 mode: PR/PR res: [0x2b623:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf39e expref: 1321 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.528766:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e5f43e7 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.528766:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.528767:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.528768:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50c8d lrc: 4/0,1 mode: --/PW res: [0x2b623:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528775:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000564fae6d/0x3234de053c4d081 lrc: 3/0,0 mode: PR/PR res: [0x2b623:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf39e expref: 1321 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.528779:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000564fae6d/0x3234de053c4d081 lrc: 4/0,0 mode: PR/PR res: [0x2b623:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf39e expref: 1321 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.528783:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000057329b82 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996986816:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.528791:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c2b2b59c going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.528812:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000007fba516 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996986368:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.528816:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c1634cb6/0x3234de053c50c5c lrc: 3/0,1 mode: --/PW res: [0x2b61c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.528877:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.528886:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.528906:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000054e3a257 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996986432:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.528908:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396296896 00010000:00010000:1.0:1651529344.528913:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000082b0fbe4/0x3234de053c4d1ae lrc: 4/0,0 mode: PR/PR res: [0x2b61c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf83d expref: 1322 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.528913:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50c63 lrc: 3/0,1 mode: --/PW res: [0x2b61d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.528920:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396296960 00010000:00010000:1.0:1651529344.528922:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000033984e72/0x3234de053c4a2fa lrc: 4/0,0 mode: PR/PR res: [0x2b61d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb9d0 expref: 1323 pid: 106695 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.528928:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12026 00000100:00100000:1.0:1651529344.528930:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12027 00000100:00100000:0.0:1651529344.528931:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1323:41278:x1731746396296896:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.528932:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1323:41278:x1731746396296960:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.528935:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.528936:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000033984e72/0x3234de053c4a2fa lrc: 4/0,0 mode: PR/PR res: [0x2b61d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb9d0 expref: 1323 pid: 106695 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.528936:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.528939:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000082b0fbe4/0x3234de053c4d1ae lrc: 4/0,0 mode: PR/PR res: [0x2b61c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf83d expref: 1323 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.528940:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000033984e72/0x3234de053c4a2fa lrc: 3/0,0 mode: PR/PR res: [0x2b61d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb9d0 expref: 1323 pid: 106695 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.528945:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033984e72/0x3234de053c4a2fa lrc: 0/0,0 mode: --/PR res: [0x2b61d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb9d0 expref: 1323 pid: 106695 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.528945:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000082b0fbe4/0x3234de053c4d1ae lrc: 3/0,0 mode: PR/PR res: [0x2b61c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf83d expref: 1323 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.528949:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.528949:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.528950:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50c63 lrc: 3/0,1 mode: PW/PW res: [0x2b61d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528952:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082b0fbe4/0x3234de053c4d1ae lrc: 0/0,0 mode: --/PR res: [0x2b61c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf83d expref: 1322 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.528953:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50c63 lrc: 4/0,1 mode: PW/PW res: [0x2b61d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528959:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.528959:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.528962:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.528967:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c1634cb6/0x3234de053c50c5c lrc: 3/0,1 mode: PW/PW res: [0x2b61c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.528973:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1321:41278:x1731746396296960:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.528975:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12027 00010000:00010000:0.0:1651529344.528975:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1634cb6/0x3234de053c50c5c lrc: 4/0,1 mode: PW/PW res: [0x2b61c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.528985:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.528994:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c1634cb6/0x3234de053c50c5c lrc: 3/0,1 mode: PW/PW res: [0x2b61c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.528994:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1320:41278:x1731746396296896:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 63us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.528997:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12026 00010000:00010000:1.0:1651529344.528998:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1634cb6/0x3234de053c50c5c lrc: 3/0,1 mode: PW/PW res: [0x2b61c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.529001:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1634cb6/0x3234de053c50c5c lrc: 3/0,1 mode: PW/PW res: [0x2b61c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.529004:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1634cb6/0x3234de053c50c5c lrc: 2/0,0 mode: PW/PW res: [0x2b61c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.529005:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50c63 lrc: 3/0,1 mode: PW/PW res: [0x2b61d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.529009:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50c63 lrc: 3/0,1 mode: PW/PW res: [0x2b61d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.529012:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50c63 lrc: 3/0,1 mode: PW/PW res: [0x2b61d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.529014:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50c63 lrc: 2/0,0 mode: PW/PW res: [0x2b61d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.529045:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+747:39030:x1731745946416128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 602us (643us total) trans 12885079299 rc 0/0 00000100:00100000:1.0:1651529344.529048:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211244 00010000:00010000:1.0:1651529344.529054:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1634cb6/0x3234de053c50c5c lrc: 2/0,0 mode: PW/PW res: [0x2b61c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.529055:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000683df145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+746:39030:x1731745946416192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 606us (632us total) trans 12885079300 rc 0/0 00010000:00010000:1.0:1651529344.529058:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1634cb6 already unused, calling callback (0000000049fddea7) 00000100:00100000:0.0:1651529344.529058:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211245 00010000:00010000:1.0:1651529344.529059:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1634cb6/0x3234de053c50c5c lrc: 2/0,0 mode: PW/PW res: [0x2b61c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.529062:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1634cb6/0x3234de053c50c5c lrc: 3/0,0 mode: PW/PW res: [0x2b61c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.529067:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1634cb6/0x3234de053c50c5c lrc: 1/0,0 mode: --/PW res: [0x2b61c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.529069:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1634cb6/0x3234de053c50c5c lrc: 0/0,0 mode: --/PW res: [0x2b61c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.529073:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50c63 lrc: 2/0,0 mode: PW/PW res: [0x2b61d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.529076:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054065c33 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.529077:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50c63 lrc: 2/0,0 mode: PW/PW res: [0x2b61d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.529080:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50c63 lrc: 3/0,0 mode: PW/PW res: [0x2b61d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.529083:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50c63 lrc: 1/0,0 mode: --/PW res: [0x2b61d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.529085:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50c63 lrc: 0/0,0 mode: --/PW res: [0x2b61d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.529281:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.529291:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946416832 00000100:00100000:1.0:1651529344.529292:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.529298:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946416896 00000100:00100000:1.0:1651529344.529300:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211252 00000100:00100000:1.0:1651529344.529302:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+747:39029:x1731745946416832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.529304:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211253 00000100:00100000:0.0:1651529344.529306:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+747:39030:x1731745946416896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.529308:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177700 count 1 00002000:00080000:0.0:1651529344.529311:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177701 count 1 00010000:00010000:1.0:1651529344.529312:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50c94 lrc: 3/0,1 mode: --/PW res: [0x2b624:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.529315:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50c9b lrc: 3/0,1 mode: --/PW res: [0x2b625:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.529317:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000593b0113/0x3234de053c4d52e lrc: 2/0,0 mode: PR/PR res: [0x2b624:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d06bb expref: 1319 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.529320:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.529320:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e14890ec/0x3234de053c4ca99 lrc: 2/0,0 mode: PR/PR res: [0x2b625:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc0c expref: 1319 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.529321:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.529321:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50c94 lrc: 4/0,1 mode: --/PW res: [0x2b624:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.529323:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.529324:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.529325:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50c9b lrc: 4/0,1 mode: --/PW res: [0x2b625:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.529328:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000593b0113/0x3234de053c4d52e lrc: 3/0,0 mode: PR/PR res: [0x2b624:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d06bb expref: 1319 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.529332:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000593b0113/0x3234de053c4d52e lrc: 4/0,0 mode: PR/PR res: [0x2b624:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d06bb expref: 1319 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.529332:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e14890ec/0x3234de053c4ca99 lrc: 3/0,0 mode: PR/PR res: [0x2b625:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc0c expref: 1319 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.529336:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996986880:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.529350:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 0000000020dd7827 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.529371:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e14890ec/0x3234de053c4ca99 lrc: 4/0,0 mode: PR/PR res: [0x2b625:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc0c expref: 1319 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.529376:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006e3eb319 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996986944:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.529401:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 0000000009370c1d going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.529422:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a9b051f pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996986496:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.529427:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c50c6a lrc: 3/0,1 mode: --/PW res: [0x2b61f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.529462:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae466fbb pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996986560:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.529472:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50c71 lrc: 3/0,1 mode: --/PW res: [0x2b61e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.529478:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.529487:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.529490:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006aa45e66 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996986688:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.529493:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50c7f lrc: 3/0,1 mode: --/PW res: [0x2b621:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.529494:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.529499:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000057329b82 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996986816:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.529500:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.529501:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50c8d lrc: 3/0,1 mode: --/PW res: [0x2b623:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.529506:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.529508:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396297408 00000100:00100000:1.0:1651529344.529511:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.529512:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000db89c39d/0x3234de053c4cc44 lrc: 4/0,0 mode: PR/PR res: [0x2b61e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce2a3 expref: 1320 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.529518:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996986624:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.529518:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396297536 00010000:00010000:0.0:1651529344.529520:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000072d3aeed/0x3234de053c4dc89 lrc: 5/0,0 mode: PR/PR res: [0x2b622:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d228a expref: 1321 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.529522:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005121546f/0x3234de053c50c78 lrc: 3/0,1 mode: --/PW res: [0x2b620:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.529524:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396297344 00010000:00010000:0.0:1651529344.529527:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ff100ff0/0x3234de053c4ce19 lrc: 4/0,0 mode: PR/PR res: [0x2b61f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce9b8 expref: 1322 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.529528:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000703c0db9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996986752:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.529530:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d8e15fbe/0x3234de053c50c86 lrc: 3/0,1 mode: --/PW res: [0x2b622:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.529531:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396297472 00010000:00010000:0.0:1651529344.529533:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b3443fb0/0x3234de053c4d4e1 lrc: 4/0,0 mode: PR/PR res: [0x2b620:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d05b1 expref: 1323 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.529536:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396297600 00000100:00100000:0.0:1651529344.529537:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396297664 00010000:00010000:0.0:1651529344.529540:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000564fae6d/0x3234de053c4d081 lrc: 4/0,0 mode: PR/PR res: [0x2b623:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf39e expref: 1325 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.529541:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006095ec8a/0x3234de053c4cc67 lrc: 4/0,0 mode: PR/PR res: [0x2b621:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce383 expref: 1325 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.529545:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12028 00000100:00100000:0.0:1651529344.529546:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1325:41278:x1731746396297408:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.529548:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12029 00010000:00010000:0.0:1651529344.529549:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.529550:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000e855587 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1325:41278:x1731746396297536:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.529550:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000db89c39d/0x3234de053c4cc44 lrc: 4/0,0 mode: PR/PR res: [0x2b61e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce2a3 expref: 1325 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.529553:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.529554:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000072d3aeed/0x3234de053c4dc89 lrc: 4/0,0 mode: PR/PR res: [0x2b622:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d228a expref: 1325 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.529554:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000db89c39d/0x3234de053c4cc44 lrc: 3/0,0 mode: PR/PR res: [0x2b61e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce2a3 expref: 1325 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.529559:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db89c39d/0x3234de053c4cc44 lrc: 0/0,0 mode: --/PR res: [0x2b61e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce2a3 expref: 1325 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.529560:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000072d3aeed/0x3234de053c4dc89 lrc: 3/0,0 mode: PR/PR res: [0x2b622:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d228a expref: 1325 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.529563:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.529564:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.529564:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50c71 lrc: 3/0,1 mode: PW/PW res: [0x2b61e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.529566:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072d3aeed/0x3234de053c4dc89 lrc: 0/0,0 mode: --/PR res: [0x2b622:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d228a expref: 1324 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.529568:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50c71 lrc: 4/0,1 mode: PW/PW res: [0x2b61e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.529569:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.529570:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.529571:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d8e15fbe/0x3234de053c50c86 lrc: 3/0,1 mode: PW/PW res: [0x2b622:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.529574:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8e15fbe/0x3234de053c50c86 lrc: 4/0,1 mode: PW/PW res: [0x2b622:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.529574:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.529580:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.529582:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1323:41278:x1731746396297408:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.529585:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12028 00000100:00100000:1.0:1651529344.529587:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000e855587 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1323:41278:x1731746396297536:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.529589:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12029 00000100:00100000:0.0:1651529344.529591:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12030 00000100:00100000:0.0:1651529344.529593:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1321:41279:x1731746396297344:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.529595:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.529597:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ff100ff0/0x3234de053c4ce19 lrc: 4/0,0 mode: PR/PR res: [0x2b61f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce9b8 expref: 1321 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.529598:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12031 00000100:00100000:1.0:1651529344.529600:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1321:41279:x1731746396297472:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.529601:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ff100ff0/0x3234de053c4ce19 lrc: 3/0,0 mode: PR/PR res: [0x2b61f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce9b8 expref: 1321 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.529603:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.529604:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b3443fb0/0x3234de053c4d4e1 lrc: 4/0,0 mode: PR/PR res: [0x2b620:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d05b1 expref: 1321 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.529606:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff100ff0/0x3234de053c4ce19 lrc: 0/0,0 mode: --/PR res: [0x2b61f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce9b8 expref: 1321 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.529608:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b3443fb0/0x3234de053c4d4e1 lrc: 3/0,0 mode: PR/PR res: [0x2b620:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d05b1 expref: 1321 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.529613:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3443fb0/0x3234de053c4d4e1 lrc: 0/0,0 mode: --/PR res: [0x2b620:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d05b1 expref: 1321 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.529616:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.529617:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.529617:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005121546f/0x3234de053c50c78 lrc: 3/0,1 mode: PW/PW res: [0x2b620:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.529620:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005121546f/0x3234de053c50c78 lrc: 4/0,1 mode: PW/PW res: [0x2b620:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.529633:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.529634:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.529634:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.529635:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c50c6a lrc: 3/0,1 mode: PW/PW res: [0x2b61f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.529638:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c50c6a lrc: 4/0,1 mode: PW/PW res: [0x2b61f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.529639:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1319:41279:x1731746396297472:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.529642:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12031 00010000:00010000:0.0:1651529344.529646:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.529652:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12032 00000100:00100000:1.0:1651529344.529653:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1318:41278:x1731746396297664:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.529656:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.529657:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000564fae6d/0x3234de053c4d081 lrc: 4/0,0 mode: PR/PR res: [0x2b623:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf39e expref: 1318 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.529661:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000564fae6d/0x3234de053c4d081 lrc: 3/0,0 mode: PR/PR res: [0x2b623:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf39e expref: 1318 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.529666:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000564fae6d/0x3234de053c4d081 lrc: 0/0,0 mode: --/PR res: [0x2b623:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf39e expref: 1318 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.529673:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1318:41279:x1731746396297344:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 78us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.529676:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12030 00010000:00010000:1.0:1651529344.529679:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.529680:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.529681:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50c8d lrc: 3/0,1 mode: PW/PW res: [0x2b623:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.529681:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12033 00000100:00100000:0.0:1651529344.529683:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1316:41279:x1731746396297600:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.529684:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50c8d lrc: 4/0,1 mode: PW/PW res: [0x2b623:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.529686:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.529687:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006095ec8a/0x3234de053c4cc67 lrc: 4/0,0 mode: PR/PR res: [0x2b621:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce383 expref: 1316 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.529693:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.529698:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006095ec8a/0x3234de053c4cc67 lrc: 3/0,0 mode: PR/PR res: [0x2b621:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce383 expref: 1316 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.529699:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1316:41278:x1731746396297664:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 45us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.529702:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12032 00010000:00010000:0.0:1651529344.529704:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006095ec8a/0x3234de053c4cc67 lrc: 0/0,0 mode: --/PR res: [0x2b621:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce383 expref: 1316 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.529707:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.529708:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.529709:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50c7f lrc: 3/0,1 mode: PW/PW res: [0x2b621:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.529710:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d8e15fbe/0x3234de053c50c86 lrc: 3/0,1 mode: PW/PW res: [0x2b622:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.529712:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50c7f lrc: 4/0,1 mode: PW/PW res: [0x2b621:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.529713:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8e15fbe/0x3234de053c50c86 lrc: 3/0,1 mode: PW/PW res: [0x2b622:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.529716:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8e15fbe/0x3234de053c50c86 lrc: 3/0,1 mode: PW/PW res: [0x2b622:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.529718:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.529719:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8e15fbe/0x3234de053c50c86 lrc: 2/0,0 mode: PW/PW res: [0x2b622:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.529724:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1314:41279:x1731746396297600:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 41us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.529732:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12033 00010000:00010000:0.0:1651529344.529750:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8e15fbe/0x3234de053c50c86 lrc: 2/0,0 mode: PW/PW res: [0x2b622:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.529753:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d8e15fbe already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.529754:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8e15fbe/0x3234de053c50c86 lrc: 2/0,0 mode: PW/PW res: [0x2b622:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.529757:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8e15fbe/0x3234de053c50c86 lrc: 3/0,0 mode: PW/PW res: [0x2b622:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.529762:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8e15fbe/0x3234de053c50c86 lrc: 1/0,0 mode: --/PW res: [0x2b622:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.529765:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8e15fbe/0x3234de053c50c86 lrc: 0/0,0 mode: --/PW res: [0x2b622:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.529770:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50c7f lrc: 3/0,1 mode: PW/PW res: [0x2b621:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.529772:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+748:39030:x1731745946416512:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1055us (1202us total) trans 12885079301 rc 0/0 00010000:00010000:0.0:1651529344.529773:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50c7f lrc: 3/0,1 mode: PW/PW res: [0x2b621:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.529775:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211250 00010000:00010000:0.0:1651529344.529776:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50c7f lrc: 3/0,1 mode: PW/PW res: [0x2b621:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.529779:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50c7f lrc: 2/0,0 mode: PW/PW res: [0x2b621:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.529782:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c50c6a lrc: 3/0,1 mode: PW/PW res: [0x2b61f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.529786:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c50c6a lrc: 3/0,1 mode: PW/PW res: [0x2b61f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.529789:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c50c6a lrc: 3/0,1 mode: PW/PW res: [0x2b61f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.529791:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c50c6a lrc: 2/0,0 mode: PW/PW res: [0x2b61f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.529821:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+749:39030:x1731745946416448:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1144us (1267us total) trans 12885079302 rc 0/0 00000100:00100000:1.0:1651529344.529824:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+749:39029:x1731745946416320:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1211us (1291us total) trans 12885079303 rc 0/0 00000100:00100000:0.0:1651529344.529824:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211249 00000100:00100000:1.0:1651529344.529827:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211246 00010000:00010000:0.0:1651529344.529831:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50c7f lrc: 2/0,0 mode: PW/PW res: [0x2b621:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.529834:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c50c6a lrc: 2/0,0 mode: PW/PW res: [0x2b61f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.529835:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d44dd5ea already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.529835:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50c7f lrc: 2/0,0 mode: PW/PW res: [0x2b621:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.529837:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b3ecd1a6 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.529838:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c50c6a lrc: 2/0,0 mode: PW/PW res: [0x2b61f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.529839:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50c7f lrc: 3/0,0 mode: PW/PW res: [0x2b621:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.529841:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c50c6a lrc: 3/0,0 mode: PW/PW res: [0x2b61f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.529843:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50c7f lrc: 1/0,0 mode: --/PW res: [0x2b621:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.529845:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c50c6a lrc: 1/0,0 mode: --/PW res: [0x2b61f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.529846:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50c7f lrc: 0/0,0 mode: --/PW res: [0x2b621:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.529850:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c50c6a lrc: 0/0,0 mode: --/PW res: [0x2b61f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.529851:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50c8d lrc: 3/0,1 mode: PW/PW res: [0x2b623:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.529854:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50c8d lrc: 3/0,1 mode: PW/PW res: [0x2b623:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.529856:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005121546f/0x3234de053c50c78 lrc: 3/0,1 mode: PW/PW res: [0x2b620:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.529857:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50c8d lrc: 3/0,1 mode: PW/PW res: [0x2b623:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.529859:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005121546f/0x3234de053c50c78 lrc: 3/0,1 mode: PW/PW res: [0x2b620:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.529860:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50c8d lrc: 2/0,0 mode: PW/PW res: [0x2b623:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.529862:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005121546f/0x3234de053c50c78 lrc: 3/0,1 mode: PW/PW res: [0x2b620:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.529865:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005121546f/0x3234de053c50c78 lrc: 2/0,0 mode: PW/PW res: [0x2b620:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.529903:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+749:39030:x1731745946416576:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1182us (1324us total) trans 12885079304 rc 0/0 00000100:00100000:1.0:1651529344.529905:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+749:39030:x1731745946416384:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1233us (1357us total) trans 12885079305 rc 0/0 00000100:00100000:0.0:1651529344.529906:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211251 00000100:00100000:1.0:1651529344.529908:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211248 00010000:00010000:0.0:1651529344.529915:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50c8d lrc: 2/0,0 mode: PW/PW res: [0x2b623:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.529925:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009ad9989c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.529927:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50c8d lrc: 2/0,0 mode: PW/PW res: [0x2b623:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.529932:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50c8d lrc: 3/0,0 mode: PW/PW res: [0x2b623:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.529946:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.529948:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50c8d lrc: 1/0,0 mode: --/PW res: [0x2b623:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.529957:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50c8d lrc: 0/0,0 mode: --/PW res: [0x2b623:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.529958:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.529962:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005121546f/0x3234de053c50c78 lrc: 2/0,0 mode: PW/PW res: [0x2b620:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.529964:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005121546f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.529965:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005121546f/0x3234de053c50c78 lrc: 2/0,0 mode: PW/PW res: [0x2b620:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.529968:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005121546f/0x3234de053c50c78 lrc: 3/0,0 mode: PW/PW res: [0x2b620:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.529972:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005121546f/0x3234de053c50c78 lrc: 1/0,0 mode: --/PW res: [0x2b620:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.529974:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005121546f/0x3234de053c50c78 lrc: 0/0,0 mode: --/PW res: [0x2b620:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.529981:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50c71 lrc: 3/0,1 mode: PW/PW res: [0x2b61e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.529984:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50c71 lrc: 3/0,1 mode: PW/PW res: [0x2b61e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.529987:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50c71 lrc: 3/0,1 mode: PW/PW res: [0x2b61e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.529990:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50c71 lrc: 2/0,0 mode: PW/PW res: [0x2b61e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.530031:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+748:39030:x1731745946416256:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1414us (1489us total) trans 12885079306 rc 0/0 00000100:00100000:0.0:1651529344.530034:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211247 00000100:00100000:0.0:1651529344.530045:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006e3eb319 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996986944:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.530062:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50c9b lrc: 3/0,1 mode: --/PW res: [0x2b625:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.530070:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396297920 00010000:00010000:0.0:1651529344.530074:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000593b0113/0x3234de053c4d52e lrc: 5/0,0 mode: PR/PR res: [0x2b624:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d06bb expref: 1314 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.530085:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396297984 00000100:00100000:1.0:1651529344.530087:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996986880:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.530088:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e14890ec/0x3234de053c4ca99 lrc: 4/0,0 mode: PR/PR res: [0x2b625:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc0c expref: 1315 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.530092:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50c94 lrc: 3/0,1 mode: --/PW res: [0x2b624:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.530100:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12034 00000100:00100000:1.0:1651529344.530102:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1315:41278:x1731746396297920:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.530105:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.530106:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000593b0113/0x3234de053c4d52e lrc: 4/0,0 mode: PR/PR res: [0x2b624:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d06bb expref: 1315 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.530115:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000593b0113/0x3234de053c4d52e lrc: 3/0,0 mode: PR/PR res: [0x2b624:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d06bb expref: 1315 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.530121:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000593b0113/0x3234de053c4d52e lrc: 0/0,0 mode: --/PR res: [0x2b624:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d06bb expref: 1315 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.530122:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12035 00000100:00100000:0.0:1651529344.530124:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1315:41278:x1731746396297984:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.530125:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.530126:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.530127:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50c94 lrc: 3/0,1 mode: PW/PW res: [0x2b624:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530128:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.530129:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e14890ec/0x3234de053c4ca99 lrc: 4/0,0 mode: PR/PR res: [0x2b625:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc0c expref: 1314 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.530130:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50c94 lrc: 4/0,1 mode: PW/PW res: [0x2b624:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530133:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e14890ec/0x3234de053c4ca99 lrc: 3/0,0 mode: PR/PR res: [0x2b625:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc0c expref: 1314 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.530136:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.530139:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e14890ec/0x3234de053c4ca99 lrc: 0/0,0 mode: --/PR res: [0x2b625:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc0c expref: 1314 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.530143:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.530144:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1313:41278:x1731746396297920:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (198us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.530144:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.530145:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50c9b lrc: 3/0,1 mode: PW/PW res: [0x2b625:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.530146:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12034 00010000:00010000:0.0:1651529344.530148:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50c9b lrc: 4/0,1 mode: PW/PW res: [0x2b625:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.530154:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50c71 lrc: 2/0,0 mode: PW/PW res: [0x2b61e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530155:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.530157:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000356aa683 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.530158:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50c71 lrc: 2/0,0 mode: PW/PW res: [0x2b61e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.530161:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50c71 lrc: 3/0,0 mode: PW/PW res: [0x2b61e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.530162:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1312:41278:x1731746396297984:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 37us (204us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.530165:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50c71 lrc: 1/0,0 mode: --/PW res: [0x2b61e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.530165:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12035 00010000:00010000:1.0:1651529344.530168:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50c71 lrc: 0/0,0 mode: --/PW res: [0x2b61e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530171:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50c9b lrc: 3/0,1 mode: PW/PW res: [0x2b625:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530174:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50c9b lrc: 3/0,1 mode: PW/PW res: [0x2b625:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.530175:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50c94 lrc: 3/0,1 mode: PW/PW res: [0x2b624:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530177:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50c9b lrc: 3/0,1 mode: PW/PW res: [0x2b625:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.530178:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50c94 lrc: 3/0,1 mode: PW/PW res: [0x2b624:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530180:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50c9b lrc: 2/0,0 mode: PW/PW res: [0x2b625:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.530181:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50c94 lrc: 3/0,1 mode: PW/PW res: [0x2b624:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.530183:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50c94 lrc: 2/0,0 mode: PW/PW res: [0x2b624:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.530241:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+748:39029:x1731745946416832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 938us (960us total) trans 12885079307 rc 0/0 00000100:00100000:1.0:1651529344.530244:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211252 00000100:00100000:1.0:1651529344.530279:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.530285:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+748:39030:x1731745946416896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 978us (992us total) trans 12885079308 rc 0/0 00000100:00100000:0.0:1651529344.530288:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211253 00000100:00100000:1.0:1651529344.530293:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.530293:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946417152 00000100:00100000:0.0:1651529344.530311:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946417280 00000100:00100000:1.0:1651529344.530314:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.530316:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211254 00000100:00100000:0.0:1651529344.530318:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+749:39030:x1731745946417152:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.530323:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177703 count 1 00010000:00010000:0.0:1651529344.530327:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50ca2 lrc: 3/0,1 mode: --/PW res: [0x2b627:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530332:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cded5bb0/0x3234de053c4cd40 lrc: 2/0,0 mode: PR/PR res: [0x2b627:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce6d2 expref: 1311 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.530335:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.530336:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.530337:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50ca2 lrc: 4/0,1 mode: --/PW res: [0x2b627:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.530342:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.530344:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cded5bb0/0x3234de053c4cd40 lrc: 3/0,0 mode: PR/PR res: [0x2b627:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce6d2 expref: 1311 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.530355:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cded5bb0/0x3234de053c4cd40 lrc: 4/0,0 mode: PR/PR res: [0x2b627:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce6d2 expref: 1311 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.530359:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006e3eb319 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996987008:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.530368:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a3b00cf3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.530370:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.530373:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50c9b lrc: 2/0,0 mode: PW/PW res: [0x2b625:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530376:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008f8dd346 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.530377:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50c9b lrc: 2/0,0 mode: PW/PW res: [0x2b625:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530380:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50c9b lrc: 3/0,0 mode: PW/PW res: [0x2b625:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530384:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50c9b lrc: 1/0,0 mode: --/PW res: [0x2b625:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530387:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50c9b lrc: 0/0,0 mode: --/PW res: [0x2b625:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530391:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50c94 lrc: 2/0,0 mode: PW/PW res: [0x2b624:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530396:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cff76789 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.530397:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50c94 lrc: 2/0,0 mode: PW/PW res: [0x2b624:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.530400:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.530400:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50c94 lrc: 3/0,0 mode: PW/PW res: [0x2b624:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530409:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50c94 lrc: 1/0,0 mode: --/PW res: [0x2b624:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.530410:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946417088 00010000:00010000:0.0:1651529344.530412:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50c94 lrc: 0/0,0 mode: --/PW res: [0x2b624:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.530419:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946417216 00000100:00100000:1.0:1651529344.530423:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946417344 00000100:00100000:0.0:1651529344.530425:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946417408 00000100:00100000:1.0:1651529344.530427:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211255 00000100:00100000:1.0:1651529344.530429:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+753:39030:x1731745946417280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.530432:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211256 00000100:00100000:0.0:1651529344.530433:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+753:39030:x1731745946417088:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.530435:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177705 count 1 00002000:00080000:0.0:1651529344.530438:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177702 count 1 00010000:00010000:1.0:1651529344.530439:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50ca9 lrc: 3/0,1 mode: --/PW res: [0x2b629:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530441:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50cb0 lrc: 3/0,1 mode: --/PW res: [0x2b626:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.530444:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000daf880b4/0x3234de053c4e1c2 lrc: 2/0,0 mode: PR/PR res: [0x2b629:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d385c expref: 1311 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.530446:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c4cbfe lrc: 2/0,0 mode: PR/PR res: [0x2b626:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce1bc expref: 1311 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.530447:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.530448:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.530448:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50ca9 lrc: 4/0,1 mode: --/PW res: [0x2b629:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530449:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.530449:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.530450:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50cb0 lrc: 4/0,1 mode: --/PW res: [0x2b626:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.530455:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000daf880b4/0x3234de053c4e1c2 lrc: 3/0,0 mode: PR/PR res: [0x2b629:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d385c expref: 1311 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.530459:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000daf880b4/0x3234de053c4e1c2 lrc: 4/0,0 mode: PR/PR res: [0x2b629:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d385c expref: 1311 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.530463:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ebb53b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996987072:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.530475:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a5495eb going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.530475:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c4cbfe lrc: 3/0,0 mode: PR/PR res: [0x2b626:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce1bc expref: 1311 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.530478:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c4cbfe lrc: 4/0,0 mode: PR/PR res: [0x2b626:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce1bc expref: 1311 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.530481:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211257 00000100:00100000:1.0:1651529344.530482:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+753:39030:x1731745946417216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.530482:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000057329b82 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996987136:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.530486:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177704 count 1 00010000:00010000:1.0:1651529344.530489:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50cb7 lrc: 3/0,1 mode: --/PW res: [0x2b628:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.530491:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed830649 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.530494:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000649b19f0/0x3234de053c4e6f4 lrc: 2/0,0 mode: PR/PR res: [0x2b628:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4cde expref: 1311 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.530497:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.530497:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.530498:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50cb7 lrc: 4/0,1 mode: --/PW res: [0x2b628:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.530499:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211258 00000100:00100000:0.0:1651529344.530500:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+753:39030:x1731745946417344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.530504:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000649b19f0/0x3234de053c4e6f4 lrc: 3/0,0 mode: PR/PR res: [0x2b628:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4cde expref: 1311 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.530505:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177706 count 1 00010000:00010000:1.0:1651529344.530507:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000649b19f0/0x3234de053c4e6f4 lrc: 4/0,0 mode: PR/PR res: [0x2b628:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4cde expref: 1311 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.530509:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50cbe lrc: 3/0,1 mode: --/PW res: [0x2b62a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.530511:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a573b31 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996987200:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.530513:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002d7b26d3/0x3234de053c4d2f7 lrc: 2/0,0 mode: PR/PR res: [0x2b62a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfde6 expref: 1311 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.530516:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.530517:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 0000000071742acc going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.530517:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.530517:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50cbe lrc: 4/0,1 mode: --/PW res: [0x2b62a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.530523:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211259 00010000:00010000:0.0:1651529344.530523:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002d7b26d3/0x3234de053c4d2f7 lrc: 3/0,0 mode: PR/PR res: [0x2b62a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfde6 expref: 1311 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.530524:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+753:39029:x1731745946417408:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.530528:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177707 count 1 00010000:00010000:1.0:1651529344.530531:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50cc5 lrc: 3/0,1 mode: --/PW res: [0x2b62b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.530535:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c923faf7/0x3234de053c4cbf0 lrc: 2/0,0 mode: PR/PR res: [0x2b62b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce192 expref: 1311 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.530538:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.530539:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.530539:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50cc5 lrc: 4/0,1 mode: --/PW res: [0x2b62b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530543:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002d7b26d3/0x3234de053c4d2f7 lrc: 4/0,0 mode: PR/PR res: [0x2b62a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfde6 expref: 1311 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.530545:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c923faf7/0x3234de053c4cbf0 lrc: 3/0,0 mode: PR/PR res: [0x2b62b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce192 expref: 1311 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.530548:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c923faf7/0x3234de053c4cbf0 lrc: 4/0,0 mode: PR/PR res: [0x2b62b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce192 expref: 1311 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.530566:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003de40890 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996987328:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.530567:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006aa45e66 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996987264:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.530582:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f9dac3f6 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.530594:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c2b2b59c going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.530596:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.530601:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946417792 00000100:00100000:0.0:1651529344.530626:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211260 00000100:00100000:0.0:1651529344.530628:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+754:39030:x1731745946417792:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.530629:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.530633:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177708 count 1 00010000:00010000:0.0:1651529344.530637:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50ccc lrc: 3/0,1 mode: --/PW res: [0x2b62c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530641:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff3c900b/0x3234de053c4f1b3 lrc: 2/0,0 mode: PR/PR res: [0x2b62c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d799a expref: 1311 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.530644:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.530645:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.530646:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50ccc lrc: 4/0,1 mode: --/PW res: [0x2b62c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530652:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ff3c900b/0x3234de053c4f1b3 lrc: 3/0,0 mode: PR/PR res: [0x2b62c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d799a expref: 1311 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.530653:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.530655:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ff3c900b/0x3234de053c4f1b3 lrc: 4/0,0 mode: PR/PR res: [0x2b62c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d799a expref: 1311 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.530659:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bca72234 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996987392:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.530668:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 0000000076b354b3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.530674:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946417856 00000100:00100000:0.0:1651529344.530679:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211261 00000100:00100000:0.0:1651529344.530681:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+755:39030:x1731745946417856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.530685:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177709 count 1 00010000:00010000:0.0:1651529344.530688:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50cd3 lrc: 3/0,1 mode: --/PW res: [0x2b62d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530692:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000074951e29/0x3234de053c4ebf5 lrc: 2/0,0 mode: PR/PR res: [0x2b62d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6159 expref: 1311 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.530695:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.530696:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.530696:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50cd3 lrc: 4/0,1 mode: --/PW res: [0x2b62d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530702:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000074951e29/0x3234de053c4ebf5 lrc: 3/0,0 mode: PR/PR res: [0x2b62d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6159 expref: 1311 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.530705:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000074951e29/0x3234de053c4ebf5 lrc: 4/0,0 mode: PR/PR res: [0x2b62d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6159 expref: 1311 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.530709:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dff6a73d pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996987456:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.530720:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bff8744a going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.530729:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396298048 00000100:00100000:0.0:1651529344.530729:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006e3eb319 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996987008:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.530733:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50ca2 lrc: 3/0,1 mode: --/PW res: [0x2b627:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.530744:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cded5bb0/0x3234de053c4cd40 lrc: 4/0,0 mode: PR/PR res: [0x2b627:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce6d2 expref: 1312 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.530753:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12036 00000100:00100000:1.0:1651529344.530755:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e29becaf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1312:41278:x1731746396298048:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.530759:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.530760:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cded5bb0/0x3234de053c4cd40 lrc: 4/0,0 mode: PR/PR res: [0x2b627:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce6d2 expref: 1312 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.530764:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cded5bb0/0x3234de053c4cd40 lrc: 3/0,0 mode: PR/PR res: [0x2b627:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce6d2 expref: 1312 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.530776:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cded5bb0/0x3234de053c4cd40 lrc: 0/0,0 mode: --/PR res: [0x2b627:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce6d2 expref: 1312 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.530780:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.530781:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.530781:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50ca2 lrc: 3/0,1 mode: PW/PW res: [0x2b627:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.530784:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50ca2 lrc: 4/0,1 mode: PW/PW res: [0x2b627:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.530794:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.530804:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e29becaf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1311:41278:x1731746396298048:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 49us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.530807:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12036 00010000:00010000:0.0:1651529344.530816:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50ca2 lrc: 3/0,1 mode: PW/PW res: [0x2b627:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530820:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50ca2 lrc: 3/0,1 mode: PW/PW res: [0x2b627:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530823:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50ca2 lrc: 3/0,1 mode: PW/PW res: [0x2b627:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.530826:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50ca2 lrc: 2/0,0 mode: PW/PW res: [0x2b627:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.530853:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50ca2 lrc: 2/0,0 mode: PW/PW res: [0x2b627:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.530857:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000017857b04 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.530858:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50ca2 lrc: 2/0,0 mode: PW/PW res: [0x2b627:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.530862:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50ca2 lrc: 3/0,0 mode: PW/PW res: [0x2b627:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.530867:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50ca2 lrc: 1/0,0 mode: --/PW res: [0x2b627:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.530869:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50ca2 lrc: 0/0,0 mode: --/PW res: [0x2b627:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.530874:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+756:39030:x1731745946417152:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 555us (595us total) trans 12885079309 rc 0/0 00000100:00100000:0.0:1651529344.530878:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211254 00000100:00100000:1.0:1651529344.530964:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ebb53b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996987072:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.530968:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50ca9 lrc: 3/0,1 mode: --/PW res: [0x2b629:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.530996:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000057329b82 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996987136:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.531000:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a573b31 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996987200:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.531001:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50cb0 lrc: 3/0,1 mode: --/PW res: [0x2b626:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.531003:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50cb7 lrc: 3/0,1 mode: --/PW res: [0x2b628:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.531044:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.531055:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946417984 00000100:00100000:0.0:1651529344.531065:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211262 00000100:00100000:0.0:1651529344.531067:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+756:39029:x1731745946417984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.531072:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177710 count 1 00010000:00010000:0.0:1651529344.531077:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50cda lrc: 3/0,1 mode: --/PW res: [0x2b62e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531084:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000009273683/0x3234de053c4b728 lrc: 2/0,0 mode: PR/PR res: [0x2b62e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc34d expref: 1310 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.531087:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.531087:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.531088:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50cda lrc: 4/0,1 mode: --/PW res: [0x2b62e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531095:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000009273683/0x3234de053c4b728 lrc: 3/0,0 mode: PR/PR res: [0x2b62e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc34d expref: 1310 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.531098:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009273683/0x3234de053c4b728 lrc: 4/0,0 mode: PR/PR res: [0x2b62e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc34d expref: 1310 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.531102:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000057329b82 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996987520:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.531114:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b81e4a0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.531208:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006aa45e66 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996987264:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.531212:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003de40890 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996987328:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.531212:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50cbe lrc: 3/0,1 mode: --/PW res: [0x2b62a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.531217:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50cc5 lrc: 3/0,1 mode: --/PW res: [0x2b62b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.531261:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bca72234 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996987392:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.531266:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50ccc lrc: 3/0,1 mode: --/PW res: [0x2b62c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.531289:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dff6a73d pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996987456:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.531293:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50cd3 lrc: 3/0,1 mode: --/PW res: [0x2b62d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.531304:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.531314:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396298304 00000100:00100000:0.0:1651529344.531317:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.531320:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c4cbfe lrc: 4/0,0 mode: PR/PR res: [0x2b626:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce1bc expref: 1311 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.531326:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.531333:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.531335:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396298432 00000100:00100000:0.0:1651529344.531337:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.531338:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c923faf7/0x3234de053c4cbf0 lrc: 4/0,0 mode: PR/PR res: [0x2b62b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce192 expref: 1312 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.531342:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396298240 00000100:00100000:0.0:1651529344.531342:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.531344:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000daf880b4/0x3234de053c4e1c2 lrc: 4/0,0 mode: PR/PR res: [0x2b629:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d385c expref: 1313 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.531347:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.531348:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396298560 00010000:00010000:1.0:1651529344.531350:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ff3c900b/0x3234de053c4f1b3 lrc: 4/0,0 mode: PR/PR res: [0x2b62c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d799a expref: 1314 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.531353:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396298368 00000100:00100000:1.0:1651529344.531354:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396298496 00010000:00010000:1.0:1651529344.531356:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002d7b26d3/0x3234de053c4d2f7 lrc: 4/0,0 mode: PR/PR res: [0x2b62a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfde6 expref: 1316 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.531358:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000649b19f0/0x3234de053c4e6f4 lrc: 4/0,0 mode: PR/PR res: [0x2b628:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4cde expref: 1316 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.531360:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396298624 00010000:00010000:1.0:1651529344.531363:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000074951e29/0x3234de053c4ebf5 lrc: 4/0,0 mode: PR/PR res: [0x2b62d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6159 expref: 1317 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.531365:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12037 00000100:00100000:0.0:1651529344.531367:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1317:41278:x1731746396298304:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.531368:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12038 00000100:00100000:1.0:1651529344.531369:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1317:41278:x1731746396298432:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.531369:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.531371:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c4cbfe lrc: 4/0,0 mode: PR/PR res: [0x2b626:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce1bc expref: 1317 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.531372:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.531373:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c923faf7/0x3234de053c4cbf0 lrc: 4/0,0 mode: PR/PR res: [0x2b62b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce192 expref: 1317 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.531374:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c4cbfe lrc: 3/0,0 mode: PR/PR res: [0x2b626:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce1bc expref: 1317 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.531379:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c923faf7/0x3234de053c4cbf0 lrc: 3/0,0 mode: PR/PR res: [0x2b62b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce192 expref: 1317 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.531380:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c4cbfe lrc: 0/0,0 mode: --/PR res: [0x2b626:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce1bc expref: 1317 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.531384:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.531385:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c923faf7/0x3234de053c4cbf0 lrc: 0/0,0 mode: --/PR res: [0x2b62b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce192 expref: 1316 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.531385:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.531386:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50cb0 lrc: 3/0,1 mode: PW/PW res: [0x2b626:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.531388:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.531389:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.531389:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50cb0 lrc: 4/0,1 mode: PW/PW res: [0x2b626:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.531390:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50cc5 lrc: 3/0,1 mode: PW/PW res: [0x2b62b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.531393:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50cc5 lrc: 4/0,1 mode: PW/PW res: [0x2b62b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531395:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.531399:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.531406:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1315:41278:x1731746396298304:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 39us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.531409:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12037 00000100:00100000:1.0:1651529344.531413:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1314:41278:x1731746396298432:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 43us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.531415:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12039 00000100:00100000:1.0:1651529344.531416:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12038 00000100:00100000:0.0:1651529344.531417:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1314:41279:x1731746396298240:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.531419:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.531421:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000daf880b4/0x3234de053c4e1c2 lrc: 4/0,0 mode: PR/PR res: [0x2b629:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d385c expref: 1313 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.531422:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12040 00000100:00100000:1.0:1651529344.531423:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1313:41278:x1731746396298560:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.531425:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000daf880b4/0x3234de053c4e1c2 lrc: 3/0,0 mode: PR/PR res: [0x2b629:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d385c expref: 1313 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.531426:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.531427:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ff3c900b/0x3234de053c4f1b3 lrc: 4/0,0 mode: PR/PR res: [0x2b62c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d799a expref: 1313 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.531429:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000daf880b4/0x3234de053c4e1c2 lrc: 0/0,0 mode: --/PR res: [0x2b629:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d385c expref: 1313 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.531431:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ff3c900b/0x3234de053c4f1b3 lrc: 3/0,0 mode: PR/PR res: [0x2b62c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d799a expref: 1313 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.531433:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.531433:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.531434:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50ca9 lrc: 3/0,1 mode: PW/PW res: [0x2b629:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.531436:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff3c900b/0x3234de053c4f1b3 lrc: 0/0,0 mode: --/PR res: [0x2b62c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d799a expref: 1312 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.531440:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.531440:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.531440:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50ca9 lrc: 4/0,1 mode: PW/PW res: [0x2b629:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.531441:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50ccc lrc: 3/0,1 mode: PW/PW res: [0x2b62c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.531444:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50ccc lrc: 4/0,1 mode: PW/PW res: [0x2b62c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531448:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.531453:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1311:41279:x1731746396298240:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 36us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.531456:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12039 00010000:00010000:1.0:1651529344.531458:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.531464:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1311:41278:x1731746396298560:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 40us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.531467:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12040 00000100:00100000:0.0:1651529344.531468:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12041 00000100:00100000:0.0:1651529344.531470:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1309:41279:x1731746396298496:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.531471:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12042 00000100:00100000:1.0:1651529344.531473:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1309:41279:x1731746396298368:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.531473:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.531474:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002d7b26d3/0x3234de053c4d2f7 lrc: 4/0,0 mode: PR/PR res: [0x2b62a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfde6 expref: 1309 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.531475:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.531477:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000649b19f0/0x3234de053c4e6f4 lrc: 4/0,0 mode: PR/PR res: [0x2b628:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4cde expref: 1309 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.531478:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002d7b26d3/0x3234de053c4d2f7 lrc: 3/0,0 mode: PR/PR res: [0x2b62a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfde6 expref: 1309 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.531480:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000649b19f0/0x3234de053c4e6f4 lrc: 3/0,0 mode: PR/PR res: [0x2b628:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4cde expref: 1309 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.531483:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d7b26d3/0x3234de053c4d2f7 lrc: 0/0,0 mode: --/PR res: [0x2b62a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfde6 expref: 1309 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.531485:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000649b19f0/0x3234de053c4e6f4 lrc: 0/0,0 mode: --/PR res: [0x2b628:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4cde expref: 1309 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.531486:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.531487:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.531488:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50cbe lrc: 3/0,1 mode: PW/PW res: [0x2b62a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531490:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50cbe lrc: 4/0,1 mode: PW/PW res: [0x2b62a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.531491:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.531491:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.531492:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50cb7 lrc: 3/0,1 mode: PW/PW res: [0x2b628:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.531495:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50cb7 lrc: 4/0,1 mode: PW/PW res: [0x2b628:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531499:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.531501:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.531504:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1307:41279:x1731746396298496:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.531505:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1307:41279:x1731746396298368:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.531506:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12041 00000100:00100000:1.0:1651529344.531508:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12042 00000100:00100000:0.0:1651529344.531511:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12043 00000100:00100000:0.0:1651529344.531512:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e45eb301 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1305:41279:x1731746396298624:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.531514:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.531516:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50ca9 lrc: 3/0,1 mode: PW/PW res: [0x2b629:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531516:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000074951e29/0x3234de053c4ebf5 lrc: 4/0,0 mode: PR/PR res: [0x2b62d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6159 expref: 1305 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.531519:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50ca9 lrc: 3/0,1 mode: PW/PW res: [0x2b629:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531519:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000074951e29/0x3234de053c4ebf5 lrc: 3/0,0 mode: PR/PR res: [0x2b62d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6159 expref: 1305 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.531522:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50ca9 lrc: 3/0,1 mode: PW/PW res: [0x2b629:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531524:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074951e29/0x3234de053c4ebf5 lrc: 0/0,0 mode: --/PR res: [0x2b62d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6159 expref: 1305 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.531525:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50ca9 lrc: 2/0,0 mode: PW/PW res: [0x2b629:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531527:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.531528:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.531528:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50cd3 lrc: 3/0,1 mode: PW/PW res: [0x2b62d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531537:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50cd3 lrc: 4/0,1 mode: PW/PW res: [0x2b62d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531543:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.531548:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e45eb301 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1304:41279:x1731746396298624:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.531551:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12043 00000100:00100000:1.0:1651529344.531572:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+757:39030:x1731745946417280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1142us (1278us total) trans 12885079310 rc 0/0 00000100:00100000:1.0:1651529344.531575:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211255 00010000:00010000:1.0:1651529344.531582:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50cb7 lrc: 3/0,1 mode: PW/PW res: [0x2b628:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531588:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50ca9 lrc: 2/0,0 mode: PW/PW res: [0x2b629:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531593:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dc65d2aa already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.531594:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50cb7 lrc: 3/0,1 mode: PW/PW res: [0x2b628:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531594:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50ca9 lrc: 2/0,0 mode: PW/PW res: [0x2b629:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.531597:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50cb7 lrc: 3/0,1 mode: PW/PW res: [0x2b628:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531597:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50ca9 lrc: 3/0,0 mode: PW/PW res: [0x2b629:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.531600:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50cb7 lrc: 2/0,0 mode: PW/PW res: [0x2b628:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531602:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50ca9 lrc: 1/0,0 mode: --/PW res: [0x2b629:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531604:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50ca9 lrc: 0/0,0 mode: --/PW res: [0x2b629:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531614:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50cb7 lrc: 2/0,0 mode: PW/PW res: [0x2b628:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531617:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2a2495 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.531618:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50cb7 lrc: 2/0,0 mode: PW/PW res: [0x2b628:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531621:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50cb7 lrc: 3/0,0 mode: PW/PW res: [0x2b628:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531626:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50cb7 lrc: 1/0,0 mode: --/PW res: [0x2b628:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531629:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50cb7 lrc: 0/0,0 mode: --/PW res: [0x2b628:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531635:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50cb0 lrc: 3/0,1 mode: PW/PW res: [0x2b626:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.531637:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+757:39030:x1731745946417216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1154us (1295us total) trans 12885079311 rc 0/0 00010000:00010000:0.0:1651529344.531638:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50cb0 lrc: 3/0,1 mode: PW/PW res: [0x2b626:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.531640:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211257 00010000:00010000:0.0:1651529344.531641:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50cb0 lrc: 3/0,1 mode: PW/PW res: [0x2b626:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531644:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50cb0 lrc: 2/0,0 mode: PW/PW res: [0x2b626:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.531647:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50cc5 lrc: 3/0,1 mode: PW/PW res: [0x2b62b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.531656:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50cc5 lrc: 3/0,1 mode: PW/PW res: [0x2b62b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.531660:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50cc5 lrc: 3/0,1 mode: PW/PW res: [0x2b62b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.531663:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50cc5 lrc: 2/0,0 mode: PW/PW res: [0x2b62b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.531706:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+758:39030:x1731745946417088:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1272us (1391us total) trans 12885079312 rc 0/0 00000100:00100000:1.0:1651529344.531707:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+758:39029:x1731745946417408:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1182us (1307us total) trans 12885079313 rc 0/0 00000100:00100000:0.0:1651529344.531709:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211256 00000100:00100000:1.0:1651529344.531711:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211259 00010000:00010000:0.0:1651529344.531717:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50cb0 lrc: 2/0,0 mode: PW/PW res: [0x2b626:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.531719:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50cc5 lrc: 2/0,0 mode: PW/PW res: [0x2b62b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531721:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000092d9e682 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.531722:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f27c804 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.531722:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50cb0 lrc: 2/0,0 mode: PW/PW res: [0x2b626:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.531723:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50cc5 lrc: 2/0,0 mode: PW/PW res: [0x2b62b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531725:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50cb0 lrc: 3/0,0 mode: PW/PW res: [0x2b626:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.531726:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50cc5 lrc: 3/0,0 mode: PW/PW res: [0x2b62b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531729:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50cb0 lrc: 1/0,0 mode: --/PW res: [0x2b626:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.531731:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50cc5 lrc: 1/0,0 mode: --/PW res: [0x2b62b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531732:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50cb0 lrc: 0/0,0 mode: --/PW res: [0x2b626:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.531744:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50cc5 lrc: 0/0,0 mode: --/PW res: [0x2b62b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531749:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50cbe lrc: 3/0,1 mode: PW/PW res: [0x2b62a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531752:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50cbe lrc: 3/0,1 mode: PW/PW res: [0x2b62a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531755:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50cbe lrc: 3/0,1 mode: PW/PW res: [0x2b62a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531758:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50cbe lrc: 2/0,0 mode: PW/PW res: [0x2b62a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.531775:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.531805:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+757:39030:x1731745946417344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1304us (1441us total) trans 12885079314 rc 0/0 00000100:00100000:0.0:1651529344.531808:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211258 00010000:00010000:0.0:1651529344.531815:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50cbe lrc: 2/0,0 mode: PW/PW res: [0x2b62a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531821:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000009bc967c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.531822:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50cbe lrc: 2/0,0 mode: PW/PW res: [0x2b62a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531825:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50cbe lrc: 3/0,0 mode: PW/PW res: [0x2b62a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531829:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50cbe lrc: 1/0,0 mode: --/PW res: [0x2b62a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531831:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50cbe lrc: 0/0,0 mode: --/PW res: [0x2b62a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531837:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50ccc lrc: 3/0,1 mode: PW/PW res: [0x2b62c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531840:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50ccc lrc: 3/0,1 mode: PW/PW res: [0x2b62c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531843:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50ccc lrc: 3/0,1 mode: PW/PW res: [0x2b62c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531846:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50ccc lrc: 2/0,0 mode: PW/PW res: [0x2b62c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.531905:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+757:39030:x1731745946417792:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1275us (1308us total) trans 12885079315 rc 0/0 00000100:00100000:0.0:1651529344.531908:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211260 00010000:00010000:0.0:1651529344.531936:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50ccc lrc: 2/0,0 mode: PW/PW res: [0x2b62c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531943:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008cc70fcd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.531945:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50ccc lrc: 2/0,0 mode: PW/PW res: [0x2b62c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531950:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50ccc lrc: 3/0,0 mode: PW/PW res: [0x2b62c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531958:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50ccc lrc: 1/0,0 mode: --/PW res: [0x2b62c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531961:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50ccc lrc: 0/0,0 mode: --/PW res: [0x2b62c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531968:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50cd3 lrc: 3/0,1 mode: PW/PW res: [0x2b62d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531971:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50cd3 lrc: 3/0,1 mode: PW/PW res: [0x2b62d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531974:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50cd3 lrc: 3/0,1 mode: PW/PW res: [0x2b62d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.531977:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50cd3 lrc: 2/0,0 mode: PW/PW res: [0x2b62d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.532003:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50cd3 lrc: 2/0,0 mode: PW/PW res: [0x2b62d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.532007:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005d8a4887 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.532008:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50cd3 lrc: 2/0,0 mode: PW/PW res: [0x2b62d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.532011:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50cd3 lrc: 3/0,0 mode: PW/PW res: [0x2b62d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.532019:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50cd3 lrc: 1/0,0 mode: --/PW res: [0x2b62d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.532022:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50cd3 lrc: 0/0,0 mode: --/PW res: [0x2b62d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.532039:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+757:39030:x1731745946417856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1357us (1409us total) trans 12885079316 rc 0/0 00000100:00100000:0.0:1651529344.532042:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211261 00000100:00100000:1.0:1651529344.532076:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.532080:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000057329b82 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996987520:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.532090:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50cda lrc: 3/0,1 mode: --/PW res: [0x2b62e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.532094:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.532110:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.532119:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.532123:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946418176 00000100:00100000:1.0:1651529344.532127:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.532129:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946418304 00000100:00100000:0.0:1651529344.532136:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946418240 00000100:00100000:0.0:1651529344.532140:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946418368 00000100:00100000:1.0:1651529344.532146:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946418432 00000100:00100000:0.0:1651529344.532146:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211263 00000100:00100000:0.0:1651529344.532147:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+760:39030:x1731745946418176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.532153:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177711 count 1 00000100:00100000:1.0:1651529344.532155:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211264 00000100:00100000:1.0:1651529344.532156:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+761:39030:x1731745946418304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.532157:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50ce1 lrc: 3/0,1 mode: --/PW res: [0x2b62f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.532161:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000086923ba4/0x3234de053c4c75f lrc: 2/0,0 mode: PR/PR res: [0x2b62f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccfcc expref: 1303 pid: 72396 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.532162:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177713 count 1 00010000:00010000:0.0:1651529344.532164:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.532165:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.532166:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50ce8 lrc: 3/0,1 mode: --/PW res: [0x2b631:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.532166:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50ce1 lrc: 4/0,1 mode: --/PW res: [0x2b62f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.532171:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e23b97fa/0x3234de053c4d6d9 lrc: 2/0,0 mode: PR/PR res: [0x2b631:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0cf7 expref: 1303 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.532172:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000086923ba4/0x3234de053c4c75f lrc: 3/0,0 mode: PR/PR res: [0x2b62f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccfcc expref: 1303 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.532174:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.532175:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.532176:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50ce8 lrc: 4/0,1 mode: --/PW res: [0x2b631:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.532176:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000086923ba4/0x3234de053c4c75f lrc: 4/0,0 mode: PR/PR res: [0x2b62f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccfcc expref: 1303 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.532180:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000057329b82 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996987584:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.532182:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e23b97fa/0x3234de053c4d6d9 lrc: 3/0,0 mode: PR/PR res: [0x2b631:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0cf7 expref: 1303 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.532187:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e23b97fa/0x3234de053c4d6d9 lrc: 4/0,0 mode: PR/PR res: [0x2b631:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0cf7 expref: 1303 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.532191:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996987648:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.532194:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c2b2b59c going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.532201:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211265 00000100:00100000:0.0:1651529344.532203:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+761:39029:x1731745946418240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.532206:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 000000004ca54b8a going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.532207:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177712 count 1 00000100:00100000:1.0:1651529344.532213:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211266 00000100:00100000:1.0:1651529344.532215:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+761:39029:x1731745946418368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.532219:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177714 count 1 00010000:00010000:1.0:1651529344.532242:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50cef lrc: 3/0,1 mode: --/PW res: [0x2b632:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.532249:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50cf6 lrc: 3/0,1 mode: --/PW res: [0x2b630:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.532254:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb401f00/0x3234de053c4d225 lrc: 2/0,0 mode: PR/PR res: [0x2b632:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa35 expref: 1303 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.532255:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000018947586/0x3234de053c4e5dc lrc: 2/0,0 mode: PR/PR res: [0x2b630:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d48e7 expref: 1303 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.532257:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.532258:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.532258:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50cef lrc: 4/0,1 mode: --/PW res: [0x2b632:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.532258:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.532258:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.532259:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50cf6 lrc: 4/0,1 mode: --/PW res: [0x2b630:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.532265:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fb401f00/0x3234de053c4d225 lrc: 3/0,0 mode: PR/PR res: [0x2b632:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa35 expref: 1303 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.532266:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000018947586/0x3234de053c4e5dc lrc: 3/0,0 mode: PR/PR res: [0x2b630:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d48e7 expref: 1303 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.532268:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fb401f00/0x3234de053c4d225 lrc: 4/0,0 mode: PR/PR res: [0x2b632:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa35 expref: 1303 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.532270:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000018947586/0x3234de053c4e5dc lrc: 4/0,0 mode: PR/PR res: [0x2b630:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d48e7 expref: 1303 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.532275:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a4b486d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996987712:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.532277:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dff6a73d pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996987776:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.532283:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 0000000071742acc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.532286:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a3b00cf3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.532289:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211267 00000100:00100000:1.0:1651529344.532291:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+761:39030:x1731745946418432:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.532294:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396299008 00002000:00080000:1.0:1651529344.532295:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177715 count 1 00010000:00010000:1.0:1651529344.532299:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50cfd lrc: 3/0,1 mode: --/PW res: [0x2b633:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.532299:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000009273683/0x3234de053c4b728 lrc: 4/0,0 mode: PR/PR res: [0x2b62e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc34d expref: 1304 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.532303:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007a25596b/0x3234de053c4f342 lrc: 2/0,0 mode: PR/PR res: [0x2b633:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7fcf expref: 1304 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.532310:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12044 00000100:00100000:0.0:1651529344.532312:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1304:41279:x1731746396299008:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.532313:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.532314:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.532314:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.532315:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50cfd lrc: 4/0,1 mode: --/PW res: [0x2b633:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.532316:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000009273683/0x3234de053c4b728 lrc: 4/0,0 mode: PR/PR res: [0x2b62e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc34d expref: 1304 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.532319:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000009273683/0x3234de053c4b728 lrc: 3/0,0 mode: PR/PR res: [0x2b62e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc34d expref: 1304 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.532321:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007a25596b/0x3234de053c4f342 lrc: 3/0,0 mode: PR/PR res: [0x2b633:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7fcf expref: 1304 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.532325:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007a25596b/0x3234de053c4f342 lrc: 4/0,0 mode: PR/PR res: [0x2b633:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7fcf expref: 1304 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.532325:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009273683/0x3234de053c4b728 lrc: 0/0,0 mode: --/PR res: [0x2b62e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc34d expref: 1304 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.532329:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009b8db73b pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996987840:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.532329:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.532329:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.532330:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50cda lrc: 3/0,1 mode: PW/PW res: [0x2b62e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.532333:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50cda lrc: 4/0,1 mode: PW/PW res: [0x2b62e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.532336:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000499d0377 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.532342:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.532349:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1303:41279:x1731746396299008:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 37us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.532351:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.532352:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12044 00010000:00010000:0.0:1651529344.532357:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50cda lrc: 3/0,1 mode: PW/PW res: [0x2b62e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.532361:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50cda lrc: 3/0,1 mode: PW/PW res: [0x2b62e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.532364:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50cda lrc: 3/0,1 mode: PW/PW res: [0x2b62e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.532366:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.532366:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50cda lrc: 2/0,0 mode: PW/PW res: [0x2b62e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.532404:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+762:39029:x1731745946417984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1336us (1360us total) trans 12885079317 rc 0/0 00000100:00100000:0.0:1651529344.532407:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211262 00000100:00100000:0.0:1651529344.532411:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946418560 00000100:00100000:0.0:1651529344.532420:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946418496 00000100:00100000:0.0:1651529344.532425:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211268 00000100:00100000:0.0:1651529344.532427:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+763:39030:x1731745946418560:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.532432:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177717 count 1 00010000:00010000:0.0:1651529344.532436:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50d04 lrc: 3/0,1 mode: --/PW res: [0x2b635:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.532448:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211269 00000100:00100000:1.0:1651529344.532450:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+763:39030:x1731745946418496:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.532456:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177716 count 1 00010000:00010000:1.0:1651529344.532460:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50d0b lrc: 3/0,1 mode: --/PW res: [0x2b634:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.532460:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000455eb39/0x3234de053c4a7c3 lrc: 2/0,0 mode: PR/PR res: [0x2b635:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc54 expref: 1302 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.532463:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.532464:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.532465:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000402de11c/0x3234de053c4c720 lrc: 2/0,0 mode: PR/PR res: [0x2b634:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce60 expref: 1302 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.532465:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50d04 lrc: 4/0,1 mode: --/PW res: [0x2b635:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.532468:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.532468:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.532469:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50d0b lrc: 4/0,1 mode: --/PW res: [0x2b634:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.532472:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000455eb39/0x3234de053c4a7c3 lrc: 3/0,0 mode: PR/PR res: [0x2b635:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc54 expref: 1302 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.532475:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000402de11c/0x3234de053c4c720 lrc: 3/0,0 mode: PR/PR res: [0x2b634:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce60 expref: 1302 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.532475:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000455eb39/0x3234de053c4a7c3 lrc: 4/0,0 mode: PR/PR res: [0x2b635:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc54 expref: 1302 pid: 72395 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.532479:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000402de11c/0x3234de053c4c720 lrc: 4/0,0 mode: PR/PR res: [0x2b634:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce60 expref: 1302 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.532479:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bca72234 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996987904:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.532483:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ef7d105 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996987968:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.532494:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 0000000029ae2bb2 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.532499:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d09f5ee1 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.532499:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50cda lrc: 2/0,0 mode: PW/PW res: [0x2b62e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.532503:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000734ecdfd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.532504:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50cda lrc: 2/0,0 mode: PW/PW res: [0x2b62e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.532507:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50cda lrc: 3/0,0 mode: PW/PW res: [0x2b62e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.532513:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50cda lrc: 1/0,0 mode: --/PW res: [0x2b62e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.532516:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50cda lrc: 0/0,0 mode: --/PW res: [0x2b62e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.532548:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.532558:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946419008 00000100:00100000:0.0:1651529344.532569:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211270 00000100:00100000:0.0:1651529344.532570:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+764:39029:x1731745946419008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.532575:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177718 count 1 00010000:00010000:0.0:1651529344.532579:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c50d12 lrc: 3/0,1 mode: --/PW res: [0x2b636:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.532584:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000344d6602/0x3234de053c4cc9f lrc: 2/0,0 mode: PR/PR res: [0x2b636:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce455 expref: 1302 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.532587:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.532587:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.532588:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c50d12 lrc: 4/0,1 mode: --/PW res: [0x2b636:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.532594:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000344d6602/0x3234de053c4cc9f lrc: 3/0,0 mode: PR/PR res: [0x2b636:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce455 expref: 1302 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.532598:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000344d6602/0x3234de053c4cc9f lrc: 4/0,0 mode: PR/PR res: [0x2b636:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce455 expref: 1302 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.532605:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006aa45e66 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996988032:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.532616:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ff7bf023 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.532864:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000057329b82 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996987584:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.532869:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50ce1 lrc: 3/0,1 mode: --/PW res: [0x2b62f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.532882:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dff6a73d pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996987776:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.532884:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.532885:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50cf6 lrc: 3/0,1 mode: --/PW res: [0x2b630:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.532892:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.532897:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396299264 00000100:00100000:1.0:1651529344.532898:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.532902:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000086923ba4/0x3234de053c4c75f lrc: 4/0,0 mode: PR/PR res: [0x2b62f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccfcc expref: 1303 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.532905:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.532913:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.532919:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396299392 00010000:00010000:0.0:1651529344.532928:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fb401f00/0x3234de053c4d225 lrc: 5/0,0 mode: PR/PR res: [0x2b632:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa35 expref: 1304 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.532929:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996987648:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.532933:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50ce8 lrc: 3/0,1 mode: --/PW res: [0x2b631:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.532933:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396299328 00010000:00010000:0.0:1651529344.532935:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e23b97fa/0x3234de053c4d6d9 lrc: 4/0,0 mode: PR/PR res: [0x2b631:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0cf7 expref: 1305 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.532939:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396299520 00000100:00100000:1.0:1651529344.532941:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a4b486d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996987712:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.532941:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007a25596b/0x3234de053c4f342 lrc: 5/0,0 mode: PR/PR res: [0x2b633:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7fcf expref: 1306 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.532943:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50cef lrc: 3/0,1 mode: --/PW res: [0x2b632:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.532948:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396299456 00000100:00100000:1.0:1651529344.532949:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009b8db73b pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996987840:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.532950:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000018947586/0x3234de053c4e5dc lrc: 4/0,0 mode: PR/PR res: [0x2b630:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d48e7 expref: 1307 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.532951:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50cfd lrc: 3/0,1 mode: --/PW res: [0x2b633:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.532957:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12045 00000100:00100000:1.0:1651529344.532959:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1307:41279:x1731746396299264:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.532962:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.532964:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000086923ba4/0x3234de053c4c75f lrc: 4/0,0 mode: PR/PR res: [0x2b62f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccfcc expref: 1307 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.532967:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12046 00010000:00010000:1.0:1651529344.532968:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000086923ba4/0x3234de053c4c75f lrc: 3/0,0 mode: PR/PR res: [0x2b62f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccfcc expref: 1307 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.532968:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1307:41279:x1731746396299392:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.532972:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.532974:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086923ba4/0x3234de053c4c75f lrc: 0/0,0 mode: --/PR res: [0x2b62f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccfcc expref: 1307 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.532980:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.532981:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.532982:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50ce1 lrc: 3/0,1 mode: PW/PW res: [0x2b62f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.532982:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fb401f00/0x3234de053c4d225 lrc: 4/0,0 mode: PR/PR res: [0x2b632:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa35 expref: 1306 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.532984:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50ce1 lrc: 4/0,1 mode: PW/PW res: [0x2b62f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.532986:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fb401f00/0x3234de053c4d225 lrc: 3/0,0 mode: PR/PR res: [0x2b632:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa35 expref: 1306 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.532994:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.532998:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb401f00/0x3234de053c4d225 lrc: 0/0,0 mode: --/PR res: [0x2b632:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa35 expref: 1306 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.533002:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.533002:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.533003:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1305:41279:x1731746396299264:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 43us (119us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.533003:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50cef lrc: 3/0,1 mode: PW/PW res: [0x2b632:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.533006:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12045 00010000:00010000:0.0:1651529344.533006:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50cef lrc: 4/0,1 mode: PW/PW res: [0x2b632:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.533012:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12047 00010000:00010000:0.0:1651529344.533016:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.533019:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1304:41278:x1731746396299328:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.533022:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.533023:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1304:41279:x1731746396299392:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 54us (131us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.533024:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e23b97fa/0x3234de053c4d6d9 lrc: 4/0,0 mode: PR/PR res: [0x2b631:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0cf7 expref: 1304 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.533026:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12046 00010000:00010000:1.0:1651529344.533028:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e23b97fa/0x3234de053c4d6d9 lrc: 3/0,0 mode: PR/PR res: [0x2b631:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0cf7 expref: 1304 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.533032:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12048 00010000:00010000:1.0:1651529344.533033:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e23b97fa/0x3234de053c4d6d9 lrc: 0/0,0 mode: --/PR res: [0x2b631:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0cf7 expref: 1303 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.533033:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1303:41279:x1731746396299520:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.533036:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.533036:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.533037:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.533037:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007a25596b/0x3234de053c4f342 lrc: 4/0,0 mode: PR/PR res: [0x2b633:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7fcf expref: 1302 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.533038:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50ce8 lrc: 3/0,1 mode: PW/PW res: [0x2b631:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533041:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50ce8 lrc: 4/0,1 mode: PW/PW res: [0x2b631:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533041:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007a25596b/0x3234de053c4f342 lrc: 3/0,0 mode: PR/PR res: [0x2b633:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7fcf expref: 1302 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.533046:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.533046:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a25596b/0x3234de053c4f342 lrc: 0/0,0 mode: --/PR res: [0x2b633:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7fcf expref: 1302 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.533049:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.533050:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.533050:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50cfd lrc: 3/0,1 mode: PW/PW res: [0x2b633:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.533052:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1301:41278:x1731746396299328:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 38us (153us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.533053:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50cfd lrc: 4/0,1 mode: PW/PW res: [0x2b633:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.533054:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12047 00000100:00100000:1.0:1651529344.533059:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12049 00010000:00010000:0.0:1651529344.533062:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.533066:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1300:41278:x1731746396299456:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.533067:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1300:41279:x1731746396299520:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (162us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.533069:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.533070:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12048 00010000:00010000:1.0:1651529344.533071:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000018947586/0x3234de053c4e5dc lrc: 4/0,0 mode: PR/PR res: [0x2b630:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d48e7 expref: 1300 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.533074:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000018947586/0x3234de053c4e5dc lrc: 3/0,0 mode: PR/PR res: [0x2b630:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d48e7 expref: 1299 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.533076:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50ce1 lrc: 3/0,1 mode: PW/PW res: [0x2b62f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533079:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018947586/0x3234de053c4e5dc lrc: 0/0,0 mode: --/PR res: [0x2b630:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d48e7 expref: 1299 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.533079:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50ce1 lrc: 3/0,1 mode: PW/PW res: [0x2b62f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533082:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.533082:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50ce1 lrc: 3/0,1 mode: PW/PW res: [0x2b62f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533083:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.533084:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50cf6 lrc: 3/0,1 mode: PW/PW res: [0x2b630:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533085:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50ce1 lrc: 2/0,0 mode: PW/PW res: [0x2b62f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533089:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50cf6 lrc: 4/0,1 mode: PW/PW res: [0x2b630:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533098:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.533103:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1298:41278:x1731746396299456:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 37us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.533106:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12049 00010000:00010000:1.0:1651529344.533114:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50cfd lrc: 3/0,1 mode: PW/PW res: [0x2b633:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533117:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50cfd lrc: 3/0,1 mode: PW/PW res: [0x2b633:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533120:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50cfd lrc: 3/0,1 mode: PW/PW res: [0x2b633:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533123:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50cfd lrc: 2/0,0 mode: PW/PW res: [0x2b633:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.533132:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+765:39030:x1731745946418176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 984us (1056us total) trans 12885079318 rc 0/0 00000100:00100000:0.0:1651529344.533135:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211263 00010000:00010000:0.0:1651529344.533142:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50ce1 lrc: 2/0,0 mode: PW/PW res: [0x2b62f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533145:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a0607df4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.533146:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50ce1 lrc: 2/0,0 mode: PW/PW res: [0x2b62f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533149:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50ce1 lrc: 3/0,0 mode: PW/PW res: [0x2b62f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533154:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50ce1 lrc: 1/0,0 mode: --/PW res: [0x2b62f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533156:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50ce1 lrc: 0/0,0 mode: --/PW res: [0x2b62f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533160:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50cfd lrc: 2/0,0 mode: PW/PW res: [0x2b633:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533163:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001d253066 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.533164:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+765:39030:x1731745946418432:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 873us (1037us total) trans 12885079319 rc 0/0 00010000:00010000:0.0:1651529344.533164:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50cfd lrc: 2/0,0 mode: PW/PW res: [0x2b633:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.533167:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211267 00010000:00010000:0.0:1651529344.533167:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50cfd lrc: 3/0,0 mode: PW/PW res: [0x2b633:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533170:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50cfd lrc: 1/0,0 mode: --/PW res: [0x2b633:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533172:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50cfd lrc: 0/0,0 mode: --/PW res: [0x2b633:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533175:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50cef lrc: 3/0,1 mode: PW/PW res: [0x2b632:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533178:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50cef lrc: 3/0,1 mode: PW/PW res: [0x2b632:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533178:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50cf6 lrc: 3/0,1 mode: PW/PW res: [0x2b630:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533180:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50cf6 lrc: 3/0,1 mode: PW/PW res: [0x2b630:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533182:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50cef lrc: 3/0,1 mode: PW/PW res: [0x2b632:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533183:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50cf6 lrc: 3/0,1 mode: PW/PW res: [0x2b630:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533184:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50cef lrc: 2/0,0 mode: PW/PW res: [0x2b632:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533186:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50cf6 lrc: 2/0,0 mode: PW/PW res: [0x2b630:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.533252:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+765:39029:x1731745946418368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1037us (1133us total) trans 12885079320 rc 0/0 00000100:00100000:1.0:1651529344.533255:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211266 00010000:00010000:1.0:1651529344.533262:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50cef lrc: 2/0,0 mode: PW/PW res: [0x2b632:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533266:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000069f7ba22 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.533267:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50cef lrc: 2/0,0 mode: PW/PW res: [0x2b632:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533270:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50cef lrc: 3/0,0 mode: PW/PW res: [0x2b632:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533274:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50cef lrc: 1/0,0 mode: --/PW res: [0x2b632:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.533275:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+765:39029:x1731745946418240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1071us (1164us total) trans 12885079321 rc 0/0 00010000:00010000:1.0:1651529344.533277:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50cef lrc: 0/0,0 mode: --/PW res: [0x2b632:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.533278:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211265 00010000:00010000:1.0:1651529344.533282:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50cf6 lrc: 2/0,0 mode: PW/PW res: [0x2b630:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533284:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cdc65e28 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.533285:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50cf6 lrc: 2/0,0 mode: PW/PW res: [0x2b630:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533288:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50cf6 lrc: 3/0,0 mode: PW/PW res: [0x2b630:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533291:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50cf6 lrc: 1/0,0 mode: --/PW res: [0x2b630:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.533293:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bca72234 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996987904:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.533294:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50cf6 lrc: 0/0,0 mode: --/PW res: [0x2b630:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533296:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50d04 lrc: 3/0,1 mode: --/PW res: [0x2b635:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533299:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50ce8 lrc: 3/0,1 mode: PW/PW res: [0x2b631:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533301:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50ce8 lrc: 3/0,1 mode: PW/PW res: [0x2b631:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533304:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50ce8 lrc: 3/0,1 mode: PW/PW res: [0x2b631:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533307:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50ce8 lrc: 2/0,0 mode: PW/PW res: [0x2b631:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.533340:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.533353:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.533361:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+765:39030:x1731745946418304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1199us (1263us total) trans 12885079322 rc 0/0 00000100:00100000:1.0:1651529344.533365:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211264 00000100:00100000:0.0:1651529344.533366:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.533380:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ef7d105 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996987968:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.533384:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50d0b lrc: 3/0,1 mode: --/PW res: [0x2b634:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.533396:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396299584 00010000:00010000:1.0:1651529344.533401:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000455eb39/0x3234de053c4a7c3 lrc: 4/0,0 mode: PR/PR res: [0x2b635:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc54 expref: 1298 pid: 72395 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.533409:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50ce8 lrc: 2/0,0 mode: PW/PW res: [0x2b631:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533413:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000048c07243 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.533414:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50ce8 lrc: 2/0,0 mode: PW/PW res: [0x2b631:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533417:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50ce8 lrc: 3/0,0 mode: PW/PW res: [0x2b631:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533422:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50ce8 lrc: 1/0,0 mode: --/PW res: [0x2b631:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533425:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50ce8 lrc: 0/0,0 mode: --/PW res: [0x2b631:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.533434:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396299712 00010000:00010000:1.0:1651529344.533438:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000402de11c/0x3234de053c4c720 lrc: 4/0,0 mode: PR/PR res: [0x2b634:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce60 expref: 1299 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.533443:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396299840 00010000:00010000:1.0:1651529344.533445:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000344d6602/0x3234de053c4cc9f lrc: 5/0,0 mode: PR/PR res: [0x2b636:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce455 expref: 1300 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.533450:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12050 00000100:00100000:1.0:1651529344.533451:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d8aeac5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1300:41279:x1731746396299584:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.533454:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.533455:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000455eb39/0x3234de053c4a7c3 lrc: 4/0,0 mode: PR/PR res: [0x2b635:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc54 expref: 1300 pid: 72395 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.533459:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000455eb39/0x3234de053c4a7c3 lrc: 3/0,0 mode: PR/PR res: [0x2b635:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc54 expref: 1300 pid: 72395 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.533459:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006aa45e66 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996988032:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.533463:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c50d12 lrc: 3/0,1 mode: --/PW res: [0x2b636:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533467:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000455eb39/0x3234de053c4a7c3 lrc: 0/0,0 mode: --/PR res: [0x2b635:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc54 expref: 1300 pid: 72395 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.533471:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.533471:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.533472:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50d04 lrc: 3/0,1 mode: PW/PW res: [0x2b635:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.533472:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12051 00000100:00100000:0.0:1651529344.533474:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1299:41278:x1731746396299712:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.533475:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50d04 lrc: 4/0,1 mode: PW/PW res: [0x2b635:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533478:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.533480:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000402de11c/0x3234de053c4c720 lrc: 4/0,0 mode: PR/PR res: [0x2b634:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce60 expref: 1299 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.533485:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.533489:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000402de11c/0x3234de053c4c720 lrc: 3/0,0 mode: PR/PR res: [0x2b634:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce60 expref: 1299 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.533495:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d8aeac5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1299:41279:x1731746396299584:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 43us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.533498:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12050 00010000:00010000:0.0:1651529344.533500:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000402de11c/0x3234de053c4c720 lrc: 0/0,0 mode: --/PR res: [0x2b634:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce60 expref: 1299 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.533504:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.533505:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.533505:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50d0b lrc: 3/0,1 mode: PW/PW res: [0x2b634:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.533507:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12052 00010000:00010000:0.0:1651529344.533508:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50d0b lrc: 4/0,1 mode: PW/PW res: [0x2b634:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.533509:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1297:41278:x1731746396299840:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.533511:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.533513:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000344d6602/0x3234de053c4cc9f lrc: 4/0,0 mode: PR/PR res: [0x2b636:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce455 expref: 1297 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.533518:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.533523:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000344d6602/0x3234de053c4cc9f lrc: 3/0,0 mode: PR/PR res: [0x2b636:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce455 expref: 1297 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.533526:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1297:41278:x1731746396299712:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 51us (173us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.533528:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000344d6602/0x3234de053c4cc9f lrc: 0/0,0 mode: --/PR res: [0x2b636:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce455 expref: 1297 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.533529:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12051 00010000:00010000:1.0:1651529344.533534:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.533535:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.533536:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c50d12 lrc: 3/0,1 mode: PW/PW res: [0x2b636:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533536:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50d04 lrc: 3/0,1 mode: PW/PW res: [0x2b635:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533538:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c50d12 lrc: 4/0,1 mode: PW/PW res: [0x2b636:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533540:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50d04 lrc: 3/0,1 mode: PW/PW res: [0x2b635:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533543:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50d04 lrc: 3/0,1 mode: PW/PW res: [0x2b635:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533547:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.533550:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50d04 lrc: 2/0,0 mode: PW/PW res: [0x2b635:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.533553:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1295:41278:x1731746396299840:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 44us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.533556:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12052 00010000:00010000:1.0:1651529344.533564:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50d0b lrc: 3/0,1 mode: PW/PW res: [0x2b634:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533567:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50d0b lrc: 3/0,1 mode: PW/PW res: [0x2b634:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533570:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50d0b lrc: 3/0,1 mode: PW/PW res: [0x2b634:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533573:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50d0b lrc: 2/0,0 mode: PW/PW res: [0x2b634:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.533609:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+766:39030:x1731745946418496:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1158us (1243us total) trans 12885079323 rc 0/0 00000100:00100000:1.0:1651529344.533612:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211269 00000100:00100000:0.0:1651529344.533614:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+766:39030:x1731745946418560:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1186us (1262us total) trans 12885079324 rc 0/0 00000100:00100000:0.0:1651529344.533617:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211268 00010000:00010000:1.0:1651529344.533619:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50d04 lrc: 2/0,0 mode: PW/PW res: [0x2b635:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533622:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027456046 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.533623:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50d04 lrc: 2/0,0 mode: PW/PW res: [0x2b635:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533625:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50d0b lrc: 2/0,0 mode: PW/PW res: [0x2b634:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533626:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50d04 lrc: 3/0,0 mode: PW/PW res: [0x2b635:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533628:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000085580035 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.533629:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50d0b lrc: 2/0,0 mode: PW/PW res: [0x2b634:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533631:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50d04 lrc: 1/0,0 mode: --/PW res: [0x2b635:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533632:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50d0b lrc: 3/0,0 mode: PW/PW res: [0x2b634:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533633:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50d04 lrc: 0/0,0 mode: --/PW res: [0x2b635:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533639:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50d0b lrc: 1/0,0 mode: --/PW res: [0x2b634:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533642:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50d0b lrc: 0/0,0 mode: --/PW res: [0x2b634:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533648:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c50d12 lrc: 3/0,1 mode: PW/PW res: [0x2b636:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533651:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c50d12 lrc: 3/0,1 mode: PW/PW res: [0x2b636:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533654:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c50d12 lrc: 3/0,1 mode: PW/PW res: [0x2b636:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533656:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c50d12 lrc: 2/0,0 mode: PW/PW res: [0x2b636:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.533668:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.533686:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.533699:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.533699:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+765:39029:x1731745946419008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1127us (1151us total) trans 12885079325 rc 0/0 00000100:00100000:0.0:1651529344.533702:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211270 00000100:00100000:0.0:1651529344.533706:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946419200 00000100:00100000:1.0:1651529344.533709:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.533725:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946419264 00000100:00100000:1.0:1651529344.533727:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.533746:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946419328 00000100:00100000:0.0:1651529344.533753:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946419456 00000100:00100000:0.0:1651529344.533759:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211271 00000100:00100000:0.0:1651529344.533760:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+768:39030:x1731745946419200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.533766:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177719 count 1 00010000:00010000:0.0:1651529344.533770:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50d19 lrc: 3/0,1 mode: --/PW res: [0x2b637:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533774:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000039e11001/0x3234de053c4db63 lrc: 2/0,0 mode: PR/PR res: [0x2b637:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1db3 expref: 1294 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.533777:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.533778:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.533779:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50d19 lrc: 4/0,1 mode: --/PW res: [0x2b637:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533785:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000039e11001/0x3234de053c4db63 lrc: 3/0,0 mode: PR/PR res: [0x2b637:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1db3 expref: 1294 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.533789:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000039e11001/0x3234de053c4db63 lrc: 4/0,0 mode: PR/PR res: [0x2b637:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1db3 expref: 1294 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.533793:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006aa45e66 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996988096:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.533795:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946419392 00000100:00100000:1.0:1651529344.533807:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211272 00000100:00100000:1.0:1651529344.533813:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+769:39029:x1731745946419264:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.533814:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000504ef660 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.533819:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177720 count 1 00010000:00010000:0.0:1651529344.533819:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c50d12 lrc: 2/0,0 mode: PW/PW res: [0x2b636:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533822:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b855716b already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.533823:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50d20 lrc: 3/0,1 mode: --/PW res: [0x2b638:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533823:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c50d12 lrc: 2/0,0 mode: PW/PW res: [0x2b636:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533826:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c50d12 lrc: 3/0,0 mode: PW/PW res: [0x2b636:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533830:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cb5113e4/0x3234de053c4e5c7 lrc: 2/0,0 mode: PR/PR res: [0x2b638:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d48bd expref: 1294 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.533831:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c50d12 lrc: 1/0,0 mode: --/PW res: [0x2b636:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533833:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.533834:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.533834:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c50d12 lrc: 0/0,0 mode: --/PW res: [0x2b636:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533835:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50d20 lrc: 4/0,1 mode: --/PW res: [0x2b638:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533842:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cb5113e4/0x3234de053c4e5c7 lrc: 3/0,0 mode: PR/PR res: [0x2b638:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d48bd expref: 1294 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.533842:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211273 00000100:00100000:0.0:1651529344.533844:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+769:39030:x1731745946419328:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.533845:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cb5113e4/0x3234de053c4e5c7 lrc: 4/0,0 mode: PR/PR res: [0x2b638:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d48bd expref: 1294 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.533849:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cee35a0c pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996988160:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.533849:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177721 count 1 00000100:00100000:1.0:1651529344.533858:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d09f5ee1 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.533865:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211274 00000100:00100000:1.0:1651529344.533867:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b71ab49a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+769:39030:x1731745946419456:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.533868:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c50d27 lrc: 3/0,1 mode: --/PW res: [0x2b639:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.533871:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177723 count 1 00010000:00010000:0.0:1651529344.533873:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c4dfa7 lrc: 2/0,0 mode: PR/PR res: [0x2b639:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f95 expref: 1294 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.533874:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50d2e lrc: 3/0,1 mode: --/PW res: [0x2b63b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533876:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.533876:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.533877:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c50d27 lrc: 4/0,1 mode: --/PW res: [0x2b639:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.533878:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006f3c6505/0x3234de053c4eaba lrc: 2/0,0 mode: PR/PR res: [0x2b63b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c9e expref: 1294 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.533881:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.533882:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.533883:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50d2e lrc: 4/0,1 mode: --/PW res: [0x2b63b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533884:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c4dfa7 lrc: 3/0,0 mode: PR/PR res: [0x2b639:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f95 expref: 1294 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.533887:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c4dfa7 lrc: 4/0,0 mode: PR/PR res: [0x2b639:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f95 expref: 1294 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.533889:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006f3c6505/0x3234de053c4eaba lrc: 3/0,0 mode: PR/PR res: [0x2b63b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c9e expref: 1294 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.533892:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006f3c6505/0x3234de053c4eaba lrc: 4/0,0 mode: PR/PR res: [0x2b63b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c9e expref: 1294 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.533894:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000057329b82 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996988224:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.533896:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005d2b5bb3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996988288:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.533903:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b81e4a0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.533904:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 0000000071742acc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.533910:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211275 00000100:00100000:0.0:1651529344.533912:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+769:39029:x1731745946419392:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.533916:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177722 count 1 00010000:00010000:0.0:1651529344.533919:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50d35 lrc: 3/0,1 mode: --/PW res: [0x2b63a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533924:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000058ca488c/0x3234de053c4d68c lrc: 2/0,0 mode: PR/PR res: [0x2b63a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0bd1 expref: 1294 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.533927:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.533927:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.533928:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50d35 lrc: 4/0,1 mode: --/PW res: [0x2b63a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.533934:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000058ca488c/0x3234de053c4d68c lrc: 3/0,0 mode: PR/PR res: [0x2b63a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0bd1 expref: 1294 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.533937:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000058ca488c/0x3234de053c4d68c lrc: 4/0,0 mode: PR/PR res: [0x2b63a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0bd1 expref: 1294 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.533941:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006e3eb319 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996988352:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.533954:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c086aae3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.534052:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.534065:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946419584 00000100:00100000:1.0:1651529344.534070:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.534095:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946419712 00000100:00100000:1.0:1651529344.534104:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.534110:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946419904 00000100:00100000:0.0:1651529344.534118:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211276 00000100:00100000:0.0:1651529344.534120:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+772:39030:x1731745946419584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.534125:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177724 count 1 00010000:00010000:0.0:1651529344.534129:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50d3c lrc: 3/0,1 mode: --/PW res: [0x2b63c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.534134:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005c1ca8ce/0x3234de053c4dd00 lrc: 2/0,0 mode: PR/PR res: [0x2b63c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d249e expref: 1294 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.534135:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211277 00000100:00100000:1.0:1651529344.534137:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+772:39030:x1731745946419712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.534137:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.534137:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1651529344.534142:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177725 count 1 00010000:00010000:1.0:1651529344.534147:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50d43 lrc: 3/0,1 mode: --/PW res: [0x2b63d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.534153:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50d3c lrc: 4/0,1 mode: --/PW res: [0x2b63c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.534158:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004f9d79d3/0x3234de053c4d383 lrc: 2/0,0 mode: PR/PR res: [0x2b63d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0040 expref: 1294 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.534161:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.534161:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.534161:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005c1ca8ce/0x3234de053c4dd00 lrc: 3/0,0 mode: PR/PR res: [0x2b63c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d249e expref: 1294 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.534162:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50d43 lrc: 4/0,1 mode: --/PW res: [0x2b63d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.534165:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005c1ca8ce/0x3234de053c4dd00 lrc: 4/0,0 mode: PR/PR res: [0x2b63c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d249e expref: 1294 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.534169:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000043b7984f pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996988416:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.534172:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004f9d79d3/0x3234de053c4d383 lrc: 3/0,0 mode: PR/PR res: [0x2b63d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0040 expref: 1294 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.534176:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004f9d79d3/0x3234de053c4d383 lrc: 4/0,0 mode: PR/PR res: [0x2b63d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0040 expref: 1294 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.534180:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ee8cd7c9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996988480:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.534188:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 000000004ca54b8a going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.534190:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a82c4968 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.534194:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211278 00000100:00100000:1.0:1651529344.534196:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+772:39030:x1731745946419904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.534200:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177726 count 1 00000100:00100000:0.0:1651529344.534200:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006aa45e66 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996988096:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.534204:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50d4a lrc: 3/0,1 mode: --/PW res: [0x2b63e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.534204:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50d19 lrc: 3/0,1 mode: --/PW res: [0x2b637:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.534208:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c4cc05 lrc: 2/0,0 mode: PR/PR res: [0x2b63e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce1d8 expref: 1294 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.534211:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.534211:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.534212:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50d4a lrc: 4/0,1 mode: --/PW res: [0x2b63e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.534217:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c4cc05 lrc: 3/0,0 mode: PR/PR res: [0x2b63e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce1d8 expref: 1294 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.534220:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c4cc05 lrc: 4/0,0 mode: PR/PR res: [0x2b63e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce1d8 expref: 1294 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.534242:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ba0b61e6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996988544:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.534250:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fe434b1c going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.534267:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cee35a0c pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996988160:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.534271:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50d20 lrc: 3/0,1 mode: --/PW res: [0x2b638:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.534283:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005d2b5bb3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996988288:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.534286:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50d2e lrc: 3/0,1 mode: --/PW res: [0x2b63b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.534308:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000057329b82 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996988224:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.534312:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c50d27 lrc: 3/0,1 mode: --/PW res: [0x2b639:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.534331:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006e3eb319 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996988352:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.534334:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50d35 lrc: 3/0,1 mode: --/PW res: [0x2b63a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.534356:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.534365:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396300352 00000100:00100000:0.0:1651529344.534366:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.534374:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.534376:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cb5113e4/0x3234de053c4e5c7 lrc: 4/0,0 mode: PR/PR res: [0x2b638:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d48bd expref: 1295 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.534382:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.534387:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396300480 00010000:00010000:1.0:1651529344.534389:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006f3c6505/0x3234de053c4eaba lrc: 4/0,0 mode: PR/PR res: [0x2b63b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c9e expref: 1296 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.534391:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.534394:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396300288 00010000:00010000:1.0:1651529344.534396:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000039e11001/0x3234de053c4db63 lrc: 4/0,0 mode: PR/PR res: [0x2b637:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1db3 expref: 1297 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.534398:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396300416 00000100:00100000:1.0:1651529344.534400:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396300544 00010000:00010000:1.0:1651529344.534402:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000058ca488c/0x3234de053c4d68c lrc: 4/0,0 mode: PR/PR res: [0x2b63a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0bd1 expref: 1299 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.534403:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c4dfa7 lrc: 4/0,0 mode: PR/PR res: [0x2b639:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f95 expref: 1299 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.534409:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12053 00000100:00100000:1.0:1651529344.534411:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1299:41278:x1731746396300352:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.534411:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12054 00000100:00100000:0.0:1651529344.534413:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1299:41278:x1731746396300480:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.534414:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.534415:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cb5113e4/0x3234de053c4e5c7 lrc: 4/0,0 mode: PR/PR res: [0x2b638:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d48bd expref: 1299 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.534416:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.534418:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006f3c6505/0x3234de053c4eaba lrc: 4/0,0 mode: PR/PR res: [0x2b63b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c9e expref: 1299 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.534419:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cb5113e4/0x3234de053c4e5c7 lrc: 3/0,0 mode: PR/PR res: [0x2b638:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d48bd expref: 1299 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.534421:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006f3c6505/0x3234de053c4eaba lrc: 3/0,0 mode: PR/PR res: [0x2b63b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c9e expref: 1299 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.534424:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb5113e4/0x3234de053c4e5c7 lrc: 0/0,0 mode: --/PR res: [0x2b638:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d48bd expref: 1299 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.534428:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.534428:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.534428:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f3c6505/0x3234de053c4eaba lrc: 0/0,0 mode: --/PR res: [0x2b63b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c9e expref: 1298 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.534429:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50d20 lrc: 3/0,1 mode: PW/PW res: [0x2b638:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.534431:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.534432:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50d20 lrc: 4/0,1 mode: PW/PW res: [0x2b638:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.534432:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.534433:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50d2e lrc: 3/0,1 mode: PW/PW res: [0x2b63b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.534436:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50d2e lrc: 4/0,1 mode: PW/PW res: [0x2b63b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.534438:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.534445:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.534452:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1297:41278:x1731746396300352:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 40us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.534453:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1297:41278:x1731746396300480:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 39us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.534455:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12053 00000100:00100000:0.0:1651529344.534457:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12054 00000100:00100000:1.0:1651529344.534460:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12055 00000100:00100000:1.0:1651529344.534462:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1295:41279:x1731746396300288:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.534462:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12056 00010000:00010000:1.0:1651529344.534464:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.534464:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1295:41279:x1731746396300416:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.534466:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000039e11001/0x3234de053c4db63 lrc: 4/0,0 mode: PR/PR res: [0x2b637:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1db3 expref: 1295 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.534466:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.534468:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c4dfa7 lrc: 4/0,0 mode: PR/PR res: [0x2b639:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f95 expref: 1295 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.534470:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000039e11001/0x3234de053c4db63 lrc: 3/0,0 mode: PR/PR res: [0x2b637:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1db3 expref: 1295 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.534471:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c4dfa7 lrc: 3/0,0 mode: PR/PR res: [0x2b639:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f95 expref: 1295 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.534474:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039e11001/0x3234de053c4db63 lrc: 0/0,0 mode: --/PR res: [0x2b637:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1db3 expref: 1295 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.534478:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.534478:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.534479:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50d19 lrc: 3/0,1 mode: PW/PW res: [0x2b637:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.534482:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50d19 lrc: 4/0,1 mode: PW/PW res: [0x2b637:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.534491:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.534497:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1294:41279:x1731746396300288:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.534500:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12055 00010000:00010000:0.0:1651529344.534502:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c4dfa7 lrc: 0/0,0 mode: --/PR res: [0x2b639:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f95 expref: 1293 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.534504:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12057 00000100:00100000:1.0:1651529344.534505:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045c93b49 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1293:41279:x1731746396300544:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.534508:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.534508:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.534509:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000058ca488c/0x3234de053c4d68c lrc: 4/0,0 mode: PR/PR res: [0x2b63a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0bd1 expref: 1292 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.534509:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.534510:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c50d27 lrc: 3/0,1 mode: PW/PW res: [0x2b639:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.534512:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c50d27 lrc: 4/0,1 mode: PW/PW res: [0x2b639:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.534513:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000058ca488c/0x3234de053c4d68c lrc: 3/0,0 mode: PR/PR res: [0x2b63a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0bd1 expref: 1292 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.534518:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058ca488c/0x3234de053c4d68c lrc: 0/0,0 mode: --/PR res: [0x2b63a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0bd1 expref: 1292 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.534521:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.534521:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.534522:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50d35 lrc: 3/0,1 mode: PW/PW res: [0x2b63a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.534525:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50d35 lrc: 4/0,1 mode: PW/PW res: [0x2b63a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.534533:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.534538:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045c93b49 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1291:41279:x1731746396300544:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.534540:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12057 00010000:00010000:0.0:1651529344.534544:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.534552:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1290:41279:x1731746396300416:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 88us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.534555:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12056 00010000:00010000:1.0:1651529344.534557:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50d20 lrc: 3/0,1 mode: PW/PW res: [0x2b638:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.534560:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50d20 lrc: 3/0,1 mode: PW/PW res: [0x2b638:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.534563:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50d20 lrc: 3/0,1 mode: PW/PW res: [0x2b638:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.534566:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c50d27 lrc: 3/0,1 mode: PW/PW res: [0x2b639:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.534568:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50d20 lrc: 2/0,0 mode: PW/PW res: [0x2b638:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.534569:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c50d27 lrc: 3/0,1 mode: PW/PW res: [0x2b639:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.534573:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c50d27 lrc: 3/0,1 mode: PW/PW res: [0x2b639:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.534575:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c50d27 lrc: 2/0,0 mode: PW/PW res: [0x2b639:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.534608:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+774:39029:x1731745946419264:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 798us (921us total) trans 12885079326 rc 0/0 00000100:00100000:1.0:1651529344.534611:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211272 00000100:00100000:0.0:1651529344.534615:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+773:39030:x1731745946419328:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 770us (915us total) trans 12885079327 rc 0/0 00010000:00010000:1.0:1651529344.534618:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50d2e lrc: 3/0,1 mode: PW/PW res: [0x2b63b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.534618:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211273 00010000:00010000:1.0:1651529344.534621:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50d2e lrc: 3/0,1 mode: PW/PW res: [0x2b63b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.534624:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50d2e lrc: 3/0,1 mode: PW/PW res: [0x2b63b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.534625:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50d20 lrc: 2/0,0 mode: PW/PW res: [0x2b638:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.534626:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50d2e lrc: 2/0,0 mode: PW/PW res: [0x2b63b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.534628:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000002904524 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.534629:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50d20 lrc: 2/0,0 mode: PW/PW res: [0x2b638:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.534632:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50d20 lrc: 3/0,0 mode: PW/PW res: [0x2b638:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.534644:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50d20 lrc: 1/0,0 mode: --/PW res: [0x2b638:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.534647:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50d20 lrc: 0/0,0 mode: --/PW res: [0x2b638:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.534652:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c50d27 lrc: 2/0,0 mode: PW/PW res: [0x2b639:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.534654:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b3edbdf4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.534655:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c50d27 lrc: 2/0,0 mode: PW/PW res: [0x2b639:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.534658:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c50d27 lrc: 3/0,0 mode: PW/PW res: [0x2b639:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.534661:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c50d27 lrc: 1/0,0 mode: --/PW res: [0x2b639:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.534666:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c50d27 lrc: 0/0,0 mode: --/PW res: [0x2b639:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.534667:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b71ab49a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+773:39030:x1731745946419456:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 799us (958us total) trans 12885079328 rc 0/0 00000100:00100000:1.0:1651529344.534670:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211274 00010000:00010000:0.0:1651529344.534670:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50d2e lrc: 2/0,0 mode: PW/PW res: [0x2b63b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.534672:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e0e037e6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.534673:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50d2e lrc: 2/0,0 mode: PW/PW res: [0x2b63b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.534676:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50d2e lrc: 3/0,0 mode: PW/PW res: [0x2b63b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.534679:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50d2e lrc: 1/0,0 mode: --/PW res: [0x2b63b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.534681:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50d2e lrc: 0/0,0 mode: --/PW res: [0x2b63b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.534687:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50d35 lrc: 3/0,1 mode: PW/PW res: [0x2b63a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.534690:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50d35 lrc: 3/0,1 mode: PW/PW res: [0x2b63a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.534693:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50d35 lrc: 3/0,1 mode: PW/PW res: [0x2b63a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.534696:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50d35 lrc: 2/0,0 mode: PW/PW res: [0x2b63a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.534724:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.534747:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.534756:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+773:39029:x1731745946419392:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 843us (1028us total) trans 12885079329 rc 0/0 00000100:00100000:1.0:1651529344.534758:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.534759:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211275 00010000:00010000:0.0:1651529344.534766:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50d19 lrc: 3/0,1 mode: PW/PW res: [0x2b637:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.534769:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50d19 lrc: 3/0,1 mode: PW/PW res: [0x2b637:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.534772:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50d19 lrc: 3/0,1 mode: PW/PW res: [0x2b637:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.534775:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50d19 lrc: 2/0,0 mode: PW/PW res: [0x2b637:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.534808:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+773:39030:x1731745946419200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1047us (1140us total) trans 12885079330 rc 0/0 00000100:00100000:0.0:1651529344.534811:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211271 00010000:00010000:0.0:1651529344.534830:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50d35 lrc: 2/0,0 mode: PW/PW res: [0x2b63a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.534834:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d9ada8a3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.534835:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50d35 lrc: 2/0,0 mode: PW/PW res: [0x2b63a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.534840:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50d19 lrc: 2/0,0 mode: PW/PW res: [0x2b637:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.534846:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eb50e2ae already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.534847:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50d19 lrc: 2/0,0 mode: PW/PW res: [0x2b637:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.534850:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50d19 lrc: 3/0,0 mode: PW/PW res: [0x2b637:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.534855:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50d19 lrc: 1/0,0 mode: --/PW res: [0x2b637:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.534855:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50d35 lrc: 3/0,0 mode: PW/PW res: [0x2b63a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.534858:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50d19 lrc: 0/0,0 mode: --/PW res: [0x2b637:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.534866:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396300672 00010000:00010000:0.0:1651529344.534870:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50d35 lrc: 1/0,0 mode: --/PW res: [0x2b63a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.534871:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005c1ca8ce/0x3234de053c4dd00 lrc: 5/0,0 mode: PR/PR res: [0x2b63c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d249e expref: 1290 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.534873:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50d35 lrc: 0/0,0 mode: --/PW res: [0x2b63a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.534878:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396300608 00010000:00010000:1.0:1651529344.534880:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004f9d79d3/0x3234de053c4d383 lrc: 5/0,0 mode: PR/PR res: [0x2b63d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0040 expref: 1291 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.534884:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396300736 00000100:00100000:0.0:1651529344.534885:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000043b7984f pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996988416:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.534886:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c4cc05 lrc: 5/0,0 mode: PR/PR res: [0x2b63e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce1d8 expref: 1292 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.534888:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50d3c lrc: 3/0,1 mode: --/PW res: [0x2b63c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.534891:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12058 00000100:00100000:1.0:1651529344.534892:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1292:41279:x1731746396300672:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.534895:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.534895:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12059 00010000:00010000:1.0:1651529344.534896:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005c1ca8ce/0x3234de053c4dd00 lrc: 4/0,0 mode: PR/PR res: [0x2b63c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d249e expref: 1292 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.534897:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1292:41279:x1731746396300608:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.534900:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005c1ca8ce/0x3234de053c4dd00 lrc: 3/0,0 mode: PR/PR res: [0x2b63c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d249e expref: 1292 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.534901:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.534902:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004f9d79d3/0x3234de053c4d383 lrc: 5/0,0 mode: PR/PR res: [0x2b63d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0040 expref: 1292 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.534905:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c1ca8ce/0x3234de053c4dd00 lrc: 0/0,0 mode: --/PR res: [0x2b63c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d249e expref: 1292 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.534906:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004f9d79d3/0x3234de053c4d383 lrc: 4/0,0 mode: PR/PR res: [0x2b63d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0040 expref: 1292 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.534908:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.534908:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.534909:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50d3c lrc: 3/0,1 mode: PW/PW res: [0x2b63c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.534912:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50d3c lrc: 4/0,1 mode: PW/PW res: [0x2b63c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.534913:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.534914:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.534915:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50d43 lrc: 3/0,1 mode: PW/PW res: [0x2b63d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.534923:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.534929:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50d43 lrc: 4/0,1 mode: PW/PW res: [0x2b63d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.534932:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1291:41279:x1731746396300672:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 39us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.534935:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12058 00000100:00100000:1.0:1651529344.534939:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12060 00010000:00010000:0.0:1651529344.534939:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.534941:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1290:41279:x1731746396300736:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.534944:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.534945:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c4cc05 lrc: 5/0,0 mode: PR/PR res: [0x2b63e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce1d8 expref: 1290 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.534950:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1290:41279:x1731746396300608:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 51us (202us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.534951:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c4cc05 lrc: 4/0,0 mode: PR/PR res: [0x2b63e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce1d8 expref: 1290 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.534955:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12059 00010000:00010000:1.0:1651529344.534956:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.534956:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.534957:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50d4a lrc: 3/0,1 mode: PW/PW res: [0x2b63e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.534960:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50d4a lrc: 4/0,1 mode: PW/PW res: [0x2b63e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.534964:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.534967:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50d3c lrc: 3/0,1 mode: PW/PW res: [0x2b63c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.534968:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1289:41279:x1731746396300736:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 27us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.534971:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12060 00010000:00010000:0.0:1651529344.534971:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50d3c lrc: 3/0,1 mode: PW/PW res: [0x2b63c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.534980:0:80278:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c4cc05 lrc: 0/0,0 mode: --/PR res: [0x2b63e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce1d8 expref: 1288 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.534984:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ba0b61e6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996988544:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.534988:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50d4a lrc: 3/0,1 mode: PW/PW res: [0x2b63e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.534991:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50d4a lrc: 3/0,1 mode: PW/PW res: [0x2b63e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.534994:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50d4a lrc: 3/0,1 mode: PW/PW res: [0x2b63e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.534997:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50d4a lrc: 3/0,1 mode: PW/PW res: [0x2b63e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535000:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50d4a lrc: 2/0,0 mode: PW/PW res: [0x2b63e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535001:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50d3c lrc: 3/0,1 mode: PW/PW res: [0x2b63c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535004:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50d3c lrc: 2/0,0 mode: PW/PW res: [0x2b63c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.535048:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+774:39030:x1731745946419904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 852us (949us total) trans 12885079331 rc 0/0 00000100:00100000:1.0:1651529344.535051:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211278 00000100:00100000:0.0:1651529344.535054:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+773:39030:x1731745946419584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 933us (1003us total) trans 12885079332 rc 0/0 00000100:00100000:0.0:1651529344.535057:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211276 00010000:00010000:1.0:1651529344.535061:0:72396:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f9d79d3/0x3234de053c4d383 lrc: 0/0,0 mode: --/PR res: [0x2b63d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0040 expref: 1287 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.535065:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ee8cd7c9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996988480:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.535065:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50d4a lrc: 2/0,0 mode: PW/PW res: [0x2b63e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535069:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50d43 lrc: 3/0,1 mode: PW/PW res: [0x2b63d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535069:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054065c33 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.535070:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50d4a lrc: 2/0,0 mode: PW/PW res: [0x2b63e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535072:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50d43 lrc: 3/0,1 mode: PW/PW res: [0x2b63d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535073:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50d4a lrc: 3/0,0 mode: PW/PW res: [0x2b63e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535075:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50d43 lrc: 3/0,1 mode: PW/PW res: [0x2b63d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535078:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50d43 lrc: 3/0,1 mode: PW/PW res: [0x2b63d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535078:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50d4a lrc: 1/0,0 mode: --/PW res: [0x2b63e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535080:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50d4a lrc: 0/0,0 mode: --/PW res: [0x2b63e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535083:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50d43 lrc: 2/0,0 mode: PW/PW res: [0x2b63d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535084:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50d3c lrc: 2/0,0 mode: PW/PW res: [0x2b63c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535087:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009880d77c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.535088:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50d3c lrc: 2/0,0 mode: PW/PW res: [0x2b63c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535103:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50d3c lrc: 3/0,0 mode: PW/PW res: [0x2b63c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535106:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50d3c lrc: 1/0,0 mode: --/PW res: [0x2b63c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535109:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50d3c lrc: 0/0,0 mode: --/PW res: [0x2b63c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535113:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50d43 lrc: 2/0,0 mode: PW/PW res: [0x2b63d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535116:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000048b51e47 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.535117:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50d43 lrc: 2/0,0 mode: PW/PW res: [0x2b63d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535119:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50d43 lrc: 3/0,0 mode: PW/PW res: [0x2b63d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.535122:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+773:39030:x1731745946419712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 985us (1052us total) trans 12885079333 rc 0/0 00010000:00010000:0.0:1651529344.535122:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50d43 lrc: 1/0,0 mode: --/PW res: [0x2b63d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.535125:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211277 00010000:00010000:0.0:1651529344.535125:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50d43 lrc: 0/0,0 mode: --/PW res: [0x2b63d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.535156:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.535168:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946420224 00000100:00100000:0.0:1651529344.535171:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.535176:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946420288 00000100:00100000:1.0:1651529344.535183:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211279 00000100:00100000:1.0:1651529344.535185:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+774:39030:x1731745946420224:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.535195:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529344.535197:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177727 count 1 00010000:00010000:1.0:1651529344.535201:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50d51 lrc: 3/0,1 mode: --/PW res: [0x2b63f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.535202:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.535211:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bb5f9fa8/0x3234de053c4e61b lrc: 2/0,0 mode: PR/PR res: [0x2b63f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4996 expref: 1286 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.535212:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.535215:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.535216:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.535216:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50d51 lrc: 4/0,1 mode: --/PW res: [0x2b63f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.535219:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946420352 00010000:00010000:1.0:1651529344.535237:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bb5f9fa8/0x3234de053c4e61b lrc: 3/0,0 mode: PR/PR res: [0x2b63f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4996 expref: 1286 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.535244:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946420416 00010000:00010000:1.0:1651529344.535247:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bb5f9fa8/0x3234de053c4e61b lrc: 4/0,0 mode: PR/PR res: [0x2b63f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4996 expref: 1286 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.535250:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946420480 00000100:00100000:0.0:1651529344.535256:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211280 00000100:00100000:0.0:1651529344.535257:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+777:39029:x1731745946420288:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.535260:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cee35a0c pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996988608:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.535263:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177728 count 1 00010000:00010000:0.0:1651529344.535267:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50d58 lrc: 3/0,1 mode: --/PW res: [0x2b640:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.535273:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 0000000071742acc going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.535280:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211281 00010000:00010000:0.0:1651529344.535280:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000054ed35ee/0x3234de053c4dd9a lrc: 2/0,0 mode: PR/PR res: [0x2b640:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d27d1 expref: 1286 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.535282:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+777:39030:x1731745946420352:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.535284:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.535284:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.535285:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50d58 lrc: 4/0,1 mode: --/PW res: [0x2b640:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.535287:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177729 count 1 00010000:00010000:1.0:1651529344.535291:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50d5f lrc: 3/0,1 mode: --/PW res: [0x2b641:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535292:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000054ed35ee/0x3234de053c4dd9a lrc: 3/0,0 mode: PR/PR res: [0x2b640:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d27d1 expref: 1286 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.535295:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001e100c7c/0x3234de053c4ca06 lrc: 2/0,0 mode: PR/PR res: [0x2b641:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda0d expref: 1286 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.535295:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000054ed35ee/0x3234de053c4dd9a lrc: 4/0,0 mode: PR/PR res: [0x2b640:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d27d1 expref: 1286 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.535298:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.535299:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.535299:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50d5f lrc: 4/0,1 mode: --/PW res: [0x2b641:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.535300:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006aa45e66 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996988672:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.535306:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001e100c7c/0x3234de053c4ca06 lrc: 3/0,0 mode: PR/PR res: [0x2b641:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda0d expref: 1286 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.535309:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001e100c7c/0x3234de053c4ca06 lrc: 4/0,0 mode: PR/PR res: [0x2b641:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda0d expref: 1286 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.535309:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ff7bf023 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.535313:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000075e1000f pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996988736:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.535318:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211282 00000100:00100000:0.0:1651529344.535319:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+777:39029:x1731745946420416:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.535320:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 000000007e004c12 going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.535324:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177730 count 1 00000100:00100000:1.0:1651529344.535326:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211283 00010000:00010000:0.0:1651529344.535327:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50d66 lrc: 3/0,1 mode: --/PW res: [0x2b642:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.535328:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+777:39030:x1731745946420480:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.535332:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177731 count 1 00010000:00010000:0.0:1651529344.535332:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000702421e2/0x3234de053c4dece lrc: 2/0,0 mode: PR/PR res: [0x2b642:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c23 expref: 1286 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.535335:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50d6d lrc: 3/0,1 mode: --/PW res: [0x2b643:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535335:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.535335:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.535336:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50d66 lrc: 4/0,1 mode: --/PW res: [0x2b642:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535339:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dda68b75/0x3234de053c4d153 lrc: 2/0,0 mode: PR/PR res: [0x2b643:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf6bc expref: 1286 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.535342:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.535342:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000702421e2/0x3234de053c4dece lrc: 3/0,0 mode: PR/PR res: [0x2b642:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c23 expref: 1286 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.535343:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.535343:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50d6d lrc: 4/0,1 mode: --/PW res: [0x2b643:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535346:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000702421e2/0x3234de053c4dece lrc: 4/0,0 mode: PR/PR res: [0x2b642:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c23 expref: 1286 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.535349:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dda68b75/0x3234de053c4d153 lrc: 3/0,0 mode: PR/PR res: [0x2b643:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf6bc expref: 1286 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.535349:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000075b025a pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996988800:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.535353:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dda68b75/0x3234de053c4d153 lrc: 4/0,0 mode: PR/PR res: [0x2b643:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf6bc expref: 1286 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.535356:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c086aae3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.535357:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bddc5ca7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996988864:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.535362:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fb6c773d going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.535635:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.535644:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.535650:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.535657:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946420608 00000100:00100000:1.0:1651529344.535667:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946420544 00000100:00100000:1.0:1651529344.535673:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211284 00000100:00100000:1.0:1651529344.535675:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+779:39030:x1731745946420608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.535675:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946420672 00002000:00080000:1.0:1651529344.535680:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177733 count 1 00010000:00010000:1.0:1651529344.535684:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50d74 lrc: 3/0,1 mode: --/PW res: [0x2b645:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535689:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000051f06669/0x3234de053c4e7f7 lrc: 2/0,0 mode: PR/PR res: [0x2b645:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d507a expref: 1286 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.535692:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.535693:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.535694:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50d74 lrc: 4/0,1 mode: --/PW res: [0x2b645:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.535697:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211285 00010000:00010000:1.0:1651529344.535700:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000051f06669/0x3234de053c4e7f7 lrc: 3/0,0 mode: PR/PR res: [0x2b645:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d507a expref: 1286 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.535703:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000051f06669/0x3234de053c4e7f7 lrc: 4/0,0 mode: PR/PR res: [0x2b645:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d507a expref: 1286 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.535707:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996988928:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.535707:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+780:39029:x1731745946420544:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.535712:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177732 count 1 00000100:00100000:1.0:1651529344.535718:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 0000000089d75f07 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.535724:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211286 00010000:00010000:0.0:1651529344.535725:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50d7b lrc: 3/0,1 mode: --/PW res: [0x2b644:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.535726:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+780:39029:x1731745946420672:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.535730:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177734 count 1 00010000:00010000:1.0:1651529344.535743:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50d82 lrc: 3/0,1 mode: --/PW res: [0x2b646:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535748:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000005282bc2/0x3234de053c4deab lrc: 2/0,0 mode: PR/PR res: [0x2b646:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b66 expref: 1286 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.535751:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.535752:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.535752:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50d82 lrc: 4/0,1 mode: --/PW res: [0x2b646:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535754:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a4a9e52a/0x3234de053c4ddd9 lrc: 2/0,0 mode: PR/PR res: [0x2b644:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d288e expref: 1286 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.535758:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000005282bc2/0x3234de053c4deab lrc: 3/0,0 mode: PR/PR res: [0x2b646:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b66 expref: 1286 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.535758:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.535759:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.535759:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50d7b lrc: 4/0,1 mode: --/PW res: [0x2b644:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535761:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000005282bc2/0x3234de053c4deab lrc: 4/0,0 mode: PR/PR res: [0x2b646:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b66 expref: 1286 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.535765:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996988992:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.535767:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a4a9e52a/0x3234de053c4ddd9 lrc: 3/0,0 mode: PR/PR res: [0x2b644:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d288e expref: 1286 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.535771:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a4a9e52a/0x3234de053c4ddd9 lrc: 4/0,0 mode: PR/PR res: [0x2b644:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d288e expref: 1286 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.535772:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f79d8146 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.535775:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000037ac96ac pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996989056:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.535796:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000504ef660 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.535824:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cee35a0c pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996988608:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.535828:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50d51 lrc: 3/0,1 mode: --/PW res: [0x2b63f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.535842:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006aa45e66 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996988672:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.535846:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50d58 lrc: 3/0,1 mode: --/PW res: [0x2b640:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.535864:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000075b025a pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996988800:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.535867:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.535867:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50d66 lrc: 3/0,1 mode: --/PW res: [0x2b642:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.535874:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.535880:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.535887:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.535895:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396301376 00000100:00100000:1.0:1651529344.535896:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.535900:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000054ed35ee/0x3234de053c4dd9a lrc: 4/0,0 mode: PR/PR res: [0x2b640:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d27d1 expref: 1287 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.535903:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000075e1000f pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996988736:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.535906:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50d5f lrc: 3/0,1 mode: --/PW res: [0x2b641:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.535906:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396301312 00010000:00010000:0.0:1651529344.535908:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bb5f9fa8/0x3234de053c4e61b lrc: 4/0,0 mode: PR/PR res: [0x2b63f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4996 expref: 1288 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.535913:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396301504 00000100:00100000:1.0:1651529344.535915:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bddc5ca7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996988864:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.535915:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001e100c7c/0x3234de053c4ca06 lrc: 4/0,0 mode: PR/PR res: [0x2b641:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda0d expref: 1289 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.535917:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50d6d lrc: 3/0,1 mode: --/PW res: [0x2b643:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.535921:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396301440 00000100:00100000:1.0:1651529344.535923:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396301568 00010000:00010000:0.0:1651529344.535923:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000702421e2/0x3234de053c4dece lrc: 4/0,0 mode: PR/PR res: [0x2b642:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c23 expref: 1290 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.535928:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dda68b75/0x3234de053c4d153 lrc: 4/0,0 mode: PR/PR res: [0x2b643:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf6bc expref: 1291 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.535928:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12061 00000100:00100000:0.0:1651529344.535930:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1291:41278:x1731746396301376:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.535932:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.535934:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12062 00010000:00010000:0.0:1651529344.535934:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000054ed35ee/0x3234de053c4dd9a lrc: 4/0,0 mode: PR/PR res: [0x2b640:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d27d1 expref: 1291 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.535935:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1291:41279:x1731746396301312:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.535937:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000054ed35ee/0x3234de053c4dd9a lrc: 3/0,0 mode: PR/PR res: [0x2b640:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d27d1 expref: 1291 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.535938:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.535940:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bb5f9fa8/0x3234de053c4e61b lrc: 4/0,0 mode: PR/PR res: [0x2b63f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4996 expref: 1291 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.535943:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bb5f9fa8/0x3234de053c4e61b lrc: 3/0,0 mode: PR/PR res: [0x2b63f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4996 expref: 1291 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.535943:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054ed35ee/0x3234de053c4dd9a lrc: 0/0,0 mode: --/PR res: [0x2b640:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d27d1 expref: 1291 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.535946:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.535947:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.535948:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50d58 lrc: 3/0,1 mode: PW/PW res: [0x2b640:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535949:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb5f9fa8/0x3234de053c4e61b lrc: 0/0,0 mode: --/PR res: [0x2b63f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4996 expref: 1290 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.535951:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50d58 lrc: 4/0,1 mode: PW/PW res: [0x2b640:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535953:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.535953:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.535954:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50d51 lrc: 3/0,1 mode: PW/PW res: [0x2b63f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.535957:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.535959:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50d51 lrc: 4/0,1 mode: PW/PW res: [0x2b63f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535965:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.535966:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1289:41278:x1731746396301376:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.535969:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12061 00000100:00100000:1.0:1651529344.535972:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1288:41279:x1731746396301312:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.535973:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12063 00000100:00100000:1.0:1651529344.535975:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12062 00000100:00100000:0.0:1651529344.535975:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1288:41278:x1731746396301504:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.535977:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.535978:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001e100c7c/0x3234de053c4ca06 lrc: 4/0,0 mode: PR/PR res: [0x2b641:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda0d expref: 1287 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.535979:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12064 00000100:00100000:1.0:1651529344.535981:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002017d1f9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1287:41279:x1731746396301440:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.535982:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001e100c7c/0x3234de053c4ca06 lrc: 3/0,0 mode: PR/PR res: [0x2b641:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda0d expref: 1287 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.535983:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.535985:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000702421e2/0x3234de053c4dece lrc: 4/0,0 mode: PR/PR res: [0x2b642:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c23 expref: 1287 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.535987:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e100c7c/0x3234de053c4ca06 lrc: 0/0,0 mode: --/PR res: [0x2b641:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda0d expref: 1287 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.535988:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000702421e2/0x3234de053c4dece lrc: 3/0,0 mode: PR/PR res: [0x2b642:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c23 expref: 1287 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.535990:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.535991:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.535991:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50d5f lrc: 3/0,1 mode: PW/PW res: [0x2b641:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535993:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000702421e2/0x3234de053c4dece lrc: 0/0,0 mode: --/PR res: [0x2b642:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c23 expref: 1286 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.535994:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50d5f lrc: 4/0,1 mode: PW/PW res: [0x2b641:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.535996:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.535997:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.535998:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50d66 lrc: 3/0,1 mode: PW/PW res: [0x2b642:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536000:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50d66 lrc: 4/0,1 mode: PW/PW res: [0x2b642:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.536004:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.536010:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1285:41278:x1731746396301504:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.536013:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12063 00010000:00010000:1.0:1651529344.536019:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.536022:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12065 00000100:00100000:1.0:1651529344.536025:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002017d1f9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1284:41279:x1731746396301440:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 43us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.536025:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1284:41279:x1731746396301568:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.536027:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.536028:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12064 00010000:00010000:0.0:1651529344.536029:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dda68b75/0x3234de053c4d153 lrc: 4/0,0 mode: PR/PR res: [0x2b643:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf6bc expref: 1284 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.536033:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dda68b75/0x3234de053c4d153 lrc: 3/0,0 mode: PR/PR res: [0x2b643:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf6bc expref: 1283 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.536038:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dda68b75/0x3234de053c4d153 lrc: 0/0,0 mode: --/PR res: [0x2b643:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf6bc expref: 1283 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.536039:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50d5f lrc: 3/0,1 mode: PW/PW res: [0x2b641:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.536041:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.536042:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.536043:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50d5f lrc: 3/0,1 mode: PW/PW res: [0x2b641:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.536043:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50d6d lrc: 3/0,1 mode: PW/PW res: [0x2b643:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536046:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50d5f lrc: 3/0,1 mode: PW/PW res: [0x2b641:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.536046:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50d6d lrc: 4/0,1 mode: PW/PW res: [0x2b643:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536048:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50d5f lrc: 2/0,0 mode: PW/PW res: [0x2b641:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.536054:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.536101:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1282:41279:x1731746396301568:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 76us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.536105:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12065 00000100:00100000:1.0:1651529344.536111:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+781:39030:x1731745946420352:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 828us (916us total) trans 12885079334 rc 0/0 00010000:00010000:0.0:1651529344.536112:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50d5f lrc: 2/0,0 mode: PW/PW res: [0x2b641:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.536114:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211281 00010000:00010000:0.0:1651529344.536116:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000356aa683 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.536117:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50d5f lrc: 2/0,0 mode: PW/PW res: [0x2b641:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.536120:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50d5f lrc: 3/0,0 mode: PW/PW res: [0x2b641:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536121:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50d6d lrc: 3/0,1 mode: PW/PW res: [0x2b643:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536124:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50d6d lrc: 3/0,1 mode: PW/PW res: [0x2b643:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.536125:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50d5f lrc: 1/0,0 mode: --/PW res: [0x2b641:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536127:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50d6d lrc: 3/0,1 mode: PW/PW res: [0x2b643:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.536127:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50d5f lrc: 0/0,0 mode: --/PW res: [0x2b641:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536130:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50d6d lrc: 2/0,0 mode: PW/PW res: [0x2b643:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.536133:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50d58 lrc: 3/0,1 mode: PW/PW res: [0x2b640:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.536136:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50d58 lrc: 3/0,1 mode: PW/PW res: [0x2b640:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.536158:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50d58 lrc: 3/0,1 mode: PW/PW res: [0x2b640:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.536162:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50d58 lrc: 2/0,0 mode: PW/PW res: [0x2b640:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.536177:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+781:39030:x1731745946420480:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 849us (965us total) trans 12885079335 rc 0/0 00000100:00100000:1.0:1651529344.536180:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211283 00010000:00010000:1.0:1651529344.536187:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50d6d lrc: 2/0,0 mode: PW/PW res: [0x2b643:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536190:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003a73c8ff already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.536191:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50d6d lrc: 2/0,0 mode: PW/PW res: [0x2b643:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536194:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50d6d lrc: 3/0,0 mode: PW/PW res: [0x2b643:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536199:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50d6d lrc: 1/0,0 mode: --/PW res: [0x2b643:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536202:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50d6d lrc: 0/0,0 mode: --/PW res: [0x2b643:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536206:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50d58 lrc: 2/0,0 mode: PW/PW res: [0x2b640:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.536207:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+781:39029:x1731745946420288:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 948us (1035us total) trans 12885079336 rc 0/0 00010000:00010000:1.0:1651529344.536209:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000827909ec already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.536210:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50d58 lrc: 2/0,0 mode: PW/PW res: [0x2b640:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.536210:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211280 00010000:00010000:1.0:1651529344.536213:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50d58 lrc: 3/0,0 mode: PW/PW res: [0x2b640:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536216:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50d58 lrc: 1/0,0 mode: --/PW res: [0x2b640:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536218:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50d58 lrc: 0/0,0 mode: --/PW res: [0x2b640:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.536218:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50d66 lrc: 3/0,1 mode: PW/PW res: [0x2b642:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536240:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50d51 lrc: 3/0,1 mode: PW/PW res: [0x2b63f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536243:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50d51 lrc: 3/0,1 mode: PW/PW res: [0x2b63f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.536245:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50d66 lrc: 3/0,1 mode: PW/PW res: [0x2b642:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536246:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50d51 lrc: 3/0,1 mode: PW/PW res: [0x2b63f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536248:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50d51 lrc: 2/0,0 mode: PW/PW res: [0x2b63f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.536248:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50d66 lrc: 3/0,1 mode: PW/PW res: [0x2b642:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.536251:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50d66 lrc: 2/0,0 mode: PW/PW res: [0x2b642:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.536286:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+782:39030:x1731745946420224:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1100us (1130us total) trans 12885079337 rc 0/0 00000100:00100000:1.0:1651529344.536289:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211279 00000100:00100000:0.0:1651529344.536295:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+781:39029:x1731745946420416:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 975us (1093us total) trans 12885079338 rc 0/0 00000100:00100000:0.0:1651529344.536298:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211282 00010000:00010000:0.0:1651529344.536305:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50d51 lrc: 2/0,0 mode: PW/PW res: [0x2b63f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.536308:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000017857b04 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.536309:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50d51 lrc: 2/0,0 mode: PW/PW res: [0x2b63f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.536312:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50d51 lrc: 3/0,0 mode: PW/PW res: [0x2b63f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.536317:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50d51 lrc: 1/0,0 mode: --/PW res: [0x2b63f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.536320:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50d51 lrc: 0/0,0 mode: --/PW res: [0x2b63f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.536331:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50d66 lrc: 2/0,0 mode: PW/PW res: [0x2b642:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.536333:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.536334:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eb2009d7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.536335:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50d66 lrc: 2/0,0 mode: PW/PW res: [0x2b642:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.536342:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50d66 lrc: 3/0,0 mode: PW/PW res: [0x2b642:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.536345:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.536345:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50d66 lrc: 1/0,0 mode: --/PW res: [0x2b642:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.536348:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50d66 lrc: 0/0,0 mode: --/PW res: [0x2b642:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.536356:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.536359:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000037ac96ac pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996989056:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.536362:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50d7b lrc: 3/0,1 mode: --/PW res: [0x2b644:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.536392:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996988928:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.536399:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396301632 00010000:00010000:1.0:1651529344.536402:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50d74 lrc: 3/0,1 mode: --/PW res: [0x2b645:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.536405:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000051f06669/0x3234de053c4e7f7 lrc: 4/0,0 mode: PR/PR res: [0x2b645:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d507a expref: 1282 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.536411:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996988992:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.536415:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396301696 00010000:00010000:0.0:1651529344.536418:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000005282bc2/0x3234de053c4deab lrc: 4/0,0 mode: PR/PR res: [0x2b646:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b66 expref: 1283 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.536419:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50d82 lrc: 3/0,1 mode: --/PW res: [0x2b646:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.536422:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396301760 00010000:00010000:0.0:1651529344.536424:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a4a9e52a/0x3234de053c4ddd9 lrc: 4/0,0 mode: PR/PR res: [0x2b644:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d288e expref: 1284 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.536426:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12066 00000100:00100000:1.0:1651529344.536428:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1284:41279:x1731746396301632:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.536429:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12067 00010000:00010000:1.0:1651529344.536431:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.536433:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000051f06669/0x3234de053c4e7f7 lrc: 4/0,0 mode: PR/PR res: [0x2b645:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d507a expref: 1284 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.536437:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000051f06669/0x3234de053c4e7f7 lrc: 3/0,0 mode: PR/PR res: [0x2b645:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d507a expref: 1284 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.536442:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051f06669/0x3234de053c4e7f7 lrc: 0/0,0 mode: --/PR res: [0x2b645:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d507a expref: 1284 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.536446:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.536447:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.536448:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50d74 lrc: 3/0,1 mode: PW/PW res: [0x2b645:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.536448:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1283:41279:x1731746396301696:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.536451:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.536452:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000005282bc2/0x3234de053c4deab lrc: 4/0,0 mode: PR/PR res: [0x2b646:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b66 expref: 1283 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.536453:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50d74 lrc: 4/0,1 mode: PW/PW res: [0x2b645:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.536456:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000005282bc2/0x3234de053c4deab lrc: 3/0,0 mode: PR/PR res: [0x2b646:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b66 expref: 1283 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.536459:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.536462:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005282bc2/0x3234de053c4deab lrc: 0/0,0 mode: --/PR res: [0x2b646:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b66 expref: 1283 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.536466:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.536466:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.536467:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1282:41279:x1731746396301632:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 38us (134us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.536467:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50d82 lrc: 3/0,1 mode: PW/PW res: [0x2b646:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.536469:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12066 00010000:00010000:0.0:1651529344.536470:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50d82 lrc: 4/0,1 mode: PW/PW res: [0x2b646:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.536475:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12068 00000100:00100000:1.0:1651529344.536476:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1281:41278:x1731746396301760:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.536480:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.536485:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.536487:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a4a9e52a/0x3234de053c4ddd9 lrc: 4/0,0 mode: PR/PR res: [0x2b644:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d288e expref: 1281 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.536488:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1281:41279:x1731746396301696:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (143us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.536491:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a4a9e52a/0x3234de053c4ddd9 lrc: 3/0,0 mode: PR/PR res: [0x2b644:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d288e expref: 1281 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.536491:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12067 00010000:00010000:1.0:1651529344.536496:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4a9e52a/0x3234de053c4ddd9 lrc: 0/0,0 mode: --/PR res: [0x2b644:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d288e expref: 1280 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.536499:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.536500:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.536500:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50d7b lrc: 3/0,1 mode: PW/PW res: [0x2b644:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536503:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50d7b lrc: 4/0,1 mode: PW/PW res: [0x2b644:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536514:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.536518:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50d7b lrc: 3/0,1 mode: PW/PW res: [0x2b644:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.536520:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1279:41278:x1731746396301760:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 43us (164us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.536521:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50d7b lrc: 3/0,1 mode: PW/PW res: [0x2b644:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.536523:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12068 00010000:00010000:0.0:1651529344.536525:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50d7b lrc: 3/0,1 mode: PW/PW res: [0x2b644:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.536527:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50d7b lrc: 2/0,0 mode: PW/PW res: [0x2b644:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536530:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50d82 lrc: 3/0,1 mode: PW/PW res: [0x2b646:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536538:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50d82 lrc: 3/0,1 mode: PW/PW res: [0x2b646:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536542:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50d82 lrc: 3/0,1 mode: PW/PW res: [0x2b646:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536544:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50d82 lrc: 2/0,0 mode: PW/PW res: [0x2b646:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.536589:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+782:39029:x1731745946420672:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 862us (939us total) trans 12885079340 rc 0/0 00000100:00100000:1.0:1651529344.536592:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211286 00000100:00100000:0.0:1651529344.536592:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+782:39029:x1731745946420544:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 893us (948us total) trans 12885079339 rc 0/0 00000100:00100000:0.0:1651529344.536595:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211285 00010000:00010000:1.0:1651529344.536599:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50d7b lrc: 2/0,0 mode: PW/PW res: [0x2b644:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536603:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003b0cd546 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.536603:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50d82 lrc: 2/0,0 mode: PW/PW res: [0x2b646:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536604:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50d7b lrc: 2/0,0 mode: PW/PW res: [0x2b644:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536609:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50d7b lrc: 3/0,0 mode: PW/PW res: [0x2b644:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536614:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50d7b lrc: 1/0,0 mode: --/PW res: [0x2b644:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536616:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50d7b lrc: 0/0,0 mode: --/PW res: [0x2b644:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.536617:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009ad9989c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.536619:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50d82 lrc: 2/0,0 mode: PW/PW res: [0x2b646:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536622:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50d74 lrc: 3/0,1 mode: PW/PW res: [0x2b645:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.536622:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50d82 lrc: 3/0,0 mode: PW/PW res: [0x2b646:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536625:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50d74 lrc: 3/0,1 mode: PW/PW res: [0x2b645:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.536627:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50d82 lrc: 1/0,0 mode: --/PW res: [0x2b646:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536628:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50d74 lrc: 3/0,1 mode: PW/PW res: [0x2b645:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.536630:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50d82 lrc: 0/0,0 mode: --/PW res: [0x2b646:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536631:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50d74 lrc: 2/0,0 mode: PW/PW res: [0x2b645:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.536634:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50d74 lrc: 3/0,0 mode: PW/PW res: [0x2b645:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.536643:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008f8dd346 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.536644:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50d74 lrc: 2/0,0 mode: PW/PW res: [0x2b645:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.536647:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50d74 lrc: 3/0,0 mode: PW/PW res: [0x2b645:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.536650:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50d74 lrc: 1/0,0 mode: --/PW res: [0x2b645:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.536652:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50d74 lrc: 0/0,0 mode: --/PW res: [0x2b645:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.536668:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+781:39030:x1731745946420608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 992us (1033us total) trans 12885079341 rc 0/0 00000100:00100000:1.0:1651529344.536671:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211284 00000100:00100000:0.0:1651529344.536679:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.536695:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.536699:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946421248 00000100:00100000:1.0:1651529344.536705:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946421376 00000100:00100000:0.0:1651529344.536706:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.536720:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946421312 00000100:00100000:1.0:1651529344.536727:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211287 00000100:00100000:1.0:1651529344.536729:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+783:39030:x1731745946421248:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.536741:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177735 count 1 00000100:00100000:0.0:1651529344.536741:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.536751:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50d89 lrc: 3/0,1 mode: --/PW res: [0x2b647:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.536755:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.536756:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c890f38f/0x3234de053c4cde8 lrc: 2/0,0 mode: PR/PR res: [0x2b647:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce91e expref: 1278 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.536764:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.536765:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.536766:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50d89 lrc: 4/0,1 mode: --/PW res: [0x2b647:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536773:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c890f38f/0x3234de053c4cde8 lrc: 3/0,0 mode: PR/PR res: [0x2b647:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce91e expref: 1278 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.536782:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946421504 00010000:00010000:1.0:1651529344.536784:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c890f38f/0x3234de053c4cde8 lrc: 4/0,0 mode: PR/PR res: [0x2b647:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce91e expref: 1278 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.536789:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996989120:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.536789:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946421440 00000100:00100000:0.0:1651529344.536794:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211288 00000100:00100000:0.0:1651529344.536795:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+785:39030:x1731745946421376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.536803:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 000000004ca54b8a going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.536807:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177737 count 1 00000100:00100000:1.0:1651529344.536810:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211289 00000100:00100000:1.0:1651529344.536812:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+785:39029:x1731745946421312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.536812:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50d90 lrc: 3/0,1 mode: --/PW res: [0x2b649:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.536817:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177736 count 1 00010000:00010000:0.0:1651529344.536817:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009afb6466/0x3234de053c4f0b0 lrc: 2/0,0 mode: PR/PR res: [0x2b649:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7572 expref: 1278 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.536820:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.536820:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.536821:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50d97 lrc: 3/0,1 mode: --/PW res: [0x2b648:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.536821:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50d90 lrc: 4/0,1 mode: --/PW res: [0x2b649:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536826:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003e05029b/0x3234de053c4e82f lrc: 2/0,0 mode: PR/PR res: [0x2b648:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5176 expref: 1278 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.536829:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.536829:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.536830:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50d97 lrc: 4/0,1 mode: --/PW res: [0x2b648:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536836:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003e05029b/0x3234de053c4e82f lrc: 3/0,0 mode: PR/PR res: [0x2b648:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5176 expref: 1278 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.536839:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003e05029b/0x3234de053c4e82f lrc: 4/0,0 mode: PR/PR res: [0x2b648:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5176 expref: 1278 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.536842:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009afb6466/0x3234de053c4f0b0 lrc: 3/0,0 mode: PR/PR res: [0x2b649:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7572 expref: 1278 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.536843:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996989184:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.536846:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009afb6466/0x3234de053c4f0b0 lrc: 4/0,0 mode: PR/PR res: [0x2b649:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7572 expref: 1278 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.536850:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 000000007e004c12 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.536850:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000673bcbe2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996989248:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.536855:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211290 00000100:00100000:1.0:1651529344.536857:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+785:39030:x1731745946421504:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.536860:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000000d706dff going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.536861:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177739 count 1 00010000:00010000:1.0:1651529344.536864:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50d9e lrc: 3/0,1 mode: --/PW res: [0x2b64b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.536866:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211291 00000100:00100000:0.0:1651529344.536868:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+785:39029:x1731745946421440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.536869:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009b55ee85/0x3234de053c4ef83 lrc: 2/0,0 mode: PR/PR res: [0x2b64b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d705c expref: 1278 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.536871:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.536872:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.536873:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50d9e lrc: 4/0,1 mode: --/PW res: [0x2b64b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.536873:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177738 count 1 00010000:00010000:0.0:1651529344.536877:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50da5 lrc: 3/0,1 mode: --/PW res: [0x2b64a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.536878:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009b55ee85/0x3234de053c4ef83 lrc: 3/0,0 mode: PR/PR res: [0x2b64b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d705c expref: 1278 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.536882:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009b55ee85/0x3234de053c4ef83 lrc: 4/0,0 mode: PR/PR res: [0x2b64b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d705c expref: 1278 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.536884:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000031b1c31d/0x3234de053c4e96a lrc: 2/0,0 mode: PR/PR res: [0x2b64a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d56f5 expref: 1278 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.536886:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009b8db73b pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996989312:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.536887:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.536887:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.536888:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50da5 lrc: 4/0,1 mode: --/PW res: [0x2b64a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.536891:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 0000000071742acc going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.536894:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000031b1c31d/0x3234de053c4e96a lrc: 3/0,0 mode: PR/PR res: [0x2b64a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d56f5 expref: 1278 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.536898:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000031b1c31d/0x3234de053c4e96a lrc: 4/0,0 mode: PR/PR res: [0x2b64a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d56f5 expref: 1278 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.536902:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000974b675b pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996989376:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.536908:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e7e12492 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.536979:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.536987:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.536993:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.536999:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946421696 00000100:00100000:0.0:1651529344.537010:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946421760 00000100:00100000:1.0:1651529344.537013:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946421824 00000100:00100000:0.0:1651529344.537017:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211292 00000100:00100000:0.0:1651529344.537018:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+788:39029:x1731745946421696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.537024:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177740 count 1 00000100:00100000:1.0:1651529344.537026:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211293 00000100:00100000:1.0:1651529344.537027:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+788:39030:x1731745946421760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.537028:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50dac lrc: 3/0,1 mode: --/PW res: [0x2b64c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.537032:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177741 count 1 00010000:00010000:0.0:1651529344.537035:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c4f3f8 lrc: 2/0,0 mode: PR/PR res: [0x2b64c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8237 expref: 1278 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.537036:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50db3 lrc: 3/0,1 mode: --/PW res: [0x2b64d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537038:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.537038:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.537039:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50dac lrc: 4/0,1 mode: --/PW res: [0x2b64c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537041:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c4df22 lrc: 2/0,0 mode: PR/PR res: [0x2b64d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2dd5 expref: 1278 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.537044:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.537044:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.537045:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50db3 lrc: 4/0,1 mode: --/PW res: [0x2b64d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537045:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c4f3f8 lrc: 3/0,0 mode: PR/PR res: [0x2b64c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8237 expref: 1278 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.537049:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c4f3f8 lrc: 4/0,0 mode: PR/PR res: [0x2b64c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8237 expref: 1278 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.537051:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c4df22 lrc: 3/0,0 mode: PR/PR res: [0x2b64d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2dd5 expref: 1278 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.537053:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ac8dec6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996989440:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.537055:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c4df22 lrc: 4/0,0 mode: PR/PR res: [0x2b64d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2dd5 expref: 1278 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.537059:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a4b486d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996989504:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.537065:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000504ef660 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.537072:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211294 00000100:00100000:1.0:1651529344.537074:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fe434b1c going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.537091:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+788:39029:x1731745946421824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.537107:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177742 count 1 00010000:00010000:0.0:1651529344.537112:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50dba lrc: 3/0,1 mode: --/PW res: [0x2b64e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537116:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e173dfae/0x3234de053c4aca1 lrc: 2/0,0 mode: PR/PR res: [0x2b64e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbea7 expref: 1278 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.537119:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.537120:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.537121:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50dba lrc: 4/0,1 mode: --/PW res: [0x2b64e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537127:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e173dfae/0x3234de053c4aca1 lrc: 3/0,0 mode: PR/PR res: [0x2b64e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbea7 expref: 1278 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.537131:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e173dfae/0x3234de053c4aca1 lrc: 4/0,0 mode: PR/PR res: [0x2b64e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbea7 expref: 1278 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.537135:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a573b31 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996989568:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.537143:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000afe7ff7b going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.537169:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000673bcbe2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996989248:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.537171:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996989184:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.537174:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50d90 lrc: 3/0,1 mode: --/PW res: [0x2b649:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537175:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50d97 lrc: 3/0,1 mode: --/PW res: [0x2b648:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.537183:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996989120:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.537185:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50d89 lrc: 3/0,1 mode: --/PW res: [0x2b647:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.537360:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009b8db73b pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996989312:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.537364:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50d9e lrc: 3/0,1 mode: --/PW res: [0x2b64b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.537397:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.537406:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396302464 00000100:00100000:0.0:1651529344.537408:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.537417:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c890f38f/0x3234de053c4cde8 lrc: 4/0,0 mode: PR/PR res: [0x2b647:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce91e expref: 1279 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.537417:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.537426:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.537435:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396302592 00010000:00010000:1.0:1651529344.537438:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009afb6466/0x3234de053c4f0b0 lrc: 4/0,0 mode: PR/PR res: [0x2b649:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7572 expref: 1280 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.537440:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.537445:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396302720 00010000:00010000:1.0:1651529344.537447:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009b55ee85/0x3234de053c4ef83 lrc: 4/0,0 mode: PR/PR res: [0x2b64b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d705c expref: 1281 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.537451:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396302528 00010000:00010000:1.0:1651529344.537453:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003e05029b/0x3234de053c4e82f lrc: 4/0,0 mode: PR/PR res: [0x2b648:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5176 expref: 1282 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.537457:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396302656 00000100:00100000:0.0:1651529344.537463:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000974b675b pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996989376:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.537466:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000031b1c31d/0x3234de053c4e96a lrc: 4/0,0 mode: PR/PR res: [0x2b64a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d56f5 expref: 1283 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.537468:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50da5 lrc: 3/0,1 mode: --/PW res: [0x2b64a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.537471:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12069 00000100:00100000:1.0:1651529344.537473:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1283:41279:x1731746396302464:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.537475:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.537475:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ac8dec6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996989440:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.537477:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c890f38f/0x3234de053c4cde8 lrc: 4/0,0 mode: PR/PR res: [0x2b647:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce91e expref: 1283 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.537477:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50dac lrc: 3/0,1 mode: --/PW res: [0x2b64c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537480:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c890f38f/0x3234de053c4cde8 lrc: 3/0,0 mode: PR/PR res: [0x2b647:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce91e expref: 1283 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.537484:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12070 00010000:00010000:1.0:1651529344.537486:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c890f38f/0x3234de053c4cde8 lrc: 0/0,0 mode: --/PR res: [0x2b647:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce91e expref: 1283 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.537486:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1283:41279:x1731746396302592:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.537489:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.537490:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.537490:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.537491:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50d89 lrc: 3/0,1 mode: PW/PW res: [0x2b647:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537491:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009afb6466/0x3234de053c4f0b0 lrc: 4/0,0 mode: PR/PR res: [0x2b649:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7572 expref: 1282 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.537494:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50d89 lrc: 4/0,1 mode: PW/PW res: [0x2b647:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537495:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009afb6466/0x3234de053c4f0b0 lrc: 3/0,0 mode: PR/PR res: [0x2b649:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7572 expref: 1282 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.537500:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009afb6466/0x3234de053c4f0b0 lrc: 0/0,0 mode: --/PR res: [0x2b649:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7572 expref: 1282 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.537501:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.537504:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.537509:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1281:41279:x1731746396302464:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.537511:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12069 00000100:00100000:1.0:1651529344.537516:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12071 00000100:00100000:1.0:1651529344.537517:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cd81e40c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1280:41279:x1731746396302720:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.537520:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.537520:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.537521:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009b55ee85/0x3234de053c4ef83 lrc: 4/0,0 mode: PR/PR res: [0x2b64b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d705c expref: 1280 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.537521:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50d90 lrc: 3/0,1 mode: PW/PW res: [0x2b649:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537525:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009b55ee85/0x3234de053c4ef83 lrc: 3/0,0 mode: PR/PR res: [0x2b64b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d705c expref: 1280 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.537525:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50d90 lrc: 4/0,1 mode: PW/PW res: [0x2b649:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537529:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b55ee85/0x3234de053c4ef83 lrc: 0/0,0 mode: --/PR res: [0x2b64b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d705c expref: 1280 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.537531:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.537532:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.537533:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.537534:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50d9e lrc: 3/0,1 mode: PW/PW res: [0x2b64b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537539:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50d9e lrc: 4/0,1 mode: PW/PW res: [0x2b64b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.537539:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1279:41279:x1731746396302592:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 52us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.537542:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12070 00010000:00010000:1.0:1651529344.537544:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.537548:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12072 00000100:00100000:1.0:1651529344.537549:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cd81e40c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1278:41279:x1731746396302720:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 31us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.537550:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1278:41278:x1731746396302528:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.537551:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12071 00010000:00010000:0.0:1651529344.537552:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.537559:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12073 00000100:00100000:1.0:1651529344.537561:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1277:41278:x1731746396302656:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.537563:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.537564:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000031b1c31d/0x3234de053c4e96a lrc: 4/0,0 mode: PR/PR res: [0x2b64a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d56f5 expref: 1277 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.537566:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003e05029b/0x3234de053c4e82f lrc: 4/0,0 mode: PR/PR res: [0x2b648:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5176 expref: 1277 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.537568:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000031b1c31d/0x3234de053c4e96a lrc: 3/0,0 mode: PR/PR res: [0x2b64a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d56f5 expref: 1277 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.537571:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003e05029b/0x3234de053c4e82f lrc: 3/0,0 mode: PR/PR res: [0x2b648:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5176 expref: 1277 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.537572:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031b1c31d/0x3234de053c4e96a lrc: 0/0,0 mode: --/PR res: [0x2b64a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d56f5 expref: 1277 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.537576:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.537576:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.537576:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e05029b/0x3234de053c4e82f lrc: 0/0,0 mode: --/PR res: [0x2b648:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5176 expref: 1276 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.537577:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50da5 lrc: 3/0,1 mode: PW/PW res: [0x2b64a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537580:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50da5 lrc: 4/0,1 mode: PW/PW res: [0x2b64a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537580:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.537581:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.537582:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50d97 lrc: 3/0,1 mode: PW/PW res: [0x2b648:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537585:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50d97 lrc: 4/0,1 mode: PW/PW res: [0x2b648:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537592:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.537600:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.537603:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1275:41278:x1731746396302656:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 41us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.537606:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12073 00000100:00100000:0.0:1651529344.537607:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1275:41278:x1731746396302528:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 57us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.537610:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12072 00010000:00010000:1.0:1651529344.537614:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50d97 lrc: 3/0,1 mode: PW/PW res: [0x2b648:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537617:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50d97 lrc: 3/0,1 mode: PW/PW res: [0x2b648:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537617:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50d90 lrc: 3/0,1 mode: PW/PW res: [0x2b649:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537620:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50d97 lrc: 3/0,1 mode: PW/PW res: [0x2b648:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537620:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50d90 lrc: 3/0,1 mode: PW/PW res: [0x2b649:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537623:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50d97 lrc: 2/0,0 mode: PW/PW res: [0x2b648:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537626:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50d90 lrc: 3/0,1 mode: PW/PW res: [0x2b649:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537629:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50d90 lrc: 2/0,0 mode: PW/PW res: [0x2b649:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.537662:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+790:39029:x1731745946421312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 849us (955us total) trans 12885079342 rc 0/0 00000100:00100000:1.0:1651529344.537665:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211289 00010000:00010000:1.0:1651529344.537672:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50d97 lrc: 2/0,0 mode: PW/PW res: [0x2b648:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537675:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008cc70fcd already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.537676:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50d97 lrc: 2/0,0 mode: PW/PW res: [0x2b648:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537681:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50d97 lrc: 3/0,0 mode: PW/PW res: [0x2b648:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.537684:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+789:39030:x1731745946421376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 887us (988us total) trans 12885079343 rc 0/0 00010000:00010000:1.0:1651529344.537685:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50d97 lrc: 1/0,0 mode: --/PW res: [0x2b648:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.537687:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211288 00010000:00010000:1.0:1651529344.537688:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50d97 lrc: 0/0,0 mode: --/PW res: [0x2b648:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537692:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50d90 lrc: 2/0,0 mode: PW/PW res: [0x2b649:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537695:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000034aad4d already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.537696:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50d90 lrc: 2/0,0 mode: PW/PW res: [0x2b649:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537696:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50da5 lrc: 3/0,1 mode: PW/PW res: [0x2b64a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537699:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50d90 lrc: 3/0,0 mode: PW/PW res: [0x2b649:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537699:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50da5 lrc: 3/0,1 mode: PW/PW res: [0x2b64a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537702:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50d90 lrc: 1/0,0 mode: --/PW res: [0x2b649:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537702:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50da5 lrc: 3/0,1 mode: PW/PW res: [0x2b64a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537704:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50d90 lrc: 0/0,0 mode: --/PW res: [0x2b649:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537704:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50da5 lrc: 2/0,0 mode: PW/PW res: [0x2b64a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537709:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50d89 lrc: 3/0,1 mode: PW/PW res: [0x2b647:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537714:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50d89 lrc: 3/0,1 mode: PW/PW res: [0x2b647:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537717:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50d89 lrc: 3/0,1 mode: PW/PW res: [0x2b647:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537720:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50d89 lrc: 2/0,0 mode: PW/PW res: [0x2b647:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.537759:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+790:39029:x1731745946421440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 889us (1004us total) trans 12885079344 rc 0/0 00000100:00100000:0.0:1651529344.537762:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211291 00010000:00010000:0.0:1651529344.537769:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50da5 lrc: 2/0,0 mode: PW/PW res: [0x2b64a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.537771:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+789:39030:x1731745946421248:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1042us (1092us total) trans 12885079345 rc 0/0 00000100:00100000:1.0:1651529344.537774:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211287 00010000:00010000:0.0:1651529344.537775:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001d253066 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.537776:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50da5 lrc: 2/0,0 mode: PW/PW res: [0x2b64a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537779:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50da5 lrc: 3/0,0 mode: PW/PW res: [0x2b64a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537781:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50d9e lrc: 3/0,1 mode: PW/PW res: [0x2b64b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537783:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50da5 lrc: 1/0,0 mode: --/PW res: [0x2b64a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537784:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50d9e lrc: 3/0,1 mode: PW/PW res: [0x2b64b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537786:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50da5 lrc: 0/0,0 mode: --/PW res: [0x2b64a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537787:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50d9e lrc: 3/0,1 mode: PW/PW res: [0x2b64b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537790:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50d9e lrc: 2/0,0 mode: PW/PW res: [0x2b64b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537790:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50d89 lrc: 2/0,0 mode: PW/PW res: [0x2b647:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537793:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d44dd5ea already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.537794:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50d89 lrc: 2/0,0 mode: PW/PW res: [0x2b647:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537797:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50d89 lrc: 3/0,0 mode: PW/PW res: [0x2b647:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537800:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50d89 lrc: 1/0,0 mode: --/PW res: [0x2b647:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537802:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50d89 lrc: 0/0,0 mode: --/PW res: [0x2b647:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537806:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50d9e lrc: 2/0,0 mode: PW/PW res: [0x2b64b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537809:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000009bc967c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.537810:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50d9e lrc: 2/0,0 mode: PW/PW res: [0x2b64b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537812:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50d9e lrc: 3/0,0 mode: PW/PW res: [0x2b64b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537815:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50d9e lrc: 1/0,0 mode: --/PW res: [0x2b64b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.537818:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50d9e lrc: 0/0,0 mode: --/PW res: [0x2b64b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.537822:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+789:39030:x1731745946421504:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 964us (1088us total) trans 12885079346 rc 0/0 00000100:00100000:1.0:1651529344.537826:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211290 00000100:00100000:0.0:1651529344.537861:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.537865:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a4b486d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996989504:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.537869:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50db3 lrc: 3/0,1 mode: --/PW res: [0x2b64d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.537870:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.537893:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396302784 00010000:00010000:0.0:1651529344.537905:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c4f3f8 lrc: 4/0,0 mode: PR/PR res: [0x2b64c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8237 expref: 1274 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.537920:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396302848 00010000:00010000:0.0:1651529344.537923:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c4df22 lrc: 4/0,0 mode: PR/PR res: [0x2b64d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2dd5 expref: 1275 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.537927:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.537936:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396302912 00010000:00010000:0.0:1651529344.537939:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e173dfae/0x3234de053c4aca1 lrc: 5/0,0 mode: PR/PR res: [0x2b64e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbea7 expref: 1276 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.537944:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12074 00000100:00100000:0.0:1651529344.537946:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1276:41278:x1731746396302784:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.537949:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.537950:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c4f3f8 lrc: 4/0,0 mode: PR/PR res: [0x2b64c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8237 expref: 1276 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.537954:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c4f3f8 lrc: 3/0,0 mode: PR/PR res: [0x2b64c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8237 expref: 1276 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.537959:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c4f3f8 lrc: 0/0,0 mode: --/PR res: [0x2b64c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8237 expref: 1276 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.537963:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.537963:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.537964:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12075 00010000:00010000:0.0:1651529344.537964:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50dac lrc: 3/0,1 mode: PW/PW res: [0x2b64c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.537966:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1275:41278:x1731746396302848:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.537967:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50dac lrc: 4/0,1 mode: PW/PW res: [0x2b64c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.537970:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.537972:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c4df22 lrc: 4/0,0 mode: PR/PR res: [0x2b64d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2dd5 expref: 1275 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.537974:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.537976:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c4df22 lrc: 3/0,0 mode: PR/PR res: [0x2b64d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2dd5 expref: 1275 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.537981:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1275:41278:x1731746396302784:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 34us (121us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.537982:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c4df22 lrc: 0/0,0 mode: --/PR res: [0x2b64d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2dd5 expref: 1275 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.537983:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12074 00010000:00010000:1.0:1651529344.537986:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.537987:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.537988:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50db3 lrc: 3/0,1 mode: PW/PW res: [0x2b64d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.537988:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12076 00010000:00010000:1.0:1651529344.537991:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50db3 lrc: 4/0,1 mode: PW/PW res: [0x2b64d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.538000:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.538005:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1273:41279:x1731746396302912:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.538007:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1273:41278:x1731746396302848:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (136us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.538008:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.538009:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12075 00010000:00010000:0.0:1651529344.538010:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e173dfae/0x3234de053c4aca1 lrc: 5/0,0 mode: PR/PR res: [0x2b64e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbea7 expref: 1273 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.538014:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e173dfae/0x3234de053c4aca1 lrc: 4/0,0 mode: PR/PR res: [0x2b64e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbea7 expref: 1272 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.538017:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50db3 lrc: 3/0,1 mode: PW/PW res: [0x2b64d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538019:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.538020:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50db3 lrc: 3/0,1 mode: PW/PW res: [0x2b64d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538020:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.538020:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50dba lrc: 3/0,1 mode: PW/PW res: [0x2b64e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.538023:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50db3 lrc: 3/0,1 mode: PW/PW res: [0x2b64d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538023:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50dba lrc: 4/0,1 mode: PW/PW res: [0x2b64e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.538026:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50db3 lrc: 2/0,0 mode: PW/PW res: [0x2b64d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538028:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.538041:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1272:41279:x1731746396302912:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.538044:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12076 00010000:00010000:0.0:1651529344.538067:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50db3 lrc: 2/0,0 mode: PW/PW res: [0x2b64d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538071:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000092d9e682 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.538072:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50db3 lrc: 2/0,0 mode: PW/PW res: [0x2b64d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.538074:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+789:39030:x1731745946421760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1046us (1087us total) trans 12885079347 rc 0/0 00010000:00010000:0.0:1651529344.538074:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50db3 lrc: 3/0,0 mode: PW/PW res: [0x2b64d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.538077:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211293 00010000:00010000:0.0:1651529344.538079:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50db3 lrc: 1/0,0 mode: --/PW res: [0x2b64d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538082:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50db3 lrc: 0/0,0 mode: --/PW res: [0x2b64d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538088:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50dac lrc: 3/0,1 mode: PW/PW res: [0x2b64c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.538094:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.538110:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50dac lrc: 3/0,1 mode: PW/PW res: [0x2b64c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538113:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50dac lrc: 3/0,1 mode: PW/PW res: [0x2b64c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538116:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50dac lrc: 2/0,0 mode: PW/PW res: [0x2b64c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.538144:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.538152:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.538173:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.538184:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+789:39029:x1731745946421696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1157us (1198us total) trans 12885079348 rc 0/0 00000100:00100000:0.0:1651529344.538187:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211292 00000100:00100000:0.0:1651529344.538193:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946422272 00000100:00100000:0.0:1651529344.538198:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946422336 00000100:00100000:0.0:1651529344.538205:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946422464 00000100:00100000:1.0:1651529344.538209:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.538209:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946422400 00000100:00100000:0.0:1651529344.538214:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946422528 00000100:00100000:0.0:1651529344.538249:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211295 00000100:00100000:0.0:1651529344.538251:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+793:39030:x1731745946422272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.538252:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211296 00000100:00100000:1.0:1651529344.538254:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+793:39030:x1731745946422336:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.538257:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177743 count 1 00002000:00080000:1.0:1651529344.538260:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177744 count 1 00010000:00010000:0.0:1651529344.538261:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50dc1 lrc: 3/0,1 mode: --/PW res: [0x2b64f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.538264:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50dc8 lrc: 3/0,1 mode: --/PW res: [0x2b650:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538265:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000013e02de/0x3234de053c4de11 lrc: 2/0,0 mode: PR/PR res: [0x2b64f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2975 expref: 1271 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.538268:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.538269:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003ad9543a/0x3234de053c4d6a1 lrc: 2/0,0 mode: PR/PR res: [0x2b650:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c41 expref: 1271 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.538269:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.538269:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50dc1 lrc: 4/0,1 mode: --/PW res: [0x2b64f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.538272:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.538273:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.538274:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50dc8 lrc: 4/0,1 mode: --/PW res: [0x2b650:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538276:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000013e02de/0x3234de053c4de11 lrc: 3/0,0 mode: PR/PR res: [0x2b64f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2975 expref: 1271 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.538280:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003ad9543a/0x3234de053c4d6a1 lrc: 3/0,0 mode: PR/PR res: [0x2b650:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c41 expref: 1271 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.538280:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000013e02de/0x3234de053c4de11 lrc: 4/0,0 mode: PR/PR res: [0x2b64f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2975 expref: 1271 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.538284:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003ad9543a/0x3234de053c4d6a1 lrc: 4/0,0 mode: PR/PR res: [0x2b650:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c41 expref: 1271 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.538285:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000824ca843 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996989632:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.538288:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996989696:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.538294:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 0000000070e666f7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.538296:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fe434b1c going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.538299:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50dac lrc: 2/0,0 mode: PW/PW res: [0x2b64c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.538302:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211297 00010000:00010000:0.0:1651529344.538302:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f27c804 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.538303:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50dac lrc: 2/0,0 mode: PW/PW res: [0x2b64c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.538304:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+793:39029:x1731745946422464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.538308:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177746 count 1 00010000:00010000:0.0:1651529344.538308:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50dac lrc: 3/0,0 mode: PW/PW res: [0x2b64c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.538311:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50dcf lrc: 3/0,1 mode: --/PW res: [0x2b652:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538313:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50dac lrc: 1/0,0 mode: --/PW res: [0x2b64c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.538315:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000842fc2b4/0x3234de053c4afb8 lrc: 2/0,0 mode: PR/PR res: [0x2b652:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbfe2 expref: 1271 pid: 80281 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.538316:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50dac lrc: 0/0,0 mode: --/PW res: [0x2b64c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.538318:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.538319:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.538319:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50dcf lrc: 4/0,1 mode: --/PW res: [0x2b652:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.538325:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000842fc2b4/0x3234de053c4afb8 lrc: 3/0,0 mode: PR/PR res: [0x2b652:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbfe2 expref: 1271 pid: 80281 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.538328:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000842fc2b4/0x3234de053c4afb8 lrc: 4/0,0 mode: PR/PR res: [0x2b652:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbfe2 expref: 1271 pid: 80281 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.538332:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996989760:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.538336:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000babe2d90 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.538362:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211298 00000100:00100000:1.0:1651529344.538364:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211299 00000100:00100000:0.0:1651529344.538364:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+793:39029:x1731745946422400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.538370:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177745 count 1 00000100:00100000:1.0:1651529344.538373:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+793:39030:x1731745946422528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.538373:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50dd6 lrc: 3/0,1 mode: --/PW res: [0x2b651:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.538378:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177747 count 1 00010000:00010000:0.0:1651529344.538378:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003f20516a/0x3234de053c4a076 lrc: 2/0,0 mode: PR/PR res: [0x2b651:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb792 expref: 1271 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.538381:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.538382:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50ddd lrc: 3/0,1 mode: --/PW res: [0x2b653:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538382:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.538382:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50dd6 lrc: 4/0,1 mode: --/PW res: [0x2b651:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.538386:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000887ca6bc/0x3234de053c4ed0d lrc: 2/0,0 mode: PR/PR res: [0x2b653:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6606 expref: 1271 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.538389:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.538389:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003f20516a/0x3234de053c4a076 lrc: 3/0,0 mode: PR/PR res: [0x2b651:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb792 expref: 1271 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.538390:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.538390:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50ddd lrc: 4/0,1 mode: --/PW res: [0x2b653:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538392:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003f20516a/0x3234de053c4a076 lrc: 4/0,0 mode: PR/PR res: [0x2b651:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb792 expref: 1271 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.538397:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ebb53b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996989824:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.538399:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000887ca6bc/0x3234de053c4ed0d lrc: 3/0,0 mode: PR/PR res: [0x2b653:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6606 expref: 1271 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.538402:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000887ca6bc/0x3234de053c4ed0d lrc: 4/0,0 mode: PR/PR res: [0x2b653:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6606 expref: 1271 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.538404:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ff7bf023 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.538406:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996989888:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.538412:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 0000000089d75f07 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.538414:0:106695:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e173dfae/0x3234de053c4aca1 lrc: 0/0,0 mode: --/PR res: [0x2b64e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbea7 expref: 1271 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.538418:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a573b31 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996989568:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.538421:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50dba lrc: 3/0,1 mode: PW/PW res: [0x2b64e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538425:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50dba lrc: 3/0,1 mode: PW/PW res: [0x2b64e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.538427:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.538427:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50dba lrc: 3/0,1 mode: PW/PW res: [0x2b64e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538430:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50dba lrc: 3/0,1 mode: PW/PW res: [0x2b64e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538433:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50dba lrc: 2/0,0 mode: PW/PW res: [0x2b64e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.538435:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.538446:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946422592 00000100:00100000:1.0:1651529344.538453:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946422656 00000100:00100000:1.0:1651529344.538461:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211300 00000100:00100000:1.0:1651529344.538462:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+796:39029:x1731745946422592:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.538467:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177748 count 1 00010000:00010000:1.0:1651529344.538471:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50de4 lrc: 3/0,1 mode: --/PW res: [0x2b654:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.538475:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000028ae306d/0x3234de053c4bb81 lrc: 2/0,0 mode: PR/PR res: [0x2b654:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc568 expref: 1270 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.538478:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.538479:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.538480:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50de4 lrc: 4/0,1 mode: --/PW res: [0x2b654:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.538488:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+796:39029:x1731745946421824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1396us (1495us total) trans 12885079349 rc 0/0 00000100:00100000:0.0:1651529344.538491:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211294 00010000:00010000:1.0:1651529344.538494:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000028ae306d/0x3234de053c4bb81 lrc: 3/0,0 mode: PR/PR res: [0x2b654:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc568 expref: 1270 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.538497:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211301 00010000:00010000:1.0:1651529344.538498:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000028ae306d/0x3234de053c4bb81 lrc: 4/0,0 mode: PR/PR res: [0x2b654:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc568 expref: 1270 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.538499:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+795:39030:x1731745946422656:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.538501:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000075e1000f pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996989952:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.538504:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177749 count 1 00000100:00100000:1.0:1651529344.538508:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 0000000071742acc going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.538508:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50deb lrc: 3/0,1 mode: --/PW res: [0x2b655:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538513:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006d136d05/0x3234de053c4c7ba lrc: 2/0,0 mode: PR/PR res: [0x2b655:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd146 expref: 1270 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.538514:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50dba lrc: 2/0,0 mode: PW/PW res: [0x2b64e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538516:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.538516:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.538517:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2a2495 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.538517:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50deb lrc: 4/0,1 mode: --/PW res: [0x2b655:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.538518:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50dba lrc: 2/0,0 mode: PW/PW res: [0x2b64e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.538522:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50dba lrc: 3/0,0 mode: PW/PW res: [0x2b64e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538524:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006d136d05/0x3234de053c4c7ba lrc: 3/0,0 mode: PR/PR res: [0x2b655:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd146 expref: 1270 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.538526:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50dba lrc: 1/0,0 mode: --/PW res: [0x2b64e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538527:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006d136d05/0x3234de053c4c7ba lrc: 4/0,0 mode: PR/PR res: [0x2b655:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd146 expref: 1270 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.538529:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50dba lrc: 0/0,0 mode: --/PW res: [0x2b64e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.538531:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a573b31 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996990016:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.538538:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000afe7ff7b going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.538697:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.538708:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946422912 00000100:00100000:0.0:1651529344.538716:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211302 00000100:00100000:0.0:1651529344.538718:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+796:39029:x1731745946422912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.538723:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177750 count 1 00010000:00010000:0.0:1651529344.538727:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50df2 lrc: 3/0,1 mode: --/PW res: [0x2b656:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538742:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007f832a18/0x3234de053c4e294 lrc: 2/0,0 mode: PR/PR res: [0x2b656:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3bb9 expref: 1270 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.538746:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.538747:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.538747:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50df2 lrc: 4/0,1 mode: --/PW res: [0x2b656:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.538754:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007f832a18/0x3234de053c4e294 lrc: 3/0,0 mode: PR/PR res: [0x2b656:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3bb9 expref: 1270 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.538758:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007f832a18/0x3234de053c4e294 lrc: 4/0,0 mode: PR/PR res: [0x2b656:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3bb9 expref: 1270 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.538762:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fc130417 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996990080:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.538773:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 000000003678d25f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.538857:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996989696:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.538862:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50dc8 lrc: 3/0,1 mode: --/PW res: [0x2b650:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.538880:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000824ca843 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996989632:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.538884:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996989760:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.538884:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50dc1 lrc: 3/0,1 mode: --/PW res: [0x2b64f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.538887:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50dcf lrc: 3/0,1 mode: --/PW res: [0x2b652:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.539131:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ebb53b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996989824:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.539135:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50dd6 lrc: 3/0,1 mode: --/PW res: [0x2b651:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.539143:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.539150:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.539159:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.539165:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a573b31 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996990016:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.539166:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.539168:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50deb lrc: 3/0,1 mode: --/PW res: [0x2b655:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.539173:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.539176:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396303360 00000100:00100000:1.0:1651529344.539180:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996989888:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.539181:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000013e02de/0x3234de053c4de11 lrc: 4/0,0 mode: PR/PR res: [0x2b64f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2975 expref: 1271 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.539184:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50ddd lrc: 3/0,1 mode: --/PW res: [0x2b653:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.539186:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396303488 00010000:00010000:0.0:1651529344.539189:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000842fc2b4/0x3234de053c4afb8 lrc: 4/0,0 mode: PR/PR res: [0x2b652:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbfe2 expref: 1272 pid: 80281 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.539191:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000075e1000f pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996989952:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.539193:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50de4 lrc: 3/0,1 mode: --/PW res: [0x2b654:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.539193:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396303616 00010000:00010000:0.0:1651529344.539195:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000887ca6bc/0x3234de053c4ed0d lrc: 4/0,0 mode: PR/PR res: [0x2b653:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6606 expref: 1273 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.539199:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396303424 00000100:00100000:0.0:1651529344.539200:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396303552 00010000:00010000:0.0:1651529344.539201:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003f20516a/0x3234de053c4a076 lrc: 4/0,0 mode: PR/PR res: [0x2b651:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb792 expref: 1275 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.539204:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003ad9543a/0x3234de053c4d6a1 lrc: 4/0,0 mode: PR/PR res: [0x2b650:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c41 expref: 1275 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.539206:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12077 00000100:00100000:0.0:1651529344.539208:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1275:41279:x1731746396303360:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.539211:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12078 00010000:00010000:0.0:1651529344.539211:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.539212:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a37852a8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1275:41279:x1731746396303488:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.539212:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000013e02de/0x3234de053c4de11 lrc: 4/0,0 mode: PR/PR res: [0x2b64f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2975 expref: 1275 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.539215:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.539216:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000013e02de/0x3234de053c4de11 lrc: 3/0,0 mode: PR/PR res: [0x2b64f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2975 expref: 1275 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.539217:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000842fc2b4/0x3234de053c4afb8 lrc: 4/0,0 mode: PR/PR res: [0x2b652:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbfe2 expref: 1275 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.539221:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000842fc2b4/0x3234de053c4afb8 lrc: 3/0,0 mode: PR/PR res: [0x2b652:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbfe2 expref: 1275 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.539241:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000842fc2b4/0x3234de053c4afb8 lrc: 0/0,0 mode: --/PR res: [0x2b652:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbfe2 expref: 1275 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.539245:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.539246:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.539247:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50dcf lrc: 3/0,1 mode: PW/PW res: [0x2b652:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.539250:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50dcf lrc: 4/0,1 mode: PW/PW res: [0x2b652:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.539256:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.539263:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000013e02de/0x3234de053c4de11 lrc: 0/0,0 mode: --/PR res: [0x2b64f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2975 expref: 1274 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.539267:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.539268:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.539269:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50dc1 lrc: 3/0,1 mode: PW/PW res: [0x2b64f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539272:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50dc1 lrc: 4/0,1 mode: PW/PW res: [0x2b64f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.539273:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a37852a8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1273:41279:x1731746396303488:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 60us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.539276:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12078 00010000:00010000:0.0:1651529344.539278:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.539281:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12079 00000100:00100000:1.0:1651529344.539283:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1272:41279:x1731746396303616:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.539286:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.539286:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1272:41279:x1731746396303360:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 78us (144us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.539287:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000887ca6bc/0x3234de053c4ed0d lrc: 4/0,0 mode: PR/PR res: [0x2b653:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6606 expref: 1272 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.539289:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12077 00010000:00010000:1.0:1651529344.539294:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000887ca6bc/0x3234de053c4ed0d lrc: 3/0,0 mode: PR/PR res: [0x2b653:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6606 expref: 1271 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.539298:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12080 00010000:00010000:1.0:1651529344.539299:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000887ca6bc/0x3234de053c4ed0d lrc: 0/0,0 mode: --/PR res: [0x2b653:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6606 expref: 1271 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.539300:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1271:41278:x1731746396303552:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.539302:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.539302:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.539303:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50ddd lrc: 3/0,1 mode: PW/PW res: [0x2b653:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539303:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.539304:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003f20516a/0x3234de053c4a076 lrc: 4/0,0 mode: PR/PR res: [0x2b651:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb792 expref: 1270 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.539306:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50ddd lrc: 4/0,1 mode: PW/PW res: [0x2b653:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539308:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003f20516a/0x3234de053c4a076 lrc: 3/0,0 mode: PR/PR res: [0x2b651:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb792 expref: 1270 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.539312:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.539317:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1270:41279:x1731746396303616:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 34us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.539320:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12079 00000100:00100000:1.0:1651529344.539324:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12081 00000100:00100000:1.0:1651529344.539326:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1269:41278:x1731746396303424:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.539327:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f20516a/0x3234de053c4a076 lrc: 0/0,0 mode: --/PR res: [0x2b651:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb792 expref: 1269 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.539328:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.539329:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003ad9543a/0x3234de053c4d6a1 lrc: 4/0,0 mode: PR/PR res: [0x2b650:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c41 expref: 1269 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.539333:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003ad9543a/0x3234de053c4d6a1 lrc: 3/0,0 mode: PR/PR res: [0x2b650:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c41 expref: 1269 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.539334:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.539334:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.539335:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50dd6 lrc: 3/0,1 mode: PW/PW res: [0x2b651:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.539338:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ad9543a/0x3234de053c4d6a1 lrc: 0/0,0 mode: --/PR res: [0x2b650:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c41 expref: 1268 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.539338:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50dd6 lrc: 4/0,1 mode: PW/PW res: [0x2b651:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.539341:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.539341:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.539342:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50dc8 lrc: 3/0,1 mode: PW/PW res: [0x2b650:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.539345:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50dc8 lrc: 4/0,1 mode: PW/PW res: [0x2b650:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539345:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.539350:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.539352:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1267:41278:x1731746396303552:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 51us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.539354:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12080 00000100:00100000:1.0:1651529344.539355:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1267:41278:x1731746396303424:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 29us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.539357:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12081 00010000:00010000:0.0:1651529344.539363:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50dd6 lrc: 3/0,1 mode: PW/PW res: [0x2b651:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.539364:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50dcf lrc: 3/0,1 mode: PW/PW res: [0x2b652:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539367:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50dd6 lrc: 3/0,1 mode: PW/PW res: [0x2b651:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.539368:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50dcf lrc: 3/0,1 mode: PW/PW res: [0x2b652:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539370:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50dd6 lrc: 3/0,1 mode: PW/PW res: [0x2b651:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.539371:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50dcf lrc: 3/0,1 mode: PW/PW res: [0x2b652:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.539373:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50dcf lrc: 2/0,0 mode: PW/PW res: [0x2b652:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539373:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50dd6 lrc: 2/0,0 mode: PW/PW res: [0x2b651:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.539418:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+798:39029:x1731745946422400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1054us (1251us total) trans 12885079350 rc 0/0 00000100:00100000:0.0:1651529344.539421:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211298 00000100:00100000:1.0:1651529344.539422:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+798:39029:x1731745946422464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1117us (1270us total) trans 12885079351 rc 0/0 00000100:00100000:1.0:1651529344.539425:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211297 00010000:00010000:0.0:1651529344.539429:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50dd6 lrc: 2/0,0 mode: PW/PW res: [0x2b651:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.539432:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50dc8 lrc: 3/0,1 mode: PW/PW res: [0x2b650:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539432:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cff76789 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.539433:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50dd6 lrc: 2/0,0 mode: PW/PW res: [0x2b651:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.539436:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50dc8 lrc: 3/0,1 mode: PW/PW res: [0x2b650:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539436:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50dd6 lrc: 3/0,0 mode: PW/PW res: [0x2b651:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.539439:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50dc8 lrc: 3/0,1 mode: PW/PW res: [0x2b650:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539440:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50dd6 lrc: 1/0,0 mode: --/PW res: [0x2b651:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.539442:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50dc8 lrc: 2/0,0 mode: PW/PW res: [0x2b650:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539443:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50dd6 lrc: 0/0,0 mode: --/PW res: [0x2b651:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539447:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50dcf lrc: 2/0,0 mode: PW/PW res: [0x2b652:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539450:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054065c33 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.539451:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50dcf lrc: 2/0,0 mode: PW/PW res: [0x2b652:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539454:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50dcf lrc: 3/0,0 mode: PW/PW res: [0x2b652:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539457:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50dcf lrc: 1/0,0 mode: --/PW res: [0x2b652:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539462:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50dcf lrc: 0/0,0 mode: --/PW res: [0x2b652:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539465:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50dc8 lrc: 2/0,0 mode: PW/PW res: [0x2b650:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539468:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000048b51e47 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.539469:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50dc8 lrc: 2/0,0 mode: PW/PW res: [0x2b650:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539471:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50dc8 lrc: 3/0,0 mode: PW/PW res: [0x2b650:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.539473:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+797:39030:x1731745946422336:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1218us (1329us total) trans 12885079352 rc 0/0 00010000:00010000:0.0:1651529344.539474:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50dc8 lrc: 1/0,0 mode: --/PW res: [0x2b650:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.539476:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211296 00010000:00010000:0.0:1651529344.539477:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50dc8 lrc: 0/0,0 mode: --/PW res: [0x2b650:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.539482:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50ddd lrc: 3/0,1 mode: PW/PW res: [0x2b653:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539483:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50dc1 lrc: 3/0,1 mode: PW/PW res: [0x2b64f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.539485:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50ddd lrc: 3/0,1 mode: PW/PW res: [0x2b653:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539485:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50dc1 lrc: 3/0,1 mode: PW/PW res: [0x2b64f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.539488:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50ddd lrc: 3/0,1 mode: PW/PW res: [0x2b653:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539488:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50dc1 lrc: 3/0,1 mode: PW/PW res: [0x2b64f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539491:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50dc1 lrc: 2/0,0 mode: PW/PW res: [0x2b64f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.539493:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50ddd lrc: 2/0,0 mode: PW/PW res: [0x2b653:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.539526:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+798:39030:x1731745946422272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1275us (1433us total) trans 12885079353 rc 0/0 00000100:00100000:1.0:1651529344.539527:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+798:39030:x1731745946422528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1153us (1324us total) trans 12885079354 rc 0/0 00000100:00100000:0.0:1651529344.539529:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211295 00000100:00100000:1.0:1651529344.539531:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211299 00010000:00010000:0.0:1651529344.539536:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50dc1 lrc: 2/0,0 mode: PW/PW res: [0x2b64f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.539537:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50ddd lrc: 2/0,0 mode: PW/PW res: [0x2b653:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539539:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dc65d2aa already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.539540:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50dc1 lrc: 2/0,0 mode: PW/PW res: [0x2b64f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.539541:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e0e037e6 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.539542:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50ddd lrc: 2/0,0 mode: PW/PW res: [0x2b653:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539543:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50dc1 lrc: 3/0,0 mode: PW/PW res: [0x2b64f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.539545:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50ddd lrc: 3/0,0 mode: PW/PW res: [0x2b653:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539547:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50dc1 lrc: 1/0,0 mode: --/PW res: [0x2b64f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.539549:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50ddd lrc: 1/0,0 mode: --/PW res: [0x2b653:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539550:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50dc1 lrc: 0/0,0 mode: --/PW res: [0x2b64f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.539552:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50ddd lrc: 0/0,0 mode: --/PW res: [0x2b653:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.539574:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.539596:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.539615:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396303744 00010000:00010000:1.0:1651529344.539635:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006d136d05/0x3234de053c4c7ba lrc: 4/0,0 mode: PR/PR res: [0x2b655:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd146 expref: 1266 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.539651:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396303680 00010000:00010000:1.0:1651529344.539654:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000028ae306d/0x3234de053c4bb81 lrc: 4/0,0 mode: PR/PR res: [0x2b654:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc568 expref: 1267 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.539663:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12082 00000100:00100000:1.0:1651529344.539664:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1267:41279:x1731746396303744:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.539667:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.539669:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006d136d05/0x3234de053c4c7ba lrc: 4/0,0 mode: PR/PR res: [0x2b655:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd146 expref: 1267 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.539672:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006d136d05/0x3234de053c4c7ba lrc: 3/0,0 mode: PR/PR res: [0x2b655:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd146 expref: 1267 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.539678:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d136d05/0x3234de053c4c7ba lrc: 0/0,0 mode: --/PR res: [0x2b655:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd146 expref: 1267 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.539680:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12083 00010000:00010000:1.0:1651529344.539681:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.539682:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.539682:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50deb lrc: 3/0,1 mode: PW/PW res: [0x2b655:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.539683:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1266:41278:x1731746396303680:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.539686:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50deb lrc: 4/0,1 mode: PW/PW res: [0x2b655:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539687:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.539689:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000028ae306d/0x3234de053c4bb81 lrc: 4/0,0 mode: PR/PR res: [0x2b654:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc568 expref: 1266 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.539694:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.539699:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000028ae306d/0x3234de053c4bb81 lrc: 3/0,0 mode: PR/PR res: [0x2b654:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc568 expref: 1266 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.539704:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1266:41279:x1731746396303744:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 39us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.539707:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12082 00010000:00010000:0.0:1651529344.539710:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028ae306d/0x3234de053c4bb81 lrc: 0/0,0 mode: --/PR res: [0x2b654:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc568 expref: 1265 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.539714:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.539714:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.539715:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50de4 lrc: 3/0,1 mode: PW/PW res: [0x2b654:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539718:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50de4 lrc: 4/0,1 mode: PW/PW res: [0x2b654:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539752:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.539760:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1264:41278:x1731746396303680:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 77us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.539763:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12083 00000100:00100000:1.0:1651529344.539771:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.539771:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50deb lrc: 3/0,1 mode: PW/PW res: [0x2b655:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539797:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50deb lrc: 3/0,1 mode: PW/PW res: [0x2b655:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539802:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50deb lrc: 3/0,1 mode: PW/PW res: [0x2b655:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539805:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50deb lrc: 2/0,0 mode: PW/PW res: [0x2b655:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.539818:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.539827:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.539837:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.539843:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.539851:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.539859:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50de4 lrc: 3/0,1 mode: PW/PW res: [0x2b654:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.539862:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50de4 lrc: 3/0,1 mode: PW/PW res: [0x2b654:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.539866:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50de4 lrc: 3/0,1 mode: PW/PW res: [0x2b654:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.539869:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50de4 lrc: 2/0,0 mode: PW/PW res: [0x2b654:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.539876:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+797:39030:x1731745946422656:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1375us (1440us total) trans 12885079355 rc 0/0 00000100:00100000:0.0:1651529344.539884:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211301 00000100:00100000:0.0:1651529344.539889:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946423296 00000100:00100000:0.0:1651529344.539895:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946423424 00000100:00100000:0.0:1651529344.539901:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946423360 00000100:00100000:0.0:1651529344.539906:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946423552 00000100:00100000:0.0:1651529344.539910:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946423488 00000100:00100000:0.0:1651529344.539913:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211303 00000100:00100000:0.0:1651529344.539914:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc8a938e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+802:39030:x1731745946423296:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.539920:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177751 count 1 00010000:00010000:0.0:1651529344.539924:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c50df9 lrc: 3/0,1 mode: --/PW res: [0x2b657:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.539926:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+802:39029:x1731745946422592:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1463us (1498us total) trans 12885079356 rc 0/0 00000100:00100000:1.0:1651529344.539929:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211300 00010000:00010000:0.0:1651529344.539929:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ad732268/0x3234de053c49fea lrc: 2/0,0 mode: PR/PR res: [0x2b657:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb585 expref: 1263 pid: 80281 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.539932:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.539933:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.539933:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c50df9 lrc: 4/0,1 mode: --/PW res: [0x2b657:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.539934:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211304 00000100:00100000:1.0:1651529344.539936:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+801:39030:x1731745946423424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.539941:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177753 count 1 00010000:00010000:0.0:1651529344.539942:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ad732268/0x3234de053c49fea lrc: 3/0,0 mode: PR/PR res: [0x2b657:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb585 expref: 1263 pid: 80281 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.539945:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50e00 lrc: 3/0,1 mode: --/PW res: [0x2b659:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539946:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ad732268/0x3234de053c49fea lrc: 4/0,0 mode: PR/PR res: [0x2b657:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb585 expref: 1263 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.539950:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009a9d566c/0x3234de053c4de03 lrc: 2/0,0 mode: PR/PR res: [0x2b659:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d28fe expref: 1263 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.539950:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ac8dec6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996990144:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.539953:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.539953:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.539954:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50e00 lrc: 4/0,1 mode: --/PW res: [0x2b659:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.539959:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e68b7e1f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.539961:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009a9d566c/0x3234de053c4de03 lrc: 3/0,0 mode: PR/PR res: [0x2b659:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d28fe expref: 1263 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.539964:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009a9d566c/0x3234de053c4de03 lrc: 4/0,0 mode: PR/PR res: [0x2b659:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d28fe expref: 1263 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.539965:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50deb lrc: 2/0,0 mode: PW/PW res: [0x2b655:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.539968:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000064719963 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996990208:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.539968:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009880d77c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.539969:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50deb lrc: 2/0,0 mode: PW/PW res: [0x2b655:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539972:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50deb lrc: 3/0,0 mode: PW/PW res: [0x2b655:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.539976:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 0000000057299e7f going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.539976:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50deb lrc: 1/0,0 mode: --/PW res: [0x2b655:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539979:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50deb lrc: 0/0,0 mode: --/PW res: [0x2b655:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.539983:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211305 00010000:00010000:0.0:1651529344.539983:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50de4 lrc: 2/0,0 mode: PW/PW res: [0x2b654:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.539985:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+801:39029:x1731745946423360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.539988:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000002904524 already unused, calling callback (0000000049fddea7) 00002000:00080000:1.0:1651529344.539989:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177752 count 1 00010000:00010000:0.0:1651529344.539989:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50de4 lrc: 2/0,0 mode: PW/PW res: [0x2b654:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539991:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50de4 lrc: 3/0,0 mode: PW/PW res: [0x2b654:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.539992:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50e07 lrc: 3/0,1 mode: --/PW res: [0x2b658:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.539994:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50de4 lrc: 1/0,0 mode: --/PW res: [0x2b654:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.539996:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c4d558 lrc: 2/0,0 mode: PR/PR res: [0x2b658:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d071d expref: 1263 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.539997:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50de4 lrc: 0/0,0 mode: --/PW res: [0x2b654:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.539999:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.540000:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.540000:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50e07 lrc: 4/0,1 mode: --/PW res: [0x2b658:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.540004:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211306 00010000:00010000:1.0:1651529344.540006:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c4d558 lrc: 3/0,0 mode: PR/PR res: [0x2b658:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d071d expref: 1263 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.540006:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+801:39030:x1731745946423552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.540009:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c4d558 lrc: 4/0,0 mode: PR/PR res: [0x2b658:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d071d expref: 1263 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:0.0:1651529344.540010:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177755 count 1 00000100:00100000:1.0:1651529344.540013:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000066de8c9f pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996990272:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.540013:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50e0e lrc: 3/0,1 mode: --/PW res: [0x2b65b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540017:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c4cc36 lrc: 2/0,0 mode: PR/PR res: [0x2b65b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce287 expref: 1263 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.540019:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 0000000071742acc going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.540020:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.540020:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.540021:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50e0e lrc: 4/0,1 mode: --/PW res: [0x2b65b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.540025:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211307 00000100:00100000:1.0:1651529344.540026:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+801:39029:x1731745946423488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.540029:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c4cc36 lrc: 3/0,0 mode: PR/PR res: [0x2b65b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce287 expref: 1263 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.540030:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177754 count 1 00010000:00010000:1.0:1651529344.540033:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50e15 lrc: 3/0,1 mode: --/PW res: [0x2b65a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540033:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c4cc36 lrc: 4/0,0 mode: PR/PR res: [0x2b65b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce287 expref: 1263 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.540037:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005432bd68/0x3234de053c4eb5b lrc: 2/0,0 mode: PR/PR res: [0x2b65a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ef1 expref: 1263 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.540037:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000974b675b pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996990336:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.540040:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.540040:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.540041:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50e15 lrc: 4/0,1 mode: --/PW res: [0x2b65a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.540044:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000008dd99533 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.540047:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005432bd68/0x3234de053c4eb5b lrc: 3/0,0 mode: PR/PR res: [0x2b65a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ef1 expref: 1263 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.540053:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005432bd68/0x3234de053c4eb5b lrc: 4/0,0 mode: PR/PR res: [0x2b65a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ef1 expref: 1263 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.540054:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fc130417 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996990080:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.540057:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d28c414b pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996990400:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.540058:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50df2 lrc: 3/0,1 mode: --/PW res: [0x2b656:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.540063:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000babe2d90 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.540089:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396303808 00010000:00010000:0.0:1651529344.540094:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007f832a18/0x3234de053c4e294 lrc: 4/0,0 mode: PR/PR res: [0x2b656:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3bb9 expref: 1264 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.540105:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12084 00000100:00100000:0.0:1651529344.540107:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1264:41278:x1731746396303808:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.540110:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.540111:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007f832a18/0x3234de053c4e294 lrc: 4/0,0 mode: PR/PR res: [0x2b656:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3bb9 expref: 1264 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.540115:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007f832a18/0x3234de053c4e294 lrc: 3/0,0 mode: PR/PR res: [0x2b656:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3bb9 expref: 1264 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.540123:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f832a18/0x3234de053c4e294 lrc: 0/0,0 mode: --/PR res: [0x2b656:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3bb9 expref: 1264 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.540126:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.540127:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.540128:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50df2 lrc: 3/0,1 mode: PW/PW res: [0x2b656:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540131:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50df2 lrc: 4/0,1 mode: PW/PW res: [0x2b656:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540137:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.540145:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1263:41278:x1731746396303808:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.540148:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12084 00010000:00010000:0.0:1651529344.540170:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50df2 lrc: 3/0,1 mode: PW/PW res: [0x2b656:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540174:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50df2 lrc: 3/0,1 mode: PW/PW res: [0x2b656:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540177:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50df2 lrc: 3/0,1 mode: PW/PW res: [0x2b656:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540180:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50df2 lrc: 2/0,0 mode: PW/PW res: [0x2b656:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540195:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50df2 lrc: 3/0,0 mode: PW/PW res: [0x2b656:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540199:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d9ada8a3 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.540204:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50df2 lrc: 3/0,0 mode: PW/PW res: [0x2b656:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540208:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50df2 lrc: 3/0,0 mode: PW/PW res: [0x2b656:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540213:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50df2 lrc: 1/0,0 mode: --/PW res: [0x2b656:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540216:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50df2 lrc: 0/0,0 mode: --/PW res: [0x2b656:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.540267:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+802:39029:x1731745946422912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1548us (1570us total) trans 12885079357 rc 0/0 00000100:00100000:0.0:1651529344.540270:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211302 00000100:00100000:1.0:1651529344.540276:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.540287:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ac8dec6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996990144:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.540291:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c50df9 lrc: 3/0,1 mode: --/PW res: [0x2b657:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.540298:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946423616 00000100:00100000:0.0:1651529344.540308:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211308 00000100:00100000:0.0:1651529344.540310:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+802:39029:x1731745946423616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.540313:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.540315:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177756 count 1 00010000:00010000:0.0:1651529344.540319:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50e1c lrc: 3/0,1 mode: --/PW res: [0x2b65c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.540321:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946423680 00010000:00010000:0.0:1651529344.540323:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c4def1 lrc: 2/0,0 mode: PR/PR res: [0x2b65c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d03 expref: 1262 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.540326:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.540326:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.540327:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50e1c lrc: 4/0,1 mode: --/PW res: [0x2b65c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.540328:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211309 00000100:00100000:1.0:1651529344.540330:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+803:39030:x1731745946423680:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.540334:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c4def1 lrc: 3/0,0 mode: PR/PR res: [0x2b65c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d03 expref: 1262 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.540335:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177757 count 1 00010000:00010000:0.0:1651529344.540337:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c4def1 lrc: 4/0,0 mode: PR/PR res: [0x2b65c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d03 expref: 1262 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.540339:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50e23 lrc: 3/0,1 mode: --/PW res: [0x2b65d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.540342:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ac8dec6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996990464:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.540344:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007398cbbc/0x3234de053c4f3ab lrc: 2/0,0 mode: PR/PR res: [0x2b65d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d813b expref: 1262 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.540347:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.540348:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.540348:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50e23 lrc: 4/0,1 mode: --/PW res: [0x2b65d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.540355:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e1aa6a77 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.540361:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007398cbbc/0x3234de053c4f3ab lrc: 3/0,0 mode: PR/PR res: [0x2b65d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d813b expref: 1262 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.540365:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007398cbbc/0x3234de053c4f3ab lrc: 4/0,0 mode: PR/PR res: [0x2b65d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d813b expref: 1262 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.540369:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996990528:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.540396:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000499d0377 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.540425:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000064719963 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996990208:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.540429:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50e00 lrc: 3/0,1 mode: --/PW res: [0x2b659:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.540465:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.540473:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000066de8c9f pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996990272:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.540482:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50e07 lrc: 3/0,1 mode: --/PW res: [0x2b658:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.540482:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.540489:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946424128 00000100:00100000:0.0:1651529344.540489:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.540498:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.540505:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211310 00000100:00100000:0.0:1651529344.540506:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.540507:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+804:39030:x1731745946424128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.540515:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:1.0:1651529344.540516:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177758 count 1 00010000:00010000:1.0:1651529344.540520:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50e2a lrc: 3/0,1 mode: --/PW res: [0x2b65e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.540523:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000974b675b pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996990336:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.540525:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000013fe88c2/0x3234de053c4d0e3 lrc: 2/0,0 mode: PR/PR res: [0x2b65e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf518 expref: 1262 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.540527:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50e0e lrc: 3/0,1 mode: --/PW res: [0x2b65b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540528:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.540528:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.540529:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50e2a lrc: 4/0,1 mode: --/PW res: [0x2b65e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.540534:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396304512 00010000:00010000:1.0:1651529344.540535:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000013fe88c2/0x3234de053c4d0e3 lrc: 3/0,0 mode: PR/PR res: [0x2b65e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf518 expref: 1262 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.540538:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000013fe88c2/0x3234de053c4d0e3 lrc: 4/0,0 mode: PR/PR res: [0x2b65e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf518 expref: 1263 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.540542:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000066de8c9f pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996990592:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.540557:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009a9d566c/0x3234de053c4de03 lrc: 4/0,0 mode: PR/PR res: [0x2b659:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d28fe expref: 1263 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.540562:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 0000000057299e7f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.540569:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d28c414b pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996990400:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.540573:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50e15 lrc: 3/0,1 mode: --/PW res: [0x2b65a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.540579:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396304448 00000100:00100000:0.0:1651529344.540581:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396304704 00010000:00010000:1.0:1651529344.540584:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ad732268/0x3234de053c49fea lrc: 4/0,0 mode: PR/PR res: [0x2b657:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb585 expref: 1265 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.540584:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005432bd68/0x3234de053c4eb5b lrc: 4/0,0 mode: PR/PR res: [0x2b65a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ef1 expref: 1265 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.540589:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396304640 00000100:00100000:0.0:1651529344.540589:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396304576 00010000:00010000:0.0:1651529344.540591:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c4d558 lrc: 4/0,0 mode: PR/PR res: [0x2b658:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d071d expref: 1267 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.540592:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c4cc36 lrc: 4/0,0 mode: PR/PR res: [0x2b65b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce287 expref: 1267 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.540596:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12085 00000100:00100000:0.0:1651529344.540598:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001e35645b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1267:41279:x1731746396304512:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.540599:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12086 00000100:00100000:1.0:1651529344.540601:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1267:41278:x1731746396304448:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.540601:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.540602:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009a9d566c/0x3234de053c4de03 lrc: 4/0,0 mode: PR/PR res: [0x2b659:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d28fe expref: 1267 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.540603:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.540604:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ad732268/0x3234de053c49fea lrc: 4/0,0 mode: PR/PR res: [0x2b657:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb585 expref: 1267 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.540606:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009a9d566c/0x3234de053c4de03 lrc: 3/0,0 mode: PR/PR res: [0x2b659:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d28fe expref: 1267 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.540608:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ad732268/0x3234de053c49fea lrc: 3/0,0 mode: PR/PR res: [0x2b657:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb585 expref: 1267 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.540612:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a9d566c/0x3234de053c4de03 lrc: 0/0,0 mode: --/PR res: [0x2b659:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d28fe expref: 1267 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.540614:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad732268/0x3234de053c49fea lrc: 0/0,0 mode: --/PR res: [0x2b657:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb585 expref: 1267 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.540617:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.540618:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.540618:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c50df9 lrc: 3/0,1 mode: PW/PW res: [0x2b657:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540621:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c50df9 lrc: 4/0,1 mode: PW/PW res: [0x2b657:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540626:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.540627:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.540628:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50e00 lrc: 3/0,1 mode: PW/PW res: [0x2b659:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540631:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.540637:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50e00 lrc: 4/0,1 mode: PW/PW res: [0x2b659:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.540638:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1265:41278:x1731746396304448:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 36us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.540640:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12086 00000100:00100000:1.0:1651529344.540645:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12087 00000100:00100000:1.0:1651529344.540647:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1264:41279:x1731746396304704:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.540649:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.540650:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005432bd68/0x3234de053c4eb5b lrc: 4/0,0 mode: PR/PR res: [0x2b65a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ef1 expref: 1264 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.540655:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.540661:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005432bd68/0x3234de053c4eb5b lrc: 3/0,0 mode: PR/PR res: [0x2b65a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ef1 expref: 1264 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.540663:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001e35645b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1264:41279:x1731746396304512:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 64us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.540665:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12085 00010000:00010000:1.0:1651529344.540666:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005432bd68/0x3234de053c4eb5b lrc: 0/0,0 mode: --/PR res: [0x2b65a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ef1 expref: 1264 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.540670:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.540670:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.540671:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50e15 lrc: 3/0,1 mode: PW/PW res: [0x2b65a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540674:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50e15 lrc: 4/0,1 mode: PW/PW res: [0x2b65a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.540675:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12088 00000100:00100000:0.0:1651529344.540677:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1262:41278:x1731746396304576:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.540680:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.540680:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.540681:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c4d558 lrc: 4/0,0 mode: PR/PR res: [0x2b658:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d071d expref: 1262 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.540685:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1262:41279:x1731746396304704:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.540688:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12087 00010000:00010000:0.0:1651529344.540688:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c4d558 lrc: 3/0,0 mode: PR/PR res: [0x2b658:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d071d expref: 1262 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.540693:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12089 00010000:00010000:0.0:1651529344.540693:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c4d558 lrc: 0/0,0 mode: --/PR res: [0x2b658:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d071d expref: 1261 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.540694:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1261:41278:x1731746396304640:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.540696:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.540697:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.540697:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.540698:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c4cc36 lrc: 4/0,0 mode: PR/PR res: [0x2b65b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce287 expref: 1260 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.540698:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50e07 lrc: 3/0,1 mode: PW/PW res: [0x2b658:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540701:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50e07 lrc: 4/0,1 mode: PW/PW res: [0x2b658:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540702:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c4cc36 lrc: 3/0,0 mode: PR/PR res: [0x2b65b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce287 expref: 1260 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.540706:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c4cc36 lrc: 0/0,0 mode: --/PR res: [0x2b65b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce287 expref: 1260 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.540709:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.540715:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1260:41278:x1731746396304576:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (209us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.540716:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.540716:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.540717:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50e0e lrc: 3/0,1 mode: PW/PW res: [0x2b65b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.540717:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12088 00010000:00010000:1.0:1651529344.540720:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50e0e lrc: 4/0,1 mode: PW/PW res: [0x2b65b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540724:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c50df9 lrc: 3/0,1 mode: PW/PW res: [0x2b657:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540729:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.540733:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c50df9 lrc: 3/0,1 mode: PW/PW res: [0x2b657:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.540742:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1258:41278:x1731746396304640:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 39us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.540745:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12089 00010000:00010000:0.0:1651529344.540745:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c50df9 lrc: 3/0,1 mode: PW/PW res: [0x2b657:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540750:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c50df9 lrc: 2/0,0 mode: PW/PW res: [0x2b657:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540754:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50e00 lrc: 3/0,1 mode: PW/PW res: [0x2b659:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540757:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50e00 lrc: 3/0,1 mode: PW/PW res: [0x2b659:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540761:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50e00 lrc: 3/0,1 mode: PW/PW res: [0x2b659:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540763:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50e00 lrc: 2/0,0 mode: PW/PW res: [0x2b659:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.540796:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc8a938e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+806:39030:x1731745946423296:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 881us (978us total) trans 12885079358 rc 0/0 00000100:00100000:0.0:1651529344.540799:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211303 00000100:00100000:1.0:1651529344.540807:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+805:39030:x1731745946423424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 870us (979us total) trans 12885079359 rc 0/0 00000100:00100000:1.0:1651529344.540810:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211304 00010000:00010000:1.0:1651529344.540818:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50e15 lrc: 3/0,1 mode: PW/PW res: [0x2b65a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540819:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50e0e lrc: 3/0,1 mode: PW/PW res: [0x2b65b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540821:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50e15 lrc: 3/0,1 mode: PW/PW res: [0x2b65a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540823:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50e0e lrc: 3/0,1 mode: PW/PW res: [0x2b65b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540824:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50e15 lrc: 3/0,1 mode: PW/PW res: [0x2b65a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540826:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50e0e lrc: 3/0,1 mode: PW/PW res: [0x2b65b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540827:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50e15 lrc: 2/0,0 mode: PW/PW res: [0x2b65a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540829:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50e0e lrc: 2/0,0 mode: PW/PW res: [0x2b65b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.540862:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+806:39030:x1731745946423552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 856us (1019us total) trans 12885079360 rc 0/0 00000100:00100000:1.0:1651529344.540863:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+806:39029:x1731745946423488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 836us (1012us total) trans 12885079361 rc 0/0 00000100:00100000:0.0:1651529344.540865:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211306 00000100:00100000:1.0:1651529344.540868:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211307 00010000:00010000:0.0:1651529344.540872:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c50df9 lrc: 2/0,0 mode: PW/PW res: [0x2b657:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540875:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50e00 lrc: 2/0,0 mode: PW/PW res: [0x2b659:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540875:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b3edbdf4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.540876:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c50df9 lrc: 2/0,0 mode: PW/PW res: [0x2b657:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540878:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000085580035 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.540879:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50e00 lrc: 2/0,0 mode: PW/PW res: [0x2b659:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540879:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c50df9 lrc: 3/0,0 mode: PW/PW res: [0x2b657:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540882:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50e00 lrc: 3/0,0 mode: PW/PW res: [0x2b659:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540884:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c50df9 lrc: 1/0,0 mode: --/PW res: [0x2b657:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540887:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50e00 lrc: 1/0,0 mode: --/PW res: [0x2b659:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540887:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c50df9 lrc: 0/0,0 mode: --/PW res: [0x2b657:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540890:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50e00 lrc: 0/0,0 mode: --/PW res: [0x2b659:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540891:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50e15 lrc: 2/0,0 mode: PW/PW res: [0x2b65a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540894:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50e0e lrc: 2/0,0 mode: PW/PW res: [0x2b65b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540894:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000069f7ba22 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.540895:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50e15 lrc: 2/0,0 mode: PW/PW res: [0x2b65a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540897:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006b93727a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.540897:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50e15 lrc: 3/0,0 mode: PW/PW res: [0x2b65a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540898:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50e0e lrc: 2/0,0 mode: PW/PW res: [0x2b65b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540900:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50e0e lrc: 3/0,0 mode: PW/PW res: [0x2b65b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540901:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50e15 lrc: 1/0,0 mode: --/PW res: [0x2b65a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.540903:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50e15 lrc: 0/0,0 mode: --/PW res: [0x2b65a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540906:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50e0e lrc: 1/0,0 mode: --/PW res: [0x2b65b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540909:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50e0e lrc: 0/0,0 mode: --/PW res: [0x2b65b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540914:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50e07 lrc: 3/0,1 mode: PW/PW res: [0x2b658:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540917:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50e07 lrc: 3/0,1 mode: PW/PW res: [0x2b658:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540920:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50e07 lrc: 3/0,1 mode: PW/PW res: [0x2b658:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.540922:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50e07 lrc: 2/0,0 mode: PW/PW res: [0x2b658:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.540963:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.540975:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.540988:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+805:39029:x1731745946423360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1002us (1151us total) trans 12885079362 rc 0/0 00000100:00100000:1.0:1651529344.540991:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211305 00000100:00100000:1.0:1651529344.540998:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396304768 00010000:00010000:1.0:1651529344.541008:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c4def1 lrc: 5/0,0 mode: PR/PR res: [0x2b65c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d03 expref: 1258 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.541016:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396304832 00010000:00010000:0.0:1651529344.541024:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50e07 lrc: 2/0,0 mode: PW/PW res: [0x2b658:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.541028:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000048c07243 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.541029:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50e07 lrc: 2/0,0 mode: PW/PW res: [0x2b658:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.541032:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50e07 lrc: 3/0,0 mode: PW/PW res: [0x2b658:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.541037:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50e07 lrc: 1/0,0 mode: --/PW res: [0x2b658:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.541040:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50e07 lrc: 0/0,0 mode: --/PW res: [0x2b658:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541047:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007398cbbc/0x3234de053c4f3ab lrc: 5/0,0 mode: PR/PR res: [0x2b65d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d813b expref: 1259 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.541049:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ac8dec6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996990464:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.541053:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50e1c lrc: 3/0,1 mode: --/PW res: [0x2b65c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.541057:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12090 00000100:00100000:1.0:1651529344.541059:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1259:41279:x1731746396304768:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.541062:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.541063:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c4def1 lrc: 4/0,0 mode: PR/PR res: [0x2b65c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d03 expref: 1259 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.541067:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c4def1 lrc: 3/0,0 mode: PR/PR res: [0x2b65c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d03 expref: 1259 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.541067:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12091 00010000:00010000:1.0:1651529344.541073:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c4def1 lrc: 0/0,0 mode: --/PR res: [0x2b65c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d03 expref: 1259 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.541077:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.541078:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.541078:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50e1c lrc: 3/0,1 mode: PW/PW res: [0x2b65c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541081:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50e1c lrc: 4/0,1 mode: PW/PW res: [0x2b65c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.541083:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1258:41278:x1731746396304832:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.541087:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.541090:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.541094:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007398cbbc/0x3234de053c4f3ab lrc: 5/0,0 mode: PR/PR res: [0x2b65d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d813b expref: 1258 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.541100:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1258:41279:x1731746396304768:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 41us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.541103:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12090 00010000:00010000:0.0:1651529344.541103:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007398cbbc/0x3234de053c4f3ab lrc: 4/0,0 mode: PR/PR res: [0x2b65d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d813b expref: 1258 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.541109:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.541109:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.541110:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50e23 lrc: 3/0,1 mode: PW/PW res: [0x2b65d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.541113:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50e23 lrc: 4/0,1 mode: PW/PW res: [0x2b65d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541114:0:80277:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007398cbbc/0x3234de053c4f3ab lrc: 0/0,0 mode: --/PR res: [0x2b65d:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d813b expref: 1257 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.541118:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.541119:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996990528:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.541122:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50e23 lrc: 3/0,1 mode: PW/PW res: [0x2b65d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.541125:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1256:41278:x1731746396304832:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (150us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.541126:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50e23 lrc: 3/0,1 mode: PW/PW res: [0x2b65d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541128:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50e23 lrc: 3/0,1 mode: PW/PW res: [0x2b65d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.541128:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12091 00010000:00010000:1.0:1651529344.541131:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50e23 lrc: 3/0,1 mode: PW/PW res: [0x2b65d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541134:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50e23 lrc: 2/0,0 mode: PW/PW res: [0x2b65d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.541136:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50e1c lrc: 3/0,1 mode: PW/PW res: [0x2b65c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.541139:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50e1c lrc: 3/0,1 mode: PW/PW res: [0x2b65c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.541148:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50e1c lrc: 3/0,1 mode: PW/PW res: [0x2b65c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.541151:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50e1c lrc: 2/0,0 mode: PW/PW res: [0x2b65c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.541182:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+806:39030:x1731745946423680:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 851us (868us total) trans 12885079363 rc 0/0 00000100:00100000:1.0:1651529344.541185:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211309 00010000:00010000:1.0:1651529344.541191:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50e23 lrc: 2/0,0 mode: PW/PW res: [0x2b65d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541195:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eb2009d7 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.541196:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50e23 lrc: 2/0,0 mode: PW/PW res: [0x2b65d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541201:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50e23 lrc: 3/0,0 mode: PW/PW res: [0x2b65d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541205:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50e23 lrc: 1/0,0 mode: --/PW res: [0x2b65d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541208:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50e23 lrc: 0/0,0 mode: --/PW res: [0x2b65d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541212:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50e1c lrc: 2/0,0 mode: PW/PW res: [0x2b65c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541215:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000035eaa2c8 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.541216:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50e1c lrc: 2/0,0 mode: PW/PW res: [0x2b65c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541219:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50e1c lrc: 3/0,0 mode: PW/PW res: [0x2b65c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541237:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50e1c lrc: 1/0,0 mode: --/PW res: [0x2b65c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541240:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50e1c lrc: 0/0,0 mode: --/PW res: [0x2b65c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.541259:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+805:39029:x1731745946423616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 947us (982us total) trans 12885079364 rc 0/0 00000100:00100000:0.0:1651529344.541262:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211308 00000100:00100000:1.0:1651529344.541274:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.541297:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.541308:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946424320 00000100:00100000:0.0:1651529344.541321:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946424448 00000100:00100000:0.0:1651529344.541328:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211311 00000100:00100000:0.0:1651529344.541330:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+806:39030:x1731745946424320:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.541335:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177759 count 1 00010000:00010000:0.0:1651529344.541340:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c50e31 lrc: 3/0,1 mode: --/PW res: [0x2b65f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.541344:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211312 00010000:00010000:0.0:1651529344.541344:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000649f045f/0x3234de053c4e0e9 lrc: 2/0,0 mode: PR/PR res: [0x2b65f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3450 expref: 1255 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.541346:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+806:39030:x1731745946424448:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.541348:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.541348:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.541349:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c50e31 lrc: 4/0,1 mode: --/PW res: [0x2b65f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.541352:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177761 count 1 00010000:00010000:0.0:1651529344.541356:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000649f045f/0x3234de053c4e0e9 lrc: 3/0,0 mode: PR/PR res: [0x2b65f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3450 expref: 1255 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.541357:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50e38 lrc: 3/0,1 mode: --/PW res: [0x2b661:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.541359:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000649f045f/0x3234de053c4e0e9 lrc: 4/0,0 mode: PR/PR res: [0x2b65f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3450 expref: 1255 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.541361:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000022aef4fa/0x3234de053c4e978 lrc: 2/0,0 mode: PR/PR res: [0x2b661:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d572d expref: 1255 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.541363:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000055e03b4f pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996990656:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.541364:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.541365:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.541366:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50e38 lrc: 4/0,1 mode: --/PW res: [0x2b661:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541373:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000022aef4fa/0x3234de053c4e978 lrc: 3/0,0 mode: PR/PR res: [0x2b661:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d572d expref: 1255 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.541376:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000afe7ff7b going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.541383:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000022aef4fa/0x3234de053c4e978 lrc: 4/0,0 mode: PR/PR res: [0x2b661:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d572d expref: 1255 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.541387:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000064719963 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996990720:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.541388:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.541396:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fe434b1c going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.541402:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946424384 00000100:00100000:1.0:1651529344.541420:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211313 00000100:00100000:1.0:1651529344.541422:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+807:39029:x1731745946424384:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.541422:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529344.541434:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177760 count 1 00010000:00010000:1.0:1651529344.541438:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50e3f lrc: 3/0,1 mode: --/PW res: [0x2b660:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541445:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c31ccc29/0x3234de053c4cae6 lrc: 2/0,0 mode: PR/PR res: [0x2b660:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd40 expref: 1255 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.541448:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.541454:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.541455:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50e3f lrc: 4/0,1 mode: --/PW res: [0x2b660:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541462:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c31ccc29/0x3234de053c4cae6 lrc: 3/0,0 mode: PR/PR res: [0x2b660:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd40 expref: 1255 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.541465:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.541466:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c31ccc29/0x3234de053c4cae6 lrc: 4/0,0 mode: PR/PR res: [0x2b660:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd40 expref: 1255 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.541475:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000be0ace91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996990784:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.541482:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.541487:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d09f5ee1 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.541493:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946424576 00000100:00100000:1.0:1651529344.541503:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946424512 00000100:00100000:1.0:1651529344.541508:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946424640 00000100:00100000:1.0:1651529344.541512:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211314 00000100:00100000:1.0:1651529344.541514:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+810:39030:x1731745946424576:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.541518:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177763 count 1 00010000:00010000:1.0:1651529344.541522:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50e46 lrc: 3/0,1 mode: --/PW res: [0x2b663:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541531:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000038b46627/0x3234de053c4de42 lrc: 2/0,0 mode: PR/PR res: [0x2b663:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d29ec expref: 1255 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.541540:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.541543:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.541544:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.541545:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50e46 lrc: 4/0,1 mode: --/PW res: [0x2b663:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.541547:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946424704 00010000:00010000:1.0:1651529344.541551:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000038b46627/0x3234de053c4de42 lrc: 3/0,0 mode: PR/PR res: [0x2b663:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d29ec expref: 1255 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.541553:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211315 00010000:00010000:1.0:1651529344.541554:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000038b46627/0x3234de053c4de42 lrc: 4/0,0 mode: PR/PR res: [0x2b663:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d29ec expref: 1255 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.541555:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+811:39029:x1731745946424512:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.541558:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000822949b3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996990848:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.541560:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177762 count 1 00010000:00010000:0.0:1651529344.541564:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c50e4d lrc: 3/0,1 mode: --/PW res: [0x2b662:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.541571:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aeda71fe going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.541576:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003b855b6a/0x3234de053c4daec lrc: 2/0,0 mode: PR/PR res: [0x2b662:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1bc2 expref: 1255 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.541578:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211316 00010000:00010000:0.0:1651529344.541579:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.541580:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+811:39029:x1731745946424640:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.541580:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.541581:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c50e4d lrc: 4/0,1 mode: --/PW res: [0x2b662:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.541584:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177764 count 1 00010000:00010000:1.0:1651529344.541588:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50e54 lrc: 3/0,1 mode: --/PW res: [0x2b664:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.541588:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003b855b6a/0x3234de053c4daec lrc: 3/0,0 mode: PR/PR res: [0x2b662:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1bc2 expref: 1255 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.541591:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003b855b6a/0x3234de053c4daec lrc: 4/0,0 mode: PR/PR res: [0x2b662:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1bc2 expref: 1255 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.541592:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c4ecd5 lrc: 2/0,0 mode: PR/PR res: [0x2b664:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6534 expref: 1255 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.541595:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.541595:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.541595:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005384a251 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996990912:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.541596:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50e54 lrc: 4/0,1 mode: --/PW res: [0x2b664:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.541604:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 0000000076b354b3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.541605:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c4ecd5 lrc: 3/0,0 mode: PR/PR res: [0x2b664:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6534 expref: 1255 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.541608:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c4ecd5 lrc: 4/0,0 mode: PR/PR res: [0x2b664:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6534 expref: 1255 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.541610:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211317 00000100:00100000:1.0:1651529344.541612:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000012863683 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996990976:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.541612:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+811:39030:x1731745946424704:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.541618:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177765 count 1 00000100:00100000:1.0:1651529344.541619:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8a0b704 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.541621:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fe2031b/0x3234de053c50e5b lrc: 3/0,1 mode: --/PW res: [0x2b665:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.541626:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000066de8c9f pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996990592:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.541626:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000283dc86f/0x3234de053c4ddf5 lrc: 2/0,0 mode: PR/PR res: [0x2b665:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d28d4 expref: 1255 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.541629:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.541629:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.541630:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50e2a lrc: 3/0,1 mode: --/PW res: [0x2b65e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.541630:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008fe2031b/0x3234de053c50e5b lrc: 4/0,1 mode: --/PW res: [0x2b665:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.541636:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000283dc86f/0x3234de053c4ddf5 lrc: 3/0,0 mode: PR/PR res: [0x2b665:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d28d4 expref: 1255 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.541652:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000283dc86f/0x3234de053c4ddf5 lrc: 4/0,0 mode: PR/PR res: [0x2b665:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d28d4 expref: 1255 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.541656:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ffb5d0a pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996991040:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.541664:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 000000008dd99533 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.541718:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.541730:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396305408 00010000:00010000:1.0:1651529344.541748:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000013fe88c2/0x3234de053c4d0e3 lrc: 4/0,0 mode: PR/PR res: [0x2b65e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf518 expref: 1256 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.541749:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.541756:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396305472 00000100:00100000:0.0:1651529344.541756:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.541764:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000649f045f/0x3234de053c4e0e9 lrc: 5/0,0 mode: PR/PR res: [0x2b65f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3450 expref: 1257 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.541768:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000055e03b4f pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996990656:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.541769:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396305536 00010000:00010000:1.0:1651529344.541772:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000022aef4fa/0x3234de053c4e978 lrc: 5/0,0 mode: PR/PR res: [0x2b661:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d572d expref: 1258 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.541772:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c50e31 lrc: 3/0,1 mode: --/PW res: [0x2b65f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.541776:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12092 00000100:00100000:1.0:1651529344.541778:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000461918a5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1258:41278:x1731746396305408:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.541781:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.541782:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12093 00010000:00010000:1.0:1651529344.541783:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000013fe88c2/0x3234de053c4d0e3 lrc: 4/0,0 mode: PR/PR res: [0x2b65e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf518 expref: 1258 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.541784:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1258:41278:x1731746396305472:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.541787:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000013fe88c2/0x3234de053c4d0e3 lrc: 3/0,0 mode: PR/PR res: [0x2b65e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf518 expref: 1258 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.541788:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.541789:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000649f045f/0x3234de053c4e0e9 lrc: 4/0,0 mode: PR/PR res: [0x2b65f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3450 expref: 1258 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.541792:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013fe88c2/0x3234de053c4d0e3 lrc: 0/0,0 mode: --/PR res: [0x2b65e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf518 expref: 1258 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.541793:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000649f045f/0x3234de053c4e0e9 lrc: 3/0,0 mode: PR/PR res: [0x2b65f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3450 expref: 1258 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.541796:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.541796:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.541797:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50e2a lrc: 3/0,1 mode: PW/PW res: [0x2b65e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.541799:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000649f045f/0x3234de053c4e0e9 lrc: 0/0,0 mode: --/PR res: [0x2b65f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3450 expref: 1257 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.541800:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50e2a lrc: 4/0,1 mode: PW/PW res: [0x2b65e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.541803:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.541803:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.541804:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c50e31 lrc: 3/0,1 mode: PW/PW res: [0x2b65f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541806:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.541807:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c50e31 lrc: 4/0,1 mode: PW/PW res: [0x2b65f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.541813:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.541814:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000461918a5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1256:41278:x1731746396305408:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.541817:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12092 00000100:00100000:0.0:1651529344.541820:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1255:41278:x1731746396305472:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 35us (71us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.541823:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12093 00000100:00100000:1.0:1651529344.541826:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12094 00000100:00100000:1.0:1651529344.541827:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1254:41278:x1731746396305536:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.541830:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.541830:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c50e31 lrc: 3/0,1 mode: PW/PW res: [0x2b65f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541831:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000022aef4fa/0x3234de053c4e978 lrc: 5/0,0 mode: PR/PR res: [0x2b661:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d572d expref: 1254 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.541833:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c50e31 lrc: 3/0,1 mode: PW/PW res: [0x2b65f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541835:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000022aef4fa/0x3234de053c4e978 lrc: 4/0,0 mode: PR/PR res: [0x2b661:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d572d expref: 1254 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.541836:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c50e31 lrc: 3/0,1 mode: PW/PW res: [0x2b65f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.541839:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c50e31 lrc: 2/0,0 mode: PW/PW res: [0x2b65f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541840:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.541840:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.541841:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50e38 lrc: 3/0,1 mode: PW/PW res: [0x2b661:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541844:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50e38 lrc: 4/0,1 mode: PW/PW res: [0x2b661:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541848:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.541852:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1254:41278:x1731746396305536:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 25us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.541855:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12094 00010000:00010000:1.0:1651529344.541862:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50e2a lrc: 3/0,1 mode: PW/PW res: [0x2b65e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541865:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50e2a lrc: 3/0,1 mode: PW/PW res: [0x2b65e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541869:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50e2a lrc: 3/0,1 mode: PW/PW res: [0x2b65e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541871:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50e2a lrc: 2/0,0 mode: PW/PW res: [0x2b65e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.541880:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+812:39030:x1731745946424320:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 549us (605us total) trans 12885079365 rc 0/0 00000100:00100000:0.0:1651529344.541883:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211311 00010000:00010000:0.0:1651529344.541906:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c50e31 lrc: 2/0,0 mode: PW/PW res: [0x2b65f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.541910:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000010b0a5e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.541911:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c50e31 lrc: 2/0,0 mode: PW/PW res: [0x2b65f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.541914:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+812:39030:x1731745946424128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1406us (1449us total) trans 12885079366 rc 0/0 00000100:00100000:1.0:1651529344.541917:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211310 00010000:00010000:1.0:1651529344.541924:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50e2a lrc: 2/0,0 mode: PW/PW res: [0x2b65e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541927:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003b0cd546 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.541928:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50e2a lrc: 2/0,0 mode: PW/PW res: [0x2b65e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541931:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50e2a lrc: 3/0,0 mode: PW/PW res: [0x2b65e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.541934:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c50e31 lrc: 3/0,0 mode: PW/PW res: [0x2b65f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541945:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50e2a lrc: 1/0,0 mode: --/PW res: [0x2b65e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541948:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50e2a lrc: 0/0,0 mode: --/PW res: [0x2b65e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.541948:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c50e31 lrc: 1/0,0 mode: --/PW res: [0x2b65f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.541951:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c50e31 lrc: 0/0,0 mode: --/PW res: [0x2b65f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541959:0:72397:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022aef4fa/0x3234de053c4e978 lrc: 0/0,0 mode: --/PR res: [0x2b661:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d572d expref: 1253 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.541962:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000064719963 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996990720:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.541966:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50e38 lrc: 3/0,1 mode: PW/PW res: [0x2b661:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541977:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50e38 lrc: 3/0,1 mode: PW/PW res: [0x2b661:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541980:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50e38 lrc: 3/0,1 mode: PW/PW res: [0x2b661:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541983:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50e38 lrc: 3/0,1 mode: PW/PW res: [0x2b661:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.541990:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50e38 lrc: 2/0,0 mode: PW/PW res: [0x2b661:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.542027:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.542037:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+812:39030:x1731745946424448:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 683us (734us total) trans 12885079367 rc 0/0 00000100:00100000:1.0:1651529344.542040:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211312 00000100:00100000:0.0:1651529344.542042:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.542054:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396305600 00010000:00010000:1.0:1651529344.542059:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c31ccc29/0x3234de053c4cae6 lrc: 5/0,0 mode: PR/PR res: [0x2b660:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd40 expref: 1253 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.542064:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.542080:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396305728 00010000:00010000:1.0:1651529344.542088:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003b855b6a/0x3234de053c4daec lrc: 5/0,0 mode: PR/PR res: [0x2b662:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1bc2 expref: 1254 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.542093:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396305664 00010000:00010000:1.0:1651529344.542096:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000038b46627/0x3234de053c4de42 lrc: 5/0,0 mode: PR/PR res: [0x2b663:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d29ec expref: 1255 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.542110:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12095 00000100:00100000:1.0:1651529344.542112:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1255:41279:x1731746396305600:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.542114:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.542115:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.542116:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c31ccc29/0x3234de053c4cae6 lrc: 5/0,0 mode: PR/PR res: [0x2b660:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd40 expref: 1255 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.542120:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c31ccc29/0x3234de053c4cae6 lrc: 4/0,0 mode: PR/PR res: [0x2b660:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd40 expref: 1255 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.542125:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.542126:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.542127:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50e3f lrc: 3/0,1 mode: PW/PW res: [0x2b660:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.542130:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50e3f lrc: 4/0,1 mode: PW/PW res: [0x2b660:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.542135:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.542139:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005384a251 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996990912:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.542141:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1255:41279:x1731746396305600:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 29us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.542143:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12095 00010000:00010000:0.0:1651529344.542144:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c50e4d lrc: 3/0,1 mode: --/PW res: [0x2b662:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.542147:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396305792 00010000:00010000:1.0:1651529344.542150:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c4ecd5 lrc: 5/0,0 mode: PR/PR res: [0x2b664:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6534 expref: 1255 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.542150:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50e38 lrc: 2/0,0 mode: PW/PW res: [0x2b661:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542153:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000827909ec already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.542154:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50e38 lrc: 2/0,0 mode: PW/PW res: [0x2b661:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.542155:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12096 00000100:00100000:1.0:1651529344.542156:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1255:41278:x1731746396305728:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.542157:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50e38 lrc: 3/0,0 mode: PW/PW res: [0x2b661:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.542158:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.542160:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003b855b6a/0x3234de053c4daec lrc: 4/0,0 mode: PR/PR res: [0x2b662:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1bc2 expref: 1255 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.542162:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50e38 lrc: 1/0,0 mode: --/PW res: [0x2b661:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.542163:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003b855b6a/0x3234de053c4daec lrc: 3/0,0 mode: PR/PR res: [0x2b662:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1bc2 expref: 1255 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.542164:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50e38 lrc: 0/0,0 mode: --/PW res: [0x2b661:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.542167:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b855b6a/0x3234de053c4daec lrc: 0/0,0 mode: --/PR res: [0x2b662:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1bc2 expref: 1255 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.542170:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.542171:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.542172:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c50e4d lrc: 3/0,1 mode: PW/PW res: [0x2b662:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.542172:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ffb5d0a pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996991040:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.542175:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c50e4d lrc: 4/0,1 mode: PW/PW res: [0x2b662:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542176:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008fe2031b/0x3234de053c50e5b lrc: 3/0,1 mode: --/PW res: [0x2b665:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.542184:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.542189:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1254:41278:x1731746396305728:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 32us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.542189:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12097 00000100:00100000:0.0:1651529344.542191:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1254:41278:x1731746396305664:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.542192:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12096 00010000:00010000:0.0:1651529344.542194:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.542196:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12098 00010000:00010000:0.0:1651529344.542196:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000038b46627/0x3234de053c4de42 lrc: 5/0,0 mode: PR/PR res: [0x2b663:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d29ec expref: 1253 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.542198:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1253:41279:x1731746396305792:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.542200:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.542200:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000038b46627/0x3234de053c4de42 lrc: 4/0,0 mode: PR/PR res: [0x2b663:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d29ec expref: 1253 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.542201:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c4ecd5 lrc: 5/0,0 mode: PR/PR res: [0x2b664:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6534 expref: 1253 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.542205:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c4ecd5 lrc: 4/0,0 mode: PR/PR res: [0x2b664:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6534 expref: 1253 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.542205:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.542206:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.542207:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50e46 lrc: 3/0,1 mode: PW/PW res: [0x2b663:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.542210:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.542210:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.542210:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50e46 lrc: 4/0,1 mode: PW/PW res: [0x2b663:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.542211:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50e54 lrc: 3/0,1 mode: PW/PW res: [0x2b664:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.542214:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50e54 lrc: 4/0,1 mode: PW/PW res: [0x2b664:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542214:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.542218:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.542221:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1253:41278:x1731746396305664:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 30us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.542239:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1253:41279:x1731746396305792:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.542242:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12097 00000100:00100000:1.0:1651529344.542244:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12098 00010000:00010000:0.0:1651529344.542249:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c50e4d lrc: 3/0,1 mode: PW/PW res: [0x2b662:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.542254:0:80280:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c4ecd5 lrc: 0/0,0 mode: --/PR res: [0x2b664:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6534 expref: 1251 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.542255:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c50e4d lrc: 3/0,1 mode: PW/PW res: [0x2b662:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.542258:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000012863683 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996990976:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.542258:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c50e4d lrc: 3/0,1 mode: PW/PW res: [0x2b662:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.542261:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50e54 lrc: 3/0,1 mode: PW/PW res: [0x2b664:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542261:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c50e4d lrc: 2/0,0 mode: PW/PW res: [0x2b662:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.542265:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50e54 lrc: 3/0,1 mode: PW/PW res: [0x2b664:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.542273:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50e54 lrc: 3/0,1 mode: PW/PW res: [0x2b664:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.542277:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50e54 lrc: 3/0,1 mode: PW/PW res: [0x2b664:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.542280:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50e54 lrc: 2/0,0 mode: PW/PW res: [0x2b664:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.542312:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+813:39029:x1731745946424512:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 756us (847us total) trans 12885079368 rc 0/0 00000100:00100000:0.0:1651529344.542315:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211315 00000100:00100000:1.0:1651529344.542322:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+812:39029:x1731745946424640:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 741us (839us total) trans 12885079369 rc 0/0 00010000:00010000:0.0:1651529344.542322:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c50e4d lrc: 2/0,0 mode: PW/PW res: [0x2b662:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.542324:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211316 00010000:00010000:0.0:1651529344.542326:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000022a9b983 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.542327:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c50e4d lrc: 2/0,0 mode: PW/PW res: [0x2b662:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542330:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c50e4d lrc: 3/0,0 mode: PW/PW res: [0x2b662:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.542336:0:80278:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038b46627/0x3234de053c4de42 lrc: 0/0,0 mode: --/PR res: [0x2b663:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d29ec expref: 1250 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.542340:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000822949b3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996990848:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.542343:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50e46 lrc: 3/0,1 mode: PW/PW res: [0x2b663:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.542346:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50e46 lrc: 3/0,1 mode: PW/PW res: [0x2b663:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.542349:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50e46 lrc: 3/0,1 mode: PW/PW res: [0x2b663:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542350:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c50e4d lrc: 1/0,0 mode: --/PW res: [0x2b662:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.542352:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50e46 lrc: 3/0,1 mode: PW/PW res: [0x2b663:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542353:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c50e4d lrc: 0/0,0 mode: --/PW res: [0x2b662:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.542357:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50e46 lrc: 2/0,0 mode: PW/PW res: [0x2b663:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542357:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50e54 lrc: 2/0,0 mode: PW/PW res: [0x2b664:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542360:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000017857b04 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.542361:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50e54 lrc: 2/0,0 mode: PW/PW res: [0x2b664:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542364:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50e54 lrc: 3/0,0 mode: PW/PW res: [0x2b664:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542373:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50e54 lrc: 1/0,0 mode: --/PW res: [0x2b664:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542376:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017857b04/0x3234de053c50e54 lrc: 0/0,0 mode: --/PW res: [0x2b664:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542380:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50e46 lrc: 2/0,0 mode: PW/PW res: [0x2b663:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542382:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009ad9989c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.542383:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50e46 lrc: 2/0,0 mode: PW/PW res: [0x2b663:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542385:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50e46 lrc: 3/0,0 mode: PW/PW res: [0x2b663:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542388:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50e46 lrc: 1/0,0 mode: --/PW res: [0x2b663:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542391:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ad9989c/0x3234de053c50e46 lrc: 0/0,0 mode: --/PW res: [0x2b663:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.542396:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+812:39030:x1731745946424576:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 881us (974us total) trans 12885079370 rc 0/0 00000100:00100000:1.0:1651529344.542399:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211314 00010000:00010000:1.0:1651529344.542409:0:80279:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c31ccc29/0x3234de053c4cae6 lrc: 0/0,0 mode: --/PR res: [0x2b660:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd40 expref: 1249 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.542413:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000be0ace91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996990784:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.542417:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50e3f lrc: 3/0,1 mode: PW/PW res: [0x2b660:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.542419:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.542438:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50e3f lrc: 3/0,1 mode: PW/PW res: [0x2b660:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.542441:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50e3f lrc: 3/0,1 mode: PW/PW res: [0x2b660:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.542443:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.542454:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50e3f lrc: 3/0,1 mode: PW/PW res: [0x2b660:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.542457:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50e3f lrc: 2/0,0 mode: PW/PW res: [0x2b660:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.542459:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.542477:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.542504:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+812:39029:x1731745946424384:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1076us (1110us total) trans 12885079371 rc 0/0 00000100:00100000:1.0:1651529344.542508:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211313 00010000:00010000:0.0:1651529344.542515:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50e3f lrc: 2/0,0 mode: PW/PW res: [0x2b660:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.542519:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946424960 00010000:00010000:0.0:1651529344.542519:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008f8dd346 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.542520:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50e3f lrc: 2/0,0 mode: PW/PW res: [0x2b660:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542523:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50e3f lrc: 3/0,0 mode: PW/PW res: [0x2b660:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.542525:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946425088 00010000:00010000:0.0:1651529344.542527:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50e3f lrc: 1/0,0 mode: --/PW res: [0x2b660:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.542528:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946425024 00010000:00010000:0.0:1651529344.542530:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f8dd346/0x3234de053c50e3f lrc: 0/0,0 mode: --/PW res: [0x2b660:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.542536:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211318 00000100:00100000:1.0:1651529344.542538:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+814:39030:x1731745946424960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.542543:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177766 count 1 00010000:00010000:1.0:1651529344.542547:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50e62 lrc: 3/0,1 mode: --/PW res: [0x2b666:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.542552:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000063f303c5/0x3234de053c4d3f3 lrc: 2/0,0 mode: PR/PR res: [0x2b666:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d01a5 expref: 1248 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.542555:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.542555:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.542556:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50e62 lrc: 4/0,1 mode: --/PW res: [0x2b666:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.542557:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211319 00000100:00100000:0.0:1651529344.542559:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+814:39030:x1731745946425088:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.542562:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000063f303c5/0x3234de053c4d3f3 lrc: 3/0,0 mode: PR/PR res: [0x2b666:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d01a5 expref: 1248 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.542565:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177768 count 1 00010000:00010000:1.0:1651529344.542566:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000063f303c5/0x3234de053c4d3f3 lrc: 4/0,0 mode: PR/PR res: [0x2b666:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d01a5 expref: 1248 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.542569:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c50e69 lrc: 3/0,1 mode: --/PW res: [0x2b668:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.542570:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000012863683 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996991104:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.542574:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000063c40bba/0x3234de053c4e764 lrc: 2/0,0 mode: PR/PR res: [0x2b668:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e66 expref: 1248 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.542577:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.542577:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.542578:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c50e69 lrc: 4/0,1 mode: --/PW res: [0x2b668:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.542583:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aeda71fe going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.542589:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396305856 00010000:00010000:0.0:1651529344.542592:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000063c40bba/0x3234de053c4e764 lrc: 3/0,0 mode: PR/PR res: [0x2b668:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e66 expref: 1249 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.542594:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000283dc86f/0x3234de053c4ddf5 lrc: 4/0,0 mode: PR/PR res: [0x2b665:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d28d4 expref: 1249 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.542596:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000063c40bba/0x3234de053c4e764 lrc: 4/0,0 mode: PR/PR res: [0x2b668:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e66 expref: 1249 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.542600:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029abc941 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996991168:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.542601:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12099 00000100:00100000:1.0:1651529344.542603:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f53a84c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1249:41278:x1731746396305856:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.542605:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.542606:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000283dc86f/0x3234de053c4ddf5 lrc: 4/0,0 mode: PR/PR res: [0x2b665:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d28d4 expref: 1249 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.542609:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000008dd99533 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.542610:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000283dc86f/0x3234de053c4ddf5 lrc: 3/0,0 mode: PR/PR res: [0x2b665:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d28d4 expref: 1249 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.542615:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211320 00010000:00010000:1.0:1651529344.542616:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000283dc86f/0x3234de053c4ddf5 lrc: 0/0,0 mode: --/PR res: [0x2b665:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d28d4 expref: 1249 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.542617:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+814:39029:x1731745946425024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.542619:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.542620:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.542620:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008fe2031b/0x3234de053c50e5b lrc: 3/0,1 mode: PW/PW res: [0x2b665:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.542622:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177767 count 1 00010000:00010000:1.0:1651529344.542623:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008fe2031b/0x3234de053c50e5b lrc: 4/0,1 mode: PW/PW res: [0x2b665:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542625:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c50e70 lrc: 3/0,1 mode: --/PW res: [0x2b667:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.542632:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.542636:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006247fb8a/0x3234de053c4f151 lrc: 2/0,0 mode: PR/PR res: [0x2b667:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7812 expref: 1248 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.542638:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f53a84c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1248:41278:x1731746396305856:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 35us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.542641:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12099 00010000:00010000:0.0:1651529344.542642:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.542643:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.542644:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c50e70 lrc: 4/0,1 mode: --/PW res: [0x2b667:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542665:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006247fb8a/0x3234de053c4f151 lrc: 3/0,0 mode: PR/PR res: [0x2b667:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7812 expref: 1247 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.542669:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.542677:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006247fb8a/0x3234de053c4f151 lrc: 4/0,0 mode: PR/PR res: [0x2b667:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7812 expref: 1247 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.542682:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000055e03b4f pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996991232:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.542690:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 0000000076b354b3 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.542695:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008fe2031b/0x3234de053c50e5b lrc: 3/0,1 mode: PW/PW res: [0x2b665:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542698:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008fe2031b/0x3234de053c50e5b lrc: 3/0,1 mode: PW/PW res: [0x2b665:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.542701:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.542701:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fe2031b/0x3234de053c50e5b lrc: 3/0,1 mode: PW/PW res: [0x2b665:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542704:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008fe2031b/0x3234de053c50e5b lrc: 2/0,0 mode: PW/PW res: [0x2b665:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.542714:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.542752:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.542753:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+815:39030:x1731745946424704:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1140us (1213us total) trans 12885079372 rc 0/0 00000100:00100000:0.0:1651529344.542756:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211317 00000100:00100000:0.0:1651529344.542762:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946425472 00000100:00100000:0.0:1651529344.542768:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946425536 00000100:00100000:0.0:1651529344.542771:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946425600 00000100:00100000:0.0:1651529344.542774:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946425664 00000100:00100000:0.0:1651529344.542778:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211321 00000100:00100000:0.0:1651529344.542780:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+818:39030:x1731745946425472:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.542781:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211322 00000100:00100000:1.0:1651529344.542783:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+818:39029:x1731745946425536:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.542784:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177769 count 1 00010000:00010000:0.0:1651529344.542788:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50e77 lrc: 3/0,1 mode: --/PW res: [0x2b669:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.542789:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177770 count 1 00010000:00010000:1.0:1651529344.542793:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50e7e lrc: 3/0,1 mode: --/PW res: [0x2b66a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542793:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb65f45c/0x3234de053c4ca0d lrc: 2/0,0 mode: PR/PR res: [0x2b669:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda1b expref: 1247 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.542796:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.542797:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.542797:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50e77 lrc: 4/0,1 mode: --/PW res: [0x2b669:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.542798:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000098834c70/0x3234de053c4d7e3 lrc: 2/0,0 mode: PR/PR res: [0x2b66a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d10e0 expref: 1247 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.542801:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.542802:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.542803:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50e7e lrc: 4/0,1 mode: --/PW res: [0x2b66a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542804:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fb65f45c/0x3234de053c4ca0d lrc: 3/0,0 mode: PR/PR res: [0x2b669:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda1b expref: 1247 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.542807:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fb65f45c/0x3234de053c4ca0d lrc: 4/0,0 mode: PR/PR res: [0x2b669:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda1b expref: 1247 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.542809:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000098834c70/0x3234de053c4d7e3 lrc: 3/0,0 mode: PR/PR res: [0x2b66a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d10e0 expref: 1247 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.542811:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fc130417 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996991296:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.542813:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000098834c70/0x3234de053c4d7e3 lrc: 4/0,0 mode: PR/PR res: [0x2b66a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d10e0 expref: 1247 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.542817:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004bb67ba4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996991360:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.542824:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000abca413e going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.542830:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008fe2031b/0x3234de053c50e5b lrc: 2/0,0 mode: PW/PW res: [0x2b665:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.542833:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 0000000020dd7827 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.542833:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008fe2031b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.542834:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008fe2031b/0x3234de053c50e5b lrc: 2/0,0 mode: PW/PW res: [0x2b665:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.542839:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211323 00000100:00100000:1.0:1651529344.542840:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+818:39030:x1731745946425600:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.542846:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177771 count 1 00010000:00010000:1.0:1651529344.542849:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50e85 lrc: 3/0,1 mode: --/PW res: [0x2b66b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.542853:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd9fc154/0x3234de053c4cb48 lrc: 2/0,0 mode: PR/PR res: [0x2b66b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde9e expref: 1247 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.542853:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008fe2031b/0x3234de053c50e5b lrc: 3/0,0 mode: PW/PW res: [0x2b665:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.542856:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.542857:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.542857:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50e85 lrc: 4/0,1 mode: --/PW res: [0x2b66b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542857:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008fe2031b/0x3234de053c50e5b lrc: 1/0,0 mode: --/PW res: [0x2b665:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542861:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008fe2031b/0x3234de053c50e5b lrc: 0/0,0 mode: --/PW res: [0x2b665:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.542863:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dd9fc154/0x3234de053c4cb48 lrc: 3/0,0 mode: PR/PR res: [0x2b66b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde9e expref: 1247 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.542867:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dd9fc154/0x3234de053c4cb48 lrc: 4/0,0 mode: PR/PR res: [0x2b66b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde9e expref: 1247 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.542870:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000264aecf8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996991424:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.542870:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211324 00000100:00100000:0.0:1651529344.542871:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+818:39029:x1731745946425664:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.542876:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8a0b704 going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.542876:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177772 count 1 00010000:00010000:0.0:1651529344.542879:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50e8c lrc: 3/0,1 mode: --/PW res: [0x2b66c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542884:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000052a301de/0x3234de053c4e8de lrc: 2/0,0 mode: PR/PR res: [0x2b66c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5432 expref: 1247 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.542887:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.542887:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.542888:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50e8c lrc: 4/0,1 mode: --/PW res: [0x2b66c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.542910:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000052a301de/0x3234de053c4e8de lrc: 3/0,0 mode: PR/PR res: [0x2b66c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5432 expref: 1247 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.542914:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000052a301de/0x3234de053c4e8de lrc: 4/0,0 mode: PR/PR res: [0x2b66c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5432 expref: 1247 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.542918:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a573b31 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996991488:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.542920:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.542930:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946425728 00000100:00100000:1.0:1651529344.542937:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211325 00000100:00100000:1.0:1651529344.542938:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+819:39029:x1731745946425728:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.542943:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a3b00cf3 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.542949:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177773 count 1 00010000:00010000:1.0:1651529344.542953:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50e93 lrc: 3/0,1 mode: --/PW res: [0x2b66d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.542966:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000059e8aacc/0x3234de053c4da75 lrc: 2/0,0 mode: PR/PR res: [0x2b66d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a4f expref: 1247 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.542969:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.542970:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.542971:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50e93 lrc: 4/0,1 mode: --/PW res: [0x2b66d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.542977:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000059e8aacc/0x3234de053c4da75 lrc: 3/0,0 mode: PR/PR res: [0x2b66d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a4f expref: 1247 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.542987:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000059e8aacc/0x3234de053c4da75 lrc: 4/0,0 mode: PR/PR res: [0x2b66d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a4f expref: 1247 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.542991:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd68fdd5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996991552:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.543005:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 0000000071742acc going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.543013:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000012863683 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996991104:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.543017:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50e62 lrc: 3/0,1 mode: --/PW res: [0x2b666:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.543128:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.543135:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396306240 00010000:00010000:1.0:1651529344.543139:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000063f303c5/0x3234de053c4d3f3 lrc: 4/0,0 mode: PR/PR res: [0x2b666:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d01a5 expref: 1248 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.543147:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12100 00000100:00100000:1.0:1651529344.543149:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1248:41278:x1731746396306240:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.543151:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.543153:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000063f303c5/0x3234de053c4d3f3 lrc: 4/0,0 mode: PR/PR res: [0x2b666:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d01a5 expref: 1248 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.543156:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000063f303c5/0x3234de053c4d3f3 lrc: 3/0,0 mode: PR/PR res: [0x2b666:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d01a5 expref: 1248 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.543162:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063f303c5/0x3234de053c4d3f3 lrc: 0/0,0 mode: --/PR res: [0x2b666:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d01a5 expref: 1248 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.543165:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.543166:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.543167:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50e62 lrc: 3/0,1 mode: PW/PW res: [0x2b666:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.543170:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50e62 lrc: 4/0,1 mode: PW/PW res: [0x2b666:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.543175:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.543187:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1247:41278:x1731746396306240:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 37us (60us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.543190:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12100 00010000:00010000:1.0:1651529344.543196:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50e62 lrc: 3/0,1 mode: PW/PW res: [0x2b666:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.543200:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50e62 lrc: 3/0,1 mode: PW/PW res: [0x2b666:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.543212:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50e62 lrc: 3/0,1 mode: PW/PW res: [0x2b666:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.543216:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50e62 lrc: 2/0,0 mode: PW/PW res: [0x2b666:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543247:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50e62 lrc: 2/0,0 mode: PW/PW res: [0x2b666:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543252:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008cc70fcd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.543253:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50e62 lrc: 2/0,0 mode: PW/PW res: [0x2b666:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543256:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50e62 lrc: 3/0,0 mode: PW/PW res: [0x2b666:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543261:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50e62 lrc: 1/0,0 mode: --/PW res: [0x2b666:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543264:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008cc70fcd/0x3234de053c50e62 lrc: 0/0,0 mode: --/PW res: [0x2b666:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.543270:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+820:39030:x1731745946424960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 731us (827us total) trans 12885079373 rc 0/0 00000100:00100000:1.0:1651529344.543273:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211318 00000100:00100000:0.0:1651529344.543346:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029abc941 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996991168:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.543351:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004bb67ba4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996991360:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.543352:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c50e69 lrc: 3/0,1 mode: --/PW res: [0x2b668:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.543355:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50e7e lrc: 3/0,1 mode: --/PW res: [0x2b66a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.543359:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fc130417 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996991296:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.543362:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000264aecf8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996991424:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.543362:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50e77 lrc: 3/0,1 mode: --/PW res: [0x2b669:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.543364:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50e85 lrc: 3/0,1 mode: --/PW res: [0x2b66b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.543368:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a573b31 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996991488:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.543370:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50e8c lrc: 3/0,1 mode: --/PW res: [0x2b66c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.543376:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000055e03b4f pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996991232:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.543378:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c50e70 lrc: 3/0,1 mode: --/PW res: [0x2b667:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.543524:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.543538:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd68fdd5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996991552:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.543541:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50e93 lrc: 3/0,1 mode: --/PW res: [0x2b66d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.543547:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946425856 00000100:00100000:1.0:1651529344.543554:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211326 00000100:00100000:1.0:1651529344.543556:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+820:39029:x1731745946425856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.543556:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.543567:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.543575:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:1.0:1651529344.543582:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177774 count 1 00000100:00100000:0.0:1651529344.543583:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.543587:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50e9a lrc: 3/0,1 mode: --/PW res: [0x2b66e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.543590:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.543591:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a1d18c85/0x3234de053c4dc82 lrc: 2/0,0 mode: PR/PR res: [0x2b66e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2244 expref: 1246 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.543595:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.543595:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.543595:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.543596:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50e9a lrc: 4/0,1 mode: --/PW res: [0x2b66e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.543601:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.543602:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a1d18c85/0x3234de053c4dc82 lrc: 3/0,0 mode: PR/PR res: [0x2b66e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2244 expref: 1246 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.543606:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a1d18c85/0x3234de053c4dc82 lrc: 4/0,0 mode: PR/PR res: [0x2b66e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2244 expref: 1246 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.543607:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396306496 00000100:00100000:1.0:1651529344.543610:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd68fdd5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996991616:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.543613:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000063c40bba/0x3234de053c4e764 lrc: 4/0,0 mode: PR/PR res: [0x2b668:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e66 expref: 1247 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.543620:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8a0b704 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.543621:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396306560 00010000:00010000:0.0:1651529344.543623:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006247fb8a/0x3234de053c4f151 lrc: 4/0,0 mode: PR/PR res: [0x2b667:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7812 expref: 1248 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.543626:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396306624 00000100:00100000:0.0:1651529344.543628:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396306688 00010000:00010000:0.0:1651529344.543630:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000098834c70/0x3234de053c4d7e3 lrc: 4/0,0 mode: PR/PR res: [0x2b66a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d10e0 expref: 1250 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.543631:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fb65f45c/0x3234de053c4ca0d lrc: 4/0,0 mode: PR/PR res: [0x2b669:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda1b expref: 1250 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.543634:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396306752 00000100:00100000:1.0:1651529344.543636:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396306816 00010000:00010000:0.0:1651529344.543636:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dd9fc154/0x3234de053c4cb48 lrc: 4/0,0 mode: PR/PR res: [0x2b66b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde9e expref: 1251 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.543638:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000059e8aacc/0x3234de053c4da75 lrc: 4/0,0 mode: PR/PR res: [0x2b66d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a4f expref: 1252 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.543641:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396306880 00010000:00010000:0.0:1651529344.543643:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000052a301de/0x3234de053c4e8de lrc: 4/0,0 mode: PR/PR res: [0x2b66c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5432 expref: 1253 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.543646:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12101 00000100:00100000:1.0:1651529344.543648:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1253:41279:x1731746396306496:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.543649:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12102 00010000:00010000:1.0:1651529344.543650:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.543651:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1253:41279:x1731746396306560:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.543652:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000063c40bba/0x3234de053c4e764 lrc: 4/0,0 mode: PR/PR res: [0x2b668:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e66 expref: 1253 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.543654:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.543655:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000063c40bba/0x3234de053c4e764 lrc: 3/0,0 mode: PR/PR res: [0x2b668:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e66 expref: 1253 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.543655:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006247fb8a/0x3234de053c4f151 lrc: 4/0,0 mode: PR/PR res: [0x2b667:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7812 expref: 1253 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.543659:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006247fb8a/0x3234de053c4f151 lrc: 3/0,0 mode: PR/PR res: [0x2b667:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7812 expref: 1253 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.543661:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063c40bba/0x3234de053c4e764 lrc: 0/0,0 mode: --/PR res: [0x2b668:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e66 expref: 1253 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.543664:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.543664:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006247fb8a/0x3234de053c4f151 lrc: 0/0,0 mode: --/PR res: [0x2b667:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7812 expref: 1252 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.543665:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.543666:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c50e69 lrc: 3/0,1 mode: PW/PW res: [0x2b668:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.543669:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c50e69 lrc: 4/0,1 mode: PW/PW res: [0x2b668:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543669:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.543669:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.543670:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c50e70 lrc: 3/0,1 mode: PW/PW res: [0x2b667:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543673:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c50e70 lrc: 4/0,1 mode: PW/PW res: [0x2b667:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.543680:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.543686:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1251:41279:x1731746396306496:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 38us (130us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.543686:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.543689:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12101 00000100:00100000:1.0:1651529344.543694:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12103 00000100:00100000:0.0:1651529344.543694:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1250:41279:x1731746396306560:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.543695:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1250:41279:x1731746396306688:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.543697:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12102 00010000:00010000:1.0:1651529344.543698:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.543699:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000098834c70/0x3234de053c4d7e3 lrc: 4/0,0 mode: PR/PR res: [0x2b66a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d10e0 expref: 1250 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.543702:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12104 00010000:00010000:1.0:1651529344.543703:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000098834c70/0x3234de053c4d7e3 lrc: 3/0,0 mode: PR/PR res: [0x2b66a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d10e0 expref: 1249 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.543704:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1249:41278:x1731746396306624:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.543706:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.543708:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098834c70/0x3234de053c4d7e3 lrc: 0/0,0 mode: --/PR res: [0x2b66a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d10e0 expref: 1249 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.543708:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fb65f45c/0x3234de053c4ca0d lrc: 4/0,0 mode: PR/PR res: [0x2b669:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda1b expref: 1249 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.543711:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.543712:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.543712:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fb65f45c/0x3234de053c4ca0d lrc: 3/0,0 mode: PR/PR res: [0x2b669:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda1b expref: 1248 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.543713:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50e7e lrc: 3/0,1 mode: PW/PW res: [0x2b66a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.543715:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50e7e lrc: 4/0,1 mode: PW/PW res: [0x2b66a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543716:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb65f45c/0x3234de053c4ca0d lrc: 0/0,0 mode: --/PR res: [0x2b669:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda1b expref: 1248 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.543720:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.543721:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.543721:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.543722:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50e77 lrc: 3/0,1 mode: PW/PW res: [0x2b669:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543725:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50e77 lrc: 4/0,1 mode: PW/PW res: [0x2b669:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.543726:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1247:41279:x1731746396306688:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 30us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.543728:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12103 00010000:00010000:0.0:1651529344.543730:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.543732:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12105 00000100:00100000:1.0:1651529344.543742:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1246:41278:x1731746396306752:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.543745:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.543746:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dd9fc154/0x3234de053c4cb48 lrc: 4/0,0 mode: PR/PR res: [0x2b66b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde9e expref: 1246 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.543746:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1246:41278:x1731746396306624:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 41us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.543748:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12104 00010000:00010000:1.0:1651529344.543750:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dd9fc154/0x3234de053c4cb48 lrc: 3/0,0 mode: PR/PR res: [0x2b66b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde9e expref: 1246 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.543753:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12106 00010000:00010000:1.0:1651529344.543755:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd9fc154/0x3234de053c4cb48 lrc: 0/0,0 mode: --/PR res: [0x2b66b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde9e expref: 1245 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.543755:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bbea9917 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1245:41279:x1731746396306816:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.543757:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.543758:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.543759:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.543759:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50e85 lrc: 3/0,1 mode: PW/PW res: [0x2b66b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543759:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000059e8aacc/0x3234de053c4da75 lrc: 4/0,0 mode: PR/PR res: [0x2b66d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a4f expref: 1244 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.543762:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50e85 lrc: 4/0,1 mode: PW/PW res: [0x2b66b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543763:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000059e8aacc/0x3234de053c4da75 lrc: 3/0,0 mode: PR/PR res: [0x2b66d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a4f expref: 1244 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.543768:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059e8aacc/0x3234de053c4da75 lrc: 0/0,0 mode: --/PR res: [0x2b66d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a4f expref: 1244 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.543769:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.543771:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.543772:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.543772:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50e93 lrc: 3/0,1 mode: PW/PW res: [0x2b66d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.543774:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1243:41278:x1731746396306752:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 39us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.543776:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12105 00010000:00010000:0.0:1651529344.543778:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50e93 lrc: 4/0,1 mode: PW/PW res: [0x2b66d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.543781:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12107 00000100:00100000:1.0:1651529344.543783:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1242:41278:x1731746396306880:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.543787:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.543791:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.543793:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000052a301de/0x3234de053c4e8de lrc: 4/0,0 mode: PR/PR res: [0x2b66c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5432 expref: 1242 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.543793:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bbea9917 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1242:41279:x1731746396306816:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.543795:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12106 00010000:00010000:1.0:1651529344.543797:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000052a301de/0x3234de053c4e8de lrc: 3/0,0 mode: PR/PR res: [0x2b66c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5432 expref: 1242 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.543802:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052a301de/0x3234de053c4e8de lrc: 0/0,0 mode: --/PR res: [0x2b66c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5432 expref: 1241 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.543805:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.543805:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c50e69 lrc: 3/0,1 mode: PW/PW res: [0x2b668:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.543806:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.543807:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50e8c lrc: 3/0,1 mode: PW/PW res: [0x2b66c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543808:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c50e69 lrc: 3/0,1 mode: PW/PW res: [0x2b668:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.543809:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50e8c lrc: 4/0,1 mode: PW/PW res: [0x2b66c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543811:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c50e69 lrc: 3/0,1 mode: PW/PW res: [0x2b668:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543814:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c50e69 lrc: 2/0,0 mode: PW/PW res: [0x2b668:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.543818:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.543824:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1240:41278:x1731746396306880:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 41us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.543826:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12107 00010000:00010000:1.0:1651529344.543834:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50e7e lrc: 3/0,1 mode: PW/PW res: [0x2b66a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.543837:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50e7e lrc: 3/0,1 mode: PW/PW res: [0x2b66a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.543840:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50e7e lrc: 3/0,1 mode: PW/PW res: [0x2b66a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.543843:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50e7e lrc: 2/0,0 mode: PW/PW res: [0x2b66a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.543870:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+822:39030:x1731745946425088:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1310us (1410us total) trans 12885079374 rc 0/0 00000100:00100000:0.0:1651529344.543873:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211319 00010000:00010000:0.0:1651529344.543880:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c50e69 lrc: 2/0,0 mode: PW/PW res: [0x2b668:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543883:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000be0f0b1c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.543884:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c50e69 lrc: 2/0,0 mode: PW/PW res: [0x2b668:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543887:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c50e69 lrc: 3/0,0 mode: PW/PW res: [0x2b668:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.543889:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+821:39029:x1731745946425536:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1105us (1195us total) trans 12885079375 rc 0/0 00000100:00100000:1.0:1651529344.543892:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211322 00010000:00010000:0.0:1651529344.543892:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c50e69 lrc: 1/0,0 mode: --/PW res: [0x2b668:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543894:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c50e69 lrc: 0/0,0 mode: --/PW res: [0x2b668:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543898:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50e7e lrc: 2/0,0 mode: PW/PW res: [0x2b66a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.543899:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50e85 lrc: 3/0,1 mode: PW/PW res: [0x2b66b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543901:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000356aa683 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.543902:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50e7e lrc: 2/0,0 mode: PW/PW res: [0x2b66a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.543903:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50e85 lrc: 3/0,1 mode: PW/PW res: [0x2b66b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543905:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50e7e lrc: 3/0,0 mode: PW/PW res: [0x2b66a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.543906:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50e85 lrc: 3/0,1 mode: PW/PW res: [0x2b66b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.543908:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50e85 lrc: 2/0,0 mode: PW/PW res: [0x2b66b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543908:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50e7e lrc: 1/0,0 mode: --/PW res: [0x2b66a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543910:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000356aa683/0x3234de053c50e7e lrc: 0/0,0 mode: --/PW res: [0x2b66a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543914:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50e85 lrc: 3/0,0 mode: PW/PW res: [0x2b66b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543923:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003a73c8ff already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.543924:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50e85 lrc: 2/0,0 mode: PW/PW res: [0x2b66b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543927:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50e85 lrc: 3/0,0 mode: PW/PW res: [0x2b66b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543930:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50e85 lrc: 1/0,0 mode: --/PW res: [0x2b66b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543933:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a73c8ff/0x3234de053c50e85 lrc: 0/0,0 mode: --/PW res: [0x2b66b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543939:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50e77 lrc: 3/0,1 mode: PW/PW res: [0x2b669:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.543942:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50e77 lrc: 3/0,1 mode: PW/PW res: [0x2b669:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.543945:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+821:39030:x1731745946425600:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1104us (1231us total) trans 12885079376 rc 0/0 00010000:00010000:0.0:1651529344.543945:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50e77 lrc: 3/0,1 mode: PW/PW res: [0x2b669:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.543948:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211323 00010000:00010000:0.0:1651529344.543948:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50e77 lrc: 2/0,0 mode: PW/PW res: [0x2b669:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.543954:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50e93 lrc: 3/0,1 mode: PW/PW res: [0x2b66d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.543958:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50e93 lrc: 3/0,1 mode: PW/PW res: [0x2b66d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.543961:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50e93 lrc: 3/0,1 mode: PW/PW res: [0x2b66d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.543966:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50e93 lrc: 2/0,0 mode: PW/PW res: [0x2b66d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.543993:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+822:39030:x1731745946425472:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1212us (1323us total) trans 12885079377 rc 0/0 00000100:00100000:0.0:1651529344.543996:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211321 00000100:00100000:1.0:1651529344.544002:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+821:39029:x1731745946425728:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1063us (1083us total) trans 12885079378 rc 0/0 00010000:00010000:0.0:1651529344.544003:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50e77 lrc: 2/0,0 mode: PW/PW res: [0x2b669:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.544005:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211325 00010000:00010000:0.0:1651529344.544006:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000005a52f96 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.544007:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50e77 lrc: 2/0,0 mode: PW/PW res: [0x2b669:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544010:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50e77 lrc: 3/0,0 mode: PW/PW res: [0x2b669:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544015:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50e77 lrc: 1/0,0 mode: --/PW res: [0x2b669:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544017:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50e77 lrc: 0/0,0 mode: --/PW res: [0x2b669:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544021:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50e93 lrc: 2/0,0 mode: PW/PW res: [0x2b66d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544024:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000092d9e682 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.544025:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50e93 lrc: 2/0,0 mode: PW/PW res: [0x2b66d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544027:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50e93 lrc: 3/0,0 mode: PW/PW res: [0x2b66d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544033:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50e93 lrc: 1/0,0 mode: --/PW res: [0x2b66d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544036:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092d9e682/0x3234de053c50e93 lrc: 0/0,0 mode: --/PW res: [0x2b66d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544041:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50e8c lrc: 3/0,1 mode: PW/PW res: [0x2b66c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544044:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50e8c lrc: 3/0,1 mode: PW/PW res: [0x2b66c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544047:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50e8c lrc: 3/0,1 mode: PW/PW res: [0x2b66c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544050:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50e8c lrc: 2/0,0 mode: PW/PW res: [0x2b66c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.544083:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+821:39029:x1731745946425664:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1211us (1331us total) trans 12885079379 rc 0/0 00000100:00100000:0.0:1651529344.544086:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211324 00010000:00010000:0.0:1651529344.544093:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50e8c lrc: 2/0,0 mode: PW/PW res: [0x2b66c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544116:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006abc37e1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.544117:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50e8c lrc: 2/0,0 mode: PW/PW res: [0x2b66c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544120:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50e8c lrc: 3/0,0 mode: PW/PW res: [0x2b66c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544125:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50e8c lrc: 1/0,0 mode: --/PW res: [0x2b66c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544128:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50e8c lrc: 0/0,0 mode: --/PW res: [0x2b66c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544135:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c50e70 lrc: 3/0,1 mode: PW/PW res: [0x2b667:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544151:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c50e70 lrc: 3/0,1 mode: PW/PW res: [0x2b667:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544155:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c50e70 lrc: 3/0,1 mode: PW/PW res: [0x2b667:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544158:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c50e70 lrc: 2/0,0 mode: PW/PW res: [0x2b667:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.544217:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd68fdd5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996991616:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.544240:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50e9a lrc: 3/0,1 mode: --/PW res: [0x2b66e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.544263:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+821:39029:x1731745946425024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1644us (1785us total) trans 12885079380 rc 0/0 00000100:00100000:0.0:1651529344.544266:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211320 00000100:00100000:1.0:1651529344.544278:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.544284:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c50e70 lrc: 2/0,0 mode: PW/PW res: [0x2b667:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544299:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001630f6d1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.544301:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c50e70 lrc: 2/0,0 mode: PW/PW res: [0x2b667:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544304:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c50e70 lrc: 3/0,0 mode: PW/PW res: [0x2b667:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544308:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c50e70 lrc: 1/0,0 mode: --/PW res: [0x2b667:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.544311:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.544311:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c50e70 lrc: 0/0,0 mode: --/PW res: [0x2b667:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.544322:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.544330:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.544330:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946426368 00000100:00100000:0.0:1651529344.544336:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946426496 00000100:00100000:1.0:1651529344.544338:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.544348:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946426624 00000100:00100000:0.0:1651529344.544352:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946426432 00000100:00100000:1.0:1651529344.544353:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396307008 00010000:00010000:1.0:1651529344.544363:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a1d18c85/0x3234de053c4dc82 lrc: 4/0,0 mode: PR/PR res: [0x2b66e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2244 expref: 1240 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.544371:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12108 00000100:00100000:1.0:1651529344.544373:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1240:41278:x1731746396307008:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.544376:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.544377:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a1d18c85/0x3234de053c4dc82 lrc: 4/0,0 mode: PR/PR res: [0x2b66e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2244 expref: 1240 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.544383:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211327 00000100:00100000:0.0:1651529344.544385:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+824:39030:x1731745946426368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.544391:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177775 count 1 00010000:00010000:0.0:1651529344.544395:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50ea1 lrc: 3/0,1 mode: --/PW res: [0x2b66f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.544397:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a1d18c85/0x3234de053c4dc82 lrc: 3/0,0 mode: PR/PR res: [0x2b66e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2244 expref: 1240 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.544400:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000802b682c/0x3234de053c4d615 lrc: 2/0,0 mode: PR/PR res: [0x2b66f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d09fc expref: 1240 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.544403:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1d18c85/0x3234de053c4dc82 lrc: 0/0,0 mode: --/PR res: [0x2b66e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2244 expref: 1240 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.544403:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.544404:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.544405:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50ea1 lrc: 4/0,1 mode: --/PW res: [0x2b66f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.544406:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.544407:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.544408:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50e9a lrc: 3/0,1 mode: PW/PW res: [0x2b66e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.544411:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50e9a lrc: 4/0,1 mode: PW/PW res: [0x2b66e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544412:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000802b682c/0x3234de053c4d615 lrc: 3/0,0 mode: PR/PR res: [0x2b66f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d09fc expref: 1239 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.544416:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000802b682c/0x3234de053c4d615 lrc: 4/0,0 mode: PR/PR res: [0x2b66f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d09fc expref: 1239 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.544417:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.544420:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000028589556 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996991680:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.544424:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1239:41278:x1731746396307008:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 51us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.544427:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12108 00000100:00100000:0.0:1651529344.544430:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bff8744a going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.544435:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211328 00000100:00100000:1.0:1651529344.544436:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+824:39030:x1731745946426496:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.544441:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177777 count 1 00010000:00010000:1.0:1651529344.544445:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50ea8 lrc: 3/0,1 mode: --/PW res: [0x2b671:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.544449:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d9fbe817/0x3234de053c4cec8 lrc: 2/0,0 mode: PR/PR res: [0x2b671:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced1c expref: 1238 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.544450:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211329 00000100:00100000:0.0:1651529344.544452:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+824:39030:x1731745946426624:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.544455:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.544455:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.544456:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50ea8 lrc: 4/0,1 mode: --/PW res: [0x2b671:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.544457:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177779 count 1 00010000:00010000:0.0:1651529344.544461:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50eaf lrc: 3/0,1 mode: --/PW res: [0x2b673:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.544462:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d9fbe817/0x3234de053c4cec8 lrc: 3/0,0 mode: PR/PR res: [0x2b671:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced1c expref: 1238 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.544465:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000be1256ce/0x3234de053c4eb9a lrc: 2/0,0 mode: PR/PR res: [0x2b673:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5fdf expref: 1238 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.544466:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d9fbe817/0x3234de053c4cec8 lrc: 4/0,0 mode: PR/PR res: [0x2b671:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced1c expref: 1238 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.544468:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.544469:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.544470:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000be0ace91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996991744:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.544470:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50eaf lrc: 4/0,1 mode: --/PW res: [0x2b673:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544476:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000be1256ce/0x3234de053c4eb9a lrc: 3/0,0 mode: PR/PR res: [0x2b673:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5fdf expref: 1238 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.544477:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8a0b704 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.544482:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000be1256ce/0x3234de053c4eb9a lrc: 4/0,0 mode: PR/PR res: [0x2b673:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5fdf expref: 1238 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.544483:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211330 00000100:00100000:1.0:1651529344.544485:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+824:39030:x1731745946426432:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.544486:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005d2b5bb3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996991808:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.544489:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177776 count 1 00010000:00010000:1.0:1651529344.544493:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50eb6 lrc: 3/0,1 mode: --/PW res: [0x2b670:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.544493:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 0000000049203969 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.544497:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e50ab3ae/0x3234de053c4e844 lrc: 2/0,0 mode: PR/PR res: [0x2b670:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51c3 expref: 1238 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.544500:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.544500:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.544501:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50eb6 lrc: 4/0,1 mode: --/PW res: [0x2b670:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.544507:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.544509:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e50ab3ae/0x3234de053c4e844 lrc: 3/0,0 mode: PR/PR res: [0x2b670:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51c3 expref: 1238 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.544512:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e50ab3ae/0x3234de053c4e844 lrc: 4/0,0 mode: PR/PR res: [0x2b670:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51c3 expref: 1238 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.544516:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000822949b3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996991872:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.544522:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.544523:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fe434b1c going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.544528:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946426560 00000100:00100000:0.0:1651529344.544534:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.544546:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946426688 00000100:00100000:1.0:1651529344.544550:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946426752 00000100:00100000:1.0:1651529344.544554:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211331 00000100:00100000:1.0:1651529344.544555:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+827:39030:x1731745946426560:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.544560:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177778 count 1 00010000:00010000:1.0:1651529344.544563:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50ebd lrc: 3/0,1 mode: --/PW res: [0x2b672:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.544567:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000003dc2fa0/0x3234de053c4af80 lrc: 2/0,0 mode: PR/PR res: [0x2b672:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbfcd expref: 1238 pid: 72397 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.544573:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211332 00000100:00100000:0.0:1651529344.544575:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006a20fa64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+827:39030:x1731745946426688:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.544581:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177780 count 1 00010000:00010000:0.0:1651529344.544585:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50ec4 lrc: 3/0,1 mode: --/PW res: [0x2b674:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544590:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006e60010b/0x3234de053c4d788 lrc: 2/0,0 mode: PR/PR res: [0x2b674:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0fc8 expref: 1238 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.544593:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.544594:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.544594:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50ec4 lrc: 4/0,1 mode: --/PW res: [0x2b674:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.544596:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.544597:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.544597:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50ebd lrc: 4/0,1 mode: --/PW res: [0x2b672:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544600:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006e60010b/0x3234de053c4d788 lrc: 3/0,0 mode: PR/PR res: [0x2b674:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0fc8 expref: 1238 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.544604:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006e60010b/0x3234de053c4d788 lrc: 4/0,0 mode: PR/PR res: [0x2b674:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0fc8 expref: 1238 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.544605:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000003dc2fa0/0x3234de053c4af80 lrc: 3/0,0 mode: PR/PR res: [0x2b672:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbfcd expref: 1238 pid: 72397 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.544608:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005384a251 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996991936:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.544609:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000003dc2fa0/0x3234de053c4af80 lrc: 4/0,0 mode: PR/PR res: [0x2b672:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbfcd expref: 1238 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.544613:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000064719963 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996992000:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.544618:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 0000000009370c1d going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.544621:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a6b79b05 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.544624:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211333 00000100:00100000:0.0:1651529344.544625:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+827:39029:x1731745946426752:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.544628:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50e9a lrc: 3/0,1 mode: PW/PW res: [0x2b66e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.544630:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177781 count 1 00010000:00010000:1.0:1651529344.544631:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50e9a lrc: 3/0,1 mode: PW/PW res: [0x2b66e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544633:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50ecb lrc: 3/0,1 mode: --/PW res: [0x2b675:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.544635:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50e9a lrc: 3/0,1 mode: PW/PW res: [0x2b66e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.544637:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50e9a lrc: 2/0,0 mode: PW/PW res: [0x2b66e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544637:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000542972b0/0x3234de053c4c4e2 lrc: 2/0,0 mode: PR/PR res: [0x2b675:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc9ac expref: 1238 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.544640:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.544641:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.544641:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50ecb lrc: 4/0,1 mode: --/PW res: [0x2b675:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544670:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000542972b0/0x3234de053c4c4e2 lrc: 3/0,0 mode: PR/PR res: [0x2b675:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc9ac expref: 1238 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.544674:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000542972b0/0x3234de053c4c4e2 lrc: 4/0,0 mode: PR/PR res: [0x2b675:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc9ac expref: 1238 pid: 72395 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.544678:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000055e03b4f pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996992064:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.544681:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+828:39029:x1731745946425856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1124us (1157us total) trans 12885079381 rc 0/0 00000100:00100000:1.0:1651529344.544684:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211326 00000100:00100000:0.0:1651529344.544686:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c0dff858 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.544691:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50e9a lrc: 2/0,0 mode: PW/PW res: [0x2b66e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544694:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000009bc967c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.544695:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50e9a lrc: 2/0,0 mode: PW/PW res: [0x2b66e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544698:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50e9a lrc: 3/0,0 mode: PW/PW res: [0x2b66e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544703:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50e9a lrc: 1/0,0 mode: --/PW res: [0x2b66e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544706:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009bc967c/0x3234de053c50e9a lrc: 0/0,0 mode: --/PW res: [0x2b66e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.544859:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.544886:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946426880 00000100:00100000:0.0:1651529344.544894:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211334 00000100:00100000:1.0:1651529344.544895:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000be0ace91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996991744:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.544896:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+828:39029:x1731745946426880:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.544899:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50ea8 lrc: 3/0,1 mode: --/PW res: [0x2b671:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.544901:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177782 count 1 00010000:00010000:0.0:1651529344.544905:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50ed2 lrc: 3/0,1 mode: --/PW res: [0x2b676:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544910:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f83fa588/0x3234de053c4e511 lrc: 2/0,0 mode: PR/PR res: [0x2b676:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4567 expref: 1238 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.544913:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.544913:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.544914:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50ed2 lrc: 4/0,1 mode: --/PW res: [0x2b676:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.544921:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f83fa588/0x3234de053c4e511 lrc: 3/0,0 mode: PR/PR res: [0x2b676:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4567 expref: 1238 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.544925:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f83fa588/0x3234de053c4e511 lrc: 4/0,0 mode: PR/PR res: [0x2b676:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4567 expref: 1238 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.544929:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a573b31 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996992128:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.544942:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aac87b31 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.544951:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000028589556 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745996991680:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.544955:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50ea1 lrc: 3/0,1 mode: --/PW res: [0x2b66f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.545172:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000822949b3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996991872:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.545181:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50eb6 lrc: 3/0,1 mode: --/PW res: [0x2b670:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.545188:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000064719963 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996992000:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.545191:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50ebd lrc: 3/0,1 mode: --/PW res: [0x2b672:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.545204:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.545213:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396307520 00010000:00010000:1.0:1651529344.545218:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000802b682c/0x3234de053c4d615 lrc: 4/0,0 mode: PR/PR res: [0x2b66f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d09fc expref: 1239 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.545247:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12109 00000100:00100000:1.0:1651529344.545249:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1239:41278:x1731746396307520:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.545249:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.545253:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.545259:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000802b682c/0x3234de053c4d615 lrc: 4/0,0 mode: PR/PR res: [0x2b66f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d09fc expref: 1239 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.545260:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.545263:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000802b682c/0x3234de053c4d615 lrc: 3/0,0 mode: PR/PR res: [0x2b66f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d09fc expref: 1239 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.545266:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.545269:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000802b682c/0x3234de053c4d615 lrc: 0/0,0 mode: --/PR res: [0x2b66f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d09fc expref: 1239 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.545272:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.545275:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.545275:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.545276:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50ea1 lrc: 3/0,1 mode: PW/PW res: [0x2b66f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.545276:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.545279:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50ea1 lrc: 4/0,1 mode: PW/PW res: [0x2b66f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.545281:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.545288:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.545298:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1238:41278:x1731746396307520:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 48us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.545301:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12109 00000100:00100000:1.0:1651529344.545305:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396307584 00010000:00010000:1.0:1651529344.545309:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d9fbe817/0x3234de053c4cec8 lrc: 4/0,0 mode: PR/PR res: [0x2b671:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced1c expref: 1238 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.545321:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396307776 00010000:00010000:1.0:1651529344.545325:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e50ab3ae/0x3234de053c4e844 lrc: 4/0,0 mode: PR/PR res: [0x2b670:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51c3 expref: 1239 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.545327:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.545329:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396307712 00010000:00010000:1.0:1651529344.545331:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000be1256ce/0x3234de053c4eb9a lrc: 5/0,0 mode: PR/PR res: [0x2b673:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5fdf expref: 1240 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.545335:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396307904 00000100:00100000:0.0:1651529344.545336:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005d2b5bb3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996991808:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.545337:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000003dc2fa0/0x3234de053c4af80 lrc: 4/0,0 mode: PR/PR res: [0x2b672:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbfcd expref: 1241 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.545340:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50eaf lrc: 3/0,1 mode: --/PW res: [0x2b673:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.545343:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396307840 00010000:00010000:1.0:1651529344.545346:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006e60010b/0x3234de053c4d788 lrc: 5/0,0 mode: PR/PR res: [0x2b674:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0fc8 expref: 1242 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.545349:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396307968 00000100:00100000:0.0:1651529344.545349:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005384a251 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996991936:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.545351:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000542972b0/0x3234de053c4c4e2 lrc: 5/0,0 mode: PR/PR res: [0x2b675:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc9ac expref: 1243 pid: 72395 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.545352:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50ec4 lrc: 3/0,1 mode: --/PW res: [0x2b674:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.545355:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396308032 00010000:00010000:1.0:1651529344.545357:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f83fa588/0x3234de053c4e511 lrc: 5/0,0 mode: PR/PR res: [0x2b676:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4567 expref: 1244 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.545358:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000055e03b4f pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996992064:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.545360:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50ecb lrc: 3/0,1 mode: --/PW res: [0x2b675:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.545361:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12110 00000100:00100000:1.0:1651529344.545362:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1244:41279:x1731746396307584:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.545365:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.545366:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d9fbe817/0x3234de053c4cec8 lrc: 4/0,0 mode: PR/PR res: [0x2b671:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced1c expref: 1244 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.545366:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a573b31 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996992128:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.545368:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50ed2 lrc: 3/0,1 mode: --/PW res: [0x2b676:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545370:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d9fbe817/0x3234de053c4cec8 lrc: 3/0,0 mode: PR/PR res: [0x2b671:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced1c expref: 1244 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.545373:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50ea1 lrc: 3/0,1 mode: PW/PW res: [0x2b66f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545375:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9fbe817/0x3234de053c4cec8 lrc: 0/0,0 mode: --/PR res: [0x2b671:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced1c expref: 1244 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.545376:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50ea1 lrc: 3/0,1 mode: PW/PW res: [0x2b66f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545378:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.545379:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.545379:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50ea1 lrc: 3/0,1 mode: PW/PW res: [0x2b66f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545380:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50ea8 lrc: 3/0,1 mode: PW/PW res: [0x2b671:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545382:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50ea1 lrc: 2/0,0 mode: PW/PW res: [0x2b66f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545383:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50ea8 lrc: 4/0,1 mode: PW/PW res: [0x2b671:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545389:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.545400:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1243:41279:x1731746396307584:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 37us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.545403:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12110 00000100:00100000:1.0:1651529344.545407:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12111 00000100:00100000:1.0:1651529344.545409:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1242:41278:x1731746396307776:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.545411:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.545413:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e50ab3ae/0x3234de053c4e844 lrc: 4/0,0 mode: PR/PR res: [0x2b670:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51c3 expref: 1242 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.545417:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e50ab3ae/0x3234de053c4e844 lrc: 3/0,0 mode: PR/PR res: [0x2b670:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51c3 expref: 1242 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.545421:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e50ab3ae/0x3234de053c4e844 lrc: 0/0,0 mode: --/PR res: [0x2b670:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d51c3 expref: 1242 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.545425:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.545425:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.545426:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50eb6 lrc: 3/0,1 mode: PW/PW res: [0x2b670:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545431:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50eb6 lrc: 4/0,1 mode: PW/PW res: [0x2b670:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.545431:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+829:39030:x1731745946426368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1045us (1120us total) trans 12885079382 rc 0/0 00000100:00100000:0.0:1651529344.545434:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211327 00010000:00010000:1.0:1651529344.545437:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.545442:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50ea1 lrc: 2/0,0 mode: PW/PW res: [0x2b66f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.545443:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1241:41278:x1731746396307776:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 33us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.545445:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12111 00010000:00010000:0.0:1651529344.545445:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000048c07243 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.545446:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50ea1 lrc: 2/0,0 mode: PW/PW res: [0x2b66f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.545449:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12112 00010000:00010000:0.0:1651529344.545449:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50ea1 lrc: 3/0,0 mode: PW/PW res: [0x2b66f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.545450:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1240:41279:x1731746396307712:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.545452:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.545453:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000be1256ce/0x3234de053c4eb9a lrc: 4/0,0 mode: PR/PR res: [0x2b673:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5fdf expref: 1240 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.545454:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50ea1 lrc: 1/0,0 mode: --/PW res: [0x2b66f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545457:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000be1256ce/0x3234de053c4eb9a lrc: 3/0,0 mode: PR/PR res: [0x2b673:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5fdf expref: 1240 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.545457:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50ea1 lrc: 0/0,0 mode: --/PW res: [0x2b66f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545462:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be1256ce/0x3234de053c4eb9a lrc: 0/0,0 mode: --/PR res: [0x2b673:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5fdf expref: 1240 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.545464:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12113 00010000:00010000:1.0:1651529344.545465:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.545465:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.545466:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50eaf lrc: 3/0,1 mode: PW/PW res: [0x2b673:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.545466:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d9169e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1239:41278:x1731746396307904:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.545469:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50eaf lrc: 4/0,1 mode: PW/PW res: [0x2b673:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545469:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.545471:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000003dc2fa0/0x3234de053c4af80 lrc: 4/0,0 mode: PR/PR res: [0x2b672:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbfcd expref: 1239 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.545475:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000003dc2fa0/0x3234de053c4af80 lrc: 3/0,0 mode: PR/PR res: [0x2b672:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbfcd expref: 1239 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.545479:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.545484:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1239:41279:x1731746396307712:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.545486:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12112 00010000:00010000:0.0:1651529344.545487:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003dc2fa0/0x3234de053c4af80 lrc: 0/0,0 mode: --/PR res: [0x2b672:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbfcd expref: 1239 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.545490:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12114 00000100:00100000:1.0:1651529344.545492:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1238:41279:x1731746396307840:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.545494:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.545494:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.545495:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.545495:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50ebd lrc: 3/0,1 mode: PW/PW res: [0x2b672:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545496:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006e60010b/0x3234de053c4d788 lrc: 4/0,0 mode: PR/PR res: [0x2b674:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0fc8 expref: 1237 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.545498:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50ebd lrc: 4/0,1 mode: PW/PW res: [0x2b672:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545500:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006e60010b/0x3234de053c4d788 lrc: 3/0,0 mode: PR/PR res: [0x2b674:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0fc8 expref: 1237 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.545504:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e60010b/0x3234de053c4d788 lrc: 0/0,0 mode: --/PR res: [0x2b674:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0fc8 expref: 1237 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.545508:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.545515:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.545515:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d9169e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1236:41278:x1731746396307904:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 49us (243us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.545516:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.545517:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50ec4 lrc: 3/0,1 mode: PW/PW res: [0x2b674:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.545518:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12113 00010000:00010000:1.0:1651529344.545520:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50ec4 lrc: 4/0,1 mode: PW/PW res: [0x2b674:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545528:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.545534:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1235:41279:x1731746396307840:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 41us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.545535:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12115 00000100:00100000:1.0:1651529344.545537:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12114 00000100:00100000:0.0:1651529344.545537:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1235:41279:x1731746396307968:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.545540:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.545541:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12116 00010000:00010000:0.0:1651529344.545542:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000542972b0/0x3234de053c4c4e2 lrc: 4/0,0 mode: PR/PR res: [0x2b675:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc9ac expref: 1234 pid: 72395 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.545543:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1234:41279:x1731746396308032:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.545545:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.545546:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000542972b0/0x3234de053c4c4e2 lrc: 3/0,0 mode: PR/PR res: [0x2b675:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc9ac expref: 1234 pid: 72395 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.545547:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f83fa588/0x3234de053c4e511 lrc: 4/0,0 mode: PR/PR res: [0x2b676:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4567 expref: 1234 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.545551:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f83fa588/0x3234de053c4e511 lrc: 3/0,0 mode: PR/PR res: [0x2b676:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4567 expref: 1234 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.545551:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000542972b0/0x3234de053c4c4e2 lrc: 0/0,0 mode: --/PR res: [0x2b675:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc9ac expref: 1234 pid: 72395 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.545554:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.545555:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f83fa588/0x3234de053c4e511 lrc: 0/0,0 mode: --/PR res: [0x2b676:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4567 expref: 1233 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.545555:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.545556:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50ecb lrc: 3/0,1 mode: PW/PW res: [0x2b675:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545559:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.545559:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50ecb lrc: 4/0,1 mode: PW/PW res: [0x2b675:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545560:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.545560:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50ed2 lrc: 3/0,1 mode: PW/PW res: [0x2b676:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545563:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50ed2 lrc: 4/0,1 mode: PW/PW res: [0x2b676:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545564:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.545571:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.545576:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1232:41279:x1731746396308032:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 32us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.545576:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1232:41279:x1731746396307968:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.545578:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12115 00000100:00100000:1.0:1651529344.545580:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12116 00010000:00010000:0.0:1651529344.545585:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50eaf lrc: 3/0,1 mode: PW/PW res: [0x2b673:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545588:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50ea8 lrc: 3/0,1 mode: PW/PW res: [0x2b671:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545588:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50eaf lrc: 3/0,1 mode: PW/PW res: [0x2b673:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545591:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50ea8 lrc: 3/0,1 mode: PW/PW res: [0x2b671:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545591:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50eaf lrc: 3/0,1 mode: PW/PW res: [0x2b673:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545594:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50eaf lrc: 2/0,0 mode: PW/PW res: [0x2b673:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545595:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50ea8 lrc: 3/0,1 mode: PW/PW res: [0x2b671:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545597:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50ea8 lrc: 2/0,0 mode: PW/PW res: [0x2b671:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.545638:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+830:39030:x1731745946426496:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1201us (1316us total) trans 12885079383 rc 0/0 00000100:00100000:1.0:1651529344.545641:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211328 00000100:00100000:0.0:1651529344.545641:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+830:39030:x1731745946426624:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1187us (1310us total) trans 12885079384 rc 0/0 00000100:00100000:0.0:1651529344.545644:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211329 00010000:00010000:1.0:1651529344.545648:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50ebd lrc: 3/0,1 mode: PW/PW res: [0x2b672:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545651:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50ebd lrc: 3/0,1 mode: PW/PW res: [0x2b672:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545651:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50eaf lrc: 2/0,0 mode: PW/PW res: [0x2b673:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545654:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50ebd lrc: 3/0,1 mode: PW/PW res: [0x2b672:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545656:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50ebd lrc: 2/0,0 mode: PW/PW res: [0x2b672:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545657:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000069f7ba22 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.545658:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50eaf lrc: 2/0,0 mode: PW/PW res: [0x2b673:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545660:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50eaf lrc: 3/0,0 mode: PW/PW res: [0x2b673:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545672:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50eaf lrc: 1/0,0 mode: --/PW res: [0x2b673:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545675:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50eaf lrc: 0/0,0 mode: --/PW res: [0x2b673:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545679:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50ea8 lrc: 2/0,0 mode: PW/PW res: [0x2b671:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545682:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d44dd5ea already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.545683:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50ea8 lrc: 2/0,0 mode: PW/PW res: [0x2b671:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545686:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50ea8 lrc: 3/0,0 mode: PW/PW res: [0x2b671:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545689:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50ea8 lrc: 1/0,0 mode: --/PW res: [0x2b671:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545691:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44dd5ea/0x3234de053c50ea8 lrc: 0/0,0 mode: --/PW res: [0x2b671:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.545693:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+829:39030:x1731745946426560:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1137us (1186us total) trans 12885079385 rc 0/0 00010000:00010000:0.0:1651529344.545695:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50ebd lrc: 2/0,0 mode: PW/PW res: [0x2b672:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.545698:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211331 00010000:00010000:0.0:1651529344.545698:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054065c33 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.545698:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50ebd lrc: 2/0,0 mode: PW/PW res: [0x2b672:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545701:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50ebd lrc: 3/0,0 mode: PW/PW res: [0x2b672:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545704:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50eb6 lrc: 3/0,1 mode: PW/PW res: [0x2b670:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545704:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50ebd lrc: 1/0,0 mode: --/PW res: [0x2b672:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545706:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054065c33/0x3234de053c50ebd lrc: 0/0,0 mode: --/PW res: [0x2b672:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545708:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50eb6 lrc: 3/0,1 mode: PW/PW res: [0x2b670:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545711:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50eb6 lrc: 3/0,1 mode: PW/PW res: [0x2b670:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.545713:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50eb6 lrc: 2/0,0 mode: PW/PW res: [0x2b670:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545713:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50ec4 lrc: 3/0,1 mode: PW/PW res: [0x2b674:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545716:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50ec4 lrc: 3/0,1 mode: PW/PW res: [0x2b674:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545718:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50ec4 lrc: 3/0,1 mode: PW/PW res: [0x2b674:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545726:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50ec4 lrc: 2/0,0 mode: PW/PW res: [0x2b674:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.545758:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+830:39030:x1731745946426432:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1272us (1419us total) trans 12885079386 rc 0/0 00000100:00100000:1.0:1651529344.545761:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211330 00000100:00100000:0.0:1651529344.545771:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006a20fa64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+829:39030:x1731745946426688:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1195us (1249us total) trans 12885079387 rc 0/0 00000100:00100000:0.0:1651529344.545774:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211332 00010000:00010000:0.0:1651529344.545794:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50eb6 lrc: 2/0,0 mode: PW/PW res: [0x2b670:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545797:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000048b51e47 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.545798:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50eb6 lrc: 2/0,0 mode: PW/PW res: [0x2b670:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545801:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50eb6 lrc: 3/0,0 mode: PW/PW res: [0x2b670:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545806:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50eb6 lrc: 1/0,0 mode: --/PW res: [0x2b670:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545808:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048b51e47/0x3234de053c50eb6 lrc: 0/0,0 mode: --/PW res: [0x2b670:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545812:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50ec4 lrc: 2/0,0 mode: PW/PW res: [0x2b674:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545815:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000002904524 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.545816:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50ec4 lrc: 2/0,0 mode: PW/PW res: [0x2b674:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545821:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50ec4 lrc: 3/0,0 mode: PW/PW res: [0x2b674:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545824:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50ec4 lrc: 1/0,0 mode: --/PW res: [0x2b674:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545827:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50ec4 lrc: 0/0,0 mode: --/PW res: [0x2b674:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545832:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50ecb lrc: 3/0,1 mode: PW/PW res: [0x2b675:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545835:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50ecb lrc: 3/0,1 mode: PW/PW res: [0x2b675:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545838:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50ecb lrc: 3/0,1 mode: PW/PW res: [0x2b675:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545841:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50ecb lrc: 2/0,0 mode: PW/PW res: [0x2b675:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.545880:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+829:39029:x1731745946426752:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1253us (1345us total) trans 12885079388 rc 0/0 00000100:00100000:0.0:1651529344.545883:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211333 00010000:00010000:0.0:1651529344.545890:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50ecb lrc: 2/0,0 mode: PW/PW res: [0x2b675:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545912:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000085580035 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.545913:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50ecb lrc: 2/0,0 mode: PW/PW res: [0x2b675:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545916:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50ecb lrc: 3/0,0 mode: PW/PW res: [0x2b675:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545920:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50ecb lrc: 1/0,0 mode: --/PW res: [0x2b675:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545923:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50ecb lrc: 0/0,0 mode: --/PW res: [0x2b675:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545941:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50ed2 lrc: 3/0,1 mode: PW/PW res: [0x2b676:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545944:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50ed2 lrc: 3/0,1 mode: PW/PW res: [0x2b676:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545947:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50ed2 lrc: 3/0,1 mode: PW/PW res: [0x2b676:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.545950:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50ed2 lrc: 2/0,0 mode: PW/PW res: [0x2b676:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.545991:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+829:39029:x1731745946426880:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1094us (1132us total) trans 12885079389 rc 0/0 00000100:00100000:0.0:1651529344.545995:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211334 00010000:00010000:0.0:1651529344.546002:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50ed2 lrc: 2/0,0 mode: PW/PW res: [0x2b676:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.546005:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e0e037e6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.546006:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50ed2 lrc: 2/0,0 mode: PW/PW res: [0x2b676:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.546009:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50ed2 lrc: 3/0,0 mode: PW/PW res: [0x2b676:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.546013:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50ed2 lrc: 1/0,0 mode: --/PW res: [0x2b676:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.546016:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50ed2 lrc: 0/0,0 mode: --/PW res: [0x2b676:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.546059:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.546074:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946427456 00000100:00100000:0.0:1651529344.546082:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211335 00000100:00100000:1.0:1651529344.546083:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.546084:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+829:39030:x1731745946427456:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.546099:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.546104:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177783 count 1 00000100:00100000:1.0:1651529344.546106:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.546108:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50ed9 lrc: 3/0,1 mode: --/PW res: [0x2b677:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.546112:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.546113:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004d29e43d/0x3234de053c4d781 lrc: 2/0,0 mode: PR/PR res: [0x2b677:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0fac expref: 1230 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.546121:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.546125:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.546126:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.546127:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50ed9 lrc: 4/0,1 mode: --/PW res: [0x2b677:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.546128:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946427520 00000100:00100000:1.0:1651529344.546136:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946427648 00010000:00010000:0.0:1651529344.546138:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004d29e43d/0x3234de053c4d781 lrc: 3/0,0 mode: PR/PR res: [0x2b677:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0fac expref: 1230 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.546141:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946427776 00000100:00100000:1.0:1651529344.546145:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946427584 00000100:00100000:1.0:1651529344.546148:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946427712 00000100:00100000:1.0:1651529344.546152:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211336 00000100:00100000:1.0:1651529344.546154:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+834:39030:x1731745946427520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.546159:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177784 count 1 00010000:00010000:1.0:1651529344.546164:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50ee0 lrc: 3/0,1 mode: --/PW res: [0x2b678:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.546170:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004d29e43d/0x3234de053c4d781 lrc: 4/0,0 mode: PR/PR res: [0x2b677:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0fac expref: 1230 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.546175:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a4b486d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996992192:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.546176:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c1e08ee3/0x3234de053c4cab5 lrc: 2/0,0 mode: PR/PR res: [0x2b678:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdcad expref: 1230 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.546180:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.546181:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.546181:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50ee0 lrc: 4/0,1 mode: --/PW res: [0x2b678:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.546189:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a3b00cf3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.546194:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c1e08ee3/0x3234de053c4cab5 lrc: 3/0,0 mode: PR/PR res: [0x2b678:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdcad expref: 1230 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.546197:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c1e08ee3/0x3234de053c4cab5 lrc: 4/0,0 mode: PR/PR res: [0x2b678:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdcad expref: 1230 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.546197:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211337 00000100:00100000:0.0:1651529344.546198:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+834:39030:x1731745946427648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.546202:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004534b316 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996992256:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.546203:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177786 count 1 00010000:00010000:0.0:1651529344.546207:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c50ee7 lrc: 3/0,1 mode: --/PW res: [0x2b67a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.546211:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a6b79b05 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.546212:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4f1e4 lrc: 2/0,0 mode: PR/PR res: [0x2b67a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a7a expref: 1230 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.546215:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.546216:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.546216:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c50ee7 lrc: 4/0,1 mode: --/PW res: [0x2b67a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.546218:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211338 00000100:00100000:1.0:1651529344.546219:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+834:39030:x1731745946427776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.546241:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177788 count 1 00010000:00010000:0.0:1651529344.546244:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4f1e4 lrc: 3/0,0 mode: PR/PR res: [0x2b67a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a7a expref: 1230 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.546245:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50eee lrc: 3/0,1 mode: --/PW res: [0x2b67c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.546248:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4f1e4 lrc: 4/0,0 mode: PR/PR res: [0x2b67a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a7a expref: 1230 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.546252:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000062022a4b/0x3234de053c4be60 lrc: 2/0,0 mode: PR/PR res: [0x2b67c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6b1 expref: 1230 pid: 72397 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.546252:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996992320:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.546255:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.546256:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.546257:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50eee lrc: 4/0,1 mode: --/PW res: [0x2b67c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.546260:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000003003c8b0 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.546263:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000062022a4b/0x3234de053c4be60 lrc: 3/0,0 mode: PR/PR res: [0x2b67c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6b1 expref: 1230 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.546266:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000062022a4b/0x3234de053c4be60 lrc: 4/0,0 mode: PR/PR res: [0x2b67c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6b1 expref: 1230 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.546266:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211339 00000100:00100000:0.0:1651529344.546268:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+834:39030:x1731745946427584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.546270:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d28c414b pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996992384:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.546272:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177785 count 1 00010000:00010000:0.0:1651529344.546275:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50ef5 lrc: 3/0,1 mode: --/PW res: [0x2b679:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.546278:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b52d0f36 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.546280:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009d5010bf/0x3234de053c4ef36 lrc: 2/0,0 mode: PR/PR res: [0x2b679:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ee2 expref: 1230 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.546283:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.546283:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.546284:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211340 00010000:00010000:0.0:1651529344.546284:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50ef5 lrc: 4/0,1 mode: --/PW res: [0x2b679:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.546286:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+834:39030:x1731745946427712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.546290:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177787 count 1 00010000:00010000:0.0:1651529344.546290:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009d5010bf/0x3234de053c4ef36 lrc: 3/0,0 mode: PR/PR res: [0x2b679:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ee2 expref: 1230 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.546293:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009d5010bf/0x3234de053c4ef36 lrc: 4/0,0 mode: PR/PR res: [0x2b679:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ee2 expref: 1230 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.546294:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c50efc lrc: 3/0,1 mode: --/PW res: [0x2b67b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.546297:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996992448:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.546298:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006a3dc94e/0x3234de053c4e5f1 lrc: 2/0,0 mode: PR/PR res: [0x2b67b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d491f expref: 1230 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.546301:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.546302:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.546302:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c50efc lrc: 4/0,1 mode: --/PW res: [0x2b67b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.546303:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aac87b31 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.546309:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006a3dc94e/0x3234de053c4e5f1 lrc: 3/0,0 mode: PR/PR res: [0x2b67b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d491f expref: 1230 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.546312:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006a3dc94e/0x3234de053c4e5f1 lrc: 4/0,0 mode: PR/PR res: [0x2b67b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d491f expref: 1230 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.546316:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bc420ca1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996992512:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.546318:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.546322:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b7af823 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.546327:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946427904 00000100:00100000:0.0:1651529344.546333:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.546338:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211341 00000100:00100000:1.0:1651529344.546339:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+835:39030:x1731745946427904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.546343:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177790 count 1 00010000:00010000:1.0:1651529344.546347:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c50f03 lrc: 3/0,1 mode: --/PW res: [0x2b67e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.546351:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000345d04ae/0x3234de053c4f3f1 lrc: 2/0,0 mode: PR/PR res: [0x2b67e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8229 expref: 1230 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.546354:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.546355:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.546355:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c50f03 lrc: 4/0,1 mode: --/PW res: [0x2b67e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.546361:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000345d04ae/0x3234de053c4f3f1 lrc: 3/0,0 mode: PR/PR res: [0x2b67e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8229 expref: 1230 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.546365:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000345d04ae/0x3234de053c4f3f1 lrc: 4/0,0 mode: PR/PR res: [0x2b67e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8229 expref: 1230 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.546373:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946427840 00000100:00100000:0.0:1651529344.546379:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211342 00000100:00100000:0.0:1651529344.546381:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+836:39029:x1731745946427840:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.546386:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177789 count 1 00010000:00010000:0.0:1651529344.546390:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50f0a lrc: 3/0,1 mode: --/PW res: [0x2b67d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.546394:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005a1b12ea/0x3234de053c4d6f5 lrc: 2/0,0 mode: PR/PR res: [0x2b67d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d91 expref: 1230 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.546396:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c9f4ec84 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996992576:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.546397:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.546398:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.546399:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50f0a lrc: 4/0,1 mode: --/PW res: [0x2b67d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.546405:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005a1b12ea/0x3234de053c4d6f5 lrc: 3/0,0 mode: PR/PR res: [0x2b67d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d91 expref: 1230 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.546410:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 0000000099c1da85 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.546416:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005a1b12ea/0x3234de053c4d6f5 lrc: 4/0,0 mode: PR/PR res: [0x2b67d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d91 expref: 1230 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.546420:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ef7d105 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996992640:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.546449:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 0000000009370c1d going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.546805:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.546813:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d28c414b pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996992384:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.546814:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.546822:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50eee lrc: 3/0,1 mode: --/PW res: [0x2b67c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.546822:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.546835:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396308608 00010000:00010000:1.0:1651529344.546839:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004d29e43d/0x3234de053c4d781 lrc: 5/0,0 mode: PR/PR res: [0x2b677:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0fac expref: 1231 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.546842:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.546846:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396308672 00010000:00010000:1.0:1651529344.546849:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c1e08ee3/0x3234de053c4cab5 lrc: 5/0,0 mode: PR/PR res: [0x2b678:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdcad expref: 1232 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.546851:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.546853:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396308736 00010000:00010000:1.0:1651529344.546855:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4f1e4 lrc: 5/0,0 mode: PR/PR res: [0x2b67a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a7a expref: 1233 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.546865:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396308864 00010000:00010000:1.0:1651529344.546873:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009d5010bf/0x3234de053c4ef36 lrc: 5/0,0 mode: PR/PR res: [0x2b679:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ee2 expref: 1234 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.546875:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996992320:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.546880:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396308800 00010000:00010000:0.0:1651529344.546880:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c50ee7 lrc: 3/0,1 mode: --/PW res: [0x2b67a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.546882:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000062022a4b/0x3234de053c4be60 lrc: 4/0,0 mode: PR/PR res: [0x2b67c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6b1 expref: 1235 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.546887:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12117 00000100:00100000:0.0:1651529344.546887:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996992448:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.546889:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1235:41279:x1731746396308608:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.546889:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50ef5 lrc: 3/0,1 mode: --/PW res: [0x2b679:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.546891:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.546893:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004d29e43d/0x3234de053c4d781 lrc: 5/0,0 mode: PR/PR res: [0x2b677:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0fac expref: 1235 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.546895:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a4b486d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996992192:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.546896:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004d29e43d/0x3234de053c4d781 lrc: 3/0,0 mode: PR/PR res: [0x2b677:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0fac expref: 1235 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.546901:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50ed9 lrc: 3/0,1 mode: --/PW res: [0x2b677:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.546904:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d29e43d/0x3234de053c4d781 lrc: 0/0,0 mode: --/PR res: [0x2b677:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0fac expref: 1235 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.546908:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.546909:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.546910:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50ed9 lrc: 3/0,1 mode: PW/PW res: [0x2b677:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.546913:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50ed9 lrc: 4/0,1 mode: PW/PW res: [0x2b677:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.546926:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.546944:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1234:41279:x1731746396308608:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 48us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.546944:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12118 00000100:00100000:0.0:1651529344.546946:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1234:41279:x1731746396308672:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.546948:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12117 00000100:00100000:1.0:1651529344.546953:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12119 00000100:00100000:1.0:1651529344.546954:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1233:41279:x1731746396308736:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.546957:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.546959:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4f1e4 lrc: 4/0,0 mode: PR/PR res: [0x2b67a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a7a expref: 1233 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.546959:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.546961:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c1e08ee3/0x3234de053c4cab5 lrc: 5/0,0 mode: PR/PR res: [0x2b678:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdcad expref: 1233 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.546962:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4f1e4 lrc: 3/0,0 mode: PR/PR res: [0x2b67a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a7a expref: 1233 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.546965:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c1e08ee3/0x3234de053c4cab5 lrc: 4/0,0 mode: PR/PR res: [0x2b678:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdcad expref: 1233 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.546967:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb5dc195/0x3234de053c4f1e4 lrc: 0/0,0 mode: --/PR res: [0x2b67a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a7a expref: 1233 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.546971:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.546971:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.546971:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.546972:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c50ee7 lrc: 3/0,1 mode: PW/PW res: [0x2b67a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.546972:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.546973:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50ee0 lrc: 3/0,1 mode: PW/PW res: [0x2b678:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.546975:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c50ee7 lrc: 4/0,1 mode: PW/PW res: [0x2b67a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.546976:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50ee0 lrc: 4/0,1 mode: PW/PW res: [0x2b678:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.546981:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.546984:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.546990:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1232:41279:x1731746396308736:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.546993:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12119 00000100:00100000:0.0:1651529344.546994:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1232:41279:x1731746396308672:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 48us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.546997:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12120 00000100:00100000:1.0:1651529344.546998:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b5574957 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1231:41279:x1731746396308864:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.547001:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.547002:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009d5010bf/0x3234de053c4ef36 lrc: 4/0,0 mode: PR/PR res: [0x2b679:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ee2 expref: 1231 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.547006:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009d5010bf/0x3234de053c4ef36 lrc: 3/0,0 mode: PR/PR res: [0x2b679:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ee2 expref: 1231 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.547009:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12118 00010000:00010000:1.0:1651529344.547010:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d5010bf/0x3234de053c4ef36 lrc: 0/0,0 mode: --/PR res: [0x2b679:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ee2 expref: 1231 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.547013:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.547014:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.547015:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50ef5 lrc: 3/0,1 mode: PW/PW res: [0x2b679:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.547016:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12121 00010000:00010000:1.0:1651529344.547018:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50ef5 lrc: 4/0,1 mode: PW/PW res: [0x2b679:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.547018:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1229:41278:x1731746396308800:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.547021:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.547022:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000062022a4b/0x3234de053c4be60 lrc: 4/0,0 mode: PR/PR res: [0x2b67c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6b1 expref: 1229 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.547026:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.547031:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b5574957 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1229:41279:x1731746396308864:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 32us (189us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.547032:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000062022a4b/0x3234de053c4be60 lrc: 3/0,0 mode: PR/PR res: [0x2b67c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6b1 expref: 1229 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.547033:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12120 00010000:00010000:0.0:1651529344.547038:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062022a4b/0x3234de053c4be60 lrc: 0/0,0 mode: --/PR res: [0x2b67c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6b1 expref: 1228 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.547042:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.547042:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.547043:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50eee lrc: 3/0,1 mode: PW/PW res: [0x2b67c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547046:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50eee lrc: 4/0,1 mode: PW/PW res: [0x2b67c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.547047:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bc420ca1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996992512:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.547051:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c50efc lrc: 3/0,1 mode: --/PW res: [0x2b67b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547055:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.547062:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1227:41278:x1731746396308800:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 44us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.547065:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12121 00000100:00100000:1.0:1651529344.547067:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c9f4ec84 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996992576:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.547069:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c50f03 lrc: 3/0,1 mode: --/PW res: [0x2b67e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547072:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c50ee7 lrc: 3/0,1 mode: PW/PW res: [0x2b67a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.547075:0:72396:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1e08ee3/0x3234de053c4cab5 lrc: 0/0,0 mode: --/PR res: [0x2b678:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdcad expref: 1226 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.547075:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c50ee7 lrc: 3/0,1 mode: PW/PW res: [0x2b67a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547078:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c50ee7 lrc: 3/0,1 mode: PW/PW res: [0x2b67a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.547079:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004534b316 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996992256:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.547081:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50ee0 lrc: 3/0,1 mode: PW/PW res: [0x2b678:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547081:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c50ee7 lrc: 2/0,0 mode: PW/PW res: [0x2b67a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.547084:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50ee0 lrc: 3/0,1 mode: PW/PW res: [0x2b678:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.547087:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50ee0 lrc: 3/0,1 mode: PW/PW res: [0x2b678:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.547090:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50ee0 lrc: 3/0,1 mode: PW/PW res: [0x2b678:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.547093:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50ee0 lrc: 2/0,0 mode: PW/PW res: [0x2b678:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.547128:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+838:39030:x1731745946427648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 929us (1029us total) trans 12885079390 rc 0/0 00000100:00100000:0.0:1651529344.547131:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211337 00000100:00100000:1.0:1651529344.547136:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+837:39030:x1731745946427520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 981us (1053us total) trans 12885079391 rc 0/0 00010000:00010000:0.0:1651529344.547138:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c50ee7 lrc: 2/0,0 mode: PW/PW res: [0x2b67a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.547141:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211336 00010000:00010000:0.0:1651529344.547142:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b3edbdf4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.547143:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c50ee7 lrc: 2/0,0 mode: PW/PW res: [0x2b67a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547146:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c50ee7 lrc: 3/0,0 mode: PW/PW res: [0x2b67a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.547148:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50eee lrc: 3/0,1 mode: PW/PW res: [0x2b67c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547150:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c50ee7 lrc: 1/0,0 mode: --/PW res: [0x2b67a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.547151:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50eee lrc: 3/0,1 mode: PW/PW res: [0x2b67c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547153:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c50ee7 lrc: 0/0,0 mode: --/PW res: [0x2b67a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.547155:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50eee lrc: 3/0,1 mode: PW/PW res: [0x2b67c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.547157:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50eee lrc: 2/0,0 mode: PW/PW res: [0x2b67c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547157:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50ee0 lrc: 2/0,0 mode: PW/PW res: [0x2b678:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547160:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006b93727a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.547161:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50ee0 lrc: 2/0,0 mode: PW/PW res: [0x2b678:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547164:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50ee0 lrc: 3/0,0 mode: PW/PW res: [0x2b678:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547174:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50ee0 lrc: 1/0,0 mode: --/PW res: [0x2b678:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547177:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50ee0 lrc: 0/0,0 mode: --/PW res: [0x2b678:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547181:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50eee lrc: 2/0,0 mode: PW/PW res: [0x2b67c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547183:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000035eaa2c8 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.547184:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50eee lrc: 2/0,0 mode: PW/PW res: [0x2b67c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547187:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50eee lrc: 3/0,0 mode: PW/PW res: [0x2b67c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547190:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50eee lrc: 1/0,0 mode: --/PW res: [0x2b67c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547192:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50eee lrc: 0/0,0 mode: --/PW res: [0x2b67c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.547195:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+837:39030:x1731745946427776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 974us (1088us total) trans 12885079392 rc 0/0 00000100:00100000:1.0:1651529344.547197:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211338 00010000:00010000:0.0:1651529344.547199:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50ef5 lrc: 3/0,1 mode: PW/PW res: [0x2b679:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547202:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50ef5 lrc: 3/0,1 mode: PW/PW res: [0x2b679:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547205:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50ef5 lrc: 3/0,1 mode: PW/PW res: [0x2b679:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547207:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50ef5 lrc: 2/0,0 mode: PW/PW res: [0x2b679:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.547212:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.547243:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.547271:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+837:39030:x1731745946427584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1003us (1158us total) trans 12885079393 rc 0/0 00000100:00100000:0.0:1651529344.547275:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211339 00000100:00100000:1.0:1651529344.547277:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.547284:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50ef5 lrc: 2/0,0 mode: PW/PW res: [0x2b679:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547287:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000827909ec already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.547288:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50ef5 lrc: 2/0,0 mode: PW/PW res: [0x2b679:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547291:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50ef5 lrc: 3/0,0 mode: PW/PW res: [0x2b679:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547295:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50ef5 lrc: 1/0,0 mode: --/PW res: [0x2b679:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547298:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c50ef5 lrc: 0/0,0 mode: --/PW res: [0x2b679:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.547308:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ef7d105 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996992640:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.547311:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50f0a lrc: 3/0,1 mode: --/PW res: [0x2b67d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547316:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50ed9 lrc: 3/0,1 mode: PW/PW res: [0x2b677:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547319:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50ed9 lrc: 3/0,1 mode: PW/PW res: [0x2b677:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547325:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50ed9 lrc: 3/0,1 mode: PW/PW res: [0x2b677:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547327:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50ed9 lrc: 2/0,0 mode: PW/PW res: [0x2b677:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.547351:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396308992 00010000:00010000:1.0:1651529344.547357:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000345d04ae/0x3234de053c4f3f1 lrc: 4/0,0 mode: PR/PR res: [0x2b67e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8229 expref: 1226 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.547371:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396308928 00010000:00010000:1.0:1651529344.547374:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006a3dc94e/0x3234de053c4e5f1 lrc: 4/0,0 mode: PR/PR res: [0x2b67b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d491f expref: 1227 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.547381:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396309056 00000100:00100000:0.0:1651529344.547381:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+837:39030:x1731745946427456:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1296us (1322us total) trans 12885079394 rc 0/0 00010000:00010000:1.0:1651529344.547383:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005a1b12ea/0x3234de053c4d6f5 lrc: 4/0,0 mode: PR/PR res: [0x2b67d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d91 expref: 1228 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.547385:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211335 00000100:00100000:1.0:1651529344.547388:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12122 00000100:00100000:1.0:1651529344.547390:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1228:41279:x1731746396308992:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.547392:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.547393:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000345d04ae/0x3234de053c4f3f1 lrc: 4/0,0 mode: PR/PR res: [0x2b67e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8229 expref: 1228 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.547397:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000345d04ae/0x3234de053c4f3f1 lrc: 3/0,0 mode: PR/PR res: [0x2b67e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8229 expref: 1228 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.547401:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50ed9 lrc: 2/0,0 mode: PW/PW res: [0x2b677:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.547402:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000345d04ae/0x3234de053c4f3f1 lrc: 0/0,0 mode: --/PR res: [0x2b67e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8229 expref: 1228 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.547405:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001d253066 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.547406:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.547406:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50ed9 lrc: 2/0,0 mode: PW/PW res: [0x2b677:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.547407:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.547408:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c50f03 lrc: 3/0,1 mode: PW/PW res: [0x2b67e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547409:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50ed9 lrc: 3/0,0 mode: PW/PW res: [0x2b677:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.547411:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c50f03 lrc: 4/0,1 mode: PW/PW res: [0x2b67e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547414:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50ed9 lrc: 1/0,0 mode: --/PW res: [0x2b677:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547416:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50ed9 lrc: 0/0,0 mode: --/PW res: [0x2b677:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.547418:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.547424:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1227:41279:x1731746396308992:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 34us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.547424:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12123 00000100:00100000:0.0:1651529344.547426:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1227:41278:x1731746396308928:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.547427:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12122 00010000:00010000:0.0:1651529344.547429:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.547431:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006a3dc94e/0x3234de053c4e5f1 lrc: 4/0,0 mode: PR/PR res: [0x2b67b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d491f expref: 1226 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.547432:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12124 00000100:00100000:1.0:1651529344.547434:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1226:41279:x1731746396309056:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.547435:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006a3dc94e/0x3234de053c4e5f1 lrc: 3/0,0 mode: PR/PR res: [0x2b67b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d491f expref: 1226 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.547436:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.547437:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005a1b12ea/0x3234de053c4d6f5 lrc: 4/0,0 mode: PR/PR res: [0x2b67d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d91 expref: 1226 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.547440:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a3dc94e/0x3234de053c4e5f1 lrc: 0/0,0 mode: --/PR res: [0x2b67b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d491f expref: 1226 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.547441:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005a1b12ea/0x3234de053c4d6f5 lrc: 3/0,0 mode: PR/PR res: [0x2b67d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d91 expref: 1226 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.547444:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.547444:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.547445:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c50efc lrc: 3/0,1 mode: PW/PW res: [0x2b67b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.547446:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a1b12ea/0x3234de053c4d6f5 lrc: 0/0,0 mode: --/PR res: [0x2b67d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d91 expref: 1225 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.547448:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c50efc lrc: 4/0,1 mode: PW/PW res: [0x2b67b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.547449:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.547449:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.547450:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50f0a lrc: 3/0,1 mode: PW/PW res: [0x2b67d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.547453:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50f0a lrc: 4/0,1 mode: PW/PW res: [0x2b67d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547458:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.547466:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1224:41278:x1731746396308928:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 39us (223us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.547469:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.547474:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1224:41279:x1731746396309056:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 40us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.547474:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12123 00000100:00100000:1.0:1651529344.547477:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12124 00010000:00010000:1.0:1651529344.547484:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c50efc lrc: 3/0,1 mode: PW/PW res: [0x2b67b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.547487:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c50efc lrc: 3/0,1 mode: PW/PW res: [0x2b67b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.547490:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c50efc lrc: 3/0,1 mode: PW/PW res: [0x2b67b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.547493:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c50efc lrc: 2/0,0 mode: PW/PW res: [0x2b67b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547494:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50f0a lrc: 3/0,1 mode: PW/PW res: [0x2b67d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547498:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50f0a lrc: 3/0,1 mode: PW/PW res: [0x2b67d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547517:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50f0a lrc: 3/0,1 mode: PW/PW res: [0x2b67d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547520:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50f0a lrc: 2/0,0 mode: PW/PW res: [0x2b67d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.547532:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+837:39030:x1731745946427712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1245us (1410us total) trans 12885079395 rc 0/0 00000100:00100000:1.0:1651529344.547535:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211340 00010000:00010000:1.0:1651529344.547541:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c50f03 lrc: 3/0,1 mode: PW/PW res: [0x2b67e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.547544:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c50f03 lrc: 3/0,1 mode: PW/PW res: [0x2b67e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.547547:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c50f03 lrc: 3/0,1 mode: PW/PW res: [0x2b67e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.547550:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c50f03 lrc: 2/0,0 mode: PW/PW res: [0x2b67e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.547566:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+837:39029:x1731745946427840:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1184us (1232us total) trans 12885079396 rc 0/0 00000100:00100000:0.0:1651529344.547569:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211342 00010000:00010000:0.0:1651529344.547576:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c50efc lrc: 2/0,0 mode: PW/PW res: [0x2b67b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547579:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000022a9b983 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.547580:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c50efc lrc: 2/0,0 mode: PW/PW res: [0x2b67b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547583:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c50efc lrc: 3/0,0 mode: PW/PW res: [0x2b67b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.547587:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+837:39030:x1731745946427904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1246us (1269us total) trans 12885079397 rc 0/0 00010000:00010000:0.0:1651529344.547587:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c50efc lrc: 1/0,0 mode: --/PW res: [0x2b67b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547590:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022a9b983/0x3234de053c50efc lrc: 0/0,0 mode: --/PW res: [0x2b67b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.547591:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211341 00010000:00010000:0.0:1651529344.547594:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50f0a lrc: 2/0,0 mode: PW/PW res: [0x2b67d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547597:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eb2009d7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.547598:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50f0a lrc: 2/0,0 mode: PW/PW res: [0x2b67d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547601:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50f0a lrc: 3/0,0 mode: PW/PW res: [0x2b67d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547604:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50f0a lrc: 1/0,0 mode: --/PW res: [0x2b67d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547606:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50f0a lrc: 0/0,0 mode: --/PW res: [0x2b67d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547610:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c50f03 lrc: 2/0,0 mode: PW/PW res: [0x2b67e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547612:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000010b0a5e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.547613:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c50f03 lrc: 2/0,0 mode: PW/PW res: [0x2b67e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547616:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c50f03 lrc: 3/0,0 mode: PW/PW res: [0x2b67e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547619:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c50f03 lrc: 1/0,0 mode: --/PW res: [0x2b67e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547621:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000010b0a5e/0x3234de053c50f03 lrc: 0/0,0 mode: --/PW res: [0x2b67e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.547626:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.547645:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946428544 00000100:00100000:0.0:1651529344.547648:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.547662:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946428480 00000100:00100000:1.0:1651529344.547669:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211343 00000100:00100000:1.0:1651529344.547671:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+838:39030:x1731745946428544:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.547676:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177792 count 1 00000100:00100000:0.0:1651529344.547676:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.547681:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50f11 lrc: 3/0,1 mode: --/PW res: [0x2b680:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.547686:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000068accb78/0x3234de053c4de73 lrc: 2/0,0 mode: PR/PR res: [0x2b680:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a86 expref: 1222 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.547689:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.547689:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.547690:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50f11 lrc: 4/0,1 mode: --/PW res: [0x2b680:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.547700:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.547710:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000068accb78/0x3234de053c4de73 lrc: 3/0,0 mode: PR/PR res: [0x2b680:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a86 expref: 1222 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.547711:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946428672 00010000:00010000:1.0:1651529344.547714:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000068accb78/0x3234de053c4de73 lrc: 4/0,0 mode: PR/PR res: [0x2b680:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a86 expref: 1222 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.547720:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946428608 00000100:00100000:1.0:1651529344.547723:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d28c414b pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996992704:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.547725:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211344 00000100:00100000:0.0:1651529344.547726:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+840:39029:x1731745946428480:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.547732:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177791 count 1 00000100:00100000:1.0:1651529344.547744:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a6b79b05 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.547749:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50f18 lrc: 3/0,1 mode: --/PW res: [0x2b67f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.547751:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211345 00000100:00100000:1.0:1651529344.547753:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+840:39030:x1731745946428672:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.547754:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f554f6e2/0x3234de053c4cecf lrc: 2/0,0 mode: PR/PR res: [0x2b67f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced2a expref: 1222 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.547757:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1651529344.547758:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177794 count 1 00010000:00010000:0.0:1651529344.547758:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.547759:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50f18 lrc: 4/0,1 mode: --/PW res: [0x2b67f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.547762:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50f1f lrc: 3/0,1 mode: --/PW res: [0x2b682:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.547766:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003eacebea/0x3234de053c4dd77 lrc: 2/0,0 mode: PR/PR res: [0x2b682:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2714 expref: 1222 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.547766:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f554f6e2/0x3234de053c4cecf lrc: 3/0,0 mode: PR/PR res: [0x2b67f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced2a expref: 1222 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.547769:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f554f6e2/0x3234de053c4cecf lrc: 4/0,0 mode: PR/PR res: [0x2b67f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced2a expref: 1222 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.547770:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.547770:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.547771:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50f1f lrc: 4/0,1 mode: --/PW res: [0x2b682:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.547773:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000264aecf8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996992768:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.547777:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003eacebea/0x3234de053c4dd77 lrc: 3/0,0 mode: PR/PR res: [0x2b682:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2714 expref: 1222 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.547781:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003eacebea/0x3234de053c4dd77 lrc: 4/0,0 mode: PR/PR res: [0x2b682:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2714 expref: 1222 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.547783:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 0000000009370c1d going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.547785:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f39ca9ea pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996992832:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.547790:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211346 00000100:00100000:0.0:1651529344.547792:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+840:39029:x1731745946428608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.547793:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000412e5d26 going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.547797:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177793 count 1 00010000:00010000:0.0:1651529344.547800:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50f26 lrc: 3/0,1 mode: --/PW res: [0x2b681:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547804:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c4deea lrc: 2/0,0 mode: PR/PR res: [0x2b681:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c85 expref: 1222 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.547807:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.547808:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.547808:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50f26 lrc: 4/0,1 mode: --/PW res: [0x2b681:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.547814:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c4deea lrc: 3/0,0 mode: PR/PR res: [0x2b681:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c85 expref: 1222 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.547817:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c4deea lrc: 4/0,0 mode: PR/PR res: [0x2b681:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c85 expref: 1222 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.547821:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004bb67ba4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996992896:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.547828:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a3b00cf3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.548043:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.548056:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.548062:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.548062:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946428800 00000100:00100000:1.0:1651529344.548069:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.548073:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946428736 00000100:00100000:1.0:1651529344.548084:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946428928 00000100:00100000:0.0:1651529344.548085:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946428864 00000100:00100000:0.0:1651529344.548092:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211347 00000100:00100000:0.0:1651529344.548094:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+844:39030:x1731745946428800:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.548099:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211348 00002000:00080000:0.0:1651529344.548099:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177796 count 1 00000100:00100000:1.0:1651529344.548100:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+844:39029:x1731745946428736:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.548104:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50f2d lrc: 3/0,1 mode: --/PW res: [0x2b684:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.548106:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177795 count 1 00010000:00010000:0.0:1651529344.548108:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000016a5c698/0x3234de053c4cb87 lrc: 2/0,0 mode: PR/PR res: [0x2b684:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce00a expref: 1222 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.548110:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50f34 lrc: 3/0,1 mode: --/PW res: [0x2b683:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548111:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.548112:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.548113:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50f2d lrc: 4/0,1 mode: --/PW res: [0x2b684:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.548115:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c63a3577/0x3234de053c4ef8a lrc: 2/0,0 mode: PR/PR res: [0x2b683:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d70a2 expref: 1222 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.548118:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.548118:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.548119:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50f34 lrc: 4/0,1 mode: --/PW res: [0x2b683:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548119:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000016a5c698/0x3234de053c4cb87 lrc: 3/0,0 mode: PR/PR res: [0x2b684:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce00a expref: 1222 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.548122:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000016a5c698/0x3234de053c4cb87 lrc: 4/0,0 mode: PR/PR res: [0x2b684:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce00a expref: 1222 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.548126:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c63a3577/0x3234de053c4ef8a lrc: 3/0,0 mode: PR/PR res: [0x2b683:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d70a2 expref: 1222 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.548126:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000034e35367 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996992960:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.548129:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c63a3577/0x3234de053c4ef8a lrc: 4/0,0 mode: PR/PR res: [0x2b683:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d70a2 expref: 1222 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.548133:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fe004e2b pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996993024:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.548138:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bff8744a going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.548142:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b7af823 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.548144:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211349 00000100:00100000:0.0:1651529344.548145:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+844:39029:x1731745946428864:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.548149:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211350 00000100:00100000:1.0:1651529344.548150:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+844:39030:x1731745946428928:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.548150:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177797 count 1 00010000:00010000:0.0:1651529344.548153:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e05029b/0x3234de053c50f3b lrc: 3/0,1 mode: --/PW res: [0x2b685:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.548154:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177798 count 1 00010000:00010000:1.0:1651529344.548157:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50f42 lrc: 3/0,1 mode: --/PW res: [0x2b686:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548157:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000475f42fd/0x3234de053c4e263 lrc: 2/0,0 mode: PR/PR res: [0x2b685:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ad9 expref: 1222 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.548160:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.548161:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d9068558/0x3234de053c4da0c lrc: 2/0,0 mode: PR/PR res: [0x2b686:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d18c7 expref: 1222 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.548161:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.548161:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e05029b/0x3234de053c50f3b lrc: 4/0,1 mode: --/PW res: [0x2b685:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.548165:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.548165:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.548166:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50f42 lrc: 4/0,1 mode: --/PW res: [0x2b686:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548167:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000475f42fd/0x3234de053c4e263 lrc: 3/0,0 mode: PR/PR res: [0x2b685:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ad9 expref: 1222 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.548172:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d9068558/0x3234de053c4da0c lrc: 3/0,0 mode: PR/PR res: [0x2b686:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d18c7 expref: 1222 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.548175:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d9068558/0x3234de053c4da0c lrc: 4/0,0 mode: PR/PR res: [0x2b686:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d18c7 expref: 1222 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.548179:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000093ddaf92 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996993152:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.548194:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 000000007d8fabda going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.548199:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000475f42fd/0x3234de053c4e263 lrc: 4/0,0 mode: PR/PR res: [0x2b685:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ad9 expref: 1222 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.548204:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000913beefe pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996993088:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.548213:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000003ad73843 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.548252:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d28c414b pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996992704:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.548257:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50f11 lrc: 3/0,1 mode: --/PW res: [0x2b680:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.548295:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000264aecf8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996992768:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.548302:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.548305:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50f18 lrc: 3/0,1 mode: --/PW res: [0x2b67f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.548309:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.548316:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.548323:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.548331:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004bb67ba4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996992896:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.548333:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f39ca9ea pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996992832:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.548335:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50f26 lrc: 3/0,1 mode: --/PW res: [0x2b681:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.548337:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50f1f lrc: 3/0,1 mode: --/PW res: [0x2b682:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.548342:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396309632 00000100:00100000:1.0:1651529344.548346:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396309696 00010000:00010000:0.0:1651529344.548348:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000068accb78/0x3234de053c4de73 lrc: 4/0,0 mode: PR/PR res: [0x2b680:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a86 expref: 1224 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.548351:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f554f6e2/0x3234de053c4cecf lrc: 4/0,0 mode: PR/PR res: [0x2b67f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced2a expref: 1224 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.548356:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396309824 00000100:00100000:0.0:1651529344.548356:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396309760 00010000:00010000:1.0:1651529344.548358:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c4deea lrc: 4/0,0 mode: PR/PR res: [0x2b681:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c85 expref: 1226 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.548358:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003eacebea/0x3234de053c4dd77 lrc: 4/0,0 mode: PR/PR res: [0x2b682:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2714 expref: 1226 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.548363:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12125 00000100:00100000:0.0:1651529344.548365:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1226:41279:x1731746396309632:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.548366:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12126 00000100:00100000:1.0:1651529344.548367:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1226:41279:x1731746396309696:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.548368:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.548370:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.548370:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000068accb78/0x3234de053c4de73 lrc: 4/0,0 mode: PR/PR res: [0x2b680:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a86 expref: 1226 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.548371:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f554f6e2/0x3234de053c4cecf lrc: 4/0,0 mode: PR/PR res: [0x2b67f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced2a expref: 1226 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.548374:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000068accb78/0x3234de053c4de73 lrc: 3/0,0 mode: PR/PR res: [0x2b680:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a86 expref: 1226 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.548375:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f554f6e2/0x3234de053c4cecf lrc: 3/0,0 mode: PR/PR res: [0x2b67f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced2a expref: 1226 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.548379:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068accb78/0x3234de053c4de73 lrc: 0/0,0 mode: --/PR res: [0x2b680:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a86 expref: 1226 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.548380:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f554f6e2/0x3234de053c4cecf lrc: 0/0,0 mode: --/PR res: [0x2b67f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced2a expref: 1226 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.548383:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.548383:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.548384:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.548384:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50f11 lrc: 3/0,1 mode: PW/PW res: [0x2b680:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.548385:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.548385:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50f18 lrc: 3/0,1 mode: PW/PW res: [0x2b67f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548387:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50f11 lrc: 4/0,1 mode: PW/PW res: [0x2b680:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.548388:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50f18 lrc: 4/0,1 mode: PW/PW res: [0x2b67f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548401:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.548402:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.548429:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1224:41279:x1731746396309696:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 61us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.548432:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12126 00000100:00100000:0.0:1651529344.548434:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1224:41279:x1731746396309632:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 67us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.548437:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12125 00000100:00100000:1.0:1651529344.548439:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12127 00000100:00100000:1.0:1651529344.548441:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e3dc394f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1222:41278:x1731746396309760:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.548443:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.548443:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12128 00010000:00010000:1.0:1651529344.548445:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003eacebea/0x3234de053c4dd77 lrc: 4/0,0 mode: PR/PR res: [0x2b682:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2714 expref: 1222 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.548445:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a13808c6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1222:41278:x1731746396309824:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.548447:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.548449:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003eacebea/0x3234de053c4dd77 lrc: 3/0,0 mode: PR/PR res: [0x2b682:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2714 expref: 1222 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.548449:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c4deea lrc: 4/0,0 mode: PR/PR res: [0x2b681:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c85 expref: 1222 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.548453:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003eacebea/0x3234de053c4dd77 lrc: 0/0,0 mode: --/PR res: [0x2b682:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2714 expref: 1222 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.548453:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c4deea lrc: 3/0,0 mode: PR/PR res: [0x2b681:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c85 expref: 1222 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.548457:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.548457:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.548458:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50f1f lrc: 3/0,1 mode: PW/PW res: [0x2b682:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548458:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c4deea lrc: 0/0,0 mode: --/PR res: [0x2b681:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2c85 expref: 1221 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.548461:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50f1f lrc: 4/0,1 mode: PW/PW res: [0x2b682:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548462:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.548462:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.548463:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50f26 lrc: 3/0,1 mode: PW/PW res: [0x2b681:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548466:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50f26 lrc: 4/0,1 mode: PW/PW res: [0x2b681:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.548467:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.548472:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e3dc394f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1220:41278:x1731746396309760:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 31us (155us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.548473:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.548474:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12127 00000100:00100000:0.0:1651529344.548479:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a13808c6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1219:41278:x1731746396309824:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.548481:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12128 00010000:00010000:1.0:1651529344.548485:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50f11 lrc: 3/0,1 mode: PW/PW res: [0x2b680:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548488:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50f26 lrc: 3/0,1 mode: PW/PW res: [0x2b681:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.548489:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50f11 lrc: 3/0,1 mode: PW/PW res: [0x2b680:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548491:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50f26 lrc: 3/0,1 mode: PW/PW res: [0x2b681:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.548492:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50f11 lrc: 3/0,1 mode: PW/PW res: [0x2b680:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.548494:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50f11 lrc: 2/0,0 mode: PW/PW res: [0x2b680:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548494:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50f26 lrc: 3/0,1 mode: PW/PW res: [0x2b681:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548497:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50f26 lrc: 2/0,0 mode: PW/PW res: [0x2b681:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.548538:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+846:39030:x1731745946428544:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 866us (911us total) trans 12885079398 rc 0/0 00000100:00100000:1.0:1651529344.548541:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211343 00010000:00010000:1.0:1651529344.548547:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50f1f lrc: 3/0,1 mode: PW/PW res: [0x2b682:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.548547:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+845:39029:x1731745946428608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 753us (846us total) trans 12885079399 rc 0/0 00000100:00100000:0.0:1651529344.548550:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211346 00010000:00010000:1.0:1651529344.548551:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50f1f lrc: 3/0,1 mode: PW/PW res: [0x2b682:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.548554:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50f1f lrc: 3/0,1 mode: PW/PW res: [0x2b682:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.548556:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50f1f lrc: 2/0,0 mode: PW/PW res: [0x2b682:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548557:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50f11 lrc: 2/0,0 mode: PW/PW res: [0x2b680:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548560:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dc65d2aa already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.548561:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50f11 lrc: 2/0,0 mode: PW/PW res: [0x2b680:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548564:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50f11 lrc: 3/0,0 mode: PW/PW res: [0x2b680:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548576:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50f11 lrc: 1/0,0 mode: --/PW res: [0x2b680:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548579:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c50f11 lrc: 0/0,0 mode: --/PW res: [0x2b680:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.548599:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+845:39030:x1731745946428672:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 845us (923us total) trans 12885079400 rc 0/0 00000100:00100000:1.0:1651529344.548602:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211345 00010000:00010000:0.0:1651529344.548604:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50f26 lrc: 2/0,0 mode: PW/PW res: [0x2b681:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548607:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d9ada8a3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.548608:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50f26 lrc: 2/0,0 mode: PW/PW res: [0x2b681:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548618:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50f26 lrc: 3/0,0 mode: PW/PW res: [0x2b681:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548622:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50f26 lrc: 1/0,0 mode: --/PW res: [0x2b681:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548625:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50f26 lrc: 0/0,0 mode: --/PW res: [0x2b681:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548629:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50f1f lrc: 2/0,0 mode: PW/PW res: [0x2b682:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548632:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cff76789 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.548632:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50f1f lrc: 2/0,0 mode: PW/PW res: [0x2b682:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548635:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50f1f lrc: 3/0,0 mode: PW/PW res: [0x2b682:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548638:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50f1f lrc: 1/0,0 mode: --/PW res: [0x2b682:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548647:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c50f1f lrc: 0/0,0 mode: --/PW res: [0x2b682:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548654:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50f18 lrc: 3/0,1 mode: PW/PW res: [0x2b67f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548656:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50f18 lrc: 3/0,1 mode: PW/PW res: [0x2b67f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548659:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50f18 lrc: 3/0,1 mode: PW/PW res: [0x2b67f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548662:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50f18 lrc: 2/0,0 mode: PW/PW res: [0x2b67f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.548678:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.548689:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.548710:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+845:39029:x1731745946428480:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 983us (1061us total) trans 12885079401 rc 0/0 00000100:00100000:0.0:1651529344.548713:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211344 00000100:00100000:1.0:1651529344.548718:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.548720:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50f18 lrc: 2/0,0 mode: PW/PW res: [0x2b67f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548723:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009880d77c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.548724:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50f18 lrc: 2/0,0 mode: PW/PW res: [0x2b67f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548727:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50f18 lrc: 3/0,0 mode: PW/PW res: [0x2b67f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548732:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50f18 lrc: 1/0,0 mode: --/PW res: [0x2b67f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548745:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50f18 lrc: 0/0,0 mode: --/PW res: [0x2b67f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.548753:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.548756:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000913beefe pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996993088:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.548760:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003e05029b/0x3234de053c50f3b lrc: 3/0,1 mode: --/PW res: [0x2b685:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.548782:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fe004e2b pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996993024:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.548783:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000034e35367 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996992960:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.548786:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50f34 lrc: 3/0,1 mode: --/PW res: [0x2b683:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548787:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50f2d lrc: 3/0,1 mode: --/PW res: [0x2b684:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.548793:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000093ddaf92 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996993152:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.548794:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396309888 00010000:00010000:1.0:1651529344.548796:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50f42 lrc: 3/0,1 mode: --/PW res: [0x2b686:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548799:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000016a5c698/0x3234de053c4cb87 lrc: 4/0,0 mode: PR/PR res: [0x2b684:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce00a expref: 1219 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.548802:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396309952 00000100:00100000:0.0:1651529344.548804:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396310016 00010000:00010000:1.0:1651529344.548807:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c63a3577/0x3234de053c4ef8a lrc: 4/0,0 mode: PR/PR res: [0x2b683:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d70a2 expref: 1221 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.548807:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d9068558/0x3234de053c4da0c lrc: 4/0,0 mode: PR/PR res: [0x2b686:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d18c7 expref: 1221 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.548812:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396310080 00000100:00100000:1.0:1651529344.548813:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12129 00000100:00100000:1.0:1651529344.548814:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1222:41279:x1731746396309888:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.548814:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000475f42fd/0x3234de053c4e263 lrc: 4/0,0 mode: PR/PR res: [0x2b685:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ad9 expref: 1222 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.548817:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.548819:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000016a5c698/0x3234de053c4cb87 lrc: 4/0,0 mode: PR/PR res: [0x2b684:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce00a expref: 1222 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.548821:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12130 00000100:00100000:0.0:1651529344.548823:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1222:41279:x1731746396309952:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.548825:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000016a5c698/0x3234de053c4cb87 lrc: 3/0,0 mode: PR/PR res: [0x2b684:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce00a expref: 1222 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.548826:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.548827:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c63a3577/0x3234de053c4ef8a lrc: 4/0,0 mode: PR/PR res: [0x2b683:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d70a2 expref: 1222 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.548831:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016a5c698/0x3234de053c4cb87 lrc: 0/0,0 mode: --/PR res: [0x2b684:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce00a expref: 1222 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.548831:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c63a3577/0x3234de053c4ef8a lrc: 3/0,0 mode: PR/PR res: [0x2b683:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d70a2 expref: 1222 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.548834:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.548835:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.548836:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50f2d lrc: 3/0,1 mode: PW/PW res: [0x2b684:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548836:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c63a3577/0x3234de053c4ef8a lrc: 0/0,0 mode: --/PR res: [0x2b683:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d70a2 expref: 1221 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.548839:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50f2d lrc: 4/0,1 mode: PW/PW res: [0x2b684:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548839:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.548840:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.548841:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50f34 lrc: 3/0,1 mode: PW/PW res: [0x2b683:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548844:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50f34 lrc: 4/0,1 mode: PW/PW res: [0x2b683:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.548849:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.548861:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.548863:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1220:41279:x1731746396309888:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 43us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.548866:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12129 00000100:00100000:0.0:1651529344.548869:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1220:41279:x1731746396309952:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 45us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.548871:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12131 00000100:00100000:1.0:1651529344.548873:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1219:41278:x1731746396310016:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.548873:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12130 00010000:00010000:1.0:1651529344.548876:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.548878:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d9068558/0x3234de053c4da0c lrc: 4/0,0 mode: PR/PR res: [0x2b686:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d18c7 expref: 1218 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.548878:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12132 00000100:00100000:0.0:1651529344.548880:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1218:41278:x1731746396310080:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.548881:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d9068558/0x3234de053c4da0c lrc: 3/0,0 mode: PR/PR res: [0x2b686:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d18c7 expref: 1218 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.548882:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.548884:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000475f42fd/0x3234de053c4e263 lrc: 4/0,0 mode: PR/PR res: [0x2b685:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ad9 expref: 1218 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.548886:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9068558/0x3234de053c4da0c lrc: 0/0,0 mode: --/PR res: [0x2b686:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d18c7 expref: 1218 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.548888:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000475f42fd/0x3234de053c4e263 lrc: 3/0,0 mode: PR/PR res: [0x2b685:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ad9 expref: 1218 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.548890:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.548890:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.548891:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50f42 lrc: 3/0,1 mode: PW/PW res: [0x2b686:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548893:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000475f42fd/0x3234de053c4e263 lrc: 0/0,0 mode: --/PR res: [0x2b685:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ad9 expref: 1217 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.548894:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50f42 lrc: 4/0,1 mode: PW/PW res: [0x2b686:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548896:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.548897:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.548898:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003e05029b/0x3234de053c50f3b lrc: 3/0,1 mode: PW/PW res: [0x2b685:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.548900:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.548900:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e05029b/0x3234de053c50f3b lrc: 4/0,1 mode: PW/PW res: [0x2b685:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.548906:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1216:41278:x1731746396310016:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 32us (188us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.548907:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.548908:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12131 00000100:00100000:0.0:1651529344.548911:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1215:41278:x1731746396310080:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 31us (159us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.548914:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50f42 lrc: 3/0,1 mode: PW/PW res: [0x2b686:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.548914:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12132 00010000:00010000:1.0:1651529344.548918:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50f42 lrc: 3/0,1 mode: PW/PW res: [0x2b686:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.548921:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50f42 lrc: 3/0,1 mode: PW/PW res: [0x2b686:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.548923:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50f42 lrc: 2/0,0 mode: PW/PW res: [0x2b686:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548949:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003e05029b/0x3234de053c50f3b lrc: 3/0,1 mode: PW/PW res: [0x2b685:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548953:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e05029b/0x3234de053c50f3b lrc: 3/0,1 mode: PW/PW res: [0x2b685:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548959:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e05029b/0x3234de053c50f3b lrc: 3/0,1 mode: PW/PW res: [0x2b685:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.548961:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e05029b/0x3234de053c50f3b lrc: 2/0,0 mode: PW/PW res: [0x2b685:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.548968:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+845:39030:x1731745946428928:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 817us (906us total) trans 12885079402 rc 0/0 00000100:00100000:1.0:1651529344.548971:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211350 00010000:00010000:1.0:1651529344.548977:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50f34 lrc: 3/0,1 mode: PW/PW res: [0x2b683:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.548981:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50f34 lrc: 3/0,1 mode: PW/PW res: [0x2b683:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.548984:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50f34 lrc: 3/0,1 mode: PW/PW res: [0x2b683:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.548987:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50f34 lrc: 2/0,0 mode: PW/PW res: [0x2b683:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.549008:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+846:39029:x1731745946428864:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 862us (938us total) trans 12885079403 rc 0/0 00000100:00100000:0.0:1651529344.549011:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211349 00010000:00010000:0.0:1651529344.549018:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50f42 lrc: 2/0,0 mode: PW/PW res: [0x2b686:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549021:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2a2495 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.549022:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50f42 lrc: 2/0,0 mode: PW/PW res: [0x2b686:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.549023:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+845:39029:x1731745946428736:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 922us (967us total) trans 12885079404 rc 0/0 00000100:00100000:1.0:1651529344.549026:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211348 00010000:00010000:0.0:1651529344.549026:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50f42 lrc: 3/0,0 mode: PW/PW res: [0x2b686:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549030:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50f42 lrc: 1/0,0 mode: --/PW res: [0x2b686:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549033:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c50f42 lrc: 0/0,0 mode: --/PW res: [0x2b686:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549037:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e05029b/0x3234de053c50f3b lrc: 2/0,0 mode: PW/PW res: [0x2b685:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549040:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003e05029b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.549041:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e05029b/0x3234de053c50f3b lrc: 2/0,0 mode: PW/PW res: [0x2b685:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549044:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e05029b/0x3234de053c50f3b lrc: 3/0,0 mode: PW/PW res: [0x2b685:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549047:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e05029b/0x3234de053c50f3b lrc: 1/0,0 mode: --/PW res: [0x2b685:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549049:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e05029b/0x3234de053c50f3b lrc: 0/0,0 mode: --/PW res: [0x2b685:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549053:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50f34 lrc: 2/0,0 mode: PW/PW res: [0x2b683:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549055:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f27c804 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.549056:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50f34 lrc: 2/0,0 mode: PW/PW res: [0x2b683:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549058:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50f34 lrc: 3/0,0 mode: PW/PW res: [0x2b683:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.549061:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.549061:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50f34 lrc: 1/0,0 mode: --/PW res: [0x2b683:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549064:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c50f34 lrc: 0/0,0 mode: --/PW res: [0x2b683:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549070:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50f2d lrc: 3/0,1 mode: PW/PW res: [0x2b684:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549073:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50f2d lrc: 3/0,1 mode: PW/PW res: [0x2b684:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.549074:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.549076:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50f2d lrc: 3/0,1 mode: PW/PW res: [0x2b684:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549085:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50f2d lrc: 2/0,0 mode: PW/PW res: [0x2b684:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.549089:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.549099:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.549126:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+845:39030:x1731745946428800:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1031us (1083us total) trans 12885079405 rc 0/0 00000100:00100000:0.0:1651529344.549129:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211347 00000100:00100000:0.0:1651529344.549134:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946429312 00000100:00100000:0.0:1651529344.549144:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946429376 00000100:00100000:0.0:1651529344.549148:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946429696 00000100:00100000:0.0:1651529344.549153:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946429632 00000100:00100000:0.0:1651529344.549158:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211351 00000100:00100000:0.0:1651529344.549159:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+848:39030:x1731745946429312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.549163:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211352 00000100:00100000:1.0:1651529344.549165:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+848:39029:x1731745946429376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.549171:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177800 count 1 00010000:00010000:1.0:1651529344.549176:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c50f49 lrc: 3/0,1 mode: --/PW res: [0x2b688:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.549181:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008153e4d5/0x3234de053c4ea19 lrc: 2/0,0 mode: PR/PR res: [0x2b688:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d59f7 expref: 1214 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.549182:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177799 count 1 00010000:00010000:1.0:1651529344.549184:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.549185:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.549185:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c50f49 lrc: 4/0,1 mode: --/PW res: [0x2b688:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549186:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50f50 lrc: 3/0,1 mode: --/PW res: [0x2b687:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549191:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e2f53db9/0x3234de053c4dd07 lrc: 2/0,0 mode: PR/PR res: [0x2b687:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d24b3 expref: 1214 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.549192:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008153e4d5/0x3234de053c4ea19 lrc: 3/0,0 mode: PR/PR res: [0x2b688:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d59f7 expref: 1214 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.549196:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008153e4d5/0x3234de053c4ea19 lrc: 4/0,0 mode: PR/PR res: [0x2b688:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d59f7 expref: 1214 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.549197:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.549197:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.549198:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50f50 lrc: 4/0,1 mode: --/PW res: [0x2b687:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.549200:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f39ca9ea pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996993216:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.549205:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e2f53db9/0x3234de053c4dd07 lrc: 3/0,0 mode: PR/PR res: [0x2b687:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d24b3 expref: 1214 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.549208:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e2f53db9/0x3234de053c4dd07 lrc: 4/0,0 mode: PR/PR res: [0x2b687:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d24b3 expref: 1214 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.549210:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 0000000099c1da85 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.549212:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000034e35367 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996993280:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.549216:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211353 00000100:00100000:1.0:1651529344.549218:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+848:39030:x1731745946429696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.549221:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060852af0 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.549238:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177802 count 1 00010000:00010000:1.0:1651529344.549242:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c50f57 lrc: 3/0,1 mode: --/PW res: [0x2b68a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.549246:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a1517c27/0x3234de053c4f4d8 lrc: 2/0,0 mode: PR/PR res: [0x2b68a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85e8 expref: 1214 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.549246:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50f2d lrc: 2/0,0 mode: PW/PW res: [0x2b684:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549249:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000034aad4d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.549250:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50f2d lrc: 2/0,0 mode: PW/PW res: [0x2b684:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.549252:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.549252:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.549253:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c50f57 lrc: 4/0,1 mode: --/PW res: [0x2b68a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549253:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50f2d lrc: 3/0,0 mode: PW/PW res: [0x2b684:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549258:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50f2d lrc: 1/0,0 mode: --/PW res: [0x2b684:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.549259:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a1517c27/0x3234de053c4f4d8 lrc: 3/0,0 mode: PR/PR res: [0x2b68a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85e8 expref: 1214 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.549263:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a1517c27/0x3234de053c4f4d8 lrc: 4/0,0 mode: PR/PR res: [0x2b68a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85e8 expref: 1214 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.549264:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c50f2d lrc: 0/0,0 mode: --/PW res: [0x2b684:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.549267:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d28c414b pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996993344:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.549271:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211354 00000100:00100000:0.0:1651529344.549273:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+848:39030:x1731745946429632:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.549274:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b7af823 going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.549293:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177801 count 1 00000100:00100000:1.0:1651529344.549297:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.549297:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c50f5e lrc: 3/0,1 mode: --/PW res: [0x2b689:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549312:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000955978ce/0x3234de053c4e5a4 lrc: 2/0,0 mode: PR/PR res: [0x2b689:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d47dd expref: 1214 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.549315:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.549316:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.549317:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c50f5e lrc: 4/0,1 mode: --/PW res: [0x2b689:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549324:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000955978ce/0x3234de053c4e5a4 lrc: 3/0,0 mode: PR/PR res: [0x2b689:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d47dd expref: 1214 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.549327:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000955978ce/0x3234de053c4e5a4 lrc: 4/0,0 mode: PR/PR res: [0x2b689:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d47dd expref: 1214 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.549331:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000913beefe pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996993408:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.549340:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b81e4a0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.549341:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.549347:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946429760 00000100:00100000:0.0:1651529344.549353:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946429824 00000100:00100000:0.0:1651529344.549362:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211355 00000100:00100000:0.0:1651529344.549364:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+850:39029:x1731745946429760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.549369:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177803 count 1 00010000:00010000:0.0:1651529344.549372:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50f65 lrc: 3/0,1 mode: --/PW res: [0x2b68b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549377:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006c9dd8e6/0x3234de053c4f659 lrc: 2/0,0 mode: PR/PR res: [0x2b68b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c24 expref: 1214 pid: 156655 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.549378:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.549380:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.549380:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.549381:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50f65 lrc: 4/0,1 mode: --/PW res: [0x2b68b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.549385:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.549387:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006c9dd8e6/0x3234de053c4f659 lrc: 3/0,0 mode: PR/PR res: [0x2b68b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c24 expref: 1214 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.549390:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006c9dd8e6/0x3234de053c4f659 lrc: 4/0,0 mode: PR/PR res: [0x2b68b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c24 expref: 1214 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.549391:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946429888 00000100:00100000:0.0:1651529344.549394:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004bb67ba4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996993472:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.549396:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946429952 00000100:00100000:1.0:1651529344.549399:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211356 00000100:00100000:1.0:1651529344.549401:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+852:39030:x1731745946429824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.549406:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177804 count 1 00010000:00010000:1.0:1651529344.549410:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50f6c lrc: 3/0,1 mode: --/PW res: [0x2b68c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.549414:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c16957d8/0x3234de053c4f533 lrc: 2/0,0 mode: PR/PR res: [0x2b68c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d872a expref: 1214 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.549418:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.549418:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.549419:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50f6c lrc: 4/0,1 mode: --/PW res: [0x2b68c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.549422:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000000a4def41 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.549430:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211357 00000100:00100000:0.0:1651529344.549431:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+852:39029:x1731745946429888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.549433:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c16957d8/0x3234de053c4f533 lrc: 3/0,0 mode: PR/PR res: [0x2b68c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d872a expref: 1214 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.549437:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c16957d8/0x3234de053c4f533 lrc: 4/0,0 mode: PR/PR res: [0x2b68c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d872a expref: 1214 pid: 156655 timeout: 20103 lvb_type: 1 00002000:00080000:0.0:1651529344.549437:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177805 count 1 00010000:00010000:0.0:1651529344.549440:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50f73 lrc: 3/0,1 mode: --/PW res: [0x2b68d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.549441:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003e3f0f77 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996993536:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.549445:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000928e420a/0x3234de053c4c6a2 lrc: 2/0,0 mode: PR/PR res: [0x2b68d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc61 expref: 1214 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.549448:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.549449:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.549449:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.549449:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50f73 lrc: 4/0,1 mode: --/PW res: [0x2b68d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.549455:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211358 00010000:00010000:0.0:1651529344.549456:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000928e420a/0x3234de053c4c6a2 lrc: 3/0,0 mode: PR/PR res: [0x2b68d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc61 expref: 1214 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.549457:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+852:39030:x1731745946429952:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.549459:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000928e420a/0x3234de053c4c6a2 lrc: 4/0,0 mode: PR/PR res: [0x2b68d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc61 expref: 1214 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:1.0:1651529344.549461:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177806 count 1 00000100:00100000:0.0:1651529344.549463:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000264aecf8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996993600:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.549465:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50f7a lrc: 3/0,1 mode: --/PW res: [0x2b68e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.549469:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bc83f98f/0x3234de053c4dbbe lrc: 2/0,0 mode: PR/PR res: [0x2b68e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1efc expref: 1214 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.549471:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 000000008dd99533 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.549472:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.549473:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.549474:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50f7a lrc: 4/0,1 mode: --/PW res: [0x2b68e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.549482:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bc83f98f/0x3234de053c4dbbe lrc: 3/0,0 mode: PR/PR res: [0x2b68e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1efc expref: 1214 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.549486:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bc83f98f/0x3234de053c4dbbe lrc: 4/0,0 mode: PR/PR res: [0x2b68e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1efc expref: 1214 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.549489:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000078a40aa9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996993664:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.549495:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b52d0f36 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.549553:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f39ca9ea pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996993216:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.549557:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c50f49 lrc: 3/0,1 mode: --/PW res: [0x2b688:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.549583:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000034e35367 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996993280:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.549586:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d28c414b pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996993344:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.549588:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50f50 lrc: 3/0,1 mode: --/PW res: [0x2b687:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.549590:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c50f57 lrc: 3/0,1 mode: --/PW res: [0x2b68a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.549755:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.549767:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.549774:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.549784:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.549786:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396310656 00010000:00010000:1.0:1651529344.549795:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008153e4d5/0x3234de053c4ea19 lrc: 4/0,0 mode: PR/PR res: [0x2b688:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d59f7 expref: 1215 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.549795:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000913beefe pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996993408:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.549800:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c50f5e lrc: 3/0,1 mode: --/PW res: [0x2b689:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.549801:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396310784 00010000:00010000:1.0:1651529344.549803:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e2f53db9/0x3234de053c4dd07 lrc: 4/0,0 mode: PR/PR res: [0x2b687:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d24b3 expref: 1216 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.549807:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396310720 00000100:00100000:1.0:1651529344.549808:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396310848 00010000:00010000:1.0:1651529344.549810:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000955978ce/0x3234de053c4e5a4 lrc: 4/0,0 mode: PR/PR res: [0x2b689:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d47dd expref: 1218 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.549812:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a1517c27/0x3234de053c4f4d8 lrc: 4/0,0 mode: PR/PR res: [0x2b68a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85e8 expref: 1218 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.549815:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12133 00000100:00100000:1.0:1651529344.549817:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1218:41279:x1731746396310656:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.549819:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.549819:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12134 00000100:00100000:0.0:1651529344.549820:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001743f524 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1218:41279:x1731746396310784:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.549821:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008153e4d5/0x3234de053c4ea19 lrc: 4/0,0 mode: PR/PR res: [0x2b688:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d59f7 expref: 1218 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.549823:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.549824:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008153e4d5/0x3234de053c4ea19 lrc: 3/0,0 mode: PR/PR res: [0x2b688:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d59f7 expref: 1218 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.549825:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e2f53db9/0x3234de053c4dd07 lrc: 4/0,0 mode: PR/PR res: [0x2b687:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d24b3 expref: 1218 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.549828:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e2f53db9/0x3234de053c4dd07 lrc: 3/0,0 mode: PR/PR res: [0x2b687:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d24b3 expref: 1218 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.549830:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008153e4d5/0x3234de053c4ea19 lrc: 0/0,0 mode: --/PR res: [0x2b688:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d59f7 expref: 1218 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.549834:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.549834:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.549834:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2f53db9/0x3234de053c4dd07 lrc: 0/0,0 mode: --/PR res: [0x2b687:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d24b3 expref: 1217 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.549835:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c50f49 lrc: 3/0,1 mode: PW/PW res: [0x2b688:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.549838:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c50f49 lrc: 4/0,1 mode: PW/PW res: [0x2b688:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549838:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.549838:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.549839:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50f50 lrc: 3/0,1 mode: PW/PW res: [0x2b687:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549842:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50f50 lrc: 4/0,1 mode: PW/PW res: [0x2b687:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.549844:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.549851:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.549853:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1216:41279:x1731746396310656:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.549855:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12133 00000100:00100000:0.0:1651529344.549858:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001743f524 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1215:41279:x1731746396310784:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 37us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.549860:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12135 00000100:00100000:1.0:1651529344.549862:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1215:41279:x1731746396310848:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.549862:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12134 00010000:00010000:1.0:1651529344.549864:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.549865:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000955978ce/0x3234de053c4e5a4 lrc: 4/0,0 mode: PR/PR res: [0x2b689:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d47dd expref: 1214 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.549869:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000955978ce/0x3234de053c4e5a4 lrc: 3/0,0 mode: PR/PR res: [0x2b689:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d47dd expref: 1214 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.549870:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12136 00000100:00100000:0.0:1651529344.549872:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1214:41279:x1731746396310720:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.549873:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000955978ce/0x3234de053c4e5a4 lrc: 0/0,0 mode: --/PR res: [0x2b689:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d47dd expref: 1214 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.549874:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.549876:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a1517c27/0x3234de053c4f4d8 lrc: 4/0,0 mode: PR/PR res: [0x2b68a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85e8 expref: 1214 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.549877:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.549877:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.549878:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c50f5e lrc: 3/0,1 mode: PW/PW res: [0x2b689:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549880:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a1517c27/0x3234de053c4f4d8 lrc: 3/0,0 mode: PR/PR res: [0x2b68a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85e8 expref: 1213 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.549881:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c50f5e lrc: 4/0,1 mode: PW/PW res: [0x2b689:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549884:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1517c27/0x3234de053c4f4d8 lrc: 0/0,0 mode: --/PR res: [0x2b68a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85e8 expref: 1213 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.549888:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.549891:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.549896:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.549897:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1212:41279:x1731746396310848:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 35us (113us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.549897:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c50f57 lrc: 3/0,1 mode: PW/PW res: [0x2b68a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.549900:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12135 00010000:00010000:0.0:1651529344.549900:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c50f57 lrc: 4/0,1 mode: PW/PW res: [0x2b68a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549909:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.549912:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c50f49 lrc: 3/0,1 mode: PW/PW res: [0x2b688:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.549915:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1211:41279:x1731746396310720:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (140us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.549916:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c50f49 lrc: 3/0,1 mode: PW/PW res: [0x2b688:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.549918:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12136 00010000:00010000:1.0:1651529344.549922:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c50f49 lrc: 3/0,1 mode: PW/PW res: [0x2b688:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.549924:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c50f49 lrc: 2/0,0 mode: PW/PW res: [0x2b688:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549924:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c50f5e lrc: 3/0,1 mode: PW/PW res: [0x2b689:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549928:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c50f5e lrc: 3/0,1 mode: PW/PW res: [0x2b689:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549936:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c50f5e lrc: 3/0,1 mode: PW/PW res: [0x2b689:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.549939:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c50f5e lrc: 2/0,0 mode: PW/PW res: [0x2b689:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.549971:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+854:39029:x1731745946429376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 805us (897us total) trans 12885079406 rc 0/0 00000100:00100000:1.0:1651529344.549974:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211352 00010000:00010000:1.0:1651529344.549981:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c50f57 lrc: 3/0,1 mode: PW/PW res: [0x2b68a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.549984:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c50f57 lrc: 3/0,1 mode: PW/PW res: [0x2b68a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.549987:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c50f57 lrc: 3/0,1 mode: PW/PW res: [0x2b68a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.549990:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c50f57 lrc: 2/0,0 mode: PW/PW res: [0x2b68a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.550014:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+854:39030:x1731745946429632:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 740us (915us total) trans 12885079407 rc 0/0 00000100:00100000:0.0:1651529344.550018:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211354 00010000:00010000:0.0:1651529344.550025:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c50f49 lrc: 2/0,0 mode: PW/PW res: [0x2b688:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.550028:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+853:39030:x1731745946429696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 809us (939us total) trans 12885079408 rc 0/0 00010000:00010000:0.0:1651529344.550028:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006c0ed60a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.550029:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c50f49 lrc: 2/0,0 mode: PW/PW res: [0x2b688:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.550031:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211353 00010000:00010000:0.0:1651529344.550033:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c50f49 lrc: 3/0,0 mode: PW/PW res: [0x2b688:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550037:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c50f49 lrc: 1/0,0 mode: --/PW res: [0x2b688:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550040:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c50f49 lrc: 0/0,0 mode: --/PW res: [0x2b688:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550044:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c50f5e lrc: 2/0,0 mode: PW/PW res: [0x2b689:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550047:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001630f6d1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.550048:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c50f5e lrc: 2/0,0 mode: PW/PW res: [0x2b689:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550050:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c50f5e lrc: 3/0,0 mode: PW/PW res: [0x2b689:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550054:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c50f5e lrc: 1/0,0 mode: --/PW res: [0x2b689:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550056:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c50f5e lrc: 0/0,0 mode: --/PW res: [0x2b689:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550060:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c50f57 lrc: 2/0,0 mode: PW/PW res: [0x2b68a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550062:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b855716b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.550063:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c50f57 lrc: 2/0,0 mode: PW/PW res: [0x2b68a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550075:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c50f57 lrc: 3/0,0 mode: PW/PW res: [0x2b68a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550078:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c50f57 lrc: 1/0,0 mode: --/PW res: [0x2b68a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550081:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c50f57 lrc: 0/0,0 mode: --/PW res: [0x2b68a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.550096:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004bb67ba4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996993472:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.550100:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50f65 lrc: 3/0,1 mode: --/PW res: [0x2b68b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.550107:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000264aecf8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996993600:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.550108:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.550109:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50f73 lrc: 3/0,1 mode: --/PW res: [0x2b68d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.550119:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.550119:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50f50 lrc: 3/0,1 mode: PW/PW res: [0x2b687:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550122:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50f50 lrc: 3/0,1 mode: PW/PW res: [0x2b687:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550125:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50f50 lrc: 3/0,1 mode: PW/PW res: [0x2b687:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550131:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50f50 lrc: 2/0,0 mode: PW/PW res: [0x2b687:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.550147:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.550167:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+853:39030:x1731745946429312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1007us (1107us total) trans 12885079409 rc 0/0 00000100:00100000:0.0:1651529344.550170:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211351 00000100:00100000:1.0:1651529344.550175:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.550177:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50f50 lrc: 2/0,0 mode: PW/PW res: [0x2b687:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550180:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003b0cd546 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.550198:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50f50 lrc: 2/0,0 mode: PW/PW res: [0x2b687:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550201:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50f50 lrc: 3/0,0 mode: PW/PW res: [0x2b687:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550206:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50f50 lrc: 1/0,0 mode: --/PW res: [0x2b687:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.550207:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003e3f0f77 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996993536:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.550209:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c50f50 lrc: 0/0,0 mode: --/PW res: [0x2b687:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.550212:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50f6c lrc: 3/0,1 mode: --/PW res: [0x2b68c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.550217:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396310912 00000100:00100000:1.0:1651529344.550219:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000078a40aa9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996993664:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.550221:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006c9dd8e6/0x3234de053c4f659 lrc: 4/0,0 mode: PR/PR res: [0x2b68b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c24 expref: 1211 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.550241:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50f7a lrc: 3/0,1 mode: --/PW res: [0x2b68e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.550248:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396311040 00000100:00100000:0.0:1651529344.550250:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396310976 00010000:00010000:1.0:1651529344.550253:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000928e420a/0x3234de053c4c6a2 lrc: 4/0,0 mode: PR/PR res: [0x2b68d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc61 expref: 1213 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.550253:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c16957d8/0x3234de053c4f533 lrc: 4/0,0 mode: PR/PR res: [0x2b68c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d872a expref: 1213 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.550257:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396311104 00000100:00100000:1.0:1651529344.550259:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12137 00010000:00010000:0.0:1651529344.550259:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bc83f98f/0x3234de053c4dbbe lrc: 4/0,0 mode: PR/PR res: [0x2b68e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1efc expref: 1214 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.550260:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1214:41279:x1731746396310912:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.550263:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.550265:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006c9dd8e6/0x3234de053c4f659 lrc: 4/0,0 mode: PR/PR res: [0x2b68b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c24 expref: 1214 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.550265:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12138 00000100:00100000:0.0:1651529344.550266:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1214:41279:x1731746396310976:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.550268:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006c9dd8e6/0x3234de053c4f659 lrc: 3/0,0 mode: PR/PR res: [0x2b68b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c24 expref: 1214 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.550269:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.550270:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c16957d8/0x3234de053c4f533 lrc: 4/0,0 mode: PR/PR res: [0x2b68c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d872a expref: 1214 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.550274:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c9dd8e6/0x3234de053c4f659 lrc: 0/0,0 mode: --/PR res: [0x2b68b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c24 expref: 1214 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.550274:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c16957d8/0x3234de053c4f533 lrc: 3/0,0 mode: PR/PR res: [0x2b68c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d872a expref: 1214 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.550279:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c16957d8/0x3234de053c4f533 lrc: 0/0,0 mode: --/PR res: [0x2b68c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d872a expref: 1214 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.550280:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.550281:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.550281:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50f65 lrc: 3/0,1 mode: PW/PW res: [0x2b68b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550282:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.550283:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.550284:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50f65 lrc: 4/0,1 mode: PW/PW res: [0x2b68b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550284:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50f6c lrc: 3/0,1 mode: PW/PW res: [0x2b68c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550287:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50f6c lrc: 4/0,1 mode: PW/PW res: [0x2b68c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.550294:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.550303:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.550309:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1212:41279:x1731746396310912:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 47us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.550312:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12137 00000100:00100000:1.0:1651529344.550317:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12139 00000100:00100000:1.0:1651529344.550318:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1211:41279:x1731746396311040:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.550321:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.550322:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000928e420a/0x3234de053c4c6a2 lrc: 4/0,0 mode: PR/PR res: [0x2b68d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc61 expref: 1211 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.550326:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000928e420a/0x3234de053c4c6a2 lrc: 3/0,0 mode: PR/PR res: [0x2b68d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc61 expref: 1211 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.550326:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1211:41279:x1731746396310976:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 59us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.550329:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12138 00010000:00010000:1.0:1651529344.550331:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000928e420a/0x3234de053c4c6a2 lrc: 0/0,0 mode: --/PR res: [0x2b68d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc61 expref: 1211 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.550334:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.550334:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12140 00010000:00010000:1.0:1651529344.550335:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.550336:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50f73 lrc: 3/0,1 mode: PW/PW res: [0x2b68d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.550336:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1209:41279:x1731746396311104:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.550338:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.550339:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50f73 lrc: 4/0,1 mode: PW/PW res: [0x2b68d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550340:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bc83f98f/0x3234de053c4dbbe lrc: 4/0,0 mode: PR/PR res: [0x2b68e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1efc expref: 1209 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.550344:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bc83f98f/0x3234de053c4dbbe lrc: 3/0,0 mode: PR/PR res: [0x2b68e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1efc expref: 1209 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.550348:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.550354:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1209:41279:x1731746396311040:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.550356:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12139 00010000:00010000:0.0:1651529344.550356:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc83f98f/0x3234de053c4dbbe lrc: 0/0,0 mode: --/PR res: [0x2b68e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1efc expref: 1209 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.550360:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.550361:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.550361:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50f7a lrc: 3/0,1 mode: PW/PW res: [0x2b68e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.550363:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50f6c lrc: 3/0,1 mode: PW/PW res: [0x2b68c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550364:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50f7a lrc: 4/0,1 mode: PW/PW res: [0x2b68e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.550366:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50f6c lrc: 3/0,1 mode: PW/PW res: [0x2b68c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.550369:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50f6c lrc: 3/0,1 mode: PW/PW res: [0x2b68c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550373:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.550377:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50f6c lrc: 2/0,0 mode: PW/PW res: [0x2b68c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.550399:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1207:41279:x1731746396311104:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 44us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.550402:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12140 00010000:00010000:0.0:1651529344.550409:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50f6c lrc: 2/0,0 mode: PW/PW res: [0x2b68c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550412:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eb50e2ae already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.550413:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50f6c lrc: 2/0,0 mode: PW/PW res: [0x2b68c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550416:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50f6c lrc: 3/0,0 mode: PW/PW res: [0x2b68c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.550418:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+853:39030:x1731745946429824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1016us (1077us total) trans 12885079410 rc 0/0 00000100:00100000:1.0:1651529344.550421:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211356 00010000:00010000:0.0:1651529344.550421:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50f6c lrc: 1/0,0 mode: --/PW res: [0x2b68c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550423:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c50f6c lrc: 0/0,0 mode: --/PW res: [0x2b68c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.550428:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50f7a lrc: 3/0,1 mode: PW/PW res: [0x2b68e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550429:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50f73 lrc: 3/0,1 mode: PW/PW res: [0x2b68d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550432:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50f73 lrc: 3/0,1 mode: PW/PW res: [0x2b68d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.550434:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50f7a lrc: 3/0,1 mode: PW/PW res: [0x2b68e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550435:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50f73 lrc: 3/0,1 mode: PW/PW res: [0x2b68d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.550437:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50f7a lrc: 3/0,1 mode: PW/PW res: [0x2b68e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550438:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50f73 lrc: 2/0,0 mode: PW/PW res: [0x2b68d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.550440:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50f7a lrc: 2/0,0 mode: PW/PW res: [0x2b68e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.550476:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+854:39030:x1731745946429952:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1018us (1091us total) trans 12885079411 rc 0/0 00000100:00100000:1.0:1651529344.550479:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211358 00000100:00100000:0.0:1651529344.550484:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+853:39029:x1731745946429888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1052us (1107us total) trans 12885079412 rc 0/0 00000100:00100000:0.0:1651529344.550487:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211357 00010000:00010000:0.0:1651529344.550495:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50f73 lrc: 2/0,0 mode: PW/PW res: [0x2b68d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550498:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000005a52f96 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.550499:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50f73 lrc: 2/0,0 mode: PW/PW res: [0x2b68d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550502:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50f73 lrc: 3/0,0 mode: PW/PW res: [0x2b68d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550506:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50f73 lrc: 1/0,0 mode: --/PW res: [0x2b68d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550509:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c50f73 lrc: 0/0,0 mode: --/PW res: [0x2b68d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550513:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50f7a lrc: 2/0,0 mode: PW/PW res: [0x2b68e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.550514:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.550516:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027456046 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.550517:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50f7a lrc: 2/0,0 mode: PW/PW res: [0x2b68e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550529:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50f7a lrc: 3/0,0 mode: PW/PW res: [0x2b68e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.550530:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.550533:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50f7a lrc: 1/0,0 mode: --/PW res: [0x2b68e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550536:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c50f7a lrc: 0/0,0 mode: --/PW res: [0x2b68e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.550541:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.550542:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50f65 lrc: 3/0,1 mode: PW/PW res: [0x2b68b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550544:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50f65 lrc: 3/0,1 mode: PW/PW res: [0x2b68b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550547:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50f65 lrc: 3/0,1 mode: PW/PW res: [0x2b68b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550550:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50f65 lrc: 2/0,0 mode: PW/PW res: [0x2b68b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.550552:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.550589:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946430336 00000100:00100000:0.0:1651529344.550596:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+854:39029:x1731745946429760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1231us (1299us total) trans 12885079413 rc 0/0 00000100:00100000:0.0:1651529344.550600:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211355 00000100:00100000:1.0:1651529344.550601:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946430272 00000100:00100000:0.0:1651529344.550605:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946430400 00000100:00100000:1.0:1651529344.550608:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946430464 00000100:00100000:1.0:1651529344.550613:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211359 00000100:00100000:1.0:1651529344.550615:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+855:39030:x1731745946430336:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.550620:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177808 count 1 00010000:00010000:1.0:1651529344.550624:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50f81 lrc: 3/0,1 mode: --/PW res: [0x2b690:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.550629:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a96127a5/0x3234de053c4ebd2 lrc: 2/0,0 mode: PR/PR res: [0x2b690:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d60cd expref: 1206 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.550636:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211360 00010000:00010000:1.0:1651529344.550638:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.550638:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+856:39030:x1731745946430272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.550639:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.550639:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50f81 lrc: 4/0,1 mode: --/PW res: [0x2b690:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.550643:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177807 count 1 00010000:00010000:1.0:1651529344.550647:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a96127a5/0x3234de053c4ebd2 lrc: 3/0,0 mode: PR/PR res: [0x2b690:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d60cd expref: 1206 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.550648:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c50f88 lrc: 3/0,1 mode: --/PW res: [0x2b68f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.550651:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a96127a5/0x3234de053c4ebd2 lrc: 4/0,0 mode: PR/PR res: [0x2b690:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d60cd expref: 1206 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.550652:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e1c4a5d9/0x3234de053c4d432 lrc: 2/0,0 mode: PR/PR res: [0x2b68f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d029a expref: 1206 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.550655:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d9ef3c1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996993728:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.550656:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.550656:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.550657:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c50f88 lrc: 4/0,1 mode: --/PW res: [0x2b68f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.550663:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e5f43e7 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.550664:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e1c4a5d9/0x3234de053c4d432 lrc: 3/0,0 mode: PR/PR res: [0x2b68f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d029a expref: 1206 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.550667:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e1c4a5d9/0x3234de053c4d432 lrc: 4/0,0 mode: PR/PR res: [0x2b68f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d029a expref: 1206 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.550670:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211361 00000100:00100000:1.0:1651529344.550672:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+856:39029:x1731745946430464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.550672:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000264aecf8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996993792:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.550676:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177810 count 1 00010000:00010000:1.0:1651529344.550679:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50f8f lrc: 3/0,1 mode: --/PW res: [0x2b692:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.550681:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000000a4def41 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.550683:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000821e98e9/0x3234de053c4e733 lrc: 2/0,0 mode: PR/PR res: [0x2b692:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4dbe expref: 1206 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.550686:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.550687:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.550687:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50f65 lrc: 2/0,0 mode: PW/PW res: [0x2b68b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.550688:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50f8f lrc: 4/0,1 mode: --/PW res: [0x2b692:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550690:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006abc37e1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.550691:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50f65 lrc: 2/0,0 mode: PW/PW res: [0x2b68b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.550696:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000821e98e9/0x3234de053c4e733 lrc: 3/0,0 mode: PR/PR res: [0x2b692:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4dbe expref: 1206 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.550696:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50f65 lrc: 3/0,0 mode: PW/PW res: [0x2b68b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.550699:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000821e98e9/0x3234de053c4e733 lrc: 4/0,0 mode: PR/PR res: [0x2b692:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4dbe expref: 1206 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.550700:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50f65 lrc: 1/0,0 mode: --/PW res: [0x2b68b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.550703:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f99b3c22 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996993856:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.550703:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50f65 lrc: 0/0,0 mode: --/PW res: [0x2b68b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.550709:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b7af823 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.550710:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211362 00000100:00100000:0.0:1651529344.550712:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de69fa5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+856:39030:x1731745946430400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.550717:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177809 count 1 00010000:00010000:0.0:1651529344.550720:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fe2031b/0x3234de053c50f96 lrc: 3/0,1 mode: --/PW res: [0x2b691:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550724:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007c03c8fa/0x3234de053c4d050 lrc: 2/0,0 mode: PR/PR res: [0x2b691:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf294 expref: 1206 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.550727:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.550727:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.550728:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008fe2031b/0x3234de053c50f96 lrc: 4/0,1 mode: --/PW res: [0x2b691:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550733:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007c03c8fa/0x3234de053c4d050 lrc: 3/0,0 mode: PR/PR res: [0x2b691:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf294 expref: 1206 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.550759:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007c03c8fa/0x3234de053c4d050 lrc: 4/0,0 mode: PR/PR res: [0x2b691:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf294 expref: 1206 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.550761:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.550764:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004bb67ba4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996993920:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.550774:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.550788:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000008dd99533 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.550795:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946430848 00000100:00100000:0.0:1651529344.550806:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946430784 00000100:00100000:0.0:1651529344.550812:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211363 00000100:00100000:0.0:1651529344.550814:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+858:39030:x1731745946430848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.550818:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.550819:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177812 count 1 00000100:00100000:1.0:1651529344.550829:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946430912 00010000:00010000:0.0:1651529344.550830:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50f9d lrc: 3/0,1 mode: --/PW res: [0x2b694:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550835:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b2ea03e9/0x3234de053c4da13 lrc: 2/0,0 mode: PR/PR res: [0x2b694:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d18d5 expref: 1206 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.550838:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211364 00000100:00100000:1.0:1651529344.550840:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+859:39029:x1731745946430784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.550842:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.550843:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.550844:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50f9d lrc: 4/0,1 mode: --/PW res: [0x2b694:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.550845:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177811 count 1 00010000:00010000:1.0:1651529344.550849:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50fa4 lrc: 3/0,1 mode: --/PW res: [0x2b693:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.550853:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008de0a3e5/0x3234de053c4db5c lrc: 2/0,0 mode: PR/PR res: [0x2b693:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d82 expref: 1206 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.550856:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.550857:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.550858:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50fa4 lrc: 4/0,1 mode: --/PW res: [0x2b693:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550871:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b2ea03e9/0x3234de053c4da13 lrc: 3/0,0 mode: PR/PR res: [0x2b694:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d18d5 expref: 1206 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.550873:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008de0a3e5/0x3234de053c4db5c lrc: 3/0,0 mode: PR/PR res: [0x2b693:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d82 expref: 1206 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.550875:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b2ea03e9/0x3234de053c4da13 lrc: 4/0,0 mode: PR/PR res: [0x2b694:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d18d5 expref: 1206 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.550877:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008de0a3e5/0x3234de053c4db5c lrc: 4/0,0 mode: PR/PR res: [0x2b693:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d82 expref: 1206 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.550879:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000034e35367 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996993984:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.550881:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a925fbf6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996994048:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.550889:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060852af0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.550890:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd96f074 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.550895:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211365 00000100:00100000:0.0:1651529344.550897:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+859:39030:x1731745946430912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.550902:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177813 count 1 00010000:00010000:0.0:1651529344.550905:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50fab lrc: 3/0,1 mode: --/PW res: [0x2b695:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.550908:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.550909:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c3bc1618/0x3234de053c4f24d lrc: 2/0,0 mode: PR/PR res: [0x2b695:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7bed expref: 1206 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.550913:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.550913:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.550914:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50fab lrc: 4/0,1 mode: --/PW res: [0x2b695:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550931:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c3bc1618/0x3234de053c4f24d lrc: 3/0,0 mode: PR/PR res: [0x2b695:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7bed expref: 1206 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.550935:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c3bc1618/0x3234de053c4f24d lrc: 4/0,0 mode: PR/PR res: [0x2b695:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7bed expref: 1206 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.550939:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000913beefe pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996994112:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.550948:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000abca413e going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.550954:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946430976 00000100:00100000:0.0:1651529344.550965:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211366 00000100:00100000:0.0:1651529344.550967:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+860:39029:x1731745946430976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.550971:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177814 count 1 00010000:00010000:0.0:1651529344.550975:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50fb2 lrc: 3/0,1 mode: --/PW res: [0x2b696:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550979:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000062316f27/0x3234de053c4e883 lrc: 2/0,0 mode: PR/PR res: [0x2b696:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d530c expref: 1206 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.550981:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d9ef3c1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996993728:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.550982:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.550983:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.550984:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50fb2 lrc: 4/0,1 mode: --/PW res: [0x2b696:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.550986:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50f81 lrc: 3/0,1 mode: --/PW res: [0x2b690:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.550990:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000062316f27/0x3234de053c4e883 lrc: 3/0,0 mode: PR/PR res: [0x2b696:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d530c expref: 1206 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.550993:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000062316f27/0x3234de053c4e883 lrc: 4/0,0 mode: PR/PR res: [0x2b696:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d530c expref: 1206 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.550997:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d9cfef26 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996994176:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.551009:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e1aa6a77 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.551513:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f99b3c22 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996993856:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.551518:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50f8f lrc: 3/0,1 mode: --/PW res: [0x2b692:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.551546:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.551553:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396311680 00000100:00100000:0.0:1651529344.551553:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.551559:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e1c4a5d9/0x3234de053c4d432 lrc: 5/0,0 mode: PR/PR res: [0x2b68f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d029a expref: 1207 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.551560:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.551571:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.551574:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396311808 00010000:00010000:1.0:1651529344.551578:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007c03c8fa/0x3234de053c4d050 lrc: 5/0,0 mode: PR/PR res: [0x2b691:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf294 expref: 1208 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.551590:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396311616 00000100:00100000:0.0:1651529344.551590:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.551593:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a96127a5/0x3234de053c4ebd2 lrc: 4/0,0 mode: PR/PR res: [0x2b690:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d60cd expref: 1209 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.551594:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.551597:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396311744 00010000:00010000:1.0:1651529344.551599:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000821e98e9/0x3234de053c4e733 lrc: 4/0,0 mode: PR/PR res: [0x2b692:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4dbe expref: 1210 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.551599:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.551603:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396311936 00010000:00010000:1.0:1651529344.551605:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008de0a3e5/0x3234de053c4db5c lrc: 5/0,0 mode: PR/PR res: [0x2b693:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d82 expref: 1211 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.551609:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396311872 00000100:00100000:0.0:1651529344.551609:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.551611:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b2ea03e9/0x3234de053c4da13 lrc: 5/0,0 mode: PR/PR res: [0x2b694:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d18d5 expref: 1212 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.551615:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396312000 00010000:00010000:1.0:1651529344.551617:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c3bc1618/0x3234de053c4f24d lrc: 5/0,0 mode: PR/PR res: [0x2b695:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7bed expref: 1213 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.551617:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004bb67ba4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996993920:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.551621:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396312064 00010000:00010000:1.0:1651529344.551622:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000062316f27/0x3234de053c4e883 lrc: 5/0,0 mode: PR/PR res: [0x2b696:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d530c expref: 1214 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.551623:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008fe2031b/0x3234de053c50f96 lrc: 3/0,1 mode: --/PW res: [0x2b691:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.551627:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12141 00000100:00100000:1.0:1651529344.551628:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005649b5c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1214:41279:x1731746396311680:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.551630:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000264aecf8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996993792:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.551632:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.551632:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c50f88 lrc: 3/0,1 mode: --/PW res: [0x2b68f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.551634:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e1c4a5d9/0x3234de053c4d432 lrc: 4/0,0 mode: PR/PR res: [0x2b68f:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d029a expref: 1214 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.551637:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e1c4a5d9/0x3234de053c4d432 lrc: 3/0,0 mode: PR/PR res: [0x2b68f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d029a expref: 1214 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.551638:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000034e35367 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996993984:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.551641:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50f9d lrc: 3/0,1 mode: --/PW res: [0x2b694:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.551643:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1c4a5d9/0x3234de053c4d432 lrc: 0/0,0 mode: --/PR res: [0x2b68f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d029a expref: 1214 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.551646:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000913beefe pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996994112:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.551647:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.551647:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.551648:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c50f88 lrc: 3/0,1 mode: PW/PW res: [0x2b68f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551649:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50fab lrc: 3/0,1 mode: --/PW res: [0x2b695:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.551651:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c50f88 lrc: 4/0,1 mode: PW/PW res: [0x2b68f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.551654:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d9cfef26 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996994176:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.551657:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50fb2 lrc: 3/0,1 mode: --/PW res: [0x2b696:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.551661:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.551668:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c50f88 lrc: 3/0,1 mode: PW/PW res: [0x2b68f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.551671:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005649b5c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1213:41279:x1731746396311680:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (126us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.551671:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c50f88 lrc: 3/0,1 mode: PW/PW res: [0x2b68f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.551674:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12141 00010000:00010000:0.0:1651529344.551677:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c50f88 lrc: 3/0,1 mode: PW/PW res: [0x2b68f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551680:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c50f88 lrc: 2/0,0 mode: PW/PW res: [0x2b68f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.551683:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12142 00000100:00100000:1.0:1651529344.551685:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1212:41279:x1731746396311808:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.551687:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.551689:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007c03c8fa/0x3234de053c4d050 lrc: 4/0,0 mode: PR/PR res: [0x2b691:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf294 expref: 1212 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.551695:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007c03c8fa/0x3234de053c4d050 lrc: 3/0,0 mode: PR/PR res: [0x2b691:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf294 expref: 1212 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.551700:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c03c8fa/0x3234de053c4d050 lrc: 0/0,0 mode: --/PR res: [0x2b691:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf294 expref: 1212 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.551703:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.551704:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.551704:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008fe2031b/0x3234de053c50f96 lrc: 3/0,1 mode: PW/PW res: [0x2b691:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.551707:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008fe2031b/0x3234de053c50f96 lrc: 4/0,1 mode: PW/PW res: [0x2b691:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.551716:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.551721:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1211:41279:x1731746396311808:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 36us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.551723:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12142 00000100:00100000:1.0:1651529344.551727:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12143 00000100:00100000:0.0:1651529344.551728:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+861:39030:x1731745946430272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1089us (1198us total) trans 12885079414 rc 0/0 00000100:00100000:1.0:1651529344.551729:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a13808c6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1210:41278:x1731746396311616:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.551731:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.551731:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211360 00010000:00010000:1.0:1651529344.551733:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a96127a5/0x3234de053c4ebd2 lrc: 4/0,0 mode: PR/PR res: [0x2b690:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d60cd expref: 1210 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.551746:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a96127a5/0x3234de053c4ebd2 lrc: 3/0,0 mode: PR/PR res: [0x2b690:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d60cd expref: 1210 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.551748:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c50f88 lrc: 2/0,0 mode: PW/PW res: [0x2b68f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.551751:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a96127a5/0x3234de053c4ebd2 lrc: 0/0,0 mode: --/PR res: [0x2b690:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d60cd expref: 1210 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.551752:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000be0f0b1c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.551753:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c50f88 lrc: 2/0,0 mode: PW/PW res: [0x2b68f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.551754:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.551755:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.551756:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50f81 lrc: 3/0,1 mode: PW/PW res: [0x2b690:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551756:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c50f88 lrc: 3/0,0 mode: PW/PW res: [0x2b68f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.551758:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50f81 lrc: 4/0,1 mode: PW/PW res: [0x2b690:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551760:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c50f88 lrc: 1/0,0 mode: --/PW res: [0x2b68f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551763:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be0f0b1c/0x3234de053c50f88 lrc: 0/0,0 mode: --/PW res: [0x2b68f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.551765:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.551769:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008fe2031b/0x3234de053c50f96 lrc: 3/0,1 mode: PW/PW res: [0x2b691:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.551770:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a13808c6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1209:41278:x1731746396311616:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 41us (210us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.551772:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008fe2031b/0x3234de053c50f96 lrc: 3/0,1 mode: PW/PW res: [0x2b691:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.551773:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12143 00010000:00010000:0.0:1651529344.551775:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fe2031b/0x3234de053c50f96 lrc: 3/0,1 mode: PW/PW res: [0x2b691:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.551777:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12144 00010000:00010000:0.0:1651529344.551778:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008fe2031b/0x3234de053c50f96 lrc: 2/0,0 mode: PW/PW res: [0x2b691:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.551779:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1208:41278:x1731746396311744:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.551781:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.551783:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000821e98e9/0x3234de053c4e733 lrc: 4/0,0 mode: PR/PR res: [0x2b692:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4dbe expref: 1208 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.551786:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000821e98e9/0x3234de053c4e733 lrc: 3/0,0 mode: PR/PR res: [0x2b692:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4dbe expref: 1208 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.551790:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000821e98e9/0x3234de053c4e733 lrc: 0/0,0 mode: --/PR res: [0x2b692:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4dbe expref: 1208 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.551796:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.551797:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.551797:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50f8f lrc: 3/0,1 mode: PW/PW res: [0x2b692:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.551800:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50f8f lrc: 4/0,1 mode: PW/PW res: [0x2b692:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.551805:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.551809:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1207:41278:x1731746396311744:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 30us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.551812:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12144 00000100:00100000:0.0:1651529344.551814:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de69fa5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+861:39030:x1731745946430400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1101us (1272us total) trans 12885079415 rc 0/0 00000100:00100000:1.0:1651529344.551815:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12145 00000100:00100000:1.0:1651529344.551816:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1206:41279:x1731746396311936:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.551817:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211362 00010000:00010000:1.0:1651529344.551818:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.551820:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008de0a3e5/0x3234de053c4db5c lrc: 5/0,0 mode: PR/PR res: [0x2b693:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d82 expref: 1206 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.551823:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008de0a3e5/0x3234de053c4db5c lrc: 4/0,0 mode: PR/PR res: [0x2b693:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d82 expref: 1206 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.551823:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008fe2031b/0x3234de053c50f96 lrc: 2/0,0 mode: PW/PW res: [0x2b691:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551826:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008fe2031b already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.551827:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.551827:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008fe2031b/0x3234de053c50f96 lrc: 2/0,0 mode: PW/PW res: [0x2b691:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.551828:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.551828:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50fa4 lrc: 3/0,1 mode: PW/PW res: [0x2b693:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551830:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008fe2031b/0x3234de053c50f96 lrc: 3/0,0 mode: PW/PW res: [0x2b691:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.551833:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50fa4 lrc: 4/0,1 mode: PW/PW res: [0x2b693:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551834:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008fe2031b/0x3234de053c50f96 lrc: 1/0,0 mode: --/PW res: [0x2b691:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.551837:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.551837:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008fe2031b/0x3234de053c50f96 lrc: 0/0,0 mode: --/PW res: [0x2b691:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.551841:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1206:41279:x1731746396311936:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 24us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.551843:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12145 00000100:00100000:0.0:1651529344.551845:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12146 00000100:00100000:1.0:1651529344.551847:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12147 00000100:00100000:0.0:1651529344.551847:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1205:41279:x1731746396311872:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.551848:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1205:41279:x1731746396312000:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.551850:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.551850:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.551851:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c3bc1618/0x3234de053c4f24d lrc: 4/0,0 mode: PR/PR res: [0x2b695:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7bed expref: 1205 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.551852:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b2ea03e9/0x3234de053c4da13 lrc: 4/0,0 mode: PR/PR res: [0x2b694:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d18d5 expref: 1205 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.551855:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c3bc1618/0x3234de053c4f24d lrc: 3/0,0 mode: PR/PR res: [0x2b695:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7bed expref: 1205 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.551856:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b2ea03e9/0x3234de053c4da13 lrc: 3/0,0 mode: PR/PR res: [0x2b694:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d18d5 expref: 1205 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.551859:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3bc1618/0x3234de053c4f24d lrc: 0/0,0 mode: --/PR res: [0x2b695:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7bed expref: 1205 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.551861:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2ea03e9/0x3234de053c4da13 lrc: 0/0,0 mode: --/PR res: [0x2b694:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d18d5 expref: 1205 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.551862:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.551863:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.551863:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50fab lrc: 3/0,1 mode: PW/PW res: [0x2b695:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551864:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.551865:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.551866:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50fab lrc: 4/0,1 mode: PW/PW res: [0x2b695:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551866:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50f9d lrc: 3/0,1 mode: PW/PW res: [0x2b694:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551869:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50f9d lrc: 4/0,1 mode: PW/PW res: [0x2b694:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.551877:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.551881:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.551882:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1203:41279:x1731746396312000:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 33us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.551884:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12147 00000100:00100000:1.0:1651529344.551888:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12148 00000100:00100000:0.0:1651529344.551889:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1202:41279:x1731746396311872:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.551890:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d696796e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1202:41278:x1731746396312064:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.551891:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12146 00010000:00010000:1.0:1651529344.551892:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.551894:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000062316f27/0x3234de053c4e883 lrc: 4/0,0 mode: PR/PR res: [0x2b696:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d530c expref: 1202 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.551897:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000062316f27/0x3234de053c4e883 lrc: 3/0,0 mode: PR/PR res: [0x2b696:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d530c expref: 1201 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.551898:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50f9d lrc: 3/0,1 mode: PW/PW res: [0x2b694:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.551902:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062316f27/0x3234de053c4e883 lrc: 0/0,0 mode: --/PR res: [0x2b696:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d530c expref: 1201 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.551904:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50f9d lrc: 3/0,1 mode: PW/PW res: [0x2b694:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.551905:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.551905:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.551906:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50fb2 lrc: 3/0,1 mode: PW/PW res: [0x2b696:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551907:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50f9d lrc: 3/0,1 mode: PW/PW res: [0x2b694:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.551909:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50fb2 lrc: 4/0,1 mode: PW/PW res: [0x2b696:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551910:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50f9d lrc: 2/0,0 mode: PW/PW res: [0x2b694:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.551917:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.551922:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d696796e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1200:41278:x1731746396312064:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 31us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.551924:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12148 00010000:00010000:1.0:1651529344.551938:0:80279:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008de0a3e5/0x3234de053c4db5c lrc: 0/0,0 mode: --/PR res: [0x2b693:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d82 expref: 1199 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.551942:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a925fbf6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996994048:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.551945:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50fa4 lrc: 3/0,1 mode: PW/PW res: [0x2b693:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.551949:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50fa4 lrc: 3/0,1 mode: PW/PW res: [0x2b693:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.551951:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50fa4 lrc: 3/0,1 mode: PW/PW res: [0x2b693:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.551955:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50fa4 lrc: 3/0,1 mode: PW/PW res: [0x2b693:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.551955:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+861:39030:x1731745946430848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1140us (1194us total) trans 12885079416 rc 0/0 00010000:00010000:1.0:1651529344.551957:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50fa4 lrc: 2/0,0 mode: PW/PW res: [0x2b693:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.551958:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211363 00010000:00010000:0.0:1651529344.551973:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50f9d lrc: 2/0,0 mode: PW/PW res: [0x2b694:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551976:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000035eaa2c8 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.551977:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50f9d lrc: 2/0,0 mode: PW/PW res: [0x2b694:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551980:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50f9d lrc: 3/0,0 mode: PW/PW res: [0x2b694:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551984:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50f9d lrc: 1/0,0 mode: --/PW res: [0x2b694:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551987:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035eaa2c8/0x3234de053c50f9d lrc: 0/0,0 mode: --/PW res: [0x2b694:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551991:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50fa4 lrc: 2/0,0 mode: PW/PW res: [0x2b693:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551994:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000734ecdfd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.551995:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50fa4 lrc: 2/0,0 mode: PW/PW res: [0x2b693:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.551997:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50fa4 lrc: 3/0,0 mode: PW/PW res: [0x2b693:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.552000:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+861:39029:x1731745946430784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1159us (1226us total) trans 12885079417 rc 0/0 00010000:00010000:0.0:1651529344.552001:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50fa4 lrc: 1/0,0 mode: --/PW res: [0x2b693:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.552003:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211364 00010000:00010000:0.0:1651529344.552003:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c50fa4 lrc: 0/0,0 mode: --/PW res: [0x2b693:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552009:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50fab lrc: 3/0,1 mode: PW/PW res: [0x2b695:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.552011:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50f81 lrc: 3/0,1 mode: PW/PW res: [0x2b690:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552012:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50fab lrc: 3/0,1 mode: PW/PW res: [0x2b695:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552015:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50fab lrc: 3/0,1 mode: PW/PW res: [0x2b695:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.552016:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50f81 lrc: 3/0,1 mode: PW/PW res: [0x2b690:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552017:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50fab lrc: 2/0,0 mode: PW/PW res: [0x2b695:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.552019:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50f81 lrc: 3/0,1 mode: PW/PW res: [0x2b690:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.552022:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50f81 lrc: 2/0,0 mode: PW/PW res: [0x2b690:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.552059:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+862:39030:x1731745946430912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1161us (1241us total) trans 12885079418 rc 0/0 00000100:00100000:1.0:1651529344.552061:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+862:39030:x1731745946430336:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1446us (1547us total) trans 12885079419 rc 0/0 00000100:00100000:0.0:1651529344.552062:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211365 00000100:00100000:1.0:1651529344.552064:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211359 00010000:00010000:0.0:1651529344.552069:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50fab lrc: 2/0,0 mode: PW/PW res: [0x2b695:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552073:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006b93727a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.552074:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50fab lrc: 2/0,0 mode: PW/PW res: [0x2b695:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552077:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50fab lrc: 3/0,0 mode: PW/PW res: [0x2b695:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552081:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50fab lrc: 1/0,0 mode: --/PW res: [0x2b695:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.552082:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50f8f lrc: 3/0,1 mode: PW/PW res: [0x2b692:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552083:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b93727a/0x3234de053c50fab lrc: 0/0,0 mode: --/PW res: [0x2b695:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.552086:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50f8f lrc: 3/0,1 mode: PW/PW res: [0x2b692:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552088:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50f81 lrc: 2/0,0 mode: PW/PW res: [0x2b690:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.552089:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50f8f lrc: 3/0,1 mode: PW/PW res: [0x2b692:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552090:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cdc65e28 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.552091:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50f81 lrc: 2/0,0 mode: PW/PW res: [0x2b690:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.552092:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50f8f lrc: 2/0,0 mode: PW/PW res: [0x2b692:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552096:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50f81 lrc: 3/0,0 mode: PW/PW res: [0x2b690:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552107:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50f81 lrc: 1/0,0 mode: --/PW res: [0x2b690:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552109:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c50f81 lrc: 0/0,0 mode: --/PW res: [0x2b690:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552113:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50f8f lrc: 2/0,0 mode: PW/PW res: [0x2b692:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552116:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a0607df4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.552117:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50f8f lrc: 2/0,0 mode: PW/PW res: [0x2b692:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552120:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50f8f lrc: 3/0,0 mode: PW/PW res: [0x2b692:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552123:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50f8f lrc: 1/0,0 mode: --/PW res: [0x2b692:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552125:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c50f8f lrc: 0/0,0 mode: --/PW res: [0x2b692:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.552128:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+861:39029:x1731745946430464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1455us (1575us total) trans 12885079420 rc 0/0 00010000:00010000:0.0:1651529344.552131:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50fb2 lrc: 3/0,1 mode: PW/PW res: [0x2b696:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.552132:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211361 00010000:00010000:0.0:1651529344.552137:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50fb2 lrc: 3/0,1 mode: PW/PW res: [0x2b696:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552139:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50fb2 lrc: 3/0,1 mode: PW/PW res: [0x2b696:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552142:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50fb2 lrc: 2/0,0 mode: PW/PW res: [0x2b696:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.552176:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+861:39029:x1731745946430976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1209us (1268us total) trans 12885079421 rc 0/0 00000100:00100000:0.0:1651529344.552179:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211366 00010000:00010000:0.0:1651529344.552185:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50fb2 lrc: 2/0,0 mode: PW/PW res: [0x2b696:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552188:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e0e037e6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.552189:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50fb2 lrc: 2/0,0 mode: PW/PW res: [0x2b696:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552192:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50fb2 lrc: 3/0,0 mode: PW/PW res: [0x2b696:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552196:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50fb2 lrc: 1/0,0 mode: --/PW res: [0x2b696:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552199:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c50fb2 lrc: 0/0,0 mode: --/PW res: [0x2b696:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.552441:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.552451:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.552452:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946431616 00000100:00100000:1.0:1651529344.552459:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.552462:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946431744 00000100:00100000:0.0:1651529344.552476:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946431552 00000100:00100000:1.0:1651529344.552478:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.552486:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946431680 00000100:00100000:1.0:1651529344.552489:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211367 00000100:00100000:1.0:1651529344.552491:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+864:39030:x1731745946431616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.552493:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211368 00000100:00100000:0.0:1651529344.552495:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+864:39030:x1731745946431744:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.552497:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177816 count 1 00002000:00080000:0.0:1651529344.552501:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177818 count 1 00010000:00010000:1.0:1651529344.552502:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50fb9 lrc: 3/0,1 mode: --/PW res: [0x2b698:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552505:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50fc0 lrc: 3/0,1 mode: --/PW res: [0x2b69a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.552507:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f466dca7/0x3234de053c4e4d2 lrc: 2/0,0 mode: PR/PR res: [0x2b698:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4495 expref: 1198 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.552510:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.552511:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.552511:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50fb9 lrc: 4/0,1 mode: --/PW res: [0x2b698:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.552518:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f466dca7/0x3234de053c4e4d2 lrc: 3/0,0 mode: PR/PR res: [0x2b698:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4495 expref: 1198 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.552522:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f466dca7/0x3234de053c4e4d2 lrc: 4/0,0 mode: PR/PR res: [0x2b698:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4495 expref: 1198 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.552526:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d718cfe4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996994240:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.552544:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000498d603f/0x3234de053c4ddd2 lrc: 2/0,0 mode: PR/PR res: [0x2b69a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2879 expref: 1198 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.552548:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.552548:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.552548:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.552549:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50fc0 lrc: 4/0,1 mode: --/PW res: [0x2b69a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.552554:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211369 00000100:00100000:1.0:1651529344.552556:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+864:39030:x1731745946431552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.552557:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000498d603f/0x3234de053c4ddd2 lrc: 3/0,0 mode: PR/PR res: [0x2b69a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2879 expref: 1198 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.552560:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177815 count 1 00010000:00010000:0.0:1651529344.552561:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000498d603f/0x3234de053c4ddd2 lrc: 4/0,0 mode: PR/PR res: [0x2b69a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2879 expref: 1198 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.552564:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e05029b/0x3234de053c50fc7 lrc: 3/0,1 mode: --/PW res: [0x2b697:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.552565:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000065f5e47d pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996994304:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.552569:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c4c712 lrc: 2/0,0 mode: PR/PR res: [0x2b697:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce36 expref: 1198 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.552572:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.552572:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.552573:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e05029b/0x3234de053c50fc7 lrc: 4/0,1 mode: --/PW res: [0x2b697:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.552575:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000abca413e going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.552579:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c4c712 lrc: 3/0,0 mode: PR/PR res: [0x2b697:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce36 expref: 1198 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.552582:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c4c712 lrc: 4/0,0 mode: PR/PR res: [0x2b697:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce36 expref: 1198 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.552582:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211370 00000100:00100000:0.0:1651529344.552584:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+864:39030:x1731745946431680:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.552587:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005912c4a3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996994368:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.552589:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177817 count 1 00010000:00010000:0.0:1651529344.552592:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50fce lrc: 3/0,1 mode: --/PW res: [0x2b699:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.552593:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000412e5d26 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.552597:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006d7fa65b/0x3234de053c4e49a lrc: 2/0,0 mode: PR/PR res: [0x2b699:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43a0 expref: 1198 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.552600:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.552600:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.552601:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50fce lrc: 4/0,1 mode: --/PW res: [0x2b699:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.552605:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.552607:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006d7fa65b/0x3234de053c4e49a lrc: 3/0,0 mode: PR/PR res: [0x2b699:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43a0 expref: 1198 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.552610:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006d7fa65b/0x3234de053c4e49a lrc: 4/0,0 mode: PR/PR res: [0x2b699:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43a0 expref: 1198 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.552614:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bc420ca1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996994432:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.552618:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.552621:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060852af0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.552634:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.552635:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946431808 00000100:00100000:0.0:1651529344.552644:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946431872 00000100:00100000:0.0:1651529344.552650:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946432000 00000100:00100000:0.0:1651529344.552653:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211371 00000100:00100000:0.0:1651529344.552655:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+867:39029:x1731745946431808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.552657:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.552659:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177819 count 1 00010000:00010000:0.0:1651529344.552663:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50fd5 lrc: 3/0,1 mode: --/PW res: [0x2b69b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552667:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a2fbd5f2/0x3234de053c4b31c lrc: 2/0,0 mode: PR/PR res: [0x2b69b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc178 expref: 1198 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.552671:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.552671:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.552672:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50fd5 lrc: 4/0,1 mode: --/PW res: [0x2b69b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.552678:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a2fbd5f2/0x3234de053c4b31c lrc: 3/0,0 mode: PR/PR res: [0x2b69b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc178 expref: 1198 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.552681:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a2fbd5f2/0x3234de053c4b31c lrc: 4/0,0 mode: PR/PR res: [0x2b69b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc178 expref: 1198 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.552685:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c9f4ec84 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996994496:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.552687:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946431936 00000100:00100000:1.0:1651529344.552694:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211372 00000100:00100000:0.0:1651529344.552697:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed830649 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.552703:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+868:39030:x1731745946431872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.552704:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211373 00000100:00100000:0.0:1651529344.552706:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+868:39030:x1731745946432000:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.552708:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177820 count 1 00002000:00080000:0.0:1651529344.552710:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177822 count 1 00010000:00010000:1.0:1651529344.552712:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50fdc lrc: 3/0,1 mode: --/PW res: [0x2b69c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.552716:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b54a65c7/0x3234de053c4bd3a lrc: 2/0,0 mode: PR/PR res: [0x2b69c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc62c expref: 1198 pid: 80280 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.552719:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.552720:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.552720:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50fdc lrc: 4/0,1 mode: --/PW res: [0x2b69c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.552727:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b54a65c7/0x3234de053c4bd3a lrc: 3/0,0 mode: PR/PR res: [0x2b69c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc62c expref: 1198 pid: 80280 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.552729:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50fe3 lrc: 3/0,1 mode: --/PW res: [0x2b69e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.552730:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b54a65c7/0x3234de053c4bd3a lrc: 4/0,0 mode: PR/PR res: [0x2b69c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc62c expref: 1198 pid: 80280 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.552733:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000bdbd971/0x3234de053c4f0b7 lrc: 2/0,0 mode: PR/PR res: [0x2b69e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7580 expref: 1198 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.552744:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000088fa78f8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996994560:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.552748:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.552749:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.552750:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50fe3 lrc: 4/0,1 mode: --/PW res: [0x2b69e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.552753:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 0000000053a0cffa going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.552757:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000bdbd971/0x3234de053c4f0b7 lrc: 3/0,0 mode: PR/PR res: [0x2b69e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7580 expref: 1198 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.552760:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211374 00000100:00100000:1.0:1651529344.552761:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+868:39030:x1731745946431936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.552761:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000bdbd971/0x3234de053c4f0b7 lrc: 4/0,0 mode: PR/PR res: [0x2b69e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7580 expref: 1198 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.552765:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000027e31dd1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996994624:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.552766:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177821 count 1 00010000:00010000:1.0:1651529344.552769:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50fea lrc: 3/0,1 mode: --/PW res: [0x2b69d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.552773:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000000d706dff going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.552774:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000043037897/0x3234de053c4eef0 lrc: 2/0,0 mode: PR/PR res: [0x2b69d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e2c expref: 1198 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.552777:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.552777:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.552778:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50fea lrc: 4/0,1 mode: --/PW res: [0x2b69d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.552784:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000043037897/0x3234de053c4eef0 lrc: 3/0,0 mode: PR/PR res: [0x2b69d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e2c expref: 1198 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.552787:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000043037897/0x3234de053c4eef0 lrc: 4/0,0 mode: PR/PR res: [0x2b69d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e2c expref: 1198 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.552791:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f9050c71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996994688:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.552797:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 0000000020dd7827 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.552949:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000065f5e47d pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996994304:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.552954:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50fc0 lrc: 3/0,1 mode: --/PW res: [0x2b69a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.552969:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bc420ca1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996994432:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.552972:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50fce lrc: 3/0,1 mode: --/PW res: [0x2b699:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.552973:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d718cfe4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996994240:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.552978:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50fb9 lrc: 3/0,1 mode: --/PW res: [0x2b698:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.552985:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005912c4a3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996994368:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.552987:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003e05029b/0x3234de053c50fc7 lrc: 3/0,1 mode: --/PW res: [0x2b697:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.553316:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000088fa78f8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996994560:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.553324:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.553325:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50fdc lrc: 3/0,1 mode: --/PW res: [0x2b69c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.553333:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.553340:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.553347:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f9050c71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996994688:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.553348:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.553350:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50fea lrc: 3/0,1 mode: --/PW res: [0x2b69d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.553355:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.553357:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396312704 00000100:00100000:0.0:1651529344.553360:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.553362:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f466dca7/0x3234de053c4e4d2 lrc: 4/0,0 mode: PR/PR res: [0x2b698:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4495 expref: 1199 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.553365:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.553367:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396312768 00010000:00010000:1.0:1651529344.553369:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000498d603f/0x3234de053c4ddd2 lrc: 4/0,0 mode: PR/PR res: [0x2b69a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2879 expref: 1200 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.553371:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.553374:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396312832 00010000:00010000:1.0:1651529344.553376:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006d7fa65b/0x3234de053c4e49a lrc: 4/0,0 mode: PR/PR res: [0x2b699:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43a0 expref: 1201 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.553378:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c9f4ec84 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996994496:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.553380:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396312896 00010000:00010000:1.0:1651529344.553382:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c4c712 lrc: 4/0,0 mode: PR/PR res: [0x2b697:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce36 expref: 1202 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.553383:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50fd5 lrc: 3/0,1 mode: --/PW res: [0x2b69b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.553385:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396313024 00010000:00010000:1.0:1651529344.553387:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a2fbd5f2/0x3234de053c4b31c lrc: 4/0,0 mode: PR/PR res: [0x2b69b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc178 expref: 1203 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.553389:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000027e31dd1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996994624:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.553391:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396312960 00010000:00010000:0.0:1651529344.553392:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50fe3 lrc: 3/0,1 mode: --/PW res: [0x2b69e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.553393:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b54a65c7/0x3234de053c4bd3a lrc: 4/0,0 mode: PR/PR res: [0x2b69c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc62c expref: 1204 pid: 80280 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.553397:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396313088 00000100:00100000:0.0:1651529344.553398:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396313152 00010000:00010000:1.0:1651529344.553399:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000bdbd971/0x3234de053c4f0b7 lrc: 4/0,0 mode: PR/PR res: [0x2b69e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7580 expref: 1205 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.553403:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000043037897/0x3234de053c4eef0 lrc: 4/0,0 mode: PR/PR res: [0x2b69d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e2c expref: 1206 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.553404:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12149 00000100:00100000:1.0:1651529344.553405:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1206:41279:x1731746396312704:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.553408:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.553409:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f466dca7/0x3234de053c4e4d2 lrc: 4/0,0 mode: PR/PR res: [0x2b698:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4495 expref: 1206 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.553409:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12150 00000100:00100000:0.0:1651529344.553411:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1206:41278:x1731746396312768:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.553413:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f466dca7/0x3234de053c4e4d2 lrc: 3/0,0 mode: PR/PR res: [0x2b698:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4495 expref: 1206 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.553414:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.553416:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000498d603f/0x3234de053c4ddd2 lrc: 4/0,0 mode: PR/PR res: [0x2b69a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2879 expref: 1206 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.553419:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f466dca7/0x3234de053c4e4d2 lrc: 0/0,0 mode: --/PR res: [0x2b698:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4495 expref: 1206 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.553419:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000498d603f/0x3234de053c4ddd2 lrc: 3/0,0 mode: PR/PR res: [0x2b69a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2879 expref: 1206 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.553422:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.553423:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.553424:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50fb9 lrc: 3/0,1 mode: PW/PW res: [0x2b698:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553425:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000498d603f/0x3234de053c4ddd2 lrc: 0/0,0 mode: --/PR res: [0x2b69a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2879 expref: 1205 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.553427:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50fb9 lrc: 4/0,1 mode: PW/PW res: [0x2b698:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553429:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.553430:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.553431:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50fc0 lrc: 3/0,1 mode: PW/PW res: [0x2b69a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.553433:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.553433:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50fc0 lrc: 4/0,1 mode: PW/PW res: [0x2b69a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553440:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.553441:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1204:41279:x1731746396312704:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 36us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.553444:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12149 00000100:00100000:0.0:1651529344.553447:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1203:41278:x1731746396312768:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.553449:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12151 00000100:00100000:1.0:1651529344.553450:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1203:41279:x1731746396312832:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.553450:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12150 00010000:00010000:1.0:1651529344.553453:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.553454:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006d7fa65b/0x3234de053c4e49a lrc: 4/0,0 mode: PR/PR res: [0x2b699:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43a0 expref: 1202 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.553455:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12152 00000100:00100000:0.0:1651529344.553457:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1202:41278:x1731746396312896:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.553458:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006d7fa65b/0x3234de053c4e49a lrc: 3/0,0 mode: PR/PR res: [0x2b699:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43a0 expref: 1202 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.553459:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.553461:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c4c712 lrc: 4/0,0 mode: PR/PR res: [0x2b697:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce36 expref: 1202 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.553462:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d7fa65b/0x3234de053c4e49a lrc: 0/0,0 mode: --/PR res: [0x2b699:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43a0 expref: 1202 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.553465:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c4c712 lrc: 3/0,0 mode: PR/PR res: [0x2b697:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce36 expref: 1202 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.553466:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.553466:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.553467:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50fce lrc: 3/0,1 mode: PW/PW res: [0x2b699:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553469:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c4c712 lrc: 0/0,0 mode: --/PR res: [0x2b697:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce36 expref: 1201 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.553470:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50fce lrc: 4/0,1 mode: PW/PW res: [0x2b699:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553473:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.553473:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.553474:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003e05029b/0x3234de053c50fc7 lrc: 3/0,1 mode: PW/PW res: [0x2b697:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.553480:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.553484:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e05029b/0x3234de053c50fc7 lrc: 4/0,1 mode: PW/PW res: [0x2b697:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.553486:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1200:41279:x1731746396312832:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.553488:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12151 00010000:00010000:0.0:1651529344.553494:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.553500:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12153 00000100:00100000:0.0:1651529344.553500:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1199:41278:x1731746396312896:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.553502:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1199:41279:x1731746396313024:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.553503:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12152 00010000:00010000:1.0:1651529344.553505:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.553506:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a2fbd5f2/0x3234de053c4b31c lrc: 4/0,0 mode: PR/PR res: [0x2b69b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc178 expref: 1198 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.553507:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12154 00000100:00100000:0.0:1651529344.553509:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1198:41278:x1731746396312960:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.553510:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a2fbd5f2/0x3234de053c4b31c lrc: 3/0,0 mode: PR/PR res: [0x2b69b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc178 expref: 1198 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.553512:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.553513:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b54a65c7/0x3234de053c4bd3a lrc: 4/0,0 mode: PR/PR res: [0x2b69c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc62c expref: 1198 pid: 80280 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.553515:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2fbd5f2/0x3234de053c4b31c lrc: 0/0,0 mode: --/PR res: [0x2b69b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc178 expref: 1198 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.553517:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b54a65c7/0x3234de053c4bd3a lrc: 3/0,0 mode: PR/PR res: [0x2b69c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc62c expref: 1198 pid: 80280 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.553519:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.553519:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.553520:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50fd5 lrc: 3/0,1 mode: PW/PW res: [0x2b69b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553522:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b54a65c7/0x3234de053c4bd3a lrc: 0/0,0 mode: --/PR res: [0x2b69c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc62c expref: 1197 pid: 80280 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.553523:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50fd5 lrc: 4/0,1 mode: PW/PW res: [0x2b69b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553525:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.553526:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.553527:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50fdc lrc: 3/0,1 mode: PW/PW res: [0x2b69c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.553531:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.553537:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1196:41279:x1731746396313024:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (182us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.553538:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50fdc lrc: 4/0,1 mode: PW/PW res: [0x2b69c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.553539:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12153 00000100:00100000:1.0:1651529344.553544:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12155 00010000:00010000:0.0:1651529344.553546:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.553551:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000534d68d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1195:41279:x1731746396313088:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.553552:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1195:41278:x1731746396312960:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (192us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.553554:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.553554:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12154 00010000:00010000:1.0:1651529344.553556:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000bdbd971/0x3234de053c4f0b7 lrc: 4/0,0 mode: PR/PR res: [0x2b69e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7580 expref: 1195 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.553559:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000bdbd971/0x3234de053c4f0b7 lrc: 3/0,0 mode: PR/PR res: [0x2b69e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7580 expref: 1194 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.553559:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12156 00000100:00100000:0.0:1651529344.553561:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1194:41278:x1731746396313152:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.553563:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.553564:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000bdbd971/0x3234de053c4f0b7 lrc: 0/0,0 mode: --/PR res: [0x2b69e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7580 expref: 1194 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.553564:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000043037897/0x3234de053c4eef0 lrc: 4/0,0 mode: PR/PR res: [0x2b69d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e2c expref: 1194 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.553568:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.553568:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.553568:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000043037897/0x3234de053c4eef0 lrc: 3/0,0 mode: PR/PR res: [0x2b69d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e2c expref: 1193 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.553569:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50fe3 lrc: 3/0,1 mode: PW/PW res: [0x2b69e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.553572:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50fe3 lrc: 4/0,1 mode: PW/PW res: [0x2b69e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553573:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043037897/0x3234de053c4eef0 lrc: 0/0,0 mode: --/PR res: [0x2b69d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e2c expref: 1193 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.553576:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.553577:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.553580:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.553583:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50fea lrc: 3/0,1 mode: PW/PW res: [0x2b69d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.553585:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000534d68d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1192:41279:x1731746396313088:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (220us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.553587:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50fea lrc: 4/0,1 mode: PW/PW res: [0x2b69d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.553588:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12155 00010000:00010000:0.0:1651529344.553598:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.553604:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003e05029b/0x3234de053c50fc7 lrc: 3/0,1 mode: PW/PW res: [0x2b697:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.553604:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1191:41278:x1731746396313152:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.553606:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12156 00010000:00010000:1.0:1651529344.553608:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e05029b/0x3234de053c50fc7 lrc: 3/0,1 mode: PW/PW res: [0x2b697:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.553611:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e05029b/0x3234de053c50fc7 lrc: 3/0,1 mode: PW/PW res: [0x2b697:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553613:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50fce lrc: 3/0,1 mode: PW/PW res: [0x2b699:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.553614:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e05029b/0x3234de053c50fc7 lrc: 2/0,0 mode: PW/PW res: [0x2b697:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553616:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50fce lrc: 3/0,1 mode: PW/PW res: [0x2b699:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553619:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50fce lrc: 3/0,1 mode: PW/PW res: [0x2b699:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553628:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50fce lrc: 2/0,0 mode: PW/PW res: [0x2b699:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.553661:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+870:39030:x1731745946431552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1104us (1202us total) trans 12885079422 rc 0/0 00000100:00100000:1.0:1651529344.553664:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211369 00010000:00010000:1.0:1651529344.553671:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50fb9 lrc: 3/0,1 mode: PW/PW res: [0x2b698:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.553674:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50fb9 lrc: 3/0,1 mode: PW/PW res: [0x2b698:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.553675:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+869:39030:x1731745946431680:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1090us (1196us total) trans 12885079423 rc 0/0 00010000:00010000:1.0:1651529344.553678:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50fb9 lrc: 3/0,1 mode: PW/PW res: [0x2b698:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.553678:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211370 00010000:00010000:1.0:1651529344.553680:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50fb9 lrc: 2/0,0 mode: PW/PW res: [0x2b698:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553694:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e05029b/0x3234de053c50fc7 lrc: 2/0,0 mode: PW/PW res: [0x2b697:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553697:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003e05029b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.553698:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e05029b/0x3234de053c50fc7 lrc: 2/0,0 mode: PW/PW res: [0x2b697:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553704:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e05029b/0x3234de053c50fc7 lrc: 3/0,0 mode: PW/PW res: [0x2b697:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553709:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e05029b/0x3234de053c50fc7 lrc: 1/0,0 mode: --/PW res: [0x2b697:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553711:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e05029b/0x3234de053c50fc7 lrc: 0/0,0 mode: --/PW res: [0x2b697:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.553716:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+869:39030:x1731745946431616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1225us (1276us total) trans 12885079424 rc 0/0 00010000:00010000:0.0:1651529344.553716:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50fce lrc: 2/0,0 mode: PW/PW res: [0x2b699:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.553719:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211367 00010000:00010000:0.0:1651529344.553719:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000085580035 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.553720:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50fce lrc: 2/0,0 mode: PW/PW res: [0x2b699:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553722:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50fce lrc: 3/0,0 mode: PW/PW res: [0x2b699:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553725:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50fce lrc: 1/0,0 mode: --/PW res: [0x2b699:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.553726:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50fea lrc: 3/0,1 mode: PW/PW res: [0x2b69d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553728:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c50fce lrc: 0/0,0 mode: --/PW res: [0x2b699:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.553729:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50fea lrc: 3/0,1 mode: PW/PW res: [0x2b69d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553731:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50fb9 lrc: 2/0,0 mode: PW/PW res: [0x2b698:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.553745:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50fea lrc: 3/0,1 mode: PW/PW res: [0x2b69d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553746:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005d8a4887 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.553747:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50fb9 lrc: 2/0,0 mode: PW/PW res: [0x2b698:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.553748:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50fea lrc: 2/0,0 mode: PW/PW res: [0x2b69d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553750:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50fb9 lrc: 3/0,0 mode: PW/PW res: [0x2b698:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553753:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50fb9 lrc: 1/0,0 mode: --/PW res: [0x2b698:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553755:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c50fb9 lrc: 0/0,0 mode: --/PW res: [0x2b698:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553759:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50fea lrc: 2/0,0 mode: PW/PW res: [0x2b69d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553762:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d9ada8a3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.553763:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50fea lrc: 2/0,0 mode: PW/PW res: [0x2b69d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553765:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50fea lrc: 3/0,0 mode: PW/PW res: [0x2b69d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553768:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50fea lrc: 1/0,0 mode: --/PW res: [0x2b69d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553771:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9ada8a3/0x3234de053c50fea lrc: 0/0,0 mode: --/PW res: [0x2b69d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553779:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50fe3 lrc: 3/0,1 mode: PW/PW res: [0x2b69e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.553782:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+869:39030:x1731745946431936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1020us (1125us total) trans 12885079425 rc 0/0 00010000:00010000:0.0:1651529344.553782:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50fe3 lrc: 3/0,1 mode: PW/PW res: [0x2b69e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.553784:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211374 00010000:00010000:0.0:1651529344.553785:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50fe3 lrc: 3/0,1 mode: PW/PW res: [0x2b69e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553787:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50fe3 lrc: 2/0,0 mode: PW/PW res: [0x2b69e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.553791:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50fdc lrc: 3/0,1 mode: PW/PW res: [0x2b69c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.553794:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50fdc lrc: 3/0,1 mode: PW/PW res: [0x2b69c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.553797:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50fdc lrc: 3/0,1 mode: PW/PW res: [0x2b69c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.553799:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50fdc lrc: 2/0,0 mode: PW/PW res: [0x2b69c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.553832:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+870:39030:x1731745946432000:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1125us (1197us total) trans 12885079426 rc 0/0 00000100:00100000:0.0:1651529344.553835:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211373 00000100:00100000:1.0:1651529344.553837:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+870:39030:x1731745946431872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1140us (1218us total) trans 12885079427 rc 0/0 00000100:00100000:1.0:1651529344.553839:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211372 00010000:00010000:0.0:1651529344.553842:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50fe3 lrc: 2/0,0 mode: PW/PW res: [0x2b69e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553845:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000069f7ba22 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.553846:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50fe3 lrc: 2/0,0 mode: PW/PW res: [0x2b69e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553848:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50fe3 lrc: 3/0,0 mode: PW/PW res: [0x2b69e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553853:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50fe3 lrc: 1/0,0 mode: --/PW res: [0x2b69e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553856:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c50fe3 lrc: 0/0,0 mode: --/PW res: [0x2b69e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553860:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50fdc lrc: 2/0,0 mode: PW/PW res: [0x2b69c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553862:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009880d77c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.553863:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50fdc lrc: 2/0,0 mode: PW/PW res: [0x2b69c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553866:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50fdc lrc: 3/0,0 mode: PW/PW res: [0x2b69c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553869:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50fdc lrc: 1/0,0 mode: --/PW res: [0x2b69c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553872:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009880d77c/0x3234de053c50fdc lrc: 0/0,0 mode: --/PW res: [0x2b69c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553877:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50fd5 lrc: 3/0,1 mode: PW/PW res: [0x2b69b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553880:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50fd5 lrc: 3/0,1 mode: PW/PW res: [0x2b69b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553883:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50fd5 lrc: 3/0,1 mode: PW/PW res: [0x2b69b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553886:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50fd5 lrc: 2/0,0 mode: PW/PW res: [0x2b69b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.553927:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+869:39029:x1731745946431808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1271us (1321us total) trans 12885079428 rc 0/0 00000100:00100000:0.0:1651529344.553930:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211371 00010000:00010000:0.0:1651529344.553959:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50fd5 lrc: 2/0,0 mode: PW/PW res: [0x2b69b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553963:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000002904524 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.553964:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50fd5 lrc: 2/0,0 mode: PW/PW res: [0x2b69b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553968:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50fd5 lrc: 3/0,0 mode: PW/PW res: [0x2b69b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553972:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50fd5 lrc: 1/0,0 mode: --/PW res: [0x2b69b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553975:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c50fd5 lrc: 0/0,0 mode: --/PW res: [0x2b69b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553981:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50fc0 lrc: 3/0,1 mode: PW/PW res: [0x2b69a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.553984:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50fc0 lrc: 3/0,1 mode: PW/PW res: [0x2b69a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554003:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50fc0 lrc: 3/0,1 mode: PW/PW res: [0x2b69a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554006:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50fc0 lrc: 2/0,0 mode: PW/PW res: [0x2b69a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.554052:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+869:39030:x1731745946431744:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1556us (1600us total) trans 12885079429 rc 0/0 00000100:00100000:0.0:1651529344.554055:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211368 00010000:00010000:0.0:1651529344.554062:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50fc0 lrc: 2/0,0 mode: PW/PW res: [0x2b69a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554066:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001d253066 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.554067:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50fc0 lrc: 2/0,0 mode: PW/PW res: [0x2b69a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554069:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50fc0 lrc: 3/0,0 mode: PW/PW res: [0x2b69a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554074:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50fc0 lrc: 1/0,0 mode: --/PW res: [0x2b69a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554077:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c50fc0 lrc: 0/0,0 mode: --/PW res: [0x2b69a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.554167:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.554178:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946432576 00000100:00100000:0.0:1651529344.554187:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211375 00000100:00100000:0.0:1651529344.554188:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+869:39029:x1731745946432576:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.554191:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.554194:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177823 count 1 00010000:00010000:0.0:1651529344.554198:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50ff1 lrc: 3/0,1 mode: --/PW res: [0x2b69f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.554200:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.554202:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c4f3ea lrc: 2/0,0 mode: PR/PR res: [0x2b69f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8222 expref: 1190 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.554210:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.554212:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.554213:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.554214:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50ff1 lrc: 4/0,1 mode: --/PW res: [0x2b69f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.554216:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.554235:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.554249:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.554255:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c4f3ea lrc: 3/0,0 mode: PR/PR res: [0x2b69f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8222 expref: 1190 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.554256:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.554259:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c4f3ea lrc: 4/0,0 mode: PR/PR res: [0x2b69f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8222 expref: 1190 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.554263:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946432640 00000100:00100000:0.0:1651529344.554263:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000027e31dd1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996994752:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.554270:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946432704 00000100:00100000:1.0:1651529344.554276:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946432768 00000100:00100000:1.0:1651529344.554278:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946432896 00000100:00100000:1.0:1651529344.554281:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946432832 00000100:00100000:1.0:1651529344.554283:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946432960 00000100:00100000:0.0:1651529344.554283:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 000000000a4def41 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.554285:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946433024 00000100:00100000:1.0:1651529344.554288:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211376 00000100:00100000:1.0:1651529344.554289:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+876:39030:x1731745946432640:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.554290:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211377 00000100:00100000:0.0:1651529344.554292:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+876:39029:x1731745946432704:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.554295:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177824 count 1 00002000:00080000:0.0:1651529344.554297:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177825 count 1 00010000:00010000:1.0:1651529344.554299:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50ff8 lrc: 3/0,1 mode: --/PW res: [0x2b6a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554301:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50fff lrc: 3/0,1 mode: --/PW res: [0x2b6a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.554304:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a4a9e253/0x3234de053c4eb38 lrc: 2/0,0 mode: PR/PR res: [0x2b6a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e7a expref: 1190 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.554307:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.554308:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.554308:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000919d1ea6/0x3234de053c4e3b3 lrc: 2/0,0 mode: PR/PR res: [0x2b6a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3fe1 expref: 1190 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.554309:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50ff8 lrc: 4/0,1 mode: --/PW res: [0x2b6a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554311:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.554312:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.554312:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50fff lrc: 4/0,1 mode: --/PW res: [0x2b6a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.554315:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a4a9e253/0x3234de053c4eb38 lrc: 3/0,0 mode: PR/PR res: [0x2b6a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e7a expref: 1190 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.554319:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000919d1ea6/0x3234de053c4e3b3 lrc: 3/0,0 mode: PR/PR res: [0x2b6a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3fe1 expref: 1190 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.554322:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a4a9e253/0x3234de053c4eb38 lrc: 4/0,0 mode: PR/PR res: [0x2b6a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e7a expref: 1190 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.554322:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000919d1ea6/0x3234de053c4e3b3 lrc: 4/0,0 mode: PR/PR res: [0x2b6a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3fe1 expref: 1190 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.554326:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006647e4ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996994816:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.554326:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000034e35367 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996994880:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.554333:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 0000000029ae2bb2 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.554336:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f9dac3f6 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.554339:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211378 00000100:00100000:0.0:1651529344.554341:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+876:39030:x1731745946432768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.554342:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211379 00000100:00100000:1.0:1651529344.554344:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+876:39030:x1731745946432896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.554345:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177826 count 1 00002000:00080000:1.0:1651529344.554348:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177828 count 1 00010000:00010000:0.0:1651529344.554348:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c51006 lrc: 3/0,1 mode: --/PW res: [0x2b6a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.554351:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c5100d lrc: 3/0,1 mode: --/PW res: [0x2b6a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554352:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000059d31bf4/0x3234de053c4f556 lrc: 2/0,0 mode: PR/PR res: [0x2b6a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d87c4 expref: 1190 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.554355:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.554356:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009f3cda3b/0x3234de053c4e0f0 lrc: 2/0,0 mode: PR/PR res: [0x2b6a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d346c expref: 1190 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.554356:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.554356:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c51006 lrc: 4/0,1 mode: --/PW res: [0x2b6a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.554359:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.554359:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.554360:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c5100d lrc: 4/0,1 mode: --/PW res: [0x2b6a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554362:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000059d31bf4/0x3234de053c4f556 lrc: 3/0,0 mode: PR/PR res: [0x2b6a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d87c4 expref: 1190 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.554365:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000059d31bf4/0x3234de053c4f556 lrc: 4/0,0 mode: PR/PR res: [0x2b6a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d87c4 expref: 1190 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.554366:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009f3cda3b/0x3234de053c4e0f0 lrc: 3/0,0 mode: PR/PR res: [0x2b6a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d346c expref: 1190 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.554369:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009f3cda3b/0x3234de053c4e0f0 lrc: 4/0,0 mode: PR/PR res: [0x2b6a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d346c expref: 1190 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.554369:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000264aecf8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996994944:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.554375:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e1aa6a77 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.554376:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005a17dd72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996995008:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.554380:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211380 00000100:00100000:0.0:1651529344.554382:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+876:39030:x1731745946432832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.554383:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a5495eb going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.554385:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177827 count 1 00000100:00100000:1.0:1651529344.554388:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211381 00010000:00010000:0.0:1651529344.554388:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c51014 lrc: 3/0,1 mode: --/PW res: [0x2b6a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.554390:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a13808c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+876:39030:x1731745946432960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.554392:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd649927/0x3234de053c4ea89 lrc: 2/0,0 mode: PR/PR res: [0x2b6a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5bef expref: 1190 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.554394:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177829 count 1 00010000:00010000:0.0:1651529344.554395:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.554396:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.554396:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c51014 lrc: 4/0,1 mode: --/PW res: [0x2b6a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.554397:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c5101b lrc: 3/0,1 mode: --/PW res: [0x2b6a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.554401:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f4101dd9/0x3234de053c4b0bb lrc: 2/0,0 mode: PR/PR res: [0x2b6a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc060 expref: 1190 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.554402:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fd649927/0x3234de053c4ea89 lrc: 3/0,0 mode: PR/PR res: [0x2b6a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5bef expref: 1190 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.554404:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.554404:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.554405:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c5101b lrc: 4/0,1 mode: --/PW res: [0x2b6a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554408:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fd649927/0x3234de053c4ea89 lrc: 4/0,0 mode: PR/PR res: [0x2b6a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5bef expref: 1190 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.554410:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f4101dd9/0x3234de053c4b0bb lrc: 3/0,0 mode: PR/PR res: [0x2b6a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc060 expref: 1190 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.554412:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004bb67ba4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996995072:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.554414:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f4101dd9/0x3234de053c4b0bb lrc: 4/0,0 mode: PR/PR res: [0x2b6a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc060 expref: 1190 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.554418:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000078a40aa9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996995136:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.554418:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000000d706dff going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.554423:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211382 00000100:00100000:1.0:1651529344.554424:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000babe2d90 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.554425:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+876:39030:x1731745946433024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.554428:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177830 count 1 00010000:00010000:0.0:1651529344.554431:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c51022 lrc: 3/0,1 mode: --/PW res: [0x2b6a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554435:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008333cc77/0x3234de053c4e18a lrc: 2/0,0 mode: PR/PR res: [0x2b6a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d376e expref: 1190 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.554438:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.554439:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.554439:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c51022 lrc: 4/0,1 mode: --/PW res: [0x2b6a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554445:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008333cc77/0x3234de053c4e18a lrc: 3/0,0 mode: PR/PR res: [0x2b6a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d376e expref: 1190 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.554449:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008333cc77/0x3234de053c4e18a lrc: 4/0,0 mode: PR/PR res: [0x2b6a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d376e expref: 1190 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.554455:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d523a75 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996995200:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.554461:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed830649 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.554863:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.554868:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000034e35367 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996994880:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.554872:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.554873:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50fff lrc: 3/0,1 mode: --/PW res: [0x2b6a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.554881:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396313728 00010000:00010000:1.0:1651529344.554887:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c4f3ea lrc: 4/0,0 mode: PR/PR res: [0x2b69f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8222 expref: 1191 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.554887:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000027e31dd1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996994752:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.554889:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50ff1 lrc: 3/0,1 mode: --/PW res: [0x2b69f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.554894:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396313792 00010000:00010000:1.0:1651529344.554896:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000919d1ea6/0x3234de053c4e3b3 lrc: 4/0,0 mode: PR/PR res: [0x2b6a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3fe1 expref: 1192 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.554896:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12157 00000100:00100000:0.0:1651529344.554898:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1192:41279:x1731746396313728:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.554902:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12158 00010000:00010000:0.0:1651529344.554902:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.554903:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c4f3ea lrc: 4/0,0 mode: PR/PR res: [0x2b69f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8222 expref: 1192 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.554904:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1192:41278:x1731746396313792:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.554907:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.554907:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c4f3ea lrc: 3/0,0 mode: PR/PR res: [0x2b69f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8222 expref: 1192 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.554908:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000919d1ea6/0x3234de053c4e3b3 lrc: 4/0,0 mode: PR/PR res: [0x2b6a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3fe1 expref: 1192 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.554912:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000919d1ea6/0x3234de053c4e3b3 lrc: 3/0,0 mode: PR/PR res: [0x2b6a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3fe1 expref: 1192 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.554913:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c4f3ea lrc: 0/0,0 mode: --/PR res: [0x2b69f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8222 expref: 1192 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.554917:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.554917:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.554918:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000919d1ea6/0x3234de053c4e3b3 lrc: 0/0,0 mode: --/PR res: [0x2b6a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3fe1 expref: 1191 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.554918:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50ff1 lrc: 3/0,1 mode: PW/PW res: [0x2b69f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.554921:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.554921:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50ff1 lrc: 4/0,1 mode: PW/PW res: [0x2b69f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.554922:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.554923:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50fff lrc: 3/0,1 mode: PW/PW res: [0x2b6a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.554926:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50fff lrc: 4/0,1 mode: PW/PW res: [0x2b6a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554927:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.554938:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.554942:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1190:41279:x1731746396313728:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 37us (73us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.554945:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1190:41278:x1731746396313792:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 40us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.554945:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12157 00000100:00100000:1.0:1651529344.554947:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12158 00010000:00010000:0.0:1651529344.554952:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50fff lrc: 3/0,1 mode: PW/PW res: [0x2b6a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554956:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50fff lrc: 3/0,1 mode: PW/PW res: [0x2b6a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554959:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50fff lrc: 3/0,1 mode: PW/PW res: [0x2b6a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.554962:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50fff lrc: 2/0,0 mode: PW/PW res: [0x2b6a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.555010:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+877:39029:x1731745946432704:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 717us (809us total) trans 12885079430 rc 0/0 00000100:00100000:0.0:1651529344.555013:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211377 00010000:00010000:0.0:1651529344.555021:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50fff lrc: 2/0,0 mode: PW/PW res: [0x2b6a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555027:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006abc37e1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.555028:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50fff lrc: 2/0,0 mode: PW/PW res: [0x2b6a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555031:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50fff lrc: 3/0,0 mode: PW/PW res: [0x2b6a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555035:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50fff lrc: 1/0,0 mode: --/PW res: [0x2b6a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555038:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006abc37e1/0x3234de053c50fff lrc: 0/0,0 mode: --/PW res: [0x2b6a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555044:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50ff1 lrc: 3/0,1 mode: PW/PW res: [0x2b69f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555047:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50ff1 lrc: 3/0,1 mode: PW/PW res: [0x2b69f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555050:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50ff1 lrc: 3/0,1 mode: PW/PW res: [0x2b69f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555053:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50ff1 lrc: 2/0,0 mode: PW/PW res: [0x2b69f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.555111:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+877:39029:x1731745946432576:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 922us (951us total) trans 12885079431 rc 0/0 00000100:00100000:0.0:1651529344.555115:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211375 00010000:00010000:0.0:1651529344.555122:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50ff1 lrc: 2/0,0 mode: PW/PW res: [0x2b69f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555126:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000048c07243 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.555127:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50ff1 lrc: 2/0,0 mode: PW/PW res: [0x2b69f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555130:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50ff1 lrc: 3/0,0 mode: PW/PW res: [0x2b69f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555135:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50ff1 lrc: 1/0,0 mode: --/PW res: [0x2b69f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555137:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c50ff1 lrc: 0/0,0 mode: --/PW res: [0x2b69f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.555152:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006647e4ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996994816:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.555157:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50ff8 lrc: 3/0,1 mode: --/PW res: [0x2b6a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.555164:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005a17dd72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996995008:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.555167:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c5100d lrc: 3/0,1 mode: --/PW res: [0x2b6a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.555185:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.555201:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000264aecf8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996994944:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.555206:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c51006 lrc: 3/0,1 mode: --/PW res: [0x2b6a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.555214:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946433472 00000100:00100000:0.0:1651529344.555241:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211383 00000100:00100000:0.0:1651529344.555243:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+877:39029:x1731745946433472:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.555251:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.555257:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.555263:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.555269:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:0.0:1651529344.555282:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177831 count 1 00000100:00100000:1.0:1651529344.555286:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.555287:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51029 lrc: 3/0,1 mode: --/PW res: [0x2b6a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.555296:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.555298:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000011253cb5/0x3234de053c4daa6 lrc: 2/0,0 mode: PR/PR res: [0x2b6a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ae2 expref: 1188 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.555301:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.555301:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.555301:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.555302:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51029 lrc: 4/0,1 mode: --/PW res: [0x2b6a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.555309:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000078a40aa9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996995136:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.555309:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000011253cb5/0x3234de053c4daa6 lrc: 3/0,0 mode: PR/PR res: [0x2b6a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ae2 expref: 1188 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.555312:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000011253cb5/0x3234de053c4daa6 lrc: 4/0,0 mode: PR/PR res: [0x2b6a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ae2 expref: 1188 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.555313:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c5101b lrc: 3/0,1 mode: --/PW res: [0x2b6a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.555317:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000264aecf8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996995264:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.555319:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396313856 00010000:00010000:1.0:1651529344.555324:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a4a9e253/0x3234de053c4eb38 lrc: 4/0,0 mode: PR/PR res: [0x2b6a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e7a expref: 1189 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.555332:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a3b00cf3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.555335:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396313920 00010000:00010000:1.0:1651529344.555338:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000059d31bf4/0x3234de053c4f556 lrc: 4/0,0 mode: PR/PR res: [0x2b6a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d87c4 expref: 1190 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.555340:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946433536 00000100:00100000:1.0:1651529344.555343:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396314048 00010000:00010000:1.0:1651529344.555345:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fd649927/0x3234de053c4ea89 lrc: 5/0,0 mode: PR/PR res: [0x2b6a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5bef expref: 1191 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.555350:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211384 00000100:00100000:0.0:1651529344.555352:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+878:39029:x1731745946433536:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.555355:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396314176 00002000:00080000:0.0:1651529344.555356:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177832 count 1 00010000:00010000:1.0:1651529344.555357:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008333cc77/0x3234de053c4e18a lrc: 5/0,0 mode: PR/PR res: [0x2b6a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d376e expref: 1192 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.555360:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c51030 lrc: 3/0,1 mode: --/PW res: [0x2b6a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.555361:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396313984 00010000:00010000:1.0:1651529344.555363:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009f3cda3b/0x3234de053c4e0f0 lrc: 4/0,0 mode: PR/PR res: [0x2b6a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d346c expref: 1193 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.555364:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c4df14 lrc: 2/0,0 mode: PR/PR res: [0x2b6a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d73 expref: 1193 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.555367:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396314112 00010000:00010000:1.0:1651529344.555369:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f4101dd9/0x3234de053c4b0bb lrc: 4/0,0 mode: PR/PR res: [0x2b6a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc060 expref: 1194 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.555370:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.555371:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.555371:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c51030 lrc: 4/0,1 mode: --/PW res: [0x2b6a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.555374:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12159 00000100:00100000:1.0:1651529344.555375:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1194:41279:x1731746396313856:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.555378:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c4df14 lrc: 3/0,0 mode: PR/PR res: [0x2b6a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d73 expref: 1194 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.555379:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.555380:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a4a9e253/0x3234de053c4eb38 lrc: 4/0,0 mode: PR/PR res: [0x2b6a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e7a expref: 1194 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.555381:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c4df14 lrc: 4/0,0 mode: PR/PR res: [0x2b6a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d73 expref: 1194 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.555385:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000027e31dd1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996995328:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.555386:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a4a9e253/0x3234de053c4eb38 lrc: 3/0,0 mode: PR/PR res: [0x2b6a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e7a expref: 1194 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.555392:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4a9e253/0x3234de053c4eb38 lrc: 0/0,0 mode: --/PR res: [0x2b6a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e7a expref: 1194 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.555392:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 0000000029ae2bb2 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.555395:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.555396:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.555397:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50ff8 lrc: 3/0,1 mode: PW/PW res: [0x2b6a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.555400:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50ff8 lrc: 4/0,1 mode: PW/PW res: [0x2b6a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.555400:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004bb67ba4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996995072:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.555403:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c51014 lrc: 3/0,1 mode: --/PW res: [0x2b6a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.555406:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.555410:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d523a75 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996995200:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.555412:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c51022 lrc: 3/0,1 mode: --/PW res: [0x2b6a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.555413:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1193:41279:x1731746396313856:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 37us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.555416:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12159 00000100:00100000:0.0:1651529344.555419:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12160 00000100:00100000:1.0:1651529344.555421:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12161 00000100:00100000:0.0:1651529344.555421:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1192:41279:x1731746396313920:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.555423:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1192:41278:x1731746396314048:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.555424:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.555425:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.555426:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000059d31bf4/0x3234de053c4f556 lrc: 4/0,0 mode: PR/PR res: [0x2b6a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d87c4 expref: 1192 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.555427:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fd649927/0x3234de053c4ea89 lrc: 4/0,0 mode: PR/PR res: [0x2b6a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5bef expref: 1192 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.555429:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000059d31bf4/0x3234de053c4f556 lrc: 3/0,0 mode: PR/PR res: [0x2b6a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d87c4 expref: 1192 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.555430:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fd649927/0x3234de053c4ea89 lrc: 3/0,0 mode: PR/PR res: [0x2b6a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5bef expref: 1192 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.555435:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd649927/0x3234de053c4ea89 lrc: 0/0,0 mode: --/PR res: [0x2b6a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5bef expref: 1192 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.555435:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059d31bf4/0x3234de053c4f556 lrc: 0/0,0 mode: --/PR res: [0x2b6a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d87c4 expref: 1192 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.555439:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.555439:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.555439:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.555440:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c51014 lrc: 3/0,1 mode: PW/PW res: [0x2b6a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555440:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.555440:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c51006 lrc: 3/0,1 mode: PW/PW res: [0x2b6a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.555443:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c51014 lrc: 4/0,1 mode: PW/PW res: [0x2b6a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555443:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c51006 lrc: 4/0,1 mode: PW/PW res: [0x2b6a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.555452:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.555456:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.555457:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1190:41278:x1731746396314048:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.555460:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12161 00000100:00100000:0.0:1651529344.555463:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1189:41279:x1731746396313920:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 41us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.555464:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12162 00000100:00100000:1.0:1651529344.555465:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c680c11 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1189:41278:x1731746396314176:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.555466:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12160 00010000:00010000:1.0:1651529344.555467:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.555469:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008333cc77/0x3234de053c4e18a lrc: 4/0,0 mode: PR/PR res: [0x2b6a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d376e expref: 1188 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.555471:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12163 00010000:00010000:1.0:1651529344.555472:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008333cc77/0x3234de053c4e18a lrc: 3/0,0 mode: PR/PR res: [0x2b6a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d376e expref: 1188 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.555473:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1188:41279:x1731746396313984:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.555475:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.555477:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008333cc77/0x3234de053c4e18a lrc: 0/0,0 mode: --/PR res: [0x2b6a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d376e expref: 1188 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.555477:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009f3cda3b/0x3234de053c4e0f0 lrc: 4/0,0 mode: PR/PR res: [0x2b6a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d346c expref: 1188 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.555481:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009f3cda3b/0x3234de053c4e0f0 lrc: 3/0,0 mode: PR/PR res: [0x2b6a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d346c expref: 1188 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.555482:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.555483:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.555484:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c51022 lrc: 3/0,1 mode: PW/PW res: [0x2b6a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.555486:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c51022 lrc: 4/0,1 mode: PW/PW res: [0x2b6a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555486:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f3cda3b/0x3234de053c4e0f0 lrc: 0/0,0 mode: --/PR res: [0x2b6a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d346c expref: 1187 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.555490:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.555490:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.555491:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c5100d lrc: 3/0,1 mode: PW/PW res: [0x2b6a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.555494:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.555499:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c680c11 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1186:41278:x1731746396314176:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (230us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.555500:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c5100d lrc: 4/0,1 mode: PW/PW res: [0x2b6a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.555502:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12162 00010000:00010000:0.0:1651529344.555509:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.555516:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1185:41279:x1731746396313984:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.555517:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12164 00000100:00100000:1.0:1651529344.555519:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1185:41279:x1731746396314112:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.555519:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12163 00010000:00010000:1.0:1651529344.555522:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.555524:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f4101dd9/0x3234de053c4b0bb lrc: 4/0,0 mode: PR/PR res: [0x2b6a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc060 expref: 1184 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.555526:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c51006 lrc: 3/0,1 mode: PW/PW res: [0x2b6a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.555527:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f4101dd9/0x3234de053c4b0bb lrc: 3/0,0 mode: PR/PR res: [0x2b6a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc060 expref: 1184 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.555529:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c51006 lrc: 3/0,1 mode: PW/PW res: [0x2b6a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.555532:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4101dd9/0x3234de053c4b0bb lrc: 0/0,0 mode: --/PR res: [0x2b6a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc060 expref: 1184 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.555532:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c51006 lrc: 3/0,1 mode: PW/PW res: [0x2b6a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.555535:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.555535:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c51006 lrc: 2/0,0 mode: PW/PW res: [0x2b6a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.555536:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.555537:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c5101b lrc: 3/0,1 mode: PW/PW res: [0x2b6a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.555540:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c5101b lrc: 4/0,1 mode: PW/PW res: [0x2b6a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.555546:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.555550:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1183:41279:x1731746396314112:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 31us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.555553:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12164 00010000:00010000:1.0:1651529344.555561:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50ff8 lrc: 3/0,1 mode: PW/PW res: [0x2b6a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.555564:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50ff8 lrc: 3/0,1 mode: PW/PW res: [0x2b6a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.555567:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50ff8 lrc: 3/0,1 mode: PW/PW res: [0x2b6a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.555570:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50ff8 lrc: 2/0,0 mode: PW/PW res: [0x2b6a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.555584:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+879:39030:x1731745946432768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1235us (1367us total) trans 12885079432 rc 0/0 00000100:00100000:0.0:1651529344.555587:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211378 00010000:00010000:0.0:1651529344.555594:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c51006 lrc: 2/0,0 mode: PW/PW res: [0x2b6a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555598:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000005a52f96 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.555599:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c51006 lrc: 2/0,0 mode: PW/PW res: [0x2b6a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555602:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c51006 lrc: 3/0,0 mode: PW/PW res: [0x2b6a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555606:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c51006 lrc: 1/0,0 mode: --/PW res: [0x2b6a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555609:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005a52f96/0x3234de053c51006 lrc: 0/0,0 mode: --/PW res: [0x2b6a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.555613:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+879:39030:x1731745946432640:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1323us (1427us total) trans 12885079433 rc 0/0 00010000:00010000:0.0:1651529344.555614:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50ff8 lrc: 2/0,0 mode: PW/PW res: [0x2b6a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.555616:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211376 00010000:00010000:0.0:1651529344.555616:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eb2009d7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.555617:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50ff8 lrc: 2/0,0 mode: PW/PW res: [0x2b6a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555622:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50ff8 lrc: 3/0,0 mode: PW/PW res: [0x2b6a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.555623:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c5100d lrc: 3/0,1 mode: PW/PW res: [0x2b6a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555626:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50ff8 lrc: 1/0,0 mode: --/PW res: [0x2b6a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555628:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb2009d7/0x3234de053c50ff8 lrc: 0/0,0 mode: --/PW res: [0x2b6a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.555629:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c5100d lrc: 3/0,1 mode: PW/PW res: [0x2b6a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.555632:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c5100d lrc: 3/0,1 mode: PW/PW res: [0x2b6a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555634:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c51014 lrc: 3/0,1 mode: PW/PW res: [0x2b6a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.555635:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c5100d lrc: 2/0,0 mode: PW/PW res: [0x2b6a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555637:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c51014 lrc: 3/0,1 mode: PW/PW res: [0x2b6a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555639:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c51014 lrc: 3/0,1 mode: PW/PW res: [0x2b6a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555648:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c51014 lrc: 2/0,0 mode: PW/PW res: [0x2b6a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.555672:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+880:39030:x1731745946432896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1327us (1456us total) trans 12885079434 rc 0/0 00000100:00100000:1.0:1651529344.555675:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211379 00010000:00010000:1.0:1651529344.555681:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c5101b lrc: 3/0,1 mode: PW/PW res: [0x2b6a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.555684:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c5101b lrc: 3/0,1 mode: PW/PW res: [0x2b6a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.555684:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+879:39030:x1731745946432832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1302us (1462us total) trans 12885079435 rc 0/0 00010000:00010000:1.0:1651529344.555687:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c5101b lrc: 3/0,1 mode: PW/PW res: [0x2b6a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.555687:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211380 00010000:00010000:1.0:1651529344.555690:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c5101b lrc: 2/0,0 mode: PW/PW res: [0x2b6a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555704:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c5100d lrc: 2/0,0 mode: PW/PW res: [0x2b6a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555710:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000827909ec already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.555711:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c5100d lrc: 2/0,0 mode: PW/PW res: [0x2b6a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555714:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c5100d lrc: 3/0,0 mode: PW/PW res: [0x2b6a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555718:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c5100d lrc: 1/0,0 mode: --/PW res: [0x2b6a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555721:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000827909ec/0x3234de053c5100d lrc: 0/0,0 mode: --/PW res: [0x2b6a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555725:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c51014 lrc: 2/0,0 mode: PW/PW res: [0x2b6a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.555726:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a13808c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+879:39030:x1731745946432960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1335us (1477us total) trans 12885079436 rc 0/0 00010000:00010000:0.0:1651529344.555728:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001630f6d1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.555729:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c51014 lrc: 2/0,0 mode: PW/PW res: [0x2b6a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.555731:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211381 00010000:00010000:0.0:1651529344.555731:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c51014 lrc: 3/0,0 mode: PW/PW res: [0x2b6a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555744:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c51014 lrc: 1/0,0 mode: --/PW res: [0x2b6a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555747:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001630f6d1/0x3234de053c51014 lrc: 0/0,0 mode: --/PW res: [0x2b6a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555751:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c5101b lrc: 2/0,0 mode: PW/PW res: [0x2b6a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555754:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b3edbdf4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.555755:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c5101b lrc: 2/0,0 mode: PW/PW res: [0x2b6a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555757:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c5101b lrc: 3/0,0 mode: PW/PW res: [0x2b6a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555760:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c5101b lrc: 1/0,0 mode: --/PW res: [0x2b6a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555763:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3edbdf4/0x3234de053c5101b lrc: 0/0,0 mode: --/PW res: [0x2b6a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555770:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c51022 lrc: 3/0,1 mode: PW/PW res: [0x2b6a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555772:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c51022 lrc: 3/0,1 mode: PW/PW res: [0x2b6a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555775:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c51022 lrc: 3/0,1 mode: PW/PW res: [0x2b6a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555778:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c51022 lrc: 2/0,0 mode: PW/PW res: [0x2b6a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.555814:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+879:39030:x1731745946433024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1388us (1557us total) trans 12885079437 rc 0/0 00000100:00100000:0.0:1651529344.555817:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211382 00010000:00010000:0.0:1651529344.555823:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c51022 lrc: 2/0,0 mode: PW/PW res: [0x2b6a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555827:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027456046 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.555828:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c51022 lrc: 2/0,0 mode: PW/PW res: [0x2b6a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555831:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c51022 lrc: 3/0,0 mode: PW/PW res: [0x2b6a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555835:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c51022 lrc: 1/0,0 mode: --/PW res: [0x2b6a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.555838:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c51022 lrc: 0/0,0 mode: --/PW res: [0x2b6a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.555933:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000264aecf8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996995264:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.555964:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51029 lrc: 3/0,1 mode: --/PW res: [0x2b6a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.555983:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.555998:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.556008:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946433792 00000100:00100000:0.0:1651529344.556008:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.556015:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.556022:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946433920 00000100:00100000:0.0:1651529344.556025:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000027e31dd1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996995328:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.556028:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946434048 00000100:00100000:1.0:1651529344.556032:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946434176 00000100:00100000:1.0:1651529344.556038:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211385 00000100:00100000:1.0:1651529344.556040:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+882:39030:x1731745946433792:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.556045:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177833 count 1 00010000:00010000:0.0:1651529344.556053:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c51030 lrc: 3/0,1 mode: --/PW res: [0x2b6a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.556055:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e50ab3ae/0x3234de053c51037 lrc: 3/0,1 mode: --/PW res: [0x2b6a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.556060:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001e28e0da/0x3234de053c4e6ed lrc: 2/0,0 mode: PR/PR res: [0x2b6a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4cad expref: 1182 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.556062:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211386 00010000:00010000:1.0:1651529344.556063:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.556063:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+882:39030:x1731745946433920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.556064:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.556065:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e50ab3ae/0x3234de053c51037 lrc: 4/0,1 mode: --/PW res: [0x2b6a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.556069:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177834 count 1 00010000:00010000:1.0:1651529344.556071:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001e28e0da/0x3234de053c4e6ed lrc: 3/0,0 mode: PR/PR res: [0x2b6a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4cad expref: 1182 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.556073:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c5103e lrc: 3/0,1 mode: --/PW res: [0x2b6aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.556075:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001e28e0da/0x3234de053c4e6ed lrc: 4/0,0 mode: PR/PR res: [0x2b6a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4cad expref: 1182 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.556079:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000066de8c9f pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996995392:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.556089:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 0000000089d75f07 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.556091:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000021332347/0x3234de053c4f223 lrc: 2/0,0 mode: PR/PR res: [0x2b6aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b53 expref: 1182 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.556094:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.556095:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.556095:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c5103e lrc: 4/0,1 mode: --/PW res: [0x2b6aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.556096:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211387 00000100:00100000:1.0:1651529344.556097:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+882:39030:x1731745946434048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.556102:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177836 count 1 00010000:00010000:0.0:1651529344.556103:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000021332347/0x3234de053c4f223 lrc: 3/0,0 mode: PR/PR res: [0x2b6aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b53 expref: 1182 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.556105:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c51045 lrc: 3/0,1 mode: --/PW res: [0x2b6ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556106:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000021332347/0x3234de053c4f223 lrc: 4/0,0 mode: PR/PR res: [0x2b6aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b53 expref: 1182 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.556109:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001abce4d8/0x3234de053c4dd8c lrc: 2/0,0 mode: PR/PR res: [0x2b6ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2761 expref: 1182 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.556110:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000027e31dd1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996995456:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.556112:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.556113:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.556113:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c51045 lrc: 4/0,1 mode: --/PW res: [0x2b6ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.556119:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001abce4d8/0x3234de053c4dd8c lrc: 3/0,0 mode: PR/PR res: [0x2b6ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2761 expref: 1182 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.556119:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 0000000029ae2bb2 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.556123:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001abce4d8/0x3234de053c4dd8c lrc: 4/0,0 mode: PR/PR res: [0x2b6ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2761 expref: 1182 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.556126:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211388 00000100:00100000:1.0:1651529344.556127:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000076d5f96b pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996995520:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.556128:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+882:39030:x1731745946434176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.556132:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177838 count 1 00000100:00100000:1.0:1651529344.556133:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f9dac3f6 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.556136:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c5104c lrc: 3/0,1 mode: --/PW res: [0x2b6ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556140:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000056390483/0x3234de053c4cfb6 lrc: 2/0,0 mode: PR/PR res: [0x2b6ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf072 expref: 1182 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.556143:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.556144:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.556144:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c5104c lrc: 4/0,1 mode: --/PW res: [0x2b6ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.556146:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.556150:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000056390483/0x3234de053c4cfb6 lrc: 3/0,0 mode: PR/PR res: [0x2b6ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf072 expref: 1182 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.556154:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000056390483/0x3234de053c4cfb6 lrc: 4/0,0 mode: PR/PR res: [0x2b6ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf072 expref: 1182 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.556157:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a138afb6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996995584:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.556160:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.556164:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a3b00cf3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.556169:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946433984 00000100:00100000:1.0:1651529344.556172:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.556181:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946434112 00000100:00100000:0.0:1651529344.556188:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211389 00000100:00100000:0.0:1651529344.556189:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+884:39030:x1731745946433984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.556194:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:0.0:1651529344.556195:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177835 count 1 00010000:00010000:0.0:1651529344.556199:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c51053 lrc: 3/0,1 mode: --/PW res: [0x2b6ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556203:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001c02002e/0x3234de053c4a706 lrc: 2/0,0 mode: PR/PR res: [0x2b6ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbbf2 expref: 1182 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.556206:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.556206:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.556207:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c51053 lrc: 4/0,1 mode: --/PW res: [0x2b6ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556213:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001c02002e/0x3234de053c4a706 lrc: 3/0,0 mode: PR/PR res: [0x2b6ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbbf2 expref: 1182 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.556216:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001c02002e/0x3234de053c4a706 lrc: 4/0,0 mode: PR/PR res: [0x2b6ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbbf2 expref: 1182 pid: 151609 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.556220:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000023afca5e pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996995648:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.556241:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211390 00000100:00100000:1.0:1651529344.556243:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000e07233e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+884:39030:x1731745946434112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.556250:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060852af0 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.556254:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177837 count 1 00010000:00010000:1.0:1651529344.556258:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c5105a lrc: 3/0,1 mode: --/PW res: [0x2b6ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.556263:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000e3a7232/0x3234de053c4ca45 lrc: 2/0,0 mode: PR/PR res: [0x2b6ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdaca expref: 1182 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.556266:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.556267:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.556268:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c5105a lrc: 4/0,1 mode: --/PW res: [0x2b6ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.556274:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000e3a7232/0x3234de053c4ca45 lrc: 3/0,0 mode: PR/PR res: [0x2b6ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdaca expref: 1182 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.556278:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000e3a7232/0x3234de053c4ca45 lrc: 4/0,0 mode: PR/PR res: [0x2b6ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdaca expref: 1182 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.556289:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d28c414b pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996995712:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.556303:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000babe2d90 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.556309:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396314752 00010000:00010000:1.0:1651529344.556314:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000011253cb5/0x3234de053c4daa6 lrc: 4/0,0 mode: PR/PR res: [0x2b6a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ae2 expref: 1183 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.556321:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396314816 00010000:00010000:1.0:1651529344.556331:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c4df14 lrc: 4/0,0 mode: PR/PR res: [0x2b6a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d73 expref: 1184 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.556343:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12165 00000100:00100000:1.0:1651529344.556344:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1184:41279:x1731746396314752:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.556347:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.556349:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000011253cb5/0x3234de053c4daa6 lrc: 4/0,0 mode: PR/PR res: [0x2b6a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ae2 expref: 1184 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.556352:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000011253cb5/0x3234de053c4daa6 lrc: 3/0,0 mode: PR/PR res: [0x2b6a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ae2 expref: 1184 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.556358:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011253cb5/0x3234de053c4daa6 lrc: 0/0,0 mode: --/PR res: [0x2b6a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ae2 expref: 1184 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.556359:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12166 00000100:00100000:0.0:1651529344.556361:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1183:41278:x1731746396314816:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.556362:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.556362:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.556363:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51029 lrc: 3/0,1 mode: PW/PW res: [0x2b6a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556365:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.556366:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51029 lrc: 4/0,1 mode: PW/PW res: [0x2b6a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556367:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c4df14 lrc: 4/0,0 mode: PR/PR res: [0x2b6a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d73 expref: 1183 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.556372:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c4df14 lrc: 3/0,0 mode: PR/PR res: [0x2b6a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d73 expref: 1183 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.556374:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.556381:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1183:41279:x1731746396314752:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 36us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.556384:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12165 00010000:00010000:0.0:1651529344.556404:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c4df14 lrc: 0/0,0 mode: --/PR res: [0x2b6a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d73 expref: 1182 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.556409:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.556409:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.556410:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c51030 lrc: 3/0,1 mode: PW/PW res: [0x2b6a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556413:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c51030 lrc: 4/0,1 mode: PW/PW res: [0x2b6a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556420:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.556434:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1181:41278:x1731746396314816:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 72us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.556441:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12166 00010000:00010000:0.0:1651529344.556448:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c51030 lrc: 3/0,1 mode: PW/PW res: [0x2b6a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556451:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c51030 lrc: 3/0,1 mode: PW/PW res: [0x2b6a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556455:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c51030 lrc: 3/0,1 mode: PW/PW res: [0x2b6a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556457:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c51030 lrc: 2/0,0 mode: PW/PW res: [0x2b6a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.556468:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000076d5f96b pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996995520:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.556473:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c51045 lrc: 3/0,1 mode: --/PW res: [0x2b6ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.556479:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000066de8c9f pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996995392:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.556482:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e50ab3ae/0x3234de053c51037 lrc: 3/0,1 mode: --/PW res: [0x2b6a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.556504:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+885:39029:x1731745946433536:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1151us (1217us total) trans 12885079438 rc 0/0 00000100:00100000:0.0:1651529344.556507:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211384 00010000:00010000:0.0:1651529344.556514:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c51030 lrc: 2/0,0 mode: PW/PW res: [0x2b6a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556517:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b855716b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.556518:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c51030 lrc: 2/0,0 mode: PW/PW res: [0x2b6a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556521:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c51030 lrc: 3/0,0 mode: PW/PW res: [0x2b6a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556526:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c51030 lrc: 1/0,0 mode: --/PW res: [0x2b6a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556529:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c51030 lrc: 0/0,0 mode: --/PW res: [0x2b6a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.556538:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000027e31dd1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996995456:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.556542:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c5103e lrc: 3/0,1 mode: --/PW res: [0x2b6aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556547:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51029 lrc: 3/0,1 mode: PW/PW res: [0x2b6a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556552:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51029 lrc: 3/0,1 mode: PW/PW res: [0x2b6a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556555:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51029 lrc: 3/0,1 mode: PW/PW res: [0x2b6a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556558:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51029 lrc: 2/0,0 mode: PW/PW res: [0x2b6a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.556620:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+885:39029:x1731745946433472:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1376us (1434us total) trans 12885079439 rc 0/0 00000100:00100000:0.0:1651529344.556623:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211383 00010000:00010000:0.0:1651529344.556647:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51029 lrc: 2/0,0 mode: PW/PW res: [0x2b6a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556651:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eb50e2ae already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.556659:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51029 lrc: 2/0,0 mode: PW/PW res: [0x2b6a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556662:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51029 lrc: 3/0,0 mode: PW/PW res: [0x2b6a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556667:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51029 lrc: 1/0,0 mode: --/PW res: [0x2b6a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556669:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51029 lrc: 0/0,0 mode: --/PW res: [0x2b6a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.556685:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.556694:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.556702:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.556703:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a138afb6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996995584:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.556712:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.556712:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c5104c lrc: 3/0,1 mode: --/PW res: [0x2b6ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.556718:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.556720:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000023afca5e pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996995648:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.556722:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c51053 lrc: 3/0,1 mode: --/PW res: [0x2b6ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.556724:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.556728:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946434624 00000100:00100000:1.0:1651529344.556729:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.556746:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d28c414b pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996995712:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.556750:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c5105a lrc: 3/0,1 mode: --/PW res: [0x2b6ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.556758:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396314944 00010000:00010000:1.0:1651529344.556762:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001e28e0da/0x3234de053c4e6ed lrc: 4/0,0 mode: PR/PR res: [0x2b6a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4cad expref: 1181 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.556772:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211391 00000100:00100000:0.0:1651529344.556774:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+885:39029:x1731745946434624:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.556779:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177839 count 1 00000100:00100000:1.0:1651529344.556781:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396315008 00010000:00010000:1.0:1651529344.556784:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000021332347/0x3234de053c4f223 lrc: 4/0,0 mode: PR/PR res: [0x2b6aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b53 expref: 1182 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.556784:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c51061 lrc: 3/0,1 mode: --/PW res: [0x2b6af:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556788:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005278c3cc/0x3234de053c4e645 lrc: 2/0,0 mode: PR/PR res: [0x2b6af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a06 expref: 1182 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.556789:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396315136 00010000:00010000:1.0:1651529344.556791:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000056390483/0x3234de053c4cfb6 lrc: 4/0,0 mode: PR/PR res: [0x2b6ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf072 expref: 1183 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.556791:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.556792:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.556793:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c51061 lrc: 4/0,1 mode: --/PW res: [0x2b6af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.556795:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396315264 00010000:00010000:1.0:1651529344.556797:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000e3a7232/0x3234de053c4ca45 lrc: 4/0,0 mode: PR/PR res: [0x2b6ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdaca expref: 1184 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.556800:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005278c3cc/0x3234de053c4e645 lrc: 3/0,0 mode: PR/PR res: [0x2b6af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a06 expref: 1184 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.556801:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396315072 00010000:00010000:1.0:1651529344.556803:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001abce4d8/0x3234de053c4dd8c lrc: 4/0,0 mode: PR/PR res: [0x2b6ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2761 expref: 1185 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.556806:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396315200 00010000:00010000:0.0:1651529344.556806:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005278c3cc/0x3234de053c4e645 lrc: 4/0,0 mode: PR/PR res: [0x2b6af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a06 expref: 1185 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.556808:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001c02002e/0x3234de053c4a706 lrc: 4/0,0 mode: PR/PR res: [0x2b6ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbbf2 expref: 1186 pid: 151609 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.556810:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000023afca5e pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996995776:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.556813:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12167 00000100:00100000:1.0:1651529344.556815:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1186:41279:x1731746396314944:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.556818:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.556819:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001e28e0da/0x3234de053c4e6ed lrc: 4/0,0 mode: PR/PR res: [0x2b6a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4cad expref: 1186 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.556819:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a3b00cf3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.556822:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001e28e0da/0x3234de053c4e6ed lrc: 3/0,0 mode: PR/PR res: [0x2b6a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4cad expref: 1186 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.556826:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12168 00010000:00010000:1.0:1651529344.556828:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e28e0da/0x3234de053c4e6ed lrc: 0/0,0 mode: --/PR res: [0x2b6a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4cad expref: 1186 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.556828:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1186:41279:x1731746396315008:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.556831:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.556832:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.556833:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.556833:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000021332347/0x3234de053c4f223 lrc: 4/0,0 mode: PR/PR res: [0x2b6aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b53 expref: 1185 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.556834:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e50ab3ae/0x3234de053c51037 lrc: 3/0,1 mode: PW/PW res: [0x2b6a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.556837:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e50ab3ae/0x3234de053c51037 lrc: 4/0,1 mode: PW/PW res: [0x2b6a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556837:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000021332347/0x3234de053c4f223 lrc: 3/0,0 mode: PR/PR res: [0x2b6aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b53 expref: 1185 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.556842:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021332347/0x3234de053c4f223 lrc: 0/0,0 mode: --/PR res: [0x2b6aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b53 expref: 1185 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.556843:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.556846:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.556846:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.556847:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c5103e lrc: 3/0,1 mode: PW/PW res: [0x2b6aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.556850:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1184:41279:x1731746396314944:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (166us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.556850:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c5103e lrc: 4/0,1 mode: PW/PW res: [0x2b6aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.556853:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12167 00000100:00100000:1.0:1651529344.556857:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12169 00000100:00100000:1.0:1651529344.556858:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009f0728c5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1183:41279:x1731746396315136:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.556859:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.556861:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.556862:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000056390483/0x3234de053c4cfb6 lrc: 4/0,0 mode: PR/PR res: [0x2b6ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf072 expref: 1183 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.556864:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1183:41279:x1731746396315008:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (170us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.556866:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000056390483/0x3234de053c4cfb6 lrc: 3/0,0 mode: PR/PR res: [0x2b6ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf072 expref: 1183 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.556867:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12168 00010000:00010000:1.0:1651529344.556870:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056390483/0x3234de053c4cfb6 lrc: 0/0,0 mode: --/PR res: [0x2b6ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf072 expref: 1182 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.556873:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.556873:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12170 00010000:00010000:1.0:1651529344.556874:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.556874:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1181:41279:x1731746396315264:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.556875:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c5104c lrc: 3/0,1 mode: PW/PW res: [0x2b6ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556877:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.556878:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000e3a7232/0x3234de053c4ca45 lrc: 4/0,0 mode: PR/PR res: [0x2b6ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdaca expref: 1181 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.556880:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c5104c lrc: 4/0,1 mode: PW/PW res: [0x2b6ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556882:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000e3a7232/0x3234de053c4ca45 lrc: 3/0,0 mode: PR/PR res: [0x2b6ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdaca expref: 1181 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.556886:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e3a7232/0x3234de053c4ca45 lrc: 0/0,0 mode: --/PR res: [0x2b6ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdaca expref: 1181 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.556890:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.556896:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009f0728c5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1181:41279:x1731746396315136:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 37us (184us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.556897:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.556897:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.556898:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12169 00010000:00010000:0.0:1651529344.556898:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c5105a lrc: 3/0,1 mode: PW/PW res: [0x2b6ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556901:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c5105a lrc: 4/0,1 mode: PW/PW res: [0x2b6ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.556906:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12171 00010000:00010000:0.0:1651529344.556910:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.556914:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1179:41278:x1731746396315072:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.556916:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1179:41279:x1731746396315264:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 41us (198us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.556917:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.556919:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001abce4d8/0x3234de053c4dd8c lrc: 4/0,0 mode: PR/PR res: [0x2b6ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2761 expref: 1179 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.556919:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12170 00010000:00010000:1.0:1651529344.556922:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001abce4d8/0x3234de053c4dd8c lrc: 3/0,0 mode: PR/PR res: [0x2b6ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2761 expref: 1178 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.556924:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12172 00000100:00100000:0.0:1651529344.556925:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1178:41278:x1731746396315200:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.556927:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001abce4d8/0x3234de053c4dd8c lrc: 0/0,0 mode: --/PR res: [0x2b6ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2761 expref: 1178 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.556928:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.556929:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001c02002e/0x3234de053c4a706 lrc: 4/0,0 mode: PR/PR res: [0x2b6ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbbf2 expref: 1178 pid: 151609 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.556931:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.556932:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.556932:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c51045 lrc: 3/0,1 mode: PW/PW res: [0x2b6ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556933:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001c02002e/0x3234de053c4a706 lrc: 3/0,0 mode: PR/PR res: [0x2b6ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbbf2 expref: 1177 pid: 151609 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.556935:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c51045 lrc: 4/0,1 mode: PW/PW res: [0x2b6ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556938:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c02002e/0x3234de053c4a706 lrc: 0/0,0 mode: --/PR res: [0x2b6ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbbf2 expref: 1177 pid: 151609 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.556941:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.556942:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.556943:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c51053 lrc: 3/0,1 mode: PW/PW res: [0x2b6ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.556944:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.556945:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c51053 lrc: 4/0,1 mode: PW/PW res: [0x2b6ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.556949:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1176:41278:x1731746396315072:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (225us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.556951:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.556952:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12171 00000100:00100000:0.0:1651529344.556956:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1175:41278:x1731746396315200:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 30us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.556958:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12172 00010000:00010000:1.0:1651529344.556959:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e50ab3ae/0x3234de053c51037 lrc: 3/0,1 mode: PW/PW res: [0x2b6a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.556963:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e50ab3ae/0x3234de053c51037 lrc: 3/0,1 mode: PW/PW res: [0x2b6a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556964:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c5103e lrc: 3/0,1 mode: PW/PW res: [0x2b6aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.556966:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e50ab3ae/0x3234de053c51037 lrc: 3/0,1 mode: PW/PW res: [0x2b6a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.556968:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e50ab3ae/0x3234de053c51037 lrc: 2/0,0 mode: PW/PW res: [0x2b6a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556968:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c5103e lrc: 3/0,1 mode: PW/PW res: [0x2b6aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556971:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c5103e lrc: 3/0,1 mode: PW/PW res: [0x2b6aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.556973:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c5103e lrc: 2/0,0 mode: PW/PW res: [0x2b6aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.557012:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+887:39030:x1731745946433792:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 971us (1029us total) trans 12885079440 rc 0/0 00000100:00100000:1.0:1651529344.557015:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211385 00000100:00100000:0.0:1651529344.557021:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+886:39030:x1731745946433920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 956us (1022us total) trans 12885079441 rc 0/0 00010000:00010000:1.0:1651529344.557022:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c51045 lrc: 3/0,1 mode: PW/PW res: [0x2b6ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.557024:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211386 00010000:00010000:1.0:1651529344.557025:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c51045 lrc: 3/0,1 mode: PW/PW res: [0x2b6ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.557028:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c51045 lrc: 3/0,1 mode: PW/PW res: [0x2b6ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.557031:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c51045 lrc: 2/0,0 mode: PW/PW res: [0x2b6ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557031:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e50ab3ae/0x3234de053c51037 lrc: 2/0,0 mode: PW/PW res: [0x2b6a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557034:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e50ab3ae already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.557035:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e50ab3ae/0x3234de053c51037 lrc: 2/0,0 mode: PW/PW res: [0x2b6a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557051:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e50ab3ae/0x3234de053c51037 lrc: 3/0,0 mode: PW/PW res: [0x2b6a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557056:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e50ab3ae/0x3234de053c51037 lrc: 1/0,0 mode: --/PW res: [0x2b6a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557059:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e50ab3ae/0x3234de053c51037 lrc: 0/0,0 mode: --/PW res: [0x2b6a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557063:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c5103e lrc: 2/0,0 mode: PW/PW res: [0x2b6aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557066:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006c0ed60a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.557067:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c5103e lrc: 2/0,0 mode: PW/PW res: [0x2b6aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.557069:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+886:39030:x1731745946434048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 971us (1061us total) trans 12885079442 rc 0/0 00010000:00010000:0.0:1651529344.557070:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c5103e lrc: 3/0,0 mode: PW/PW res: [0x2b6aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.557072:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211387 00010000:00010000:0.0:1651529344.557073:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c5103e lrc: 1/0,0 mode: --/PW res: [0x2b6aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557075:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c5103e lrc: 0/0,0 mode: --/PW res: [0x2b6aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.557078:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c5105a lrc: 3/0,1 mode: PW/PW res: [0x2b6ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557079:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c51045 lrc: 2/0,0 mode: PW/PW res: [0x2b6ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.557081:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c5105a lrc: 3/0,1 mode: PW/PW res: [0x2b6ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557081:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003b0cd546 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.557082:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c51045 lrc: 2/0,0 mode: PW/PW res: [0x2b6ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557084:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c51045 lrc: 3/0,0 mode: PW/PW res: [0x2b6ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.557085:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c5105a lrc: 3/0,1 mode: PW/PW res: [0x2b6ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.557087:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c5105a lrc: 2/0,0 mode: PW/PW res: [0x2b6ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557087:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c51045 lrc: 1/0,0 mode: --/PW res: [0x2b6ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557090:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b0cd546/0x3234de053c51045 lrc: 0/0,0 mode: --/PW res: [0x2b6ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557094:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c5105a lrc: 2/0,0 mode: PW/PW res: [0x2b6ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557096:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000034aad4d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.557097:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c5105a lrc: 2/0,0 mode: PW/PW res: [0x2b6ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557100:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c5105a lrc: 3/0,0 mode: PW/PW res: [0x2b6ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557103:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c5105a lrc: 1/0,0 mode: --/PW res: [0x2b6ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557105:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000034aad4d/0x3234de053c5105a lrc: 0/0,0 mode: --/PW res: [0x2b6ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557112:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c5104c lrc: 3/0,1 mode: PW/PW res: [0x2b6ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.557115:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000e07233e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+886:39030:x1731745946434112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 871us (943us total) trans 12885079443 rc 0/0 00010000:00010000:0.0:1651529344.557115:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c5104c lrc: 3/0,1 mode: PW/PW res: [0x2b6ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557117:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c5104c lrc: 3/0,1 mode: PW/PW res: [0x2b6ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.557118:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211390 00010000:00010000:0.0:1651529344.557120:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c5104c lrc: 2/0,0 mode: PW/PW res: [0x2b6ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.557132:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.557156:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+886:39030:x1731745946434176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1027us (1141us total) trans 12885079444 rc 0/0 00000100:00100000:0.0:1651529344.557159:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211388 00000100:00100000:0.0:1651529344.557164:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946434688 00000100:00100000:0.0:1651529344.557175:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211392 00000100:00100000:0.0:1651529344.557177:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+886:39029:x1731745946434688:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.557182:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177840 count 1 00010000:00010000:0.0:1651529344.557186:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c51068 lrc: 3/0,1 mode: --/PW res: [0x2b6b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557190:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000045786213/0x3234de053c4d71f lrc: 2/0,0 mode: PR/PR res: [0x2b6b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e24 expref: 1174 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.557193:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.557194:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.557195:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c51068 lrc: 4/0,1 mode: --/PW res: [0x2b6b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557201:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000045786213/0x3234de053c4d71f lrc: 3/0,0 mode: PR/PR res: [0x2b6b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e24 expref: 1174 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.557204:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000045786213/0x3234de053c4d71f lrc: 4/0,0 mode: PR/PR res: [0x2b6b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e24 expref: 1174 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.557211:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a138afb6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996995840:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.557219:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 0000000029ae2bb2 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.557259:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c5104c lrc: 2/0,0 mode: PW/PW res: [0x2b6ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557263:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f27c804 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.557264:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c5104c lrc: 2/0,0 mode: PW/PW res: [0x2b6ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557267:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c5104c lrc: 3/0,0 mode: PW/PW res: [0x2b6ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557272:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c5104c lrc: 1/0,0 mode: --/PW res: [0x2b6ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557286:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f27c804/0x3234de053c5104c lrc: 0/0,0 mode: --/PW res: [0x2b6ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557294:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c51053 lrc: 3/0,1 mode: PW/PW res: [0x2b6ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557297:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c51053 lrc: 3/0,1 mode: PW/PW res: [0x2b6ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557300:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c51053 lrc: 3/0,1 mode: PW/PW res: [0x2b6ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557305:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c51053 lrc: 2/0,0 mode: PW/PW res: [0x2b6ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.557348:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+887:39030:x1731745946433984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1158us (1202us total) trans 12885079445 rc 0/0 00000100:00100000:0.0:1651529344.557352:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211389 00000100:00100000:1.0:1651529344.557398:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.557399:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c51053 lrc: 2/0,0 mode: PW/PW res: [0x2b6ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557403:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2a2495 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.557409:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c51053 lrc: 2/0,0 mode: PW/PW res: [0x2b6ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.557415:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.557424:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.557424:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c51053 lrc: 3/0,0 mode: PW/PW res: [0x2b6ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557429:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c51053 lrc: 1/0,0 mode: --/PW res: [0x2b6ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.557430:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.557432:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2a2495/0x3234de053c51053 lrc: 0/0,0 mode: --/PW res: [0x2b6ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.557440:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.557446:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946434880 00000100:00100000:1.0:1651529344.557447:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946434944 00000100:00100000:0.0:1651529344.557452:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946435072 00000100:00100000:1.0:1651529344.557454:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946435008 00000100:00100000:0.0:1651529344.557460:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946435136 00000100:00100000:0.0:1651529344.557466:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211393 00000100:00100000:0.0:1651529344.557467:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+891:39029:x1731745946434880:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.557468:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211394 00000100:00100000:1.0:1651529344.557470:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+891:39030:x1731745946434944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.557472:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177841 count 1 00002000:00080000:1.0:1651529344.557475:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177842 count 1 00010000:00010000:1.0:1651529344.557480:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000649f045f/0x3234de053c5106f lrc: 3/0,1 mode: --/PW res: [0x2b6b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.557484:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004fb962f5/0x3234de053c4ccc2 lrc: 2/0,0 mode: PR/PR res: [0x2b6b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce4e1 expref: 1174 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.557488:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.557488:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.557489:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000649f045f/0x3234de053c5106f lrc: 4/0,1 mode: --/PW res: [0x2b6b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.557496:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004fb962f5/0x3234de053c4ccc2 lrc: 3/0,0 mode: PR/PR res: [0x2b6b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce4e1 expref: 1174 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.557501:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c51076 lrc: 3/0,1 mode: --/PW res: [0x2b6b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557506:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2e9e25a/0x3234de053c4f55d lrc: 2/0,0 mode: PR/PR res: [0x2b6b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d87d9 expref: 1174 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.557509:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.557510:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.557511:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c51076 lrc: 4/0,1 mode: --/PW res: [0x2b6b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.557513:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004fb962f5/0x3234de053c4ccc2 lrc: 4/0,0 mode: PR/PR res: [0x2b6b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce4e1 expref: 1174 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.557517:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e7f02909 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996995904:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.557518:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c2e9e25a/0x3234de053c4f55d lrc: 3/0,0 mode: PR/PR res: [0x2b6b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d87d9 expref: 1174 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.557521:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c2e9e25a/0x3234de053c4f55d lrc: 4/0,0 mode: PR/PR res: [0x2b6b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d87d9 expref: 1174 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.557526:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000264aecf8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996995968:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.557527:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b7af823 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.557533:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211395 00000100:00100000:1.0:1651529344.557535:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+891:39030:x1731745946435072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.557535:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 000000003678d25f going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.557540:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177844 count 1 00000100:00100000:0.0:1651529344.557542:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211396 00010000:00010000:1.0:1651529344.557544:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005121546f/0x3234de053c5107d lrc: 3/0,1 mode: --/PW res: [0x2b6b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.557544:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+891:39030:x1731745946435008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.557548:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000229b2bb9/0x3234de053c4d64d lrc: 2/0,0 mode: PR/PR res: [0x2b6b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ad5 expref: 1174 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.557549:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177843 count 1 00010000:00010000:1.0:1651529344.557551:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.557552:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.557552:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005121546f/0x3234de053c5107d lrc: 4/0,1 mode: --/PW res: [0x2b6b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557552:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51084 lrc: 3/0,1 mode: --/PW res: [0x2b6b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557556:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002c8e37a2/0x3234de053c4e87c lrc: 2/0,0 mode: PR/PR res: [0x2b6b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d52e2 expref: 1174 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.557558:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000229b2bb9/0x3234de053c4d64d lrc: 3/0,0 mode: PR/PR res: [0x2b6b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ad5 expref: 1174 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.557560:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.557560:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.557561:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000229b2bb9/0x3234de053c4d64d lrc: 4/0,0 mode: PR/PR res: [0x2b6b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ad5 expref: 1174 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.557561:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51084 lrc: 4/0,1 mode: --/PW res: [0x2b6b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.557565:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004534b316 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996996032:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.557567:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002c8e37a2/0x3234de053c4e87c lrc: 3/0,0 mode: PR/PR res: [0x2b6b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d52e2 expref: 1174 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.557570:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002c8e37a2/0x3234de053c4e87c lrc: 4/0,0 mode: PR/PR res: [0x2b6b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d52e2 expref: 1174 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.557572:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f9dac3f6 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.557574:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d523a75 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996996096:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.557577:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211397 00000100:00100000:1.0:1651529344.557579:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+891:39030:x1731745946435136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.557580:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c2b2b59c going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.557583:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177845 count 1 00010000:00010000:1.0:1651529344.557586:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c5108b lrc: 3/0,1 mode: --/PW res: [0x2b6b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.557590:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a3924c32/0x3234de053c4e13d lrc: 2/0,0 mode: PR/PR res: [0x2b6b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d35ae expref: 1174 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.557593:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.557593:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.557594:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c5108b lrc: 4/0,1 mode: --/PW res: [0x2b6b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.557595:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.557599:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a3924c32/0x3234de053c4e13d lrc: 3/0,0 mode: PR/PR res: [0x2b6b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d35ae expref: 1174 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.557603:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a3924c32/0x3234de053c4e13d lrc: 4/0,0 mode: PR/PR res: [0x2b6b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d35ae expref: 1174 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.557607:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000066de8c9f pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996996160:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.557612:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000babe2d90 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.557617:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946435200 00000100:00100000:1.0:1651529344.557629:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211398 00000100:00100000:1.0:1651529344.557631:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+892:39029:x1731745946435200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.557635:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177846 count 1 00010000:00010000:1.0:1651529344.557639:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8e15fbe/0x3234de053c51092 lrc: 3/0,1 mode: --/PW res: [0x2b6b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.557643:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e5a05ec8/0x3234de053c4db24 lrc: 2/0,0 mode: PR/PR res: [0x2b6b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ca2 expref: 1174 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.557646:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.557646:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.557647:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8e15fbe/0x3234de053c51092 lrc: 4/0,1 mode: --/PW res: [0x2b6b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.557692:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e5a05ec8/0x3234de053c4db24 lrc: 3/0,0 mode: PR/PR res: [0x2b6b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ca2 expref: 1174 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.557696:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e5a05ec8/0x3234de053c4db24 lrc: 4/0,0 mode: PR/PR res: [0x2b6b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ca2 expref: 1174 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.557697:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.557700:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000076d5f96b pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996996224:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.557708:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a4eb401d going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.557745:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.557775:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a138afb6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996995840:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.557779:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c51068 lrc: 3/0,1 mode: --/PW res: [0x2b6b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.557783:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396315776 00000100:00100000:0.0:1651529344.557787:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000023afca5e pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996995776:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.557789:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005278c3cc/0x3234de053c4e645 lrc: 4/0,0 mode: PR/PR res: [0x2b6af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a06 expref: 1175 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.557790:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c51061 lrc: 3/0,1 mode: --/PW res: [0x2b6af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.557797:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396315904 00000100:00100000:0.0:1651529344.557798:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12173 00010000:00010000:1.0:1651529344.557799:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000045786213/0x3234de053c4d71f lrc: 4/0,0 mode: PR/PR res: [0x2b6b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e24 expref: 1176 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.557800:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1176:41279:x1731746396315776:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.557803:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.557805:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12174 00010000:00010000:0.0:1651529344.557805:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005278c3cc/0x3234de053c4e645 lrc: 4/0,0 mode: PR/PR res: [0x2b6af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a06 expref: 1176 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.557806:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1176:41278:x1731746396315904:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.557809:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.557809:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005278c3cc/0x3234de053c4e645 lrc: 3/0,0 mode: PR/PR res: [0x2b6af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a06 expref: 1176 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.557810:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000045786213/0x3234de053c4d71f lrc: 4/0,0 mode: PR/PR res: [0x2b6b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e24 expref: 1176 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.557814:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000045786213/0x3234de053c4d71f lrc: 3/0,0 mode: PR/PR res: [0x2b6b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e24 expref: 1176 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.557815:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005278c3cc/0x3234de053c4e645 lrc: 0/0,0 mode: --/PR res: [0x2b6af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a06 expref: 1176 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.557818:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.557819:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.557820:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c51061 lrc: 3/0,1 mode: PW/PW res: [0x2b6af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.557822:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045786213/0x3234de053c4d71f lrc: 0/0,0 mode: --/PR res: [0x2b6b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e24 expref: 1175 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.557823:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c51061 lrc: 4/0,1 mode: PW/PW res: [0x2b6af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.557826:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.557827:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.557828:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c51068 lrc: 3/0,1 mode: PW/PW res: [0x2b6b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557829:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.557831:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c51068 lrc: 4/0,1 mode: PW/PW res: [0x2b6b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.557844:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.557845:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1174:41279:x1731746396315776:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 44us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.557852:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1174:41278:x1731746396315904:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 44us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.557854:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12174 00000100:00100000:0.0:1651529344.557862:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12173 00010000:00010000:0.0:1651529344.557870:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c51068 lrc: 3/0,1 mode: PW/PW res: [0x2b6b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557873:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c51068 lrc: 3/0,1 mode: PW/PW res: [0x2b6b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557889:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c51068 lrc: 3/0,1 mode: PW/PW res: [0x2b6b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557892:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c51068 lrc: 2/0,0 mode: PW/PW res: [0x2b6b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.557938:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+893:39029:x1731745946434688:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 760us (805us total) trans 12885079446 rc 0/0 00000100:00100000:0.0:1651529344.557955:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211392 00010000:00010000:0.0:1651529344.557962:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c51068 lrc: 2/0,0 mode: PW/PW res: [0x2b6b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557966:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dc65d2aa already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.557967:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c51068 lrc: 2/0,0 mode: PW/PW res: [0x2b6b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557970:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c51068 lrc: 3/0,0 mode: PW/PW res: [0x2b6b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557974:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c51068 lrc: 1/0,0 mode: --/PW res: [0x2b6b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557977:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc65d2aa/0x3234de053c51068 lrc: 0/0,0 mode: --/PW res: [0x2b6b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557983:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c51061 lrc: 3/0,1 mode: PW/PW res: [0x2b6af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557986:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c51061 lrc: 3/0,1 mode: PW/PW res: [0x2b6af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557989:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c51061 lrc: 3/0,1 mode: PW/PW res: [0x2b6af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.557992:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c51061 lrc: 2/0,0 mode: PW/PW res: [0x2b6af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.558033:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+893:39029:x1731745946434624:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1258us (1330us total) trans 12885079447 rc 0/0 00000100:00100000:0.0:1651529344.558036:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211391 00010000:00010000:0.0:1651529344.558042:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c51061 lrc: 2/0,0 mode: PW/PW res: [0x2b6af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.558046:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cff76789 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.558047:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c51061 lrc: 2/0,0 mode: PW/PW res: [0x2b6af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.558049:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c51061 lrc: 3/0,0 mode: PW/PW res: [0x2b6af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.558054:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c51061 lrc: 1/0,0 mode: --/PW res: [0x2b6af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.558057:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cff76789/0x3234de053c51061 lrc: 0/0,0 mode: --/PW res: [0x2b6af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.558080:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e7f02909 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996995904:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.558085:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000649f045f/0x3234de053c5106f lrc: 3/0,1 mode: --/PW res: [0x2b6b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.558104:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004534b316 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996996032:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.558107:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005121546f/0x3234de053c5107d lrc: 3/0,1 mode: --/PW res: [0x2b6b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.558128:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.558162:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000066de8c9f pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996996160:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.558163:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.558166:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c5108b lrc: 3/0,1 mode: --/PW res: [0x2b6b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.558171:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.558179:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000076d5f96b pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996996224:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.558182:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d8e15fbe/0x3234de053c51092 lrc: 3/0,1 mode: --/PW res: [0x2b6b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.558205:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396315968 00000100:00100000:0.0:1651529344.558205:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.558210:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004fb962f5/0x3234de053c4ccc2 lrc: 4/0,0 mode: PR/PR res: [0x2b6b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce4e1 expref: 1173 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.558213:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.558239:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396316096 00000100:00100000:0.0:1651529344.558239:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.558243:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000229b2bb9/0x3234de053c4d64d lrc: 4/0,0 mode: PR/PR res: [0x2b6b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ad5 expref: 1174 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.558246:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.558248:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396316032 00010000:00010000:1.0:1651529344.558250:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c2e9e25a/0x3234de053c4f55d lrc: 5/0,0 mode: PR/PR res: [0x2b6b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d87d9 expref: 1175 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.558252:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.558254:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396316224 00010000:00010000:1.0:1651529344.558256:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002c8e37a2/0x3234de053c4e87c lrc: 5/0,0 mode: PR/PR res: [0x2b6b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d52e2 expref: 1176 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.558260:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396316160 00000100:00100000:0.0:1651529344.558261:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d523a75 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996996096:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.558263:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a3924c32/0x3234de053c4e13d lrc: 4/0,0 mode: PR/PR res: [0x2b6b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d35ae expref: 1177 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.558265:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51084 lrc: 3/0,1 mode: --/PW res: [0x2b6b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.558267:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396316288 00010000:00010000:1.0:1651529344.558269:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e5a05ec8/0x3234de053c4db24 lrc: 4/0,0 mode: PR/PR res: [0x2b6b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ca2 expref: 1178 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.558272:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000264aecf8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996995968:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.558274:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12175 00000100:00100000:1.0:1651529344.558275:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1178:41278:x1731746396315968:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.558275:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c51076 lrc: 3/0,1 mode: --/PW res: [0x2b6b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558278:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.558279:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004fb962f5/0x3234de053c4ccc2 lrc: 4/0,0 mode: PR/PR res: [0x2b6b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce4e1 expref: 1178 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.558281:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946435264 00010000:00010000:1.0:1651529344.558283:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004fb962f5/0x3234de053c4ccc2 lrc: 3/0,0 mode: PR/PR res: [0x2b6b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce4e1 expref: 1178 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.558288:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004fb962f5/0x3234de053c4ccc2 lrc: 0/0,0 mode: --/PR res: [0x2b6b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce4e1 expref: 1178 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.558288:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946435584 00010000:00010000:1.0:1651529344.558292:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.558292:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211399 00010000:00010000:1.0:1651529344.558293:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.558293:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000649f045f/0x3234de053c5106f lrc: 3/0,1 mode: PW/PW res: [0x2b6b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.558293:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+894:39029:x1731745946435264:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.558296:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000649f045f/0x3234de053c5106f lrc: 4/0,1 mode: PW/PW res: [0x2b6b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.558298:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177847 count 1 00010000:00010000:0.0:1651529344.558302:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c51099 lrc: 3/0,1 mode: --/PW res: [0x2b6b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558303:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.558306:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000084321a20/0x3234de053c4d662 lrc: 2/0,0 mode: PR/PR res: [0x2b6b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0aff expref: 1177 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.558315:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1177:41278:x1731746396315968:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 39us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.558318:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12175 00010000:00010000:0.0:1651529344.558319:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.558320:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.558320:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c51099 lrc: 4/0,1 mode: --/PW res: [0x2b6b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.558322:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12176 00000100:00100000:1.0:1651529344.558324:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bdd4fa38 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1176:41278:x1731746396316096:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.558327:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.558328:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000229b2bb9/0x3234de053c4d64d lrc: 4/0,0 mode: PR/PR res: [0x2b6b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ad5 expref: 1176 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.558328:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000084321a20/0x3234de053c4d662 lrc: 3/0,0 mode: PR/PR res: [0x2b6b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0aff expref: 1176 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.558331:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000084321a20/0x3234de053c4d662 lrc: 4/0,0 mode: PR/PR res: [0x2b6b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0aff expref: 1176 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.558332:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000229b2bb9/0x3234de053c4d64d lrc: 3/0,0 mode: PR/PR res: [0x2b6b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ad5 expref: 1176 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.558336:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000264aecf8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996996288:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.558337:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000229b2bb9/0x3234de053c4d64d lrc: 0/0,0 mode: --/PR res: [0x2b6b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ad5 expref: 1176 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.558340:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.558340:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.558341:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005121546f/0x3234de053c5107d lrc: 3/0,1 mode: PW/PW res: [0x2b6b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558344:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005121546f/0x3234de053c5107d lrc: 4/0,1 mode: PW/PW res: [0x2b6b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.558344:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060852af0 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.558350:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.558350:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211400 00000100:00100000:0.0:1651529344.558352:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+894:39029:x1731745946435584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.558355:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bdd4fa38 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1175:41278:x1731746396316096:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 31us (184us total) trans 0 rc 0/0 00002000:00080000:0.0:1651529344.558357:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177848 count 1 00000100:00100000:1.0:1651529344.558358:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12176 00010000:00010000:0.0:1651529344.558360:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c510a0 lrc: 3/0,1 mode: --/PW res: [0x2b6b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.558364:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006c974544/0x3234de053c4e91d lrc: 2/0,0 mode: PR/PR res: [0x2b6b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5551 expref: 1174 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.558366:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12177 00000100:00100000:1.0:1651529344.558367:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1174:41279:x1731746396316032:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.558367:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.558368:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.558369:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c510a0 lrc: 4/0,1 mode: --/PW res: [0x2b6b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558370:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.558371:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c2e9e25a/0x3234de053c4f55d lrc: 4/0,0 mode: PR/PR res: [0x2b6b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d87d9 expref: 1174 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.558375:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c2e9e25a/0x3234de053c4f55d lrc: 3/0,0 mode: PR/PR res: [0x2b6b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d87d9 expref: 1174 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.558377:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006c974544/0x3234de053c4e91d lrc: 3/0,0 mode: PR/PR res: [0x2b6b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5551 expref: 1174 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.558379:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2e9e25a/0x3234de053c4f55d lrc: 0/0,0 mode: --/PR res: [0x2b6b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d87d9 expref: 1174 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.558380:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006c974544/0x3234de053c4e91d lrc: 4/0,0 mode: PR/PR res: [0x2b6b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5551 expref: 1174 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.558382:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.558383:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.558384:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c51076 lrc: 3/0,1 mode: PW/PW res: [0x2b6b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.558384:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d523a75 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996996352:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.558387:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c51076 lrc: 4/0,1 mode: PW/PW res: [0x2b6b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.558390:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e1aa6a77 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.558395:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.558400:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1173:41279:x1731746396316032:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 32us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.558402:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12177 00010000:00010000:0.0:1651529344.558403:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c51076 lrc: 3/0,1 mode: PW/PW res: [0x2b6b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.558406:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12178 00010000:00010000:0.0:1651529344.558407:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c51076 lrc: 3/0,1 mode: PW/PW res: [0x2b6b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.558408:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1172:41278:x1731746396316224:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.558410:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.558410:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c51076 lrc: 3/0,1 mode: PW/PW res: [0x2b6b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558412:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002c8e37a2/0x3234de053c4e87c lrc: 4/0,0 mode: PR/PR res: [0x2b6b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d52e2 expref: 1172 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.558412:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c51076 lrc: 2/0,0 mode: PW/PW res: [0x2b6b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558415:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002c8e37a2/0x3234de053c4e87c lrc: 3/0,0 mode: PR/PR res: [0x2b6b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d52e2 expref: 1172 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.558420:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c8e37a2/0x3234de053c4e87c lrc: 0/0,0 mode: --/PR res: [0x2b6b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d52e2 expref: 1172 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.558423:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.558424:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.558424:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51084 lrc: 3/0,1 mode: PW/PW res: [0x2b6b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558427:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51084 lrc: 4/0,1 mode: PW/PW res: [0x2b6b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558435:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.558439:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1171:41278:x1731746396316224:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 31us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.558441:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12178 00000100:00100000:1.0:1651529344.558445:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12179 00000100:00100000:1.0:1651529344.558447:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1170:41279:x1731746396316160:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.558449:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.558450:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a3924c32/0x3234de053c4e13d lrc: 4/0,0 mode: PR/PR res: [0x2b6b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d35ae expref: 1170 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.558454:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a3924c32/0x3234de053c4e13d lrc: 3/0,0 mode: PR/PR res: [0x2b6b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d35ae expref: 1170 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.558458:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3924c32/0x3234de053c4e13d lrc: 0/0,0 mode: --/PR res: [0x2b6b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d35ae expref: 1170 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.558458:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+895:39029:x1731745946434880:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 990us (1060us total) trans 12885079448 rc 0/0 00000100:00100000:0.0:1651529344.558461:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211393 00010000:00010000:1.0:1651529344.558464:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.558464:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.558465:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c5108b lrc: 3/0,1 mode: PW/PW res: [0x2b6b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558468:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c5108b lrc: 4/0,1 mode: PW/PW res: [0x2b6b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.558468:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c51076 lrc: 2/0,0 mode: PW/PW res: [0x2b6b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558473:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.558474:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e0e037e6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.558475:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c51076 lrc: 2/0,0 mode: PW/PW res: [0x2b6b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.558478:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1169:41279:x1731746396316160:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 31us (232us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.558478:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c51076 lrc: 3/0,0 mode: PW/PW res: [0x2b6b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.558480:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12179 00010000:00010000:0.0:1651529344.558482:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c51076 lrc: 1/0,0 mode: --/PW res: [0x2b6b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.558484:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12180 00000100:00100000:1.0:1651529344.558485:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1168:41279:x1731746396316288:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.558485:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c51076 lrc: 0/0,0 mode: --/PW res: [0x2b6b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558487:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.558488:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e5a05ec8/0x3234de053c4db24 lrc: 4/0,0 mode: PR/PR res: [0x2b6b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ca2 expref: 1168 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.558491:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51084 lrc: 3/0,1 mode: PW/PW res: [0x2b6b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558492:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e5a05ec8/0x3234de053c4db24 lrc: 3/0,0 mode: PR/PR res: [0x2b6b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ca2 expref: 1168 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.558494:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51084 lrc: 3/0,1 mode: PW/PW res: [0x2b6b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558496:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5a05ec8/0x3234de053c4db24 lrc: 0/0,0 mode: --/PR res: [0x2b6b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ca2 expref: 1168 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.558497:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51084 lrc: 3/0,1 mode: PW/PW res: [0x2b6b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558499:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.558499:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51084 lrc: 2/0,0 mode: PW/PW res: [0x2b6b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558500:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.558500:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d8e15fbe/0x3234de053c51092 lrc: 3/0,1 mode: PW/PW res: [0x2b6b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558503:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8e15fbe/0x3234de053c51092 lrc: 4/0,1 mode: PW/PW res: [0x2b6b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558509:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.558513:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1167:41279:x1731746396316288:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 27us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.558515:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12180 00010000:00010000:1.0:1651529344.558522:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000649f045f/0x3234de053c5106f lrc: 3/0,1 mode: PW/PW res: [0x2b6b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558525:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000649f045f/0x3234de053c5106f lrc: 3/0,1 mode: PW/PW res: [0x2b6b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558528:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000649f045f/0x3234de053c5106f lrc: 3/0,1 mode: PW/PW res: [0x2b6b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558531:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000649f045f/0x3234de053c5106f lrc: 2/0,0 mode: PW/PW res: [0x2b6b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.558545:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+895:39030:x1731745946435008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 992us (1107us total) trans 12885079449 rc 0/0 00000100:00100000:0.0:1651529344.558548:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211396 00010000:00010000:0.0:1651529344.558555:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51084 lrc: 2/0,0 mode: PW/PW res: [0x2b6b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.558558:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a0607df4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.558560:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51084 lrc: 2/0,0 mode: PW/PW res: [0x2b6b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.558562:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51084 lrc: 3/0,0 mode: PW/PW res: [0x2b6b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.558567:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51084 lrc: 1/0,0 mode: --/PW res: [0x2b6b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.558569:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51084 lrc: 0/0,0 mode: --/PW res: [0x2b6b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.558573:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000649f045f/0x3234de053c5106f lrc: 2/0,0 mode: PW/PW res: [0x2b6b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.558574:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+895:39030:x1731745946434944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1104us (1159us total) trans 12885079450 rc 0/0 00010000:00010000:0.0:1651529344.558576:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000649f045f already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.558577:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211394 00010000:00010000:0.0:1651529344.558577:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000649f045f/0x3234de053c5106f lrc: 2/0,0 mode: PW/PW res: [0x2b6b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.558580:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000649f045f/0x3234de053c5106f lrc: 3/0,0 mode: PW/PW res: [0x2b6b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558584:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005121546f/0x3234de053c5107d lrc: 3/0,1 mode: PW/PW res: [0x2b6b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.558585:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000649f045f/0x3234de053c5106f lrc: 1/0,0 mode: --/PW res: [0x2b6b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.558588:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000649f045f/0x3234de053c5106f lrc: 0/0,0 mode: --/PW res: [0x2b6b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558590:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005121546f/0x3234de053c5107d lrc: 3/0,1 mode: PW/PW res: [0x2b6b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558593:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005121546f/0x3234de053c5107d lrc: 3/0,1 mode: PW/PW res: [0x2b6b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558596:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005121546f/0x3234de053c5107d lrc: 2/0,0 mode: PW/PW res: [0x2b6b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.558632:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+895:39030:x1731745946435072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1097us (1208us total) trans 12885079451 rc 0/0 00000100:00100000:1.0:1651529344.558635:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211395 00010000:00010000:1.0:1651529344.558641:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d8e15fbe/0x3234de053c51092 lrc: 3/0,1 mode: PW/PW res: [0x2b6b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558644:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8e15fbe/0x3234de053c51092 lrc: 3/0,1 mode: PW/PW res: [0x2b6b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558647:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8e15fbe/0x3234de053c51092 lrc: 3/0,1 mode: PW/PW res: [0x2b6b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558650:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8e15fbe/0x3234de053c51092 lrc: 2/0,0 mode: PW/PW res: [0x2b6b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.558685:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+895:39029:x1731745946435200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1053us (1089us total) trans 12885079452 rc 0/0 00000100:00100000:1.0:1651529344.558689:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211398 00010000:00010000:1.0:1651529344.558695:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c5108b lrc: 3/0,1 mode: PW/PW res: [0x2b6b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558698:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c5108b lrc: 3/0,1 mode: PW/PW res: [0x2b6b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558701:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c5108b lrc: 3/0,1 mode: PW/PW res: [0x2b6b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.558704:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c5108b lrc: 2/0,0 mode: PW/PW res: [0x2b6b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.558731:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+895:39030:x1731745946435136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1152us (1291us total) trans 12885079453 rc 0/0 00000100:00100000:1.0:1651529344.558743:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211397 00000100:00100000:1.0:1651529344.559063:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.559080:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.559104:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005121546f/0x3234de053c5107d lrc: 2/0,0 mode: PW/PW res: [0x2b6b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559108:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005121546f already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.559109:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.559109:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005121546f/0x3234de053c5107d lrc: 2/0,0 mode: PW/PW res: [0x2b6b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559112:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005121546f/0x3234de053c5107d lrc: 3/0,0 mode: PW/PW res: [0x2b6b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.559116:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.559116:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005121546f/0x3234de053c5107d lrc: 1/0,0 mode: --/PW res: [0x2b6b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559119:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005121546f/0x3234de053c5107d lrc: 0/0,0 mode: --/PW res: [0x2b6b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.559122:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.559123:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8e15fbe/0x3234de053c51092 lrc: 2/0,0 mode: PW/PW res: [0x2b6b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559131:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d8e15fbe already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.559132:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.559132:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8e15fbe/0x3234de053c51092 lrc: 2/0,0 mode: PW/PW res: [0x2b6b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559139:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8e15fbe/0x3234de053c51092 lrc: 3/0,0 mode: PW/PW res: [0x2b6b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.559141:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946435904 00010000:00010000:0.0:1651529344.559143:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8e15fbe/0x3234de053c51092 lrc: 1/0,0 mode: --/PW res: [0x2b6b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559145:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8e15fbe/0x3234de053c51092 lrc: 0/0,0 mode: --/PW res: [0x2b6b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.559150:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946435840 00010000:00010000:0.0:1651529344.559153:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c5108b lrc: 2/0,0 mode: PW/PW res: [0x2b6b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.559154:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211401 00000100:00100000:1.0:1651529344.559155:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+896:39029:x1731745946435904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.559156:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b3ecd1a6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.559157:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c5108b lrc: 2/0,0 mode: PW/PW res: [0x2b6b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559159:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c5108b lrc: 3/0,0 mode: PW/PW res: [0x2b6b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.559161:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177850 count 1 00010000:00010000:0.0:1651529344.559163:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c5108b lrc: 1/0,0 mode: --/PW res: [0x2b6b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559165:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3ecd1a6/0x3234de053c5108b lrc: 0/0,0 mode: --/PW res: [0x2b6b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.559166:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056ce51ac/0x3234de053c510a7 lrc: 3/0,1 mode: --/PW res: [0x2b6ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.559170:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e0c2c8e0/0x3234de053c4cb3a lrc: 2/0,0 mode: PR/PR res: [0x2b6ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde82 expref: 1166 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.559173:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.559174:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.559174:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946435968 00010000:00010000:1.0:1651529344.559175:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056ce51ac/0x3234de053c510a7 lrc: 4/0,1 mode: --/PW res: [0x2b6ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.559185:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946436032 00010000:00010000:1.0:1651529344.559188:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e0c2c8e0/0x3234de053c4cb3a lrc: 3/0,0 mode: PR/PR res: [0x2b6ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde82 expref: 1166 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.559188:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946436096 00000100:00100000:0.0:1651529344.559190:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946436160 00010000:00010000:1.0:1651529344.559192:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e0c2c8e0/0x3234de053c4cb3a lrc: 4/0,0 mode: PR/PR res: [0x2b6ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde82 expref: 1166 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.559193:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211402 00000100:00100000:0.0:1651529344.559194:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+900:39030:x1731745946435840:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.559196:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f7006631 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996996416:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.559200:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177849 count 1 00010000:00010000:0.0:1651529344.559203:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c510ae lrc: 3/0,1 mode: --/PW res: [0x2b6b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.559207:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 000000007e004c12 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.559208:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000060dc727a/0x3234de053c4f4f4 lrc: 2/0,0 mode: PR/PR res: [0x2b6b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8658 expref: 1166 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.559211:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.559212:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.559213:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211403 00000100:00100000:1.0:1651529344.559214:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+900:39030:x1731745946435968:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.559219:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177851 count 1 00010000:00010000:1.0:1651529344.559238:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1634cb6/0x3234de053c510b5 lrc: 3/0,1 mode: --/PW res: [0x2b6bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.559243:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c4f468 lrc: 2/0,0 mode: PR/PR res: [0x2b6bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8460 expref: 1166 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.559244:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c510ae lrc: 4/0,1 mode: --/PW res: [0x2b6b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.559249:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.559249:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.559250:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1634cb6/0x3234de053c510b5 lrc: 4/0,1 mode: --/PW res: [0x2b6bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559253:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000060dc727a/0x3234de053c4f4f4 lrc: 3/0,0 mode: PR/PR res: [0x2b6b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8658 expref: 1166 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.559256:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c4f468 lrc: 3/0,0 mode: PR/PR res: [0x2b6bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8460 expref: 1166 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.559257:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000060dc727a/0x3234de053c4f4f4 lrc: 4/0,0 mode: PR/PR res: [0x2b6b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8658 expref: 1166 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.559260:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c4f468 lrc: 4/0,0 mode: PR/PR res: [0x2b6bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8460 expref: 1166 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.559261:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000027e31dd1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996996480:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.559264:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003562cf4d pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996996544:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.559270:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c086aae3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.559272:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 0000000071742acc going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.559278:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211404 00000100:00100000:1.0:1651529344.559280:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+900:39029:x1731745946436032:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.559280:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d523a75 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996996352:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.559284:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177852 count 1 00010000:00010000:0.0:1651529344.559284:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c510a0 lrc: 3/0,1 mode: --/PW res: [0x2b6b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.559287:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0efadcd/0x3234de053c510bc lrc: 3/0,1 mode: --/PW res: [0x2b6bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.559291:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b16f6b13/0x3234de053c4d83e lrc: 2/0,0 mode: PR/PR res: [0x2b6bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d11ea expref: 1166 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.559293:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211405 00010000:00010000:1.0:1651529344.559294:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.559295:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.559295:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0efadcd/0x3234de053c510bc lrc: 4/0,1 mode: --/PW res: [0x2b6bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.559295:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+900:39030:x1731745946436096:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.559300:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177853 count 1 00010000:00010000:1.0:1651529344.559303:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b16f6b13/0x3234de053c4d83e lrc: 3/0,0 mode: PR/PR res: [0x2b6bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d11ea expref: 1166 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.559303:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c510c3 lrc: 3/0,1 mode: --/PW res: [0x2b6bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.559307:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b16f6b13/0x3234de053c4d83e lrc: 4/0,0 mode: PR/PR res: [0x2b6bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d11ea expref: 1166 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.559307:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c4ecc0 lrc: 2/0,0 mode: PR/PR res: [0x2b6bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d64fc expref: 1166 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.559311:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006e255cae pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996996608:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.559311:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.559311:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.559312:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c510c3 lrc: 4/0,1 mode: --/PW res: [0x2b6bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.559316:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b7af823 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.559318:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c4ecc0 lrc: 3/0,0 mode: PR/PR res: [0x2b6bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d64fc expref: 1166 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.559321:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c4ecc0 lrc: 4/0,0 mode: PR/PR res: [0x2b6bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d64fc expref: 1166 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.559322:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211406 00000100:00100000:1.0:1651529344.559323:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+900:39030:x1731745946436160:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.559325:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d523a75 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996996672:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.559327:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177854 count 1 00010000:00010000:1.0:1651529344.559330:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043037897/0x3234de053c510ca lrc: 3/0,1 mode: --/PW res: [0x2b6be:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.559332:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e1aa6a77 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.559334:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a455296d/0x3234de053c4ddee lrc: 2/0,0 mode: PR/PR res: [0x2b6be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d28c6 expref: 1166 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.559337:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.559337:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.559338:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043037897/0x3234de053c510ca lrc: 4/0,1 mode: --/PW res: [0x2b6be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.559339:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000264aecf8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996996288:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.559342:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c51099 lrc: 3/0,1 mode: --/PW res: [0x2b6b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.559343:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a455296d/0x3234de053c4ddee lrc: 3/0,0 mode: PR/PR res: [0x2b6be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d28c6 expref: 1166 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.559347:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a455296d/0x3234de053c4ddee lrc: 4/0,0 mode: PR/PR res: [0x2b6be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d28c6 expref: 1166 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.559351:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a925fbf6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996996736:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.559357:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f9dac3f6 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.559359:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.559385:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396316736 00010000:00010000:0.0:1651529344.559390:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000084321a20/0x3234de053c4d662 lrc: 4/0,0 mode: PR/PR res: [0x2b6b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0aff expref: 1167 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.559401:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12181 00000100:00100000:0.0:1651529344.559403:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1167:41278:x1731746396316736:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.559406:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.559407:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000084321a20/0x3234de053c4d662 lrc: 4/0,0 mode: PR/PR res: [0x2b6b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0aff expref: 1167 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.559411:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000084321a20/0x3234de053c4d662 lrc: 3/0,0 mode: PR/PR res: [0x2b6b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0aff expref: 1167 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.559413:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.559416:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084321a20/0x3234de053c4d662 lrc: 0/0,0 mode: --/PR res: [0x2b6b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0aff expref: 1167 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.559420:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.559421:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396316800 00010000:00010000:0.0:1651529344.559421:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.559421:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c51099 lrc: 3/0,1 mode: PW/PW res: [0x2b6b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559424:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c51099 lrc: 4/0,1 mode: PW/PW res: [0x2b6b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.559426:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006c974544/0x3234de053c4e91d lrc: 4/0,0 mode: PR/PR res: [0x2b6b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5551 expref: 1167 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.559431:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.559434:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12182 00000100:00100000:1.0:1651529344.559436:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1167:41279:x1731746396316800:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.559438:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.559438:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1167:41278:x1731746396316736:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 34us (79us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.559440:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006c974544/0x3234de053c4e91d lrc: 4/0,0 mode: PR/PR res: [0x2b6b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5551 expref: 1167 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.559441:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12181 00010000:00010000:1.0:1651529344.559444:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006c974544/0x3234de053c4e91d lrc: 3/0,0 mode: PR/PR res: [0x2b6b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5551 expref: 1166 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.559447:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c51099 lrc: 3/0,1 mode: PW/PW res: [0x2b6b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.559449:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c974544/0x3234de053c4e91d lrc: 0/0,0 mode: --/PR res: [0x2b6b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5551 expref: 1166 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.559450:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c51099 lrc: 3/0,1 mode: PW/PW res: [0x2b6b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.559453:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.559453:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.559453:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c51099 lrc: 3/0,1 mode: PW/PW res: [0x2b6b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.559454:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c510a0 lrc: 3/0,1 mode: PW/PW res: [0x2b6b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559456:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c51099 lrc: 2/0,0 mode: PW/PW res: [0x2b6b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.559457:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c510a0 lrc: 4/0,1 mode: PW/PW res: [0x2b6b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.559468:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.559475:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1165:41279:x1731746396316800:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 39us (77us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.559478:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12182 00000100:00100000:0.0:1651529344.559506:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+901:39029:x1731745946435264:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1212us (1378us total) trans 12885079454 rc 0/0 00000100:00100000:0.0:1651529344.559509:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211399 00010000:00010000:0.0:1651529344.559516:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c51099 lrc: 2/0,0 mode: PW/PW res: [0x2b6b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559520:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005d8a4887 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.559521:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c51099 lrc: 2/0,0 mode: PW/PW res: [0x2b6b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559524:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c51099 lrc: 3/0,0 mode: PW/PW res: [0x2b6b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559530:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c51099 lrc: 1/0,0 mode: --/PW res: [0x2b6b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559533:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c51099 lrc: 0/0,0 mode: --/PW res: [0x2b6b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559539:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c510a0 lrc: 3/0,1 mode: PW/PW res: [0x2b6b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559541:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c510a0 lrc: 3/0,1 mode: PW/PW res: [0x2b6b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559545:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c510a0 lrc: 3/0,1 mode: PW/PW res: [0x2b6b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559547:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c510a0 lrc: 2/0,0 mode: PW/PW res: [0x2b6b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.559587:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+901:39029:x1731745946435584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1234us (1383us total) trans 12885079455 rc 0/0 00000100:00100000:0.0:1651529344.559590:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211400 00010000:00010000:0.0:1651529344.559597:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c510a0 lrc: 2/0,0 mode: PW/PW res: [0x2b6b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559600:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cdc65e28 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.559601:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c510a0 lrc: 2/0,0 mode: PW/PW res: [0x2b6b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559604:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c510a0 lrc: 3/0,0 mode: PW/PW res: [0x2b6b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559609:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c510a0 lrc: 1/0,0 mode: --/PW res: [0x2b6b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559611:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c510a0 lrc: 0/0,0 mode: --/PW res: [0x2b6b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.559643:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.559690:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946436544 00000100:00100000:0.0:1651529344.559720:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211407 00000100:00100000:0.0:1651529344.559721:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+901:39029:x1731745946436544:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.559723:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.559730:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946436608 00000100:00100000:1.0:1651529344.559746:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211408 00000100:00100000:1.0:1651529344.559748:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+902:39029:x1731745946436608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.559748:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177855 count 1 00010000:00010000:0.0:1651529344.559752:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c510d1 lrc: 3/0,1 mode: --/PW res: [0x2b6bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.559753:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177856 count 1 00010000:00010000:0.0:1651529344.559757:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004042fb39/0x3234de053c4cef2 lrc: 2/0,0 mode: PR/PR res: [0x2b6bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cedb6 expref: 1164 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.559758:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c510d8 lrc: 3/0,1 mode: --/PW res: [0x2b6c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559760:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.559761:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.559762:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003337bc40/0x3234de053c4d161 lrc: 2/0,0 mode: PR/PR res: [0x2b6c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf6d8 expref: 1164 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.559762:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c510d1 lrc: 4/0,1 mode: --/PW res: [0x2b6bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.559765:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.559766:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.559767:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c510d8 lrc: 4/0,1 mode: --/PW res: [0x2b6c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.559769:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004042fb39/0x3234de053c4cef2 lrc: 3/0,0 mode: PR/PR res: [0x2b6bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cedb6 expref: 1164 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.559773:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003337bc40/0x3234de053c4d161 lrc: 3/0,0 mode: PR/PR res: [0x2b6c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf6d8 expref: 1164 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.559775:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004042fb39/0x3234de053c4cef2 lrc: 4/0,0 mode: PR/PR res: [0x2b6bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cedb6 expref: 1164 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.559777:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003337bc40/0x3234de053c4d161 lrc: 4/0,0 mode: PR/PR res: [0x2b6c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf6d8 expref: 1164 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.559779:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000034e35367 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996996800:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.559784:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000057329b82 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996996864:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.559790:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000003678d25f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.559792:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a4eb401d going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.560730:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f7006631 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996996416:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.560744:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000056ce51ac/0x3234de053c510a7 lrc: 3/0,1 mode: --/PW res: [0x2b6ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.560752:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003562cf4d pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996996544:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.560754:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000027e31dd1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996996480:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.560755:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c1634cb6/0x3234de053c510b5 lrc: 3/0,1 mode: --/PW res: [0x2b6bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.560760:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c510ae lrc: 3/0,1 mode: --/PW res: [0x2b6b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.560761:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006e255cae pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996996608:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.560763:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a0efadcd/0x3234de053c510bc lrc: 3/0,1 mode: --/PW res: [0x2b6bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.560818:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a925fbf6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996996736:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.560821:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000043037897/0x3234de053c510ca lrc: 3/0,1 mode: --/PW res: [0x2b6be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.560821:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.560832:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.560839:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396317056 00000100:00100000:0.0:1651529344.560841:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.560849:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.560850:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000060dc727a/0x3234de053c4f4f4 lrc: 4/0,0 mode: PR/PR res: [0x2b6b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8658 expref: 1165 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.560856:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396316992 00000100:00100000:0.0:1651529344.560856:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.560859:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e0c2c8e0/0x3234de053c4cb3a lrc: 4/0,0 mode: PR/PR res: [0x2b6ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde82 expref: 1166 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.560861:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.560863:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396317120 00010000:00010000:1.0:1651529344.560865:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c4f468 lrc: 4/0,0 mode: PR/PR res: [0x2b6bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8460 expref: 1167 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.560869:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396317184 00000100:00100000:0.0:1651529344.560876:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.560877:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b16f6b13/0x3234de053c4d83e lrc: 4/0,0 mode: PR/PR res: [0x2b6bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d11ea expref: 1168 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.560881:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396317248 00010000:00010000:1.0:1651529344.560884:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c4ecc0 lrc: 5/0,0 mode: PR/PR res: [0x2b6bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d64fc expref: 1169 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.560887:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396317312 00010000:00010000:1.0:1651529344.560889:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a455296d/0x3234de053c4ddee lrc: 4/0,0 mode: PR/PR res: [0x2b6be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d28c6 expref: 1170 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.560892:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.560893:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396317376 00000100:00100000:0.0:1651529344.560900:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d523a75 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996996672:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.560904:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004042fb39/0x3234de053c4cef2 lrc: 5/0,0 mode: PR/PR res: [0x2b6bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cedb6 expref: 1171 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.560905:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c510c3 lrc: 3/0,1 mode: --/PW res: [0x2b6bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.560908:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396317440 00010000:00010000:1.0:1651529344.560911:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003337bc40/0x3234de053c4d161 lrc: 5/0,0 mode: PR/PR res: [0x2b6c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf6d8 expref: 1172 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.560915:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12183 00000100:00100000:0.0:1651529344.560916:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000034e35367 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996996800:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.560917:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000969ab41d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1172:41279:x1731746396317056:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.560920:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.560920:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c510d1 lrc: 3/0,1 mode: --/PW res: [0x2b6bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.560922:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000060dc727a/0x3234de053c4f4f4 lrc: 4/0,0 mode: PR/PR res: [0x2b6b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8658 expref: 1172 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.560925:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000060dc727a/0x3234de053c4f4f4 lrc: 3/0,0 mode: PR/PR res: [0x2b6b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8658 expref: 1172 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.560931:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060dc727a/0x3234de053c4f4f4 lrc: 0/0,0 mode: --/PR res: [0x2b6b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8658 expref: 1172 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.560935:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.560935:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.560936:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c510ae lrc: 3/0,1 mode: PW/PW res: [0x2b6b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.560937:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12184 00010000:00010000:1.0:1651529344.560939:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c510ae lrc: 4/0,1 mode: PW/PW res: [0x2b6b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.560940:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1171:41279:x1731746396316992:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.560945:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.560949:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.560958:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e0c2c8e0/0x3234de053c4cb3a lrc: 4/0,0 mode: PR/PR res: [0x2b6ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde82 expref: 1171 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.560959:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000969ab41d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1171:41279:x1731746396317056:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.560962:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12183 00010000:00010000:0.0:1651529344.560963:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e0c2c8e0/0x3234de053c4cb3a lrc: 3/0,0 mode: PR/PR res: [0x2b6ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde82 expref: 1171 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.560970:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0c2c8e0/0x3234de053c4cb3a lrc: 0/0,0 mode: --/PR res: [0x2b6ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde82 expref: 1170 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.560971:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12185 00000100:00100000:1.0:1651529344.560973:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1170:41278:x1731746396317120:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.560974:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.560975:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.560975:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.560976:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000056ce51ac/0x3234de053c510a7 lrc: 3/0,1 mode: PW/PW res: [0x2b6ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.560977:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c4f468 lrc: 4/0,0 mode: PR/PR res: [0x2b6bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8460 expref: 1169 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.560979:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056ce51ac/0x3234de053c510a7 lrc: 4/0,1 mode: PW/PW res: [0x2b6ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.560983:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c4f468 lrc: 3/0,0 mode: PR/PR res: [0x2b6bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8460 expref: 1169 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.560989:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.560994:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c4f468 lrc: 0/0,0 mode: --/PR res: [0x2b6bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8460 expref: 1169 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.560998:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.560998:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.560998:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1168:41279:x1731746396316992:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 58us (166us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.560999:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c1634cb6/0x3234de053c510b5 lrc: 3/0,1 mode: PW/PW res: [0x2b6bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.561001:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12184 00010000:00010000:1.0:1651529344.561002:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1634cb6/0x3234de053c510b5 lrc: 4/0,1 mode: PW/PW res: [0x2b6bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.561007:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12186 00010000:00010000:1.0:1651529344.561008:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.561009:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1167:41279:x1731746396317184:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.561012:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.561013:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1167:41278:x1731746396317120:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 40us (173us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.561014:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b16f6b13/0x3234de053c4d83e lrc: 4/0,0 mode: PR/PR res: [0x2b6bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d11ea expref: 1167 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.561016:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12185 00010000:00010000:0.0:1651529344.561017:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b16f6b13/0x3234de053c4d83e lrc: 3/0,0 mode: PR/PR res: [0x2b6bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d11ea expref: 1167 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.561021:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12187 00000100:00100000:1.0:1651529344.561022:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1166:41278:x1731746396317248:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.561022:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b16f6b13/0x3234de053c4d83e lrc: 0/0,0 mode: --/PR res: [0x2b6bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d11ea expref: 1166 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.561025:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.561026:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c4ecc0 lrc: 4/0,0 mode: PR/PR res: [0x2b6bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d64fc expref: 1165 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.561026:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.561027:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.561027:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0efadcd/0x3234de053c510bc lrc: 3/0,1 mode: PW/PW res: [0x2b6bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561030:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c4ecc0 lrc: 3/0,0 mode: PR/PR res: [0x2b6bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d64fc expref: 1165 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.561030:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0efadcd/0x3234de053c510bc lrc: 4/0,1 mode: PW/PW res: [0x2b6bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561034:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c4ecc0 lrc: 0/0,0 mode: --/PR res: [0x2b6bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d64fc expref: 1165 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.561039:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.561044:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.561044:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1164:41279:x1731746396317184:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (196us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.561045:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.561046:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c510c3 lrc: 3/0,1 mode: PW/PW res: [0x2b6bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.561047:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12186 00010000:00010000:1.0:1651529344.561049:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c510c3 lrc: 4/0,1 mode: PW/PW res: [0x2b6bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.561051:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12188 00000100:00100000:0.0:1651529344.561053:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1163:41279:x1731746396317312:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.561055:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.561057:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.561063:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1163:41278:x1731746396317248:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 40us (207us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.561063:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a455296d/0x3234de053c4ddee lrc: 4/0,0 mode: PR/PR res: [0x2b6be:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d28c6 expref: 1163 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.561065:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12187 00000100:00100000:1.0:1651529344.561070:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12189 00010000:00010000:0.0:1651529344.561070:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a455296d/0x3234de053c4ddee lrc: 3/0,0 mode: PR/PR res: [0x2b6be:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d28c6 expref: 1162 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.561072:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1162:41278:x1731746396317376:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.561074:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.561074:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a455296d/0x3234de053c4ddee lrc: 0/0,0 mode: --/PR res: [0x2b6be:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d28c6 expref: 1162 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.561075:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004042fb39/0x3234de053c4cef2 lrc: 4/0,0 mode: PR/PR res: [0x2b6bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cedb6 expref: 1162 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.561078:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.561078:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.561079:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004042fb39/0x3234de053c4cef2 lrc: 3/0,0 mode: PR/PR res: [0x2b6bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cedb6 expref: 1161 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.561079:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000043037897/0x3234de053c510ca lrc: 3/0,1 mode: PW/PW res: [0x2b6be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561082:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043037897/0x3234de053c510ca lrc: 4/0,1 mode: PW/PW res: [0x2b6be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561084:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004042fb39/0x3234de053c4cef2 lrc: 0/0,0 mode: --/PR res: [0x2b6bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cedb6 expref: 1161 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.561091:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.561096:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.561096:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1160:41279:x1731746396317312:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 43us (235us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.561097:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.561098:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c510d1 lrc: 3/0,1 mode: PW/PW res: [0x2b6bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.561099:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12188 00010000:00010000:1.0:1651529344.561101:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c510d1 lrc: 4/0,1 mode: PW/PW res: [0x2b6bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.561103:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12190 00000100:00100000:0.0:1651529344.561105:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de23fde4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1159:41278:x1731746396317440:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.561109:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.561113:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.561115:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1159:41278:x1731746396317376:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (239us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.561115:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003337bc40/0x3234de053c4d161 lrc: 5/0,0 mode: PR/PR res: [0x2b6c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf6d8 expref: 1159 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.561117:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12189 00010000:00010000:0.0:1651529344.561119:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003337bc40/0x3234de053c4d161 lrc: 4/0,0 mode: PR/PR res: [0x2b6c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf6d8 expref: 1159 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.561123:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.561124:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.561125:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a0efadcd/0x3234de053c510bc lrc: 3/0,1 mode: PW/PW res: [0x2b6bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561125:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c510d8 lrc: 3/0,1 mode: PW/PW res: [0x2b6c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561128:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0efadcd/0x3234de053c510bc lrc: 3/0,1 mode: PW/PW res: [0x2b6bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561128:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c510d8 lrc: 4/0,1 mode: PW/PW res: [0x2b6c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561131:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0efadcd/0x3234de053c510bc lrc: 3/0,1 mode: PW/PW res: [0x2b6bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561132:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.561134:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0efadcd/0x3234de053c510bc lrc: 2/0,0 mode: PW/PW res: [0x2b6bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.561137:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de23fde4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1158:41278:x1731746396317440:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.561139:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12190 00010000:00010000:0.0:1651529344.561155:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0efadcd/0x3234de053c510bc lrc: 2/0,0 mode: PW/PW res: [0x2b6bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561158:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a0efadcd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.561160:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0efadcd/0x3234de053c510bc lrc: 2/0,0 mode: PW/PW res: [0x2b6bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561162:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0efadcd/0x3234de053c510bc lrc: 3/0,0 mode: PW/PW res: [0x2b6bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561166:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0efadcd/0x3234de053c510bc lrc: 1/0,0 mode: --/PW res: [0x2b6bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561169:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0efadcd/0x3234de053c510bc lrc: 0/0,0 mode: --/PW res: [0x2b6bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561177:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c510ae lrc: 3/0,1 mode: PW/PW res: [0x2b6b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561180:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c510ae lrc: 3/0,1 mode: PW/PW res: [0x2b6b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.561185:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+903:39029:x1731745946436032:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1904us (2068us total) trans 12885079456 rc 0/0 00000100:00100000:1.0:1651529344.561188:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211404 00010000:00010000:0.0:1651529344.561189:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c510ae lrc: 3/0,1 mode: PW/PW res: [0x2b6b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561192:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c510ae lrc: 2/0,0 mode: PW/PW res: [0x2b6b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561195:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c1634cb6/0x3234de053c510b5 lrc: 3/0,1 mode: PW/PW res: [0x2b6bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561199:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1634cb6/0x3234de053c510b5 lrc: 3/0,1 mode: PW/PW res: [0x2b6bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561202:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1634cb6/0x3234de053c510b5 lrc: 3/0,1 mode: PW/PW res: [0x2b6bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561204:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1634cb6/0x3234de053c510b5 lrc: 2/0,0 mode: PW/PW res: [0x2b6bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.561256:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+904:39030:x1731745946435840:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 2060us (2175us total) trans 12885079457 rc 0/0 00000100:00100000:1.0:1651529344.561257:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+904:39030:x1731745946435968:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 2041us (2148us total) trans 12885079458 rc 0/0 00000100:00100000:0.0:1651529344.561259:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211402 00000100:00100000:1.0:1651529344.561261:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211403 00010000:00010000:0.0:1651529344.561267:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c510ae lrc: 2/0,0 mode: PW/PW res: [0x2b6b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561268:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000043037897/0x3234de053c510ca lrc: 3/0,1 mode: PW/PW res: [0x2b6be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561270:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000734ecdfd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.561271:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c510ae lrc: 2/0,0 mode: PW/PW res: [0x2b6b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561272:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043037897/0x3234de053c510ca lrc: 3/0,1 mode: PW/PW res: [0x2b6be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561274:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c510ae lrc: 3/0,0 mode: PW/PW res: [0x2b6b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561275:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043037897/0x3234de053c510ca lrc: 3/0,1 mode: PW/PW res: [0x2b6be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561278:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043037897/0x3234de053c510ca lrc: 2/0,0 mode: PW/PW res: [0x2b6be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561279:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c510ae lrc: 1/0,0 mode: --/PW res: [0x2b6b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561282:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c510ae lrc: 0/0,0 mode: --/PW res: [0x2b6b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561293:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1634cb6/0x3234de053c510b5 lrc: 2/0,0 mode: PW/PW res: [0x2b6bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561296:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1634cb6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.561297:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1634cb6/0x3234de053c510b5 lrc: 2/0,0 mode: PW/PW res: [0x2b6bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561299:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1634cb6/0x3234de053c510b5 lrc: 3/0,0 mode: PW/PW res: [0x2b6bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561303:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1634cb6/0x3234de053c510b5 lrc: 1/0,0 mode: --/PW res: [0x2b6bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561305:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1634cb6/0x3234de053c510b5 lrc: 0/0,0 mode: --/PW res: [0x2b6bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561309:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043037897/0x3234de053c510ca lrc: 2/0,0 mode: PW/PW res: [0x2b6be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561311:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000043037897 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.561312:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043037897/0x3234de053c510ca lrc: 2/0,0 mode: PW/PW res: [0x2b6be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.561313:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+903:39030:x1731745946436160:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1989us (2181us total) trans 12885079459 rc 0/0 00000100:00100000:1.0:1651529344.561316:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211406 00010000:00010000:0.0:1651529344.561317:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043037897/0x3234de053c510ca lrc: 3/0,0 mode: PW/PW res: [0x2b6be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561320:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043037897/0x3234de053c510ca lrc: 1/0,0 mode: --/PW res: [0x2b6be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561323:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000056ce51ac/0x3234de053c510a7 lrc: 3/0,1 mode: PW/PW res: [0x2b6ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561323:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043037897/0x3234de053c510ca lrc: 0/0,0 mode: --/PW res: [0x2b6be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561326:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056ce51ac/0x3234de053c510a7 lrc: 3/0,1 mode: PW/PW res: [0x2b6ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561329:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056ce51ac/0x3234de053c510a7 lrc: 3/0,1 mode: PW/PW res: [0x2b6ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561331:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c510c3 lrc: 3/0,1 mode: PW/PW res: [0x2b6bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561332:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056ce51ac/0x3234de053c510a7 lrc: 2/0,0 mode: PW/PW res: [0x2b6ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561334:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c510c3 lrc: 3/0,1 mode: PW/PW res: [0x2b6bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561337:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c510c3 lrc: 3/0,1 mode: PW/PW res: [0x2b6bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561344:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c510c3 lrc: 2/0,0 mode: PW/PW res: [0x2b6bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.561366:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+904:39029:x1731745946435904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 2209us (2303us total) trans 12885079460 rc 0/0 00000100:00100000:1.0:1651529344.561369:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211401 00010000:00010000:1.0:1651529344.561379:0:80279:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003337bc40/0x3234de053c4d161 lrc: 0/0,0 mode: --/PR res: [0x2b6c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf6d8 expref: 1157 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.561383:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000057329b82 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996996864:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.561383:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+903:39030:x1731745946436096:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 2087us (2260us total) trans 12885079461 rc 0/0 00000100:00100000:0.0:1651529344.561386:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211405 00010000:00010000:1.0:1651529344.561387:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c510d8 lrc: 3/0,1 mode: PW/PW res: [0x2b6c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561390:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c510d8 lrc: 3/0,1 mode: PW/PW res: [0x2b6c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561393:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056ce51ac/0x3234de053c510a7 lrc: 2/0,0 mode: PW/PW res: [0x2b6ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561396:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c510d8 lrc: 3/0,1 mode: PW/PW res: [0x2b6c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561399:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c510d8 lrc: 3/0,1 mode: PW/PW res: [0x2b6c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561399:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000056ce51ac already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.561400:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056ce51ac/0x3234de053c510a7 lrc: 2/0,0 mode: PW/PW res: [0x2b6ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561401:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c510d8 lrc: 2/0,0 mode: PW/PW res: [0x2b6c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561402:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056ce51ac/0x3234de053c510a7 lrc: 3/0,0 mode: PW/PW res: [0x2b6ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561407:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056ce51ac/0x3234de053c510a7 lrc: 1/0,0 mode: --/PW res: [0x2b6ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561416:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056ce51ac/0x3234de053c510a7 lrc: 0/0,0 mode: --/PW res: [0x2b6ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561421:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c510c3 lrc: 2/0,0 mode: PW/PW res: [0x2b6bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561423:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000048c07243 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.561424:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c510c3 lrc: 2/0,0 mode: PW/PW res: [0x2b6bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561427:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c510c3 lrc: 3/0,0 mode: PW/PW res: [0x2b6bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561430:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c510c3 lrc: 1/0,0 mode: --/PW res: [0x2b6bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561433:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c510c3 lrc: 0/0,0 mode: --/PW res: [0x2b6bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561436:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c510d8 lrc: 2/0,0 mode: PW/PW res: [0x2b6c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561439:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000760c4860 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.561440:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+903:39029:x1731745946436608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1691us (1717us total) trans 12885079462 rc 0/0 00010000:00010000:0.0:1651529344.561440:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c510d8 lrc: 2/0,0 mode: PW/PW res: [0x2b6c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561442:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c510d8 lrc: 3/0,0 mode: PW/PW res: [0x2b6c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.561443:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211408 00010000:00010000:0.0:1651529344.561445:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c510d8 lrc: 1/0,0 mode: --/PW res: [0x2b6c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561448:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000760c4860/0x3234de053c510d8 lrc: 0/0,0 mode: --/PW res: [0x2b6c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561454:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c510d1 lrc: 3/0,1 mode: PW/PW res: [0x2b6bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561457:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c510d1 lrc: 3/0,1 mode: PW/PW res: [0x2b6bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561460:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c510d1 lrc: 3/0,1 mode: PW/PW res: [0x2b6bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561462:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c510d1 lrc: 2/0,0 mode: PW/PW res: [0x2b6bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.561498:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+903:39029:x1731745946436544:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1776us (1855us total) trans 12885079463 rc 0/0 00000100:00100000:0.0:1651529344.561501:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211407 00010000:00010000:0.0:1651529344.561508:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c510d1 lrc: 2/0,0 mode: PW/PW res: [0x2b6bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561511:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001d253066 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.561512:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c510d1 lrc: 2/0,0 mode: PW/PW res: [0x2b6bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561515:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c510d1 lrc: 3/0,0 mode: PW/PW res: [0x2b6bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561519:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c510d1 lrc: 1/0,0 mode: --/PW res: [0x2b6bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561522:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c510d1 lrc: 0/0,0 mode: --/PW res: [0x2b6bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.561718:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.561745:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.561750:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946437120 00000100:00100000:1.0:1651529344.561753:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.561762:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.561766:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946437248 00000100:00100000:0.0:1651529344.561772:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946437184 00000100:00100000:0.0:1651529344.561776:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946437312 00000100:00100000:1.0:1651529344.561784:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211409 00000100:00100000:1.0:1651529344.561786:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+906:39030:x1731745946437120:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.561787:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211410 00000100:00100000:0.0:1651529344.561788:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+906:39030:x1731745946437248:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.561792:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177857 count 1 00002000:00080000:0.0:1651529344.561794:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177859 count 1 00010000:00010000:1.0:1651529344.561796:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c510df lrc: 3/0,1 mode: --/PW res: [0x2b6c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561799:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c510e6 lrc: 3/0,1 mode: --/PW res: [0x2b6c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561801:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c14a9138/0x3234de053c4dc58 lrc: 2/0,0 mode: PR/PR res: [0x2b6c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d21aa expref: 1156 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.561804:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008660880b/0x3234de053c4c7ac lrc: 2/0,0 mode: PR/PR res: [0x2b6c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd11c expref: 1156 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.561805:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.561805:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.561806:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c510df lrc: 4/0,1 mode: --/PW res: [0x2b6c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.561807:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.561808:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.561809:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c510e6 lrc: 4/0,1 mode: --/PW res: [0x2b6c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561813:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c14a9138/0x3234de053c4dc58 lrc: 3/0,0 mode: PR/PR res: [0x2b6c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d21aa expref: 1156 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.561816:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008660880b/0x3234de053c4c7ac lrc: 3/0,0 mode: PR/PR res: [0x2b6c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd11c expref: 1156 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.561817:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c14a9138/0x3234de053c4dc58 lrc: 4/0,0 mode: PR/PR res: [0x2b6c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d21aa expref: 1156 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.561819:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008660880b/0x3234de053c4c7ac lrc: 4/0,0 mode: PR/PR res: [0x2b6c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd11c expref: 1156 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.561821:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006aa45e66 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996996928:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.561824:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001d1586f2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996996992:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.561836:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000babe2d90 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.561841:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c086aae3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.561843:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211411 00000100:00100000:1.0:1651529344.561845:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+906:39030:x1731745946437184:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.561850:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177858 count 1 00010000:00010000:1.0:1651529344.561853:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c510ed lrc: 3/0,1 mode: --/PW res: [0x2b6c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561858:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008c2e0bd6/0x3234de053c4e1fa lrc: 2/0,0 mode: PR/PR res: [0x2b6c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d392e expref: 1156 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.561861:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.561861:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.561862:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c510ed lrc: 4/0,1 mode: --/PW res: [0x2b6c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561868:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008c2e0bd6/0x3234de053c4e1fa lrc: 3/0,0 mode: PR/PR res: [0x2b6c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d392e expref: 1156 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.561876:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211412 00000100:00100000:0.0:1651529344.561878:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+906:39030:x1731745946437312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.561883:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177860 count 1 00010000:00010000:0.0:1651529344.561887:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c510f4 lrc: 3/0,1 mode: --/PW res: [0x2b6c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.561888:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008c2e0bd6/0x3234de053c4e1fa lrc: 4/0,0 mode: PR/PR res: [0x2b6c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d392e expref: 1156 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.561891:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005bc4e419/0x3234de053c4f6ad lrc: 2/0,0 mode: PR/PR res: [0x2b6c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d82 expref: 1156 pid: 156655 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.561892:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000075b025a pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996997056:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.561897:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.561898:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.561898:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c510f4 lrc: 4/0,1 mode: --/PW res: [0x2b6c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.561900:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a4eb401d going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.561914:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.561923:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005bc4e419/0x3234de053c4f6ad lrc: 3/0,0 mode: PR/PR res: [0x2b6c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d82 expref: 1156 pid: 156655 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.561927:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.561928:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005bc4e419/0x3234de053c4f6ad lrc: 4/0,0 mode: PR/PR res: [0x2b6c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d82 expref: 1156 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.561936:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.561951:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002f77bb41 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996997120:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.561962:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060852af0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.561969:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946437632 00000100:00100000:1.0:1651529344.561975:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.561992:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946437760 00000100:00100000:0.0:1651529344.561997:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946437696 00000100:00100000:0.0:1651529344.562000:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946437824 00000100:00100000:0.0:1651529344.562003:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211413 00000100:00100000:0.0:1651529344.562005:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+910:39030:x1731745946437632:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.562010:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177861 count 1 00010000:00010000:0.0:1651529344.562014:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c510fb lrc: 3/0,1 mode: --/PW res: [0x2b6c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562018:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000069a75e9b/0x3234de053c4e8c9 lrc: 2/0,0 mode: PR/PR res: [0x2b6c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d53c9 expref: 1156 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.562019:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211414 00000100:00100000:1.0:1651529344.562021:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+910:39030:x1731745946437760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.562024:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.562025:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.562025:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c510fb lrc: 4/0,1 mode: --/PW res: [0x2b6c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.562026:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177863 count 1 00010000:00010000:1.0:1651529344.562030:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c51102 lrc: 3/0,1 mode: --/PW res: [0x2b6c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562031:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000069a75e9b/0x3234de053c4e8c9 lrc: 3/0,0 mode: PR/PR res: [0x2b6c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d53c9 expref: 1156 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.562035:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004eba1bc5/0x3234de053c4ec03 lrc: 2/0,0 mode: PR/PR res: [0x2b6c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d619f expref: 1156 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.562035:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000069a75e9b/0x3234de053c4e8c9 lrc: 4/0,0 mode: PR/PR res: [0x2b6c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d53c9 expref: 1156 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.562038:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.562038:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.562039:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c51102 lrc: 4/0,1 mode: --/PW res: [0x2b6c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.562039:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002f363f4a pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996997184:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.562046:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004eba1bc5/0x3234de053c4ec03 lrc: 3/0,0 mode: PR/PR res: [0x2b6c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d619f expref: 1156 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.562052:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004eba1bc5/0x3234de053c4ec03 lrc: 4/0,0 mode: PR/PR res: [0x2b6c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d619f expref: 1156 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.562056:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f99b3c22 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996997248:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.562069:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a82c4968 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.562074:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d09f5ee1 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.562076:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211415 00000100:00100000:0.0:1651529344.562078:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+910:39030:x1731745946437696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.562080:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211416 00000100:00100000:1.0:1651529344.562082:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+910:39030:x1731745946437824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.562083:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177862 count 1 00002000:00080000:1.0:1651529344.562086:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177864 count 1 00010000:00010000:0.0:1651529344.562087:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c51109 lrc: 3/0,1 mode: --/PW res: [0x2b6c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.562089:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c51110 lrc: 3/0,1 mode: --/PW res: [0x2b6c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562091:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001e4f515e/0x3234de053c49f81 lrc: 2/0,0 mode: PR/PR res: [0x2b6c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb45f expref: 1156 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.562094:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000068762ab5/0x3234de053c4c8af lrc: 2/0,0 mode: PR/PR res: [0x2b6c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd464 expref: 1156 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.562095:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.562095:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.562096:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c51109 lrc: 4/0,1 mode: --/PW res: [0x2b6c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.562097:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.562097:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.562098:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c51110 lrc: 4/0,1 mode: --/PW res: [0x2b6c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.562104:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000068762ab5/0x3234de053c4c8af lrc: 3/0,0 mode: PR/PR res: [0x2b6c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd464 expref: 1156 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.562105:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001e4f515e/0x3234de053c49f81 lrc: 3/0,0 mode: PR/PR res: [0x2b6c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb45f expref: 1156 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.562107:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000068762ab5/0x3234de053c4c8af lrc: 4/0,0 mode: PR/PR res: [0x2b6c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd464 expref: 1156 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.562109:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001e4f515e/0x3234de053c49f81 lrc: 4/0,0 mode: PR/PR res: [0x2b6c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb45f expref: 1156 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.562112:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005d3fb3ef pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996997376:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.562114:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a925fbf6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996997312:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.562119:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e7e12492 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.562121:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 0000000053a0cffa going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.562185:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006aa45e66 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996996928:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.562190:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c510df lrc: 3/0,1 mode: --/PW res: [0x2b6c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.562192:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001d1586f2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996996992:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.562196:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c510e6 lrc: 3/0,1 mode: --/PW res: [0x2b6c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.562371:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.562387:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.562387:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396318272 00000100:00100000:1.0:1651529344.562394:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.562394:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008660880b/0x3234de053c4c7ac lrc: 4/0,0 mode: PR/PR res: [0x2b6c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd11c expref: 1157 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.562405:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396318208 00010000:00010000:0.0:1651529344.562407:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c14a9138/0x3234de053c4dc58 lrc: 4/0,0 mode: PR/PR res: [0x2b6c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d21aa expref: 1158 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.562412:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396318336 00010000:00010000:0.0:1651529344.562414:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008c2e0bd6/0x3234de053c4e1fa lrc: 5/0,0 mode: PR/PR res: [0x2b6c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d392e expref: 1159 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.562417:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.562418:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396318400 00010000:00010000:0.0:1651529344.562421:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005bc4e419/0x3234de053c4f6ad lrc: 5/0,0 mode: PR/PR res: [0x2b6c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d82 expref: 1160 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.562425:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12191 00000100:00100000:0.0:1651529344.562427:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1160:41278:x1731746396318272:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.562430:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.562431:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000075b025a pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996997056:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.562431:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008660880b/0x3234de053c4c7ac lrc: 4/0,0 mode: PR/PR res: [0x2b6c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd11c expref: 1160 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.562435:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c510ed lrc: 3/0,1 mode: --/PW res: [0x2b6c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562435:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008660880b/0x3234de053c4c7ac lrc: 3/0,0 mode: PR/PR res: [0x2b6c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd11c expref: 1160 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.562441:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008660880b/0x3234de053c4c7ac lrc: 0/0,0 mode: --/PR res: [0x2b6c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd11c expref: 1160 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.562443:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12192 00010000:00010000:0.0:1651529344.562444:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.562445:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1159:41278:x1731746396318208:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.562445:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.562446:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c510e6 lrc: 3/0,1 mode: PW/PW res: [0x2b6c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.562448:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.562449:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c510e6 lrc: 4/0,1 mode: PW/PW res: [0x2b6c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.562450:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c14a9138/0x3234de053c4dc58 lrc: 4/0,0 mode: PR/PR res: [0x2b6c1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d21aa expref: 1159 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.562454:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c14a9138/0x3234de053c4dc58 lrc: 3/0,0 mode: PR/PR res: [0x2b6c1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d21aa expref: 1159 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.562456:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.562460:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c14a9138/0x3234de053c4dc58 lrc: 0/0,0 mode: --/PR res: [0x2b6c1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d21aa expref: 1159 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.562464:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.562464:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.562465:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c510df lrc: 3/0,1 mode: PW/PW res: [0x2b6c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.562465:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1158:41278:x1731746396318272:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 37us (94us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.562468:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c510df lrc: 4/0,1 mode: PW/PW res: [0x2b6c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.562468:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12191 00000100:00100000:0.0:1651529344.562472:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12193 00000100:00100000:0.0:1651529344.562474:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1157:41279:x1731746396318336:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.562475:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.562476:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.562478:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008c2e0bd6/0x3234de053c4e1fa lrc: 4/0,0 mode: PR/PR res: [0x2b6c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d392e expref: 1157 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.562482:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1157:41278:x1731746396318208:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 36us (95us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.562482:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008c2e0bd6/0x3234de053c4e1fa lrc: 3/0,0 mode: PR/PR res: [0x2b6c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d392e expref: 1157 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.562485:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12192 00010000:00010000:0.0:1651529344.562486:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c2e0bd6/0x3234de053c4e1fa lrc: 0/0,0 mode: --/PR res: [0x2b6c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d392e expref: 1157 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.562490:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.562490:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.562491:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12194 00010000:00010000:0.0:1651529344.562491:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c510ed lrc: 3/0,1 mode: PW/PW res: [0x2b6c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.562492:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1155:41278:x1731746396318400:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.562494:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c510ed lrc: 4/0,1 mode: PW/PW res: [0x2b6c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.562495:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.562496:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005bc4e419/0x3234de053c4f6ad lrc: 5/0,0 mode: PR/PR res: [0x2b6c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d82 expref: 1155 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.562500:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005bc4e419/0x3234de053c4f6ad lrc: 4/0,0 mode: PR/PR res: [0x2b6c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d82 expref: 1155 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.562503:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.562509:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1155:41279:x1731746396318336:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 34us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.562511:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12193 00010000:00010000:1.0:1651529344.562512:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.562513:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.562514:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c510f4 lrc: 3/0,1 mode: PW/PW res: [0x2b6c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.562519:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c510f4 lrc: 4/0,1 mode: PW/PW res: [0x2b6c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562521:0:80276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005bc4e419/0x3234de053c4f6ad lrc: 0/0,0 mode: --/PR res: [0x2b6c4:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d82 expref: 1154 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.562524:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.562525:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002f77bb41 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996997120:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.562528:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c510f4 lrc: 3/0,1 mode: PW/PW res: [0x2b6c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.562529:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1153:41278:x1731746396318400:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.562531:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12194 00010000:00010000:0.0:1651529344.562532:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c510f4 lrc: 3/0,1 mode: PW/PW res: [0x2b6c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562534:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c510f4 lrc: 3/0,1 mode: PW/PW res: [0x2b6c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.562538:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c510df lrc: 3/0,1 mode: PW/PW res: [0x2b6c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562538:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c510f4 lrc: 3/0,1 mode: PW/PW res: [0x2b6c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562540:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c510f4 lrc: 2/0,0 mode: PW/PW res: [0x2b6c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.562542:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c510df lrc: 3/0,1 mode: PW/PW res: [0x2b6c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.562545:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c510df lrc: 3/0,1 mode: PW/PW res: [0x2b6c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.562547:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c510df lrc: 2/0,0 mode: PW/PW res: [0x2b6c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.562598:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+912:39030:x1731745946437120:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 811us (880us total) trans 12885079464 rc 0/0 00000100:00100000:1.0:1651529344.562601:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211409 00010000:00010000:1.0:1651529344.562608:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c510ed lrc: 3/0,1 mode: PW/PW res: [0x2b6c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.562610:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+911:39030:x1731745946437312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 731us (847us total) trans 12885079465 rc 0/0 00010000:00010000:1.0:1651529344.562611:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c510ed lrc: 3/0,1 mode: PW/PW res: [0x2b6c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.562613:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211412 00010000:00010000:1.0:1651529344.562614:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c510ed lrc: 3/0,1 mode: PW/PW res: [0x2b6c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.562617:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c510ed lrc: 2/0,0 mode: PW/PW res: [0x2b6c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562621:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c510f4 lrc: 2/0,0 mode: PW/PW res: [0x2b6c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562644:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000069f7ba22 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.562646:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c510f4 lrc: 2/0,0 mode: PW/PW res: [0x2b6c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562649:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c510f4 lrc: 3/0,0 mode: PW/PW res: [0x2b6c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.562656:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+911:39030:x1731745946437184:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 810us (903us total) trans 12885079466 rc 0/0 00010000:00010000:0.0:1651529344.562656:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c510f4 lrc: 1/0,0 mode: --/PW res: [0x2b6c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.562659:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211411 00010000:00010000:0.0:1651529344.562659:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c510f4 lrc: 0/0,0 mode: --/PW res: [0x2b6c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562664:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c510df lrc: 2/0,0 mode: PW/PW res: [0x2b6c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562666:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007104c91e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.562667:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c510df lrc: 2/0,0 mode: PW/PW res: [0x2b6c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562670:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c510df lrc: 3/0,0 mode: PW/PW res: [0x2b6c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562683:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c510df lrc: 1/0,0 mode: --/PW res: [0x2b6c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562686:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007104c91e/0x3234de053c510df lrc: 0/0,0 mode: --/PW res: [0x2b6c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562690:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c510ed lrc: 2/0,0 mode: PW/PW res: [0x2b6c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562693:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002e1250c9 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.562694:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c510ed lrc: 2/0,0 mode: PW/PW res: [0x2b6c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562702:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c510ed lrc: 3/0,0 mode: PW/PW res: [0x2b6c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562706:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c510ed lrc: 1/0,0 mode: --/PW res: [0x2b6c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562709:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e1250c9/0x3234de053c510ed lrc: 0/0,0 mode: --/PW res: [0x2b6c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.562718:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.562720:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002f363f4a pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996997184:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.562724:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c510fb lrc: 3/0,1 mode: --/PW res: [0x2b6c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.562727:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.562728:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c510e6 lrc: 3/0,1 mode: PW/PW res: [0x2b6c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562731:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c510e6 lrc: 3/0,1 mode: PW/PW res: [0x2b6c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562745:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c510e6 lrc: 3/0,1 mode: PW/PW res: [0x2b6c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562753:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c510e6 lrc: 2/0,0 mode: PW/PW res: [0x2b6c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.562791:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f99b3c22 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996997248:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.562797:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+911:39030:x1731745946437248:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1007us (1052us total) trans 12885079467 rc 0/0 00000100:00100000:0.0:1651529344.562800:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211410 00010000:00010000:1.0:1651529344.562801:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c51102 lrc: 3/0,1 mode: --/PW res: [0x2b6c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.562808:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396318464 00010000:00010000:0.0:1651529344.562808:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c510e6 lrc: 2/0,0 mode: PW/PW res: [0x2b6c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562811:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000002904524 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.562812:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c510e6 lrc: 2/0,0 mode: PW/PW res: [0x2b6c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.562813:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000069a75e9b/0x3234de053c4e8c9 lrc: 4/0,0 mode: PR/PR res: [0x2b6c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d53c9 expref: 1153 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.562815:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c510e6 lrc: 3/0,0 mode: PW/PW res: [0x2b6c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.562819:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396318528 00010000:00010000:1.0:1651529344.562821:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004eba1bc5/0x3234de053c4ec03 lrc: 4/0,0 mode: PR/PR res: [0x2b6c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d619f expref: 1154 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.562831:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12195 00000100:00100000:1.0:1651529344.562833:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1154:41279:x1731746396318464:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.562837:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.562838:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000069a75e9b/0x3234de053c4e8c9 lrc: 4/0,0 mode: PR/PR res: [0x2b6c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d53c9 expref: 1154 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.562839:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c510e6 lrc: 1/0,0 mode: --/PW res: [0x2b6c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.562842:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000069a75e9b/0x3234de053c4e8c9 lrc: 3/0,0 mode: PR/PR res: [0x2b6c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d53c9 expref: 1154 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.562843:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c510e6 lrc: 0/0,0 mode: --/PW res: [0x2b6c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.562847:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069a75e9b/0x3234de053c4e8c9 lrc: 0/0,0 mode: --/PR res: [0x2b6c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d53c9 expref: 1154 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.562851:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.562851:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.562852:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c510fb lrc: 3/0,1 mode: PW/PW res: [0x2b6c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.562853:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005d3fb3ef pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996997376:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.562855:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c510fb lrc: 4/0,1 mode: PW/PW res: [0x2b6c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562857:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c51109 lrc: 3/0,1 mode: --/PW res: [0x2b6c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.562863:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.562869:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12196 00000100:00100000:1.0:1651529344.562870:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1153:41279:x1731746396318464:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 37us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.562871:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1153:41278:x1731746396318528:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.562873:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12195 00010000:00010000:0.0:1651529344.562875:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.562876:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004eba1bc5/0x3234de053c4ec03 lrc: 4/0,0 mode: PR/PR res: [0x2b6c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d619f expref: 1152 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.562880:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004eba1bc5/0x3234de053c4ec03 lrc: 3/0,0 mode: PR/PR res: [0x2b6c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d619f expref: 1152 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.562883:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a925fbf6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996997312:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.562885:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004eba1bc5/0x3234de053c4ec03 lrc: 0/0,0 mode: --/PR res: [0x2b6c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d619f expref: 1152 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.562886:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c51110 lrc: 3/0,1 mode: --/PW res: [0x2b6c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562889:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.562889:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.562890:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c51102 lrc: 3/0,1 mode: PW/PW res: [0x2b6c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562893:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c51102 lrc: 4/0,1 mode: PW/PW res: [0x2b6c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562902:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.562911:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1151:41278:x1731746396318528:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.562915:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12196 00010000:00010000:1.0:1651529344.562940:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c51102 lrc: 3/0,1 mode: PW/PW res: [0x2b6c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.562954:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c51102 lrc: 3/0,1 mode: PW/PW res: [0x2b6c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562955:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c510fb lrc: 3/0,1 mode: PW/PW res: [0x2b6c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.562957:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c51102 lrc: 3/0,1 mode: PW/PW res: [0x2b6c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562959:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c510fb lrc: 3/0,1 mode: PW/PW res: [0x2b6c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.562960:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c51102 lrc: 2/0,0 mode: PW/PW res: [0x2b6c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562962:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c510fb lrc: 3/0,1 mode: PW/PW res: [0x2b6c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.562972:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c510fb lrc: 2/0,0 mode: PW/PW res: [0x2b6c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.563001:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+912:39030:x1731745946437760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 979us (1073us total) trans 12885079468 rc 0/0 00000100:00100000:1.0:1651529344.563004:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211414 00000100:00100000:0.0:1651529344.563013:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+911:39030:x1731745946437632:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1007us (1099us total) trans 12885079469 rc 0/0 00000100:00100000:0.0:1651529344.563016:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211413 00000100:00100000:1.0:1651529344.563020:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.563024:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c51102 lrc: 2/0,0 mode: PW/PW res: [0x2b6c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563034:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005531aaab already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.563035:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c51102 lrc: 2/0,0 mode: PW/PW res: [0x2b6c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.563037:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.563038:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c51102 lrc: 3/0,0 mode: PW/PW res: [0x2b6c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563062:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c51102 lrc: 1/0,0 mode: --/PW res: [0x2b6c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563066:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005531aaab/0x3234de053c51102 lrc: 0/0,0 mode: --/PW res: [0x2b6c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.563070:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396318720 00010000:00010000:0.0:1651529344.563070:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c510fb lrc: 2/0,0 mode: PW/PW res: [0x2b6c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563073:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000085580035 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.563074:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c510fb lrc: 2/0,0 mode: PW/PW res: [0x2b6c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.563076:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001e4f515e/0x3234de053c49f81 lrc: 4/0,0 mode: PR/PR res: [0x2b6c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb45f expref: 1151 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.563077:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c510fb lrc: 3/0,0 mode: PW/PW res: [0x2b6c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563080:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c510fb lrc: 1/0,0 mode: --/PW res: [0x2b6c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.563083:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396318848 00010000:00010000:0.0:1651529344.563083:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c510fb lrc: 0/0,0 mode: --/PW res: [0x2b6c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.563085:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000068762ab5/0x3234de053c4c8af lrc: 4/0,0 mode: PR/PR res: [0x2b6c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd464 expref: 1152 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.563091:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12197 00000100:00100000:1.0:1651529344.563093:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d46d0fc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1152:41279:x1731746396318720:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.563093:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12198 00010000:00010000:1.0:1651529344.563095:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.563095:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1152:41279:x1731746396318848:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.563097:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001e4f515e/0x3234de053c49f81 lrc: 4/0,0 mode: PR/PR res: [0x2b6c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb45f expref: 1152 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.563098:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.563100:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001e4f515e/0x3234de053c49f81 lrc: 3/0,0 mode: PR/PR res: [0x2b6c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb45f expref: 1152 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.563100:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000068762ab5/0x3234de053c4c8af lrc: 4/0,0 mode: PR/PR res: [0x2b6c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd464 expref: 1152 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.563104:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000068762ab5/0x3234de053c4c8af lrc: 3/0,0 mode: PR/PR res: [0x2b6c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd464 expref: 1152 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.563106:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e4f515e/0x3234de053c49f81 lrc: 0/0,0 mode: --/PR res: [0x2b6c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb45f expref: 1152 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.563108:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068762ab5/0x3234de053c4c8af lrc: 0/0,0 mode: --/PR res: [0x2b6c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd464 expref: 1152 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.563110:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.563110:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.563111:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c51109 lrc: 3/0,1 mode: PW/PW res: [0x2b6c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563112:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.563112:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.563113:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c51110 lrc: 3/0,1 mode: PW/PW res: [0x2b6c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.563114:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c51109 lrc: 4/0,1 mode: PW/PW res: [0x2b6c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563119:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c51110 lrc: 4/0,1 mode: PW/PW res: [0x2b6c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.563124:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.563131:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d46d0fc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1150:41279:x1731746396318720:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 38us (111us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.563134:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.563140:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12197 00010000:00010000:1.0:1651529344.563152:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c51110 lrc: 3/0,1 mode: PW/PW res: [0x2b6c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.563155:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c51110 lrc: 3/0,1 mode: PW/PW res: [0x2b6c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.563155:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1149:41279:x1731746396318848:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 46us (105us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.563158:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c51110 lrc: 3/0,1 mode: PW/PW res: [0x2b6c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.563158:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12198 00010000:00010000:1.0:1651529344.563161:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c51110 lrc: 2/0,0 mode: PW/PW res: [0x2b6c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563165:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c51109 lrc: 3/0,1 mode: PW/PW res: [0x2b6c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563174:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c51109 lrc: 3/0,1 mode: PW/PW res: [0x2b6c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563178:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c51109 lrc: 3/0,1 mode: PW/PW res: [0x2b6c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563180:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c51109 lrc: 2/0,0 mode: PW/PW res: [0x2b6c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.563202:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+912:39030:x1731745946437824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1120us (1227us total) trans 12885079470 rc 0/0 00000100:00100000:1.0:1651529344.563205:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211416 00000100:00100000:0.0:1651529344.563247:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+911:39030:x1731745946437696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1162us (1305us total) trans 12885079471 rc 0/0 00000100:00100000:0.0:1651529344.563250:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211415 00000100:00100000:1.0:1651529344.563253:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.563265:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c51110 lrc: 2/0,0 mode: PW/PW res: [0x2b6c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.563269:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.563269:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001650e9dc already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.563270:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c51110 lrc: 2/0,0 mode: PW/PW res: [0x2b6c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563273:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c51110 lrc: 3/0,0 mode: PW/PW res: [0x2b6c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563278:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c51110 lrc: 1/0,0 mode: --/PW res: [0x2b6c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.563280:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.563280:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001650e9dc/0x3234de053c51110 lrc: 0/0,0 mode: --/PW res: [0x2b6c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563289:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c51109 lrc: 2/0,0 mode: PW/PW res: [0x2b6c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563292:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006c0ed60a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.563293:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c51109 lrc: 2/0,0 mode: PW/PW res: [0x2b6c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563296:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c51109 lrc: 3/0,0 mode: PW/PW res: [0x2b6c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563299:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c51109 lrc: 1/0,0 mode: --/PW res: [0x2b6c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563302:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c51109 lrc: 0/0,0 mode: --/PW res: [0x2b6c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.563309:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.563309:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946438144 00000100:00100000:0.0:1651529344.563315:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946438080 00000100:00100000:0.0:1651529344.563322:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946438208 00000100:00100000:0.0:1651529344.563326:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946438400 00000100:00100000:0.0:1651529344.563333:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211417 00000100:00100000:0.0:1651529344.563334:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+914:39030:x1731745946438144:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.563346:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.563353:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177866 count 1 00000100:00100000:1.0:1651529344.563354:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.563357:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51117 lrc: 3/0,1 mode: --/PW res: [0x2b6ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.563361:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946438528 00010000:00010000:0.0:1651529344.563362:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c4ae30 lrc: 2/0,0 mode: PR/PR res: [0x2b6ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf3a expref: 1148 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.563366:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.563366:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.563367:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51117 lrc: 4/0,1 mode: --/PW res: [0x2b6ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.563371:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946438464 00000100:00100000:1.0:1651529344.563377:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211418 00000100:00100000:1.0:1651529344.563379:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+916:39029:x1731745946438080:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.563384:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177865 count 1 00010000:00010000:0.0:1651529344.563385:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c4ae30 lrc: 3/0,0 mode: PR/PR res: [0x2b6ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf3a expref: 1148 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.563389:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c5111e lrc: 3/0,1 mode: --/PW res: [0x2b6c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563389:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c4ae30 lrc: 4/0,0 mode: PR/PR res: [0x2b6ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf3a expref: 1148 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.563393:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005d3fb3ef pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996997440:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.563394:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e0580105/0x3234de053c4dba2 lrc: 2/0,0 mode: PR/PR res: [0x2b6c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e9a expref: 1148 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.563397:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.563397:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.563398:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c5111e lrc: 4/0,1 mode: --/PW res: [0x2b6c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.563407:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a82c4968 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.563414:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e0580105/0x3234de053c4dba2 lrc: 3/0,0 mode: PR/PR res: [0x2b6c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e9a expref: 1148 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.563414:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211419 00000100:00100000:0.0:1651529344.563416:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000020f79bc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+916:39029:x1731745946438208:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.563418:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e0580105/0x3234de053c4dba2 lrc: 4/0,0 mode: PR/PR res: [0x2b6c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e9a expref: 1148 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:0.0:1651529344.563421:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177867 count 1 00000100:00100000:1.0:1651529344.563422:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000075b025a pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996997504:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.563424:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51125 lrc: 3/0,1 mode: --/PW res: [0x2b6cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563429:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009759a81a/0x3234de053c4eaa5 lrc: 2/0,0 mode: PR/PR res: [0x2b6cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c5f expref: 1148 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.563431:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cfa1ca05 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.563432:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.563432:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.563433:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51125 lrc: 4/0,1 mode: --/PW res: [0x2b6cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.563437:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211420 00000100:00100000:1.0:1651529344.563439:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+916:39029:x1731745946438400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.563444:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177868 count 1 00010000:00010000:1.0:1651529344.563447:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c5112c lrc: 3/0,1 mode: --/PW res: [0x2b6cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.563451:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000066c2c73b/0x3234de053c4e74f lrc: 2/0,0 mode: PR/PR res: [0x2b6cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e12 expref: 1148 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.563454:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.563455:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.563455:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c5112c lrc: 4/0,1 mode: --/PW res: [0x2b6cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563455:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009759a81a/0x3234de053c4eaa5 lrc: 3/0,0 mode: PR/PR res: [0x2b6cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c5f expref: 1148 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.563459:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009759a81a/0x3234de053c4eaa5 lrc: 4/0,0 mode: PR/PR res: [0x2b6cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c5f expref: 1148 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.563462:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000066c2c73b/0x3234de053c4e74f lrc: 3/0,0 mode: PR/PR res: [0x2b6cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e12 expref: 1148 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.563463:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002f363f4a pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996997568:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.563465:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000066c2c73b/0x3234de053c4e74f lrc: 4/0,0 mode: PR/PR res: [0x2b6cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e12 expref: 1148 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.563469:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006e255cae pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996997632:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.563471:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e1aa6a77 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.563476:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 0000000071742acc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.563478:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211421 00000100:00100000:0.0:1651529344.563479:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+916:39030:x1731745946438528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.563481:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211422 00000100:00100000:1.0:1651529344.563483:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+916:39029:x1731745946438464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.563484:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177870 count 1 00002000:00080000:1.0:1651529344.563487:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177869 count 1 00010000:00010000:0.0:1651529344.563487:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c51133 lrc: 3/0,1 mode: --/PW res: [0x2b6ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.563490:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004645bf7f/0x3234de053c5113a lrc: 3/0,1 mode: --/PW res: [0x2b6cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563492:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000044cb0b20/0x3234de053c4ed7d lrc: 2/0,0 mode: PR/PR res: [0x2b6ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d686e expref: 1148 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.563494:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ae62dd69/0x3234de053c4e048 lrc: 2/0,0 mode: PR/PR res: [0x2b6cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3219 expref: 1148 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.563497:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.563497:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.563497:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.563498:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004645bf7f/0x3234de053c5113a lrc: 4/0,1 mode: --/PW res: [0x2b6cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563498:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.563498:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c51133 lrc: 4/0,1 mode: --/PW res: [0x2b6ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.563504:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ae62dd69/0x3234de053c4e048 lrc: 3/0,0 mode: PR/PR res: [0x2b6cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3219 expref: 1148 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.563504:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000044cb0b20/0x3234de053c4ed7d lrc: 3/0,0 mode: PR/PR res: [0x2b6ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d686e expref: 1148 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.563507:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ae62dd69/0x3234de053c4e048 lrc: 4/0,0 mode: PR/PR res: [0x2b6cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3219 expref: 1148 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.563508:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000044cb0b20/0x3234de053c4ed7d lrc: 4/0,0 mode: PR/PR res: [0x2b6ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d686e expref: 1148 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.563511:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003562cf4d pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996997696:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.563512:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002f77bb41 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996997760:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.563517:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f9dac3f6 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.563519:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060852af0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.563531:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.563544:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.563576:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946438592 00000100:00100000:0.0:1651529344.563583:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946438656 00000100:00100000:0.0:1651529344.563591:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211423 00000100:00100000:0.0:1651529344.563593:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+918:39029:x1731745946438592:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.563598:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177871 count 1 00010000:00010000:0.0:1651529344.563602:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c51141 lrc: 3/0,1 mode: --/PW res: [0x2b6cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563606:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a372b285/0x3234de053c4e76b lrc: 2/0,0 mode: PR/PR res: [0x2b6cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e74 expref: 1148 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.563607:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211424 00000100:00100000:1.0:1651529344.563609:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+918:39030:x1731745946438656:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.563609:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.563610:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.563611:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c51141 lrc: 4/0,1 mode: --/PW res: [0x2b6cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.563615:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177872 count 1 00010000:00010000:0.0:1651529344.563617:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a372b285/0x3234de053c4e76b lrc: 3/0,0 mode: PR/PR res: [0x2b6cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e74 expref: 1148 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.563618:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd0e6a75/0x3234de053c51148 lrc: 3/0,1 mode: --/PW res: [0x2b6d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.563621:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a372b285/0x3234de053c4e76b lrc: 4/0,0 mode: PR/PR res: [0x2b6cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e74 expref: 1148 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.563623:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e03711e0/0x3234de053c4e8e5 lrc: 2/0,0 mode: PR/PR res: [0x2b6d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5455 expref: 1148 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.563625:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001d1586f2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996997824:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.563626:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.563627:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.563627:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd0e6a75/0x3234de053c51148 lrc: 4/0,1 mode: --/PW res: [0x2b6d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.563634:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e03711e0/0x3234de053c4e8e5 lrc: 3/0,0 mode: PR/PR res: [0x2b6d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5455 expref: 1148 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.563638:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 000000000a4def41 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.563644:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e03711e0/0x3234de053c4e8e5 lrc: 4/0,0 mode: PR/PR res: [0x2b6d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5455 expref: 1148 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.563648:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f99b3c22 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996997888:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.563657:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000499d0377 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.563714:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005d3fb3ef pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996997440:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.563719:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51117 lrc: 3/0,1 mode: --/PW res: [0x2b6ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.563789:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000075b025a pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996997504:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.563794:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c5111e lrc: 3/0,1 mode: --/PW res: [0x2b6c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.564042:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.564050:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.564066:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396319232 00000100:00100000:0.0:1651529344.564076:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002f363f4a pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996997568:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.564077:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c4ae30 lrc: 4/0,0 mode: PR/PR res: [0x2b6ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf3a expref: 1149 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.564081:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51125 lrc: 3/0,1 mode: --/PW res: [0x2b6cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.564085:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396319296 00010000:00010000:1.0:1651529344.564087:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e0580105/0x3234de053c4dba2 lrc: 4/0,0 mode: PR/PR res: [0x2b6c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e9a expref: 1150 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.564089:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12199 00000100:00100000:0.0:1651529344.564091:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1150:41279:x1731746396319232:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.564093:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12200 00000100:00100000:1.0:1651529344.564095:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1150:41279:x1731746396319296:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.564095:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.564096:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c4ae30 lrc: 4/0,0 mode: PR/PR res: [0x2b6ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf3a expref: 1150 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.564098:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.564099:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e0580105/0x3234de053c4dba2 lrc: 4/0,0 mode: PR/PR res: [0x2b6c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e9a expref: 1150 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.564103:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e0580105/0x3234de053c4dba2 lrc: 3/0,0 mode: PR/PR res: [0x2b6c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e9a expref: 1150 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.564103:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c4ae30 lrc: 3/0,0 mode: PR/PR res: [0x2b6ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf3a expref: 1150 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.564108:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c4ae30 lrc: 0/0,0 mode: --/PR res: [0x2b6ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf3a expref: 1150 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.564109:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0580105/0x3234de053c4dba2 lrc: 0/0,0 mode: --/PR res: [0x2b6c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e9a expref: 1150 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.564112:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.564112:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.564113:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.564113:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.564114:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c5111e lrc: 3/0,1 mode: PW/PW res: [0x2b6c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564114:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51117 lrc: 3/0,1 mode: PW/PW res: [0x2b6ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.564117:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c5111e lrc: 4/0,1 mode: PW/PW res: [0x2b6c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564117:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51117 lrc: 4/0,1 mode: PW/PW res: [0x2b6ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.564123:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.564123:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.564135:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1148:41279:x1731746396319232:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 43us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.564137:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12199 00000100:00100000:1.0:1651529344.564139:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1148:41279:x1731746396319296:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 44us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.564142:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12200 00010000:00010000:0.0:1651529344.564145:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51117 lrc: 3/0,1 mode: PW/PW res: [0x2b6ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564148:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51117 lrc: 3/0,1 mode: PW/PW res: [0x2b6ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564151:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51117 lrc: 3/0,1 mode: PW/PW res: [0x2b6ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.564152:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006e255cae pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996997632:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.564156:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c5112c lrc: 3/0,1 mode: --/PW res: [0x2b6cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564156:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51117 lrc: 2/0,0 mode: PW/PW res: [0x2b6ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.564162:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c5111e lrc: 3/0,1 mode: PW/PW res: [0x2b6c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.564165:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c5111e lrc: 3/0,1 mode: PW/PW res: [0x2b6c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.564168:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c5111e lrc: 3/0,1 mode: PW/PW res: [0x2b6c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.564171:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c5111e lrc: 2/0,0 mode: PW/PW res: [0x2b6c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.564207:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+920:39030:x1731745946438144:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 872us (954us total) trans 12885079472 rc 0/0 00000100:00100000:0.0:1651529344.564210:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211417 00000100:00100000:1.0:1651529344.564215:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+919:39029:x1731745946438080:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 835us (946us total) trans 12885079473 rc 0/0 00010000:00010000:0.0:1651529344.564217:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51117 lrc: 2/0,0 mode: PW/PW res: [0x2b6ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.564218:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211418 00010000:00010000:0.0:1651529344.564220:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a0607df4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.564221:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51117 lrc: 2/0,0 mode: PW/PW res: [0x2b6ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564243:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51117 lrc: 3/0,0 mode: PW/PW res: [0x2b6ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564248:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51117 lrc: 1/0,0 mode: --/PW res: [0x2b6ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564251:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51117 lrc: 0/0,0 mode: --/PW res: [0x2b6ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564255:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c5111e lrc: 2/0,0 mode: PW/PW res: [0x2b6c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564272:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000f905106 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.564273:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c5111e lrc: 2/0,0 mode: PW/PW res: [0x2b6c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564276:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c5111e lrc: 3/0,0 mode: PW/PW res: [0x2b6c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564280:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c5111e lrc: 1/0,0 mode: --/PW res: [0x2b6c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564282:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f905106/0x3234de053c5111e lrc: 0/0,0 mode: --/PW res: [0x2b6c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.564311:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003562cf4d pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996997696:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.564315:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004645bf7f/0x3234de053c5113a lrc: 3/0,1 mode: --/PW res: [0x2b6cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.564336:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f99b3c22 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996997888:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.564340:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cd0e6a75/0x3234de053c51148 lrc: 3/0,1 mode: --/PW res: [0x2b6d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.564348:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002f77bb41 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996997760:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.564350:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.564352:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c51133 lrc: 3/0,1 mode: --/PW res: [0x2b6ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.564357:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.564359:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001d1586f2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996997824:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.564362:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c51141 lrc: 3/0,1 mode: --/PW res: [0x2b6cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.564363:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.564370:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.564384:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.564389:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396319488 00010000:00010000:0.0:1651529344.564395:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000066c2c73b/0x3234de053c4e74f lrc: 4/0,0 mode: PR/PR res: [0x2b6cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e12 expref: 1147 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.564400:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.564401:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396319616 00010000:00010000:0.0:1651529344.564403:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ae62dd69/0x3234de053c4e048 lrc: 4/0,0 mode: PR/PR res: [0x2b6cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3219 expref: 1148 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.564410:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396319744 00010000:00010000:0.0:1651529344.564412:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e03711e0/0x3234de053c4e8e5 lrc: 4/0,0 mode: PR/PR res: [0x2b6d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5455 expref: 1149 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.564414:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396319424 00000100:00100000:0.0:1651529344.564416:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396319680 00010000:00010000:0.0:1651529344.564418:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000044cb0b20/0x3234de053c4ed7d lrc: 4/0,0 mode: PR/PR res: [0x2b6ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d686e expref: 1151 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.564420:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009759a81a/0x3234de053c4eaa5 lrc: 4/0,0 mode: PR/PR res: [0x2b6cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c5f expref: 1151 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.564426:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396319808 00010000:00010000:1.0:1651529344.564428:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a372b285/0x3234de053c4e76b lrc: 4/0,0 mode: PR/PR res: [0x2b6cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e74 expref: 1152 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.564433:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12201 00000100:00100000:1.0:1651529344.564434:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1152:41279:x1731746396319488:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.564437:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.564438:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000066c2c73b/0x3234de053c4e74f lrc: 4/0,0 mode: PR/PR res: [0x2b6cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e12 expref: 1152 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.564441:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12202 00010000:00010000:1.0:1651529344.564442:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000066c2c73b/0x3234de053c4e74f lrc: 3/0,0 mode: PR/PR res: [0x2b6cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e12 expref: 1152 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.564442:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1152:41279:x1731746396319616:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.564448:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066c2c73b/0x3234de053c4e74f lrc: 0/0,0 mode: --/PR res: [0x2b6cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e12 expref: 1152 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.564452:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.564452:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.564453:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c5112c lrc: 3/0,1 mode: PW/PW res: [0x2b6cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564455:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.564456:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c5112c lrc: 4/0,1 mode: PW/PW res: [0x2b6cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564457:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ae62dd69/0x3234de053c4e048 lrc: 4/0,0 mode: PR/PR res: [0x2b6cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3219 expref: 1151 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.564461:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ae62dd69/0x3234de053c4e048 lrc: 3/0,0 mode: PR/PR res: [0x2b6cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3219 expref: 1151 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.564463:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.564467:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae62dd69/0x3234de053c4e048 lrc: 0/0,0 mode: --/PR res: [0x2b6cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3219 expref: 1151 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.564471:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.564471:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.564472:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1150:41279:x1731746396319488:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 37us (122us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.564472:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004645bf7f/0x3234de053c5113a lrc: 3/0,1 mode: PW/PW res: [0x2b6cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.564474:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12201 00010000:00010000:0.0:1651529344.564475:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004645bf7f/0x3234de053c5113a lrc: 4/0,1 mode: PW/PW res: [0x2b6cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.564479:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12203 00000100:00100000:1.0:1651529344.564480:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1149:41279:x1731746396319744:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.564483:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.564486:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.564491:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e03711e0/0x3234de053c4e8e5 lrc: 4/0,0 mode: PR/PR res: [0x2b6d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5455 expref: 1149 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.564494:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1149:41279:x1731746396319616:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 51us (136us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.564495:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e03711e0/0x3234de053c4e8e5 lrc: 3/0,0 mode: PR/PR res: [0x2b6d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5455 expref: 1149 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.564497:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12202 00010000:00010000:1.0:1651529344.564499:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e03711e0/0x3234de053c4e8e5 lrc: 0/0,0 mode: --/PR res: [0x2b6d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5455 expref: 1148 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.564502:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12204 00000100:00100000:0.0:1651529344.564504:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1148:41279:x1731746396319680:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.564505:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.564506:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.564506:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.564507:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cd0e6a75/0x3234de053c51148 lrc: 3/0,1 mode: PW/PW res: [0x2b6d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564508:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000044cb0b20/0x3234de053c4ed7d lrc: 4/0,0 mode: PR/PR res: [0x2b6ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d686e expref: 1147 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.564509:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd0e6a75/0x3234de053c51148 lrc: 4/0,1 mode: PW/PW res: [0x2b6d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564511:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000044cb0b20/0x3234de053c4ed7d lrc: 3/0,0 mode: PR/PR res: [0x2b6ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d686e expref: 1147 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.564515:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.564516:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044cb0b20/0x3234de053c4ed7d lrc: 0/0,0 mode: --/PR res: [0x2b6ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d686e expref: 1147 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.564520:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1146:41279:x1731746396319744:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 39us (157us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.564520:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.564521:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.564521:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c51133 lrc: 3/0,1 mode: PW/PW res: [0x2b6ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.564523:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12203 00010000:00010000:0.0:1651529344.564524:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c51133 lrc: 4/0,1 mode: PW/PW res: [0x2b6ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.564528:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12205 00000100:00100000:1.0:1651529344.564529:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1fb0a67 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1145:41279:x1731746396319424:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.564531:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.564532:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.564533:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009759a81a/0x3234de053c4eaa5 lrc: 4/0,0 mode: PR/PR res: [0x2b6cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c5f expref: 1145 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.564536:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1145:41279:x1731746396319680:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 31us (151us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.564537:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009759a81a/0x3234de053c4eaa5 lrc: 3/0,0 mode: PR/PR res: [0x2b6cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c5f expref: 1145 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.564538:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12204 00010000:00010000:1.0:1651529344.564541:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009759a81a/0x3234de053c4eaa5 lrc: 0/0,0 mode: --/PR res: [0x2b6cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c5f expref: 1144 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.564542:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12206 00000100:00100000:0.0:1651529344.564544:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007fca8239 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1144:41279:x1731746396319808:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.564545:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.564545:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.564546:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51125 lrc: 3/0,1 mode: PW/PW res: [0x2b6cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564546:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.564548:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a372b285/0x3234de053c4e76b lrc: 4/0,0 mode: PR/PR res: [0x2b6cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e74 expref: 1143 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.564549:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51125 lrc: 4/0,1 mode: PW/PW res: [0x2b6cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564551:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a372b285/0x3234de053c4e76b lrc: 3/0,0 mode: PR/PR res: [0x2b6cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e74 expref: 1143 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.564558:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.564562:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a372b285/0x3234de053c4e76b lrc: 0/0,0 mode: --/PR res: [0x2b6cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e74 expref: 1143 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.564564:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1fb0a67 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1143:41279:x1731746396319424:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 34us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.564566:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12205 00010000:00010000:0.0:1651529344.564566:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.564566:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.564567:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c51141 lrc: 3/0,1 mode: PW/PW res: [0x2b6cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564570:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c51141 lrc: 4/0,1 mode: PW/PW res: [0x2b6cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564576:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.564577:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c5112c lrc: 3/0,1 mode: PW/PW res: [0x2b6cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.564581:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c5112c lrc: 3/0,1 mode: PW/PW res: [0x2b6cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.564582:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007fca8239 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1141:41279:x1731746396319808:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 37us (182us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.564584:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c5112c lrc: 3/0,1 mode: PW/PW res: [0x2b6cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.564584:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12206 00010000:00010000:1.0:1651529344.564587:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c5112c lrc: 2/0,0 mode: PW/PW res: [0x2b6cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564591:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51125 lrc: 3/0,1 mode: PW/PW res: [0x2b6cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564600:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51125 lrc: 3/0,1 mode: PW/PW res: [0x2b6cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564603:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51125 lrc: 3/0,1 mode: PW/PW res: [0x2b6cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564606:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51125 lrc: 2/0,0 mode: PW/PW res: [0x2b6cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.564628:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+920:39029:x1731745946438400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1187us (1318us total) trans 12885079474 rc 0/0 00000100:00100000:1.0:1651529344.564630:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211420 00010000:00010000:1.0:1651529344.564637:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004645bf7f/0x3234de053c5113a lrc: 3/0,1 mode: PW/PW res: [0x2b6cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.564643:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004645bf7f/0x3234de053c5113a lrc: 3/0,1 mode: PW/PW res: [0x2b6cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.564645:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000020f79bc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+919:39029:x1731745946438208:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1228us (1364us total) trans 12885079475 rc 0/0 00010000:00010000:1.0:1651529344.564646:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004645bf7f/0x3234de053c5113a lrc: 3/0,1 mode: PW/PW res: [0x2b6cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.564648:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004645bf7f/0x3234de053c5113a lrc: 2/0,0 mode: PW/PW res: [0x2b6cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.564648:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211419 00010000:00010000:0.0:1651529344.564675:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c5112c lrc: 2/0,0 mode: PW/PW res: [0x2b6cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564679:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ae53a7c6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.564680:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c5112c lrc: 2/0,0 mode: PW/PW res: [0x2b6cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564683:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c5112c lrc: 3/0,0 mode: PW/PW res: [0x2b6cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.564685:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+919:39029:x1731745946438464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1201us (1331us total) trans 12885079476 rc 0/0 00000100:00100000:1.0:1651529344.564688:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211422 00010000:00010000:0.0:1651529344.564688:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c5112c lrc: 1/0,0 mode: --/PW res: [0x2b6cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564691:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae53a7c6/0x3234de053c5112c lrc: 0/0,0 mode: --/PW res: [0x2b6cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.564694:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cd0e6a75/0x3234de053c51148 lrc: 3/0,1 mode: PW/PW res: [0x2b6d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564695:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51125 lrc: 2/0,0 mode: PW/PW res: [0x2b6cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.564697:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd0e6a75/0x3234de053c51148 lrc: 3/0,1 mode: PW/PW res: [0x2b6d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564697:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eb50e2ae already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.564698:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51125 lrc: 2/0,0 mode: PW/PW res: [0x2b6cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.564700:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd0e6a75/0x3234de053c51148 lrc: 3/0,1 mode: PW/PW res: [0x2b6d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564701:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51125 lrc: 3/0,0 mode: PW/PW res: [0x2b6cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.564703:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd0e6a75/0x3234de053c51148 lrc: 2/0,0 mode: PW/PW res: [0x2b6d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564704:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51125 lrc: 1/0,0 mode: --/PW res: [0x2b6cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564707:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51125 lrc: 0/0,0 mode: --/PW res: [0x2b6cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564710:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004645bf7f/0x3234de053c5113a lrc: 2/0,0 mode: PW/PW res: [0x2b6cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564712:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004645bf7f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.564713:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004645bf7f/0x3234de053c5113a lrc: 2/0,0 mode: PW/PW res: [0x2b6cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564716:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004645bf7f/0x3234de053c5113a lrc: 3/0,0 mode: PW/PW res: [0x2b6cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564719:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004645bf7f/0x3234de053c5113a lrc: 1/0,0 mode: --/PW res: [0x2b6cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564722:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004645bf7f/0x3234de053c5113a lrc: 0/0,0 mode: --/PW res: [0x2b6cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564725:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd0e6a75/0x3234de053c51148 lrc: 2/0,0 mode: PW/PW res: [0x2b6d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564728:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cd0e6a75 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.564729:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd0e6a75/0x3234de053c51148 lrc: 2/0,0 mode: PW/PW res: [0x2b6d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.564730:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+919:39030:x1731745946438656:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1120us (1186us total) trans 12885079477 rc 0/0 00010000:00010000:0.0:1651529344.564731:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd0e6a75/0x3234de053c51148 lrc: 3/0,0 mode: PW/PW res: [0x2b6d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.564744:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211424 00010000:00010000:0.0:1651529344.564744:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd0e6a75/0x3234de053c51148 lrc: 1/0,0 mode: --/PW res: [0x2b6d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564747:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd0e6a75/0x3234de053c51148 lrc: 0/0,0 mode: --/PW res: [0x2b6d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564755:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c51133 lrc: 3/0,1 mode: PW/PW res: [0x2b6ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564757:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c51133 lrc: 3/0,1 mode: PW/PW res: [0x2b6ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564760:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c51133 lrc: 3/0,1 mode: PW/PW res: [0x2b6ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564763:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c51133 lrc: 2/0,0 mode: PW/PW res: [0x2b6ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.564778:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.564794:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.564801:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+919:39030:x1731745946438528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1320us (1455us total) trans 12885079478 rc 0/0 00000100:00100000:0.0:1651529344.564804:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211421 00000100:00100000:0.0:1651529344.564809:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946439104 00000100:00100000:0.0:1651529344.564815:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946439232 00000100:00100000:0.0:1651529344.564823:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211425 00000100:00100000:0.0:1651529344.564824:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ea32140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+920:39029:x1731745946439104:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.564830:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177873 count 1 00010000:00010000:0.0:1651529344.564834:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c5114f lrc: 3/0,1 mode: --/PW res: [0x2b6d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564838:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c4ecb9 lrc: 2/0,0 mode: PR/PR res: [0x2b6d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d64c4 expref: 1140 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.564842:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.564842:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.564843:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c5114f lrc: 4/0,1 mode: --/PW res: [0x2b6d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564849:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c4ecb9 lrc: 3/0,0 mode: PR/PR res: [0x2b6d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d64c4 expref: 1140 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.564853:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c4ecb9 lrc: 4/0,0 mode: PR/PR res: [0x2b6d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d64c4 expref: 1140 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.564858:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f39ca9ea pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996997952:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.564866:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060852af0 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.564871:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c51133 lrc: 2/0,0 mode: PW/PW res: [0x2b6ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564875:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b855716b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.564876:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c51133 lrc: 2/0,0 mode: PW/PW res: [0x2b6ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564878:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c51133 lrc: 3/0,0 mode: PW/PW res: [0x2b6ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.564894:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211426 00000100:00100000:1.0:1651529344.564896:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfc79d4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+920:39030:x1731745946439232:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.564900:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c51133 lrc: 1/0,0 mode: --/PW res: [0x2b6ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.564902:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177874 count 1 00010000:00010000:1.0:1651529344.564906:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043037897/0x3234de053c51156 lrc: 3/0,1 mode: --/PW res: [0x2b6d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.564911:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000ba20ac4/0x3234de053c4b1e8 lrc: 2/0,0 mode: PR/PR res: [0x2b6d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc0fa expref: 1140 pid: 80280 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.564914:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.564915:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.564915:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043037897/0x3234de053c51156 lrc: 4/0,1 mode: --/PW res: [0x2b6d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564918:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c51133 lrc: 0/0,0 mode: --/PW res: [0x2b6ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.564922:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000ba20ac4/0x3234de053c4b1e8 lrc: 3/0,0 mode: PR/PR res: [0x2b6d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc0fa expref: 1140 pid: 80280 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.564926:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000ba20ac4/0x3234de053c4b1e8 lrc: 4/0,0 mode: PR/PR res: [0x2b6d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc0fa expref: 1140 pid: 80280 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.564930:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005914c920 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996998016:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.564932:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c51141 lrc: 3/0,1 mode: PW/PW res: [0x2b6cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564937:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c51141 lrc: 3/0,1 mode: PW/PW res: [0x2b6cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.564941:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000babe2d90 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.564942:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c51141 lrc: 3/0,1 mode: PW/PW res: [0x2b6cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.564951:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c51141 lrc: 2/0,0 mode: PW/PW res: [0x2b6cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.565017:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+921:39029:x1731745946438592:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1422us (1485us total) trans 12885079479 rc 0/0 00000100:00100000:0.0:1651529344.565020:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211423 00010000:00010000:0.0:1651529344.565037:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c51141 lrc: 2/0,0 mode: PW/PW res: [0x2b6cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.565041:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027456046 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.565045:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.565056:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.565072:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c51141 lrc: 2/0,0 mode: PW/PW res: [0x2b6cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.565074:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.565085:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c51141 lrc: 3/0,0 mode: PW/PW res: [0x2b6cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.565086:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.565104:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.565110:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c51141 lrc: 1/0,0 mode: --/PW res: [0x2b6cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.565113:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c51141 lrc: 0/0,0 mode: --/PW res: [0x2b6cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.565122:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946439424 00000100:00100000:1.0:1651529344.565124:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.565129:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946439360 00000100:00100000:0.0:1651529344.565132:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946439552 00000100:00100000:0.0:1651529344.565135:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946439488 00000100:00100000:1.0:1651529344.565139:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946439616 00000100:00100000:0.0:1651529344.565144:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211427 00000100:00100000:0.0:1651529344.565146:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+925:39030:x1731745946439424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.565152:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211428 00000100:00100000:1.0:1651529344.565153:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+925:39029:x1731745946439360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.565159:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177875 count 1 00002000:00080000:0.0:1651529344.565167:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177876 count 1 00010000:00010000:1.0:1651529344.565170:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b95fbd27/0x3234de053c5115d lrc: 3/0,1 mode: --/PW res: [0x2b6d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.565171:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c51164 lrc: 3/0,1 mode: --/PW res: [0x2b6d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565175:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000001b5857/0x3234de053c4cc75 lrc: 2/0,0 mode: PR/PR res: [0x2b6d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce3bb expref: 1140 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.565176:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000221ed512/0x3234de053c4dbf6 lrc: 2/0,0 mode: PR/PR res: [0x2b6d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ff8 expref: 1140 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.565178:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.565179:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.565180:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b95fbd27/0x3234de053c5115d lrc: 4/0,1 mode: --/PW res: [0x2b6d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565186:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000001b5857/0x3234de053c4cc75 lrc: 3/0,0 mode: PR/PR res: [0x2b6d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce3bb expref: 1140 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.565189:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.565190:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000001b5857/0x3234de053c4cc75 lrc: 4/0,0 mode: PR/PR res: [0x2b6d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce3bb expref: 1140 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.565190:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.565190:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c51164 lrc: 4/0,1 mode: --/PW res: [0x2b6d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.565194:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006e255cae pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996998080:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.565198:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000221ed512/0x3234de053c4dbf6 lrc: 3/0,0 mode: PR/PR res: [0x2b6d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ff8 expref: 1140 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.565202:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 0000000071742acc going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.565202:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000221ed512/0x3234de053c4dbf6 lrc: 4/0,0 mode: PR/PR res: [0x2b6d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ff8 expref: 1140 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.565206:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000822949b3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996998144:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.565209:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211429 00000100:00100000:1.0:1651529344.565211:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+925:39030:x1731745946439552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.565215:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177878 count 1 00010000:00010000:1.0:1651529344.565218:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006816963f/0x3234de053c5116b lrc: 3/0,1 mode: --/PW res: [0x2b6d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565239:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e4b5c5d1/0x3234de053c4d948 lrc: 2/0,0 mode: PR/PR res: [0x2b6d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d15cc expref: 1140 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.565242:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.565243:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.565243:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006816963f/0x3234de053c5116b lrc: 4/0,1 mode: --/PW res: [0x2b6d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.565243:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 0000000076b354b3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.565250:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e4b5c5d1/0x3234de053c4d948 lrc: 3/0,0 mode: PR/PR res: [0x2b6d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d15cc expref: 1140 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.565252:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211430 00010000:00010000:1.0:1651529344.565254:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e4b5c5d1/0x3234de053c4d948 lrc: 4/0,0 mode: PR/PR res: [0x2b6d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d15cc expref: 1140 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.565254:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+925:39030:x1731745946439488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.565258:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c43262d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996998208:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.565259:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177877 count 1 00010000:00010000:0.0:1651529344.565262:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c51172 lrc: 3/0,1 mode: --/PW res: [0x2b6d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.565265:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b52d0f36 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.565269:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000069d84be3/0x3234de053c4c83f lrc: 2/0,0 mode: PR/PR res: [0x2b6d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd330 expref: 1140 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.565271:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211431 00010000:00010000:0.0:1651529344.565272:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.565273:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+925:39030:x1731745946439616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.565273:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.565274:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c51172 lrc: 4/0,1 mode: --/PW res: [0x2b6d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.565277:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177879 count 1 00010000:00010000:0.0:1651529344.565280:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000069d84be3/0x3234de053c4c83f lrc: 3/0,0 mode: PR/PR res: [0x2b6d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd330 expref: 1140 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.565281:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000557304be/0x3234de053c51179 lrc: 3/0,1 mode: --/PW res: [0x2b6d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.565284:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000069d84be3/0x3234de053c4c83f lrc: 4/0,0 mode: PR/PR res: [0x2b6d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd330 expref: 1140 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.565287:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b31b1dc0/0x3234de053c4ca3e lrc: 2/0,0 mode: PR/PR res: [0x2b6d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdabc expref: 1140 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.565288:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000be0ace91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996998272:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.565290:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.565291:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.565292:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000557304be/0x3234de053c51179 lrc: 4/0,1 mode: --/PW res: [0x2b6d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.565295:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000afe7ff7b going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.565297:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b31b1dc0/0x3234de053c4ca3e lrc: 3/0,0 mode: PR/PR res: [0x2b6d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdabc expref: 1140 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.565301:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b31b1dc0/0x3234de053c4ca3e lrc: 4/0,0 mode: PR/PR res: [0x2b6d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdabc expref: 1140 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.565303:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f39ca9ea pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996997952:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.565305:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d6486d55 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996998336:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.565307:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c5114f lrc: 3/0,1 mode: --/PW res: [0x2b6d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.565311:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000567ee0ef going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.565316:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396320384 00010000:00010000:1.0:1651529344.565321:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c4ecb9 lrc: 4/0,0 mode: PR/PR res: [0x2b6d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d64c4 expref: 1141 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.565323:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.565332:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12207 00000100:00100000:1.0:1651529344.565333:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1141:41278:x1731746396320384:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.565336:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.565337:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c4ecb9 lrc: 4/0,0 mode: PR/PR res: [0x2b6d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d64c4 expref: 1141 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.565344:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c4ecb9 lrc: 3/0,0 mode: PR/PR res: [0x2b6d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d64c4 expref: 1141 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.565355:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c4ecb9 lrc: 0/0,0 mode: --/PR res: [0x2b6d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d64c4 expref: 1141 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.565359:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.565360:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.565360:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c5114f lrc: 3/0,1 mode: PW/PW res: [0x2b6d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565364:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c5114f lrc: 4/0,1 mode: PW/PW res: [0x2b6d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565372:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.565377:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.565391:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1140:41278:x1731746396320384:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 56us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.565393:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12207 00000100:00100000:1.0:1651529344.565398:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396320448 00010000:00010000:0.0:1651529344.565404:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c5114f lrc: 3/0,1 mode: PW/PW res: [0x2b6d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.565408:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c5114f lrc: 3/0,1 mode: PW/PW res: [0x2b6d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.565412:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c5114f lrc: 3/0,1 mode: PW/PW res: [0x2b6d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.565415:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c5114f lrc: 2/0,0 mode: PW/PW res: [0x2b6d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565426:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000ba20ac4/0x3234de053c4b1e8 lrc: 5/0,0 mode: PR/PR res: [0x2b6d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc0fa expref: 1140 pid: 80280 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.565434:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12208 00000100:00100000:1.0:1651529344.565436:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1140:41278:x1731746396320448:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.565439:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.565440:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000ba20ac4/0x3234de053c4b1e8 lrc: 5/0,0 mode: PR/PR res: [0x2b6d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc0fa expref: 1140 pid: 80280 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.565444:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000ba20ac4/0x3234de053c4b1e8 lrc: 4/0,0 mode: PR/PR res: [0x2b6d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc0fa expref: 1140 pid: 80280 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.565449:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.565449:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.565450:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000043037897/0x3234de053c51156 lrc: 3/0,1 mode: PW/PW res: [0x2b6d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565453:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043037897/0x3234de053c51156 lrc: 4/0,1 mode: PW/PW res: [0x2b6d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565458:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.565469:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1140:41278:x1731746396320448:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 33us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.565472:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12208 00000100:00100000:0.0:1651529344.565477:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ea32140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+926:39029:x1731745946439104:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 651us (698us total) trans 12885079480 rc 0/0 00000100:00100000:1.0:1651529344.565480:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946439680 00000100:00100000:0.0:1651529344.565480:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211425 00000100:00100000:1.0:1651529344.565487:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211432 00000100:00100000:1.0:1651529344.565488:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+926:39029:x1731745946439680:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.565493:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177880 count 1 00010000:00010000:0.0:1651529344.565493:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c5114f lrc: 2/0,0 mode: PW/PW res: [0x2b6d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565496:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c7e55f5/0x3234de053c51180 lrc: 3/0,1 mode: --/PW res: [0x2b6d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.565496:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000734ecdfd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.565497:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c5114f lrc: 2/0,0 mode: PW/PW res: [0x2b6d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.565500:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c5114f lrc: 3/0,0 mode: PW/PW res: [0x2b6d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565501:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000013916bea/0x3234de053c4da3d lrc: 2/0,0 mode: PR/PR res: [0x2b6d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d196f expref: 1139 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.565504:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.565505:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.565505:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c7e55f5/0x3234de053c51180 lrc: 4/0,1 mode: --/PW res: [0x2b6d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.565505:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c5114f lrc: 1/0,0 mode: --/PW res: [0x2b6d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.565508:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c5114f lrc: 0/0,0 mode: --/PW res: [0x2b6d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565512:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000013916bea/0x3234de053c4da3d lrc: 3/0,0 mode: PR/PR res: [0x2b6d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d196f expref: 1139 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.565515:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000013916bea/0x3234de053c4da3d lrc: 4/0,0 mode: PR/PR res: [0x2b6d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d196f expref: 1139 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.565519:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000086eaa330 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996998400:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.565527:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 000000007d8fabda going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.565536:0:80278:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ba20ac4/0x3234de053c4b1e8 lrc: 0/0,0 mode: --/PR res: [0x2b6d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc0fa expref: 1139 pid: 80280 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.565548:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005914c920 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996998016:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.565552:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000043037897/0x3234de053c51156 lrc: 3/0,1 mode: PW/PW res: [0x2b6d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565555:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000043037897/0x3234de053c51156 lrc: 3/0,1 mode: PW/PW res: [0x2b6d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565558:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043037897/0x3234de053c51156 lrc: 3/0,1 mode: PW/PW res: [0x2b6d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565561:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043037897/0x3234de053c51156 lrc: 3/0,1 mode: PW/PW res: [0x2b6d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.565566:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043037897/0x3234de053c51156 lrc: 2/0,0 mode: PW/PW res: [0x2b6d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.565612:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043037897/0x3234de053c51156 lrc: 2/0,0 mode: PW/PW res: [0x2b6d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.565616:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000043037897 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.565617:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043037897/0x3234de053c51156 lrc: 2/0,0 mode: PW/PW res: [0x2b6d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.565620:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043037897/0x3234de053c51156 lrc: 3/0,0 mode: PW/PW res: [0x2b6d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.565624:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043037897/0x3234de053c51156 lrc: 1/0,0 mode: --/PW res: [0x2b6d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.565627:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043037897/0x3234de053c51156 lrc: 0/0,0 mode: --/PW res: [0x2b6d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.565635:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfc79d4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+927:39030:x1731745946439232:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 738us (841us total) trans 12885079481 rc 0/0 00000100:00100000:1.0:1651529344.565638:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211426 00000100:00100000:0.0:1651529344.565644:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000822949b3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996998144:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.565647:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c51164 lrc: 3/0,1 mode: --/PW res: [0x2b6d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.565651:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006e255cae pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996998080:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.565655:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b95fbd27/0x3234de053c5115d lrc: 3/0,1 mode: --/PW res: [0x2b6d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.565880:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.565892:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.565892:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.565905:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.565911:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000be0ace91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996998272:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.565912:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.565917:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c51172 lrc: 3/0,1 mode: --/PW res: [0x2b6d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.565919:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.565927:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.565935:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c43262d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996998208:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.565939:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006816963f/0x3234de053c5116b lrc: 3/0,1 mode: --/PW res: [0x2b6d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.565946:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d6486d55 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996998336:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.565948:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000557304be/0x3234de053c51179 lrc: 3/0,1 mode: --/PW res: [0x2b6d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.565950:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396320512 00000100:00100000:1.0:1651529344.565954:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946440192 00010000:00010000:0.0:1651529344.565958:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000001b5857/0x3234de053c4cc75 lrc: 4/0,0 mode: PR/PR res: [0x2b6d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce3bb expref: 1139 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.565965:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946440128 00000100:00100000:1.0:1651529344.565971:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211433 00000100:00100000:1.0:1651529344.565973:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+928:39030:x1731745946440192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.565976:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396320640 00002000:00080000:1.0:1651529344.565978:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177882 count 1 00010000:00010000:0.0:1651529344.565979:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000069d84be3/0x3234de053c4c83f lrc: 4/0,0 mode: PR/PR res: [0x2b6d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd330 expref: 1140 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.565982:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0c2c8e0/0x3234de053c51187 lrc: 3/0,1 mode: --/PW res: [0x2b6da:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.565983:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396320768 00010000:00010000:0.0:1651529344.565985:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b31b1dc0/0x3234de053c4ca3e lrc: 4/0,0 mode: PR/PR res: [0x2b6d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdabc expref: 1141 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.565986:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001c008f60/0x3234de053c4dce4 lrc: 2/0,0 mode: PR/PR res: [0x2b6da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d240b expref: 1141 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.565989:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396320576 00010000:00010000:1.0:1651529344.565990:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.565990:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.565991:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0c2c8e0/0x3234de053c51187 lrc: 4/0,1 mode: --/PW res: [0x2b6da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.565991:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000221ed512/0x3234de053c4dbf6 lrc: 4/0,0 mode: PR/PR res: [0x2b6d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ff8 expref: 1142 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.565995:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396320704 00010000:00010000:0.0:1651529344.565997:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e4b5c5d1/0x3234de053c4d948 lrc: 4/0,0 mode: PR/PR res: [0x2b6d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d15cc expref: 1143 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.565998:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001c008f60/0x3234de053c4dce4 lrc: 3/0,0 mode: PR/PR res: [0x2b6da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d240b expref: 1143 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.566001:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001c008f60/0x3234de053c4dce4 lrc: 4/0,0 mode: PR/PR res: [0x2b6da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d240b expref: 1143 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.566002:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12209 00000100:00100000:0.0:1651529344.566003:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1143:41279:x1731746396320512:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.566005:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d6486d55 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996998464:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.566006:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.566008:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000001b5857/0x3234de053c4cc75 lrc: 4/0,0 mode: PR/PR res: [0x2b6d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce3bb expref: 1143 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.566012:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000001b5857/0x3234de053c4cc75 lrc: 3/0,0 mode: PR/PR res: [0x2b6d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce3bb expref: 1143 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.566016:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 0000000071742acc going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.566018:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000001b5857/0x3234de053c4cc75 lrc: 0/0,0 mode: --/PR res: [0x2b6d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce3bb expref: 1143 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.566021:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12210 00010000:00010000:0.0:1651529344.566022:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.566023:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1142:41279:x1731746396320640:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.566023:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.566024:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b95fbd27/0x3234de053c5115d lrc: 3/0,1 mode: PW/PW res: [0x2b6d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566026:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.566027:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b95fbd27/0x3234de053c5115d lrc: 4/0,1 mode: PW/PW res: [0x2b6d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566028:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000069d84be3/0x3234de053c4c83f lrc: 4/0,0 mode: PR/PR res: [0x2b6d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd330 expref: 1142 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.566032:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000069d84be3/0x3234de053c4c83f lrc: 3/0,0 mode: PR/PR res: [0x2b6d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd330 expref: 1142 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.566037:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.566044:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069d84be3/0x3234de053c4c83f lrc: 0/0,0 mode: --/PR res: [0x2b6d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd330 expref: 1142 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.566045:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1142:41279:x1731746396320512:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (154us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.566048:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.566048:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.566048:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12209 00010000:00010000:1.0:1651529344.566049:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c51172 lrc: 3/0,1 mode: PW/PW res: [0x2b6d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566052:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c51172 lrc: 4/0,1 mode: PW/PW res: [0x2b6d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.566053:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12211 00000100:00100000:0.0:1651529344.566055:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000515bc9a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1140:41279:x1731746396320768:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.566057:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.566059:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b31b1dc0/0x3234de053c4ca3e lrc: 4/0,0 mode: PR/PR res: [0x2b6d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdabc expref: 1140 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.566061:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.566068:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1140:41279:x1731746396320640:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 44us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.566070:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12210 00000100:00100000:1.0:1651529344.566076:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12212 00000100:00100000:1.0:1651529344.566077:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1139:41278:x1731746396320576:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.566080:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.566081:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000221ed512/0x3234de053c4dbf6 lrc: 4/0,0 mode: PR/PR res: [0x2b6d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ff8 expref: 1139 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.566085:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000221ed512/0x3234de053c4dbf6 lrc: 3/0,0 mode: PR/PR res: [0x2b6d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ff8 expref: 1139 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.566090:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000221ed512/0x3234de053c4dbf6 lrc: 0/0,0 mode: --/PR res: [0x2b6d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ff8 expref: 1139 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.566091:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b31b1dc0/0x3234de053c4ca3e lrc: 3/0,0 mode: PR/PR res: [0x2b6d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdabc expref: 1139 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.566097:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b31b1dc0/0x3234de053c4ca3e lrc: 0/0,0 mode: --/PR res: [0x2b6d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdabc expref: 1139 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.566101:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.566102:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.566102:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.566102:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.566103:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c51164 lrc: 3/0,1 mode: PW/PW res: [0x2b6d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566103:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000557304be/0x3234de053c51179 lrc: 3/0,1 mode: PW/PW res: [0x2b6d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566106:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c51164 lrc: 4/0,1 mode: PW/PW res: [0x2b6d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566106:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000557304be/0x3234de053c51179 lrc: 4/0,1 mode: PW/PW res: [0x2b6d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566118:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.566118:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.566124:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1137:41278:x1731746396320576:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 46us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.566126:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000515bc9a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1137:41279:x1731746396320768:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 71us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.566127:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12212 00000100:00100000:0.0:1651529344.566129:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12211 00000100:00100000:1.0:1651529344.566131:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12213 00000100:00100000:1.0:1651529344.566133:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005914c920 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1135:41278:x1731746396320704:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.566135:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.566137:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e4b5c5d1/0x3234de053c4d948 lrc: 4/0,0 mode: PR/PR res: [0x2b6d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d15cc expref: 1135 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.566140:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c51164 lrc: 3/0,1 mode: PW/PW res: [0x2b6d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566141:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e4b5c5d1/0x3234de053c4d948 lrc: 3/0,0 mode: PR/PR res: [0x2b6d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d15cc expref: 1135 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.566144:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c51164 lrc: 3/0,1 mode: PW/PW res: [0x2b6d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566145:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4b5c5d1/0x3234de053c4d948 lrc: 0/0,0 mode: --/PR res: [0x2b6d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d15cc expref: 1135 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.566147:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c51164 lrc: 3/0,1 mode: PW/PW res: [0x2b6d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566150:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c51164 lrc: 2/0,0 mode: PW/PW res: [0x2b6d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566151:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.566152:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.566152:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006816963f/0x3234de053c5116b lrc: 3/0,1 mode: PW/PW res: [0x2b6d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566155:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006816963f/0x3234de053c5116b lrc: 4/0,1 mode: PW/PW res: [0x2b6d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566161:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.566165:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005914c920 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1134:41278:x1731746396320704:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.566168:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12213 00010000:00010000:1.0:1651529344.566175:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b95fbd27/0x3234de053c5115d lrc: 3/0,1 mode: PW/PW res: [0x2b6d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566178:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b95fbd27/0x3234de053c5115d lrc: 3/0,1 mode: PW/PW res: [0x2b6d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566181:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b95fbd27/0x3234de053c5115d lrc: 3/0,1 mode: PW/PW res: [0x2b6d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566184:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b95fbd27/0x3234de053c5115d lrc: 2/0,0 mode: PW/PW res: [0x2b6d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.566190:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+929:39030:x1731745946439424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1043us (1145us total) trans 12885079482 rc 0/0 00000100:00100000:0.0:1651529344.566201:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211427 00000100:00100000:0.0:1651529344.566206:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211434 00000100:00100000:0.0:1651529344.566207:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+929:39030:x1731745946440128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.566214:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177881 count 1 00010000:00010000:0.0:1651529344.566218:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c5118e lrc: 3/0,1 mode: --/PW res: [0x2b6d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566242:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4f30a lrc: 2/0,0 mode: PR/PR res: [0x2b6d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ed3 expref: 1133 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.566244:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+929:39029:x1731745946439360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1089us (1186us total) trans 12885079483 rc 0/0 00010000:00010000:0.0:1651529344.566245:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.566246:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.566247:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211428 00010000:00010000:0.0:1651529344.566247:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c5118e lrc: 4/0,1 mode: --/PW res: [0x2b6d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566254:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000557304be/0x3234de053c51179 lrc: 3/0,1 mode: PW/PW res: [0x2b6d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566254:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4f30a lrc: 3/0,0 mode: PR/PR res: [0x2b6d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ed3 expref: 1133 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.566257:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000557304be/0x3234de053c51179 lrc: 3/0,1 mode: PW/PW res: [0x2b6d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566257:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4f30a lrc: 4/0,0 mode: PR/PR res: [0x2b6d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ed3 expref: 1133 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.566260:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000557304be/0x3234de053c51179 lrc: 3/0,1 mode: PW/PW res: [0x2b6d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.566262:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005fb0ec6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996998528:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.566263:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000557304be/0x3234de053c51179 lrc: 2/0,0 mode: PW/PW res: [0x2b6d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.566277:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a3b00cf3 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.566282:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c51164 lrc: 2/0,0 mode: PW/PW res: [0x2b6d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566285:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cdc65e28 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.566286:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c51164 lrc: 2/0,0 mode: PW/PW res: [0x2b6d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566289:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c51164 lrc: 3/0,0 mode: PW/PW res: [0x2b6d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566293:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c51164 lrc: 1/0,0 mode: --/PW res: [0x2b6d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566296:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c51164 lrc: 0/0,0 mode: --/PW res: [0x2b6d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.566300:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+929:39030:x1731745946439616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1026us (1195us total) trans 12885079484 rc 0/0 00010000:00010000:0.0:1651529344.566301:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b95fbd27/0x3234de053c5115d lrc: 2/0,0 mode: PW/PW res: [0x2b6d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.566303:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211431 00010000:00010000:0.0:1651529344.566303:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b95fbd27 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.566304:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b95fbd27/0x3234de053c5115d lrc: 2/0,0 mode: PW/PW res: [0x2b6d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566307:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b95fbd27/0x3234de053c5115d lrc: 3/0,0 mode: PW/PW res: [0x2b6d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566310:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006816963f/0x3234de053c5116b lrc: 3/0,1 mode: PW/PW res: [0x2b6d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566310:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b95fbd27/0x3234de053c5115d lrc: 1/0,0 mode: --/PW res: [0x2b6d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566312:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b95fbd27/0x3234de053c5115d lrc: 0/0,0 mode: --/PW res: [0x2b6d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566314:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006816963f/0x3234de053c5116b lrc: 3/0,1 mode: PW/PW res: [0x2b6d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566316:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000557304be/0x3234de053c51179 lrc: 2/0,0 mode: PW/PW res: [0x2b6d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566317:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006816963f/0x3234de053c5116b lrc: 3/0,1 mode: PW/PW res: [0x2b6d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566318:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000557304be already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.566319:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006816963f/0x3234de053c5116b lrc: 2/0,0 mode: PW/PW res: [0x2b6d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566319:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000557304be/0x3234de053c51179 lrc: 2/0,0 mode: PW/PW res: [0x2b6d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566322:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000557304be/0x3234de053c51179 lrc: 3/0,0 mode: PW/PW res: [0x2b6d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566325:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000557304be/0x3234de053c51179 lrc: 1/0,0 mode: --/PW res: [0x2b6d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566328:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000557304be/0x3234de053c51179 lrc: 0/0,0 mode: --/PW res: [0x2b6d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566331:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006816963f/0x3234de053c5116b lrc: 2/0,0 mode: PW/PW res: [0x2b6d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566334:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006816963f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.566334:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006816963f/0x3234de053c5116b lrc: 2/0,0 mode: PW/PW res: [0x2b6d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566337:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006816963f/0x3234de053c5116b lrc: 3/0,0 mode: PW/PW res: [0x2b6d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566340:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006816963f/0x3234de053c5116b lrc: 1/0,0 mode: --/PW res: [0x2b6d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566343:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006816963f/0x3234de053c5116b lrc: 0/0,0 mode: --/PW res: [0x2b6d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.566348:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+929:39030:x1731745946439552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1136us (1274us total) trans 12885079485 rc 0/0 00010000:00010000:0.0:1651529344.566349:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c51172 lrc: 3/0,1 mode: PW/PW res: [0x2b6d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.566351:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211429 00010000:00010000:0.0:1651529344.566354:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c51172 lrc: 3/0,1 mode: PW/PW res: [0x2b6d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566357:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c51172 lrc: 3/0,1 mode: PW/PW res: [0x2b6d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566360:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c51172 lrc: 2/0,0 mode: PW/PW res: [0x2b6d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.566379:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.566398:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+929:39030:x1731745946439488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1143us (1311us total) trans 12885079486 rc 0/0 00000100:00100000:0.0:1651529344.566401:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211430 00010000:00010000:0.0:1651529344.566408:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c51172 lrc: 2/0,0 mode: PW/PW res: [0x2b6d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566411:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005d8a4887 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.566412:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c51172 lrc: 2/0,0 mode: PW/PW res: [0x2b6d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566414:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c51172 lrc: 3/0,0 mode: PW/PW res: [0x2b6d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566419:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c51172 lrc: 1/0,0 mode: --/PW res: [0x2b6d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566421:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c51172 lrc: 0/0,0 mode: --/PW res: [0x2b6d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.566446:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000086eaa330 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996998400:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.566466:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007c7e55f5/0x3234de053c51180 lrc: 3/0,1 mode: --/PW res: [0x2b6d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.566479:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396320832 00010000:00010000:1.0:1651529344.566484:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000013916bea/0x3234de053c4da3d lrc: 4/0,0 mode: PR/PR res: [0x2b6d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d196f expref: 1134 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.566492:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12214 00000100:00100000:1.0:1651529344.566493:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1134:41279:x1731746396320832:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.566496:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.566497:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000013916bea/0x3234de053c4da3d lrc: 4/0,0 mode: PR/PR res: [0x2b6d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d196f expref: 1134 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.566501:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000013916bea/0x3234de053c4da3d lrc: 3/0,0 mode: PR/PR res: [0x2b6d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d196f expref: 1134 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.566507:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013916bea/0x3234de053c4da3d lrc: 0/0,0 mode: --/PR res: [0x2b6d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d196f expref: 1134 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.566510:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.566510:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.566511:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007c7e55f5/0x3234de053c51180 lrc: 3/0,1 mode: PW/PW res: [0x2b6d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566517:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c7e55f5/0x3234de053c51180 lrc: 4/0,1 mode: PW/PW res: [0x2b6d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566522:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.566531:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1133:41279:x1731746396320832:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 37us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.566533:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12214 00010000:00010000:1.0:1651529344.566539:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007c7e55f5/0x3234de053c51180 lrc: 3/0,1 mode: PW/PW res: [0x2b6d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566542:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c7e55f5/0x3234de053c51180 lrc: 3/0,1 mode: PW/PW res: [0x2b6d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566545:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c7e55f5/0x3234de053c51180 lrc: 3/0,1 mode: PW/PW res: [0x2b6d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566548:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c7e55f5/0x3234de053c51180 lrc: 2/0,0 mode: PW/PW res: [0x2b6d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566569:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c7e55f5/0x3234de053c51180 lrc: 2/0,0 mode: PW/PW res: [0x2b6d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566573:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007c7e55f5 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.566574:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c7e55f5/0x3234de053c51180 lrc: 2/0,0 mode: PW/PW res: [0x2b6d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566577:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c7e55f5/0x3234de053c51180 lrc: 3/0,0 mode: PW/PW res: [0x2b6d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566582:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c7e55f5/0x3234de053c51180 lrc: 1/0,0 mode: --/PW res: [0x2b6d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566585:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c7e55f5/0x3234de053c51180 lrc: 0/0,0 mode: --/PW res: [0x2b6d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.566593:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+929:39029:x1731745946439680:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1104us (1270us total) trans 12885079487 rc 0/0 00000100:00100000:1.0:1651529344.566596:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211432 00000100:00100000:0.0:1651529344.566653:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.566673:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946440448 00000100:00100000:1.0:1651529344.566682:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211435 00000100:00100000:1.0:1651529344.566684:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+929:39030:x1731745946440448:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.566692:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529344.566696:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177884 count 1 00010000:00010000:1.0:1651529344.566700:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd9fc154/0x3234de053c51195 lrc: 3/0,1 mode: --/PW res: [0x2b6dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566705:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c4c70b lrc: 2/0,0 mode: PR/PR res: [0x2b6dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce1a expref: 1132 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.566708:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.566709:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.566710:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd9fc154/0x3234de053c51195 lrc: 4/0,1 mode: --/PW res: [0x2b6dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.566718:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.566723:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c4c70b lrc: 3/0,0 mode: PR/PR res: [0x2b6dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce1a expref: 1132 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.566726:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c4c70b lrc: 4/0,0 mode: PR/PR res: [0x2b6dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce1a expref: 1132 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.566730:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000086eaa330 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996998592:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.566761:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 000000007d8fabda going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.566763:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.566774:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d6486d55 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996998464:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.566778:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e0c2c8e0/0x3234de053c51187 lrc: 3/0,1 mode: --/PW res: [0x2b6da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.566792:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.566794:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946440384 00000100:00100000:0.0:1651529344.566802:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.566809:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946440512 00000100:00100000:0.0:1651529344.566811:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.566813:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946440576 00000100:00100000:1.0:1651529344.566825:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946440640 00000100:00100000:1.0:1651529344.566831:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211436 00000100:00100000:1.0:1651529344.566833:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+933:39030:x1731745946440384:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.566838:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177883 count 1 00010000:00010000:1.0:1651529344.566842:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041b8eb55/0x3234de053c5119c lrc: 3/0,1 mode: --/PW res: [0x2b6db:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.566842:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.566846:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dbf6c6aa/0x3234de053c4cb17 lrc: 2/0,0 mode: PR/PR res: [0x2b6db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cddcc expref: 1132 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.566849:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.566849:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946440896 00010000:00010000:1.0:1651529344.566850:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.566850:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041b8eb55/0x3234de053c5119c lrc: 4/0,1 mode: --/PW res: [0x2b6db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566856:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dbf6c6aa/0x3234de053c4cb17 lrc: 3/0,0 mode: PR/PR res: [0x2b6db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cddcc expref: 1132 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.566856:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211437 00000100:00100000:0.0:1651529344.566858:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+934:39029:x1731745946440512:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.566860:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dbf6c6aa/0x3234de053c4cb17 lrc: 4/0,0 mode: PR/PR res: [0x2b6db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cddcc expref: 1132 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:0.0:1651529344.566863:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177885 count 1 00000100:00100000:1.0:1651529344.566864:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d6486d55 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996998656:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.566868:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c511a3 lrc: 3/0,1 mode: --/PW res: [0x2b6dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566872:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009c8ad646/0x3234de053c4c07b lrc: 2/0,0 mode: PR/PR res: [0x2b6dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc79f expref: 1132 pid: 72395 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.566876:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a6b79b05 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.566883:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211438 00010000:00010000:0.0:1651529344.566883:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.566884:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.566884:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c511a3 lrc: 4/0,1 mode: --/PW res: [0x2b6dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.566885:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+934:39030:x1731745946440576:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.566890:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177886 count 1 00010000:00010000:0.0:1651529344.566892:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009c8ad646/0x3234de053c4c07b lrc: 3/0,0 mode: PR/PR res: [0x2b6dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc79f expref: 1132 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.566893:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006156151/0x3234de053c511aa lrc: 3/0,1 mode: --/PW res: [0x2b6de:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.566896:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009c8ad646/0x3234de053c4c07b lrc: 4/0,0 mode: PR/PR res: [0x2b6dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc79f expref: 1132 pid: 72395 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.566897:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000083677712/0x3234de053c4d6cb lrc: 2/0,0 mode: PR/PR res: [0x2b6de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ccd expref: 1132 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.566900:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.566900:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000050bbb886 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996998720:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.566901:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.566901:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006156151/0x3234de053c511aa lrc: 4/0,1 mode: --/PW res: [0x2b6de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566907:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000083677712/0x3234de053c4d6cb lrc: 3/0,0 mode: PR/PR res: [0x2b6de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ccd expref: 1132 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.566909:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e7e12492 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.566911:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000083677712/0x3234de053c4d6cb lrc: 4/0,0 mode: PR/PR res: [0x2b6de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ccd expref: 1132 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.566915:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003e8ef62e pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996998784:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.566915:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211439 00000100:00100000:0.0:1651529344.566917:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+934:39030:x1731745946440640:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.566922:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aeda71fe going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.566922:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177887 count 1 00010000:00010000:0.0:1651529344.566925:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c511b1 lrc: 3/0,1 mode: --/PW res: [0x2b6df:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.566928:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211440 00000100:00100000:1.0:1651529344.566929:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+934:39030:x1731745946440896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.566930:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000091b8a26b/0x3234de053c4c44f lrc: 2/0,0 mode: PR/PR res: [0x2b6df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc95f expref: 1132 pid: 80277 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.566933:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177888 count 1 00010000:00010000:0.0:1651529344.566933:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.566933:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.566934:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c511b1 lrc: 4/0,1 mode: --/PW res: [0x2b6df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566936:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a35aa4a/0x3234de053c511b8 lrc: 3/0,1 mode: --/PW res: [0x2b6e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566940:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000896a135f/0x3234de053c4d79d lrc: 2/0,0 mode: PR/PR res: [0x2b6e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d100e expref: 1132 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.566940:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000091b8a26b/0x3234de053c4c44f lrc: 3/0,0 mode: PR/PR res: [0x2b6df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc95f expref: 1132 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.566943:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.566943:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000091b8a26b/0x3234de053c4c44f lrc: 4/0,0 mode: PR/PR res: [0x2b6df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc95f expref: 1132 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.566944:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.566944:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a35aa4a/0x3234de053c511b8 lrc: 4/0,1 mode: --/PW res: [0x2b6e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.566953:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000896a135f/0x3234de053c4d79d lrc: 3/0,0 mode: PR/PR res: [0x2b6e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d100e expref: 1132 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.566957:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000896a135f/0x3234de053c4d79d lrc: 4/0,0 mode: PR/PR res: [0x2b6e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d100e expref: 1132 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.566960:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009acffcb8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996998912:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.566963:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029d739c8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996998848:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.566966:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8a0b704 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.566971:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396321344 00000100:00100000:0.0:1651529344.566972:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000afe7ff7b going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.566975:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001c008f60/0x3234de053c4dce4 lrc: 4/0,0 mode: PR/PR res: [0x2b6da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d240b expref: 1133 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.566980:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005fb0ec6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996998528:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.566982:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396321408 00010000:00010000:1.0:1651529344.566984:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4f30a lrc: 4/0,0 mode: PR/PR res: [0x2b6d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ed3 expref: 1134 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.566984:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c5118e lrc: 3/0,1 mode: --/PW res: [0x2b6d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.566993:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12215 00000100:00100000:1.0:1651529344.566995:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007fca8239 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1134:41279:x1731746396321344:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.566998:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.566999:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001c008f60/0x3234de053c4dce4 lrc: 4/0,0 mode: PR/PR res: [0x2b6da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d240b expref: 1134 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.567001:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12216 00010000:00010000:1.0:1651529344.567003:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001c008f60/0x3234de053c4dce4 lrc: 3/0,0 mode: PR/PR res: [0x2b6da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d240b expref: 1134 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.567004:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1134:41278:x1731746396321408:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.567007:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.567009:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4f30a lrc: 4/0,0 mode: PR/PR res: [0x2b6d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ed3 expref: 1134 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.567011:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c008f60/0x3234de053c4dce4 lrc: 0/0,0 mode: --/PR res: [0x2b6da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d240b expref: 1134 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.567012:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4f30a lrc: 3/0,0 mode: PR/PR res: [0x2b6d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ed3 expref: 1134 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.567015:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.567015:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.567016:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e0c2c8e0/0x3234de053c51187 lrc: 3/0,1 mode: PW/PW res: [0x2b6da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.567018:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016ff53ef/0x3234de053c4f30a lrc: 0/0,0 mode: --/PR res: [0x2b6d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ed3 expref: 1133 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.567019:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0c2c8e0/0x3234de053c51187 lrc: 4/0,1 mode: PW/PW res: [0x2b6da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.567022:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.567023:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.567024:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c5118e lrc: 3/0,1 mode: PW/PW res: [0x2b6d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.567025:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.567026:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c5118e lrc: 4/0,1 mode: PW/PW res: [0x2b6d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.567032:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007fca8239 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1132:41279:x1731746396321344:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 36us (230us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.567033:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.567034:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12215 00000100:00100000:0.0:1651529344.567039:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1131:41278:x1731746396321408:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 35us (227us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.567042:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e0c2c8e0/0x3234de053c51187 lrc: 3/0,1 mode: PW/PW res: [0x2b6da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.567042:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12216 00010000:00010000:1.0:1651529344.567046:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0c2c8e0/0x3234de053c51187 lrc: 3/0,1 mode: PW/PW res: [0x2b6da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.567049:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0c2c8e0/0x3234de053c51187 lrc: 3/0,1 mode: PW/PW res: [0x2b6da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.567049:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c5118e lrc: 3/0,1 mode: PW/PW res: [0x2b6d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.567051:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0c2c8e0/0x3234de053c51187 lrc: 2/0,0 mode: PW/PW res: [0x2b6da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.567052:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c5118e lrc: 3/0,1 mode: PW/PW res: [0x2b6d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.567055:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c5118e lrc: 3/0,1 mode: PW/PW res: [0x2b6d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.567058:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c5118e lrc: 2/0,0 mode: PW/PW res: [0x2b6d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.567096:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+936:39030:x1731745946440192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1122us (1216us total) trans 12885079488 rc 0/0 00000100:00100000:1.0:1651529344.567099:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211433 00000100:00100000:0.0:1651529344.567106:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+935:39030:x1731745946440128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 898us (1214us total) trans 12885079489 rc 0/0 00000100:00100000:0.0:1651529344.567110:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211434 00010000:00010000:0.0:1651529344.567117:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0c2c8e0/0x3234de053c51187 lrc: 2/0,0 mode: PW/PW res: [0x2b6da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.567121:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e0c2c8e0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.567122:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0c2c8e0/0x3234de053c51187 lrc: 2/0,0 mode: PW/PW res: [0x2b6da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.567125:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0c2c8e0/0x3234de053c51187 lrc: 3/0,0 mode: PW/PW res: [0x2b6da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.567126:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.567129:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0c2c8e0/0x3234de053c51187 lrc: 1/0,0 mode: --/PW res: [0x2b6da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.567139:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0c2c8e0/0x3234de053c51187 lrc: 0/0,0 mode: --/PW res: [0x2b6da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.567144:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c5118e lrc: 2/0,0 mode: PW/PW res: [0x2b6d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.567146:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e0e037e6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.567147:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c5118e lrc: 2/0,0 mode: PW/PW res: [0x2b6d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.567153:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c5118e lrc: 3/0,0 mode: PW/PW res: [0x2b6d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.567156:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c5118e lrc: 1/0,0 mode: --/PW res: [0x2b6d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.567159:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c5118e lrc: 0/0,0 mode: --/PW res: [0x2b6d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.567166:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396321536 00010000:00010000:0.0:1651529344.567170:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c4c70b lrc: 5/0,0 mode: PR/PR res: [0x2b6dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce1a expref: 1131 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.567180:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12217 00000100:00100000:0.0:1651529344.567182:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1131:41279:x1731746396321536:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.567185:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.567186:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c4c70b lrc: 5/0,0 mode: PR/PR res: [0x2b6dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce1a expref: 1131 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.567189:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c4c70b lrc: 4/0,0 mode: PR/PR res: [0x2b6dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce1a expref: 1131 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.567194:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.567195:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.567196:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd9fc154/0x3234de053c51195 lrc: 3/0,1 mode: PW/PW res: [0x2b6dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.567201:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd9fc154/0x3234de053c51195 lrc: 4/0,1 mode: PW/PW res: [0x2b6dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.567206:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.567217:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1131:41279:x1731746396321536:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 35us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.567219:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12217 00010000:00010000:1.0:1651529344.567244:0:72396:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c4c70b lrc: 0/0,0 mode: --/PR res: [0x2b6dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce1a expref: 1130 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.567249:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000086eaa330 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996998592:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.567252:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dd9fc154/0x3234de053c51195 lrc: 3/0,1 mode: PW/PW res: [0x2b6dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.567256:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dd9fc154/0x3234de053c51195 lrc: 3/0,1 mode: PW/PW res: [0x2b6dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.567258:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd9fc154/0x3234de053c51195 lrc: 3/0,1 mode: PW/PW res: [0x2b6dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.567261:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd9fc154/0x3234de053c51195 lrc: 3/0,1 mode: PW/PW res: [0x2b6dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.567271:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd9fc154/0x3234de053c51195 lrc: 2/0,0 mode: PW/PW res: [0x2b6dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.567295:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.567303:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.567315:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd9fc154/0x3234de053c51195 lrc: 2/0,0 mode: PW/PW res: [0x2b6dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.567322:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+935:39030:x1731745946440448:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 637us (669us total) trans 12885079490 rc 0/0 00010000:00010000:0.0:1651529344.567324:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dd9fc154 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.567325:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd9fc154/0x3234de053c51195 lrc: 2/0,0 mode: PW/PW res: [0x2b6dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.567327:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211435 00010000:00010000:0.0:1651529344.567329:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd9fc154/0x3234de053c51195 lrc: 3/0,0 mode: PW/PW res: [0x2b6dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.567333:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946441216 00010000:00010000:0.0:1651529344.567333:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd9fc154/0x3234de053c51195 lrc: 1/0,0 mode: --/PW res: [0x2b6dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.567336:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd9fc154/0x3234de053c51195 lrc: 0/0,0 mode: --/PW res: [0x2b6dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.567338:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946441280 00000100:00100000:1.0:1651529344.567344:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211441 00000100:00100000:1.0:1651529344.567346:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+936:39030:x1731745946441216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.567350:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211442 00002000:00080000:1.0:1651529344.567351:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177889 count 1 00000100:00100000:0.0:1651529344.567353:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+936:39029:x1731745946441280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.567355:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d688ac01/0x3234de053c511bf lrc: 3/0,1 mode: --/PW res: [0x2b6e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.567358:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177890 count 1 00010000:00010000:1.0:1651529344.567360:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000009fd6afb/0x3234de053c4d5d6 lrc: 2/0,0 mode: PR/PR res: [0x2b6e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d08c1 expref: 1129 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.567362:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c511c6 lrc: 3/0,1 mode: --/PW res: [0x2b6e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.567363:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.567364:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.567364:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d688ac01/0x3234de053c511bf lrc: 4/0,1 mode: --/PW res: [0x2b6e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.567366:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000024e518f1/0x3234de053c4d4cc lrc: 2/0,0 mode: PR/PR res: [0x2b6e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d053a expref: 1129 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.567369:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.567370:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.567371:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000009fd6afb/0x3234de053c4d5d6 lrc: 3/0,0 mode: PR/PR res: [0x2b6e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d08c1 expref: 1129 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.567371:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c511c6 lrc: 4/0,1 mode: --/PW res: [0x2b6e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.567374:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009fd6afb/0x3234de053c4d5d6 lrc: 4/0,0 mode: PR/PR res: [0x2b6e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d08c1 expref: 1129 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.567378:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b4acf60d pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996998976:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.567378:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000024e518f1/0x3234de053c4d4cc lrc: 3/0,0 mode: PR/PR res: [0x2b6e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d053a expref: 1129 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.567381:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000024e518f1/0x3234de053c4d4cc lrc: 4/0,0 mode: PR/PR res: [0x2b6e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d053a expref: 1129 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.567385:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000007fba516 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996999040:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.567386:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000567ee0ef going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.567394:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a3b00cf3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.567467:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.567475:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d6486d55 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996998656:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.567479:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000041b8eb55/0x3234de053c5119c lrc: 3/0,1 mode: --/PW res: [0x2b6db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.567486:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396321728 00010000:00010000:1.0:1651529344.567491:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dbf6c6aa/0x3234de053c4cb17 lrc: 4/0,0 mode: PR/PR res: [0x2b6db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cddcc expref: 1130 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.567502:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12218 00000100:00100000:1.0:1651529344.567504:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e392dfeb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1130:41278:x1731746396321728:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.567507:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.567509:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dbf6c6aa/0x3234de053c4cb17 lrc: 4/0,0 mode: PR/PR res: [0x2b6db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cddcc expref: 1130 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.567512:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dbf6c6aa/0x3234de053c4cb17 lrc: 3/0,0 mode: PR/PR res: [0x2b6db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cddcc expref: 1130 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.567518:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dbf6c6aa/0x3234de053c4cb17 lrc: 0/0,0 mode: --/PR res: [0x2b6db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cddcc expref: 1130 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.567521:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.567522:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.567523:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000041b8eb55/0x3234de053c5119c lrc: 3/0,1 mode: PW/PW res: [0x2b6db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.567533:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041b8eb55/0x3234de053c5119c lrc: 4/0,1 mode: PW/PW res: [0x2b6db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.567547:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.567554:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e392dfeb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1129:41278:x1731746396321728:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 49us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.567556:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.567557:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12218 00010000:00010000:1.0:1651529344.567567:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000041b8eb55/0x3234de053c5119c lrc: 3/0,1 mode: PW/PW res: [0x2b6db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.567571:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041b8eb55/0x3234de053c5119c lrc: 3/0,1 mode: PW/PW res: [0x2b6db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.567574:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041b8eb55/0x3234de053c5119c lrc: 3/0,1 mode: PW/PW res: [0x2b6db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.567582:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000050bbb886 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996998720:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.567584:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041b8eb55/0x3234de053c5119c lrc: 2/0,0 mode: PW/PW res: [0x2b6db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.567608:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c511a3 lrc: 3/0,1 mode: --/PW res: [0x2b6dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.567625:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+937:39030:x1731745946440384:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 792us (934us total) trans 12885079491 rc 0/0 00010000:00010000:0.0:1651529344.567626:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041b8eb55/0x3234de053c5119c lrc: 2/0,0 mode: PW/PW res: [0x2b6db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.567629:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211436 00010000:00010000:0.0:1651529344.567629:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000041b8eb55 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.567630:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041b8eb55/0x3234de053c5119c lrc: 2/0,0 mode: PW/PW res: [0x2b6db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.567633:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946441344 00010000:00010000:0.0:1651529344.567633:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041b8eb55/0x3234de053c5119c lrc: 3/0,0 mode: PW/PW res: [0x2b6db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.567638:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041b8eb55/0x3234de053c5119c lrc: 1/0,0 mode: --/PW res: [0x2b6db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.567640:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211443 00000100:00100000:1.0:1651529344.567641:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+937:39029:x1731745946441344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.567641:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041b8eb55/0x3234de053c5119c lrc: 0/0,0 mode: --/PW res: [0x2b6db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.567646:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177891 count 1 00010000:00010000:1.0:1651529344.567650:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005de6f336/0x3234de053c511cd lrc: 3/0,1 mode: --/PW res: [0x2b6e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.567657:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e1ef46c4/0x3234de053c4efb4 lrc: 2/0,0 mode: PR/PR res: [0x2b6e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d713c expref: 1128 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.567660:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.567661:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.567661:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005de6f336/0x3234de053c511cd lrc: 4/0,1 mode: --/PW res: [0x2b6e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.567699:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e1ef46c4/0x3234de053c4efb4 lrc: 3/0,0 mode: PR/PR res: [0x2b6e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d713c expref: 1128 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.567700:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029d739c8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996998848:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.567702:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e1ef46c4/0x3234de053c4efb4 lrc: 4/0,0 mode: PR/PR res: [0x2b6e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d713c expref: 1128 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.567705:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c511b1 lrc: 3/0,1 mode: --/PW res: [0x2b6df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.567706:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae466fbb pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996999104:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.567720:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a6b79b05 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.567729:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003e8ef62e pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996998784:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.567733:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000006156151/0x3234de053c511aa lrc: 3/0,1 mode: --/PW res: [0x2b6de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.567757:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009acffcb8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996998912:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.567761:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004a35aa4a/0x3234de053c511b8 lrc: 3/0,1 mode: --/PW res: [0x2b6e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.567824:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.567844:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946441472 00000100:00100000:1.0:1651529344.567855:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211444 00000100:00100000:1.0:1651529344.567857:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+938:39029:x1731745946441472:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.567862:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177892 count 1 00010000:00010000:1.0:1651529344.567866:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008fba62e/0x3234de053c511d4 lrc: 3/0,1 mode: --/PW res: [0x2b6e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.567871:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee557312/0x3234de053c4cc52 lrc: 2/0,0 mode: PR/PR res: [0x2b6e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce2e9 expref: 1128 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.567874:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.567875:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.567875:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008fba62e/0x3234de053c511d4 lrc: 4/0,1 mode: --/PW res: [0x2b6e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.567881:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ee557312/0x3234de053c4cc52 lrc: 3/0,0 mode: PR/PR res: [0x2b6e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce2e9 expref: 1128 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.567885:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ee557312/0x3234de053c4cc52 lrc: 4/0,0 mode: PR/PR res: [0x2b6e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce2e9 expref: 1128 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.567889:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e5997468 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996999168:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.567900:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aeda71fe going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.567947:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.567956:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.567957:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396321856 00010000:00010000:1.0:1651529344.567963:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009c8ad646/0x3234de053c4c07b lrc: 4/0,0 mode: PR/PR res: [0x2b6dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc79f expref: 1129 pid: 72395 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.567970:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396321984 00010000:00010000:1.0:1651529344.567973:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000083677712/0x3234de053c4d6cb lrc: 4/0,0 mode: PR/PR res: [0x2b6de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ccd expref: 1130 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.567976:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.567978:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396322112 00010000:00010000:1.0:1651529344.567980:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000091b8a26b/0x3234de053c4c44f lrc: 4/0,0 mode: PR/PR res: [0x2b6df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc95f expref: 1131 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.567989:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.567991:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396322048 00010000:00010000:1.0:1651529344.567994:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000896a135f/0x3234de053c4d79d lrc: 4/0,0 mode: PR/PR res: [0x2b6e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d100e expref: 1132 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.567999:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12219 00000100:00100000:1.0:1651529344.568000:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1132:41278:x1731746396321856:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.568003:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.568004:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009c8ad646/0x3234de053c4c07b lrc: 4/0,0 mode: PR/PR res: [0x2b6dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc79f expref: 1132 pid: 72395 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.568005:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.568012:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396322304 00010000:00010000:1.0:1651529344.568015:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009c8ad646/0x3234de053c4c07b lrc: 3/0,0 mode: PR/PR res: [0x2b6dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc79f expref: 1133 pid: 72395 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.568018:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000009fd6afb/0x3234de053c4d5d6 lrc: 5/0,0 mode: PR/PR res: [0x2b6e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d08c1 expref: 1133 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.568021:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c8ad646/0x3234de053c4c07b lrc: 0/0,0 mode: --/PR res: [0x2b6dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc79f expref: 1133 pid: 72395 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.568025:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.568025:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.568026:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c511a3 lrc: 3/0,1 mode: PW/PW res: [0x2b6dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.568027:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12220 00010000:00010000:1.0:1651529344.568029:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c511a3 lrc: 4/0,1 mode: PW/PW res: [0x2b6dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.568029:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1132:41278:x1731746396321984:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.568032:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.568033:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000083677712/0x3234de053c4d6cb lrc: 4/0,0 mode: PR/PR res: [0x2b6de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ccd expref: 1132 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.568039:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.568043:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000083677712/0x3234de053c4d6cb lrc: 3/0,0 mode: PR/PR res: [0x2b6de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ccd expref: 1132 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.568049:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1132:41278:x1731746396321856:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 48us (103us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.568049:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083677712/0x3234de053c4d6cb lrc: 0/0,0 mode: --/PR res: [0x2b6de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ccd expref: 1132 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.568052:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12219 00010000:00010000:0.0:1651529344.568053:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.568054:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.568055:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000006156151/0x3234de053c511aa lrc: 3/0,1 mode: PW/PW res: [0x2b6de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.568057:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12221 00000100:00100000:1.0:1651529344.568058:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1130:41278:x1731746396322112:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.568058:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006156151/0x3234de053c511aa lrc: 4/0,1 mode: PW/PW res: [0x2b6de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568061:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.568063:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000091b8a26b/0x3234de053c4c44f lrc: 4/0,0 mode: PR/PR res: [0x2b6df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc95f expref: 1130 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.568068:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.568072:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000091b8a26b/0x3234de053c4c44f lrc: 3/0,0 mode: PR/PR res: [0x2b6df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc95f expref: 1130 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.568075:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1130:41278:x1731746396321984:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 46us (119us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.568077:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091b8a26b/0x3234de053c4c44f lrc: 0/0,0 mode: --/PR res: [0x2b6df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc95f expref: 1130 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.568078:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12220 00010000:00010000:1.0:1651529344.568081:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.568082:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.568082:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c511b1 lrc: 3/0,1 mode: PW/PW res: [0x2b6df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.568083:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12222 00010000:00010000:1.0:1651529344.568085:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c511b1 lrc: 4/0,1 mode: PW/PW res: [0x2b6df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.568085:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1128:41278:x1731746396322048:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.568087:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.568089:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000896a135f/0x3234de053c4d79d lrc: 4/0,0 mode: PR/PR res: [0x2b6e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d100e expref: 1128 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.568094:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.568099:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000896a135f/0x3234de053c4d79d lrc: 3/0,0 mode: PR/PR res: [0x2b6e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d100e expref: 1128 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.568100:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1128:41278:x1731746396322112:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.568103:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12221 00010000:00010000:0.0:1651529344.568104:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000896a135f/0x3234de053c4d79d lrc: 0/0,0 mode: --/PR res: [0x2b6e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d100e expref: 1128 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.568107:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12223 00010000:00010000:0.0:1651529344.568108:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.568108:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.568109:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1126:41278:x1731746396322304:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.568109:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004a35aa4a/0x3234de053c511b8 lrc: 3/0,1 mode: PW/PW res: [0x2b6e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568111:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.568112:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a35aa4a/0x3234de053c511b8 lrc: 4/0,1 mode: PW/PW res: [0x2b6e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568113:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000009fd6afb/0x3234de053c4d5d6 lrc: 5/0,0 mode: PR/PR res: [0x2b6e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d08c1 expref: 1126 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.568116:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000009fd6afb/0x3234de053c4d5d6 lrc: 4/0,0 mode: PR/PR res: [0x2b6e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d08c1 expref: 1126 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.568120:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.568126:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1126:41278:x1731746396322048:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (137us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.568127:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.568127:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.568128:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d688ac01/0x3234de053c511bf lrc: 3/0,1 mode: PW/PW res: [0x2b6e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.568129:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12222 00010000:00010000:1.0:1651529344.568131:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d688ac01/0x3234de053c511bf lrc: 4/0,1 mode: PW/PW res: [0x2b6e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568135:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.568135:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c511a3 lrc: 3/0,1 mode: PW/PW res: [0x2b6dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568139:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c511a3 lrc: 3/0,1 mode: PW/PW res: [0x2b6dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.568141:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1125:41278:x1731746396322304:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 31us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.568143:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12223 00010000:00010000:0.0:1651529344.568144:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c511a3 lrc: 3/0,1 mode: PW/PW res: [0x2b6dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568147:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c511a3 lrc: 2/0,0 mode: PW/PW res: [0x2b6dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568151:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000006156151/0x3234de053c511aa lrc: 3/0,1 mode: PW/PW res: [0x2b6de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568154:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006156151/0x3234de053c511aa lrc: 3/0,1 mode: PW/PW res: [0x2b6de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568158:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006156151/0x3234de053c511aa lrc: 3/0,1 mode: PW/PW res: [0x2b6de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568160:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006156151/0x3234de053c511aa lrc: 2/0,0 mode: PW/PW res: [0x2b6de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.568195:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+940:39029:x1731745946440512:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1337us (1477us total) trans 12885079492 rc 0/0 00000100:00100000:1.0:1651529344.568204:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+940:39030:x1731745946440576:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1318us (1442us total) trans 12885079493 rc 0/0 00000100:00100000:1.0:1651529344.568207:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211438 00010000:00010000:1.0:1651529344.568214:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004a35aa4a/0x3234de053c511b8 lrc: 3/0,1 mode: PW/PW res: [0x2b6e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568217:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a35aa4a/0x3234de053c511b8 lrc: 3/0,1 mode: PW/PW res: [0x2b6e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568220:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a35aa4a/0x3234de053c511b8 lrc: 3/0,1 mode: PW/PW res: [0x2b6e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568239:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a35aa4a/0x3234de053c511b8 lrc: 2/0,0 mode: PW/PW res: [0x2b6e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.568240:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211437 00010000:00010000:0.0:1651529344.568253:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c511b1 lrc: 3/0,1 mode: PW/PW res: [0x2b6df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568257:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c511b1 lrc: 3/0,1 mode: PW/PW res: [0x2b6df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568260:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c511b1 lrc: 3/0,1 mode: PW/PW res: [0x2b6df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568263:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c511b1 lrc: 2/0,0 mode: PW/PW res: [0x2b6df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.568276:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+939:39030:x1731745946440896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1346us (1434us total) trans 12885079494 rc 0/0 00000100:00100000:1.0:1651529344.568279:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211440 00010000:00010000:1.0:1651529344.568290:0:72396:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009fd6afb/0x3234de053c4d5d6 lrc: 0/0,0 mode: --/PR res: [0x2b6e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d08c1 expref: 1124 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.568297:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b4acf60d pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745996998976:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.568299:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+939:39030:x1731745946440640:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1381us (1507us total) trans 12885079495 rc 0/0 00010000:00010000:1.0:1651529344.568300:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d688ac01/0x3234de053c511bf lrc: 3/0,1 mode: PW/PW res: [0x2b6e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.568302:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211439 00010000:00010000:1.0:1651529344.568304:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d688ac01/0x3234de053c511bf lrc: 3/0,1 mode: PW/PW res: [0x2b6e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568306:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d688ac01/0x3234de053c511bf lrc: 3/0,1 mode: PW/PW res: [0x2b6e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568309:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d688ac01/0x3234de053c511bf lrc: 3/0,1 mode: PW/PW res: [0x2b6e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568310:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c511a3 lrc: 2/0,0 mode: PW/PW res: [0x2b6dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568312:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d688ac01/0x3234de053c511bf lrc: 2/0,0 mode: PW/PW res: [0x2b6e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568315:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000085580035 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.568317:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c511a3 lrc: 2/0,0 mode: PW/PW res: [0x2b6dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568319:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c511a3 lrc: 3/0,0 mode: PW/PW res: [0x2b6dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568324:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c511a3 lrc: 1/0,0 mode: --/PW res: [0x2b6dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568327:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c511a3 lrc: 0/0,0 mode: --/PW res: [0x2b6dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568331:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006156151/0x3234de053c511aa lrc: 2/0,0 mode: PW/PW res: [0x2b6de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568333:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000006156151 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.568334:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006156151/0x3234de053c511aa lrc: 2/0,0 mode: PW/PW res: [0x2b6de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568337:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006156151/0x3234de053c511aa lrc: 3/0,0 mode: PW/PW res: [0x2b6de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568340:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006156151/0x3234de053c511aa lrc: 1/0,0 mode: --/PW res: [0x2b6de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568343:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006156151/0x3234de053c511aa lrc: 0/0,0 mode: --/PW res: [0x2b6de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568346:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a35aa4a/0x3234de053c511b8 lrc: 2/0,0 mode: PW/PW res: [0x2b6e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.568349:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+939:39030:x1731745946441216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1002us (1054us total) trans 12885079496 rc 0/0 00010000:00010000:0.0:1651529344.568349:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004a35aa4a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.568350:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a35aa4a/0x3234de053c511b8 lrc: 2/0,0 mode: PW/PW res: [0x2b6e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.568352:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211441 00010000:00010000:0.0:1651529344.568352:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a35aa4a/0x3234de053c511b8 lrc: 3/0,0 mode: PW/PW res: [0x2b6e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568355:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a35aa4a/0x3234de053c511b8 lrc: 1/0,0 mode: --/PW res: [0x2b6e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568358:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a35aa4a/0x3234de053c511b8 lrc: 0/0,0 mode: --/PW res: [0x2b6e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568361:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c511b1 lrc: 2/0,0 mode: PW/PW res: [0x2b6df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568364:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000002904524 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.568365:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c511b1 lrc: 2/0,0 mode: PW/PW res: [0x2b6df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568367:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c511b1 lrc: 3/0,0 mode: PW/PW res: [0x2b6df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568370:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c511b1 lrc: 1/0,0 mode: --/PW res: [0x2b6df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568373:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c511b1 lrc: 0/0,0 mode: --/PW res: [0x2b6df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568376:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d688ac01/0x3234de053c511bf lrc: 2/0,0 mode: PW/PW res: [0x2b6e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568379:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d688ac01 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.568387:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d688ac01/0x3234de053c511bf lrc: 2/0,0 mode: PW/PW res: [0x2b6e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568390:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d688ac01/0x3234de053c511bf lrc: 3/0,0 mode: PW/PW res: [0x2b6e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568393:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d688ac01/0x3234de053c511bf lrc: 1/0,0 mode: --/PW res: [0x2b6e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568396:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d688ac01/0x3234de053c511bf lrc: 0/0,0 mode: --/PW res: [0x2b6e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.568408:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000007fba516 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996999040:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.568411:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c511c6 lrc: 3/0,1 mode: --/PW res: [0x2b6e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.568415:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.568425:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.568438:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.568466:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e5997468 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745996999168:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.568476:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000008fba62e/0x3234de053c511d4 lrc: 3/0,1 mode: --/PW res: [0x2b6e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.568486:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396322368 00010000:00010000:1.0:1651529344.568491:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000024e518f1/0x3234de053c4d4cc lrc: 4/0,0 mode: PR/PR res: [0x2b6e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d053a expref: 1124 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.568501:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396322432 00010000:00010000:1.0:1651529344.568503:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e1ef46c4/0x3234de053c4efb4 lrc: 5/0,0 mode: PR/PR res: [0x2b6e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d713c expref: 1125 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.568504:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396322560 00000100:00100000:1.0:1651529344.568508:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12224 00000100:00100000:1.0:1651529344.568510:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1126:41279:x1731746396322368:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.568510:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ee557312/0x3234de053c4cc52 lrc: 4/0,0 mode: PR/PR res: [0x2b6e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce2e9 expref: 1126 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.568513:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.568514:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000024e518f1/0x3234de053c4d4cc lrc: 4/0,0 mode: PR/PR res: [0x2b6e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d053a expref: 1126 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.568518:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000024e518f1/0x3234de053c4d4cc lrc: 3/0,0 mode: PR/PR res: [0x2b6e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d053a expref: 1126 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.568523:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024e518f1/0x3234de053c4d4cc lrc: 0/0,0 mode: --/PR res: [0x2b6e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d053a expref: 1126 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.568527:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.568527:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.568528:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c511c6 lrc: 3/0,1 mode: PW/PW res: [0x2b6e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568531:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c511c6 lrc: 4/0,1 mode: PW/PW res: [0x2b6e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.568532:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12225 00000100:00100000:0.0:1651529344.568534:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000db7aa2bf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1125:41279:x1731746396322432:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.568537:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.568540:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.568544:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e1ef46c4/0x3234de053c4efb4 lrc: 5/0,0 mode: PR/PR res: [0x2b6e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d713c expref: 1125 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.568548:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e1ef46c4/0x3234de053c4efb4 lrc: 4/0,0 mode: PR/PR res: [0x2b6e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d713c expref: 1125 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.568549:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1125:41279:x1731746396322368:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 38us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.568552:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12224 00010000:00010000:0.0:1651529344.568554:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.568555:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.568555:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005de6f336/0x3234de053c511cd lrc: 3/0,1 mode: PW/PW res: [0x2b6e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.568556:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12226 00000100:00100000:1.0:1651529344.568558:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1124:41279:x1731746396322560:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.568558:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005de6f336/0x3234de053c511cd lrc: 4/0,1 mode: PW/PW res: [0x2b6e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568561:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.568562:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ee557312/0x3234de053c4cc52 lrc: 4/0,0 mode: PR/PR res: [0x2b6e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce2e9 expref: 1124 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.568563:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.568566:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ee557312/0x3234de053c4cc52 lrc: 3/0,0 mode: PR/PR res: [0x2b6e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce2e9 expref: 1124 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.568571:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee557312/0x3234de053c4cc52 lrc: 0/0,0 mode: --/PR res: [0x2b6e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce2e9 expref: 1124 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.568571:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000db7aa2bf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1124:41279:x1731746396322432:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 37us (146us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.568574:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.568574:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12225 00010000:00010000:1.0:1651529344.568575:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.568576:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000008fba62e/0x3234de053c511d4 lrc: 3/0,1 mode: PW/PW res: [0x2b6e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568578:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008fba62e/0x3234de053c511d4 lrc: 4/0,1 mode: PW/PW res: [0x2b6e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568584:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.568585:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c511c6 lrc: 3/0,1 mode: PW/PW res: [0x2b6e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.568589:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1122:41279:x1731746396322560:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 30us (150us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.568589:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c511c6 lrc: 3/0,1 mode: PW/PW res: [0x2b6e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.568591:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12226 00010000:00010000:0.0:1651529344.568594:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c511c6 lrc: 3/0,1 mode: PW/PW res: [0x2b6e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568597:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000008fba62e/0x3234de053c511d4 lrc: 3/0,1 mode: PW/PW res: [0x2b6e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568597:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c511c6 lrc: 2/0,0 mode: PW/PW res: [0x2b6e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568601:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008fba62e/0x3234de053c511d4 lrc: 3/0,1 mode: PW/PW res: [0x2b6e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568604:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008fba62e/0x3234de053c511d4 lrc: 3/0,1 mode: PW/PW res: [0x2b6e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568606:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008fba62e/0x3234de053c511d4 lrc: 2/0,0 mode: PW/PW res: [0x2b6e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.568645:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+940:39029:x1731745946441280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1292us (1341us total) trans 12885079497 rc 0/0 00000100:00100000:1.0:1651529344.568648:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+940:39029:x1731745946441472:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 790us (824us total) trans 12885079498 rc 0/0 00000100:00100000:0.0:1651529344.568648:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211442 00000100:00100000:1.0:1651529344.568651:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211444 00010000:00010000:0.0:1651529344.568655:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c511c6 lrc: 2/0,0 mode: PW/PW res: [0x2b6e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568658:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000069f7ba22 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.568659:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c511c6 lrc: 2/0,0 mode: PW/PW res: [0x2b6e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568661:0:80277:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1ef46c4/0x3234de053c4efb4 lrc: 0/0,0 mode: --/PR res: [0x2b6e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d713c expref: 1121 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.568662:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c511c6 lrc: 3/0,0 mode: PW/PW res: [0x2b6e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.568665:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae466fbb pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996999104:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.568666:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c511c6 lrc: 1/0,0 mode: --/PW res: [0x2b6e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568669:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005de6f336/0x3234de053c511cd lrc: 3/0,1 mode: PW/PW res: [0x2b6e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568669:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c511c6 lrc: 0/0,0 mode: --/PW res: [0x2b6e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568672:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005de6f336/0x3234de053c511cd lrc: 3/0,1 mode: PW/PW res: [0x2b6e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568673:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008fba62e/0x3234de053c511d4 lrc: 2/0,0 mode: PW/PW res: [0x2b6e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568676:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000008fba62e already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.568677:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005de6f336/0x3234de053c511cd lrc: 3/0,1 mode: PW/PW res: [0x2b6e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568677:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008fba62e/0x3234de053c511d4 lrc: 2/0,0 mode: PW/PW res: [0x2b6e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568680:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005de6f336/0x3234de053c511cd lrc: 3/0,1 mode: PW/PW res: [0x2b6e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568680:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008fba62e/0x3234de053c511d4 lrc: 3/0,0 mode: PW/PW res: [0x2b6e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568683:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005de6f336/0x3234de053c511cd lrc: 2/0,0 mode: PW/PW res: [0x2b6e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568683:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008fba62e/0x3234de053c511d4 lrc: 1/0,0 mode: --/PW res: [0x2b6e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568685:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008fba62e/0x3234de053c511d4 lrc: 0/0,0 mode: --/PW res: [0x2b6e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568689:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005de6f336/0x3234de053c511cd lrc: 3/0,0 mode: PW/PW res: [0x2b6e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568698:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005de6f336 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.568699:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005de6f336/0x3234de053c511cd lrc: 2/0,0 mode: PW/PW res: [0x2b6e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568702:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005de6f336/0x3234de053c511cd lrc: 3/0,0 mode: PW/PW res: [0x2b6e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568705:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005de6f336/0x3234de053c511cd lrc: 1/0,0 mode: --/PW res: [0x2b6e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568708:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005de6f336/0x3234de053c511cd lrc: 0/0,0 mode: --/PW res: [0x2b6e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.568719:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+939:39029:x1731745946441344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1077us (1163us total) trans 12885079499 rc 0/0 00000100:00100000:1.0:1651529344.568722:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211443 00000100:00100000:0.0:1651529344.568802:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.568812:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946441856 00000100:00100000:1.0:1651529344.568820:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211445 00000100:00100000:1.0:1651529344.568822:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+939:39030:x1731745946441856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.568824:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529344.568827:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177893 count 1 00010000:00010000:1.0:1651529344.568831:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e85ad79c/0x3234de053c511db lrc: 3/0,1 mode: --/PW res: [0x2b6e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.568832:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.568843:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000093685f3b/0x3234de053c4f698 lrc: 2/0,0 mode: PR/PR res: [0x2b6e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d04 expref: 1120 pid: 156655 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.568843:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.568847:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.568848:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.568848:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e85ad79c/0x3234de053c511db lrc: 4/0,1 mode: --/PW res: [0x2b6e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.568850:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.568859:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946441984 00010000:00010000:1.0:1651529344.568862:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000093685f3b/0x3234de053c4f698 lrc: 3/0,0 mode: PR/PR res: [0x2b6e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d04 expref: 1120 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.568866:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000093685f3b/0x3234de053c4f698 lrc: 4/0,0 mode: PR/PR res: [0x2b6e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d04 expref: 1120 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.568866:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946442048 00000100:00100000:0.0:1651529344.568872:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946442176 00000100:00100000:1.0:1651529344.568875:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae466fbb pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996999232:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.568875:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946442240 00000100:00100000:0.0:1651529344.568881:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211446 00000100:00100000:0.0:1651529344.568883:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+943:39029:x1731745946441984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.568888:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177894 count 1 00000100:00100000:1.0:1651529344.568890:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a6b79b05 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.568893:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c511e2 lrc: 3/0,1 mode: --/PW res: [0x2b6e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.568896:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211447 00000100:00100000:1.0:1651529344.568898:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+943:39029:x1731745946442048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.568898:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000073c38663/0x3234de053c4e4d9 lrc: 2/0,0 mode: PR/PR res: [0x2b6e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d44b1 expref: 1120 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.568901:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.568902:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.568902:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c511e2 lrc: 4/0,1 mode: --/PW res: [0x2b6e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.568903:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177895 count 1 00010000:00010000:1.0:1651529344.568906:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ecdd226/0x3234de053c511e9 lrc: 3/0,1 mode: --/PW res: [0x2b6e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568910:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f8e04ec4/0x3234de053c49fce lrc: 2/0,0 mode: PR/PR res: [0x2b6e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb55b expref: 1120 pid: 80281 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.568913:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.568914:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.568915:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ecdd226/0x3234de053c511e9 lrc: 4/0,1 mode: --/PW res: [0x2b6e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568920:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f8e04ec4/0x3234de053c49fce lrc: 3/0,0 mode: PR/PR res: [0x2b6e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb55b expref: 1120 pid: 80281 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.568924:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f8e04ec4/0x3234de053c49fce lrc: 4/0,0 mode: PR/PR res: [0x2b6e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb55b expref: 1120 pid: 80281 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.568928:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e5997468 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996999296:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.568934:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8a0b704 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.568940:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211448 00010000:00010000:0.0:1651529344.568946:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000073c38663/0x3234de053c4e4d9 lrc: 3/0,0 mode: PR/PR res: [0x2b6e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d44b1 expref: 1120 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.568950:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000073710b61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+943:39029:x1731745946442176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.568953:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000073c38663/0x3234de053c4e4d9 lrc: 4/0,0 mode: PR/PR res: [0x2b6e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d44b1 expref: 1120 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:1.0:1651529344.568956:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177896 count 1 00010000:00010000:1.0:1651529344.568959:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bb75065/0x3234de053c511f0 lrc: 3/0,1 mode: --/PW res: [0x2b6e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.568961:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007ac35c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996999360:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.568964:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005b93642a/0x3234de053c4e4a8 lrc: 2/0,0 mode: PR/PR res: [0x2b6e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43e6 expref: 1120 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.568967:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.568967:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.568968:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009bb75065/0x3234de053c511f0 lrc: 4/0,1 mode: --/PW res: [0x2b6e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.568974:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005b93642a/0x3234de053c4e4a8 lrc: 3/0,0 mode: PR/PR res: [0x2b6e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43e6 expref: 1120 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.568974:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 0000000049203969 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.568977:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005b93642a/0x3234de053c4e4a8 lrc: 4/0,0 mode: PR/PR res: [0x2b6e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43e6 expref: 1120 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.568981:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002a1f5cf2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996999424:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.568982:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211449 00000100:00100000:0.0:1651529344.568984:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+943:39030:x1731745946442240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.568988:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aeda71fe going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.568990:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177897 count 1 00010000:00010000:0.0:1651529344.568994:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c511f7 lrc: 3/0,1 mode: --/PW res: [0x2b6e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.568998:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004c65360a/0x3234de053c4edbc lrc: 2/0,0 mode: PR/PR res: [0x2b6e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d694e expref: 1120 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.569002:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.569002:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.569003:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.569003:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c511f7 lrc: 4/0,1 mode: --/PW res: [0x2b6e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.569009:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004c65360a/0x3234de053c4edbc lrc: 3/0,0 mode: PR/PR res: [0x2b6e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d694e expref: 1120 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.569013:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004c65360a/0x3234de053c4edbc lrc: 4/0,0 mode: PR/PR res: [0x2b6e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d694e expref: 1120 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.569017:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.569017:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000007fba516 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996999488:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.569024:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000003003c8b0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.569028:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.569029:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946442304 00000100:00100000:0.0:1651529344.569037:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946442368 00000100:00100000:0.0:1651529344.569040:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946442432 00000100:00100000:0.0:1651529344.569043:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211450 00000100:00100000:0.0:1651529344.569044:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+946:39029:x1731745946442304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.569048:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177898 count 1 00010000:00010000:0.0:1651529344.569052:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c511fe lrc: 3/0,1 mode: --/PW res: [0x2b6ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.569056:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005630c62e/0x3234de053c4dec0 lrc: 2/0,0 mode: PR/PR res: [0x2b6ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2bdd expref: 1120 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.569059:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.569060:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.569060:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c511fe lrc: 4/0,1 mode: --/PW res: [0x2b6ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.569066:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005630c62e/0x3234de053c4dec0 lrc: 3/0,0 mode: PR/PR res: [0x2b6ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2bdd expref: 1120 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.569069:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005630c62e/0x3234de053c4dec0 lrc: 4/0,0 mode: PR/PR res: [0x2b6ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2bdd expref: 1120 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.569073:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005fb0ec6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996999552:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.569081:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211451 00000100:00100000:1.0:1651529344.569083:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+946:39030:x1731745946442368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.569086:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 0000000009370c1d going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.569092:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211452 00002000:00080000:1.0:1651529344.569093:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177899 count 1 00000100:00100000:0.0:1651529344.569094:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085af61db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+946:39029:x1731745946442432:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.569097:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004273867c/0x3234de053c51205 lrc: 3/0,1 mode: --/PW res: [0x2b6eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.569101:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000022086dac/0x3234de053c4e63e lrc: 2/0,0 mode: PR/PR res: [0x2b6eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d49f1 expref: 1120 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.569104:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.569105:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.569106:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004273867c/0x3234de053c51205 lrc: 4/0,1 mode: --/PW res: [0x2b6eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.569112:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000022086dac/0x3234de053c4e63e lrc: 3/0,0 mode: PR/PR res: [0x2b6eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d49f1 expref: 1120 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.569114:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177900 count 1 00010000:00010000:1.0:1651529344.569115:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000022086dac/0x3234de053c4e63e lrc: 4/0,0 mode: PR/PR res: [0x2b6eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d49f1 expref: 1120 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.569119:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000edfe60d3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996999616:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.569119:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c5120c lrc: 3/0,1 mode: --/PW res: [0x2b6ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.569123:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002961d9ef/0x3234de053c4d0ea lrc: 2/0,0 mode: PR/PR res: [0x2b6ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf526 expref: 1120 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.569126:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.569127:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000567ee0ef going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.569127:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.569128:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c5120c lrc: 4/0,1 mode: --/PW res: [0x2b6ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.569134:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002961d9ef/0x3234de053c4d0ea lrc: 3/0,0 mode: PR/PR res: [0x2b6ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf526 expref: 1120 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.569138:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002961d9ef/0x3234de053c4d0ea lrc: 4/0,0 mode: PR/PR res: [0x2b6ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf526 expref: 1120 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.569142:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000078f9a278 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996999680:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.569150:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a3b00cf3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.569449:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e5997468 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745996999296:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.569454:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007ecdd226/0x3234de053c511e9 lrc: 3/0,1 mode: --/PW res: [0x2b6e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.569454:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007ac35c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745996999360:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.569459:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c511e2 lrc: 3/0,1 mode: --/PW res: [0x2b6e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.569464:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002a1f5cf2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745996999424:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.569467:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009bb75065/0x3234de053c511f0 lrc: 3/0,1 mode: --/PW res: [0x2b6e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.569473:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae466fbb pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996999232:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.569475:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e85ad79c/0x3234de053c511db lrc: 3/0,1 mode: --/PW res: [0x2b6e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.569509:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.569516:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.569522:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.569527:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000007fba516 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745996999488:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.569529:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.569531:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c511f7 lrc: 3/0,1 mode: --/PW res: [0x2b6e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.569537:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.569560:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396322880 00010000:00010000:0.0:1651529344.569565:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f8e04ec4/0x3234de053c49fce lrc: 4/0,0 mode: PR/PR res: [0x2b6e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb55b expref: 1121 pid: 80281 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.569571:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396322816 00000100:00100000:1.0:1651529344.569572:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396323008 00010000:00010000:0.0:1651529344.569573:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000093685f3b/0x3234de053c4f698 lrc: 4/0,0 mode: PR/PR res: [0x2b6e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d04 expref: 1122 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.569578:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005b93642a/0x3234de053c4e4a8 lrc: 4/0,0 mode: PR/PR res: [0x2b6e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43e6 expref: 1123 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.569578:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396322944 00010000:00010000:0.0:1651529344.569580:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000073c38663/0x3234de053c4e4d9 lrc: 4/0,0 mode: PR/PR res: [0x2b6e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d44b1 expref: 1124 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.569584:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396323072 00000100:00100000:0.0:1651529344.569585:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12227 00010000:00010000:1.0:1651529344.569587:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004c65360a/0x3234de053c4edbc lrc: 4/0,0 mode: PR/PR res: [0x2b6e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d694e expref: 1125 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.569587:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1125:41278:x1731746396322880:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.569590:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.569591:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f8e04ec4/0x3234de053c49fce lrc: 4/0,0 mode: PR/PR res: [0x2b6e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb55b expref: 1125 pid: 80281 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.569592:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12228 00000100:00100000:1.0:1651529344.569593:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1125:41279:x1731746396322816:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.569595:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f8e04ec4/0x3234de053c49fce lrc: 3/0,0 mode: PR/PR res: [0x2b6e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb55b expref: 1125 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.569596:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.569598:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000093685f3b/0x3234de053c4f698 lrc: 4/0,0 mode: PR/PR res: [0x2b6e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d04 expref: 1125 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.569602:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000093685f3b/0x3234de053c4f698 lrc: 3/0,0 mode: PR/PR res: [0x2b6e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d04 expref: 1125 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.569607:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093685f3b/0x3234de053c4f698 lrc: 0/0,0 mode: --/PR res: [0x2b6e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d04 expref: 1125 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.569611:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.569612:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.569613:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e85ad79c/0x3234de053c511db lrc: 3/0,1 mode: PW/PW res: [0x2b6e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.569614:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8e04ec4/0x3234de053c49fce lrc: 0/0,0 mode: --/PR res: [0x2b6e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb55b expref: 1124 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.569616:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e85ad79c/0x3234de053c511db lrc: 4/0,1 mode: PW/PW res: [0x2b6e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.569618:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.569619:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.569620:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007ecdd226/0x3234de053c511e9 lrc: 3/0,1 mode: PW/PW res: [0x2b6e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.569622:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.569623:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ecdd226/0x3234de053c511e9 lrc: 4/0,1 mode: PW/PW res: [0x2b6e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.569632:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.569636:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1123:41279:x1731746396322816:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.569639:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12228 00000100:00100000:0.0:1651529344.569640:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1123:41278:x1731746396322880:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 53us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.569643:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12227 00000100:00100000:1.0:1651529344.569645:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12229 00000100:00100000:1.0:1651529344.569646:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1121:41278:x1731746396323008:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.569649:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.569649:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12230 00010000:00010000:1.0:1651529344.569651:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005b93642a/0x3234de053c4e4a8 lrc: 4/0,0 mode: PR/PR res: [0x2b6e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43e6 expref: 1121 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.569651:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1121:41279:x1731746396322944:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.569653:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.569655:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005b93642a/0x3234de053c4e4a8 lrc: 3/0,0 mode: PR/PR res: [0x2b6e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43e6 expref: 1121 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.569655:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000073c38663/0x3234de053c4e4d9 lrc: 4/0,0 mode: PR/PR res: [0x2b6e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d44b1 expref: 1121 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.569658:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000073c38663/0x3234de053c4e4d9 lrc: 3/0,0 mode: PR/PR res: [0x2b6e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d44b1 expref: 1121 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.569660:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b93642a/0x3234de053c4e4a8 lrc: 0/0,0 mode: --/PR res: [0x2b6e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43e6 expref: 1121 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.569663:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.569663:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073c38663/0x3234de053c4e4d9 lrc: 0/0,0 mode: --/PR res: [0x2b6e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d44b1 expref: 1120 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.569664:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.569664:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009bb75065/0x3234de053c511f0 lrc: 3/0,1 mode: PW/PW res: [0x2b6e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.569667:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009bb75065/0x3234de053c511f0 lrc: 4/0,1 mode: PW/PW res: [0x2b6e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.569667:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.569667:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.569668:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c511e2 lrc: 3/0,1 mode: PW/PW res: [0x2b6e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.569673:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.569673:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c511e2 lrc: 4/0,1 mode: PW/PW res: [0x2b6e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.569678:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1119:41278:x1731746396323008:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 31us (156us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.569679:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.569680:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12229 00000100:00100000:1.0:1651529344.569684:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12231 00000100:00100000:0.0:1651529344.569684:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1118:41279:x1731746396322944:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.569686:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1118:41279:x1731746396323072:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.569687:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12230 00010000:00010000:1.0:1651529344.569688:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.569689:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004c65360a/0x3234de053c4edbc lrc: 4/0,0 mode: PR/PR res: [0x2b6e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d694e expref: 1117 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.569693:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004c65360a/0x3234de053c4edbc lrc: 3/0,0 mode: PR/PR res: [0x2b6e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d694e expref: 1117 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.569695:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005fb0ec6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745996999552:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.569697:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c65360a/0x3234de053c4edbc lrc: 0/0,0 mode: --/PR res: [0x2b6e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d694e expref: 1117 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.569699:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c511fe lrc: 3/0,1 mode: --/PW res: [0x2b6ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.569703:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.569703:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.569704:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c511f7 lrc: 3/0,1 mode: PW/PW res: [0x2b6e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.569704:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c511e2 lrc: 3/0,1 mode: PW/PW res: [0x2b6e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.569707:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c511f7 lrc: 4/0,1 mode: PW/PW res: [0x2b6e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.569707:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c511e2 lrc: 3/0,1 mode: PW/PW res: [0x2b6e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.569710:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c511e2 lrc: 3/0,1 mode: PW/PW res: [0x2b6e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.569713:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c511e2 lrc: 2/0,0 mode: PW/PW res: [0x2b6e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.569716:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.569721:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1116:41279:x1731746396323072:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.569723:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12231 00000100:00100000:1.0:1651529344.569743:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000edfe60d3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996999616:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.569747:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004273867c/0x3234de053c51205 lrc: 3/0,1 mode: --/PW res: [0x2b6eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.569753:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007ecdd226/0x3234de053c511e9 lrc: 3/0,1 mode: PW/PW res: [0x2b6e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.569756:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ecdd226/0x3234de053c511e9 lrc: 3/0,1 mode: PW/PW res: [0x2b6e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.569759:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ecdd226/0x3234de053c511e9 lrc: 3/0,1 mode: PW/PW res: [0x2b6e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.569762:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ecdd226/0x3234de053c511e9 lrc: 2/0,0 mode: PW/PW res: [0x2b6e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.569777:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+947:39029:x1731745946441984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 893us (953us total) trans 12885079500 rc 0/0 00000100:00100000:0.0:1651529344.569781:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211446 00010000:00010000:0.0:1651529344.569788:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c511e2 lrc: 2/0,0 mode: PW/PW res: [0x2b6e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.569791:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001d253066 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.569792:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c511e2 lrc: 2/0,0 mode: PW/PW res: [0x2b6e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.569795:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c511e2 lrc: 3/0,0 mode: PW/PW res: [0x2b6e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.569799:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c511e2 lrc: 1/0,0 mode: --/PW res: [0x2b6e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.569802:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c511e2 lrc: 0/0,0 mode: --/PW res: [0x2b6e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.569804:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+947:39029:x1731745946442048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 906us (972us total) trans 12885079501 rc 0/0 00010000:00010000:0.0:1651529344.569807:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ecdd226/0x3234de053c511e9 lrc: 2/0,0 mode: PW/PW res: [0x2b6e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.569808:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211447 00010000:00010000:0.0:1651529344.569809:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007ecdd226 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.569810:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ecdd226/0x3234de053c511e9 lrc: 2/0,0 mode: PW/PW res: [0x2b6e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.569813:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ecdd226/0x3234de053c511e9 lrc: 3/0,0 mode: PW/PW res: [0x2b6e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.569815:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009bb75065/0x3234de053c511f0 lrc: 3/0,1 mode: PW/PW res: [0x2b6e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.569816:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ecdd226/0x3234de053c511e9 lrc: 1/0,0 mode: --/PW res: [0x2b6e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.569818:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009bb75065/0x3234de053c511f0 lrc: 3/0,1 mode: PW/PW res: [0x2b6e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.569821:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bb75065/0x3234de053c511f0 lrc: 3/0,1 mode: PW/PW res: [0x2b6e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.569821:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ecdd226/0x3234de053c511e9 lrc: 0/0,0 mode: --/PW res: [0x2b6e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.569824:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009bb75065/0x3234de053c511f0 lrc: 2/0,0 mode: PW/PW res: [0x2b6e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.569827:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c511f7 lrc: 3/0,1 mode: PW/PW res: [0x2b6e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.569830:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c511f7 lrc: 3/0,1 mode: PW/PW res: [0x2b6e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.569839:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c511f7 lrc: 3/0,1 mode: PW/PW res: [0x2b6e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.569842:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c511f7 lrc: 2/0,0 mode: PW/PW res: [0x2b6e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.569860:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000073710b61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+948:39029:x1731745946442176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 918us (1017us total) trans 12885079502 rc 0/0 00000100:00100000:1.0:1651529344.569863:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211448 00010000:00010000:1.0:1651529344.569869:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e85ad79c/0x3234de053c511db lrc: 3/0,1 mode: PW/PW res: [0x2b6e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.569872:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e85ad79c/0x3234de053c511db lrc: 3/0,1 mode: PW/PW res: [0x2b6e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.569875:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e85ad79c/0x3234de053c511db lrc: 3/0,1 mode: PW/PW res: [0x2b6e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.569878:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+947:39030:x1731745946442240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 893us (1028us total) trans 12885079503 rc 0/0 00010000:00010000:1.0:1651529344.569880:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e85ad79c/0x3234de053c511db lrc: 2/0,0 mode: PW/PW res: [0x2b6e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.569881:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211449 00010000:00010000:0.0:1651529344.569909:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009bb75065/0x3234de053c511f0 lrc: 2/0,0 mode: PW/PW res: [0x2b6e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.569913:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009bb75065 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.569914:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009bb75065/0x3234de053c511f0 lrc: 2/0,0 mode: PW/PW res: [0x2b6e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.569916:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+947:39030:x1731745946441856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1093us (1114us total) trans 12885079504 rc 0/0 00010000:00010000:0.0:1651529344.569916:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009bb75065/0x3234de053c511f0 lrc: 3/0,0 mode: PW/PW res: [0x2b6e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.569919:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211445 00010000:00010000:0.0:1651529344.569922:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009bb75065/0x3234de053c511f0 lrc: 1/0,0 mode: --/PW res: [0x2b6e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.569925:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009bb75065/0x3234de053c511f0 lrc: 0/0,0 mode: --/PW res: [0x2b6e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.569929:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c511f7 lrc: 2/0,0 mode: PW/PW res: [0x2b6e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.569931:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000048c07243 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.569932:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c511f7 lrc: 2/0,0 mode: PW/PW res: [0x2b6e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.569935:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c511f7 lrc: 3/0,0 mode: PW/PW res: [0x2b6e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.569938:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c511f7 lrc: 1/0,0 mode: --/PW res: [0x2b6e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.569940:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c511f7 lrc: 0/0,0 mode: --/PW res: [0x2b6e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.569944:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e85ad79c/0x3234de053c511db lrc: 2/0,0 mode: PW/PW res: [0x2b6e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.569946:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e85ad79c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.569947:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e85ad79c/0x3234de053c511db lrc: 2/0,0 mode: PW/PW res: [0x2b6e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.569950:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e85ad79c/0x3234de053c511db lrc: 3/0,0 mode: PW/PW res: [0x2b6e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.569953:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e85ad79c/0x3234de053c511db lrc: 1/0,0 mode: --/PW res: [0x2b6e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.569956:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e85ad79c/0x3234de053c511db lrc: 0/0,0 mode: --/PW res: [0x2b6e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.569981:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.569991:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.570008:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000078f9a278 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996999680:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.570013:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c5120c lrc: 3/0,1 mode: --/PW res: [0x2b6ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.570044:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.570066:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396323200 00010000:00010000:1.0:1651529344.570071:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005630c62e/0x3234de053c4dec0 lrc: 4/0,0 mode: PR/PR res: [0x2b6ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2bdd expref: 1116 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.570082:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396323264 00010000:00010000:1.0:1651529344.570084:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000022086dac/0x3234de053c4e63e lrc: 4/0,0 mode: PR/PR res: [0x2b6eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d49f1 expref: 1117 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.570085:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396323328 00000100:00100000:1.0:1651529344.570089:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12232 00000100:00100000:1.0:1651529344.570091:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000066a4e147 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1118:41279:x1731746396323200:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.570091:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002961d9ef/0x3234de053c4d0ea lrc: 4/0,0 mode: PR/PR res: [0x2b6ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf526 expref: 1118 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.570094:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.570095:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005630c62e/0x3234de053c4dec0 lrc: 4/0,0 mode: PR/PR res: [0x2b6ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2bdd expref: 1118 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.570099:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005630c62e/0x3234de053c4dec0 lrc: 3/0,0 mode: PR/PR res: [0x2b6ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2bdd expref: 1118 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.570107:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005630c62e/0x3234de053c4dec0 lrc: 0/0,0 mode: --/PR res: [0x2b6ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2bdd expref: 1118 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.570109:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12233 00010000:00010000:1.0:1651529344.570111:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.570111:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1117:41278:x1731746396323264:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.570112:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.570112:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c511fe lrc: 3/0,1 mode: PW/PW res: [0x2b6ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.570114:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.570115:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c511fe lrc: 4/0,1 mode: PW/PW res: [0x2b6ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.570116:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000022086dac/0x3234de053c4e63e lrc: 4/0,0 mode: PR/PR res: [0x2b6eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d49f1 expref: 1117 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.570120:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000022086dac/0x3234de053c4e63e lrc: 3/0,0 mode: PR/PR res: [0x2b6eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d49f1 expref: 1117 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.570124:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.570135:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000066a4e147 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1117:41279:x1731746396323200:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.570137:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12232 00010000:00010000:0.0:1651529344.570137:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022086dac/0x3234de053c4e63e lrc: 0/0,0 mode: --/PR res: [0x2b6eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d49f1 expref: 1117 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.570142:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.570142:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.570143:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004273867c/0x3234de053c51205 lrc: 3/0,1 mode: PW/PW res: [0x2b6eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.570146:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12234 00010000:00010000:0.0:1651529344.570146:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004273867c/0x3234de053c51205 lrc: 4/0,1 mode: PW/PW res: [0x2b6eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.570148:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1115:41278:x1731746396323328:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.570150:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.570152:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002961d9ef/0x3234de053c4d0ea lrc: 4/0,0 mode: PR/PR res: [0x2b6ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf526 expref: 1115 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.570156:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.570162:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002961d9ef/0x3234de053c4d0ea lrc: 3/0,0 mode: PR/PR res: [0x2b6ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf526 expref: 1115 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.570163:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1115:41278:x1731746396323264:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 52us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.570166:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12233 00010000:00010000:1.0:1651529344.570168:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002961d9ef/0x3234de053c4d0ea lrc: 0/0,0 mode: --/PR res: [0x2b6ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf526 expref: 1115 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.570173:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.570173:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c511fe lrc: 3/0,1 mode: PW/PW res: [0x2b6ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570174:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.570175:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c5120c lrc: 3/0,1 mode: PW/PW res: [0x2b6ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.570176:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c511fe lrc: 3/0,1 mode: PW/PW res: [0x2b6ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570178:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c5120c lrc: 4/0,1 mode: PW/PW res: [0x2b6ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.570179:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c511fe lrc: 3/0,1 mode: PW/PW res: [0x2b6ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.570182:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c511fe lrc: 2/0,0 mode: PW/PW res: [0x2b6ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570186:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.570192:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1113:41278:x1731746396323328:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 44us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.570195:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12234 00010000:00010000:1.0:1651529344.570202:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004273867c/0x3234de053c51205 lrc: 3/0,1 mode: PW/PW res: [0x2b6eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570206:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004273867c/0x3234de053c51205 lrc: 3/0,1 mode: PW/PW res: [0x2b6eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570214:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004273867c/0x3234de053c51205 lrc: 3/0,1 mode: PW/PW res: [0x2b6eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570217:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004273867c/0x3234de053c51205 lrc: 2/0,0 mode: PW/PW res: [0x2b6eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.570278:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+948:39030:x1731745946442368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1195us (1261us total) trans 12885079505 rc 0/0 00000100:00100000:1.0:1651529344.570281:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211451 00000100:00100000:0.0:1651529344.570283:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+948:39029:x1731745946442304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1238us (1280us total) trans 12885079506 rc 0/0 00000100:00100000:0.0:1651529344.570286:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211450 00010000:00010000:0.0:1651529344.570294:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c5120c lrc: 3/0,1 mode: PW/PW res: [0x2b6ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.570298:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c5120c lrc: 3/0,1 mode: PW/PW res: [0x2b6ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.570301:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c5120c lrc: 3/0,1 mode: PW/PW res: [0x2b6ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.570304:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c5120c lrc: 2/0,0 mode: PW/PW res: [0x2b6ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.570317:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.570334:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.570344:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085af61db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+947:39029:x1731745946442432:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1249us (1316us total) trans 12885079507 rc 0/0 00000100:00100000:1.0:1651529344.570347:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.570347:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211452 00000100:00100000:0.0:1651529344.570352:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946442752 00000100:00100000:1.0:1651529344.570355:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.570359:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946442688 00000100:00100000:0.0:1651529344.570367:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946442880 00000100:00100000:1.0:1651529344.570371:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.570371:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946442816 00000100:00100000:0.0:1651529344.570383:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946442944 00000100:00100000:0.0:1651529344.570390:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211453 00000100:00100000:0.0:1651529344.570392:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+951:39030:x1731745946442752:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.570397:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177902 count 1 00010000:00010000:0.0:1651529344.570401:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c51213 lrc: 3/0,1 mode: --/PW res: [0x2b6ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.570406:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004051e2c1/0x3234de053c4c870 lrc: 2/0,0 mode: PR/PR res: [0x2b6ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd3ae expref: 1112 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.570409:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.570410:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.570410:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c51213 lrc: 4/0,1 mode: --/PW res: [0x2b6ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.570417:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004051e2c1/0x3234de053c4c870 lrc: 3/0,0 mode: PR/PR res: [0x2b6ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd3ae expref: 1112 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.570420:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211454 00010000:00010000:0.0:1651529344.570421:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004051e2c1/0x3234de053c4c870 lrc: 4/0,0 mode: PR/PR res: [0x2b6ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd3ae expref: 1112 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.570422:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+951:39029:x1731745946442688:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.570425:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000089d7f5d6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996999744:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.570428:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177901 count 1 00010000:00010000:1.0:1651529344.570433:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfb26db5/0x3234de053c5121a lrc: 3/0,1 mode: --/PW res: [0x2b6ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.570439:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 000000008dd99533 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.570443:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c4be98 lrc: 2/0,0 mode: PR/PR res: [0x2b6ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6bf expref: 1112 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.570444:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004273867c/0x3234de053c51205 lrc: 2/0,0 mode: PW/PW res: [0x2b6eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570447:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.570447:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.570448:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfb26db5/0x3234de053c5121a lrc: 4/0,1 mode: --/PW res: [0x2b6ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.570448:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004273867c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.570449:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004273867c/0x3234de053c51205 lrc: 2/0,0 mode: PW/PW res: [0x2b6eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.570451:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004273867c/0x3234de053c51205 lrc: 3/0,0 mode: PW/PW res: [0x2b6eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570455:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c4be98 lrc: 3/0,0 mode: PR/PR res: [0x2b6ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6bf expref: 1112 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.570459:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c4be98 lrc: 4/0,0 mode: PR/PR res: [0x2b6ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6bf expref: 1112 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.570463:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000054e3a257 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996999808:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.570471:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 0000000071742acc going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.570474:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004273867c/0x3234de053c51205 lrc: 1/0,0 mode: --/PW res: [0x2b6eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.570477:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004273867c/0x3234de053c51205 lrc: 0/0,0 mode: --/PW res: [0x2b6eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.570478:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211455 00000100:00100000:1.0:1651529344.570479:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+951:39030:x1731745946442880:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.570481:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c511fe lrc: 2/0,0 mode: PW/PW res: [0x2b6ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.570484:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177904 count 1 00010000:00010000:0.0:1651529344.570484:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027456046 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.570485:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c511fe lrc: 2/0,0 mode: PW/PW res: [0x2b6ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570487:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008eb0a7f4/0x3234de053c51221 lrc: 3/0,1 mode: --/PW res: [0x2b6f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.570488:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c511fe lrc: 3/0,0 mode: PW/PW res: [0x2b6ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570491:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba00fdd7/0x3234de053c4ec50 lrc: 2/0,0 mode: PR/PR res: [0x2b6f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d62a2 expref: 1112 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.570491:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c511fe lrc: 1/0,0 mode: --/PW res: [0x2b6ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570494:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.570494:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c511fe lrc: 0/0,0 mode: --/PW res: [0x2b6ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570495:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.570495:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008eb0a7f4/0x3234de053c51221 lrc: 4/0,1 mode: --/PW res: [0x2b6f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.570497:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c5120c lrc: 2/0,0 mode: PW/PW res: [0x2b6ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.570499:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b855716b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.570500:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c5120c lrc: 2/0,0 mode: PW/PW res: [0x2b6ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570501:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ba00fdd7/0x3234de053c4ec50 lrc: 3/0,0 mode: PR/PR res: [0x2b6f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d62a2 expref: 1112 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.570503:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c5120c lrc: 3/0,0 mode: PW/PW res: [0x2b6ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570504:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ba00fdd7/0x3234de053c4ec50 lrc: 4/0,0 mode: PR/PR res: [0x2b6f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d62a2 expref: 1112 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.570506:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c5120c lrc: 1/0,0 mode: --/PW res: [0x2b6ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.570508:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b4acf60d pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996999872:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.570509:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c5120c lrc: 0/0,0 mode: --/PW res: [0x2b6ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.570514:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aeda71fe going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.570518:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211456 00000100:00100000:1.0:1651529344.570520:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211457 00000100:00100000:0.0:1651529344.570520:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+951:39029:x1731745946442816:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.570522:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+951:39029:x1731745946442944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.570525:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177903 count 1 00002000:00080000:1.0:1651529344.570526:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177905 count 1 00010000:00010000:0.0:1651529344.570528:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c51228 lrc: 3/0,1 mode: --/PW res: [0x2b6ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570529:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059d45c45/0x3234de053c5122f lrc: 3/0,1 mode: --/PW res: [0x2b6f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.570532:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf2234d0/0x3234de053c4d367 lrc: 2/0,0 mode: PR/PR res: [0x2b6ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff7c expref: 1112 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.570535:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.570536:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bb6137fd/0x3234de053c4e0e2 lrc: 2/0,0 mode: PR/PR res: [0x2b6f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3426 expref: 1112 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.570536:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.570536:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c51228 lrc: 4/0,1 mode: --/PW res: [0x2b6ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570539:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.570539:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.570540:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059d45c45/0x3234de053c5122f lrc: 4/0,1 mode: --/PW res: [0x2b6f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.570543:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bf2234d0/0x3234de053c4d367 lrc: 3/0,0 mode: PR/PR res: [0x2b6ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff7c expref: 1112 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.570546:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bb6137fd/0x3234de053c4e0e2 lrc: 3/0,0 mode: PR/PR res: [0x2b6f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3426 expref: 1112 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.570546:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bf2234d0/0x3234de053c4d367 lrc: 4/0,0 mode: PR/PR res: [0x2b6ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff7c expref: 1112 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.570549:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bb6137fd/0x3234de053c4e0e2 lrc: 4/0,0 mode: PR/PR res: [0x2b6f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3426 expref: 1112 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.570553:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ba0b61e6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997000000:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.570559:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a6b79b05 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.570565:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002c4168d4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996999936:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.570574:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 000000003003c8b0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.570592:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.570602:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.570611:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.570627:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946443072 00000100:00100000:0.0:1651529344.570635:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946443008 00000100:00100000:0.0:1651529344.570642:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946443136 00000100:00100000:0.0:1651529344.570647:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211458 00000100:00100000:0.0:1651529344.570648:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+954:39029:x1731745946443072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.570652:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211459 00002000:00080000:0.0:1651529344.570653:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177907 count 1 00000100:00100000:1.0:1651529344.570654:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+954:39030:x1731745946443008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.570657:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c51236 lrc: 3/0,1 mode: --/PW res: [0x2b6f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.570659:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177906 count 1 00010000:00010000:1.0:1651529344.570663:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dbb69211/0x3234de053c5123d lrc: 3/0,1 mode: --/PW res: [0x2b6f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570668:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c7243a53/0x3234de053c4d917 lrc: 2/0,0 mode: PR/PR res: [0x2b6f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1540 expref: 1112 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.570671:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.570672:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.570672:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dbb69211/0x3234de053c5123d lrc: 4/0,1 mode: --/PW res: [0x2b6f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.570677:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009ed6a85f/0x3234de053c4dade lrc: 2/0,0 mode: PR/PR res: [0x2b6f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ba6 expref: 1112 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.570679:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c7243a53/0x3234de053c4d917 lrc: 3/0,0 mode: PR/PR res: [0x2b6f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1540 expref: 1112 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.570680:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.570681:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.570682:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c7243a53/0x3234de053c4d917 lrc: 4/0,0 mode: PR/PR res: [0x2b6f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1540 expref: 1112 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.570682:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c51236 lrc: 4/0,1 mode: --/PW res: [0x2b6f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.570686:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000999005e pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997000064:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.570689:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009ed6a85f/0x3234de053c4dade lrc: 3/0,0 mode: PR/PR res: [0x2b6f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ba6 expref: 1112 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.570693:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009ed6a85f/0x3234de053c4dade lrc: 4/0,0 mode: PR/PR res: [0x2b6f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ba6 expref: 1112 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.570697:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8a0b704 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.570697:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004a6776b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997000128:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.570702:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211460 00000100:00100000:1.0:1651529344.570704:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+954:39030:x1731745946443136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.570706:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b81e4a0 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.570708:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177908 count 1 00010000:00010000:1.0:1651529344.570711:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5b283df/0x3234de053c51244 lrc: 3/0,1 mode: --/PW res: [0x2b6f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570715:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000352c04c3/0x3234de053c4dba9 lrc: 2/0,0 mode: PR/PR res: [0x2b6f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1eb6 expref: 1112 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.570718:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.570719:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.570719:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5b283df/0x3234de053c51244 lrc: 4/0,1 mode: --/PW res: [0x2b6f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.570727:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000352c04c3/0x3234de053c4dba9 lrc: 3/0,0 mode: PR/PR res: [0x2b6f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1eb6 expref: 1112 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.570731:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000352c04c3/0x3234de053c4dba9 lrc: 4/0,0 mode: PR/PR res: [0x2b6f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1eb6 expref: 1112 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.570745:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005ea32140 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997000192:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.570753:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000babe2d90 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.571063:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000054e3a257 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745996999808:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.571068:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bfb26db5/0x3234de053c5121a lrc: 3/0,1 mode: --/PW res: [0x2b6ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.571093:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b4acf60d pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745996999872:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.571096:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008eb0a7f4/0x3234de053c51221 lrc: 3/0,1 mode: --/PW res: [0x2b6f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.571102:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.571103:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ba0b61e6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997000000:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.571110:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000059d45c45/0x3234de053c5122f lrc: 3/0,1 mode: --/PW res: [0x2b6f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.571117:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396323840 00000100:00100000:0.0:1651529344.571121:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.571123:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004051e2c1/0x3234de053c4c870 lrc: 5/0,0 mode: PR/PR res: [0x2b6ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd3ae expref: 1113 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.571132:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.571149:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396323968 00010000:00010000:1.0:1651529344.571152:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ba00fdd7/0x3234de053c4ec50 lrc: 4/0,0 mode: PR/PR res: [0x2b6f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d62a2 expref: 1114 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.571157:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396323904 00010000:00010000:1.0:1651529344.571159:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c4be98 lrc: 4/0,0 mode: PR/PR res: [0x2b6ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6bf expref: 1115 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.571164:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12235 00000100:00100000:1.0:1651529344.571165:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1115:41279:x1731746396323840:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.571168:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.571169:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004051e2c1/0x3234de053c4c870 lrc: 5/0,0 mode: PR/PR res: [0x2b6ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd3ae expref: 1115 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.571178:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.571180:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004051e2c1/0x3234de053c4c870 lrc: 4/0,0 mode: PR/PR res: [0x2b6ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd3ae expref: 1115 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.571185:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.571186:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.571187:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.571187:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c51213 lrc: 3/0,1 mode: PW/PW res: [0x2b6ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.571191:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c51213 lrc: 4/0,1 mode: PW/PW res: [0x2b6ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.571201:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.571215:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1115:41279:x1731746396323840:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 49us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.571217:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002c4168d4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745996999936:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.571218:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12235 00010000:00010000:0.0:1651529344.571221:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c51228 lrc: 3/0,1 mode: --/PW res: [0x2b6ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.571237:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396324032 00010000:00010000:1.0:1651529344.571241:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bb6137fd/0x3234de053c4e0e2 lrc: 4/0,0 mode: PR/PR res: [0x2b6f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3426 expref: 1115 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.571246:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396324096 00010000:00010000:0.0:1651529344.571246:0:106695:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004051e2c1/0x3234de053c4c870 lrc: 0/0,0 mode: --/PR res: [0x2b6ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd3ae expref: 1115 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.571248:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bf2234d0/0x3234de053c4d367 lrc: 4/0,0 mode: PR/PR res: [0x2b6ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff7c expref: 1116 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.571250:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000089d7f5d6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745996999744:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.571253:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12236 00010000:00010000:0.0:1651529344.571253:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c51213 lrc: 3/0,1 mode: PW/PW res: [0x2b6ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.571254:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1115:41279:x1731746396323968:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.571256:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c51213 lrc: 3/0,1 mode: PW/PW res: [0x2b6ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.571257:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.571258:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ba00fdd7/0x3234de053c4ec50 lrc: 4/0,0 mode: PR/PR res: [0x2b6f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d62a2 expref: 1115 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.571259:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c51213 lrc: 3/0,1 mode: PW/PW res: [0x2b6ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.571262:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ba00fdd7/0x3234de053c4ec50 lrc: 3/0,0 mode: PR/PR res: [0x2b6f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d62a2 expref: 1115 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.571262:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c51213 lrc: 3/0,1 mode: PW/PW res: [0x2b6ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.571265:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c51213 lrc: 2/0,0 mode: PW/PW res: [0x2b6ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.571266:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba00fdd7/0x3234de053c4ec50 lrc: 0/0,0 mode: --/PR res: [0x2b6f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d62a2 expref: 1115 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.571270:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.571270:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.571271:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008eb0a7f4/0x3234de053c51221 lrc: 3/0,1 mode: PW/PW res: [0x2b6f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.571276:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008eb0a7f4/0x3234de053c51221 lrc: 4/0,1 mode: PW/PW res: [0x2b6f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.571283:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.571288:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1114:41279:x1731746396323968:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 33us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.571291:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12236 00000100:00100000:1.0:1651529344.571295:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12237 00000100:00100000:1.0:1651529344.571296:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1113:41279:x1731746396323904:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.571299:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.571300:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c4be98 lrc: 4/0,0 mode: PR/PR res: [0x2b6ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6bf expref: 1113 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.571303:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c4be98 lrc: 3/0,0 mode: PR/PR res: [0x2b6ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6bf expref: 1113 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.571307:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+955:39030:x1731745946442752:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 914us (990us total) trans 12885079508 rc 0/0 00010000:00010000:1.0:1651529344.571308:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c4be98 lrc: 0/0,0 mode: --/PR res: [0x2b6ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6bf expref: 1113 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.571310:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211453 00010000:00010000:1.0:1651529344.571311:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.571312:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.571312:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bfb26db5/0x3234de053c5121a lrc: 3/0,1 mode: PW/PW res: [0x2b6ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.571315:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfb26db5/0x3234de053c5121a lrc: 4/0,1 mode: PW/PW res: [0x2b6ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.571317:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c51213 lrc: 2/0,0 mode: PW/PW res: [0x2b6ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.571320:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005d8a4887 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.571321:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c51213 lrc: 2/0,0 mode: PW/PW res: [0x2b6ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.571323:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.571324:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c51213 lrc: 3/0,0 mode: PW/PW res: [0x2b6ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.571327:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1112:41279:x1731746396323904:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 30us (196us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.571329:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c51213 lrc: 1/0,0 mode: --/PW res: [0x2b6ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.571330:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12237 00010000:00010000:0.0:1651529344.571332:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c51213 lrc: 0/0,0 mode: --/PW res: [0x2b6ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.571333:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12238 00000100:00100000:1.0:1651529344.571335:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1111:41279:x1731746396324032:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.571337:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.571338:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bb6137fd/0x3234de053c4e0e2 lrc: 4/0,0 mode: PR/PR res: [0x2b6f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3426 expref: 1111 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.571341:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004a6776b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997000128:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.571342:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bb6137fd/0x3234de053c4e0e2 lrc: 3/0,0 mode: PR/PR res: [0x2b6f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3426 expref: 1111 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.571344:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c51236 lrc: 3/0,1 mode: --/PW res: [0x2b6f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.571346:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb6137fd/0x3234de053c4e0e2 lrc: 0/0,0 mode: --/PR res: [0x2b6f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3426 expref: 1111 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.571349:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.571350:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.571350:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000059d45c45/0x3234de053c5122f lrc: 3/0,1 mode: PW/PW res: [0x2b6f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.571351:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12239 00010000:00010000:1.0:1651529344.571353:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059d45c45/0x3234de053c5122f lrc: 4/0,1 mode: PW/PW res: [0x2b6f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.571353:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ccd58b65 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1110:41278:x1731746396324096:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.571359:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.571363:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1110:41279:x1731746396324032:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 27us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.571365:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12238 00010000:00010000:1.0:1651529344.571372:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000059d45c45/0x3234de053c5122f lrc: 3/0,1 mode: PW/PW res: [0x2b6f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.571375:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059d45c45/0x3234de053c5122f lrc: 3/0,1 mode: PW/PW res: [0x2b6f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.571378:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059d45c45/0x3234de053c5122f lrc: 3/0,1 mode: PW/PW res: [0x2b6f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.571382:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.571384:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bf2234d0/0x3234de053c4d367 lrc: 4/0,0 mode: PR/PR res: [0x2b6ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff7c expref: 1109 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.571388:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bf2234d0/0x3234de053c4d367 lrc: 3/0,0 mode: PR/PR res: [0x2b6ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff7c expref: 1109 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.571390:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059d45c45/0x3234de053c5122f lrc: 2/0,0 mode: PW/PW res: [0x2b6f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.571394:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf2234d0/0x3234de053c4d367 lrc: 0/0,0 mode: --/PR res: [0x2b6ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff7c expref: 1109 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.571404:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.571404:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.571405:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c51228 lrc: 3/0,1 mode: PW/PW res: [0x2b6ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.571408:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c51228 lrc: 4/0,1 mode: PW/PW res: [0x2b6ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.571415:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.571422:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ccd58b65 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1108:41278:x1731746396324096:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 69us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.571425:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12239 00000100:00100000:1.0:1651529344.571433:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+955:39029:x1731745946442944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 909us (1061us total) trans 12885079509 rc 0/0 00010000:00010000:0.0:1651529344.571435:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059d45c45/0x3234de053c5122f lrc: 2/0,0 mode: PW/PW res: [0x2b6f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.571436:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211457 00010000:00010000:0.0:1651529344.571439:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000059d45c45 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.571440:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059d45c45/0x3234de053c5122f lrc: 2/0,0 mode: PW/PW res: [0x2b6f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.571443:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008eb0a7f4/0x3234de053c51221 lrc: 3/0,1 mode: PW/PW res: [0x2b6f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.571443:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059d45c45/0x3234de053c5122f lrc: 3/0,0 mode: PW/PW res: [0x2b6f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.571447:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008eb0a7f4/0x3234de053c51221 lrc: 3/0,1 mode: PW/PW res: [0x2b6f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.571447:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059d45c45/0x3234de053c5122f lrc: 1/0,0 mode: --/PW res: [0x2b6f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.571450:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008eb0a7f4/0x3234de053c51221 lrc: 3/0,1 mode: PW/PW res: [0x2b6f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.571450:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059d45c45/0x3234de053c5122f lrc: 0/0,0 mode: --/PW res: [0x2b6f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.571452:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008eb0a7f4/0x3234de053c51221 lrc: 2/0,0 mode: PW/PW res: [0x2b6f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.571455:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c51228 lrc: 3/0,1 mode: PW/PW res: [0x2b6ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.571458:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c51228 lrc: 3/0,1 mode: PW/PW res: [0x2b6ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.571473:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c51228 lrc: 3/0,1 mode: PW/PW res: [0x2b6ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.571476:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c51228 lrc: 2/0,0 mode: PW/PW res: [0x2b6ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.571491:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+955:39030:x1731745946442880:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1011us (1144us total) trans 12885079510 rc 0/0 00000100:00100000:1.0:1651529344.571495:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211455 00010000:00010000:1.0:1651529344.571501:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bfb26db5/0x3234de053c5121a lrc: 3/0,1 mode: PW/PW res: [0x2b6ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.571504:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bfb26db5/0x3234de053c5121a lrc: 3/0,1 mode: PW/PW res: [0x2b6ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.571507:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfb26db5/0x3234de053c5121a lrc: 3/0,1 mode: PW/PW res: [0x2b6ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.571510:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bfb26db5/0x3234de053c5121a lrc: 2/0,0 mode: PW/PW res: [0x2b6ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.571515:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+955:39029:x1731745946442816:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 994us (1159us total) trans 12885079511 rc 0/0 00000100:00100000:0.0:1651529344.571525:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211456 00010000:00010000:0.0:1651529344.571533:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008eb0a7f4/0x3234de053c51221 lrc: 2/0,0 mode: PW/PW res: [0x2b6f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.571538:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008eb0a7f4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.571540:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008eb0a7f4/0x3234de053c51221 lrc: 2/0,0 mode: PW/PW res: [0x2b6f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.571542:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008eb0a7f4/0x3234de053c51221 lrc: 3/0,0 mode: PW/PW res: [0x2b6f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.571545:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+955:39029:x1731745946442688:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1122us (1211us total) trans 12885079512 rc 0/0 00010000:00010000:0.0:1651529344.571547:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008eb0a7f4/0x3234de053c51221 lrc: 1/0,0 mode: --/PW res: [0x2b6f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.571548:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211454 00010000:00010000:0.0:1651529344.571550:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008eb0a7f4/0x3234de053c51221 lrc: 0/0,0 mode: --/PW res: [0x2b6f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.571554:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c51228 lrc: 2/0,0 mode: PW/PW res: [0x2b6ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.571556:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cdc65e28 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.571557:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c51228 lrc: 2/0,0 mode: PW/PW res: [0x2b6ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.571558:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000999005e pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997000064:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.571560:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c51228 lrc: 3/0,0 mode: PW/PW res: [0x2b6ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.571562:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dbb69211/0x3234de053c5123d lrc: 3/0,1 mode: --/PW res: [0x2b6f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.571563:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c51228 lrc: 1/0,0 mode: --/PW res: [0x2b6ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.571565:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c51228 lrc: 0/0,0 mode: --/PW res: [0x2b6ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.571568:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005ea32140 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997000192:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.571569:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bfb26db5/0x3234de053c5121a lrc: 2/0,0 mode: PW/PW res: [0x2b6ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.571570:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a5b283df/0x3234de053c51244 lrc: 3/0,1 mode: --/PW res: [0x2b6f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.571572:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bfb26db5 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.571573:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfb26db5/0x3234de053c5121a lrc: 2/0,0 mode: PW/PW res: [0x2b6ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.571575:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfb26db5/0x3234de053c5121a lrc: 3/0,0 mode: PW/PW res: [0x2b6ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.571578:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bfb26db5/0x3234de053c5121a lrc: 1/0,0 mode: --/PW res: [0x2b6ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.571581:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfb26db5/0x3234de053c5121a lrc: 0/0,0 mode: --/PW res: [0x2b6ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.571585:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.571603:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.571614:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.571628:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396324160 00010000:00010000:0.0:1651529344.571634:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c7243a53/0x3234de053c4d917 lrc: 4/0,0 mode: PR/PR res: [0x2b6f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1540 expref: 1108 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.571644:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396324224 00010000:00010000:0.0:1651529344.571647:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009ed6a85f/0x3234de053c4dade lrc: 4/0,0 mode: PR/PR res: [0x2b6f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ba6 expref: 1109 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.571651:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396324288 00010000:00010000:0.0:1651529344.571653:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000352c04c3/0x3234de053c4dba9 lrc: 4/0,0 mode: PR/PR res: [0x2b6f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1eb6 expref: 1110 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.571660:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12240 00000100:00100000:0.0:1651529344.571662:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ea32140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1110:41278:x1731746396324160:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.571665:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.571666:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c7243a53/0x3234de053c4d917 lrc: 4/0,0 mode: PR/PR res: [0x2b6f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1540 expref: 1110 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.571670:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c7243a53/0x3234de053c4d917 lrc: 3/0,0 mode: PR/PR res: [0x2b6f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1540 expref: 1110 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.571673:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12241 00000100:00100000:1.0:1651529344.571675:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfc79d4e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1110:41279:x1731746396324224:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.571675:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7243a53/0x3234de053c4d917 lrc: 0/0,0 mode: --/PR res: [0x2b6f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1540 expref: 1110 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.571679:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.571681:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009ed6a85f/0x3234de053c4dade lrc: 4/0,0 mode: PR/PR res: [0x2b6f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ba6 expref: 1110 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.571685:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009ed6a85f/0x3234de053c4dade lrc: 3/0,0 mode: PR/PR res: [0x2b6f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ba6 expref: 1110 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.571691:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ed6a85f/0x3234de053c4dade lrc: 0/0,0 mode: --/PR res: [0x2b6f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ba6 expref: 1110 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.571695:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.571696:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.571697:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c51236 lrc: 3/0,1 mode: PW/PW res: [0x2b6f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.571700:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c51236 lrc: 4/0,1 mode: PW/PW res: [0x2b6f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.571705:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.571706:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.571707:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dbb69211/0x3234de053c5123d lrc: 3/0,1 mode: PW/PW res: [0x2b6f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.571709:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.571716:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dbb69211/0x3234de053c5123d lrc: 4/0,1 mode: PW/PW res: [0x2b6f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.571719:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfc79d4e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1108:41279:x1731746396324224:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 43us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.571723:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12241 00010000:00010000:0.0:1651529344.571730:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.571744:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12242 00000100:00100000:1.0:1651529344.571746:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005914c920 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1107:41278:x1731746396324288:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.571747:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ea32140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1107:41278:x1731746396324160:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 84us (161us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.571749:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.571750:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12240 00010000:00010000:1.0:1651529344.571751:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000352c04c3/0x3234de053c4dba9 lrc: 4/0,0 mode: PR/PR res: [0x2b6f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1eb6 expref: 1107 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.571754:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000352c04c3/0x3234de053c4dba9 lrc: 3/0,0 mode: PR/PR res: [0x2b6f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1eb6 expref: 1106 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.571758:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c51236 lrc: 3/0,1 mode: PW/PW res: [0x2b6f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.571760:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000352c04c3/0x3234de053c4dba9 lrc: 0/0,0 mode: --/PR res: [0x2b6f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1eb6 expref: 1106 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.571761:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c51236 lrc: 3/0,1 mode: PW/PW res: [0x2b6f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.571763:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.571764:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.571764:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c51236 lrc: 3/0,1 mode: PW/PW res: [0x2b6f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.571765:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a5b283df/0x3234de053c51244 lrc: 3/0,1 mode: PW/PW res: [0x2b6f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.571767:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c51236 lrc: 2/0,0 mode: PW/PW res: [0x2b6f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.571768:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5b283df/0x3234de053c51244 lrc: 4/0,1 mode: PW/PW res: [0x2b6f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.571774:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.571780:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005914c920 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1105:41278:x1731746396324288:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.571782:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12242 00010000:00010000:1.0:1651529344.571789:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dbb69211/0x3234de053c5123d lrc: 3/0,1 mode: PW/PW res: [0x2b6f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.571793:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dbb69211/0x3234de053c5123d lrc: 3/0,1 mode: PW/PW res: [0x2b6f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.571796:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dbb69211/0x3234de053c5123d lrc: 3/0,1 mode: PW/PW res: [0x2b6f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.571798:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dbb69211/0x3234de053c5123d lrc: 2/0,0 mode: PW/PW res: [0x2b6f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.571837:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+956:39029:x1731745946443072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1187us (1245us total) trans 12885079513 rc 0/0 00000100:00100000:1.0:1651529344.571848:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+956:39030:x1731745946443008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1193us (1245us total) trans 12885079514 rc 0/0 00000100:00100000:0.0:1651529344.571849:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211458 00000100:00100000:1.0:1651529344.571851:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211459 00010000:00010000:1.0:1651529344.571858:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a5b283df/0x3234de053c51244 lrc: 3/0,1 mode: PW/PW res: [0x2b6f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.571861:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5b283df/0x3234de053c51244 lrc: 3/0,1 mode: PW/PW res: [0x2b6f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.571864:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5b283df/0x3234de053c51244 lrc: 3/0,1 mode: PW/PW res: [0x2b6f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.571865:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c51236 lrc: 2/0,0 mode: PW/PW res: [0x2b6f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.571867:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5b283df/0x3234de053c51244 lrc: 2/0,0 mode: PW/PW res: [0x2b6f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.571869:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000734ecdfd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.571870:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c51236 lrc: 2/0,0 mode: PW/PW res: [0x2b6f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.571873:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c51236 lrc: 3/0,0 mode: PW/PW res: [0x2b6f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.571883:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c51236 lrc: 1/0,0 mode: --/PW res: [0x2b6f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.571886:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c51236 lrc: 0/0,0 mode: --/PW res: [0x2b6f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.571891:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dbb69211/0x3234de053c5123d lrc: 2/0,0 mode: PW/PW res: [0x2b6f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.571894:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dbb69211 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.571894:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbb69211/0x3234de053c5123d lrc: 2/0,0 mode: PW/PW res: [0x2b6f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.571897:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbb69211/0x3234de053c5123d lrc: 3/0,0 mode: PW/PW res: [0x2b6f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.571900:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dbb69211/0x3234de053c5123d lrc: 1/0,0 mode: --/PW res: [0x2b6f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.571903:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dbb69211/0x3234de053c5123d lrc: 0/0,0 mode: --/PW res: [0x2b6f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.571904:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+955:39030:x1731745946443136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1199us (1292us total) trans 12885079515 rc 0/0 00010000:00010000:0.0:1651529344.571906:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5b283df/0x3234de053c51244 lrc: 2/0,0 mode: PW/PW res: [0x2b6f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.571908:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211460 00010000:00010000:0.0:1651529344.571909:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5b283df already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.571909:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5b283df/0x3234de053c51244 lrc: 2/0,0 mode: PW/PW res: [0x2b6f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.571912:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5b283df/0x3234de053c51244 lrc: 3/0,0 mode: PW/PW res: [0x2b6f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.571915:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5b283df/0x3234de053c51244 lrc: 1/0,0 mode: --/PW res: [0x2b6f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.571918:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5b283df/0x3234de053c51244 lrc: 0/0,0 mode: --/PW res: [0x2b6f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.571943:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.571959:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.571971:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946443712 00000100:00100000:1.0:1651529344.571975:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.571986:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946443776 00000100:00100000:0.0:1651529344.571991:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946443840 00000100:00100000:1.0:1651529344.571992:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.572001:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946443968 00000100:00100000:1.0:1651529344.572007:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.572017:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946443904 00000100:00100000:1.0:1651529344.572026:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211461 00000100:00100000:1.0:1651529344.572028:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007fca8239 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+959:39029:x1731745946443712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.572033:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211462 00002000:00080000:1.0:1651529344.572034:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177909 count 1 00000100:00100000:0.0:1651529344.572035:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+959:39030:x1731745946443776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.572038:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c5124b lrc: 3/0,1 mode: --/PW res: [0x2b6f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.572041:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177910 count 1 00010000:00010000:1.0:1651529344.572043:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c4cd78 lrc: 2/0,0 mode: PR/PR res: [0x2b6f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce7ea expref: 1104 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.572045:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51252 lrc: 3/0,1 mode: --/PW res: [0x2b6f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.572046:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.572046:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.572047:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c5124b lrc: 4/0,1 mode: --/PW res: [0x2b6f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572050:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000a69779d/0x3234de053c4caca lrc: 2/0,0 mode: PR/PR res: [0x2b6f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdcfa expref: 1104 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.572053:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.572054:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c4cd78 lrc: 3/0,0 mode: PR/PR res: [0x2b6f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce7ea expref: 1104 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.572054:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.572054:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51252 lrc: 4/0,1 mode: --/PW res: [0x2b6f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.572057:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c4cd78 lrc: 4/0,0 mode: PR/PR res: [0x2b6f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce7ea expref: 1104 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.572061:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000a69779d/0x3234de053c4caca lrc: 3/0,0 mode: PR/PR res: [0x2b6f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdcfa expref: 1104 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.572064:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000054e3a257 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997000256:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.572065:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000a69779d/0x3234de053c4caca lrc: 4/0,0 mode: PR/PR res: [0x2b6f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdcfa expref: 1104 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.572072:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000078f9a278 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997000320:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.572077:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8a0b704 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.572084:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211463 00000100:00100000:1.0:1651529344.572086:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+959:39029:x1731745946443840:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.572088:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060852af0 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.572090:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177911 count 1 00010000:00010000:1.0:1651529344.572094:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098834c70/0x3234de053c51259 lrc: 3/0,1 mode: --/PW res: [0x2b6f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.572098:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001da137ec/0x3234de053c4bb57 lrc: 2/0,0 mode: PR/PR res: [0x2b6f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc54c expref: 1104 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.572101:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.572102:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.572102:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098834c70/0x3234de053c51259 lrc: 4/0,1 mode: --/PW res: [0x2b6f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.572115:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001da137ec/0x3234de053c4bb57 lrc: 3/0,0 mode: PR/PR res: [0x2b6f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc54c expref: 1104 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.572119:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001da137ec/0x3234de053c4bb57 lrc: 4/0,0 mode: PR/PR res: [0x2b6f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc54c expref: 1104 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.572123:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009acffcb8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997000384:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.572130:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a6b79b05 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.572130:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211464 00000100:00100000:0.0:1651529344.572132:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+959:39030:x1731745946443904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.572137:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177912 count 1 00010000:00010000:0.0:1651529344.572141:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51260 lrc: 3/0,1 mode: --/PW res: [0x2b6f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.572144:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211465 00000100:00100000:1.0:1651529344.572146:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+959:39029:x1731745946443968:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.572146:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a73cb925/0x3234de053c4db47 lrc: 2/0,0 mode: PR/PR res: [0x2b6f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d2e expref: 1104 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.572149:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.572149:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.572150:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51260 lrc: 4/0,1 mode: --/PW res: [0x2b6f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.572151:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177913 count 1 00010000:00010000:1.0:1651529344.572154:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031f35bc4/0x3234de053c51267 lrc: 3/0,1 mode: --/PW res: [0x2b6f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572157:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a73cb925/0x3234de053c4db47 lrc: 3/0,0 mode: PR/PR res: [0x2b6f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d2e expref: 1104 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.572158:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004dc838b8/0x3234de053c4da67 lrc: 2/0,0 mode: PR/PR res: [0x2b6f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a2c expref: 1104 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.572160:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a73cb925/0x3234de053c4db47 lrc: 4/0,0 mode: PR/PR res: [0x2b6f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d2e expref: 1104 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.572161:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.572162:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.572163:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031f35bc4/0x3234de053c51267 lrc: 4/0,1 mode: --/PW res: [0x2b6f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.572164:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000059363096 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997000448:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.572169:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004dc838b8/0x3234de053c4da67 lrc: 3/0,0 mode: PR/PR res: [0x2b6f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a2c expref: 1104 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.572172:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004dc838b8/0x3234de053c4da67 lrc: 4/0,0 mode: PR/PR res: [0x2b6f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a2c expref: 1104 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.572172:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 0000000076b354b3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.572176:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003e8ef62e pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997000512:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.572183:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 0000000071742acc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.572188:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.572199:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.572212:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.572219:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946444096 00000100:00100000:0.0:1651529344.572242:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946444032 00000100:00100000:0.0:1651529344.572246:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946444160 00000100:00100000:0.0:1651529344.572250:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211466 00000100:00100000:0.0:1651529344.572252:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+962:39029:x1731745946444096:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.572257:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177915 count 1 00010000:00010000:0.0:1651529344.572261:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c5126e lrc: 3/0,1 mode: --/PW res: [0x2b6fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572265:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000b940763/0x3234de053c4d72d lrc: 2/0,0 mode: PR/PR res: [0x2b6fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e5c expref: 1104 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.572271:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211467 00000100:00100000:1.0:1651529344.572273:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+962:39030:x1731745946444032:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.572278:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177914 count 1 00010000:00010000:1.0:1651529344.572283:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b1677ad/0x3234de053c51275 lrc: 3/0,1 mode: --/PW res: [0x2b6fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572285:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.572285:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.572286:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c5126e lrc: 4/0,1 mode: --/PW res: [0x2b6fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.572290:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008dec4239/0x3234de053c4c616 lrc: 2/0,0 mode: PR/PR res: [0x2b6fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca4d expref: 1104 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.572293:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.572293:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.572294:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b1677ad/0x3234de053c51275 lrc: 4/0,1 mode: --/PW res: [0x2b6fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572294:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000b940763/0x3234de053c4d72d lrc: 3/0,0 mode: PR/PR res: [0x2b6fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e5c expref: 1104 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.572297:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000b940763/0x3234de053c4d72d lrc: 4/0,0 mode: PR/PR res: [0x2b6fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e5c expref: 1104 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.572301:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008dec4239/0x3234de053c4c616 lrc: 3/0,0 mode: PR/PR res: [0x2b6fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca4d expref: 1104 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.572301:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004a6776b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997000576:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.572304:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008dec4239/0x3234de053c4c616 lrc: 4/0,0 mode: PR/PR res: [0x2b6fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca4d expref: 1104 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.572308:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c43262d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997000640:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.572312:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 000000000e7e66c4 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.572316:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aeda71fe going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.572318:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211468 00000100:00100000:0.0:1651529344.572320:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+962:39030:x1731745946444160:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.572325:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177916 count 1 00010000:00010000:0.0:1651529344.572328:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008fba62e/0x3234de053c5127c lrc: 3/0,1 mode: --/PW res: [0x2b6fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572332:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000085fe1d35/0x3234de053c4f59c lrc: 2/0,0 mode: PR/PR res: [0x2b6fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d88dc expref: 1104 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.572335:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.572336:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.572337:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008fba62e/0x3234de053c5127c lrc: 4/0,1 mode: --/PW res: [0x2b6fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572343:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000085fe1d35/0x3234de053c4f59c lrc: 3/0,0 mode: PR/PR res: [0x2b6fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d88dc expref: 1104 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.572346:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000085fe1d35/0x3234de053c4f59c lrc: 4/0,0 mode: PR/PR res: [0x2b6fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d88dc expref: 1104 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.572374:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000089d7f5d6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997000704:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.572393:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 000000000a4def41 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.572433:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000054e3a257 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997000256:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.572435:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000078f9a278 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997000320:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.572438:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c5124b lrc: 3/0,1 mode: --/PW res: [0x2b6f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572439:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51252 lrc: 3/0,1 mode: --/PW res: [0x2b6f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.572455:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009acffcb8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997000384:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.572464:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000098834c70/0x3234de053c51259 lrc: 3/0,1 mode: --/PW res: [0x2b6f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.572504:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000059363096 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997000448:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.572508:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51260 lrc: 3/0,1 mode: --/PW res: [0x2b6f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.572676:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.572682:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.572688:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.572695:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.572706:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396324864 00000100:00100000:1.0:1651529344.572707:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.572712:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c4cd78 lrc: 4/0,0 mode: PR/PR res: [0x2b6f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce7ea expref: 1105 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.572714:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003e8ef62e pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997000512:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.572717:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396324992 00010000:00010000:1.0:1651529344.572718:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000031f35bc4/0x3234de053c51267 lrc: 3/0,1 mode: --/PW res: [0x2b6f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572720:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001da137ec/0x3234de053c4bb57 lrc: 4/0,0 mode: PR/PR res: [0x2b6f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc54c expref: 1106 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.572724:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396324928 00000100:00100000:1.0:1651529344.572726:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396325120 00010000:00010000:0.0:1651529344.572726:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000a69779d/0x3234de053c4caca lrc: 4/0,0 mode: PR/PR res: [0x2b6f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdcfa expref: 1107 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.572730:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004dc838b8/0x3234de053c4da67 lrc: 4/0,0 mode: PR/PR res: [0x2b6f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a2c expref: 1108 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.572730:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396325056 00010000:00010000:0.0:1651529344.572732:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a73cb925/0x3234de053c4db47 lrc: 4/0,0 mode: PR/PR res: [0x2b6f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d2e expref: 1109 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.572748:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12243 00000100:00100000:1.0:1651529344.572750:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1109:41279:x1731746396324864:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.572750:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12244 00000100:00100000:0.0:1651529344.572752:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1109:41279:x1731746396324992:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.572753:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.572754:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c4cd78 lrc: 4/0,0 mode: PR/PR res: [0x2b6f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce7ea expref: 1109 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.572755:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.572757:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001da137ec/0x3234de053c4bb57 lrc: 4/0,0 mode: PR/PR res: [0x2b6f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc54c expref: 1109 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.572758:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c4cd78 lrc: 3/0,0 mode: PR/PR res: [0x2b6f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce7ea expref: 1109 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.572761:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001da137ec/0x3234de053c4bb57 lrc: 3/0,0 mode: PR/PR res: [0x2b6f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc54c expref: 1109 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.572764:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c4cd78 lrc: 0/0,0 mode: --/PR res: [0x2b6f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce7ea expref: 1109 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.572767:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001da137ec/0x3234de053c4bb57 lrc: 0/0,0 mode: --/PR res: [0x2b6f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc54c expref: 1109 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.572768:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.572769:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.572770:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c5124b lrc: 3/0,1 mode: PW/PW res: [0x2b6f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572771:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.572771:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.572772:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000098834c70/0x3234de053c51259 lrc: 3/0,1 mode: PW/PW res: [0x2b6f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.572773:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c5124b lrc: 4/0,1 mode: PW/PW res: [0x2b6f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572775:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098834c70/0x3234de053c51259 lrc: 4/0,1 mode: PW/PW res: [0x2b6f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.572780:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.572785:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.572794:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1107:41279:x1731746396324992:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.572795:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1107:41279:x1731746396324864:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 44us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.572797:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12244 00000100:00100000:1.0:1651529344.572799:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12243 00000100:00100000:0.0:1651529344.572802:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12245 00000100:00100000:1.0:1651529344.572804:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12246 00000100:00100000:0.0:1651529344.572804:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1105:41278:x1731746396324928:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.572806:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6d06412 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1105:41279:x1731746396325120:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.572806:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.572808:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.572808:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000a69779d/0x3234de053c4caca lrc: 4/0,0 mode: PR/PR res: [0x2b6f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdcfa expref: 1105 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.572810:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004dc838b8/0x3234de053c4da67 lrc: 4/0,0 mode: PR/PR res: [0x2b6f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a2c expref: 1105 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.572811:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000a69779d/0x3234de053c4caca lrc: 3/0,0 mode: PR/PR res: [0x2b6f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdcfa expref: 1105 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.572813:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004dc838b8/0x3234de053c4da67 lrc: 3/0,0 mode: PR/PR res: [0x2b6f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a2c expref: 1105 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.572816:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a69779d/0x3234de053c4caca lrc: 0/0,0 mode: --/PR res: [0x2b6f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdcfa expref: 1105 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.572818:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004dc838b8/0x3234de053c4da67 lrc: 0/0,0 mode: --/PR res: [0x2b6f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a2c expref: 1105 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.572820:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.572820:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.572821:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51252 lrc: 3/0,1 mode: PW/PW res: [0x2b6f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.572822:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.572822:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.572823:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000031f35bc4/0x3234de053c51267 lrc: 3/0,1 mode: PW/PW res: [0x2b6f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572824:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51252 lrc: 4/0,1 mode: PW/PW res: [0x2b6f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.572826:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031f35bc4/0x3234de053c51267 lrc: 4/0,1 mode: PW/PW res: [0x2b6f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572830:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.572834:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.572834:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1103:41278:x1731746396324928:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 30us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.572837:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12245 00000100:00100000:1.0:1651529344.572839:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6d06412 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1102:41279:x1731746396325120:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 33us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.572841:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12247 00000100:00100000:1.0:1651529344.572842:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12246 00000100:00100000:0.0:1651529344.572842:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1102:41278:x1731746396325056:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.572844:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.572846:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a73cb925/0x3234de053c4db47 lrc: 4/0,0 mode: PR/PR res: [0x2b6f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d2e expref: 1101 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.572849:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a73cb925/0x3234de053c4db47 lrc: 3/0,0 mode: PR/PR res: [0x2b6f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d2e expref: 1101 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.572853:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c5124b lrc: 3/0,1 mode: PW/PW res: [0x2b6f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572854:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a73cb925/0x3234de053c4db47 lrc: 0/0,0 mode: --/PR res: [0x2b6f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d2e expref: 1101 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.572856:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c5124b lrc: 3/0,1 mode: PW/PW res: [0x2b6f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572857:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.572857:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.572858:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51260 lrc: 3/0,1 mode: PW/PW res: [0x2b6f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.572859:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c5124b lrc: 3/0,1 mode: PW/PW res: [0x2b6f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.572862:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c5124b lrc: 2/0,0 mode: PW/PW res: [0x2b6f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572864:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51260 lrc: 4/0,1 mode: PW/PW res: [0x2b6f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572875:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.572880:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1100:41278:x1731746396325056:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.572883:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12247 00010000:00010000:0.0:1651529344.572890:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c5124b lrc: 2/0,0 mode: PW/PW res: [0x2b6f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572893:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000009ec9189 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.572894:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c5124b lrc: 2/0,0 mode: PW/PW res: [0x2b6f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572897:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c5124b lrc: 3/0,0 mode: PW/PW res: [0x2b6f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572901:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c5124b lrc: 1/0,0 mode: --/PW res: [0x2b6f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572904:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c5124b lrc: 0/0,0 mode: --/PW res: [0x2b6f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.572908:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007fca8239 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+963:39029:x1731745946443712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 879us (965us total) trans 12885079516 rc 0/0 00010000:00010000:0.0:1651529344.572909:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51260 lrc: 3/0,1 mode: PW/PW res: [0x2b6f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.572911:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211461 00010000:00010000:0.0:1651529344.572912:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51260 lrc: 3/0,1 mode: PW/PW res: [0x2b6f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572915:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51260 lrc: 3/0,1 mode: PW/PW res: [0x2b6f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.572917:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000098834c70/0x3234de053c51259 lrc: 3/0,1 mode: PW/PW res: [0x2b6f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.572918:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51260 lrc: 2/0,0 mode: PW/PW res: [0x2b6f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.572920:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098834c70/0x3234de053c51259 lrc: 3/0,1 mode: PW/PW res: [0x2b6f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.572923:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098834c70/0x3234de053c51259 lrc: 3/0,1 mode: PW/PW res: [0x2b6f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.572926:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000098834c70/0x3234de053c51259 lrc: 2/0,0 mode: PW/PW res: [0x2b6f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.572962:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+964:39029:x1731745946443840:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 876us (987us total) trans 12885079518 rc 0/0 00000100:00100000:1.0:1651529344.572965:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211463 00010000:00010000:1.0:1651529344.572971:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000031f35bc4/0x3234de053c51267 lrc: 3/0,1 mode: PW/PW res: [0x2b6f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.572974:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031f35bc4/0x3234de053c51267 lrc: 3/0,1 mode: PW/PW res: [0x2b6f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.572978:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031f35bc4/0x3234de053c51267 lrc: 3/0,1 mode: PW/PW res: [0x2b6f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.572980:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000031f35bc4/0x3234de053c51267 lrc: 2/0,0 mode: PW/PW res: [0x2b6f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.573012:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+964:39030:x1731745946443904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 879us (1004us total) trans 12885079517 rc 0/0 00000100:00100000:0.0:1651529344.573015:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211464 00010000:00010000:0.0:1651529344.573022:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51260 lrc: 2/0,0 mode: PW/PW res: [0x2b6f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.573026:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+963:39029:x1731745946443968:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 879us (1034us total) trans 12885079519 rc 0/0 00010000:00010000:0.0:1651529344.573026:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a0607df4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.573027:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51260 lrc: 2/0,0 mode: PW/PW res: [0x2b6f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.573029:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211465 00010000:00010000:0.0:1651529344.573029:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51260 lrc: 3/0,0 mode: PW/PW res: [0x2b6f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573034:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51260 lrc: 1/0,0 mode: --/PW res: [0x2b6f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573037:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51260 lrc: 0/0,0 mode: --/PW res: [0x2b6f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573041:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000098834c70/0x3234de053c51259 lrc: 2/0,0 mode: PW/PW res: [0x2b6f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573044:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000098834c70 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.573045:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000098834c70/0x3234de053c51259 lrc: 2/0,0 mode: PW/PW res: [0x2b6f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573059:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000098834c70/0x3234de053c51259 lrc: 3/0,0 mode: PW/PW res: [0x2b6f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573063:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000098834c70/0x3234de053c51259 lrc: 1/0,0 mode: --/PW res: [0x2b6f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573066:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098834c70/0x3234de053c51259 lrc: 0/0,0 mode: --/PW res: [0x2b6f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573075:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000031f35bc4/0x3234de053c51267 lrc: 2/0,0 mode: PW/PW res: [0x2b6f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.573078:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.573078:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000031f35bc4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.573079:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000031f35bc4/0x3234de053c51267 lrc: 2/0,0 mode: PW/PW res: [0x2b6f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573086:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000031f35bc4/0x3234de053c51267 lrc: 3/0,0 mode: PW/PW res: [0x2b6f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.573089:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.573090:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000031f35bc4/0x3234de053c51267 lrc: 1/0,0 mode: --/PW res: [0x2b6f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573092:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031f35bc4/0x3234de053c51267 lrc: 0/0,0 mode: --/PW res: [0x2b6f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.573099:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.573104:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000089d7f5d6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997000704:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.573108:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000008fba62e/0x3234de053c5127c lrc: 3/0,1 mode: --/PW res: [0x2b6fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.573114:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004a6776b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997000576:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.573117:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c5126e lrc: 3/0,1 mode: --/PW res: [0x2b6fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573121:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51252 lrc: 3/0,1 mode: PW/PW res: [0x2b6f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573124:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51252 lrc: 3/0,1 mode: PW/PW res: [0x2b6f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573127:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51252 lrc: 3/0,1 mode: PW/PW res: [0x2b6f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573129:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51252 lrc: 2/0,0 mode: PW/PW res: [0x2b6f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.573164:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c43262d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997000640:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.573168:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002b1677ad/0x3234de053c51275 lrc: 3/0,1 mode: --/PW res: [0x2b6fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.573173:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+963:39030:x1731745946443776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1137us (1214us total) trans 12885079520 rc 0/0 00000100:00100000:0.0:1651529344.573176:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211462 00000100:00100000:1.0:1651529344.573181:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396325248 00010000:00010000:1.0:1651529344.573185:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008dec4239/0x3234de053c4c616 lrc: 4/0,0 mode: PR/PR res: [0x2b6fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca4d expref: 1100 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.573192:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396325184 00010000:00010000:1.0:1651529344.573194:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000b940763/0x3234de053c4d72d lrc: 4/0,0 mode: PR/PR res: [0x2b6fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e5c expref: 1101 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.573198:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396325376 00010000:00010000:0.0:1651529344.573198:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51252 lrc: 2/0,0 mode: PW/PW res: [0x2b6f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573200:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000085fe1d35/0x3234de053c4f59c lrc: 4/0,0 mode: PR/PR res: [0x2b6fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d88dc expref: 1102 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.573205:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12248 00010000:00010000:0.0:1651529344.573205:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eb50e2ae already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.573206:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51252 lrc: 2/0,0 mode: PW/PW res: [0x2b6f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.573207:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfc79d4e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1102:41279:x1731746396325248:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.573208:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51252 lrc: 3/0,0 mode: PW/PW res: [0x2b6f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573209:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.573210:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008dec4239/0x3234de053c4c616 lrc: 4/0,0 mode: PR/PR res: [0x2b6fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca4d expref: 1102 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.573214:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008dec4239/0x3234de053c4c616 lrc: 3/0,0 mode: PR/PR res: [0x2b6fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca4d expref: 1102 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.573219:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008dec4239/0x3234de053c4c616 lrc: 0/0,0 mode: --/PR res: [0x2b6fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca4d expref: 1102 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.573238:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.573239:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.573240:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002b1677ad/0x3234de053c51275 lrc: 3/0,1 mode: PW/PW res: [0x2b6fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573240:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51252 lrc: 1/0,0 mode: --/PW res: [0x2b6f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573243:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b1677ad/0x3234de053c51275 lrc: 4/0,1 mode: PW/PW res: [0x2b6fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573243:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51252 lrc: 0/0,0 mode: --/PW res: [0x2b6f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573249:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.573254:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12249 00000100:00100000:0.0:1651529344.573256:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ea32140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1101:41279:x1731746396325184:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.573257:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfc79d4e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1101:41279:x1731746396325248:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 49us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.573259:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12248 00010000:00010000:0.0:1651529344.573260:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.573261:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000b940763/0x3234de053c4d72d lrc: 4/0,0 mode: PR/PR res: [0x2b6fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e5c expref: 1101 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.573264:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12250 00010000:00010000:0.0:1651529344.573265:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000b940763/0x3234de053c4d72d lrc: 3/0,0 mode: PR/PR res: [0x2b6fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e5c expref: 1100 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.573266:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005914c920 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1100:41279:x1731746396325376:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.573268:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.573270:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000085fe1d35/0x3234de053c4f59c lrc: 4/0,0 mode: PR/PR res: [0x2b6fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d88dc expref: 1100 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.573270:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b940763/0x3234de053c4d72d lrc: 0/0,0 mode: --/PR res: [0x2b6fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e5c expref: 1100 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.573274:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000085fe1d35/0x3234de053c4f59c lrc: 3/0,0 mode: PR/PR res: [0x2b6fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d88dc expref: 1100 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.573276:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.573277:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.573278:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085fe1d35/0x3234de053c4f59c lrc: 0/0,0 mode: --/PR res: [0x2b6fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d88dc expref: 1099 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.573278:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c5126e lrc: 3/0,1 mode: PW/PW res: [0x2b6fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573281:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c5126e lrc: 4/0,1 mode: PW/PW res: [0x2b6fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573282:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.573283:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.573283:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000008fba62e/0x3234de053c5127c lrc: 3/0,1 mode: PW/PW res: [0x2b6fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573287:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.573288:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008fba62e/0x3234de053c5127c lrc: 4/0,1 mode: PW/PW res: [0x2b6fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.573294:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ea32140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1098:41279:x1731746396325184:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 38us (205us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.573297:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.573302:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005914c920 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1098:41279:x1731746396325376:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.573304:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12249 00000100:00100000:1.0:1651529344.573305:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12250 00010000:00010000:0.0:1651529344.573311:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000008fba62e/0x3234de053c5127c lrc: 3/0,1 mode: PW/PW res: [0x2b6fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573313:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002b1677ad/0x3234de053c51275 lrc: 3/0,1 mode: PW/PW res: [0x2b6fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573314:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008fba62e/0x3234de053c5127c lrc: 3/0,1 mode: PW/PW res: [0x2b6fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573316:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b1677ad/0x3234de053c51275 lrc: 3/0,1 mode: PW/PW res: [0x2b6fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573317:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008fba62e/0x3234de053c5127c lrc: 3/0,1 mode: PW/PW res: [0x2b6fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573319:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b1677ad/0x3234de053c51275 lrc: 3/0,1 mode: PW/PW res: [0x2b6fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573320:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008fba62e/0x3234de053c5127c lrc: 2/0,0 mode: PW/PW res: [0x2b6fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573321:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b1677ad/0x3234de053c51275 lrc: 2/0,0 mode: PW/PW res: [0x2b6fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.573362:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+964:39030:x1731745946444032:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1088us (1163us total) trans 12885079521 rc 0/0 00000100:00100000:1.0:1651529344.573365:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211467 00000100:00100000:0.0:1651529344.573387:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+963:39030:x1731745946444160:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1066us (1175us total) trans 12885079522 rc 0/0 00000100:00100000:0.0:1651529344.573391:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211468 00010000:00010000:0.0:1651529344.573398:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008fba62e/0x3234de053c5127c lrc: 2/0,0 mode: PW/PW res: [0x2b6fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.573400:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.573402:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000008fba62e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.573403:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008fba62e/0x3234de053c5127c lrc: 2/0,0 mode: PW/PW res: [0x2b6fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573413:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008fba62e/0x3234de053c5127c lrc: 3/0,0 mode: PW/PW res: [0x2b6fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.573417:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.573418:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008fba62e/0x3234de053c5127c lrc: 1/0,0 mode: --/PW res: [0x2b6fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573420:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008fba62e/0x3234de053c5127c lrc: 0/0,0 mode: --/PW res: [0x2b6fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573424:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b1677ad/0x3234de053c51275 lrc: 2/0,0 mode: PW/PW res: [0x2b6fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573427:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002b1677ad already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.573428:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.573428:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b1677ad/0x3234de053c51275 lrc: 2/0,0 mode: PW/PW res: [0x2b6fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573435:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b1677ad/0x3234de053c51275 lrc: 3/0,0 mode: PW/PW res: [0x2b6fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573439:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b1677ad/0x3234de053c51275 lrc: 1/0,0 mode: --/PW res: [0x2b6fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.573441:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.573444:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b1677ad/0x3234de053c51275 lrc: 0/0,0 mode: --/PW res: [0x2b6fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573450:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c5126e lrc: 3/0,1 mode: PW/PW res: [0x2b6fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573453:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c5126e lrc: 3/0,1 mode: PW/PW res: [0x2b6fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573456:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c5126e lrc: 3/0,1 mode: PW/PW res: [0x2b6fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573459:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c5126e lrc: 2/0,0 mode: PW/PW res: [0x2b6fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.573473:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946444928 00000100:00100000:1.0:1651529344.573484:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946445056 00000100:00100000:1.0:1651529344.573488:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946444864 00000100:00100000:1.0:1651529344.573491:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946444992 00000100:00100000:1.0:1651529344.573497:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211469 00000100:00100000:1.0:1651529344.573498:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+967:39030:x1731745946444928:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.573503:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177918 count 1 00010000:00010000:1.0:1651529344.573508:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7308f91/0x3234de053c51283 lrc: 3/0,1 mode: --/PW res: [0x2b6fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573518:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e993192b/0x3234de053c4f541 lrc: 2/0,0 mode: PR/PR res: [0x2b6fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8762 expref: 1096 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.573522:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.573522:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.573523:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7308f91/0x3234de053c51283 lrc: 4/0,1 mode: --/PW res: [0x2b6fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.573523:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+967:39029:x1731745946444096:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1270us (1335us total) trans 12885079523 rc 0/0 00000100:00100000:0.0:1651529344.573526:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211466 00010000:00010000:1.0:1651529344.573530:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e993192b/0x3234de053c4f541 lrc: 3/0,0 mode: PR/PR res: [0x2b6fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8762 expref: 1096 pid: 156655 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.573532:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211470 00010000:00010000:1.0:1651529344.573533:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e993192b/0x3234de053c4f541 lrc: 4/0,0 mode: PR/PR res: [0x2b6fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8762 expref: 1096 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.573533:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+966:39030:x1731745946445056:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.573538:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003e8ef62e pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997000768:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.573539:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177920 count 1 00010000:00010000:0.0:1651529344.573543:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c5128a lrc: 3/0,1 mode: --/PW res: [0x2b700:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.573546:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 0000000053a0cffa going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.573548:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cf6fe39b/0x3234de053c4da91 lrc: 2/0,0 mode: PR/PR res: [0x2b700:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1aaa expref: 1096 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.573552:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211471 00010000:00010000:0.0:1651529344.573553:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.573554:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+966:39029:x1731745946444864:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.573554:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.573555:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c5128a lrc: 4/0,1 mode: --/PW res: [0x2b700:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.573559:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177917 count 1 00010000:00010000:0.0:1651529344.573561:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cf6fe39b/0x3234de053c4da91 lrc: 3/0,0 mode: PR/PR res: [0x2b700:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1aaa expref: 1096 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.573562:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b6ece5d/0x3234de053c51291 lrc: 3/0,1 mode: --/PW res: [0x2b6fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573565:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cf6fe39b/0x3234de053c4da91 lrc: 4/0,0 mode: PR/PR res: [0x2b700:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1aaa expref: 1096 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.573566:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005db13f7e/0x3234de053c4e924 lrc: 2/0,0 mode: PR/PR res: [0x2b6fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d55b3 expref: 1096 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.573569:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.573569:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004a6776b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997000832:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.573570:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.573570:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b6ece5d/0x3234de053c51291 lrc: 4/0,1 mode: --/PW res: [0x2b6fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573577:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005db13f7e/0x3234de053c4e924 lrc: 3/0,0 mode: PR/PR res: [0x2b6fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d55b3 expref: 1096 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.573578:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e1aa6a77 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.573580:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005db13f7e/0x3234de053c4e924 lrc: 4/0,0 mode: PR/PR res: [0x2b6fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d55b3 expref: 1096 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.573584:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a130088 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997000896:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.573585:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211472 00000100:00100000:0.0:1651529344.573587:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+966:39029:x1731745946444992:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.573590:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f9dac3f6 going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.573591:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177919 count 1 00010000:00010000:0.0:1651529344.573594:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c51298 lrc: 3/0,1 mode: --/PW res: [0x2b6ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573598:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002f987e7d/0x3234de053c4e852 lrc: 2/0,0 mode: PR/PR res: [0x2b6ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d522c expref: 1096 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.573617:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.573618:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.573619:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c51298 lrc: 4/0,1 mode: --/PW res: [0x2b6ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573628:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002f987e7d/0x3234de053c4e852 lrc: 3/0,0 mode: PR/PR res: [0x2b6ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d522c expref: 1096 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.573632:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002f987e7d/0x3234de053c4e852 lrc: 4/0,0 mode: PR/PR res: [0x2b6ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d522c expref: 1096 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.573636:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000089d7f5d6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997000960:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.573644:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 0000000029ae2bb2 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.573648:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.573650:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c5126e lrc: 2/0,0 mode: PW/PW res: [0x2b6fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573660:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006c0ed60a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.573661:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c5126e lrc: 2/0,0 mode: PW/PW res: [0x2b6fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.573664:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.573664:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c5126e lrc: 3/0,0 mode: PW/PW res: [0x2b6fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573669:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c5126e lrc: 1/0,0 mode: --/PW res: [0x2b6fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573672:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c5126e lrc: 0/0,0 mode: --/PW res: [0x2b6fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.573674:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.573679:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946445120 00000100:00100000:0.0:1651529344.573686:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946445184 00000100:00100000:0.0:1651529344.573693:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946445248 00000100:00100000:0.0:1651529344.573698:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211473 00000100:00100000:0.0:1651529344.573699:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+969:39029:x1731745946445120:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.573704:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177921 count 1 00000100:00100000:1.0:1651529344.573707:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211474 00010000:00010000:0.0:1651529344.573707:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c5129f lrc: 3/0,1 mode: --/PW res: [0x2b701:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.573709:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+969:39030:x1731745946445184:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.573711:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b1848133/0x3234de053c4f3dc lrc: 2/0,0 mode: PR/PR res: [0x2b701:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81ea expref: 1096 pid: 72396 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.573714:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177922 count 1 00010000:00010000:0.0:1651529344.573714:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.573715:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.573715:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c5129f lrc: 4/0,1 mode: --/PW res: [0x2b701:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573718:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec163e8e/0x3234de053c512a6 lrc: 3/0,1 mode: --/PW res: [0x2b702:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573723:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000954b1161/0x3234de053c4dfbc lrc: 2/0,0 mode: PR/PR res: [0x2b702:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d304b expref: 1096 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.573726:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.573726:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.573727:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec163e8e/0x3234de053c512a6 lrc: 4/0,1 mode: --/PW res: [0x2b702:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573734:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000954b1161/0x3234de053c4dfbc lrc: 3/0,0 mode: PR/PR res: [0x2b702:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d304b expref: 1096 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.573751:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000954b1161/0x3234de053c4dfbc lrc: 4/0,0 mode: PR/PR res: [0x2b702:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d304b expref: 1096 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.573754:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b1848133/0x3234de053c4f3dc lrc: 3/0,0 mode: PR/PR res: [0x2b701:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81ea expref: 1096 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.573756:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d718cfe4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997001024:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.573758:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b1848133/0x3234de053c4f3dc lrc: 4/0,0 mode: PR/PR res: [0x2b701:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81ea expref: 1096 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.573762:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000059363096 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997001088:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.573764:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cfa1ca05 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.573771:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211475 00000100:00100000:1.0:1651529344.573772:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+969:39029:x1731745946445248:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.573772:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000504ef660 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.573777:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177923 count 1 00010000:00010000:1.0:1651529344.573780:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ff3021f/0x3234de053c512ad lrc: 3/0,1 mode: --/PW res: [0x2b703:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573784:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000058742c0b/0x3234de053c4e78e lrc: 2/0,0 mode: PR/PR res: [0x2b703:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4ed6 expref: 1096 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.573788:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.573788:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.573788:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.573789:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ff3021f/0x3234de053c512ad lrc: 4/0,1 mode: --/PW res: [0x2b703:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573795:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000058742c0b/0x3234de053c4e78e lrc: 3/0,0 mode: PR/PR res: [0x2b703:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4ed6 expref: 1096 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.573799:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000058742c0b/0x3234de053c4e78e lrc: 4/0,0 mode: PR/PR res: [0x2b703:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4ed6 expref: 1096 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.573803:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005a17dd72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997001152:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.573809:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d09f5ee1 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.573814:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946445312 00000100:00100000:1.0:1651529344.573850:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211476 00000100:00100000:1.0:1651529344.573851:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+970:39029:x1731745946445312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.573856:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177924 count 1 00010000:00010000:1.0:1651529344.573860:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000896a135f/0x3234de053c512b4 lrc: 3/0,1 mode: --/PW res: [0x2b704:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573864:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c4df3e lrc: 2/0,0 mode: PR/PR res: [0x2b704:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e29 expref: 1096 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.573868:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.573868:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.573869:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000896a135f/0x3234de053c512b4 lrc: 4/0,1 mode: --/PW res: [0x2b704:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.573875:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c4df3e lrc: 3/0,0 mode: PR/PR res: [0x2b704:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e29 expref: 1096 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.573885:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c4df3e lrc: 4/0,0 mode: PR/PR res: [0x2b704:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e29 expref: 1096 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.573889:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006647e4ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997001216:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.573898:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd96f074 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.573906:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003e8ef62e pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997000768:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.573916:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c7308f91/0x3234de053c51283 lrc: 3/0,1 mode: --/PW res: [0x2b6fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.573950:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004a6776b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997000832:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.573963:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a130088 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997000896:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.573967:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001b6ece5d/0x3234de053c51291 lrc: 3/0,1 mode: --/PW res: [0x2b6fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.573984:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c5128a lrc: 3/0,1 mode: --/PW res: [0x2b700:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.574006:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000089d7f5d6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997000960:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.574010:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c51298 lrc: 3/0,1 mode: --/PW res: [0x2b6ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.574041:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d718cfe4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997001024:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.574049:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000059363096 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997001088:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.574052:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ec163e8e/0x3234de053c512a6 lrc: 3/0,1 mode: --/PW res: [0x2b702:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574053:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c5129f lrc: 3/0,1 mode: --/PW res: [0x2b701:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.574285:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.574308:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.574317:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.574323:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.574333:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.574333:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396325952 00000100:00100000:1.0:1651529344.574338:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.574340:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cf6fe39b/0x3234de053c4da91 lrc: 4/0,0 mode: PR/PR res: [0x2b700:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1aaa expref: 1097 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.574343:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.574346:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396325888 00000100:00100000:1.0:1651529344.574348:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.574348:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e993192b/0x3234de053c4f541 lrc: 4/0,0 mode: PR/PR res: [0x2b6fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8762 expref: 1098 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.574352:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396326080 00010000:00010000:0.0:1651529344.574355:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000954b1161/0x3234de053c4dfbc lrc: 4/0,0 mode: PR/PR res: [0x2b702:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d304b expref: 1099 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.574356:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005a17dd72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997001152:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.574359:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396326016 00010000:00010000:1.0:1651529344.574360:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000ff3021f/0x3234de053c512ad lrc: 3/0,1 mode: --/PW res: [0x2b703:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574361:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005db13f7e/0x3234de053c4e924 lrc: 4/0,0 mode: PR/PR res: [0x2b6fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d55b3 expref: 1100 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.574365:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396326208 00000100:00100000:1.0:1651529344.574367:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006647e4ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997001216:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.574367:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b1848133/0x3234de053c4f3dc lrc: 4/0,0 mode: PR/PR res: [0x2b701:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81ea expref: 1101 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.574370:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000896a135f/0x3234de053c512b4 lrc: 3/0,1 mode: --/PW res: [0x2b704:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.574371:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396326144 00010000:00010000:0.0:1651529344.574373:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002f987e7d/0x3234de053c4e852 lrc: 4/0,0 mode: PR/PR res: [0x2b6ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d522c expref: 1102 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.574375:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396326336 00000100:00100000:0.0:1651529344.574377:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396326272 00010000:00010000:0.0:1651529344.574379:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000058742c0b/0x3234de053c4e78e lrc: 4/0,0 mode: PR/PR res: [0x2b703:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4ed6 expref: 1104 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.574380:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c4df3e lrc: 4/0,0 mode: PR/PR res: [0x2b704:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e29 expref: 1104 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.574384:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12251 00000100:00100000:0.0:1651529344.574385:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1104:41278:x1731746396325952:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.574387:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12252 00010000:00010000:0.0:1651529344.574388:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.574389:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a13808c6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1104:41279:x1731746396325888:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.574390:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cf6fe39b/0x3234de053c4da91 lrc: 4/0,0 mode: PR/PR res: [0x2b700:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1aaa expref: 1104 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.574392:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.574393:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cf6fe39b/0x3234de053c4da91 lrc: 3/0,0 mode: PR/PR res: [0x2b700:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1aaa expref: 1104 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.574394:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e993192b/0x3234de053c4f541 lrc: 4/0,0 mode: PR/PR res: [0x2b6fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8762 expref: 1104 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.574397:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e993192b/0x3234de053c4f541 lrc: 3/0,0 mode: PR/PR res: [0x2b6fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8762 expref: 1104 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.574399:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf6fe39b/0x3234de053c4da91 lrc: 0/0,0 mode: --/PR res: [0x2b700:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1aaa expref: 1104 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.574402:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.574403:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e993192b/0x3234de053c4f541 lrc: 0/0,0 mode: --/PR res: [0x2b6fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8762 expref: 1103 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.574403:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.574404:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c5128a lrc: 3/0,1 mode: PW/PW res: [0x2b700:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.574407:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.574407:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.574408:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c7308f91/0x3234de053c51283 lrc: 3/0,1 mode: PW/PW res: [0x2b6fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574409:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c5128a lrc: 4/0,1 mode: PW/PW res: [0x2b700:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.574411:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7308f91/0x3234de053c51283 lrc: 4/0,1 mode: PW/PW res: [0x2b6fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574416:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.574417:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.574426:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a13808c6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1102:41279:x1731746396325888:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 36us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.574426:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1102:41278:x1731746396325952:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 40us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.574428:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12252 00000100:00100000:0.0:1651529344.574430:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12251 00000100:00100000:1.0:1651529344.574433:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12253 00000100:00100000:1.0:1651529344.574434:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040f63b09 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1100:41278:x1731746396326080:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.574435:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12254 00000100:00100000:0.0:1651529344.574436:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1100:41279:x1731746396326016:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.574437:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.574438:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000954b1161/0x3234de053c4dfbc lrc: 4/0,0 mode: PR/PR res: [0x2b702:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d304b expref: 1100 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.574439:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.574440:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005db13f7e/0x3234de053c4e924 lrc: 4/0,0 mode: PR/PR res: [0x2b6fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d55b3 expref: 1100 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.574442:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000954b1161/0x3234de053c4dfbc lrc: 3/0,0 mode: PR/PR res: [0x2b702:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d304b expref: 1100 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.574444:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005db13f7e/0x3234de053c4e924 lrc: 3/0,0 mode: PR/PR res: [0x2b6fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d55b3 expref: 1100 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.574446:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000954b1161/0x3234de053c4dfbc lrc: 0/0,0 mode: --/PR res: [0x2b702:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d304b expref: 1100 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.574449:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005db13f7e/0x3234de053c4e924 lrc: 0/0,0 mode: --/PR res: [0x2b6fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d55b3 expref: 1100 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.574450:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.574450:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.574451:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ec163e8e/0x3234de053c512a6 lrc: 3/0,1 mode: PW/PW res: [0x2b702:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574453:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.574453:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.574454:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001b6ece5d/0x3234de053c51291 lrc: 3/0,1 mode: PW/PW res: [0x2b6fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.574456:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec163e8e/0x3234de053c512a6 lrc: 4/0,1 mode: PW/PW res: [0x2b702:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574457:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b6ece5d/0x3234de053c51291 lrc: 4/0,1 mode: PW/PW res: [0x2b6fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.574462:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.574466:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040f63b09 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1098:41278:x1731746396326080:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 31us (149us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.574469:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.574475:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1098:41279:x1731746396326016:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.574476:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12253 00000100:00100000:0.0:1651529344.574478:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12254 00000100:00100000:0.0:1651529344.574483:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12255 00000100:00100000:0.0:1651529344.574484:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1096:41278:x1731746396326208:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.574485:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12256 00000100:00100000:1.0:1651529344.574487:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1096:41279:x1731746396326144:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.574487:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.574488:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b1848133/0x3234de053c4f3dc lrc: 4/0,0 mode: PR/PR res: [0x2b701:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81ea expref: 1096 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.574490:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.574491:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002f987e7d/0x3234de053c4e852 lrc: 4/0,0 mode: PR/PR res: [0x2b6ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d522c expref: 1096 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.574492:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b1848133/0x3234de053c4f3dc lrc: 3/0,0 mode: PR/PR res: [0x2b701:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81ea expref: 1096 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.574495:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002f987e7d/0x3234de053c4e852 lrc: 3/0,0 mode: PR/PR res: [0x2b6ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d522c expref: 1096 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.574496:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1848133/0x3234de053c4f3dc lrc: 0/0,0 mode: --/PR res: [0x2b701:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81ea expref: 1096 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.574499:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.574500:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f987e7d/0x3234de053c4e852 lrc: 0/0,0 mode: --/PR res: [0x2b6ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d522c expref: 1095 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.574500:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.574501:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c5129f lrc: 3/0,1 mode: PW/PW res: [0x2b701:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.574503:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.574504:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.574504:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c5129f lrc: 4/0,1 mode: PW/PW res: [0x2b701:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.574505:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c51298 lrc: 3/0,1 mode: PW/PW res: [0x2b6ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.574508:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c51298 lrc: 4/0,1 mode: PW/PW res: [0x2b6ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574510:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.574514:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1094:41278:x1731746396326208:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 29us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.574517:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12255 00010000:00010000:1.0:1651529344.574520:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.574525:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1093:41279:x1731746396326144:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 38us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.574527:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12257 00000100:00100000:1.0:1651529344.574528:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12256 00000100:00100000:0.0:1651529344.574529:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1093:41279:x1731746396326272:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.574531:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.574533:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12258 00010000:00010000:0.0:1651529344.574533:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000058742c0b/0x3234de053c4e78e lrc: 4/0,0 mode: PR/PR res: [0x2b703:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4ed6 expref: 1092 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.574535:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1092:41278:x1731746396326336:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.574537:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000058742c0b/0x3234de053c4e78e lrc: 3/0,0 mode: PR/PR res: [0x2b703:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4ed6 expref: 1092 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.574538:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.574539:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c4df3e lrc: 4/0,0 mode: PR/PR res: [0x2b704:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e29 expref: 1092 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.574541:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058742c0b/0x3234de053c4e78e lrc: 0/0,0 mode: --/PR res: [0x2b703:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4ed6 expref: 1092 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.574543:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c4df3e lrc: 3/0,0 mode: PR/PR res: [0x2b704:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e29 expref: 1092 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.574545:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.574545:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.574546:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000ff3021f/0x3234de053c512ad lrc: 3/0,1 mode: PW/PW res: [0x2b703:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.574547:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c4df3e lrc: 0/0,0 mode: --/PR res: [0x2b704:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e29 expref: 1091 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.574549:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ff3021f/0x3234de053c512ad lrc: 4/0,1 mode: PW/PW res: [0x2b703:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.574551:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.574552:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.574553:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000896a135f/0x3234de053c512b4 lrc: 3/0,1 mode: PW/PW res: [0x2b704:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574558:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.574561:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000896a135f/0x3234de053c512b4 lrc: 4/0,1 mode: PW/PW res: [0x2b704:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.574563:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1090:41279:x1731746396326272:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 34us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.574566:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12257 00010000:00010000:1.0:1651529344.574568:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.574572:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c51298 lrc: 3/0,1 mode: PW/PW res: [0x2b6ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.574573:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1089:41278:x1731746396326336:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.574576:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12258 00010000:00010000:0.0:1651529344.574576:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c51298 lrc: 3/0,1 mode: PW/PW res: [0x2b6ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574579:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c51298 lrc: 3/0,1 mode: PW/PW res: [0x2b6ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574581:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c51298 lrc: 2/0,0 mode: PW/PW res: [0x2b6ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.574584:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c7308f91/0x3234de053c51283 lrc: 3/0,1 mode: PW/PW res: [0x2b6fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.574587:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7308f91/0x3234de053c51283 lrc: 3/0,1 mode: PW/PW res: [0x2b6fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.574590:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7308f91/0x3234de053c51283 lrc: 3/0,1 mode: PW/PW res: [0x2b6fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.574593:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7308f91/0x3234de053c51283 lrc: 2/0,0 mode: PW/PW res: [0x2b6fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.574633:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+972:39029:x1731745946444992:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1046us (1192us total) trans 12885079524 rc 0/0 00000100:00100000:0.0:1651529344.574636:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211472 00000100:00100000:1.0:1651529344.574644:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+971:39030:x1731745946444928:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1144us (1243us total) trans 12885079525 rc 0/0 00010000:00010000:0.0:1651529344.574644:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c51298 lrc: 2/0,0 mode: PW/PW res: [0x2b6ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.574647:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211469 00010000:00010000:0.0:1651529344.574647:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000002904524 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.574648:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c51298 lrc: 2/0,0 mode: PW/PW res: [0x2b6ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574651:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c51298 lrc: 3/0,0 mode: PW/PW res: [0x2b6ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.574654:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001b6ece5d/0x3234de053c51291 lrc: 3/0,1 mode: PW/PW res: [0x2b6fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574655:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c51298 lrc: 1/0,0 mode: --/PW res: [0x2b6ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.574657:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b6ece5d/0x3234de053c51291 lrc: 3/0,1 mode: PW/PW res: [0x2b6fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574658:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002904524/0x3234de053c51298 lrc: 0/0,0 mode: --/PW res: [0x2b6ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.574660:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b6ece5d/0x3234de053c51291 lrc: 3/0,1 mode: PW/PW res: [0x2b6fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.574662:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b6ece5d/0x3234de053c51291 lrc: 2/0,0 mode: PW/PW res: [0x2b6fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574663:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7308f91/0x3234de053c51283 lrc: 2/0,0 mode: PW/PW res: [0x2b6fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574666:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c7308f91 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.574666:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7308f91/0x3234de053c51283 lrc: 2/0,0 mode: PW/PW res: [0x2b6fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574669:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7308f91/0x3234de053c51283 lrc: 3/0,0 mode: PW/PW res: [0x2b6fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574678:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7308f91/0x3234de053c51283 lrc: 1/0,0 mode: --/PW res: [0x2b6fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574681:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7308f91/0x3234de053c51283 lrc: 0/0,0 mode: --/PW res: [0x2b6fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574684:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b6ece5d/0x3234de053c51291 lrc: 2/0,0 mode: PW/PW res: [0x2b6fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574687:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001b6ece5d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.574688:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b6ece5d/0x3234de053c51291 lrc: 2/0,0 mode: PW/PW res: [0x2b6fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574691:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b6ece5d/0x3234de053c51291 lrc: 3/0,0 mode: PW/PW res: [0x2b6fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574694:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b6ece5d/0x3234de053c51291 lrc: 1/0,0 mode: --/PW res: [0x2b6fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574697:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b6ece5d/0x3234de053c51291 lrc: 0/0,0 mode: --/PW res: [0x2b6fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.574702:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+971:39029:x1731745946444864:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1147us (1273us total) trans 12885079526 rc 0/0 00010000:00010000:0.0:1651529344.574703:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c5129f lrc: 3/0,1 mode: PW/PW res: [0x2b701:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.574705:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211471 00010000:00010000:0.0:1651529344.574706:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c5129f lrc: 3/0,1 mode: PW/PW res: [0x2b701:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574709:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c5129f lrc: 3/0,1 mode: PW/PW res: [0x2b701:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.574711:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000896a135f/0x3234de053c512b4 lrc: 3/0,1 mode: PW/PW res: [0x2b704:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574712:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c5129f lrc: 2/0,0 mode: PW/PW res: [0x2b701:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.574714:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000896a135f/0x3234de053c512b4 lrc: 3/0,1 mode: PW/PW res: [0x2b704:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.574717:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000896a135f/0x3234de053c512b4 lrc: 3/0,1 mode: PW/PW res: [0x2b704:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.574720:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000896a135f/0x3234de053c512b4 lrc: 2/0,0 mode: PW/PW res: [0x2b704:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.574764:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+972:39029:x1731745946445120:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1064us (1116us total) trans 12885079527 rc 0/0 00000100:00100000:0.0:1651529344.574767:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211473 00000100:00100000:1.0:1651529344.574769:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+972:39029:x1731745946445312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 917us (981us total) trans 12885079528 rc 0/0 00000100:00100000:1.0:1651529344.574772:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211476 00010000:00010000:0.0:1651529344.574774:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c5129f lrc: 2/0,0 mode: PW/PW res: [0x2b701:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574778:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000085580035 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.574779:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c5129f lrc: 2/0,0 mode: PW/PW res: [0x2b701:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.574780:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000ff3021f/0x3234de053c512ad lrc: 3/0,1 mode: PW/PW res: [0x2b703:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574781:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c5129f lrc: 3/0,0 mode: PW/PW res: [0x2b701:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.574783:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ff3021f/0x3234de053c512ad lrc: 3/0,1 mode: PW/PW res: [0x2b703:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.574786:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ff3021f/0x3234de053c512ad lrc: 3/0,1 mode: PW/PW res: [0x2b703:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574786:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c5129f lrc: 1/0,0 mode: --/PW res: [0x2b701:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574789:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085580035/0x3234de053c5129f lrc: 0/0,0 mode: --/PW res: [0x2b701:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.574791:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ff3021f/0x3234de053c512ad lrc: 2/0,0 mode: PW/PW res: [0x2b703:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574793:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000896a135f/0x3234de053c512b4 lrc: 2/0,0 mode: PW/PW res: [0x2b704:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574796:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000896a135f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.574796:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000896a135f/0x3234de053c512b4 lrc: 2/0,0 mode: PW/PW res: [0x2b704:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574806:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000896a135f/0x3234de053c512b4 lrc: 3/0,0 mode: PW/PW res: [0x2b704:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574810:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000896a135f/0x3234de053c512b4 lrc: 1/0,0 mode: --/PW res: [0x2b704:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574812:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000896a135f/0x3234de053c512b4 lrc: 0/0,0 mode: --/PW res: [0x2b704:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574816:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ff3021f/0x3234de053c512ad lrc: 2/0,0 mode: PW/PW res: [0x2b703:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574818:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000ff3021f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.574819:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ff3021f/0x3234de053c512ad lrc: 2/0,0 mode: PW/PW res: [0x2b703:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574822:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ff3021f/0x3234de053c512ad lrc: 3/0,0 mode: PW/PW res: [0x2b703:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574825:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ff3021f/0x3234de053c512ad lrc: 1/0,0 mode: --/PW res: [0x2b703:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.574826:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+971:39029:x1731745946445248:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1053us (1152us total) trans 12885079529 rc 0/0 00010000:00010000:0.0:1651529344.574828:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ff3021f/0x3234de053c512ad lrc: 0/0,0 mode: --/PW res: [0x2b703:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.574829:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211475 00010000:00010000:0.0:1651529344.574834:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c5128a lrc: 3/0,1 mode: PW/PW res: [0x2b700:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.574836:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ec163e8e/0x3234de053c512a6 lrc: 3/0,1 mode: PW/PW res: [0x2b702:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574837:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c5128a lrc: 3/0,1 mode: PW/PW res: [0x2b700:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.574839:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec163e8e/0x3234de053c512a6 lrc: 3/0,1 mode: PW/PW res: [0x2b702:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574840:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c5128a lrc: 3/0,1 mode: PW/PW res: [0x2b700:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.574842:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec163e8e/0x3234de053c512a6 lrc: 3/0,1 mode: PW/PW res: [0x2b702:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574842:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c5128a lrc: 2/0,0 mode: PW/PW res: [0x2b700:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.574845:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec163e8e/0x3234de053c512a6 lrc: 2/0,0 mode: PW/PW res: [0x2b702:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.574880:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+972:39030:x1731745946445184:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1170us (1216us total) trans 12885079530 rc 0/0 00000100:00100000:1.0:1651529344.574883:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211474 00000100:00100000:0.0:1651529344.574884:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+972:39030:x1731745946445056:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1350us (1467us total) trans 12885079531 rc 0/0 00000100:00100000:0.0:1651529344.574888:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211470 00010000:00010000:0.0:1651529344.574895:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c5128a lrc: 2/0,0 mode: PW/PW res: [0x2b700:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574901:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000069f7ba22 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.574902:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c5128a lrc: 2/0,0 mode: PW/PW res: [0x2b700:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574905:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c5128a lrc: 3/0,0 mode: PW/PW res: [0x2b700:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574909:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c5128a lrc: 1/0,0 mode: --/PW res: [0x2b700:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574912:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069f7ba22/0x3234de053c5128a lrc: 0/0,0 mode: --/PW res: [0x2b700:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574915:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec163e8e/0x3234de053c512a6 lrc: 2/0,0 mode: PW/PW res: [0x2b702:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574918:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ec163e8e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.574919:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec163e8e/0x3234de053c512a6 lrc: 2/0,0 mode: PW/PW res: [0x2b702:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574921:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec163e8e/0x3234de053c512a6 lrc: 3/0,0 mode: PW/PW res: [0x2b702:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574924:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec163e8e/0x3234de053c512a6 lrc: 1/0,0 mode: --/PW res: [0x2b702:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.574927:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec163e8e/0x3234de053c512a6 lrc: 0/0,0 mode: --/PW res: [0x2b702:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.575217:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.575239:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946445952 00000100:00100000:1.0:1651529344.575245:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.575254:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946445888 00000100:00100000:0.0:1651529344.575261:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211477 00000100:00100000:0.0:1651529344.575263:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ada533bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+972:39030:x1731745946445952:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.575264:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.575273:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.575280:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.575287:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177926 count 1 00010000:00010000:0.0:1651529344.575291:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c512bb lrc: 3/0,1 mode: --/PW res: [0x2b706:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.575297:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf21e361/0x3234de053c4e320 lrc: 2/0,0 mode: PR/PR res: [0x2b706:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3da3 expref: 1088 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.575300:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.575300:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.575301:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c512bb lrc: 4/0,1 mode: --/PW res: [0x2b706:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.575303:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.575313:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.575315:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bf21e361/0x3234de053c4e320 lrc: 3/0,0 mode: PR/PR res: [0x2b706:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3da3 expref: 1088 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.575319:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bf21e361/0x3234de053c4e320 lrc: 4/0,0 mode: PR/PR res: [0x2b706:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3da3 expref: 1088 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.575320:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.575328:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000059363096 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997001280:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.575330:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946446016 00000100:00100000:1.0:1651529344.575339:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946446080 00000100:00100000:1.0:1651529344.575344:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946446208 00000100:00100000:1.0:1651529344.575346:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946446336 00000100:00100000:1.0:1651529344.575349:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946446144 00000100:00100000:0.0:1651529344.575349:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060852af0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.575351:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946446272 00000100:00100000:1.0:1651529344.575354:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211478 00000100:00100000:1.0:1651529344.575355:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+978:39029:x1731745946445888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.575356:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211479 00000100:00100000:0.0:1651529344.575358:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+978:39029:x1731745946446016:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.575361:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177925 count 1 00002000:00080000:0.0:1651529344.575363:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177927 count 1 00010000:00010000:1.0:1651529344.575366:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031f35bc4/0x3234de053c512c2 lrc: 3/0,1 mode: --/PW res: [0x2b705:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.575366:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c512c9 lrc: 3/0,1 mode: --/PW res: [0x2b707:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.575371:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001201dc92/0x3234de053c4deb9 lrc: 2/0,0 mode: PR/PR res: [0x2b705:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b89 expref: 1088 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.575371:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f423b01c/0x3234de053c4bf78 lrc: 2/0,0 mode: PR/PR res: [0x2b707:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc728 expref: 1088 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.575374:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.575374:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.575374:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.575374:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.575375:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031f35bc4/0x3234de053c512c2 lrc: 4/0,1 mode: --/PW res: [0x2b705:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.575375:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c512c9 lrc: 4/0,1 mode: --/PW res: [0x2b707:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.575381:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f423b01c/0x3234de053c4bf78 lrc: 3/0,0 mode: PR/PR res: [0x2b707:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc728 expref: 1088 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.575382:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001201dc92/0x3234de053c4deb9 lrc: 3/0,0 mode: PR/PR res: [0x2b705:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b89 expref: 1088 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.575385:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001201dc92/0x3234de053c4deb9 lrc: 4/0,0 mode: PR/PR res: [0x2b705:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b89 expref: 1088 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.575385:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f423b01c/0x3234de053c4bf78 lrc: 4/0,0 mode: PR/PR res: [0x2b707:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc728 expref: 1088 pid: 72395 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.575388:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000089d7f5d6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997001344:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.575390:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000093ddaf92 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997001408:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.575395:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 0000000070e666f7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.575399:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f9dac3f6 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.575401:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211480 00000100:00100000:0.0:1651529344.575402:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+978:39030:x1731745946446080:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.575406:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211481 00002000:00080000:0.0:1651529344.575406:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177928 count 1 00000100:00100000:1.0:1651529344.575408:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfc79d4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+978:39030:x1731745946446208:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.575409:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c512d0 lrc: 3/0,1 mode: --/PW res: [0x2b708:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.575412:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177930 count 1 00010000:00010000:0.0:1651529344.575413:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000042765ffe/0x3234de053c4dc3c lrc: 2/0,0 mode: PR/PR res: [0x2b708:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d212c expref: 1088 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.575415:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098834c70/0x3234de053c512d7 lrc: 3/0,1 mode: --/PW res: [0x2b70a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.575416:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.575417:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.575418:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c512d0 lrc: 4/0,1 mode: --/PW res: [0x2b708:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.575419:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004616f2ef/0x3234de053c4f5e9 lrc: 2/0,0 mode: PR/PR res: [0x2b70a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89f4 expref: 1088 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.575422:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.575422:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.575423:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098834c70/0x3234de053c512d7 lrc: 4/0,1 mode: --/PW res: [0x2b70a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.575423:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000042765ffe/0x3234de053c4dc3c lrc: 3/0,0 mode: PR/PR res: [0x2b708:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d212c expref: 1088 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.575426:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000042765ffe/0x3234de053c4dc3c lrc: 4/0,0 mode: PR/PR res: [0x2b708:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d212c expref: 1088 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.575429:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004616f2ef/0x3234de053c4f5e9 lrc: 3/0,0 mode: PR/PR res: [0x2b70a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89f4 expref: 1088 pid: 156655 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.575430:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004a6776b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997001472:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.575433:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004616f2ef/0x3234de053c4f5e9 lrc: 4/0,0 mode: PR/PR res: [0x2b70a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89f4 expref: 1088 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.575436:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006647e4ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997001536:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.575436:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000504ef660 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.575442:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 0000000053a0cffa going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.575442:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211482 00000100:00100000:0.0:1651529344.575444:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ea32140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+978:39030:x1731745946446336:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.575447:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177932 count 1 00000100:00100000:1.0:1651529344.575448:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211483 00000100:00100000:1.0:1651529344.575449:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005914c920 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+978:39030:x1731745946446144:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.575450:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c512de lrc: 3/0,1 mode: --/PW res: [0x2b70c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.575453:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177929 count 1 00010000:00010000:0.0:1651529344.575454:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000705cc353/0x3234de053c4f25b lrc: 2/0,0 mode: PR/PR res: [0x2b70c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c17 expref: 1088 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.575456:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024e518f1/0x3234de053c512e5 lrc: 3/0,1 mode: --/PW res: [0x2b709:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.575457:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.575458:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.575458:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c512de lrc: 4/0,1 mode: --/PW res: [0x2b70c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.575460:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c01fa80c/0x3234de053c4f52c lrc: 2/0,0 mode: PR/PR res: [0x2b709:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d871c expref: 1088 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.575463:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.575464:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.575465:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024e518f1/0x3234de053c512e5 lrc: 4/0,1 mode: --/PW res: [0x2b709:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.575466:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000705cc353/0x3234de053c4f25b lrc: 3/0,0 mode: PR/PR res: [0x2b70c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c17 expref: 1088 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.575470:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c01fa80c/0x3234de053c4f52c lrc: 3/0,0 mode: PR/PR res: [0x2b709:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d871c expref: 1088 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.575470:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000705cc353/0x3234de053c4f25b lrc: 4/0,0 mode: PR/PR res: [0x2b70c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c17 expref: 1088 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.575473:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c01fa80c/0x3234de053c4f52c lrc: 4/0,0 mode: PR/PR res: [0x2b709:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d871c expref: 1088 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.575474:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002c4168d4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997001600:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.575477:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005a17dd72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997001664:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.575480:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c2b2b59c going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.575483:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 0000000057299e7f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.575485:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211484 00000100:00100000:0.0:1651529344.575487:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a13808c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+978:39030:x1731745946446272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.575491:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177931 count 1 00010000:00010000:0.0:1651529344.575493:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5b283df/0x3234de053c512ec lrc: 3/0,1 mode: --/PW res: [0x2b70b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.575497:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ec255d88/0x3234de053c4e224 lrc: 2/0,0 mode: PR/PR res: [0x2b70b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d39c8 expref: 1088 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.575500:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.575501:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.575502:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5b283df/0x3234de053c512ec lrc: 4/0,1 mode: --/PW res: [0x2b70b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.575507:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ec255d88/0x3234de053c4e224 lrc: 3/0,0 mode: PR/PR res: [0x2b70b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d39c8 expref: 1088 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.575511:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ec255d88/0x3234de053c4e224 lrc: 4/0,0 mode: PR/PR res: [0x2b70b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d39c8 expref: 1088 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.575515:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002a957ba7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997001728:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.575521:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000abca413e going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.576040:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000089d7f5d6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997001344:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.576050:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c512c9 lrc: 3/0,1 mode: --/PW res: [0x2b707:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.576061:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.576063:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004a6776b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997001472:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.576066:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c512d0 lrc: 3/0,1 mode: --/PW res: [0x2b708:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.576068:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.576072:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002c4168d4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997001600:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.576074:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c512de lrc: 3/0,1 mode: --/PW res: [0x2b70c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.576075:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.576080:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000059363096 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997001280:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.576081:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.576082:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c512bb lrc: 3/0,1 mode: --/PW res: [0x2b706:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.576090:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.576094:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396326912 00000100:00100000:1.0:1651529344.576095:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.576099:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bf21e361/0x3234de053c4e320 lrc: 4/0,0 mode: PR/PR res: [0x2b706:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3da3 expref: 1089 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.576103:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000093ddaf92 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997001408:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.576105:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396327040 00010000:00010000:0.0:1651529344.576107:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001201dc92/0x3234de053c4deb9 lrc: 4/0,0 mode: PR/PR res: [0x2b705:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b89 expref: 1090 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.576108:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000031f35bc4/0x3234de053c512c2 lrc: 3/0,1 mode: --/PW res: [0x2b705:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.576111:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396326976 00010000:00010000:0.0:1651529344.576114:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f423b01c/0x3234de053c4bf78 lrc: 4/0,0 mode: PR/PR res: [0x2b707:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc728 expref: 1091 pid: 72395 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.576117:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006647e4ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997001536:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.576117:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396327168 00010000:00010000:1.0:1651529344.576119:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000098834c70/0x3234de053c512d7 lrc: 3/0,1 mode: --/PW res: [0x2b70a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576119:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004616f2ef/0x3234de053c4f5e9 lrc: 4/0,0 mode: PR/PR res: [0x2b70a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89f4 expref: 1092 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.576124:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396327104 00000100:00100000:1.0:1651529344.576125:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396327232 00010000:00010000:0.0:1651529344.576126:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000042765ffe/0x3234de053c4dc3c lrc: 4/0,0 mode: PR/PR res: [0x2b708:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d212c expref: 1093 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.576130:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000705cc353/0x3234de053c4f25b lrc: 4/0,0 mode: PR/PR res: [0x2b70c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c17 expref: 1094 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.576130:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12259 00000100:00100000:0.0:1651529344.576132:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1094:41279:x1731746396326912:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.576134:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.576136:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12260 00010000:00010000:0.0:1651529344.576136:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bf21e361/0x3234de053c4e320 lrc: 4/0,0 mode: PR/PR res: [0x2b706:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3da3 expref: 1094 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.576138:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a253639 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1094:41279:x1731746396327040:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.576139:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bf21e361/0x3234de053c4e320 lrc: 3/0,0 mode: PR/PR res: [0x2b706:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3da3 expref: 1094 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.576141:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.576142:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001201dc92/0x3234de053c4deb9 lrc: 4/0,0 mode: PR/PR res: [0x2b705:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b89 expref: 1094 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.576145:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf21e361/0x3234de053c4e320 lrc: 0/0,0 mode: --/PR res: [0x2b706:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3da3 expref: 1094 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.576146:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001201dc92/0x3234de053c4deb9 lrc: 3/0,0 mode: PR/PR res: [0x2b705:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b89 expref: 1094 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.576149:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.576150:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.576150:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c512bb lrc: 3/0,1 mode: PW/PW res: [0x2b706:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.576151:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001201dc92/0x3234de053c4deb9 lrc: 0/0,0 mode: --/PR res: [0x2b705:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b89 expref: 1093 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.576153:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c512bb lrc: 4/0,1 mode: PW/PW res: [0x2b706:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.576155:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.576155:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.576156:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000031f35bc4/0x3234de053c512c2 lrc: 3/0,1 mode: PW/PW res: [0x2b705:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576160:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.576162:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031f35bc4/0x3234de053c512c2 lrc: 4/0,1 mode: PW/PW res: [0x2b705:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.576168:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.576169:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1092:41279:x1731746396326912:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.576171:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12259 00000100:00100000:1.0:1651529344.576175:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a253639 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1091:41279:x1731746396327040:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.576176:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12261 00000100:00100000:1.0:1651529344.576177:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12260 00000100:00100000:0.0:1651529344.576177:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1091:41278:x1731746396326976:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.576180:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.576181:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f423b01c/0x3234de053c4bf78 lrc: 4/0,0 mode: PR/PR res: [0x2b707:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc728 expref: 1090 pid: 72395 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.576185:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f423b01c/0x3234de053c4bf78 lrc: 3/0,0 mode: PR/PR res: [0x2b707:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc728 expref: 1090 pid: 72395 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.576186:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12262 00000100:00100000:1.0:1651529344.576188:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1090:41279:x1731746396327168:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.576189:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f423b01c/0x3234de053c4bf78 lrc: 0/0,0 mode: --/PR res: [0x2b707:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc728 expref: 1090 pid: 72395 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.576191:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.576192:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004616f2ef/0x3234de053c4f5e9 lrc: 4/0,0 mode: PR/PR res: [0x2b70a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89f4 expref: 1089 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.576192:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.576193:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.576193:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c512c9 lrc: 3/0,1 mode: PW/PW res: [0x2b707:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.576196:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004616f2ef/0x3234de053c4f5e9 lrc: 3/0,0 mode: PR/PR res: [0x2b70a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89f4 expref: 1089 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.576199:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c512c9 lrc: 4/0,1 mode: PW/PW res: [0x2b707:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.576200:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004616f2ef/0x3234de053c4f5e9 lrc: 0/0,0 mode: --/PR res: [0x2b70a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89f4 expref: 1089 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.576204:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.576204:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.576204:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.576205:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000098834c70/0x3234de053c512d7 lrc: 3/0,1 mode: PW/PW res: [0x2b70a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.576208:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098834c70/0x3234de053c512d7 lrc: 4/0,1 mode: PW/PW res: [0x2b70a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.576209:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1088:41278:x1731746396326976:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 31us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.576212:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12261 00010000:00010000:1.0:1651529344.576215:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.576216:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12263 00000100:00100000:0.0:1651529344.576217:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1087:41278:x1731746396327104:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.576219:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.576220:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1087:41279:x1731746396327168:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 31us (139us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.576221:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000042765ffe/0x3234de053c4dc3c lrc: 4/0,0 mode: PR/PR res: [0x2b708:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d212c expref: 1087 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.576239:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12262 00010000:00010000:0.0:1651529344.576241:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000042765ffe/0x3234de053c4dc3c lrc: 3/0,0 mode: PR/PR res: [0x2b708:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d212c expref: 1086 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.576244:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12264 00000100:00100000:1.0:1651529344.576245:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1086:41278:x1731746396327232:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.576248:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.576250:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000705cc353/0x3234de053c4f25b lrc: 4/0,0 mode: PR/PR res: [0x2b70c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c17 expref: 1086 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.576254:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000705cc353/0x3234de053c4f25b lrc: 3/0,0 mode: PR/PR res: [0x2b70c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c17 expref: 1086 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.576258:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000705cc353/0x3234de053c4f25b lrc: 0/0,0 mode: --/PR res: [0x2b70c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c17 expref: 1086 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.576262:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.576263:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.576263:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c512de lrc: 3/0,1 mode: PW/PW res: [0x2b70c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.576266:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c512de lrc: 4/0,1 mode: PW/PW res: [0x2b70c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576273:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042765ffe/0x3234de053c4dc3c lrc: 0/0,0 mode: --/PR res: [0x2b708:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d212c expref: 1085 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.576278:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.576278:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.576279:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c512d0 lrc: 3/0,1 mode: PW/PW res: [0x2b708:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576282:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c512d0 lrc: 4/0,1 mode: PW/PW res: [0x2b708:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.576288:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.576294:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1084:41278:x1731746396327232:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 48us (199us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.576296:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.576297:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12264 00000100:00100000:0.0:1651529344.576304:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1083:41278:x1731746396327104:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 86us (214us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.576305:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000098834c70/0x3234de053c512d7 lrc: 3/0,1 mode: PW/PW res: [0x2b70a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.576307:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12263 00010000:00010000:1.0:1651529344.576308:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098834c70/0x3234de053c512d7 lrc: 3/0,1 mode: PW/PW res: [0x2b70a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.576312:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098834c70/0x3234de053c512d7 lrc: 3/0,1 mode: PW/PW res: [0x2b70a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.576314:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000098834c70/0x3234de053c512d7 lrc: 2/0,0 mode: PW/PW res: [0x2b70a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576314:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c512c9 lrc: 3/0,1 mode: PW/PW res: [0x2b707:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576317:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c512c9 lrc: 3/0,1 mode: PW/PW res: [0x2b707:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576326:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c512c9 lrc: 3/0,1 mode: PW/PW res: [0x2b707:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576329:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c512c9 lrc: 2/0,0 mode: PW/PW res: [0x2b707:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.576358:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfc79d4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+980:39030:x1731745946446208:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 950us (1078us total) trans 12885079532 rc 0/0 00000100:00100000:1.0:1651529344.576362:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211481 00010000:00010000:1.0:1651529344.576368:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000031f35bc4/0x3234de053c512c2 lrc: 3/0,1 mode: PW/PW res: [0x2b705:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.576370:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+979:39029:x1731745946446016:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1011us (1106us total) trans 12885079533 rc 0/0 00010000:00010000:1.0:1651529344.576372:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031f35bc4/0x3234de053c512c2 lrc: 3/0,1 mode: PW/PW res: [0x2b705:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.576373:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211479 00010000:00010000:1.0:1651529344.576375:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031f35bc4/0x3234de053c512c2 lrc: 3/0,1 mode: PW/PW res: [0x2b705:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.576377:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000031f35bc4/0x3234de053c512c2 lrc: 2/0,0 mode: PW/PW res: [0x2b705:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576383:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c512de lrc: 3/0,1 mode: PW/PW res: [0x2b70c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576394:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c512de lrc: 3/0,1 mode: PW/PW res: [0x2b70c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576397:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c512de lrc: 3/0,1 mode: PW/PW res: [0x2b70c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576401:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c512de lrc: 2/0,0 mode: PW/PW res: [0x2b70c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.576416:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+979:39029:x1731745946445888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1060us (1171us total) trans 12885079534 rc 0/0 00000100:00100000:1.0:1651529344.576419:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211478 00000100:00100000:0.0:1651529344.576435:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ea32140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+979:39030:x1731745946446336:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 991us (1139us total) trans 12885079535 rc 0/0 00000100:00100000:0.0:1651529344.576438:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211482 00010000:00010000:0.0:1651529344.576445:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c512d0 lrc: 3/0,1 mode: PW/PW res: [0x2b708:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576455:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c512d0 lrc: 3/0,1 mode: PW/PW res: [0x2b708:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.576457:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.576459:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c512d0 lrc: 3/0,1 mode: PW/PW res: [0x2b708:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576466:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c512d0 lrc: 2/0,0 mode: PW/PW res: [0x2b708:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.576469:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.576497:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+979:39030:x1731745946446080:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1094us (1224us total) trans 12885079536 rc 0/0 00000100:00100000:0.0:1651529344.576500:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211480 00010000:00010000:0.0:1651529344.576507:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000098834c70/0x3234de053c512d7 lrc: 2/0,0 mode: PW/PW res: [0x2b70a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576511:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000098834c70 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.576512:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000098834c70/0x3234de053c512d7 lrc: 2/0,0 mode: PW/PW res: [0x2b70a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576515:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000098834c70/0x3234de053c512d7 lrc: 3/0,0 mode: PW/PW res: [0x2b70a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576519:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000098834c70/0x3234de053c512d7 lrc: 1/0,0 mode: --/PW res: [0x2b70a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576522:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098834c70/0x3234de053c512d7 lrc: 0/0,0 mode: --/PW res: [0x2b70a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576526:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c512c9 lrc: 2/0,0 mode: PW/PW res: [0x2b707:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576529:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001d253066 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.576530:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c512c9 lrc: 2/0,0 mode: PW/PW res: [0x2b707:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576533:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c512c9 lrc: 3/0,0 mode: PW/PW res: [0x2b707:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576536:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c512c9 lrc: 1/0,0 mode: --/PW res: [0x2b707:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576538:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d253066/0x3234de053c512c9 lrc: 0/0,0 mode: --/PW res: [0x2b707:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576542:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000031f35bc4/0x3234de053c512c2 lrc: 2/0,0 mode: PW/PW res: [0x2b705:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576545:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000031f35bc4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.576546:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000031f35bc4/0x3234de053c512c2 lrc: 2/0,0 mode: PW/PW res: [0x2b705:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576566:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000031f35bc4/0x3234de053c512c2 lrc: 3/0,0 mode: PW/PW res: [0x2b705:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576570:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000031f35bc4/0x3234de053c512c2 lrc: 1/0,0 mode: --/PW res: [0x2b705:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.576572:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005a17dd72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997001664:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.576573:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031f35bc4/0x3234de053c512c2 lrc: 0/0,0 mode: --/PW res: [0x2b705:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.576577:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000024e518f1/0x3234de053c512e5 lrc: 3/0,1 mode: --/PW res: [0x2b709:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576577:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c512de lrc: 2/0,0 mode: PW/PW res: [0x2b70c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576579:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000009ec9189 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.576580:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c512de lrc: 2/0,0 mode: PW/PW res: [0x2b70c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576583:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c512de lrc: 3/0,0 mode: PW/PW res: [0x2b70c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.576584:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396327296 00010000:00010000:0.0:1651529344.576586:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c512de lrc: 1/0,0 mode: --/PW res: [0x2b70c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.576589:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c01fa80c/0x3234de053c4f52c lrc: 4/0,0 mode: PR/PR res: [0x2b709:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d871c expref: 1083 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.576589:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009ec9189/0x3234de053c512de lrc: 0/0,0 mode: --/PW res: [0x2b70c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.576595:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396327360 00010000:00010000:1.0:1651529344.576597:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ec255d88/0x3234de053c4e224 lrc: 5/0,0 mode: PR/PR res: [0x2b70b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d39c8 expref: 1084 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.576603:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12265 00010000:00010000:0.0:1651529344.576603:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c512d0 lrc: 2/0,0 mode: PW/PW res: [0x2b708:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.576605:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1084:41279:x1731746396327296:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.576606:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e0e037e6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.576607:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c512d0 lrc: 2/0,0 mode: PW/PW res: [0x2b708:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.576608:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.576609:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c01fa80c/0x3234de053c4f52c lrc: 4/0,0 mode: PR/PR res: [0x2b709:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d871c expref: 1084 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.576610:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c512d0 lrc: 3/0,0 mode: PW/PW res: [0x2b708:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.576613:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c01fa80c/0x3234de053c4f52c lrc: 3/0,0 mode: PR/PR res: [0x2b709:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d871c expref: 1084 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.576613:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c512d0 lrc: 1/0,0 mode: --/PW res: [0x2b708:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576616:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0e037e6/0x3234de053c512d0 lrc: 0/0,0 mode: --/PW res: [0x2b708:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.576618:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c01fa80c/0x3234de053c4f52c lrc: 0/0,0 mode: --/PR res: [0x2b709:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d871c expref: 1084 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.576622:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.576623:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.576624:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000024e518f1/0x3234de053c512e5 lrc: 3/0,1 mode: PW/PW res: [0x2b709:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.576627:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024e518f1/0x3234de053c512e5 lrc: 4/0,1 mode: PW/PW res: [0x2b709:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.576629:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002a957ba7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997001728:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.576633:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.576633:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a5b283df/0x3234de053c512ec lrc: 3/0,1 mode: --/PW res: [0x2b70b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576638:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c512bb lrc: 3/0,1 mode: PW/PW res: [0x2b706:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576640:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c512bb lrc: 3/0,1 mode: PW/PW res: [0x2b706:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.576641:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1083:41279:x1731746396327296:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.576643:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12265 00010000:00010000:0.0:1651529344.576646:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c512bb lrc: 3/0,1 mode: PW/PW res: [0x2b706:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.576647:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12266 00010000:00010000:0.0:1651529344.576648:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c512bb lrc: 2/0,0 mode: PW/PW res: [0x2b706:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.576649:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1082:41278:x1731746396327360:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.576651:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.576652:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ec255d88/0x3234de053c4e224 lrc: 4/0,0 mode: PR/PR res: [0x2b70b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d39c8 expref: 1082 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.576656:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ec255d88/0x3234de053c4e224 lrc: 3/0,0 mode: PR/PR res: [0x2b70b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d39c8 expref: 1082 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.576660:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec255d88/0x3234de053c4e224 lrc: 0/0,0 mode: --/PR res: [0x2b70b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d39c8 expref: 1082 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.576666:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.576667:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.576667:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a5b283df/0x3234de053c512ec lrc: 3/0,1 mode: PW/PW res: [0x2b70b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.576670:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5b283df/0x3234de053c512ec lrc: 4/0,1 mode: PW/PW res: [0x2b70b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.576680:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.576685:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1081:41278:x1731746396327360:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.576688:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12266 00010000:00010000:1.0:1651529344.576694:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000024e518f1/0x3234de053c512e5 lrc: 3/0,1 mode: PW/PW res: [0x2b709:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.576697:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024e518f1/0x3234de053c512e5 lrc: 3/0,1 mode: PW/PW res: [0x2b709:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.576700:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024e518f1/0x3234de053c512e5 lrc: 3/0,1 mode: PW/PW res: [0x2b709:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.576703:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024e518f1/0x3234de053c512e5 lrc: 2/0,0 mode: PW/PW res: [0x2b709:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.576728:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ada533bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+980:39030:x1731745946445952:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1464us (1511us total) trans 12885079537 rc 0/0 00000100:00100000:0.0:1651529344.576731:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211477 00000100:00100000:1.0:1651529344.576753:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005914c920 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+979:39030:x1731745946446144:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1303us (1440us total) trans 12885079538 rc 0/0 00000100:00100000:1.0:1651529344.576756:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211483 00010000:00010000:0.0:1651529344.576762:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c512bb lrc: 2/0,0 mode: PW/PW res: [0x2b706:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576766:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000048c07243 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.576767:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c512bb lrc: 2/0,0 mode: PW/PW res: [0x2b706:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576770:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c512bb lrc: 3/0,0 mode: PW/PW res: [0x2b706:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576775:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c512bb lrc: 1/0,0 mode: --/PW res: [0x2b706:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576778:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048c07243/0x3234de053c512bb lrc: 0/0,0 mode: --/PW res: [0x2b706:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576782:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024e518f1/0x3234de053c512e5 lrc: 2/0,0 mode: PW/PW res: [0x2b709:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576785:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e518f1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.576786:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024e518f1/0x3234de053c512e5 lrc: 2/0,0 mode: PW/PW res: [0x2b709:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576789:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024e518f1/0x3234de053c512e5 lrc: 3/0,0 mode: PW/PW res: [0x2b709:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.576791:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.576792:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024e518f1/0x3234de053c512e5 lrc: 1/0,0 mode: --/PW res: [0x2b709:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576794:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024e518f1/0x3234de053c512e5 lrc: 0/0,0 mode: --/PW res: [0x2b709:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576799:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a5b283df/0x3234de053c512ec lrc: 3/0,1 mode: PW/PW res: [0x2b70b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576802:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5b283df/0x3234de053c512ec lrc: 3/0,1 mode: PW/PW res: [0x2b70b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.576805:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.576805:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5b283df/0x3234de053c512ec lrc: 3/0,1 mode: PW/PW res: [0x2b70b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576807:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5b283df/0x3234de053c512ec lrc: 2/0,0 mode: PW/PW res: [0x2b70b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.576820:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.576847:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.576862:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a13808c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+979:39030:x1731745946446272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1374us (1541us total) trans 12885079539 rc 0/0 00000100:00100000:0.0:1651529344.576865:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211484 00000100:00100000:1.0:1651529344.576868:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.576872:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946446784 00000100:00100000:0.0:1651529344.576878:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946446848 00000100:00100000:0.0:1651529344.576886:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946446912 00000100:00100000:0.0:1651529344.576890:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946446976 00000100:00100000:0.0:1651529344.576895:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946447040 00000100:00100000:0.0:1651529344.576899:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211485 00000100:00100000:0.0:1651529344.576900:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+983:39029:x1731745946446784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.576905:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177933 count 1 00000100:00100000:1.0:1651529344.576907:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211486 00000100:00100000:1.0:1651529344.576909:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+983:39030:x1731745946446848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.576909:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dbb69211/0x3234de053c512f3 lrc: 3/0,1 mode: --/PW res: [0x2b70d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.576914:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177934 count 1 00010000:00010000:0.0:1651529344.576914:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008564120b/0x3234de053c4ca5a lrc: 2/0,0 mode: PR/PR res: [0x2b70d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb25 expref: 1080 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.576917:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.576918:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.576919:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3443fb0/0x3234de053c512fa lrc: 3/0,1 mode: --/PW res: [0x2b70e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576919:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dbb69211/0x3234de053c512f3 lrc: 4/0,1 mode: --/PW res: [0x2b70d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.576924:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9934b5e/0x3234de053c4d8fb lrc: 2/0,0 mode: PR/PR res: [0x2b70e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d14ec expref: 1080 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.576926:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008564120b/0x3234de053c4ca5a lrc: 3/0,0 mode: PR/PR res: [0x2b70d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb25 expref: 1080 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.576927:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.576927:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.576928:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3443fb0/0x3234de053c512fa lrc: 4/0,1 mode: --/PW res: [0x2b70e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576929:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008564120b/0x3234de053c4ca5a lrc: 4/0,0 mode: PR/PR res: [0x2b70d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb25 expref: 1080 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.576935:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e9934b5e/0x3234de053c4d8fb lrc: 3/0,0 mode: PR/PR res: [0x2b70e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d14ec expref: 1080 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.576938:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e9934b5e/0x3234de053c4d8fb lrc: 4/0,0 mode: PR/PR res: [0x2b70e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d14ec expref: 1080 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.576943:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000055e03b4f pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997001856:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.576950:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000053ee5af1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997001792:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.576953:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d09f5ee1 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.576959:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211487 00000100:00100000:1.0:1651529344.576960:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+983:39029:x1731745946446912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.576960:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000000e7e66c4 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.576964:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177935 count 1 00010000:00010000:1.0:1651529344.576967:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e60de6b/0x3234de053c51301 lrc: 3/0,1 mode: --/PW res: [0x2b70f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.576968:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211488 00000100:00100000:0.0:1651529344.576969:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+983:39030:x1731745946446976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.576971:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002056e733/0x3234de053c4eca4 lrc: 2/0,0 mode: PR/PR res: [0x2b70f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6470 expref: 1080 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.576974:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:0.0:1651529344.576974:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177936 count 1 00010000:00010000:1.0:1651529344.576975:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.576975:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e60de6b/0x3234de053c51301 lrc: 4/0,1 mode: --/PW res: [0x2b70f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.576978:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfb26db5/0x3234de053c51308 lrc: 3/0,1 mode: --/PW res: [0x2b710:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.576981:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002056e733/0x3234de053c4eca4 lrc: 3/0,0 mode: PR/PR res: [0x2b70f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6470 expref: 1080 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.576982:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003e2e2708/0x3234de053c4ca53 lrc: 2/0,0 mode: PR/PR res: [0x2b710:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb09 expref: 1080 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.576985:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002056e733/0x3234de053c4eca4 lrc: 4/0,0 mode: PR/PR res: [0x2b70f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6470 expref: 1080 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.576985:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.576986:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.576986:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfb26db5/0x3234de053c51308 lrc: 4/0,1 mode: --/PW res: [0x2b710:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.576988:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fe004e2b pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997001920:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.576992:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003e2e2708/0x3234de053c4ca53 lrc: 3/0,0 mode: PR/PR res: [0x2b710:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb09 expref: 1080 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.576995:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a6b79b05 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.576996:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003e2e2708/0x3234de053c4ca53 lrc: 4/0,0 mode: PR/PR res: [0x2b710:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb09 expref: 1080 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.577000:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211489 00000100:00100000:0.0:1651529344.577000:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ea0220b6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997001984:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.577002:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+983:39030:x1731745946447040:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.577006:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177937 count 1 00000100:00100000:0.0:1651529344.577006:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 000000000a4def41 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.577008:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094bb6891/0x3234de053c5130f lrc: 3/0,1 mode: --/PW res: [0x2b711:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.577011:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5b283df/0x3234de053c512ec lrc: 2/0,0 mode: PW/PW res: [0x2b70b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.577014:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5b283df already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.577015:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e0742af9/0x3234de053c4d9b1 lrc: 2/0,0 mode: PR/PR res: [0x2b711:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1746 expref: 1080 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.577015:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5b283df/0x3234de053c512ec lrc: 2/0,0 mode: PW/PW res: [0x2b70b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577018:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.577018:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.577018:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5b283df/0x3234de053c512ec lrc: 3/0,0 mode: PW/PW res: [0x2b70b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577019:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094bb6891/0x3234de053c5130f lrc: 4/0,1 mode: --/PW res: [0x2b711:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.577022:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5b283df/0x3234de053c512ec lrc: 1/0,0 mode: --/PW res: [0x2b70b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577024:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e0742af9/0x3234de053c4d9b1 lrc: 3/0,0 mode: PR/PR res: [0x2b711:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1746 expref: 1080 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.577025:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5b283df/0x3234de053c512ec lrc: 0/0,0 mode: --/PW res: [0x2b70b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577028:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e0742af9/0x3234de053c4d9b1 lrc: 4/0,0 mode: PR/PR res: [0x2b711:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1746 expref: 1080 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.577031:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005912c4a3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997002048:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.577037:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 0000000057299e7f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.577071:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.577089:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946447104 00000100:00100000:0.0:1651529344.577097:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211490 00000100:00100000:0.0:1651529344.577099:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+984:39030:x1731745946447104:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.577102:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.577104:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177938 count 1 00000100:00100000:1.0:1651529344.577114:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.577114:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008eb0a7f4/0x3234de053c51316 lrc: 3/0,1 mode: --/PW res: [0x2b712:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.577138:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f05ca331/0x3234de053c4d5b3 lrc: 2/0,0 mode: PR/PR res: [0x2b712:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0827 expref: 1080 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.577141:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.577142:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.577143:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008eb0a7f4/0x3234de053c51316 lrc: 4/0,1 mode: --/PW res: [0x2b712:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.577150:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f05ca331/0x3234de053c4d5b3 lrc: 3/0,0 mode: PR/PR res: [0x2b712:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0827 expref: 1080 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.577156:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f05ca331/0x3234de053c4d5b3 lrc: 4/0,0 mode: PR/PR res: [0x2b712:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0827 expref: 1080 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.577160:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014f8af45 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997002112:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.577171:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e1aa6a77 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.577176:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946447168 00000100:00100000:0.0:1651529344.577189:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946447232 00000100:00100000:0.0:1651529344.577193:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211491 00000100:00100000:0.0:1651529344.577195:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+986:39029:x1731745946447168:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.577199:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177939 count 1 00000100:00100000:1.0:1651529344.577200:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211492 00000100:00100000:1.0:1651529344.577202:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+986:39030:x1731745946447232:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.577203:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059d45c45/0x3234de053c5131d lrc: 3/0,1 mode: --/PW res: [0x2b713:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.577208:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177940 count 1 00010000:00010000:0.0:1651529344.577208:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a6f99d04/0x3234de053c4ce66 lrc: 2/0,0 mode: PR/PR res: [0x2b713:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb24 expref: 1080 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.577211:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.577211:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.577212:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0dd8497/0x3234de053c51324 lrc: 3/0,1 mode: --/PW res: [0x2b714:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.577212:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059d45c45/0x3234de053c5131d lrc: 4/0,1 mode: --/PW res: [0x2b713:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577216:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e1964129/0x3234de053c4f040 lrc: 2/0,0 mode: PR/PR res: [0x2b714:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d73ce expref: 1080 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.577218:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a6f99d04/0x3234de053c4ce66 lrc: 3/0,0 mode: PR/PR res: [0x2b713:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb24 expref: 1080 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.577220:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.577220:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.577221:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0dd8497/0x3234de053c51324 lrc: 4/0,1 mode: --/PW res: [0x2b714:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577242:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e1964129/0x3234de053c4f040 lrc: 3/0,0 mode: PR/PR res: [0x2b714:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d73ce expref: 1080 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.577246:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e1964129/0x3234de053c4f040 lrc: 4/0,0 mode: PR/PR res: [0x2b714:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d73ce expref: 1080 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.577255:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c9f4ec84 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997002240:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.577261:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a6f99d04/0x3234de053c4ce66 lrc: 4/0,0 mode: PR/PR res: [0x2b713:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb24 expref: 1080 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.577264:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 0000000053a0cffa going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.577268:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000078f9a278 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997002176:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.577277:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 000000003003c8b0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.577296:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000055e03b4f pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997001856:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.577301:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b3443fb0/0x3234de053c512fa lrc: 3/0,1 mode: --/PW res: [0x2b70e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.577322:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000053ee5af1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997001792:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.577326:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dbb69211/0x3234de053c512f3 lrc: 3/0,1 mode: --/PW res: [0x2b70d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.577624:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fe004e2b pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997001920:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.577628:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000e60de6b/0x3234de053c51301 lrc: 3/0,1 mode: --/PW res: [0x2b70f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.577660:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.577668:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.577677:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005912c4a3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997002048:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.577677:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.577685:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000094bb6891/0x3234de053c5130f lrc: 3/0,1 mode: --/PW res: [0x2b711:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.577685:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.577693:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.577698:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396328000 00010000:00010000:1.0:1651529344.577708:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002056e733/0x3234de053c4eca4 lrc: 4/0,0 mode: PR/PR res: [0x2b70f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6470 expref: 1081 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.577712:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.577714:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396327936 00000100:00100000:0.0:1651529344.577716:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.577717:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e9934b5e/0x3234de053c4d8fb lrc: 4/0,0 mode: PR/PR res: [0x2b70e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d14ec expref: 1082 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.577721:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396328064 00000100:00100000:0.0:1651529344.577722:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.577723:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008564120b/0x3234de053c4ca5a lrc: 4/0,0 mode: PR/PR res: [0x2b70d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb25 expref: 1083 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.577727:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396328128 00010000:00010000:1.0:1651529344.577729:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003e2e2708/0x3234de053c4ca53 lrc: 5/0,0 mode: PR/PR res: [0x2b710:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb09 expref: 1084 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.577730:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ea0220b6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997001984:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.577733:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396328192 00010000:00010000:0.0:1651529344.577743:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bfb26db5/0x3234de053c51308 lrc: 3/0,1 mode: --/PW res: [0x2b710:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577745:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e0742af9/0x3234de053c4d9b1 lrc: 4/0,0 mode: PR/PR res: [0x2b711:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1746 expref: 1085 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.577749:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12267 00000100:00100000:1.0:1651529344.577751:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8f0043c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1085:41278:x1731746396328000:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.577752:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000078f9a278 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997002176:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.577753:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.577755:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002056e733/0x3234de053c4eca4 lrc: 4/0,0 mode: PR/PR res: [0x2b70f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6470 expref: 1085 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.577755:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000059d45c45/0x3234de053c5131d lrc: 3/0,1 mode: --/PW res: [0x2b713:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.577760:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014f8af45 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997002112:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.577761:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002056e733/0x3234de053c4eca4 lrc: 3/0,0 mode: PR/PR res: [0x2b70f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6470 expref: 1085 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.577763:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008eb0a7f4/0x3234de053c51316 lrc: 3/0,1 mode: --/PW res: [0x2b712:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577766:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002056e733/0x3234de053c4eca4 lrc: 0/0,0 mode: --/PR res: [0x2b70f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6470 expref: 1085 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.577769:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396328256 00010000:00010000:1.0:1651529344.577770:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.577770:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.577771:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000e60de6b/0x3234de053c51301 lrc: 3/0,1 mode: PW/PW res: [0x2b70f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577774:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e60de6b/0x3234de053c51301 lrc: 4/0,1 mode: PW/PW res: [0x2b70f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.577774:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f05ca331/0x3234de053c4d5b3 lrc: 4/0,0 mode: PR/PR res: [0x2b712:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0827 expref: 1085 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.577779:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396328384 00010000:00010000:1.0:1651529344.577781:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.577781:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a6f99d04/0x3234de053c4ce66 lrc: 4/0,0 mode: PR/PR res: [0x2b713:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb24 expref: 1086 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.577785:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396328320 00010000:00010000:0.0:1651529344.577787:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e1964129/0x3234de053c4f040 lrc: 5/0,0 mode: PR/PR res: [0x2b714:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d73ce expref: 1087 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.577790:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8f0043c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1087:41278:x1731746396328000:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.577792:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12268 00000100:00100000:1.0:1651529344.577794:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12267 00000100:00100000:0.0:1651529344.577794:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1087:41279:x1731746396327936:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.577797:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.577798:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e9934b5e/0x3234de053c4d8fb lrc: 4/0,0 mode: PR/PR res: [0x2b70e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d14ec expref: 1086 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.577802:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12269 00010000:00010000:0.0:1651529344.577802:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e9934b5e/0x3234de053c4d8fb lrc: 3/0,0 mode: PR/PR res: [0x2b70e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d14ec expref: 1086 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.577804:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1086:41278:x1731746396328064:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.577806:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.577807:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008564120b/0x3234de053c4ca5a lrc: 4/0,0 mode: PR/PR res: [0x2b70d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb25 expref: 1086 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.577808:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9934b5e/0x3234de053c4d8fb lrc: 0/0,0 mode: --/PR res: [0x2b70e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d14ec expref: 1086 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.577811:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008564120b/0x3234de053c4ca5a lrc: 3/0,0 mode: PR/PR res: [0x2b70d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb25 expref: 1085 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.577811:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.577812:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.577813:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b3443fb0/0x3234de053c512fa lrc: 3/0,1 mode: PW/PW res: [0x2b70e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577816:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008564120b/0x3234de053c4ca5a lrc: 0/0,0 mode: --/PR res: [0x2b70d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb25 expref: 1085 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.577816:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3443fb0/0x3234de053c512fa lrc: 4/0,1 mode: PW/PW res: [0x2b70e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577820:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.577820:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.577821:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dbb69211/0x3234de053c512f3 lrc: 3/0,1 mode: PW/PW res: [0x2b70d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.577826:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.577831:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dbb69211/0x3234de053c512f3 lrc: 4/0,1 mode: PW/PW res: [0x2b70d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.577833:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1084:41279:x1731746396327936:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 39us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.577836:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12268 00010000:00010000:1.0:1651529344.577840:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.577846:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1083:41278:x1731746396328064:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 41us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.577848:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12270 00000100:00100000:1.0:1651529344.577850:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12269 00000100:00100000:0.0:1651529344.577850:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1083:41279:x1731746396328128:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.577853:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.577855:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12271 00010000:00010000:0.0:1651529344.577855:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003e2e2708/0x3234de053c4ca53 lrc: 4/0,0 mode: PR/PR res: [0x2b710:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb09 expref: 1082 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.577856:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1082:41279:x1731746396328192:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.577859:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.577859:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003e2e2708/0x3234de053c4ca53 lrc: 3/0,0 mode: PR/PR res: [0x2b710:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb09 expref: 1082 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.577860:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e0742af9/0x3234de053c4d9b1 lrc: 4/0,0 mode: PR/PR res: [0x2b711:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1746 expref: 1082 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.577863:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e2e2708/0x3234de053c4ca53 lrc: 0/0,0 mode: --/PR res: [0x2b710:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb09 expref: 1082 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.577864:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e0742af9/0x3234de053c4d9b1 lrc: 3/0,0 mode: PR/PR res: [0x2b711:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1746 expref: 1082 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.577867:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.577867:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.577868:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bfb26db5/0x3234de053c51308 lrc: 3/0,1 mode: PW/PW res: [0x2b710:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577869:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0742af9/0x3234de053c4d9b1 lrc: 0/0,0 mode: --/PR res: [0x2b711:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1746 expref: 1081 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.577874:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.577874:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfb26db5/0x3234de053c51308 lrc: 4/0,1 mode: PW/PW res: [0x2b710:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577875:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.577876:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000094bb6891/0x3234de053c5130f lrc: 3/0,1 mode: PW/PW res: [0x2b711:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577878:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094bb6891/0x3234de053c5130f lrc: 4/0,1 mode: PW/PW res: [0x2b711:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.577879:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.577884:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.577885:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1080:41279:x1731746396328128:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.577888:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12270 00000100:00100000:1.0:1651529344.577889:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1080:41279:x1731746396328192:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.577892:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12271 00000100:00100000:0.0:1651529344.577893:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12272 00000100:00100000:0.0:1651529344.577895:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1078:41279:x1731746396328256:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.577896:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12273 00000100:00100000:1.0:1651529344.577897:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1078:41278:x1731746396328384:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.577897:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.577899:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.577899:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f05ca331/0x3234de053c4d5b3 lrc: 4/0,0 mode: PR/PR res: [0x2b712:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0827 expref: 1078 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.577901:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a6f99d04/0x3234de053c4ce66 lrc: 4/0,0 mode: PR/PR res: [0x2b713:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb24 expref: 1078 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.577902:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f05ca331/0x3234de053c4d5b3 lrc: 3/0,0 mode: PR/PR res: [0x2b712:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0827 expref: 1078 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.577905:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a6f99d04/0x3234de053c4ce66 lrc: 3/0,0 mode: PR/PR res: [0x2b713:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb24 expref: 1078 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.577907:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f05ca331/0x3234de053c4d5b3 lrc: 0/0,0 mode: --/PR res: [0x2b712:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0827 expref: 1078 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.577909:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6f99d04/0x3234de053c4ce66 lrc: 0/0,0 mode: --/PR res: [0x2b713:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb24 expref: 1078 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.577910:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.577910:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.577911:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008eb0a7f4/0x3234de053c51316 lrc: 3/0,1 mode: PW/PW res: [0x2b712:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577912:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.577913:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.577914:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000059d45c45/0x3234de053c5131d lrc: 3/0,1 mode: PW/PW res: [0x2b713:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.577914:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008eb0a7f4/0x3234de053c51316 lrc: 4/0,1 mode: PW/PW res: [0x2b712:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577916:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059d45c45/0x3234de053c5131d lrc: 4/0,1 mode: PW/PW res: [0x2b713:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.577922:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.577925:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.577929:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1076:41278:x1731746396328384:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 31us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.577932:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12273 00000100:00100000:0.0:1651529344.577933:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1076:41279:x1731746396328256:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 38us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.577936:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12274 00000100:00100000:0.0:1651529344.577937:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12272 00000100:00100000:1.0:1651529344.577938:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000496e37f3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1075:41278:x1731746396328320:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.577940:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.577941:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e1964129/0x3234de053c4f040 lrc: 5/0,0 mode: PR/PR res: [0x2b714:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d73ce expref: 1074 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.577944:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dbb69211/0x3234de053c512f3 lrc: 3/0,1 mode: PW/PW res: [0x2b70d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577945:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e1964129/0x3234de053c4f040 lrc: 4/0,0 mode: PR/PR res: [0x2b714:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d73ce expref: 1074 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.577947:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dbb69211/0x3234de053c512f3 lrc: 3/0,1 mode: PW/PW res: [0x2b70d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577949:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.577950:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.577950:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e0dd8497/0x3234de053c51324 lrc: 3/0,1 mode: PW/PW res: [0x2b714:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.577950:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dbb69211/0x3234de053c512f3 lrc: 3/0,1 mode: PW/PW res: [0x2b70d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577953:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0dd8497/0x3234de053c51324 lrc: 4/0,1 mode: PW/PW res: [0x2b714:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.577953:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dbb69211/0x3234de053c512f3 lrc: 2/0,0 mode: PW/PW res: [0x2b70d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577957:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.577962:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000496e37f3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1074:41278:x1731746396328320:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 24us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.577965:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12274 00010000:00010000:1.0:1651529344.577975:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b3443fb0/0x3234de053c512fa lrc: 3/0,1 mode: PW/PW res: [0x2b70e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577978:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3443fb0/0x3234de053c512fa lrc: 3/0,1 mode: PW/PW res: [0x2b70e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577981:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3443fb0/0x3234de053c512fa lrc: 3/0,1 mode: PW/PW res: [0x2b70e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.577984:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3443fb0/0x3234de053c512fa lrc: 2/0,0 mode: PW/PW res: [0x2b70e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.578001:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+987:39029:x1731745946446784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1099us (1209us total) trans 12885079540 rc 0/0 00000100:00100000:0.0:1651529344.578004:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211485 00010000:00010000:0.0:1651529344.578010:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bfb26db5/0x3234de053c51308 lrc: 3/0,1 mode: PW/PW res: [0x2b710:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578013:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bfb26db5/0x3234de053c51308 lrc: 3/0,1 mode: PW/PW res: [0x2b710:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578016:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfb26db5/0x3234de053c51308 lrc: 3/0,1 mode: PW/PW res: [0x2b710:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578019:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bfb26db5/0x3234de053c51308 lrc: 2/0,0 mode: PW/PW res: [0x2b710:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.578027:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+987:39030:x1731745946446848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1117us (1221us total) trans 12885079541 rc 0/0 00000100:00100000:1.0:1651529344.578030:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211486 00010000:00010000:1.0:1651529344.578037:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000e60de6b/0x3234de053c51301 lrc: 3/0,1 mode: PW/PW res: [0x2b70f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578040:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e60de6b/0x3234de053c51301 lrc: 3/0,1 mode: PW/PW res: [0x2b70f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578043:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e60de6b/0x3234de053c51301 lrc: 3/0,1 mode: PW/PW res: [0x2b70f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578046:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e60de6b/0x3234de053c51301 lrc: 2/0,0 mode: PW/PW res: [0x2b70f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.578053:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+987:39030:x1731745946446976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1083us (1206us total) trans 12885079542 rc 0/0 00000100:00100000:0.0:1651529344.578056:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211488 00010000:00010000:0.0:1651529344.578062:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000059d45c45/0x3234de053c5131d lrc: 3/0,1 mode: PW/PW res: [0x2b713:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578066:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059d45c45/0x3234de053c5131d lrc: 3/0,1 mode: PW/PW res: [0x2b713:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578069:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059d45c45/0x3234de053c5131d lrc: 3/0,1 mode: PW/PW res: [0x2b713:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578071:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059d45c45/0x3234de053c5131d lrc: 2/0,0 mode: PW/PW res: [0x2b713:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.578076:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+987:39029:x1731745946446912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1115us (1256us total) trans 12885079543 rc 0/0 00000100:00100000:1.0:1651529344.578079:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211487 00010000:00010000:1.0:1651529344.578089:0:72397:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1964129/0x3234de053c4f040 lrc: 0/0,0 mode: --/PR res: [0x2b714:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d73ce expref: 1073 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.578093:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c9f4ec84 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997002240:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.578096:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e0dd8497/0x3234de053c51324 lrc: 3/0,1 mode: PW/PW res: [0x2b714:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578100:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e0dd8497/0x3234de053c51324 lrc: 3/0,1 mode: PW/PW res: [0x2b714:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578102:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0dd8497/0x3234de053c51324 lrc: 3/0,1 mode: PW/PW res: [0x2b714:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.578102:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+987:39029:x1731745946447168:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 907us (1005us total) trans 12885079544 rc 0/0 00010000:00010000:1.0:1651529344.578105:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0dd8497/0x3234de053c51324 lrc: 3/0,1 mode: PW/PW res: [0x2b714:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.578105:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211491 00010000:00010000:1.0:1651529344.578108:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0dd8497/0x3234de053c51324 lrc: 2/0,0 mode: PW/PW res: [0x2b714:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578113:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dbb69211/0x3234de053c512f3 lrc: 2/0,0 mode: PW/PW res: [0x2b70d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578116:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dbb69211 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.578117:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbb69211/0x3234de053c512f3 lrc: 2/0,0 mode: PW/PW res: [0x2b70d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578120:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbb69211/0x3234de053c512f3 lrc: 3/0,0 mode: PW/PW res: [0x2b70d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578124:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dbb69211/0x3234de053c512f3 lrc: 1/0,0 mode: --/PW res: [0x2b70d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578127:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dbb69211/0x3234de053c512f3 lrc: 0/0,0 mode: --/PW res: [0x2b70d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578131:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3443fb0/0x3234de053c512fa lrc: 2/0,0 mode: PW/PW res: [0x2b70e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578134:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b3443fb0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.578135:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3443fb0/0x3234de053c512fa lrc: 2/0,0 mode: PW/PW res: [0x2b70e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578137:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3443fb0/0x3234de053c512fa lrc: 3/0,0 mode: PW/PW res: [0x2b70e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.578140:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+987:39030:x1731745946447232:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 938us (1026us total) trans 12885079545 rc 0/0 00010000:00010000:0.0:1651529344.578141:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3443fb0/0x3234de053c512fa lrc: 1/0,0 mode: --/PW res: [0x2b70e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.578143:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211492 00010000:00010000:0.0:1651529344.578143:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3443fb0/0x3234de053c512fa lrc: 0/0,0 mode: --/PW res: [0x2b70e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578147:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bfb26db5/0x3234de053c51308 lrc: 2/0,0 mode: PW/PW res: [0x2b710:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578150:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000094bb6891/0x3234de053c5130f lrc: 3/0,1 mode: PW/PW res: [0x2b711:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578151:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bfb26db5 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.578152:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfb26db5/0x3234de053c51308 lrc: 2/0,0 mode: PW/PW res: [0x2b710:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578153:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094bb6891/0x3234de053c5130f lrc: 3/0,1 mode: PW/PW res: [0x2b711:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578155:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfb26db5/0x3234de053c51308 lrc: 3/0,0 mode: PW/PW res: [0x2b710:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578156:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094bb6891/0x3234de053c5130f lrc: 3/0,1 mode: PW/PW res: [0x2b711:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578158:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bfb26db5/0x3234de053c51308 lrc: 1/0,0 mode: --/PW res: [0x2b710:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578159:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094bb6891/0x3234de053c5130f lrc: 2/0,0 mode: PW/PW res: [0x2b711:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578160:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfb26db5/0x3234de053c51308 lrc: 0/0,0 mode: --/PW res: [0x2b710:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578164:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e60de6b/0x3234de053c51301 lrc: 2/0,0 mode: PW/PW res: [0x2b70f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578166:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000e60de6b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.578167:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e60de6b/0x3234de053c51301 lrc: 2/0,0 mode: PW/PW res: [0x2b70f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578170:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e60de6b/0x3234de053c51301 lrc: 3/0,0 mode: PW/PW res: [0x2b70f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578173:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e60de6b/0x3234de053c51301 lrc: 1/0,0 mode: --/PW res: [0x2b70f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578175:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e60de6b/0x3234de053c51301 lrc: 0/0,0 mode: --/PW res: [0x2b70f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578179:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059d45c45/0x3234de053c5131d lrc: 2/0,0 mode: PW/PW res: [0x2b713:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578182:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000059d45c45 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.578183:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059d45c45/0x3234de053c5131d lrc: 2/0,0 mode: PW/PW res: [0x2b713:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578185:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059d45c45/0x3234de053c5131d lrc: 3/0,0 mode: PW/PW res: [0x2b713:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.578186:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+987:39030:x1731745946447040:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1183us (1317us total) trans 12885079546 rc 0/0 00010000:00010000:0.0:1651529344.578188:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059d45c45/0x3234de053c5131d lrc: 1/0,0 mode: --/PW res: [0x2b713:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.578189:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211489 00010000:00010000:0.0:1651529344.578191:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059d45c45/0x3234de053c5131d lrc: 0/0,0 mode: --/PW res: [0x2b713:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578194:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0dd8497/0x3234de053c51324 lrc: 2/0,0 mode: PW/PW res: [0x2b714:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578196:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e0dd8497 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.578197:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0dd8497/0x3234de053c51324 lrc: 2/0,0 mode: PW/PW res: [0x2b714:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578200:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0dd8497/0x3234de053c51324 lrc: 3/0,0 mode: PW/PW res: [0x2b714:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578203:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0dd8497/0x3234de053c51324 lrc: 1/0,0 mode: --/PW res: [0x2b714:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578206:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0dd8497/0x3234de053c51324 lrc: 0/0,0 mode: --/PW res: [0x2b714:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578209:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094bb6891/0x3234de053c5130f lrc: 2/0,0 mode: PW/PW res: [0x2b711:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578212:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000094bb6891 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.578212:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094bb6891/0x3234de053c5130f lrc: 2/0,0 mode: PW/PW res: [0x2b711:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578215:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094bb6891/0x3234de053c5130f lrc: 3/0,0 mode: PW/PW res: [0x2b711:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578218:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094bb6891/0x3234de053c5130f lrc: 1/0,0 mode: --/PW res: [0x2b711:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578221:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094bb6891/0x3234de053c5130f lrc: 0/0,0 mode: --/PW res: [0x2b711:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578242:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008eb0a7f4/0x3234de053c51316 lrc: 3/0,1 mode: PW/PW res: [0x2b712:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578250:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008eb0a7f4/0x3234de053c51316 lrc: 3/0,1 mode: PW/PW res: [0x2b712:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578253:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008eb0a7f4/0x3234de053c51316 lrc: 3/0,1 mode: PW/PW res: [0x2b712:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578256:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008eb0a7f4/0x3234de053c51316 lrc: 2/0,0 mode: PW/PW res: [0x2b712:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.578292:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+987:39030:x1731745946447104:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1192us (1222us total) trans 12885079547 rc 0/0 00000100:00100000:0.0:1651529344.578295:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211490 00010000:00010000:0.0:1651529344.578304:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008eb0a7f4/0x3234de053c51316 lrc: 2/0,0 mode: PW/PW res: [0x2b712:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578307:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008eb0a7f4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.578308:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008eb0a7f4/0x3234de053c51316 lrc: 2/0,0 mode: PW/PW res: [0x2b712:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578311:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008eb0a7f4/0x3234de053c51316 lrc: 3/0,0 mode: PW/PW res: [0x2b712:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578333:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008eb0a7f4/0x3234de053c51316 lrc: 1/0,0 mode: --/PW res: [0x2b712:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578337:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008eb0a7f4/0x3234de053c51316 lrc: 0/0,0 mode: --/PW res: [0x2b712:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.578437:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.578451:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.578456:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946447808 00000100:00100000:1.0:1651529344.578458:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946447872 00000100:00100000:0.0:1651529344.578468:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211493 00000100:00100000:0.0:1651529344.578474:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+988:39030:x1731745946447808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.578476:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211494 00000100:00100000:1.0:1651529344.578478:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+988:39029:x1731745946447872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.578480:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177941 count 1 00002000:00080000:1.0:1651529344.578484:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177942 count 1 00010000:00010000:0.0:1651529344.578485:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b1677ad/0x3234de053c5132b lrc: 3/0,1 mode: --/PW res: [0x2b715:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578488:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009698444d/0x3234de053c51332 lrc: 3/0,1 mode: --/PW res: [0x2b716:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578489:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c5a746a4/0x3234de053c4d11b lrc: 2/0,0 mode: PR/PR res: [0x2b715:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf60d expref: 1072 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.578493:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2bf14b4/0x3234de053c4f66e lrc: 2/0,0 mode: PR/PR res: [0x2b716:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c78 expref: 1072 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.578493:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.578493:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.578494:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b1677ad/0x3234de053c5132b lrc: 4/0,1 mode: --/PW res: [0x2b715:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578496:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.578497:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.578498:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009698444d/0x3234de053c51332 lrc: 4/0,1 mode: --/PW res: [0x2b716:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578501:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c5a746a4/0x3234de053c4d11b lrc: 3/0,0 mode: PR/PR res: [0x2b715:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf60d expref: 1072 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.578505:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c2bf14b4/0x3234de053c4f66e lrc: 3/0,0 mode: PR/PR res: [0x2b716:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c78 expref: 1072 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.578509:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c2bf14b4/0x3234de053c4f66e lrc: 4/0,0 mode: PR/PR res: [0x2b716:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c78 expref: 1072 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.578513:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fe004e2b pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997002368:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.578529:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.578542:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c5a746a4/0x3234de053c4d11b lrc: 4/0,0 mode: PR/PR res: [0x2b715:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf60d expref: 1072 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.578548:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014f8af45 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997002304:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.578558:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 0000000029ae2bb2 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.578568:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.578579:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.578586:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.578595:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946447936 00000100:00100000:1.0:1651529344.578598:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.578613:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.578613:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946448000 00000100:00100000:0.0:1651529344.578622:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946448064 00000100:00100000:1.0:1651529344.578623:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.578640:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946448128 00000100:00100000:1.0:1651529344.578647:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946448256 00000100:00100000:1.0:1651529344.578649:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946448192 00000100:00100000:0.0:1651529344.578652:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211495 00000100:00100000:1.0:1651529344.578654:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211496 00000100:00100000:0.0:1651529344.578654:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+994:39030:x1731745946447936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.578656:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+994:39030:x1731745946448000:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.578660:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177943 count 1 00002000:00080000:1.0:1651529344.578661:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177944 count 1 00010000:00010000:0.0:1651529344.578664:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c51339 lrc: 3/0,1 mode: --/PW res: [0x2b717:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578665:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c51340 lrc: 3/0,1 mode: --/PW res: [0x2b718:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578669:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a2ebb8fb/0x3234de053c4c743 lrc: 2/0,0 mode: PR/PR res: [0x2b718:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf4e expref: 1072 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.578669:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000865040d5/0x3234de053c4dec7 lrc: 2/0,0 mode: PR/PR res: [0x2b717:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2beb expref: 1072 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.578672:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.578672:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.578673:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.578673:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c51339 lrc: 4/0,1 mode: --/PW res: [0x2b717:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578674:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.578674:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c51340 lrc: 4/0,1 mode: --/PW res: [0x2b718:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578680:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a2ebb8fb/0x3234de053c4c743 lrc: 3/0,0 mode: PR/PR res: [0x2b718:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf4e expref: 1072 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.578680:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000865040d5/0x3234de053c4dec7 lrc: 3/0,0 mode: PR/PR res: [0x2b717:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2beb expref: 1072 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.578683:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000865040d5/0x3234de053c4dec7 lrc: 4/0,0 mode: PR/PR res: [0x2b717:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2beb expref: 1072 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.578684:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a2ebb8fb/0x3234de053c4c743 lrc: 4/0,0 mode: PR/PR res: [0x2b718:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf4e expref: 1072 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.578687:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000078f9a278 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997002432:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.578688:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000055e03b4f pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997002496:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.578700:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b7af823 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.578700:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 000000000e7e66c4 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.578705:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211497 00000100:00100000:1.0:1651529344.578708:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211498 00000100:00100000:0.0:1651529344.578708:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+994:39029:x1731745946448064:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.578710:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+994:39030:x1731745946448128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.578712:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177945 count 1 00002000:00080000:1.0:1651529344.578714:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177946 count 1 00010000:00010000:0.0:1651529344.578715:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51347 lrc: 3/0,1 mode: --/PW res: [0x2b719:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578717:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3eb2ea8/0x3234de053c5134e lrc: 3/0,1 mode: --/PW res: [0x2b71a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578719:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bb2d6d77/0x3234de053c4ce43 lrc: 2/0,0 mode: PR/PR res: [0x2b719:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea98 expref: 1072 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.578721:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000009548b62/0x3234de053c4de8f lrc: 2/0,0 mode: PR/PR res: [0x2b71a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2afd expref: 1072 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.578722:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.578722:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.578723:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51347 lrc: 4/0,1 mode: --/PW res: [0x2b719:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578724:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.578724:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.578725:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3eb2ea8/0x3234de053c5134e lrc: 4/0,1 mode: --/PW res: [0x2b71a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578731:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bb2d6d77/0x3234de053c4ce43 lrc: 3/0,0 mode: PR/PR res: [0x2b719:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea98 expref: 1072 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.578745:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000009548b62/0x3234de053c4de8f lrc: 3/0,0 mode: PR/PR res: [0x2b71a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2afd expref: 1072 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.578746:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bb2d6d77/0x3234de053c4ce43 lrc: 4/0,0 mode: PR/PR res: [0x2b719:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea98 expref: 1072 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.578749:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009548b62/0x3234de053c4de8f lrc: 4/0,0 mode: PR/PR res: [0x2b71a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2afd expref: 1072 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.578750:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ea0220b6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997002560:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.578753:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000086eaa330 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997002624:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.578758:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 000000008dd99533 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.578761:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e5f43e7 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.578765:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211499 00000100:00100000:1.0:1651529344.578767:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211500 00000100:00100000:0.0:1651529344.578767:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+994:39030:x1731745946448256:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.578769:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+994:39030:x1731745946448192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.578774:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177947 count 1 00010000:00010000:1.0:1651529344.578777:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51355 lrc: 3/0,1 mode: --/PW res: [0x2b71b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578781:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000293bb831/0x3234de053c4e002 lrc: 2/0,0 mode: PR/PR res: [0x2b71b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d311d expref: 1072 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.578790:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177948 count 1 00010000:00010000:1.0:1651529344.578791:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.578792:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.578793:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51355 lrc: 4/0,1 mode: --/PW res: [0x2b71b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.578794:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c5135c lrc: 3/0,1 mode: --/PW res: [0x2b71c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578799:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000293bb831/0x3234de053c4e002 lrc: 3/0,0 mode: PR/PR res: [0x2b71b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d311d expref: 1072 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.578799:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b21d9729/0x3234de053c4af25 lrc: 2/0,0 mode: PR/PR res: [0x2b71c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf9c expref: 1072 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.578802:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.578802:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.578803:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000293bb831/0x3234de053c4e002 lrc: 4/0,0 mode: PR/PR res: [0x2b71b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d311d expref: 1072 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.578803:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c5135c lrc: 4/0,1 mode: --/PW res: [0x2b71c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.578807:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c43262d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997002688:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.578810:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b21d9729/0x3234de053c4af25 lrc: 3/0,0 mode: PR/PR res: [0x2b71c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf9c expref: 1072 pid: 72395 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.578813:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a5495eb going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.578813:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b21d9729/0x3234de053c4af25 lrc: 4/0,0 mode: PR/PR res: [0x2b71c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf9c expref: 1072 pid: 72395 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.578817:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000053ee5af1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997002752:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.578826:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000afe7ff7b going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.578866:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014f8af45 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997002304:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.578870:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002b1677ad/0x3234de053c5132b lrc: 3/0,1 mode: --/PW res: [0x2b715:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.578873:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.578888:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fe004e2b pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997002368:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.578893:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009698444d/0x3234de053c51332 lrc: 3/0,1 mode: --/PW res: [0x2b716:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.578899:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396328960 00010000:00010000:1.0:1651529344.578928:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c2bf14b4/0x3234de053c4f66e lrc: 4/0,0 mode: PR/PR res: [0x2b716:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c78 expref: 1073 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.578937:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12275 00000100:00100000:1.0:1651529344.578938:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1073:41279:x1731746396328960:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.578941:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.578943:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c2bf14b4/0x3234de053c4f66e lrc: 4/0,0 mode: PR/PR res: [0x2b716:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c78 expref: 1073 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.578946:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c2bf14b4/0x3234de053c4f66e lrc: 3/0,0 mode: PR/PR res: [0x2b716:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c78 expref: 1073 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.578952:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2bf14b4/0x3234de053c4f66e lrc: 0/0,0 mode: --/PR res: [0x2b716:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c78 expref: 1073 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.578956:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.578956:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.578957:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009698444d/0x3234de053c51332 lrc: 3/0,1 mode: PW/PW res: [0x2b716:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578960:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009698444d/0x3234de053c51332 lrc: 4/0,1 mode: PW/PW res: [0x2b716:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578966:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.578979:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1072:41279:x1731746396328960:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 39us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.578981:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12275 00010000:00010000:1.0:1651529344.578989:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009698444d/0x3234de053c51332 lrc: 3/0,1 mode: PW/PW res: [0x2b716:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578992:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009698444d/0x3234de053c51332 lrc: 3/0,1 mode: PW/PW res: [0x2b716:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578995:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009698444d/0x3234de053c51332 lrc: 3/0,1 mode: PW/PW res: [0x2b716:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.578998:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009698444d/0x3234de053c51332 lrc: 2/0,0 mode: PW/PW res: [0x2b716:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.579016:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009698444d/0x3234de053c51332 lrc: 2/0,0 mode: PW/PW res: [0x2b716:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.579020:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009698444d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.579021:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009698444d/0x3234de053c51332 lrc: 2/0,0 mode: PW/PW res: [0x2b716:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.579024:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009698444d/0x3234de053c51332 lrc: 3/0,0 mode: PW/PW res: [0x2b716:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.579029:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009698444d/0x3234de053c51332 lrc: 1/0,0 mode: --/PW res: [0x2b716:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.579032:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009698444d/0x3234de053c51332 lrc: 0/0,0 mode: --/PW res: [0x2b716:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.579050:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+995:39029:x1731745946447872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 571us (598us total) trans 12885079548 rc 0/0 00000100:00100000:1.0:1651529344.579053:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211494 00000100:00100000:1.0:1651529344.579069:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.579083:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396329024 00010000:00010000:1.0:1651529344.579104:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c5a746a4/0x3234de053c4d11b lrc: 4/0,0 mode: PR/PR res: [0x2b715:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf60d expref: 1072 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.579111:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12276 00000100:00100000:0.0:1651529344.579123:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000078f9a278 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997002432:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.579124:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1072:41278:x1731746396329024:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.579127:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.579128:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c5a746a4/0x3234de053c4d11b lrc: 4/0,0 mode: PR/PR res: [0x2b715:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf60d expref: 1072 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.579128:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c51339 lrc: 3/0,1 mode: --/PW res: [0x2b717:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.579132:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c5a746a4/0x3234de053c4d11b lrc: 3/0,0 mode: PR/PR res: [0x2b715:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf60d expref: 1072 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.579138:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5a746a4/0x3234de053c4d11b lrc: 0/0,0 mode: --/PR res: [0x2b715:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf60d expref: 1072 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.579142:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.579142:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.579143:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002b1677ad/0x3234de053c5132b lrc: 3/0,1 mode: PW/PW res: [0x2b715:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.579146:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b1677ad/0x3234de053c5132b lrc: 4/0,1 mode: PW/PW res: [0x2b715:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.579155:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.579159:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002b1677ad/0x3234de053c5132b lrc: 3/0,1 mode: PW/PW res: [0x2b715:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.579162:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b1677ad/0x3234de053c5132b lrc: 3/0,1 mode: PW/PW res: [0x2b715:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.579165:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1071:41278:x1731746396329024:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 52us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.579168:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12276 00010000:00010000:0.0:1651529344.579170:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b1677ad/0x3234de053c5132b lrc: 3/0,1 mode: PW/PW res: [0x2b715:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.579173:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b1677ad/0x3234de053c5132b lrc: 2/0,0 mode: PW/PW res: [0x2b715:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.579178:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000055e03b4f pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997002496:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.579182:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c51340 lrc: 3/0,1 mode: --/PW res: [0x2b718:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.579220:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+995:39030:x1731745946447808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 749us (783us total) trans 12885079549 rc 0/0 00000100:00100000:0.0:1651529344.579241:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211493 00010000:00010000:0.0:1651529344.579248:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b1677ad/0x3234de053c5132b lrc: 2/0,0 mode: PW/PW res: [0x2b715:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.579252:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002b1677ad already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.579269:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b1677ad/0x3234de053c5132b lrc: 2/0,0 mode: PW/PW res: [0x2b715:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.579273:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b1677ad/0x3234de053c5132b lrc: 3/0,0 mode: PW/PW res: [0x2b715:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.579278:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b1677ad/0x3234de053c5132b lrc: 1/0,0 mode: --/PW res: [0x2b715:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.579281:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b1677ad/0x3234de053c5132b lrc: 0/0,0 mode: --/PW res: [0x2b715:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.579284:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.579339:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946448832 00000100:00100000:0.0:1651529344.579352:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211501 00000100:00100000:0.0:1651529344.579354:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+995:39029:x1731745946448832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.579359:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177949 count 1 00010000:00010000:0.0:1651529344.579363:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c51363 lrc: 3/0,1 mode: --/PW res: [0x2b71d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.579368:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000696f9da8/0x3234de053c4e9d3 lrc: 2/0,0 mode: PR/PR res: [0x2b71d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58ca expref: 1070 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.579371:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.579372:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.579372:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c51363 lrc: 4/0,1 mode: --/PW res: [0x2b71d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.579379:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000696f9da8/0x3234de053c4e9d3 lrc: 3/0,0 mode: PR/PR res: [0x2b71d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58ca expref: 1070 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.579382:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000696f9da8/0x3234de053c4e9d3 lrc: 4/0,0 mode: PR/PR res: [0x2b71d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58ca expref: 1070 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.579386:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000078f9a278 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997002816:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.579426:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 000000000e7e66c4 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.579443:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.579459:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946448896 00000100:00100000:0.0:1651529344.579473:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ea0220b6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997002560:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.579480:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211502 00000100:00100000:1.0:1651529344.579482:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+996:39029:x1731745946448896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.579483:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51347 lrc: 3/0,1 mode: --/PW res: [0x2b719:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.579487:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177950 count 1 00010000:00010000:1.0:1651529344.579492:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c5136a lrc: 3/0,1 mode: --/PW res: [0x2b71e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.579496:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000022eafa17/0x3234de053c4efad lrc: 2/0,0 mode: PR/PR res: [0x2b71e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7120 expref: 1070 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.579499:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.579500:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.579501:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c5136a lrc: 4/0,1 mode: --/PW res: [0x2b71e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.579507:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000022eafa17/0x3234de053c4efad lrc: 3/0,0 mode: PR/PR res: [0x2b71e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7120 expref: 1070 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.579511:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000022eafa17/0x3234de053c4efad lrc: 4/0,0 mode: PR/PR res: [0x2b71e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7120 expref: 1070 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.579515:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fe004e2b pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997002880:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.579530:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 0000000053a0cffa going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.579582:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.579583:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000053ee5af1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997002752:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.579587:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c5135c lrc: 3/0,1 mode: --/PW res: [0x2b71c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.579589:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.579595:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.579601:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.579609:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396329088 00000100:00100000:1.0:1651529344.579610:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.579615:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000865040d5/0x3234de053c4dec7 lrc: 4/0,0 mode: PR/PR res: [0x2b717:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2beb expref: 1071 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.579616:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.579621:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396329152 00000100:00100000:1.0:1651529344.579623:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000086eaa330 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997002624:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.579623:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a2ebb8fb/0x3234de053c4c743 lrc: 4/0,0 mode: PR/PR res: [0x2b718:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf4e expref: 1072 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.579627:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396329216 00010000:00010000:1.0:1651529344.579628:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e3eb2ea8/0x3234de053c5134e lrc: 3/0,1 mode: --/PW res: [0x2b71a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.579629:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bb2d6d77/0x3234de053c4ce43 lrc: 4/0,0 mode: PR/PR res: [0x2b719:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea98 expref: 1073 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.579634:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c43262d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997002688:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.579634:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396329344 00010000:00010000:0.0:1651529344.579636:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000293bb831/0x3234de053c4e002 lrc: 4/0,0 mode: PR/PR res: [0x2b71b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d311d expref: 1074 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.579637:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51355 lrc: 3/0,1 mode: --/PW res: [0x2b71b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.579640:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396329280 00010000:00010000:0.0:1651529344.579642:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000009548b62/0x3234de053c4de8f lrc: 4/0,0 mode: PR/PR res: [0x2b71a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2afd expref: 1075 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.579643:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396329408 00010000:00010000:1.0:1651529344.579647:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b21d9729/0x3234de053c4af25 lrc: 4/0,0 mode: PR/PR res: [0x2b71c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf9c expref: 1076 pid: 72395 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.579653:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12277 00000100:00100000:1.0:1651529344.579655:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1076:41279:x1731746396329088:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.579657:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.579659:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000865040d5/0x3234de053c4dec7 lrc: 4/0,0 mode: PR/PR res: [0x2b717:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2beb expref: 1076 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.579663:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000865040d5/0x3234de053c4dec7 lrc: 3/0,0 mode: PR/PR res: [0x2b717:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2beb expref: 1076 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.579668:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000865040d5/0x3234de053c4dec7 lrc: 0/0,0 mode: --/PR res: [0x2b717:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2beb expref: 1076 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.579672:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.579673:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.579673:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c51339 lrc: 3/0,1 mode: PW/PW res: [0x2b717:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.579676:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c51339 lrc: 4/0,1 mode: PW/PW res: [0x2b717:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.579676:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12278 00000100:00100000:0.0:1651529344.579678:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1075:41279:x1731746396329152:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.579682:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.579683:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a2ebb8fb/0x3234de053c4c743 lrc: 4/0,0 mode: PR/PR res: [0x2b718:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf4e expref: 1075 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.579686:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.579693:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a2ebb8fb/0x3234de053c4c743 lrc: 3/0,0 mode: PR/PR res: [0x2b718:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf4e expref: 1075 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.579695:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1075:41279:x1731746396329088:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 39us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.579698:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12277 00010000:00010000:0.0:1651529344.579699:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2ebb8fb/0x3234de053c4c743 lrc: 0/0,0 mode: --/PR res: [0x2b718:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf4e expref: 1075 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.579703:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12279 00010000:00010000:0.0:1651529344.579703:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.579703:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.579704:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1073:41279:x1731746396329216:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.579707:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.579708:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bb2d6d77/0x3234de053c4ce43 lrc: 4/0,0 mode: PR/PR res: [0x2b719:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea98 expref: 1073 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.579712:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bb2d6d77/0x3234de053c4ce43 lrc: 3/0,0 mode: PR/PR res: [0x2b719:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea98 expref: 1073 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.579714:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c51340 lrc: 3/0,1 mode: PW/PW res: [0x2b718:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.579716:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb2d6d77/0x3234de053c4ce43 lrc: 0/0,0 mode: --/PR res: [0x2b719:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea98 expref: 1073 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.579717:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c51340 lrc: 4/0,1 mode: PW/PW res: [0x2b718:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.579723:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.579723:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.579724:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51347 lrc: 3/0,1 mode: PW/PW res: [0x2b719:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.579728:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.579733:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51347 lrc: 4/0,1 mode: PW/PW res: [0x2b719:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.579745:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1072:41279:x1731746396329152:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 66us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.579748:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12278 00010000:00010000:1.0:1651529344.579752:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.579759:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1071:41279:x1731746396329216:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 54us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.579759:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12280 00000100:00100000:1.0:1651529344.579761:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12279 00000100:00100000:0.0:1651529344.579761:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1071:41279:x1731746396329344:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.579764:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.579766:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12281 00010000:00010000:0.0:1651529344.579766:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000293bb831/0x3234de053c4e002 lrc: 4/0,0 mode: PR/PR res: [0x2b71b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d311d expref: 1070 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.579768:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1070:41279:x1731746396329408:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.579770:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.579770:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000293bb831/0x3234de053c4e002 lrc: 3/0,0 mode: PR/PR res: [0x2b71b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d311d expref: 1070 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.579772:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b21d9729/0x3234de053c4af25 lrc: 4/0,0 mode: PR/PR res: [0x2b71c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf9c expref: 1070 pid: 72395 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.579775:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000293bb831/0x3234de053c4e002 lrc: 0/0,0 mode: --/PR res: [0x2b71b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d311d expref: 1070 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.579776:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b21d9729/0x3234de053c4af25 lrc: 3/0,0 mode: PR/PR res: [0x2b71c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf9c expref: 1070 pid: 72395 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.579778:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.579779:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.579780:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51355 lrc: 3/0,1 mode: PW/PW res: [0x2b71b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.579781:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b21d9729/0x3234de053c4af25 lrc: 0/0,0 mode: --/PR res: [0x2b71c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf9c expref: 1069 pid: 72395 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.579783:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51355 lrc: 4/0,1 mode: PW/PW res: [0x2b71b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.579784:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.579785:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.579786:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c5135c lrc: 3/0,1 mode: PW/PW res: [0x2b71c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.579789:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c5135c lrc: 4/0,1 mode: PW/PW res: [0x2b71c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.579792:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.579799:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1068:41279:x1731746396329344:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.579801:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12280 00010000:00010000:1.0:1651529344.579804:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.579809:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1067:41279:x1731746396329408:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.579811:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12282 00000100:00100000:1.0:1651529344.579813:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12281 00000100:00100000:0.0:1651529344.579813:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d177f8a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1067:41279:x1731746396329280:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.579816:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.579818:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000009548b62/0x3234de053c4de8f lrc: 4/0,0 mode: PR/PR res: [0x2b71a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2afd expref: 1066 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.579821:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c51340 lrc: 3/0,1 mode: PW/PW res: [0x2b718:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.579822:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000009548b62/0x3234de053c4de8f lrc: 3/0,0 mode: PR/PR res: [0x2b71a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2afd expref: 1066 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.579825:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c51340 lrc: 3/0,1 mode: PW/PW res: [0x2b718:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.579826:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009548b62/0x3234de053c4de8f lrc: 0/0,0 mode: --/PR res: [0x2b71a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2afd expref: 1066 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.579828:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c51340 lrc: 3/0,1 mode: PW/PW res: [0x2b718:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.579830:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c51340 lrc: 2/0,0 mode: PW/PW res: [0x2b718:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.579830:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.579830:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.579831:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e3eb2ea8/0x3234de053c5134e lrc: 3/0,1 mode: PW/PW res: [0x2b71a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.579834:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3eb2ea8/0x3234de053c5134e lrc: 4/0,1 mode: PW/PW res: [0x2b71a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.579848:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.579854:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d177f8a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1065:41279:x1731746396329280:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.579856:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12282 00010000:00010000:0.0:1651529344.579867:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51347 lrc: 3/0,1 mode: PW/PW res: [0x2b719:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.579870:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51347 lrc: 3/0,1 mode: PW/PW res: [0x2b719:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.579873:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51347 lrc: 3/0,1 mode: PW/PW res: [0x2b719:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.579878:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51347 lrc: 2/0,0 mode: PW/PW res: [0x2b719:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.579879:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+997:39030:x1731745946448000:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1222us (1299us total) trans 12885079550 rc 0/0 00000100:00100000:1.0:1651529344.579882:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211496 00010000:00010000:1.0:1651529344.579889:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51355 lrc: 3/0,1 mode: PW/PW res: [0x2b71b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.579894:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51355 lrc: 3/0,1 mode: PW/PW res: [0x2b71b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.579897:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51355 lrc: 3/0,1 mode: PW/PW res: [0x2b71b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.579900:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51355 lrc: 2/0,0 mode: PW/PW res: [0x2b71b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.579927:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+998:39029:x1731745946448064:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1219us (1340us total) trans 12885079551 rc 0/0 00000100:00100000:0.0:1651529344.579930:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211497 00010000:00010000:0.0:1651529344.579937:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c5135c lrc: 3/0,1 mode: PW/PW res: [0x2b71c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.579940:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+997:39030:x1731745946448192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1170us (1317us total) trans 12885079552 rc 0/0 00010000:00010000:0.0:1651529344.579940:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c5135c lrc: 3/0,1 mode: PW/PW res: [0x2b71c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.579943:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211500 00010000:00010000:0.0:1651529344.579943:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c5135c lrc: 3/0,1 mode: PW/PW res: [0x2b71c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.579946:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c5135c lrc: 2/0,0 mode: PW/PW res: [0x2b71c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.579949:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e3eb2ea8/0x3234de053c5134e lrc: 3/0,1 mode: PW/PW res: [0x2b71a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.579952:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3eb2ea8/0x3234de053c5134e lrc: 3/0,1 mode: PW/PW res: [0x2b71a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.579955:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3eb2ea8/0x3234de053c5134e lrc: 3/0,1 mode: PW/PW res: [0x2b71a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.579958:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3eb2ea8/0x3234de053c5134e lrc: 2/0,0 mode: PW/PW res: [0x2b71a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.579998:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+998:39030:x1731745946448128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1287us (1404us total) trans 12885079553 rc 0/0 00000100:00100000:1.0:1651529344.580002:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211498 00000100:00100000:0.0:1651529344.580006:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+997:39030:x1731745946448256:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1239us (1398us total) trans 12885079554 rc 0/0 00000100:00100000:0.0:1651529344.580009:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211499 00010000:00010000:0.0:1651529344.580017:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c51340 lrc: 2/0,0 mode: PW/PW res: [0x2b718:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580027:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ea00c64e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.580028:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c51340 lrc: 2/0,0 mode: PW/PW res: [0x2b718:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580032:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c51340 lrc: 3/0,0 mode: PW/PW res: [0x2b718:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580037:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c51340 lrc: 1/0,0 mode: --/PW res: [0x2b718:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580040:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c51340 lrc: 0/0,0 mode: --/PW res: [0x2b718:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.580042:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.580044:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51347 lrc: 2/0,0 mode: PW/PW res: [0x2b719:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580052:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eb50e2ae already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.580052:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51347 lrc: 2/0,0 mode: PW/PW res: [0x2b719:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.580055:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.580055:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51347 lrc: 3/0,0 mode: PW/PW res: [0x2b719:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580058:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51347 lrc: 1/0,0 mode: --/PW res: [0x2b719:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580061:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c51347 lrc: 0/0,0 mode: --/PW res: [0x2b719:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580065:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51355 lrc: 2/0,0 mode: PW/PW res: [0x2b71b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580068:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eaaf5dcd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.580068:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51355 lrc: 2/0,0 mode: PW/PW res: [0x2b71b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580071:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51355 lrc: 3/0,0 mode: PW/PW res: [0x2b71b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580074:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51355 lrc: 1/0,0 mode: --/PW res: [0x2b71b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580077:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51355 lrc: 0/0,0 mode: --/PW res: [0x2b71b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580080:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3eb2ea8/0x3234de053c5134e lrc: 2/0,0 mode: PW/PW res: [0x2b71a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580082:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e3eb2ea8 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.580083:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3eb2ea8/0x3234de053c5134e lrc: 2/0,0 mode: PW/PW res: [0x2b71a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580086:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3eb2ea8/0x3234de053c5134e lrc: 3/0,0 mode: PW/PW res: [0x2b71a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580089:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3eb2ea8/0x3234de053c5134e lrc: 1/0,0 mode: --/PW res: [0x2b71a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580091:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3eb2ea8/0x3234de053c5134e lrc: 0/0,0 mode: --/PW res: [0x2b71a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580095:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c5135c lrc: 2/0,0 mode: PW/PW res: [0x2b71c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580097:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a0607df4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.580098:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c5135c lrc: 2/0,0 mode: PW/PW res: [0x2b71c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580100:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c5135c lrc: 3/0,0 mode: PW/PW res: [0x2b71c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580103:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c5135c lrc: 1/0,0 mode: --/PW res: [0x2b71c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580106:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c5135c lrc: 0/0,0 mode: --/PW res: [0x2b71c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580112:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c51339 lrc: 3/0,1 mode: PW/PW res: [0x2b717:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580115:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c51339 lrc: 3/0,1 mode: PW/PW res: [0x2b717:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580118:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c51339 lrc: 3/0,1 mode: PW/PW res: [0x2b717:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580121:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c51339 lrc: 2/0,0 mode: PW/PW res: [0x2b717:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.580156:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fe004e2b pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997002880:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.580161:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c5136a lrc: 3/0,1 mode: --/PW res: [0x2b71e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.580168:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396329728 00010000:00010000:1.0:1651529344.580173:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000022eafa17/0x3234de053c4efad lrc: 4/0,0 mode: PR/PR res: [0x2b71e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7120 expref: 1065 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.580179:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+997:39030:x1731745946447936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1524us (1617us total) trans 12885079555 rc 0/0 00000100:00100000:0.0:1651529344.580182:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211495 00000100:00100000:1.0:1651529344.580186:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396329536 00010000:00010000:1.0:1651529344.580189:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000696f9da8/0x3234de053c4e9d3 lrc: 5/0,0 mode: PR/PR res: [0x2b71d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58ca expref: 1066 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.580195:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12283 00000100:00100000:1.0:1651529344.580196:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1066:41279:x1731746396329728:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.580199:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.580200:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000022eafa17/0x3234de053c4efad lrc: 4/0,0 mode: PR/PR res: [0x2b71e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7120 expref: 1066 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.580203:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c51339 lrc: 2/0,0 mode: PW/PW res: [0x2b717:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580204:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000022eafa17/0x3234de053c4efad lrc: 3/0,0 mode: PR/PR res: [0x2b71e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7120 expref: 1066 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.580207:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006c0ed60a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.580208:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c51339 lrc: 2/0,0 mode: PW/PW res: [0x2b717:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580209:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022eafa17/0x3234de053c4efad lrc: 0/0,0 mode: --/PR res: [0x2b71e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7120 expref: 1066 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.580211:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c51339 lrc: 3/0,0 mode: PW/PW res: [0x2b717:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580215:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c51339 lrc: 1/0,0 mode: --/PW res: [0x2b717:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580216:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.580216:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.580217:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c5136a lrc: 3/0,1 mode: PW/PW res: [0x2b71e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580218:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c51339 lrc: 0/0,0 mode: --/PW res: [0x2b717:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580220:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c5136a lrc: 4/0,1 mode: PW/PW res: [0x2b71e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580243:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.580250:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1065:41279:x1731746396329728:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 53us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.580253:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12283 00000100:00100000:1.0:1651529344.580257:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12284 00000100:00100000:1.0:1651529344.580259:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1064:41278:x1731746396329536:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.580261:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.580263:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000696f9da8/0x3234de053c4e9d3 lrc: 5/0,0 mode: PR/PR res: [0x2b71d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58ca expref: 1064 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.580267:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000696f9da8/0x3234de053c4e9d3 lrc: 4/0,0 mode: PR/PR res: [0x2b71d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58ca expref: 1064 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.580271:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.580272:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.580273:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c51363 lrc: 3/0,1 mode: PW/PW res: [0x2b71d:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580273:0:156655:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000696f9da8/0x3234de053c4e9d3 lrc: 0/0,0 mode: --/PR res: [0x2b71d:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d58ca expref: 1064 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.580278:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c51363 lrc: 4/0,1 mode: PW/PW res: [0x2b71d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.580278:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000078f9a278 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997002816:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.580282:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.580282:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c51363 lrc: 4/0,1 mode: PW/PW res: [0x2b71d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.580286:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1063:41278:x1731746396329536:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 27us (232us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.580287:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c51363 lrc: 3/0,1 mode: PW/PW res: [0x2b71d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.580289:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12284 00010000:00010000:0.0:1651529344.580290:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c51363 lrc: 3/0,1 mode: PW/PW res: [0x2b71d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580293:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c51363 lrc: 3/0,1 mode: PW/PW res: [0x2b71d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580294:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c5136a lrc: 3/0,1 mode: PW/PW res: [0x2b71e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580296:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c51363 lrc: 2/0,0 mode: PW/PW res: [0x2b71d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580298:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c5136a lrc: 3/0,1 mode: PW/PW res: [0x2b71e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580301:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c5136a lrc: 3/0,1 mode: PW/PW res: [0x2b71e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580303:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c5136a lrc: 2/0,0 mode: PW/PW res: [0x2b71e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.580341:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+998:39029:x1731745946448832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 986us (1057us total) trans 12885079556 rc 0/0 00000100:00100000:0.0:1651529344.580344:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211501 00000100:00100000:1.0:1651529344.580345:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+998:39029:x1731745946448896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 863us (902us total) trans 12885079557 rc 0/0 00000100:00100000:1.0:1651529344.580348:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211502 00010000:00010000:0.0:1651529344.580351:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c51363 lrc: 2/0,0 mode: PW/PW res: [0x2b71d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580354:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000734ecdfd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.580355:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c51363 lrc: 2/0,0 mode: PW/PW res: [0x2b71d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580358:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c51363 lrc: 3/0,0 mode: PW/PW res: [0x2b71d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580362:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c51363 lrc: 1/0,0 mode: --/PW res: [0x2b71d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580365:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c51363 lrc: 0/0,0 mode: --/PW res: [0x2b71d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580369:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c5136a lrc: 2/0,0 mode: PW/PW res: [0x2b71e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580372:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088cc87df already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.580373:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c5136a lrc: 2/0,0 mode: PW/PW res: [0x2b71e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580376:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c5136a lrc: 3/0,0 mode: PW/PW res: [0x2b71e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580379:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c5136a lrc: 1/0,0 mode: --/PW res: [0x2b71e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580381:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c5136a lrc: 0/0,0 mode: --/PW res: [0x2b71e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.580383:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.580410:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.580429:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946449024 00000100:00100000:1.0:1651529344.580444:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946449088 00000100:00100000:0.0:1651529344.580447:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211503 00000100:00100000:0.0:1651529344.580449:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+998:39030:x1731745946449024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.580455:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211504 00000100:00100000:1.0:1651529344.580457:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+998:39029:x1731745946449088:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.580460:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177952 count 1 00002000:00080000:1.0:1651529344.580462:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177953 count 1 00010000:00010000:0.0:1651529344.580464:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c51371 lrc: 3/0,1 mode: --/PW res: [0x2b720:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580467:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51378 lrc: 3/0,1 mode: --/PW res: [0x2b721:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580471:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000254546df/0x3234de053c4de88 lrc: 2/0,0 mode: PR/PR res: [0x2b721:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2aef expref: 1062 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.580471:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba3bcbdf/0x3234de053c4a11e lrc: 2/0,0 mode: PR/PR res: [0x2b720:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb8e2 expref: 1062 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.580474:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.580474:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.580475:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.580475:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.580476:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51378 lrc: 4/0,1 mode: --/PW res: [0x2b721:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580476:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c51371 lrc: 4/0,1 mode: --/PW res: [0x2b720:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580482:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000254546df/0x3234de053c4de88 lrc: 3/0,0 mode: PR/PR res: [0x2b721:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2aef expref: 1062 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.580486:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000254546df/0x3234de053c4de88 lrc: 4/0,0 mode: PR/PR res: [0x2b721:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2aef expref: 1062 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.580490:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bddc5ca7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997002944:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.580497:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ba3bcbdf/0x3234de053c4a11e lrc: 3/0,0 mode: PR/PR res: [0x2b720:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb8e2 expref: 1062 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.580501:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ba3bcbdf/0x3234de053c4a11e lrc: 4/0,0 mode: PR/PR res: [0x2b720:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb8e2 expref: 1062 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.580504:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 0000000053a0cffa going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.580512:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000053ee5af1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997003008:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.580516:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.580521:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ff7bf023 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.580527:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946448960 00000100:00100000:1.0:1651529344.580531:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.580546:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946449152 00000100:00100000:0.0:1651529344.580553:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211505 00000100:00100000:0.0:1651529344.580555:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1000:39030:x1731745946448960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.580560:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177951 count 1 00010000:00010000:0.0:1651529344.580564:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c5137f lrc: 3/0,1 mode: --/PW res: [0x2b71f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580568:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000089e57af8/0x3234de053c4c996 lrc: 2/0,0 mode: PR/PR res: [0x2b71f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd823 expref: 1062 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.580579:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.580606:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.580615:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.580618:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.580619:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.580619:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c5137f lrc: 4/0,1 mode: --/PW res: [0x2b71f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.580623:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.580627:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000089e57af8/0x3234de053c4c996 lrc: 3/0,0 mode: PR/PR res: [0x2b71f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd823 expref: 1062 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.580629:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946449216 00010000:00010000:0.0:1651529344.580631:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000089e57af8/0x3234de053c4c996 lrc: 4/0,0 mode: PR/PR res: [0x2b71f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd823 expref: 1062 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.580635:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946449280 00000100:00100000:0.0:1651529344.580635:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ea0220b6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997003072:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.580637:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946449344 00000100:00100000:1.0:1651529344.580639:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946449408 00000100:00100000:1.0:1651529344.580642:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211506 00000100:00100000:1.0:1651529344.580644:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e578d0c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1004:39030:x1731745946449152:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.580649:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e1aa6a77 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.580655:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177954 count 1 00000100:00100000:0.0:1651529344.580656:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211507 00000100:00100000:0.0:1651529344.580658:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1004:39030:x1731745946449216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.580659:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51386 lrc: 3/0,1 mode: --/PW res: [0x2b722:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.580663:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177955 count 1 00010000:00010000:1.0:1651529344.580664:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000111401ed/0x3234de053c4d93a lrc: 2/0,0 mode: PR/PR res: [0x2b722:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d15a2 expref: 1062 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.580667:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.580667:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.580667:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c5138d lrc: 3/0,1 mode: --/PW res: [0x2b723:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580668:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51386 lrc: 4/0,1 mode: --/PW res: [0x2b722:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580671:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d9354cc1/0x3234de053c4de81 lrc: 2/0,0 mode: PR/PR res: [0x2b723:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ae1 expref: 1062 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.580674:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000111401ed/0x3234de053c4d93a lrc: 3/0,0 mode: PR/PR res: [0x2b722:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d15a2 expref: 1062 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.580674:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.580675:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.580675:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c5138d lrc: 4/0,1 mode: --/PW res: [0x2b723:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580678:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000111401ed/0x3234de053c4d93a lrc: 4/0,0 mode: PR/PR res: [0x2b722:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d15a2 expref: 1062 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.580682:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d6486d55 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997003136:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.580690:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f79d8146 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.580697:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211508 00010000:00010000:0.0:1651529344.580697:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d9354cc1/0x3234de053c4de81 lrc: 3/0,0 mode: PR/PR res: [0x2b723:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ae1 expref: 1062 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.580698:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1004:39030:x1731745946449280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.580701:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d9354cc1/0x3234de053c4de81 lrc: 4/0,0 mode: PR/PR res: [0x2b723:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ae1 expref: 1062 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:1.0:1651529344.580702:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177956 count 1 00000100:00100000:0.0:1651529344.580705:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014f8af45 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997003200:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.580706:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51394 lrc: 3/0,1 mode: --/PW res: [0x2b724:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580710:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000087c25fa6/0x3234de053c4e33c lrc: 2/0,0 mode: PR/PR res: [0x2b724:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3df7 expref: 1062 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.580713:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.580714:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.580714:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51394 lrc: 4/0,1 mode: --/PW res: [0x2b724:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580720:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000087c25fa6/0x3234de053c4e33c lrc: 3/0,0 mode: PR/PR res: [0x2b724:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3df7 expref: 1062 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.580723:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000087c25fa6/0x3234de053c4e33c lrc: 4/0,0 mode: PR/PR res: [0x2b724:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3df7 expref: 1062 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.580724:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a82c4968 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.580727:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c43262d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997003264:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.580731:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211509 00000100:00100000:0.0:1651529344.580732:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1004:39029:x1731745946449344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.580743:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000412e5d26 going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.580746:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177957 count 1 00000100:00100000:1.0:1651529344.580750:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211510 00010000:00010000:0.0:1651529344.580750:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c5139b lrc: 3/0,1 mode: --/PW res: [0x2b725:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.580752:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1004:39030:x1731745946449408:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.580754:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000960c9563/0x3234de053c4e875 lrc: 2/0,0 mode: PR/PR res: [0x2b725:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d52bf expref: 1062 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.580756:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177958 count 1 00010000:00010000:0.0:1651529344.580757:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.580758:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.580759:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c5139b lrc: 4/0,1 mode: --/PW res: [0x2b725:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580760:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c513a2 lrc: 3/0,1 mode: --/PW res: [0x2b726:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580764:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a2fa60e6/0x3234de053c4e2fd lrc: 2/0,0 mode: PR/PR res: [0x2b726:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3cfb expref: 1062 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.580765:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000960c9563/0x3234de053c4e875 lrc: 3/0,0 mode: PR/PR res: [0x2b725:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d52bf expref: 1062 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.580768:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000960c9563/0x3234de053c4e875 lrc: 4/0,0 mode: PR/PR res: [0x2b725:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d52bf expref: 1062 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.580770:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.580770:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.580771:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c513a2 lrc: 4/0,1 mode: --/PW res: [0x2b726:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.580772:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002a957ba7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997003328:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.580777:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a2fa60e6/0x3234de053c4e2fd lrc: 3/0,0 mode: PR/PR res: [0x2b726:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3cfb expref: 1062 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.580780:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a2fa60e6/0x3234de053c4e2fd lrc: 4/0,0 mode: PR/PR res: [0x2b726:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3cfb expref: 1062 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.580780:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 0000000076b354b3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.580784:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000086eaa330 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997003392:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.580791:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 0000000020dd7827 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.580808:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bddc5ca7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997002944:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.580813:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51378 lrc: 3/0,1 mode: --/PW res: [0x2b721:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.580829:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000053ee5af1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997003008:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.580833:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c51371 lrc: 3/0,1 mode: --/PW res: [0x2b720:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.580888:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.580896:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.580906:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396330176 00010000:00010000:1.0:1651529344.580912:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ba3bcbdf/0x3234de053c4a11e lrc: 4/0,0 mode: PR/PR res: [0x2b720:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb8e2 expref: 1063 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.580918:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396330112 00000100:00100000:1.0:1651529344.580920:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12285 00000100:00100000:1.0:1651529344.580922:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1064:41278:x1731746396330176:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.580924:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000254546df/0x3234de053c4de88 lrc: 4/0,0 mode: PR/PR res: [0x2b721:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2aef expref: 1064 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.580925:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.580926:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ba3bcbdf/0x3234de053c4a11e lrc: 4/0,0 mode: PR/PR res: [0x2b720:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb8e2 expref: 1064 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.580930:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ba3bcbdf/0x3234de053c4a11e lrc: 3/0,0 mode: PR/PR res: [0x2b720:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb8e2 expref: 1064 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.580936:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12286 00000100:00100000:0.0:1651529344.580937:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1064:41279:x1731746396330112:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.580941:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.580942:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba3bcbdf/0x3234de053c4a11e lrc: 0/0,0 mode: --/PR res: [0x2b720:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb8e2 expref: 1064 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.580942:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000254546df/0x3234de053c4de88 lrc: 4/0,0 mode: PR/PR res: [0x2b721:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2aef expref: 1064 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.580946:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.580946:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000254546df/0x3234de053c4de88 lrc: 3/0,0 mode: PR/PR res: [0x2b721:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2aef expref: 1063 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.580947:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.580948:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c51371 lrc: 3/0,1 mode: PW/PW res: [0x2b720:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580951:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c51371 lrc: 4/0,1 mode: PW/PW res: [0x2b720:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580952:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000254546df/0x3234de053c4de88 lrc: 0/0,0 mode: --/PR res: [0x2b721:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2aef expref: 1063 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.580960:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.580963:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.580964:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.580965:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51378 lrc: 3/0,1 mode: PW/PW res: [0x2b721:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580968:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51378 lrc: 4/0,1 mode: PW/PW res: [0x2b721:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.580969:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1062:41278:x1731746396330176:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 46us (81us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.580971:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12285 00010000:00010000:1.0:1651529344.580986:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51378 lrc: 4/0,1 mode: PW/PW res: [0x2b721:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580990:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51378 lrc: 4/0,1 mode: PW/PW res: [0x2b721:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.580992:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.580993:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51378 lrc: 3/0,1 mode: PW/PW res: [0x2b721:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.580998:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51378 lrc: 2/0,0 mode: PW/PW res: [0x2b721:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.581000:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1061:41279:x1731746396330112:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 62us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.581003:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12286 00010000:00010000:0.0:1651529344.581016:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51378 lrc: 2/0,0 mode: PW/PW res: [0x2b721:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581019:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e6b94407 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.581020:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51378 lrc: 2/0,0 mode: PW/PW res: [0x2b721:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581023:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51378 lrc: 3/0,0 mode: PW/PW res: [0x2b721:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581028:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51378 lrc: 1/0,0 mode: --/PW res: [0x2b721:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581030:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51378 lrc: 0/0,0 mode: --/PW res: [0x2b721:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.581039:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1005:39029:x1731745946449088:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 581us (628us total) trans 12885079558 rc 0/0 00010000:00010000:0.0:1651529344.581039:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c51371 lrc: 3/0,1 mode: PW/PW res: [0x2b720:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.581041:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211504 00010000:00010000:0.0:1651529344.581042:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c51371 lrc: 3/0,1 mode: PW/PW res: [0x2b720:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581045:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c51371 lrc: 3/0,1 mode: PW/PW res: [0x2b720:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581047:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c51371 lrc: 2/0,0 mode: PW/PW res: [0x2b720:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.581093:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1005:39030:x1731745946449024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 643us (710us total) trans 12885079559 rc 0/0 00000100:00100000:0.0:1651529344.581096:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211503 00010000:00010000:0.0:1651529344.581103:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c51371 lrc: 2/0,0 mode: PW/PW res: [0x2b720:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581106:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cdc65e28 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.581107:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c51371 lrc: 2/0,0 mode: PW/PW res: [0x2b720:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581110:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c51371 lrc: 3/0,0 mode: PW/PW res: [0x2b720:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581114:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c51371 lrc: 1/0,0 mode: --/PW res: [0x2b720:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581117:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c51371 lrc: 0/0,0 mode: --/PW res: [0x2b720:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.581126:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ea0220b6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997003072:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.581130:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c5137f lrc: 3/0,1 mode: --/PW res: [0x2b71f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.581237:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d6486d55 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997003136:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.581247:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51386 lrc: 3/0,1 mode: --/PW res: [0x2b722:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.581259:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c43262d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997003264:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.581262:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51394 lrc: 3/0,1 mode: --/PW res: [0x2b724:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.581262:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002a957ba7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997003328:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.581266:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c5139b lrc: 3/0,1 mode: --/PW res: [0x2b725:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.581273:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014f8af45 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997003200:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.581275:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c5138d lrc: 3/0,1 mode: --/PW res: [0x2b723:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.581288:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.581296:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.581298:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.581313:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946449920 00000100:00100000:1.0:1651529344.581315:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.581321:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946449984 00000100:00100000:0.0:1651529344.581328:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211511 00000100:00100000:0.0:1651529344.581329:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1006:39030:x1731745946449920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.581332:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:0.0:1651529344.581335:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177959 count 1 00000100:00100000:1.0:1651529344.581339:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.581339:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000954b1161/0x3234de053c513a9 lrc: 3/0,1 mode: --/PW res: [0x2b727:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.581345:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.581346:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009b442b4b/0x3234de053c4b07c lrc: 2/0,0 mode: PR/PR res: [0x2b727:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc036 expref: 1060 pid: 80278 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.581349:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.581349:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.581350:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000954b1161/0x3234de053c513a9 lrc: 4/0,1 mode: --/PW res: [0x2b727:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.581351:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.581356:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009b442b4b/0x3234de053c4b07c lrc: 3/0,0 mode: PR/PR res: [0x2b727:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc036 expref: 1060 pid: 80278 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.581358:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000086eaa330 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997003392:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.581360:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009b442b4b/0x3234de053c4b07c lrc: 4/0,0 mode: PR/PR res: [0x2b727:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc036 expref: 1060 pid: 80278 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.581362:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c513a2 lrc: 3/0,1 mode: --/PW res: [0x2b726:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.581364:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ea0220b6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997003456:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.581371:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211512 00000100:00100000:1.0:1651529344.581373:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1006:39029:x1731745946449984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.581376:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e1aa6a77 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.581378:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177960 count 1 00010000:00010000:1.0:1651529344.581382:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c513b0 lrc: 3/0,1 mode: --/PW res: [0x2b728:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.581386:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c4cd71 lrc: 2/0,0 mode: PR/PR res: [0x2b728:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce7ce expref: 1060 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.581390:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.581390:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.581391:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c513b0 lrc: 4/0,1 mode: --/PW res: [0x2b728:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.581397:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c4cd71 lrc: 3/0,0 mode: PR/PR res: [0x2b728:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce7ce expref: 1060 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.581403:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396330304 00010000:00010000:0.0:1651529344.581408:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000111401ed/0x3234de053c4d93a lrc: 4/0,0 mode: PR/PR res: [0x2b722:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d15a2 expref: 1061 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.581410:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c4cd71 lrc: 4/0,0 mode: PR/PR res: [0x2b728:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce7ce expref: 1061 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.581414:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f7006631 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997003520:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.581414:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396330240 00010000:00010000:0.0:1651529344.581416:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000089e57af8/0x3234de053c4c996 lrc: 4/0,0 mode: PR/PR res: [0x2b71f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd823 expref: 1062 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.581421:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396330432 00010000:00010000:0.0:1651529344.581423:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000087c25fa6/0x3234de053c4e33c lrc: 4/0,0 mode: PR/PR res: [0x2b724:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3df7 expref: 1063 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.581425:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 0000000020dd7827 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.581429:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396330368 00000100:00100000:1.0:1651529344.581430:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396330560 00010000:00010000:0.0:1651529344.581431:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d9354cc1/0x3234de053c4de81 lrc: 4/0,0 mode: PR/PR res: [0x2b723:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ae1 expref: 1064 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.581435:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a2fa60e6/0x3234de053c4e2fd lrc: 4/0,0 mode: PR/PR res: [0x2b726:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3cfb expref: 1065 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.581436:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396330496 00010000:00010000:0.0:1651529344.581438:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000960c9563/0x3234de053c4e875 lrc: 4/0,0 mode: PR/PR res: [0x2b725:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d52bf expref: 1066 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.581442:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12287 00000100:00100000:0.0:1651529344.581444:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1066:41278:x1731746396330304:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.581446:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12288 00000100:00100000:1.0:1651529344.581447:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082df86ec pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1066:41279:x1731746396330240:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.581447:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.581448:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000111401ed/0x3234de053c4d93a lrc: 4/0,0 mode: PR/PR res: [0x2b722:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d15a2 expref: 1066 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.581450:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.581451:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000089e57af8/0x3234de053c4c996 lrc: 4/0,0 mode: PR/PR res: [0x2b71f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd823 expref: 1066 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.581451:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000111401ed/0x3234de053c4d93a lrc: 3/0,0 mode: PR/PR res: [0x2b722:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d15a2 expref: 1066 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.581455:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000089e57af8/0x3234de053c4c996 lrc: 3/0,0 mode: PR/PR res: [0x2b71f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd823 expref: 1066 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.581457:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000111401ed/0x3234de053c4d93a lrc: 0/0,0 mode: --/PR res: [0x2b722:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d15a2 expref: 1066 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.581460:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.581461:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089e57af8/0x3234de053c4c996 lrc: 0/0,0 mode: --/PR res: [0x2b71f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd823 expref: 1065 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.581461:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.581462:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51386 lrc: 3/0,1 mode: PW/PW res: [0x2b722:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.581464:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.581465:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.581465:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51386 lrc: 4/0,1 mode: PW/PW res: [0x2b722:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.581466:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c5137f lrc: 3/0,1 mode: PW/PW res: [0x2b71f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.581469:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c5137f lrc: 4/0,1 mode: PW/PW res: [0x2b71f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581475:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.581482:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1064:41278:x1731746396330304:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 38us (184us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.581485:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.581492:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082df86ec pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1064:41279:x1731746396330240:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 44us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.581492:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12287 00000100:00100000:1.0:1651529344.581495:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12288 00000100:00100000:0.0:1651529344.581497:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12289 00000100:00100000:0.0:1651529344.581498:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1062:41278:x1731746396330432:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.581501:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.581503:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000087c25fa6/0x3234de053c4e33c lrc: 4/0,0 mode: PR/PR res: [0x2b724:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3df7 expref: 1062 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.581504:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12290 00000100:00100000:1.0:1651529344.581505:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1062:41279:x1731746396330368:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.581506:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000087c25fa6/0x3234de053c4e33c lrc: 3/0,0 mode: PR/PR res: [0x2b724:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3df7 expref: 1062 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.581508:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.581510:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d9354cc1/0x3234de053c4de81 lrc: 4/0,0 mode: PR/PR res: [0x2b723:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ae1 expref: 1062 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.581511:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087c25fa6/0x3234de053c4e33c lrc: 0/0,0 mode: --/PR res: [0x2b724:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3df7 expref: 1062 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.581513:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d9354cc1/0x3234de053c4de81 lrc: 3/0,0 mode: PR/PR res: [0x2b723:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ae1 expref: 1062 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.581515:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.581515:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.581516:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51394 lrc: 3/0,1 mode: PW/PW res: [0x2b724:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.581519:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9354cc1/0x3234de053c4de81 lrc: 0/0,0 mode: --/PR res: [0x2b723:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ae1 expref: 1061 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.581519:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51394 lrc: 4/0,1 mode: PW/PW res: [0x2b724:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.581522:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.581523:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.581523:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c5138d lrc: 3/0,1 mode: PW/PW res: [0x2b723:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581528:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.581533:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c5138d lrc: 4/0,1 mode: PW/PW res: [0x2b723:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.581534:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1060:41278:x1731746396330432:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.581537:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12289 00010000:00010000:1.0:1651529344.581542:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.581547:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12291 00000100:00100000:1.0:1651529344.581548:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1059:41279:x1731746396330368:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.581549:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1059:41279:x1731746396330496:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.581550:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12290 00010000:00010000:0.0:1651529344.581551:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.581553:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000960c9563/0x3234de053c4e875 lrc: 4/0,0 mode: PR/PR res: [0x2b725:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d52bf expref: 1058 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.581555:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12292 00000100:00100000:1.0:1651529344.581557:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1058:41278:x1731746396330560:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.581557:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000960c9563/0x3234de053c4e875 lrc: 3/0,0 mode: PR/PR res: [0x2b725:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d52bf expref: 1058 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.581559:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.581561:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a2fa60e6/0x3234de053c4e2fd lrc: 4/0,0 mode: PR/PR res: [0x2b726:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3cfb expref: 1058 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.581561:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000960c9563/0x3234de053c4e875 lrc: 0/0,0 mode: --/PR res: [0x2b725:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d52bf expref: 1058 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.581564:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a2fa60e6/0x3234de053c4e2fd lrc: 3/0,0 mode: PR/PR res: [0x2b726:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3cfb expref: 1057 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.581565:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.581565:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.581566:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c5139b lrc: 3/0,1 mode: PW/PW res: [0x2b725:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.581569:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2fa60e6/0x3234de053c4e2fd lrc: 0/0,0 mode: --/PR res: [0x2b726:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3cfb expref: 1057 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.581569:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c5139b lrc: 4/0,1 mode: PW/PW res: [0x2b725:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.581572:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.581573:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.581574:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c513a2 lrc: 3/0,1 mode: PW/PW res: [0x2b726:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581574:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.581577:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c513a2 lrc: 4/0,1 mode: PW/PW res: [0x2b726:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.581579:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1056:41279:x1731746396330496:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 30us (228us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.581582:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.581582:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12291 00000100:00100000:1.0:1651529344.581587:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1055:41278:x1731746396330560:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 29us (241us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.581588:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c5137f lrc: 3/0,1 mode: PW/PW res: [0x2b71f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.581589:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12292 00010000:00010000:0.0:1651529344.581591:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c5137f lrc: 3/0,1 mode: PW/PW res: [0x2b71f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581594:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c5137f lrc: 3/0,1 mode: PW/PW res: [0x2b71f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581597:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c5137f lrc: 2/0,0 mode: PW/PW res: [0x2b71f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.581598:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51386 lrc: 3/0,1 mode: PW/PW res: [0x2b722:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.581601:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51386 lrc: 3/0,1 mode: PW/PW res: [0x2b722:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.581604:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51386 lrc: 3/0,1 mode: PW/PW res: [0x2b722:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.581609:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51386 lrc: 2/0,0 mode: PW/PW res: [0x2b722:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.581644:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1008:39030:x1731745946448960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1088us (1128us total) trans 12885079560 rc 0/0 00000100:00100000:0.0:1651529344.581647:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211505 00000100:00100000:1.0:1651529344.581653:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e578d0c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1008:39030:x1731745946449152:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1008us (1121us total) trans 12885079561 rc 0/0 00000100:00100000:1.0:1651529344.581656:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211506 00010000:00010000:1.0:1651529344.581663:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51394 lrc: 3/0,1 mode: PW/PW res: [0x2b724:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.581666:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51394 lrc: 3/0,1 mode: PW/PW res: [0x2b724:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.581669:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51394 lrc: 3/0,1 mode: PW/PW res: [0x2b724:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.581672:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51394 lrc: 2/0,0 mode: PW/PW res: [0x2b724:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581691:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c5138d lrc: 3/0,1 mode: PW/PW res: [0x2b723:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581695:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c5138d lrc: 3/0,1 mode: PW/PW res: [0x2b723:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581698:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c5138d lrc: 3/0,1 mode: PW/PW res: [0x2b723:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581701:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c5138d lrc: 2/0,0 mode: PW/PW res: [0x2b723:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.581707:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1007:39030:x1731745946449280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1008us (1107us total) trans 12885079562 rc 0/0 00000100:00100000:1.0:1651529344.581710:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211508 00010000:00010000:1.0:1651529344.581716:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c513a2 lrc: 3/0,1 mode: PW/PW res: [0x2b726:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.581720:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c513a2 lrc: 3/0,1 mode: PW/PW res: [0x2b726:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.581725:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c513a2 lrc: 3/0,1 mode: PW/PW res: [0x2b726:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.581728:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c513a2 lrc: 2/0,0 mode: PW/PW res: [0x2b726:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.581747:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1007:39030:x1731745946449216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1088us (1168us total) trans 12885079563 rc 0/0 00000100:00100000:0.0:1651529344.581752:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211507 00010000:00010000:0.0:1651529344.581759:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c5139b lrc: 3/0,1 mode: PW/PW res: [0x2b725:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581762:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c5139b lrc: 3/0,1 mode: PW/PW res: [0x2b725:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581766:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c5139b lrc: 3/0,1 mode: PW/PW res: [0x2b725:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581768:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c5139b lrc: 2/0,0 mode: PW/PW res: [0x2b725:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.581769:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1007:39030:x1731745946449408:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1016us (1146us total) trans 12885079564 rc 0/0 00000100:00100000:1.0:1651529344.581772:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211510 00000100:00100000:0.0:1651529344.581810:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1007:39029:x1731745946449344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1077us (1195us total) trans 12885079565 rc 0/0 00000100:00100000:1.0:1651529344.581812:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.581813:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211509 00010000:00010000:0.0:1651529344.581820:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c5137f lrc: 2/0,0 mode: PW/PW res: [0x2b71f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581824:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005d8a4887 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.581825:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c5137f lrc: 2/0,0 mode: PW/PW res: [0x2b71f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581828:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c5137f lrc: 3/0,0 mode: PW/PW res: [0x2b71f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581832:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c5137f lrc: 1/0,0 mode: --/PW res: [0x2b71f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581835:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c5137f lrc: 0/0,0 mode: --/PW res: [0x2b71f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581839:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51386 lrc: 2/0,0 mode: PW/PW res: [0x2b722:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581842:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000073043e99 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.581843:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51386 lrc: 2/0,0 mode: PW/PW res: [0x2b722:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581846:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51386 lrc: 3/0,0 mode: PW/PW res: [0x2b722:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581849:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51386 lrc: 1/0,0 mode: --/PW res: [0x2b722:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581851:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51386 lrc: 0/0,0 mode: --/PW res: [0x2b722:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581855:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51394 lrc: 2/0,0 mode: PW/PW res: [0x2b724:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581857:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000acc438d7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.581858:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51394 lrc: 2/0,0 mode: PW/PW res: [0x2b724:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581863:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51394 lrc: 3/0,0 mode: PW/PW res: [0x2b724:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581866:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51394 lrc: 1/0,0 mode: --/PW res: [0x2b724:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581869:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51394 lrc: 0/0,0 mode: --/PW res: [0x2b724:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581872:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c5138d lrc: 2/0,0 mode: PW/PW res: [0x2b723:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581875:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b855716b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.581875:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c5138d lrc: 2/0,0 mode: PW/PW res: [0x2b723:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581878:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c5138d lrc: 3/0,0 mode: PW/PW res: [0x2b723:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581881:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c5138d lrc: 1/0,0 mode: --/PW res: [0x2b723:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581883:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c5138d lrc: 0/0,0 mode: --/PW res: [0x2b723:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581887:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c513a2 lrc: 2/0,0 mode: PW/PW res: [0x2b726:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581890:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000495c20c9 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.581891:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c513a2 lrc: 2/0,0 mode: PW/PW res: [0x2b726:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581893:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c513a2 lrc: 3/0,0 mode: PW/PW res: [0x2b726:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581896:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c513a2 lrc: 1/0,0 mode: --/PW res: [0x2b726:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581899:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c513a2 lrc: 0/0,0 mode: --/PW res: [0x2b726:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581902:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c5139b lrc: 2/0,0 mode: PW/PW res: [0x2b725:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581905:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027456046 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.581906:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c5139b lrc: 2/0,0 mode: PW/PW res: [0x2b725:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581908:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c5139b lrc: 3/0,0 mode: PW/PW res: [0x2b725:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581929:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c5139b lrc: 1/0,0 mode: --/PW res: [0x2b725:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.581932:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c5139b lrc: 0/0,0 mode: --/PW res: [0x2b725:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.581945:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396331136 00000100:00100000:0.0:1651529344.581945:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ea0220b6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997003456:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.581951:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009b442b4b/0x3234de053c4b07c lrc: 4/0,0 mode: PR/PR res: [0x2b727:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc036 expref: 1055 pid: 80278 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.581959:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12293 00000100:00100000:1.0:1651529344.581961:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1055:41279:x1731746396331136:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.581963:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000954b1161/0x3234de053c513a9 lrc: 3/0,1 mode: --/PW res: [0x2b727:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.581964:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.581965:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009b442b4b/0x3234de053c4b07c lrc: 4/0,0 mode: PR/PR res: [0x2b727:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc036 expref: 1055 pid: 80278 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.581969:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009b442b4b/0x3234de053c4b07c lrc: 3/0,0 mode: PR/PR res: [0x2b727:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc036 expref: 1055 pid: 80278 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.581974:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b442b4b/0x3234de053c4b07c lrc: 0/0,0 mode: --/PR res: [0x2b727:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc036 expref: 1055 pid: 80278 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.581981:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.581981:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.581982:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000954b1161/0x3234de053c513a9 lrc: 3/0,1 mode: PW/PW res: [0x2b727:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.581985:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000954b1161/0x3234de053c513a9 lrc: 4/0,1 mode: PW/PW res: [0x2b727:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.581996:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.582009:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000954b1161/0x3234de053c513a9 lrc: 3/0,1 mode: PW/PW res: [0x2b727:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.582014:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1054:41279:x1731746396331136:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 52us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.582017:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12293 00010000:00010000:0.0:1651529344.582017:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000954b1161/0x3234de053c513a9 lrc: 3/0,1 mode: PW/PW res: [0x2b727:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582021:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000954b1161/0x3234de053c513a9 lrc: 3/0,1 mode: PW/PW res: [0x2b727:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582023:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000954b1161/0x3234de053c513a9 lrc: 2/0,0 mode: PW/PW res: [0x2b727:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.582062:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f7006631 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997003520:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.582066:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1007:39030:x1731745946449920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 736us (778us total) trans 12885079566 rc 0/0 00000100:00100000:0.0:1651529344.582070:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211511 00010000:00010000:1.0:1651529344.582071:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c513b0 lrc: 3/0,1 mode: --/PW res: [0x2b728:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582095:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000954b1161/0x3234de053c513a9 lrc: 2/0,0 mode: PW/PW res: [0x2b727:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582099:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000954b1161 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.582100:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000954b1161/0x3234de053c513a9 lrc: 2/0,0 mode: PW/PW res: [0x2b727:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582120:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000954b1161/0x3234de053c513a9 lrc: 3/0,0 mode: PW/PW res: [0x2b727:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.582124:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.582125:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000954b1161/0x3234de053c513a9 lrc: 1/0,0 mode: --/PW res: [0x2b727:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582127:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000954b1161/0x3234de053c513a9 lrc: 0/0,0 mode: --/PW res: [0x2b727:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.582136:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.582141:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946450176 00000100:00100000:1.0:1651529344.582144:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.582147:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946450112 00000100:00100000:1.0:1651529344.582152:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.582152:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211513 00000100:00100000:0.0:1651529344.582153:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1008:39030:x1731745946450176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.582158:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.582158:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177962 count 1 00000100:00100000:1.0:1651529344.582167:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.582169:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094bb6891/0x3234de053c513b7 lrc: 3/0,1 mode: --/PW res: [0x2b72a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.582173:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.582174:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b63cb48d/0x3234de053c4a872 lrc: 2/0,0 mode: PR/PR res: [0x2b72a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc93 expref: 1053 pid: 80278 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.582177:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.582178:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.582179:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094bb6891/0x3234de053c513b7 lrc: 4/0,1 mode: --/PW res: [0x2b72a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.582180:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396331200 00010000:00010000:1.0:1651529344.582185:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c4cd71 lrc: 4/0,0 mode: PR/PR res: [0x2b728:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce7ce expref: 1054 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.582185:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b63cb48d/0x3234de053c4a872 lrc: 3/0,0 mode: PR/PR res: [0x2b72a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc93 expref: 1054 pid: 80278 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.582191:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b63cb48d/0x3234de053c4a872 lrc: 4/0,0 mode: PR/PR res: [0x2b72a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc93 expref: 1054 pid: 80278 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.582195:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12294 00000100:00100000:0.0:1651529344.582195:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ea0220b6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997003584:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.582196:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1054:41279:x1731746396331200:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.582199:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.582200:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c4cd71 lrc: 4/0,0 mode: PR/PR res: [0x2b728:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce7ce expref: 1054 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.582204:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c4cd71 lrc: 3/0,0 mode: PR/PR res: [0x2b728:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce7ce expref: 1054 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.582210:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 000000000e7e66c4 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.582216:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c4cd71 lrc: 0/0,0 mode: --/PR res: [0x2b728:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce7ce expref: 1054 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.582217:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946450240 00010000:00010000:1.0:1651529344.582219:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.582220:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.582221:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c513b0 lrc: 3/0,1 mode: PW/PW res: [0x2b728:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582240:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c513b0 lrc: 4/0,1 mode: PW/PW res: [0x2b728:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582247:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.582254:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1053:41279:x1731746396331200:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 57us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.582257:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12294 00000100:00100000:1.0:1651529344.582264:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946450304 00000100:00100000:0.0:1651529344.582265:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946450368 00000100:00100000:0.0:1651529344.582272:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946450432 00000100:00100000:0.0:1651529344.582276:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211514 00000100:00100000:0.0:1651529344.582278:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1012:39030:x1731745946450112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.582280:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211515 00000100:00100000:1.0:1651529344.582282:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1012:39029:x1731745946450240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.582283:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177961 count 1 00002000:00080000:1.0:1651529344.582287:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177963 count 1 00010000:00010000:0.0:1651529344.582287:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009698444d/0x3234de053c513be lrc: 3/0,1 mode: --/PW res: [0x2b729:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582290:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c513c5 lrc: 3/0,1 mode: --/PW res: [0x2b72b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582292:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f8b63594/0x3234de053c4c72e lrc: 2/0,0 mode: PR/PR res: [0x2b729:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cced0 expref: 1052 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.582295:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000af9a238a/0x3234de053c4f4c3 lrc: 2/0,0 mode: PR/PR res: [0x2b72b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8594 expref: 1052 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.582295:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.582296:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.582297:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009698444d/0x3234de053c513be lrc: 4/0,1 mode: --/PW res: [0x2b729:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582298:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.582299:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.582299:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c513c5 lrc: 4/0,1 mode: --/PW res: [0x2b72b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582303:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f8b63594/0x3234de053c4c72e lrc: 3/0,0 mode: PR/PR res: [0x2b729:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cced0 expref: 1052 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.582306:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000af9a238a/0x3234de053c4f4c3 lrc: 3/0,0 mode: PR/PR res: [0x2b72b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8594 expref: 1052 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.582306:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f8b63594/0x3234de053c4c72e lrc: 4/0,0 mode: PR/PR res: [0x2b729:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cced0 expref: 1052 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.582309:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000af9a238a/0x3234de053c4f4c3 lrc: 4/0,0 mode: PR/PR res: [0x2b72b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8594 expref: 1052 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.582311:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000078f9a278 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997003648:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.582313:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000075e1000f pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997003712:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.582319:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000003ad73843 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.582322:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.582325:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211516 00000100:00100000:0.0:1651529344.582327:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1012:39029:x1731745946450368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.582328:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211517 00000100:00100000:1.0:1651529344.582330:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1012:39030:x1731745946450432:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.582331:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177965 count 1 00002000:00080000:1.0:1651529344.582334:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177966 count 1 00010000:00010000:0.0:1651529344.582334:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0dd8497/0x3234de053c513cc lrc: 3/0,1 mode: --/PW res: [0x2b72d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582337:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001201dc92/0x3234de053c513d3 lrc: 3/0,1 mode: --/PW res: [0x2b72e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582338:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d4076692/0x3234de053c4ed29 lrc: 2/0,0 mode: PR/PR res: [0x2b72d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6676 expref: 1052 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.582341:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.582341:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.582342:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0dd8497/0x3234de053c513cc lrc: 4/0,1 mode: --/PW res: [0x2b72d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582344:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea8e6dc3/0x3234de053c4f3d5 lrc: 2/0,0 mode: PR/PR res: [0x2b72e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81dc expref: 1052 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.582347:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.582347:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d4076692/0x3234de053c4ed29 lrc: 3/0,0 mode: PR/PR res: [0x2b72d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6676 expref: 1052 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.582348:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.582348:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001201dc92/0x3234de053c513d3 lrc: 4/0,1 mode: --/PW res: [0x2b72e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582351:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d4076692/0x3234de053c4ed29 lrc: 4/0,0 mode: PR/PR res: [0x2b72d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6676 expref: 1052 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.582354:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ea8e6dc3/0x3234de053c4f3d5 lrc: 3/0,0 mode: PR/PR res: [0x2b72e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81dc expref: 1052 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.582355:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002c4168d4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997003776:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.582357:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ea8e6dc3/0x3234de053c4f3d5 lrc: 4/0,0 mode: PR/PR res: [0x2b72e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81dc expref: 1052 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.582361:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000fb8e412 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997003840:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.582361:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 000000003c8b0daf going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.582366:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211518 00000100:00100000:1.0:1651529344.582367:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a5495eb going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.582368:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1012:39030:x1731745946450304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.582372:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177964 count 1 00010000:00010000:1.0:1651529344.582375:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c513b0 lrc: 3/0,1 mode: PW/PW res: [0x2b728:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582375:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e60de6b/0x3234de053c513da lrc: 3/0,1 mode: --/PW res: [0x2b72c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582378:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c513b0 lrc: 3/0,1 mode: PW/PW res: [0x2b728:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582379:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000e33677d/0x3234de053c4d765 lrc: 2/0,0 mode: PR/PR res: [0x2b72c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f3c expref: 1052 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.582381:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c513b0 lrc: 3/0,1 mode: PW/PW res: [0x2b728:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582382:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.582382:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.582383:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e60de6b/0x3234de053c513da lrc: 4/0,1 mode: --/PW res: [0x2b72c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.582384:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c513b0 lrc: 2/0,0 mode: PW/PW res: [0x2b728:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582389:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000e33677d/0x3234de053c4d765 lrc: 3/0,0 mode: PR/PR res: [0x2b72c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f3c expref: 1052 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.582399:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000e33677d/0x3234de053c4d765 lrc: 4/0,0 mode: PR/PR res: [0x2b72c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f3c expref: 1052 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.582404:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000089d7f5d6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997003904:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.582411:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 0000000009370c1d going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.582415:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c513b0 lrc: 2/0,0 mode: PW/PW res: [0x2b728:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582418:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5c1b0ba already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.582419:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c513b0 lrc: 2/0,0 mode: PW/PW res: [0x2b728:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582425:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c513b0 lrc: 3/0,0 mode: PW/PW res: [0x2b728:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.582427:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1013:39029:x1731745946449984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1053us (1130us total) trans 12885079567 rc 0/0 00010000:00010000:0.0:1651529344.582429:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c513b0 lrc: 1/0,0 mode: --/PW res: [0x2b728:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.582430:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211512 00010000:00010000:0.0:1651529344.582432:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c513b0 lrc: 0/0,0 mode: --/PW res: [0x2b728:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.582446:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.582497:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946450496 00000100:00100000:0.0:1651529344.582505:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211519 00000100:00100000:0.0:1651529344.582506:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1013:39029:x1731745946450496:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.582511:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177967 count 1 00010000:00010000:0.0:1651529344.582515:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3443fb0/0x3234de053c513e1 lrc: 3/0,1 mode: --/PW res: [0x2b72f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582520:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001ab96373/0x3234de053c4ba9a lrc: 2/0,0 mode: PR/PR res: [0x2b72f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc4f8 expref: 1052 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.582523:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.582523:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.582524:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3443fb0/0x3234de053c513e1 lrc: 4/0,1 mode: --/PW res: [0x2b72f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582530:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001ab96373/0x3234de053c4ba9a lrc: 3/0,0 mode: PR/PR res: [0x2b72f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc4f8 expref: 1052 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.582536:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001ab96373/0x3234de053c4ba9a lrc: 4/0,0 mode: PR/PR res: [0x2b72f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc4f8 expref: 1052 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.582540:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004a6776b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997003968:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.582552:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a3b00cf3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.582683:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000078f9a278 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997003648:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.582688:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009698444d/0x3234de053c513be lrc: 3/0,1 mode: --/PW res: [0x2b729:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.582717:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ea0220b6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997003584:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.582720:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000094bb6891/0x3234de053c513b7 lrc: 3/0,1 mode: --/PW res: [0x2b72a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.582723:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.582733:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946451072 00000100:00100000:0.0:1651529344.582752:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211520 00000100:00100000:0.0:1651529344.582753:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1014:39030:x1731745946451072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.582758:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177968 count 1 00010000:00010000:0.0:1651529344.582762:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024e518f1/0x3234de053c513e8 lrc: 3/0,1 mode: --/PW res: [0x2b730:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582767:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004f06ff08/0x3234de053c4d42b lrc: 2/0,0 mode: PR/PR res: [0x2b730:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0270 expref: 1052 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.582770:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.582770:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.582771:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024e518f1/0x3234de053c513e8 lrc: 4/0,1 mode: --/PW res: [0x2b730:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.582778:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004f06ff08/0x3234de053c4d42b lrc: 3/0,0 mode: PR/PR res: [0x2b730:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0270 expref: 1052 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.582781:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004f06ff08/0x3234de053c4d42b lrc: 4/0,0 mode: PR/PR res: [0x2b730:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0270 expref: 1052 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.582785:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ea0220b6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997004032:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.582797:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 000000003ad73843 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.582949:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002c4168d4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997003776:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.582973:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e0dd8497/0x3234de053c513cc lrc: 3/0,1 mode: --/PW res: [0x2b72d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.582976:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.582981:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000089d7f5d6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997003904:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.582983:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.582984:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000e60de6b/0x3234de053c513da lrc: 3/0,1 mode: --/PW res: [0x2b72c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.582990:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.582990:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004a6776b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997003968:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.582992:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b3443fb0/0x3234de053c513e1 lrc: 3/0,1 mode: --/PW res: [0x2b72f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.582996:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.583000:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396331328 00000100:00100000:1.0:1651529344.583001:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.583005:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f8b63594/0x3234de053c4c72e lrc: 4/0,0 mode: PR/PR res: [0x2b729:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cced0 expref: 1053 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.583006:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.583011:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.583011:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396331456 00010000:00010000:0.0:1651529344.583013:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d4076692/0x3234de053c4ed29 lrc: 4/0,0 mode: PR/PR res: [0x2b72d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6676 expref: 1054 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.583024:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396331264 00000100:00100000:1.0:1651529344.583026:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000075e1000f pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997003712:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.583027:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b63cb48d/0x3234de053c4a872 lrc: 4/0,0 mode: PR/PR res: [0x2b72a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc93 expref: 1055 pid: 80278 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.583030:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c513c5 lrc: 3/0,1 mode: --/PW res: [0x2b72b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.583037:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000fb8e412 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997003840:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.583040:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001201dc92/0x3234de053c513d3 lrc: 3/0,1 mode: --/PW res: [0x2b72e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.583045:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396331392 00010000:00010000:1.0:1651529344.583050:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000af9a238a/0x3234de053c4f4c3 lrc: 4/0,0 mode: PR/PR res: [0x2b72b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8594 expref: 1056 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.583055:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396331584 00010000:00010000:0.0:1651529344.583059:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000e33677d/0x3234de053c4d765 lrc: 4/0,0 mode: PR/PR res: [0x2b72c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f3c expref: 1057 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.583064:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396331520 00000100:00100000:0.0:1651529344.583064:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396331648 00010000:00010000:0.0:1651529344.583067:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001ab96373/0x3234de053c4ba9a lrc: 4/0,0 mode: PR/PR res: [0x2b72f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc4f8 expref: 1059 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.583068:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ea8e6dc3/0x3234de053c4f3d5 lrc: 4/0,0 mode: PR/PR res: [0x2b72e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81dc expref: 1059 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.583072:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12295 00000100:00100000:0.0:1651529344.583073:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000619c18c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1059:41278:x1731746396331328:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.583075:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12296 00000100:00100000:1.0:1651529344.583076:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1059:41278:x1731746396331456:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.583076:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.583078:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f8b63594/0x3234de053c4c72e lrc: 4/0,0 mode: PR/PR res: [0x2b729:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cced0 expref: 1059 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.583079:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.583081:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d4076692/0x3234de053c4ed29 lrc: 4/0,0 mode: PR/PR res: [0x2b72d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6676 expref: 1059 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.583081:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f8b63594/0x3234de053c4c72e lrc: 3/0,0 mode: PR/PR res: [0x2b729:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cced0 expref: 1059 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.583084:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d4076692/0x3234de053c4ed29 lrc: 3/0,0 mode: PR/PR res: [0x2b72d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6676 expref: 1059 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.583087:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8b63594/0x3234de053c4c72e lrc: 0/0,0 mode: --/PR res: [0x2b729:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cced0 expref: 1059 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.583090:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4076692/0x3234de053c4ed29 lrc: 0/0,0 mode: --/PR res: [0x2b72d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6676 expref: 1059 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.583091:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.583092:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.583093:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009698444d/0x3234de053c513be lrc: 3/0,1 mode: PW/PW res: [0x2b729:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583094:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.583094:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.583095:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e0dd8497/0x3234de053c513cc lrc: 3/0,1 mode: PW/PW res: [0x2b72d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583095:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009698444d/0x3234de053c513be lrc: 4/0,1 mode: PW/PW res: [0x2b729:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583098:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0dd8497/0x3234de053c513cc lrc: 4/0,1 mode: PW/PW res: [0x2b72d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583102:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.583108:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.583120:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000619c18c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1057:41278:x1731746396331328:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 46us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.583123:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12295 00000100:00100000:1.0:1651529344.583124:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1057:41278:x1731746396331456:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 47us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.583127:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12296 00000100:00100000:1.0:1651529344.583132:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12297 00000100:00100000:1.0:1651529344.583134:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1055:41279:x1731746396331264:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.583134:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12298 00000100:00100000:0.0:1651529344.583136:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1055:41279:x1731746396331392:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.583137:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.583138:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b63cb48d/0x3234de053c4a872 lrc: 4/0,0 mode: PR/PR res: [0x2b72a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc93 expref: 1055 pid: 80278 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.583139:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.583141:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000af9a238a/0x3234de053c4f4c3 lrc: 4/0,0 mode: PR/PR res: [0x2b72b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8594 expref: 1055 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.583142:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b63cb48d/0x3234de053c4a872 lrc: 3/0,0 mode: PR/PR res: [0x2b72a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc93 expref: 1055 pid: 80278 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.583145:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000af9a238a/0x3234de053c4f4c3 lrc: 3/0,0 mode: PR/PR res: [0x2b72b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8594 expref: 1055 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.583147:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b63cb48d/0x3234de053c4a872 lrc: 0/0,0 mode: --/PR res: [0x2b72a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc93 expref: 1055 pid: 80278 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.583149:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af9a238a/0x3234de053c4f4c3 lrc: 0/0,0 mode: --/PR res: [0x2b72b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8594 expref: 1055 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.583150:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.583151:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.583152:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000094bb6891/0x3234de053c513b7 lrc: 3/0,1 mode: PW/PW res: [0x2b72a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583153:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.583154:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.583155:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094bb6891/0x3234de053c513b7 lrc: 4/0,1 mode: PW/PW res: [0x2b72a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583155:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c513c5 lrc: 3/0,1 mode: PW/PW res: [0x2b72b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583158:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c513c5 lrc: 4/0,1 mode: PW/PW res: [0x2b72b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583164:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.583172:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.583174:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1053:41279:x1731746396331264:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 35us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.583177:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12297 00000100:00100000:0.0:1651529344.583178:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1053:41279:x1731746396331392:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 41us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.583181:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12298 00000100:00100000:1.0:1651529344.583182:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12299 00000100:00100000:1.0:1651529344.583184:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1051:41278:x1731746396331584:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.583186:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12300 00010000:00010000:1.0:1651529344.583187:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.583187:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1051:41279:x1731746396331648:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.583188:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000e33677d/0x3234de053c4d765 lrc: 4/0,0 mode: PR/PR res: [0x2b72c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f3c expref: 1051 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.583190:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.583191:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001ab96373/0x3234de053c4ba9a lrc: 4/0,0 mode: PR/PR res: [0x2b72f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc4f8 expref: 1051 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.583192:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000e33677d/0x3234de053c4d765 lrc: 3/0,0 mode: PR/PR res: [0x2b72c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f3c expref: 1051 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.583195:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001ab96373/0x3234de053c4ba9a lrc: 3/0,0 mode: PR/PR res: [0x2b72f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc4f8 expref: 1051 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.583197:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e33677d/0x3234de053c4d765 lrc: 0/0,0 mode: --/PR res: [0x2b72c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f3c expref: 1051 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.583200:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.583200:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ab96373/0x3234de053c4ba9a lrc: 0/0,0 mode: --/PR res: [0x2b72f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc4f8 expref: 1050 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.583201:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.583202:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000e60de6b/0x3234de053c513da lrc: 3/0,1 mode: PW/PW res: [0x2b72c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583203:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.583204:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.583205:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e60de6b/0x3234de053c513da lrc: 4/0,1 mode: PW/PW res: [0x2b72c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583205:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b3443fb0/0x3234de053c513e1 lrc: 3/0,1 mode: PW/PW res: [0x2b72f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583210:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3443fb0/0x3234de053c513e1 lrc: 4/0,1 mode: PW/PW res: [0x2b72f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583213:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.583218:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1049:41278:x1731746396331584:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 34us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.583221:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12299 00010000:00010000:0.0:1651529344.583236:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.583242:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12301 00000100:00100000:0.0:1651529344.583243:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1048:41279:x1731746396331648:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 54us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.583244:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1048:41279:x1731746396331520:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.583246:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12300 00010000:00010000:1.0:1651529344.583247:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.583248:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ea8e6dc3/0x3234de053c4f3d5 lrc: 4/0,0 mode: PR/PR res: [0x2b72e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81dc expref: 1047 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.583252:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ea8e6dc3/0x3234de053c4f3d5 lrc: 3/0,0 mode: PR/PR res: [0x2b72e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81dc expref: 1047 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.583252:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e0dd8497/0x3234de053c513cc lrc: 3/0,1 mode: PW/PW res: [0x2b72d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583256:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0dd8497/0x3234de053c513cc lrc: 3/0,1 mode: PW/PW res: [0x2b72d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583257:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea8e6dc3/0x3234de053c4f3d5 lrc: 0/0,0 mode: --/PR res: [0x2b72e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d81dc expref: 1047 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.583259:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0dd8497/0x3234de053c513cc lrc: 3/0,1 mode: PW/PW res: [0x2b72d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583261:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.583261:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.583262:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001201dc92/0x3234de053c513d3 lrc: 3/0,1 mode: PW/PW res: [0x2b72e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583262:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0dd8497/0x3234de053c513cc lrc: 2/0,0 mode: PW/PW res: [0x2b72d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583265:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001201dc92/0x3234de053c513d3 lrc: 4/0,1 mode: PW/PW res: [0x2b72e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583271:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.583277:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1046:41279:x1731746396331520:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.583279:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12301 00010000:00010000:1.0:1651529344.583289:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001201dc92/0x3234de053c513d3 lrc: 3/0,1 mode: PW/PW res: [0x2b72e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583292:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001201dc92/0x3234de053c513d3 lrc: 3/0,1 mode: PW/PW res: [0x2b72e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583295:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001201dc92/0x3234de053c513d3 lrc: 3/0,1 mode: PW/PW res: [0x2b72e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583298:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001201dc92/0x3234de053c513d3 lrc: 2/0,0 mode: PW/PW res: [0x2b72e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.583302:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1015:39029:x1731745946450368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 974us (1135us total) trans 12885079568 rc 0/0 00000100:00100000:0.0:1651529344.583304:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211516 00010000:00010000:0.0:1651529344.583318:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000e60de6b/0x3234de053c513da lrc: 3/0,1 mode: PW/PW res: [0x2b72c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583322:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e60de6b/0x3234de053c513da lrc: 3/0,1 mode: PW/PW res: [0x2b72c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583325:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e60de6b/0x3234de053c513da lrc: 3/0,1 mode: PW/PW res: [0x2b72c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583328:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e60de6b/0x3234de053c513da lrc: 2/0,0 mode: PW/PW res: [0x2b72c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.583345:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1016:39030:x1731745946450432:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1014us (1171us total) trans 12885079569 rc 0/0 00000100:00100000:1.0:1651529344.583348:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211517 00010000:00010000:1.0:1651529344.583355:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c513c5 lrc: 3/0,1 mode: PW/PW res: [0x2b72b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583359:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c513c5 lrc: 3/0,1 mode: PW/PW res: [0x2b72b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583362:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c513c5 lrc: 3/0,1 mode: PW/PW res: [0x2b72b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.583362:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1015:39030:x1731745946450304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 994us (1204us total) trans 12885079570 rc 0/0 00010000:00010000:1.0:1651529344.583365:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c513c5 lrc: 2/0,0 mode: PW/PW res: [0x2b72b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.583365:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211518 00010000:00010000:0.0:1651529344.583372:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0dd8497/0x3234de053c513cc lrc: 2/0,0 mode: PW/PW res: [0x2b72d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583375:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e0dd8497 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.583376:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0dd8497/0x3234de053c513cc lrc: 2/0,0 mode: PW/PW res: [0x2b72d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583379:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0dd8497/0x3234de053c513cc lrc: 3/0,0 mode: PW/PW res: [0x2b72d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583384:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0dd8497/0x3234de053c513cc lrc: 1/0,0 mode: --/PW res: [0x2b72d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583387:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0dd8497/0x3234de053c513cc lrc: 0/0,0 mode: --/PW res: [0x2b72d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583391:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001201dc92/0x3234de053c513d3 lrc: 2/0,0 mode: PW/PW res: [0x2b72e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583394:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001201dc92 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.583395:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1015:39029:x1731745946450240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1113us (1243us total) trans 12885079571 rc 0/0 00010000:00010000:0.0:1651529344.583395:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001201dc92/0x3234de053c513d3 lrc: 2/0,0 mode: PW/PW res: [0x2b72e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583397:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001201dc92/0x3234de053c513d3 lrc: 3/0,0 mode: PW/PW res: [0x2b72e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.583398:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211515 00010000:00010000:0.0:1651529344.583400:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001201dc92/0x3234de053c513d3 lrc: 1/0,0 mode: --/PW res: [0x2b72e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583403:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001201dc92/0x3234de053c513d3 lrc: 0/0,0 mode: --/PW res: [0x2b72e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583406:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e60de6b/0x3234de053c513da lrc: 2/0,0 mode: PW/PW res: [0x2b72c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583409:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000e60de6b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.583410:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e60de6b/0x3234de053c513da lrc: 2/0,0 mode: PW/PW res: [0x2b72c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583412:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e60de6b/0x3234de053c513da lrc: 3/0,0 mode: PW/PW res: [0x2b72c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.583413:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.583415:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e60de6b/0x3234de053c513da lrc: 1/0,0 mode: --/PW res: [0x2b72c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583418:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e60de6b/0x3234de053c513da lrc: 0/0,0 mode: --/PW res: [0x2b72c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583422:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c513c5 lrc: 2/0,0 mode: PW/PW res: [0x2b72b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583424:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000491b5359 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.583425:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c513c5 lrc: 2/0,0 mode: PW/PW res: [0x2b72b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583427:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c513c5 lrc: 3/0,0 mode: PW/PW res: [0x2b72b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583430:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c513c5 lrc: 1/0,0 mode: --/PW res: [0x2b72b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583433:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c513c5 lrc: 0/0,0 mode: --/PW res: [0x2b72b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.583442:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ea0220b6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997004032:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.583446:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000024e518f1/0x3234de053c513e8 lrc: 3/0,1 mode: --/PW res: [0x2b730:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583451:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009698444d/0x3234de053c513be lrc: 3/0,1 mode: PW/PW res: [0x2b729:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583454:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009698444d/0x3234de053c513be lrc: 3/0,1 mode: PW/PW res: [0x2b729:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583459:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009698444d/0x3234de053c513be lrc: 3/0,1 mode: PW/PW res: [0x2b729:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583462:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009698444d/0x3234de053c513be lrc: 2/0,0 mode: PW/PW res: [0x2b729:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.583507:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1015:39030:x1731745946450112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1227us (1362us total) trans 12885079572 rc 0/0 00000100:00100000:1.0:1651529344.583508:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396331712 00010000:00010000:1.0:1651529344.583514:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004f06ff08/0x3234de053c4d42b lrc: 4/0,0 mode: PR/PR res: [0x2b730:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0270 expref: 1046 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.583522:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12302 00000100:00100000:1.0:1651529344.583524:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b9d7b776 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1046:41279:x1731746396331712:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.583524:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211514 00010000:00010000:1.0:1651529344.583528:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.583529:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004f06ff08/0x3234de053c4d42b lrc: 4/0,0 mode: PR/PR res: [0x2b730:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0270 expref: 1046 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.583531:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b3443fb0/0x3234de053c513e1 lrc: 3/0,1 mode: PW/PW res: [0x2b72f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583533:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004f06ff08/0x3234de053c4d42b lrc: 3/0,0 mode: PR/PR res: [0x2b730:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0270 expref: 1046 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.583538:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f06ff08/0x3234de053c4d42b lrc: 0/0,0 mode: --/PR res: [0x2b730:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0270 expref: 1046 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.583542:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.583542:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.583543:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000024e518f1/0x3234de053c513e8 lrc: 3/0,1 mode: PW/PW res: [0x2b730:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583546:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024e518f1/0x3234de053c513e8 lrc: 4/0,1 mode: PW/PW res: [0x2b730:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583546:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3443fb0/0x3234de053c513e1 lrc: 3/0,1 mode: PW/PW res: [0x2b72f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583549:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3443fb0/0x3234de053c513e1 lrc: 3/0,1 mode: PW/PW res: [0x2b72f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583552:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3443fb0/0x3234de053c513e1 lrc: 2/0,0 mode: PW/PW res: [0x2b72f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583556:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.583563:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b9d7b776 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1045:41279:x1731746396331712:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 39us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.583566:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12302 00000100:00100000:0.0:1651529344.583593:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1015:39029:x1731745946450496:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1085us (1147us total) trans 12885079573 rc 0/0 00000100:00100000:0.0:1651529344.583595:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211519 00010000:00010000:0.0:1651529344.583602:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009698444d/0x3234de053c513be lrc: 2/0,0 mode: PW/PW res: [0x2b729:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583621:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009698444d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.583623:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009698444d/0x3234de053c513be lrc: 2/0,0 mode: PW/PW res: [0x2b729:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583626:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009698444d/0x3234de053c513be lrc: 3/0,0 mode: PW/PW res: [0x2b729:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583631:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009698444d/0x3234de053c513be lrc: 1/0,0 mode: --/PW res: [0x2b729:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583633:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009698444d/0x3234de053c513be lrc: 0/0,0 mode: --/PW res: [0x2b729:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583638:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3443fb0/0x3234de053c513e1 lrc: 2/0,0 mode: PW/PW res: [0x2b72f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.583642:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.583654:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b3443fb0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.583655:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3443fb0/0x3234de053c513e1 lrc: 2/0,0 mode: PW/PW res: [0x2b72f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.583657:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.583658:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3443fb0/0x3234de053c513e1 lrc: 3/0,0 mode: PW/PW res: [0x2b72f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583667:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3443fb0/0x3234de053c513e1 lrc: 1/0,0 mode: --/PW res: [0x2b72f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583669:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3443fb0/0x3234de053c513e1 lrc: 0/0,0 mode: --/PW res: [0x2b72f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.583674:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.583676:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000024e518f1/0x3234de053c513e8 lrc: 3/0,1 mode: PW/PW res: [0x2b730:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583679:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024e518f1/0x3234de053c513e8 lrc: 3/0,1 mode: PW/PW res: [0x2b730:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583682:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024e518f1/0x3234de053c513e8 lrc: 3/0,1 mode: PW/PW res: [0x2b730:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583684:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024e518f1/0x3234de053c513e8 lrc: 2/0,0 mode: PW/PW res: [0x2b730:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.583689:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.583698:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946451136 00000100:00100000:1.0:1651529344.583705:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946451200 00000100:00100000:1.0:1651529344.583710:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946451328 00000100:00100000:1.0:1651529344.583714:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946451264 00000100:00100000:1.0:1651529344.583717:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211521 00000100:00100000:1.0:1651529344.583719:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1019:39030:x1731745946451136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.583724:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177969 count 1 00010000:00010000:1.0:1651529344.583729:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005630c62e/0x3234de053c513ef lrc: 3/0,1 mode: --/PW res: [0x2b731:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583747:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000003152710/0x3234de053c4ccd7 lrc: 2/0,0 mode: PR/PR res: [0x2b731:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce551 expref: 1044 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.583750:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.583751:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.583751:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005630c62e/0x3234de053c513ef lrc: 4/0,1 mode: --/PW res: [0x2b731:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.583756:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1019:39030:x1731745946451072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 988us (1020us total) trans 12885079574 rc 0/0 00010000:00010000:1.0:1651529344.583758:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000003152710/0x3234de053c4ccd7 lrc: 3/0,0 mode: PR/PR res: [0x2b731:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce551 expref: 1044 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.583759:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211520 00010000:00010000:1.0:1651529344.583762:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000003152710/0x3234de053c4ccd7 lrc: 4/0,0 mode: PR/PR res: [0x2b731:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce551 expref: 1044 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.583765:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211522 00000100:00100000:1.0:1651529344.583767:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f39ca9ea pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997004096:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.583767:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1018:39030:x1731745946451200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.583772:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177970 count 1 00000100:00100000:1.0:1651529344.583776:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 0000000053a0cffa going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.583782:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211523 00000100:00100000:1.0:1651529344.583784:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1018:39030:x1731745946451328:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.583788:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177972 count 1 00010000:00010000:1.0:1651529344.583792:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005282bc2/0x3234de053c513f6 lrc: 3/0,1 mode: --/PW res: [0x2b734:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583796:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004355d948/0x3234de053c4dc5f lrc: 2/0,0 mode: PR/PR res: [0x2b734:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d21c6 expref: 1044 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.583799:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.583799:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.583799:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c513fd lrc: 3/0,1 mode: --/PW res: [0x2b732:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583804:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a8332865/0x3234de053c4f502 lrc: 2/0,0 mode: PR/PR res: [0x2b732:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8690 expref: 1044 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.583808:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.583808:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.583809:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005282bc2/0x3234de053c513f6 lrc: 4/0,1 mode: --/PW res: [0x2b734:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583809:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c513fd lrc: 4/0,1 mode: --/PW res: [0x2b732:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583817:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004355d948/0x3234de053c4dc5f lrc: 3/0,0 mode: PR/PR res: [0x2b734:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d21c6 expref: 1044 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.583817:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a8332865/0x3234de053c4f502 lrc: 3/0,0 mode: PR/PR res: [0x2b732:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8690 expref: 1044 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.583820:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004355d948/0x3234de053c4dc5f lrc: 4/0,0 mode: PR/PR res: [0x2b734:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d21c6 expref: 1044 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.583821:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a8332865/0x3234de053c4f502 lrc: 4/0,0 mode: PR/PR res: [0x2b732:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8690 expref: 1044 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.583824:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bddc5ca7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997004160:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.583825:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ea0220b6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997004224:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.583831:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fb6c773d going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.583834:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 000000000e7e66c4 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.583837:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211524 00000100:00100000:1.0:1651529344.583839:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1018:39029:x1731745946451264:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.583840:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024e518f1/0x3234de053c513e8 lrc: 2/0,0 mode: PW/PW res: [0x2b730:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.583843:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177971 count 1 00010000:00010000:0.0:1651529344.583843:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024e518f1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.583844:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024e518f1/0x3234de053c513e8 lrc: 2/0,0 mode: PW/PW res: [0x2b730:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583846:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000702421e2/0x3234de053c51404 lrc: 3/0,1 mode: --/PW res: [0x2b733:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583847:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024e518f1/0x3234de053c513e8 lrc: 3/0,0 mode: PW/PW res: [0x2b730:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583850:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a8f5e901/0x3234de053c4c1ee lrc: 2/0,0 mode: PR/PR res: [0x2b733:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc855 expref: 1044 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.583851:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024e518f1/0x3234de053c513e8 lrc: 1/0,0 mode: --/PW res: [0x2b730:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583854:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024e518f1/0x3234de053c513e8 lrc: 0/0,0 mode: --/PW res: [0x2b730:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583856:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.583857:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.583857:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000702421e2/0x3234de053c51404 lrc: 4/0,1 mode: --/PW res: [0x2b733:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583863:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a8f5e901/0x3234de053c4c1ee lrc: 3/0,0 mode: PR/PR res: [0x2b733:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc855 expref: 1044 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.583863:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000094bb6891/0x3234de053c513b7 lrc: 3/0,1 mode: PW/PW res: [0x2b72a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.583866:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a8f5e901/0x3234de053c4c1ee lrc: 4/0,0 mode: PR/PR res: [0x2b733:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc855 expref: 1044 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.583866:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094bb6891/0x3234de053c513b7 lrc: 3/0,1 mode: PW/PW res: [0x2b72a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583869:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094bb6891/0x3234de053c513b7 lrc: 3/0,1 mode: PW/PW res: [0x2b72a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.583870:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000fb8e412 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997004288:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.583872:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094bb6891/0x3234de053c513b7 lrc: 2/0,0 mode: PW/PW res: [0x2b72a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.583876:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 0000000089d75f07 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.583888:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.583908:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1019:39030:x1731745946450176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1754us (1784us total) trans 12885079575 rc 0/0 00000100:00100000:0.0:1651529344.583911:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211513 00000100:00100000:0.0:1651529344.583916:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946451392 00000100:00100000:1.0:1651529344.583923:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.583923:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211525 00000100:00100000:0.0:1651529344.583925:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1019:39029:x1731745946451392:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.583936:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177973 count 1 00010000:00010000:0.0:1651529344.583940:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c5140b lrc: 3/0,1 mode: --/PW res: [0x2b735:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583945:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007e5ba060/0x3234de053c49f9d lrc: 2/0,0 mode: PR/PR res: [0x2b735:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb4e4 expref: 1044 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.583948:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.583949:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.583949:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c5140b lrc: 4/0,1 mode: --/PW res: [0x2b735:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.583958:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007e5ba060/0x3234de053c49f9d lrc: 3/0,0 mode: PR/PR res: [0x2b735:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb4e4 expref: 1044 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.583962:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007e5ba060/0x3234de053c49f9d lrc: 4/0,0 mode: PR/PR res: [0x2b735:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb4e4 expref: 1044 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.583966:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004a6776b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997004352:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.583976:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946451456 00000100:00100000:1.0:1651529344.583992:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211526 00000100:00100000:1.0:1651529344.583994:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1020:39030:x1731745946451456:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.583998:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bff8744a going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.583999:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177974 count 1 00010000:00010000:1.0:1651529344.584003:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079615549/0x3234de053c51412 lrc: 3/0,1 mode: --/PW res: [0x2b736:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.584005:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094bb6891/0x3234de053c513b7 lrc: 2/0,0 mode: PW/PW res: [0x2b72a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.584007:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000054dd6f57/0x3234de053c4ec11 lrc: 2/0,0 mode: PR/PR res: [0x2b736:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d61d7 expref: 1044 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.584010:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.584011:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.584012:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079615549/0x3234de053c51412 lrc: 4/0,1 mode: --/PW res: [0x2b736:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.584018:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000054dd6f57/0x3234de053c4ec11 lrc: 3/0,0 mode: PR/PR res: [0x2b736:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d61d7 expref: 1044 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.584019:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000094bb6891 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.584020:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094bb6891/0x3234de053c513b7 lrc: 2/0,0 mode: PW/PW res: [0x2b72a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.584022:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000054dd6f57/0x3234de053c4ec11 lrc: 4/0,0 mode: PR/PR res: [0x2b736:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d61d7 expref: 1044 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.584024:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094bb6891/0x3234de053c513b7 lrc: 3/0,0 mode: PW/PW res: [0x2b72a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.584026:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000075b025a pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997004416:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.584028:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094bb6891/0x3234de053c513b7 lrc: 1/0,0 mode: --/PW res: [0x2b72a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.584031:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094bb6891/0x3234de053c513b7 lrc: 0/0,0 mode: --/PW res: [0x2b72a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.584034:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 0000000020dd7827 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.584086:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.584093:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.584100:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946451520 00000100:00100000:0.0:1651529344.584106:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946451584 00000100:00100000:0.0:1651529344.584110:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211527 00000100:00100000:0.0:1651529344.584112:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1022:39029:x1731745946451520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.584117:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177975 count 1 00010000:00010000:0.0:1651529344.584120:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c51419 lrc: 3/0,1 mode: --/PW res: [0x2b737:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.584125:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000892be50b/0x3234de053c4f3a4 lrc: 2/0,0 mode: PR/PR res: [0x2b737:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8134 expref: 1044 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.584128:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.584128:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.584129:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c51419 lrc: 4/0,1 mode: --/PW res: [0x2b737:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.584135:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000892be50b/0x3234de053c4f3a4 lrc: 3/0,0 mode: PR/PR res: [0x2b737:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8134 expref: 1044 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.584139:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000892be50b/0x3234de053c4f3a4 lrc: 4/0,0 mode: PR/PR res: [0x2b737:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8134 expref: 1044 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.584143:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000078f9a278 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997004480:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.584157:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000000d706dff going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.584164:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211528 00000100:00100000:0.0:1651529344.584166:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1022:39030:x1731745946451584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.584170:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177976 count 1 00010000:00010000:0.0:1651529344.584174:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c51420 lrc: 3/0,1 mode: --/PW res: [0x2b738:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.584178:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e69b5582/0x3234de053c4c807 lrc: 2/0,0 mode: PR/PR res: [0x2b738:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd250 expref: 1044 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.584181:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.584182:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.584182:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c51420 lrc: 4/0,1 mode: --/PW res: [0x2b738:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.584188:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e69b5582/0x3234de053c4c807 lrc: 3/0,0 mode: PR/PR res: [0x2b738:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd250 expref: 1044 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.584192:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e69b5582/0x3234de053c4c807 lrc: 4/0,0 mode: PR/PR res: [0x2b738:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd250 expref: 1044 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.584195:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000053ee5af1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997004544:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.584204:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e68b7e1f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.584534:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.584551:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ea0220b6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997004224:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.584556:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c513fd lrc: 3/0,1 mode: --/PW res: [0x2b732:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.584570:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.584578:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.584584:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.584594:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396332288 00010000:00010000:0.0:1651529344.584608:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000003152710/0x3234de053c4ccd7 lrc: 5/0,0 mode: PR/PR res: [0x2b731:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce551 expref: 1045 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.584614:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.584619:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.584619:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396332352 00010000:00010000:0.0:1651529344.584622:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004355d948/0x3234de053c4dc5f lrc: 5/0,0 mode: PR/PR res: [0x2b734:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d21c6 expref: 1046 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.584624:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.584626:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396332416 00010000:00010000:0.0:1651529344.584628:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a8332865/0x3234de053c4f502 lrc: 4/0,0 mode: PR/PR res: [0x2b732:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8690 expref: 1047 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.584631:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.584632:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396332480 00010000:00010000:0.0:1651529344.584634:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a8f5e901/0x3234de053c4c1ee lrc: 5/0,0 mode: PR/PR res: [0x2b733:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc855 expref: 1048 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.584638:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396332608 00000100:00100000:1.0:1651529344.584639:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f39ca9ea pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997004096:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.584640:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000054dd6f57/0x3234de053c4ec11 lrc: 5/0,0 mode: PR/PR res: [0x2b736:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d61d7 expref: 1049 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.584644:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005630c62e/0x3234de053c513ef lrc: 3/0,1 mode: --/PW res: [0x2b731:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.584644:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396332736 00010000:00010000:0.0:1651529344.584646:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e69b5582/0x3234de053c4c807 lrc: 5/0,0 mode: PR/PR res: [0x2b738:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd250 expref: 1050 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.584650:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396332544 00000100:00100000:1.0:1651529344.584651:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bddc5ca7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997004160:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.584652:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007e5ba060/0x3234de053c49f9d lrc: 5/0,0 mode: PR/PR res: [0x2b735:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb4e4 expref: 1051 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.584653:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000005282bc2/0x3234de053c513f6 lrc: 3/0,1 mode: --/PW res: [0x2b734:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.584656:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396332672 00010000:00010000:0.0:1651529344.584658:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000892be50b/0x3234de053c4f3a4 lrc: 5/0,0 mode: PR/PR res: [0x2b737:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8134 expref: 1052 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.584662:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000fb8e412 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997004288:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.584662:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12303 00010000:00010000:1.0:1651529344.584664:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000702421e2/0x3234de053c51404 lrc: 3/0,1 mode: --/PW res: [0x2b733:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.584664:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1052:41279:x1731746396332288:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.584667:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.584668:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000003152710/0x3234de053c4ccd7 lrc: 4/0,0 mode: PR/PR res: [0x2b731:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce551 expref: 1052 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.584670:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12304 00000100:00100000:1.0:1651529344.584672:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1052:41278:x1731746396332352:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.584672:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000003152710/0x3234de053c4ccd7 lrc: 3/0,0 mode: PR/PR res: [0x2b731:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce551 expref: 1052 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.584676:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.584677:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004355d948/0x3234de053c4dc5f lrc: 4/0,0 mode: PR/PR res: [0x2b734:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d21c6 expref: 1052 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.584678:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003152710/0x3234de053c4ccd7 lrc: 0/0,0 mode: --/PR res: [0x2b731:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce551 expref: 1052 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.584681:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004355d948/0x3234de053c4dc5f lrc: 3/0,0 mode: PR/PR res: [0x2b734:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d21c6 expref: 1051 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.584681:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.584682:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.584683:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005630c62e/0x3234de053c513ef lrc: 3/0,1 mode: PW/PW res: [0x2b731:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.584686:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004355d948/0x3234de053c4dc5f lrc: 0/0,0 mode: --/PR res: [0x2b734:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d21c6 expref: 1051 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.584686:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005630c62e/0x3234de053c513ef lrc: 4/0,1 mode: PW/PW res: [0x2b731:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.584690:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.584690:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.584691:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000005282bc2/0x3234de053c513f6 lrc: 3/0,1 mode: PW/PW res: [0x2b734:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.584696:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.584702:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005282bc2/0x3234de053c513f6 lrc: 4/0,1 mode: PW/PW res: [0x2b734:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.584706:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1050:41279:x1731746396332288:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (173us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.584708:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.584709:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12303 00000100:00100000:0.0:1651529344.584714:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12305 00000100:00100000:1.0:1651529344.584715:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1049:41278:x1731746396332352:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 43us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.584716:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1049:41279:x1731746396332416:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.584718:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12304 00010000:00010000:0.0:1651529344.584719:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.584720:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a8332865/0x3234de053c4f502 lrc: 4/0,0 mode: PR/PR res: [0x2b732:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8690 expref: 1049 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.584724:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12306 00000100:00100000:1.0:1651529344.584726:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1048:41278:x1731746396332480:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.584727:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a8332865/0x3234de053c4f502 lrc: 3/0,0 mode: PR/PR res: [0x2b732:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8690 expref: 1048 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.584728:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.584730:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a8f5e901/0x3234de053c4c1ee lrc: 4/0,0 mode: PR/PR res: [0x2b733:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc855 expref: 1048 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.584732:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8332865/0x3234de053c4f502 lrc: 0/0,0 mode: --/PR res: [0x2b732:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8690 expref: 1048 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.584733:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a8f5e901/0x3234de053c4c1ee lrc: 3/0,0 mode: PR/PR res: [0x2b733:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc855 expref: 1048 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.584745:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.584745:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.584746:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c513fd lrc: 3/0,1 mode: PW/PW res: [0x2b732:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.584749:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c513fd lrc: 4/0,1 mode: PW/PW res: [0x2b732:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.584750:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8f5e901/0x3234de053c4c1ee lrc: 0/0,0 mode: --/PR res: [0x2b733:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc855 expref: 1047 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.584754:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.584754:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.584755:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000702421e2/0x3234de053c51404 lrc: 3/0,1 mode: PW/PW res: [0x2b733:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.584756:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.584758:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000702421e2/0x3234de053c51404 lrc: 4/0,1 mode: PW/PW res: [0x2b733:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.584762:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1046:41279:x1731746396332416:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 45us (183us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.584764:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.584765:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12305 00000100:00100000:0.0:1651529344.584769:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12307 00000100:00100000:1.0:1651529344.584770:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1045:41278:x1731746396332480:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 44us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.584771:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1045:41278:x1731746396332608:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.584773:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12306 00010000:00010000:0.0:1651529344.584773:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.584775:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000054dd6f57/0x3234de053c4ec11 lrc: 5/0,0 mode: PR/PR res: [0x2b736:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d61d7 expref: 1045 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.584778:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12308 00010000:00010000:0.0:1651529344.584778:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000054dd6f57/0x3234de053c4ec11 lrc: 4/0,0 mode: PR/PR res: [0x2b736:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d61d7 expref: 1044 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.584780:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1044:41278:x1731746396332736:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.584782:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.584783:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.584784:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e69b5582/0x3234de053c4c807 lrc: 5/0,0 mode: PR/PR res: [0x2b738:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd250 expref: 1044 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.584784:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.584784:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000079615549/0x3234de053c51412 lrc: 3/0,1 mode: PW/PW res: [0x2b736:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.584787:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e69b5582/0x3234de053c4c807 lrc: 4/0,0 mode: PR/PR res: [0x2b738:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd250 expref: 1044 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.584787:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079615549/0x3234de053c51412 lrc: 4/0,1 mode: PW/PW res: [0x2b736:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.584791:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.584792:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.584793:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.584793:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c51420 lrc: 3/0,1 mode: PW/PW res: [0x2b738:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.584796:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c51420 lrc: 4/0,1 mode: PW/PW res: [0x2b738:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.584796:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1044:41278:x1731746396332608:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 24us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.584798:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12307 00010000:00010000:1.0:1651529344.584800:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.584802:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12309 00000100:00100000:0.0:1651529344.584803:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de6bf351 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1043:41278:x1731746396332544:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.584804:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1043:41278:x1731746396332736:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 24us (185us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.584805:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.584806:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007e5ba060/0x3234de053c49f9d lrc: 5/0,0 mode: PR/PR res: [0x2b735:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb4e4 expref: 1043 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.584807:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12308 00000100:00100000:1.0:1651529344.584810:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12310 00010000:00010000:0.0:1651529344.584810:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007e5ba060/0x3234de053c49f9d lrc: 4/0,0 mode: PR/PR res: [0x2b735:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb4e4 expref: 1042 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.584812:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1042:41278:x1731746396332672:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.584814:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.584814:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.584815:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000892be50b/0x3234de053c4f3a4 lrc: 5/0,0 mode: PR/PR res: [0x2b737:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8134 expref: 1042 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.584815:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.584815:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c5140b lrc: 3/0,1 mode: PW/PW res: [0x2b735:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.584818:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c5140b lrc: 4/0,1 mode: PW/PW res: [0x2b735:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.584821:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000892be50b/0x3234de053c4f3a4 lrc: 4/0,0 mode: PR/PR res: [0x2b737:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8134 expref: 1042 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.584823:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.584826:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.584826:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.584827:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c51419 lrc: 3/0,1 mode: PW/PW res: [0x2b737:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.584827:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de6bf351 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1042:41278:x1731746396332544:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 23us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.584829:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12309 00010000:00010000:1.0:1651529344.584830:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c51419 lrc: 4/0,1 mode: PW/PW res: [0x2b737:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.584833:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.584838:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1041:41278:x1731746396332672:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 25us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.584840:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12310 00010000:00010000:0.0:1651529344.584841:0:72395:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000892be50b/0x3234de053c4f3a4 lrc: 0/0,0 mode: --/PR res: [0x2b737:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8134 expref: 1041 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.584845:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000078f9a278 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997004480:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.584848:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c51419 lrc: 3/0,1 mode: PW/PW res: [0x2b737:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.584850:0:72396:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054dd6f57/0x3234de053c4ec11 lrc: 0/0,0 mode: --/PR res: [0x2b736:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d61d7 expref: 1039 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.584851:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c51419 lrc: 3/0,1 mode: PW/PW res: [0x2b737:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.584854:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000075b025a pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997004416:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.584854:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c51419 lrc: 3/0,1 mode: PW/PW res: [0x2b737:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.584857:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000079615549/0x3234de053c51412 lrc: 3/0,1 mode: PW/PW res: [0x2b736:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.584857:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c51419 lrc: 3/0,1 mode: PW/PW res: [0x2b737:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.584860:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000079615549/0x3234de053c51412 lrc: 3/0,1 mode: PW/PW res: [0x2b736:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.584860:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c51419 lrc: 2/0,0 mode: PW/PW res: [0x2b737:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.584863:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079615549/0x3234de053c51412 lrc: 3/0,1 mode: PW/PW res: [0x2b736:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.584867:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079615549/0x3234de053c51412 lrc: 3/0,1 mode: PW/PW res: [0x2b736:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.584870:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079615549/0x3234de053c51412 lrc: 2/0,0 mode: PW/PW res: [0x2b736:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.584915:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1024:39029:x1731745946451520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 802us (829us total) trans 12885079576 rc 0/0 00000100:00100000:0.0:1651529344.584920:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211527 00000100:00100000:1.0:1651529344.584922:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1024:39030:x1731745946451456:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 927us (999us total) trans 12885079577 rc 0/0 00000100:00100000:1.0:1651529344.584925:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211526 00010000:00010000:0.0:1651529344.584931:0:80281:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e69b5582/0x3234de053c4c807 lrc: 0/0,0 mode: --/PR res: [0x2b738:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd250 expref: 1038 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.584932:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000702421e2/0x3234de053c51404 lrc: 3/0,1 mode: PW/PW res: [0x2b733:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.584935:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000702421e2/0x3234de053c51404 lrc: 3/0,1 mode: PW/PW res: [0x2b733:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.584935:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000053ee5af1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997004544:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.584938:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000702421e2/0x3234de053c51404 lrc: 3/0,1 mode: PW/PW res: [0x2b733:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.584938:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c51420 lrc: 3/0,1 mode: PW/PW res: [0x2b738:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.584941:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000702421e2/0x3234de053c51404 lrc: 2/0,0 mode: PW/PW res: [0x2b733:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.584941:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c51420 lrc: 3/0,1 mode: PW/PW res: [0x2b738:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.584944:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c51420 lrc: 3/0,1 mode: PW/PW res: [0x2b738:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.584947:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c51420 lrc: 3/0,1 mode: PW/PW res: [0x2b738:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.584956:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c51420 lrc: 2/0,0 mode: PW/PW res: [0x2b738:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.584979:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1024:39029:x1731745946451264:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1139us (1290us total) trans 12885079578 rc 0/0 00000100:00100000:1.0:1651529344.584981:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211524 00010000:00010000:1.0:1651529344.584988:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000005282bc2/0x3234de053c513f6 lrc: 3/0,1 mode: PW/PW res: [0x2b734:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.584991:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1023:39030:x1731745946451584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 824us (897us total) trans 12885079579 rc 0/0 00010000:00010000:1.0:1651529344.584993:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005282bc2/0x3234de053c513f6 lrc: 3/0,1 mode: PW/PW res: [0x2b734:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.584994:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211528 00010000:00010000:1.0:1651529344.584996:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005282bc2/0x3234de053c513f6 lrc: 3/0,1 mode: PW/PW res: [0x2b734:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.584999:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005282bc2/0x3234de053c513f6 lrc: 2/0,0 mode: PW/PW res: [0x2b734:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585001:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c513fd lrc: 3/0,1 mode: PW/PW res: [0x2b732:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585007:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c513fd lrc: 3/0,1 mode: PW/PW res: [0x2b732:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585010:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c513fd lrc: 3/0,1 mode: PW/PW res: [0x2b732:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585012:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c513fd lrc: 2/0,0 mode: PW/PW res: [0x2b732:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.585028:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1024:39030:x1731745946451328:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1243us (1354us total) trans 12885079580 rc 0/0 00000100:00100000:1.0:1651529344.585031:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211523 00010000:00010000:1.0:1651529344.585037:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005630c62e/0x3234de053c513ef lrc: 3/0,1 mode: PW/PW res: [0x2b731:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.585040:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005630c62e/0x3234de053c513ef lrc: 3/0,1 mode: PW/PW res: [0x2b731:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.585043:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005630c62e/0x3234de053c513ef lrc: 3/0,1 mode: PW/PW res: [0x2b731:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.585043:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1023:39030:x1731745946451200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1276us (1386us total) trans 12885079581 rc 0/0 00010000:00010000:1.0:1651529344.585045:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005630c62e/0x3234de053c513ef lrc: 2/0,0 mode: PW/PW res: [0x2b731:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.585046:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211522 00010000:00010000:0.0:1651529344.585052:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c51419 lrc: 2/0,0 mode: PW/PW res: [0x2b737:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585055:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d1b07eb5 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.585056:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c51419 lrc: 2/0,0 mode: PW/PW res: [0x2b737:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585059:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c51419 lrc: 3/0,0 mode: PW/PW res: [0x2b737:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585064:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c51419 lrc: 1/0,0 mode: --/PW res: [0x2b737:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585066:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c51419 lrc: 0/0,0 mode: --/PW res: [0x2b737:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585071:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079615549/0x3234de053c51412 lrc: 2/0,0 mode: PW/PW res: [0x2b736:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.585074:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1023:39030:x1731745946451136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1354us (1432us total) trans 12885079582 rc 0/0 00010000:00010000:0.0:1651529344.585074:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000079615549 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.585074:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079615549/0x3234de053c51412 lrc: 2/0,0 mode: PW/PW res: [0x2b736:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585077:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079615549/0x3234de053c51412 lrc: 3/0,0 mode: PW/PW res: [0x2b736:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.585078:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211521 00010000:00010000:0.0:1651529344.585080:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079615549/0x3234de053c51412 lrc: 1/0,0 mode: --/PW res: [0x2b736:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585083:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079615549/0x3234de053c51412 lrc: 0/0,0 mode: --/PW res: [0x2b736:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585086:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000702421e2/0x3234de053c51404 lrc: 2/0,0 mode: PW/PW res: [0x2b733:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585089:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000702421e2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.585089:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000702421e2/0x3234de053c51404 lrc: 2/0,0 mode: PW/PW res: [0x2b733:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585092:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000702421e2/0x3234de053c51404 lrc: 3/0,0 mode: PW/PW res: [0x2b733:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585095:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000702421e2/0x3234de053c51404 lrc: 1/0,0 mode: --/PW res: [0x2b733:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585098:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000702421e2/0x3234de053c51404 lrc: 0/0,0 mode: --/PW res: [0x2b733:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585101:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c51420 lrc: 2/0,0 mode: PW/PW res: [0x2b738:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585104:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e696ff9d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.585105:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c51420 lrc: 2/0,0 mode: PW/PW res: [0x2b738:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585107:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c51420 lrc: 3/0,0 mode: PW/PW res: [0x2b738:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585110:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c51420 lrc: 1/0,0 mode: --/PW res: [0x2b738:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585113:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c51420 lrc: 0/0,0 mode: --/PW res: [0x2b738:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585116:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005282bc2/0x3234de053c513f6 lrc: 2/0,0 mode: PW/PW res: [0x2b734:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585119:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000005282bc2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.585119:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005282bc2/0x3234de053c513f6 lrc: 2/0,0 mode: PW/PW res: [0x2b734:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585124:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005282bc2/0x3234de053c513f6 lrc: 3/0,0 mode: PW/PW res: [0x2b734:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585128:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005282bc2/0x3234de053c513f6 lrc: 1/0,0 mode: --/PW res: [0x2b734:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585130:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005282bc2/0x3234de053c513f6 lrc: 0/0,0 mode: --/PW res: [0x2b734:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585133:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c513fd lrc: 2/0,0 mode: PW/PW res: [0x2b732:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585136:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000004c7843a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.585137:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c513fd lrc: 2/0,0 mode: PW/PW res: [0x2b732:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585139:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c513fd lrc: 3/0,0 mode: PW/PW res: [0x2b732:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585142:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c513fd lrc: 1/0,0 mode: --/PW res: [0x2b732:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585145:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c513fd lrc: 0/0,0 mode: --/PW res: [0x2b732:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585148:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005630c62e/0x3234de053c513ef lrc: 2/0,0 mode: PW/PW res: [0x2b731:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585151:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005630c62e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.585152:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005630c62e/0x3234de053c513ef lrc: 2/0,0 mode: PW/PW res: [0x2b731:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585155:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005630c62e/0x3234de053c513ef lrc: 3/0,0 mode: PW/PW res: [0x2b731:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585158:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005630c62e/0x3234de053c513ef lrc: 1/0,0 mode: --/PW res: [0x2b731:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585160:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005630c62e/0x3234de053c513ef lrc: 0/0,0 mode: --/PW res: [0x2b731:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585170:0:106695:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e5ba060/0x3234de053c49f9d lrc: 0/0,0 mode: --/PR res: [0x2b735:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb4e4 expref: 1037 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.585174:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004a6776b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997004352:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.585207:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c5140b lrc: 3/0,1 mode: PW/PW res: [0x2b735:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585211:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c5140b lrc: 3/0,1 mode: PW/PW res: [0x2b735:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585221:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c5140b lrc: 3/0,1 mode: PW/PW res: [0x2b735:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585243:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c5140b lrc: 3/0,1 mode: PW/PW res: [0x2b735:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585246:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c5140b lrc: 2/0,0 mode: PW/PW res: [0x2b735:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.585324:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1023:39029:x1731745946451392:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1391us (1428us total) trans 12885079583 rc 0/0 00000100:00100000:0.0:1651529344.585327:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211525 00010000:00010000:0.0:1651529344.585335:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c5140b lrc: 2/0,0 mode: PW/PW res: [0x2b735:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585338:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a706026 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.585339:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c5140b lrc: 2/0,0 mode: PW/PW res: [0x2b735:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585353:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c5140b lrc: 3/0,0 mode: PW/PW res: [0x2b735:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585358:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c5140b lrc: 1/0,0 mode: --/PW res: [0x2b735:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585360:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c5140b lrc: 0/0,0 mode: --/PW res: [0x2b735:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.585361:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.585372:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.585377:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946452160 00000100:00100000:1.0:1651529344.585379:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.585393:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.585393:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946452224 00000100:00100000:0.0:1651529344.585406:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946452352 00000100:00100000:1.0:1651529344.585408:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946452288 00000100:00100000:0.0:1651529344.585413:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211529 00000100:00100000:0.0:1651529344.585414:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1026:39030:x1731745946452160:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.585422:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211530 00000100:00100000:1.0:1651529344.585424:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1026:39030:x1731745946452224:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.585430:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177978 count 1 00010000:00010000:1.0:1651529344.585434:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000865040d5/0x3234de053c51427 lrc: 3/0,1 mode: --/PW res: [0x2b73a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.585439:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c4cbf7 lrc: 2/0,0 mode: PR/PR res: [0x2b73a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce1a0 expref: 1036 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.585442:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.585443:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.585443:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000865040d5/0x3234de053c51427 lrc: 4/0,1 mode: --/PW res: [0x2b73a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.585451:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177977 count 1 00010000:00010000:0.0:1651529344.585456:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c5142e lrc: 3/0,1 mode: --/PW res: [0x2b739:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585461:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b26b71e3/0x3234de053c4f334 lrc: 2/0,0 mode: PR/PR res: [0x2b739:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f43 expref: 1036 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.585463:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c4cbf7 lrc: 3/0,0 mode: PR/PR res: [0x2b73a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce1a0 expref: 1036 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.585464:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.585465:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.585465:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c5142e lrc: 4/0,1 mode: --/PW res: [0x2b739:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.585467:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c4cbf7 lrc: 4/0,0 mode: PR/PR res: [0x2b73a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce1a0 expref: 1036 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.585472:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000057329b82 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997004608:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.585472:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b26b71e3/0x3234de053c4f334 lrc: 3/0,0 mode: PR/PR res: [0x2b739:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f43 expref: 1036 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.585476:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b26b71e3/0x3234de053c4f334 lrc: 4/0,0 mode: PR/PR res: [0x2b739:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f43 expref: 1036 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.585480:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004a6776b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997004672:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.585481:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f79d8146 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.585488:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211531 00000100:00100000:1.0:1651529344.585489:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1026:39030:x1731745946452352:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.585494:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177980 count 1 00010000:00010000:1.0:1651529344.585497:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000905f0208/0x3234de053c51435 lrc: 3/0,1 mode: --/PW res: [0x2b73c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.585501:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006346f85e/0x3234de053c4e668 lrc: 2/0,0 mode: PR/PR res: [0x2b73c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a68 expref: 1036 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.585503:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e68b7e1f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.585505:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.585505:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.585506:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000905f0208/0x3234de053c51435 lrc: 4/0,1 mode: --/PW res: [0x2b73c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.585510:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211532 00010000:00010000:1.0:1651529344.585512:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006346f85e/0x3234de053c4e668 lrc: 3/0,0 mode: PR/PR res: [0x2b73c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a68 expref: 1036 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.585512:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1026:39030:x1731745946452288:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.585515:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006346f85e/0x3234de053c4e668 lrc: 4/0,0 mode: PR/PR res: [0x2b73c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a68 expref: 1036 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:0.0:1651529344.585517:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177979 count 1 00000100:00100000:1.0:1651529344.585519:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006e3eb319 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997004736:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.585521:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c5143c lrc: 3/0,1 mode: --/PW res: [0x2b73b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.585525:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d09f5ee1 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.585525:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000776a84f4/0x3234de053c4f303 lrc: 2/0,0 mode: PR/PR res: [0x2b73b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ec5 expref: 1036 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.585528:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.585529:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.585530:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c5143c lrc: 4/0,1 mode: --/PW res: [0x2b73b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585536:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000776a84f4/0x3234de053c4f303 lrc: 3/0,0 mode: PR/PR res: [0x2b73b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ec5 expref: 1036 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.585539:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.585539:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000776a84f4/0x3234de053c4f303 lrc: 4/0,0 mode: PR/PR res: [0x2b73b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ec5 expref: 1036 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.585543:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000053ee5af1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997004800:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.585551:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e1aa6a77 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.585552:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.585556:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946452480 00000100:00100000:1.0:1651529344.585562:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.585563:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946452416 00000100:00100000:0.0:1651529344.585578:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946452544 00000100:00100000:0.0:1651529344.585586:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211533 00000100:00100000:0.0:1651529344.585587:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1029:39030:x1731745946452480:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.585592:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177982 count 1 00010000:00010000:0.0:1651529344.585595:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51443 lrc: 3/0,1 mode: --/PW res: [0x2b73e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.585600:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.585600:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eaf12d4f/0x3234de053c4e7e2 lrc: 2/0,0 mode: PR/PR res: [0x2b73e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5026 expref: 1036 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.585603:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.585603:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.585604:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51443 lrc: 4/0,1 mode: --/PW res: [0x2b73e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585610:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eaf12d4f/0x3234de053c4e7e2 lrc: 3/0,0 mode: PR/PR res: [0x2b73e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5026 expref: 1036 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.585613:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eaf12d4f/0x3234de053c4e7e2 lrc: 4/0,0 mode: PR/PR res: [0x2b73e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5026 expref: 1036 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.585617:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000078f9a278 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997004864:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.585629:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 0000000049203969 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.585635:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946452608 00000100:00100000:1.0:1651529344.585639:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211534 00000100:00100000:1.0:1651529344.585641:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1030:39029:x1731745946452416:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.585642:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211535 00000100:00100000:0.0:1651529344.585644:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f3433a83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1030:39029:x1731745946452544:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.585646:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177981 count 1 00002000:00080000:0.0:1651529344.585648:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177983 count 1 00010000:00010000:1.0:1651529344.585651:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4af5857/0x3234de053c5144a lrc: 3/0,1 mode: --/PW res: [0x2b73d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585651:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51451 lrc: 3/0,1 mode: --/PW res: [0x2b73f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.585655:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000eec163c/0x3234de053c4d6b6 lrc: 2/0,0 mode: PR/PR res: [0x2b73d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c87 expref: 1036 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.585655:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9b5cda2/0x3234de053c4e05d lrc: 2/0,0 mode: PR/PR res: [0x2b73f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3243 expref: 1036 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.585658:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.585659:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.585659:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.585659:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.585660:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4af5857/0x3234de053c5144a lrc: 4/0,1 mode: --/PW res: [0x2b73d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585660:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51451 lrc: 4/0,1 mode: --/PW res: [0x2b73f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.585666:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e9b5cda2/0x3234de053c4e05d lrc: 3/0,0 mode: PR/PR res: [0x2b73f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3243 expref: 1036 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.585667:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000eec163c/0x3234de053c4d6b6 lrc: 3/0,0 mode: PR/PR res: [0x2b73d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c87 expref: 1036 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.585670:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000eec163c/0x3234de053c4d6b6 lrc: 4/0,0 mode: PR/PR res: [0x2b73d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c87 expref: 1036 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.585674:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000fb8e412 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997004992:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.585682:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 000000004ca54b8a going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.585686:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e9b5cda2/0x3234de053c4e05d lrc: 4/0,0 mode: PR/PR res: [0x2b73f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3243 expref: 1036 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.585689:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211536 00000100:00100000:1.0:1651529344.585690:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1030:39029:x1731745946452608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.585690:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ea0220b6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997004928:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.585695:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177984 count 1 00010000:00010000:1.0:1651529344.585698:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed1d2805/0x3234de053c51458 lrc: 3/0,1 mode: --/PW res: [0x2b740:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.585699:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 0000000076b354b3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.585705:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c49f49 lrc: 2/0,0 mode: PR/PR res: [0x2b740:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb36a expref: 1036 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.585708:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.585708:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.585709:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed1d2805/0x3234de053c51458 lrc: 4/0,1 mode: --/PW res: [0x2b740:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.585714:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c49f49 lrc: 3/0,0 mode: PR/PR res: [0x2b740:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb36a expref: 1036 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.585718:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c49f49 lrc: 4/0,0 mode: PR/PR res: [0x2b740:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb36a expref: 1036 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.585722:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bddc5ca7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997005056:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.585728:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 0000000020dd7827 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.586176:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000057329b82 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997004608:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.586180:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000865040d5/0x3234de053c51427 lrc: 3/0,1 mode: --/PW res: [0x2b73a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.586253:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006e3eb319 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997004736:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.586256:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.586257:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000905f0208/0x3234de053c51435 lrc: 3/0,1 mode: --/PW res: [0x2b73c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.586265:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.586274:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.586281:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396333312 00000100:00100000:0.0:1651529344.586282:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.586286:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c4cbf7 lrc: 4/0,0 mode: PR/PR res: [0x2b73a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce1a0 expref: 1037 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.586292:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396333504 00010000:00010000:1.0:1651529344.586300:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006346f85e/0x3234de053c4e668 lrc: 4/0,0 mode: PR/PR res: [0x2b73c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a68 expref: 1038 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.586307:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.586309:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396333376 00010000:00010000:1.0:1651529344.586312:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b26b71e3/0x3234de053c4f334 lrc: 5/0,0 mode: PR/PR res: [0x2b739:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f43 expref: 1039 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.586313:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.586316:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396333440 00010000:00010000:1.0:1651529344.586318:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000776a84f4/0x3234de053c4f303 lrc: 5/0,0 mode: PR/PR res: [0x2b73b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ec5 expref: 1040 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.586318:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.586323:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396333632 00000100:00100000:0.0:1651529344.586324:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.586325:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000eec163c/0x3234de053c4d6b6 lrc: 5/0,0 mode: PR/PR res: [0x2b73d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c87 expref: 1041 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.586328:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396333568 00010000:00010000:1.0:1651529344.586330:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eaf12d4f/0x3234de053c4e7e2 lrc: 5/0,0 mode: PR/PR res: [0x2b73e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5026 expref: 1042 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.586333:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ea0220b6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997004928:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.586334:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396333760 00010000:00010000:1.0:1651529344.586336:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c49f49 lrc: 5/0,0 mode: PR/PR res: [0x2b740:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb36a expref: 1043 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.586337:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51451 lrc: 3/0,1 mode: --/PW res: [0x2b73f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.586340:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396333696 00010000:00010000:1.0:1651529344.586342:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b5cda2/0x3234de053c4e05d lrc: 4/0,0 mode: PR/PR res: [0x2b73f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3243 expref: 1044 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.586344:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000053ee5af1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997004800:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.586347:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12311 00010000:00010000:0.0:1651529344.586347:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c5143c lrc: 3/0,1 mode: --/PW res: [0x2b73b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.586349:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1044:41279:x1731746396333312:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.586352:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.586353:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c4cbf7 lrc: 4/0,0 mode: PR/PR res: [0x2b73a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce1a0 expref: 1044 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.586353:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000078f9a278 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997004864:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.586356:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51443 lrc: 3/0,1 mode: --/PW res: [0x2b73e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.586357:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c4cbf7 lrc: 3/0,0 mode: PR/PR res: [0x2b73a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce1a0 expref: 1044 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.586361:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004a6776b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997004672:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.586363:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c4cbf7 lrc: 0/0,0 mode: --/PR res: [0x2b73a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce1a0 expref: 1044 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.586363:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c5142e lrc: 3/0,1 mode: --/PW res: [0x2b739:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.586366:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.586367:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.586368:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000865040d5/0x3234de053c51427 lrc: 3/0,1 mode: PW/PW res: [0x2b73a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.586370:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12312 00010000:00010000:1.0:1651529344.586371:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000865040d5/0x3234de053c51427 lrc: 4/0,1 mode: PW/PW res: [0x2b73a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.586372:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1043:41279:x1731746396333504:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.586376:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.586377:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.586377:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006346f85e/0x3234de053c4e668 lrc: 4/0,0 mode: PR/PR res: [0x2b73c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a68 expref: 1043 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.586381:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006346f85e/0x3234de053c4e668 lrc: 3/0,0 mode: PR/PR res: [0x2b73c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a68 expref: 1043 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.586386:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1043:41279:x1731746396333312:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 36us (130us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.586387:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006346f85e/0x3234de053c4e668 lrc: 0/0,0 mode: --/PR res: [0x2b73c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a68 expref: 1043 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.586388:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12311 00010000:00010000:0.0:1651529344.586391:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.586392:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.586392:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000905f0208/0x3234de053c51435 lrc: 3/0,1 mode: PW/PW res: [0x2b73c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.586393:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12313 00000100:00100000:1.0:1651529344.586394:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1041:41278:x1731746396333376:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.586395:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000905f0208/0x3234de053c51435 lrc: 4/0,1 mode: PW/PW res: [0x2b73c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.586397:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.586398:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b26b71e3/0x3234de053c4f334 lrc: 4/0,0 mode: PR/PR res: [0x2b739:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f43 expref: 1041 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.586402:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b26b71e3/0x3234de053c4f334 lrc: 3/0,0 mode: PR/PR res: [0x2b739:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f43 expref: 1041 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.586408:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.586414:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b26b71e3/0x3234de053c4f334 lrc: 0/0,0 mode: --/PR res: [0x2b739:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f43 expref: 1041 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.586415:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1041:41279:x1731746396333504:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 43us (149us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.586417:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.586418:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.586418:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12312 00010000:00010000:1.0:1651529344.586419:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c5142e lrc: 3/0,1 mode: PW/PW res: [0x2b739:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.586422:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c5142e lrc: 4/0,1 mode: PW/PW res: [0x2b739:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.586424:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12314 00000100:00100000:0.0:1651529344.586426:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1039:41278:x1731746396333440:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.586428:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.586431:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.586437:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1039:41278:x1731746396333376:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (163us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.586437:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000776a84f4/0x3234de053c4f303 lrc: 4/0,0 mode: PR/PR res: [0x2b73b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ec5 expref: 1039 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.586439:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12313 00010000:00010000:0.0:1651529344.586441:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000776a84f4/0x3234de053c4f303 lrc: 3/0,0 mode: PR/PR res: [0x2b73b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ec5 expref: 1039 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.586444:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12315 00000100:00100000:1.0:1651529344.586446:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1038:41278:x1731746396333632:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.586446:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000776a84f4/0x3234de053c4f303 lrc: 0/0,0 mode: --/PR res: [0x2b73b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ec5 expref: 1038 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.586448:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.586449:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.586450:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000eec163c/0x3234de053c4d6b6 lrc: 5/0,0 mode: PR/PR res: [0x2b73d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c87 expref: 1037 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.586450:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.586451:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c5143c lrc: 3/0,1 mode: PW/PW res: [0x2b73b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.586453:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000eec163c/0x3234de053c4d6b6 lrc: 4/0,0 mode: PR/PR res: [0x2b73d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c87 expref: 1037 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.586454:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c5143c lrc: 4/0,1 mode: PW/PW res: [0x2b73b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.586458:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.586458:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.586459:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e4af5857/0x3234de053c5144a lrc: 3/0,1 mode: PW/PW res: [0x2b73d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586459:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.586462:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4af5857/0x3234de053c5144a lrc: 4/0,1 mode: PW/PW res: [0x2b73d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.586465:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1037:41278:x1731746396333440:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 39us (183us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.586466:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.586468:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12314 00000100:00100000:1.0:1651529344.586471:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1036:41278:x1731746396333632:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 24us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.586472:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12316 00000100:00100000:1.0:1651529344.586474:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12315 00000100:00100000:0.0:1651529344.586474:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000d49c4f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1036:41279:x1731746396333568:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.586477:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.586478:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12317 00010000:00010000:0.0:1651529344.586478:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eaf12d4f/0x3234de053c4e7e2 lrc: 4/0,0 mode: PR/PR res: [0x2b73e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5026 expref: 1035 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.586479:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1035:41278:x1731746396333760:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.586482:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.586482:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eaf12d4f/0x3234de053c4e7e2 lrc: 3/0,0 mode: PR/PR res: [0x2b73e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5026 expref: 1035 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.586483:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c49f49 lrc: 5/0,0 mode: PR/PR res: [0x2b740:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb36a expref: 1035 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.586486:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c49f49 lrc: 4/0,0 mode: PR/PR res: [0x2b740:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb36a expref: 1035 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.586486:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eaf12d4f/0x3234de053c4e7e2 lrc: 0/0,0 mode: --/PR res: [0x2b73e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5026 expref: 1035 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.586489:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.586490:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.586490:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.586491:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.586491:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51443 lrc: 3/0,1 mode: PW/PW res: [0x2b73e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.586492:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ed1d2805/0x3234de053c51458 lrc: 3/0,1 mode: PW/PW res: [0x2b740:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586494:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51443 lrc: 4/0,1 mode: PW/PW res: [0x2b73e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.586495:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed1d2805/0x3234de053c51458 lrc: 4/0,1 mode: PW/PW res: [0x2b740:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.586498:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.586499:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.586502:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1034:41278:x1731746396333760:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 22us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.586504:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12317 00000100:00100000:0.0:1651529344.586504:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000d49c4f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1034:41279:x1731746396333568:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 29us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.586506:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12316 00000100:00100000:1.0:1651529344.586508:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12318 00000100:00100000:1.0:1651529344.586509:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1032:41279:x1731746396333696:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.586511:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.586513:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e9b5cda2/0x3234de053c4e05d lrc: 4/0,0 mode: PR/PR res: [0x2b73f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3243 expref: 1032 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.586516:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e9b5cda2/0x3234de053c4e05d lrc: 3/0,0 mode: PR/PR res: [0x2b73f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3243 expref: 1032 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.586516:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c5142e lrc: 3/0,1 mode: PW/PW res: [0x2b739:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586519:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c5142e lrc: 3/0,1 mode: PW/PW res: [0x2b739:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.586520:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b5cda2/0x3234de053c4e05d lrc: 0/0,0 mode: --/PR res: [0x2b73f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3243 expref: 1032 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.586522:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c5142e lrc: 3/0,1 mode: PW/PW res: [0x2b739:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.586524:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.586524:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.586525:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51451 lrc: 3/0,1 mode: PW/PW res: [0x2b73f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586525:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c5142e lrc: 2/0,0 mode: PW/PW res: [0x2b739:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.586528:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51451 lrc: 4/0,1 mode: PW/PW res: [0x2b73f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.586536:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.586541:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1031:41279:x1731746396333696:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 31us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.586544:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12318 00010000:00010000:1.0:1651529344.586555:0:72396:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000eec163c/0x3234de053c4d6b6 lrc: 0/0,0 mode: --/PR res: [0x2b73d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c87 expref: 1030 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.586559:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000fb8e412 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997004992:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.586562:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e4af5857/0x3234de053c5144a lrc: 3/0,1 mode: PW/PW res: [0x2b73d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.586565:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e4af5857/0x3234de053c5144a lrc: 3/0,1 mode: PW/PW res: [0x2b73d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.586568:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4af5857/0x3234de053c5144a lrc: 3/0,1 mode: PW/PW res: [0x2b73d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.586571:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4af5857/0x3234de053c5144a lrc: 3/0,1 mode: PW/PW res: [0x2b73d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.586573:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1031:39030:x1731745946452160:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1158us (1213us total) trans 12885079584 rc 0/0 00010000:00010000:1.0:1651529344.586574:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4af5857/0x3234de053c5144a lrc: 2/0,0 mode: PW/PW res: [0x2b73d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.586576:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211529 00010000:00010000:0.0:1651529344.586589:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c5143c lrc: 3/0,1 mode: PW/PW res: [0x2b73b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586592:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c5143c lrc: 3/0,1 mode: PW/PW res: [0x2b73b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586595:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c5143c lrc: 3/0,1 mode: PW/PW res: [0x2b73b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586598:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c5143c lrc: 2/0,0 mode: PW/PW res: [0x2b73b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.586617:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1032:39029:x1731745946452416:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 975us (1065us total) trans 12885079585 rc 0/0 00000100:00100000:1.0:1651529344.586622:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211534 00010000:00010000:1.0:1651529344.586632:0:80280:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c49f49 lrc: 0/0,0 mode: --/PR res: [0x2b740:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb36a expref: 1029 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.586633:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1031:39030:x1731745946452288:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1120us (1245us total) trans 12885079586 rc 0/0 00000100:00100000:1.0:1651529344.586636:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bddc5ca7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997005056:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.586638:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211532 00010000:00010000:1.0:1651529344.586640:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ed1d2805/0x3234de053c51458 lrc: 3/0,1 mode: PW/PW res: [0x2b740:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.586643:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ed1d2805/0x3234de053c51458 lrc: 3/0,1 mode: PW/PW res: [0x2b740:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586644:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51443 lrc: 3/0,1 mode: PW/PW res: [0x2b73e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.586646:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed1d2805/0x3234de053c51458 lrc: 3/0,1 mode: PW/PW res: [0x2b740:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586647:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51443 lrc: 3/0,1 mode: PW/PW res: [0x2b73e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.586649:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed1d2805/0x3234de053c51458 lrc: 3/0,1 mode: PW/PW res: [0x2b740:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.586651:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed1d2805/0x3234de053c51458 lrc: 2/0,0 mode: PW/PW res: [0x2b740:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586651:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51443 lrc: 3/0,1 mode: PW/PW res: [0x2b73e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586653:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51443 lrc: 2/0,0 mode: PW/PW res: [0x2b73e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.586684:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1032:39029:x1731745946452608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 992us (1084us total) trans 12885079587 rc 0/0 00000100:00100000:0.0:1651529344.586685:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1032:39030:x1731745946452480:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1097us (1146us total) trans 12885079588 rc 0/0 00000100:00100000:1.0:1651529344.586686:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211536 00000100:00100000:0.0:1651529344.586688:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211533 00010000:00010000:1.0:1651529344.586693:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000865040d5/0x3234de053c51427 lrc: 3/0,1 mode: PW/PW res: [0x2b73a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586694:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c5142e lrc: 2/0,0 mode: PW/PW res: [0x2b739:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586698:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c9570753 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.586699:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000865040d5/0x3234de053c51427 lrc: 3/0,1 mode: PW/PW res: [0x2b73a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586699:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c5142e lrc: 2/0,0 mode: PW/PW res: [0x2b739:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586701:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c5142e lrc: 3/0,0 mode: PW/PW res: [0x2b739:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.586702:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000865040d5/0x3234de053c51427 lrc: 3/0,1 mode: PW/PW res: [0x2b73a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.586705:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000865040d5/0x3234de053c51427 lrc: 2/0,0 mode: PW/PW res: [0x2b73a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586706:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c5142e lrc: 1/0,0 mode: --/PW res: [0x2b739:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586709:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c5142e lrc: 0/0,0 mode: --/PW res: [0x2b739:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586713:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4af5857/0x3234de053c5144a lrc: 2/0,0 mode: PW/PW res: [0x2b73d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586716:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e4af5857 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.586717:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4af5857/0x3234de053c5144a lrc: 2/0,0 mode: PW/PW res: [0x2b73d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586720:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4af5857/0x3234de053c5144a lrc: 3/0,0 mode: PW/PW res: [0x2b73d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586723:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4af5857/0x3234de053c5144a lrc: 1/0,0 mode: --/PW res: [0x2b73d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586725:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4af5857/0x3234de053c5144a lrc: 0/0,0 mode: --/PW res: [0x2b73d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586729:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c5143c lrc: 2/0,0 mode: PW/PW res: [0x2b73b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586731:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e6b94407 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.586732:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c5143c lrc: 2/0,0 mode: PW/PW res: [0x2b73b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.586749:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1031:39030:x1731745946452224:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1324us (1377us total) trans 12885079589 rc 0/0 00010000:00010000:0.0:1651529344.586749:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c5143c lrc: 3/0,0 mode: PW/PW res: [0x2b73b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.586752:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211530 00010000:00010000:0.0:1651529344.586752:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c5143c lrc: 1/0,0 mode: --/PW res: [0x2b73b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586755:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c5143c lrc: 0/0,0 mode: --/PW res: [0x2b73b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.586759:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000905f0208/0x3234de053c51435 lrc: 3/0,1 mode: PW/PW res: [0x2b73c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586759:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed1d2805/0x3234de053c51458 lrc: 2/0,0 mode: PW/PW res: [0x2b740:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.586762:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000905f0208/0x3234de053c51435 lrc: 3/0,1 mode: PW/PW res: [0x2b73c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586762:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ed1d2805 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.586763:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed1d2805/0x3234de053c51458 lrc: 2/0,0 mode: PW/PW res: [0x2b740:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.586765:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000905f0208/0x3234de053c51435 lrc: 3/0,1 mode: PW/PW res: [0x2b73c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586765:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed1d2805/0x3234de053c51458 lrc: 3/0,0 mode: PW/PW res: [0x2b740:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.586768:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000905f0208/0x3234de053c51435 lrc: 2/0,0 mode: PW/PW res: [0x2b73c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586768:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed1d2805/0x3234de053c51458 lrc: 1/0,0 mode: --/PW res: [0x2b740:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586771:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed1d2805/0x3234de053c51458 lrc: 0/0,0 mode: --/PW res: [0x2b740:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586774:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51443 lrc: 2/0,0 mode: PW/PW res: [0x2b73e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586777:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088cc87df already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.586778:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51443 lrc: 2/0,0 mode: PW/PW res: [0x2b73e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586781:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51443 lrc: 3/0,0 mode: PW/PW res: [0x2b73e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586784:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51443 lrc: 1/0,0 mode: --/PW res: [0x2b73e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586786:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51443 lrc: 0/0,0 mode: --/PW res: [0x2b73e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586789:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000865040d5/0x3234de053c51427 lrc: 2/0,0 mode: PW/PW res: [0x2b73a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586792:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000865040d5 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.586793:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000865040d5/0x3234de053c51427 lrc: 2/0,0 mode: PW/PW res: [0x2b73a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586795:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000865040d5/0x3234de053c51427 lrc: 3/0,0 mode: PW/PW res: [0x2b73a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586798:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000865040d5/0x3234de053c51427 lrc: 1/0,0 mode: --/PW res: [0x2b73a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.586799:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1031:39030:x1731745946452352:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1309us (1419us total) trans 12885079590 rc 0/0 00010000:00010000:0.0:1651529344.586801:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000865040d5/0x3234de053c51427 lrc: 0/0,0 mode: --/PW res: [0x2b73a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.586803:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211531 00010000:00010000:0.0:1651529344.586804:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000905f0208/0x3234de053c51435 lrc: 2/0,0 mode: PW/PW res: [0x2b73c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586807:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000905f0208 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.586808:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000905f0208/0x3234de053c51435 lrc: 2/0,0 mode: PW/PW res: [0x2b73c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586810:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000905f0208/0x3234de053c51435 lrc: 3/0,0 mode: PW/PW res: [0x2b73c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586813:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000905f0208/0x3234de053c51435 lrc: 1/0,0 mode: --/PW res: [0x2b73c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586816:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000905f0208/0x3234de053c51435 lrc: 0/0,0 mode: --/PW res: [0x2b73c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586821:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51451 lrc: 3/0,1 mode: PW/PW res: [0x2b73f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586824:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51451 lrc: 3/0,1 mode: PW/PW res: [0x2b73f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586827:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51451 lrc: 3/0,1 mode: PW/PW res: [0x2b73f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586829:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51451 lrc: 2/0,0 mode: PW/PW res: [0x2b73f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.586865:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f3433a83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1031:39029:x1731745946452544:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1220us (1302us total) trans 12885079591 rc 0/0 00000100:00100000:0.0:1651529344.586868:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211535 00010000:00010000:0.0:1651529344.586888:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51451 lrc: 2/0,0 mode: PW/PW res: [0x2b73f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586891:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eaaf5dcd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.586892:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51451 lrc: 2/0,0 mode: PW/PW res: [0x2b73f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586895:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51451 lrc: 3/0,0 mode: PW/PW res: [0x2b73f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586900:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51451 lrc: 1/0,0 mode: --/PW res: [0x2b73f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.586902:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51451 lrc: 0/0,0 mode: --/PW res: [0x2b73f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.587048:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.587056:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946453184 00000100:00100000:0.0:1651529344.587070:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211537 00000100:00100000:0.0:1651529344.587072:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1031:39029:x1731745946453184:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.587077:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177985 count 1 00010000:00010000:0.0:1651529344.587081:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c5145f lrc: 3/0,1 mode: --/PW res: [0x2b741:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.587086:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c4d28e lrc: 2/0,0 mode: PR/PR res: [0x2b741:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc03 expref: 1028 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.587089:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.587090:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.587091:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c5145f lrc: 4/0,1 mode: --/PW res: [0x2b741:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.587097:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c4d28e lrc: 3/0,0 mode: PR/PR res: [0x2b741:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc03 expref: 1028 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.587101:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c4d28e lrc: 4/0,0 mode: PR/PR res: [0x2b741:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc03 expref: 1028 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.587105:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006e255cae pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997005120:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.587137:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000000d706dff going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.587162:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.587171:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946453440 00000100:00100000:0.0:1651529344.587172:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.587181:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.587193:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946453376 00000100:00100000:1.0:1651529344.587201:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211538 00000100:00100000:1.0:1651529344.587202:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1033:39029:x1731745946453440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.587202:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946453504 00002000:00080000:1.0:1651529344.587208:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177987 count 1 00000100:00100000:0.0:1651529344.587212:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211539 00000100:00100000:0.0:1651529344.587214:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1034:39030:x1731745946453376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.587217:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9354cc1/0x3234de053c51466 lrc: 3/0,1 mode: --/PW res: [0x2b743:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.587219:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177986 count 1 00010000:00010000:1.0:1651529344.587231:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a6f87d2f/0x3234de053c4f19e lrc: 2/0,0 mode: PR/PR res: [0x2b743:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7962 expref: 1028 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.587235:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.587235:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.587236:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9354cc1/0x3234de053c51466 lrc: 4/0,1 mode: --/PW res: [0x2b743:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.587248:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a6f87d2f/0x3234de053c4f19e lrc: 3/0,0 mode: PR/PR res: [0x2b743:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7962 expref: 1028 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.587252:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a6f87d2f/0x3234de053c4f19e lrc: 4/0,0 mode: PR/PR res: [0x2b743:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7962 expref: 1028 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.587261:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bddc5ca7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997005184:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.587261:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c5146d lrc: 3/0,1 mode: --/PW res: [0x2b742:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.587269:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000099ad1c93/0x3234de053c4c8a8 lrc: 2/0,0 mode: PR/PR res: [0x2b742:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd456 expref: 1028 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.587272:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.587275:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 000000007e004c12 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.587282:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211540 00000100:00100000:1.0:1651529344.587283:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1034:39030:x1731745946453504:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.587288:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177988 count 1 00010000:00010000:0.0:1651529344.587291:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.587291:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c5146d lrc: 4/0,1 mode: --/PW res: [0x2b742:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.587292:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c3d6b55/0x3234de053c51474 lrc: 3/0,1 mode: --/PW res: [0x2b744:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.587296:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000128333f8/0x3234de053c4ef0c lrc: 2/0,0 mode: PR/PR res: [0x2b744:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e72 expref: 1028 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.587299:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.587300:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.587300:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c3d6b55/0x3234de053c51474 lrc: 4/0,1 mode: --/PW res: [0x2b744:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.587300:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000099ad1c93/0x3234de053c4c8a8 lrc: 3/0,0 mode: PR/PR res: [0x2b742:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd456 expref: 1028 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.587303:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000099ad1c93/0x3234de053c4c8a8 lrc: 4/0,0 mode: PR/PR res: [0x2b742:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd456 expref: 1028 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.587307:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000128333f8/0x3234de053c4ef0c lrc: 3/0,0 mode: PR/PR res: [0x2b744:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e72 expref: 1028 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.587307:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006929eb96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997005248:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.587310:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000128333f8/0x3234de053c4ef0c lrc: 4/0,0 mode: PR/PR res: [0x2b744:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e72 expref: 1028 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.587314:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000fb8e412 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997005312:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.587316:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e68b7e1f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.587321:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e5f43e7 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.587371:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.587386:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.587389:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.587401:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006e255cae pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997005120:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.587406:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c5145f lrc: 3/0,1 mode: --/PW res: [0x2b741:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.587422:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.587432:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946453632 00000100:00100000:1.0:1651529344.587433:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.587442:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946453760 00000100:00100000:0.0:1651529344.587446:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946453824 00000100:00100000:0.0:1651529344.587452:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946453696 00000100:00100000:0.0:1651529344.587457:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211541 00000100:00100000:0.0:1651529344.587464:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1038:39030:x1731745946453632:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.587465:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211542 00000100:00100000:1.0:1651529344.587466:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1038:39030:x1731745946453824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.587469:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177989 count 1 00002000:00080000:1.0:1651529344.587471:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177992 count 1 00010000:00010000:0.0:1651529344.587473:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c5147b lrc: 3/0,1 mode: --/PW res: [0x2b745:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.587476:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000254546df/0x3234de053c51482 lrc: 3/0,1 mode: --/PW res: [0x2b748:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.587477:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007eb6ad4b/0x3234de053c4e1d7 lrc: 2/0,0 mode: PR/PR res: [0x2b745:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3894 expref: 1028 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.587480:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.587481:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c4f43e lrc: 2/0,0 mode: PR/PR res: [0x2b748:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83b8 expref: 1028 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.587481:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.587482:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c5147b lrc: 4/0,1 mode: --/PW res: [0x2b745:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.587484:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.587484:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.587485:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000254546df/0x3234de053c51482 lrc: 4/0,1 mode: --/PW res: [0x2b748:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.587488:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007eb6ad4b/0x3234de053c4e1d7 lrc: 3/0,0 mode: PR/PR res: [0x2b745:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3894 expref: 1028 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.587491:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c4f43e lrc: 3/0,0 mode: PR/PR res: [0x2b748:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83b8 expref: 1028 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.587492:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007eb6ad4b/0x3234de053c4e1d7 lrc: 4/0,0 mode: PR/PR res: [0x2b745:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3894 expref: 1028 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.587495:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c4f43e lrc: 4/0,0 mode: PR/PR res: [0x2b748:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83b8 expref: 1028 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.587496:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006e255cae pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997005376:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.587499:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ffb5d0a pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997005440:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.587506:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 0000000076b354b3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.587507:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 0000000089d75f07 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.587512:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211543 00000100:00100000:1.0:1651529344.587513:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396334336 00000100:00100000:0.0:1651529344.587514:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1038:39029:x1731745946453696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.587517:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c4d28e lrc: 4/0,0 mode: PR/PR res: [0x2b741:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc03 expref: 1029 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:0.0:1651529344.587518:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177990 count 1 00010000:00010000:0.0:1651529344.587521:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51489 lrc: 3/0,1 mode: --/PW res: [0x2b746:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.587525:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12319 00000100:00100000:1.0:1651529344.587527:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1029:41279:x1731746396334336:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.587528:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005cc6645c/0x3234de053c4dc90 lrc: 2/0,0 mode: PR/PR res: [0x2b746:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2298 expref: 1029 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.587529:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.587531:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c4d28e lrc: 4/0,0 mode: PR/PR res: [0x2b741:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc03 expref: 1029 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.587531:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.587531:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.587532:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51489 lrc: 4/0,1 mode: --/PW res: [0x2b746:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.587537:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c4d28e lrc: 3/0,0 mode: PR/PR res: [0x2b741:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc03 expref: 1029 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.587538:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005cc6645c/0x3234de053c4dc90 lrc: 3/0,0 mode: PR/PR res: [0x2b746:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2298 expref: 1029 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.587541:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005cc6645c/0x3234de053c4dc90 lrc: 4/0,0 mode: PR/PR res: [0x2b746:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2298 expref: 1029 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.587542:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c4d28e lrc: 0/0,0 mode: --/PR res: [0x2b741:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc03 expref: 1029 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.587546:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.587547:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.587547:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c5145f lrc: 3/0,1 mode: PW/PW res: [0x2b741:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.587550:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c5145f lrc: 4/0,1 mode: PW/PW res: [0x2b741:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.587560:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.587572:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009acffcb8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997005504:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.587573:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1028:41279:x1731746396334336:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 46us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.587576:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12319 00000100:00100000:1.0:1651529344.587583:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211544 00000100:00100000:1.0:1651529344.587585:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1038:39030:x1731745946453760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.587589:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177991 count 1 00000100:00100000:0.0:1651529344.587589:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000504ef660 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.587593:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009548b62/0x3234de053c51490 lrc: 3/0,1 mode: --/PW res: [0x2b747:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.587597:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006fb68572/0x3234de053c4cfa8 lrc: 2/0,0 mode: PR/PR res: [0x2b747:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf02c expref: 1027 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.587603:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.587603:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.587604:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009548b62/0x3234de053c51490 lrc: 4/0,1 mode: --/PW res: [0x2b747:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.587605:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c5145f lrc: 3/0,1 mode: PW/PW res: [0x2b741:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.587609:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c5145f lrc: 3/0,1 mode: PW/PW res: [0x2b741:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.587610:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006fb68572/0x3234de053c4cfa8 lrc: 3/0,0 mode: PR/PR res: [0x2b747:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf02c expref: 1027 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.587612:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c5145f lrc: 3/0,1 mode: PW/PW res: [0x2b741:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.587613:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006fb68572/0x3234de053c4cfa8 lrc: 4/0,0 mode: PR/PR res: [0x2b747:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf02c expref: 1027 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.587615:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c5145f lrc: 2/0,0 mode: PW/PW res: [0x2b741:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.587617:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cee35a0c pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997005568:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.587625:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d09f5ee1 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.587662:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1039:39029:x1731745946453184:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 589us (614us total) trans 12885079592 rc 0/0 00000100:00100000:0.0:1651529344.587665:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211537 00010000:00010000:0.0:1651529344.587672:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c5145f lrc: 2/0,0 mode: PW/PW res: [0x2b741:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.587676:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5c1b0ba already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.587677:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c5145f lrc: 2/0,0 mode: PW/PW res: [0x2b741:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.587680:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c5145f lrc: 3/0,0 mode: PW/PW res: [0x2b741:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.587684:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c5145f lrc: 1/0,0 mode: --/PW res: [0x2b741:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.587687:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c5145f lrc: 0/0,0 mode: --/PW res: [0x2b741:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.587697:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006929eb96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997005248:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.587700:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c5146d lrc: 3/0,1 mode: --/PW res: [0x2b742:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.587749:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bddc5ca7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997005184:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.587754:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d9354cc1/0x3234de053c51466 lrc: 3/0,1 mode: --/PW res: [0x2b743:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.587762:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000fb8e412 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997005312:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.587765:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002c3d6b55/0x3234de053c51474 lrc: 3/0,1 mode: --/PW res: [0x2b744:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.587846:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.587872:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946454144 00000100:00100000:0.0:1651529344.587882:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211545 00000100:00100000:0.0:1651529344.587883:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1039:39030:x1731745946454144:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.587889:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177993 count 1 00000100:00100000:1.0:1651529344.587892:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.587893:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3eb2ea8/0x3234de053c51497 lrc: 3/0,1 mode: --/PW res: [0x2b749:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.587899:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.587905:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.587918:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c4bd8dfc/0x3234de053c4c65c lrc: 2/0,0 mode: PR/PR res: [0x2b749:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb57 expref: 1027 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.587922:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.587923:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.587923:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3eb2ea8/0x3234de053c51497 lrc: 4/0,1 mode: --/PW res: [0x2b749:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.587936:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c4bd8dfc/0x3234de053c4c65c lrc: 3/0,0 mode: PR/PR res: [0x2b749:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb57 expref: 1027 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.587938:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396334720 00010000:00010000:0.0:1651529344.587940:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c4bd8dfc/0x3234de053c4c65c lrc: 4/0,0 mode: PR/PR res: [0x2b749:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb57 expref: 1028 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.587943:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000099ad1c93/0x3234de053c4c8a8 lrc: 4/0,0 mode: PR/PR res: [0x2b742:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd456 expref: 1028 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.587944:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c43262d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997005632:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.587954:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396334528 00010000:00010000:1.0:1651529344.587956:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a6f87d2f/0x3234de053c4f19e lrc: 4/0,0 mode: PR/PR res: [0x2b743:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7962 expref: 1029 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.587960:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ff7bf023 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.587961:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396334656 00010000:00010000:1.0:1651529344.587963:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000128333f8/0x3234de053c4ef0c lrc: 4/0,0 mode: PR/PR res: [0x2b744:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e72 expref: 1030 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.587967:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12320 00000100:00100000:0.0:1651529344.587968:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006e255cae pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997005376:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.587969:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1030:41279:x1731746396334720:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.587971:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.587972:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c5147b lrc: 3/0,1 mode: --/PW res: [0x2b745:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.587973:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000099ad1c93/0x3234de053c4c8a8 lrc: 4/0,0 mode: PR/PR res: [0x2b742:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd456 expref: 1030 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.587976:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000099ad1c93/0x3234de053c4c8a8 lrc: 3/0,0 mode: PR/PR res: [0x2b742:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd456 expref: 1030 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.587982:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099ad1c93/0x3234de053c4c8a8 lrc: 0/0,0 mode: --/PR res: [0x2b742:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd456 expref: 1030 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.587985:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.587986:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.587987:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c5146d lrc: 3/0,1 mode: PW/PW res: [0x2b742:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.587992:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c5146d lrc: 4/0,1 mode: PW/PW res: [0x2b742:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.588001:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12321 00000100:00100000:0.0:1651529344.588003:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1029:41279:x1731746396334528:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.588008:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.588012:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.588014:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a6f87d2f/0x3234de053c4f19e lrc: 4/0,0 mode: PR/PR res: [0x2b743:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7962 expref: 1029 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.588017:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1029:41279:x1731746396334720:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 48us (126us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.588018:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a6f87d2f/0x3234de053c4f19e lrc: 3/0,0 mode: PR/PR res: [0x2b743:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7962 expref: 1029 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.588020:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12320 00010000:00010000:0.0:1651529344.588024:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6f87d2f/0x3234de053c4f19e lrc: 0/0,0 mode: --/PR res: [0x2b743:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7962 expref: 1028 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.588025:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12322 00000100:00100000:1.0:1651529344.588027:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1027:41279:x1731746396334656:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.588028:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.588028:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.588029:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.588029:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d9354cc1/0x3234de053c51466 lrc: 3/0,1 mode: PW/PW res: [0x2b743:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.588031:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000128333f8/0x3234de053c4ef0c lrc: 4/0,0 mode: PR/PR res: [0x2b744:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e72 expref: 1027 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.588032:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9354cc1/0x3234de053c51466 lrc: 4/0,1 mode: PW/PW res: [0x2b743:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.588035:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000128333f8/0x3234de053c4ef0c lrc: 3/0,0 mode: PR/PR res: [0x2b744:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e72 expref: 1027 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.588042:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.588045:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000128333f8/0x3234de053c4ef0c lrc: 0/0,0 mode: --/PR res: [0x2b744:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e72 expref: 1027 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.588049:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.588049:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1026:41279:x1731746396334528:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 45us (150us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.588050:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.588051:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002c3d6b55/0x3234de053c51474 lrc: 3/0,1 mode: PW/PW res: [0x2b744:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.588052:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12321 00010000:00010000:1.0:1651529344.588054:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c3d6b55/0x3234de053c51474 lrc: 4/0,1 mode: PW/PW res: [0x2b744:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588059:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c5146d lrc: 3/0,1 mode: PW/PW res: [0x2b742:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.588062:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.588062:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c5146d lrc: 3/0,1 mode: PW/PW res: [0x2b742:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.588067:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1025:41279:x1731746396334656:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (162us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.588068:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c5146d lrc: 3/0,1 mode: PW/PW res: [0x2b742:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.588070:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12322 00010000:00010000:0.0:1651529344.588071:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c5146d lrc: 2/0,0 mode: PW/PW res: [0x2b742:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.588077:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d9354cc1/0x3234de053c51466 lrc: 3/0,1 mode: PW/PW res: [0x2b743:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.588081:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9354cc1/0x3234de053c51466 lrc: 3/0,1 mode: PW/PW res: [0x2b743:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.588084:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9354cc1/0x3234de053c51466 lrc: 3/0,1 mode: PW/PW res: [0x2b743:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.588086:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9354cc1/0x3234de053c51466 lrc: 2/0,0 mode: PW/PW res: [0x2b743:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.588120:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1041:39030:x1731745946453376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 904us (948us total) trans 12885079593 rc 0/0 00000100:00100000:1.0:1651529344.588130:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1041:39029:x1731745946453440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 927us (968us total) trans 12885079594 rc 0/0 00000100:00100000:1.0:1651529344.588133:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211538 00010000:00010000:1.0:1651529344.588140:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002c3d6b55/0x3234de053c51474 lrc: 3/0,1 mode: PW/PW res: [0x2b744:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.588143:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c3d6b55/0x3234de053c51474 lrc: 3/0,1 mode: PW/PW res: [0x2b744:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.588146:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c3d6b55/0x3234de053c51474 lrc: 3/0,1 mode: PW/PW res: [0x2b744:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.588146:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211539 00010000:00010000:1.0:1651529344.588149:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c3d6b55/0x3234de053c51474 lrc: 2/0,0 mode: PW/PW res: [0x2b744:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588163:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c5146d lrc: 2/0,0 mode: PW/PW res: [0x2b742:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588175:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000495c20c9 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.588176:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c5146d lrc: 2/0,0 mode: PW/PW res: [0x2b742:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588179:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c5146d lrc: 3/0,0 mode: PW/PW res: [0x2b742:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588185:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c5146d lrc: 1/0,0 mode: --/PW res: [0x2b742:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.588186:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1040:39030:x1731745946453504:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 901us (1005us total) trans 12885079595 rc 0/0 00000100:00100000:1.0:1651529344.588188:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211540 00010000:00010000:0.0:1651529344.588188:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c5146d lrc: 0/0,0 mode: --/PW res: [0x2b742:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588192:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9354cc1/0x3234de053c51466 lrc: 2/0,0 mode: PW/PW res: [0x2b743:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588195:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d9354cc1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.588196:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9354cc1/0x3234de053c51466 lrc: 2/0,0 mode: PW/PW res: [0x2b743:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588198:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9354cc1/0x3234de053c51466 lrc: 3/0,0 mode: PW/PW res: [0x2b743:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588202:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9354cc1/0x3234de053c51466 lrc: 1/0,0 mode: --/PW res: [0x2b743:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588204:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9354cc1/0x3234de053c51466 lrc: 0/0,0 mode: --/PW res: [0x2b743:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588208:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c3d6b55/0x3234de053c51474 lrc: 2/0,0 mode: PW/PW res: [0x2b744:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588210:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002c3d6b55 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.588211:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c3d6b55/0x3234de053c51474 lrc: 2/0,0 mode: PW/PW res: [0x2b744:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588213:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c3d6b55/0x3234de053c51474 lrc: 3/0,0 mode: PW/PW res: [0x2b744:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588217:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c3d6b55/0x3234de053c51474 lrc: 1/0,0 mode: --/PW res: [0x2b744:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588219:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c3d6b55/0x3234de053c51474 lrc: 0/0,0 mode: --/PW res: [0x2b744:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.588263:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ffb5d0a pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997005440:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.588267:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000254546df/0x3234de053c51482 lrc: 3/0,1 mode: --/PW res: [0x2b748:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.588295:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cee35a0c pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997005568:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.588309:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009acffcb8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997005504:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.588311:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000009548b62/0x3234de053c51490 lrc: 3/0,1 mode: --/PW res: [0x2b747:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588313:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51489 lrc: 3/0,1 mode: --/PW res: [0x2b746:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.588325:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.588332:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.588338:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.588344:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.588359:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396334848 00000100:00100000:1.0:1651529344.588362:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.588367:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396334976 00010000:00010000:1.0:1651529344.588372:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c4f43e lrc: 4/0,0 mode: PR/PR res: [0x2b748:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83b8 expref: 1026 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.588377:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007eb6ad4b/0x3234de053c4e1d7 lrc: 4/0,0 mode: PR/PR res: [0x2b745:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3894 expref: 1026 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.588378:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396335040 00010000:00010000:1.0:1651529344.588380:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005cc6645c/0x3234de053c4dc90 lrc: 4/0,0 mode: PR/PR res: [0x2b746:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2298 expref: 1027 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.588384:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396335104 00000100:00100000:1.0:1651529344.588385:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396335168 00010000:00010000:1.0:1651529344.588387:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c4bd8dfc/0x3234de053c4c65c lrc: 5/0,0 mode: PR/PR res: [0x2b749:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb57 expref: 1029 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.588388:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006fb68572/0x3234de053c4cfa8 lrc: 4/0,0 mode: PR/PR res: [0x2b747:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf02c expref: 1029 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.588392:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12323 00000100:00100000:1.0:1651529344.588393:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1029:41279:x1731746396334976:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.588395:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12324 00010000:00010000:1.0:1651529344.588396:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.588396:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7bfdb64 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1029:41279:x1731746396334848:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.588397:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c4f43e lrc: 4/0,0 mode: PR/PR res: [0x2b748:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83b8 expref: 1029 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.588399:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.588401:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c4f43e lrc: 3/0,0 mode: PR/PR res: [0x2b748:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83b8 expref: 1029 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.588401:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007eb6ad4b/0x3234de053c4e1d7 lrc: 4/0,0 mode: PR/PR res: [0x2b745:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3894 expref: 1029 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.588404:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007eb6ad4b/0x3234de053c4e1d7 lrc: 3/0,0 mode: PR/PR res: [0x2b745:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3894 expref: 1029 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.588407:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c4f43e lrc: 0/0,0 mode: --/PR res: [0x2b748:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83b8 expref: 1029 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.588410:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.588410:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007eb6ad4b/0x3234de053c4e1d7 lrc: 0/0,0 mode: --/PR res: [0x2b745:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3894 expref: 1028 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.588411:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.588411:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000254546df/0x3234de053c51482 lrc: 3/0,1 mode: PW/PW res: [0x2b748:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588414:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.588414:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.588415:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000254546df/0x3234de053c51482 lrc: 4/0,1 mode: PW/PW res: [0x2b748:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588415:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c5147b lrc: 3/0,1 mode: PW/PW res: [0x2b745:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588418:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c5147b lrc: 4/0,1 mode: PW/PW res: [0x2b745:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.588421:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.588425:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.588432:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1027:41279:x1731746396334976:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.588435:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12323 00000100:00100000:0.0:1651529344.588439:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7bfdb64 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1026:41279:x1731746396334848:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.588440:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12325 00000100:00100000:1.0:1651529344.588442:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1026:41278:x1731746396335040:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.588442:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12324 00010000:00010000:1.0:1651529344.588444:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.588446:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005cc6645c/0x3234de053c4dc90 lrc: 4/0,0 mode: PR/PR res: [0x2b746:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2298 expref: 1025 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.588450:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005cc6645c/0x3234de053c4dc90 lrc: 3/0,0 mode: PR/PR res: [0x2b746:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2298 expref: 1025 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.588452:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12326 00000100:00100000:0.0:1651529344.588453:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1025:41278:x1731746396335168:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.588454:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cc6645c/0x3234de053c4dc90 lrc: 0/0,0 mode: --/PR res: [0x2b746:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2298 expref: 1025 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.588456:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.588458:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.588458:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.588458:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c4bd8dfc/0x3234de053c4c65c lrc: 5/0,0 mode: PR/PR res: [0x2b749:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb57 expref: 1024 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.588459:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51489 lrc: 3/0,1 mode: PW/PW res: [0x2b746:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588461:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c4bd8dfc/0x3234de053c4c65c lrc: 4/0,0 mode: PR/PR res: [0x2b749:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb57 expref: 1024 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.588462:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51489 lrc: 4/0,1 mode: PW/PW res: [0x2b746:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588466:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.588467:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.588467:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e3eb2ea8/0x3234de053c51497 lrc: 3/0,1 mode: PW/PW res: [0x2b749:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.588469:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.588475:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1024:41278:x1731746396335040:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.588477:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12325 00010000:00010000:0.0:1651529344.588477:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3eb2ea8/0x3234de053c51497 lrc: 4/0,1 mode: PW/PW res: [0x2b749:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.588481:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12327 00010000:00010000:0.0:1651529344.588481:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.588483:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1023:41279:x1731746396335104:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.588485:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.588486:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006fb68572/0x3234de053c4cfa8 lrc: 4/0,0 mode: PR/PR res: [0x2b747:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf02c expref: 1023 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.588487:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1023:41278:x1731746396335168:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (125us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.588490:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006fb68572/0x3234de053c4cfa8 lrc: 3/0,0 mode: PR/PR res: [0x2b747:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf02c expref: 1023 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.588490:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12326 00010000:00010000:1.0:1651529344.588495:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006fb68572/0x3234de053c4cfa8 lrc: 0/0,0 mode: --/PR res: [0x2b747:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf02c expref: 1022 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.588497:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51489 lrc: 3/0,1 mode: PW/PW res: [0x2b746:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.588498:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.588498:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.588499:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009548b62/0x3234de053c51490 lrc: 3/0,1 mode: PW/PW res: [0x2b747:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588500:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51489 lrc: 3/0,1 mode: PW/PW res: [0x2b746:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.588502:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009548b62/0x3234de053c51490 lrc: 4/0,1 mode: PW/PW res: [0x2b747:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588503:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51489 lrc: 3/0,1 mode: PW/PW res: [0x2b746:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588505:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51489 lrc: 2/0,0 mode: PW/PW res: [0x2b746:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.588508:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.588513:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1021:41279:x1731746396335104:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 29us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.588515:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12327 00010000:00010000:1.0:1651529344.588521:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000254546df/0x3234de053c51482 lrc: 3/0,1 mode: PW/PW res: [0x2b748:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.588524:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000254546df/0x3234de053c51482 lrc: 3/0,1 mode: PW/PW res: [0x2b748:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.588530:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000254546df/0x3234de053c51482 lrc: 3/0,1 mode: PW/PW res: [0x2b748:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.588533:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000254546df/0x3234de053c51482 lrc: 2/0,0 mode: PW/PW res: [0x2b748:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.588568:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1041:39029:x1731745946453696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1041us (1122us total) trans 12885079596 rc 0/0 00000100:00100000:0.0:1651529344.588571:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211543 00010000:00010000:0.0:1651529344.588578:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51489 lrc: 2/0,0 mode: PW/PW res: [0x2b746:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.588581:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1040:39030:x1731745946453824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1114us (1158us total) trans 12885079597 rc 0/0 00010000:00010000:0.0:1651529344.588582:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000073043e99 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.588583:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51489 lrc: 2/0,0 mode: PW/PW res: [0x2b746:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.588584:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211542 00010000:00010000:0.0:1651529344.588585:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51489 lrc: 3/0,0 mode: PW/PW res: [0x2b746:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.588591:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000009548b62/0x3234de053c51490 lrc: 3/0,1 mode: PW/PW res: [0x2b747:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588593:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51489 lrc: 1/0,0 mode: --/PW res: [0x2b746:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.588594:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009548b62/0x3234de053c51490 lrc: 3/0,1 mode: PW/PW res: [0x2b747:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588595:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51489 lrc: 0/0,0 mode: --/PW res: [0x2b746:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.588597:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009548b62/0x3234de053c51490 lrc: 3/0,1 mode: PW/PW res: [0x2b747:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.588600:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009548b62/0x3234de053c51490 lrc: 2/0,0 mode: PW/PW res: [0x2b747:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588600:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000254546df/0x3234de053c51482 lrc: 2/0,0 mode: PW/PW res: [0x2b748:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588602:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000254546df already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.588603:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000254546df/0x3234de053c51482 lrc: 2/0,0 mode: PW/PW res: [0x2b748:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588606:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000254546df/0x3234de053c51482 lrc: 3/0,0 mode: PW/PW res: [0x2b748:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588615:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000254546df/0x3234de053c51482 lrc: 1/0,0 mode: --/PW res: [0x2b748:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588618:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000254546df/0x3234de053c51482 lrc: 0/0,0 mode: --/PW res: [0x2b748:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588622:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009548b62/0x3234de053c51490 lrc: 2/0,0 mode: PW/PW res: [0x2b747:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588625:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000009548b62 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.588626:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009548b62/0x3234de053c51490 lrc: 2/0,0 mode: PW/PW res: [0x2b747:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588629:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009548b62/0x3234de053c51490 lrc: 3/0,0 mode: PW/PW res: [0x2b747:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588632:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009548b62/0x3234de053c51490 lrc: 1/0,0 mode: --/PW res: [0x2b747:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588634:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009548b62/0x3234de053c51490 lrc: 0/0,0 mode: --/PW res: [0x2b747:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.588637:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1040:39030:x1731745946453760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1051us (1248us total) trans 12885079598 rc 0/0 00000100:00100000:1.0:1651529344.588640:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211544 00010000:00010000:0.0:1651529344.588640:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c5147b lrc: 3/0,1 mode: PW/PW res: [0x2b745:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588643:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c5147b lrc: 3/0,1 mode: PW/PW res: [0x2b745:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588646:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c5147b lrc: 3/0,1 mode: PW/PW res: [0x2b745:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588648:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c5147b lrc: 2/0,0 mode: PW/PW res: [0x2b745:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.588674:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.588685:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1040:39030:x1731745946453632:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1220us (1314us total) trans 12885079599 rc 0/0 00000100:00100000:1.0:1651529344.588688:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.588688:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211541 00000100:00100000:0.0:1651529344.588693:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946454592 00000100:00100000:0.0:1651529344.588698:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946454528 00000100:00100000:1.0:1651529344.588699:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.588703:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946454656 00000100:00100000:0.0:1651529344.588712:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211546 00000100:00100000:0.0:1651529344.588713:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1042:39029:x1731745946454592:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.588719:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177995 count 1 00010000:00010000:0.0:1651529344.588723:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c5149e lrc: 3/0,1 mode: --/PW res: [0x2b74b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588727:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000035236d9a/0x3234de053c4e787 lrc: 2/0,0 mode: PR/PR res: [0x2b74b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4eba expref: 1020 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.588730:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.588731:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.588732:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c5149e lrc: 4/0,1 mode: --/PW res: [0x2b74b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588746:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000035236d9a/0x3234de053c4e787 lrc: 3/0,0 mode: PR/PR res: [0x2b74b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4eba expref: 1020 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.588750:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000035236d9a/0x3234de053c4e787 lrc: 4/0,0 mode: PR/PR res: [0x2b74b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4eba expref: 1020 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.588754:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009acffcb8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997005696:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.588763:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c0dff858 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.588768:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c5147b lrc: 2/0,0 mode: PW/PW res: [0x2b745:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588771:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000acc438d7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.588772:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c5147b lrc: 2/0,0 mode: PW/PW res: [0x2b745:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588776:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c5147b lrc: 3/0,0 mode: PW/PW res: [0x2b745:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588780:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c5147b lrc: 1/0,0 mode: --/PW res: [0x2b745:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588783:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c5147b lrc: 0/0,0 mode: --/PW res: [0x2b745:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.588798:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211547 00000100:00100000:1.0:1651529344.588800:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1042:39030:x1731745946454528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.588806:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177994 count 1 00000100:00100000:0.0:1651529344.588807:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211548 00000100:00100000:0.0:1651529344.588809:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1042:39030:x1731745946454656:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.588811:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c514a5 lrc: 3/0,1 mode: --/PW res: [0x2b74a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.588814:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177996 count 1 00010000:00010000:1.0:1651529344.588816:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f80e4dc2/0x3234de053c4d81b lrc: 2/0,0 mode: PR/PR res: [0x2b74a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1188 expref: 1020 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.588819:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.588820:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.588820:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c514a5 lrc: 4/0,1 mode: --/PW res: [0x2b74a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.588827:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f80e4dc2/0x3234de053c4d81b lrc: 3/0,0 mode: PR/PR res: [0x2b74a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1188 expref: 1020 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.588829:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000954b1161/0x3234de053c514ac lrc: 3/0,1 mode: --/PW res: [0x2b74c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.588831:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f80e4dc2/0x3234de053c4d81b lrc: 4/0,0 mode: PR/PR res: [0x2b74a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1188 expref: 1020 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.588834:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f8d2c80d/0x3234de053c4e358 lrc: 2/0,0 mode: PR/PR res: [0x2b74c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e67 expref: 1020 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.588835:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000673bcbe2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997005760:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.588837:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.588838:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.588839:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000954b1161/0x3234de053c514ac lrc: 4/0,1 mode: --/PW res: [0x2b74c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.588846:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 0000000053a0cffa going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.588846:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f8d2c80d/0x3234de053c4e358 lrc: 3/0,0 mode: PR/PR res: [0x2b74c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e67 expref: 1020 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.588850:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f8d2c80d/0x3234de053c4e358 lrc: 4/0,0 mode: PR/PR res: [0x2b74c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e67 expref: 1020 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.588854:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000086eaa330 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997005824:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.588862:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000008dd99533 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.588871:0:80276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4bd8dfc/0x3234de053c4c65c lrc: 0/0,0 mode: --/PR res: [0x2b749:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb57 expref: 1020 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.588875:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c43262d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997005632:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.588879:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e3eb2ea8/0x3234de053c51497 lrc: 3/0,1 mode: PW/PW res: [0x2b749:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588882:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e3eb2ea8/0x3234de053c51497 lrc: 3/0,1 mode: PW/PW res: [0x2b749:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588885:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3eb2ea8/0x3234de053c51497 lrc: 3/0,1 mode: PW/PW res: [0x2b749:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588888:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3eb2ea8/0x3234de053c51497 lrc: 3/0,1 mode: PW/PW res: [0x2b749:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.588890:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3eb2ea8/0x3234de053c51497 lrc: 2/0,0 mode: PW/PW res: [0x2b749:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.588951:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.588973:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1043:39030:x1731745946454144:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1088us (1127us total) trans 12885079600 rc 0/0 00000100:00100000:1.0:1651529344.588986:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.588988:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211545 00000100:00100000:0.0:1651529344.588994:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946454720 00000100:00100000:0.0:1651529344.589002:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946454784 00000100:00100000:0.0:1651529344.589008:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211549 00000100:00100000:0.0:1651529344.589010:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1044:39029:x1731745946454720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.589015:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177997 count 1 00010000:00010000:0.0:1651529344.589019:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c514b3 lrc: 3/0,1 mode: --/PW res: [0x2b74d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589034:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000915b7205/0x3234de053c4ea2e lrc: 2/0,0 mode: PR/PR res: [0x2b74d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a21 expref: 1019 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.589038:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.589038:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.589039:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c514b3 lrc: 4/0,1 mode: --/PW res: [0x2b74d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.589042:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.589046:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000915b7205/0x3234de053c4ea2e lrc: 3/0,0 mode: PR/PR res: [0x2b74d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a21 expref: 1019 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.589049:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000915b7205/0x3234de053c4ea2e lrc: 4/0,0 mode: PR/PR res: [0x2b74d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a21 expref: 1019 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.589058:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.589060:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c43262d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997005888:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.589065:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946454848 00000100:00100000:0.0:1651529344.589077:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e7e12492 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.589078:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946454912 00000100:00100000:1.0:1651529344.589085:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211550 00000100:00100000:1.0:1651529344.589087:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1046:39030:x1731745946454784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.589090:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211551 00002000:00080000:1.0:1651529344.589092:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177998 count 1 00000100:00100000:0.0:1651529344.589092:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1046:39029:x1731745946454848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.589096:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c514ba lrc: 3/0,1 mode: --/PW res: [0x2b74e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.589097:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:177999 count 1 00010000:00010000:0.0:1651529344.589100:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c514c1 lrc: 3/0,1 mode: --/PW res: [0x2b74f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589101:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003ed121ae/0x3234de053c4efa6 lrc: 2/0,0 mode: PR/PR res: [0x2b74e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d70e8 expref: 1019 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.589104:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.589105:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.589105:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c514ba lrc: 4/0,1 mode: --/PW res: [0x2b74e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589112:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003ed121ae/0x3234de053c4efa6 lrc: 3/0,0 mode: PR/PR res: [0x2b74e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d70e8 expref: 1019 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.589115:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003ed121ae/0x3234de053c4efa6 lrc: 4/0,0 mode: PR/PR res: [0x2b74e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d70e8 expref: 1019 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.589119:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f39ca9ea pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997005952:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.589119:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ebff1324/0x3234de053c4d6c4 lrc: 2/0,0 mode: PR/PR res: [0x2b74f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0cbf expref: 1019 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.589122:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.589123:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.589123:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c514c1 lrc: 4/0,1 mode: --/PW res: [0x2b74f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.589128:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b7af823 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.589130:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ebff1324/0x3234de053c4d6c4 lrc: 3/0,0 mode: PR/PR res: [0x2b74f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0cbf expref: 1019 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.589134:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211552 00010000:00010000:0.0:1651529344.589134:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ebff1324/0x3234de053c4d6c4 lrc: 4/0,0 mode: PR/PR res: [0x2b74f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0cbf expref: 1019 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.589136:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1046:39030:x1731745946454912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.589138:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d6486d55 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997006016:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.589140:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178000 count 1 00010000:00010000:1.0:1651529344.589143:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c514c8 lrc: 3/0,1 mode: --/PW res: [0x2b750:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.589146:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000029ae2bb2 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.589147:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dde59581/0x3234de053c4e407 lrc: 2/0,0 mode: PR/PR res: [0x2b750:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4107 expref: 1019 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.589150:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.589151:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.589151:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c514c8 lrc: 4/0,1 mode: --/PW res: [0x2b750:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589152:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3eb2ea8/0x3234de053c51497 lrc: 2/0,0 mode: PW/PW res: [0x2b749:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589156:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e3eb2ea8 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.589157:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dde59581/0x3234de053c4e407 lrc: 3/0,0 mode: PR/PR res: [0x2b750:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4107 expref: 1019 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.589157:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3eb2ea8/0x3234de053c51497 lrc: 2/0,0 mode: PW/PW res: [0x2b749:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589159:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3eb2ea8/0x3234de053c51497 lrc: 3/0,0 mode: PW/PW res: [0x2b749:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589161:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dde59581/0x3234de053c4e407 lrc: 4/0,0 mode: PR/PR res: [0x2b750:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4107 expref: 1019 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.589164:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3eb2ea8/0x3234de053c51497 lrc: 1/0,0 mode: --/PW res: [0x2b749:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.589165:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005d3fb3ef pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997006080:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.589167:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3eb2ea8/0x3234de053c51497 lrc: 0/0,0 mode: --/PW res: [0x2b749:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.589171:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e5f43e7 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.589176:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009acffcb8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997005696:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.589179:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000673bcbe2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997005760:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.589180:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c5149e lrc: 3/0,1 mode: --/PW res: [0x2b74b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589182:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c514a5 lrc: 3/0,1 mode: --/PW res: [0x2b74a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.589197:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.589214:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000086eaa330 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997005824:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.589217:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000954b1161/0x3234de053c514ac lrc: 3/0,1 mode: --/PW res: [0x2b74c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.589238:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.589255:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946455040 00000100:00100000:0.0:1651529344.589256:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.589267:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.589268:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211553 00000100:00100000:1.0:1651529344.589275:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1047:39030:x1731745946455040:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.589281:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178001 count 1 00010000:00010000:1.0:1651529344.589285:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c514cf lrc: 3/0,1 mode: --/PW res: [0x2b751:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589289:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c6cb1a73/0x3234de053c4a63b lrc: 2/0,0 mode: PR/PR res: [0x2b751:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb82 expref: 1019 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.589292:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.589293:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.589294:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c514cf lrc: 4/0,1 mode: --/PW res: [0x2b751:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589300:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c6cb1a73/0x3234de053c4a63b lrc: 3/0,0 mode: PR/PR res: [0x2b751:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb82 expref: 1019 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.589303:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c6cb1a73/0x3234de053c4a63b lrc: 4/0,0 mode: PR/PR res: [0x2b751:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb82 expref: 1019 pid: 151609 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.589307:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002f363f4a pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997006144:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.589315:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 0000000057299e7f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.589321:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396335488 00010000:00010000:1.0:1651529344.589325:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f80e4dc2/0x3234de053c4d81b lrc: 4/0,0 mode: PR/PR res: [0x2b74a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1188 expref: 1020 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.589336:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396335424 00010000:00010000:1.0:1651529344.589339:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000035236d9a/0x3234de053c4e787 lrc: 4/0,0 mode: PR/PR res: [0x2b74b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4eba expref: 1021 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.589340:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396335552 00010000:00010000:0.0:1651529344.589345:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f8d2c80d/0x3234de053c4e358 lrc: 4/0,0 mode: PR/PR res: [0x2b74c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e67 expref: 1022 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.589347:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12328 00000100:00100000:1.0:1651529344.589349:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1022:41279:x1731746396335488:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.589351:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.589352:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12329 00010000:00010000:1.0:1651529344.589353:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f80e4dc2/0x3234de053c4d81b lrc: 4/0,0 mode: PR/PR res: [0x2b74a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1188 expref: 1022 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.589354:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1022:41279:x1731746396335424:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.589356:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f80e4dc2/0x3234de053c4d81b lrc: 3/0,0 mode: PR/PR res: [0x2b74a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1188 expref: 1022 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.589357:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.589358:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000035236d9a/0x3234de053c4e787 lrc: 4/0,0 mode: PR/PR res: [0x2b74b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4eba expref: 1022 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.589361:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f80e4dc2/0x3234de053c4d81b lrc: 0/0,0 mode: --/PR res: [0x2b74a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1188 expref: 1022 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.589362:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000035236d9a/0x3234de053c4e787 lrc: 3/0,0 mode: PR/PR res: [0x2b74b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4eba expref: 1022 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.589365:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.589365:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.589366:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c514a5 lrc: 3/0,1 mode: PW/PW res: [0x2b74a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589368:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035236d9a/0x3234de053c4e787 lrc: 0/0,0 mode: --/PR res: [0x2b74b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4eba expref: 1021 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.589369:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c514a5 lrc: 4/0,1 mode: PW/PW res: [0x2b74a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589372:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.589372:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.589373:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c5149e lrc: 3/0,1 mode: PW/PW res: [0x2b74b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589376:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.589376:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c5149e lrc: 4/0,1 mode: PW/PW res: [0x2b74b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.589382:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1020:41279:x1731746396335488:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 33us (145us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.589383:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.589384:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12328 00000100:00100000:1.0:1651529344.589389:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12330 00000100:00100000:1.0:1651529344.589390:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031e6b9e0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1019:41279:x1731746396335552:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.589390:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1019:41279:x1731746396335424:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 36us (135us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.589393:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.589393:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12329 00010000:00010000:1.0:1651529344.589394:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f8d2c80d/0x3234de053c4e358 lrc: 4/0,0 mode: PR/PR res: [0x2b74c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e67 expref: 1019 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.589398:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f8d2c80d/0x3234de053c4e358 lrc: 3/0,0 mode: PR/PR res: [0x2b74c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e67 expref: 1018 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.589399:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c5149e lrc: 3/0,1 mode: PW/PW res: [0x2b74b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589402:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8d2c80d/0x3234de053c4e358 lrc: 0/0,0 mode: --/PR res: [0x2b74c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e67 expref: 1018 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.589403:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c5149e lrc: 3/0,1 mode: PW/PW res: [0x2b74b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589406:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.589406:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.589406:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c5149e lrc: 3/0,1 mode: PW/PW res: [0x2b74b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589407:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000954b1161/0x3234de053c514ac lrc: 3/0,1 mode: PW/PW res: [0x2b74c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589408:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c5149e lrc: 2/0,0 mode: PW/PW res: [0x2b74b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589410:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000954b1161/0x3234de053c514ac lrc: 4/0,1 mode: PW/PW res: [0x2b74c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589418:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.589423:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031e6b9e0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1017:41279:x1731746396335552:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 32us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.589426:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12330 00010000:00010000:1.0:1651529344.589438:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c514a5 lrc: 3/0,1 mode: PW/PW res: [0x2b74a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589441:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c514a5 lrc: 3/0,1 mode: PW/PW res: [0x2b74a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589447:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c514a5 lrc: 3/0,1 mode: PW/PW res: [0x2b74a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589450:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c514a5 lrc: 2/0,0 mode: PW/PW res: [0x2b74a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.589466:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1048:39029:x1731745946454592:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 751us (792us total) trans 12885079601 rc 0/0 00000100:00100000:0.0:1651529344.589469:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211546 00010000:00010000:0.0:1651529344.589476:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c5149e lrc: 2/0,0 mode: PW/PW res: [0x2b74b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589479:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ea00c64e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.589481:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c5149e lrc: 2/0,0 mode: PW/PW res: [0x2b74b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589483:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c5149e lrc: 3/0,0 mode: PW/PW res: [0x2b74b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589488:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c5149e lrc: 1/0,0 mode: --/PW res: [0x2b74b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589491:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea00c64e/0x3234de053c5149e lrc: 0/0,0 mode: --/PW res: [0x2b74b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.589492:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1048:39030:x1731745946454528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 690us (804us total) trans 12885079602 rc 0/0 00000100:00100000:1.0:1651529344.589494:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211547 00010000:00010000:0.0:1651529344.589495:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c514a5 lrc: 2/0,0 mode: PW/PW res: [0x2b74a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589498:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004678bff1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.589498:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c514a5 lrc: 2/0,0 mode: PW/PW res: [0x2b74a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589504:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c514a5 lrc: 3/0,0 mode: PW/PW res: [0x2b74a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589507:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c514a5 lrc: 1/0,0 mode: --/PW res: [0x2b74a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589509:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c514a5 lrc: 0/0,0 mode: --/PW res: [0x2b74a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589514:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000954b1161/0x3234de053c514ac lrc: 3/0,1 mode: PW/PW res: [0x2b74c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589517:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000954b1161/0x3234de053c514ac lrc: 3/0,1 mode: PW/PW res: [0x2b74c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589520:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000954b1161/0x3234de053c514ac lrc: 3/0,1 mode: PW/PW res: [0x2b74c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589522:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000954b1161/0x3234de053c514ac lrc: 2/0,0 mode: PW/PW res: [0x2b74c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.589557:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1048:39030:x1731745946454656:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 748us (858us total) trans 12885079603 rc 0/0 00000100:00100000:0.0:1651529344.589560:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211548 00010000:00010000:0.0:1651529344.589567:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000954b1161/0x3234de053c514ac lrc: 2/0,0 mode: PW/PW res: [0x2b74c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589572:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000954b1161 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.589573:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000954b1161/0x3234de053c514ac lrc: 2/0,0 mode: PW/PW res: [0x2b74c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589576:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000954b1161/0x3234de053c514ac lrc: 3/0,0 mode: PW/PW res: [0x2b74c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589580:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000954b1161/0x3234de053c514ac lrc: 1/0,0 mode: --/PW res: [0x2b74c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589583:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000954b1161/0x3234de053c514ac lrc: 0/0,0 mode: --/PW res: [0x2b74c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.589667:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c43262d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997005888:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.589690:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c514b3 lrc: 3/0,1 mode: --/PW res: [0x2b74d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.589701:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.589716:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946455296 00000100:00100000:0.0:1651529344.589733:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211554 00000100:00100000:0.0:1651529344.589763:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1048:39030:x1731745946455296:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.589769:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178002 count 1 00000100:00100000:1.0:1651529344.589770:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f39ca9ea pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997005952:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.589773:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c514d6 lrc: 3/0,1 mode: --/PW res: [0x2b752:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589775:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c514ba lrc: 3/0,1 mode: --/PW res: [0x2b74e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589778:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c0866663/0x3234de053c4e304 lrc: 2/0,0 mode: PR/PR res: [0x2b752:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d09 expref: 1016 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.589784:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005d3fb3ef pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997006080:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.589784:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.589785:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.589785:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c514d6 lrc: 4/0,1 mode: --/PW res: [0x2b752:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589787:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c514c8 lrc: 3/0,1 mode: --/PW res: [0x2b750:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.589792:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002f363f4a pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997006144:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.589792:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c0866663/0x3234de053c4e304 lrc: 3/0,0 mode: PR/PR res: [0x2b752:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d09 expref: 1016 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.589795:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c514cf lrc: 3/0,1 mode: --/PW res: [0x2b751:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589796:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c0866663/0x3234de053c4e304 lrc: 4/0,0 mode: PR/PR res: [0x2b752:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d09 expref: 1016 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.589800:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c43262d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997006208:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.589814:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000504ef660 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.589822:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d6486d55 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997006016:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.589824:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.589826:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c514c1 lrc: 3/0,1 mode: --/PW res: [0x2b74f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.589840:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.589848:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946455360 00000100:00100000:1.0:1651529344.589857:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946455424 00000100:00100000:1.0:1651529344.589865:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211555 00000100:00100000:1.0:1651529344.589867:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1050:39030:x1731745946455424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.589873:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178004 count 1 00010000:00010000:1.0:1651529344.589877:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c514dd lrc: 3/0,1 mode: --/PW res: [0x2b754:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.589883:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211556 00000100:00100000:0.0:1651529344.589885:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1050:39029:x1731745946455360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.589887:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003f0e1642/0x3234de053c4e81a lrc: 2/0,0 mode: PR/PR res: [0x2b754:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d513e expref: 1016 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.589890:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178003 count 1 00010000:00010000:1.0:1651529344.589891:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.589891:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.589892:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c514dd lrc: 4/0,1 mode: --/PW res: [0x2b754:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.589894:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c514e4 lrc: 3/0,1 mode: --/PW res: [0x2b753:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.589899:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003f0e1642/0x3234de053c4e81a lrc: 3/0,0 mode: PR/PR res: [0x2b754:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d513e expref: 1016 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.589901:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e90f6a58/0x3234de053c4f41b lrc: 2/0,0 mode: PR/PR res: [0x2b753:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d832c expref: 1016 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.589902:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003f0e1642/0x3234de053c4e81a lrc: 4/0,0 mode: PR/PR res: [0x2b754:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d513e expref: 1016 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.589904:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.589905:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.589905:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c514e4 lrc: 4/0,1 mode: --/PW res: [0x2b753:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.589906:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005d3fb3ef pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997006272:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.589912:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e90f6a58/0x3234de053c4f41b lrc: 3/0,0 mode: PR/PR res: [0x2b753:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d832c expref: 1016 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.589915:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e90f6a58/0x3234de053c4f41b lrc: 4/0,0 mode: PR/PR res: [0x2b753:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d832c expref: 1016 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.589917:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e5f43e7 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.589919:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009acffcb8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997006336:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.589928:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 000000000d706dff going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.589988:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.589996:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.590002:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.590012:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.590022:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.590023:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396336000 00000100:00100000:1.0:1651529344.590034:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.590034:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003ed121ae/0x3234de053c4efa6 lrc: 4/0,0 mode: PR/PR res: [0x2b74e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d70e8 expref: 1017 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.590040:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396336128 00000100:00100000:0.0:1651529344.590040:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396335936 00010000:00010000:0.0:1651529344.590043:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000915b7205/0x3234de053c4ea2e lrc: 4/0,0 mode: PR/PR res: [0x2b74d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a21 expref: 1019 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.590045:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dde59581/0x3234de053c4e407 lrc: 4/0,0 mode: PR/PR res: [0x2b750:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4107 expref: 1019 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.590047:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396336064 00010000:00010000:0.0:1651529344.590049:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ebff1324/0x3234de053c4d6c4 lrc: 4/0,0 mode: PR/PR res: [0x2b74f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0cbf expref: 1020 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.590051:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396336192 00010000:00010000:1.0:1651529344.590054:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c6cb1a73/0x3234de053c4a63b lrc: 4/0,0 mode: PR/PR res: [0x2b751:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb82 expref: 1021 pid: 151609 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.590056:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396336256 00000100:00100000:1.0:1651529344.590059:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12331 00010000:00010000:0.0:1651529344.590059:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c0866663/0x3234de053c4e304 lrc: 5/0,0 mode: PR/PR res: [0x2b752:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d09 expref: 1022 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.590061:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1022:41279:x1731746396336000:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.590063:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.590064:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12332 00010000:00010000:1.0:1651529344.590065:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003ed121ae/0x3234de053c4efa6 lrc: 4/0,0 mode: PR/PR res: [0x2b74e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d70e8 expref: 1022 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.590065:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1022:41278:x1731746396335936:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.590068:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003ed121ae/0x3234de053c4efa6 lrc: 3/0,0 mode: PR/PR res: [0x2b74e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d70e8 expref: 1022 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.590068:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.590069:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000915b7205/0x3234de053c4ea2e lrc: 4/0,0 mode: PR/PR res: [0x2b74d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a21 expref: 1022 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.590073:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000915b7205/0x3234de053c4ea2e lrc: 3/0,0 mode: PR/PR res: [0x2b74d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a21 expref: 1022 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.590074:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ed121ae/0x3234de053c4efa6 lrc: 0/0,0 mode: --/PR res: [0x2b74e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d70e8 expref: 1022 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.590078:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.590078:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.590079:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c514ba lrc: 3/0,1 mode: PW/PW res: [0x2b74e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590079:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000915b7205/0x3234de053c4ea2e lrc: 0/0,0 mode: --/PR res: [0x2b74d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a21 expref: 1021 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.590082:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c514ba lrc: 4/0,1 mode: PW/PW res: [0x2b74e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590082:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.590083:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.590084:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c514b3 lrc: 3/0,1 mode: PW/PW res: [0x2b74d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590087:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c514b3 lrc: 4/0,1 mode: PW/PW res: [0x2b74d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.590091:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.590093:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.590102:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1020:41279:x1731746396336000:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 41us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.590105:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12331 00000100:00100000:0.0:1651529344.590107:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1020:41278:x1731746396335936:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.590110:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12333 00000100:00100000:1.0:1651529344.590111:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1019:41279:x1731746396336128:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.590112:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12332 00010000:00010000:1.0:1651529344.590114:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.590116:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dde59581/0x3234de053c4e407 lrc: 4/0,0 mode: PR/PR res: [0x2b750:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4107 expref: 1018 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.590117:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12334 00000100:00100000:0.0:1651529344.590118:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1018:41278:x1731746396336064:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.590119:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dde59581/0x3234de053c4e407 lrc: 3/0,0 mode: PR/PR res: [0x2b750:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4107 expref: 1018 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.590121:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.590122:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ebff1324/0x3234de053c4d6c4 lrc: 4/0,0 mode: PR/PR res: [0x2b74f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0cbf expref: 1018 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.590124:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dde59581/0x3234de053c4e407 lrc: 0/0,0 mode: --/PR res: [0x2b750:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4107 expref: 1018 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.590126:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ebff1324/0x3234de053c4d6c4 lrc: 3/0,0 mode: PR/PR res: [0x2b74f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0cbf expref: 1018 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.590128:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.590128:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.590129:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c514c8 lrc: 3/0,1 mode: PW/PW res: [0x2b750:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590131:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ebff1324/0x3234de053c4d6c4 lrc: 0/0,0 mode: --/PR res: [0x2b74f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0cbf expref: 1017 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.590132:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c514c8 lrc: 4/0,1 mode: PW/PW res: [0x2b750:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590135:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.590135:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.590136:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c514c1 lrc: 3/0,1 mode: PW/PW res: [0x2b74f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.590138:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.590139:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c514c1 lrc: 4/0,1 mode: PW/PW res: [0x2b74f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.590143:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1016:41279:x1731746396336128:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 31us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.590145:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12333 00010000:00010000:0.0:1651529344.590145:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.590150:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12335 00000100:00100000:0.0:1651529344.590150:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1015:41278:x1731746396336064:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 31us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.590151:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1015:41278:x1731746396336192:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.590153:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.590153:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12334 00010000:00010000:1.0:1651529344.590155:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c6cb1a73/0x3234de053c4a63b lrc: 4/0,0 mode: PR/PR res: [0x2b751:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb82 expref: 1015 pid: 151609 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.590157:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12336 00010000:00010000:1.0:1651529344.590158:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c6cb1a73/0x3234de053c4a63b lrc: 3/0,0 mode: PR/PR res: [0x2b751:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb82 expref: 1014 pid: 151609 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.590159:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1014:41279:x1731746396336256:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.590161:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.590162:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c0866663/0x3234de053c4e304 lrc: 5/0,0 mode: PR/PR res: [0x2b752:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d09 expref: 1014 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.590163:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6cb1a73/0x3234de053c4a63b lrc: 0/0,0 mode: --/PR res: [0x2b751:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb82 expref: 1014 pid: 151609 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.590166:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.590167:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.590167:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c514cf lrc: 3/0,1 mode: PW/PW res: [0x2b751:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.590170:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c514cf lrc: 4/0,1 mode: PW/PW res: [0x2b751:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.590175:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.590180:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1013:41278:x1731746396336192:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 28us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.590182:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12335 00010000:00010000:0.0:1651529344.590195:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c0866663/0x3234de053c4e304 lrc: 4/0,0 mode: PR/PR res: [0x2b752:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d09 expref: 1012 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.590201:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.590201:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.590202:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c514d6 lrc: 3/0,1 mode: PW/PW res: [0x2b752:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.590203:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c514ba lrc: 3/0,1 mode: PW/PW res: [0x2b74e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590205:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c514d6 lrc: 4/0,1 mode: PW/PW res: [0x2b752:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.590207:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c514ba lrc: 3/0,1 mode: PW/PW res: [0x2b74e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.590210:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c514ba lrc: 3/0,1 mode: PW/PW res: [0x2b74e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590210:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.590212:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c514ba lrc: 2/0,0 mode: PW/PW res: [0x2b74e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.590217:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1012:41279:x1731746396336256:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 58us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.590242:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12336 00010000:00010000:0.0:1651529344.590249:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c514c1 lrc: 3/0,1 mode: PW/PW res: [0x2b74f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590253:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c514c1 lrc: 3/0,1 mode: PW/PW res: [0x2b74f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590256:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c514c1 lrc: 3/0,1 mode: PW/PW res: [0x2b74f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590261:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c514c1 lrc: 2/0,0 mode: PW/PW res: [0x2b74f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.590270:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1051:39030:x1731745946454784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1182us (1288us total) trans 12885079604 rc 0/0 00000100:00100000:1.0:1651529344.590273:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211550 00010000:00010000:1.0:1651529344.590280:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c514c8 lrc: 3/0,1 mode: PW/PW res: [0x2b750:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.590284:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c514c8 lrc: 3/0,1 mode: PW/PW res: [0x2b750:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.590287:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c514c8 lrc: 3/0,1 mode: PW/PW res: [0x2b750:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.590290:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c514c8 lrc: 2/0,0 mode: PW/PW res: [0x2b750:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.590308:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1051:39029:x1731745946454848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1215us (1266us total) trans 12885079605 rc 0/0 00000100:00100000:0.0:1651529344.590311:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211551 00010000:00010000:0.0:1651529344.590318:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c514ba lrc: 2/0,0 mode: PW/PW res: [0x2b74e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590322:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d84ad17b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.590323:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c514ba lrc: 2/0,0 mode: PW/PW res: [0x2b74e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590326:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c514ba lrc: 3/0,0 mode: PW/PW res: [0x2b74e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.590329:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1051:39030:x1731745946454912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1192us (1271us total) trans 12885079606 rc 0/0 00010000:00010000:0.0:1651529344.590330:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c514ba lrc: 1/0,0 mode: --/PW res: [0x2b74e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590333:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c514ba lrc: 0/0,0 mode: --/PW res: [0x2b74e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.590334:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211552 00010000:00010000:0.0:1651529344.590337:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c514c1 lrc: 2/0,0 mode: PW/PW res: [0x2b74f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590340:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b855716b already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.590341:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c514cf lrc: 3/0,1 mode: PW/PW res: [0x2b751:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590341:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c514c1 lrc: 2/0,0 mode: PW/PW res: [0x2b74f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.590344:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c514cf lrc: 3/0,1 mode: PW/PW res: [0x2b751:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590344:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c514c1 lrc: 3/0,0 mode: PW/PW res: [0x2b74f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.590347:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c514cf lrc: 3/0,1 mode: PW/PW res: [0x2b751:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590347:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c514c1 lrc: 1/0,0 mode: --/PW res: [0x2b74f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.590350:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c514cf lrc: 2/0,0 mode: PW/PW res: [0x2b751:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590350:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b855716b/0x3234de053c514c1 lrc: 0/0,0 mode: --/PW res: [0x2b74f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590353:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c514c8 lrc: 2/0,0 mode: PW/PW res: [0x2b750:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590356:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2a86deb already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.590357:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c514c8 lrc: 2/0,0 mode: PW/PW res: [0x2b750:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590359:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c514c8 lrc: 3/0,0 mode: PW/PW res: [0x2b750:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590362:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c514c8 lrc: 1/0,0 mode: --/PW res: [0x2b750:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590365:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c514c8 lrc: 0/0,0 mode: --/PW res: [0x2b750:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590369:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c514cf lrc: 2/0,0 mode: PW/PW res: [0x2b751:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590372:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba070658 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.590373:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c514cf lrc: 2/0,0 mode: PW/PW res: [0x2b751:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590375:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c514cf lrc: 3/0,0 mode: PW/PW res: [0x2b751:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.590378:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1051:39030:x1731745946455040:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1103us (1181us total) trans 12885079607 rc 0/0 00010000:00010000:0.0:1651529344.590378:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c514cf lrc: 1/0,0 mode: --/PW res: [0x2b751:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.590381:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211553 00010000:00010000:0.0:1651529344.590381:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c514cf lrc: 0/0,0 mode: --/PW res: [0x2b751:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590391:0:72395:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0866663/0x3234de053c4e304 lrc: 0/0,0 mode: --/PR res: [0x2b752:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d09 expref: 1011 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.590394:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c43262d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997006208:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.590398:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c514d6 lrc: 3/0,1 mode: PW/PW res: [0x2b752:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590401:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c514d6 lrc: 3/0,1 mode: PW/PW res: [0x2b752:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590403:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c514d6 lrc: 3/0,1 mode: PW/PW res: [0x2b752:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590416:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c514d6 lrc: 3/0,1 mode: PW/PW res: [0x2b752:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590419:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c514d6 lrc: 2/0,0 mode: PW/PW res: [0x2b752:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.590420:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.590431:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.590476:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1051:39030:x1731745946455296:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 713us (776us total) trans 12885079608 rc 0/0 00000100:00100000:0.0:1651529344.590479:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211554 00010000:00010000:0.0:1651529344.590487:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c514d6 lrc: 2/0,0 mode: PW/PW res: [0x2b752:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590490:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005d8a4887 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.590491:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c514d6 lrc: 2/0,0 mode: PW/PW res: [0x2b752:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590494:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c514d6 lrc: 3/0,0 mode: PW/PW res: [0x2b752:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590498:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c514d6 lrc: 1/0,0 mode: --/PW res: [0x2b752:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590501:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d8a4887/0x3234de053c514d6 lrc: 0/0,0 mode: --/PW res: [0x2b752:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.590526:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009acffcb8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997006336:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.590530:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c514e4 lrc: 3/0,1 mode: --/PW res: [0x2b753:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.590531:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005d3fb3ef pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997006272:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.590536:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c514dd lrc: 3/0,1 mode: --/PW res: [0x2b754:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590537:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c514b3 lrc: 3/0,1 mode: PW/PW res: [0x2b74d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590540:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c514b3 lrc: 3/0,1 mode: PW/PW res: [0x2b74d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.590543:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396336320 00010000:00010000:0.0:1651529344.590543:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c514b3 lrc: 3/0,1 mode: PW/PW res: [0x2b74d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590545:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c514b3 lrc: 2/0,0 mode: PW/PW res: [0x2b74d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.590548:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003f0e1642/0x3234de053c4e81a lrc: 4/0,0 mode: PR/PR res: [0x2b754:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d513e expref: 1011 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.590557:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396336384 00010000:00010000:1.0:1651529344.590559:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e90f6a58/0x3234de053c4f41b lrc: 4/0,0 mode: PR/PR res: [0x2b753:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d832c expref: 1012 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.590565:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12337 00000100:00100000:1.0:1651529344.590567:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d17e32b2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1012:41278:x1731746396336320:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.590569:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.590571:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003f0e1642/0x3234de053c4e81a lrc: 4/0,0 mode: PR/PR res: [0x2b754:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d513e expref: 1012 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.590574:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003f0e1642/0x3234de053c4e81a lrc: 3/0,0 mode: PR/PR res: [0x2b754:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d513e expref: 1012 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.590580:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f0e1642/0x3234de053c4e81a lrc: 0/0,0 mode: --/PR res: [0x2b754:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d513e expref: 1012 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.590583:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.590584:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.590585:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c514dd lrc: 3/0,1 mode: PW/PW res: [0x2b754:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.590588:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c514dd lrc: 4/0,1 mode: PW/PW res: [0x2b754:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.590593:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.590601:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1051:39029:x1731745946454720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1590us (1650us total) trans 12885079609 rc 0/0 00000100:00100000:0.0:1651529344.590605:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211549 00000100:00100000:1.0:1651529344.590608:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d17e32b2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1011:41278:x1731746396336320:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.590610:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12337 00010000:00010000:0.0:1651529344.590612:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c514b3 lrc: 2/0,0 mode: PW/PW res: [0x2b74d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590615:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027456046 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.590616:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c514b3 lrc: 2/0,0 mode: PW/PW res: [0x2b74d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.590619:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12338 00010000:00010000:0.0:1651529344.590619:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c514b3 lrc: 3/0,0 mode: PW/PW res: [0x2b74d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.590621:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1010:41279:x1731746396336384:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.590623:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.590625:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e90f6a58/0x3234de053c4f41b lrc: 4/0,0 mode: PR/PR res: [0x2b753:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d832c expref: 1010 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.590629:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e90f6a58/0x3234de053c4f41b lrc: 3/0,0 mode: PR/PR res: [0x2b753:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d832c expref: 1010 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.590633:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e90f6a58/0x3234de053c4f41b lrc: 0/0,0 mode: --/PR res: [0x2b753:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d832c expref: 1010 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.590637:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.590637:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.590638:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c514e4 lrc: 3/0,1 mode: PW/PW res: [0x2b753:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590639:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c514b3 lrc: 1/0,0 mode: --/PW res: [0x2b74d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.590641:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c514e4 lrc: 4/0,1 mode: PW/PW res: [0x2b753:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590642:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027456046/0x3234de053c514b3 lrc: 0/0,0 mode: --/PW res: [0x2b74d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.590651:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.590656:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1009:41279:x1731746396336384:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.590659:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12338 00010000:00010000:0.0:1651529344.590663:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c514e4 lrc: 3/0,1 mode: PW/PW res: [0x2b753:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.590666:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c514dd lrc: 3/0,1 mode: PW/PW res: [0x2b754:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590666:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c514e4 lrc: 3/0,1 mode: PW/PW res: [0x2b753:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.590669:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c514dd lrc: 3/0,1 mode: PW/PW res: [0x2b754:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590669:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c514e4 lrc: 3/0,1 mode: PW/PW res: [0x2b753:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.590672:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c514dd lrc: 3/0,1 mode: PW/PW res: [0x2b754:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590672:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c514e4 lrc: 2/0,0 mode: PW/PW res: [0x2b753:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.590675:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c514dd lrc: 2/0,0 mode: PW/PW res: [0x2b754:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.590714:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1052:39029:x1731745946455360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 828us (889us total) trans 12885079610 rc 0/0 00000100:00100000:1.0:1651529344.590716:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1052:39030:x1731745946455424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 848us (876us total) trans 12885079611 rc 0/0 00000100:00100000:0.0:1651529344.590717:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211556 00000100:00100000:1.0:1651529344.590719:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211555 00010000:00010000:0.0:1651529344.590724:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c514e4 lrc: 2/0,0 mode: PW/PW res: [0x2b753:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590727:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cdc65e28 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.590728:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c514e4 lrc: 2/0,0 mode: PW/PW res: [0x2b753:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590731:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c514e4 lrc: 3/0,0 mode: PW/PW res: [0x2b753:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590745:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c514e4 lrc: 1/0,0 mode: --/PW res: [0x2b753:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590748:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cdc65e28/0x3234de053c514e4 lrc: 0/0,0 mode: --/PW res: [0x2b753:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590753:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c514dd lrc: 2/0,0 mode: PW/PW res: [0x2b754:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590755:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c0de17df already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.590756:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c514dd lrc: 2/0,0 mode: PW/PW res: [0x2b754:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590759:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c514dd lrc: 3/0,0 mode: PW/PW res: [0x2b754:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.590760:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.590762:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c514dd lrc: 1/0,0 mode: --/PW res: [0x2b754:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590765:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c514dd lrc: 0/0,0 mode: --/PW res: [0x2b754:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.590773:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.590794:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946455872 00000100:00100000:1.0:1651529344.590803:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946455808 00000100:00100000:1.0:1651529344.590817:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211557 00000100:00100000:1.0:1651529344.590819:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1052:39029:x1731745946455872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.590824:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178006 count 1 00000100:00100000:0.0:1651529344.590829:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211558 00000100:00100000:0.0:1651529344.590831:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1052:39030:x1731745946455808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.590835:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e33677d/0x3234de053c514eb lrc: 3/0,1 mode: --/PW res: [0x2b756:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.590837:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178005 count 1 00010000:00010000:1.0:1651529344.590840:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004a74ee8f/0x3234de053c4dcf2 lrc: 2/0,0 mode: PR/PR res: [0x2b756:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2482 expref: 1008 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.590841:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c514f2 lrc: 3/0,1 mode: --/PW res: [0x2b755:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.590843:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.590844:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.590844:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e33677d/0x3234de053c514eb lrc: 4/0,1 mode: --/PW res: [0x2b756:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590846:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004cbaf771/0x3234de053c4d494 lrc: 2/0,0 mode: PR/PR res: [0x2b755:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0422 expref: 1008 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.590849:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.590850:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.590851:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004a74ee8f/0x3234de053c4dcf2 lrc: 3/0,0 mode: PR/PR res: [0x2b756:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2482 expref: 1008 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.590851:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c514f2 lrc: 4/0,1 mode: --/PW res: [0x2b755:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.590855:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004a74ee8f/0x3234de053c4dcf2 lrc: 4/0,0 mode: PR/PR res: [0x2b756:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2482 expref: 1008 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.590857:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004cbaf771/0x3234de053c4d494 lrc: 3/0,0 mode: PR/PR res: [0x2b755:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0422 expref: 1008 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.590860:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000023afca5e pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997006400:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.590861:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004cbaf771/0x3234de053c4d494 lrc: 4/0,0 mode: PR/PR res: [0x2b755:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0422 expref: 1008 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.590874:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e5f43e7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.590883:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.590885:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009acffcb8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997006464:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.590895:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 0000000029ae2bb2 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.590902:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946456000 00000100:00100000:0.0:1651529344.590915:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211559 00000100:00100000:0.0:1651529344.590916:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1053:39029:x1731745946456000:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.590921:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178008 count 1 00000100:00100000:1.0:1651529344.590922:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.590925:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c514f9 lrc: 3/0,1 mode: --/PW res: [0x2b758:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590936:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003330d891/0x3234de053c4f68a lrc: 2/0,0 mode: PR/PR res: [0x2b758:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ce8 expref: 1008 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.590939:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.590940:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.590941:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c514f9 lrc: 4/0,1 mode: --/PW res: [0x2b758:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.590947:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003330d891/0x3234de053c4f68a lrc: 3/0,0 mode: PR/PR res: [0x2b758:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ce8 expref: 1008 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.590950:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003330d891/0x3234de053c4f68a lrc: 4/0,0 mode: PR/PR res: [0x2b758:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ce8 expref: 1008 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.590954:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.590954:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c43262d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997006528:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.590962:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946455936 00000100:00100000:0.0:1651529344.590967:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000000d706dff going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.590974:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946456064 00000100:00100000:1.0:1651529344.590978:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211560 00000100:00100000:1.0:1651529344.590980:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1055:39030:x1731745946455936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.590985:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178007 count 1 00010000:00010000:1.0:1651529344.590989:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d29e43d/0x3234de053c51500 lrc: 3/0,1 mode: --/PW res: [0x2b757:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.590992:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211561 00010000:00010000:1.0:1651529344.590994:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000016a020f8/0x3234de053c4e72c lrc: 2/0,0 mode: PR/PR res: [0x2b757:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4db0 expref: 1008 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.590994:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1055:39030:x1731745946456064:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.590997:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.590997:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.590998:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d29e43d/0x3234de053c51500 lrc: 4/0,1 mode: --/PW res: [0x2b757:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.590999:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178009 count 1 00010000:00010000:0.0:1651529344.591003:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51507 lrc: 3/0,1 mode: --/PW res: [0x2b759:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591005:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000016a020f8/0x3234de053c4e72c lrc: 3/0,0 mode: PR/PR res: [0x2b757:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4db0 expref: 1008 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.591007:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003ccb55ee/0x3234de053c4d868 lrc: 2/0,0 mode: PR/PR res: [0x2b759:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1292 expref: 1008 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.591009:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000016a020f8/0x3234de053c4e72c lrc: 4/0,0 mode: PR/PR res: [0x2b757:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4db0 expref: 1008 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.591010:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.591013:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000913beefe pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997006592:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.591021:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b7af823 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.591032:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.591033:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51507 lrc: 4/0,1 mode: --/PW res: [0x2b759:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.591044:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003ccb55ee/0x3234de053c4d868 lrc: 3/0,0 mode: PR/PR res: [0x2b759:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1292 expref: 1008 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.591047:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.591048:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003ccb55ee/0x3234de053c4d868 lrc: 4/0,0 mode: PR/PR res: [0x2b759:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1292 expref: 1008 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.591052:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000086eaa330 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997006656:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.591061:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e7e12492 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.591062:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.591067:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946456256 00000100:00100000:1.0:1651529344.591073:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.591081:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946456320 00000100:00100000:0.0:1651529344.591085:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946456384 00000100:00100000:0.0:1651529344.591089:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211562 00000100:00100000:0.0:1651529344.591091:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1058:39029:x1731745946456256:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.591096:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178010 count 1 00010000:00010000:0.0:1651529344.591099:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c5150e lrc: 3/0,1 mode: --/PW res: [0x2b75a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.591103:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000065a19c0e/0x3234de053c4dc66 lrc: 2/0,0 mode: PR/PR res: [0x2b75a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d21d4 expref: 1008 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.591106:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.591107:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.591108:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211563 00010000:00010000:0.0:1651529344.591108:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c5150e lrc: 4/0,1 mode: --/PW res: [0x2b75a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.591110:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1058:39030:x1731745946456320:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.591114:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000065a19c0e/0x3234de053c4dc66 lrc: 3/0,0 mode: PR/PR res: [0x2b75a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d21d4 expref: 1008 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.591115:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178011 count 1 00010000:00010000:0.0:1651529344.591117:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000065a19c0e/0x3234de053c4dc66 lrc: 4/0,0 mode: PR/PR res: [0x2b75a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d21d4 expref: 1008 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.591120:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e60010b/0x3234de053c51515 lrc: 3/0,1 mode: --/PW res: [0x2b75b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.591121:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cee35a0c pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997006720:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.591124:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000902f602d/0x3234de053c4e88a lrc: 2/0,0 mode: PR/PR res: [0x2b75b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5313 expref: 1008 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.591127:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.591128:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.591128:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e60010b/0x3234de053c51515 lrc: 4/0,1 mode: --/PW res: [0x2b75b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.591134:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000afe7ff7b going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.591140:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211564 00000100:00100000:0.0:1651529344.591141:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000021fdd79f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1058:39029:x1731745946456384:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.591144:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000902f602d/0x3234de053c4e88a lrc: 3/0,0 mode: PR/PR res: [0x2b75b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5313 expref: 1008 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.591146:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178012 count 1 00010000:00010000:1.0:1651529344.591148:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000902f602d/0x3234de053c4e88a lrc: 4/0,0 mode: PR/PR res: [0x2b75b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5313 expref: 1008 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.591149:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000293bb831/0x3234de053c5151c lrc: 3/0,1 mode: --/PW res: [0x2b75c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.591152:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d523a75 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997006784:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.591154:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c4cf8c lrc: 2/0,0 mode: PR/PR res: [0x2b75c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cefca expref: 1008 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.591157:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.591157:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.591158:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000293bb831/0x3234de053c5151c lrc: 4/0,1 mode: --/PW res: [0x2b75c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.591160:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cfa1ca05 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.591164:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c4cf8c lrc: 3/0,0 mode: PR/PR res: [0x2b75c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cefca expref: 1008 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.591167:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c4cf8c lrc: 4/0,0 mode: PR/PR res: [0x2b75c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cefca expref: 1008 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.591174:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ffb5d0a pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997006848:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.591204:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c086aae3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.591255:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.591255:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009acffcb8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997006464:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.591264:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.591264:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c514f2 lrc: 3/0,1 mode: --/PW res: [0x2b755:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.591279:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000023afca5e pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997006400:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.591289:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000e33677d/0x3234de053c514eb lrc: 3/0,1 mode: --/PW res: [0x2b756:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.591296:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396336960 00000100:00100000:0.0:1651529344.591302:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c43262d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997006528:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.591306:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c514f9 lrc: 3/0,1 mode: --/PW res: [0x2b758:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591308:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004cbaf771/0x3234de053c4d494 lrc: 4/0,0 mode: PR/PR res: [0x2b755:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0422 expref: 1009 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.591313:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396337024 00000100:00100000:1.0:1651529344.591316:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12339 00000100:00100000:1.0:1651529344.591318:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1010:41279:x1731746396336960:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.591318:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004a74ee8f/0x3234de053c4dcf2 lrc: 4/0,0 mode: PR/PR res: [0x2b756:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2482 expref: 1010 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.591321:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.591322:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004cbaf771/0x3234de053c4d494 lrc: 4/0,0 mode: PR/PR res: [0x2b755:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0422 expref: 1010 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.591328:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12340 00000100:00100000:0.0:1651529344.591330:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1010:41278:x1731746396337024:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.591333:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.591334:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004cbaf771/0x3234de053c4d494 lrc: 3/0,0 mode: PR/PR res: [0x2b755:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0422 expref: 1010 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.591334:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004a74ee8f/0x3234de053c4dcf2 lrc: 4/0,0 mode: PR/PR res: [0x2b756:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2482 expref: 1010 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.591338:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004a74ee8f/0x3234de053c4dcf2 lrc: 3/0,0 mode: PR/PR res: [0x2b756:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2482 expref: 1010 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.591339:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cbaf771/0x3234de053c4d494 lrc: 0/0,0 mode: --/PR res: [0x2b755:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0422 expref: 1010 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.591343:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.591343:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.591344:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c514f2 lrc: 3/0,1 mode: PW/PW res: [0x2b755:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.591344:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a74ee8f/0x3234de053c4dcf2 lrc: 0/0,0 mode: --/PR res: [0x2b756:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2482 expref: 1009 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.591347:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c514f2 lrc: 4/0,1 mode: PW/PW res: [0x2b755:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.591348:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.591349:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.591350:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000e33677d/0x3234de053c514eb lrc: 3/0,1 mode: PW/PW res: [0x2b756:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.591352:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e33677d/0x3234de053c514eb lrc: 4/0,1 mode: PW/PW res: [0x2b756:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591356:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.591366:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1008:41279:x1731746396336960:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 48us (112us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.591373:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.591374:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12339 00000100:00100000:0.0:1651529344.591381:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1007:41278:x1731746396337024:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 50us (116us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.591382:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000e33677d/0x3234de053c514eb lrc: 3/0,1 mode: PW/PW res: [0x2b756:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.591384:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12340 00010000:00010000:1.0:1651529344.591385:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e33677d/0x3234de053c514eb lrc: 3/0,1 mode: PW/PW res: [0x2b756:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591388:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e33677d/0x3234de053c514eb lrc: 3/0,1 mode: PW/PW res: [0x2b756:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591393:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e33677d/0x3234de053c514eb lrc: 2/0,0 mode: PW/PW res: [0x2b756:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.591410:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c514f2 lrc: 3/0,1 mode: PW/PW res: [0x2b755:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.591414:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c514f2 lrc: 3/0,1 mode: PW/PW res: [0x2b755:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.591417:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c514f2 lrc: 3/0,1 mode: PW/PW res: [0x2b755:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.591420:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c514f2 lrc: 2/0,0 mode: PW/PW res: [0x2b755:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.591435:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1059:39029:x1731745946455872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 615us (675us total) trans 12885079612 rc 0/0 00000100:00100000:1.0:1651529344.591438:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211557 00000100:00100000:0.0:1651529344.591478:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1059:39030:x1731745946455808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 646us (704us total) trans 12885079613 rc 0/0 00000100:00100000:0.0:1651529344.591481:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211558 00010000:00010000:0.0:1651529344.591489:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e33677d/0x3234de053c514eb lrc: 2/0,0 mode: PW/PW res: [0x2b756:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.591511:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000e33677d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.591520:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e33677d/0x3234de053c514eb lrc: 2/0,0 mode: PW/PW res: [0x2b756:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.591523:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e33677d/0x3234de053c514eb lrc: 3/0,0 mode: PW/PW res: [0x2b756:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.591528:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e33677d/0x3234de053c514eb lrc: 1/0,0 mode: --/PW res: [0x2b756:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.591531:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e33677d/0x3234de053c514eb lrc: 0/0,0 mode: --/PW res: [0x2b756:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.591535:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c514f2 lrc: 2/0,0 mode: PW/PW res: [0x2b755:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.591538:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000734ecdfd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.591539:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c514f2 lrc: 2/0,0 mode: PW/PW res: [0x2b755:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.591542:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c514f2 lrc: 3/0,0 mode: PW/PW res: [0x2b755:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.591545:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c514f2 lrc: 1/0,0 mode: --/PW res: [0x2b755:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.591550:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000734ecdfd/0x3234de053c514f2 lrc: 0/0,0 mode: --/PW res: [0x2b755:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.591556:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.591566:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.591573:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.591579:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000086eaa330 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997006656:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.591580:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.591583:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51507 lrc: 3/0,1 mode: --/PW res: [0x2b759:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.591586:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.591602:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000913beefe pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997006592:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.591607:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004d29e43d/0x3234de053c51500 lrc: 3/0,1 mode: --/PW res: [0x2b757:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.591614:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cee35a0c pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997006720:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.591618:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c5150e lrc: 3/0,1 mode: --/PW res: [0x2b75a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.591620:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d523a75 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997006784:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.591623:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006e60010b/0x3234de053c51515 lrc: 3/0,1 mode: --/PW res: [0x2b75b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.591626:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ffb5d0a pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997006848:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.591628:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396337088 00010000:00010000:0.0:1651529344.591629:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000293bb831/0x3234de053c5151c lrc: 3/0,1 mode: --/PW res: [0x2b75c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591633:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003330d891/0x3234de053c4f68a lrc: 4/0,0 mode: PR/PR res: [0x2b758:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ce8 expref: 1007 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.591638:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396337216 00010000:00010000:1.0:1651529344.591640:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000065a19c0e/0x3234de053c4dc66 lrc: 4/0,0 mode: PR/PR res: [0x2b75a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d21d4 expref: 1008 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.591643:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.591644:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396337152 00010000:00010000:1.0:1651529344.591646:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000016a020f8/0x3234de053c4e72c lrc: 4/0,0 mode: PR/PR res: [0x2b757:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4db0 expref: 1009 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.591650:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396337344 00000100:00100000:0.0:1651529344.591650:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946456704 00010000:00010000:1.0:1651529344.591652:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000902f602d/0x3234de053c4e88a lrc: 4/0,0 mode: PR/PR res: [0x2b75b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5313 expref: 1010 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.591656:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396337280 00000100:00100000:0.0:1651529344.591660:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211565 00010000:00010000:1.0:1651529344.591664:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003ccb55ee/0x3234de053c4d868 lrc: 4/0,0 mode: PR/PR res: [0x2b759:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1292 expref: 1011 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.591669:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12341 00000100:00100000:1.0:1651529344.591671:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1011:41278:x1731746396337088:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.591673:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.591675:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003330d891/0x3234de053c4f68a lrc: 4/0,0 mode: PR/PR res: [0x2b758:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ce8 expref: 1011 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.591678:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003330d891/0x3234de053c4f68a lrc: 3/0,0 mode: PR/PR res: [0x2b758:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ce8 expref: 1011 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.591684:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003330d891/0x3234de053c4f68a lrc: 0/0,0 mode: --/PR res: [0x2b758:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ce8 expref: 1011 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.591686:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1059:39030:x1731745946456704:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.591691:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178013 count 1 00010000:00010000:1.0:1651529344.591695:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.591696:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.591696:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c51523 lrc: 3/0,1 mode: --/PW res: [0x2b75d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591697:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c514f9 lrc: 3/0,1 mode: PW/PW res: [0x2b758:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591700:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c514f9 lrc: 4/0,1 mode: PW/PW res: [0x2b758:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.591701:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000128ab1d3/0x3234de053c4dda8 lrc: 2/0,0 mode: PR/PR res: [0x2b75d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2802 expref: 1010 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.591704:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.591705:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.591705:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c51523 lrc: 4/0,1 mode: --/PW res: [0x2b75d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591709:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.591716:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1010:41278:x1731746396337088:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 45us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.591719:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12341 00000100:00100000:1.0:1651529344.591723:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12342 00000100:00100000:1.0:1651529344.591725:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1009:41278:x1731746396337216:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.591727:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.591729:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000065a19c0e/0x3234de053c4dc66 lrc: 4/0,0 mode: PR/PR res: [0x2b75a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d21d4 expref: 1009 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.591732:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000065a19c0e/0x3234de053c4dc66 lrc: 3/0,0 mode: PR/PR res: [0x2b75a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d21d4 expref: 1009 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.591732:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000128ab1d3/0x3234de053c4dda8 lrc: 3/0,0 mode: PR/PR res: [0x2b75d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2802 expref: 1009 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.591744:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000128ab1d3/0x3234de053c4dda8 lrc: 4/0,0 mode: PR/PR res: [0x2b75d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2802 expref: 1009 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.591745:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065a19c0e/0x3234de053c4dc66 lrc: 0/0,0 mode: --/PR res: [0x2b75a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d21d4 expref: 1009 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.591748:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cee35a0c pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997006912:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.591749:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.591750:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.591750:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c5150e lrc: 3/0,1 mode: PW/PW res: [0x2b75a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591756:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c5150e lrc: 4/0,1 mode: PW/PW res: [0x2b75a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.591758:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000afe7ff7b going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.591764:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.591770:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1008:41278:x1731746396337216:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 44us (204us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.591770:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c514f9 lrc: 3/0,1 mode: PW/PW res: [0x2b758:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.591772:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12342 00010000:00010000:0.0:1651529344.591773:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c514f9 lrc: 3/0,1 mode: PW/PW res: [0x2b758:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.591776:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12343 00010000:00010000:0.0:1651529344.591777:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c514f9 lrc: 3/0,1 mode: PW/PW res: [0x2b758:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.591778:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1007:41279:x1731746396337152:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.591779:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c514f9 lrc: 2/0,0 mode: PW/PW res: [0x2b758:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591780:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.591782:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000016a020f8/0x3234de053c4e72c lrc: 4/0,0 mode: PR/PR res: [0x2b757:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4db0 expref: 1007 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.591785:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000016a020f8/0x3234de053c4e72c lrc: 3/0,0 mode: PR/PR res: [0x2b757:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4db0 expref: 1007 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.591790:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016a020f8/0x3234de053c4e72c lrc: 0/0,0 mode: --/PR res: [0x2b757:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4db0 expref: 1007 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.591793:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.591794:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.591794:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004d29e43d/0x3234de053c51500 lrc: 3/0,1 mode: PW/PW res: [0x2b757:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591797:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d29e43d/0x3234de053c51500 lrc: 4/0,1 mode: PW/PW res: [0x2b757:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591806:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.591810:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1006:41279:x1731746396337152:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 32us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.591813:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12343 00000100:00100000:1.0:1651529344.591816:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12344 00000100:00100000:0.0:1651529344.591817:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1060:39029:x1731745946456000:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 900us (934us total) trans 12885079614 rc 0/0 00000100:00100000:1.0:1651529344.591818:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071577dd8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1005:41278:x1731746396337344:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.591820:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.591820:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211559 00010000:00010000:1.0:1651529344.591821:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000902f602d/0x3234de053c4e88a lrc: 4/0,0 mode: PR/PR res: [0x2b75b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5313 expref: 1005 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.591825:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000902f602d/0x3234de053c4e88a lrc: 3/0,0 mode: PR/PR res: [0x2b75b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5313 expref: 1005 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.591828:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c514f9 lrc: 2/0,0 mode: PW/PW res: [0x2b758:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591829:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000902f602d/0x3234de053c4e88a lrc: 0/0,0 mode: --/PR res: [0x2b75b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5313 expref: 1005 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.591831:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006c0ed60a already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.591832:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.591832:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c514f9 lrc: 2/0,0 mode: PW/PW res: [0x2b758:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591833:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.591834:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006e60010b/0x3234de053c51515 lrc: 3/0,1 mode: PW/PW res: [0x2b75b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.591835:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c514f9 lrc: 3/0,0 mode: PW/PW res: [0x2b758:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591836:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e60010b/0x3234de053c51515 lrc: 4/0,1 mode: PW/PW res: [0x2b75b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.591839:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c514f9 lrc: 1/0,0 mode: --/PW res: [0x2b758:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591842:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.591842:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c0ed60a/0x3234de053c514f9 lrc: 0/0,0 mode: --/PW res: [0x2b758:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.591846:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071577dd8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1004:41278:x1731746396337344:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 28us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.591848:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12344 00010000:00010000:0.0:1651529344.591848:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c5150e lrc: 3/0,1 mode: PW/PW res: [0x2b75a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.591851:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c5150e lrc: 3/0,1 mode: PW/PW res: [0x2b75a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.591854:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c5150e lrc: 3/0,1 mode: PW/PW res: [0x2b75a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.591855:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12345 00000100:00100000:1.0:1651529344.591857:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1003:41279:x1731746396337280:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.591857:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c5150e lrc: 2/0,0 mode: PW/PW res: [0x2b75a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591859:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.591860:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003ccb55ee/0x3234de053c4d868 lrc: 4/0,0 mode: PR/PR res: [0x2b759:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1292 expref: 1003 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.591864:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003ccb55ee/0x3234de053c4d868 lrc: 3/0,0 mode: PR/PR res: [0x2b759:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1292 expref: 1003 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.591868:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ccb55ee/0x3234de053c4d868 lrc: 0/0,0 mode: --/PR res: [0x2b759:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1292 expref: 1003 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.591871:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.591872:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.591873:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51507 lrc: 3/0,1 mode: PW/PW res: [0x2b759:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591876:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51507 lrc: 4/0,1 mode: PW/PW res: [0x2b759:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591884:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.591889:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1002:41279:x1731746396337280:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 31us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.591891:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12345 00010000:00010000:1.0:1651529344.591898:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006e60010b/0x3234de053c51515 lrc: 3/0,1 mode: PW/PW res: [0x2b75b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591901:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e60010b/0x3234de053c51515 lrc: 3/0,1 mode: PW/PW res: [0x2b75b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.591901:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1060:39029:x1731745946456256:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 809us (854us total) trans 12885079615 rc 0/0 00010000:00010000:1.0:1651529344.591904:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e60010b/0x3234de053c51515 lrc: 3/0,1 mode: PW/PW res: [0x2b75b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.591904:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211562 00010000:00010000:1.0:1651529344.591907:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e60010b/0x3234de053c51515 lrc: 2/0,0 mode: PW/PW res: [0x2b75b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.591911:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51507 lrc: 3/0,1 mode: PW/PW res: [0x2b759:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.591920:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51507 lrc: 3/0,1 mode: PW/PW res: [0x2b759:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.591923:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51507 lrc: 3/0,1 mode: PW/PW res: [0x2b759:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.591926:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51507 lrc: 2/0,0 mode: PW/PW res: [0x2b759:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.591948:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1061:39030:x1731745946456320:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 837us (885us total) trans 12885079616 rc 0/0 00000100:00100000:1.0:1651529344.591951:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211563 00010000:00010000:1.0:1651529344.591958:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004d29e43d/0x3234de053c51500 lrc: 3/0,1 mode: PW/PW res: [0x2b757:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.591960:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1060:39030:x1731745946456064:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 966us (1006us total) trans 12885079617 rc 0/0 00010000:00010000:1.0:1651529344.591961:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d29e43d/0x3234de053c51500 lrc: 3/0,1 mode: PW/PW res: [0x2b757:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.591963:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211561 00010000:00010000:1.0:1651529344.591964:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d29e43d/0x3234de053c51500 lrc: 3/0,1 mode: PW/PW res: [0x2b757:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.591967:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d29e43d/0x3234de053c51500 lrc: 2/0,0 mode: PW/PW res: [0x2b757:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.591971:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c5150e lrc: 2/0,0 mode: PW/PW res: [0x2b75a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.591974:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eb50e2ae already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.591975:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c5150e lrc: 2/0,0 mode: PW/PW res: [0x2b75a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.591978:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c5150e lrc: 3/0,0 mode: PW/PW res: [0x2b75a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.591982:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c5150e lrc: 1/0,0 mode: --/PW res: [0x2b75a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.591985:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb50e2ae/0x3234de053c5150e lrc: 0/0,0 mode: --/PW res: [0x2b75a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.591989:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e60010b/0x3234de053c51515 lrc: 2/0,0 mode: PW/PW res: [0x2b75b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.591992:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006e60010b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.591993:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e60010b/0x3234de053c51515 lrc: 2/0,0 mode: PW/PW res: [0x2b75b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.591996:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e60010b/0x3234de053c51515 lrc: 3/0,0 mode: PW/PW res: [0x2b75b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.591997:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1060:39030:x1731745946455936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1016us (1074us total) trans 12885079618 rc 0/0 00010000:00010000:0.0:1651529344.591999:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e60010b/0x3234de053c51515 lrc: 1/0,0 mode: --/PW res: [0x2b75b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.592001:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211560 00010000:00010000:0.0:1651529344.592002:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e60010b/0x3234de053c51515 lrc: 0/0,0 mode: --/PW res: [0x2b75b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592005:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51507 lrc: 2/0,0 mode: PW/PW res: [0x2b759:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592007:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a0607df4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.592008:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51507 lrc: 2/0,0 mode: PW/PW res: [0x2b759:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592011:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51507 lrc: 3/0,0 mode: PW/PW res: [0x2b759:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592014:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51507 lrc: 1/0,0 mode: --/PW res: [0x2b759:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.592017:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.592017:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0607df4/0x3234de053c51507 lrc: 0/0,0 mode: --/PW res: [0x2b759:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592020:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d29e43d/0x3234de053c51500 lrc: 2/0,0 mode: PW/PW res: [0x2b757:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592022:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004d29e43d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.592023:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d29e43d/0x3234de053c51500 lrc: 2/0,0 mode: PW/PW res: [0x2b757:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592026:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d29e43d/0x3234de053c51500 lrc: 3/0,0 mode: PW/PW res: [0x2b757:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592029:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d29e43d/0x3234de053c51500 lrc: 1/0,0 mode: --/PW res: [0x2b757:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.592031:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.592031:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d29e43d/0x3234de053c51500 lrc: 0/0,0 mode: --/PW res: [0x2b757:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.592058:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396337472 00010000:00010000:0.0:1651529344.592063:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c4cf8c lrc: 4/0,0 mode: PR/PR res: [0x2b75c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cefca expref: 1002 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.592076:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12346 00000100:00100000:0.0:1651529344.592078:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1002:41278:x1731746396337472:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.592081:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.592082:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c4cf8c lrc: 4/0,0 mode: PR/PR res: [0x2b75c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cefca expref: 1002 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.592086:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c4cf8c lrc: 3/0,0 mode: PR/PR res: [0x2b75c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cefca expref: 1002 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.592091:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c4cf8c lrc: 0/0,0 mode: --/PR res: [0x2b75c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cefca expref: 1002 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.592095:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.592095:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.592096:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000293bb831/0x3234de053c5151c lrc: 3/0,1 mode: PW/PW res: [0x2b75c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592099:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000293bb831/0x3234de053c5151c lrc: 4/0,1 mode: PW/PW res: [0x2b75c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592106:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.592113:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1001:41278:x1731746396337472:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 35us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.592115:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12346 00000100:00100000:1.0:1651529344.592138:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946456768 00010000:00010000:0.0:1651529344.592139:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000293bb831/0x3234de053c5151c lrc: 3/0,1 mode: PW/PW res: [0x2b75c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592143:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000293bb831/0x3234de053c5151c lrc: 3/0,1 mode: PW/PW res: [0x2b75c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.592146:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211566 00010000:00010000:0.0:1651529344.592146:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000293bb831/0x3234de053c5151c lrc: 3/0,1 mode: PW/PW res: [0x2b75c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.592148:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1060:39030:x1731745946456768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.592148:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000293bb831/0x3234de053c5151c lrc: 2/0,0 mode: PW/PW res: [0x2b75c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.592153:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178014 count 1 00010000:00010000:1.0:1651529344.592157:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb76f8f9/0x3234de053c5152a lrc: 3/0,1 mode: --/PW res: [0x2b75e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.592162:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000083a35be2/0x3234de053c4c7dd lrc: 2/0,0 mode: PR/PR res: [0x2b75e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd1c4 expref: 1000 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.592165:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.592166:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.592166:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb76f8f9/0x3234de053c5152a lrc: 4/0,1 mode: --/PW res: [0x2b75e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.592173:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000083a35be2/0x3234de053c4c7dd lrc: 3/0,0 mode: PR/PR res: [0x2b75e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd1c4 expref: 1000 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.592176:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000083a35be2/0x3234de053c4c7dd lrc: 4/0,0 mode: PR/PR res: [0x2b75e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd1c4 expref: 1000 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.592180:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000075b025a pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997006976:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.592195:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8a0b704 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.592214:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000021fdd79f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1061:39029:x1731745946456384:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1062us (1131us total) trans 12885079619 rc 0/0 00000100:00100000:0.0:1651529344.592218:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211564 00000100:00100000:1.0:1651529344.592274:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.592297:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000293bb831/0x3234de053c5151c lrc: 2/0,0 mode: PW/PW res: [0x2b75c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592301:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000293bb831 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.592302:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000293bb831/0x3234de053c5151c lrc: 2/0,0 mode: PW/PW res: [0x2b75c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592305:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000293bb831/0x3234de053c5151c lrc: 3/0,0 mode: PW/PW res: [0x2b75c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.592315:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.592316:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000293bb831/0x3234de053c5151c lrc: 1/0,0 mode: --/PW res: [0x2b75c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592319:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000293bb831/0x3234de053c5151c lrc: 0/0,0 mode: --/PW res: [0x2b75c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.592328:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946456960 00000100:00100000:1.0:1651529344.592332:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.592334:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946457024 00000100:00100000:1.0:1651529344.592351:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.592352:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211567 00000100:00100000:0.0:1651529344.592353:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1062:39030:x1731745946456960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.592364:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178015 count 1 00000100:00100000:1.0:1651529344.592366:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.592368:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c51531 lrc: 3/0,1 mode: --/PW res: [0x2b75f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.592375:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.592386:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946457152 00000100:00100000:1.0:1651529344.592393:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946457088 00010000:00010000:0.0:1651529344.592397:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004a1913b4/0x3234de053c4c66a lrc: 2/0,0 mode: PR/PR res: [0x2b75f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb9d expref: 1000 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.592401:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946457216 00000100:00100000:1.0:1651529344.592406:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211568 00000100:00100000:1.0:1651529344.592407:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1065:39029:x1731745946457024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.592410:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.592410:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.592411:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c51531 lrc: 4/0,1 mode: --/PW res: [0x2b75f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.592412:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178016 count 1 00010000:00010000:1.0:1651529344.592416:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e37edc36/0x3234de053c51538 lrc: 3/0,1 mode: --/PW res: [0x2b760:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592419:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004a1913b4/0x3234de053c4c66a lrc: 3/0,0 mode: PR/PR res: [0x2b75f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb9d expref: 1000 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.592421:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c25c2811/0x3234de053c4cb09 lrc: 2/0,0 mode: PR/PR res: [0x2b760:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cddb0 expref: 1000 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.592422:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004a1913b4/0x3234de053c4c66a lrc: 4/0,0 mode: PR/PR res: [0x2b75f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb9d expref: 1000 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.592424:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.592425:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.592425:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e37edc36/0x3234de053c51538 lrc: 4/0,1 mode: --/PW res: [0x2b760:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.592426:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000028589556 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997007040:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.592432:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c25c2811/0x3234de053c4cb09 lrc: 3/0,0 mode: PR/PR res: [0x2b760:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cddb0 expref: 1000 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.592435:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c25c2811/0x3234de053c4cb09 lrc: 4/0,0 mode: PR/PR res: [0x2b760:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cddb0 expref: 1000 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.592436:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e68b7e1f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.592442:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006e3eb319 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997007104:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.592443:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211569 00000100:00100000:0.0:1651529344.592445:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1065:39029:x1731745946457152:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.592449:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178018 count 1 00000100:00100000:1.0:1651529344.592451:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cfa1ca05 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.592453:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c5153f lrc: 3/0,1 mode: --/PW res: [0x2b762:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.592456:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396337856 00010000:00010000:0.0:1651529344.592457:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a4e1853d/0x3234de053c4a006 lrc: 2/0,0 mode: PR/PR res: [0x2b762:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5d2 expref: 1000 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.592460:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000128ab1d3/0x3234de053c4dda8 lrc: 5/0,0 mode: PR/PR res: [0x2b75d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2802 expref: 1001 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.592460:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.592461:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.592461:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c5153f lrc: 4/0,1 mode: --/PW res: [0x2b762:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592467:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a4e1853d/0x3234de053c4a006 lrc: 3/0,0 mode: PR/PR res: [0x2b762:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5d2 expref: 1001 pid: 72397 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.592468:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12347 00000100:00100000:1.0:1651529344.592469:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1001:41278:x1731746396337856:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.592471:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a4e1853d/0x3234de053c4a006 lrc: 4/0,0 mode: PR/PR res: [0x2b762:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5d2 expref: 1001 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.592472:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.592473:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000128ab1d3/0x3234de053c4dda8 lrc: 5/0,0 mode: PR/PR res: [0x2b75d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2802 expref: 1001 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.592474:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005384a251 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997007168:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.592477:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000128ab1d3/0x3234de053c4dda8 lrc: 4/0,0 mode: PR/PR res: [0x2b75d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2802 expref: 1001 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.592481:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e7e12492 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.592482:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.592483:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.592484:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c51523 lrc: 3/0,1 mode: PW/PW res: [0x2b75d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.592487:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c51523 lrc: 4/0,1 mode: PW/PW res: [0x2b75d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.592487:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211570 00000100:00100000:0.0:1651529344.592489:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1065:39029:x1731745946457088:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.592491:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00080000:0.0:1651529344.592492:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178017 count 1 00010000:00010000:0.0:1651529344.592495:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c51546 lrc: 3/0,1 mode: --/PW res: [0x2b761:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.592497:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1001:41278:x1731746396337856:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 27us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.592500:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12347 00010000:00010000:0.0:1651529344.592500:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000be2303ad/0x3234de053c4f579 lrc: 2/0,0 mode: PR/PR res: [0x2b761:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d885e expref: 1001 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.592503:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.592503:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.592504:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c51546 lrc: 4/0,1 mode: --/PW res: [0x2b761:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.592506:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211571 00000100:00100000:1.0:1651529344.592508:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1065:39029:x1731745946457216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.592509:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000be2303ad/0x3234de053c4f579 lrc: 3/0,0 mode: PR/PR res: [0x2b761:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d885e expref: 1000 pid: 156655 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.592512:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178019 count 1 00010000:00010000:0.0:1651529344.592513:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000be2303ad/0x3234de053c4f579 lrc: 4/0,0 mode: PR/PR res: [0x2b761:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d885e expref: 1000 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.592515:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d60102b6/0x3234de053c5154d lrc: 3/0,1 mode: --/PW res: [0x2b763:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.592516:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005d2b5bb3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997007232:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.592520:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004e1fb73e/0x3234de053c4da59 lrc: 2/0,0 mode: PR/PR res: [0x2b763:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d19c3 expref: 1000 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.592523:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.592523:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.592523:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 000000000d706dff going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.592524:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d60102b6/0x3234de053c5154d lrc: 4/0,1 mode: --/PW res: [0x2b763:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.592530:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004e1fb73e/0x3234de053c4da59 lrc: 3/0,0 mode: PR/PR res: [0x2b763:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d19c3 expref: 1000 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.592532:0:151609:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000128ab1d3/0x3234de053c4dda8 lrc: 0/0,0 mode: --/PR res: [0x2b75d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2802 expref: 1000 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.592533:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004e1fb73e/0x3234de053c4da59 lrc: 4/0,0 mode: PR/PR res: [0x2b763:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d19c3 expref: 1000 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.592536:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cee35a0c pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997006912:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.592537:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000057329b82 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997007296:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.592539:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c51523 lrc: 3/0,1 mode: PW/PW res: [0x2b75d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592542:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c51523 lrc: 3/0,1 mode: PW/PW res: [0x2b75d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.592544:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd96f074 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.592545:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c51523 lrc: 3/0,1 mode: PW/PW res: [0x2b75d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.592551:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000075b025a pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997006976:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.592551:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c51523 lrc: 3/0,1 mode: PW/PW res: [0x2b75d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592553:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c51523 lrc: 2/0,0 mode: PW/PW res: [0x2b75d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.592554:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cb76f8f9/0x3234de053c5152a lrc: 3/0,1 mode: --/PW res: [0x2b75e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.592586:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.592591:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1066:39030:x1731745946456704:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 928us (947us total) trans 12885079620 rc 0/0 00000100:00100000:0.0:1651529344.592594:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211565 00010000:00010000:0.0:1651529344.592600:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c51523 lrc: 2/0,0 mode: PW/PW res: [0x2b75d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592604:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c9570753 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.592605:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c51523 lrc: 2/0,0 mode: PW/PW res: [0x2b75d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592608:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c51523 lrc: 3/0,0 mode: PW/PW res: [0x2b75d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.592609:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.592612:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c51523 lrc: 1/0,0 mode: --/PW res: [0x2b75d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592623:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c51523 lrc: 0/0,0 mode: --/PW res: [0x2b75d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.592630:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946457280 00000100:00100000:0.0:1651529344.592641:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211572 00000100:00100000:0.0:1651529344.592642:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1066:39030:x1731745946457280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.592647:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178020 count 1 00010000:00010000:0.0:1651529344.592651:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c51554 lrc: 3/0,1 mode: --/PW res: [0x2b764:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592655:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006c26a0d1/0x3234de053c4d114 lrc: 2/0,0 mode: PR/PR res: [0x2b764:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf5ea expref: 999 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.592658:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.592659:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.592660:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c51554 lrc: 4/0,1 mode: --/PW res: [0x2b764:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592666:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006c26a0d1/0x3234de053c4d114 lrc: 3/0,0 mode: PR/PR res: [0x2b764:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf5ea expref: 999 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.592670:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006c26a0d1/0x3234de053c4d114 lrc: 4/0,0 mode: PR/PR res: [0x2b764:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf5ea expref: 999 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.592674:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cee35a0c pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997007360:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.592687:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000afe7ff7b going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.592699:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396337920 00010000:00010000:1.0:1651529344.592722:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000083a35be2/0x3234de053c4c7dd lrc: 4/0,0 mode: PR/PR res: [0x2b75e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd1c4 expref: 1000 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.592731:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12348 00000100:00100000:1.0:1651529344.592732:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1000:41279:x1731746396337920:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.592743:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.592745:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000083a35be2/0x3234de053c4c7dd lrc: 4/0,0 mode: PR/PR res: [0x2b75e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd1c4 expref: 1000 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.592749:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000083a35be2/0x3234de053c4c7dd lrc: 3/0,0 mode: PR/PR res: [0x2b75e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd1c4 expref: 1000 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.592754:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083a35be2/0x3234de053c4c7dd lrc: 0/0,0 mode: --/PR res: [0x2b75e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd1c4 expref: 1000 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.592758:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.592759:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.592760:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cb76f8f9/0x3234de053c5152a lrc: 3/0,1 mode: PW/PW res: [0x2b75e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.592763:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb76f8f9/0x3234de053c5152a lrc: 4/0,1 mode: PW/PW res: [0x2b75e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.592772:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.592783:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+999:41279:x1731746396337920:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 50us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.592785:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12348 00010000:00010000:1.0:1651529344.592793:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cb76f8f9/0x3234de053c5152a lrc: 3/0,1 mode: PW/PW res: [0x2b75e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.592796:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb76f8f9/0x3234de053c5152a lrc: 3/0,1 mode: PW/PW res: [0x2b75e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.592799:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb76f8f9/0x3234de053c5152a lrc: 3/0,1 mode: PW/PW res: [0x2b75e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.592802:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb76f8f9/0x3234de053c5152a lrc: 2/0,0 mode: PW/PW res: [0x2b75e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.592837:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.592848:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb76f8f9/0x3234de053c5152a lrc: 2/0,0 mode: PW/PW res: [0x2b75e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592852:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cb76f8f9 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.592853:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb76f8f9/0x3234de053c5152a lrc: 2/0,0 mode: PW/PW res: [0x2b75e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592856:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb76f8f9/0x3234de053c5152a lrc: 3/0,0 mode: PW/PW res: [0x2b75e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.592863:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1067:39030:x1731745946456768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 715us (846us total) trans 12885079621 rc 0/0 00000100:00100000:1.0:1651529344.592866:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211566 00010000:00010000:0.0:1651529344.592866:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb76f8f9/0x3234de053c5152a lrc: 1/0,0 mode: --/PW res: [0x2b75e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.592869:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb76f8f9/0x3234de053c5152a lrc: 0/0,0 mode: --/PW res: [0x2b75e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.592871:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946457664 00000100:00100000:1.0:1651529344.592877:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211573 00000100:00100000:1.0:1651529344.592879:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1067:39029:x1731745946457664:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.592883:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178021 count 1 00010000:00010000:1.0:1651529344.592887:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad204608/0x3234de053c5155b lrc: 3/0,1 mode: --/PW res: [0x2b765:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.592894:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c4ed06 lrc: 2/0,0 mode: PR/PR res: [0x2b765:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d65f8 expref: 998 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.592897:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.592898:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.592898:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad204608/0x3234de053c5155b lrc: 4/0,1 mode: --/PW res: [0x2b765:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.592905:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c4ed06 lrc: 3/0,0 mode: PR/PR res: [0x2b765:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d65f8 expref: 998 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.592917:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c4ed06 lrc: 4/0,0 mode: PR/PR res: [0x2b765:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d65f8 expref: 998 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.592921:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004bb67ba4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997007424:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.592936:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8a0b704 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.592950:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006e3eb319 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997007104:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.592954:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e37edc36/0x3234de053c51538 lrc: 3/0,1 mode: --/PW res: [0x2b760:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.592963:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005384a251 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997007168:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.592968:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c5153f lrc: 3/0,1 mode: --/PW res: [0x2b762:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.592975:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005d2b5bb3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997007232:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.592977:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c51546 lrc: 3/0,1 mode: --/PW res: [0x2b761:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.592983:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000028589556 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997007040:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.592985:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c51531 lrc: 3/0,1 mode: --/PW res: [0x2b75f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.593034:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.593044:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946457792 00000100:00100000:1.0:1651529344.593051:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211574 00000100:00100000:1.0:1651529344.593053:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1068:39030:x1731745946457792:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.593058:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178022 count 1 00010000:00010000:1.0:1651529344.593061:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b33925b5/0x3234de053c51562 lrc: 3/0,1 mode: --/PW res: [0x2b766:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.593066:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002897da4e/0x3234de053c4c973 lrc: 2/0,0 mode: PR/PR res: [0x2b766:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd797 expref: 998 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.593069:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.593069:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.593070:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b33925b5/0x3234de053c51562 lrc: 4/0,1 mode: --/PW res: [0x2b766:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.593076:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002897da4e/0x3234de053c4c973 lrc: 3/0,0 mode: PR/PR res: [0x2b766:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd797 expref: 998 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.593079:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002897da4e/0x3234de053c4c973 lrc: 4/0,0 mode: PR/PR res: [0x2b766:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd797 expref: 998 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.593083:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a138afb6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997007488:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.593094:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a4eb401d going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.593151:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000057329b82 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997007296:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.593153:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.593155:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d60102b6/0x3234de053c5154d lrc: 3/0,1 mode: --/PW res: [0x2b763:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.593167:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396338176 00010000:00010000:1.0:1651529344.593172:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004a1913b4/0x3234de053c4c66a lrc: 4/0,0 mode: PR/PR res: [0x2b75f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb9d expref: 999 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.593179:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12349 00000100:00100000:1.0:1651529344.593181:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+999:41279:x1731746396338176:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.593183:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.593185:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004a1913b4/0x3234de053c4c66a lrc: 4/0,0 mode: PR/PR res: [0x2b75f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb9d expref: 999 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.593191:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cee35a0c pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997007360:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.593197:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c51554 lrc: 3/0,1 mode: --/PW res: [0x2b764:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.593201:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004a1913b4/0x3234de053c4c66a lrc: 3/0,0 mode: PR/PR res: [0x2b75f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb9d expref: 999 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.593207:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a1913b4/0x3234de053c4c66a lrc: 0/0,0 mode: --/PR res: [0x2b75f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb9d expref: 999 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.593211:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.593211:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.593212:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c51531 lrc: 3/0,1 mode: PW/PW res: [0x2b75f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.593215:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c51531 lrc: 4/0,1 mode: PW/PW res: [0x2b75f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.593242:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.593258:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+998:41279:x1731746396338176:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 76us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.593261:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12349 00010000:00010000:0.0:1651529344.593268:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c51531 lrc: 3/0,1 mode: PW/PW res: [0x2b75f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593272:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c51531 lrc: 3/0,1 mode: PW/PW res: [0x2b75f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.593276:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.593276:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c51531 lrc: 3/0,1 mode: PW/PW res: [0x2b75f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593278:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c51531 lrc: 2/0,0 mode: PW/PW res: [0x2b75f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.593309:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.593317:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.593327:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.593334:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.593340:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1069:39030:x1731745946456960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 985us (1066us total) trans 12885079622 rc 0/0 00000100:00100000:0.0:1651529344.593343:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211567 00010000:00010000:0.0:1651529344.593350:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c51531 lrc: 2/0,0 mode: PW/PW res: [0x2b75f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593354:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a706026 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.593355:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c51531 lrc: 2/0,0 mode: PW/PW res: [0x2b75f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593358:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c51531 lrc: 3/0,0 mode: PW/PW res: [0x2b75f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593365:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c51531 lrc: 1/0,0 mode: --/PW res: [0x2b75f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.593367:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.593368:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c51531 lrc: 0/0,0 mode: --/PW res: [0x2b75f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.593376:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396338304 00000100:00100000:1.0:1651529344.593379:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396338432 00010000:00010000:0.0:1651529344.593380:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000be2303ad/0x3234de053c4f579 lrc: 4/0,0 mode: PR/PR res: [0x2b761:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d885e expref: 999 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.593384:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006c26a0d1/0x3234de053c4d114 lrc: 4/0,0 mode: PR/PR res: [0x2b764:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf5ea expref: 999 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.593385:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396338112 00010000:00010000:0.0:1651529344.593387:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c25c2811/0x3234de053c4cb09 lrc: 4/0,0 mode: PR/PR res: [0x2b760:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cddb0 expref: 1000 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.593390:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396338240 00010000:00010000:1.0:1651529344.593392:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a4e1853d/0x3234de053c4a006 lrc: 4/0,0 mode: PR/PR res: [0x2b762:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5d2 expref: 1001 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.593392:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396338368 00010000:00010000:0.0:1651529344.593395:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004e1fb73e/0x3234de053c4da59 lrc: 4/0,0 mode: PR/PR res: [0x2b763:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d19c3 expref: 1002 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.593397:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396338624 00010000:00010000:1.0:1651529344.593399:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c4ed06 lrc: 5/0,0 mode: PR/PR res: [0x2b765:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d65f8 expref: 1003 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.593400:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12350 00000100:00100000:0.0:1651529344.593401:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1003:41279:x1731746396338304:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.593404:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12351 00010000:00010000:0.0:1651529344.593404:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.593405:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000be2303ad/0x3234de053c4f579 lrc: 4/0,0 mode: PR/PR res: [0x2b761:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d885e expref: 1003 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.593406:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea4c33b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1003:41279:x1731746396338432:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.593409:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.593409:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000be2303ad/0x3234de053c4f579 lrc: 3/0,0 mode: PR/PR res: [0x2b761:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d885e expref: 1003 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.593410:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006c26a0d1/0x3234de053c4d114 lrc: 4/0,0 mode: PR/PR res: [0x2b764:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf5ea expref: 1003 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.593414:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006c26a0d1/0x3234de053c4d114 lrc: 3/0,0 mode: PR/PR res: [0x2b764:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf5ea expref: 1003 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.593417:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be2303ad/0x3234de053c4f579 lrc: 0/0,0 mode: --/PR res: [0x2b761:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d885e expref: 1003 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.593419:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c26a0d1/0x3234de053c4d114 lrc: 0/0,0 mode: --/PR res: [0x2b764:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf5ea expref: 1003 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.593420:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.593421:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.593422:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c51546 lrc: 3/0,1 mode: PW/PW res: [0x2b761:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.593423:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.593423:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.593424:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c51554 lrc: 3/0,1 mode: PW/PW res: [0x2b764:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593425:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c51546 lrc: 4/0,1 mode: PW/PW res: [0x2b761:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.593429:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c51554 lrc: 4/0,1 mode: PW/PW res: [0x2b764:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593431:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.593440:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.593453:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea4c33b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1001:41279:x1731746396338432:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 47us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.593456:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12351 00000100:00100000:1.0:1651529344.593460:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12352 00000100:00100000:1.0:1651529344.593462:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1000:41278:x1731746396338112:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.593468:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+1000:41279:x1731746396338304:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 65us (191us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.593470:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.593471:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12350 00010000:00010000:1.0:1651529344.593472:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c25c2811/0x3234de053c4cb09 lrc: 4/0,0 mode: PR/PR res: [0x2b760:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cddb0 expref: 1000 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.593476:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c25c2811/0x3234de053c4cb09 lrc: 3/0,0 mode: PR/PR res: [0x2b760:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cddb0 expref: 999 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.593481:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c25c2811/0x3234de053c4cb09 lrc: 0/0,0 mode: --/PR res: [0x2b760:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cddb0 expref: 999 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.593481:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12353 00010000:00010000:1.0:1651529344.593485:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.593485:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.593486:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e37edc36/0x3234de053c51538 lrc: 3/0,1 mode: PW/PW res: [0x2b760:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.593489:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e37edc36/0x3234de053c51538 lrc: 4/0,1 mode: PW/PW res: [0x2b760:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.593494:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+998:41278:x1731746396338240:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.593497:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.593498:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.593500:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a4e1853d/0x3234de053c4a006 lrc: 4/0,0 mode: PR/PR res: [0x2b762:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5d2 expref: 998 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.593502:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+998:41278:x1731746396338112:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (185us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.593504:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a4e1853d/0x3234de053c4a006 lrc: 3/0,0 mode: PR/PR res: [0x2b762:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5d2 expref: 998 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.593505:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12352 00000100:00100000:1.0:1651529344.593509:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12354 00010000:00010000:0.0:1651529344.593509:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4e1853d/0x3234de053c4a006 lrc: 0/0,0 mode: --/PR res: [0x2b762:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5d2 expref: 997 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.593511:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+997:41278:x1731746396338368:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.593513:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.593515:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004e1fb73e/0x3234de053c4da59 lrc: 4/0,0 mode: PR/PR res: [0x2b763:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d19c3 expref: 996 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.593515:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.593515:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.593516:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c5153f lrc: 3/0,1 mode: PW/PW res: [0x2b762:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.593518:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004e1fb73e/0x3234de053c4da59 lrc: 3/0,0 mode: PR/PR res: [0x2b763:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d19c3 expref: 996 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.593519:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c5153f lrc: 4/0,1 mode: PW/PW res: [0x2b762:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.593523:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e1fb73e/0x3234de053c4da59 lrc: 0/0,0 mode: --/PR res: [0x2b763:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d19c3 expref: 996 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.593526:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.593526:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.593527:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.593527:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d60102b6/0x3234de053c5154d lrc: 3/0,1 mode: PW/PW res: [0x2b763:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.593530:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d60102b6/0x3234de053c5154d lrc: 4/0,1 mode: PW/PW res: [0x2b763:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.593533:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+995:41278:x1731746396338240:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (205us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.593535:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.593536:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12353 00000100:00100000:1.0:1651529344.593540:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+994:41278:x1731746396338368:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 28us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.593541:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12355 00000100:00100000:0.0:1651529344.593542:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+994:41279:x1731746396338624:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.593543:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12354 00010000:00010000:0.0:1651529344.593545:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.593546:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c4ed06 lrc: 5/0,0 mode: PR/PR res: [0x2b765:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d65f8 expref: 993 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.593549:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e37edc36/0x3234de053c51538 lrc: 3/0,1 mode: PW/PW res: [0x2b760:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593550:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c4ed06 lrc: 4/0,0 mode: PR/PR res: [0x2b765:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d65f8 expref: 993 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.593552:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e37edc36/0x3234de053c51538 lrc: 3/0,1 mode: PW/PW res: [0x2b760:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593554:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.593555:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e37edc36/0x3234de053c51538 lrc: 3/0,1 mode: PW/PW res: [0x2b760:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593555:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.593555:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ad204608/0x3234de053c5155b lrc: 3/0,1 mode: PW/PW res: [0x2b765:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.593558:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e37edc36/0x3234de053c51538 lrc: 2/0,0 mode: PW/PW res: [0x2b760:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593561:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad204608/0x3234de053c5155b lrc: 4/0,1 mode: PW/PW res: [0x2b765:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593572:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.593578:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+993:41279:x1731746396338624:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.593580:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12355 00010000:00010000:0.0:1651529344.593587:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c51546 lrc: 3/0,1 mode: PW/PW res: [0x2b761:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593590:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c51546 lrc: 3/0,1 mode: PW/PW res: [0x2b761:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593593:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c51546 lrc: 3/0,1 mode: PW/PW res: [0x2b761:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593596:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c51546 lrc: 2/0,0 mode: PW/PW res: [0x2b761:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.593600:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1069:39029:x1731745946457024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1192us (1285us total) trans 12885079623 rc 0/0 00000100:00100000:1.0:1651529344.593603:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211568 00010000:00010000:1.0:1651529344.593610:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d60102b6/0x3234de053c5154d lrc: 3/0,1 mode: PW/PW res: [0x2b763:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.593613:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d60102b6/0x3234de053c5154d lrc: 3/0,1 mode: PW/PW res: [0x2b763:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.593616:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d60102b6/0x3234de053c5154d lrc: 3/0,1 mode: PW/PW res: [0x2b763:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.593619:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d60102b6/0x3234de053c5154d lrc: 2/0,0 mode: PW/PW res: [0x2b763:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.593641:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1069:39029:x1731745946457088:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1152us (1275us total) trans 12885079624 rc 0/0 00000100:00100000:0.0:1651529344.593644:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211570 00010000:00010000:0.0:1651529344.593651:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c5153f lrc: 3/0,1 mode: PW/PW res: [0x2b762:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593654:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c5153f lrc: 3/0,1 mode: PW/PW res: [0x2b762:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593657:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c5153f lrc: 3/0,1 mode: PW/PW res: [0x2b762:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.593660:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1069:39029:x1731745946457216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1151us (1285us total) trans 12885079625 rc 0/0 00010000:00010000:0.0:1651529344.593660:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c5153f lrc: 2/0,0 mode: PW/PW res: [0x2b762:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.593663:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211571 00000100:00100000:1.0:1651529344.593673:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a138afb6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997007488:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.593677:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b33925b5/0x3234de053c51562 lrc: 3/0,1 mode: --/PW res: [0x2b766:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.593684:0:80280:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c4ed06 lrc: 0/0,0 mode: --/PR res: [0x2b765:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d65f8 expref: 992 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.593688:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004bb67ba4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997007424:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.593690:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ad204608/0x3234de053c5155b lrc: 3/0,1 mode: PW/PW res: [0x2b765:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.593693:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ad204608/0x3234de053c5155b lrc: 3/0,1 mode: PW/PW res: [0x2b765:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.593693:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1069:39029:x1731745946457152:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1247us (1342us total) trans 12885079626 rc 0/0 00010000:00010000:1.0:1651529344.593695:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad204608/0x3234de053c5155b lrc: 3/0,1 mode: PW/PW res: [0x2b765:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.593695:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211569 00010000:00010000:1.0:1651529344.593698:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad204608/0x3234de053c5155b lrc: 3/0,1 mode: PW/PW res: [0x2b765:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.593701:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad204608/0x3234de053c5155b lrc: 2/0,0 mode: PW/PW res: [0x2b765:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593702:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e37edc36/0x3234de053c51538 lrc: 2/0,0 mode: PW/PW res: [0x2b760:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593705:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e37edc36 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.593706:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e37edc36/0x3234de053c51538 lrc: 2/0,0 mode: PW/PW res: [0x2b760:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593709:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e37edc36/0x3234de053c51538 lrc: 3/0,0 mode: PW/PW res: [0x2b760:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593713:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e37edc36/0x3234de053c51538 lrc: 1/0,0 mode: --/PW res: [0x2b760:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593716:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e37edc36/0x3234de053c51538 lrc: 0/0,0 mode: --/PW res: [0x2b760:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593720:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c51546 lrc: 2/0,0 mode: PW/PW res: [0x2b761:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593723:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e696ff9d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.593724:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c51546 lrc: 2/0,0 mode: PW/PW res: [0x2b761:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593727:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c51546 lrc: 3/0,0 mode: PW/PW res: [0x2b761:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593730:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c51546 lrc: 1/0,0 mode: --/PW res: [0x2b761:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593732:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c51546 lrc: 0/0,0 mode: --/PW res: [0x2b761:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.593744:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1069:39029:x1731745946457664:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 864us (907us total) trans 12885079627 rc 0/0 00010000:00010000:0.0:1651529344.593746:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d60102b6/0x3234de053c5154d lrc: 2/0,0 mode: PW/PW res: [0x2b763:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.593747:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211573 00010000:00010000:0.0:1651529344.593749:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d60102b6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.593750:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d60102b6/0x3234de053c5154d lrc: 2/0,0 mode: PW/PW res: [0x2b763:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593752:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d60102b6/0x3234de053c5154d lrc: 3/0,0 mode: PW/PW res: [0x2b763:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593756:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d60102b6/0x3234de053c5154d lrc: 1/0,0 mode: --/PW res: [0x2b763:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593759:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d60102b6/0x3234de053c5154d lrc: 0/0,0 mode: --/PW res: [0x2b763:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593762:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c5153f lrc: 2/0,0 mode: PW/PW res: [0x2b762:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.593764:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.593765:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000004c7843a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.593766:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c5153f lrc: 2/0,0 mode: PW/PW res: [0x2b762:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593768:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c5153f lrc: 3/0,0 mode: PW/PW res: [0x2b762:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593771:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c5153f lrc: 1/0,0 mode: --/PW res: [0x2b762:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593774:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c5153f lrc: 0/0,0 mode: --/PW res: [0x2b762:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593777:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad204608/0x3234de053c5155b lrc: 2/0,0 mode: PW/PW res: [0x2b765:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593779:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ad204608 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.593780:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad204608/0x3234de053c5155b lrc: 2/0,0 mode: PW/PW res: [0x2b765:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593783:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad204608/0x3234de053c5155b lrc: 3/0,0 mode: PW/PW res: [0x2b765:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593786:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad204608/0x3234de053c5155b lrc: 1/0,0 mode: --/PW res: [0x2b765:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.593789:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.593789:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad204608/0x3234de053c5155b lrc: 0/0,0 mode: --/PW res: [0x2b765:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593795:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c51554 lrc: 3/0,1 mode: PW/PW res: [0x2b764:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593798:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c51554 lrc: 3/0,1 mode: PW/PW res: [0x2b764:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593801:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c51554 lrc: 3/0,1 mode: PW/PW res: [0x2b764:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593804:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c51554 lrc: 2/0,0 mode: PW/PW res: [0x2b764:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.593846:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1069:39030:x1731745946457280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1203us (1237us total) trans 12885079628 rc 0/0 00000100:00100000:0.0:1651529344.593849:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211572 00000100:00100000:0.0:1651529344.593854:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946457984 00000100:00100000:0.0:1651529344.593860:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211575 00000100:00100000:0.0:1651529344.593862:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1069:39030:x1731745946457984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.593867:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178023 count 1 00010000:00010000:0.0:1651529344.593871:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000954b1161/0x3234de053c51569 lrc: 3/0,1 mode: --/PW res: [0x2b767:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593876:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000303453f5/0x3234de053c4cde1 lrc: 2/0,0 mode: PR/PR res: [0x2b767:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce910 expref: 991 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.593879:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.593880:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.593897:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000954b1161/0x3234de053c51569 lrc: 4/0,1 mode: --/PW res: [0x2b767:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.593900:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396338752 00010000:00010000:0.0:1651529344.593905:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000303453f5/0x3234de053c4cde1 lrc: 3/0,0 mode: PR/PR res: [0x2b767:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce910 expref: 992 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.593906:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002897da4e/0x3234de053c4c973 lrc: 4/0,0 mode: PR/PR res: [0x2b766:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd797 expref: 992 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.593909:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000303453f5/0x3234de053c4cde1 lrc: 4/0,0 mode: PR/PR res: [0x2b767:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce910 expref: 992 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.593916:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12356 00000100:00100000:1.0:1651529344.593918:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+992:41278:x1731746396338752:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.593921:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.593922:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002897da4e/0x3234de053c4c973 lrc: 4/0,0 mode: PR/PR res: [0x2b766:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd797 expref: 992 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.593926:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002897da4e/0x3234de053c4c973 lrc: 3/0,0 mode: PR/PR res: [0x2b766:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd797 expref: 992 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.593931:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002897da4e/0x3234de053c4c973 lrc: 0/0,0 mode: --/PR res: [0x2b766:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd797 expref: 992 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.593931:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005d2b5bb3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997007552:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.593935:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.593936:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.593936:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b33925b5/0x3234de053c51562 lrc: 3/0,1 mode: PW/PW res: [0x2b766:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.593942:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b33925b5/0x3234de053c51562 lrc: 4/0,1 mode: PW/PW res: [0x2b766:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.593946:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c4075652 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.593953:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c51554 lrc: 2/0,0 mode: PW/PW res: [0x2b764:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.593954:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.593956:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d1b07eb5 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.593957:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c51554 lrc: 2/0,0 mode: PW/PW res: [0x2b764:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593960:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c51554 lrc: 3/0,0 mode: PW/PW res: [0x2b764:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.593961:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+991:41278:x1731746396338752:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.593963:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12356 00010000:00010000:0.0:1651529344.593964:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c51554 lrc: 1/0,0 mode: --/PW res: [0x2b764:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.593969:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b33925b5/0x3234de053c51562 lrc: 3/0,1 mode: PW/PW res: [0x2b766:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593970:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c51554 lrc: 0/0,0 mode: --/PW res: [0x2b764:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.593973:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b33925b5/0x3234de053c51562 lrc: 3/0,1 mode: PW/PW res: [0x2b766:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.593976:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b33925b5/0x3234de053c51562 lrc: 3/0,1 mode: PW/PW res: [0x2b766:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.593978:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b33925b5/0x3234de053c51562 lrc: 2/0,0 mode: PW/PW res: [0x2b766:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593994:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b33925b5/0x3234de053c51562 lrc: 2/0,0 mode: PW/PW res: [0x2b766:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.593998:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b33925b5 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.593999:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b33925b5/0x3234de053c51562 lrc: 2/0,0 mode: PW/PW res: [0x2b766:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.594002:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b33925b5/0x3234de053c51562 lrc: 3/0,0 mode: PW/PW res: [0x2b766:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.594005:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b33925b5/0x3234de053c51562 lrc: 1/0,0 mode: --/PW res: [0x2b766:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.594008:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b33925b5/0x3234de053c51562 lrc: 0/0,0 mode: --/PW res: [0x2b766:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.594020:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1070:39030:x1731745946457792:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 966us (986us total) trans 12885079629 rc 0/0 00000100:00100000:1.0:1651529344.594023:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211574 00000100:00100000:0.0:1651529344.594050:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.594066:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946458176 00000100:00100000:1.0:1651529344.594073:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211576 00000100:00100000:1.0:1651529344.594074:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1070:39029:x1731745946458176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.594079:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178024 count 1 00000100:00100000:0.0:1651529344.594087:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.594091:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8d2c80d/0x3234de053c51570 lrc: 3/0,1 mode: --/PW res: [0x2b768:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.594095:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.594096:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000de2d3e05/0x3234de053c4d757 lrc: 2/0,0 mode: PR/PR res: [0x2b768:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f04 expref: 990 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.594105:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.594105:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.594105:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.594106:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8d2c80d/0x3234de053c51570 lrc: 4/0,1 mode: --/PW res: [0x2b768:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.594112:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.594113:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000de2d3e05/0x3234de053c4d757 lrc: 3/0,0 mode: PR/PR res: [0x2b768:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f04 expref: 990 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.594122:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000de2d3e05/0x3234de053c4d757 lrc: 4/0,0 mode: PR/PR res: [0x2b768:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f04 expref: 990 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.594126:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000027e31dd1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997007616:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.594135:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d09f5ee1 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.594148:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946458304 00000100:00100000:0.0:1651529344.594157:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.594184:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946458240 00000100:00100000:1.0:1651529344.594189:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946458368 00000100:00100000:1.0:1651529344.594194:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946458432 00000100:00100000:1.0:1651529344.594199:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946458496 00000100:00100000:1.0:1651529344.594203:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211577 00000100:00100000:1.0:1651529344.594204:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1075:39029:x1731745946458304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.594207:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211578 00002000:00080000:1.0:1651529344.594209:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178026 count 1 00000100:00100000:0.0:1651529344.594209:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1075:39029:x1731745946458240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.594213:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087c25fa6/0x3234de053c51577 lrc: 3/0,1 mode: --/PW res: [0x2b76a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.594216:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178025 count 1 00010000:00010000:1.0:1651529344.594219:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba3ddc6f/0x3234de053c4ec88 lrc: 2/0,0 mode: PR/PR res: [0x2b76a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d63ba expref: 990 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.594220:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c5157e lrc: 3/0,1 mode: --/PW res: [0x2b769:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.594236:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002fb0278b/0x3234de053c4b553 lrc: 2/0,0 mode: PR/PR res: [0x2b769:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc274 expref: 990 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.594237:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.594238:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.594239:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087c25fa6/0x3234de053c51577 lrc: 4/0,1 mode: --/PW res: [0x2b76a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.594239:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.594240:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.594241:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c5157e lrc: 4/0,1 mode: --/PW res: [0x2b769:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.594246:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ba3ddc6f/0x3234de053c4ec88 lrc: 3/0,0 mode: PR/PR res: [0x2b76a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d63ba expref: 990 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.594249:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ba3ddc6f/0x3234de053c4ec88 lrc: 4/0,0 mode: PR/PR res: [0x2b76a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d63ba expref: 990 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.594253:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000023afca5e pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997007680:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.594262:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000babe2d90 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.594263:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002fb0278b/0x3234de053c4b553 lrc: 3/0,0 mode: PR/PR res: [0x2b769:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc274 expref: 990 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.594267:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002fb0278b/0x3234de053c4b553 lrc: 4/0,0 mode: PR/PR res: [0x2b769:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc274 expref: 990 pid: 106695 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.594269:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211579 00000100:00100000:1.0:1651529344.594270:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1075:39029:x1731745946458368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.594272:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002f77bb41 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997007744:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.594275:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178027 count 1 00010000:00010000:1.0:1651529344.594278:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf21e361/0x3234de053c51585 lrc: 3/0,1 mode: --/PW res: [0x2b76b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.594281:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000000d706dff going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.594282:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000570bee5b/0x3234de053c4a061 lrc: 2/0,0 mode: PR/PR res: [0x2b76b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb75a expref: 990 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.594285:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.594286:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.594287:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf21e361/0x3234de053c51585 lrc: 4/0,1 mode: --/PW res: [0x2b76b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.594288:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211580 00000100:00100000:0.0:1651529344.594290:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1075:39029:x1731745946458432:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.594293:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000570bee5b/0x3234de053c4a061 lrc: 3/0,0 mode: PR/PR res: [0x2b76b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb75a expref: 990 pid: 72397 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.594294:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178028 count 1 00010000:00010000:1.0:1651529344.594296:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000570bee5b/0x3234de053c4a061 lrc: 4/0,0 mode: PR/PR res: [0x2b76b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb75a expref: 990 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.594298:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c5158c lrc: 3/0,1 mode: --/PW res: [0x2b76c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.594300:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d523a75 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997007808:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.594303:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c4ec3b lrc: 2/0,0 mode: PR/PR res: [0x2b76c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d626a expref: 990 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.594306:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b52d0f36 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.594306:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.594307:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.594307:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c5158c lrc: 4/0,1 mode: --/PW res: [0x2b76c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.594312:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211581 00010000:00010000:0.0:1651529344.594313:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c4ec3b lrc: 3/0,0 mode: PR/PR res: [0x2b76c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d626a expref: 990 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.594314:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1075:39029:x1731745946458496:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.594317:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178029 count 1 00010000:00010000:0.0:1651529344.594317:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c4ec3b lrc: 4/0,0 mode: PR/PR res: [0x2b76c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d626a expref: 990 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.594320:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ec63a1b/0x3234de053c51593 lrc: 3/0,1 mode: --/PW res: [0x2b76d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.594321:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002f363f4a pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997007872:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.594324:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000abb748bc/0x3234de053c4c831 lrc: 2/0,0 mode: PR/PR res: [0x2b76d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd2ea expref: 990 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.594327:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.594327:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e7e12492 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.594328:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.594328:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ec63a1b/0x3234de053c51593 lrc: 4/0,1 mode: --/PW res: [0x2b76d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.594334:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000abb748bc/0x3234de053c4c831 lrc: 3/0,0 mode: PR/PR res: [0x2b76d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd2ea expref: 990 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.594337:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005d2b5bb3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997007552:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.594340:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000abb748bc/0x3234de053c4c831 lrc: 4/0,0 mode: PR/PR res: [0x2b76d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd2ea expref: 990 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.594341:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000954b1161/0x3234de053c51569 lrc: 3/0,1 mode: --/PW res: [0x2b767:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.594344:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000913beefe pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997007936:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.594350:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000567ee0ef going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.594430:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000027e31dd1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997007616:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.594435:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f8d2c80d/0x3234de053c51570 lrc: 3/0,1 mode: --/PW res: [0x2b768:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.594497:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.594499:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.594506:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.594507:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946458816 00000100:00100000:0.0:1651529344.594515:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396339072 00000100:00100000:1.0:1651529344.594519:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211582 00000100:00100000:1.0:1651529344.594521:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1076:39030:x1731745946458816:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.594521:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000303453f5/0x3234de053c4cde1 lrc: 4/0,0 mode: PR/PR res: [0x2b767:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce910 expref: 991 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:1.0:1651529344.594526:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178030 count 1 00000100:00100000:0.0:1651529344.594530:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396339200 00010000:00010000:1.0:1651529344.594535:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c653241/0x3234de053c5159a lrc: 3/0,1 mode: --/PW res: [0x2b76e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.594539:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004884fc72/0x3234de053c4e271 lrc: 2/0,0 mode: PR/PR res: [0x2b76e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b03 expref: 992 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.594547:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.594548:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.594548:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c653241/0x3234de053c5159a lrc: 4/0,1 mode: --/PW res: [0x2b76e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.594548:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000de2d3e05/0x3234de053c4d757 lrc: 4/0,0 mode: PR/PR res: [0x2b768:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f04 expref: 992 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.594562:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004884fc72/0x3234de053c4e271 lrc: 3/0,0 mode: PR/PR res: [0x2b76e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b03 expref: 992 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.594566:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004884fc72/0x3234de053c4e271 lrc: 4/0,0 mode: PR/PR res: [0x2b76e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b03 expref: 992 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.594567:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12357 00000100:00100000:0.0:1651529344.594569:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+992:41279:x1731746396339072:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.594570:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd68fdd5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997008000:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.594572:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.594573:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000303453f5/0x3234de053c4cde1 lrc: 4/0,0 mode: PR/PR res: [0x2b767:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce910 expref: 992 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.594578:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000303453f5/0x3234de053c4cde1 lrc: 3/0,0 mode: PR/PR res: [0x2b767:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce910 expref: 992 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.594583:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 000000007d8fabda going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.594590:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12358 00000100:00100000:1.0:1651529344.594592:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1a0028d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+992:41279:x1731746396339200:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.594595:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.594596:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000de2d3e05/0x3234de053c4d757 lrc: 4/0,0 mode: PR/PR res: [0x2b768:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f04 expref: 992 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.594600:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000de2d3e05/0x3234de053c4d757 lrc: 3/0,0 mode: PR/PR res: [0x2b768:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f04 expref: 992 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.594600:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000303453f5/0x3234de053c4cde1 lrc: 0/0,0 mode: --/PR res: [0x2b767:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce910 expref: 992 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.594604:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.594605:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.594606:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de2d3e05/0x3234de053c4d757 lrc: 0/0,0 mode: --/PR res: [0x2b768:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f04 expref: 991 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.594606:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000954b1161/0x3234de053c51569 lrc: 3/0,1 mode: PW/PW res: [0x2b767:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.594609:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000954b1161/0x3234de053c51569 lrc: 4/0,1 mode: PW/PW res: [0x2b767:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.594610:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.594610:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.594611:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f8d2c80d/0x3234de053c51570 lrc: 3/0,1 mode: PW/PW res: [0x2b768:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.594616:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8d2c80d/0x3234de053c51570 lrc: 4/0,1 mode: PW/PW res: [0x2b768:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.594616:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.594623:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.594623:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+990:41279:x1731746396339072:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 54us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.594626:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12357 00000100:00100000:1.0:1651529344.594629:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1a0028d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+989:41279:x1731746396339200:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.594631:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12358 00010000:00010000:0.0:1651529344.594632:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000954b1161/0x3234de053c51569 lrc: 3/0,1 mode: PW/PW res: [0x2b767:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.594636:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000954b1161/0x3234de053c51569 lrc: 3/0,1 mode: PW/PW res: [0x2b767:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.594639:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000954b1161/0x3234de053c51569 lrc: 3/0,1 mode: PW/PW res: [0x2b767:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.594641:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000954b1161/0x3234de053c51569 lrc: 2/0,0 mode: PW/PW res: [0x2b767:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.594643:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f8d2c80d/0x3234de053c51570 lrc: 3/0,1 mode: PW/PW res: [0x2b768:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.594647:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8d2c80d/0x3234de053c51570 lrc: 3/0,1 mode: PW/PW res: [0x2b768:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.594650:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8d2c80d/0x3234de053c51570 lrc: 3/0,1 mode: PW/PW res: [0x2b768:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.594652:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8d2c80d/0x3234de053c51570 lrc: 2/0,0 mode: PW/PW res: [0x2b768:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.594687:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1078:39030:x1731745946457984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 824us (923us total) trans 12885079630 rc 0/0 00000100:00100000:0.0:1651529344.594690:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211575 00000100:00100000:1.0:1651529344.594695:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1077:39029:x1731745946458176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 619us (645us total) trans 12885079631 rc 0/0 00010000:00010000:0.0:1651529344.594697:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000954b1161/0x3234de053c51569 lrc: 2/0,0 mode: PW/PW res: [0x2b767:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.594698:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211576 00010000:00010000:0.0:1651529344.594701:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000954b1161 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.594701:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000954b1161/0x3234de053c51569 lrc: 2/0,0 mode: PW/PW res: [0x2b767:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.594704:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000954b1161/0x3234de053c51569 lrc: 3/0,0 mode: PW/PW res: [0x2b767:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.594709:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000954b1161/0x3234de053c51569 lrc: 1/0,0 mode: --/PW res: [0x2b767:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.594711:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000954b1161/0x3234de053c51569 lrc: 0/0,0 mode: --/PW res: [0x2b767:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.594715:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8d2c80d/0x3234de053c51570 lrc: 2/0,0 mode: PW/PW res: [0x2b768:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.594718:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f8d2c80d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.594719:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8d2c80d/0x3234de053c51570 lrc: 2/0,0 mode: PW/PW res: [0x2b768:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.594722:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8d2c80d/0x3234de053c51570 lrc: 3/0,0 mode: PW/PW res: [0x2b768:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.594725:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8d2c80d/0x3234de053c51570 lrc: 1/0,0 mode: --/PW res: [0x2b768:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.594727:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8d2c80d/0x3234de053c51570 lrc: 0/0,0 mode: --/PW res: [0x2b768:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.594758:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000023afca5e pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997007680:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.594762:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000087c25fa6/0x3234de053c51577 lrc: 3/0,1 mode: --/PW res: [0x2b76a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.594826:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002f77bb41 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997007744:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.594831:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d523a75 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997007808:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.594831:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c5157e lrc: 3/0,1 mode: --/PW res: [0x2b769:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.594835:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bf21e361/0x3234de053c51585 lrc: 3/0,1 mode: --/PW res: [0x2b76b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.594945:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.594966:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.594969:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.594980:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000913beefe pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997007936:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.594983:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005ec63a1b/0x3234de053c51593 lrc: 3/0,1 mode: --/PW res: [0x2b76d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.594990:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396339456 00010000:00010000:1.0:1651529344.594994:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ba3ddc6f/0x3234de053c4ec88 lrc: 4/0,0 mode: PR/PR res: [0x2b76a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d63ba expref: 989 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.594996:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002f363f4a pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997007872:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.595001:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c5158c lrc: 3/0,1 mode: --/PW res: [0x2b76c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.595011:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12359 00000100:00100000:0.0:1651529344.595011:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946458944 00000100:00100000:1.0:1651529344.595012:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+989:41279:x1731746396339456:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.595016:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.595017:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ba3ddc6f/0x3234de053c4ec88 lrc: 4/0,0 mode: PR/PR res: [0x2b76a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d63ba expref: 989 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.595021:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946459008 00010000:00010000:1.0:1651529344.595026:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ba3ddc6f/0x3234de053c4ec88 lrc: 3/0,0 mode: PR/PR res: [0x2b76a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d63ba expref: 989 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.595026:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211583 00000100:00100000:0.0:1651529344.595027:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1078:39029:x1731745946458944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.595032:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba3ddc6f/0x3234de053c4ec88 lrc: 0/0,0 mode: --/PR res: [0x2b76a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d63ba expref: 989 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:0.0:1651529344.595033:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178031 count 1 00010000:00010000:0.0:1651529344.595037:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c515a1 lrc: 3/0,1 mode: --/PW res: [0x2b76f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595038:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.595039:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.595040:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000087c25fa6/0x3234de053c51577 lrc: 3/0,1 mode: PW/PW res: [0x2b76a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595041:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002c7a6b64/0x3234de053c4ce04 lrc: 2/0,0 mode: PR/PR res: [0x2b76f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce956 expref: 988 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.595043:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087c25fa6/0x3234de053c51577 lrc: 4/0,1 mode: PW/PW res: [0x2b76a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595044:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.595045:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.595046:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c515a1 lrc: 4/0,1 mode: --/PW res: [0x2b76f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595049:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.595052:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002c7a6b64/0x3234de053c4ce04 lrc: 3/0,0 mode: PR/PR res: [0x2b76f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce956 expref: 988 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.595056:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002c7a6b64/0x3234de053c4ce04 lrc: 4/0,0 mode: PR/PR res: [0x2b76f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce956 expref: 988 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.595057:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+988:41279:x1731746396339456:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 44us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.595059:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12359 00000100:00100000:0.0:1651529344.595060:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002f363f4a pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997008064:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.595067:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211584 00000100:00100000:1.0:1651529344.595069:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1078:39030:x1731745946459008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.595069:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c086aae3 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.595074:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178032 count 1 00010000:00010000:1.0:1651529344.595078:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dcc98c1/0x3234de053c515a8 lrc: 3/0,1 mode: --/PW res: [0x2b770:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595082:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000211d44dd/0x3234de053c4ca1b lrc: 2/0,0 mode: PR/PR res: [0x2b770:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda37 expref: 987 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.595085:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.595086:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.595086:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dcc98c1/0x3234de053c515a8 lrc: 4/0,1 mode: --/PW res: [0x2b770:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595093:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000211d44dd/0x3234de053c4ca1b lrc: 3/0,0 mode: PR/PR res: [0x2b770:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda37 expref: 987 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.595096:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000211d44dd/0x3234de053c4ca1b lrc: 4/0,0 mode: PR/PR res: [0x2b770:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda37 expref: 987 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.595096:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.595100:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000913beefe pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997008128:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.595117:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000567ee0ef going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.595117:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.595127:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000087c25fa6/0x3234de053c51577 lrc: 3/0,1 mode: PW/PW res: [0x2b76a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595130:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087c25fa6/0x3234de053c51577 lrc: 3/0,1 mode: PW/PW res: [0x2b76a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.595130:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.595138:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087c25fa6/0x3234de053c51577 lrc: 3/0,1 mode: PW/PW res: [0x2b76a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595141:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087c25fa6/0x3234de053c51577 lrc: 2/0,0 mode: PW/PW res: [0x2b76a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.595159:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.595174:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.595179:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087c25fa6/0x3234de053c51577 lrc: 2/0,0 mode: PW/PW res: [0x2b76a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595183:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000087c25fa6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.595184:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087c25fa6/0x3234de053c51577 lrc: 2/0,0 mode: PW/PW res: [0x2b76a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595187:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087c25fa6/0x3234de053c51577 lrc: 3/0,0 mode: PW/PW res: [0x2b76a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595192:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087c25fa6/0x3234de053c51577 lrc: 1/0,0 mode: --/PW res: [0x2b76a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595195:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087c25fa6/0x3234de053c51577 lrc: 0/0,0 mode: --/PW res: [0x2b76a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.595201:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1079:39029:x1731745946458304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 996us (1114us total) trans 12885079632 rc 0/0 00000100:00100000:1.0:1651529344.595205:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211577 00000100:00100000:1.0:1651529344.595213:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396339584 00010000:00010000:1.0:1651529344.595218:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000570bee5b/0x3234de053c4a061 lrc: 4/0,0 mode: PR/PR res: [0x2b76b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb75a expref: 988 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.595243:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396339520 00000100:00100000:0.0:1651529344.595244:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396339648 00010000:00010000:1.0:1651529344.595246:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002fb0278b/0x3234de053c4b553 lrc: 4/0,0 mode: PR/PR res: [0x2b769:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc274 expref: 990 pid: 106695 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.595250:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c4ec3b lrc: 4/0,0 mode: PR/PR res: [0x2b76c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d626a expref: 990 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.595251:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396339776 00010000:00010000:1.0:1651529344.595253:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000abb748bc/0x3234de053c4c831 lrc: 4/0,0 mode: PR/PR res: [0x2b76d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd2ea expref: 991 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.595256:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396339968 00000100:00100000:1.0:1651529344.595258:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12360 00010000:00010000:0.0:1651529344.595258:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004884fc72/0x3234de053c4e271 lrc: 5/0,0 mode: PR/PR res: [0x2b76e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b03 expref: 992 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.595260:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+992:41279:x1731746396339584:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.595262:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.595264:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000570bee5b/0x3234de053c4a061 lrc: 4/0,0 mode: PR/PR res: [0x2b76b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb75a expref: 992 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.595264:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12361 00000100:00100000:0.0:1651529344.595265:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+992:41278:x1731746396339520:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.595267:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000570bee5b/0x3234de053c4a061 lrc: 3/0,0 mode: PR/PR res: [0x2b76b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb75a expref: 992 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.595269:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.595270:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002fb0278b/0x3234de053c4b553 lrc: 4/0,0 mode: PR/PR res: [0x2b769:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc274 expref: 992 pid: 106695 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.595273:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000570bee5b/0x3234de053c4a061 lrc: 0/0,0 mode: --/PR res: [0x2b76b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb75a expref: 992 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.595274:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002fb0278b/0x3234de053c4b553 lrc: 3/0,0 mode: PR/PR res: [0x2b769:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc274 expref: 992 pid: 106695 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.595276:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.595277:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.595278:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf21e361/0x3234de053c51585 lrc: 3/0,1 mode: PW/PW res: [0x2b76b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595280:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fb0278b/0x3234de053c4b553 lrc: 0/0,0 mode: --/PR res: [0x2b769:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc274 expref: 991 pid: 106695 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.595281:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf21e361/0x3234de053c51585 lrc: 4/0,1 mode: PW/PW res: [0x2b76b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595283:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.595284:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.595285:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c5157e lrc: 3/0,1 mode: PW/PW res: [0x2b769:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595288:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.595288:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c5157e lrc: 4/0,1 mode: PW/PW res: [0x2b769:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595295:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.595300:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+990:41279:x1731746396339584:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 39us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.595303:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12360 00000100:00100000:1.0:1651529344.595308:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12362 00000100:00100000:0.0:1651529344.595308:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+989:41278:x1731746396339520:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.595309:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+989:41278:x1731746396339648:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.595311:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12361 00010000:00010000:1.0:1651529344.595312:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.595314:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c4ec3b lrc: 4/0,0 mode: PR/PR res: [0x2b76c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d626a expref: 989 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.595316:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12363 00010000:00010000:1.0:1651529344.595317:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c4ec3b lrc: 3/0,0 mode: PR/PR res: [0x2b76c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d626a expref: 988 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.595318:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+988:41278:x1731746396339776:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.595320:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.595322:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c4ec3b lrc: 0/0,0 mode: --/PR res: [0x2b76c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d626a expref: 988 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.595322:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000abb748bc/0x3234de053c4c831 lrc: 4/0,0 mode: PR/PR res: [0x2b76d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd2ea expref: 988 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.595326:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.595326:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.595327:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c5158c lrc: 3/0,1 mode: PW/PW res: [0x2b76c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595328:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000abb748bc/0x3234de053c4c831 lrc: 3/0,0 mode: PR/PR res: [0x2b76d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd2ea expref: 987 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.595330:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c5158c lrc: 4/0,1 mode: PW/PW res: [0x2b76c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595333:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abb748bc/0x3234de053c4c831 lrc: 0/0,0 mode: --/PR res: [0x2b76d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd2ea expref: 987 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.595338:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.595343:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+986:41278:x1731746396339648:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 34us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.595346:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12362 00000100:00100000:1.0:1651529344.595351:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12364 00000100:00100000:1.0:1651529344.595352:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+985:41278:x1731746396339968:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.595355:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.595356:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004884fc72/0x3234de053c4e271 lrc: 5/0,0 mode: PR/PR res: [0x2b76e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b03 expref: 985 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.595359:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004884fc72/0x3234de053c4e271 lrc: 4/0,0 mode: PR/PR res: [0x2b76e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b03 expref: 985 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.595364:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.595365:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.595365:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002c653241/0x3234de053c5159a lrc: 3/0,1 mode: PW/PW res: [0x2b76e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595368:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c653241/0x3234de053c5159a lrc: 4/0,1 mode: PW/PW res: [0x2b76e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595373:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.595374:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.595375:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005ec63a1b/0x3234de053c51593 lrc: 3/0,1 mode: PW/PW res: [0x2b76d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595379:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ec63a1b/0x3234de053c51593 lrc: 4/0,1 mode: PW/PW res: [0x2b76d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595381:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.595386:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+985:41278:x1731746396339968:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 33us (212us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.595389:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.595394:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12364 00000100:00100000:0.0:1651529344.595397:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+984:41278:x1731746396339776:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 78us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.595400:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12363 00010000:00010000:1.0:1651529344.595404:0:80279:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004884fc72/0x3234de053c4e271 lrc: 0/0,0 mode: --/PR res: [0x2b76e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b03 expref: 983 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.595407:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c5157e lrc: 3/0,1 mode: PW/PW res: [0x2b769:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.595408:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd68fdd5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997008000:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.595410:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c5157e lrc: 3/0,1 mode: PW/PW res: [0x2b769:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595412:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002c653241/0x3234de053c5159a lrc: 3/0,1 mode: PW/PW res: [0x2b76e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595414:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c5157e lrc: 3/0,1 mode: PW/PW res: [0x2b769:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595417:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002c653241/0x3234de053c5159a lrc: 3/0,1 mode: PW/PW res: [0x2b76e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595419:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c5157e lrc: 2/0,0 mode: PW/PW res: [0x2b769:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595420:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c653241/0x3234de053c5159a lrc: 3/0,1 mode: PW/PW res: [0x2b76e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595423:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c653241/0x3234de053c5159a lrc: 3/0,1 mode: PW/PW res: [0x2b76e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595426:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c653241/0x3234de053c5159a lrc: 2/0,0 mode: PW/PW res: [0x2b76e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.595464:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1080:39029:x1731745946458240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1254us (1369us total) trans 12885079633 rc 0/0 00000100:00100000:1.0:1651529344.595468:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1080:39030:x1731745946458816:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 946us (969us total) trans 12885079634 rc 0/0 00000100:00100000:0.0:1651529344.595468:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211578 00000100:00100000:1.0:1651529344.595471:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211582 00010000:00010000:0.0:1651529344.595474:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c5158c lrc: 3/0,1 mode: PW/PW res: [0x2b76c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595478:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bf21e361/0x3234de053c51585 lrc: 3/0,1 mode: PW/PW res: [0x2b76b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595478:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c5158c lrc: 3/0,1 mode: PW/PW res: [0x2b76c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595481:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf21e361/0x3234de053c51585 lrc: 3/0,1 mode: PW/PW res: [0x2b76b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595481:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c5158c lrc: 3/0,1 mode: PW/PW res: [0x2b76c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595483:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c5158c lrc: 2/0,0 mode: PW/PW res: [0x2b76c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595484:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf21e361/0x3234de053c51585 lrc: 3/0,1 mode: PW/PW res: [0x2b76b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595487:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf21e361/0x3234de053c51585 lrc: 2/0,0 mode: PW/PW res: [0x2b76b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.595517:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1080:39029:x1731745946458432:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1227us (1405us total) trans 12885079635 rc 0/0 00000100:00100000:1.0:1651529344.595519:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1080:39029:x1731745946458368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1248us (1415us total) trans 12885079636 rc 0/0 00000100:00100000:0.0:1651529344.595520:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211580 00000100:00100000:1.0:1651529344.595522:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211579 00010000:00010000:0.0:1651529344.595526:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c5157e lrc: 2/0,0 mode: PW/PW res: [0x2b769:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595530:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005ec63a1b/0x3234de053c51593 lrc: 3/0,1 mode: PW/PW res: [0x2b76d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595530:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004678bff1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.595531:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c5157e lrc: 2/0,0 mode: PW/PW res: [0x2b769:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595534:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ec63a1b/0x3234de053c51593 lrc: 3/0,1 mode: PW/PW res: [0x2b76d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595534:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c5157e lrc: 3/0,0 mode: PW/PW res: [0x2b769:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595537:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ec63a1b/0x3234de053c51593 lrc: 3/0,1 mode: PW/PW res: [0x2b76d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595539:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ec63a1b/0x3234de053c51593 lrc: 2/0,0 mode: PW/PW res: [0x2b76d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595539:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c5157e lrc: 1/0,0 mode: --/PW res: [0x2b769:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595541:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c5157e lrc: 0/0,0 mode: --/PW res: [0x2b769:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595546:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c653241/0x3234de053c5159a lrc: 2/0,0 mode: PW/PW res: [0x2b76e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595548:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002c653241 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.595549:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c653241/0x3234de053c5159a lrc: 2/0,0 mode: PW/PW res: [0x2b76e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595552:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c653241/0x3234de053c5159a lrc: 3/0,0 mode: PW/PW res: [0x2b76e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595555:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c653241/0x3234de053c5159a lrc: 1/0,0 mode: --/PW res: [0x2b76e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595557:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c653241/0x3234de053c5159a lrc: 0/0,0 mode: --/PW res: [0x2b76e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595561:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c5158c lrc: 2/0,0 mode: PW/PW res: [0x2b76c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595566:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000acc438d7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.595566:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c5158c lrc: 2/0,0 mode: PW/PW res: [0x2b76c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.595568:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1079:39029:x1731745946458496:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1253us (1411us total) trans 12885079637 rc 0/0 00010000:00010000:0.0:1651529344.595569:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c5158c lrc: 3/0,0 mode: PW/PW res: [0x2b76c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.595570:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211581 00010000:00010000:0.0:1651529344.595572:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c5158c lrc: 1/0,0 mode: --/PW res: [0x2b76c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595574:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c5158c lrc: 0/0,0 mode: --/PW res: [0x2b76c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595578:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf21e361/0x3234de053c51585 lrc: 2/0,0 mode: PW/PW res: [0x2b76b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595580:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bf21e361 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.595581:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf21e361/0x3234de053c51585 lrc: 2/0,0 mode: PW/PW res: [0x2b76b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595584:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf21e361/0x3234de053c51585 lrc: 3/0,0 mode: PW/PW res: [0x2b76b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595594:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf21e361/0x3234de053c51585 lrc: 1/0,0 mode: --/PW res: [0x2b76b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595597:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf21e361/0x3234de053c51585 lrc: 0/0,0 mode: --/PW res: [0x2b76b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.595601:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.595601:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ec63a1b/0x3234de053c51593 lrc: 2/0,0 mode: PW/PW res: [0x2b76d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595604:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005ec63a1b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.595605:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ec63a1b/0x3234de053c51593 lrc: 2/0,0 mode: PW/PW res: [0x2b76d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595607:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ec63a1b/0x3234de053c51593 lrc: 3/0,0 mode: PW/PW res: [0x2b76d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595610:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ec63a1b/0x3234de053c51593 lrc: 1/0,0 mode: --/PW res: [0x2b76d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595613:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ec63a1b/0x3234de053c51593 lrc: 0/0,0 mode: --/PW res: [0x2b76d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.595623:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.595624:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002f363f4a pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997008064:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.595627:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c515a1 lrc: 3/0,1 mode: --/PW res: [0x2b76f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.595631:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.595674:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396340160 00010000:00010000:1.0:1651529344.595684:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000211d44dd/0x3234de053c4ca1b lrc: 5/0,0 mode: PR/PR res: [0x2b770:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda37 expref: 983 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.595694:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396340096 00010000:00010000:1.0:1651529344.595697:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002c7a6b64/0x3234de053c4ce04 lrc: 4/0,0 mode: PR/PR res: [0x2b76f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce956 expref: 984 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.595704:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12365 00000100:00100000:1.0:1651529344.595706:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012f61efb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+984:41279:x1731746396340160:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.595709:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.595710:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000211d44dd/0x3234de053c4ca1b lrc: 5/0,0 mode: PR/PR res: [0x2b770:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda37 expref: 984 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.595713:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000211d44dd/0x3234de053c4ca1b lrc: 4/0,0 mode: PR/PR res: [0x2b770:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda37 expref: 984 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.595713:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12366 00000100:00100000:0.0:1651529344.595716:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+984:41279:x1731746396340096:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.595719:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.595719:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.595720:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.595720:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003dcc98c1/0x3234de053c515a8 lrc: 3/0,1 mode: PW/PW res: [0x2b770:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595721:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002c7a6b64/0x3234de053c4ce04 lrc: 4/0,0 mode: PR/PR res: [0x2b76f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce956 expref: 984 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.595723:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dcc98c1/0x3234de053c515a8 lrc: 4/0,1 mode: PW/PW res: [0x2b770:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595728:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.595728:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002c7a6b64/0x3234de053c4ce04 lrc: 3/0,0 mode: PR/PR res: [0x2b76f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce956 expref: 984 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.595733:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c7a6b64/0x3234de053c4ce04 lrc: 0/0,0 mode: --/PR res: [0x2b76f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce956 expref: 984 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.595749:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012f61efb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+984:41279:x1731746396340160:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.595752:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12365 00010000:00010000:0.0:1651529344.595764:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.595765:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.595766:0:72396:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000211d44dd/0x3234de053c4ca1b lrc: 0/0,0 mode: --/PR res: [0x2b770:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda37 expref: 982 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.595766:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c515a1 lrc: 3/0,1 mode: PW/PW res: [0x2b76f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595769:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c515a1 lrc: 4/0,1 mode: PW/PW res: [0x2b76f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.595770:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000913beefe pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997008128:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.595774:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003dcc98c1/0x3234de053c515a8 lrc: 3/0,1 mode: PW/PW res: [0x2b770:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595776:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.595777:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003dcc98c1/0x3234de053c515a8 lrc: 3/0,1 mode: PW/PW res: [0x2b770:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595780:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003dcc98c1/0x3234de053c515a8 lrc: 3/0,1 mode: PW/PW res: [0x2b770:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595783:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dcc98c1/0x3234de053c515a8 lrc: 3/0,1 mode: PW/PW res: [0x2b770:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.595784:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+981:41279:x1731746396340096:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 68us (152us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.595786:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003dcc98c1/0x3234de053c515a8 lrc: 2/0,0 mode: PW/PW res: [0x2b770:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.595786:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12366 00010000:00010000:0.0:1651529344.595801:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c515a1 lrc: 3/0,1 mode: PW/PW res: [0x2b76f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595804:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c515a1 lrc: 3/0,1 mode: PW/PW res: [0x2b76f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595808:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c515a1 lrc: 3/0,1 mode: PW/PW res: [0x2b76f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595813:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c515a1 lrc: 2/0,0 mode: PW/PW res: [0x2b76f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.595829:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1079:39030:x1731745946459008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 758us (862us total) trans 12885079638 rc 0/0 00000100:00100000:1.0:1651529344.595831:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211584 00000100:00100000:1.0:1651529344.595836:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946459200 00000100:00100000:1.0:1651529344.595842:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211585 00000100:00100000:1.0:1651529344.595843:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1080:39029:x1731745946459200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.595848:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178033 count 1 00010000:00010000:1.0:1651529344.595852:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ce8a004/0x3234de053c515af lrc: 3/0,1 mode: --/PW res: [0x2b771:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.595852:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1080:39029:x1731745946458944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 823us (906us total) trans 12885079639 rc 0/0 00000100:00100000:0.0:1651529344.595854:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211583 00010000:00010000:1.0:1651529344.595856:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e5280238/0x3234de053c4ec6c lrc: 2/0,0 mode: PR/PR res: [0x2b771:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d635f expref: 980 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.595862:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.595862:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.595863:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ce8a004/0x3234de053c515af lrc: 4/0,1 mode: --/PW res: [0x2b771:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595869:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e5280238/0x3234de053c4ec6c lrc: 3/0,0 mode: PR/PR res: [0x2b771:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d635f expref: 980 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.595873:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e5280238/0x3234de053c4ec6c lrc: 4/0,0 mode: PR/PR res: [0x2b771:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d635f expref: 980 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.595877:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000913beefe pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997008192:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.595885:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 0000000071742acc going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.595887:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003dcc98c1/0x3234de053c515a8 lrc: 2/0,0 mode: PW/PW res: [0x2b770:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595891:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003dcc98c1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.595892:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003dcc98c1/0x3234de053c515a8 lrc: 2/0,0 mode: PW/PW res: [0x2b770:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595895:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003dcc98c1/0x3234de053c515a8 lrc: 3/0,0 mode: PW/PW res: [0x2b770:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595900:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003dcc98c1/0x3234de053c515a8 lrc: 1/0,0 mode: --/PW res: [0x2b770:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595911:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003dcc98c1/0x3234de053c515a8 lrc: 0/0,0 mode: --/PW res: [0x2b770:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595915:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c515a1 lrc: 2/0,0 mode: PW/PW res: [0x2b76f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595918:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000073043e99 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.595919:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c515a1 lrc: 2/0,0 mode: PW/PW res: [0x2b76f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595922:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c515a1 lrc: 3/0,0 mode: PW/PW res: [0x2b76f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.595924:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.595926:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c515a1 lrc: 1/0,0 mode: --/PW res: [0x2b76f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.595928:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c515a1 lrc: 0/0,0 mode: --/PW res: [0x2b76f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.595940:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946459520 00000100:00100000:1.0:1651529344.595953:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211586 00000100:00100000:1.0:1651529344.595955:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1080:39030:x1731745946459520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.595960:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178034 count 1 00010000:00010000:1.0:1651529344.595970:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bc4e419/0x3234de053c515b6 lrc: 3/0,1 mode: --/PW res: [0x2b772:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595975:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000034f81b17/0x3234de053c4a014 lrc: 2/0,0 mode: PR/PR res: [0x2b772:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5ee expref: 980 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.595984:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.595984:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.595985:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005bc4e419/0x3234de053c515b6 lrc: 4/0,1 mode: --/PW res: [0x2b772:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.595992:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000034f81b17/0x3234de053c4a014 lrc: 3/0,0 mode: PR/PR res: [0x2b772:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5ee expref: 980 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.595996:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000034f81b17/0x3234de053c4a014 lrc: 4/0,0 mode: PR/PR res: [0x2b772:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5ee expref: 980 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.596000:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000264aecf8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997008256:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.596014:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 000000007d8fabda going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.596024:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.596040:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.596049:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.596049:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946459584 00000100:00100000:1.0:1651529344.596057:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.596057:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946459712 00000100:00100000:0.0:1651529344.596061:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946459648 00000100:00100000:1.0:1651529344.596063:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946459776 00000100:00100000:1.0:1651529344.596078:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211587 00000100:00100000:1.0:1651529344.596080:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1084:39029:x1731745946459584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.596085:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178035 count 1 00010000:00010000:1.0:1651529344.596088:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009203d64e/0x3234de053c515bd lrc: 3/0,1 mode: --/PW res: [0x2b773:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.596092:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211588 00010000:00010000:1.0:1651529344.596093:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000042c1773e/0x3234de053c4ab58 lrc: 2/0,0 mode: PR/PR res: [0x2b773:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbdea expref: 980 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.596094:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1084:39029:x1731745946459712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.596096:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.596097:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.596097:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009203d64e/0x3234de053c515bd lrc: 4/0,1 mode: --/PW res: [0x2b773:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.596100:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178037 count 1 00010000:00010000:1.0:1651529344.596104:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000042c1773e/0x3234de053c4ab58 lrc: 3/0,0 mode: PR/PR res: [0x2b773:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbdea expref: 980 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.596104:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c515c4 lrc: 3/0,1 mode: --/PW res: [0x2b775:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.596108:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000042c1773e/0x3234de053c4ab58 lrc: 4/0,0 mode: PR/PR res: [0x2b773:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbdea expref: 980 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.596109:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000028584103/0x3234de053c4e423 lrc: 2/0,0 mode: PR/PR res: [0x2b775:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d419a expref: 980 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.596111:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006aa45e66 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997008320:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.596112:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.596113:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.596113:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c515c4 lrc: 4/0,1 mode: --/PW res: [0x2b775:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.596122:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cfa1ca05 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.596123:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000028584103/0x3234de053c4e423 lrc: 3/0,0 mode: PR/PR res: [0x2b775:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d419a expref: 980 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.596127:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211589 00010000:00010000:0.0:1651529344.596127:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000028584103/0x3234de053c4e423 lrc: 4/0,0 mode: PR/PR res: [0x2b775:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d419a expref: 980 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.596129:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1084:39029:x1731745946459648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.596131:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004972eb27 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997008384:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.596133:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178036 count 1 00010000:00010000:1.0:1651529344.596136:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018c74a51/0x3234de053c515cb lrc: 3/0,1 mode: --/PW res: [0x2b774:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.596140:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000837ab3ca/0x3234de053c4f207 lrc: 2/0,0 mode: PR/PR res: [0x2b774:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7aea expref: 980 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.596143:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.596144:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.596144:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018c74a51/0x3234de053c515cb lrc: 4/0,1 mode: --/PW res: [0x2b774:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.596150:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000837ab3ca/0x3234de053c4f207 lrc: 3/0,0 mode: PR/PR res: [0x2b774:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7aea expref: 980 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.596154:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000837ab3ca/0x3234de053c4f207 lrc: 4/0,0 mode: PR/PR res: [0x2b774:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7aea expref: 980 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.596154:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 000000000a4def41 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.596158:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bca72234 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997008448:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.596162:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211590 00000100:00100000:1.0:1651529344.596164:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 0000000099c1da85 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.596164:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1084:39029:x1731745946459776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.596188:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.596189:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178038 count 1 00010000:00010000:0.0:1651529344.596193:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c515d2 lrc: 3/0,1 mode: --/PW res: [0x2b776:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.596198:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000030404887/0x3234de053c4f587 lrc: 2/0,0 mode: PR/PR res: [0x2b776:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d888f expref: 980 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.596201:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.596201:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.596202:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c515d2 lrc: 4/0,1 mode: --/PW res: [0x2b776:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.596209:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000030404887/0x3234de053c4f587 lrc: 3/0,0 mode: PR/PR res: [0x2b776:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d888f expref: 980 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.596212:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000030404887/0x3234de053c4f587 lrc: 4/0,0 mode: PR/PR res: [0x2b776:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d888f expref: 980 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.596217:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005cc6463a pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997008512:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.596220:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.596242:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000003003c8b0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.596248:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946459840 00000100:00100000:0.0:1651529344.596255:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946460096 00000100:00100000:0.0:1651529344.596259:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211591 00000100:00100000:0.0:1651529344.596261:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1086:39029:x1731745946459840:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.596266:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178039 count 1 00010000:00010000:0.0:1651529344.596281:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c515d9 lrc: 3/0,1 mode: --/PW res: [0x2b777:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.596286:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000083b7e42d/0x3234de053c4f39d lrc: 2/0,0 mode: PR/PR res: [0x2b777:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8126 expref: 980 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.596289:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.596290:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.596290:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c515d9 lrc: 4/0,1 mode: --/PW res: [0x2b777:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.596295:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.596297:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000083b7e42d/0x3234de053c4f39d lrc: 3/0,0 mode: PR/PR res: [0x2b777:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8126 expref: 980 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.596300:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000083b7e42d/0x3234de053c4f39d lrc: 4/0,0 mode: PR/PR res: [0x2b777:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8126 expref: 980 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.596304:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.596304:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003e3f0f77 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997008576:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.596312:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211592 00000100:00100000:1.0:1651529344.596313:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1086:39029:x1731745946460096:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.596325:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178040 count 1 00010000:00010000:1.0:1651529344.596329:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac93cd8e/0x3234de053c515e0 lrc: 3/0,1 mode: --/PW res: [0x2b778:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.596331:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c2b2b59c going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.596334:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000052ea5946/0x3234de053c4f2bd lrc: 2/0,0 mode: PR/PR res: [0x2b778:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7de5 expref: 980 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.596337:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.596338:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.596338:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac93cd8e/0x3234de053c515e0 lrc: 4/0,1 mode: --/PW res: [0x2b778:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.596345:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000052ea5946/0x3234de053c4f2bd lrc: 3/0,0 mode: PR/PR res: [0x2b778:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7de5 expref: 980 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.596348:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000052ea5946/0x3234de053c4f2bd lrc: 4/0,0 mode: PR/PR res: [0x2b778:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7de5 expref: 980 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.596355:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997008640:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.596375:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fe434b1c going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.596383:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000913beefe pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997008192:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.596387:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009ce8a004/0x3234de053c515af lrc: 3/0,1 mode: --/PW res: [0x2b771:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.596405:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396340416 00010000:00010000:1.0:1651529344.596410:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e5280238/0x3234de053c4ec6c lrc: 4/0,0 mode: PR/PR res: [0x2b771:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d635f expref: 981 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.596420:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396340480 00010000:00010000:1.0:1651529344.596423:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000034f81b17/0x3234de053c4a014 lrc: 5/0,0 mode: PR/PR res: [0x2b772:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5ee expref: 982 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.596429:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12367 00000100:00100000:1.0:1651529344.596431:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+982:41279:x1731746396340416:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.596434:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.596440:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e5280238/0x3234de053c4ec6c lrc: 4/0,0 mode: PR/PR res: [0x2b771:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d635f expref: 982 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.596444:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e5280238/0x3234de053c4ec6c lrc: 3/0,0 mode: PR/PR res: [0x2b771:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d635f expref: 982 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.596450:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5280238/0x3234de053c4ec6c lrc: 0/0,0 mode: --/PR res: [0x2b771:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d635f expref: 982 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.596459:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004972eb27 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997008384:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.596460:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.596461:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.596461:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009ce8a004/0x3234de053c515af lrc: 3/0,1 mode: PW/PW res: [0x2b771:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.596464:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c515c4 lrc: 3/0,1 mode: --/PW res: [0x2b775:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.596465:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ce8a004/0x3234de053c515af lrc: 4/0,1 mode: PW/PW res: [0x2b771:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.596471:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.596471:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12368 00000100:00100000:0.0:1651529344.596473:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+981:41278:x1731746396340480:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.596476:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.596478:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000034f81b17/0x3234de053c4a014 lrc: 5/0,0 mode: PR/PR res: [0x2b772:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5ee expref: 981 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.596482:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+981:41279:x1731746396340416:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 50us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.596485:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12367 00010000:00010000:0.0:1651529344.596488:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000034f81b17/0x3234de053c4a014 lrc: 4/0,0 mode: PR/PR res: [0x2b772:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5ee expref: 980 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.596494:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.596495:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.596496:0:80278:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034f81b17/0x3234de053c4a014 lrc: 0/0,0 mode: --/PR res: [0x2b772:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5ee expref: 980 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.596496:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005bc4e419/0x3234de053c515b6 lrc: 3/0,1 mode: PW/PW res: [0x2b772:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.596499:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005bc4e419/0x3234de053c515b6 lrc: 4/0,1 mode: PW/PW res: [0x2b772:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.596500:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000264aecf8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997008256:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.596503:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.596504:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005bc4e419/0x3234de053c515b6 lrc: 3/0,1 mode: PW/PW res: [0x2b772:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.596507:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005bc4e419/0x3234de053c515b6 lrc: 3/0,1 mode: PW/PW res: [0x2b772:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.596510:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005bc4e419/0x3234de053c515b6 lrc: 3/0,1 mode: PW/PW res: [0x2b772:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.596510:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+979:41278:x1731746396340480:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 36us (206us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.596513:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bc4e419/0x3234de053c515b6 lrc: 3/0,1 mode: PW/PW res: [0x2b772:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.596513:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12368 00010000:00010000:1.0:1651529344.596516:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005bc4e419/0x3234de053c515b6 lrc: 2/0,0 mode: PW/PW res: [0x2b772:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.596548:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005bc4e419/0x3234de053c515b6 lrc: 2/0,0 mode: PW/PW res: [0x2b772:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.596552:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005bc4e419 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.596553:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005bc4e419/0x3234de053c515b6 lrc: 2/0,0 mode: PW/PW res: [0x2b772:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.596556:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005bc4e419/0x3234de053c515b6 lrc: 3/0,0 mode: PW/PW res: [0x2b772:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.596561:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005bc4e419/0x3234de053c515b6 lrc: 1/0,0 mode: --/PW res: [0x2b772:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.596564:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005bc4e419/0x3234de053c515b6 lrc: 0/0,0 mode: --/PW res: [0x2b772:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.596572:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1087:39030:x1731745946459520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 616us (648us total) trans 12885079640 rc 0/0 00000100:00100000:1.0:1651529344.596575:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211586 00000100:00100000:1.0:1651529344.596585:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006aa45e66 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997008320:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.596589:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009203d64e/0x3234de053c515bd lrc: 3/0,1 mode: --/PW res: [0x2b773:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.596603:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009ce8a004/0x3234de053c515af lrc: 3/0,1 mode: PW/PW res: [0x2b771:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.596606:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ce8a004/0x3234de053c515af lrc: 3/0,1 mode: PW/PW res: [0x2b771:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.596609:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ce8a004/0x3234de053c515af lrc: 3/0,1 mode: PW/PW res: [0x2b771:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.596612:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ce8a004/0x3234de053c515af lrc: 2/0,0 mode: PW/PW res: [0x2b771:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.596623:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ce8a004/0x3234de053c515af lrc: 2/0,0 mode: PW/PW res: [0x2b771:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.596626:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009ce8a004 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.596627:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ce8a004/0x3234de053c515af lrc: 2/0,0 mode: PW/PW res: [0x2b771:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.596630:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ce8a004/0x3234de053c515af lrc: 3/0,0 mode: PW/PW res: [0x2b771:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.596634:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ce8a004/0x3234de053c515af lrc: 1/0,0 mode: --/PW res: [0x2b771:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.596637:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ce8a004/0x3234de053c515af lrc: 0/0,0 mode: --/PW res: [0x2b771:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.596654:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1087:39029:x1731745946459200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 809us (1053us total) trans 12885079641 rc 0/0 00000100:00100000:1.0:1651529344.596657:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211585 00000100:00100000:1.0:1651529344.596774:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.596776:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.596784:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bca72234 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997008448:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.596788:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000018c74a51/0x3234de053c515cb lrc: 3/0,1 mode: --/PW res: [0x2b774:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.596794:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946460288 00000100:00100000:1.0:1651529344.596801:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211593 00000100:00100000:1.0:1651529344.596802:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d5e5262 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1087:39030:x1731745946460288:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.596820:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178041 count 1 00010000:00010000:1.0:1651529344.596825:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a2d126a/0x3234de053c515e7 lrc: 3/0,1 mode: --/PW res: [0x2b779:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.596829:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000be185979/0x3234de053c4ea9e lrc: 2/0,0 mode: PR/PR res: [0x2b779:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c43 expref: 978 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.596845:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.596846:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.596847:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a2d126a/0x3234de053c515e7 lrc: 4/0,1 mode: --/PW res: [0x2b779:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.596854:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000be185979/0x3234de053c4ea9e lrc: 3/0,0 mode: PR/PR res: [0x2b779:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c43 expref: 978 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.596857:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000be185979/0x3234de053c4ea9e lrc: 4/0,0 mode: PR/PR res: [0x2b779:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c43 expref: 978 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.596861:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.596862:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ef7d105 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997008704:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.596880:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.596882:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000567ee0ef going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.596892:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946460352 00000100:00100000:1.0:1651529344.596909:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211594 00000100:00100000:1.0:1651529344.596910:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1088:39030:x1731745946460352:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.596912:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:1.0:1651529344.596915:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178042 count 1 00000100:00100000:0.0:1651529344.596923:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.596925:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fcb879f/0x3234de053c515ee lrc: 3/0,1 mode: --/PW res: [0x2b77a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.596932:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.596934:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000485752e5/0x3234de053c4c68d lrc: 2/0,0 mode: PR/PR res: [0x2b77a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc29 expref: 978 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.596937:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.596937:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.596938:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.596938:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fcb879f/0x3234de053c515ee lrc: 4/0,1 mode: --/PW res: [0x2b77a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.596945:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000485752e5/0x3234de053c4c68d lrc: 3/0,0 mode: PR/PR res: [0x2b77a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc29 expref: 978 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.596947:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005cc6463a pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997008512:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.596948:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000485752e5/0x3234de053c4c68d lrc: 4/0,0 mode: PR/PR res: [0x2b77a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc29 expref: 978 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.596951:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c515d2 lrc: 3/0,1 mode: --/PW res: [0x2b776:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.596952:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997008768:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.596958:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003e3f0f77 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997008576:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.596961:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c515d9 lrc: 3/0,1 mode: --/PW res: [0x2b777:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.596965:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d09f5ee1 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.596972:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997008640:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.596976:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ac93cd8e/0x3234de053c515e0 lrc: 3/0,1 mode: --/PW res: [0x2b778:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.596985:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396340800 00000100:00100000:0.0:1651529344.596992:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396340736 00010000:00010000:1.0:1651529344.596997:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000042c1773e/0x3234de053c4ab58 lrc: 4/0,0 mode: PR/PR res: [0x2b773:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbdea expref: 980 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.596998:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000028584103/0x3234de053c4e423 lrc: 4/0,0 mode: PR/PR res: [0x2b775:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d419a expref: 980 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.597003:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396340928 00000100:00100000:0.0:1651529344.597004:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396340864 00010000:00010000:1.0:1651529344.597006:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000030404887/0x3234de053c4f587 lrc: 4/0,0 mode: PR/PR res: [0x2b776:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d888f expref: 982 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.597006:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000837ab3ca/0x3234de053c4f207 lrc: 4/0,0 mode: PR/PR res: [0x2b774:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7aea expref: 982 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.597011:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396341056 00000100:00100000:0.0:1651529344.597011:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396340992 00010000:00010000:1.0:1651529344.597013:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000052ea5946/0x3234de053c4f2bd lrc: 4/0,0 mode: PR/PR res: [0x2b778:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7de5 expref: 984 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.597013:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000083b7e42d/0x3234de053c4f39d lrc: 4/0,0 mode: PR/PR res: [0x2b777:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8126 expref: 984 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.597018:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12369 00000100:00100000:1.0:1651529344.597019:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+984:41278:x1731746396340800:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.597021:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12370 00010000:00010000:1.0:1651529344.597022:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.597023:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000042c1773e/0x3234de053c4ab58 lrc: 4/0,0 mode: PR/PR res: [0x2b773:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbdea expref: 984 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.597023:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+984:41278:x1731746396340736:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.597026:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.597027:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000042c1773e/0x3234de053c4ab58 lrc: 3/0,0 mode: PR/PR res: [0x2b773:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbdea expref: 984 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.597027:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000028584103/0x3234de053c4e423 lrc: 4/0,0 mode: PR/PR res: [0x2b775:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d419a expref: 984 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.597032:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042c1773e/0x3234de053c4ab58 lrc: 0/0,0 mode: --/PR res: [0x2b773:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbdea expref: 984 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.597036:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.597037:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.597037:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009203d64e/0x3234de053c515bd lrc: 3/0,1 mode: PW/PW res: [0x2b773:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597040:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009203d64e/0x3234de053c515bd lrc: 4/0,1 mode: PW/PW res: [0x2b773:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597045:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000028584103/0x3234de053c4e423 lrc: 3/0,0 mode: PR/PR res: [0x2b775:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d419a expref: 983 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.597047:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.597051:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028584103/0x3234de053c4e423 lrc: 0/0,0 mode: --/PR res: [0x2b775:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d419a expref: 983 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.597055:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.597056:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.597059:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+982:41278:x1731746396340800:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 39us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.597062:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12369 00000100:00100000:1.0:1651529344.597067:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12371 00000100:00100000:1.0:1651529344.597069:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+981:41278:x1731746396340928:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.597071:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.597072:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c515c4 lrc: 3/0,1 mode: PW/PW res: [0x2b775:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597073:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000030404887/0x3234de053c4f587 lrc: 4/0,0 mode: PR/PR res: [0x2b776:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d888f expref: 981 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.597076:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000030404887/0x3234de053c4f587 lrc: 3/0,0 mode: PR/PR res: [0x2b776:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d888f expref: 981 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.597076:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c515c4 lrc: 4/0,1 mode: PW/PW res: [0x2b775:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597081:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030404887/0x3234de053c4f587 lrc: 0/0,0 mode: --/PR res: [0x2b776:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d888f expref: 981 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.597085:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.597085:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.597086:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c515d2 lrc: 3/0,1 mode: PW/PW res: [0x2b776:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597091:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c515d2 lrc: 4/0,1 mode: PW/PW res: [0x2b776:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597091:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.597099:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.597105:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+980:41278:x1731746396340928:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.597105:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+980:41278:x1731746396340736:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 81us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.597107:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12371 00000100:00100000:0.0:1651529344.597109:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12370 00000100:00100000:1.0:1651529344.597111:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12372 00000100:00100000:1.0:1651529344.597113:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001cec52dd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+978:41279:x1731746396340864:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.597115:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.597115:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12373 00010000:00010000:1.0:1651529344.597116:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000837ab3ca/0x3234de053c4f207 lrc: 4/0,0 mode: PR/PR res: [0x2b774:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7aea expref: 978 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.597117:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+978:41278:x1731746396341056:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.597119:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.597120:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000837ab3ca/0x3234de053c4f207 lrc: 3/0,0 mode: PR/PR res: [0x2b774:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7aea expref: 978 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.597121:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000052ea5946/0x3234de053c4f2bd lrc: 4/0,0 mode: PR/PR res: [0x2b778:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7de5 expref: 978 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.597124:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000837ab3ca/0x3234de053c4f207 lrc: 0/0,0 mode: --/PR res: [0x2b774:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7aea expref: 978 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.597125:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000052ea5946/0x3234de053c4f2bd lrc: 3/0,0 mode: PR/PR res: [0x2b778:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7de5 expref: 978 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.597128:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.597128:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.597129:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000018c74a51/0x3234de053c515cb lrc: 3/0,1 mode: PW/PW res: [0x2b774:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597130:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052ea5946/0x3234de053c4f2bd lrc: 0/0,0 mode: --/PR res: [0x2b778:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7de5 expref: 977 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.597132:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018c74a51/0x3234de053c515cb lrc: 4/0,1 mode: PW/PW res: [0x2b774:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597133:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.597134:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.597135:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ac93cd8e/0x3234de053c515e0 lrc: 3/0,1 mode: PW/PW res: [0x2b778:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597138:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac93cd8e/0x3234de053c515e0 lrc: 4/0,1 mode: PW/PW res: [0x2b778:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597140:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.597144:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001cec52dd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+976:41279:x1731746396340864:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 31us (221us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.597148:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.597153:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12372 00000100:00100000:0.0:1651529344.597154:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+976:41278:x1731746396341056:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.597156:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12373 00000100:00100000:0.0:1651529344.597161:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12374 00000100:00100000:0.0:1651529344.597163:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+974:41279:x1731746396340992:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.597165:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.597166:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000083b7e42d/0x3234de053c4f39d lrc: 4/0,0 mode: PR/PR res: [0x2b777:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8126 expref: 974 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.597167:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009203d64e/0x3234de053c515bd lrc: 3/0,1 mode: PW/PW res: [0x2b773:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597170:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009203d64e/0x3234de053c515bd lrc: 3/0,1 mode: PW/PW res: [0x2b773:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597172:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000083b7e42d/0x3234de053c4f39d lrc: 3/0,0 mode: PR/PR res: [0x2b777:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8126 expref: 974 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.597173:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009203d64e/0x3234de053c515bd lrc: 3/0,1 mode: PW/PW res: [0x2b773:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597176:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009203d64e/0x3234de053c515bd lrc: 2/0,0 mode: PW/PW res: [0x2b773:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597177:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083b7e42d/0x3234de053c4f39d lrc: 0/0,0 mode: --/PR res: [0x2b777:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8126 expref: 974 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.597180:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.597181:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.597181:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c515d9 lrc: 3/0,1 mode: PW/PW res: [0x2b777:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597191:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c515d9 lrc: 4/0,1 mode: PW/PW res: [0x2b777:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597218:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.597219:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1089:39029:x1731745946459584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1138us (1195us total) trans 12885079642 rc 0/0 00000100:00100000:1.0:1651529344.597236:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211587 00000100:00100000:0.0:1651529344.597237:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+973:41279:x1731746396340992:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 73us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.597240:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12374 00010000:00010000:1.0:1651529344.597243:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000018c74a51/0x3234de053c515cb lrc: 3/0,1 mode: PW/PW res: [0x2b774:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597246:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018c74a51/0x3234de053c515cb lrc: 3/0,1 mode: PW/PW res: [0x2b774:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597247:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c515d2 lrc: 3/0,1 mode: PW/PW res: [0x2b776:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597249:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018c74a51/0x3234de053c515cb lrc: 3/0,1 mode: PW/PW res: [0x2b774:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597250:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c515d2 lrc: 3/0,1 mode: PW/PW res: [0x2b776:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597252:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000018c74a51/0x3234de053c515cb lrc: 2/0,0 mode: PW/PW res: [0x2b774:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597254:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c515d2 lrc: 3/0,1 mode: PW/PW res: [0x2b776:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597265:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c515d2 lrc: 2/0,0 mode: PW/PW res: [0x2b776:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.597289:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1090:39029:x1731745946459648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1159us (1240us total) trans 12885079643 rc 0/0 00000100:00100000:1.0:1651529344.597292:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211589 00010000:00010000:1.0:1651529344.597298:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ac93cd8e/0x3234de053c515e0 lrc: 3/0,1 mode: PW/PW res: [0x2b778:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597302:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac93cd8e/0x3234de053c515e0 lrc: 3/0,1 mode: PW/PW res: [0x2b778:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597305:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac93cd8e/0x3234de053c515e0 lrc: 3/0,1 mode: PW/PW res: [0x2b778:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597307:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac93cd8e/0x3234de053c515e0 lrc: 2/0,0 mode: PW/PW res: [0x2b778:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.597307:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1089:39029:x1731745946459776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1143us (1250us total) trans 12885079644 rc 0/0 00000100:00100000:0.0:1651529344.597310:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211590 00010000:00010000:0.0:1651529344.597318:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009203d64e/0x3234de053c515bd lrc: 2/0,0 mode: PW/PW res: [0x2b773:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597321:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009203d64e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.597322:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009203d64e/0x3234de053c515bd lrc: 2/0,0 mode: PW/PW res: [0x2b773:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597325:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009203d64e/0x3234de053c515bd lrc: 3/0,0 mode: PW/PW res: [0x2b773:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597330:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009203d64e/0x3234de053c515bd lrc: 1/0,0 mode: --/PW res: [0x2b773:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597333:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009203d64e/0x3234de053c515bd lrc: 0/0,0 mode: --/PW res: [0x2b773:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.597337:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1089:39029:x1731745946460096:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1023us (1117us total) trans 12885079645 rc 0/0 00010000:00010000:0.0:1651529344.597337:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000018c74a51/0x3234de053c515cb lrc: 2/0,0 mode: PW/PW res: [0x2b774:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.597340:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211592 00010000:00010000:0.0:1651529344.597340:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000018c74a51 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.597341:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000018c74a51/0x3234de053c515cb lrc: 2/0,0 mode: PW/PW res: [0x2b774:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597344:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000018c74a51/0x3234de053c515cb lrc: 3/0,0 mode: PW/PW res: [0x2b774:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597347:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000018c74a51/0x3234de053c515cb lrc: 1/0,0 mode: --/PW res: [0x2b774:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597350:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018c74a51/0x3234de053c515cb lrc: 0/0,0 mode: --/PW res: [0x2b774:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597353:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c515d2 lrc: 2/0,0 mode: PW/PW res: [0x2b776:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597355:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5c1b0ba already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.597356:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c515d2 lrc: 2/0,0 mode: PW/PW res: [0x2b776:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597359:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c515d2 lrc: 3/0,0 mode: PW/PW res: [0x2b776:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597362:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c515d2 lrc: 1/0,0 mode: --/PW res: [0x2b776:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597364:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c515d2 lrc: 0/0,0 mode: --/PW res: [0x2b776:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597368:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac93cd8e/0x3234de053c515e0 lrc: 2/0,0 mode: PW/PW res: [0x2b778:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597371:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ac93cd8e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.597372:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac93cd8e/0x3234de053c515e0 lrc: 2/0,0 mode: PW/PW res: [0x2b778:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597374:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac93cd8e/0x3234de053c515e0 lrc: 3/0,0 mode: PW/PW res: [0x2b778:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597377:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac93cd8e/0x3234de053c515e0 lrc: 1/0,0 mode: --/PW res: [0x2b778:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597380:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac93cd8e/0x3234de053c515e0 lrc: 0/0,0 mode: --/PW res: [0x2b778:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597385:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c515d9 lrc: 3/0,1 mode: PW/PW res: [0x2b777:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597387:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c515d9 lrc: 3/0,1 mode: PW/PW res: [0x2b777:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597390:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c515d9 lrc: 3/0,1 mode: PW/PW res: [0x2b777:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597393:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c515d9 lrc: 2/0,0 mode: PW/PW res: [0x2b777:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.597395:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.597409:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.597435:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1089:39029:x1731745946459840:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1174us (1247us total) trans 12885079646 rc 0/0 00000100:00100000:0.0:1651529344.597439:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211591 00010000:00010000:0.0:1651529344.597446:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c515d9 lrc: 2/0,0 mode: PW/PW res: [0x2b777:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597449:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000037fb8315 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.597450:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c515d9 lrc: 2/0,0 mode: PW/PW res: [0x2b777:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597453:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c515d9 lrc: 3/0,0 mode: PW/PW res: [0x2b777:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597457:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c515d9 lrc: 1/0,0 mode: --/PW res: [0x2b777:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597460:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c515d9 lrc: 0/0,0 mode: --/PW res: [0x2b777:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597467:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c515c4 lrc: 3/0,1 mode: PW/PW res: [0x2b775:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597470:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c515c4 lrc: 3/0,1 mode: PW/PW res: [0x2b775:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597473:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c515c4 lrc: 3/0,1 mode: PW/PW res: [0x2b775:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597475:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c515c4 lrc: 2/0,0 mode: PW/PW res: [0x2b775:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.597503:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396341376 00010000:00010000:1.0:1651529344.597509:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000be185979/0x3234de053c4ea9e lrc: 5/0,0 mode: PR/PR res: [0x2b779:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c43 expref: 973 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.597519:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396341440 00010000:00010000:1.0:1651529344.597521:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000485752e5/0x3234de053c4c68d lrc: 5/0,0 mode: PR/PR res: [0x2b77a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc29 expref: 974 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.597527:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12375 00000100:00100000:1.0:1651529344.597528:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+974:41278:x1731746396341376:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.597531:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.597533:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000be185979/0x3234de053c4ea9e lrc: 5/0,0 mode: PR/PR res: [0x2b779:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c43 expref: 974 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.597542:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000be185979/0x3234de053c4ea9e lrc: 4/0,0 mode: PR/PR res: [0x2b779:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c43 expref: 974 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.597547:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1089:39029:x1731745946459712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1452us (1514us total) trans 12885079647 rc 0/0 00010000:00010000:1.0:1651529344.597548:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.597549:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.597550:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000a2d126a/0x3234de053c515e7 lrc: 3/0,1 mode: PW/PW res: [0x2b779:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.597550:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211588 00010000:00010000:1.0:1651529344.597553:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a2d126a/0x3234de053c515e7 lrc: 4/0,1 mode: PW/PW res: [0x2b779:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597557:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.597558:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c515c4 lrc: 2/0,0 mode: PW/PW res: [0x2b775:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597561:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000495c20c9 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.597562:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c515c4 lrc: 2/0,0 mode: PW/PW res: [0x2b775:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.597564:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+974:41278:x1731746396341376:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (170us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.597565:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c515c4 lrc: 3/0,0 mode: PW/PW res: [0x2b775:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.597567:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12375 00010000:00010000:0.0:1651529344.597569:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c515c4 lrc: 1/0,0 mode: --/PW res: [0x2b775:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.597571:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12376 00010000:00010000:0.0:1651529344.597572:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c515c4 lrc: 0/0,0 mode: --/PW res: [0x2b775:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.597573:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+973:41278:x1731746396341440:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.597575:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.597577:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000485752e5/0x3234de053c4c68d lrc: 5/0,0 mode: PR/PR res: [0x2b77a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc29 expref: 973 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.597580:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000485752e5/0x3234de053c4c68d lrc: 4/0,0 mode: PR/PR res: [0x2b77a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc29 expref: 973 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.597584:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.597585:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.597585:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009fcb879f/0x3234de053c515ee lrc: 3/0,1 mode: PW/PW res: [0x2b77a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597588:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fcb879f/0x3234de053c515ee lrc: 4/0,1 mode: PW/PW res: [0x2b77a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597592:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.597604:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+973:41278:x1731746396341440:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 22us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.597607:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12376 00010000:00010000:1.0:1651529344.597617:0:80278:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000485752e5/0x3234de053c4c68d lrc: 0/0,0 mode: --/PR res: [0x2b77a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc29 expref: 972 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.597628:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997008768:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.597632:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009fcb879f/0x3234de053c515ee lrc: 3/0,1 mode: PW/PW res: [0x2b77a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597637:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009fcb879f/0x3234de053c515ee lrc: 3/0,1 mode: PW/PW res: [0x2b77a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597640:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fcb879f/0x3234de053c515ee lrc: 3/0,1 mode: PW/PW res: [0x2b77a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597643:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fcb879f/0x3234de053c515ee lrc: 3/0,1 mode: PW/PW res: [0x2b77a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597646:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009fcb879f/0x3234de053c515ee lrc: 2/0,0 mode: PW/PW res: [0x2b77a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.597648:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.597656:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.597670:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.597679:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.597687:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.597695:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009fcb879f/0x3234de053c515ee lrc: 2/0,0 mode: PW/PW res: [0x2b77a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597701:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009fcb879f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.597702:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009fcb879f/0x3234de053c515ee lrc: 2/0,0 mode: PW/PW res: [0x2b77a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597705:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009fcb879f/0x3234de053c515ee lrc: 3/0,0 mode: PW/PW res: [0x2b77a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.597711:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1089:39030:x1731745946460352:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 799us (866us total) trans 12885079648 rc 0/0 00000100:00100000:1.0:1651529344.597714:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211594 00010000:00010000:0.0:1651529344.597715:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009fcb879f/0x3234de053c515ee lrc: 1/0,0 mode: --/PW res: [0x2b77a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597717:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fcb879f/0x3234de053c515ee lrc: 0/0,0 mode: --/PW res: [0x2b77a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.597719:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946460672 00000100:00100000:1.0:1651529344.597724:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946460800 00000100:00100000:0.0:1651529344.597726:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946460608 00000100:00100000:1.0:1651529344.597728:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946460864 00000100:00100000:0.0:1651529344.597733:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946460736 00000100:00100000:1.0:1651529344.597743:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211595 00000100:00100000:1.0:1651529344.597745:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1093:39030:x1731745946460672:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.597749:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211596 00002000:00080000:1.0:1651529344.597750:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178044 count 1 00000100:00100000:0.0:1651529344.597751:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1093:39030:x1731745946460800:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.597755:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099ad1c93/0x3234de053c515f5 lrc: 3/0,1 mode: --/PW res: [0x2b77c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.597756:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178046 count 1 00010000:00010000:1.0:1651529344.597759:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000066556eb/0x3234de053c4c671 lrc: 2/0,0 mode: PR/PR res: [0x2b77c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccbab expref: 971 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.597760:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c515fc lrc: 3/0,1 mode: --/PW res: [0x2b77e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597764:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.597765:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.597765:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006c63fc9c/0x3234de053c4e010 lrc: 2/0,0 mode: PR/PR res: [0x2b77e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3139 expref: 971 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.597766:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099ad1c93/0x3234de053c515f5 lrc: 4/0,1 mode: --/PW res: [0x2b77c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597768:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.597769:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.597770:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c515fc lrc: 4/0,1 mode: --/PW res: [0x2b77e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597772:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000066556eb/0x3234de053c4c671 lrc: 3/0,0 mode: PR/PR res: [0x2b77c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccbab expref: 971 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.597776:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000066556eb/0x3234de053c4c671 lrc: 4/0,0 mode: PR/PR res: [0x2b77c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccbab expref: 971 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.597777:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006c63fc9c/0x3234de053c4e010 lrc: 3/0,0 mode: PR/PR res: [0x2b77e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3139 expref: 971 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.597780:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997008832:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.597781:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006c63fc9c/0x3234de053c4e010 lrc: 4/0,0 mode: PR/PR res: [0x2b77e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3139 expref: 971 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.597785:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ebb53b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997008896:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.597789:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 000000007d8fabda going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.597794:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000000a4def41 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.597795:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211597 00000100:00100000:1.0:1651529344.597797:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1093:39029:x1731745946460608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.597801:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178043 count 1 00000100:00100000:0.0:1651529344.597801:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211598 00000100:00100000:0.0:1651529344.597803:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1093:39030:x1731745946460864:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.597804:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068762ab5/0x3234de053c51603 lrc: 3/0,1 mode: --/PW res: [0x2b77b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597808:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dc4c1e63/0x3234de053c4caf4 lrc: 2/0,0 mode: PR/PR res: [0x2b77b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd6a expref: 971 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.597811:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.597812:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.597812:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068762ab5/0x3234de053c51603 lrc: 4/0,1 mode: --/PW res: [0x2b77b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597820:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dc4c1e63/0x3234de053c4caf4 lrc: 3/0,0 mode: PR/PR res: [0x2b77b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd6a expref: 971 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.597824:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dc4c1e63/0x3234de053c4caf4 lrc: 4/0,0 mode: PR/PR res: [0x2b77b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd6a expref: 971 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:0.0:1651529344.597824:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178047 count 1 00000100:00100000:1.0:1651529344.597827:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997008960:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.597828:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c5160a lrc: 3/0,1 mode: --/PW res: [0x2b77f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597832:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000316bc05e/0x3234de053c4cbd4 lrc: 2/0,0 mode: PR/PR res: [0x2b77f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce10d expref: 971 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.597834:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c3caa148 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.597836:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.597836:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.597837:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c5160a lrc: 4/0,1 mode: --/PW res: [0x2b77f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.597839:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211599 00000100:00100000:1.0:1651529344.597841:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1093:39029:x1731745946460736:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.597843:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000316bc05e/0x3234de053c4cbd4 lrc: 3/0,0 mode: PR/PR res: [0x2b77f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce10d expref: 971 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.597844:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178045 count 1 00010000:00010000:1.0:1651529344.597847:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb6a3f83/0x3234de053c51611 lrc: 3/0,1 mode: --/PW res: [0x2b77d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.597849:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000316bc05e/0x3234de053c4cbd4 lrc: 4/0,0 mode: PR/PR res: [0x2b77f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce10d expref: 971 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.597852:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c4ece3 lrc: 2/0,0 mode: PR/PR res: [0x2b77d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6550 expref: 971 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.597853:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f2582a33 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997009024:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.597855:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.597855:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.597856:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb6a3f83/0x3234de053c51611 lrc: 4/0,1 mode: --/PW res: [0x2b77d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597861:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c4ece3 lrc: 3/0,0 mode: PR/PR res: [0x2b77d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6550 expref: 971 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.597861:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c2b2b59c going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.597865:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c4ece3 lrc: 4/0,0 mode: PR/PR res: [0x2b77d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6550 expref: 971 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.597869:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dfef64e7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997009088:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.597875:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 0000000018ebe812 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.597877:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.597881:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946461184 00000100:00100000:1.0:1651529344.597892:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211600 00000100:00100000:1.0:1651529344.597893:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1094:39030:x1731745946461184:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.597898:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178048 count 1 00010000:00010000:1.0:1651529344.597901:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023b8edfa/0x3234de053c51618 lrc: 3/0,1 mode: --/PW res: [0x2b780:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597914:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005e77fa1b/0x3234de053c4dbc5 lrc: 2/0,0 mode: PR/PR res: [0x2b780:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f18 expref: 971 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.597917:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.597918:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.597918:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023b8edfa/0x3234de053c51618 lrc: 4/0,1 mode: --/PW res: [0x2b780:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597943:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005e77fa1b/0x3234de053c4dbc5 lrc: 3/0,0 mode: PR/PR res: [0x2b780:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f18 expref: 971 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.597951:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005e77fa1b/0x3234de053c4dbc5 lrc: 4/0,0 mode: PR/PR res: [0x2b780:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f18 expref: 971 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.597956:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009b8db73b pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997009152:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.597969:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 0000000071742acc going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.597979:0:72396:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be185979/0x3234de053c4ea9e lrc: 0/0,0 mode: --/PR res: [0x2b779:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c43 expref: 971 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.597983:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ef7d105 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997008704:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.597987:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000a2d126a/0x3234de053c515e7 lrc: 3/0,1 mode: PW/PW res: [0x2b779:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597990:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000a2d126a/0x3234de053c515e7 lrc: 3/0,1 mode: PW/PW res: [0x2b779:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.597993:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a2d126a/0x3234de053c515e7 lrc: 3/0,1 mode: PW/PW res: [0x2b779:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.598003:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a2d126a/0x3234de053c515e7 lrc: 3/0,1 mode: PW/PW res: [0x2b779:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.598006:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a2d126a/0x3234de053c515e7 lrc: 2/0,0 mode: PW/PW res: [0x2b779:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.598024:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a2d126a/0x3234de053c515e7 lrc: 2/0,0 mode: PW/PW res: [0x2b779:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.598029:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000a2d126a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.598030:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a2d126a/0x3234de053c515e7 lrc: 2/0,0 mode: PW/PW res: [0x2b779:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.598033:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a2d126a/0x3234de053c515e7 lrc: 3/0,0 mode: PW/PW res: [0x2b779:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.598038:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a2d126a/0x3234de053c515e7 lrc: 1/0,0 mode: --/PW res: [0x2b779:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.598041:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a2d126a/0x3234de053c515e7 lrc: 0/0,0 mode: --/PW res: [0x2b779:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.598047:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d5e5262 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1095:39030:x1731745946460288:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1243us (1278us total) trans 12885079649 rc 0/0 00000100:00100000:1.0:1651529344.598050:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211593 00000100:00100000:0.0:1651529344.598055:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.598075:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946461312 00000100:00100000:1.0:1651529344.598085:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211601 00000100:00100000:1.0:1651529344.598087:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1095:39030:x1731745946461312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.598092:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178049 count 1 00010000:00010000:1.0:1651529344.598096:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a764502/0x3234de053c5161f lrc: 3/0,1 mode: --/PW res: [0x2b781:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.598113:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000064c2958e/0x3234de053c4dabb lrc: 2/0,0 mode: PR/PR res: [0x2b781:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b3d expref: 970 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.598116:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.598117:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.598117:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a764502/0x3234de053c5161f lrc: 4/0,1 mode: --/PW res: [0x2b781:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.598124:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000064c2958e/0x3234de053c4dabb lrc: 3/0,0 mode: PR/PR res: [0x2b781:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b3d expref: 970 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.598127:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000064c2958e/0x3234de053c4dabb lrc: 4/0,0 mode: PR/PR res: [0x2b781:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b3d expref: 970 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.598131:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ef7d105 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997009216:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.598145:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000567ee0ef going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.598155:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997008832:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.598159:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000099ad1c93/0x3234de053c515f5 lrc: 3/0,1 mode: --/PW res: [0x2b77c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.598199:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ebb53b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997008896:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.598203:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c515fc lrc: 3/0,1 mode: --/PW res: [0x2b77e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.598253:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.598266:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946461376 00000100:00100000:1.0:1651529344.598276:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211602 00000100:00100000:1.0:1651529344.598278:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1096:39030:x1731745946461376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.598283:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178050 count 1 00010000:00010000:1.0:1651529344.598300:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd3089ef/0x3234de053c51626 lrc: 3/0,1 mode: --/PW res: [0x2b782:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.598305:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c4df29 lrc: 2/0,0 mode: PR/PR res: [0x2b782:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2de3 expref: 970 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.598313:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.598313:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.598314:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd3089ef/0x3234de053c51626 lrc: 4/0,1 mode: --/PW res: [0x2b782:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.598314:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f2582a33 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997009024:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.598318:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c5160a lrc: 3/0,1 mode: --/PW res: [0x2b77f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.598321:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c4df29 lrc: 3/0,0 mode: PR/PR res: [0x2b782:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2de3 expref: 970 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.598325:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c4df29 lrc: 4/0,0 mode: PR/PR res: [0x2b782:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2de3 expref: 970 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.598329:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997009280:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.598342:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000499d0377 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.598350:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997008960:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.598354:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000068762ab5/0x3234de053c51603 lrc: 3/0,1 mode: --/PW res: [0x2b77b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.598367:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dfef64e7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997009088:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.598370:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eb6a3f83/0x3234de053c51611 lrc: 3/0,1 mode: --/PW res: [0x2b77d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.598392:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009b8db73b pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997009152:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.598395:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000023b8edfa/0x3234de053c51618 lrc: 3/0,1 mode: --/PW res: [0x2b780:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.598402:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ef7d105 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997009216:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.598404:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002a764502/0x3234de053c5161f lrc: 3/0,1 mode: --/PW res: [0x2b781:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.598688:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.598706:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396341632 00000100:00100000:0.0:1651529344.598708:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.598712:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000066556eb/0x3234de053c4c671 lrc: 4/0,0 mode: PR/PR res: [0x2b77c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccbab expref: 971 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.598717:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.598725:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396341952 00000100:00100000:0.0:1651529344.598727:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.598728:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000316bc05e/0x3234de053c4cbd4 lrc: 4/0,0 mode: PR/PR res: [0x2b77f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce10d expref: 972 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.598732:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.598733:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396341760 00010000:00010000:1.0:1651529344.598746:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006c63fc9c/0x3234de053c4e010 lrc: 4/0,0 mode: PR/PR res: [0x2b77e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3139 expref: 973 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.598747:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.598751:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396341888 00000100:00100000:0.0:1651529344.598752:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.598753:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dc4c1e63/0x3234de053c4caf4 lrc: 4/0,0 mode: PR/PR res: [0x2b77b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd6a expref: 974 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.598757:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396342016 00010000:00010000:1.0:1651529344.598764:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c4ece3 lrc: 4/0,0 mode: PR/PR res: [0x2b77d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6550 expref: 975 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.598765:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396342336 00000100:00100000:1.0:1651529344.598769:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396342144 00010000:00010000:0.0:1651529344.598771:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000064c2958e/0x3234de053c4dabb lrc: 4/0,0 mode: PR/PR res: [0x2b781:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b3d expref: 977 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.598772:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005e77fa1b/0x3234de053c4dbc5 lrc: 4/0,0 mode: PR/PR res: [0x2b780:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f18 expref: 977 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.598777:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12377 00000100:00100000:1.0:1651529344.598779:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+977:41279:x1731746396341632:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.598779:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12378 00000100:00100000:0.0:1651529344.598781:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+977:41278:x1731746396341952:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.598782:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.598783:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000066556eb/0x3234de053c4c671 lrc: 4/0,0 mode: PR/PR res: [0x2b77c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccbab expref: 977 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.598787:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000066556eb/0x3234de053c4c671 lrc: 3/0,0 mode: PR/PR res: [0x2b77c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccbab expref: 977 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.598793:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000066556eb/0x3234de053c4c671 lrc: 0/0,0 mode: --/PR res: [0x2b77c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccbab expref: 977 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.598801:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.598802:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.598803:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.598803:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000099ad1c93/0x3234de053c515f5 lrc: 3/0,1 mode: PW/PW res: [0x2b77c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.598803:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000316bc05e/0x3234de053c4cbd4 lrc: 4/0,0 mode: PR/PR res: [0x2b77f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce10d expref: 976 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.598807:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099ad1c93/0x3234de053c515f5 lrc: 4/0,1 mode: PW/PW res: [0x2b77c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.598807:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000316bc05e/0x3234de053c4cbd4 lrc: 3/0,0 mode: PR/PR res: [0x2b77f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce10d expref: 976 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.598813:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.598813:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000316bc05e/0x3234de053c4cbd4 lrc: 0/0,0 mode: --/PR res: [0x2b77f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce10d expref: 976 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.598817:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.598817:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.598818:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c5160a lrc: 3/0,1 mode: PW/PW res: [0x2b77f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.598822:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c5160a lrc: 4/0,1 mode: PW/PW res: [0x2b77f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.598825:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+975:41279:x1731746396341632:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 46us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.598828:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12377 00000100:00100000:1.0:1651529344.598833:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12379 00010000:00010000:0.0:1651529344.598834:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.598835:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000011803d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+974:41279:x1731746396341760:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.598838:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.598839:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006c63fc9c/0x3234de053c4e010 lrc: 4/0,0 mode: PR/PR res: [0x2b77e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3139 expref: 974 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.598841:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+974:41278:x1731746396341952:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 60us (133us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.598843:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006c63fc9c/0x3234de053c4e010 lrc: 3/0,0 mode: PR/PR res: [0x2b77e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3139 expref: 974 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.598844:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12378 00010000:00010000:1.0:1651529344.598848:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c63fc9c/0x3234de053c4e010 lrc: 0/0,0 mode: --/PR res: [0x2b77e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3139 expref: 973 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.598850:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12380 00010000:00010000:1.0:1651529344.598851:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.598852:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.598852:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c515fc lrc: 3/0,1 mode: PW/PW res: [0x2b77e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.598852:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+972:41279:x1731746396341888:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.598854:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.598855:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c515fc lrc: 4/0,1 mode: PW/PW res: [0x2b77e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.598856:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dc4c1e63/0x3234de053c4caf4 lrc: 4/0,0 mode: PR/PR res: [0x2b77b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd6a expref: 972 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.598859:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dc4c1e63/0x3234de053c4caf4 lrc: 3/0,0 mode: PR/PR res: [0x2b77b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd6a expref: 972 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.598863:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.598869:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000011803d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+972:41279:x1731746396341760:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 33us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.598871:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12379 00010000:00010000:0.0:1651529344.598871:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc4c1e63/0x3234de053c4caf4 lrc: 0/0,0 mode: --/PR res: [0x2b77b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd6a expref: 972 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.598874:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.598875:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.598876:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000068762ab5/0x3234de053c51603 lrc: 3/0,1 mode: PW/PW res: [0x2b77b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.598879:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12381 00010000:00010000:0.0:1651529344.598879:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068762ab5/0x3234de053c51603 lrc: 4/0,1 mode: PW/PW res: [0x2b77b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.598881:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+970:41279:x1731746396342016:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.598883:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.598885:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c4ece3 lrc: 4/0,0 mode: PR/PR res: [0x2b77d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6550 expref: 970 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.598887:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.598893:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+970:41279:x1731746396341888:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 41us (166us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.598895:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c4ece3 lrc: 3/0,0 mode: PR/PR res: [0x2b77d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6550 expref: 970 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.598896:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12380 00010000:00010000:1.0:1651529344.598900:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c4ece3 lrc: 0/0,0 mode: --/PR res: [0x2b77d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6550 expref: 969 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.598900:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12382 00000100:00100000:0.0:1651529344.598902:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+969:41278:x1731746396342336:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.598903:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.598904:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.598904:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb6a3f83/0x3234de053c51611 lrc: 3/0,1 mode: PW/PW res: [0x2b77d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.598904:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.598906:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000064c2958e/0x3234de053c4dabb lrc: 4/0,0 mode: PR/PR res: [0x2b781:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b3d expref: 968 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.598907:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb6a3f83/0x3234de053c51611 lrc: 4/0,1 mode: PW/PW res: [0x2b77d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.598909:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000064c2958e/0x3234de053c4dabb lrc: 3/0,0 mode: PR/PR res: [0x2b781:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b3d expref: 968 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.598913:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.598914:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064c2958e/0x3234de053c4dabb lrc: 0/0,0 mode: --/PR res: [0x2b781:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b3d expref: 968 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.598918:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.598918:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.598919:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+967:41279:x1731746396342016:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 37us (186us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.598919:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002a764502/0x3234de053c5161f lrc: 3/0,1 mode: PW/PW res: [0x2b781:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.598921:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12381 00010000:00010000:0.0:1651529344.598924:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a764502/0x3234de053c5161f lrc: 4/0,1 mode: PW/PW res: [0x2b781:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.598926:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12383 00000100:00100000:1.0:1651529344.598928:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+966:41279:x1731746396342144:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.598930:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.598932:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.598937:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005e77fa1b/0x3234de053c4dbc5 lrc: 4/0,0 mode: PR/PR res: [0x2b780:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f18 expref: 966 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.598938:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+966:41278:x1731746396342336:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.598940:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12382 00010000:00010000:1.0:1651529344.598941:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005e77fa1b/0x3234de053c4dbc5 lrc: 3/0,0 mode: PR/PR res: [0x2b780:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f18 expref: 966 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.598946:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e77fa1b/0x3234de053c4dbc5 lrc: 0/0,0 mode: --/PR res: [0x2b780:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f18 expref: 965 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.598947:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c5160a lrc: 3/0,1 mode: PW/PW res: [0x2b77f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.598949:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.598950:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.598950:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c5160a lrc: 3/0,1 mode: PW/PW res: [0x2b77f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.598951:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000023b8edfa/0x3234de053c51618 lrc: 3/0,1 mode: PW/PW res: [0x2b780:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.598953:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023b8edfa/0x3234de053c51618 lrc: 4/0,1 mode: PW/PW res: [0x2b780:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.598953:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c5160a lrc: 3/0,1 mode: PW/PW res: [0x2b77f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.598955:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c5160a lrc: 2/0,0 mode: PW/PW res: [0x2b77f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.598959:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.598964:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+964:41279:x1731746396342144:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 36us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.598967:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12383 00010000:00010000:1.0:1651529344.598975:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eb6a3f83/0x3234de053c51611 lrc: 3/0,1 mode: PW/PW res: [0x2b77d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.598978:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb6a3f83/0x3234de053c51611 lrc: 3/0,1 mode: PW/PW res: [0x2b77d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.598981:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb6a3f83/0x3234de053c51611 lrc: 3/0,1 mode: PW/PW res: [0x2b77d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.598984:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb6a3f83/0x3234de053c51611 lrc: 2/0,0 mode: PW/PW res: [0x2b77d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.599003:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1097:39030:x1731745946460864:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1199us (1323us total) trans 12885079650 rc 0/0 00000100:00100000:0.0:1651529344.599006:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211598 00010000:00010000:0.0:1651529344.599013:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c515fc lrc: 3/0,1 mode: PW/PW res: [0x2b77e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599016:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c515fc lrc: 3/0,1 mode: PW/PW res: [0x2b77e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599020:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c515fc lrc: 3/0,1 mode: PW/PW res: [0x2b77e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599022:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c515fc lrc: 2/0,0 mode: PW/PW res: [0x2b77e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.599027:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1097:39029:x1731745946460736:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1186us (1340us total) trans 12885079651 rc 0/0 00000100:00100000:1.0:1651529344.599030:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211599 00010000:00010000:1.0:1651529344.599038:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000068762ab5/0x3234de053c51603 lrc: 3/0,1 mode: PW/PW res: [0x2b77b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599041:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068762ab5/0x3234de053c51603 lrc: 3/0,1 mode: PW/PW res: [0x2b77b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599044:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068762ab5/0x3234de053c51603 lrc: 3/0,1 mode: PW/PW res: [0x2b77b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599047:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068762ab5/0x3234de053c51603 lrc: 2/0,0 mode: PW/PW res: [0x2b77b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.599056:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1097:39030:x1731745946460800:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1305us (1399us total) trans 12885079652 rc 0/0 00000100:00100000:0.0:1651529344.599059:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211596 00010000:00010000:0.0:1651529344.599066:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c5160a lrc: 2/0,0 mode: PW/PW res: [0x2b77f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599069:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088cc87df already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.599070:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c5160a lrc: 2/0,0 mode: PW/PW res: [0x2b77f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599073:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c5160a lrc: 3/0,0 mode: PW/PW res: [0x2b77f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.599077:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1097:39029:x1731745946460608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1279us (1407us total) trans 12885079653 rc 0/0 00010000:00010000:0.0:1651529344.599077:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c5160a lrc: 1/0,0 mode: --/PW res: [0x2b77f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.599080:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211597 00010000:00010000:0.0:1651529344.599080:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c5160a lrc: 0/0,0 mode: --/PW res: [0x2b77f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599084:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb6a3f83/0x3234de053c51611 lrc: 2/0,0 mode: PW/PW res: [0x2b77d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599086:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000023b8edfa/0x3234de053c51618 lrc: 3/0,1 mode: PW/PW res: [0x2b780:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599088:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eb6a3f83 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.599088:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb6a3f83/0x3234de053c51611 lrc: 2/0,0 mode: PW/PW res: [0x2b77d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599089:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023b8edfa/0x3234de053c51618 lrc: 3/0,1 mode: PW/PW res: [0x2b780:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599091:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb6a3f83/0x3234de053c51611 lrc: 3/0,0 mode: PW/PW res: [0x2b77d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599094:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb6a3f83/0x3234de053c51611 lrc: 1/0,0 mode: --/PW res: [0x2b77d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599095:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023b8edfa/0x3234de053c51618 lrc: 3/0,1 mode: PW/PW res: [0x2b780:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599097:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023b8edfa/0x3234de053c51618 lrc: 2/0,0 mode: PW/PW res: [0x2b780:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599097:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb6a3f83/0x3234de053c51611 lrc: 0/0,0 mode: --/PW res: [0x2b77d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599100:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c515fc lrc: 2/0,0 mode: PW/PW res: [0x2b77e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599103:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eaaf5dcd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.599103:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c515fc lrc: 2/0,0 mode: PW/PW res: [0x2b77e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599106:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c515fc lrc: 3/0,0 mode: PW/PW res: [0x2b77e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599109:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c515fc lrc: 1/0,0 mode: --/PW res: [0x2b77e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599112:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c515fc lrc: 0/0,0 mode: --/PW res: [0x2b77e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599116:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068762ab5/0x3234de053c51603 lrc: 2/0,0 mode: PW/PW res: [0x2b77b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599118:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000068762ab5 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.599119:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068762ab5/0x3234de053c51603 lrc: 2/0,0 mode: PW/PW res: [0x2b77b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599122:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068762ab5/0x3234de053c51603 lrc: 3/0,0 mode: PW/PW res: [0x2b77b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.599125:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1097:39030:x1731745946461184:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1231us (1249us total) trans 12885079654 rc 0/0 00010000:00010000:0.0:1651529344.599125:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068762ab5/0x3234de053c51603 lrc: 1/0,0 mode: --/PW res: [0x2b77b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599127:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068762ab5/0x3234de053c51603 lrc: 0/0,0 mode: --/PW res: [0x2b77b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.599128:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211600 00010000:00010000:0.0:1651529344.599131:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023b8edfa/0x3234de053c51618 lrc: 2/0,0 mode: PW/PW res: [0x2b780:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599133:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000023b8edfa already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.599134:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000099ad1c93/0x3234de053c515f5 lrc: 3/0,1 mode: PW/PW res: [0x2b77c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599134:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023b8edfa/0x3234de053c51618 lrc: 2/0,0 mode: PW/PW res: [0x2b780:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599137:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099ad1c93/0x3234de053c515f5 lrc: 3/0,1 mode: PW/PW res: [0x2b77c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599137:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023b8edfa/0x3234de053c51618 lrc: 3/0,0 mode: PW/PW res: [0x2b780:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599140:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099ad1c93/0x3234de053c515f5 lrc: 3/0,1 mode: PW/PW res: [0x2b77c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599140:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023b8edfa/0x3234de053c51618 lrc: 1/0,0 mode: --/PW res: [0x2b780:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599143:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099ad1c93/0x3234de053c515f5 lrc: 2/0,0 mode: PW/PW res: [0x2b77c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599143:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023b8edfa/0x3234de053c51618 lrc: 0/0,0 mode: --/PW res: [0x2b780:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599146:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099ad1c93/0x3234de053c515f5 lrc: 2/0,0 mode: PW/PW res: [0x2b77c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599149:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000099ad1c93 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.599150:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099ad1c93/0x3234de053c515f5 lrc: 2/0,0 mode: PW/PW res: [0x2b77c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599152:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099ad1c93/0x3234de053c515f5 lrc: 3/0,0 mode: PW/PW res: [0x2b77c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599155:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099ad1c93/0x3234de053c515f5 lrc: 1/0,0 mode: --/PW res: [0x2b77c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599158:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099ad1c93/0x3234de053c515f5 lrc: 0/0,0 mode: --/PW res: [0x2b77c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.599170:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1097:39030:x1731745946460672:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1424us (1522us total) trans 12885079655 rc 0/0 00000100:00100000:1.0:1651529344.599173:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211595 00010000:00010000:1.0:1651529344.599178:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002a764502/0x3234de053c5161f lrc: 3/0,1 mode: PW/PW res: [0x2b781:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599184:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a764502/0x3234de053c5161f lrc: 3/0,1 mode: PW/PW res: [0x2b781:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599187:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a764502/0x3234de053c5161f lrc: 3/0,1 mode: PW/PW res: [0x2b781:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.599187:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.599205:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a764502/0x3234de053c5161f lrc: 2/0,0 mode: PW/PW res: [0x2b781:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599277:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a764502/0x3234de053c5161f lrc: 2/0,0 mode: PW/PW res: [0x2b781:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599281:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a764502 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.599282:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a764502/0x3234de053c5161f lrc: 2/0,0 mode: PW/PW res: [0x2b781:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599287:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a764502/0x3234de053c5161f lrc: 3/0,0 mode: PW/PW res: [0x2b781:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599292:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a764502/0x3234de053c5161f lrc: 1/0,0 mode: --/PW res: [0x2b781:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599295:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a764502/0x3234de053c5161f lrc: 0/0,0 mode: --/PW res: [0x2b781:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.599311:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1097:39030:x1731745946461312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1223us (1256us total) trans 12885079656 rc 0/0 00000100:00100000:1.0:1651529344.599315:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211601 00000100:00100000:1.0:1651529344.599325:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396342528 00010000:00010000:1.0:1651529344.599330:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c4df29 lrc: 5/0,0 mode: PR/PR res: [0x2b782:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2de3 expref: 964 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.599337:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12384 00000100:00100000:1.0:1651529344.599339:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+964:41278:x1731746396342528:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.599341:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.599350:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c4df29 lrc: 5/0,0 mode: PR/PR res: [0x2b782:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2de3 expref: 964 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.599355:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c4df29 lrc: 4/0,0 mode: PR/PR res: [0x2b782:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2de3 expref: 964 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.599363:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.599363:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.599364:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd3089ef/0x3234de053c51626 lrc: 3/0,1 mode: PW/PW res: [0x2b782:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599367:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd3089ef/0x3234de053c51626 lrc: 4/0,1 mode: PW/PW res: [0x2b782:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599372:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.599386:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+964:41278:x1731746396342528:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 46us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.599388:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12384 00010000:00010000:1.0:1651529344.599399:0:80277:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c4df29 lrc: 0/0,0 mode: --/PR res: [0x2b782:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2de3 expref: 963 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.599404:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997009280:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.599407:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dd3089ef/0x3234de053c51626 lrc: 3/0,1 mode: PW/PW res: [0x2b782:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599411:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dd3089ef/0x3234de053c51626 lrc: 3/0,1 mode: PW/PW res: [0x2b782:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599413:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd3089ef/0x3234de053c51626 lrc: 3/0,1 mode: PW/PW res: [0x2b782:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599416:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd3089ef/0x3234de053c51626 lrc: 3/0,1 mode: PW/PW res: [0x2b782:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599419:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd3089ef/0x3234de053c51626 lrc: 2/0,0 mode: PW/PW res: [0x2b782:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.599420:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.599453:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd3089ef/0x3234de053c51626 lrc: 2/0,0 mode: PW/PW res: [0x2b782:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599457:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dd3089ef already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.599458:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd3089ef/0x3234de053c51626 lrc: 2/0,0 mode: PW/PW res: [0x2b782:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599461:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd3089ef/0x3234de053c51626 lrc: 3/0,0 mode: PW/PW res: [0x2b782:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599466:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd3089ef/0x3234de053c51626 lrc: 1/0,0 mode: --/PW res: [0x2b782:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599468:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd3089ef/0x3234de053c51626 lrc: 0/0,0 mode: --/PW res: [0x2b782:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.599476:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1097:39030:x1731745946461376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1197us (1223us total) trans 12885079657 rc 0/0 00000100:00100000:1.0:1651529344.599479:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211602 00000100:00100000:1.0:1651529344.599484:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946461440 00000100:00100000:1.0:1651529344.599490:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211603 00000100:00100000:1.0:1651529344.599492:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a13808c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1097:39030:x1731745946461440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.599503:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178051 count 1 00010000:00010000:1.0:1651529344.599507:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea0ab3e9/0x3234de053c5162d lrc: 3/0,1 mode: --/PW res: [0x2b783:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599512:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c4f45a lrc: 2/0,0 mode: PR/PR res: [0x2b783:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d840c expref: 962 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.599515:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.599516:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.599516:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea0ab3e9/0x3234de053c5162d lrc: 4/0,1 mode: --/PW res: [0x2b783:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599523:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c4f45a lrc: 3/0,0 mode: PR/PR res: [0x2b783:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d840c expref: 962 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.599526:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c4f45a lrc: 4/0,0 mode: PR/PR res: [0x2b783:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d840c expref: 962 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.599533:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997009344:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.599545:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.599555:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000499d0377 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.599561:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946461568 00000100:00100000:1.0:1651529344.599575:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211604 00000100:00100000:1.0:1651529344.599576:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1098:39030:x1731745946461568:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.599581:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178053 count 1 00010000:00010000:1.0:1651529344.599585:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034d24763/0x3234de053c51634 lrc: 3/0,1 mode: --/PW res: [0x2b785:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599589:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000099a3e2d9/0x3234de053c4ec57 lrc: 2/0,0 mode: PR/PR res: [0x2b785:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d62b0 expref: 962 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.599591:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.599592:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.599593:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.599594:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034d24763/0x3234de053c51634 lrc: 4/0,1 mode: --/PW res: [0x2b785:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599600:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000099a3e2d9/0x3234de053c4ec57 lrc: 3/0,0 mode: PR/PR res: [0x2b785:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d62b0 expref: 962 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.599601:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.599603:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000099a3e2d9/0x3234de053c4ec57 lrc: 4/0,0 mode: PR/PR res: [0x2b785:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d62b0 expref: 962 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.599611:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.599613:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006026725b pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997009408:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.599618:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.599621:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cfa1ca05 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.599627:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946461696 00000100:00100000:0.0:1651529344.599639:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.599643:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946461504 00000100:00100000:1.0:1651529344.599650:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946461632 00000100:00100000:1.0:1651529344.599653:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946461760 00000100:00100000:1.0:1651529344.599655:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946461824 00000100:00100000:1.0:1651529344.599658:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211605 00000100:00100000:1.0:1651529344.599659:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1103:39030:x1731745946461696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.599670:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178055 count 1 00010000:00010000:1.0:1651529344.599674:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000004e74ca/0x3234de053c5163b lrc: 3/0,1 mode: --/PW res: [0x2b787:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599679:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000891933bd/0x3234de053c4e68b lrc: 2/0,0 mode: PR/PR res: [0x2b787:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4aca expref: 962 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.599687:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.599688:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.599688:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211606 00010000:00010000:1.0:1651529344.599689:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000004e74ca/0x3234de053c5163b lrc: 4/0,1 mode: --/PW res: [0x2b787:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.599691:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1103:39029:x1731745946461504:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.599695:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000891933bd/0x3234de053c4e68b lrc: 3/0,0 mode: PR/PR res: [0x2b787:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4aca expref: 962 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.599697:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178052 count 1 00010000:00010000:1.0:1651529344.599698:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000891933bd/0x3234de053c4e68b lrc: 4/0,0 mode: PR/PR res: [0x2b787:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4aca expref: 962 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.599701:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51642 lrc: 3/0,1 mode: --/PW res: [0x2b784:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.599702:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997009472:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.599706:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e36baf74/0x3234de053c4d463 lrc: 2/0,0 mode: PR/PR res: [0x2b784:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0396 expref: 962 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.599709:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.599710:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.599711:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51642 lrc: 4/0,1 mode: --/PW res: [0x2b784:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.599715:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a4eb401d going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.599721:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211607 00000100:00100000:1.0:1651529344.599723:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1103:39029:x1731745946461632:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.599728:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178054 count 1 00010000:00010000:1.0:1651529344.599731:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000695e6e5e/0x3234de053c51649 lrc: 3/0,1 mode: --/PW res: [0x2b786:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599744:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ad242558/0x3234de053c4f388 lrc: 2/0,0 mode: PR/PR res: [0x2b786:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80d2 expref: 962 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.599747:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.599748:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.599749:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000695e6e5e/0x3234de053c51649 lrc: 4/0,1 mode: --/PW res: [0x2b786:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599754:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ad242558/0x3234de053c4f388 lrc: 3/0,0 mode: PR/PR res: [0x2b786:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80d2 expref: 962 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.599756:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e36baf74/0x3234de053c4d463 lrc: 3/0,0 mode: PR/PR res: [0x2b784:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0396 expref: 962 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.599758:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ad242558/0x3234de053c4f388 lrc: 4/0,0 mode: PR/PR res: [0x2b786:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80d2 expref: 962 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.599760:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e36baf74/0x3234de053c4d463 lrc: 4/0,0 mode: PR/PR res: [0x2b784:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0396 expref: 962 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.599761:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ef7d105 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997009536:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.599764:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005914c920 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997009600:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.599769:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000babe2d90 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.599773:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c2b2b59c going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.599775:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211608 00000100:00100000:1.0:1651529344.599777:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfc79d4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1103:39029:x1731745946461760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.599780:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211609 00002000:00080000:1.0:1651529344.599781:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178056 count 1 00000100:00100000:0.0:1651529344.599782:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ea32140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1103:39030:x1731745946461824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.599784:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8fe7f95/0x3234de053c51650 lrc: 3/0,1 mode: --/PW res: [0x2b788:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.599787:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178057 count 1 00010000:00010000:1.0:1651529344.599788:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000f744e26/0x3234de053c4dc74 lrc: 2/0,0 mode: PR/PR res: [0x2b788:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d21fe expref: 962 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.599791:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51657 lrc: 3/0,1 mode: --/PW res: [0x2b789:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599792:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.599792:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.599793:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8fe7f95/0x3234de053c51650 lrc: 4/0,1 mode: --/PW res: [0x2b788:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599798:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000f744e26/0x3234de053c4dc74 lrc: 3/0,0 mode: PR/PR res: [0x2b788:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d21fe expref: 962 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.599802:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000f744e26/0x3234de053c4dc74 lrc: 4/0,0 mode: PR/PR res: [0x2b788:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d21fe expref: 962 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.599805:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009b8db73b pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997009664:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.599809:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c3665e26/0x3234de053c4cbdb lrc: 2/0,0 mode: PR/PR res: [0x2b789:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce130 expref: 962 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.599811:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b52d0f36 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.599813:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.599813:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.599814:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51657 lrc: 4/0,1 mode: --/PW res: [0x2b789:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.599819:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997009344:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.599821:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c3665e26/0x3234de053c4cbdb lrc: 3/0,0 mode: PR/PR res: [0x2b789:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce130 expref: 962 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.599823:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ea0ab3e9/0x3234de053c5162d lrc: 3/0,1 mode: --/PW res: [0x2b783:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599825:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c3665e26/0x3234de053c4cbdb lrc: 4/0,0 mode: PR/PR res: [0x2b789:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce130 expref: 962 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.599829:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007fca8239 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997009728:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.599837:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000000a4def41 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.599838:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.599854:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.599876:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946462400 00000100:00100000:0.0:1651529344.599889:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211610 00000100:00100000:0.0:1651529344.599890:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1104:39030:x1731745946462400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.599895:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178058 count 1 00010000:00010000:0.0:1651529344.599899:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c5165e lrc: 3/0,1 mode: --/PW res: [0x2b78a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599904:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009c307aec/0x3234de053c4cb33 lrc: 2/0,0 mode: PR/PR res: [0x2b78a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde51 expref: 962 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.599907:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.599907:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.599908:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c5165e lrc: 4/0,1 mode: --/PW res: [0x2b78a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.599914:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009c307aec/0x3234de053c4cb33 lrc: 3/0,0 mode: PR/PR res: [0x2b78a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde51 expref: 962 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.599917:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009c307aec/0x3234de053c4cb33 lrc: 4/0,0 mode: PR/PR res: [0x2b78a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde51 expref: 962 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.599919:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396342592 00000100:00100000:0.0:1651529344.599921:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b0d9532a pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997009792:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.599930:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c4f45a lrc: 4/0,0 mode: PR/PR res: [0x2b783:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d840c expref: 963 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.599935:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed830649 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.599944:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12385 00000100:00100000:1.0:1651529344.599946:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+963:41279:x1731746396342592:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.599948:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.599949:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.599950:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c4f45a lrc: 4/0,0 mode: PR/PR res: [0x2b783:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d840c expref: 963 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.599959:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c4f45a lrc: 3/0,0 mode: PR/PR res: [0x2b783:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d840c expref: 963 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.599965:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c4f45a lrc: 0/0,0 mode: --/PR res: [0x2b783:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d840c expref: 963 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.599969:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.599969:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.599970:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea0ab3e9/0x3234de053c5162d lrc: 3/0,1 mode: PW/PW res: [0x2b783:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599973:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea0ab3e9/0x3234de053c5162d lrc: 4/0,1 mode: PW/PW res: [0x2b783:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.599987:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.599999:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+962:41279:x1731746396342592:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 53us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.600002:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12385 00000100:00100000:1.0:1651529344.600007:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396342656 00010000:00010000:1.0:1651529344.600010:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000099a3e2d9/0x3234de053c4ec57 lrc: 5/0,0 mode: PR/PR res: [0x2b785:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d62b0 expref: 962 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.600025:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12386 00000100:00100000:0.0:1651529344.600027:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e75f071f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+962:41278:x1731746396342656:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.600031:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.600033:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000099a3e2d9/0x3234de053c4ec57 lrc: 5/0,0 mode: PR/PR res: [0x2b785:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d62b0 expref: 962 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.600035:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006026725b pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997009408:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.600037:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000099a3e2d9/0x3234de053c4ec57 lrc: 3/0,0 mode: PR/PR res: [0x2b785:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d62b0 expref: 962 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.600045:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000034d24763/0x3234de053c51634 lrc: 3/0,1 mode: --/PW res: [0x2b785:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.600047:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099a3e2d9/0x3234de053c4ec57 lrc: 0/0,0 mode: --/PR res: [0x2b785:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d62b0 expref: 962 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.600051:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.600052:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.600053:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ea0ab3e9/0x3234de053c5162d lrc: 3/0,1 mode: PW/PW res: [0x2b783:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.600053:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000034d24763/0x3234de053c51634 lrc: 3/0,1 mode: PW/PW res: [0x2b785:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.600056:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea0ab3e9/0x3234de053c5162d lrc: 3/0,1 mode: PW/PW res: [0x2b783:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.600056:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034d24763/0x3234de053c51634 lrc: 4/0,1 mode: PW/PW res: [0x2b785:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.600059:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea0ab3e9/0x3234de053c5162d lrc: 3/0,1 mode: PW/PW res: [0x2b783:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.600062:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea0ab3e9/0x3234de053c5162d lrc: 2/0,0 mode: PW/PW res: [0x2b783:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.600066:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.600097:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e75f071f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+961:41278:x1731746396342656:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 69us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.600100:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12386 00000100:00100000:1.0:1651529344.600108:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a13808c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1105:39030:x1731745946461440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 615us (689us total) trans 12885079658 rc 0/0 00000100:00100000:1.0:1651529344.600111:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211603 00010000:00010000:0.0:1651529344.600112:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea0ab3e9/0x3234de053c5162d lrc: 2/0,0 mode: PW/PW res: [0x2b783:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.600116:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ea0ab3e9 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.600117:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea0ab3e9/0x3234de053c5162d lrc: 2/0,0 mode: PW/PW res: [0x2b783:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.600118:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000034d24763/0x3234de053c51634 lrc: 3/0,1 mode: PW/PW res: [0x2b785:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.600121:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034d24763/0x3234de053c51634 lrc: 3/0,1 mode: PW/PW res: [0x2b785:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.600124:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034d24763/0x3234de053c51634 lrc: 3/0,1 mode: PW/PW res: [0x2b785:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.600126:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034d24763/0x3234de053c51634 lrc: 2/0,0 mode: PW/PW res: [0x2b785:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.600131:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea0ab3e9/0x3234de053c5162d lrc: 3/0,0 mode: PW/PW res: [0x2b783:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.600142:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea0ab3e9/0x3234de053c5162d lrc: 1/0,0 mode: --/PW res: [0x2b783:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.600147:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea0ab3e9/0x3234de053c5162d lrc: 0/0,0 mode: --/PW res: [0x2b783:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.600152:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034d24763/0x3234de053c51634 lrc: 2/0,0 mode: PW/PW res: [0x2b785:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.600154:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000034d24763 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.600155:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034d24763/0x3234de053c51634 lrc: 2/0,0 mode: PW/PW res: [0x2b785:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.600165:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1105:39030:x1731745946461568:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 588us (620us total) trans 12885079659 rc 0/0 00010000:00010000:0.0:1651529344.600167:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034d24763/0x3234de053c51634 lrc: 3/0,0 mode: PW/PW res: [0x2b785:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.600168:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211604 00010000:00010000:0.0:1651529344.600171:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034d24763/0x3234de053c51634 lrc: 1/0,0 mode: --/PW res: [0x2b785:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.600174:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034d24763/0x3234de053c51634 lrc: 0/0,0 mode: --/PW res: [0x2b785:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.600195:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997009472:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.600199:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000004e74ca/0x3234de053c5163b lrc: 3/0,1 mode: --/PW res: [0x2b787:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.600267:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ef7d105 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997009536:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.600271:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000695e6e5e/0x3234de053c51649 lrc: 3/0,1 mode: --/PW res: [0x2b786:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.600275:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005914c920 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997009600:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.600277:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009b8db73b pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997009664:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.600280:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e8fe7f95/0x3234de053c51650 lrc: 3/0,1 mode: --/PW res: [0x2b788:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.600280:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51642 lrc: 3/0,1 mode: --/PW res: [0x2b784:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.600327:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007fca8239 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997009728:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.600331:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51657 lrc: 3/0,1 mode: --/PW res: [0x2b789:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.600337:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b0d9532a pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997009792:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.600340:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c5165e lrc: 3/0,1 mode: --/PW res: [0x2b78a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.600413:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.600421:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.600427:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946462464 00000100:00100000:1.0:1651529344.600439:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946462528 00000100:00100000:1.0:1651529344.600443:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211611 00000100:00100000:1.0:1651529344.600444:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1106:39030:x1731745946462464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.600450:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178059 count 1 00000100:00100000:0.0:1651529344.600450:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211612 00000100:00100000:0.0:1651529344.600452:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1106:39029:x1731745946462528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.600454:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5161cbb/0x3234de053c51665 lrc: 3/0,1 mode: --/PW res: [0x2b78b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.600458:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178060 count 1 00010000:00010000:1.0:1651529344.600461:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a6e983b9/0x3234de053c4cd32 lrc: 2/0,0 mode: PR/PR res: [0x2b78b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce6a8 expref: 960 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.600462:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c5166c lrc: 3/0,1 mode: --/PW res: [0x2b78c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.600464:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.600465:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.600465:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5161cbb/0x3234de053c51665 lrc: 4/0,1 mode: --/PW res: [0x2b78b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.600466:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd47abca/0x3234de053c4e6a0 lrc: 2/0,0 mode: PR/PR res: [0x2b78c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b02 expref: 960 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.600469:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.600470:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.600471:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c5166c lrc: 4/0,1 mode: --/PW res: [0x2b78c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.600472:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a6e983b9/0x3234de053c4cd32 lrc: 3/0,0 mode: PR/PR res: [0x2b78b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce6a8 expref: 960 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.600475:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a6e983b9/0x3234de053c4cd32 lrc: 4/0,0 mode: PR/PR res: [0x2b78b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce6a8 expref: 960 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.600478:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fd47abca/0x3234de053c4e6a0 lrc: 3/0,0 mode: PR/PR res: [0x2b78c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b02 expref: 960 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.600479:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997009856:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.600481:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fd47abca/0x3234de053c4e6a0 lrc: 4/0,0 mode: PR/PR res: [0x2b78c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b02 expref: 960 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.600485:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b0d9532a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997009920:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.600493:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a4eb401d going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.600502:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed830649 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.600667:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.600683:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.600692:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.600694:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396342848 00000100:00100000:1.0:1651529344.600699:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.600700:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000891933bd/0x3234de053c4e68b lrc: 4/0,0 mode: PR/PR res: [0x2b787:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4aca expref: 961 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.600705:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.600707:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396342976 00000100:00100000:1.0:1651529344.600709:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.600709:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e36baf74/0x3234de053c4d463 lrc: 4/0,0 mode: PR/PR res: [0x2b784:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0396 expref: 962 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.600713:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396342912 00010000:00010000:0.0:1651529344.600716:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ad242558/0x3234de053c4f388 lrc: 4/0,0 mode: PR/PR res: [0x2b786:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80d2 expref: 963 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.600719:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396343040 00000100:00100000:0.0:1651529344.600720:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396343168 00010000:00010000:0.0:1651529344.600722:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c3665e26/0x3234de053c4cbdb lrc: 4/0,0 mode: PR/PR res: [0x2b789:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce130 expref: 965 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.600725:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000f744e26/0x3234de053c4dc74 lrc: 4/0,0 mode: PR/PR res: [0x2b788:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d21fe expref: 965 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.600726:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396343296 00010000:00010000:0.0:1651529344.600728:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009c307aec/0x3234de053c4cb33 lrc: 4/0,0 mode: PR/PR res: [0x2b78a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde51 expref: 966 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.600732:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12387 00000100:00100000:1.0:1651529344.600743:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+966:41278:x1731746396342848:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.600746:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.600746:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12388 00000100:00100000:0.0:1651529344.600747:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+966:41278:x1731746396342976:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.600748:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000891933bd/0x3234de053c4e68b lrc: 4/0,0 mode: PR/PR res: [0x2b787:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4aca expref: 966 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.600750:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.600752:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000891933bd/0x3234de053c4e68b lrc: 3/0,0 mode: PR/PR res: [0x2b787:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4aca expref: 966 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.600752:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e36baf74/0x3234de053c4d463 lrc: 4/0,0 mode: PR/PR res: [0x2b784:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0396 expref: 966 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.600758:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000891933bd/0x3234de053c4e68b lrc: 0/0,0 mode: --/PR res: [0x2b787:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4aca expref: 966 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.600758:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e36baf74/0x3234de053c4d463 lrc: 3/0,0 mode: PR/PR res: [0x2b784:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0396 expref: 966 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.600762:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.600762:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.600763:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000004e74ca/0x3234de053c5163b lrc: 3/0,1 mode: PW/PW res: [0x2b787:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.600764:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e36baf74/0x3234de053c4d463 lrc: 0/0,0 mode: --/PR res: [0x2b784:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0396 expref: 965 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.600766:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000004e74ca/0x3234de053c5163b lrc: 4/0,1 mode: PW/PW res: [0x2b787:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.600768:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.600768:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.600769:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51642 lrc: 3/0,1 mode: PW/PW res: [0x2b784:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.600772:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51642 lrc: 4/0,1 mode: PW/PW res: [0x2b784:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.600773:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.600780:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.600784:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+964:41278:x1731746396342848:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 49us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.600787:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12387 00000100:00100000:1.0:1651529344.600792:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12389 00000100:00100000:1.0:1651529344.600793:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+963:41279:x1731746396342912:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.600793:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+963:41278:x1731746396342976:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 44us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.600795:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12388 00010000:00010000:1.0:1651529344.600796:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.600798:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ad242558/0x3234de053c4f388 lrc: 4/0,0 mode: PR/PR res: [0x2b786:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80d2 expref: 963 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.600800:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12390 00010000:00010000:1.0:1651529344.600802:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ad242558/0x3234de053c4f388 lrc: 3/0,0 mode: PR/PR res: [0x2b786:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80d2 expref: 962 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.600802:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+962:41279:x1731746396343168:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.600805:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.600806:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad242558/0x3234de053c4f388 lrc: 0/0,0 mode: --/PR res: [0x2b786:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80d2 expref: 962 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.600806:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c3665e26/0x3234de053c4cbdb lrc: 4/0,0 mode: PR/PR res: [0x2b789:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce130 expref: 962 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.600809:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.600810:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.600811:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000695e6e5e/0x3234de053c51649 lrc: 3/0,1 mode: PW/PW res: [0x2b786:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.600814:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000695e6e5e/0x3234de053c51649 lrc: 4/0,1 mode: PW/PW res: [0x2b786:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.600820:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.600828:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c3665e26/0x3234de053c4cbdb lrc: 3/0,0 mode: PR/PR res: [0x2b789:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce130 expref: 961 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.600831:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+961:41279:x1731746396342912:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 37us (139us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.600833:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3665e26/0x3234de053c4cbdb lrc: 0/0,0 mode: --/PR res: [0x2b789:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce130 expref: 961 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.600834:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12389 00010000:00010000:0.0:1651529344.600837:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.600838:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12391 00010000:00010000:0.0:1651529344.600838:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.600838:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51657 lrc: 3/0,1 mode: PW/PW res: [0x2b789:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.600840:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+959:41279:x1731746396343040:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.600841:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51657 lrc: 4/0,1 mode: PW/PW res: [0x2b789:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.600842:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.600844:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000f744e26/0x3234de053c4dc74 lrc: 4/0,0 mode: PR/PR res: [0x2b788:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d21fe expref: 959 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.600847:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000f744e26/0x3234de053c4dc74 lrc: 3/0,0 mode: PR/PR res: [0x2b788:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d21fe expref: 959 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.600852:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f744e26/0x3234de053c4dc74 lrc: 0/0,0 mode: --/PR res: [0x2b788:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d21fe expref: 959 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.600856:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.600856:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.600857:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e8fe7f95/0x3234de053c51650 lrc: 3/0,1 mode: PW/PW res: [0x2b788:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.600858:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.600860:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8fe7f95/0x3234de053c51650 lrc: 4/0,1 mode: PW/PW res: [0x2b788:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.600864:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+958:41279:x1731746396343168:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 62us (159us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.600865:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.600867:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12390 00000100:00100000:1.0:1651529344.600870:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+957:41279:x1731746396343040:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 30us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.600872:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12392 00000100:00100000:1.0:1651529344.600874:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12391 00000100:00100000:0.0:1651529344.600874:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+957:41279:x1731746396343296:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.600876:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.600878:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009c307aec/0x3234de053c4cb33 lrc: 4/0,0 mode: PR/PR res: [0x2b78a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde51 expref: 956 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.600880:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000695e6e5e/0x3234de053c51649 lrc: 3/0,1 mode: PW/PW res: [0x2b786:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.600881:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009c307aec/0x3234de053c4cb33 lrc: 3/0,0 mode: PR/PR res: [0x2b78a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde51 expref: 956 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.600883:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000695e6e5e/0x3234de053c51649 lrc: 3/0,1 mode: PW/PW res: [0x2b786:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.600886:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000695e6e5e/0x3234de053c51649 lrc: 3/0,1 mode: PW/PW res: [0x2b786:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.600886:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c307aec/0x3234de053c4cb33 lrc: 0/0,0 mode: --/PR res: [0x2b78a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde51 expref: 956 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.600889:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000695e6e5e/0x3234de053c51649 lrc: 2/0,0 mode: PW/PW res: [0x2b786:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.600892:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.600893:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.600894:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c5165e lrc: 3/0,1 mode: PW/PW res: [0x2b78a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.600896:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c5165e lrc: 4/0,1 mode: PW/PW res: [0x2b78a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.600909:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.600914:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+955:41279:x1731746396343296:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.600917:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12392 00010000:00010000:0.0:1651529344.600923:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51642 lrc: 3/0,1 mode: PW/PW res: [0x2b784:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.600927:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51642 lrc: 3/0,1 mode: PW/PW res: [0x2b784:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.600930:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51642 lrc: 3/0,1 mode: PW/PW res: [0x2b784:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.600932:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51642 lrc: 2/0,0 mode: PW/PW res: [0x2b784:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.600935:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1107:39029:x1731745946461632:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1211us (1324us total) trans 12885079660 rc 0/0 00000100:00100000:1.0:1651529344.600938:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211607 00010000:00010000:1.0:1651529344.600944:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e8fe7f95/0x3234de053c51650 lrc: 3/0,1 mode: PW/PW res: [0x2b788:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.600948:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8fe7f95/0x3234de053c51650 lrc: 3/0,1 mode: PW/PW res: [0x2b788:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.600951:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8fe7f95/0x3234de053c51650 lrc: 3/0,1 mode: PW/PW res: [0x2b788:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.600953:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8fe7f95/0x3234de053c51650 lrc: 2/0,0 mode: PW/PW res: [0x2b788:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.600983:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1108:39029:x1731745946461504:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1291us (1381us total) trans 12885079661 rc 0/0 00000100:00100000:0.0:1651529344.600986:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211606 00000100:00100000:1.0:1651529344.600991:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfc79d4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1107:39029:x1731745946461760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1213us (1373us total) trans 12885079662 rc 0/0 00010000:00010000:0.0:1651529344.600993:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51657 lrc: 3/0,1 mode: PW/PW res: [0x2b789:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.600994:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211608 00010000:00010000:0.0:1651529344.600996:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51657 lrc: 3/0,1 mode: PW/PW res: [0x2b789:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601000:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51657 lrc: 3/0,1 mode: PW/PW res: [0x2b789:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.601001:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000004e74ca/0x3234de053c5163b lrc: 3/0,1 mode: PW/PW res: [0x2b787:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601002:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51657 lrc: 2/0,0 mode: PW/PW res: [0x2b789:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.601004:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000004e74ca/0x3234de053c5163b lrc: 3/0,1 mode: PW/PW res: [0x2b787:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.601007:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000004e74ca/0x3234de053c5163b lrc: 3/0,1 mode: PW/PW res: [0x2b787:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.601012:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000004e74ca/0x3234de053c5163b lrc: 2/0,0 mode: PW/PW res: [0x2b787:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.601034:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ea32140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1108:39030:x1731745946461824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1251us (1399us total) trans 12885079663 rc 0/0 00000100:00100000:0.0:1651529344.601037:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211609 00010000:00010000:0.0:1651529344.601044:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000695e6e5e/0x3234de053c51649 lrc: 2/0,0 mode: PW/PW res: [0x2b786:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.601046:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1107:39030:x1731745946461696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1385us (1464us total) trans 12885079664 rc 0/0 00010000:00010000:0.0:1651529344.601047:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000695e6e5e already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.601048:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211605 00010000:00010000:0.0:1651529344.601048:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000695e6e5e/0x3234de053c51649 lrc: 2/0,0 mode: PW/PW res: [0x2b786:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601051:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000695e6e5e/0x3234de053c51649 lrc: 3/0,0 mode: PW/PW res: [0x2b786:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601056:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000695e6e5e/0x3234de053c51649 lrc: 1/0,0 mode: --/PW res: [0x2b786:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.601059:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997009856:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.601061:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000695e6e5e/0x3234de053c51649 lrc: 0/0,0 mode: --/PW res: [0x2b786:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.601063:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d5161cbb/0x3234de053c51665 lrc: 3/0,1 mode: --/PW res: [0x2b78b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601065:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51642 lrc: 2/0,0 mode: PW/PW res: [0x2b784:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601068:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e6b94407 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.601069:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51642 lrc: 2/0,0 mode: PW/PW res: [0x2b784:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601071:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51642 lrc: 3/0,0 mode: PW/PW res: [0x2b784:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601074:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51642 lrc: 1/0,0 mode: --/PW res: [0x2b784:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.601076:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.601077:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51642 lrc: 0/0,0 mode: --/PW res: [0x2b784:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601080:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8fe7f95/0x3234de053c51650 lrc: 2/0,0 mode: PW/PW res: [0x2b788:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601083:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e8fe7f95 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.601084:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8fe7f95/0x3234de053c51650 lrc: 2/0,0 mode: PW/PW res: [0x2b788:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601089:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8fe7f95/0x3234de053c51650 lrc: 3/0,0 mode: PW/PW res: [0x2b788:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601100:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8fe7f95/0x3234de053c51650 lrc: 1/0,0 mode: --/PW res: [0x2b788:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601102:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8fe7f95/0x3234de053c51650 lrc: 0/0,0 mode: --/PW res: [0x2b788:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601106:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51657 lrc: 2/0,0 mode: PW/PW res: [0x2b789:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601109:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000491b5359 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.601110:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51657 lrc: 2/0,0 mode: PW/PW res: [0x2b789:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601112:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51657 lrc: 3/0,0 mode: PW/PW res: [0x2b789:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.601114:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.601115:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51657 lrc: 1/0,0 mode: --/PW res: [0x2b789:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601122:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51657 lrc: 0/0,0 mode: --/PW res: [0x2b789:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601126:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000004e74ca/0x3234de053c5163b lrc: 2/0,0 mode: PW/PW res: [0x2b787:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601131:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000004e74ca already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.601132:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000004e74ca/0x3234de053c5163b lrc: 2/0,0 mode: PW/PW res: [0x2b787:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601135:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000004e74ca/0x3234de053c5163b lrc: 3/0,0 mode: PW/PW res: [0x2b787:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601138:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000004e74ca/0x3234de053c5163b lrc: 1/0,0 mode: --/PW res: [0x2b787:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601141:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000004e74ca/0x3234de053c5163b lrc: 0/0,0 mode: --/PW res: [0x2b787:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601146:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c5165e lrc: 3/0,1 mode: PW/PW res: [0x2b78a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601148:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c5165e lrc: 3/0,1 mode: PW/PW res: [0x2b78a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601151:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c5165e lrc: 3/0,1 mode: PW/PW res: [0x2b78a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601154:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c5165e lrc: 2/0,0 mode: PW/PW res: [0x2b78a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.601190:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1107:39030:x1731745946462400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1299us (1336us total) trans 12885079665 rc 0/0 00000100:00100000:0.0:1651529344.601193:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211610 00010000:00010000:0.0:1651529344.601200:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c5165e lrc: 2/0,0 mode: PW/PW res: [0x2b78a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601203:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c9570753 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.601204:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c5165e lrc: 2/0,0 mode: PW/PW res: [0x2b78a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601207:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c5165e lrc: 3/0,0 mode: PW/PW res: [0x2b78a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601211:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c5165e lrc: 1/0,0 mode: --/PW res: [0x2b78a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601243:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9570753/0x3234de053c5165e lrc: 0/0,0 mode: --/PW res: [0x2b78a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.601254:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396343616 00010000:00010000:1.0:1651529344.601260:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a6e983b9/0x3234de053c4cd32 lrc: 4/0,0 mode: PR/PR res: [0x2b78b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce6a8 expref: 955 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.601267:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396343680 00010000:00010000:1.0:1651529344.601269:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fd47abca/0x3234de053c4e6a0 lrc: 5/0,0 mode: PR/PR res: [0x2b78c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b02 expref: 956 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.601275:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12393 00000100:00100000:0.0:1651529344.601275:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b0d9532a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997009920:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.601277:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000781af77d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+956:41279:x1731746396343616:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.601279:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c5166c lrc: 3/0,1 mode: --/PW res: [0x2b78c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.601280:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.601281:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a6e983b9/0x3234de053c4cd32 lrc: 4/0,0 mode: PR/PR res: [0x2b78b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce6a8 expref: 956 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.601287:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a6e983b9/0x3234de053c4cd32 lrc: 3/0,0 mode: PR/PR res: [0x2b78b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce6a8 expref: 956 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.601288:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12394 00000100:00100000:0.0:1651529344.601290:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+956:41278:x1731746396343680:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.601293:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6e983b9/0x3234de053c4cd32 lrc: 0/0,0 mode: --/PR res: [0x2b78b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce6a8 expref: 956 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.601293:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.601295:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fd47abca/0x3234de053c4e6a0 lrc: 4/0,0 mode: PR/PR res: [0x2b78c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b02 expref: 956 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.601296:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.601297:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.601297:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d5161cbb/0x3234de053c51665 lrc: 3/0,1 mode: PW/PW res: [0x2b78b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601299:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fd47abca/0x3234de053c4e6a0 lrc: 3/0,0 mode: PR/PR res: [0x2b78c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b02 expref: 955 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.601301:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5161cbb/0x3234de053c51665 lrc: 4/0,1 mode: PW/PW res: [0x2b78b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601304:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd47abca/0x3234de053c4e6a0 lrc: 0/0,0 mode: --/PR res: [0x2b78c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b02 expref: 955 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.601307:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.601307:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.601308:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.601309:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c5166c lrc: 3/0,1 mode: PW/PW res: [0x2b78c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601312:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c5166c lrc: 4/0,1 mode: PW/PW res: [0x2b78c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.601314:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000781af77d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+954:41279:x1731746396343616:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 37us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.601317:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12393 00010000:00010000:0.0:1651529344.601318:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.601325:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+953:41278:x1731746396343680:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (211us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.601326:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d5161cbb/0x3234de053c51665 lrc: 3/0,1 mode: PW/PW res: [0x2b78b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.601327:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12394 00010000:00010000:1.0:1651529344.601330:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5161cbb/0x3234de053c51665 lrc: 3/0,1 mode: PW/PW res: [0x2b78b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.601333:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5161cbb/0x3234de053c51665 lrc: 3/0,1 mode: PW/PW res: [0x2b78b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601334:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c5166c lrc: 3/0,1 mode: PW/PW res: [0x2b78c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601337:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c5166c lrc: 3/0,1 mode: PW/PW res: [0x2b78c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.601338:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5161cbb/0x3234de053c51665 lrc: 2/0,0 mode: PW/PW res: [0x2b78b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601340:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c5166c lrc: 3/0,1 mode: PW/PW res: [0x2b78c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601352:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c5166c lrc: 2/0,0 mode: PW/PW res: [0x2b78c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.601386:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1107:39030:x1731745946462464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 940us (973us total) trans 12885079666 rc 0/0 00000100:00100000:1.0:1651529344.601389:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211611 00000100:00100000:1.0:1651529344.601404:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.601434:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1107:39029:x1731745946462528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 981us (1012us total) trans 12885079667 rc 0/0 00000100:00100000:0.0:1651529344.601437:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211612 00000100:00100000:1.0:1651529344.601439:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.601450:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946462784 00000100:00100000:1.0:1651529344.601455:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.601467:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946462720 00000100:00100000:0.0:1651529344.601474:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946462912 00000100:00100000:0.0:1651529344.601479:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211613 00000100:00100000:0.0:1651529344.601480:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1109:39029:x1731745946462784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.601486:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178062 count 1 00010000:00010000:0.0:1651529344.601490:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c51673 lrc: 3/0,1 mode: --/PW res: [0x2b78e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601495:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c4cf4d lrc: 2/0,0 mode: PR/PR res: [0x2b78e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceef8 expref: 952 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.601497:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.601498:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.601498:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.601499:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c51673 lrc: 4/0,1 mode: --/PW res: [0x2b78e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601506:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c4cf4d lrc: 3/0,0 mode: PR/PR res: [0x2b78e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceef8 expref: 952 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.601510:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c4cf4d lrc: 4/0,0 mode: PR/PR res: [0x2b78e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceef8 expref: 952 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.601514:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b0d9532a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997009984:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.601523:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.601523:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000029ae2bb2 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.601536:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5161cbb/0x3234de053c51665 lrc: 2/0,0 mode: PW/PW res: [0x2b78b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601539:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d5161cbb already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.601540:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5161cbb/0x3234de053c51665 lrc: 2/0,0 mode: PW/PW res: [0x2b78b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601543:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5161cbb/0x3234de053c51665 lrc: 3/0,0 mode: PW/PW res: [0x2b78b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601548:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5161cbb/0x3234de053c51665 lrc: 1/0,0 mode: --/PW res: [0x2b78b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601550:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5161cbb/0x3234de053c51665 lrc: 0/0,0 mode: --/PW res: [0x2b78b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.601554:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.601555:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c5166c lrc: 2/0,0 mode: PW/PW res: [0x2b78c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601557:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d1b07eb5 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.601558:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c5166c lrc: 2/0,0 mode: PW/PW res: [0x2b78c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601561:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c5166c lrc: 3/0,0 mode: PW/PW res: [0x2b78c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.601562:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946462848 00010000:00010000:0.0:1651529344.601564:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c5166c lrc: 1/0,0 mode: --/PW res: [0x2b78c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601567:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1b07eb5/0x3234de053c5166c lrc: 0/0,0 mode: --/PW res: [0x2b78c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.601572:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946463040 00000100:00100000:1.0:1651529344.601576:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946462976 00000100:00100000:1.0:1651529344.601579:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211614 00000100:00100000:1.0:1651529344.601581:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1112:39030:x1731745946462720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.601581:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211615 00002000:00080000:1.0:1651529344.601586:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178061 count 1 00010000:00010000:1.0:1651529344.601590:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080981043/0x3234de053c5167a lrc: 3/0,1 mode: --/PW res: [0x2b78d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.601595:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000174ef069/0x3234de053c4c950 lrc: 2/0,0 mode: PR/PR res: [0x2b78d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd6b7 expref: 952 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.601597:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1112:39029:x1731745946462912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.601598:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.601599:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.601600:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080981043/0x3234de053c5167a lrc: 4/0,1 mode: --/PW res: [0x2b78d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.601602:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178064 count 1 00010000:00010000:0.0:1651529344.601606:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c51681 lrc: 3/0,1 mode: --/PW res: [0x2b790:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.601607:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000174ef069/0x3234de053c4c950 lrc: 3/0,0 mode: PR/PR res: [0x2b78d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd6b7 expref: 952 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.601610:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000174ef069/0x3234de053c4c950 lrc: 4/0,0 mode: PR/PR res: [0x2b78d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd6b7 expref: 952 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.601610:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003db8eee7/0x3234de053c4f127 lrc: 2/0,0 mode: PR/PR res: [0x2b790:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7747 expref: 952 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.601613:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.601614:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997010048:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.601614:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.601615:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c51681 lrc: 4/0,1 mode: --/PW res: [0x2b790:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601621:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003db8eee7/0x3234de053c4f127 lrc: 3/0,0 mode: PR/PR res: [0x2b790:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7747 expref: 952 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.601624:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003db8eee7/0x3234de053c4f127 lrc: 4/0,0 mode: PR/PR res: [0x2b790:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7747 expref: 952 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.601625:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b7af823 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.601631:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211616 00000100:00100000:1.0:1651529344.601632:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1112:39030:x1731745946462848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.601637:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178063 count 1 00010000:00010000:1.0:1651529344.601640:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067750919/0x3234de053c51688 lrc: 3/0,1 mode: --/PW res: [0x2b78f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.601644:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ccb1f748/0x3234de053c4c8b6 lrc: 2/0,0 mode: PR/PR res: [0x2b78f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd480 expref: 952 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.601644:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006731397d pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997010112:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.601647:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.601647:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.601648:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067750919/0x3234de053c51688 lrc: 4/0,1 mode: --/PW res: [0x2b78f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.601653:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c2b2b59c going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.601654:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ccb1f748/0x3234de053c4c8b6 lrc: 3/0,0 mode: PR/PR res: [0x2b78f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd480 expref: 952 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.601660:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ccb1f748/0x3234de053c4c8b6 lrc: 4/0,0 mode: PR/PR res: [0x2b78f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd480 expref: 952 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.601664:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000055e03b4f pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997010176:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.601670:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 0000000099c1da85 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.601674:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211617 00000100:00100000:1.0:1651529344.601676:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211618 00000100:00100000:0.0:1651529344.601676:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1112:39029:x1731745946463040:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.601678:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1112:39030:x1731745946462976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.601681:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178065 count 1 00002000:00080000:0.0:1651529344.601681:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178066 count 1 00010000:00010000:1.0:1651529344.601684:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dbec785/0x3234de053c51696 lrc: 3/0,1 mode: --/PW res: [0x2b791:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.601688:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a7c68d66/0x3234de053c4dbb0 lrc: 2/0,0 mode: PR/PR res: [0x2b791:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ed2 expref: 952 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.601691:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.601692:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.601692:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dbec785/0x3234de053c51696 lrc: 4/0,1 mode: --/PW res: [0x2b791:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601694:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c5168f lrc: 3/0,1 mode: --/PW res: [0x2b792:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.601698:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a7c68d66/0x3234de053c4dbb0 lrc: 3/0,0 mode: PR/PR res: [0x2b791:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ed2 expref: 952 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.601699:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f9b662b3/0x3234de053c4d4da lrc: 2/0,0 mode: PR/PR res: [0x2b792:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0572 expref: 952 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.601701:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a7c68d66/0x3234de053c4dbb0 lrc: 4/0,0 mode: PR/PR res: [0x2b791:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ed2 expref: 952 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.601702:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.601702:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.601703:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c5168f lrc: 4/0,1 mode: --/PW res: [0x2b792:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.601708:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000824ca843 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997010240:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.601710:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f9b662b3/0x3234de053c4d4da lrc: 3/0,0 mode: PR/PR res: [0x2b792:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0572 expref: 952 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.601713:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 000000007d8fabda going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.601713:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f9b662b3/0x3234de053c4d4da lrc: 4/0,0 mode: PR/PR res: [0x2b792:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0572 expref: 952 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.601717:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085af61db pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997010304:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.601725:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e68b7e1f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.601753:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.601753:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b0d9532a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997009984:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.601762:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c51673 lrc: 3/0,1 mode: --/PW res: [0x2b78e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.601769:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946463552 00000100:00100000:1.0:1651529344.601776:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.601776:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211619 00000100:00100000:0.0:1651529344.601777:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1113:39029:x1731745946463552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.601782:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178068 count 1 00010000:00010000:0.0:1651529344.601786:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c5169d lrc: 3/0,1 mode: --/PW res: [0x2b794:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601790:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ccaf8927/0x3234de053c4d130 lrc: 2/0,0 mode: PR/PR res: [0x2b794:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf65a expref: 952 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.601793:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.601793:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.601794:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c5169d lrc: 4/0,1 mode: --/PW res: [0x2b794:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.601799:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.601800:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ccaf8927/0x3234de053c4d130 lrc: 3/0,0 mode: PR/PR res: [0x2b794:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf65a expref: 952 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.601810:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ccaf8927/0x3234de053c4d130 lrc: 4/0,0 mode: PR/PR res: [0x2b794:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf65a expref: 952 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.601814:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b0d9532a pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997010368:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.601822:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000afe7ff7b going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.601828:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946463488 00000100:00100000:0.0:1651529344.601839:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211620 00000100:00100000:0.0:1651529344.601841:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1114:39030:x1731745946463488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.601845:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178067 count 1 00010000:00010000:0.0:1651529344.601849:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c516a4 lrc: 3/0,1 mode: --/PW res: [0x2b793:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601853:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000133beab8/0x3234de053c4f0e8 lrc: 2/0,0 mode: PR/PR res: [0x2b793:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d760c expref: 952 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.601856:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.601856:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.601857:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c516a4 lrc: 4/0,1 mode: --/PW res: [0x2b793:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601863:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000133beab8/0x3234de053c4f0e8 lrc: 3/0,0 mode: PR/PR res: [0x2b793:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d760c expref: 952 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.601866:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000133beab8/0x3234de053c4f0e8 lrc: 4/0,0 mode: PR/PR res: [0x2b793:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d760c expref: 952 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.601870:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396343872 00010000:00010000:1.0:1651529344.601876:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c4cf4d lrc: 4/0,0 mode: PR/PR res: [0x2b78e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceef8 expref: 953 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.601888:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12395 00000100:00100000:1.0:1651529344.601890:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+953:41279:x1731746396343872:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.601891:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000de0edbdc pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997010432:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.601893:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.601894:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c4cf4d lrc: 4/0,0 mode: PR/PR res: [0x2b78e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceef8 expref: 953 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.601898:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c4cf4d lrc: 3/0,0 mode: PR/PR res: [0x2b78e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceef8 expref: 953 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.601905:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ff7bf023 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.601910:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c4cf4d lrc: 0/0,0 mode: --/PR res: [0x2b78e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceef8 expref: 953 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.601914:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.601914:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.601915:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c51673 lrc: 3/0,1 mode: PW/PW res: [0x2b78e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.601921:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c51673 lrc: 4/0,1 mode: PW/PW res: [0x2b78e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.601933:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.601940:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+952:41279:x1731746396343872:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 49us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.601942:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12395 00010000:00010000:0.0:1651529344.601961:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c51673 lrc: 3/0,1 mode: PW/PW res: [0x2b78e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601965:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c51673 lrc: 3/0,1 mode: PW/PW res: [0x2b78e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601971:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c51673 lrc: 3/0,1 mode: PW/PW res: [0x2b78e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.601979:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c51673 lrc: 2/0,0 mode: PW/PW res: [0x2b78e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.602052:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1115:39029:x1731745946462784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 570us (647us total) trans 12885079668 rc 0/0 00000100:00100000:0.0:1651529344.602055:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211613 00010000:00010000:0.0:1651529344.602062:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c51673 lrc: 2/0,0 mode: PW/PW res: [0x2b78e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.602066:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000004c7843a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.602067:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c51673 lrc: 2/0,0 mode: PW/PW res: [0x2b78e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.602070:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c51673 lrc: 3/0,0 mode: PW/PW res: [0x2b78e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.602087:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c51673 lrc: 1/0,0 mode: --/PW res: [0x2b78e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.602090:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004c7843a/0x3234de053c51673 lrc: 0/0,0 mode: --/PW res: [0x2b78e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.602138:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997010048:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.602142:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000080981043/0x3234de053c5167a lrc: 3/0,1 mode: --/PW res: [0x2b78d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.602158:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000824ca843 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997010240:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.602161:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003dbec785/0x3234de053c51696 lrc: 3/0,1 mode: --/PW res: [0x2b791:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.602168:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000055e03b4f pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997010176:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.602170:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000067750919/0x3234de053c51688 lrc: 3/0,1 mode: --/PW res: [0x2b78f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.602173:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b0d9532a pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997010368:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.602177:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c5169d lrc: 3/0,1 mode: --/PW res: [0x2b794:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.602184:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085af61db pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997010304:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.602187:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c5168f lrc: 3/0,1 mode: --/PW res: [0x2b792:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.602193:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006731397d pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997010112:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.602195:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c51681 lrc: 3/0,1 mode: --/PW res: [0x2b790:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.602200:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000de0edbdc pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997010432:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.602203:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c516a4 lrc: 3/0,1 mode: --/PW res: [0x2b793:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.602256:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.602267:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946463616 00000100:00100000:0.0:1651529344.602278:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211621 00000100:00100000:0.0:1651529344.602280:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1115:39030:x1731745946463616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.602285:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178069 count 1 00010000:00010000:0.0:1651529344.602289:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c516ab lrc: 3/0,1 mode: --/PW res: [0x2b795:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.602293:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000041483b76/0x3234de053c4a07d lrc: 2/0,0 mode: PR/PR res: [0x2b795:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7bc expref: 951 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.602296:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.602297:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.602298:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c516ab lrc: 4/0,1 mode: --/PW res: [0x2b795:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.602305:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000041483b76/0x3234de053c4a07d lrc: 3/0,0 mode: PR/PR res: [0x2b795:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7bc expref: 951 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.602308:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000041483b76/0x3234de053c4a07d lrc: 4/0,0 mode: PR/PR res: [0x2b795:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7bc expref: 951 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.602312:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000de0edbdc pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997010496:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.602324:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c2b2b59c going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.602507:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.602523:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396343936 00000100:00100000:1.0:1651529344.602528:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.602529:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000174ef069/0x3234de053c4c950 lrc: 4/0,0 mode: PR/PR res: [0x2b78d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd6b7 expref: 952 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.602545:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.602555:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396344064 00010000:00010000:0.0:1651529344.602558:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ccb1f748/0x3234de053c4c8b6 lrc: 4/0,0 mode: PR/PR res: [0x2b78f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd480 expref: 953 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.602559:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.602563:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396344000 00000100:00100000:1.0:1651529344.602565:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.602565:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003db8eee7/0x3234de053c4f127 lrc: 4/0,0 mode: PR/PR res: [0x2b790:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7747 expref: 954 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.602570:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.602570:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396344192 00010000:00010000:0.0:1651529344.602572:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f9b662b3/0x3234de053c4d4da lrc: 4/0,0 mode: PR/PR res: [0x2b792:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0572 expref: 955 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.602575:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.602576:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396344128 00010000:00010000:0.0:1651529344.602578:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a7c68d66/0x3234de053c4dbb0 lrc: 4/0,0 mode: PR/PR res: [0x2b791:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ed2 expref: 956 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.602582:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396344320 00000100:00100000:1.0:1651529344.602590:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396344256 00010000:00010000:0.0:1651529344.602590:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000133beab8/0x3234de053c4f0e8 lrc: 4/0,0 mode: PR/PR res: [0x2b793:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d760c expref: 957 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.602595:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ccaf8927/0x3234de053c4d130 lrc: 4/0,0 mode: PR/PR res: [0x2b794:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf65a expref: 958 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.602596:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12396 00000100:00100000:0.0:1651529344.602597:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+958:41279:x1731746396343936:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.602600:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.602601:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000174ef069/0x3234de053c4c950 lrc: 4/0,0 mode: PR/PR res: [0x2b78d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd6b7 expref: 958 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.602602:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12397 00000100:00100000:1.0:1651529344.602604:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+958:41279:x1731746396344064:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.602605:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000174ef069/0x3234de053c4c950 lrc: 3/0,0 mode: PR/PR res: [0x2b78d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd6b7 expref: 958 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.602607:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.602608:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ccb1f748/0x3234de053c4c8b6 lrc: 4/0,0 mode: PR/PR res: [0x2b78f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd480 expref: 958 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.602611:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000174ef069/0x3234de053c4c950 lrc: 0/0,0 mode: --/PR res: [0x2b78d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd6b7 expref: 958 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.602612:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ccb1f748/0x3234de053c4c8b6 lrc: 3/0,0 mode: PR/PR res: [0x2b78f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd480 expref: 958 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.602615:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.602615:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.602616:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000080981043/0x3234de053c5167a lrc: 3/0,1 mode: PW/PW res: [0x2b78d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.602618:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ccb1f748/0x3234de053c4c8b6 lrc: 0/0,0 mode: --/PR res: [0x2b78f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd480 expref: 957 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.602619:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080981043/0x3234de053c5167a lrc: 4/0,1 mode: PW/PW res: [0x2b78d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.602621:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.602622:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.602623:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000067750919/0x3234de053c51688 lrc: 3/0,1 mode: PW/PW res: [0x2b78f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.602626:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067750919/0x3234de053c51688 lrc: 4/0,1 mode: PW/PW res: [0x2b78f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.602629:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.602638:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.602650:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+956:41279:x1731746396344064:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 45us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.602653:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12397 00000100:00100000:0.0:1651529344.602660:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+956:41279:x1731746396343936:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 62us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.602663:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12398 00000100:00100000:1.0:1651529344.602665:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+955:41278:x1731746396344000:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.602665:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12396 00010000:00010000:1.0:1651529344.602668:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.602669:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003db8eee7/0x3234de053c4f127 lrc: 4/0,0 mode: PR/PR res: [0x2b790:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7747 expref: 954 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.602671:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12399 00010000:00010000:1.0:1651529344.602673:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003db8eee7/0x3234de053c4f127 lrc: 3/0,0 mode: PR/PR res: [0x2b790:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7747 expref: 954 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.602673:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+954:41279:x1731746396344192:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.602676:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.602677:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f9b662b3/0x3234de053c4d4da lrc: 4/0,0 mode: PR/PR res: [0x2b792:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0572 expref: 954 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.602678:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003db8eee7/0x3234de053c4f127 lrc: 0/0,0 mode: --/PR res: [0x2b790:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7747 expref: 954 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.602681:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.602681:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f9b662b3/0x3234de053c4d4da lrc: 3/0,0 mode: PR/PR res: [0x2b792:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0572 expref: 953 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.602682:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.602682:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c51681 lrc: 3/0,1 mode: PW/PW res: [0x2b790:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.602685:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c51681 lrc: 4/0,1 mode: PW/PW res: [0x2b790:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.602686:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9b662b3/0x3234de053c4d4da lrc: 0/0,0 mode: --/PR res: [0x2b792:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0572 expref: 953 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.602689:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.602690:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.602691:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c5168f lrc: 3/0,1 mode: PW/PW res: [0x2b792:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.602694:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.602699:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+952:41278:x1731746396344000:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 34us (155us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.602700:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c5168f lrc: 4/0,1 mode: PW/PW res: [0x2b792:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.602702:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12398 00000100:00100000:1.0:1651529344.602706:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12400 00010000:00010000:0.0:1651529344.602706:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.602708:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de45c136 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+951:41278:x1731746396344128:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.602710:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.602712:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a7c68d66/0x3234de053c4dbb0 lrc: 4/0,0 mode: PR/PR res: [0x2b791:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ed2 expref: 951 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.602712:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+951:41279:x1731746396344192:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 39us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.602715:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12399 00010000:00010000:1.0:1651529344.602716:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a7c68d66/0x3234de053c4dbb0 lrc: 3/0,0 mode: PR/PR res: [0x2b791:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ed2 expref: 951 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.602720:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7c68d66/0x3234de053c4dbb0 lrc: 0/0,0 mode: --/PR res: [0x2b791:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ed2 expref: 950 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.602720:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12401 00000100:00100000:0.0:1651529344.602721:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+950:41279:x1731746396344320:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.602723:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.602724:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.602724:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.602725:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003dbec785/0x3234de053c51696 lrc: 3/0,1 mode: PW/PW res: [0x2b791:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.602725:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000133beab8/0x3234de053c4f0e8 lrc: 4/0,0 mode: PR/PR res: [0x2b793:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d760c expref: 949 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.602728:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dbec785/0x3234de053c51696 lrc: 4/0,1 mode: PW/PW res: [0x2b791:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.602729:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000133beab8/0x3234de053c4f0e8 lrc: 3/0,0 mode: PR/PR res: [0x2b793:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d760c expref: 949 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.602743:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.602743:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000133beab8/0x3234de053c4f0e8 lrc: 0/0,0 mode: --/PR res: [0x2b793:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d760c expref: 949 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.602747:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.602747:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.602748:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de45c136 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+948:41278:x1731746396344128:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 40us (183us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.602748:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c516a4 lrc: 3/0,1 mode: PW/PW res: [0x2b793:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.602751:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12400 00010000:00010000:0.0:1651529344.602751:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c516a4 lrc: 4/0,1 mode: PW/PW res: [0x2b793:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.602758:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.602759:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12402 00000100:00100000:1.0:1651529344.602761:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+947:41278:x1731746396344256:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.602763:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.602764:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+947:41279:x1731746396344320:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (194us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.602765:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ccaf8927/0x3234de053c4d130 lrc: 4/0,0 mode: PR/PR res: [0x2b794:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf65a expref: 947 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.602767:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12401 00010000:00010000:1.0:1651529344.602769:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ccaf8927/0x3234de053c4d130 lrc: 3/0,0 mode: PR/PR res: [0x2b794:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf65a expref: 947 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.602773:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c51681 lrc: 3/0,1 mode: PW/PW res: [0x2b790:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.602774:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ccaf8927/0x3234de053c4d130 lrc: 0/0,0 mode: --/PR res: [0x2b794:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf65a expref: 946 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.602777:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.602777:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.602777:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c51681 lrc: 3/0,1 mode: PW/PW res: [0x2b790:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.602778:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c5169d lrc: 3/0,1 mode: PW/PW res: [0x2b794:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.602780:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c51681 lrc: 3/0,1 mode: PW/PW res: [0x2b790:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.602781:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c5169d lrc: 4/0,1 mode: PW/PW res: [0x2b794:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.602783:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c51681 lrc: 2/0,0 mode: PW/PW res: [0x2b790:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.602790:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.602796:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+945:41278:x1731746396344256:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 35us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.602798:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12402 00010000:00010000:1.0:1651529344.602806:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000080981043/0x3234de053c5167a lrc: 3/0,1 mode: PW/PW res: [0x2b78d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.602810:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080981043/0x3234de053c5167a lrc: 3/0,1 mode: PW/PW res: [0x2b78d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.602813:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080981043/0x3234de053c5167a lrc: 3/0,1 mode: PW/PW res: [0x2b78d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.602818:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080981043/0x3234de053c5167a lrc: 2/0,0 mode: PW/PW res: [0x2b78d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.602835:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1116:39029:x1731745946462912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1237us (1379us total) trans 12885079669 rc 0/0 00000100:00100000:0.0:1651529344.602838:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211615 00010000:00010000:0.0:1651529344.602844:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c5168f lrc: 3/0,1 mode: PW/PW res: [0x2b792:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.602848:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c5168f lrc: 3/0,1 mode: PW/PW res: [0x2b792:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.602851:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c5168f lrc: 3/0,1 mode: PW/PW res: [0x2b792:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.602853:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c5168f lrc: 2/0,0 mode: PW/PW res: [0x2b792:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.602861:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1116:39030:x1731745946462720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1279us (1422us total) trans 12885079670 rc 0/0 00000100:00100000:1.0:1651529344.602864:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211614 00010000:00010000:1.0:1651529344.602871:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000067750919/0x3234de053c51688 lrc: 3/0,1 mode: PW/PW res: [0x2b78f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.602874:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067750919/0x3234de053c51688 lrc: 3/0,1 mode: PW/PW res: [0x2b78f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.602877:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067750919/0x3234de053c51688 lrc: 3/0,1 mode: PW/PW res: [0x2b78f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.602880:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067750919/0x3234de053c51688 lrc: 2/0,0 mode: PW/PW res: [0x2b78f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.602888:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1116:39029:x1731745946463040:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1211us (1364us total) trans 12885079671 rc 0/0 00000100:00100000:0.0:1651529344.602891:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211617 00010000:00010000:0.0:1651529344.602897:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c516a4 lrc: 3/0,1 mode: PW/PW res: [0x2b793:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.602903:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c516a4 lrc: 3/0,1 mode: PW/PW res: [0x2b793:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.602906:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c516a4 lrc: 3/0,1 mode: PW/PW res: [0x2b793:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.602908:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c516a4 lrc: 2/0,0 mode: PW/PW res: [0x2b793:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.602910:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1116:39030:x1731745946462848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1277us (1413us total) trans 12885079672 rc 0/0 00000100:00100000:1.0:1651529344.602913:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211616 00010000:00010000:1.0:1651529344.602919:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003dbec785/0x3234de053c51696 lrc: 3/0,1 mode: PW/PW res: [0x2b791:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.602922:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003dbec785/0x3234de053c51696 lrc: 3/0,1 mode: PW/PW res: [0x2b791:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.602927:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dbec785/0x3234de053c51696 lrc: 3/0,1 mode: PW/PW res: [0x2b791:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.602930:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003dbec785/0x3234de053c51696 lrc: 2/0,0 mode: PW/PW res: [0x2b791:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.602937:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1116:39030:x1731745946463488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1096us (1139us total) trans 12885079673 rc 0/0 00000100:00100000:0.0:1651529344.602940:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211620 00010000:00010000:0.0:1651529344.602946:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c51681 lrc: 2/0,0 mode: PW/PW res: [0x2b790:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.602950:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e696ff9d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.602951:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c51681 lrc: 2/0,0 mode: PW/PW res: [0x2b790:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.602953:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c51681 lrc: 3/0,0 mode: PW/PW res: [0x2b790:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.602958:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c51681 lrc: 1/0,0 mode: --/PW res: [0x2b790:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.602959:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1116:39030:x1731745946462976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1280us (1404us total) trans 12885079674 rc 0/0 00010000:00010000:0.0:1651529344.602960:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e696ff9d/0x3234de053c51681 lrc: 0/0,0 mode: --/PW res: [0x2b790:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.602961:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211618 00010000:00010000:0.0:1651529344.602965:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080981043/0x3234de053c5167a lrc: 2/0,0 mode: PW/PW res: [0x2b78d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.602967:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000080981043 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.602968:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080981043/0x3234de053c5167a lrc: 2/0,0 mode: PW/PW res: [0x2b78d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.602971:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080981043/0x3234de053c5167a lrc: 3/0,0 mode: PW/PW res: [0x2b78d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.602974:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080981043/0x3234de053c5167a lrc: 1/0,0 mode: --/PW res: [0x2b78d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.602977:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080981043/0x3234de053c5167a lrc: 0/0,0 mode: --/PW res: [0x2b78d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.602980:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c5168f lrc: 2/0,0 mode: PW/PW res: [0x2b792:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.602983:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a706026 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.602983:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c5168f lrc: 2/0,0 mode: PW/PW res: [0x2b792:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.602986:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c5168f lrc: 3/0,0 mode: PW/PW res: [0x2b792:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.602987:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.602989:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c5168f lrc: 1/0,0 mode: --/PW res: [0x2b792:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.602992:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a706026/0x3234de053c5168f lrc: 0/0,0 mode: --/PW res: [0x2b792:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.602995:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067750919/0x3234de053c51688 lrc: 2/0,0 mode: PW/PW res: [0x2b78f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.602998:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067750919 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.602999:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067750919/0x3234de053c51688 lrc: 2/0,0 mode: PW/PW res: [0x2b78f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603001:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067750919/0x3234de053c51688 lrc: 3/0,0 mode: PW/PW res: [0x2b78f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603004:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067750919/0x3234de053c51688 lrc: 1/0,0 mode: --/PW res: [0x2b78f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603007:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067750919/0x3234de053c51688 lrc: 0/0,0 mode: --/PW res: [0x2b78f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603010:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c516a4 lrc: 2/0,0 mode: PW/PW res: [0x2b793:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603013:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000acc438d7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.603013:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c516a4 lrc: 2/0,0 mode: PW/PW res: [0x2b793:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603018:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c516a4 lrc: 3/0,0 mode: PW/PW res: [0x2b793:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603021:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c516a4 lrc: 1/0,0 mode: --/PW res: [0x2b793:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603024:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c516a4 lrc: 0/0,0 mode: --/PW res: [0x2b793:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603027:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003dbec785/0x3234de053c51696 lrc: 2/0,0 mode: PW/PW res: [0x2b791:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603030:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003dbec785 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.603030:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003dbec785/0x3234de053c51696 lrc: 2/0,0 mode: PW/PW res: [0x2b791:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603033:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003dbec785/0x3234de053c51696 lrc: 3/0,0 mode: PW/PW res: [0x2b791:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603036:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003dbec785/0x3234de053c51696 lrc: 1/0,0 mode: --/PW res: [0x2b791:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603038:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003dbec785/0x3234de053c51696 lrc: 0/0,0 mode: --/PW res: [0x2b791:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603044:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c5169d lrc: 3/0,1 mode: PW/PW res: [0x2b794:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603049:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c5169d lrc: 3/0,1 mode: PW/PW res: [0x2b794:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603051:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c5169d lrc: 3/0,1 mode: PW/PW res: [0x2b794:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603054:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c5169d lrc: 2/0,0 mode: PW/PW res: [0x2b794:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.603086:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1116:39029:x1731745946463552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1308us (1333us total) trans 12885079675 rc 0/0 00000100:00100000:0.0:1651529344.603103:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211619 00010000:00010000:0.0:1651529344.603110:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c5169d lrc: 2/0,0 mode: PW/PW res: [0x2b794:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603113:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000073043e99 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.603114:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c5169d lrc: 2/0,0 mode: PW/PW res: [0x2b794:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603117:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c5169d lrc: 3/0,0 mode: PW/PW res: [0x2b794:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603121:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c5169d lrc: 1/0,0 mode: --/PW res: [0x2b794:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.603128:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396344768 00010000:00010000:1.0:1651529344.603134:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000041483b76/0x3234de053c4a07d lrc: 5/0,0 mode: PR/PR res: [0x2b795:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7bc expref: 945 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.603137:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c5169d lrc: 0/0,0 mode: --/PW res: [0x2b794:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.603142:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12403 00000100:00100000:1.0:1651529344.603144:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+945:41278:x1731746396344768:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.603147:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.603148:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000041483b76/0x3234de053c4a07d lrc: 5/0,0 mode: PR/PR res: [0x2b795:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7bc expref: 945 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.603152:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000041483b76/0x3234de053c4a07d lrc: 3/0,0 mode: PR/PR res: [0x2b795:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7bc expref: 945 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.603152:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000de0edbdc pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997010496:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.603157:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041483b76/0x3234de053c4a07d lrc: 0/0,0 mode: --/PR res: [0x2b795:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7bc expref: 945 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.603163:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.603164:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.603165:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c516ab lrc: 3/0,1 mode: PW/PW res: [0x2b795:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.603168:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c516ab lrc: 4/0,1 mode: PW/PW res: [0x2b795:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.603173:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.603181:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+944:41278:x1731746396344768:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.603183:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12403 00010000:00010000:0.0:1651529344.603184:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c516ab lrc: 3/0,1 mode: PW/PW res: [0x2b795:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603190:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c516ab lrc: 3/0,1 mode: PW/PW res: [0x2b795:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603194:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c516ab lrc: 3/0,1 mode: PW/PW res: [0x2b795:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603199:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c516ab lrc: 3/0,1 mode: PW/PW res: [0x2b795:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603204:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c516ab lrc: 2/0,0 mode: PW/PW res: [0x2b795:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.603295:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.603306:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.603315:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.603315:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1116:39030:x1731745946463616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1034us (1059us total) trans 12885079676 rc 0/0 00000100:00100000:0.0:1651529344.603324:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211621 00000100:00100000:0.0:1651529344.603330:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946463872 00000100:00100000:0.0:1651529344.603352:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946463808 00000100:00100000:0.0:1651529344.603357:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946463936 00000100:00100000:1.0:1651529344.603360:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.603376:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946464000 00000100:00100000:0.0:1651529344.603383:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211622 00000100:00100000:0.0:1651529344.603385:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050a0adb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1119:39030:x1731745946463872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.603386:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.603395:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178071 count 1 00000100:00100000:1.0:1651529344.603396:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.603400:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c516b2 lrc: 3/0,1 mode: --/PW res: [0x2b797:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.603403:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.603405:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d03fa777/0x3234de053c4c89a lrc: 2/0,0 mode: PR/PR res: [0x2b797:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd43a expref: 943 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.603408:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.603409:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.603409:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c516b2 lrc: 4/0,1 mode: --/PW res: [0x2b797:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.603412:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946464128 00010000:00010000:0.0:1651529344.603416:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d03fa777/0x3234de053c4c89a lrc: 3/0,0 mode: PR/PR res: [0x2b797:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd43a expref: 943 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.603417:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946464064 00000100:00100000:1.0:1651529344.603419:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946464192 00010000:00010000:0.0:1651529344.603420:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d03fa777/0x3234de053c4c89a lrc: 4/0,0 mode: PR/PR res: [0x2b797:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd43a expref: 943 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.603422:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211623 00000100:00100000:1.0:1651529344.603424:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1122:39029:x1731745946463808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.603424:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000de0edbdc pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997010560:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.603429:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178070 count 1 00010000:00010000:1.0:1651529344.603434:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c516b9 lrc: 3/0,1 mode: --/PW res: [0x2b796:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.603441:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d9ffd789/0x3234de053c4cad1 lrc: 2/0,0 mode: PR/PR res: [0x2b796:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd08 expref: 943 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.603444:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.603445:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.603445:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c516b9 lrc: 4/0,1 mode: --/PW res: [0x2b796:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.603455:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000504ef660 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.603460:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d9ffd789/0x3234de053c4cad1 lrc: 3/0,0 mode: PR/PR res: [0x2b796:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd08 expref: 943 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.603462:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211624 00010000:00010000:1.0:1651529344.603463:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d9ffd789/0x3234de053c4cad1 lrc: 4/0,0 mode: PR/PR res: [0x2b796:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd08 expref: 943 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.603464:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1122:39029:x1731745946463936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.603468:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997010624:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.603469:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178072 count 1 00010000:00010000:0.0:1651529344.603473:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c516c0 lrc: 3/0,1 mode: --/PW res: [0x2b798:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.603477:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 000000007d8fabda going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.603478:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c4c719 lrc: 2/0,0 mode: PR/PR res: [0x2b798:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce52 expref: 943 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.603483:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211625 00010000:00010000:0.0:1651529344.603483:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.603484:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.603484:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c516c0 lrc: 4/0,1 mode: --/PW res: [0x2b798:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.603485:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1122:39030:x1731745946464000:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.603489:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178073 count 1 00010000:00010000:0.0:1651529344.603491:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c4c719 lrc: 3/0,0 mode: PR/PR res: [0x2b798:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce52 expref: 943 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.603493:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a74ee8f/0x3234de053c516c7 lrc: 3/0,1 mode: --/PW res: [0x2b799:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603494:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c4c719 lrc: 4/0,0 mode: PR/PR res: [0x2b798:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce52 expref: 943 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.603497:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005cc676e8/0x3234de053c4cb79 lrc: 2/0,0 mode: PR/PR res: [0x2b799:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf54 expref: 943 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.603498:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006731397d pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997010688:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.603500:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.603501:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.603502:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a74ee8f/0x3234de053c516c7 lrc: 4/0,1 mode: --/PW res: [0x2b799:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.603506:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 000000008dd99533 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.603508:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005cc676e8/0x3234de053c4cb79 lrc: 3/0,0 mode: PR/PR res: [0x2b799:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf54 expref: 943 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.603511:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005cc676e8/0x3234de053c4cb79 lrc: 4/0,0 mode: PR/PR res: [0x2b799:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf54 expref: 943 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.603511:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c516ab lrc: 2/0,0 mode: PW/PW res: [0x2b795:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603514:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eaaf5dcd already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.603515:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f2582a33 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997010752:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.603515:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c516ab lrc: 2/0,0 mode: PW/PW res: [0x2b795:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603518:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c516ab lrc: 3/0,0 mode: PW/PW res: [0x2b795:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.603521:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b7af823 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.603522:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c516ab lrc: 1/0,0 mode: --/PW res: [0x2b795:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.603527:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211626 00010000:00010000:0.0:1651529344.603527:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c516ab lrc: 0/0,0 mode: --/PW res: [0x2b795:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.603529:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1122:39030:x1731745946464128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.603532:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178075 count 1 00010000:00010000:1.0:1651529344.603535:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c008f60/0x3234de053c516ce lrc: 3/0,1 mode: --/PW res: [0x2b79b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.603535:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211627 00000100:00100000:0.0:1651529344.603536:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1122:39029:x1731745946464064:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.603539:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b79d565b/0x3234de053c4d46a lrc: 2/0,0 mode: PR/PR res: [0x2b79b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d03a4 expref: 943 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.603541:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178074 count 1 00010000:00010000:1.0:1651529344.603542:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.603543:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.603543:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c008f60/0x3234de053c516ce lrc: 4/0,1 mode: --/PW res: [0x2b79b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603543:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c516d5 lrc: 3/0,1 mode: --/PW res: [0x2b79a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.603547:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c4deff lrc: 2/0,0 mode: PR/PR res: [0x2b79a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d1f expref: 943 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.603549:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b79d565b/0x3234de053c4d46a lrc: 3/0,0 mode: PR/PR res: [0x2b79b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d03a4 expref: 943 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.603550:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.603551:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.603551:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c516d5 lrc: 4/0,1 mode: --/PW res: [0x2b79a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.603554:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b79d565b/0x3234de053c4d46a lrc: 4/0,0 mode: PR/PR res: [0x2b79b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d03a4 expref: 943 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.603557:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c4deff lrc: 3/0,0 mode: PR/PR res: [0x2b79a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d1f expref: 943 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.603558:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000824ca843 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997010816:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.603561:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c4deff lrc: 4/0,0 mode: PR/PR res: [0x2b79a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d1f expref: 943 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.603563:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cfa1ca05 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.603565:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085af61db pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997010880:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.603569:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211628 00000100:00100000:1.0:1651529344.603570:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1122:39029:x1731745946464192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.603572:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c0dff858 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.603574:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178076 count 1 00010000:00010000:1.0:1651529344.603577:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055480488/0x3234de053c516dc lrc: 3/0,1 mode: --/PW res: [0x2b79c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.603581:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003f51a2e3/0x3234de053c4f4d1 lrc: 2/0,0 mode: PR/PR res: [0x2b79c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85e1 expref: 943 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.603584:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.603584:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.603585:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055480488/0x3234de053c516dc lrc: 4/0,1 mode: --/PW res: [0x2b79c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.603588:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.603591:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003f51a2e3/0x3234de053c4f4d1 lrc: 3/0,0 mode: PR/PR res: [0x2b79c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85e1 expref: 943 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.603594:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003f51a2e3/0x3234de053c4f4d1 lrc: 4/0,0 mode: PR/PR res: [0x2b79c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85e1 expref: 943 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.603601:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f39ca9ea pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997010944:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.603607:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e5f43e7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.603612:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946464256 00000100:00100000:1.0:1651529344.603646:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211629 00000100:00100000:1.0:1651529344.603648:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1123:39030:x1731745946464256:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.603653:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178077 count 1 00010000:00010000:1.0:1651529344.603663:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f625209/0x3234de053c516e3 lrc: 3/0,1 mode: --/PW res: [0x2b79d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.603668:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007e069076/0x3234de053c4dbef lrc: 2/0,0 mode: PR/PR res: [0x2b79d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1fce expref: 943 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.603671:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.603672:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.603672:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f625209/0x3234de053c516e3 lrc: 4/0,1 mode: --/PW res: [0x2b79d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.603679:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007e069076/0x3234de053c4dbef lrc: 3/0,0 mode: PR/PR res: [0x2b79d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1fce expref: 943 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.603682:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007e069076/0x3234de053c4dbef lrc: 4/0,0 mode: PR/PR res: [0x2b79d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1fce expref: 943 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.603686:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005d3fb3ef pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997011008:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.603700:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 000000004698fefb going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.604026:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000de0edbdc pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997010560:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.604027:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.604031:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c516b2 lrc: 3/0,1 mode: --/PW res: [0x2b797:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.604034:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.604039:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006731397d pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997010688:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.604040:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.604041:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c516c0 lrc: 3/0,1 mode: --/PW res: [0x2b798:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.604046:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.604055:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396345024 00010000:00010000:0.0:1651529344.604061:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d9ffd789/0x3234de053c4cad1 lrc: 5/0,0 mode: PR/PR res: [0x2b796:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd08 expref: 944 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.604062:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997010624:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.604067:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c516b9 lrc: 3/0,1 mode: --/PW res: [0x2b796:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.604067:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396345152 00010000:00010000:0.0:1651529344.604069:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005cc676e8/0x3234de053c4cb79 lrc: 5/0,0 mode: PR/PR res: [0x2b799:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf54 expref: 945 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.604073:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396344960 00000100:00100000:1.0:1651529344.604074:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f2582a33 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997010752:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.604075:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d03fa777/0x3234de053c4c89a lrc: 4/0,0 mode: PR/PR res: [0x2b797:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd43a expref: 946 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.604077:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004a74ee8f/0x3234de053c516c7 lrc: 3/0,1 mode: --/PW res: [0x2b799:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.604079:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396345088 00010000:00010000:0.0:1651529344.604081:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c4c719 lrc: 4/0,0 mode: PR/PR res: [0x2b798:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce52 expref: 947 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.604083:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12404 00000100:00100000:1.0:1651529344.604085:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+947:41278:x1731746396345024:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.604086:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12405 00010000:00010000:1.0:1651529344.604088:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.604088:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+947:41278:x1731746396345152:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.604090:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d9ffd789/0x3234de053c4cad1 lrc: 4/0,0 mode: PR/PR res: [0x2b796:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd08 expref: 947 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.604091:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.604092:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005cc676e8/0x3234de053c4cb79 lrc: 4/0,0 mode: PR/PR res: [0x2b799:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf54 expref: 947 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.604094:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d9ffd789/0x3234de053c4cad1 lrc: 3/0,0 mode: PR/PR res: [0x2b796:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd08 expref: 947 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.604096:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005cc676e8/0x3234de053c4cb79 lrc: 3/0,0 mode: PR/PR res: [0x2b799:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf54 expref: 947 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.604099:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9ffd789/0x3234de053c4cad1 lrc: 0/0,0 mode: --/PR res: [0x2b796:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdd08 expref: 947 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.604102:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cc676e8/0x3234de053c4cb79 lrc: 0/0,0 mode: --/PR res: [0x2b799:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf54 expref: 946 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.604103:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.604103:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.604104:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c516b9 lrc: 3/0,1 mode: PW/PW res: [0x2b796:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604106:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.604106:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.604107:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c516b9 lrc: 4/0,1 mode: PW/PW res: [0x2b796:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604107:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004a74ee8f/0x3234de053c516c7 lrc: 3/0,1 mode: PW/PW res: [0x2b799:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604110:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a74ee8f/0x3234de053c516c7 lrc: 4/0,1 mode: PW/PW res: [0x2b799:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.604113:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.604121:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.604130:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+945:41278:x1731746396345024:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 45us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.604133:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12404 00000100:00100000:0.0:1651529344.604135:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+945:41278:x1731746396345152:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 46us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.604138:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12405 00000100:00100000:1.0:1651529344.604139:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12406 00000100:00100000:1.0:1651529344.604141:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+943:41279:x1731746396344960:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.604143:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12407 00010000:00010000:1.0:1651529344.604144:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.604144:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005239dfe7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+943:41279:x1731746396345088:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.604146:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d03fa777/0x3234de053c4c89a lrc: 4/0,0 mode: PR/PR res: [0x2b797:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd43a expref: 943 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.604147:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.604149:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d03fa777/0x3234de053c4c89a lrc: 3/0,0 mode: PR/PR res: [0x2b797:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd43a expref: 943 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.604149:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c4c719 lrc: 4/0,0 mode: PR/PR res: [0x2b798:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce52 expref: 943 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.604153:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c4c719 lrc: 3/0,0 mode: PR/PR res: [0x2b798:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce52 expref: 943 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.604154:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d03fa777/0x3234de053c4c89a lrc: 0/0,0 mode: --/PR res: [0x2b797:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd43a expref: 943 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.604158:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.604159:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.604159:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c516b2 lrc: 3/0,1 mode: PW/PW res: [0x2b797:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.604162:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c516b2 lrc: 4/0,1 mode: PW/PW res: [0x2b797:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.604171:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.604182:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+942:41279:x1731746396344960:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 40us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.604185:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12406 00000100:00100000:1.0:1651529344.604195:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000824ca843 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997010816:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.604199:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001c008f60/0x3234de053c516ce lrc: 3/0,1 mode: --/PW res: [0x2b79b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604206:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c4c719 lrc: 0/0,0 mode: --/PR res: [0x2b798:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce52 expref: 941 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.604211:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.604211:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.604212:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c516c0 lrc: 3/0,1 mode: PW/PW res: [0x2b798:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.604213:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004a74ee8f/0x3234de053c516c7 lrc: 3/0,1 mode: PW/PW res: [0x2b799:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604215:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c516c0 lrc: 4/0,1 mode: PW/PW res: [0x2b798:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.604216:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a74ee8f/0x3234de053c516c7 lrc: 3/0,1 mode: PW/PW res: [0x2b799:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.604220:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a74ee8f/0x3234de053c516c7 lrc: 3/0,1 mode: PW/PW res: [0x2b799:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.604236:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a74ee8f/0x3234de053c516c7 lrc: 2/0,0 mode: PW/PW res: [0x2b799:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604240:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.604253:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005239dfe7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+940:41279:x1731746396345088:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 107us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.604256:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12407 00010000:00010000:0.0:1651529344.604266:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c516c0 lrc: 3/0,1 mode: PW/PW res: [0x2b798:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604270:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c516c0 lrc: 3/0,1 mode: PW/PW res: [0x2b798:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604273:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c516c0 lrc: 3/0,1 mode: PW/PW res: [0x2b798:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604276:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c516c0 lrc: 2/0,0 mode: PW/PW res: [0x2b798:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.604280:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1124:39030:x1731745946464000:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 794us (920us total) trans 12885079677 rc 0/0 00000100:00100000:1.0:1651529344.604283:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211625 00010000:00010000:1.0:1651529344.604291:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c516b9 lrc: 3/0,1 mode: PW/PW res: [0x2b796:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.604296:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c516b9 lrc: 3/0,1 mode: PW/PW res: [0x2b796:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.604299:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c516b9 lrc: 3/0,1 mode: PW/PW res: [0x2b796:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.604302:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c516b9 lrc: 2/0,0 mode: PW/PW res: [0x2b796:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.604328:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1125:39029:x1731745946463936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 863us (1013us total) trans 12885079678 rc 0/0 00000100:00100000:0.0:1651529344.604331:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211624 00010000:00010000:0.0:1651529344.604338:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a74ee8f/0x3234de053c516c7 lrc: 2/0,0 mode: PW/PW res: [0x2b799:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.604341:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1124:39029:x1731745946463808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 916us (1034us total) trans 12885079679 rc 0/0 00010000:00010000:0.0:1651529344.604342:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004a74ee8f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.604343:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a74ee8f/0x3234de053c516c7 lrc: 2/0,0 mode: PW/PW res: [0x2b799:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.604344:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211623 00010000:00010000:0.0:1651529344.604346:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a74ee8f/0x3234de053c516c7 lrc: 3/0,0 mode: PW/PW res: [0x2b799:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604350:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a74ee8f/0x3234de053c516c7 lrc: 1/0,0 mode: --/PW res: [0x2b799:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604353:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a74ee8f/0x3234de053c516c7 lrc: 0/0,0 mode: --/PW res: [0x2b799:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604357:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c516c0 lrc: 2/0,0 mode: PW/PW res: [0x2b798:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.604358:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.604360:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000495c20c9 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.604361:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c516c0 lrc: 2/0,0 mode: PW/PW res: [0x2b798:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604372:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c516c0 lrc: 3/0,0 mode: PW/PW res: [0x2b798:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604376:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c516c0 lrc: 1/0,0 mode: --/PW res: [0x2b798:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604383:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c516c0 lrc: 0/0,0 mode: --/PW res: [0x2b798:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604387:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c516b9 lrc: 2/0,0 mode: PW/PW res: [0x2b796:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604390:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b96e362a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.604390:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c516b9 lrc: 2/0,0 mode: PW/PW res: [0x2b796:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604393:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c516b9 lrc: 3/0,0 mode: PW/PW res: [0x2b796:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604396:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c516b9 lrc: 1/0,0 mode: --/PW res: [0x2b796:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604399:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c516b9 lrc: 0/0,0 mode: --/PW res: [0x2b796:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.604400:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.604409:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.604410:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085af61db pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997010880:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.604414:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c516d5 lrc: 3/0,1 mode: --/PW res: [0x2b79a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604419:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c516b2 lrc: 3/0,1 mode: PW/PW res: [0x2b797:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604422:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c516b2 lrc: 3/0,1 mode: PW/PW res: [0x2b797:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604425:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c516b2 lrc: 3/0,1 mode: PW/PW res: [0x2b797:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604428:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c516b2 lrc: 2/0,0 mode: PW/PW res: [0x2b797:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.604443:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.604470:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050a0adb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1124:39030:x1731745946463872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1084us (1175us total) trans 12885079680 rc 0/0 00000100:00100000:0.0:1651529344.604473:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211622 00000100:00100000:1.0:1651529344.604479:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005d3fb3ef pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997011008:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.604484:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004f625209/0x3234de053c516e3 lrc: 3/0,1 mode: --/PW res: [0x2b79d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.604491:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f39ca9ea pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997010944:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.604494:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000055480488/0x3234de053c516dc lrc: 3/0,1 mode: --/PW res: [0x2b79c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.604500:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396345216 00010000:00010000:1.0:1651529344.604505:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b79d565b/0x3234de053c4d46a lrc: 4/0,0 mode: PR/PR res: [0x2b79b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d03a4 expref: 940 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.604508:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c516b2 lrc: 2/0,0 mode: PW/PW res: [0x2b797:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.604510:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396345344 00010000:00010000:1.0:1651529344.604512:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007e069076/0x3234de053c4dbef lrc: 4/0,0 mode: PR/PR res: [0x2b79d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1fce expref: 941 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.604512:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088cc87df already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.604513:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c516b2 lrc: 2/0,0 mode: PW/PW res: [0x2b797:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.604516:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396345280 00010000:00010000:0.0:1651529344.604516:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c516b2 lrc: 3/0,0 mode: PW/PW res: [0x2b797:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.604518:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c4deff lrc: 4/0,0 mode: PR/PR res: [0x2b79a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d1f expref: 942 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.604522:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396345408 00010000:00010000:1.0:1651529344.604523:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003f51a2e3/0x3234de053c4f4d1 lrc: 4/0,0 mode: PR/PR res: [0x2b79c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85e1 expref: 943 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.604523:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c516b2 lrc: 1/0,0 mode: --/PW res: [0x2b797:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604526:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c516b2 lrc: 0/0,0 mode: --/PW res: [0x2b797:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.604528:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12408 00000100:00100000:1.0:1651529344.604530:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+943:41278:x1731746396345216:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.604532:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.604534:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b79d565b/0x3234de053c4d46a lrc: 4/0,0 mode: PR/PR res: [0x2b79b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d03a4 expref: 943 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.604537:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b79d565b/0x3234de053c4d46a lrc: 3/0,0 mode: PR/PR res: [0x2b79b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d03a4 expref: 943 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.604543:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b79d565b/0x3234de053c4d46a lrc: 0/0,0 mode: --/PR res: [0x2b79b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d03a4 expref: 943 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.604546:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.604547:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.604548:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001c008f60/0x3234de053c516ce lrc: 3/0,1 mode: PW/PW res: [0x2b79b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.604551:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c008f60/0x3234de053c516ce lrc: 4/0,1 mode: PW/PW res: [0x2b79b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.604556:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12409 00000100:00100000:0.0:1651529344.604558:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+942:41279:x1731746396345344:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.604562:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.604563:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007e069076/0x3234de053c4dbef lrc: 4/0,0 mode: PR/PR res: [0x2b79d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1fce expref: 942 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.604567:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.604567:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007e069076/0x3234de053c4dbef lrc: 3/0,0 mode: PR/PR res: [0x2b79d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1fce expref: 942 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.604573:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e069076/0x3234de053c4dbef lrc: 0/0,0 mode: --/PR res: [0x2b79d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1fce expref: 942 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.604576:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.604580:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+941:41278:x1731746396345216:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 49us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.604582:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12408 00010000:00010000:0.0:1651529344.604583:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.604584:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004f625209/0x3234de053c516e3 lrc: 3/0,1 mode: PW/PW res: [0x2b79d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604587:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f625209/0x3234de053c516e3 lrc: 4/0,1 mode: PW/PW res: [0x2b79d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.604588:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12410 00000100:00100000:1.0:1651529344.604590:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+940:41279:x1731746396345280:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.604592:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.604594:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c4deff lrc: 4/0,0 mode: PR/PR res: [0x2b79a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d1f expref: 940 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.604600:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.604603:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c4deff lrc: 3/0,0 mode: PR/PR res: [0x2b79a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d1f expref: 940 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.604607:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+940:41279:x1731746396345344:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 49us (207us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.604609:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c4deff lrc: 0/0,0 mode: --/PR res: [0x2b79a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d1f expref: 940 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.604610:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12409 00010000:00010000:1.0:1651529344.604612:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.604613:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.604613:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c516d5 lrc: 3/0,1 mode: PW/PW res: [0x2b79a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.604616:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12411 00000100:00100000:0.0:1651529344.604618:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+938:41279:x1731746396345408:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.604619:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c516d5 lrc: 4/0,1 mode: PW/PW res: [0x2b79a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604620:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.604622:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003f51a2e3/0x3234de053c4f4d1 lrc: 4/0,0 mode: PR/PR res: [0x2b79c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85e1 expref: 938 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.604627:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.604633:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+938:41279:x1731746396345280:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.604635:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12410 00010000:00010000:1.0:1651529344.604642:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001c008f60/0x3234de053c516ce lrc: 3/0,1 mode: PW/PW res: [0x2b79b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.604646:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c008f60/0x3234de053c516ce lrc: 3/0,1 mode: PW/PW res: [0x2b79b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.604649:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c008f60/0x3234de053c516ce lrc: 3/0,1 mode: PW/PW res: [0x2b79b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604649:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003f51a2e3/0x3234de053c4f4d1 lrc: 3/0,0 mode: PR/PR res: [0x2b79c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85e1 expref: 937 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.604651:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c008f60/0x3234de053c516ce lrc: 2/0,0 mode: PW/PW res: [0x2b79b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604655:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f51a2e3/0x3234de053c4f4d1 lrc: 0/0,0 mode: --/PR res: [0x2b79c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d85e1 expref: 937 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.604673:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.604674:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.604675:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000055480488/0x3234de053c516dc lrc: 3/0,1 mode: PW/PW res: [0x2b79c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604678:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055480488/0x3234de053c516dc lrc: 4/0,1 mode: PW/PW res: [0x2b79c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604687:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.604694:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+936:41279:x1731746396345408:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 76us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.604697:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12411 00000100:00100000:1.0:1651529344.604701:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1124:39030:x1731745946464128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1171us (1314us total) trans 12885079681 rc 0/0 00000100:00100000:1.0:1651529344.604704:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211626 00010000:00010000:0.0:1651529344.604704:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c516d5 lrc: 3/0,1 mode: PW/PW res: [0x2b79a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604707:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c516d5 lrc: 3/0,1 mode: PW/PW res: [0x2b79a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604710:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c516d5 lrc: 3/0,1 mode: PW/PW res: [0x2b79a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.604711:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000055480488/0x3234de053c516dc lrc: 3/0,1 mode: PW/PW res: [0x2b79c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604713:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c516d5 lrc: 2/0,0 mode: PW/PW res: [0x2b79a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.604714:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055480488/0x3234de053c516dc lrc: 3/0,1 mode: PW/PW res: [0x2b79c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.604717:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055480488/0x3234de053c516dc lrc: 3/0,1 mode: PW/PW res: [0x2b79c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.604720:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000055480488/0x3234de053c516dc lrc: 2/0,0 mode: PW/PW res: [0x2b79c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.604769:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1125:39029:x1731745946464064:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1231us (1373us total) trans 12885079682 rc 0/0 00000100:00100000:1.0:1651529344.604770:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1125:39029:x1731745946464192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1199us (1367us total) trans 12885079683 rc 0/0 00000100:00100000:0.0:1651529344.604772:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211627 00000100:00100000:1.0:1651529344.604774:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211628 00010000:00010000:0.0:1651529344.604779:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c008f60/0x3234de053c516ce lrc: 2/0,0 mode: PW/PW res: [0x2b79b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.604782:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004f625209/0x3234de053c516e3 lrc: 3/0,1 mode: PW/PW res: [0x2b79d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604783:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001c008f60 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.604783:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c008f60/0x3234de053c516ce lrc: 2/0,0 mode: PW/PW res: [0x2b79b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.604785:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f625209/0x3234de053c516e3 lrc: 3/0,1 mode: PW/PW res: [0x2b79d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604786:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c008f60/0x3234de053c516ce lrc: 3/0,0 mode: PW/PW res: [0x2b79b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.604788:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f625209/0x3234de053c516e3 lrc: 3/0,1 mode: PW/PW res: [0x2b79d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.604790:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f625209/0x3234de053c516e3 lrc: 2/0,0 mode: PW/PW res: [0x2b79d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604791:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c008f60/0x3234de053c516ce lrc: 1/0,0 mode: --/PW res: [0x2b79b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604794:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c008f60/0x3234de053c516ce lrc: 0/0,0 mode: --/PW res: [0x2b79b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604798:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c516d5 lrc: 2/0,0 mode: PW/PW res: [0x2b79a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604800:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000037fb8315 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.604801:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c516d5 lrc: 2/0,0 mode: PW/PW res: [0x2b79a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604804:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c516d5 lrc: 3/0,0 mode: PW/PW res: [0x2b79a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604807:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c516d5 lrc: 1/0,0 mode: --/PW res: [0x2b79a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604810:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c516d5 lrc: 0/0,0 mode: --/PW res: [0x2b79a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604813:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000055480488/0x3234de053c516dc lrc: 2/0,0 mode: PW/PW res: [0x2b79c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604815:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000055480488 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.604816:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000055480488/0x3234de053c516dc lrc: 2/0,0 mode: PW/PW res: [0x2b79c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.604820:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1124:39030:x1731745946464256:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1171us (1232us total) trans 12885079684 rc 0/0 00010000:00010000:0.0:1651529344.604821:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000055480488/0x3234de053c516dc lrc: 3/0,0 mode: PW/PW res: [0x2b79c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.604823:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211629 00010000:00010000:0.0:1651529344.604824:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000055480488/0x3234de053c516dc lrc: 1/0,0 mode: --/PW res: [0x2b79c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604827:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055480488/0x3234de053c516dc lrc: 0/0,0 mode: --/PW res: [0x2b79c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604830:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f625209/0x3234de053c516e3 lrc: 2/0,0 mode: PW/PW res: [0x2b79d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604833:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004f625209 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.604833:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f625209/0x3234de053c516e3 lrc: 2/0,0 mode: PW/PW res: [0x2b79d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604836:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f625209/0x3234de053c516e3 lrc: 3/0,0 mode: PW/PW res: [0x2b79d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604839:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f625209/0x3234de053c516e3 lrc: 1/0,0 mode: --/PW res: [0x2b79d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.604841:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f625209/0x3234de053c516e3 lrc: 0/0,0 mode: --/PW res: [0x2b79d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.604856:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.604865:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946464832 00000100:00100000:0.0:1651529344.604874:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.604876:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211630 00000100:00100000:1.0:1651529344.604878:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1124:39029:x1731745946464832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.604883:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178078 count 1 00000100:00100000:0.0:1651529344.604886:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.604888:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fe25cb3/0x3234de053c516ea lrc: 3/0,1 mode: --/PW res: [0x2b79e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.604898:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001b4905da/0x3234de053c4f055 lrc: 2/0,0 mode: PR/PR res: [0x2b79e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d743e expref: 935 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.604902:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.604902:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.604903:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fe25cb3/0x3234de053c516ea lrc: 4/0,1 mode: --/PW res: [0x2b79e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.604913:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.604917:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001b4905da/0x3234de053c4f055 lrc: 3/0,0 mode: PR/PR res: [0x2b79e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d743e expref: 935 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.604921:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001b4905da/0x3234de053c4f055 lrc: 4/0,0 mode: PR/PR res: [0x2b79e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d743e expref: 935 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.604925:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000974b675b pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997011072:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.604926:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946464896 00000100:00100000:1.0:1651529344.604942:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 0000000099c1da85 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.604946:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946464960 00000100:00100000:1.0:1651529344.604948:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946465024 00000100:00100000:1.0:1651529344.604958:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211631 00000100:00100000:1.0:1651529344.604960:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1127:39030:x1731745946464896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.604964:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178079 count 1 00010000:00010000:1.0:1651529344.604968:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0a98e9b/0x3234de053c516f1 lrc: 3/0,1 mode: --/PW res: [0x2b79f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.604972:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000281e99c0/0x3234de053c4f190 lrc: 2/0,0 mode: PR/PR res: [0x2b79f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7938 expref: 935 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.604977:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211632 00000100:00100000:0.0:1651529344.604979:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1127:39030:x1731745946465024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.604981:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.604982:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.604982:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0a98e9b/0x3234de053c516f1 lrc: 4/0,1 mode: --/PW res: [0x2b79f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.604985:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178081 count 1 00010000:00010000:1.0:1651529344.604989:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000281e99c0/0x3234de053c4f190 lrc: 3/0,0 mode: PR/PR res: [0x2b79f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7938 expref: 935 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.604990:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c516f8 lrc: 3/0,1 mode: --/PW res: [0x2b7a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.604992:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000281e99c0/0x3234de053c4f190 lrc: 4/0,0 mode: PR/PR res: [0x2b79f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7938 expref: 935 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.604995:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000009693da4/0x3234de053c4f1f2 lrc: 2/0,0 mode: PR/PR res: [0x2b7a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a96 expref: 935 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.604996:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000117fbeca pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997011136:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.604998:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.604999:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.605000:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c516f8 lrc: 4/0,1 mode: --/PW res: [0x2b7a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.605003:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cfa1ca05 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.605007:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000009693da4/0x3234de053c4f1f2 lrc: 3/0,0 mode: PR/PR res: [0x2b7a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a96 expref: 935 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.605009:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211633 00000100:00100000:1.0:1651529344.605011:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085af61db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1127:39029:x1731745946464960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.605011:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009693da4/0x3234de053c4f1f2 lrc: 4/0,0 mode: PR/PR res: [0x2b7a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a96 expref: 935 pid: 72396 timeout: 20103 lvb_type: 1 00002000:00080000:1.0:1651529344.605015:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178080 count 1 00000100:00100000:0.0:1651529344.605015:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000de0edbdc pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997011200:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.605018:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c165c1a/0x3234de053c516ff lrc: 3/0,1 mode: --/PW res: [0x2b7a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605023:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c4d551 lrc: 2/0,0 mode: PR/PR res: [0x2b7a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d070f expref: 935 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.605024:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 0000000029ae2bb2 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.605026:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.605026:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.605027:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c165c1a/0x3234de053c516ff lrc: 4/0,1 mode: --/PW res: [0x2b7a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605033:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c4d551 lrc: 3/0,0 mode: PR/PR res: [0x2b7a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d070f expref: 935 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.605036:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c4d551 lrc: 4/0,0 mode: PR/PR res: [0x2b7a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d070f expref: 935 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.605040:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029abc941 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997011264:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.605046:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e5f43e7 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.605265:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.605274:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000974b675b pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997011072:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.605278:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002fe25cb3/0x3234de053c516ea lrc: 3/0,1 mode: --/PW res: [0x2b79e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.605286:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946465088 00000100:00100000:1.0:1651529344.605293:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211634 00000100:00100000:1.0:1651529344.605294:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1128:39029:x1731745946465088:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.605299:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178082 count 1 00010000:00010000:1.0:1651529344.605303:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e578053/0x3234de053c51706 lrc: 3/0,1 mode: --/PW res: [0x2b7a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605307:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001722859c/0x3234de053c4c57c lrc: 2/0,0 mode: PR/PR res: [0x2b7a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc9e4 expref: 935 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.605311:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.605311:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.605312:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e578053/0x3234de053c51706 lrc: 4/0,1 mode: --/PW res: [0x2b7a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605318:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001722859c/0x3234de053c4c57c lrc: 3/0,0 mode: PR/PR res: [0x2b7a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc9e4 expref: 935 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.605322:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001722859c/0x3234de053c4c57c lrc: 4/0,0 mode: PR/PR res: [0x2b7a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc9e4 expref: 935 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.605340:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000974b675b pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997011328:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.605351:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 000000007d8fabda going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.605379:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.605408:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.605415:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.605429:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.605431:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.605439:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946465216 00000100:00100000:1.0:1651529344.605446:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946465152 00000100:00100000:0.0:1651529344.605446:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.605456:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946465280 00000100:00100000:1.0:1651529344.605462:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211635 00000100:00100000:1.0:1651529344.605464:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1131:39029:x1731745946465216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.605465:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:1.0:1651529344.605474:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178084 count 1 00000100:00100000:0.0:1651529344.605476:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211636 00000100:00100000:0.0:1651529344.605478:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1131:39030:x1731745946465152:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.605479:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dce56518/0x3234de053c5170d lrc: 3/0,1 mode: --/PW res: [0x2b7a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605484:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000060f12f9d/0x3234de053c4e9a9 lrc: 2/0,0 mode: PR/PR res: [0x2b7a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5806 expref: 935 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.605485:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178083 count 1 00010000:00010000:1.0:1651529344.605487:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.605487:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.605488:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dce56518/0x3234de053c5170d lrc: 4/0,1 mode: --/PW res: [0x2b7a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.605490:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51714 lrc: 3/0,1 mode: --/PW res: [0x2b7a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605495:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000060f12f9d/0x3234de053c4e9a9 lrc: 3/0,0 mode: PR/PR res: [0x2b7a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5806 expref: 935 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.605495:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000065a4478b/0x3234de053c4e431 lrc: 2/0,0 mode: PR/PR res: [0x2b7a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d41e7 expref: 935 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.605498:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000060f12f9d/0x3234de053c4e9a9 lrc: 4/0,0 mode: PR/PR res: [0x2b7a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5806 expref: 935 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.605502:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fc130417 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997011392:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.605512:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 0000000089d75f07 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.605515:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.605516:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.605517:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51714 lrc: 4/0,1 mode: --/PW res: [0x2b7a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.605519:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029abc941 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997011264:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.605523:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008c165c1a/0x3234de053c516ff lrc: 3/0,1 mode: --/PW res: [0x2b7a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.605526:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000065a4478b/0x3234de053c4e431 lrc: 3/0,0 mode: PR/PR res: [0x2b7a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d41e7 expref: 935 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.605529:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396345984 00010000:00010000:0.0:1651529344.605530:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000065a4478b/0x3234de053c4e431 lrc: 4/0,0 mode: PR/PR res: [0x2b7a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d41e7 expref: 936 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.605533:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001b4905da/0x3234de053c4f055 lrc: 4/0,0 mode: PR/PR res: [0x2b79e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d743e expref: 936 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.605538:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396346112 00010000:00010000:1.0:1651529344.605540:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000009693da4/0x3234de053c4f1f2 lrc: 5/0,0 mode: PR/PR res: [0x2b7a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a96 expref: 937 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.605544:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396346048 00000100:00100000:0.0:1651529344.605545:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000edfe60d3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997011456:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.605546:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000281e99c0/0x3234de053c4f190 lrc: 5/0,0 mode: PR/PR res: [0x2b79f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7938 expref: 938 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.605550:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396346176 00010000:00010000:1.0:1651529344.605553:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c4d551 lrc: 4/0,0 mode: PR/PR res: [0x2b7a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d070f expref: 939 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.605555:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 0000000049203969 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.605557:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12412 00000100:00100000:1.0:1651529344.605559:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+939:41279:x1731746396345984:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.605561:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.605562:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211637 00010000:00010000:1.0:1651529344.605563:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001b4905da/0x3234de053c4f055 lrc: 4/0,0 mode: PR/PR res: [0x2b79e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d743e expref: 939 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.605563:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1131:39029:x1731745946465280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.605566:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001b4905da/0x3234de053c4f055 lrc: 3/0,0 mode: PR/PR res: [0x2b79e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d743e expref: 939 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:0.0:1651529344.605570:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178085 count 1 00010000:00010000:1.0:1651529344.605572:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b4905da/0x3234de053c4f055 lrc: 0/0,0 mode: --/PR res: [0x2b79e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d743e expref: 939 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.605573:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c5171b lrc: 3/0,1 mode: --/PW res: [0x2b7a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605575:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.605576:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.605577:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002fe25cb3/0x3234de053c516ea lrc: 3/0,1 mode: PW/PW res: [0x2b79e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.605578:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007fa78486/0x3234de053c4c815 lrc: 2/0,0 mode: PR/PR res: [0x2b7a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd296 expref: 938 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.605580:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fe25cb3/0x3234de053c516ea lrc: 4/0,1 mode: PW/PW res: [0x2b79e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.605581:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.605581:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.605582:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c5171b lrc: 4/0,1 mode: --/PW res: [0x2b7a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605586:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.605588:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007fa78486/0x3234de053c4c815 lrc: 3/0,0 mode: PR/PR res: [0x2b7a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd296 expref: 938 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.605592:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+938:41279:x1731746396345984:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (177us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.605592:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007fa78486/0x3234de053c4c815 lrc: 4/0,0 mode: PR/PR res: [0x2b7a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd296 expref: 938 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.605595:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12412 00000100:00100000:0.0:1651529344.605595:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a13808c6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997011520:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.605599:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12413 00000100:00100000:1.0:1651529344.605601:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+937:41279:x1731746396346112:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.605602:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000504ef660 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.605603:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.605604:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000009693da4/0x3234de053c4f1f2 lrc: 5/0,0 mode: PR/PR res: [0x2b7a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a96 expref: 937 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.605608:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000009693da4/0x3234de053c4f1f2 lrc: 4/0,0 mode: PR/PR res: [0x2b7a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a96 expref: 937 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.605610:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000de0edbdc pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997011200:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.605612:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009693da4/0x3234de053c4f1f2 lrc: 0/0,0 mode: --/PR res: [0x2b7a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a96 expref: 937 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.605614:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c516f8 lrc: 3/0,1 mode: --/PW res: [0x2b7a1:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605615:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.605616:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.605617:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c516f8 lrc: 3/0,1 mode: PW/PW res: [0x2b7a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605620:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c516f8 lrc: 4/0,1 mode: PW/PW res: [0x2b7a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605624:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.605624:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c516f8 lrc: 3/0,1 mode: PW/PW res: [0x2b7a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.605629:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+936:41279:x1731746396346112:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 27us (198us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.605630:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c516f8 lrc: 3/0,1 mode: PW/PW res: [0x2b7a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.605631:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12413 00010000:00010000:0.0:1651529344.605633:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c516f8 lrc: 3/0,1 mode: PW/PW res: [0x2b7a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.605634:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12414 00000100:00100000:1.0:1651529344.605636:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d036941 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+935:41278:x1731746396346048:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.605636:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c516f8 lrc: 2/0,0 mode: PW/PW res: [0x2b7a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605638:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.605639:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000281e99c0/0x3234de053c4f190 lrc: 5/0,0 mode: PR/PR res: [0x2b79f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7938 expref: 935 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.605643:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000281e99c0/0x3234de053c4f190 lrc: 4/0,0 mode: PR/PR res: [0x2b79f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7938 expref: 935 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.605647:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.605647:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.605648:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e0a98e9b/0x3234de053c516f1 lrc: 3/0,1 mode: PW/PW res: [0x2b79f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605651:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0a98e9b/0x3234de053c516f1 lrc: 4/0,1 mode: PW/PW res: [0x2b79f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605655:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.605658:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d036941 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+935:41278:x1731746396346048:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 22us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.605661:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12414 00000100:00100000:1.0:1651529344.605668:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12415 00000100:00100000:1.0:1651529344.605669:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+934:41278:x1731746396346176:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.605672:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.605673:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c4d551 lrc: 4/0,0 mode: PR/PR res: [0x2b7a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d070f expref: 934 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.605676:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c4d551 lrc: 3/0,0 mode: PR/PR res: [0x2b7a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d070f expref: 934 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.605677:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1132:39030:x1731745946465024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 696us (764us total) trans 12885079685 rc 0/0 00010000:00010000:1.0:1651529344.605680:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c4d551 lrc: 0/0,0 mode: --/PR res: [0x2b7a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d070f expref: 934 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.605680:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211632 00010000:00010000:1.0:1651529344.605686:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.605687:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.605687:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c516f8 lrc: 2/0,0 mode: PW/PW res: [0x2b7a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605688:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008c165c1a/0x3234de053c516ff lrc: 3/0,1 mode: PW/PW res: [0x2b7a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605690:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c165c1a/0x3234de053c516ff lrc: 4/0,1 mode: PW/PW res: [0x2b7a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.605691:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000491b5359 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.605691:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c516f8 lrc: 2/0,0 mode: PW/PW res: [0x2b7a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.605694:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c516f8 lrc: 3/0,0 mode: PW/PW res: [0x2b7a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605696:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.605699:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c516f8 lrc: 1/0,0 mode: --/PW res: [0x2b7a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.605700:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+933:41278:x1731746396346176:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 31us (240us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.605701:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c516f8 lrc: 0/0,0 mode: --/PW res: [0x2b7a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.605703:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12415 00010000:00010000:1.0:1651529344.605713:0:72396:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000281e99c0/0x3234de053c4f190 lrc: 0/0,0 mode: --/PR res: [0x2b79f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7938 expref: 932 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.605717:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000117fbeca pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997011136:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.605727:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e0a98e9b/0x3234de053c516f1 lrc: 3/0,1 mode: PW/PW res: [0x2b79f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605731:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e0a98e9b/0x3234de053c516f1 lrc: 3/0,1 mode: PW/PW res: [0x2b79f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605733:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0a98e9b/0x3234de053c516f1 lrc: 3/0,1 mode: PW/PW res: [0x2b79f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605747:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0a98e9b/0x3234de053c516f1 lrc: 3/0,1 mode: PW/PW res: [0x2b79f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605750:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0a98e9b/0x3234de053c516f1 lrc: 2/0,0 mode: PW/PW res: [0x2b79f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.605753:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.605804:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0a98e9b/0x3234de053c516f1 lrc: 2/0,0 mode: PW/PW res: [0x2b79f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.605808:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e0a98e9b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.605809:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0a98e9b/0x3234de053c516f1 lrc: 2/0,0 mode: PW/PW res: [0x2b79f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.605812:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0a98e9b/0x3234de053c516f1 lrc: 3/0,0 mode: PW/PW res: [0x2b79f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.605817:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0a98e9b/0x3234de053c516f1 lrc: 1/0,0 mode: --/PW res: [0x2b79f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.605820:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0a98e9b/0x3234de053c516f1 lrc: 0/0,0 mode: --/PW res: [0x2b79f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.605827:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396346240 00010000:00010000:0.0:1651529344.605832:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001722859c/0x3234de053c4c57c lrc: 5/0,0 mode: PR/PR res: [0x2b7a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc9e4 expref: 932 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.605843:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12416 00000100:00100000:0.0:1651529344.605850:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+932:41278:x1731746396346240:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.605851:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1132:39030:x1731745946464896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 890us (976us total) trans 12885079686 rc 0/0 00000100:00100000:1.0:1651529344.605854:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211631 00010000:00010000:0.0:1651529344.605854:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.605855:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001722859c/0x3234de053c4c57c lrc: 5/0,0 mode: PR/PR res: [0x2b7a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc9e4 expref: 932 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.605863:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008c165c1a/0x3234de053c516ff lrc: 3/0,1 mode: PW/PW res: [0x2b7a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605866:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c165c1a/0x3234de053c516ff lrc: 3/0,1 mode: PW/PW res: [0x2b7a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605869:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c165c1a/0x3234de053c516ff lrc: 3/0,1 mode: PW/PW res: [0x2b7a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605872:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c165c1a/0x3234de053c516ff lrc: 2/0,0 mode: PW/PW res: [0x2b7a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.605876:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001722859c/0x3234de053c4c57c lrc: 4/0,0 mode: PR/PR res: [0x2b7a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc9e4 expref: 932 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.605899:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.605899:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.605900:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008e578053/0x3234de053c51706 lrc: 3/0,1 mode: PW/PW res: [0x2b7a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.605903:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e578053/0x3234de053c51706 lrc: 4/0,1 mode: PW/PW res: [0x2b7a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.605909:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.605910:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085af61db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1132:39029:x1731745946464960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 898us (1024us total) trans 12885079687 rc 0/0 00000100:00100000:1.0:1651529344.605913:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211633 00010000:00010000:1.0:1651529344.605919:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002fe25cb3/0x3234de053c516ea lrc: 3/0,1 mode: PW/PW res: [0x2b79e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.605920:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+932:41278:x1731746396346240:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 73us (166us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.605922:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fe25cb3/0x3234de053c516ea lrc: 3/0,1 mode: PW/PW res: [0x2b79e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.605925:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12416 00010000:00010000:1.0:1651529344.605928:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fe25cb3/0x3234de053c516ea lrc: 3/0,1 mode: PW/PW res: [0x2b79e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605931:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002fe25cb3/0x3234de053c516ea lrc: 2/0,0 mode: PW/PW res: [0x2b79e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.605948:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c165c1a/0x3234de053c516ff lrc: 2/0,0 mode: PW/PW res: [0x2b7a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.605952:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008c165c1a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.605953:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c165c1a/0x3234de053c516ff lrc: 2/0,0 mode: PW/PW res: [0x2b7a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.605956:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c165c1a/0x3234de053c516ff lrc: 3/0,0 mode: PW/PW res: [0x2b7a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.605961:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c165c1a/0x3234de053c516ff lrc: 1/0,0 mode: --/PW res: [0x2b7a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.605966:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1132:39029:x1731745946464832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1087us (1110us total) trans 12885079688 rc 0/0 00010000:00010000:0.0:1651529344.605966:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c165c1a/0x3234de053c516ff lrc: 0/0,0 mode: --/PW res: [0x2b7a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.605969:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211630 00010000:00010000:0.0:1651529344.605970:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002fe25cb3/0x3234de053c516ea lrc: 2/0,0 mode: PW/PW res: [0x2b79e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.605973:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002fe25cb3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.605974:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002fe25cb3/0x3234de053c516ea lrc: 2/0,0 mode: PW/PW res: [0x2b79e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.605977:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002fe25cb3/0x3234de053c516ea lrc: 3/0,0 mode: PW/PW res: [0x2b79e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605979:0:80279:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001722859c/0x3234de053c4c57c lrc: 0/0,0 mode: --/PR res: [0x2b7a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc9e4 expref: 931 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.605980:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002fe25cb3/0x3234de053c516ea lrc: 1/0,0 mode: --/PW res: [0x2b79e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.605982:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fe25cb3/0x3234de053c516ea lrc: 0/0,0 mode: --/PW res: [0x2b79e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.605983:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000974b675b pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997011328:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.605987:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008e578053/0x3234de053c51706 lrc: 3/0,1 mode: PW/PW res: [0x2b7a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605990:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008e578053/0x3234de053c51706 lrc: 3/0,1 mode: PW/PW res: [0x2b7a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605993:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e578053/0x3234de053c51706 lrc: 3/0,1 mode: PW/PW res: [0x2b7a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.605996:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e578053/0x3234de053c51706 lrc: 3/0,1 mode: PW/PW res: [0x2b7a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606001:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e578053/0x3234de053c51706 lrc: 2/0,0 mode: PW/PW res: [0x2b7a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.606018:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.606054:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1132:39029:x1731745946465088:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 758us (789us total) trans 12885079689 rc 0/0 00000100:00100000:1.0:1651529344.606064:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211634 00000100:00100000:1.0:1651529344.606069:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946465856 00000100:00100000:1.0:1651529344.606076:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211638 00000100:00100000:1.0:1651529344.606084:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1132:39030:x1731745946465856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.606090:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178086 count 1 00010000:00010000:0.0:1651529344.606094:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e578053/0x3234de053c51706 lrc: 2/0,0 mode: PW/PW res: [0x2b7a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606098:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008e578053 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.606099:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e578053/0x3234de053c51706 lrc: 2/0,0 mode: PW/PW res: [0x2b7a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606100:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089e57af8/0x3234de053c51722 lrc: 3/0,1 mode: --/PW res: [0x2b7a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606104:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e578053/0x3234de053c51706 lrc: 3/0,0 mode: PW/PW res: [0x2b7a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606105:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004ac029b6/0x3234de053c4d654 lrc: 2/0,0 mode: PR/PR res: [0x2b7a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ae3 expref: 930 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.606108:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.606109:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.606109:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e578053/0x3234de053c51706 lrc: 1/0,0 mode: --/PW res: [0x2b7a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606110:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089e57af8/0x3234de053c51722 lrc: 4/0,1 mode: --/PW res: [0x2b7a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606111:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e578053/0x3234de053c51706 lrc: 0/0,0 mode: --/PW res: [0x2b7a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606116:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004ac029b6/0x3234de053c4d654 lrc: 3/0,0 mode: PR/PR res: [0x2b7a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ae3 expref: 930 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.606120:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004ac029b6/0x3234de053c4d654 lrc: 4/0,0 mode: PR/PR res: [0x2b7a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ae3 expref: 930 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.606121:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a13808c6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997011520:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.606127:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000974b675b pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997011584:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.606141:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 000000007d8fabda going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.606145:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c5171b lrc: 3/0,1 mode: --/PW res: [0x2b7a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.606150:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fc130417 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997011392:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.606154:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dce56518/0x3234de053c5170d lrc: 3/0,1 mode: --/PW res: [0x2b7a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.606155:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000edfe60d3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997011456:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.606157:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51714 lrc: 3/0,1 mode: --/PW res: [0x2b7a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.606283:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.606301:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946465984 00000100:00100000:0.0:1651529344.606307:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.606319:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.606328:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.606329:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946466112 00000100:00100000:1.0:1651529344.606337:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946465920 00000100:00100000:1.0:1651529344.606341:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946466048 00000100:00100000:1.0:1651529344.606345:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211639 00000100:00100000:1.0:1651529344.606346:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a13808c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1136:39029:x1731745946465984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.606352:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178088 count 1 00000100:00100000:0.0:1651529344.606355:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211640 00010000:00010000:1.0:1651529344.606356:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0d30d7f/0x3234de053c51729 lrc: 3/0,1 mode: --/PW res: [0x2b7a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.606357:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1136:39029:x1731745946466112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.606361:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000329f2d10/0x3234de053c4d1bc lrc: 2/0,0 mode: PR/PR res: [0x2b7a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf859 expref: 930 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.606363:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178090 count 1 00010000:00010000:1.0:1651529344.606364:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.606365:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.606365:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0d30d7f/0x3234de053c51729 lrc: 4/0,1 mode: --/PW res: [0x2b7a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606368:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51730 lrc: 3/0,1 mode: --/PW res: [0x2b7aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606372:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000329f2d10/0x3234de053c4d1bc lrc: 3/0,0 mode: PR/PR res: [0x2b7a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf859 expref: 930 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.606372:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003980a189/0x3234de053c4f063 lrc: 2/0,0 mode: PR/PR res: [0x2b7aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d745a expref: 930 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.606376:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.606376:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.606377:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51730 lrc: 4/0,1 mode: --/PW res: [0x2b7aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606378:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000329f2d10/0x3234de053c4d1bc lrc: 4/0,0 mode: PR/PR res: [0x2b7a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf859 expref: 930 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.606382:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fc130417 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997011648:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.606403:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 0000000020dd7827 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.606406:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003980a189/0x3234de053c4f063 lrc: 3/0,0 mode: PR/PR res: [0x2b7aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d745a expref: 930 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.606409:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211641 00010000:00010000:0.0:1651529344.606410:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003980a189/0x3234de053c4f063 lrc: 4/0,0 mode: PR/PR res: [0x2b7aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d745a expref: 930 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.606411:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1136:39030:x1731745946465920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.606415:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e5997468 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997011712:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.606416:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178087 count 1 00010000:00010000:1.0:1651529344.606419:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000796e2f49/0x3234de053c51737 lrc: 3/0,1 mode: --/PW res: [0x2b7a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606423:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c6d4be69/0x3234de053c4cb5d lrc: 2/0,0 mode: PR/PR res: [0x2b7a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cded6 expref: 930 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.606424:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000049203969 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.606426:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.606427:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.606428:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000796e2f49/0x3234de053c51737 lrc: 4/0,1 mode: --/PW res: [0x2b7a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.606431:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211642 00000100:00100000:0.0:1651529344.606432:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1136:39030:x1731745946466048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.606434:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c6d4be69/0x3234de053c4cb5d lrc: 3/0,0 mode: PR/PR res: [0x2b7a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cded6 expref: 930 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.606437:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c6d4be69/0x3234de053c4cb5d lrc: 4/0,0 mode: PR/PR res: [0x2b7a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cded6 expref: 930 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:0.0:1651529344.606437:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178089 count 1 00010000:00010000:0.0:1651529344.606440:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c5173e lrc: 3/0,1 mode: --/PW res: [0x2b7a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.606444:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000117fbeca pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997011776:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.606451:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a6b79b05 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.606458:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f49e49e2/0x3234de053c4d69a lrc: 2/0,0 mode: PR/PR res: [0x2b7a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c3a expref: 930 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.606464:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.606464:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.606465:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c5173e lrc: 4/0,1 mode: --/PW res: [0x2b7a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606472:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f49e49e2/0x3234de053c4d69a lrc: 3/0,0 mode: PR/PR res: [0x2b7a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c3a expref: 930 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.606475:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f49e49e2/0x3234de053c4d69a lrc: 4/0,0 mode: PR/PR res: [0x2b7a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c3a expref: 930 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.606479:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002a1f5cf2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997011840:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.606484:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.606487:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000504ef660 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.606507:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.606513:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396346432 00010000:00010000:1.0:1651529344.606518:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007fa78486/0x3234de053c4c815 lrc: 4/0,0 mode: PR/PR res: [0x2b7a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd296 expref: 931 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.606531:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396346368 00010000:00010000:0.0:1651529344.606537:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000060f12f9d/0x3234de053c4e9a9 lrc: 4/0,0 mode: PR/PR res: [0x2b7a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5806 expref: 932 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.606539:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12417 00000100:00100000:1.0:1651529344.606541:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+932:41278:x1731746396346432:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.606547:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12418 00010000:00010000:1.0:1651529344.606549:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.606549:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+932:41279:x1731746396346368:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.606551:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007fa78486/0x3234de053c4c815 lrc: 4/0,0 mode: PR/PR res: [0x2b7a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd296 expref: 932 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.606552:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.606553:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000060f12f9d/0x3234de053c4e9a9 lrc: 4/0,0 mode: PR/PR res: [0x2b7a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5806 expref: 932 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.606555:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007fa78486/0x3234de053c4c815 lrc: 3/0,0 mode: PR/PR res: [0x2b7a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd296 expref: 932 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.606557:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000060f12f9d/0x3234de053c4e9a9 lrc: 3/0,0 mode: PR/PR res: [0x2b7a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5806 expref: 932 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.606560:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fa78486/0x3234de053c4c815 lrc: 0/0,0 mode: --/PR res: [0x2b7a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd296 expref: 932 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.606564:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.606565:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.606566:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c5171b lrc: 3/0,1 mode: PW/PW res: [0x2b7a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606571:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c5171b lrc: 4/0,1 mode: PW/PW res: [0x2b7a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606580:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.606591:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+931:41278:x1731746396346432:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 49us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.606594:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12417 00010000:00010000:0.0:1651529344.606600:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060f12f9d/0x3234de053c4e9a9 lrc: 0/0,0 mode: --/PR res: [0x2b7a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5806 expref: 930 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.606604:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.606605:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.606606:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dce56518/0x3234de053c5170d lrc: 3/0,1 mode: PW/PW res: [0x2b7a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.606608:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.606609:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dce56518/0x3234de053c5170d lrc: 4/0,1 mode: PW/PW res: [0x2b7a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606618:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.606626:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+929:41279:x1731746396346368:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 76us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.606629:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12418 00000100:00100000:0.0:1651529344.606634:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396346496 00010000:00010000:0.0:1651529344.606638:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000065a4478b/0x3234de053c4e431 lrc: 4/0,0 mode: PR/PR res: [0x2b7a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d41e7 expref: 929 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.606647:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12419 00000100:00100000:0.0:1651529344.606649:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+929:41279:x1731746396346496:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.606651:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.606653:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000065a4478b/0x3234de053c4e431 lrc: 4/0,0 mode: PR/PR res: [0x2b7a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d41e7 expref: 929 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.606656:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000065a4478b/0x3234de053c4e431 lrc: 3/0,0 mode: PR/PR res: [0x2b7a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d41e7 expref: 929 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.606662:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065a4478b/0x3234de053c4e431 lrc: 0/0,0 mode: --/PR res: [0x2b7a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d41e7 expref: 929 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.606665:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.606666:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.606666:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51714 lrc: 3/0,1 mode: PW/PW res: [0x2b7a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606669:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51714 lrc: 4/0,1 mode: PW/PW res: [0x2b7a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606676:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.606677:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.606681:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+928:41279:x1731746396346496:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.606684:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12419 00000100:00100000:0.0:1651529344.606688:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396347008 00010000:00010000:0.0:1651529344.606691:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004ac029b6/0x3234de053c4d654 lrc: 5/0,0 mode: PR/PR res: [0x2b7a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ae3 expref: 928 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.606696:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12420 00000100:00100000:0.0:1651529344.606697:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+928:41279:x1731746396347008:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.606699:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.606700:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004ac029b6/0x3234de053c4d654 lrc: 5/0,0 mode: PR/PR res: [0x2b7a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ae3 expref: 928 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.606704:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dce56518/0x3234de053c5170d lrc: 3/0,1 mode: PW/PW res: [0x2b7a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606704:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004ac029b6/0x3234de053c4d654 lrc: 4/0,0 mode: PR/PR res: [0x2b7a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ae3 expref: 928 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.606708:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dce56518/0x3234de053c5170d lrc: 3/0,1 mode: PW/PW res: [0x2b7a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606708:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.606709:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.606710:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000089e57af8/0x3234de053c51722 lrc: 3/0,1 mode: PW/PW res: [0x2b7a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606712:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dce56518/0x3234de053c5170d lrc: 3/0,1 mode: PW/PW res: [0x2b7a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606713:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089e57af8/0x3234de053c51722 lrc: 4/0,1 mode: PW/PW res: [0x2b7a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606714:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dce56518/0x3234de053c5170d lrc: 2/0,0 mode: PW/PW res: [0x2b7a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606717:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.606730:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+928:41279:x1731746396347008:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 32us (54us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.606733:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12420 00010000:00010000:0.0:1651529344.606749:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c5171b lrc: 3/0,1 mode: PW/PW res: [0x2b7a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606753:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c5171b lrc: 3/0,1 mode: PW/PW res: [0x2b7a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606756:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c5171b lrc: 3/0,1 mode: PW/PW res: [0x2b7a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606759:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c5171b lrc: 2/0,0 mode: PW/PW res: [0x2b7a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.606771:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1137:39029:x1731745946465216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1306us (1393us total) trans 12885079690 rc 0/0 00000100:00100000:1.0:1651529344.606775:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211635 00010000:00010000:1.0:1651529344.606788:0:80279:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ac029b6/0x3234de053c4d654 lrc: 0/0,0 mode: --/PR res: [0x2b7a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ae3 expref: 927 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.606795:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000974b675b pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997011584:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.606799:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000089e57af8/0x3234de053c51722 lrc: 3/0,1 mode: PW/PW res: [0x2b7a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.606801:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1137:39029:x1731745946465280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1236us (1371us total) trans 12885079691 rc 0/0 00010000:00010000:1.0:1651529344.606802:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000089e57af8/0x3234de053c51722 lrc: 3/0,1 mode: PW/PW res: [0x2b7a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606804:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089e57af8/0x3234de053c51722 lrc: 3/0,1 mode: PW/PW res: [0x2b7a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.606804:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211637 00010000:00010000:1.0:1651529344.606807:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089e57af8/0x3234de053c51722 lrc: 3/0,1 mode: PW/PW res: [0x2b7a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.606810:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089e57af8/0x3234de053c51722 lrc: 2/0,0 mode: PW/PW res: [0x2b7a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606811:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51714 lrc: 3/0,1 mode: PW/PW res: [0x2b7a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606815:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51714 lrc: 3/0,1 mode: PW/PW res: [0x2b7a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606825:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51714 lrc: 3/0,1 mode: PW/PW res: [0x2b7a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606842:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51714 lrc: 2/0,0 mode: PW/PW res: [0x2b7a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.606849:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1137:39030:x1731745946465856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 764us (831us total) trans 12885079692 rc 0/0 00000100:00100000:1.0:1651529344.606852:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211638 00000100:00100000:0.0:1651529344.606898:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1137:39030:x1731745946465152:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1419us (1490us total) trans 12885079693 rc 0/0 00000100:00100000:0.0:1651529344.606909:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211636 00010000:00010000:0.0:1651529344.606927:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dce56518/0x3234de053c5170d lrc: 2/0,0 mode: PW/PW res: [0x2b7a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606932:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dce56518 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.606934:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dce56518/0x3234de053c5170d lrc: 2/0,0 mode: PW/PW res: [0x2b7a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606939:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dce56518/0x3234de053c5170d lrc: 3/0,0 mode: PW/PW res: [0x2b7a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.606944:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.606947:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dce56518/0x3234de053c5170d lrc: 1/0,0 mode: --/PW res: [0x2b7a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606953:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dce56518/0x3234de053c5170d lrc: 0/0,0 mode: --/PW res: [0x2b7a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606957:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c5171b lrc: 2/0,0 mode: PW/PW res: [0x2b7a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606960:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5c1b0ba already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.606961:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c5171b lrc: 2/0,0 mode: PW/PW res: [0x2b7a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606964:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c5171b lrc: 3/0,0 mode: PW/PW res: [0x2b7a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606967:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c5171b lrc: 1/0,0 mode: --/PW res: [0x2b7a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606969:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c5171b lrc: 0/0,0 mode: --/PW res: [0x2b7a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.606972:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.606973:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089e57af8/0x3234de053c51722 lrc: 2/0,0 mode: PW/PW res: [0x2b7a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606975:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000089e57af8 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.606976:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089e57af8/0x3234de053c51722 lrc: 2/0,0 mode: PW/PW res: [0x2b7a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.606979:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.606981:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089e57af8/0x3234de053c51722 lrc: 3/0,0 mode: PW/PW res: [0x2b7a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.606984:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089e57af8/0x3234de053c51722 lrc: 1/0,0 mode: --/PW res: [0x2b7a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.606985:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.606987:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089e57af8/0x3234de053c51722 lrc: 0/0,0 mode: --/PW res: [0x2b7a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.606997:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fc130417 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997011648:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.606998:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51714 lrc: 2/0,0 mode: PW/PW res: [0x2b7a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.607001:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f0d30d7f/0x3234de053c51729 lrc: 3/0,1 mode: --/PW res: [0x2b7a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.607009:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000117fbeca pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997011776:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.607011:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000796e2f49/0x3234de053c51737 lrc: 3/0,1 mode: --/PW res: [0x2b7a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607015:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e6b94407 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.607016:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51714 lrc: 2/0,0 mode: PW/PW res: [0x2b7a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.607017:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396347136 00010000:00010000:0.0:1651529344.607018:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51714 lrc: 3/0,0 mode: PW/PW res: [0x2b7a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.607021:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003980a189/0x3234de053c4f063 lrc: 5/0,0 mode: PR/PR res: [0x2b7aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d745a expref: 927 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.607022:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51714 lrc: 1/0,0 mode: --/PW res: [0x2b7a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607025:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51714 lrc: 0/0,0 mode: --/PW res: [0x2b7a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.607027:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396347264 00010000:00010000:1.0:1651529344.607029:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f49e49e2/0x3234de053c4d69a lrc: 5/0,0 mode: PR/PR res: [0x2b7a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c3a expref: 928 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.607033:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396347200 00010000:00010000:1.0:1651529344.607034:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000329f2d10/0x3234de053c4d1bc lrc: 4/0,0 mode: PR/PR res: [0x2b7a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf859 expref: 929 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.607038:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396347328 00000100:00100000:0.0:1651529344.607038:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002a1f5cf2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997011840:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.607040:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c6d4be69/0x3234de053c4cb5d lrc: 4/0,0 mode: PR/PR res: [0x2b7a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cded6 expref: 930 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.607043:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c5173e lrc: 3/0,1 mode: --/PW res: [0x2b7a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.607045:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12421 00000100:00100000:1.0:1651529344.607046:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000091b9484 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+930:41279:x1731746396347136:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.607049:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.607050:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003980a189/0x3234de053c4f063 lrc: 4/0,0 mode: PR/PR res: [0x2b7aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d745a expref: 930 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.607050:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e5997468 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997011712:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.607052:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51730 lrc: 3/0,1 mode: --/PW res: [0x2b7aa:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.607056:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003980a189/0x3234de053c4f063 lrc: 3/0,0 mode: PR/PR res: [0x2b7aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d745a expref: 930 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.607060:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12422 00010000:00010000:1.0:1651529344.607062:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003980a189/0x3234de053c4f063 lrc: 0/0,0 mode: --/PR res: [0x2b7aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d745a expref: 930 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.607062:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+930:41279:x1731746396347264:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.607065:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.607065:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.607066:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.607067:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51730 lrc: 3/0,1 mode: PW/PW res: [0x2b7aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607067:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f49e49e2/0x3234de053c4d69a lrc: 4/0,0 mode: PR/PR res: [0x2b7a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c3a expref: 929 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.607070:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51730 lrc: 4/0,1 mode: PW/PW res: [0x2b7aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607071:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f49e49e2/0x3234de053c4d69a lrc: 3/0,0 mode: PR/PR res: [0x2b7a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c3a expref: 929 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.607076:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f49e49e2/0x3234de053c4d69a lrc: 0/0,0 mode: --/PR res: [0x2b7a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c3a expref: 929 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.607079:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.607086:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.607087:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.607088:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000091b9484 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+928:41279:x1731746396347136:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (145us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.607088:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c5173e lrc: 3/0,1 mode: PW/PW res: [0x2b7a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.607091:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12421 00010000:00010000:0.0:1651529344.607091:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c5173e lrc: 4/0,1 mode: PW/PW res: [0x2b7a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607099:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.607100:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12423 00000100:00100000:1.0:1651529344.607101:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+927:41278:x1731746396347200:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.607104:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.607106:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000329f2d10/0x3234de053c4d1bc lrc: 4/0,0 mode: PR/PR res: [0x2b7a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf859 expref: 927 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.607107:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+927:41279:x1731746396347264:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 45us (136us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.607109:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000329f2d10/0x3234de053c4d1bc lrc: 3/0,0 mode: PR/PR res: [0x2b7a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf859 expref: 927 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.607110:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12422 00010000:00010000:1.0:1651529344.607114:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000329f2d10/0x3234de053c4d1bc lrc: 0/0,0 mode: --/PR res: [0x2b7a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf859 expref: 926 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.607116:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12424 00010000:00010000:1.0:1651529344.607118:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.607118:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.607118:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+925:41278:x1731746396347328:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.607119:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f0d30d7f/0x3234de053c51729 lrc: 3/0,1 mode: PW/PW res: [0x2b7a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.607122:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0d30d7f/0x3234de053c51729 lrc: 4/0,1 mode: PW/PW res: [0x2b7a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.607128:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.607134:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+925:41278:x1731746396347200:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 32us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.607136:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12423 00010000:00010000:1.0:1651529344.607143:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f0d30d7f/0x3234de053c51729 lrc: 3/0,1 mode: PW/PW res: [0x2b7a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607145:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.607146:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0d30d7f/0x3234de053c51729 lrc: 3/0,1 mode: PW/PW res: [0x2b7a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607147:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c6d4be69/0x3234de053c4cb5d lrc: 4/0,0 mode: PR/PR res: [0x2b7a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cded6 expref: 924 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.607149:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0d30d7f/0x3234de053c51729 lrc: 3/0,1 mode: PW/PW res: [0x2b7a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607151:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c6d4be69/0x3234de053c4cb5d lrc: 3/0,0 mode: PR/PR res: [0x2b7a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cded6 expref: 924 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.607152:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0d30d7f/0x3234de053c51729 lrc: 2/0,0 mode: PW/PW res: [0x2b7a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607156:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6d4be69/0x3234de053c4cb5d lrc: 0/0,0 mode: --/PR res: [0x2b7a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cded6 expref: 924 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.607160:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.607161:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.607167:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000796e2f49/0x3234de053c51737 lrc: 3/0,1 mode: PW/PW res: [0x2b7a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607170:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000796e2f49/0x3234de053c51737 lrc: 4/0,1 mode: PW/PW res: [0x2b7a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607180:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.607187:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+923:41278:x1731746396347328:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 68us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.607189:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12424 00010000:00010000:0.0:1651529344.607197:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51730 lrc: 3/0,1 mode: PW/PW res: [0x2b7aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607200:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51730 lrc: 3/0,1 mode: PW/PW res: [0x2b7aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.607203:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a13808c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1137:39029:x1731745946465984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 856us (931us total) trans 12885079694 rc 0/0 00010000:00010000:0.0:1651529344.607203:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51730 lrc: 3/0,1 mode: PW/PW res: [0x2b7aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.607206:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211639 00010000:00010000:0.0:1651529344.607206:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51730 lrc: 2/0,0 mode: PW/PW res: [0x2b7aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.607213:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000796e2f49/0x3234de053c51737 lrc: 3/0,1 mode: PW/PW res: [0x2b7a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.607217:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000796e2f49/0x3234de053c51737 lrc: 3/0,1 mode: PW/PW res: [0x2b7a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.607220:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000796e2f49/0x3234de053c51737 lrc: 3/0,1 mode: PW/PW res: [0x2b7a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.607239:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000796e2f49/0x3234de053c51737 lrc: 2/0,0 mode: PW/PW res: [0x2b7a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.607270:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1138:39029:x1731745946466112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 912us (963us total) trans 12885079695 rc 0/0 00000100:00100000:0.0:1651529344.607273:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211640 00000100:00100000:1.0:1651529344.607278:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1137:39030:x1731745946465920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 867us (959us total) trans 12885079696 rc 0/0 00010000:00010000:0.0:1651529344.607280:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c5173e lrc: 3/0,1 mode: PW/PW res: [0x2b7a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.607282:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211641 00010000:00010000:0.0:1651529344.607283:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c5173e lrc: 3/0,1 mode: PW/PW res: [0x2b7a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607286:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c5173e lrc: 3/0,1 mode: PW/PW res: [0x2b7a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607288:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c5173e lrc: 2/0,0 mode: PW/PW res: [0x2b7a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.607318:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.607322:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1137:39030:x1731745946466048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 889us (993us total) trans 12885079697 rc 0/0 00000100:00100000:0.0:1651529344.607324:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211642 00000100:00100000:0.0:1651529344.607329:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946466240 00000100:00100000:1.0:1651529344.607332:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.607336:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946466304 00000100:00100000:0.0:1651529344.607341:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211643 00000100:00100000:0.0:1651529344.607342:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1138:39029:x1731745946466240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.607344:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.607347:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178091 count 1 00010000:00010000:0.0:1651529344.607351:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dbec785/0x3234de053c51745 lrc: 3/0,1 mode: --/PW res: [0x2b7ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.607354:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.607356:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000047348548/0x3234de053c4cfc4 lrc: 2/0,0 mode: PR/PR res: [0x2b7ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf0a3 expref: 922 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.607367:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.607367:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.607368:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dbec785/0x3234de053c51745 lrc: 4/0,1 mode: --/PW res: [0x2b7ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607375:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000047348548/0x3234de053c4cfc4 lrc: 3/0,0 mode: PR/PR res: [0x2b7ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf0a3 expref: 922 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.607379:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000047348548/0x3234de053c4cfc4 lrc: 4/0,0 mode: PR/PR res: [0x2b7ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf0a3 expref: 922 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.607384:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e5997468 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997011904:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.607393:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 0000000029ae2bb2 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.607398:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0d30d7f/0x3234de053c51729 lrc: 2/0,0 mode: PW/PW res: [0x2b7a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607401:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f0d30d7f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.607402:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0d30d7f/0x3234de053c51729 lrc: 2/0,0 mode: PW/PW res: [0x2b7a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607405:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0d30d7f/0x3234de053c51729 lrc: 3/0,0 mode: PW/PW res: [0x2b7a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607409:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0d30d7f/0x3234de053c51729 lrc: 1/0,0 mode: --/PW res: [0x2b7a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607412:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0d30d7f/0x3234de053c51729 lrc: 0/0,0 mode: --/PW res: [0x2b7a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607416:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51730 lrc: 2/0,0 mode: PW/PW res: [0x2b7aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607418:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000073043e99 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.607419:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51730 lrc: 2/0,0 mode: PW/PW res: [0x2b7aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607422:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51730 lrc: 3/0,0 mode: PW/PW res: [0x2b7aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.607430:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946466368 00000100:00100000:1.0:1651529344.607438:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946466432 00000100:00100000:1.0:1651529344.607445:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211644 00000100:00100000:1.0:1651529344.607447:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1140:39030:x1731745946466304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.607453:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178092 count 1 00010000:00010000:1.0:1651529344.607457:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000888fed6b/0x3234de053c5174c lrc: 3/0,1 mode: --/PW res: [0x2b7ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607458:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51730 lrc: 1/0,0 mode: --/PW res: [0x2b7aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.607462:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007a4313e8/0x3234de053c4dd5b lrc: 2/0,0 mode: PR/PR res: [0x2b7ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d26c0 expref: 922 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.607462:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51730 lrc: 0/0,0 mode: --/PW res: [0x2b7aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.607465:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.607465:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.607466:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000888fed6b/0x3234de053c5174c lrc: 4/0,1 mode: --/PW res: [0x2b7ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607466:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000796e2f49/0x3234de053c51737 lrc: 2/0,0 mode: PW/PW res: [0x2b7a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607469:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000796e2f49 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.607470:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000796e2f49/0x3234de053c51737 lrc: 2/0,0 mode: PW/PW res: [0x2b7a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607472:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000796e2f49/0x3234de053c51737 lrc: 3/0,0 mode: PW/PW res: [0x2b7a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.607473:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007a4313e8/0x3234de053c4dd5b lrc: 3/0,0 mode: PR/PR res: [0x2b7ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d26c0 expref: 922 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.607476:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007a4313e8/0x3234de053c4dd5b lrc: 4/0,0 mode: PR/PR res: [0x2b7ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d26c0 expref: 922 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.607476:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000796e2f49/0x3234de053c51737 lrc: 1/0,0 mode: --/PW res: [0x2b7a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607478:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000796e2f49/0x3234de053c51737 lrc: 0/0,0 mode: --/PW res: [0x2b7a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.607480:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000117fbeca pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997011968:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.607481:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c5173e lrc: 2/0,0 mode: PW/PW res: [0x2b7a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607484:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000acc438d7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.607485:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c5173e lrc: 2/0,0 mode: PW/PW res: [0x2b7a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607490:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c5173e lrc: 3/0,0 mode: PW/PW res: [0x2b7a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.607491:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 0000000099c1da85 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.607493:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c5173e lrc: 1/0,0 mode: --/PW res: [0x2b7a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607495:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c5173e lrc: 0/0,0 mode: --/PW res: [0x2b7a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.607496:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211645 00000100:00100000:1.0:1651529344.607498:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1140:39029:x1731745946466368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.607502:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178093 count 1 00010000:00010000:1.0:1651529344.607505:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a47eb378/0x3234de053c51753 lrc: 3/0,1 mode: --/PW res: [0x2b7ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.607505:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211646 00000100:00100000:0.0:1651529344.607507:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1140:39030:x1731745946466432:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.607510:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e3a98370/0x3234de053c4d822 lrc: 2/0,0 mode: PR/PR res: [0x2b7ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1196 expref: 922 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.607512:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178094 count 1 00010000:00010000:1.0:1651529344.607513:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.607513:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.607514:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a47eb378/0x3234de053c51753 lrc: 4/0,1 mode: --/PW res: [0x2b7ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607515:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067750919/0x3234de053c5175a lrc: 3/0,1 mode: --/PW res: [0x2b7ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.607519:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e3a98370/0x3234de053c4d822 lrc: 3/0,0 mode: PR/PR res: [0x2b7ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1196 expref: 922 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.607519:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000907a5a89/0x3234de053c4ef6e lrc: 2/0,0 mode: PR/PR res: [0x2b7ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f8a expref: 922 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.607521:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.607522:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.607523:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e3a98370/0x3234de053c4d822 lrc: 4/0,0 mode: PR/PR res: [0x2b7ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1196 expref: 922 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.607523:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067750919/0x3234de053c5175a lrc: 4/0,1 mode: --/PW res: [0x2b7ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.607526:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fc130417 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997012032:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.607529:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000907a5a89/0x3234de053c4ef6e lrc: 3/0,0 mode: PR/PR res: [0x2b7ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f8a expref: 922 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.607532:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a6b79b05 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.607533:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000907a5a89/0x3234de053c4ef6e lrc: 4/0,0 mode: PR/PR res: [0x2b7ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f8a expref: 922 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.607537:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002a1f5cf2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997012096:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.607546:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 0000000076b354b3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.607582:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.607588:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946467008 00000100:00100000:0.0:1651529344.607606:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211647 00000100:00100000:0.0:1651529344.607607:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1141:39029:x1731745946467008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.607612:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178096 count 1 00000100:00100000:1.0:1651529344.607617:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.607627:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080981043/0x3234de053c51761 lrc: 3/0,1 mode: --/PW res: [0x2b7b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607631:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006cc08109/0x3234de053c4ced6 lrc: 2/0,0 mode: PR/PR res: [0x2b7b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced38 expref: 922 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.607634:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.607635:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.607635:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.607636:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080981043/0x3234de053c51761 lrc: 4/0,1 mode: --/PW res: [0x2b7b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607648:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006cc08109/0x3234de053c4ced6 lrc: 3/0,0 mode: PR/PR res: [0x2b7b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced38 expref: 922 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.607651:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.607652:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006cc08109/0x3234de053c4ced6 lrc: 4/0,0 mode: PR/PR res: [0x2b7b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced38 expref: 922 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.607656:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000de0edbdc pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997012160:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.607660:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.607670:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946466944 00000100:00100000:0.0:1651529344.607674:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 000000003ad73843 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.607680:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946467136 00000100:00100000:0.0:1651529344.607680:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946467072 00000100:00100000:1.0:1651529344.607684:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211648 00000100:00100000:1.0:1651529344.607686:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1144:39030:x1731745946466944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.607687:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211649 00000100:00100000:0.0:1651529344.607689:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1144:39029:x1731745946467136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.607690:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178095 count 1 00002000:00080000:0.0:1651529344.607693:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178098 count 1 00010000:00010000:1.0:1651529344.607694:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8e988a0/0x3234de053c51768 lrc: 3/0,1 mode: --/PW res: [0x2b7af:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607697:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5161cbb/0x3234de053c5176f lrc: 3/0,1 mode: --/PW res: [0x2b7b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607701:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a7ddedfd/0x3234de053c4f60c lrc: 2/0,0 mode: PR/PR res: [0x2b7b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ad4 expref: 922 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.607702:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ad4655ce/0x3234de053c4dae5 lrc: 2/0,0 mode: PR/PR res: [0x2b7af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1bb4 expref: 922 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.607704:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.607705:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.607705:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.607705:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5161cbb/0x3234de053c5176f lrc: 4/0,1 mode: --/PW res: [0x2b7b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.607706:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.607706:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8e988a0/0x3234de053c51768 lrc: 4/0,1 mode: --/PW res: [0x2b7af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607711:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a7ddedfd/0x3234de053c4f60c lrc: 3/0,0 mode: PR/PR res: [0x2b7b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ad4 expref: 922 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.607713:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ad4655ce/0x3234de053c4dae5 lrc: 3/0,0 mode: PR/PR res: [0x2b7af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1bb4 expref: 922 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.607715:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a7ddedfd/0x3234de053c4f60c lrc: 4/0,0 mode: PR/PR res: [0x2b7b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ad4 expref: 922 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.607716:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ad4655ce/0x3234de053c4dae5 lrc: 4/0,0 mode: PR/PR res: [0x2b7af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1bb4 expref: 922 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.607719:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b4acf60d pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997012224:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.607720:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005d3fb3ef pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997012288:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.607726:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000000e7e66c4 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.607729:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 000000007e004c12 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.607732:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211650 00000100:00100000:0.0:1651529344.607733:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1144:39030:x1731745946467072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.607747:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178097 count 1 00010000:00010000:0.0:1651529344.607751:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8fe7f95/0x3234de053c51776 lrc: 3/0,1 mode: --/PW res: [0x2b7b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607755:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000030b71431/0x3234de053c4f047 lrc: 2/0,0 mode: PR/PR res: [0x2b7b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d73ea expref: 922 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.607758:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.607759:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.607759:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8fe7f95/0x3234de053c51776 lrc: 4/0,1 mode: --/PW res: [0x2b7b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607765:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000030b71431/0x3234de053c4f047 lrc: 3/0,0 mode: PR/PR res: [0x2b7b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d73ea expref: 922 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.607769:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000030b71431/0x3234de053c4f047 lrc: 4/0,0 mode: PR/PR res: [0x2b7b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d73ea expref: 922 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.607773:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000fb8e412 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997012352:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.607781:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000003c8b0daf going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.607790:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e5997468 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997011904:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.607794:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003dbec785/0x3234de053c51745 lrc: 3/0,1 mode: --/PW res: [0x2b7ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.607817:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396347392 00010000:00010000:0.0:1651529344.607822:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000047348548/0x3234de053c4cfc4 lrc: 4/0,0 mode: PR/PR res: [0x2b7ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf0a3 expref: 923 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.607834:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12425 00000100:00100000:0.0:1651529344.607835:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+923:41279:x1731746396347392:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.607838:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.607840:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000047348548/0x3234de053c4cfc4 lrc: 4/0,0 mode: PR/PR res: [0x2b7ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf0a3 expref: 923 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.607843:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000047348548/0x3234de053c4cfc4 lrc: 3/0,0 mode: PR/PR res: [0x2b7ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf0a3 expref: 923 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.607849:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047348548/0x3234de053c4cfc4 lrc: 0/0,0 mode: --/PR res: [0x2b7ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf0a3 expref: 923 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.607852:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.607853:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.607853:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003dbec785/0x3234de053c51745 lrc: 3/0,1 mode: PW/PW res: [0x2b7ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607856:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dbec785/0x3234de053c51745 lrc: 4/0,1 mode: PW/PW res: [0x2b7ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607863:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.607874:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+922:41279:x1731746396347392:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.607877:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12425 00010000:00010000:0.0:1651529344.607883:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003dbec785/0x3234de053c51745 lrc: 3/0,1 mode: PW/PW res: [0x2b7ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607886:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003dbec785/0x3234de053c51745 lrc: 3/0,1 mode: PW/PW res: [0x2b7ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607892:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dbec785/0x3234de053c51745 lrc: 3/0,1 mode: PW/PW res: [0x2b7ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.607895:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003dbec785/0x3234de053c51745 lrc: 2/0,0 mode: PW/PW res: [0x2b7ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.608002:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1145:39029:x1731745946466240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 659us (684us total) trans 12885079698 rc 0/0 00000100:00100000:0.0:1651529344.608006:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211643 00010000:00010000:0.0:1651529344.608014:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003dbec785/0x3234de053c51745 lrc: 2/0,0 mode: PW/PW res: [0x2b7ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608017:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003dbec785 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.608018:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003dbec785/0x3234de053c51745 lrc: 2/0,0 mode: PW/PW res: [0x2b7ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608021:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003dbec785/0x3234de053c51745 lrc: 3/0,0 mode: PW/PW res: [0x2b7ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608026:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003dbec785/0x3234de053c51745 lrc: 1/0,0 mode: --/PW res: [0x2b7ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608029:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003dbec785/0x3234de053c51745 lrc: 0/0,0 mode: --/PW res: [0x2b7ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.608054:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000117fbeca pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997011968:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.608059:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000888fed6b/0x3234de053c5174c lrc: 3/0,1 mode: --/PW res: [0x2b7ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.608061:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.608066:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fc130417 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997012032:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.608068:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a47eb378/0x3234de053c51753 lrc: 3/0,1 mode: --/PW res: [0x2b7ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.608068:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.608077:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.608087:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396347648 00010000:00010000:1.0:1651529344.608092:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e3a98370/0x3234de053c4d822 lrc: 4/0,0 mode: PR/PR res: [0x2b7ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1196 expref: 922 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.608093:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002a1f5cf2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997012096:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.608097:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000067750919/0x3234de053c5175a lrc: 3/0,1 mode: --/PW res: [0x2b7ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.608098:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396347520 00010000:00010000:1.0:1651529344.608101:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007a4313e8/0x3234de053c4dd5b lrc: 4/0,0 mode: PR/PR res: [0x2b7ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d26c0 expref: 923 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.608103:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000de0edbdc pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997012160:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.608105:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396347712 00010000:00010000:0.0:1651529344.608106:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000080981043/0x3234de053c51761 lrc: 3/0,1 mode: --/PW res: [0x2b7b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.608107:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000907a5a89/0x3234de053c4ef6e lrc: 4/0,0 mode: PR/PR res: [0x2b7ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f8a expref: 924 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.608111:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12426 00000100:00100000:1.0:1651529344.608113:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+924:41279:x1731746396347648:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.608113:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12427 00010000:00010000:1.0:1651529344.608115:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.608115:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+924:41279:x1731746396347520:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.608116:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e3a98370/0x3234de053c4d822 lrc: 4/0,0 mode: PR/PR res: [0x2b7ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1196 expref: 924 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.608118:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.608120:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e3a98370/0x3234de053c4d822 lrc: 3/0,0 mode: PR/PR res: [0x2b7ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1196 expref: 924 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.608120:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007a4313e8/0x3234de053c4dd5b lrc: 4/0,0 mode: PR/PR res: [0x2b7ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d26c0 expref: 924 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.608124:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007a4313e8/0x3234de053c4dd5b lrc: 3/0,0 mode: PR/PR res: [0x2b7ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d26c0 expref: 924 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.608126:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3a98370/0x3234de053c4d822 lrc: 0/0,0 mode: --/PR res: [0x2b7ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1196 expref: 924 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.608129:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.608129:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a4313e8/0x3234de053c4dd5b lrc: 0/0,0 mode: --/PR res: [0x2b7ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d26c0 expref: 923 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.608130:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.608131:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a47eb378/0x3234de053c51753 lrc: 3/0,1 mode: PW/PW res: [0x2b7ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608133:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.608134:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.608135:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000888fed6b/0x3234de053c5174c lrc: 3/0,1 mode: PW/PW res: [0x2b7ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.608137:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a47eb378/0x3234de053c51753 lrc: 4/0,1 mode: PW/PW res: [0x2b7ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608140:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000888fed6b/0x3234de053c5174c lrc: 4/0,1 mode: PW/PW res: [0x2b7ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.608143:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.608149:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.608156:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+922:41279:x1731746396347648:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 43us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.608156:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+922:41279:x1731746396347520:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.608159:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12427 00000100:00100000:1.0:1651529344.608161:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12426 00000100:00100000:0.0:1651529344.608164:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12428 00000100:00100000:0.0:1651529344.608184:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bbd85ac9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+920:41279:x1731746396347712:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.608187:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.608188:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a47eb378/0x3234de053c51753 lrc: 3/0,1 mode: PW/PW res: [0x2b7ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608189:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000907a5a89/0x3234de053c4ef6e lrc: 4/0,0 mode: PR/PR res: [0x2b7ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f8a expref: 920 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.608191:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a47eb378/0x3234de053c51753 lrc: 3/0,1 mode: PW/PW res: [0x2b7ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608192:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000907a5a89/0x3234de053c4ef6e lrc: 3/0,0 mode: PR/PR res: [0x2b7ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f8a expref: 920 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.608194:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a47eb378/0x3234de053c51753 lrc: 3/0,1 mode: PW/PW res: [0x2b7ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.608197:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a47eb378/0x3234de053c51753 lrc: 2/0,0 mode: PW/PW res: [0x2b7ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608198:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000907a5a89/0x3234de053c4ef6e lrc: 0/0,0 mode: --/PR res: [0x2b7ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f8a expref: 920 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.608201:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.608202:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.608202:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000067750919/0x3234de053c5175a lrc: 3/0,1 mode: PW/PW res: [0x2b7ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608211:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067750919/0x3234de053c5175a lrc: 4/0,1 mode: PW/PW res: [0x2b7ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608220:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.608243:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bbd85ac9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+919:41279:x1731746396347712:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 59us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.608246:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12428 00000100:00100000:1.0:1651529344.608256:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1145:39029:x1731745946466368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 756us (911us total) trans 12885079699 rc 0/0 00010000:00010000:0.0:1651529344.608258:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a47eb378/0x3234de053c51753 lrc: 2/0,0 mode: PW/PW res: [0x2b7ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.608259:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211645 00010000:00010000:0.0:1651529344.608261:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a47eb378 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.608262:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a47eb378/0x3234de053c51753 lrc: 2/0,0 mode: PW/PW res: [0x2b7ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608265:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a47eb378/0x3234de053c51753 lrc: 3/0,0 mode: PW/PW res: [0x2b7ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.608266:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000888fed6b/0x3234de053c5174c lrc: 3/0,1 mode: PW/PW res: [0x2b7ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.608269:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000888fed6b/0x3234de053c5174c lrc: 3/0,1 mode: PW/PW res: [0x2b7ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608269:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a47eb378/0x3234de053c51753 lrc: 1/0,0 mode: --/PW res: [0x2b7ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608272:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a47eb378/0x3234de053c51753 lrc: 0/0,0 mode: --/PW res: [0x2b7ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.608273:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000888fed6b/0x3234de053c5174c lrc: 3/0,1 mode: PW/PW res: [0x2b7ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.608275:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000888fed6b/0x3234de053c5174c lrc: 2/0,0 mode: PW/PW res: [0x2b7ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608277:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000067750919/0x3234de053c5175a lrc: 3/0,1 mode: PW/PW res: [0x2b7ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608280:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067750919/0x3234de053c5175a lrc: 3/0,1 mode: PW/PW res: [0x2b7ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608292:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067750919/0x3234de053c5175a lrc: 3/0,1 mode: PW/PW res: [0x2b7ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608295:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067750919/0x3234de053c5175a lrc: 2/0,0 mode: PW/PW res: [0x2b7ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.608312:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1146:39030:x1731745946466304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 864us (980us total) trans 12885079700 rc 0/0 00000100:00100000:1.0:1651529344.608315:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211644 00000100:00100000:1.0:1651529344.608330:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.608365:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1145:39030:x1731745946466432:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 826us (979us total) trans 12885079701 rc 0/0 00000100:00100000:0.0:1651529344.608369:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211646 00000100:00100000:0.0:1651529344.608375:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946467264 00000100:00100000:0.0:1651529344.608385:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211651 00000100:00100000:0.0:1651529344.608387:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cb9f189a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1145:39029:x1731745946467264:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.608392:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178099 count 1 00010000:00010000:0.0:1651529344.608396:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c5177d lrc: 3/0,1 mode: --/PW res: [0x2b7b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608401:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f21c5d6c/0x3234de053c4c472 lrc: 2/0,0 mode: PR/PR res: [0x2b7b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc97b expref: 918 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.608411:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.608411:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.608412:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c5177d lrc: 4/0,1 mode: --/PW res: [0x2b7b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608419:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f21c5d6c/0x3234de053c4c472 lrc: 3/0,0 mode: PR/PR res: [0x2b7b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc97b expref: 918 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.608425:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f21c5d6c/0x3234de053c4c472 lrc: 4/0,0 mode: PR/PR res: [0x2b7b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc97b expref: 918 pid: 151609 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.608429:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ffb5d0a pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997012416:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.608444:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 0000000076b354b3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.608448:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.608449:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000888fed6b/0x3234de053c5174c lrc: 2/0,0 mode: PW/PW res: [0x2b7ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608474:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000888fed6b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.608475:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000888fed6b/0x3234de053c5174c lrc: 2/0,0 mode: PW/PW res: [0x2b7ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608478:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000888fed6b/0x3234de053c5174c lrc: 3/0,0 mode: PW/PW res: [0x2b7ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.608479:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.608483:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000888fed6b/0x3234de053c5174c lrc: 1/0,0 mode: --/PW res: [0x2b7ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608486:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000888fed6b/0x3234de053c5174c lrc: 0/0,0 mode: --/PW res: [0x2b7ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.608487:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.608490:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067750919/0x3234de053c5175a lrc: 2/0,0 mode: PW/PW res: [0x2b7ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.608493:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.608493:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067750919 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.608494:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067750919/0x3234de053c5175a lrc: 2/0,0 mode: PW/PW res: [0x2b7ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608497:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067750919/0x3234de053c5175a lrc: 3/0,0 mode: PW/PW res: [0x2b7ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608500:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067750919/0x3234de053c5175a lrc: 1/0,0 mode: --/PW res: [0x2b7ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608503:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067750919/0x3234de053c5175a lrc: 0/0,0 mode: --/PW res: [0x2b7ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.608507:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005d3fb3ef pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997012288:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.608511:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f8e988a0/0x3234de053c51768 lrc: 3/0,1 mode: --/PW res: [0x2b7af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.608513:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b4acf60d pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997012224:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.608517:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d5161cbb/0x3234de053c5176f lrc: 3/0,1 mode: --/PW res: [0x2b7b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.608518:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396347776 00010000:00010000:1.0:1651529344.608522:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006cc08109/0x3234de053c4ced6 lrc: 4/0,0 mode: PR/PR res: [0x2b7b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced38 expref: 919 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.608523:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000fb8e412 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997012352:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.608526:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e8fe7f95/0x3234de053c51776 lrc: 3/0,1 mode: --/PW res: [0x2b7b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.608527:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396347968 00010000:00010000:1.0:1651529344.608530:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a7ddedfd/0x3234de053c4f60c lrc: 4/0,0 mode: PR/PR res: [0x2b7b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ad4 expref: 920 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.608533:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396348096 00000100:00100000:1.0:1651529344.608537:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396348224 00010000:00010000:0.0:1651529344.608537:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ad4655ce/0x3234de053c4dae5 lrc: 4/0,0 mode: PR/PR res: [0x2b7af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1bb4 expref: 921 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.608539:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000030b71431/0x3234de053c4f047 lrc: 4/0,0 mode: PR/PR res: [0x2b7b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d73ea expref: 922 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.608543:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12429 00000100:00100000:1.0:1651529344.608545:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12430 00000100:00100000:0.0:1651529344.608545:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+922:41279:x1731746396347776:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.608547:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+922:41278:x1731746396347968:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.608548:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.608549:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006cc08109/0x3234de053c4ced6 lrc: 4/0,0 mode: PR/PR res: [0x2b7b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced38 expref: 922 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.608550:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.608551:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a7ddedfd/0x3234de053c4f60c lrc: 4/0,0 mode: PR/PR res: [0x2b7b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ad4 expref: 922 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.608553:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006cc08109/0x3234de053c4ced6 lrc: 3/0,0 mode: PR/PR res: [0x2b7b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced38 expref: 922 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.608555:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a7ddedfd/0x3234de053c4f60c lrc: 3/0,0 mode: PR/PR res: [0x2b7b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ad4 expref: 922 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.608558:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cc08109/0x3234de053c4ced6 lrc: 0/0,0 mode: --/PR res: [0x2b7b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced38 expref: 922 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.608560:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7ddedfd/0x3234de053c4f60c lrc: 0/0,0 mode: --/PR res: [0x2b7b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ad4 expref: 922 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.608562:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.608562:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.608563:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000080981043/0x3234de053c51761 lrc: 3/0,1 mode: PW/PW res: [0x2b7b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.608564:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.608564:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.608565:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d5161cbb/0x3234de053c5176f lrc: 3/0,1 mode: PW/PW res: [0x2b7b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608566:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080981043/0x3234de053c51761 lrc: 4/0,1 mode: PW/PW res: [0x2b7b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.608568:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5161cbb/0x3234de053c5176f lrc: 4/0,1 mode: PW/PW res: [0x2b7b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608572:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.608579:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.608588:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+920:41278:x1731746396347968:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 40us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.608591:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12430 00000100:00100000:1.0:1651529344.608596:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12431 00000100:00100000:1.0:1651529344.608597:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+919:41278:x1731746396348096:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.608600:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.608601:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ad4655ce/0x3234de053c4dae5 lrc: 4/0,0 mode: PR/PR res: [0x2b7af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1bb4 expref: 919 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.608602:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+919:41279:x1731746396347776:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 55us (153us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.608605:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ad4655ce/0x3234de053c4dae5 lrc: 3/0,0 mode: PR/PR res: [0x2b7af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1bb4 expref: 919 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.608605:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12429 00010000:00010000:1.0:1651529344.608610:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad4655ce/0x3234de053c4dae5 lrc: 0/0,0 mode: --/PR res: [0x2b7af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1bb4 expref: 918 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.608610:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12432 00010000:00010000:1.0:1651529344.608613:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.608614:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.608614:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f8e988a0/0x3234de053c51768 lrc: 3/0,1 mode: PW/PW res: [0x2b7af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.608617:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8e988a0/0x3234de053c51768 lrc: 4/0,1 mode: PW/PW res: [0x2b7af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.608623:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.608626:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+917:41278:x1731746396348224:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.608627:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+917:41278:x1731746396348096:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 30us (141us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.608629:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.608630:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12431 00010000:00010000:0.0:1651529344.608631:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000030b71431/0x3234de053c4f047 lrc: 4/0,0 mode: PR/PR res: [0x2b7b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d73ea expref: 917 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.608635:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000030b71431/0x3234de053c4f047 lrc: 3/0,0 mode: PR/PR res: [0x2b7b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d73ea expref: 916 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.608636:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f8e988a0/0x3234de053c51768 lrc: 3/0,1 mode: PW/PW res: [0x2b7af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.608639:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8e988a0/0x3234de053c51768 lrc: 3/0,1 mode: PW/PW res: [0x2b7af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608640:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030b71431/0x3234de053c4f047 lrc: 0/0,0 mode: --/PR res: [0x2b7b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d73ea expref: 916 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.608642:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8e988a0/0x3234de053c51768 lrc: 3/0,1 mode: PW/PW res: [0x2b7af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608644:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.608644:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.608645:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8e988a0/0x3234de053c51768 lrc: 2/0,0 mode: PW/PW res: [0x2b7af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608645:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e8fe7f95/0x3234de053c51776 lrc: 3/0,1 mode: PW/PW res: [0x2b7b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608648:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8fe7f95/0x3234de053c51776 lrc: 4/0,1 mode: PW/PW res: [0x2b7b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608661:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.608667:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+915:41278:x1731746396348224:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 40us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.608670:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12432 00010000:00010000:0.0:1651529344.608676:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000080981043/0x3234de053c51761 lrc: 3/0,1 mode: PW/PW res: [0x2b7b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608680:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080981043/0x3234de053c51761 lrc: 3/0,1 mode: PW/PW res: [0x2b7b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608683:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080981043/0x3234de053c51761 lrc: 3/0,1 mode: PW/PW res: [0x2b7b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.608685:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1146:39030:x1731745946466944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 999us (1068us total) trans 12885079702 rc 0/0 00010000:00010000:0.0:1651529344.608685:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080981043/0x3234de053c51761 lrc: 2/0,0 mode: PW/PW res: [0x2b7b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.608688:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211648 00000100:00100000:1.0:1651529344.608724:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.608725:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1146:39029:x1731745946467008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1117us (1143us total) trans 12885079703 rc 0/0 00000100:00100000:0.0:1651529344.608728:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211647 00000100:00100000:0.0:1651529344.608733:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946467520 00000100:00100000:0.0:1651529344.608758:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211652 00000100:00100000:0.0:1651529344.608760:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1146:39029:x1731745946467520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.608765:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178101 count 1 00000100:00100000:1.0:1651529344.608766:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.608770:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000695e6e5e/0x3234de053c51784 lrc: 3/0,1 mode: --/PW res: [0x2b7b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608774:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9001d94/0x3234de053c4ea66 lrc: 2/0,0 mode: PR/PR res: [0x2b7b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ad7 expref: 914 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.608777:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.608778:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.608779:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000695e6e5e/0x3234de053c51784 lrc: 4/0,1 mode: --/PW res: [0x2b7b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608785:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e9001d94/0x3234de053c4ea66 lrc: 3/0,0 mode: PR/PR res: [0x2b7b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ad7 expref: 914 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.608786:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.608789:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e9001d94/0x3234de053c4ea66 lrc: 4/0,0 mode: PR/PR res: [0x2b7b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ad7 expref: 914 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.608793:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000fb8e412 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997012480:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.608801:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 000000000e7e66c4 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.608807:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d5161cbb/0x3234de053c5176f lrc: 3/0,1 mode: PW/PW res: [0x2b7b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608810:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5161cbb/0x3234de053c5176f lrc: 3/0,1 mode: PW/PW res: [0x2b7b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608813:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5161cbb/0x3234de053c5176f lrc: 3/0,1 mode: PW/PW res: [0x2b7b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608815:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5161cbb/0x3234de053c5176f lrc: 2/0,0 mode: PW/PW res: [0x2b7b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.608820:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.608853:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946467584 00000100:00100000:1.0:1651529344.608867:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946467456 00000100:00100000:0.0:1651529344.608871:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1149:39029:x1731745946467136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1181us (1210us total) trans 12885079704 rc 0/0 00000100:00100000:1.0:1651529344.608873:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211653 00000100:00100000:1.0:1651529344.608874:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1149:39030:x1731745946467584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.608875:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211649 00002000:00080000:1.0:1651529344.608880:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178102 count 1 00000100:00100000:0.0:1651529344.608881:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211654 00000100:00100000:0.0:1651529344.608882:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1148:39029:x1731745946467456:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.608884:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002aadba27/0x3234de053c5178b lrc: 3/0,1 mode: --/PW res: [0x2b7b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.608887:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178100 count 1 00010000:00010000:1.0:1651529344.608889:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000de658da6/0x3234de053c4e90f lrc: 2/0,0 mode: PR/PR res: [0x2b7b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d54c5 expref: 914 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.608891:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f625209/0x3234de053c51792 lrc: 3/0,1 mode: --/PW res: [0x2b7b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.608895:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.608895:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.608896:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002aadba27/0x3234de053c5178b lrc: 4/0,1 mode: --/PW res: [0x2b7b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.608902:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000de658da6/0x3234de053c4e90f lrc: 3/0,0 mode: PR/PR res: [0x2b7b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d54c5 expref: 914 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.608906:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000de658da6/0x3234de053c4e90f lrc: 4/0,0 mode: PR/PR res: [0x2b7b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d54c5 expref: 914 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.608910:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009b8db73b pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997012544:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.608912:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000019ed34fd/0x3234de053c4ce2e lrc: 2/0,0 mode: PR/PR res: [0x2b7b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea1a expref: 914 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.608917:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.608918:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.608919:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a5495eb going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.608919:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f625209/0x3234de053c51792 lrc: 4/0,1 mode: --/PW res: [0x2b7b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.608926:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396348416 00010000:00010000:1.0:1651529344.608930:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f21c5d6c/0x3234de053c4c472 lrc: 5/0,0 mode: PR/PR res: [0x2b7b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc97b expref: 915 pid: 151609 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.608942:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12433 00000100:00100000:1.0:1651529344.608944:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+915:41279:x1731746396348416:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.608947:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.608948:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f21c5d6c/0x3234de053c4c472 lrc: 5/0,0 mode: PR/PR res: [0x2b7b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc97b expref: 915 pid: 151609 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.608952:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f21c5d6c/0x3234de053c4c472 lrc: 4/0,0 mode: PR/PR res: [0x2b7b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc97b expref: 915 pid: 151609 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.608960:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.608960:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.608961:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c5177d lrc: 3/0,1 mode: PW/PW res: [0x2b7b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608963:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000019ed34fd/0x3234de053c4ce2e lrc: 3/0,0 mode: PR/PR res: [0x2b7b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea1a expref: 915 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.608964:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c5177d lrc: 4/0,1 mode: PW/PW res: [0x2b7b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.608969:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.608969:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000019ed34fd/0x3234de053c4ce2e lrc: 4/0,0 mode: PR/PR res: [0x2b7b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea1a expref: 915 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.608973:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000028589556 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997012608:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.608974:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+915:41279:x1731746396348416:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 30us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.608977:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12433 00000100:00100000:0.0:1651529344.608983:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 0000000049203969 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.608989:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8e988a0/0x3234de053c51768 lrc: 2/0,0 mode: PW/PW res: [0x2b7af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.608991:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.608992:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f8e988a0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.608993:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8e988a0/0x3234de053c51768 lrc: 2/0,0 mode: PW/PW res: [0x2b7af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.608996:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8e988a0/0x3234de053c51768 lrc: 3/0,0 mode: PW/PW res: [0x2b7af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609001:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8e988a0/0x3234de053c51768 lrc: 1/0,0 mode: --/PW res: [0x2b7af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609004:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8e988a0/0x3234de053c51768 lrc: 0/0,0 mode: --/PW res: [0x2b7af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609008:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080981043/0x3234de053c51761 lrc: 2/0,0 mode: PW/PW res: [0x2b7b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609013:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000080981043 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.609014:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080981043/0x3234de053c51761 lrc: 2/0,0 mode: PW/PW res: [0x2b7b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609016:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080981043/0x3234de053c51761 lrc: 3/0,0 mode: PW/PW res: [0x2b7b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609020:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080981043/0x3234de053c51761 lrc: 1/0,0 mode: --/PW res: [0x2b7b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.609025:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.609050:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080981043/0x3234de053c51761 lrc: 0/0,0 mode: --/PW res: [0x2b7b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609054:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5161cbb/0x3234de053c5176f lrc: 2/0,0 mode: PW/PW res: [0x2b7b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609057:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d5161cbb already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.609058:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5161cbb/0x3234de053c5176f lrc: 2/0,0 mode: PW/PW res: [0x2b7b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609061:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5161cbb/0x3234de053c5176f lrc: 3/0,0 mode: PW/PW res: [0x2b7b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609065:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5161cbb/0x3234de053c5176f lrc: 1/0,0 mode: --/PW res: [0x2b7b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609067:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5161cbb/0x3234de053c5176f lrc: 0/0,0 mode: --/PW res: [0x2b7b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609079:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e8fe7f95/0x3234de053c51776 lrc: 3/0,1 mode: PW/PW res: [0x2b7b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609082:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8fe7f95/0x3234de053c51776 lrc: 3/0,1 mode: PW/PW res: [0x2b7b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609085:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8fe7f95/0x3234de053c51776 lrc: 3/0,1 mode: PW/PW res: [0x2b7b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609088:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8fe7f95/0x3234de053c51776 lrc: 2/0,0 mode: PW/PW res: [0x2b7b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.609104:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.609112:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946467648 00000100:00100000:1.0:1651529344.609118:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946467712 00000100:00100000:1.0:1651529344.609122:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211655 00000100:00100000:1.0:1651529344.609123:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1151:39029:x1731745946467648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.609128:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178103 count 1 00010000:00010000:1.0:1651529344.609132:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cadb9e90/0x3234de053c51799 lrc: 3/0,1 mode: --/PW res: [0x2b7b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.609137:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e767732f/0x3234de053c4e22b lrc: 2/0,0 mode: PR/PR res: [0x2b7b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d39d6 expref: 914 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.609140:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.609141:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.609141:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cadb9e90/0x3234de053c51799 lrc: 4/0,1 mode: --/PW res: [0x2b7b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.609155:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e767732f/0x3234de053c4e22b lrc: 3/0,0 mode: PR/PR res: [0x2b7b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d39d6 expref: 914 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.609159:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e767732f/0x3234de053c4e22b lrc: 4/0,0 mode: PR/PR res: [0x2b7b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d39d6 expref: 914 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.609161:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1151:39030:x1731745946467072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1414us (1497us total) trans 12885079705 rc 0/0 00000100:00100000:1.0:1651529344.609163:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dfef64e7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997012672:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.609164:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211650 00000100:00100000:0.0:1651529344.609170:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211656 00000100:00100000:1.0:1651529344.609171:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000412e5d26 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.609172:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1150:39030:x1731745946467712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.609177:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178104 count 1 00000100:00100000:1.0:1651529344.609178:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396348608 00010000:00010000:0.0:1651529344.609181:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055480488/0x3234de053c517a0 lrc: 3/0,1 mode: --/PW res: [0x2b7b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.609182:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e9001d94/0x3234de053c4ea66 lrc: 5/0,0 mode: PR/PR res: [0x2b7b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ad7 expref: 915 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.609186:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000269a3f0/0x3234de053c4cda2 lrc: 2/0,0 mode: PR/PR res: [0x2b7b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce84c expref: 915 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.609189:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12434 00010000:00010000:0.0:1651529344.609189:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.609189:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.609190:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055480488/0x3234de053c517a0 lrc: 4/0,1 mode: --/PW res: [0x2b7b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.609191:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+915:41279:x1731746396348608:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.609193:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.609195:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e9001d94/0x3234de053c4ea66 lrc: 5/0,0 mode: PR/PR res: [0x2b7b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ad7 expref: 915 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.609198:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e9001d94/0x3234de053c4ea66 lrc: 4/0,0 mode: PR/PR res: [0x2b7b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ad7 expref: 915 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.609198:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000269a3f0/0x3234de053c4cda2 lrc: 3/0,0 mode: PR/PR res: [0x2b7b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce84c expref: 915 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.609201:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000269a3f0/0x3234de053c4cda2 lrc: 4/0,0 mode: PR/PR res: [0x2b7b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce84c expref: 915 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.609203:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.609204:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.609205:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000695e6e5e/0x3234de053c51784 lrc: 3/0,1 mode: PW/PW res: [0x2b7b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.609206:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b4acf60d pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997012736:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.609208:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000695e6e5e/0x3234de053c51784 lrc: 4/0,1 mode: PW/PW res: [0x2b7b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.609213:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.609214:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bff8744a going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.609218:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+915:41279:x1731746396348608:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 27us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.609220:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12434 00010000:00010000:0.0:1651529344.609220:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8fe7f95/0x3234de053c51776 lrc: 2/0,0 mode: PW/PW res: [0x2b7b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609239:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e8fe7f95 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.609241:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8fe7f95/0x3234de053c51776 lrc: 2/0,0 mode: PW/PW res: [0x2b7b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609244:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8fe7f95/0x3234de053c51776 lrc: 3/0,0 mode: PW/PW res: [0x2b7b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609249:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8fe7f95/0x3234de053c51776 lrc: 1/0,0 mode: --/PW res: [0x2b7b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609251:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8fe7f95/0x3234de053c51776 lrc: 0/0,0 mode: --/PW res: [0x2b7b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.609257:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.609276:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946467776 00000100:00100000:0.0:1651529344.609288:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211657 00000100:00100000:0.0:1651529344.609289:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1151:39029:x1731745946467776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.609294:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178105 count 1 00010000:00010000:0.0:1651529344.609298:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c008f60/0x3234de053c517a7 lrc: 3/0,1 mode: --/PW res: [0x2b7b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609302:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002d694861/0x3234de053c4de49 lrc: 2/0,0 mode: PR/PR res: [0x2b7b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d29fa expref: 914 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.609305:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.609306:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.609307:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c008f60/0x3234de053c517a7 lrc: 4/0,1 mode: --/PW res: [0x2b7b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609313:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002d694861/0x3234de053c4de49 lrc: 3/0,0 mode: PR/PR res: [0x2b7b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d29fa expref: 914 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.609316:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002d694861/0x3234de053c4de49 lrc: 4/0,0 mode: PR/PR res: [0x2b7b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d29fa expref: 914 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.609320:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000de0edbdc pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997012800:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.609329:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 0000000009370c1d going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.609341:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.609346:0:156655:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f21c5d6c/0x3234de053c4c472 lrc: 0/0,0 mode: --/PR res: [0x2b7b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc97b expref: 914 pid: 151609 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.609351:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ffb5d0a pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997012416:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.609355:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c5177d lrc: 3/0,1 mode: PW/PW res: [0x2b7b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609358:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c5177d lrc: 3/0,1 mode: PW/PW res: [0x2b7b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609361:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c5177d lrc: 3/0,1 mode: PW/PW res: [0x2b7b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609364:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c5177d lrc: 3/0,1 mode: PW/PW res: [0x2b7b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609366:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c5177d lrc: 2/0,0 mode: PW/PW res: [0x2b7b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.609369:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.609381:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009b8db73b pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997012544:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.609385:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002aadba27/0x3234de053c5178b lrc: 3/0,1 mode: --/PW res: [0x2b7b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.609392:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396348672 00010000:00010000:1.0:1651529344.609396:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000de658da6/0x3234de053c4e90f lrc: 4/0,0 mode: PR/PR res: [0x2b7b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d54c5 expref: 914 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.609402:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396348736 00010000:00010000:1.0:1651529344.609404:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000019ed34fd/0x3234de053c4ce2e lrc: 5/0,0 mode: PR/PR res: [0x2b7b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea1a expref: 915 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.609409:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12435 00000100:00100000:1.0:1651529344.609411:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ede49ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+915:41278:x1731746396348672:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.609414:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.609416:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000de658da6/0x3234de053c4e90f lrc: 4/0,0 mode: PR/PR res: [0x2b7b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d54c5 expref: 915 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.609419:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000de658da6/0x3234de053c4e90f lrc: 3/0,0 mode: PR/PR res: [0x2b7b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d54c5 expref: 915 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.609427:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cb9f189a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1152:39029:x1731745946467264:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1039us (1096us total) trans 12885079706 rc 0/0 00000100:00100000:0.0:1651529344.609430:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211651 00010000:00010000:1.0:1651529344.609432:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de658da6/0x3234de053c4e90f lrc: 0/0,0 mode: --/PR res: [0x2b7b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d54c5 expref: 915 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.609435:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.609436:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.609437:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002aadba27/0x3234de053c5178b lrc: 3/0,1 mode: PW/PW res: [0x2b7b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.609440:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002aadba27/0x3234de053c5178b lrc: 4/0,1 mode: PW/PW res: [0x2b7b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.609446:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.609450:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c5177d lrc: 2/0,0 mode: PW/PW res: [0x2b7b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.609453:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ede49ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+914:41278:x1731746396348672:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 41us (113us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.609454:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b96e362a already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.609455:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12435 00000100:00100000:1.0:1651529344.609463:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12436 00000100:00100000:1.0:1651529344.609465:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+913:41278:x1731746396348736:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.609467:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.609469:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000019ed34fd/0x3234de053c4ce2e lrc: 5/0,0 mode: PR/PR res: [0x2b7b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea1a expref: 913 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.609471:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c5177d lrc: 2/0,0 mode: PW/PW res: [0x2b7b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609474:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c5177d lrc: 3/0,0 mode: PW/PW res: [0x2b7b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.609475:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000019ed34fd/0x3234de053c4ce2e lrc: 4/0,0 mode: PR/PR res: [0x2b7b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea1a expref: 913 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.609479:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c5177d lrc: 1/0,0 mode: --/PW res: [0x2b7b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.609480:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.609480:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.609481:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004f625209/0x3234de053c51792 lrc: 3/0,1 mode: PW/PW res: [0x2b7b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609482:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c5177d lrc: 0/0,0 mode: --/PW res: [0x2b7b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.609484:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f625209/0x3234de053c51792 lrc: 4/0,1 mode: PW/PW res: [0x2b7b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.609488:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.609492:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+913:41278:x1731746396348736:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 26us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.609494:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12436 00010000:00010000:0.0:1651529344.609494:0:80281:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9001d94/0x3234de053c4ea66 lrc: 0/0,0 mode: --/PR res: [0x2b7b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ad7 expref: 913 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.609497:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000fb8e412 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997012480:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.609501:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002aadba27/0x3234de053c5178b lrc: 3/0,1 mode: PW/PW res: [0x2b7b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609501:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000695e6e5e/0x3234de053c51784 lrc: 3/0,1 mode: PW/PW res: [0x2b7b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.609504:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002aadba27/0x3234de053c5178b lrc: 3/0,1 mode: PW/PW res: [0x2b7b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609504:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000695e6e5e/0x3234de053c51784 lrc: 3/0,1 mode: PW/PW res: [0x2b7b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.609507:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002aadba27/0x3234de053c5178b lrc: 3/0,1 mode: PW/PW res: [0x2b7b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609507:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000695e6e5e/0x3234de053c51784 lrc: 3/0,1 mode: PW/PW res: [0x2b7b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.609509:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002aadba27/0x3234de053c5178b lrc: 2/0,0 mode: PW/PW res: [0x2b7b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609510:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000695e6e5e/0x3234de053c51784 lrc: 3/0,1 mode: PW/PW res: [0x2b7b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609512:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000695e6e5e/0x3234de053c51784 lrc: 2/0,0 mode: PW/PW res: [0x2b7b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.609556:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1153:39030:x1731745946467584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 680us (790us total) trans 12885079707 rc 0/0 00000100:00100000:1.0:1651529344.609559:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211653 00000100:00100000:0.0:1651529344.609561:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1152:39029:x1731745946467520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 800us (837us total) trans 12885079708 rc 0/0 00000100:00100000:0.0:1651529344.609564:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211652 00010000:00010000:0.0:1651529344.609572:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002aadba27/0x3234de053c5178b lrc: 2/0,0 mode: PW/PW res: [0x2b7b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.609574:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.609613:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002aadba27 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.609615:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002aadba27/0x3234de053c5178b lrc: 2/0,0 mode: PW/PW res: [0x2b7b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609618:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002aadba27/0x3234de053c5178b lrc: 3/0,0 mode: PW/PW res: [0x2b7b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609623:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002aadba27/0x3234de053c5178b lrc: 1/0,0 mode: --/PW res: [0x2b7b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609626:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002aadba27/0x3234de053c5178b lrc: 0/0,0 mode: --/PW res: [0x2b7b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609637:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000695e6e5e/0x3234de053c51784 lrc: 2/0,0 mode: PW/PW res: [0x2b7b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609639:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000695e6e5e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.609640:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000695e6e5e/0x3234de053c51784 lrc: 2/0,0 mode: PW/PW res: [0x2b7b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609643:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000695e6e5e/0x3234de053c51784 lrc: 3/0,0 mode: PW/PW res: [0x2b7b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609646:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000695e6e5e/0x3234de053c51784 lrc: 1/0,0 mode: --/PW res: [0x2b7b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609656:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000695e6e5e/0x3234de053c51784 lrc: 0/0,0 mode: --/PW res: [0x2b7b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.609667:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000de0edbdc pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997012800:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.609671:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001c008f60/0x3234de053c517a7 lrc: 3/0,1 mode: --/PW res: [0x2b7b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.609677:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b4acf60d pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997012736:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.609680:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.609680:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000055480488/0x3234de053c517a0 lrc: 3/0,1 mode: --/PW res: [0x2b7b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609686:0:80276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019ed34fd/0x3234de053c4ce2e lrc: 0/0,0 mode: --/PR res: [0x2b7b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cea1a expref: 911 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.609688:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.609689:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000028589556 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997012608:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.609691:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004f625209/0x3234de053c51792 lrc: 3/0,1 mode: PW/PW res: [0x2b7b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609694:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004f625209/0x3234de053c51792 lrc: 3/0,1 mode: PW/PW res: [0x2b7b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.609696:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.609697:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f625209/0x3234de053c51792 lrc: 3/0,1 mode: PW/PW res: [0x2b7b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609699:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f625209/0x3234de053c51792 lrc: 3/0,1 mode: PW/PW res: [0x2b7b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609703:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f625209/0x3234de053c51792 lrc: 2/0,0 mode: PW/PW res: [0x2b7b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.609705:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dfef64e7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997012672:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.609709:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cadb9e90/0x3234de053c51799 lrc: 3/0,1 mode: --/PW res: [0x2b7b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.609715:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396348864 00010000:00010000:1.0:1651529344.609720:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000269a3f0/0x3234de053c4cda2 lrc: 4/0,0 mode: PR/PR res: [0x2b7b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce84c expref: 911 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.609725:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396348800 00010000:00010000:1.0:1651529344.609727:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e767732f/0x3234de053c4e22b lrc: 4/0,0 mode: PR/PR res: [0x2b7b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d39d6 expref: 912 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.609731:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396348928 00010000:00010000:1.0:1651529344.609733:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002d694861/0x3234de053c4de49 lrc: 4/0,0 mode: PR/PR res: [0x2b7b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d29fa expref: 913 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.609747:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12437 00000100:00100000:1.0:1651529344.609749:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+913:41278:x1731746396348864:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.609753:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.609754:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000269a3f0/0x3234de053c4cda2 lrc: 4/0,0 mode: PR/PR res: [0x2b7b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce84c expref: 913 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.609758:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000269a3f0/0x3234de053c4cda2 lrc: 3/0,0 mode: PR/PR res: [0x2b7b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce84c expref: 913 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.609764:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000269a3f0/0x3234de053c4cda2 lrc: 0/0,0 mode: --/PR res: [0x2b7b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce84c expref: 913 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.609767:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.609768:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.609772:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1152:39029:x1731745946467456:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 888us (951us total) trans 12885079709 rc 0/0 00010000:00010000:1.0:1651529344.609774:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000055480488/0x3234de053c517a0 lrc: 3/0,1 mode: PW/PW res: [0x2b7b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.609775:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211654 00010000:00010000:1.0:1651529344.609777:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055480488/0x3234de053c517a0 lrc: 4/0,1 mode: PW/PW res: [0x2b7b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.609780:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946468224 00010000:00010000:1.0:1651529344.609790:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.609794:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211658 00000100:00100000:0.0:1651529344.609796:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1152:39030:x1731745946468224:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.609798:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+912:41278:x1731746396348864:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 49us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.609801:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12437 00002000:00080000:0.0:1651529344.609801:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178106 count 1 00000100:00100000:1.0:1651529344.609805:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12438 00010000:00010000:0.0:1651529344.609805:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a74ee8f/0x3234de053c517ae lrc: 3/0,1 mode: --/PW res: [0x2b7ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.609807:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+911:41279:x1731746396348800:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.609809:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.609809:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bc36e4a9/0x3234de053c4a12c lrc: 2/0,0 mode: PR/PR res: [0x2b7ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb8f0 expref: 911 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.609811:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e767732f/0x3234de053c4e22b lrc: 4/0,0 mode: PR/PR res: [0x2b7b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d39d6 expref: 911 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.609817:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e767732f/0x3234de053c4e22b lrc: 3/0,0 mode: PR/PR res: [0x2b7b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d39d6 expref: 911 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.609821:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e767732f/0x3234de053c4e22b lrc: 0/0,0 mode: --/PR res: [0x2b7b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d39d6 expref: 911 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.609824:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.609825:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.609826:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cadb9e90/0x3234de053c51799 lrc: 3/0,1 mode: PW/PW res: [0x2b7b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609826:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.609827:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.609828:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a74ee8f/0x3234de053c517ae lrc: 4/0,1 mode: --/PW res: [0x2b7ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.609829:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cadb9e90/0x3234de053c51799 lrc: 4/0,1 mode: PW/PW res: [0x2b7b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.609834:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.609835:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bc36e4a9/0x3234de053c4a12c lrc: 3/0,0 mode: PR/PR res: [0x2b7ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb8f0 expref: 910 pid: 151609 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.609839:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+910:41279:x1731746396348800:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 31us (150us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.609839:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bc36e4a9/0x3234de053c4a12c lrc: 4/0,0 mode: PR/PR res: [0x2b7ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb8f0 expref: 910 pid: 151609 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.609841:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12438 00000100:00100000:1.0:1651529344.609844:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12439 00000100:00100000:1.0:1651529344.609846:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+909:41279:x1731746396348928:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.609848:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.609849:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002d694861/0x3234de053c4de49 lrc: 4/0,0 mode: PR/PR res: [0x2b7b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d29fa expref: 909 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.609853:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002d694861/0x3234de053c4de49 lrc: 3/0,0 mode: PR/PR res: [0x2b7b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d29fa expref: 909 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.609857:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b4acf60d pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997012864:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.609858:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d694861/0x3234de053c4de49 lrc: 0/0,0 mode: --/PR res: [0x2b7b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d29fa expref: 909 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.609861:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.609861:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.609862:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001c008f60/0x3234de053c517a7 lrc: 3/0,1 mode: PW/PW res: [0x2b7b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.609865:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c008f60/0x3234de053c517a7 lrc: 4/0,1 mode: PW/PW res: [0x2b7b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.609866:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bff8744a going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.609871:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f625209/0x3234de053c51792 lrc: 2/0,0 mode: PW/PW res: [0x2b7b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.609874:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.609879:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+908:41279:x1731746396348928:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 33us (184us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.609881:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004f625209 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.609882:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12439 00010000:00010000:0.0:1651529344.609882:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f625209/0x3234de053c51792 lrc: 2/0,0 mode: PW/PW res: [0x2b7b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609884:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f625209/0x3234de053c51792 lrc: 3/0,0 mode: PW/PW res: [0x2b7b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609889:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f625209/0x3234de053c51792 lrc: 1/0,0 mode: --/PW res: [0x2b7b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.609890:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cadb9e90/0x3234de053c51799 lrc: 3/0,1 mode: PW/PW res: [0x2b7b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609892:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f625209/0x3234de053c51792 lrc: 0/0,0 mode: --/PW res: [0x2b7b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.609893:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cadb9e90/0x3234de053c51799 lrc: 3/0,1 mode: PW/PW res: [0x2b7b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.609896:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cadb9e90/0x3234de053c51799 lrc: 3/0,1 mode: PW/PW res: [0x2b7b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609898:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001c008f60/0x3234de053c517a7 lrc: 3/0,1 mode: PW/PW res: [0x2b7b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.609899:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cadb9e90/0x3234de053c51799 lrc: 2/0,0 mode: PW/PW res: [0x2b7b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609901:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c008f60/0x3234de053c517a7 lrc: 3/0,1 mode: PW/PW res: [0x2b7b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609904:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c008f60/0x3234de053c517a7 lrc: 3/0,1 mode: PW/PW res: [0x2b7b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609916:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c008f60/0x3234de053c517a7 lrc: 2/0,0 mode: PW/PW res: [0x2b7b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.609941:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1153:39029:x1731745946467648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 817us (949us total) trans 12885079710 rc 0/0 00000100:00100000:1.0:1651529344.609944:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211655 00000100:00100000:0.0:1651529344.609969:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1153:39029:x1731745946467776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 679us (712us total) trans 12885079711 rc 0/0 00000100:00100000:0.0:1651529344.609973:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211657 00000100:00100000:1.0:1651529344.609979:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.609981:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cadb9e90/0x3234de053c51799 lrc: 2/0,0 mode: PW/PW res: [0x2b7b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.609992:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cadb9e90 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.609993:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cadb9e90/0x3234de053c51799 lrc: 2/0,0 mode: PW/PW res: [0x2b7b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.609996:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.609996:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cadb9e90/0x3234de053c51799 lrc: 3/0,0 mode: PW/PW res: [0x2b7b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610001:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cadb9e90/0x3234de053c51799 lrc: 1/0,0 mode: --/PW res: [0x2b7b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610003:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cadb9e90/0x3234de053c51799 lrc: 0/0,0 mode: --/PW res: [0x2b7b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.610008:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.610008:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c008f60/0x3234de053c517a7 lrc: 2/0,0 mode: PW/PW res: [0x2b7b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610010:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001c008f60 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.610011:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c008f60/0x3234de053c517a7 lrc: 2/0,0 mode: PW/PW res: [0x2b7b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610014:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c008f60/0x3234de053c517a7 lrc: 3/0,0 mode: PW/PW res: [0x2b7b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610017:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c008f60/0x3234de053c517a7 lrc: 1/0,0 mode: --/PW res: [0x2b7b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610020:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c008f60/0x3234de053c517a7 lrc: 0/0,0 mode: --/PW res: [0x2b7b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610026:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000055480488/0x3234de053c517a0 lrc: 3/0,1 mode: PW/PW res: [0x2b7b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610028:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055480488/0x3234de053c517a0 lrc: 3/0,1 mode: PW/PW res: [0x2b7b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610031:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055480488/0x3234de053c517a0 lrc: 3/0,1 mode: PW/PW res: [0x2b7b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610034:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000055480488/0x3234de053c517a0 lrc: 2/0,0 mode: PW/PW res: [0x2b7b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.610055:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946468416 00000100:00100000:1.0:1651529344.610065:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946468480 00000100:00100000:1.0:1651529344.610069:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946468544 00000100:00100000:1.0:1651529344.610073:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211659 00000100:00100000:1.0:1651529344.610074:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1156:39029:x1731745946468416:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.610080:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178107 count 1 00010000:00010000:1.0:1651529344.610084:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050f0d32a/0x3234de053c517b5 lrc: 3/0,1 mode: --/PW res: [0x2b7bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.610089:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007104861f/0x3234de053c4f6d0 lrc: 2/0,0 mode: PR/PR res: [0x2b7bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8de4 expref: 907 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.610092:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.610092:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.610093:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050f0d32a/0x3234de053c517b5 lrc: 4/0,1 mode: --/PW res: [0x2b7bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.610099:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007104861f/0x3234de053c4f6d0 lrc: 3/0,0 mode: PR/PR res: [0x2b7bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8de4 expref: 907 pid: 156655 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.610107:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1156:39030:x1731745946467712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 933us (1082us total) trans 12885079712 rc 0/0 00010000:00010000:1.0:1651529344.610108:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007104861f/0x3234de053c4f6d0 lrc: 4/0,0 mode: PR/PR res: [0x2b7bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8de4 expref: 907 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.610110:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211656 00000100:00100000:1.0:1651529344.610114:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000037ac96ac pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997012928:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.610116:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211660 00000100:00100000:0.0:1651529344.610117:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1155:39030:x1731745946468480:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.610122:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178108 count 1 00000100:00100000:1.0:1651529344.610123:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000412e5d26 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.610127:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c517bc lrc: 3/0,1 mode: --/PW res: [0x2b7bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.610129:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211661 00000100:00100000:1.0:1651529344.610131:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1155:39030:x1731745946468544:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.610131:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008f258e75/0x3234de053c4e725 lrc: 2/0,0 mode: PR/PR res: [0x2b7bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d94 expref: 907 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.610134:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1651529344.610135:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178109 count 1 00010000:00010000:0.0:1651529344.610135:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.610136:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c517bc lrc: 4/0,1 mode: --/PW res: [0x2b7bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.610138:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009acdc117/0x3234de053c517c3 lrc: 3/0,1 mode: --/PW res: [0x2b7bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.610143:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dc8c63f1/0x3234de053c4b1be lrc: 2/0,0 mode: PR/PR res: [0x2b7bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc0e5 expref: 907 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.610143:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008f258e75/0x3234de053c4e725 lrc: 3/0,0 mode: PR/PR res: [0x2b7bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d94 expref: 907 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.610145:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.610146:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.610146:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008f258e75/0x3234de053c4e725 lrc: 4/0,0 mode: PR/PR res: [0x2b7bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d94 expref: 907 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.610147:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009acdc117/0x3234de053c517c3 lrc: 4/0,1 mode: --/PW res: [0x2b7bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.610150:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000de0edbdc pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997012992:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.610152:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dc8c63f1/0x3234de053c4b1be lrc: 3/0,0 mode: PR/PR res: [0x2b7bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc0e5 expref: 907 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.610156:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dc8c63f1/0x3234de053c4b1be lrc: 4/0,0 mode: PR/PR res: [0x2b7bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc0e5 expref: 907 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.610159:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 0000000029ae2bb2 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.610160:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000043b7984f pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997013056:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.610164:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000055480488/0x3234de053c517a0 lrc: 2/0,0 mode: PW/PW res: [0x2b7b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.610166:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a5495eb going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.610180:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000055480488 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.610181:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000055480488/0x3234de053c517a0 lrc: 2/0,0 mode: PW/PW res: [0x2b7b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610186:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000055480488/0x3234de053c517a0 lrc: 3/0,0 mode: PW/PW res: [0x2b7b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610191:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000055480488/0x3234de053c517a0 lrc: 1/0,0 mode: --/PW res: [0x2b7b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610194:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055480488/0x3234de053c517a0 lrc: 0/0,0 mode: --/PW res: [0x2b7b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.610220:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.610258:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.610258:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946468672 00000100:00100000:1.0:1651529344.610268:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.610272:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946468608 00000100:00100000:0.0:1651529344.610279:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946468736 00000100:00100000:0.0:1651529344.610284:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211662 00000100:00100000:0.0:1651529344.610286:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1158:39029:x1731745946468672:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.610287:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211663 00000100:00100000:1.0:1651529344.610289:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1158:39030:x1731745946468608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.610292:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178111 count 1 00002000:00080000:1.0:1651529344.610294:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178110 count 1 00010000:00010000:0.0:1651529344.610295:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c517ca lrc: 3/0,1 mode: --/PW res: [0x2b7bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.610298:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089e57af8/0x3234de053c517d1 lrc: 3/0,1 mode: --/PW res: [0x2b7be:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610300:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004240f06a/0x3234de053c4d7c0 lrc: 2/0,0 mode: PR/PR res: [0x2b7bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d107e expref: 907 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.610303:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000917a6c6e/0x3234de053c4e2ef lrc: 2/0,0 mode: PR/PR res: [0x2b7be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3cd1 expref: 907 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.610303:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.610306:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.610306:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.610307:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089e57af8/0x3234de053c517d1 lrc: 4/0,1 mode: --/PW res: [0x2b7be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.610313:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000917a6c6e/0x3234de053c4e2ef lrc: 3/0,0 mode: PR/PR res: [0x2b7be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3cd1 expref: 907 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.610317:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000917a6c6e/0x3234de053c4e2ef lrc: 4/0,0 mode: PR/PR res: [0x2b7be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3cd1 expref: 907 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.610321:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000057329b82 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997013120:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.610321:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.610322:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c517ca lrc: 4/0,1 mode: --/PW res: [0x2b7bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610330:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004240f06a/0x3234de053c4d7c0 lrc: 3/0,0 mode: PR/PR res: [0x2b7bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d107e expref: 907 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.610331:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a6b79b05 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.610334:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004240f06a/0x3234de053c4d7c0 lrc: 4/0,0 mode: PR/PR res: [0x2b7bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d107e expref: 907 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.610337:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211664 00000100:00100000:1.0:1651529344.610339:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1158:39030:x1731745946468736:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.610342:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178112 count 1 00010000:00010000:1.0:1651529344.610346:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c517d8 lrc: 3/0,1 mode: --/PW res: [0x2b7c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.610351:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bb9bc56f/0x3234de053c4d9bf lrc: 2/0,0 mode: PR/PR res: [0x2b7c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d179a expref: 907 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.610351:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b0d9532a pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997013184:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.610354:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.610354:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.610355:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c517d8 lrc: 4/0,1 mode: --/PW res: [0x2b7c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.610360:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bb9bc56f/0x3234de053c4d9bf lrc: 3/0,0 mode: PR/PR res: [0x2b7c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d179a expref: 907 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.610360:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 000000003ad73843 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.610364:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bb9bc56f/0x3234de053c4d9bf lrc: 4/0,0 mode: PR/PR res: [0x2b7c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d179a expref: 907 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.610368:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000075b025a pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997013248:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.610374:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 000000007e004c12 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.610376:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.610384:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946468800 00000100:00100000:1.0:1651529344.610400:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.610401:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211665 00000100:00100000:0.0:1651529344.610403:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1159:39030:x1731745946468800:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.610407:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396349504 00002000:00080000:0.0:1651529344.610408:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178113 count 1 00010000:00010000:1.0:1651529344.610412:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bc36e4a9/0x3234de053c4a12c lrc: 5/0,0 mode: PR/PR res: [0x2b7ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb8f0 expref: 908 pid: 151609 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.610412:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c517df lrc: 3/0,1 mode: --/PW res: [0x2b7c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610416:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e0c2f0ae/0x3234de053c4e48c lrc: 2/0,0 mode: PR/PR res: [0x2b7c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4376 expref: 908 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.610419:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.610420:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12440 00010000:00010000:0.0:1651529344.610420:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.610420:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c517df lrc: 4/0,1 mode: --/PW res: [0x2b7c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.610421:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+908:41278:x1731746396349504:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.610424:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.610425:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bc36e4a9/0x3234de053c4a12c lrc: 5/0,0 mode: PR/PR res: [0x2b7ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb8f0 expref: 908 pid: 151609 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.610427:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e0c2f0ae/0x3234de053c4e48c lrc: 3/0,0 mode: PR/PR res: [0x2b7c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4376 expref: 908 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.610429:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bc36e4a9/0x3234de053c4a12c lrc: 4/0,0 mode: PR/PR res: [0x2b7ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb8f0 expref: 908 pid: 151609 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.610430:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e0c2f0ae/0x3234de053c4e48c lrc: 4/0,0 mode: PR/PR res: [0x2b7c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4376 expref: 908 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.610435:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.610435:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.610436:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004a74ee8f/0x3234de053c517ae lrc: 3/0,1 mode: PW/PW res: [0x2b7ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.610437:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000054e3a257 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997013312:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.610439:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a74ee8f/0x3234de053c517ae lrc: 4/0,1 mode: PW/PW res: [0x2b7ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.610444:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.610445:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aac87b31 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.610450:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+908:41278:x1731746396349504:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 28us (50us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.610452:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12440 00010000:00010000:0.0:1651529344.610454:0:80276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc36e4a9/0x3234de053c4a12c lrc: 0/0,0 mode: --/PR res: [0x2b7ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb8f0 expref: 908 pid: 151609 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.610458:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b4acf60d pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997012864:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.610461:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004a74ee8f/0x3234de053c517ae lrc: 3/0,1 mode: PW/PW res: [0x2b7ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610464:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004a74ee8f/0x3234de053c517ae lrc: 3/0,1 mode: PW/PW res: [0x2b7ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610467:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a74ee8f/0x3234de053c517ae lrc: 3/0,1 mode: PW/PW res: [0x2b7ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610470:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a74ee8f/0x3234de053c517ae lrc: 3/0,1 mode: PW/PW res: [0x2b7ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610473:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a74ee8f/0x3234de053c517ae lrc: 2/0,0 mode: PW/PW res: [0x2b7ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.610559:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1160:39030:x1731745946468224:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 762us (985us total) trans 12885079713 rc 0/0 00000100:00100000:0.0:1651529344.610562:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211658 00010000:00010000:0.0:1651529344.610569:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a74ee8f/0x3234de053c517ae lrc: 2/0,0 mode: PW/PW res: [0x2b7ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610573:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004a74ee8f already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.610574:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.610574:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a74ee8f/0x3234de053c517ae lrc: 2/0,0 mode: PW/PW res: [0x2b7ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610577:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a74ee8f/0x3234de053c517ae lrc: 3/0,0 mode: PW/PW res: [0x2b7ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610581:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a74ee8f/0x3234de053c517ae lrc: 1/0,0 mode: --/PW res: [0x2b7ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610584:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a74ee8f/0x3234de053c517ae lrc: 0/0,0 mode: --/PW res: [0x2b7ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.610594:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000de0edbdc pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997012992:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.610597:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c517bc lrc: 3/0,1 mode: --/PW res: [0x2b7bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.610603:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.610617:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.610621:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396349568 00010000:00010000:0.0:1651529344.610626:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007104861f/0x3234de053c4f6d0 lrc: 5/0,0 mode: PR/PR res: [0x2b7bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8de4 expref: 907 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.610627:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000037ac96ac pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997012928:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.610631:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000050f0d32a/0x3234de053c517b5 lrc: 3/0,1 mode: --/PW res: [0x2b7bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.610632:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396349632 00010000:00010000:0.0:1651529344.610634:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008f258e75/0x3234de053c4e725 lrc: 4/0,0 mode: PR/PR res: [0x2b7bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d94 expref: 908 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.610638:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000043b7984f pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997013056:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.610638:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396349696 00010000:00010000:1.0:1651529344.610640:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009acdc117/0x3234de053c517c3 lrc: 3/0,1 mode: --/PW res: [0x2b7bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610641:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dc8c63f1/0x3234de053c4b1be lrc: 4/0,0 mode: PR/PR res: [0x2b7bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc0e5 expref: 909 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.610645:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12441 00000100:00100000:0.0:1651529344.610647:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+909:41279:x1731746396349568:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.610649:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12442 00010000:00010000:0.0:1651529344.610650:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.610651:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050ef6a3e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+909:41279:x1731746396349632:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.610651:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007104861f/0x3234de053c4f6d0 lrc: 4/0,0 mode: PR/PR res: [0x2b7bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8de4 expref: 909 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.610654:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.610655:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007104861f/0x3234de053c4f6d0 lrc: 3/0,0 mode: PR/PR res: [0x2b7bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8de4 expref: 909 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.610656:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008f258e75/0x3234de053c4e725 lrc: 4/0,0 mode: PR/PR res: [0x2b7bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d94 expref: 909 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.610660:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008f258e75/0x3234de053c4e725 lrc: 3/0,0 mode: PR/PR res: [0x2b7bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d94 expref: 909 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.610660:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007104861f/0x3234de053c4f6d0 lrc: 0/0,0 mode: --/PR res: [0x2b7bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8de4 expref: 909 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.610664:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.610664:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.610665:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f258e75/0x3234de053c4e725 lrc: 0/0,0 mode: --/PR res: [0x2b7bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d94 expref: 908 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.610665:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000050f0d32a/0x3234de053c517b5 lrc: 3/0,1 mode: PW/PW res: [0x2b7bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610668:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050f0d32a/0x3234de053c517b5 lrc: 4/0,1 mode: PW/PW res: [0x2b7bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.610669:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.610670:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.610671:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c517bc lrc: 3/0,1 mode: PW/PW res: [0x2b7bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.610674:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c517bc lrc: 4/0,1 mode: PW/PW res: [0x2b7bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610678:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.610686:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+907:41279:x1731746396349568:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (119us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.610689:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.610694:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12441 00000100:00100000:1.0:1651529344.610697:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050ef6a3e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+906:41279:x1731746396349632:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 45us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.610699:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12443 00000100:00100000:1.0:1651529344.610701:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12442 00000100:00100000:0.0:1651529344.610701:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+906:41279:x1731746396349696:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.610704:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.610705:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dc8c63f1/0x3234de053c4b1be lrc: 4/0,0 mode: PR/PR res: [0x2b7bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc0e5 expref: 905 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.610709:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dc8c63f1/0x3234de053c4b1be lrc: 3/0,0 mode: PR/PR res: [0x2b7bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc0e5 expref: 905 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.610713:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000050f0d32a/0x3234de053c517b5 lrc: 3/0,1 mode: PW/PW res: [0x2b7bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610714:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc8c63f1/0x3234de053c4b1be lrc: 0/0,0 mode: --/PR res: [0x2b7bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc0e5 expref: 905 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.610717:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.610718:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.610719:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050f0d32a/0x3234de053c517b5 lrc: 3/0,1 mode: PW/PW res: [0x2b7bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610719:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009acdc117/0x3234de053c517c3 lrc: 3/0,1 mode: PW/PW res: [0x2b7bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.610722:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050f0d32a/0x3234de053c517b5 lrc: 3/0,1 mode: PW/PW res: [0x2b7bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610722:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009acdc117/0x3234de053c517c3 lrc: 4/0,1 mode: PW/PW res: [0x2b7bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.610725:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050f0d32a/0x3234de053c517b5 lrc: 2/0,0 mode: PW/PW res: [0x2b7bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610731:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.610748:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+904:41279:x1731746396349696:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 46us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.610751:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12443 00010000:00010000:0.0:1651529344.610757:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050f0d32a/0x3234de053c517b5 lrc: 2/0,0 mode: PW/PW res: [0x2b7bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610761:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000050f0d32a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.610762:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050f0d32a/0x3234de053c517b5 lrc: 2/0,0 mode: PW/PW res: [0x2b7bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610765:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050f0d32a/0x3234de053c517b5 lrc: 3/0,0 mode: PW/PW res: [0x2b7bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610769:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050f0d32a/0x3234de053c517b5 lrc: 1/0,0 mode: --/PW res: [0x2b7bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610772:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050f0d32a/0x3234de053c517b5 lrc: 0/0,0 mode: --/PW res: [0x2b7bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610778:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c517bc lrc: 3/0,1 mode: PW/PW res: [0x2b7bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.610782:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1160:39029:x1731745946468416:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 706us (802us total) trans 12885079714 rc 0/0 00000100:00100000:1.0:1651529344.610785:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211659 00010000:00010000:1.0:1651529344.610791:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009acdc117/0x3234de053c517c3 lrc: 3/0,1 mode: PW/PW res: [0x2b7bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.610794:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009acdc117/0x3234de053c517c3 lrc: 3/0,1 mode: PW/PW res: [0x2b7bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610796:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c517bc lrc: 3/0,1 mode: PW/PW res: [0x2b7bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.610797:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009acdc117/0x3234de053c517c3 lrc: 3/0,1 mode: PW/PW res: [0x2b7bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.610799:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009acdc117/0x3234de053c517c3 lrc: 2/0,0 mode: PW/PW res: [0x2b7bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610800:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c517bc lrc: 3/0,1 mode: PW/PW res: [0x2b7bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610803:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c517bc lrc: 2/0,0 mode: PW/PW res: [0x2b7bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.610838:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1161:39030:x1731745946468544:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 706us (830us total) trans 12885079715 rc 0/0 00000100:00100000:1.0:1651529344.610842:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211661 00000100:00100000:0.0:1651529344.610850:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1160:39030:x1731745946468480:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 731us (853us total) trans 12885079716 rc 0/0 00000100:00100000:0.0:1651529344.610853:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211660 00000100:00100000:1.0:1651529344.610858:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.610861:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009acdc117/0x3234de053c517c3 lrc: 2/0,0 mode: PW/PW res: [0x2b7bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610873:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009acdc117 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.610874:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009acdc117/0x3234de053c517c3 lrc: 2/0,0 mode: PW/PW res: [0x2b7bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610877:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009acdc117/0x3234de053c517c3 lrc: 3/0,0 mode: PW/PW res: [0x2b7bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610882:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009acdc117/0x3234de053c517c3 lrc: 1/0,0 mode: --/PW res: [0x2b7bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610885:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009acdc117/0x3234de053c517c3 lrc: 0/0,0 mode: --/PW res: [0x2b7bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610889:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c517bc lrc: 2/0,0 mode: PW/PW res: [0x2b7bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610892:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000037fb8315 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.610892:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c517bc lrc: 2/0,0 mode: PW/PW res: [0x2b7bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610895:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c517bc lrc: 3/0,0 mode: PW/PW res: [0x2b7bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610898:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c517bc lrc: 1/0,0 mode: --/PW res: [0x2b7bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610901:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c517bc lrc: 0/0,0 mode: --/PW res: [0x2b7bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.610908:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946469120 00000100:00100000:0.0:1651529344.610922:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211666 00000100:00100000:0.0:1651529344.610925:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1160:39030:x1731745946469120:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.610932:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178114 count 1 00010000:00010000:0.0:1651529344.610938:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c517e6 lrc: 3/0,1 mode: --/PW res: [0x2b7c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610945:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000013e35a9c/0x3234de053c4e3a5 lrc: 2/0,0 mode: PR/PR res: [0x2b7c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3fb7 expref: 903 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.610965:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.610966:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.610967:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c517e6 lrc: 4/0,1 mode: --/PW res: [0x2b7c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.610975:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000013e35a9c/0x3234de053c4e3a5 lrc: 3/0,0 mode: PR/PR res: [0x2b7c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3fb7 expref: 903 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.610979:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000013e35a9c/0x3234de053c4e3a5 lrc: 4/0,0 mode: PR/PR res: [0x2b7c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3fb7 expref: 903 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.610983:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000de0edbdc pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997013376:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.610992:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 0000000029ae2bb2 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.611072:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.611079:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946469312 00000100:00100000:1.0:1651529344.611086:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211667 00000100:00100000:1.0:1651529344.611087:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1161:39029:x1731745946469312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.611092:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178115 count 1 00010000:00010000:1.0:1651529344.611097:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c517ed lrc: 3/0,1 mode: --/PW res: [0x2b7c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.611102:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000073bfd46f/0x3234de053c4e65a lrc: 2/0,0 mode: PR/PR res: [0x2b7c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a4c expref: 903 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.611113:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.611114:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.611115:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.611115:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c517ed lrc: 4/0,1 mode: --/PW res: [0x2b7c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.611121:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.611123:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000073bfd46f/0x3234de053c4e65a lrc: 3/0,0 mode: PR/PR res: [0x2b7c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a4c expref: 903 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.611126:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000073bfd46f/0x3234de053c4e65a lrc: 4/0,0 mode: PR/PR res: [0x2b7c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a4c expref: 903 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.611128:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946469376 00000100:00100000:1.0:1651529344.611131:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000043b7984f pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997013440:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.611134:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946469440 00000100:00100000:0.0:1651529344.611142:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211668 00000100:00100000:0.0:1651529344.611144:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1163:39030:x1731745946469376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.611148:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fb6c773d going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.611149:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178116 count 1 00010000:00010000:0.0:1651529344.611154:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c517f4 lrc: 3/0,1 mode: --/PW res: [0x2b7c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.611155:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211669 00000100:00100000:1.0:1651529344.611157:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085af61db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1163:39030:x1731745946469440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.611158:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c4df30 lrc: 2/0,0 mode: PR/PR res: [0x2b7c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2df1 expref: 903 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.611161:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178117 count 1 00010000:00010000:0.0:1651529344.611161:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.611162:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.611162:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c517f4 lrc: 4/0,1 mode: --/PW res: [0x2b7c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.611165:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c517fb lrc: 3/0,1 mode: --/PW res: [0x2b7c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.611169:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009c6de5a9/0x3234de053c4e2da lrc: 2/0,0 mode: PR/PR res: [0x2b7c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ca7 expref: 903 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.611169:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c4df30 lrc: 3/0,0 mode: PR/PR res: [0x2b7c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2df1 expref: 903 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.611173:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.611173:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.611173:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c4df30 lrc: 4/0,0 mode: PR/PR res: [0x2b7c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2df1 expref: 903 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.611174:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c517fb lrc: 4/0,1 mode: --/PW res: [0x2b7c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.611177:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e124baf1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997013504:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.611180:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009c6de5a9/0x3234de053c4e2da lrc: 3/0,0 mode: PR/PR res: [0x2b7c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ca7 expref: 903 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.611183:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009c6de5a9/0x3234de053c4e2da lrc: 4/0,0 mode: PR/PR res: [0x2b7c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ca7 expref: 903 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.611186:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 0000000049203969 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.611187:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000037ac96ac pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997013568:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.611194:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a5495eb going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.611384:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000057329b82 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997013120:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.611387:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.611389:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000089e57af8/0x3234de053c517d1 lrc: 3/0,1 mode: --/PW res: [0x2b7be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.611401:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396349760 00010000:00010000:1.0:1651529344.611406:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000917a6c6e/0x3234de053c4e2ef lrc: 4/0,0 mode: PR/PR res: [0x2b7be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3cd1 expref: 904 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.611407:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.611413:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396349888 00010000:00010000:1.0:1651529344.611415:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004240f06a/0x3234de053c4d7c0 lrc: 5/0,0 mode: PR/PR res: [0x2b7bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d107e expref: 905 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.611427:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12444 00000100:00100000:0.0:1651529344.611427:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b0d9532a pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997013184:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.611428:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+905:41278:x1731746396349760:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.611431:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.611431:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c517ca lrc: 3/0,1 mode: --/PW res: [0x2b7bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.611432:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000917a6c6e/0x3234de053c4e2ef lrc: 4/0,0 mode: PR/PR res: [0x2b7be:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3cd1 expref: 905 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.611436:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000917a6c6e/0x3234de053c4e2ef lrc: 3/0,0 mode: PR/PR res: [0x2b7be:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3cd1 expref: 905 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.611439:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12445 00000100:00100000:0.0:1651529344.611441:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+905:41278:x1731746396349888:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.611442:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000917a6c6e/0x3234de053c4e2ef lrc: 0/0,0 mode: --/PR res: [0x2b7be:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3cd1 expref: 905 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.611444:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.611445:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.611446:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.611446:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004240f06a/0x3234de053c4d7c0 lrc: 4/0,0 mode: PR/PR res: [0x2b7bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d107e expref: 904 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.611447:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000089e57af8/0x3234de053c517d1 lrc: 3/0,1 mode: PW/PW res: [0x2b7be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.611450:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089e57af8/0x3234de053c517d1 lrc: 4/0,1 mode: PW/PW res: [0x2b7be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.611450:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004240f06a/0x3234de053c4d7c0 lrc: 3/0,0 mode: PR/PR res: [0x2b7bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d107e expref: 904 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.611456:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.611456:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004240f06a/0x3234de053c4d7c0 lrc: 0/0,0 mode: --/PR res: [0x2b7bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d107e expref: 904 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.611459:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.611460:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.611461:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c517ca lrc: 3/0,1 mode: PW/PW res: [0x2b7bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.611464:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+903:41278:x1731746396349760:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (78us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.611464:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c517ca lrc: 4/0,1 mode: PW/PW res: [0x2b7bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.611467:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12444 00000100:00100000:1.0:1651529344.611476:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000075b025a pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997013248:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.611480:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c517d8 lrc: 3/0,1 mode: --/PW res: [0x2b7c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.611485:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.611486:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000089e57af8/0x3234de053c517d1 lrc: 3/0,1 mode: PW/PW res: [0x2b7be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.611489:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089e57af8/0x3234de053c517d1 lrc: 3/0,1 mode: PW/PW res: [0x2b7be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.611492:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089e57af8/0x3234de053c517d1 lrc: 3/0,1 mode: PW/PW res: [0x2b7be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.611493:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+902:41278:x1731746396349888:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 51us (86us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.611494:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089e57af8/0x3234de053c517d1 lrc: 2/0,0 mode: PW/PW res: [0x2b7be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.611496:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12445 00010000:00010000:0.0:1651529344.611511:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c517ca lrc: 3/0,1 mode: PW/PW res: [0x2b7bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.611517:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c517ca lrc: 3/0,1 mode: PW/PW res: [0x2b7bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.611521:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c517ca lrc: 3/0,1 mode: PW/PW res: [0x2b7bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.611523:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c517ca lrc: 2/0,0 mode: PW/PW res: [0x2b7bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.611538:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1164:39030:x1731745946468608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1248us (1280us total) trans 12885079717 rc 0/0 00000100:00100000:1.0:1651529344.611541:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211663 00000100:00100000:0.0:1651529344.611564:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1164:39029:x1731745946468672:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1277us (1344us total) trans 12885079718 rc 0/0 00000100:00100000:0.0:1651529344.611567:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211662 00010000:00010000:0.0:1651529344.611582:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089e57af8/0x3234de053c517d1 lrc: 2/0,0 mode: PW/PW res: [0x2b7be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.611585:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000089e57af8 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.611586:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089e57af8/0x3234de053c517d1 lrc: 2/0,0 mode: PW/PW res: [0x2b7be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.611589:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089e57af8/0x3234de053c517d1 lrc: 3/0,0 mode: PW/PW res: [0x2b7be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.611594:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089e57af8/0x3234de053c517d1 lrc: 1/0,0 mode: --/PW res: [0x2b7be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.611596:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089e57af8/0x3234de053c517d1 lrc: 0/0,0 mode: --/PW res: [0x2b7be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.611601:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c517ca lrc: 2/0,0 mode: PW/PW res: [0x2b7bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.611604:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e6b94407 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.611604:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c517ca lrc: 2/0,0 mode: PW/PW res: [0x2b7bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.611607:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c517ca lrc: 3/0,0 mode: PW/PW res: [0x2b7bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.611610:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c517ca lrc: 1/0,0 mode: --/PW res: [0x2b7bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.611613:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c517ca lrc: 0/0,0 mode: --/PW res: [0x2b7bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.611622:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000054e3a257 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997013312:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.611625:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c517df lrc: 3/0,1 mode: --/PW res: [0x2b7c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.611762:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.611791:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.611793:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946469632 00000100:00100000:0.0:1651529344.611803:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946469696 00000100:00100000:1.0:1651529344.611805:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.611813:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211670 00000100:00100000:0.0:1651529344.611819:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1165:39029:x1731745946469632:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.611821:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:0.0:1651529344.611825:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178118 count 1 00010000:00010000:0.0:1651529344.611829:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51802 lrc: 3/0,1 mode: --/PW res: [0x2b7c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.611830:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211671 00000100:00100000:1.0:1651529344.611832:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1165:39030:x1731745946469696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.611838:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178119 count 1 00010000:00010000:1.0:1651529344.611843:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c51809 lrc: 3/0,1 mode: --/PW res: [0x2b7c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.611848:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000029def14e/0x3234de053c4e5ce lrc: 2/0,0 mode: PR/PR res: [0x2b7c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d48cb expref: 901 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.611858:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cdd47e67/0x3234de053c4d4ef lrc: 2/0,0 mode: PR/PR res: [0x2b7c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d05cd expref: 901 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.611861:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.611862:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.611862:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51802 lrc: 4/0,1 mode: --/PW res: [0x2b7c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.611863:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.611864:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.611865:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c51809 lrc: 4/0,1 mode: --/PW res: [0x2b7c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.611870:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cdd47e67/0x3234de053c4d4ef lrc: 3/0,0 mode: PR/PR res: [0x2b7c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d05cd expref: 901 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.611873:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000029def14e/0x3234de053c4e5ce lrc: 3/0,0 mode: PR/PR res: [0x2b7c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d48cb expref: 901 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.611873:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cdd47e67/0x3234de053c4d4ef lrc: 4/0,0 mode: PR/PR res: [0x2b7c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d05cd expref: 901 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.611877:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000029def14e/0x3234de053c4e5ce lrc: 4/0,0 mode: PR/PR res: [0x2b7c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d48cb expref: 901 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.611878:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000054e3a257 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997013632:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.611881:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997013696:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.611887:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 000000003ad73843 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.611890:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 000000007e004c12 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.611896:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000de0edbdc pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997013376:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.611897:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396350080 00010000:00010000:0.0:1651529344.611899:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c517e6 lrc: 3/0,1 mode: --/PW res: [0x2b7c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.611901:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bb9bc56f/0x3234de053c4d9bf lrc: 4/0,0 mode: PR/PR res: [0x2b7c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d179a expref: 902 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.611908:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396350208 00010000:00010000:1.0:1651529344.611910:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e0c2f0ae/0x3234de053c4e48c lrc: 4/0,0 mode: PR/PR res: [0x2b7c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4376 expref: 903 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.611926:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12446 00000100:00100000:1.0:1651529344.611927:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+903:41278:x1731746396350080:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.611930:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.611931:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bb9bc56f/0x3234de053c4d9bf lrc: 4/0,0 mode: PR/PR res: [0x2b7c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d179a expref: 903 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.611935:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bb9bc56f/0x3234de053c4d9bf lrc: 3/0,0 mode: PR/PR res: [0x2b7c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d179a expref: 903 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.611936:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.611940:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb9bc56f/0x3234de053c4d9bf lrc: 0/0,0 mode: --/PR res: [0x2b7c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d179a expref: 903 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.611944:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.611944:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.611945:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c517d8 lrc: 3/0,1 mode: PW/PW res: [0x2b7c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.611948:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c517d8 lrc: 4/0,1 mode: PW/PW res: [0x2b7c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.611954:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.611966:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+902:41278:x1731746396350080:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 38us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.611969:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12446 00000100:00100000:1.0:1651529344.611973:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396350464 00010000:00010000:1.0:1651529344.611977:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000013e35a9c/0x3234de053c4e3a5 lrc: 4/0,0 mode: PR/PR res: [0x2b7c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3fb7 expref: 902 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.611980:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.611981:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396350528 00010000:00010000:1.0:1651529344.611983:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000073bfd46f/0x3234de053c4e65a lrc: 5/0,0 mode: PR/PR res: [0x2b7c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a4c expref: 903 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.611988:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12447 00000100:00100000:1.0:1651529344.611989:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+903:41278:x1731746396350208:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.611991:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.611993:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e0c2f0ae/0x3234de053c4e48c lrc: 4/0,0 mode: PR/PR res: [0x2b7c1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4376 expref: 903 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.611996:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e0c2f0ae/0x3234de053c4e48c lrc: 3/0,0 mode: PR/PR res: [0x2b7c1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4376 expref: 903 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.612009:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0c2f0ae/0x3234de053c4e48c lrc: 0/0,0 mode: --/PR res: [0x2b7c1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4376 expref: 903 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.612016:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.612017:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.612018:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.612019:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c517df lrc: 3/0,1 mode: PW/PW res: [0x2b7c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.612021:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.612022:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c517df lrc: 4/0,1 mode: PW/PW res: [0x2b7c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612031:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.612035:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e124baf1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997013504:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.612041:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+902:41278:x1731746396350208:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 51us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.612043:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12447 00010000:00010000:0.0:1651529344.612044:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c517f4 lrc: 3/0,1 mode: --/PW res: [0x2b7c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.612048:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396350592 00010000:00010000:0.0:1651529344.612050:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c517df lrc: 3/0,1 mode: PW/PW res: [0x2b7c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612051:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c4df30 lrc: 4/0,0 mode: PR/PR res: [0x2b7c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2df1 expref: 902 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.612052:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c517df lrc: 3/0,1 mode: PW/PW res: [0x2b7c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.612056:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396350656 00010000:00010000:0.0:1651529344.612056:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c517df lrc: 3/0,1 mode: PW/PW res: [0x2b7c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612058:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009c6de5a9/0x3234de053c4e2da lrc: 5/0,0 mode: PR/PR res: [0x2b7c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ca7 expref: 903 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.612058:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c517df lrc: 2/0,0 mode: PW/PW res: [0x2b7c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.612062:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12448 00000100:00100000:1.0:1651529344.612064:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+903:41279:x1731746396350464:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.612066:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.612067:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000013e35a9c/0x3234de053c4e3a5 lrc: 4/0,0 mode: PR/PR res: [0x2b7c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3fb7 expref: 903 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.612070:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000013e35a9c/0x3234de053c4e3a5 lrc: 3/0,0 mode: PR/PR res: [0x2b7c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3fb7 expref: 903 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.612075:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013e35a9c/0x3234de053c4e3a5 lrc: 0/0,0 mode: --/PR res: [0x2b7c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3fb7 expref: 903 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.612079:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.612079:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.612080:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c517e6 lrc: 3/0,1 mode: PW/PW res: [0x2b7c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612085:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c517e6 lrc: 4/0,1 mode: PW/PW res: [0x2b7c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612093:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.612098:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+902:41279:x1731746396350464:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 34us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.612101:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12448 00000100:00100000:1.0:1651529344.612105:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12449 00000100:00100000:1.0:1651529344.612106:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cd5e5a1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+901:41278:x1731746396350528:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.612108:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.612110:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000073bfd46f/0x3234de053c4e65a lrc: 5/0,0 mode: PR/PR res: [0x2b7c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a4c expref: 901 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.612113:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000073bfd46f/0x3234de053c4e65a lrc: 4/0,0 mode: PR/PR res: [0x2b7c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a4c expref: 901 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.612117:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.612118:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.612119:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c517ed lrc: 3/0,1 mode: PW/PW res: [0x2b7c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.612120:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1166:39030:x1731745946468800:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1715us (1743us total) trans 12885079719 rc 0/0 00010000:00010000:1.0:1651529344.612121:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c517ed lrc: 4/0,1 mode: PW/PW res: [0x2b7c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.612123:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211665 00010000:00010000:1.0:1651529344.612126:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.612129:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cd5e5a1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+901:41278:x1731746396350528:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 23us (150us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.612130:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c517df lrc: 2/0,0 mode: PW/PW res: [0x2b7c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.612132:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12449 00010000:00010000:0.0:1651529344.612134:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5c1b0ba already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.612135:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c517df lrc: 2/0,0 mode: PW/PW res: [0x2b7c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612137:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c517df lrc: 3/0,0 mode: PW/PW res: [0x2b7c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.612139:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12450 00000100:00100000:1.0:1651529344.612141:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+900:41279:x1731746396350592:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.612143:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.612144:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c4df30 lrc: 4/0,0 mode: PR/PR res: [0x2b7c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2df1 expref: 900 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.612145:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c517df lrc: 1/0,0 mode: --/PW res: [0x2b7c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612147:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c4df30 lrc: 3/0,0 mode: PR/PR res: [0x2b7c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2df1 expref: 900 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.612147:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c517df lrc: 0/0,0 mode: --/PW res: [0x2b7c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612151:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c4df30 lrc: 0/0,0 mode: --/PR res: [0x2b7c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2df1 expref: 900 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.612153:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c517e6 lrc: 3/0,1 mode: PW/PW res: [0x2b7c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612155:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.612155:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.612156:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c517f4 lrc: 3/0,1 mode: PW/PW res: [0x2b7c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612156:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c517e6 lrc: 3/0,1 mode: PW/PW res: [0x2b7c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612159:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c517f4 lrc: 4/0,1 mode: PW/PW res: [0x2b7c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612159:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c517e6 lrc: 3/0,1 mode: PW/PW res: [0x2b7c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612162:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c517e6 lrc: 2/0,0 mode: PW/PW res: [0x2b7c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612167:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.612171:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+899:41279:x1731746396350592:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 30us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.612173:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12450 00000100:00100000:1.0:1651529344.612177:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12451 00000100:00100000:1.0:1651529344.612179:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+898:41278:x1731746396350656:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.612181:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.612182:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009c6de5a9/0x3234de053c4e2da lrc: 5/0,0 mode: PR/PR res: [0x2b7c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ca7 expref: 898 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.612186:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009c6de5a9/0x3234de053c4e2da lrc: 4/0,0 mode: PR/PR res: [0x2b7c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ca7 expref: 898 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.612190:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.612190:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.612191:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c517fb lrc: 3/0,1 mode: PW/PW res: [0x2b7c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612194:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c517fb lrc: 4/0,1 mode: PW/PW res: [0x2b7c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612198:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.612201:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+898:41278:x1731746396350656:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 22us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.612204:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12451 00010000:00010000:1.0:1651529344.612214:0:80277:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073bfd46f/0x3234de053c4e65a lrc: 0/0,0 mode: --/PR res: [0x2b7c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a4c expref: 897 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.612238:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000043b7984f pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997013440:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.612242:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c517ed lrc: 3/0,1 mode: PW/PW res: [0x2b7c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612248:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c517ed lrc: 3/0,1 mode: PW/PW res: [0x2b7c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612251:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c517ed lrc: 3/0,1 mode: PW/PW res: [0x2b7c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612254:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c517ed lrc: 3/0,1 mode: PW/PW res: [0x2b7c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.612255:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1166:39030:x1731745946469120:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1329us (1396us total) trans 12885079720 rc 0/0 00010000:00010000:1.0:1651529344.612257:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c517ed lrc: 2/0,0 mode: PW/PW res: [0x2b7c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.612258:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211666 00010000:00010000:0.0:1651529344.612272:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c517f4 lrc: 3/0,1 mode: PW/PW res: [0x2b7c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612276:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c517f4 lrc: 3/0,1 mode: PW/PW res: [0x2b7c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612282:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c517f4 lrc: 3/0,1 mode: PW/PW res: [0x2b7c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612284:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c517f4 lrc: 2/0,0 mode: PW/PW res: [0x2b7c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.612298:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1166:39029:x1731745946469312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1210us (1226us total) trans 12885079721 rc 0/0 00000100:00100000:1.0:1651529344.612301:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211667 00010000:00010000:1.0:1651529344.612309:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c517d8 lrc: 3/0,1 mode: PW/PW res: [0x2b7c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612312:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c517d8 lrc: 3/0,1 mode: PW/PW res: [0x2b7c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612315:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c517d8 lrc: 3/0,1 mode: PW/PW res: [0x2b7c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612318:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c517d8 lrc: 2/0,0 mode: PW/PW res: [0x2b7c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.612321:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1166:39030:x1731745946469376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1176us (1209us total) trans 12885079722 rc 0/0 00000100:00100000:0.0:1651529344.612324:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211668 00010000:00010000:0.0:1651529344.612331:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c517e6 lrc: 2/0,0 mode: PW/PW res: [0x2b7c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612334:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000491b5359 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.612335:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c517e6 lrc: 2/0,0 mode: PW/PW res: [0x2b7c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612338:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c517e6 lrc: 3/0,0 mode: PW/PW res: [0x2b7c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612342:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c517e6 lrc: 1/0,0 mode: --/PW res: [0x2b7c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612345:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c517e6 lrc: 0/0,0 mode: --/PW res: [0x2b7c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612349:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c517ed lrc: 2/0,0 mode: PW/PW res: [0x2b7c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.612351:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1166:39030:x1731745946468736:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 2011us (2082us total) trans 12885079723 rc 0/0 00000100:00100000:1.0:1651529344.612353:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211664 00010000:00010000:0.0:1651529344.612353:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001644aaad already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.612354:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c517ed lrc: 2/0,0 mode: PW/PW res: [0x2b7c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612356:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c517ed lrc: 3/0,0 mode: PW/PW res: [0x2b7c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612359:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c517ed lrc: 1/0,0 mode: --/PW res: [0x2b7c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612362:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c517ed lrc: 0/0,0 mode: --/PW res: [0x2b7c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612363:0:72397:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c6de5a9/0x3234de053c4e2da lrc: 0/0,0 mode: --/PR res: [0x2b7c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ca7 expref: 896 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.612365:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c517f4 lrc: 2/0,0 mode: PW/PW res: [0x2b7c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.612367:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000037ac96ac pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997013568:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.612368:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088cc87df already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.612368:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c517f4 lrc: 2/0,0 mode: PW/PW res: [0x2b7c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612371:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c517fb lrc: 3/0,1 mode: PW/PW res: [0x2b7c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612371:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c517f4 lrc: 3/0,0 mode: PW/PW res: [0x2b7c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612374:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c517fb lrc: 3/0,1 mode: PW/PW res: [0x2b7c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612374:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c517f4 lrc: 1/0,0 mode: --/PW res: [0x2b7c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612376:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c517f4 lrc: 0/0,0 mode: --/PW res: [0x2b7c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612377:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c517fb lrc: 3/0,1 mode: PW/PW res: [0x2b7c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612380:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c517fb lrc: 3/0,1 mode: PW/PW res: [0x2b7c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612380:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c517d8 lrc: 2/0,0 mode: PW/PW res: [0x2b7c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612382:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c517fb lrc: 2/0,0 mode: PW/PW res: [0x2b7c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612383:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f10dea8 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.612384:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c517d8 lrc: 2/0,0 mode: PW/PW res: [0x2b7c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612386:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c517d8 lrc: 3/0,0 mode: PW/PW res: [0x2b7c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612389:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c517d8 lrc: 1/0,0 mode: --/PW res: [0x2b7c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612392:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c517d8 lrc: 0/0,0 mode: --/PW res: [0x2b7c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612395:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c517fb lrc: 2/0,0 mode: PW/PW res: [0x2b7c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612398:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000087f212ed already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.612399:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c517fb lrc: 2/0,0 mode: PW/PW res: [0x2b7c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612401:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c517fb lrc: 3/0,0 mode: PW/PW res: [0x2b7c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612404:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c517fb lrc: 1/0,0 mode: --/PW res: [0x2b7c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612407:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c517fb lrc: 0/0,0 mode: --/PW res: [0x2b7c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.612412:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085af61db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1166:39030:x1731745946469440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1255us (1291us total) trans 12885079724 rc 0/0 00000100:00100000:1.0:1651529344.612415:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211669 00000100:00100000:0.0:1651529344.612442:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000054e3a257 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997013632:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.612447:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51802 lrc: 3/0,1 mode: --/PW res: [0x2b7c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.612450:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.612463:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.612500:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396350784 00010000:00010000:0.0:1651529344.612506:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cdd47e67/0x3234de053c4d4ef lrc: 4/0,0 mode: PR/PR res: [0x2b7c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d05cd expref: 896 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.612516:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396350848 00010000:00010000:0.0:1651529344.612518:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000029def14e/0x3234de053c4e5ce lrc: 5/0,0 mode: PR/PR res: [0x2b7c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d48cb expref: 897 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.612521:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12452 00000100:00100000:1.0:1651529344.612523:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+897:41278:x1731746396350784:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.612524:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12453 00000100:00100000:0.0:1651529344.612526:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+897:41278:x1731746396350848:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.612527:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.612529:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cdd47e67/0x3234de053c4d4ef lrc: 4/0,0 mode: PR/PR res: [0x2b7c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d05cd expref: 897 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.612529:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.612531:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000029def14e/0x3234de053c4e5ce lrc: 5/0,0 mode: PR/PR res: [0x2b7c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d48cb expref: 897 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.612533:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cdd47e67/0x3234de053c4d4ef lrc: 3/0,0 mode: PR/PR res: [0x2b7c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d05cd expref: 897 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.612535:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000029def14e/0x3234de053c4e5ce lrc: 4/0,0 mode: PR/PR res: [0x2b7c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d48cb expref: 897 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.612539:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cdd47e67/0x3234de053c4d4ef lrc: 0/0,0 mode: --/PR res: [0x2b7c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d05cd expref: 897 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.612543:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.612543:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.612543:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.612544:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51802 lrc: 3/0,1 mode: PW/PW res: [0x2b7c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612544:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.612544:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c51809 lrc: 3/0,1 mode: PW/PW res: [0x2b7c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612547:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51802 lrc: 4/0,1 mode: PW/PW res: [0x2b7c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612548:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c51809 lrc: 4/0,1 mode: PW/PW res: [0x2b7c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612557:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.612567:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+896:41278:x1731746396350784:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 43us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.612570:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12452 00010000:00010000:1.0:1651529344.612581:0:72396:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029def14e/0x3234de053c4e5ce lrc: 0/0,0 mode: --/PR res: [0x2b7c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d48cb expref: 895 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.612581:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.612588:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997013696:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.612589:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+894:41278:x1731746396350848:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 62us (126us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.612591:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c51809 lrc: 3/0,1 mode: PW/PW res: [0x2b7c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.612592:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12453 00010000:00010000:1.0:1651529344.612594:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c51809 lrc: 3/0,1 mode: PW/PW res: [0x2b7c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612597:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c51809 lrc: 3/0,1 mode: PW/PW res: [0x2b7c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612599:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51802 lrc: 3/0,1 mode: PW/PW res: [0x2b7c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612600:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c51809 lrc: 3/0,1 mode: PW/PW res: [0x2b7c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612602:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51802 lrc: 3/0,1 mode: PW/PW res: [0x2b7c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612603:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c51809 lrc: 2/0,0 mode: PW/PW res: [0x2b7c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612605:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51802 lrc: 3/0,1 mode: PW/PW res: [0x2b7c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612608:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51802 lrc: 2/0,0 mode: PW/PW res: [0x2b7c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.612645:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1167:39030:x1731745946469696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 812us (859us total) trans 12885079725 rc 0/0 00000100:00100000:1.0:1651529344.612648:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211671 00000100:00100000:0.0:1651529344.612654:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1166:39029:x1731745946469632:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 838us (891us total) trans 12885079726 rc 0/0 00000100:00100000:0.0:1651529344.612657:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211670 00010000:00010000:0.0:1651529344.612664:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c51809 lrc: 2/0,0 mode: PW/PW res: [0x2b7c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612667:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005532ef34 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.612668:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c51809 lrc: 2/0,0 mode: PW/PW res: [0x2b7c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612671:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c51809 lrc: 3/0,0 mode: PW/PW res: [0x2b7c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612676:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c51809 lrc: 1/0,0 mode: --/PW res: [0x2b7c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612678:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c51809 lrc: 0/0,0 mode: --/PW res: [0x2b7c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612683:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51802 lrc: 2/0,0 mode: PW/PW res: [0x2b7c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612685:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000495c20c9 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.612686:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51802 lrc: 2/0,0 mode: PW/PW res: [0x2b7c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612689:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51802 lrc: 3/0,0 mode: PW/PW res: [0x2b7c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612692:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51802 lrc: 1/0,0 mode: --/PW res: [0x2b7c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612697:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51802 lrc: 0/0,0 mode: --/PW res: [0x2b7c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.612753:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.612763:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.612765:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946470272 00000100:00100000:1.0:1651529344.612771:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.612779:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946470208 00000100:00100000:1.0:1651529344.612784:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.612784:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946470400 00000100:00100000:0.0:1651529344.612788:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946470336 00000100:00100000:1.0:1651529344.612791:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.612792:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211672 00000100:00100000:0.0:1651529344.612794:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1169:39030:x1731745946470272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.612798:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946470528 00000100:00100000:1.0:1651529344.612809:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211673 00000100:00100000:1.0:1651529344.612810:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1170:39029:x1731745946470208:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.612816:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178120 count 1 00002000:00080000:0.0:1651529344.612819:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178121 count 1 00010000:00010000:1.0:1651529344.612821:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c51810 lrc: 3/0,1 mode: --/PW res: [0x2b7c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612825:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003411b870/0x3234de053c4ed6f lrc: 2/0,0 mode: PR/PR res: [0x2b7c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d67f0 expref: 893 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.612828:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.612829:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.612830:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c51810 lrc: 4/0,1 mode: --/PW res: [0x2b7c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612836:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003411b870/0x3234de053c4ed6f lrc: 3/0,0 mode: PR/PR res: [0x2b7c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d67f0 expref: 893 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.612840:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003411b870/0x3234de053c4ed6f lrc: 4/0,0 mode: PR/PR res: [0x2b7c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d67f0 expref: 893 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.612842:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51817 lrc: 3/0,1 mode: --/PW res: [0x2b7c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612847:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ca71f4b4/0x3234de053c4cb6b lrc: 2/0,0 mode: PR/PR res: [0x2b7c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf0e expref: 893 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.612850:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.612851:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.612852:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51817 lrc: 4/0,1 mode: --/PW res: [0x2b7c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.612853:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006aa45e66 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997013760:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.612859:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ca71f4b4/0x3234de053c4cb6b lrc: 3/0,0 mode: PR/PR res: [0x2b7c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf0e expref: 893 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.612863:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ca71f4b4/0x3234de053c4cb6b lrc: 4/0,0 mode: PR/PR res: [0x2b7c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf0e expref: 893 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.612864:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a5495eb going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.612870:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211674 00000100:00100000:0.0:1651529344.612870:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e124baf1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997013824:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.612872:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1170:39030:x1731745946470400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.612877:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178123 count 1 00000100:00100000:0.0:1651529344.612879:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 0000000049203969 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.612880:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c5181e lrc: 3/0,1 mode: --/PW res: [0x2b7cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612887:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ccc12e16/0x3234de053c4e10c lrc: 2/0,0 mode: PR/PR res: [0x2b7cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d34ce expref: 893 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.612887:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211675 00000100:00100000:0.0:1651529344.612889:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1170:39029:x1731745946470336:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.612890:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.612890:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.612891:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c5181e lrc: 4/0,1 mode: --/PW res: [0x2b7cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.612893:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178122 count 1 00010000:00010000:0.0:1651529344.612896:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51825 lrc: 3/0,1 mode: --/PW res: [0x2b7ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612897:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ccc12e16/0x3234de053c4e10c lrc: 3/0,0 mode: PR/PR res: [0x2b7cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d34ce expref: 893 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.612901:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ccc12e16/0x3234de053c4e10c lrc: 4/0,0 mode: PR/PR res: [0x2b7cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d34ce expref: 893 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.612904:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004bb67ba4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997013888:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.612911:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aeda71fe going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.612917:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211676 00000100:00100000:1.0:1651529344.612918:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1170:39030:x1731745946470528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.612918:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bc54929c/0x3234de053c4ed14 lrc: 2/0,0 mode: PR/PR res: [0x2b7ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6630 expref: 893 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.612922:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178125 count 1 00010000:00010000:0.0:1651529344.612924:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.612925:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c5182c lrc: 3/0,1 mode: --/PW res: [0x2b7cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612925:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.612926:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51825 lrc: 4/0,1 mode: --/PW res: [0x2b7ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.612930:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000abfeb192/0x3234de053c4e98d lrc: 2/0,0 mode: PR/PR res: [0x2b7cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d57c7 expref: 893 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.612933:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.612933:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.612934:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c5182c lrc: 4/0,1 mode: --/PW res: [0x2b7cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.612937:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bc54929c/0x3234de053c4ed14 lrc: 3/0,0 mode: PR/PR res: [0x2b7ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6630 expref: 893 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.612940:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000abfeb192/0x3234de053c4e98d lrc: 3/0,0 mode: PR/PR res: [0x2b7cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d57c7 expref: 893 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.612943:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000abfeb192/0x3234de053c4e98d lrc: 4/0,0 mode: PR/PR res: [0x2b7cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d57c7 expref: 893 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.612944:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bc54929c/0x3234de053c4ed14 lrc: 4/0,0 mode: PR/PR res: [0x2b7ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6630 expref: 893 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.612947:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000027e31dd1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997014016:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.612952:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fb6c773d going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.612952:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e5997468 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997013952:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.612962:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 0000000029ae2bb2 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.612965:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.612970:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946470464 00000100:00100000:0.0:1651529344.612983:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211677 00000100:00100000:0.0:1651529344.612985:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1171:39029:x1731745946470464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.612986:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.612996:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178124 count 1 00010000:00010000:0.0:1651529344.613000:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51833 lrc: 3/0,1 mode: --/PW res: [0x2b7cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.613001:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.613005:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000091069ebb/0x3234de053c4c6be lrc: 2/0,0 mode: PR/PR res: [0x2b7cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cccfb expref: 893 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.613008:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.613009:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.613009:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51833 lrc: 4/0,1 mode: --/PW res: [0x2b7cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.613016:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000091069ebb/0x3234de053c4c6be lrc: 3/0,0 mode: PR/PR res: [0x2b7cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cccfb expref: 893 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.613019:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000091069ebb/0x3234de053c4c6be lrc: 4/0,0 mode: PR/PR res: [0x2b7cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cccfb expref: 893 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.613023:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae466fbb pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997014080:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.613036:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000504ef660 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.613042:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946470592 00000100:00100000:0.0:1651529344.613047:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946470720 00000100:00100000:1.0:1651529344.613050:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211678 00000100:00100000:1.0:1651529344.613057:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1173:39029:x1731745946470592:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.613058:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211679 00000100:00100000:0.0:1651529344.613059:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1173:39030:x1731745946470720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.613062:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178126 count 1 00010000:00010000:1.0:1651529344.613067:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c5183a lrc: 3/0,1 mode: --/PW res: [0x2b7ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.613071:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000092459db7/0x3234de053c4eeb1 lrc: 2/0,0 mode: PR/PR res: [0x2b7ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6cc0 expref: 893 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.613075:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.613075:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.613076:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c5183a lrc: 4/0,1 mode: --/PW res: [0x2b7ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.613079:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178127 count 1 00010000:00010000:0.0:1651529344.613084:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5161cbb/0x3234de053c51841 lrc: 3/0,1 mode: --/PW res: [0x2b7cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.613085:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000092459db7/0x3234de053c4eeb1 lrc: 3/0,0 mode: PR/PR res: [0x2b7ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6cc0 expref: 893 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.613088:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000092459db7/0x3234de053c4eeb1 lrc: 4/0,0 mode: PR/PR res: [0x2b7ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6cc0 expref: 893 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.613088:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fc0a011a/0x3234de053c4c8e7 lrc: 2/0,0 mode: PR/PR res: [0x2b7cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd536 expref: 893 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.613091:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.613092:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000012863683 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997014144:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.613092:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.613093:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5161cbb/0x3234de053c51841 lrc: 4/0,1 mode: --/PW res: [0x2b7cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.613099:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fc0a011a/0x3234de053c4c8e7 lrc: 3/0,0 mode: PR/PR res: [0x2b7cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd536 expref: 893 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.613100:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 0000000099c1da85 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.613102:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fc0a011a/0x3234de053c4c8e7 lrc: 4/0,0 mode: PR/PR res: [0x2b7cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd536 expref: 893 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.613106:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000edfe60d3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997014208:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.613115:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c2b2b59c going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.613280:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006aa45e66 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997013760:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.613285:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c51810 lrc: 3/0,1 mode: --/PW res: [0x2b7c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.613344:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e124baf1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997013824:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.613348:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51817 lrc: 3/0,1 mode: --/PW res: [0x2b7c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.613354:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004bb67ba4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997013888:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.613358:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c5181e lrc: 3/0,1 mode: --/PW res: [0x2b7cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.613382:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000027e31dd1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997014016:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.613385:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c5182c lrc: 3/0,1 mode: --/PW res: [0x2b7cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.613400:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e5997468 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997013952:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.613404:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51825 lrc: 3/0,1 mode: --/PW res: [0x2b7ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.613695:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.613706:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000edfe60d3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997014208:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.613711:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d5161cbb/0x3234de053c51841 lrc: 3/0,1 mode: --/PW res: [0x2b7cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.613718:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae466fbb pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997014080:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.613720:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51833 lrc: 3/0,1 mode: --/PW res: [0x2b7cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.613721:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.613731:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.613746:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.613756:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396351552 00010000:00010000:0.0:1651529344.613761:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000abfeb192/0x3234de053c4e98d lrc: 4/0,0 mode: PR/PR res: [0x2b7cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d57c7 expref: 894 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.613767:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396351680 00000100:00100000:1.0:1651529344.613769:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.613769:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bc54929c/0x3234de053c4ed14 lrc: 4/0,0 mode: PR/PR res: [0x2b7ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6630 expref: 895 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.613774:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396351808 00000100:00100000:1.0:1651529344.613775:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.613776:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000092459db7/0x3234de053c4eeb1 lrc: 5/0,0 mode: PR/PR res: [0x2b7ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6cc0 expref: 896 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.613780:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.613780:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12454 00000100:00100000:0.0:1651529344.613782:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+896:41278:x1731746396351552:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.613784:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.613785:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.613785:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000abfeb192/0x3234de053c4e98d lrc: 4/0,0 mode: PR/PR res: [0x2b7cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d57c7 expref: 896 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.613789:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000abfeb192/0x3234de053c4e98d lrc: 3/0,0 mode: PR/PR res: [0x2b7cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d57c7 expref: 896 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.613793:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000012863683 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997014144:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.613795:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abfeb192/0x3234de053c4e98d lrc: 0/0,0 mode: --/PR res: [0x2b7cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d57c7 expref: 896 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.613797:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c5183a lrc: 3/0,1 mode: --/PW res: [0x2b7ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.613799:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.613799:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.613800:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c5182c lrc: 3/0,1 mode: PW/PW res: [0x2b7cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.613803:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c5182c lrc: 4/0,1 mode: PW/PW res: [0x2b7cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.613804:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396351360 00010000:00010000:1.0:1651529344.613809:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003411b870/0x3234de053c4ed6f lrc: 4/0,0 mode: PR/PR res: [0x2b7c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d67f0 expref: 896 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.613813:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.613822:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396351488 00000100:00100000:0.0:1651529344.613823:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+897:41278:x1731746396351552:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 41us (129us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.613824:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ca71f4b4/0x3234de053c4cb6b lrc: 4/0,0 mode: PR/PR res: [0x2b7c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf0e expref: 897 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.613826:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12454 00000100:00100000:1.0:1651529344.613829:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396351616 00010000:00010000:1.0:1651529344.613831:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ccc12e16/0x3234de053c4e10c lrc: 4/0,0 mode: PR/PR res: [0x2b7cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d34ce expref: 897 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.613831:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396351744 00010000:00010000:0.0:1651529344.613834:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000091069ebb/0x3234de053c4c6be lrc: 4/0,0 mode: PR/PR res: [0x2b7cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cccfb expref: 898 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.613835:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396351872 00010000:00010000:1.0:1651529344.613837:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fc0a011a/0x3234de053c4c8e7 lrc: 4/0,0 mode: PR/PR res: [0x2b7cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd536 expref: 899 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.613839:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12455 00000100:00100000:0.0:1651529344.613841:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+899:41278:x1731746396351680:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.613842:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12456 00010000:00010000:0.0:1651529344.613843:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.613844:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ce633b1f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+899:41278:x1731746396351808:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.613844:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bc54929c/0x3234de053c4ed14 lrc: 4/0,0 mode: PR/PR res: [0x2b7ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6630 expref: 899 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.613847:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.613848:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000092459db7/0x3234de053c4eeb1 lrc: 4/0,0 mode: PR/PR res: [0x2b7ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6cc0 expref: 899 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.613848:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bc54929c/0x3234de053c4ed14 lrc: 3/0,0 mode: PR/PR res: [0x2b7ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6630 expref: 899 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.613852:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000092459db7/0x3234de053c4eeb1 lrc: 3/0,0 mode: PR/PR res: [0x2b7ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6cc0 expref: 899 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.613853:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc54929c/0x3234de053c4ed14 lrc: 0/0,0 mode: --/PR res: [0x2b7ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6630 expref: 899 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.613856:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.613857:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.613858:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092459db7/0x3234de053c4eeb1 lrc: 0/0,0 mode: --/PR res: [0x2b7ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6cc0 expref: 898 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.613858:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51825 lrc: 3/0,1 mode: PW/PW res: [0x2b7ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.613860:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51825 lrc: 4/0,1 mode: PW/PW res: [0x2b7ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.613861:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.613862:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.613863:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c5183a lrc: 3/0,1 mode: PW/PW res: [0x2b7ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.613866:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c5183a lrc: 4/0,1 mode: PW/PW res: [0x2b7ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.613866:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.613871:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+897:41278:x1731746396351680:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 30us (157us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.613872:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.613873:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12455 00000100:00100000:0.0:1651529344.613877:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12457 00000100:00100000:1.0:1651529344.613879:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ce633b1f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+896:41278:x1731746396351808:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.613879:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+896:41279:x1731746396351360:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.613881:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.613882:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12456 00010000:00010000:0.0:1651529344.613883:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003411b870/0x3234de053c4ed6f lrc: 4/0,0 mode: PR/PR res: [0x2b7c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d67f0 expref: 896 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.613886:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003411b870/0x3234de053c4ed6f lrc: 3/0,0 mode: PR/PR res: [0x2b7c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d67f0 expref: 895 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.613891:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12458 00010000:00010000:0.0:1651529344.613891:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003411b870/0x3234de053c4ed6f lrc: 0/0,0 mode: --/PR res: [0x2b7c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d67f0 expref: 895 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.613892:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+895:41279:x1731746396351488:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.613894:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.613895:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.613895:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.613896:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ca71f4b4/0x3234de053c4cb6b lrc: 4/0,0 mode: PR/PR res: [0x2b7c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf0e expref: 894 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.613896:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c51810 lrc: 3/0,1 mode: PW/PW res: [0x2b7c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.613898:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c51810 lrc: 4/0,1 mode: PW/PW res: [0x2b7c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.613900:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ca71f4b4/0x3234de053c4cb6b lrc: 3/0,0 mode: PR/PR res: [0x2b7c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf0e expref: 894 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.613907:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.613911:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca71f4b4/0x3234de053c4cb6b lrc: 0/0,0 mode: --/PR res: [0x2b7c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf0e expref: 894 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.613912:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+894:41279:x1731746396351360:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.613915:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12457 00010000:00010000:1.0:1651529344.613916:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.613916:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.613917:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51817 lrc: 3/0,1 mode: PW/PW res: [0x2b7c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.613919:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12459 00010000:00010000:1.0:1651529344.613920:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51817 lrc: 4/0,1 mode: PW/PW res: [0x2b7c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.613920:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+892:41279:x1731746396351616:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.613923:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.613924:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ccc12e16/0x3234de053c4e10c lrc: 4/0,0 mode: PR/PR res: [0x2b7cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d34ce expref: 892 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.613929:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.613935:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+892:41279:x1731746396351488:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (172us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.613935:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ccc12e16/0x3234de053c4e10c lrc: 3/0,0 mode: PR/PR res: [0x2b7cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d34ce expref: 892 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.613938:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12458 00010000:00010000:0.0:1651529344.613940:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ccc12e16/0x3234de053c4e10c lrc: 0/0,0 mode: --/PR res: [0x2b7cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d34ce expref: 891 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.613942:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12460 00000100:00100000:1.0:1651529344.613944:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+891:41279:x1731746396351744:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.613946:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.613946:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.613946:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.613947:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c5181e lrc: 3/0,1 mode: PW/PW res: [0x2b7cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.613948:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000091069ebb/0x3234de053c4c6be lrc: 4/0,0 mode: PR/PR res: [0x2b7cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cccfb expref: 890 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.613950:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c5181e lrc: 4/0,1 mode: PW/PW res: [0x2b7cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.613952:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000091069ebb/0x3234de053c4c6be lrc: 3/0,0 mode: PR/PR res: [0x2b7cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cccfb expref: 890 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.613958:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.613962:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091069ebb/0x3234de053c4c6be lrc: 0/0,0 mode: --/PR res: [0x2b7cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cccfb expref: 890 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.613964:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+890:41279:x1731746396351616:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 43us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.613967:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12459 00010000:00010000:1.0:1651529344.613969:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.613969:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.613970:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51833 lrc: 3/0,1 mode: PW/PW res: [0x2b7cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.613971:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12461 00010000:00010000:1.0:1651529344.613973:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51833 lrc: 4/0,1 mode: PW/PW res: [0x2b7cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.613973:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+888:41279:x1731746396351872:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.613975:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.613977:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fc0a011a/0x3234de053c4c8e7 lrc: 4/0,0 mode: PR/PR res: [0x2b7cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd536 expref: 888 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.613982:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.613987:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+888:41279:x1731746396351744:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 43us (207us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.613987:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fc0a011a/0x3234de053c4c8e7 lrc: 3/0,0 mode: PR/PR res: [0x2b7cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd536 expref: 888 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.613990:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12460 00010000:00010000:0.0:1651529344.613992:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc0a011a/0x3234de053c4c8e7 lrc: 0/0,0 mode: --/PR res: [0x2b7cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd536 expref: 888 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.613995:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.613996:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.613997:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d5161cbb/0x3234de053c51841 lrc: 3/0,1 mode: PW/PW res: [0x2b7cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.613998:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c5182c lrc: 3/0,1 mode: PW/PW res: [0x2b7cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614000:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5161cbb/0x3234de053c51841 lrc: 4/0,1 mode: PW/PW res: [0x2b7cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614002:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c5182c lrc: 3/0,1 mode: PW/PW res: [0x2b7cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614005:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c5182c lrc: 3/0,1 mode: PW/PW res: [0x2b7cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614005:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.614008:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c5182c lrc: 2/0,0 mode: PW/PW res: [0x2b7cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.614011:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+886:41279:x1731746396351872:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.614013:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12461 00010000:00010000:0.0:1651529344.614025:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d5161cbb/0x3234de053c51841 lrc: 3/0,1 mode: PW/PW res: [0x2b7cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614028:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5161cbb/0x3234de053c51841 lrc: 3/0,1 mode: PW/PW res: [0x2b7cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614031:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5161cbb/0x3234de053c51841 lrc: 3/0,1 mode: PW/PW res: [0x2b7cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614034:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5161cbb/0x3234de053c51841 lrc: 2/0,0 mode: PW/PW res: [0x2b7cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.614053:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1175:39030:x1731745946470528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1134us (1262us total) trans 12885079727 rc 0/0 00000100:00100000:1.0:1651529344.614056:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211676 00010000:00010000:1.0:1651529344.614063:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c51810 lrc: 3/0,1 mode: PW/PW res: [0x2b7c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614066:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c51810 lrc: 3/0,1 mode: PW/PW res: [0x2b7c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614069:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c51810 lrc: 3/0,1 mode: PW/PW res: [0x2b7c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614072:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c51810 lrc: 2/0,0 mode: PW/PW res: [0x2b7c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.614075:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1174:39030:x1731745946470720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1014us (1073us total) trans 12885079728 rc 0/0 00000100:00100000:0.0:1651529344.614078:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211679 00010000:00010000:0.0:1651529344.614093:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c5182c lrc: 2/0,0 mode: PW/PW res: [0x2b7cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614099:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f3240ce7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.614100:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c5182c lrc: 2/0,0 mode: PW/PW res: [0x2b7cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614103:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c5182c lrc: 3/0,0 mode: PW/PW res: [0x2b7cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614107:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c5182c lrc: 1/0,0 mode: --/PW res: [0x2b7cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.614110:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1174:39029:x1731745946470208:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1298us (1346us total) trans 12885079729 rc 0/0 00010000:00010000:0.0:1651529344.614110:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c5182c lrc: 0/0,0 mode: --/PW res: [0x2b7cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.614113:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211673 00010000:00010000:0.0:1651529344.614114:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5161cbb/0x3234de053c51841 lrc: 2/0,0 mode: PW/PW res: [0x2b7cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614117:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d5161cbb already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.614118:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5161cbb/0x3234de053c51841 lrc: 2/0,0 mode: PW/PW res: [0x2b7cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614120:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c5181e lrc: 3/0,1 mode: PW/PW res: [0x2b7cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614121:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5161cbb/0x3234de053c51841 lrc: 3/0,0 mode: PW/PW res: [0x2b7cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614123:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c5181e lrc: 3/0,1 mode: PW/PW res: [0x2b7cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614124:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5161cbb/0x3234de053c51841 lrc: 1/0,0 mode: --/PW res: [0x2b7cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614126:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c5181e lrc: 3/0,1 mode: PW/PW res: [0x2b7cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614126:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5161cbb/0x3234de053c51841 lrc: 0/0,0 mode: --/PW res: [0x2b7cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614129:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c5181e lrc: 2/0,0 mode: PW/PW res: [0x2b7cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614130:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c51810 lrc: 2/0,0 mode: PW/PW res: [0x2b7c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614133:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032eb11d3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.614133:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c51810 lrc: 2/0,0 mode: PW/PW res: [0x2b7c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614136:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c51810 lrc: 3/0,0 mode: PW/PW res: [0x2b7c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614139:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c51810 lrc: 1/0,0 mode: --/PW res: [0x2b7c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614142:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c51810 lrc: 0/0,0 mode: --/PW res: [0x2b7c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614145:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c5181e lrc: 2/0,0 mode: PW/PW res: [0x2b7cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614148:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000029e40f3d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.614148:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c5181e lrc: 2/0,0 mode: PW/PW res: [0x2b7cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614151:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c5181e lrc: 3/0,0 mode: PW/PW res: [0x2b7cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614154:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c5181e lrc: 1/0,0 mode: --/PW res: [0x2b7cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.614157:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1174:39030:x1731745946470400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1284us (1386us total) trans 12885079730 rc 0/0 00010000:00010000:0.0:1651529344.614157:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c5181e lrc: 0/0,0 mode: --/PW res: [0x2b7cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.614160:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211674 00010000:00010000:0.0:1651529344.614164:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51825 lrc: 3/0,1 mode: PW/PW res: [0x2b7ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614166:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c5183a lrc: 3/0,1 mode: PW/PW res: [0x2b7ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614166:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51825 lrc: 3/0,1 mode: PW/PW res: [0x2b7ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614169:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c5183a lrc: 3/0,1 mode: PW/PW res: [0x2b7ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614169:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51825 lrc: 3/0,1 mode: PW/PW res: [0x2b7ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614172:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c5183a lrc: 3/0,1 mode: PW/PW res: [0x2b7ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614172:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51825 lrc: 2/0,0 mode: PW/PW res: [0x2b7ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614175:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c5183a lrc: 2/0,0 mode: PW/PW res: [0x2b7ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.614210:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1175:39029:x1731745946470592:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1152us (1231us total) trans 12885079731 rc 0/0 00000100:00100000:1.0:1651529344.614212:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211678 00000100:00100000:0.0:1651529344.614215:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1174:39029:x1731745946470336:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1325us (1430us total) trans 12885079732 rc 0/0 00000100:00100000:0.0:1651529344.614218:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211675 00010000:00010000:0.0:1651529344.614244:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51825 lrc: 2/0,0 mode: PW/PW res: [0x2b7ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614248:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000073043e99 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.614249:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51825 lrc: 2/0,0 mode: PW/PW res: [0x2b7ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614252:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51825 lrc: 3/0,0 mode: PW/PW res: [0x2b7ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614257:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51825 lrc: 1/0,0 mode: --/PW res: [0x2b7ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614260:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51825 lrc: 0/0,0 mode: --/PW res: [0x2b7ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614264:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c5183a lrc: 2/0,0 mode: PW/PW res: [0x2b7ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614266:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065c40e6a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.614267:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c5183a lrc: 2/0,0 mode: PW/PW res: [0x2b7ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614270:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c5183a lrc: 3/0,0 mode: PW/PW res: [0x2b7ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614273:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c5183a lrc: 1/0,0 mode: --/PW res: [0x2b7ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614276:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c5183a lrc: 0/0,0 mode: --/PW res: [0x2b7ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614281:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51833 lrc: 3/0,1 mode: PW/PW res: [0x2b7cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614283:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51833 lrc: 3/0,1 mode: PW/PW res: [0x2b7cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614289:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51833 lrc: 3/0,1 mode: PW/PW res: [0x2b7cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614292:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51833 lrc: 2/0,0 mode: PW/PW res: [0x2b7cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.614331:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1174:39029:x1731745946470464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1346us (1366us total) trans 12885079733 rc 0/0 00000100:00100000:0.0:1651529344.614334:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211677 00010000:00010000:0.0:1651529344.614353:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51833 lrc: 2/0,0 mode: PW/PW res: [0x2b7cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614356:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eaaf5dcd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.614357:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51833 lrc: 2/0,0 mode: PW/PW res: [0x2b7cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614361:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51833 lrc: 3/0,0 mode: PW/PW res: [0x2b7cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614365:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51833 lrc: 1/0,0 mode: --/PW res: [0x2b7cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614379:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51833 lrc: 0/0,0 mode: --/PW res: [0x2b7cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614397:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51817 lrc: 3/0,1 mode: PW/PW res: [0x2b7c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614400:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51817 lrc: 3/0,1 mode: PW/PW res: [0x2b7c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614403:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51817 lrc: 3/0,1 mode: PW/PW res: [0x2b7c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614406:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51817 lrc: 2/0,0 mode: PW/PW res: [0x2b7c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.614451:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1174:39030:x1731745946470272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1656us (1698us total) trans 12885079734 rc 0/0 00000100:00100000:0.0:1651529344.614454:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211672 00010000:00010000:0.0:1651529344.614460:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51817 lrc: 2/0,0 mode: PW/PW res: [0x2b7c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614463:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000acc438d7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.614464:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51817 lrc: 2/0,0 mode: PW/PW res: [0x2b7c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614467:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51817 lrc: 3/0,0 mode: PW/PW res: [0x2b7c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614472:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51817 lrc: 1/0,0 mode: --/PW res: [0x2b7c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614474:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51817 lrc: 0/0,0 mode: --/PW res: [0x2b7c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.614545:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.614556:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946470976 00000100:00100000:1.0:1651529344.614557:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.614568:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946471104 00000100:00100000:0.0:1651529344.614576:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211680 00000100:00100000:0.0:1651529344.614578:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012756c2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1175:39029:x1731745946470976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.614580:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211681 00000100:00100000:1.0:1651529344.614582:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1175:39029:x1731745946471104:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.614583:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178128 count 1 00002000:00080000:1.0:1651529344.614587:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178130 count 1 00010000:00010000:0.0:1651529344.614587:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000695e6e5e/0x3234de053c51848 lrc: 3/0,1 mode: --/PW res: [0x2b7d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614592:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c5184f lrc: 3/0,1 mode: --/PW res: [0x2b7d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614597:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e98f1d6e/0x3234de053c4dd3f lrc: 2/0,0 mode: PR/PR res: [0x2b7d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2611 expref: 885 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.614602:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.614603:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.614603:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c5184f lrc: 4/0,1 mode: --/PW res: [0x2b7d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614610:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e98f1d6e/0x3234de053c4dd3f lrc: 3/0,0 mode: PR/PR res: [0x2b7d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2611 expref: 885 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.614614:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e98f1d6e/0x3234de053c4dd3f lrc: 4/0,0 mode: PR/PR res: [0x2b7d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2611 expref: 885 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.614619:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d1130404/0x3234de053c4d806 lrc: 2/0,0 mode: PR/PR res: [0x2b7d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1149 expref: 885 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.614622:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.614623:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.614624:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000695e6e5e/0x3234de053c51848 lrc: 4/0,1 mode: --/PW res: [0x2b7d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.614627:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004bb67ba4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997014272:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.614639:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 000000007e004c12 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.614642:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d1130404/0x3234de053c4d806 lrc: 3/0,0 mode: PR/PR res: [0x2b7d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1149 expref: 885 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.614647:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.614647:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d1130404/0x3234de053c4d806 lrc: 4/0,0 mode: PR/PR res: [0x2b7d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1149 expref: 885 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.614659:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae466fbb pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997014336:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.614670:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 0000000076b354b3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.614686:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946471232 00000100:00100000:0.0:1651529344.614697:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211682 00000100:00100000:0.0:1651529344.614699:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1176:39029:x1731745946471232:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.614703:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.614703:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178132 count 1 00010000:00010000:0.0:1651529344.614713:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c51856 lrc: 3/0,1 mode: --/PW res: [0x2b7d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614718:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008432a29b/0x3234de053c4d6e0 lrc: 2/0,0 mode: PR/PR res: [0x2b7d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d4b expref: 885 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.614721:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.614721:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.614722:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c51856 lrc: 4/0,1 mode: --/PW res: [0x2b7d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614728:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008432a29b/0x3234de053c4d6e0 lrc: 3/0,0 mode: PR/PR res: [0x2b7d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d4b expref: 885 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.614732:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008432a29b/0x3234de053c4d6e0 lrc: 4/0,0 mode: PR/PR res: [0x2b7d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d4b expref: 885 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.614744:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.614745:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000edfe60d3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997014400:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.614754:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.614754:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c2b2b59c going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.614767:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946471360 00000100:00100000:0.0:1651529344.614773:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946471040 00000100:00100000:0.0:1651529344.614779:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946471168 00000100:00100000:0.0:1651529344.614783:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211683 00000100:00100000:0.0:1651529344.614785:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1179:39029:x1731745946471360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.614789:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178134 count 1 00000100:00100000:1.0:1651529344.614792:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.614793:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8fe7f95/0x3234de053c5185d lrc: 3/0,1 mode: --/PW res: [0x2b7d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614797:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000822d9e20/0x3234de053c4c790 lrc: 2/0,0 mode: PR/PR res: [0x2b7d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd082 expref: 885 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.614798:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.614801:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.614801:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.614802:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8fe7f95/0x3234de053c5185d lrc: 4/0,1 mode: --/PW res: [0x2b7d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.614804:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946471296 00010000:00010000:0.0:1651529344.614808:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000822d9e20/0x3234de053c4c790 lrc: 3/0,0 mode: PR/PR res: [0x2b7d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd082 expref: 885 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.614810:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946471808 00010000:00010000:0.0:1651529344.614811:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000822d9e20/0x3234de053c4c790 lrc: 4/0,0 mode: PR/PR res: [0x2b7d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd082 expref: 885 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.614813:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211684 00000100:00100000:1.0:1651529344.614815:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1181:39029:x1731745946471040:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.614815:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e5997468 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997014464:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.614820:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178129 count 1 00010000:00010000:1.0:1651529344.614824:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51864 lrc: 3/0,1 mode: --/PW res: [0x2b7d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.614827:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 000000008dd99533 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.614838:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b2d88630/0x3234de053c4e3d6 lrc: 2/0,0 mode: PR/PR res: [0x2b7d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4051 expref: 885 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.614842:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.614842:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.614843:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51864 lrc: 4/0,1 mode: --/PW res: [0x2b7d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614850:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b2d88630/0x3234de053c4e3d6 lrc: 3/0,0 mode: PR/PR res: [0x2b7d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4051 expref: 885 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.614850:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211685 00000100:00100000:0.0:1651529344.614851:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1181:39029:x1731745946471168:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.614853:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b2d88630/0x3234de053c4e3d6 lrc: 4/0,0 mode: PR/PR res: [0x2b7d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4051 expref: 885 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.614857:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ba0b61e6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997014528:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.614857:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178131 count 1 00010000:00010000:0.0:1651529344.614860:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080981043/0x3234de053c5186b lrc: 3/0,1 mode: --/PW res: [0x2b7d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614865:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000079489ed7/0x3234de053c4be52 lrc: 2/0,0 mode: PR/PR res: [0x2b7d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6aa expref: 885 pid: 80281 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.614866:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.614870:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.614871:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.614872:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211686 00010000:00010000:0.0:1651529344.614872:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080981043/0x3234de053c5186b lrc: 4/0,1 mode: --/PW res: [0x2b7d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.614874:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1181:39029:x1731745946471296:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.614878:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178133 count 1 00010000:00010000:0.0:1651529344.614878:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000079489ed7/0x3234de053c4be52 lrc: 3/0,0 mode: PR/PR res: [0x2b7d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6aa expref: 885 pid: 80281 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.614881:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000079489ed7/0x3234de053c4be52 lrc: 4/0,0 mode: PR/PR res: [0x2b7d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6aa expref: 885 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.614882:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51872 lrc: 3/0,1 mode: --/PW res: [0x2b7d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.614885:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e124baf1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997014592:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.614886:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dfd786ba/0x3234de053c4dd0e lrc: 2/0,0 mode: PR/PR res: [0x2b7d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d24d6 expref: 885 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.614889:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.614890:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.614890:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51872 lrc: 4/0,1 mode: --/PW res: [0x2b7d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.614896:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dfd786ba/0x3234de053c4dd0e lrc: 3/0,0 mode: PR/PR res: [0x2b7d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d24d6 expref: 885 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.614900:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dfd786ba/0x3234de053c4dd0e lrc: 4/0,0 mode: PR/PR res: [0x2b7d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d24d6 expref: 885 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.614904:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000999005e pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997014656:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.614907:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000000d706dff going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.614910:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a6b79b05 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.614914:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211687 00000100:00100000:0.0:1651529344.614916:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1181:39029:x1731745946471808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.614921:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178135 count 1 00010000:00010000:0.0:1651529344.614924:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067750919/0x3234de053c51879 lrc: 3/0,1 mode: --/PW res: [0x2b7d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614939:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000f0712e5/0x3234de053c4e16e lrc: 2/0,0 mode: PR/PR res: [0x2b7d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d36e2 expref: 885 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.614942:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.614943:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.614944:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067750919/0x3234de053c51879 lrc: 4/0,1 mode: --/PW res: [0x2b7d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.614959:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000f0712e5/0x3234de053c4e16e lrc: 3/0,0 mode: PR/PR res: [0x2b7d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d36e2 expref: 885 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.614962:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000f0712e5/0x3234de053c4e16e lrc: 4/0,0 mode: PR/PR res: [0x2b7d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d36e2 expref: 885 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.614966:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000de0edbdc pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997014720:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.614979:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e1aa6a77 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.614987:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000edfe60d3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997014400:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.614991:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c51856 lrc: 3/0,1 mode: --/PW res: [0x2b7d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.615003:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae466fbb pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997014336:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.615006:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000695e6e5e/0x3234de053c51848 lrc: 3/0,1 mode: --/PW res: [0x2b7d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.615015:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004bb67ba4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997014272:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.615019:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c5184f lrc: 3/0,1 mode: --/PW res: [0x2b7d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.615178:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.615189:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.615190:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396352128 00010000:00010000:0.0:1651529344.615196:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e98f1d6e/0x3234de053c4dd3f lrc: 4/0,0 mode: PR/PR res: [0x2b7d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2611 expref: 886 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.615197:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.615206:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396352256 00010000:00010000:0.0:1651529344.615215:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d1130404/0x3234de053c4d806 lrc: 4/0,0 mode: PR/PR res: [0x2b7d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1149 expref: 887 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.615217:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396352320 00000100:00100000:0.0:1651529344.615220:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12462 00010000:00010000:1.0:1651529344.615231:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008432a29b/0x3234de053c4d6e0 lrc: 4/0,0 mode: PR/PR res: [0x2b7d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d4b expref: 888 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.615236:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+888:41279:x1731746396352128:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.615240:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.615241:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e98f1d6e/0x3234de053c4dd3f lrc: 4/0,0 mode: PR/PR res: [0x2b7d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2611 expref: 888 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.615242:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12463 00000100:00100000:1.0:1651529344.615244:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000039bebb6e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+888:41279:x1731746396352256:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.615245:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e98f1d6e/0x3234de053c4dd3f lrc: 3/0,0 mode: PR/PR res: [0x2b7d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2611 expref: 888 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.615247:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.615249:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d1130404/0x3234de053c4d806 lrc: 4/0,0 mode: PR/PR res: [0x2b7d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1149 expref: 888 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.615251:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e98f1d6e/0x3234de053c4dd3f lrc: 0/0,0 mode: --/PR res: [0x2b7d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2611 expref: 888 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.615253:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d1130404/0x3234de053c4d806 lrc: 3/0,0 mode: PR/PR res: [0x2b7d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1149 expref: 888 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.615255:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.615256:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.615257:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c5184f lrc: 3/0,1 mode: PW/PW res: [0x2b7d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615259:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1130404/0x3234de053c4d806 lrc: 0/0,0 mode: --/PR res: [0x2b7d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1149 expref: 887 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.615260:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c5184f lrc: 4/0,1 mode: PW/PW res: [0x2b7d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615262:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.615263:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.615264:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000695e6e5e/0x3234de053c51848 lrc: 3/0,1 mode: PW/PW res: [0x2b7d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615268:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.615272:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000695e6e5e/0x3234de053c51848 lrc: 4/0,1 mode: PW/PW res: [0x2b7d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.615277:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+886:41279:x1731746396352128:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 55us (99us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.615282:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.615285:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12462 00000100:00100000:1.0:1651529344.615289:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000039bebb6e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+885:41279:x1731746396352256:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 44us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.615291:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12464 00000100:00100000:1.0:1651529344.615293:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12463 00000100:00100000:0.0:1651529344.615293:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+885:41278:x1731746396352320:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.615296:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.615297:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008432a29b/0x3234de053c4d6e0 lrc: 4/0,0 mode: PR/PR res: [0x2b7d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d4b expref: 884 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.615301:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008432a29b/0x3234de053c4d6e0 lrc: 3/0,0 mode: PR/PR res: [0x2b7d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d4b expref: 884 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.615306:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008432a29b/0x3234de053c4d6e0 lrc: 0/0,0 mode: --/PR res: [0x2b7d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d4b expref: 884 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.615307:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c5184f lrc: 3/0,1 mode: PW/PW res: [0x2b7d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615309:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.615310:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.615310:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c51856 lrc: 3/0,1 mode: PW/PW res: [0x2b7d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615311:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c5184f lrc: 3/0,1 mode: PW/PW res: [0x2b7d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615313:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c51856 lrc: 4/0,1 mode: PW/PW res: [0x2b7d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615314:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c5184f lrc: 3/0,1 mode: PW/PW res: [0x2b7d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615319:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c5184f lrc: 2/0,0 mode: PW/PW res: [0x2b7d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615319:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.615325:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+883:41278:x1731746396352320:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 32us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.615334:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12464 00000100:00100000:0.0:1651529344.615377:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e5997468 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997014464:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.615379:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1182:39029:x1731745946471104:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 796us (821us total) trans 12885079735 rc 0/0 00000100:00100000:1.0:1651529344.615382:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211681 00010000:00010000:0.0:1651529344.615392:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e8fe7f95/0x3234de053c5185d lrc: 3/0,1 mode: --/PW res: [0x2b7d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615398:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c51856 lrc: 3/0,1 mode: PW/PW res: [0x2b7d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615401:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c51856 lrc: 3/0,1 mode: PW/PW res: [0x2b7d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615405:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c51856 lrc: 3/0,1 mode: PW/PW res: [0x2b7d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615408:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c51856 lrc: 2/0,0 mode: PW/PW res: [0x2b7d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.615438:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.615452:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.615461:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1182:39029:x1731745946471232:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 761us (813us total) trans 12885079736 rc 0/0 00000100:00100000:0.0:1651529344.615464:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211682 00010000:00010000:0.0:1651529344.615471:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c5184f lrc: 2/0,0 mode: PW/PW res: [0x2b7d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615474:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004f275b98 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.615475:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c5184f lrc: 2/0,0 mode: PW/PW res: [0x2b7d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.615478:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.615478:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c5184f lrc: 3/0,0 mode: PW/PW res: [0x2b7d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615483:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c5184f lrc: 1/0,0 mode: --/PW res: [0x2b7d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615486:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c5184f lrc: 0/0,0 mode: --/PW res: [0x2b7d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615490:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c51856 lrc: 2/0,0 mode: PW/PW res: [0x2b7d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615493:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b96e362a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.615494:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c51856 lrc: 2/0,0 mode: PW/PW res: [0x2b7d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615497:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c51856 lrc: 3/0,0 mode: PW/PW res: [0x2b7d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615500:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c51856 lrc: 1/0,0 mode: --/PW res: [0x2b7d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615502:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b96e362a/0x3234de053c51856 lrc: 0/0,0 mode: --/PW res: [0x2b7d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.615511:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e124baf1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997014592:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.615514:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ba0b61e6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997014528:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.615514:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000080981043/0x3234de053c5186b lrc: 3/0,1 mode: --/PW res: [0x2b7d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615518:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51864 lrc: 3/0,1 mode: --/PW res: [0x2b7d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615519:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000695e6e5e/0x3234de053c51848 lrc: 3/0,1 mode: PW/PW res: [0x2b7d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615522:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000695e6e5e/0x3234de053c51848 lrc: 3/0,1 mode: PW/PW res: [0x2b7d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.615525:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396352448 00010000:00010000:0.0:1651529344.615525:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000695e6e5e/0x3234de053c51848 lrc: 3/0,1 mode: PW/PW res: [0x2b7d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615530:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000822d9e20/0x3234de053c4c790 lrc: 4/0,0 mode: PR/PR res: [0x2b7d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd082 expref: 883 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.615536:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396352512 00010000:00010000:1.0:1651529344.615538:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b2d88630/0x3234de053c4e3d6 lrc: 4/0,0 mode: PR/PR res: [0x2b7d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4051 expref: 884 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.615542:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396352576 00010000:00010000:1.0:1651529344.615544:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000079489ed7/0x3234de053c4be52 lrc: 4/0,0 mode: PR/PR res: [0x2b7d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6aa expref: 885 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.615547:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000695e6e5e/0x3234de053c51848 lrc: 2/0,0 mode: PW/PW res: [0x2b7d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.615549:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12465 00000100:00100000:1.0:1651529344.615551:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+885:41278:x1731746396352448:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.615553:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.615555:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000822d9e20/0x3234de053c4c790 lrc: 4/0,0 mode: PR/PR res: [0x2b7d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd082 expref: 885 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.615558:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000822d9e20/0x3234de053c4c790 lrc: 3/0,0 mode: PR/PR res: [0x2b7d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd082 expref: 885 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.615564:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000822d9e20/0x3234de053c4c790 lrc: 0/0,0 mode: --/PR res: [0x2b7d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd082 expref: 885 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.615568:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.615568:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.615569:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e8fe7f95/0x3234de053c5185d lrc: 3/0,1 mode: PW/PW res: [0x2b7d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615572:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8fe7f95/0x3234de053c5185d lrc: 4/0,1 mode: PW/PW res: [0x2b7d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615582:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.615592:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+884:41278:x1731746396352448:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.615594:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12465 00000100:00100000:1.0:1651529344.615599:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12466 00000100:00100000:1.0:1651529344.615600:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+883:41279:x1731746396352512:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.615603:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.615604:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b2d88630/0x3234de053c4e3d6 lrc: 4/0,0 mode: PR/PR res: [0x2b7d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4051 expref: 883 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.615608:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b2d88630/0x3234de053c4e3d6 lrc: 3/0,0 mode: PR/PR res: [0x2b7d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4051 expref: 883 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.615610:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012756c2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1182:39029:x1731745946470976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1031us (1065us total) trans 12885079737 rc 0/0 00010000:00010000:1.0:1651529344.615613:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2d88630/0x3234de053c4e3d6 lrc: 0/0,0 mode: --/PR res: [0x2b7d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4051 expref: 883 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.615613:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211680 00010000:00010000:1.0:1651529344.615616:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.615616:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.615617:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51864 lrc: 3/0,1 mode: PW/PW res: [0x2b7d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615620:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51864 lrc: 4/0,1 mode: PW/PW res: [0x2b7d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615626:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.615630:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+882:41279:x1731746396352512:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 29us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.615632:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12466 00000100:00100000:1.0:1651529344.615636:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12467 00000100:00100000:1.0:1651529344.615637:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+881:41278:x1731746396352576:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.615640:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.615641:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000079489ed7/0x3234de053c4be52 lrc: 4/0,0 mode: PR/PR res: [0x2b7d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6aa expref: 881 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.615644:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000079489ed7/0x3234de053c4be52 lrc: 3/0,0 mode: PR/PR res: [0x2b7d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6aa expref: 881 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.615646:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000695e6e5e/0x3234de053c51848 lrc: 2/0,0 mode: PW/PW res: [0x2b7d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615649:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079489ed7/0x3234de053c4be52 lrc: 0/0,0 mode: --/PR res: [0x2b7d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6aa expref: 881 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.615650:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000695e6e5e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.615651:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000695e6e5e/0x3234de053c51848 lrc: 2/0,0 mode: PW/PW res: [0x2b7d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615652:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.615652:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.615653:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000080981043/0x3234de053c5186b lrc: 3/0,1 mode: PW/PW res: [0x2b7d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615654:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000695e6e5e/0x3234de053c51848 lrc: 3/0,0 mode: PW/PW res: [0x2b7d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615656:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080981043/0x3234de053c5186b lrc: 4/0,1 mode: PW/PW res: [0x2b7d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615659:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000695e6e5e/0x3234de053c51848 lrc: 1/0,0 mode: --/PW res: [0x2b7d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615661:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000695e6e5e/0x3234de053c51848 lrc: 0/0,0 mode: --/PW res: [0x2b7d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615664:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.615669:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+880:41278:x1731746396352576:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 31us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.615671:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12467 00010000:00010000:0.0:1651529344.615674:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000080981043/0x3234de053c5186b lrc: 3/0,1 mode: PW/PW res: [0x2b7d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615677:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080981043/0x3234de053c5186b lrc: 3/0,1 mode: PW/PW res: [0x2b7d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615680:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080981043/0x3234de053c5186b lrc: 3/0,1 mode: PW/PW res: [0x2b7d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.615681:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000999005e pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997014656:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.615683:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080981043/0x3234de053c5186b lrc: 2/0,0 mode: PW/PW res: [0x2b7d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615684:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51872 lrc: 3/0,1 mode: --/PW res: [0x2b7d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615689:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51864 lrc: 3/0,1 mode: PW/PW res: [0x2b7d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615692:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51864 lrc: 3/0,1 mode: PW/PW res: [0x2b7d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615695:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51864 lrc: 3/0,1 mode: PW/PW res: [0x2b7d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615698:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51864 lrc: 2/0,0 mode: PW/PW res: [0x2b7d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.615726:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1183:39029:x1731745946471168:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 873us (971us total) trans 12885079738 rc 0/0 00000100:00100000:0.0:1651529344.615729:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211685 00010000:00010000:0.0:1651529344.615750:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080981043/0x3234de053c5186b lrc: 2/0,0 mode: PW/PW res: [0x2b7d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.615751:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1182:39029:x1731745946471040:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 935us (1016us total) trans 12885079739 rc 0/0 00000100:00100000:1.0:1651529344.615754:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211684 00010000:00010000:0.0:1651529344.615754:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000080981043 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.615755:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080981043/0x3234de053c5186b lrc: 2/0,0 mode: PW/PW res: [0x2b7d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615758:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080981043/0x3234de053c5186b lrc: 3/0,0 mode: PW/PW res: [0x2b7d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615762:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080981043/0x3234de053c5186b lrc: 1/0,0 mode: --/PW res: [0x2b7d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615765:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080981043/0x3234de053c5186b lrc: 0/0,0 mode: --/PW res: [0x2b7d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615769:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51864 lrc: 2/0,0 mode: PW/PW res: [0x2b7d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615778:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000046d6c242 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.615779:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51864 lrc: 2/0,0 mode: PW/PW res: [0x2b7d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615782:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51864 lrc: 3/0,0 mode: PW/PW res: [0x2b7d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615785:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51864 lrc: 1/0,0 mode: --/PW res: [0x2b7d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615787:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51864 lrc: 0/0,0 mode: --/PW res: [0x2b7d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.615795:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.615797:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000de0edbdc pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997014720:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.615800:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000067750919/0x3234de053c51879 lrc: 3/0,1 mode: --/PW res: [0x2b7d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615805:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e8fe7f95/0x3234de053c5185d lrc: 3/0,1 mode: PW/PW res: [0x2b7d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615808:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8fe7f95/0x3234de053c5185d lrc: 3/0,1 mode: PW/PW res: [0x2b7d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615811:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8fe7f95/0x3234de053c5185d lrc: 3/0,1 mode: PW/PW res: [0x2b7d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.615816:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.615816:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8fe7f95/0x3234de053c5185d lrc: 2/0,0 mode: PW/PW res: [0x2b7d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.615826:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.615840:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.615859:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1182:39029:x1731745946471360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1073us (1156us total) trans 12885079740 rc 0/0 00000100:00100000:0.0:1651529344.615862:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211683 00000100:00100000:0.0:1651529344.615867:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946472128 00000100:00100000:0.0:1651529344.615873:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946472192 00000100:00100000:0.0:1651529344.615877:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211688 00000100:00100000:0.0:1651529344.615879:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1183:39030:x1731745946472128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.615883:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178136 count 1 00010000:00010000:0.0:1651529344.615887:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dbec785/0x3234de053c51880 lrc: 3/0,1 mode: --/PW res: [0x2b7d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615892:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000005444c8d/0x3234de053c4ea51 lrc: 2/0,0 mode: PR/PR res: [0x2b7d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a9f expref: 879 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.615895:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.615896:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.615896:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dbec785/0x3234de053c51880 lrc: 4/0,1 mode: --/PW res: [0x2b7d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.615898:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211689 00010000:00010000:0.0:1651529344.615903:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000005444c8d/0x3234de053c4ea51 lrc: 3/0,0 mode: PR/PR res: [0x2b7d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a9f expref: 879 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.615905:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1183:39029:x1731745946472192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.615906:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000005444c8d/0x3234de053c4ea51 lrc: 4/0,0 mode: PR/PR res: [0x2b7d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a9f expref: 879 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:1.0:1651529344.615911:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178137 count 1 00000100:00100000:0.0:1651529344.615912:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000de0edbdc pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997014784:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.615916:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51887 lrc: 3/0,1 mode: --/PW res: [0x2b7d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615921:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef1f4d2f/0x3234de053c4d1f4 lrc: 2/0,0 mode: PR/PR res: [0x2b7d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf9b7 expref: 879 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.615924:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.615925:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.615926:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51887 lrc: 4/0,1 mode: --/PW res: [0x2b7d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.615938:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ef1f4d2f/0x3234de053c4d1f4 lrc: 3/0,0 mode: PR/PR res: [0x2b7d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf9b7 expref: 879 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.615945:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ef1f4d2f/0x3234de053c4d1f4 lrc: 4/0,0 mode: PR/PR res: [0x2b7d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf9b7 expref: 879 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.615949:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005fb0ec6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997014848:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.615954:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e68b7e1f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.615958:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a6b79b05 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.615962:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8fe7f95/0x3234de053c5185d lrc: 2/0,0 mode: PW/PW res: [0x2b7d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.615963:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396352960 00010000:00010000:0.0:1651529344.615967:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e8fe7f95 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.615968:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000f0712e5/0x3234de053c4e16e lrc: 4/0,0 mode: PR/PR res: [0x2b7d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d36e2 expref: 880 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.615969:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8fe7f95/0x3234de053c5185d lrc: 2/0,0 mode: PW/PW res: [0x2b7d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615973:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8fe7f95/0x3234de053c5185d lrc: 3/0,0 mode: PW/PW res: [0x2b7d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.615975:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396352768 00010000:00010000:1.0:1651529344.615977:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dfd786ba/0x3234de053c4dd0e lrc: 4/0,0 mode: PR/PR res: [0x2b7d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d24d6 expref: 881 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.615978:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8fe7f95/0x3234de053c5185d lrc: 1/0,0 mode: --/PW res: [0x2b7d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.615981:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8fe7f95/0x3234de053c5185d lrc: 0/0,0 mode: --/PW res: [0x2b7d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.615982:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12468 00000100:00100000:1.0:1651529344.615983:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+881:41278:x1731746396352960:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.615986:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.615987:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000f0712e5/0x3234de053c4e16e lrc: 4/0,0 mode: PR/PR res: [0x2b7d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d36e2 expref: 881 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.615990:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000f0712e5/0x3234de053c4e16e lrc: 3/0,0 mode: PR/PR res: [0x2b7d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d36e2 expref: 881 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.615996:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f0712e5/0x3234de053c4e16e lrc: 0/0,0 mode: --/PR res: [0x2b7d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d36e2 expref: 881 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.616002:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.616003:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.616003:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000067750919/0x3234de053c51879 lrc: 3/0,1 mode: PW/PW res: [0x2b7d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.616006:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067750919/0x3234de053c51879 lrc: 4/0,1 mode: PW/PW res: [0x2b7d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.616024:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.616031:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+880:41278:x1731746396352960:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 46us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.616033:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12468 00000100:00100000:1.0:1651529344.616038:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12469 00000100:00100000:1.0:1651529344.616039:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+879:41278:x1731746396352768:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.616042:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.616043:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dfd786ba/0x3234de053c4dd0e lrc: 4/0,0 mode: PR/PR res: [0x2b7d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d24d6 expref: 879 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.616047:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dfd786ba/0x3234de053c4dd0e lrc: 3/0,0 mode: PR/PR res: [0x2b7d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d24d6 expref: 879 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.616051:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfd786ba/0x3234de053c4dd0e lrc: 0/0,0 mode: --/PR res: [0x2b7d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d24d6 expref: 879 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.616055:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.616055:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.616056:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51872 lrc: 3/0,1 mode: PW/PW res: [0x2b7d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.616059:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51872 lrc: 4/0,1 mode: PW/PW res: [0x2b7d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.616062:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.616073:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.616079:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+878:41278:x1731746396352768:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 38us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.616081:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12469 00010000:00010000:1.0:1651529344.616088:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51872 lrc: 3/0,1 mode: PW/PW res: [0x2b7d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.616089:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.616091:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51872 lrc: 3/0,1 mode: PW/PW res: [0x2b7d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.616094:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51872 lrc: 3/0,1 mode: PW/PW res: [0x2b7d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.616096:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51872 lrc: 2/0,0 mode: PW/PW res: [0x2b7d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.616116:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.616123:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.616133:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000067750919/0x3234de053c51879 lrc: 3/0,1 mode: PW/PW res: [0x2b7d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.616137:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067750919/0x3234de053c51879 lrc: 3/0,1 mode: PW/PW res: [0x2b7d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.616141:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067750919/0x3234de053c51879 lrc: 3/0,1 mode: PW/PW res: [0x2b7d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.616143:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067750919/0x3234de053c51879 lrc: 2/0,0 mode: PW/PW res: [0x2b7d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.616156:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1184:39029:x1731745946471296:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1281us (1364us total) trans 12885079741 rc 0/0 00000100:00100000:1.0:1651529344.616159:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211686 00000100:00100000:1.0:1651529344.616164:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946472384 00000100:00100000:1.0:1651529344.616171:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946472448 00000100:00100000:1.0:1651529344.616175:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946472512 00000100:00100000:1.0:1651529344.616179:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946472576 00000100:00100000:1.0:1651529344.616182:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211690 00000100:00100000:1.0:1651529344.616184:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1188:39029:x1731745946472384:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.616189:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178138 count 1 00010000:00010000:1.0:1651529344.616193:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c5188e lrc: 3/0,1 mode: --/PW res: [0x2b7da:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.616195:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1188:39029:x1731745946471808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1279us (1396us total) trans 12885079742 rc 0/0 00010000:00010000:1.0:1651529344.616198:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002099d3d5/0x3234de053c4f285 lrc: 2/0,0 mode: PR/PR res: [0x2b7da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d21 expref: 877 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.616198:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211687 00010000:00010000:1.0:1651529344.616201:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.616201:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.616202:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c5188e lrc: 4/0,1 mode: --/PW res: [0x2b7da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.616204:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211691 00000100:00100000:0.0:1651529344.616206:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1187:39030:x1731745946472448:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.616208:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002099d3d5/0x3234de053c4f285 lrc: 3/0,0 mode: PR/PR res: [0x2b7da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d21 expref: 877 pid: 72396 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.616211:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178139 count 1 00010000:00010000:1.0:1651529344.616212:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002099d3d5/0x3234de053c4f285 lrc: 4/0,0 mode: PR/PR res: [0x2b7da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d21 expref: 877 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.616215:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51895 lrc: 3/0,1 mode: --/PW res: [0x2b7db:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.616216:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000999005e pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997014912:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.616219:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000024eb78a2/0x3234de053c4a068 lrc: 2/0,0 mode: PR/PR res: [0x2b7db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb768 expref: 877 pid: 80277 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.616241:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 000000007d8fabda going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.616248:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211692 00000100:00100000:1.0:1651529344.616250:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085af61db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1187:39029:x1731745946472512:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.616254:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178140 count 1 00010000:00010000:1.0:1651529344.616258:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c5189c lrc: 3/0,1 mode: --/PW res: [0x2b7dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.616258:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.616259:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.616260:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51895 lrc: 4/0,1 mode: --/PW res: [0x2b7db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.616263:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000016627d6e/0x3234de053c4d96b lrc: 2/0,0 mode: PR/PR res: [0x2b7dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d162e expref: 877 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.616266:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.616267:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.616267:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c5189c lrc: 4/0,1 mode: --/PW res: [0x2b7dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.616268:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000024eb78a2/0x3234de053c4a068 lrc: 3/0,0 mode: PR/PR res: [0x2b7db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb768 expref: 877 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.616273:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000016627d6e/0x3234de053c4d96b lrc: 3/0,0 mode: PR/PR res: [0x2b7dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d162e expref: 877 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.616275:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000024eb78a2/0x3234de053c4a068 lrc: 4/0,0 mode: PR/PR res: [0x2b7db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb768 expref: 877 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.616277:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000016627d6e/0x3234de053c4d96b lrc: 4/0,0 mode: PR/PR res: [0x2b7dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d162e expref: 877 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.616279:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e5997468 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997014976:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.616281:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ba0b61e6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997015040:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.616288:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aac87b31 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.616289:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 0000000020dd7827 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.616295:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211693 00000100:00100000:1.0:1651529344.616296:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1187:39030:x1731745946472576:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.616299:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51872 lrc: 2/0,0 mode: PW/PW res: [0x2b7d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.616300:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178141 count 1 00010000:00010000:0.0:1651529344.616302:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000093dbd0d already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.616303:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c518a3 lrc: 3/0,1 mode: --/PW res: [0x2b7dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.616303:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51872 lrc: 2/0,0 mode: PW/PW res: [0x2b7d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.616306:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51872 lrc: 3/0,0 mode: PW/PW res: [0x2b7d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.616307:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f383d7b6/0x3234de053c4dd38 lrc: 2/0,0 mode: PR/PR res: [0x2b7dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d25f5 expref: 877 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.616310:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.616311:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.616311:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51872 lrc: 1/0,0 mode: --/PW res: [0x2b7d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.616312:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c518a3 lrc: 4/0,1 mode: --/PW res: [0x2b7dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.616314:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51872 lrc: 0/0,0 mode: --/PW res: [0x2b7d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.616317:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f383d7b6/0x3234de053c4dd38 lrc: 3/0,0 mode: PR/PR res: [0x2b7dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d25f5 expref: 877 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.616318:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067750919/0x3234de053c51879 lrc: 2/0,0 mode: PW/PW res: [0x2b7d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.616321:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f383d7b6/0x3234de053c4dd38 lrc: 4/0,0 mode: PR/PR res: [0x2b7dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d25f5 expref: 877 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.616321:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067750919 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.616322:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067750919/0x3234de053c51879 lrc: 2/0,0 mode: PW/PW res: [0x2b7d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.616324:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000034e35367 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997015104:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.616324:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067750919/0x3234de053c51879 lrc: 3/0,0 mode: PW/PW res: [0x2b7d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.616328:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067750919/0x3234de053c51879 lrc: 1/0,0 mode: --/PW res: [0x2b7d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.616330:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f9dac3f6 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.616330:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067750919/0x3234de053c51879 lrc: 0/0,0 mode: --/PW res: [0x2b7d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.616401:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005fb0ec6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997014848:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.616405:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51887 lrc: 3/0,1 mode: --/PW res: [0x2b7d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.616406:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.616422:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000de0edbdc pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997014784:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.616426:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003dbec785/0x3234de053c51880 lrc: 3/0,1 mode: --/PW res: [0x2b7d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.616434:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396353152 00010000:00010000:0.0:1651529344.616444:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ef1f4d2f/0x3234de053c4d1f4 lrc: 4/0,0 mode: PR/PR res: [0x2b7d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf9b7 expref: 878 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.616454:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12470 00000100:00100000:0.0:1651529344.616456:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000f76b19f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+878:41279:x1731746396353152:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.616459:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.616460:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ef1f4d2f/0x3234de053c4d1f4 lrc: 4/0,0 mode: PR/PR res: [0x2b7d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf9b7 expref: 878 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.616464:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ef1f4d2f/0x3234de053c4d1f4 lrc: 3/0,0 mode: PR/PR res: [0x2b7d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf9b7 expref: 878 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.616470:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef1f4d2f/0x3234de053c4d1f4 lrc: 0/0,0 mode: --/PR res: [0x2b7d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf9b7 expref: 878 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.616474:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.616474:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.616475:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51887 lrc: 3/0,1 mode: PW/PW res: [0x2b7d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.616478:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51887 lrc: 4/0,1 mode: PW/PW res: [0x2b7d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.616486:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.616488:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51887 lrc: 3/0,1 mode: PW/PW res: [0x2b7d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.616492:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51887 lrc: 3/0,1 mode: PW/PW res: [0x2b7d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.616500:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51887 lrc: 3/0,1 mode: PW/PW res: [0x2b7d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.616503:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51887 lrc: 2/0,0 mode: PW/PW res: [0x2b7d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.616510:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000f76b19f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+877:41279:x1731746396353152:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 53us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.616519:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12470 00010000:00010000:0.0:1651529344.616531:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51887 lrc: 2/0,0 mode: PW/PW res: [0x2b7d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.616547:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1188:39029:x1731745946472192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 641us (720us total) trans 12885079743 rc 0/0 00010000:00010000:0.0:1651529344.616547:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000040cd657 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.616548:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51887 lrc: 2/0,0 mode: PW/PW res: [0x2b7d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.616550:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211689 00010000:00010000:0.0:1651529344.616551:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51887 lrc: 3/0,0 mode: PW/PW res: [0x2b7d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.616555:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51887 lrc: 1/0,0 mode: --/PW res: [0x2b7d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.616561:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51887 lrc: 0/0,0 mode: --/PW res: [0x2b7d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.616564:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.616571:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946472960 00000100:00100000:0.0:1651529344.616576:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.616587:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211694 00000100:00100000:1.0:1651529344.616589:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1188:39030:x1731745946472960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.616594:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178143 count 1 00010000:00010000:1.0:1651529344.616598:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c518aa lrc: 3/0,1 mode: --/PW res: [0x2b7df:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.616603:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b8eb7e9b/0x3234de053c4f0be lrc: 2/0,0 mode: PR/PR res: [0x2b7df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d758e expref: 876 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.616614:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.616614:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.616615:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c518aa lrc: 4/0,1 mode: --/PW res: [0x2b7df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.616622:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b8eb7e9b/0x3234de053c4f0be lrc: 3/0,0 mode: PR/PR res: [0x2b7df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d758e expref: 876 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.616624:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.616625:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b8eb7e9b/0x3234de053c4f0be lrc: 4/0,0 mode: PR/PR res: [0x2b7df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d758e expref: 876 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.616629:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d523a75 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997015168:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.616653:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 0000000053a0cffa going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.616660:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000999005e pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997014912:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.616664:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c5188e lrc: 3/0,1 mode: --/PW res: [0x2b7da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.616678:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946472896 00000100:00100000:0.0:1651529344.616686:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211695 00000100:00100000:0.0:1651529344.616687:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1189:39029:x1731745946472896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.616698:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178142 count 1 00010000:00010000:0.0:1651529344.616702:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c518b1 lrc: 3/0,1 mode: --/PW res: [0x2b7de:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.616707:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000019ad8da7/0x3234de053c4a0ae lrc: 2/0,0 mode: PR/PR res: [0x2b7de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb856 expref: 876 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.616710:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.616710:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.616711:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c518b1 lrc: 4/0,1 mode: --/PW res: [0x2b7de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.616718:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000019ad8da7/0x3234de053c4a0ae lrc: 3/0,0 mode: PR/PR res: [0x2b7de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb856 expref: 876 pid: 80277 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.616720:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ba0b61e6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997015040:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.616724:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c5189c lrc: 3/0,1 mode: --/PW res: [0x2b7dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.616747:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000019ad8da7/0x3234de053c4a0ae lrc: 4/0,0 mode: PR/PR res: [0x2b7de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb856 expref: 876 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.616751:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000edfe60d3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997015232:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.616756:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.616761:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000000d706dff going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.616768:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946473024 00000100:00100000:1.0:1651529344.616791:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211696 00000100:00100000:1.0:1651529344.616793:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1190:39030:x1731745946473024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.616798:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178144 count 1 00000100:00100000:0.0:1651529344.616800:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e5997468 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997014976:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.616802:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c518b8 lrc: 3/0,1 mode: --/PW res: [0x2b7e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.616805:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51895 lrc: 3/0,1 mode: --/PW res: [0x2b7db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.616806:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001955af26/0x3234de053c4c608 lrc: 2/0,0 mode: PR/PR res: [0x2b7e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca38 expref: 876 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.616810:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.616810:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.616811:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c518b8 lrc: 4/0,1 mode: --/PW res: [0x2b7e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.616817:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001955af26/0x3234de053c4c608 lrc: 3/0,0 mode: PR/PR res: [0x2b7e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca38 expref: 876 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.616819:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.616829:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001955af26/0x3234de053c4c608 lrc: 4/0,0 mode: PR/PR res: [0x2b7e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca38 expref: 876 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.616830:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.616838:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d9cfef26 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997015296:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.616839:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.616847:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396353216 00010000:00010000:0.0:1651529344.616852:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000005444c8d/0x3234de053c4ea51 lrc: 4/0,0 mode: PR/PR res: [0x2b7d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a9f expref: 877 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.616853:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 0000000020dd7827 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.616857:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396353536 00000100:00100000:1.0:1651529344.616860:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396353408 00010000:00010000:0.0:1651529344.616860:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000024eb78a2/0x3234de053c4a068 lrc: 4/0,0 mode: PR/PR res: [0x2b7db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb768 expref: 878 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.616864:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396353600 00010000:00010000:1.0:1651529344.616865:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002099d3d5/0x3234de053c4f285 lrc: 4/0,0 mode: PR/PR res: [0x2b7da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d21 expref: 880 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.616866:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000016627d6e/0x3234de053c4d96b lrc: 4/0,0 mode: PR/PR res: [0x2b7dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d162e expref: 880 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.616871:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12471 00000100:00100000:1.0:1651529344.616873:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+880:41279:x1731746396353216:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.616873:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12472 00010000:00010000:1.0:1651529344.616875:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.616875:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+880:41279:x1731746396353536:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.616877:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000005444c8d/0x3234de053c4ea51 lrc: 4/0,0 mode: PR/PR res: [0x2b7d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a9f expref: 880 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.616877:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.616879:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000024eb78a2/0x3234de053c4a068 lrc: 4/0,0 mode: PR/PR res: [0x2b7db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb768 expref: 880 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.616881:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000005444c8d/0x3234de053c4ea51 lrc: 3/0,0 mode: PR/PR res: [0x2b7d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a9f expref: 880 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.616886:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005444c8d/0x3234de053c4ea51 lrc: 0/0,0 mode: --/PR res: [0x2b7d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a9f expref: 880 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.616890:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.616890:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.616891:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003dbec785/0x3234de053c51880 lrc: 3/0,1 mode: PW/PW res: [0x2b7d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.616896:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dbec785/0x3234de053c51880 lrc: 4/0,1 mode: PW/PW res: [0x2b7d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.616907:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.616913:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+879:41279:x1731746396353216:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 40us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.616916:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12471 00010000:00010000:0.0:1651529344.616916:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000024eb78a2/0x3234de053c4a068 lrc: 3/0,0 mode: PR/PR res: [0x2b7db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb768 expref: 880 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.616923:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024eb78a2/0x3234de053c4a068 lrc: 0/0,0 mode: --/PR res: [0x2b7db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb768 expref: 878 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.616927:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.616928:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.616929:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51895 lrc: 3/0,1 mode: PW/PW res: [0x2b7db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.616931:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12473 00000100:00100000:1.0:1651529344.616932:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+877:41279:x1731746396353408:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.616932:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51895 lrc: 4/0,1 mode: PW/PW res: [0x2b7db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.616935:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.616937:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002099d3d5/0x3234de053c4f285 lrc: 4/0,0 mode: PR/PR res: [0x2b7da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d21 expref: 877 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.616938:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.616940:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002099d3d5/0x3234de053c4f285 lrc: 3/0,0 mode: PR/PR res: [0x2b7da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d21 expref: 877 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.616945:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002099d3d5/0x3234de053c4f285 lrc: 0/0,0 mode: --/PR res: [0x2b7da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d21 expref: 877 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.616946:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+877:41279:x1731746396353536:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 70us (127us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.616949:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.616949:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12472 00010000:00010000:1.0:1651529344.616950:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.616950:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c5188e lrc: 3/0,1 mode: PW/PW res: [0x2b7da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.616953:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c5188e lrc: 4/0,1 mode: PW/PW res: [0x2b7da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.616954:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12474 00000100:00100000:0.0:1651529344.616956:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+875:41279:x1731746396353600:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.616958:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.616960:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000016627d6e/0x3234de053c4d96b lrc: 4/0,0 mode: PR/PR res: [0x2b7dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d162e expref: 875 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.616962:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.616963:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000016627d6e/0x3234de053c4d96b lrc: 3/0,0 mode: PR/PR res: [0x2b7dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d162e expref: 875 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.616968:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+875:41279:x1731746396353408:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (138us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.616968:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016627d6e/0x3234de053c4d96b lrc: 0/0,0 mode: --/PR res: [0x2b7dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d162e expref: 875 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.616971:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12473 00010000:00010000:0.0:1651529344.616972:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.616972:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.616973:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c5189c lrc: 3/0,1 mode: PW/PW res: [0x2b7dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.616976:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c5189c lrc: 4/0,1 mode: PW/PW res: [0x2b7dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.616978:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c5188e lrc: 3/0,1 mode: PW/PW res: [0x2b7da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.616981:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c5188e lrc: 3/0,1 mode: PW/PW res: [0x2b7da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.616985:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.616990:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c5188e lrc: 3/0,1 mode: PW/PW res: [0x2b7da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.616990:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+873:41279:x1731746396353600:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 34us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.616993:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12474 00010000:00010000:1.0:1651529344.616994:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c5188e lrc: 2/0,0 mode: PW/PW res: [0x2b7da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617005:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003dbec785/0x3234de053c51880 lrc: 3/0,1 mode: PW/PW res: [0x2b7d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617008:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003dbec785/0x3234de053c51880 lrc: 3/0,1 mode: PW/PW res: [0x2b7d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617011:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dbec785/0x3234de053c51880 lrc: 3/0,1 mode: PW/PW res: [0x2b7d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617014:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003dbec785/0x3234de053c51880 lrc: 2/0,0 mode: PW/PW res: [0x2b7d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.617036:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1192:39029:x1731745946472384:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 851us (975us total) trans 12885079744 rc 0/0 00000100:00100000:1.0:1651529344.617039:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211690 00010000:00010000:1.0:1651529344.617046:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c5189c lrc: 3/0,1 mode: PW/PW res: [0x2b7dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617049:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c5189c lrc: 3/0,1 mode: PW/PW res: [0x2b7dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617053:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c5189c lrc: 3/0,1 mode: PW/PW res: [0x2b7dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617056:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c5189c lrc: 2/0,0 mode: PW/PW res: [0x2b7dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.617057:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1191:39030:x1731745946472128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1177us (1262us total) trans 12885079745 rc 0/0 00000100:00100000:0.0:1651529344.617060:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211688 00010000:00010000:0.0:1651529344.617074:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51895 lrc: 3/0,1 mode: PW/PW res: [0x2b7db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617077:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51895 lrc: 3/0,1 mode: PW/PW res: [0x2b7db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617081:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51895 lrc: 3/0,1 mode: PW/PW res: [0x2b7db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617083:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51895 lrc: 2/0,0 mode: PW/PW res: [0x2b7db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.617092:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085af61db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1191:39029:x1731745946472512:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 842us (977us total) trans 12885079746 rc 0/0 00000100:00100000:1.0:1651529344.617095:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211692 00000100:00100000:0.0:1651529344.617117:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1191:39030:x1731745946472448:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 911us (1028us total) trans 12885079747 rc 0/0 00000100:00100000:0.0:1651529344.617120:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211691 00010000:00010000:0.0:1651529344.617127:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c5188e lrc: 2/0,0 mode: PW/PW res: [0x2b7da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617131:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d5eeb0cd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.617132:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c5188e lrc: 2/0,0 mode: PW/PW res: [0x2b7da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617135:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c5188e lrc: 3/0,0 mode: PW/PW res: [0x2b7da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617140:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c5188e lrc: 1/0,0 mode: --/PW res: [0x2b7da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617143:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c5188e lrc: 0/0,0 mode: --/PW res: [0x2b7da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617147:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003dbec785/0x3234de053c51880 lrc: 2/0,0 mode: PW/PW res: [0x2b7d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617149:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003dbec785 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.617150:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003dbec785/0x3234de053c51880 lrc: 2/0,0 mode: PW/PW res: [0x2b7d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617153:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003dbec785/0x3234de053c51880 lrc: 3/0,0 mode: PW/PW res: [0x2b7d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617156:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003dbec785/0x3234de053c51880 lrc: 1/0,0 mode: --/PW res: [0x2b7d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617158:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003dbec785/0x3234de053c51880 lrc: 0/0,0 mode: --/PW res: [0x2b7d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617162:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c5189c lrc: 2/0,0 mode: PW/PW res: [0x2b7dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617164:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000579ed558 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.617193:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000034e35367 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997015104:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.617198:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c518a3 lrc: 3/0,1 mode: --/PW res: [0x2b7dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617215:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c5189c lrc: 2/0,0 mode: PW/PW res: [0x2b7dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617219:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c5189c lrc: 3/0,0 mode: PW/PW res: [0x2b7dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617238:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c5189c lrc: 1/0,0 mode: --/PW res: [0x2b7dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617242:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c5189c lrc: 0/0,0 mode: --/PW res: [0x2b7dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.617250:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.617258:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.617268:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.617268:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51895 lrc: 2/0,0 mode: PW/PW res: [0x2b7db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617271:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000037fb8315 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.617272:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51895 lrc: 2/0,0 mode: PW/PW res: [0x2b7db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617275:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51895 lrc: 3/0,0 mode: PW/PW res: [0x2b7db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.617276:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d523a75 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997015168:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.617279:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c518aa lrc: 3/0,1 mode: --/PW res: [0x2b7df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617279:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51895 lrc: 1/0,0 mode: --/PW res: [0x2b7db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617281:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51895 lrc: 0/0,0 mode: --/PW res: [0x2b7db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.617288:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396353664 00010000:00010000:1.0:1651529344.617292:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f383d7b6/0x3234de053c4dd38 lrc: 4/0,0 mode: PR/PR res: [0x2b7dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d25f5 expref: 873 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.617293:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000edfe60d3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997015232:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.617298:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c518b1 lrc: 3/0,1 mode: --/PW res: [0x2b7de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.617299:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396353920 00010000:00010000:1.0:1651529344.617301:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b8eb7e9b/0x3234de053c4f0be lrc: 4/0,0 mode: PR/PR res: [0x2b7df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d758e expref: 874 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.617307:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396353984 00010000:00010000:1.0:1651529344.617309:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000019ad8da7/0x3234de053c4a0ae lrc: 4/0,0 mode: PR/PR res: [0x2b7de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb856 expref: 875 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.617314:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12475 00000100:00100000:1.0:1651529344.617315:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+875:41279:x1731746396353664:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.617318:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.617325:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f383d7b6/0x3234de053c4dd38 lrc: 4/0,0 mode: PR/PR res: [0x2b7dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d25f5 expref: 875 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.617326:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12476 00010000:00010000:1.0:1651529344.617329:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f383d7b6/0x3234de053c4dd38 lrc: 3/0,0 mode: PR/PR res: [0x2b7dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d25f5 expref: 875 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.617335:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f383d7b6/0x3234de053c4dd38 lrc: 0/0,0 mode: --/PR res: [0x2b7dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d25f5 expref: 875 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.617339:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.617339:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.617340:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c518a3 lrc: 3/0,1 mode: PW/PW res: [0x2b7dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.617340:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+874:41279:x1731746396353920:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.617343:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c518a3 lrc: 4/0,1 mode: PW/PW res: [0x2b7dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617344:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.617346:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b8eb7e9b/0x3234de053c4f0be lrc: 4/0,0 mode: PR/PR res: [0x2b7df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d758e expref: 874 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.617349:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.617350:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b8eb7e9b/0x3234de053c4f0be lrc: 3/0,0 mode: PR/PR res: [0x2b7df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d758e expref: 874 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.617355:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8eb7e9b/0x3234de053c4f0be lrc: 0/0,0 mode: --/PR res: [0x2b7df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d758e expref: 874 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.617356:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+874:41279:x1731746396353664:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.617359:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12475 00010000:00010000:0.0:1651529344.617359:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.617359:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.617360:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c518aa lrc: 3/0,1 mode: PW/PW res: [0x2b7df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.617364:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12477 00000100:00100000:1.0:1651529344.617365:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000e855587 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+872:41278:x1731746396353984:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.617368:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.617369:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000019ad8da7/0x3234de053c4a0ae lrc: 4/0,0 mode: PR/PR res: [0x2b7de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb856 expref: 872 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.617373:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000019ad8da7/0x3234de053c4a0ae lrc: 3/0,0 mode: PR/PR res: [0x2b7de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb856 expref: 872 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.617374:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c518aa lrc: 4/0,1 mode: PW/PW res: [0x2b7df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617377:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019ad8da7/0x3234de053c4a0ae lrc: 0/0,0 mode: --/PR res: [0x2b7de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb856 expref: 872 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.617380:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.617383:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.617387:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.617388:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c518b1 lrc: 3/0,1 mode: PW/PW res: [0x2b7de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617391:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c518b1 lrc: 4/0,1 mode: PW/PW res: [0x2b7de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.617391:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+871:41279:x1731746396353920:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 50us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.617393:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12476 00010000:00010000:1.0:1651529344.617400:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.617405:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000e855587 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+870:41278:x1731746396353984:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 39us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.617408:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12477 00010000:00010000:0.0:1651529344.617408:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c518b1 lrc: 3/0,1 mode: PW/PW res: [0x2b7de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617411:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c518b1 lrc: 3/0,1 mode: PW/PW res: [0x2b7de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617414:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c518b1 lrc: 3/0,1 mode: PW/PW res: [0x2b7de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617417:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c518b1 lrc: 2/0,0 mode: PW/PW res: [0x2b7de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617419:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c518a3 lrc: 3/0,1 mode: PW/PW res: [0x2b7dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617422:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c518a3 lrc: 3/0,1 mode: PW/PW res: [0x2b7dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617426:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c518a3 lrc: 3/0,1 mode: PW/PW res: [0x2b7dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617428:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c518a3 lrc: 2/0,0 mode: PW/PW res: [0x2b7dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.617460:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1192:39029:x1731745946472896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 772us (835us total) trans 12885079748 rc 0/0 00000100:00100000:0.0:1651529344.617463:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211695 00000100:00100000:1.0:1651529344.617469:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1191:39030:x1731745946472576:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1172us (1346us total) trans 12885079749 rc 0/0 00010000:00010000:0.0:1651529344.617470:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c518b1 lrc: 2/0,0 mode: PW/PW res: [0x2b7de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.617472:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211693 00010000:00010000:0.0:1651529344.617473:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000495c20c9 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.617474:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c518b1 lrc: 2/0,0 mode: PW/PW res: [0x2b7de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617477:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c518b1 lrc: 3/0,0 mode: PW/PW res: [0x2b7de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617480:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c518aa lrc: 3/0,1 mode: PW/PW res: [0x2b7df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617481:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c518b1 lrc: 1/0,0 mode: --/PW res: [0x2b7de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617483:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c518aa lrc: 3/0,1 mode: PW/PW res: [0x2b7df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617486:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c518aa lrc: 3/0,1 mode: PW/PW res: [0x2b7df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617487:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c518b1 lrc: 0/0,0 mode: --/PW res: [0x2b7de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617488:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c518aa lrc: 2/0,0 mode: PW/PW res: [0x2b7df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617491:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c518a3 lrc: 2/0,0 mode: PW/PW res: [0x2b7dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617493:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dd394f60 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.617494:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c518a3 lrc: 2/0,0 mode: PW/PW res: [0x2b7dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617504:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c518a3 lrc: 3/0,0 mode: PW/PW res: [0x2b7dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617507:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c518a3 lrc: 1/0,0 mode: --/PW res: [0x2b7dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617510:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c518a3 lrc: 0/0,0 mode: --/PW res: [0x2b7dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617514:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c518aa lrc: 2/0,0 mode: PW/PW res: [0x2b7df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617516:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6eb3f34 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.617517:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c518aa lrc: 2/0,0 mode: PW/PW res: [0x2b7df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617522:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c518aa lrc: 3/0,0 mode: PW/PW res: [0x2b7df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.617525:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1191:39030:x1731745946472960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 935us (960us total) trans 12885079750 rc 0/0 00010000:00010000:0.0:1651529344.617525:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c518aa lrc: 1/0,0 mode: --/PW res: [0x2b7df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617528:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c518aa lrc: 0/0,0 mode: --/PW res: [0x2b7df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.617529:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211694 00000100:00100000:0.0:1651529344.617555:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.617571:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.617591:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.617602:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.617616:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.617623:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946473280 00000100:00100000:1.0:1651529344.617627:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d9cfef26 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997015296:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.617633:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946473344 00010000:00010000:1.0:1651529344.617636:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c518b8 lrc: 3/0,1 mode: --/PW res: [0x2b7e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.617637:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946473408 00000100:00100000:0.0:1651529344.617642:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946473472 00000100:00100000:0.0:1651529344.617648:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211697 00000100:00100000:0.0:1651529344.617650:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1194:39029:x1731745946473280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.617653:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396354176 00002000:00080000:0.0:1651529344.617655:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178145 count 1 00010000:00010000:1.0:1651529344.617657:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001955af26/0x3234de053c4c608 lrc: 4/0,0 mode: PR/PR res: [0x2b7e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca38 expref: 870 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.617659:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c518bf lrc: 3/0,1 mode: --/PW res: [0x2b7e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.617665:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12478 00000100:00100000:1.0:1651529344.617666:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+870:41279:x1731746396354176:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.617669:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.617670:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001955af26/0x3234de053c4c608 lrc: 4/0,0 mode: PR/PR res: [0x2b7e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca38 expref: 870 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.617674:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001955af26/0x3234de053c4c608 lrc: 3/0,0 mode: PR/PR res: [0x2b7e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca38 expref: 870 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.617679:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ae5e4d52/0x3234de053c4c73c lrc: 2/0,0 mode: PR/PR res: [0x2b7e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf32 expref: 870 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.617680:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001955af26/0x3234de053c4c608 lrc: 0/0,0 mode: --/PR res: [0x2b7e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca38 expref: 870 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.617682:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.617683:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.617683:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.617684:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.617684:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c518bf lrc: 4/0,1 mode: --/PW res: [0x2b7e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617685:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c518b8 lrc: 3/0,1 mode: PW/PW res: [0x2b7e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617690:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c518b8 lrc: 4/0,1 mode: PW/PW res: [0x2b7e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617691:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ae5e4d52/0x3234de053c4c73c lrc: 3/0,0 mode: PR/PR res: [0x2b7e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf32 expref: 869 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.617696:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.617696:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ae5e4d52/0x3234de053c4c73c lrc: 4/0,0 mode: PR/PR res: [0x2b7e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf32 expref: 869 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.617700:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b0d9532a pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997015360:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.617704:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+869:41279:x1731746396354176:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 37us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.617707:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12478 00000100:00100000:0.0:1651529344.617709:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000008dd99533 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.617713:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211698 00000100:00100000:1.0:1651529344.617715:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1194:39030:x1731745946473344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.617716:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211699 00000100:00100000:0.0:1651529344.617718:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1194:39029:x1731745946473408:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.617720:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178146 count 1 00002000:00080000:0.0:1651529344.617722:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178147 count 1 00010000:00010000:1.0:1651529344.617723:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c518c6 lrc: 3/0,1 mode: --/PW res: [0x2b7e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617726:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c518cd lrc: 3/0,1 mode: --/PW res: [0x2b7e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617728:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a3306ad5/0x3234de053c4ede6 lrc: 2/0,0 mode: PR/PR res: [0x2b7e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a04 expref: 868 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.617730:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c4f445 lrc: 2/0,0 mode: PR/PR res: [0x2b7e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83e9 expref: 868 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.617731:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.617731:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.617732:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c518c6 lrc: 4/0,1 mode: --/PW res: [0x2b7e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617733:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.617743:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.617744:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c518cd lrc: 4/0,1 mode: --/PW res: [0x2b7e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617749:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a3306ad5/0x3234de053c4ede6 lrc: 3/0,0 mode: PR/PR res: [0x2b7e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a04 expref: 868 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.617752:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a3306ad5/0x3234de053c4ede6 lrc: 4/0,0 mode: PR/PR res: [0x2b7e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a04 expref: 868 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.617760:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d9cfef26 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997015424:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.617766:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c4f445 lrc: 3/0,0 mode: PR/PR res: [0x2b7e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83e9 expref: 868 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.617768:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 0000000020dd7827 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.617775:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211700 00000100:00100000:1.0:1651529344.617777:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1194:39030:x1731745946473472:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.617781:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178148 count 1 00010000:00010000:1.0:1651529344.617785:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c518d4 lrc: 3/0,1 mode: --/PW res: [0x2b7e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617789:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009f4d6120/0x3234de053c4ccf3 lrc: 2/0,0 mode: PR/PR res: [0x2b7e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce600 expref: 868 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.617792:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.617792:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c4f445 lrc: 4/0,0 mode: PR/PR res: [0x2b7e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83e9 expref: 868 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.617793:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.617793:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c518d4 lrc: 4/0,1 mode: --/PW res: [0x2b7e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.617798:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002a1f5cf2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997015488:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.617807:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed830649 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.617809:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009f4d6120/0x3234de053c4ccf3 lrc: 3/0,0 mode: PR/PR res: [0x2b7e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce600 expref: 868 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.617813:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009f4d6120/0x3234de053c4ccf3 lrc: 4/0,0 mode: PR/PR res: [0x2b7e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce600 expref: 868 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.617817:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000023afca5e pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997015552:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.617820:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.617824:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a6b79b05 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.617830:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946473536 00000100:00100000:0.0:1651529344.617833:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.617847:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946473664 00000100:00100000:1.0:1651529344.617854:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211701 00000100:00100000:1.0:1651529344.617855:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1196:39029:x1731745946473536:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.617860:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178149 count 1 00000100:00100000:0.0:1651529344.617862:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.617864:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e90f6a58/0x3234de053c518db lrc: 3/0,1 mode: --/PW res: [0x2b7e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617869:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002620a844/0x3234de053c4d02d lrc: 2/0,0 mode: PR/PR res: [0x2b7e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf1fa expref: 868 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.617872:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.617872:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.617873:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e90f6a58/0x3234de053c518db lrc: 4/0,1 mode: --/PW res: [0x2b7e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617879:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002620a844/0x3234de053c4d02d lrc: 3/0,0 mode: PR/PR res: [0x2b7e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf1fa expref: 868 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.617882:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002620a844/0x3234de053c4d02d lrc: 4/0,0 mode: PR/PR res: [0x2b7e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf1fa expref: 868 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.617889:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946473600 00000100:00100000:0.0:1651529344.617896:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211702 00000100:00100000:0.0:1651529344.617897:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1197:39029:x1731745946473664:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.617902:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178151 count 1 00010000:00010000:0.0:1651529344.617906:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c518e2 lrc: 3/0,1 mode: --/PW res: [0x2b7e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.617907:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d523a75 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997015616:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.617926:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 0000000053a0cffa going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.617934:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211703 00010000:00010000:0.0:1651529344.617934:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009be10370/0x3234de053c4a1f7 lrc: 2/0,0 mode: PR/PR res: [0x2b7e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb944 expref: 868 pid: 72395 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.617936:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1197:39029:x1731745946473600:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.617937:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.617938:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.617939:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c518e2 lrc: 4/0,1 mode: --/PW res: [0x2b7e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.617940:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178150 count 1 00010000:00010000:1.0:1651529344.617944:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c518e9 lrc: 3/0,1 mode: --/PW res: [0x2b7e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.617946:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009be10370/0x3234de053c4a1f7 lrc: 3/0,0 mode: PR/PR res: [0x2b7e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb944 expref: 868 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.617949:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000066a6b134/0x3234de053c4d84c lrc: 2/0,0 mode: PR/PR res: [0x2b7e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1230 expref: 868 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.617952:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.617952:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.617952:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009be10370/0x3234de053c4a1f7 lrc: 4/0,0 mode: PR/PR res: [0x2b7e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb944 expref: 868 pid: 72395 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.617953:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c518e9 lrc: 4/0,1 mode: --/PW res: [0x2b7e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.617956:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006e3eb319 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997015680:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.617959:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000066a6b134/0x3234de053c4d84c lrc: 3/0,0 mode: PR/PR res: [0x2b7e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1230 expref: 868 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.617963:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000066a6b134/0x3234de053c4d84c lrc: 4/0,0 mode: PR/PR res: [0x2b7e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1230 expref: 868 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.617965:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c4075652 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.617966:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000264aecf8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997015744:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.617974:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fb6c773d going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.617979:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c518b8 lrc: 3/0,1 mode: PW/PW res: [0x2b7e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617982:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c518b8 lrc: 3/0,1 mode: PW/PW res: [0x2b7e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617985:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c518b8 lrc: 3/0,1 mode: PW/PW res: [0x2b7e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.617988:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c518b8 lrc: 2/0,0 mode: PW/PW res: [0x2b7e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.618005:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c518b8 lrc: 3/0,0 mode: PW/PW res: [0x2b7e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.618009:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b2d06199 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.618010:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c518b8 lrc: 2/0,0 mode: PW/PW res: [0x2b7e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.618013:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c518b8 lrc: 3/0,0 mode: PW/PW res: [0x2b7e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.618017:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c518b8 lrc: 1/0,0 mode: --/PW res: [0x2b7e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.618020:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c518b8 lrc: 0/0,0 mode: --/PW res: [0x2b7e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.618048:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1198:39030:x1731745946473024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1255us (1292us total) trans 12885079751 rc 0/0 00000100:00100000:1.0:1651529344.618051:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211696 00000100:00100000:0.0:1651529344.618258:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.618280:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b0d9532a pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997015360:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.618285:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c518bf lrc: 3/0,1 mode: --/PW res: [0x2b7e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.618300:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946474112 00000100:00100000:0.0:1651529344.618300:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006e3eb319 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997015680:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.618302:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c518e2 lrc: 3/0,1 mode: --/PW res: [0x2b7e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.618307:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211704 00000100:00100000:0.0:1651529344.618308:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002a1f5cf2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997015488:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.618309:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1198:39029:x1731745946474112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.618310:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c518cd lrc: 3/0,1 mode: --/PW res: [0x2b7e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.618314:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178152 count 1 00010000:00010000:1.0:1651529344.618318:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b54a65c7/0x3234de053c518f0 lrc: 3/0,1 mode: --/PW res: [0x2b7e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618323:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008723d15a/0x3234de053c4e28d lrc: 2/0,0 mode: PR/PR res: [0x2b7e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3bab expref: 868 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.618326:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.618327:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.618328:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b54a65c7/0x3234de053c518f0 lrc: 4/0,1 mode: --/PW res: [0x2b7e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618334:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008723d15a/0x3234de053c4e28d lrc: 3/0,0 mode: PR/PR res: [0x2b7e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3bab expref: 868 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.618337:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008723d15a/0x3234de053c4e28d lrc: 4/0,0 mode: PR/PR res: [0x2b7e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3bab expref: 868 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.618342:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000913beefe pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997015808:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.618355:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 0000000018ebe812 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.618363:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d9cfef26 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997015424:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.618367:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c518c6 lrc: 3/0,1 mode: --/PW res: [0x2b7e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.618373:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000023afca5e pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997015552:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.618384:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c518d4 lrc: 3/0,1 mode: --/PW res: [0x2b7e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.618392:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d523a75 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997015616:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.618394:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e90f6a58/0x3234de053c518db lrc: 3/0,1 mode: --/PW res: [0x2b7e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.618400:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000264aecf8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997015744:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.618402:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c518e9 lrc: 3/0,1 mode: --/PW res: [0x2b7e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.618440:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.618448:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.618454:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396354432 00010000:00010000:1.0:1651529344.618459:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ae5e4d52/0x3234de053c4c73c lrc: 4/0,0 mode: PR/PR res: [0x2b7e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf32 expref: 869 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.618466:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396354560 00010000:00010000:1.0:1651529344.618468:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c4f445 lrc: 4/0,0 mode: PR/PR res: [0x2b7e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83e9 expref: 870 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.618489:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12479 00000100:00100000:1.0:1651529344.618491:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+870:41279:x1731746396354432:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.618494:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.618495:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ae5e4d52/0x3234de053c4c73c lrc: 4/0,0 mode: PR/PR res: [0x2b7e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf32 expref: 870 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.618499:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ae5e4d52/0x3234de053c4c73c lrc: 3/0,0 mode: PR/PR res: [0x2b7e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf32 expref: 870 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.618505:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae5e4d52/0x3234de053c4c73c lrc: 0/0,0 mode: --/PR res: [0x2b7e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf32 expref: 870 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.618509:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.618509:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.618509:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.618510:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c518bf lrc: 3/0,1 mode: PW/PW res: [0x2b7e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618513:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c518bf lrc: 4/0,1 mode: PW/PW res: [0x2b7e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.618514:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.618519:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.618522:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.618531:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+869:41279:x1731746396354432:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 40us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.618534:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12479 00000100:00100000:1.0:1651529344.618538:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396354688 00000100:00100000:0.0:1651529344.618541:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.618542:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002620a844/0x3234de053c4d02d lrc: 4/0,0 mode: PR/PR res: [0x2b7e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf1fa expref: 869 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.618546:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396354496 00010000:00010000:1.0:1651529344.618548:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a3306ad5/0x3234de053c4ede6 lrc: 4/0,0 mode: PR/PR res: [0x2b7e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a04 expref: 870 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.618552:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396354816 00010000:00010000:1.0:1651529344.618554:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000066a6b134/0x3234de053c4d84c lrc: 4/0,0 mode: PR/PR res: [0x2b7e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1230 expref: 871 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.618558:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396354624 00000100:00100000:0.0:1651529344.618565:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.618568:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009f4d6120/0x3234de053c4ccf3 lrc: 4/0,0 mode: PR/PR res: [0x2b7e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce600 expref: 872 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.618573:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12480 00000100:00100000:1.0:1651529344.618579:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+872:41279:x1731746396354560:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.618580:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c518bf lrc: 3/0,1 mode: PW/PW res: [0x2b7e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618582:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.618583:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c4f445 lrc: 4/0,0 mode: PR/PR res: [0x2b7e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83e9 expref: 872 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.618584:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c518bf lrc: 3/0,1 mode: PW/PW res: [0x2b7e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618587:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c4f445 lrc: 3/0,0 mode: PR/PR res: [0x2b7e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83e9 expref: 872 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.618587:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c518bf lrc: 3/0,1 mode: PW/PW res: [0x2b7e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.618590:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c518bf lrc: 2/0,0 mode: PW/PW res: [0x2b7e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618592:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c4f445 lrc: 0/0,0 mode: --/PR res: [0x2b7e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83e9 expref: 872 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.618595:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.618596:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.618596:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c518cd lrc: 3/0,1 mode: PW/PW res: [0x2b7e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618599:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c518cd lrc: 4/0,1 mode: PW/PW res: [0x2b7e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618608:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.618617:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+871:41279:x1731746396354560:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 43us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.618620:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12480 00000100:00100000:1.0:1651529344.618624:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396354752 00010000:00010000:1.0:1651529344.618627:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009be10370/0x3234de053c4a1f7 lrc: 4/0,0 mode: PR/PR res: [0x2b7e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb944 expref: 871 pid: 72395 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.618632:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12481 00000100:00100000:1.0:1651529344.618634:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+871:41279:x1731746396354688:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.618636:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.618637:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002620a844/0x3234de053c4d02d lrc: 4/0,0 mode: PR/PR res: [0x2b7e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf1fa expref: 871 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.618640:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002620a844/0x3234de053c4d02d lrc: 3/0,0 mode: PR/PR res: [0x2b7e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf1fa expref: 871 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.618643:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1199:39029:x1731745946473280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 992us (1088us total) trans 12885079752 rc 0/0 00010000:00010000:1.0:1651529344.618645:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002620a844/0x3234de053c4d02d lrc: 0/0,0 mode: --/PR res: [0x2b7e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf1fa expref: 871 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.618647:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211697 00010000:00010000:1.0:1651529344.618648:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.618649:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.618650:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e90f6a58/0x3234de053c518db lrc: 3/0,1 mode: PW/PW res: [0x2b7e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618653:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e90f6a58/0x3234de053c518db lrc: 4/0,1 mode: PW/PW res: [0x2b7e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.618654:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c518bf lrc: 2/0,0 mode: PW/PW res: [0x2b7e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.618658:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088cc87df already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.618659:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.618659:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c518bf lrc: 2/0,0 mode: PW/PW res: [0x2b7e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.618662:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c518bf lrc: 3/0,0 mode: PW/PW res: [0x2b7e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.618664:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+870:41279:x1731746396354688:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 30us (156us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.618666:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c518bf lrc: 1/0,0 mode: --/PW res: [0x2b7e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.618667:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12481 00010000:00010000:0.0:1651529344.618669:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c518bf lrc: 0/0,0 mode: --/PW res: [0x2b7e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.618670:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12482 00000100:00100000:1.0:1651529344.618672:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+869:41278:x1731746396354496:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.618674:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.618675:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a3306ad5/0x3234de053c4ede6 lrc: 4/0,0 mode: PR/PR res: [0x2b7e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a04 expref: 869 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.618675:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c518cd lrc: 3/0,1 mode: PW/PW res: [0x2b7e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.618678:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c518cd lrc: 3/0,1 mode: PW/PW res: [0x2b7e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618679:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a3306ad5/0x3234de053c4ede6 lrc: 3/0,0 mode: PR/PR res: [0x2b7e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a04 expref: 869 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.618681:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c518cd lrc: 3/0,1 mode: PW/PW res: [0x2b7e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618683:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3306ad5/0x3234de053c4ede6 lrc: 0/0,0 mode: --/PR res: [0x2b7e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a04 expref: 869 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.618684:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c518cd lrc: 2/0,0 mode: PW/PW res: [0x2b7e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618686:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.618687:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.618688:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c518c6 lrc: 3/0,1 mode: PW/PW res: [0x2b7e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618693:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c518c6 lrc: 4/0,1 mode: PW/PW res: [0x2b7e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618699:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.618702:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+868:41278:x1731746396354496:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 30us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.618705:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12482 00000100:00100000:1.0:1651529344.618708:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12483 00000100:00100000:1.0:1651529344.618710:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+867:41279:x1731746396354816:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.618712:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.618713:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000066a6b134/0x3234de053c4d84c lrc: 4/0,0 mode: PR/PR res: [0x2b7e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1230 expref: 867 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.618716:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000066a6b134/0x3234de053c4d84c lrc: 3/0,0 mode: PR/PR res: [0x2b7e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1230 expref: 867 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.618720:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066a6b134/0x3234de053c4d84c lrc: 0/0,0 mode: --/PR res: [0x2b7e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1230 expref: 867 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.618723:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.618724:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.618725:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c518e9 lrc: 3/0,1 mode: PW/PW res: [0x2b7e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618727:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c518e9 lrc: 4/0,1 mode: PW/PW res: [0x2b7e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.618744:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1199:39029:x1731745946473408:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1001us (1117us total) trans 12885079753 rc 0/0 00010000:00010000:1.0:1651529344.618745:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.618748:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211699 00000100:00100000:1.0:1651529344.618751:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+866:41279:x1731746396354816:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 40us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.618753:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12483 00010000:00010000:0.0:1651529344.618755:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c518cd lrc: 2/0,0 mode: PW/PW res: [0x2b7e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.618757:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12484 00000100:00100000:1.0:1651529344.618759:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e29becaf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+865:41278:x1731746396354624:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.618759:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000491b5359 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.618760:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c518cd lrc: 2/0,0 mode: PW/PW res: [0x2b7e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618761:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.618763:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009f4d6120/0x3234de053c4ccf3 lrc: 4/0,0 mode: PR/PR res: [0x2b7e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce600 expref: 865 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.618763:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c518cd lrc: 3/0,0 mode: PW/PW res: [0x2b7e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618766:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009f4d6120/0x3234de053c4ccf3 lrc: 3/0,0 mode: PR/PR res: [0x2b7e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce600 expref: 865 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.618767:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c518cd lrc: 1/0,0 mode: --/PW res: [0x2b7e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.618770:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c518cd lrc: 0/0,0 mode: --/PW res: [0x2b7e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618771:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f4d6120/0x3234de053c4ccf3 lrc: 0/0,0 mode: --/PR res: [0x2b7e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce600 expref: 865 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.618775:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.618775:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.618776:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c518d4 lrc: 3/0,1 mode: PW/PW res: [0x2b7e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618779:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c518d4 lrc: 4/0,1 mode: PW/PW res: [0x2b7e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618785:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.618785:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.618789:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e29becaf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+864:41278:x1731746396354624:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 30us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.618792:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12484 00000100:00100000:1.0:1651529344.618799:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396355008 00010000:00010000:1.0:1651529344.618802:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008723d15a/0x3234de053c4e28d lrc: 5/0,0 mode: PR/PR res: [0x2b7e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3bab expref: 864 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.618807:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12485 00000100:00100000:1.0:1651529344.618808:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+864:41278:x1731746396354752:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.618810:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.618811:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009be10370/0x3234de053c4a1f7 lrc: 4/0,0 mode: PR/PR res: [0x2b7e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb944 expref: 864 pid: 72395 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.618821:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009be10370/0x3234de053c4a1f7 lrc: 3/0,0 mode: PR/PR res: [0x2b7e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb944 expref: 864 pid: 72395 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.618827:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009be10370/0x3234de053c4a1f7 lrc: 0/0,0 mode: --/PR res: [0x2b7e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb944 expref: 864 pid: 72395 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.618830:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12486 00000100:00100000:0.0:1651529344.618832:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+864:41278:x1731746396355008:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.618836:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.618837:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.618837:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.618838:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c518e2 lrc: 3/0,1 mode: PW/PW res: [0x2b7e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.618839:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008723d15a/0x3234de053c4e28d lrc: 5/0,0 mode: PR/PR res: [0x2b7e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3bab expref: 863 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.618841:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c518e2 lrc: 4/0,1 mode: PW/PW res: [0x2b7e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.618844:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008723d15a/0x3234de053c4e28d lrc: 4/0,0 mode: PR/PR res: [0x2b7e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3bab expref: 863 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.618850:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.618856:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.618856:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.618859:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+863:41278:x1731746396354752:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 50us (294us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.618861:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b54a65c7/0x3234de053c518f0 lrc: 3/0,1 mode: PW/PW res: [0x2b7e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.618862:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12485 00010000:00010000:1.0:1651529344.618871:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e90f6a58/0x3234de053c518db lrc: 3/0,1 mode: PW/PW res: [0x2b7e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618874:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e90f6a58/0x3234de053c518db lrc: 3/0,1 mode: PW/PW res: [0x2b7e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618877:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e90f6a58/0x3234de053c518db lrc: 3/0,1 mode: PW/PW res: [0x2b7e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.618878:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b54a65c7/0x3234de053c518f0 lrc: 4/0,1 mode: PW/PW res: [0x2b7e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618880:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e90f6a58/0x3234de053c518db lrc: 2/0,0 mode: PW/PW res: [0x2b7e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.618884:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.618897:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+862:41278:x1731746396355008:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 64us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.618900:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12486 00010000:00010000:0.0:1651529344.618908:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c518e2 lrc: 3/0,1 mode: PW/PW res: [0x2b7e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.618911:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c518e2 lrc: 3/0,1 mode: PW/PW res: [0x2b7e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.618914:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c518e2 lrc: 3/0,1 mode: PW/PW res: [0x2b7e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.618919:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c518e2 lrc: 2/0,0 mode: PW/PW res: [0x2b7e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.618921:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1199:39029:x1731745946473536:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1065us (1100us total) trans 12885079754 rc 0/0 00000100:00100000:1.0:1651529344.618924:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211701 00010000:00010000:1.0:1651529344.618931:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c518c6 lrc: 3/0,1 mode: PW/PW res: [0x2b7e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618934:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c518c6 lrc: 3/0,1 mode: PW/PW res: [0x2b7e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618937:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c518c6 lrc: 3/0,1 mode: PW/PW res: [0x2b7e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618940:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c518c6 lrc: 2/0,0 mode: PW/PW res: [0x2b7e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.618965:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1200:39029:x1731745946473664:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1067us (1131us total) trans 12885079755 rc 0/0 00000100:00100000:0.0:1651529344.618968:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211702 00010000:00010000:0.0:1651529344.618975:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e90f6a58/0x3234de053c518db lrc: 2/0,0 mode: PW/PW res: [0x2b7e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.618978:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e90f6a58 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.618979:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1199:39030:x1731745946473344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1263us (1408us total) trans 12885079756 rc 0/0 00010000:00010000:0.0:1651529344.618979:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e90f6a58/0x3234de053c518db lrc: 2/0,0 mode: PW/PW res: [0x2b7e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.618982:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211698 00010000:00010000:0.0:1651529344.618982:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e90f6a58/0x3234de053c518db lrc: 3/0,0 mode: PW/PW res: [0x2b7e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.618987:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e90f6a58/0x3234de053c518db lrc: 1/0,0 mode: --/PW res: [0x2b7e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618989:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c518e9 lrc: 3/0,1 mode: PW/PW res: [0x2b7e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.618990:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e90f6a58/0x3234de053c518db lrc: 0/0,0 mode: --/PW res: [0x2b7e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618992:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c518e9 lrc: 3/0,1 mode: PW/PW res: [0x2b7e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.618994:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c518e2 lrc: 2/0,0 mode: PW/PW res: [0x2b7e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.618995:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c518e9 lrc: 3/0,1 mode: PW/PW res: [0x2b7e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.618996:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5c1b0ba already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.618998:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c518e9 lrc: 2/0,0 mode: PW/PW res: [0x2b7e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.618998:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c518e2 lrc: 2/0,0 mode: PW/PW res: [0x2b7e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619016:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c518e2 lrc: 3/0,0 mode: PW/PW res: [0x2b7e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619020:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c518e2 lrc: 1/0,0 mode: --/PW res: [0x2b7e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619023:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c518e2 lrc: 0/0,0 mode: --/PW res: [0x2b7e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.619026:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1199:39029:x1731745946473600:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1090us (1164us total) trans 12885079757 rc 0/0 00010000:00010000:0.0:1651529344.619027:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c518c6 lrc: 2/0,0 mode: PW/PW res: [0x2b7e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.619029:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211703 00010000:00010000:0.0:1651529344.619030:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bfb594be already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.619031:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c518c6 lrc: 2/0,0 mode: PW/PW res: [0x2b7e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619033:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c518c6 lrc: 3/0,0 mode: PW/PW res: [0x2b7e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.619035:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c518d4 lrc: 3/0,1 mode: PW/PW res: [0x2b7e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619037:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c518c6 lrc: 1/0,0 mode: --/PW res: [0x2b7e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.619038:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c518d4 lrc: 3/0,1 mode: PW/PW res: [0x2b7e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619039:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c518c6 lrc: 0/0,0 mode: --/PW res: [0x2b7e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.619041:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c518d4 lrc: 3/0,1 mode: PW/PW res: [0x2b7e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619043:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c518e9 lrc: 2/0,0 mode: PW/PW res: [0x2b7e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619045:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009c763642 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.619046:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c518d4 lrc: 2/0,0 mode: PW/PW res: [0x2b7e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619046:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c518e9 lrc: 2/0,0 mode: PW/PW res: [0x2b7e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619049:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c518e9 lrc: 3/0,0 mode: PW/PW res: [0x2b7e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619052:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c518e9 lrc: 1/0,0 mode: --/PW res: [0x2b7e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619054:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c518e9 lrc: 0/0,0 mode: --/PW res: [0x2b7e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619058:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c518d4 lrc: 2/0,0 mode: PW/PW res: [0x2b7e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619060:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c8d9712a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.619061:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c518d4 lrc: 2/0,0 mode: PW/PW res: [0x2b7e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619064:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c518d4 lrc: 3/0,0 mode: PW/PW res: [0x2b7e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619067:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c518d4 lrc: 1/0,0 mode: --/PW res: [0x2b7e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619069:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c518d4 lrc: 0/0,0 mode: --/PW res: [0x2b7e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.619073:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1199:39030:x1731745946473472:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1296us (1457us total) trans 12885079758 rc 0/0 00000100:00100000:1.0:1651529344.619076:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211700 00010000:00010000:1.0:1651529344.619085:0:72397:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008723d15a/0x3234de053c4e28d lrc: 0/0,0 mode: --/PR res: [0x2b7e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3bab expref: 861 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.619086:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.619090:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000913beefe pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997015808:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.619101:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b54a65c7/0x3234de053c518f0 lrc: 3/0,1 mode: PW/PW res: [0x2b7e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.619104:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b54a65c7/0x3234de053c518f0 lrc: 3/0,1 mode: PW/PW res: [0x2b7e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.619105:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.619107:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b54a65c7/0x3234de053c518f0 lrc: 3/0,1 mode: PW/PW res: [0x2b7e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.619119:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b54a65c7/0x3234de053c518f0 lrc: 3/0,1 mode: PW/PW res: [0x2b7e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.619122:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b54a65c7/0x3234de053c518f0 lrc: 2/0,0 mode: PW/PW res: [0x2b7e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619152:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b54a65c7/0x3234de053c518f0 lrc: 2/0,0 mode: PW/PW res: [0x2b7e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619156:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b54a65c7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.619157:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b54a65c7/0x3234de053c518f0 lrc: 2/0,0 mode: PW/PW res: [0x2b7e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619160:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b54a65c7/0x3234de053c518f0 lrc: 3/0,0 mode: PW/PW res: [0x2b7e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619165:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b54a65c7/0x3234de053c518f0 lrc: 1/0,0 mode: --/PW res: [0x2b7e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619168:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b54a65c7/0x3234de053c518f0 lrc: 0/0,0 mode: --/PW res: [0x2b7e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.619197:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1199:39029:x1731745946474112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 887us (946us total) trans 12885079759 rc 0/0 00000100:00100000:1.0:1651529344.619200:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211704 00000100:00100000:1.0:1651529344.619205:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946474368 00000100:00100000:1.0:1651529344.619212:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946474304 00000100:00100000:1.0:1651529344.619218:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211705 00000100:00100000:1.0:1651529344.619220:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1200:39030:x1731745946474368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.619239:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178154 count 1 00010000:00010000:1.0:1651529344.619244:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ba7c8c9/0x3234de053c518f7 lrc: 3/0,1 mode: --/PW res: [0x2b7ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.619248:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000516dff5d/0x3234de053c4d1b5 lrc: 2/0,0 mode: PR/PR res: [0x2b7ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf84b expref: 860 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.619254:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211706 00000100:00100000:0.0:1651529344.619256:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1200:39029:x1731745946474304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.619259:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.619259:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.619260:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ba7c8c9/0x3234de053c518f7 lrc: 4/0,1 mode: --/PW res: [0x2b7ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.619262:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178153 count 1 00010000:00010000:0.0:1651529344.619266:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c518fe lrc: 3/0,1 mode: --/PW res: [0x2b7e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.619267:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000516dff5d/0x3234de053c4d1b5 lrc: 3/0,0 mode: PR/PR res: [0x2b7ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf84b expref: 860 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.619271:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000516dff5d/0x3234de053c4d1b5 lrc: 4/0,0 mode: PR/PR res: [0x2b7ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf84b expref: 860 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.619271:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c0440314/0x3234de053c4d7b9 lrc: 2/0,0 mode: PR/PR res: [0x2b7e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d104d expref: 860 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.619275:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000913beefe pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997015872:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.619276:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.619277:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.619278:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c518fe lrc: 4/0,1 mode: --/PW res: [0x2b7e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619285:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c0440314/0x3234de053c4d7b9 lrc: 3/0,0 mode: PR/PR res: [0x2b7e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d104d expref: 860 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.619289:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.619295:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c0440314/0x3234de053c4d7b9 lrc: 4/0,0 mode: PR/PR res: [0x2b7e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d104d expref: 860 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.619300:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ad6d0877 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997015936:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.619309:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 0000000049203969 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.619364:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.619373:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.619379:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.619401:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.619409:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.619420:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946474624 00000100:00100000:0.0:1651529344.619420:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946474560 00000100:00100000:1.0:1651529344.619429:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946474688 00000100:00100000:1.0:1651529344.619440:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946474816 00000100:00100000:1.0:1651529344.619447:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946474752 00000100:00100000:1.0:1651529344.619453:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211707 00000100:00100000:1.0:1651529344.619455:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1205:39030:x1731745946474624:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.619460:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178156 count 1 00000100:00100000:0.0:1651529344.619461:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211708 00000100:00100000:0.0:1651529344.619463:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1205:39029:x1731745946474560:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.619464:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a7b079b/0x3234de053c51905 lrc: 3/0,1 mode: --/PW res: [0x2b7ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.619469:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000050f3aed4/0x3234de053c4cfe7 lrc: 2/0,0 mode: PR/PR res: [0x2b7ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf0fe expref: 860 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.619472:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.619472:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.619473:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a7b079b/0x3234de053c51905 lrc: 4/0,1 mode: --/PW res: [0x2b7ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.619482:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178155 count 1 00010000:00010000:1.0:1651529344.619485:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000050f3aed4/0x3234de053c4cfe7 lrc: 3/0,0 mode: PR/PR res: [0x2b7ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf0fe expref: 860 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.619486:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c5190c lrc: 3/0,1 mode: --/PW res: [0x2b7eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.619489:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000050f3aed4/0x3234de053c4cfe7 lrc: 4/0,0 mode: PR/PR res: [0x2b7ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf0fe expref: 860 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.619491:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000011cf29cf/0x3234de053c4eddf lrc: 2/0,0 mode: PR/PR res: [0x2b7eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d69b7 expref: 860 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.619493:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d9cfef26 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997016000:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.619495:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.619495:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.619496:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c5190c lrc: 4/0,1 mode: --/PW res: [0x2b7eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.619502:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b7af823 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.619503:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000011cf29cf/0x3234de053c4eddf lrc: 3/0,0 mode: PR/PR res: [0x2b7eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d69b7 expref: 860 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.619507:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000011cf29cf/0x3234de053c4eddf lrc: 4/0,0 mode: PR/PR res: [0x2b7eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d69b7 expref: 860 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.619508:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211709 00000100:00100000:1.0:1651529344.619510:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d777ba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1205:39029:x1731745946474688:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.619511:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000057329b82 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997016064:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.619514:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178157 count 1 00010000:00010000:1.0:1651529344.619517:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c51913 lrc: 3/0,1 mode: --/PW res: [0x2b7ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.619519:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed830649 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.619522:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000648e877b/0x3234de053c4f4df lrc: 2/0,0 mode: PR/PR res: [0x2b7ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d860b expref: 860 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.619525:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.619525:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.619526:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c51913 lrc: 4/0,1 mode: --/PW res: [0x2b7ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.619526:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211710 00000100:00100000:0.0:1651529344.619528:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1205:39029:x1731745946474816:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.619532:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000648e877b/0x3234de053c4f4df lrc: 3/0,0 mode: PR/PR res: [0x2b7ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d860b expref: 860 pid: 72396 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.619532:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178159 count 1 00010000:00010000:1.0:1651529344.619535:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000648e877b/0x3234de053c4f4df lrc: 4/0,0 mode: PR/PR res: [0x2b7ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d860b expref: 860 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.619535:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c5191a lrc: 3/0,1 mode: --/PW res: [0x2b7ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.619539:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004bb67ba4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997016128:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.619540:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f862aa0b/0x3234de053c4c9f8 lrc: 2/0,0 mode: PR/PR res: [0x2b7ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd9f1 expref: 860 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.619543:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.619543:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.619544:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c5191a lrc: 4/0,1 mode: --/PW res: [0x2b7ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.619545:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 000000004698fefb going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.619550:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211711 00010000:00010000:0.0:1651529344.619550:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f862aa0b/0x3234de053c4c9f8 lrc: 3/0,0 mode: PR/PR res: [0x2b7ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd9f1 expref: 860 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.619552:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1205:39029:x1731745946474752:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.619553:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f862aa0b/0x3234de053c4c9f8 lrc: 4/0,0 mode: PR/PR res: [0x2b7ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd9f1 expref: 860 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:1.0:1651529344.619556:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178158 count 1 00000100:00100000:0.0:1651529344.619557:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002a1f5cf2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997016192:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.619559:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000876c3b77/0x3234de053c51921 lrc: 3/0,1 mode: --/PW res: [0x2b7ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.619564:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c4075652 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.619566:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1093027/0x3234de053c4a117 lrc: 2/0,0 mode: PR/PR res: [0x2b7ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb8bf expref: 860 pid: 80280 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.619569:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.619569:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.619570:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000876c3b77/0x3234de053c51921 lrc: 4/0,1 mode: --/PW res: [0x2b7ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.619575:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f1093027/0x3234de053c4a117 lrc: 3/0,0 mode: PR/PR res: [0x2b7ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb8bf expref: 860 pid: 80280 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.619579:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f1093027/0x3234de053c4a117 lrc: 4/0,0 mode: PR/PR res: [0x2b7ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb8bf expref: 860 pid: 80280 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.619579:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.619583:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ba0b61e6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997016256:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.619589:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a4eb401d going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.619594:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946474880 00000100:00100000:1.0:1651529344.619611:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211712 00000100:00100000:1.0:1651529344.619612:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1206:39030:x1731745946474880:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.619617:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178160 count 1 00010000:00010000:1.0:1651529344.619620:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be2303ad/0x3234de053c51928 lrc: 3/0,1 mode: --/PW res: [0x2b7f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.619624:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004ca9b47e/0x3234de053c4e389 lrc: 2/0,0 mode: PR/PR res: [0x2b7f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f1d expref: 860 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.619630:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.619631:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.619631:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be2303ad/0x3234de053c51928 lrc: 4/0,1 mode: --/PW res: [0x2b7f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.619637:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004ca9b47e/0x3234de053c4e389 lrc: 3/0,0 mode: PR/PR res: [0x2b7f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f1d expref: 860 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.619640:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004ca9b47e/0x3234de053c4e389 lrc: 4/0,0 mode: PR/PR res: [0x2b7f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f1d expref: 860 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.619652:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000999005e pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997016320:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.619667:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8a0b704 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.619670:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.619676:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000913beefe pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997015872:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.619680:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005ba7c8c9/0x3234de053c518f7 lrc: 3/0,1 mode: --/PW res: [0x2b7ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.619682:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.619696:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ad6d0877 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997015936:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.619701:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c518fe lrc: 3/0,1 mode: --/PW res: [0x2b7e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.619708:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396355520 00010000:00010000:0.0:1651529344.619712:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000516dff5d/0x3234de053c4d1b5 lrc: 4/0,0 mode: PR/PR res: [0x2b7ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf84b expref: 861 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.619722:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396355648 00010000:00010000:0.0:1651529344.619724:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c0440314/0x3234de053c4d7b9 lrc: 4/0,0 mode: PR/PR res: [0x2b7e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d104d expref: 862 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.619727:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12487 00000100:00100000:1.0:1651529344.619729:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+862:41278:x1731746396355520:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.619733:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12488 00000100:00100000:0.0:1651529344.619742:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+862:41278:x1731746396355648:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.619745:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.619745:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.619746:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000516dff5d/0x3234de053c4d1b5 lrc: 4/0,0 mode: PR/PR res: [0x2b7ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf84b expref: 862 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.619751:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000516dff5d/0x3234de053c4d1b5 lrc: 3/0,0 mode: PR/PR res: [0x2b7ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf84b expref: 862 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.619757:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000516dff5d/0x3234de053c4d1b5 lrc: 0/0,0 mode: --/PR res: [0x2b7ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf84b expref: 862 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.619760:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.619761:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.619761:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c0440314/0x3234de053c4d7b9 lrc: 4/0,0 mode: PR/PR res: [0x2b7e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d104d expref: 862 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.619762:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005ba7c8c9/0x3234de053c518f7 lrc: 3/0,1 mode: PW/PW res: [0x2b7ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.619765:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ba7c8c9/0x3234de053c518f7 lrc: 4/0,1 mode: PW/PW res: [0x2b7ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619766:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c0440314/0x3234de053c4d7b9 lrc: 3/0,0 mode: PR/PR res: [0x2b7e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d104d expref: 861 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.619771:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.619772:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0440314/0x3234de053c4d7b9 lrc: 0/0,0 mode: --/PR res: [0x2b7e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d104d expref: 861 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.619776:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.619777:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.619778:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c518fe lrc: 3/0,1 mode: PW/PW res: [0x2b7e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.619782:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+860:41278:x1731746396355520:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 53us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.619785:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12487 00010000:00010000:0.0:1651529344.619787:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c518fe lrc: 4/0,1 mode: PW/PW res: [0x2b7e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.619793:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005ba7c8c9/0x3234de053c518f7 lrc: 3/0,1 mode: PW/PW res: [0x2b7ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619794:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.619796:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ba7c8c9/0x3234de053c518f7 lrc: 3/0,1 mode: PW/PW res: [0x2b7ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.619799:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ba7c8c9/0x3234de053c518f7 lrc: 3/0,1 mode: PW/PW res: [0x2b7ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.619801:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ba7c8c9/0x3234de053c518f7 lrc: 2/0,0 mode: PW/PW res: [0x2b7ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.619802:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+859:41278:x1731746396355648:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 59us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.619804:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12488 00010000:00010000:0.0:1651529344.619818:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c518fe lrc: 3/0,1 mode: PW/PW res: [0x2b7e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619822:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c518fe lrc: 3/0,1 mode: PW/PW res: [0x2b7e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619825:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c518fe lrc: 3/0,1 mode: PW/PW res: [0x2b7e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619827:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c518fe lrc: 2/0,0 mode: PW/PW res: [0x2b7e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.619848:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1207:39030:x1731745946474368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 627us (762us total) trans 12885079760 rc 0/0 00000100:00100000:1.0:1651529344.619851:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211705 00000100:00100000:0.0:1651529344.619870:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1207:39029:x1731745946474304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 613us (764us total) trans 12885079761 rc 0/0 00000100:00100000:0.0:1651529344.619873:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211706 00010000:00010000:0.0:1651529344.619880:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ba7c8c9/0x3234de053c518f7 lrc: 2/0,0 mode: PW/PW res: [0x2b7ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619884:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005ba7c8c9 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.619885:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ba7c8c9/0x3234de053c518f7 lrc: 2/0,0 mode: PW/PW res: [0x2b7ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619888:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ba7c8c9/0x3234de053c518f7 lrc: 3/0,0 mode: PW/PW res: [0x2b7ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619892:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ba7c8c9/0x3234de053c518f7 lrc: 1/0,0 mode: --/PW res: [0x2b7ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619895:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ba7c8c9/0x3234de053c518f7 lrc: 0/0,0 mode: --/PW res: [0x2b7ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619899:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c518fe lrc: 2/0,0 mode: PW/PW res: [0x2b7e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619902:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000acc438d7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.619903:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c518fe lrc: 2/0,0 mode: PW/PW res: [0x2b7e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619908:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c518fe lrc: 3/0,0 mode: PW/PW res: [0x2b7e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619911:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c518fe lrc: 1/0,0 mode: --/PW res: [0x2b7e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.619913:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c518fe lrc: 0/0,0 mode: --/PW res: [0x2b7e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.620074:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.620097:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946475072 00000100:00100000:0.0:1651529344.620141:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211713 00000100:00100000:0.0:1651529344.620143:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1207:39030:x1731745946475072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.620157:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178161 count 1 00010000:00010000:0.0:1651529344.620161:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c5192f lrc: 3/0,1 mode: --/PW res: [0x2b7f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620166:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000092d4ff52/0x3234de053c4f10b lrc: 2/0,0 mode: PR/PR res: [0x2b7f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d768a expref: 858 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.620169:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.620169:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.620170:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c5192f lrc: 4/0,1 mode: --/PW res: [0x2b7f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.620184:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.620184:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000092d4ff52/0x3234de053c4f10b lrc: 3/0,0 mode: PR/PR res: [0x2b7f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d768a expref: 858 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.620190:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000092d4ff52/0x3234de053c4f10b lrc: 4/0,0 mode: PR/PR res: [0x2b7f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d768a expref: 858 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.620194:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a4b486d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997016384:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.620199:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.620204:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 000000000a4def41 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.620207:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.620217:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000057329b82 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997016064:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.620221:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c5190c lrc: 3/0,1 mode: --/PW res: [0x2b7eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.620252:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396355712 00000100:00100000:1.0:1651529344.620255:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.620257:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000011cf29cf/0x3234de053c4eddf lrc: 4/0,0 mode: PR/PR res: [0x2b7eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d69b7 expref: 859 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.620271:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396355840 00010000:00010000:0.0:1651529344.620274:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000648e877b/0x3234de053c4f4df lrc: 5/0,0 mode: PR/PR res: [0x2b7ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d860b expref: 860 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.620278:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396355776 00010000:00010000:0.0:1651529344.620280:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000050f3aed4/0x3234de053c4cfe7 lrc: 5/0,0 mode: PR/PR res: [0x2b7ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf0fe expref: 861 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.620281:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.620285:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396355904 00000100:00100000:1.0:1651529344.620286:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.620287:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f862aa0b/0x3234de053c4c9f8 lrc: 5/0,0 mode: PR/PR res: [0x2b7ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd9f1 expref: 862 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.620293:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.620293:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396355968 00010000:00010000:0.0:1651529344.620295:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f1093027/0x3234de053c4a117 lrc: 5/0,0 mode: PR/PR res: [0x2b7ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb8bf expref: 863 pid: 80280 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.620299:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396356032 00000100:00100000:1.0:1651529344.620301:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d9cfef26 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997016000:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.620302:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004ca9b47e/0x3234de053c4e389 lrc: 5/0,0 mode: PR/PR res: [0x2b7f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f1d expref: 864 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.620306:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002a7b079b/0x3234de053c51905 lrc: 3/0,1 mode: --/PW res: [0x2b7ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.620306:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12489 00000100:00100000:0.0:1651529344.620308:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+864:41279:x1731746396355712:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.620310:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.620312:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000011cf29cf/0x3234de053c4eddf lrc: 4/0,0 mode: PR/PR res: [0x2b7eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d69b7 expref: 864 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.620313:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004bb67ba4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997016128:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.620315:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c51913 lrc: 3/0,1 mode: --/PW res: [0x2b7ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620315:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000011cf29cf/0x3234de053c4eddf lrc: 3/0,0 mode: PR/PR res: [0x2b7eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d69b7 expref: 864 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.620321:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011cf29cf/0x3234de053c4eddf lrc: 0/0,0 mode: --/PR res: [0x2b7eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d69b7 expref: 864 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.620322:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12490 00000100:00100000:1.0:1651529344.620324:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+863:41279:x1731746396355840:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.620324:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.620325:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.620325:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c5190c lrc: 3/0,1 mode: PW/PW res: [0x2b7eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.620327:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.620328:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c5190c lrc: 4/0,1 mode: PW/PW res: [0x2b7eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.620329:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000648e877b/0x3234de053c4f4df lrc: 4/0,0 mode: PR/PR res: [0x2b7ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d860b expref: 863 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.620335:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000648e877b/0x3234de053c4f4df lrc: 3/0,0 mode: PR/PR res: [0x2b7ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d860b expref: 863 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.620341:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000648e877b/0x3234de053c4f4df lrc: 0/0,0 mode: --/PR res: [0x2b7ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d860b expref: 863 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.620344:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.620345:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.620346:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c51913 lrc: 3/0,1 mode: PW/PW res: [0x2b7ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.620349:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c51913 lrc: 4/0,1 mode: PW/PW res: [0x2b7ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620353:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.620355:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.620366:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+862:41279:x1731746396355712:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 57us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.620369:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12489 00000100:00100000:1.0:1651529344.620371:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+862:41279:x1731746396355840:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 47us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.620374:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12490 00000100:00100000:0.0:1651529344.620376:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12491 00000100:00100000:0.0:1651529344.620377:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e45eb301 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+860:41278:x1731746396355776:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.620380:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12492 00010000:00010000:0.0:1651529344.620380:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.620382:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+860:41278:x1731746396355904:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.620382:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000050f3aed4/0x3234de053c4cfe7 lrc: 4/0,0 mode: PR/PR res: [0x2b7ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf0fe expref: 860 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.620384:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.620386:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f862aa0b/0x3234de053c4c9f8 lrc: 5/0,0 mode: PR/PR res: [0x2b7ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd9f1 expref: 860 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.620386:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000050f3aed4/0x3234de053c4cfe7 lrc: 3/0,0 mode: PR/PR res: [0x2b7ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf0fe expref: 860 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.620390:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f862aa0b/0x3234de053c4c9f8 lrc: 4/0,0 mode: PR/PR res: [0x2b7ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd9f1 expref: 860 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.620391:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050f3aed4/0x3234de053c4cfe7 lrc: 0/0,0 mode: --/PR res: [0x2b7ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf0fe expref: 860 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.620394:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.620395:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.620395:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.620395:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.620396:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c5191a lrc: 3/0,1 mode: PW/PW res: [0x2b7ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620396:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002a7b079b/0x3234de053c51905 lrc: 3/0,1 mode: PW/PW res: [0x2b7ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.620399:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c5191a lrc: 4/0,1 mode: PW/PW res: [0x2b7ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620399:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a7b079b/0x3234de053c51905 lrc: 4/0,1 mode: PW/PW res: [0x2b7ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.620403:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.620407:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.620415:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+859:41278:x1731746396355904:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.620417:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12492 00000100:00100000:1.0:1651529344.620422:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12493 00000100:00100000:1.0:1651529344.620423:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+858:41279:x1731746396355968:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.620424:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e45eb301 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+859:41278:x1731746396355776:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (159us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.620425:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.620427:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f1093027/0x3234de053c4a117 lrc: 5/0,0 mode: PR/PR res: [0x2b7ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb8bf expref: 858 pid: 80280 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.620428:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12491 00010000:00010000:1.0:1651529344.620431:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f1093027/0x3234de053c4a117 lrc: 4/0,0 mode: PR/PR res: [0x2b7ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb8bf expref: 857 pid: 80280 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.620435:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.620436:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.620436:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000876c3b77/0x3234de053c51921 lrc: 3/0,1 mode: PW/PW res: [0x2b7ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.620438:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12494 00010000:00010000:1.0:1651529344.620439:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000876c3b77/0x3234de053c51921 lrc: 4/0,1 mode: PW/PW res: [0x2b7ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.620439:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+857:41279:x1731746396356032:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.620442:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.620443:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.620444:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004ca9b47e/0x3234de053c4e389 lrc: 5/0,0 mode: PR/PR res: [0x2b7f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f1d expref: 857 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.620447:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004ca9b47e/0x3234de053c4e389 lrc: 4/0,0 mode: PR/PR res: [0x2b7f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f1d expref: 857 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.620448:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+857:41279:x1731746396355968:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 24us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.620450:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12493 00010000:00010000:0.0:1651529344.620453:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.620453:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.620454:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000be2303ad/0x3234de053c51928 lrc: 3/0,1 mode: PW/PW res: [0x2b7f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620457:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be2303ad/0x3234de053c51928 lrc: 4/0,1 mode: PW/PW res: [0x2b7f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.620460:0:80279:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1093027/0x3234de053c4a117 lrc: 0/0,0 mode: --/PR res: [0x2b7ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb8bf expref: 856 pid: 80280 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.620461:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.620463:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ba0b61e6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997016256:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.620466:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000876c3b77/0x3234de053c51921 lrc: 3/0,1 mode: PW/PW res: [0x2b7ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.620467:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+855:41279:x1731746396356032:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 27us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.620469:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12494 00010000:00010000:1.0:1651529344.620470:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000876c3b77/0x3234de053c51921 lrc: 3/0,1 mode: PW/PW res: [0x2b7ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.620472:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000876c3b77/0x3234de053c51921 lrc: 3/0,1 mode: PW/PW res: [0x2b7ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.620475:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000876c3b77/0x3234de053c51921 lrc: 3/0,1 mode: PW/PW res: [0x2b7ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.620478:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000876c3b77/0x3234de053c51921 lrc: 2/0,0 mode: PW/PW res: [0x2b7ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620479:0:80276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f862aa0b/0x3234de053c4c9f8 lrc: 0/0,0 mode: --/PR res: [0x2b7ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd9f1 expref: 854 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.620483:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002a1f5cf2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997016192:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.620494:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c5191a lrc: 3/0,1 mode: PW/PW res: [0x2b7ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620497:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c5191a lrc: 3/0,1 mode: PW/PW res: [0x2b7ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620500:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c5191a lrc: 3/0,1 mode: PW/PW res: [0x2b7ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620503:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c5191a lrc: 3/0,1 mode: PW/PW res: [0x2b7ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620506:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c5191a lrc: 2/0,0 mode: PW/PW res: [0x2b7ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.620521:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1208:39029:x1731745946474752:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 968us (1111us total) trans 12885079762 rc 0/0 00000100:00100000:1.0:1651529344.620525:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211711 00000100:00100000:1.0:1651529344.620530:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946475136 00000100:00100000:1.0:1651529344.620539:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211714 00000100:00100000:1.0:1651529344.620541:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1209:39030:x1731745946475136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.620546:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178162 count 1 00010000:00010000:1.0:1651529344.620550:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c01fa80c/0x3234de053c51936 lrc: 3/0,1 mode: --/PW res: [0x2b7f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.620553:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1209:39029:x1731745946474816:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1024us (1158us total) trans 12885079763 rc 0/0 00010000:00010000:1.0:1651529344.620555:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000080aae64a/0x3234de053c4e780 lrc: 2/0,0 mode: PR/PR res: [0x2b7f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e9e expref: 853 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.620556:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211710 00010000:00010000:1.0:1651529344.620558:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.620559:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.620559:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c01fa80c/0x3234de053c51936 lrc: 4/0,1 mode: --/PW res: [0x2b7f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620564:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000876c3b77/0x3234de053c51921 lrc: 2/0,0 mode: PW/PW res: [0x2b7ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.620566:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000080aae64a/0x3234de053c4e780 lrc: 3/0,0 mode: PR/PR res: [0x2b7f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e9e expref: 853 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.620567:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000876c3b77 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.620568:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000876c3b77/0x3234de053c51921 lrc: 2/0,0 mode: PW/PW res: [0x2b7ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.620569:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000080aae64a/0x3234de053c4e780 lrc: 4/0,0 mode: PR/PR res: [0x2b7f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e9e expref: 853 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.620570:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000876c3b77/0x3234de053c51921 lrc: 3/0,0 mode: PW/PW res: [0x2b7ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.620573:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005fb0ec6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997016448:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.620578:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000876c3b77/0x3234de053c51921 lrc: 1/0,0 mode: --/PW res: [0x2b7ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620580:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000876c3b77/0x3234de053c51921 lrc: 0/0,0 mode: --/PW res: [0x2b7ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.620581:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a4eb401d going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.620584:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c5191a lrc: 2/0,0 mode: PW/PW res: [0x2b7ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620587:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000073043e99 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.620588:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c5191a lrc: 2/0,0 mode: PW/PW res: [0x2b7ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.620589:0:80277:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ca9b47e/0x3234de053c4e389 lrc: 0/0,0 mode: --/PR res: [0x2b7f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f1d expref: 853 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.620591:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c5191a lrc: 3/0,0 mode: PW/PW res: [0x2b7ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620594:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c5191a lrc: 1/0,0 mode: --/PW res: [0x2b7ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.620596:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000999005e pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997016320:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.620596:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c5191a lrc: 0/0,0 mode: --/PW res: [0x2b7ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.620599:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000be2303ad/0x3234de053c51928 lrc: 3/0,1 mode: PW/PW res: [0x2b7f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.620602:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000be2303ad/0x3234de053c51928 lrc: 3/0,1 mode: PW/PW res: [0x2b7f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620602:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c5190c lrc: 3/0,1 mode: PW/PW res: [0x2b7eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.620605:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be2303ad/0x3234de053c51928 lrc: 3/0,1 mode: PW/PW res: [0x2b7f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620605:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c5190c lrc: 3/0,1 mode: PW/PW res: [0x2b7eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.620608:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be2303ad/0x3234de053c51928 lrc: 3/0,1 mode: PW/PW res: [0x2b7f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.620611:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be2303ad/0x3234de053c51928 lrc: 2/0,0 mode: PW/PW res: [0x2b7f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620611:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c5190c lrc: 3/0,1 mode: PW/PW res: [0x2b7eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620614:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c5190c lrc: 2/0,0 mode: PW/PW res: [0x2b7eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.620651:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1210:39030:x1731745946474880:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1037us (1072us total) trans 12885079764 rc 0/0 00000100:00100000:1.0:1651529344.620653:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211712 00000100:00100000:0.0:1651529344.620658:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1209:39029:x1731745946474560:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1194us (1294us total) trans 12885079765 rc 0/0 00010000:00010000:1.0:1651529344.620661:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c51913 lrc: 3/0,1 mode: PW/PW res: [0x2b7ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.620661:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211708 00010000:00010000:1.0:1651529344.620664:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c51913 lrc: 3/0,1 mode: PW/PW res: [0x2b7ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620667:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be2303ad/0x3234de053c51928 lrc: 2/0,0 mode: PW/PW res: [0x2b7f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.620669:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c51913 lrc: 3/0,1 mode: PW/PW res: [0x2b7ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620671:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000be2303ad already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.620671:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be2303ad/0x3234de053c51928 lrc: 2/0,0 mode: PW/PW res: [0x2b7f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.620672:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c51913 lrc: 2/0,0 mode: PW/PW res: [0x2b7ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620674:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be2303ad/0x3234de053c51928 lrc: 3/0,0 mode: PW/PW res: [0x2b7f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620685:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be2303ad/0x3234de053c51928 lrc: 1/0,0 mode: --/PW res: [0x2b7f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620688:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be2303ad/0x3234de053c51928 lrc: 0/0,0 mode: --/PW res: [0x2b7f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620693:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c5190c lrc: 2/0,0 mode: PW/PW res: [0x2b7eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620696:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eaaf5dcd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.620697:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c5190c lrc: 2/0,0 mode: PW/PW res: [0x2b7eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620699:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c5190c lrc: 3/0,0 mode: PW/PW res: [0x2b7eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620703:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c5190c lrc: 1/0,0 mode: --/PW res: [0x2b7eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620705:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c5190c lrc: 0/0,0 mode: --/PW res: [0x2b7eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620708:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c51913 lrc: 2/0,0 mode: PW/PW res: [0x2b7ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.620709:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d777ba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1209:39029:x1731745946474688:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1198us (1329us total) trans 12885079766 rc 0/0 00010000:00010000:0.0:1651529344.620711:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000b62c3c9 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.620712:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211709 00010000:00010000:0.0:1651529344.620712:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c51913 lrc: 2/0,0 mode: PW/PW res: [0x2b7ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620714:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c51913 lrc: 3/0,0 mode: PW/PW res: [0x2b7ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620717:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c51913 lrc: 1/0,0 mode: --/PW res: [0x2b7ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.620719:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002a7b079b/0x3234de053c51905 lrc: 3/0,1 mode: PW/PW res: [0x2b7ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620720:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c51913 lrc: 0/0,0 mode: --/PW res: [0x2b7ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.620722:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a7b079b/0x3234de053c51905 lrc: 3/0,1 mode: PW/PW res: [0x2b7ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.620725:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a7b079b/0x3234de053c51905 lrc: 3/0,1 mode: PW/PW res: [0x2b7ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.620727:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a7b079b/0x3234de053c51905 lrc: 2/0,0 mode: PW/PW res: [0x2b7ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.620772:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.620773:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1209:39030:x1731745946474624:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1317us (1400us total) trans 12885079767 rc 0/0 00000100:00100000:1.0:1651529344.620785:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211707 00000100:00100000:1.0:1651529344.620813:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396356224 00010000:00010000:1.0:1651529344.620829:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000092d4ff52/0x3234de053c4f10b lrc: 5/0,0 mode: PR/PR res: [0x2b7f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d768a expref: 853 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.620836:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a7b079b/0x3234de053c51905 lrc: 2/0,0 mode: PW/PW res: [0x2b7ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620840:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a7b079b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.620841:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a7b079b/0x3234de053c51905 lrc: 2/0,0 mode: PW/PW res: [0x2b7ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620844:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a7b079b/0x3234de053c51905 lrc: 3/0,0 mode: PW/PW res: [0x2b7ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620849:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a7b079b/0x3234de053c51905 lrc: 1/0,0 mode: --/PW res: [0x2b7ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620851:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a7b079b/0x3234de053c51905 lrc: 0/0,0 mode: --/PW res: [0x2b7ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.620861:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12495 00000100:00100000:1.0:1651529344.620863:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+853:41278:x1731746396356224:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.620867:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.620868:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000092d4ff52/0x3234de053c4f10b lrc: 5/0,0 mode: PR/PR res: [0x2b7f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d768a expref: 853 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.620872:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000092d4ff52/0x3234de053c4f10b lrc: 4/0,0 mode: PR/PR res: [0x2b7f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d768a expref: 853 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.620878:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.620879:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.620879:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c5192f lrc: 3/0,1 mode: PW/PW res: [0x2b7f1:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620879:0:151609:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092d4ff52/0x3234de053c4f10b lrc: 0/0,0 mode: --/PR res: [0x2b7f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d768a expref: 853 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.620883:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c5192f lrc: 4/0,1 mode: PW/PW res: [0x2b7f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.620883:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a4b486d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997016384:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.620887:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.620887:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c5192f lrc: 3/0,1 mode: PW/PW res: [0x2b7f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620890:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c5192f lrc: 3/0,1 mode: PW/PW res: [0x2b7f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620896:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c5192f lrc: 3/0,1 mode: PW/PW res: [0x2b7f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.620899:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+852:41278:x1731746396356224:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.620902:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12495 00010000:00010000:0.0:1651529344.620906:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c5192f lrc: 3/0,1 mode: PW/PW res: [0x2b7f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620909:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c5192f lrc: 2/0,0 mode: PW/PW res: [0x2b7f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.620953:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1209:39030:x1731745946475072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 808us (879us total) trans 12885079768 rc 0/0 00000100:00100000:0.0:1651529344.620956:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211713 00010000:00010000:0.0:1651529344.620963:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c5192f lrc: 2/0,0 mode: PW/PW res: [0x2b7f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620966:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e6b94407 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.620967:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c5192f lrc: 2/0,0 mode: PW/PW res: [0x2b7f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620970:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c5192f lrc: 3/0,0 mode: PW/PW res: [0x2b7f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620975:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c5192f lrc: 1/0,0 mode: --/PW res: [0x2b7f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.620978:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c5192f lrc: 0/0,0 mode: --/PW res: [0x2b7f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.621019:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.621029:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.621039:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946475776 00000100:00100000:0.0:1651529344.621040:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946475712 00000100:00100000:1.0:1651529344.621046:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211715 00000100:00100000:0.0:1651529344.621052:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211716 00000100:00100000:1.0:1651529344.621053:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1210:39030:x1731745946475776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.621053:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1210:39029:x1731745946475712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.621059:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178164 count 1 00002000:00080000:0.0:1651529344.621059:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178163 count 1 00010000:00010000:1.0:1651529344.621063:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e993192b/0x3234de053c5193d lrc: 3/0,1 mode: --/PW res: [0x2b7f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.621068:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001c24d93c/0x3234de053c4d78f lrc: 2/0,0 mode: PR/PR res: [0x2b7f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0fd6 expref: 851 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.621071:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.621071:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.621072:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e993192b/0x3234de053c5193d lrc: 4/0,1 mode: --/PW res: [0x2b7f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.621078:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001c24d93c/0x3234de053c4d78f lrc: 3/0,0 mode: PR/PR res: [0x2b7f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0fd6 expref: 851 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.621082:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001c24d93c/0x3234de053c4d78f lrc: 4/0,0 mode: PR/PR res: [0x2b7f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0fd6 expref: 851 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.621092:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000822949b3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997016512:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.621093:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51944 lrc: 3/0,1 mode: --/PW res: [0x2b7f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.621103:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 0000000020dd7827 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.621107:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003ae9ca0f/0x3234de053c4c107 lrc: 2/0,0 mode: PR/PR res: [0x2b7f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc7ec expref: 851 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.621110:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.621111:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.621112:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51944 lrc: 4/0,1 mode: --/PW res: [0x2b7f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621119:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003ae9ca0f/0x3234de053c4c107 lrc: 3/0,0 mode: PR/PR res: [0x2b7f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc7ec expref: 851 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.621123:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003ae9ca0f/0x3234de053c4c107 lrc: 4/0,0 mode: PR/PR res: [0x2b7f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc7ec expref: 851 pid: 72395 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.621125:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.621127:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a4b486d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997016576:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.621137:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 000000000a4def41 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.621150:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.621163:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.621169:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946475840 00000100:00100000:0.0:1651529344.621169:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.621179:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.621189:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946475904 00000100:00100000:1.0:1651529344.621194:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946475968 00000100:00100000:1.0:1651529344.621198:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946476032 00000100:00100000:0.0:1651529344.621200:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946476096 00000100:00100000:1.0:1651529344.621205:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211717 00000100:00100000:1.0:1651529344.621206:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1215:39029:x1731745946475840:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.621211:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211718 00002000:00080000:1.0:1651529344.621212:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178165 count 1 00000100:00100000:0.0:1651529344.621213:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1215:39030:x1731745946475904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.621216:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2e9e25a/0x3234de053c5194b lrc: 3/0,1 mode: --/PW res: [0x2b7f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.621218:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178166 count 1 00010000:00010000:1.0:1651529344.621220:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f5d61433/0x3234de053c4d248 lrc: 2/0,0 mode: PR/PR res: [0x2b7f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfac1 expref: 851 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.621234:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.621235:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.621237:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51952 lrc: 3/0,1 mode: --/PW res: [0x2b7f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.621240:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2e9e25a/0x3234de053c5194b lrc: 4/0,1 mode: --/PW res: [0x2b7f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621242:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fff466fa/0x3234de053c4c583 lrc: 2/0,0 mode: PR/PR res: [0x2b7f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc9f2 expref: 851 pid: 80281 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.621245:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.621246:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.621247:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51952 lrc: 4/0,1 mode: --/PW res: [0x2b7f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.621248:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f5d61433/0x3234de053c4d248 lrc: 3/0,0 mode: PR/PR res: [0x2b7f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfac1 expref: 851 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.621251:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f5d61433/0x3234de053c4d248 lrc: 4/0,0 mode: PR/PR res: [0x2b7f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfac1 expref: 851 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.621254:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fff466fa/0x3234de053c4c583 lrc: 3/0,0 mode: PR/PR res: [0x2b7f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc9f2 expref: 851 pid: 80281 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.621255:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000716b388d pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997016640:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.621258:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fff466fa/0x3234de053c4c583 lrc: 4/0,0 mode: PR/PR res: [0x2b7f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc9f2 expref: 851 pid: 80281 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.621262:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997016704:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.621266:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 000000007d8fabda going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.621271:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c4075652 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.621272:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211719 00000100:00100000:1.0:1651529344.621274:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1215:39029:x1731745946475968:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.621277:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211720 00002000:00080000:1.0:1651529344.621278:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178167 count 1 00000100:00100000:0.0:1651529344.621279:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1215:39030:x1731745946476032:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.621281:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059d31bf4/0x3234de053c51959 lrc: 3/0,1 mode: --/PW res: [0x2b7f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.621285:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000315dddd8/0x3234de053c4ea12 lrc: 2/0,0 mode: PR/PR res: [0x2b7f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d59d4 expref: 851 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.621291:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.621292:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.621292:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059d31bf4/0x3234de053c51959 lrc: 4/0,1 mode: --/PW res: [0x2b7f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.621298:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000315dddd8/0x3234de053c4ea12 lrc: 3/0,0 mode: PR/PR res: [0x2b7f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d59d4 expref: 851 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.621301:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000315dddd8/0x3234de053c4ea12 lrc: 4/0,0 mode: PR/PR res: [0x2b7f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d59d4 expref: 851 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:0.0:1651529344.621301:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178168 count 1 00000100:00100000:1.0:1651529344.621305:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000095d7eb1a pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997016768:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.621305:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51960 lrc: 3/0,1 mode: --/PW res: [0x2b7f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621310:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005206389b/0x3234de053c4ec73 lrc: 2/0,0 mode: PR/PR res: [0x2b7f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d636d expref: 851 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.621311:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.621313:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.621314:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.621315:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51960 lrc: 4/0,1 mode: --/PW res: [0x2b7f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.621316:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211721 00000100:00100000:1.0:1651529344.621318:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1215:39029:x1731745946476096:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.621321:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005206389b/0x3234de053c4ec73 lrc: 3/0,0 mode: PR/PR res: [0x2b7f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d636d expref: 851 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.621322:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178169 count 1 00010000:00010000:0.0:1651529344.621324:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005206389b/0x3234de053c4ec73 lrc: 4/0,0 mode: PR/PR res: [0x2b7f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d636d expref: 851 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.621325:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c16957d8/0x3234de053c51967 lrc: 3/0,1 mode: --/PW res: [0x2b7f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.621328:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009b8db73b pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997016832:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.621329:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005f241912/0x3234de053c4edae lrc: 2/0,0 mode: PR/PR res: [0x2b7f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6932 expref: 851 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.621332:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.621332:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.621333:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c16957d8/0x3234de053c51967 lrc: 4/0,1 mode: --/PW res: [0x2b7f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.621336:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e7e12492 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.621341:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005f241912/0x3234de053c4edae lrc: 3/0,0 mode: PR/PR res: [0x2b7f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6932 expref: 851 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.621345:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005f241912/0x3234de053c4edae lrc: 4/0,0 mode: PR/PR res: [0x2b7f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6932 expref: 851 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.621348:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ee8cd7c9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997016896:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.621362:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000567ee0ef going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.621373:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005fb0ec6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997016448:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.621374:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.621377:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c01fa80c/0x3234de053c51936 lrc: 3/0,1 mode: --/PW res: [0x2b7f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.621404:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396356608 00010000:00010000:0.0:1651529344.621409:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000080aae64a/0x3234de053c4e780 lrc: 4/0,0 mode: PR/PR res: [0x2b7f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e9e expref: 852 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.621420:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12496 00000100:00100000:0.0:1651529344.621422:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+852:41278:x1731746396356608:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.621425:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.621426:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000080aae64a/0x3234de053c4e780 lrc: 4/0,0 mode: PR/PR res: [0x2b7f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e9e expref: 852 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.621430:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000080aae64a/0x3234de053c4e780 lrc: 3/0,0 mode: PR/PR res: [0x2b7f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e9e expref: 852 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.621436:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080aae64a/0x3234de053c4e780 lrc: 0/0,0 mode: --/PR res: [0x2b7f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e9e expref: 852 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.621439:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.621440:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.621441:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c01fa80c/0x3234de053c51936 lrc: 3/0,1 mode: PW/PW res: [0x2b7f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621444:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c01fa80c/0x3234de053c51936 lrc: 4/0,1 mode: PW/PW res: [0x2b7f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621452:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.621454:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c01fa80c/0x3234de053c51936 lrc: 3/0,1 mode: PW/PW res: [0x2b7f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.621458:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c01fa80c/0x3234de053c51936 lrc: 3/0,1 mode: PW/PW res: [0x2b7f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.621462:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+851:41278:x1731746396356608:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 39us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.621464:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12496 00010000:00010000:1.0:1651529344.621466:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c01fa80c/0x3234de053c51936 lrc: 3/0,1 mode: PW/PW res: [0x2b7f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.621469:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c01fa80c/0x3234de053c51936 lrc: 2/0,0 mode: PW/PW res: [0x2b7f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621497:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c01fa80c/0x3234de053c51936 lrc: 2/0,0 mode: PW/PW res: [0x2b7f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621501:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c01fa80c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.621502:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c01fa80c/0x3234de053c51936 lrc: 2/0,0 mode: PW/PW res: [0x2b7f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621505:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c01fa80c/0x3234de053c51936 lrc: 3/0,0 mode: PW/PW res: [0x2b7f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621510:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c01fa80c/0x3234de053c51936 lrc: 1/0,0 mode: --/PW res: [0x2b7f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621513:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c01fa80c/0x3234de053c51936 lrc: 0/0,0 mode: --/PW res: [0x2b7f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.621517:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1216:39030:x1731745946475136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 975us (1333us total) trans 12885079769 rc 0/0 00000100:00100000:1.0:1651529344.621521:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211714 00000100:00100000:1.0:1651529344.621597:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.621598:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a4b486d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997016576:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.621607:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51944 lrc: 3/0,1 mode: --/PW res: [0x2b7f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.621608:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.621615:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396356928 00010000:00010000:0.0:1651529344.621619:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003ae9ca0f/0x3234de053c4c107 lrc: 4/0,0 mode: PR/PR res: [0x2b7f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc7ec expref: 851 pid: 72395 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.621622:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000822949b3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997016512:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.621629:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396356864 00010000:00010000:1.0:1651529344.621631:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e993192b/0x3234de053c5193d lrc: 3/0,1 mode: --/PW res: [0x2b7f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621632:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001c24d93c/0x3234de053c4d78f lrc: 4/0,0 mode: PR/PR res: [0x2b7f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0fd6 expref: 852 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.621640:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12497 00000100:00100000:0.0:1651529344.621642:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+852:41279:x1731746396356928:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.621645:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12498 00010000:00010000:0.0:1651529344.621645:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.621646:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003ae9ca0f/0x3234de053c4c107 lrc: 4/0,0 mode: PR/PR res: [0x2b7f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc7ec expref: 852 pid: 72395 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.621647:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d8aeac5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+852:41278:x1731746396356864:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.621649:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003ae9ca0f/0x3234de053c4c107 lrc: 3/0,0 mode: PR/PR res: [0x2b7f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc7ec expref: 852 pid: 72395 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.621651:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.621652:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001c24d93c/0x3234de053c4d78f lrc: 4/0,0 mode: PR/PR res: [0x2b7f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0fd6 expref: 852 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.621655:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ae9ca0f/0x3234de053c4c107 lrc: 0/0,0 mode: --/PR res: [0x2b7f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc7ec expref: 852 pid: 72395 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.621656:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001c24d93c/0x3234de053c4d78f lrc: 3/0,0 mode: PR/PR res: [0x2b7f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0fd6 expref: 852 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.621659:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.621659:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.621660:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51944 lrc: 3/0,1 mode: PW/PW res: [0x2b7f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.621662:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c24d93c/0x3234de053c4d78f lrc: 0/0,0 mode: --/PR res: [0x2b7f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0fd6 expref: 851 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.621663:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51944 lrc: 4/0,1 mode: PW/PW res: [0x2b7f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.621666:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.621667:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.621668:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e993192b/0x3234de053c5193d lrc: 3/0,1 mode: PW/PW res: [0x2b7f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621670:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.621671:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e993192b/0x3234de053c5193d lrc: 4/0,1 mode: PW/PW res: [0x2b7f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.621678:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+850:41279:x1731746396356928:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (87us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.621679:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.621680:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12497 00000100:00100000:1.0:1651529344.621685:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d8aeac5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+849:41278:x1731746396356864:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 38us (77us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.621686:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51944 lrc: 3/0,1 mode: PW/PW res: [0x2b7f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.621688:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12498 00010000:00010000:0.0:1651529344.621689:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51944 lrc: 3/0,1 mode: PW/PW res: [0x2b7f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621692:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51944 lrc: 3/0,1 mode: PW/PW res: [0x2b7f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621695:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51944 lrc: 2/0,0 mode: PW/PW res: [0x2b7f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.621700:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e993192b/0x3234de053c5193d lrc: 3/0,1 mode: PW/PW res: [0x2b7f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.621703:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e993192b/0x3234de053c5193d lrc: 3/0,1 mode: PW/PW res: [0x2b7f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.621706:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e993192b/0x3234de053c5193d lrc: 3/0,1 mode: PW/PW res: [0x2b7f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.621709:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e993192b/0x3234de053c5193d lrc: 2/0,0 mode: PW/PW res: [0x2b7f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.621767:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1217:39030:x1731745946475776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 718us (737us total) trans 12885079770 rc 0/0 00000100:00100000:1.0:1651529344.621769:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211715 00000100:00100000:0.0:1651529344.621771:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1217:39029:x1731745946475712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 717us (752us total) trans 12885079771 rc 0/0 00000100:00100000:0.0:1651529344.621774:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211716 00000100:00100000:1.0:1651529344.621780:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000716b388d pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997016640:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.621782:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51944 lrc: 2/0,0 mode: PW/PW res: [0x2b7f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.621784:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c2e9e25a/0x3234de053c5194b lrc: 3/0,1 mode: --/PW res: [0x2b7f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621786:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d5eeb0cd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.621787:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51944 lrc: 2/0,0 mode: PW/PW res: [0x2b7f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621790:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51944 lrc: 3/0,0 mode: PW/PW res: [0x2b7f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621794:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51944 lrc: 1/0,0 mode: --/PW res: [0x2b7f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.621798:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.621818:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51944 lrc: 0/0,0 mode: --/PW res: [0x2b7f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621823:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e993192b/0x3234de053c5193d lrc: 2/0,0 mode: PW/PW res: [0x2b7f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621825:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e993192b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.621826:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e993192b/0x3234de053c5193d lrc: 2/0,0 mode: PW/PW res: [0x2b7f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621841:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e993192b/0x3234de053c5193d lrc: 3/0,0 mode: PW/PW res: [0x2b7f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621845:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e993192b/0x3234de053c5193d lrc: 1/0,0 mode: --/PW res: [0x2b7f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621847:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e993192b/0x3234de053c5193d lrc: 0/0,0 mode: --/PW res: [0x2b7f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.621861:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946476160 00000100:00100000:0.0:1651529344.621872:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211722 00000100:00100000:0.0:1651529344.621873:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1216:39030:x1731745946476160:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.621878:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178170 count 1 00010000:00010000:0.0:1651529344.621882:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c5196e lrc: 3/0,1 mode: --/PW res: [0x2b7fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.621887:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ad9bb328/0x3234de053c4e2d3 lrc: 2/0,0 mode: PR/PR res: [0x2b7fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c99 expref: 848 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.621890:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.621891:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.621891:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c5196e lrc: 4/0,1 mode: --/PW res: [0x2b7fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.621904:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.621904:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ad9bb328/0x3234de053c4e2d3 lrc: 3/0,0 mode: PR/PR res: [0x2b7fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c99 expref: 848 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.621910:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.621916:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.621922:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.621923:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ad9bb328/0x3234de053c4e2d3 lrc: 4/0,0 mode: PR/PR res: [0x2b7fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c99 expref: 848 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.621932:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.621933:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a4b486d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997016960:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.621941:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000095d7eb1a pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997016768:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.621945:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000059d31bf4/0x3234de053c51959 lrc: 3/0,1 mode: --/PW res: [0x2b7f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.621949:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 000000000a4def41 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.621957:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997016704:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.621959:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ee8cd7c9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997016896:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.621961:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51952 lrc: 3/0,1 mode: --/PW res: [0x2b7f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.621962:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c16957d8/0x3234de053c51967 lrc: 3/0,1 mode: --/PW res: [0x2b7f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.621967:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009b8db73b pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997016832:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.621968:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396356992 00010000:00010000:0.0:1651529344.621970:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51960 lrc: 3/0,1 mode: --/PW res: [0x2b7f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.621972:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f5d61433/0x3234de053c4d248 lrc: 4/0,0 mode: PR/PR res: [0x2b7f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfac1 expref: 849 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.621978:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396357120 00010000:00010000:1.0:1651529344.621980:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000315dddd8/0x3234de053c4ea12 lrc: 4/0,0 mode: PR/PR res: [0x2b7f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d59d4 expref: 850 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.621984:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396357056 00010000:00010000:1.0:1651529344.621986:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fff466fa/0x3234de053c4c583 lrc: 4/0,0 mode: PR/PR res: [0x2b7f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc9f2 expref: 851 pid: 80281 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.621989:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396357248 00010000:00010000:1.0:1651529344.621991:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005f241912/0x3234de053c4edae lrc: 4/0,0 mode: PR/PR res: [0x2b7f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6932 expref: 852 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.621997:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396357184 00010000:00010000:0.0:1651529344.622002:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005206389b/0x3234de053c4ec73 lrc: 4/0,0 mode: PR/PR res: [0x2b7f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d636d expref: 853 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.622008:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12499 00000100:00100000:1.0:1651529344.622010:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+853:41279:x1731746396356992:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.622010:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12500 00000100:00100000:0.0:1651529344.622012:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+853:41279:x1731746396357120:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.622013:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.622014:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f5d61433/0x3234de053c4d248 lrc: 4/0,0 mode: PR/PR res: [0x2b7f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfac1 expref: 853 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.622014:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.622016:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000315dddd8/0x3234de053c4ea12 lrc: 4/0,0 mode: PR/PR res: [0x2b7f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d59d4 expref: 853 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.622018:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f5d61433/0x3234de053c4d248 lrc: 3/0,0 mode: PR/PR res: [0x2b7f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfac1 expref: 853 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.622022:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000315dddd8/0x3234de053c4ea12 lrc: 3/0,0 mode: PR/PR res: [0x2b7f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d59d4 expref: 853 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.622023:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5d61433/0x3234de053c4d248 lrc: 0/0,0 mode: --/PR res: [0x2b7f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfac1 expref: 853 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.622027:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.622027:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.622028:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2e9e25a/0x3234de053c5194b lrc: 3/0,1 mode: PW/PW res: [0x2b7f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622028:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000315dddd8/0x3234de053c4ea12 lrc: 0/0,0 mode: --/PR res: [0x2b7f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d59d4 expref: 852 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.622031:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2e9e25a/0x3234de053c5194b lrc: 4/0,1 mode: PW/PW res: [0x2b7f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622032:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.622032:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.622033:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000059d31bf4/0x3234de053c51959 lrc: 3/0,1 mode: PW/PW res: [0x2b7f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622036:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059d31bf4/0x3234de053c51959 lrc: 4/0,1 mode: PW/PW res: [0x2b7f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.622038:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.622050:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+851:41279:x1731746396356992:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 40us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.622053:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12499 00000100:00100000:1.0:1651529344.622058:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12501 00000100:00100000:1.0:1651529344.622060:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+850:41278:x1731746396357056:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.622063:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.622067:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.622070:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fff466fa/0x3234de053c4c583 lrc: 4/0,0 mode: PR/PR res: [0x2b7f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc9f2 expref: 850 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.622074:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fff466fa/0x3234de053c4c583 lrc: 3/0,0 mode: PR/PR res: [0x2b7f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc9f2 expref: 850 pid: 80281 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.622075:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+850:41279:x1731746396357120:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 63us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.622078:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12500 00010000:00010000:1.0:1651529344.622079:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fff466fa/0x3234de053c4c583 lrc: 0/0,0 mode: --/PR res: [0x2b7f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc9f2 expref: 850 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.622082:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.622083:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.622084:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51952 lrc: 3/0,1 mode: PW/PW res: [0x2b7f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.622084:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12502 00000100:00100000:0.0:1651529344.622085:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+848:41279:x1731746396357248:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.622087:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51952 lrc: 4/0,1 mode: PW/PW res: [0x2b7f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622088:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.622089:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005f241912/0x3234de053c4edae lrc: 4/0,0 mode: PR/PR res: [0x2b7f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6932 expref: 848 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.622095:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.622099:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005f241912/0x3234de053c4edae lrc: 3/0,0 mode: PR/PR res: [0x2b7f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6932 expref: 848 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.622101:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+848:41278:x1731746396357056:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.622103:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12501 00010000:00010000:0.0:1651529344.622105:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f241912/0x3234de053c4edae lrc: 0/0,0 mode: --/PR res: [0x2b7f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6932 expref: 848 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.622108:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12503 00010000:00010000:0.0:1651529344.622109:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.622109:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.622110:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+846:41278:x1731746396357184:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.622110:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c16957d8/0x3234de053c51967 lrc: 3/0,1 mode: PW/PW res: [0x2b7f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.622112:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.622113:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005206389b/0x3234de053c4ec73 lrc: 4/0,0 mode: PR/PR res: [0x2b7f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d636d expref: 846 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.622113:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c16957d8/0x3234de053c51967 lrc: 4/0,1 mode: PW/PW res: [0x2b7f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.622119:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005206389b/0x3234de053c4ec73 lrc: 3/0,0 mode: PR/PR res: [0x2b7f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d636d expref: 846 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.622122:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.622128:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+846:41279:x1731746396357248:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (205us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.622130:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005206389b/0x3234de053c4ec73 lrc: 0/0,0 mode: --/PR res: [0x2b7f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d636d expref: 846 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.622131:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12502 00010000:00010000:1.0:1651529344.622134:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.622135:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.622135:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51960 lrc: 3/0,1 mode: PW/PW res: [0x2b7f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622137:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51952 lrc: 3/0,1 mode: PW/PW res: [0x2b7f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.622138:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51960 lrc: 4/0,1 mode: PW/PW res: [0x2b7f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622141:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51952 lrc: 3/0,1 mode: PW/PW res: [0x2b7f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622144:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51952 lrc: 3/0,1 mode: PW/PW res: [0x2b7f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.622147:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.622152:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+844:41278:x1731746396357184:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (220us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.622152:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51952 lrc: 2/0,0 mode: PW/PW res: [0x2b7f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.622155:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12503 00010000:00010000:1.0:1651529344.622163:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c2e9e25a/0x3234de053c5194b lrc: 3/0,1 mode: PW/PW res: [0x2b7f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.622166:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2e9e25a/0x3234de053c5194b lrc: 3/0,1 mode: PW/PW res: [0x2b7f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.622169:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2e9e25a/0x3234de053c5194b lrc: 3/0,1 mode: PW/PW res: [0x2b7f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.622174:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2e9e25a/0x3234de053c5194b lrc: 2/0,0 mode: PW/PW res: [0x2b7f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.622214:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1218:39030:x1731745946475904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1000us (1064us total) trans 12885079772 rc 0/0 00000100:00100000:1.0:1651529344.622216:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1218:39029:x1731745946475840:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1008us (1091us total) trans 12885079773 rc 0/0 00000100:00100000:0.0:1651529344.622217:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211718 00000100:00100000:1.0:1651529344.622219:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211717 00010000:00010000:1.0:1651529344.622244:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c16957d8/0x3234de053c51967 lrc: 3/0,1 mode: PW/PW res: [0x2b7f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622244:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51960 lrc: 3/0,1 mode: PW/PW res: [0x2b7f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.622248:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c16957d8/0x3234de053c51967 lrc: 3/0,1 mode: PW/PW res: [0x2b7f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622248:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51960 lrc: 3/0,1 mode: PW/PW res: [0x2b7f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.622251:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c16957d8/0x3234de053c51967 lrc: 3/0,1 mode: PW/PW res: [0x2b7f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622251:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51960 lrc: 3/0,1 mode: PW/PW res: [0x2b7f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.622254:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c16957d8/0x3234de053c51967 lrc: 2/0,0 mode: PW/PW res: [0x2b7f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622254:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51960 lrc: 2/0,0 mode: PW/PW res: [0x2b7f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.622290:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1218:39030:x1731745946476032:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1010us (1120us total) trans 12885079774 rc 0/0 00000100:00100000:1.0:1651529344.622292:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1218:39029:x1731745946476096:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 973us (1113us total) trans 12885079775 rc 0/0 00000100:00100000:0.0:1651529344.622293:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211720 00000100:00100000:1.0:1651529344.622295:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211721 00010000:00010000:0.0:1651529344.622300:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51952 lrc: 2/0,0 mode: PW/PW res: [0x2b7f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.622302:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000059d31bf4/0x3234de053c51959 lrc: 3/0,1 mode: PW/PW res: [0x2b7f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622303:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000040cd657 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.622304:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51952 lrc: 2/0,0 mode: PW/PW res: [0x2b7f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.622305:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059d31bf4/0x3234de053c51959 lrc: 3/0,1 mode: PW/PW res: [0x2b7f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622307:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51952 lrc: 3/0,0 mode: PW/PW res: [0x2b7f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.622311:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059d31bf4/0x3234de053c51959 lrc: 3/0,1 mode: PW/PW res: [0x2b7f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622312:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51952 lrc: 1/0,0 mode: --/PW res: [0x2b7f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.622313:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059d31bf4/0x3234de053c51959 lrc: 2/0,0 mode: PW/PW res: [0x2b7f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622315:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51952 lrc: 0/0,0 mode: --/PW res: [0x2b7f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622319:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2e9e25a/0x3234de053c5194b lrc: 2/0,0 mode: PW/PW res: [0x2b7f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622322:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2e9e25a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.622323:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2e9e25a/0x3234de053c5194b lrc: 2/0,0 mode: PW/PW res: [0x2b7f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622325:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2e9e25a/0x3234de053c5194b lrc: 3/0,0 mode: PW/PW res: [0x2b7f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622329:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2e9e25a/0x3234de053c5194b lrc: 1/0,0 mode: --/PW res: [0x2b7f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622331:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2e9e25a/0x3234de053c5194b lrc: 0/0,0 mode: --/PW res: [0x2b7f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622335:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51960 lrc: 2/0,0 mode: PW/PW res: [0x2b7f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622337:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000093dbd0d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.622338:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51960 lrc: 2/0,0 mode: PW/PW res: [0x2b7f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.622341:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1217:39029:x1731745946475968:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1067us (1178us total) trans 12885079776 rc 0/0 00010000:00010000:0.0:1651529344.622341:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51960 lrc: 3/0,0 mode: PW/PW res: [0x2b7f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.622344:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211719 00010000:00010000:0.0:1651529344.622344:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51960 lrc: 1/0,0 mode: --/PW res: [0x2b7f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622347:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51960 lrc: 0/0,0 mode: --/PW res: [0x2b7f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622350:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c16957d8/0x3234de053c51967 lrc: 2/0,0 mode: PW/PW res: [0x2b7f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622352:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c16957d8 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.622353:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c16957d8/0x3234de053c51967 lrc: 2/0,0 mode: PW/PW res: [0x2b7f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622356:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c16957d8/0x3234de053c51967 lrc: 3/0,0 mode: PW/PW res: [0x2b7f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.622358:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.622359:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c16957d8/0x3234de053c51967 lrc: 1/0,0 mode: --/PW res: [0x2b7f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622361:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c16957d8/0x3234de053c51967 lrc: 0/0,0 mode: --/PW res: [0x2b7f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622365:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059d31bf4/0x3234de053c51959 lrc: 2/0,0 mode: PW/PW res: [0x2b7f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622370:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000059d31bf4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.622371:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059d31bf4/0x3234de053c51959 lrc: 2/0,0 mode: PW/PW res: [0x2b7f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622381:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059d31bf4/0x3234de053c51959 lrc: 3/0,0 mode: PW/PW res: [0x2b7f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.622384:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.622384:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059d31bf4/0x3234de053c51959 lrc: 1/0,0 mode: --/PW res: [0x2b7f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622387:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059d31bf4/0x3234de053c51959 lrc: 0/0,0 mode: --/PW res: [0x2b7f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.622394:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.622399:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a4b486d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997016960:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.622402:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c5196e lrc: 3/0,1 mode: --/PW res: [0x2b7fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.622429:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946476288 00000100:00100000:1.0:1651529344.622446:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946476224 00000100:00100000:0.0:1651529344.622451:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211723 00000100:00100000:1.0:1651529344.622453:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211724 00000100:00100000:0.0:1651529344.622453:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1218:39030:x1731745946476288:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.622455:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1218:39030:x1731745946476224:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.622459:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178172 count 1 00002000:00080000:1.0:1651529344.622460:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178171 count 1 00010000:00010000:0.0:1651529344.622463:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51975 lrc: 3/0,1 mode: --/PW res: [0x2b7fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.622465:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba79f088/0x3234de053c5197c lrc: 3/0,1 mode: --/PW res: [0x2b7fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622467:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dff77f66/0x3234de053c4d06c lrc: 2/0,0 mode: PR/PR res: [0x2b7fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf34a expref: 843 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.622469:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000089167818/0x3234de053c4f0f6 lrc: 2/0,0 mode: PR/PR res: [0x2b7fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7652 expref: 843 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.622472:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.622473:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.622474:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba79f088/0x3234de053c5197c lrc: 4/0,1 mode: --/PW res: [0x2b7fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.622481:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000089167818/0x3234de053c4f0f6 lrc: 3/0,0 mode: PR/PR res: [0x2b7fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7652 expref: 843 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.622485:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000089167818/0x3234de053c4f0f6 lrc: 4/0,0 mode: PR/PR res: [0x2b7fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7652 expref: 843 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.622488:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.622489:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000095d7eb1a pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997017024:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.622489:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.622490:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51975 lrc: 4/0,1 mode: --/PW res: [0x2b7fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622497:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dff77f66/0x3234de053c4d06c lrc: 3/0,0 mode: PR/PR res: [0x2b7fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf34a expref: 843 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.622499:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 000000007d8fabda going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.622501:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dff77f66/0x3234de053c4d06c lrc: 4/0,0 mode: PR/PR res: [0x2b7fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf34a expref: 843 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.622505:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396357312 00000100:00100000:0.0:1651529344.622505:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a4b486d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997017088:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.622509:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ad9bb328/0x3234de053c4e2d3 lrc: 4/0,0 mode: PR/PR res: [0x2b7fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c99 expref: 844 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.622514:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000000a4def41 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.622516:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12504 00000100:00100000:1.0:1651529344.622517:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+844:41279:x1731746396357312:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.622520:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.622521:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ad9bb328/0x3234de053c4e2d3 lrc: 4/0,0 mode: PR/PR res: [0x2b7fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c99 expref: 844 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.622525:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ad9bb328/0x3234de053c4e2d3 lrc: 3/0,0 mode: PR/PR res: [0x2b7fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c99 expref: 844 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.622531:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad9bb328/0x3234de053c4e2d3 lrc: 0/0,0 mode: --/PR res: [0x2b7fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c99 expref: 844 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.622534:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.622535:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.622536:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c5196e lrc: 3/0,1 mode: PW/PW res: [0x2b7fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.622539:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c5196e lrc: 4/0,1 mode: PW/PW res: [0x2b7fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.622548:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.622551:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c5196e lrc: 3/0,1 mode: PW/PW res: [0x2b7fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.622554:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+843:41279:x1731746396357312:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (161us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.622555:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c5196e lrc: 3/0,1 mode: PW/PW res: [0x2b7fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.622557:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12504 00010000:00010000:0.0:1651529344.622558:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c5196e lrc: 3/0,1 mode: PW/PW res: [0x2b7fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622560:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c5196e lrc: 2/0,0 mode: PW/PW res: [0x2b7fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.622649:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1219:39030:x1731745946476160:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 775us (851us total) trans 12885079777 rc 0/0 00000100:00100000:0.0:1651529344.622653:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211722 00010000:00010000:0.0:1651529344.622661:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c5196e lrc: 2/0,0 mode: PW/PW res: [0x2b7fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622664:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000046d6c242 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.622665:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c5196e lrc: 2/0,0 mode: PW/PW res: [0x2b7fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622668:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c5196e lrc: 3/0,0 mode: PW/PW res: [0x2b7fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.622673:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.622673:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c5196e lrc: 1/0,0 mode: --/PW res: [0x2b7fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622676:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c5196e lrc: 0/0,0 mode: --/PW res: [0x2b7fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.622689:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946476864 00000100:00100000:0.0:1651529344.622698:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211725 00000100:00100000:0.0:1651529344.622700:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1219:39029:x1731745946476864:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.622705:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178173 count 1 00010000:00010000:0.0:1651529344.622708:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51983 lrc: 3/0,1 mode: --/PW res: [0x2b7fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.622710:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.622713:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006ea9ef69/0x3234de053c4e3f9 lrc: 2/0,0 mode: PR/PR res: [0x2b7fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d40c1 expref: 842 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.622717:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.622718:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.622719:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.622719:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51983 lrc: 4/0,1 mode: --/PW res: [0x2b7fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.622727:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.622732:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006ea9ef69/0x3234de053c4e3f9 lrc: 3/0,0 mode: PR/PR res: [0x2b7fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d40c1 expref: 842 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.622741:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.622744:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006ea9ef69/0x3234de053c4e3f9 lrc: 4/0,0 mode: PR/PR res: [0x2b7fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d40c1 expref: 842 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.622748:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946476928 00000100:00100000:0.0:1651529344.622748:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009b8db73b pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997017152:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.622754:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946476992 00000100:00100000:1.0:1651529344.622760:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946477056 00000100:00100000:1.0:1651529344.622768:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946477120 00000100:00100000:0.0:1651529344.622769:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c4075652 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.622775:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211726 00000100:00100000:1.0:1651529344.622777:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1223:39030:x1731745946476928:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.622781:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211727 00002000:00080000:1.0:1651529344.622782:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178174 count 1 00000100:00100000:0.0:1651529344.622783:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1223:39029:x1731745946476992:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.622786:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c559283b/0x3234de053c5198a lrc: 3/0,1 mode: --/PW res: [0x2b7fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.622788:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178175 count 1 00010000:00010000:1.0:1651529344.622791:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001230be19/0x3234de053c4e994 lrc: 2/0,0 mode: PR/PR res: [0x2b7fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d57d5 expref: 842 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.622791:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51991 lrc: 3/0,1 mode: --/PW res: [0x2b7ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622796:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000170fa924/0x3234de053c4d241 lrc: 2/0,0 mode: PR/PR res: [0x2b7ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfab3 expref: 842 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.622797:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.622798:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.622798:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c559283b/0x3234de053c5198a lrc: 4/0,1 mode: --/PW res: [0x2b7fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622799:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.622799:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.622800:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51991 lrc: 4/0,1 mode: --/PW res: [0x2b7ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.622805:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001230be19/0x3234de053c4e994 lrc: 3/0,0 mode: PR/PR res: [0x2b7fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d57d5 expref: 842 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.622808:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001230be19/0x3234de053c4e994 lrc: 4/0,0 mode: PR/PR res: [0x2b7fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d57d5 expref: 842 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.622812:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000264aecf8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997017216:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.622821:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd96f074 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.622825:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000170fa924/0x3234de053c4d241 lrc: 3/0,0 mode: PR/PR res: [0x2b7ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfab3 expref: 842 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.622827:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211728 00000100:00100000:1.0:1651529344.622829:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1223:39030:x1731745946477056:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.622829:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000170fa924/0x3234de053c4d241 lrc: 4/0,0 mode: PR/PR res: [0x2b7ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfab3 expref: 842 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:1.0:1651529344.622833:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178176 count 1 00000100:00100000:0.0:1651529344.622833:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997017280:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.622836:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039586f31/0x3234de053c51998 lrc: 3/0,1 mode: --/PW res: [0x2b800:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.622840:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b699c548/0x3234de053c4df7d lrc: 2/0,0 mode: PR/PR res: [0x2b800:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f25 expref: 842 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.622841:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed830649 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.622843:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.622844:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.622845:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039586f31/0x3234de053c51998 lrc: 4/0,1 mode: --/PW res: [0x2b800:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.622848:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211729 00000100:00100000:0.0:1651529344.622849:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1223:39029:x1731745946477120:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.622853:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b699c548/0x3234de053c4df7d lrc: 3/0,0 mode: PR/PR res: [0x2b800:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f25 expref: 842 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.622854:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178177 count 1 00010000:00010000:1.0:1651529344.622856:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b699c548/0x3234de053c4df7d lrc: 4/0,0 mode: PR/PR res: [0x2b800:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f25 expref: 842 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.622857:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c5199f lrc: 3/0,1 mode: --/PW res: [0x2b801:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.622860:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004bb67ba4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997017344:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.622862:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4f1c1 lrc: 2/0,0 mode: PR/PR res: [0x2b801:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d79b6 expref: 842 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.622865:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.622865:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.622866:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000499d0377 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.622866:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c5199f lrc: 4/0,1 mode: --/PW res: [0x2b801:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622872:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4f1c1 lrc: 3/0,0 mode: PR/PR res: [0x2b801:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d79b6 expref: 842 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.622875:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4f1c1 lrc: 4/0,0 mode: PR/PR res: [0x2b801:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d79b6 expref: 842 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.622879:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997017408:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.622880:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.622886:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 000000003003c8b0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.622891:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946477184 00000100:00100000:0.0:1651529344.622903:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211730 00000100:00100000:0.0:1651529344.622905:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1224:39030:x1731745946477184:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.622921:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178178 count 1 00010000:00010000:0.0:1651529344.622924:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c519a6 lrc: 3/0,1 mode: --/PW res: [0x2b802:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622929:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004d748f29/0x3234de053c4e550 lrc: 2/0,0 mode: PR/PR res: [0x2b802:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4671 expref: 842 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.622932:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.622932:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.622933:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c519a6 lrc: 4/0,1 mode: --/PW res: [0x2b802:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.622939:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004d748f29/0x3234de053c4e550 lrc: 3/0,0 mode: PR/PR res: [0x2b802:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4671 expref: 842 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.622942:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004d748f29/0x3234de053c4e550 lrc: 4/0,0 mode: PR/PR res: [0x2b802:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4671 expref: 842 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.622946:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997017472:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.622955:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e7e12492 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.622978:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.622980:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a4b486d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997017088:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.622984:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51975 lrc: 3/0,1 mode: --/PW res: [0x2b7fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.622985:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.622996:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000095d7eb1a pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997017024:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.623000:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ba79f088/0x3234de053c5197c lrc: 3/0,1 mode: --/PW res: [0x2b7fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.623007:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396357568 00010000:00010000:1.0:1651529344.623011:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000089167818/0x3234de053c4f0f6 lrc: 4/0,0 mode: PR/PR res: [0x2b7fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7652 expref: 843 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.623018:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396357696 00010000:00010000:1.0:1651529344.623027:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dff77f66/0x3234de053c4d06c lrc: 4/0,0 mode: PR/PR res: [0x2b7fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf34a expref: 844 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.623042:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12505 00000100:00100000:1.0:1651529344.623044:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045c93b49 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+844:41278:x1731746396357568:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.623047:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.623047:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12506 00010000:00010000:1.0:1651529344.623048:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000089167818/0x3234de053c4f0f6 lrc: 4/0,0 mode: PR/PR res: [0x2b7fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7652 expref: 844 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.623049:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+844:41278:x1731746396357696:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.623052:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000089167818/0x3234de053c4f0f6 lrc: 3/0,0 mode: PR/PR res: [0x2b7fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7652 expref: 844 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.623052:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.623054:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dff77f66/0x3234de053c4d06c lrc: 4/0,0 mode: PR/PR res: [0x2b7fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf34a expref: 844 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.623058:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089167818/0x3234de053c4f0f6 lrc: 0/0,0 mode: --/PR res: [0x2b7fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7652 expref: 844 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.623058:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dff77f66/0x3234de053c4d06c lrc: 3/0,0 mode: PR/PR res: [0x2b7fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf34a expref: 844 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.623061:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.623062:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.623063:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba79f088/0x3234de053c5197c lrc: 3/0,1 mode: PW/PW res: [0x2b7fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623064:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dff77f66/0x3234de053c4d06c lrc: 0/0,0 mode: --/PR res: [0x2b7fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf34a expref: 843 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.623066:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba79f088/0x3234de053c5197c lrc: 4/0,1 mode: PW/PW res: [0x2b7fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623068:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.623069:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.623070:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51975 lrc: 3/0,1 mode: PW/PW res: [0x2b7fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623072:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.623073:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51975 lrc: 4/0,1 mode: PW/PW res: [0x2b7fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623079:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.623081:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045c93b49 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+842:41278:x1731746396357568:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.623083:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12505 00000100:00100000:0.0:1651529344.623086:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+841:41278:x1731746396357696:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.623091:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12506 00010000:00010000:1.0:1651529344.623095:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ba79f088/0x3234de053c5197c lrc: 3/0,1 mode: PW/PW res: [0x2b7fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623098:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba79f088/0x3234de053c5197c lrc: 3/0,1 mode: PW/PW res: [0x2b7fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623098:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51975 lrc: 3/0,1 mode: PW/PW res: [0x2b7fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623101:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51975 lrc: 3/0,1 mode: PW/PW res: [0x2b7fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623104:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba79f088/0x3234de053c5197c lrc: 3/0,1 mode: PW/PW res: [0x2b7fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623104:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51975 lrc: 3/0,1 mode: PW/PW res: [0x2b7fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623106:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba79f088/0x3234de053c5197c lrc: 2/0,0 mode: PW/PW res: [0x2b7fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623107:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51975 lrc: 2/0,0 mode: PW/PW res: [0x2b7fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.623153:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1226:39030:x1731745946476224:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 697us (769us total) trans 12885079778 rc 0/0 00000100:00100000:1.0:1651529344.623156:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211724 00000100:00100000:0.0:1651529344.623163:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1225:39030:x1731745946476288:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 709us (805us total) trans 12885079779 rc 0/0 00000100:00100000:0.0:1651529344.623166:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211723 00010000:00010000:0.0:1651529344.623173:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba79f088/0x3234de053c5197c lrc: 2/0,0 mode: PW/PW res: [0x2b7fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623176:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba79f088 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.623177:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba79f088/0x3234de053c5197c lrc: 2/0,0 mode: PW/PW res: [0x2b7fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623180:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba79f088/0x3234de053c5197c lrc: 3/0,0 mode: PW/PW res: [0x2b7fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623185:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba79f088/0x3234de053c5197c lrc: 1/0,0 mode: --/PW res: [0x2b7fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623188:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba79f088/0x3234de053c5197c lrc: 0/0,0 mode: --/PW res: [0x2b7fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623192:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51975 lrc: 2/0,0 mode: PW/PW res: [0x2b7fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623194:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c8d9712a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.623195:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51975 lrc: 2/0,0 mode: PW/PW res: [0x2b7fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623198:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51975 lrc: 3/0,0 mode: PW/PW res: [0x2b7fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623201:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51975 lrc: 1/0,0 mode: --/PW res: [0x2b7fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623203:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51975 lrc: 0/0,0 mode: --/PW res: [0x2b7fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.623335:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.623350:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.623358:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.623359:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009b8db73b pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997017152:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.623363:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51983 lrc: 3/0,1 mode: --/PW res: [0x2b7fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.623365:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.623370:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946477440 00000100:00100000:1.0:1651529344.623381:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000264aecf8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997017216:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.623391:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c559283b/0x3234de053c5198a lrc: 3/0,1 mode: --/PW res: [0x2b7fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.623398:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946477376 00000100:00100000:0.0:1651529344.623406:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211731 00000100:00100000:1.0:1651529344.623407:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396357888 00000100:00100000:0.0:1651529344.623408:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1226:39030:x1731745946477440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.623412:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006ea9ef69/0x3234de053c4e3f9 lrc: 4/0,0 mode: PR/PR res: [0x2b7fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d40c1 expref: 841 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:0.0:1651529344.623413:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178180 count 1 00010000:00010000:0.0:1651529344.623417:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c519ad lrc: 3/0,1 mode: --/PW res: [0x2b804:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.623419:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396358016 00010000:00010000:1.0:1651529344.623421:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001230be19/0x3234de053c4e994 lrc: 4/0,0 mode: PR/PR res: [0x2b7fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d57d5 expref: 842 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.623421:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000857f3009/0x3234de053c4d50b lrc: 2/0,0 mode: PR/PR res: [0x2b804:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0659 expref: 842 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.623426:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12507 00000100:00100000:1.0:1651529344.623428:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+842:41279:x1731746396357888:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.623431:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.623432:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006ea9ef69/0x3234de053c4e3f9 lrc: 4/0,0 mode: PR/PR res: [0x2b7fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d40c1 expref: 842 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.623436:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006ea9ef69/0x3234de053c4e3f9 lrc: 3/0,0 mode: PR/PR res: [0x2b7fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d40c1 expref: 842 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.623436:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.623436:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.623437:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c519ad lrc: 4/0,1 mode: --/PW res: [0x2b804:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623441:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ea9ef69/0x3234de053c4e3f9 lrc: 0/0,0 mode: --/PR res: [0x2b7fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d40c1 expref: 842 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.623445:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.623445:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.623446:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51983 lrc: 3/0,1 mode: PW/PW res: [0x2b7fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623449:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51983 lrc: 4/0,1 mode: PW/PW res: [0x2b7fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623453:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000857f3009/0x3234de053c4d50b lrc: 3/0,0 mode: PR/PR res: [0x2b804:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0659 expref: 841 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.623459:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.623463:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000857f3009/0x3234de053c4d50b lrc: 4/0,0 mode: PR/PR res: [0x2b804:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0659 expref: 841 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.623467:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+841:41279:x1731746396357888:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.623468:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009b8db73b pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997017536:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.623469:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12507 00000100:00100000:1.0:1651529344.623474:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12508 00000100:00100000:1.0:1651529344.623475:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+840:41279:x1731746396358016:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.623477:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000003678d25f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.623478:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.623479:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001230be19/0x3234de053c4e994 lrc: 4/0,0 mode: PR/PR res: [0x2b7fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d57d5 expref: 840 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.623483:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001230be19/0x3234de053c4e994 lrc: 3/0,0 mode: PR/PR res: [0x2b7fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d57d5 expref: 840 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.623485:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997017280:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.623488:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001230be19/0x3234de053c4e994 lrc: 0/0,0 mode: --/PR res: [0x2b7fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d57d5 expref: 840 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.623488:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51991 lrc: 3/0,1 mode: --/PW res: [0x2b7ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623491:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.623492:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.623492:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c559283b/0x3234de053c5198a lrc: 3/0,1 mode: PW/PW res: [0x2b7fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623493:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51983 lrc: 3/0,1 mode: PW/PW res: [0x2b7fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623495:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c559283b/0x3234de053c5198a lrc: 4/0,1 mode: PW/PW res: [0x2b7fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623499:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51983 lrc: 3/0,1 mode: PW/PW res: [0x2b7fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623501:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.623502:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51983 lrc: 3/0,1 mode: PW/PW res: [0x2b7fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623504:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51983 lrc: 2/0,0 mode: PW/PW res: [0x2b7fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.623506:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+839:41279:x1731746396358016:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 30us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.623508:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12508 00000100:00100000:1.0:1651529344.623515:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211732 00000100:00100000:1.0:1651529344.623516:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1226:39029:x1731745946477376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.623521:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178179 count 1 00010000:00010000:1.0:1651529344.623524:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b54a65c7/0x3234de053c519b4 lrc: 3/0,1 mode: --/PW res: [0x2b803:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623528:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ecab8346/0x3234de053c4e637 lrc: 2/0,0 mode: PR/PR res: [0x2b803:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d49e3 expref: 838 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.623534:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.623534:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.623535:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b54a65c7/0x3234de053c519b4 lrc: 4/0,1 mode: --/PW res: [0x2b803:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623541:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ecab8346/0x3234de053c4e637 lrc: 3/0,0 mode: PR/PR res: [0x2b803:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d49e3 expref: 838 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.623542:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1227:39029:x1731745946476864:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 841us (869us total) trans 12885079780 rc 0/0 00010000:00010000:1.0:1651529344.623545:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ecab8346/0x3234de053c4e637 lrc: 4/0,0 mode: PR/PR res: [0x2b803:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d49e3 expref: 838 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.623545:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211725 00000100:00100000:1.0:1651529344.623549:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000703c0db9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997017600:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.623552:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51983 lrc: 2/0,0 mode: PW/PW res: [0x2b7fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623555:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bfb594be already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.623556:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000babe2d90 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.623556:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51983 lrc: 2/0,0 mode: PW/PW res: [0x2b7fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623559:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51983 lrc: 3/0,0 mode: PW/PW res: [0x2b7fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623564:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c559283b/0x3234de053c5198a lrc: 3/0,1 mode: PW/PW res: [0x2b7fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623567:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c559283b/0x3234de053c5198a lrc: 3/0,1 mode: PW/PW res: [0x2b7fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623570:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c559283b/0x3234de053c5198a lrc: 3/0,1 mode: PW/PW res: [0x2b7fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623573:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c559283b/0x3234de053c5198a lrc: 2/0,0 mode: PW/PW res: [0x2b7fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623579:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51983 lrc: 1/0,0 mode: --/PW res: [0x2b7fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623588:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51983 lrc: 0/0,0 mode: --/PW res: [0x2b7fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623593:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c559283b/0x3234de053c5198a lrc: 2/0,0 mode: PW/PW res: [0x2b7fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623595:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c559283b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.623596:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c559283b/0x3234de053c5198a lrc: 2/0,0 mode: PW/PW res: [0x2b7fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623599:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c559283b/0x3234de053c5198a lrc: 3/0,0 mode: PW/PW res: [0x2b7fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623602:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c559283b/0x3234de053c5198a lrc: 1/0,0 mode: --/PW res: [0x2b7fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623605:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c559283b/0x3234de053c5198a lrc: 0/0,0 mode: --/PW res: [0x2b7fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.623615:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1227:39030:x1731745946476928:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 837us (904us total) trans 12885079781 rc 0/0 00000100:00100000:1.0:1651529344.623618:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211726 00000100:00100000:1.0:1651529344.623685:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004bb67ba4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997017344:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.623699:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997017408:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.623703:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000039586f31/0x3234de053c51998 lrc: 3/0,1 mode: --/PW res: [0x2b800:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623704:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c5199f lrc: 3/0,1 mode: --/PW res: [0x2b801:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.623722:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.623722:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997017472:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.623730:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.623745:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.623752:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c519a6 lrc: 3/0,1 mode: --/PW res: [0x2b802:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.623754:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.623760:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396358144 00000100:00100000:0.0:1651529344.623760:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396358208 00010000:00010000:1.0:1651529344.623765:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000170fa924/0x3234de053c4d241 lrc: 4/0,0 mode: PR/PR res: [0x2b7ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfab3 expref: 840 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.623766:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b699c548/0x3234de053c4df7d lrc: 4/0,0 mode: PR/PR res: [0x2b800:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f25 expref: 840 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.623771:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396358272 00000100:00100000:0.0:1651529344.623771:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396358336 00010000:00010000:1.0:1651529344.623773:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4f1c1 lrc: 4/0,0 mode: PR/PR res: [0x2b801:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d79b6 expref: 842 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.623774:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004d748f29/0x3234de053c4e550 lrc: 4/0,0 mode: PR/PR res: [0x2b802:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4671 expref: 842 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.623779:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12509 00000100:00100000:1.0:1651529344.623780:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+842:41279:x1731746396358144:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.623781:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12510 00000100:00100000:0.0:1651529344.623782:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+842:41278:x1731746396358208:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.623783:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.623784:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000170fa924/0x3234de053c4d241 lrc: 4/0,0 mode: PR/PR res: [0x2b7ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfab3 expref: 842 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.623785:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.623786:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b699c548/0x3234de053c4df7d lrc: 4/0,0 mode: PR/PR res: [0x2b800:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f25 expref: 842 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.623788:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000170fa924/0x3234de053c4d241 lrc: 3/0,0 mode: PR/PR res: [0x2b7ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfab3 expref: 842 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.623790:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b699c548/0x3234de053c4df7d lrc: 3/0,0 mode: PR/PR res: [0x2b800:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f25 expref: 842 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.623796:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b699c548/0x3234de053c4df7d lrc: 0/0,0 mode: --/PR res: [0x2b800:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f25 expref: 842 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.623797:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000170fa924/0x3234de053c4d241 lrc: 0/0,0 mode: --/PR res: [0x2b7ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfab3 expref: 842 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.623801:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.623801:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.623802:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51991 lrc: 3/0,1 mode: PW/PW res: [0x2b7ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623805:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51991 lrc: 4/0,1 mode: PW/PW res: [0x2b7ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623815:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.623822:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.623822:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.623823:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+840:41279:x1731746396358144:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (102us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.623823:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000039586f31/0x3234de053c51998 lrc: 3/0,1 mode: PW/PW res: [0x2b800:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.623826:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12509 00010000:00010000:0.0:1651529344.623827:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039586f31/0x3234de053c51998 lrc: 4/0,1 mode: PW/PW res: [0x2b800:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.623830:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12511 00000100:00100000:1.0:1651529344.623832:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+839:41279:x1731746396358272:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.623837:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.623840:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.623842:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4f1c1 lrc: 4/0,0 mode: PR/PR res: [0x2b801:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d79b6 expref: 839 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.623845:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+839:41278:x1731746396358208:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 62us (115us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.623846:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4f1c1 lrc: 3/0,0 mode: PR/PR res: [0x2b801:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d79b6 expref: 839 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.623848:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12510 00010000:00010000:1.0:1651529344.623851:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db11c60d/0x3234de053c4f1c1 lrc: 0/0,0 mode: --/PR res: [0x2b801:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d79b6 expref: 838 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.623853:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12512 00000100:00100000:0.0:1651529344.623855:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002017d1f9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+838:41278:x1731746396358336:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.623857:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.623858:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.623858:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c5199f lrc: 3/0,1 mode: PW/PW res: [0x2b801:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623858:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.623859:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004d748f29/0x3234de053c4e550 lrc: 4/0,0 mode: PR/PR res: [0x2b802:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4671 expref: 837 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.623861:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c5199f lrc: 4/0,1 mode: PW/PW res: [0x2b801:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623863:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004d748f29/0x3234de053c4e550 lrc: 3/0,0 mode: PR/PR res: [0x2b802:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4671 expref: 837 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.623870:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.623874:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d748f29/0x3234de053c4e550 lrc: 0/0,0 mode: --/PR res: [0x2b802:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4671 expref: 837 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.623876:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+837:41279:x1731746396358272:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 43us (131us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.623878:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.623879:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12511 00010000:00010000:0.0:1651529344.623879:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.623879:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c519a6 lrc: 3/0,1 mode: PW/PW res: [0x2b802:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623882:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c519a6 lrc: 4/0,1 mode: PW/PW res: [0x2b802:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623886:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000039586f31/0x3234de053c51998 lrc: 3/0,1 mode: PW/PW res: [0x2b800:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623888:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.623889:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039586f31/0x3234de053c51998 lrc: 3/0,1 mode: PW/PW res: [0x2b800:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623893:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039586f31/0x3234de053c51998 lrc: 3/0,1 mode: PW/PW res: [0x2b800:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.623895:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039586f31/0x3234de053c51998 lrc: 2/0,0 mode: PW/PW res: [0x2b800:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.623922:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002017d1f9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+835:41278:x1731746396358336:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 65us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.623925:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12512 00010000:00010000:0.0:1651529344.623936:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51991 lrc: 3/0,1 mode: PW/PW res: [0x2b7ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623940:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51991 lrc: 3/0,1 mode: PW/PW res: [0x2b7ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.623943:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51991 lrc: 3/0,1 mode: PW/PW res: [0x2b7ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.623945:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1227:39030:x1731745946477056:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1115us (1217us total) trans 12885079782 rc 0/0 00010000:00010000:0.0:1651529344.623946:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51991 lrc: 2/0,0 mode: PW/PW res: [0x2b7ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.623948:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211728 00000100:00100000:1.0:1651529344.623962:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.623992:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1227:39029:x1731745946476992:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1208us (1274us total) trans 12885079783 rc 0/0 00000100:00100000:0.0:1651529344.623995:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211727 00000100:00100000:0.0:1651529344.624001:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946477760 00000100:00100000:0.0:1651529344.624011:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211733 00000100:00100000:0.0:1651529344.624012:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1227:39029:x1731745946477760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.624015:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.624017:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178182 count 1 00010000:00010000:0.0:1651529344.624021:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c519bb lrc: 3/0,1 mode: --/PW res: [0x2b806:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624026:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009d73fcf0/0x3234de053c4ee10 lrc: 2/0,0 mode: PR/PR res: [0x2b806:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a74 expref: 834 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.624029:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.624030:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.624031:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c519bb lrc: 4/0,1 mode: --/PW res: [0x2b806:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624037:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009d73fcf0/0x3234de053c4ee10 lrc: 3/0,0 mode: PR/PR res: [0x2b806:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a74 expref: 834 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.624041:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009d73fcf0/0x3234de053c4ee10 lrc: 4/0,0 mode: PR/PR res: [0x2b806:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a74 expref: 834 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.624045:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997017664:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.624054:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e7e12492 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.624057:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.624059:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c5199f lrc: 3/0,1 mode: PW/PW res: [0x2b801:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624069:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c5199f lrc: 3/0,1 mode: PW/PW res: [0x2b801:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.624071:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.624072:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c5199f lrc: 3/0,1 mode: PW/PW res: [0x2b801:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624075:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c5199f lrc: 2/0,0 mode: PW/PW res: [0x2b801:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.624098:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946477696 00000100:00100000:1.0:1651529344.624106:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211734 00000100:00100000:1.0:1651529344.624108:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1229:39030:x1731745946477696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.624113:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178181 count 1 00010000:00010000:1.0:1651529344.624117:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c519c2 lrc: 3/0,1 mode: --/PW res: [0x2b805:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.624122:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008a5d6c31/0x3234de053c4a7a7 lrc: 2/0,0 mode: PR/PR res: [0x2b805:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc38 expref: 834 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.624125:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.624126:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.624126:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c519c2 lrc: 4/0,1 mode: --/PW res: [0x2b805:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.624139:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008a5d6c31/0x3234de053c4a7a7 lrc: 3/0,0 mode: PR/PR res: [0x2b805:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc38 expref: 834 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.624143:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008a5d6c31/0x3234de053c4a7a7 lrc: 4/0,0 mode: PR/PR res: [0x2b805:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc38 expref: 834 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.624147:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004089c807 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997017728:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.624150:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1229:39029:x1731745946477120:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1300us (1416us total) trans 12885079784 rc 0/0 00000100:00100000:0.0:1651529344.624154:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211729 00000100:00100000:1.0:1651529344.624156:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000567ee0ef going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.624161:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c519a6 lrc: 3/0,1 mode: PW/PW res: [0x2b802:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.624164:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000703c0db9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997017600:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.624167:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c519a6 lrc: 3/0,1 mode: PW/PW res: [0x2b802:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.624168:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b54a65c7/0x3234de053c519b4 lrc: 3/0,1 mode: --/PW res: [0x2b803:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.624175:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396358464 00010000:00010000:1.0:1651529344.624179:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000857f3009/0x3234de053c4d50b lrc: 5/0,0 mode: PR/PR res: [0x2b804:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0659 expref: 835 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.624183:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c519a6 lrc: 3/0,1 mode: PW/PW res: [0x2b802:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.624185:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396358528 00010000:00010000:0.0:1651529344.624186:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c519a6 lrc: 2/0,0 mode: PW/PW res: [0x2b802:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.624188:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ecab8346/0x3234de053c4e637 lrc: 4/0,0 mode: PR/PR res: [0x2b803:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d49e3 expref: 836 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.624193:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12513 00000100:00100000:1.0:1651529344.624195:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+836:41278:x1731746396358464:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.624197:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.624198:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000857f3009/0x3234de053c4d50b lrc: 5/0,0 mode: PR/PR res: [0x2b804:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0659 expref: 836 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.624202:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000857f3009/0x3234de053c4d50b lrc: 4/0,0 mode: PR/PR res: [0x2b804:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0659 expref: 836 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.624208:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.624208:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.624209:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c519ad lrc: 3/0,1 mode: PW/PW res: [0x2b804:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.624212:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c519ad lrc: 4/0,1 mode: PW/PW res: [0x2b804:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.624219:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.624221:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1229:39030:x1731745946477184:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1315us (1341us total) trans 12885079785 rc 0/0 00000100:00100000:1.0:1651529344.624241:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+836:41278:x1731746396358464:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 45us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.624243:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211730 00000100:00100000:1.0:1651529344.624244:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12513 00000100:00100000:1.0:1651529344.624248:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12514 00000100:00100000:1.0:1651529344.624250:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+835:41279:x1731746396358528:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.624250:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039586f31/0x3234de053c51998 lrc: 2/0,0 mode: PW/PW res: [0x2b800:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.624252:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.624254:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ecab8346/0x3234de053c4e637 lrc: 4/0,0 mode: PR/PR res: [0x2b803:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d49e3 expref: 835 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.624254:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000039586f31 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.624255:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039586f31/0x3234de053c51998 lrc: 2/0,0 mode: PW/PW res: [0x2b800:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.624258:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ecab8346/0x3234de053c4e637 lrc: 3/0,0 mode: PR/PR res: [0x2b803:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d49e3 expref: 835 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.624258:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039586f31/0x3234de053c51998 lrc: 3/0,0 mode: PW/PW res: [0x2b800:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.624262:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ecab8346/0x3234de053c4e637 lrc: 0/0,0 mode: --/PR res: [0x2b803:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d49e3 expref: 835 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.624263:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039586f31/0x3234de053c51998 lrc: 1/0,0 mode: --/PW res: [0x2b800:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.624266:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.624266:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.624266:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039586f31/0x3234de053c51998 lrc: 0/0,0 mode: --/PW res: [0x2b800:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.624267:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b54a65c7/0x3234de053c519b4 lrc: 3/0,1 mode: PW/PW res: [0x2b803:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.624270:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b54a65c7/0x3234de053c519b4 lrc: 4/0,1 mode: PW/PW res: [0x2b803:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624270:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51991 lrc: 2/0,0 mode: PW/PW res: [0x2b7ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624273:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b2d06199 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.624274:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51991 lrc: 2/0,0 mode: PW/PW res: [0x2b7ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.624276:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.624276:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51991 lrc: 3/0,0 mode: PW/PW res: [0x2b7ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624279:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51991 lrc: 1/0,0 mode: --/PW res: [0x2b7ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.624281:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+834:41279:x1731746396358528:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 31us (210us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.624282:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51991 lrc: 0/0,0 mode: --/PW res: [0x2b7ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.624284:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12514 00010000:00010000:0.0:1651529344.624285:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c5199f lrc: 2/0,0 mode: PW/PW res: [0x2b801:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624288:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6eb3f34 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.624289:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c5199f lrc: 2/0,0 mode: PW/PW res: [0x2b801:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.624290:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b54a65c7/0x3234de053c519b4 lrc: 3/0,1 mode: PW/PW res: [0x2b803:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624291:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c5199f lrc: 3/0,0 mode: PW/PW res: [0x2b801:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.624294:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b54a65c7/0x3234de053c519b4 lrc: 3/0,1 mode: PW/PW res: [0x2b803:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624294:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c5199f lrc: 1/0,0 mode: --/PW res: [0x2b801:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.624297:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b54a65c7/0x3234de053c519b4 lrc: 3/0,1 mode: PW/PW res: [0x2b803:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624297:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c5199f lrc: 0/0,0 mode: --/PW res: [0x2b801:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.624299:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b54a65c7/0x3234de053c519b4 lrc: 2/0,0 mode: PW/PW res: [0x2b803:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624301:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c519a6 lrc: 2/0,0 mode: PW/PW res: [0x2b802:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624317:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dd394f60 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.624318:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c519a6 lrc: 2/0,0 mode: PW/PW res: [0x2b802:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624321:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c519a6 lrc: 3/0,0 mode: PW/PW res: [0x2b802:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624325:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c519a6 lrc: 1/0,0 mode: --/PW res: [0x2b802:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624328:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c519a6 lrc: 0/0,0 mode: --/PW res: [0x2b802:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624332:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b54a65c7/0x3234de053c519b4 lrc: 2/0,0 mode: PW/PW res: [0x2b803:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624334:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b54a65c7 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.624335:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1229:39029:x1731745946477376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 818us (970us total) trans 12885079786 rc 0/0 00010000:00010000:0.0:1651529344.624335:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b54a65c7/0x3234de053c519b4 lrc: 2/0,0 mode: PW/PW res: [0x2b803:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.624338:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211732 00010000:00010000:0.0:1651529344.624340:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b54a65c7/0x3234de053c519b4 lrc: 3/0,0 mode: PW/PW res: [0x2b803:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624344:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b54a65c7/0x3234de053c519b4 lrc: 1/0,0 mode: --/PW res: [0x2b803:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624346:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b54a65c7/0x3234de053c519b4 lrc: 0/0,0 mode: --/PW res: [0x2b803:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624358:0:80276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000857f3009/0x3234de053c4d50b lrc: 0/0,0 mode: --/PR res: [0x2b804:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0659 expref: 833 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.624361:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009b8db73b pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997017536:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.624364:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c519ad lrc: 3/0,1 mode: PW/PW res: [0x2b804:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624367:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c519ad lrc: 3/0,1 mode: PW/PW res: [0x2b804:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624370:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c519ad lrc: 3/0,1 mode: PW/PW res: [0x2b804:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624373:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c519ad lrc: 3/0,1 mode: PW/PW res: [0x2b804:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.624375:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.624376:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c519ad lrc: 2/0,0 mode: PW/PW res: [0x2b804:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.624403:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.624413:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.624423:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1229:39030:x1731745946477440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1014us (1072us total) trans 12885079787 rc 0/0 00000100:00100000:0.0:1651529344.624426:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211731 00000100:00100000:0.0:1651529344.624431:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946478016 00000100:00100000:0.0:1651529344.624441:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946478080 00000100:00100000:0.0:1651529344.624446:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211735 00000100:00100000:0.0:1651529344.624448:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1230:39030:x1731745946478016:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.624453:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178183 count 1 00010000:00010000:0.0:1651529344.624457:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c519c9 lrc: 3/0,1 mode: --/PW res: [0x2b807:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624462:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000074d971f4/0x3234de053c4f67c lrc: 2/0,0 mode: PR/PR res: [0x2b807:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8cbe expref: 832 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.624465:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.624465:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.624466:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c519c9 lrc: 4/0,1 mode: --/PW res: [0x2b807:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624472:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000074d971f4/0x3234de053c4f67c lrc: 3/0,0 mode: PR/PR res: [0x2b807:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8cbe expref: 832 pid: 156655 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.624478:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211736 00000100:00100000:1.0:1651529344.624480:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1230:39030:x1731745946478080:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.624486:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178184 count 1 00010000:00010000:1.0:1651529344.624490:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e90f6a58/0x3234de053c519d0 lrc: 3/0,1 mode: --/PW res: [0x2b808:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624492:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000074d971f4/0x3234de053c4f67c lrc: 4/0,0 mode: PR/PR res: [0x2b807:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8cbe expref: 832 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.624495:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000afd5f999/0x3234de053c4e40e lrc: 2/0,0 mode: PR/PR res: [0x2b808:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d412a expref: 832 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.624496:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009b8db73b pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997017792:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.624498:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.624499:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.624500:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e90f6a58/0x3234de053c519d0 lrc: 4/0,1 mode: --/PW res: [0x2b808:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.624506:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000afd5f999/0x3234de053c4e40e lrc: 3/0,0 mode: PR/PR res: [0x2b808:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d412a expref: 832 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.624511:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e68b7e1f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.624517:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000afd5f999/0x3234de053c4e40e lrc: 4/0,0 mode: PR/PR res: [0x2b808:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d412a expref: 832 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.624518:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c519ad lrc: 2/0,0 mode: PW/PW res: [0x2b804:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.624521:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000050bbb886 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997017856:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.624521:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000579ed558 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.624522:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c519ad lrc: 2/0,0 mode: PW/PW res: [0x2b804:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624525:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c519ad lrc: 3/0,0 mode: PW/PW res: [0x2b804:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.624530:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000499d0377 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.624530:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c519ad lrc: 1/0,0 mode: --/PW res: [0x2b804:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624533:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c519ad lrc: 0/0,0 mode: --/PW res: [0x2b804:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.624536:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396358784 00010000:00010000:1.0:1651529344.624541:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009d73fcf0/0x3234de053c4ee10 lrc: 4/0,0 mode: PR/PR res: [0x2b806:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a74 expref: 833 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.624542:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997017664:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.624545:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c519bb lrc: 3/0,1 mode: --/PW res: [0x2b806:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.624549:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12515 00000100:00100000:1.0:1651529344.624550:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+833:41278:x1731746396358784:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.624553:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.624554:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009d73fcf0/0x3234de053c4ee10 lrc: 4/0,0 mode: PR/PR res: [0x2b806:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a74 expref: 833 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.624558:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009d73fcf0/0x3234de053c4ee10 lrc: 3/0,0 mode: PR/PR res: [0x2b806:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a74 expref: 833 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.624566:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d73fcf0/0x3234de053c4ee10 lrc: 0/0,0 mode: --/PR res: [0x2b806:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a74 expref: 833 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.624570:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.624570:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.624571:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c519bb lrc: 3/0,1 mode: PW/PW res: [0x2b806:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.624583:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c519bb lrc: 4/0,1 mode: PW/PW res: [0x2b806:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.624593:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.624600:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+832:41278:x1731746396358784:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 49us (187us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.624601:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c519bb lrc: 3/0,1 mode: PW/PW res: [0x2b806:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.624602:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12515 00010000:00010000:0.0:1651529344.624616:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c519bb lrc: 3/0,1 mode: PW/PW res: [0x2b806:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624622:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c519bb lrc: 3/0,1 mode: PW/PW res: [0x2b806:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624634:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c519bb lrc: 2/0,0 mode: PW/PW res: [0x2b806:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.624667:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.624674:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1231:39029:x1731745946477760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 661us (711us total) trans 12885079788 rc 0/0 00000100:00100000:1.0:1651529344.624677:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.624677:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211733 00000100:00100000:0.0:1651529344.624682:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946478272 00000100:00100000:0.0:1651529344.624693:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211737 00000100:00100000:0.0:1651529344.624695:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1231:39029:x1731745946478272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.624700:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178185 count 1 00010000:00010000:0.0:1651529344.624704:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be2303ad/0x3234de053c519d7 lrc: 3/0,1 mode: --/PW res: [0x2b809:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.624707:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.624709:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cc074488/0x3234de053c4c911 lrc: 2/0,0 mode: PR/PR res: [0x2b809:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd591 expref: 831 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.624719:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.624719:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.624719:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.624720:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be2303ad/0x3234de053c519d7 lrc: 4/0,1 mode: --/PW res: [0x2b809:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.624726:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.624727:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cc074488/0x3234de053c4c911 lrc: 3/0,0 mode: PR/PR res: [0x2b809:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd591 expref: 831 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.624746:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004089c807 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997017728:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.624747:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cc074488/0x3234de053c4c911 lrc: 4/0,0 mode: PR/PR res: [0x2b809:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd591 expref: 831 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.624750:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c519c2 lrc: 3/0,1 mode: --/PW res: [0x2b805:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.624751:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997017920:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.624757:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946478336 00000100:00100000:0.0:1651529344.624769:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e7e12492 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.624770:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946478464 00010000:00010000:0.0:1651529344.624773:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c519bb lrc: 2/0,0 mode: PW/PW res: [0x2b806:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.624777:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946478400 00000100:00100000:1.0:1651529344.624781:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211738 00010000:00010000:0.0:1651529344.624782:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004f275b98 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.624783:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000098d47485 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1234:39030:x1731745946478336:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.624783:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c519bb lrc: 2/0,0 mode: PW/PW res: [0x2b806:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624786:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c519bb lrc: 3/0,0 mode: PW/PW res: [0x2b806:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.624788:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178186 count 1 00010000:00010000:0.0:1651529344.624791:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c519bb lrc: 1/0,0 mode: --/PW res: [0x2b806:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.624792:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079489ed7/0x3234de053c519de lrc: 3/0,1 mode: --/PW res: [0x2b80a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624793:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c519bb lrc: 0/0,0 mode: --/PW res: [0x2b806:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.624796:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000095fca58f/0x3234de053c4f158 lrc: 2/0,0 mode: PR/PR res: [0x2b80a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7819 expref: 831 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.624799:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.624800:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.624800:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079489ed7/0x3234de053c519de lrc: 4/0,1 mode: --/PW res: [0x2b80a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.624807:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000095fca58f/0x3234de053c4f158 lrc: 3/0,0 mode: PR/PR res: [0x2b80a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7819 expref: 831 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.624810:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000095fca58f/0x3234de053c4f158 lrc: 4/0,0 mode: PR/PR res: [0x2b80a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7819 expref: 831 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.624814:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000076d5f96b pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997017984:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.624823:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 000000007d8fabda going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.624829:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396358912 00000100:00100000:0.0:1651529344.624829:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211739 00000100:00100000:0.0:1651529344.624831:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1234:39030:x1731745946478464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.624832:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008a5d6c31/0x3234de053c4a7a7 lrc: 4/0,0 mode: PR/PR res: [0x2b805:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc38 expref: 832 pid: 72397 timeout: 20103 lvb_type: 1 00002000:00080000:0.0:1651529344.624837:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178188 count 1 00000100:00100000:1.0:1651529344.624839:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12516 00010000:00010000:0.0:1651529344.624840:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c519e5 lrc: 3/0,1 mode: --/PW res: [0x2b80c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.624841:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+832:41279:x1731746396358912:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.624844:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.624845:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008a5d6c31/0x3234de053c4a7a7 lrc: 4/0,0 mode: PR/PR res: [0x2b805:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc38 expref: 832 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.624845:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000069d9333b/0x3234de053c4ca29 lrc: 2/0,0 mode: PR/PR res: [0x2b80c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda53 expref: 832 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.624848:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.624848:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.624849:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008a5d6c31/0x3234de053c4a7a7 lrc: 3/0,0 mode: PR/PR res: [0x2b805:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc38 expref: 832 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.624849:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c519e5 lrc: 4/0,1 mode: --/PW res: [0x2b80c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.624854:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a5d6c31/0x3234de053c4a7a7 lrc: 0/0,0 mode: --/PR res: [0x2b805:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc38 expref: 832 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.624856:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000069d9333b/0x3234de053c4ca29 lrc: 3/0,0 mode: PR/PR res: [0x2b80c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda53 expref: 832 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.624857:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.624858:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.624859:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c519c2 lrc: 3/0,1 mode: PW/PW res: [0x2b805:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624859:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000069d9333b/0x3234de053c4ca29 lrc: 4/0,0 mode: PR/PR res: [0x2b80c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda53 expref: 831 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.624862:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c519c2 lrc: 4/0,1 mode: PW/PW res: [0x2b805:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.624863:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997018048:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.624867:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.624872:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000008dd99533 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.624873:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+831:41279:x1731746396358912:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 31us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.624876:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12516 00000100:00100000:0.0:1651529344.624878:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211740 00000100:00100000:0.0:1651529344.624880:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1234:39030:x1731745946478400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.624884:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c519c2 lrc: 3/0,1 mode: PW/PW res: [0x2b805:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.624884:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178187 count 1 00010000:00010000:1.0:1651529344.624887:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c519c2 lrc: 3/0,1 mode: PW/PW res: [0x2b805:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624887:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c519ec lrc: 3/0,1 mode: --/PW res: [0x2b80b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624891:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006141c28a/0x3234de053c4dcc1 lrc: 2/0,0 mode: PR/PR res: [0x2b80b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d234e expref: 830 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.624892:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c519c2 lrc: 3/0,1 mode: PW/PW res: [0x2b805:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624894:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.624894:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.624895:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c519c2 lrc: 2/0,0 mode: PW/PW res: [0x2b805:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624895:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c519ec lrc: 4/0,1 mode: --/PW res: [0x2b80b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624901:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006141c28a/0x3234de053c4dcc1 lrc: 3/0,0 mode: PR/PR res: [0x2b80b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d234e expref: 830 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.624912:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006141c28a/0x3234de053c4dcc1 lrc: 4/0,0 mode: PR/PR res: [0x2b80b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d234e expref: 830 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.624916:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997018112:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.624923:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed830649 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.624928:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c519c2 lrc: 2/0,0 mode: PW/PW res: [0x2b805:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624932:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009c763642 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.624933:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c519c2 lrc: 2/0,0 mode: PW/PW res: [0x2b805:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624935:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c519c2 lrc: 3/0,0 mode: PW/PW res: [0x2b805:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.624936:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1235:39030:x1731745946477696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 828us (928us total) trans 12885079789 rc 0/0 00000100:00100000:1.0:1651529344.624939:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211734 00010000:00010000:0.0:1651529344.624940:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c519c2 lrc: 1/0,0 mode: --/PW res: [0x2b805:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.624943:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c519c2 lrc: 0/0,0 mode: --/PW res: [0x2b805:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.624954:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.625015:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.625016:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000050bbb886 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997017856:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.625025:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e90f6a58/0x3234de053c519d0 lrc: 3/0,1 mode: --/PW res: [0x2b808:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.625027:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.625038:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396359040 00010000:00010000:1.0:1651529344.625043:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000afd5f999/0x3234de053c4e40e lrc: 4/0,0 mode: PR/PR res: [0x2b808:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d412a expref: 831 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.625051:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946478528 00000100:00100000:0.0:1651529344.625062:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211741 00000100:00100000:0.0:1651529344.625064:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1235:39030:x1731745946478528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.625069:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178189 count 1 00000100:00100000:1.0:1651529344.625077:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396358976 00010000:00010000:0.0:1651529344.625079:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c519f3 lrc: 3/0,1 mode: --/PW res: [0x2b80d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.625081:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000074d971f4/0x3234de053c4f67c lrc: 5/0,0 mode: PR/PR res: [0x2b807:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8cbe expref: 832 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.625084:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000689e285e/0x3234de053c4eb85 lrc: 2/0,0 mode: PR/PR res: [0x2b80d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5fa7 expref: 832 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.625087:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.625087:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.625088:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c519f3 lrc: 4/0,1 mode: --/PW res: [0x2b80d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.625089:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12517 00000100:00100000:1.0:1651529344.625090:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+832:41279:x1731746396359040:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.625093:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.625095:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000afd5f999/0x3234de053c4e40e lrc: 4/0,0 mode: PR/PR res: [0x2b808:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d412a expref: 832 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.625095:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000689e285e/0x3234de053c4eb85 lrc: 3/0,0 mode: PR/PR res: [0x2b80d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5fa7 expref: 832 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.625098:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000afd5f999/0x3234de053c4e40e lrc: 3/0,0 mode: PR/PR res: [0x2b808:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d412a expref: 832 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.625098:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000689e285e/0x3234de053c4eb85 lrc: 4/0,0 mode: PR/PR res: [0x2b80d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5fa7 expref: 832 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.625102:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997018176:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.625104:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000afd5f999/0x3234de053c4e40e lrc: 0/0,0 mode: --/PR res: [0x2b808:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d412a expref: 832 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.625108:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.625108:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.625109:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e90f6a58/0x3234de053c519d0 lrc: 3/0,1 mode: PW/PW res: [0x2b808:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.625112:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e90f6a58/0x3234de053c519d0 lrc: 4/0,1 mode: PW/PW res: [0x2b808:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.625112:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 0000000070e666f7 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.625118:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.625125:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+831:41279:x1731746396359040:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 34us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.625127:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12517 00000100:00100000:1.0:1651529344.625131:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12518 00000100:00100000:1.0:1651529344.625133:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+830:41278:x1731746396358976:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.625135:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.625136:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000074d971f4/0x3234de053c4f67c lrc: 5/0,0 mode: PR/PR res: [0x2b807:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8cbe expref: 830 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.625137:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009b8db73b pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997017792:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.625140:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000074d971f4/0x3234de053c4f67c lrc: 3/0,0 mode: PR/PR res: [0x2b807:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8cbe expref: 830 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.625144:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c519c9 lrc: 3/0,1 mode: --/PW res: [0x2b807:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.625146:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074d971f4/0x3234de053c4f67c lrc: 0/0,0 mode: --/PR res: [0x2b807:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8cbe expref: 830 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.625149:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.625150:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.625150:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c519c9 lrc: 3/0,1 mode: PW/PW res: [0x2b807:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.625153:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c519c9 lrc: 4/0,1 mode: PW/PW res: [0x2b807:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.625163:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.625168:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+829:41278:x1731746396358976:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 34us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.625170:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12518 00010000:00010000:0.0:1651529344.625183:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c519c9 lrc: 3/0,1 mode: PW/PW res: [0x2b807:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.625187:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c519c9 lrc: 3/0,1 mode: PW/PW res: [0x2b807:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.625190:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c519c9 lrc: 3/0,1 mode: PW/PW res: [0x2b807:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.625193:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c519c9 lrc: 2/0,0 mode: PW/PW res: [0x2b807:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.625197:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e90f6a58/0x3234de053c519d0 lrc: 3/0,1 mode: PW/PW res: [0x2b808:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.625205:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e90f6a58/0x3234de053c519d0 lrc: 3/0,1 mode: PW/PW res: [0x2b808:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.625209:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e90f6a58/0x3234de053c519d0 lrc: 3/0,1 mode: PW/PW res: [0x2b808:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.625212:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e90f6a58/0x3234de053c519d0 lrc: 2/0,0 mode: PW/PW res: [0x2b808:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.625273:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1237:39030:x1731745946478080:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 791us (869us total) trans 12885079791 rc 0/0 00000100:00100000:0.0:1651529344.625273:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1237:39030:x1731745946478016:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 823us (898us total) trans 12885079790 rc 0/0 00000100:00100000:1.0:1651529344.625276:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211736 00000100:00100000:0.0:1651529344.625277:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211735 00010000:00010000:0.0:1651529344.625285:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c519c9 lrc: 2/0,0 mode: PW/PW res: [0x2b807:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.625288:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065c40e6a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.625289:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c519c9 lrc: 2/0,0 mode: PW/PW res: [0x2b807:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.625292:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c519c9 lrc: 3/0,0 mode: PW/PW res: [0x2b807:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.625293:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.625306:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c519c9 lrc: 1/0,0 mode: --/PW res: [0x2b807:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.625309:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c519c9 lrc: 0/0,0 mode: --/PW res: [0x2b807:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.625313:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e90f6a58/0x3234de053c519d0 lrc: 2/0,0 mode: PW/PW res: [0x2b808:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.625316:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e90f6a58 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.625316:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e90f6a58/0x3234de053c519d0 lrc: 2/0,0 mode: PW/PW res: [0x2b808:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.625319:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e90f6a58/0x3234de053c519d0 lrc: 3/0,0 mode: PW/PW res: [0x2b808:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.625322:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e90f6a58/0x3234de053c519d0 lrc: 1/0,0 mode: --/PW res: [0x2b808:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.625325:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e90f6a58/0x3234de053c519d0 lrc: 0/0,0 mode: --/PW res: [0x2b808:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.625332:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946478720 00000100:00100000:0.0:1651529344.625342:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211742 00000100:00100000:0.0:1651529344.625343:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1236:39030:x1731745946478720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.625348:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178190 count 1 00010000:00010000:0.0:1651529344.625352:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c519fa lrc: 3/0,1 mode: --/PW res: [0x2b80e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.625356:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e43f41a0/0x3234de053c4e4a1 lrc: 2/0,0 mode: PR/PR res: [0x2b80e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43ca expref: 828 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.625359:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.625360:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.625360:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c519fa lrc: 4/0,1 mode: --/PW res: [0x2b80e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.625367:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e43f41a0/0x3234de053c4e4a1 lrc: 3/0,0 mode: PR/PR res: [0x2b80e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43ca expref: 828 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.625370:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e43f41a0/0x3234de053c4e4a1 lrc: 4/0,0 mode: PR/PR res: [0x2b80e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43ca expref: 828 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.625374:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009b8db73b pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997018240:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.625388:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e68b7e1f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.625467:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997017920:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.625479:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000be2303ad/0x3234de053c519d7 lrc: 3/0,1 mode: --/PW res: [0x2b809:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.625493:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.625508:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000076d5f96b pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997017984:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.625513:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000079489ed7/0x3234de053c519de lrc: 3/0,1 mode: --/PW res: [0x2b80a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.625513:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.625524:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946478848 00000100:00100000:0.0:1651529344.625524:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997018048:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.625528:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c519e5 lrc: 3/0,1 mode: --/PW res: [0x2b80c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.625534:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946478912 00000100:00100000:1.0:1651529344.625539:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211743 00000100:00100000:1.0:1651529344.625540:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1238:39030:x1731745946478848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.625541:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211744 00002000:00080000:1.0:1651529344.625545:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178191 count 1 00010000:00010000:1.0:1651529344.625549:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a7b079b/0x3234de053c51a01 lrc: 3/0,1 mode: --/PW res: [0x2b80f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.625558:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1238:39029:x1731745946478912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.625559:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c49f73 lrc: 2/0,0 mode: PR/PR res: [0x2b80f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb427 expref: 828 pid: 80281 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.625562:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.625563:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.625564:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a7b079b/0x3234de053c51a01 lrc: 4/0,1 mode: --/PW res: [0x2b80f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.625564:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178192 count 1 00010000:00010000:0.0:1651529344.625568:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c51a08 lrc: 3/0,1 mode: --/PW res: [0x2b810:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.625570:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c49f73 lrc: 3/0,0 mode: PR/PR res: [0x2b80f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb427 expref: 828 pid: 80281 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.625576:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c49f73 lrc: 4/0,0 mode: PR/PR res: [0x2b80f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb427 expref: 828 pid: 80281 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.625580:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000076d5f96b pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997018304:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.625582:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000034c18a1d/0x3234de053c4da28 lrc: 2/0,0 mode: PR/PR res: [0x2b810:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1922 expref: 828 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.625585:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.625586:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.625587:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c51a08 lrc: 4/0,1 mode: --/PW res: [0x2b810:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.625594:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000499d0377 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.625615:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000034c18a1d/0x3234de053c4da28 lrc: 3/0,0 mode: PR/PR res: [0x2b810:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1922 expref: 828 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.625619:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000034c18a1d/0x3234de053c4da28 lrc: 4/0,0 mode: PR/PR res: [0x2b810:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1922 expref: 828 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.625623:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085af61db pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997018368:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.625632:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 000000008dd99533 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.625639:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000006c4043a pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997018112:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.625649:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c519ec lrc: 3/0,1 mode: --/PW res: [0x2b80b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.625658:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997018176:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.625661:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c519f3 lrc: 3/0,1 mode: --/PW res: [0x2b80d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.625675:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009b8db73b pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997018240:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.625677:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c519fa lrc: 3/0,1 mode: --/PW res: [0x2b80e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.625913:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.625933:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.625946:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.625955:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.625962:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396359424 00000100:00100000:0.0:1651529344.625963:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.625968:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cc074488/0x3234de053c4c911 lrc: 4/0,0 mode: PR/PR res: [0x2b809:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd591 expref: 829 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.625968:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.625980:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396359552 00010000:00010000:1.0:1651529344.625983:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000069d9333b/0x3234de053c4ca29 lrc: 4/0,0 mode: PR/PR res: [0x2b80c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda53 expref: 830 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.625987:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396359488 00010000:00010000:1.0:1651529344.625990:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000095fca58f/0x3234de053c4f158 lrc: 4/0,0 mode: PR/PR res: [0x2b80a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7819 expref: 831 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.626001:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396359936 00010000:00010000:1.0:1651529344.626004:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e43f41a0/0x3234de053c4e4a1 lrc: 4/0,0 mode: PR/PR res: [0x2b80e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43ca expref: 832 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.626010:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085af61db pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997018368:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.626014:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396359744 00010000:00010000:0.0:1651529344.626014:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c51a08 lrc: 3/0,1 mode: --/PW res: [0x2b810:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.626017:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006141c28a/0x3234de053c4dcc1 lrc: 4/0,0 mode: PR/PR res: [0x2b80b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d234e expref: 833 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.626021:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396359872 00010000:00010000:1.0:1651529344.626023:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000689e285e/0x3234de053c4eb85 lrc: 4/0,0 mode: PR/PR res: [0x2b80d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5fa7 expref: 834 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.626023:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12519 00000100:00100000:0.0:1651529344.626025:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cd81e40c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+834:41279:x1731746396359424:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.626028:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12520 00010000:00010000:0.0:1651529344.626029:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.626030:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+834:41279:x1731746396359552:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.626033:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.626034:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000069d9333b/0x3234de053c4ca29 lrc: 4/0,0 mode: PR/PR res: [0x2b80c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda53 expref: 834 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.626038:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000069d9333b/0x3234de053c4ca29 lrc: 3/0,0 mode: PR/PR res: [0x2b80c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda53 expref: 834 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.626041:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cc074488/0x3234de053c4c911 lrc: 4/0,0 mode: PR/PR res: [0x2b809:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd591 expref: 834 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.626044:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069d9333b/0x3234de053c4ca29 lrc: 0/0,0 mode: --/PR res: [0x2b80c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda53 expref: 834 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.626047:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.626048:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.626048:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cc074488/0x3234de053c4c911 lrc: 3/0,0 mode: PR/PR res: [0x2b809:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd591 expref: 833 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.626049:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c519e5 lrc: 3/0,1 mode: PW/PW res: [0x2b80c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.626052:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c519e5 lrc: 4/0,1 mode: PW/PW res: [0x2b80c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626054:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc074488/0x3234de053c4c911 lrc: 0/0,0 mode: --/PR res: [0x2b809:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd591 expref: 833 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.626057:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.626058:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.626059:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000be2303ad/0x3234de053c519d7 lrc: 3/0,1 mode: PW/PW res: [0x2b809:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.626062:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.626068:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be2303ad/0x3234de053c519d7 lrc: 4/0,1 mode: PW/PW res: [0x2b809:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.626073:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+832:41279:x1731746396359552:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.626075:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12520 00010000:00010000:0.0:1651529344.626079:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.626080:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12521 00000100:00100000:1.0:1651529344.626082:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+831:41278:x1731746396359488:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.626084:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.626086:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000095fca58f/0x3234de053c4f158 lrc: 4/0,0 mode: PR/PR res: [0x2b80a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7819 expref: 831 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.626086:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cd81e40c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+831:41279:x1731746396359424:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 60us (174us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.626089:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000095fca58f/0x3234de053c4f158 lrc: 3/0,0 mode: PR/PR res: [0x2b80a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7819 expref: 831 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.626089:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12519 00010000:00010000:1.0:1651529344.626094:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095fca58f/0x3234de053c4f158 lrc: 0/0,0 mode: --/PR res: [0x2b80a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7819 expref: 830 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.626098:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.626098:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.626099:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000079489ed7/0x3234de053c519de lrc: 3/0,1 mode: PW/PW res: [0x2b80a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.626099:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12522 00000100:00100000:0.0:1651529344.626101:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+829:41279:x1731746396359936:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.626102:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079489ed7/0x3234de053c519de lrc: 4/0,1 mode: PW/PW res: [0x2b80a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626104:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.626106:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e43f41a0/0x3234de053c4e4a1 lrc: 4/0,0 mode: PR/PR res: [0x2b80e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43ca expref: 829 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.626108:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.626109:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e43f41a0/0x3234de053c4e4a1 lrc: 3/0,0 mode: PR/PR res: [0x2b80e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43ca expref: 829 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.626113:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+829:41278:x1731746396359488:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 31us (167us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.626114:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e43f41a0/0x3234de053c4e4a1 lrc: 0/0,0 mode: --/PR res: [0x2b80e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d43ca expref: 829 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.626116:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12521 00010000:00010000:0.0:1651529344.626118:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.626119:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.626119:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c519fa lrc: 3/0,1 mode: PW/PW res: [0x2b80e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.626120:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12523 00000100:00100000:1.0:1651529344.626121:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+827:41278:x1731746396359744:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.626122:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c519fa lrc: 4/0,1 mode: PW/PW res: [0x2b80e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.626123:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.626124:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006141c28a/0x3234de053c4dcc1 lrc: 4/0,0 mode: PR/PR res: [0x2b80b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d234e expref: 827 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.626128:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006141c28a/0x3234de053c4dcc1 lrc: 3/0,0 mode: PR/PR res: [0x2b80b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d234e expref: 827 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.626128:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.626133:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006141c28a/0x3234de053c4dcc1 lrc: 0/0,0 mode: --/PR res: [0x2b80b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d234e expref: 827 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.626133:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+827:41279:x1731746396359936:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 31us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.626135:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12522 00010000:00010000:1.0:1651529344.626136:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.626137:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.626137:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c519ec lrc: 3/0,1 mode: PW/PW res: [0x2b80b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.626140:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c519ec lrc: 4/0,1 mode: PW/PW res: [0x2b80b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.626140:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12524 00000100:00100000:0.0:1651529344.626141:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+825:41278:x1731746396359872:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.626143:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.626145:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000689e285e/0x3234de053c4eb85 lrc: 4/0,0 mode: PR/PR res: [0x2b80d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5fa7 expref: 825 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.626149:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.626154:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+825:41278:x1731746396359744:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (191us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.626155:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000689e285e/0x3234de053c4eb85 lrc: 3/0,0 mode: PR/PR res: [0x2b80d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5fa7 expref: 825 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.626156:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12523 00010000:00010000:0.0:1651529344.626160:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000689e285e/0x3234de053c4eb85 lrc: 0/0,0 mode: --/PR res: [0x2b80d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5fa7 expref: 824 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.626166:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.626167:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000076d5f96b pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997018304:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.626167:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.626168:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c519f3 lrc: 3/0,1 mode: PW/PW res: [0x2b80d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626170:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c519f3 lrc: 4/0,1 mode: PW/PW res: [0x2b80d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.626171:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002a7b079b/0x3234de053c51a01 lrc: 3/0,1 mode: --/PW res: [0x2b80f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.626176:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000079489ed7/0x3234de053c519de lrc: 3/0,1 mode: PW/PW res: [0x2b80a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626176:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.626179:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079489ed7/0x3234de053c519de lrc: 3/0,1 mode: PW/PW res: [0x2b80a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.626181:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+823:41278:x1731746396359872:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 39us (214us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.626183:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079489ed7/0x3234de053c519de lrc: 3/0,1 mode: PW/PW res: [0x2b80a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.626184:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12524 00010000:00010000:1.0:1651529344.626185:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079489ed7/0x3234de053c519de lrc: 2/0,0 mode: PW/PW res: [0x2b80a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626190:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c519ec lrc: 3/0,1 mode: PW/PW res: [0x2b80b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626199:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c519ec lrc: 3/0,1 mode: PW/PW res: [0x2b80b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626203:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c519ec lrc: 3/0,1 mode: PW/PW res: [0x2b80b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626205:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c519ec lrc: 2/0,0 mode: PW/PW res: [0x2b80b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.626244:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000098d47485 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1240:39030:x1731745946478336:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1460us (1537us total) trans 12885079792 rc 0/0 00000100:00100000:1.0:1651529344.626248:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211738 00000100:00100000:1.0:1651529344.626262:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.626266:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1239:39030:x1731745946478400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1385us (1539us total) trans 12885079793 rc 0/0 00000100:00100000:0.0:1651529344.626276:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211740 00010000:00010000:0.0:1651529344.626283:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079489ed7/0x3234de053c519de lrc: 2/0,0 mode: PW/PW res: [0x2b80a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626287:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000079489ed7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.626288:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079489ed7/0x3234de053c519de lrc: 2/0,0 mode: PW/PW res: [0x2b80a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.626291:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.626291:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079489ed7/0x3234de053c519de lrc: 3/0,0 mode: PW/PW res: [0x2b80a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626295:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079489ed7/0x3234de053c519de lrc: 1/0,0 mode: --/PW res: [0x2b80a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626298:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079489ed7/0x3234de053c519de lrc: 0/0,0 mode: --/PW res: [0x2b80a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626302:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c519ec lrc: 2/0,0 mode: PW/PW res: [0x2b80b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626305:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eaaf5dcd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.626306:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c519ec lrc: 2/0,0 mode: PW/PW res: [0x2b80b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626309:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c519ec lrc: 3/0,0 mode: PW/PW res: [0x2b80b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626312:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c519ec lrc: 1/0,0 mode: --/PW res: [0x2b80b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626317:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c519ec lrc: 0/0,0 mode: --/PW res: [0x2b80b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626322:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c519e5 lrc: 3/0,1 mode: PW/PW res: [0x2b80c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626325:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c519e5 lrc: 3/0,1 mode: PW/PW res: [0x2b80c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626328:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c519e5 lrc: 3/0,1 mode: PW/PW res: [0x2b80c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626331:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c519e5 lrc: 2/0,0 mode: PW/PW res: [0x2b80c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.626362:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396360000 00000100:00100000:0.0:1651529344.626373:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1239:39030:x1731745946478464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1541us (1653us total) trans 12885079794 rc 0/0 00000100:00100000:0.0:1651529344.626376:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211739 00010000:00010000:1.0:1651529344.626378:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c49f73 lrc: 4/0,0 mode: PR/PR res: [0x2b80f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb427 expref: 823 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.626383:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c519e5 lrc: 2/0,0 mode: PW/PW res: [0x2b80c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.626385:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396360064 00010000:00010000:0.0:1651529344.626386:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e6b94407 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.626387:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c519e5 lrc: 2/0,0 mode: PW/PW res: [0x2b80c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.626388:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000034c18a1d/0x3234de053c4da28 lrc: 4/0,0 mode: PR/PR res: [0x2b810:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1922 expref: 824 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.626390:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c519e5 lrc: 3/0,0 mode: PW/PW res: [0x2b80c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.626393:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12525 00000100:00100000:1.0:1651529344.626395:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+824:41278:x1731746396360000:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.626398:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.626399:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c49f73 lrc: 4/0,0 mode: PR/PR res: [0x2b80f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb427 expref: 824 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.626405:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c49f73 lrc: 3/0,0 mode: PR/PR res: [0x2b80f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb427 expref: 824 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.626409:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c519e5 lrc: 1/0,0 mode: --/PW res: [0x2b80c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.626411:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c49f73 lrc: 0/0,0 mode: --/PR res: [0x2b80f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb427 expref: 824 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.626413:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c519e5 lrc: 0/0,0 mode: --/PW res: [0x2b80c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.626414:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.626415:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.626416:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002a7b079b/0x3234de053c51a01 lrc: 3/0,1 mode: PW/PW res: [0x2b80f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.626419:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a7b079b/0x3234de053c51a01 lrc: 4/0,1 mode: PW/PW res: [0x2b80f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626419:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c519f3 lrc: 3/0,1 mode: PW/PW res: [0x2b80d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626422:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c519f3 lrc: 3/0,1 mode: PW/PW res: [0x2b80d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.626425:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.626425:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c519f3 lrc: 3/0,1 mode: PW/PW res: [0x2b80d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626428:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c519f3 lrc: 2/0,0 mode: PW/PW res: [0x2b80d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.626432:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+823:41278:x1731746396360000:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.626434:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12525 00000100:00100000:1.0:1651529344.626438:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12526 00000100:00100000:1.0:1651529344.626440:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a37852a8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+822:41279:x1731746396360064:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.626442:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.626443:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000034c18a1d/0x3234de053c4da28 lrc: 4/0,0 mode: PR/PR res: [0x2b810:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1922 expref: 822 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.626447:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000034c18a1d/0x3234de053c4da28 lrc: 3/0,0 mode: PR/PR res: [0x2b810:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1922 expref: 822 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.626451:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034c18a1d/0x3234de053c4da28 lrc: 0/0,0 mode: --/PR res: [0x2b810:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1922 expref: 822 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.626455:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.626455:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.626456:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c51a08 lrc: 3/0,1 mode: PW/PW res: [0x2b810:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.626459:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c51a08 lrc: 4/0,1 mode: PW/PW res: [0x2b810:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.626464:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1239:39030:x1731745946478528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1399us (1509us total) trans 12885079795 rc 0/0 00010000:00010000:1.0:1651529344.626469:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.626474:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a37852a8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+821:41279:x1731746396360064:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.626474:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211741 00000100:00100000:1.0:1651529344.626477:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12526 00010000:00010000:0.0:1651529344.626481:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c519f3 lrc: 2/0,0 mode: PW/PW res: [0x2b80d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626484:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000073043e99 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.626485:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c519f3 lrc: 2/0,0 mode: PW/PW res: [0x2b80d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.626487:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002a7b079b/0x3234de053c51a01 lrc: 3/0,1 mode: PW/PW res: [0x2b80f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626488:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c519f3 lrc: 3/0,0 mode: PW/PW res: [0x2b80d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.626490:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a7b079b/0x3234de053c51a01 lrc: 3/0,1 mode: PW/PW res: [0x2b80f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626493:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c519f3 lrc: 1/0,0 mode: --/PW res: [0x2b80d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.626494:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a7b079b/0x3234de053c51a01 lrc: 3/0,1 mode: PW/PW res: [0x2b80f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.626496:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a7b079b/0x3234de053c51a01 lrc: 2/0,0 mode: PW/PW res: [0x2b80f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626523:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c519f3 lrc: 0/0,0 mode: --/PW res: [0x2b80d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626528:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a7b079b/0x3234de053c51a01 lrc: 2/0,0 mode: PW/PW res: [0x2b80f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626531:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002a7b079b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.626532:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a7b079b/0x3234de053c51a01 lrc: 2/0,0 mode: PW/PW res: [0x2b80f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626534:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a7b079b/0x3234de053c51a01 lrc: 3/0,0 mode: PW/PW res: [0x2b80f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626538:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a7b079b/0x3234de053c51a01 lrc: 1/0,0 mode: --/PW res: [0x2b80f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.626539:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1239:39030:x1731745946478848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 998us (1046us total) trans 12885079796 rc 0/0 00010000:00010000:0.0:1651529344.626541:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a7b079b/0x3234de053c51a01 lrc: 0/0,0 mode: --/PW res: [0x2b80f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.626542:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211743 00010000:00010000:0.0:1651529344.626548:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c51a08 lrc: 3/0,1 mode: PW/PW res: [0x2b810:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626551:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c51a08 lrc: 3/0,1 mode: PW/PW res: [0x2b810:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626554:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c51a08 lrc: 3/0,1 mode: PW/PW res: [0x2b810:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626556:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c51a08 lrc: 2/0,0 mode: PW/PW res: [0x2b810:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.626577:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.626591:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.626592:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1239:39029:x1731745946478912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1033us (1079us total) trans 12885079797 rc 0/0 00000100:00100000:0.0:1651529344.626595:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211744 00000100:00100000:0.0:1651529344.626608:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946479552 00000100:00100000:0.0:1651529344.626613:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946479488 00000100:00100000:0.0:1651529344.626617:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211745 00000100:00100000:0.0:1651529344.626618:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1240:39029:x1731745946479552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.626623:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178194 count 1 00010000:00010000:0.0:1651529344.626627:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51a0f lrc: 3/0,1 mode: --/PW res: [0x2b812:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626632:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d4205d0e/0x3234de053c4a0c3 lrc: 2/0,0 mode: PR/PR res: [0x2b812:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb887 expref: 820 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.626635:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.626635:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.626636:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51a0f lrc: 4/0,1 mode: --/PW res: [0x2b812:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626643:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d4205d0e/0x3234de053c4a0c3 lrc: 3/0,0 mode: PR/PR res: [0x2b812:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb887 expref: 820 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.626647:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d4205d0e/0x3234de053c4a0c3 lrc: 4/0,0 mode: PR/PR res: [0x2b812:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb887 expref: 820 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.626651:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085af61db pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997018432:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.626654:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211746 00000100:00100000:1.0:1651529344.626661:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1240:39030:x1731745946479488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.626666:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e68b7e1f going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.626672:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178193 count 1 00010000:00010000:0.0:1651529344.626672:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c51a08 lrc: 2/0,0 mode: PW/PW res: [0x2b810:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626675:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5c1b0ba already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.626676:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c51a16 lrc: 3/0,1 mode: --/PW res: [0x2b811:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626676:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c51a08 lrc: 2/0,0 mode: PW/PW res: [0x2b810:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626679:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c51a08 lrc: 3/0,0 mode: PW/PW res: [0x2b810:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.626681:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006306c7ff/0x3234de053c49fd5 lrc: 2/0,0 mode: PR/PR res: [0x2b811:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb569 expref: 820 pid: 80281 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.626684:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.626685:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.626686:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c51a16 lrc: 4/0,1 mode: --/PW res: [0x2b811:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.626692:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006306c7ff/0x3234de053c49fd5 lrc: 3/0,0 mode: PR/PR res: [0x2b811:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb569 expref: 820 pid: 80281 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.626696:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006306c7ff/0x3234de053c49fd5 lrc: 4/0,0 mode: PR/PR res: [0x2b811:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb569 expref: 820 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.626698:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c51a08 lrc: 1/0,0 mode: --/PW res: [0x2b810:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.626700:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ba0b61e6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997018496:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.626701:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c51a08 lrc: 0/0,0 mode: --/PW res: [0x2b810:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.626709:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 000000007d8fabda going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.626710:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000be2303ad/0x3234de053c519d7 lrc: 3/0,1 mode: PW/PW res: [0x2b809:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626715:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be2303ad/0x3234de053c519d7 lrc: 3/0,1 mode: PW/PW res: [0x2b809:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626718:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be2303ad/0x3234de053c519d7 lrc: 3/0,1 mode: PW/PW res: [0x2b809:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626720:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be2303ad/0x3234de053c519d7 lrc: 2/0,0 mode: PW/PW res: [0x2b809:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.626776:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1241:39029:x1731745946478272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 2080us (2116us total) trans 12885079798 rc 0/0 00000100:00100000:0.0:1651529344.626794:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211737 00000100:00100000:1.0:1651529344.626822:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.626841:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.626841:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946479680 00000100:00100000:0.0:1651529344.626848:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211747 00000100:00100000:0.0:1651529344.626850:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1241:39029:x1731745946479680:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.626855:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178196 count 1 00000100:00100000:1.0:1651529344.626856:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.626859:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51a1d lrc: 3/0,1 mode: --/PW res: [0x2b814:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.626863:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.626863:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001112ca05/0x3234de053c4ea43 lrc: 2/0,0 mode: PR/PR res: [0x2b814:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a75 expref: 820 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.626866:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.626867:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.626868:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51a1d lrc: 4/0,1 mode: --/PW res: [0x2b814:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.626869:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946479616 00000100:00100000:1.0:1651529344.626876:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946479808 00010000:00010000:0.0:1651529344.626877:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001112ca05/0x3234de053c4ea43 lrc: 3/0,0 mode: PR/PR res: [0x2b814:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a75 expref: 820 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.626879:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946479744 00010000:00010000:0.0:1651529344.626880:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001112ca05/0x3234de053c4ea43 lrc: 4/0,0 mode: PR/PR res: [0x2b814:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a75 expref: 820 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.626883:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211748 00000100:00100000:1.0:1651529344.626884:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1244:39030:x1731745946479616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.626884:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b0d9532a pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997018560:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.626889:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178195 count 1 00010000:00010000:1.0:1651529344.626893:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000876c3b77/0x3234de053c51a24 lrc: 3/0,1 mode: --/PW res: [0x2b813:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.626899:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 0000000070e666f7 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.626904:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be2303ad/0x3234de053c519d7 lrc: 2/0,0 mode: PW/PW res: [0x2b809:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.626905:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a517f489/0x3234de053c4e8a6 lrc: 2/0,0 mode: PR/PR res: [0x2b813:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5375 expref: 820 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.626907:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000be2303ad already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.626908:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.626908:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be2303ad/0x3234de053c519d7 lrc: 2/0,0 mode: PW/PW res: [0x2b809:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.626909:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.626909:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000876c3b77/0x3234de053c51a24 lrc: 4/0,1 mode: --/PW res: [0x2b813:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626911:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be2303ad/0x3234de053c519d7 lrc: 3/0,0 mode: PW/PW res: [0x2b809:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626915:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be2303ad/0x3234de053c519d7 lrc: 1/0,0 mode: --/PW res: [0x2b809:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.626916:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a517f489/0x3234de053c4e8a6 lrc: 3/0,0 mode: PR/PR res: [0x2b813:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5375 expref: 820 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.626918:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be2303ad/0x3234de053c519d7 lrc: 0/0,0 mode: --/PW res: [0x2b809:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.626919:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a517f489/0x3234de053c4e8a6 lrc: 4/0,0 mode: PR/PR res: [0x2b813:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5375 expref: 820 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.626926:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d6486d55 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997018624:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.626935:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 0000000071742acc going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.626941:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211749 00000100:00100000:1.0:1651529344.626943:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1244:39029:x1731745946479808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.626944:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211750 00000100:00100000:0.0:1651529344.626946:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1244:39030:x1731745946479744:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.626947:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178198 count 1 00010000:00010000:1.0:1651529344.626950:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ba7c8c9/0x3234de053c51a2b lrc: 3/0,1 mode: --/PW res: [0x2b816:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.626951:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178197 count 1 00010000:00010000:1.0:1651529344.626955:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000094e623a3/0x3234de053c4eb70 lrc: 2/0,0 mode: PR/PR res: [0x2b816:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f53 expref: 820 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.626955:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51a32 lrc: 3/0,1 mode: --/PW res: [0x2b815:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.626957:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.626958:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.626959:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ba7c8c9/0x3234de053c51a2b lrc: 4/0,1 mode: --/PW res: [0x2b816:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626959:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000070278b0c/0x3234de053c4d94f lrc: 2/0,0 mode: PR/PR res: [0x2b815:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d15da expref: 820 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.626962:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.626962:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.626963:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51a32 lrc: 4/0,1 mode: --/PW res: [0x2b815:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.626964:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000094e623a3/0x3234de053c4eb70 lrc: 3/0,0 mode: PR/PR res: [0x2b816:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f53 expref: 820 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.626968:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000094e623a3/0x3234de053c4eb70 lrc: 4/0,0 mode: PR/PR res: [0x2b816:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f53 expref: 820 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.626970:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000070278b0c/0x3234de053c4d94f lrc: 3/0,0 mode: PR/PR res: [0x2b815:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d15da expref: 820 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.626971:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000086eaa330 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997018688:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.626973:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000070278b0c/0x3234de053c4d94f lrc: 4/0,0 mode: PR/PR res: [0x2b815:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d15da expref: 820 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.626977:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c3caa148 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.626977:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000054e3a257 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997018752:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.626985:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed830649 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.626992:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.626992:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c519fa lrc: 3/0,1 mode: PW/PW res: [0x2b80e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.626995:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c519fa lrc: 3/0,1 mode: PW/PW res: [0x2b80e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627005:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c519fa lrc: 3/0,1 mode: PW/PW res: [0x2b80e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627011:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c519fa lrc: 2/0,0 mode: PW/PW res: [0x2b80e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.627053:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1245:39030:x1731745946478720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1709us (1760us total) trans 12885079799 rc 0/0 00000100:00100000:0.0:1651529344.627056:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211742 00000100:00100000:0.0:1651529344.627062:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946479872 00000100:00100000:0.0:1651529344.627068:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211751 00000100:00100000:0.0:1651529344.627070:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1245:39030:x1731745946479872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.627089:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178199 count 1 00010000:00010000:0.0:1651529344.627094:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51a39 lrc: 3/0,1 mode: --/PW res: [0x2b817:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627098:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c4c6d3 lrc: 2/0,0 mode: PR/PR res: [0x2b817:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd48 expref: 820 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.627101:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.627102:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.627103:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51a39 lrc: 4/0,1 mode: --/PW res: [0x2b817:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627109:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c4c6d3 lrc: 3/0,0 mode: PR/PR res: [0x2b817:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd48 expref: 820 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.627112:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c4c6d3 lrc: 4/0,0 mode: PR/PR res: [0x2b817:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd48 expref: 820 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.627119:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e5997468 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997018816:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.627147:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e7e12492 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.627153:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c519fa lrc: 2/0,0 mode: PW/PW res: [0x2b80e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627156:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000acc438d7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.627157:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c519fa lrc: 2/0,0 mode: PW/PW res: [0x2b80e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627160:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c519fa lrc: 3/0,0 mode: PW/PW res: [0x2b80e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627164:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c519fa lrc: 1/0,0 mode: --/PW res: [0x2b80e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627167:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c519fa lrc: 0/0,0 mode: --/PW res: [0x2b80e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.627197:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085af61db pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997018432:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.627201:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51a0f lrc: 3/0,1 mode: --/PW res: [0x2b812:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.627203:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.627214:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.627216:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946479936 00000100:00100000:0.0:1651529344.627240:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211752 00000100:00100000:1.0:1651529344.627241:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.627242:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1246:39030:x1731745946479936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.627247:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178200 count 1 00000100:00100000:1.0:1651529344.627250:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ba0b61e6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997018496:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.627251:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51a40 lrc: 3/0,1 mode: --/PW res: [0x2b818:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627255:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c51a16 lrc: 3/0,1 mode: --/PW res: [0x2b811:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627255:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004b04a112/0x3234de053c4db6a lrc: 2/0,0 mode: PR/PR res: [0x2b818:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1dc8 expref: 820 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.627258:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.627259:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.627260:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51a40 lrc: 4/0,1 mode: --/PW res: [0x2b818:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.627261:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396360704 00010000:00010000:1.0:1651529344.627266:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006306c7ff/0x3234de053c49fd5 lrc: 4/0,0 mode: PR/PR res: [0x2b811:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb569 expref: 821 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.627266:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004b04a112/0x3234de053c4db6a lrc: 3/0,0 mode: PR/PR res: [0x2b818:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1dc8 expref: 821 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.627269:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004b04a112/0x3234de053c4db6a lrc: 4/0,0 mode: PR/PR res: [0x2b818:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1dc8 expref: 821 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.627272:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396360512 00000100:00100000:0.0:1651529344.627273:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085af61db pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997018880:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.627275:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d4205d0e/0x3234de053c4a0c3 lrc: 4/0,0 mode: PR/PR res: [0x2b812:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb887 expref: 822 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.627279:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12527 00000100:00100000:1.0:1651529344.627281:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+822:41279:x1731746396360704:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.627284:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.627287:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c086aae3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.627292:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006306c7ff/0x3234de053c49fd5 lrc: 4/0,0 mode: PR/PR res: [0x2b811:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb569 expref: 822 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.627295:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006306c7ff/0x3234de053c49fd5 lrc: 3/0,0 mode: PR/PR res: [0x2b811:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb569 expref: 822 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.627301:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006306c7ff/0x3234de053c49fd5 lrc: 0/0,0 mode: --/PR res: [0x2b811:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb569 expref: 822 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.627307:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.627308:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.627309:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c51a16 lrc: 3/0,1 mode: PW/PW res: [0x2b811:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627312:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c51a16 lrc: 4/0,1 mode: PW/PW res: [0x2b811:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627318:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.627332:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+821:41279:x1731746396360704:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 50us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.627335:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12527 00000100:00100000:1.0:1651529344.627340:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12528 00000100:00100000:1.0:1651529344.627341:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+820:41278:x1731746396360512:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.627344:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.627345:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d4205d0e/0x3234de053c4a0c3 lrc: 4/0,0 mode: PR/PR res: [0x2b812:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb887 expref: 820 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.627349:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d4205d0e/0x3234de053c4a0c3 lrc: 3/0,0 mode: PR/PR res: [0x2b812:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb887 expref: 820 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.627354:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4205d0e/0x3234de053c4a0c3 lrc: 0/0,0 mode: --/PR res: [0x2b812:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb887 expref: 820 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.627357:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.627358:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.627359:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51a0f lrc: 3/0,1 mode: PW/PW res: [0x2b812:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627381:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51a0f lrc: 4/0,1 mode: PW/PW res: [0x2b812:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.627383:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000054e3a257 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997018752:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.627389:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.627393:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51a32 lrc: 3/0,1 mode: --/PW res: [0x2b815:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.627399:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+819:41278:x1731746396360512:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 57us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.627401:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12528 00010000:00010000:0.0:1651529344.627403:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51a0f lrc: 3/0,1 mode: PW/PW res: [0x2b812:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627409:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51a0f lrc: 3/0,1 mode: PW/PW res: [0x2b812:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627412:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51a0f lrc: 3/0,1 mode: PW/PW res: [0x2b812:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627415:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51a0f lrc: 2/0,0 mode: PW/PW res: [0x2b812:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.627416:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d6486d55 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997018624:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.627420:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000876c3b77/0x3234de053c51a24 lrc: 3/0,1 mode: --/PW res: [0x2b813:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.627426:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000086eaa330 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997018688:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.627429:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005ba7c8c9/0x3234de053c51a2b lrc: 3/0,1 mode: --/PW res: [0x2b816:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627434:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c51a16 lrc: 3/0,1 mode: PW/PW res: [0x2b811:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627437:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c51a16 lrc: 3/0,1 mode: PW/PW res: [0x2b811:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627440:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c51a16 lrc: 3/0,1 mode: PW/PW res: [0x2b811:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627445:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c51a16 lrc: 2/0,0 mode: PW/PW res: [0x2b811:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.627462:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1247:39029:x1731745946479552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 843us (885us total) trans 12885079800 rc 0/0 00000100:00100000:0.0:1651529344.627465:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211745 00010000:00010000:0.0:1651529344.627473:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51a0f lrc: 2/0,0 mode: PW/PW res: [0x2b812:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.627488:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1247:39030:x1731745946479488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 826us (897us total) trans 12885079801 rc 0/0 00010000:00010000:0.0:1651529344.627490:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000491b5359 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.627491:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211746 00010000:00010000:0.0:1651529344.627491:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51a0f lrc: 2/0,0 mode: PW/PW res: [0x2b812:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627494:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51a0f lrc: 3/0,0 mode: PW/PW res: [0x2b812:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627499:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51a0f lrc: 1/0,0 mode: --/PW res: [0x2b812:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627502:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51a0f lrc: 0/0,0 mode: --/PW res: [0x2b812:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627506:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c51a16 lrc: 2/0,0 mode: PW/PW res: [0x2b811:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627509:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000b62c3c9 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.627510:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c51a16 lrc: 2/0,0 mode: PW/PW res: [0x2b811:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627513:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c51a16 lrc: 3/0,0 mode: PW/PW res: [0x2b811:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627516:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c51a16 lrc: 1/0,0 mode: --/PW res: [0x2b811:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627518:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b62c3c9/0x3234de053c51a16 lrc: 0/0,0 mode: --/PW res: [0x2b811:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.627529:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b0d9532a pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997018560:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.627532:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51a1d lrc: 3/0,1 mode: --/PW res: [0x2b814:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.627596:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.627602:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.627612:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396360768 00000100:00100000:0.0:1651529344.627612:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.627622:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a517f489/0x3234de053c4e8a6 lrc: 4/0,0 mode: PR/PR res: [0x2b813:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5375 expref: 819 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.627623:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e5997468 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997018816:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.627630:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396360896 00010000:00010000:1.0:1651529344.627632:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000094e623a3/0x3234de053c4eb70 lrc: 4/0,0 mode: PR/PR res: [0x2b816:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f53 expref: 820 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.627641:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396360832 00010000:00010000:0.0:1651529344.627642:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51a39 lrc: 3/0,1 mode: --/PW res: [0x2b817:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627644:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001112ca05/0x3234de053c4ea43 lrc: 4/0,0 mode: PR/PR res: [0x2b814:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a75 expref: 821 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.627649:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12529 00000100:00100000:1.0:1651529344.627651:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+821:41278:x1731746396360768:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.627654:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.627655:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a517f489/0x3234de053c4e8a6 lrc: 4/0,0 mode: PR/PR res: [0x2b813:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5375 expref: 821 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.627659:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a517f489/0x3234de053c4e8a6 lrc: 3/0,0 mode: PR/PR res: [0x2b813:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5375 expref: 821 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.627665:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a517f489/0x3234de053c4e8a6 lrc: 0/0,0 mode: --/PR res: [0x2b813:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5375 expref: 821 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.627669:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.627669:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.627670:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000876c3b77/0x3234de053c51a24 lrc: 3/0,1 mode: PW/PW res: [0x2b813:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.627671:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12530 00010000:00010000:1.0:1651529344.627681:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000876c3b77/0x3234de053c51a24 lrc: 4/0,1 mode: PW/PW res: [0x2b813:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.627685:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+820:41278:x1731746396360896:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.627687:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.627690:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.627692:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000094e623a3/0x3234de053c4eb70 lrc: 4/0,0 mode: PR/PR res: [0x2b816:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f53 expref: 820 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.627694:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+820:41278:x1731746396360768:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 43us (99us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.627696:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000094e623a3/0x3234de053c4eb70 lrc: 3/0,0 mode: PR/PR res: [0x2b816:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f53 expref: 820 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.627697:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12529 00000100:00100000:1.0:1651529344.627702:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12531 00010000:00010000:0.0:1651529344.627702:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094e623a3/0x3234de053c4eb70 lrc: 0/0,0 mode: --/PR res: [0x2b816:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f53 expref: 819 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.627704:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+819:41279:x1731746396360832:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.627706:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.627706:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.627706:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.627707:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005ba7c8c9/0x3234de053c51a2b lrc: 3/0,1 mode: PW/PW res: [0x2b816:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627708:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001112ca05/0x3234de053c4ea43 lrc: 4/0,0 mode: PR/PR res: [0x2b814:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a75 expref: 818 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.627710:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ba7c8c9/0x3234de053c51a2b lrc: 4/0,1 mode: PW/PW res: [0x2b816:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627711:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001112ca05/0x3234de053c4ea43 lrc: 3/0,0 mode: PR/PR res: [0x2b814:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a75 expref: 818 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.627716:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001112ca05/0x3234de053c4ea43 lrc: 0/0,0 mode: --/PR res: [0x2b814:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a75 expref: 818 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.627720:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.627728:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+818:41278:x1731746396360896:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 54us (126us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.627730:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.627730:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.627731:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51a1d lrc: 3/0,1 mode: PW/PW res: [0x2b814:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.627731:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12530 00010000:00010000:1.0:1651529344.627743:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51a1d lrc: 4/0,1 mode: PW/PW res: [0x2b814:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627752:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.627759:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+816:41279:x1731746396360832:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 55us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.627762:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12531 00000100:00100000:0.0:1651529344.627762:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.627767:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396361024 00010000:00010000:1.0:1651529344.627770:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c4c6d3 lrc: 4/0,0 mode: PR/PR res: [0x2b817:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd48 expref: 816 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.627775:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12532 00000100:00100000:0.0:1651529344.627776:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.627777:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+816:41278:x1731746396361024:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.627779:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.627780:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c4c6d3 lrc: 4/0,0 mode: PR/PR res: [0x2b817:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd48 expref: 816 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.627790:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c4c6d3 lrc: 3/0,0 mode: PR/PR res: [0x2b817:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd48 expref: 816 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.627791:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.627795:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c4c6d3 lrc: 0/0,0 mode: --/PR res: [0x2b817:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd48 expref: 816 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.627799:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.627800:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.627801:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51a39 lrc: 3/0,1 mode: PW/PW res: [0x2b817:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627803:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51a39 lrc: 4/0,1 mode: PW/PW res: [0x2b817:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.627811:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.627820:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.627826:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+815:41278:x1731746396361024:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 49us (64us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.627829:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12532 00000100:00100000:1.0:1651529344.627833:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396360960 00010000:00010000:1.0:1651529344.627836:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000070278b0c/0x3234de053c4d94f lrc: 4/0,0 mode: PR/PR res: [0x2b815:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d15da expref: 815 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.627841:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12533 00000100:00100000:0.0:1651529344.627847:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.627850:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001e35645b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+815:41279:x1731746396360960:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.627853:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.627854:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000070278b0c/0x3234de053c4d94f lrc: 4/0,0 mode: PR/PR res: [0x2b815:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d15da expref: 815 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.627854:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946480000 00010000:00010000:1.0:1651529344.627858:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000070278b0c/0x3234de053c4d94f lrc: 3/0,0 mode: PR/PR res: [0x2b815:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d15da expref: 815 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.627863:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946480064 00010000:00010000:1.0:1651529344.627868:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070278b0c/0x3234de053c4d94f lrc: 0/0,0 mode: --/PR res: [0x2b815:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d15da expref: 815 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.627868:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211753 00000100:00100000:0.0:1651529344.627870:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1248:39030:x1731745946480000:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.627872:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.627873:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.627873:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51a32 lrc: 3/0,1 mode: PW/PW res: [0x2b815:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.627875:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178201 count 1 00010000:00010000:1.0:1651529344.627876:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51a32 lrc: 4/0,1 mode: PW/PW res: [0x2b815:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627879:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51a47 lrc: 3/0,1 mode: --/PW res: [0x2b819:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627885:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.627890:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ecea9d9b/0x3234de053c4ceb3 lrc: 2/0,0 mode: PR/PR res: [0x2b819:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cecba expref: 814 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.627894:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001e35645b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+814:41279:x1731746396360960:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 50us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.627897:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12533 00000100:00100000:1.0:1651529344.627905:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396361088 00010000:00010000:1.0:1651529344.627909:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004b04a112/0x3234de053c4db6a lrc: 5/0,0 mode: PR/PR res: [0x2b818:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1dc8 expref: 814 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.627911:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.627912:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.627913:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51a47 lrc: 4/0,1 mode: --/PW res: [0x2b819:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.627914:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12534 00000100:00100000:1.0:1651529344.627915:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+814:41278:x1731746396361088:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.627918:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.627919:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004b04a112/0x3234de053c4db6a lrc: 5/0,0 mode: PR/PR res: [0x2b818:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1dc8 expref: 814 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.627921:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ecea9d9b/0x3234de053c4ceb3 lrc: 3/0,0 mode: PR/PR res: [0x2b819:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cecba expref: 814 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.627922:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004b04a112/0x3234de053c4db6a lrc: 4/0,0 mode: PR/PR res: [0x2b818:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1dc8 expref: 814 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.627925:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ecea9d9b/0x3234de053c4ceb3 lrc: 4/0,0 mode: PR/PR res: [0x2b819:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cecba expref: 814 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.627927:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.627928:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.627929:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51a40 lrc: 3/0,1 mode: PW/PW res: [0x2b818:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.627929:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000edfe60d3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997018944:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.627932:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51a40 lrc: 4/0,1 mode: PW/PW res: [0x2b818:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627936:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.627938:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000abca413e going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.627941:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+814:41278:x1731746396361088:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 25us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.627943:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12534 00000100:00100000:0.0:1651529344.627945:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211754 00000100:00100000:0.0:1651529344.627947:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1248:39029:x1731745946480064:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.627950:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000876c3b77/0x3234de053c51a24 lrc: 3/0,1 mode: PW/PW res: [0x2b813:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.627951:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178202 count 1 00010000:00010000:1.0:1651529344.627953:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000876c3b77/0x3234de053c51a24 lrc: 3/0,1 mode: PW/PW res: [0x2b813:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627955:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51a4e lrc: 3/0,1 mode: --/PW res: [0x2b81a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627956:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000876c3b77/0x3234de053c51a24 lrc: 3/0,1 mode: PW/PW res: [0x2b813:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.627959:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000876c3b77/0x3234de053c51a24 lrc: 2/0,0 mode: PW/PW res: [0x2b813:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627959:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000398396e1/0x3234de053c4e56c lrc: 2/0,0 mode: PR/PR res: [0x2b81a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d46d3 expref: 813 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.627962:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.627963:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.627963:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51a4e lrc: 4/0,1 mode: --/PW res: [0x2b81a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627977:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000398396e1/0x3234de053c4e56c lrc: 3/0,0 mode: PR/PR res: [0x2b81a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d46d3 expref: 813 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.627981:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000398396e1/0x3234de053c4e56c lrc: 4/0,0 mode: PR/PR res: [0x2b81a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d46d3 expref: 813 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.627984:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000de0edbdc pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997019008:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.627991:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed830649 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.627996:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000876c3b77/0x3234de053c51a24 lrc: 2/0,0 mode: PW/PW res: [0x2b813:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.627999:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000876c3b77 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.628000:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000876c3b77/0x3234de053c51a24 lrc: 2/0,0 mode: PW/PW res: [0x2b813:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.628001:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1249:39030:x1731745946479616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1115us (1159us total) trans 12885079802 rc 0/0 00000100:00100000:1.0:1651529344.628003:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211748 00010000:00010000:0.0:1651529344.628005:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000876c3b77/0x3234de053c51a24 lrc: 3/0,0 mode: PW/PW res: [0x2b813:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.628010:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005ba7c8c9/0x3234de053c51a2b lrc: 3/0,1 mode: PW/PW res: [0x2b816:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628010:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000876c3b77/0x3234de053c51a24 lrc: 1/0,0 mode: --/PW res: [0x2b813:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628013:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000876c3b77/0x3234de053c51a24 lrc: 0/0,0 mode: --/PW res: [0x2b813:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.628016:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ba7c8c9/0x3234de053c51a2b lrc: 3/0,1 mode: PW/PW res: [0x2b816:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628018:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51a32 lrc: 3/0,1 mode: PW/PW res: [0x2b815:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.628019:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ba7c8c9/0x3234de053c51a2b lrc: 3/0,1 mode: PW/PW res: [0x2b816:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.628021:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ba7c8c9/0x3234de053c51a2b lrc: 2/0,0 mode: PW/PW res: [0x2b816:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628021:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51a32 lrc: 3/0,1 mode: PW/PW res: [0x2b815:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628024:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51a32 lrc: 3/0,1 mode: PW/PW res: [0x2b815:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628027:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51a32 lrc: 2/0,0 mode: PW/PW res: [0x2b815:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.628057:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1250:39029:x1731745946479808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1114us (1201us total) trans 12885079803 rc 0/0 00000100:00100000:1.0:1651529344.628060:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211749 00000100:00100000:0.0:1651529344.628073:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1249:39030:x1731745946479744:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1127us (1210us total) trans 12885079804 rc 0/0 00000100:00100000:0.0:1651529344.628076:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211750 00010000:00010000:0.0:1651529344.628084:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ba7c8c9/0x3234de053c51a2b lrc: 2/0,0 mode: PW/PW res: [0x2b816:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628090:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005ba7c8c9 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.628091:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ba7c8c9/0x3234de053c51a2b lrc: 2/0,0 mode: PW/PW res: [0x2b816:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628094:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ba7c8c9/0x3234de053c51a2b lrc: 3/0,0 mode: PW/PW res: [0x2b816:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628098:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ba7c8c9/0x3234de053c51a2b lrc: 1/0,0 mode: --/PW res: [0x2b816:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628101:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ba7c8c9/0x3234de053c51a2b lrc: 0/0,0 mode: --/PW res: [0x2b816:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628105:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51a32 lrc: 2/0,0 mode: PW/PW res: [0x2b815:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628108:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000495c20c9 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.628108:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51a32 lrc: 2/0,0 mode: PW/PW res: [0x2b815:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628111:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51a32 lrc: 3/0,0 mode: PW/PW res: [0x2b815:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628114:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51a32 lrc: 1/0,0 mode: --/PW res: [0x2b815:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628117:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51a32 lrc: 0/0,0 mode: --/PW res: [0x2b815:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628126:0:151609:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b04a112/0x3234de053c4db6a lrc: 0/0,0 mode: --/PR res: [0x2b818:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1dc8 expref: 813 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.628130:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085af61db pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997018880:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.628133:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51a40 lrc: 3/0,1 mode: PW/PW res: [0x2b818:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628136:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51a40 lrc: 3/0,1 mode: PW/PW res: [0x2b818:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628139:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51a40 lrc: 3/0,1 mode: PW/PW res: [0x2b818:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628142:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51a40 lrc: 3/0,1 mode: PW/PW res: [0x2b818:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628145:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51a40 lrc: 2/0,0 mode: PW/PW res: [0x2b818:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.628209:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1249:39030:x1731745946479936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 966us (1006us total) trans 12885079805 rc 0/0 00000100:00100000:0.0:1651529344.628212:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211752 00010000:00010000:0.0:1651529344.628219:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51a40 lrc: 2/0,0 mode: PW/PW res: [0x2b818:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628244:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c8d9712a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.628245:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51a40 lrc: 2/0,0 mode: PW/PW res: [0x2b818:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628248:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51a40 lrc: 3/0,0 mode: PW/PW res: [0x2b818:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628252:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51a40 lrc: 1/0,0 mode: --/PW res: [0x2b818:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628255:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51a40 lrc: 0/0,0 mode: --/PW res: [0x2b818:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628266:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51a1d lrc: 3/0,1 mode: PW/PW res: [0x2b814:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628269:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51a1d lrc: 3/0,1 mode: PW/PW res: [0x2b814:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628272:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51a1d lrc: 3/0,1 mode: PW/PW res: [0x2b814:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628275:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51a1d lrc: 2/0,0 mode: PW/PW res: [0x2b814:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.628315:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1249:39029:x1731745946479680:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1464us (1494us total) trans 12885079806 rc 0/0 00000100:00100000:0.0:1651529344.628319:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211747 00010000:00010000:0.0:1651529344.628345:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51a1d lrc: 2/0,0 mode: PW/PW res: [0x2b814:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628349:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088cc87df already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.628350:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51a1d lrc: 2/0,0 mode: PW/PW res: [0x2b814:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628353:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51a1d lrc: 3/0,0 mode: PW/PW res: [0x2b814:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.628363:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.628373:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51a1d lrc: 1/0,0 mode: --/PW res: [0x2b814:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.628375:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.628376:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51a1d lrc: 0/0,0 mode: --/PW res: [0x2b814:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.628382:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.628391:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.628398:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946480704 00000100:00100000:0.0:1651529344.628408:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946480768 00000100:00100000:1.0:1651529344.628410:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946480640 00000100:00100000:1.0:1651529344.628413:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946480832 00000100:00100000:0.0:1651529344.628418:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211755 00000100:00100000:0.0:1651529344.628419:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1252:39029:x1731745946480704:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.628422:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211756 00000100:00100000:1.0:1651529344.628424:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1252:39029:x1731745946480640:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.628425:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178204 count 1 00010000:00010000:0.0:1651529344.628428:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c51a55 lrc: 3/0,1 mode: --/PW res: [0x2b81c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.628429:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178203 count 1 00010000:00010000:0.0:1651529344.628433:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d2dc5f9b/0x3234de053c4e3dd lrc: 2/0,0 mode: PR/PR res: [0x2b81c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d406d expref: 812 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.628434:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c51a5c lrc: 3/0,1 mode: --/PW res: [0x2b81b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628438:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.628439:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001ff758be/0x3234de053c4df68 lrc: 2/0,0 mode: PR/PR res: [0x2b81b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ec3 expref: 812 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.628439:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.628440:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c51a55 lrc: 4/0,1 mode: --/PW res: [0x2b81c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.628442:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.628443:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.628444:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c51a5c lrc: 4/0,1 mode: --/PW res: [0x2b81b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628446:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d2dc5f9b/0x3234de053c4e3dd lrc: 3/0,0 mode: PR/PR res: [0x2b81c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d406d expref: 812 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.628450:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d2dc5f9b/0x3234de053c4e3dd lrc: 4/0,0 mode: PR/PR res: [0x2b81c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d406d expref: 812 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.628451:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001ff758be/0x3234de053c4df68 lrc: 3/0,0 mode: PR/PR res: [0x2b81b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ec3 expref: 812 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.628454:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001ff758be/0x3234de053c4df68 lrc: 4/0,0 mode: PR/PR res: [0x2b81b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ec3 expref: 812 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.628458:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d9ef3c1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997019136:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.628467:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c3caa148 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.628474:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211757 00000100:00100000:1.0:1651529344.628475:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1252:39030:x1731745946480768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.628479:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085af61db pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997019072:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.628489:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178205 count 1 00000100:00100000:0.0:1651529344.628489:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e68b7e1f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.628493:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b54a65c7/0x3234de053c51a63 lrc: 3/0,1 mode: --/PW res: [0x2b81d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.628496:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211758 00010000:00010000:1.0:1651529344.628498:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004c6fa7d3/0x3234de053c4e6d1 lrc: 2/0,0 mode: PR/PR res: [0x2b81d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c0c expref: 812 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.628498:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1252:39030:x1731745946480832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.628501:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.628501:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.628502:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b54a65c7/0x3234de053c51a63 lrc: 4/0,1 mode: --/PW res: [0x2b81d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.628503:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178206 count 1 00010000:00010000:0.0:1651529344.628507:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c51a6a lrc: 3/0,1 mode: --/PW res: [0x2b81e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.628510:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004c6fa7d3/0x3234de053c4e6d1 lrc: 3/0,0 mode: PR/PR res: [0x2b81d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c0c expref: 812 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.628511:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000165272de/0x3234de053c4f2c4 lrc: 2/0,0 mode: PR/PR res: [0x2b81e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7df3 expref: 812 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.628514:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004c6fa7d3/0x3234de053c4e6d1 lrc: 4/0,0 mode: PR/PR res: [0x2b81d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c0c expref: 812 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.628514:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.628515:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.628515:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c51a6a lrc: 4/0,1 mode: --/PW res: [0x2b81e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.628518:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006e255cae pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997019200:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.628524:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000165272de/0x3234de053c4f2c4 lrc: 3/0,0 mode: PR/PR res: [0x2b81e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7df3 expref: 812 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.628525:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 000000007d8fabda going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.628528:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000165272de/0x3234de053c4f2c4 lrc: 4/0,0 mode: PR/PR res: [0x2b81e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7df3 expref: 812 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.628532:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b0d9532a pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997019264:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.628538:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c086aae3 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.628544:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51a39 lrc: 3/0,1 mode: PW/PW res: [0x2b817:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628547:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51a39 lrc: 3/0,1 mode: PW/PW res: [0x2b817:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628550:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51a39 lrc: 3/0,1 mode: PW/PW res: [0x2b817:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628552:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51a39 lrc: 2/0,0 mode: PW/PW res: [0x2b817:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.628576:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.628609:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1253:39030:x1731745946479872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1538us (1617us total) trans 12885079807 rc 0/0 00000100:00100000:0.0:1651529344.628612:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211751 00000100:00100000:0.0:1651529344.628617:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946480896 00000100:00100000:1.0:1651529344.628618:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.628627:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211759 00000100:00100000:0.0:1651529344.628629:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1253:39030:x1731745946480896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.628634:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178207 count 1 00010000:00010000:0.0:1651529344.628638:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c51a71 lrc: 3/0,1 mode: --/PW res: [0x2b81f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628642:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009c583e70/0x3234de053c4cbbf lrc: 2/0,0 mode: PR/PR res: [0x2b81f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce0b2 expref: 812 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.628645:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.628646:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.628647:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c51a71 lrc: 4/0,1 mode: --/PW res: [0x2b81f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.628652:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.628653:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009c583e70/0x3234de053c4cbbf lrc: 3/0,0 mode: PR/PR res: [0x2b81f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce0b2 expref: 812 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.628656:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009c583e70/0x3234de053c4cbbf lrc: 4/0,0 mode: PR/PR res: [0x2b81f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce0b2 expref: 812 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.628660:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396361152 00000100:00100000:0.0:1651529344.628660:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000054e3a257 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997019328:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.628665:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ecea9d9b/0x3234de053c4ceb3 lrc: 5/0,0 mode: PR/PR res: [0x2b819:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cecba expref: 813 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.628673:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 0000000049203969 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.628677:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396361216 00010000:00010000:0.0:1651529344.628679:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51a39 lrc: 2/0,0 mode: PW/PW res: [0x2b817:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.628680:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000398396e1/0x3234de053c4e56c lrc: 5/0,0 mode: PR/PR res: [0x2b81a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d46d3 expref: 814 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.628682:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000037fb8315 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.628683:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51a39 lrc: 2/0,0 mode: PW/PW res: [0x2b817:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.628686:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12535 00010000:00010000:0.0:1651529344.628686:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51a39 lrc: 3/0,0 mode: PW/PW res: [0x2b817:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.628687:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+814:41278:x1731746396361152:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.628690:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.628691:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51a39 lrc: 1/0,0 mode: --/PW res: [0x2b817:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.628692:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ecea9d9b/0x3234de053c4ceb3 lrc: 5/0,0 mode: PR/PR res: [0x2b819:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cecba expref: 814 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.628694:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51a39 lrc: 0/0,0 mode: --/PW res: [0x2b817:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.628698:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ecea9d9b/0x3234de053c4ceb3 lrc: 4/0,0 mode: PR/PR res: [0x2b819:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cecba expref: 814 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.628703:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000de0edbdc pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997019008:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.628704:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.628705:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.628705:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51a47 lrc: 3/0,1 mode: PW/PW res: [0x2b819:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628706:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51a4e lrc: 3/0,1 mode: --/PW res: [0x2b81a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.628708:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51a47 lrc: 4/0,1 mode: PW/PW res: [0x2b819:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628712:0:106695:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ecea9d9b/0x3234de053c4ceb3 lrc: 0/0,0 mode: --/PR res: [0x2b819:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cecba expref: 814 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.628713:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.628716:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000edfe60d3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997018944:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.628718:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51a47 lrc: 3/0,1 mode: PW/PW res: [0x2b819:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.628720:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+813:41278:x1731746396361152:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 32us (103us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.628721:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51a47 lrc: 3/0,1 mode: PW/PW res: [0x2b819:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.628723:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12535 00010000:00010000:0.0:1651529344.628724:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51a47 lrc: 3/0,1 mode: PW/PW res: [0x2b819:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628726:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51a47 lrc: 3/0,1 mode: PW/PW res: [0x2b819:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.628727:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12536 00000100:00100000:1.0:1651529344.628728:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+812:41279:x1731746396361216:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.628731:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.628731:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51a47 lrc: 2/0,0 mode: PW/PW res: [0x2b819:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.628732:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000398396e1/0x3234de053c4e56c lrc: 4/0,0 mode: PR/PR res: [0x2b81a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d46d3 expref: 812 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.628746:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000398396e1/0x3234de053c4e56c lrc: 3/0,0 mode: PR/PR res: [0x2b81a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d46d3 expref: 812 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.628751:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000398396e1/0x3234de053c4e56c lrc: 0/0,0 mode: --/PR res: [0x2b81a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d46d3 expref: 812 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.628758:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.628758:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.628759:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51a4e lrc: 3/0,1 mode: PW/PW res: [0x2b81a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.628762:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51a4e lrc: 4/0,1 mode: PW/PW res: [0x2b81a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.628771:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.628776:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+811:41279:x1731746396361216:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 47us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.628779:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12536 00000100:00100000:1.0:1651529344.628796:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.628815:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1254:39030:x1731745946480000:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 944us (1038us total) trans 12885079808 rc 0/0 00000100:00100000:0.0:1651529344.628818:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211753 00000100:00100000:0.0:1651529344.628823:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946480960 00000100:00100000:0.0:1651529344.628834:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211760 00000100:00100000:0.0:1651529344.628835:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1254:39030:x1731745946480960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.628840:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178208 count 1 00010000:00010000:0.0:1651529344.628844:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c51a78 lrc: 3/0,1 mode: --/PW res: [0x2b820:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628849:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fae8c1d4/0x3234de053c4e4c4 lrc: 2/0,0 mode: PR/PR res: [0x2b820:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d445d expref: 810 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.628852:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.628853:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.628853:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c51a78 lrc: 4/0,1 mode: --/PW res: [0x2b820:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628860:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fae8c1d4/0x3234de053c4e4c4 lrc: 3/0,0 mode: PR/PR res: [0x2b820:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d445d expref: 810 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.628863:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fae8c1d4/0x3234de053c4e4c4 lrc: 4/0,0 mode: PR/PR res: [0x2b820:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d445d expref: 810 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.628870:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000edfe60d3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997019392:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.628900:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000abca413e going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.628906:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51a47 lrc: 2/0,0 mode: PW/PW res: [0x2b819:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628909:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000046d6c242 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.628910:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51a47 lrc: 2/0,0 mode: PW/PW res: [0x2b819:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628913:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51a47 lrc: 3/0,0 mode: PW/PW res: [0x2b819:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628917:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51a47 lrc: 1/0,0 mode: --/PW res: [0x2b819:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628920:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51a47 lrc: 0/0,0 mode: --/PW res: [0x2b819:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628926:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51a4e lrc: 3/0,1 mode: PW/PW res: [0x2b81a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.628939:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d9ef3c1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997019136:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.628949:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c51a5c lrc: 3/0,1 mode: --/PW res: [0x2b81b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628951:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51a4e lrc: 3/0,1 mode: PW/PW res: [0x2b81a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628955:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51a4e lrc: 3/0,1 mode: PW/PW res: [0x2b81a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.628960:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51a4e lrc: 2/0,0 mode: PW/PW res: [0x2b81a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.628963:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.628988:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946481024 00000100:00100000:1.0:1651529344.628995:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211761 00000100:00100000:1.0:1651529344.629002:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1255:39030:x1731745946481024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.629007:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178209 count 1 00010000:00010000:1.0:1651529344.629011:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077f05843/0x3234de053c51a7f lrc: 3/0,1 mode: --/PW res: [0x2b821:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.629016:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000949f4f7f/0x3234de053c4d987 lrc: 2/0,0 mode: PR/PR res: [0x2b821:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1690 expref: 810 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.629019:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.629020:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.629020:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077f05843/0x3234de053c51a7f lrc: 4/0,1 mode: --/PW res: [0x2b821:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.629027:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000949f4f7f/0x3234de053c4d987 lrc: 3/0,0 mode: PR/PR res: [0x2b821:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1690 expref: 810 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.629029:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1256:39029:x1731745946480064:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1081us (1217us total) trans 12885079809 rc 0/0 00010000:00010000:1.0:1651529344.629030:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000949f4f7f/0x3234de053c4d987 lrc: 4/0,0 mode: PR/PR res: [0x2b821:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1690 expref: 810 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.629032:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211754 00000100:00100000:1.0:1651529344.629034:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000027c41311 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997019456:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.629039:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51a4e lrc: 2/0,0 mode: PW/PW res: [0x2b81a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629042:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000093dbd0d already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.629043:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8a0b704 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.629043:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51a4e lrc: 2/0,0 mode: PW/PW res: [0x2b81a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629046:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51a4e lrc: 3/0,0 mode: PW/PW res: [0x2b81a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.629050:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006e255cae pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997019200:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.629050:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51a4e lrc: 1/0,0 mode: --/PW res: [0x2b81a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.629053:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b54a65c7/0x3234de053c51a63 lrc: 3/0,1 mode: --/PW res: [0x2b81d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629053:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51a4e lrc: 0/0,0 mode: --/PW res: [0x2b81a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.629062:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085af61db pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997019072:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.629066:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c51a55 lrc: 3/0,1 mode: --/PW res: [0x2b81c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.629075:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b0d9532a pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997019264:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.629077:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c51a6a lrc: 3/0,1 mode: --/PW res: [0x2b81e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.629092:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000054e3a257 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997019328:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.629095:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c51a71 lrc: 3/0,1 mode: --/PW res: [0x2b81f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.629171:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.629178:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.629196:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396361856 00010000:00010000:1.0:1651529344.629202:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d2dc5f9b/0x3234de053c4e3dd lrc: 4/0,0 mode: PR/PR res: [0x2b81c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d406d expref: 811 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.629210:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396361984 00000100:00100000:0.0:1651529344.629212:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.629233:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000165272de/0x3234de053c4f2c4 lrc: 4/0,0 mode: PR/PR res: [0x2b81e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7df3 expref: 812 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.629239:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396362112 00010000:00010000:1.0:1651529344.629247:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fae8c1d4/0x3234de053c4e4c4 lrc: 5/0,0 mode: PR/PR res: [0x2b820:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d445d expref: 813 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.629257:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12537 00000100:00100000:1.0:1651529344.629259:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+813:41279:x1731746396361856:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.629261:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.629262:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.629263:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d2dc5f9b/0x3234de053c4e3dd lrc: 4/0,0 mode: PR/PR res: [0x2b81c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d406d expref: 813 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.629267:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d2dc5f9b/0x3234de053c4e3dd lrc: 3/0,0 mode: PR/PR res: [0x2b81c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d406d expref: 813 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.629271:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.629273:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2dc5f9b/0x3234de053c4e3dd lrc: 0/0,0 mode: --/PR res: [0x2b81c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d406d expref: 813 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.629276:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.629277:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.629278:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c51a55 lrc: 3/0,1 mode: PW/PW res: [0x2b81c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.629278:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.629281:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c51a55 lrc: 4/0,1 mode: PW/PW res: [0x2b81c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.629283:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.629290:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.629301:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c51a55 lrc: 3/0,1 mode: PW/PW res: [0x2b81c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.629306:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+812:41279:x1731746396361856:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 47us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.629309:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12537 00010000:00010000:0.0:1651529344.629310:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c51a55 lrc: 3/0,1 mode: PW/PW res: [0x2b81c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.629314:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396361792 00010000:00010000:1.0:1651529344.629317:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001ff758be/0x3234de053c4df68 lrc: 4/0,0 mode: PR/PR res: [0x2b81b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ec3 expref: 812 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.629322:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396361920 00010000:00010000:0.0:1651529344.629323:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c51a55 lrc: 3/0,1 mode: PW/PW res: [0x2b81c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.629324:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004c6fa7d3/0x3234de053c4e6d1 lrc: 4/0,0 mode: PR/PR res: [0x2b81d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c0c expref: 813 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.629326:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c51a55 lrc: 2/0,0 mode: PW/PW res: [0x2b81c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.629328:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396362048 00010000:00010000:1.0:1651529344.629330:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009c583e70/0x3234de053c4cbbf lrc: 4/0,0 mode: PR/PR res: [0x2b81f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce0b2 expref: 814 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.629334:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12538 00000100:00100000:1.0:1651529344.629336:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+814:41279:x1731746396361984:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.629338:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.629339:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000165272de/0x3234de053c4f2c4 lrc: 4/0,0 mode: PR/PR res: [0x2b81e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7df3 expref: 814 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.629342:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000165272de/0x3234de053c4f2c4 lrc: 3/0,0 mode: PR/PR res: [0x2b81e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7df3 expref: 814 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.629347:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000165272de/0x3234de053c4f2c4 lrc: 0/0,0 mode: --/PR res: [0x2b81e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7df3 expref: 814 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.629351:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.629352:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.629352:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c51a6a lrc: 3/0,1 mode: PW/PW res: [0x2b81e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.629358:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c51a6a lrc: 4/0,1 mode: PW/PW res: [0x2b81e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.629366:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.629372:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+813:41279:x1731746396361984:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 36us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.629373:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1256:39029:x1731745946480704:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 952us (1010us total) trans 12885079810 rc 0/0 00000100:00100000:1.0:1651529344.629374:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12538 00000100:00100000:0.0:1651529344.629376:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211755 00000100:00100000:1.0:1651529344.629379:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12539 00000100:00100000:1.0:1651529344.629380:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085af61db pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+812:41279:x1731746396362112:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.629381:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946481152 00010000:00010000:1.0:1651529344.629382:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.629384:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fae8c1d4/0x3234de053c4e4c4 lrc: 5/0,0 mode: PR/PR res: [0x2b820:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d445d expref: 812 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.629387:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fae8c1d4/0x3234de053c4e4c4 lrc: 4/0,0 mode: PR/PR res: [0x2b820:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d445d expref: 812 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.629391:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211762 00000100:00100000:0.0:1651529344.629393:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1256:39030:x1731745946481152:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.629398:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:0.0:1651529344.629398:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178210 count 1 00010000:00010000:1.0:1651529344.629399:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.629400:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c51a78 lrc: 3/0,1 mode: PW/PW res: [0x2b820:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629402:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51a86 lrc: 3/0,1 mode: --/PW res: [0x2b822:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.629403:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c51a78 lrc: 4/0,1 mode: PW/PW res: [0x2b820:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.629407:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.629407:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000029a7c39e/0x3234de053c4d6af lrc: 2/0,0 mode: PR/PR res: [0x2b822:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c79 expref: 812 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.629410:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.629410:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.629411:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51a86 lrc: 4/0,1 mode: --/PW res: [0x2b822:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.629412:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085af61db pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+812:41279:x1731746396362112:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 31us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.629414:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12539 00000100:00100000:1.0:1651529344.629418:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12540 00010000:00010000:0.0:1651529344.629418:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000029a7c39e/0x3234de053c4d6af lrc: 3/0,0 mode: PR/PR res: [0x2b822:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c79 expref: 811 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.629420:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000461918a5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+811:41279:x1731746396361792:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.629421:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000029a7c39e/0x3234de053c4d6af lrc: 4/0,0 mode: PR/PR res: [0x2b822:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c79 expref: 811 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.629422:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.629423:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001ff758be/0x3234de053c4df68 lrc: 4/0,0 mode: PR/PR res: [0x2b81b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ec3 expref: 811 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.629426:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000064719963 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997019520:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.629427:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001ff758be/0x3234de053c4df68 lrc: 3/0,0 mode: PR/PR res: [0x2b81b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ec3 expref: 811 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.629431:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ff758be/0x3234de053c4df68 lrc: 0/0,0 mode: --/PR res: [0x2b81b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2ec3 expref: 811 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.629434:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.629434:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c086aae3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.629435:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.629435:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c51a5c lrc: 3/0,1 mode: PW/PW res: [0x2b81b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.629438:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c51a5c lrc: 4/0,1 mode: PW/PW res: [0x2b81b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629440:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c51a55 lrc: 2/0,0 mode: PW/PW res: [0x2b81c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629443:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004f275b98 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.629444:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.629444:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c51a55 lrc: 2/0,0 mode: PW/PW res: [0x2b81c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629447:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c51a55 lrc: 3/0,0 mode: PW/PW res: [0x2b81c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.629448:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000461918a5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+810:41279:x1731746396361792:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 28us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.629450:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12540 00010000:00010000:0.0:1651529344.629451:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c51a55 lrc: 1/0,0 mode: --/PW res: [0x2b81c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629454:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c51a55 lrc: 0/0,0 mode: --/PW res: [0x2b81c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.629458:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12541 00010000:00010000:0.0:1651529344.629459:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c51a6a lrc: 3/0,1 mode: PW/PW res: [0x2b81e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.629460:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+809:41279:x1731746396361920:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.629462:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.629462:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c51a6a lrc: 3/0,1 mode: PW/PW res: [0x2b81e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.629463:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004c6fa7d3/0x3234de053c4e6d1 lrc: 4/0,0 mode: PR/PR res: [0x2b81d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c0c expref: 809 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.629465:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c51a6a lrc: 3/0,1 mode: PW/PW res: [0x2b81e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.629467:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004c6fa7d3/0x3234de053c4e6d1 lrc: 3/0,0 mode: PR/PR res: [0x2b81d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c0c expref: 809 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.629468:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c51a6a lrc: 2/0,0 mode: PW/PW res: [0x2b81e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.629471:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c6fa7d3/0x3234de053c4e6d1 lrc: 0/0,0 mode: --/PR res: [0x2b81d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c0c expref: 809 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.629474:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.629475:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.629475:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b54a65c7/0x3234de053c51a63 lrc: 3/0,1 mode: PW/PW res: [0x2b81d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.629478:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b54a65c7/0x3234de053c51a63 lrc: 4/0,1 mode: PW/PW res: [0x2b81d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.629484:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.629488:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+808:41279:x1731746396361920:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 28us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.629490:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12541 00000100:00100000:1.0:1651529344.629494:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12542 00000100:00100000:1.0:1651529344.629495:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+807:41279:x1731746396362048:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.629497:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.629499:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009c583e70/0x3234de053c4cbbf lrc: 4/0,0 mode: PR/PR res: [0x2b81f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce0b2 expref: 807 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.629502:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009c583e70/0x3234de053c4cbbf lrc: 3/0,0 mode: PR/PR res: [0x2b81f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce0b2 expref: 807 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.629504:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1257:39030:x1731745946480832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1005us (1113us total) trans 12885079811 rc 0/0 00010000:00010000:1.0:1651529344.629507:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c583e70/0x3234de053c4cbbf lrc: 0/0,0 mode: --/PR res: [0x2b81f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce0b2 expref: 807 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.629508:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211758 00010000:00010000:1.0:1651529344.629510:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.629510:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.629511:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c51a71 lrc: 3/0,1 mode: PW/PW res: [0x2b81f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.629513:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c51a71 lrc: 4/0,1 mode: PW/PW res: [0x2b81f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629514:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c51a6a lrc: 2/0,0 mode: PW/PW res: [0x2b81e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629518:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000579ed558 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.629519:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c51a6a lrc: 2/0,0 mode: PW/PW res: [0x2b81e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.629523:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.629528:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+806:41279:x1731746396362048:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 32us (244us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.629529:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c51a6a lrc: 3/0,0 mode: PW/PW res: [0x2b81e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.629530:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12542 00010000:00010000:0.0:1651529344.629534:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c51a6a lrc: 1/0,0 mode: --/PW res: [0x2b81e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629537:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c51a6a lrc: 0/0,0 mode: --/PW res: [0x2b81e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.629544:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000027c41311 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997019456:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.629547:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000077f05843/0x3234de053c51a7f lrc: 3/0,1 mode: --/PW res: [0x2b821:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629548:0:106695:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fae8c1d4/0x3234de053c4e4c4 lrc: 0/0,0 mode: --/PR res: [0x2b820:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d445d expref: 805 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.629551:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000edfe60d3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997019392:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.629554:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c51a5c lrc: 3/0,1 mode: PW/PW res: [0x2b81b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629555:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c51a78 lrc: 3/0,1 mode: PW/PW res: [0x2b820:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.629557:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c51a5c lrc: 3/0,1 mode: PW/PW res: [0x2b81b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629558:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c51a78 lrc: 3/0,1 mode: PW/PW res: [0x2b820:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.629560:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c51a5c lrc: 3/0,1 mode: PW/PW res: [0x2b81b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.629563:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c51a5c lrc: 2/0,0 mode: PW/PW res: [0x2b81b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629563:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c51a78 lrc: 3/0,1 mode: PW/PW res: [0x2b820:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629566:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c51a78 lrc: 3/0,1 mode: PW/PW res: [0x2b820:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629569:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c51a78 lrc: 2/0,0 mode: PW/PW res: [0x2b820:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.629606:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1258:39029:x1731745946480640:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1181us (1223us total) trans 12885079812 rc 0/0 00000100:00100000:1.0:1651529344.629609:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211756 00000100:00100000:0.0:1651529344.629611:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1257:39030:x1731745946480960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 775us (815us total) trans 12885079813 rc 0/0 00000100:00100000:0.0:1651529344.629614:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211760 00010000:00010000:1.0:1651529344.629616:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b54a65c7/0x3234de053c51a63 lrc: 3/0,1 mode: PW/PW res: [0x2b81d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.629619:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b54a65c7/0x3234de053c51a63 lrc: 3/0,1 mode: PW/PW res: [0x2b81d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629621:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c51a5c lrc: 2/0,0 mode: PW/PW res: [0x2b81b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.629622:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b54a65c7/0x3234de053c51a63 lrc: 3/0,1 mode: PW/PW res: [0x2b81d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.629625:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b54a65c7/0x3234de053c51a63 lrc: 2/0,0 mode: PW/PW res: [0x2b81d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629625:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009c763642 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.629626:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c51a5c lrc: 2/0,0 mode: PW/PW res: [0x2b81b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629628:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c51a5c lrc: 3/0,0 mode: PW/PW res: [0x2b81b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629640:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c51a5c lrc: 1/0,0 mode: --/PW res: [0x2b81b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629643:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c763642/0x3234de053c51a5c lrc: 0/0,0 mode: --/PW res: [0x2b81b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629648:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c51a78 lrc: 2/0,0 mode: PW/PW res: [0x2b820:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629650:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6eb3f34 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.629651:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c51a78 lrc: 2/0,0 mode: PW/PW res: [0x2b820:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629654:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c51a78 lrc: 3/0,0 mode: PW/PW res: [0x2b820:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629657:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c51a78 lrc: 1/0,0 mode: --/PW res: [0x2b820:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629660:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c51a78 lrc: 0/0,0 mode: --/PW res: [0x2b820:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.629662:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1257:39030:x1731745946480768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1185us (1287us total) trans 12885079814 rc 0/0 00010000:00010000:0.0:1651529344.629663:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b54a65c7/0x3234de053c51a63 lrc: 2/0,0 mode: PW/PW res: [0x2b81d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.629664:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211757 00010000:00010000:0.0:1651529344.629665:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b54a65c7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.629666:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b54a65c7/0x3234de053c51a63 lrc: 2/0,0 mode: PW/PW res: [0x2b81d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629669:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b54a65c7/0x3234de053c51a63 lrc: 3/0,0 mode: PW/PW res: [0x2b81d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629672:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b54a65c7/0x3234de053c51a63 lrc: 1/0,0 mode: --/PW res: [0x2b81d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629675:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b54a65c7/0x3234de053c51a63 lrc: 0/0,0 mode: --/PW res: [0x2b81d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629682:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c51a71 lrc: 3/0,1 mode: PW/PW res: [0x2b81f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629685:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c51a71 lrc: 3/0,1 mode: PW/PW res: [0x2b81f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629688:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c51a71 lrc: 3/0,1 mode: PW/PW res: [0x2b81f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629690:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c51a71 lrc: 2/0,0 mode: PW/PW res: [0x2b81f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.629691:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.629725:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1257:39030:x1731745946480896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1095us (1149us total) trans 12885079815 rc 0/0 00000100:00100000:0.0:1651529344.629728:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211759 00010000:00010000:0.0:1651529344.629743:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c51a71 lrc: 2/0,0 mode: PW/PW res: [0x2b81f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629747:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dd394f60 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.629748:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c51a71 lrc: 2/0,0 mode: PW/PW res: [0x2b81f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629751:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c51a71 lrc: 3/0,0 mode: PW/PW res: [0x2b81f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629756:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c51a71 lrc: 1/0,0 mode: --/PW res: [0x2b81f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629759:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c51a71 lrc: 0/0,0 mode: --/PW res: [0x2b81f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.629780:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396362176 00010000:00010000:0.0:1651529344.629785:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000949f4f7f/0x3234de053c4d987 lrc: 4/0,0 mode: PR/PR res: [0x2b821:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1690 expref: 805 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.629796:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12543 00000100:00100000:0.0:1651529344.629798:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+805:41278:x1731746396362176:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.629801:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.629817:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000949f4f7f/0x3234de053c4d987 lrc: 4/0,0 mode: PR/PR res: [0x2b821:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1690 expref: 805 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.629821:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000949f4f7f/0x3234de053c4d987 lrc: 3/0,0 mode: PR/PR res: [0x2b821:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1690 expref: 805 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.629827:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000949f4f7f/0x3234de053c4d987 lrc: 0/0,0 mode: --/PR res: [0x2b821:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1690 expref: 805 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.629831:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.629831:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.629843:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000077f05843/0x3234de053c51a7f lrc: 3/0,1 mode: PW/PW res: [0x2b821:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629849:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077f05843/0x3234de053c51a7f lrc: 4/0,1 mode: PW/PW res: [0x2b821:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629858:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.629861:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000077f05843/0x3234de053c51a7f lrc: 3/0,1 mode: PW/PW res: [0x2b821:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.629866:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077f05843/0x3234de053c51a7f lrc: 3/0,1 mode: PW/PW res: [0x2b821:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.629869:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077f05843/0x3234de053c51a7f lrc: 3/0,1 mode: PW/PW res: [0x2b821:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.629869:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+804:41278:x1731746396362176:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 70us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.629871:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12543 00010000:00010000:1.0:1651529344.629872:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000077f05843/0x3234de053c51a7f lrc: 2/0,0 mode: PW/PW res: [0x2b821:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629903:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000077f05843/0x3234de053c51a7f lrc: 2/0,0 mode: PW/PW res: [0x2b821:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629924:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000077f05843 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.629925:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000077f05843/0x3234de053c51a7f lrc: 2/0,0 mode: PW/PW res: [0x2b821:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.629931:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1257:39030:x1731745946481024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 929us (968us total) trans 12885079816 rc 0/0 00010000:00010000:0.0:1651529344.629933:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000077f05843/0x3234de053c51a7f lrc: 3/0,0 mode: PW/PW res: [0x2b821:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.629935:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211761 00010000:00010000:0.0:1651529344.629938:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000077f05843/0x3234de053c51a7f lrc: 1/0,0 mode: --/PW res: [0x2b821:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.629941:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077f05843/0x3234de053c51a7f lrc: 0/0,0 mode: --/PW res: [0x2b821:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.629949:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.629955:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946481408 00000100:00100000:1.0:1651529344.629964:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211763 00000100:00100000:1.0:1651529344.629980:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1257:39029:x1731745946481408:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.629986:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178211 count 1 00010000:00010000:1.0:1651529344.629990:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2aafb48/0x3234de053c51a8d lrc: 3/0,1 mode: --/PW res: [0x2b823:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.629995:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000713eebe9/0x3234de053c4c8a1 lrc: 2/0,0 mode: PR/PR res: [0x2b823:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd441 expref: 803 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.629998:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.629999:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.629999:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2aafb48/0x3234de053c51a8d lrc: 4/0,1 mode: --/PW res: [0x2b823:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.630006:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000713eebe9/0x3234de053c4c8a1 lrc: 3/0,0 mode: PR/PR res: [0x2b823:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd441 expref: 803 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.630010:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000713eebe9/0x3234de053c4c8a1 lrc: 4/0,0 mode: PR/PR res: [0x2b823:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd441 expref: 803 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.630014:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d6486d55 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997019584:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.630029:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000499d0377 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.630048:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.630071:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946481472 00000100:00100000:1.0:1651529344.630079:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.630094:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.630097:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946481792 00000100:00100000:1.0:1651529344.630113:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.630122:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946481920 00000100:00100000:1.0:1651529344.630124:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.630132:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946481856 00000100:00100000:1.0:1651529344.630133:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.630145:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946481984 00000100:00100000:1.0:1651529344.630147:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.630150:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946482048 00000100:00100000:0.0:1651529344.630153:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211764 00000100:00100000:1.0:1651529344.630155:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211765 00000100:00100000:0.0:1651529344.630155:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1263:39029:x1731745946481472:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.630157:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1263:39030:x1731745946481792:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.630160:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178212 count 1 00002000:00080000:1.0:1651529344.630163:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178213 count 1 00010000:00010000:0.0:1651529344.630164:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51a94 lrc: 3/0,1 mode: --/PW res: [0x2b824:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.630167:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071d5fc61/0x3234de053c51a9b lrc: 3/0,1 mode: --/PW res: [0x2b825:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.630169:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000437ad37b/0x3234de053c4ec7a lrc: 2/0,0 mode: PR/PR res: [0x2b824:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6397 expref: 803 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.630171:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dcfaf2ba/0x3234de053c4cea5 lrc: 2/0,0 mode: PR/PR res: [0x2b825:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec9e expref: 803 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.630172:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.630173:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.630173:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51a94 lrc: 4/0,1 mode: --/PW res: [0x2b824:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.630175:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.630175:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.630176:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071d5fc61/0x3234de053c51a9b lrc: 4/0,1 mode: --/PW res: [0x2b825:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.630180:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000437ad37b/0x3234de053c4ec7a lrc: 3/0,0 mode: PR/PR res: [0x2b824:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6397 expref: 803 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.630183:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dcfaf2ba/0x3234de053c4cea5 lrc: 3/0,0 mode: PR/PR res: [0x2b825:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec9e expref: 803 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.630184:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000437ad37b/0x3234de053c4ec7a lrc: 4/0,0 mode: PR/PR res: [0x2b824:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6397 expref: 803 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.630187:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dcfaf2ba/0x3234de053c4cea5 lrc: 4/0,0 mode: PR/PR res: [0x2b825:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec9e expref: 803 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.630188:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d28c414b pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997019648:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.630191:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006e255cae pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997019712:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.630208:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8a0b704 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.630214:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211766 00000100:00100000:0.0:1651529344.630215:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 0000000076b354b3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.630216:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1263:39030:x1731745946481920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.630220:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178215 count 1 00010000:00010000:1.0:1651529344.630239:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062cde35a/0x3234de053c51aa2 lrc: 3/0,1 mode: --/PW res: [0x2b827:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.630240:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211767 00000100:00100000:0.0:1651529344.630242:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a8819a3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1263:39029:x1731745946481856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.630243:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c4f3ff lrc: 2/0,0 mode: PR/PR res: [0x2b827:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8268 expref: 803 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.630247:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.630247:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:0.0:1651529344.630247:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178214 count 1 00010000:00010000:1.0:1651529344.630248:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062cde35a/0x3234de053c51aa2 lrc: 4/0,1 mode: --/PW res: [0x2b827:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.630251:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c51aa9 lrc: 3/0,1 mode: --/PW res: [0x2b826:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.630254:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c4f3ff lrc: 3/0,0 mode: PR/PR res: [0x2b827:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8268 expref: 803 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.630260:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c4f3ff lrc: 4/0,0 mode: PR/PR res: [0x2b827:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8268 expref: 803 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.630264:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d9ef3c1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997019776:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.630268:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c601ef5c/0x3234de053c4cb25 lrc: 2/0,0 mode: PR/PR res: [0x2b826:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde12 expref: 803 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.630271:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a6b79b05 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.630271:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.630272:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.630273:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c51aa9 lrc: 4/0,1 mode: --/PW res: [0x2b826:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.630277:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211768 00000100:00100000:1.0:1651529344.630279:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1263:39029:x1731745946481984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.630280:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c601ef5c/0x3234de053c4cb25 lrc: 3/0,0 mode: PR/PR res: [0x2b826:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde12 expref: 803 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.630283:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178216 count 1 00010000:00010000:0.0:1651529344.630283:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c601ef5c/0x3234de053c4cb25 lrc: 4/0,0 mode: PR/PR res: [0x2b826:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde12 expref: 803 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.630286:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb266188/0x3234de053c51ab0 lrc: 3/0,1 mode: --/PW res: [0x2b828:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.630288:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000066de8c9f pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997019840:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.630290:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000aa4fceaa/0x3234de053c4eac1 lrc: 2/0,0 mode: PR/PR res: [0x2b828:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5cac expref: 803 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.630293:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.630293:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.630294:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb266188/0x3234de053c51ab0 lrc: 4/0,1 mode: --/PW res: [0x2b828:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.630296:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000afe7ff7b going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.630300:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000aa4fceaa/0x3234de053c4eac1 lrc: 3/0,0 mode: PR/PR res: [0x2b828:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5cac expref: 803 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.630303:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211769 00010000:00010000:1.0:1651529344.630304:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000aa4fceaa/0x3234de053c4eac1 lrc: 4/0,0 mode: PR/PR res: [0x2b828:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5cac expref: 803 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.630305:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085af61db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1263:39030:x1731745946482048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.630309:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178217 count 1 00000100:00100000:1.0:1651529344.630311:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007c534a1e pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997019904:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.630313:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51ab7 lrc: 3/0,1 mode: --/PW res: [0x2b829:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.630317:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.630317:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e258b408/0x3234de053c4d18b lrc: 2/0,0 mode: PR/PR res: [0x2b829:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf780 expref: 803 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.630322:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.630323:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.630324:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51ab7 lrc: 4/0,1 mode: --/PW res: [0x2b829:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.630329:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e258b408/0x3234de053c4d18b lrc: 3/0,0 mode: PR/PR res: [0x2b829:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf780 expref: 803 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.630333:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e258b408/0x3234de053c4d18b lrc: 4/0,0 mode: PR/PR res: [0x2b829:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf780 expref: 803 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.630336:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004534b316 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997019968:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.630343:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 000000000d706dff going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.630350:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000064719963 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997019520:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.630354:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51a86 lrc: 3/0,1 mode: --/PW res: [0x2b822:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.630363:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.630372:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d6486d55 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997019584:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.630376:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d2aafb48/0x3234de053c51a8d lrc: 3/0,1 mode: --/PW res: [0x2b823:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.630383:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396362496 00000100:00100000:0.0:1651529344.630393:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396362560 00010000:00010000:0.0:1651529344.630399:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000713eebe9/0x3234de053c4c8a1 lrc: 4/0,0 mode: PR/PR res: [0x2b823:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd441 expref: 805 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.630410:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12544 00000100:00100000:0.0:1651529344.630412:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+805:41278:x1731746396362560:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.630414:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.630416:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000713eebe9/0x3234de053c4c8a1 lrc: 4/0,0 mode: PR/PR res: [0x2b823:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd441 expref: 805 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.630419:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000029a7c39e/0x3234de053c4d6af lrc: 4/0,0 mode: PR/PR res: [0x2b822:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c79 expref: 805 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.630420:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000713eebe9/0x3234de053c4c8a1 lrc: 3/0,0 mode: PR/PR res: [0x2b823:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd441 expref: 805 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.630425:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000713eebe9/0x3234de053c4c8a1 lrc: 0/0,0 mode: --/PR res: [0x2b823:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd441 expref: 805 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.630428:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12545 00000100:00100000:1.0:1651529344.630429:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+804:41279:x1731746396362496:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.630429:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.630429:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.630430:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d2aafb48/0x3234de053c51a8d lrc: 3/0,1 mode: PW/PW res: [0x2b823:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.630432:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.630433:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2aafb48/0x3234de053c51a8d lrc: 4/0,1 mode: PW/PW res: [0x2b823:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.630434:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000029a7c39e/0x3234de053c4d6af lrc: 4/0,0 mode: PR/PR res: [0x2b822:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c79 expref: 804 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.630438:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000029a7c39e/0x3234de053c4d6af lrc: 3/0,0 mode: PR/PR res: [0x2b822:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c79 expref: 804 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.630441:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.630449:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029a7c39e/0x3234de053c4d6af lrc: 0/0,0 mode: --/PR res: [0x2b822:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c79 expref: 804 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.630451:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+804:41278:x1731746396362560:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 39us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.630454:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12544 00010000:00010000:1.0:1651529344.630457:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.630458:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.630459:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51a86 lrc: 3/0,1 mode: PW/PW res: [0x2b822:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.630462:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51a86 lrc: 4/0,1 mode: PW/PW res: [0x2b822:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.630471:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.630475:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51a86 lrc: 3/0,1 mode: PW/PW res: [0x2b822:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.630478:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+802:41279:x1731746396362496:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 48us (354us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.630478:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51a86 lrc: 3/0,1 mode: PW/PW res: [0x2b822:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.630481:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12545 00010000:00010000:0.0:1651529344.630482:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51a86 lrc: 3/0,1 mode: PW/PW res: [0x2b822:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.630487:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51a86 lrc: 2/0,0 mode: PW/PW res: [0x2b822:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.630489:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d2aafb48/0x3234de053c51a8d lrc: 3/0,1 mode: PW/PW res: [0x2b823:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.630492:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2aafb48/0x3234de053c51a8d lrc: 3/0,1 mode: PW/PW res: [0x2b823:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.630495:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2aafb48/0x3234de053c51a8d lrc: 3/0,1 mode: PW/PW res: [0x2b823:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.630497:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2aafb48/0x3234de053c51a8d lrc: 2/0,0 mode: PW/PW res: [0x2b823:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.630553:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1265:39029:x1731745946481408:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 586us (603us total) trans 12885079818 rc 0/0 00000100:00100000:0.0:1651529344.630553:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1265:39030:x1731745946481152:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1159us (1282us total) trans 12885079817 rc 0/0 00000100:00100000:1.0:1651529344.630555:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211763 00000100:00100000:0.0:1651529344.630557:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211762 00010000:00010000:0.0:1651529344.630564:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51a86 lrc: 2/0,0 mode: PW/PW res: [0x2b822:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.630568:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b2d06199 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.630569:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51a86 lrc: 2/0,0 mode: PW/PW res: [0x2b822:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.630572:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51a86 lrc: 3/0,0 mode: PW/PW res: [0x2b822:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.630577:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51a86 lrc: 1/0,0 mode: --/PW res: [0x2b822:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.630579:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51a86 lrc: 0/0,0 mode: --/PW res: [0x2b822:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.630584:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2aafb48/0x3234de053c51a8d lrc: 2/0,0 mode: PW/PW res: [0x2b823:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.630587:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d2aafb48 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.630588:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2aafb48/0x3234de053c51a8d lrc: 2/0,0 mode: PW/PW res: [0x2b823:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.630590:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2aafb48/0x3234de053c51a8d lrc: 3/0,0 mode: PW/PW res: [0x2b823:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.630594:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2aafb48/0x3234de053c51a8d lrc: 1/0,0 mode: --/PW res: [0x2b823:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.630596:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2aafb48/0x3234de053c51a8d lrc: 0/0,0 mode: --/PW res: [0x2b823:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.630807:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006e255cae pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997019712:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.630816:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000071d5fc61/0x3234de053c51a9b lrc: 3/0,1 mode: --/PW res: [0x2b825:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.630818:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.630824:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d9ef3c1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997019776:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.630827:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000062cde35a/0x3234de053c51aa2 lrc: 3/0,1 mode: --/PW res: [0x2b827:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.630841:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007c534a1e pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997019904:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.630843:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cb266188/0x3234de053c51ab0 lrc: 3/0,1 mode: --/PW res: [0x2b828:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.630868:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000066de8c9f pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997019840:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.630872:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c51aa9 lrc: 3/0,1 mode: --/PW res: [0x2b826:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.630880:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004534b316 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997019968:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.630882:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.630883:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51ab7 lrc: 3/0,1 mode: --/PW res: [0x2b829:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.630889:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946482112 00000100:00100000:0.0:1651529344.630889:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946482176 00000100:00100000:0.0:1651529344.630896:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211770 00000100:00100000:1.0:1651529344.630902:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211771 00000100:00100000:1.0:1651529344.630903:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1265:39029:x1731745946482112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.630904:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1265:39030:x1731745946482176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.630909:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178218 count 1 00002000:00080000:0.0:1651529344.630909:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178219 count 1 00010000:00010000:1.0:1651529344.630913:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034f81b17/0x3234de053c51abe lrc: 3/0,1 mode: --/PW res: [0x2b82a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.630913:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51ac5 lrc: 3/0,1 mode: --/PW res: [0x2b82b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.630918:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000009bf0b7b/0x3234de053c4e86e lrc: 2/0,0 mode: PR/PR res: [0x2b82a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d52b8 expref: 801 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.630918:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4f1cf lrc: 2/0,0 mode: PR/PR res: [0x2b82b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a34 expref: 801 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.630921:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.630921:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.630922:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034f81b17/0x3234de053c51abe lrc: 4/0,1 mode: --/PW res: [0x2b82a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.630929:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000009bf0b7b/0x3234de053c4e86e lrc: 3/0,0 mode: PR/PR res: [0x2b82a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d52b8 expref: 801 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.630933:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009bf0b7b/0x3234de053c4e86e lrc: 4/0,0 mode: PR/PR res: [0x2b82a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d52b8 expref: 801 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.630937:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000089d7f5d6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997020032:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.630947:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a6b79b05 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.630953:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.630954:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.630954:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51ac5 lrc: 4/0,1 mode: --/PW res: [0x2b82b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.630963:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4f1cf lrc: 3/0,0 mode: PR/PR res: [0x2b82b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a34 expref: 801 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.630966:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4f1cf lrc: 4/0,0 mode: PR/PR res: [0x2b82b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a34 expref: 801 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.630968:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.630971:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004534b316 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997020096:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.630980:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000afe7ff7b going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.630989:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d28c414b pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997019648:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.630993:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51a94 lrc: 3/0,1 mode: --/PW res: [0x2b824:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.631004:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396362944 00010000:00010000:1.0:1651529344.631014:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dcfaf2ba/0x3234de053c4cea5 lrc: 4/0,0 mode: PR/PR res: [0x2b825:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec9e expref: 802 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.631029:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12546 00000100:00100000:1.0:1651529344.631031:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+802:41278:x1731746396362944:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.631034:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.631035:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dcfaf2ba/0x3234de053c4cea5 lrc: 4/0,0 mode: PR/PR res: [0x2b825:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec9e expref: 802 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.631039:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dcfaf2ba/0x3234de053c4cea5 lrc: 3/0,0 mode: PR/PR res: [0x2b825:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec9e expref: 802 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.631045:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcfaf2ba/0x3234de053c4cea5 lrc: 0/0,0 mode: --/PR res: [0x2b825:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec9e expref: 802 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.631048:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.631049:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.631050:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000071d5fc61/0x3234de053c51a9b lrc: 3/0,1 mode: PW/PW res: [0x2b825:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.631053:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071d5fc61/0x3234de053c51a9b lrc: 4/0,1 mode: PW/PW res: [0x2b825:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.631060:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.631072:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+801:41278:x1731746396362944:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 41us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.631075:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12546 00010000:00010000:1.0:1651529344.631082:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000071d5fc61/0x3234de053c51a9b lrc: 3/0,1 mode: PW/PW res: [0x2b825:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.631085:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071d5fc61/0x3234de053c51a9b lrc: 3/0,1 mode: PW/PW res: [0x2b825:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.631088:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071d5fc61/0x3234de053c51a9b lrc: 3/0,1 mode: PW/PW res: [0x2b825:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.631091:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071d5fc61/0x3234de053c51a9b lrc: 2/0,0 mode: PW/PW res: [0x2b825:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631105:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071d5fc61/0x3234de053c51a9b lrc: 2/0,0 mode: PW/PW res: [0x2b825:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631109:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000071d5fc61 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.631110:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071d5fc61/0x3234de053c51a9b lrc: 2/0,0 mode: PW/PW res: [0x2b825:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631115:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071d5fc61/0x3234de053c51a9b lrc: 3/0,0 mode: PW/PW res: [0x2b825:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631120:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071d5fc61/0x3234de053c51a9b lrc: 1/0,0 mode: --/PW res: [0x2b825:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631123:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071d5fc61/0x3234de053c51a9b lrc: 0/0,0 mode: --/PW res: [0x2b825:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.631143:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1266:39030:x1731745946481792:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 985us (1072us total) trans 12885079819 rc 0/0 00000100:00100000:1.0:1651529344.631146:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211765 00000100:00100000:1.0:1651529344.631157:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.631174:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.631181:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.631187:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.631197:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.631203:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396363136 00010000:00010000:1.0:1651529344.631207:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000aa4fceaa/0x3234de053c4eac1 lrc: 4/0,0 mode: PR/PR res: [0x2b828:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5cac expref: 801 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.631213:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396362880 00010000:00010000:1.0:1651529344.631215:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000437ad37b/0x3234de053c4ec7a lrc: 4/0,0 mode: PR/PR res: [0x2b824:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6397 expref: 802 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.631218:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396363200 00010000:00010000:0.0:1651529344.631239:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e258b408/0x3234de053c4d18b lrc: 4/0,0 mode: PR/PR res: [0x2b829:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf780 expref: 803 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.631241:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396363008 00010000:00010000:1.0:1651529344.631245:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c4f3ff lrc: 4/0,0 mode: PR/PR res: [0x2b827:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8268 expref: 804 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.631246:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396363072 00010000:00010000:0.0:1651529344.631248:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c601ef5c/0x3234de053c4cb25 lrc: 4/0,0 mode: PR/PR res: [0x2b826:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde12 expref: 805 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.631250:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12547 00000100:00100000:1.0:1651529344.631251:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f53a84c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+805:41278:x1731746396363136:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.631254:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.631254:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12548 00010000:00010000:1.0:1651529344.631255:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000aa4fceaa/0x3234de053c4eac1 lrc: 4/0,0 mode: PR/PR res: [0x2b828:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5cac expref: 805 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.631256:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+805:41279:x1731746396362880:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.631259:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000aa4fceaa/0x3234de053c4eac1 lrc: 3/0,0 mode: PR/PR res: [0x2b828:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5cac expref: 805 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.631259:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.631261:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000437ad37b/0x3234de053c4ec7a lrc: 4/0,0 mode: PR/PR res: [0x2b824:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6397 expref: 805 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.631264:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa4fceaa/0x3234de053c4eac1 lrc: 0/0,0 mode: --/PR res: [0x2b828:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5cac expref: 805 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.631264:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000437ad37b/0x3234de053c4ec7a lrc: 3/0,0 mode: PR/PR res: [0x2b824:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6397 expref: 805 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.631268:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.631268:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.631269:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cb266188/0x3234de053c51ab0 lrc: 3/0,1 mode: PW/PW res: [0x2b828:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.631272:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb266188/0x3234de053c51ab0 lrc: 4/0,1 mode: PW/PW res: [0x2b828:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.631279:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.631287:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f53a84c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+804:41278:x1731746396363136:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (129us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.631287:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000437ad37b/0x3234de053c4ec7a lrc: 0/0,0 mode: --/PR res: [0x2b824:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6397 expref: 804 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.631289:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12547 00010000:00010000:0.0:1651529344.631292:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.631292:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.631293:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51a94 lrc: 3/0,1 mode: PW/PW res: [0x2b824:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631296:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51a94 lrc: 4/0,1 mode: PW/PW res: [0x2b824:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.631298:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12549 00000100:00100000:1.0:1651529344.631299:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+802:41278:x1731746396363200:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.631302:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.631303:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e258b408/0x3234de053c4d18b lrc: 4/0,0 mode: PR/PR res: [0x2b829:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf780 expref: 802 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.631304:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.631307:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e258b408/0x3234de053c4d18b lrc: 3/0,0 mode: PR/PR res: [0x2b829:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf780 expref: 802 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.631311:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+802:41279:x1731746396362880:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 55us (137us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.631312:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e258b408/0x3234de053c4d18b lrc: 0/0,0 mode: --/PR res: [0x2b829:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf780 expref: 802 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.631314:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12548 00010000:00010000:1.0:1651529344.631315:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.631316:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.631316:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51ab7 lrc: 3/0,1 mode: PW/PW res: [0x2b829:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.631319:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51ab7 lrc: 4/0,1 mode: PW/PW res: [0x2b829:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.631319:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12550 00000100:00100000:0.0:1651529344.631321:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+800:41279:x1731746396363008:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.631324:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.631325:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c4f3ff lrc: 4/0,0 mode: PR/PR res: [0x2b827:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8268 expref: 800 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.631332:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.631336:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c4f3ff lrc: 3/0,0 mode: PR/PR res: [0x2b827:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8268 expref: 800 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.631338:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+800:41278:x1731746396363200:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.631340:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12549 00010000:00010000:0.0:1651529344.631342:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c4f3ff lrc: 0/0,0 mode: --/PR res: [0x2b827:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8268 expref: 800 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.631345:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12551 00000100:00100000:1.0:1651529344.631346:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+799:41279:x1731746396363072:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.631348:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.631348:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.631349:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.631349:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000062cde35a/0x3234de053c51aa2 lrc: 3/0,1 mode: PW/PW res: [0x2b827:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.631350:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c601ef5c/0x3234de053c4cb25 lrc: 4/0,0 mode: PR/PR res: [0x2b826:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde12 expref: 798 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.631352:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062cde35a/0x3234de053c51aa2 lrc: 4/0,1 mode: PW/PW res: [0x2b827:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.631354:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c601ef5c/0x3234de053c4cb25 lrc: 3/0,0 mode: PR/PR res: [0x2b826:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde12 expref: 798 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.631361:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.631365:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c601ef5c/0x3234de053c4cb25 lrc: 0/0,0 mode: --/PR res: [0x2b826:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cde12 expref: 798 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.631367:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+798:41279:x1731746396363008:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 45us (180us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.631368:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.631369:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.631369:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12550 00010000:00010000:1.0:1651529344.631370:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c51aa9 lrc: 3/0,1 mode: PW/PW res: [0x2b826:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.631373:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c51aa9 lrc: 4/0,1 mode: PW/PW res: [0x2b826:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631376:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51ab7 lrc: 3/0,1 mode: PW/PW res: [0x2b829:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.631381:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.631385:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51ab7 lrc: 3/0,1 mode: PW/PW res: [0x2b829:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.631387:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+796:41279:x1731746396363072:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 40us (190us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.631388:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51ab7 lrc: 3/0,1 mode: PW/PW res: [0x2b829:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.631390:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12551 00010000:00010000:0.0:1651529344.631391:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51ab7 lrc: 2/0,0 mode: PW/PW res: [0x2b829:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.631399:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cb266188/0x3234de053c51ab0 lrc: 3/0,1 mode: PW/PW res: [0x2b828:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.631403:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb266188/0x3234de053c51ab0 lrc: 3/0,1 mode: PW/PW res: [0x2b828:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.631406:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb266188/0x3234de053c51ab0 lrc: 3/0,1 mode: PW/PW res: [0x2b828:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.631408:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb266188/0x3234de053c51ab0 lrc: 2/0,0 mode: PW/PW res: [0x2b828:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.631437:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085af61db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1267:39030:x1731745946482048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1131us (1290us total) trans 12885079820 rc 0/0 00000100:00100000:0.0:1651529344.631440:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211769 00010000:00010000:0.0:1651529344.631446:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c51aa9 lrc: 3/0,1 mode: PW/PW res: [0x2b826:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.631449:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1266:39029:x1731745946481984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1170us (1316us total) trans 12885079821 rc 0/0 00010000:00010000:0.0:1651529344.631450:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c51aa9 lrc: 3/0,1 mode: PW/PW res: [0x2b826:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.631452:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211768 00010000:00010000:0.0:1651529344.631453:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c51aa9 lrc: 3/0,1 mode: PW/PW res: [0x2b826:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631456:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c51aa9 lrc: 2/0,0 mode: PW/PW res: [0x2b826:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.631459:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000062cde35a/0x3234de053c51aa2 lrc: 3/0,1 mode: PW/PW res: [0x2b827:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.631462:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062cde35a/0x3234de053c51aa2 lrc: 3/0,1 mode: PW/PW res: [0x2b827:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.631465:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062cde35a/0x3234de053c51aa2 lrc: 3/0,1 mode: PW/PW res: [0x2b827:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.631467:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062cde35a/0x3234de053c51aa2 lrc: 2/0,0 mode: PW/PW res: [0x2b827:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.631488:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a8819a3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1267:39029:x1731745946481856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1245us (1374us total) trans 12885079822 rc 0/0 00000100:00100000:0.0:1651529344.631491:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211767 00010000:00010000:0.0:1651529344.631498:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51ab7 lrc: 2/0,0 mode: PW/PW res: [0x2b829:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.631500:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1266:39030:x1731745946481920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1283us (1405us total) trans 12885079823 rc 0/0 00010000:00010000:0.0:1651529344.631501:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000040cd657 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.631502:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51ab7 lrc: 2/0,0 mode: PW/PW res: [0x2b829:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.631503:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211766 00010000:00010000:0.0:1651529344.631505:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51ab7 lrc: 3/0,0 mode: PW/PW res: [0x2b829:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631509:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51ab7 lrc: 1/0,0 mode: --/PW res: [0x2b829:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631514:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51ab7 lrc: 0/0,0 mode: --/PW res: [0x2b829:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631519:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb266188/0x3234de053c51ab0 lrc: 2/0,0 mode: PW/PW res: [0x2b828:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631521:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cb266188 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.631522:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb266188/0x3234de053c51ab0 lrc: 2/0,0 mode: PW/PW res: [0x2b828:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631525:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb266188/0x3234de053c51ab0 lrc: 3/0,0 mode: PW/PW res: [0x2b828:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631528:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb266188/0x3234de053c51ab0 lrc: 1/0,0 mode: --/PW res: [0x2b828:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.631529:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.631531:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb266188/0x3234de053c51ab0 lrc: 0/0,0 mode: --/PW res: [0x2b828:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631534:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c51aa9 lrc: 2/0,0 mode: PW/PW res: [0x2b826:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631537:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065c40e6a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.631537:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c51aa9 lrc: 2/0,0 mode: PW/PW res: [0x2b826:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631550:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c51aa9 lrc: 3/0,0 mode: PW/PW res: [0x2b826:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.631552:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.631554:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c51aa9 lrc: 1/0,0 mode: --/PW res: [0x2b826:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631556:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c51aa9 lrc: 0/0,0 mode: --/PW res: [0x2b826:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631560:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062cde35a/0x3234de053c51aa2 lrc: 2/0,0 mode: PW/PW res: [0x2b827:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.631561:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.631562:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000062cde35a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.631563:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062cde35a/0x3234de053c51aa2 lrc: 2/0,0 mode: PW/PW res: [0x2b827:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631566:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062cde35a/0x3234de053c51aa2 lrc: 3/0,0 mode: PW/PW res: [0x2b827:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631569:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062cde35a/0x3234de053c51aa2 lrc: 1/0,0 mode: --/PW res: [0x2b827:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631572:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062cde35a/0x3234de053c51aa2 lrc: 0/0,0 mode: --/PW res: [0x2b827:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.631582:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004534b316 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997020096:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.631587:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51ac5 lrc: 3/0,1 mode: --/PW res: [0x2b82b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631592:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51a94 lrc: 3/0,1 mode: PW/PW res: [0x2b824:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631595:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51a94 lrc: 3/0,1 mode: PW/PW res: [0x2b824:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631598:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51a94 lrc: 3/0,1 mode: PW/PW res: [0x2b824:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631600:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51a94 lrc: 2/0,0 mode: PW/PW res: [0x2b824:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.631626:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000089d7f5d6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997020032:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.631631:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000034f81b17/0x3234de053c51abe lrc: 3/0,1 mode: --/PW res: [0x2b82a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.631638:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396363264 00010000:00010000:1.0:1651529344.631643:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4f1cf lrc: 4/0,0 mode: PR/PR res: [0x2b82b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a34 expref: 796 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.631649:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396363328 00010000:00010000:1.0:1651529344.631651:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000009bf0b7b/0x3234de053c4e86e lrc: 4/0,0 mode: PR/PR res: [0x2b82a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d52b8 expref: 797 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.631658:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1266:39029:x1731745946481472:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1502us (1609us total) trans 12885079824 rc 0/0 00000100:00100000:0.0:1651529344.631661:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211764 00000100:00100000:1.0:1651529344.631667:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12552 00000100:00100000:1.0:1651529344.631668:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+797:41279:x1731746396363264:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.631671:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.631673:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4f1cf lrc: 4/0,0 mode: PR/PR res: [0x2b82b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a34 expref: 797 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.631676:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4f1cf lrc: 3/0,0 mode: PR/PR res: [0x2b82b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a34 expref: 797 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.631682:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0e4295a/0x3234de053c4f1cf lrc: 0/0,0 mode: --/PR res: [0x2b82b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a34 expref: 797 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.631686:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.631686:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.631687:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51ac5 lrc: 3/0,1 mode: PW/PW res: [0x2b82b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.631690:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51ac5 lrc: 4/0,1 mode: PW/PW res: [0x2b82b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.631695:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946482496 00010000:00010000:1.0:1651529344.631698:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.631705:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+796:41279:x1731746396363264:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.631708:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12552 00000100:00100000:0.0:1651529344.631708:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211772 00000100:00100000:0.0:1651529344.631710:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1266:39030:x1731745946482496:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.631712:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12553 00000100:00100000:1.0:1651529344.631714:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+795:41278:x1731746396363328:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00002000:00080000:0.0:1651529344.631715:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178220 count 1 00010000:00010000:1.0:1651529344.631716:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.631717:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000009bf0b7b/0x3234de053c4e86e lrc: 4/0,0 mode: PR/PR res: [0x2b82a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d52b8 expref: 795 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.631719:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51acc lrc: 3/0,1 mode: --/PW res: [0x2b82c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.631721:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000009bf0b7b/0x3234de053c4e86e lrc: 3/0,0 mode: PR/PR res: [0x2b82a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d52b8 expref: 795 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.631724:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008b3a2f01/0x3234de053c4e2a2 lrc: 2/0,0 mode: PR/PR res: [0x2b82c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3be3 expref: 795 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.631725:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009bf0b7b/0x3234de053c4e86e lrc: 0/0,0 mode: --/PR res: [0x2b82a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d52b8 expref: 795 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.631730:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.631730:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.631731:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.631731:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51acc lrc: 4/0,1 mode: --/PW res: [0x2b82c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.631732:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.631732:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000034f81b17/0x3234de053c51abe lrc: 3/0,1 mode: PW/PW res: [0x2b82a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.631745:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034f81b17/0x3234de053c51abe lrc: 4/0,1 mode: PW/PW res: [0x2b82a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.631752:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.631757:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008b3a2f01/0x3234de053c4e2a2 lrc: 3/0,0 mode: PR/PR res: [0x2b82c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3be3 expref: 794 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.631758:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+794:41278:x1731746396363328:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 43us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.631760:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12553 00010000:00010000:1.0:1651529344.631768:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000034f81b17/0x3234de053c51abe lrc: 3/0,1 mode: PW/PW res: [0x2b82a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.631771:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034f81b17/0x3234de053c51abe lrc: 3/0,1 mode: PW/PW res: [0x2b82a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631771:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008b3a2f01/0x3234de053c4e2a2 lrc: 4/0,0 mode: PR/PR res: [0x2b82c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3be3 expref: 793 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.631774:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034f81b17/0x3234de053c51abe lrc: 3/0,1 mode: PW/PW res: [0x2b82a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.631776:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034f81b17/0x3234de053c51abe lrc: 2/0,0 mode: PW/PW res: [0x2b82a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.631776:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e7f02909 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997020160:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.631792:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000afe7ff7b going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.631796:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51a94 lrc: 2/0,0 mode: PW/PW res: [0x2b824:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631800:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bfb594be already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.631801:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51a94 lrc: 2/0,0 mode: PW/PW res: [0x2b824:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631804:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51a94 lrc: 3/0,0 mode: PW/PW res: [0x2b824:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631808:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51a94 lrc: 1/0,0 mode: --/PW res: [0x2b824:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631813:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51a94 lrc: 0/0,0 mode: --/PW res: [0x2b824:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631818:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034f81b17/0x3234de053c51abe lrc: 2/0,0 mode: PW/PW res: [0x2b82a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.631819:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1267:39029:x1731745946482112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 915us (937us total) trans 12885079825 rc 0/0 00010000:00010000:0.0:1651529344.631820:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000034f81b17 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.631821:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034f81b17/0x3234de053c51abe lrc: 2/0,0 mode: PW/PW res: [0x2b82a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.631822:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211771 00010000:00010000:0.0:1651529344.631824:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034f81b17/0x3234de053c51abe lrc: 3/0,0 mode: PW/PW res: [0x2b82a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631827:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034f81b17/0x3234de053c51abe lrc: 1/0,0 mode: --/PW res: [0x2b82a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631830:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034f81b17/0x3234de053c51abe lrc: 0/0,0 mode: --/PW res: [0x2b82a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631836:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51ac5 lrc: 3/0,1 mode: PW/PW res: [0x2b82b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631839:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51ac5 lrc: 3/0,1 mode: PW/PW res: [0x2b82b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631842:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51ac5 lrc: 3/0,1 mode: PW/PW res: [0x2b82b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631845:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51ac5 lrc: 2/0,0 mode: PW/PW res: [0x2b82b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.631857:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.631874:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.631885:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.631890:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1267:39030:x1731745946482176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 986us (1072us total) trans 12885079826 rc 0/0 00000100:00100000:0.0:1651529344.631893:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211770 00000100:00100000:1.0:1651529344.631895:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.631899:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946482816 00000100:00100000:0.0:1651529344.631905:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946482880 00000100:00100000:0.0:1651529344.631913:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946482944 00000100:00100000:0.0:1651529344.631917:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946483008 00000100:00100000:0.0:1651529344.631921:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211773 00000100:00100000:0.0:1651529344.631922:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1270:39030:x1731745946482816:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.631927:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178221 count 1 00010000:00010000:0.0:1651529344.631931:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c51ad3 lrc: 3/0,1 mode: --/PW res: [0x2b82d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631936:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ca2dd9ce/0x3234de053c4e955 lrc: 2/0,0 mode: PR/PR res: [0x2b82d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d56bd expref: 793 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.631939:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.631939:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.631940:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c51ad3 lrc: 4/0,1 mode: --/PW res: [0x2b82d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.631946:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211774 00010000:00010000:0.0:1651529344.631946:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ca2dd9ce/0x3234de053c4e955 lrc: 3/0,0 mode: PR/PR res: [0x2b82d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d56bd expref: 793 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.631948:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1270:39029:x1731745946482880:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.631954:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178222 count 1 00010000:00010000:1.0:1651529344.631958:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003152710/0x3234de053c51ada lrc: 3/0,1 mode: --/PW res: [0x2b82e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.631963:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000342d8e80/0x3234de053c4ceac lrc: 2/0,0 mode: PR/PR res: [0x2b82e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cecac expref: 793 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.631966:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.631967:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.631967:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ca2dd9ce/0x3234de053c4e955 lrc: 4/0,0 mode: PR/PR res: [0x2b82d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d56bd expref: 793 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.631968:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003152710/0x3234de053c51ada lrc: 4/0,1 mode: --/PW res: [0x2b82e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.631972:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000be0ace91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997020224:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.631975:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000342d8e80/0x3234de053c4ceac lrc: 3/0,0 mode: PR/PR res: [0x2b82e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cecac expref: 793 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.631978:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000342d8e80/0x3234de053c4ceac lrc: 4/0,0 mode: PR/PR res: [0x2b82e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cecac expref: 793 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.631982:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000027c41311 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997020288:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.631987:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ff7bf023 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.631993:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51ac5 lrc: 2/0,0 mode: PW/PW res: [0x2b82b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.631996:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d5eeb0cd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.631997:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51ac5 lrc: 2/0,0 mode: PW/PW res: [0x2b82b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.631998:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.632000:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51ac5 lrc: 3/0,0 mode: PW/PW res: [0x2b82b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.632004:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211775 00010000:00010000:0.0:1651529344.632004:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51ac5 lrc: 1/0,0 mode: --/PW res: [0x2b82b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.632005:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1270:39030:x1731745946482944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.632007:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51ac5 lrc: 0/0,0 mode: --/PW res: [0x2b82b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.632010:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178223 count 1 00010000:00010000:1.0:1651529344.632013:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fb962f5/0x3234de053c51ae1 lrc: 3/0,1 mode: --/PW res: [0x2b82f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.632015:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211776 00010000:00010000:1.0:1651529344.632017:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000066c54aab/0x3234de053c4ca7d lrc: 2/0,0 mode: PR/PR res: [0x2b82f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdbaa expref: 793 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.632017:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1270:39029:x1731745946483008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.632021:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.632021:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.632022:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fb962f5/0x3234de053c51ae1 lrc: 4/0,1 mode: --/PW res: [0x2b82f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.632022:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178224 count 1 00010000:00010000:0.0:1651529344.632025:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51ae8 lrc: 3/0,1 mode: --/PW res: [0x2b830:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.632028:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000066c54aab/0x3234de053c4ca7d lrc: 3/0,0 mode: PR/PR res: [0x2b82f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdbaa expref: 793 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.632029:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008a2f0f44/0x3234de053c49fff lrc: 2/0,0 mode: PR/PR res: [0x2b830:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5b6 expref: 793 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.632031:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000066c54aab/0x3234de053c4ca7d lrc: 4/0,0 mode: PR/PR res: [0x2b82f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdbaa expref: 793 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.632032:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.632033:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.632034:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51ae8 lrc: 4/0,1 mode: --/PW res: [0x2b830:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.632035:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006731397d pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997020352:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.632040:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008a2f0f44/0x3234de053c49fff lrc: 3/0,0 mode: PR/PR res: [0x2b830:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5b6 expref: 793 pid: 72397 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.632041:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8a0b704 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.632055:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008a2f0f44/0x3234de053c49fff lrc: 4/0,0 mode: PR/PR res: [0x2b830:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5b6 expref: 793 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.632069:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000076d5f96b pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997020416:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.632079:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aac87b31 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.632116:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.632129:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.632137:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946483072 00000100:00100000:1.0:1651529344.632154:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.632165:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.632169:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946483136 00000100:00100000:1.0:1651529344.632174:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396363776 00000100:00100000:0.0:1651529344.632178:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946483200 00000100:00100000:0.0:1651529344.632184:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211777 00000100:00100000:0.0:1651529344.632186:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1273:39030:x1731745946483072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.632189:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008b3a2f01/0x3234de053c4e2a2 lrc: 5/0,0 mode: PR/PR res: [0x2b82c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3be3 expref: 794 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:0.0:1651529344.632191:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178225 count 1 00010000:00010000:0.0:1651529344.632195:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51aef lrc: 3/0,1 mode: --/PW res: [0x2b831:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.632197:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12554 00000100:00100000:1.0:1651529344.632199:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bbea9917 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+794:41278:x1731746396363776:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.632199:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c4ecce lrc: 2/0,0 mode: PR/PR res: [0x2b831:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6526 expref: 794 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.632201:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.632203:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008b3a2f01/0x3234de053c4e2a2 lrc: 5/0,0 mode: PR/PR res: [0x2b82c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3be3 expref: 794 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.632203:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.632203:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.632204:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51aef lrc: 4/0,1 mode: --/PW res: [0x2b831:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.632206:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008b3a2f01/0x3234de053c4e2a2 lrc: 4/0,0 mode: PR/PR res: [0x2b82c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3be3 expref: 794 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.632210:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c4ecce lrc: 3/0,0 mode: PR/PR res: [0x2b831:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6526 expref: 794 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.632212:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.632212:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.632213:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51acc lrc: 3/0,1 mode: PW/PW res: [0x2b82c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632213:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c4ecce lrc: 4/0,0 mode: PR/PR res: [0x2b831:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6526 expref: 794 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.632216:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51acc lrc: 4/0,1 mode: PW/PW res: [0x2b82c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.632218:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d28c414b pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997020480:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.632221:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.632244:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bbea9917 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+794:41278:x1731746396363776:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 45us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.632247:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12554 00000100:00100000:1.0:1651529344.632259:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211778 00000100:00100000:1.0:1651529344.632260:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1273:39029:x1731745946483136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.632265:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178226 count 1 00000100:00100000:0.0:1651529344.632268:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c2b2b59c going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.632269:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc67b411/0x3234de053c51af6 lrc: 3/0,1 mode: --/PW res: [0x2b832:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.632273:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000509ea615/0x3234de053c4cfa1 lrc: 2/0,0 mode: PR/PR res: [0x2b832:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf01e expref: 793 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.632276:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211779 00010000:00010000:1.0:1651529344.632277:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.632277:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.632278:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc67b411/0x3234de053c51af6 lrc: 4/0,1 mode: --/PW res: [0x2b832:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.632278:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1273:39030:x1731745946483200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.632283:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178227 count 1 00010000:00010000:1.0:1651529344.632284:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000509ea615/0x3234de053c4cfa1 lrc: 3/0,0 mode: PR/PR res: [0x2b832:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf01e expref: 793 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.632287:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000509ea615/0x3234de053c4cfa1 lrc: 4/0,0 mode: PR/PR res: [0x2b832:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf01e expref: 793 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.632287:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51afd lrc: 3/0,1 mode: --/PW res: [0x2b833:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.632291:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000de0edbdc pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997020544:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.632299:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a6b79b05 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.632304:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a8e6813d/0x3234de053c4a0a0 lrc: 2/0,0 mode: PR/PR res: [0x2b833:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb833 expref: 793 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.632307:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.632308:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.632308:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51afd lrc: 4/0,1 mode: --/PW res: [0x2b833:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632318:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a8e6813d/0x3234de053c4a0a0 lrc: 3/0,0 mode: PR/PR res: [0x2b833:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb833 expref: 793 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.632322:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a8e6813d/0x3234de053c4a0a0 lrc: 4/0,0 mode: PR/PR res: [0x2b833:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb833 expref: 793 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.632326:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000066de8c9f pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997020608:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.632339:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c0dff858 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.632349:0:80276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b3a2f01/0x3234de053c4e2a2 lrc: 0/0,0 mode: --/PR res: [0x2b82c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3be3 expref: 793 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.632353:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e7f02909 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997020160:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.632357:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51acc lrc: 3/0,1 mode: PW/PW res: [0x2b82c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632360:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51acc lrc: 3/0,1 mode: PW/PW res: [0x2b82c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632363:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51acc lrc: 3/0,1 mode: PW/PW res: [0x2b82c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632366:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51acc lrc: 3/0,1 mode: PW/PW res: [0x2b82c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632368:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51acc lrc: 2/0,0 mode: PW/PW res: [0x2b82c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.632430:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1274:39030:x1731745946482496:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 719us (900us total) trans 12885079827 rc 0/0 00000100:00100000:0.0:1651529344.632433:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211772 00010000:00010000:0.0:1651529344.632440:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51acc lrc: 2/0,0 mode: PW/PW res: [0x2b82c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632444:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000acc438d7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.632445:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51acc lrc: 2/0,0 mode: PW/PW res: [0x2b82c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632448:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51acc lrc: 3/0,0 mode: PW/PW res: [0x2b82c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632452:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51acc lrc: 1/0,0 mode: --/PW res: [0x2b82c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632455:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51acc lrc: 0/0,0 mode: --/PW res: [0x2b82c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.632487:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000027c41311 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997020288:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.632492:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000003152710/0x3234de053c51ada lrc: 3/0,1 mode: --/PW res: [0x2b82e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.632494:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000076d5f96b pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997020416:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.632498:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51ae8 lrc: 3/0,1 mode: --/PW res: [0x2b830:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.632500:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006731397d pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997020352:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.632502:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004fb962f5/0x3234de053c51ae1 lrc: 3/0,1 mode: --/PW res: [0x2b82f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.632505:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000be0ace91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997020224:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.632507:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c51ad3 lrc: 3/0,1 mode: --/PW res: [0x2b82d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.632569:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.632579:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946483520 00000100:00100000:0.0:1651529344.632587:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211780 00000100:00100000:0.0:1651529344.632588:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1274:39030:x1731745946483520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.632594:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178228 count 1 00010000:00010000:0.0:1651529344.632597:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51b04 lrc: 3/0,1 mode: --/PW res: [0x2b834:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632602:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001e16b1b3/0x3234de053c4d7dc lrc: 2/0,0 mode: PR/PR res: [0x2b834:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d10c4 expref: 792 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.632605:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.632605:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.632606:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51b04 lrc: 4/0,1 mode: --/PW res: [0x2b834:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632612:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001e16b1b3/0x3234de053c4d7dc lrc: 3/0,0 mode: PR/PR res: [0x2b834:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d10c4 expref: 792 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.632616:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001e16b1b3/0x3234de053c4d7dc lrc: 4/0,0 mode: PR/PR res: [0x2b834:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d10c4 expref: 792 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.632620:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000be0ace91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997020672:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.632631:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aac87b31 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.632676:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.632698:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396363968 00000100:00100000:1.0:1651529344.632700:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.632704:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000066c54aab/0x3234de053c4ca7d lrc: 4/0,0 mode: PR/PR res: [0x2b82f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdbaa expref: 793 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.632709:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.632717:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396363840 00000100:00100000:1.0:1651529344.632720:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.632720:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ca2dd9ce/0x3234de053c4e955 lrc: 4/0,0 mode: PR/PR res: [0x2b82d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d56bd expref: 794 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.632725:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396364032 00010000:00010000:0.0:1651529344.632727:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008a2f0f44/0x3234de053c49fff lrc: 4/0,0 mode: PR/PR res: [0x2b830:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5b6 expref: 795 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.632745:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.632746:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396363904 00010000:00010000:0.0:1651529344.632749:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000342d8e80/0x3234de053c4ceac lrc: 4/0,0 mode: PR/PR res: [0x2b82e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cecac expref: 796 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.632750:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.632754:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396364224 00010000:00010000:0.0:1651529344.632756:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c4ecce lrc: 5/0,0 mode: PR/PR res: [0x2b831:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6526 expref: 797 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.632763:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396364288 00000100:00100000:0.0:1651529344.632766:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12555 00000100:00100000:0.0:1651529344.632768:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+798:41279:x1731746396363968:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.632769:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000509ea615/0x3234de053c4cfa1 lrc: 5/0,0 mode: PR/PR res: [0x2b832:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf01e expref: 798 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.632771:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.632773:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000066c54aab/0x3234de053c4ca7d lrc: 4/0,0 mode: PR/PR res: [0x2b82f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdbaa expref: 798 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.632775:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12556 00010000:00010000:0.0:1651529344.632776:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000066c54aab/0x3234de053c4ca7d lrc: 3/0,0 mode: PR/PR res: [0x2b82f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdbaa expref: 798 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.632777:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+798:41278:x1731746396363840:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.632780:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.632781:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ca2dd9ce/0x3234de053c4e955 lrc: 4/0,0 mode: PR/PR res: [0x2b82d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d56bd expref: 798 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.632782:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066c54aab/0x3234de053c4ca7d lrc: 0/0,0 mode: --/PR res: [0x2b82f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdbaa expref: 798 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.632785:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ca2dd9ce/0x3234de053c4e955 lrc: 3/0,0 mode: PR/PR res: [0x2b82d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d56bd expref: 797 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.632786:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.632787:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.632787:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004fb962f5/0x3234de053c51ae1 lrc: 3/0,1 mode: PW/PW res: [0x2b82f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.632791:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca2dd9ce/0x3234de053c4e955 lrc: 0/0,0 mode: --/PR res: [0x2b82d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d56bd expref: 797 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.632791:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fb962f5/0x3234de053c51ae1 lrc: 4/0,1 mode: PW/PW res: [0x2b82f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.632795:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.632796:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.632796:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c51ad3 lrc: 3/0,1 mode: PW/PW res: [0x2b82d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632800:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.632806:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c51ad3 lrc: 4/0,1 mode: PW/PW res: [0x2b82d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.632810:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+796:41279:x1731746396363968:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 41us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.632813:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12555 00010000:00010000:1.0:1651529344.632815:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.632822:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12557 00000100:00100000:1.0:1651529344.632823:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+795:41278:x1731746396363840:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 45us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.632824:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+795:41279:x1731746396364032:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.632825:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12556 00010000:00010000:0.0:1651529344.632827:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.632829:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008a2f0f44/0x3234de053c49fff lrc: 4/0,0 mode: PR/PR res: [0x2b830:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5b6 expref: 794 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.632831:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12558 00000100:00100000:1.0:1651529344.632832:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+794:41278:x1731746396363904:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.632832:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008a2f0f44/0x3234de053c49fff lrc: 3/0,0 mode: PR/PR res: [0x2b830:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5b6 expref: 794 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.632835:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.632836:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000342d8e80/0x3234de053c4ceac lrc: 4/0,0 mode: PR/PR res: [0x2b82e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cecac expref: 794 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.632837:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a2f0f44/0x3234de053c49fff lrc: 0/0,0 mode: --/PR res: [0x2b830:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5b6 expref: 794 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.632840:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000342d8e80/0x3234de053c4ceac lrc: 3/0,0 mode: PR/PR res: [0x2b82e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cecac expref: 793 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.632841:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.632841:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.632842:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51ae8 lrc: 3/0,1 mode: PW/PW res: [0x2b830:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.632845:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000342d8e80/0x3234de053c4ceac lrc: 0/0,0 mode: --/PR res: [0x2b82e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cecac expref: 793 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.632845:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51ae8 lrc: 4/0,1 mode: PW/PW res: [0x2b830:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.632849:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.632850:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.632850:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000003152710/0x3234de053c51ada lrc: 3/0,1 mode: PW/PW res: [0x2b82e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632851:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.632853:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003152710/0x3234de053c51ada lrc: 4/0,1 mode: PW/PW res: [0x2b82e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.632860:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.632864:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+792:41278:x1731746396363904:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 31us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.632867:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12558 00000100:00100000:1.0:1651529344.632871:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12559 00000100:00100000:0.0:1651529344.632875:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+791:41279:x1731746396364032:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 32us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.632878:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+791:41278:x1731746396364224:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.632879:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12557 00010000:00010000:1.0:1651529344.632881:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.632883:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c4ecce lrc: 5/0,0 mode: PR/PR res: [0x2b831:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6526 expref: 790 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.632884:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12560 00000100:00100000:0.0:1651529344.632885:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+790:41278:x1731746396364288:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.632886:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c4ecce lrc: 4/0,0 mode: PR/PR res: [0x2b831:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6526 expref: 790 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.632888:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.632890:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000509ea615/0x3234de053c4cfa1 lrc: 5/0,0 mode: PR/PR res: [0x2b832:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf01e expref: 790 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.632891:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.632892:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.632892:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51aef lrc: 3/0,1 mode: PW/PW res: [0x2b831:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632894:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000509ea615/0x3234de053c4cfa1 lrc: 4/0,0 mode: PR/PR res: [0x2b832:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf01e expref: 790 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.632895:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51aef lrc: 4/0,1 mode: PW/PW res: [0x2b831:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.632899:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.632899:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.632900:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.632900:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dc67b411/0x3234de053c51af6 lrc: 3/0,1 mode: PW/PW res: [0x2b832:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632903:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc67b411/0x3234de053c51af6 lrc: 4/0,1 mode: PW/PW res: [0x2b832:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.632904:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+790:41278:x1731746396364224:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 31us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.632906:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12559 00010000:00010000:0.0:1651529344.632908:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.632914:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+789:41278:x1731746396364288:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 28us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.632917:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12560 00010000:00010000:1.0:1651529344.632918:0:72396:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000509ea615/0x3234de053c4cfa1 lrc: 0/0,0 mode: --/PR res: [0x2b832:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf01e expref: 789 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.632921:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000de0edbdc pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997020544:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.632923:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51ae8 lrc: 3/0,1 mode: PW/PW res: [0x2b830:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.632925:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dc67b411/0x3234de053c51af6 lrc: 3/0,1 mode: PW/PW res: [0x2b832:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632926:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51ae8 lrc: 3/0,1 mode: PW/PW res: [0x2b830:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.632930:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dc67b411/0x3234de053c51af6 lrc: 3/0,1 mode: PW/PW res: [0x2b832:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632930:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51ae8 lrc: 3/0,1 mode: PW/PW res: [0x2b830:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632932:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51ae8 lrc: 2/0,0 mode: PW/PW res: [0x2b830:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.632933:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc67b411/0x3234de053c51af6 lrc: 3/0,1 mode: PW/PW res: [0x2b832:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.632936:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc67b411/0x3234de053c51af6 lrc: 3/0,1 mode: PW/PW res: [0x2b832:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.632939:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc67b411/0x3234de053c51af6 lrc: 2/0,0 mode: PW/PW res: [0x2b832:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.632979:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1276:39029:x1731745946483008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 961us (1083us total) trans 12885079828 rc 0/0 00000100:00100000:0.0:1651529344.632982:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211776 00000100:00100000:1.0:1651529344.632985:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1275:39029:x1731745946483136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 723us (831us total) trans 12885079829 rc 0/0 00000100:00100000:1.0:1651529344.632988:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211778 00010000:00010000:0.0:1651529344.632988:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51ae8 lrc: 2/0,0 mode: PW/PW res: [0x2b830:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632992:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000073043e99 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.632993:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51ae8 lrc: 2/0,0 mode: PW/PW res: [0x2b830:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.632995:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004fb962f5/0x3234de053c51ae1 lrc: 3/0,1 mode: PW/PW res: [0x2b82f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.632996:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51ae8 lrc: 3/0,0 mode: PW/PW res: [0x2b830:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.632998:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004fb962f5/0x3234de053c51ae1 lrc: 3/0,1 mode: PW/PW res: [0x2b82f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.633001:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fb962f5/0x3234de053c51ae1 lrc: 3/0,1 mode: PW/PW res: [0x2b82f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633003:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51ae8 lrc: 1/0,0 mode: --/PW res: [0x2b830:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.633004:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004fb962f5/0x3234de053c51ae1 lrc: 2/0,0 mode: PW/PW res: [0x2b82f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633005:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51ae8 lrc: 0/0,0 mode: --/PW res: [0x2b830:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633009:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc67b411/0x3234de053c51af6 lrc: 2/0,0 mode: PW/PW res: [0x2b832:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633012:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dc67b411 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.633019:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc67b411/0x3234de053c51af6 lrc: 2/0,0 mode: PW/PW res: [0x2b832:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633023:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc67b411/0x3234de053c51af6 lrc: 3/0,0 mode: PW/PW res: [0x2b832:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633026:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc67b411/0x3234de053c51af6 lrc: 1/0,0 mode: --/PW res: [0x2b832:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633029:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc67b411/0x3234de053c51af6 lrc: 0/0,0 mode: --/PW res: [0x2b832:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633033:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004fb962f5/0x3234de053c51ae1 lrc: 2/0,0 mode: PW/PW res: [0x2b82f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633035:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004fb962f5 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.633036:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004fb962f5/0x3234de053c51ae1 lrc: 2/0,0 mode: PW/PW res: [0x2b82f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633039:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004fb962f5/0x3234de053c51ae1 lrc: 3/0,0 mode: PW/PW res: [0x2b82f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633042:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004fb962f5/0x3234de053c51ae1 lrc: 1/0,0 mode: --/PW res: [0x2b82f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.633043:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1275:39030:x1731745946482944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1037us (1158us total) trans 12885079830 rc 0/0 00010000:00010000:0.0:1651529344.633044:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004fb962f5/0x3234de053c51ae1 lrc: 0/0,0 mode: --/PW res: [0x2b82f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.633046:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211775 00010000:00010000:1.0:1651529344.633052:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000003152710/0x3234de053c51ada lrc: 3/0,1 mode: PW/PW res: [0x2b82e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.633055:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000066de8c9f pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997020608:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.633056:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003152710/0x3234de053c51ada lrc: 3/0,1 mode: PW/PW res: [0x2b82e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633058:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51afd lrc: 3/0,1 mode: --/PW res: [0x2b833:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.633059:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003152710/0x3234de053c51ada lrc: 3/0,1 mode: PW/PW res: [0x2b82e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.633061:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003152710/0x3234de053c51ada lrc: 2/0,0 mode: PW/PW res: [0x2b82e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633092:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003152710/0x3234de053c51ada lrc: 2/0,0 mode: PW/PW res: [0x2b82e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633095:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000003152710 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.633096:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003152710/0x3234de053c51ada lrc: 2/0,0 mode: PW/PW res: [0x2b82e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633099:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003152710/0x3234de053c51ada lrc: 3/0,0 mode: PW/PW res: [0x2b82e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633104:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003152710/0x3234de053c51ada lrc: 1/0,0 mode: --/PW res: [0x2b82e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.633105:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1275:39029:x1731745946482880:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1156us (1231us total) trans 12885079831 rc 0/0 00000100:00100000:1.0:1651529344.633108:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211774 00010000:00010000:0.0:1651529344.633109:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003152710/0x3234de053c51ada lrc: 0/0,0 mode: --/PW res: [0x2b82e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633117:0:106695:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c4ecce lrc: 0/0,0 mode: --/PR res: [0x2b831:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6526 expref: 787 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.633121:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d28c414b pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997020480:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.633123:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.633124:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51aef lrc: 3/0,1 mode: PW/PW res: [0x2b831:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633127:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51aef lrc: 3/0,1 mode: PW/PW res: [0x2b831:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633135:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51aef lrc: 3/0,1 mode: PW/PW res: [0x2b831:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633139:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51aef lrc: 3/0,1 mode: PW/PW res: [0x2b831:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633146:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51aef lrc: 2/0,0 mode: PW/PW res: [0x2b831:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.633151:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.633184:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1275:39030:x1731745946483072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 997us (1055us total) trans 12885079832 rc 0/0 00000100:00100000:0.0:1651529344.633187:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211777 00010000:00010000:0.0:1651529344.633194:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51aef lrc: 2/0,0 mode: PW/PW res: [0x2b831:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633197:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e6b94407 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.633198:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51aef lrc: 2/0,0 mode: PW/PW res: [0x2b831:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633201:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51aef lrc: 3/0,0 mode: PW/PW res: [0x2b831:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633205:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51aef lrc: 1/0,0 mode: --/PW res: [0x2b831:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633208:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51aef lrc: 0/0,0 mode: --/PW res: [0x2b831:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633214:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c51ad3 lrc: 3/0,1 mode: PW/PW res: [0x2b82d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633217:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c51ad3 lrc: 3/0,1 mode: PW/PW res: [0x2b82d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633220:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c51ad3 lrc: 3/0,1 mode: PW/PW res: [0x2b82d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633253:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c51ad3 lrc: 2/0,0 mode: PW/PW res: [0x2b82d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.633266:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396364352 00010000:00010000:1.0:1651529344.633272:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a8e6813d/0x3234de053c4a0a0 lrc: 4/0,0 mode: PR/PR res: [0x2b833:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb833 expref: 787 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.633279:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396364480 00010000:00010000:1.0:1651529344.633282:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001e16b1b3/0x3234de053c4d7dc lrc: 5/0,0 mode: PR/PR res: [0x2b834:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d10c4 expref: 788 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.633287:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12561 00000100:00100000:1.0:1651529344.633289:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d9169e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+788:41279:x1731746396364352:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.633292:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.633293:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a8e6813d/0x3234de053c4a0a0 lrc: 4/0,0 mode: PR/PR res: [0x2b833:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb833 expref: 788 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.633297:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a8e6813d/0x3234de053c4a0a0 lrc: 3/0,0 mode: PR/PR res: [0x2b833:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb833 expref: 788 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.633302:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8e6813d/0x3234de053c4a0a0 lrc: 0/0,0 mode: --/PR res: [0x2b833:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb833 expref: 788 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.633306:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.633306:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.633311:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1275:39030:x1731745946482816:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1387us (1454us total) trans 12885079833 rc 0/0 00010000:00010000:1.0:1651529344.633313:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51afd lrc: 3/0,1 mode: PW/PW res: [0x2b833:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.633314:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211773 00010000:00010000:1.0:1651529344.633317:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51afd lrc: 4/0,1 mode: PW/PW res: [0x2b833:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633322:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c51ad3 lrc: 2/0,0 mode: PW/PW res: [0x2b82d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.633326:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.633330:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5c1b0ba already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.633332:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c51ad3 lrc: 2/0,0 mode: PW/PW res: [0x2b82d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.633334:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d9169e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+787:41279:x1731746396364352:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 44us (211us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.633335:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c51ad3 lrc: 3/0,0 mode: PW/PW res: [0x2b82d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.633336:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12561 00010000:00010000:0.0:1651529344.633340:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c51ad3 lrc: 1/0,0 mode: --/PW res: [0x2b82d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633342:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c51ad3 lrc: 0/0,0 mode: --/PW res: [0x2b82d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.633344:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12562 00000100:00100000:1.0:1651529344.633346:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+786:41278:x1731746396364480:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.633348:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51afd lrc: 3/0,1 mode: PW/PW res: [0x2b833:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.633349:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.633350:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001e16b1b3/0x3234de053c4d7dc lrc: 5/0,0 mode: PR/PR res: [0x2b834:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d10c4 expref: 786 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.633351:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51afd lrc: 3/0,1 mode: PW/PW res: [0x2b833:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.633354:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001e16b1b3/0x3234de053c4d7dc lrc: 4/0,0 mode: PR/PR res: [0x2b834:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d10c4 expref: 786 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.633354:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51afd lrc: 3/0,1 mode: PW/PW res: [0x2b833:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633357:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51afd lrc: 2/0,0 mode: PW/PW res: [0x2b833:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.633358:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.633359:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.633359:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51b04 lrc: 3/0,1 mode: PW/PW res: [0x2b834:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.633362:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51b04 lrc: 4/0,1 mode: PW/PW res: [0x2b834:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.633366:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.633370:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+786:41278:x1731746396364480:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 24us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.633373:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12562 00000100:00100000:0.0:1651529344.633428:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1275:39030:x1731745946483200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1149us (1262us total) trans 12885079834 rc 0/0 00000100:00100000:1.0:1651529344.633431:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.633431:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211779 00000100:00100000:0.0:1651529344.633444:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946483776 00000100:00100000:1.0:1651529344.633447:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.633451:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946483712 00000100:00100000:0.0:1651529344.633459:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211781 00000100:00100000:0.0:1651529344.633461:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1276:39029:x1731745946483776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.633466:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178230 count 1 00010000:00010000:0.0:1651529344.633470:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51b0b lrc: 3/0,1 mode: --/PW res: [0x2b836:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633475:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cbf7f641/0x3234de053c4ef67 lrc: 2/0,0 mode: PR/PR res: [0x2b836:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f7c expref: 785 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.633478:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.633478:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.633479:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51b0b lrc: 4/0,1 mode: --/PW res: [0x2b836:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.633482:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.633486:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cbf7f641/0x3234de053c4ef67 lrc: 3/0,0 mode: PR/PR res: [0x2b836:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f7c expref: 785 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.633489:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cbf7f641/0x3234de053c4ef67 lrc: 4/0,0 mode: PR/PR res: [0x2b836:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f7c expref: 785 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.633493:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d28c414b pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997020736:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.633503:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e1aa6a77 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.633508:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.633530:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51afd lrc: 2/0,0 mode: PW/PW res: [0x2b833:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633533:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000037fb8315 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.633534:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51afd lrc: 2/0,0 mode: PW/PW res: [0x2b833:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633537:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51afd lrc: 3/0,0 mode: PW/PW res: [0x2b833:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.633540:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.633551:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946483904 00000100:00100000:1.0:1651529344.633557:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946483840 00010000:00010000:0.0:1651529344.633563:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51afd lrc: 1/0,0 mode: --/PW res: [0x2b833:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633566:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51afd lrc: 0/0,0 mode: --/PW res: [0x2b833:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.633567:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946483968 00000100:00100000:1.0:1651529344.633572:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211782 00000100:00100000:1.0:1651529344.633574:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1279:39030:x1731745946483712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.633579:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178229 count 1 00010000:00010000:1.0:1651529344.633583:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060da8203/0x3234de053c51b12 lrc: 3/0,1 mode: --/PW res: [0x2b835:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.633585:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211783 00000100:00100000:0.0:1651529344.633587:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1279:39029:x1731745946483904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.633588:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c4df37 lrc: 2/0,0 mode: PR/PR res: [0x2b835:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e0d expref: 785 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.633591:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.633591:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.633592:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060da8203/0x3234de053c51b12 lrc: 4/0,1 mode: --/PW res: [0x2b835:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.633593:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178232 count 1 00010000:00010000:0.0:1651529344.633596:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51b19 lrc: 3/0,1 mode: --/PW res: [0x2b838:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.633599:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c4df37 lrc: 3/0,0 mode: PR/PR res: [0x2b835:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e0d expref: 785 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.633601:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001e521674/0x3234de053c4d486 lrc: 2/0,0 mode: PR/PR res: [0x2b838:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0406 expref: 785 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.633602:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c4df37 lrc: 4/0,0 mode: PR/PR res: [0x2b835:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e0d expref: 785 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.633604:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.633604:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.633605:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51b19 lrc: 4/0,1 mode: --/PW res: [0x2b838:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.633606:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000027c41311 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997020800:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.633615:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 0000000053a0cffa going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.633622:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211784 00000100:00100000:1.0:1651529344.633623:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1279:39030:x1731745946483840:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.633627:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178231 count 1 00010000:00010000:0.0:1651529344.633634:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001e521674/0x3234de053c4d486 lrc: 3/0,0 mode: PR/PR res: [0x2b838:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0406 expref: 785 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.633638:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001e521674/0x3234de053c4d486 lrc: 4/0,0 mode: PR/PR res: [0x2b838:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0406 expref: 785 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.633640:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000662594c3/0x3234de053c51b20 lrc: 3/0,1 mode: --/PW res: [0x2b837:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.633647:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c4ec26 lrc: 2/0,0 mode: PR/PR res: [0x2b837:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6224 expref: 785 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.633650:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.633651:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.633652:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000662594c3/0x3234de053c51b20 lrc: 4/0,1 mode: --/PW res: [0x2b837:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.633652:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000066de8c9f pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997020864:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.633658:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c4ec26 lrc: 3/0,0 mode: PR/PR res: [0x2b837:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6224 expref: 785 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.633661:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c4ec26 lrc: 4/0,0 mode: PR/PR res: [0x2b837:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6224 expref: 785 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.633661:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c2b2b59c going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.633665:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000059363096 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997020928:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.633668:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211785 00000100:00100000:0.0:1651529344.633670:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1279:39030:x1731745946483968:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.633673:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b7af823 going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.633674:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178233 count 1 00010000:00010000:0.0:1651529344.633678:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51b27 lrc: 3/0,1 mode: --/PW res: [0x2b839:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633682:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000be58d33b/0x3234de053c4db0f lrc: 2/0,0 mode: PR/PR res: [0x2b839:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c55 expref: 785 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.633685:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.633686:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.633687:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.633687:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51b27 lrc: 4/0,1 mode: --/PW res: [0x2b839:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633693:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000be58d33b/0x3234de053c4db0f lrc: 3/0,0 mode: PR/PR res: [0x2b839:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c55 expref: 785 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.633699:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000be58d33b/0x3234de053c4db0f lrc: 4/0,0 mode: PR/PR res: [0x2b839:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c55 expref: 785 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.633702:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000076d5f96b pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997020992:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.633716:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.633729:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c0dff858 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.633746:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d28c414b pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997020736:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.633750:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51b0b lrc: 3/0,1 mode: --/PW res: [0x2b836:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.633755:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.633758:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946484032 00000100:00100000:0.0:1651529344.633767:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946484096 00000100:00100000:0.0:1651529344.633773:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211786 00000100:00100000:0.0:1651529344.633775:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1281:39030:x1731745946484032:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.633779:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178234 count 1 00010000:00010000:0.0:1651529344.633784:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51b2e lrc: 3/0,1 mode: --/PW res: [0x2b83a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633788:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006455a7db/0x3234de053c49fe3 lrc: 2/0,0 mode: PR/PR res: [0x2b83a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb58c expref: 785 pid: 80276 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.633791:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211787 00010000:00010000:0.0:1651529344.633791:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.633792:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.633792:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51b2e lrc: 4/0,1 mode: --/PW res: [0x2b83a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.633793:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1281:39030:x1731745946484096:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.633798:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006455a7db/0x3234de053c49fe3 lrc: 3/0,0 mode: PR/PR res: [0x2b83a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb58c expref: 785 pid: 80276 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.633799:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178235 count 1 00010000:00010000:0.0:1651529344.633802:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006455a7db/0x3234de053c49fe3 lrc: 4/0,0 mode: PR/PR res: [0x2b83a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb58c expref: 785 pid: 80276 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.633803:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069e35989/0x3234de053c51b35 lrc: 3/0,1 mode: --/PW res: [0x2b83b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.633806:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d28c414b pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997021056:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.633807:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ccc8a2af/0x3234de053c4e596 lrc: 2/0,0 mode: PR/PR res: [0x2b83b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d47c1 expref: 785 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.633810:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.633811:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.633812:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069e35989/0x3234de053c51b35 lrc: 4/0,1 mode: --/PW res: [0x2b83b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.633818:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bff8744a going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.633825:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ccc8a2af/0x3234de053c4e596 lrc: 3/0,0 mode: PR/PR res: [0x2b83b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d47c1 expref: 785 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.633829:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ccc8a2af/0x3234de053c4e596 lrc: 4/0,0 mode: PR/PR res: [0x2b83b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d47c1 expref: 785 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.633833:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002c4168d4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997021120:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.633842:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 0000000018ebe812 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.633842:0:80276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e16b1b3/0x3234de053c4d7dc lrc: 0/0,0 mode: --/PR res: [0x2b834:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d10c4 expref: 785 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.633847:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000be0ace91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997020672:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.633848:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396364800 00010000:00010000:0.0:1651529344.633850:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51b04 lrc: 3/0,1 mode: PW/PW res: [0x2b834:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.633853:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cbf7f641/0x3234de053c4ef67 lrc: 4/0,0 mode: PR/PR res: [0x2b836:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f7c expref: 785 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.633854:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51b04 lrc: 3/0,1 mode: PW/PW res: [0x2b834:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633857:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51b04 lrc: 3/0,1 mode: PW/PW res: [0x2b834:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.633860:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12563 00010000:00010000:0.0:1651529344.633860:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51b04 lrc: 3/0,1 mode: PW/PW res: [0x2b834:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.633862:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+785:41279:x1731746396364800:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.633862:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51b04 lrc: 2/0,0 mode: PW/PW res: [0x2b834:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.633864:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.633866:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cbf7f641/0x3234de053c4ef67 lrc: 4/0,0 mode: PR/PR res: [0x2b836:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f7c expref: 785 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.633869:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cbf7f641/0x3234de053c4ef67 lrc: 3/0,0 mode: PR/PR res: [0x2b836:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f7c expref: 785 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.633877:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cbf7f641/0x3234de053c4ef67 lrc: 0/0,0 mode: --/PR res: [0x2b836:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f7c expref: 785 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.633881:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.633882:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.633883:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51b0b lrc: 3/0,1 mode: PW/PW res: [0x2b836:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.633886:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51b0b lrc: 4/0,1 mode: PW/PW res: [0x2b836:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.633896:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.633902:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+784:41279:x1731746396364800:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.633905:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12563 00000100:00100000:0.0:1651529344.633909:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1282:39030:x1731745946483520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1319us (1340us total) trans 12885079835 rc 0/0 00000100:00100000:0.0:1651529344.633912:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211780 00010000:00010000:0.0:1651529344.633919:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51b04 lrc: 2/0,0 mode: PW/PW res: [0x2b834:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633922:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088cc87df already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.633923:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51b04 lrc: 2/0,0 mode: PW/PW res: [0x2b834:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633926:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51b04 lrc: 3/0,0 mode: PW/PW res: [0x2b834:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633931:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51b04 lrc: 1/0,0 mode: --/PW res: [0x2b834:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633934:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51b04 lrc: 0/0,0 mode: --/PW res: [0x2b834:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633939:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51b0b lrc: 3/0,1 mode: PW/PW res: [0x2b836:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633942:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51b0b lrc: 3/0,1 mode: PW/PW res: [0x2b836:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633945:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51b0b lrc: 3/0,1 mode: PW/PW res: [0x2b836:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.633948:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51b0b lrc: 2/0,0 mode: PW/PW res: [0x2b836:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.633989:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1282:39029:x1731745946483776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 527us (558us total) trans 12885079836 rc 0/0 00000100:00100000:0.0:1651529344.633992:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211781 00010000:00010000:0.0:1651529344.633998:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51b0b lrc: 2/0,0 mode: PW/PW res: [0x2b836:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634002:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000495c20c9 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.634003:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51b0b lrc: 2/0,0 mode: PW/PW res: [0x2b836:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634006:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51b0b lrc: 3/0,0 mode: PW/PW res: [0x2b836:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634010:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51b0b lrc: 1/0,0 mode: --/PW res: [0x2b836:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634013:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51b0b lrc: 0/0,0 mode: --/PW res: [0x2b836:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.634091:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.634102:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946484608 00000100:00100000:0.0:1651529344.634132:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211788 00000100:00100000:0.0:1651529344.634134:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1282:39030:x1731745946484608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.634139:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178236 count 1 00010000:00010000:0.0:1651529344.634143:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51b3c lrc: 3/0,1 mode: --/PW res: [0x2b83c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634174:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008513649d/0x3234de053c4eff3 lrc: 2/0,0 mode: PR/PR res: [0x2b83c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d725b expref: 783 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.634178:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.634179:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.634179:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51b3c lrc: 4/0,1 mode: --/PW res: [0x2b83c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634187:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008513649d/0x3234de053c4eff3 lrc: 3/0,0 mode: PR/PR res: [0x2b83c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d725b expref: 783 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.634190:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008513649d/0x3234de053c4eff3 lrc: 4/0,0 mode: PR/PR res: [0x2b83c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d725b expref: 783 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.634194:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000be0ace91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997021184:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.634210:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ff7bf023 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.634212:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.634218:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000066de8c9f pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997020864:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.634239:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51b19 lrc: 3/0,1 mode: --/PW res: [0x2b838:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.634247:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946484672 00000100:00100000:0.0:1651529344.634257:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211789 00000100:00100000:0.0:1651529344.634259:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1283:39030:x1731745946484672:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.634264:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178237 count 1 00010000:00010000:0.0:1651529344.634268:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51b43 lrc: 3/0,1 mode: --/PW res: [0x2b83d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.634277:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.634278:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000719ce468/0x3234de053c4d91e lrc: 2/0,0 mode: PR/PR res: [0x2b83d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d154e expref: 783 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.634286:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.634286:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.634287:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.634287:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51b43 lrc: 4/0,1 mode: --/PW res: [0x2b83d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.634292:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.634294:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000719ce468/0x3234de053c4d91e lrc: 3/0,0 mode: PR/PR res: [0x2b83d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d154e expref: 783 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.634297:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000719ce468/0x3234de053c4d91e lrc: 4/0,0 mode: PR/PR res: [0x2b83d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d154e expref: 783 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.634298:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.634301:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000066de8c9f pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997021248:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.634309:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000027c41311 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997020800:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.634315:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aac87b31 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.634318:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000060da8203/0x3234de053c51b12 lrc: 3/0,1 mode: --/PW res: [0x2b835:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.634323:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000076d5f96b pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997020992:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.634326:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000059363096 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997020928:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.634326:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51b27 lrc: 3/0,1 mode: --/PW res: [0x2b839:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.634330:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000662594c3/0x3234de053c51b20 lrc: 3/0,1 mode: --/PW res: [0x2b837:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.634335:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396364928 00010000:00010000:1.0:1651529344.634340:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c4ec26 lrc: 4/0,0 mode: PR/PR res: [0x2b837:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6224 expref: 784 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.634345:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396365056 00010000:00010000:1.0:1651529344.634347:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c4df37 lrc: 4/0,0 mode: PR/PR res: [0x2b835:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e0d expref: 785 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.634351:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396364992 00000100:00100000:0.0:1651529344.634355:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396365120 00010000:00010000:0.0:1651529344.634360:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000be58d33b/0x3234de053c4db0f lrc: 4/0,0 mode: PR/PR res: [0x2b839:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c55 expref: 787 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.634362:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001e521674/0x3234de053c4d486 lrc: 4/0,0 mode: PR/PR res: [0x2b838:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0406 expref: 787 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.634366:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12564 00000100:00100000:0.0:1651529344.634368:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+787:41279:x1731746396364928:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.634370:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12565 00010000:00010000:0.0:1651529344.634371:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.634372:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+787:41279:x1731746396365056:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.634372:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c4ec26 lrc: 4/0,0 mode: PR/PR res: [0x2b837:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6224 expref: 787 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.634374:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.634376:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c4df37 lrc: 4/0,0 mode: PR/PR res: [0x2b835:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e0d expref: 787 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.634379:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c4df37 lrc: 3/0,0 mode: PR/PR res: [0x2b835:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e0d expref: 787 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.634385:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c4df37 lrc: 0/0,0 mode: --/PR res: [0x2b835:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e0d expref: 787 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.634391:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.634392:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.634393:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000060da8203/0x3234de053c51b12 lrc: 3/0,1 mode: PW/PW res: [0x2b835:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634394:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c4ec26 lrc: 3/0,0 mode: PR/PR res: [0x2b837:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6224 expref: 786 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.634395:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060da8203/0x3234de053c51b12 lrc: 4/0,1 mode: PW/PW res: [0x2b835:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634400:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c4ec26 lrc: 0/0,0 mode: --/PR res: [0x2b837:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6224 expref: 786 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.634402:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.634404:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.634405:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.634406:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000662594c3/0x3234de053c51b20 lrc: 3/0,1 mode: PW/PW res: [0x2b837:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.634409:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+785:41279:x1731746396365056:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (124us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.634409:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000662594c3/0x3234de053c51b20 lrc: 4/0,1 mode: PW/PW res: [0x2b837:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.634412:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12565 00000100:00100000:1.0:1651529344.634416:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12566 00010000:00010000:0.0:1651529344.634419:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.634424:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+784:41278:x1731746396365120:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.634427:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.634427:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+784:41279:x1731746396364928:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 58us (151us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.634429:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000be58d33b/0x3234de053c4db0f lrc: 4/0,0 mode: PR/PR res: [0x2b839:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c55 expref: 784 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.634430:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12564 00010000:00010000:1.0:1651529344.634433:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000be58d33b/0x3234de053c4db0f lrc: 3/0,0 mode: PR/PR res: [0x2b839:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c55 expref: 783 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.634435:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12567 00010000:00010000:1.0:1651529344.634437:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be58d33b/0x3234de053c4db0f lrc: 0/0,0 mode: --/PR res: [0x2b839:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c55 expref: 783 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.634437:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+783:41278:x1731746396364992:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.634440:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.634441:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.634442:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.634442:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51b27 lrc: 3/0,1 mode: PW/PW res: [0x2b839:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634442:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001e521674/0x3234de053c4d486 lrc: 4/0,0 mode: PR/PR res: [0x2b838:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0406 expref: 782 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.634445:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51b27 lrc: 4/0,1 mode: PW/PW res: [0x2b839:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634448:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001e521674/0x3234de053c4d486 lrc: 3/0,0 mode: PR/PR res: [0x2b838:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0406 expref: 782 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.634454:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.634459:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e521674/0x3234de053c4d486 lrc: 0/0,0 mode: --/PR res: [0x2b838:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0406 expref: 782 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.634460:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+782:41278:x1731746396365120:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 35us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.634462:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12566 00010000:00010000:0.0:1651529344.634463:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.634463:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.634464:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51b19 lrc: 3/0,1 mode: PW/PW res: [0x2b838:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634467:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51b19 lrc: 4/0,1 mode: PW/PW res: [0x2b838:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.634470:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000662594c3/0x3234de053c51b20 lrc: 3/0,1 mode: PW/PW res: [0x2b837:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.634473:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000662594c3/0x3234de053c51b20 lrc: 3/0,1 mode: PW/PW res: [0x2b837:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634473:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.634477:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000662594c3/0x3234de053c51b20 lrc: 3/0,1 mode: PW/PW res: [0x2b837:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.634479:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000662594c3/0x3234de053c51b20 lrc: 2/0,0 mode: PW/PW res: [0x2b837:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.634479:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+780:41278:x1731746396364992:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.634481:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12567 00010000:00010000:0.0:1651529344.634494:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51b27 lrc: 3/0,1 mode: PW/PW res: [0x2b839:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634498:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51b27 lrc: 3/0,1 mode: PW/PW res: [0x2b839:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634501:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51b27 lrc: 3/0,1 mode: PW/PW res: [0x2b839:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634506:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51b27 lrc: 2/0,0 mode: PW/PW res: [0x2b839:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.634521:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1284:39030:x1731745946483840:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 896us (1012us total) trans 12885079837 rc 0/0 00000100:00100000:1.0:1651529344.634524:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211784 00010000:00010000:1.0:1651529344.634530:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000060da8203/0x3234de053c51b12 lrc: 3/0,1 mode: PW/PW res: [0x2b835:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.634536:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060da8203/0x3234de053c51b12 lrc: 3/0,1 mode: PW/PW res: [0x2b835:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.634539:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060da8203/0x3234de053c51b12 lrc: 3/0,1 mode: PW/PW res: [0x2b835:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.634541:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060da8203/0x3234de053c51b12 lrc: 2/0,0 mode: PW/PW res: [0x2b835:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.634545:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1284:39030:x1731745946483968:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 874us (1004us total) trans 12885079838 rc 0/0 00000100:00100000:0.0:1651529344.634555:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211785 00010000:00010000:0.0:1651529344.634563:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51b19 lrc: 3/0,1 mode: PW/PW res: [0x2b838:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634566:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51b19 lrc: 3/0,1 mode: PW/PW res: [0x2b838:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634569:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51b19 lrc: 3/0,1 mode: PW/PW res: [0x2b838:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634572:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51b19 lrc: 2/0,0 mode: PW/PW res: [0x2b838:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.634578:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1284:39030:x1731745946483712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1004us (1131us total) trans 12885079839 rc 0/0 00000100:00100000:1.0:1651529344.634581:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211782 00000100:00100000:0.0:1651529344.634630:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1284:39029:x1731745946483904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1041us (1148us total) trans 12885079840 rc 0/0 00000100:00100000:0.0:1651529344.634633:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211783 00010000:00010000:0.0:1651529344.634640:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000662594c3/0x3234de053c51b20 lrc: 2/0,0 mode: PW/PW res: [0x2b837:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.634642:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.634643:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000662594c3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.634644:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000662594c3/0x3234de053c51b20 lrc: 2/0,0 mode: PW/PW res: [0x2b837:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.634654:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.634659:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000662594c3/0x3234de053c51b20 lrc: 3/0,0 mode: PW/PW res: [0x2b837:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634668:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000662594c3/0x3234de053c51b20 lrc: 1/0,0 mode: --/PW res: [0x2b837:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634671:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000662594c3/0x3234de053c51b20 lrc: 0/0,0 mode: --/PW res: [0x2b837:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634675:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51b27 lrc: 2/0,0 mode: PW/PW res: [0x2b839:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634678:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eaaf5dcd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.634679:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51b27 lrc: 2/0,0 mode: PW/PW res: [0x2b839:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634686:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51b27 lrc: 3/0,0 mode: PW/PW res: [0x2b839:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634689:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51b27 lrc: 1/0,0 mode: --/PW res: [0x2b839:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634692:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51b27 lrc: 0/0,0 mode: --/PW res: [0x2b839:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634696:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060da8203/0x3234de053c51b12 lrc: 2/0,0 mode: PW/PW res: [0x2b835:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634708:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000060da8203 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.634709:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060da8203/0x3234de053c51b12 lrc: 2/0,0 mode: PW/PW res: [0x2b835:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634712:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060da8203/0x3234de053c51b12 lrc: 3/0,0 mode: PW/PW res: [0x2b835:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634716:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060da8203/0x3234de053c51b12 lrc: 1/0,0 mode: --/PW res: [0x2b835:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634718:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060da8203/0x3234de053c51b12 lrc: 0/0,0 mode: --/PW res: [0x2b835:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.634729:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.634731:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51b19 lrc: 2/0,0 mode: PW/PW res: [0x2b838:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634744:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000491b5359 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.634745:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51b19 lrc: 2/0,0 mode: PW/PW res: [0x2b838:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634748:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51b19 lrc: 3/0,0 mode: PW/PW res: [0x2b838:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634752:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51b19 lrc: 1/0,0 mode: --/PW res: [0x2b838:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634754:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51b19 lrc: 0/0,0 mode: --/PW res: [0x2b838:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.634768:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d28c414b pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997021056:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.634771:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51b2e lrc: 3/0,1 mode: --/PW res: [0x2b83a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.634774:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.634778:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000be0ace91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997021184:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.634780:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51b3c lrc: 3/0,1 mode: --/PW res: [0x2b83c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.634792:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002c4168d4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997021120:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.634797:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000069e35989/0x3234de053c51b35 lrc: 3/0,1 mode: --/PW res: [0x2b83b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.634803:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000066de8c9f pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997021248:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.634804:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396365184 00010000:00010000:0.0:1651529344.634806:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51b43 lrc: 3/0,1 mode: --/PW res: [0x2b83d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.634808:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006455a7db/0x3234de053c49fe3 lrc: 4/0,0 mode: PR/PR res: [0x2b83a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb58c expref: 780 pid: 80276 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.634814:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396365248 00000100:00100000:0.0:1651529344.634815:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396365760 00010000:00010000:1.0:1651529344.634816:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ccc8a2af/0x3234de053c4e596 lrc: 4/0,0 mode: PR/PR res: [0x2b83b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d47c1 expref: 782 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.634819:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008513649d/0x3234de053c4eff3 lrc: 4/0,0 mode: PR/PR res: [0x2b83c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d725b expref: 782 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.634820:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396365824 00010000:00010000:1.0:1651529344.634823:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000719ce468/0x3234de053c4d91e lrc: 4/0,0 mode: PR/PR res: [0x2b83d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d154e expref: 783 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.634827:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12568 00000100:00100000:1.0:1651529344.634829:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b5574957 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+783:41279:x1731746396365184:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.634831:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.634832:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006455a7db/0x3234de053c49fe3 lrc: 4/0,0 mode: PR/PR res: [0x2b83a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb58c expref: 783 pid: 80276 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.634843:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006455a7db/0x3234de053c49fe3 lrc: 3/0,0 mode: PR/PR res: [0x2b83a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb58c expref: 783 pid: 80276 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.634843:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12569 00000100:00100000:0.0:1651529344.634845:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+783:41279:x1731746396365248:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.634849:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006455a7db/0x3234de053c49fe3 lrc: 0/0,0 mode: --/PR res: [0x2b83a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb58c expref: 783 pid: 80276 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.634853:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.634853:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.634854:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51b2e lrc: 3/0,1 mode: PW/PW res: [0x2b83a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.634857:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51b2e lrc: 4/0,1 mode: PW/PW res: [0x2b83a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634857:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.634859:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ccc8a2af/0x3234de053c4e596 lrc: 4/0,0 mode: PR/PR res: [0x2b83b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d47c1 expref: 782 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.634863:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ccc8a2af/0x3234de053c4e596 lrc: 3/0,0 mode: PR/PR res: [0x2b83b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d47c1 expref: 782 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.634867:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.634875:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ccc8a2af/0x3234de053c4e596 lrc: 0/0,0 mode: --/PR res: [0x2b83b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d47c1 expref: 782 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.634877:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b5574957 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+782:41279:x1731746396365184:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 48us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.634880:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12568 00010000:00010000:0.0:1651529344.634883:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.634883:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.634884:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000069e35989/0x3234de053c51b35 lrc: 3/0,1 mode: PW/PW res: [0x2b83b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634887:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069e35989/0x3234de053c51b35 lrc: 4/0,1 mode: PW/PW res: [0x2b83b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.634889:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12570 00000100:00100000:1.0:1651529344.634891:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+780:41279:x1731746396365824:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.634894:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.634896:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.634901:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000719ce468/0x3234de053c4d91e lrc: 4/0,0 mode: PR/PR res: [0x2b83d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d154e expref: 780 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.634905:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000719ce468/0x3234de053c4d91e lrc: 3/0,0 mode: PR/PR res: [0x2b83d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d154e expref: 780 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.634905:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+780:41279:x1731746396365248:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 59us (250us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.634910:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000719ce468/0x3234de053c4d91e lrc: 0/0,0 mode: --/PR res: [0x2b83d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d154e expref: 780 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.634913:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.634914:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.634915:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51b43 lrc: 3/0,1 mode: PW/PW res: [0x2b83d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.634918:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51b43 lrc: 4/0,1 mode: PW/PW res: [0x2b83d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.634919:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12569 00010000:00010000:1.0:1651529344.634926:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.634930:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12571 00000100:00100000:1.0:1651529344.634932:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+778:41279:x1731746396365824:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.634932:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+778:41278:x1731746396365760:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.634935:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12570 00010000:00010000:0.0:1651529344.634935:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.634937:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008513649d/0x3234de053c4eff3 lrc: 4/0,0 mode: PR/PR res: [0x2b83c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d725b expref: 778 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.634941:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008513649d/0x3234de053c4eff3 lrc: 3/0,0 mode: PR/PR res: [0x2b83c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d725b expref: 777 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.634943:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000069e35989/0x3234de053c51b35 lrc: 3/0,1 mode: PW/PW res: [0x2b83b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.634946:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069e35989/0x3234de053c51b35 lrc: 3/0,1 mode: PW/PW res: [0x2b83b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634946:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008513649d/0x3234de053c4eff3 lrc: 0/0,0 mode: --/PR res: [0x2b83c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d725b expref: 777 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.634949:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069e35989/0x3234de053c51b35 lrc: 3/0,1 mode: PW/PW res: [0x2b83b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.634952:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069e35989/0x3234de053c51b35 lrc: 2/0,0 mode: PW/PW res: [0x2b83b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634952:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.634952:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.634953:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51b3c lrc: 3/0,1 mode: PW/PW res: [0x2b83c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634956:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51b3c lrc: 4/0,1 mode: PW/PW res: [0x2b83c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634967:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.634973:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+776:41278:x1731746396365760:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 41us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.634976:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12571 00010000:00010000:0.0:1651529344.634982:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51b2e lrc: 3/0,1 mode: PW/PW res: [0x2b83a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634986:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51b2e lrc: 3/0,1 mode: PW/PW res: [0x2b83a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634989:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51b2e lrc: 3/0,1 mode: PW/PW res: [0x2b83a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.634991:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51b2e lrc: 2/0,0 mode: PW/PW res: [0x2b83a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.634994:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1284:39030:x1731745946484096:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1200us (1278us total) trans 12885079841 rc 0/0 00000100:00100000:1.0:1651529344.634997:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211787 00000100:00100000:1.0:1651529344.635030:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.635033:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1284:39030:x1731745946484032:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1257us (1346us total) trans 12885079842 rc 0/0 00000100:00100000:0.0:1651529344.635036:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211786 00000100:00100000:0.0:1651529344.635041:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946484864 00000100:00100000:1.0:1651529344.635045:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.635048:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946484928 00000100:00100000:0.0:1651529344.635052:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211790 00000100:00100000:0.0:1651529344.635054:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1285:39030:x1731745946484864:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.635056:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.635059:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178238 count 1 00010000:00010000:0.0:1651529344.635063:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c51b4a lrc: 3/0,1 mode: --/PW res: [0x2b83e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.635066:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.635067:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000025d7c12d/0x3234de053c4d264 lrc: 2/0,0 mode: PR/PR res: [0x2b83e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb07 expref: 775 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.635070:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.635071:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.635072:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c51b4a lrc: 4/0,1 mode: --/PW res: [0x2b83e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635078:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000025d7c12d/0x3234de053c4d264 lrc: 3/0,0 mode: PR/PR res: [0x2b83e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb07 expref: 775 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.635082:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000025d7c12d/0x3234de053c4d264 lrc: 4/0,0 mode: PR/PR res: [0x2b83e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb07 expref: 775 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.635086:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000066de8c9f pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997021312:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.635094:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ff7bf023 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.635099:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069e35989/0x3234de053c51b35 lrc: 2/0,0 mode: PW/PW res: [0x2b83b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635102:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000069e35989 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.635103:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069e35989/0x3234de053c51b35 lrc: 2/0,0 mode: PW/PW res: [0x2b83b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635106:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069e35989/0x3234de053c51b35 lrc: 3/0,0 mode: PW/PW res: [0x2b83b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635111:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069e35989/0x3234de053c51b35 lrc: 1/0,0 mode: --/PW res: [0x2b83b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635114:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069e35989/0x3234de053c51b35 lrc: 0/0,0 mode: --/PW res: [0x2b83b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635118:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51b2e lrc: 2/0,0 mode: PW/PW res: [0x2b83a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635120:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000093dbd0d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.635121:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51b2e lrc: 2/0,0 mode: PW/PW res: [0x2b83a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635124:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51b2e lrc: 3/0,0 mode: PW/PW res: [0x2b83a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635127:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51b2e lrc: 1/0,0 mode: --/PW res: [0x2b83a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.635129:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946484992 00010000:00010000:0.0:1651529344.635130:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51b2e lrc: 0/0,0 mode: --/PW res: [0x2b83a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.635136:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946485056 00000100:00100000:0.0:1651529344.635137:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211791 00000100:00100000:0.0:1651529344.635139:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1287:39030:x1731745946484928:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.635141:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211792 00000100:00100000:1.0:1651529344.635143:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1287:39030:x1731745946484992:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.635149:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178240 count 1 00010000:00010000:1.0:1651529344.635153:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005960f1ad/0x3234de053c51b51 lrc: 3/0,1 mode: --/PW res: [0x2b840:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.635158:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b81ff678/0x3234de053c4ed99 lrc: 2/0,0 mode: PR/PR res: [0x2b840:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6908 expref: 775 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.635162:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178239 count 1 00010000:00010000:1.0:1651529344.635163:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.635164:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.635165:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005960f1ad/0x3234de053c51b51 lrc: 4/0,1 mode: --/PW res: [0x2b840:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635166:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c51b58 lrc: 3/0,1 mode: --/PW res: [0x2b83f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635170:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000434c5c8c/0x3234de053c4dfb5 lrc: 2/0,0 mode: PR/PR res: [0x2b83f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2fe9 expref: 775 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.635171:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b81ff678/0x3234de053c4ed99 lrc: 3/0,0 mode: PR/PR res: [0x2b840:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6908 expref: 775 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.635173:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.635174:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.635175:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b81ff678/0x3234de053c4ed99 lrc: 4/0,0 mode: PR/PR res: [0x2b840:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6908 expref: 775 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.635175:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c51b58 lrc: 4/0,1 mode: --/PW res: [0x2b83f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.635179:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003562cf4d pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997021376:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.635181:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000434c5c8c/0x3234de053c4dfb5 lrc: 3/0,0 mode: PR/PR res: [0x2b83f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2fe9 expref: 775 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.635184:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000434c5c8c/0x3234de053c4dfb5 lrc: 4/0,0 mode: PR/PR res: [0x2b83f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2fe9 expref: 775 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.635189:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000be0ace91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997021440:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.635190:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b52d0f36 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.635196:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211793 00000100:00100000:1.0:1651529344.635197:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1287:39029:x1731745946485056:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.635197:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bff8744a going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.635202:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178241 count 1 00010000:00010000:0.0:1651529344.635203:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51b3c lrc: 3/0,1 mode: PW/PW res: [0x2b83c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.635205:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000516dff5d/0x3234de053c51b5f lrc: 3/0,1 mode: --/PW res: [0x2b841:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635206:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51b3c lrc: 3/0,1 mode: PW/PW res: [0x2b83c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.635209:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009c101084/0x3234de053c4db2b lrc: 2/0,0 mode: PR/PR res: [0x2b841:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1cda expref: 775 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.635209:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51b3c lrc: 3/0,1 mode: PW/PW res: [0x2b83c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.635212:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.635212:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51b3c lrc: 2/0,0 mode: PW/PW res: [0x2b83c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.635213:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.635214:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000516dff5d/0x3234de053c51b5f lrc: 4/0,1 mode: --/PW res: [0x2b841:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.635233:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009c101084/0x3234de053c4db2b lrc: 3/0,0 mode: PR/PR res: [0x2b841:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1cda expref: 775 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.635242:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009c101084/0x3234de053c4db2b lrc: 4/0,0 mode: PR/PR res: [0x2b841:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1cda expref: 775 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.635246:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f7006631 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997021504:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.635254:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f9dac3f6 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.635267:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1288:39030:x1731745946484608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1132us (1176us total) trans 12885079843 rc 0/0 00000100:00100000:1.0:1651529344.635301:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.635308:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211788 00000100:00100000:0.0:1651529344.635314:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946485120 00000100:00100000:0.0:1651529344.635323:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211794 00000100:00100000:0.0:1651529344.635325:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1288:39030:x1731745946485120:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.635336:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178242 count 1 00010000:00010000:0.0:1651529344.635341:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c51b66 lrc: 3/0,1 mode: --/PW res: [0x2b842:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635345:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f08aa69d/0x3234de053c4c64e lrc: 2/0,0 mode: PR/PR res: [0x2b842:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb1f expref: 775 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.635348:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.635349:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.635350:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c51b66 lrc: 4/0,1 mode: --/PW res: [0x2b842:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.635356:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.635356:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f08aa69d/0x3234de053c4c64e lrc: 3/0,0 mode: PR/PR res: [0x2b842:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb1f expref: 775 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.635360:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f08aa69d/0x3234de053c4c64e lrc: 4/0,0 mode: PR/PR res: [0x2b842:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb1f expref: 775 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.635366:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.635367:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d28c414b pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997021568:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.635377:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946485184 00000100:00100000:0.0:1651529344.635386:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c4075652 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.635391:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211795 00010000:00010000:0.0:1651529344.635391:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51b3c lrc: 2/0,0 mode: PW/PW res: [0x2b83c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.635393:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1289:39029:x1731745946485184:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.635394:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000046d6c242 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.635395:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51b3c lrc: 2/0,0 mode: PW/PW res: [0x2b83c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.635398:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178243 count 1 00010000:00010000:0.0:1651529344.635398:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51b3c lrc: 3/0,0 mode: PW/PW res: [0x2b83c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.635402:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000329f2d10/0x3234de053c51b6d lrc: 3/0,1 mode: --/PW res: [0x2b843:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635402:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51b3c lrc: 1/0,0 mode: --/PW res: [0x2b83c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.635407:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000052741dd5/0x3234de053c4eebf lrc: 2/0,0 mode: PR/PR res: [0x2b843:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6cea expref: 775 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.635410:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.635411:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.635411:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000329f2d10/0x3234de053c51b6d lrc: 4/0,1 mode: --/PW res: [0x2b843:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635418:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51b3c lrc: 0/0,0 mode: --/PW res: [0x2b83c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.635420:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000052741dd5/0x3234de053c4eebf lrc: 3/0,0 mode: PR/PR res: [0x2b843:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6cea expref: 775 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.635424:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000052741dd5/0x3234de053c4eebf lrc: 4/0,0 mode: PR/PR res: [0x2b843:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6cea expref: 775 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.635428:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009acffcb8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997021632:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.635429:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000066de8c9f pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997021312:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.635433:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c51b4a lrc: 3/0,1 mode: --/PW res: [0x2b83e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.635436:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 0000000089d75f07 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.635438:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51b43 lrc: 3/0,1 mode: PW/PW res: [0x2b83d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635443:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51b43 lrc: 3/0,1 mode: PW/PW res: [0x2b83d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635462:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51b43 lrc: 3/0,1 mode: PW/PW res: [0x2b83d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635465:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51b43 lrc: 2/0,0 mode: PW/PW res: [0x2b83d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.635481:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.635489:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946485568 00000100:00100000:1.0:1651529344.635495:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211796 00000100:00100000:1.0:1651529344.635497:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b09b3bd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1291:39030:x1731745946485568:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.635501:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178244 count 1 00010000:00010000:1.0:1651529344.635505:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fb0278b/0x3234de053c51b74 lrc: 3/0,1 mode: --/PW res: [0x2b844:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.635510:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1291:39030:x1731745946484672:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1250us (1298us total) trans 12885079844 rc 0/0 00000100:00100000:0.0:1651529344.635513:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211789 00010000:00010000:1.0:1651529344.635517:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008f27c157/0x3234de053c4c903 lrc: 2/0,0 mode: PR/PR res: [0x2b844:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd57c expref: 775 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.635520:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.635520:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.635521:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fb0278b/0x3234de053c51b74 lrc: 4/0,1 mode: --/PW res: [0x2b844:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635521:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51b43 lrc: 2/0,0 mode: PW/PW res: [0x2b83d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635524:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b2d06199 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.635525:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51b43 lrc: 2/0,0 mode: PW/PW res: [0x2b83d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.635528:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008f27c157/0x3234de053c4c903 lrc: 3/0,0 mode: PR/PR res: [0x2b844:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd57c expref: 775 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.635528:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51b43 lrc: 3/0,0 mode: PW/PW res: [0x2b83d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635532:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51b43 lrc: 1/0,0 mode: --/PW res: [0x2b83d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.635534:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008f27c157/0x3234de053c4c903 lrc: 4/0,0 mode: PR/PR res: [0x2b844:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd57c expref: 775 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.635535:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51b43 lrc: 0/0,0 mode: --/PW res: [0x2b83d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.635538:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c43262d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997021696:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.635546:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a5495eb going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.635564:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396365888 00010000:00010000:0.0:1651529344.635569:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000025d7c12d/0x3234de053c4d264 lrc: 4/0,0 mode: PR/PR res: [0x2b83e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb07 expref: 776 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.635576:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12572 00000100:00100000:0.0:1651529344.635578:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+776:41278:x1731746396365888:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.635581:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.635582:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000025d7c12d/0x3234de053c4d264 lrc: 4/0,0 mode: PR/PR res: [0x2b83e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb07 expref: 776 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.635586:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000025d7c12d/0x3234de053c4d264 lrc: 3/0,0 mode: PR/PR res: [0x2b83e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb07 expref: 776 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.635591:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025d7c12d/0x3234de053c4d264 lrc: 0/0,0 mode: --/PR res: [0x2b83e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb07 expref: 776 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.635594:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.635595:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.635596:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c51b4a lrc: 3/0,1 mode: PW/PW res: [0x2b83e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635599:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c51b4a lrc: 4/0,1 mode: PW/PW res: [0x2b83e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635622:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.635633:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+775:41278:x1731746396365888:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 54us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.635636:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12572 00010000:00010000:0.0:1651529344.635642:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c51b4a lrc: 3/0,1 mode: PW/PW res: [0x2b83e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635645:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c51b4a lrc: 3/0,1 mode: PW/PW res: [0x2b83e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635648:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c51b4a lrc: 3/0,1 mode: PW/PW res: [0x2b83e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635651:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c51b4a lrc: 2/0,0 mode: PW/PW res: [0x2b83e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.635698:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.635721:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1291:39030:x1731745946484864:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 666us (690us total) trans 12885079845 rc 0/0 00000100:00100000:0.0:1651529344.635732:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211790 00000100:00100000:0.0:1651529344.635747:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946485696 00000100:00100000:0.0:1651529344.635754:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211797 00000100:00100000:0.0:1651529344.635756:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1291:39030:x1731745946485696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.635760:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178245 count 1 00010000:00010000:0.0:1651529344.635764:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c51b7b lrc: 3/0,1 mode: --/PW res: [0x2b845:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635769:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000518200b6/0x3234de053c4c41e lrc: 2/0,0 mode: PR/PR res: [0x2b845:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc958 expref: 774 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.635772:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.635773:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.635774:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c51b7b lrc: 4/0,1 mode: --/PW res: [0x2b845:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635787:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000518200b6/0x3234de053c4c41e lrc: 3/0,0 mode: PR/PR res: [0x2b845:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc958 expref: 774 pid: 156655 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.635791:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.635791:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000518200b6/0x3234de053c4c41e lrc: 4/0,0 mode: PR/PR res: [0x2b845:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc958 expref: 774 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.635800:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.635800:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000066de8c9f pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997021760:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.635810:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.635810:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c2b2b59c going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.635815:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c51b4a lrc: 2/0,0 mode: PW/PW res: [0x2b83e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635818:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dd394f60 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.635819:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c51b4a lrc: 2/0,0 mode: PW/PW res: [0x2b83e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635822:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c51b4a lrc: 3/0,0 mode: PW/PW res: [0x2b83e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635826:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c51b4a lrc: 1/0,0 mode: --/PW res: [0x2b83e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635829:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c51b4a lrc: 0/0,0 mode: --/PW res: [0x2b83e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.635846:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000be0ace91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997021440:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.635850:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c51b58 lrc: 3/0,1 mode: --/PW res: [0x2b83f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.635857:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d28c414b pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997021568:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.635858:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003562cf4d pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997021376:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.635860:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c51b66 lrc: 3/0,1 mode: --/PW res: [0x2b842:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.635863:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005960f1ad/0x3234de053c51b51 lrc: 3/0,1 mode: --/PW res: [0x2b840:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.635868:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396366016 00000100:00100000:1.0:1651529344.635870:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f7006631 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997021504:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.635873:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000516dff5d/0x3234de053c51b5f lrc: 3/0,1 mode: --/PW res: [0x2b841:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.635879:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396366144 00010000:00010000:1.0:1651529344.635883:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000434c5c8c/0x3234de053c4dfb5 lrc: 4/0,0 mode: PR/PR res: [0x2b83f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2fe9 expref: 776 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.635893:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b81ff678/0x3234de053c4ed99 lrc: 4/0,0 mode: PR/PR res: [0x2b840:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6908 expref: 776 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.635896:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396366208 00010000:00010000:1.0:1651529344.635899:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009c101084/0x3234de053c4db2b lrc: 4/0,0 mode: PR/PR res: [0x2b841:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1cda expref: 777 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.635900:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12573 00000100:00100000:0.0:1651529344.635901:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+777:41278:x1731746396366144:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.635904:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.635906:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000434c5c8c/0x3234de053c4dfb5 lrc: 4/0,0 mode: PR/PR res: [0x2b83f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2fe9 expref: 777 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.635907:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12574 00000100:00100000:1.0:1651529344.635908:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+777:41278:x1731746396366016:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.635910:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000434c5c8c/0x3234de053c4dfb5 lrc: 3/0,0 mode: PR/PR res: [0x2b83f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2fe9 expref: 777 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.635911:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.635913:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b81ff678/0x3234de053c4ed99 lrc: 4/0,0 mode: PR/PR res: [0x2b840:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6908 expref: 777 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.635915:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000434c5c8c/0x3234de053c4dfb5 lrc: 0/0,0 mode: --/PR res: [0x2b83f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2fe9 expref: 777 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.635917:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b81ff678/0x3234de053c4ed99 lrc: 3/0,0 mode: PR/PR res: [0x2b840:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6908 expref: 777 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.635921:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.635922:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b81ff678/0x3234de053c4ed99 lrc: 0/0,0 mode: --/PR res: [0x2b840:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6908 expref: 776 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.635922:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.635922:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c51b58 lrc: 3/0,1 mode: PW/PW res: [0x2b83f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635925:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c51b58 lrc: 4/0,1 mode: PW/PW res: [0x2b83f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.635926:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.635926:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.635927:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005960f1ad/0x3234de053c51b51 lrc: 3/0,1 mode: PW/PW res: [0x2b840:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.635930:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005960f1ad/0x3234de053c51b51 lrc: 4/0,1 mode: PW/PW res: [0x2b840:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635932:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.635936:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.635940:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+775:41278:x1731746396366144:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 38us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.635943:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+775:41278:x1731746396366016:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 34us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.635943:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12573 00000100:00100000:1.0:1651529344.635946:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12574 00000100:00100000:0.0:1651529344.635948:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12575 00000100:00100000:0.0:1651529344.635950:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e3dc394f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+773:41278:x1731746396366208:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.635952:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.635953:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009c101084/0x3234de053c4db2b lrc: 4/0,0 mode: PR/PR res: [0x2b841:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1cda expref: 773 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.635956:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009acffcb8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997021632:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.635957:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009c101084/0x3234de053c4db2b lrc: 3/0,0 mode: PR/PR res: [0x2b841:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1cda expref: 773 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.635960:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000329f2d10/0x3234de053c51b6d lrc: 3/0,1 mode: --/PW res: [0x2b843:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635961:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c101084/0x3234de053c4db2b lrc: 0/0,0 mode: --/PR res: [0x2b841:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1cda expref: 773 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.635966:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005960f1ad/0x3234de053c51b51 lrc: 3/0,1 mode: PW/PW res: [0x2b840:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.635968:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005960f1ad/0x3234de053c51b51 lrc: 3/0,1 mode: PW/PW res: [0x2b840:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.635972:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005960f1ad/0x3234de053c51b51 lrc: 3/0,1 mode: PW/PW res: [0x2b840:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.635974:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005960f1ad/0x3234de053c51b51 lrc: 2/0,0 mode: PW/PW res: [0x2b840:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635979:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.635980:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.635986:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000516dff5d/0x3234de053c51b5f lrc: 3/0,1 mode: PW/PW res: [0x2b841:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.635990:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000516dff5d/0x3234de053c51b5f lrc: 4/0,1 mode: PW/PW res: [0x2b841:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636000:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.636006:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e3dc394f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+772:41278:x1731746396366208:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 56us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.636019:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12575 00000100:00100000:1.0:1651529344.636025:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1292:39030:x1731745946484992:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 880us (968us total) trans 12885079846 rc 0/0 00000100:00100000:1.0:1651529344.636028:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211792 00010000:00010000:1.0:1651529344.636035:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000516dff5d/0x3234de053c51b5f lrc: 3/0,1 mode: PW/PW res: [0x2b841:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636038:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000516dff5d/0x3234de053c51b5f lrc: 3/0,1 mode: PW/PW res: [0x2b841:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636041:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000516dff5d/0x3234de053c51b5f lrc: 3/0,1 mode: PW/PW res: [0x2b841:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636043:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000516dff5d/0x3234de053c51b5f lrc: 2/0,0 mode: PW/PW res: [0x2b841:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636049:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c51b58 lrc: 3/0,1 mode: PW/PW res: [0x2b83f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636053:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c51b58 lrc: 3/0,1 mode: PW/PW res: [0x2b83f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636067:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c51b58 lrc: 3/0,1 mode: PW/PW res: [0x2b83f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636070:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c51b58 lrc: 2/0,0 mode: PW/PW res: [0x2b83f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.636096:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1293:39029:x1731745946485056:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 897us (1030us total) trans 12885079847 rc 0/0 00000100:00100000:1.0:1651529344.636099:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211793 00000100:00100000:1.0:1651529344.636109:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c43262d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997021696:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.636109:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1292:39030:x1731745946484928:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 969us (1064us total) trans 12885079848 rc 0/0 00010000:00010000:1.0:1651529344.636112:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002fb0278b/0x3234de053c51b74 lrc: 3/0,1 mode: --/PW res: [0x2b844:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.636112:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211791 00010000:00010000:0.0:1651529344.636119:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005960f1ad/0x3234de053c51b51 lrc: 2/0,0 mode: PW/PW res: [0x2b840:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636125:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005960f1ad already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.636126:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005960f1ad/0x3234de053c51b51 lrc: 2/0,0 mode: PW/PW res: [0x2b840:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.636127:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.636129:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005960f1ad/0x3234de053c51b51 lrc: 3/0,0 mode: PW/PW res: [0x2b840:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636141:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005960f1ad/0x3234de053c51b51 lrc: 1/0,0 mode: --/PW res: [0x2b840:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636144:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005960f1ad/0x3234de053c51b51 lrc: 0/0,0 mode: --/PW res: [0x2b840:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.636147:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.636162:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.636167:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000516dff5d/0x3234de053c51b5f lrc: 2/0,0 mode: PW/PW res: [0x2b841:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636170:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000516dff5d already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.636171:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.636171:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000516dff5d/0x3234de053c51b5f lrc: 2/0,0 mode: PW/PW res: [0x2b841:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636173:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000516dff5d/0x3234de053c51b5f lrc: 3/0,0 mode: PW/PW res: [0x2b841:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636177:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000516dff5d/0x3234de053c51b5f lrc: 1/0,0 mode: --/PW res: [0x2b841:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636180:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000516dff5d/0x3234de053c51b5f lrc: 0/0,0 mode: --/PW res: [0x2b841:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636184:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c51b58 lrc: 2/0,0 mode: PW/PW res: [0x2b83f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636186:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6eb3f34 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.636187:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c51b58 lrc: 2/0,0 mode: PW/PW res: [0x2b83f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636189:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c51b58 lrc: 3/0,0 mode: PW/PW res: [0x2b83f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636193:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c51b58 lrc: 1/0,0 mode: --/PW res: [0x2b83f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636195:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c51b58 lrc: 0/0,0 mode: --/PW res: [0x2b83f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.636210:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946485760 00000100:00100000:0.0:1651529344.636220:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211798 00000100:00100000:0.0:1651529344.636240:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1292:39030:x1731745946485760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.636245:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178246 count 1 00010000:00010000:0.0:1651529344.636248:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51b82 lrc: 3/0,1 mode: --/PW res: [0x2b846:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.636251:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.636252:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004dbdb411/0x3234de053c4efd7 lrc: 2/0,0 mode: PR/PR res: [0x2b846:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7200 expref: 771 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.636258:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.636259:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396366336 00010000:00010000:0.0:1651529344.636259:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.636259:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51b82 lrc: 4/0,1 mode: --/PW res: [0x2b846:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636264:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000052741dd5/0x3234de053c4eebf lrc: 4/0,0 mode: PR/PR res: [0x2b843:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6cea expref: 772 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.636266:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004dbdb411/0x3234de053c4efd7 lrc: 3/0,0 mode: PR/PR res: [0x2b846:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7200 expref: 772 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.636270:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396366272 00010000:00010000:1.0:1651529344.636272:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f08aa69d/0x3234de053c4c64e lrc: 4/0,0 mode: PR/PR res: [0x2b842:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb1f expref: 773 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.636276:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396366400 00010000:00010000:1.0:1651529344.636278:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008f27c157/0x3234de053c4c903 lrc: 4/0,0 mode: PR/PR res: [0x2b844:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd57c expref: 774 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.636282:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12576 00000100:00100000:1.0:1651529344.636284:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+774:41279:x1731746396366336:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.636284:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004dbdb411/0x3234de053c4efd7 lrc: 4/0,0 mode: PR/PR res: [0x2b846:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7200 expref: 774 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.636287:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.636288:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000052741dd5/0x3234de053c4eebf lrc: 4/0,0 mode: PR/PR res: [0x2b843:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6cea expref: 774 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.636288:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d28c414b pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997021824:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.636291:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000052741dd5/0x3234de053c4eebf lrc: 3/0,0 mode: PR/PR res: [0x2b843:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6cea expref: 774 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.636297:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052741dd5/0x3234de053c4eebf lrc: 0/0,0 mode: --/PR res: [0x2b843:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6cea expref: 774 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.636300:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.636301:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.636304:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bff8744a going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.636309:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000329f2d10/0x3234de053c51b6d lrc: 3/0,1 mode: PW/PW res: [0x2b843:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636312:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000329f2d10/0x3234de053c51b6d lrc: 4/0,1 mode: PW/PW res: [0x2b843:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.636312:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000066de8c9f pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997021760:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.636316:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c51b7b lrc: 3/0,1 mode: --/PW res: [0x2b845:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636318:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.636326:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+773:41279:x1731746396366336:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 41us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.636328:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12576 00000100:00100000:1.0:1651529344.636332:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396366784 00010000:00010000:1.0:1651529344.636335:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000518200b6/0x3234de053c4c41e lrc: 4/0,0 mode: PR/PR res: [0x2b845:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc958 expref: 773 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.636341:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12577 00000100:00100000:1.0:1651529344.636342:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+773:41279:x1731746396366272:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.636347:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12578 00000100:00100000:0.0:1651529344.636349:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+773:41279:x1731746396366400:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.636353:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.636354:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.636354:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008f27c157/0x3234de053c4c903 lrc: 4/0,0 mode: PR/PR res: [0x2b844:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd57c expref: 773 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.636355:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f08aa69d/0x3234de053c4c64e lrc: 4/0,0 mode: PR/PR res: [0x2b842:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb1f expref: 773 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.636358:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008f27c157/0x3234de053c4c903 lrc: 3/0,0 mode: PR/PR res: [0x2b844:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd57c expref: 773 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.636359:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f08aa69d/0x3234de053c4c64e lrc: 3/0,0 mode: PR/PR res: [0x2b842:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb1f expref: 773 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.636364:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f08aa69d/0x3234de053c4c64e lrc: 0/0,0 mode: --/PR res: [0x2b842:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb1f expref: 773 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.636365:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f27c157/0x3234de053c4c903 lrc: 0/0,0 mode: --/PR res: [0x2b844:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd57c expref: 773 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.636368:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.636368:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.636368:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.636369:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c51b66 lrc: 3/0,1 mode: PW/PW res: [0x2b842:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636369:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.636370:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002fb0278b/0x3234de053c51b74 lrc: 3/0,1 mode: PW/PW res: [0x2b844:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636372:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c51b66 lrc: 4/0,1 mode: PW/PW res: [0x2b842:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636381:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.636390:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+771:41279:x1731746396366272:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 47us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.636393:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12577 00000100:00100000:1.0:1651529344.636397:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12579 00000100:00100000:1.0:1651529344.636399:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+770:41278:x1731746396366784:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.636402:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.636403:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000518200b6/0x3234de053c4c41e lrc: 4/0,0 mode: PR/PR res: [0x2b845:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc958 expref: 770 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.636408:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fb0278b/0x3234de053c51b74 lrc: 4/0,1 mode: PW/PW res: [0x2b844:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636409:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000518200b6/0x3234de053c4c41e lrc: 3/0,0 mode: PR/PR res: [0x2b845:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc958 expref: 770 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.636414:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000518200b6/0x3234de053c4c41e lrc: 0/0,0 mode: --/PR res: [0x2b845:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc958 expref: 770 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.636419:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.636423:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.636423:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.636424:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c51b7b lrc: 3/0,1 mode: PW/PW res: [0x2b845:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.636426:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+769:41279:x1731746396366400:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 77us (255us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.636427:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c51b7b lrc: 4/0,1 mode: PW/PW res: [0x2b845:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.636429:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12578 00010000:00010000:1.0:1651529344.636435:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.636441:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+768:41278:x1731746396366784:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 41us (191us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.636442:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c51b66 lrc: 3/0,1 mode: PW/PW res: [0x2b842:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.636443:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12579 00010000:00010000:0.0:1651529344.636446:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c51b66 lrc: 3/0,1 mode: PW/PW res: [0x2b842:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636449:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c51b66 lrc: 3/0,1 mode: PW/PW res: [0x2b842:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636451:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c51b66 lrc: 2/0,0 mode: PW/PW res: [0x2b842:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636452:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000329f2d10/0x3234de053c51b6d lrc: 3/0,1 mode: PW/PW res: [0x2b843:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636455:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000329f2d10/0x3234de053c51b6d lrc: 3/0,1 mode: PW/PW res: [0x2b843:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636458:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000329f2d10/0x3234de053c51b6d lrc: 3/0,1 mode: PW/PW res: [0x2b843:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636464:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000329f2d10/0x3234de053c51b6d lrc: 2/0,0 mode: PW/PW res: [0x2b843:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.636506:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1294:39029:x1731745946485184:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1112us (1150us total) trans 12885079849 rc 0/0 00000100:00100000:1.0:1651529344.636509:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211795 00000100:00100000:0.0:1651529344.636513:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1293:39030:x1731745946485120:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1187us (1212us total) trans 12885079850 rc 0/0 00010000:00010000:1.0:1651529344.636515:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002fb0278b/0x3234de053c51b74 lrc: 3/0,1 mode: PW/PW res: [0x2b844:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.636516:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211794 00010000:00010000:1.0:1651529344.636519:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fb0278b/0x3234de053c51b74 lrc: 3/0,1 mode: PW/PW res: [0x2b844:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636522:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fb0278b/0x3234de053c51b74 lrc: 3/0,1 mode: PW/PW res: [0x2b844:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636524:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002fb0278b/0x3234de053c51b74 lrc: 2/0,0 mode: PW/PW res: [0x2b844:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636543:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c51b7b lrc: 3/0,1 mode: PW/PW res: [0x2b845:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636547:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c51b7b lrc: 3/0,1 mode: PW/PW res: [0x2b845:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636550:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c51b7b lrc: 3/0,1 mode: PW/PW res: [0x2b845:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636553:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c51b7b lrc: 2/0,0 mode: PW/PW res: [0x2b845:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.636561:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b09b3bd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1293:39030:x1731745946485568:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1063us (1080us total) trans 12885079851 rc 0/0 00000100:00100000:1.0:1651529344.636563:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211796 00000100:00100000:0.0:1651529344.636587:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1293:39030:x1731745946485696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 831us (890us total) trans 12885079852 rc 0/0 00000100:00100000:0.0:1651529344.636590:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211797 00010000:00010000:0.0:1651529344.636597:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000329f2d10/0x3234de053c51b6d lrc: 2/0,0 mode: PW/PW res: [0x2b843:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636600:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000329f2d10 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.636601:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000329f2d10/0x3234de053c51b6d lrc: 2/0,0 mode: PW/PW res: [0x2b843:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636604:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000329f2d10/0x3234de053c51b6d lrc: 3/0,0 mode: PW/PW res: [0x2b843:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.636609:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.636609:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000329f2d10/0x3234de053c51b6d lrc: 1/0,0 mode: --/PW res: [0x2b843:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636612:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000329f2d10/0x3234de053c51b6d lrc: 0/0,0 mode: --/PW res: [0x2b843:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636624:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c51b66 lrc: 2/0,0 mode: PW/PW res: [0x2b842:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636627:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000579ed558 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.636632:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c51b66 lrc: 2/0,0 mode: PW/PW res: [0x2b842:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636635:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c51b66 lrc: 3/0,0 mode: PW/PW res: [0x2b842:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.636638:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.636638:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c51b66 lrc: 1/0,0 mode: --/PW res: [0x2b842:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636641:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c51b66 lrc: 0/0,0 mode: --/PW res: [0x2b842:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636644:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002fb0278b/0x3234de053c51b74 lrc: 2/0,0 mode: PW/PW res: [0x2b844:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636647:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002fb0278b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.636647:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002fb0278b/0x3234de053c51b74 lrc: 2/0,0 mode: PW/PW res: [0x2b844:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636650:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002fb0278b/0x3234de053c51b74 lrc: 3/0,0 mode: PW/PW res: [0x2b844:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636653:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002fb0278b/0x3234de053c51b74 lrc: 1/0,0 mode: --/PW res: [0x2b844:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636656:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fb0278b/0x3234de053c51b74 lrc: 0/0,0 mode: --/PW res: [0x2b844:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.636657:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.636659:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c51b7b lrc: 2/0,0 mode: PW/PW res: [0x2b845:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636662:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004f275b98 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.636662:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c51b7b lrc: 2/0,0 mode: PW/PW res: [0x2b845:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636665:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c51b7b lrc: 3/0,0 mode: PW/PW res: [0x2b845:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636668:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c51b7b lrc: 1/0,0 mode: --/PW res: [0x2b845:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636670:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c51b7b lrc: 0/0,0 mode: --/PW res: [0x2b845:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.636677:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.636686:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d28c414b pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997021824:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.636691:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51b82 lrc: 3/0,1 mode: --/PW res: [0x2b846:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.636698:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946485952 00000100:00100000:0.0:1651529344.636708:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946486080 00000100:00100000:0.0:1651529344.636713:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946486016 00000100:00100000:0.0:1651529344.636719:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211799 00000100:00100000:0.0:1651529344.636720:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1295:39029:x1731745946485952:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.636725:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178247 count 1 00010000:00010000:0.0:1651529344.636729:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51b89 lrc: 3/0,1 mode: --/PW res: [0x2b847:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636733:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b24a58c3/0x3234de053c4a895 lrc: 2/0,0 mode: PR/PR res: [0x2b847:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbcaf expref: 767 pid: 80281 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.636746:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.636746:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.636747:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51b89 lrc: 4/0,1 mode: --/PW res: [0x2b847:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.636754:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211800 00010000:00010000:0.0:1651529344.636754:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b24a58c3/0x3234de053c4a895 lrc: 3/0,0 mode: PR/PR res: [0x2b847:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbcaf expref: 767 pid: 80281 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.636756:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085af61db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1295:39029:x1731745946486080:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.636758:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b24a58c3/0x3234de053c4a895 lrc: 4/0,0 mode: PR/PR res: [0x2b847:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbcaf expref: 767 pid: 80281 timeout: 20103 lvb_type: 1 00002000:00080000:1.0:1651529344.636762:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178249 count 1 00000100:00100000:0.0:1651529344.636762:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d28c414b pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997021888:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.636767:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2fbd5f2/0x3234de053c51b90 lrc: 3/0,1 mode: --/PW res: [0x2b849:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636771:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000c7f6c19/0x3234de053c4d9f7 lrc: 2/0,0 mode: PR/PR res: [0x2b849:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d187a expref: 767 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.636775:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c2b2b59c going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.636781:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.636782:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.636783:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2fbd5f2/0x3234de053c51b90 lrc: 4/0,1 mode: --/PW res: [0x2b849:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636791:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000c7f6c19/0x3234de053c4d9f7 lrc: 3/0,0 mode: PR/PR res: [0x2b849:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d187a expref: 767 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.636794:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000c7f6c19/0x3234de053c4d9f7 lrc: 4/0,0 mode: PR/PR res: [0x2b849:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d187a expref: 767 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.636797:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211801 00000100:00100000:1.0:1651529344.636798:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae466fbb pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997021952:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.636800:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1295:39029:x1731745946486016:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.636805:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178248 count 1 00000100:00100000:1.0:1651529344.636807:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 000000007e004c12 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.636809:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c51b97 lrc: 3/0,1 mode: --/PW res: [0x2b848:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.636813:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396366912 00010000:00010000:0.0:1651529344.636813:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007a5ce5c5/0x3234de053c4ef98 lrc: 2/0,0 mode: PR/PR res: [0x2b848:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d70be expref: 767 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.636816:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.636817:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004dbdb411/0x3234de053c4efd7 lrc: 4/0,0 mode: PR/PR res: [0x2b846:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7200 expref: 768 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.636817:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.636817:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c51b97 lrc: 4/0,1 mode: --/PW res: [0x2b848:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636824:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007a5ce5c5/0x3234de053c4ef98 lrc: 3/0,0 mode: PR/PR res: [0x2b848:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d70be expref: 768 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.636825:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12580 00000100:00100000:1.0:1651529344.636827:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+768:41278:x1731746396366912:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.636827:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007a5ce5c5/0x3234de053c4ef98 lrc: 4/0,0 mode: PR/PR res: [0x2b848:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d70be expref: 768 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.636831:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.636831:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000066de8c9f pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997022016:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.636832:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004dbdb411/0x3234de053c4efd7 lrc: 4/0,0 mode: PR/PR res: [0x2b846:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7200 expref: 768 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.636835:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004dbdb411/0x3234de053c4efd7 lrc: 3/0,0 mode: PR/PR res: [0x2b846:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7200 expref: 768 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.636839:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ff7bf023 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.636841:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004dbdb411/0x3234de053c4efd7 lrc: 0/0,0 mode: --/PR res: [0x2b846:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7200 expref: 768 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.636844:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.636845:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.636846:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51b82 lrc: 3/0,1 mode: PW/PW res: [0x2b846:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636849:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51b82 lrc: 4/0,1 mode: PW/PW res: [0x2b846:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.636859:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.636866:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+767:41278:x1731746396366912:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.636868:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12580 00010000:00010000:0.0:1651529344.636880:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51b82 lrc: 3/0,1 mode: PW/PW res: [0x2b846:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636884:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51b82 lrc: 3/0,1 mode: PW/PW res: [0x2b846:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636890:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51b82 lrc: 3/0,1 mode: PW/PW res: [0x2b846:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636893:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51b82 lrc: 2/0,0 mode: PW/PW res: [0x2b846:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.636957:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1296:39030:x1731745946485760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 717us (830us total) trans 12885079853 rc 0/0 00000100:00100000:0.0:1651529344.636960:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211798 00010000:00010000:0.0:1651529344.636968:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51b82 lrc: 2/0,0 mode: PW/PW res: [0x2b846:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.636969:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.636971:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d5eeb0cd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.636972:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51b82 lrc: 2/0,0 mode: PW/PW res: [0x2b846:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636980:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51b82 lrc: 3/0,0 mode: PW/PW res: [0x2b846:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636986:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51b82 lrc: 1/0,0 mode: --/PW res: [0x2b846:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.636988:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51b82 lrc: 0/0,0 mode: --/PW res: [0x2b846:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.636996:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946486336 00000100:00100000:0.0:1651529344.637006:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211802 00000100:00100000:0.0:1651529344.637007:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1296:39029:x1731745946486336:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.637012:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178250 count 1 00010000:00010000:0.0:1651529344.637016:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51b9e lrc: 3/0,1 mode: --/PW res: [0x2b84a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.637020:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003ec78f20/0x3234de053c4e44d lrc: 2/0,0 mode: PR/PR res: [0x2b84a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d426c expref: 766 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.637041:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.637041:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.637042:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51b9e lrc: 4/0,1 mode: --/PW res: [0x2b84a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.637050:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003ec78f20/0x3234de053c4e44d lrc: 3/0,0 mode: PR/PR res: [0x2b84a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d426c expref: 766 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.637054:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003ec78f20/0x3234de053c4e44d lrc: 4/0,0 mode: PR/PR res: [0x2b84a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d426c expref: 766 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.637058:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000be0ace91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997022080:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.637060:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.637090:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 0000000029ae2bb2 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.637106:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d28c414b pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997021888:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.637110:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51b89 lrc: 3/0,1 mode: --/PW res: [0x2b847:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.637124:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.637133:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.637141:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.637144:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.637154:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.637164:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946486464 00000100:00100000:0.0:1651529344.637164:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946486400 00000100:00100000:1.0:1651529344.637170:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946486528 00000100:00100000:0.0:1651529344.637175:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946486784 00000100:00100000:0.0:1651529344.637180:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211803 00000100:00100000:1.0:1651529344.637187:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211804 00000100:00100000:0.0:1651529344.637187:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1300:39029:x1731745946486464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.637189:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1300:39030:x1731745946486400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.637192:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178252 count 1 00002000:00080000:1.0:1651529344.637194:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178251 count 1 00010000:00010000:0.0:1651529344.637196:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51ba5 lrc: 3/0,1 mode: --/PW res: [0x2b84c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.637199:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000842fc2b4/0x3234de053c51bac lrc: 3/0,1 mode: --/PW res: [0x2b84b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.637200:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b19f7ce3/0x3234de053c4e8ec lrc: 2/0,0 mode: PR/PR res: [0x2b84c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5463 expref: 766 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.637203:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006291b43a/0x3234de053c4dfca lrc: 2/0,0 mode: PR/PR res: [0x2b84b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3075 expref: 766 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.637204:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.637204:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.637205:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51ba5 lrc: 4/0,1 mode: --/PW res: [0x2b84c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.637207:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.637207:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.637208:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000842fc2b4/0x3234de053c51bac lrc: 4/0,1 mode: --/PW res: [0x2b84b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.637211:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b19f7ce3/0x3234de053c4e8ec lrc: 3/0,0 mode: PR/PR res: [0x2b84c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5463 expref: 766 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.637214:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006291b43a/0x3234de053c4dfca lrc: 3/0,0 mode: PR/PR res: [0x2b84b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3075 expref: 766 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.637215:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b19f7ce3/0x3234de053c4e8ec lrc: 4/0,0 mode: PR/PR res: [0x2b84c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5463 expref: 766 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.637218:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006291b43a/0x3234de053c4dfca lrc: 4/0,0 mode: PR/PR res: [0x2b84b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3075 expref: 766 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.637219:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000076d5f96b pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997022144:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.637233:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e5997468 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997022208:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.637245:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000003ad73843 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.637248:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 0000000018ebe812 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.637251:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211805 00000100:00100000:0.0:1651529344.637253:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1300:39030:x1731745946486784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.637255:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae466fbb pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997021952:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.637259:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a2fbd5f2/0x3234de053c51b90 lrc: 3/0,1 mode: --/PW res: [0x2b849:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.637259:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178254 count 1 00010000:00010000:0.0:1651529344.637263:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51bb3 lrc: 3/0,1 mode: --/PW res: [0x2b84e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.637266:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211806 00010000:00010000:0.0:1651529344.637267:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea4a7f5c/0x3234de053c4e9f6 lrc: 2/0,0 mode: PR/PR res: [0x2b84e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d595d expref: 766 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.637268:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1300:39030:x1731745946486528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.637270:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.637271:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.637271:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51bb3 lrc: 4/0,1 mode: --/PW res: [0x2b84e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.637273:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178253 count 1 00010000:00010000:1.0:1651529344.637277:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082b0fbe4/0x3234de053c51bba lrc: 3/0,1 mode: --/PW res: [0x2b84d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.637277:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ea4a7f5c/0x3234de053c4e9f6 lrc: 3/0,0 mode: PR/PR res: [0x2b84e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d595d expref: 766 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.637281:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000010c92236/0x3234de053c4dceb lrc: 2/0,0 mode: PR/PR res: [0x2b84d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d244a expref: 766 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.637281:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ea4a7f5c/0x3234de053c4e9f6 lrc: 4/0,0 mode: PR/PR res: [0x2b84e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d595d expref: 766 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.637284:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.637285:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.637285:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082b0fbe4/0x3234de053c51bba lrc: 4/0,1 mode: --/PW res: [0x2b84d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.637291:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000010c92236/0x3234de053c4dceb lrc: 3/0,0 mode: PR/PR res: [0x2b84d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d244a expref: 766 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.637294:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000010c92236/0x3234de053c4dceb lrc: 4/0,0 mode: PR/PR res: [0x2b84d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d244a expref: 766 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.637299:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae466fbb pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997022336:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.637305:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e7f02909 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997022272:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.637313:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 000000007e004c12 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.637315:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a3b00cf3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.637318:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396366976 00010000:00010000:1.0:1651529344.637323:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b24a58c3/0x3234de053c4a895 lrc: 4/0,0 mode: PR/PR res: [0x2b847:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbcaf expref: 767 pid: 80281 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.637330:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396367040 00010000:00010000:1.0:1651529344.637332:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000c7f6c19/0x3234de053c4d9f7 lrc: 4/0,0 mode: PR/PR res: [0x2b849:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d187a expref: 768 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.637340:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.637344:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12581 00000100:00100000:1.0:1651529344.637346:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+768:41279:x1731746396366976:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.637349:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.637350:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b24a58c3/0x3234de053c4a895 lrc: 4/0,0 mode: PR/PR res: [0x2b847:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbcaf expref: 768 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.637354:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b24a58c3/0x3234de053c4a895 lrc: 3/0,0 mode: PR/PR res: [0x2b847:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbcaf expref: 768 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.637359:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b24a58c3/0x3234de053c4a895 lrc: 0/0,0 mode: --/PR res: [0x2b847:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbcaf expref: 768 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.637363:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.637363:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.637364:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51b89 lrc: 3/0,1 mode: PW/PW res: [0x2b847:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.637367:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51b89 lrc: 4/0,1 mode: PW/PW res: [0x2b847:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.637375:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000066de8c9f pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997022016:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.637384:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.637385:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c51b97 lrc: 3/0,1 mode: --/PW res: [0x2b848:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.637390:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51b89 lrc: 3/0,1 mode: PW/PW res: [0x2b847:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.637395:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+767:41279:x1731746396366976:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 48us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.637397:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12581 00010000:00010000:0.0:1651529344.637400:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51b89 lrc: 3/0,1 mode: PW/PW res: [0x2b847:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.637402:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396367168 00010000:00010000:0.0:1651529344.637404:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51b89 lrc: 3/0,1 mode: PW/PW res: [0x2b847:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.637405:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007a5ce5c5/0x3234de053c4ef98 lrc: 4/0,0 mode: PR/PR res: [0x2b848:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d70be expref: 767 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.637406:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51b89 lrc: 2/0,0 mode: PW/PW res: [0x2b847:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.637410:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12582 00000100:00100000:1.0:1651529344.637412:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001743f524 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+767:41279:x1731746396367040:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.637414:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.637415:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000c7f6c19/0x3234de053c4d9f7 lrc: 4/0,0 mode: PR/PR res: [0x2b849:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d187a expref: 767 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.637419:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000c7f6c19/0x3234de053c4d9f7 lrc: 3/0,0 mode: PR/PR res: [0x2b849:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d187a expref: 767 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.637423:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c7f6c19/0x3234de053c4d9f7 lrc: 0/0,0 mode: --/PR res: [0x2b849:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d187a expref: 767 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.637427:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.637427:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.637428:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a2fbd5f2/0x3234de053c51b90 lrc: 3/0,1 mode: PW/PW res: [0x2b849:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.637431:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2fbd5f2/0x3234de053c51b90 lrc: 4/0,1 mode: PW/PW res: [0x2b849:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.637438:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.637443:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001743f524 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+766:41279:x1731746396367040:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 31us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.637446:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12582 00000100:00100000:0.0:1651529344.637446:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1301:39029:x1731745946485952:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 725us (837us total) trans 12885079854 rc 0/0 00000100:00100000:0.0:1651529344.637449:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211799 00000100:00100000:1.0:1651529344.637453:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12583 00000100:00100000:1.0:1651529344.637455:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+765:41278:x1731746396367168:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.637456:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51b89 lrc: 2/0,0 mode: PW/PW res: [0x2b847:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.637457:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.637459:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007a5ce5c5/0x3234de053c4ef98 lrc: 4/0,0 mode: PR/PR res: [0x2b848:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d70be expref: 765 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.637459:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bfb594be already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.637460:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51b89 lrc: 2/0,0 mode: PW/PW res: [0x2b847:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.637462:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007a5ce5c5/0x3234de053c4ef98 lrc: 3/0,0 mode: PR/PR res: [0x2b848:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d70be expref: 765 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.637463:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51b89 lrc: 3/0,0 mode: PW/PW res: [0x2b847:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.637466:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a5ce5c5/0x3234de053c4ef98 lrc: 0/0,0 mode: --/PR res: [0x2b848:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d70be expref: 765 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.637469:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.637470:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.637471:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c51b97 lrc: 3/0,1 mode: PW/PW res: [0x2b848:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.637474:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c51b97 lrc: 4/0,1 mode: PW/PW res: [0x2b848:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.637482:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.637487:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+764:41278:x1731746396367168:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 32us (148us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.637489:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51b89 lrc: 1/0,0 mode: --/PW res: [0x2b847:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.637490:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12583 00010000:00010000:0.0:1651529344.637492:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51b89 lrc: 0/0,0 mode: --/PW res: [0x2b847:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.637499:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c51b97 lrc: 3/0,1 mode: PW/PW res: [0x2b848:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.637502:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a2fbd5f2/0x3234de053c51b90 lrc: 3/0,1 mode: PW/PW res: [0x2b849:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.637502:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c51b97 lrc: 3/0,1 mode: PW/PW res: [0x2b848:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.637505:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2fbd5f2/0x3234de053c51b90 lrc: 3/0,1 mode: PW/PW res: [0x2b849:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.637505:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c51b97 lrc: 3/0,1 mode: PW/PW res: [0x2b848:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.637508:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c51b97 lrc: 2/0,0 mode: PW/PW res: [0x2b848:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.637511:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2fbd5f2/0x3234de053c51b90 lrc: 3/0,1 mode: PW/PW res: [0x2b849:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.637513:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2fbd5f2/0x3234de053c51b90 lrc: 2/0,0 mode: PW/PW res: [0x2b849:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.637550:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1302:39029:x1731745946486016:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 750us (873us total) trans 12885079855 rc 0/0 00000100:00100000:0.0:1651529344.637553:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211801 00000100:00100000:1.0:1651529344.637555:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085af61db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1301:39029:x1731745946486080:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 798us (918us total) trans 12885079856 rc 0/0 00000100:00100000:1.0:1651529344.637558:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211800 00010000:00010000:0.0:1651529344.637560:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c51b97 lrc: 2/0,0 mode: PW/PW res: [0x2b848:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.637563:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065c40e6a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.637564:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c51b97 lrc: 2/0,0 mode: PW/PW res: [0x2b848:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.637567:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c51b97 lrc: 3/0,0 mode: PW/PW res: [0x2b848:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.637571:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c51b97 lrc: 1/0,0 mode: --/PW res: [0x2b848:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.637574:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c51b97 lrc: 0/0,0 mode: --/PW res: [0x2b848:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.637578:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2fbd5f2/0x3234de053c51b90 lrc: 2/0,0 mode: PW/PW res: [0x2b849:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.637581:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a2fbd5f2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.637582:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2fbd5f2/0x3234de053c51b90 lrc: 2/0,0 mode: PW/PW res: [0x2b849:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.637585:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2fbd5f2/0x3234de053c51b90 lrc: 3/0,0 mode: PW/PW res: [0x2b849:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.637588:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2fbd5f2/0x3234de053c51b90 lrc: 1/0,0 mode: --/PW res: [0x2b849:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.637590:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2fbd5f2/0x3234de053c51b90 lrc: 0/0,0 mode: --/PW res: [0x2b849:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.637817:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.637828:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.637838:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946486848 00000100:00100000:1.0:1651529344.637845:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946486912 00000100:00100000:0.0:1651529344.637853:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.637860:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946486976 00000100:00100000:1.0:1651529344.637868:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211807 00000100:00100000:1.0:1651529344.637870:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1303:39029:x1731745946486848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.637874:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:1.0:1651529344.637875:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178255 count 1 00010000:00010000:1.0:1651529344.637879:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b4c7160/0x3234de053c51bc1 lrc: 3/0,1 mode: --/PW res: [0x2b84f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.637889:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000df83e9c5/0x3234de053c4cc91 lrc: 2/0,0 mode: PR/PR res: [0x2b84f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce42b expref: 763 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.637893:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.637893:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.637894:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b4c7160/0x3234de053c51bc1 lrc: 4/0,1 mode: --/PW res: [0x2b84f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.637901:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000df83e9c5/0x3234de053c4cc91 lrc: 3/0,0 mode: PR/PR res: [0x2b84f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce42b expref: 763 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.637905:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000df83e9c5/0x3234de053c4cc91 lrc: 4/0,0 mode: PR/PR res: [0x2b84f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce42b expref: 763 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.637909:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b0d9532a pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997022400:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.637922:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000be0ace91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997022080:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.637924:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000412e5d26 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.637927:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51b9e lrc: 3/0,1 mode: --/PW res: [0x2b84a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.637931:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211808 00000100:00100000:1.0:1651529344.637933:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1303:39030:x1731745946486912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.637937:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178256 count 1 00000100:00100000:0.0:1651529344.637939:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000076d5f96b pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997022144:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.637940:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6df39da/0x3234de053c51bc8 lrc: 3/0,1 mode: --/PW res: [0x2b850:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.637942:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51ba5 lrc: 3/0,1 mode: --/PW res: [0x2b84c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.637945:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000494804d1/0x3234de053c4ee79 lrc: 2/0,0 mode: PR/PR res: [0x2b850:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6bfc expref: 763 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.637948:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.637948:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.637948:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211809 00010000:00010000:1.0:1651529344.637949:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6df39da/0x3234de053c51bc8 lrc: 4/0,1 mode: --/PW res: [0x2b850:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.637950:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1303:39029:x1731745946486976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.637955:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000494804d1/0x3234de053c4ee79 lrc: 3/0,0 mode: PR/PR res: [0x2b850:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6bfc expref: 763 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.637955:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178257 count 1 00010000:00010000:1.0:1651529344.637958:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000494804d1/0x3234de053c4ee79 lrc: 4/0,0 mode: PR/PR res: [0x2b850:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6bfc expref: 763 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.637959:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51bcf lrc: 3/0,1 mode: --/PW res: [0x2b851:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.637963:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002380a18f/0x3234de053c4b920 lrc: 2/0,0 mode: PR/PR res: [0x2b851:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc434 expref: 763 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.637965:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000de0edbdc pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997022464:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.637966:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.637967:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.637967:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51bcf lrc: 4/0,1 mode: --/PW res: [0x2b851:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.637971:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e5f43e7 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.637974:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002380a18f/0x3234de053c4b920 lrc: 3/0,0 mode: PR/PR res: [0x2b851:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc434 expref: 763 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.637978:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002380a18f/0x3234de053c4b920 lrc: 4/0,0 mode: PR/PR res: [0x2b851:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc434 expref: 763 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.637980:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e5997468 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997022208:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.637982:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000076d5f96b pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997022528:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.637983:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000842fc2b4/0x3234de053c51bac lrc: 3/0,1 mode: --/PW res: [0x2b84b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.637991:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 000000003ad73843 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.638001:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae466fbb pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997022336:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.638004:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000082b0fbe4/0x3234de053c51bba lrc: 3/0,1 mode: --/PW res: [0x2b84d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.638033:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396367296 00010000:00010000:0.0:1651529344.638038:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003ec78f20/0x3234de053c4e44d lrc: 4/0,0 mode: PR/PR res: [0x2b84a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d426c expref: 764 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.638056:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12584 00000100:00100000:1.0:1651529344.638057:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.638058:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+764:41278:x1731746396367296:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.638061:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.638062:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003ec78f20/0x3234de053c4e44d lrc: 4/0,0 mode: PR/PR res: [0x2b84a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d426c expref: 764 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.638063:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.638066:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003ec78f20/0x3234de053c4e44d lrc: 3/0,0 mode: PR/PR res: [0x2b84a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d426c expref: 764 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.638069:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.638071:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ec78f20/0x3234de053c4e44d lrc: 0/0,0 mode: --/PR res: [0x2b84a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d426c expref: 764 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.638075:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.638075:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.638075:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.638076:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51b9e lrc: 3/0,1 mode: PW/PW res: [0x2b84a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638079:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51b9e lrc: 4/0,1 mode: PW/PW res: [0x2b84a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.638080:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396367680 00010000:00010000:1.0:1651529344.638085:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b19f7ce3/0x3234de053c4e8ec lrc: 4/0,0 mode: PR/PR res: [0x2b84c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5463 expref: 764 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.638086:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.638091:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396367808 00010000:00010000:1.0:1651529344.638093:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006291b43a/0x3234de053c4dfca lrc: 4/0,0 mode: PR/PR res: [0x2b84b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3075 expref: 765 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.638094:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+765:41278:x1731746396367296:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.638097:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396367872 00000100:00100000:0.0:1651529344.638098:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12584 00010000:00010000:1.0:1651529344.638099:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000010c92236/0x3234de053c4dceb lrc: 4/0,0 mode: PR/PR res: [0x2b84d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d244a expref: 766 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.638103:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396367936 00000100:00100000:1.0:1651529344.638106:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12585 00010000:00010000:0.0:1651529344.638106:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ea4a7f5c/0x3234de053c4e9f6 lrc: 5/0,0 mode: PR/PR res: [0x2b84e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d595d expref: 766 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.638108:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+766:41278:x1731746396367680:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.638110:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.638111:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12586 00010000:00010000:1.0:1651529344.638112:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b19f7ce3/0x3234de053c4e8ec lrc: 4/0,0 mode: PR/PR res: [0x2b84c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5463 expref: 766 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.638113:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+766:41278:x1731746396367808:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.638115:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b19f7ce3/0x3234de053c4e8ec lrc: 3/0,0 mode: PR/PR res: [0x2b84c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5463 expref: 766 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.638115:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.638117:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006291b43a/0x3234de053c4dfca lrc: 4/0,0 mode: PR/PR res: [0x2b84b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3075 expref: 766 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.638120:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006291b43a/0x3234de053c4dfca lrc: 3/0,0 mode: PR/PR res: [0x2b84b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3075 expref: 766 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.638121:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b19f7ce3/0x3234de053c4e8ec lrc: 0/0,0 mode: --/PR res: [0x2b84c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5463 expref: 766 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.638125:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.638125:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.638125:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006291b43a/0x3234de053c4dfca lrc: 0/0,0 mode: --/PR res: [0x2b84b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3075 expref: 765 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.638126:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51ba5 lrc: 3/0,1 mode: PW/PW res: [0x2b84c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638128:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.638129:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51ba5 lrc: 4/0,1 mode: PW/PW res: [0x2b84c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638129:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.638130:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000842fc2b4/0x3234de053c51bac lrc: 3/0,1 mode: PW/PW res: [0x2b84b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638133:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000842fc2b4/0x3234de053c51bac lrc: 4/0,1 mode: PW/PW res: [0x2b84b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.638140:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.638149:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.638153:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+764:41278:x1731746396367680:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 44us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.638156:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12585 00000100:00100000:0.0:1651529344.638156:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+764:41278:x1731746396367808:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.638159:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12586 00000100:00100000:1.0:1651529344.638161:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12587 00000100:00100000:1.0:1651529344.638162:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+762:41279:x1731746396367872:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.638164:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12588 00010000:00010000:1.0:1651529344.638165:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.638165:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+762:41278:x1731746396367936:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.638166:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000010c92236/0x3234de053c4dceb lrc: 4/0,0 mode: PR/PR res: [0x2b84d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d244a expref: 762 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.638168:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.638169:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ea4a7f5c/0x3234de053c4e9f6 lrc: 5/0,0 mode: PR/PR res: [0x2b84e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d595d expref: 762 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.638170:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000010c92236/0x3234de053c4dceb lrc: 3/0,0 mode: PR/PR res: [0x2b84d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d244a expref: 762 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.638173:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ea4a7f5c/0x3234de053c4e9f6 lrc: 4/0,0 mode: PR/PR res: [0x2b84e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d595d expref: 762 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.638175:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010c92236/0x3234de053c4dceb lrc: 0/0,0 mode: --/PR res: [0x2b84d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d244a expref: 762 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.638178:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.638178:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.638179:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.638179:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000082b0fbe4/0x3234de053c51bba lrc: 3/0,1 mode: PW/PW res: [0x2b84d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638179:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.638179:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51bb3 lrc: 3/0,1 mode: PW/PW res: [0x2b84e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.638182:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082b0fbe4/0x3234de053c51bba lrc: 4/0,1 mode: PW/PW res: [0x2b84d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638182:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51bb3 lrc: 4/0,1 mode: PW/PW res: [0x2b84e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638187:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.638188:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.638191:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+761:41278:x1731746396367936:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 25us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.638193:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+761:41279:x1731746396367872:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 30us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.638193:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12588 00000100:00100000:1.0:1651529344.638196:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12587 00010000:00010000:1.0:1651529344.638202:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000842fc2b4/0x3234de053c51bac lrc: 3/0,1 mode: PW/PW res: [0x2b84b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638202:0:156655:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea4a7f5c/0x3234de053c4e9f6 lrc: 0/0,0 mode: --/PR res: [0x2b84e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d595d expref: 759 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.638205:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000842fc2b4/0x3234de053c51bac lrc: 3/0,1 mode: PW/PW res: [0x2b84b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.638205:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e7f02909 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997022272:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.638209:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51bb3 lrc: 3/0,1 mode: PW/PW res: [0x2b84e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.638211:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000842fc2b4/0x3234de053c51bac lrc: 3/0,1 mode: PW/PW res: [0x2b84b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.638213:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000842fc2b4/0x3234de053c51bac lrc: 2/0,0 mode: PW/PW res: [0x2b84b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638213:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51bb3 lrc: 3/0,1 mode: PW/PW res: [0x2b84e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638215:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51bb3 lrc: 3/0,1 mode: PW/PW res: [0x2b84e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638218:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51bb3 lrc: 3/0,1 mode: PW/PW res: [0x2b84e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638269:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51bb3 lrc: 2/0,0 mode: PW/PW res: [0x2b84e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.638284:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1304:39030:x1731745946486400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1094us (1159us total) trans 12885079857 rc 0/0 00000100:00100000:1.0:1651529344.638287:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211804 00010000:00010000:1.0:1651529344.638296:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000082b0fbe4/0x3234de053c51bba lrc: 3/0,1 mode: PW/PW res: [0x2b84d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.638299:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082b0fbe4/0x3234de053c51bba lrc: 3/0,1 mode: PW/PW res: [0x2b84d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.638302:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082b0fbe4/0x3234de053c51bba lrc: 3/0,1 mode: PW/PW res: [0x2b84d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.638305:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082b0fbe4/0x3234de053c51bba lrc: 2/0,0 mode: PW/PW res: [0x2b84d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.638311:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1304:39030:x1731745946486784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1057us (1157us total) trans 12885079858 rc 0/0 00000100:00100000:0.0:1651529344.638322:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211805 00010000:00010000:0.0:1651529344.638330:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000842fc2b4/0x3234de053c51bac lrc: 2/0,0 mode: PW/PW res: [0x2b84b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638333:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000842fc2b4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.638334:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000842fc2b4/0x3234de053c51bac lrc: 2/0,0 mode: PW/PW res: [0x2b84b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638337:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000842fc2b4/0x3234de053c51bac lrc: 3/0,0 mode: PW/PW res: [0x2b84b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638344:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000842fc2b4/0x3234de053c51bac lrc: 1/0,0 mode: --/PW res: [0x2b84b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.638345:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1304:39030:x1731745946486528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1076us (1208us total) trans 12885079859 rc 0/0 00010000:00010000:0.0:1651529344.638347:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000842fc2b4/0x3234de053c51bac lrc: 0/0,0 mode: --/PW res: [0x2b84b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.638348:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211806 00010000:00010000:0.0:1651529344.638351:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51bb3 lrc: 2/0,0 mode: PW/PW res: [0x2b84e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638354:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e6b94407 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.638355:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51bb3 lrc: 2/0,0 mode: PW/PW res: [0x2b84e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638358:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51bb3 lrc: 3/0,0 mode: PW/PW res: [0x2b84e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638361:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51bb3 lrc: 1/0,0 mode: --/PW res: [0x2b84e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638363:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6b94407/0x3234de053c51bb3 lrc: 0/0,0 mode: --/PW res: [0x2b84e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638367:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082b0fbe4/0x3234de053c51bba lrc: 2/0,0 mode: PW/PW res: [0x2b84d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638369:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000082b0fbe4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.638370:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082b0fbe4/0x3234de053c51bba lrc: 2/0,0 mode: PW/PW res: [0x2b84d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638373:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082b0fbe4/0x3234de053c51bba lrc: 3/0,0 mode: PW/PW res: [0x2b84d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638376:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082b0fbe4/0x3234de053c51bba lrc: 1/0,0 mode: --/PW res: [0x2b84d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638379:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082b0fbe4/0x3234de053c51bba lrc: 0/0,0 mode: --/PW res: [0x2b84d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638385:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51ba5 lrc: 3/0,1 mode: PW/PW res: [0x2b84c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638387:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51ba5 lrc: 3/0,1 mode: PW/PW res: [0x2b84c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638390:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51ba5 lrc: 3/0,1 mode: PW/PW res: [0x2b84c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638393:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51ba5 lrc: 2/0,0 mode: PW/PW res: [0x2b84c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.638414:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.638424:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.638434:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.638439:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1304:39029:x1731745946486464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1251us (1384us total) trans 12885079860 rc 0/0 00000100:00100000:0.0:1651529344.638442:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211803 00010000:00010000:0.0:1651529344.638449:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51ba5 lrc: 2/0,0 mode: PW/PW res: [0x2b84c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638455:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c8d9712a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.638456:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51ba5 lrc: 2/0,0 mode: PW/PW res: [0x2b84c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638459:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51ba5 lrc: 3/0,0 mode: PW/PW res: [0x2b84c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638463:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51ba5 lrc: 1/0,0 mode: --/PW res: [0x2b84c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638466:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51ba5 lrc: 0/0,0 mode: --/PW res: [0x2b84c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638471:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51b9e lrc: 3/0,1 mode: PW/PW res: [0x2b84a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638474:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51b9e lrc: 3/0,1 mode: PW/PW res: [0x2b84a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638477:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51b9e lrc: 3/0,1 mode: PW/PW res: [0x2b84a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638480:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51b9e lrc: 2/0,0 mode: PW/PW res: [0x2b84a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.638496:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000de0edbdc pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997022464:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.638501:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d6df39da/0x3234de053c51bc8 lrc: 3/0,1 mode: --/PW res: [0x2b850:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.638509:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396368064 00010000:00010000:1.0:1651529344.638513:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000494804d1/0x3234de053c4ee79 lrc: 4/0,0 mode: PR/PR res: [0x2b850:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6bfc expref: 759 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.638524:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396368000 00010000:00010000:1.0:1651529344.638526:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000df83e9c5/0x3234de053c4cc91 lrc: 5/0,0 mode: PR/PR res: [0x2b84f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce42b expref: 760 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.638531:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396368128 00010000:00010000:1.0:1651529344.638533:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002380a18f/0x3234de053c4b920 lrc: 5/0,0 mode: PR/PR res: [0x2b851:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc434 expref: 761 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.638537:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12589 00000100:00100000:1.0:1651529344.638539:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005649b5c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+761:41278:x1731746396368064:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.638543:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1304:39029:x1731745946486336:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1534us (1574us total) trans 12885079861 rc 0/0 00000100:00100000:0.0:1651529344.638546:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211802 00010000:00010000:1.0:1651529344.638547:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.638548:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000494804d1/0x3234de053c4ee79 lrc: 4/0,0 mode: PR/PR res: [0x2b850:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6bfc expref: 761 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.638552:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000494804d1/0x3234de053c4ee79 lrc: 3/0,0 mode: PR/PR res: [0x2b850:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6bfc expref: 761 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.638553:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51b9e lrc: 2/0,0 mode: PW/PW res: [0x2b84a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638556:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000040cd657 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.638557:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000494804d1/0x3234de053c4ee79 lrc: 0/0,0 mode: --/PR res: [0x2b850:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6bfc expref: 761 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.638557:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51b9e lrc: 2/0,0 mode: PW/PW res: [0x2b84a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638560:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51b9e lrc: 3/0,0 mode: PW/PW res: [0x2b84a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.638562:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.638562:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.638563:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d6df39da/0x3234de053c51bc8 lrc: 3/0,1 mode: PW/PW res: [0x2b850:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638565:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51b9e lrc: 1/0,0 mode: --/PW res: [0x2b84a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.638566:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6df39da/0x3234de053c51bc8 lrc: 4/0,1 mode: PW/PW res: [0x2b850:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638568:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51b9e lrc: 0/0,0 mode: --/PW res: [0x2b84a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.638572:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.638577:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000076d5f96b pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997022528:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.638580:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005649b5c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+760:41278:x1731746396368064:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 41us (166us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.638581:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51bcf lrc: 3/0,1 mode: --/PW res: [0x2b851:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.638583:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12589 00000100:00100000:1.0:1651529344.638591:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12590 00000100:00100000:1.0:1651529344.638593:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+759:41279:x1731746396368000:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.638595:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.638596:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000df83e9c5/0x3234de053c4cc91 lrc: 5/0,0 mode: PR/PR res: [0x2b84f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce42b expref: 759 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.638600:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000df83e9c5/0x3234de053c4cc91 lrc: 4/0,0 mode: PR/PR res: [0x2b84f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce42b expref: 759 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.638605:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.638605:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.638606:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000b4c7160/0x3234de053c51bc1 lrc: 3/0,1 mode: PW/PW res: [0x2b84f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.638618:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b4c7160/0x3234de053c51bc1 lrc: 4/0,1 mode: PW/PW res: [0x2b84f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.638629:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.638635:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+759:41279:x1731746396368000:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.638638:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12590 00000100:00100000:1.0:1651529344.638642:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12591 00000100:00100000:1.0:1651529344.638644:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+758:41279:x1731746396368128:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.638646:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.638647:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002380a18f/0x3234de053c4b920 lrc: 4/0,0 mode: PR/PR res: [0x2b851:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc434 expref: 758 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.638651:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.638658:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002380a18f/0x3234de053c4b920 lrc: 3/0,0 mode: PR/PR res: [0x2b851:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc434 expref: 758 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.638663:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002380a18f/0x3234de053c4b920 lrc: 0/0,0 mode: --/PR res: [0x2b851:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc434 expref: 758 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.638666:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.638667:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.638668:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51bcf lrc: 3/0,1 mode: PW/PW res: [0x2b851:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.638674:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.638676:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51bcf lrc: 4/0,1 mode: PW/PW res: [0x2b851:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.638682:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.638691:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.638697:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+757:41279:x1731746396368128:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 53us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.638697:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.638700:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12591 00000100:00100000:1.0:1651529344.638708:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946487360 00000100:00100000:1.0:1651529344.638713:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946487296 00000100:00100000:1.0:1651529344.638725:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946487488 00000100:00100000:1.0:1651529344.638729:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946487424 00000100:00100000:1.0:1651529344.638733:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211810 00000100:00100000:1.0:1651529344.638744:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1307:39029:x1731745946487360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.638750:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178259 count 1 00010000:00010000:1.0:1651529344.638754:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000128edb5c/0x3234de053c51bd6 lrc: 3/0,1 mode: --/PW res: [0x2b853:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.638758:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005d4f86f7/0x3234de053c4f6c2 lrc: 2/0,0 mode: PR/PR res: [0x2b853:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8dba expref: 756 pid: 156655 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.638761:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211811 00010000:00010000:1.0:1651529344.638762:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.638762:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.638763:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000128edb5c/0x3234de053c51bd6 lrc: 4/0,1 mode: --/PW res: [0x2b853:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.638764:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1307:39030:x1731745946487296:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.638770:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005d4f86f7/0x3234de053c4f6c2 lrc: 3/0,0 mode: PR/PR res: [0x2b853:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8dba expref: 756 pid: 156655 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.638770:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178258 count 1 00010000:00010000:1.0:1651529344.638774:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005d4f86f7/0x3234de053c4f6c2 lrc: 4/0,0 mode: PR/PR res: [0x2b853:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8dba expref: 756 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.638774:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51bdd lrc: 3/0,1 mode: --/PW res: [0x2b852:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638779:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000f3240b0/0x3234de053c4ef9f lrc: 2/0,0 mode: PR/PR res: [0x2b852:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d70da expref: 756 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.638780:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000900b179f pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997022592:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.638782:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.638783:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.638783:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51bdd lrc: 4/0,1 mode: --/PW res: [0x2b852:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.638789:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cfa1ca05 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.638790:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000f3240b0/0x3234de053c4ef9f lrc: 3/0,0 mode: PR/PR res: [0x2b852:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d70da expref: 756 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.638794:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000f3240b0/0x3234de053c4ef9f lrc: 4/0,0 mode: PR/PR res: [0x2b852:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d70da expref: 756 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.638796:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211812 00000100:00100000:1.0:1651529344.638798:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1307:39029:x1731745946487488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.638798:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005fb0ec6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997022656:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.638802:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178261 count 1 00010000:00010000:1.0:1651529344.638805:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d483ffab/0x3234de053c51be4 lrc: 3/0,1 mode: --/PW res: [0x2b855:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.638807:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 000000003ad73843 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.638809:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009edfeee6/0x3234de053c4dfdf lrc: 2/0,0 mode: PR/PR res: [0x2b855:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d30ad expref: 756 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.638812:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.638812:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.638813:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d483ffab/0x3234de053c51be4 lrc: 4/0,1 mode: --/PW res: [0x2b855:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.638814:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211813 00000100:00100000:0.0:1651529344.638816:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1307:39030:x1731745946487424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.638819:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009edfeee6/0x3234de053c4dfdf lrc: 3/0,0 mode: PR/PR res: [0x2b855:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d30ad expref: 756 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.638820:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178260 count 1 00010000:00010000:1.0:1651529344.638822:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009edfeee6/0x3234de053c4dfdf lrc: 4/0,0 mode: PR/PR res: [0x2b855:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d30ad expref: 756 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.638823:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51beb lrc: 3/0,1 mode: --/PW res: [0x2b854:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.638826:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a130088 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997022720:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.638830:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b7578525/0x3234de053c4e43f lrc: 2/0,0 mode: PR/PR res: [0x2b854:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d421f expref: 756 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.638832:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 000000004ca54b8a going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.638833:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.638833:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.638834:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51beb lrc: 4/0,1 mode: --/PW res: [0x2b854:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.638840:0:80278:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df83e9c5/0x3234de053c4cc91 lrc: 0/0,0 mode: --/PR res: [0x2b84f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce42b expref: 756 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.638840:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b7578525/0x3234de053c4e43f lrc: 3/0,0 mode: PR/PR res: [0x2b854:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d421f expref: 756 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.638843:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b7578525/0x3234de053c4e43f lrc: 4/0,0 mode: PR/PR res: [0x2b854:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d421f expref: 756 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.638844:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b0d9532a pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997022400:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.638847:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000064719963 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997022784:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.638848:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000b4c7160/0x3234de053c51bc1 lrc: 3/0,1 mode: PW/PW res: [0x2b84f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.638851:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000b4c7160/0x3234de053c51bc1 lrc: 3/0,1 mode: PW/PW res: [0x2b84f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.638853:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aac87b31 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.638854:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b4c7160/0x3234de053c51bc1 lrc: 3/0,1 mode: PW/PW res: [0x2b84f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.638857:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b4c7160/0x3234de053c51bc1 lrc: 3/0,1 mode: PW/PW res: [0x2b84f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638857:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51bcf lrc: 3/0,1 mode: PW/PW res: [0x2b851:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.638860:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b4c7160/0x3234de053c51bc1 lrc: 2/0,0 mode: PW/PW res: [0x2b84f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638860:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51bcf lrc: 3/0,1 mode: PW/PW res: [0x2b851:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638864:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51bcf lrc: 3/0,1 mode: PW/PW res: [0x2b851:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638873:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51bcf lrc: 2/0,0 mode: PW/PW res: [0x2b851:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.638902:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1309:39029:x1731745946486848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1031us (1085us total) trans 12885079862 rc 0/0 00000100:00100000:1.0:1651529344.638905:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211807 00010000:00010000:1.0:1651529344.638912:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d6df39da/0x3234de053c51bc8 lrc: 3/0,1 mode: PW/PW res: [0x2b850:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.638914:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1308:39029:x1731745946486976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 963us (1061us total) trans 12885079863 rc 0/0 00010000:00010000:1.0:1651529344.638915:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6df39da/0x3234de053c51bc8 lrc: 3/0,1 mode: PW/PW res: [0x2b850:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.638917:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211809 00010000:00010000:1.0:1651529344.638920:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6df39da/0x3234de053c51bc8 lrc: 3/0,1 mode: PW/PW res: [0x2b850:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.638923:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6df39da/0x3234de053c51bc8 lrc: 2/0,0 mode: PW/PW res: [0x2b850:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638925:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b4c7160/0x3234de053c51bc1 lrc: 2/0,0 mode: PW/PW res: [0x2b84f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638928:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000b4c7160 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.638936:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b4c7160/0x3234de053c51bc1 lrc: 2/0,0 mode: PW/PW res: [0x2b84f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638939:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b4c7160/0x3234de053c51bc1 lrc: 3/0,0 mode: PW/PW res: [0x2b84f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638945:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b4c7160/0x3234de053c51bc1 lrc: 1/0,0 mode: --/PW res: [0x2b84f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638947:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b4c7160/0x3234de053c51bc1 lrc: 0/0,0 mode: --/PW res: [0x2b84f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638951:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51bcf lrc: 2/0,0 mode: PW/PW res: [0x2b851:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638954:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000073043e99 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.638955:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51bcf lrc: 2/0,0 mode: PW/PW res: [0x2b851:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.638960:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1308:39030:x1731745946486912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1026us (1132us total) trans 12885079864 rc 0/0 00010000:00010000:0.0:1651529344.638960:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51bcf lrc: 3/0,0 mode: PW/PW res: [0x2b851:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.638963:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211808 00010000:00010000:0.0:1651529344.638964:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51bcf lrc: 1/0,0 mode: --/PW res: [0x2b851:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638966:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073043e99/0x3234de053c51bcf lrc: 0/0,0 mode: --/PW res: [0x2b851:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638969:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6df39da/0x3234de053c51bc8 lrc: 2/0,0 mode: PW/PW res: [0x2b850:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638972:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6df39da already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.638973:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6df39da/0x3234de053c51bc8 lrc: 2/0,0 mode: PW/PW res: [0x2b850:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638975:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6df39da/0x3234de053c51bc8 lrc: 3/0,0 mode: PW/PW res: [0x2b850:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.638978:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6df39da/0x3234de053c51bc8 lrc: 1/0,0 mode: --/PW res: [0x2b850:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.638980:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.638981:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6df39da/0x3234de053c51bc8 lrc: 0/0,0 mode: --/PW res: [0x2b850:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.638989:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946487808 00000100:00100000:0.0:1651529344.639000:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211814 00000100:00100000:0.0:1651529344.639002:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1308:39030:x1731745946487808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.639007:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178262 count 1 00010000:00010000:0.0:1651529344.639010:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51bf2 lrc: 3/0,1 mode: --/PW res: [0x2b856:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639014:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4d5db86/0x3234de053c4c1e7 lrc: 2/0,0 mode: PR/PR res: [0x2b856:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc84e expref: 755 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.639017:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.639018:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.639018:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51bf2 lrc: 4/0,1 mode: --/PW res: [0x2b856:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639025:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b4d5db86/0x3234de053c4c1e7 lrc: 3/0,0 mode: PR/PR res: [0x2b856:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc84e expref: 755 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.639029:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b4d5db86/0x3234de053c4c1e7 lrc: 4/0,0 mode: PR/PR res: [0x2b856:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc84e expref: 755 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.639032:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002a957ba7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997022848:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.639045:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a3b00cf3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.639185:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000900b179f pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997022592:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.639190:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000128edb5c/0x3234de053c51bd6 lrc: 3/0,1 mode: --/PW res: [0x2b853:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.639219:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.639243:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.639252:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946487936 00000100:00100000:0.0:1651529344.639252:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.639262:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946487872 00000100:00100000:1.0:1651529344.639266:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946488000 00000100:00100000:1.0:1651529344.639271:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211815 00000100:00100000:1.0:1651529344.639273:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1311:39030:x1731745946487936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.639279:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211816 00000100:00100000:0.0:1651529344.639281:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1311:39029:x1731745946488000:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.639283:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178264 count 1 00002000:00080000:0.0:1651529344.639286:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178265 count 1 00010000:00010000:1.0:1651529344.639287:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000689e285e/0x3234de053c51bf9 lrc: 3/0,1 mode: --/PW res: [0x2b858:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639290:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51c00 lrc: 3/0,1 mode: --/PW res: [0x2b859:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639292:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f5501c48/0x3234de053c4dcac lrc: 2/0,0 mode: PR/PR res: [0x2b858:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2316 expref: 755 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.639295:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003185e0fa/0x3234de053c4d3bb lrc: 2/0,0 mode: PR/PR res: [0x2b859:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00e8 expref: 755 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.639298:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.639298:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.639298:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.639299:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000689e285e/0x3234de053c51bf9 lrc: 4/0,1 mode: --/PW res: [0x2b858:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639299:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.639300:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51c00 lrc: 4/0,1 mode: --/PW res: [0x2b859:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639305:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f5501c48/0x3234de053c4dcac lrc: 3/0,0 mode: PR/PR res: [0x2b858:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2316 expref: 755 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.639306:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003185e0fa/0x3234de053c4d3bb lrc: 3/0,0 mode: PR/PR res: [0x2b859:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00e8 expref: 755 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.639309:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f5501c48/0x3234de053c4dcac lrc: 4/0,0 mode: PR/PR res: [0x2b858:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2316 expref: 755 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.639310:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003185e0fa/0x3234de053c4d3bb lrc: 4/0,0 mode: PR/PR res: [0x2b859:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00e8 expref: 755 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.639313:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae466fbb pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997022912:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.639314:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004a6776b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997022976:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.639324:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 0000000089d75f07 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.639325:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 000000003c8b0daf going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.639330:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211817 00000100:00100000:1.0:1651529344.639332:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1311:39029:x1731745946487872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.639336:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178263 count 1 00010000:00010000:1.0:1651529344.639340:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a96127a5/0x3234de053c51c07 lrc: 3/0,1 mode: --/PW res: [0x2b857:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639344:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002d6742d5/0x3234de053c4cf31 lrc: 2/0,0 mode: PR/PR res: [0x2b857:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceeb2 expref: 755 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.639347:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.639348:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.639349:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a96127a5/0x3234de053c51c07 lrc: 4/0,1 mode: --/PW res: [0x2b857:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639357:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002d6742d5/0x3234de053c4cf31 lrc: 3/0,0 mode: PR/PR res: [0x2b857:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceeb2 expref: 755 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.639361:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002d6742d5/0x3234de053c4cf31 lrc: 4/0,0 mode: PR/PR res: [0x2b857:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceeb2 expref: 755 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.639364:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e5997468 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997023040:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.639370:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000412e5d26 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.639539:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a130088 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997022720:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.639543:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d483ffab/0x3234de053c51be4 lrc: 3/0,1 mode: --/PW res: [0x2b855:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.639544:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.639551:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.639564:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396368640 00000100:00100000:0.0:1651529344.639569:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.639570:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005d4f86f7/0x3234de053c4f6c2 lrc: 4/0,0 mode: PR/PR res: [0x2b853:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8dba expref: 756 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.639581:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396368768 00010000:00010000:1.0:1651529344.639584:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009edfeee6/0x3234de053c4dfdf lrc: 4/0,0 mode: PR/PR res: [0x2b855:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d30ad expref: 757 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.639586:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.639589:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396368896 00010000:00010000:1.0:1651529344.639591:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b4d5db86/0x3234de053c4c1e7 lrc: 5/0,0 mode: PR/PR res: [0x2b856:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc84e expref: 758 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.639592:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.639595:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396368704 00010000:00010000:1.0:1651529344.639597:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000f3240b0/0x3234de053c4ef9f lrc: 5/0,0 mode: PR/PR res: [0x2b852:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d70da expref: 759 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.639608:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396368832 00010000:00010000:1.0:1651529344.639610:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b7578525/0x3234de053c4e43f lrc: 5/0,0 mode: PR/PR res: [0x2b854:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d421f expref: 760 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.639615:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12592 00000100:00100000:0.0:1651529344.639621:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005fb0ec6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997022656:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.639623:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+760:41279:x1731746396368640:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.639625:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51bdd lrc: 3/0,1 mode: --/PW res: [0x2b852:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639626:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.639627:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005d4f86f7/0x3234de053c4f6c2 lrc: 4/0,0 mode: PR/PR res: [0x2b853:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8dba expref: 760 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.639631:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005d4f86f7/0x3234de053c4f6c2 lrc: 3/0,0 mode: PR/PR res: [0x2b853:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8dba expref: 760 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.639633:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000064719963 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997022784:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.639635:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51beb lrc: 3/0,1 mode: --/PW res: [0x2b854:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639637:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d4f86f7/0x3234de053c4f6c2 lrc: 0/0,0 mode: --/PR res: [0x2b853:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8dba expref: 760 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.639641:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.639641:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.639641:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002a957ba7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997022848:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.639642:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000128edb5c/0x3234de053c51bd6 lrc: 3/0,1 mode: PW/PW res: [0x2b853:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639643:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51bf2 lrc: 3/0,1 mode: --/PW res: [0x2b856:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639645:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000128edb5c/0x3234de053c51bd6 lrc: 4/0,1 mode: PW/PW res: [0x2b853:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.639648:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004a6776b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997022976:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.639651:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.639651:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51c00 lrc: 3/0,1 mode: --/PW res: [0x2b859:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.639657:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12593 00000100:00100000:0.0:1651529344.639659:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+759:41279:x1731746396368768:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.639660:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+759:41279:x1731746396368640:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 36us (117us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.639662:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.639663:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12592 00010000:00010000:0.0:1651529344.639664:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009edfeee6/0x3234de053c4dfdf lrc: 4/0,0 mode: PR/PR res: [0x2b855:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d30ad expref: 759 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.639667:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009edfeee6/0x3234de053c4dfdf lrc: 3/0,0 mode: PR/PR res: [0x2b855:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d30ad expref: 758 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.639668:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12594 00000100:00100000:1.0:1651529344.639669:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+758:41279:x1731746396368896:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.639672:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.639673:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b4d5db86/0x3234de053c4c1e7 lrc: 4/0,0 mode: PR/PR res: [0x2b856:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc84e expref: 758 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.639673:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009edfeee6/0x3234de053c4dfdf lrc: 0/0,0 mode: --/PR res: [0x2b855:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d30ad expref: 758 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.639677:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b4d5db86/0x3234de053c4c1e7 lrc: 3/0,0 mode: PR/PR res: [0x2b856:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc84e expref: 758 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.639680:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.639680:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.639681:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4d5db86/0x3234de053c4c1e7 lrc: 0/0,0 mode: --/PR res: [0x2b856:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc84e expref: 757 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.639681:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d483ffab/0x3234de053c51be4 lrc: 3/0,1 mode: PW/PW res: [0x2b855:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639684:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d483ffab/0x3234de053c51be4 lrc: 4/0,1 mode: PW/PW res: [0x2b855:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639685:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.639685:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.639686:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51bf2 lrc: 3/0,1 mode: PW/PW res: [0x2b856:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639689:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51bf2 lrc: 4/0,1 mode: PW/PW res: [0x2b856:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639694:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.639701:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+756:41279:x1731746396368768:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (150us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.639704:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.639710:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+756:41279:x1731746396368896:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 40us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.639713:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12594 00000100:00100000:1.0:1651529344.639717:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12595 00000100:00100000:1.0:1651529344.639719:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+755:41278:x1731746396368704:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.639721:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.639722:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000f3240b0/0x3234de053c4ef9f lrc: 4/0,0 mode: PR/PR res: [0x2b852:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d70da expref: 755 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.639724:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12593 00010000:00010000:1.0:1651529344.639726:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000f3240b0/0x3234de053c4ef9f lrc: 3/0,0 mode: PR/PR res: [0x2b852:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d70da expref: 755 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.639730:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12596 00010000:00010000:1.0:1651529344.639731:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f3240b0/0x3234de053c4ef9f lrc: 0/0,0 mode: --/PR res: [0x2b852:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d70da expref: 754 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.639732:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d696796e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+754:41278:x1731746396368832:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.639741:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.639742:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.639743:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51bdd lrc: 3/0,1 mode: PW/PW res: [0x2b852:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639746:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51bdd lrc: 4/0,1 mode: PW/PW res: [0x2b852:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639746:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.639748:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b7578525/0x3234de053c4e43f lrc: 4/0,0 mode: PR/PR res: [0x2b854:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d421f expref: 753 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.639752:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b7578525/0x3234de053c4e43f lrc: 3/0,0 mode: PR/PR res: [0x2b854:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d421f expref: 753 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.639754:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.639759:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+753:41278:x1731746396368704:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 40us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.639762:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12595 00010000:00010000:0.0:1651529344.639763:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7578525/0x3234de053c4e43f lrc: 0/0,0 mode: --/PR res: [0x2b854:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d421f expref: 753 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.639766:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.639767:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.639768:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51beb lrc: 3/0,1 mode: PW/PW res: [0x2b854:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639770:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000128edb5c/0x3234de053c51bd6 lrc: 3/0,1 mode: PW/PW res: [0x2b853:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639771:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51beb lrc: 4/0,1 mode: PW/PW res: [0x2b854:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639773:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000128edb5c/0x3234de053c51bd6 lrc: 3/0,1 mode: PW/PW res: [0x2b853:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639777:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000128edb5c/0x3234de053c51bd6 lrc: 3/0,1 mode: PW/PW res: [0x2b853:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639777:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.639779:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000128edb5c/0x3234de053c51bd6 lrc: 2/0,0 mode: PW/PW res: [0x2b853:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.639784:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d696796e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+751:41278:x1731746396368832:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 51us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.639792:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12596 00010000:00010000:0.0:1651529344.639802:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51bdd lrc: 3/0,1 mode: PW/PW res: [0x2b852:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639806:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51bdd lrc: 3/0,1 mode: PW/PW res: [0x2b852:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639809:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51bdd lrc: 3/0,1 mode: PW/PW res: [0x2b852:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639812:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51bdd lrc: 2/0,0 mode: PW/PW res: [0x2b852:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.639822:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1312:39029:x1731745946487360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1077us (1171us total) trans 12885079865 rc 0/0 00000100:00100000:1.0:1651529344.639825:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211810 00010000:00010000:1.0:1651529344.639832:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d483ffab/0x3234de053c51be4 lrc: 3/0,1 mode: PW/PW res: [0x2b855:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639835:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d483ffab/0x3234de053c51be4 lrc: 3/0,1 mode: PW/PW res: [0x2b855:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639838:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d483ffab/0x3234de053c51be4 lrc: 3/0,1 mode: PW/PW res: [0x2b855:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.639841:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d483ffab/0x3234de053c51be4 lrc: 2/0,0 mode: PW/PW res: [0x2b855:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.639860:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1313:39030:x1731745946487296:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1096us (1186us total) trans 12885079866 rc 0/0 00000100:00100000:0.0:1651529344.639863:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211811 00010000:00010000:0.0:1651529344.639871:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000128edb5c/0x3234de053c51bd6 lrc: 2/0,0 mode: PW/PW res: [0x2b853:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639877:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000128edb5c already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.639878:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1312:39029:x1731745946487488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1079us (1195us total) trans 12885079867 rc 0/0 00010000:00010000:0.0:1651529344.639878:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000128edb5c/0x3234de053c51bd6 lrc: 2/0,0 mode: PW/PW res: [0x2b853:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.639881:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211812 00010000:00010000:0.0:1651529344.639881:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000128edb5c/0x3234de053c51bd6 lrc: 3/0,0 mode: PW/PW res: [0x2b853:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639885:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000128edb5c/0x3234de053c51bd6 lrc: 1/0,0 mode: --/PW res: [0x2b853:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639888:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000128edb5c/0x3234de053c51bd6 lrc: 0/0,0 mode: --/PW res: [0x2b853:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.639891:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae466fbb pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997022912:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.639892:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51bdd lrc: 2/0,0 mode: PW/PW res: [0x2b852:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639895:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000491b5359 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.639896:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000689e285e/0x3234de053c51bf9 lrc: 3/0,1 mode: --/PW res: [0x2b858:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639896:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51bdd lrc: 2/0,0 mode: PW/PW res: [0x2b852:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639898:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51bdd lrc: 3/0,0 mode: PW/PW res: [0x2b852:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639901:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51bdd lrc: 1/0,0 mode: --/PW res: [0x2b852:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639904:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000491b5359/0x3234de053c51bdd lrc: 0/0,0 mode: --/PW res: [0x2b852:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639907:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d483ffab/0x3234de053c51be4 lrc: 2/0,0 mode: PW/PW res: [0x2b855:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639910:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d483ffab already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.639911:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d483ffab/0x3234de053c51be4 lrc: 2/0,0 mode: PW/PW res: [0x2b855:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639913:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d483ffab/0x3234de053c51be4 lrc: 3/0,0 mode: PW/PW res: [0x2b855:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639916:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d483ffab/0x3234de053c51be4 lrc: 1/0,0 mode: --/PW res: [0x2b855:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639919:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d483ffab/0x3234de053c51be4 lrc: 0/0,0 mode: --/PW res: [0x2b855:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639925:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51beb lrc: 3/0,1 mode: PW/PW res: [0x2b854:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639928:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51beb lrc: 3/0,1 mode: PW/PW res: [0x2b854:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639931:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51beb lrc: 3/0,1 mode: PW/PW res: [0x2b854:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639933:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51beb lrc: 2/0,0 mode: PW/PW res: [0x2b854:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.639942:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.639957:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.639967:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.639977:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1312:39030:x1731745946487424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1160us (1280us total) trans 12885079868 rc 0/0 00000100:00100000:0.0:1651529344.639981:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211813 00010000:00010000:0.0:1651529344.639988:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51beb lrc: 2/0,0 mode: PW/PW res: [0x2b854:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639991:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eaaf5dcd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.639992:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51beb lrc: 2/0,0 mode: PW/PW res: [0x2b854:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639995:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51beb lrc: 3/0,0 mode: PW/PW res: [0x2b854:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.639999:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51beb lrc: 1/0,0 mode: --/PW res: [0x2b854:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640002:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eaaf5dcd/0x3234de053c51beb lrc: 0/0,0 mode: --/PW res: [0x2b854:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640007:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51bf2 lrc: 3/0,1 mode: PW/PW res: [0x2b856:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640010:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51bf2 lrc: 3/0,1 mode: PW/PW res: [0x2b856:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640013:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51bf2 lrc: 3/0,1 mode: PW/PW res: [0x2b856:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640016:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51bf2 lrc: 2/0,0 mode: PW/PW res: [0x2b856:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.640034:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e5997468 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997023040:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.640038:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a96127a5/0x3234de053c51c07 lrc: 3/0,1 mode: --/PW res: [0x2b857:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.640045:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396369024 00010000:00010000:1.0:1651529344.640050:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f5501c48/0x3234de053c4dcac lrc: 4/0,0 mode: PR/PR res: [0x2b858:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2316 expref: 751 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.640057:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396369088 00010000:00010000:1.0:1651529344.640059:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003185e0fa/0x3234de053c4d3bb lrc: 4/0,0 mode: PR/PR res: [0x2b859:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00e8 expref: 752 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.640063:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396369152 00010000:00010000:1.0:1651529344.640065:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002d6742d5/0x3234de053c4cf31 lrc: 4/0,0 mode: PR/PR res: [0x2b857:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceeb2 expref: 753 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.640076:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12597 00000100:00100000:0.0:1651529344.640077:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1312:39030:x1731745946487808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1074us (1097us total) trans 12885079869 rc 0/0 00000100:00100000:1.0:1651529344.640078:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+753:41279:x1731746396369024:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.640080:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211814 00010000:00010000:1.0:1651529344.640081:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.640082:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f5501c48/0x3234de053c4dcac lrc: 4/0,0 mode: PR/PR res: [0x2b858:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2316 expref: 753 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.640086:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f5501c48/0x3234de053c4dcac lrc: 3/0,0 mode: PR/PR res: [0x2b858:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2316 expref: 753 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.640087:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51bf2 lrc: 2/0,0 mode: PW/PW res: [0x2b856:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640091:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000495c20c9 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.640092:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5501c48/0x3234de053c4dcac lrc: 0/0,0 mode: --/PR res: [0x2b858:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2316 expref: 753 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.640092:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51bf2 lrc: 2/0,0 mode: PW/PW res: [0x2b856:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.640095:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.640095:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51bf2 lrc: 3/0,0 mode: PW/PW res: [0x2b856:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.640096:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.640097:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000689e285e/0x3234de053c51bf9 lrc: 3/0,1 mode: PW/PW res: [0x2b858:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640099:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51bf2 lrc: 1/0,0 mode: --/PW res: [0x2b856:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.640100:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000689e285e/0x3234de053c51bf9 lrc: 4/0,1 mode: PW/PW res: [0x2b858:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640102:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000495c20c9/0x3234de053c51bf2 lrc: 0/0,0 mode: --/PW res: [0x2b856:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.640106:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.640113:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+752:41279:x1731746396369024:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.640115:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12597 00000100:00100000:1.0:1651529344.640119:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12598 00000100:00100000:1.0:1651529344.640121:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+751:41278:x1731746396369088:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.640123:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.640124:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003185e0fa/0x3234de053c4d3bb lrc: 4/0,0 mode: PR/PR res: [0x2b859:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00e8 expref: 751 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.640128:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003185e0fa/0x3234de053c4d3bb lrc: 3/0,0 mode: PR/PR res: [0x2b859:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00e8 expref: 751 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.640140:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003185e0fa/0x3234de053c4d3bb lrc: 0/0,0 mode: --/PR res: [0x2b859:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00e8 expref: 751 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.640154:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.640154:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.640155:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51c00 lrc: 3/0,1 mode: PW/PW res: [0x2b859:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.640158:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51c00 lrc: 4/0,1 mode: PW/PW res: [0x2b859:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.640167:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.640172:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12599 00000100:00100000:1.0:1651529344.640173:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+750:41278:x1731746396369088:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 52us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.640174:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+750:41279:x1731746396369152:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.640176:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12598 00010000:00010000:0.0:1651529344.640178:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.640183:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000689e285e/0x3234de053c51bf9 lrc: 3/0,1 mode: PW/PW res: [0x2b858:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.640186:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000689e285e/0x3234de053c51bf9 lrc: 3/0,1 mode: PW/PW res: [0x2b858:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.640189:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000689e285e/0x3234de053c51bf9 lrc: 3/0,1 mode: PW/PW res: [0x2b858:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640190:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002d6742d5/0x3234de053c4cf31 lrc: 4/0,0 mode: PR/PR res: [0x2b857:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceeb2 expref: 749 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.640191:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000689e285e/0x3234de053c51bf9 lrc: 2/0,0 mode: PW/PW res: [0x2b858:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640195:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002d6742d5/0x3234de053c4cf31 lrc: 3/0,0 mode: PR/PR res: [0x2b857:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceeb2 expref: 749 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.640206:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d6742d5/0x3234de053c4cf31 lrc: 0/0,0 mode: --/PR res: [0x2b857:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceeb2 expref: 749 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.640210:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.640210:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.640211:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a96127a5/0x3234de053c51c07 lrc: 3/0,1 mode: PW/PW res: [0x2b857:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640214:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a96127a5/0x3234de053c51c07 lrc: 4/0,1 mode: PW/PW res: [0x2b857:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640251:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.640256:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1312:39030:x1731745946487936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 981us (1036us total) trans 12885079870 rc 0/0 00000100:00100000:1.0:1651529344.640259:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211815 00000100:00100000:0.0:1651529344.640260:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+748:41279:x1731746396369152:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 85us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.640262:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12599 00010000:00010000:1.0:1651529344.640266:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a96127a5/0x3234de053c51c07 lrc: 3/0,1 mode: PW/PW res: [0x2b857:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.640270:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a96127a5/0x3234de053c51c07 lrc: 3/0,1 mode: PW/PW res: [0x2b857:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640270:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000689e285e/0x3234de053c51bf9 lrc: 2/0,0 mode: PW/PW res: [0x2b858:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.640273:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a96127a5/0x3234de053c51c07 lrc: 3/0,1 mode: PW/PW res: [0x2b857:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640273:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000689e285e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.640274:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000689e285e/0x3234de053c51bf9 lrc: 2/0,0 mode: PW/PW res: [0x2b858:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.640276:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a96127a5/0x3234de053c51c07 lrc: 2/0,0 mode: PW/PW res: [0x2b857:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640277:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000689e285e/0x3234de053c51bf9 lrc: 3/0,0 mode: PW/PW res: [0x2b858:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640282:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000689e285e/0x3234de053c51bf9 lrc: 1/0,0 mode: --/PW res: [0x2b858:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640291:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000689e285e/0x3234de053c51bf9 lrc: 0/0,0 mode: --/PW res: [0x2b858:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640295:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a96127a5/0x3234de053c51c07 lrc: 2/0,0 mode: PW/PW res: [0x2b857:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640298:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a96127a5 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.640299:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a96127a5/0x3234de053c51c07 lrc: 2/0,0 mode: PW/PW res: [0x2b857:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640302:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a96127a5/0x3234de053c51c07 lrc: 3/0,0 mode: PW/PW res: [0x2b857:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640305:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a96127a5/0x3234de053c51c07 lrc: 1/0,0 mode: --/PW res: [0x2b857:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640308:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a96127a5/0x3234de053c51c07 lrc: 0/0,0 mode: --/PW res: [0x2b857:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.640312:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1312:39029:x1731745946487872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 979us (1068us total) trans 12885079871 rc 0/0 00010000:00010000:0.0:1651529344.640313:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51c00 lrc: 3/0,1 mode: PW/PW res: [0x2b859:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.640315:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211817 00010000:00010000:0.0:1651529344.640316:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51c00 lrc: 3/0,1 mode: PW/PW res: [0x2b859:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640322:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51c00 lrc: 3/0,1 mode: PW/PW res: [0x2b859:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640324:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51c00 lrc: 2/0,0 mode: PW/PW res: [0x2b859:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.640349:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.640362:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1312:39029:x1731745946488000:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1080us (1109us total) trans 12885079872 rc 0/0 00000100:00100000:1.0:1651529344.640365:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.640365:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211816 00000100:00100000:0.0:1651529344.640370:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946488512 00000100:00100000:1.0:1651529344.640375:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.640386:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946488640 00000100:00100000:0.0:1651529344.640394:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946488576 00000100:00100000:0.0:1651529344.640399:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211818 00000100:00100000:0.0:1651529344.640401:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1314:39029:x1731745946488512:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.640406:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178266 count 1 00010000:00010000:0.0:1651529344.640410:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51c0e lrc: 3/0,1 mode: --/PW res: [0x2b85a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.640413:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.640415:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0bb0de7/0x3234de053c4f564 lrc: 2/0,0 mode: PR/PR res: [0x2b85a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d87ee expref: 747 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.640418:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.640419:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.640419:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51c0e lrc: 4/0,1 mode: --/PW res: [0x2b85a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.640424:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.640426:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b0bb0de7/0x3234de053c4f564 lrc: 3/0,0 mode: PR/PR res: [0x2b85a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d87ee expref: 747 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.640430:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b0bb0de7/0x3234de053c4f564 lrc: 4/0,0 mode: PR/PR res: [0x2b85a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d87ee expref: 747 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.640434:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ea0220b6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997023104:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.640448:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aac87b31 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.640453:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51c00 lrc: 2/0,0 mode: PW/PW res: [0x2b859:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.640455:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946488704 00010000:00010000:0.0:1651529344.640456:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000088cc87df already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.640457:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51c00 lrc: 2/0,0 mode: PW/PW res: [0x2b859:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640460:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51c00 lrc: 3/0,0 mode: PW/PW res: [0x2b859:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.640462:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946488768 00010000:00010000:0.0:1651529344.640465:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51c00 lrc: 1/0,0 mode: --/PW res: [0x2b859:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.640470:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211819 00000100:00100000:1.0:1651529344.640472:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1316:39029:x1731745946488640:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.640473:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088cc87df/0x3234de053c51c00 lrc: 0/0,0 mode: --/PW res: [0x2b859:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.640477:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178268 count 1 00000100:00100000:0.0:1651529344.640481:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211820 00010000:00010000:1.0:1651529344.640482:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be1256ce/0x3234de053c51c15 lrc: 3/0,1 mode: --/PW res: [0x2b85c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.640483:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1316:39029:x1731745946488576:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.640487:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003a9d224b/0x3234de053c4dc12 lrc: 2/0,0 mode: PR/PR res: [0x2b85c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d20bc expref: 747 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.640488:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178267 count 1 00010000:00010000:1.0:1651529344.640490:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.640491:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.640491:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be1256ce/0x3234de053c51c15 lrc: 4/0,1 mode: --/PW res: [0x2b85c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640491:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c51c1c lrc: 3/0,1 mode: --/PW res: [0x2b85b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640495:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008f926c05/0x3234de053c4e756 lrc: 2/0,0 mode: PR/PR res: [0x2b85b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e3c expref: 747 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.640498:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003a9d224b/0x3234de053c4dc12 lrc: 3/0,0 mode: PR/PR res: [0x2b85c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d20bc expref: 747 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.640498:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.640499:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.640499:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c51c1c lrc: 4/0,1 mode: --/PW res: [0x2b85b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.640502:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003a9d224b/0x3234de053c4dc12 lrc: 4/0,0 mode: PR/PR res: [0x2b85c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d20bc expref: 747 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.640506:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000078a40aa9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997023168:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.640515:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000412e5d26 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.640521:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211821 00000100:00100000:1.0:1651529344.640523:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1316:39029:x1731745946488704:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.640524:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008f926c05/0x3234de053c4e756 lrc: 3/0,0 mode: PR/PR res: [0x2b85b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e3c expref: 747 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.640527:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178269 count 1 00010000:00010000:0.0:1651529344.640528:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008f926c05/0x3234de053c4e756 lrc: 4/0,0 mode: PR/PR res: [0x2b85b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e3c expref: 747 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.640530:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000920e959f/0x3234de053c51c23 lrc: 3/0,1 mode: --/PW res: [0x2b85d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.640533:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002c4168d4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997023232:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.640537:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005fb3bcc7/0x3234de053c4e5ea lrc: 2/0,0 mode: PR/PR res: [0x2b85d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4911 expref: 747 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.640540:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.640541:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.640541:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000920e959f/0x3234de053c51c23 lrc: 4/0,1 mode: --/PW res: [0x2b85d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.640541:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 000000003ad73843 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.640547:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005fb3bcc7/0x3234de053c4e5ea lrc: 3/0,0 mode: PR/PR res: [0x2b85d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4911 expref: 747 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.640548:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211822 00010000:00010000:1.0:1651529344.640550:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005fb3bcc7/0x3234de053c4e5ea lrc: 4/0,0 mode: PR/PR res: [0x2b85d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4911 expref: 747 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.640550:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1316:39030:x1731745946488768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.640554:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c20a6e11 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997023296:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.640554:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178270 count 1 00010000:00010000:0.0:1651529344.640558:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51c2a lrc: 3/0,1 mode: --/PW res: [0x2b85e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.640560:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f79d8146 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.640562:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb247601/0x3234de053c4d796 lrc: 2/0,0 mode: PR/PR res: [0x2b85e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ff2 expref: 747 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.640565:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.640566:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.640566:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51c2a lrc: 4/0,1 mode: --/PW res: [0x2b85e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640573:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eb247601/0x3234de053c4d796 lrc: 3/0,0 mode: PR/PR res: [0x2b85e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ff2 expref: 747 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.640576:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eb247601/0x3234de053c4d796 lrc: 4/0,0 mode: PR/PR res: [0x2b85e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ff2 expref: 747 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.640580:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000053ee5af1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997023360:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.640586:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bff8744a going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.640672:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.640680:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.640688:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.640697:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946488960 00000100:00100000:0.0:1651529344.640698:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946488896 00000100:00100000:1.0:1651529344.640704:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946489024 00000100:00100000:0.0:1651529344.640709:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211823 00000100:00100000:0.0:1651529344.640710:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1319:39030:x1731745946488960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.640714:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211824 00002000:00080000:0.0:1651529344.640715:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178272 count 1 00000100:00100000:1.0:1651529344.640716:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1319:39029:x1731745946488896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.640720:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fb0278b/0x3234de053c51c31 lrc: 3/0,1 mode: --/PW res: [0x2b860:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.640721:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178271 count 1 00010000:00010000:0.0:1651529344.640724:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d7285c52/0x3234de053c4aed1 lrc: 2/0,0 mode: PR/PR res: [0x2b860:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf72 expref: 747 pid: 80278 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.640725:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f14837b/0x3234de053c51c38 lrc: 3/0,1 mode: --/PW res: [0x2b85f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640728:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.640728:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.640729:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007c57055c/0x3234de053c4cfcb lrc: 2/0,0 mode: PR/PR res: [0x2b85f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf0c6 expref: 747 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.640729:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fb0278b/0x3234de053c51c31 lrc: 4/0,1 mode: --/PW res: [0x2b860:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.640744:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.640744:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d7285c52/0x3234de053c4aed1 lrc: 3/0,0 mode: PR/PR res: [0x2b860:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf72 expref: 747 pid: 80278 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.640745:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.640745:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f14837b/0x3234de053c51c38 lrc: 4/0,1 mode: --/PW res: [0x2b85f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640748:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d7285c52/0x3234de053c4aed1 lrc: 4/0,0 mode: PR/PR res: [0x2b860:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf72 expref: 747 pid: 80278 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.640752:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007c57055c/0x3234de053c4cfcb lrc: 3/0,0 mode: PR/PR res: [0x2b85f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf0c6 expref: 747 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.640752:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002a957ba7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997023424:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.640756:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007c57055c/0x3234de053c4cfcb lrc: 4/0,0 mode: PR/PR res: [0x2b85f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf0c6 expref: 747 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.640760:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000027c41311 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997023488:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.640765:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 000000000e7e66c4 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.640772:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211825 00000100:00100000:0.0:1651529344.640774:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055050f08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1319:39029:x1731745946489024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.640775:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 000000004ca54b8a going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.640778:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178273 count 1 00010000:00010000:0.0:1651529344.640782:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000329f2d10/0x3234de053c51c3f lrc: 3/0,1 mode: --/PW res: [0x2b861:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640786:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000021012aa4/0x3234de053c4e947 lrc: 2/0,0 mode: PR/PR res: [0x2b861:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5685 expref: 747 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.640789:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.640790:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.640790:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000329f2d10/0x3234de053c51c3f lrc: 4/0,1 mode: --/PW res: [0x2b861:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640797:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000021012aa4/0x3234de053c4e947 lrc: 3/0,0 mode: PR/PR res: [0x2b861:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5685 expref: 747 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.640800:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000021012aa4/0x3234de053c4e947 lrc: 4/0,0 mode: PR/PR res: [0x2b861:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5685 expref: 747 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.640804:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000064719963 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997023552:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.640813:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a82c4968 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.640888:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ea0220b6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997023104:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.640896:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.640898:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51c0e lrc: 3/0,1 mode: --/PW res: [0x2b85a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.640906:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000078a40aa9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997023168:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.640906:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002c4168d4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997023232:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.640909:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c51c1c lrc: 3/0,1 mode: --/PW res: [0x2b85b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.640911:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000be1256ce/0x3234de053c51c15 lrc: 3/0,1 mode: --/PW res: [0x2b85c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.640917:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396369664 00010000:00010000:1.0:1651529344.640922:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b0bb0de7/0x3234de053c4f564 lrc: 4/0,0 mode: PR/PR res: [0x2b85a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d87ee expref: 748 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.640932:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12600 00000100:00100000:1.0:1651529344.640933:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+748:41279:x1731746396369664:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.640936:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.640938:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b0bb0de7/0x3234de053c4f564 lrc: 4/0,0 mode: PR/PR res: [0x2b85a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d87ee expref: 748 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.640942:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b0bb0de7/0x3234de053c4f564 lrc: 3/0,0 mode: PR/PR res: [0x2b85a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d87ee expref: 748 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.640947:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0bb0de7/0x3234de053c4f564 lrc: 0/0,0 mode: --/PR res: [0x2b85a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d87ee expref: 748 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.640951:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.640951:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.640952:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51c0e lrc: 3/0,1 mode: PW/PW res: [0x2b85a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.640955:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51c0e lrc: 4/0,1 mode: PW/PW res: [0x2b85a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.640963:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.640965:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51c0e lrc: 3/0,1 mode: PW/PW res: [0x2b85a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640968:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51c0e lrc: 3/0,1 mode: PW/PW res: [0x2b85a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.640972:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+747:41279:x1731746396369664:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 38us (77us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.640975:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12600 00010000:00010000:0.0:1651529344.640976:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51c0e lrc: 3/0,1 mode: PW/PW res: [0x2b85a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.640978:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51c0e lrc: 2/0,0 mode: PW/PW res: [0x2b85a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.641026:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1320:39029:x1731745946488512:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 624us (676us total) trans 12885079873 rc 0/0 00000100:00100000:0.0:1651529344.641031:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211818 00010000:00010000:0.0:1651529344.641038:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51c0e lrc: 2/0,0 mode: PW/PW res: [0x2b85a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641041:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000037fb8315 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.641042:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51c0e lrc: 2/0,0 mode: PW/PW res: [0x2b85a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641045:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51c0e lrc: 3/0,0 mode: PW/PW res: [0x2b85a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641050:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51c0e lrc: 1/0,0 mode: --/PW res: [0x2b85a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641053:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037fb8315/0x3234de053c51c0e lrc: 0/0,0 mode: --/PW res: [0x2b85a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.641108:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.641117:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396369792 00010000:00010000:1.0:1651529344.641123:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008f926c05/0x3234de053c4e756 lrc: 4/0,0 mode: PR/PR res: [0x2b85b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e3c expref: 747 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.641133:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12601 00000100:00100000:1.0:1651529344.641135:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+747:41279:x1731746396369792:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.641138:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.641139:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008f926c05/0x3234de053c4e756 lrc: 4/0,0 mode: PR/PR res: [0x2b85b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e3c expref: 747 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.641143:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008f926c05/0x3234de053c4e756 lrc: 3/0,0 mode: PR/PR res: [0x2b85b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e3c expref: 747 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.641148:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f926c05/0x3234de053c4e756 lrc: 0/0,0 mode: --/PR res: [0x2b85b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e3c expref: 747 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.641151:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.641152:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.641153:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c51c1c lrc: 3/0,1 mode: PW/PW res: [0x2b85b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.641156:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c51c1c lrc: 4/0,1 mode: PW/PW res: [0x2b85b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.641164:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.641173:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+746:41279:x1731746396369792:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 37us (65us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.641175:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12601 00000100:00100000:1.0:1651529344.641190:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.641202:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c51c1c lrc: 3/0,1 mode: PW/PW res: [0x2b85b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641206:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c51c1c lrc: 3/0,1 mode: PW/PW res: [0x2b85b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641210:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c51c1c lrc: 3/0,1 mode: PW/PW res: [0x2b85b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641215:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c51c1c lrc: 2/0,0 mode: PW/PW res: [0x2b85b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.641239:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.641266:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c20a6e11 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997023296:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.641270:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000920e959f/0x3234de053c51c23 lrc: 3/0,1 mode: --/PW res: [0x2b85d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.641277:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396369728 00000100:00100000:0.0:1651529344.641282:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1320:39029:x1731745946488576:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 798us (906us total) trans 12885079874 rc 0/0 00000100:00100000:0.0:1651529344.641285:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211820 00010000:00010000:1.0:1651529344.641287:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003a9d224b/0x3234de053c4dc12 lrc: 4/0,0 mode: PR/PR res: [0x2b85c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d20bc expref: 746 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.641290:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946489344 00000100:00100000:1.0:1651529344.641297:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12602 00000100:00100000:1.0:1651529344.641304:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+746:41279:x1731746396369728:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.641305:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211826 00010000:00010000:1.0:1651529344.641307:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.641307:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1320:39030:x1731745946489344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.641308:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003a9d224b/0x3234de053c4dc12 lrc: 4/0,0 mode: PR/PR res: [0x2b85c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d20bc expref: 746 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.641312:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003a9d224b/0x3234de053c4dc12 lrc: 3/0,0 mode: PR/PR res: [0x2b85c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d20bc expref: 746 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:0.0:1651529344.641312:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178274 count 1 00010000:00010000:0.0:1651529344.641316:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000516dff5d/0x3234de053c51c46 lrc: 3/0,1 mode: --/PW res: [0x2b862:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.641317:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a9d224b/0x3234de053c4dc12 lrc: 0/0,0 mode: --/PR res: [0x2b85c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d20bc expref: 746 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.641321:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.641321:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.641321:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2613351/0x3234de053c4d8c3 lrc: 2/0,0 mode: PR/PR res: [0x2b862:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d13d4 expref: 745 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.641322:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000be1256ce/0x3234de053c51c15 lrc: 3/0,1 mode: PW/PW res: [0x2b85c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641324:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.641325:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be1256ce/0x3234de053c51c15 lrc: 4/0,1 mode: PW/PW res: [0x2b85c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641325:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.641325:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000516dff5d/0x3234de053c51c46 lrc: 4/0,1 mode: --/PW res: [0x2b862:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.641331:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.641332:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c2613351/0x3234de053c4d8c3 lrc: 3/0,0 mode: PR/PR res: [0x2b862:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d13d4 expref: 745 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.641336:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c2613351/0x3234de053c4d8c3 lrc: 4/0,0 mode: PR/PR res: [0x2b862:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d13d4 expref: 745 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.641338:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+745:41279:x1731746396369728:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 34us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.641340:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12602 00000100:00100000:0.0:1651529344.641343:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002c4168d4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997023616:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.641346:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000be1256ce/0x3234de053c51c15 lrc: 3/0,1 mode: PW/PW res: [0x2b85c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.641350:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be1256ce/0x3234de053c51c15 lrc: 3/0,1 mode: PW/PW res: [0x2b85c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.641352:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000009370c1d going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.641353:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be1256ce/0x3234de053c51c15 lrc: 3/0,1 mode: PW/PW res: [0x2b85c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.641356:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be1256ce/0x3234de053c51c15 lrc: 2/0,0 mode: PW/PW res: [0x2b85c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641388:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c51c1c lrc: 2/0,0 mode: PW/PW res: [0x2b85b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641392:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a5c1b0ba already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.641393:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c51c1c lrc: 2/0,0 mode: PW/PW res: [0x2b85b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641396:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c51c1c lrc: 3/0,0 mode: PW/PW res: [0x2b85b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641401:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c51c1c lrc: 1/0,0 mode: --/PW res: [0x2b85b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641403:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5c1b0ba/0x3234de053c51c1c lrc: 0/0,0 mode: --/PW res: [0x2b85b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.641405:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1321:39029:x1731745946488640:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 932us (1040us total) trans 12885079875 rc 0/0 00000100:00100000:1.0:1651529344.641408:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211819 00010000:00010000:0.0:1651529344.641408:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be1256ce/0x3234de053c51c15 lrc: 2/0,0 mode: PW/PW res: [0x2b85c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641410:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000be1256ce already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.641411:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be1256ce/0x3234de053c51c15 lrc: 2/0,0 mode: PW/PW res: [0x2b85c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641414:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be1256ce/0x3234de053c51c15 lrc: 3/0,0 mode: PW/PW res: [0x2b85c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641418:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be1256ce/0x3234de053c51c15 lrc: 1/0,0 mode: --/PW res: [0x2b85c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641420:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be1256ce/0x3234de053c51c15 lrc: 0/0,0 mode: --/PW res: [0x2b85c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.641429:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000053ee5af1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997023360:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.641433:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51c2a lrc: 3/0,1 mode: --/PW res: [0x2b85e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.641440:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002a957ba7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997023424:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.641442:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002fb0278b/0x3234de053c51c31 lrc: 3/0,1 mode: --/PW res: [0x2b860:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.641478:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000064719963 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997023552:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.641483:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000329f2d10/0x3234de053c51c3f lrc: 3/0,1 mode: --/PW res: [0x2b861:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.641486:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000027c41311 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997023488:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.641490:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001f14837b/0x3234de053c51c38 lrc: 3/0,1 mode: --/PW res: [0x2b85f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.641504:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.641514:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396369856 00000100:00100000:1.0:1651529344.641515:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.641520:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005fb3bcc7/0x3234de053c4e5ea lrc: 4/0,0 mode: PR/PR res: [0x2b85d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4911 expref: 745 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.641522:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.641530:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396369984 00000100:00100000:1.0:1651529344.641533:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.641533:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d7285c52/0x3234de053c4aed1 lrc: 4/0,0 mode: PR/PR res: [0x2b860:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf72 expref: 746 pid: 80278 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.641540:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.641540:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396370112 00010000:00010000:0.0:1651529344.641542:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000021012aa4/0x3234de053c4e947 lrc: 4/0,0 mode: PR/PR res: [0x2b861:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5685 expref: 747 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.641545:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396369920 00000100:00100000:0.0:1651529344.641547:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396370048 00010000:00010000:0.0:1651529344.641549:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007c57055c/0x3234de053c4cfcb lrc: 4/0,0 mode: PR/PR res: [0x2b85f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf0c6 expref: 749 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.641550:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eb247601/0x3234de053c4d796 lrc: 4/0,0 mode: PR/PR res: [0x2b85e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ff2 expref: 749 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.641553:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12603 00000100:00100000:0.0:1651529344.641555:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000534d68d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+749:41278:x1731746396369856:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.641557:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12604 00010000:00010000:0.0:1651529344.641558:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.641559:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+749:41278:x1731746396369984:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.641559:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005fb3bcc7/0x3234de053c4e5ea lrc: 4/0,0 mode: PR/PR res: [0x2b85d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4911 expref: 749 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.641561:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.641563:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d7285c52/0x3234de053c4aed1 lrc: 4/0,0 mode: PR/PR res: [0x2b860:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf72 expref: 749 pid: 80278 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.641563:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005fb3bcc7/0x3234de053c4e5ea lrc: 3/0,0 mode: PR/PR res: [0x2b85d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4911 expref: 749 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.641566:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d7285c52/0x3234de053c4aed1 lrc: 3/0,0 mode: PR/PR res: [0x2b860:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf72 expref: 749 pid: 80278 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.641569:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005fb3bcc7/0x3234de053c4e5ea lrc: 0/0,0 mode: --/PR res: [0x2b85d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4911 expref: 749 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.641572:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7285c52/0x3234de053c4aed1 lrc: 0/0,0 mode: --/PR res: [0x2b860:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf72 expref: 748 pid: 80278 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.641572:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.641573:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.641574:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000920e959f/0x3234de053c51c23 lrc: 3/0,1 mode: PW/PW res: [0x2b85d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.641576:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.641577:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.641577:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002fb0278b/0x3234de053c51c31 lrc: 3/0,1 mode: PW/PW res: [0x2b860:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641577:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000920e959f/0x3234de053c51c23 lrc: 4/0,1 mode: PW/PW res: [0x2b85d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.641580:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fb0278b/0x3234de053c51c31 lrc: 4/0,1 mode: PW/PW res: [0x2b860:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641586:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.641596:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.641606:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+747:41278:x1731746396369984:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 46us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.641608:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12604 00000100:00100000:1.0:1651529344.641618:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12605 00000100:00100000:1.0:1651529344.641620:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+746:41278:x1731746396370112:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.641623:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.641625:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000021012aa4/0x3234de053c4e947 lrc: 4/0,0 mode: PR/PR res: [0x2b861:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5685 expref: 746 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.641625:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000534d68d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+746:41278:x1731746396369856:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 69us (121us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.641629:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000021012aa4/0x3234de053c4e947 lrc: 3/0,0 mode: PR/PR res: [0x2b861:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5685 expref: 746 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.641629:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12603 00010000:00010000:1.0:1651529344.641633:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021012aa4/0x3234de053c4e947 lrc: 0/0,0 mode: --/PR res: [0x2b861:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5685 expref: 745 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.641637:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.641637:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.641638:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000329f2d10/0x3234de053c51c3f lrc: 3/0,1 mode: PW/PW res: [0x2b861:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.641639:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12606 00000100:00100000:0.0:1651529344.641640:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+744:41279:x1731746396370048:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.641641:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000329f2d10/0x3234de053c51c3f lrc: 4/0,1 mode: PW/PW res: [0x2b861:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641643:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.641645:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007c57055c/0x3234de053c4cfcb lrc: 4/0,0 mode: PR/PR res: [0x2b85f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf0c6 expref: 744 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.641650:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.641655:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+744:41278:x1731746396370112:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (133us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.641655:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007c57055c/0x3234de053c4cfcb lrc: 3/0,0 mode: PR/PR res: [0x2b85f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf0c6 expref: 744 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.641657:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12605 00010000:00010000:0.0:1651529344.641661:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c57055c/0x3234de053c4cfcb lrc: 0/0,0 mode: --/PR res: [0x2b85f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf0c6 expref: 743 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.641662:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12607 00000100:00100000:1.0:1651529344.641664:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+743:41279:x1731746396369920:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.641665:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.641665:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.641666:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.641666:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001f14837b/0x3234de053c51c38 lrc: 3/0,1 mode: PW/PW res: [0x2b85f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.641667:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eb247601/0x3234de053c4d796 lrc: 4/0,0 mode: PR/PR res: [0x2b85e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ff2 expref: 742 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.641669:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f14837b/0x3234de053c51c38 lrc: 4/0,1 mode: PW/PW res: [0x2b85f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.641671:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eb247601/0x3234de053c4d796 lrc: 3/0,0 mode: PR/PR res: [0x2b85e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ff2 expref: 742 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.641676:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb247601/0x3234de053c4d796 lrc: 0/0,0 mode: --/PR res: [0x2b85e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ff2 expref: 742 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.641679:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.641685:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+741:41279:x1731746396370048:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 44us (145us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.641686:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.641686:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.641687:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51c2a lrc: 3/0,1 mode: PW/PW res: [0x2b85e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.641688:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12606 00010000:00010000:1.0:1651529344.641690:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51c2a lrc: 4/0,1 mode: PW/PW res: [0x2b85e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641695:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002fb0278b/0x3234de053c51c31 lrc: 3/0,1 mode: PW/PW res: [0x2b860:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.641698:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.641704:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+740:41279:x1731746396369920:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 40us (171us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.641704:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fb0278b/0x3234de053c51c31 lrc: 3/0,1 mode: PW/PW res: [0x2b860:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.641706:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12607 00010000:00010000:0.0:1651529344.641707:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fb0278b/0x3234de053c51c31 lrc: 3/0,1 mode: PW/PW res: [0x2b860:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641710:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002fb0278b/0x3234de053c51c31 lrc: 2/0,0 mode: PW/PW res: [0x2b860:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.641714:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000920e959f/0x3234de053c51c23 lrc: 3/0,1 mode: PW/PW res: [0x2b85d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.641717:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000920e959f/0x3234de053c51c23 lrc: 3/0,1 mode: PW/PW res: [0x2b85d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.641720:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000920e959f/0x3234de053c51c23 lrc: 3/0,1 mode: PW/PW res: [0x2b85d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.641723:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000920e959f/0x3234de053c51c23 lrc: 2/0,0 mode: PW/PW res: [0x2b85d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.641766:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1322:39030:x1731745946488960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1055us (1094us total) trans 12885079876 rc 0/0 00000100:00100000:0.0:1651529344.641770:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211823 00000100:00100000:1.0:1651529344.641774:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1321:39029:x1731745946488704:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1250us (1361us total) trans 12885079877 rc 0/0 00000100:00100000:1.0:1651529344.641777:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211821 00010000:00010000:0.0:1651529344.641777:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000329f2d10/0x3234de053c51c3f lrc: 3/0,1 mode: PW/PW res: [0x2b861:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641781:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000329f2d10/0x3234de053c51c3f lrc: 3/0,1 mode: PW/PW res: [0x2b861:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.641784:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001f14837b/0x3234de053c51c38 lrc: 3/0,1 mode: PW/PW res: [0x2b85f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641784:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000329f2d10/0x3234de053c51c3f lrc: 3/0,1 mode: PW/PW res: [0x2b861:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641787:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000329f2d10/0x3234de053c51c3f lrc: 2/0,0 mode: PW/PW res: [0x2b861:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.641788:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f14837b/0x3234de053c51c38 lrc: 3/0,1 mode: PW/PW res: [0x2b85f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.641791:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f14837b/0x3234de053c51c38 lrc: 3/0,1 mode: PW/PW res: [0x2b85f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.641794:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f14837b/0x3234de053c51c38 lrc: 2/0,0 mode: PW/PW res: [0x2b85f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.641822:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055050f08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1322:39029:x1731745946489024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1047us (1134us total) trans 12885079878 rc 0/0 00000100:00100000:1.0:1651529344.641825:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1322:39029:x1731745946488896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1108us (1144us total) trans 12885079879 rc 0/0 00000100:00100000:0.0:1651529344.641825:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211825 00000100:00100000:1.0:1651529344.641828:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211824 00010000:00010000:0.0:1651529344.641832:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51c2a lrc: 3/0,1 mode: PW/PW res: [0x2b85e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641835:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51c2a lrc: 3/0,1 mode: PW/PW res: [0x2b85e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641838:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51c2a lrc: 3/0,1 mode: PW/PW res: [0x2b85e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641840:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51c2a lrc: 2/0,0 mode: PW/PW res: [0x2b85e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.641843:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.641868:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.641881:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.641884:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1321:39030:x1731745946488768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1333us (1460us total) trans 12885079880 rc 0/0 00000100:00100000:0.0:1651529344.641887:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211822 00000100:00100000:0.0:1651529344.641904:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946489600 00000100:00100000:0.0:1651529344.641914:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946489664 00000100:00100000:0.0:1651529344.641919:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211827 00000100:00100000:0.0:1651529344.641921:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1322:39030:x1731745946489600:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.641925:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178275 count 1 00010000:00010000:0.0:1651529344.641930:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51c4d lrc: 3/0,1 mode: --/PW res: [0x2b863:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641937:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000489c2195/0x3234de053c4e03a lrc: 2/0,0 mode: PR/PR res: [0x2b863:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d31fd expref: 739 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.641940:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.641941:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.641941:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51c4d lrc: 4/0,1 mode: --/PW res: [0x2b863:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641948:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000489c2195/0x3234de053c4e03a lrc: 3/0,0 mode: PR/PR res: [0x2b863:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d31fd expref: 739 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.641951:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000489c2195/0x3234de053c4e03a lrc: 4/0,0 mode: PR/PR res: [0x2b863:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d31fd expref: 739 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.641955:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014f8af45 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997023680:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.641964:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aac87b31 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.641969:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002fb0278b/0x3234de053c51c31 lrc: 2/0,0 mode: PW/PW res: [0x2b860:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.641972:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002fb0278b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.641973:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002fb0278b/0x3234de053c51c31 lrc: 2/0,0 mode: PW/PW res: [0x2b860:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.641989:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396370304 00010000:00010000:1.0:1651529344.641995:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c2613351/0x3234de053c4d8c3 lrc: 5/0,0 mode: PR/PR res: [0x2b862:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d13d4 expref: 740 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.641996:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002fb0278b/0x3234de053c51c31 lrc: 3/0,0 mode: PW/PW res: [0x2b860:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642001:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002fb0278b/0x3234de053c51c31 lrc: 1/0,0 mode: --/PW res: [0x2b860:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.642004:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12608 00010000:00010000:0.0:1651529344.642004:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fb0278b/0x3234de053c51c31 lrc: 0/0,0 mode: --/PW res: [0x2b860:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.642005:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+740:41278:x1731746396370304:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.642008:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.642009:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c2613351/0x3234de053c4d8c3 lrc: 5/0,0 mode: PR/PR res: [0x2b862:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d13d4 expref: 740 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.642009:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000920e959f/0x3234de053c51c23 lrc: 2/0,0 mode: PW/PW res: [0x2b85d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642012:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000920e959f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.642012:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000920e959f/0x3234de053c51c23 lrc: 2/0,0 mode: PW/PW res: [0x2b85d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642013:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c2613351/0x3234de053c4d8c3 lrc: 4/0,0 mode: PR/PR res: [0x2b862:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d13d4 expref: 740 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.642015:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000920e959f/0x3234de053c51c23 lrc: 3/0,0 mode: PW/PW res: [0x2b85d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642018:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000920e959f/0x3234de053c51c23 lrc: 1/0,0 mode: --/PW res: [0x2b85d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642019:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.642019:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.642020:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000516dff5d/0x3234de053c51c46 lrc: 3/0,1 mode: PW/PW res: [0x2b862:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642023:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000516dff5d/0x3234de053c51c46 lrc: 4/0,1 mode: PW/PW res: [0x2b862:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642028:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.642038:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000920e959f/0x3234de053c51c23 lrc: 0/0,0 mode: --/PW res: [0x2b85d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.642041:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+740:41278:x1731746396370304:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (160us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.642043:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000329f2d10/0x3234de053c51c3f lrc: 2/0,0 mode: PW/PW res: [0x2b861:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.642044:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12608 00010000:00010000:0.0:1651529344.642045:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000329f2d10 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.642046:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000329f2d10/0x3234de053c51c3f lrc: 2/0,0 mode: PW/PW res: [0x2b861:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642051:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000329f2d10/0x3234de053c51c3f lrc: 3/0,0 mode: PW/PW res: [0x2b861:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.642052:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211828 00000100:00100000:1.0:1651529344.642054:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1322:39029:x1731745946489664:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.642055:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000329f2d10/0x3234de053c51c3f lrc: 1/0,0 mode: --/PW res: [0x2b861:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642058:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000329f2d10/0x3234de053c51c3f lrc: 0/0,0 mode: --/PW res: [0x2b861:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.642059:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178276 count 1 00010000:00010000:0.0:1651529344.642061:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f14837b/0x3234de053c51c38 lrc: 2/0,0 mode: PW/PW res: [0x2b85f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642062:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086ec1398/0x3234de053c51c54 lrc: 3/0,1 mode: --/PW res: [0x2b864:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642064:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001f14837b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.642065:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f14837b/0x3234de053c51c38 lrc: 2/0,0 mode: PW/PW res: [0x2b85f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642067:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004cc3c45b/0x3234de053c4ca30 lrc: 2/0,0 mode: PR/PR res: [0x2b864:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda61 expref: 739 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.642067:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f14837b/0x3234de053c51c38 lrc: 3/0,0 mode: PW/PW res: [0x2b85f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642070:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.642070:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f14837b/0x3234de053c51c38 lrc: 1/0,0 mode: --/PW res: [0x2b85f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642071:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.642071:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086ec1398/0x3234de053c51c54 lrc: 4/0,1 mode: --/PW res: [0x2b864:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642073:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f14837b/0x3234de053c51c38 lrc: 0/0,0 mode: --/PW res: [0x2b85f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642076:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51c2a lrc: 2/0,0 mode: PW/PW res: [0x2b85e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642078:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004cc3c45b/0x3234de053c4ca30 lrc: 3/0,0 mode: PR/PR res: [0x2b864:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda61 expref: 739 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.642081:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004cc3c45b/0x3234de053c4ca30 lrc: 4/0,0 mode: PR/PR res: [0x2b864:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda61 expref: 739 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.642081:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000acc438d7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.642082:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51c2a lrc: 2/0,0 mode: PW/PW res: [0x2b85e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.642085:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006e255cae pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997023744:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.642085:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51c2a lrc: 3/0,0 mode: PW/PW res: [0x2b85e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642088:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51c2a lrc: 1/0,0 mode: --/PW res: [0x2b85e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642090:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000acc438d7/0x3234de053c51c2a lrc: 0/0,0 mode: --/PW res: [0x2b85e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.642093:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cfa1ca05 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.642107:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.642129:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.642138:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946489792 00000100:00100000:0.0:1651529344.642148:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946489920 00000100:00100000:0.0:1651529344.642155:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211829 00000100:00100000:0.0:1651529344.642156:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1324:39030:x1731745946489792:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.642161:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178277 count 1 00010000:00010000:0.0:1651529344.642165:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c51c5b lrc: 3/0,1 mode: --/PW res: [0x2b865:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642169:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000034b16874/0x3234de053c4db55 lrc: 2/0,0 mode: PR/PR res: [0x2b865:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d51 expref: 739 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.642172:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.642172:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.642172:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.642173:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c51c5b lrc: 4/0,1 mode: --/PW res: [0x2b865:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.642179:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946489856 00010000:00010000:0.0:1651529344.642180:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000034b16874/0x3234de053c4db55 lrc: 3/0,0 mode: PR/PR res: [0x2b865:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d51 expref: 739 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.642184:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000034b16874/0x3234de053c4db55 lrc: 4/0,0 mode: PR/PR res: [0x2b865:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d51 expref: 739 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.642186:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211830 00000100:00100000:1.0:1651529344.642188:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1325:39029:x1731745946489920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.642193:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178279 count 1 00010000:00010000:1.0:1651529344.642197:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c51c62 lrc: 3/0,1 mode: --/PW res: [0x2b867:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.642206:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000089d7f5d6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997023808:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.642209:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f852d1af/0x3234de053c4e2cc lrc: 2/0,0 mode: PR/PR res: [0x2b867:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c45 expref: 739 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.642214:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.642215:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.642216:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c51c62 lrc: 4/0,1 mode: --/PW res: [0x2b867:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642236:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f852d1af/0x3234de053c4e2cc lrc: 3/0,0 mode: PR/PR res: [0x2b867:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c45 expref: 739 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.642239:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f852d1af/0x3234de053c4e2cc lrc: 4/0,0 mode: PR/PR res: [0x2b867:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c45 expref: 739 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.642243:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bc420ca1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997023872:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.642244:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000000e7e66c4 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.642252:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f79d8146 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.642258:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211831 00000100:00100000:1.0:1651529344.642260:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1325:39029:x1731745946489856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.642264:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178278 count 1 00010000:00010000:0.0:1651529344.642265:0:106695:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2613351/0x3234de053c4d8c3 lrc: 0/0,0 mode: --/PR res: [0x2b862:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d13d4 expref: 739 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.642268:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c51c69 lrc: 3/0,1 mode: --/PW res: [0x2b866:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.642269:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002c4168d4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997023616:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.642272:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007fc02894/0x3234de053c4ee56 lrc: 2/0,0 mode: PR/PR res: [0x2b866:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b62 expref: 738 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.642273:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000516dff5d/0x3234de053c51c46 lrc: 3/0,1 mode: PW/PW res: [0x2b862:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642275:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.642276:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.642276:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000516dff5d/0x3234de053c51c46 lrc: 3/0,1 mode: PW/PW res: [0x2b862:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642277:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c51c69 lrc: 4/0,1 mode: --/PW res: [0x2b866:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642279:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000516dff5d/0x3234de053c51c46 lrc: 3/0,1 mode: PW/PW res: [0x2b862:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642285:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007fc02894/0x3234de053c4ee56 lrc: 3/0,0 mode: PR/PR res: [0x2b866:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b62 expref: 738 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.642289:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007fc02894/0x3234de053c4ee56 lrc: 4/0,0 mode: PR/PR res: [0x2b866:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b62 expref: 738 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.642292:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c9f4ec84 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997023936:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.642293:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000516dff5d/0x3234de053c51c46 lrc: 3/0,1 mode: PW/PW res: [0x2b862:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.642298:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000412e5d26 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.642298:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000516dff5d/0x3234de053c51c46 lrc: 2/0,0 mode: PW/PW res: [0x2b862:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.642331:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.642354:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1326:39030:x1731745946489344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1046us (1164us total) trans 12885079881 rc 0/0 00000100:00100000:0.0:1651529344.642357:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211826 00000100:00100000:0.0:1651529344.642362:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946490048 00000100:00100000:0.0:1651529344.642379:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211832 00000100:00100000:1.0:1651529344.642381:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.642381:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1326:39030:x1731745946490048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.642385:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178280 count 1 00010000:00010000:0.0:1651529344.642390:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51c70 lrc: 3/0,1 mode: --/PW res: [0x2b868:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642394:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000555e0b1c/0x3234de053c4bd5d lrc: 2/0,0 mode: PR/PR res: [0x2b868:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc633 expref: 738 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.642397:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.642398:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.642399:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51c70 lrc: 4/0,1 mode: --/PW res: [0x2b868:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.642409:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.642418:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000555e0b1c/0x3234de053c4bd5d lrc: 3/0,0 mode: PR/PR res: [0x2b868:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc633 expref: 738 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.642422:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000555e0b1c/0x3234de053c4bd5d lrc: 4/0,0 mode: PR/PR res: [0x2b868:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc633 expref: 738 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.642429:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002c4168d4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997024000:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.642439:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000009370c1d going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.642445:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946490112 00000100:00100000:0.0:1651529344.642452:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211833 00000100:00100000:0.0:1651529344.642454:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1327:39029:x1731745946490112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.642458:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178281 count 1 00010000:00010000:0.0:1651529344.642462:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51c77 lrc: 3/0,1 mode: --/PW res: [0x2b869:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.642465:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.642466:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c725e83b/0x3234de053c4d0dc lrc: 2/0,0 mode: PR/PR res: [0x2b869:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf4f5 expref: 738 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.642469:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.642470:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.642470:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51c77 lrc: 4/0,1 mode: --/PW res: [0x2b869:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.642475:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396370816 00010000:00010000:0.0:1651529344.642477:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c725e83b/0x3234de053c4d0dc lrc: 3/0,0 mode: PR/PR res: [0x2b869:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf4f5 expref: 739 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.642480:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000489c2195/0x3234de053c4e03a lrc: 5/0,0 mode: PR/PR res: [0x2b863:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d31fd expref: 739 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.642480:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c725e83b/0x3234de053c4d0dc lrc: 4/0,0 mode: PR/PR res: [0x2b869:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf4f5 expref: 739 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.642484:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000078f9a278 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997024064:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.642487:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396370880 00010000:00010000:1.0:1651529344.642489:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004cc3c45b/0x3234de053c4ca30 lrc: 5/0,0 mode: PR/PR res: [0x2b864:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda61 expref: 740 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.642499:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12609 00000100:00100000:1.0:1651529344.642506:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+740:41279:x1731746396370816:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.642509:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.642511:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000489c2195/0x3234de053c4e03a lrc: 5/0,0 mode: PR/PR res: [0x2b863:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d31fd expref: 740 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.642517:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000489c2195/0x3234de053c4e03a lrc: 4/0,0 mode: PR/PR res: [0x2b863:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d31fd expref: 740 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.642523:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.642524:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.642524:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51c4d lrc: 3/0,1 mode: PW/PW res: [0x2b863:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642527:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51c4d lrc: 4/0,1 mode: PW/PW res: [0x2b863:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.642530:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 0000000029ae2bb2 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.642532:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.642537:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000516dff5d/0x3234de053c51c46 lrc: 2/0,0 mode: PW/PW res: [0x2b862:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.642539:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+740:41279:x1731746396370816:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (129us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.642540:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000516dff5d already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.642541:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12609 00010000:00010000:0.0:1651529344.642541:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000516dff5d/0x3234de053c51c46 lrc: 2/0,0 mode: PW/PW res: [0x2b862:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642544:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000516dff5d/0x3234de053c51c46 lrc: 3/0,0 mode: PW/PW res: [0x2b862:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.642546:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12610 00000100:00100000:1.0:1651529344.642547:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c680c11 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+739:41279:x1731746396370880:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.642549:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.642549:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000516dff5d/0x3234de053c51c46 lrc: 1/0,0 mode: --/PW res: [0x2b862:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642551:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004cc3c45b/0x3234de053c4ca30 lrc: 5/0,0 mode: PR/PR res: [0x2b864:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda61 expref: 739 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.642552:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000516dff5d/0x3234de053c51c46 lrc: 0/0,0 mode: --/PW res: [0x2b862:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642554:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004cc3c45b/0x3234de053c4ca30 lrc: 4/0,0 mode: PR/PR res: [0x2b864:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda61 expref: 739 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.642558:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.642559:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.642560:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000086ec1398/0x3234de053c51c54 lrc: 3/0,1 mode: PW/PW res: [0x2b864:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642563:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086ec1398/0x3234de053c51c54 lrc: 4/0,1 mode: PW/PW res: [0x2b864:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642567:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.642570:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c680c11 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+739:41279:x1731746396370880:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 22us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.642572:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12610 00010000:00010000:0.0:1651529344.642573:0:156655:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000489c2195/0x3234de053c4e03a lrc: 0/0,0 mode: --/PR res: [0x2b863:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d31fd expref: 739 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.642577:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014f8af45 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997023680:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.642581:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51c4d lrc: 3/0,1 mode: PW/PW res: [0x2b863:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642584:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51c4d lrc: 3/0,1 mode: PW/PW res: [0x2b863:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642585:0:80278:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cc3c45b/0x3234de053c4ca30 lrc: 0/0,0 mode: --/PR res: [0x2b864:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda61 expref: 737 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.642587:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51c4d lrc: 3/0,1 mode: PW/PW res: [0x2b863:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.642589:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006e255cae pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997023744:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.642592:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000086ec1398/0x3234de053c51c54 lrc: 3/0,1 mode: PW/PW res: [0x2b864:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642592:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51c4d lrc: 3/0,1 mode: PW/PW res: [0x2b863:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642595:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000086ec1398/0x3234de053c51c54 lrc: 3/0,1 mode: PW/PW res: [0x2b864:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642595:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51c4d lrc: 2/0,0 mode: PW/PW res: [0x2b863:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642598:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086ec1398/0x3234de053c51c54 lrc: 3/0,1 mode: PW/PW res: [0x2b864:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642601:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086ec1398/0x3234de053c51c54 lrc: 3/0,1 mode: PW/PW res: [0x2b864:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642604:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000086ec1398/0x3234de053c51c54 lrc: 2/0,0 mode: PW/PW res: [0x2b864:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.642640:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1329:39030:x1731745946489600:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 719us (797us total) trans 12885079882 rc 0/0 00000100:00100000:0.0:1651529344.642643:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211827 00000100:00100000:1.0:1651529344.642651:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1328:39029:x1731745946489664:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 596us (783us total) trans 12885079883 rc 0/0 00010000:00010000:0.0:1651529344.642651:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51c4d lrc: 2/0,0 mode: PW/PW res: [0x2b863:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.642654:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211828 00010000:00010000:0.0:1651529344.642654:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d5eeb0cd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.642655:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51c4d lrc: 2/0,0 mode: PW/PW res: [0x2b863:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642658:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51c4d lrc: 3/0,0 mode: PW/PW res: [0x2b863:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642662:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51c4d lrc: 1/0,0 mode: --/PW res: [0x2b863:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642665:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5eeb0cd/0x3234de053c51c4d lrc: 0/0,0 mode: --/PW res: [0x2b863:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642669:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000086ec1398/0x3234de053c51c54 lrc: 2/0,0 mode: PW/PW res: [0x2b864:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.642671:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.642687:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000086ec1398 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.642688:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000086ec1398/0x3234de053c51c54 lrc: 2/0,0 mode: PW/PW res: [0x2b864:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642691:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000086ec1398/0x3234de053c51c54 lrc: 3/0,0 mode: PW/PW res: [0x2b864:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642708:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000086ec1398/0x3234de053c51c54 lrc: 1/0,0 mode: --/PW res: [0x2b864:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642711:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086ec1398/0x3234de053c51c54 lrc: 0/0,0 mode: --/PW res: [0x2b864:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.642722:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000089d7f5d6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997023808:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.642725:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c51c5b lrc: 3/0,1 mode: --/PW res: [0x2b865:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.642760:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946490176 00000100:00100000:0.0:1651529344.642766:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.642775:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211834 00000100:00100000:1.0:1651529344.642777:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1328:39029:x1731745946490176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.642779:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:1.0:1651529344.642787:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178282 count 1 00000100:00100000:0.0:1651529344.642788:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.642796:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c51c7e lrc: 3/0,1 mode: --/PW res: [0x2b86a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.642797:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.642801:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a1db1946/0x3234de053c4f293 lrc: 2/0,0 mode: PR/PR res: [0x2b86a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d4b expref: 736 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.642804:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.642805:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.642805:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002c4168d4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997024000:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.642806:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c51c7e lrc: 4/0,1 mode: --/PW res: [0x2b86a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642809:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51c70 lrc: 3/0,1 mode: --/PW res: [0x2b868:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642813:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a1db1946/0x3234de053c4f293 lrc: 3/0,0 mode: PR/PR res: [0x2b86a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d4b expref: 736 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.642816:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a1db1946/0x3234de053c4f293 lrc: 4/0,0 mode: PR/PR res: [0x2b86a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d4b expref: 736 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.642818:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396370944 00000100:00100000:1.0:1651529344.642820:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003de40890 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997024128:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.642823:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000034b16874/0x3234de053c4db55 lrc: 4/0,0 mode: PR/PR res: [0x2b865:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d51 expref: 737 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.642828:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396371072 00000100:00100000:1.0:1651529344.642829:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.642831:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007fc02894/0x3234de053c4ee56 lrc: 5/0,0 mode: PR/PR res: [0x2b866:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b62 expref: 738 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.642835:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396371008 00000100:00100000:1.0:1651529344.642836:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bc420ca1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997023872:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.642838:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f852d1af/0x3234de053c4e2cc lrc: 4/0,0 mode: PR/PR res: [0x2b867:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c45 expref: 739 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.642840:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c51c62 lrc: 3/0,1 mode: --/PW res: [0x2b867:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.642842:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396371136 00010000:00010000:0.0:1651529344.642843:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000555e0b1c/0x3234de053c4bd5d lrc: 4/0,0 mode: PR/PR res: [0x2b868:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc633 expref: 740 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.642847:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c9f4ec84 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997023936:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.642848:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12611 00010000:00010000:1.0:1651529344.642849:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c51c69 lrc: 3/0,1 mode: --/PW res: [0x2b866:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.642849:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+740:41279:x1731746396370944:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.642852:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.642853:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000034b16874/0x3234de053c4db55 lrc: 4/0,0 mode: PR/PR res: [0x2b865:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d51 expref: 740 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.642855:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12612 00000100:00100000:1.0:1651529344.642857:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+740:41279:x1731746396371072:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.642857:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000034b16874/0x3234de053c4db55 lrc: 3/0,0 mode: PR/PR res: [0x2b865:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d51 expref: 740 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.642860:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.642861:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007fc02894/0x3234de053c4ee56 lrc: 4/0,0 mode: PR/PR res: [0x2b866:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b62 expref: 740 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.642862:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034b16874/0x3234de053c4db55 lrc: 0/0,0 mode: --/PR res: [0x2b865:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d51 expref: 740 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.642865:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007fc02894/0x3234de053c4ee56 lrc: 3/0,0 mode: PR/PR res: [0x2b866:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b62 expref: 740 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.642870:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fc02894/0x3234de053c4ee56 lrc: 0/0,0 mode: --/PR res: [0x2b866:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b62 expref: 740 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.642874:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.642874:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.642875:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c51c69 lrc: 3/0,1 mode: PW/PW res: [0x2b866:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642880:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c51c69 lrc: 4/0,1 mode: PW/PW res: [0x2b866:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642884:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.642885:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.642886:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.642886:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c51c5b lrc: 3/0,1 mode: PW/PW res: [0x2b865:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642890:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c51c5b lrc: 4/0,1 mode: PW/PW res: [0x2b865:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.642892:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+738:41279:x1731746396371072:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.642894:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12612 00010000:00010000:0.0:1651529344.642896:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.642899:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12613 00000100:00100000:1.0:1651529344.642901:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+737:41279:x1731746396371008:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.642903:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.642904:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f852d1af/0x3234de053c4e2cc lrc: 4/0,0 mode: PR/PR res: [0x2b867:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c45 expref: 737 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.642904:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+737:41279:x1731746396370944:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 53us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.642906:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12611 00010000:00010000:1.0:1651529344.642908:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f852d1af/0x3234de053c4e2cc lrc: 3/0,0 mode: PR/PR res: [0x2b867:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c45 expref: 737 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.642912:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12614 00010000:00010000:1.0:1651529344.642913:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f852d1af/0x3234de053c4e2cc lrc: 0/0,0 mode: --/PR res: [0x2b867:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3c45 expref: 736 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.642914:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+736:41279:x1731746396371136:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.642916:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.642916:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.642916:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.642917:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c51c62 lrc: 3/0,1 mode: PW/PW res: [0x2b867:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642918:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000555e0b1c/0x3234de053c4bd5d lrc: 4/0,0 mode: PR/PR res: [0x2b868:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc633 expref: 735 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.642920:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c51c62 lrc: 4/0,1 mode: PW/PW res: [0x2b867:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642922:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000555e0b1c/0x3234de053c4bd5d lrc: 3/0,0 mode: PR/PR res: [0x2b868:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc633 expref: 735 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.642927:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000555e0b1c/0x3234de053c4bd5d lrc: 0/0,0 mode: --/PR res: [0x2b868:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc633 expref: 735 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.642928:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.642930:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.642931:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.642932:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51c70 lrc: 3/0,1 mode: PW/PW res: [0x2b868:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.642933:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+734:41279:x1731746396371008:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 31us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.642935:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12613 00010000:00010000:0.0:1651529344.642935:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51c70 lrc: 4/0,1 mode: PW/PW res: [0x2b868:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642940:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.642942:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c51c69 lrc: 3/0,1 mode: PW/PW res: [0x2b866:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.642945:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c51c69 lrc: 3/0,1 mode: PW/PW res: [0x2b866:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.642945:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+733:41279:x1731746396371136:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 31us (148us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.642948:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c51c69 lrc: 3/0,1 mode: PW/PW res: [0x2b866:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.642948:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12614 00010000:00010000:1.0:1651529344.642950:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c51c69 lrc: 2/0,0 mode: PW/PW res: [0x2b866:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642953:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c51c5b lrc: 3/0,1 mode: PW/PW res: [0x2b865:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642956:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c51c5b lrc: 3/0,1 mode: PW/PW res: [0x2b865:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642967:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c51c5b lrc: 3/0,1 mode: PW/PW res: [0x2b865:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.642970:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c51c5b lrc: 2/0,0 mode: PW/PW res: [0x2b865:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.642993:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1330:39029:x1731745946489856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 732us (821us total) trans 12885079884 rc 0/0 00000100:00100000:1.0:1651529344.642996:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211831 00010000:00010000:1.0:1651529344.643003:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c51c62 lrc: 3/0,1 mode: PW/PW res: [0x2b867:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.643006:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c51c62 lrc: 3/0,1 mode: PW/PW res: [0x2b867:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.643008:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1329:39030:x1731745946489792:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 850us (900us total) trans 12885079885 rc 0/0 00010000:00010000:1.0:1651529344.643009:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c51c62 lrc: 3/0,1 mode: PW/PW res: [0x2b867:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.643010:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211829 00010000:00010000:1.0:1651529344.643012:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c51c62 lrc: 2/0,0 mode: PW/PW res: [0x2b867:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643028:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c51c69 lrc: 2/0,0 mode: PW/PW res: [0x2b866:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643034:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003c571c06 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.643035:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c51c69 lrc: 2/0,0 mode: PW/PW res: [0x2b866:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643038:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c51c69 lrc: 3/0,0 mode: PW/PW res: [0x2b866:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643042:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c51c69 lrc: 1/0,0 mode: --/PW res: [0x2b866:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643045:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c51c69 lrc: 0/0,0 mode: --/PW res: [0x2b866:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.643049:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1329:39029:x1731745946489920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 860us (928us total) trans 12885079886 rc 0/0 00010000:00010000:0.0:1651529344.643049:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c51c5b lrc: 2/0,0 mode: PW/PW res: [0x2b865:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.643051:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211830 00010000:00010000:0.0:1651529344.643052:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004f275b98 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.643053:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c51c5b lrc: 2/0,0 mode: PW/PW res: [0x2b865:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643055:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c51c5b lrc: 3/0,0 mode: PW/PW res: [0x2b865:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643059:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c51c5b lrc: 1/0,0 mode: --/PW res: [0x2b865:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643061:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f275b98/0x3234de053c51c5b lrc: 0/0,0 mode: --/PW res: [0x2b865:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643065:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c51c62 lrc: 2/0,0 mode: PW/PW res: [0x2b867:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643067:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ef6f99f3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.643068:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c51c62 lrc: 2/0,0 mode: PW/PW res: [0x2b867:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643071:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c51c62 lrc: 3/0,0 mode: PW/PW res: [0x2b867:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643074:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c51c62 lrc: 1/0,0 mode: --/PW res: [0x2b867:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643076:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c51c62 lrc: 0/0,0 mode: --/PW res: [0x2b867:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643083:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51c70 lrc: 3/0,1 mode: PW/PW res: [0x2b868:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643085:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51c70 lrc: 3/0,1 mode: PW/PW res: [0x2b868:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643088:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51c70 lrc: 3/0,1 mode: PW/PW res: [0x2b868:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.643089:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.643091:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51c70 lrc: 2/0,0 mode: PW/PW res: [0x2b868:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.643102:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.643132:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1329:39030:x1731745946490048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 751us (801us total) trans 12885079887 rc 0/0 00000100:00100000:0.0:1651529344.643135:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211832 00000100:00100000:0.0:1651529344.643140:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946490496 00000100:00100000:0.0:1651529344.643150:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946490432 00000100:00100000:0.0:1651529344.643155:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211835 00000100:00100000:0.0:1651529344.643157:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1330:39030:x1731745946490496:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.643162:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178284 count 1 00010000:00010000:0.0:1651529344.643166:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c51c85 lrc: 3/0,1 mode: --/PW res: [0x2b86c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643170:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003d983b2a/0x3234de053c4d3ad lrc: 2/0,0 mode: PR/PR res: [0x2b86c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00be expref: 732 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.643173:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.643174:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.643175:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c51c85 lrc: 4/0,1 mode: --/PW res: [0x2b86c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643181:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003d983b2a/0x3234de053c4d3ad lrc: 3/0,0 mode: PR/PR res: [0x2b86c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00be expref: 732 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.643185:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003d983b2a/0x3234de053c4d3ad lrc: 4/0,0 mode: PR/PR res: [0x2b86c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00be expref: 732 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.643188:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211836 00000100:00100000:1.0:1651529344.643190:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1330:39029:x1731745946490432:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.643200:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178283 count 1 00010000:00010000:1.0:1651529344.643204:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c51c8c lrc: 3/0,1 mode: --/PW res: [0x2b86b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.643213:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002c4168d4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997024192:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.643215:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e2eead3f/0x3234de053c4a443 lrc: 2/0,0 mode: PR/PR res: [0x2b86b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba86 expref: 732 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.643218:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.643219:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.643219:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c51c8c lrc: 4/0,1 mode: --/PW res: [0x2b86b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.643238:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aac87b31 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.643240:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e2eead3f/0x3234de053c4a443 lrc: 3/0,0 mode: PR/PR res: [0x2b86b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba86 expref: 732 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.643243:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51c70 lrc: 2/0,0 mode: PW/PW res: [0x2b868:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.643244:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e2eead3f/0x3234de053c4a443 lrc: 4/0,0 mode: PR/PR res: [0x2b86b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba86 expref: 732 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.643246:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000040cd657 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.643247:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51c70 lrc: 2/0,0 mode: PW/PW res: [0x2b868:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.643248:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ac8dec6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997024256:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.643250:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51c70 lrc: 3/0,0 mode: PW/PW res: [0x2b868:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643254:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51c70 lrc: 1/0,0 mode: --/PW res: [0x2b868:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.643257:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 000000004ca54b8a going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.643257:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000040cd657/0x3234de053c51c70 lrc: 0/0,0 mode: --/PW res: [0x2b868:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.643320:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.643339:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.643355:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.643362:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.643378:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946490816 00000100:00100000:0.0:1651529344.643381:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.643387:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946490880 00000100:00100000:1.0:1651529344.643392:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946490944 00000100:00100000:1.0:1651529344.643395:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946491008 00000100:00100000:1.0:1651529344.643404:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211837 00000100:00100000:1.0:1651529344.643406:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1334:39029:x1731745946490816:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.643407:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211838 00000100:00100000:0.0:1651529344.643409:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1334:39030:x1731745946490880:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.643411:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178285 count 1 00002000:00080000:0.0:1651529344.643415:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178286 count 1 00010000:00010000:1.0:1651529344.643416:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3ae24c2/0x3234de053c51c93 lrc: 3/0,1 mode: --/PW res: [0x2b86d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643419:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51c9a lrc: 3/0,1 mode: --/PW res: [0x2b86e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.643420:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000638ae58b/0x3234de053c4d122 lrc: 2/0,0 mode: PR/PR res: [0x2b86d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf630 expref: 732 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.643423:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.643424:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.643424:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e2f1d657/0x3234de053c4a00d lrc: 2/0,0 mode: PR/PR res: [0x2b86e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5e0 expref: 732 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.643425:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3ae24c2/0x3234de053c51c93 lrc: 4/0,1 mode: --/PW res: [0x2b86d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643427:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.643428:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.643428:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51c9a lrc: 4/0,1 mode: --/PW res: [0x2b86e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.643431:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000638ae58b/0x3234de053c4d122 lrc: 3/0,0 mode: PR/PR res: [0x2b86d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf630 expref: 732 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.643435:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e2f1d657/0x3234de053c4a00d lrc: 3/0,0 mode: PR/PR res: [0x2b86e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5e0 expref: 732 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.643437:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000638ae58b/0x3234de053c4d122 lrc: 4/0,0 mode: PR/PR res: [0x2b86d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf630 expref: 732 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.643439:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e2f1d657/0x3234de053c4a00d lrc: 4/0,0 mode: PR/PR res: [0x2b86e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5e0 expref: 732 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.643441:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ebb53b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997024320:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.643443:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000053ee5af1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997024384:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.643452:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 0000000057299e7f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.643452:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 0000000009370c1d going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.643458:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211839 00000100:00100000:1.0:1651529344.643459:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1334:39029:x1731745946490944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.643460:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211840 00000100:00100000:0.0:1651529344.643462:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1334:39030:x1731745946491008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.643463:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178287 count 1 00010000:00010000:1.0:1651529344.643466:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7a2d4e3/0x3234de053c51ca1 lrc: 3/0,1 mode: --/PW res: [0x2b86f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.643466:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178288 count 1 00010000:00010000:0.0:1651529344.643469:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c51ca8 lrc: 3/0,1 mode: --/PW res: [0x2b870:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.643470:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005267a56c/0x3234de053c4ebe0 lrc: 2/0,0 mode: PR/PR res: [0x2b86f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6105 expref: 732 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.643473:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.643473:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006f053e48/0x3234de053c4e6bc lrc: 2/0,0 mode: PR/PR res: [0x2b870:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b80 expref: 732 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.643474:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.643475:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7a2d4e3/0x3234de053c51ca1 lrc: 4/0,1 mode: --/PW res: [0x2b86f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643476:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.643477:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.643477:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c51ca8 lrc: 4/0,1 mode: --/PW res: [0x2b870:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.643480:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005267a56c/0x3234de053c4ebe0 lrc: 3/0,0 mode: PR/PR res: [0x2b86f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6105 expref: 732 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.643483:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006f053e48/0x3234de053c4e6bc lrc: 3/0,0 mode: PR/PR res: [0x2b870:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b80 expref: 732 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.643484:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005267a56c/0x3234de053c4ebe0 lrc: 4/0,0 mode: PR/PR res: [0x2b86f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6105 expref: 732 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.643489:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006f053e48/0x3234de053c4e6bc lrc: 4/0,0 mode: PR/PR res: [0x2b870:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b80 expref: 732 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.643490:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c9f4ec84 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997024448:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.643493:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ea0220b6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997024512:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.643497:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b7af823 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.643506:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003de40890 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997024128:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.643509:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c51c7e lrc: 3/0,1 mode: --/PW res: [0x2b86a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.643516:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c2b2b59c going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.643524:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000078f9a278 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997024064:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.643528:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51c77 lrc: 3/0,1 mode: --/PW res: [0x2b869:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.643564:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.643572:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396371456 00010000:00010000:1.0:1651529344.643577:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c725e83b/0x3234de053c4d0dc lrc: 4/0,0 mode: PR/PR res: [0x2b869:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf4f5 expref: 733 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.643590:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002c4168d4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997024192:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.643594:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c51c85 lrc: 3/0,1 mode: --/PW res: [0x2b86c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.643596:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396371520 00010000:00010000:1.0:1651529344.643599:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a1db1946/0x3234de053c4f293 lrc: 4/0,0 mode: PR/PR res: [0x2b86a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d4b expref: 734 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.643602:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12615 00000100:00100000:0.0:1651529344.643604:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+734:41279:x1731746396371456:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.643606:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12616 00010000:00010000:0.0:1651529344.643607:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.643608:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+734:41279:x1731746396371520:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.643609:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c725e83b/0x3234de053c4d0dc lrc: 4/0,0 mode: PR/PR res: [0x2b869:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf4f5 expref: 734 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.643611:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.643612:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a1db1946/0x3234de053c4f293 lrc: 4/0,0 mode: PR/PR res: [0x2b86a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d4b expref: 734 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.643613:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c725e83b/0x3234de053c4d0dc lrc: 3/0,0 mode: PR/PR res: [0x2b869:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf4f5 expref: 734 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.643616:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a1db1946/0x3234de053c4f293 lrc: 3/0,0 mode: PR/PR res: [0x2b86a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d4b expref: 734 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.643619:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c725e83b/0x3234de053c4d0dc lrc: 0/0,0 mode: --/PR res: [0x2b869:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf4f5 expref: 734 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.643624:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1db1946/0x3234de053c4f293 lrc: 0/0,0 mode: --/PR res: [0x2b86a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d4b expref: 734 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.643628:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.643628:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.643629:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c51c7e lrc: 3/0,1 mode: PW/PW res: [0x2b86a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.643632:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c51c7e lrc: 4/0,1 mode: PW/PW res: [0x2b86a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.643638:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.643641:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.643641:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.643642:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51c77 lrc: 3/0,1 mode: PW/PW res: [0x2b869:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643645:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51c77 lrc: 4/0,1 mode: PW/PW res: [0x2b869:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.643650:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+732:41279:x1731746396371520:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.643653:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12616 00010000:00010000:0.0:1651529344.643657:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.643661:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c51c7e lrc: 3/0,1 mode: PW/PW res: [0x2b86a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.643664:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c51c7e lrc: 3/0,1 mode: PW/PW res: [0x2b86a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.643665:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+731:41279:x1731746396371456:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 60us (294us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.643667:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c51c7e lrc: 3/0,1 mode: PW/PW res: [0x2b86a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.643668:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12615 00010000:00010000:1.0:1651529344.643670:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c51c7e lrc: 2/0,0 mode: PW/PW res: [0x2b86a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643676:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51c77 lrc: 3/0,1 mode: PW/PW res: [0x2b869:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643685:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51c77 lrc: 3/0,1 mode: PW/PW res: [0x2b869:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643688:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51c77 lrc: 3/0,1 mode: PW/PW res: [0x2b869:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643691:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51c77 lrc: 2/0,0 mode: PW/PW res: [0x2b869:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.643713:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1336:39029:x1731745946490176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 935us (1042us total) trans 12885079888 rc 0/0 00000100:00100000:1.0:1651529344.643716:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211834 00000100:00100000:0.0:1651529344.643730:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1335:39029:x1731745946490112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1275us (1354us total) trans 12885079889 rc 0/0 00000100:00100000:1.0:1651529344.643732:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.643733:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211833 00010000:00010000:0.0:1651529344.643757:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c51c7e lrc: 2/0,0 mode: PW/PW res: [0x2b86a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643760:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a520645e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.643762:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c51c7e lrc: 2/0,0 mode: PW/PW res: [0x2b86a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643764:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c51c7e lrc: 3/0,0 mode: PW/PW res: [0x2b86a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643769:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c51c7e lrc: 1/0,0 mode: --/PW res: [0x2b86a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643772:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c51c7e lrc: 0/0,0 mode: --/PW res: [0x2b86a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643777:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51c77 lrc: 2/0,0 mode: PW/PW res: [0x2b869:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643779:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c8d9712a already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.643780:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.643780:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51c77 lrc: 2/0,0 mode: PW/PW res: [0x2b869:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643783:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51c77 lrc: 3/0,0 mode: PW/PW res: [0x2b869:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643786:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51c77 lrc: 1/0,0 mode: --/PW res: [0x2b869:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643791:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8d9712a/0x3234de053c51c77 lrc: 0/0,0 mode: --/PW res: [0x2b869:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.643800:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396371584 00010000:00010000:0.0:1651529344.643805:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003d983b2a/0x3234de053c4d3ad lrc: 4/0,0 mode: PR/PR res: [0x2b86c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00be expref: 731 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.643821:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396371648 00010000:00010000:0.0:1651529344.643824:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e2eead3f/0x3234de053c4a443 lrc: 5/0,0 mode: PR/PR res: [0x2b86b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba86 expref: 732 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.643832:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12617 00000100:00100000:0.0:1651529344.643833:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009f0728c5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+732:41279:x1731746396371584:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.643837:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.643838:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003d983b2a/0x3234de053c4d3ad lrc: 4/0,0 mode: PR/PR res: [0x2b86c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00be expref: 732 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.643842:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003d983b2a/0x3234de053c4d3ad lrc: 3/0,0 mode: PR/PR res: [0x2b86c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00be expref: 732 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.643846:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d983b2a/0x3234de053c4d3ad lrc: 0/0,0 mode: --/PR res: [0x2b86c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00be expref: 732 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.643847:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ac8dec6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997024256:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.643850:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.643850:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.643851:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c51c85 lrc: 3/0,1 mode: PW/PW res: [0x2b86c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.643852:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c51c8c lrc: 3/0,1 mode: --/PW res: [0x2b86b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643855:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c51c85 lrc: 4/0,1 mode: PW/PW res: [0x2b86c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.643859:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12618 00000100:00100000:1.0:1651529344.643861:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+731:41279:x1731746396371648:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.643861:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.643865:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.643866:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e2eead3f/0x3234de053c4a443 lrc: 4/0,0 mode: PR/PR res: [0x2b86b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba86 expref: 731 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.643872:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009f0728c5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+731:41279:x1731746396371584:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 38us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.643874:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12617 00010000:00010000:1.0:1651529344.643876:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e2eead3f/0x3234de053c4a443 lrc: 3/0,0 mode: PR/PR res: [0x2b86b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba86 expref: 731 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.643882:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2eead3f/0x3234de053c4a443 lrc: 0/0,0 mode: --/PR res: [0x2b86b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba86 expref: 730 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.643885:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.643885:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c51c85 lrc: 3/0,1 mode: PW/PW res: [0x2b86c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.643886:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.643887:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c51c8c lrc: 3/0,1 mode: PW/PW res: [0x2b86b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643889:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c51c85 lrc: 3/0,1 mode: PW/PW res: [0x2b86c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.643892:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c51c8c lrc: 4/0,1 mode: PW/PW res: [0x2b86b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643892:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c51c85 lrc: 3/0,1 mode: PW/PW res: [0x2b86c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643894:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c51c85 lrc: 2/0,0 mode: PW/PW res: [0x2b86c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.643898:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.643905:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+729:41279:x1731746396371648:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 44us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.643908:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12618 00010000:00010000:1.0:1651529344.643915:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c51c8c lrc: 3/0,1 mode: PW/PW res: [0x2b86b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.643919:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c51c8c lrc: 3/0,1 mode: PW/PW res: [0x2b86b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.643922:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c51c8c lrc: 3/0,1 mode: PW/PW res: [0x2b86b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.643924:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c51c8c lrc: 2/0,0 mode: PW/PW res: [0x2b86b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.643938:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1335:39030:x1731745946490496:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 773us (841us total) trans 12885079890 rc 0/0 00000100:00100000:0.0:1651529344.643941:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211835 00010000:00010000:0.0:1651529344.643947:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c51c85 lrc: 2/0,0 mode: PW/PW res: [0x2b86c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643951:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000065c40e6a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.643952:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c51c85 lrc: 2/0,0 mode: PW/PW res: [0x2b86c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643955:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c51c85 lrc: 3/0,0 mode: PW/PW res: [0x2b86c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643959:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c51c85 lrc: 1/0,0 mode: --/PW res: [0x2b86c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643962:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065c40e6a/0x3234de053c51c85 lrc: 0/0,0 mode: --/PW res: [0x2b86c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643966:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c51c8c lrc: 2/0,0 mode: PW/PW res: [0x2b86b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.643967:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1335:39029:x1731745946490432:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 776us (864us total) trans 12885079891 rc 0/0 00000100:00100000:1.0:1651529344.643969:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211836 00010000:00010000:0.0:1651529344.643969:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008288bff7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.643970:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c51c8c lrc: 2/0,0 mode: PW/PW res: [0x2b86b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643972:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c51c8c lrc: 3/0,0 mode: PW/PW res: [0x2b86b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643975:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c51c8c lrc: 1/0,0 mode: --/PW res: [0x2b86b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.643978:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c51c8c lrc: 0/0,0 mode: --/PW res: [0x2b86b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.644051:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.644059:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.644072:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ebb53b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997024320:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.644076:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a3ae24c2/0x3234de053c51c93 lrc: 3/0,1 mode: --/PW res: [0x2b86d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.644077:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.644097:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c9f4ec84 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997024448:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.644099:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.644100:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e7a2d4e3/0x3234de053c51ca1 lrc: 3/0,1 mode: --/PW res: [0x2b86f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.644109:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.644111:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946491328 00000100:00100000:0.0:1651529344.644117:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.644124:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946491392 00000100:00100000:1.0:1651529344.644129:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211841 00000100:00100000:1.0:1651529344.644130:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1336:39029:x1731745946491328:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.644134:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000053ee5af1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997024384:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.644135:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178289 count 1 00010000:00010000:0.0:1651529344.644138:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51c9a lrc: 3/0,1 mode: --/PW res: [0x2b86e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644140:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099354594/0x3234de053c51caf lrc: 3/0,1 mode: --/PW res: [0x2b871:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644144:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002d8afcd4/0x3234de053c4d5cf lrc: 2/0,0 mode: PR/PR res: [0x2b871:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d08b3 expref: 728 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.644145:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ea0220b6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997024512:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.644147:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.644148:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.644148:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099354594/0x3234de053c51caf lrc: 4/0,1 mode: --/PW res: [0x2b871:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644154:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002d8afcd4/0x3234de053c4d5cf lrc: 3/0,0 mode: PR/PR res: [0x2b871:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d08b3 expref: 728 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.644158:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002d8afcd4/0x3234de053c4d5cf lrc: 4/0,0 mode: PR/PR res: [0x2b871:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d08b3 expref: 728 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.644164:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c51ca8 lrc: 3/0,1 mode: --/PW res: [0x2b870:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.644171:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d9ef3c1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997024576:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.644181:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211842 00000100:00100000:1.0:1651529344.644185:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 000000004ca54b8a going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.644189:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1336:39030:x1731745946491392:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.644191:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396371712 00002000:00080000:0.0:1651529344.644194:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178290 count 1 00010000:00010000:1.0:1651529344.644195:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000638ae58b/0x3234de053c4d122 lrc: 4/0,0 mode: PR/PR res: [0x2b86d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf630 expref: 729 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.644198:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c51cb6 lrc: 3/0,1 mode: --/PW res: [0x2b872:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.644200:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396371840 00010000:00010000:1.0:1651529344.644203:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006f053e48/0x3234de053c4e6bc lrc: 4/0,0 mode: PR/PR res: [0x2b870:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b80 expref: 730 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.644203:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006b6445d4/0x3234de053c4c7b3 lrc: 2/0,0 mode: PR/PR res: [0x2b872:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd12a expref: 730 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.644206:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.644206:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.644207:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396371776 00010000:00010000:0.0:1651529344.644207:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c51cb6 lrc: 4/0,1 mode: --/PW res: [0x2b872:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644209:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e2f1d657/0x3234de053c4a00d lrc: 4/0,0 mode: PR/PR res: [0x2b86e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5e0 expref: 731 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.644213:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396371904 00010000:00010000:1.0:1651529344.644214:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005267a56c/0x3234de053c4ebe0 lrc: 4/0,0 mode: PR/PR res: [0x2b86f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6105 expref: 732 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.644214:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006b6445d4/0x3234de053c4c7b3 lrc: 3/0,0 mode: PR/PR res: [0x2b872:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd12a expref: 732 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.644219:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12619 00000100:00100000:1.0:1651529344.644220:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+732:41279:x1731746396371712:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.644220:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006b6445d4/0x3234de053c4c7b3 lrc: 4/0,0 mode: PR/PR res: [0x2b872:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd12a expref: 732 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.644238:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.644240:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000638ae58b/0x3234de053c4d122 lrc: 4/0,0 mode: PR/PR res: [0x2b86d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf630 expref: 732 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.644243:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ea0220b6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997024640:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.644244:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000638ae58b/0x3234de053c4d122 lrc: 3/0,0 mode: PR/PR res: [0x2b86d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf630 expref: 732 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.644249:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000638ae58b/0x3234de053c4d122 lrc: 0/0,0 mode: --/PR res: [0x2b86d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf630 expref: 732 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.644252:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c2b2b59c going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.644253:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.644254:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.644255:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a3ae24c2/0x3234de053c51c93 lrc: 3/0,1 mode: PW/PW res: [0x2b86d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644257:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3ae24c2/0x3234de053c51c93 lrc: 4/0,1 mode: PW/PW res: [0x2b86d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644264:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.644271:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+731:41279:x1731746396371712:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 49us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.644273:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12619 00000100:00100000:0.0:1651529344.644277:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.644287:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12620 00000100:00100000:1.0:1651529344.644289:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+730:41279:x1731746396371840:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.644291:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.644293:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006f053e48/0x3234de053c4e6bc lrc: 4/0,0 mode: PR/PR res: [0x2b870:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b80 expref: 730 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.644293:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.644297:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006f053e48/0x3234de053c4e6bc lrc: 3/0,0 mode: PR/PR res: [0x2b870:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b80 expref: 730 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.644301:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f053e48/0x3234de053c4e6bc lrc: 0/0,0 mode: --/PR res: [0x2b870:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b80 expref: 730 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.644307:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.644308:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.644309:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c51ca8 lrc: 3/0,1 mode: PW/PW res: [0x2b870:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644311:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c51ca8 lrc: 4/0,1 mode: PW/PW res: [0x2b870:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.644314:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946491456 00000100:00100000:0.0:1651529344.644321:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946491520 00010000:00010000:1.0:1651529344.644331:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.644333:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211843 00000100:00100000:0.0:1651529344.644335:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1338:39029:x1731745946491456:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.644340:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+729:41279:x1731746396371840:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 51us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.644343:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12620 00002000:00080000:0.0:1651529344.644345:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178291 count 1 00000100:00100000:1.0:1651529344.644347:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12621 00000100:00100000:1.0:1651529344.644349:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+728:41279:x1731746396371776:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.644350:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c51cbd lrc: 3/0,1 mode: --/PW res: [0x2b873:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644351:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.644353:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e2f1d657/0x3234de053c4a00d lrc: 4/0,0 mode: PR/PR res: [0x2b86e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5e0 expref: 728 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.644354:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b128bba6/0x3234de053c4d408 lrc: 2/0,0 mode: PR/PR res: [0x2b873:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0200 expref: 728 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.644357:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e2f1d657/0x3234de053c4a00d lrc: 3/0,0 mode: PR/PR res: [0x2b86e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5e0 expref: 728 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.644358:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.644358:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.644359:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c51cbd lrc: 4/0,1 mode: --/PW res: [0x2b873:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644361:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2f1d657/0x3234de053c4a00d lrc: 0/0,0 mode: --/PR res: [0x2b86e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5e0 expref: 728 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.644365:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.644365:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b128bba6/0x3234de053c4d408 lrc: 3/0,0 mode: PR/PR res: [0x2b873:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0200 expref: 727 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.644366:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.644366:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51c9a lrc: 3/0,1 mode: PW/PW res: [0x2b86e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644369:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51c9a lrc: 4/0,1 mode: PW/PW res: [0x2b86e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644371:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b128bba6/0x3234de053c4d408 lrc: 4/0,0 mode: PR/PR res: [0x2b873:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0200 expref: 727 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.644377:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.644381:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002c4168d4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997024704:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.644382:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+727:41279:x1731746396371776:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.644384:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12621 00000100:00100000:1.0:1651529344.644388:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12622 00000100:00100000:1.0:1651529344.644389:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+726:41279:x1731746396371904:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.644390:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000003c8b0daf going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.644391:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.644393:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005267a56c/0x3234de053c4ebe0 lrc: 4/0,0 mode: PR/PR res: [0x2b86f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6105 expref: 726 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.644395:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211844 00010000:00010000:1.0:1651529344.644396:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005267a56c/0x3234de053c4ebe0 lrc: 3/0,0 mode: PR/PR res: [0x2b86f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6105 expref: 726 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.644397:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1338:39029:x1731745946491520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.644400:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005267a56c/0x3234de053c4ebe0 lrc: 0/0,0 mode: --/PR res: [0x2b86f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6105 expref: 726 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:0.0:1651529344.644401:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178292 count 1 00010000:00010000:1.0:1651529344.644403:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.644404:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.644405:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e7a2d4e3/0x3234de053c51ca1 lrc: 3/0,1 mode: PW/PW res: [0x2b86f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644405:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51cc4 lrc: 3/0,1 mode: --/PW res: [0x2b874:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644409:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000072a160c0/0x3234de053c4f652 lrc: 2/0,0 mode: PR/PR res: [0x2b874:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c08 expref: 725 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.644410:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7a2d4e3/0x3234de053c51ca1 lrc: 4/0,1 mode: PW/PW res: [0x2b86f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644412:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.644413:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.644413:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51cc4 lrc: 4/0,1 mode: --/PW res: [0x2b874:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644416:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.644419:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000072a160c0/0x3234de053c4f652 lrc: 3/0,0 mode: PR/PR res: [0x2b874:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c08 expref: 725 pid: 156655 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.644420:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+725:41279:x1731746396371904:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 31us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.644423:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12622 00010000:00010000:0.0:1651529344.644423:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000072a160c0/0x3234de053c4f652 lrc: 4/0,0 mode: PR/PR res: [0x2b874:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c08 expref: 725 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.644429:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000078f9a278 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997024768:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.644431:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e7a2d4e3/0x3234de053c51ca1 lrc: 3/0,1 mode: PW/PW res: [0x2b86f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644435:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7a2d4e3/0x3234de053c51ca1 lrc: 3/0,1 mode: PW/PW res: [0x2b86f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.644436:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 0000000029ae2bb2 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.644438:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7a2d4e3/0x3234de053c51ca1 lrc: 3/0,1 mode: PW/PW res: [0x2b86f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644440:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7a2d4e3/0x3234de053c51ca1 lrc: 2/0,0 mode: PW/PW res: [0x2b86f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644440:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51c9a lrc: 3/0,1 mode: PW/PW res: [0x2b86e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644443:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51c9a lrc: 3/0,1 mode: PW/PW res: [0x2b86e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644452:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51c9a lrc: 3/0,1 mode: PW/PW res: [0x2b86e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644456:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51c9a lrc: 2/0,0 mode: PW/PW res: [0x2b86e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.644482:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1340:39029:x1731745946490944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1021us (1126us total) trans 12885079892 rc 0/0 00000100:00100000:1.0:1651529344.644484:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211839 00010000:00010000:1.0:1651529344.644491:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a3ae24c2/0x3234de053c51c93 lrc: 3/0,1 mode: PW/PW res: [0x2b86d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644494:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3ae24c2/0x3234de053c51c93 lrc: 3/0,1 mode: PW/PW res: [0x2b86d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.644495:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1339:39030:x1731745946490880:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1085us (1156us total) trans 12885079893 rc 0/0 00010000:00010000:1.0:1651529344.644497:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3ae24c2/0x3234de053c51c93 lrc: 3/0,1 mode: PW/PW res: [0x2b86d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.644498:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211838 00010000:00010000:1.0:1651529344.644500:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3ae24c2/0x3234de053c51c93 lrc: 2/0,0 mode: PW/PW res: [0x2b86d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.644536:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1339:39029:x1731745946490816:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1129us (1217us total) trans 12885079894 rc 0/0 00010000:00010000:0.0:1651529344.644536:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7a2d4e3/0x3234de053c51ca1 lrc: 2/0,0 mode: PW/PW res: [0x2b86f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.644539:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211837 00010000:00010000:0.0:1651529344.644540:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e7a2d4e3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.644541:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7a2d4e3/0x3234de053c51ca1 lrc: 2/0,0 mode: PW/PW res: [0x2b86f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644544:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7a2d4e3/0x3234de053c51ca1 lrc: 3/0,0 mode: PW/PW res: [0x2b86f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644549:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7a2d4e3/0x3234de053c51ca1 lrc: 1/0,0 mode: --/PW res: [0x2b86f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644552:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7a2d4e3/0x3234de053c51ca1 lrc: 0/0,0 mode: --/PW res: [0x2b86f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644556:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51c9a lrc: 2/0,0 mode: PW/PW res: [0x2b86e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644559:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bfb594be already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.644560:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51c9a lrc: 2/0,0 mode: PW/PW res: [0x2b86e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644562:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51c9a lrc: 3/0,0 mode: PW/PW res: [0x2b86e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644566:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51c9a lrc: 1/0,0 mode: --/PW res: [0x2b86e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644568:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfb594be/0x3234de053c51c9a lrc: 0/0,0 mode: --/PW res: [0x2b86e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644572:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3ae24c2/0x3234de053c51c93 lrc: 2/0,0 mode: PW/PW res: [0x2b86d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644574:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a3ae24c2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.644575:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3ae24c2/0x3234de053c51c93 lrc: 2/0,0 mode: PW/PW res: [0x2b86d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644584:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3ae24c2/0x3234de053c51c93 lrc: 3/0,0 mode: PW/PW res: [0x2b86d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644587:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3ae24c2/0x3234de053c51c93 lrc: 1/0,0 mode: --/PW res: [0x2b86d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644590:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3ae24c2/0x3234de053c51c93 lrc: 0/0,0 mode: --/PW res: [0x2b86d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644606:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c51ca8 lrc: 3/0,1 mode: PW/PW res: [0x2b870:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644609:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c51ca8 lrc: 3/0,1 mode: PW/PW res: [0x2b870:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644612:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c51ca8 lrc: 3/0,1 mode: PW/PW res: [0x2b870:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644614:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c51ca8 lrc: 2/0,0 mode: PW/PW res: [0x2b870:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.644621:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.644657:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396372480 00010000:00010000:1.0:1651529344.644663:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002d8afcd4/0x3234de053c4d5cf lrc: 5/0,0 mode: PR/PR res: [0x2b871:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d08b3 expref: 725 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.644671:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12623 00000100:00100000:1.0:1651529344.644672:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+725:41278:x1731746396372480:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.644682:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.644683:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002d8afcd4/0x3234de053c4d5cf lrc: 5/0,0 mode: PR/PR res: [0x2b871:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d08b3 expref: 725 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.644687:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002d8afcd4/0x3234de053c4d5cf lrc: 4/0,0 mode: PR/PR res: [0x2b871:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d08b3 expref: 725 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.644691:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1339:39030:x1731745946491008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1228us (1328us total) trans 12885079895 rc 0/0 00010000:00010000:1.0:1651529344.644693:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.644693:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.644694:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000099354594/0x3234de053c51caf lrc: 3/0,1 mode: PW/PW res: [0x2b871:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.644694:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211840 00010000:00010000:1.0:1651529344.644697:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099354594/0x3234de053c51caf lrc: 4/0,1 mode: PW/PW res: [0x2b871:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644702:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.644702:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c51ca8 lrc: 2/0,0 mode: PW/PW res: [0x2b870:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644707:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000579ed558 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.644708:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+725:41278:x1731746396372480:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.644711:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12623 00010000:00010000:1.0:1651529344.644721:0:72396:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d8afcd4/0x3234de053c4d5cf lrc: 0/0,0 mode: --/PR res: [0x2b871:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d08b3 expref: 724 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.644723:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c51ca8 lrc: 2/0,0 mode: PW/PW res: [0x2b870:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.644725:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d9ef3c1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997024576:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.644726:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c51ca8 lrc: 3/0,0 mode: PW/PW res: [0x2b870:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644728:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000099354594/0x3234de053c51caf lrc: 3/0,1 mode: PW/PW res: [0x2b871:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644731:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000099354594/0x3234de053c51caf lrc: 3/0,1 mode: PW/PW res: [0x2b871:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644731:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c51ca8 lrc: 1/0,0 mode: --/PW res: [0x2b870:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644744:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099354594/0x3234de053c51caf lrc: 3/0,1 mode: PW/PW res: [0x2b871:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644747:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099354594/0x3234de053c51caf lrc: 3/0,1 mode: PW/PW res: [0x2b871:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644750:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099354594/0x3234de053c51caf lrc: 2/0,0 mode: PW/PW res: [0x2b871:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644753:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000579ed558/0x3234de053c51ca8 lrc: 0/0,0 mode: --/PW res: [0x2b870:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644759:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099354594/0x3234de053c51caf lrc: 3/0,0 mode: PW/PW res: [0x2b871:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644775:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000099354594 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.644776:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099354594/0x3234de053c51caf lrc: 2/0,0 mode: PW/PW res: [0x2b871:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644787:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099354594/0x3234de053c51caf lrc: 3/0,0 mode: PW/PW res: [0x2b871:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644791:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099354594/0x3234de053c51caf lrc: 1/0,0 mode: --/PW res: [0x2b871:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.644793:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1339:39029:x1731745946491328:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 662us (743us total) trans 12885079896 rc 0/0 00010000:00010000:0.0:1651529344.644794:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099354594/0x3234de053c51caf lrc: 0/0,0 mode: --/PW res: [0x2b871:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.644797:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211841 00000100:00100000:0.0:1651529344.644807:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ea0220b6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997024640:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.644811:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.644811:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c51cb6 lrc: 3/0,1 mode: --/PW res: [0x2b872:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.644821:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396372544 00010000:00010000:0.0:1651529344.644836:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006b6445d4/0x3234de053c4c7b3 lrc: 4/0,0 mode: PR/PR res: [0x2b872:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd12a expref: 724 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.644857:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12624 00000100:00100000:0.0:1651529344.644859:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bdd4fa38 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+724:41278:x1731746396372544:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.644862:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.644864:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006b6445d4/0x3234de053c4c7b3 lrc: 4/0,0 mode: PR/PR res: [0x2b872:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd12a expref: 724 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.644873:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006b6445d4/0x3234de053c4c7b3 lrc: 3/0,0 mode: PR/PR res: [0x2b872:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd12a expref: 724 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.644879:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b6445d4/0x3234de053c4c7b3 lrc: 0/0,0 mode: --/PR res: [0x2b872:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd12a expref: 724 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.644883:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.644883:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.644884:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c51cb6 lrc: 3/0,1 mode: PW/PW res: [0x2b872:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644890:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c51cb6 lrc: 4/0,1 mode: PW/PW res: [0x2b872:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.644893:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.644896:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.644903:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.644904:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bdd4fa38 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+723:41278:x1731746396372544:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 44us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.644906:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12624 00000100:00100000:0.0:1651529344.644915:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396372608 00010000:00010000:0.0:1651529344.644919:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b128bba6/0x3234de053c4d408 lrc: 5/0,0 mode: PR/PR res: [0x2b873:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0200 expref: 723 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.644923:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396372672 00010000:00010000:0.0:1651529344.644925:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000072a160c0/0x3234de053c4f652 lrc: 5/0,0 mode: PR/PR res: [0x2b874:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c08 expref: 724 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.644930:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12625 00000100:00100000:0.0:1651529344.644932:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+724:41279:x1731746396372608:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.644933:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12626 00010000:00010000:0.0:1651529344.644934:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.644935:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+724:41279:x1731746396372672:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.644935:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b128bba6/0x3234de053c4d408 lrc: 5/0,0 mode: PR/PR res: [0x2b873:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0200 expref: 724 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.644938:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.644938:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b128bba6/0x3234de053c4d408 lrc: 4/0,0 mode: PR/PR res: [0x2b873:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0200 expref: 724 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.644940:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000072a160c0/0x3234de053c4f652 lrc: 5/0,0 mode: PR/PR res: [0x2b874:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c08 expref: 724 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.644943:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.644944:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.644945:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000072a160c0/0x3234de053c4f652 lrc: 4/0,0 mode: PR/PR res: [0x2b874:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c08 expref: 724 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.644945:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c51cbd lrc: 3/0,1 mode: PW/PW res: [0x2b873:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644948:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c51cbd lrc: 4/0,1 mode: PW/PW res: [0x2b873:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644950:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.644951:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.644952:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51cc4 lrc: 3/0,1 mode: PW/PW res: [0x2b874:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.644952:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.644955:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51cc4 lrc: 4/0,1 mode: PW/PW res: [0x2b874:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.644966:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.644973:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+724:41279:x1731746396372672:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 37us (69us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.644974:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+724:41279:x1731746396372608:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (81us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.644977:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12626 00000100:00100000:0.0:1651529344.644979:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12625 00010000:00010000:0.0:1651529344.644990:0:80276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b128bba6/0x3234de053c4d408 lrc: 0/0,0 mode: --/PR res: [0x2b873:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0200 expref: 722 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.644994:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002c4168d4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997024704:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.644997:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c51cbd lrc: 3/0,1 mode: PW/PW res: [0x2b873:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645001:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c51cbd lrc: 3/0,1 mode: PW/PW res: [0x2b873:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645004:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c51cbd lrc: 3/0,1 mode: PW/PW res: [0x2b873:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645007:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c51cbd lrc: 3/0,1 mode: PW/PW res: [0x2b873:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645009:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c51cbd lrc: 2/0,0 mode: PW/PW res: [0x2b873:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.645072:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1339:39029:x1731745946491456:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 736us (795us total) trans 12885079897 rc 0/0 00000100:00100000:0.0:1651529344.645075:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211843 00010000:00010000:0.0:1651529344.645086:0:156655:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072a160c0/0x3234de053c4f652 lrc: 0/0,0 mode: --/PR res: [0x2b874:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c08 expref: 721 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.645090:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000078f9a278 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997024768:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.645094:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51cc4 lrc: 3/0,1 mode: PW/PW res: [0x2b874:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645097:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51cc4 lrc: 3/0,1 mode: PW/PW res: [0x2b874:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645100:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51cc4 lrc: 3/0,1 mode: PW/PW res: [0x2b874:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645103:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51cc4 lrc: 3/0,1 mode: PW/PW res: [0x2b874:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645105:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51cc4 lrc: 2/0,0 mode: PW/PW res: [0x2b874:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.645145:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1339:39029:x1731745946491520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 747us (852us total) trans 12885079898 rc 0/0 00000100:00100000:0.0:1651529344.645148:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211844 00010000:00010000:0.0:1651529344.645155:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c51cbd lrc: 2/0,0 mode: PW/PW res: [0x2b873:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645158:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dd394f60 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.645159:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c51cbd lrc: 2/0,0 mode: PW/PW res: [0x2b873:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645162:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c51cbd lrc: 3/0,0 mode: PW/PW res: [0x2b873:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645167:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c51cbd lrc: 1/0,0 mode: --/PW res: [0x2b873:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645169:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd394f60/0x3234de053c51cbd lrc: 0/0,0 mode: --/PW res: [0x2b873:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645174:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51cc4 lrc: 2/0,0 mode: PW/PW res: [0x2b874:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645177:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b2d06199 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.645177:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51cc4 lrc: 2/0,0 mode: PW/PW res: [0x2b874:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645180:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51cc4 lrc: 3/0,0 mode: PW/PW res: [0x2b874:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645183:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51cc4 lrc: 1/0,0 mode: --/PW res: [0x2b874:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645188:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2d06199/0x3234de053c51cc4 lrc: 0/0,0 mode: --/PW res: [0x2b874:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645210:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c51cb6 lrc: 3/0,1 mode: PW/PW res: [0x2b872:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645213:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c51cb6 lrc: 3/0,1 mode: PW/PW res: [0x2b872:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645216:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c51cb6 lrc: 3/0,1 mode: PW/PW res: [0x2b872:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645219:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c51cb6 lrc: 2/0,0 mode: PW/PW res: [0x2b872:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.645286:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1339:39030:x1731745946491392:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1102us (1227us total) trans 12885079899 rc 0/0 00000100:00100000:0.0:1651529344.645289:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211842 00010000:00010000:0.0:1651529344.645296:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c51cb6 lrc: 2/0,0 mode: PW/PW res: [0x2b872:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645300:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6eb3f34 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.645301:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c51cb6 lrc: 2/0,0 mode: PW/PW res: [0x2b872:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645304:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c51cb6 lrc: 3/0,0 mode: PW/PW res: [0x2b872:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645309:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c51cb6 lrc: 1/0,0 mode: --/PW res: [0x2b872:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645312:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6eb3f34/0x3234de053c51cb6 lrc: 0/0,0 mode: --/PW res: [0x2b872:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.645326:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.645333:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.645339:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.645360:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.645381:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.645391:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946491776 00000100:00100000:0.0:1651529344.645391:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.645399:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946491712 00000100:00100000:0.0:1651529344.645399:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.645403:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946491840 00000100:00100000:1.0:1651529344.645406:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946491904 00000100:00100000:0.0:1651529344.645406:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946491968 00000100:00100000:1.0:1651529344.645409:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946492288 00000100:00100000:0.0:1651529344.645415:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946492480 00000100:00100000:0.0:1651529344.645419:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211845 00000100:00100000:0.0:1651529344.645421:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1345:39030:x1731745946491776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.645422:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211846 00000100:00100000:1.0:1651529344.645424:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1345:39029:x1731745946491712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.645429:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178293 count 1 00010000:00010000:1.0:1651529344.645434:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c51ccb lrc: 3/0,1 mode: --/PW res: [0x2b875:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.645443:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178294 count 1 00010000:00010000:1.0:1651529344.645444:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000ea67f94/0x3234de053c4e3f2 lrc: 2/0,0 mode: PR/PR res: [0x2b875:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d40b3 expref: 720 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.645447:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.645447:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51cd2 lrc: 3/0,1 mode: --/PW res: [0x2b876:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.645448:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.645449:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c51ccb lrc: 4/0,1 mode: --/PW res: [0x2b875:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645452:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005982bf47/0x3234de053c4ea90 lrc: 2/0,0 mode: PR/PR res: [0x2b876:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c20 expref: 720 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.645455:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.645456:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000ea67f94/0x3234de053c4e3f2 lrc: 3/0,0 mode: PR/PR res: [0x2b875:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d40b3 expref: 720 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.645456:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.645457:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51cd2 lrc: 4/0,1 mode: --/PW res: [0x2b876:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.645459:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000ea67f94/0x3234de053c4e3f2 lrc: 4/0,0 mode: PR/PR res: [0x2b875:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d40b3 expref: 720 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.645463:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000093ddaf92 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997024832:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.645464:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005982bf47/0x3234de053c4ea90 lrc: 3/0,0 mode: PR/PR res: [0x2b876:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c20 expref: 720 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.645468:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005982bf47/0x3234de053c4ea90 lrc: 4/0,0 mode: PR/PR res: [0x2b876:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c20 expref: 720 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.645472:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003de40890 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997024896:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.645479:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000499d0377 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.645486:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211847 00000100:00100000:1.0:1651529344.645487:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1345:39029:x1731745946491840:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.645488:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 0000000009370c1d going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.645492:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178295 count 1 00000100:00100000:0.0:1651529344.645494:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211848 00010000:00010000:1.0:1651529344.645496:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7c68d66/0x3234de053c51cd9 lrc: 3/0,1 mode: --/PW res: [0x2b877:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.645496:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1345:39030:x1731745946491904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.645500:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bdb8391c/0x3234de053c4c90a lrc: 2/0,0 mode: PR/PR res: [0x2b877:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd58a expref: 720 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.645501:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178296 count 1 00010000:00010000:1.0:1651529344.645503:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.645504:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.645504:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7c68d66/0x3234de053c51cd9 lrc: 4/0,1 mode: --/PW res: [0x2b877:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645504:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51ce0 lrc: 3/0,1 mode: --/PW res: [0x2b878:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645508:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000019f696fe/0x3234de053c4d08f lrc: 2/0,0 mode: PR/PR res: [0x2b878:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf3e4 expref: 720 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.645510:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bdb8391c/0x3234de053c4c90a lrc: 3/0,0 mode: PR/PR res: [0x2b877:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd58a expref: 720 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.645511:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.645512:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.645513:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51ce0 lrc: 4/0,1 mode: --/PW res: [0x2b878:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.645514:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bdb8391c/0x3234de053c4c90a lrc: 4/0,0 mode: PR/PR res: [0x2b877:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd58a expref: 720 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.645518:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a13808c6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997024960:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.645519:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000019f696fe/0x3234de053c4d08f lrc: 3/0,0 mode: PR/PR res: [0x2b878:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf3e4 expref: 720 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.645522:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000019f696fe/0x3234de053c4d08f lrc: 4/0,0 mode: PR/PR res: [0x2b878:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf3e4 expref: 720 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.645525:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8a0b704 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.645526:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ebb53b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997025024:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.645531:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211849 00000100:00100000:1.0:1651529344.645533:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1345:39029:x1731745946491968:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.645533:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 000000003c8b0daf going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.645537:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178297 count 1 00000100:00100000:0.0:1651529344.645539:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211850 00010000:00010000:1.0:1651529344.645540:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e77fa1b/0x3234de053c51ce7 lrc: 3/0,1 mode: --/PW res: [0x2b879:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.645540:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1345:39029:x1731745946492288:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.645544:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000007034f71/0x3234de053c4e319 lrc: 2/0,0 mode: PR/PR res: [0x2b879:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d6b expref: 720 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.645544:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178298 count 1 00010000:00010000:0.0:1651529344.645547:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a96127a5/0x3234de053c51cee lrc: 3/0,1 mode: --/PW res: [0x2b87a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.645548:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.645548:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.645549:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e77fa1b/0x3234de053c51ce7 lrc: 4/0,1 mode: --/PW res: [0x2b879:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.645551:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000089734d80/0x3234de053c4f5e2 lrc: 2/0,0 mode: PR/PR res: [0x2b87a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89e6 expref: 720 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.645554:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000007034f71/0x3234de053c4e319 lrc: 3/0,0 mode: PR/PR res: [0x2b879:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d6b expref: 720 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.645554:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.645555:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.645555:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a96127a5/0x3234de053c51cee lrc: 4/0,1 mode: --/PW res: [0x2b87a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.645558:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000007034f71/0x3234de053c4e319 lrc: 4/0,0 mode: PR/PR res: [0x2b879:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d6b expref: 720 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.645561:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006647e4ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997025088:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.645561:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000089734d80/0x3234de053c4f5e2 lrc: 3/0,0 mode: PR/PR res: [0x2b87a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89e6 expref: 720 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.645564:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000089734d80/0x3234de053c4f5e2 lrc: 4/0,0 mode: PR/PR res: [0x2b87a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89e6 expref: 720 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.645568:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cfa1ca05 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.645568:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c9f4ec84 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997025152:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.645573:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211851 00000100:00100000:0.0:1651529344.645574:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c2b2b59c going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.645575:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1345:39029:x1731745946492480:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.645579:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178299 count 1 00010000:00010000:1.0:1651529344.645582:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000352c04c3/0x3234de053c51cf5 lrc: 3/0,1 mode: --/PW res: [0x2b87b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.645587:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000511d4b7b/0x3234de053c4ebd9 lrc: 2/0,0 mode: PR/PR res: [0x2b87b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d60e9 expref: 720 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.645588:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.645592:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.645593:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.645594:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000352c04c3/0x3234de053c51cf5 lrc: 4/0,1 mode: --/PW res: [0x2b87b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.645599:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000511d4b7b/0x3234de053c4ebd9 lrc: 3/0,0 mode: PR/PR res: [0x2b87b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d60e9 expref: 720 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.645602:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000511d4b7b/0x3234de053c4ebd9 lrc: 4/0,0 mode: PR/PR res: [0x2b87b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d60e9 expref: 720 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.645606:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a223a622 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997025216:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.645612:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d09f5ee1 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.645617:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946492544 00000100:00100000:1.0:1651529344.645634:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211852 00000100:00100000:1.0:1651529344.645642:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1346:39030:x1731745946492544:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.645647:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178300 count 1 00010000:00010000:1.0:1651529344.645651:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0580105/0x3234de053c51cfc lrc: 3/0,1 mode: --/PW res: [0x2b87c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.645655:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000966e90ab/0x3234de053c4d6a8 lrc: 2/0,0 mode: PR/PR res: [0x2b87c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c4f expref: 720 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.645658:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.645658:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.645659:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0580105/0x3234de053c51cfc lrc: 4/0,1 mode: --/PW res: [0x2b87c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.645666:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000966e90ab/0x3234de053c4d6a8 lrc: 3/0,0 mode: PR/PR res: [0x2b87c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c4f expref: 720 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.645669:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000966e90ab/0x3234de053c4d6a8 lrc: 4/0,0 mode: PR/PR res: [0x2b87c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c4f expref: 720 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.645673:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005a17dd72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997025280:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.645686:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 0000000020dd7827 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.645823:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000093ddaf92 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997024832:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.645828:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c51ccb lrc: 3/0,1 mode: --/PW res: [0x2b875:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.646147:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a13808c6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997024960:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.646150:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a7c68d66/0x3234de053c51cd9 lrc: 3/0,1 mode: --/PW res: [0x2b877:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.646150:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.646159:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.646167:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.646170:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396372928 00000100:00100000:0.0:1651529344.646173:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.646175:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000ea67f94/0x3234de053c4e3f2 lrc: 4/0,0 mode: PR/PR res: [0x2b875:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d40b3 expref: 721 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.646183:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.646186:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396373184 00010000:00010000:1.0:1651529344.646189:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bdb8391c/0x3234de053c4c90a lrc: 4/0,0 mode: PR/PR res: [0x2b877:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd58a expref: 722 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.646190:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ebb53b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997025024:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.646193:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396373312 00010000:00010000:1.0:1651529344.646195:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000007034f71/0x3234de053c4e319 lrc: 5/0,0 mode: PR/PR res: [0x2b879:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d6b expref: 723 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.646195:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51ce0 lrc: 3/0,1 mode: --/PW res: [0x2b878:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.646199:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396372992 00010000:00010000:1.0:1651529344.646201:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005982bf47/0x3234de053c4ea90 lrc: 5/0,0 mode: PR/PR res: [0x2b876:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c20 expref: 724 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.646205:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396373248 00010000:00010000:1.0:1651529344.646207:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000019f696fe/0x3234de053c4d08f lrc: 4/0,0 mode: PR/PR res: [0x2b878:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf3e4 expref: 725 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.646211:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12627 00000100:00100000:1.0:1651529344.646213:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+725:41279:x1731746396372928:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.646220:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.646220:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003de40890 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997024896:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.646241:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000ea67f94/0x3234de053c4e3f2 lrc: 4/0,0 mode: PR/PR res: [0x2b875:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d40b3 expref: 725 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.646243:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51cd2 lrc: 3/0,1 mode: --/PW res: [0x2b876:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646245:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000ea67f94/0x3234de053c4e3f2 lrc: 3/0,0 mode: PR/PR res: [0x2b875:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d40b3 expref: 725 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.646251:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ea67f94/0x3234de053c4e3f2 lrc: 0/0,0 mode: --/PR res: [0x2b875:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d40b3 expref: 725 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.646254:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.646255:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.646256:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c51ccb lrc: 3/0,1 mode: PW/PW res: [0x2b875:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646261:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c51ccb lrc: 4/0,1 mode: PW/PW res: [0x2b875:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.646262:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12628 00000100:00100000:0.0:1651529344.646264:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+724:41278:x1731746396373184:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.646268:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.646268:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.646269:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bdb8391c/0x3234de053c4c90a lrc: 4/0,0 mode: PR/PR res: [0x2b877:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd58a expref: 724 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.646273:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bdb8391c/0x3234de053c4c90a lrc: 3/0,0 mode: PR/PR res: [0x2b877:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd58a expref: 724 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.646280:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+724:41279:x1731746396372928:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 66us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.646283:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12627 00000100:00100000:1.0:1651529344.646288:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12629 00000100:00100000:1.0:1651529344.646290:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+723:41278:x1731746396373312:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.646293:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.646294:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000007034f71/0x3234de053c4e319 lrc: 5/0,0 mode: PR/PR res: [0x2b879:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d6b expref: 723 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.646295:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bdb8391c/0x3234de053c4c90a lrc: 0/0,0 mode: --/PR res: [0x2b877:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd58a expref: 723 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.646298:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000007034f71/0x3234de053c4e319 lrc: 4/0,0 mode: PR/PR res: [0x2b879:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d6b expref: 723 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.646299:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.646300:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.646301:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a7c68d66/0x3234de053c51cd9 lrc: 3/0,1 mode: PW/PW res: [0x2b877:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646303:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.646303:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.646304:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005e77fa1b/0x3234de053c51ce7 lrc: 3/0,1 mode: PW/PW res: [0x2b879:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646304:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7c68d66/0x3234de053c51cd9 lrc: 4/0,1 mode: PW/PW res: [0x2b877:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646307:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e77fa1b/0x3234de053c51ce7 lrc: 4/0,1 mode: PW/PW res: [0x2b879:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646313:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.646317:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.646321:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+722:41278:x1731746396373184:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 57us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.646323:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+722:41278:x1731746396373312:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.646324:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12628 00000100:00100000:1.0:1651529344.646326:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12629 00000100:00100000:0.0:1651529344.646330:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12630 00000100:00100000:1.0:1651529344.646332:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12631 00000100:00100000:0.0:1651529344.646332:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+720:41278:x1731746396372992:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.646333:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000969ab41d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+720:41278:x1731746396373248:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.646334:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.646336:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.646336:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005982bf47/0x3234de053c4ea90 lrc: 4/0,0 mode: PR/PR res: [0x2b876:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c20 expref: 720 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.646337:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000019f696fe/0x3234de053c4d08f lrc: 4/0,0 mode: PR/PR res: [0x2b878:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf3e4 expref: 720 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.646340:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005982bf47/0x3234de053c4ea90 lrc: 3/0,0 mode: PR/PR res: [0x2b876:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c20 expref: 720 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.646341:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000019f696fe/0x3234de053c4d08f lrc: 3/0,0 mode: PR/PR res: [0x2b878:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf3e4 expref: 720 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.646344:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005982bf47/0x3234de053c4ea90 lrc: 0/0,0 mode: --/PR res: [0x2b876:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c20 expref: 720 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.646345:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019f696fe/0x3234de053c4d08f lrc: 0/0,0 mode: --/PR res: [0x2b878:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf3e4 expref: 720 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.646348:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.646348:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.646349:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.646349:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.646349:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51cd2 lrc: 3/0,1 mode: PW/PW res: [0x2b876:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646350:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51ce0 lrc: 3/0,1 mode: PW/PW res: [0x2b878:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646353:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51ce0 lrc: 4/0,1 mode: PW/PW res: [0x2b878:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646355:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51cd2 lrc: 4/0,1 mode: PW/PW res: [0x2b876:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646362:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.646367:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000969ab41d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+718:41278:x1731746396373248:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (184us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.646368:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.646369:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12631 00000100:00100000:0.0:1651529344.646375:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+717:41278:x1731746396372992:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.646377:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12630 00010000:00010000:1.0:1651529344.646380:0:80280:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007034f71/0x3234de053c4e319 lrc: 0/0,0 mode: --/PR res: [0x2b879:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3d6b expref: 716 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.646384:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006647e4ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997025088:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.646388:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005e77fa1b/0x3234de053c51ce7 lrc: 3/0,1 mode: PW/PW res: [0x2b879:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646388:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51cd2 lrc: 3/0,1 mode: PW/PW res: [0x2b876:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646391:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005e77fa1b/0x3234de053c51ce7 lrc: 3/0,1 mode: PW/PW res: [0x2b879:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646391:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51cd2 lrc: 3/0,1 mode: PW/PW res: [0x2b876:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646394:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e77fa1b/0x3234de053c51ce7 lrc: 3/0,1 mode: PW/PW res: [0x2b879:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646394:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51cd2 lrc: 3/0,1 mode: PW/PW res: [0x2b876:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646397:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e77fa1b/0x3234de053c51ce7 lrc: 3/0,1 mode: PW/PW res: [0x2b879:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646397:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51cd2 lrc: 2/0,0 mode: PW/PW res: [0x2b876:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646399:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e77fa1b/0x3234de053c51ce7 lrc: 2/0,0 mode: PW/PW res: [0x2b879:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.646444:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1348:39029:x1731745946491968:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 911us (1099us total) trans 12885079901 rc 0/0 00000100:00100000:1.0:1651529344.646447:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211849 00010000:00010000:1.0:1651529344.646455:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a7c68d66/0x3234de053c51cd9 lrc: 3/0,1 mode: PW/PW res: [0x2b877:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.646457:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1347:39030:x1731745946491776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1035us (1131us total) trans 12885079900 rc 0/0 00010000:00010000:1.0:1651529344.646458:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7c68d66/0x3234de053c51cd9 lrc: 3/0,1 mode: PW/PW res: [0x2b877:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.646460:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211845 00010000:00010000:1.0:1651529344.646463:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7c68d66/0x3234de053c51cd9 lrc: 3/0,1 mode: PW/PW res: [0x2b877:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646466:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7c68d66/0x3234de053c51cd9 lrc: 2/0,0 mode: PW/PW res: [0x2b877:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646467:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51ce0 lrc: 3/0,1 mode: PW/PW res: [0x2b878:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646471:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51ce0 lrc: 3/0,1 mode: PW/PW res: [0x2b878:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646486:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51ce0 lrc: 3/0,1 mode: PW/PW res: [0x2b878:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646489:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51ce0 lrc: 2/0,0 mode: PW/PW res: [0x2b878:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.646504:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1347:39029:x1731745946491840:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1016us (1164us total) trans 12885079902 rc 0/0 00000100:00100000:1.0:1651529344.646507:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211847 00010000:00010000:1.0:1651529344.646513:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c51ccb lrc: 3/0,1 mode: PW/PW res: [0x2b875:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646516:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c51ccb lrc: 3/0,1 mode: PW/PW res: [0x2b875:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646519:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c51ccb lrc: 3/0,1 mode: PW/PW res: [0x2b875:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646522:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c51ccb lrc: 2/0,0 mode: PW/PW res: [0x2b875:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.646523:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1347:39030:x1731745946491904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1026us (1142us total) trans 12885079903 rc 0/0 00000100:00100000:0.0:1651529344.646526:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211848 00010000:00010000:0.0:1651529344.646533:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51cd2 lrc: 2/0,0 mode: PW/PW res: [0x2b876:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646537:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000046d6c242 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.646538:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51cd2 lrc: 2/0,0 mode: PW/PW res: [0x2b876:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646541:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51cd2 lrc: 3/0,0 mode: PW/PW res: [0x2b876:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646545:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51cd2 lrc: 1/0,0 mode: --/PW res: [0x2b876:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646548:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046d6c242/0x3234de053c51cd2 lrc: 0/0,0 mode: --/PW res: [0x2b876:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.646551:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1347:39029:x1731745946491712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1126us (1217us total) trans 12885079904 rc 0/0 00010000:00010000:0.0:1651529344.646552:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e77fa1b/0x3234de053c51ce7 lrc: 2/0,0 mode: PW/PW res: [0x2b879:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.646554:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211846 00010000:00010000:0.0:1651529344.646555:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005e77fa1b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.646556:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e77fa1b/0x3234de053c51ce7 lrc: 2/0,0 mode: PW/PW res: [0x2b879:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646559:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e77fa1b/0x3234de053c51ce7 lrc: 3/0,0 mode: PW/PW res: [0x2b879:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646562:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e77fa1b/0x3234de053c51ce7 lrc: 1/0,0 mode: --/PW res: [0x2b879:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646565:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e77fa1b/0x3234de053c51ce7 lrc: 0/0,0 mode: --/PW res: [0x2b879:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646568:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7c68d66/0x3234de053c51cd9 lrc: 2/0,0 mode: PW/PW res: [0x2b877:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646570:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a7c68d66 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.646571:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7c68d66/0x3234de053c51cd9 lrc: 2/0,0 mode: PW/PW res: [0x2b877:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646574:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7c68d66/0x3234de053c51cd9 lrc: 3/0,0 mode: PW/PW res: [0x2b877:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646577:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7c68d66/0x3234de053c51cd9 lrc: 1/0,0 mode: --/PW res: [0x2b877:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646580:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7c68d66/0x3234de053c51cd9 lrc: 0/0,0 mode: --/PW res: [0x2b877:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646583:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51ce0 lrc: 2/0,0 mode: PW/PW res: [0x2b878:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646586:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000093dbd0d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.646587:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51ce0 lrc: 2/0,0 mode: PW/PW res: [0x2b878:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646589:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51ce0 lrc: 3/0,0 mode: PW/PW res: [0x2b878:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646600:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51ce0 lrc: 1/0,0 mode: --/PW res: [0x2b878:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646603:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000093dbd0d/0x3234de053c51ce0 lrc: 0/0,0 mode: --/PW res: [0x2b878:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646606:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c51ccb lrc: 2/0,0 mode: PW/PW res: [0x2b875:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646609:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d3d72adb already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.646610:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c51ccb lrc: 2/0,0 mode: PW/PW res: [0x2b875:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646612:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c51ccb lrc: 3/0,0 mode: PW/PW res: [0x2b875:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646615:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c51ccb lrc: 1/0,0 mode: --/PW res: [0x2b875:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646618:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c51ccb lrc: 0/0,0 mode: --/PW res: [0x2b875:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.646620:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.646632:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.646636:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c9f4ec84 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997025152:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.646639:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a96127a5/0x3234de053c51cee lrc: 3/0,1 mode: --/PW res: [0x2b87a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.646642:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.646663:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396373440 00010000:00010000:0.0:1651529344.646668:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000089734d80/0x3234de053c4f5e2 lrc: 4/0,0 mode: PR/PR res: [0x2b87a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89e6 expref: 716 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.646679:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396373696 00010000:00010000:0.0:1651529344.646682:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000966e90ab/0x3234de053c4d6a8 lrc: 5/0,0 mode: PR/PR res: [0x2b87c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c4f expref: 717 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.646686:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396373632 00010000:00010000:0.0:1651529344.646688:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000511d4b7b/0x3234de053c4ebd9 lrc: 5/0,0 mode: PR/PR res: [0x2b87b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d60e9 expref: 718 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.646692:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a223a622 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997025216:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.646693:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12632 00000100:00100000:0.0:1651529344.646695:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+718:41279:x1731746396373440:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.646697:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000352c04c3/0x3234de053c51cf5 lrc: 3/0,1 mode: --/PW res: [0x2b87b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646697:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.646699:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000089734d80/0x3234de053c4f5e2 lrc: 4/0,0 mode: PR/PR res: [0x2b87a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89e6 expref: 718 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.646705:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12633 00000100:00100000:1.0:1651529344.646707:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a13808c6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+718:41278:x1731746396373696:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.646710:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.646712:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000966e90ab/0x3234de053c4d6a8 lrc: 5/0,0 mode: PR/PR res: [0x2b87c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c4f expref: 718 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.646716:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000966e90ab/0x3234de053c4d6a8 lrc: 4/0,0 mode: PR/PR res: [0x2b87c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c4f expref: 718 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.646719:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000089734d80/0x3234de053c4f5e2 lrc: 3/0,0 mode: PR/PR res: [0x2b87a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89e6 expref: 718 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.646722:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.646722:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.646723:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e0580105/0x3234de053c51cfc lrc: 3/0,1 mode: PW/PW res: [0x2b87c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646725:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089734d80/0x3234de053c4f5e2 lrc: 0/0,0 mode: --/PR res: [0x2b87a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89e6 expref: 718 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.646726:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0580105/0x3234de053c51cfc lrc: 4/0,1 mode: PW/PW res: [0x2b87c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646729:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.646730:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.646730:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.646752:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a13808c6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+717:41278:x1731746396373696:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 44us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.646755:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12633 00010000:00010000:0.0:1651529344.646757:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a96127a5/0x3234de053c51cee lrc: 3/0,1 mode: PW/PW res: [0x2b87a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.646760:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12634 00010000:00010000:0.0:1651529344.646761:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a96127a5/0x3234de053c51cee lrc: 4/0,1 mode: PW/PW res: [0x2b87a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.646762:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+716:41279:x1731746396373632:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.646765:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.646766:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000511d4b7b/0x3234de053c4ebd9 lrc: 4/0,0 mode: PR/PR res: [0x2b87b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d60e9 expref: 716 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.646768:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.646770:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000511d4b7b/0x3234de053c4ebd9 lrc: 3/0,0 mode: PR/PR res: [0x2b87b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d60e9 expref: 716 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.646775:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000511d4b7b/0x3234de053c4ebd9 lrc: 0/0,0 mode: --/PR res: [0x2b87b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d60e9 expref: 716 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.646776:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+716:41279:x1731746396373440:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 80us (156us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.646779:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.646779:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.646779:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12632 00010000:00010000:1.0:1651529344.646780:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000352c04c3/0x3234de053c51cf5 lrc: 3/0,1 mode: PW/PW res: [0x2b87b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646783:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000352c04c3/0x3234de053c51cf5 lrc: 4/0,1 mode: PW/PW res: [0x2b87b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646786:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a96127a5/0x3234de053c51cee lrc: 3/0,1 mode: PW/PW res: [0x2b87a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646789:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.646789:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a96127a5/0x3234de053c51cee lrc: 3/0,1 mode: PW/PW res: [0x2b87a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646792:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a96127a5/0x3234de053c51cee lrc: 3/0,1 mode: PW/PW res: [0x2b87a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.646795:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+714:41279:x1731746396373632:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 33us (153us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.646797:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a96127a5/0x3234de053c51cee lrc: 2/0,0 mode: PW/PW res: [0x2b87a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.646798:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12634 00010000:00010000:1.0:1651529344.646808:0:80278:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000966e90ab/0x3234de053c4d6a8 lrc: 0/0,0 mode: --/PR res: [0x2b87c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c4f expref: 713 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.646811:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005a17dd72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997025280:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.646815:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e0580105/0x3234de053c51cfc lrc: 3/0,1 mode: PW/PW res: [0x2b87c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646818:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e0580105/0x3234de053c51cfc lrc: 3/0,1 mode: PW/PW res: [0x2b87c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646820:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0580105/0x3234de053c51cfc lrc: 3/0,1 mode: PW/PW res: [0x2b87c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646823:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0580105/0x3234de053c51cfc lrc: 3/0,1 mode: PW/PW res: [0x2b87c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646826:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0580105/0x3234de053c51cfc lrc: 2/0,0 mode: PW/PW res: [0x2b87c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.646863:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1348:39029:x1731745946492288:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1321us (1471us total) trans 12885079905 rc 0/0 00000100:00100000:0.0:1651529344.646866:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211850 00010000:00010000:0.0:1651529344.646873:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a96127a5/0x3234de053c51cee lrc: 2/0,0 mode: PW/PW res: [0x2b87a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.646876:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1347:39030:x1731745946492544:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1239us (1287us total) trans 12885079906 rc 0/0 00010000:00010000:0.0:1651529344.646877:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a96127a5 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.646878:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a96127a5/0x3234de053c51cee lrc: 2/0,0 mode: PW/PW res: [0x2b87a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.646879:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211852 00010000:00010000:0.0:1651529344.646881:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a96127a5/0x3234de053c51cee lrc: 3/0,0 mode: PW/PW res: [0x2b87a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646886:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000352c04c3/0x3234de053c51cf5 lrc: 3/0,1 mode: PW/PW res: [0x2b87b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646889:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000352c04c3/0x3234de053c51cf5 lrc: 3/0,1 mode: PW/PW res: [0x2b87b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646892:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000352c04c3/0x3234de053c51cf5 lrc: 3/0,1 mode: PW/PW res: [0x2b87b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.646895:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000352c04c3/0x3234de053c51cf5 lrc: 2/0,0 mode: PW/PW res: [0x2b87b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646896:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a96127a5/0x3234de053c51cee lrc: 1/0,0 mode: --/PW res: [0x2b87a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646900:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a96127a5/0x3234de053c51cee lrc: 0/0,0 mode: --/PW res: [0x2b87a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646910:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0580105/0x3234de053c51cfc lrc: 2/0,0 mode: PW/PW res: [0x2b87c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646913:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e0580105 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.646914:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0580105/0x3234de053c51cfc lrc: 2/0,0 mode: PW/PW res: [0x2b87c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646917:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0580105/0x3234de053c51cfc lrc: 3/0,0 mode: PW/PW res: [0x2b87c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646920:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0580105/0x3234de053c51cfc lrc: 1/0,0 mode: --/PW res: [0x2b87c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646923:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0580105/0x3234de053c51cfc lrc: 0/0,0 mode: --/PW res: [0x2b87c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646926:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000352c04c3/0x3234de053c51cf5 lrc: 2/0,0 mode: PW/PW res: [0x2b87b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646929:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000352c04c3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.646929:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000352c04c3/0x3234de053c51cf5 lrc: 2/0,0 mode: PW/PW res: [0x2b87b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.646932:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000352c04c3/0x3234de053c51cf5 lrc: 3/0,0 mode: PW/PW res: [0x2b87b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.646934:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1347:39029:x1731745946492480:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1358us (1534us total) trans 12885079907 rc 0/0 00010000:00010000:0.0:1651529344.646935:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000352c04c3/0x3234de053c51cf5 lrc: 1/0,0 mode: --/PW res: [0x2b87b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.646937:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211851 00010000:00010000:0.0:1651529344.646938:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000352c04c3/0x3234de053c51cf5 lrc: 0/0,0 mode: --/PW res: [0x2b87b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.646988:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.647011:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.647020:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.647032:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.647038:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946492928 00000100:00100000:1.0:1651529344.647040:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.647050:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946492992 00000100:00100000:0.0:1651529344.647054:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946493056 00000100:00100000:0.0:1651529344.647073:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946493120 00000100:00100000:1.0:1651529344.647074:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946493184 00000100:00100000:0.0:1651529344.647082:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211853 00000100:00100000:1.0:1651529344.647089:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211854 00000100:00100000:0.0:1651529344.647089:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1351:39030:x1731745946492928:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.647091:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1351:39030:x1731745946493056:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.647094:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178301 count 1 00002000:00080000:1.0:1651529344.647096:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178303 count 1 00010000:00010000:0.0:1651529344.647099:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c51d03 lrc: 3/0,1 mode: --/PW res: [0x2b87d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.647101:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc83f98f/0x3234de053c51d0a lrc: 3/0,1 mode: --/PW res: [0x2b87f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.647104:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006ba501c0/0x3234de053c4d1e6 lrc: 2/0,0 mode: PR/PR res: [0x2b87d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf963 expref: 712 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.647106:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008b85ac47/0x3234de053c4d184 lrc: 2/0,0 mode: PR/PR res: [0x2b87f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf74f expref: 712 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.647107:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.647107:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.647108:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c51d03 lrc: 4/0,1 mode: --/PW res: [0x2b87d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.647109:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.647110:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.647111:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc83f98f/0x3234de053c51d0a lrc: 4/0,1 mode: --/PW res: [0x2b87f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.647115:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006ba501c0/0x3234de053c4d1e6 lrc: 3/0,0 mode: PR/PR res: [0x2b87d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf963 expref: 712 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.647117:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008b85ac47/0x3234de053c4d184 lrc: 3/0,0 mode: PR/PR res: [0x2b87f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf74f expref: 712 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.647119:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006ba501c0/0x3234de053c4d1e6 lrc: 4/0,0 mode: PR/PR res: [0x2b87d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf963 expref: 712 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.647123:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000027c41311 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997025344:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.647124:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008b85ac47/0x3234de053c4d184 lrc: 4/0,0 mode: PR/PR res: [0x2b87f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf74f expref: 712 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.647128:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002f363f4a pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997025408:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.647135:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 000000000d706dff going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.647137:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d09f5ee1 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.647141:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211855 00000100:00100000:1.0:1651529344.647143:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211856 00000100:00100000:0.0:1651529344.647143:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000802c76be pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1351:39029:x1731745946492992:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.647145:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1351:39029:x1731745946493120:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.647147:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178302 count 1 00002000:00080000:1.0:1651529344.647149:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178304 count 1 00010000:00010000:0.0:1651529344.647150:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086ec1398/0x3234de053c51d11 lrc: 3/0,1 mode: --/PW res: [0x2b87e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.647153:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040e86ed1/0x3234de053c51d18 lrc: 3/0,1 mode: --/PW res: [0x2b880:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.647155:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000aeddd027/0x3234de053c4dda1 lrc: 2/0,0 mode: PR/PR res: [0x2b87e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d27f4 expref: 712 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.647157:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002c7b8dc4/0x3234de053c4d1ed lrc: 2/0,0 mode: PR/PR res: [0x2b880:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf97f expref: 712 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.647157:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.647158:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.647159:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086ec1398/0x3234de053c51d11 lrc: 4/0,1 mode: --/PW res: [0x2b87e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.647160:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.647160:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.647161:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040e86ed1/0x3234de053c51d18 lrc: 4/0,1 mode: --/PW res: [0x2b880:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.647164:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000aeddd027/0x3234de053c4dda1 lrc: 3/0,0 mode: PR/PR res: [0x2b87e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d27f4 expref: 712 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.647167:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002c7b8dc4/0x3234de053c4d1ed lrc: 3/0,0 mode: PR/PR res: [0x2b880:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf97f expref: 712 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.647170:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002c7b8dc4/0x3234de053c4d1ed lrc: 4/0,0 mode: PR/PR res: [0x2b880:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf97f expref: 712 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.647177:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002f77bb41 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997025536:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.647188:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000aeddd027/0x3234de053c4dda1 lrc: 4/0,0 mode: PR/PR res: [0x2b87e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d27f4 expref: 712 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.647191:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 000000004ca54b8a going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.647193:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000078a40aa9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997025472:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.647196:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211857 00000100:00100000:1.0:1651529344.647198:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1351:39030:x1731745946493184:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.647202:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178305 count 1 00000100:00100000:0.0:1651529344.647202:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c0dff858 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.647206:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aaa296ad/0x3234de053c51d1f lrc: 3/0,1 mode: --/PW res: [0x2b881:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.647210:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006479d6a2/0x3234de053c4db78 lrc: 2/0,0 mode: PR/PR res: [0x2b881:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e00 expref: 712 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.647213:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.647213:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.647214:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aaa296ad/0x3234de053c51d1f lrc: 4/0,1 mode: --/PW res: [0x2b881:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.647216:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.647220:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006479d6a2/0x3234de053c4db78 lrc: 3/0,0 mode: PR/PR res: [0x2b881:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e00 expref: 712 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.647234:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006479d6a2/0x3234de053c4db78 lrc: 4/0,0 mode: PR/PR res: [0x2b881:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e00 expref: 712 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.647238:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000028589556 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997025600:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.647251:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000412e5d26 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.647256:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946493376 00000100:00100000:1.0:1651529344.647274:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211858 00000100:00100000:1.0:1651529344.647276:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1352:39029:x1731745946493376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.647277:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529344.647281:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178306 count 1 00010000:00010000:1.0:1651529344.647285:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c51d26 lrc: 3/0,1 mode: --/PW res: [0x2b882:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.647289:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c4c6fd lrc: 2/0,0 mode: PR/PR res: [0x2b882:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccdfe expref: 712 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.647289:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.647292:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.647293:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.647293:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c51d26 lrc: 4/0,1 mode: --/PW res: [0x2b882:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.647299:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c4c6fd lrc: 3/0,0 mode: PR/PR res: [0x2b882:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccdfe expref: 712 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.647302:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c4c6fd lrc: 4/0,0 mode: PR/PR res: [0x2b882:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccdfe expref: 712 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.647306:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000fb8e412 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997025664:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.647338:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946493440 00000100:00100000:1.0:1651529344.647344:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000babe2d90 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.647351:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946493632 00000100:00100000:1.0:1651529344.647356:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211859 00000100:00100000:1.0:1651529344.647358:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1354:39029:x1731745946493632:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.647362:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178308 count 1 00000100:00100000:0.0:1651529344.647364:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211860 00010000:00010000:1.0:1651529344.647366:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066c54aab/0x3234de053c51d2d lrc: 3/0,1 mode: --/PW res: [0x2b884:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.647366:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1354:39030:x1731745946493440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.647371:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000549e1aab/0x3234de053c4d145 lrc: 2/0,0 mode: PR/PR res: [0x2b884:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf699 expref: 712 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.647371:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178307 count 1 00010000:00010000:1.0:1651529344.647374:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.647374:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.647375:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066c54aab/0x3234de053c51d2d lrc: 4/0,1 mode: --/PW res: [0x2b884:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.647376:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f14837b/0x3234de053c51d34 lrc: 3/0,1 mode: --/PW res: [0x2b883:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.647381:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000549e1aab/0x3234de053c4d145 lrc: 3/0,0 mode: PR/PR res: [0x2b884:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf699 expref: 712 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.647383:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000496616a7/0x3234de053c4c632 lrc: 2/0,0 mode: PR/PR res: [0x2b883:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccabd expref: 712 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.647384:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000549e1aab/0x3234de053c4d145 lrc: 4/0,0 mode: PR/PR res: [0x2b884:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf699 expref: 712 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.647386:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.647387:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.647387:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f14837b/0x3234de053c51d34 lrc: 4/0,1 mode: --/PW res: [0x2b883:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.647388:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bddc5ca7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997025728:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.647394:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000496616a7/0x3234de053c4c632 lrc: 3/0,0 mode: PR/PR res: [0x2b883:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccabd expref: 712 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.647396:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8a0b704 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.647398:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000496616a7/0x3234de053c4c632 lrc: 4/0,0 mode: PR/PR res: [0x2b883:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccabd expref: 712 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.647402:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f39ca9ea pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997025792:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.647411:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed830649 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.647708:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002f77bb41 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997025536:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.647710:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000078a40aa9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997025472:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.647713:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000040e86ed1/0x3234de053c51d18 lrc: 3/0,1 mode: --/PW res: [0x2b880:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.647714:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000086ec1398/0x3234de053c51d11 lrc: 3/0,1 mode: --/PW res: [0x2b87e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.647720:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002f363f4a pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997025408:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.647722:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bc83f98f/0x3234de053c51d0a lrc: 3/0,1 mode: --/PW res: [0x2b87f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.647722:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000027c41311 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997025344:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.647724:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c51d03 lrc: 3/0,1 mode: --/PW res: [0x2b87d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.647794:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.647801:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.647807:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.647814:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.647824:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.647825:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396374016 00000100:00100000:1.0:1651529344.647832:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000028589556 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997025600:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.647835:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000aaa296ad/0x3234de053c51d1f lrc: 3/0,1 mode: --/PW res: [0x2b881:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.647842:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396374144 00010000:00010000:1.0:1651529344.647847:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000aeddd027/0x3234de053c4dda1 lrc: 4/0,0 mode: PR/PR res: [0x2b87e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d27f4 expref: 714 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.647852:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396373952 00010000:00010000:0.0:1651529344.647852:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008b85ac47/0x3234de053c4d184 lrc: 4/0,0 mode: PR/PR res: [0x2b87f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf74f expref: 714 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.647860:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396374080 00010000:00010000:0.0:1651529344.647863:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002c7b8dc4/0x3234de053c4d1ed lrc: 4/0,0 mode: PR/PR res: [0x2b880:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf97f expref: 716 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.647864:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006ba501c0/0x3234de053c4d1e6 lrc: 4/0,0 mode: PR/PR res: [0x2b87d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf963 expref: 716 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.647868:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396374208 00000100:00100000:1.0:1651529344.647870:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12635 00010000:00010000:0.0:1651529344.647870:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006479d6a2/0x3234de053c4db78 lrc: 4/0,0 mode: PR/PR res: [0x2b881:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e00 expref: 717 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.647871:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+717:41279:x1731746396374144:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.647874:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.647875:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000aeddd027/0x3234de053c4dda1 lrc: 4/0,0 mode: PR/PR res: [0x2b87e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d27f4 expref: 717 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.647876:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12636 00000100:00100000:0.0:1651529344.647877:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+717:41279:x1731746396374016:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.647879:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000aeddd027/0x3234de053c4dda1 lrc: 3/0,0 mode: PR/PR res: [0x2b87e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d27f4 expref: 717 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.647880:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.647881:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008b85ac47/0x3234de053c4d184 lrc: 4/0,0 mode: PR/PR res: [0x2b87f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf74f expref: 717 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.647885:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aeddd027/0x3234de053c4dda1 lrc: 0/0,0 mode: --/PR res: [0x2b87e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d27f4 expref: 717 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.647885:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008b85ac47/0x3234de053c4d184 lrc: 3/0,0 mode: PR/PR res: [0x2b87f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf74f expref: 717 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.647891:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.647891:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b85ac47/0x3234de053c4d184 lrc: 0/0,0 mode: --/PR res: [0x2b87f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf74f expref: 716 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.647892:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.647893:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000086ec1398/0x3234de053c51d11 lrc: 3/0,1 mode: PW/PW res: [0x2b87e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.647895:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.647895:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.647896:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086ec1398/0x3234de053c51d11 lrc: 4/0,1 mode: PW/PW res: [0x2b87e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.647896:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bc83f98f/0x3234de053c51d0a lrc: 3/0,1 mode: PW/PW res: [0x2b87f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.647902:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc83f98f/0x3234de053c51d0a lrc: 4/0,1 mode: PW/PW res: [0x2b87f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.647905:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.647915:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+715:41279:x1731746396374144:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 43us (114us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.647918:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.647923:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12635 00000100:00100000:0.0:1651529344.647926:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+714:41279:x1731746396374016:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 48us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.647928:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12637 00000100:00100000:1.0:1651529344.647929:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de23fde4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+714:41278:x1731746396374080:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.647929:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12636 00010000:00010000:1.0:1651529344.647932:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.647934:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002c7b8dc4/0x3234de053c4d1ed lrc: 4/0,0 mode: PR/PR res: [0x2b880:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf97f expref: 713 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.647935:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12638 00000100:00100000:0.0:1651529344.647936:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+713:41278:x1731746396373952:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.647937:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002c7b8dc4/0x3234de053c4d1ed lrc: 3/0,0 mode: PR/PR res: [0x2b880:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf97f expref: 713 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.647939:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.647940:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006ba501c0/0x3234de053c4d1e6 lrc: 4/0,0 mode: PR/PR res: [0x2b87d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf963 expref: 713 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.647942:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c7b8dc4/0x3234de053c4d1ed lrc: 0/0,0 mode: --/PR res: [0x2b880:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf97f expref: 713 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.647944:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006ba501c0/0x3234de053c4d1e6 lrc: 3/0,0 mode: PR/PR res: [0x2b87d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf963 expref: 713 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.647946:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.647946:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.647947:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000040e86ed1/0x3234de053c51d18 lrc: 3/0,1 mode: PW/PW res: [0x2b880:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.647949:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ba501c0/0x3234de053c4d1e6 lrc: 0/0,0 mode: --/PR res: [0x2b87d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf963 expref: 712 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.647950:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040e86ed1/0x3234de053c51d18 lrc: 4/0,1 mode: PW/PW res: [0x2b880:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.647953:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.647953:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.647954:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c51d03 lrc: 3/0,1 mode: PW/PW res: [0x2b87d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.647956:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.647957:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c51d03 lrc: 4/0,1 mode: PW/PW res: [0x2b87d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.647961:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de23fde4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+711:41278:x1731746396374080:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 31us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.647964:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12637 00010000:00010000:0.0:1651529344.647966:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.647968:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12639 00000100:00100000:1.0:1651529344.647969:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+710:41278:x1731746396374208:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.647971:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+710:41278:x1731746396373952:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 34us (163us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.647972:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.647973:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006479d6a2/0x3234de053c4db78 lrc: 4/0,0 mode: PR/PR res: [0x2b881:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e00 expref: 710 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.647973:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12638 00010000:00010000:1.0:1651529344.647977:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006479d6a2/0x3234de053c4db78 lrc: 3/0,0 mode: PR/PR res: [0x2b881:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e00 expref: 709 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.647981:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006479d6a2/0x3234de053c4db78 lrc: 0/0,0 mode: --/PR res: [0x2b881:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e00 expref: 709 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.647983:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000086ec1398/0x3234de053c51d11 lrc: 3/0,1 mode: PW/PW res: [0x2b87e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.647984:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.647985:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.647985:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000aaa296ad/0x3234de053c51d1f lrc: 3/0,1 mode: PW/PW res: [0x2b881:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.647986:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086ec1398/0x3234de053c51d11 lrc: 3/0,1 mode: PW/PW res: [0x2b87e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.647990:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086ec1398/0x3234de053c51d11 lrc: 3/0,1 mode: PW/PW res: [0x2b87e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.647991:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aaa296ad/0x3234de053c51d1f lrc: 4/0,1 mode: PW/PW res: [0x2b881:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.647992:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000086ec1398/0x3234de053c51d11 lrc: 2/0,0 mode: PW/PW res: [0x2b87e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.647996:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.648001:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+708:41278:x1731746396374208:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 31us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.648003:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12639 00010000:00010000:1.0:1651529344.648010:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000040e86ed1/0x3234de053c51d18 lrc: 3/0,1 mode: PW/PW res: [0x2b880:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648013:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040e86ed1/0x3234de053c51d18 lrc: 3/0,1 mode: PW/PW res: [0x2b880:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648016:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040e86ed1/0x3234de053c51d18 lrc: 3/0,1 mode: PW/PW res: [0x2b880:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648019:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040e86ed1/0x3234de053c51d18 lrc: 2/0,0 mode: PW/PW res: [0x2b880:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.648039:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000802c76be pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1355:39029:x1731745946492992:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 895us (1027us total) trans 12885079908 rc 0/0 00000100:00100000:0.0:1651529344.648042:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211855 00010000:00010000:0.0:1651529344.648049:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000086ec1398/0x3234de053c51d11 lrc: 2/0,0 mode: PW/PW res: [0x2b87e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648052:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000086ec1398 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.648053:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000086ec1398/0x3234de053c51d11 lrc: 2/0,0 mode: PW/PW res: [0x2b87e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648058:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000086ec1398/0x3234de053c51d11 lrc: 3/0,0 mode: PW/PW res: [0x2b87e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.648063:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1355:39029:x1731745946493120:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 917us (1031us total) trans 12885079909 rc 0/0 00010000:00010000:0.0:1651529344.648063:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000086ec1398/0x3234de053c51d11 lrc: 1/0,0 mode: --/PW res: [0x2b87e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.648066:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211856 00010000:00010000:0.0:1651529344.648066:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086ec1398/0x3234de053c51d11 lrc: 0/0,0 mode: --/PW res: [0x2b87e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648070:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040e86ed1/0x3234de053c51d18 lrc: 2/0,0 mode: PW/PW res: [0x2b880:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648073:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000040e86ed1 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.648074:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000aaa296ad/0x3234de053c51d1f lrc: 3/0,1 mode: PW/PW res: [0x2b881:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648074:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040e86ed1/0x3234de053c51d18 lrc: 2/0,0 mode: PW/PW res: [0x2b880:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648076:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040e86ed1/0x3234de053c51d18 lrc: 3/0,0 mode: PW/PW res: [0x2b880:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648077:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aaa296ad/0x3234de053c51d1f lrc: 3/0,1 mode: PW/PW res: [0x2b881:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648079:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040e86ed1/0x3234de053c51d18 lrc: 1/0,0 mode: --/PW res: [0x2b880:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648080:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aaa296ad/0x3234de053c51d1f lrc: 3/0,1 mode: PW/PW res: [0x2b881:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648082:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040e86ed1/0x3234de053c51d18 lrc: 0/0,0 mode: --/PW res: [0x2b880:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648083:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aaa296ad/0x3234de053c51d1f lrc: 2/0,0 mode: PW/PW res: [0x2b881:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648095:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aaa296ad/0x3234de053c51d1f lrc: 2/0,0 mode: PW/PW res: [0x2b881:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648100:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000aaa296ad already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.648101:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aaa296ad/0x3234de053c51d1f lrc: 2/0,0 mode: PW/PW res: [0x2b881:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648104:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aaa296ad/0x3234de053c51d1f lrc: 3/0,0 mode: PW/PW res: [0x2b881:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648107:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aaa296ad/0x3234de053c51d1f lrc: 1/0,0 mode: --/PW res: [0x2b881:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648109:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aaa296ad/0x3234de053c51d1f lrc: 0/0,0 mode: --/PW res: [0x2b881:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648115:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c51d03 lrc: 3/0,1 mode: PW/PW res: [0x2b87d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.648118:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1355:39030:x1731745946493184:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 919us (1078us total) trans 12885079910 rc 0/0 00010000:00010000:0.0:1651529344.648118:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c51d03 lrc: 3/0,1 mode: PW/PW res: [0x2b87d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.648121:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211857 00010000:00010000:0.0:1651529344.648121:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c51d03 lrc: 3/0,1 mode: PW/PW res: [0x2b87d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648124:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c51d03 lrc: 2/0,0 mode: PW/PW res: [0x2b87d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648127:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bc83f98f/0x3234de053c51d0a lrc: 3/0,1 mode: PW/PW res: [0x2b87f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648130:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc83f98f/0x3234de053c51d0a lrc: 3/0,1 mode: PW/PW res: [0x2b87f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648134:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc83f98f/0x3234de053c51d0a lrc: 3/0,1 mode: PW/PW res: [0x2b87f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648136:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc83f98f/0x3234de053c51d0a lrc: 2/0,0 mode: PW/PW res: [0x2b87f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.648173:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1356:39030:x1731745946493056:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1082us (1153us total) trans 12885079912 rc 0/0 00000100:00100000:1.0:1651529344.648176:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211854 00000100:00100000:0.0:1651529344.648181:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1355:39030:x1731745946492928:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1092us (1193us total) trans 12885079911 rc 0/0 00000100:00100000:0.0:1651529344.648185:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211853 00010000:00010000:0.0:1651529344.648205:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c51d03 lrc: 2/0,0 mode: PW/PW res: [0x2b87d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648208:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ef6f99f3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.648209:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c51d03 lrc: 2/0,0 mode: PW/PW res: [0x2b87d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648219:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c51d03 lrc: 3/0,0 mode: PW/PW res: [0x2b87d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.648221:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.648242:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c51d03 lrc: 1/0,0 mode: --/PW res: [0x2b87d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648245:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c51d03 lrc: 0/0,0 mode: --/PW res: [0x2b87d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.648248:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.648249:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc83f98f/0x3234de053c51d0a lrc: 2/0,0 mode: PW/PW res: [0x2b87f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648252:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bc83f98f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.648253:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc83f98f/0x3234de053c51d0a lrc: 2/0,0 mode: PW/PW res: [0x2b87f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648256:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc83f98f/0x3234de053c51d0a lrc: 3/0,0 mode: PW/PW res: [0x2b87f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.648259:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.648262:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc83f98f/0x3234de053c51d0a lrc: 1/0,0 mode: --/PW res: [0x2b87f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648264:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc83f98f/0x3234de053c51d0a lrc: 0/0,0 mode: --/PW res: [0x2b87f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.648274:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f39ca9ea pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997025792:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.648278:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001f14837b/0x3234de053c51d34 lrc: 3/0,1 mode: --/PW res: [0x2b883:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.648301:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000fb8e412 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997025664:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.648312:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c51d26 lrc: 3/0,1 mode: --/PW res: [0x2b882:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.648321:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bddc5ca7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997025728:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.648324:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000066c54aab/0x3234de053c51d2d lrc: 3/0,1 mode: --/PW res: [0x2b884:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.648330:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396374336 00010000:00010000:1.0:1651529344.648335:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000549e1aab/0x3234de053c4d145 lrc: 4/0,0 mode: PR/PR res: [0x2b884:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf699 expref: 708 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.648345:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396374272 00010000:00010000:1.0:1651529344.648348:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c4c6fd lrc: 4/0,0 mode: PR/PR res: [0x2b882:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccdfe expref: 709 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.648352:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396374464 00010000:00010000:1.0:1651529344.648354:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000496616a7/0x3234de053c4c632 lrc: 4/0,0 mode: PR/PR res: [0x2b883:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccabd expref: 710 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.648359:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12640 00000100:00100000:1.0:1651529344.648360:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+710:41278:x1731746396374336:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.648363:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.648364:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000549e1aab/0x3234de053c4d145 lrc: 4/0,0 mode: PR/PR res: [0x2b884:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf699 expref: 710 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.648365:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12641 00000100:00100000:0.0:1651529344.648367:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+710:41279:x1731746396374272:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.648370:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000549e1aab/0x3234de053c4d145 lrc: 3/0,0 mode: PR/PR res: [0x2b884:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf699 expref: 710 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.648371:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.648373:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c4c6fd lrc: 4/0,0 mode: PR/PR res: [0x2b882:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccdfe expref: 710 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.648376:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000549e1aab/0x3234de053c4d145 lrc: 0/0,0 mode: --/PR res: [0x2b884:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf699 expref: 710 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.648377:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c4c6fd lrc: 3/0,0 mode: PR/PR res: [0x2b882:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccdfe expref: 710 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.648379:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.648380:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.648381:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000066c54aab/0x3234de053c51d2d lrc: 3/0,1 mode: PW/PW res: [0x2b884:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648383:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c4c6fd lrc: 0/0,0 mode: --/PR res: [0x2b882:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccdfe expref: 709 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.648384:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066c54aab/0x3234de053c51d2d lrc: 4/0,1 mode: PW/PW res: [0x2b884:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648386:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.648387:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.648388:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c51d26 lrc: 3/0,1 mode: PW/PW res: [0x2b882:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648390:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.648391:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c51d26 lrc: 4/0,1 mode: PW/PW res: [0x2b882:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.648398:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+708:41278:x1731746396374336:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 37us (178us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.648402:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.648407:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12640 00000100:00100000:0.0:1651529344.648409:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+708:41279:x1731746396374272:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.648411:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12642 00000100:00100000:1.0:1651529344.648414:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+707:41278:x1731746396374464:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.648414:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12641 00010000:00010000:1.0:1651529344.648417:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.648418:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000496616a7/0x3234de053c4c632 lrc: 4/0,0 mode: PR/PR res: [0x2b883:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccabd expref: 706 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.648422:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000496616a7/0x3234de053c4c632 lrc: 3/0,0 mode: PR/PR res: [0x2b883:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccabd expref: 706 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.648427:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000496616a7/0x3234de053c4c632 lrc: 0/0,0 mode: --/PR res: [0x2b883:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccabd expref: 706 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.648431:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.648431:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.648432:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001f14837b/0x3234de053c51d34 lrc: 3/0,1 mode: PW/PW res: [0x2b883:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648435:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f14837b/0x3234de053c51d34 lrc: 4/0,1 mode: PW/PW res: [0x2b883:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648444:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.648447:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001f14837b/0x3234de053c51d34 lrc: 3/0,1 mode: PW/PW res: [0x2b883:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.648449:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+705:41278:x1731746396374464:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 36us (191us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.648451:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f14837b/0x3234de053c51d34 lrc: 3/0,1 mode: PW/PW res: [0x2b883:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.648452:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12642 00010000:00010000:0.0:1651529344.648454:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f14837b/0x3234de053c51d34 lrc: 3/0,1 mode: PW/PW res: [0x2b883:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648457:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f14837b/0x3234de053c51d34 lrc: 2/0,0 mode: PW/PW res: [0x2b883:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648459:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000066c54aab/0x3234de053c51d2d lrc: 3/0,1 mode: PW/PW res: [0x2b884:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648462:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066c54aab/0x3234de053c51d2d lrc: 3/0,1 mode: PW/PW res: [0x2b884:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648465:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066c54aab/0x3234de053c51d2d lrc: 3/0,1 mode: PW/PW res: [0x2b884:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648468:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066c54aab/0x3234de053c51d2d lrc: 2/0,0 mode: PW/PW res: [0x2b884:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.648513:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1356:39029:x1731745946493632:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1154us (1223us total) trans 12885079913 rc 0/0 00000100:00100000:1.0:1651529344.648516:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211859 00010000:00010000:1.0:1651529344.648523:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c51d26 lrc: 3/0,1 mode: PW/PW res: [0x2b882:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.648525:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1355:39030:x1731745946493440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1158us (1247us total) trans 12885079914 rc 0/0 00010000:00010000:1.0:1651529344.648526:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c51d26 lrc: 3/0,1 mode: PW/PW res: [0x2b882:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.648528:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211860 00010000:00010000:1.0:1651529344.648529:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c51d26 lrc: 3/0,1 mode: PW/PW res: [0x2b882:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648532:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c51d26 lrc: 2/0,0 mode: PW/PW res: [0x2b882:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648547:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f14837b/0x3234de053c51d34 lrc: 2/0,0 mode: PW/PW res: [0x2b883:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648551:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001f14837b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.648552:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f14837b/0x3234de053c51d34 lrc: 2/0,0 mode: PW/PW res: [0x2b883:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648555:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f14837b/0x3234de053c51d34 lrc: 3/0,0 mode: PW/PW res: [0x2b883:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648560:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f14837b/0x3234de053c51d34 lrc: 1/0,0 mode: --/PW res: [0x2b883:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648562:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f14837b/0x3234de053c51d34 lrc: 0/0,0 mode: --/PW res: [0x2b883:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648566:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066c54aab/0x3234de053c51d2d lrc: 2/0,0 mode: PW/PW res: [0x2b884:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.648569:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1355:39029:x1731745946493376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1292us (1352us total) trans 12885079915 rc 0/0 00010000:00010000:0.0:1651529344.648569:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000066c54aab already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.648570:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066c54aab/0x3234de053c51d2d lrc: 2/0,0 mode: PW/PW res: [0x2b884:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.648571:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211858 00010000:00010000:0.0:1651529344.648573:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066c54aab/0x3234de053c51d2d lrc: 3/0,0 mode: PW/PW res: [0x2b884:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648576:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066c54aab/0x3234de053c51d2d lrc: 1/0,0 mode: --/PW res: [0x2b884:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648578:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066c54aab/0x3234de053c51d2d lrc: 0/0,0 mode: --/PW res: [0x2b884:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648582:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c51d26 lrc: 2/0,0 mode: PW/PW res: [0x2b882:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648585:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000078e8c25c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.648585:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c51d26 lrc: 2/0,0 mode: PW/PW res: [0x2b882:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648588:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c51d26 lrc: 3/0,0 mode: PW/PW res: [0x2b882:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648591:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c51d26 lrc: 1/0,0 mode: --/PW res: [0x2b882:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648594:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078e8c25c/0x3234de053c51d26 lrc: 0/0,0 mode: --/PW res: [0x2b882:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.648605:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.648622:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.648645:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946493888 00000100:00100000:1.0:1651529344.648648:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946493824 00000100:00100000:0.0:1651529344.648655:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211861 00000100:00100000:0.0:1651529344.648657:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1356:39029:x1731745946493888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.648663:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211862 00000100:00100000:1.0:1651529344.648665:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1356:39030:x1731745946493824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.648667:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178310 count 1 00002000:00080000:1.0:1651529344.648670:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178309 count 1 00010000:00010000:0.0:1651529344.648671:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000920e959f/0x3234de053c51d3b lrc: 3/0,1 mode: --/PW res: [0x2b886:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648675:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e2e2708/0x3234de053c51d42 lrc: 3/0,1 mode: --/PW res: [0x2b885:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648676:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000077678908/0x3234de053c4f119 lrc: 2/0,0 mode: PR/PR res: [0x2b886:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d76de expref: 704 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.648679:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.648680:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.648681:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000920e959f/0x3234de053c51d3b lrc: 4/0,1 mode: --/PW res: [0x2b886:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648682:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b866be3a/0x3234de053c4f15f lrc: 2/0,0 mode: PR/PR res: [0x2b885:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7827 expref: 704 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.648685:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.648686:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.648686:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e2e2708/0x3234de053c51d42 lrc: 4/0,1 mode: --/PW res: [0x2b885:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648693:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b866be3a/0x3234de053c4f15f lrc: 3/0,0 mode: PR/PR res: [0x2b885:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7827 expref: 704 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.648697:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b866be3a/0x3234de053c4f15f lrc: 4/0,0 mode: PR/PR res: [0x2b885:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7827 expref: 704 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.648701:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000fb8e412 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997025856:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.648703:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000077678908/0x3234de053c4f119 lrc: 3/0,0 mode: PR/PR res: [0x2b886:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d76de expref: 704 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.648707:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000077678908/0x3234de053c4f119 lrc: 4/0,0 mode: PR/PR res: [0x2b886:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d76de expref: 704 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.648711:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000065f5e47d pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997025920:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.648714:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 0000000071742acc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.648726:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed830649 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.648729:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.648733:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946494016 00000100:00100000:0.0:1651529344.648752:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211863 00000100:00100000:0.0:1651529344.648754:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1357:39029:x1731745946494016:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.648758:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.648759:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178312 count 1 00010000:00010000:0.0:1651529344.648762:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be1256ce/0x3234de053c51d49 lrc: 3/0,1 mode: --/PW res: [0x2b888:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648767:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c4e0b8 lrc: 2/0,0 mode: PR/PR res: [0x2b888:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d335b expref: 704 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.648770:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.648771:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.648772:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be1256ce/0x3234de053c51d49 lrc: 4/0,1 mode: --/PW res: [0x2b888:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648778:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c4e0b8 lrc: 3/0,0 mode: PR/PR res: [0x2b888:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d335b expref: 704 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.648784:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c4e0b8 lrc: 4/0,0 mode: PR/PR res: [0x2b888:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d335b expref: 704 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.648787:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bc420ca1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997025984:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.648790:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.648795:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 000000000d706dff going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.648826:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946493952 00000100:00100000:1.0:1651529344.648839:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946494080 00000100:00100000:1.0:1651529344.648847:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211864 00000100:00100000:1.0:1651529344.648849:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1359:39030:x1731745946493952:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.648851:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529344.648854:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178311 count 1 00010000:00010000:1.0:1651529344.648858:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008564120b/0x3234de053c51d50 lrc: 3/0,1 mode: --/PW res: [0x2b887:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.648859:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.648865:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c49fab lrc: 2/0,0 mode: PR/PR res: [0x2b887:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb507 expref: 704 pid: 72397 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.648866:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.648868:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.648869:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.648870:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008564120b/0x3234de053c51d50 lrc: 4/0,1 mode: --/PW res: [0x2b887:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.648872:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946494208 00010000:00010000:1.0:1651529344.648876:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c49fab lrc: 3/0,0 mode: PR/PR res: [0x2b887:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb507 expref: 704 pid: 72397 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.648883:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946494144 00010000:00010000:1.0:1651529344.648885:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c49fab lrc: 4/0,0 mode: PR/PR res: [0x2b887:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb507 expref: 704 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.648885:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946494272 00000100:00100000:0.0:1651529344.648888:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211865 00000100:00100000:1.0:1651529344.648890:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002f77bb41 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997026048:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.648890:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1362:39030:x1731745946494080:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.648895:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178313 count 1 00010000:00010000:0.0:1651529344.648899:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000689e285e/0x3234de053c51d57 lrc: 3/0,1 mode: --/PW res: [0x2b889:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.648903:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000412e5d26 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.648910:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211866 00010000:00010000:0.0:1651529344.648910:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002a6de03b/0x3234de053c4e21d lrc: 2/0,0 mode: PR/PR res: [0x2b889:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d39ba expref: 704 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.648912:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1362:39030:x1731745946494208:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.648913:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.648914:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.648914:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000689e285e/0x3234de053c51d57 lrc: 4/0,1 mode: --/PW res: [0x2b889:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.648917:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178315 count 1 00010000:00010000:1.0:1651529344.648920:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b31b1dc0/0x3234de053c51d5e lrc: 3/0,1 mode: --/PW res: [0x2b88b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648921:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002a6de03b/0x3234de053c4e21d lrc: 3/0,0 mode: PR/PR res: [0x2b889:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d39ba expref: 704 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.648924:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000215d667c/0x3234de053c4dd62 lrc: 2/0,0 mode: PR/PR res: [0x2b88b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d26dc expref: 704 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.648925:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002a6de03b/0x3234de053c4e21d lrc: 4/0,0 mode: PR/PR res: [0x2b889:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d39ba expref: 704 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.648927:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.648928:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.648929:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b31b1dc0/0x3234de053c51d5e lrc: 4/0,1 mode: --/PW res: [0x2b88b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.648929:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000078f9a278 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997026112:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.648935:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000215d667c/0x3234de053c4dd62 lrc: 3/0,0 mode: PR/PR res: [0x2b88b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d26dc expref: 704 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.648938:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000abca413e going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.648939:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000215d667c/0x3234de053c4dd62 lrc: 4/0,0 mode: PR/PR res: [0x2b88b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d26dc expref: 704 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.648943:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dfc79d4e pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997026176:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.648944:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211867 00000100:00100000:0.0:1651529344.648945:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1362:39029:x1731745946494144:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.648950:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 000000004ca54b8a going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.648950:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178314 count 1 00010000:00010000:0.0:1651529344.648953:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005267a56c/0x3234de053c51d65 lrc: 3/0,1 mode: --/PW res: [0x2b88a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.648955:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211868 00000100:00100000:1.0:1651529344.648957:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1362:39029:x1731745946494272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.648957:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f4a0aba2/0x3234de053c4e41c lrc: 2/0,0 mode: PR/PR res: [0x2b88a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d417e expref: 704 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.648960:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1651529344.648961:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178316 count 1 00010000:00010000:0.0:1651529344.648961:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.648961:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005267a56c/0x3234de053c51d65 lrc: 4/0,1 mode: --/PW res: [0x2b88a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648964:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e3a7232/0x3234de053c51d6c lrc: 3/0,1 mode: --/PW res: [0x2b88c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.648968:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000848aee59/0x3234de053c4e916 lrc: 2/0,0 mode: PR/PR res: [0x2b88c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5535 expref: 704 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.648968:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f4a0aba2/0x3234de053c4e41c lrc: 3/0,0 mode: PR/PR res: [0x2b88a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d417e expref: 704 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.648971:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.648972:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.648972:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e3a7232/0x3234de053c51d6c lrc: 4/0,1 mode: --/PW res: [0x2b88c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.648972:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f4a0aba2/0x3234de053c4e41c lrc: 4/0,0 mode: PR/PR res: [0x2b88a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d417e expref: 704 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.648978:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000848aee59/0x3234de053c4e916 lrc: 3/0,0 mode: PR/PR res: [0x2b88c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5535 expref: 704 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.648978:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014f8af45 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997026240:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.648984:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000848aee59/0x3234de053c4e916 lrc: 4/0,0 mode: PR/PR res: [0x2b88c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5535 expref: 704 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.648985:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 0000000070e666f7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.648988:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005ea32140 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997026304:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.648994:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd96f074 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.649121:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000065f5e47d pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997025920:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.649124:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.649126:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000920e959f/0x3234de053c51d3b lrc: 3/0,1 mode: --/PW res: [0x2b886:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.649131:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.649134:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bc420ca1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997025984:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.649136:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000be1256ce/0x3234de053c51d49 lrc: 3/0,1 mode: --/PW res: [0x2b888:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.649140:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.649148:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000fb8e412 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997025856:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.649152:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003e2e2708/0x3234de053c51d42 lrc: 3/0,1 mode: --/PW res: [0x2b885:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.649159:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396374976 00010000:00010000:1.0:1651529344.649164:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000077678908/0x3234de053c4f119 lrc: 4/0,0 mode: PR/PR res: [0x2b886:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d76de expref: 705 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.649173:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396375104 00010000:00010000:1.0:1651529344.649176:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c4e0b8 lrc: 4/0,0 mode: PR/PR res: [0x2b888:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d335b expref: 706 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.649180:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396375040 00010000:00010000:1.0:1651529344.649182:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b866be3a/0x3234de053c4f15f lrc: 4/0,0 mode: PR/PR res: [0x2b885:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7827 expref: 707 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.649187:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12643 00000100:00100000:1.0:1651529344.649194:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007fca8239 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+707:41278:x1731746396374976:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.649197:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12644 00010000:00010000:1.0:1651529344.649198:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.649199:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000077678908/0x3234de053c4f119 lrc: 4/0,0 mode: PR/PR res: [0x2b886:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d76de expref: 707 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.649199:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005914c920 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+707:41278:x1731746396375104:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.649202:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000077678908/0x3234de053c4f119 lrc: 3/0,0 mode: PR/PR res: [0x2b886:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d76de expref: 707 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.649203:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.649205:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c4e0b8 lrc: 4/0,0 mode: PR/PR res: [0x2b888:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d335b expref: 707 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.649208:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077678908/0x3234de053c4f119 lrc: 0/0,0 mode: --/PR res: [0x2b886:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d76de expref: 707 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.649209:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c4e0b8 lrc: 3/0,0 mode: PR/PR res: [0x2b888:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d335b expref: 707 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.649212:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.649212:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.649213:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000920e959f/0x3234de053c51d3b lrc: 3/0,1 mode: PW/PW res: [0x2b886:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649214:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c4e0b8 lrc: 0/0,0 mode: --/PR res: [0x2b888:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d335b expref: 706 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.649216:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000920e959f/0x3234de053c51d3b lrc: 4/0,1 mode: PW/PW res: [0x2b886:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649218:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.649219:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.649220:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000be1256ce/0x3234de053c51d49 lrc: 3/0,1 mode: PW/PW res: [0x2b888:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.649235:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.649242:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be1256ce/0x3234de053c51d49 lrc: 4/0,1 mode: PW/PW res: [0x2b888:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.649248:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007fca8239 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+705:41278:x1731746396374976:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 58us (125us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.649249:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.649251:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12643 00000100:00100000:1.0:1651529344.649256:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12645 00000100:00100000:0.0:1651529344.649256:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005914c920 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+704:41278:x1731746396375104:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 57us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.649258:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d46d0fc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+704:41279:x1731746396375040:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.649259:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12644 00010000:00010000:1.0:1651529344.649261:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.649262:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b866be3a/0x3234de053c4f15f lrc: 4/0,0 mode: PR/PR res: [0x2b885:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7827 expref: 704 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.649266:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b866be3a/0x3234de053c4f15f lrc: 3/0,0 mode: PR/PR res: [0x2b885:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7827 expref: 703 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.649267:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000be1256ce/0x3234de053c51d49 lrc: 3/0,1 mode: PW/PW res: [0x2b888:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649270:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be1256ce/0x3234de053c51d49 lrc: 3/0,1 mode: PW/PW res: [0x2b888:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.649271:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b866be3a/0x3234de053c4f15f lrc: 0/0,0 mode: --/PR res: [0x2b885:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7827 expref: 703 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.649273:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be1256ce/0x3234de053c51d49 lrc: 3/0,1 mode: PW/PW res: [0x2b888:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.649274:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.649275:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.649276:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003e2e2708/0x3234de053c51d42 lrc: 3/0,1 mode: PW/PW res: [0x2b885:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649276:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be1256ce/0x3234de053c51d49 lrc: 2/0,0 mode: PW/PW res: [0x2b888:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.649279:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e2e2708/0x3234de053c51d42 lrc: 4/0,1 mode: PW/PW res: [0x2b885:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.649284:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.649289:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d46d0fc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+702:41279:x1731746396375040:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 31us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.649292:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12645 00010000:00010000:1.0:1651529344.649305:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003e2e2708/0x3234de053c51d42 lrc: 3/0,1 mode: PW/PW res: [0x2b885:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.649308:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e2e2708/0x3234de053c51d42 lrc: 3/0,1 mode: PW/PW res: [0x2b885:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.649311:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e2e2708/0x3234de053c51d42 lrc: 3/0,1 mode: PW/PW res: [0x2b885:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.649316:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e2e2708/0x3234de053c51d42 lrc: 2/0,0 mode: PW/PW res: [0x2b885:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.649316:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1363:39029:x1731745946494016:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 561us (586us total) trans 12885079916 rc 0/0 00000100:00100000:0.0:1651529344.649319:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211863 00010000:00010000:0.0:1651529344.649333:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be1256ce/0x3234de053c51d49 lrc: 2/0,0 mode: PW/PW res: [0x2b888:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649339:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000be1256ce already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.649361:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1363:39030:x1731745946493824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 695us (739us total) trans 12885079917 rc 0/0 00010000:00010000:0.0:1651529344.649362:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be1256ce/0x3234de053c51d49 lrc: 2/0,0 mode: PW/PW res: [0x2b888:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.649364:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211862 00010000:00010000:0.0:1651529344.649366:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be1256ce/0x3234de053c51d49 lrc: 3/0,0 mode: PW/PW res: [0x2b888:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649371:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be1256ce/0x3234de053c51d49 lrc: 1/0,0 mode: --/PW res: [0x2b888:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649373:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be1256ce/0x3234de053c51d49 lrc: 0/0,0 mode: --/PW res: [0x2b888:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649378:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e2e2708/0x3234de053c51d42 lrc: 2/0,0 mode: PW/PW res: [0x2b885:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649381:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003e2e2708 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.649382:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e2e2708/0x3234de053c51d42 lrc: 2/0,0 mode: PW/PW res: [0x2b885:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.649384:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002f77bb41 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997026048:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.649384:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e2e2708/0x3234de053c51d42 lrc: 3/0,0 mode: PW/PW res: [0x2b885:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.649388:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008564120b/0x3234de053c51d50 lrc: 3/0,1 mode: --/PW res: [0x2b887:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649388:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e2e2708/0x3234de053c51d42 lrc: 1/0,0 mode: --/PW res: [0x2b885:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649390:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e2e2708/0x3234de053c51d42 lrc: 0/0,0 mode: --/PW res: [0x2b885:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649397:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000920e959f/0x3234de053c51d3b lrc: 3/0,1 mode: PW/PW res: [0x2b886:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649400:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000920e959f/0x3234de053c51d3b lrc: 3/0,1 mode: PW/PW res: [0x2b886:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649422:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000920e959f/0x3234de053c51d3b lrc: 3/0,1 mode: PW/PW res: [0x2b886:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649438:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000920e959f/0x3234de053c51d3b lrc: 2/0,0 mode: PW/PW res: [0x2b886:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.649476:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.649486:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1363:39029:x1731745946493888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 829us (881us total) trans 12885079918 rc 0/0 00000100:00100000:0.0:1651529344.649489:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211861 00010000:00010000:0.0:1651529344.649497:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000920e959f/0x3234de053c51d3b lrc: 2/0,0 mode: PW/PW res: [0x2b886:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649500:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000920e959f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.649501:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000920e959f/0x3234de053c51d3b lrc: 2/0,0 mode: PW/PW res: [0x2b886:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.649504:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.649504:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000920e959f/0x3234de053c51d3b lrc: 3/0,0 mode: PW/PW res: [0x2b886:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649508:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000920e959f/0x3234de053c51d3b lrc: 1/0,0 mode: --/PW res: [0x2b886:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649511:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000920e959f/0x3234de053c51d3b lrc: 0/0,0 mode: --/PW res: [0x2b886:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.649520:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014f8af45 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997026240:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.649524:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005267a56c/0x3234de053c51d65 lrc: 3/0,1 mode: --/PW res: [0x2b88a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.649530:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000078f9a278 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997026112:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.649533:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000689e285e/0x3234de053c51d57 lrc: 3/0,1 mode: --/PW res: [0x2b889:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.649534:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.649541:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.649551:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.649552:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396375168 00010000:00010000:0.0:1651529344.649557:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c49fab lrc: 4/0,0 mode: PR/PR res: [0x2b887:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb507 expref: 702 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.649560:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dfc79d4e pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997026176:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.649563:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b31b1dc0/0x3234de053c51d5e lrc: 3/0,1 mode: --/PW res: [0x2b88b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.649570:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005ea32140 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997026304:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.649572:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000e3a7232/0x3234de053c51d6c lrc: 3/0,1 mode: --/PW res: [0x2b88c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.649579:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396375232 00000100:00100000:0.0:1651529344.649579:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396375296 00010000:00010000:0.0:1651529344.649582:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000215d667c/0x3234de053c4dd62 lrc: 4/0,0 mode: PR/PR res: [0x2b88b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d26dc expref: 704 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.649584:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002a6de03b/0x3234de053c4e21d lrc: 4/0,0 mode: PR/PR res: [0x2b889:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d39ba expref: 704 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.649599:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396375360 00000100:00100000:0.0:1651529344.649599:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396375424 00010000:00010000:1.0:1651529344.649602:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f4a0aba2/0x3234de053c4e41c lrc: 4/0,0 mode: PR/PR res: [0x2b88a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d417e expref: 706 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.649603:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000848aee59/0x3234de053c4e916 lrc: 4/0,0 mode: PR/PR res: [0x2b88c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5535 expref: 706 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.649606:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12646 00000100:00100000:1.0:1651529344.649608:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007fca8239 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+706:41279:x1731746396375168:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.649610:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12647 00010000:00010000:1.0:1651529344.649611:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.649612:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c49fab lrc: 4/0,0 mode: PR/PR res: [0x2b887:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb507 expref: 706 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.649612:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+706:41279:x1731746396375296:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.649615:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.649616:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c49fab lrc: 3/0,0 mode: PR/PR res: [0x2b887:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb507 expref: 706 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.649616:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000215d667c/0x3234de053c4dd62 lrc: 4/0,0 mode: PR/PR res: [0x2b88b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d26dc expref: 706 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.649620:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000215d667c/0x3234de053c4dd62 lrc: 3/0,0 mode: PR/PR res: [0x2b88b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d26dc expref: 706 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.649622:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c49fab lrc: 0/0,0 mode: --/PR res: [0x2b887:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb507 expref: 706 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.649625:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000215d667c/0x3234de053c4dd62 lrc: 0/0,0 mode: --/PR res: [0x2b88b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d26dc expref: 705 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.649626:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.649626:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.649627:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008564120b/0x3234de053c51d50 lrc: 3/0,1 mode: PW/PW res: [0x2b887:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649629:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.649630:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008564120b/0x3234de053c51d50 lrc: 4/0,1 mode: PW/PW res: [0x2b887:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649630:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.649630:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b31b1dc0/0x3234de053c51d5e lrc: 3/0,1 mode: PW/PW res: [0x2b88b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.649636:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.649644:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007fca8239 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+704:41279:x1731746396375168:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.649647:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12646 00000100:00100000:1.0:1651529344.649652:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12648 00000100:00100000:1.0:1651529344.649653:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005914c920 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+703:41278:x1731746396375232:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.649655:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b31b1dc0/0x3234de053c51d5e lrc: 4/0,1 mode: PW/PW res: [0x2b88b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.649656:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.649657:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002a6de03b/0x3234de053c4e21d lrc: 4/0,0 mode: PR/PR res: [0x2b889:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d39ba expref: 703 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.649661:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002a6de03b/0x3234de053c4e21d lrc: 3/0,0 mode: PR/PR res: [0x2b889:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d39ba expref: 703 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.649666:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.649672:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a6de03b/0x3234de053c4e21d lrc: 0/0,0 mode: --/PR res: [0x2b889:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d39ba expref: 703 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.649674:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+703:41279:x1731746396375296:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 61us (140us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.649676:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.649676:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.649677:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000689e285e/0x3234de053c51d57 lrc: 3/0,1 mode: PW/PW res: [0x2b889:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.649677:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12647 00010000:00010000:1.0:1651529344.649680:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000689e285e/0x3234de053c51d57 lrc: 4/0,1 mode: PW/PW res: [0x2b889:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.649682:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12649 00000100:00100000:0.0:1651529344.649683:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+701:41279:x1731746396375360:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.649686:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.649689:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.649695:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005914c920 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+701:41278:x1731746396375232:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.649697:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12648 00000100:00100000:1.0:1651529344.649702:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12650 00000100:00100000:1.0:1651529344.649704:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+700:41278:x1731746396375424:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.649705:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f4a0aba2/0x3234de053c4e41c lrc: 4/0,0 mode: PR/PR res: [0x2b88a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d417e expref: 700 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.649706:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.649708:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000848aee59/0x3234de053c4e916 lrc: 4/0,0 mode: PR/PR res: [0x2b88c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5535 expref: 700 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.649711:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000848aee59/0x3234de053c4e916 lrc: 3/0,0 mode: PR/PR res: [0x2b88c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5535 expref: 700 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.649712:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f4a0aba2/0x3234de053c4e41c lrc: 3/0,0 mode: PR/PR res: [0x2b88a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d417e expref: 700 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.649716:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000848aee59/0x3234de053c4e916 lrc: 0/0,0 mode: --/PR res: [0x2b88c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5535 expref: 700 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.649718:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4a0aba2/0x3234de053c4e41c lrc: 0/0,0 mode: --/PR res: [0x2b88a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d417e expref: 700 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.649719:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.649720:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.649721:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000e3a7232/0x3234de053c51d6c lrc: 3/0,1 mode: PW/PW res: [0x2b88c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649721:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.649722:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.649723:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e3a7232/0x3234de053c51d6c lrc: 4/0,1 mode: PW/PW res: [0x2b88c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649723:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005267a56c/0x3234de053c51d65 lrc: 3/0,1 mode: PW/PW res: [0x2b88a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649726:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005267a56c/0x3234de053c51d65 lrc: 4/0,1 mode: PW/PW res: [0x2b88a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.649729:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.649732:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.649733:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+698:41278:x1731746396375424:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 29us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.649745:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12650 00000100:00100000:0.0:1651529344.649748:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+697:41279:x1731746396375360:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 63us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.649751:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12649 00010000:00010000:1.0:1651529344.649752:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008564120b/0x3234de053c51d50 lrc: 3/0,1 mode: PW/PW res: [0x2b887:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.649755:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008564120b/0x3234de053c51d50 lrc: 3/0,1 mode: PW/PW res: [0x2b887:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649758:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000689e285e/0x3234de053c51d57 lrc: 3/0,1 mode: PW/PW res: [0x2b889:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.649759:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008564120b/0x3234de053c51d50 lrc: 3/0,1 mode: PW/PW res: [0x2b887:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649761:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000689e285e/0x3234de053c51d57 lrc: 3/0,1 mode: PW/PW res: [0x2b889:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.649762:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008564120b/0x3234de053c51d50 lrc: 2/0,0 mode: PW/PW res: [0x2b887:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649765:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000689e285e/0x3234de053c51d57 lrc: 3/0,1 mode: PW/PW res: [0x2b889:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649775:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000689e285e/0x3234de053c51d57 lrc: 2/0,0 mode: PW/PW res: [0x2b889:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.649803:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1364:39030:x1731745946493952:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 954us (1045us total) trans 12885079919 rc 0/0 00000100:00100000:1.0:1651529344.649806:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211864 00010000:00010000:1.0:1651529344.649813:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000e3a7232/0x3234de053c51d6c lrc: 3/0,1 mode: PW/PW res: [0x2b88c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.649814:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1363:39030:x1731745946494080:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 923us (1024us total) trans 12885079920 rc 0/0 00010000:00010000:1.0:1651529344.649816:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e3a7232/0x3234de053c51d6c lrc: 3/0,1 mode: PW/PW res: [0x2b88c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.649817:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211865 00010000:00010000:1.0:1651529344.649819:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e3a7232/0x3234de053c51d6c lrc: 3/0,1 mode: PW/PW res: [0x2b88c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.649822:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e3a7232/0x3234de053c51d6c lrc: 2/0,0 mode: PW/PW res: [0x2b88c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649824:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005267a56c/0x3234de053c51d65 lrc: 3/0,1 mode: PW/PW res: [0x2b88a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649827:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005267a56c/0x3234de053c51d65 lrc: 3/0,1 mode: PW/PW res: [0x2b88a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649838:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005267a56c/0x3234de053c51d65 lrc: 3/0,1 mode: PW/PW res: [0x2b88a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649841:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005267a56c/0x3234de053c51d65 lrc: 2/0,0 mode: PW/PW res: [0x2b88a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.649860:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1364:39029:x1731745946494272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 903us (994us total) trans 12885079921 rc 0/0 00000100:00100000:1.0:1651529344.649863:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211868 00010000:00010000:1.0:1651529344.649870:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b31b1dc0/0x3234de053c51d5e lrc: 3/0,1 mode: PW/PW res: [0x2b88b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.649874:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1363:39029:x1731745946494144:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 928us (1015us total) trans 12885079922 rc 0/0 00010000:00010000:1.0:1651529344.649876:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b31b1dc0/0x3234de053c51d5e lrc: 3/0,1 mode: PW/PW res: [0x2b88b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.649877:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211867 00010000:00010000:1.0:1651529344.649879:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b31b1dc0/0x3234de053c51d5e lrc: 3/0,1 mode: PW/PW res: [0x2b88b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.649881:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b31b1dc0/0x3234de053c51d5e lrc: 2/0,0 mode: PW/PW res: [0x2b88b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649884:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008564120b/0x3234de053c51d50 lrc: 2/0,0 mode: PW/PW res: [0x2b887:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649887:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008564120b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.649888:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008564120b/0x3234de053c51d50 lrc: 2/0,0 mode: PW/PW res: [0x2b887:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649892:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008564120b/0x3234de053c51d50 lrc: 3/0,0 mode: PW/PW res: [0x2b887:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649896:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008564120b/0x3234de053c51d50 lrc: 1/0,0 mode: --/PW res: [0x2b887:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649899:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008564120b/0x3234de053c51d50 lrc: 0/0,0 mode: --/PW res: [0x2b887:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649903:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000689e285e/0x3234de053c51d57 lrc: 2/0,0 mode: PW/PW res: [0x2b889:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649906:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000689e285e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.649907:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000689e285e/0x3234de053c51d57 lrc: 2/0,0 mode: PW/PW res: [0x2b889:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649909:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000689e285e/0x3234de053c51d57 lrc: 3/0,0 mode: PW/PW res: [0x2b889:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.649911:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1363:39030:x1731745946494208:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 999us (1060us total) trans 12885079923 rc 0/0 00010000:00010000:0.0:1651529344.649912:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000689e285e/0x3234de053c51d57 lrc: 1/0,0 mode: --/PW res: [0x2b889:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.649914:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211866 00010000:00010000:0.0:1651529344.649915:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000689e285e/0x3234de053c51d57 lrc: 0/0,0 mode: --/PW res: [0x2b889:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649918:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e3a7232/0x3234de053c51d6c lrc: 2/0,0 mode: PW/PW res: [0x2b88c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649923:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000e3a7232 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.649924:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e3a7232/0x3234de053c51d6c lrc: 2/0,0 mode: PW/PW res: [0x2b88c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649927:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e3a7232/0x3234de053c51d6c lrc: 3/0,0 mode: PW/PW res: [0x2b88c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649930:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e3a7232/0x3234de053c51d6c lrc: 1/0,0 mode: --/PW res: [0x2b88c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649932:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e3a7232/0x3234de053c51d6c lrc: 0/0,0 mode: --/PW res: [0x2b88c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649936:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005267a56c/0x3234de053c51d65 lrc: 2/0,0 mode: PW/PW res: [0x2b88a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649938:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005267a56c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.649939:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005267a56c/0x3234de053c51d65 lrc: 2/0,0 mode: PW/PW res: [0x2b88a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649941:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005267a56c/0x3234de053c51d65 lrc: 3/0,0 mode: PW/PW res: [0x2b88a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649944:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005267a56c/0x3234de053c51d65 lrc: 1/0,0 mode: --/PW res: [0x2b88a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649947:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005267a56c/0x3234de053c51d65 lrc: 0/0,0 mode: --/PW res: [0x2b88a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.649948:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.649950:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b31b1dc0/0x3234de053c51d5e lrc: 2/0,0 mode: PW/PW res: [0x2b88b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649953:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b31b1dc0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.649954:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b31b1dc0/0x3234de053c51d5e lrc: 2/0,0 mode: PW/PW res: [0x2b88b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649956:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b31b1dc0/0x3234de053c51d5e lrc: 3/0,0 mode: PW/PW res: [0x2b88b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.649959:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b31b1dc0/0x3234de053c51d5e lrc: 1/0,0 mode: --/PW res: [0x2b88b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.649962:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.649962:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b31b1dc0/0x3234de053c51d5e lrc: 0/0,0 mode: --/PW res: [0x2b88b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.649977:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.649979:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946494848 00000100:00100000:0.0:1651529344.649985:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946494912 00000100:00100000:0.0:1651529344.649992:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946494976 00000100:00100000:0.0:1651529344.649997:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211869 00000100:00100000:0.0:1651529344.649998:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1365:39030:x1731745946494848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.650003:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178317 count 1 00010000:00010000:0.0:1651529344.650007:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099354594/0x3234de053c51d73 lrc: 3/0,1 mode: --/PW res: [0x2b88d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.650011:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000921e9e0f/0x3234de053c4d6e7 lrc: 2/0,0 mode: PR/PR res: [0x2b88d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d67 expref: 696 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.650017:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.650017:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.650018:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099354594/0x3234de053c51d73 lrc: 4/0,1 mode: --/PW res: [0x2b88d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.650024:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000921e9e0f/0x3234de053c4d6e7 lrc: 3/0,0 mode: PR/PR res: [0x2b88d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d67 expref: 696 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.650028:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000921e9e0f/0x3234de053c4d6e7 lrc: 4/0,0 mode: PR/PR res: [0x2b88d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d67 expref: 696 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.650032:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000078f9a278 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997026368:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.650040:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211870 00000100:00100000:1.0:1651529344.650042:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1365:39030:x1731745946494912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.650047:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000000d706dff going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.650053:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178318 count 1 00000100:00100000:0.0:1651529344.650053:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211871 00000100:00100000:0.0:1651529344.650055:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1365:39030:x1731745946494976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.650057:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d6aea49/0x3234de053c51d7a lrc: 3/0,1 mode: --/PW res: [0x2b88e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650062:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a542168f/0x3234de053c4e056 lrc: 2/0,0 mode: PR/PR res: [0x2b88e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3235 expref: 696 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.650066:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.650066:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.650067:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d6aea49/0x3234de053c51d7a lrc: 4/0,1 mode: --/PW res: [0x2b88e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650074:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a542168f/0x3234de053c4e056 lrc: 3/0,0 mode: PR/PR res: [0x2b88e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3235 expref: 696 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.650077:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178319 count 1 00010000:00010000:1.0:1651529344.650078:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a542168f/0x3234de053c4e056 lrc: 4/0,0 mode: PR/PR res: [0x2b88e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3235 expref: 696 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.650081:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3ae24c2/0x3234de053c51d81 lrc: 3/0,1 mode: --/PW res: [0x2b88f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.650082:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005ea32140 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997026432:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.650086:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f8a7fbb1/0x3234de053c4c957 lrc: 2/0,0 mode: PR/PR res: [0x2b88f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd6d3 expref: 696 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.650089:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.650090:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 0000000020dd7827 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.650090:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.650090:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3ae24c2/0x3234de053c51d81 lrc: 4/0,1 mode: --/PW res: [0x2b88f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.650100:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f8a7fbb1/0x3234de053c4c957 lrc: 3/0,0 mode: PR/PR res: [0x2b88f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd6d3 expref: 696 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.650103:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f8a7fbb1/0x3234de053c4c957 lrc: 4/0,0 mode: PR/PR res: [0x2b88f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd6d3 expref: 696 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.650107:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014f8af45 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997026496:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.650115:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed830649 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.650208:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.650245:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.650255:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.650256:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946495168 00000100:00100000:0.0:1651529344.650263:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.650272:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.650275:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946495296 00000100:00100000:1.0:1651529344.650285:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946495424 00000100:00100000:1.0:1651529344.650292:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946495232 00000100:00100000:1.0:1651529344.650295:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946495360 00000100:00100000:1.0:1651529344.650298:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211872 00000100:00100000:1.0:1651529344.650300:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1370:39029:x1731745946495168:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.650305:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178320 count 1 00000100:00100000:0.0:1651529344.650306:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211873 00000100:00100000:0.0:1651529344.650308:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1370:39029:x1731745946495296:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.650309:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d288bfff/0x3234de053c51d88 lrc: 3/0,1 mode: --/PW res: [0x2b890:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650314:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e1d98a9c/0x3234de053c4f414 lrc: 2/0,0 mode: PR/PR res: [0x2b890:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d82ae expref: 696 pid: 72396 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.650314:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178322 count 1 00010000:00010000:1.0:1651529344.650317:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.650318:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.650318:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d288bfff/0x3234de053c51d88 lrc: 4/0,1 mode: --/PW res: [0x2b890:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.650319:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c51d8f lrc: 3/0,1 mode: --/PW res: [0x2b892:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.650323:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007dc159e9/0x3234de053c4df4c lrc: 2/0,0 mode: PR/PR res: [0x2b892:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e53 expref: 696 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.650326:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.650327:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e1d98a9c/0x3234de053c4f414 lrc: 3/0,0 mode: PR/PR res: [0x2b890:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d82ae expref: 696 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.650327:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.650328:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c51d8f lrc: 4/0,1 mode: --/PW res: [0x2b892:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650331:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e1d98a9c/0x3234de053c4f414 lrc: 4/0,0 mode: PR/PR res: [0x2b890:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d82ae expref: 696 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.650335:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dfc79d4e pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997026560:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.650337:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007dc159e9/0x3234de053c4df4c lrc: 3/0,0 mode: PR/PR res: [0x2b892:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e53 expref: 696 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.650341:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007dc159e9/0x3234de053c4df4c lrc: 4/0,0 mode: PR/PR res: [0x2b892:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e53 expref: 696 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.650345:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000065f5e47d pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997026624:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.650346:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fe434b1c going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.650352:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211874 00000100:00100000:0.0:1651529344.650353:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 0000000049203969 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.650354:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1370:39029:x1731745946495424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.650358:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178324 count 1 00000100:00100000:0.0:1651529344.650360:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211875 00010000:00010000:1.0:1651529344.650361:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000934ba032/0x3234de053c51d96 lrc: 3/0,1 mode: --/PW res: [0x2b894:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.650361:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1370:39029:x1731745946495232:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.650365:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b9d8a3ea/0x3234de053c4d9a3 lrc: 2/0,0 mode: PR/PR res: [0x2b894:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1700 expref: 696 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.650366:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178321 count 1 00010000:00010000:1.0:1651529344.650368:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.650369:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.650369:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000934ba032/0x3234de053c51d96 lrc: 4/0,1 mode: --/PW res: [0x2b894:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.650369:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7a2d4e3/0x3234de053c51d9d lrc: 3/0,1 mode: --/PW res: [0x2b891:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.650373:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006570db6c/0x3234de053c4cdbe lrc: 2/0,0 mode: PR/PR res: [0x2b891:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce8a0 expref: 696 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.650376:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b9d8a3ea/0x3234de053c4d9a3 lrc: 3/0,0 mode: PR/PR res: [0x2b894:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1700 expref: 696 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.650376:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.650377:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.650377:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7a2d4e3/0x3234de053c51d9d lrc: 4/0,1 mode: --/PW res: [0x2b891:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650380:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b9d8a3ea/0x3234de053c4d9a3 lrc: 4/0,0 mode: PR/PR res: [0x2b894:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1700 expref: 696 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.650383:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006570db6c/0x3234de053c4cdbe lrc: 3/0,0 mode: PR/PR res: [0x2b891:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce8a0 expref: 696 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.650384:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000088fa78f8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997026688:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.650387:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006570db6c/0x3234de053c4cdbe lrc: 4/0,0 mode: PR/PR res: [0x2b891:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce8a0 expref: 696 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.650390:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8a0b704 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.650401:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211876 00000100:00100000:1.0:1651529344.650403:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1370:39029:x1731745946495360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.650407:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178323 count 1 00010000:00010000:1.0:1651529344.650409:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d05ad66e/0x3234de053c51da4 lrc: 3/0,1 mode: --/PW res: [0x2b893:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650414:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000585e590e/0x3234de053c4eb31 lrc: 2/0,0 mode: PR/PR res: [0x2b893:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e65 expref: 696 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.650416:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003e8ef62e pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997026752:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.650417:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.650417:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.650418:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d05ad66e/0x3234de053c51da4 lrc: 4/0,1 mode: --/PW res: [0x2b893:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650424:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000585e590e/0x3234de053c4eb31 lrc: 3/0,0 mode: PR/PR res: [0x2b893:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e65 expref: 696 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.650425:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 0000000076b354b3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.650427:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000585e590e/0x3234de053c4eb31 lrc: 4/0,0 mode: PR/PR res: [0x2b893:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e65 expref: 696 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.650431:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004972eb27 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997026816:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.650437:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 000000004ca54b8a going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.650478:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000078f9a278 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997026368:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.650483:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000099354594/0x3234de053c51d73 lrc: 3/0,1 mode: --/PW res: [0x2b88d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.650502:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.650512:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005ea32140 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997026432:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.650517:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002d6aea49/0x3234de053c51d7a lrc: 3/0,1 mode: --/PW res: [0x2b88e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.650523:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.650531:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396376000 00010000:00010000:1.0:1651529344.650536:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000921e9e0f/0x3234de053c4d6e7 lrc: 4/0,0 mode: PR/PR res: [0x2b88d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d67 expref: 697 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.650536:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.650547:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014f8af45 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997026496:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.650548:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396376064 00010000:00010000:1.0:1651529344.650551:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a542168f/0x3234de053c4e056 lrc: 4/0,0 mode: PR/PR res: [0x2b88e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3235 expref: 698 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.650555:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396376128 00010000:00010000:1.0:1651529344.650558:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f8a7fbb1/0x3234de053c4c957 lrc: 4/0,0 mode: PR/PR res: [0x2b88f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd6d3 expref: 699 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.650562:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12651 00000100:00100000:1.0:1651529344.650564:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+699:41278:x1731746396376000:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.650566:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.650566:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a3ae24c2/0x3234de053c51d81 lrc: 3/0,1 mode: --/PW res: [0x2b88f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650567:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000921e9e0f/0x3234de053c4d6e7 lrc: 4/0,0 mode: PR/PR res: [0x2b88d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d67 expref: 699 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.650571:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000921e9e0f/0x3234de053c4d6e7 lrc: 3/0,0 mode: PR/PR res: [0x2b88d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d67 expref: 699 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.650575:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12652 00010000:00010000:1.0:1651529344.650577:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000921e9e0f/0x3234de053c4d6e7 lrc: 0/0,0 mode: --/PR res: [0x2b88d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d67 expref: 699 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.650577:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1fb0a67 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+699:41279:x1731746396376064:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.650580:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.650582:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a542168f/0x3234de053c4e056 lrc: 4/0,0 mode: PR/PR res: [0x2b88e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3235 expref: 699 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.650583:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.650584:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.650585:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000099354594/0x3234de053c51d73 lrc: 3/0,1 mode: PW/PW res: [0x2b88d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.650586:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a542168f/0x3234de053c4e056 lrc: 3/0,0 mode: PR/PR res: [0x2b88e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3235 expref: 698 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.650588:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099354594/0x3234de053c51d73 lrc: 4/0,1 mode: PW/PW res: [0x2b88d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.650592:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a542168f/0x3234de053c4e056 lrc: 0/0,0 mode: --/PR res: [0x2b88e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3235 expref: 698 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.650597:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.650602:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.650603:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.650604:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002d6aea49/0x3234de053c51d7a lrc: 3/0,1 mode: PW/PW res: [0x2b88e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.650607:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+697:41278:x1731746396376000:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 43us (105us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.650607:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d6aea49/0x3234de053c51d7a lrc: 4/0,1 mode: PW/PW res: [0x2b88e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.650610:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12651 00010000:00010000:0.0:1651529344.650616:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.650622:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12653 00000100:00100000:1.0:1651529344.650624:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+696:41278:x1731746396376128:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.650624:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1fb0a67 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+696:41279:x1731746396376064:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 46us (101us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.650626:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.650626:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12652 00010000:00010000:1.0:1651529344.650628:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f8a7fbb1/0x3234de053c4c957 lrc: 4/0,0 mode: PR/PR res: [0x2b88f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd6d3 expref: 696 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.650632:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f8a7fbb1/0x3234de053c4c957 lrc: 3/0,0 mode: PR/PR res: [0x2b88f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd6d3 expref: 695 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.650637:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8a7fbb1/0x3234de053c4c957 lrc: 0/0,0 mode: --/PR res: [0x2b88f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd6d3 expref: 695 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.650638:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000099354594/0x3234de053c51d73 lrc: 3/0,1 mode: PW/PW res: [0x2b88d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650640:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.650641:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.650642:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a3ae24c2/0x3234de053c51d81 lrc: 3/0,1 mode: PW/PW res: [0x2b88f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.650642:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099354594/0x3234de053c51d73 lrc: 3/0,1 mode: PW/PW res: [0x2b88d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650645:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3ae24c2/0x3234de053c51d81 lrc: 4/0,1 mode: PW/PW res: [0x2b88f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.650645:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099354594/0x3234de053c51d73 lrc: 3/0,1 mode: PW/PW res: [0x2b88d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.650647:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099354594/0x3234de053c51d73 lrc: 2/0,0 mode: PW/PW res: [0x2b88d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650654:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.650659:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+694:41278:x1731746396376128:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.650662:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12653 00010000:00010000:1.0:1651529344.650670:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002d6aea49/0x3234de053c51d7a lrc: 3/0,1 mode: PW/PW res: [0x2b88e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650673:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d6aea49/0x3234de053c51d7a lrc: 3/0,1 mode: PW/PW res: [0x2b88e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650676:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d6aea49/0x3234de053c51d7a lrc: 3/0,1 mode: PW/PW res: [0x2b88e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650679:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d6aea49/0x3234de053c51d7a lrc: 2/0,0 mode: PW/PW res: [0x2b88e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.650701:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1372:39030:x1731745946494848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 702us (753us total) trans 12885079924 rc 0/0 00000100:00100000:0.0:1651529344.650704:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211869 00010000:00010000:0.0:1651529344.650711:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099354594/0x3234de053c51d73 lrc: 2/0,0 mode: PW/PW res: [0x2b88d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.650715:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000099354594 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.650716:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099354594/0x3234de053c51d73 lrc: 2/0,0 mode: PW/PW res: [0x2b88d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.650719:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099354594/0x3234de053c51d73 lrc: 3/0,0 mode: PW/PW res: [0x2b88d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.650721:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1371:39030:x1731745946494912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 679us (759us total) trans 12885079925 rc 0/0 00010000:00010000:0.0:1651529344.650723:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099354594/0x3234de053c51d73 lrc: 1/0,0 mode: --/PW res: [0x2b88d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.650724:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211870 00010000:00010000:0.0:1651529344.650726:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099354594/0x3234de053c51d73 lrc: 0/0,0 mode: --/PW res: [0x2b88d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.650730:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d6aea49/0x3234de053c51d7a lrc: 2/0,0 mode: PW/PW res: [0x2b88e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.650733:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002d6aea49 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.650744:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d6aea49/0x3234de053c51d7a lrc: 2/0,0 mode: PW/PW res: [0x2b88e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.650747:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d6aea49/0x3234de053c51d7a lrc: 3/0,0 mode: PW/PW res: [0x2b88e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.650751:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d6aea49/0x3234de053c51d7a lrc: 1/0,0 mode: --/PW res: [0x2b88e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.650756:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d6aea49/0x3234de053c51d7a lrc: 0/0,0 mode: --/PW res: [0x2b88e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.650762:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a3ae24c2/0x3234de053c51d81 lrc: 3/0,1 mode: PW/PW res: [0x2b88f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.650764:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3ae24c2/0x3234de053c51d81 lrc: 3/0,1 mode: PW/PW res: [0x2b88f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.650768:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3ae24c2/0x3234de053c51d81 lrc: 3/0,1 mode: PW/PW res: [0x2b88f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.650770:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3ae24c2/0x3234de053c51d81 lrc: 2/0,0 mode: PW/PW res: [0x2b88f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.650827:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1371:39030:x1731745946494976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 771us (849us total) trans 12885079926 rc 0/0 00000100:00100000:0.0:1651529344.650830:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211871 00010000:00010000:0.0:1651529344.650837:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3ae24c2/0x3234de053c51d81 lrc: 2/0,0 mode: PW/PW res: [0x2b88f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.650840:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a3ae24c2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.650841:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3ae24c2/0x3234de053c51d81 lrc: 2/0,0 mode: PW/PW res: [0x2b88f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.650844:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3ae24c2/0x3234de053c51d81 lrc: 3/0,0 mode: PW/PW res: [0x2b88f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.650855:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.650864:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3ae24c2/0x3234de053c51d81 lrc: 1/0,0 mode: --/PW res: [0x2b88f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.650884:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3ae24c2/0x3234de053c51d81 lrc: 0/0,0 mode: --/PW res: [0x2b88f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.650896:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.650896:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000065f5e47d pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997026624:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.650912:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.650927:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dfc79d4e pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997026560:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.650928:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c51d8f lrc: 3/0,1 mode: --/PW res: [0x2b892:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650932:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d288bfff/0x3234de053c51d88 lrc: 3/0,1 mode: --/PW res: [0x2b890:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.650937:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003e8ef62e pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997026752:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.650939:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396376320 00010000:00010000:0.0:1651529344.650940:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e7a2d4e3/0x3234de053c51d9d lrc: 3/0,1 mode: --/PW res: [0x2b891:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650944:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e1d98a9c/0x3234de053c4f414 lrc: 4/0,0 mode: PR/PR res: [0x2b890:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d82ae expref: 694 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.650945:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946495872 00000100:00100000:1.0:1651529344.650951:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12654 00000100:00100000:0.0:1651529344.650952:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946495808 00000100:00100000:1.0:1651529344.650953:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+694:41279:x1731746396376320:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.650955:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.650959:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211877 00000100:00100000:0.0:1651529344.650961:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1372:39030:x1731745946495872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.650962:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e1d98a9c/0x3234de053c4f414 lrc: 4/0,0 mode: PR/PR res: [0x2b890:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d82ae expref: 694 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.650966:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e1d98a9c/0x3234de053c4f414 lrc: 3/0,0 mode: PR/PR res: [0x2b890:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d82ae expref: 694 pid: 72396 timeout: 20103 lvb_type: 1 00002000:00080000:0.0:1651529344.650966:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178326 count 1 00010000:00010000:0.0:1651529344.650970:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c51dab lrc: 3/0,1 mode: --/PW res: [0x2b896:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650972:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1d98a9c/0x3234de053c4f414 lrc: 0/0,0 mode: --/PR res: [0x2b890:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d82ae expref: 694 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.650974:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a7fc8d7d/0x3234de053c4d447 lrc: 2/0,0 mode: PR/PR res: [0x2b896:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d02e0 expref: 694 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.650975:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.650976:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.650977:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d288bfff/0x3234de053c51d88 lrc: 3/0,1 mode: PW/PW res: [0x2b890:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650980:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d288bfff/0x3234de053c51d88 lrc: 4/0,1 mode: PW/PW res: [0x2b890:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.650980:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.650980:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.650981:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c51dab lrc: 4/0,1 mode: --/PW res: [0x2b896:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.650988:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.650995:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+693:41279:x1731746396376320:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.650998:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12654 00000100:00100000:1.0:1651529344.651006:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000088fa78f8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997026688:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.651013:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a7fc8d7d/0x3234de053c4d447 lrc: 3/0,0 mode: PR/PR res: [0x2b896:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d02e0 expref: 692 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.651017:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a7fc8d7d/0x3234de053c4d447 lrc: 4/0,0 mode: PR/PR res: [0x2b896:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d02e0 expref: 692 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.651019:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000934ba032/0x3234de053c51d96 lrc: 3/0,1 mode: --/PW res: [0x2b894:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.651021:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003e8ef62e pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997026880:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.651026:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d288bfff/0x3234de053c51d88 lrc: 3/0,1 mode: PW/PW res: [0x2b890:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651029:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d288bfff/0x3234de053c51d88 lrc: 3/0,1 mode: PW/PW res: [0x2b890:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.651030:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c2b2b59c going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.651032:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d288bfff/0x3234de053c51d88 lrc: 3/0,1 mode: PW/PW res: [0x2b890:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651035:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d288bfff/0x3234de053c51d88 lrc: 2/0,0 mode: PW/PW res: [0x2b890:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.651037:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211878 00000100:00100000:0.0:1651529344.651039:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1372:39029:x1731745946495808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.651050:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178325 count 1 00010000:00010000:0.0:1651529344.651054:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c51db2 lrc: 3/0,1 mode: --/PW res: [0x2b895:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.651058:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000052977309/0x3234de053c4beb4 lrc: 2/0,0 mode: PR/PR res: [0x2b895:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6cd expref: 692 pid: 80278 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.651061:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.651062:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.651062:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c51db2 lrc: 4/0,1 mode: --/PW res: [0x2b895:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.651070:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000052977309/0x3234de053c4beb4 lrc: 3/0,0 mode: PR/PR res: [0x2b895:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6cd expref: 692 pid: 80278 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.651074:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000052977309/0x3234de053c4beb4 lrc: 4/0,0 mode: PR/PR res: [0x2b895:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6cd expref: 692 pid: 80278 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.651077:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1373:39029:x1731745946495168:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 776us (880us total) trans 12885079927 rc 0/0 00000100:00100000:1.0:1651529344.651080:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211872 00000100:00100000:0.0:1651529344.651090:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009acffcb8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997026944:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.651099:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b81e4a0 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.651104:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d288bfff/0x3234de053c51d88 lrc: 2/0,0 mode: PW/PW res: [0x2b890:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.651107:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d288bfff already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.651108:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d288bfff/0x3234de053c51d88 lrc: 2/0,0 mode: PW/PW res: [0x2b890:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.651111:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d288bfff/0x3234de053c51d88 lrc: 3/0,0 mode: PW/PW res: [0x2b890:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.651115:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d288bfff/0x3234de053c51d88 lrc: 1/0,0 mode: --/PW res: [0x2b890:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.651118:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d288bfff/0x3234de053c51d88 lrc: 0/0,0 mode: --/PW res: [0x2b890:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.651129:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.651132:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.651159:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004972eb27 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997026816:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.651177:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d05ad66e/0x3234de053c51da4 lrc: 3/0,1 mode: --/PW res: [0x2b893:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.651184:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946495936 00000100:00100000:1.0:1651529344.651191:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211879 00000100:00100000:1.0:1651529344.651193:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1373:39029:x1731745946495936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.651198:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178327 count 1 00010000:00010000:1.0:1651529344.651202:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f926d75/0x3234de053c51db9 lrc: 3/0,1 mode: --/PW res: [0x2b897:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651206:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003319354a/0x3234de053c4c774 lrc: 2/0,0 mode: PR/PR res: [0x2b897:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd012 expref: 692 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.651209:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.651210:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.651211:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f926d75/0x3234de053c51db9 lrc: 4/0,1 mode: --/PW res: [0x2b897:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651217:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003319354a/0x3234de053c4c774 lrc: 3/0,0 mode: PR/PR res: [0x2b897:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd012 expref: 692 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.651220:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003319354a/0x3234de053c4c774 lrc: 4/0,0 mode: PR/PR res: [0x2b897:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd012 expref: 692 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.651240:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004972eb27 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997027008:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.651254:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd96f074 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.651260:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396376576 00010000:00010000:1.0:1651529344.651265:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006570db6c/0x3234de053c4cdbe lrc: 4/0,0 mode: PR/PR res: [0x2b891:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce8a0 expref: 693 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.651272:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12655 00000100:00100000:1.0:1651529344.651274:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+693:41279:x1731746396376576:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.651276:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.651278:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006570db6c/0x3234de053c4cdbe lrc: 4/0,0 mode: PR/PR res: [0x2b891:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce8a0 expref: 693 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.651281:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006570db6c/0x3234de053c4cdbe lrc: 3/0,0 mode: PR/PR res: [0x2b891:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce8a0 expref: 693 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.651287:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006570db6c/0x3234de053c4cdbe lrc: 0/0,0 mode: --/PR res: [0x2b891:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce8a0 expref: 693 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.651296:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.651299:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.651299:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.651305:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e7a2d4e3/0x3234de053c51d9d lrc: 3/0,1 mode: PW/PW res: [0x2b891:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651308:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7a2d4e3/0x3234de053c51d9d lrc: 4/0,1 mode: PW/PW res: [0x2b891:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651317:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.651321:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e7a2d4e3/0x3234de053c51d9d lrc: 3/0,1 mode: PW/PW res: [0x2b891:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.651327:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+692:41279:x1731746396376576:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 52us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.651329:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12655 00000100:00100000:1.0:1651529344.651337:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946496064 00010000:00010000:0.0:1651529344.651341:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7a2d4e3/0x3234de053c51d9d lrc: 3/0,1 mode: PW/PW res: [0x2b891:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.651343:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211880 00000100:00100000:1.0:1651529344.651344:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1374:39030:x1731745946496064:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.651345:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7a2d4e3/0x3234de053c51d9d lrc: 3/0,1 mode: PW/PW res: [0x2b891:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.651348:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7a2d4e3/0x3234de053c51d9d lrc: 2/0,0 mode: PW/PW res: [0x2b891:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.651349:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178328 count 1 00010000:00010000:1.0:1651529344.651353:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f0edbda/0x3234de053c51dc0 lrc: 3/0,1 mode: --/PW res: [0x2b898:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651357:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee811cd0/0x3234de053c4d845 lrc: 2/0,0 mode: PR/PR res: [0x2b898:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1206 expref: 691 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.651360:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.651361:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.651361:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f0edbda/0x3234de053c51dc0 lrc: 4/0,1 mode: --/PW res: [0x2b898:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651367:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ee811cd0/0x3234de053c4d845 lrc: 3/0,0 mode: PR/PR res: [0x2b898:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1206 expref: 691 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.651371:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ee811cd0/0x3234de053c4d845 lrc: 4/0,0 mode: PR/PR res: [0x2b898:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1206 expref: 691 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.651375:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dfc79d4e pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997027072:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.651382:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fe434b1c going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.651399:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.651402:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1375:39029:x1731745946495232:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1040us (1139us total) trans 12885079928 rc 0/0 00000100:00100000:0.0:1651529344.651405:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211875 00000100:00100000:1.0:1651529344.651412:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.651413:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7a2d4e3/0x3234de053c51d9d lrc: 2/0,0 mode: PW/PW res: [0x2b891:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.651416:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e7a2d4e3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.651417:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7a2d4e3/0x3234de053c51d9d lrc: 2/0,0 mode: PW/PW res: [0x2b891:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.651420:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7a2d4e3/0x3234de053c51d9d lrc: 3/0,0 mode: PW/PW res: [0x2b891:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.651425:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7a2d4e3/0x3234de053c51d9d lrc: 1/0,0 mode: --/PW res: [0x2b891:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.651430:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7a2d4e3/0x3234de053c51d9d lrc: 0/0,0 mode: --/PW res: [0x2b891:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.651445:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396376384 00010000:00010000:1.0:1651529344.651450:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007dc159e9/0x3234de053c4df4c lrc: 4/0,0 mode: PR/PR res: [0x2b892:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e53 expref: 692 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.651472:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396376512 00010000:00010000:1.0:1651529344.651475:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b9d8a3ea/0x3234de053c4d9a3 lrc: 4/0,0 mode: PR/PR res: [0x2b894:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1700 expref: 693 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.651484:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12656 00000100:00100000:1.0:1651529344.651486:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007fca8239 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+693:41278:x1731746396376384:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.651488:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.651488:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12657 00010000:00010000:1.0:1651529344.651490:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007dc159e9/0x3234de053c4df4c lrc: 4/0,0 mode: PR/PR res: [0x2b892:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e53 expref: 693 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.651490:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005914c920 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+693:41278:x1731746396376512:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.651494:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007dc159e9/0x3234de053c4df4c lrc: 3/0,0 mode: PR/PR res: [0x2b892:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e53 expref: 693 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.651494:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.651496:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b9d8a3ea/0x3234de053c4d9a3 lrc: 4/0,0 mode: PR/PR res: [0x2b894:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1700 expref: 693 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.651499:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007dc159e9/0x3234de053c4df4c lrc: 0/0,0 mode: --/PR res: [0x2b892:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e53 expref: 693 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.651500:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b9d8a3ea/0x3234de053c4d9a3 lrc: 3/0,0 mode: PR/PR res: [0x2b894:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1700 expref: 693 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.651503:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.651503:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.651504:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c51d8f lrc: 3/0,1 mode: PW/PW res: [0x2b892:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.651506:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9d8a3ea/0x3234de053c4d9a3 lrc: 0/0,0 mode: --/PR res: [0x2b894:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1700 expref: 692 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.651507:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c51d8f lrc: 4/0,1 mode: PW/PW res: [0x2b892:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.651509:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.651510:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.651511:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000934ba032/0x3234de053c51d96 lrc: 3/0,1 mode: PW/PW res: [0x2b894:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651515:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.651520:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000934ba032/0x3234de053c51d96 lrc: 4/0,1 mode: PW/PW res: [0x2b894:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.651525:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007fca8239 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+691:41278:x1731746396376384:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 39us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.651528:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12656 00010000:00010000:0.0:1651529344.651533:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.651541:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005914c920 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+690:41278:x1731746396376512:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 50us (129us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.651542:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000934ba032/0x3234de053c51d96 lrc: 3/0,1 mode: PW/PW res: [0x2b894:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651545:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000934ba032/0x3234de053c51d96 lrc: 3/0,1 mode: PW/PW res: [0x2b894:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.651545:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12657 00010000:00010000:1.0:1651529344.651548:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000934ba032/0x3234de053c51d96 lrc: 3/0,1 mode: PW/PW res: [0x2b894:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651551:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000934ba032/0x3234de053c51d96 lrc: 2/0,0 mode: PW/PW res: [0x2b894:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.651577:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c51d8f lrc: 3/0,1 mode: PW/PW res: [0x2b892:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.651580:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c51d8f lrc: 3/0,1 mode: PW/PW res: [0x2b892:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.651584:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c51d8f lrc: 3/0,1 mode: PW/PW res: [0x2b892:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.651586:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c51d8f lrc: 2/0,0 mode: PW/PW res: [0x2b892:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.651594:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1375:39029:x1731745946495424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1239us (1339us total) trans 12885079929 rc 0/0 00000100:00100000:1.0:1651529344.651597:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211874 00000100:00100000:1.0:1651529344.651620:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.651625:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1375:39029:x1731745946495296:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1316us (1380us total) trans 12885079930 rc 0/0 00000100:00100000:0.0:1651529344.651628:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211873 00010000:00010000:0.0:1651529344.651635:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000934ba032/0x3234de053c51d96 lrc: 2/0,0 mode: PW/PW res: [0x2b894:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.651639:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000934ba032 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.651640:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000934ba032/0x3234de053c51d96 lrc: 2/0,0 mode: PW/PW res: [0x2b894:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.651643:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000934ba032/0x3234de053c51d96 lrc: 3/0,0 mode: PW/PW res: [0x2b894:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.651644:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.651647:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000934ba032/0x3234de053c51d96 lrc: 1/0,0 mode: --/PW res: [0x2b894:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.651674:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000934ba032/0x3234de053c51d96 lrc: 0/0,0 mode: --/PW res: [0x2b894:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.651679:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c51d8f lrc: 2/0,0 mode: PW/PW res: [0x2b892:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.651681:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d3d72adb already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.651682:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c51d8f lrc: 2/0,0 mode: PW/PW res: [0x2b892:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.651685:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c51d8f lrc: 3/0,0 mode: PW/PW res: [0x2b892:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.651689:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c51d8f lrc: 1/0,0 mode: --/PW res: [0x2b892:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.651691:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c51d8f lrc: 0/0,0 mode: --/PW res: [0x2b892:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.651700:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946496128 00000100:00100000:1.0:1651529344.651710:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.651719:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211881 00000100:00100000:0.0:1651529344.651721:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1375:39030:x1731745946496128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.651726:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178329 count 1 00000100:00100000:1.0:1651529344.651730:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.651730:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c51dc7 lrc: 3/0,1 mode: --/PW res: [0x2b899:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.651746:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.651746:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4f349 lrc: 2/0,0 mode: PR/PR res: [0x2b899:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7feb expref: 689 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.651749:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.651750:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.651750:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c51dc7 lrc: 4/0,1 mode: --/PW res: [0x2b899:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.651757:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4f349 lrc: 3/0,0 mode: PR/PR res: [0x2b899:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7feb expref: 689 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.651758:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.651761:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4f349 lrc: 4/0,0 mode: PR/PR res: [0x2b899:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7feb expref: 689 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.651763:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396376640 00000100:00100000:0.0:1651529344.651765:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000065f5e47d pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997027136:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.651769:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000585e590e/0x3234de053c4eb31 lrc: 4/0,0 mode: PR/PR res: [0x2b893:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e65 expref: 690 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.651775:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396377024 00010000:00010000:1.0:1651529344.651777:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a7fc8d7d/0x3234de053c4d447 lrc: 5/0,0 mode: PR/PR res: [0x2b896:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d02e0 expref: 691 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.651779:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 000000000d706dff going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.651788:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396377088 00000100:00100000:0.0:1651529344.651788:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009acffcb8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997026944:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.651791:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000052977309/0x3234de053c4beb4 lrc: 4/0,0 mode: PR/PR res: [0x2b895:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6cd expref: 692 pid: 80278 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.651791:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c51db2 lrc: 3/0,1 mode: --/PW res: [0x2b895:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.651795:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396377152 00010000:00010000:1.0:1651529344.651797:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003319354a/0x3234de053c4c774 lrc: 5/0,0 mode: PR/PR res: [0x2b897:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd012 expref: 693 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.651798:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003e8ef62e pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997026880:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.651800:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c51dab lrc: 3/0,1 mode: --/PW res: [0x2b896:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.651801:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396377216 00010000:00010000:1.0:1651529344.651803:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ee811cd0/0x3234de053c4d845 lrc: 5/0,0 mode: PR/PR res: [0x2b898:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1206 expref: 694 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.651807:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12658 00000100:00100000:1.0:1651529344.651809:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ea32140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+694:41278:x1731746396376640:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.651812:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.651813:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000585e590e/0x3234de053c4eb31 lrc: 4/0,0 mode: PR/PR res: [0x2b893:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e65 expref: 694 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.651817:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000585e590e/0x3234de053c4eb31 lrc: 3/0,0 mode: PR/PR res: [0x2b893:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e65 expref: 694 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.651822:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000585e590e/0x3234de053c4eb31 lrc: 0/0,0 mode: --/PR res: [0x2b893:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e65 expref: 694 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.651835:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.651836:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.651837:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d05ad66e/0x3234de053c51da4 lrc: 3/0,1 mode: PW/PW res: [0x2b893:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651840:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d05ad66e/0x3234de053c51da4 lrc: 4/0,1 mode: PW/PW res: [0x2b893:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651847:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.651847:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12659 00000100:00100000:0.0:1651529344.651849:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000515bc9a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+693:41278:x1731746396377024:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.651853:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.651854:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ea32140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+693:41278:x1731746396376640:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 44us (234us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.651855:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a7fc8d7d/0x3234de053c4d447 lrc: 4/0,0 mode: PR/PR res: [0x2b896:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d02e0 expref: 693 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.651856:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12658 00010000:00010000:0.0:1651529344.651859:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a7fc8d7d/0x3234de053c4d447 lrc: 3/0,0 mode: PR/PR res: [0x2b896:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d02e0 expref: 692 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.651861:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12660 00000100:00100000:1.0:1651529344.651863:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+692:41278:x1731746396377088:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.651864:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7fc8d7d/0x3234de053c4d447 lrc: 0/0,0 mode: --/PR res: [0x2b896:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d02e0 expref: 692 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.651865:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.651867:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000052977309/0x3234de053c4beb4 lrc: 4/0,0 mode: PR/PR res: [0x2b895:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6cd expref: 692 pid: 80278 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.651868:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.651868:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.651869:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c51dab lrc: 3/0,1 mode: PW/PW res: [0x2b896:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651871:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000052977309/0x3234de053c4beb4 lrc: 3/0,0 mode: PR/PR res: [0x2b895:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6cd expref: 691 pid: 80278 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.651875:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052977309/0x3234de053c4beb4 lrc: 0/0,0 mode: --/PR res: [0x2b895:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc6cd expref: 691 pid: 80278 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.651879:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.651879:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.651880:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c51db2 lrc: 3/0,1 mode: PW/PW res: [0x2b895:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651885:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c51db2 lrc: 4/0,1 mode: PW/PW res: [0x2b895:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.651885:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c51dab lrc: 4/0,1 mode: PW/PW res: [0x2b896:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.651892:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.651895:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.651900:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+690:41278:x1731746396377088:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.651902:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12660 00000100:00100000:0.0:1651529344.651904:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000515bc9a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+690:41278:x1731746396377024:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 55us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.651907:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12661 00000100:00100000:1.0:1651529344.651908:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+689:41278:x1731746396377152:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.651908:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12659 00010000:00010000:1.0:1651529344.651910:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.651912:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003319354a/0x3234de053c4c774 lrc: 5/0,0 mode: PR/PR res: [0x2b897:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd012 expref: 688 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.651915:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003319354a/0x3234de053c4c774 lrc: 4/0,0 mode: PR/PR res: [0x2b897:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd012 expref: 688 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.651918:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12662 00010000:00010000:1.0:1651529344.651919:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.651920:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.651920:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+688:41278:x1731746396377216:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.651921:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006f926d75/0x3234de053c51db9 lrc: 3/0,1 mode: PW/PW res: [0x2b897:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.651923:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.651924:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f926d75/0x3234de053c51db9 lrc: 4/0,1 mode: PW/PW res: [0x2b897:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.651924:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ee811cd0/0x3234de053c4d845 lrc: 5/0,0 mode: PR/PR res: [0x2b898:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1206 expref: 688 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.651928:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.651932:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+688:41278:x1731746396377152:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 23us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.651935:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12661 00010000:00010000:0.0:1651529344.651940:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ee811cd0/0x3234de053c4d845 lrc: 4/0,0 mode: PR/PR res: [0x2b898:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1206 expref: 687 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.651945:0:106695:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003319354a/0x3234de053c4c774 lrc: 0/0,0 mode: --/PR res: [0x2b897:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd012 expref: 687 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.651946:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.651947:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.651947:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006f0edbda/0x3234de053c51dc0 lrc: 3/0,1 mode: PW/PW res: [0x2b898:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.651949:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004972eb27 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997027008:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.651950:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f0edbda/0x3234de053c51dc0 lrc: 4/0,1 mode: PW/PW res: [0x2b898:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651952:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006f926d75/0x3234de053c51db9 lrc: 3/0,1 mode: PW/PW res: [0x2b897:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651955:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006f926d75/0x3234de053c51db9 lrc: 3/0,1 mode: PW/PW res: [0x2b897:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.651955:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.651958:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f926d75/0x3234de053c51db9 lrc: 3/0,1 mode: PW/PW res: [0x2b897:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.651961:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f926d75/0x3234de053c51db9 lrc: 3/0,1 mode: PW/PW res: [0x2b897:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.651961:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+686:41278:x1731746396377216:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.651963:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12662 00010000:00010000:1.0:1651529344.651964:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f926d75/0x3234de053c51db9 lrc: 2/0,0 mode: PW/PW res: [0x2b897:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.651978:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c51dab lrc: 3/0,1 mode: PW/PW res: [0x2b896:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.651982:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c51dab lrc: 3/0,1 mode: PW/PW res: [0x2b896:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.651985:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c51dab lrc: 3/0,1 mode: PW/PW res: [0x2b896:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.651998:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c51dab lrc: 2/0,0 mode: PW/PW res: [0x2b896:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.652005:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1376:39029:x1731745946495936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 811us (876us total) trans 12885079931 rc 0/0 00000100:00100000:1.0:1651529344.652008:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211879 00010000:00010000:1.0:1651529344.652019:0:72397:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee811cd0/0x3234de053c4d845 lrc: 0/0,0 mode: --/PR res: [0x2b898:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1206 expref: 685 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.652025:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dfc79d4e pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997027072:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.652029:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006f0edbda/0x3234de053c51dc0 lrc: 3/0,1 mode: PW/PW res: [0x2b898:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.652032:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006f0edbda/0x3234de053c51dc0 lrc: 3/0,1 mode: PW/PW res: [0x2b898:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.652035:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f0edbda/0x3234de053c51dc0 lrc: 3/0,1 mode: PW/PW res: [0x2b898:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.652038:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f0edbda/0x3234de053c51dc0 lrc: 3/0,1 mode: PW/PW res: [0x2b898:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.652040:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f0edbda/0x3234de053c51dc0 lrc: 2/0,0 mode: PW/PW res: [0x2b898:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.652040:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1376:39030:x1731745946495872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1078us (1144us total) trans 12885079932 rc 0/0 00000100:00100000:0.0:1651529344.652043:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211877 00010000:00010000:0.0:1651529344.652058:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f926d75/0x3234de053c51db9 lrc: 2/0,0 mode: PW/PW res: [0x2b897:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652061:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006f926d75 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.652062:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f926d75/0x3234de053c51db9 lrc: 2/0,0 mode: PW/PW res: [0x2b897:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652065:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f926d75/0x3234de053c51db9 lrc: 3/0,0 mode: PW/PW res: [0x2b897:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652070:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f926d75/0x3234de053c51db9 lrc: 1/0,0 mode: --/PW res: [0x2b897:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652073:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f926d75/0x3234de053c51db9 lrc: 0/0,0 mode: --/PW res: [0x2b897:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652077:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c51dab lrc: 2/0,0 mode: PW/PW res: [0x2b896:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.652079:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1376:39030:x1731745946496064:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 734us (783us total) trans 12885079933 rc 0/0 00010000:00010000:0.0:1651529344.652080:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008288bff7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.652081:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c51dab lrc: 2/0,0 mode: PW/PW res: [0x2b896:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.652082:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211880 00010000:00010000:0.0:1651529344.652086:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c51dab lrc: 3/0,0 mode: PW/PW res: [0x2b896:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.652089:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d05ad66e/0x3234de053c51da4 lrc: 3/0,1 mode: PW/PW res: [0x2b893:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652089:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c51dab lrc: 1/0,0 mode: --/PW res: [0x2b896:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652091:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c51dab lrc: 0/0,0 mode: --/PW res: [0x2b896:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.652092:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d05ad66e/0x3234de053c51da4 lrc: 3/0,1 mode: PW/PW res: [0x2b893:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652095:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f0edbda/0x3234de053c51dc0 lrc: 2/0,0 mode: PW/PW res: [0x2b898:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.652097:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d05ad66e/0x3234de053c51da4 lrc: 3/0,1 mode: PW/PW res: [0x2b893:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652097:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006f0edbda already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.652098:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f0edbda/0x3234de053c51dc0 lrc: 2/0,0 mode: PW/PW res: [0x2b898:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.652100:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d05ad66e/0x3234de053c51da4 lrc: 2/0,0 mode: PW/PW res: [0x2b893:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652101:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f0edbda/0x3234de053c51dc0 lrc: 3/0,0 mode: PW/PW res: [0x2b898:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652104:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f0edbda/0x3234de053c51dc0 lrc: 1/0,0 mode: --/PW res: [0x2b898:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652106:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f0edbda/0x3234de053c51dc0 lrc: 0/0,0 mode: --/PW res: [0x2b898:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652110:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d05ad66e/0x3234de053c51da4 lrc: 2/0,0 mode: PW/PW res: [0x2b893:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652114:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d05ad66e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.652115:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d05ad66e/0x3234de053c51da4 lrc: 2/0,0 mode: PW/PW res: [0x2b893:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652118:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d05ad66e/0x3234de053c51da4 lrc: 3/0,0 mode: PW/PW res: [0x2b893:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652121:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d05ad66e/0x3234de053c51da4 lrc: 1/0,0 mode: --/PW res: [0x2b893:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652124:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d05ad66e/0x3234de053c51da4 lrc: 0/0,0 mode: --/PW res: [0x2b893:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652129:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c51db2 lrc: 3/0,1 mode: PW/PW res: [0x2b895:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.652131:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1376:39029:x1731745946495360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1728us (1859us total) trans 12885079934 rc 0/0 00010000:00010000:0.0:1651529344.652132:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c51db2 lrc: 3/0,1 mode: PW/PW res: [0x2b895:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.652134:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211876 00010000:00010000:0.0:1651529344.652135:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c51db2 lrc: 3/0,1 mode: PW/PW res: [0x2b895:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652138:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c51db2 lrc: 2/0,0 mode: PW/PW res: [0x2b895:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.652149:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.652176:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.652180:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1376:39029:x1731745946495808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1141us (1268us total) trans 12885079935 rc 0/0 00000100:00100000:0.0:1651529344.652183:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211878 00000100:00100000:0.0:1651529344.652189:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946496256 00000100:00100000:0.0:1651529344.652194:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946496192 00000100:00100000:1.0:1651529344.652196:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.652202:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211882 00000100:00100000:0.0:1651529344.652204:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1377:39030:x1731745946496256:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.652209:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178331 count 1 00010000:00010000:0.0:1651529344.652213:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000511d4b7b/0x3234de053c51dce lrc: 3/0,1 mode: --/PW res: [0x2b89b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652217:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000069d8a5d4/0x3234de053c4b61e lrc: 2/0,0 mode: PR/PR res: [0x2b89b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc2d6 expref: 684 pid: 80278 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.652220:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.652221:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.652238:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000511d4b7b/0x3234de053c51dce lrc: 4/0,1 mode: --/PW res: [0x2b89b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652246:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000069d8a5d4/0x3234de053c4b61e lrc: 3/0,0 mode: PR/PR res: [0x2b89b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc2d6 expref: 684 pid: 80278 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.652249:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000069d8a5d4/0x3234de053c4b61e lrc: 4/0,0 mode: PR/PR res: [0x2b89b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc2d6 expref: 684 pid: 80278 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.652253:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004972eb27 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997027200:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.652262:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c2b2b59c going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.652267:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c51db2 lrc: 2/0,0 mode: PW/PW res: [0x2b895:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652272:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a520645e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.652273:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c51db2 lrc: 2/0,0 mode: PW/PW res: [0x2b895:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652276:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c51db2 lrc: 3/0,0 mode: PW/PW res: [0x2b895:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652281:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c51db2 lrc: 1/0,0 mode: --/PW res: [0x2b895:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652283:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c51db2 lrc: 0/0,0 mode: --/PW res: [0x2b895:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.652292:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000065f5e47d pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997027136:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.652295:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c51dc7 lrc: 3/0,1 mode: --/PW res: [0x2b899:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.652302:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211883 00000100:00100000:0.0:1651529344.652304:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ede401b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1377:39029:x1731745946496192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.652308:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396377280 00002000:00080000:0.0:1651529344.652309:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178330 count 1 00010000:00010000:0.0:1651529344.652312:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f14837b/0x3234de053c51dd5 lrc: 3/0,1 mode: --/PW res: [0x2b89a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.652313:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4f349 lrc: 4/0,0 mode: PR/PR res: [0x2b899:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7feb expref: 685 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.652321:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12663 00000100:00100000:1.0:1651529344.652322:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+685:41278:x1731746396377280:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.652325:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.652327:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4f349 lrc: 4/0,0 mode: PR/PR res: [0x2b899:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7feb expref: 685 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.652330:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4f349 lrc: 3/0,0 mode: PR/PR res: [0x2b899:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7feb expref: 685 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.652335:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001127aa81/0x3234de053c4f660 lrc: 2/0,0 mode: PR/PR res: [0x2b89a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c32 expref: 685 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.652339:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054a30dd8/0x3234de053c4f349 lrc: 0/0,0 mode: --/PR res: [0x2b899:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7feb expref: 685 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.652342:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.652342:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.652342:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.652343:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.652343:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f14837b/0x3234de053c51dd5 lrc: 4/0,1 mode: --/PW res: [0x2b89a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.652344:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c51dc7 lrc: 3/0,1 mode: PW/PW res: [0x2b899:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.652347:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c51dc7 lrc: 4/0,1 mode: PW/PW res: [0x2b899:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652350:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001127aa81/0x3234de053c4f660 lrc: 3/0,0 mode: PR/PR res: [0x2b89a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c32 expref: 684 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.652353:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001127aa81/0x3234de053c4f660 lrc: 4/0,0 mode: PR/PR res: [0x2b89a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c32 expref: 684 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.652357:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.652364:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f9050c71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997027264:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.652366:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+684:41278:x1731746396377280:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 43us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.652369:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12663 00000100:00100000:0.0:1651529344.652373:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 000000000d706dff going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.652377:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c51dc7 lrc: 3/0,1 mode: PW/PW res: [0x2b899:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652380:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c51dc7 lrc: 3/0,1 mode: PW/PW res: [0x2b899:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652384:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c51dc7 lrc: 3/0,1 mode: PW/PW res: [0x2b899:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652386:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c51dc7 lrc: 2/0,0 mode: PW/PW res: [0x2b899:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.652430:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1378:39030:x1731745946496128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 708us (786us total) trans 12885079936 rc 0/0 00000100:00100000:0.0:1651529344.652433:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211881 00010000:00010000:0.0:1651529344.652441:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c51dc7 lrc: 2/0,0 mode: PW/PW res: [0x2b899:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652444:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003c571c06 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.652445:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c51dc7 lrc: 2/0,0 mode: PW/PW res: [0x2b899:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652448:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c51dc7 lrc: 3/0,0 mode: PW/PW res: [0x2b899:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652453:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c51dc7 lrc: 1/0,0 mode: --/PW res: [0x2b899:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652455:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c51dc7 lrc: 0/0,0 mode: --/PW res: [0x2b899:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.652529:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.652545:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.652560:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004972eb27 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997027200:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.652564:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000511d4b7b/0x3234de053c51dce lrc: 3/0,1 mode: --/PW res: [0x2b89b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.652565:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.652571:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946496768 00000100:00100000:1.0:1651529344.652572:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.652583:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396377344 00010000:00010000:1.0:1651529344.652588:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000069d8a5d4/0x3234de053c4b61e lrc: 4/0,0 mode: PR/PR res: [0x2b89b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc2d6 expref: 684 pid: 80278 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.652596:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12664 00000100:00100000:1.0:1651529344.652597:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+684:41278:x1731746396377344:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.652600:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.652601:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000069d8a5d4/0x3234de053c4b61e lrc: 4/0,0 mode: PR/PR res: [0x2b89b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc2d6 expref: 684 pid: 80278 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.652603:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946496896 00010000:00010000:1.0:1651529344.652612:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000069d8a5d4/0x3234de053c4b61e lrc: 3/0,0 mode: PR/PR res: [0x2b89b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc2d6 expref: 684 pid: 80278 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.652622:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069d8a5d4/0x3234de053c4b61e lrc: 0/0,0 mode: --/PR res: [0x2b89b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc2d6 expref: 684 pid: 80278 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.652626:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946496832 00010000:00010000:1.0:1651529344.652631:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.652631:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.652631:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211884 00010000:00010000:1.0:1651529344.652632:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000511d4b7b/0x3234de053c51dce lrc: 3/0,1 mode: PW/PW res: [0x2b89b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.652633:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1380:39030:x1731745946496768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.652635:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000511d4b7b/0x3234de053c51dce lrc: 4/0,1 mode: PW/PW res: [0x2b89b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.652638:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178332 count 1 00010000:00010000:1.0:1651529344.652644:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.652648:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c51ddc lrc: 3/0,1 mode: --/PW res: [0x2b89c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.652652:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+683:41278:x1731746396377344:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 54us (107us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.652652:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b55090a0/0x3234de053c4e3eb lrc: 2/0,0 mode: PR/PR res: [0x2b89c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4097 expref: 683 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.652654:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12664 00010000:00010000:0.0:1651529344.652656:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.652656:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.652657:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c51ddc lrc: 4/0,1 mode: --/PW res: [0x2b89c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.652662:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211885 00000100:00100000:1.0:1651529344.652664:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1380:39030:x1731745946496896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.652664:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b55090a0/0x3234de053c4e3eb lrc: 3/0,0 mode: PR/PR res: [0x2b89c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4097 expref: 682 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.652667:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b55090a0/0x3234de053c4e3eb lrc: 4/0,0 mode: PR/PR res: [0x2b89c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4097 expref: 682 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:1.0:1651529344.652669:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178334 count 1 00000100:00100000:0.0:1651529344.652671:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004972eb27 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997027328:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.652672:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e783e5a/0x3234de053c51de3 lrc: 3/0,1 mode: --/PW res: [0x2b89e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.652677:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f291cae5/0x3234de053c4f20e lrc: 2/0,0 mode: PR/PR res: [0x2b89e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b06 expref: 682 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.652681:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e7e12492 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.652682:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.652683:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.652683:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e783e5a/0x3234de053c51de3 lrc: 4/0,1 mode: --/PW res: [0x2b89e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.652687:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211886 00000100:00100000:0.0:1651529344.652689:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1380:39030:x1731745946496832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.652690:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f291cae5/0x3234de053c4f20e lrc: 3/0,0 mode: PR/PR res: [0x2b89e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b06 expref: 682 pid: 72396 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.652693:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178333 count 1 00010000:00010000:1.0:1651529344.652694:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f291cae5/0x3234de053c4f20e lrc: 4/0,0 mode: PR/PR res: [0x2b89e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b06 expref: 682 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.652696:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086ec1398/0x3234de053c51dea lrc: 3/0,1 mode: --/PW res: [0x2b89d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.652698:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000999005e pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997027392:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.652700:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe0caf59/0x3234de053c4c7c1 lrc: 2/0,0 mode: PR/PR res: [0x2b89d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd154 expref: 682 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.652704:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.652704:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.652705:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086ec1398/0x3234de053c51dea lrc: 4/0,1 mode: --/PW res: [0x2b89d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.652706:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000071742acc going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.652711:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fe0caf59/0x3234de053c4c7c1 lrc: 3/0,0 mode: PR/PR res: [0x2b89d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd154 expref: 682 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.652714:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fe0caf59/0x3234de053c4c7c1 lrc: 4/0,0 mode: PR/PR res: [0x2b89d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd154 expref: 682 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.652718:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dfc79d4e pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997027456:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.652721:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.652724:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 000000003003c8b0 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.652728:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000511d4b7b/0x3234de053c51dce lrc: 3/0,1 mode: PW/PW res: [0x2b89b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652731:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000511d4b7b/0x3234de053c51dce lrc: 3/0,1 mode: PW/PW res: [0x2b89b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652748:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000511d4b7b/0x3234de053c51dce lrc: 3/0,1 mode: PW/PW res: [0x2b89b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652750:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000511d4b7b/0x3234de053c51dce lrc: 2/0,0 mode: PW/PW res: [0x2b89b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.652753:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.652773:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.652791:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1381:39030:x1731745946496256:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 586us (642us total) trans 12885079937 rc 0/0 00000100:00100000:0.0:1651529344.652795:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211882 00000100:00100000:0.0:1651529344.652800:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946497024 00000100:00100000:0.0:1651529344.652810:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946497152 00000100:00100000:0.0:1651529344.652816:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211887 00000100:00100000:0.0:1651529344.652818:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1382:39029:x1731745946497024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.652819:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.652823:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178335 count 1 00010000:00010000:0.0:1651529344.652827:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a96127a5/0x3234de053c51df1 lrc: 3/0,1 mode: --/PW res: [0x2b89f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652831:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000001bc478a/0x3234de053c4d909 lrc: 2/0,0 mode: PR/PR res: [0x2b89f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1524 expref: 682 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.652835:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.652835:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.652836:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a96127a5/0x3234de053c51df1 lrc: 4/0,1 mode: --/PW res: [0x2b89f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.652846:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946497088 00000100:00100000:1.0:1651529344.652854:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211888 00000100:00100000:1.0:1651529344.652856:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1383:39030:x1731745946497152:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.652857:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000001bc478a/0x3234de053c4d909 lrc: 3/0,0 mode: PR/PR res: [0x2b89f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1524 expref: 682 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.652861:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178337 count 1 00010000:00010000:0.0:1651529344.652861:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000001bc478a/0x3234de053c4d909 lrc: 4/0,0 mode: PR/PR res: [0x2b89f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1524 expref: 682 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.652865:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c51df8 lrc: 3/0,1 mode: --/PW res: [0x2b8a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.652865:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007fca8239 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997027520:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.652870:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c4ecab lrc: 2/0,0 mode: PR/PR res: [0x2b8a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d648c expref: 682 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.652875:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.652876:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.652876:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c51df8 lrc: 4/0,1 mode: --/PW res: [0x2b8a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.652880:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000003678d25f going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.652885:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000511d4b7b/0x3234de053c51dce lrc: 2/0,0 mode: PW/PW res: [0x2b89b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.652890:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c4ecab lrc: 3/0,0 mode: PR/PR res: [0x2b8a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d648c expref: 682 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.652891:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000511d4b7b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.652892:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000511d4b7b/0x3234de053c51dce lrc: 2/0,0 mode: PW/PW res: [0x2b89b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.652894:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c4ecab lrc: 4/0,0 mode: PR/PR res: [0x2b8a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d648c expref: 682 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.652895:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000511d4b7b/0x3234de053c51dce lrc: 3/0,0 mode: PW/PW res: [0x2b89b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.652898:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004089c807 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997027584:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.652899:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000511d4b7b/0x3234de053c51dce lrc: 1/0,0 mode: --/PW res: [0x2b89b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.652902:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000511d4b7b/0x3234de053c51dce lrc: 0/0,0 mode: --/PW res: [0x2b89b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.652906:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fe434b1c going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.652911:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f9050c71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997027264:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.652913:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211889 00000100:00100000:1.0:1651529344.652914:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1383:39029:x1731745946497088:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.652915:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001f14837b/0x3234de053c51dd5 lrc: 3/0,1 mode: --/PW res: [0x2b89a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.652919:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178336 count 1 00010000:00010000:1.0:1651529344.652922:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066c54aab/0x3234de053c51dff lrc: 3/0,1 mode: --/PW res: [0x2b8a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.652926:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e499398e/0x3234de053c4d455 lrc: 2/0,0 mode: PR/PR res: [0x2b8a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d035e expref: 682 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.652929:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.652930:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.652931:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066c54aab/0x3234de053c51dff lrc: 4/0,1 mode: --/PW res: [0x2b8a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.652939:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e499398e/0x3234de053c4d455 lrc: 3/0,0 mode: PR/PR res: [0x2b8a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d035e expref: 682 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.652942:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e499398e/0x3234de053c4d455 lrc: 4/0,0 mode: PR/PR res: [0x2b8a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d035e expref: 682 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.652955:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000050bbb886 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997027648:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.652967:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 000000004ca54b8a going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.652973:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396377408 00010000:00010000:1.0:1651529344.652978:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001127aa81/0x3234de053c4f660 lrc: 4/0,0 mode: PR/PR res: [0x2b89a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c32 expref: 683 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.652985:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12665 00000100:00100000:1.0:1651529344.652987:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+683:41279:x1731746396377408:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.652989:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.652990:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001127aa81/0x3234de053c4f660 lrc: 4/0,0 mode: PR/PR res: [0x2b89a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c32 expref: 683 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.652993:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.652994:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001127aa81/0x3234de053c4f660 lrc: 3/0,0 mode: PR/PR res: [0x2b89a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c32 expref: 683 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.652999:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001127aa81/0x3234de053c4f660 lrc: 0/0,0 mode: --/PR res: [0x2b89a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c32 expref: 683 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.653003:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.653003:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.653004:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001f14837b/0x3234de053c51dd5 lrc: 3/0,1 mode: PW/PW res: [0x2b89a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.653007:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f14837b/0x3234de053c51dd5 lrc: 4/0,1 mode: PW/PW res: [0x2b89a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.653016:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.653022:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+682:41279:x1731746396377408:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 35us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.653024:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12665 00000100:00100000:1.0:1651529344.653042:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946497216 00000100:00100000:1.0:1651529344.653046:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211890 00000100:00100000:1.0:1651529344.653048:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005914c920 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1384:39030:x1731745946497216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.653052:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178338 count 1 00010000:00010000:0.0:1651529344.653056:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001f14837b/0x3234de053c51dd5 lrc: 3/0,1 mode: PW/PW res: [0x2b89a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653060:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f14837b/0x3234de053c51dd5 lrc: 3/0,1 mode: PW/PW res: [0x2b89a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.653063:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b866be3a/0x3234de053c51e06 lrc: 3/0,1 mode: --/PW res: [0x2b8a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653064:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f14837b/0x3234de053c51dd5 lrc: 3/0,1 mode: PW/PW res: [0x2b89a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.653067:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008a081af8/0x3234de053c4d30c lrc: 2/0,0 mode: PR/PR res: [0x2b8a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe2c expref: 681 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.653069:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f14837b/0x3234de053c51dd5 lrc: 2/0,0 mode: PW/PW res: [0x2b89a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.653070:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.653071:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.653072:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b866be3a/0x3234de053c51e06 lrc: 4/0,1 mode: --/PW res: [0x2b8a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.653077:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008a081af8/0x3234de053c4d30c lrc: 3/0,0 mode: PR/PR res: [0x2b8a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe2c expref: 681 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.653083:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008a081af8/0x3234de053c4d30c lrc: 4/0,0 mode: PR/PR res: [0x2b8a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe2c expref: 681 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.653087:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029d739c8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997027712:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.653100:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d09f5ee1 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.653129:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ede401b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1385:39029:x1731745946496192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 824us (953us total) trans 12885079938 rc 0/0 00000100:00100000:0.0:1651529344.653132:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211883 00010000:00010000:0.0:1651529344.653153:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f14837b/0x3234de053c51dd5 lrc: 2/0,0 mode: PW/PW res: [0x2b89a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653157:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001f14837b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.653158:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f14837b/0x3234de053c51dd5 lrc: 2/0,0 mode: PW/PW res: [0x2b89a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653161:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f14837b/0x3234de053c51dd5 lrc: 3/0,0 mode: PW/PW res: [0x2b89a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653165:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f14837b/0x3234de053c51dd5 lrc: 1/0,0 mode: --/PW res: [0x2b89a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653168:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f14837b/0x3234de053c51dd5 lrc: 0/0,0 mode: --/PW res: [0x2b89a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.653178:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004972eb27 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997027328:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.653179:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000999005e pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997027392:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.653181:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c51ddc lrc: 3/0,1 mode: --/PW res: [0x2b89c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.653183:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006e783e5a/0x3234de053c51de3 lrc: 3/0,1 mode: --/PW res: [0x2b89e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.653330:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.653340:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946497280 00000100:00100000:0.0:1651529344.653351:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211891 00000100:00100000:0.0:1651529344.653352:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1385:39030:x1731745946497280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.653358:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178339 count 1 00010000:00010000:0.0:1651529344.653362:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1093027/0x3234de053c51e0d lrc: 3/0,1 mode: --/PW res: [0x2b8a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653366:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002a2a7bf8/0x3234de053c4e4f5 lrc: 2/0,0 mode: PR/PR res: [0x2b8a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d451a expref: 681 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.653370:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.653370:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.653371:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1093027/0x3234de053c51e0d lrc: 4/0,1 mode: --/PW res: [0x2b8a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653392:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002a2a7bf8/0x3234de053c4e4f5 lrc: 3/0,0 mode: PR/PR res: [0x2b8a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d451a expref: 681 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.653396:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002a2a7bf8/0x3234de053c4e4f5 lrc: 4/0,0 mode: PR/PR res: [0x2b8a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d451a expref: 681 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.653400:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005ea32140 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997027776:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.653411:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 0000000076b354b3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.653484:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dfc79d4e pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997027456:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.653494:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000086ec1398/0x3234de053c51dea lrc: 3/0,1 mode: --/PW res: [0x2b89d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.653502:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007fca8239 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997027520:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.653504:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.653505:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a96127a5/0x3234de053c51df1 lrc: 3/0,1 mode: --/PW res: [0x2b89f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.653510:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.653516:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.653524:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.653525:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396377856 00000100:00100000:1.0:1651529344.653531:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.653531:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b55090a0/0x3234de053c4e3eb lrc: 4/0,0 mode: PR/PR res: [0x2b89c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4097 expref: 682 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.653536:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.653543:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004089c807 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997027584:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.653547:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c51df8 lrc: 3/0,1 mode: --/PW res: [0x2b8a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.653552:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396378112 00000100:00100000:1.0:1651529344.653554:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000050bbb886 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997027648:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.653556:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000066c54aab/0x3234de053c51dff lrc: 3/0,1 mode: --/PW res: [0x2b8a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653556:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fe0caf59/0x3234de053c4c7c1 lrc: 4/0,0 mode: PR/PR res: [0x2b89d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd154 expref: 683 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.653565:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396378240 00010000:00010000:1.0:1651529344.653570:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000001bc478a/0x3234de053c4d909 lrc: 4/0,0 mode: PR/PR res: [0x2b89f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1524 expref: 684 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.653571:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396377920 00010000:00010000:0.0:1651529344.653574:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f291cae5/0x3234de053c4f20e lrc: 4/0,0 mode: PR/PR res: [0x2b89e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b06 expref: 685 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.653575:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396378176 00010000:00010000:1.0:1651529344.653577:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c4ecab lrc: 4/0,0 mode: PR/PR res: [0x2b8a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d648c expref: 686 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.653579:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396378304 00000100:00100000:1.0:1651529344.653582:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12666 00010000:00010000:0.0:1651529344.653582:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e499398e/0x3234de053c4d455 lrc: 4/0,0 mode: PR/PR res: [0x2b8a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d035e expref: 687 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.653584:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e392dfeb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+687:41279:x1731746396377856:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.653587:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.653587:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12667 00010000:00010000:1.0:1651529344.653588:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b55090a0/0x3234de053c4e3eb lrc: 4/0,0 mode: PR/PR res: [0x2b89c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4097 expref: 687 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.653588:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+687:41279:x1731746396378112:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.653592:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b55090a0/0x3234de053c4e3eb lrc: 3/0,0 mode: PR/PR res: [0x2b89c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4097 expref: 687 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.653592:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.653593:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fe0caf59/0x3234de053c4c7c1 lrc: 4/0,0 mode: PR/PR res: [0x2b89d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd154 expref: 687 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.653598:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b55090a0/0x3234de053c4e3eb lrc: 0/0,0 mode: --/PR res: [0x2b89c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4097 expref: 687 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.653599:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fe0caf59/0x3234de053c4c7c1 lrc: 3/0,0 mode: PR/PR res: [0x2b89d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd154 expref: 687 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.653601:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.653602:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.653603:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c51ddc lrc: 3/0,1 mode: PW/PW res: [0x2b89c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653605:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe0caf59/0x3234de053c4c7c1 lrc: 0/0,0 mode: --/PR res: [0x2b89d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd154 expref: 686 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.653606:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c51ddc lrc: 4/0,1 mode: PW/PW res: [0x2b89c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653609:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.653609:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.653610:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000086ec1398/0x3234de053c51dea lrc: 3/0,1 mode: PW/PW res: [0x2b89d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.653616:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.653619:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086ec1398/0x3234de053c51dea lrc: 4/0,1 mode: PW/PW res: [0x2b89d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.653624:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e392dfeb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+685:41279:x1731746396377856:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.653627:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12666 00010000:00010000:0.0:1651529344.653627:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.653634:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+684:41279:x1731746396378112:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 45us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.653636:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12668 00000100:00100000:1.0:1651529344.653638:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+684:41279:x1731746396378240:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.653638:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12667 00010000:00010000:1.0:1651529344.653641:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.653642:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000001bc478a/0x3234de053c4d909 lrc: 4/0,0 mode: PR/PR res: [0x2b89f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1524 expref: 684 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.653646:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000001bc478a/0x3234de053c4d909 lrc: 3/0,0 mode: PR/PR res: [0x2b89f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1524 expref: 684 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.653651:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001bc478a/0x3234de053c4d909 lrc: 0/0,0 mode: --/PR res: [0x2b89f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1524 expref: 684 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.653654:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.653655:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.653655:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a96127a5/0x3234de053c51df1 lrc: 3/0,1 mode: PW/PW res: [0x2b89f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.653656:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12669 00010000:00010000:1.0:1651529344.653658:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a96127a5/0x3234de053c51df1 lrc: 4/0,1 mode: PW/PW res: [0x2b89f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.653658:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+682:41278:x1731746396377920:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.653661:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.653662:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f291cae5/0x3234de053c4f20e lrc: 4/0,0 mode: PR/PR res: [0x2b89e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b06 expref: 682 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.653667:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.653672:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+682:41279:x1731746396378240:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 33us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.653675:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12668 00000100:00100000:1.0:1651529344.653679:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12670 00000100:00100000:1.0:1651529344.653680:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+681:41278:x1731746396378176:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.653681:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f291cae5/0x3234de053c4f20e lrc: 3/0,0 mode: PR/PR res: [0x2b89e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b06 expref: 681 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.653682:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.653684:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c4ecab lrc: 4/0,0 mode: PR/PR res: [0x2b8a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d648c expref: 681 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.653686:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f291cae5/0x3234de053c4f20e lrc: 0/0,0 mode: --/PR res: [0x2b89e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b06 expref: 681 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.653688:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c4ecab lrc: 3/0,0 mode: PR/PR res: [0x2b8a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d648c expref: 681 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.653690:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.653691:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.653691:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006e783e5a/0x3234de053c51de3 lrc: 3/0,1 mode: PW/PW res: [0x2b89e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.653692:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c4ecab lrc: 0/0,0 mode: --/PR res: [0x2b8a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d648c expref: 680 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.653694:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e783e5a/0x3234de053c51de3 lrc: 4/0,1 mode: PW/PW res: [0x2b89e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.653695:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.653696:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.653697:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c51df8 lrc: 3/0,1 mode: PW/PW res: [0x2b8a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.653699:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c51df8 lrc: 4/0,1 mode: PW/PW res: [0x2b8a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653704:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.653711:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+679:41278:x1731746396377920:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 53us (186us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.653712:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.653714:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12669 00000100:00100000:1.0:1651529344.653717:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+678:41278:x1731746396378176:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 36us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.653719:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12671 00000100:00100000:1.0:1651529344.653720:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12670 00000100:00100000:0.0:1651529344.653720:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+678:41278:x1731746396378304:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.653723:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.653724:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e499398e/0x3234de053c4d455 lrc: 4/0,0 mode: PR/PR res: [0x2b8a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d035e expref: 677 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.653728:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006e783e5a/0x3234de053c51de3 lrc: 3/0,1 mode: PW/PW res: [0x2b89e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653728:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e499398e/0x3234de053c4d455 lrc: 3/0,0 mode: PR/PR res: [0x2b8a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d035e expref: 677 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.653731:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e783e5a/0x3234de053c51de3 lrc: 3/0,1 mode: PW/PW res: [0x2b89e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653733:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e499398e/0x3234de053c4d455 lrc: 0/0,0 mode: --/PR res: [0x2b8a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d035e expref: 677 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.653743:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e783e5a/0x3234de053c51de3 lrc: 3/0,1 mode: PW/PW res: [0x2b89e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.653746:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e783e5a/0x3234de053c51de3 lrc: 2/0,0 mode: PW/PW res: [0x2b89e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653747:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.653747:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.653748:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000066c54aab/0x3234de053c51dff lrc: 3/0,1 mode: PW/PW res: [0x2b8a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653751:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066c54aab/0x3234de053c51dff lrc: 4/0,1 mode: PW/PW res: [0x2b8a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653766:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.653773:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+676:41278:x1731746396378304:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 52us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.653775:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12671 00010000:00010000:0.0:1651529344.653783:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000086ec1398/0x3234de053c51dea lrc: 3/0,1 mode: PW/PW res: [0x2b89d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653786:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086ec1398/0x3234de053c51dea lrc: 3/0,1 mode: PW/PW res: [0x2b89d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653789:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086ec1398/0x3234de053c51dea lrc: 3/0,1 mode: PW/PW res: [0x2b89d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653792:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000086ec1398/0x3234de053c51dea lrc: 2/0,0 mode: PW/PW res: [0x2b89d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.653795:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1386:39030:x1731745946496896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1130us (1230us total) trans 12885079939 rc 0/0 00000100:00100000:1.0:1651529344.653798:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211885 00010000:00010000:1.0:1651529344.653805:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000066c54aab/0x3234de053c51dff lrc: 3/0,1 mode: PW/PW res: [0x2b8a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.653809:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066c54aab/0x3234de053c51dff lrc: 3/0,1 mode: PW/PW res: [0x2b8a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.653812:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066c54aab/0x3234de053c51dff lrc: 3/0,1 mode: PW/PW res: [0x2b8a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.653814:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066c54aab/0x3234de053c51dff lrc: 2/0,0 mode: PW/PW res: [0x2b8a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.653842:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1387:39030:x1731745946496832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1152us (1269us total) trans 12885079940 rc 0/0 00000100:00100000:0.0:1651529344.653845:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211886 00010000:00010000:0.0:1651529344.653852:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e783e5a/0x3234de053c51de3 lrc: 2/0,0 mode: PW/PW res: [0x2b89e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.653853:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1386:39029:x1731745946497088:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 938us (1038us total) trans 12885079941 rc 0/0 00010000:00010000:0.0:1651529344.653856:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006e783e5a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.653857:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e783e5a/0x3234de053c51de3 lrc: 2/0,0 mode: PW/PW res: [0x2b89e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.653858:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211889 00010000:00010000:0.0:1651529344.653860:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e783e5a/0x3234de053c51de3 lrc: 3/0,0 mode: PW/PW res: [0x2b89e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653864:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e783e5a/0x3234de053c51de3 lrc: 1/0,0 mode: --/PW res: [0x2b89e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.653865:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c51df8 lrc: 3/0,1 mode: PW/PW res: [0x2b8a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653867:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e783e5a/0x3234de053c51de3 lrc: 0/0,0 mode: --/PW res: [0x2b89e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.653868:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c51df8 lrc: 3/0,1 mode: PW/PW res: [0x2b8a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.653871:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c51df8 lrc: 3/0,1 mode: PW/PW res: [0x2b8a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653871:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000086ec1398/0x3234de053c51dea lrc: 2/0,0 mode: PW/PW res: [0x2b89d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.653874:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c51df8 lrc: 2/0,0 mode: PW/PW res: [0x2b8a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653874:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000086ec1398 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.653875:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000086ec1398/0x3234de053c51dea lrc: 2/0,0 mode: PW/PW res: [0x2b89d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653878:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000086ec1398/0x3234de053c51dea lrc: 3/0,0 mode: PW/PW res: [0x2b89d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653881:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000086ec1398/0x3234de053c51dea lrc: 1/0,0 mode: --/PW res: [0x2b89d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653886:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086ec1398/0x3234de053c51dea lrc: 0/0,0 mode: --/PW res: [0x2b89d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653889:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066c54aab/0x3234de053c51dff lrc: 2/0,0 mode: PW/PW res: [0x2b8a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653892:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000066c54aab already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.653893:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066c54aab/0x3234de053c51dff lrc: 2/0,0 mode: PW/PW res: [0x2b8a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653895:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066c54aab/0x3234de053c51dff lrc: 3/0,0 mode: PW/PW res: [0x2b8a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653898:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066c54aab/0x3234de053c51dff lrc: 1/0,0 mode: --/PW res: [0x2b8a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.653901:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1386:39030:x1731745946497152:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1045us (1149us total) trans 12885079942 rc 0/0 00010000:00010000:0.0:1651529344.653901:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066c54aab/0x3234de053c51dff lrc: 0/0,0 mode: --/PW res: [0x2b8a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.653904:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211888 00010000:00010000:0.0:1651529344.653904:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c51df8 lrc: 2/0,0 mode: PW/PW res: [0x2b8a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653907:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004ab50553 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.653907:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c51df8 lrc: 2/0,0 mode: PW/PW res: [0x2b8a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653912:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c51df8 lrc: 3/0,0 mode: PW/PW res: [0x2b8a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653916:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c51df8 lrc: 1/0,0 mode: --/PW res: [0x2b8a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653918:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c51df8 lrc: 0/0,0 mode: --/PW res: [0x2b8a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653925:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c51ddc lrc: 3/0,1 mode: PW/PW res: [0x2b89c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653927:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c51ddc lrc: 3/0,1 mode: PW/PW res: [0x2b89c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653930:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c51ddc lrc: 3/0,1 mode: PW/PW res: [0x2b89c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653933:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c51ddc lrc: 2/0,0 mode: PW/PW res: [0x2b89c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.653962:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.653975:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.653981:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1386:39030:x1731745946496768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1347us (1452us total) trans 12885079943 rc 0/0 00000100:00100000:0.0:1651529344.653984:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211884 00010000:00010000:0.0:1651529344.653991:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c51ddc lrc: 2/0,0 mode: PW/PW res: [0x2b89c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.653997:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ef6f99f3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.653998:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c51ddc lrc: 2/0,0 mode: PW/PW res: [0x2b89c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.654000:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c51ddc lrc: 3/0,0 mode: PW/PW res: [0x2b89c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.654005:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c51ddc lrc: 1/0,0 mode: --/PW res: [0x2b89c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.654007:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef6f99f3/0x3234de053c51ddc lrc: 0/0,0 mode: --/PW res: [0x2b89c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.654013:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a96127a5/0x3234de053c51df1 lrc: 3/0,1 mode: PW/PW res: [0x2b89f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.654015:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a96127a5/0x3234de053c51df1 lrc: 3/0,1 mode: PW/PW res: [0x2b89f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.654019:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a96127a5/0x3234de053c51df1 lrc: 3/0,1 mode: PW/PW res: [0x2b89f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.654021:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a96127a5/0x3234de053c51df1 lrc: 2/0,0 mode: PW/PW res: [0x2b89f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.654054:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1386:39029:x1731745946497024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1235us (1333us total) trans 12885079944 rc 0/0 00000100:00100000:0.0:1651529344.654057:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211887 00010000:00010000:0.0:1651529344.654063:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a96127a5/0x3234de053c51df1 lrc: 2/0,0 mode: PW/PW res: [0x2b89f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.654083:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a96127a5 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.654084:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a96127a5/0x3234de053c51df1 lrc: 2/0,0 mode: PW/PW res: [0x2b89f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.654087:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a96127a5/0x3234de053c51df1 lrc: 3/0,0 mode: PW/PW res: [0x2b89f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.654088:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029d739c8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997027712:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.654092:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a96127a5/0x3234de053c51df1 lrc: 1/0,0 mode: --/PW res: [0x2b89f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.654093:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b866be3a/0x3234de053c51e06 lrc: 3/0,1 mode: --/PW res: [0x2b8a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.654095:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a96127a5/0x3234de053c51df1 lrc: 0/0,0 mode: --/PW res: [0x2b89f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.654100:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396378368 00010000:00010000:1.0:1651529344.654104:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008a081af8/0x3234de053c4d30c lrc: 4/0,0 mode: PR/PR res: [0x2b8a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe2c expref: 676 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.654113:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396378432 00010000:00010000:1.0:1651529344.654116:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002a2a7bf8/0x3234de053c4e4f5 lrc: 4/0,0 mode: PR/PR res: [0x2b8a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d451a expref: 677 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.654121:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12672 00000100:00100000:1.0:1651529344.654123:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+677:41278:x1731746396378368:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.654126:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.654127:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008a081af8/0x3234de053c4d30c lrc: 4/0,0 mode: PR/PR res: [0x2b8a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe2c expref: 677 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.654127:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005ea32140 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997027776:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.654130:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008a081af8/0x3234de053c4d30c lrc: 3/0,0 mode: PR/PR res: [0x2b8a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe2c expref: 677 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.654131:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f1093027/0x3234de053c51e0d lrc: 3/0,1 mode: --/PW res: [0x2b8a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.654136:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a081af8/0x3234de053c4d30c lrc: 0/0,0 mode: --/PR res: [0x2b8a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe2c expref: 677 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.654139:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.654140:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.654141:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b866be3a/0x3234de053c51e06 lrc: 3/0,1 mode: PW/PW res: [0x2b8a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.654141:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12673 00000100:00100000:0.0:1651529344.654142:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000db7aa2bf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+676:41279:x1731746396378432:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.654144:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b866be3a/0x3234de053c51e06 lrc: 4/0,1 mode: PW/PW res: [0x2b8a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.654146:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.654147:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002a2a7bf8/0x3234de053c4e4f5 lrc: 4/0,0 mode: PR/PR res: [0x2b8a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d451a expref: 676 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.654149:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.654151:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002a2a7bf8/0x3234de053c4e4f5 lrc: 3/0,0 mode: PR/PR res: [0x2b8a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d451a expref: 676 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.654156:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a2a7bf8/0x3234de053c4e4f5 lrc: 0/0,0 mode: --/PR res: [0x2b8a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d451a expref: 676 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.654157:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+676:41278:x1731746396378368:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 34us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.654160:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12672 00010000:00010000:0.0:1651529344.654160:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.654160:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.654161:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1093027/0x3234de053c51e0d lrc: 3/0,1 mode: PW/PW res: [0x2b8a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.654164:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1093027/0x3234de053c51e0d lrc: 4/0,1 mode: PW/PW res: [0x2b8a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.654167:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b866be3a/0x3234de053c51e06 lrc: 3/0,1 mode: PW/PW res: [0x2b8a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.654170:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b866be3a/0x3234de053c51e06 lrc: 3/0,1 mode: PW/PW res: [0x2b8a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.654170:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.654173:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b866be3a/0x3234de053c51e06 lrc: 3/0,1 mode: PW/PW res: [0x2b8a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.654175:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b866be3a/0x3234de053c51e06 lrc: 2/0,0 mode: PW/PW res: [0x2b8a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.654177:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000db7aa2bf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+674:41279:x1731746396378432:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 34us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.654180:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12673 00010000:00010000:0.0:1651529344.654198:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f1093027/0x3234de053c51e0d lrc: 3/0,1 mode: PW/PW res: [0x2b8a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.654201:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1093027/0x3234de053c51e0d lrc: 3/0,1 mode: PW/PW res: [0x2b8a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.654204:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1093027/0x3234de053c51e0d lrc: 3/0,1 mode: PW/PW res: [0x2b8a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.654209:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1093027/0x3234de053c51e0d lrc: 2/0,0 mode: PW/PW res: [0x2b8a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.654240:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005914c920 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1386:39030:x1731745946497216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1190us (1246us total) trans 12885079945 rc 0/0 00000100:00100000:1.0:1651529344.654243:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211890 00000100:00100000:1.0:1651529344.654271:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.654298:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.654314:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1386:39030:x1731745946497280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 960us (984us total) trans 12885079946 rc 0/0 00000100:00100000:0.0:1651529344.654317:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211891 00000100:00100000:0.0:1651529344.654322:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946497344 00000100:00100000:1.0:1651529344.654328:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.654328:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946497472 00000100:00100000:0.0:1651529344.654337:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946497408 00000100:00100000:0.0:1651529344.654342:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211892 00000100:00100000:0.0:1651529344.654344:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1388:39029:x1731745946497344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.654349:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178340 count 1 00010000:00010000:0.0:1651529344.654353:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000174ef069/0x3234de053c51e14 lrc: 3/0,1 mode: --/PW res: [0x2b8a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.654358:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c4d55f lrc: 2/0,0 mode: PR/PR res: [0x2b8a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0739 expref: 673 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.654361:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.654361:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.654361:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.654362:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000174ef069/0x3234de053c51e14 lrc: 4/0,1 mode: --/PW res: [0x2b8a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.654368:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c4d55f lrc: 3/0,0 mode: PR/PR res: [0x2b8a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0739 expref: 673 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.654372:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c4d55f lrc: 4/0,0 mode: PR/PR res: [0x2b8a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0739 expref: 673 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.654376:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005ea32140 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997027840:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.654390:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c2b2b59c going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.654393:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946497536 00000100:00100000:1.0:1651529344.654400:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211893 00000100:00100000:1.0:1651529344.654402:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1389:39029:x1731745946497472:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.654407:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178342 count 1 00010000:00010000:0.0:1651529344.654410:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b866be3a/0x3234de053c51e06 lrc: 2/0,0 mode: PW/PW res: [0x2b8a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.654411:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fff466fa/0x3234de053c51e1b lrc: 3/0,1 mode: --/PW res: [0x2b8a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.654414:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b866be3a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.654415:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b866be3a/0x3234de053c51e06 lrc: 2/0,0 mode: PW/PW res: [0x2b8a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.654418:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c4c6f6 lrc: 2/0,0 mode: PR/PR res: [0x2b8a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccde9 expref: 673 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.654418:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b866be3a/0x3234de053c51e06 lrc: 3/0,0 mode: PW/PW res: [0x2b8a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.654422:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.654422:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.654423:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fff466fa/0x3234de053c51e1b lrc: 4/0,1 mode: --/PW res: [0x2b8a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.654423:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b866be3a/0x3234de053c51e06 lrc: 1/0,0 mode: --/PW res: [0x2b8a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.654426:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b866be3a/0x3234de053c51e06 lrc: 0/0,0 mode: --/PW res: [0x2b8a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.654430:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c4c6f6 lrc: 3/0,0 mode: PR/PR res: [0x2b8a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccde9 expref: 673 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.654430:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1093027/0x3234de053c51e0d lrc: 2/0,0 mode: PW/PW res: [0x2b8a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.654433:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c4c6f6 lrc: 4/0,0 mode: PR/PR res: [0x2b8a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccde9 expref: 673 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.654433:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f1093027 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.654433:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1093027/0x3234de053c51e0d lrc: 2/0,0 mode: PW/PW res: [0x2b8a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.654436:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1093027/0x3234de053c51e0d lrc: 3/0,0 mode: PW/PW res: [0x2b8a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.654437:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000007fba516 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997027904:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.654440:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1093027/0x3234de053c51e0d lrc: 1/0,0 mode: --/PW res: [0x2b8a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.654442:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1093027/0x3234de053c51e0d lrc: 0/0,0 mode: --/PW res: [0x2b8a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.654446:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d09f5ee1 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.654450:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211894 00000100:00100000:0.0:1651529344.654452:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1389:39029:x1731745946497408:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.654453:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211895 00000100:00100000:1.0:1651529344.654455:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1389:39029:x1731745946497536:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.654456:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178341 count 1 00002000:00080000:1.0:1651529344.654459:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178343 count 1 00010000:00010000:0.0:1651529344.654459:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002897da4e/0x3234de053c51e22 lrc: 3/0,1 mode: --/PW res: [0x2b8a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.654462:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000281e99c0/0x3234de053c51e29 lrc: 3/0,1 mode: --/PW res: [0x2b8a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.654463:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000062b4acc7/0x3234de053c4f032 lrc: 2/0,0 mode: PR/PR res: [0x2b8a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7396 expref: 673 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.654466:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b8ad3932/0x3234de053c4e1f3 lrc: 2/0,0 mode: PR/PR res: [0x2b8a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3912 expref: 673 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.654466:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.654467:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.654467:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002897da4e/0x3234de053c51e22 lrc: 4/0,1 mode: --/PW res: [0x2b8a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.654469:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.654470:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.654470:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000281e99c0/0x3234de053c51e29 lrc: 4/0,1 mode: --/PW res: [0x2b8a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.654474:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000062b4acc7/0x3234de053c4f032 lrc: 3/0,0 mode: PR/PR res: [0x2b8a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7396 expref: 673 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.654476:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b8ad3932/0x3234de053c4e1f3 lrc: 3/0,0 mode: PR/PR res: [0x2b8a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3912 expref: 673 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.654477:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000062b4acc7/0x3234de053c4f032 lrc: 4/0,0 mode: PR/PR res: [0x2b8a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7396 expref: 673 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.654480:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b8ad3932/0x3234de053c4e1f3 lrc: 4/0,0 mode: PR/PR res: [0x2b8a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3912 expref: 673 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.654484:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007ac35c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997028032:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.654484:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007fca8239 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997027968:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.654490:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fe434b1c going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.654493:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b81e4a0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.654504:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.654517:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.654564:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.654575:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.654584:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946497792 00000100:00100000:0.0:1651529344.654593:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946497856 00000100:00100000:0.0:1651529344.654598:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946498304 00000100:00100000:0.0:1651529344.654601:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946498240 00000100:00100000:1.0:1651529344.654606:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211896 00000100:00100000:1.0:1651529344.654608:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1393:39030:x1731745946497792:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.654608:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211897 00000100:00100000:0.0:1651529344.654610:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1393:39029:x1731745946497856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.654613:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178344 count 1 00010000:00010000:1.0:1651529344.654617:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6f87d2f/0x3234de053c51e30 lrc: 3/0,1 mode: --/PW res: [0x2b8a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.654622:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000406b6859/0x3234de053c4f078 lrc: 2/0,0 mode: PR/PR res: [0x2b8a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d74ca expref: 673 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.654625:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.654626:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.654626:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6f87d2f/0x3234de053c51e30 lrc: 4/0,1 mode: --/PW res: [0x2b8a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.654629:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178345 count 1 00010000:00010000:0.0:1651529344.654634:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cac510f/0x3234de053c51e37 lrc: 3/0,1 mode: --/PW res: [0x2b8a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.654635:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000406b6859/0x3234de053c4f078 lrc: 3/0,0 mode: PR/PR res: [0x2b8a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d74ca expref: 673 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.654638:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000103b2d5e/0x3234de053c4e971 lrc: 2/0,0 mode: PR/PR res: [0x2b8a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5703 expref: 673 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.654639:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000406b6859/0x3234de053c4f078 lrc: 4/0,0 mode: PR/PR res: [0x2b8a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d74ca expref: 673 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.654641:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.654642:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005b3c5aba pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997028096:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.654642:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.654643:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cac510f/0x3234de053c51e37 lrc: 4/0,1 mode: --/PW res: [0x2b8a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.654650:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000103b2d5e/0x3234de053c4e971 lrc: 3/0,0 mode: PR/PR res: [0x2b8a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5703 expref: 673 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.654656:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 000000004ca54b8a going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.654660:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000103b2d5e/0x3234de053c4e971 lrc: 4/0,0 mode: PR/PR res: [0x2b8a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5703 expref: 673 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.654663:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211898 00000100:00100000:1.0:1651529344.654664:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfc79d4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1393:39030:x1731745946498304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.654665:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000023afca5e pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997028160:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.654669:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178347 count 1 00010000:00010000:1.0:1651529344.654672:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff3c900b/0x3234de053c51e3e lrc: 3/0,1 mode: --/PW res: [0x2b8ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.654674:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000504ef660 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.654677:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008934356d/0x3234de053c4e73a lrc: 2/0,0 mode: PR/PR res: [0x2b8ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4de8 expref: 673 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.654680:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.654680:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.654680:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211899 00010000:00010000:1.0:1651529344.654681:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff3c900b/0x3234de053c51e3e lrc: 4/0,1 mode: --/PW res: [0x2b8ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.654682:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1393:39029:x1731745946498240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.654687:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008934356d/0x3234de053c4e73a lrc: 3/0,0 mode: PR/PR res: [0x2b8ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4de8 expref: 673 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.654687:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178346 count 1 00010000:00010000:1.0:1651529344.654690:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008934356d/0x3234de053c4e73a lrc: 4/0,0 mode: PR/PR res: [0x2b8ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4de8 expref: 673 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.654690:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006609c41a/0x3234de053c51e45 lrc: 3/0,1 mode: --/PW res: [0x2b8aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.654694:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000050bbb886 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997028224:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.654694:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004da4611f/0x3234de053c4f5aa lrc: 2/0,0 mode: PR/PR res: [0x2b8aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8922 expref: 673 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.654697:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.654697:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.654698:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006609c41a/0x3234de053c51e45 lrc: 4/0,1 mode: --/PW res: [0x2b8aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.654701:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000071742acc going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.654704:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004da4611f/0x3234de053c4f5aa lrc: 3/0,0 mode: PR/PR res: [0x2b8aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8922 expref: 673 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.654708:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004da4611f/0x3234de053c4f5aa lrc: 4/0,0 mode: PR/PR res: [0x2b8aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8922 expref: 673 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.654712:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d523a75 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997028288:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.654718:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000afe7ff7b going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.655023:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005ea32140 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997027840:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.655034:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.655034:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000174ef069/0x3234de053c51e14 lrc: 3/0,1 mode: --/PW res: [0x2b8a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.655041:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.655053:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.655057:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007fca8239 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997027968:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.655060:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.655069:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000007fba516 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997027904:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.655071:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002897da4e/0x3234de053c51e22 lrc: 3/0,1 mode: --/PW res: [0x2b8a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655074:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fff466fa/0x3234de053c51e1b lrc: 3/0,1 mode: --/PW res: [0x2b8a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.655080:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007ac35c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997028032:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.655083:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000281e99c0/0x3234de053c51e29 lrc: 3/0,1 mode: --/PW res: [0x2b8a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.655088:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396378496 00010000:00010000:1.0:1651529344.655093:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c4d55f lrc: 4/0,0 mode: PR/PR res: [0x2b8a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0739 expref: 674 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.655098:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396378624 00010000:00010000:1.0:1651529344.655114:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b8ad3932/0x3234de053c4e1f3 lrc: 4/0,0 mode: PR/PR res: [0x2b8a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3912 expref: 675 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.655119:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396378560 00000100:00100000:0.0:1651529344.655120:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000023afca5e pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997028160:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.655122:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c4c6f6 lrc: 4/0,0 mode: PR/PR res: [0x2b8a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccde9 expref: 676 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.655124:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002cac510f/0x3234de053c51e37 lrc: 3/0,1 mode: --/PW res: [0x2b8a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.655128:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396378688 00010000:00010000:1.0:1651529344.655130:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000062b4acc7/0x3234de053c4f032 lrc: 4/0,0 mode: PR/PR res: [0x2b8a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7396 expref: 677 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.655132:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12674 00000100:00100000:0.0:1651529344.655134:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+677:41279:x1731746396378496:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.655135:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12675 00000100:00100000:1.0:1651529344.655136:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+677:41279:x1731746396378624:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.655138:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.655139:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.655139:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c4d55f lrc: 4/0,0 mode: PR/PR res: [0x2b8a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0739 expref: 677 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.655140:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b8ad3932/0x3234de053c4e1f3 lrc: 4/0,0 mode: PR/PR res: [0x2b8a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3912 expref: 677 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.655143:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c4d55f lrc: 3/0,0 mode: PR/PR res: [0x2b8a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0739 expref: 677 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.655144:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b8ad3932/0x3234de053c4e1f3 lrc: 3/0,0 mode: PR/PR res: [0x2b8a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3912 expref: 677 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.655149:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c4d55f lrc: 0/0,0 mode: --/PR res: [0x2b8a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0739 expref: 677 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.655150:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8ad3932/0x3234de053c4e1f3 lrc: 0/0,0 mode: --/PR res: [0x2b8a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3912 expref: 677 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.655152:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.655153:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.655153:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.655154:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.655154:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000174ef069/0x3234de053c51e14 lrc: 3/0,1 mode: PW/PW res: [0x2b8a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655155:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000281e99c0/0x3234de053c51e29 lrc: 3/0,1 mode: PW/PW res: [0x2b8a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655157:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000174ef069/0x3234de053c51e14 lrc: 4/0,1 mode: PW/PW res: [0x2b8a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655158:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000281e99c0/0x3234de053c51e29 lrc: 4/0,1 mode: PW/PW res: [0x2b8a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655163:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.655164:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.655175:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+675:41279:x1731746396378496:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 40us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.655177:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12674 00000100:00100000:1.0:1651529344.655179:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+675:41279:x1731746396378624:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.655182:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12675 00000100:00100000:0.0:1651529344.655184:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12676 00000100:00100000:0.0:1651529344.655186:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+673:41279:x1731746396378560:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.655188:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12677 00000100:00100000:1.0:1651529344.655189:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+673:41279:x1731746396378688:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.655189:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.655190:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c4c6f6 lrc: 4/0,0 mode: PR/PR res: [0x2b8a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccde9 expref: 673 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.655192:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.655193:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000062b4acc7/0x3234de053c4f032 lrc: 4/0,0 mode: PR/PR res: [0x2b8a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7396 expref: 673 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.655194:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c4c6f6 lrc: 3/0,0 mode: PR/PR res: [0x2b8a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccde9 expref: 673 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.655197:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000062b4acc7/0x3234de053c4f032 lrc: 3/0,0 mode: PR/PR res: [0x2b8a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7396 expref: 673 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.655199:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c4c6f6 lrc: 0/0,0 mode: --/PR res: [0x2b8a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccde9 expref: 673 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.655202:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062b4acc7/0x3234de053c4f032 lrc: 0/0,0 mode: --/PR res: [0x2b8a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7396 expref: 673 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.655203:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.655203:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.655204:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fff466fa/0x3234de053c51e1b lrc: 3/0,1 mode: PW/PW res: [0x2b8a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655205:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.655206:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.655207:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002897da4e/0x3234de053c51e22 lrc: 3/0,1 mode: PW/PW res: [0x2b8a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655207:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fff466fa/0x3234de053c51e1b lrc: 4/0,1 mode: PW/PW res: [0x2b8a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655210:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002897da4e/0x3234de053c51e22 lrc: 4/0,1 mode: PW/PW res: [0x2b8a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655215:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.655220:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+671:41279:x1731746396378560:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (167us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.655232:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.655238:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+671:41279:x1731746396378688:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 48us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.655246:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12677 00000100:00100000:0.0:1651529344.655248:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12676 00010000:00010000:0.0:1651529344.655255:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002897da4e/0x3234de053c51e22 lrc: 3/0,1 mode: PW/PW res: [0x2b8a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655256:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000281e99c0/0x3234de053c51e29 lrc: 3/0,1 mode: PW/PW res: [0x2b8a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655259:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002897da4e/0x3234de053c51e22 lrc: 3/0,1 mode: PW/PW res: [0x2b8a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655260:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000281e99c0/0x3234de053c51e29 lrc: 3/0,1 mode: PW/PW res: [0x2b8a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655262:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002897da4e/0x3234de053c51e22 lrc: 3/0,1 mode: PW/PW res: [0x2b8a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655263:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000281e99c0/0x3234de053c51e29 lrc: 3/0,1 mode: PW/PW res: [0x2b8a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655265:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002897da4e/0x3234de053c51e22 lrc: 2/0,0 mode: PW/PW res: [0x2b8a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655266:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000281e99c0/0x3234de053c51e29 lrc: 2/0,0 mode: PW/PW res: [0x2b8a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.655314:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1395:39029:x1731745946497536:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 858us (952us total) trans 12885079947 rc 0/0 00000100:00100000:1.0:1651529344.655317:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211895 00000100:00100000:0.0:1651529344.655320:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1394:39029:x1731745946497408:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 867us (991us total) trans 12885079948 rc 0/0 00000100:00100000:0.0:1651529344.655323:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211894 00000100:00100000:1.0:1651529344.655327:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005b3c5aba pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997028096:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.655330:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002897da4e/0x3234de053c51e22 lrc: 2/0,0 mode: PW/PW res: [0x2b8a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655331:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a6f87d2f/0x3234de053c51e30 lrc: 3/0,1 mode: --/PW res: [0x2b8a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655333:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002897da4e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.655334:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002897da4e/0x3234de053c51e22 lrc: 2/0,0 mode: PW/PW res: [0x2b8a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655336:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fff466fa/0x3234de053c51e1b lrc: 3/0,1 mode: PW/PW res: [0x2b8a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655339:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fff466fa/0x3234de053c51e1b lrc: 3/0,1 mode: PW/PW res: [0x2b8a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655340:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002897da4e/0x3234de053c51e22 lrc: 3/0,0 mode: PW/PW res: [0x2b8a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655342:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fff466fa/0x3234de053c51e1b lrc: 3/0,1 mode: PW/PW res: [0x2b8a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655345:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fff466fa/0x3234de053c51e1b lrc: 2/0,0 mode: PW/PW res: [0x2b8a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655345:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002897da4e/0x3234de053c51e22 lrc: 1/0,0 mode: --/PW res: [0x2b8a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655347:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002897da4e/0x3234de053c51e22 lrc: 0/0,0 mode: --/PW res: [0x2b8a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655359:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000281e99c0/0x3234de053c51e29 lrc: 2/0,0 mode: PW/PW res: [0x2b8a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655362:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000281e99c0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.655363:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000281e99c0/0x3234de053c51e29 lrc: 2/0,0 mode: PW/PW res: [0x2b8a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655365:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000281e99c0/0x3234de053c51e29 lrc: 3/0,0 mode: PW/PW res: [0x2b8a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655369:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000281e99c0/0x3234de053c51e29 lrc: 1/0,0 mode: --/PW res: [0x2b8a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655371:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000281e99c0/0x3234de053c51e29 lrc: 0/0,0 mode: --/PW res: [0x2b8a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.655382:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1394:39029:x1731745946497472:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 979us (1084us total) trans 12885079949 rc 0/0 00000100:00100000:1.0:1651529344.655385:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211893 00010000:00010000:0.0:1651529344.655389:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fff466fa/0x3234de053c51e1b lrc: 2/0,0 mode: PW/PW res: [0x2b8a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655392:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fff466fa already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.655392:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fff466fa/0x3234de053c51e1b lrc: 2/0,0 mode: PW/PW res: [0x2b8a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655395:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fff466fa/0x3234de053c51e1b lrc: 3/0,0 mode: PW/PW res: [0x2b8a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655406:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fff466fa/0x3234de053c51e1b lrc: 1/0,0 mode: --/PW res: [0x2b8a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655416:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fff466fa/0x3234de053c51e1b lrc: 0/0,0 mode: --/PW res: [0x2b8a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655424:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000174ef069/0x3234de053c51e14 lrc: 3/0,1 mode: PW/PW res: [0x2b8a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655427:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000174ef069/0x3234de053c51e14 lrc: 3/0,1 mode: PW/PW res: [0x2b8a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655430:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000174ef069/0x3234de053c51e14 lrc: 3/0,1 mode: PW/PW res: [0x2b8a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655433:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000174ef069/0x3234de053c51e14 lrc: 2/0,0 mode: PW/PW res: [0x2b8a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.655447:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.655457:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.655469:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.655481:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.655481:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1394:39029:x1731745946497344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1137us (1210us total) trans 12885079950 rc 0/0 00000100:00100000:0.0:1651529344.655485:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211892 00000100:00100000:0.0:1651529344.655495:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d523a75 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997028288:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.655499:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006609c41a/0x3234de053c51e45 lrc: 3/0,1 mode: --/PW res: [0x2b8aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655505:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000174ef069/0x3234de053c51e14 lrc: 2/0,0 mode: PW/PW res: [0x2b8a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655508:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000174ef069 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.655509:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000174ef069/0x3234de053c51e14 lrc: 2/0,0 mode: PW/PW res: [0x2b8a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655512:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000174ef069/0x3234de053c51e14 lrc: 3/0,0 mode: PW/PW res: [0x2b8a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655516:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000174ef069/0x3234de053c51e14 lrc: 1/0,0 mode: --/PW res: [0x2b8a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655518:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000174ef069/0x3234de053c51e14 lrc: 0/0,0 mode: --/PW res: [0x2b8a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.655525:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396378752 00010000:00010000:0.0:1651529344.655530:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000406b6859/0x3234de053c4f078 lrc: 4/0,0 mode: PR/PR res: [0x2b8a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d74ca expref: 670 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.655535:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396378880 00010000:00010000:0.0:1651529344.655538:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000103b2d5e/0x3234de053c4e971 lrc: 4/0,0 mode: PR/PR res: [0x2b8a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5703 expref: 671 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.655540:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000050bbb886 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997028224:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.655542:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396379008 00010000:00010000:0.0:1651529344.655544:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008934356d/0x3234de053c4e73a lrc: 4/0,0 mode: PR/PR res: [0x2b8ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4de8 expref: 672 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.655545:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ff3c900b/0x3234de053c51e3e lrc: 3/0,1 mode: --/PW res: [0x2b8ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.655548:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396379136 00010000:00010000:0.0:1651529344.655550:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004da4611f/0x3234de053c4f5aa lrc: 4/0,0 mode: PR/PR res: [0x2b8aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8922 expref: 673 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.655553:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12678 00000100:00100000:1.0:1651529344.655555:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+673:41279:x1731746396378752:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.655556:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12679 00010000:00010000:1.0:1651529344.655558:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.655558:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+673:41279:x1731746396378880:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.655560:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000406b6859/0x3234de053c4f078 lrc: 4/0,0 mode: PR/PR res: [0x2b8a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d74ca expref: 673 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.655561:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.655562:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000103b2d5e/0x3234de053c4e971 lrc: 4/0,0 mode: PR/PR res: [0x2b8a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5703 expref: 673 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.655564:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000406b6859/0x3234de053c4f078 lrc: 3/0,0 mode: PR/PR res: [0x2b8a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d74ca expref: 673 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.655569:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000406b6859/0x3234de053c4f078 lrc: 0/0,0 mode: --/PR res: [0x2b8a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d74ca expref: 673 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.655573:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.655574:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.655575:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a6f87d2f/0x3234de053c51e30 lrc: 3/0,1 mode: PW/PW res: [0x2b8a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655578:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6f87d2f/0x3234de053c51e30 lrc: 4/0,1 mode: PW/PW res: [0x2b8a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655582:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000103b2d5e/0x3234de053c4e971 lrc: 3/0,0 mode: PR/PR res: [0x2b8a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5703 expref: 672 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.655584:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.655588:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000103b2d5e/0x3234de053c4e971 lrc: 0/0,0 mode: --/PR res: [0x2b8a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5703 expref: 672 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.655592:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.655592:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.655597:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+671:41279:x1731746396378752:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 41us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.655599:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12678 00010000:00010000:0.0:1651529344.655599:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002cac510f/0x3234de053c51e37 lrc: 3/0,1 mode: PW/PW res: [0x2b8a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.655605:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12680 00010000:00010000:0.0:1651529344.655605:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cac510f/0x3234de053c51e37 lrc: 4/0,1 mode: PW/PW res: [0x2b8a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.655607:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000066a4e147 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+670:41279:x1731746396379008:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.655609:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.655611:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008934356d/0x3234de053c4e73a lrc: 4/0,0 mode: PR/PR res: [0x2b8ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4de8 expref: 670 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.655611:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.655615:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008934356d/0x3234de053c4e73a lrc: 3/0,0 mode: PR/PR res: [0x2b8ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4de8 expref: 670 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.655619:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+670:41279:x1731746396378880:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 60us (161us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.655620:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008934356d/0x3234de053c4e73a lrc: 0/0,0 mode: --/PR res: [0x2b8ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4de8 expref: 670 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.655621:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12679 00010000:00010000:1.0:1651529344.655623:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.655624:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.655625:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff3c900b/0x3234de053c51e3e lrc: 3/0,1 mode: PW/PW res: [0x2b8ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.655627:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12681 00000100:00100000:0.0:1651529344.655629:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+668:41279:x1731746396379136:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.655630:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff3c900b/0x3234de053c51e3e lrc: 4/0,1 mode: PW/PW res: [0x2b8ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655631:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.655632:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004da4611f/0x3234de053c4f5aa lrc: 4/0,0 mode: PR/PR res: [0x2b8aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8922 expref: 668 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.655636:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.655636:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004da4611f/0x3234de053c4f5aa lrc: 3/0,0 mode: PR/PR res: [0x2b8aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8922 expref: 668 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.655641:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000066a4e147 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+668:41279:x1731746396379008:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 34us (172us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.655641:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004da4611f/0x3234de053c4f5aa lrc: 0/0,0 mode: --/PR res: [0x2b8aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8922 expref: 668 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.655643:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12680 00010000:00010000:0.0:1651529344.655645:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.655645:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.655646:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006609c41a/0x3234de053c51e45 lrc: 3/0,1 mode: PW/PW res: [0x2b8aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655649:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006609c41a/0x3234de053c51e45 lrc: 4/0,1 mode: PW/PW res: [0x2b8aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655654:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a6f87d2f/0x3234de053c51e30 lrc: 3/0,1 mode: PW/PW res: [0x2b8a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655657:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6f87d2f/0x3234de053c51e30 lrc: 3/0,1 mode: PW/PW res: [0x2b8a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655657:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.655660:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6f87d2f/0x3234de053c51e30 lrc: 3/0,1 mode: PW/PW res: [0x2b8a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.655662:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+666:41279:x1731746396379136:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 33us (181us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.655663:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6f87d2f/0x3234de053c51e30 lrc: 2/0,0 mode: PW/PW res: [0x2b8a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.655664:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12681 00010000:00010000:0.0:1651529344.655703:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002cac510f/0x3234de053c51e37 lrc: 3/0,1 mode: PW/PW res: [0x2b8a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655707:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002cac510f/0x3234de053c51e37 lrc: 3/0,1 mode: PW/PW res: [0x2b8a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655710:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cac510f/0x3234de053c51e37 lrc: 3/0,1 mode: PW/PW res: [0x2b8a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.655711:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1394:39030:x1731745946497792:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1102us (1206us total) trans 12885079951 rc 0/0 00010000:00010000:0.0:1651529344.655712:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002cac510f/0x3234de053c51e37 lrc: 2/0,0 mode: PW/PW res: [0x2b8a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.655713:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211896 00010000:00010000:1.0:1651529344.655720:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ff3c900b/0x3234de053c51e3e lrc: 3/0,1 mode: PW/PW res: [0x2b8ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655723:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff3c900b/0x3234de053c51e3e lrc: 3/0,1 mode: PW/PW res: [0x2b8ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655727:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff3c900b/0x3234de053c51e3e lrc: 3/0,1 mode: PW/PW res: [0x2b8ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655729:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ff3c900b/0x3234de053c51e3e lrc: 2/0,0 mode: PW/PW res: [0x2b8ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.655769:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1395:39029:x1731745946497856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1158us (1252us total) trans 12885079952 rc 0/0 00000100:00100000:0.0:1651529344.655772:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211897 00010000:00010000:0.0:1651529344.655779:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006609c41a/0x3234de053c51e45 lrc: 3/0,1 mode: PW/PW res: [0x2b8aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.655780:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfc79d4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1394:39030:x1731745946498304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1115us (1216us total) trans 12885079953 rc 0/0 00000100:00100000:1.0:1651529344.655783:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211898 00010000:00010000:0.0:1651529344.655783:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006609c41a/0x3234de053c51e45 lrc: 3/0,1 mode: PW/PW res: [0x2b8aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655786:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006609c41a/0x3234de053c51e45 lrc: 3/0,1 mode: PW/PW res: [0x2b8aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655789:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006609c41a/0x3234de053c51e45 lrc: 2/0,0 mode: PW/PW res: [0x2b8aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.655818:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.655821:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1394:39029:x1731745946498240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1138us (1245us total) trans 12885079954 rc 0/0 00000100:00100000:0.0:1651529344.655823:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211899 00000100:00100000:0.0:1651529344.655828:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946498368 00000100:00100000:1.0:1651529344.655832:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.655835:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946498432 00000100:00100000:0.0:1651529344.655839:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211900 00000100:00100000:0.0:1651529344.655841:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1395:39029:x1731745946498368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.655843:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.655845:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178348 count 1 00010000:00010000:0.0:1651529344.655849:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000561ebbe2/0x3234de053c51e4c lrc: 3/0,1 mode: --/PW res: [0x2b8ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.655852:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.655854:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e27cb552/0x3234de053c4eda0 lrc: 2/0,0 mode: PR/PR res: [0x2b8ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6916 expref: 665 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.655865:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.655866:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.655867:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000561ebbe2/0x3234de053c51e4c lrc: 4/0,1 mode: --/PW res: [0x2b8ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655874:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e27cb552/0x3234de053c4eda0 lrc: 3/0,0 mode: PR/PR res: [0x2b8ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6916 expref: 665 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.655878:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e27cb552/0x3234de053c4eda0 lrc: 4/0,0 mode: PR/PR res: [0x2b8ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6916 expref: 665 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.655882:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d523a75 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997028352:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.655891:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000504ef660 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.655896:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6f87d2f/0x3234de053c51e30 lrc: 2/0,0 mode: PW/PW res: [0x2b8a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655899:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6f87d2f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.655900:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6f87d2f/0x3234de053c51e30 lrc: 2/0,0 mode: PW/PW res: [0x2b8a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655903:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6f87d2f/0x3234de053c51e30 lrc: 3/0,0 mode: PW/PW res: [0x2b8a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655907:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6f87d2f/0x3234de053c51e30 lrc: 1/0,0 mode: --/PW res: [0x2b8a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655910:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6f87d2f/0x3234de053c51e30 lrc: 0/0,0 mode: --/PW res: [0x2b8a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.655926:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946498496 00010000:00010000:0.0:1651529344.655931:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002cac510f/0x3234de053c51e37 lrc: 2/0,0 mode: PW/PW res: [0x2b8a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.655933:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946498560 00000100:00100000:1.0:1651529344.655941:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211901 00000100:00100000:1.0:1651529344.655942:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1397:39030:x1731745946498432:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.655948:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178349 count 1 00010000:00010000:0.0:1651529344.655950:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002cac510f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.655951:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002cac510f/0x3234de053c51e37 lrc: 2/0,0 mode: PW/PW res: [0x2b8a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655952:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a902d314/0x3234de053c51e53 lrc: 3/0,1 mode: --/PW res: [0x2b8ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655953:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002cac510f/0x3234de053c51e37 lrc: 3/0,0 mode: PW/PW res: [0x2b8a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655957:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000069393391/0x3234de053c4d607 lrc: 2/0,0 mode: PR/PR res: [0x2b8ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d09a1 expref: 665 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.655958:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002cac510f/0x3234de053c51e37 lrc: 1/0,0 mode: --/PW res: [0x2b8a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655960:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.655960:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cac510f/0x3234de053c51e37 lrc: 0/0,0 mode: --/PW res: [0x2b8a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655961:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.655962:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a902d314/0x3234de053c51e53 lrc: 4/0,1 mode: --/PW res: [0x2b8ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655964:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ff3c900b/0x3234de053c51e3e lrc: 2/0,0 mode: PW/PW res: [0x2b8ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655967:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ff3c900b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.655968:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff3c900b/0x3234de053c51e3e lrc: 2/0,0 mode: PW/PW res: [0x2b8ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655969:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000069393391/0x3234de053c4d607 lrc: 3/0,0 mode: PR/PR res: [0x2b8ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d09a1 expref: 665 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.655970:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff3c900b/0x3234de053c51e3e lrc: 3/0,0 mode: PW/PW res: [0x2b8ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.655973:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000069393391/0x3234de053c4d607 lrc: 4/0,0 mode: PR/PR res: [0x2b8ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d09a1 expref: 665 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.655974:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ff3c900b/0x3234de053c51e3e lrc: 1/0,0 mode: --/PW res: [0x2b8ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655976:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff3c900b/0x3234de053c51e3e lrc: 0/0,0 mode: --/PW res: [0x2b8ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.655977:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a4b486d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997028416:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.655979:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006609c41a/0x3234de053c51e45 lrc: 2/0,0 mode: PW/PW res: [0x2b8aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655982:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006609c41a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.655983:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006609c41a/0x3234de053c51e45 lrc: 2/0,0 mode: PW/PW res: [0x2b8aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655986:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006609c41a/0x3234de053c51e45 lrc: 3/0,0 mode: PW/PW res: [0x2b8aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.655988:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd96f074 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.655989:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006609c41a/0x3234de053c51e45 lrc: 1/0,0 mode: --/PW res: [0x2b8aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.655991:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006609c41a/0x3234de053c51e45 lrc: 0/0,0 mode: --/PW res: [0x2b8aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.655994:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211902 00000100:00100000:1.0:1651529344.655995:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1397:39029:x1731745946498496:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.656000:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178350 count 1 00000100:00100000:0.0:1651529344.656001:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211903 00010000:00010000:1.0:1651529344.656003:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009211dffb/0x3234de053c51e5a lrc: 3/0,1 mode: --/PW res: [0x2b8ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.656003:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1397:39030:x1731745946498560:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.656007:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005bdaff4a/0x3234de053c4ce4a lrc: 2/0,0 mode: PR/PR res: [0x2b8ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceab4 expref: 665 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.656008:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178351 count 1 00010000:00010000:1.0:1651529344.656010:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.656011:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.656011:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009211dffb/0x3234de053c51e5a lrc: 4/0,1 mode: --/PW res: [0x2b8ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.656011:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e8ef8f3/0x3234de053c51e61 lrc: 3/0,1 mode: --/PW res: [0x2b8af:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.656015:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008cf3b4c5/0x3234de053c4d336 lrc: 2/0,0 mode: PR/PR res: [0x2b8af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfeb1 expref: 665 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.656017:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005bdaff4a/0x3234de053c4ce4a lrc: 3/0,0 mode: PR/PR res: [0x2b8ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceab4 expref: 665 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.656018:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.656019:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.656019:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e8ef8f3/0x3234de053c51e61 lrc: 4/0,1 mode: --/PW res: [0x2b8af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.656023:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005bdaff4a/0x3234de053c4ce4a lrc: 4/0,0 mode: PR/PR res: [0x2b8ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceab4 expref: 665 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.656026:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997028480:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.656026:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008cf3b4c5/0x3234de053c4d336 lrc: 3/0,0 mode: PR/PR res: [0x2b8af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfeb1 expref: 665 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.656033:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cfa1ca05 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.656046:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008cf3b4c5/0x3234de053c4d336 lrc: 4/0,0 mode: PR/PR res: [0x2b8af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfeb1 expref: 665 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.656051:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.656051:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000023afca5e pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997028544:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.656070:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e7e12492 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.656076:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946498688 00000100:00100000:0.0:1651529344.656088:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211904 00000100:00100000:0.0:1651529344.656089:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1398:39030:x1731745946498688:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.656094:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178353 count 1 00010000:00010000:0.0:1651529344.656098:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea03f360/0x3234de053c51e68 lrc: 3/0,1 mode: --/PW res: [0x2b8b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.656102:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c4e06b lrc: 2/0,0 mode: PR/PR res: [0x2b8b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d327b expref: 665 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.656105:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.656106:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.656106:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.656107:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea03f360/0x3234de053c51e68 lrc: 4/0,1 mode: --/PW res: [0x2b8b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.656113:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c4e06b lrc: 3/0,0 mode: PR/PR res: [0x2b8b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d327b expref: 665 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.656116:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c4e06b lrc: 4/0,0 mode: PR/PR res: [0x2b8b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d327b expref: 665 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.656123:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000913beefe pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997028608:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.656131:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c2b2b59c going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.656143:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946498624 00000100:00100000:0.0:1651529344.656153:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211905 00000100:00100000:0.0:1651529344.656155:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1399:39029:x1731745946498624:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.656159:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178352 count 1 00010000:00010000:0.0:1651529344.656163:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fb69f9f/0x3234de053c51e6f lrc: 3/0,1 mode: --/PW res: [0x2b8b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.656167:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005a2a8776/0x3234de053c4b808 lrc: 2/0,0 mode: PR/PR res: [0x2b8b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc3a8 expref: 665 pid: 80281 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.656168:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.656170:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.656170:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.656171:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008fb69f9f/0x3234de053c51e6f lrc: 4/0,1 mode: --/PW res: [0x2b8b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.656176:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.656177:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005a2a8776/0x3234de053c4b808 lrc: 3/0,0 mode: PR/PR res: [0x2b8b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc3a8 expref: 665 pid: 80281 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.656181:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005a2a8776/0x3234de053c4b808 lrc: 4/0,0 mode: PR/PR res: [0x2b8b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc3a8 expref: 665 pid: 80281 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.656183:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.656185:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000027e31dd1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997028672:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.656189:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946498816 00000100:00100000:1.0:1651529344.656194:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946498752 00000100:00100000:0.0:1651529344.656197:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000abca413e going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.656204:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211906 00000100:00100000:1.0:1651529344.656206:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211907 00000100:00100000:0.0:1651529344.656206:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1401:39030:x1731745946498816:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.656208:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1401:39029:x1731745946498752:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.656210:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178355 count 1 00002000:00080000:1.0:1651529344.656213:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178354 count 1 00010000:00010000:0.0:1651529344.656213:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066374bf8/0x3234de053c51e76 lrc: 3/0,1 mode: --/PW res: [0x2b8b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.656217:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073f23091/0x3234de053c51e7d lrc: 3/0,1 mode: --/PW res: [0x2b8b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.656217:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008e3070d2/0x3234de053c4c80e lrc: 2/0,0 mode: PR/PR res: [0x2b8b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd26c expref: 665 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.656220:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.656221:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b56504df/0x3234de053c4ea82 lrc: 2/0,0 mode: PR/PR res: [0x2b8b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5bd3 expref: 665 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.656221:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.656240:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.656240:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.656241:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073f23091/0x3234de053c51e7d lrc: 4/0,1 mode: --/PW res: [0x2b8b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.656251:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b56504df/0x3234de053c4ea82 lrc: 3/0,0 mode: PR/PR res: [0x2b8b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5bd3 expref: 665 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.656253:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066374bf8/0x3234de053c51e76 lrc: 4/0,1 mode: --/PW res: [0x2b8b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.656254:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b56504df/0x3234de053c4ea82 lrc: 4/0,0 mode: PR/PR res: [0x2b8b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5bd3 expref: 665 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.656258:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000999005e pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997028736:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.656262:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008e3070d2/0x3234de053c4c80e lrc: 3/0,0 mode: PR/PR res: [0x2b8b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd26c expref: 665 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.656266:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b7af823 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.656266:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008e3070d2/0x3234de053c4c80e lrc: 4/0,0 mode: PR/PR res: [0x2b8b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd26c expref: 665 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.656270:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000012863683 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997028800:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.656275:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396379520 00010000:00010000:1.0:1651529344.656279:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e27cb552/0x3234de053c4eda0 lrc: 5/0,0 mode: PR/PR res: [0x2b8ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6916 expref: 666 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.656290:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12682 00000100:00100000:1.0:1651529344.656292:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+666:41279:x1731746396379520:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.656295:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.656295:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c4075652 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.656296:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e27cb552/0x3234de053c4eda0 lrc: 5/0,0 mode: PR/PR res: [0x2b8ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6916 expref: 666 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.656300:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e27cb552/0x3234de053c4eda0 lrc: 4/0,0 mode: PR/PR res: [0x2b8ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6916 expref: 666 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.656303:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d523a75 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997028352:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.656306:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e27cb552/0x3234de053c4eda0 lrc: 0/0,0 mode: --/PR res: [0x2b8ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6916 expref: 666 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.656309:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.656310:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.656311:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000561ebbe2/0x3234de053c51e4c lrc: 3/0,1 mode: PW/PW res: [0x2b8ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.656314:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000561ebbe2/0x3234de053c51e4c lrc: 4/0,1 mode: PW/PW res: [0x2b8ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.656318:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.656318:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000561ebbe2/0x3234de053c51e4c lrc: 4/0,1 mode: PW/PW res: [0x2b8ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.656322:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000561ebbe2/0x3234de053c51e4c lrc: 3/0,1 mode: PW/PW res: [0x2b8ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.656324:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+665:41279:x1731746396379520:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 32us (148us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.656325:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000561ebbe2/0x3234de053c51e4c lrc: 3/0,1 mode: PW/PW res: [0x2b8ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.656327:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12682 00010000:00010000:0.0:1651529344.656328:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000561ebbe2/0x3234de053c51e4c lrc: 3/0,1 mode: PW/PW res: [0x2b8ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.656331:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000561ebbe2/0x3234de053c51e4c lrc: 2/0,0 mode: PW/PW res: [0x2b8ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.656370:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1402:39029:x1731745946498368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 529us (552us total) trans 12885079955 rc 0/0 00000100:00100000:0.0:1651529344.656373:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211900 00000100:00100000:1.0:1651529344.656378:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.656380:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000561ebbe2/0x3234de053c51e4c lrc: 2/0,0 mode: PW/PW res: [0x2b8ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.656383:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000561ebbe2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.656384:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000561ebbe2/0x3234de053c51e4c lrc: 2/0,0 mode: PW/PW res: [0x2b8ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.656387:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000561ebbe2/0x3234de053c51e4c lrc: 3/0,0 mode: PW/PW res: [0x2b8ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.656392:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000561ebbe2/0x3234de053c51e4c lrc: 1/0,0 mode: --/PW res: [0x2b8ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.656394:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000561ebbe2/0x3234de053c51e4c lrc: 0/0,0 mode: --/PW res: [0x2b8ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.656416:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997028480:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.656420:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009211dffb/0x3234de053c51e5a lrc: 3/0,1 mode: --/PW res: [0x2b8ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.656447:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396379584 00010000:00010000:0.0:1651529344.656453:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005bdaff4a/0x3234de053c4ce4a lrc: 4/0,0 mode: PR/PR res: [0x2b8ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceab4 expref: 665 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.656454:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a4b486d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997028416:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.656471:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a902d314/0x3234de053c51e53 lrc: 3/0,1 mode: --/PW res: [0x2b8ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.656476:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12683 00000100:00100000:0.0:1651529344.656478:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+665:41278:x1731746396379584:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.656481:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.656483:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.656483:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005bdaff4a/0x3234de053c4ce4a lrc: 4/0,0 mode: PR/PR res: [0x2b8ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceab4 expref: 665 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.656487:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005bdaff4a/0x3234de053c4ce4a lrc: 3/0,0 mode: PR/PR res: [0x2b8ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceab4 expref: 665 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.656492:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005bdaff4a/0x3234de053c4ce4a lrc: 0/0,0 mode: --/PR res: [0x2b8ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceab4 expref: 665 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.656502:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.656510:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.656516:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396379648 00010000:00010000:1.0:1651529344.656521:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000069393391/0x3234de053c4d607 lrc: 4/0,0 mode: PR/PR res: [0x2b8ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d09a1 expref: 666 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.656522:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.656523:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.656524:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009211dffb/0x3234de053c51e5a lrc: 3/0,1 mode: PW/PW res: [0x2b8ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.656526:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396379712 00010000:00010000:1.0:1651529344.656528:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008cf3b4c5/0x3234de053c4d336 lrc: 5/0,0 mode: PR/PR res: [0x2b8af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfeb1 expref: 666 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.656532:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396379776 00010000:00010000:1.0:1651529344.656534:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c4e06b lrc: 5/0,0 mode: PR/PR res: [0x2b8b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d327b expref: 667 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.656541:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009211dffb/0x3234de053c51e5a lrc: 4/0,1 mode: PW/PW res: [0x2b8ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.656545:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12684 00000100:00100000:1.0:1651529344.656547:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+667:41278:x1731746396379648:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.656549:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.656554:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.656556:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000069393391/0x3234de053c4d607 lrc: 4/0,0 mode: PR/PR res: [0x2b8ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d09a1 expref: 667 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.656557:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+667:41278:x1731746396379584:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 79us (179us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.656560:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000069393391/0x3234de053c4d607 lrc: 3/0,0 mode: PR/PR res: [0x2b8ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d09a1 expref: 667 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.656560:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12683 00010000:00010000:1.0:1651529344.656565:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069393391/0x3234de053c4d607 lrc: 0/0,0 mode: --/PR res: [0x2b8ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d09a1 expref: 666 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.656565:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12685 00000100:00100000:0.0:1651529344.656567:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+666:41279:x1731746396379712:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.656569:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.656570:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.656571:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a902d314/0x3234de053c51e53 lrc: 3/0,1 mode: PW/PW res: [0x2b8ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.656574:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a902d314/0x3234de053c51e53 lrc: 4/0,1 mode: PW/PW res: [0x2b8ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.656580:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.656581:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.656584:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008cf3b4c5/0x3234de053c4d336 lrc: 5/0,0 mode: PR/PR res: [0x2b8af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfeb1 expref: 665 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.656587:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+665:41278:x1731746396379648:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 39us (104us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.656588:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008cf3b4c5/0x3234de053c4d336 lrc: 4/0,0 mode: PR/PR res: [0x2b8af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfeb1 expref: 665 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.656589:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12684 00010000:00010000:0.0:1651529344.656593:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.656593:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.656594:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12686 00010000:00010000:0.0:1651529344.656594:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005e8ef8f3/0x3234de053c51e61 lrc: 3/0,1 mode: PW/PW res: [0x2b8af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.656596:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+664:41279:x1731746396379776:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.656597:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e8ef8f3/0x3234de053c51e61 lrc: 4/0,1 mode: PW/PW res: [0x2b8af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.656598:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.656599:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c4e06b lrc: 5/0,0 mode: PR/PR res: [0x2b8b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d327b expref: 664 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.656602:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.656603:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c4e06b lrc: 4/0,0 mode: PR/PR res: [0x2b8b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d327b expref: 664 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.656607:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.656607:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+664:41279:x1731746396379712:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 39us (105us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.656608:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.656609:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea03f360/0x3234de053c51e68 lrc: 3/0,1 mode: PW/PW res: [0x2b8b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.656610:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12685 00010000:00010000:1.0:1651529344.656611:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea03f360/0x3234de053c51e68 lrc: 4/0,1 mode: PW/PW res: [0x2b8b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.656616:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.656620:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+663:41279:x1731746396379776:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 24us (111us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.656621:0:72395:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c4e06b lrc: 0/0,0 mode: --/PR res: [0x2b8b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d327b expref: 663 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.656623:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12686 00000100:00100000:0.0:1651529344.656625:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000913beefe pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997028608:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.656628:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ea03f360/0x3234de053c51e68 lrc: 3/0,1 mode: PW/PW res: [0x2b8b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.656629:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009211dffb/0x3234de053c51e5a lrc: 3/0,1 mode: PW/PW res: [0x2b8ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.656631:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ea03f360/0x3234de053c51e68 lrc: 3/0,1 mode: PW/PW res: [0x2b8b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.656633:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009211dffb/0x3234de053c51e5a lrc: 3/0,1 mode: PW/PW res: [0x2b8ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.656634:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea03f360/0x3234de053c51e68 lrc: 3/0,1 mode: PW/PW res: [0x2b8b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.656636:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009211dffb/0x3234de053c51e5a lrc: 3/0,1 mode: PW/PW res: [0x2b8ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.656637:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea03f360/0x3234de053c51e68 lrc: 3/0,1 mode: PW/PW res: [0x2b8b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.656639:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009211dffb/0x3234de053c51e5a lrc: 2/0,0 mode: PW/PW res: [0x2b8ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.656640:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea03f360/0x3234de053c51e68 lrc: 2/0,0 mode: PW/PW res: [0x2b8b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.656691:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1403:39029:x1731745946498496:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 695us (847us total) trans 12885079956 rc 0/0 00000100:00100000:1.0:1651529344.656694:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211902 00010000:00010000:1.0:1651529344.656701:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a902d314/0x3234de053c51e53 lrc: 3/0,1 mode: PW/PW res: [0x2b8ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.656704:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a902d314/0x3234de053c51e53 lrc: 3/0,1 mode: PW/PW res: [0x2b8ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.656707:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a902d314/0x3234de053c51e53 lrc: 3/0,1 mode: PW/PW res: [0x2b8ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.656710:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a902d314/0x3234de053c51e53 lrc: 2/0,0 mode: PW/PW res: [0x2b8ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.656710:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1402:39030:x1731745946498688:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 620us (659us total) trans 12885079957 rc 0/0 00000100:00100000:0.0:1651529344.656713:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211904 00010000:00010000:0.0:1651529344.656731:0:156655:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008cf3b4c5/0x3234de053c4d336 lrc: 0/0,0 mode: --/PR res: [0x2b8af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfeb1 expref: 661 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.656744:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000023afca5e pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997028544:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.656748:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005e8ef8f3/0x3234de053c51e61 lrc: 3/0,1 mode: PW/PW res: [0x2b8af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.656751:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005e8ef8f3/0x3234de053c51e61 lrc: 3/0,1 mode: PW/PW res: [0x2b8af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.656756:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e8ef8f3/0x3234de053c51e61 lrc: 3/0,1 mode: PW/PW res: [0x2b8af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.656757:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1402:39030:x1731745946498432:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 814us (925us total) trans 12885079958 rc 0/0 00010000:00010000:0.0:1651529344.656759:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e8ef8f3/0x3234de053c51e61 lrc: 3/0,1 mode: PW/PW res: [0x2b8af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.656760:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211901 00010000:00010000:0.0:1651529344.656762:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e8ef8f3/0x3234de053c51e61 lrc: 2/0,0 mode: PW/PW res: [0x2b8af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.656775:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.656804:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1402:39030:x1731745946498560:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 801us (951us total) trans 12885079959 rc 0/0 00000100:00100000:0.0:1651529344.656807:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211903 00000100:00100000:0.0:1651529344.656818:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946499392 00000100:00100000:1.0:1651529344.656820:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.656824:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211908 00000100:00100000:0.0:1651529344.656826:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1402:39030:x1731745946499392:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.656830:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178356 count 1 00010000:00010000:0.0:1651529344.656834:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8a7fbb1/0x3234de053c51e84 lrc: 3/0,1 mode: --/PW res: [0x2b8b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.656839:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b11923f6/0x3234de053c4c663 lrc: 2/0,0 mode: PR/PR res: [0x2b8b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb8f expref: 660 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.656842:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.656843:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.656844:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8a7fbb1/0x3234de053c51e84 lrc: 4/0,1 mode: --/PW res: [0x2b8b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.656850:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.656852:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b11923f6/0x3234de053c4c663 lrc: 3/0,0 mode: PR/PR res: [0x2b8b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb8f expref: 660 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.656856:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b11923f6/0x3234de053c4c663 lrc: 4/0,0 mode: PR/PR res: [0x2b8b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb8f expref: 660 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.656860:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000023afca5e pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997028864:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.656869:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b81e4a0 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.656874:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009211dffb/0x3234de053c51e5a lrc: 2/0,0 mode: PW/PW res: [0x2b8ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.656877:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009211dffb already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.656878:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009211dffb/0x3234de053c51e5a lrc: 2/0,0 mode: PW/PW res: [0x2b8ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.656880:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.656881:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009211dffb/0x3234de053c51e5a lrc: 3/0,0 mode: PW/PW res: [0x2b8ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.656885:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009211dffb/0x3234de053c51e5a lrc: 1/0,0 mode: --/PW res: [0x2b8ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.656888:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009211dffb/0x3234de053c51e5a lrc: 0/0,0 mode: --/PW res: [0x2b8ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.656892:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea03f360/0x3234de053c51e68 lrc: 2/0,0 mode: PW/PW res: [0x2b8b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.656897:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ea03f360 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.656898:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea03f360/0x3234de053c51e68 lrc: 2/0,0 mode: PW/PW res: [0x2b8b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.656900:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea03f360/0x3234de053c51e68 lrc: 3/0,0 mode: PW/PW res: [0x2b8b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.656903:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea03f360/0x3234de053c51e68 lrc: 1/0,0 mode: --/PW res: [0x2b8b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.656906:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea03f360/0x3234de053c51e68 lrc: 0/0,0 mode: --/PW res: [0x2b8b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.656909:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a902d314/0x3234de053c51e53 lrc: 2/0,0 mode: PW/PW res: [0x2b8ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.656912:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a902d314 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.656913:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a902d314/0x3234de053c51e53 lrc: 2/0,0 mode: PW/PW res: [0x2b8ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.656915:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a902d314/0x3234de053c51e53 lrc: 3/0,0 mode: PW/PW res: [0x2b8ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.656918:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a902d314/0x3234de053c51e53 lrc: 1/0,0 mode: --/PW res: [0x2b8ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.656921:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a902d314/0x3234de053c51e53 lrc: 0/0,0 mode: --/PW res: [0x2b8ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.656925:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e8ef8f3/0x3234de053c51e61 lrc: 2/0,0 mode: PW/PW res: [0x2b8af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.656928:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000999005e pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997028736:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.656932:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000073f23091/0x3234de053c51e7d lrc: 3/0,1 mode: --/PW res: [0x2b8b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.656940:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396379904 00010000:00010000:0.0:1651529344.656943:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005e8ef8f3 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.656945:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b56504df/0x3234de053c4ea82 lrc: 4/0,0 mode: PR/PR res: [0x2b8b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5bd3 expref: 661 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.656945:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e8ef8f3/0x3234de053c51e61 lrc: 2/0,0 mode: PW/PW res: [0x2b8af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.656947:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e8ef8f3/0x3234de053c51e61 lrc: 3/0,0 mode: PW/PW res: [0x2b8af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.656955:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396379840 00010000:00010000:1.0:1651529344.656957:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005a2a8776/0x3234de053c4b808 lrc: 5/0,0 mode: PR/PR res: [0x2b8b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc3a8 expref: 662 pid: 80281 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.656962:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396379968 00010000:00010000:1.0:1651529344.656964:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008e3070d2/0x3234de053c4c80e lrc: 5/0,0 mode: PR/PR res: [0x2b8b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd26c expref: 663 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.656967:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e8ef8f3/0x3234de053c51e61 lrc: 1/0,0 mode: --/PW res: [0x2b8af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.656968:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12687 00000100:00100000:1.0:1651529344.656970:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ccd58b65 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+663:41279:x1731746396379904:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.656971:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e8ef8f3/0x3234de053c51e61 lrc: 0/0,0 mode: --/PW res: [0x2b8af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.656972:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.656974:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b56504df/0x3234de053c4ea82 lrc: 4/0,0 mode: PR/PR res: [0x2b8b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5bd3 expref: 663 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.656977:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b56504df/0x3234de053c4ea82 lrc: 3/0,0 mode: PR/PR res: [0x2b8b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5bd3 expref: 663 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.656983:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000027e31dd1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997028672:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.656985:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b56504df/0x3234de053c4ea82 lrc: 0/0,0 mode: --/PR res: [0x2b8b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5bd3 expref: 663 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.656987:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008fb69f9f/0x3234de053c51e6f lrc: 3/0,1 mode: --/PW res: [0x2b8b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.656989:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.656990:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.656991:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000073f23091/0x3234de053c51e7d lrc: 3/0,1 mode: PW/PW res: [0x2b8b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.656993:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000012863683 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997028800:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.656994:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073f23091/0x3234de053c51e7d lrc: 4/0,1 mode: PW/PW res: [0x2b8b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.656995:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000066374bf8/0x3234de053c51e76 lrc: 3/0,1 mode: --/PW res: [0x2b8b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657000:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.657003:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12688 00000100:00100000:0.0:1651529344.657005:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+662:41278:x1731746396379840:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.657008:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ccd58b65 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+662:41279:x1731746396379904:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 38us (189us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.657008:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.657010:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005a2a8776/0x3234de053c4b808 lrc: 4/0,0 mode: PR/PR res: [0x2b8b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc3a8 expref: 662 pid: 80281 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.657011:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12687 00010000:00010000:0.0:1651529344.657014:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005a2a8776/0x3234de053c4b808 lrc: 3/0,0 mode: PR/PR res: [0x2b8b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc3a8 expref: 661 pid: 80281 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.657019:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12689 00000100:00100000:1.0:1651529344.657021:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+661:41278:x1731746396379968:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.657024:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.657025:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008e3070d2/0x3234de053c4c80e lrc: 4/0,0 mode: PR/PR res: [0x2b8b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd26c expref: 661 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.657029:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008e3070d2/0x3234de053c4c80e lrc: 3/0,0 mode: PR/PR res: [0x2b8b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd26c expref: 661 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.657033:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e3070d2/0x3234de053c4c80e lrc: 0/0,0 mode: --/PR res: [0x2b8b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd26c expref: 661 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.657034:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a2a8776/0x3234de053c4b808 lrc: 0/0,0 mode: --/PR res: [0x2b8b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc3a8 expref: 661 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.657039:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.657040:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.657041:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000066374bf8/0x3234de053c51e76 lrc: 3/0,1 mode: PW/PW res: [0x2b8b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657043:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066374bf8/0x3234de053c51e76 lrc: 4/0,1 mode: PW/PW res: [0x2b8b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657047:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.657048:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.657048:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008fb69f9f/0x3234de053c51e6f lrc: 3/0,1 mode: PW/PW res: [0x2b8b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657052:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.657057:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+659:41278:x1731746396379968:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 35us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.657060:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12689 00010000:00010000:1.0:1651529344.657066:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000073f23091/0x3234de053c51e7d lrc: 3/0,1 mode: PW/PW res: [0x2b8b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657066:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008fb69f9f/0x3234de053c51e6f lrc: 4/0,1 mode: PW/PW res: [0x2b8b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657069:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073f23091/0x3234de053c51e7d lrc: 3/0,1 mode: PW/PW res: [0x2b8b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657072:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073f23091/0x3234de053c51e7d lrc: 3/0,1 mode: PW/PW res: [0x2b8b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657073:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.657075:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073f23091/0x3234de053c51e7d lrc: 2/0,0 mode: PW/PW res: [0x2b8b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.657087:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+658:41278:x1731746396379840:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 75us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.657090:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12688 00010000:00010000:0.0:1651529344.657097:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000066374bf8/0x3234de053c51e76 lrc: 3/0,1 mode: PW/PW res: [0x2b8b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657100:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066374bf8/0x3234de053c51e76 lrc: 3/0,1 mode: PW/PW res: [0x2b8b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657105:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066374bf8/0x3234de053c51e76 lrc: 3/0,1 mode: PW/PW res: [0x2b8b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657108:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066374bf8/0x3234de053c51e76 lrc: 2/0,0 mode: PW/PW res: [0x2b8b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.657116:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1403:39029:x1731745946498752:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 907us (933us total) trans 12885079960 rc 0/0 00000100:00100000:1.0:1651529344.657119:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211907 00000100:00100000:0.0:1651529344.657146:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1403:39030:x1731745946498816:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 940us (978us total) trans 12885079961 rc 0/0 00000100:00100000:0.0:1651529344.657149:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211906 00000100:00100000:1.0:1651529344.657154:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.657156:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008fb69f9f/0x3234de053c51e6f lrc: 3/0,1 mode: PW/PW res: [0x2b8b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657166:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008fb69f9f/0x3234de053c51e6f lrc: 3/0,1 mode: PW/PW res: [0x2b8b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657169:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fb69f9f/0x3234de053c51e6f lrc: 3/0,1 mode: PW/PW res: [0x2b8b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.657172:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.657172:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008fb69f9f/0x3234de053c51e6f lrc: 2/0,0 mode: PW/PW res: [0x2b8b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.657182:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.657192:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.657212:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1403:39029:x1731745946498624:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1056us (1112us total) trans 12885079962 rc 0/0 00000100:00100000:0.0:1651529344.657215:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211905 00000100:00100000:0.0:1651529344.657220:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946499520 00000100:00100000:0.0:1651529344.657243:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946499456 00000100:00100000:0.0:1651529344.657248:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946499648 00000100:00100000:0.0:1651529344.657253:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946499584 00000100:00100000:0.0:1651529344.657257:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211909 00000100:00100000:0.0:1651529344.657258:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1406:39029:x1731745946499520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.657263:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178358 count 1 00010000:00010000:0.0:1651529344.657268:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c51e8b lrc: 3/0,1 mode: --/PW res: [0x2b8b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.657272:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211910 00010000:00010000:0.0:1651529344.657272:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cc418822/0x3234de053c4f2cb lrc: 2/0,0 mode: PR/PR res: [0x2b8b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e01 expref: 657 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.657275:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1406:39029:x1731745946499456:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.657275:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.657276:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.657277:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c51e8b lrc: 4/0,1 mode: --/PW res: [0x2b8b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.657280:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178357 count 1 00010000:00010000:0.0:1651529344.657283:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cc418822/0x3234de053c4f2cb lrc: 3/0,0 mode: PR/PR res: [0x2b8b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e01 expref: 657 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.657285:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081575d6c/0x3234de053c51e92 lrc: 3/0,1 mode: --/PW res: [0x2b8b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657286:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cc418822/0x3234de053c4f2cb lrc: 4/0,0 mode: PR/PR res: [0x2b8b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e01 expref: 657 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.657290:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a2e86fa1/0x3234de053c4e24e lrc: 2/0,0 mode: PR/PR res: [0x2b8b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a85 expref: 657 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.657293:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.657294:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.657294:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081575d6c/0x3234de053c51e92 lrc: 4/0,1 mode: --/PW res: [0x2b8b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657301:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a2e86fa1/0x3234de053c4e24e lrc: 3/0,0 mode: PR/PR res: [0x2b8b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a85 expref: 657 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.657304:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a2e86fa1/0x3234de053c4e24e lrc: 4/0,0 mode: PR/PR res: [0x2b8b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a85 expref: 657 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.657306:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000012863683 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997028928:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.657309:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bca72234 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997028992:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.657334:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 0000000070e666f7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.657337:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a6b79b05 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.657343:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211911 00000100:00100000:1.0:1651529344.657345:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1406:39029:x1731745946499648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.657350:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178360 count 1 00010000:00010000:0.0:1651529344.657350:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073f23091/0x3234de053c51e7d lrc: 2/0,0 mode: PW/PW res: [0x2b8b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657353:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001ccd9b7/0x3234de053c51e99 lrc: 3/0,1 mode: --/PW res: [0x2b8b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657354:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000073f23091 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.657355:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073f23091/0x3234de053c51e7d lrc: 2/0,0 mode: PW/PW res: [0x2b8b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657357:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002f5b5445/0x3234de053c4dc2e lrc: 2/0,0 mode: PR/PR res: [0x2b8b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2110 expref: 657 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.657358:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073f23091/0x3234de053c51e7d lrc: 3/0,0 mode: PW/PW res: [0x2b8b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657360:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.657361:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.657361:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001ccd9b7/0x3234de053c51e99 lrc: 4/0,1 mode: --/PW res: [0x2b8b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657367:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002f5b5445/0x3234de053c4dc2e lrc: 3/0,0 mode: PR/PR res: [0x2b8b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2110 expref: 657 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.657371:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002f5b5445/0x3234de053c4dc2e lrc: 4/0,0 mode: PR/PR res: [0x2b8b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2110 expref: 657 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.657371:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073f23091/0x3234de053c51e7d lrc: 1/0,0 mode: --/PW res: [0x2b8b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657374:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073f23091/0x3234de053c51e7d lrc: 0/0,0 mode: --/PW res: [0x2b8b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.657375:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000037ac96ac pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997029056:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.657379:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066374bf8/0x3234de053c51e76 lrc: 2/0,0 mode: PW/PW res: [0x2b8b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.657381:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fb6c773d going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.657382:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000066374bf8 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.657382:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066374bf8/0x3234de053c51e76 lrc: 2/0,0 mode: PW/PW res: [0x2b8b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657385:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066374bf8/0x3234de053c51e76 lrc: 3/0,0 mode: PW/PW res: [0x2b8b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657388:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066374bf8/0x3234de053c51e76 lrc: 1/0,0 mode: --/PW res: [0x2b8b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.657389:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211912 00000100:00100000:1.0:1651529344.657390:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006501eb7b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1406:39029:x1731745946499584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.657391:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066374bf8/0x3234de053c51e76 lrc: 0/0,0 mode: --/PW res: [0x2b8b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.657394:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178359 count 1 00010000:00010000:0.0:1651529344.657394:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008fb69f9f/0x3234de053c51e6f lrc: 2/0,0 mode: PW/PW res: [0x2b8b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657397:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008fb69f9f already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.657398:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c51ea0 lrc: 3/0,1 mode: --/PW res: [0x2b8b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657398:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008fb69f9f/0x3234de053c51e6f lrc: 2/0,0 mode: PW/PW res: [0x2b8b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657401:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008fb69f9f/0x3234de053c51e6f lrc: 3/0,0 mode: PW/PW res: [0x2b8b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657402:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c4a9c2ef/0x3234de053c4e175 lrc: 2/0,0 mode: PR/PR res: [0x2b8b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d36e9 expref: 657 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.657404:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008fb69f9f/0x3234de053c51e6f lrc: 1/0,0 mode: --/PW res: [0x2b8b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657405:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.657406:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.657406:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c51ea0 lrc: 4/0,1 mode: --/PW res: [0x2b8b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657411:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c4a9c2ef/0x3234de053c4e175 lrc: 3/0,0 mode: PR/PR res: [0x2b8b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d36e9 expref: 657 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.657415:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c4a9c2ef/0x3234de053c4e175 lrc: 4/0,0 mode: PR/PR res: [0x2b8b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d36e9 expref: 657 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.657418:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006e3eb319 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997029120:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.657423:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008fb69f9f/0x3234de053c51e6f lrc: 0/0,0 mode: --/PW res: [0x2b8b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.657424:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b7af823 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.657458:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.657469:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000023afca5e pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997028864:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.657478:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f8a7fbb1/0x3234de053c51e84 lrc: 3/0,1 mode: --/PW res: [0x2b8b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.657480:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.657485:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946499712 00000100:00100000:1.0:1651529344.657490:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.657499:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946499776 00000100:00100000:1.0:1651529344.657501:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.657511:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946499840 00000100:00100000:0.0:1651529344.657518:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211913 00000100:00100000:1.0:1651529344.657520:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396380544 00000100:00100000:0.0:1651529344.657520:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1409:39030:x1731745946499712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.657524:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178361 count 1 00010000:00010000:1.0:1651529344.657526:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b11923f6/0x3234de053c4c663 lrc: 4/0,0 mode: PR/PR res: [0x2b8b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb8f expref: 658 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.657528:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c51ea7 lrc: 3/0,1 mode: --/PW res: [0x2b8b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.657537:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12690 00000100:00100000:1.0:1651529344.657538:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+658:41278:x1731746396380544:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.657540:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009fe80686/0x3234de053c4e6ca lrc: 2/0,0 mode: PR/PR res: [0x2b8b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4bbf expref: 658 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.657541:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.657542:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b11923f6/0x3234de053c4c663 lrc: 4/0,0 mode: PR/PR res: [0x2b8b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb8f expref: 658 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.657544:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.657544:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.657545:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c51ea7 lrc: 4/0,1 mode: --/PW res: [0x2b8b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657549:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b11923f6/0x3234de053c4c663 lrc: 3/0,0 mode: PR/PR res: [0x2b8b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb8f expref: 658 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.657551:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009fe80686/0x3234de053c4e6ca lrc: 3/0,0 mode: PR/PR res: [0x2b8b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4bbf expref: 658 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.657554:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b11923f6/0x3234de053c4c663 lrc: 0/0,0 mode: --/PR res: [0x2b8b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb8f expref: 658 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.657555:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009fe80686/0x3234de053c4e6ca lrc: 4/0,0 mode: PR/PR res: [0x2b8b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4bbf expref: 658 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.657558:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.657559:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.657559:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f8a7fbb1/0x3234de053c51e84 lrc: 3/0,1 mode: PW/PW res: [0x2b8b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.657559:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000023afca5e pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997029184:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.657562:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8a7fbb1/0x3234de053c51e84 lrc: 4/0,1 mode: PW/PW res: [0x2b8b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.657568:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060852af0 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.657570:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.657578:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+657:41278:x1731746396380544:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.657579:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211914 00000100:00100000:1.0:1651529344.657580:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12690 00000100:00100000:0.0:1651529344.657581:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1409:39030:x1731745946499776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.657586:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178362 count 1 00000100:00100000:1.0:1651529344.657588:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211915 00010000:00010000:0.0:1651529344.657589:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c51eae lrc: 3/0,1 mode: --/PW res: [0x2b8ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.657590:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1409:39030:x1731745946499840:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.657593:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006b1b3a7a/0x3234de053c4f53a lrc: 2/0,0 mode: PR/PR res: [0x2b8ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8738 expref: 656 pid: 156655 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.657594:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178363 count 1 00010000:00010000:0.0:1651529344.657596:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.657597:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.657598:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c51eb5 lrc: 3/0,1 mode: --/PW res: [0x2b8bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657598:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c51eae lrc: 4/0,1 mode: --/PW res: [0x2b8ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.657602:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d2c0ea84/0x3234de053c4d964 lrc: 2/0,0 mode: PR/PR res: [0x2b8bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1612 expref: 656 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.657604:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006b1b3a7a/0x3234de053c4f53a lrc: 3/0,0 mode: PR/PR res: [0x2b8ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8738 expref: 656 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.657607:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.657607:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006b1b3a7a/0x3234de053c4f53a lrc: 4/0,0 mode: PR/PR res: [0x2b8ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8738 expref: 656 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.657608:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.657608:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c51eb5 lrc: 4/0,1 mode: --/PW res: [0x2b8bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.657611:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000913beefe pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997029248:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.657615:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d2c0ea84/0x3234de053c4d964 lrc: 3/0,0 mode: PR/PR res: [0x2b8bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1612 expref: 656 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.657618:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d2c0ea84/0x3234de053c4d964 lrc: 4/0,0 mode: PR/PR res: [0x2b8bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1612 expref: 656 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.657618:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c0dff858 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.657622:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ad6d0877 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997029312:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.657623:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f8a7fbb1/0x3234de053c51e84 lrc: 3/0,1 mode: PW/PW res: [0x2b8b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657626:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8a7fbb1/0x3234de053c51e84 lrc: 3/0,1 mode: PW/PW res: [0x2b8b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657629:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8a7fbb1/0x3234de053c51e84 lrc: 3/0,1 mode: PW/PW res: [0x2b8b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.657630:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd96f074 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.657632:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8a7fbb1/0x3234de053c51e84 lrc: 2/0,0 mode: PW/PW res: [0x2b8b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.657678:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1410:39030:x1731745946499392:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 851us (903us total) trans 12885079963 rc 0/0 00000100:00100000:0.0:1651529344.657682:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211908 00010000:00010000:0.0:1651529344.657689:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8a7fbb1/0x3234de053c51e84 lrc: 2/0,0 mode: PW/PW res: [0x2b8b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657693:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f8a7fbb1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.657694:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8a7fbb1/0x3234de053c51e84 lrc: 2/0,0 mode: PW/PW res: [0x2b8b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657697:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8a7fbb1/0x3234de053c51e84 lrc: 3/0,0 mode: PW/PW res: [0x2b8b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657701:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8a7fbb1/0x3234de053c51e84 lrc: 1/0,0 mode: --/PW res: [0x2b8b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657704:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8a7fbb1/0x3234de053c51e84 lrc: 0/0,0 mode: --/PW res: [0x2b8b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.657856:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.657868:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946499904 00000100:00100000:0.0:1651529344.657878:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211916 00000100:00100000:0.0:1651529344.657880:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1410:39030:x1731745946499904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.657885:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178364 count 1 00010000:00010000:0.0:1651529344.657890:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c51ebc lrc: 3/0,1 mode: --/PW res: [0x2b8bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657894:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000089184c32/0x3234de053c4c934 lrc: 2/0,0 mode: PR/PR res: [0x2b8bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd647 expref: 656 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.657897:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.657898:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.657898:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c51ebc lrc: 4/0,1 mode: --/PW res: [0x2b8bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.657906:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000089184c32/0x3234de053c4c934 lrc: 3/0,0 mode: PR/PR res: [0x2b8bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd647 expref: 656 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.657909:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000089184c32/0x3234de053c4c934 lrc: 4/0,0 mode: PR/PR res: [0x2b8bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd647 expref: 656 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.657913:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d523a75 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997029376:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.657924:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 0000000029ae2bb2 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.658219:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000012863683 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997028928:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.658259:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c51e8b lrc: 3/0,1 mode: --/PW res: [0x2b8b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.658284:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.658286:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000023afca5e pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997029184:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.658294:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.658295:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c51ea7 lrc: 3/0,1 mode: --/PW res: [0x2b8b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.658301:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.658303:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000913beefe pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997029248:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.658305:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c51eae lrc: 3/0,1 mode: --/PW res: [0x2b8ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.658308:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.658312:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396380608 00000100:00100000:1.0:1651529344.658315:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.658317:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a2e86fa1/0x3234de053c4e24e lrc: 5/0,0 mode: PR/PR res: [0x2b8b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a85 expref: 657 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.658319:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.658324:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.658325:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396380736 00010000:00010000:0.0:1651529344.658327:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002f5b5445/0x3234de053c4dc2e lrc: 5/0,0 mode: PR/PR res: [0x2b8b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2110 expref: 658 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.658336:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.658338:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396380672 00010000:00010000:0.0:1651529344.658341:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cc418822/0x3234de053c4f2cb lrc: 4/0,0 mode: PR/PR res: [0x2b8b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e01 expref: 659 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.658344:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bca72234 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997028992:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.658345:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396380864 00010000:00010000:0.0:1651529344.658347:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009fe80686/0x3234de053c4e6ca lrc: 4/0,0 mode: PR/PR res: [0x2b8b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4bbf expref: 660 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.658349:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000081575d6c/0x3234de053c51e92 lrc: 3/0,1 mode: --/PW res: [0x2b8b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.658351:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396380800 00010000:00010000:0.0:1651529344.658353:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c4a9c2ef/0x3234de053c4e175 lrc: 5/0,0 mode: PR/PR res: [0x2b8b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d36e9 expref: 661 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.658357:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396380992 00000100:00100000:1.0:1651529344.658358:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000037ac96ac pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997029056:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.658359:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d2c0ea84/0x3234de053c4d964 lrc: 5/0,0 mode: PR/PR res: [0x2b8bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1612 expref: 662 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.658361:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000001ccd9b7/0x3234de053c51e99 lrc: 3/0,1 mode: --/PW res: [0x2b8b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.658363:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396380928 00010000:00010000:0.0:1651529344.658364:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006b1b3a7a/0x3234de053c4f53a lrc: 4/0,0 mode: PR/PR res: [0x2b8ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8738 expref: 663 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.658367:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006e3eb319 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997029120:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.658368:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396381056 00010000:00010000:1.0:1651529344.658369:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c51ea0 lrc: 3/0,1 mode: --/PW res: [0x2b8b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.658370:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000089184c32/0x3234de053c4c934 lrc: 5/0,0 mode: PR/PR res: [0x2b8bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd647 expref: 664 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.658374:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ad6d0877 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997029312:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.658377:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c51eb5 lrc: 3/0,1 mode: --/PW res: [0x2b8bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.658377:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12691 00000100:00100000:0.0:1651529344.658379:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+664:41278:x1731746396380608:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.658382:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.658383:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12692 00010000:00010000:0.0:1651529344.658384:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a2e86fa1/0x3234de053c4e24e lrc: 4/0,0 mode: PR/PR res: [0x2b8b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a85 expref: 664 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.658385:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+664:41278:x1731746396380736:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.658387:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a2e86fa1/0x3234de053c4e24e lrc: 3/0,0 mode: PR/PR res: [0x2b8b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a85 expref: 664 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.658388:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.658390:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002f5b5445/0x3234de053c4dc2e lrc: 4/0,0 mode: PR/PR res: [0x2b8b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2110 expref: 664 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.658393:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2e86fa1/0x3234de053c4e24e lrc: 0/0,0 mode: --/PR res: [0x2b8b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a85 expref: 664 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.658394:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002f5b5445/0x3234de053c4dc2e lrc: 3/0,0 mode: PR/PR res: [0x2b8b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2110 expref: 664 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.658397:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.658397:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.658398:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000081575d6c/0x3234de053c51e92 lrc: 3/0,1 mode: PW/PW res: [0x2b8b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.658399:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f5b5445/0x3234de053c4dc2e lrc: 0/0,0 mode: --/PR res: [0x2b8b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2110 expref: 663 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.658401:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081575d6c/0x3234de053c51e92 lrc: 4/0,1 mode: PW/PW res: [0x2b8b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.658406:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.658406:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.658407:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000001ccd9b7/0x3234de053c51e99 lrc: 3/0,1 mode: PW/PW res: [0x2b8b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.658412:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.658417:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001ccd9b7/0x3234de053c51e99 lrc: 4/0,1 mode: PW/PW res: [0x2b8b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.658422:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+662:41278:x1731746396380608:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (138us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.658423:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.658425:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12691 00000100:00100000:1.0:1651529344.658430:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+661:41278:x1731746396380736:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 45us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.658430:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12693 00000100:00100000:0.0:1651529344.658431:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+661:41279:x1731746396380672:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.658433:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12692 00010000:00010000:0.0:1651529344.658434:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.658436:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cc418822/0x3234de053c4f2cb lrc: 4/0,0 mode: PR/PR res: [0x2b8b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e01 expref: 661 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.658439:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12694 00010000:00010000:0.0:1651529344.658440:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cc418822/0x3234de053c4f2cb lrc: 3/0,0 mode: PR/PR res: [0x2b8b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e01 expref: 660 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.658441:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6d06412 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+660:41278:x1731746396380864:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.658443:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.658445:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009fe80686/0x3234de053c4e6ca lrc: 4/0,0 mode: PR/PR res: [0x2b8b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4bbf expref: 660 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.658445:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc418822/0x3234de053c4f2cb lrc: 0/0,0 mode: --/PR res: [0x2b8b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e01 expref: 660 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.658448:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.658449:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009fe80686/0x3234de053c4e6ca lrc: 3/0,0 mode: PR/PR res: [0x2b8b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4bbf expref: 659 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.658449:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.658449:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c51e8b lrc: 3/0,1 mode: PW/PW res: [0x2b8b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.658452:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c51e8b lrc: 4/0,1 mode: PW/PW res: [0x2b8b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.658453:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fe80686/0x3234de053c4e6ca lrc: 0/0,0 mode: --/PR res: [0x2b8b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4bbf expref: 659 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.658457:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.658458:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.658458:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c51ea7 lrc: 3/0,1 mode: PW/PW res: [0x2b8b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.658458:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.658461:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c51ea7 lrc: 4/0,1 mode: PW/PW res: [0x2b8b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.658463:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+658:41279:x1731746396380672:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 31us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.658465:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12693 00010000:00010000:1.0:1651529344.658471:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.658476:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6d06412 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+657:41278:x1731746396380864:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.658476:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12695 00000100:00100000:0.0:1651529344.658478:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+657:41279:x1731746396380800:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.658479:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12694 00010000:00010000:0.0:1651529344.658480:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.658482:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c4a9c2ef/0x3234de053c4e175 lrc: 4/0,0 mode: PR/PR res: [0x2b8b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d36e9 expref: 656 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.658488:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12696 00010000:00010000:0.0:1651529344.658488:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c4a9c2ef/0x3234de053c4e175 lrc: 3/0,0 mode: PR/PR res: [0x2b8b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d36e9 expref: 656 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.658489:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+656:41278:x1731746396380992:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.658492:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.658493:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d2c0ea84/0x3234de053c4d964 lrc: 4/0,0 mode: PR/PR res: [0x2b8bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1612 expref: 656 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.658493:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4a9c2ef/0x3234de053c4e175 lrc: 0/0,0 mode: --/PR res: [0x2b8b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d36e9 expref: 656 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.658496:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.658496:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.658497:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d2c0ea84/0x3234de053c4d964 lrc: 3/0,0 mode: PR/PR res: [0x2b8bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1612 expref: 655 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.658497:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c51ea0 lrc: 3/0,1 mode: PW/PW res: [0x2b8b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.658500:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c51ea0 lrc: 4/0,1 mode: PW/PW res: [0x2b8b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.658501:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2c0ea84/0x3234de053c4d964 lrc: 0/0,0 mode: --/PR res: [0x2b8bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1612 expref: 655 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.658505:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.658505:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.658506:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c51eb5 lrc: 3/0,1 mode: PW/PW res: [0x2b8bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.658509:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.658515:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+654:41279:x1731746396380800:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 36us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.658517:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12695 00010000:00010000:1.0:1651529344.658518:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c51eb5 lrc: 4/0,1 mode: PW/PW res: [0x2b8bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.658522:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12697 00000100:00100000:0.0:1651529344.658523:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+653:41279:x1731746396380928:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.658524:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.658526:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.658527:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006b1b3a7a/0x3234de053c4f53a lrc: 4/0,0 mode: PR/PR res: [0x2b8ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8738 expref: 653 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.658530:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+653:41278:x1731746396380992:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (210us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.658531:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006b1b3a7a/0x3234de053c4f53a lrc: 3/0,0 mode: PR/PR res: [0x2b8ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8738 expref: 653 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.658532:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12696 00010000:00010000:0.0:1651529344.658535:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b1b3a7a/0x3234de053c4f53a lrc: 0/0,0 mode: --/PR res: [0x2b8ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8738 expref: 652 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.658537:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12698 00000100:00100000:1.0:1651529344.658538:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+651:41279:x1731746396381056:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.658539:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.658539:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.658540:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c51eae lrc: 3/0,1 mode: PW/PW res: [0x2b8ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.658541:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.658542:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000089184c32/0x3234de053c4c934 lrc: 5/0,0 mode: PR/PR res: [0x2b8bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd647 expref: 651 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.658543:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c51eae lrc: 4/0,1 mode: PW/PW res: [0x2b8ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.658546:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000089184c32/0x3234de053c4c934 lrc: 4/0,0 mode: PR/PR res: [0x2b8bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd647 expref: 651 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.658549:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.658550:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.658551:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.658551:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c51ebc lrc: 3/0,1 mode: PW/PW res: [0x2b8bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.658553:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+651:41279:x1731746396380928:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 29us (229us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.658554:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c51ebc lrc: 4/0,1 mode: PW/PW res: [0x2b8bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.658556:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12697 00010000:00010000:1.0:1651529344.658558:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.658561:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c51eae lrc: 3/0,1 mode: PW/PW res: [0x2b8ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.658562:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+650:41279:x1731746396381056:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 24us (227us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.658564:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c51eae lrc: 3/0,1 mode: PW/PW res: [0x2b8ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.658565:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12698 00010000:00010000:0.0:1651529344.658567:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c51eae lrc: 3/0,1 mode: PW/PW res: [0x2b8ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.658570:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c51eae lrc: 2/0,0 mode: PW/PW res: [0x2b8ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.658574:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c51eb5 lrc: 3/0,1 mode: PW/PW res: [0x2b8bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.658577:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c51eb5 lrc: 3/0,1 mode: PW/PW res: [0x2b8bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.658580:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c51eb5 lrc: 3/0,1 mode: PW/PW res: [0x2b8bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.658583:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c51eb5 lrc: 2/0,0 mode: PW/PW res: [0x2b8bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.658626:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1412:39030:x1731745946499776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1044us (1135us total) trans 12885079964 rc 0/0 00000100:00100000:0.0:1651529344.658629:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211914 00000100:00100000:1.0:1651529344.658635:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1411:39030:x1731745946499840:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1044us (1134us total) trans 12885079965 rc 0/0 00010000:00010000:0.0:1651529344.658637:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c51eae lrc: 2/0,0 mode: PW/PW res: [0x2b8ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.658638:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211915 00010000:00010000:0.0:1651529344.658640:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008288bff7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.658642:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c51eae lrc: 2/0,0 mode: PW/PW res: [0x2b8ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.658644:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c51eae lrc: 3/0,0 mode: PW/PW res: [0x2b8ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.658645:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c51ea0 lrc: 3/0,1 mode: PW/PW res: [0x2b8b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.658648:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c51ea0 lrc: 3/0,1 mode: PW/PW res: [0x2b8b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.658649:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c51eae lrc: 1/0,0 mode: --/PW res: [0x2b8ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.658651:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c51ea0 lrc: 3/0,1 mode: PW/PW res: [0x2b8b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.658652:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008288bff7/0x3234de053c51eae lrc: 0/0,0 mode: --/PW res: [0x2b8ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.658654:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c51ea0 lrc: 2/0,0 mode: PW/PW res: [0x2b8b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.658656:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c51eb5 lrc: 2/0,0 mode: PW/PW res: [0x2b8bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.658659:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c9b39253 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.658659:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c51eb5 lrc: 2/0,0 mode: PW/PW res: [0x2b8bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.658670:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c51eb5 lrc: 3/0,0 mode: PW/PW res: [0x2b8bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.658674:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c51eb5 lrc: 1/0,0 mode: --/PW res: [0x2b8bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.658677:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c51eb5 lrc: 0/0,0 mode: --/PW res: [0x2b8bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.658681:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c51ea0 lrc: 2/0,0 mode: PW/PW res: [0x2b8b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.658683:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009fd52982 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.658684:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c51ea0 lrc: 2/0,0 mode: PW/PW res: [0x2b8b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.658687:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c51ea0 lrc: 3/0,0 mode: PW/PW res: [0x2b8b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.658690:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c51ea0 lrc: 1/0,0 mode: --/PW res: [0x2b8b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.658693:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c51ea0 lrc: 0/0,0 mode: --/PW res: [0x2b8b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.658694:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006501eb7b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1411:39029:x1731745946499584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1303us (1502us total) trans 12885079966 rc 0/0 00000100:00100000:1.0:1651529344.658697:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211912 00010000:00010000:0.0:1651529344.658699:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c51e8b lrc: 3/0,1 mode: PW/PW res: [0x2b8b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.658704:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000001ccd9b7/0x3234de053c51e99 lrc: 3/0,1 mode: PW/PW res: [0x2b8b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.658704:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c51e8b lrc: 3/0,1 mode: PW/PW res: [0x2b8b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.658707:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001ccd9b7/0x3234de053c51e99 lrc: 3/0,1 mode: PW/PW res: [0x2b8b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.658707:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c51e8b lrc: 3/0,1 mode: PW/PW res: [0x2b8b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.658710:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001ccd9b7/0x3234de053c51e99 lrc: 3/0,1 mode: PW/PW res: [0x2b8b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.658710:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c51e8b lrc: 2/0,0 mode: PW/PW res: [0x2b8b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.658713:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001ccd9b7/0x3234de053c51e99 lrc: 2/0,0 mode: PW/PW res: [0x2b8b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.658762:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1412:39029:x1731745946499520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1502us (1607us total) trans 12885079967 rc 0/0 00000100:00100000:1.0:1651529344.658763:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1412:39029:x1731745946499648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1417us (1580us total) trans 12885079968 rc 0/0 00000100:00100000:0.0:1651529344.658765:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211909 00000100:00100000:1.0:1651529344.658766:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211911 00010000:00010000:0.0:1651529344.658772:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c51e8b lrc: 2/0,0 mode: PW/PW res: [0x2b8b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.658773:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000081575d6c/0x3234de053c51e92 lrc: 3/0,1 mode: PW/PW res: [0x2b8b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.658775:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003c571c06 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.658776:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c51e8b lrc: 2/0,0 mode: PW/PW res: [0x2b8b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.658777:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081575d6c/0x3234de053c51e92 lrc: 3/0,1 mode: PW/PW res: [0x2b8b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.658779:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c51e8b lrc: 3/0,0 mode: PW/PW res: [0x2b8b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.658780:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081575d6c/0x3234de053c51e92 lrc: 3/0,1 mode: PW/PW res: [0x2b8b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.658783:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c51e8b lrc: 1/0,0 mode: --/PW res: [0x2b8b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.658785:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081575d6c/0x3234de053c51e92 lrc: 2/0,0 mode: PW/PW res: [0x2b8b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.658786:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c571c06/0x3234de053c51e8b lrc: 0/0,0 mode: --/PW res: [0x2b8b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.658791:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001ccd9b7/0x3234de053c51e99 lrc: 2/0,0 mode: PW/PW res: [0x2b8b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.658800:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000001ccd9b7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.658801:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001ccd9b7/0x3234de053c51e99 lrc: 2/0,0 mode: PW/PW res: [0x2b8b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.658804:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001ccd9b7/0x3234de053c51e99 lrc: 3/0,0 mode: PW/PW res: [0x2b8b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.658807:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001ccd9b7/0x3234de053c51e99 lrc: 1/0,0 mode: --/PW res: [0x2b8b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.658810:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001ccd9b7/0x3234de053c51e99 lrc: 0/0,0 mode: --/PW res: [0x2b8b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.658813:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081575d6c/0x3234de053c51e92 lrc: 2/0,0 mode: PW/PW res: [0x2b8b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.658816:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000081575d6c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.658817:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081575d6c/0x3234de053c51e92 lrc: 2/0,0 mode: PW/PW res: [0x2b8b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.658819:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081575d6c/0x3234de053c51e92 lrc: 3/0,0 mode: PW/PW res: [0x2b8b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.658820:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1411:39029:x1731745946499456:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1545us (1648us total) trans 12885079969 rc 0/0 00000100:00100000:1.0:1651529344.658822:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211910 00010000:00010000:0.0:1651529344.658822:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081575d6c/0x3234de053c51e92 lrc: 1/0,0 mode: --/PW res: [0x2b8b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.658825:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081575d6c/0x3234de053c51e92 lrc: 0/0,0 mode: --/PW res: [0x2b8b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.658831:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c51ea7 lrc: 3/0,1 mode: PW/PW res: [0x2b8b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.658834:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c51ea7 lrc: 3/0,1 mode: PW/PW res: [0x2b8b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.658837:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c51ea7 lrc: 3/0,1 mode: PW/PW res: [0x2b8b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.658840:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c51ea7 lrc: 2/0,0 mode: PW/PW res: [0x2b8b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.658875:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1411:39030:x1731745946499712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1354us (1417us total) trans 12885079970 rc 0/0 00000100:00100000:0.0:1651529344.658878:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211913 00010000:00010000:0.0:1651529344.658884:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c51ea7 lrc: 2/0,0 mode: PW/PW res: [0x2b8b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.658887:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a520645e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.658888:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c51ea7 lrc: 2/0,0 mode: PW/PW res: [0x2b8b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.658891:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c51ea7 lrc: 3/0,0 mode: PW/PW res: [0x2b8b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.658896:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c51ea7 lrc: 1/0,0 mode: --/PW res: [0x2b8b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.658899:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a520645e/0x3234de053c51ea7 lrc: 0/0,0 mode: --/PW res: [0x2b8b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.658908:0:156655:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089184c32/0x3234de053c4c934 lrc: 0/0,0 mode: --/PR res: [0x2b8bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd647 expref: 649 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.658912:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d523a75 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997029376:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.658915:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c51ebc lrc: 3/0,1 mode: PW/PW res: [0x2b8bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.658918:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c51ebc lrc: 3/0,1 mode: PW/PW res: [0x2b8bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.658921:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c51ebc lrc: 3/0,1 mode: PW/PW res: [0x2b8bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.658924:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c51ebc lrc: 3/0,1 mode: PW/PW res: [0x2b8bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.658926:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c51ebc lrc: 2/0,0 mode: PW/PW res: [0x2b8bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.658996:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1411:39030:x1731745946499904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1114us (1139us total) trans 12885079971 rc 0/0 00000100:00100000:0.0:1651529344.658999:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211916 00010000:00010000:0.0:1651529344.659006:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c51ebc lrc: 2/0,0 mode: PW/PW res: [0x2b8bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659010:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d3d72adb already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.659011:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c51ebc lrc: 2/0,0 mode: PW/PW res: [0x2b8bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659014:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c51ebc lrc: 3/0,0 mode: PW/PW res: [0x2b8bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659018:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c51ebc lrc: 1/0,0 mode: --/PW res: [0x2b8bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659021:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3d72adb/0x3234de053c51ebc lrc: 0/0,0 mode: --/PW res: [0x2b8bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.659053:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.659081:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946500480 00000100:00100000:0.0:1651529344.659089:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211917 00000100:00100000:0.0:1651529344.659091:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1411:39030:x1731745946500480:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.659096:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178365 count 1 00010000:00010000:0.0:1651529344.659100:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7a2d4e3/0x3234de053c51ec3 lrc: 3/0,1 mode: --/PW res: [0x2b8bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659118:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e7e9cb7d/0x3234de053c4c869 lrc: 2/0,0 mode: PR/PR res: [0x2b8bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd392 expref: 648 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.659123:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.659124:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.659125:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7a2d4e3/0x3234de053c51ec3 lrc: 4/0,1 mode: --/PW res: [0x2b8bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659132:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e7e9cb7d/0x3234de053c4c869 lrc: 3/0,0 mode: PR/PR res: [0x2b8bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd392 expref: 648 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.659136:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e7e9cb7d/0x3234de053c4c869 lrc: 4/0,0 mode: PR/PR res: [0x2b8bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd392 expref: 648 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.659140:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d523a75 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997029440:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.659168:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 0000000029ae2bb2 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.659194:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.659202:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.659211:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946500544 00000100:00100000:0.0:1651529344.659211:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.659220:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.659249:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946500608 00000100:00100000:0.0:1651529344.659280:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946500736 00000100:00100000:1.0:1651529344.659283:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946500672 00000100:00100000:0.0:1651529344.659290:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211918 00000100:00100000:1.0:1651529344.659292:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211919 00000100:00100000:0.0:1651529344.659292:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1415:39029:x1731745946500544:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.659294:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1415:39030:x1731745946500608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.659297:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178366 count 1 00002000:00080000:1.0:1651529344.659299:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178367 count 1 00010000:00010000:0.0:1651529344.659301:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3ae24c2/0x3234de053c51eca lrc: 3/0,1 mode: --/PW res: [0x2b8be:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659304:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054dd6f57/0x3234de053c51ed1 lrc: 3/0,1 mode: --/PW res: [0x2b8bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659305:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c4d5a5 lrc: 2/0,0 mode: PR/PR res: [0x2b8be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d080b expref: 648 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.659309:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005415bfd7/0x3234de053c4c846 lrc: 2/0,0 mode: PR/PR res: [0x2b8bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd33e expref: 648 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.659311:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.659311:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.659312:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.659312:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3ae24c2/0x3234de053c51eca lrc: 4/0,1 mode: --/PW res: [0x2b8be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659313:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.659313:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054dd6f57/0x3234de053c51ed1 lrc: 4/0,1 mode: --/PW res: [0x2b8bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659318:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c4d5a5 lrc: 3/0,0 mode: PR/PR res: [0x2b8be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d080b expref: 648 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.659320:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005415bfd7/0x3234de053c4c846 lrc: 3/0,0 mode: PR/PR res: [0x2b8bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd33e expref: 648 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.659322:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c4d5a5 lrc: 4/0,0 mode: PR/PR res: [0x2b8be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d080b expref: 648 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.659326:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005415bfd7/0x3234de053c4c846 lrc: 4/0,0 mode: PR/PR res: [0x2b8bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd33e expref: 648 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.659330:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a13808c6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997029568:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.659340:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a6b79b05 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.659343:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd68fdd5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997029504:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.659346:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211920 00000100:00100000:1.0:1651529344.659348:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1415:39030:x1731745946500736:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.659352:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178369 count 1 00000100:00100000:0.0:1651529344.659352:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e68b7e1f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.659355:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004eba1bc5/0x3234de053c51ed8 lrc: 3/0,1 mode: --/PW res: [0x2b8c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659359:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bfb6dba2/0x3234de053c4e9fd lrc: 2/0,0 mode: PR/PR res: [0x2b8c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5979 expref: 648 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.659359:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211921 00000100:00100000:0.0:1651529344.659361:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1415:39029:x1731745946500672:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.659362:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.659363:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.659364:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004eba1bc5/0x3234de053c51ed8 lrc: 4/0,1 mode: --/PW res: [0x2b8c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.659366:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178368 count 1 00010000:00010000:1.0:1651529344.659369:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bfb6dba2/0x3234de053c4e9fd lrc: 3/0,0 mode: PR/PR res: [0x2b8c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5979 expref: 648 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.659373:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bfb6dba2/0x3234de053c4e9fd lrc: 4/0,0 mode: PR/PR res: [0x2b8c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5979 expref: 648 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.659379:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006647e4ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997029632:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.659382:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099354594/0x3234de053c51edf lrc: 3/0,1 mode: --/PW res: [0x2b8c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.659385:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000499d0377 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.659387:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000219276c2/0x3234de053c4d233 lrc: 2/0,0 mode: PR/PR res: [0x2b8c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa5f expref: 648 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.659390:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.659391:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.659391:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099354594/0x3234de053c51edf lrc: 4/0,1 mode: --/PW res: [0x2b8c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659400:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000219276c2/0x3234de053c4d233 lrc: 3/0,0 mode: PR/PR res: [0x2b8c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa5f expref: 648 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.659402:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.659404:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000219276c2/0x3234de053c4d233 lrc: 4/0,0 mode: PR/PR res: [0x2b8c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa5f expref: 648 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.659408:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000034e35367 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997029696:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.659416:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000504ef660 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.659430:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946500864 00000100:00100000:1.0:1651529344.659432:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.659440:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946500800 00000100:00100000:0.0:1651529344.659447:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211922 00000100:00100000:0.0:1651529344.659448:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1417:39030:x1731745946500864:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.659453:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178371 count 1 00010000:00010000:0.0:1651529344.659457:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1093027/0x3234de053c51ee6 lrc: 3/0,1 mode: --/PW res: [0x2b8c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659461:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000084459261/0x3234de053c4d32f lrc: 2/0,0 mode: PR/PR res: [0x2b8c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfeaa expref: 648 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.659464:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.659464:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.659465:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.659466:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1093027/0x3234de053c51ee6 lrc: 4/0,1 mode: --/PW res: [0x2b8c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659472:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000084459261/0x3234de053c4d32f lrc: 3/0,0 mode: PR/PR res: [0x2b8c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfeaa expref: 648 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.659477:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000084459261/0x3234de053c4d32f lrc: 4/0,0 mode: PR/PR res: [0x2b8c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfeaa expref: 648 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.659481:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d9cfef26 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997029760:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.659488:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 0000000070e666f7 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.659496:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d523a75 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997029440:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.659499:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e7a2d4e3/0x3234de053c51ec3 lrc: 3/0,1 mode: --/PW res: [0x2b8bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.659502:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.659513:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946500928 00000100:00100000:0.0:1651529344.659522:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211923 00000100:00100000:1.0:1651529344.659527:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211924 00000100:00100000:1.0:1651529344.659528:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1418:39029:x1731745946500928:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.659533:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178372 count 1 00010000:00010000:1.0:1651529344.659537:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074951e29/0x3234de053c51eed lrc: 3/0,1 mode: --/PW res: [0x2b8c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.659537:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1418:39029:x1731745946500800:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.659542:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000021be5e77/0x3234de053c4f4a0 lrc: 2/0,0 mode: PR/PR res: [0x2b8c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8524 expref: 648 pid: 72396 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.659542:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178370 count 1 00010000:00010000:1.0:1651529344.659545:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.659546:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.659546:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074951e29/0x3234de053c51eed lrc: 4/0,1 mode: --/PW res: [0x2b8c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659546:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b866be3a/0x3234de053c51ef4 lrc: 3/0,1 mode: --/PW res: [0x2b8c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659550:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c815f369/0x3234de053c4f01d lrc: 2/0,0 mode: PR/PR res: [0x2b8c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d730a expref: 648 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.659553:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000021be5e77/0x3234de053c4f4a0 lrc: 3/0,0 mode: PR/PR res: [0x2b8c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8524 expref: 648 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.659553:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.659554:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.659554:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b866be3a/0x3234de053c51ef4 lrc: 4/0,1 mode: --/PW res: [0x2b8c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659556:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000021be5e77/0x3234de053c4f4a0 lrc: 4/0,0 mode: PR/PR res: [0x2b8c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8524 expref: 648 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.659561:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c815f369/0x3234de053c4f01d lrc: 3/0,0 mode: PR/PR res: [0x2b8c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d730a expref: 648 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.659563:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000095d7eb1a pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997029824:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.659566:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c815f369/0x3234de053c4f01d lrc: 4/0,0 mode: PR/PR res: [0x2b8c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d730a expref: 648 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.659571:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 000000007d8fabda going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.659571:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d523a75 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997029888:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.659579:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396381632 00000100:00100000:0.0:1651529344.659579:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 0000000029ae2bb2 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.659583:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e7e9cb7d/0x3234de053c4c869 lrc: 4/0,0 mode: PR/PR res: [0x2b8bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd392 expref: 649 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.659591:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12699 00000100:00100000:1.0:1651529344.659592:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+649:41278:x1731746396381632:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.659595:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.659596:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e7e9cb7d/0x3234de053c4c869 lrc: 4/0,0 mode: PR/PR res: [0x2b8bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd392 expref: 649 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.659600:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e7e9cb7d/0x3234de053c4c869 lrc: 3/0,0 mode: PR/PR res: [0x2b8bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd392 expref: 649 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.659605:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7e9cb7d/0x3234de053c4c869 lrc: 0/0,0 mode: --/PR res: [0x2b8bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd392 expref: 649 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.659609:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.659609:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.659610:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e7a2d4e3/0x3234de053c51ec3 lrc: 3/0,1 mode: PW/PW res: [0x2b8bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659613:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7a2d4e3/0x3234de053c51ec3 lrc: 4/0,1 mode: PW/PW res: [0x2b8bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659629:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.659636:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+648:41278:x1731746396381632:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 43us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.659639:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12699 00010000:00010000:0.0:1651529344.659642:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e7a2d4e3/0x3234de053c51ec3 lrc: 3/0,1 mode: PW/PW res: [0x2b8bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659646:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7a2d4e3/0x3234de053c51ec3 lrc: 3/0,1 mode: PW/PW res: [0x2b8bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659650:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7a2d4e3/0x3234de053c51ec3 lrc: 3/0,1 mode: PW/PW res: [0x2b8bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.659651:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a13808c6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997029568:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.659655:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000054dd6f57/0x3234de053c51ed1 lrc: 3/0,1 mode: --/PW res: [0x2b8bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659661:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7a2d4e3/0x3234de053c51ec3 lrc: 2/0,0 mode: PW/PW res: [0x2b8bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.659708:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1419:39030:x1731745946500480:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 616us (655us total) trans 12885079972 rc 0/0 00000100:00100000:0.0:1651529344.659711:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211917 00010000:00010000:0.0:1651529344.659718:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7a2d4e3/0x3234de053c51ec3 lrc: 2/0,0 mode: PW/PW res: [0x2b8bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659722:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e7a2d4e3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.659723:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7a2d4e3/0x3234de053c51ec3 lrc: 2/0,0 mode: PW/PW res: [0x2b8bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659726:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7a2d4e3/0x3234de053c51ec3 lrc: 3/0,0 mode: PW/PW res: [0x2b8bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659731:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7a2d4e3/0x3234de053c51ec3 lrc: 1/0,0 mode: --/PW res: [0x2b8bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.659744:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7a2d4e3/0x3234de053c51ec3 lrc: 0/0,0 mode: --/PW res: [0x2b8bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.659755:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd68fdd5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997029504:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.659759:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006647e4ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997029632:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.659759:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a3ae24c2/0x3234de053c51eca lrc: 3/0,1 mode: --/PW res: [0x2b8be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659763:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004eba1bc5/0x3234de053c51ed8 lrc: 3/0,1 mode: --/PW res: [0x2b8c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.659893:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000034e35367 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997029696:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.659896:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000099354594/0x3234de053c51edf lrc: 3/0,1 mode: --/PW res: [0x2b8c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.659907:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.659916:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.659924:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.659934:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396381696 00000100:00100000:0.0:1651529344.659935:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.659945:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005415bfd7/0x3234de053c4c846 lrc: 4/0,0 mode: PR/PR res: [0x2b8bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd33e expref: 648 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.659947:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.659951:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396381824 00010000:00010000:1.0:1651529344.659954:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c4d5a5 lrc: 4/0,0 mode: PR/PR res: [0x2b8be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d080b expref: 649 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.659958:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396381760 00010000:00010000:1.0:1651529344.659960:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bfb6dba2/0x3234de053c4e9fd lrc: 4/0,0 mode: PR/PR res: [0x2b8c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5979 expref: 650 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.659960:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d9cfef26 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997029760:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.659964:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396381888 00010000:00010000:0.0:1651529344.659964:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f1093027/0x3234de053c51ee6 lrc: 3/0,1 mode: --/PW res: [0x2b8c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.659966:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000219276c2/0x3234de053c4d233 lrc: 4/0,0 mode: PR/PR res: [0x2b8c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa5f expref: 651 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.659971:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12700 00000100:00100000:1.0:1651529344.659972:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+651:41279:x1731746396381696:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.659975:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.659976:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005415bfd7/0x3234de053c4c846 lrc: 4/0,0 mode: PR/PR res: [0x2b8bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd33e expref: 651 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.659979:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005415bfd7/0x3234de053c4c846 lrc: 3/0,0 mode: PR/PR res: [0x2b8bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd33e expref: 651 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.659987:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946501504 00010000:00010000:1.0:1651529344.659991:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005415bfd7/0x3234de053c4c846 lrc: 0/0,0 mode: --/PR res: [0x2b8bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd33e expref: 651 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.659996:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211925 00000100:00100000:0.0:1651529344.659998:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1419:39030:x1731745946501504:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.659999:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.660000:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.660001:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000054dd6f57/0x3234de053c51ed1 lrc: 3/0,1 mode: PW/PW res: [0x2b8bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.660003:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178373 count 1 00010000:00010000:1.0:1651529344.660004:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054dd6f57/0x3234de053c51ed1 lrc: 4/0,1 mode: PW/PW res: [0x2b8bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660007:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c51efb lrc: 3/0,1 mode: --/PW res: [0x2b8c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.660010:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.660022:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+650:41279:x1731746396381696:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 49us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.660025:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12700 00000100:00100000:1.0:1651529344.660029:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12701 00010000:00010000:0.0:1651529344.660029:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000db5d109d/0x3234de053c4f683 lrc: 2/0,0 mode: PR/PR res: [0x2b8c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ccc expref: 649 pid: 156655 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.660031:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040f63b09 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+649:41278:x1731746396381824:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.660032:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.660033:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.660033:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c51efb lrc: 4/0,1 mode: --/PW res: [0x2b8c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.660034:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.660035:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c4d5a5 lrc: 4/0,0 mode: PR/PR res: [0x2b8be:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d080b expref: 649 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.660039:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c4d5a5 lrc: 3/0,0 mode: PR/PR res: [0x2b8be:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d080b expref: 649 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.660044:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c4d5a5 lrc: 0/0,0 mode: --/PR res: [0x2b8be:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d080b expref: 649 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.660047:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.660048:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.660048:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a3ae24c2/0x3234de053c51eca lrc: 3/0,1 mode: PW/PW res: [0x2b8be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660050:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000db5d109d/0x3234de053c4f683 lrc: 3/0,0 mode: PR/PR res: [0x2b8c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ccc expref: 648 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.660051:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3ae24c2/0x3234de053c51eca lrc: 4/0,1 mode: PW/PW res: [0x2b8be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660053:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000db5d109d/0x3234de053c4f683 lrc: 4/0,0 mode: PR/PR res: [0x2b8c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ccc expref: 648 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.660059:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.660063:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d9cfef26 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997029952:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.660064:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040f63b09 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+648:41278:x1731746396381824:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 33us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.660067:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12701 00000100:00100000:0.0:1651529344.660073:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000504ef660 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.660074:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12702 00000100:00100000:1.0:1651529344.660076:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+647:41279:x1731746396381760:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.660077:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a3ae24c2/0x3234de053c51eca lrc: 3/0,1 mode: PW/PW res: [0x2b8be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.660079:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.660080:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bfb6dba2/0x3234de053c4e9fd lrc: 4/0,0 mode: PR/PR res: [0x2b8c1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5979 expref: 647 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.660080:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3ae24c2/0x3234de053c51eca lrc: 3/0,1 mode: PW/PW res: [0x2b8be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.660083:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bfb6dba2/0x3234de053c4e9fd lrc: 3/0,0 mode: PR/PR res: [0x2b8c1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5979 expref: 647 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.660083:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3ae24c2/0x3234de053c51eca lrc: 3/0,1 mode: PW/PW res: [0x2b8be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660087:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3ae24c2/0x3234de053c51eca lrc: 2/0,0 mode: PW/PW res: [0x2b8be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.660088:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfb6dba2/0x3234de053c4e9fd lrc: 0/0,0 mode: --/PR res: [0x2b8c1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5979 expref: 647 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.660091:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.660092:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.660093:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004eba1bc5/0x3234de053c51ed8 lrc: 3/0,1 mode: PW/PW res: [0x2b8c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.660095:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004eba1bc5/0x3234de053c51ed8 lrc: 4/0,1 mode: PW/PW res: [0x2b8c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.660101:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.660106:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+646:41279:x1731746396381760:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 29us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.660108:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12702 00000100:00100000:1.0:1651529344.660112:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12703 00000100:00100000:1.0:1651529344.660113:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+645:41278:x1731746396381888:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.660115:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.660116:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000219276c2/0x3234de053c4d233 lrc: 4/0,0 mode: PR/PR res: [0x2b8c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa5f expref: 645 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.660120:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000219276c2/0x3234de053c4d233 lrc: 3/0,0 mode: PR/PR res: [0x2b8c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa5f expref: 645 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.660124:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000219276c2/0x3234de053c4d233 lrc: 0/0,0 mode: --/PR res: [0x2b8c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa5f expref: 645 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.660124:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1420:39029:x1731745946500544:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 832us (930us total) trans 12885079973 rc 0/0 00000100:00100000:0.0:1651529344.660127:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211918 00010000:00010000:1.0:1651529344.660128:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.660128:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.660129:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000099354594/0x3234de053c51edf lrc: 3/0,1 mode: PW/PW res: [0x2b8c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.660132:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099354594/0x3234de053c51edf lrc: 4/0,1 mode: PW/PW res: [0x2b8c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660135:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3ae24c2/0x3234de053c51eca lrc: 2/0,0 mode: PW/PW res: [0x2b8be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.660140:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.660145:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+644:41278:x1731746396381888:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 31us (198us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.660146:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a3ae24c2 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.660147:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12703 00010000:00010000:0.0:1651529344.660147:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3ae24c2/0x3234de053c51eca lrc: 2/0,0 mode: PW/PW res: [0x2b8be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660150:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3ae24c2/0x3234de053c51eca lrc: 3/0,0 mode: PW/PW res: [0x2b8be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.660155:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000054dd6f57/0x3234de053c51ed1 lrc: 3/0,1 mode: PW/PW res: [0x2b8bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660155:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3ae24c2/0x3234de053c51eca lrc: 1/0,0 mode: --/PW res: [0x2b8be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.660158:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054dd6f57/0x3234de053c51ed1 lrc: 3/0,1 mode: PW/PW res: [0x2b8bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660158:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3ae24c2/0x3234de053c51eca lrc: 0/0,0 mode: --/PW res: [0x2b8be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.660161:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054dd6f57/0x3234de053c51ed1 lrc: 3/0,1 mode: PW/PW res: [0x2b8bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660164:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000099354594/0x3234de053c51edf lrc: 3/0,1 mode: PW/PW res: [0x2b8c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.660167:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054dd6f57/0x3234de053c51ed1 lrc: 2/0,0 mode: PW/PW res: [0x2b8bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660167:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099354594/0x3234de053c51edf lrc: 3/0,1 mode: PW/PW res: [0x2b8c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660170:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099354594/0x3234de053c51edf lrc: 3/0,1 mode: PW/PW res: [0x2b8c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660177:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099354594/0x3234de053c51edf lrc: 2/0,0 mode: PW/PW res: [0x2b8c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.660209:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1421:39030:x1731745946500608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 914us (1006us total) trans 12885079974 rc 0/0 00000100:00100000:1.0:1651529344.660211:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211919 00000100:00100000:0.0:1651529344.660213:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1421:39029:x1731745946500672:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 851us (992us total) trans 12885079975 rc 0/0 00000100:00100000:0.0:1651529344.660216:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211921 00010000:00010000:1.0:1651529344.660218:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004eba1bc5/0x3234de053c51ed8 lrc: 3/0,1 mode: PW/PW res: [0x2b8c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.660238:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004eba1bc5/0x3234de053c51ed8 lrc: 3/0,1 mode: PW/PW res: [0x2b8c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.660242:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004eba1bc5/0x3234de053c51ed8 lrc: 3/0,1 mode: PW/PW res: [0x2b8c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.660244:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004eba1bc5/0x3234de053c51ed8 lrc: 2/0,0 mode: PW/PW res: [0x2b8c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660262:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054dd6f57/0x3234de053c51ed1 lrc: 2/0,0 mode: PW/PW res: [0x2b8bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660266:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054dd6f57 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.660267:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054dd6f57/0x3234de053c51ed1 lrc: 2/0,0 mode: PW/PW res: [0x2b8bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660270:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054dd6f57/0x3234de053c51ed1 lrc: 3/0,0 mode: PW/PW res: [0x2b8bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660275:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054dd6f57/0x3234de053c51ed1 lrc: 1/0,0 mode: --/PW res: [0x2b8bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660278:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054dd6f57/0x3234de053c51ed1 lrc: 0/0,0 mode: --/PW res: [0x2b8bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660282:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099354594/0x3234de053c51edf lrc: 2/0,0 mode: PW/PW res: [0x2b8c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.660283:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1420:39030:x1731745946500736:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 934us (1071us total) trans 12885079976 rc 0/0 00000100:00100000:1.0:1651529344.660285:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211920 00010000:00010000:0.0:1651529344.660285:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000099354594 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.660286:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099354594/0x3234de053c51edf lrc: 2/0,0 mode: PW/PW res: [0x2b8c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660289:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099354594/0x3234de053c51edf lrc: 3/0,0 mode: PW/PW res: [0x2b8c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660292:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099354594/0x3234de053c51edf lrc: 1/0,0 mode: --/PW res: [0x2b8c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660295:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099354594/0x3234de053c51edf lrc: 0/0,0 mode: --/PW res: [0x2b8c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660298:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004eba1bc5/0x3234de053c51ed8 lrc: 2/0,0 mode: PW/PW res: [0x2b8c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660301:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004eba1bc5 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.660301:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004eba1bc5/0x3234de053c51ed8 lrc: 2/0,0 mode: PW/PW res: [0x2b8c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660304:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004eba1bc5/0x3234de053c51ed8 lrc: 3/0,0 mode: PW/PW res: [0x2b8c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660307:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004eba1bc5/0x3234de053c51ed8 lrc: 1/0,0 mode: --/PW res: [0x2b8c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660310:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004eba1bc5/0x3234de053c51ed8 lrc: 0/0,0 mode: --/PW res: [0x2b8c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.660320:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.660369:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.660387:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d523a75 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997029888:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.660392:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b866be3a/0x3234de053c51ef4 lrc: 3/0,1 mode: --/PW res: [0x2b8c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.660398:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.660399:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396381952 00010000:00010000:0.0:1651529344.660404:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000084459261/0x3234de053c4d32f lrc: 4/0,0 mode: PR/PR res: [0x2b8c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfeaa expref: 644 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.660405:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396382016 00000100:00100000:0.0:1651529344.660409:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396382080 00010000:00010000:1.0:1651529344.660411:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000021be5e77/0x3234de053c4f4a0 lrc: 5/0,0 mode: PR/PR res: [0x2b8c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8524 expref: 646 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.660412:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c815f369/0x3234de053c4f01d lrc: 4/0,0 mode: PR/PR res: [0x2b8c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d730a expref: 646 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.660418:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12704 00000100:00100000:1.0:1651529344.660419:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+646:41279:x1731746396381952:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.660422:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.660423:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000084459261/0x3234de053c4d32f lrc: 4/0,0 mode: PR/PR res: [0x2b8c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfeaa expref: 646 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.660427:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000084459261/0x3234de053c4d32f lrc: 3/0,0 mode: PR/PR res: [0x2b8c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfeaa expref: 646 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.660433:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084459261/0x3234de053c4d32f lrc: 0/0,0 mode: --/PR res: [0x2b8c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfeaa expref: 646 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.660434:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12705 00010000:00010000:1.0:1651529344.660436:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.660436:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a13808c6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+645:41278:x1731746396382016:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.660437:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.660438:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1093027/0x3234de053c51ee6 lrc: 3/0,1 mode: PW/PW res: [0x2b8c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660439:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.660441:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1093027/0x3234de053c51ee6 lrc: 4/0,1 mode: PW/PW res: [0x2b8c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660441:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000021be5e77/0x3234de053c4f4a0 lrc: 5/0,0 mode: PR/PR res: [0x2b8c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8524 expref: 645 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.660444:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000021be5e77/0x3234de053c4f4a0 lrc: 4/0,0 mode: PR/PR res: [0x2b8c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8524 expref: 645 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.660451:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.660462:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+645:41279:x1731746396381952:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.660464:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12704 00000100:00100000:1.0:1651529344.660469:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12706 00000100:00100000:1.0:1651529344.660471:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+644:41279:x1731746396382080:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.660473:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.660475:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c815f369/0x3234de053c4f01d lrc: 4/0,0 mode: PR/PR res: [0x2b8c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d730a expref: 644 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.660475:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.660476:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.660477:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000074951e29/0x3234de053c51eed lrc: 3/0,1 mode: PW/PW res: [0x2b8c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.660478:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c815f369/0x3234de053c4f01d lrc: 3/0,0 mode: PR/PR res: [0x2b8c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d730a expref: 644 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.660483:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c815f369/0x3234de053c4f01d lrc: 0/0,0 mode: --/PR res: [0x2b8c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d730a expref: 644 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.660483:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074951e29/0x3234de053c51eed lrc: 4/0,1 mode: PW/PW res: [0x2b8c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.660486:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.660487:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.660488:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b866be3a/0x3234de053c51ef4 lrc: 3/0,1 mode: PW/PW res: [0x2b8c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660488:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.660491:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b866be3a/0x3234de053c51ef4 lrc: 4/0,1 mode: PW/PW res: [0x2b8c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.660496:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a13808c6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+643:41278:x1731746396382016:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 59us (137us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.660498:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.660504:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+643:41279:x1731746396382080:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 32us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.660505:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12705 00000100:00100000:1.0:1651529344.660507:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12706 00010000:00010000:0.0:1651529344.660512:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f1093027/0x3234de053c51ee6 lrc: 3/0,1 mode: PW/PW res: [0x2b8c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660515:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1093027/0x3234de053c51ee6 lrc: 3/0,1 mode: PW/PW res: [0x2b8c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.660517:0:80279:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021be5e77/0x3234de053c4f4a0 lrc: 0/0,0 mode: --/PR res: [0x2b8c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8524 expref: 641 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.660518:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1093027/0x3234de053c51ee6 lrc: 3/0,1 mode: PW/PW res: [0x2b8c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.660521:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000095d7eb1a pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997029824:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.660521:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1093027/0x3234de053c51ee6 lrc: 2/0,0 mode: PW/PW res: [0x2b8c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.660524:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000074951e29/0x3234de053c51eed lrc: 3/0,1 mode: PW/PW res: [0x2b8c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.660528:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000074951e29/0x3234de053c51eed lrc: 3/0,1 mode: PW/PW res: [0x2b8c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.660530:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074951e29/0x3234de053c51eed lrc: 3/0,1 mode: PW/PW res: [0x2b8c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.660533:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074951e29/0x3234de053c51eed lrc: 3/0,1 mode: PW/PW res: [0x2b8c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.660536:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074951e29/0x3234de053c51eed lrc: 2/0,0 mode: PW/PW res: [0x2b8c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.660585:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1421:39029:x1731745946500928:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1056us (1083us total) trans 12885079978 rc 0/0 00000100:00100000:1.0:1651529344.660588:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211924 00000100:00100000:0.0:1651529344.660600:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1420:39030:x1731745946500864:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1150us (1197us total) trans 12885079977 rc 0/0 00000100:00100000:0.0:1651529344.660603:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211922 00010000:00010000:0.0:1651529344.660610:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b866be3a/0x3234de053c51ef4 lrc: 3/0,1 mode: PW/PW res: [0x2b8c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660613:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b866be3a/0x3234de053c51ef4 lrc: 3/0,1 mode: PW/PW res: [0x2b8c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660617:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b866be3a/0x3234de053c51ef4 lrc: 3/0,1 mode: PW/PW res: [0x2b8c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660619:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b866be3a/0x3234de053c51ef4 lrc: 2/0,0 mode: PW/PW res: [0x2b8c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.660623:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.660651:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.660680:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.660683:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1420:39029:x1731745946500800:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1158us (1251us total) trans 12885079979 rc 0/0 00000100:00100000:0.0:1651529344.660686:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211923 00000100:00100000:0.0:1651529344.660691:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946501632 00000100:00100000:0.0:1651529344.660697:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946501568 00000100:00100000:0.0:1651529344.660703:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946501760 00000100:00100000:0.0:1651529344.660707:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211926 00000100:00100000:0.0:1651529344.660709:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1422:39030:x1731745946501632:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.660714:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178375 count 1 00000100:00100000:1.0:1651529344.660716:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.660718:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066c54aab/0x3234de053c51f02 lrc: 3/0,1 mode: --/PW res: [0x2b8c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660723:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a9e524c4/0x3234de053c4dccf lrc: 2/0,0 mode: PR/PR res: [0x2b8c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23cc expref: 640 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.660726:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.660726:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.660727:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066c54aab/0x3234de053c51f02 lrc: 4/0,1 mode: --/PW res: [0x2b8c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660742:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a9e524c4/0x3234de053c4dccf lrc: 3/0,0 mode: PR/PR res: [0x2b8c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23cc expref: 640 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.660746:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a9e524c4/0x3234de053c4dccf lrc: 4/0,0 mode: PR/PR res: [0x2b8c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23cc expref: 640 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.660750:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d523a75 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997030016:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.660751:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.660763:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946501696 00000100:00100000:0.0:1651529344.660771:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c0dff858 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.660777:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211927 00000100:00100000:1.0:1651529344.660779:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1423:39029:x1731745946501568:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.660784:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178374 count 1 00010000:00010000:1.0:1651529344.660789:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2c22fc3/0x3234de053c51f09 lrc: 3/0,1 mode: --/PW res: [0x2b8c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660791:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1093027/0x3234de053c51ee6 lrc: 2/0,0 mode: PW/PW res: [0x2b8c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.660794:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000486f4d27/0x3234de053c4d328 lrc: 2/0,0 mode: PR/PR res: [0x2b8c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe95 expref: 640 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.660795:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f1093027 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.660796:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1093027/0x3234de053c51ee6 lrc: 2/0,0 mode: PW/PW res: [0x2b8c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.660797:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.660798:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.660798:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2c22fc3/0x3234de053c51f09 lrc: 4/0,1 mode: --/PW res: [0x2b8c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660799:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1093027/0x3234de053c51ee6 lrc: 3/0,0 mode: PW/PW res: [0x2b8c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.660805:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000486f4d27/0x3234de053c4d328 lrc: 3/0,0 mode: PR/PR res: [0x2b8c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe95 expref: 640 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.660809:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000486f4d27/0x3234de053c4d328 lrc: 4/0,0 mode: PR/PR res: [0x2b8c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe95 expref: 640 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.660813:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009b8db73b pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997030080:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.660813:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1093027/0x3234de053c51ee6 lrc: 1/0,0 mode: --/PW res: [0x2b8c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660816:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1093027/0x3234de053c51ee6 lrc: 0/0,0 mode: --/PW res: [0x2b8c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660820:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074951e29/0x3234de053c51eed lrc: 2/0,0 mode: PW/PW res: [0x2b8c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.660821:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 000000007d8fabda going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.660823:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000074951e29 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.660824:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074951e29/0x3234de053c51eed lrc: 2/0,0 mode: PW/PW res: [0x2b8c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660827:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074951e29/0x3234de053c51eed lrc: 3/0,0 mode: PW/PW res: [0x2b8c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.660828:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211928 00000100:00100000:1.0:1651529344.660829:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1423:39030:x1731745946501760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.660833:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178377 count 1 00010000:00010000:1.0:1651529344.660836:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c51f10 lrc: 3/0,1 mode: --/PW res: [0x2b8c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.660840:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c1c596eb/0x3234de053c4c854 lrc: 2/0,0 mode: PR/PR res: [0x2b8c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd361 expref: 640 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.660843:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.660844:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.660845:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c51f10 lrc: 4/0,1 mode: --/PW res: [0x2b8c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.660850:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c1c596eb/0x3234de053c4c854 lrc: 3/0,0 mode: PR/PR res: [0x2b8c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd361 expref: 640 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.660850:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074951e29/0x3234de053c51eed lrc: 1/0,0 mode: --/PW res: [0x2b8c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660853:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074951e29/0x3234de053c51eed lrc: 0/0,0 mode: --/PW res: [0x2b8c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660857:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b866be3a/0x3234de053c51ef4 lrc: 2/0,0 mode: PW/PW res: [0x2b8c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660860:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b866be3a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.660861:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b866be3a/0x3234de053c51ef4 lrc: 2/0,0 mode: PW/PW res: [0x2b8c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.660864:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c1c596eb/0x3234de053c4c854 lrc: 4/0,0 mode: PR/PR res: [0x2b8c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd361 expref: 640 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.660864:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b866be3a/0x3234de053c51ef4 lrc: 3/0,0 mode: PW/PW res: [0x2b8c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660867:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b866be3a/0x3234de053c51ef4 lrc: 1/0,0 mode: --/PW res: [0x2b8c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.660868:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997030144:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.660869:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b866be3a/0x3234de053c51ef4 lrc: 0/0,0 mode: --/PW res: [0x2b8c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.660875:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.660880:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211929 00000100:00100000:0.0:1651529344.660881:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1423:39029:x1731745946501696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.660885:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396382656 00002000:00080000:0.0:1651529344.660887:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178376 count 1 00010000:00010000:1.0:1651529344.660889:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000db5d109d/0x3234de053c4f683 lrc: 5/0,0 mode: PR/PR res: [0x2b8c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ccc expref: 641 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.660890:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e783e5a/0x3234de053c51f17 lrc: 3/0,1 mode: --/PW res: [0x2b8c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.660897:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12707 00000100:00100000:1.0:1651529344.660899:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+641:41278:x1731746396382656:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.660901:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.660903:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000db5d109d/0x3234de053c4f683 lrc: 5/0,0 mode: PR/PR res: [0x2b8c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ccc expref: 641 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.660906:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000db5d109d/0x3234de053c4f683 lrc: 4/0,0 mode: PR/PR res: [0x2b8c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ccc expref: 641 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.660906:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003decc94a/0x3234de053c4eb00 lrc: 2/0,0 mode: PR/PR res: [0x2b8c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5dbd expref: 641 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.660910:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.660911:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.660911:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e783e5a/0x3234de053c51f17 lrc: 4/0,1 mode: --/PW res: [0x2b8c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.660912:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.660912:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.660913:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c51efb lrc: 3/0,1 mode: PW/PW res: [0x2b8c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.660916:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c51efb lrc: 4/0,1 mode: PW/PW res: [0x2b8c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660919:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003decc94a/0x3234de053c4eb00 lrc: 3/0,0 mode: PR/PR res: [0x2b8c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5dbd expref: 641 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.660921:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.660922:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003decc94a/0x3234de053c4eb00 lrc: 4/0,0 mode: PR/PR res: [0x2b8c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5dbd expref: 641 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.660926:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+641:41278:x1731746396382656:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 27us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.660926:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004bb67ba4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997030208:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.660928:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12707 00000100:00100000:0.0:1651529344.660936:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aac87b31 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.660942:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.660946:0:156655:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db5d109d/0x3234de053c4f683 lrc: 0/0,0 mode: --/PR res: [0x2b8c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8ccc expref: 640 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.660957:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d9cfef26 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997029952:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.660961:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.660961:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c51efb lrc: 3/0,1 mode: PW/PW res: [0x2b8c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660971:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c51efb lrc: 3/0,1 mode: PW/PW res: [0x2b8c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.660974:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.660974:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c51efb lrc: 3/0,1 mode: PW/PW res: [0x2b8c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660977:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c51efb lrc: 3/0,1 mode: PW/PW res: [0x2b8c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.660980:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c51efb lrc: 2/0,0 mode: PW/PW res: [0x2b8c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.661023:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1424:39030:x1731745946501504:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1024us (1099us total) trans 12885079980 rc 0/0 00000100:00100000:1.0:1651529344.661024:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946501888 00000100:00100000:0.0:1651529344.661026:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211925 00000100:00100000:1.0:1651529344.661031:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946501824 00000100:00100000:0.0:1651529344.661032:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946501952 00000100:00100000:1.0:1651529344.661035:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211930 00000100:00100000:1.0:1651529344.661037:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1426:39030:x1731745946501888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.661047:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178379 count 1 00010000:00010000:1.0:1651529344.661051:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a4fe8ca/0x3234de053c51f1e lrc: 3/0,1 mode: --/PW res: [0x2b8cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.661055:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211931 00010000:00010000:1.0:1651529344.661056:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000009b4e922/0x3234de053c4d669 lrc: 2/0,0 mode: PR/PR res: [0x2b8cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b0d expref: 639 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.661057:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1426:39030:x1731745946501824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.661059:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.661059:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.661060:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a4fe8ca/0x3234de053c51f1e lrc: 4/0,1 mode: --/PW res: [0x2b8cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.661062:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178378 count 1 00010000:00010000:0.0:1651529344.661066:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d05ad66e/0x3234de053c51f25 lrc: 3/0,1 mode: --/PW res: [0x2b8ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661069:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000009b4e922/0x3234de053c4d669 lrc: 3/0,0 mode: PR/PR res: [0x2b8cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b0d expref: 639 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.661070:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003e997e20/0x3234de053c4c96c lrc: 2/0,0 mode: PR/PR res: [0x2b8ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd789 expref: 639 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.661073:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009b4e922/0x3234de053c4d669 lrc: 4/0,0 mode: PR/PR res: [0x2b8cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b0d expref: 639 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.661073:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.661074:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.661075:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d05ad66e/0x3234de053c51f25 lrc: 4/0,1 mode: --/PW res: [0x2b8ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.661077:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a4b486d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997030272:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.661082:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003e997e20/0x3234de053c4c96c lrc: 3/0,0 mode: PR/PR res: [0x2b8ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd789 expref: 639 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.661085:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000499d0377 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.661085:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003e997e20/0x3234de053c4c96c lrc: 4/0,0 mode: PR/PR res: [0x2b8ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd789 expref: 639 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.661090:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d9cfef26 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997030336:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.661091:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211932 00000100:00100000:1.0:1651529344.661093:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1426:39030:x1731745946501952:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.661097:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178380 count 1 00000100:00100000:0.0:1651529344.661098:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000504ef660 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.661100:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aab15112/0x3234de053c51f2c lrc: 3/0,1 mode: --/PW res: [0x2b8cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661104:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d5bd6cab/0x3234de053c4efe5 lrc: 2/0,0 mode: PR/PR res: [0x2b8cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7238 expref: 639 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.661105:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c51efb lrc: 2/0,0 mode: PW/PW res: [0x2b8c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661107:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.661108:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.661108:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aab15112/0x3234de053c51f2c lrc: 4/0,1 mode: --/PW res: [0x2b8cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.661108:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004ab50553 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.661109:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c51efb lrc: 2/0,0 mode: PW/PW res: [0x2b8c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.661112:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c51efb lrc: 3/0,0 mode: PW/PW res: [0x2b8c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661114:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d5bd6cab/0x3234de053c4efe5 lrc: 3/0,0 mode: PR/PR res: [0x2b8cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7238 expref: 639 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.661117:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c51efb lrc: 1/0,0 mode: --/PW res: [0x2b8c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661118:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d5bd6cab/0x3234de053c4efe5 lrc: 4/0,0 mode: PR/PR res: [0x2b8cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7238 expref: 639 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.661119:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c51efb lrc: 0/0,0 mode: --/PW res: [0x2b8c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.661122:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997030400:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.661129:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000089d75f07 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.661200:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009b8db73b pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997030080:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.661205:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f2c22fc3/0x3234de053c51f09 lrc: 3/0,1 mode: --/PW res: [0x2b8c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.661247:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d523a75 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997030016:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.661249:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997030144:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.661252:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c51f10 lrc: 3/0,1 mode: --/PW res: [0x2b8c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.661252:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000066c54aab/0x3234de053c51f02 lrc: 3/0,1 mode: --/PW res: [0x2b8c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.661308:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.661315:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946502016 00000100:00100000:1.0:1651529344.661321:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211933 00000100:00100000:1.0:1651529344.661323:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1427:39030:x1731745946502016:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.661328:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178381 count 1 00010000:00010000:1.0:1651529344.661332:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c51f33 lrc: 3/0,1 mode: --/PW res: [0x2b8cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661336:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002213c2e8/0x3234de053c4e836 lrc: 2/0,0 mode: PR/PR res: [0x2b8cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d517d expref: 639 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.661340:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.661340:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.661341:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c51f33 lrc: 4/0,1 mode: --/PW res: [0x2b8cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661350:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002213c2e8/0x3234de053c4e836 lrc: 3/0,0 mode: PR/PR res: [0x2b8cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d517d expref: 639 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.661353:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002213c2e8/0x3234de053c4e836 lrc: 4/0,0 mode: PR/PR res: [0x2b8cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d517d expref: 639 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.661357:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009b8db73b pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997030464:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.661371:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 000000007d8fabda going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.661525:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.661534:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.661540:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.661569:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004bb67ba4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997030208:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.661586:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.661588:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006e783e5a/0x3234de053c51f17 lrc: 3/0,1 mode: --/PW res: [0x2b8c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.661594:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.661599:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.661601:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d9cfef26 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997030336:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.661604:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.661604:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d05ad66e/0x3234de053c51f25 lrc: 3/0,1 mode: --/PW res: [0x2b8ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.661610:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396382720 00010000:00010000:0.0:1651529344.661615:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000486f4d27/0x3234de053c4d328 lrc: 4/0,0 mode: PR/PR res: [0x2b8c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe95 expref: 640 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.661620:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396382848 00010000:00010000:0.0:1651529344.661623:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a9e524c4/0x3234de053c4dccf lrc: 4/0,0 mode: PR/PR res: [0x2b8c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23cc expref: 641 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.661627:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396382784 00000100:00100000:1.0:1651529344.661629:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396382976 00010000:00010000:0.0:1651529344.661629:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c1c596eb/0x3234de053c4c854 lrc: 4/0,0 mode: PR/PR res: [0x2b8c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd361 expref: 642 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.661633:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396383104 00010000:00010000:1.0:1651529344.661635:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000009b4e922/0x3234de053c4d669 lrc: 5/0,0 mode: PR/PR res: [0x2b8cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b0d expref: 644 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.661635:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d5bd6cab/0x3234de053c4efe5 lrc: 5/0,0 mode: PR/PR res: [0x2b8cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7238 expref: 644 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.661640:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396382912 00000100:00100000:1.0:1651529344.661641:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396383040 00010000:00010000:0.0:1651529344.661642:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003decc94a/0x3234de053c4eb00 lrc: 4/0,0 mode: PR/PR res: [0x2b8c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5dbd expref: 645 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.661644:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003e997e20/0x3234de053c4c96c lrc: 4/0,0 mode: PR/PR res: [0x2b8ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd789 expref: 646 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.661647:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12708 00000100:00100000:0.0:1651529344.661648:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a253639 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+646:41279:x1731746396382720:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.661650:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12709 00000100:00100000:1.0:1651529344.661651:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+646:41279:x1731746396382848:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.661651:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.661652:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000486f4d27/0x3234de053c4d328 lrc: 4/0,0 mode: PR/PR res: [0x2b8c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe95 expref: 646 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.661655:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.661656:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000486f4d27/0x3234de053c4d328 lrc: 3/0,0 mode: PR/PR res: [0x2b8c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe95 expref: 646 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.661657:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a9e524c4/0x3234de053c4dccf lrc: 4/0,0 mode: PR/PR res: [0x2b8c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23cc expref: 646 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.661661:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a9e524c4/0x3234de053c4dccf lrc: 3/0,0 mode: PR/PR res: [0x2b8c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23cc expref: 646 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.661662:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000486f4d27/0x3234de053c4d328 lrc: 0/0,0 mode: --/PR res: [0x2b8c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe95 expref: 646 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.661665:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.661666:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9e524c4/0x3234de053c4dccf lrc: 0/0,0 mode: --/PR res: [0x2b8c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d23cc expref: 645 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.661666:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.661667:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f2c22fc3/0x3234de053c51f09 lrc: 3/0,1 mode: PW/PW res: [0x2b8c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661670:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.661670:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2c22fc3/0x3234de053c51f09 lrc: 4/0,1 mode: PW/PW res: [0x2b8c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661671:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.661672:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000066c54aab/0x3234de053c51f02 lrc: 3/0,1 mode: PW/PW res: [0x2b8c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661675:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066c54aab/0x3234de053c51f02 lrc: 4/0,1 mode: PW/PW res: [0x2b8c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.661680:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.661690:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.661704:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+644:41279:x1731746396382848:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 52us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.661706:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12709 00000100:00100000:0.0:1651529344.661714:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a253639 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+643:41279:x1731746396382720:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 64us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.661717:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12708 00000100:00100000:1.0:1651529344.661719:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12710 00000100:00100000:1.0:1651529344.661721:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+642:41279:x1731746396382784:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.661724:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.661725:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c1c596eb/0x3234de053c4c854 lrc: 4/0,0 mode: PR/PR res: [0x2b8c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd361 expref: 642 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.661727:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12711 00000100:00100000:0.0:1651529344.661729:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+642:41279:x1731746396383104:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.661731:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c1c596eb/0x3234de053c4c854 lrc: 3/0,0 mode: PR/PR res: [0x2b8c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd361 expref: 642 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.661732:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.661741:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d5bd6cab/0x3234de053c4efe5 lrc: 5/0,0 mode: PR/PR res: [0x2b8cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7238 expref: 642 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.661745:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d5bd6cab/0x3234de053c4efe5 lrc: 4/0,0 mode: PR/PR res: [0x2b8cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7238 expref: 642 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.661747:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1c596eb/0x3234de053c4c854 lrc: 0/0,0 mode: --/PR res: [0x2b8c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd361 expref: 642 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.661751:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.661751:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.661751:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.661752:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c51f10 lrc: 3/0,1 mode: PW/PW res: [0x2b8c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.661752:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.661753:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000aab15112/0x3234de053c51f2c lrc: 3/0,1 mode: PW/PW res: [0x2b8cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661755:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c51f10 lrc: 4/0,1 mode: PW/PW res: [0x2b8c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.661756:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aab15112/0x3234de053c51f2c lrc: 4/0,1 mode: PW/PW res: [0x2b8cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.661760:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.661762:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.661766:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+641:41279:x1731746396383104:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 36us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.661768:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+641:41279:x1731746396382784:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 46us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.661769:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12711 00000100:00100000:1.0:1651529344.661770:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12710 00000100:00100000:0.0:1651529344.661773:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12712 00000100:00100000:1.0:1651529344.661775:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12713 00000100:00100000:0.0:1651529344.661775:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+639:41279:x1731746396382976:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.661777:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+639:41279:x1731746396382912:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.661777:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.661778:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000009b4e922/0x3234de053c4d669 lrc: 5/0,0 mode: PR/PR res: [0x2b8cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b0d expref: 639 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.661779:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.661781:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003decc94a/0x3234de053c4eb00 lrc: 4/0,0 mode: PR/PR res: [0x2b8c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5dbd expref: 639 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.661782:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000009b4e922/0x3234de053c4d669 lrc: 4/0,0 mode: PR/PR res: [0x2b8cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b0d expref: 639 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.661784:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003decc94a/0x3234de053c4eb00 lrc: 3/0,0 mode: PR/PR res: [0x2b8c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5dbd expref: 639 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.661786:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.661787:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.661787:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003a4fe8ca/0x3234de053c51f1e lrc: 3/0,1 mode: PW/PW res: [0x2b8cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661789:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003decc94a/0x3234de053c4eb00 lrc: 0/0,0 mode: --/PR res: [0x2b8c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5dbd expref: 639 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.661790:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a4fe8ca/0x3234de053c51f1e lrc: 4/0,1 mode: PW/PW res: [0x2b8cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661793:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.661793:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.661794:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006e783e5a/0x3234de053c51f17 lrc: 3/0,1 mode: PW/PW res: [0x2b8c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.661794:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.661797:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e783e5a/0x3234de053c51f17 lrc: 4/0,1 mode: PW/PW res: [0x2b8c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.661799:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+638:41279:x1731746396382976:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 23us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.661801:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12712 00010000:00010000:1.0:1651529344.661805:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.661810:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+637:41279:x1731746396382912:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.661813:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12714 00000100:00100000:1.0:1651529344.661814:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12713 00000100:00100000:0.0:1651529344.661815:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+637:41279:x1731746396383040:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.661817:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.661819:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003e997e20/0x3234de053c4c96c lrc: 4/0,0 mode: PR/PR res: [0x2b8ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd789 expref: 636 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.661822:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003e997e20/0x3234de053c4c96c lrc: 3/0,0 mode: PR/PR res: [0x2b8ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd789 expref: 636 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.661826:0:80280:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009b4e922/0x3234de053c4d669 lrc: 0/0,0 mode: --/PR res: [0x2b8cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b0d expref: 636 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.661827:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e997e20/0x3234de053c4c96c lrc: 0/0,0 mode: --/PR res: [0x2b8ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd789 expref: 636 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.661829:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a4b486d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997030272:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.661831:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.661831:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.661832:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d05ad66e/0x3234de053c51f25 lrc: 3/0,1 mode: PW/PW res: [0x2b8ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661833:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003a4fe8ca/0x3234de053c51f1e lrc: 3/0,1 mode: PW/PW res: [0x2b8cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.661835:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d05ad66e/0x3234de053c51f25 lrc: 4/0,1 mode: PW/PW res: [0x2b8ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661836:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003a4fe8ca/0x3234de053c51f1e lrc: 3/0,1 mode: PW/PW res: [0x2b8cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661839:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a4fe8ca/0x3234de053c51f1e lrc: 3/0,1 mode: PW/PW res: [0x2b8cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.661840:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.661842:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a4fe8ca/0x3234de053c51f1e lrc: 3/0,1 mode: PW/PW res: [0x2b8cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661845:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a4fe8ca/0x3234de053c51f1e lrc: 2/0,0 mode: PW/PW res: [0x2b8cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.661846:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+634:41279:x1731746396383040:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 31us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.661848:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12714 00010000:00010000:0.0:1651529344.661861:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006e783e5a/0x3234de053c51f17 lrc: 3/0,1 mode: PW/PW res: [0x2b8c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.661865:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e783e5a/0x3234de053c51f17 lrc: 3/0,1 mode: PW/PW res: [0x2b8c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.661868:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e783e5a/0x3234de053c51f17 lrc: 3/0,1 mode: PW/PW res: [0x2b8c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.661871:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e783e5a/0x3234de053c51f17 lrc: 2/0,0 mode: PW/PW res: [0x2b8c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.661889:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1429:39030:x1731745946501888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 852us (947us total) trans 12885079981 rc 0/0 00000100:00100000:1.0:1651529344.661892:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211930 00010000:00010000:1.0:1651529344.661903:0:106695:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5bd6cab/0x3234de053c4efe5 lrc: 0/0,0 mode: --/PR res: [0x2b8cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7238 expref: 633 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.661907:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997030400:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.661910:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000aab15112/0x3234de053c51f2c lrc: 3/0,1 mode: PW/PW res: [0x2b8cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.661910:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1428:39029:x1731745946501696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1028us (1159us total) trans 12885079982 rc 0/0 00000100:00100000:0.0:1651529344.661913:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211929 00010000:00010000:1.0:1651529344.661914:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000aab15112/0x3234de053c51f2c lrc: 3/0,1 mode: PW/PW res: [0x2b8cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661916:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aab15112/0x3234de053c51f2c lrc: 3/0,1 mode: PW/PW res: [0x2b8cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661919:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aab15112/0x3234de053c51f2c lrc: 3/0,1 mode: PW/PW res: [0x2b8cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.661920:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a4fe8ca/0x3234de053c51f1e lrc: 2/0,0 mode: PW/PW res: [0x2b8cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.661924:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003a4fe8ca already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.661925:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aab15112/0x3234de053c51f2c lrc: 2/0,0 mode: PW/PW res: [0x2b8cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.661925:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a4fe8ca/0x3234de053c51f1e lrc: 2/0,0 mode: PW/PW res: [0x2b8cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.661928:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a4fe8ca/0x3234de053c51f1e lrc: 3/0,0 mode: PW/PW res: [0x2b8cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.661939:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a4fe8ca/0x3234de053c51f1e lrc: 1/0,0 mode: --/PW res: [0x2b8cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.661942:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a4fe8ca/0x3234de053c51f1e lrc: 0/0,0 mode: --/PW res: [0x2b8cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.661947:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e783e5a/0x3234de053c51f17 lrc: 2/0,0 mode: PW/PW res: [0x2b8c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.661949:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006e783e5a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.661950:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e783e5a/0x3234de053c51f17 lrc: 2/0,0 mode: PW/PW res: [0x2b8c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.661953:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e783e5a/0x3234de053c51f17 lrc: 3/0,0 mode: PW/PW res: [0x2b8c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.661956:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e783e5a/0x3234de053c51f17 lrc: 1/0,0 mode: --/PW res: [0x2b8c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.661961:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e783e5a/0x3234de053c51f17 lrc: 0/0,0 mode: --/PW res: [0x2b8c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.661963:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1428:39030:x1731745946501952:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 869us (989us total) trans 12885079983 rc 0/0 00010000:00010000:0.0:1651529344.661965:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aab15112/0x3234de053c51f2c lrc: 2/0,0 mode: PW/PW res: [0x2b8cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.661966:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211932 00010000:00010000:0.0:1651529344.661967:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000aab15112 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.661968:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aab15112/0x3234de053c51f2c lrc: 2/0,0 mode: PW/PW res: [0x2b8cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.661971:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aab15112/0x3234de053c51f2c lrc: 3/0,0 mode: PW/PW res: [0x2b8cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661973:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f2c22fc3/0x3234de053c51f09 lrc: 3/0,1 mode: PW/PW res: [0x2b8c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.661974:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aab15112/0x3234de053c51f2c lrc: 1/0,0 mode: --/PW res: [0x2b8cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661976:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2c22fc3/0x3234de053c51f09 lrc: 3/0,1 mode: PW/PW res: [0x2b8c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.661976:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aab15112/0x3234de053c51f2c lrc: 0/0,0 mode: --/PW res: [0x2b8cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661979:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2c22fc3/0x3234de053c51f09 lrc: 3/0,1 mode: PW/PW res: [0x2b8c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.661981:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2c22fc3/0x3234de053c51f09 lrc: 2/0,0 mode: PW/PW res: [0x2b8c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.661983:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000066c54aab/0x3234de053c51f02 lrc: 3/0,1 mode: PW/PW res: [0x2b8c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.661985:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066c54aab/0x3234de053c51f02 lrc: 3/0,1 mode: PW/PW res: [0x2b8c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.661993:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066c54aab/0x3234de053c51f02 lrc: 3/0,1 mode: PW/PW res: [0x2b8c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.661996:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066c54aab/0x3234de053c51f02 lrc: 2/0,0 mode: PW/PW res: [0x2b8c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.662017:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1429:39029:x1731745946501568:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1237us (1366us total) trans 12885079984 rc 0/0 00000100:00100000:1.0:1651529344.662019:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211927 00010000:00010000:1.0:1651529344.662025:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c51f10 lrc: 3/0,1 mode: PW/PW res: [0x2b8c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.662028:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c51f10 lrc: 3/0,1 mode: PW/PW res: [0x2b8c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.662032:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1428:39030:x1731745946501632:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1322us (1408us total) trans 12885079985 rc 0/0 00010000:00010000:1.0:1651529344.662034:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c51f10 lrc: 3/0,1 mode: PW/PW res: [0x2b8c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.662035:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211926 00010000:00010000:1.0:1651529344.662037:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c51f10 lrc: 2/0,0 mode: PW/PW res: [0x2b8c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662052:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2c22fc3/0x3234de053c51f09 lrc: 2/0,0 mode: PW/PW res: [0x2b8c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662055:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f2c22fc3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.662056:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2c22fc3/0x3234de053c51f09 lrc: 2/0,0 mode: PW/PW res: [0x2b8c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662059:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2c22fc3/0x3234de053c51f09 lrc: 3/0,0 mode: PW/PW res: [0x2b8c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662063:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2c22fc3/0x3234de053c51f09 lrc: 1/0,0 mode: --/PW res: [0x2b8c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662066:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2c22fc3/0x3234de053c51f09 lrc: 0/0,0 mode: --/PW res: [0x2b8c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662070:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066c54aab/0x3234de053c51f02 lrc: 2/0,0 mode: PW/PW res: [0x2b8c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.662072:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1428:39030:x1731745946501760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1242us (1392us total) trans 12885079986 rc 0/0 00010000:00010000:0.0:1651529344.662073:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000066c54aab already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.662074:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066c54aab/0x3234de053c51f02 lrc: 2/0,0 mode: PW/PW res: [0x2b8c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.662075:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211928 00010000:00010000:0.0:1651529344.662077:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066c54aab/0x3234de053c51f02 lrc: 3/0,0 mode: PW/PW res: [0x2b8c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662080:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066c54aab/0x3234de053c51f02 lrc: 1/0,0 mode: --/PW res: [0x2b8c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662083:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066c54aab/0x3234de053c51f02 lrc: 0/0,0 mode: --/PW res: [0x2b8c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.662084:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009b8db73b pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997030464:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.662086:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c51f10 lrc: 2/0,0 mode: PW/PW res: [0x2b8c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.662088:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c51f33 lrc: 3/0,1 mode: --/PW res: [0x2b8cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662088:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d766c581 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.662089:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c51f10 lrc: 2/0,0 mode: PW/PW res: [0x2b8c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662092:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c51f10 lrc: 3/0,0 mode: PW/PW res: [0x2b8c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662095:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c51f10 lrc: 1/0,0 mode: --/PW res: [0x2b8c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662097:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c51f10 lrc: 0/0,0 mode: --/PW res: [0x2b8c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.662103:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.662104:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d05ad66e/0x3234de053c51f25 lrc: 3/0,1 mode: PW/PW res: [0x2b8ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662111:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d05ad66e/0x3234de053c51f25 lrc: 3/0,1 mode: PW/PW res: [0x2b8ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662115:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d05ad66e/0x3234de053c51f25 lrc: 3/0,1 mode: PW/PW res: [0x2b8ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662117:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d05ad66e/0x3234de053c51f25 lrc: 2/0,0 mode: PW/PW res: [0x2b8ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.662152:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1428:39030:x1731745946501824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1094us (1190us total) trans 12885079987 rc 0/0 00000100:00100000:0.0:1651529344.662154:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211931 00010000:00010000:0.0:1651529344.662161:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d05ad66e/0x3234de053c51f25 lrc: 2/0,0 mode: PW/PW res: [0x2b8ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662164:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d05ad66e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.662165:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d05ad66e/0x3234de053c51f25 lrc: 2/0,0 mode: PW/PW res: [0x2b8ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662168:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d05ad66e/0x3234de053c51f25 lrc: 3/0,0 mode: PW/PW res: [0x2b8ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662172:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d05ad66e/0x3234de053c51f25 lrc: 1/0,0 mode: --/PW res: [0x2b8ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662175:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d05ad66e/0x3234de053c51f25 lrc: 0/0,0 mode: --/PW res: [0x2b8ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.662220:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396383168 00010000:00010000:0.0:1651529344.662256:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002213c2e8/0x3234de053c4e836 lrc: 4/0,0 mode: PR/PR res: [0x2b8cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d517d expref: 633 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.662268:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12715 00000100:00100000:0.0:1651529344.662270:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8f0043c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+633:41278:x1731746396383168:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.662273:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.662275:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002213c2e8/0x3234de053c4e836 lrc: 4/0,0 mode: PR/PR res: [0x2b8cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d517d expref: 633 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.662278:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002213c2e8/0x3234de053c4e836 lrc: 3/0,0 mode: PR/PR res: [0x2b8cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d517d expref: 633 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.662284:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002213c2e8/0x3234de053c4e836 lrc: 0/0,0 mode: --/PR res: [0x2b8cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d517d expref: 633 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.662287:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.662288:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.662289:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c51f33 lrc: 3/0,1 mode: PW/PW res: [0x2b8cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662292:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c51f33 lrc: 4/0,1 mode: PW/PW res: [0x2b8cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662300:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.662302:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c51f33 lrc: 3/0,1 mode: PW/PW res: [0x2b8cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.662307:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c51f33 lrc: 3/0,1 mode: PW/PW res: [0x2b8cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.662311:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8f0043c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+632:41278:x1731746396383168:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.662313:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12715 00010000:00010000:1.0:1651529344.662314:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c51f33 lrc: 3/0,1 mode: PW/PW res: [0x2b8cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.662318:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c51f33 lrc: 2/0,0 mode: PW/PW res: [0x2b8cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662343:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c51f33 lrc: 2/0,0 mode: PW/PW res: [0x2b8cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662356:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004df22a54 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.662358:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c51f33 lrc: 2/0,0 mode: PW/PW res: [0x2b8cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.662361:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1428:39030:x1731745946502016:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1037us (1053us total) trans 12885079988 rc 0/0 00010000:00010000:0.0:1651529344.662361:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c51f33 lrc: 3/0,0 mode: PW/PW res: [0x2b8cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.662364:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211933 00010000:00010000:0.0:1651529344.662365:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c51f33 lrc: 1/0,0 mode: --/PW res: [0x2b8cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662376:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c51f33 lrc: 0/0,0 mode: --/PW res: [0x2b8cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.662399:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.662425:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.662435:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.662436:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946502656 00000100:00100000:1.0:1651529344.662441:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.662444:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946502720 00000100:00100000:1.0:1651529344.662447:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.662458:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946502848 00000100:00100000:0.0:1651529344.662464:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946502976 00000100:00100000:1.0:1651529344.662467:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.662470:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946502784 00000100:00100000:0.0:1651529344.662479:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946502912 00000100:00100000:1.0:1651529344.662482:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.662491:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946503040 00000100:00100000:0.0:1651529344.662495:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211934 00000100:00100000:0.0:1651529344.662497:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1434:39030:x1731745946502656:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.662498:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211935 00000100:00100000:1.0:1651529344.662500:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1434:39029:x1731745946502720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.662503:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178382 count 1 00002000:00080000:1.0:1651529344.662506:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178383 count 1 00010000:00010000:0.0:1651529344.662507:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f0edbda/0x3234de053c51f3a lrc: 3/0,1 mode: --/PW res: [0x2b8ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.662510:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000707bb969/0x3234de053c51f41 lrc: 3/0,1 mode: --/PW res: [0x2b8cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662512:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d8ea9f0a/0x3234de053c4a0b5 lrc: 2/0,0 mode: PR/PR res: [0x2b8ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb86b expref: 631 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.662515:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e6832ce5/0x3234de053c4edd1 lrc: 2/0,0 mode: PR/PR res: [0x2b8cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6994 expref: 631 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.662515:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.662516:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.662517:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f0edbda/0x3234de053c51f3a lrc: 4/0,1 mode: --/PW res: [0x2b8ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.662518:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.662519:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.662520:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000707bb969/0x3234de053c51f41 lrc: 4/0,1 mode: --/PW res: [0x2b8cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.662523:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d8ea9f0a/0x3234de053c4a0b5 lrc: 3/0,0 mode: PR/PR res: [0x2b8ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb86b expref: 631 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.662527:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e6832ce5/0x3234de053c4edd1 lrc: 3/0,0 mode: PR/PR res: [0x2b8cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6994 expref: 631 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.662527:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d8ea9f0a/0x3234de053c4a0b5 lrc: 4/0,0 mode: PR/PR res: [0x2b8ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb86b expref: 631 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.662533:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e6832ce5/0x3234de053c4edd1 lrc: 4/0,0 mode: PR/PR res: [0x2b8cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6994 expref: 631 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.662537:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007ac35c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997030592:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.662548:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.662550:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000034e35367 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997030528:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.662553:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211936 00000100:00100000:1.0:1651529344.662555:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1434:39029:x1731745946502848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.662559:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178385 count 1 00000100:00100000:0.0:1651529344.662560:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 0000000070e666f7 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.662562:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c51f48 lrc: 3/0,1 mode: --/PW res: [0x2b8d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.662566:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c0fd8705/0x3234de053c4eab3 lrc: 2/0,0 mode: PR/PR res: [0x2b8d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c7b expref: 631 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.662566:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211937 00000100:00100000:0.0:1651529344.662568:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1434:39029:x1731745946502976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.662569:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.662569:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.662570:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c51f48 lrc: 4/0,1 mode: --/PW res: [0x2b8d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.662573:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178387 count 1 00010000:00010000:1.0:1651529344.662575:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c0fd8705/0x3234de053c4eab3 lrc: 3/0,0 mode: PR/PR res: [0x2b8d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c7b expref: 631 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.662576:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f926d75/0x3234de053c51f4f lrc: 3/0,1 mode: --/PW res: [0x2b8d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.662579:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c0fd8705/0x3234de053c4eab3 lrc: 4/0,0 mode: PR/PR res: [0x2b8d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c7b expref: 631 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.662581:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000011af3344/0x3234de053c4e661 lrc: 2/0,0 mode: PR/PR res: [0x2b8d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a5a expref: 631 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.662584:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.662585:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.662585:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f926d75/0x3234de053c51f4f lrc: 4/0,1 mode: --/PW res: [0x2b8d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.662586:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000007fba516 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997030656:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.662592:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 000000007d8fabda going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.662592:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000011af3344/0x3234de053c4e661 lrc: 3/0,0 mode: PR/PR res: [0x2b8d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a5a expref: 631 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.662595:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000011af3344/0x3234de053c4e661 lrc: 4/0,0 mode: PR/PR res: [0x2b8d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a5a expref: 631 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.662598:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211938 00000100:00100000:1.0:1651529344.662599:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1434:39029:x1731745946502784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.662599:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd68fdd5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997030720:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.662603:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178384 count 1 00000100:00100000:0.0:1651529344.662605:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000003ad73843 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.662606:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c51f56 lrc: 3/0,1 mode: --/PW res: [0x2b8d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.662610:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e6577475/0x3234de053c4e239 lrc: 2/0,0 mode: PR/PR res: [0x2b8d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a46 expref: 631 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.662611:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211939 00010000:00010000:1.0:1651529344.662613:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.662613:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.662613:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1434:39029:x1731745946502912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.662614:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c51f56 lrc: 4/0,1 mode: --/PW res: [0x2b8d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.662617:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178386 count 1 00010000:00010000:0.0:1651529344.662619:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000934ba032/0x3234de053c51f5d lrc: 3/0,1 mode: --/PW res: [0x2b8d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.662620:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e6577475/0x3234de053c4e239 lrc: 3/0,0 mode: PR/PR res: [0x2b8d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a46 expref: 631 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.662623:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e6577475/0x3234de053c4e239 lrc: 4/0,0 mode: PR/PR res: [0x2b8d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a46 expref: 631 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.662624:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c4d59e lrc: 2/0,0 mode: PR/PR res: [0x2b8d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d07fd expref: 631 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.662627:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a9b051f pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997030784:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.662627:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.662627:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.662628:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000934ba032/0x3234de053c51f5d lrc: 4/0,1 mode: --/PW res: [0x2b8d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.662633:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000089d75f07 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.662633:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c4d59e lrc: 3/0,0 mode: PR/PR res: [0x2b8d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d07fd expref: 631 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.662638:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211940 00010000:00010000:0.0:1651529344.662639:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c4d59e lrc: 4/0,0 mode: PR/PR res: [0x2b8d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d07fd expref: 631 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.662640:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1434:39029:x1731745946503040:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.662643:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d9cfef26 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997030848:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.662644:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178388 count 1 00010000:00010000:1.0:1651529344.662647:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaf12d4f/0x3234de053c51f64 lrc: 3/0,1 mode: --/PW res: [0x2b8d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.662649:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c0dff858 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.662651:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000452f16e2/0x3234de053c49f6c lrc: 2/0,0 mode: PR/PR res: [0x2b8d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb419 expref: 631 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.662654:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.662654:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.662655:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eaf12d4f/0x3234de053c51f64 lrc: 4/0,1 mode: --/PW res: [0x2b8d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.662660:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000452f16e2/0x3234de053c49f6c lrc: 3/0,0 mode: PR/PR res: [0x2b8d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb419 expref: 631 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.662664:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000452f16e2/0x3234de053c49f6c lrc: 4/0,0 mode: PR/PR res: [0x2b8d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb419 expref: 631 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.662664:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.662667:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004be0190 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997030912:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.662673:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f79d8146 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.662678:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946503104 00000100:00100000:1.0:1651529344.662690:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211941 00000100:00100000:1.0:1651529344.662692:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000002e08c45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1435:39030:x1731745946503104:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.662705:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178389 count 1 00010000:00010000:1.0:1651529344.662709:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051f06669/0x3234de053c51f6b lrc: 3/0,1 mode: --/PW res: [0x2b8d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.662721:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000cc6b103/0x3234de053c4f675 lrc: 2/0,0 mode: PR/PR res: [0x2b8d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c86 expref: 631 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.662724:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.662725:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.662726:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051f06669/0x3234de053c51f6b lrc: 4/0,1 mode: --/PW res: [0x2b8d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.662732:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000cc6b103/0x3234de053c4f675 lrc: 3/0,0 mode: PR/PR res: [0x2b8d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c86 expref: 631 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.662744:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000cc6b103/0x3234de053c4f675 lrc: 4/0,0 mode: PR/PR res: [0x2b8d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c86 expref: 631 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.662748:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000673bcbe2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997030976:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.662760:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aeda71fe going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.662878:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007ac35c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997030592:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.662882:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000707bb969/0x3234de053c51f41 lrc: 3/0,1 mode: --/PW res: [0x2b8cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.662904:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000034e35367 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997030528:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.662909:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006f0edbda/0x3234de053c51f3a lrc: 3/0,1 mode: --/PW res: [0x2b8ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.663328:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd68fdd5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997030720:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.663330:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.663337:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006f926d75/0x3234de053c51f4f lrc: 3/0,1 mode: --/PW res: [0x2b8d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.663338:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.663345:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.663345:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d9cfef26 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997030848:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.663348:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000934ba032/0x3234de053c51f5d lrc: 3/0,1 mode: --/PW res: [0x2b8d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.663351:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.663355:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396383808 00000100:00100000:1.0:1651529344.663358:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.663360:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e6832ce5/0x3234de053c4edd1 lrc: 4/0,0 mode: PR/PR res: [0x2b8cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6994 expref: 632 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.663362:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.663366:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396383936 00010000:00010000:0.0:1651529344.663368:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c0fd8705/0x3234de053c4eab3 lrc: 5/0,0 mode: PR/PR res: [0x2b8d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c7b expref: 633 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.663372:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396384064 00000100:00100000:1.0:1651529344.663375:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.663375:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e6577475/0x3234de053c4e239 lrc: 5/0,0 mode: PR/PR res: [0x2b8d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a46 expref: 634 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.663379:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396383872 00010000:00010000:0.0:1651529344.663380:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d8ea9f0a/0x3234de053c4a0b5 lrc: 4/0,0 mode: PR/PR res: [0x2b8ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb86b expref: 635 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.663381:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.663384:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396384000 00010000:00010000:0.0:1651529344.663386:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000011af3344/0x3234de053c4e661 lrc: 4/0,0 mode: PR/PR res: [0x2b8d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a5a expref: 636 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.663389:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000007fba516 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997030656:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.663390:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396384128 00010000:00010000:0.0:1651529344.663392:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c4d59e lrc: 4/0,0 mode: PR/PR res: [0x2b8d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d07fd expref: 637 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.663393:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c51f48 lrc: 3/0,1 mode: --/PW res: [0x2b8d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.663396:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396384192 00010000:00010000:0.0:1651529344.663398:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000452f16e2/0x3234de053c49f6c lrc: 5/0,0 mode: PR/PR res: [0x2b8d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb419 expref: 638 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.663400:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a9b051f pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997030784:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.663401:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396384256 00010000:00010000:1.0:1651529344.663402:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c51f56 lrc: 3/0,1 mode: --/PW res: [0x2b8d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663403:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000cc6b103/0x3234de053c4f675 lrc: 5/0,0 mode: PR/PR res: [0x2b8d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c86 expref: 639 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.663408:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12716 00000100:00100000:1.0:1651529344.663410:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12717 00000100:00100000:0.0:1651529344.663410:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+639:41278:x1731746396383808:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.663412:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+639:41278:x1731746396383936:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.663414:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.663415:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e6832ce5/0x3234de053c4edd1 lrc: 4/0,0 mode: PR/PR res: [0x2b8cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6994 expref: 639 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.663416:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.663417:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c0fd8705/0x3234de053c4eab3 lrc: 4/0,0 mode: PR/PR res: [0x2b8d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c7b expref: 639 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.663419:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e6832ce5/0x3234de053c4edd1 lrc: 3/0,0 mode: PR/PR res: [0x2b8cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6994 expref: 639 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.663421:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c0fd8705/0x3234de053c4eab3 lrc: 3/0,0 mode: PR/PR res: [0x2b8d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c7b expref: 639 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.663424:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6832ce5/0x3234de053c4edd1 lrc: 0/0,0 mode: --/PR res: [0x2b8cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6994 expref: 639 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.663427:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0fd8705/0x3234de053c4eab3 lrc: 0/0,0 mode: --/PR res: [0x2b8d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c7b expref: 639 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.663428:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.663429:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.663430:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000707bb969/0x3234de053c51f41 lrc: 3/0,1 mode: PW/PW res: [0x2b8cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.663431:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.663432:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.663433:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c51f48 lrc: 3/0,1 mode: PW/PW res: [0x2b8d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663433:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000707bb969/0x3234de053c51f41 lrc: 4/0,1 mode: PW/PW res: [0x2b8cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.663438:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c51f48 lrc: 4/0,1 mode: PW/PW res: [0x2b8d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663443:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.663450:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.663453:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+637:41278:x1731746396383808:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 43us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.663456:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12716 00000100:00100000:1.0:1651529344.663458:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+637:41278:x1731746396383936:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 45us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.663460:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12717 00000100:00100000:0.0:1651529344.663462:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12718 00000100:00100000:0.0:1651529344.663464:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+635:41278:x1731746396384064:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.663466:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.663467:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12719 00000100:00100000:1.0:1651529344.663468:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+635:41279:x1731746396383872:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.663468:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e6577475/0x3234de053c4e239 lrc: 4/0,0 mode: PR/PR res: [0x2b8d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a46 expref: 635 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.663471:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.663472:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d8ea9f0a/0x3234de053c4a0b5 lrc: 4/0,0 mode: PR/PR res: [0x2b8ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb86b expref: 635 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.663475:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e6577475/0x3234de053c4e239 lrc: 3/0,0 mode: PR/PR res: [0x2b8d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a46 expref: 635 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.663476:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d8ea9f0a/0x3234de053c4a0b5 lrc: 3/0,0 mode: PR/PR res: [0x2b8ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb86b expref: 635 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.663479:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6577475/0x3234de053c4e239 lrc: 0/0,0 mode: --/PR res: [0x2b8d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a46 expref: 635 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.663481:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8ea9f0a/0x3234de053c4a0b5 lrc: 0/0,0 mode: --/PR res: [0x2b8ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb86b expref: 635 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.663483:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.663483:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.663484:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c51f56 lrc: 3/0,1 mode: PW/PW res: [0x2b8d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.663485:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.663485:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.663486:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006f0edbda/0x3234de053c51f3a lrc: 3/0,1 mode: PW/PW res: [0x2b8ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663487:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c51f56 lrc: 4/0,1 mode: PW/PW res: [0x2b8d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.663489:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f0edbda/0x3234de053c51f3a lrc: 4/0,1 mode: PW/PW res: [0x2b8ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663496:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.663501:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+633:41278:x1731746396384064:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 37us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.663504:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12718 00010000:00010000:1.0:1651529344.663507:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.663512:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+632:41279:x1731746396383872:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 43us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.663514:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12720 00000100:00100000:1.0:1651529344.663516:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12719 00000100:00100000:0.0:1651529344.663516:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+632:41279:x1731746396384000:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.663519:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.663520:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000011af3344/0x3234de053c4e661 lrc: 4/0,0 mode: PR/PR res: [0x2b8d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a5a expref: 631 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.663521:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12721 00000100:00100000:1.0:1651529344.663523:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+631:41279:x1731746396384128:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.663524:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000011af3344/0x3234de053c4e661 lrc: 3/0,0 mode: PR/PR res: [0x2b8d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a5a expref: 631 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.663525:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.663526:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c4d59e lrc: 4/0,0 mode: PR/PR res: [0x2b8d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d07fd expref: 631 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.663529:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011af3344/0x3234de053c4e661 lrc: 0/0,0 mode: --/PR res: [0x2b8d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a5a expref: 631 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.663530:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c4d59e lrc: 3/0,0 mode: PR/PR res: [0x2b8d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d07fd expref: 631 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.663532:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.663533:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.663534:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006f926d75/0x3234de053c51f4f lrc: 3/0,1 mode: PW/PW res: [0x2b8d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.663535:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c4d59e lrc: 0/0,0 mode: --/PR res: [0x2b8d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d07fd expref: 630 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.663536:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f926d75/0x3234de053c51f4f lrc: 4/0,1 mode: PW/PW res: [0x2b8d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.663539:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.663539:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.663540:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000934ba032/0x3234de053c51f5d lrc: 3/0,1 mode: PW/PW res: [0x2b8d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663542:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.663543:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000934ba032/0x3234de053c51f5d lrc: 4/0,1 mode: PW/PW res: [0x2b8d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.663547:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+629:41279:x1731746396384000:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 31us (189us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.663551:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.663556:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+629:41279:x1731746396384128:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.663557:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12720 00000100:00100000:1.0:1651529344.663559:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12721 00000100:00100000:0.0:1651529344.663562:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12722 00000100:00100000:1.0:1651529344.663564:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12723 00000100:00100000:0.0:1651529344.663564:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000496e37f3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+627:41279:x1731746396384192:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.663566:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+627:41279:x1731746396384256:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.663566:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.663568:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.663568:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000452f16e2/0x3234de053c49f6c lrc: 5/0,0 mode: PR/PR res: [0x2b8d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb419 expref: 627 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.663569:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000cc6b103/0x3234de053c4f675 lrc: 5/0,0 mode: PR/PR res: [0x2b8d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c86 expref: 627 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.663571:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000452f16e2/0x3234de053c49f6c lrc: 4/0,0 mode: PR/PR res: [0x2b8d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb419 expref: 627 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.663573:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000cc6b103/0x3234de053c4f675 lrc: 4/0,0 mode: PR/PR res: [0x2b8d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c86 expref: 627 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.663576:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.663576:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.663577:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.663577:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eaf12d4f/0x3234de053c51f64 lrc: 3/0,1 mode: PW/PW res: [0x2b8d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.663578:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.663579:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000051f06669/0x3234de053c51f6b lrc: 3/0,1 mode: PW/PW res: [0x2b8d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663580:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eaf12d4f/0x3234de053c51f64 lrc: 4/0,1 mode: PW/PW res: [0x2b8d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.663582:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051f06669/0x3234de053c51f6b lrc: 4/0,1 mode: PW/PW res: [0x2b8d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663585:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.663586:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.663590:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+627:41279:x1731746396384256:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 24us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.663590:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000496e37f3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+627:41279:x1731746396384192:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 25us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.663592:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12722 00000100:00100000:1.0:1651529344.663593:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12723 00010000:00010000:0.0:1651529344.663601:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006f926d75/0x3234de053c51f4f lrc: 3/0,1 mode: PW/PW res: [0x2b8d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.663604:0:80280:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000452f16e2/0x3234de053c49f6c lrc: 0/0,0 mode: --/PR res: [0x2b8d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb419 expref: 625 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.663605:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f926d75/0x3234de053c51f4f lrc: 3/0,1 mode: PW/PW res: [0x2b8d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.663608:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004be0190 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997030912:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.663608:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f926d75/0x3234de053c51f4f lrc: 3/0,1 mode: PW/PW res: [0x2b8d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663611:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f926d75/0x3234de053c51f4f lrc: 2/0,0 mode: PW/PW res: [0x2b8d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.663612:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eaf12d4f/0x3234de053c51f64 lrc: 3/0,1 mode: PW/PW res: [0x2b8d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.663615:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eaf12d4f/0x3234de053c51f64 lrc: 3/0,1 mode: PW/PW res: [0x2b8d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.663617:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eaf12d4f/0x3234de053c51f64 lrc: 3/0,1 mode: PW/PW res: [0x2b8d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.663621:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaf12d4f/0x3234de053c51f64 lrc: 3/0,1 mode: PW/PW res: [0x2b8d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.663623:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eaf12d4f/0x3234de053c51f64 lrc: 2/0,0 mode: PW/PW res: [0x2b8d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.663666:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1437:39029:x1731745946502976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1097us (1224us total) trans 12885079989 rc 0/0 00000100:00100000:0.0:1651529344.663669:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211937 00000100:00100000:1.0:1651529344.663675:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1436:39029:x1731745946503040:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1034us (1192us total) trans 12885079990 rc 0/0 00010000:00010000:0.0:1651529344.663677:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000934ba032/0x3234de053c51f5d lrc: 3/0,1 mode: PW/PW res: [0x2b8d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.663678:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211940 00010000:00010000:0.0:1651529344.663680:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000934ba032/0x3234de053c51f5d lrc: 3/0,1 mode: PW/PW res: [0x2b8d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663683:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000934ba032/0x3234de053c51f5d lrc: 3/0,1 mode: PW/PW res: [0x2b8d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663686:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000934ba032/0x3234de053c51f5d lrc: 2/0,0 mode: PW/PW res: [0x2b8d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.663688:0:72397:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000cc6b103/0x3234de053c4f675 lrc: 0/0,0 mode: --/PR res: [0x2b8d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c86 expref: 624 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.663692:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000673bcbe2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997030976:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.663695:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000051f06669/0x3234de053c51f6b lrc: 3/0,1 mode: PW/PW res: [0x2b8d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.663698:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000051f06669/0x3234de053c51f6b lrc: 3/0,1 mode: PW/PW res: [0x2b8d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.663703:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051f06669/0x3234de053c51f6b lrc: 3/0,1 mode: PW/PW res: [0x2b8d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.663706:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051f06669/0x3234de053c51f6b lrc: 3/0,1 mode: PW/PW res: [0x2b8d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.663709:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051f06669/0x3234de053c51f6b lrc: 2/0,0 mode: PW/PW res: [0x2b8d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.663720:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1436:39029:x1731745946502912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1106us (1257us total) trans 12885079991 rc 0/0 00000100:00100000:0.0:1651529344.663723:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211939 00010000:00010000:0.0:1651529344.663729:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f926d75/0x3234de053c51f4f lrc: 2/0,0 mode: PW/PW res: [0x2b8d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663732:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006f926d75 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.663733:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f926d75/0x3234de053c51f4f lrc: 2/0,0 mode: PW/PW res: [0x2b8d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663747:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f926d75/0x3234de053c51f4f lrc: 3/0,0 mode: PW/PW res: [0x2b8d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663752:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f926d75/0x3234de053c51f4f lrc: 1/0,0 mode: --/PW res: [0x2b8d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.663754:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000002e08c45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1436:39030:x1731745946503104:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1061us (1090us total) trans 12885079992 rc 0/0 00010000:00010000:0.0:1651529344.663754:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f926d75/0x3234de053c51f4f lrc: 0/0,0 mode: --/PW res: [0x2b8d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.663757:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211941 00010000:00010000:0.0:1651529344.663759:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eaf12d4f/0x3234de053c51f64 lrc: 2/0,0 mode: PW/PW res: [0x2b8d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663762:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eaf12d4f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.663763:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaf12d4f/0x3234de053c51f64 lrc: 2/0,0 mode: PW/PW res: [0x2b8d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.663765:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000707bb969/0x3234de053c51f41 lrc: 3/0,1 mode: PW/PW res: [0x2b8cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663766:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaf12d4f/0x3234de053c51f64 lrc: 3/0,0 mode: PW/PW res: [0x2b8d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.663768:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000707bb969/0x3234de053c51f41 lrc: 3/0,1 mode: PW/PW res: [0x2b8cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663769:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eaf12d4f/0x3234de053c51f64 lrc: 1/0,0 mode: --/PW res: [0x2b8d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.663771:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000707bb969/0x3234de053c51f41 lrc: 3/0,1 mode: PW/PW res: [0x2b8cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663771:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eaf12d4f/0x3234de053c51f64 lrc: 0/0,0 mode: --/PW res: [0x2b8d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.663773:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000707bb969/0x3234de053c51f41 lrc: 2/0,0 mode: PW/PW res: [0x2b8cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663774:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000934ba032/0x3234de053c51f5d lrc: 2/0,0 mode: PW/PW res: [0x2b8d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663777:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000934ba032 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.663778:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000934ba032/0x3234de053c51f5d lrc: 2/0,0 mode: PW/PW res: [0x2b8d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663780:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000934ba032/0x3234de053c51f5d lrc: 3/0,0 mode: PW/PW res: [0x2b8d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663783:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000934ba032/0x3234de053c51f5d lrc: 1/0,0 mode: --/PW res: [0x2b8d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663786:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000934ba032/0x3234de053c51f5d lrc: 0/0,0 mode: --/PW res: [0x2b8d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663790:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051f06669/0x3234de053c51f6b lrc: 2/0,0 mode: PW/PW res: [0x2b8d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663792:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000051f06669 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.663793:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051f06669/0x3234de053c51f6b lrc: 2/0,0 mode: PW/PW res: [0x2b8d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663796:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051f06669/0x3234de053c51f6b lrc: 3/0,0 mode: PW/PW res: [0x2b8d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663799:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051f06669/0x3234de053c51f6b lrc: 1/0,0 mode: --/PW res: [0x2b8d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663801:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051f06669/0x3234de053c51f6b lrc: 0/0,0 mode: --/PW res: [0x2b8d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.663804:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1436:39029:x1731745946502720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1304us (1379us total) trans 12885079993 rc 0/0 00010000:00010000:0.0:1651529344.663804:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000707bb969/0x3234de053c51f41 lrc: 2/0,0 mode: PW/PW res: [0x2b8cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663807:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000707bb969 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.663808:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000707bb969/0x3234de053c51f41 lrc: 2/0,0 mode: PW/PW res: [0x2b8cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.663809:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211935 00010000:00010000:0.0:1651529344.663810:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000707bb969/0x3234de053c51f41 lrc: 3/0,0 mode: PW/PW res: [0x2b8cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663813:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000707bb969/0x3234de053c51f41 lrc: 1/0,0 mode: --/PW res: [0x2b8cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.663815:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c51f56 lrc: 3/0,1 mode: PW/PW res: [0x2b8d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663816:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000707bb969/0x3234de053c51f41 lrc: 0/0,0 mode: --/PW res: [0x2b8cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.663818:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c51f56 lrc: 3/0,1 mode: PW/PW res: [0x2b8d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.663821:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c51f56 lrc: 3/0,1 mode: PW/PW res: [0x2b8d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663823:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006f0edbda/0x3234de053c51f3a lrc: 3/0,1 mode: PW/PW res: [0x2b8ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.663824:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c51f56 lrc: 2/0,0 mode: PW/PW res: [0x2b8d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663826:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f0edbda/0x3234de053c51f3a lrc: 3/0,1 mode: PW/PW res: [0x2b8ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663829:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f0edbda/0x3234de053c51f3a lrc: 3/0,1 mode: PW/PW res: [0x2b8ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663838:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f0edbda/0x3234de053c51f3a lrc: 2/0,0 mode: PW/PW res: [0x2b8ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.663859:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1437:39029:x1731745946502784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1259us (1411us total) trans 12885079994 rc 0/0 00000100:00100000:1.0:1651529344.663862:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211938 00010000:00010000:1.0:1651529344.663868:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c51f48 lrc: 3/0,1 mode: PW/PW res: [0x2b8d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.663871:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c51f48 lrc: 3/0,1 mode: PW/PW res: [0x2b8d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.663874:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c51f48 lrc: 3/0,1 mode: PW/PW res: [0x2b8d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.663875:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1436:39030:x1731745946502656:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1377us (1476us total) trans 12885079995 rc 0/0 00010000:00010000:1.0:1651529344.663876:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c51f48 lrc: 2/0,0 mode: PW/PW res: [0x2b8d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.663878:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211934 00010000:00010000:0.0:1651529344.663894:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c51f56 lrc: 2/0,0 mode: PW/PW res: [0x2b8d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663897:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c9b39253 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.663898:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c51f56 lrc: 2/0,0 mode: PW/PW res: [0x2b8d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663901:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c51f56 lrc: 3/0,0 mode: PW/PW res: [0x2b8d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663906:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c51f56 lrc: 1/0,0 mode: --/PW res: [0x2b8d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663909:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c51f56 lrc: 0/0,0 mode: --/PW res: [0x2b8d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663913:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f0edbda/0x3234de053c51f3a lrc: 2/0,0 mode: PW/PW res: [0x2b8ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.663914:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1436:39029:x1731745946502848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1359us (1479us total) trans 12885079996 rc 0/0 00010000:00010000:0.0:1651529344.663915:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006f0edbda already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.663916:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f0edbda/0x3234de053c51f3a lrc: 2/0,0 mode: PW/PW res: [0x2b8ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.663917:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211936 00010000:00010000:0.0:1651529344.663919:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f0edbda/0x3234de053c51f3a lrc: 3/0,0 mode: PW/PW res: [0x2b8ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663922:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f0edbda/0x3234de053c51f3a lrc: 1/0,0 mode: --/PW res: [0x2b8ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663925:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f0edbda/0x3234de053c51f3a lrc: 0/0,0 mode: --/PW res: [0x2b8ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663928:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c51f48 lrc: 2/0,0 mode: PW/PW res: [0x2b8d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663931:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009fd52982 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.663932:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c51f48 lrc: 2/0,0 mode: PW/PW res: [0x2b8d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663934:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c51f48 lrc: 3/0,0 mode: PW/PW res: [0x2b8d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663938:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c51f48 lrc: 1/0,0 mode: --/PW res: [0x2b8d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.663940:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c51f48 lrc: 0/0,0 mode: --/PW res: [0x2b8d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.664257:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.664268:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946503744 00000100:00100000:0.0:1651529344.664270:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.664276:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946503680 00000100:00100000:0.0:1651529344.664277:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.664286:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946503872 00000100:00100000:0.0:1651529344.664286:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.664290:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946504000 00000100:00100000:0.0:1651529344.664292:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.664303:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946503808 00000100:00100000:1.0:1651529344.664308:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211942 00000100:00100000:0.0:1651529344.664308:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.664310:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1440:39029:x1731745946503744:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.664315:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529344.664316:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178391 count 1 00010000:00010000:1.0:1651529344.664320:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc44198a/0x3234de053c51f72 lrc: 3/0,1 mode: --/PW res: [0x2b8d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.664322:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.664325:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000006c1fa55/0x3234de053c4cee4 lrc: 2/0,0 mode: PR/PR res: [0x2b8d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced7e expref: 623 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.664328:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.664328:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946503936 00010000:00010000:1.0:1651529344.664329:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.664329:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc44198a/0x3234de053c51f72 lrc: 4/0,1 mode: --/PW res: [0x2b8d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.664334:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946504064 00010000:00010000:1.0:1651529344.664336:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000006c1fa55/0x3234de053c4cee4 lrc: 3/0,0 mode: PR/PR res: [0x2b8d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced7e expref: 623 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.664336:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946504128 00000100:00100000:0.0:1651529344.664339:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211943 00010000:00010000:1.0:1651529344.664340:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000006c1fa55/0x3234de053c4cee4 lrc: 4/0,0 mode: PR/PR res: [0x2b8d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced7e expref: 623 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.664341:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1443:39030:x1731745946503680:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.664346:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178390 count 1 00000100:00100000:1.0:1651529344.664347:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000043b7984f pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997031040:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.664351:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c51f79 lrc: 3/0,1 mode: --/PW res: [0x2b8d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.664358:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.664358:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003324f656/0x3234de053c4f2e0 lrc: 2/0,0 mode: PR/PR res: [0x2b8d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e63 expref: 623 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.664361:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.664362:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.664363:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c51f79 lrc: 4/0,1 mode: --/PW res: [0x2b8d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.664364:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211944 00000100:00100000:1.0:1651529344.664365:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1443:39029:x1731745946503872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.664369:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178393 count 1 00010000:00010000:0.0:1651529344.664370:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003324f656/0x3234de053c4f2e0 lrc: 3/0,0 mode: PR/PR res: [0x2b8d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e63 expref: 623 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.664372:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fa75d86/0x3234de053c51f80 lrc: 3/0,1 mode: --/PW res: [0x2b8d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.664373:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003324f656/0x3234de053c4f2e0 lrc: 4/0,0 mode: PR/PR res: [0x2b8d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e63 expref: 623 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.664377:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4f33b lrc: 2/0,0 mode: PR/PR res: [0x2b8d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f7b expref: 623 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.664377:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000023afca5e pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997031104:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.664380:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.664380:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.664381:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fa75d86/0x3234de053c51f80 lrc: 4/0,1 mode: --/PW res: [0x2b8d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.664387:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4f33b lrc: 3/0,0 mode: PR/PR res: [0x2b8d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f7b expref: 623 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.664387:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b81e4a0 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.664390:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4f33b lrc: 4/0,0 mode: PR/PR res: [0x2b8d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f7b expref: 623 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.664394:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000057329b82 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997031168:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.664394:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211945 00000100:00100000:0.0:1651529344.664395:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1443:39029:x1731745946504000:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.664399:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178395 count 1 00000100:00100000:1.0:1651529344.664400:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e5f43e7 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.664402:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d288bfff/0x3234de053c51f87 lrc: 3/0,1 mode: --/PW res: [0x2b8db:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.664406:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211946 00010000:00010000:0.0:1651529344.664407:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd1e7c0d/0x3234de053c4c8d9 lrc: 2/0,0 mode: PR/PR res: [0x2b8db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd505 expref: 623 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.664408:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1443:39030:x1731745946503808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.664410:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.664410:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1651529344.664411:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178392 count 1 00010000:00010000:0.0:1651529344.664411:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d288bfff/0x3234de053c51f87 lrc: 4/0,1 mode: --/PW res: [0x2b8db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.664414:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ffd5f73/0x3234de053c51f8e lrc: 3/0,1 mode: --/PW res: [0x2b8d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.664417:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dd1e7c0d/0x3234de053c4c8d9 lrc: 3/0,0 mode: PR/PR res: [0x2b8db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd505 expref: 623 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.664419:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000008fd24be/0x3234de053c4d199 lrc: 2/0,0 mode: PR/PR res: [0x2b8d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf7fe expref: 623 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.664421:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dd1e7c0d/0x3234de053c4c8d9 lrc: 4/0,0 mode: PR/PR res: [0x2b8db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd505 expref: 623 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.664422:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.664422:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.664423:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ffd5f73/0x3234de053c51f8e lrc: 4/0,1 mode: --/PW res: [0x2b8d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.664424:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a138afb6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997031232:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.664428:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000008fd24be/0x3234de053c4d199 lrc: 3/0,0 mode: PR/PR res: [0x2b8d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf7fe expref: 623 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.664431:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e68b7e1f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.664432:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000008fd24be/0x3234de053c4d199 lrc: 4/0,0 mode: PR/PR res: [0x2b8d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf7fe expref: 623 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.664436:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000673bcbe2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997031296:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.664436:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211947 00000100:00100000:0.0:1651529344.664438:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1443:39030:x1731745946503936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.664442:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 000000007e004c12 going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.664442:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178394 count 1 00010000:00010000:0.0:1651529344.664445:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d6aea49/0x3234de053c51f95 lrc: 3/0,1 mode: --/PW res: [0x2b8da:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.664447:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211948 00000100:00100000:1.0:1651529344.664449:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1443:39030:x1731745946504064:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.664449:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000508afb8a/0x3234de053c4b108 lrc: 2/0,0 mode: PR/PR res: [0x2b8da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc091 expref: 623 pid: 80280 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.664452:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.664452:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1651529344.664453:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178396 count 1 00010000:00010000:0.0:1651529344.664453:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d6aea49/0x3234de053c51f95 lrc: 4/0,1 mode: --/PW res: [0x2b8da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.664456:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b6258e0/0x3234de053c51f9c lrc: 3/0,1 mode: --/PW res: [0x2b8dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.664459:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000508afb8a/0x3234de053c4b108 lrc: 3/0,0 mode: PR/PR res: [0x2b8da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc091 expref: 623 pid: 80280 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.664462:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000053029ce7/0x3234de053c4e80c lrc: 2/0,0 mode: PR/PR res: [0x2b8dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d50f8 expref: 623 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.664465:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.664465:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000508afb8a/0x3234de053c4b108 lrc: 4/0,0 mode: PR/PR res: [0x2b8da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc091 expref: 623 pid: 80280 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.664466:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.664466:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b6258e0/0x3234de053c51f9c lrc: 4/0,1 mode: --/PW res: [0x2b8dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.664469:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000012863683 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997031360:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.664472:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000053029ce7/0x3234de053c4e80c lrc: 3/0,0 mode: PR/PR res: [0x2b8dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d50f8 expref: 623 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.664475:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000053029ce7/0x3234de053c4e80c lrc: 4/0,0 mode: PR/PR res: [0x2b8dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d50f8 expref: 623 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.664475:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 0000000070e666f7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.664479:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bca72234 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997031424:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.664480:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211949 00000100:00100000:0.0:1651529344.664482:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1443:39030:x1731745946504128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.664485:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a5495eb going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.664485:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178397 count 1 00010000:00010000:0.0:1651529344.664488:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b31b1dc0/0x3234de053c51fa3 lrc: 3/0,1 mode: --/PW res: [0x2b8dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.664492:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000047772d9f/0x3234de053c4e50a lrc: 2/0,0 mode: PR/PR res: [0x2b8dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4559 expref: 623 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.664495:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.664496:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.664496:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b31b1dc0/0x3234de053c51fa3 lrc: 4/0,1 mode: --/PW res: [0x2b8dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.664502:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000047772d9f/0x3234de053c4e50a lrc: 3/0,0 mode: PR/PR res: [0x2b8dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4559 expref: 623 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.664506:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000047772d9f/0x3234de053c4e50a lrc: 4/0,0 mode: PR/PR res: [0x2b8dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4559 expref: 623 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.664512:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005a17dd72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997031488:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.664525:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c0dff858 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.665033:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000043b7984f pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997031040:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.665038:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fc44198a/0x3234de053c51f72 lrc: 3/0,1 mode: --/PW res: [0x2b8d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.665064:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000057329b82 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997031168:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.665067:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009fa75d86/0x3234de053c51f80 lrc: 3/0,1 mode: --/PW res: [0x2b8d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.665075:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.665083:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.665084:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000673bcbe2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997031296:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.665091:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001ffd5f73/0x3234de053c51f8e lrc: 3/0,1 mode: --/PW res: [0x2b8d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.665091:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.665097:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bca72234 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997031424:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.665098:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.665100:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001b6258e0/0x3234de053c51f9c lrc: 3/0,1 mode: --/PW res: [0x2b8dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.665106:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.665111:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396384896 00000100:00100000:0.0:1651529344.665112:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.665116:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003324f656/0x3234de053c4f2e0 lrc: 5/0,0 mode: PR/PR res: [0x2b8d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e63 expref: 624 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.665116:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.665122:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396385024 00000100:00100000:0.0:1651529344.665122:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.665124:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dd1e7c0d/0x3234de053c4c8d9 lrc: 5/0,0 mode: PR/PR res: [0x2b8db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd505 expref: 625 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.665128:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396385152 00010000:00010000:1.0:1651529344.665130:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000508afb8a/0x3234de053c4b108 lrc: 5/0,0 mode: PR/PR res: [0x2b8da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc091 expref: 626 pid: 80280 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.665130:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a138afb6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997031232:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.665134:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396385280 00010000:00010000:0.0:1651529344.665134:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d288bfff/0x3234de053c51f87 lrc: 3/0,1 mode: --/PW res: [0x2b8db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.665136:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000053029ce7/0x3234de053c4e80c lrc: 4/0,0 mode: PR/PR res: [0x2b8dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d50f8 expref: 627 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.665140:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396384832 00010000:00010000:1.0:1651529344.665142:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000006c1fa55/0x3234de053c4cee4 lrc: 4/0,0 mode: PR/PR res: [0x2b8d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced7e expref: 628 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.665142:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000023afca5e pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997031104:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.665144:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c51f79 lrc: 3/0,1 mode: --/PW res: [0x2b8d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.665145:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396384960 00010000:00010000:1.0:1651529344.665147:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4f33b lrc: 4/0,0 mode: PR/PR res: [0x2b8d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f7b expref: 629 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.665150:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000012863683 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997031360:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.665151:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396385088 00010000:00010000:0.0:1651529344.665152:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002d6aea49/0x3234de053c51f95 lrc: 3/0,1 mode: --/PW res: [0x2b8da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.665153:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000008fd24be/0x3234de053c4d199 lrc: 4/0,0 mode: PR/PR res: [0x2b8d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf7fe expref: 630 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.665157:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396385216 00000100:00100000:0.0:1651529344.665158:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005a17dd72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997031488:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.665159:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000047772d9f/0x3234de053c4e50a lrc: 4/0,0 mode: PR/PR res: [0x2b8dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4559 expref: 631 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.665160:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b31b1dc0/0x3234de053c51fa3 lrc: 3/0,1 mode: --/PW res: [0x2b8dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.665164:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12724 00000100:00100000:1.0:1651529344.665165:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+631:41279:x1731746396384896:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.665167:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12725 00010000:00010000:1.0:1651529344.665168:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.665169:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003324f656/0x3234de053c4f2e0 lrc: 4/0,0 mode: PR/PR res: [0x2b8d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e63 expref: 631 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.665169:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+631:41279:x1731746396385024:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.665172:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.665173:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003324f656/0x3234de053c4f2e0 lrc: 3/0,0 mode: PR/PR res: [0x2b8d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e63 expref: 631 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.665174:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dd1e7c0d/0x3234de053c4c8d9 lrc: 4/0,0 mode: PR/PR res: [0x2b8db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd505 expref: 631 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.665178:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dd1e7c0d/0x3234de053c4c8d9 lrc: 3/0,0 mode: PR/PR res: [0x2b8db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd505 expref: 631 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.665179:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003324f656/0x3234de053c4f2e0 lrc: 0/0,0 mode: --/PR res: [0x2b8d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e63 expref: 631 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.665182:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.665183:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.665184:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c51f79 lrc: 3/0,1 mode: PW/PW res: [0x2b8d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665184:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd1e7c0d/0x3234de053c4c8d9 lrc: 0/0,0 mode: --/PR res: [0x2b8db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd505 expref: 630 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.665188:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.665188:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.665189:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c51f79 lrc: 4/0,1 mode: PW/PW res: [0x2b8d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665189:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d288bfff/0x3234de053c51f87 lrc: 3/0,1 mode: PW/PW res: [0x2b8db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665192:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d288bfff/0x3234de053c51f87 lrc: 4/0,1 mode: PW/PW res: [0x2b8db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.665200:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.665207:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.665210:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+629:41279:x1731746396384896:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 44us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.665212:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12724 00000100:00100000:0.0:1651529344.665214:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+629:41279:x1731746396385024:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 45us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.665217:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12725 00000100:00100000:1.0:1651529344.665219:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12726 00000100:00100000:1.0:1651529344.665220:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+627:41279:x1731746396385152:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.665233:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.665234:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000508afb8a/0x3234de053c4b108 lrc: 4/0,0 mode: PR/PR res: [0x2b8da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc091 expref: 627 pid: 80280 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.665239:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12727 00000100:00100000:0.0:1651529344.665241:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a13808c6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+627:41279:x1731746396385280:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.665243:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000508afb8a/0x3234de053c4b108 lrc: 3/0,0 mode: PR/PR res: [0x2b8da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc091 expref: 627 pid: 80280 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.665244:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.665246:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000053029ce7/0x3234de053c4e80c lrc: 4/0,0 mode: PR/PR res: [0x2b8dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d50f8 expref: 627 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.665248:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000508afb8a/0x3234de053c4b108 lrc: 0/0,0 mode: --/PR res: [0x2b8da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc091 expref: 627 pid: 80280 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.665250:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000053029ce7/0x3234de053c4e80c lrc: 3/0,0 mode: PR/PR res: [0x2b8dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d50f8 expref: 627 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.665252:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.665252:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.665253:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002d6aea49/0x3234de053c51f95 lrc: 3/0,1 mode: PW/PW res: [0x2b8da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665255:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053029ce7/0x3234de053c4e80c lrc: 0/0,0 mode: --/PR res: [0x2b8dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d50f8 expref: 626 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.665256:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d6aea49/0x3234de053c51f95 lrc: 4/0,1 mode: PW/PW res: [0x2b8da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665258:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.665259:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.665260:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001b6258e0/0x3234de053c51f9c lrc: 3/0,1 mode: PW/PW res: [0x2b8dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665263:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b6258e0/0x3234de053c51f9c lrc: 4/0,1 mode: PW/PW res: [0x2b8dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.665267:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.665273:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+625:41279:x1731746396385152:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 52us (182us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.665277:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.665281:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12726 00000100:00100000:0.0:1651529344.665283:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a13808c6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+624:41279:x1731746396385280:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.665286:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12728 00000100:00100000:1.0:1651529344.665288:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+624:41278:x1731746396384832:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.665288:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12727 00010000:00010000:1.0:1651529344.665291:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.665292:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000006c1fa55/0x3234de053c4cee4 lrc: 4/0,0 mode: PR/PR res: [0x2b8d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced7e expref: 623 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.665293:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12729 00000100:00100000:0.0:1651529344.665295:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d177f8a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+623:41278:x1731746396384960:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.665296:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000006c1fa55/0x3234de053c4cee4 lrc: 3/0,0 mode: PR/PR res: [0x2b8d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced7e expref: 623 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.665297:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.665298:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4f33b lrc: 4/0,0 mode: PR/PR res: [0x2b8d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f7b expref: 623 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.665301:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006c1fa55/0x3234de053c4cee4 lrc: 0/0,0 mode: --/PR res: [0x2b8d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced7e expref: 623 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.665304:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.665305:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.665305:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fc44198a/0x3234de053c51f72 lrc: 3/0,1 mode: PW/PW res: [0x2b8d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665305:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4f33b lrc: 3/0,0 mode: PR/PR res: [0x2b8d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f7b expref: 622 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.665309:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc44198a/0x3234de053c51f72 lrc: 4/0,1 mode: PW/PW res: [0x2b8d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665310:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000828505cd/0x3234de053c4f33b lrc: 0/0,0 mode: --/PR res: [0x2b8d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7f7b expref: 622 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.665313:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.665313:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.665314:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.665314:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009fa75d86/0x3234de053c51f80 lrc: 3/0,1 mode: PW/PW res: [0x2b8d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665317:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fa75d86/0x3234de053c51f80 lrc: 4/0,1 mode: PW/PW res: [0x2b8d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.665319:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+621:41278:x1731746396384832:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 31us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.665322:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12728 00010000:00010000:0.0:1651529344.665325:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.665330:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d177f8a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+620:41278:x1731746396384960:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.665333:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12730 00000100:00100000:1.0:1651529344.665334:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+620:41278:x1731746396385088:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.665334:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12729 00010000:00010000:1.0:1651529344.665337:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.665339:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000008fd24be/0x3234de053c4d199 lrc: 4/0,0 mode: PR/PR res: [0x2b8d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf7fe expref: 619 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.665342:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000008fd24be/0x3234de053c4d199 lrc: 3/0,0 mode: PR/PR res: [0x2b8d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf7fe expref: 619 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.665342:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12731 00000100:00100000:0.0:1651529344.665344:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+619:41278:x1731746396385216:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.665346:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.665347:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008fd24be/0x3234de053c4d199 lrc: 0/0,0 mode: --/PR res: [0x2b8d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf7fe expref: 619 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.665348:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000047772d9f/0x3234de053c4e50a lrc: 4/0,0 mode: PR/PR res: [0x2b8dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4559 expref: 619 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.665350:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.665351:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.665351:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001ffd5f73/0x3234de053c51f8e lrc: 3/0,1 mode: PW/PW res: [0x2b8d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665352:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000047772d9f/0x3234de053c4e50a lrc: 3/0,0 mode: PR/PR res: [0x2b8dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4559 expref: 618 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.665354:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ffd5f73/0x3234de053c51f8e lrc: 4/0,1 mode: PW/PW res: [0x2b8d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665356:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047772d9f/0x3234de053c4e50a lrc: 0/0,0 mode: --/PR res: [0x2b8dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4559 expref: 618 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.665360:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.665360:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.665360:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.665361:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b31b1dc0/0x3234de053c51fa3 lrc: 3/0,1 mode: PW/PW res: [0x2b8dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665364:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b31b1dc0/0x3234de053c51fa3 lrc: 4/0,1 mode: PW/PW res: [0x2b8dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.665365:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+617:41278:x1731746396385088:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 30us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.665368:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12730 00010000:00010000:0.0:1651529344.665370:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.665374:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+616:41278:x1731746396385216:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 30us (253us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.665377:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001b6258e0/0x3234de053c51f9c lrc: 3/0,1 mode: PW/PW res: [0x2b8dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.665377:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12731 00010000:00010000:1.0:1651529344.665381:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b6258e0/0x3234de053c51f9c lrc: 3/0,1 mode: PW/PW res: [0x2b8dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665383:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d288bfff/0x3234de053c51f87 lrc: 3/0,1 mode: PW/PW res: [0x2b8db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.665384:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b6258e0/0x3234de053c51f9c lrc: 3/0,1 mode: PW/PW res: [0x2b8dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665386:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d288bfff/0x3234de053c51f87 lrc: 3/0,1 mode: PW/PW res: [0x2b8db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.665387:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b6258e0/0x3234de053c51f9c lrc: 2/0,0 mode: PW/PW res: [0x2b8dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665389:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d288bfff/0x3234de053c51f87 lrc: 3/0,1 mode: PW/PW res: [0x2b8db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665392:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d288bfff/0x3234de053c51f87 lrc: 2/0,0 mode: PW/PW res: [0x2b8db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.665436:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1445:39030:x1731745946504064:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 986us (1120us total) trans 12885079997 rc 0/0 00000100:00100000:1.0:1651529344.665439:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211948 00010000:00010000:1.0:1651529344.665446:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001ffd5f73/0x3234de053c51f8e lrc: 3/0,1 mode: PW/PW res: [0x2b8d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.665449:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ffd5f73/0x3234de053c51f8e lrc: 3/0,1 mode: PW/PW res: [0x2b8d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.665450:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1444:39029:x1731745946504000:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1053us (1163us total) trans 12885079998 rc 0/0 00010000:00010000:1.0:1651529344.665452:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ffd5f73/0x3234de053c51f8e lrc: 3/0,1 mode: PW/PW res: [0x2b8d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.665453:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211945 00010000:00010000:1.0:1651529344.665455:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ffd5f73/0x3234de053c51f8e lrc: 2/0,0 mode: PW/PW res: [0x2b8d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665460:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c51f79 lrc: 3/0,1 mode: PW/PW res: [0x2b8d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665469:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c51f79 lrc: 3/0,1 mode: PW/PW res: [0x2b8d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665472:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c51f79 lrc: 3/0,1 mode: PW/PW res: [0x2b8d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665475:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c51f79 lrc: 2/0,0 mode: PW/PW res: [0x2b8d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.665490:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1445:39030:x1731745946503808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1082us (1197us total) trans 12885079999 rc 0/0 00000100:00100000:1.0:1651529344.665495:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211946 00010000:00010000:1.0:1651529344.665501:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009fa75d86/0x3234de053c51f80 lrc: 3/0,1 mode: PW/PW res: [0x2b8d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.665505:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fa75d86/0x3234de053c51f80 lrc: 3/0,1 mode: PW/PW res: [0x2b8d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.665508:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fa75d86/0x3234de053c51f80 lrc: 3/0,1 mode: PW/PW res: [0x2b8d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.665509:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1444:39030:x1731745946503680:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1167us (1239us total) trans 12885080000 rc 0/0 00010000:00010000:1.0:1651529344.665511:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009fa75d86/0x3234de053c51f80 lrc: 2/0,0 mode: PW/PW res: [0x2b8d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.665512:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211943 00010000:00010000:0.0:1651529344.665518:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002d6aea49/0x3234de053c51f95 lrc: 3/0,1 mode: PW/PW res: [0x2b8da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665522:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d6aea49/0x3234de053c51f95 lrc: 3/0,1 mode: PW/PW res: [0x2b8da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665525:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d6aea49/0x3234de053c51f95 lrc: 3/0,1 mode: PW/PW res: [0x2b8da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665530:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d6aea49/0x3234de053c51f95 lrc: 2/0,0 mode: PW/PW res: [0x2b8da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.665540:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1444:39029:x1731745946503872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1174us (1262us total) trans 12885080001 rc 0/0 00000100:00100000:1.0:1651529344.665542:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211944 00010000:00010000:1.0:1651529344.665549:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fc44198a/0x3234de053c51f72 lrc: 3/0,1 mode: PW/PW res: [0x2b8d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.665551:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc44198a/0x3234de053c51f72 lrc: 3/0,1 mode: PW/PW res: [0x2b8d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.665554:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc44198a/0x3234de053c51f72 lrc: 3/0,1 mode: PW/PW res: [0x2b8d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.665557:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc44198a/0x3234de053c51f72 lrc: 2/0,0 mode: PW/PW res: [0x2b8d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.665560:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1444:39030:x1731745946503936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1121us (1251us total) trans 12885080002 rc 0/0 00000100:00100000:0.0:1651529344.665562:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211947 00010000:00010000:0.0:1651529344.665569:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b31b1dc0/0x3234de053c51fa3 lrc: 3/0,1 mode: PW/PW res: [0x2b8dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665572:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b31b1dc0/0x3234de053c51fa3 lrc: 3/0,1 mode: PW/PW res: [0x2b8dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665575:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b31b1dc0/0x3234de053c51fa3 lrc: 3/0,1 mode: PW/PW res: [0x2b8dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665578:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b31b1dc0/0x3234de053c51fa3 lrc: 2/0,0 mode: PW/PW res: [0x2b8dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.665588:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1444:39029:x1731745946503744:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1277us (1331us total) trans 12885080003 rc 0/0 00000100:00100000:1.0:1651529344.665590:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211942 00000100:00100000:0.0:1651529344.665609:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1444:39030:x1731745946504128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1126us (1286us total) trans 12885080004 rc 0/0 00000100:00100000:0.0:1651529344.665611:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211949 00010000:00010000:0.0:1651529344.665618:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b6258e0/0x3234de053c51f9c lrc: 2/0,0 mode: PW/PW res: [0x2b8dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665621:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001b6258e0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.665622:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b6258e0/0x3234de053c51f9c lrc: 2/0,0 mode: PW/PW res: [0x2b8dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665625:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b6258e0/0x3234de053c51f9c lrc: 3/0,0 mode: PW/PW res: [0x2b8dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665630:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b6258e0/0x3234de053c51f9c lrc: 1/0,0 mode: --/PW res: [0x2b8dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665633:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b6258e0/0x3234de053c51f9c lrc: 0/0,0 mode: --/PW res: [0x2b8dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665637:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d288bfff/0x3234de053c51f87 lrc: 2/0,0 mode: PW/PW res: [0x2b8db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665639:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d288bfff already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.665640:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d288bfff/0x3234de053c51f87 lrc: 2/0,0 mode: PW/PW res: [0x2b8db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665643:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d288bfff/0x3234de053c51f87 lrc: 3/0,0 mode: PW/PW res: [0x2b8db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665646:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d288bfff/0x3234de053c51f87 lrc: 1/0,0 mode: --/PW res: [0x2b8db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665649:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d288bfff/0x3234de053c51f87 lrc: 0/0,0 mode: --/PW res: [0x2b8db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665652:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ffd5f73/0x3234de053c51f8e lrc: 2/0,0 mode: PW/PW res: [0x2b8d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665655:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001ffd5f73 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.665656:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ffd5f73/0x3234de053c51f8e lrc: 2/0,0 mode: PW/PW res: [0x2b8d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665659:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ffd5f73/0x3234de053c51f8e lrc: 3/0,0 mode: PW/PW res: [0x2b8d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665662:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ffd5f73/0x3234de053c51f8e lrc: 1/0,0 mode: --/PW res: [0x2b8d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665664:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ffd5f73/0x3234de053c51f8e lrc: 0/0,0 mode: --/PW res: [0x2b8d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665668:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c51f79 lrc: 2/0,0 mode: PW/PW res: [0x2b8d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665670:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004ab50553 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.665671:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c51f79 lrc: 2/0,0 mode: PW/PW res: [0x2b8d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665674:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c51f79 lrc: 3/0,0 mode: PW/PW res: [0x2b8d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665677:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c51f79 lrc: 1/0,0 mode: --/PW res: [0x2b8d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665679:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ab50553/0x3234de053c51f79 lrc: 0/0,0 mode: --/PW res: [0x2b8d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665683:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009fa75d86/0x3234de053c51f80 lrc: 2/0,0 mode: PW/PW res: [0x2b8d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665685:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009fa75d86 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.665686:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009fa75d86/0x3234de053c51f80 lrc: 2/0,0 mode: PW/PW res: [0x2b8d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665689:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009fa75d86/0x3234de053c51f80 lrc: 3/0,0 mode: PW/PW res: [0x2b8d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665706:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009fa75d86/0x3234de053c51f80 lrc: 1/0,0 mode: --/PW res: [0x2b8d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665709:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fa75d86/0x3234de053c51f80 lrc: 0/0,0 mode: --/PW res: [0x2b8d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665713:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d6aea49/0x3234de053c51f95 lrc: 2/0,0 mode: PW/PW res: [0x2b8da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665716:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002d6aea49 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.665716:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d6aea49/0x3234de053c51f95 lrc: 2/0,0 mode: PW/PW res: [0x2b8da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665719:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d6aea49/0x3234de053c51f95 lrc: 3/0,0 mode: PW/PW res: [0x2b8da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665722:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d6aea49/0x3234de053c51f95 lrc: 1/0,0 mode: --/PW res: [0x2b8da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665725:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d6aea49/0x3234de053c51f95 lrc: 0/0,0 mode: --/PW res: [0x2b8da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665729:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc44198a/0x3234de053c51f72 lrc: 2/0,0 mode: PW/PW res: [0x2b8d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665731:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fc44198a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.665732:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc44198a/0x3234de053c51f72 lrc: 2/0,0 mode: PW/PW res: [0x2b8d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665745:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc44198a/0x3234de053c51f72 lrc: 3/0,0 mode: PW/PW res: [0x2b8d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665749:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc44198a/0x3234de053c51f72 lrc: 1/0,0 mode: --/PW res: [0x2b8d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665751:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc44198a/0x3234de053c51f72 lrc: 0/0,0 mode: --/PW res: [0x2b8d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665755:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b31b1dc0/0x3234de053c51fa3 lrc: 2/0,0 mode: PW/PW res: [0x2b8dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665769:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b31b1dc0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.665771:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b31b1dc0/0x3234de053c51fa3 lrc: 2/0,0 mode: PW/PW res: [0x2b8dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665776:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b31b1dc0/0x3234de053c51fa3 lrc: 3/0,0 mode: PW/PW res: [0x2b8dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665780:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b31b1dc0/0x3234de053c51fa3 lrc: 1/0,0 mode: --/PW res: [0x2b8dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665782:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b31b1dc0/0x3234de053c51fa3 lrc: 0/0,0 mode: --/PW res: [0x2b8dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.665819:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.665837:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946504832 00000100:00100000:1.0:1651529344.665842:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.665854:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946504896 00000100:00100000:0.0:1651529344.665861:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211950 00000100:00100000:0.0:1651529344.665863:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1445:39030:x1731745946504832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.665866:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211951 00000100:00100000:1.0:1651529344.665868:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1445:39030:x1731745946504896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.665869:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178398 count 1 00010000:00010000:0.0:1651529344.665873:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e3a7232/0x3234de053c51faa lrc: 3/0,1 mode: --/PW res: [0x2b8de:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.665874:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178399 count 1 00010000:00010000:0.0:1651529344.665877:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b041da85/0x3234de053c4d057 lrc: 2/0,0 mode: PR/PR res: [0x2b8de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf2cc expref: 615 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.665879:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000674569e9/0x3234de053c51fb1 lrc: 3/0,1 mode: --/PW res: [0x2b8df:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665880:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.665881:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.665882:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e3a7232/0x3234de053c51faa lrc: 4/0,1 mode: --/PW res: [0x2b8de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.665884:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003c54b296/0x3234de053c4e4cb lrc: 2/0,0 mode: PR/PR res: [0x2b8df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4480 expref: 615 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.665887:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.665887:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.665888:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000674569e9/0x3234de053c51fb1 lrc: 4/0,1 mode: --/PW res: [0x2b8df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.665888:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b041da85/0x3234de053c4d057 lrc: 3/0,0 mode: PR/PR res: [0x2b8de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf2cc expref: 615 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.665895:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003c54b296/0x3234de053c4e4cb lrc: 3/0,0 mode: PR/PR res: [0x2b8df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4480 expref: 615 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.665895:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b041da85/0x3234de053c4d057 lrc: 4/0,0 mode: PR/PR res: [0x2b8de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf2cc expref: 615 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.665898:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003c54b296/0x3234de053c4e4cb lrc: 4/0,0 mode: PR/PR res: [0x2b8df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4480 expref: 615 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.665899:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000716b388d pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997031552:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.665903:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000057329b82 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997031616:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.665913:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c0dff858 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.665919:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000499d0377 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.665970:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.665978:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.665988:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.665996:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.666003:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.666003:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946504960 00000100:00100000:1.0:1651529344.666013:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.666025:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946505024 00000100:00100000:0.0:1651529344.666032:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946505088 00000100:00100000:0.0:1651529344.666038:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946505216 00000100:00100000:0.0:1651529344.666041:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946505280 00000100:00100000:1.0:1651529344.666044:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946505344 00000100:00100000:0.0:1651529344.666047:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211952 00000100:00100000:0.0:1651529344.666049:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1451:39030:x1731745946504960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.666054:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178400 count 1 00000100:00100000:1.0:1651529344.666055:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211953 00000100:00100000:1.0:1651529344.666056:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1451:39029:x1731745946505024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.666058:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008564120b/0x3234de053c51fb8 lrc: 3/0,1 mode: --/PW res: [0x2b8e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.666062:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178401 count 1 00010000:00010000:0.0:1651529344.666063:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000891bb0c1/0x3234de053c4dd7e lrc: 2/0,0 mode: PR/PR res: [0x2b8e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d273e expref: 615 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.666066:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007eb6ad4b/0x3234de053c51fbf lrc: 3/0,1 mode: --/PW res: [0x2b8e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.666066:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.666067:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.666068:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008564120b/0x3234de053c51fb8 lrc: 4/0,1 mode: --/PW res: [0x2b8e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.666071:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000068a90887/0x3234de053c4e438 lrc: 2/0,0 mode: PR/PR res: [0x2b8e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d41fc expref: 615 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.666074:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.666074:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000891bb0c1/0x3234de053c4dd7e lrc: 3/0,0 mode: PR/PR res: [0x2b8e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d273e expref: 615 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.666075:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.666075:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007eb6ad4b/0x3234de053c51fbf lrc: 4/0,1 mode: --/PW res: [0x2b8e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.666080:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000891bb0c1/0x3234de053c4dd7e lrc: 4/0,0 mode: PR/PR res: [0x2b8e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d273e expref: 615 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.666082:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000068a90887/0x3234de053c4e438 lrc: 3/0,0 mode: PR/PR res: [0x2b8e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d41fc expref: 615 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.666084:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ee8cd7c9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997031680:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.666085:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000068a90887/0x3234de053c4e438 lrc: 4/0,0 mode: PR/PR res: [0x2b8e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d41fc expref: 615 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.666092:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ad6d0877 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997031744:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.666095:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c086aae3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.666101:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 000000007d8fabda going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.666101:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211954 00000100:00100000:0.0:1651529344.666103:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1451:39030:x1731745946505088:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.666107:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211955 00002000:00080000:0.0:1651529344.666107:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178402 count 1 00000100:00100000:1.0:1651529344.666109:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1451:39030:x1731745946505216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.666110:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e2e2708/0x3234de053c51fc6 lrc: 3/0,1 mode: --/PW res: [0x2b8e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.666113:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178403 count 1 00010000:00010000:0.0:1651529344.666114:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000b8823b9/0x3234de053c4c7cf lrc: 2/0,0 mode: PR/PR res: [0x2b8e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd17e expref: 615 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.666116:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000daf880b4/0x3234de053c51fcd lrc: 3/0,1 mode: --/PW res: [0x2b8e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.666117:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.666118:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.666118:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e2e2708/0x3234de053c51fc6 lrc: 4/0,1 mode: --/PW res: [0x2b8e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.666120:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ab75cd58/0x3234de053c4ebbd lrc: 2/0,0 mode: PR/PR res: [0x2b8e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d60a3 expref: 615 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.666123:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.666124:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.666124:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000daf880b4/0x3234de053c51fcd lrc: 4/0,1 mode: --/PW res: [0x2b8e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.666124:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000b8823b9/0x3234de053c4c7cf lrc: 3/0,0 mode: PR/PR res: [0x2b8e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd17e expref: 615 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.666127:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000b8823b9/0x3234de053c4c7cf lrc: 4/0,0 mode: PR/PR res: [0x2b8e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd17e expref: 615 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.666130:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ab75cd58/0x3234de053c4ebbd lrc: 3/0,0 mode: PR/PR res: [0x2b8e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d60a3 expref: 615 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.666134:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ab75cd58/0x3234de053c4ebbd lrc: 4/0,0 mode: PR/PR res: [0x2b8e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d60a3 expref: 615 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.666137:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006e3eb319 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997031872:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.666153:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 0000000099c1da85 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.666157:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000999005e pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997031808:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.666159:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211956 00000100:00100000:1.0:1651529344.666161:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1451:39029:x1731745946505280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.666165:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178404 count 1 00000100:00100000:0.0:1651529344.666166:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ff7bf023 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.666169:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049a3c67c/0x3234de053c51fd4 lrc: 3/0,1 mode: --/PW res: [0x2b8e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.666172:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211957 00010000:00010000:1.0:1651529344.666173:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b3c5d6ac/0x3234de053c4e55e lrc: 2/0,0 mode: PR/PR res: [0x2b8e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d468d expref: 615 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.666174:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1451:39030:x1731745946505344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.666176:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.666176:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.666177:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049a3c67c/0x3234de053c51fd4 lrc: 4/0,1 mode: --/PW res: [0x2b8e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.666179:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178405 count 1 00010000:00010000:1.0:1651529344.666183:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b3c5d6ac/0x3234de053c4e55e lrc: 3/0,0 mode: PR/PR res: [0x2b8e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d468d expref: 615 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.666183:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074951e29/0x3234de053c51fdb lrc: 3/0,1 mode: --/PW res: [0x2b8e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.666186:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b3c5d6ac/0x3234de053c4e55e lrc: 4/0,0 mode: PR/PR res: [0x2b8e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d468d expref: 615 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.666188:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000039498f36/0x3234de053c4e702 lrc: 2/0,0 mode: PR/PR res: [0x2b8e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4cfa expref: 615 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.666190:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f39ca9ea pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997031936:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.666196:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f9dac3f6 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.666215:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.666216:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.666217:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074951e29/0x3234de053c51fdb lrc: 4/0,1 mode: --/PW res: [0x2b8e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.666266:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.666266:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000039498f36/0x3234de053c4e702 lrc: 3/0,0 mode: PR/PR res: [0x2b8e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4cfa expref: 615 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.666280:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.666282:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000039498f36/0x3234de053c4e702 lrc: 4/0,0 mode: PR/PR res: [0x2b8e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4cfa expref: 615 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.666290:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000093ddaf92 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997032000:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.666305:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a3b00cf3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.666320:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000716b388d pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997031552:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.666326:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000e3a7232/0x3234de053c51faa lrc: 3/0,1 mode: --/PW res: [0x2b8de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.666338:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396385856 00000100:00100000:1.0:1651529344.666342:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000057329b82 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997031616:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.666343:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b041da85/0x3234de053c4d057 lrc: 4/0,0 mode: PR/PR res: [0x2b8de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf2cc expref: 616 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.666346:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000674569e9/0x3234de053c51fb1 lrc: 3/0,1 mode: --/PW res: [0x2b8df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.666355:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396385920 00010000:00010000:0.0:1651529344.666359:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003c54b296/0x3234de053c4e4cb lrc: 4/0,0 mode: PR/PR res: [0x2b8df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4480 expref: 617 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.666362:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12732 00000100:00100000:1.0:1651529344.666364:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+617:41278:x1731746396385856:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.666372:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.666374:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b041da85/0x3234de053c4d057 lrc: 4/0,0 mode: PR/PR res: [0x2b8de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf2cc expref: 617 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.666378:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b041da85/0x3234de053c4d057 lrc: 3/0,0 mode: PR/PR res: [0x2b8de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf2cc expref: 617 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.666383:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12733 00010000:00010000:1.0:1651529344.666384:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b041da85/0x3234de053c4d057 lrc: 0/0,0 mode: --/PR res: [0x2b8de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf2cc expref: 617 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.666386:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+617:41278:x1731746396385920:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.666388:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.666388:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.666389:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000e3a7232/0x3234de053c51faa lrc: 3/0,1 mode: PW/PW res: [0x2b8de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.666389:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.666391:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003c54b296/0x3234de053c4e4cb lrc: 4/0,0 mode: PR/PR res: [0x2b8df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4480 expref: 616 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.666392:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e3a7232/0x3234de053c51faa lrc: 4/0,1 mode: PW/PW res: [0x2b8de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.666395:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003c54b296/0x3234de053c4e4cb lrc: 3/0,0 mode: PR/PR res: [0x2b8df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4480 expref: 616 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.666401:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.666407:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c54b296/0x3234de053c4e4cb lrc: 0/0,0 mode: --/PR res: [0x2b8df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4480 expref: 616 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.666410:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+616:41278:x1731746396385856:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 45us (145us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.666411:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.666412:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12732 00010000:00010000:0.0:1651529344.666412:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.666413:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000674569e9/0x3234de053c51fb1 lrc: 3/0,1 mode: PW/PW res: [0x2b8df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.666418:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000674569e9/0x3234de053c51fb1 lrc: 4/0,1 mode: PW/PW res: [0x2b8df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.666437:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.666444:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+614:41278:x1731746396385920:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 58us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.666448:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12733 00010000:00010000:0.0:1651529344.666476:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000e3a7232/0x3234de053c51faa lrc: 3/0,1 mode: PW/PW res: [0x2b8de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.666479:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e3a7232/0x3234de053c51faa lrc: 3/0,1 mode: PW/PW res: [0x2b8de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.666483:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e3a7232/0x3234de053c51faa lrc: 3/0,1 mode: PW/PW res: [0x2b8de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.666485:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e3a7232/0x3234de053c51faa lrc: 2/0,0 mode: PW/PW res: [0x2b8de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.666494:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000674569e9/0x3234de053c51fb1 lrc: 3/0,1 mode: PW/PW res: [0x2b8df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.666501:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000674569e9/0x3234de053c51fb1 lrc: 3/0,1 mode: PW/PW res: [0x2b8df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.666504:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000674569e9/0x3234de053c51fb1 lrc: 3/0,1 mode: PW/PW res: [0x2b8df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.666506:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000674569e9/0x3234de053c51fb1 lrc: 2/0,0 mode: PW/PW res: [0x2b8df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.666560:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1453:39030:x1731745946504896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 691us (717us total) trans 12885080006 rc 0/0 00000100:00100000:1.0:1651529344.666563:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211951 00000100:00100000:1.0:1651529344.666574:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ad6d0877 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997031744:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.666577:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007eb6ad4b/0x3234de053c51fbf lrc: 3/0,1 mode: --/PW res: [0x2b8e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.666578:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1452:39030:x1731745946504832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 705us (750us total) trans 12885080005 rc 0/0 00000100:00100000:0.0:1651529344.666581:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211950 00000100:00100000:0.0:1651529344.666594:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ee8cd7c9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997031680:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.666598:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008564120b/0x3234de053c51fb8 lrc: 3/0,1 mode: --/PW res: [0x2b8e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.666606:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e3a7232/0x3234de053c51faa lrc: 2/0,0 mode: PW/PW res: [0x2b8de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.666609:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000e3a7232 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.666610:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e3a7232/0x3234de053c51faa lrc: 2/0,0 mode: PW/PW res: [0x2b8de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.666613:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e3a7232/0x3234de053c51faa lrc: 3/0,0 mode: PW/PW res: [0x2b8de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.666617:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e3a7232/0x3234de053c51faa lrc: 1/0,0 mode: --/PW res: [0x2b8de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.666620:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e3a7232/0x3234de053c51faa lrc: 0/0,0 mode: --/PW res: [0x2b8de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.666631:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000674569e9/0x3234de053c51fb1 lrc: 2/0,0 mode: PW/PW res: [0x2b8df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.666634:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000674569e9 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.666635:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000674569e9/0x3234de053c51fb1 lrc: 2/0,0 mode: PW/PW res: [0x2b8df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.666637:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000674569e9/0x3234de053c51fb1 lrc: 3/0,0 mode: PW/PW res: [0x2b8df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.666643:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000674569e9/0x3234de053c51fb1 lrc: 1/0,0 mode: --/PW res: [0x2b8df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.666646:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000674569e9/0x3234de053c51fb1 lrc: 0/0,0 mode: --/PW res: [0x2b8df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.666654:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000999005e pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997031808:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.666662:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003e2e2708/0x3234de053c51fc6 lrc: 3/0,1 mode: --/PW res: [0x2b8e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.666666:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006e3eb319 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997031872:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.666669:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000093ddaf92 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997032000:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.666670:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000daf880b4/0x3234de053c51fcd lrc: 3/0,1 mode: --/PW res: [0x2b8e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.666672:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000074951e29/0x3234de053c51fdb lrc: 3/0,1 mode: --/PW res: [0x2b8e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.666677:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f39ca9ea pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997031936:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.666679:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000049a3c67c/0x3234de053c51fd4 lrc: 3/0,1 mode: --/PW res: [0x2b8e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.666810:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.666821:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.666821:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946505728 00000100:00100000:1.0:1651529344.666828:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946505792 00000100:00100000:0.0:1651529344.666830:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211958 00000100:00100000:0.0:1651529344.666832:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1453:39030:x1731745946505728:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.666835:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211959 00000100:00100000:1.0:1651529344.666837:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1453:39029:x1731745946505792:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.666842:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178407 count 1 00010000:00010000:1.0:1651529344.666846:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001328eb82/0x3234de053c51fe2 lrc: 3/0,1 mode: --/PW res: [0x2b8e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.666851:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003ced498b/0x3234de053c4c988 lrc: 2/0,0 mode: PR/PR res: [0x2b8e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd7dd expref: 613 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.666851:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178406 count 1 00010000:00010000:1.0:1651529344.666854:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.666855:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.666855:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c51fe9 lrc: 3/0,1 mode: --/PW res: [0x2b8e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.666856:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001328eb82/0x3234de053c51fe2 lrc: 4/0,1 mode: --/PW res: [0x2b8e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.666862:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003ced498b/0x3234de053c4c988 lrc: 3/0,0 mode: PR/PR res: [0x2b8e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd7dd expref: 613 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.666865:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003ced498b/0x3234de053c4c988 lrc: 4/0,0 mode: PR/PR res: [0x2b8e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd7dd expref: 613 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.666870:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000050bbb886 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997032064:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.666886:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002052722b/0x3234de053c4e6d8 lrc: 2/0,0 mode: PR/PR res: [0x2b8e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c28 expref: 613 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.666889:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 0000000099c1da85 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.666889:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.666890:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.666890:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c51fe9 lrc: 4/0,1 mode: --/PW res: [0x2b8e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.666898:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002052722b/0x3234de053c4e6d8 lrc: 3/0,0 mode: PR/PR res: [0x2b8e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c28 expref: 613 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.666902:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.666902:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002052722b/0x3234de053c4e6d8 lrc: 4/0,0 mode: PR/PR res: [0x2b8e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c28 expref: 613 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.666914:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000093ddaf92 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997032128:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.666929:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ff7bf023 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.666938:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.666946:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396386048 00010000:00010000:1.0:1651529344.666956:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ab75cd58/0x3234de053c4ebbd lrc: 4/0,0 mode: PR/PR res: [0x2b8e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d60a3 expref: 614 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.666964:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396385984 00010000:00010000:1.0:1651529344.666966:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000891bb0c1/0x3234de053c4dd7e lrc: 4/0,0 mode: PR/PR res: [0x2b8e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d273e expref: 615 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.666976:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12734 00000100:00100000:0.0:1651529344.666979:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+615:41279:x1731746396386048:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.666981:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12735 00010000:00010000:0.0:1651529344.666982:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.666983:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+615:41278:x1731746396385984:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.666984:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ab75cd58/0x3234de053c4ebbd lrc: 4/0,0 mode: PR/PR res: [0x2b8e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d60a3 expref: 615 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.666986:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.666988:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000891bb0c1/0x3234de053c4dd7e lrc: 4/0,0 mode: PR/PR res: [0x2b8e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d273e expref: 615 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.666988:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ab75cd58/0x3234de053c4ebbd lrc: 3/0,0 mode: PR/PR res: [0x2b8e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d60a3 expref: 615 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.666991:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000891bb0c1/0x3234de053c4dd7e lrc: 3/0,0 mode: PR/PR res: [0x2b8e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d273e expref: 615 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.666994:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab75cd58/0x3234de053c4ebbd lrc: 0/0,0 mode: --/PR res: [0x2b8e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d60a3 expref: 615 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.666997:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000891bb0c1/0x3234de053c4dd7e lrc: 0/0,0 mode: --/PR res: [0x2b8e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d273e expref: 615 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.666998:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.666999:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.667000:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000daf880b4/0x3234de053c51fcd lrc: 3/0,1 mode: PW/PW res: [0x2b8e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667001:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.667002:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.667003:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008564120b/0x3234de053c51fb8 lrc: 3/0,1 mode: PW/PW res: [0x2b8e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667003:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000daf880b4/0x3234de053c51fcd lrc: 4/0,1 mode: PW/PW res: [0x2b8e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667006:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008564120b/0x3234de053c51fb8 lrc: 4/0,1 mode: PW/PW res: [0x2b8e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667012:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.667023:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.667033:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+613:41278:x1731746396385984:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 50us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.667036:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12735 00000100:00100000:0.0:1651529344.667042:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+612:41279:x1731746396386048:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 63us (140us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.667044:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000daf880b4/0x3234de053c51fcd lrc: 3/0,1 mode: PW/PW res: [0x2b8e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.667046:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12734 00010000:00010000:1.0:1651529344.667047:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000daf880b4/0x3234de053c51fcd lrc: 3/0,1 mode: PW/PW res: [0x2b8e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667051:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000daf880b4/0x3234de053c51fcd lrc: 3/0,1 mode: PW/PW res: [0x2b8e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667053:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000daf880b4/0x3234de053c51fcd lrc: 2/0,0 mode: PW/PW res: [0x2b8e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667067:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008564120b/0x3234de053c51fb8 lrc: 3/0,1 mode: PW/PW res: [0x2b8e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667079:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008564120b/0x3234de053c51fb8 lrc: 3/0,1 mode: PW/PW res: [0x2b8e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667083:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008564120b/0x3234de053c51fb8 lrc: 3/0,1 mode: PW/PW res: [0x2b8e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667086:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008564120b/0x3234de053c51fb8 lrc: 2/0,0 mode: PW/PW res: [0x2b8e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.667095:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1454:39030:x1731745946505216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 985us (1098us total) trans 12885080007 rc 0/0 00000100:00100000:1.0:1651529344.667098:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211955 00000100:00100000:1.0:1651529344.667112:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.667129:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.667135:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1454:39030:x1731745946504960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1085us (1165us total) trans 12885080008 rc 0/0 00000100:00100000:0.0:1651529344.667139:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211952 00000100:00100000:1.0:1651529344.667140:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.667146:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000daf880b4/0x3234de053c51fcd lrc: 2/0,0 mode: PW/PW res: [0x2b8e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667149:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000daf880b4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.667150:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000daf880b4/0x3234de053c51fcd lrc: 2/0,0 mode: PW/PW res: [0x2b8e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667153:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000daf880b4/0x3234de053c51fcd lrc: 3/0,0 mode: PW/PW res: [0x2b8e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667158:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000daf880b4/0x3234de053c51fcd lrc: 1/0,0 mode: --/PW res: [0x2b8e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667161:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000daf880b4/0x3234de053c51fcd lrc: 0/0,0 mode: --/PW res: [0x2b8e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667165:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008564120b/0x3234de053c51fb8 lrc: 2/0,0 mode: PW/PW res: [0x2b8e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667168:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008564120b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.667168:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008564120b/0x3234de053c51fb8 lrc: 2/0,0 mode: PW/PW res: [0x2b8e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.667169:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.667171:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008564120b/0x3234de053c51fb8 lrc: 3/0,0 mode: PW/PW res: [0x2b8e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667174:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008564120b/0x3234de053c51fb8 lrc: 1/0,0 mode: --/PW res: [0x2b8e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667177:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008564120b/0x3234de053c51fb8 lrc: 0/0,0 mode: --/PW res: [0x2b8e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.667198:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396386176 00010000:00010000:1.0:1651529344.667204:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000b8823b9/0x3234de053c4c7cf lrc: 4/0,0 mode: PR/PR res: [0x2b8e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd17e expref: 612 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.667209:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000093ddaf92 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997032128:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.667212:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396386112 00010000:00010000:0.0:1651529344.667213:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c51fe9 lrc: 3/0,1 mode: --/PW res: [0x2b8e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667214:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000068a90887/0x3234de053c4e438 lrc: 4/0,0 mode: PR/PR res: [0x2b8e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d41fc expref: 613 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.667218:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396386240 00010000:00010000:1.0:1651529344.667220:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b3c5d6ac/0x3234de053c4e55e lrc: 4/0,0 mode: PR/PR res: [0x2b8e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d468d expref: 614 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.667220:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396386368 00010000:00010000:0.0:1651529344.667240:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000039498f36/0x3234de053c4e702 lrc: 4/0,0 mode: PR/PR res: [0x2b8e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4cfa expref: 615 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.667241:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12736 00000100:00100000:1.0:1651529344.667243:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082df86ec pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+615:41279:x1731746396386176:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.667246:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.667247:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12737 00010000:00010000:1.0:1651529344.667248:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000b8823b9/0x3234de053c4c7cf lrc: 4/0,0 mode: PR/PR res: [0x2b8e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd17e expref: 615 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.667249:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+615:41278:x1731746396386112:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.667251:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000b8823b9/0x3234de053c4c7cf lrc: 3/0,0 mode: PR/PR res: [0x2b8e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd17e expref: 615 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.667252:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.667253:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000068a90887/0x3234de053c4e438 lrc: 4/0,0 mode: PR/PR res: [0x2b8e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d41fc expref: 615 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.667257:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b8823b9/0x3234de053c4c7cf lrc: 0/0,0 mode: --/PR res: [0x2b8e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd17e expref: 615 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.667257:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000068a90887/0x3234de053c4e438 lrc: 3/0,0 mode: PR/PR res: [0x2b8e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d41fc expref: 615 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.667261:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.667262:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.667263:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003e2e2708/0x3234de053c51fc6 lrc: 3/0,1 mode: PW/PW res: [0x2b8e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667266:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e2e2708/0x3234de053c51fc6 lrc: 4/0,1 mode: PW/PW res: [0x2b8e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667276:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.667288:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068a90887/0x3234de053c4e438 lrc: 0/0,0 mode: --/PR res: [0x2b8e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d41fc expref: 614 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.667292:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082df86ec pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+614:41279:x1731746396386176:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 48us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.667294:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12736 00010000:00010000:0.0:1651529344.667297:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.667297:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.667298:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007eb6ad4b/0x3234de053c51fbf lrc: 3/0,1 mode: PW/PW res: [0x2b8e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667301:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007eb6ad4b/0x3234de053c51fbf lrc: 4/0,1 mode: PW/PW res: [0x2b8e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.667303:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12738 00000100:00100000:1.0:1651529344.667305:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+612:41278:x1731746396386240:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.667308:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.667309:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b3c5d6ac/0x3234de053c4e55e lrc: 4/0,0 mode: PR/PR res: [0x2b8e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d468d expref: 612 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.667312:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.667319:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b3c5d6ac/0x3234de053c4e55e lrc: 3/0,0 mode: PR/PR res: [0x2b8e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d468d expref: 612 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.667320:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+612:41278:x1731746396386112:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 71us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.667323:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12737 00010000:00010000:1.0:1651529344.667324:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3c5d6ac/0x3234de053c4e55e lrc: 0/0,0 mode: --/PR res: [0x2b8e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d468d expref: 612 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.667327:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.667328:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.667329:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000049a3c67c/0x3234de053c51fd4 lrc: 3/0,1 mode: PW/PW res: [0x2b8e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.667329:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12739 00000100:00100000:0.0:1651529344.667330:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+610:41278:x1731746396386368:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.667331:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049a3c67c/0x3234de053c51fd4 lrc: 4/0,1 mode: PW/PW res: [0x2b8e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667333:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.667335:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000039498f36/0x3234de053c4e702 lrc: 4/0,0 mode: PR/PR res: [0x2b8e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4cfa expref: 610 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.667337:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.667338:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000039498f36/0x3234de053c4e702 lrc: 3/0,0 mode: PR/PR res: [0x2b8e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4cfa expref: 610 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.667343:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+610:41278:x1731746396386240:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 37us (202us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.667343:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039498f36/0x3234de053c4e702 lrc: 0/0,0 mode: --/PR res: [0x2b8e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4cfa expref: 610 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.667346:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12738 00010000:00010000:0.0:1651529344.667346:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.667347:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.667356:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000050bbb886 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997032064:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.667360:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001328eb82/0x3234de053c51fe2 lrc: 3/0,1 mode: --/PW res: [0x2b8e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667362:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000074951e29/0x3234de053c51fdb lrc: 3/0,1 mode: PW/PW res: [0x2b8e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667366:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074951e29/0x3234de053c51fdb lrc: 4/0,1 mode: PW/PW res: [0x2b8e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667368:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007eb6ad4b/0x3234de053c51fbf lrc: 3/0,1 mode: PW/PW res: [0x2b8e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667371:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007eb6ad4b/0x3234de053c51fbf lrc: 3/0,1 mode: PW/PW res: [0x2b8e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667373:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.667374:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007eb6ad4b/0x3234de053c51fbf lrc: 3/0,1 mode: PW/PW res: [0x2b8e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667376:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007eb6ad4b/0x3234de053c51fbf lrc: 2/0,0 mode: PW/PW res: [0x2b8e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.667380:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+608:41278:x1731746396386368:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 49us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.667389:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12739 00010000:00010000:0.0:1651529344.667396:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003e2e2708/0x3234de053c51fc6 lrc: 3/0,1 mode: PW/PW res: [0x2b8e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667400:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e2e2708/0x3234de053c51fc6 lrc: 3/0,1 mode: PW/PW res: [0x2b8e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667403:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e2e2708/0x3234de053c51fc6 lrc: 3/0,1 mode: PW/PW res: [0x2b8e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667405:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e2e2708/0x3234de053c51fc6 lrc: 2/0,0 mode: PW/PW res: [0x2b8e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.667418:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1454:39029:x1731745946505024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1361us (1440us total) trans 12885080009 rc 0/0 00000100:00100000:1.0:1651529344.667421:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211953 00010000:00010000:1.0:1651529344.667428:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000049a3c67c/0x3234de053c51fd4 lrc: 3/0,1 mode: PW/PW res: [0x2b8e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667431:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049a3c67c/0x3234de053c51fd4 lrc: 3/0,1 mode: PW/PW res: [0x2b8e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667437:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049a3c67c/0x3234de053c51fd4 lrc: 3/0,1 mode: PW/PW res: [0x2b8e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667439:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049a3c67c/0x3234de053c51fd4 lrc: 2/0,0 mode: PW/PW res: [0x2b8e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.667444:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1454:39030:x1731745946505088:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1341us (1455us total) trans 12885080010 rc 0/0 00000100:00100000:0.0:1651529344.667455:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211954 00010000:00010000:0.0:1651529344.667461:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000074951e29/0x3234de053c51fdb lrc: 3/0,1 mode: PW/PW res: [0x2b8e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667465:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074951e29/0x3234de053c51fdb lrc: 3/0,1 mode: PW/PW res: [0x2b8e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667468:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074951e29/0x3234de053c51fdb lrc: 3/0,1 mode: PW/PW res: [0x2b8e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667470:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074951e29/0x3234de053c51fdb lrc: 2/0,0 mode: PW/PW res: [0x2b8e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.667477:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1454:39029:x1731745946505280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1315us (1473us total) trans 12885080011 rc 0/0 00000100:00100000:1.0:1651529344.667479:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211956 00000100:00100000:1.0:1651529344.667495:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.667508:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1454:39030:x1731745946505344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1333us (1495us total) trans 12885080012 rc 0/0 00000100:00100000:1.0:1651529344.667510:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.667511:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211957 00000100:00100000:0.0:1651529344.667516:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946505920 00000100:00100000:1.0:1651529344.667520:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.667523:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211960 00000100:00100000:0.0:1651529344.667532:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1454:39029:x1731745946505920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.667533:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.667537:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178409 count 1 00010000:00010000:0.0:1651529344.667541:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c51ff0 lrc: 3/0,1 mode: --/PW res: [0x2b8e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667546:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009847fa02/0x3234de053c4e400 lrc: 2/0,0 mode: PR/PR res: [0x2b8e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d40cf expref: 607 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.667549:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.667550:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.667550:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c51ff0 lrc: 4/0,1 mode: --/PW res: [0x2b8e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667557:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009847fa02/0x3234de053c4e400 lrc: 3/0,0 mode: PR/PR res: [0x2b8e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d40cf expref: 607 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.667560:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009847fa02/0x3234de053c4e400 lrc: 4/0,0 mode: PR/PR res: [0x2b8e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d40cf expref: 607 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.667565:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000093ddaf92 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997032192:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.667573:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ff7bf023 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.667578:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007eb6ad4b/0x3234de053c51fbf lrc: 2/0,0 mode: PW/PW res: [0x2b8e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667581:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007eb6ad4b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.667582:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007eb6ad4b/0x3234de053c51fbf lrc: 2/0,0 mode: PW/PW res: [0x2b8e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667585:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007eb6ad4b/0x3234de053c51fbf lrc: 3/0,0 mode: PW/PW res: [0x2b8e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667590:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007eb6ad4b/0x3234de053c51fbf lrc: 1/0,0 mode: --/PW res: [0x2b8e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667592:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007eb6ad4b/0x3234de053c51fbf lrc: 0/0,0 mode: --/PW res: [0x2b8e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667596:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e2e2708/0x3234de053c51fc6 lrc: 2/0,0 mode: PW/PW res: [0x2b8e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667599:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003e2e2708 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.667600:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e2e2708/0x3234de053c51fc6 lrc: 2/0,0 mode: PW/PW res: [0x2b8e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667602:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e2e2708/0x3234de053c51fc6 lrc: 3/0,0 mode: PW/PW res: [0x2b8e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.667606:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946505856 00010000:00010000:0.0:1651529344.667606:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e2e2708/0x3234de053c51fc6 lrc: 1/0,0 mode: --/PW res: [0x2b8e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667610:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e2e2708/0x3234de053c51fc6 lrc: 0/0,0 mode: --/PW res: [0x2b8e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.667616:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211961 00000100:00100000:1.0:1651529344.667618:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1455:39030:x1731745946505856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.667623:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178408 count 1 00010000:00010000:1.0:1651529344.667628:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7f046d7/0x3234de053c51ff7 lrc: 3/0,1 mode: --/PW res: [0x2b8e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667633:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009a9bc3a9/0x3234de053c4a148 lrc: 2/0,0 mode: PR/PR res: [0x2b8e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb8fe expref: 607 pid: 80280 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.667636:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.667637:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.667637:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7f046d7/0x3234de053c51ff7 lrc: 4/0,1 mode: --/PW res: [0x2b8e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667640:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049a3c67c/0x3234de053c51fd4 lrc: 2/0,0 mode: PW/PW res: [0x2b8e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667643:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000049a3c67c already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.667644:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009a9bc3a9/0x3234de053c4a148 lrc: 3/0,0 mode: PR/PR res: [0x2b8e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb8fe expref: 607 pid: 80280 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.667644:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049a3c67c/0x3234de053c51fd4 lrc: 2/0,0 mode: PW/PW res: [0x2b8e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667647:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049a3c67c/0x3234de053c51fd4 lrc: 3/0,0 mode: PW/PW res: [0x2b8e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667648:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009a9bc3a9/0x3234de053c4a148 lrc: 4/0,0 mode: PR/PR res: [0x2b8e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb8fe expref: 607 pid: 80280 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.667651:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049a3c67c/0x3234de053c51fd4 lrc: 1/0,0 mode: --/PW res: [0x2b8e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.667652:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004089c807 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997032256:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.667654:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049a3c67c/0x3234de053c51fd4 lrc: 0/0,0 mode: --/PW res: [0x2b8e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667657:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074951e29/0x3234de053c51fdb lrc: 2/0,0 mode: PW/PW res: [0x2b8e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667660:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000074951e29 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.667661:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074951e29/0x3234de053c51fdb lrc: 2/0,0 mode: PW/PW res: [0x2b8e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.667663:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a5495eb going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.667666:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074951e29/0x3234de053c51fdb lrc: 3/0,0 mode: PW/PW res: [0x2b8e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.667669:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396386624 00010000:00010000:0.0:1651529344.667669:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074951e29/0x3234de053c51fdb lrc: 1/0,0 mode: --/PW res: [0x2b8e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667671:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074951e29/0x3234de053c51fdb lrc: 0/0,0 mode: --/PW res: [0x2b8e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667673:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002052722b/0x3234de053c4e6d8 lrc: 4/0,0 mode: PR/PR res: [0x2b8e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c28 expref: 608 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.667679:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396386560 00010000:00010000:1.0:1651529344.667682:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003ced498b/0x3234de053c4c988 lrc: 4/0,0 mode: PR/PR res: [0x2b8e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd7dd expref: 609 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.667687:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12740 00000100:00100000:1.0:1651529344.667689:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+609:41278:x1731746396386624:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.667691:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.667693:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002052722b/0x3234de053c4e6d8 lrc: 4/0,0 mode: PR/PR res: [0x2b8e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c28 expref: 609 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.667696:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002052722b/0x3234de053c4e6d8 lrc: 3/0,0 mode: PR/PR res: [0x2b8e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c28 expref: 609 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.667712:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002052722b/0x3234de053c4e6d8 lrc: 0/0,0 mode: --/PR res: [0x2b8e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c28 expref: 609 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.667716:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.667716:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.667717:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c51fe9 lrc: 3/0,1 mode: PW/PW res: [0x2b8e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667720:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c51fe9 lrc: 4/0,1 mode: PW/PW res: [0x2b8e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667729:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.667744:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+608:41278:x1731746396386624:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 54us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.667747:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12740 00000100:00100000:1.0:1651529344.667751:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12741 00000100:00100000:1.0:1651529344.667753:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+607:41278:x1731746396386560:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.667755:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.667757:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003ced498b/0x3234de053c4c988 lrc: 4/0,0 mode: PR/PR res: [0x2b8e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd7dd expref: 607 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.667761:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003ced498b/0x3234de053c4c988 lrc: 3/0,0 mode: PR/PR res: [0x2b8e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd7dd expref: 607 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.667765:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ced498b/0x3234de053c4c988 lrc: 0/0,0 mode: --/PR res: [0x2b8e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd7dd expref: 607 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.667771:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.667772:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.667773:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001328eb82/0x3234de053c51fe2 lrc: 3/0,1 mode: PW/PW res: [0x2b8e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667775:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001328eb82/0x3234de053c51fe2 lrc: 4/0,1 mode: PW/PW res: [0x2b8e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667795:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.667796:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.667801:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+606:41278:x1731746396386560:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 47us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.667804:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12741 00010000:00010000:1.0:1651529344.667810:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001328eb82/0x3234de053c51fe2 lrc: 3/0,1 mode: PW/PW res: [0x2b8e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667813:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001328eb82/0x3234de053c51fe2 lrc: 3/0,1 mode: PW/PW res: [0x2b8e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667816:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001328eb82/0x3234de053c51fe2 lrc: 3/0,1 mode: PW/PW res: [0x2b8e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.667822:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.667831:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001328eb82/0x3234de053c51fe2 lrc: 2/0,0 mode: PW/PW res: [0x2b8e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.667832:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.667857:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.667876:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.667892:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1456:39029:x1731745946505792:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1054us (1071us total) trans 12885080013 rc 0/0 00000100:00100000:0.0:1651529344.667894:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946506176 00000100:00100000:1.0:1651529344.667895:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211959 00000100:00100000:1.0:1651529344.667901:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946506304 00000100:00100000:0.0:1651529344.667901:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946506240 00000100:00100000:0.0:1651529344.667909:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946506368 00000100:00100000:1.0:1651529344.667919:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211962 00000100:00100000:1.0:1651529344.667921:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1459:39029:x1731745946506176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.667924:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211963 00002000:00080000:1.0:1651529344.667926:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178410 count 1 00000100:00100000:0.0:1651529344.667926:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1459:39030:x1731745946506240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.667931:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c51ffe lrc: 3/0,1 mode: --/PW res: [0x2b8ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.667934:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178411 count 1 00010000:00010000:1.0:1651529344.667935:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cf6e14fb/0x3234de053c4ce51 lrc: 2/0,0 mode: PR/PR res: [0x2b8ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceade expref: 605 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.667938:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.667939:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.667940:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c51ffe lrc: 4/0,1 mode: --/PW res: [0x2b8ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667946:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cf6e14fb/0x3234de053c4ce51 lrc: 3/0,0 mode: PR/PR res: [0x2b8ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceade expref: 605 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.667949:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cf6e14fb/0x3234de053c4ce51 lrc: 4/0,0 mode: PR/PR res: [0x2b8ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceade expref: 605 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.667953:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007ac35c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997032320:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.667958:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2c22fc3/0x3234de053c52005 lrc: 3/0,1 mode: --/PW res: [0x2b8eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.667961:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 0000000057299e7f going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.667964:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c4c6ef lrc: 2/0,0 mode: PR/PR res: [0x2b8eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccdd4 expref: 605 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.667967:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.667968:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211964 00010000:00010000:0.0:1651529344.667968:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.667968:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2c22fc3/0x3234de053c52005 lrc: 4/0,1 mode: --/PW res: [0x2b8eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.667970:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a13808c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1459:39029:x1731745946506304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.667974:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178412 count 1 00010000:00010000:0.0:1651529344.667976:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c4c6ef lrc: 3/0,0 mode: PR/PR res: [0x2b8eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccdd4 expref: 605 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.667977:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eebe983a/0x3234de053c5200c lrc: 3/0,1 mode: --/PW res: [0x2b8ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.667980:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c4c6ef lrc: 4/0,0 mode: PR/PR res: [0x2b8eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccdd4 expref: 605 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.667981:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bbc7bf74/0x3234de053c4dbd3 lrc: 2/0,0 mode: PR/PR res: [0x2b8ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f5e expref: 605 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.667984:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.667984:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000095d7eb1a pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997032384:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.667985:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.667985:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eebe983a/0x3234de053c5200c lrc: 4/0,1 mode: --/PW res: [0x2b8ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.667991:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bbc7bf74/0x3234de053c4dbd3 lrc: 3/0,0 mode: PR/PR res: [0x2b8ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f5e expref: 605 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.667993:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000003c8b0daf going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.667995:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bbc7bf74/0x3234de053c4dbd3 lrc: 4/0,0 mode: PR/PR res: [0x2b8ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f5e expref: 605 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.667998:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f39ca9ea pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997032448:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.668001:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211965 00000100:00100000:0.0:1651529344.668002:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1459:39030:x1731745946506368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.668005:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000499d0377 going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.668007:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178413 count 1 00010000:00010000:0.0:1651529344.668010:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aab15112/0x3234de053c52013 lrc: 3/0,1 mode: --/PW res: [0x2b8ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.668012:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396387008 00010000:00010000:0.0:1651529344.668014:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007c5115ca/0x3234de053c4f3b9 lrc: 2/0,0 mode: PR/PR res: [0x2b8ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8165 expref: 606 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.668017:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009847fa02/0x3234de053c4e400 lrc: 5/0,0 mode: PR/PR res: [0x2b8e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d40cf expref: 606 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.668017:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.668018:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.668018:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aab15112/0x3234de053c52013 lrc: 4/0,1 mode: --/PW res: [0x2b8ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.668024:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12742 00010000:00010000:0.0:1651529344.668024:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007c5115ca/0x3234de053c4f3b9 lrc: 3/0,0 mode: PR/PR res: [0x2b8ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8165 expref: 606 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.668026:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+606:41278:x1731746396387008:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.668028:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.668029:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009847fa02/0x3234de053c4e400 lrc: 5/0,0 mode: PR/PR res: [0x2b8e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d40cf expref: 606 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.668030:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007c5115ca/0x3234de053c4f3b9 lrc: 4/0,0 mode: PR/PR res: [0x2b8ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8165 expref: 606 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.668034:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000999005e pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997032512:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.668036:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009847fa02/0x3234de053c4e400 lrc: 4/0,0 mode: PR/PR res: [0x2b8e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d40cf expref: 606 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.668041:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.668041:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.668041:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060852af0 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.668042:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c51ff0 lrc: 3/0,1 mode: PW/PW res: [0x2b8e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.668045:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c51ff0 lrc: 4/0,1 mode: PW/PW res: [0x2b8e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.668045:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c51fe9 lrc: 3/0,1 mode: PW/PW res: [0x2b8e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.668048:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c51fe9 lrc: 3/0,1 mode: PW/PW res: [0x2b8e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.668050:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.668051:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c51fe9 lrc: 3/0,1 mode: PW/PW res: [0x2b8e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.668054:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c51fe9 lrc: 2/0,0 mode: PW/PW res: [0x2b8e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.668055:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+606:41278:x1731746396387008:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 29us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.668058:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12742 00000100:00100000:1.0:1651529344.668066:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004089c807 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997032256:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.668070:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f7f046d7/0x3234de053c51ff7 lrc: 3/0,1 mode: --/PW res: [0x2b8e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.668092:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1460:39030:x1731745946505728:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1260us (1282us total) trans 12885080014 rc 0/0 00000100:00100000:0.0:1651529344.668095:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211958 00000100:00100000:1.0:1651529344.668099:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.668102:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001328eb82/0x3234de053c51fe2 lrc: 2/0,0 mode: PW/PW res: [0x2b8e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.668106:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001328eb82 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.668107:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001328eb82/0x3234de053c51fe2 lrc: 2/0,0 mode: PW/PW res: [0x2b8e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.668110:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001328eb82/0x3234de053c51fe2 lrc: 3/0,0 mode: PW/PW res: [0x2b8e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.668115:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001328eb82/0x3234de053c51fe2 lrc: 1/0,0 mode: --/PW res: [0x2b8e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.668117:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001328eb82/0x3234de053c51fe2 lrc: 0/0,0 mode: --/PW res: [0x2b8e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.668121:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c51fe9 lrc: 2/0,0 mode: PW/PW res: [0x2b8e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.668124:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004df22a54 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.668125:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c51fe9 lrc: 2/0,0 mode: PW/PW res: [0x2b8e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.668128:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c51fe9 lrc: 3/0,0 mode: PW/PW res: [0x2b8e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.668131:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c51fe9 lrc: 1/0,0 mode: --/PW res: [0x2b8e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.668133:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c51fe9 lrc: 0/0,0 mode: --/PW res: [0x2b8e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.668144:0:80281:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009847fa02/0x3234de053c4e400 lrc: 0/0,0 mode: --/PR res: [0x2b8e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d40cf expref: 605 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.668150:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000093ddaf92 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997032192:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.668154:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c51ff0 lrc: 3/0,1 mode: PW/PW res: [0x2b8e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.668157:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c51ff0 lrc: 3/0,1 mode: PW/PW res: [0x2b8e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.668160:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c51ff0 lrc: 3/0,1 mode: PW/PW res: [0x2b8e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.668163:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c51ff0 lrc: 3/0,1 mode: PW/PW res: [0x2b8e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.668166:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c51ff0 lrc: 2/0,0 mode: PW/PW res: [0x2b8e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.668173:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396387072 00010000:00010000:1.0:1651529344.668183:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009a9bc3a9/0x3234de053c4a148 lrc: 4/0,0 mode: PR/PR res: [0x2b8e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb8fe expref: 605 pid: 80280 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.668191:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12743 00000100:00100000:1.0:1651529344.668193:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000619c18c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+605:41279:x1731746396387072:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.668196:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.668197:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009a9bc3a9/0x3234de053c4a148 lrc: 4/0,0 mode: PR/PR res: [0x2b8e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb8fe expref: 605 pid: 80280 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.668201:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009a9bc3a9/0x3234de053c4a148 lrc: 3/0,0 mode: PR/PR res: [0x2b8e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb8fe expref: 605 pid: 80280 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.668208:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1460:39029:x1731745946505920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 675us (698us total) trans 12885080015 rc 0/0 00000100:00100000:0.0:1651529344.668211:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211960 00010000:00010000:1.0:1651529344.668212:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a9bc3a9/0x3234de053c4a148 lrc: 0/0,0 mode: --/PR res: [0x2b8e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb8fe expref: 605 pid: 80280 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.668215:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.668216:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.668217:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f7f046d7/0x3234de053c51ff7 lrc: 3/0,1 mode: PW/PW res: [0x2b8e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.668218:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c51ff0 lrc: 2/0,0 mode: PW/PW res: [0x2b8e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.668220:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7f046d7/0x3234de053c51ff7 lrc: 4/0,1 mode: PW/PW res: [0x2b8e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.668221:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d766c581 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.668240:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.668247:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000619c18c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+604:41279:x1731746396387072:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 53us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.668250:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12743 00010000:00010000:0.0:1651529344.668254:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c51ff0 lrc: 2/0,0 mode: PW/PW res: [0x2b8e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.668260:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f7f046d7/0x3234de053c51ff7 lrc: 3/0,1 mode: PW/PW res: [0x2b8e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.668260:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c51ff0 lrc: 3/0,0 mode: PW/PW res: [0x2b8e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.668264:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7f046d7/0x3234de053c51ff7 lrc: 3/0,1 mode: PW/PW res: [0x2b8e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.668264:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c51ff0 lrc: 1/0,0 mode: --/PW res: [0x2b8e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.668267:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c51ff0 lrc: 0/0,0 mode: --/PW res: [0x2b8e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.668269:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7f046d7/0x3234de053c51ff7 lrc: 3/0,1 mode: PW/PW res: [0x2b8e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.668272:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7f046d7/0x3234de053c51ff7 lrc: 2/0,0 mode: PW/PW res: [0x2b8e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.668311:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.668322:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1460:39030:x1731745946505856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 703us (789us total) trans 12885080016 rc 0/0 00000100:00100000:1.0:1651529344.668325:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211961 00000100:00100000:1.0:1651529344.668330:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946506752 00000100:00100000:0.0:1651529344.668332:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.668340:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946506816 00000100:00100000:1.0:1651529344.668346:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211966 00000100:00100000:1.0:1651529344.668347:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1461:39030:x1731745946506752:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.668352:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178414 count 1 00010000:00010000:1.0:1651529344.668361:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070dd06bd/0x3234de053c5201a lrc: 3/0,1 mode: --/PW res: [0x2b8ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.668366:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f47eb744/0x3234de053c4c9b9 lrc: 2/0,0 mode: PR/PR res: [0x2b8ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd8cb expref: 603 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.668369:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7f046d7/0x3234de053c51ff7 lrc: 2/0,0 mode: PW/PW res: [0x2b8e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.668373:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f7f046d7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.668374:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7f046d7/0x3234de053c51ff7 lrc: 2/0,0 mode: PW/PW res: [0x2b8e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.668375:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.668376:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.668376:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070dd06bd/0x3234de053c5201a lrc: 4/0,1 mode: --/PW res: [0x2b8ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.668377:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7f046d7/0x3234de053c51ff7 lrc: 3/0,0 mode: PW/PW res: [0x2b8e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.668382:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7f046d7/0x3234de053c51ff7 lrc: 1/0,0 mode: --/PW res: [0x2b8e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.668384:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f47eb744/0x3234de053c4c9b9 lrc: 3/0,0 mode: PR/PR res: [0x2b8ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd8cb expref: 603 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.668385:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7f046d7/0x3234de053c51ff7 lrc: 0/0,0 mode: --/PW res: [0x2b8e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.668388:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f47eb744/0x3234de053c4c9b9 lrc: 4/0,0 mode: PR/PR res: [0x2b8ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd8cb expref: 603 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.668392:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004be0190 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997032576:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.668395:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211967 00000100:00100000:0.0:1651529344.668397:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1461:39030:x1731745946506816:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.668402:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178415 count 1 00000100:00100000:1.0:1651529344.668405:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b52d0f36 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.668412:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c52021 lrc: 3/0,1 mode: --/PW res: [0x2b8ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.668417:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008a4b8f8b/0x3234de053c4e7a3 lrc: 2/0,0 mode: PR/PR res: [0x2b8ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f00 expref: 603 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.668420:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.668420:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.668421:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c52021 lrc: 4/0,1 mode: --/PW res: [0x2b8ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.668428:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008a4b8f8b/0x3234de053c4e7a3 lrc: 3/0,0 mode: PR/PR res: [0x2b8ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f00 expref: 603 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.668432:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008a4b8f8b/0x3234de053c4e7a3 lrc: 4/0,0 mode: PR/PR res: [0x2b8ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f00 expref: 603 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.668436:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a223a622 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997032640:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.668451:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e68b7e1f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.668539:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.668541:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000999005e pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997032512:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.668551:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.668563:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007ac35c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997032320:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.668565:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000aab15112/0x3234de053c52013 lrc: 3/0,1 mode: --/PW res: [0x2b8ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.668567:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c51ffe lrc: 3/0,1 mode: --/PW res: [0x2b8ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.668574:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f39ca9ea pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997032448:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.668576:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946506880 00010000:00010000:1.0:1651529344.668577:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eebe983a/0x3234de053c5200c lrc: 3/0,1 mode: --/PW res: [0x2b8ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.668587:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946506944 00000100:00100000:1.0:1651529344.668595:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211968 00000100:00100000:1.0:1651529344.668597:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1463:39030:x1731745946506880:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.668598:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211969 00000100:00100000:0.0:1651529344.668600:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1463:39029:x1731745946506944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.668603:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178416 count 1 00002000:00080000:0.0:1651529344.668604:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178417 count 1 00010000:00010000:1.0:1651529344.668607:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7578525/0x3234de053c52028 lrc: 3/0,1 mode: --/PW res: [0x2b8f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.668608:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c5202f lrc: 3/0,1 mode: --/PW res: [0x2b8f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.668611:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000018cf35ee/0x3234de053c4a053 lrc: 2/0,0 mode: PR/PR res: [0x2b8f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb71b expref: 603 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.668612:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000e403e3d/0x3234de053c4efde lrc: 2/0,0 mode: PR/PR res: [0x2b8f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7223 expref: 603 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.668616:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.668616:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.668617:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.668617:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c5202f lrc: 4/0,1 mode: --/PW res: [0x2b8f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.668618:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.668618:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7578525/0x3234de053c52028 lrc: 4/0,1 mode: --/PW res: [0x2b8f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.668623:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000e403e3d/0x3234de053c4efde lrc: 3/0,0 mode: PR/PR res: [0x2b8f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7223 expref: 603 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.668625:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000018cf35ee/0x3234de053c4a053 lrc: 3/0,0 mode: PR/PR res: [0x2b8f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb71b expref: 603 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.668627:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000e403e3d/0x3234de053c4efde lrc: 4/0,0 mode: PR/PR res: [0x2b8f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7223 expref: 603 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.668628:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000018cf35ee/0x3234de053c4a053 lrc: 4/0,0 mode: PR/PR res: [0x2b8f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb71b expref: 603 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.668631:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000093ddaf92 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997032704:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.668632:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007ac35c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997032768:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.668642:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000499d0377 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.668642:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a3b00cf3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.668648:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000095d7eb1a pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997032384:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.668652:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f2c22fc3/0x3234de053c52005 lrc: 3/0,1 mode: --/PW res: [0x2b8eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.668769:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.668781:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396387328 00010000:00010000:0.0:1651529344.668787:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cf6e14fb/0x3234de053c4ce51 lrc: 4/0,0 mode: PR/PR res: [0x2b8ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceade expref: 604 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.668798:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12744 00000100:00100000:0.0:1651529344.668800:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+604:41279:x1731746396387328:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.668803:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.668805:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cf6e14fb/0x3234de053c4ce51 lrc: 4/0,0 mode: PR/PR res: [0x2b8ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceade expref: 604 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.668808:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cf6e14fb/0x3234de053c4ce51 lrc: 3/0,0 mode: PR/PR res: [0x2b8ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceade expref: 604 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.668814:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf6e14fb/0x3234de053c4ce51 lrc: 0/0,0 mode: --/PR res: [0x2b8ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceade expref: 604 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.668818:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.668818:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.668819:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c51ffe lrc: 3/0,1 mode: PW/PW res: [0x2b8ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.668822:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c51ffe lrc: 4/0,1 mode: PW/PW res: [0x2b8ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.668830:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.668833:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c51ffe lrc: 3/0,1 mode: PW/PW res: [0x2b8ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.668837:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c51ffe lrc: 3/0,1 mode: PW/PW res: [0x2b8ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.668840:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c51ffe lrc: 3/0,1 mode: PW/PW res: [0x2b8ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.668840:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+603:41279:x1731746396387328:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 39us (71us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.668843:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c51ffe lrc: 2/0,0 mode: PW/PW res: [0x2b8ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.668843:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12744 00010000:00010000:0.0:1651529344.668876:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c51ffe lrc: 2/0,0 mode: PW/PW res: [0x2b8ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.668880:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000064bf7951 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.668881:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c51ffe lrc: 2/0,0 mode: PW/PW res: [0x2b8ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.668884:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c51ffe lrc: 3/0,0 mode: PW/PW res: [0x2b8ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.668888:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c51ffe lrc: 1/0,0 mode: --/PW res: [0x2b8ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.668891:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064bf7951/0x3234de053c51ffe lrc: 0/0,0 mode: --/PW res: [0x2b8ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.668899:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1464:39029:x1731745946506176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 976us (1103us total) trans 12885080017 rc 0/0 00000100:00100000:1.0:1651529344.668902:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211962 00000100:00100000:1.0:1651529344.668943:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.668954:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.668977:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.668982:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396387456 00010000:00010000:0.0:1651529344.668988:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bbc7bf74/0x3234de053c4dbd3 lrc: 4/0,0 mode: PR/PR res: [0x2b8ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f5e expref: 603 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.668997:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396387392 00010000:00010000:1.0:1651529344.669007:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c4c6ef lrc: 4/0,0 mode: PR/PR res: [0x2b8eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccdd4 expref: 604 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.669014:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396387520 00010000:00010000:1.0:1651529344.669016:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007c5115ca/0x3234de053c4f3b9 lrc: 4/0,0 mode: PR/PR res: [0x2b8ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8165 expref: 605 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.669021:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12745 00000100:00100000:1.0:1651529344.669030:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+605:41279:x1731746396387456:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.669033:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.669034:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bbc7bf74/0x3234de053c4dbd3 lrc: 4/0,0 mode: PR/PR res: [0x2b8ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f5e expref: 605 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.669034:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12746 00000100:00100000:0.0:1651529344.669036:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+605:41278:x1731746396387392:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.669038:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bbc7bf74/0x3234de053c4dbd3 lrc: 3/0,0 mode: PR/PR res: [0x2b8ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f5e expref: 605 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.669040:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.669041:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c4c6ef lrc: 4/0,0 mode: PR/PR res: [0x2b8eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccdd4 expref: 605 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.669044:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bbc7bf74/0x3234de053c4dbd3 lrc: 0/0,0 mode: --/PR res: [0x2b8ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f5e expref: 605 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.669048:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c4c6ef lrc: 3/0,0 mode: PR/PR res: [0x2b8eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccdd4 expref: 605 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.669051:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.669051:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.669052:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eebe983a/0x3234de053c5200c lrc: 3/0,1 mode: PW/PW res: [0x2b8ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669054:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c4c6ef lrc: 0/0,0 mode: --/PR res: [0x2b8eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccdd4 expref: 604 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.669055:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eebe983a/0x3234de053c5200c lrc: 4/0,1 mode: PW/PW res: [0x2b8ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669058:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.669058:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.669059:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f2c22fc3/0x3234de053c52005 lrc: 3/0,1 mode: PW/PW res: [0x2b8eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669062:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.669062:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2c22fc3/0x3234de053c52005 lrc: 4/0,1 mode: PW/PW res: [0x2b8eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.669070:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+603:41279:x1731746396387456:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 40us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.669073:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12745 00000100:00100000:1.0:1651529344.669077:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12747 00000100:00100000:1.0:1651529344.669079:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+602:41278:x1731746396387520:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.669081:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.669082:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007c5115ca/0x3234de053c4f3b9 lrc: 4/0,0 mode: PR/PR res: [0x2b8ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8165 expref: 602 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.669083:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.669086:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007c5115ca/0x3234de053c4f3b9 lrc: 3/0,0 mode: PR/PR res: [0x2b8ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8165 expref: 602 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.669090:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+602:41278:x1731746396387392:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 54us (136us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.669091:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c5115ca/0x3234de053c4f3b9 lrc: 0/0,0 mode: --/PR res: [0x2b8ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8165 expref: 602 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.669093:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12746 00010000:00010000:1.0:1651529344.669094:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.669094:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.669095:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000aab15112/0x3234de053c52013 lrc: 3/0,1 mode: PW/PW res: [0x2b8ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669098:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aab15112/0x3234de053c52013 lrc: 4/0,1 mode: PW/PW res: [0x2b8ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.669104:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a223a622 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997032640:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.669107:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.669113:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+600:41278:x1731746396387520:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.669116:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12747 00000100:00100000:1.0:1651529344.669126:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004be0190 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997032576:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.669126:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c52021 lrc: 3/0,1 mode: --/PW res: [0x2b8ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669130:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000070dd06bd/0x3234de053c5201a lrc: 3/0,1 mode: --/PW res: [0x2b8ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669133:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f2c22fc3/0x3234de053c52005 lrc: 3/0,1 mode: PW/PW res: [0x2b8eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669136:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eebe983a/0x3234de053c5200c lrc: 3/0,1 mode: PW/PW res: [0x2b8ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669136:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2c22fc3/0x3234de053c52005 lrc: 3/0,1 mode: PW/PW res: [0x2b8eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669139:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eebe983a/0x3234de053c5200c lrc: 3/0,1 mode: PW/PW res: [0x2b8ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669140:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2c22fc3/0x3234de053c52005 lrc: 3/0,1 mode: PW/PW res: [0x2b8eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669142:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eebe983a/0x3234de053c5200c lrc: 3/0,1 mode: PW/PW res: [0x2b8ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669144:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eebe983a/0x3234de053c5200c lrc: 2/0,0 mode: PW/PW res: [0x2b8ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669157:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2c22fc3/0x3234de053c52005 lrc: 2/0,0 mode: PW/PW res: [0x2b8eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.669185:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a13808c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1465:39029:x1731745946506304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1215us (1353us total) trans 12885080018 rc 0/0 00000100:00100000:1.0:1651529344.669189:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211964 00000100:00100000:0.0:1651529344.669199:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1464:39030:x1731745946506240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1272us (1352us total) trans 12885080019 rc 0/0 00000100:00100000:0.0:1651529344.669202:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211963 00000100:00100000:1.0:1651529344.669203:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.669209:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000aab15112/0x3234de053c52013 lrc: 3/0,1 mode: PW/PW res: [0x2b8ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669212:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aab15112/0x3234de053c52013 lrc: 3/0,1 mode: PW/PW res: [0x2b8ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669216:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aab15112/0x3234de053c52013 lrc: 3/0,1 mode: PW/PW res: [0x2b8ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.669218:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.669218:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aab15112/0x3234de053c52013 lrc: 2/0,0 mode: PW/PW res: [0x2b8ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.669253:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.669279:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1464:39030:x1731745946506368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1275us (1403us total) trans 12885080020 rc 0/0 00000100:00100000:0.0:1651529344.669282:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211965 00000100:00100000:0.0:1651529344.669286:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946507200 00000100:00100000:0.0:1651529344.669303:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211970 00000100:00100000:0.0:1651529344.669305:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cfdd1a6c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1464:39030:x1731745946507200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.669310:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178418 count 1 00010000:00010000:0.0:1651529344.669314:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000707bb969/0x3234de053c52036 lrc: 3/0,1 mode: --/PW res: [0x2b8f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669319:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e16b0025/0x3234de053c4d256 lrc: 2/0,0 mode: PR/PR res: [0x2b8f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfadd expref: 599 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.669322:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.669323:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.669323:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000707bb969/0x3234de053c52036 lrc: 4/0,1 mode: --/PW res: [0x2b8f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669330:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e16b0025/0x3234de053c4d256 lrc: 3/0,0 mode: PR/PR res: [0x2b8f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfadd expref: 599 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.669333:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e16b0025/0x3234de053c4d256 lrc: 4/0,0 mode: PR/PR res: [0x2b8f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfadd expref: 599 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.669338:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a223a622 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997032832:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.669344:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.669347:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c086aae3 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.669352:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eebe983a/0x3234de053c5200c lrc: 2/0,0 mode: PW/PW res: [0x2b8ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669355:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eebe983a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.669356:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eebe983a/0x3234de053c5200c lrc: 2/0,0 mode: PW/PW res: [0x2b8ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669361:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eebe983a/0x3234de053c5200c lrc: 3/0,0 mode: PW/PW res: [0x2b8ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.669375:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.669386:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396387584 00010000:00010000:0.0:1651529344.669388:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eebe983a/0x3234de053c5200c lrc: 1/0,0 mode: --/PW res: [0x2b8ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669391:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f47eb744/0x3234de053c4c9b9 lrc: 4/0,0 mode: PR/PR res: [0x2b8ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd8cb expref: 600 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.669391:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eebe983a/0x3234de053c5200c lrc: 0/0,0 mode: --/PW res: [0x2b8ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669395:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2c22fc3/0x3234de053c52005 lrc: 2/0,0 mode: PW/PW res: [0x2b8eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.669397:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396387712 00010000:00010000:0.0:1651529344.669398:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f2c22fc3 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.669399:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008a4b8f8b/0x3234de053c4e7a3 lrc: 4/0,0 mode: PR/PR res: [0x2b8ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f00 expref: 601 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.669399:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2c22fc3/0x3234de053c52005 lrc: 2/0,0 mode: PW/PW res: [0x2b8eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669402:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2c22fc3/0x3234de053c52005 lrc: 3/0,0 mode: PW/PW res: [0x2b8eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.669403:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396388032 00010000:00010000:1.0:1651529344.669405:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000e403e3d/0x3234de053c4efde lrc: 5/0,0 mode: PR/PR res: [0x2b8f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7223 expref: 602 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.669405:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2c22fc3/0x3234de053c52005 lrc: 1/0,0 mode: --/PW res: [0x2b8eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669407:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2c22fc3/0x3234de053c52005 lrc: 0/0,0 mode: --/PW res: [0x2b8eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.669409:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396388096 00010000:00010000:1.0:1651529344.669411:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000018cf35ee/0x3234de053c4a053 lrc: 5/0,0 mode: PR/PR res: [0x2b8f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb71b expref: 603 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.669411:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aab15112/0x3234de053c52013 lrc: 2/0,0 mode: PW/PW res: [0x2b8ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.669416:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12748 00010000:00010000:0.0:1651529344.669416:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000aab15112 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.669417:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aab15112/0x3234de053c52013 lrc: 2/0,0 mode: PW/PW res: [0x2b8ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.669418:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+603:41279:x1731746396387584:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.669419:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aab15112/0x3234de053c52013 lrc: 3/0,0 mode: PW/PW res: [0x2b8ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669420:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.669422:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f47eb744/0x3234de053c4c9b9 lrc: 4/0,0 mode: PR/PR res: [0x2b8ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd8cb expref: 603 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.669422:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aab15112/0x3234de053c52013 lrc: 1/0,0 mode: --/PW res: [0x2b8ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669425:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aab15112/0x3234de053c52013 lrc: 0/0,0 mode: --/PW res: [0x2b8ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669426:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f47eb744/0x3234de053c4c9b9 lrc: 3/0,0 mode: PR/PR res: [0x2b8ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd8cb expref: 603 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.669431:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f47eb744/0x3234de053c4c9b9 lrc: 0/0,0 mode: --/PR res: [0x2b8ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd8cb expref: 603 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.669435:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.669435:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.669436:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000070dd06bd/0x3234de053c5201a lrc: 3/0,1 mode: PW/PW res: [0x2b8ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.669436:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000093ddaf92 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997032704:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.669439:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070dd06bd/0x3234de053c5201a lrc: 4/0,1 mode: PW/PW res: [0x2b8ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669439:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c5202f lrc: 3/0,1 mode: --/PW res: [0x2b8f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669446:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.669454:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+602:41279:x1731746396387584:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 35us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.669466:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12749 00000100:00100000:1.0:1651529344.669468:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12748 00000100:00100000:0.0:1651529344.669468:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+602:41279:x1731746396387712:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.669471:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.669472:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12750 00010000:00010000:0.0:1651529344.669473:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008a4b8f8b/0x3234de053c4e7a3 lrc: 4/0,0 mode: PR/PR res: [0x2b8ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f00 expref: 601 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.669474:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b9d7b776 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+601:41278:x1731746396388032:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.669477:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.669477:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008a4b8f8b/0x3234de053c4e7a3 lrc: 3/0,0 mode: PR/PR res: [0x2b8ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f00 expref: 601 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.669478:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000e403e3d/0x3234de053c4efde lrc: 4/0,0 mode: PR/PR res: [0x2b8f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7223 expref: 601 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.669482:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000e403e3d/0x3234de053c4efde lrc: 3/0,0 mode: PR/PR res: [0x2b8f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7223 expref: 601 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.669485:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a4b8f8b/0x3234de053c4e7a3 lrc: 0/0,0 mode: --/PR res: [0x2b8ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f00 expref: 601 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.669487:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e403e3d/0x3234de053c4efde lrc: 0/0,0 mode: --/PR res: [0x2b8f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7223 expref: 601 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.669489:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.669489:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.669490:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.669490:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c52021 lrc: 3/0,1 mode: PW/PW res: [0x2b8ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669491:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.669492:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c5202f lrc: 3/0,1 mode: PW/PW res: [0x2b8f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669493:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c52021 lrc: 4/0,1 mode: PW/PW res: [0x2b8ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669494:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c5202f lrc: 4/0,1 mode: PW/PW res: [0x2b8f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669499:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.669502:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.669507:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b9d7b776 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+599:41278:x1731746396388032:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 33us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.669510:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12750 00000100:00100000:0.0:1651529344.669513:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+598:41279:x1731746396387712:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 44us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.669514:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12751 00000100:00100000:1.0:1651529344.669515:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+598:41278:x1731746396388096:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.669516:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12749 00010000:00010000:1.0:1651529344.669517:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.669519:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000018cf35ee/0x3234de053c4a053 lrc: 5/0,0 mode: PR/PR res: [0x2b8f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb71b expref: 597 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.669522:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000018cf35ee/0x3234de053c4a053 lrc: 4/0,0 mode: PR/PR res: [0x2b8f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb71b expref: 597 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.669527:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.669527:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.669528:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b7578525/0x3234de053c52028 lrc: 3/0,1 mode: PW/PW res: [0x2b8f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669531:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7578525/0x3234de053c52028 lrc: 4/0,1 mode: PW/PW res: [0x2b8f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669535:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.669539:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+597:41278:x1731746396388096:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 24us (165us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.669539:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c52021 lrc: 3/0,1 mode: PW/PW res: [0x2b8ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.669542:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12751 00010000:00010000:0.0:1651529344.669543:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c52021 lrc: 3/0,1 mode: PW/PW res: [0x2b8ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669546:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c52021 lrc: 3/0,1 mode: PW/PW res: [0x2b8ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669548:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c52021 lrc: 2/0,0 mode: PW/PW res: [0x2b8ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669553:0:106695:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018cf35ee/0x3234de053c4a053 lrc: 0/0,0 mode: --/PR res: [0x2b8f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb71b expref: 596 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.669557:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007ac35c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997032768:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.669561:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b7578525/0x3234de053c52028 lrc: 3/0,1 mode: PW/PW res: [0x2b8f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669564:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b7578525/0x3234de053c52028 lrc: 3/0,1 mode: PW/PW res: [0x2b8f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669567:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7578525/0x3234de053c52028 lrc: 3/0,1 mode: PW/PW res: [0x2b8f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669570:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7578525/0x3234de053c52028 lrc: 3/0,1 mode: PW/PW res: [0x2b8f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669573:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7578525/0x3234de053c52028 lrc: 2/0,0 mode: PW/PW res: [0x2b8f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.669602:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1466:39030:x1731745946506816:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1204us (1269us total) trans 12885080021 rc 0/0 00000100:00100000:0.0:1651529344.669605:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211967 00010000:00010000:0.0:1651529344.669612:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c5202f lrc: 3/0,1 mode: PW/PW res: [0x2b8f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669615:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c5202f lrc: 3/0,1 mode: PW/PW res: [0x2b8f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.669618:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1465:39030:x1731745946506880:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1020us (1090us total) trans 12885080022 rc 0/0 00010000:00010000:0.0:1651529344.669618:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c5202f lrc: 3/0,1 mode: PW/PW res: [0x2b8f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.669621:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211968 00010000:00010000:0.0:1651529344.669621:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c5202f lrc: 2/0,0 mode: PW/PW res: [0x2b8f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669628:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000070dd06bd/0x3234de053c5201a lrc: 3/0,1 mode: PW/PW res: [0x2b8ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669632:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070dd06bd/0x3234de053c5201a lrc: 3/0,1 mode: PW/PW res: [0x2b8ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669635:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070dd06bd/0x3234de053c5201a lrc: 3/0,1 mode: PW/PW res: [0x2b8ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669637:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070dd06bd/0x3234de053c5201a lrc: 2/0,0 mode: PW/PW res: [0x2b8ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.669671:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1466:39029:x1731745946506944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1070us (1119us total) trans 12885080023 rc 0/0 00000100:00100000:1.0:1651529344.669672:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1466:39030:x1731745946506752:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1323us (1361us total) trans 12885080024 rc 0/0 00000100:00100000:0.0:1651529344.669674:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211969 00000100:00100000:1.0:1651529344.669676:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211966 00010000:00010000:0.0:1651529344.669681:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c52021 lrc: 2/0,0 mode: PW/PW res: [0x2b8ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669684:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009fd52982 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.669685:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c52021 lrc: 2/0,0 mode: PW/PW res: [0x2b8ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669688:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c52021 lrc: 3/0,0 mode: PW/PW res: [0x2b8ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669693:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c52021 lrc: 1/0,0 mode: --/PW res: [0x2b8ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669696:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c52021 lrc: 0/0,0 mode: --/PW res: [0x2b8ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669700:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7578525/0x3234de053c52028 lrc: 2/0,0 mode: PW/PW res: [0x2b8f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669703:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b7578525 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.669704:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7578525/0x3234de053c52028 lrc: 2/0,0 mode: PW/PW res: [0x2b8f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669706:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7578525/0x3234de053c52028 lrc: 3/0,0 mode: PW/PW res: [0x2b8f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669710:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7578525/0x3234de053c52028 lrc: 1/0,0 mode: --/PW res: [0x2b8f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.669712:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.669712:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7578525/0x3234de053c52028 lrc: 0/0,0 mode: --/PW res: [0x2b8f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669716:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c5202f lrc: 2/0,0 mode: PW/PW res: [0x2b8f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669718:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c9b39253 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.669719:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c5202f lrc: 2/0,0 mode: PW/PW res: [0x2b8f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669722:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c5202f lrc: 3/0,0 mode: PW/PW res: [0x2b8f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669725:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c5202f lrc: 1/0,0 mode: --/PW res: [0x2b8f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669727:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c5202f lrc: 0/0,0 mode: --/PW res: [0x2b8f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669746:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070dd06bd/0x3234de053c5201a lrc: 2/0,0 mode: PW/PW res: [0x2b8ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.669749:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.669749:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000070dd06bd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.669750:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070dd06bd/0x3234de053c5201a lrc: 2/0,0 mode: PW/PW res: [0x2b8ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669752:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070dd06bd/0x3234de053c5201a lrc: 3/0,0 mode: PW/PW res: [0x2b8ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669756:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070dd06bd/0x3234de053c5201a lrc: 1/0,0 mode: --/PW res: [0x2b8ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669758:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070dd06bd/0x3234de053c5201a lrc: 0/0,0 mode: --/PW res: [0x2b8ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.669760:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.669769:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.669769:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a223a622 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997032832:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.669778:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000707bb969/0x3234de053c52036 lrc: 3/0,1 mode: --/PW res: [0x2b8f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.669785:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946507264 00000100:00100000:0.0:1651529344.669795:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946507520 00000100:00100000:0.0:1651529344.669799:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946507584 00000100:00100000:0.0:1651529344.669803:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211971 00000100:00100000:0.0:1651529344.669805:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1467:39029:x1731745946507264:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.669810:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178419 count 1 00010000:00010000:0.0:1651529344.669813:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a4fe8ca/0x3234de053c5203d lrc: 3/0,1 mode: --/PW res: [0x2b8f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669818:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009d1e5ded/0x3234de053c4f200 lrc: 2/0,0 mode: PR/PR res: [0x2b8f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7adc expref: 595 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.669821:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.669822:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.669822:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a4fe8ca/0x3234de053c5203d lrc: 4/0,1 mode: --/PW res: [0x2b8f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669829:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009d1e5ded/0x3234de053c4f200 lrc: 3/0,0 mode: PR/PR res: [0x2b8f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7adc expref: 595 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.669832:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009d1e5ded/0x3234de053c4f200 lrc: 4/0,0 mode: PR/PR res: [0x2b8f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7adc expref: 595 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.669836:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a223a622 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997032896:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.669841:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211972 00000100:00100000:1.0:1651529344.669843:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1467:39030:x1731745946507520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.669850:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e68b7e1f going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.669854:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178420 count 1 00000100:00100000:0.0:1651529344.669857:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211973 00010000:00010000:1.0:1651529344.669859:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ec78f20/0x3234de053c52044 lrc: 3/0,1 mode: --/PW res: [0x2b8f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.669859:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1467:39029:x1731745946507584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.669863:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b3e99c14/0x3234de053c4d10d lrc: 2/0,0 mode: PR/PR res: [0x2b8f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf5ce expref: 595 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.669867:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.669867:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.669868:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ec78f20/0x3234de053c52044 lrc: 4/0,1 mode: --/PW res: [0x2b8f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669875:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b3e99c14/0x3234de053c4d10d lrc: 3/0,0 mode: PR/PR res: [0x2b8f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf5ce expref: 595 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.669878:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b3e99c14/0x3234de053c4d10d lrc: 4/0,0 mode: PR/PR res: [0x2b8f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf5ce expref: 595 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:0.0:1651529344.669879:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178421 count 1 00000100:00100000:1.0:1651529344.669883:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000027c41311 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997032960:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.669883:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004eba1bc5/0x3234de053c5204b lrc: 3/0,1 mode: --/PW res: [0x2b8f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669887:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000486cd5c8/0x3234de053c4cba3 lrc: 2/0,0 mode: PR/PR res: [0x2b8f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce042 expref: 595 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.669890:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.669891:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 0000000099c1da85 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.669891:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.669892:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004eba1bc5/0x3234de053c5204b lrc: 4/0,1 mode: --/PW res: [0x2b8f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.669898:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396388224 00010000:00010000:0.0:1651529344.669898:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000486cd5c8/0x3234de053c4cba3 lrc: 3/0,0 mode: PR/PR res: [0x2b8f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce042 expref: 595 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.669902:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e16b0025/0x3234de053c4d256 lrc: 4/0,0 mode: PR/PR res: [0x2b8f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfadd expref: 596 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.669902:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000486cd5c8/0x3234de053c4cba3 lrc: 4/0,0 mode: PR/PR res: [0x2b8f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce042 expref: 596 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.669906:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000093ddaf92 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997033024:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.669910:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12752 00000100:00100000:1.0:1651529344.669912:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+596:41279:x1731746396388224:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.669914:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.669915:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e16b0025/0x3234de053c4d256 lrc: 4/0,0 mode: PR/PR res: [0x2b8f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfadd expref: 596 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.669917:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000000d706dff going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.669922:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e16b0025/0x3234de053c4d256 lrc: 3/0,0 mode: PR/PR res: [0x2b8f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfadd expref: 596 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.669927:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e16b0025/0x3234de053c4d256 lrc: 0/0,0 mode: --/PR res: [0x2b8f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfadd expref: 596 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.669930:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.669931:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.669932:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000707bb969/0x3234de053c52036 lrc: 3/0,1 mode: PW/PW res: [0x2b8f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669935:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000707bb969/0x3234de053c52036 lrc: 4/0,1 mode: PW/PW res: [0x2b8f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.669946:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.669952:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+595:41279:x1731746396388224:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.669955:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12752 00010000:00010000:0.0:1651529344.669973:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000707bb969/0x3234de053c52036 lrc: 3/0,1 mode: PW/PW res: [0x2b8f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.669995:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000707bb969/0x3234de053c52036 lrc: 3/0,1 mode: PW/PW res: [0x2b8f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.670006:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.670013:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000707bb969/0x3234de053c52036 lrc: 3/0,1 mode: PW/PW res: [0x2b8f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.670015:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.670016:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000707bb969/0x3234de053c52036 lrc: 2/0,0 mode: PW/PW res: [0x2b8f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.670025:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946507712 00000100:00100000:1.0:1651529344.670031:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946507648 00000100:00100000:1.0:1651529344.670035:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211974 00000100:00100000:1.0:1651529344.670037:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1469:39029:x1731745946507712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.670042:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178423 count 1 00010000:00010000:1.0:1651529344.670054:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0c2f0ae/0x3234de053c52052 lrc: 3/0,1 mode: --/PW res: [0x2b8f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670059:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009fe87734/0x3234de053c4efbb lrc: 2/0,0 mode: PR/PR res: [0x2b8f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7182 expref: 594 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.670062:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.670063:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.670064:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0c2f0ae/0x3234de053c52052 lrc: 4/0,1 mode: --/PW res: [0x2b8f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670070:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009fe87734/0x3234de053c4efbb lrc: 3/0,0 mode: PR/PR res: [0x2b8f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7182 expref: 594 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.670074:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009fe87734/0x3234de053c4efbb lrc: 4/0,0 mode: PR/PR res: [0x2b8f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7182 expref: 594 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.670078:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a925fbf6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997033088:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.670086:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cfdd1a6c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1470:39030:x1731745946507200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 780us (867us total) trans 12885080025 rc 0/0 00000100:00100000:0.0:1651529344.670089:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211970 00000100:00100000:1.0:1651529344.670093:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000053a0cffa going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.670099:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211975 00000100:00100000:1.0:1651529344.670101:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1469:39030:x1731745946507648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.670106:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178422 count 1 00010000:00010000:1.0:1651529344.670109:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d7fa65b/0x3234de053c52059 lrc: 3/0,1 mode: --/PW res: [0x2b8f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.670111:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000707bb969/0x3234de053c52036 lrc: 2/0,0 mode: PW/PW res: [0x2b8f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670113:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005b6bb6b6/0x3234de053c4d03b lrc: 2/0,0 mode: PR/PR res: [0x2b8f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf240 expref: 594 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.670114:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000707bb969 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.670115:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000707bb969/0x3234de053c52036 lrc: 2/0,0 mode: PW/PW res: [0x2b8f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670116:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.670117:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.670118:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d7fa65b/0x3234de053c52059 lrc: 4/0,1 mode: --/PW res: [0x2b8f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.670118:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000707bb969/0x3234de053c52036 lrc: 3/0,0 mode: PW/PW res: [0x2b8f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.670123:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000707bb969/0x3234de053c52036 lrc: 1/0,0 mode: --/PW res: [0x2b8f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670124:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005b6bb6b6/0x3234de053c4d03b lrc: 3/0,0 mode: PR/PR res: [0x2b8f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf240 expref: 594 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.670126:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000707bb969/0x3234de053c52036 lrc: 0/0,0 mode: --/PW res: [0x2b8f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670127:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005b6bb6b6/0x3234de053c4d03b lrc: 4/0,0 mode: PR/PR res: [0x2b8f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf240 expref: 594 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.670131:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f7006631 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997033152:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.670137:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f9dac3f6 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.670141:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.670201:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.670210:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946507968 00000100:00100000:0.0:1651529344.670216:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946507904 00000100:00100000:0.0:1651529344.670220:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211976 00000100:00100000:0.0:1651529344.670221:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1471:39029:x1731745946507968:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.670256:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.670263:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.670269:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.670277:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211977 00000100:00100000:1.0:1651529344.670279:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a13808c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1471:39030:x1731745946507904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.670284:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178424 count 1 00010000:00010000:1.0:1651529344.670288:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e62d422c/0x3234de053c52060 lrc: 3/0,1 mode: --/PW res: [0x2b8f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.670292:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178425 count 1 00010000:00010000:1.0:1651529344.670293:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a2ca352a/0x3234de053c4f476 lrc: 2/0,0 mode: PR/PR res: [0x2b8f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d848a expref: 594 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.670296:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.670296:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.670296:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054dd6f57/0x3234de053c52067 lrc: 3/0,1 mode: --/PW res: [0x2b8f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670297:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e62d422c/0x3234de053c52060 lrc: 4/0,1 mode: --/PW res: [0x2b8f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.670301:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000179dc9bb/0x3234de053c4d5eb lrc: 2/0,0 mode: PR/PR res: [0x2b8f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0954 expref: 594 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.670305:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.670305:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.670306:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054dd6f57/0x3234de053c52067 lrc: 4/0,1 mode: --/PW res: [0x2b8f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670307:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a2ca352a/0x3234de053c4f476 lrc: 3/0,0 mode: PR/PR res: [0x2b8f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d848a expref: 594 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.670310:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a2ca352a/0x3234de053c4f476 lrc: 4/0,0 mode: PR/PR res: [0x2b8f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d848a expref: 594 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.670313:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000179dc9bb/0x3234de053c4d5eb lrc: 3/0,0 mode: PR/PR res: [0x2b8f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0954 expref: 594 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.670314:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007c534a1e pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997033216:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.670317:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000179dc9bb/0x3234de053c4d5eb lrc: 4/0,0 mode: PR/PR res: [0x2b8f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0954 expref: 594 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.670321:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005a17dd72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997033280:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.670324:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fb6c773d going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.670330:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 000000000a4def41 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.670331:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000027c41311 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997032960:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.670335:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003ec78f20/0x3234de053c52044 lrc: 3/0,1 mode: --/PW res: [0x2b8f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.670340:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000093ddaf92 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997033024:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.670341:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396388480 00010000:00010000:0.0:1651529344.670344:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004eba1bc5/0x3234de053c5204b lrc: 3/0,1 mode: --/PW res: [0x2b8f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670345:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000486cd5c8/0x3234de053c4cba3 lrc: 4/0,0 mode: PR/PR res: [0x2b8f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce042 expref: 595 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.670350:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a223a622 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997032896:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.670356:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396388416 00010000:00010000:1.0:1651529344.670358:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009d1e5ded/0x3234de053c4f200 lrc: 4/0,0 mode: PR/PR res: [0x2b8f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7adc expref: 596 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.670363:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396388544 00010000:00010000:1.0:1651529344.670365:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b3e99c14/0x3234de053c4d10d lrc: 4/0,0 mode: PR/PR res: [0x2b8f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf5ce expref: 597 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.670369:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12753 00000100:00100000:1.0:1651529344.670371:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+597:41279:x1731746396388480:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.670373:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.670375:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000486cd5c8/0x3234de053c4cba3 lrc: 4/0,0 mode: PR/PR res: [0x2b8f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce042 expref: 597 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.670375:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003a4fe8ca/0x3234de053c5203d lrc: 3/0,1 mode: --/PW res: [0x2b8f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670378:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000486cd5c8/0x3234de053c4cba3 lrc: 3/0,0 mode: PR/PR res: [0x2b8f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce042 expref: 597 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.670384:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000486cd5c8/0x3234de053c4cba3 lrc: 0/0,0 mode: --/PR res: [0x2b8f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce042 expref: 597 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.670387:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.670388:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.670388:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004eba1bc5/0x3234de053c5204b lrc: 3/0,1 mode: PW/PW res: [0x2b8f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670391:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004eba1bc5/0x3234de053c5204b lrc: 4/0,1 mode: PW/PW res: [0x2b8f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.670392:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.670400:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.670406:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+596:41279:x1731746396388480:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.670409:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12753 00000100:00100000:1.0:1651529344.670413:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12754 00000100:00100000:1.0:1651529344.670415:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+595:41278:x1731746396388416:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.670417:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.670419:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009d1e5ded/0x3234de053c4f200 lrc: 4/0,0 mode: PR/PR res: [0x2b8f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7adc expref: 595 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.670422:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009d1e5ded/0x3234de053c4f200 lrc: 3/0,0 mode: PR/PR res: [0x2b8f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7adc expref: 595 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.670441:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d1e5ded/0x3234de053c4f200 lrc: 0/0,0 mode: --/PR res: [0x2b8f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7adc expref: 595 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.670445:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.670445:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.670446:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003a4fe8ca/0x3234de053c5203d lrc: 3/0,1 mode: PW/PW res: [0x2b8f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670449:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a4fe8ca/0x3234de053c5203d lrc: 4/0,1 mode: PW/PW res: [0x2b8f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670466:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.670470:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004eba1bc5/0x3234de053c5204b lrc: 3/0,1 mode: PW/PW res: [0x2b8f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.670476:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+594:41278:x1731746396388416:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 61us (213us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.670478:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004eba1bc5/0x3234de053c5204b lrc: 3/0,1 mode: PW/PW res: [0x2b8f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.670479:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12754 00010000:00010000:0.0:1651529344.670482:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004eba1bc5/0x3234de053c5204b lrc: 3/0,1 mode: PW/PW res: [0x2b8f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.670483:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12755 00000100:00100000:1.0:1651529344.670485:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+593:41278:x1731746396388544:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.670485:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004eba1bc5/0x3234de053c5204b lrc: 2/0,0 mode: PW/PW res: [0x2b8f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670487:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.670489:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b3e99c14/0x3234de053c4d10d lrc: 4/0,0 mode: PR/PR res: [0x2b8f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf5ce expref: 593 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.670493:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b3e99c14/0x3234de053c4d10d lrc: 3/0,0 mode: PR/PR res: [0x2b8f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf5ce expref: 593 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.670498:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3e99c14/0x3234de053c4d10d lrc: 0/0,0 mode: --/PR res: [0x2b8f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf5ce expref: 593 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.670501:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.670502:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.670502:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003ec78f20/0x3234de053c52044 lrc: 3/0,1 mode: PW/PW res: [0x2b8f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670505:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ec78f20/0x3234de053c52044 lrc: 4/0,1 mode: PW/PW res: [0x2b8f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670511:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.670516:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+592:41278:x1731746396388544:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 31us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.670519:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12755 00000100:00100000:0.0:1651529344.670525:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1472:39029:x1731745946507584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 666us (756us total) trans 12885080026 rc 0/0 00010000:00010000:1.0:1651529344.670526:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003ec78f20/0x3234de053c52044 lrc: 3/0,1 mode: PW/PW res: [0x2b8f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.670528:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211973 00010000:00010000:1.0:1651529344.670529:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ec78f20/0x3234de053c52044 lrc: 3/0,1 mode: PW/PW res: [0x2b8f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670532:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ec78f20/0x3234de053c52044 lrc: 3/0,1 mode: PW/PW res: [0x2b8f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.670534:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946508032 00010000:00010000:1.0:1651529344.670535:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ec78f20/0x3234de053c52044 lrc: 2/0,0 mode: PW/PW res: [0x2b8f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.670541:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211978 00000100:00100000:0.0:1651529344.670542:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1472:39030:x1731745946508032:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.670554:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178426 count 1 00010000:00010000:0.0:1651529344.670559:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000daf880b4/0x3234de053c5206e lrc: 3/0,1 mode: --/PW res: [0x2b8fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.670563:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f88ef7eb/0x3234de053c4f38f lrc: 2/0,0 mode: PR/PR res: [0x2b8fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80d9 expref: 591 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.670567:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.670567:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.670568:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000daf880b4/0x3234de053c5206e lrc: 4/0,1 mode: --/PW res: [0x2b8fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.670575:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f88ef7eb/0x3234de053c4f38f lrc: 3/0,0 mode: PR/PR res: [0x2b8fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80d9 expref: 591 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.670578:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f88ef7eb/0x3234de053c4f38f lrc: 4/0,0 mode: PR/PR res: [0x2b8fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80d9 expref: 591 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.670579:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1473:39030:x1731745946507520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 736us (830us total) trans 12885080027 rc 0/0 00000100:00100000:1.0:1651529344.670582:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211972 00000100:00100000:0.0:1651529344.670582:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000093ddaf92 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997033344:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.670590:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e68b7e1f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.670593:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f7006631 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997033152:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.670596:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004eba1bc5/0x3234de053c5204b lrc: 2/0,0 mode: PW/PW res: [0x2b8f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670597:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006d7fa65b/0x3234de053c52059 lrc: 3/0,1 mode: --/PW res: [0x2b8f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.670599:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004eba1bc5 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.670600:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004eba1bc5/0x3234de053c5204b lrc: 2/0,0 mode: PW/PW res: [0x2b8f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.670603:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a925fbf6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997033088:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.670603:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004eba1bc5/0x3234de053c5204b lrc: 3/0,0 mode: PW/PW res: [0x2b8f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670606:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e0c2f0ae/0x3234de053c52052 lrc: 3/0,1 mode: --/PW res: [0x2b8f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.670607:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004eba1bc5/0x3234de053c5204b lrc: 1/0,0 mode: --/PW res: [0x2b8f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.670610:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004eba1bc5/0x3234de053c5204b lrc: 0/0,0 mode: --/PW res: [0x2b8f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.670614:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ec78f20/0x3234de053c52044 lrc: 2/0,0 mode: PW/PW res: [0x2b8f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.670617:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003ec78f20 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.670618:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ec78f20/0x3234de053c52044 lrc: 2/0,0 mode: PW/PW res: [0x2b8f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.670620:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ec78f20/0x3234de053c52044 lrc: 3/0,0 mode: PW/PW res: [0x2b8f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.670624:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ec78f20/0x3234de053c52044 lrc: 1/0,0 mode: --/PW res: [0x2b8f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.670626:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ec78f20/0x3234de053c52044 lrc: 0/0,0 mode: --/PW res: [0x2b8f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.670633:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003a4fe8ca/0x3234de053c5203d lrc: 3/0,1 mode: PW/PW res: [0x2b8f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.670636:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a4fe8ca/0x3234de053c5203d lrc: 3/0,1 mode: PW/PW res: [0x2b8f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.670639:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a4fe8ca/0x3234de053c5203d lrc: 3/0,1 mode: PW/PW res: [0x2b8f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.670642:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a4fe8ca/0x3234de053c5203d lrc: 2/0,0 mode: PW/PW res: [0x2b8f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.670686:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.670695:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.670700:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396388608 00010000:00010000:1.0:1651529344.670705:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009fe87734/0x3234de053c4efbb lrc: 4/0,0 mode: PR/PR res: [0x2b8f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7182 expref: 592 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.670718:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396388736 00010000:00010000:1.0:1651529344.670721:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005b6bb6b6/0x3234de053c4d03b lrc: 4/0,0 mode: PR/PR res: [0x2b8f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf240 expref: 593 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.670722:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1473:39029:x1731745946507264:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 916us (1010us total) trans 12885080028 rc 0/0 00000100:00100000:0.0:1651529344.670725:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211971 00000100:00100000:1.0:1651529344.670726:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12756 00000100:00100000:1.0:1651529344.670727:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+593:41279:x1731746396388608:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.670730:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.670732:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009fe87734/0x3234de053c4efbb lrc: 4/0,0 mode: PR/PR res: [0x2b8f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7182 expref: 593 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.670732:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a4fe8ca/0x3234de053c5203d lrc: 2/0,0 mode: PW/PW res: [0x2b8f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670743:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009fe87734/0x3234de053c4efbb lrc: 3/0,0 mode: PR/PR res: [0x2b8f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7182 expref: 593 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.670744:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003a4fe8ca already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.670745:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a4fe8ca/0x3234de053c5203d lrc: 2/0,0 mode: PW/PW res: [0x2b8f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670749:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fe87734/0x3234de053c4efbb lrc: 0/0,0 mode: --/PR res: [0x2b8f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7182 expref: 593 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.670749:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a4fe8ca/0x3234de053c5203d lrc: 3/0,0 mode: PW/PW res: [0x2b8f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670753:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.670753:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.670753:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a4fe8ca/0x3234de053c5203d lrc: 1/0,0 mode: --/PW res: [0x2b8f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670754:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e0c2f0ae/0x3234de053c52052 lrc: 3/0,1 mode: PW/PW res: [0x2b8f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.670756:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a4fe8ca/0x3234de053c5203d lrc: 0/0,0 mode: --/PW res: [0x2b8f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670757:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0c2f0ae/0x3234de053c52052 lrc: 4/0,1 mode: PW/PW res: [0x2b8f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670764:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.670771:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+592:41279:x1731746396388608:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 43us (85us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.670774:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12756 00000100:00100000:1.0:1651529344.670778:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12757 00000100:00100000:1.0:1651529344.670780:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de6bf351 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+591:41279:x1731746396388736:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.670782:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.670784:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005b6bb6b6/0x3234de053c4d03b lrc: 4/0,0 mode: PR/PR res: [0x2b8f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf240 expref: 591 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.670787:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005b6bb6b6/0x3234de053c4d03b lrc: 3/0,0 mode: PR/PR res: [0x2b8f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf240 expref: 591 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.670792:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b6bb6b6/0x3234de053c4d03b lrc: 0/0,0 mode: --/PR res: [0x2b8f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf240 expref: 591 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.670795:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.670796:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.670796:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006d7fa65b/0x3234de053c52059 lrc: 3/0,1 mode: PW/PW res: [0x2b8f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670799:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d7fa65b/0x3234de053c52059 lrc: 4/0,1 mode: PW/PW res: [0x2b8f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670805:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.670823:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de6bf351 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+590:41279:x1731746396388736:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.670826:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12757 00010000:00010000:1.0:1651529344.670836:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e0c2f0ae/0x3234de053c52052 lrc: 3/0,1 mode: PW/PW res: [0x2b8f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.670842:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.670846:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0c2f0ae/0x3234de053c52052 lrc: 3/0,1 mode: PW/PW res: [0x2b8f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670850:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0c2f0ae/0x3234de053c52052 lrc: 3/0,1 mode: PW/PW res: [0x2b8f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670852:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0c2f0ae/0x3234de053c52052 lrc: 2/0,0 mode: PW/PW res: [0x2b8f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.670879:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.670886:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0c2f0ae/0x3234de053c52052 lrc: 2/0,0 mode: PW/PW res: [0x2b8f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.670892:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e0c2f0ae already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.670893:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0c2f0ae/0x3234de053c52052 lrc: 2/0,0 mode: PW/PW res: [0x2b8f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.670896:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0c2f0ae/0x3234de053c52052 lrc: 3/0,0 mode: PW/PW res: [0x2b8f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.670901:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0c2f0ae/0x3234de053c52052 lrc: 1/0,0 mode: --/PW res: [0x2b8f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.670904:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0c2f0ae/0x3234de053c52052 lrc: 0/0,0 mode: --/PW res: [0x2b8f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.670908:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1473:39029:x1731745946507712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 870us (902us total) trans 12885080029 rc 0/0 00000100:00100000:1.0:1651529344.670912:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211974 00000100:00100000:1.0:1651529344.670917:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946508288 00000100:00100000:1.0:1651529344.670923:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946508352 00000100:00100000:1.0:1651529344.670929:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211979 00000100:00100000:1.0:1651529344.670930:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1474:39030:x1731745946508288:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.670934:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005a17dd72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997033280:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.670935:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178427 count 1 00010000:00010000:1.0:1651529344.670940:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ba57bba/0x3234de053c52075 lrc: 3/0,1 mode: --/PW res: [0x2b8fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.670940:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000054dd6f57/0x3234de053c52067 lrc: 3/0,1 mode: --/PW res: [0x2b8f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670944:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005f4c8f7a/0x3234de053c4aa39 lrc: 2/0,0 mode: PR/PR res: [0x2b8fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd7a expref: 589 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.670947:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.670948:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.670949:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ba57bba/0x3234de053c52075 lrc: 4/0,1 mode: --/PW res: [0x2b8fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670955:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005f4c8f7a/0x3234de053c4aa39 lrc: 3/0,0 mode: PR/PR res: [0x2b8fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd7a expref: 589 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.670958:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005f4c8f7a/0x3234de053c4aa39 lrc: 4/0,0 mode: PR/PR res: [0x2b8fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd7a expref: 589 pid: 106695 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.670962:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003562cf4d pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997033408:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.670971:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000053a0cffa going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.670973:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211980 00000100:00100000:0.0:1651529344.670975:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1474:39029:x1731745946508352:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.670976:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006d7fa65b/0x3234de053c52059 lrc: 3/0,1 mode: PW/PW res: [0x2b8f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670979:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d7fa65b/0x3234de053c52059 lrc: 3/0,1 mode: PW/PW res: [0x2b8f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.670981:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178428 count 1 00010000:00010000:1.0:1651529344.670982:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d7fa65b/0x3234de053c52059 lrc: 3/0,1 mode: PW/PW res: [0x2b8f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.670985:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d7fa65b/0x3234de053c52059 lrc: 2/0,0 mode: PW/PW res: [0x2b8f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.670986:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000674569e9/0x3234de053c5207c lrc: 3/0,1 mode: --/PW res: [0x2b8fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.670990:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000029431276/0x3234de053c4e0d4 lrc: 2/0,0 mode: PR/PR res: [0x2b8fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d33ee expref: 589 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.671004:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.671005:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.671005:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000674569e9/0x3234de053c5207c lrc: 4/0,1 mode: --/PW res: [0x2b8fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671012:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000029431276/0x3234de053c4e0d4 lrc: 3/0,0 mode: PR/PR res: [0x2b8fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d33ee expref: 589 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.671016:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000029431276/0x3234de053c4e0d4 lrc: 4/0,0 mode: PR/PR res: [0x2b8fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d33ee expref: 589 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.671024:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1475:39030:x1731745946507648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 922us (1009us total) trans 12885080030 rc 0/0 00000100:00100000:1.0:1651529344.671027:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211975 00000100:00100000:0.0:1651529344.671034:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bca72234 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997033472:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.671037:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007c534a1e pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997033216:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.671041:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e62d422c/0x3234de053c52060 lrc: 3/0,1 mode: --/PW res: [0x2b8f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.671044:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 000000000a4def41 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.671049:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d7fa65b/0x3234de053c52059 lrc: 2/0,0 mode: PW/PW res: [0x2b8f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671052:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006d7fa65b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.671053:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d7fa65b/0x3234de053c52059 lrc: 2/0,0 mode: PW/PW res: [0x2b8f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671056:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d7fa65b/0x3234de053c52059 lrc: 3/0,0 mode: PW/PW res: [0x2b8f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.671057:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.671061:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d7fa65b/0x3234de053c52059 lrc: 1/0,0 mode: --/PW res: [0x2b8f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671066:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d7fa65b/0x3234de053c52059 lrc: 0/0,0 mode: --/PW res: [0x2b8f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.671073:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946508416 00000100:00100000:0.0:1651529344.671086:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211981 00000100:00100000:0.0:1651529344.671087:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1475:39030:x1731745946508416:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.671092:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178429 count 1 00010000:00010000:0.0:1651529344.671095:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc44198a/0x3234de053c52083 lrc: 3/0,1 mode: --/PW res: [0x2b8fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.671096:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.671100:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b5cb8adb/0x3234de053c4caa7 lrc: 2/0,0 mode: PR/PR res: [0x2b8fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc75 expref: 589 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.671103:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.671103:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.671104:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc44198a/0x3234de053c52083 lrc: 4/0,1 mode: --/PW res: [0x2b8fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671110:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b5cb8adb/0x3234de053c4caa7 lrc: 3/0,0 mode: PR/PR res: [0x2b8fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc75 expref: 589 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.671114:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b5cb8adb/0x3234de053c4caa7 lrc: 4/0,0 mode: PR/PR res: [0x2b8fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc75 expref: 589 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.671118:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dff6a73d pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997033536:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.671125:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 000000000d706dff going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.671129:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.671142:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396389056 00010000:00010000:1.0:1651529344.671148:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a2ca352a/0x3234de053c4f476 lrc: 4/0,0 mode: PR/PR res: [0x2b8f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d848a expref: 590 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.671157:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396389120 00000100:00100000:0.0:1651529344.671161:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12758 00000100:00100000:0.0:1651529344.671163:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+591:41278:x1731746396389056:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.671166:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000179dc9bb/0x3234de053c4d5eb lrc: 4/0,0 mode: PR/PR res: [0x2b8f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0954 expref: 591 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.671167:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.671169:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a2ca352a/0x3234de053c4f476 lrc: 4/0,0 mode: PR/PR res: [0x2b8f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d848a expref: 591 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.671172:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12759 00010000:00010000:0.0:1651529344.671173:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a2ca352a/0x3234de053c4f476 lrc: 3/0,0 mode: PR/PR res: [0x2b8f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d848a expref: 591 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.671174:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+591:41278:x1731746396389120:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.671177:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.671178:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000179dc9bb/0x3234de053c4d5eb lrc: 4/0,0 mode: PR/PR res: [0x2b8f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0954 expref: 591 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.671179:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2ca352a/0x3234de053c4f476 lrc: 0/0,0 mode: --/PR res: [0x2b8f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d848a expref: 591 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.671182:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000179dc9bb/0x3234de053c4d5eb lrc: 3/0,0 mode: PR/PR res: [0x2b8f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0954 expref: 590 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.671182:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.671183:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.671184:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e62d422c/0x3234de053c52060 lrc: 3/0,1 mode: PW/PW res: [0x2b8f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671187:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000179dc9bb/0x3234de053c4d5eb lrc: 0/0,0 mode: --/PR res: [0x2b8f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0954 expref: 590 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.671187:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e62d422c/0x3234de053c52060 lrc: 4/0,1 mode: PW/PW res: [0x2b8f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671191:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.671191:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.671192:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000054dd6f57/0x3234de053c52067 lrc: 3/0,1 mode: PW/PW res: [0x2b8f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671196:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.671201:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054dd6f57/0x3234de053c52067 lrc: 4/0,1 mode: PW/PW res: [0x2b8f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.671205:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+589:41278:x1731746396389056:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 41us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.671208:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12758 00010000:00010000:1.0:1651529344.671211:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.671218:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+588:41278:x1731746396389120:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 44us (90us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.671220:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000054dd6f57/0x3234de053c52067 lrc: 3/0,1 mode: PW/PW res: [0x2b8f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.671232:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12759 00010000:00010000:0.0:1651529344.671237:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054dd6f57/0x3234de053c52067 lrc: 3/0,1 mode: PW/PW res: [0x2b8f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671241:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054dd6f57/0x3234de053c52067 lrc: 3/0,1 mode: PW/PW res: [0x2b8f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671243:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e62d422c/0x3234de053c52060 lrc: 3/0,1 mode: PW/PW res: [0x2b8f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671244:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054dd6f57/0x3234de053c52067 lrc: 2/0,0 mode: PW/PW res: [0x2b8f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671247:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e62d422c/0x3234de053c52060 lrc: 3/0,1 mode: PW/PW res: [0x2b8f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671250:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e62d422c/0x3234de053c52060 lrc: 3/0,1 mode: PW/PW res: [0x2b8f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671252:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e62d422c/0x3234de053c52060 lrc: 2/0,0 mode: PW/PW res: [0x2b8f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.671293:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a13808c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1476:39030:x1731745946507904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1014us (1092us total) trans 12885080031 rc 0/0 00000100:00100000:1.0:1651529344.671296:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211977 00000100:00100000:0.0:1651529344.671325:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1476:39029:x1731745946507968:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1102us (1183us total) trans 12885080032 rc 0/0 00000100:00100000:1.0:1651529344.671346:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.671356:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211976 00000100:00100000:0.0:1651529344.671361:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946508480 00000100:00100000:1.0:1651529344.671366:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.671380:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211982 00000100:00100000:0.0:1651529344.671381:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1476:39030:x1731745946508480:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.671387:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178430 count 1 00010000:00010000:0.0:1651529344.671391:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fa75d86/0x3234de053c5208a lrc: 3/0,1 mode: --/PW res: [0x2b8fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671396:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002da3d5c2/0x3234de053c4a88e lrc: 2/0,0 mode: PR/PR res: [0x2b8fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbca8 expref: 587 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.671399:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.671399:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.671400:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fa75d86/0x3234de053c5208a lrc: 4/0,1 mode: --/PW res: [0x2b8fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.671402:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.671407:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002da3d5c2/0x3234de053c4a88e lrc: 3/0,0 mode: PR/PR res: [0x2b8fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbca8 expref: 587 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.671413:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002da3d5c2/0x3234de053c4a88e lrc: 4/0,0 mode: PR/PR res: [0x2b8fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbca8 expref: 587 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.671417:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000043b7984f pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997033600:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.671425:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 0000000049203969 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.671431:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054dd6f57/0x3234de053c52067 lrc: 2/0,0 mode: PW/PW res: [0x2b8f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671434:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054dd6f57 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.671435:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054dd6f57/0x3234de053c52067 lrc: 2/0,0 mode: PW/PW res: [0x2b8f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671438:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054dd6f57/0x3234de053c52067 lrc: 3/0,0 mode: PW/PW res: [0x2b8f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671442:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054dd6f57/0x3234de053c52067 lrc: 1/0,0 mode: --/PW res: [0x2b8f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671445:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054dd6f57/0x3234de053c52067 lrc: 0/0,0 mode: --/PW res: [0x2b8f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671449:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e62d422c/0x3234de053c52060 lrc: 2/0,0 mode: PW/PW res: [0x2b8f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671452:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e62d422c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.671453:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e62d422c/0x3234de053c52060 lrc: 2/0,0 mode: PW/PW res: [0x2b8f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.671463:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.671471:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.671478:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e62d422c/0x3234de053c52060 lrc: 3/0,0 mode: PW/PW res: [0x2b8f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.671486:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946508544 00000100:00100000:1.0:1651529344.671495:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211983 00000100:00100000:1.0:1651529344.671496:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1477:39029:x1731745946508544:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.671502:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178431 count 1 00010000:00010000:0.0:1651529344.671506:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e62d422c/0x3234de053c52060 lrc: 1/0,0 mode: --/PW res: [0x2b8f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671509:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e62d422c/0x3234de053c52060 lrc: 0/0,0 mode: --/PW res: [0x2b8f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671512:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b089e50b/0x3234de053c52091 lrc: 3/0,1 mode: --/PW res: [0x2b8ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671517:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009cc50b67/0x3234de053c4c8d2 lrc: 2/0,0 mode: PR/PR res: [0x2b8ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd4d4 expref: 587 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.671520:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.671520:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.671520:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bca72234 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997033472:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.671521:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b089e50b/0x3234de053c52091 lrc: 4/0,1 mode: --/PW res: [0x2b8ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671524:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000674569e9/0x3234de053c5207c lrc: 3/0,1 mode: --/PW res: [0x2b8fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671528:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009cc50b67/0x3234de053c4c8d2 lrc: 3/0,0 mode: PR/PR res: [0x2b8ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd4d4 expref: 587 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.671531:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009cc50b67/0x3234de053c4c8d2 lrc: 4/0,0 mode: PR/PR res: [0x2b8ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd4d4 expref: 587 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.671531:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000093ddaf92 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997033344:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.671533:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000daf880b4/0x3234de053c5206e lrc: 3/0,1 mode: --/PW res: [0x2b8fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.671535:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085af61db pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997033664:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.671539:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dff6a73d pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997033536:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.671544:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d09f5ee1 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.671551:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396389376 00010000:00010000:1.0:1651529344.671555:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f88ef7eb/0x3234de053c4f38f lrc: 4/0,0 mode: PR/PR res: [0x2b8fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80d9 expref: 588 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.671556:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fc44198a/0x3234de053c52083 lrc: 3/0,1 mode: --/PW res: [0x2b8fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.671566:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396389440 00010000:00010000:1.0:1651529344.671569:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005f4c8f7a/0x3234de053c4aa39 lrc: 5/0,0 mode: PR/PR res: [0x2b8fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd7a expref: 589 pid: 106695 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.671574:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396389504 00010000:00010000:1.0:1651529344.671576:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000029431276/0x3234de053c4e0d4 lrc: 4/0,0 mode: PR/PR res: [0x2b8fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d33ee expref: 590 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.671583:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12760 00000100:00100000:1.0:1651529344.671585:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+590:41278:x1731746396389376:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.671587:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.671588:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f88ef7eb/0x3234de053c4f38f lrc: 4/0,0 mode: PR/PR res: [0x2b8fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80d9 expref: 590 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.671590:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.671592:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f88ef7eb/0x3234de053c4f38f lrc: 3/0,0 mode: PR/PR res: [0x2b8fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80d9 expref: 590 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.671598:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f88ef7eb/0x3234de053c4f38f lrc: 0/0,0 mode: --/PR res: [0x2b8fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80d9 expref: 590 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.671601:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.671602:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.671603:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000daf880b4/0x3234de053c5206e lrc: 3/0,1 mode: PW/PW res: [0x2b8fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671606:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000daf880b4/0x3234de053c5206e lrc: 4/0,1 mode: PW/PW res: [0x2b8fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671621:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.671628:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+589:41278:x1731746396389376:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.671630:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12760 00000100:00100000:1.0:1651529344.671634:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396389568 00010000:00010000:1.0:1651529344.671638:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b5cb8adb/0x3234de053c4caa7 lrc: 4/0,0 mode: PR/PR res: [0x2b8fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc75 expref: 589 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.671642:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.671651:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12761 00000100:00100000:1.0:1651529344.671652:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+589:41279:x1731746396389440:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.671655:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.671656:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005f4c8f7a/0x3234de053c4aa39 lrc: 5/0,0 mode: PR/PR res: [0x2b8fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd7a expref: 589 pid: 106695 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.671660:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005f4c8f7a/0x3234de053c4aa39 lrc: 4/0,0 mode: PR/PR res: [0x2b8fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd7a expref: 589 pid: 106695 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.671670:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.671671:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.671671:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.671672:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000ba57bba/0x3234de053c52075 lrc: 3/0,1 mode: PW/PW res: [0x2b8fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671681:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ba57bba/0x3234de053c52075 lrc: 4/0,1 mode: PW/PW res: [0x2b8fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.671681:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.671686:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.671686:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000daf880b4/0x3234de053c5206e lrc: 3/0,1 mode: PW/PW res: [0x2b8fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.671696:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+589:41279:x1731746396389440:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 43us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.671699:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12761 00000100:00100000:1.0:1651529344.671703:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396389632 00010000:00010000:1.0:1651529344.671707:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002da3d5c2/0x3234de053c4a88e lrc: 5/0,0 mode: PR/PR res: [0x2b8fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbca8 expref: 589 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.671710:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000daf880b4/0x3234de053c5206e lrc: 3/0,1 mode: PW/PW res: [0x2b8fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.671714:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12762 00010000:00010000:0.0:1651529344.671715:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000daf880b4/0x3234de053c5206e lrc: 3/0,1 mode: PW/PW res: [0x2b8fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.671716:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+589:41278:x1731746396389504:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.671718:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.671718:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000daf880b4/0x3234de053c5206e lrc: 2/0,0 mode: PW/PW res: [0x2b8fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671719:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000029431276/0x3234de053c4e0d4 lrc: 4/0,0 mode: PR/PR res: [0x2b8fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d33ee expref: 589 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.671723:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000029431276/0x3234de053c4e0d4 lrc: 3/0,0 mode: PR/PR res: [0x2b8fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d33ee expref: 589 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.671727:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029431276/0x3234de053c4e0d4 lrc: 0/0,0 mode: --/PR res: [0x2b8fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d33ee expref: 589 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.671731:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.671732:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.671732:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000674569e9/0x3234de053c5207c lrc: 3/0,1 mode: PW/PW res: [0x2b8fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671744:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000674569e9/0x3234de053c5207c lrc: 4/0,1 mode: PW/PW res: [0x2b8fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671753:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.671759:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+588:41278:x1731746396389504:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.671761:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12762 00000100:00100000:1.0:1651529344.671765:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12763 00000100:00100000:1.0:1651529344.671767:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+587:41279:x1731746396389568:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.671769:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.671771:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b5cb8adb/0x3234de053c4caa7 lrc: 4/0,0 mode: PR/PR res: [0x2b8fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc75 expref: 587 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.671775:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b5cb8adb/0x3234de053c4caa7 lrc: 3/0,0 mode: PR/PR res: [0x2b8fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc75 expref: 587 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.671775:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1478:39030:x1731745946508032:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1232us (1383us total) trans 12885080033 rc 0/0 00000100:00100000:0.0:1651529344.671778:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211978 00010000:00010000:1.0:1651529344.671779:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5cb8adb/0x3234de053c4caa7 lrc: 0/0,0 mode: --/PR res: [0x2b8fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc75 expref: 587 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.671782:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.671783:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.671784:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fc44198a/0x3234de053c52083 lrc: 3/0,1 mode: PW/PW res: [0x2b8fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.671784:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946508928 00010000:00010000:1.0:1651529344.671787:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc44198a/0x3234de053c52083 lrc: 4/0,1 mode: PW/PW res: [0x2b8fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.671794:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946508992 00010000:00010000:1.0:1651529344.671802:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.671805:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211984 00000100:00100000:0.0:1651529344.671807:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1479:39030:x1731745946508928:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.671808:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+586:41279:x1731746396389568:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 40us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.671811:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12763 00002000:00080000:0.0:1651529344.671812:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178432 count 1 00000100:00100000:1.0:1651529344.671815:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12764 00000100:00100000:1.0:1651529344.671816:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000d49c4f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+585:41278:x1731746396389632:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.671819:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.671820:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002da3d5c2/0x3234de053c4a88e lrc: 5/0,0 mode: PR/PR res: [0x2b8fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbca8 expref: 585 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.671826:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002da3d5c2/0x3234de053c4a88e lrc: 4/0,0 mode: PR/PR res: [0x2b8fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbca8 expref: 585 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.671830:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ffd5f73/0x3234de053c52098 lrc: 3/0,1 mode: --/PW res: [0x2b900:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671831:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.671831:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.671832:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009fa75d86/0x3234de053c5208a lrc: 3/0,1 mode: PW/PW res: [0x2b8fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671835:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fa75d86/0x3234de053c5208a lrc: 4/0,1 mode: PW/PW res: [0x2b8fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671836:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000094d20ff5/0x3234de053c4d2b8 lrc: 2/0,0 mode: PR/PR res: [0x2b900:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfcdc expref: 585 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.671839:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.671839:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.671839:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.671840:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ffd5f73/0x3234de053c52098 lrc: 4/0,1 mode: --/PW res: [0x2b900:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.671843:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000d49c4f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+585:41278:x1731746396389632:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 26us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.671845:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12764 00010000:00010000:0.0:1651529344.671848:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000094d20ff5/0x3234de053c4d2b8 lrc: 3/0,0 mode: PR/PR res: [0x2b900:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfcdc expref: 584 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.671852:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000094d20ff5/0x3234de053c4d2b8 lrc: 4/0,0 mode: PR/PR res: [0x2b900:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfcdc expref: 584 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.671856:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211985 00000100:00100000:0.0:1651529344.671856:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a9e254e pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997033728:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.671858:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1479:39030:x1731745946508992:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.671862:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178433 count 1 00000100:00100000:0.0:1651529344.671865:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e68b7e1f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.671866:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0ad467d/0x3234de053c5209f lrc: 3/0,1 mode: --/PW res: [0x2b901:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671870:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004aa41b41/0x3234de053c4cfbd lrc: 2/0,0 mode: PR/PR res: [0x2b901:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf09c expref: 584 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.671870:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000daf880b4/0x3234de053c5206e lrc: 2/0,0 mode: PW/PW res: [0x2b8fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671873:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.671873:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000daf880b4 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.671874:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.671874:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0ad467d/0x3234de053c5209f lrc: 4/0,1 mode: --/PW res: [0x2b901:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671874:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000daf880b4/0x3234de053c5206e lrc: 2/0,0 mode: PW/PW res: [0x2b8fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671877:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000daf880b4/0x3234de053c5206e lrc: 3/0,0 mode: PW/PW res: [0x2b8fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671881:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004aa41b41/0x3234de053c4cfbd lrc: 3/0,0 mode: PR/PR res: [0x2b901:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf09c expref: 584 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.671882:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000daf880b4/0x3234de053c5206e lrc: 1/0,0 mode: --/PW res: [0x2b8fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671884:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000daf880b4/0x3234de053c5206e lrc: 0/0,0 mode: --/PW res: [0x2b8fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671885:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004aa41b41/0x3234de053c4cfbd lrc: 4/0,0 mode: PR/PR res: [0x2b901:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf09c expref: 584 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.671889:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b4acf60d pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997033792:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.671890:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000674569e9/0x3234de053c5207c lrc: 3/0,1 mode: PW/PW res: [0x2b8fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671893:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000674569e9/0x3234de053c5207c lrc: 3/0,1 mode: PW/PW res: [0x2b8fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.671896:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 0000000099c1da85 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.671896:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000674569e9/0x3234de053c5207c lrc: 3/0,1 mode: PW/PW res: [0x2b8fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671899:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000674569e9/0x3234de053c5207c lrc: 2/0,0 mode: PW/PW res: [0x2b8fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671906:0:106695:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f4c8f7a/0x3234de053c4aa39 lrc: 0/0,0 mode: --/PR res: [0x2b8fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd7a expref: 584 pid: 106695 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.671910:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003562cf4d pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997033408:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.671914:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000ba57bba/0x3234de053c52075 lrc: 3/0,1 mode: PW/PW res: [0x2b8fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671917:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000ba57bba/0x3234de053c52075 lrc: 3/0,1 mode: PW/PW res: [0x2b8fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671920:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ba57bba/0x3234de053c52075 lrc: 3/0,1 mode: PW/PW res: [0x2b8fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671923:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ba57bba/0x3234de053c52075 lrc: 3/0,1 mode: PW/PW res: [0x2b8fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.671928:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ba57bba/0x3234de053c52075 lrc: 2/0,0 mode: PW/PW res: [0x2b8fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.671960:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1481:39029:x1731745946508352:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 983us (1080us total) trans 12885080034 rc 0/0 00000100:00100000:0.0:1651529344.671963:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211980 00010000:00010000:0.0:1651529344.671971:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000674569e9/0x3234de053c5207c lrc: 2/0,0 mode: PW/PW res: [0x2b8fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.671972:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1480:39030:x1731745946508288:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1040us (1130us total) trans 12885080035 rc 0/0 00000100:00100000:1.0:1651529344.671975:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211979 00010000:00010000:0.0:1651529344.671975:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000674569e9 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.671976:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000674569e9/0x3234de053c5207c lrc: 2/0,0 mode: PW/PW res: [0x2b8fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671978:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000674569e9/0x3234de053c5207c lrc: 3/0,0 mode: PW/PW res: [0x2b8fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671983:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000674569e9/0x3234de053c5207c lrc: 1/0,0 mode: --/PW res: [0x2b8fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671986:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000674569e9/0x3234de053c5207c lrc: 0/0,0 mode: --/PW res: [0x2b8fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671990:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ba57bba/0x3234de053c52075 lrc: 2/0,0 mode: PW/PW res: [0x2b8fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671993:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000ba57bba already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.671994:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ba57bba/0x3234de053c52075 lrc: 2/0,0 mode: PW/PW res: [0x2b8fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.671997:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ba57bba/0x3234de053c52075 lrc: 3/0,0 mode: PW/PW res: [0x2b8fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672000:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ba57bba/0x3234de053c52075 lrc: 1/0,0 mode: --/PW res: [0x2b8fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672002:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ba57bba/0x3234de053c52075 lrc: 0/0,0 mode: --/PW res: [0x2b8fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672009:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fc44198a/0x3234de053c52083 lrc: 3/0,1 mode: PW/PW res: [0x2b8fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672012:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc44198a/0x3234de053c52083 lrc: 3/0,1 mode: PW/PW res: [0x2b8fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.672013:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.672015:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc44198a/0x3234de053c52083 lrc: 3/0,1 mode: PW/PW res: [0x2b8fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672017:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc44198a/0x3234de053c52083 lrc: 2/0,0 mode: PW/PW res: [0x2b8fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.672055:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1480:39030:x1731745946508416:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 967us (997us total) trans 12885080036 rc 0/0 00000100:00100000:0.0:1651529344.672058:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211981 00010000:00010000:0.0:1651529344.672064:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc44198a/0x3234de053c52083 lrc: 2/0,0 mode: PW/PW res: [0x2b8fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672068:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fc44198a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.672069:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc44198a/0x3234de053c52083 lrc: 2/0,0 mode: PW/PW res: [0x2b8fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672071:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc44198a/0x3234de053c52083 lrc: 3/0,0 mode: PW/PW res: [0x2b8fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672076:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc44198a/0x3234de053c52083 lrc: 1/0,0 mode: --/PW res: [0x2b8fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672078:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc44198a/0x3234de053c52083 lrc: 0/0,0 mode: --/PW res: [0x2b8fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672088:0:156655:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002da3d5c2/0x3234de053c4a88e lrc: 0/0,0 mode: --/PR res: [0x2b8fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbca8 expref: 583 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.672091:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000043b7984f pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997033600:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.672095:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009fa75d86/0x3234de053c5208a lrc: 3/0,1 mode: PW/PW res: [0x2b8fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.672109:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085af61db pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997033664:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.672113:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b089e50b/0x3234de053c52091 lrc: 3/0,1 mode: --/PW res: [0x2b8ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672119:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009fa75d86/0x3234de053c5208a lrc: 3/0,1 mode: PW/PW res: [0x2b8fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.672120:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396389696 00010000:00010000:0.0:1651529344.672122:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fa75d86/0x3234de053c5208a lrc: 3/0,1 mode: PW/PW res: [0x2b8fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.672125:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009cc50b67/0x3234de053c4c8d2 lrc: 4/0,0 mode: PR/PR res: [0x2b8ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd4d4 expref: 583 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.672125:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fa75d86/0x3234de053c5208a lrc: 3/0,1 mode: PW/PW res: [0x2b8fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672128:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009fa75d86/0x3234de053c5208a lrc: 2/0,0 mode: PW/PW res: [0x2b8fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.672132:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12765 00000100:00100000:1.0:1651529344.672134:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+583:41278:x1731746396389696:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.672136:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.672138:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009cc50b67/0x3234de053c4c8d2 lrc: 4/0,0 mode: PR/PR res: [0x2b8ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd4d4 expref: 583 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.672141:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009cc50b67/0x3234de053c4c8d2 lrc: 3/0,0 mode: PR/PR res: [0x2b8ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd4d4 expref: 583 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.672147:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009cc50b67/0x3234de053c4c8d2 lrc: 0/0,0 mode: --/PR res: [0x2b8ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd4d4 expref: 583 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.672151:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.672151:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.672152:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b089e50b/0x3234de053c52091 lrc: 3/0,1 mode: PW/PW res: [0x2b8ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.672155:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b089e50b/0x3234de053c52091 lrc: 4/0,1 mode: PW/PW res: [0x2b8ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.672161:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.672172:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1480:39030:x1731745946508480:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 789us (832us total) trans 12885080037 rc 0/0 00000100:00100000:0.0:1651529344.672175:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211982 00000100:00100000:1.0:1651529344.672176:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+582:41278:x1731746396389696:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 41us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.672178:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12765 00010000:00010000:0.0:1651529344.672182:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009fa75d86/0x3234de053c5208a lrc: 2/0,0 mode: PW/PW res: [0x2b8fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.672185:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b089e50b/0x3234de053c52091 lrc: 3/0,1 mode: PW/PW res: [0x2b8ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672185:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009fa75d86 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.672186:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009fa75d86/0x3234de053c5208a lrc: 2/0,0 mode: PW/PW res: [0x2b8fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.672188:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b089e50b/0x3234de053c52091 lrc: 3/0,1 mode: PW/PW res: [0x2b8ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672188:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009fa75d86/0x3234de053c5208a lrc: 3/0,0 mode: PW/PW res: [0x2b8fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.672191:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b089e50b/0x3234de053c52091 lrc: 3/0,1 mode: PW/PW res: [0x2b8ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672193:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009fa75d86/0x3234de053c5208a lrc: 1/0,0 mode: --/PW res: [0x2b8fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.672194:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b089e50b/0x3234de053c52091 lrc: 2/0,0 mode: PW/PW res: [0x2b8ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672196:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fa75d86/0x3234de053c5208a lrc: 0/0,0 mode: --/PW res: [0x2b8fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672200:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b089e50b/0x3234de053c52091 lrc: 3/0,0 mode: PW/PW res: [0x2b8ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672208:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b089e50b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.672209:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b089e50b/0x3234de053c52091 lrc: 2/0,0 mode: PW/PW res: [0x2b8ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.672251:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1480:39029:x1731745946508544:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 754us (849us total) trans 12885080038 rc 0/0 00010000:00010000:0.0:1651529344.672253:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b089e50b/0x3234de053c52091 lrc: 3/0,0 mode: PW/PW res: [0x2b8ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.672254:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211983 00010000:00010000:0.0:1651529344.672257:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b089e50b/0x3234de053c52091 lrc: 1/0,0 mode: --/PW res: [0x2b8ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672270:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b089e50b/0x3234de053c52091 lrc: 0/0,0 mode: --/PW res: [0x2b8ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.672288:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.672311:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.672322:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.672322:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946509248 00000100:00100000:1.0:1651529344.672331:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.672335:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946509312 00000100:00100000:0.0:1651529344.672339:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946509376 00000100:00100000:1.0:1651529344.672340:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946509440 00000100:00100000:0.0:1651529344.672347:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211986 00000100:00100000:0.0:1651529344.672348:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085af61db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1483:39029:x1731745946509248:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.672352:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211987 00000100:00100000:1.0:1651529344.672354:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1483:39030:x1731745946509312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.672354:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178434 count 1 00002000:00080000:1.0:1651529344.672359:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178435 count 1 00010000:00010000:0.0:1651529344.672359:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b6258e0/0x3234de053c520a6 lrc: 3/0,1 mode: --/PW res: [0x2b902:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672363:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004f03a05e/0x3234de053c4cb10 lrc: 2/0,0 mode: PR/PR res: [0x2b902:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cddbe expref: 581 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.672364:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e564c159/0x3234de053c520ad lrc: 3/0,1 mode: --/PW res: [0x2b903:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672367:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.672368:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.672368:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b6258e0/0x3234de053c520a6 lrc: 4/0,1 mode: --/PW res: [0x2b902:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.672369:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000c429a01/0x3234de053c4ee5d lrc: 2/0,0 mode: PR/PR res: [0x2b903:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b7e expref: 581 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.672372:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.672372:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.672373:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e564c159/0x3234de053c520ad lrc: 4/0,1 mode: --/PW res: [0x2b903:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672375:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004f03a05e/0x3234de053c4cb10 lrc: 3/0,0 mode: PR/PR res: [0x2b902:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cddbe expref: 581 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.672378:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004f03a05e/0x3234de053c4cb10 lrc: 4/0,0 mode: PR/PR res: [0x2b902:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cddbe expref: 581 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.672380:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000c429a01/0x3234de053c4ee5d lrc: 3/0,0 mode: PR/PR res: [0x2b903:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b7e expref: 581 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.672383:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000c429a01/0x3234de053c4ee5d lrc: 4/0,0 mode: PR/PR res: [0x2b903:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b7e expref: 581 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.672383:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000043b7984f pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997033856:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.672388:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006731397d pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997033920:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.672394:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 000000000a4def41 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.672396:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d09f5ee1 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.672400:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211988 00000100:00100000:0.0:1651529344.672402:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1483:39029:x1731745946509376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.672403:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211989 00000100:00100000:1.0:1651529344.672405:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1483:39030:x1731745946509440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.672409:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178437 count 1 00010000:00010000:1.0:1651529344.672412:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d483992/0x3234de053c520b4 lrc: 3/0,1 mode: --/PW res: [0x2b905:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.672416:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b820f514/0x3234de053c4cd2b lrc: 2/0,0 mode: PR/PR res: [0x2b905:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce69a expref: 581 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.672419:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.672419:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.672420:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d483992/0x3234de053c520b4 lrc: 4/0,1 mode: --/PW res: [0x2b905:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.672428:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178436 count 1 00010000:00010000:0.0:1651529344.672432:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053029ce7/0x3234de053c520bb lrc: 3/0,1 mode: --/PW res: [0x2b904:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.672433:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b820f514/0x3234de053c4cd2b lrc: 3/0,0 mode: PR/PR res: [0x2b905:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce69a expref: 581 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.672436:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005081a878/0x3234de053c4d63f lrc: 2/0,0 mode: PR/PR res: [0x2b904:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a8f expref: 581 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.672437:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b820f514/0x3234de053c4cd2b lrc: 4/0,0 mode: PR/PR res: [0x2b905:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce69a expref: 581 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.672440:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b0d9532a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997033984:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.672440:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.672440:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.672441:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053029ce7/0x3234de053c520bb lrc: 4/0,1 mode: --/PW res: [0x2b904:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.672447:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000499d0377 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.672448:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005081a878/0x3234de053c4d63f lrc: 3/0,0 mode: PR/PR res: [0x2b904:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a8f expref: 581 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.672451:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005081a878/0x3234de053c4d63f lrc: 4/0,0 mode: PR/PR res: [0x2b904:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a8f expref: 581 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.672455:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006aa45e66 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997034048:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.672460:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.672464:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000afe7ff7b going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.672470:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946509504 00000100:00100000:1.0:1651529344.672474:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.672486:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946509568 00000100:00100000:0.0:1651529344.672493:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211990 00000100:00100000:0.0:1651529344.672494:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1485:39029:x1731745946509504:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.672499:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178438 count 1 00010000:00010000:0.0:1651529344.672502:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051f06669/0x3234de053c520c2 lrc: 3/0,1 mode: --/PW res: [0x2b906:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672507:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c4cc21 lrc: 2/0,0 mode: PR/PR res: [0x2b906:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce25d expref: 581 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.672510:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.672510:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.672511:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051f06669/0x3234de053c520c2 lrc: 4/0,1 mode: --/PW res: [0x2b906:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672517:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c4cc21 lrc: 3/0,0 mode: PR/PR res: [0x2b906:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce25d expref: 581 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.672521:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c4cc21 lrc: 4/0,0 mode: PR/PR res: [0x2b906:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce25d expref: 581 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.672523:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211991 00000100:00100000:0.0:1651529344.672524:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000075b025a pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997034112:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.672525:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1485:39030:x1731745946509568:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.672530:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178439 count 1 00000100:00100000:0.0:1651529344.672536:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed830649 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.672540:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e8582de/0x3234de053c520c9 lrc: 3/0,1 mode: --/PW res: [0x2b907:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.672545:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ab41bcbd/0x3234de053c4cb8e lrc: 2/0,0 mode: PR/PR res: [0x2b907:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce018 expref: 581 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.672548:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.672549:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.672550:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e8582de/0x3234de053c520c9 lrc: 4/0,1 mode: --/PW res: [0x2b907:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.672556:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ab41bcbd/0x3234de053c4cb8e lrc: 3/0,0 mode: PR/PR res: [0x2b907:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce018 expref: 581 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.672559:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ab41bcbd/0x3234de053c4cb8e lrc: 4/0,0 mode: PR/PR res: [0x2b907:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce018 expref: 581 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.672563:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000de0edbdc pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997034176:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.672572:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 0000000053a0cffa going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.672628:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b4acf60d pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997033792:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.672632:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d0ad467d/0x3234de053c5209f lrc: 3/0,1 mode: --/PW res: [0x2b901:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.672642:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.672651:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.672660:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396390272 00010000:00010000:1.0:1651529344.672665:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000094d20ff5/0x3234de053c4d2b8 lrc: 5/0,0 mode: PR/PR res: [0x2b900:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfcdc expref: 582 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.672671:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a9e254e pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997033728:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.672672:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396390208 00010000:00010000:1.0:1651529344.672675:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004aa41b41/0x3234de053c4cfbd lrc: 4/0,0 mode: PR/PR res: [0x2b901:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf09c expref: 583 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.672675:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001ffd5f73/0x3234de053c52098 lrc: 3/0,1 mode: --/PW res: [0x2b900:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.672680:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12766 00000100:00100000:1.0:1651529344.672682:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+583:41279:x1731746396390272:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.672682:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000043b7984f pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997033856:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.672684:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001b6258e0/0x3234de053c520a6 lrc: 3/0,1 mode: --/PW res: [0x2b902:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.672685:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.672686:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000094d20ff5/0x3234de053c4d2b8 lrc: 4/0,0 mode: PR/PR res: [0x2b900:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfcdc expref: 583 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.672690:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000094d20ff5/0x3234de053c4d2b8 lrc: 3/0,0 mode: PR/PR res: [0x2b900:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfcdc expref: 583 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.672691:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12767 00000100:00100000:0.0:1651529344.672693:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+583:41278:x1731746396390208:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.672695:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094d20ff5/0x3234de053c4d2b8 lrc: 0/0,0 mode: --/PR res: [0x2b900:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfcdc expref: 583 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.672696:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.672698:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004aa41b41/0x3234de053c4cfbd lrc: 4/0,0 mode: PR/PR res: [0x2b901:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf09c expref: 583 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.672699:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.672699:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.672700:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001ffd5f73/0x3234de053c52098 lrc: 3/0,1 mode: PW/PW res: [0x2b900:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672701:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004aa41b41/0x3234de053c4cfbd lrc: 3/0,0 mode: PR/PR res: [0x2b901:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf09c expref: 582 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.672703:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ffd5f73/0x3234de053c52098 lrc: 4/0,1 mode: PW/PW res: [0x2b900:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672710:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004aa41b41/0x3234de053c4cfbd lrc: 0/0,0 mode: --/PR res: [0x2b901:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf09c expref: 582 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.672713:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.672721:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.672721:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.672722:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+581:41279:x1731746396390272:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 39us (93us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.672722:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d0ad467d/0x3234de053c5209f lrc: 3/0,1 mode: PW/PW res: [0x2b901:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.672724:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12766 00010000:00010000:0.0:1651529344.672725:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0ad467d/0x3234de053c5209f lrc: 4/0,1 mode: PW/PW res: [0x2b901:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672742:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.672750:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+580:41278:x1731746396390208:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 56us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.672752:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12767 00010000:00010000:0.0:1651529344.672761:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001ffd5f73/0x3234de053c52098 lrc: 3/0,1 mode: PW/PW res: [0x2b900:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672764:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ffd5f73/0x3234de053c52098 lrc: 3/0,1 mode: PW/PW res: [0x2b900:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672767:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ffd5f73/0x3234de053c52098 lrc: 3/0,1 mode: PW/PW res: [0x2b900:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672769:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ffd5f73/0x3234de053c52098 lrc: 2/0,0 mode: PW/PW res: [0x2b900:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.672792:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d0ad467d/0x3234de053c5209f lrc: 3/0,1 mode: PW/PW res: [0x2b901:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.672797:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0ad467d/0x3234de053c5209f lrc: 3/0,1 mode: PW/PW res: [0x2b901:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.672800:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0ad467d/0x3234de053c5209f lrc: 3/0,1 mode: PW/PW res: [0x2b901:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.672803:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0ad467d/0x3234de053c5209f lrc: 2/0,0 mode: PW/PW res: [0x2b901:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.672821:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1486:39030:x1731745946508928:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1013us (1179us total) trans 12885080039 rc 0/0 00000100:00100000:0.0:1651529344.672824:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211984 00010000:00010000:0.0:1651529344.672831:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ffd5f73/0x3234de053c52098 lrc: 2/0,0 mode: PW/PW res: [0x2b900:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672835:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001ffd5f73 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.672836:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ffd5f73/0x3234de053c52098 lrc: 2/0,0 mode: PW/PW res: [0x2b900:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672838:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ffd5f73/0x3234de053c52098 lrc: 3/0,0 mode: PW/PW res: [0x2b900:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672843:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ffd5f73/0x3234de053c52098 lrc: 1/0,0 mode: --/PW res: [0x2b900:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672846:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ffd5f73/0x3234de053c52098 lrc: 0/0,0 mode: --/PW res: [0x2b900:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.672847:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1486:39030:x1731745946508992:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 988us (1177us total) trans 12885080040 rc 0/0 00010000:00010000:0.0:1651529344.672849:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0ad467d/0x3234de053c5209f lrc: 2/0,0 mode: PW/PW res: [0x2b901:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.672850:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211985 00010000:00010000:0.0:1651529344.672852:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d0ad467d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.672853:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0ad467d/0x3234de053c5209f lrc: 2/0,0 mode: PW/PW res: [0x2b901:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672858:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0ad467d/0x3234de053c5209f lrc: 3/0,0 mode: PW/PW res: [0x2b901:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672862:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0ad467d/0x3234de053c5209f lrc: 1/0,0 mode: --/PW res: [0x2b901:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.672864:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0ad467d/0x3234de053c5209f lrc: 0/0,0 mode: --/PW res: [0x2b901:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.672963:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006aa45e66 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997034048:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.672965:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.672968:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000053029ce7/0x3234de053c520bb lrc: 3/0,1 mode: --/PW res: [0x2b904:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.672974:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.672980:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.672980:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000075b025a pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997034112:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.672982:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000051f06669/0x3234de053c520c2 lrc: 3/0,1 mode: --/PW res: [0x2b906:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.672987:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.672990:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396390400 00000100:00100000:1.0:1651529344.672993:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.672994:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004f03a05e/0x3234de053c4cb10 lrc: 4/0,0 mode: PR/PR res: [0x2b902:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cddbe expref: 580 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.673000:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396390592 00010000:00010000:0.0:1651529344.673002:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005081a878/0x3234de053c4d63f lrc: 4/0,0 mode: PR/PR res: [0x2b904:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a8f expref: 581 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.673006:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396390656 00000100:00100000:1.0:1651529344.673008:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.673009:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c4cc21 lrc: 4/0,0 mode: PR/PR res: [0x2b906:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce25d expref: 582 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.673013:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396390464 00010000:00010000:0.0:1651529344.673015:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000c429a01/0x3234de053c4ee5d lrc: 5/0,0 mode: PR/PR res: [0x2b903:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b7e expref: 583 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.673019:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396390528 00010000:00010000:0.0:1651529344.673021:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b820f514/0x3234de053c4cd2b lrc: 5/0,0 mode: PR/PR res: [0x2b905:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce69a expref: 584 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.673023:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006731397d pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997033920:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.673025:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12768 00000100:00100000:0.0:1651529344.673026:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+584:41279:x1731746396390400:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.673028:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e564c159/0x3234de053c520ad lrc: 3/0,1 mode: --/PW res: [0x2b903:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673029:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.673030:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004f03a05e/0x3234de053c4cb10 lrc: 4/0,0 mode: PR/PR res: [0x2b902:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cddbe expref: 584 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.673034:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b0d9532a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997033984:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.673034:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004f03a05e/0x3234de053c4cb10 lrc: 3/0,0 mode: PR/PR res: [0x2b902:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cddbe expref: 584 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.673037:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002d483992/0x3234de053c520b4 lrc: 3/0,1 mode: --/PW res: [0x2b905:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.673045:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000de0edbdc pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997034176:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.673047:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009e8582de/0x3234de053c520c9 lrc: 3/0,1 mode: --/PW res: [0x2b907:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.673053:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396390720 00010000:00010000:1.0:1651529344.673058:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ab41bcbd/0x3234de053c4cb8e lrc: 4/0,0 mode: PR/PR res: [0x2b907:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce018 expref: 585 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.673063:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12769 00000100:00100000:1.0:1651529344.673065:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+585:41279:x1731746396390592:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.673068:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.673069:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005081a878/0x3234de053c4d63f lrc: 4/0,0 mode: PR/PR res: [0x2b904:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a8f expref: 585 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.673073:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005081a878/0x3234de053c4d63f lrc: 3/0,0 mode: PR/PR res: [0x2b904:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a8f expref: 585 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.673078:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005081a878/0x3234de053c4d63f lrc: 0/0,0 mode: --/PR res: [0x2b904:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a8f expref: 585 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.673078:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f03a05e/0x3234de053c4cb10 lrc: 0/0,0 mode: --/PR res: [0x2b902:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cddbe expref: 585 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.673082:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.673083:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.673083:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000053029ce7/0x3234de053c520bb lrc: 3/0,1 mode: PW/PW res: [0x2b904:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673085:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.673086:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.673088:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001b6258e0/0x3234de053c520a6 lrc: 3/0,1 mode: PW/PW res: [0x2b902:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.673089:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053029ce7/0x3234de053c520bb lrc: 4/0,1 mode: PW/PW res: [0x2b904:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.673099:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.673105:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b6258e0/0x3234de053c520a6 lrc: 4/0,1 mode: PW/PW res: [0x2b902:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.673109:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+583:41279:x1731746396390592:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 43us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.673111:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12769 00010000:00010000:0.0:1651529344.673115:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.673116:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12770 00000100:00100000:1.0:1651529344.673117:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+582:41279:x1731746396390656:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.673120:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.673122:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c4cc21 lrc: 4/0,0 mode: PR/PR res: [0x2b906:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce25d expref: 582 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.673124:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+582:41279:x1731746396390400:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 97us (159us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.673125:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c4cc21 lrc: 3/0,0 mode: PR/PR res: [0x2b906:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce25d expref: 582 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.673128:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12768 00010000:00010000:1.0:1651529344.673130:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c4cc21 lrc: 0/0,0 mode: --/PR res: [0x2b906:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce25d expref: 582 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.673133:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.673134:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.673134:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12771 00010000:00010000:1.0:1651529344.673135:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000051f06669/0x3234de053c520c2 lrc: 3/0,1 mode: PW/PW res: [0x2b906:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.673136:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7bfdb64 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+580:41279:x1731746396390464:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.673138:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051f06669/0x3234de053c520c2 lrc: 4/0,1 mode: PW/PW res: [0x2b906:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673139:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.673140:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000c429a01/0x3234de053c4ee5d lrc: 4/0,0 mode: PR/PR res: [0x2b903:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b7e expref: 580 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.673144:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000c429a01/0x3234de053c4ee5d lrc: 3/0,0 mode: PR/PR res: [0x2b903:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b7e expref: 580 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.673148:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.673153:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+580:41279:x1731746396390656:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.673156:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12770 00010000:00010000:0.0:1651529344.673156:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c429a01/0x3234de053c4ee5d lrc: 0/0,0 mode: --/PR res: [0x2b903:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b7e expref: 580 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.673160:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12772 00010000:00010000:0.0:1651529344.673160:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.673161:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.673162:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+578:41279:x1731746396390528:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.673162:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e564c159/0x3234de053c520ad lrc: 3/0,1 mode: PW/PW res: [0x2b903:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.673164:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.673165:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e564c159/0x3234de053c520ad lrc: 4/0,1 mode: PW/PW res: [0x2b903:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.673166:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b820f514/0x3234de053c4cd2b lrc: 4/0,0 mode: PR/PR res: [0x2b905:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce69a expref: 578 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.673169:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b820f514/0x3234de053c4cd2b lrc: 3/0,0 mode: PR/PR res: [0x2b905:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce69a expref: 578 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.673174:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b820f514/0x3234de053c4cd2b lrc: 0/0,0 mode: --/PR res: [0x2b905:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce69a expref: 578 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.673177:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.673183:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7bfdb64 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+578:41279:x1731746396390464:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 47us (196us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.673184:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.673185:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.673185:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002d483992/0x3234de053c520b4 lrc: 3/0,1 mode: PW/PW res: [0x2b905:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.673186:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12771 00010000:00010000:1.0:1651529344.673188:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d483992/0x3234de053c520b4 lrc: 4/0,1 mode: PW/PW res: [0x2b905:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.673194:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.673195:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12773 00000100:00100000:0.0:1651529344.673197:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+576:41279:x1731746396390720:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.673199:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+576:41279:x1731746396390528:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 37us (206us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.673199:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.673201:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ab41bcbd/0x3234de053c4cb8e lrc: 4/0,0 mode: PR/PR res: [0x2b907:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce018 expref: 576 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.673202:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12772 00010000:00010000:0.0:1651529344.673205:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ab41bcbd/0x3234de053c4cb8e lrc: 3/0,0 mode: PR/PR res: [0x2b907:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce018 expref: 575 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.673209:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002d483992/0x3234de053c520b4 lrc: 3/0,1 mode: PW/PW res: [0x2b905:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673210:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab41bcbd/0x3234de053c4cb8e lrc: 0/0,0 mode: --/PR res: [0x2b907:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce018 expref: 575 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.673213:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d483992/0x3234de053c520b4 lrc: 3/0,1 mode: PW/PW res: [0x2b905:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673213:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.673214:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.673214:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009e8582de/0x3234de053c520c9 lrc: 3/0,1 mode: PW/PW res: [0x2b907:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.673216:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d483992/0x3234de053c520b4 lrc: 3/0,1 mode: PW/PW res: [0x2b905:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673217:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e8582de/0x3234de053c520c9 lrc: 4/0,1 mode: PW/PW res: [0x2b907:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.673218:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d483992/0x3234de053c520b4 lrc: 2/0,0 mode: PW/PW res: [0x2b905:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673244:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.673251:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+574:41279:x1731746396390720:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 53us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.673254:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12773 00010000:00010000:0.0:1651529344.673261:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d483992/0x3234de053c520b4 lrc: 2/0,0 mode: PW/PW res: [0x2b905:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673265:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002d483992 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.673266:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d483992/0x3234de053c520b4 lrc: 2/0,0 mode: PW/PW res: [0x2b905:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673269:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d483992/0x3234de053c520b4 lrc: 3/0,0 mode: PW/PW res: [0x2b905:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673273:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d483992/0x3234de053c520b4 lrc: 1/0,0 mode: --/PW res: [0x2b905:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673276:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d483992/0x3234de053c520b4 lrc: 0/0,0 mode: --/PW res: [0x2b905:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.673277:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1486:39030:x1731745946509440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 872us (945us total) trans 12885080041 rc 0/0 00000100:00100000:1.0:1651529344.673280:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211989 00010000:00010000:0.0:1651529344.673281:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000053029ce7/0x3234de053c520bb lrc: 3/0,1 mode: PW/PW res: [0x2b904:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673284:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053029ce7/0x3234de053c520bb lrc: 3/0,1 mode: PW/PW res: [0x2b904:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673287:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053029ce7/0x3234de053c520bb lrc: 3/0,1 mode: PW/PW res: [0x2b904:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.673290:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009e8582de/0x3234de053c520c9 lrc: 3/0,1 mode: PW/PW res: [0x2b907:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673290:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053029ce7/0x3234de053c520bb lrc: 2/0,0 mode: PW/PW res: [0x2b904:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.673293:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e8582de/0x3234de053c520c9 lrc: 3/0,1 mode: PW/PW res: [0x2b907:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.673296:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e8582de/0x3234de053c520c9 lrc: 3/0,1 mode: PW/PW res: [0x2b907:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.673299:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e8582de/0x3234de053c520c9 lrc: 2/0,0 mode: PW/PW res: [0x2b907:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.673338:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1487:39029:x1731745946509376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 935us (1016us total) trans 12885080042 rc 0/0 00000100:00100000:1.0:1651529344.673341:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1487:39030:x1731745946509568:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 816us (867us total) trans 12885080043 rc 0/0 00000100:00100000:0.0:1651529344.673341:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211988 00000100:00100000:1.0:1651529344.673344:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211991 00010000:00010000:0.0:1651529344.673348:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053029ce7/0x3234de053c520bb lrc: 2/0,0 mode: PW/PW res: [0x2b904:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.673351:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e564c159/0x3234de053c520ad lrc: 3/0,1 mode: PW/PW res: [0x2b903:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673352:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000053029ce7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.673353:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053029ce7/0x3234de053c520bb lrc: 2/0,0 mode: PW/PW res: [0x2b904:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.673354:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e564c159/0x3234de053c520ad lrc: 3/0,1 mode: PW/PW res: [0x2b903:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673355:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053029ce7/0x3234de053c520bb lrc: 3/0,0 mode: PW/PW res: [0x2b904:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.673357:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e564c159/0x3234de053c520ad lrc: 3/0,1 mode: PW/PW res: [0x2b903:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.673360:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e564c159/0x3234de053c520ad lrc: 2/0,0 mode: PW/PW res: [0x2b903:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673360:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053029ce7/0x3234de053c520bb lrc: 1/0,0 mode: --/PW res: [0x2b904:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673362:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053029ce7/0x3234de053c520bb lrc: 0/0,0 mode: --/PW res: [0x2b904:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673373:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e8582de/0x3234de053c520c9 lrc: 2/0,0 mode: PW/PW res: [0x2b907:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673376:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009e8582de already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.673377:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e8582de/0x3234de053c520c9 lrc: 2/0,0 mode: PW/PW res: [0x2b907:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673382:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e8582de/0x3234de053c520c9 lrc: 3/0,0 mode: PW/PW res: [0x2b907:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673386:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e8582de/0x3234de053c520c9 lrc: 1/0,0 mode: --/PW res: [0x2b907:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673388:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e8582de/0x3234de053c520c9 lrc: 0/0,0 mode: --/PW res: [0x2b907:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673392:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e564c159/0x3234de053c520ad lrc: 2/0,0 mode: PW/PW res: [0x2b903:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673394:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e564c159 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.673395:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1486:39030:x1731745946509312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1040us (1091us total) trans 12885080044 rc 0/0 00010000:00010000:0.0:1651529344.673395:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e564c159/0x3234de053c520ad lrc: 2/0,0 mode: PW/PW res: [0x2b903:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.673397:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211987 00010000:00010000:0.0:1651529344.673398:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e564c159/0x3234de053c520ad lrc: 3/0,0 mode: PW/PW res: [0x2b903:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673401:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e564c159/0x3234de053c520ad lrc: 1/0,0 mode: --/PW res: [0x2b903:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673403:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e564c159/0x3234de053c520ad lrc: 0/0,0 mode: --/PW res: [0x2b903:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673410:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000051f06669/0x3234de053c520c2 lrc: 3/0,1 mode: PW/PW res: [0x2b906:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673415:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051f06669/0x3234de053c520c2 lrc: 3/0,1 mode: PW/PW res: [0x2b906:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673418:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051f06669/0x3234de053c520c2 lrc: 3/0,1 mode: PW/PW res: [0x2b906:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673421:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051f06669/0x3234de053c520c2 lrc: 2/0,0 mode: PW/PW res: [0x2b906:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.673431:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.673446:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.673456:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1486:39029:x1731745946509504:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 961us (995us total) trans 12885080045 rc 0/0 00000100:00100000:0.0:1651529344.673459:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211990 00000100:00100000:0.0:1651529344.673464:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946509888 00000100:00100000:0.0:1651529344.673470:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946509952 00000100:00100000:0.0:1651529344.673479:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211992 00000100:00100000:0.0:1651529344.673480:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1487:39029:x1731745946509888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.673485:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178440 count 1 00010000:00010000:0.0:1651529344.673490:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaf12d4f/0x3234de053c520d0 lrc: 3/0,1 mode: --/PW res: [0x2b908:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673494:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004b467e4a/0x3234de053c4f174 lrc: 2/0,0 mode: PR/PR res: [0x2b908:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d785f expref: 573 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.673498:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.673498:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.673499:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eaf12d4f/0x3234de053c520d0 lrc: 4/0,1 mode: --/PW res: [0x2b908:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673506:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004b467e4a/0x3234de053c4f174 lrc: 3/0,0 mode: PR/PR res: [0x2b908:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d785f expref: 573 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.673513:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004b467e4a/0x3234de053c4f174 lrc: 4/0,0 mode: PR/PR res: [0x2b908:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d785f expref: 573 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.673517:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000093ddaf92 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997034240:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.673525:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000000a4def41 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.673530:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051f06669/0x3234de053c520c2 lrc: 2/0,0 mode: PW/PW res: [0x2b906:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673533:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000051f06669 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.673534:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051f06669/0x3234de053c520c2 lrc: 2/0,0 mode: PW/PW res: [0x2b906:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673537:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051f06669/0x3234de053c520c2 lrc: 3/0,0 mode: PW/PW res: [0x2b906:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.673555:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211993 00000100:00100000:1.0:1651529344.673557:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1487:39029:x1731745946509952:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.673559:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051f06669/0x3234de053c520c2 lrc: 1/0,0 mode: --/PW res: [0x2b906:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.673562:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178441 count 1 00010000:00010000:0.0:1651529344.673562:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051f06669/0x3234de053c520c2 lrc: 0/0,0 mode: --/PW res: [0x2b906:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.673567:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fa3afd1/0x3234de053c520d7 lrc: 3/0,1 mode: --/PW res: [0x2b909:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673570:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001b6258e0/0x3234de053c520a6 lrc: 3/0,1 mode: PW/PW res: [0x2b902:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.673574:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000019d35bd5/0x3234de053c4e692 lrc: 2/0,0 mode: PR/PR res: [0x2b909:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4ad8 expref: 573 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.673575:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b6258e0/0x3234de053c520a6 lrc: 3/0,1 mode: PW/PW res: [0x2b902:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.673577:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.673578:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.673578:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006fa3afd1/0x3234de053c520d7 lrc: 4/0,1 mode: --/PW res: [0x2b909:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.673585:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000019d35bd5/0x3234de053c4e692 lrc: 3/0,0 mode: PR/PR res: [0x2b909:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4ad8 expref: 573 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.673588:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000019d35bd5/0x3234de053c4e692 lrc: 4/0,0 mode: PR/PR res: [0x2b909:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4ad8 expref: 573 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.673590:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b6258e0/0x3234de053c520a6 lrc: 3/0,1 mode: PW/PW res: [0x2b902:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.673592:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000de0edbdc pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997034304:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.673603:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b7af823 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.673605:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b6258e0/0x3234de053c520a6 lrc: 2/0,0 mode: PW/PW res: [0x2b902:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.673617:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.673653:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.673660:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946510272 00000100:00100000:0.0:1651529344.673667:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085af61db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1489:39029:x1731745946509248:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1317us (1379us total) trans 12885080046 rc 0/0 00000100:00100000:0.0:1651529344.673670:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211986 00000100:00100000:1.0:1651529344.673675:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946510336 00000100:00100000:1.0:1651529344.673680:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211994 00000100:00100000:1.0:1651529344.673682:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1489:39030:x1731745946510272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.673683:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211995 00000100:00100000:0.0:1651529344.673684:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1489:39029:x1731745946510336:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.673687:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178442 count 1 00002000:00080000:0.0:1651529344.673689:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178443 count 1 00010000:00010000:1.0:1651529344.673692:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee811cd0/0x3234de053c520de lrc: 3/0,1 mode: --/PW res: [0x2b90a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673694:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c520e5 lrc: 3/0,1 mode: --/PW res: [0x2b90b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.673696:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000060baa91d/0x3234de053c4ee64 lrc: 2/0,0 mode: PR/PR res: [0x2b90a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b9a expref: 573 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.673699:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ebe82b2c/0x3234de053c4d910 lrc: 2/0,0 mode: PR/PR res: [0x2b90b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d152b expref: 573 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.673700:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.673700:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.673701:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee811cd0/0x3234de053c520de lrc: 4/0,1 mode: --/PW res: [0x2b90a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673702:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.673702:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.673703:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c520e5 lrc: 4/0,1 mode: --/PW res: [0x2b90b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.673707:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000060baa91d/0x3234de053c4ee64 lrc: 3/0,0 mode: PR/PR res: [0x2b90a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b9a expref: 573 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.673711:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000060baa91d/0x3234de053c4ee64 lrc: 4/0,0 mode: PR/PR res: [0x2b90a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b9a expref: 573 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.673715:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000027c41311 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997034368:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.673723:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000099c1da85 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.673726:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ebe82b2c/0x3234de053c4d910 lrc: 3/0,0 mode: PR/PR res: [0x2b90b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d152b expref: 573 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.673730:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ebe82b2c/0x3234de053c4d910 lrc: 4/0,0 mode: PR/PR res: [0x2b90b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d152b expref: 573 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.673743:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005a17dd72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997034432:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.673752:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 000000000e7e66c4 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.673757:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b6258e0/0x3234de053c520a6 lrc: 2/0,0 mode: PW/PW res: [0x2b902:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673761:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001b6258e0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.673762:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b6258e0/0x3234de053c520a6 lrc: 2/0,0 mode: PW/PW res: [0x2b902:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673764:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b6258e0/0x3234de053c520a6 lrc: 3/0,0 mode: PW/PW res: [0x2b902:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.673765:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.673784:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b6258e0/0x3234de053c520a6 lrc: 1/0,0 mode: --/PW res: [0x2b902:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673787:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b6258e0/0x3234de053c520a6 lrc: 0/0,0 mode: --/PW res: [0x2b902:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.673795:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.673795:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946510464 00000100:00100000:0.0:1651529344.673819:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946510400 00000100:00100000:0.0:1651529344.673828:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211996 00000100:00100000:0.0:1651529344.673830:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1491:39030:x1731745946510464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.673835:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178445 count 1 00010000:00010000:0.0:1651529344.673838:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c520ec lrc: 3/0,1 mode: --/PW res: [0x2b90d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673843:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001aaf4682/0x3234de053c4e59d lrc: 2/0,0 mode: PR/PR res: [0x2b90d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d47cf expref: 573 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.673846:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.673846:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.673847:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.673847:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c520ec lrc: 4/0,1 mode: --/PW res: [0x2b90d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673854:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001aaf4682/0x3234de053c4e59d lrc: 3/0,0 mode: PR/PR res: [0x2b90d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d47cf expref: 573 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.673857:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001aaf4682/0x3234de053c4e59d lrc: 4/0,0 mode: PR/PR res: [0x2b90d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d47cf expref: 573 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.673859:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946510528 00000100:00100000:0.0:1651529344.673861:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003562cf4d pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997034496:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.673867:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211997 00000100:00100000:1.0:1651529344.673868:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1492:39029:x1731745946510400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.673874:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 0000000049203969 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.673880:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178444 count 1 00000100:00100000:0.0:1651529344.673883:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000093ddaf92 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997034240:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.673884:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066a6b134/0x3234de053c520f3 lrc: 3/0,1 mode: --/PW res: [0x2b90c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.673889:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000031b5b294/0x3234de053c4db71 lrc: 2/0,0 mode: PR/PR res: [0x2b90c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1de4 expref: 573 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.673890:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eaf12d4f/0x3234de053c520d0 lrc: 3/0,1 mode: --/PW res: [0x2b908:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.673895:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.673895:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.673896:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066a6b134/0x3234de053c520f3 lrc: 4/0,1 mode: --/PW res: [0x2b90c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.673897:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211998 00010000:00010000:1.0:1651529344.673902:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000031b5b294/0x3234de053c4db71 lrc: 3/0,0 mode: PR/PR res: [0x2b90c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1de4 expref: 573 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.673906:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000031b5b294/0x3234de053c4db71 lrc: 4/0,0 mode: PR/PR res: [0x2b90c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1de4 expref: 573 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.673910:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a130088 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997034560:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.673915:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1492:39030:x1731745946510528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.673918:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 000000004ca54b8a going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.673920:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178446 count 1 00010000:00010000:0.0:1651529344.673923:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074951e29/0x3234de053c520fa lrc: 3/0,1 mode: --/PW res: [0x2b90e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.673928:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000de0edbdc pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997034304:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.673928:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd3b5813/0x3234de053c4e8c2 lrc: 2/0,0 mode: PR/PR res: [0x2b90e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d53c2 expref: 573 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.673931:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.673931:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.673932:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006fa3afd1/0x3234de053c520d7 lrc: 3/0,1 mode: --/PW res: [0x2b909:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673932:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074951e29/0x3234de053c520fa lrc: 4/0,1 mode: --/PW res: [0x2b90e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.673938:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fd3b5813/0x3234de053c4e8c2 lrc: 3/0,0 mode: PR/PR res: [0x2b90e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d53c2 expref: 573 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.673942:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fd3b5813/0x3234de053c4e8c2 lrc: 4/0,0 mode: PR/PR res: [0x2b90e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d53c2 expref: 573 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.673946:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.673946:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d9ef3c1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997034624:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.673954:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000000a4def41 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.673984:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946510592 00000100:00100000:1.0:1651529344.673992:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 211999 00000100:00100000:1.0:1651529344.673994:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005961f3ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1493:39030:x1731745946510592:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.673999:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178447 count 1 00010000:00010000:1.0:1651529344.674003:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1130404/0x3234de053c52101 lrc: 3/0,1 mode: --/PW res: [0x2b90f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.674010:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bbc2213d/0x3234de053c4c60f lrc: 2/0,0 mode: PR/PR res: [0x2b90f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca3f expref: 573 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.674013:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.674014:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.674014:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1130404/0x3234de053c52101 lrc: 4/0,1 mode: --/PW res: [0x2b90f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.674020:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bbc2213d/0x3234de053c4c60f lrc: 3/0,0 mode: PR/PR res: [0x2b90f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca3f expref: 573 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.674024:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bbc2213d/0x3234de053c4c60f lrc: 4/0,0 mode: PR/PR res: [0x2b90f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca3f expref: 573 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.674028:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005912c4a3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997034688:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.674042:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cfa1ca05 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.674291:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005a17dd72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997034432:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.674292:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.674301:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c520e5 lrc: 3/0,1 mode: --/PW res: [0x2b90b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.674302:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.674309:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.674310:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396391040 00010000:00010000:0.0:1651529344.674315:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004b467e4a/0x3234de053c4f174 lrc: 4/0,0 mode: PR/PR res: [0x2b908:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d785f expref: 574 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.674316:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.674321:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396391168 00010000:00010000:0.0:1651529344.674329:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000019d35bd5/0x3234de053c4e692 lrc: 4/0,0 mode: PR/PR res: [0x2b909:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4ad8 expref: 575 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.674338:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396391488 00000100:00100000:1.0:1651529344.674341:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000027c41311 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997034368:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.674341:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ebe82b2c/0x3234de053c4d910 lrc: 4/0,0 mode: PR/PR res: [0x2b90b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d152b expref: 576 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.674345:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ee811cd0/0x3234de053c520de lrc: 3/0,1 mode: --/PW res: [0x2b90a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.674345:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396391424 00010000:00010000:0.0:1651529344.674347:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000060baa91d/0x3234de053c4ee64 lrc: 4/0,0 mode: PR/PR res: [0x2b90a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b9a expref: 577 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.674352:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12774 00000100:00100000:0.0:1651529344.674353:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+577:41279:x1731746396391040:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.674354:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12775 00000100:00100000:1.0:1651529344.674356:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+577:41279:x1731746396391168:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.674356:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.674357:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004b467e4a/0x3234de053c4f174 lrc: 4/0,0 mode: PR/PR res: [0x2b908:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d785f expref: 577 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.674359:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.674361:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000019d35bd5/0x3234de053c4e692 lrc: 4/0,0 mode: PR/PR res: [0x2b909:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4ad8 expref: 577 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.674361:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004b467e4a/0x3234de053c4f174 lrc: 3/0,0 mode: PR/PR res: [0x2b908:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d785f expref: 577 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.674365:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000019d35bd5/0x3234de053c4e692 lrc: 3/0,0 mode: PR/PR res: [0x2b909:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4ad8 expref: 577 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.674367:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b467e4a/0x3234de053c4f174 lrc: 0/0,0 mode: --/PR res: [0x2b908:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d785f expref: 577 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.674370:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019d35bd5/0x3234de053c4e692 lrc: 0/0,0 mode: --/PR res: [0x2b909:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4ad8 expref: 576 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.674370:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.674371:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.674372:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eaf12d4f/0x3234de053c520d0 lrc: 3/0,1 mode: PW/PW res: [0x2b908:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.674374:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.674375:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.674375:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eaf12d4f/0x3234de053c520d0 lrc: 4/0,1 mode: PW/PW res: [0x2b908:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.674376:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006fa3afd1/0x3234de053c520d7 lrc: 3/0,1 mode: PW/PW res: [0x2b909:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.674379:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006fa3afd1/0x3234de053c520d7 lrc: 4/0,1 mode: PW/PW res: [0x2b909:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674382:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.674385:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.674390:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+575:41279:x1731746396391040:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.674392:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+575:41279:x1731746396391168:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 36us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.674393:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12774 00000100:00100000:1.0:1651529344.674395:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12775 00000100:00100000:1.0:1651529344.674434:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12776 00000100:00100000:1.0:1651529344.674436:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+573:41278:x1731746396391488:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.674437:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12777 00010000:00010000:1.0:1651529344.674439:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.674439:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+573:41279:x1731746396391424:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.674441:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ebe82b2c/0x3234de053c4d910 lrc: 4/0,0 mode: PR/PR res: [0x2b90b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d152b expref: 573 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.674442:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.674444:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000060baa91d/0x3234de053c4ee64 lrc: 4/0,0 mode: PR/PR res: [0x2b90a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b9a expref: 573 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.674447:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ebe82b2c/0x3234de053c4d910 lrc: 3/0,0 mode: PR/PR res: [0x2b90b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d152b expref: 573 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.674449:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000060baa91d/0x3234de053c4ee64 lrc: 3/0,0 mode: PR/PR res: [0x2b90a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b9a expref: 573 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.674452:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ebe82b2c/0x3234de053c4d910 lrc: 0/0,0 mode: --/PR res: [0x2b90b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d152b expref: 573 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.674454:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060baa91d/0x3234de053c4ee64 lrc: 0/0,0 mode: --/PR res: [0x2b90a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b9a expref: 573 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.674455:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.674456:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.674457:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c520e5 lrc: 3/0,1 mode: PW/PW res: [0x2b90b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674457:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.674458:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.674459:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee811cd0/0x3234de053c520de lrc: 3/0,1 mode: PW/PW res: [0x2b90a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.674460:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c520e5 lrc: 4/0,1 mode: PW/PW res: [0x2b90b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674464:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee811cd0/0x3234de053c520de lrc: 4/0,1 mode: PW/PW res: [0x2b90a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.674469:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.674474:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+571:41278:x1731746396391488:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 37us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.674477:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12776 00010000:00010000:0.0:1651529344.674480:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.674487:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+570:41279:x1731746396391424:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 48us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.674490:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12777 00000100:00100000:1.0:1651529344.674493:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a130088 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997034560:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.674497:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000066a6b134/0x3234de053c520f3 lrc: 3/0,1 mode: --/PW res: [0x2b90c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.674501:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003562cf4d pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997034496:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.674502:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006fa3afd1/0x3234de053c520d7 lrc: 3/0,1 mode: PW/PW res: [0x2b909:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674504:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c520ec lrc: 3/0,1 mode: --/PW res: [0x2b90d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.674505:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006fa3afd1/0x3234de053c520d7 lrc: 3/0,1 mode: PW/PW res: [0x2b909:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.674508:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fa3afd1/0x3234de053c520d7 lrc: 3/0,1 mode: PW/PW res: [0x2b909:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674509:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eaf12d4f/0x3234de053c520d0 lrc: 3/0,1 mode: PW/PW res: [0x2b908:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.674511:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006fa3afd1/0x3234de053c520d7 lrc: 2/0,0 mode: PW/PW res: [0x2b909:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674512:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eaf12d4f/0x3234de053c520d0 lrc: 3/0,1 mode: PW/PW res: [0x2b908:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674515:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaf12d4f/0x3234de053c520d0 lrc: 3/0,1 mode: PW/PW res: [0x2b908:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674524:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eaf12d4f/0x3234de053c520d0 lrc: 2/0,0 mode: PW/PW res: [0x2b908:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.674554:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1495:39029:x1731745946509952:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 996us (1108us total) trans 12885080047 rc 0/0 00000100:00100000:1.0:1651529344.674557:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211993 00010000:00010000:1.0:1651529344.674564:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ee811cd0/0x3234de053c520de lrc: 3/0,1 mode: PW/PW res: [0x2b90a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.674565:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1494:39029:x1731745946509888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1084us (1135us total) trans 12885080048 rc 0/0 00010000:00010000:1.0:1651529344.674567:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee811cd0/0x3234de053c520de lrc: 3/0,1 mode: PW/PW res: [0x2b90a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.674568:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211992 00010000:00010000:1.0:1651529344.674570:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee811cd0/0x3234de053c520de lrc: 3/0,1 mode: PW/PW res: [0x2b90a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.674573:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee811cd0/0x3234de053c520de lrc: 2/0,0 mode: PW/PW res: [0x2b90a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674576:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006fa3afd1/0x3234de053c520d7 lrc: 2/0,0 mode: PW/PW res: [0x2b909:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674586:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006fa3afd1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.674588:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006fa3afd1/0x3234de053c520d7 lrc: 2/0,0 mode: PW/PW res: [0x2b909:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674591:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006fa3afd1/0x3234de053c520d7 lrc: 3/0,0 mode: PW/PW res: [0x2b909:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674596:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006fa3afd1/0x3234de053c520d7 lrc: 1/0,0 mode: --/PW res: [0x2b909:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674598:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006fa3afd1/0x3234de053c520d7 lrc: 0/0,0 mode: --/PW res: [0x2b909:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674603:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eaf12d4f/0x3234de053c520d0 lrc: 2/0,0 mode: PW/PW res: [0x2b908:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674606:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eaf12d4f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.674607:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaf12d4f/0x3234de053c520d0 lrc: 2/0,0 mode: PW/PW res: [0x2b908:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674609:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaf12d4f/0x3234de053c520d0 lrc: 3/0,0 mode: PW/PW res: [0x2b908:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.674610:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1494:39030:x1731745946510272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 927us (992us total) trans 12885080049 rc 0/0 00010000:00010000:0.0:1651529344.674612:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eaf12d4f/0x3234de053c520d0 lrc: 1/0,0 mode: --/PW res: [0x2b908:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.674613:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211994 00010000:00010000:0.0:1651529344.674617:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eaf12d4f/0x3234de053c520d0 lrc: 0/0,0 mode: --/PW res: [0x2b908:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674620:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee811cd0/0x3234de053c520de lrc: 2/0,0 mode: PW/PW res: [0x2b90a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674623:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ee811cd0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.674624:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee811cd0/0x3234de053c520de lrc: 2/0,0 mode: PW/PW res: [0x2b90a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674626:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee811cd0/0x3234de053c520de lrc: 3/0,0 mode: PW/PW res: [0x2b90a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674629:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee811cd0/0x3234de053c520de lrc: 1/0,0 mode: --/PW res: [0x2b90a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674632:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee811cd0/0x3234de053c520de lrc: 0/0,0 mode: --/PW res: [0x2b90a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.674638:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.674647:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d9ef3c1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997034624:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.674650:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000074951e29/0x3234de053c520fa lrc: 3/0,1 mode: --/PW res: [0x2b90e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.674653:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.674655:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c520e5 lrc: 3/0,1 mode: PW/PW res: [0x2b90b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674661:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c520e5 lrc: 3/0,1 mode: PW/PW res: [0x2b90b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.674662:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.674664:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c520e5 lrc: 3/0,1 mode: PW/PW res: [0x2b90b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674666:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c520e5 lrc: 2/0,0 mode: PW/PW res: [0x2b90b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.674671:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.674702:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1494:39029:x1731745946510336:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1017us (1049us total) trans 12885080050 rc 0/0 00000100:00100000:0.0:1651529344.674705:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211995 00010000:00010000:0.0:1651529344.674711:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c520e5 lrc: 2/0,0 mode: PW/PW res: [0x2b90b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674715:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d766c581 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.674715:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c520e5 lrc: 2/0,0 mode: PW/PW res: [0x2b90b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674718:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c520e5 lrc: 3/0,0 mode: PW/PW res: [0x2b90b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674722:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c520e5 lrc: 1/0,0 mode: --/PW res: [0x2b90b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674725:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c520e5 lrc: 0/0,0 mode: --/PW res: [0x2b90b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.674729:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005912c4a3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997034688:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.674733:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d1130404/0x3234de053c52101 lrc: 3/0,1 mode: --/PW res: [0x2b90f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.674733:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396391616 00010000:00010000:0.0:1651529344.674748:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000031b5b294/0x3234de053c4db71 lrc: 4/0,0 mode: PR/PR res: [0x2b90c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1de4 expref: 570 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.674751:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396391744 00000100:00100000:0.0:1651529344.674753:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396391552 00010000:00010000:1.0:1651529344.674756:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bbc2213d/0x3234de053c4c60f lrc: 4/0,0 mode: PR/PR res: [0x2b90f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca3f expref: 572 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.674756:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001aaf4682/0x3234de053c4e59d lrc: 4/0,0 mode: PR/PR res: [0x2b90d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d47cf expref: 572 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.674760:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396391680 00000100:00100000:1.0:1651529344.674762:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12778 00010000:00010000:0.0:1651529344.674762:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fd3b5813/0x3234de053c4e8c2 lrc: 4/0,0 mode: PR/PR res: [0x2b90e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d53c2 expref: 573 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.674764:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031e6b9e0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+573:41278:x1731746396391616:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.674767:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.674768:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000031b5b294/0x3234de053c4db71 lrc: 4/0,0 mode: PR/PR res: [0x2b90c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1de4 expref: 573 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.674772:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000031b5b294/0x3234de053c4db71 lrc: 3/0,0 mode: PR/PR res: [0x2b90c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1de4 expref: 573 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.674777:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031b5b294/0x3234de053c4db71 lrc: 0/0,0 mode: --/PR res: [0x2b90c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1de4 expref: 573 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.674781:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.674781:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.674782:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000066a6b134/0x3234de053c520f3 lrc: 3/0,1 mode: PW/PW res: [0x2b90c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.674783:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12779 00000100:00100000:0.0:1651529344.674785:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+572:41279:x1731746396391552:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.674788:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066a6b134/0x3234de053c520f3 lrc: 4/0,1 mode: PW/PW res: [0x2b90c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674788:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.674789:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001aaf4682/0x3234de053c4e59d lrc: 4/0,0 mode: PR/PR res: [0x2b90d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d47cf expref: 572 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.674793:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001aaf4682/0x3234de053c4e59d lrc: 3/0,0 mode: PR/PR res: [0x2b90d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d47cf expref: 572 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.674794:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.674798:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001aaf4682/0x3234de053c4e59d lrc: 0/0,0 mode: --/PR res: [0x2b90d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d47cf expref: 572 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.674802:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031e6b9e0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+571:41278:x1731746396391616:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (165us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.674802:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.674803:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.674804:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c520ec lrc: 3/0,1 mode: PW/PW res: [0x2b90d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.674805:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12778 00010000:00010000:0.0:1651529344.674807:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c520ec lrc: 4/0,1 mode: PW/PW res: [0x2b90d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.674813:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12780 00010000:00010000:0.0:1651529344.674814:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.674815:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+570:41278:x1731746396391744:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.674817:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.674819:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bbc2213d/0x3234de053c4c60f lrc: 4/0,0 mode: PR/PR res: [0x2b90f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca3f expref: 570 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.674821:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+570:41279:x1731746396391552:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 36us (160us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.674822:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bbc2213d/0x3234de053c4c60f lrc: 3/0,0 mode: PR/PR res: [0x2b90f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca3f expref: 570 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.674824:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12779 00010000:00010000:1.0:1651529344.674827:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bbc2213d/0x3234de053c4c60f lrc: 0/0,0 mode: --/PR res: [0x2b90f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca3f expref: 569 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.674828:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12781 00000100:00100000:0.0:1651529344.674830:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+569:41279:x1731746396391680:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.674831:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.674831:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.674832:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d1130404/0x3234de053c52101 lrc: 3/0,1 mode: PW/PW res: [0x2b90f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674832:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.674834:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fd3b5813/0x3234de053c4e8c2 lrc: 4/0,0 mode: PR/PR res: [0x2b90e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d53c2 expref: 568 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.674835:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1130404/0x3234de053c52101 lrc: 4/0,1 mode: PW/PW res: [0x2b90f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674837:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fd3b5813/0x3234de053c4e8c2 lrc: 3/0,0 mode: PR/PR res: [0x2b90e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d53c2 expref: 568 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.674842:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.674842:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd3b5813/0x3234de053c4e8c2 lrc: 0/0,0 mode: --/PR res: [0x2b90e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d53c2 expref: 568 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.674845:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.674846:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.674846:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000074951e29/0x3234de053c520fa lrc: 3/0,1 mode: PW/PW res: [0x2b90e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.674847:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+567:41278:x1731746396391744:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.674850:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12780 00010000:00010000:0.0:1651529344.674852:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074951e29/0x3234de053c520fa lrc: 4/0,1 mode: PW/PW res: [0x2b90e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.674856:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000066a6b134/0x3234de053c520f3 lrc: 3/0,1 mode: PW/PW res: [0x2b90c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674857:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.674859:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066a6b134/0x3234de053c520f3 lrc: 3/0,1 mode: PW/PW res: [0x2b90c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.674862:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066a6b134/0x3234de053c520f3 lrc: 3/0,1 mode: PW/PW res: [0x2b90c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.674862:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+566:41279:x1731746396391680:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 31us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.674864:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12781 00010000:00010000:1.0:1651529344.674865:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066a6b134/0x3234de053c520f3 lrc: 2/0,0 mode: PW/PW res: [0x2b90c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674902:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c520ec lrc: 3/0,1 mode: PW/PW res: [0x2b90d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.674906:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1494:39029:x1731745946510400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1037us (1111us total) trans 12885080051 rc 0/0 00010000:00010000:0.0:1651529344.674906:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c520ec lrc: 3/0,1 mode: PW/PW res: [0x2b90d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.674909:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211997 00010000:00010000:0.0:1651529344.674910:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c520ec lrc: 3/0,1 mode: PW/PW res: [0x2b90d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674915:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c520ec lrc: 2/0,0 mode: PW/PW res: [0x2b90d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.674916:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d1130404/0x3234de053c52101 lrc: 3/0,1 mode: PW/PW res: [0x2b90f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.674919:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1130404/0x3234de053c52101 lrc: 3/0,1 mode: PW/PW res: [0x2b90f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.674922:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1130404/0x3234de053c52101 lrc: 3/0,1 mode: PW/PW res: [0x2b90f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.674925:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1130404/0x3234de053c52101 lrc: 2/0,0 mode: PW/PW res: [0x2b90f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.674962:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005961f3ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1495:39030:x1731745946510592:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 967us (1016us total) trans 12885080052 rc 0/0 00000100:00100000:1.0:1651529344.674965:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211999 00000100:00100000:0.0:1651529344.674982:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1494:39030:x1731745946510464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1151us (1217us total) trans 12885080053 rc 0/0 00000100:00100000:0.0:1651529344.674986:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211996 00010000:00010000:0.0:1651529344.674993:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000074951e29/0x3234de053c520fa lrc: 3/0,1 mode: PW/PW res: [0x2b90e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.674997:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074951e29/0x3234de053c520fa lrc: 3/0,1 mode: PW/PW res: [0x2b90e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.675000:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.675000:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074951e29/0x3234de053c520fa lrc: 3/0,1 mode: PW/PW res: [0x2b90e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.675003:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074951e29/0x3234de053c520fa lrc: 2/0,0 mode: PW/PW res: [0x2b90e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.675016:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.675027:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.675037:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.675052:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1494:39030:x1731745946510528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1136us (1206us total) trans 12885080054 rc 0/0 00000100:00100000:0.0:1651529344.675055:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 211998 00000100:00100000:0.0:1651529344.675072:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946510656 00000100:00100000:0.0:1651529344.675082:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946510720 00000100:00100000:0.0:1651529344.675087:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946510784 00000100:00100000:0.0:1651529344.675091:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946510848 00000100:00100000:0.0:1651529344.675097:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212000 00000100:00100000:0.0:1651529344.675099:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1497:39029:x1731745946510656:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.675104:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212001 00000100:00100000:1.0:1651529344.675106:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1497:39030:x1731745946510720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.675112:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178449 count 1 00010000:00010000:1.0:1651529344.675117:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3a98370/0x3234de053c52108 lrc: 3/0,1 mode: --/PW res: [0x2b911:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.675121:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178448 count 1 00010000:00010000:1.0:1651529344.675122:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007f321692/0x3234de053c4cdd3 lrc: 2/0,0 mode: PR/PR res: [0x2b911:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce8d8 expref: 565 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.675125:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.675125:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.675126:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3a98370/0x3234de053c52108 lrc: 4/0,1 mode: --/PW res: [0x2b911:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.675126:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a4fe8ca/0x3234de053c5210f lrc: 3/0,1 mode: --/PW res: [0x2b910:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.675131:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009a8f02cd/0x3234de053c4b7c2 lrc: 2/0,0 mode: PR/PR res: [0x2b910:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc38c expref: 565 pid: 80278 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.675133:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007f321692/0x3234de053c4cdd3 lrc: 3/0,0 mode: PR/PR res: [0x2b911:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce8d8 expref: 565 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.675134:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.675135:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.675136:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a4fe8ca/0x3234de053c5210f lrc: 4/0,1 mode: --/PW res: [0x2b910:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.675139:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007f321692/0x3234de053c4cdd3 lrc: 4/0,0 mode: PR/PR res: [0x2b911:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce8d8 expref: 565 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.675143:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007c534a1e pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997034752:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.675145:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009a8f02cd/0x3234de053c4b7c2 lrc: 3/0,0 mode: PR/PR res: [0x2b910:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc38c expref: 565 pid: 80278 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.675149:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009a8f02cd/0x3234de053c4b7c2 lrc: 4/0,0 mode: PR/PR res: [0x2b910:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc38c expref: 565 pid: 80278 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.675153:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f99b3c22 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997034816:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.675154:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b7af823 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.675159:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212002 00000100:00100000:1.0:1651529344.675161:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1497:39029:x1731745946510784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.675162:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000000e7e66c4 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.675165:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178450 count 1 00010000:00010000:1.0:1651529344.675168:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f80e4dc2/0x3234de053c52116 lrc: 3/0,1 mode: --/PW res: [0x2b912:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.675168:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066a6b134/0x3234de053c520f3 lrc: 2/0,0 mode: PW/PW res: [0x2b90c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.675171:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000066a6b134 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.675172:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f9bda1fb/0x3234de053c4d00a lrc: 2/0,0 mode: PR/PR res: [0x2b912:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf198 expref: 565 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.675172:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066a6b134/0x3234de053c520f3 lrc: 2/0,0 mode: PW/PW res: [0x2b90c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.675175:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.675175:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066a6b134/0x3234de053c520f3 lrc: 3/0,0 mode: PW/PW res: [0x2b90c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.675176:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.675176:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f80e4dc2/0x3234de053c52116 lrc: 4/0,1 mode: --/PW res: [0x2b912:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.675179:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066a6b134/0x3234de053c520f3 lrc: 1/0,0 mode: --/PW res: [0x2b90c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.675182:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f9bda1fb/0x3234de053c4d00a lrc: 3/0,0 mode: PR/PR res: [0x2b912:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf198 expref: 565 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.675182:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066a6b134/0x3234de053c520f3 lrc: 0/0,0 mode: --/PW res: [0x2b90c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.675186:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f9bda1fb/0x3234de053c4d00a lrc: 4/0,0 mode: PR/PR res: [0x2b912:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf198 expref: 565 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.675186:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c520ec lrc: 2/0,0 mode: PW/PW res: [0x2b90d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.675191:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004df22a54 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.675192:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c520ec lrc: 2/0,0 mode: PW/PW res: [0x2b90d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.675193:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000edfe60d3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997034880:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.675195:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c520ec lrc: 3/0,0 mode: PW/PW res: [0x2b90d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.675198:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c520ec lrc: 1/0,0 mode: --/PW res: [0x2b90d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.675199:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cfa1ca05 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.675200:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c520ec lrc: 0/0,0 mode: --/PW res: [0x2b90d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.675204:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212003 00010000:00010000:0.0:1651529344.675204:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1130404/0x3234de053c52101 lrc: 2/0,0 mode: PW/PW res: [0x2b90f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.675206:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1497:39030:x1731745946510848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.675206:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d1130404 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.675207:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1130404/0x3234de053c52101 lrc: 2/0,0 mode: PW/PW res: [0x2b90f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.675210:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178451 count 1 00010000:00010000:0.0:1651529344.675210:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1130404/0x3234de053c52101 lrc: 3/0,0 mode: PW/PW res: [0x2b90f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.675212:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b16f6b13/0x3234de053c5211d lrc: 3/0,1 mode: --/PW res: [0x2b913:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.675213:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1130404/0x3234de053c52101 lrc: 1/0,0 mode: --/PW res: [0x2b90f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.675216:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1130404/0x3234de053c52101 lrc: 0/0,0 mode: --/PW res: [0x2b90f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.675217:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ed7a068d/0x3234de053c4f437 lrc: 2/0,0 mode: PR/PR res: [0x2b913:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83aa expref: 565 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.675219:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074951e29/0x3234de053c520fa lrc: 2/0,0 mode: PW/PW res: [0x2b90e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.675220:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.675220:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.675221:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b16f6b13/0x3234de053c5211d lrc: 4/0,1 mode: --/PW res: [0x2b913:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.675238:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000074951e29 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.675239:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074951e29/0x3234de053c520fa lrc: 2/0,0 mode: PW/PW res: [0x2b90e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.675242:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074951e29/0x3234de053c520fa lrc: 3/0,0 mode: PW/PW res: [0x2b90e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.675244:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ed7a068d/0x3234de053c4f437 lrc: 3/0,0 mode: PR/PR res: [0x2b913:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83aa expref: 565 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.675245:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074951e29/0x3234de053c520fa lrc: 1/0,0 mode: --/PW res: [0x2b90e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.675248:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ed7a068d/0x3234de053c4f437 lrc: 4/0,0 mode: PR/PR res: [0x2b913:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83aa expref: 565 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.675248:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074951e29/0x3234de053c520fa lrc: 0/0,0 mode: --/PW res: [0x2b90e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.675251:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000054e3a257 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997034944:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.675258:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000499d0377 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.675296:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.675303:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.675311:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946511424 00000100:00100000:0.0:1651529344.675330:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.675340:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946511488 00000100:00100000:1.0:1651529344.675345:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946511552 00000100:00100000:1.0:1651529344.675350:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212004 00000100:00100000:1.0:1651529344.675352:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1500:39029:x1731745946511424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.675352:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529344.675362:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178452 count 1 00000100:00100000:0.0:1651529344.675362:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946511616 00010000:00010000:1.0:1651529344.675366:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2323f96/0x3234de053c52124 lrc: 3/0,1 mode: --/PW res: [0x2b914:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.675370:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212005 00010000:00010000:1.0:1651529344.675371:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000893c22d1/0x3234de053c4cdfd lrc: 2/0,0 mode: PR/PR res: [0x2b914:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce948 expref: 565 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.675372:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1501:39030:x1731745946511488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.675374:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.675375:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.675375:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2323f96/0x3234de053c52124 lrc: 4/0,1 mode: --/PW res: [0x2b914:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.675377:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178453 count 1 00010000:00010000:1.0:1651529344.675381:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000893c22d1/0x3234de053c4cdfd lrc: 3/0,0 mode: PR/PR res: [0x2b914:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce948 expref: 565 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.675381:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004eba1bc5/0x3234de053c5212b lrc: 3/0,1 mode: --/PW res: [0x2b915:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.675385:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000893c22d1/0x3234de053c4cdfd lrc: 4/0,0 mode: PR/PR res: [0x2b914:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce948 expref: 565 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.675386:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b30cefec/0x3234de053c4c823 lrc: 2/0,0 mode: PR/PR res: [0x2b915:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd2b2 expref: 565 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.675389:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e5997468 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997035008:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.675389:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.675390:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.675390:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004eba1bc5/0x3234de053c5212b lrc: 4/0,1 mode: --/PW res: [0x2b915:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.675397:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b30cefec/0x3234de053c4c823 lrc: 3/0,0 mode: PR/PR res: [0x2b915:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd2b2 expref: 565 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.675402:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fe434b1c going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.675407:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b30cefec/0x3234de053c4c823 lrc: 4/0,0 mode: PR/PR res: [0x2b915:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd2b2 expref: 565 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.675409:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212006 00000100:00100000:1.0:1651529344.675411:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1501:39029:x1731745946511552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.675416:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178454 count 1 00010000:00010000:1.0:1651529344.675419:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d11dbc49/0x3234de053c52132 lrc: 3/0,1 mode: --/PW res: [0x2b916:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.675423:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000188a95f4/0x3234de053c4d5f2 lrc: 2/0,0 mode: PR/PR res: [0x2b916:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d095b expref: 565 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.675425:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d9ef3c1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997035072:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.675426:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.675427:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.675427:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d11dbc49/0x3234de053c52132 lrc: 4/0,1 mode: --/PW res: [0x2b916:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.675433:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000188a95f4/0x3234de053c4d5f2 lrc: 3/0,0 mode: PR/PR res: [0x2b916:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d095b expref: 565 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.675435:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000000d706dff going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.675437:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000188a95f4/0x3234de053c4d5f2 lrc: 4/0,0 mode: PR/PR res: [0x2b916:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d095b expref: 565 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.675441:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085af61db pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997035136:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.675441:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212007 00000100:00100000:0.0:1651529344.675443:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1501:39030:x1731745946511616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.675447:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8a0b704 going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.675448:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178455 count 1 00010000:00010000:0.0:1651529344.675451:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000707bb969/0x3234de053c52139 lrc: 3/0,1 mode: --/PW res: [0x2b917:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.675456:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006c9c0f07/0x3234de053c4c3df lrc: 2/0,0 mode: PR/PR res: [0x2b917:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc943 expref: 565 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.675459:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.675459:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.675460:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000707bb969/0x3234de053c52139 lrc: 4/0,1 mode: --/PW res: [0x2b917:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.675469:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006c9c0f07/0x3234de053c4c3df lrc: 3/0,0 mode: PR/PR res: [0x2b917:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc943 expref: 565 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.675473:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006c9c0f07/0x3234de053c4c3df lrc: 4/0,0 mode: PR/PR res: [0x2b917:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc943 expref: 565 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.675476:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003562cf4d pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997035200:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.675504:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 000000003003c8b0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.675541:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007c534a1e pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997034752:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.675546:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e3a98370/0x3234de053c52108 lrc: 3/0,1 mode: --/PW res: [0x2b911:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.675731:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000edfe60d3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997034880:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.675743:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f80e4dc2/0x3234de053c52116 lrc: 3/0,1 mode: --/PW res: [0x2b912:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.675743:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.675753:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.675756:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000054e3a257 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997034944:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.675759:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b16f6b13/0x3234de053c5211d lrc: 3/0,1 mode: --/PW res: [0x2b913:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.675760:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.675769:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.675776:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396391936 00010000:00010000:1.0:1651529344.675786:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007f321692/0x3234de053c4cdd3 lrc: 4/0,0 mode: PR/PR res: [0x2b911:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce8d8 expref: 566 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.675787:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f99b3c22 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997034816:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.675791:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396392128 00010000:00010000:0.0:1651529344.675791:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003a4fe8ca/0x3234de053c5210f lrc: 3/0,1 mode: --/PW res: [0x2b910:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.675793:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ed7a068d/0x3234de053c4f437 lrc: 4/0,0 mode: PR/PR res: [0x2b913:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83aa expref: 567 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.675798:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396392000 00000100:00100000:0.0:1651529344.675799:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396392064 00010000:00010000:1.0:1651529344.675800:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009a8f02cd/0x3234de053c4b7c2 lrc: 4/0,0 mode: PR/PR res: [0x2b910:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc38c expref: 568 pid: 80278 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.675803:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f9bda1fb/0x3234de053c4d00a lrc: 4/0,0 mode: PR/PR res: [0x2b912:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf198 expref: 569 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.675804:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12782 00000100:00100000:1.0:1651529344.675806:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+569:41279:x1731746396391936:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.675809:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.675810:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007f321692/0x3234de053c4cdd3 lrc: 4/0,0 mode: PR/PR res: [0x2b911:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce8d8 expref: 569 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.675810:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12783 00000100:00100000:0.0:1651529344.675811:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+569:41279:x1731746396392128:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.675814:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007f321692/0x3234de053c4cdd3 lrc: 3/0,0 mode: PR/PR res: [0x2b911:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce8d8 expref: 569 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.675814:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.675816:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ed7a068d/0x3234de053c4f437 lrc: 4/0,0 mode: PR/PR res: [0x2b913:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83aa expref: 569 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.675822:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f321692/0x3234de053c4cdd3 lrc: 0/0,0 mode: --/PR res: [0x2b911:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce8d8 expref: 569 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.675826:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.675827:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.675827:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e3a98370/0x3234de053c52108 lrc: 3/0,1 mode: PW/PW res: [0x2b911:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.675830:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3a98370/0x3234de053c52108 lrc: 4/0,1 mode: PW/PW res: [0x2b911:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.675837:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ed7a068d/0x3234de053c4f437 lrc: 3/0,0 mode: PR/PR res: [0x2b913:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83aa expref: 568 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.675842:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.675843:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed7a068d/0x3234de053c4f437 lrc: 0/0,0 mode: --/PR res: [0x2b913:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83aa expref: 568 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.675847:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.675848:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.675849:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b16f6b13/0x3234de053c5211d lrc: 3/0,1 mode: PW/PW res: [0x2b913:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.675854:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+567:41279:x1731746396391936:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 47us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.675857:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12782 00010000:00010000:0.0:1651529344.675857:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b16f6b13/0x3234de053c5211d lrc: 4/0,1 mode: PW/PW res: [0x2b913:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.675862:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12784 00010000:00010000:0.0:1651529344.675866:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.675869:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+566:41278:x1731746396392000:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.675872:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.675873:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009a8f02cd/0x3234de053c4b7c2 lrc: 4/0,0 mode: PR/PR res: [0x2b910:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc38c expref: 566 pid: 80278 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.675877:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009a8f02cd/0x3234de053c4b7c2 lrc: 3/0,0 mode: PR/PR res: [0x2b910:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc38c expref: 566 pid: 80278 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.675882:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a8f02cd/0x3234de053c4b7c2 lrc: 0/0,0 mode: --/PR res: [0x2b910:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc38c expref: 566 pid: 80278 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.675885:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+566:41279:x1731746396392128:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 62us (120us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.675888:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.675888:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.675888:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12783 00010000:00010000:1.0:1651529344.675889:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003a4fe8ca/0x3234de053c5210f lrc: 3/0,1 mode: PW/PW res: [0x2b910:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.675892:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a4fe8ca/0x3234de053c5210f lrc: 4/0,1 mode: PW/PW res: [0x2b910:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.675894:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12785 00000100:00100000:0.0:1651529344.675895:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d17e32b2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+564:41278:x1731746396392064:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.675900:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.675904:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.675906:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+564:41278:x1731746396392000:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 41us (145us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.675906:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f9bda1fb/0x3234de053c4d00a lrc: 4/0,0 mode: PR/PR res: [0x2b912:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf198 expref: 564 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.675908:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12784 00010000:00010000:0.0:1651529344.675910:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f9bda1fb/0x3234de053c4d00a lrc: 3/0,0 mode: PR/PR res: [0x2b912:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf198 expref: 564 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.675916:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9bda1fb/0x3234de053c4d00a lrc: 0/0,0 mode: --/PR res: [0x2b912:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf198 expref: 563 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.675917:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b16f6b13/0x3234de053c5211d lrc: 3/0,1 mode: PW/PW res: [0x2b913:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.675919:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.675920:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b16f6b13/0x3234de053c5211d lrc: 3/0,1 mode: PW/PW res: [0x2b913:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.675920:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.675921:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f80e4dc2/0x3234de053c52116 lrc: 3/0,1 mode: PW/PW res: [0x2b912:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.675923:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b16f6b13/0x3234de053c5211d lrc: 3/0,1 mode: PW/PW res: [0x2b913:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.675924:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f80e4dc2/0x3234de053c52116 lrc: 4/0,1 mode: PW/PW res: [0x2b912:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.675925:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b16f6b13/0x3234de053c5211d lrc: 2/0,0 mode: PW/PW res: [0x2b913:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.675936:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.675943:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d17e32b2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+562:41278:x1731746396392064:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 47us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.675945:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12785 00010000:00010000:0.0:1651529344.675956:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b16f6b13/0x3234de053c5211d lrc: 2/0,0 mode: PW/PW res: [0x2b913:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.675960:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b16f6b13 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.675961:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b16f6b13/0x3234de053c5211d lrc: 2/0,0 mode: PW/PW res: [0x2b913:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.675964:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b16f6b13/0x3234de053c5211d lrc: 3/0,0 mode: PW/PW res: [0x2b913:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.675967:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b16f6b13/0x3234de053c5211d lrc: 1/0,0 mode: --/PW res: [0x2b913:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.675970:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1502:39030:x1731745946510848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 763us (933us total) trans 12885080055 rc 0/0 00000100:00100000:1.0:1651529344.675973:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212003 00010000:00010000:0.0:1651529344.675973:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b16f6b13/0x3234de053c5211d lrc: 0/0,0 mode: --/PW res: [0x2b913:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.675978:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003a4fe8ca/0x3234de053c5210f lrc: 3/0,1 mode: PW/PW res: [0x2b910:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.675980:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e3a98370/0x3234de053c52108 lrc: 3/0,1 mode: PW/PW res: [0x2b911:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.675981:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a4fe8ca/0x3234de053c5210f lrc: 3/0,1 mode: PW/PW res: [0x2b910:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.675983:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3a98370/0x3234de053c52108 lrc: 3/0,1 mode: PW/PW res: [0x2b911:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.675984:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a4fe8ca/0x3234de053c5210f lrc: 3/0,1 mode: PW/PW res: [0x2b910:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.675986:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3a98370/0x3234de053c52108 lrc: 3/0,1 mode: PW/PW res: [0x2b911:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.675987:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a4fe8ca/0x3234de053c5210f lrc: 2/0,0 mode: PW/PW res: [0x2b910:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.675989:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3a98370/0x3234de053c52108 lrc: 2/0,0 mode: PW/PW res: [0x2b911:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.676028:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1503:39030:x1731745946510720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 921us (1011us total) trans 12885080056 rc 0/0 00000100:00100000:1.0:1651529344.676031:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212001 00000100:00100000:0.0:1651529344.676034:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1502:39029:x1731745946510656:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 933us (1034us total) trans 12885080057 rc 0/0 00010000:00010000:1.0:1651529344.676037:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f80e4dc2/0x3234de053c52116 lrc: 3/0,1 mode: PW/PW res: [0x2b912:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.676037:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212000 00010000:00010000:1.0:1651529344.676041:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f80e4dc2/0x3234de053c52116 lrc: 3/0,1 mode: PW/PW res: [0x2b912:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676044:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f80e4dc2/0x3234de053c52116 lrc: 3/0,1 mode: PW/PW res: [0x2b912:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676044:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a4fe8ca/0x3234de053c5210f lrc: 2/0,0 mode: PW/PW res: [0x2b910:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676046:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f80e4dc2/0x3234de053c52116 lrc: 2/0,0 mode: PW/PW res: [0x2b912:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676047:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003a4fe8ca already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.676048:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a4fe8ca/0x3234de053c5210f lrc: 2/0,0 mode: PW/PW res: [0x2b910:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676051:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a4fe8ca/0x3234de053c5210f lrc: 3/0,0 mode: PW/PW res: [0x2b910:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676063:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a4fe8ca/0x3234de053c5210f lrc: 1/0,0 mode: --/PW res: [0x2b910:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676066:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a4fe8ca/0x3234de053c5210f lrc: 0/0,0 mode: --/PW res: [0x2b910:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676070:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3a98370/0x3234de053c52108 lrc: 2/0,0 mode: PW/PW res: [0x2b911:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676073:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e3a98370 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.676074:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3a98370/0x3234de053c52108 lrc: 2/0,0 mode: PW/PW res: [0x2b911:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676077:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3a98370/0x3234de053c52108 lrc: 3/0,0 mode: PW/PW res: [0x2b911:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676080:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3a98370/0x3234de053c52108 lrc: 1/0,0 mode: --/PW res: [0x2b911:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.676082:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1502:39029:x1731745946510784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 921us (1055us total) trans 12885080058 rc 0/0 00010000:00010000:0.0:1651529344.676082:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3a98370/0x3234de053c52108 lrc: 0/0,0 mode: --/PW res: [0x2b911:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.676085:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212002 00000100:00100000:1.0:1651529344.676095:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e5997468 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997035008:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.676098:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f80e4dc2/0x3234de053c52116 lrc: 2/0,0 mode: PW/PW res: [0x2b912:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676099:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f2323f96/0x3234de053c52124 lrc: 3/0,1 mode: --/PW res: [0x2b914:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676101:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f80e4dc2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.676102:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f80e4dc2/0x3234de053c52116 lrc: 2/0,0 mode: PW/PW res: [0x2b912:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676105:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f80e4dc2/0x3234de053c52116 lrc: 3/0,0 mode: PW/PW res: [0x2b912:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676109:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f80e4dc2/0x3234de053c52116 lrc: 1/0,0 mode: --/PW res: [0x2b912:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676112:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f80e4dc2/0x3234de053c52116 lrc: 0/0,0 mode: --/PW res: [0x2b912:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.676174:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d9ef3c1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997035072:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.676179:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004eba1bc5/0x3234de053c5212b lrc: 3/0,1 mode: --/PW res: [0x2b915:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.676185:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003562cf4d pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997035200:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.676188:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000707bb969/0x3234de053c52139 lrc: 3/0,1 mode: --/PW res: [0x2b917:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.676196:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.676203:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.676214:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085af61db pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997035136:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.676214:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.676235:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d11dbc49/0x3234de053c52132 lrc: 3/0,1 mode: --/PW res: [0x2b916:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.676243:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396392192 00010000:00010000:1.0:1651529344.676248:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000893c22d1/0x3234de053c4cdfd lrc: 4/0,0 mode: PR/PR res: [0x2b914:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce948 expref: 562 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.676254:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396392320 00000100:00100000:0.0:1651529344.676256:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.676257:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b30cefec/0x3234de053c4c823 lrc: 4/0,0 mode: PR/PR res: [0x2b915:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd2b2 expref: 563 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.676261:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396392448 00010000:00010000:1.0:1651529344.676263:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000188a95f4/0x3234de053c4d5f2 lrc: 4/0,0 mode: PR/PR res: [0x2b916:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d095b expref: 564 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.676263:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396392576 00000100:00100000:1.0:1651529344.676268:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12786 00000100:00100000:1.0:1651529344.676269:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+565:41279:x1731746396392192:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.676269:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006c9c0f07/0x3234de053c4c3df lrc: 4/0,0 mode: PR/PR res: [0x2b917:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc943 expref: 565 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.676272:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.676273:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000893c22d1/0x3234de053c4cdfd lrc: 4/0,0 mode: PR/PR res: [0x2b914:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce948 expref: 565 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.676275:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12787 00010000:00010000:1.0:1651529344.676277:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000893c22d1/0x3234de053c4cdfd lrc: 3/0,0 mode: PR/PR res: [0x2b914:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce948 expref: 565 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.676277:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+565:41279:x1731746396392320:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.676280:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.676282:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000893c22d1/0x3234de053c4cdfd lrc: 0/0,0 mode: --/PR res: [0x2b914:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce948 expref: 565 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.676282:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b30cefec/0x3234de053c4c823 lrc: 4/0,0 mode: PR/PR res: [0x2b915:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd2b2 expref: 565 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.676285:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b30cefec/0x3234de053c4c823 lrc: 3/0,0 mode: PR/PR res: [0x2b915:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd2b2 expref: 564 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.676286:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.676286:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.676287:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f2323f96/0x3234de053c52124 lrc: 3/0,1 mode: PW/PW res: [0x2b914:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676290:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2323f96/0x3234de053c52124 lrc: 4/0,1 mode: PW/PW res: [0x2b914:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676291:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b30cefec/0x3234de053c4c823 lrc: 0/0,0 mode: --/PR res: [0x2b915:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd2b2 expref: 564 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.676294:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.676295:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.676295:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004eba1bc5/0x3234de053c5212b lrc: 3/0,1 mode: PW/PW res: [0x2b915:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676296:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.676298:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004eba1bc5/0x3234de053c5212b lrc: 4/0,1 mode: PW/PW res: [0x2b915:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.676304:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+563:41279:x1731746396392192:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 34us (108us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.676305:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.676307:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12786 00000100:00100000:1.0:1651529344.676311:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12788 00000100:00100000:1.0:1651529344.676312:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+562:41279:x1731746396392448:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.676312:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+562:41279:x1731746396392320:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 34us (109us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.676314:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.676314:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12787 00010000:00010000:1.0:1651529344.676316:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000188a95f4/0x3234de053c4d5f2 lrc: 4/0,0 mode: PR/PR res: [0x2b916:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d095b expref: 562 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.676319:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000188a95f4/0x3234de053c4d5f2 lrc: 3/0,0 mode: PR/PR res: [0x2b916:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d095b expref: 561 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.676319:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12789 00000100:00100000:0.0:1651529344.676321:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+561:41279:x1731746396392576:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.676323:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.676324:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000188a95f4/0x3234de053c4d5f2 lrc: 0/0,0 mode: --/PR res: [0x2b916:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d095b expref: 561 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.676324:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006c9c0f07/0x3234de053c4c3df lrc: 4/0,0 mode: PR/PR res: [0x2b917:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc943 expref: 561 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.676328:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.676328:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.676328:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006c9c0f07/0x3234de053c4c3df lrc: 3/0,0 mode: PR/PR res: [0x2b917:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc943 expref: 560 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.676329:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d11dbc49/0x3234de053c52132 lrc: 3/0,1 mode: PW/PW res: [0x2b916:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676332:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d11dbc49/0x3234de053c52132 lrc: 4/0,1 mode: PW/PW res: [0x2b916:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676333:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c9c0f07/0x3234de053c4c3df lrc: 0/0,0 mode: --/PR res: [0x2b917:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc943 expref: 560 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.676336:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.676336:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.676337:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.676337:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000707bb969/0x3234de053c52139 lrc: 3/0,1 mode: PW/PW res: [0x2b917:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.676341:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+559:41279:x1731746396392448:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 28us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.676344:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12788 00010000:00010000:1.0:1651529344.676349:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f2323f96/0x3234de053c52124 lrc: 3/0,1 mode: PW/PW res: [0x2b914:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676352:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2323f96/0x3234de053c52124 lrc: 3/0,1 mode: PW/PW res: [0x2b914:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676355:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2323f96/0x3234de053c52124 lrc: 3/0,1 mode: PW/PW res: [0x2b914:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676358:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2323f96/0x3234de053c52124 lrc: 2/0,0 mode: PW/PW res: [0x2b914:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676358:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000707bb969/0x3234de053c52139 lrc: 4/0,1 mode: PW/PW res: [0x2b917:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676364:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.676385:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+558:41279:x1731746396392576:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 64us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.676388:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12789 00010000:00010000:0.0:1651529344.676395:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004eba1bc5/0x3234de053c5212b lrc: 3/0,1 mode: PW/PW res: [0x2b915:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676399:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004eba1bc5/0x3234de053c5212b lrc: 3/0,1 mode: PW/PW res: [0x2b915:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.676401:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1502:39029:x1731745946511424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1048us (1105us total) trans 12885080059 rc 0/0 00010000:00010000:0.0:1651529344.676402:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004eba1bc5/0x3234de053c5212b lrc: 3/0,1 mode: PW/PW res: [0x2b915:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.676404:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212004 00010000:00010000:0.0:1651529344.676407:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004eba1bc5/0x3234de053c5212b lrc: 2/0,0 mode: PW/PW res: [0x2b915:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676411:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d11dbc49/0x3234de053c52132 lrc: 3/0,1 mode: PW/PW res: [0x2b916:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676414:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d11dbc49/0x3234de053c52132 lrc: 3/0,1 mode: PW/PW res: [0x2b916:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676417:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d11dbc49/0x3234de053c52132 lrc: 3/0,1 mode: PW/PW res: [0x2b916:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676420:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d11dbc49/0x3234de053c52132 lrc: 2/0,0 mode: PW/PW res: [0x2b916:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.676456:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1503:39030:x1731745946511488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1083us (1152us total) trans 12885080060 rc 0/0 00000100:00100000:1.0:1651529344.676458:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1503:39029:x1731745946511552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1047us (1128us total) trans 12885080061 rc 0/0 00000100:00100000:0.0:1651529344.676459:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212005 00000100:00100000:1.0:1651529344.676461:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212006 00010000:00010000:0.0:1651529344.676466:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000707bb969/0x3234de053c52139 lrc: 3/0,1 mode: PW/PW res: [0x2b917:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676469:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000707bb969/0x3234de053c52139 lrc: 3/0,1 mode: PW/PW res: [0x2b917:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676472:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000707bb969/0x3234de053c52139 lrc: 3/0,1 mode: PW/PW res: [0x2b917:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676475:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000707bb969/0x3234de053c52139 lrc: 2/0,0 mode: PW/PW res: [0x2b917:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.676496:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.676505:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1502:39030:x1731745946511616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1061us (1153us total) trans 12885080062 rc 0/0 00000100:00100000:0.0:1651529344.676508:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212007 00000100:00100000:1.0:1651529344.676510:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.676522:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946511872 00000100:00100000:1.0:1651529344.676525:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.676537:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946511808 00000100:00100000:0.0:1651529344.676541:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946512000 00000100:00100000:0.0:1651529344.676547:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212008 00000100:00100000:0.0:1651529344.676548:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085af61db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1504:39030:x1731745946511872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.676550:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.676554:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178457 count 1 00010000:00010000:0.0:1651529344.676558:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054dd6f57/0x3234de053c52140 lrc: 3/0,1 mode: --/PW res: [0x2b919:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676562:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000587ad665/0x3234de053c4ebee lrc: 2/0,0 mode: PR/PR res: [0x2b919:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d614b expref: 557 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.676565:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.676566:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.676567:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054dd6f57/0x3234de053c52140 lrc: 4/0,1 mode: --/PW res: [0x2b919:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676574:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000587ad665/0x3234de053c4ebee lrc: 3/0,0 mode: PR/PR res: [0x2b919:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d614b expref: 557 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.676578:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000587ad665/0x3234de053c4ebee lrc: 4/0,0 mode: PR/PR res: [0x2b919:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d614b expref: 557 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.676582:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004972eb27 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997035264:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.676591:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed830649 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.676596:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2323f96/0x3234de053c52124 lrc: 2/0,0 mode: PW/PW res: [0x2b914:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676599:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f2323f96 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.676600:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2323f96/0x3234de053c52124 lrc: 2/0,0 mode: PW/PW res: [0x2b914:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676603:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2323f96/0x3234de053c52124 lrc: 3/0,0 mode: PW/PW res: [0x2b914:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676608:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2323f96/0x3234de053c52124 lrc: 1/0,0 mode: --/PW res: [0x2b914:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676611:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2323f96/0x3234de053c52124 lrc: 0/0,0 mode: --/PW res: [0x2b914:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676615:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004eba1bc5/0x3234de053c5212b lrc: 2/0,0 mode: PW/PW res: [0x2b915:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676617:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004eba1bc5 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.676618:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004eba1bc5/0x3234de053c5212b lrc: 2/0,0 mode: PW/PW res: [0x2b915:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676621:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004eba1bc5/0x3234de053c5212b lrc: 3/0,0 mode: PW/PW res: [0x2b915:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676624:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004eba1bc5/0x3234de053c5212b lrc: 1/0,0 mode: --/PW res: [0x2b915:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676626:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004eba1bc5/0x3234de053c5212b lrc: 0/0,0 mode: --/PW res: [0x2b915:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.676627:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946511936 00010000:00010000:0.0:1651529344.676630:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d11dbc49/0x3234de053c52132 lrc: 2/0,0 mode: PW/PW res: [0x2b916:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.676638:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212009 00000100:00100000:1.0:1651529344.676640:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1505:39029:x1731745946511808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.676646:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178456 count 1 00010000:00010000:1.0:1651529344.676651:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5eb030a/0x3234de053c52147 lrc: 3/0,1 mode: --/PW res: [0x2b918:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676656:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005811f6f2/0x3234de053c4d202 lrc: 2/0,0 mode: PR/PR res: [0x2b918:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf9d3 expref: 557 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.676657:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d11dbc49 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.676658:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d11dbc49/0x3234de053c52132 lrc: 2/0,0 mode: PW/PW res: [0x2b916:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676659:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.676659:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.676660:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5eb030a/0x3234de053c52147 lrc: 4/0,1 mode: --/PW res: [0x2b918:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676662:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d11dbc49/0x3234de053c52132 lrc: 3/0,0 mode: PW/PW res: [0x2b916:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676666:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005811f6f2/0x3234de053c4d202 lrc: 3/0,0 mode: PR/PR res: [0x2b918:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf9d3 expref: 557 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.676666:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d11dbc49/0x3234de053c52132 lrc: 1/0,0 mode: --/PW res: [0x2b916:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676668:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d11dbc49/0x3234de053c52132 lrc: 0/0,0 mode: --/PW res: [0x2b916:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676670:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005811f6f2/0x3234de053c4d202 lrc: 4/0,0 mode: PR/PR res: [0x2b918:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf9d3 expref: 557 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.676673:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000707bb969/0x3234de053c52139 lrc: 2/0,0 mode: PW/PW res: [0x2b917:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.676674:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b4acf60d pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997035328:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.676675:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000707bb969 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.676676:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000707bb969/0x3234de053c52139 lrc: 2/0,0 mode: PW/PW res: [0x2b917:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676679:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000707bb969/0x3234de053c52139 lrc: 3/0,0 mode: PW/PW res: [0x2b917:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676682:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000707bb969/0x3234de053c52139 lrc: 1/0,0 mode: --/PW res: [0x2b917:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676684:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000707bb969/0x3234de053c52139 lrc: 0/0,0 mode: --/PW res: [0x2b917:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.676685:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 000000004ca54b8a going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.676691:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212010 00000100:00100000:1.0:1651529344.676693:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1505:39030:x1731745946512000:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.676694:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212011 00000100:00100000:0.0:1651529344.676696:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1505:39029:x1731745946511936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.676697:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178459 count 1 00010000:00010000:1.0:1651529344.676700:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c5214e lrc: 3/0,1 mode: --/PW res: [0x2b91b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.676702:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178458 count 1 00010000:00010000:1.0:1651529344.676704:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f0fce722/0x3234de053c4acee lrc: 2/0,0 mode: PR/PR res: [0x2b91b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbec3 expref: 557 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.676705:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c52155 lrc: 3/0,1 mode: --/PW res: [0x2b91a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676708:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.676708:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.676709:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c5214e lrc: 4/0,1 mode: --/PW res: [0x2b91b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676709:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c4cf3f lrc: 2/0,0 mode: PR/PR res: [0x2b91a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceece expref: 557 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.676712:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.676712:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.676713:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c52155 lrc: 4/0,1 mode: --/PW res: [0x2b91a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676715:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f0fce722/0x3234de053c4acee lrc: 3/0,0 mode: PR/PR res: [0x2b91b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbec3 expref: 557 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.676718:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f0fce722/0x3234de053c4acee lrc: 4/0,0 mode: PR/PR res: [0x2b91b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbec3 expref: 557 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.676720:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c4cf3f lrc: 3/0,0 mode: PR/PR res: [0x2b91a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceece expref: 557 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.676722:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002a1f5cf2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997035392:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.676724:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c4cf3f lrc: 4/0,0 mode: PR/PR res: [0x2b91a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceece expref: 557 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.676727:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003562cf4d pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997035456:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.676728:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b7af823 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.676746:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000000e7e66c4 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.676796:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.676817:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.676838:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.676849:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946512064 00000100:00100000:0.0:1651529344.676849:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.676859:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946512192 00000100:00100000:1.0:1651529344.676860:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946512128 00000100:00100000:0.0:1651529344.676866:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946512256 00000100:00100000:1.0:1651529344.676867:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212012 00000100:00100000:1.0:1651529344.676869:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1509:39029:x1731745946512064:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.676874:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212013 00000100:00100000:0.0:1651529344.676875:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1509:39029:x1731745946512192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.676879:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178460 count 1 00010000:00010000:1.0:1651529344.676883:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a562d62/0x3234de053c5215c lrc: 3/0,1 mode: --/PW res: [0x2b91c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676888:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000005dc20d5/0x3234de053c4db40 lrc: 2/0,0 mode: PR/PR res: [0x2b91c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d20 expref: 557 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.676896:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178462 count 1 00010000:00010000:1.0:1651529344.676897:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.676897:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.676898:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a562d62/0x3234de053c5215c lrc: 4/0,1 mode: --/PW res: [0x2b91c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676901:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c52163 lrc: 3/0,1 mode: --/PW res: [0x2b91e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676905:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000005dc20d5/0x3234de053c4db40 lrc: 3/0,0 mode: PR/PR res: [0x2b91c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d20 expref: 557 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.676906:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fc3a3cef/0x3234de053c4f5f0 lrc: 2/0,0 mode: PR/PR res: [0x2b91e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a1e expref: 557 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.676909:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000005dc20d5/0x3234de053c4db40 lrc: 4/0,0 mode: PR/PR res: [0x2b91c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d20 expref: 557 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.676913:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b0d9532a pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997035520:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.676919:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.676920:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.676920:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c52163 lrc: 4/0,1 mode: --/PW res: [0x2b91e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.676926:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c3caa148 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.676933:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212014 00010000:00010000:0.0:1651529344.676933:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fc3a3cef/0x3234de053c4f5f0 lrc: 3/0,0 mode: PR/PR res: [0x2b91e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a1e expref: 557 pid: 156655 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.676935:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1509:39030:x1731745946512128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.676937:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fc3a3cef/0x3234de053c4f5f0 lrc: 4/0,0 mode: PR/PR res: [0x2b91e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a1e expref: 557 pid: 156655 timeout: 20103 lvb_type: 1 00002000:00080000:1.0:1651529344.676939:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178461 count 1 00000100:00100000:0.0:1651529344.676941:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006647e4ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997035584:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.676943:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c5216a lrc: 3/0,1 mode: --/PW res: [0x2b91d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.676947:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002cc8e673/0x3234de053c4d38a lrc: 2/0,0 mode: PR/PR res: [0x2b91d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d005c expref: 557 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.676950:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.676950:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.676950:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 000000003c8b0daf going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.676951:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c5216a lrc: 4/0,1 mode: --/PW res: [0x2b91d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.676956:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212015 00010000:00010000:1.0:1651529344.676957:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002cc8e673/0x3234de053c4d38a lrc: 3/0,0 mode: PR/PR res: [0x2b91d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d005c expref: 557 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.676958:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a13808c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1509:39030:x1731745946512256:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.676963:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002cc8e673/0x3234de053c4d38a lrc: 4/0,0 mode: PR/PR res: [0x2b91d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d005c expref: 557 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:0.0:1651529344.676963:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178463 count 1 00010000:00010000:0.0:1651529344.676966:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aab15112/0x3234de053c52171 lrc: 3/0,1 mode: --/PW res: [0x2b91f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.676967:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006731397d pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997035648:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.676970:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c9e87239/0x3234de053c4cfaf lrc: 2/0,0 mode: PR/PR res: [0x2b91f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf03a expref: 557 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.676974:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000babe2d90 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.676974:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.676974:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.676975:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aab15112/0x3234de053c52171 lrc: 4/0,1 mode: --/PW res: [0x2b91f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.676981:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c9e87239/0x3234de053c4cfaf lrc: 3/0,0 mode: PR/PR res: [0x2b91f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf03a expref: 557 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.676984:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c9e87239/0x3234de053c4cfaf lrc: 4/0,0 mode: PR/PR res: [0x2b91f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf03a expref: 557 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.676988:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a223a622 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997035712:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.677003:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.677015:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 0000000070e666f7 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.677024:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004972eb27 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997035264:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.677028:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000054dd6f57/0x3234de053c52140 lrc: 3/0,1 mode: --/PW res: [0x2b919:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.677039:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396392960 00010000:00010000:1.0:1651529344.677050:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000587ad665/0x3234de053c4ebee lrc: 4/0,0 mode: PR/PR res: [0x2b919:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d614b expref: 558 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.677061:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12790 00000100:00100000:1.0:1651529344.677069:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+558:41279:x1731746396392960:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.677072:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.677073:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000587ad665/0x3234de053c4ebee lrc: 4/0,0 mode: PR/PR res: [0x2b919:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d614b expref: 558 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.677077:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000587ad665/0x3234de053c4ebee lrc: 3/0,0 mode: PR/PR res: [0x2b919:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d614b expref: 558 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.677082:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000587ad665/0x3234de053c4ebee lrc: 0/0,0 mode: --/PR res: [0x2b919:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d614b expref: 558 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.677086:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.677086:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.677087:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000054dd6f57/0x3234de053c52140 lrc: 3/0,1 mode: PW/PW res: [0x2b919:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677090:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054dd6f57/0x3234de053c52140 lrc: 4/0,1 mode: PW/PW res: [0x2b919:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677099:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.677103:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000054dd6f57/0x3234de053c52140 lrc: 3/0,1 mode: PW/PW res: [0x2b919:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.677109:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+557:41279:x1731746396392960:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 46us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.677112:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12790 00000100:00100000:1.0:1651529344.677122:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b4acf60d pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997035328:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.677122:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054dd6f57/0x3234de053c52140 lrc: 3/0,1 mode: PW/PW res: [0x2b919:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.677125:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054dd6f57/0x3234de053c52140 lrc: 3/0,1 mode: PW/PW res: [0x2b919:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677126:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b5eb030a/0x3234de053c52147 lrc: 3/0,1 mode: --/PW res: [0x2b918:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.677131:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054dd6f57/0x3234de053c52140 lrc: 2/0,0 mode: PW/PW res: [0x2b919:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.677138:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.677180:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085af61db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1510:39030:x1731745946511872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 631us (684us total) trans 12885080063 rc 0/0 00000100:00100000:1.0:1651529344.677182:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.677184:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212008 00010000:00010000:0.0:1651529344.677198:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054dd6f57/0x3234de053c52140 lrc: 2/0,0 mode: PW/PW res: [0x2b919:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.677201:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054dd6f57 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.677202:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054dd6f57/0x3234de053c52140 lrc: 2/0,0 mode: PW/PW res: [0x2b919:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.677205:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054dd6f57/0x3234de053c52140 lrc: 3/0,0 mode: PW/PW res: [0x2b919:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.677210:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054dd6f57/0x3234de053c52140 lrc: 1/0,0 mode: --/PW res: [0x2b919:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.677213:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054dd6f57/0x3234de053c52140 lrc: 0/0,0 mode: --/PW res: [0x2b919:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.677215:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002a1f5cf2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997035392:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.677219:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c5214e lrc: 3/0,1 mode: --/PW res: [0x2b91b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.677221:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396393024 00010000:00010000:0.0:1651529344.677240:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005811f6f2/0x3234de053c4d202 lrc: 4/0,0 mode: PR/PR res: [0x2b918:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf9d3 expref: 557 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.677242:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396393088 00010000:00010000:1.0:1651529344.677246:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f0fce722/0x3234de053c4acee lrc: 4/0,0 mode: PR/PR res: [0x2b91b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbec3 expref: 558 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.677252:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12791 00000100:00100000:0.0:1651529344.677254:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+558:41278:x1731746396393024:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.677257:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.677258:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12792 00010000:00010000:0.0:1651529344.677259:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005811f6f2/0x3234de053c4d202 lrc: 4/0,0 mode: PR/PR res: [0x2b918:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf9d3 expref: 558 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.677260:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071577dd8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+558:41279:x1731746396393088:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.677262:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005811f6f2/0x3234de053c4d202 lrc: 3/0,0 mode: PR/PR res: [0x2b918:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf9d3 expref: 558 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.677263:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.677264:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f0fce722/0x3234de053c4acee lrc: 4/0,0 mode: PR/PR res: [0x2b91b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbec3 expref: 558 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.677267:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005811f6f2/0x3234de053c4d202 lrc: 0/0,0 mode: --/PR res: [0x2b918:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf9d3 expref: 558 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.677268:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f0fce722/0x3234de053c4acee lrc: 3/0,0 mode: PR/PR res: [0x2b91b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbec3 expref: 558 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.677271:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.677271:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.677272:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b5eb030a/0x3234de053c52147 lrc: 3/0,1 mode: PW/PW res: [0x2b918:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677274:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0fce722/0x3234de053c4acee lrc: 0/0,0 mode: --/PR res: [0x2b91b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbec3 expref: 557 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.677275:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5eb030a/0x3234de053c52147 lrc: 4/0,1 mode: PW/PW res: [0x2b918:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677277:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.677278:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.677278:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c5214e lrc: 3/0,1 mode: PW/PW res: [0x2b91b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.677283:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.677287:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c5214e lrc: 4/0,1 mode: PW/PW res: [0x2b91b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.677293:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+556:41278:x1731746396393024:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 39us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.677296:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12791 00010000:00010000:1.0:1651529344.677297:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.677305:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071577dd8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+555:41279:x1731746396393088:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 44us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.677307:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12792 00010000:00010000:1.0:1651529344.677322:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b5eb030a/0x3234de053c52147 lrc: 3/0,1 mode: PW/PW res: [0x2b918:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677325:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5eb030a/0x3234de053c52147 lrc: 3/0,1 mode: PW/PW res: [0x2b918:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677328:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5eb030a/0x3234de053c52147 lrc: 3/0,1 mode: PW/PW res: [0x2b918:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677331:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b5eb030a/0x3234de053c52147 lrc: 2/0,0 mode: PW/PW res: [0x2b918:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.677357:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b5eb030a/0x3234de053c52147 lrc: 2/0,0 mode: PW/PW res: [0x2b918:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.677361:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b5eb030a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.677362:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5eb030a/0x3234de053c52147 lrc: 2/0,0 mode: PW/PW res: [0x2b918:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.677365:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5eb030a/0x3234de053c52147 lrc: 3/0,0 mode: PW/PW res: [0x2b918:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.677370:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b5eb030a/0x3234de053c52147 lrc: 1/0,0 mode: --/PW res: [0x2b918:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.677372:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5eb030a/0x3234de053c52147 lrc: 0/0,0 mode: --/PW res: [0x2b918:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.677381:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1510:39029:x1731745946511808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 741us (871us total) trans 12885080064 rc 0/0 00000100:00100000:1.0:1651529344.677384:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212009 00010000:00010000:1.0:1651529344.677391:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c5214e lrc: 3/0,1 mode: PW/PW res: [0x2b91b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677395:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c5214e lrc: 3/0,1 mode: PW/PW res: [0x2b91b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677398:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c5214e lrc: 3/0,1 mode: PW/PW res: [0x2b91b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677401:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c5214e lrc: 2/0,0 mode: PW/PW res: [0x2b91b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.677401:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.677469:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1510:39030:x1731745946512000:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 776us (944us total) trans 12885080065 rc 0/0 00000100:00100000:0.0:1651529344.677471:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.677472:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212010 00000100:00100000:1.0:1651529344.677477:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946512704 00000100:00100000:1.0:1651529344.677487:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212016 00000100:00100000:1.0:1651529344.677488:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1510:39030:x1731745946512704:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.677498:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:1.0:1651529344.677499:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178464 count 1 00000100:00100000:0.0:1651529344.677509:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.677510:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52178 lrc: 3/0,1 mode: --/PW res: [0x2b920:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677523:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000019ccdc0d/0x3234de053c4c77b lrc: 2/0,0 mode: PR/PR res: [0x2b920:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd03c expref: 554 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.677526:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.677527:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.677528:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52178 lrc: 4/0,1 mode: --/PW res: [0x2b920:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677534:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000019ccdc0d/0x3234de053c4c77b lrc: 3/0,0 mode: PR/PR res: [0x2b920:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd03c expref: 554 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.677536:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.677538:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000019ccdc0d/0x3234de053c4c77b lrc: 4/0,0 mode: PR/PR res: [0x2b920:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd03c expref: 554 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.677547:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000de0edbdc pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997035776:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.677550:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003562cf4d pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997035456:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.677554:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c52155 lrc: 3/0,1 mode: --/PW res: [0x2b91a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.677560:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 000000004ca54b8a going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.677568:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006731397d pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997035648:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.677572:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c5216a lrc: 3/0,1 mode: --/PW res: [0x2b91d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.677579:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396393152 00010000:00010000:0.0:1651529344.677580:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c5214e lrc: 2/0,0 mode: PW/PW res: [0x2b91b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677583:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c4cf3f lrc: 4/0,0 mode: PR/PR res: [0x2b91a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceece expref: 555 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.677583:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005b1ee779 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.677584:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c5214e lrc: 2/0,0 mode: PW/PW res: [0x2b91b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.677587:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c5214e lrc: 3/0,0 mode: PW/PW res: [0x2b91b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.677588:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396393216 00010000:00010000:1.0:1651529344.677591:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000005dc20d5/0x3234de053c4db40 lrc: 5/0,0 mode: PR/PR res: [0x2b91c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d20 expref: 556 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.677592:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c5214e lrc: 1/0,0 mode: --/PW res: [0x2b91b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.677594:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c5214e lrc: 0/0,0 mode: --/PW res: [0x2b91b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.677595:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396393280 00010000:00010000:1.0:1651529344.677597:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fc3a3cef/0x3234de053c4f5f0 lrc: 5/0,0 mode: PR/PR res: [0x2b91e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a1e expref: 557 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.677601:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396393344 00010000:00010000:1.0:1651529344.677603:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002cc8e673/0x3234de053c4d38a lrc: 4/0,0 mode: PR/PR res: [0x2b91d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d005c expref: 558 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.677603:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006647e4ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997035584:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.677606:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c52163 lrc: 3/0,1 mode: --/PW res: [0x2b91e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.677608:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12793 00000100:00100000:1.0:1651529344.677609:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+558:41278:x1731746396393152:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.677612:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.677613:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c4cf3f lrc: 4/0,0 mode: PR/PR res: [0x2b91a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceece expref: 558 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.677617:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c4cf3f lrc: 3/0,0 mode: PR/PR res: [0x2b91a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceece expref: 558 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.677620:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.677622:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c4cf3f lrc: 0/0,0 mode: --/PR res: [0x2b91a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceece expref: 558 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.677626:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.677626:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.677627:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c52155 lrc: 3/0,1 mode: PW/PW res: [0x2b91a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677632:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c52155 lrc: 4/0,1 mode: PW/PW res: [0x2b91a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677642:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.677653:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+557:41278:x1731746396393152:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 43us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.677656:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12793 00000100:00100000:1.0:1651529344.677661:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12794 00000100:00100000:1.0:1651529344.677670:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+556:41279:x1731746396393216:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.677672:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.677672:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.677674:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000005dc20d5/0x3234de053c4db40 lrc: 5/0,0 mode: PR/PR res: [0x2b91c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d20 expref: 556 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.677678:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000005dc20d5/0x3234de053c4db40 lrc: 4/0,0 mode: PR/PR res: [0x2b91c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d20 expref: 556 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.677683:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.677683:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.677684:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008a562d62/0x3234de053c5215c lrc: 3/0,1 mode: PW/PW res: [0x2b91c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677687:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a562d62/0x3234de053c5215c lrc: 4/0,1 mode: PW/PW res: [0x2b91c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677691:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.677702:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+556:41279:x1731746396393216:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 33us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.677705:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12794 00000100:00100000:1.0:1651529344.677709:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12795 00000100:00100000:1.0:1651529344.677711:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+555:41278:x1731746396393280:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.677713:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.677715:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fc3a3cef/0x3234de053c4f5f0 lrc: 4/0,0 mode: PR/PR res: [0x2b91e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a1e expref: 555 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.677718:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fc3a3cef/0x3234de053c4f5f0 lrc: 3/0,0 mode: PR/PR res: [0x2b91e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a1e expref: 555 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.677723:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc3a3cef/0x3234de053c4f5f0 lrc: 0/0,0 mode: --/PR res: [0x2b91e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8a1e expref: 555 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.677730:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.677732:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.677733:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.677743:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c52163 lrc: 3/0,1 mode: PW/PW res: [0x2b91e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.677745:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946512832 00010000:00010000:1.0:1651529344.677746:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c52163 lrc: 4/0,1 mode: PW/PW res: [0x2b91e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677759:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.677760:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946512960 00000100:00100000:0.0:1651529344.677767:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212017 00000100:00100000:0.0:1651529344.677769:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1512:39030:x1731745946512832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.677773:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+554:41278:x1731746396393280:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 61us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.677776:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12795 00002000:00080000:0.0:1651529344.677779:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178465 count 1 00000100:00100000:1.0:1651529344.677781:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396393536 00010000:00010000:0.0:1651529344.677783:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2c22fc3/0x3234de053c5217f lrc: 3/0,1 mode: --/PW res: [0x2b921:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677785:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c9e87239/0x3234de053c4cfaf lrc: 5/0,0 mode: PR/PR res: [0x2b91f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf03a expref: 554 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.677788:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000003f77793/0x3234de053c4e534 lrc: 2/0,0 mode: PR/PR res: [0x2b921:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d45e5 expref: 554 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.677790:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12796 00000100:00100000:1.0:1651529344.677791:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+554:41279:x1731746396393344:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.677791:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.677792:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.677793:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2c22fc3/0x3234de053c5217f lrc: 4/0,1 mode: --/PW res: [0x2b921:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677794:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.677795:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002cc8e673/0x3234de053c4d38a lrc: 4/0,0 mode: PR/PR res: [0x2b91d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d005c expref: 554 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.677798:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002cc8e673/0x3234de053c4d38a lrc: 3/0,0 mode: PR/PR res: [0x2b91d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d005c expref: 554 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.677803:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cc8e673/0x3234de053c4d38a lrc: 0/0,0 mode: --/PR res: [0x2b91d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d005c expref: 554 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.677806:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.677807:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.677808:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c5216a lrc: 3/0,1 mode: PW/PW res: [0x2b91d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677811:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c5216a lrc: 4/0,1 mode: PW/PW res: [0x2b91d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.677813:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000003f77793/0x3234de053c4e534 lrc: 3/0,0 mode: PR/PR res: [0x2b921:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d45e5 expref: 553 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.677817:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.677817:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000003f77793/0x3234de053c4e534 lrc: 4/0,0 mode: PR/PR res: [0x2b921:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d45e5 expref: 553 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.677822:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+553:41279:x1731746396393344:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 30us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.677824:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12796 00000100:00100000:1.0:1651529344.677828:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12797 00000100:00100000:1.0:1651529344.677829:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+552:41278:x1731746396393536:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.677830:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006647e4ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997035840:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.677831:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.677833:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c9e87239/0x3234de053c4cfaf lrc: 5/0,0 mode: PR/PR res: [0x2b91f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf03a expref: 552 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.677836:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c9e87239/0x3234de053c4cfaf lrc: 4/0,0 mode: PR/PR res: [0x2b91f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf03a expref: 552 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.677840:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.677840:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000afe7ff7b going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.677841:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.677841:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000aab15112/0x3234de053c52171 lrc: 3/0,1 mode: PW/PW res: [0x2b91f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677844:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aab15112/0x3234de053c52171 lrc: 4/0,1 mode: PW/PW res: [0x2b91f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677848:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.677848:0:156655:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9e87239/0x3234de053c4cfaf lrc: 0/0,0 mode: --/PR res: [0x2b91f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf03a expref: 552 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.677852:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a223a622 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997035712:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.677853:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+551:41278:x1731746396393536:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 23us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.677855:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12797 00010000:00010000:0.0:1651529344.677855:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000aab15112/0x3234de053c52171 lrc: 3/0,1 mode: PW/PW res: [0x2b91f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.677858:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000aab15112/0x3234de053c52171 lrc: 3/0,1 mode: PW/PW res: [0x2b91f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.677861:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212018 00010000:00010000:0.0:1651529344.677861:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aab15112/0x3234de053c52171 lrc: 3/0,1 mode: PW/PW res: [0x2b91f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.677863:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1512:39029:x1731745946512960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.677867:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178466 count 1 00010000:00010000:0.0:1651529344.677867:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aab15112/0x3234de053c52171 lrc: 3/0,1 mode: PW/PW res: [0x2b91f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.677870:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aab15112/0x3234de053c52171 lrc: 2/0,0 mode: PW/PW res: [0x2b91f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677871:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52186 lrc: 3/0,1 mode: --/PW res: [0x2b922:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677875:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f24d7561/0x3234de053c4d892 lrc: 2/0,0 mode: PR/PR res: [0x2b922:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1302 expref: 550 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.677878:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.677879:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.677879:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52186 lrc: 4/0,1 mode: --/PW res: [0x2b922:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677885:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f24d7561/0x3234de053c4d892 lrc: 3/0,0 mode: PR/PR res: [0x2b922:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1302 expref: 550 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.677889:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f24d7561/0x3234de053c4d892 lrc: 4/0,0 mode: PR/PR res: [0x2b922:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1302 expref: 550 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.677893:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006731397d pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997035904:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.677900:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 0000000020dd7827 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.677906:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c5216a lrc: 3/0,1 mode: PW/PW res: [0x2b91d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677910:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c5216a lrc: 3/0,1 mode: PW/PW res: [0x2b91d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.677911:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a13808c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1513:39030:x1731745946512256:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 951us (1061us total) trans 12885080066 rc 0/0 00010000:00010000:1.0:1651529344.677913:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c5216a lrc: 3/0,1 mode: PW/PW res: [0x2b91d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.677914:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212015 00010000:00010000:1.0:1651529344.677915:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c5216a lrc: 2/0,0 mode: PW/PW res: [0x2b91d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.677932:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aab15112/0x3234de053c52171 lrc: 2/0,0 mode: PW/PW res: [0x2b91f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.677935:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000aab15112 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.677936:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aab15112/0x3234de053c52171 lrc: 2/0,0 mode: PW/PW res: [0x2b91f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.677939:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aab15112/0x3234de053c52171 lrc: 3/0,0 mode: PW/PW res: [0x2b91f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.677944:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aab15112/0x3234de053c52171 lrc: 1/0,0 mode: --/PW res: [0x2b91f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.677947:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aab15112/0x3234de053c52171 lrc: 0/0,0 mode: --/PW res: [0x2b91f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.677951:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c5216a lrc: 2/0,0 mode: PW/PW res: [0x2b91d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.677954:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003266b888 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.677955:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c5216a lrc: 2/0,0 mode: PW/PW res: [0x2b91d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.677958:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1513:39030:x1731745946512128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1022us (1119us total) trans 12885080067 rc 0/0 00010000:00010000:0.0:1651529344.677958:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c5216a lrc: 3/0,0 mode: PW/PW res: [0x2b91d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.677961:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212014 00010000:00010000:0.0:1651529344.677961:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c5216a lrc: 1/0,0 mode: --/PW res: [0x2b91d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.677963:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c5216a lrc: 0/0,0 mode: --/PW res: [0x2b91d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.677969:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c52163 lrc: 3/0,1 mode: PW/PW res: [0x2b91e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.677971:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c52163 lrc: 3/0,1 mode: PW/PW res: [0x2b91e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677972:0:72397:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005dc20d5/0x3234de053c4db40 lrc: 0/0,0 mode: --/PR res: [0x2b91c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1d20 expref: 550 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.677974:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c52163 lrc: 3/0,1 mode: PW/PW res: [0x2b91e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.677976:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b0d9532a pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997035520:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.677977:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c52163 lrc: 2/0,0 mode: PW/PW res: [0x2b91e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677980:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008a562d62/0x3234de053c5215c lrc: 3/0,1 mode: PW/PW res: [0x2b91c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677983:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008a562d62/0x3234de053c5215c lrc: 3/0,1 mode: PW/PW res: [0x2b91c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677986:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a562d62/0x3234de053c5215c lrc: 3/0,1 mode: PW/PW res: [0x2b91c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677989:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a562d62/0x3234de053c5215c lrc: 3/0,1 mode: PW/PW res: [0x2b91c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.677992:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a562d62/0x3234de053c5215c lrc: 2/0,0 mode: PW/PW res: [0x2b91c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.678019:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1514:39029:x1731745946512192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1143us (1216us total) trans 12885080068 rc 0/0 00000100:00100000:0.0:1651529344.678023:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212013 00000100:00100000:1.0:1651529344.678030:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1513:39029:x1731745946512064:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1160us (1235us total) trans 12885080069 rc 0/0 00010000:00010000:0.0:1651529344.678030:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c52163 lrc: 2/0,0 mode: PW/PW res: [0x2b91e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.678033:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212012 00010000:00010000:0.0:1651529344.678047:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009fd52982 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.678048:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c52163 lrc: 2/0,0 mode: PW/PW res: [0x2b91e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678051:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c52163 lrc: 3/0,0 mode: PW/PW res: [0x2b91e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678056:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c52163 lrc: 1/0,0 mode: --/PW res: [0x2b91e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678059:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fd52982/0x3234de053c52163 lrc: 0/0,0 mode: --/PW res: [0x2b91e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678063:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a562d62/0x3234de053c5215c lrc: 2/0,0 mode: PW/PW res: [0x2b91c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678066:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008a562d62 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.678067:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a562d62/0x3234de053c5215c lrc: 2/0,0 mode: PW/PW res: [0x2b91c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678069:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a562d62/0x3234de053c5215c lrc: 3/0,0 mode: PW/PW res: [0x2b91c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.678074:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.678075:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a562d62/0x3234de053c5215c lrc: 1/0,0 mode: --/PW res: [0x2b91c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678078:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a562d62/0x3234de053c5215c lrc: 0/0,0 mode: --/PW res: [0x2b91c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678084:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c52155 lrc: 3/0,1 mode: PW/PW res: [0x2b91a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678087:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c52155 lrc: 3/0,1 mode: PW/PW res: [0x2b91a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678090:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c52155 lrc: 3/0,1 mode: PW/PW res: [0x2b91a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678093:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c52155 lrc: 2/0,0 mode: PW/PW res: [0x2b91a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.678128:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1513:39029:x1731745946511936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1431us (1583us total) trans 12885080070 rc 0/0 00000100:00100000:0.0:1651529344.678131:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212011 00010000:00010000:0.0:1651529344.678138:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c52155 lrc: 2/0,0 mode: PW/PW res: [0x2b91a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678141:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c9b39253 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.678142:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c52155 lrc: 2/0,0 mode: PW/PW res: [0x2b91a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678145:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c52155 lrc: 3/0,0 mode: PW/PW res: [0x2b91a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678150:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c52155 lrc: 1/0,0 mode: --/PW res: [0x2b91a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678152:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9b39253/0x3234de053c52155 lrc: 0/0,0 mode: --/PW res: [0x2b91a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.678161:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396393728 00010000:00010000:0.0:1651529344.678166:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000019ccdc0d/0x3234de053c4c77b lrc: 5/0,0 mode: PR/PR res: [0x2b920:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd03c expref: 550 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.678174:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000de0edbdc pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997035776:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.678178:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52178 lrc: 3/0,1 mode: --/PW res: [0x2b920:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.678195:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12798 00000100:00100000:0.0:1651529344.678207:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+550:41279:x1731746396393728:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.678210:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.678211:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000019ccdc0d/0x3234de053c4c77b lrc: 4/0,0 mode: PR/PR res: [0x2b920:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd03c expref: 550 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.678215:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000019ccdc0d/0x3234de053c4c77b lrc: 3/0,0 mode: PR/PR res: [0x2b920:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd03c expref: 550 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.678221:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019ccdc0d/0x3234de053c4c77b lrc: 0/0,0 mode: --/PR res: [0x2b920:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd03c expref: 550 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.678246:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.678247:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.678248:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52178 lrc: 3/0,1 mode: PW/PW res: [0x2b920:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678251:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52178 lrc: 4/0,1 mode: PW/PW res: [0x2b920:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678260:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.678263:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52178 lrc: 3/0,1 mode: PW/PW res: [0x2b920:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.678266:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52178 lrc: 3/0,1 mode: PW/PW res: [0x2b920:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.678270:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52178 lrc: 3/0,1 mode: PW/PW res: [0x2b920:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.678272:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52178 lrc: 2/0,0 mode: PW/PW res: [0x2b920:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.678303:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+549:41279:x1731746396393728:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 95us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.678306:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12798 00010000:00010000:0.0:1651529344.678313:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52178 lrc: 2/0,0 mode: PW/PW res: [0x2b920:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678316:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fafb79d3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.678318:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52178 lrc: 2/0,0 mode: PW/PW res: [0x2b920:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.678321:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1513:39030:x1731745946512704:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 831us (920us total) trans 12885080071 rc 0/0 00010000:00010000:0.0:1651529344.678321:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52178 lrc: 3/0,0 mode: PW/PW res: [0x2b920:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.678324:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212016 00010000:00010000:0.0:1651529344.678325:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52178 lrc: 1/0,0 mode: --/PW res: [0x2b920:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678328:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52178 lrc: 0/0,0 mode: --/PW res: [0x2b920:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.678372:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.678380:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.678390:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.678391:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946513216 00000100:00100000:1.0:1651529344.678398:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.678406:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.678420:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946513344 00000100:00100000:1.0:1651529344.678427:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946513280 00000100:00100000:0.0:1651529344.678427:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946513152 00000100:00100000:1.0:1651529344.678433:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946513408 00000100:00100000:0.0:1651529344.678443:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212019 00000100:00100000:1.0:1651529344.678445:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212020 00000100:00100000:0.0:1651529344.678445:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1517:39029:x1731745946513216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.678447:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1517:39029:x1731745946513344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.678450:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178468 count 1 00002000:00080000:1.0:1651529344.678452:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178470 count 1 00010000:00010000:0.0:1651529344.678455:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c5218d lrc: 3/0,1 mode: --/PW res: [0x2b924:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.678457:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52194 lrc: 3/0,1 mode: --/PW res: [0x2b926:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678460:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002d08b2c6/0x3234de053c4d979 lrc: 2/0,0 mode: PR/PR res: [0x2b924:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1658 expref: 548 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.678462:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009d265c9f/0x3234de053c4e025 lrc: 2/0,0 mode: PR/PR res: [0x2b926:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d31c5 expref: 548 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.678463:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.678463:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.678464:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c5218d lrc: 4/0,1 mode: --/PW res: [0x2b924:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.678465:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.678466:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.678466:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52194 lrc: 4/0,1 mode: --/PW res: [0x2b926:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678471:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002d08b2c6/0x3234de053c4d979 lrc: 3/0,0 mode: PR/PR res: [0x2b924:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1658 expref: 548 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.678473:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009d265c9f/0x3234de053c4e025 lrc: 3/0,0 mode: PR/PR res: [0x2b926:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d31c5 expref: 548 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.678476:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009d265c9f/0x3234de053c4e025 lrc: 4/0,0 mode: PR/PR res: [0x2b926:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d31c5 expref: 548 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.678480:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000078a40aa9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997036032:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.678493:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002d08b2c6/0x3234de053c4d979 lrc: 4/0,0 mode: PR/PR res: [0x2b924:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1658 expref: 548 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.678496:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c3caa148 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.678498:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a223a622 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997035968:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.678502:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212021 00000100:00100000:1.0:1651529344.678504:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1517:39030:x1731745946513280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.678507:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 0000000070e666f7 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.678508:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178469 count 1 00010000:00010000:1.0:1651529344.678512:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c5219b lrc: 3/0,1 mode: --/PW res: [0x2b925:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.678514:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212022 00010000:00010000:1.0:1651529344.678516:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f8bfb6e2/0x3234de053c4d600 lrc: 2/0,0 mode: PR/PR res: [0x2b925:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0993 expref: 548 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.678516:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1517:39030:x1731745946513152:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.678521:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:0.0:1651529344.678521:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178467 count 1 00010000:00010000:1.0:1651529344.678522:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.678523:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c5219b lrc: 4/0,1 mode: --/PW res: [0x2b925:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678524:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c521a2 lrc: 3/0,1 mode: --/PW res: [0x2b923:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.678528:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f8bfb6e2/0x3234de053c4d600 lrc: 3/0,0 mode: PR/PR res: [0x2b925:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0993 expref: 548 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.678531:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000979e9ef5/0x3234de053c4d4fd lrc: 2/0,0 mode: PR/PR res: [0x2b923:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0613 expref: 548 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.678532:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f8bfb6e2/0x3234de053c4d600 lrc: 4/0,0 mode: PR/PR res: [0x2b925:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0993 expref: 548 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.678534:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.678535:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.678535:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c521a2 lrc: 4/0,1 mode: --/PW res: [0x2b923:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.678536:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006929eb96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997036096:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.678542:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000499d0377 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.678542:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000979e9ef5/0x3234de053c4d4fd lrc: 3/0,0 mode: PR/PR res: [0x2b923:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0613 expref: 548 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.678545:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000979e9ef5/0x3234de053c4d4fd lrc: 4/0,0 mode: PR/PR res: [0x2b923:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0613 expref: 548 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.678548:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212023 00000100:00100000:1.0:1651529344.678549:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1517:39030:x1731745946513408:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.678549:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003562cf4d pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997036160:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.678553:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178471 count 1 00010000:00010000:1.0:1651529344.678556:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c521a9 lrc: 3/0,1 mode: --/PW res: [0x2b927:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.678556:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed830649 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.678560:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000008d96b78/0x3234de053c4bc92 lrc: 2/0,0 mode: PR/PR res: [0x2b927:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5e6 expref: 548 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.678563:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.678563:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.678564:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c521a9 lrc: 4/0,1 mode: --/PW res: [0x2b927:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.678572:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000008d96b78/0x3234de053c4bc92 lrc: 3/0,0 mode: PR/PR res: [0x2b927:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5e6 expref: 548 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.678576:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000008d96b78/0x3234de053c4bc92 lrc: 4/0,0 mode: PR/PR res: [0x2b927:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5e6 expref: 548 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.678589:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007c534a1e pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997036224:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.678595:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.678597:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a4eb401d going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.678602:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946513472 00000100:00100000:1.0:1651529344.678619:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212024 00000100:00100000:1.0:1651529344.678621:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1518:39030:x1731745946513472:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.678625:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178472 count 1 00010000:00010000:1.0:1651529344.678629:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c521b0 lrc: 3/0,1 mode: --/PW res: [0x2b928:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.678638:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.678640:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f72cf775/0x3234de053c4cdcc lrc: 2/0,0 mode: PR/PR res: [0x2b928:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce8ca expref: 548 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.678644:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.678644:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.678645:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c521b0 lrc: 4/0,1 mode: --/PW res: [0x2b928:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.678651:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f72cf775/0x3234de053c4cdcc lrc: 3/0,0 mode: PR/PR res: [0x2b928:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce8ca expref: 548 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.678659:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.678668:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f72cf775/0x3234de053c4cdcc lrc: 4/0,0 mode: PR/PR res: [0x2b928:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce8ca expref: 548 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.678672:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000065f5e47d pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997036288:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.678673:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006647e4ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997035840:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.678677:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f2c22fc3/0x3234de053c5217f lrc: 3/0,1 mode: --/PW res: [0x2b921:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.678685:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000babe2d90 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.678689:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396394048 00000100:00100000:1.0:1651529344.678694:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006731397d pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997035904:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.678698:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52186 lrc: 3/0,1 mode: --/PW res: [0x2b922:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.678704:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396394112 00010000:00010000:0.0:1651529344.678708:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000003f77793/0x3234de053c4e534 lrc: 4/0,0 mode: PR/PR res: [0x2b921:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d45e5 expref: 550 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.678709:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f24d7561/0x3234de053c4d892 lrc: 4/0,0 mode: PR/PR res: [0x2b922:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1302 expref: 550 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.678716:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12799 00000100:00100000:1.0:1651529344.678723:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+550:41279:x1731746396394112:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.678723:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12800 00000100:00100000:0.0:1651529344.678725:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea4c33b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+550:41278:x1731746396394048:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.678727:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.678728:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f24d7561/0x3234de053c4d892 lrc: 4/0,0 mode: PR/PR res: [0x2b922:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1302 expref: 550 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.678728:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.678729:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000003f77793/0x3234de053c4e534 lrc: 4/0,0 mode: PR/PR res: [0x2b921:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d45e5 expref: 550 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.678732:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f24d7561/0x3234de053c4d892 lrc: 3/0,0 mode: PR/PR res: [0x2b922:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1302 expref: 550 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.678733:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000003f77793/0x3234de053c4e534 lrc: 3/0,0 mode: PR/PR res: [0x2b921:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d45e5 expref: 550 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.678747:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f24d7561/0x3234de053c4d892 lrc: 0/0,0 mode: --/PR res: [0x2b922:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1302 expref: 550 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.678748:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003f77793/0x3234de053c4e534 lrc: 0/0,0 mode: --/PR res: [0x2b921:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d45e5 expref: 550 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.678752:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.678752:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.678753:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.678753:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f2c22fc3/0x3234de053c5217f lrc: 3/0,1 mode: PW/PW res: [0x2b921:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.678754:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.678754:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52186 lrc: 3/0,1 mode: PW/PW res: [0x2b922:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678756:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2c22fc3/0x3234de053c5217f lrc: 4/0,1 mode: PW/PW res: [0x2b921:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.678757:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52186 lrc: 4/0,1 mode: PW/PW res: [0x2b922:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678763:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.678764:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.678771:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea4c33b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+548:41278:x1731746396394048:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 46us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.678772:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+548:41279:x1731746396394112:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 54us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.678773:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12800 00000100:00100000:1.0:1651529344.678789:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12799 00010000:00010000:0.0:1651529344.678797:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f2c22fc3/0x3234de053c5217f lrc: 3/0,1 mode: PW/PW res: [0x2b921:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.678799:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52186 lrc: 3/0,1 mode: PW/PW res: [0x2b922:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678801:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2c22fc3/0x3234de053c5217f lrc: 3/0,1 mode: PW/PW res: [0x2b921:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.678802:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52186 lrc: 3/0,1 mode: PW/PW res: [0x2b922:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678804:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2c22fc3/0x3234de053c5217f lrc: 3/0,1 mode: PW/PW res: [0x2b921:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.678805:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52186 lrc: 3/0,1 mode: PW/PW res: [0x2b922:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678806:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2c22fc3/0x3234de053c5217f lrc: 2/0,0 mode: PW/PW res: [0x2b921:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.678807:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52186 lrc: 2/0,0 mode: PW/PW res: [0x2b922:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.678849:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1519:39029:x1731745946512960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 985us (1177us total) trans 12885080072 rc 0/0 00000100:00100000:1.0:1651529344.678852:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212018 00000100:00100000:0.0:1651529344.678885:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1519:39030:x1731745946512832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1115us (1265us total) trans 12885080073 rc 0/0 00000100:00100000:0.0:1651529344.678888:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212017 00010000:00010000:0.0:1651529344.678912:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2c22fc3/0x3234de053c5217f lrc: 2/0,0 mode: PW/PW res: [0x2b921:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678916:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f2c22fc3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.678917:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2c22fc3/0x3234de053c5217f lrc: 2/0,0 mode: PW/PW res: [0x2b921:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678920:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2c22fc3/0x3234de053c5217f lrc: 3/0,0 mode: PW/PW res: [0x2b921:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678935:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2c22fc3/0x3234de053c5217f lrc: 1/0,0 mode: --/PW res: [0x2b921:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678938:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2c22fc3/0x3234de053c5217f lrc: 0/0,0 mode: --/PW res: [0x2b921:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678943:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52186 lrc: 2/0,0 mode: PW/PW res: [0x2b922:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678946:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000048ee8765 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.678947:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52186 lrc: 2/0,0 mode: PW/PW res: [0x2b922:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678949:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52186 lrc: 3/0,0 mode: PW/PW res: [0x2b922:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678952:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52186 lrc: 1/0,0 mode: --/PW res: [0x2b922:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.678955:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52186 lrc: 0/0,0 mode: --/PW res: [0x2b922:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.678965:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003562cf4d pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997036160:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.678968:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c521a2 lrc: 3/0,1 mode: --/PW res: [0x2b923:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.678975:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a223a622 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997035968:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.678977:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c5218d lrc: 3/0,1 mode: --/PW res: [0x2b924:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.678979:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006929eb96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997036096:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.678983:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c5219b lrc: 3/0,1 mode: --/PW res: [0x2b925:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.678991:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007c534a1e pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997036224:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.678993:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c521a9 lrc: 3/0,1 mode: --/PW res: [0x2b927:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.678999:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000078a40aa9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997036032:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.679001:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52194 lrc: 3/0,1 mode: --/PW res: [0x2b926:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.679132:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.679143:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.679143:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946513984 00000100:00100000:0.0:1651529344.679153:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946513920 00000100:00100000:0.0:1651529344.679160:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212025 00000100:00100000:0.0:1651529344.679161:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1520:39029:x1731745946513984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.679164:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212026 00000100:00100000:1.0:1651529344.679166:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1520:39030:x1731745946513920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.679166:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178474 count 1 00010000:00010000:0.0:1651529344.679171:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1130404/0x3234de053c521b7 lrc: 3/0,1 mode: --/PW res: [0x2b92a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.679172:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178473 count 1 00010000:00010000:1.0:1651529344.679177:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c521be lrc: 3/0,1 mode: --/PW res: [0x2b929:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.679181:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000c8c3c22/0x3234de053c4eed4 lrc: 2/0,0 mode: PR/PR res: [0x2b929:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d3e expref: 546 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.679184:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.679185:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.679185:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c521be lrc: 4/0,1 mode: --/PW res: [0x2b929:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.679191:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006b6970d7/0x3234de053c4ed84 lrc: 2/0,0 mode: PR/PR res: [0x2b92a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d688a expref: 546 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.679192:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000c8c3c22/0x3234de053c4eed4 lrc: 3/0,0 mode: PR/PR res: [0x2b929:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d3e expref: 546 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.679194:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.679195:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.679195:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1130404/0x3234de053c521b7 lrc: 4/0,1 mode: --/PW res: [0x2b92a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.679196:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000c8c3c22/0x3234de053c4eed4 lrc: 4/0,0 mode: PR/PR res: [0x2b929:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d3e expref: 546 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.679200:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007c534a1e pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997036352:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.679203:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006b6970d7/0x3234de053c4ed84 lrc: 3/0,0 mode: PR/PR res: [0x2b92a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d688a expref: 546 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.679206:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006b6970d7/0x3234de053c4ed84 lrc: 4/0,0 mode: PR/PR res: [0x2b92a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d688a expref: 546 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.679210:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c3caa148 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.679211:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002f363f4a pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997036416:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.679235:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.679247:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000003c8b0daf going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.679271:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.679294:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.679302:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396394176 00000100:00100000:0.0:1651529344.679303:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.679308:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009d265c9f/0x3234de053c4e025 lrc: 4/0,0 mode: PR/PR res: [0x2b926:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d31c5 expref: 547 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.679310:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.679314:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396394304 00010000:00010000:1.0:1651529344.679321:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f8bfb6e2/0x3234de053c4d600 lrc: 4/0,0 mode: PR/PR res: [0x2b925:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0993 expref: 548 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.679322:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396394240 00000100:00100000:1.0:1651529344.679327:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396394368 00010000:00010000:0.0:1651529344.679328:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002d08b2c6/0x3234de053c4d979 lrc: 4/0,0 mode: PR/PR res: [0x2b924:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1658 expref: 549 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.679330:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000979e9ef5/0x3234de053c4d4fd lrc: 4/0,0 mode: PR/PR res: [0x2b923:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0613 expref: 550 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.679353:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396394496 00000100:00100000:1.0:1651529344.679356:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12801 00010000:00010000:0.0:1651529344.679357:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000008d96b78/0x3234de053c4bc92 lrc: 4/0,0 mode: PR/PR res: [0x2b927:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5e6 expref: 551 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.679358:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+551:41278:x1731746396394176:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.679361:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.679362:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009d265c9f/0x3234de053c4e025 lrc: 4/0,0 mode: PR/PR res: [0x2b926:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d31c5 expref: 551 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.679363:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12802 00000100:00100000:0.0:1651529344.679365:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+551:41278:x1731746396394304:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.679366:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009d265c9f/0x3234de053c4e025 lrc: 3/0,0 mode: PR/PR res: [0x2b926:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d31c5 expref: 551 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.679368:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.679369:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f8bfb6e2/0x3234de053c4d600 lrc: 4/0,0 mode: PR/PR res: [0x2b925:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0993 expref: 551 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.679372:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d265c9f/0x3234de053c4e025 lrc: 0/0,0 mode: --/PR res: [0x2b926:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d31c5 expref: 551 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.679373:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f8bfb6e2/0x3234de053c4d600 lrc: 3/0,0 mode: PR/PR res: [0x2b925:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0993 expref: 551 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.679375:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.679376:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.679377:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52194 lrc: 3/0,1 mode: PW/PW res: [0x2b926:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.679379:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8bfb6e2/0x3234de053c4d600 lrc: 0/0,0 mode: --/PR res: [0x2b925:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0993 expref: 550 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.679380:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52194 lrc: 4/0,1 mode: PW/PW res: [0x2b926:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.679382:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.679383:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.679384:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c5219b lrc: 3/0,1 mode: PW/PW res: [0x2b925:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.679386:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.679387:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c5219b lrc: 4/0,1 mode: PW/PW res: [0x2b925:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.679401:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+549:41278:x1731746396394176:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 43us (167us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.679401:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.679404:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12801 00000100:00100000:0.0:1651529344.679408:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+548:41278:x1731746396394304:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 43us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.679409:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12803 00000100:00100000:1.0:1651529344.679411:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+548:41279:x1731746396394240:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.679411:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12802 00010000:00010000:1.0:1651529344.679414:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.679415:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002d08b2c6/0x3234de053c4d979 lrc: 4/0,0 mode: PR/PR res: [0x2b924:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1658 expref: 547 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.679417:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12804 00000100:00100000:0.0:1651529344.679418:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+547:41279:x1731746396394368:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.679419:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002d08b2c6/0x3234de053c4d979 lrc: 3/0,0 mode: PR/PR res: [0x2b924:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1658 expref: 547 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.679421:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.679424:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d08b2c6/0x3234de053c4d979 lrc: 0/0,0 mode: --/PR res: [0x2b924:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1658 expref: 547 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.679427:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.679428:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.679429:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c5218d lrc: 3/0,1 mode: PW/PW res: [0x2b924:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.679431:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c5218d lrc: 4/0,1 mode: PW/PW res: [0x2b924:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.679435:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000979e9ef5/0x3234de053c4d4fd lrc: 4/0,0 mode: PR/PR res: [0x2b923:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0613 expref: 546 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.679440:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.679445:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000979e9ef5/0x3234de053c4d4fd lrc: 3/0,0 mode: PR/PR res: [0x2b923:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0613 expref: 546 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.679446:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+546:41279:x1731746396394240:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 34us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.679448:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12803 00010000:00010000:0.0:1651529344.679450:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000979e9ef5/0x3234de053c4d4fd lrc: 0/0,0 mode: --/PR res: [0x2b923:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0613 expref: 546 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.679453:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12805 00000100:00100000:1.0:1651529344.679454:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+544:41279:x1731746396394496:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.679454:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.679454:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.679455:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c521a2 lrc: 3/0,1 mode: PW/PW res: [0x2b923:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.679456:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.679458:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000008d96b78/0x3234de053c4bc92 lrc: 4/0,0 mode: PR/PR res: [0x2b927:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5e6 expref: 544 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.679458:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c521a2 lrc: 4/0,1 mode: PW/PW res: [0x2b923:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.679461:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000008d96b78/0x3234de053c4bc92 lrc: 3/0,0 mode: PR/PR res: [0x2b927:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5e6 expref: 544 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.679465:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.679466:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008d96b78/0x3234de053c4bc92 lrc: 0/0,0 mode: --/PR res: [0x2b927:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5e6 expref: 544 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.679471:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+544:41279:x1731746396394368:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 52us (168us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.679472:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.679472:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.679473:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c521a9 lrc: 3/0,1 mode: PW/PW res: [0x2b927:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.679474:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12804 00010000:00010000:1.0:1651529344.679476:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c521a9 lrc: 4/0,1 mode: PW/PW res: [0x2b927:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.679481:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c5218d lrc: 3/0,1 mode: PW/PW res: [0x2b924:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.679482:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.679486:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+542:41279:x1731746396394496:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 32us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.679489:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12805 00010000:00010000:0.0:1651529344.679497:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c5218d lrc: 3/0,1 mode: PW/PW res: [0x2b924:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.679500:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c5218d lrc: 3/0,1 mode: PW/PW res: [0x2b924:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.679502:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000065f5e47d pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997036288:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.679503:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c5218d lrc: 2/0,0 mode: PW/PW res: [0x2b924:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.679506:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c521b0 lrc: 3/0,1 mode: --/PW res: [0x2b928:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.679511:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52194 lrc: 3/0,1 mode: PW/PW res: [0x2b926:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.679514:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52194 lrc: 3/0,1 mode: PW/PW res: [0x2b926:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.679517:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52194 lrc: 3/0,1 mode: PW/PW res: [0x2b926:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.679520:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52194 lrc: 2/0,0 mode: PW/PW res: [0x2b926:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.679550:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1522:39029:x1731745946513216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1104us (1178us total) trans 12885080074 rc 0/0 00000100:00100000:0.0:1651529344.679553:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212019 00010000:00010000:0.0:1651529344.679560:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c521a2 lrc: 3/0,1 mode: PW/PW res: [0x2b923:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.679563:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c521a2 lrc: 3/0,1 mode: PW/PW res: [0x2b923:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.679564:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1521:39029:x1731745946513344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1116us (1183us total) trans 12885080075 rc 0/0 00010000:00010000:0.0:1651529344.679566:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c521a2 lrc: 3/0,1 mode: PW/PW res: [0x2b923:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.679567:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212020 00010000:00010000:0.0:1651529344.679569:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c521a2 lrc: 2/0,0 mode: PW/PW res: [0x2b923:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.679575:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c5219b lrc: 3/0,1 mode: PW/PW res: [0x2b925:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.679578:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c5219b lrc: 3/0,1 mode: PW/PW res: [0x2b925:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.679581:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c5219b lrc: 3/0,1 mode: PW/PW res: [0x2b925:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.679584:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c5219b lrc: 2/0,0 mode: PW/PW res: [0x2b925:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.679602:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1522:39030:x1731745946513152:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1085us (1212us total) trans 12885080076 rc 0/0 00000100:00100000:0.0:1651529344.679605:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212022 00010000:00010000:0.0:1651529344.679611:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c5218d lrc: 2/0,0 mode: PW/PW res: [0x2b924:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.679614:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1521:39030:x1731745946513280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1110us (1216us total) trans 12885080077 rc 0/0 00010000:00010000:0.0:1651529344.679615:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004df22a54 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.679616:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c5218d lrc: 2/0,0 mode: PW/PW res: [0x2b924:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.679617:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212021 00010000:00010000:0.0:1651529344.679618:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c5218d lrc: 3/0,0 mode: PW/PW res: [0x2b924:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.679623:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c521a9 lrc: 3/0,1 mode: PW/PW res: [0x2b927:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.679623:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c5218d lrc: 1/0,0 mode: --/PW res: [0x2b924:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.679626:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c521a9 lrc: 3/0,1 mode: PW/PW res: [0x2b927:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.679626:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004df22a54/0x3234de053c5218d lrc: 0/0,0 mode: --/PW res: [0x2b924:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.679629:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c521a9 lrc: 3/0,1 mode: PW/PW res: [0x2b927:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.679630:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52194 lrc: 2/0,0 mode: PW/PW res: [0x2b926:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.679632:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c5599f68 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.679633:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52194 lrc: 2/0,0 mode: PW/PW res: [0x2b926:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.679634:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c521a9 lrc: 2/0,0 mode: PW/PW res: [0x2b927:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.679636:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52194 lrc: 3/0,0 mode: PW/PW res: [0x2b926:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.679642:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52194 lrc: 1/0,0 mode: --/PW res: [0x2b926:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.679644:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52194 lrc: 0/0,0 mode: --/PW res: [0x2b926:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.679648:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c521a2 lrc: 2/0,0 mode: PW/PW res: [0x2b923:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.679651:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d766c581 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.679651:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c521a2 lrc: 2/0,0 mode: PW/PW res: [0x2b923:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.679654:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c521a2 lrc: 3/0,0 mode: PW/PW res: [0x2b923:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.679657:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c521a2 lrc: 1/0,0 mode: --/PW res: [0x2b923:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.679660:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d766c581/0x3234de053c521a2 lrc: 0/0,0 mode: --/PW res: [0x2b923:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.679663:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1521:39030:x1731745946513408:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1112us (1257us total) trans 12885080078 rc 0/0 00010000:00010000:0.0:1651529344.679663:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c5219b lrc: 2/0,0 mode: PW/PW res: [0x2b925:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.679665:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212023 00010000:00010000:0.0:1651529344.679680:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000091ee0f93 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.679681:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c5219b lrc: 2/0,0 mode: PW/PW res: [0x2b925:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.679684:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c5219b lrc: 3/0,0 mode: PW/PW res: [0x2b925:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.679688:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c5219b lrc: 1/0,0 mode: --/PW res: [0x2b925:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.679691:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c5219b lrc: 0/0,0 mode: --/PW res: [0x2b925:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.679692:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.679695:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c521a9 lrc: 2/0,0 mode: PW/PW res: [0x2b927:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.679697:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fc4c513 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.679698:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c521a9 lrc: 2/0,0 mode: PW/PW res: [0x2b927:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.679701:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c521a9 lrc: 3/0,0 mode: PW/PW res: [0x2b927:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.679704:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c521a9 lrc: 1/0,0 mode: --/PW res: [0x2b927:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.679706:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c521a9 lrc: 0/0,0 mode: --/PW res: [0x2b927:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.679722:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.679770:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396394688 00010000:00010000:1.0:1651529344.679776:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f72cf775/0x3234de053c4cdcc lrc: 4/0,0 mode: PR/PR res: [0x2b928:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce8ca expref: 542 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.679788:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396394880 00000100:00100000:0.0:1651529344.679793:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002f363f4a pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997036416:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.679797:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000c8c3c22/0x3234de053c4eed4 lrc: 5/0,0 mode: PR/PR res: [0x2b929:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d3e expref: 543 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.679798:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d1130404/0x3234de053c521b7 lrc: 3/0,1 mode: --/PW res: [0x2b92a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.679807:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12806 00000100:00100000:1.0:1651529344.679809:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1a0028d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+543:41279:x1731746396394688:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.679812:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.679813:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f72cf775/0x3234de053c4cdcc lrc: 4/0,0 mode: PR/PR res: [0x2b928:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce8ca expref: 543 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.679814:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12807 00000100:00100000:0.0:1651529344.679816:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+543:41279:x1731746396394880:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.679817:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f72cf775/0x3234de053c4cdcc lrc: 3/0,0 mode: PR/PR res: [0x2b928:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce8ca expref: 543 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.679820:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.679822:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000c8c3c22/0x3234de053c4eed4 lrc: 5/0,0 mode: PR/PR res: [0x2b929:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d3e expref: 543 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.679825:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f72cf775/0x3234de053c4cdcc lrc: 0/0,0 mode: --/PR res: [0x2b928:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce8ca expref: 543 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.679829:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.679829:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.679830:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c521b0 lrc: 3/0,1 mode: PW/PW res: [0x2b928:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.679833:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c521b0 lrc: 4/0,1 mode: PW/PW res: [0x2b928:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.679840:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.679842:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000c8c3c22/0x3234de053c4eed4 lrc: 4/0,0 mode: PR/PR res: [0x2b929:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d3e expref: 542 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.679848:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.679848:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.679851:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1a0028d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+542:41279:x1731746396394688:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.679854:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12806 00010000:00010000:0.0:1651529344.679855:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c521be lrc: 3/0,1 mode: PW/PW res: [0x2b929:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.679858:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c521be lrc: 4/0,1 mode: PW/PW res: [0x2b929:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.679863:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.679868:0:80279:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c8c3c22/0x3234de053c4eed4 lrc: 0/0,0 mode: --/PR res: [0x2b929:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d3e expref: 541 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.679871:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+541:41279:x1731746396394880:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 54us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.679873:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007c534a1e pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997036352:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.679873:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12807 00010000:00010000:1.0:1651529344.679876:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c521be lrc: 3/0,1 mode: PW/PW res: [0x2b929:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.679879:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c521be lrc: 3/0,1 mode: PW/PW res: [0x2b929:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.679882:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c521be lrc: 3/0,1 mode: PW/PW res: [0x2b929:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.679885:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c521be lrc: 3/0,1 mode: PW/PW res: [0x2b929:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.679888:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c521be lrc: 2/0,0 mode: PW/PW res: [0x2b929:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.679906:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c521be lrc: 2/0,0 mode: PW/PW res: [0x2b929:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.679927:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008517b233 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.679928:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c521be lrc: 2/0,0 mode: PW/PW res: [0x2b929:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.679931:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c521be lrc: 3/0,0 mode: PW/PW res: [0x2b929:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.679936:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c521be lrc: 1/0,0 mode: --/PW res: [0x2b929:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.679937:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1521:39030:x1731745946513920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 770us (794us total) trans 12885080079 rc 0/0 00010000:00010000:0.0:1651529344.679939:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c521be lrc: 0/0,0 mode: --/PW res: [0x2b929:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.679940:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212026 00010000:00010000:1.0:1651529344.679948:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c521b0 lrc: 3/0,1 mode: PW/PW res: [0x2b928:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.679951:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c521b0 lrc: 3/0,1 mode: PW/PW res: [0x2b928:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.679953:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.679955:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c521b0 lrc: 3/0,1 mode: PW/PW res: [0x2b928:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.679957:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c521b0 lrc: 2/0,0 mode: PW/PW res: [0x2b928:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.679986:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.680015:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1521:39030:x1731745946513472:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1393us (1420us total) trans 12885080080 rc 0/0 00000100:00100000:0.0:1651529344.680018:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.680035:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212024 00000100:00100000:0.0:1651529344.680042:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.680046:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946514048 00000100:00100000:0.0:1651529344.680050:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.680053:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946514112 00000100:00100000:1.0:1651529344.680056:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946514240 00010000:00010000:0.0:1651529344.680056:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c521b0 lrc: 2/0,0 mode: PW/PW res: [0x2b928:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.680059:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946514176 00010000:00010000:0.0:1651529344.680059:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001391dc6d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.680060:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c521b0 lrc: 2/0,0 mode: PW/PW res: [0x2b928:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.680063:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c521b0 lrc: 3/0,0 mode: PW/PW res: [0x2b928:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.680066:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946514304 00000100:00100000:1.0:1651529344.680070:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212027 00000100:00100000:1.0:1651529344.680072:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1525:39030:x1731745946514048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.680077:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178475 count 1 00010000:00010000:1.0:1651529344.680081:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c521c5 lrc: 3/0,1 mode: --/PW res: [0x2b92b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680085:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cd04e5e8/0x3234de053c4dbcc lrc: 2/0,0 mode: PR/PR res: [0x2b92b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f50 expref: 539 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.680087:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c521b0 lrc: 1/0,0 mode: --/PW res: [0x2b928:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680088:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.680089:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.680090:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c521c5 lrc: 4/0,1 mode: --/PW res: [0x2b92b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.680090:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c521b0 lrc: 0/0,0 mode: --/PW res: [0x2b928:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680096:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cd04e5e8/0x3234de053c4dbcc lrc: 3/0,0 mode: PR/PR res: [0x2b92b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f50 expref: 539 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.680099:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212028 00010000:00010000:1.0:1651529344.680100:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cd04e5e8/0x3234de053c4dbcc lrc: 4/0,0 mode: PR/PR res: [0x2b92b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f50 expref: 539 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.680101:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a4625808 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1525:39029:x1731745946514112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.680104:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000078a40aa9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997036480:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.680106:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178476 count 1 00010000:00010000:0.0:1651529344.680109:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066a6b134/0x3234de053c521cc lrc: 3/0,1 mode: --/PW res: [0x2b92c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.680114:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ddbfcc58/0x3234de053c4e183 lrc: 2/0,0 mode: PR/PR res: [0x2b92c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d370c expref: 539 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.680117:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a4eb401d going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.680124:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212029 00010000:00010000:0.0:1651529344.680124:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.680124:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.680125:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066a6b134/0x3234de053c521cc lrc: 4/0,1 mode: --/PW res: [0x2b92c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.680126:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1525:39029:x1731745946514240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.680130:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178478 count 1 00010000:00010000:0.0:1651529344.680132:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ddbfcc58/0x3234de053c4e183 lrc: 3/0,0 mode: PR/PR res: [0x2b92c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d370c expref: 539 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.680134:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c521d3 lrc: 3/0,1 mode: --/PW res: [0x2b92e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.680136:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ddbfcc58/0x3234de053c4e183 lrc: 4/0,0 mode: PR/PR res: [0x2b92c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d370c expref: 539 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.680138:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006198627b/0x3234de053c4d6ee lrc: 2/0,0 mode: PR/PR res: [0x2b92e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d75 expref: 539 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.680141:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.680141:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.680142:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c521d3 lrc: 4/0,1 mode: --/PW res: [0x2b92e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.680143:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002f77bb41 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997036544:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.680148:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006198627b/0x3234de053c4d6ee lrc: 3/0,0 mode: PR/PR res: [0x2b92e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d75 expref: 539 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.680152:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006198627b/0x3234de053c4d6ee lrc: 4/0,0 mode: PR/PR res: [0x2b92e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d75 expref: 539 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.680152:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000003c8b0daf going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.680156:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007c534a1e pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997036608:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.680158:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212030 00000100:00100000:0.0:1651529344.680160:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1525:39030:x1731745946514176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.680162:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 000000004698fefb going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.680164:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178477 count 1 00000100:00100000:1.0:1651529344.680168:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212031 00010000:00010000:0.0:1651529344.680168:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee811cd0/0x3234de053c521da lrc: 3/0,1 mode: --/PW res: [0x2b92d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.680170:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1525:39030:x1731745946514304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.680172:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000058990195/0x3234de053c4f46f lrc: 2/0,0 mode: PR/PR res: [0x2b92d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d847c expref: 539 pid: 72396 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.680174:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178479 count 1 00010000:00010000:0.0:1651529344.680175:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.680176:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.680176:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee811cd0/0x3234de053c521da lrc: 4/0,1 mode: --/PW res: [0x2b92d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680177:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c521e1 lrc: 3/0,1 mode: --/PW res: [0x2b92f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680181:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000df5c03f8/0x3234de053c4ebcb lrc: 2/0,0 mode: PR/PR res: [0x2b92f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d60bf expref: 539 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.680182:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000058990195/0x3234de053c4f46f lrc: 3/0,0 mode: PR/PR res: [0x2b92d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d847c expref: 539 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.680186:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.680187:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.680188:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c521e1 lrc: 4/0,1 mode: --/PW res: [0x2b92f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680193:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000df5c03f8/0x3234de053c4ebcb lrc: 3/0,0 mode: PR/PR res: [0x2b92f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d60bf expref: 539 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.680197:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000df5c03f8/0x3234de053c4ebcb lrc: 4/0,0 mode: PR/PR res: [0x2b92f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d60bf expref: 539 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.680199:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000058990195/0x3234de053c4f46f lrc: 4/0,0 mode: PR/PR res: [0x2b92d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d847c expref: 539 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.680200:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003562cf4d pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997036736:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.680204:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002f363f4a pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997036672:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.680206:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 000000004ca54b8a going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.680212:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060852af0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.680241:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.680247:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.680259:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.680270:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396394944 00010000:00010000:1.0:1651529344.680275:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006b6970d7/0x3234de053c4ed84 lrc: 4/0,0 mode: PR/PR res: [0x2b92a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d688a expref: 540 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.680287:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946514368 00000100:00100000:0.0:1651529344.680298:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946514432 00000100:00100000:0.0:1651529344.680303:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212032 00000100:00100000:0.0:1651529344.680305:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1527:39029:x1731745946514368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.680310:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12808 00002000:00080000:0.0:1651529344.680310:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178480 count 1 00010000:00010000:0.0:1651529344.680314:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d11dbc49/0x3234de053c521e8 lrc: 3/0,1 mode: --/PW res: [0x2b930:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.680317:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+540:41278:x1731746396394944:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.680318:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9f8d9db/0x3234de053c4cb9c lrc: 2/0,0 mode: PR/PR res: [0x2b930:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce034 expref: 540 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.680321:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.680323:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006b6970d7/0x3234de053c4ed84 lrc: 4/0,0 mode: PR/PR res: [0x2b92a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d688a expref: 540 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.680329:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006b6970d7/0x3234de053c4ed84 lrc: 3/0,0 mode: PR/PR res: [0x2b92a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d688a expref: 540 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.680335:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b6970d7/0x3234de053c4ed84 lrc: 0/0,0 mode: --/PR res: [0x2b92a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d688a expref: 540 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.680336:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.680337:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.680338:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d11dbc49/0x3234de053c521e8 lrc: 4/0,1 mode: --/PW res: [0x2b930:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680339:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.680339:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.680340:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d1130404/0x3234de053c521b7 lrc: 3/0,1 mode: PW/PW res: [0x2b92a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680343:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1130404/0x3234de053c521b7 lrc: 4/0,1 mode: PW/PW res: [0x2b92a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.680346:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e9f8d9db/0x3234de053c4cb9c lrc: 3/0,0 mode: PR/PR res: [0x2b930:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce034 expref: 539 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.680350:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e9f8d9db/0x3234de053c4cb9c lrc: 4/0,0 mode: PR/PR res: [0x2b930:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce034 expref: 539 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.680353:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.680361:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000093ddaf92 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997036800:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.680362:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+539:41278:x1731746396394944:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 44us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.680364:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12808 00000100:00100000:0.0:1651529344.680369:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000abca413e going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.680372:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212033 00000100:00100000:1.0:1651529344.680374:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1527:39030:x1731745946514432:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.680374:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d1130404/0x3234de053c521b7 lrc: 3/0,1 mode: PW/PW res: [0x2b92a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.680377:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1130404/0x3234de053c521b7 lrc: 3/0,1 mode: PW/PW res: [0x2b92a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.680379:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178481 count 1 00010000:00010000:0.0:1651529344.680381:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1130404/0x3234de053c521b7 lrc: 3/0,1 mode: PW/PW res: [0x2b92a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680383:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c521ef lrc: 3/0,1 mode: --/PW res: [0x2b931:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.680383:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1130404/0x3234de053c521b7 lrc: 2/0,0 mode: PW/PW res: [0x2b92a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680387:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000022ae140/0x3234de053c4c85b lrc: 2/0,0 mode: PR/PR res: [0x2b931:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd376 expref: 538 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.680392:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.680393:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.680393:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c521ef lrc: 4/0,1 mode: --/PW res: [0x2b931:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680400:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000022ae140/0x3234de053c4c85b lrc: 3/0,0 mode: PR/PR res: [0x2b931:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd376 expref: 538 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.680403:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000022ae140/0x3234de053c4c85b lrc: 4/0,0 mode: PR/PR res: [0x2b931:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd376 expref: 538 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.680407:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b0d9532a pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997036864:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.680415:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 0000000020dd7827 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.680425:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1528:39029:x1731745946513984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1263us (1292us total) trans 12885080081 rc 0/0 00000100:00100000:0.0:1651529344.680428:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212025 00010000:00010000:0.0:1651529344.680435:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1130404/0x3234de053c521b7 lrc: 2/0,0 mode: PW/PW res: [0x2b92a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.680438:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d1130404 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.680439:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1130404/0x3234de053c521b7 lrc: 2/0,0 mode: PW/PW res: [0x2b92a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.680442:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1130404/0x3234de053c521b7 lrc: 3/0,0 mode: PW/PW res: [0x2b92a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.680447:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1130404/0x3234de053c521b7 lrc: 1/0,0 mode: --/PW res: [0x2b92a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.680449:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1130404/0x3234de053c521b7 lrc: 0/0,0 mode: --/PW res: [0x2b92a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.680623:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.680632:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946514944 00000100:00100000:1.0:1651529344.680641:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.680644:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212034 00000100:00100000:0.0:1651529344.680646:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1528:39030:x1731745946514944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.680648:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:0.0:1651529344.680651:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178482 count 1 00000100:00100000:1.0:1651529344.680654:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.680655:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2323f96/0x3234de053c521f6 lrc: 3/0,1 mode: --/PW res: [0x2b932:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.680665:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008acce999/0x3234de053c4f406 lrc: 2/0,0 mode: PR/PR res: [0x2b932:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8276 expref: 538 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.680668:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.680669:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.680670:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2323f96/0x3234de053c521f6 lrc: 4/0,1 mode: --/PW res: [0x2b932:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.680671:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007c534a1e pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997036608:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.680675:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c521d3 lrc: 3/0,1 mode: --/PW res: [0x2b92e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.680677:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008acce999/0x3234de053c4f406 lrc: 3/0,0 mode: PR/PR res: [0x2b932:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8276 expref: 538 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.680680:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008acce999/0x3234de053c4f406 lrc: 4/0,0 mode: PR/PR res: [0x2b932:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8276 expref: 538 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.680682:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396395264 00000100:00100000:0.0:1651529344.680685:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005384a251 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997036928:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.680686:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cd04e5e8/0x3234de053c4dbcc lrc: 5/0,0 mode: PR/PR res: [0x2b92b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f50 expref: 539 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.680693:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12809 00000100:00100000:1.0:1651529344.680694:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+539:41279:x1731746396395264:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.680696:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 0000000009370c1d going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.680697:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.680698:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cd04e5e8/0x3234de053c4dbcc lrc: 5/0,0 mode: PR/PR res: [0x2b92b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f50 expref: 539 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.680702:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cd04e5e8/0x3234de053c4dbcc lrc: 4/0,0 mode: PR/PR res: [0x2b92b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f50 expref: 539 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.680702:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002f77bb41 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997036544:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.680706:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000066a6b134/0x3234de053c521cc lrc: 3/0,1 mode: --/PW res: [0x2b92c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680707:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.680708:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.680709:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c521c5 lrc: 3/0,1 mode: PW/PW res: [0x2b92b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680712:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c521c5 lrc: 4/0,1 mode: PW/PW res: [0x2b92b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680716:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.680722:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+539:41279:x1731746396395264:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 28us (83us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.680725:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12809 00000100:00100000:1.0:1651529344.680729:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396395200 00010000:00010000:1.0:1651529344.680732:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006198627b/0x3234de053c4d6ee lrc: 4/0,0 mode: PR/PR res: [0x2b92e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d75 expref: 539 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.680750:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396395328 00010000:00010000:0.0:1651529344.680756:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ddbfcc58/0x3234de053c4e183 lrc: 4/0,0 mode: PR/PR res: [0x2b92c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d370c expref: 540 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.680763:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12810 00000100:00100000:0.0:1651529344.680764:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+540:41279:x1731746396395328:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.680767:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.680768:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ddbfcc58/0x3234de053c4e183 lrc: 4/0,0 mode: PR/PR res: [0x2b92c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d370c expref: 540 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.680772:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12811 00010000:00010000:0.0:1651529344.680772:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ddbfcc58/0x3234de053c4e183 lrc: 3/0,0 mode: PR/PR res: [0x2b92c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d370c expref: 540 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.680774:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+540:41279:x1731746396395200:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.680777:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.680777:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ddbfcc58/0x3234de053c4e183 lrc: 0/0,0 mode: --/PR res: [0x2b92c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d370c expref: 540 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.680778:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006198627b/0x3234de053c4d6ee lrc: 4/0,0 mode: PR/PR res: [0x2b92e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d75 expref: 540 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.680781:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.680781:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.680782:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000066a6b134/0x3234de053c521cc lrc: 3/0,1 mode: PW/PW res: [0x2b92c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680783:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006198627b/0x3234de053c4d6ee lrc: 3/0,0 mode: PR/PR res: [0x2b92e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d75 expref: 539 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.680785:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066a6b134/0x3234de053c521cc lrc: 4/0,1 mode: PW/PW res: [0x2b92c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680788:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006198627b/0x3234de053c4d6ee lrc: 0/0,0 mode: --/PR res: [0x2b92e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d75 expref: 539 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.680791:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.680792:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.680792:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.680793:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c521d3 lrc: 3/0,1 mode: PW/PW res: [0x2b92e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680796:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c521d3 lrc: 4/0,1 mode: PW/PW res: [0x2b92e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.680803:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+538:41279:x1731746396395328:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 38us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.680806:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12810 00010000:00010000:1.0:1651529344.680809:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.680813:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000066a6b134/0x3234de053c521cc lrc: 3/0,1 mode: PW/PW res: [0x2b92c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.680816:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+537:41279:x1731746396395200:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 41us (168us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.680816:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066a6b134/0x3234de053c521cc lrc: 3/0,1 mode: PW/PW res: [0x2b92c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.680819:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12811 00010000:00010000:0.0:1651529344.680819:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066a6b134/0x3234de053c521cc lrc: 3/0,1 mode: PW/PW res: [0x2b92c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.680822:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066a6b134/0x3234de053c521cc lrc: 2/0,0 mode: PW/PW res: [0x2b92c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.680828:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003562cf4d pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997036736:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.680832:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c521e1 lrc: 3/0,1 mode: --/PW res: [0x2b92f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680839:0:80280:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd04e5e8/0x3234de053c4dbcc lrc: 0/0,0 mode: --/PR res: [0x2b92b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f50 expref: 536 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.680843:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000078a40aa9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997036480:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.680846:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c521c5 lrc: 3/0,1 mode: PW/PW res: [0x2b92b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680849:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c521c5 lrc: 3/0,1 mode: PW/PW res: [0x2b92b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680851:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c521c5 lrc: 3/0,1 mode: PW/PW res: [0x2b92b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680854:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c521c5 lrc: 3/0,1 mode: PW/PW res: [0x2b92b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680857:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c521c5 lrc: 2/0,0 mode: PW/PW res: [0x2b92b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.680862:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a4625808 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1529:39029:x1731745946514112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 760us (875us total) trans 12885080082 rc 0/0 00000100:00100000:0.0:1651529344.680887:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212028 00010000:00010000:0.0:1651529344.680895:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066a6b134/0x3234de053c521cc lrc: 2/0,0 mode: PW/PW res: [0x2b92c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.680898:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000066a6b134 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.680899:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066a6b134/0x3234de053c521cc lrc: 2/0,0 mode: PW/PW res: [0x2b92c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.680900:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1529:39030:x1731745946514048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 828us (947us total) trans 12885080083 rc 0/0 00010000:00010000:0.0:1651529344.680902:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066a6b134/0x3234de053c521cc lrc: 3/0,0 mode: PW/PW res: [0x2b92c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.680903:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212027 00010000:00010000:0.0:1651529344.680907:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066a6b134/0x3234de053c521cc lrc: 1/0,0 mode: --/PW res: [0x2b92c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.680910:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066a6b134/0x3234de053c521cc lrc: 0/0,0 mode: --/PW res: [0x2b92c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.680914:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c521c5 lrc: 2/0,0 mode: PW/PW res: [0x2b92b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.680917:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006401eb97 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.680917:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c521c5 lrc: 2/0,0 mode: PW/PW res: [0x2b92b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.680920:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c521c5 lrc: 3/0,0 mode: PW/PW res: [0x2b92b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680923:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c521d3 lrc: 3/0,1 mode: PW/PW res: [0x2b92e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.680923:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c521c5 lrc: 1/0,0 mode: --/PW res: [0x2b92b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680926:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c521d3 lrc: 3/0,1 mode: PW/PW res: [0x2b92e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.680926:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c521c5 lrc: 0/0,0 mode: --/PW res: [0x2b92b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680930:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c521d3 lrc: 3/0,1 mode: PW/PW res: [0x2b92e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.680932:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c521d3 lrc: 2/0,0 mode: PW/PW res: [0x2b92e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.680948:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.680991:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1529:39029:x1731745946514240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 864us (973us total) trans 12885080084 rc 0/0 00000100:00100000:1.0:1651529344.681000:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212029 00010000:00010000:0.0:1651529344.681007:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c521d3 lrc: 2/0,0 mode: PW/PW res: [0x2b92e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.681008:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396395392 00010000:00010000:0.0:1651529344.681011:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f0bd9bfb already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.681012:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c521d3 lrc: 2/0,0 mode: PW/PW res: [0x2b92e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681013:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000df5c03f8/0x3234de053c4ebcb lrc: 4/0,0 mode: PR/PR res: [0x2b92f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d60bf expref: 536 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.681018:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c521d3 lrc: 3/0,0 mode: PW/PW res: [0x2b92e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.681020:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12812 00000100:00100000:1.0:1651529344.681021:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+536:41279:x1731746396395392:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.681022:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c521d3 lrc: 1/0,0 mode: --/PW res: [0x2b92e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681024:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.681025:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000df5c03f8/0x3234de053c4ebcb lrc: 4/0,0 mode: PR/PR res: [0x2b92f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d60bf expref: 536 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.681025:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c521d3 lrc: 0/0,0 mode: --/PW res: [0x2b92e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681029:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000df5c03f8/0x3234de053c4ebcb lrc: 3/0,0 mode: PR/PR res: [0x2b92f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d60bf expref: 536 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.681034:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df5c03f8/0x3234de053c4ebcb lrc: 0/0,0 mode: --/PR res: [0x2b92f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d60bf expref: 536 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.681038:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.681038:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.681039:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c521e1 lrc: 3/0,1 mode: PW/PW res: [0x2b92f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681042:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c521e1 lrc: 4/0,1 mode: PW/PW res: [0x2b92f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681048:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.681055:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+535:41279:x1731746396395392:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 33us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.681064:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12812 00000100:00100000:0.0:1651529344.681074:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002f363f4a pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997036672:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.681078:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c521e1 lrc: 3/0,1 mode: PW/PW res: [0x2b92f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681079:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ee811cd0/0x3234de053c521da lrc: 3/0,1 mode: --/PW res: [0x2b92d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681082:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c521e1 lrc: 3/0,1 mode: PW/PW res: [0x2b92f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681085:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c521e1 lrc: 3/0,1 mode: PW/PW res: [0x2b92f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681088:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c521e1 lrc: 2/0,0 mode: PW/PW res: [0x2b92f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681107:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c521e1 lrc: 2/0,0 mode: PW/PW res: [0x2b92f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681111:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004dda5a3f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.681112:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c521e1 lrc: 2/0,0 mode: PW/PW res: [0x2b92f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681115:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c521e1 lrc: 3/0,0 mode: PW/PW res: [0x2b92f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681119:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c521e1 lrc: 1/0,0 mode: --/PW res: [0x2b92f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.681132:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1529:39030:x1731745946514304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 961us (1081us total) trans 12885080085 rc 0/0 00000100:00100000:1.0:1651529344.681135:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212031 00010000:00010000:0.0:1651529344.681140:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c521e1 lrc: 0/0,0 mode: --/PW res: [0x2b92f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.681182:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.681189:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946515072 00000100:00100000:1.0:1651529344.681196:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212035 00000100:00100000:1.0:1651529344.681197:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1529:39030:x1731745946515072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.681201:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529344.681202:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178483 count 1 00010000:00010000:1.0:1651529344.681213:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b8823b9/0x3234de053c521fd lrc: 3/0,1 mode: --/PW res: [0x2b933:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681218:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001933f8c2/0x3234de053c4d88b lrc: 2/0,0 mode: PR/PR res: [0x2b933:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d12f4 expref: 534 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.681221:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.681221:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.681233:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b8823b9/0x3234de053c521fd lrc: 4/0,1 mode: --/PW res: [0x2b933:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681241:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001933f8c2/0x3234de053c4d88b lrc: 3/0,0 mode: PR/PR res: [0x2b933:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d12f4 expref: 534 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.681244:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001933f8c2/0x3234de053c4d88b lrc: 4/0,0 mode: PR/PR res: [0x2b933:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d12f4 expref: 534 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.681261:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000900b179f pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997036992:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.681275:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8a0b704 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.681283:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946515136 00000100:00100000:1.0:1651529344.681294:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212036 00000100:00100000:1.0:1651529344.681295:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1530:39030:x1731745946515136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.681297:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529344.681300:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178484 count 1 00010000:00010000:1.0:1651529344.681304:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e3070d2/0x3234de053c52204 lrc: 3/0,1 mode: --/PW res: [0x2b934:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681308:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cb953fbb/0x3234de053c4eba1 lrc: 2/0,0 mode: PR/PR res: [0x2b934:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6017 expref: 534 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.681314:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.681315:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.681315:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e3070d2/0x3234de053c52204 lrc: 4/0,1 mode: --/PW res: [0x2b934:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.681327:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.681330:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cb953fbb/0x3234de053c4eba1 lrc: 3/0,0 mode: PR/PR res: [0x2b934:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6017 expref: 534 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.681343:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cb953fbb/0x3234de053c4eba1 lrc: 4/0,0 mode: PR/PR res: [0x2b934:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6017 expref: 534 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.681347:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005912c4a3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997037056:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.681348:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.681358:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.681360:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a4eb401d going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.681370:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946515200 00000100:00100000:1.0:1651529344.681376:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946515264 00000100:00100000:0.0:1651529344.681381:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.681390:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.681394:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212037 00000100:00100000:1.0:1651529344.681396:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1532:39030:x1731745946515200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.681398:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212038 00002000:00080000:1.0:1651529344.681400:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178485 count 1 00000100:00100000:0.0:1651529344.681401:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1532:39029:x1731745946515264:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.681404:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fa78486/0x3234de053c5220b lrc: 3/0,1 mode: --/PW res: [0x2b935:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.681406:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178486 count 1 00010000:00010000:1.0:1651529344.681408:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ca2c1336/0x3234de053c4d018 lrc: 2/0,0 mode: PR/PR res: [0x2b935:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf1b4 expref: 534 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.681411:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.681411:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f80e4dc2/0x3234de053c52212 lrc: 3/0,1 mode: --/PW res: [0x2b936:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681412:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.681413:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fa78486/0x3234de053c5220b lrc: 4/0,1 mode: --/PW res: [0x2b935:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681416:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006dce3607/0x3234de053c4dd15 lrc: 2/0,0 mode: PR/PR res: [0x2b936:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2523 expref: 534 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.681419:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ca2c1336/0x3234de053c4d018 lrc: 3/0,0 mode: PR/PR res: [0x2b935:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf1b4 expref: 534 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.681419:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.681419:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.681420:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f80e4dc2/0x3234de053c52212 lrc: 4/0,1 mode: --/PW res: [0x2b936:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681423:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ca2c1336/0x3234de053c4d018 lrc: 4/0,0 mode: PR/PR res: [0x2b935:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf1b4 expref: 534 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.681426:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f9050c71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997037120:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.681427:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006dce3607/0x3234de053c4dd15 lrc: 3/0,0 mode: PR/PR res: [0x2b936:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2523 expref: 534 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.681434:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006dce3607/0x3234de053c4dd15 lrc: 4/0,0 mode: PR/PR res: [0x2b936:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2523 expref: 534 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.681440:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000499d0377 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.681445:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002f363f4a pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997037184:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.681448:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b0d9532a pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997036864:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.681452:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c521ef lrc: 3/0,1 mode: --/PW res: [0x2b931:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.681454:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060852af0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.681458:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396395712 00000100:00100000:0.0:1651529344.681462:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005384a251 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997036928:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.681463:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000058990195/0x3234de053c4f46f lrc: 4/0,0 mode: PR/PR res: [0x2b92d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d847c expref: 535 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.681465:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f2323f96/0x3234de053c521f6 lrc: 3/0,1 mode: --/PW res: [0x2b932:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.681468:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396395840 00010000:00010000:1.0:1651529344.681470:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e9f8d9db/0x3234de053c4cb9c lrc: 5/0,0 mode: PR/PR res: [0x2b930:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce034 expref: 536 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.681472:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000093ddaf92 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997036800:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.681474:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396395968 00010000:00010000:0.0:1651529344.681474:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d11dbc49/0x3234de053c521e8 lrc: 3/0,1 mode: --/PW res: [0x2b930:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681476:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008acce999/0x3234de053c4f406 lrc: 4/0,0 mode: PR/PR res: [0x2b932:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8276 expref: 537 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.681480:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396395904 00010000:00010000:1.0:1651529344.681482:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000022ae140/0x3234de053c4c85b lrc: 4/0,0 mode: PR/PR res: [0x2b931:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd376 expref: 538 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.681487:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12813 00000100:00100000:1.0:1651529344.681489:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012f61efb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+538:41278:x1731746396395712:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.681491:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.681492:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000058990195/0x3234de053c4f46f lrc: 4/0,0 mode: PR/PR res: [0x2b92d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d847c expref: 538 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.681496:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000058990195/0x3234de053c4f46f lrc: 3/0,0 mode: PR/PR res: [0x2b92d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d847c expref: 538 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.681501:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058990195/0x3234de053c4f46f lrc: 0/0,0 mode: --/PR res: [0x2b92d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d847c expref: 538 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.681504:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.681505:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.681506:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee811cd0/0x3234de053c521da lrc: 3/0,1 mode: PW/PW res: [0x2b92d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681509:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee811cd0/0x3234de053c521da lrc: 4/0,1 mode: PW/PW res: [0x2b92d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681524:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ee811cd0/0x3234de053c521da lrc: 3/0,1 mode: PW/PW res: [0x2b92d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681525:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.681528:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee811cd0/0x3234de053c521da lrc: 3/0,1 mode: PW/PW res: [0x2b92d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681531:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee811cd0/0x3234de053c521da lrc: 3/0,1 mode: PW/PW res: [0x2b92d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.681537:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012f61efb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+537:41278:x1731746396395712:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 47us (189us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.681538:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee811cd0/0x3234de053c521da lrc: 2/0,0 mode: PW/PW res: [0x2b92d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.681539:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12813 00000100:00100000:1.0:1651529344.681549:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12814 00000100:00100000:1.0:1651529344.681550:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+536:41278:x1731746396395840:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.681553:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.681554:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e9f8d9db/0x3234de053c4cb9c lrc: 4/0,0 mode: PR/PR res: [0x2b930:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce034 expref: 536 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.681558:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e9f8d9db/0x3234de053c4cb9c lrc: 3/0,0 mode: PR/PR res: [0x2b930:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce034 expref: 536 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.681563:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9f8d9db/0x3234de053c4cb9c lrc: 0/0,0 mode: --/PR res: [0x2b930:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce034 expref: 536 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.681566:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.681567:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.681568:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d11dbc49/0x3234de053c521e8 lrc: 3/0,1 mode: PW/PW res: [0x2b930:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681570:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d11dbc49/0x3234de053c521e8 lrc: 4/0,1 mode: PW/PW res: [0x2b930:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681578:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.681584:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+535:41278:x1731746396395840:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.681586:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12814 00000100:00100000:1.0:1651529344.681590:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12815 00000100:00100000:1.0:1651529344.681592:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+534:41278:x1731746396395968:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.681594:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.681595:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008acce999/0x3234de053c4f406 lrc: 4/0,0 mode: PR/PR res: [0x2b932:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8276 expref: 534 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.681599:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008acce999/0x3234de053c4f406 lrc: 3/0,0 mode: PR/PR res: [0x2b932:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8276 expref: 534 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.681601:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1533:39030:x1731745946514176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1440us (1559us total) trans 12885080086 rc 0/0 00010000:00010000:1.0:1651529344.681604:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008acce999/0x3234de053c4f406 lrc: 0/0,0 mode: --/PR res: [0x2b932:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8276 expref: 534 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.681605:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212030 00010000:00010000:1.0:1651529344.681607:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.681607:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.681608:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f2323f96/0x3234de053c521f6 lrc: 3/0,1 mode: PW/PW res: [0x2b932:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681611:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2323f96/0x3234de053c521f6 lrc: 4/0,1 mode: PW/PW res: [0x2b932:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681612:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee811cd0/0x3234de053c521da lrc: 2/0,0 mode: PW/PW res: [0x2b92d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681616:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ee811cd0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.681617:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee811cd0/0x3234de053c521da lrc: 2/0,0 mode: PW/PW res: [0x2b92d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681619:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.681624:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+533:41278:x1731746396395968:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.681626:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12815 00010000:00010000:0.0:1651529344.681626:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee811cd0/0x3234de053c521da lrc: 3/0,0 mode: PW/PW res: [0x2b92d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.681630:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12816 00010000:00010000:0.0:1651529344.681631:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee811cd0/0x3234de053c521da lrc: 1/0,0 mode: --/PW res: [0x2b92d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.681632:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+532:41279:x1731746396395904:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.681634:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.681634:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee811cd0/0x3234de053c521da lrc: 0/0,0 mode: --/PW res: [0x2b92d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681635:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000022ae140/0x3234de053c4c85b lrc: 4/0,0 mode: PR/PR res: [0x2b931:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd376 expref: 532 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.681639:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000022ae140/0x3234de053c4c85b lrc: 3/0,0 mode: PR/PR res: [0x2b931:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd376 expref: 532 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.681640:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f2323f96/0x3234de053c521f6 lrc: 3/0,1 mode: PW/PW res: [0x2b932:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681643:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000022ae140/0x3234de053c4c85b lrc: 0/0,0 mode: --/PR res: [0x2b931:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd376 expref: 532 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.681643:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2323f96/0x3234de053c521f6 lrc: 3/0,1 mode: PW/PW res: [0x2b932:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681646:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2323f96/0x3234de053c521f6 lrc: 3/0,1 mode: PW/PW res: [0x2b932:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681647:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.681647:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.681648:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c521ef lrc: 3/0,1 mode: PW/PW res: [0x2b931:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681650:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2323f96/0x3234de053c521f6 lrc: 2/0,0 mode: PW/PW res: [0x2b932:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681651:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c521ef lrc: 4/0,1 mode: PW/PW res: [0x2b931:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681657:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.681661:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+531:41279:x1731746396395904:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 29us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.681663:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12816 00010000:00010000:1.0:1651529344.681671:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c521ef lrc: 3/0,1 mode: PW/PW res: [0x2b931:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681674:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c521ef lrc: 3/0,1 mode: PW/PW res: [0x2b931:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681677:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c521ef lrc: 3/0,1 mode: PW/PW res: [0x2b931:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681679:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c521ef lrc: 2/0,0 mode: PW/PW res: [0x2b931:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.681685:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1533:39030:x1731745946514944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1038us (1061us total) trans 12885080087 rc 0/0 00000100:00100000:0.0:1651529344.681687:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212034 00010000:00010000:0.0:1651529344.681701:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d11dbc49/0x3234de053c521e8 lrc: 3/0,1 mode: PW/PW res: [0x2b930:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681705:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d11dbc49/0x3234de053c521e8 lrc: 3/0,1 mode: PW/PW res: [0x2b930:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681708:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d11dbc49/0x3234de053c521e8 lrc: 3/0,1 mode: PW/PW res: [0x2b930:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681710:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d11dbc49/0x3234de053c521e8 lrc: 2/0,0 mode: PW/PW res: [0x2b930:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.681723:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1533:39030:x1731745946514432:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1348us (1464us total) trans 12885080088 rc 0/0 00000100:00100000:1.0:1651529344.681726:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212033 00000100:00100000:0.0:1651529344.681769:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1533:39029:x1731745946514368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1463us (1522us total) trans 12885080089 rc 0/0 00000100:00100000:0.0:1651529344.681772:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212032 00010000:00010000:0.0:1651529344.681779:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2323f96/0x3234de053c521f6 lrc: 2/0,0 mode: PW/PW res: [0x2b932:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681783:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f2323f96 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.681784:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2323f96/0x3234de053c521f6 lrc: 2/0,0 mode: PW/PW res: [0x2b932:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681787:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2323f96/0x3234de053c521f6 lrc: 3/0,0 mode: PW/PW res: [0x2b932:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.681800:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.681805:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2323f96/0x3234de053c521f6 lrc: 1/0,0 mode: --/PW res: [0x2b932:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681808:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2323f96/0x3234de053c521f6 lrc: 0/0,0 mode: --/PW res: [0x2b932:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681813:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c521ef lrc: 2/0,0 mode: PW/PW res: [0x2b931:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681815:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000576f1f12 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.681816:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c521ef lrc: 2/0,0 mode: PW/PW res: [0x2b931:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681825:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c521ef lrc: 3/0,0 mode: PW/PW res: [0x2b931:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.681827:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.681829:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c521ef lrc: 1/0,0 mode: --/PW res: [0x2b931:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681831:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c521ef lrc: 0/0,0 mode: --/PW res: [0x2b931:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681835:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d11dbc49/0x3234de053c521e8 lrc: 2/0,0 mode: PW/PW res: [0x2b930:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681838:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d11dbc49 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.681839:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d11dbc49/0x3234de053c521e8 lrc: 2/0,0 mode: PW/PW res: [0x2b930:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681841:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d11dbc49/0x3234de053c521e8 lrc: 3/0,0 mode: PW/PW res: [0x2b930:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681844:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d11dbc49/0x3234de053c521e8 lrc: 1/0,0 mode: --/PW res: [0x2b930:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681847:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d11dbc49/0x3234de053c521e8 lrc: 0/0,0 mode: --/PW res: [0x2b930:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.681854:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.681857:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002f363f4a pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997037184:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.681860:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f80e4dc2/0x3234de053c52212 lrc: 3/0,1 mode: --/PW res: [0x2b936:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.681875:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396396224 00010000:00010000:0.0:1651529344.681880:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001933f8c2/0x3234de053c4d88b lrc: 5/0,0 mode: PR/PR res: [0x2b933:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d12f4 expref: 531 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.681886:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396396288 00010000:00010000:0.0:1651529344.681888:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cb953fbb/0x3234de053c4eba1 lrc: 5/0,0 mode: PR/PR res: [0x2b934:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6017 expref: 532 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.681892:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396396352 00010000:00010000:0.0:1651529344.681894:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006dce3607/0x3234de053c4dd15 lrc: 4/0,0 mode: PR/PR res: [0x2b936:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2523 expref: 533 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.681899:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12817 00000100:00100000:1.0:1651529344.681901:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+533:41279:x1731746396396224:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.681902:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12818 00000100:00100000:0.0:1651529344.681904:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+533:41279:x1731746396396288:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.681905:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.681906:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.681907:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001933f8c2/0x3234de053c4d88b lrc: 5/0,0 mode: PR/PR res: [0x2b933:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d12f4 expref: 533 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.681908:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cb953fbb/0x3234de053c4eba1 lrc: 5/0,0 mode: PR/PR res: [0x2b934:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6017 expref: 533 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.681911:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001933f8c2/0x3234de053c4d88b lrc: 4/0,0 mode: PR/PR res: [0x2b933:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d12f4 expref: 533 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.681912:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cb953fbb/0x3234de053c4eba1 lrc: 4/0,0 mode: PR/PR res: [0x2b934:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6017 expref: 533 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.681917:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.681917:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.681917:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.681918:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.681918:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008e3070d2/0x3234de053c52204 lrc: 3/0,1 mode: PW/PW res: [0x2b934:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681919:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000b8823b9/0x3234de053c521fd lrc: 3/0,1 mode: PW/PW res: [0x2b933:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.681921:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e3070d2/0x3234de053c52204 lrc: 4/0,1 mode: PW/PW res: [0x2b934:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681922:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b8823b9/0x3234de053c521fd lrc: 4/0,1 mode: PW/PW res: [0x2b933:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681927:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.681935:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+533:41279:x1731746396396224:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 34us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.681939:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12817 00010000:00010000:0.0:1651529344.681941:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.681945:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12819 00000100:00100000:1.0:1651529344.681946:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+532:41278:x1731746396396352:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.681949:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.681949:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+532:41279:x1731746396396288:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 45us (123us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.681950:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006dce3607/0x3234de053c4dd15 lrc: 4/0,0 mode: PR/PR res: [0x2b936:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2523 expref: 532 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.681952:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12818 00010000:00010000:1.0:1651529344.681954:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006dce3607/0x3234de053c4dd15 lrc: 3/0,0 mode: PR/PR res: [0x2b936:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2523 expref: 532 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.681958:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006dce3607/0x3234de053c4dd15 lrc: 0/0,0 mode: --/PR res: [0x2b936:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2523 expref: 531 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.681962:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.681963:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.681963:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f80e4dc2/0x3234de053c52212 lrc: 3/0,1 mode: PW/PW res: [0x2b936:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.681966:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f80e4dc2/0x3234de053c52212 lrc: 4/0,1 mode: PW/PW res: [0x2b936:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.681967:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.681976:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.681981:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+530:41278:x1731746396396352:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 34us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.681984:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12819 00000100:00100000:1.0:1651529344.681988:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396396416 00010000:00010000:1.0:1651529344.681992:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ca2c1336/0x3234de053c4d018 lrc: 5/0,0 mode: PR/PR res: [0x2b935:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf1b4 expref: 530 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.681997:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12820 00000100:00100000:1.0:1651529344.681998:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001cec52dd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+530:41279:x1731746396396416:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.682000:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.682002:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f80e4dc2/0x3234de053c52212 lrc: 3/0,1 mode: PW/PW res: [0x2b936:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.682008:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f80e4dc2/0x3234de053c52212 lrc: 3/0,1 mode: PW/PW res: [0x2b936:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682009:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ca2c1336/0x3234de053c4d018 lrc: 5/0,0 mode: PR/PR res: [0x2b935:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf1b4 expref: 530 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.682012:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f80e4dc2/0x3234de053c52212 lrc: 3/0,1 mode: PW/PW res: [0x2b936:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682013:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ca2c1336/0x3234de053c4d018 lrc: 4/0,0 mode: PR/PR res: [0x2b935:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf1b4 expref: 530 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.682014:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f80e4dc2/0x3234de053c52212 lrc: 2/0,0 mode: PW/PW res: [0x2b936:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682018:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.682018:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.682019:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007fa78486/0x3234de053c5220b lrc: 3/0,1 mode: PW/PW res: [0x2b935:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682022:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fa78486/0x3234de053c5220b lrc: 4/0,1 mode: PW/PW res: [0x2b935:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682026:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.682036:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001cec52dd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+530:41279:x1731746396396416:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 37us (69us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.682039:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12820 00010000:00010000:1.0:1651529344.682053:0:80279:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca2c1336/0x3234de053c4d018 lrc: 0/0,0 mode: --/PR res: [0x2b935:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf1b4 expref: 529 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.682057:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f9050c71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997037120:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.682061:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007fa78486/0x3234de053c5220b lrc: 3/0,1 mode: PW/PW res: [0x2b935:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682064:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007fa78486/0x3234de053c5220b lrc: 3/0,1 mode: PW/PW res: [0x2b935:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682067:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007fa78486/0x3234de053c5220b lrc: 3/0,1 mode: PW/PW res: [0x2b935:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682070:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fa78486/0x3234de053c5220b lrc: 3/0,1 mode: PW/PW res: [0x2b935:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682072:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007fa78486/0x3234de053c5220b lrc: 2/0,0 mode: PW/PW res: [0x2b935:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.682077:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1533:39029:x1731745946515264:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 676us (750us total) trans 12885080090 rc 0/0 00000100:00100000:0.0:1651529344.682102:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212038 00010000:00010000:0.0:1651529344.682110:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f80e4dc2/0x3234de053c52212 lrc: 2/0,0 mode: PW/PW res: [0x2b936:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.682114:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1533:39030:x1731745946515200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 717us (823us total) trans 12885080091 rc 0/0 00010000:00010000:0.0:1651529344.682114:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f80e4dc2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.682115:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f80e4dc2/0x3234de053c52212 lrc: 2/0,0 mode: PW/PW res: [0x2b936:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.682117:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212037 00010000:00010000:0.0:1651529344.682118:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f80e4dc2/0x3234de053c52212 lrc: 3/0,0 mode: PW/PW res: [0x2b936:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.682122:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f80e4dc2/0x3234de053c52212 lrc: 1/0,0 mode: --/PW res: [0x2b936:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.682125:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f80e4dc2/0x3234de053c52212 lrc: 0/0,0 mode: --/PW res: [0x2b936:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682128:0:72397:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001933f8c2/0x3234de053c4d88b lrc: 0/0,0 mode: --/PR res: [0x2b933:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d12f4 expref: 528 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.682130:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007fa78486/0x3234de053c5220b lrc: 2/0,0 mode: PW/PW res: [0x2b935:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.682132:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000900b179f pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997036992:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.682133:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007fa78486 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.682134:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007fa78486/0x3234de053c5220b lrc: 2/0,0 mode: PW/PW res: [0x2b935:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682135:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000b8823b9/0x3234de053c521fd lrc: 3/0,1 mode: PW/PW res: [0x2b933:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.682136:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007fa78486/0x3234de053c5220b lrc: 3/0,0 mode: PW/PW res: [0x2b935:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682138:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000b8823b9/0x3234de053c521fd lrc: 3/0,1 mode: PW/PW res: [0x2b933:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.682139:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007fa78486/0x3234de053c5220b lrc: 1/0,0 mode: --/PW res: [0x2b935:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.682142:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fa78486/0x3234de053c5220b lrc: 0/0,0 mode: --/PW res: [0x2b935:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682143:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b8823b9/0x3234de053c521fd lrc: 3/0,1 mode: PW/PW res: [0x2b933:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682146:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b8823b9/0x3234de053c521fd lrc: 3/0,1 mode: PW/PW res: [0x2b933:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682149:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b8823b9/0x3234de053c521fd lrc: 2/0,0 mode: PW/PW res: [0x2b933:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.682170:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.682197:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.682209:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.682210:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1533:39030:x1731745946515072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1012us (1028us total) trans 12885080092 rc 0/0 00000100:00100000:1.0:1651529344.682213:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212035 00000100:00100000:1.0:1651529344.682218:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946515712 00000100:00100000:0.0:1651529344.682220:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.682250:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946515776 00000100:00100000:1.0:1651529344.682258:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946515840 00000100:00100000:1.0:1651529344.682262:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946515904 00000100:00100000:1.0:1651529344.682266:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212039 00000100:00100000:1.0:1651529344.682267:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1536:39030:x1731745946515712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.682272:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178487 count 1 00010000:00010000:0.0:1651529344.682274:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b8823b9/0x3234de053c521fd lrc: 2/0,0 mode: PW/PW res: [0x2b933:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.682278:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000b8823b9 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.682279:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b8823b9/0x3234de053c521fd lrc: 2/0,0 mode: PW/PW res: [0x2b933:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682284:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083a35be2/0x3234de053c52219 lrc: 3/0,1 mode: --/PW res: [0x2b937:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.682284:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b8823b9/0x3234de053c521fd lrc: 3/0,0 mode: PW/PW res: [0x2b933:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682288:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004f4986fb/0x3234de053c4df8b lrc: 2/0,0 mode: PR/PR res: [0x2b937:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f41 expref: 527 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.682289:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b8823b9/0x3234de053c521fd lrc: 1/0,0 mode: --/PW res: [0x2b933:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682291:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.682291:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b8823b9/0x3234de053c521fd lrc: 0/0,0 mode: --/PW res: [0x2b933:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682292:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.682293:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083a35be2/0x3234de053c52219 lrc: 4/0,1 mode: --/PW res: [0x2b937:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.682299:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212040 00010000:00010000:1.0:1651529344.682300:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004f4986fb/0x3234de053c4df8b lrc: 3/0,0 mode: PR/PR res: [0x2b937:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f41 expref: 527 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.682301:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1536:39029:x1731745946515776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.682304:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004f4986fb/0x3234de053c4df8b lrc: 4/0,0 mode: PR/PR res: [0x2b937:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f41 expref: 527 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:0.0:1651529344.682307:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178488 count 1 00000100:00100000:1.0:1651529344.682308:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f9050c71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997037248:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.682310:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a562d62/0x3234de053c52220 lrc: 3/0,1 mode: --/PW res: [0x2b938:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.682315:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002887e00b/0x3234de053c4ab27 lrc: 2/0,0 mode: PR/PR res: [0x2b938:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbdd5 expref: 527 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.682318:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.682322:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fe434b1c going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.682339:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.682340:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a562d62/0x3234de053c52220 lrc: 4/0,1 mode: --/PW res: [0x2b938:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.682348:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002887e00b/0x3234de053c4ab27 lrc: 3/0,0 mode: PR/PR res: [0x2b938:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbdd5 expref: 527 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.682352:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002887e00b/0x3234de053c4ab27 lrc: 4/0,0 mode: PR/PR res: [0x2b938:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbdd5 expref: 527 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.682357:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005d2b5bb3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997037312:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.682366:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ff7bf023 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.682373:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212041 00000100:00100000:0.0:1651529344.682375:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1536:39030:x1731745946515840:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.682379:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178489 count 1 00010000:00010000:0.0:1651529344.682383:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c52227 lrc: 3/0,1 mode: --/PW res: [0x2b939:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.682387:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000728da614/0x3234de053c4a022 lrc: 2/0,0 mode: PR/PR res: [0x2b939:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb634 expref: 527 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.682390:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.682390:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.682391:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c52227 lrc: 4/0,1 mode: --/PW res: [0x2b939:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.682396:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000728da614/0x3234de053c4a022 lrc: 3/0,0 mode: PR/PR res: [0x2b939:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb634 expref: 527 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.682400:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000728da614/0x3234de053c4a022 lrc: 4/0,0 mode: PR/PR res: [0x2b939:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb634 expref: 527 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.682404:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000028589556 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997037376:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.682410:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000abca413e going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.682415:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212042 00000100:00100000:0.0:1651529344.682417:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1536:39029:x1731745946515904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.682421:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178490 count 1 00010000:00010000:0.0:1651529344.682424:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c5222e lrc: 3/0,1 mode: --/PW res: [0x2b93a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.682428:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a5ea7275/0x3234de053c4c8e0 lrc: 2/0,0 mode: PR/PR res: [0x2b93a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd51a expref: 527 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.682431:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.682431:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.682432:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c5222e lrc: 4/0,1 mode: --/PW res: [0x2b93a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682435:0:80280:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb953fbb/0x3234de053c4eba1 lrc: 0/0,0 mode: --/PR res: [0x2b934:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6017 expref: 527 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.682437:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a5ea7275/0x3234de053c4c8e0 lrc: 3/0,0 mode: PR/PR res: [0x2b93a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd51a expref: 527 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.682440:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005912c4a3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997037056:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.682441:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a5ea7275/0x3234de053c4c8e0 lrc: 4/0,0 mode: PR/PR res: [0x2b93a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd51a expref: 526 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.682444:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008e3070d2/0x3234de053c52204 lrc: 3/0,1 mode: PW/PW res: [0x2b934:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682448:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008e3070d2/0x3234de053c52204 lrc: 3/0,1 mode: PW/PW res: [0x2b934:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682450:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e3070d2/0x3234de053c52204 lrc: 3/0,1 mode: PW/PW res: [0x2b934:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682453:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e3070d2/0x3234de053c52204 lrc: 3/0,1 mode: PW/PW res: [0x2b934:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682458:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e3070d2/0x3234de053c52204 lrc: 2/0,0 mode: PW/PW res: [0x2b934:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.682460:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bddc5ca7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997037440:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.682474:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 0000000009370c1d going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.682479:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e3070d2/0x3234de053c52204 lrc: 2/0,0 mode: PW/PW res: [0x2b934:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.682482:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008e3070d2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.682483:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e3070d2/0x3234de053c52204 lrc: 2/0,0 mode: PW/PW res: [0x2b934:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.682488:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e3070d2/0x3234de053c52204 lrc: 3/0,0 mode: PW/PW res: [0x2b934:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.682493:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e3070d2/0x3234de053c52204 lrc: 1/0,0 mode: --/PW res: [0x2b934:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.682496:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e3070d2/0x3234de053c52204 lrc: 0/0,0 mode: --/PW res: [0x2b934:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.682501:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1537:39030:x1731745946515136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1205us (1301us total) trans 12885080093 rc 0/0 00000100:00100000:1.0:1651529344.682504:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212036 00000100:00100000:0.0:1651529344.682522:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.682540:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946516032 00000100:00100000:1.0:1651529344.682570:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212043 00000100:00100000:1.0:1651529344.682571:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1537:39029:x1731745946516032:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.682577:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178491 count 1 00010000:00010000:1.0:1651529344.682581:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e69b5582/0x3234de053c52235 lrc: 3/0,1 mode: --/PW res: [0x2b93b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682586:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b670f45a/0x3234de053c4d45c lrc: 2/0,0 mode: PR/PR res: [0x2b93b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0388 expref: 526 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.682589:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.682589:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.682590:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e69b5582/0x3234de053c52235 lrc: 4/0,1 mode: --/PW res: [0x2b93b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682597:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b670f45a/0x3234de053c4d45c lrc: 3/0,0 mode: PR/PR res: [0x2b93b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0388 expref: 526 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.682600:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b670f45a/0x3234de053c4d45c lrc: 4/0,0 mode: PR/PR res: [0x2b93b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0388 expref: 526 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.682607:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004972eb27 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997037504:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.682622:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a4eb401d going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.682636:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.682652:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.682659:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.682672:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946516096 00000100:00100000:1.0:1651529344.682678:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946516160 00000100:00100000:1.0:1651529344.682682:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946516288 00000100:00100000:1.0:1651529344.682689:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212044 00000100:00100000:1.0:1651529344.682691:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1540:39030:x1731745946516096:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.682693:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212045 00000100:00100000:0.0:1651529344.682695:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1540:39029:x1731745946516160:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.682696:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178492 count 1 00010000:00010000:1.0:1651529344.682700:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000053520ee/0x3234de053c5223c lrc: 3/0,1 mode: --/PW res: [0x2b93c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.682701:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178493 count 1 00010000:00010000:1.0:1651529344.682704:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000da10cee/0x3234de053c4f4ed lrc: 2/0,0 mode: PR/PR res: [0x2b93c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8651 expref: 526 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.682705:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5eb030a/0x3234de053c52243 lrc: 3/0,1 mode: --/PW res: [0x2b93d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682707:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.682708:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.682709:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000053520ee/0x3234de053c5223c lrc: 4/0,1 mode: --/PW res: [0x2b93c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.682709:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009c031b62/0x3234de053c4db7f lrc: 2/0,0 mode: PR/PR res: [0x2b93d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e0e expref: 526 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.682712:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.682713:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.682714:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5eb030a/0x3234de053c52243 lrc: 4/0,1 mode: --/PW res: [0x2b93d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682715:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000da10cee/0x3234de053c4f4ed lrc: 3/0,0 mode: PR/PR res: [0x2b93c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8651 expref: 526 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.682718:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000da10cee/0x3234de053c4f4ed lrc: 4/0,0 mode: PR/PR res: [0x2b93c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8651 expref: 526 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.682721:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009c031b62/0x3234de053c4db7f lrc: 3/0,0 mode: PR/PR res: [0x2b93d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e0e expref: 526 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.682722:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005912c4a3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997037568:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.682727:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009c031b62/0x3234de053c4db7f lrc: 4/0,0 mode: PR/PR res: [0x2b93d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e0e expref: 526 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.682731:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000089d7f5d6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997037632:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.682743:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cfa1ca05 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.682750:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212046 00000100:00100000:1.0:1651529344.682752:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1540:39030:x1731745946516288:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.682752:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 000000003c8b0daf going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.682757:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178494 count 1 00010000:00010000:1.0:1651529344.682760:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c5224a lrc: 3/0,1 mode: --/PW res: [0x2b93e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682765:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000053def370/0x3234de053c4d073 lrc: 2/0,0 mode: PR/PR res: [0x2b93e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf351 expref: 526 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.682768:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.682768:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.682769:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c5224a lrc: 4/0,1 mode: --/PW res: [0x2b93e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.682775:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000053def370/0x3234de053c4d073 lrc: 3/0,0 mode: PR/PR res: [0x2b93e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf351 expref: 526 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.682778:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000053def370/0x3234de053c4d073 lrc: 4/0,0 mode: PR/PR res: [0x2b93e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf351 expref: 526 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.682791:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000900b179f pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997037696:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.682801:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000071742acc going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.682810:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f9050c71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997037248:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.682814:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000083a35be2/0x3234de053c52219 lrc: 3/0,1 mode: --/PW res: [0x2b937:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.682929:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.682940:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000028589556 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997037376:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.682971:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c52227 lrc: 3/0,1 mode: --/PW res: [0x2b939:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.682975:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.682986:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.682990:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005d2b5bb3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997037312:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.682993:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008a562d62/0x3234de053c52220 lrc: 3/0,1 mode: --/PW res: [0x2b938:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.683006:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bddc5ca7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997037440:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.683013:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c5222e lrc: 3/0,1 mode: --/PW res: [0x2b93a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.683020:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000089d7f5d6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997037632:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.683022:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b5eb030a/0x3234de053c52243 lrc: 3/0,1 mode: --/PW res: [0x2b93d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.683028:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396396928 00000100:00100000:1.0:1651529344.683033:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396397056 00010000:00010000:0.0:1651529344.683034:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004f4986fb/0x3234de053c4df8b lrc: 4/0,0 mode: PR/PR res: [0x2b937:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f41 expref: 527 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.683039:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002887e00b/0x3234de053c4ab27 lrc: 4/0,0 mode: PR/PR res: [0x2b938:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbdd5 expref: 528 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.683045:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396397120 00010000:00010000:0.0:1651529344.683048:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000728da614/0x3234de053c4a022 lrc: 4/0,0 mode: PR/PR res: [0x2b939:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb634 expref: 529 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.683052:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12821 00000100:00100000:1.0:1651529344.683053:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+529:41279:x1731746396396928:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.683054:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12822 00010000:00010000:1.0:1651529344.683056:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.683056:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+529:41279:x1731746396397056:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.683058:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004f4986fb/0x3234de053c4df8b lrc: 4/0,0 mode: PR/PR res: [0x2b937:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f41 expref: 529 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.683059:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.683061:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004f4986fb/0x3234de053c4df8b lrc: 3/0,0 mode: PR/PR res: [0x2b937:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f41 expref: 529 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.683061:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002887e00b/0x3234de053c4ab27 lrc: 4/0,0 mode: PR/PR res: [0x2b938:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbdd5 expref: 529 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.683065:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002887e00b/0x3234de053c4ab27 lrc: 3/0,0 mode: PR/PR res: [0x2b938:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbdd5 expref: 529 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.683067:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f4986fb/0x3234de053c4df8b lrc: 0/0,0 mode: --/PR res: [0x2b937:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2f41 expref: 529 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.683070:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002887e00b/0x3234de053c4ab27 lrc: 0/0,0 mode: --/PR res: [0x2b938:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbdd5 expref: 529 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.683071:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.683072:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.683073:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000083a35be2/0x3234de053c52219 lrc: 3/0,1 mode: PW/PW res: [0x2b937:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683074:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.683074:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.683075:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008a562d62/0x3234de053c52220 lrc: 3/0,1 mode: PW/PW res: [0x2b938:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683076:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083a35be2/0x3234de053c52219 lrc: 4/0,1 mode: PW/PW res: [0x2b937:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683078:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a562d62/0x3234de053c52220 lrc: 4/0,1 mode: PW/PW res: [0x2b938:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683083:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.683084:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.683095:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+527:41279:x1731746396396928:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.683098:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12821 00000100:00100000:0.0:1651529344.683099:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+527:41279:x1731746396397056:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.683101:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12822 00000100:00100000:1.0:1651529344.683103:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12823 00000100:00100000:1.0:1651529344.683105:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+525:41278:x1731746396397120:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.683108:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.683108:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008a562d62/0x3234de053c52220 lrc: 3/0,1 mode: PW/PW res: [0x2b938:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683109:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000728da614/0x3234de053c4a022 lrc: 4/0,0 mode: PR/PR res: [0x2b939:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb634 expref: 525 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.683112:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a562d62/0x3234de053c52220 lrc: 3/0,1 mode: PW/PW res: [0x2b938:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683113:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000728da614/0x3234de053c4a022 lrc: 3/0,0 mode: PR/PR res: [0x2b939:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb634 expref: 525 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.683115:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a562d62/0x3234de053c52220 lrc: 3/0,1 mode: PW/PW res: [0x2b938:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683117:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a562d62/0x3234de053c52220 lrc: 2/0,0 mode: PW/PW res: [0x2b938:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683118:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000728da614/0x3234de053c4a022 lrc: 0/0,0 mode: --/PR res: [0x2b939:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb634 expref: 525 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.683121:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.683122:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.683123:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c52227 lrc: 3/0,1 mode: PW/PW res: [0x2b939:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683125:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c52227 lrc: 4/0,1 mode: PW/PW res: [0x2b939:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683133:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.683144:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+524:41278:x1731746396397120:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 39us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.683147:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12823 00000100:00100000:1.0:1651529344.683158:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004972eb27 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997037504:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.683161:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e69b5582/0x3234de053c52235 lrc: 3/0,1 mode: --/PW res: [0x2b93b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.683168:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000900b179f pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997037696:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.683170:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c5224a lrc: 3/0,1 mode: --/PW res: [0x2b93e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.683177:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005912c4a3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997037568:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.683179:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000053520ee/0x3234de053c5223c lrc: 3/0,1 mode: --/PW res: [0x2b93c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683184:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000083a35be2/0x3234de053c52219 lrc: 3/0,1 mode: PW/PW res: [0x2b937:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683186:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083a35be2/0x3234de053c52219 lrc: 3/0,1 mode: PW/PW res: [0x2b937:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683189:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083a35be2/0x3234de053c52219 lrc: 3/0,1 mode: PW/PW res: [0x2b937:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.683189:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1541:39029:x1731745946515776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 887us (992us total) trans 12885080094 rc 0/0 00010000:00010000:1.0:1651529344.683192:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083a35be2/0x3234de053c52219 lrc: 2/0,0 mode: PW/PW res: [0x2b937:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.683192:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212040 00010000:00010000:0.0:1651529344.683200:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c52227 lrc: 3/0,1 mode: PW/PW res: [0x2b939:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683210:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c52227 lrc: 3/0,1 mode: PW/PW res: [0x2b939:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683213:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c52227 lrc: 3/0,1 mode: PW/PW res: [0x2b939:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683216:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c52227 lrc: 2/0,0 mode: PW/PW res: [0x2b939:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.683256:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1542:39030:x1731745946515712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 987us (1085us total) trans 12885080095 rc 0/0 00000100:00100000:1.0:1651529344.683259:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212039 00000100:00100000:0.0:1651529344.683267:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1541:39030:x1731745946515840:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 892us (1057us total) trans 12885080096 rc 0/0 00000100:00100000:0.0:1651529344.683270:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212041 00010000:00010000:0.0:1651529344.683278:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a562d62/0x3234de053c52220 lrc: 2/0,0 mode: PW/PW res: [0x2b938:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683281:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008a562d62 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.683282:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a562d62/0x3234de053c52220 lrc: 2/0,0 mode: PW/PW res: [0x2b938:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683285:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a562d62/0x3234de053c52220 lrc: 3/0,0 mode: PW/PW res: [0x2b938:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683290:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a562d62/0x3234de053c52220 lrc: 1/0,0 mode: --/PW res: [0x2b938:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683292:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a562d62/0x3234de053c52220 lrc: 0/0,0 mode: --/PW res: [0x2b938:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.683297:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.683297:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083a35be2/0x3234de053c52219 lrc: 2/0,0 mode: PW/PW res: [0x2b937:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683299:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000083a35be2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.683300:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083a35be2/0x3234de053c52219 lrc: 2/0,0 mode: PW/PW res: [0x2b937:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683305:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083a35be2/0x3234de053c52219 lrc: 3/0,0 mode: PW/PW res: [0x2b937:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683309:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083a35be2/0x3234de053c52219 lrc: 1/0,0 mode: --/PW res: [0x2b937:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.683311:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.683311:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083a35be2/0x3234de053c52219 lrc: 0/0,0 mode: --/PW res: [0x2b937:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683315:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c52227 lrc: 2/0,0 mode: PW/PW res: [0x2b939:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683317:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003266b888 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.683318:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c52227 lrc: 2/0,0 mode: PW/PW res: [0x2b939:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683320:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c52227 lrc: 3/0,0 mode: PW/PW res: [0x2b939:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.683321:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.683323:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c52227 lrc: 1/0,0 mode: --/PW res: [0x2b939:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683326:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003266b888/0x3234de053c52227 lrc: 0/0,0 mode: --/PW res: [0x2b939:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.683330:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.683354:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396397184 00010000:00010000:0.0:1651529344.683359:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a5ea7275/0x3234de053c4c8e0 lrc: 4/0,0 mode: PR/PR res: [0x2b93a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd51a expref: 524 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.683364:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396397312 00010000:00010000:0.0:1651529344.683366:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000da10cee/0x3234de053c4f4ed lrc: 4/0,0 mode: PR/PR res: [0x2b93c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8651 expref: 525 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.683371:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396397440 00010000:00010000:0.0:1651529344.683373:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000053def370/0x3234de053c4d073 lrc: 4/0,0 mode: PR/PR res: [0x2b93e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf351 expref: 526 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.683377:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12824 00000100:00100000:1.0:1651529344.683378:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396397248 00000100:00100000:0.0:1651529344.683378:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+526:41279:x1731746396397184:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.683381:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.683382:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a5ea7275/0x3234de053c4c8e0 lrc: 4/0,0 mode: PR/PR res: [0x2b93a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd51a expref: 527 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.683383:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b670f45a/0x3234de053c4d45c lrc: 4/0,0 mode: PR/PR res: [0x2b93b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0388 expref: 527 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.683386:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a5ea7275/0x3234de053c4c8e0 lrc: 3/0,0 mode: PR/PR res: [0x2b93a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd51a expref: 527 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.683391:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12825 00010000:00010000:0.0:1651529344.683391:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5ea7275/0x3234de053c4c8e0 lrc: 0/0,0 mode: --/PR res: [0x2b93a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd51a expref: 527 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.683392:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+527:41279:x1731746396397312:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.683395:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.683395:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.683395:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.683396:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000da10cee/0x3234de053c4f4ed lrc: 4/0,0 mode: PR/PR res: [0x2b93c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8651 expref: 526 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.683396:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c5222e lrc: 3/0,1 mode: PW/PW res: [0x2b93a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683400:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000da10cee/0x3234de053c4f4ed lrc: 3/0,0 mode: PR/PR res: [0x2b93c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8651 expref: 526 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.683402:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c5222e lrc: 4/0,1 mode: PW/PW res: [0x2b93a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683406:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000da10cee/0x3234de053c4f4ed lrc: 0/0,0 mode: --/PR res: [0x2b93c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8651 expref: 526 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.683408:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.683409:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.683410:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.683411:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000053520ee/0x3234de053c5223c lrc: 3/0,1 mode: PW/PW res: [0x2b93c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683414:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000053520ee/0x3234de053c5223c lrc: 4/0,1 mode: PW/PW res: [0x2b93c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.683421:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+525:41279:x1731746396397184:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.683424:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12824 00010000:00010000:1.0:1651529344.683426:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.683433:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+524:41279:x1731746396397312:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 40us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.683436:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12825 00000100:00100000:1.0:1651529344.683441:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12826 00000100:00100000:1.0:1651529344.683442:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+523:41279:x1731746396397440:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.683443:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12827 00010000:00010000:1.0:1651529344.683445:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.683445:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000011803d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+523:41279:x1731746396397248:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.683446:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000053def370/0x3234de053c4d073 lrc: 4/0,0 mode: PR/PR res: [0x2b93e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf351 expref: 523 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.683448:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.683450:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000053def370/0x3234de053c4d073 lrc: 3/0,0 mode: PR/PR res: [0x2b93e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf351 expref: 523 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.683450:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b670f45a/0x3234de053c4d45c lrc: 4/0,0 mode: PR/PR res: [0x2b93b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0388 expref: 523 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.683454:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053def370/0x3234de053c4d073 lrc: 0/0,0 mode: --/PR res: [0x2b93e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf351 expref: 523 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.683454:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b670f45a/0x3234de053c4d45c lrc: 3/0,0 mode: PR/PR res: [0x2b93b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0388 expref: 523 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.683458:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.683459:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.683459:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c5224a lrc: 3/0,1 mode: PW/PW res: [0x2b93e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683459:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b670f45a/0x3234de053c4d45c lrc: 0/0,0 mode: --/PR res: [0x2b93b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0388 expref: 522 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.683462:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c5224a lrc: 4/0,1 mode: PW/PW res: [0x2b93e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683463:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.683464:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.683464:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e69b5582/0x3234de053c52235 lrc: 3/0,1 mode: PW/PW res: [0x2b93b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683467:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e69b5582/0x3234de053c52235 lrc: 4/0,1 mode: PW/PW res: [0x2b93b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683468:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.683472:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+521:41279:x1731746396397440:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 29us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.683475:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12826 00010000:00010000:0.0:1651529344.683480:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.683486:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000053520ee/0x3234de053c5223c lrc: 3/0,1 mode: PW/PW res: [0x2b93c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.683487:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000011803d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+520:41279:x1731746396397248:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 41us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.683489:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12827 00010000:00010000:1.0:1651529344.683490:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000053520ee/0x3234de053c5223c lrc: 3/0,1 mode: PW/PW res: [0x2b93c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683493:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000053520ee/0x3234de053c5223c lrc: 3/0,1 mode: PW/PW res: [0x2b93c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683495:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000053520ee/0x3234de053c5223c lrc: 2/0,0 mode: PW/PW res: [0x2b93c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683501:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c5222e lrc: 3/0,1 mode: PW/PW res: [0x2b93a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683510:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c5222e lrc: 3/0,1 mode: PW/PW res: [0x2b93a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683513:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c5222e lrc: 3/0,1 mode: PW/PW res: [0x2b93a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683516:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c5222e lrc: 2/0,0 mode: PW/PW res: [0x2b93a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.683536:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1542:39030:x1731745946516096:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 844us (901us total) trans 12885080097 rc 0/0 00000100:00100000:1.0:1651529344.683539:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212044 00010000:00010000:1.0:1651529344.683546:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c5224a lrc: 3/0,1 mode: PW/PW res: [0x2b93e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683549:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c5224a lrc: 3/0,1 mode: PW/PW res: [0x2b93e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683552:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c5224a lrc: 3/0,1 mode: PW/PW res: [0x2b93e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683555:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c5224a lrc: 2/0,0 mode: PW/PW res: [0x2b93e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.683576:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1542:39029:x1731745946515904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1158us (1355us total) trans 12885080098 rc 0/0 00000100:00100000:0.0:1651529344.683579:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212042 00010000:00010000:0.0:1651529344.683587:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000053520ee/0x3234de053c5223c lrc: 2/0,0 mode: PW/PW res: [0x2b93c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683590:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000053520ee already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.683591:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000053520ee/0x3234de053c5223c lrc: 2/0,0 mode: PW/PW res: [0x2b93c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.683594:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1541:39030:x1731745946516288:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 841us (934us total) trans 12885080099 rc 0/0 00000100:00100000:1.0:1651529344.683597:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212046 00010000:00010000:0.0:1651529344.683597:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000053520ee/0x3234de053c5223c lrc: 3/0,0 mode: PW/PW res: [0x2b93c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683601:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000053520ee/0x3234de053c5223c lrc: 1/0,0 mode: --/PW res: [0x2b93c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683604:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e69b5582/0x3234de053c52235 lrc: 3/0,1 mode: PW/PW res: [0x2b93b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683604:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000053520ee/0x3234de053c5223c lrc: 0/0,0 mode: --/PW res: [0x2b93c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683607:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e69b5582/0x3234de053c52235 lrc: 3/0,1 mode: PW/PW res: [0x2b93b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683608:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c5222e lrc: 2/0,0 mode: PW/PW res: [0x2b93a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683610:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e69b5582/0x3234de053c52235 lrc: 3/0,1 mode: PW/PW res: [0x2b93b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683611:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005b1ee779 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.683612:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c5222e lrc: 2/0,0 mode: PW/PW res: [0x2b93a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683613:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e69b5582/0x3234de053c52235 lrc: 2/0,0 mode: PW/PW res: [0x2b93b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683615:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c5222e lrc: 3/0,0 mode: PW/PW res: [0x2b93a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683618:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c5222e lrc: 1/0,0 mode: --/PW res: [0x2b93a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683620:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b1ee779/0x3234de053c5222e lrc: 0/0,0 mode: --/PW res: [0x2b93a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683624:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c5224a lrc: 2/0,0 mode: PW/PW res: [0x2b93e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683628:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d065f972 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.683629:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c5224a lrc: 2/0,0 mode: PW/PW res: [0x2b93e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683632:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c5224a lrc: 3/0,0 mode: PW/PW res: [0x2b93e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683635:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c5224a lrc: 1/0,0 mode: --/PW res: [0x2b93e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683637:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c5224a lrc: 0/0,0 mode: --/PW res: [0x2b93e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.683641:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1541:39029:x1731745946516032:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1069us (1120us total) trans 12885080100 rc 0/0 00010000:00010000:0.0:1651529344.683641:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e69b5582/0x3234de053c52235 lrc: 2/0,0 mode: PW/PW res: [0x2b93b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683643:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e69b5582 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.683644:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212043 00010000:00010000:0.0:1651529344.683644:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e69b5582/0x3234de053c52235 lrc: 2/0,0 mode: PW/PW res: [0x2b93b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683647:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e69b5582/0x3234de053c52235 lrc: 3/0,0 mode: PW/PW res: [0x2b93b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683650:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e69b5582/0x3234de053c52235 lrc: 1/0,0 mode: --/PW res: [0x2b93b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683652:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e69b5582/0x3234de053c52235 lrc: 0/0,0 mode: --/PW res: [0x2b93b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.683667:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.683686:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.683695:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.683757:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396397376 00000100:00100000:0.0:1651529344.683757:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.683763:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009c031b62/0x3234de053c4db7f lrc: 4/0,0 mode: PR/PR res: [0x2b93d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e0e expref: 520 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.683765:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946516608 00000100:00100000:1.0:1651529344.683779:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12828 00000100:00100000:1.0:1651529344.683781:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+520:41279:x1731746396397376:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.683784:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.683785:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009c031b62/0x3234de053c4db7f lrc: 4/0,0 mode: PR/PR res: [0x2b93d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e0e expref: 520 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.683789:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009c031b62/0x3234de053c4db7f lrc: 3/0,0 mode: PR/PR res: [0x2b93d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e0e expref: 520 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.683794:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c031b62/0x3234de053c4db7f lrc: 0/0,0 mode: --/PR res: [0x2b93d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e0e expref: 520 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.683798:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.683798:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.683799:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b5eb030a/0x3234de053c52243 lrc: 3/0,1 mode: PW/PW res: [0x2b93d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.683800:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946516544 00010000:00010000:1.0:1651529344.683802:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5eb030a/0x3234de053c52243 lrc: 4/0,1 mode: PW/PW res: [0x2b93d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.683807:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946516672 00010000:00010000:1.0:1651529344.683816:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.683818:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212047 00000100:00100000:0.0:1651529344.683820:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1543:39030:x1731745946516608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.683824:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+519:41279:x1731746396397376:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 43us (156us total) trans 0 rc 0/0 00002000:00080000:0.0:1651529344.683825:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178496 count 1 00000100:00100000:1.0:1651529344.683827:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12828 00010000:00010000:0.0:1651529344.683829:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3a98370/0x3234de053c52251 lrc: 3/0,1 mode: --/PW res: [0x2b940:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.683834:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212048 00010000:00010000:0.0:1651529344.683834:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000933c22d6/0x3234de053c4c7c8 lrc: 2/0,0 mode: PR/PR res: [0x2b940:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd170 expref: 518 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.683835:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1543:39029:x1731745946516544:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.683837:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.683838:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.683838:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3a98370/0x3234de053c52251 lrc: 4/0,1 mode: --/PW res: [0x2b940:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.683841:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178495 count 1 00010000:00010000:1.0:1651529344.683844:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c52258 lrc: 3/0,1 mode: --/PW res: [0x2b93f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683845:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000933c22d6/0x3234de053c4c7c8 lrc: 3/0,0 mode: PR/PR res: [0x2b940:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd170 expref: 518 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.683849:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006f40f80f/0x3234de053c4f0cc lrc: 2/0,0 mode: PR/PR res: [0x2b93f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d75b8 expref: 518 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.683849:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000933c22d6/0x3234de053c4c7c8 lrc: 4/0,0 mode: PR/PR res: [0x2b940:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd170 expref: 518 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.683852:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.683852:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.683853:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c52258 lrc: 4/0,1 mode: --/PW res: [0x2b93f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.683853:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000059363096 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997037760:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.683860:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006f40f80f/0x3234de053c4f0cc lrc: 3/0,0 mode: PR/PR res: [0x2b93f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d75b8 expref: 518 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.683863:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006f40f80f/0x3234de053c4f0cc lrc: 4/0,0 mode: PR/PR res: [0x2b93f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d75b8 expref: 518 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.683863:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a82c4968 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.683867:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004972eb27 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997037824:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.683868:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b5eb030a/0x3234de053c52243 lrc: 3/0,1 mode: PW/PW res: [0x2b93d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683871:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5eb030a/0x3234de053c52243 lrc: 3/0,1 mode: PW/PW res: [0x2b93d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683874:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5eb030a/0x3234de053c52243 lrc: 3/0,1 mode: PW/PW res: [0x2b93d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.683875:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000412e5d26 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.683877:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b5eb030a/0x3234de053c52243 lrc: 2/0,0 mode: PW/PW res: [0x2b93d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.683881:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212049 00000100:00100000:1.0:1651529344.683883:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1543:39029:x1731745946516672:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.683886:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178497 count 1 00010000:00010000:1.0:1651529344.683890:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c5225f lrc: 3/0,1 mode: --/PW res: [0x2b941:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683894:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e79d8550/0x3234de053c4f0ef lrc: 2/0,0 mode: PR/PR res: [0x2b941:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d762f expref: 518 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.683897:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.683897:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.683898:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c5225f lrc: 4/0,1 mode: --/PW res: [0x2b941:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.683904:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e79d8550/0x3234de053c4f0ef lrc: 3/0,0 mode: PR/PR res: [0x2b941:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d762f expref: 518 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.683907:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e79d8550/0x3234de053c4f0ef lrc: 4/0,0 mode: PR/PR res: [0x2b941:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d762f expref: 518 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.683911:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000117fbeca pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997037888:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.683933:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000020dd7827 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.683942:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1544:39029:x1731745946516160:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1246us (1290us total) trans 12885080101 rc 0/0 00000100:00100000:0.0:1651529344.683945:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212045 00010000:00010000:0.0:1651529344.683954:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b5eb030a/0x3234de053c52243 lrc: 2/0,0 mode: PW/PW res: [0x2b93d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683957:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b5eb030a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.683958:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5eb030a/0x3234de053c52243 lrc: 2/0,0 mode: PW/PW res: [0x2b93d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683961:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5eb030a/0x3234de053c52243 lrc: 3/0,0 mode: PW/PW res: [0x2b93d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.683966:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.683966:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b5eb030a/0x3234de053c52243 lrc: 1/0,0 mode: --/PW res: [0x2b93d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.683977:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5eb030a/0x3234de053c52243 lrc: 0/0,0 mode: --/PW res: [0x2b93d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.683984:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.683985:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946516800 00000100:00100000:0.0:1651529344.683998:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946516928 00000100:00100000:0.0:1651529344.684004:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212050 00000100:00100000:0.0:1651529344.684006:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1545:39029:x1731745946516800:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.684011:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178499 count 1 00010000:00010000:0.0:1651529344.684014:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b16f6b13/0x3234de053c52266 lrc: 3/0,1 mode: --/PW res: [0x2b943:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684019:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000055141a0c/0x3234de053c4a9bb lrc: 2/0,0 mode: PR/PR res: [0x2b943:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd34 expref: 518 pid: 80281 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.684022:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.684022:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.684022:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.684023:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b16f6b13/0x3234de053c52266 lrc: 4/0,1 mode: --/PW res: [0x2b943:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684035:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000055141a0c/0x3234de053c4a9bb lrc: 3/0,0 mode: PR/PR res: [0x2b943:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd34 expref: 518 pid: 80281 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.684037:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.684039:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000055141a0c/0x3234de053c4a9bb lrc: 4/0,0 mode: PR/PR res: [0x2b943:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd34 expref: 518 pid: 80281 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.684043:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ea0220b6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997037952:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.684053:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c4075652 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.684059:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946516736 00000100:00100000:0.0:1651529344.684069:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946516864 00000100:00100000:0.0:1651529344.684075:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212051 00000100:00100000:0.0:1651529344.684077:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1547:39029:x1731745946516928:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.684081:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178501 count 1 00010000:00010000:0.0:1651529344.684085:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c5226d lrc: 3/0,1 mode: --/PW res: [0x2b945:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.684088:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212052 00010000:00010000:0.0:1651529344.684089:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c4cd6a lrc: 2/0,0 mode: PR/PR res: [0x2b945:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce7ab expref: 518 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.684090:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1547:39030:x1731745946516736:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.684092:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.684093:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.684094:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c5226d lrc: 4/0,1 mode: --/PW res: [0x2b945:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.684095:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178498 count 1 00010000:00010000:0.0:1651529344.684099:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c4cd6a lrc: 3/0,0 mode: PR/PR res: [0x2b945:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce7ab expref: 518 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.684100:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c52274 lrc: 3/0,1 mode: --/PW res: [0x2b942:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684103:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c4cd6a lrc: 4/0,0 mode: PR/PR res: [0x2b945:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce7ab expref: 518 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.684104:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d2657b4f/0x3234de053c4dd54 lrc: 2/0,0 mode: PR/PR res: [0x2b942:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2665 expref: 518 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.684106:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004a6776b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997038016:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.684110:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.684110:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.684111:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c52274 lrc: 4/0,1 mode: --/PW res: [0x2b942:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.684118:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 000000003ad73843 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.684124:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d2657b4f/0x3234de053c4dd54 lrc: 3/0,0 mode: PR/PR res: [0x2b942:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2665 expref: 518 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.684128:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d2657b4f/0x3234de053c4dd54 lrc: 4/0,0 mode: PR/PR res: [0x2b942:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2665 expref: 518 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.684132:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000533fe698 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997038080:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.684140:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 0000000099c1da85 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.684144:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212053 00000100:00100000:0.0:1651529344.684146:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1547:39030:x1731745946516864:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.684153:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178500 count 1 00010000:00010000:0.0:1651529344.684156:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c5227b lrc: 3/0,1 mode: --/PW res: [0x2b944:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.684159:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.684160:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e3b9e466/0x3234de053c4ec18 lrc: 2/0,0 mode: PR/PR res: [0x2b944:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d61e5 expref: 518 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.684163:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.684164:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.684165:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c5227b lrc: 4/0,1 mode: --/PW res: [0x2b944:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684171:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e3b9e466/0x3234de053c4ec18 lrc: 3/0,0 mode: PR/PR res: [0x2b944:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d61e5 expref: 518 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.684174:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e3b9e466/0x3234de053c4ec18 lrc: 4/0,0 mode: PR/PR res: [0x2b944:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d61e5 expref: 518 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.684178:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002c4168d4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997038144:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.684192:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c0dff858 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.684200:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946517312 00000100:00100000:1.0:1651529344.684208:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212054 00000100:00100000:1.0:1651529344.684210:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1548:39030:x1731745946517312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.684215:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178502 count 1 00010000:00010000:1.0:1651529344.684239:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6711731/0x3234de053c52282 lrc: 3/0,1 mode: --/PW res: [0x2b946:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.684244:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000090b3e48a/0x3234de053c4cf2a lrc: 2/0,0 mode: PR/PR res: [0x2b946:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceea4 expref: 518 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.684247:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.684248:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.684248:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6711731/0x3234de053c52282 lrc: 4/0,1 mode: --/PW res: [0x2b946:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.684256:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000090b3e48a/0x3234de053c4cf2a lrc: 3/0,0 mode: PR/PR res: [0x2b946:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceea4 expref: 518 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.684259:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000090b3e48a/0x3234de053c4cf2a lrc: 4/0,0 mode: PR/PR res: [0x2b946:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceea4 expref: 518 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.684263:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a573b31 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997038208:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.684276:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 0000000071742acc going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.684464:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.684472:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.684482:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000059363096 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997037760:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.684488:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e3a98370/0x3234de053c52251 lrc: 3/0,1 mode: --/PW res: [0x2b940:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.684496:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.684497:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ea0220b6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997037952:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.684499:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b16f6b13/0x3234de053c52266 lrc: 3/0,1 mode: --/PW res: [0x2b943:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.684504:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.684534:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004a6776b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997038016:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.684536:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.684537:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c5226d lrc: 3/0,1 mode: --/PW res: [0x2b945:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.684543:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396397760 00000100:00100000:1.0:1651529344.684545:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004972eb27 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997037824:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.684548:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000933c22d6/0x3234de053c4c7c8 lrc: 4/0,0 mode: PR/PR res: [0x2b940:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd170 expref: 519 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.684549:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c52258 lrc: 3/0,1 mode: --/PW res: [0x2b93f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.684554:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396397888 00000100:00100000:1.0:1651529344.684556:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000117fbeca pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997037888:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.684556:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000055141a0c/0x3234de053c4a9bb lrc: 4/0,0 mode: PR/PR res: [0x2b943:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd34 expref: 520 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.684558:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c5225f lrc: 3/0,1 mode: --/PW res: [0x2b941:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.684560:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396397696 00010000:00010000:0.0:1651529344.684562:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006f40f80f/0x3234de053c4f0cc lrc: 4/0,0 mode: PR/PR res: [0x2b93f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d75b8 expref: 521 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.684565:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396397824 00000100:00100000:0.0:1651529344.684566:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396397952 00010000:00010000:0.0:1651529344.684568:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c4cd6a lrc: 4/0,0 mode: PR/PR res: [0x2b945:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce7ab expref: 523 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.684569:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e79d8550/0x3234de053c4f0ef lrc: 4/0,0 mode: PR/PR res: [0x2b941:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d762f expref: 523 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.684572:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12829 00000100:00100000:0.0:1651529344.684574:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+523:41278:x1731746396397760:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.684577:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.684578:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12830 00010000:00010000:0.0:1651529344.684578:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000933c22d6/0x3234de053c4c7c8 lrc: 4/0,0 mode: PR/PR res: [0x2b940:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd170 expref: 523 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.684579:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+523:41278:x1731746396397888:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.684582:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.684583:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000055141a0c/0x3234de053c4a9bb lrc: 4/0,0 mode: PR/PR res: [0x2b943:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd34 expref: 523 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.684585:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000933c22d6/0x3234de053c4c7c8 lrc: 3/0,0 mode: PR/PR res: [0x2b940:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd170 expref: 523 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.684587:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000055141a0c/0x3234de053c4a9bb lrc: 3/0,0 mode: PR/PR res: [0x2b943:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd34 expref: 523 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.684590:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000933c22d6/0x3234de053c4c7c8 lrc: 0/0,0 mode: --/PR res: [0x2b940:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd170 expref: 523 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.684592:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055141a0c/0x3234de053c4a9bb lrc: 0/0,0 mode: --/PR res: [0x2b943:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd34 expref: 523 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.684594:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.684594:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.684596:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.684597:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.684598:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b16f6b13/0x3234de053c52266 lrc: 3/0,1 mode: PW/PW res: [0x2b943:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.684601:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b16f6b13/0x3234de053c52266 lrc: 4/0,1 mode: PW/PW res: [0x2b943:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.684612:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.684616:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e3a98370/0x3234de053c52251 lrc: 3/0,1 mode: PW/PW res: [0x2b940:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684620:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3a98370/0x3234de053c52251 lrc: 4/0,1 mode: PW/PW res: [0x2b940:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.684621:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+521:41278:x1731746396397888:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 41us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.684624:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12830 00010000:00010000:0.0:1651529344.684627:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.684628:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12831 00000100:00100000:1.0:1651529344.684630:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+520:41279:x1731746396397696:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.684632:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.684634:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006f40f80f/0x3234de053c4f0cc lrc: 4/0,0 mode: PR/PR res: [0x2b93f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d75b8 expref: 520 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.684634:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+520:41278:x1731746396397760:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 60us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.684637:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12829 00010000:00010000:1.0:1651529344.684638:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006f40f80f/0x3234de053c4f0cc lrc: 3/0,0 mode: PR/PR res: [0x2b93f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d75b8 expref: 520 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.684642:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f40f80f/0x3234de053c4f0cc lrc: 0/0,0 mode: --/PR res: [0x2b93f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d75b8 expref: 519 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.684642:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12832 00000100:00100000:0.0:1651529344.684644:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+519:41278:x1731746396397952:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.684646:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.684646:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.684647:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c52258 lrc: 3/0,1 mode: PW/PW res: [0x2b93f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684647:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.684648:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c4cd6a lrc: 4/0,0 mode: PR/PR res: [0x2b945:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce7ab expref: 518 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.684650:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c52258 lrc: 4/0,1 mode: PW/PW res: [0x2b93f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684652:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c4cd6a lrc: 3/0,0 mode: PR/PR res: [0x2b945:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce7ab expref: 518 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.684655:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.684657:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c4cd6a lrc: 0/0,0 mode: --/PR res: [0x2b945:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce7ab expref: 518 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.684660:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+518:41279:x1731746396397696:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 30us (165us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.684661:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.684661:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.684662:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c5226d lrc: 3/0,1 mode: PW/PW res: [0x2b945:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.684663:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12831 00010000:00010000:0.0:1651529344.684665:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c5226d lrc: 4/0,1 mode: PW/PW res: [0x2b945:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.684667:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12833 00000100:00100000:1.0:1651529344.684668:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+516:41279:x1731746396397824:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.684670:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.684670:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.684671:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e79d8550/0x3234de053c4f0ef lrc: 4/0,0 mode: PR/PR res: [0x2b941:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d762f expref: 516 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.684675:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+516:41278:x1731746396397952:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 30us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.684677:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12832 00010000:00010000:1.0:1651529344.684678:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e79d8550/0x3234de053c4f0ef lrc: 3/0,0 mode: PR/PR res: [0x2b941:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d762f expref: 516 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.684682:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e79d8550/0x3234de053c4f0ef lrc: 0/0,0 mode: --/PR res: [0x2b941:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d762f expref: 515 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.684683:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b16f6b13/0x3234de053c52266 lrc: 3/0,1 mode: PW/PW res: [0x2b943:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.684685:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.684686:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.684686:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c5225f lrc: 3/0,1 mode: PW/PW res: [0x2b941:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684686:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b16f6b13/0x3234de053c52266 lrc: 3/0,1 mode: PW/PW res: [0x2b943:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.684689:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c5225f lrc: 4/0,1 mode: PW/PW res: [0x2b941:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684689:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b16f6b13/0x3234de053c52266 lrc: 3/0,1 mode: PW/PW res: [0x2b943:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684692:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b16f6b13/0x3234de053c52266 lrc: 2/0,0 mode: PW/PW res: [0x2b943:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.684694:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.684699:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+514:41279:x1731746396397824:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 30us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.684701:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12833 00010000:00010000:1.0:1651529344.684707:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c5225f lrc: 3/0,1 mode: PW/PW res: [0x2b941:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.684711:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c5225f lrc: 3/0,1 mode: PW/PW res: [0x2b941:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.684714:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c5225f lrc: 3/0,1 mode: PW/PW res: [0x2b941:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.684719:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c5225f lrc: 2/0,0 mode: PW/PW res: [0x2b941:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.684749:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1549:39029:x1731745946516800:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 742us (782us total) trans 12885080102 rc 0/0 00000100:00100000:0.0:1651529344.684752:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212050 00010000:00010000:0.0:1651529344.684759:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c5226d lrc: 3/0,1 mode: PW/PW res: [0x2b945:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684763:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c5226d lrc: 3/0,1 mode: PW/PW res: [0x2b945:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684766:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c5226d lrc: 3/0,1 mode: PW/PW res: [0x2b945:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684769:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c5226d lrc: 2/0,0 mode: PW/PW res: [0x2b945:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.684774:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1549:39029:x1731745946516672:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 890us (1017us total) trans 12885080103 rc 0/0 00000100:00100000:1.0:1651529344.684777:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212049 00010000:00010000:1.0:1651529344.684784:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c52258 lrc: 3/0,1 mode: PW/PW res: [0x2b93f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.684787:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c52258 lrc: 3/0,1 mode: PW/PW res: [0x2b93f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.684790:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c52258 lrc: 3/0,1 mode: PW/PW res: [0x2b93f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.684793:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c52258 lrc: 2/0,0 mode: PW/PW res: [0x2b93f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.684805:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1549:39029:x1731745946516928:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 727us (821us total) trans 12885080104 rc 0/0 00000100:00100000:0.0:1651529344.684808:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212051 00010000:00010000:0.0:1651529344.684815:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b16f6b13/0x3234de053c52266 lrc: 2/0,0 mode: PW/PW res: [0x2b943:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684818:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b16f6b13 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.684819:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b16f6b13/0x3234de053c52266 lrc: 2/0,0 mode: PW/PW res: [0x2b943:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684822:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b16f6b13/0x3234de053c52266 lrc: 3/0,0 mode: PW/PW res: [0x2b943:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.684823:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1549:39029:x1731745946516544:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 987us (1128us total) trans 12885080105 rc 0/0 00000100:00100000:1.0:1651529344.684826:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212048 00010000:00010000:0.0:1651529344.684827:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b16f6b13/0x3234de053c52266 lrc: 1/0,0 mode: --/PW res: [0x2b943:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684830:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b16f6b13/0x3234de053c52266 lrc: 0/0,0 mode: --/PW res: [0x2b943:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684834:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c5225f lrc: 2/0,0 mode: PW/PW res: [0x2b941:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684837:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000022a594ce already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.684837:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c5225f lrc: 2/0,0 mode: PW/PW res: [0x2b941:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684840:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c5225f lrc: 3/0,0 mode: PW/PW res: [0x2b941:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684843:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c5225f lrc: 1/0,0 mode: --/PW res: [0x2b941:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684846:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c5225f lrc: 0/0,0 mode: --/PW res: [0x2b941:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684849:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c5226d lrc: 2/0,0 mode: PW/PW res: [0x2b945:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684852:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000048ee8765 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.684852:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c5226d lrc: 2/0,0 mode: PW/PW res: [0x2b945:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684855:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c5226d lrc: 3/0,0 mode: PW/PW res: [0x2b945:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684859:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c5226d lrc: 1/0,0 mode: --/PW res: [0x2b945:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684861:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c5226d lrc: 0/0,0 mode: --/PW res: [0x2b945:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684864:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c52258 lrc: 2/0,0 mode: PW/PW res: [0x2b93f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684867:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2a53ada already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.684868:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c52258 lrc: 2/0,0 mode: PW/PW res: [0x2b93f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684870:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c52258 lrc: 3/0,0 mode: PW/PW res: [0x2b93f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684873:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c52258 lrc: 1/0,0 mode: --/PW res: [0x2b93f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684876:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c52258 lrc: 0/0,0 mode: --/PW res: [0x2b93f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684898:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e3a98370/0x3234de053c52251 lrc: 3/0,1 mode: PW/PW res: [0x2b940:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684902:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3a98370/0x3234de053c52251 lrc: 3/0,1 mode: PW/PW res: [0x2b940:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684905:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3a98370/0x3234de053c52251 lrc: 3/0,1 mode: PW/PW res: [0x2b940:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.684907:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.684907:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3a98370/0x3234de053c52251 lrc: 2/0,0 mode: PW/PW res: [0x2b940:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.684917:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000533fe698 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997038080:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.684921:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c52274 lrc: 3/0,1 mode: --/PW res: [0x2b942:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.684930:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396398016 00010000:00010000:1.0:1651529344.684934:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d2657b4f/0x3234de053c4dd54 lrc: 4/0,0 mode: PR/PR res: [0x2b942:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2665 expref: 514 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.684941:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12834 00000100:00100000:1.0:1651529344.684943:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e75f071f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+514:41278:x1731746396398016:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.684946:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.684947:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d2657b4f/0x3234de053c4dd54 lrc: 4/0,0 mode: PR/PR res: [0x2b942:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2665 expref: 514 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.684951:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d2657b4f/0x3234de053c4dd54 lrc: 3/0,0 mode: PR/PR res: [0x2b942:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2665 expref: 514 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.684956:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2657b4f/0x3234de053c4dd54 lrc: 0/0,0 mode: --/PR res: [0x2b942:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2665 expref: 514 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.684959:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.684960:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.684965:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1549:39030:x1731745946516608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1144us (1278us total) trans 12885080106 rc 0/0 00010000:00010000:1.0:1651529344.684967:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c52274 lrc: 3/0,1 mode: PW/PW res: [0x2b942:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.684968:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212047 00010000:00010000:1.0:1651529344.684971:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c52274 lrc: 4/0,1 mode: PW/PW res: [0x2b942:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684975:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3a98370/0x3234de053c52251 lrc: 2/0,0 mode: PW/PW res: [0x2b940:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.684977:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.684978:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e3a98370 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.684979:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3a98370/0x3234de053c52251 lrc: 2/0,0 mode: PW/PW res: [0x2b940:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.684982:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3a98370/0x3234de053c52251 lrc: 3/0,0 mode: PW/PW res: [0x2b940:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.684984:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e75f071f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+513:41278:x1731746396398016:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 40us (78us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.684986:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3a98370/0x3234de053c52251 lrc: 1/0,0 mode: --/PW res: [0x2b940:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.684987:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12834 00010000:00010000:0.0:1651529344.684989:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3a98370/0x3234de053c52251 lrc: 0/0,0 mode: --/PW res: [0x2b940:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.684997:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c52274 lrc: 3/0,1 mode: PW/PW res: [0x2b942:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685000:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c52274 lrc: 3/0,1 mode: PW/PW res: [0x2b942:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685003:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c52274 lrc: 3/0,1 mode: PW/PW res: [0x2b942:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685006:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c52274 lrc: 2/0,0 mode: PW/PW res: [0x2b942:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.685045:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c52274 lrc: 2/0,0 mode: PW/PW res: [0x2b942:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.685050:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000323a7bf8 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.685051:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c52274 lrc: 2/0,0 mode: PW/PW res: [0x2b942:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.685067:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1549:39030:x1731745946516736:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 977us (1045us total) trans 12885080107 rc 0/0 00000100:00100000:1.0:1651529344.685070:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212052 00010000:00010000:0.0:1651529344.685081:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c52274 lrc: 3/0,0 mode: PW/PW res: [0x2b942:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.685086:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.685086:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c52274 lrc: 1/0,0 mode: --/PW res: [0x2b942:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.685089:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c52274 lrc: 0/0,0 mode: --/PW res: [0x2b942:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.685124:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.685136:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.685145:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.685161:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002c4168d4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997038144:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.685164:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946517632 00010000:00010000:0.0:1651529344.685166:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c5227b lrc: 3/0,1 mode: --/PW res: [0x2b944:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.685170:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946517568 00000100:00100000:0.0:1651529344.685173:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946517760 00000100:00100000:1.0:1651529344.685177:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946517696 00000100:00100000:1.0:1651529344.685181:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212055 00000100:00100000:1.0:1651529344.685183:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1552:39030:x1731745946517632:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.685188:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178504 count 1 00010000:00010000:1.0:1651529344.685193:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a2a8776/0x3234de053c52289 lrc: 3/0,1 mode: --/PW res: [0x2b948:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685198:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000040085363/0x3234de053c4db94 lrc: 2/0,0 mode: PR/PR res: [0x2b948:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e54 expref: 512 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.685201:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.685202:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.685202:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a2a8776/0x3234de053c52289 lrc: 4/0,1 mode: --/PW res: [0x2b948:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.685212:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212056 00000100:00100000:0.0:1651529344.685214:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1552:39029:x1731745946517568:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.685220:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178503 count 1 00010000:00010000:1.0:1651529344.685232:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000040085363/0x3234de053c4db94 lrc: 3/0,0 mode: PR/PR res: [0x2b948:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e54 expref: 512 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.685239:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52290 lrc: 3/0,1 mode: --/PW res: [0x2b947:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685240:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000040085363/0x3234de053c4db94 lrc: 4/0,0 mode: PR/PR res: [0x2b948:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e54 expref: 512 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.685244:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ad6d0877 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997038272:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.685255:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a4eb401d going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.685256:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f11baf3c/0x3234de053c4f595 lrc: 2/0,0 mode: PR/PR res: [0x2b947:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d88c0 expref: 512 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.685259:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.685260:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.685260:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52290 lrc: 4/0,1 mode: --/PW res: [0x2b947:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.685262:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a573b31 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997038208:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.685266:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f6711731/0x3234de053c52282 lrc: 3/0,1 mode: --/PW res: [0x2b946:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.685273:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212057 00000100:00100000:1.0:1651529344.685274:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1552:39029:x1731745946517696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.685278:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f11baf3c/0x3234de053c4f595 lrc: 3/0,0 mode: PR/PR res: [0x2b947:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d88c0 expref: 512 pid: 156655 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.685279:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178505 count 1 00010000:00010000:1.0:1651529344.685282:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052977309/0x3234de053c52297 lrc: 3/0,1 mode: --/PW res: [0x2b949:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.685282:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f11baf3c/0x3234de053c4f595 lrc: 4/0,0 mode: PR/PR res: [0x2b947:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d88c0 expref: 512 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.685286:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002c4168d4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997038336:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.685289:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c4cf85 lrc: 2/0,0 mode: PR/PR res: [0x2b949:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cefbc expref: 512 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.685292:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.685292:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.685293:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052977309/0x3234de053c52297 lrc: 4/0,1 mode: --/PW res: [0x2b949:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.685296:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ff7bf023 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.685299:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c4cf85 lrc: 3/0,0 mode: PR/PR res: [0x2b949:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cefbc expref: 512 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.685302:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212058 00010000:00010000:1.0:1651529344.685303:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c4cf85 lrc: 4/0,0 mode: PR/PR res: [0x2b949:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cefbc expref: 512 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.685304:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a9519ec5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1552:39030:x1731745946517760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.685306:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bca72234 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997038400:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.685309:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178506 count 1 00000100:00100000:1.0:1651529344.685313:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000071742acc going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.685313:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5229e lrc: 3/0,1 mode: --/PW res: [0x2b94a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.685317:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000016f16ee8/0x3234de053c4d9e2 lrc: 2/0,0 mode: PR/PR res: [0x2b94a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d180a expref: 512 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.685320:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.685321:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.685321:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5229e lrc: 4/0,1 mode: --/PW res: [0x2b94a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.685328:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000016f16ee8/0x3234de053c4d9e2 lrc: 3/0,0 mode: PR/PR res: [0x2b94a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d180a expref: 512 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.685329:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.685331:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000016f16ee8/0x3234de053c4d9e2 lrc: 4/0,0 mode: PR/PR res: [0x2b94a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d180a expref: 512 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.685335:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004a6776b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997038464:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.685342:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e1aa6a77 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.685344:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.685347:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946517824 00000100:00100000:0.0:1651529344.685359:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212059 00000100:00100000:0.0:1651529344.685361:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1553:39030:x1731745946517824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.685362:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.685365:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178507 count 1 00010000:00010000:0.0:1651529344.685368:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c522a5 lrc: 3/0,1 mode: --/PW res: [0x2b94b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.685373:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.685373:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009540b5d6/0x3234de053c4f104 lrc: 2/0,0 mode: PR/PR res: [0x2b94b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7675 expref: 512 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.685376:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.685376:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.685377:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c522a5 lrc: 4/0,1 mode: --/PW res: [0x2b94b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.685383:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009540b5d6/0x3234de053c4f104 lrc: 3/0,0 mode: PR/PR res: [0x2b94b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7675 expref: 512 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.685386:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009540b5d6/0x3234de053c4f104 lrc: 4/0,0 mode: PR/PR res: [0x2b94b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7675 expref: 512 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.685390:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ea0220b6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997038528:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.685402:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000abca413e going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.685412:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946517888 00000100:00100000:1.0:1651529344.685420:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212060 00000100:00100000:1.0:1651529344.685421:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1554:39030:x1731745946517888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.685433:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178508 count 1 00010000:00010000:1.0:1651529344.685437:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c522ac lrc: 3/0,1 mode: --/PW res: [0x2b94c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685444:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c4ecdc lrc: 2/0,0 mode: PR/PR res: [0x2b94c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d653b expref: 512 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.685447:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.685448:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.685448:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c522ac lrc: 4/0,1 mode: --/PW res: [0x2b94c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685455:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c4ecdc lrc: 3/0,0 mode: PR/PR res: [0x2b94c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d653b expref: 512 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.685458:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c4ecdc lrc: 4/0,0 mode: PR/PR res: [0x2b94c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d653b expref: 512 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.685462:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000043b7984f pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997038592:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.685476:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 0000000053a0cffa going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.685482:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396398464 00010000:00010000:1.0:1651529344.685487:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e3b9e466/0x3234de053c4ec18 lrc: 4/0,0 mode: PR/PR res: [0x2b944:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d61e5 expref: 513 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.685494:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396398592 00010000:00010000:1.0:1651529344.685505:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000090b3e48a/0x3234de053c4cf2a lrc: 4/0,0 mode: PR/PR res: [0x2b946:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceea4 expref: 514 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.685514:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12835 00000100:00100000:1.0:1651529344.685515:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+514:41279:x1731746396398464:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.685518:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12836 00010000:00010000:1.0:1651529344.685519:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.685520:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+514:41279:x1731746396398592:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.685521:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e3b9e466/0x3234de053c4ec18 lrc: 4/0,0 mode: PR/PR res: [0x2b944:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d61e5 expref: 514 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.685523:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.685525:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e3b9e466/0x3234de053c4ec18 lrc: 3/0,0 mode: PR/PR res: [0x2b944:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d61e5 expref: 514 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.685525:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000090b3e48a/0x3234de053c4cf2a lrc: 4/0,0 mode: PR/PR res: [0x2b946:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceea4 expref: 514 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.685530:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3b9e466/0x3234de053c4ec18 lrc: 0/0,0 mode: --/PR res: [0x2b944:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d61e5 expref: 514 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.685530:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000090b3e48a/0x3234de053c4cf2a lrc: 3/0,0 mode: PR/PR res: [0x2b946:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceea4 expref: 514 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.685534:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.685534:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.685535:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c5227b lrc: 3/0,1 mode: PW/PW res: [0x2b944:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.685535:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090b3e48a/0x3234de053c4cf2a lrc: 0/0,0 mode: --/PR res: [0x2b946:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceea4 expref: 513 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.685538:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c5227b lrc: 4/0,1 mode: PW/PW res: [0x2b944:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.685539:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.685540:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.685541:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f6711731/0x3234de053c52282 lrc: 3/0,1 mode: PW/PW res: [0x2b946:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.685544:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6711731/0x3234de053c52282 lrc: 4/0,1 mode: PW/PW res: [0x2b946:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685546:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.685556:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+512:41279:x1731746396398464:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 39us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.685558:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12835 00010000:00010000:0.0:1651529344.685566:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.685574:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+511:41279:x1731746396398592:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 53us (201us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.685575:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f6711731/0x3234de053c52282 lrc: 3/0,1 mode: PW/PW res: [0x2b946:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.685577:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12836 00010000:00010000:1.0:1651529344.685578:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6711731/0x3234de053c52282 lrc: 3/0,1 mode: PW/PW res: [0x2b946:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685584:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6711731/0x3234de053c52282 lrc: 3/0,1 mode: PW/PW res: [0x2b946:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.685584:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c5227b lrc: 3/0,1 mode: PW/PW res: [0x2b944:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685587:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6711731/0x3234de053c52282 lrc: 2/0,0 mode: PW/PW res: [0x2b946:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.685587:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c5227b lrc: 3/0,1 mode: PW/PW res: [0x2b944:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.685591:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c5227b lrc: 3/0,1 mode: PW/PW res: [0x2b944:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.685599:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c5227b lrc: 2/0,0 mode: PW/PW res: [0x2b944:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.685629:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1556:39030:x1731745946517312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1418us (1470us total) trans 12885080108 rc 0/0 00000100:00100000:1.0:1651529344.685632:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212054 00000100:00100000:0.0:1651529344.685639:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1555:39030:x1731745946516864:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1492us (1601us total) trans 12885080109 rc 0/0 00000100:00100000:0.0:1651529344.685642:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212053 00010000:00010000:0.0:1651529344.685649:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6711731/0x3234de053c52282 lrc: 2/0,0 mode: PW/PW res: [0x2b946:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.685653:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f6711731 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.685654:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6711731/0x3234de053c52282 lrc: 2/0,0 mode: PW/PW res: [0x2b946:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.685659:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6711731/0x3234de053c52282 lrc: 3/0,0 mode: PW/PW res: [0x2b946:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.685664:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6711731/0x3234de053c52282 lrc: 1/0,0 mode: --/PW res: [0x2b946:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.685666:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6711731/0x3234de053c52282 lrc: 0/0,0 mode: --/PW res: [0x2b946:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.685670:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c5227b lrc: 2/0,0 mode: PW/PW res: [0x2b944:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.685673:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fafb79d3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.685674:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c5227b lrc: 2/0,0 mode: PW/PW res: [0x2b944:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.685676:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c5227b lrc: 3/0,0 mode: PW/PW res: [0x2b944:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.685680:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c5227b lrc: 1/0,0 mode: --/PW res: [0x2b944:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.685682:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c5227b lrc: 0/0,0 mode: --/PW res: [0x2b944:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.685799:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ad6d0877 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997038272:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.685803:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005a2a8776/0x3234de053c52289 lrc: 3/0,1 mode: --/PW res: [0x2b948:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.685815:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bca72234 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997038400:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.685818:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000052977309/0x3234de053c52297 lrc: 3/0,1 mode: --/PW res: [0x2b949:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.685830:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004a6776b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997038464:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.685833:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.685841:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5229e lrc: 3/0,1 mode: --/PW res: [0x2b94a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.685844:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.685852:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.685856:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002c4168d4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997038336:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.685859:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52290 lrc: 3/0,1 mode: --/PW res: [0x2b947:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.685860:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.685865:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.685865:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946518272 00000100:00100000:1.0:1651529344.685872:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.685875:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946518208 00000100:00100000:0.0:1651529344.685882:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212061 00000100:00100000:0.0:1651529344.685883:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1556:39030:x1731745946518272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.685893:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178510 count 1 00010000:00010000:0.0:1651529344.685897:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c522b3 lrc: 3/0,1 mode: --/PW res: [0x2b94e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.685902:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000efb77d18/0x3234de053c4a092 lrc: 2/0,0 mode: PR/PR res: [0x2b94e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7ed expref: 510 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.685905:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.685906:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.685906:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c522b3 lrc: 4/0,1 mode: --/PW res: [0x2b94e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.685913:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000efb77d18/0x3234de053c4a092 lrc: 3/0,0 mode: PR/PR res: [0x2b94e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7ed expref: 510 pid: 80277 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.685915:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396398720 00010000:00010000:0.0:1651529344.685916:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000efb77d18/0x3234de053c4a092 lrc: 4/0,0 mode: PR/PR res: [0x2b94e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7ed expref: 510 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.685921:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000040085363/0x3234de053c4db94 lrc: 4/0,0 mode: PR/PR res: [0x2b948:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e54 expref: 511 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.685921:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002c4168d4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997038656:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.685927:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396398848 00010000:00010000:1.0:1651529344.685929:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000016f16ee8/0x3234de053c4d9e2 lrc: 4/0,0 mode: PR/PR res: [0x2b94a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d180a expref: 512 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.685933:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396398784 00010000:00010000:1.0:1651529344.685940:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c4cf85 lrc: 4/0,0 mode: PR/PR res: [0x2b949:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cefbc expref: 513 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.685945:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396398912 00000100:00100000:0.0:1651529344.685947:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aac87b31 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.685948:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f11baf3c/0x3234de053c4f595 lrc: 4/0,0 mode: PR/PR res: [0x2b947:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d88c0 expref: 514 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.685952:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12837 00000100:00100000:1.0:1651529344.685954:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+514:41279:x1731746396398720:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.685955:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ea0220b6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997038528:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.685957:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.685958:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000040085363/0x3234de053c4db94 lrc: 4/0,0 mode: PR/PR res: [0x2b948:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e54 expref: 514 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.685958:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c522a5 lrc: 3/0,1 mode: --/PW res: [0x2b94b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685962:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000040085363/0x3234de053c4db94 lrc: 3/0,0 mode: PR/PR res: [0x2b948:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e54 expref: 514 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.685967:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040085363/0x3234de053c4db94 lrc: 0/0,0 mode: --/PR res: [0x2b948:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1e54 expref: 514 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.685971:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.685972:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.685972:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005a2a8776/0x3234de053c52289 lrc: 3/0,1 mode: PW/PW res: [0x2b948:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.685972:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.685976:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a2a8776/0x3234de053c52289 lrc: 4/0,1 mode: PW/PW res: [0x2b948:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.685982:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.685989:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+513:41279:x1731746396398720:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.685991:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12837 00000100:00100000:0.0:1651529344.685998:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.686004:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396398976 00010000:00010000:1.0:1651529344.686007:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009540b5d6/0x3234de053c4f104 lrc: 4/0,0 mode: PR/PR res: [0x2b94b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7675 expref: 513 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.686012:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396399040 00000100:00100000:0.0:1651529344.686016:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12838 00000100:00100000:0.0:1651529344.686018:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+514:41279:x1731746396398848:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.686021:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c4ecdc lrc: 5/0,0 mode: PR/PR res: [0x2b94c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d653b expref: 514 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.686022:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.686024:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000016f16ee8/0x3234de053c4d9e2 lrc: 4/0,0 mode: PR/PR res: [0x2b94a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d180a expref: 514 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.686026:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12839 00000100:00100000:1.0:1651529344.686028:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+514:41278:x1731746396398784:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.686028:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000016f16ee8/0x3234de053c4d9e2 lrc: 3/0,0 mode: PR/PR res: [0x2b94a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d180a expref: 514 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.686030:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.686031:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c4cf85 lrc: 4/0,0 mode: PR/PR res: [0x2b949:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cefbc expref: 514 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.686034:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016f16ee8/0x3234de053c4d9e2 lrc: 0/0,0 mode: --/PR res: [0x2b94a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d180a expref: 514 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.686035:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c4cf85 lrc: 3/0,0 mode: PR/PR res: [0x2b949:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cefbc expref: 514 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.686038:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.686038:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.686039:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5229e lrc: 3/0,1 mode: PW/PW res: [0x2b94a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.686042:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c4cf85 lrc: 0/0,0 mode: --/PR res: [0x2b949:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cefbc expref: 513 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.686045:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5229e lrc: 4/0,1 mode: PW/PW res: [0x2b94a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.686046:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.686047:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.686047:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000052977309/0x3234de053c52297 lrc: 3/0,1 mode: PW/PW res: [0x2b949:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.686050:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052977309/0x3234de053c52297 lrc: 4/0,1 mode: PW/PW res: [0x2b949:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686051:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.686057:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.686058:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+512:41279:x1731746396398848:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.686061:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12838 00000100:00100000:1.0:1651529344.686062:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+512:41278:x1731746396398784:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 34us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.686065:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12839 00000100:00100000:0.0:1651529344.686067:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12840 00000100:00100000:0.0:1651529344.686068:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+510:41278:x1731746396398912:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.686069:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12841 00000100:00100000:1.0:1651529344.686071:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000781af77d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+510:41278:x1731746396398976:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.686071:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.686072:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f11baf3c/0x3234de053c4f595 lrc: 4/0,0 mode: PR/PR res: [0x2b947:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d88c0 expref: 510 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.686073:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.686075:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009540b5d6/0x3234de053c4f104 lrc: 4/0,0 mode: PR/PR res: [0x2b94b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7675 expref: 510 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.686076:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f11baf3c/0x3234de053c4f595 lrc: 3/0,0 mode: PR/PR res: [0x2b947:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d88c0 expref: 510 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.686078:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009540b5d6/0x3234de053c4f104 lrc: 3/0,0 mode: PR/PR res: [0x2b94b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7675 expref: 510 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.686081:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f11baf3c/0x3234de053c4f595 lrc: 0/0,0 mode: --/PR res: [0x2b947:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d88c0 expref: 510 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.686083:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009540b5d6/0x3234de053c4f104 lrc: 0/0,0 mode: --/PR res: [0x2b94b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7675 expref: 510 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.686084:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.686085:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.686085:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52290 lrc: 3/0,1 mode: PW/PW res: [0x2b947:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.686088:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.686089:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.686090:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c522a5 lrc: 3/0,1 mode: PW/PW res: [0x2b94b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.686092:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c522a5 lrc: 4/0,1 mode: PW/PW res: [0x2b94b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.686102:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.686107:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000781af77d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+508:41278:x1731746396398976:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.686109:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12841 00000100:00100000:1.0:1651529344.686113:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12842 00010000:00010000:0.0:1651529344.686113:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52290 lrc: 4/0,1 mode: PW/PW res: [0x2b947:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.686115:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+507:41278:x1731746396399040:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.686117:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.686118:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c4ecdc lrc: 5/0,0 mode: PR/PR res: [0x2b94c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d653b expref: 507 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.686122:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c4ecdc lrc: 4/0,0 mode: PR/PR res: [0x2b94c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d653b expref: 507 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.686122:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.686126:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.686127:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.686127:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c522ac lrc: 3/0,1 mode: PW/PW res: [0x2b94c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.686129:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+507:41278:x1731746396398912:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 60us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.686132:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12840 00010000:00010000:1.0:1651529344.686133:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c522ac lrc: 4/0,1 mode: PW/PW res: [0x2b94c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.686137:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.686141:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+506:41278:x1731746396399040:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 26us (144us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.686142:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5229e lrc: 3/0,1 mode: PW/PW res: [0x2b94a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.686144:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12842 00010000:00010000:0.0:1651529344.686145:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5229e lrc: 3/0,1 mode: PW/PW res: [0x2b94a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686148:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5229e lrc: 3/0,1 mode: PW/PW res: [0x2b94a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.686151:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212062 00010000:00010000:0.0:1651529344.686151:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5229e lrc: 2/0,0 mode: PW/PW res: [0x2b94a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.686152:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1556:39029:x1731745946518208:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.686157:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178509 count 1 00010000:00010000:1.0:1651529344.686160:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1848133/0x3234de053c522ba lrc: 3/0,1 mode: --/PW res: [0x2b94d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.686165:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c8cd6ea4/0x3234de053c4d1a7 lrc: 2/0,0 mode: PR/PR res: [0x2b94d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf813 expref: 505 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.686168:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.686168:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.686169:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1848133/0x3234de053c522ba lrc: 4/0,1 mode: --/PW res: [0x2b94d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.686175:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c8cd6ea4/0x3234de053c4d1a7 lrc: 3/0,0 mode: PR/PR res: [0x2b94d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf813 expref: 505 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.686178:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c8cd6ea4/0x3234de053c4d1a7 lrc: 4/0,0 mode: PR/PR res: [0x2b94d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf813 expref: 505 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.686185:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003de40890 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997038720:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.686193:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fb6c773d going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.686193:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a9519ec5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1557:39030:x1731745946517760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 887us (1056us total) trans 12885080110 rc 0/0 00000100:00100000:0.0:1651529344.686196:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212058 00010000:00010000:0.0:1651529344.686202:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52290 lrc: 3/0,1 mode: PW/PW res: [0x2b947:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.686204:0:72397:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c4ecdc lrc: 0/0,0 mode: --/PR res: [0x2b94c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d653b expref: 505 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.686205:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52290 lrc: 3/0,1 mode: PW/PW res: [0x2b947:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.686208:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000043b7984f pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997038592:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.686208:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52290 lrc: 3/0,1 mode: PW/PW res: [0x2b947:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.686211:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c522ac lrc: 3/0,1 mode: PW/PW res: [0x2b94c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686211:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52290 lrc: 2/0,0 mode: PW/PW res: [0x2b947:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.686214:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c522ac lrc: 3/0,1 mode: PW/PW res: [0x2b94c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.686217:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c522ac lrc: 3/0,1 mode: PW/PW res: [0x2b94c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.686220:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c522ac lrc: 3/0,1 mode: PW/PW res: [0x2b94c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.686240:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c522ac lrc: 2/0,0 mode: PW/PW res: [0x2b94c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.686272:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1558:39029:x1731745946517568:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1057us (1147us total) trans 12885080111 rc 0/0 00000100:00100000:0.0:1651529344.686275:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212056 00010000:00010000:0.0:1651529344.686282:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5229e lrc: 2/0,0 mode: PW/PW res: [0x2b94a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.686283:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1557:39030:x1731745946517888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 861us (928us total) trans 12885080112 rc 0/0 00010000:00010000:0.0:1651529344.686285:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f0bd9bfb already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.686286:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212060 00010000:00010000:0.0:1651529344.686286:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5229e lrc: 2/0,0 mode: PW/PW res: [0x2b94a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686289:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5229e lrc: 3/0,0 mode: PW/PW res: [0x2b94a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686293:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5229e lrc: 1/0,0 mode: --/PW res: [0x2b94a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.686294:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005a2a8776/0x3234de053c52289 lrc: 3/0,1 mode: PW/PW res: [0x2b948:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686296:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5229e lrc: 0/0,0 mode: --/PW res: [0x2b94a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.686297:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a2a8776/0x3234de053c52289 lrc: 3/0,1 mode: PW/PW res: [0x2b948:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686300:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52290 lrc: 2/0,0 mode: PW/PW res: [0x2b947:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.686301:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a2a8776/0x3234de053c52289 lrc: 3/0,1 mode: PW/PW res: [0x2b948:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.686303:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a2a8776/0x3234de053c52289 lrc: 2/0,0 mode: PW/PW res: [0x2b948:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686303:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004dda5a3f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.686304:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52290 lrc: 2/0,0 mode: PW/PW res: [0x2b947:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686307:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52290 lrc: 3/0,0 mode: PW/PW res: [0x2b947:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686310:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52290 lrc: 1/0,0 mode: --/PW res: [0x2b947:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686313:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52290 lrc: 0/0,0 mode: --/PW res: [0x2b947:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686316:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c522ac lrc: 2/0,0 mode: PW/PW res: [0x2b94c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686319:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000587473f4 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.686333:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1557:39030:x1731745946517632:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1149us (1247us total) trans 12885080113 rc 0/0 00010000:00010000:0.0:1651529344.686334:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c522ac lrc: 2/0,0 mode: PW/PW res: [0x2b94c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.686336:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212055 00010000:00010000:0.0:1651529344.686337:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c522ac lrc: 3/0,0 mode: PW/PW res: [0x2b94c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686341:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c522ac lrc: 1/0,0 mode: --/PW res: [0x2b94c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686343:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c522ac lrc: 0/0,0 mode: --/PW res: [0x2b94c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686348:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a2a8776/0x3234de053c52289 lrc: 2/0,0 mode: PW/PW res: [0x2b948:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686351:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005a2a8776 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.686352:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a2a8776/0x3234de053c52289 lrc: 2/0,0 mode: PW/PW res: [0x2b948:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.686354:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000052977309/0x3234de053c52297 lrc: 3/0,1 mode: PW/PW res: [0x2b949:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686354:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a2a8776/0x3234de053c52289 lrc: 3/0,0 mode: PW/PW res: [0x2b948:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.686357:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052977309/0x3234de053c52297 lrc: 3/0,1 mode: PW/PW res: [0x2b949:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686358:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a2a8776/0x3234de053c52289 lrc: 1/0,0 mode: --/PW res: [0x2b948:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.686360:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052977309/0x3234de053c52297 lrc: 3/0,1 mode: PW/PW res: [0x2b949:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686360:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a2a8776/0x3234de053c52289 lrc: 0/0,0 mode: --/PW res: [0x2b948:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.686363:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000052977309/0x3234de053c52297 lrc: 2/0,0 mode: PW/PW res: [0x2b949:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686377:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000052977309/0x3234de053c52297 lrc: 2/0,0 mode: PW/PW res: [0x2b949:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686380:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000052977309 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.686381:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000052977309/0x3234de053c52297 lrc: 2/0,0 mode: PW/PW res: [0x2b949:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686383:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000052977309/0x3234de053c52297 lrc: 3/0,0 mode: PW/PW res: [0x2b949:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686387:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000052977309/0x3234de053c52297 lrc: 1/0,0 mode: --/PW res: [0x2b949:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686389:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052977309/0x3234de053c52297 lrc: 0/0,0 mode: --/PW res: [0x2b949:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686395:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c522a5 lrc: 3/0,1 mode: PW/PW res: [0x2b94b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686398:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c522a5 lrc: 3/0,1 mode: PW/PW res: [0x2b94b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.686400:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1557:39029:x1731745946517696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1125us (1255us total) trans 12885080114 rc 0/0 00010000:00010000:0.0:1651529344.686401:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c522a5 lrc: 3/0,1 mode: PW/PW res: [0x2b94b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.686404:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212057 00010000:00010000:0.0:1651529344.686404:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c522a5 lrc: 2/0,0 mode: PW/PW res: [0x2b94b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.686446:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1557:39030:x1731745946517824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1084us (1116us total) trans 12885080115 rc 0/0 00000100:00100000:0.0:1651529344.686449:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212059 00000100:00100000:1.0:1651529344.686454:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.686456:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c522a5 lrc: 2/0,0 mode: PW/PW res: [0x2b94b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686459:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006401eb97 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.686460:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c522a5 lrc: 2/0,0 mode: PW/PW res: [0x2b94b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686463:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c522a5 lrc: 3/0,0 mode: PW/PW res: [0x2b94b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686467:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c522a5 lrc: 1/0,0 mode: --/PW res: [0x2b94b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686470:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c522a5 lrc: 0/0,0 mode: --/PW res: [0x2b94b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.686480:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002c4168d4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997038656:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.686483:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c522b3 lrc: 3/0,1 mode: --/PW res: [0x2b94e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.686545:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396399104 00010000:00010000:1.0:1651529344.686551:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000efb77d18/0x3234de053c4a092 lrc: 4/0,0 mode: PR/PR res: [0x2b94e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7ed expref: 505 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.686559:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12843 00000100:00100000:1.0:1651529344.686561:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+505:41279:x1731746396399104:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.686563:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.686565:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000efb77d18/0x3234de053c4a092 lrc: 4/0,0 mode: PR/PR res: [0x2b94e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7ed expref: 505 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.686569:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000efb77d18/0x3234de053c4a092 lrc: 3/0,0 mode: PR/PR res: [0x2b94e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7ed expref: 505 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.686574:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000efb77d18/0x3234de053c4a092 lrc: 0/0,0 mode: --/PR res: [0x2b94e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7ed expref: 505 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.686578:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.686578:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.686579:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c522b3 lrc: 3/0,1 mode: PW/PW res: [0x2b94e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.686582:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c522b3 lrc: 4/0,1 mode: PW/PW res: [0x2b94e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.686592:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.686595:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c522b3 lrc: 3/0,1 mode: PW/PW res: [0x2b94e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686599:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c522b3 lrc: 3/0,1 mode: PW/PW res: [0x2b94e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.686603:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+504:41279:x1731746396399104:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.686606:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12843 00010000:00010000:0.0:1651529344.686612:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c522b3 lrc: 3/0,1 mode: PW/PW res: [0x2b94e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686615:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c522b3 lrc: 2/0,0 mode: PW/PW res: [0x2b94e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.686671:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1557:39030:x1731745946518272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 787us (826us total) trans 12885080116 rc 0/0 00000100:00100000:0.0:1651529344.686674:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212061 00010000:00010000:0.0:1651529344.686681:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c522b3 lrc: 2/0,0 mode: PW/PW res: [0x2b94e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686685:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001391dc6d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.686686:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c522b3 lrc: 2/0,0 mode: PW/PW res: [0x2b94e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686689:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c522b3 lrc: 3/0,0 mode: PW/PW res: [0x2b94e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686715:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c522b3 lrc: 1/0,0 mode: --/PW res: [0x2b94e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686718:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c522b3 lrc: 0/0,0 mode: --/PW res: [0x2b94e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.686751:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.686763:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.686763:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946518592 00000100:00100000:1.0:1651529344.686771:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.686783:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946518720 00000100:00100000:0.0:1651529344.686788:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946518848 00000100:00100000:1.0:1651529344.686792:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.686799:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.686810:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212063 00000100:00100000:0.0:1651529344.686812:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1559:39029:x1731745946518592:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.686814:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:0.0:1651529344.686818:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178511 count 1 00000100:00100000:1.0:1651529344.686821:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.686822:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c522c1 lrc: 3/0,1 mode: --/PW res: [0x2b94f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686827:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb5f35bf/0x3234de053c4efc2 lrc: 2/0,0 mode: PR/PR res: [0x2b94f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d71a5 expref: 503 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.686830:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.686831:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003de40890 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997038720:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.686831:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.686831:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c522c1 lrc: 4/0,1 mode: --/PW res: [0x2b94f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.686835:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b1848133/0x3234de053c522ba lrc: 3/0,1 mode: --/PW res: [0x2b94d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686841:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eb5f35bf/0x3234de053c4efc2 lrc: 3/0,0 mode: PR/PR res: [0x2b94f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d71a5 expref: 503 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.686842:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946518976 00010000:00010000:0.0:1651529344.686845:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eb5f35bf/0x3234de053c4efc2 lrc: 4/0,0 mode: PR/PR res: [0x2b94f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d71a5 expref: 503 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.686848:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946518784 00000100:00100000:1.0:1651529344.686855:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946518912 00000100:00100000:1.0:1651529344.686858:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212064 00000100:00100000:1.0:1651529344.686860:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1562:39029:x1731745946518720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.686865:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178512 count 1 00010000:00010000:1.0:1651529344.686869:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c522c8 lrc: 3/0,1 mode: --/PW res: [0x2b950:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.686873:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4f1dd lrc: 2/0,0 mode: PR/PR res: [0x2b950:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a6c expref: 503 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.686876:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.686877:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.686878:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c522c8 lrc: 4/0,1 mode: --/PW res: [0x2b950:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.686884:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002c4168d4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997038784:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.686894:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c0dff858 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.686900:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4f1dd lrc: 3/0,0 mode: PR/PR res: [0x2b950:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a6c expref: 503 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.686901:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212065 00000100:00100000:0.0:1651529344.686903:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1562:39029:x1731745946518848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.686904:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4f1dd lrc: 4/0,0 mode: PR/PR res: [0x2b950:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a6c expref: 503 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.686908:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003de40890 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997038848:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.686908:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178514 count 1 00010000:00010000:0.0:1651529344.686912:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c522cf lrc: 3/0,1 mode: --/PW res: [0x2b952:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.686916:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000392a99d/0x3234de053c4ce5f lrc: 2/0,0 mode: PR/PR res: [0x2b952:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb08 expref: 503 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.686917:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d09f5ee1 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.686919:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.686920:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.686921:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c522cf lrc: 4/0,1 mode: --/PW res: [0x2b952:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.686924:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212066 00000100:00100000:1.0:1651529344.686925:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1562:39029:x1731745946518976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.686927:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000392a99d/0x3234de053c4ce5f lrc: 3/0,0 mode: PR/PR res: [0x2b952:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb08 expref: 503 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.686930:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178516 count 1 00010000:00010000:0.0:1651529344.686930:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000392a99d/0x3234de053c4ce5f lrc: 4/0,0 mode: PR/PR res: [0x2b952:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb08 expref: 503 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.686933:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000345d04ae/0x3234de053c522d6 lrc: 3/0,1 mode: --/PW res: [0x2b954:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.686935:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004a6776b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997038912:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.686938:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000041fd63bb/0x3234de053c4ea4a lrc: 2/0,0 mode: PR/PR res: [0x2b954:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a91 expref: 503 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.686941:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.686941:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.686941:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000abca413e going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.686942:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000345d04ae/0x3234de053c522d6 lrc: 4/0,1 mode: --/PW res: [0x2b954:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.686947:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212067 00010000:00010000:1.0:1651529344.686948:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000041fd63bb/0x3234de053c4ea4a lrc: 3/0,0 mode: PR/PR res: [0x2b954:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a91 expref: 503 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.686949:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1562:39029:x1731745946518784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.686953:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178513 count 1 00010000:00010000:1.0:1651529344.686954:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000041fd63bb/0x3234de053c4ea4a lrc: 4/0,0 mode: PR/PR res: [0x2b954:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a91 expref: 503 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.686956:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c522dd lrc: 3/0,1 mode: --/PW res: [0x2b951:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.686957:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ac8dec6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997038976:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.686960:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c586dd32/0x3234de053c4c79e lrc: 2/0,0 mode: PR/PR res: [0x2b951:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd0f2 expref: 503 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.686963:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000053a0cffa going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.686963:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.686963:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.686964:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c522dd lrc: 4/0,1 mode: --/PW res: [0x2b951:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.686969:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212068 00010000:00010000:0.0:1651529344.686970:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c586dd32/0x3234de053c4c79e lrc: 3/0,0 mode: PR/PR res: [0x2b951:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd0f2 expref: 503 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.686971:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1562:39029:x1731745946518912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.686973:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c586dd32/0x3234de053c4c79e lrc: 4/0,0 mode: PR/PR res: [0x2b951:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd0f2 expref: 503 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:1.0:1651529344.686974:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178515 count 1 00010000:00010000:1.0:1651529344.686977:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c522e4 lrc: 3/0,1 mode: --/PW res: [0x2b953:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.686977:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000059363096 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997039040:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.686981:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b1296ccd/0x3234de053c4f1f9 lrc: 2/0,0 mode: PR/PR res: [0x2b953:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ac0 expref: 503 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.686983:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 000000003ad73843 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.686984:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.686985:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.686985:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c522e4 lrc: 4/0,1 mode: --/PW res: [0x2b953:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.686991:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b1296ccd/0x3234de053c4f1f9 lrc: 3/0,0 mode: PR/PR res: [0x2b953:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ac0 expref: 503 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.686995:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b1296ccd/0x3234de053c4f1f9 lrc: 4/0,0 mode: PR/PR res: [0x2b953:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ac0 expref: 503 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.686997:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.687001:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029abc941 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997039104:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.687007:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 0000000071742acc going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.687012:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946519040 00000100:00100000:1.0:1651529344.687023:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212069 00000100:00100000:1.0:1651529344.687025:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1563:39030:x1731745946519040:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.687049:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178517 count 1 00010000:00010000:1.0:1651529344.687058:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009273683/0x3234de053c522eb lrc: 3/0,1 mode: --/PW res: [0x2b955:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687063:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001753c503/0x3234de053c4d670 lrc: 2/0,0 mode: PR/PR res: [0x2b955:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b29 expref: 503 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.687066:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.687066:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.687067:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009273683/0x3234de053c522eb lrc: 4/0,1 mode: --/PW res: [0x2b955:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687073:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001753c503/0x3234de053c4d670 lrc: 3/0,0 mode: PR/PR res: [0x2b955:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b29 expref: 503 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.687077:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001753c503/0x3234de053c4d670 lrc: 4/0,0 mode: PR/PR res: [0x2b955:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b29 expref: 503 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.687081:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005d3fb3ef pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997039168:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.687094:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a5495eb going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.687101:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396399680 00010000:00010000:1.0:1651529344.687105:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c8cd6ea4/0x3234de053c4d1a7 lrc: 4/0,0 mode: PR/PR res: [0x2b94d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf813 expref: 504 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.687113:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12844 00000100:00100000:1.0:1651529344.687114:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+504:41279:x1731746396399680:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.687117:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.687119:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c8cd6ea4/0x3234de053c4d1a7 lrc: 4/0,0 mode: PR/PR res: [0x2b94d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf813 expref: 504 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.687130:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c8cd6ea4/0x3234de053c4d1a7 lrc: 3/0,0 mode: PR/PR res: [0x2b94d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf813 expref: 504 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.687136:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8cd6ea4/0x3234de053c4d1a7 lrc: 0/0,0 mode: --/PR res: [0x2b94d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf813 expref: 504 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.687140:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.687140:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.687141:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b1848133/0x3234de053c522ba lrc: 3/0,1 mode: PW/PW res: [0x2b94d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687144:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1848133/0x3234de053c522ba lrc: 4/0,1 mode: PW/PW res: [0x2b94d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687150:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.687161:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+503:41279:x1731746396399680:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 46us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.687164:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12844 00010000:00010000:1.0:1651529344.687173:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b1848133/0x3234de053c522ba lrc: 3/0,1 mode: PW/PW res: [0x2b94d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687176:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1848133/0x3234de053c522ba lrc: 3/0,1 mode: PW/PW res: [0x2b94d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687186:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1848133/0x3234de053c522ba lrc: 3/0,1 mode: PW/PW res: [0x2b94d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687189:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b1848133/0x3234de053c522ba lrc: 2/0,0 mode: PW/PW res: [0x2b94d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687201:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b1848133/0x3234de053c522ba lrc: 2/0,0 mode: PW/PW res: [0x2b94d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687205:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b1848133 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.687206:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1848133/0x3234de053c522ba lrc: 2/0,0 mode: PW/PW res: [0x2b94d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687209:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1848133/0x3234de053c522ba lrc: 3/0,0 mode: PW/PW res: [0x2b94d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687214:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b1848133/0x3234de053c522ba lrc: 1/0,0 mode: --/PW res: [0x2b94d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687217:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1848133/0x3234de053c522ba lrc: 0/0,0 mode: --/PW res: [0x2b94d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.687251:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1564:39029:x1731745946518208:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1098us (1391us total) trans 12885080117 rc 0/0 00000100:00100000:1.0:1651529344.687254:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212062 00000100:00100000:0.0:1651529344.687328:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002c4168d4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997038784:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.687330:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.687333:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c522c1 lrc: 3/0,1 mode: --/PW res: [0x2b94f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.687338:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.687347:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003de40890 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997038848:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.687352:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c522c8 lrc: 3/0,1 mode: --/PW res: [0x2b950:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.687358:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396399744 00010000:00010000:1.0:1651529344.687363:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4f1dd lrc: 4/0,0 mode: PR/PR res: [0x2b950:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a6c expref: 503 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.687369:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396399808 00010000:00010000:1.0:1651529344.687371:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eb5f35bf/0x3234de053c4efc2 lrc: 4/0,0 mode: PR/PR res: [0x2b94f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d71a5 expref: 504 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.687382:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12845 00000100:00100000:1.0:1651529344.687384:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+504:41279:x1731746396399744:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.687385:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12846 00010000:00010000:1.0:1651529344.687387:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.687387:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+504:41278:x1731746396399808:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.687388:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4f1dd lrc: 4/0,0 mode: PR/PR res: [0x2b950:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a6c expref: 504 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.687391:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.687392:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4f1dd lrc: 3/0,0 mode: PR/PR res: [0x2b950:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a6c expref: 504 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.687393:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eb5f35bf/0x3234de053c4efc2 lrc: 4/0,0 mode: PR/PR res: [0x2b94f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d71a5 expref: 504 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.687397:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003aeb15a8/0x3234de053c4f1dd lrc: 0/0,0 mode: --/PR res: [0x2b950:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a6c expref: 504 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.687397:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eb5f35bf/0x3234de053c4efc2 lrc: 3/0,0 mode: PR/PR res: [0x2b94f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d71a5 expref: 504 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.687401:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.687401:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.687402:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c522c8 lrc: 3/0,1 mode: PW/PW res: [0x2b950:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687402:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb5f35bf/0x3234de053c4efc2 lrc: 0/0,0 mode: --/PR res: [0x2b94f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d71a5 expref: 503 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.687405:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c522c8 lrc: 4/0,1 mode: PW/PW res: [0x2b950:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687406:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.687407:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.687408:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c522c1 lrc: 3/0,1 mode: PW/PW res: [0x2b94f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687411:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.687411:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c522c1 lrc: 4/0,1 mode: PW/PW res: [0x2b94f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687417:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.687422:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+502:41279:x1731746396399744:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.687424:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12845 00000100:00100000:0.0:1651529344.687430:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+501:41278:x1731746396399808:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (92us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.687432:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c522c8 lrc: 3/0,1 mode: PW/PW res: [0x2b950:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.687433:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12846 00010000:00010000:1.0:1651529344.687435:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c522c8 lrc: 3/0,1 mode: PW/PW res: [0x2b950:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687438:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c522c8 lrc: 3/0,1 mode: PW/PW res: [0x2b950:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687441:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c522c8 lrc: 2/0,0 mode: PW/PW res: [0x2b950:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687441:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c522c1 lrc: 3/0,1 mode: PW/PW res: [0x2b94f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687468:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c522c1 lrc: 3/0,1 mode: PW/PW res: [0x2b94f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687472:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c522c1 lrc: 3/0,1 mode: PW/PW res: [0x2b94f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687474:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c522c1 lrc: 2/0,0 mode: PW/PW res: [0x2b94f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.687488:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1564:39029:x1731745946518720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 627us (724us total) trans 12885080118 rc 0/0 00000100:00100000:1.0:1651529344.687490:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212064 00000100:00100000:1.0:1651529344.687538:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.687541:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1564:39029:x1731745946518592:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 728us (796us total) trans 12885080119 rc 0/0 00000100:00100000:0.0:1651529344.687545:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212063 00000100:00100000:0.0:1651529344.687550:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946519552 00000100:00100000:0.0:1651529344.687567:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212070 00000100:00100000:0.0:1651529344.687569:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1564:39029:x1731745946519552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.687574:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178518 count 1 00010000:00010000:0.0:1651529344.687578:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c522f2 lrc: 3/0,1 mode: --/PW res: [0x2b956:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687582:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b2188136/0x3234de053c4d631 lrc: 2/0,0 mode: PR/PR res: [0x2b956:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a57 expref: 500 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.687586:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.687586:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.687587:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c522f2 lrc: 4/0,1 mode: --/PW res: [0x2b956:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687593:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b2188136/0x3234de053c4d631 lrc: 3/0,0 mode: PR/PR res: [0x2b956:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a57 expref: 500 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.687597:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b2188136/0x3234de053c4d631 lrc: 4/0,0 mode: PR/PR res: [0x2b956:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a57 expref: 500 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.687598:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.687601:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002c4168d4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997039232:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.687609:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.687616:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c0dff858 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.687625:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c522c8 lrc: 2/0,0 mode: PW/PW res: [0x2b950:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687629:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000015737583 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.687630:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c522c8 lrc: 2/0,0 mode: PW/PW res: [0x2b950:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687633:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c522c8 lrc: 3/0,0 mode: PW/PW res: [0x2b950:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687637:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c522c8 lrc: 1/0,0 mode: --/PW res: [0x2b950:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687640:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c522c8 lrc: 0/0,0 mode: --/PW res: [0x2b950:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.687652:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ac8dec6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997038976:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.687657:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000345d04ae/0x3234de053c522d6 lrc: 3/0,1 mode: --/PW res: [0x2b954:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687665:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c522c1 lrc: 2/0,0 mode: PW/PW res: [0x2b94f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687668:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000576f1f12 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.687669:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c522c1 lrc: 2/0,0 mode: PW/PW res: [0x2b94f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.687670:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396399872 00010000:00010000:0.0:1651529344.687672:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c522c1 lrc: 3/0,0 mode: PW/PW res: [0x2b94f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687675:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000041fd63bb/0x3234de053c4ea4a lrc: 4/0,0 mode: PR/PR res: [0x2b954:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a91 expref: 501 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.687675:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c522c1 lrc: 1/0,0 mode: --/PW res: [0x2b94f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687680:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c522c1 lrc: 0/0,0 mode: --/PW res: [0x2b94f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.687681:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396399936 00010000:00010000:1.0:1651529344.687683:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000392a99d/0x3234de053c4ce5f lrc: 5/0,0 mode: PR/PR res: [0x2b952:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb08 expref: 502 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.687691:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12847 00000100:00100000:0.0:1651529344.687691:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004a6776b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997038912:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.687693:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+502:41279:x1731746396399872:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.687695:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.687695:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c522cf lrc: 3/0,1 mode: --/PW res: [0x2b952:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687696:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000041fd63bb/0x3234de053c4ea4a lrc: 4/0,0 mode: PR/PR res: [0x2b954:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a91 expref: 502 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.687700:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000041fd63bb/0x3234de053c4ea4a lrc: 3/0,0 mode: PR/PR res: [0x2b954:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a91 expref: 502 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.687701:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000059363096 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997039040:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.687703:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c522dd lrc: 3/0,1 mode: --/PW res: [0x2b951:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687705:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041fd63bb/0x3234de053c4ea4a lrc: 0/0,0 mode: --/PR res: [0x2b954:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a91 expref: 502 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.687709:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.687709:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.687710:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000345d04ae/0x3234de053c522d6 lrc: 3/0,1 mode: PW/PW res: [0x2b954:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687713:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000345d04ae/0x3234de053c522d6 lrc: 4/0,1 mode: PW/PW res: [0x2b954:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687719:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.687733:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+501:41279:x1731746396399872:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 39us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.687733:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.687746:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12847 00000100:00100000:1.0:1651529344.687750:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396400000 00010000:00010000:1.0:1651529344.687754:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c586dd32/0x3234de053c4c79e lrc: 4/0,0 mode: PR/PR res: [0x2b951:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd0f2 expref: 501 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.687759:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12848 00000100:00100000:1.0:1651529344.687761:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de45c136 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+501:41279:x1731746396399936:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.687767:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.687776:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.687777:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000392a99d/0x3234de053c4ce5f lrc: 4/0,0 mode: PR/PR res: [0x2b952:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb08 expref: 501 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.687777:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.687781:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000392a99d/0x3234de053c4ce5f lrc: 3/0,0 mode: PR/PR res: [0x2b952:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb08 expref: 501 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.687783:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.687791:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000392a99d/0x3234de053c4ce5f lrc: 0/0,0 mode: --/PR res: [0x2b952:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceb08 expref: 501 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.687799:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.687800:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.687800:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c522cf lrc: 3/0,1 mode: PW/PW res: [0x2b952:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.687800:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396400064 00010000:00010000:1.0:1651529344.687804:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c522cf lrc: 4/0,1 mode: PW/PW res: [0x2b952:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687805:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b1296ccd/0x3234de053c4f1f9 lrc: 5/0,0 mode: PR/PR res: [0x2b953:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ac0 expref: 501 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.687813:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.687818:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12849 00000100:00100000:1.0:1651529344.687823:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de45c136 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+501:41279:x1731746396399936:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 61us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.687825:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12848 00000100:00100000:0.0:1651529344.687825:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+501:41279:x1731746396400000:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.687828:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.687830:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c586dd32/0x3234de053c4c79e lrc: 4/0,0 mode: PR/PR res: [0x2b951:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd0f2 expref: 500 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.687834:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12850 00000100:00100000:1.0:1651529344.687836:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+500:41278:x1731746396400064:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.687836:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c586dd32/0x3234de053c4c79e lrc: 3/0,0 mode: PR/PR res: [0x2b951:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd0f2 expref: 500 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.687839:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.687840:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b1296ccd/0x3234de053c4f1f9 lrc: 5/0,0 mode: PR/PR res: [0x2b953:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ac0 expref: 500 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.687842:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c586dd32/0x3234de053c4c79e lrc: 0/0,0 mode: --/PR res: [0x2b951:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd0f2 expref: 500 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.687844:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b1296ccd/0x3234de053c4f1f9 lrc: 4/0,0 mode: PR/PR res: [0x2b953:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ac0 expref: 500 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.687845:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.687846:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.687847:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c522dd lrc: 3/0,1 mode: PW/PW res: [0x2b951:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687849:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.687849:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.687850:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c522e4 lrc: 3/0,1 mode: PW/PW res: [0x2b953:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687853:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c522e4 lrc: 4/0,1 mode: PW/PW res: [0x2b953:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687857:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.687861:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+499:41278:x1731746396400064:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 25us (84us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.687863:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12850 00010000:00010000:0.0:1651529344.687864:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c522dd lrc: 4/0,1 mode: PW/PW res: [0x2b951:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687871:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.687872:0:72397:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1296ccd/0x3234de053c4f1f9 lrc: 0/0,0 mode: --/PR res: [0x2b953:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ac0 expref: 498 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.687876:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029abc941 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997039104:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.687879:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c522e4 lrc: 3/0,1 mode: PW/PW res: [0x2b953:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.687879:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+497:41279:x1731746396400000:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 58us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.687882:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12849 00010000:00010000:1.0:1651529344.687885:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c522e4 lrc: 3/0,1 mode: PW/PW res: [0x2b953:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687888:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c522e4 lrc: 3/0,1 mode: PW/PW res: [0x2b953:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687889:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c522cf lrc: 3/0,1 mode: PW/PW res: [0x2b952:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687891:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c522e4 lrc: 3/0,1 mode: PW/PW res: [0x2b953:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687892:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c522cf lrc: 3/0,1 mode: PW/PW res: [0x2b952:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687893:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c522e4 lrc: 2/0,0 mode: PW/PW res: [0x2b953:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687896:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c522cf lrc: 3/0,1 mode: PW/PW res: [0x2b952:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687907:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c522cf lrc: 2/0,0 mode: PW/PW res: [0x2b952:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.687935:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1566:39029:x1731745946518912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 963us (1113us total) trans 12885080120 rc 0/0 00000100:00100000:1.0:1651529344.687938:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212068 00000100:00100000:1.0:1651529344.687942:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946519680 00000100:00100000:0.0:1651529344.687947:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1566:39029:x1731745946518848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1043us (1175us total) trans 12885080121 rc 0/0 00000100:00100000:1.0:1651529344.687948:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946519616 00000100:00100000:0.0:1651529344.687950:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212065 00000100:00100000:1.0:1651529344.687957:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212071 00000100:00100000:1.0:1651529344.687959:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1566:39030:x1731745946519680:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.687963:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212072 00002000:00080000:1.0:1651529344.687964:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178520 count 1 00000100:00100000:0.0:1651529344.687965:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1566:39029:x1731745946519616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.687968:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f192428c/0x3234de053c522f9 lrc: 3/0,1 mode: --/PW res: [0x2b958:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.687970:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178519 count 1 00010000:00010000:1.0:1651529344.687972:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000018426b1/0x3234de053c4ea27 lrc: 2/0,0 mode: PR/PR res: [0x2b958:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a1a expref: 496 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.687974:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52300 lrc: 3/0,1 mode: --/PW res: [0x2b957:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687978:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.687978:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.687979:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f192428c/0x3234de053c522f9 lrc: 4/0,1 mode: --/PW res: [0x2b958:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.687979:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f4de0c86/0x3234de053c49fc7 lrc: 2/0,0 mode: PR/PR res: [0x2b957:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb54d expref: 496 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.687982:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.687983:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.687983:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52300 lrc: 4/0,1 mode: --/PW res: [0x2b957:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.687985:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000018426b1/0x3234de053c4ea27 lrc: 3/0,0 mode: PR/PR res: [0x2b958:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a1a expref: 496 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.687989:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000018426b1/0x3234de053c4ea27 lrc: 4/0,0 mode: PR/PR res: [0x2b958:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a1a expref: 496 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.687990:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f4de0c86/0x3234de053c49fc7 lrc: 3/0,0 mode: PR/PR res: [0x2b957:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb54d expref: 496 pid: 72397 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.687993:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029abc941 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997039296:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.687993:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f4de0c86/0x3234de053c49fc7 lrc: 4/0,0 mode: PR/PR res: [0x2b957:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb54d expref: 496 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.688000:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000089d7f5d6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997039360:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.688001:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d09f5ee1 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.688009:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bff8744a going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.688010:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005d3fb3ef pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997039168:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.688013:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c522dd lrc: 3/0,1 mode: PW/PW res: [0x2b951:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.688014:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000009273683/0x3234de053c522eb lrc: 3/0,1 mode: --/PW res: [0x2b955:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688016:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c522dd lrc: 3/0,1 mode: PW/PW res: [0x2b951:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.688020:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000345d04ae/0x3234de053c522d6 lrc: 3/0,1 mode: PW/PW res: [0x2b954:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688020:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c522dd lrc: 3/0,1 mode: PW/PW res: [0x2b951:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688022:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c522dd lrc: 2/0,0 mode: PW/PW res: [0x2b951:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.688023:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000345d04ae/0x3234de053c522d6 lrc: 3/0,1 mode: PW/PW res: [0x2b954:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.688026:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000345d04ae/0x3234de053c522d6 lrc: 3/0,1 mode: PW/PW res: [0x2b954:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.688032:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000345d04ae/0x3234de053c522d6 lrc: 2/0,0 mode: PW/PW res: [0x2b954:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.688058:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1568:39029:x1731745946518784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1108us (1258us total) trans 12885080122 rc 0/0 00000100:00100000:0.0:1651529344.688061:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212067 00000100:00100000:1.0:1651529344.688068:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1567:39029:x1731745946518976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1142us (1280us total) trans 12885080123 rc 0/0 00010000:00010000:0.0:1651529344.688068:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c522e4 lrc: 2/0,0 mode: PW/PW res: [0x2b953:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.688071:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212066 00010000:00010000:0.0:1651529344.688071:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001c46cc6d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.688072:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c522e4 lrc: 2/0,0 mode: PW/PW res: [0x2b953:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688075:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c522e4 lrc: 3/0,0 mode: PW/PW res: [0x2b953:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688080:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c522e4 lrc: 1/0,0 mode: --/PW res: [0x2b953:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688083:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c522e4 lrc: 0/0,0 mode: --/PW res: [0x2b953:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688087:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c522cf lrc: 2/0,0 mode: PW/PW res: [0x2b952:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688097:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008517b233 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.688098:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c522cf lrc: 2/0,0 mode: PW/PW res: [0x2b952:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688101:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c522cf lrc: 3/0,0 mode: PW/PW res: [0x2b952:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.688102:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.688104:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c522cf lrc: 1/0,0 mode: --/PW res: [0x2b952:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688107:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c522cf lrc: 0/0,0 mode: --/PW res: [0x2b952:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688110:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c522dd lrc: 2/0,0 mode: PW/PW res: [0x2b951:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.688113:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.688113:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fc4c513 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.688114:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c522dd lrc: 2/0,0 mode: PW/PW res: [0x2b951:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688117:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c522dd lrc: 3/0,0 mode: PW/PW res: [0x2b951:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688120:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c522dd lrc: 1/0,0 mode: --/PW res: [0x2b951:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688122:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c522dd lrc: 0/0,0 mode: --/PW res: [0x2b951:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688125:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000345d04ae/0x3234de053c522d6 lrc: 2/0,0 mode: PW/PW res: [0x2b954:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688128:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000345d04ae already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.688129:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000345d04ae/0x3234de053c522d6 lrc: 2/0,0 mode: PW/PW res: [0x2b954:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688131:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000345d04ae/0x3234de053c522d6 lrc: 3/0,0 mode: PW/PW res: [0x2b954:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688134:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000345d04ae/0x3234de053c522d6 lrc: 1/0,0 mode: --/PW res: [0x2b954:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688137:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000345d04ae/0x3234de053c522d6 lrc: 0/0,0 mode: --/PW res: [0x2b954:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.688160:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002c4168d4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997039232:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.688164:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c522f2 lrc: 3/0,1 mode: --/PW res: [0x2b956:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.688193:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396400192 00010000:00010000:1.0:1651529344.688204:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001753c503/0x3234de053c4d670 lrc: 4/0,0 mode: PR/PR res: [0x2b955:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b29 expref: 497 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.688214:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396400256 00010000:00010000:1.0:1651529344.688216:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b2188136/0x3234de053c4d631 lrc: 4/0,0 mode: PR/PR res: [0x2b956:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a57 expref: 498 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.688218:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12851 00000100:00100000:0.0:1651529344.688220:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+498:41279:x1731746396400192:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.688240:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12852 00000100:00100000:1.0:1651529344.688242:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+498:41279:x1731746396400256:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.688245:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.688246:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b2188136/0x3234de053c4d631 lrc: 4/0,0 mode: PR/PR res: [0x2b956:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a57 expref: 498 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.688250:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b2188136/0x3234de053c4d631 lrc: 3/0,0 mode: PR/PR res: [0x2b956:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a57 expref: 498 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.688253:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.688255:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001753c503/0x3234de053c4d670 lrc: 4/0,0 mode: PR/PR res: [0x2b955:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b29 expref: 498 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.688258:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2188136/0x3234de053c4d631 lrc: 0/0,0 mode: --/PR res: [0x2b956:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a57 expref: 498 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.688260:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001753c503/0x3234de053c4d670 lrc: 3/0,0 mode: PR/PR res: [0x2b955:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b29 expref: 498 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.688262:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.688263:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.688263:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c522f2 lrc: 3/0,1 mode: PW/PW res: [0x2b956:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688265:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001753c503/0x3234de053c4d670 lrc: 0/0,0 mode: --/PR res: [0x2b955:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b29 expref: 497 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.688266:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c522f2 lrc: 4/0,1 mode: PW/PW res: [0x2b956:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688269:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.688270:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.688271:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009273683/0x3234de053c522eb lrc: 3/0,1 mode: PW/PW res: [0x2b955:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.688275:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.688280:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009273683/0x3234de053c522eb lrc: 4/0,1 mode: PW/PW res: [0x2b955:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.688286:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+496:41279:x1731746396400256:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 43us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.688288:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12852 00010000:00010000:1.0:1651529344.688301:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000009273683/0x3234de053c522eb lrc: 3/0,1 mode: PW/PW res: [0x2b955:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.688304:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009273683/0x3234de053c522eb lrc: 3/0,1 mode: PW/PW res: [0x2b955:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688308:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.688312:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009273683/0x3234de053c522eb lrc: 3/0,1 mode: PW/PW res: [0x2b955:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.688315:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009273683/0x3234de053c522eb lrc: 2/0,0 mode: PW/PW res: [0x2b955:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.688316:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+495:41279:x1731746396400192:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 95us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.688319:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12851 00010000:00010000:0.0:1651529344.688343:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009273683/0x3234de053c522eb lrc: 2/0,0 mode: PW/PW res: [0x2b955:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688347:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000009273683 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.688348:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009273683/0x3234de053c522eb lrc: 2/0,0 mode: PW/PW res: [0x2b955:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688351:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009273683/0x3234de053c522eb lrc: 3/0,0 mode: PW/PW res: [0x2b955:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688355:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009273683/0x3234de053c522eb lrc: 1/0,0 mode: --/PW res: [0x2b955:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688358:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009273683/0x3234de053c522eb lrc: 0/0,0 mode: --/PW res: [0x2b955:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.688359:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1567:39030:x1731745946519040:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1333us (1362us total) trans 12885080124 rc 0/0 00000100:00100000:1.0:1651529344.688362:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212069 00010000:00010000:0.0:1651529344.688363:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c522f2 lrc: 3/0,1 mode: PW/PW res: [0x2b956:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688366:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c522f2 lrc: 3/0,1 mode: PW/PW res: [0x2b956:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688381:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c522f2 lrc: 3/0,1 mode: PW/PW res: [0x2b956:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688384:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c522f2 lrc: 2/0,0 mode: PW/PW res: [0x2b956:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.688397:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.688423:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1567:39029:x1731745946519552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 853us (885us total) trans 12885080125 rc 0/0 00000100:00100000:0.0:1651529344.688426:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212070 00000100:00100000:0.0:1651529344.688431:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946519744 00000100:00100000:1.0:1651529344.688438:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.688438:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212073 00000100:00100000:0.0:1651529344.688439:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1567:39029:x1731745946519744:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.688473:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178521 count 1 00010000:00010000:0.0:1651529344.688477:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52307 lrc: 3/0,1 mode: --/PW res: [0x2b959:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688482:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006685f816/0x3234de053c4f21c lrc: 2/0,0 mode: PR/PR res: [0x2b959:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b30 expref: 494 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.688485:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.688486:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.688486:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52307 lrc: 4/0,1 mode: --/PW res: [0x2b959:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.688492:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.688493:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006685f816/0x3234de053c4f21c lrc: 3/0,0 mode: PR/PR res: [0x2b959:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b30 expref: 494 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.688496:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006685f816/0x3234de053c4f21c lrc: 4/0,0 mode: PR/PR res: [0x2b959:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b30 expref: 494 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.688500:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.688501:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002c4168d4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997039424:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.688509:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.688509:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c0dff858 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.688535:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c522f2 lrc: 2/0,0 mode: PW/PW res: [0x2b956:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.688540:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.688541:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000091ee0f93 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.688542:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c522f2 lrc: 2/0,0 mode: PW/PW res: [0x2b956:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.688551:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946519808 00000100:00100000:1.0:1651529344.688558:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946519872 00010000:00010000:0.0:1651529344.688563:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c522f2 lrc: 3/0,0 mode: PW/PW res: [0x2b956:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.688566:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946519936 00010000:00010000:0.0:1651529344.688568:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c522f2 lrc: 1/0,0 mode: --/PW res: [0x2b956:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.688570:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212074 00010000:00010000:0.0:1651529344.688571:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c522f2 lrc: 0/0,0 mode: --/PW res: [0x2b956:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.688572:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1570:39030:x1731745946519808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.688577:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178522 count 1 00010000:00010000:1.0:1651529344.688582:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8c6a7f2/0x3234de053c5230e lrc: 3/0,1 mode: --/PW res: [0x2b95a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.688586:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009e650250/0x3234de053c4f6e5 lrc: 2/0,0 mode: PR/PR res: [0x2b95a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8e1c expref: 494 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.688590:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.688590:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.688590:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212075 00010000:00010000:1.0:1651529344.688591:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8c6a7f2/0x3234de053c5230e lrc: 4/0,1 mode: --/PW res: [0x2b95a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.688592:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1570:39029:x1731745946519872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.688597:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009e650250/0x3234de053c4f6e5 lrc: 3/0,0 mode: PR/PR res: [0x2b95a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8e1c expref: 494 pid: 156655 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.688598:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178523 count 1 00010000:00010000:1.0:1651529344.688601:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009e650250/0x3234de053c4f6e5 lrc: 4/0,0 mode: PR/PR res: [0x2b95a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8e1c expref: 494 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.688601:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c52315 lrc: 3/0,1 mode: --/PW res: [0x2b95b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.688605:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005cc6463a pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997039488:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.688614:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f79d8146 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.688621:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029abc941 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997039296:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.688624:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f192428c/0x3234de053c522f9 lrc: 3/0,1 mode: --/PW res: [0x2b958:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688627:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000044a7b260/0x3234de053c4d305 lrc: 2/0,0 mode: PR/PR res: [0x2b95b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe1e expref: 494 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.688630:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.688631:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.688631:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c52315 lrc: 4/0,1 mode: --/PW res: [0x2b95b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688641:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000044a7b260/0x3234de053c4d305 lrc: 3/0,0 mode: PR/PR res: [0x2b95b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe1e expref: 494 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.688642:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212076 00000100:00100000:1.0:1651529344.688644:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1570:39030:x1731745946519936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.688645:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000044a7b260/0x3234de053c4d305 lrc: 4/0,0 mode: PR/PR res: [0x2b95b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe1e expref: 494 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:1.0:1651529344.688649:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178524 count 1 00000100:00100000:0.0:1651529344.688649:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002a957ba7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997039552:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.688652:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094a0ec28/0x3234de053c5231c lrc: 3/0,1 mode: --/PW res: [0x2b95c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.688656:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000769aa8eb/0x3234de053c4d2c6 lrc: 2/0,0 mode: PR/PR res: [0x2b95c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd22 expref: 494 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.688658:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000abca413e going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.688659:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.688660:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.688661:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094a0ec28/0x3234de053c5231c lrc: 4/0,1 mode: --/PW res: [0x2b95c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.688667:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000769aa8eb/0x3234de053c4d2c6 lrc: 3/0,0 mode: PR/PR res: [0x2b95c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd22 expref: 494 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.688667:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000089d7f5d6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997039360:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.688670:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52300 lrc: 3/0,1 mode: --/PW res: [0x2b957:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.688672:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000769aa8eb/0x3234de053c4d2c6 lrc: 4/0,0 mode: PR/PR res: [0x2b95c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd22 expref: 494 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.688677:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000088fa78f8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997039616:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.688684:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d09f5ee1 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.688690:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396400768 00010000:00010000:1.0:1651529344.688695:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000018426b1/0x3234de053c4ea27 lrc: 4/0,0 mode: PR/PR res: [0x2b958:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a1a expref: 495 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.688698:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.688701:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396400832 00010000:00010000:1.0:1651529344.688711:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f4de0c86/0x3234de053c49fc7 lrc: 4/0,0 mode: PR/PR res: [0x2b957:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb54d expref: 496 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.688717:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12853 00000100:00100000:1.0:1651529344.688719:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+496:41278:x1731746396400768:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.688722:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.688723:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000018426b1/0x3234de053c4ea27 lrc: 4/0,0 mode: PR/PR res: [0x2b958:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a1a expref: 496 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.688727:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000018426b1/0x3234de053c4ea27 lrc: 3/0,0 mode: PR/PR res: [0x2b958:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a1a expref: 496 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.688727:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.688732:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000018426b1/0x3234de053c4ea27 lrc: 0/0,0 mode: --/PR res: [0x2b958:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5a1a expref: 496 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.688748:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.688749:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.688750:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f192428c/0x3234de053c522f9 lrc: 3/0,1 mode: PW/PW res: [0x2b958:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.688758:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.688759:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f192428c/0x3234de053c522f9 lrc: 4/0,1 mode: PW/PW res: [0x2b958:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.688766:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946520000 00010000:00010000:1.0:1651529344.688767:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.688773:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946520064 00000100:00100000:1.0:1651529344.688779:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+495:41278:x1731746396400768:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 59us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.688782:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12853 00000100:00100000:0.0:1651529344.688782:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212077 00000100:00100000:0.0:1651529344.688784:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1572:39030:x1731745946520000:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.688787:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396400896 00010000:00010000:1.0:1651529344.688790:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006685f816/0x3234de053c4f21c lrc: 5/0,0 mode: PR/PR res: [0x2b959:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b30 expref: 495 pid: 72396 timeout: 20103 lvb_type: 1 00002000:00080000:0.0:1651529344.688790:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178525 count 1 00010000:00010000:0.0:1651529344.688793:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c52323 lrc: 3/0,1 mode: --/PW res: [0x2b95d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.688796:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12854 00000100:00100000:1.0:1651529344.688797:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+495:41278:x1731746396400832:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.688798:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005c8ce251/0x3234de053c4de7a lrc: 2/0,0 mode: PR/PR res: [0x2b95d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2abe expref: 495 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.688799:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.688801:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f4de0c86/0x3234de053c49fc7 lrc: 4/0,0 mode: PR/PR res: [0x2b957:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb54d expref: 495 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.688804:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f4de0c86/0x3234de053c49fc7 lrc: 3/0,0 mode: PR/PR res: [0x2b957:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb54d expref: 495 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.688804:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.688804:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.688805:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c52323 lrc: 4/0,1 mode: --/PW res: [0x2b95d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.688809:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4de0c86/0x3234de053c49fc7 lrc: 0/0,0 mode: --/PR res: [0x2b957:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb54d expref: 495 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.688812:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005c8ce251/0x3234de053c4de7a lrc: 3/0,0 mode: PR/PR res: [0x2b95d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2abe expref: 495 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.688813:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.688813:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.688814:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52300 lrc: 3/0,1 mode: PW/PW res: [0x2b957:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688815:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005c8ce251/0x3234de053c4de7a lrc: 4/0,0 mode: PR/PR res: [0x2b95d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2abe expref: 494 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.688817:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52300 lrc: 4/0,1 mode: PW/PW res: [0x2b957:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.688819:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000057329b82 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997039680:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.688825:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.688834:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 000000003c8b0daf going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.688835:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+494:41278:x1731746396400832:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 38us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.688838:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12854 00000100:00100000:0.0:1651529344.688840:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212078 00000100:00100000:1.0:1651529344.688842:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12855 00000100:00100000:0.0:1651529344.688842:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1572:39030:x1731745946520064:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.688844:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005239dfe7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+493:41279:x1731746396400896:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.688846:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00080000:0.0:1651529344.688846:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178526 count 1 00010000:00010000:1.0:1651529344.688848:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006685f816/0x3234de053c4f21c lrc: 5/0,0 mode: PR/PR res: [0x2b959:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b30 expref: 493 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.688849:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c5232a lrc: 3/0,1 mode: --/PW res: [0x2b95e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.688851:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006685f816/0x3234de053c4f21c lrc: 4/0,0 mode: PR/PR res: [0x2b959:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b30 expref: 493 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.688854:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cab2bcca/0x3234de053c4f40d lrc: 2/0,0 mode: PR/PR res: [0x2b95e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d828b expref: 493 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.688855:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.688856:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.688857:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52307 lrc: 3/0,1 mode: PW/PW res: [0x2b959:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688857:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.688857:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.688858:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c5232a lrc: 4/0,1 mode: --/PW res: [0x2b95e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.688862:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52307 lrc: 4/0,1 mode: PW/PW res: [0x2b959:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.688866:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.688866:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cab2bcca/0x3234de053c4f40d lrc: 3/0,0 mode: PR/PR res: [0x2b95e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d828b expref: 493 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.688870:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005239dfe7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+493:41279:x1731746396400896:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 25us (112us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.688870:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cab2bcca/0x3234de053c4f40d lrc: 4/0,0 mode: PR/PR res: [0x2b95e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d828b expref: 493 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.688872:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12855 00000100:00100000:0.0:1651529344.688874:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006e3eb319 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997039744:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.688880:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 0000000070e666f7 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.688885:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f192428c/0x3234de053c522f9 lrc: 3/0,1 mode: PW/PW res: [0x2b958:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688885:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52300 lrc: 3/0,1 mode: PW/PW res: [0x2b957:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.688888:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f192428c/0x3234de053c522f9 lrc: 3/0,1 mode: PW/PW res: [0x2b958:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688888:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52300 lrc: 3/0,1 mode: PW/PW res: [0x2b957:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.688891:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f192428c/0x3234de053c522f9 lrc: 3/0,1 mode: PW/PW res: [0x2b958:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688891:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52300 lrc: 3/0,1 mode: PW/PW res: [0x2b957:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688893:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52300 lrc: 2/0,0 mode: PW/PW res: [0x2b957:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.688894:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f192428c/0x3234de053c522f9 lrc: 2/0,0 mode: PW/PW res: [0x2b958:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.688937:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1574:39030:x1731745946519680:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 977us (1170us total) trans 12885080126 rc 0/0 00000100:00100000:1.0:1651529344.688940:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212071 00000100:00100000:0.0:1651529344.688940:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1574:39029:x1731745946519616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 974us (1156us total) trans 12885080127 rc 0/0 00000100:00100000:0.0:1651529344.688970:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212072 00010000:00010000:0.0:1651529344.688979:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52300 lrc: 2/0,0 mode: PW/PW res: [0x2b957:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.688999:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c5599f68 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.689000:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52300 lrc: 2/0,0 mode: PW/PW res: [0x2b957:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.689003:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52300 lrc: 3/0,0 mode: PW/PW res: [0x2b957:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.689008:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52300 lrc: 1/0,0 mode: --/PW res: [0x2b957:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.689010:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52300 lrc: 0/0,0 mode: --/PW res: [0x2b957:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.689015:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f192428c/0x3234de053c522f9 lrc: 2/0,0 mode: PW/PW res: [0x2b958:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.689017:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f192428c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.689018:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f192428c/0x3234de053c522f9 lrc: 2/0,0 mode: PW/PW res: [0x2b958:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.689021:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f192428c/0x3234de053c522f9 lrc: 3/0,0 mode: PW/PW res: [0x2b958:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.689024:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f192428c/0x3234de053c522f9 lrc: 1/0,0 mode: --/PW res: [0x2b958:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.689027:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f192428c/0x3234de053c522f9 lrc: 0/0,0 mode: --/PW res: [0x2b958:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.689050:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.689070:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002a957ba7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997039552:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.689074:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c52315 lrc: 3/0,1 mode: --/PW res: [0x2b95b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.689081:0:151609:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006685f816/0x3234de053c4f21c lrc: 0/0,0 mode: --/PR res: [0x2b959:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b30 expref: 492 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.689085:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002c4168d4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997039424:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.689087:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52307 lrc: 3/0,1 mode: PW/PW res: [0x2b959:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.689090:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52307 lrc: 3/0,1 mode: PW/PW res: [0x2b959:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.689091:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.689092:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52307 lrc: 3/0,1 mode: PW/PW res: [0x2b959:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.689095:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52307 lrc: 3/0,1 mode: PW/PW res: [0x2b959:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.689098:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52307 lrc: 2/0,0 mode: PW/PW res: [0x2b959:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.689099:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.689108:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005cc6463a pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997039488:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.689113:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d8c6a7f2/0x3234de053c5230e lrc: 3/0,1 mode: --/PW res: [0x2b95a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.689119:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000088fa78f8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997039616:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.689122:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000094a0ec28/0x3234de053c5231c lrc: 3/0,1 mode: --/PW res: [0x2b95c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.689128:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396400960 00010000:00010000:1.0:1651529344.689132:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009e650250/0x3234de053c4f6e5 lrc: 4/0,0 mode: PR/PR res: [0x2b95a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8e1c expref: 492 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.689137:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396401088 00010000:00010000:1.0:1651529344.689139:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000769aa8eb/0x3234de053c4d2c6 lrc: 4/0,0 mode: PR/PR res: [0x2b95c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd22 expref: 493 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.689143:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396401024 00010000:00010000:1.0:1651529344.689145:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000044a7b260/0x3234de053c4d305 lrc: 4/0,0 mode: PR/PR res: [0x2b95b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe1e expref: 494 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.689149:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12856 00000100:00100000:1.0:1651529344.689151:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+494:41278:x1731746396400960:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.689153:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.689154:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009e650250/0x3234de053c4f6e5 lrc: 4/0,0 mode: PR/PR res: [0x2b95a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8e1c expref: 494 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.689158:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009e650250/0x3234de053c4f6e5 lrc: 3/0,0 mode: PR/PR res: [0x2b95a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8e1c expref: 494 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.689171:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e650250/0x3234de053c4f6e5 lrc: 0/0,0 mode: --/PR res: [0x2b95a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8e1c expref: 494 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.689175:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.689176:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.689177:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d8c6a7f2/0x3234de053c5230e lrc: 3/0,1 mode: PW/PW res: [0x2b95a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.689178:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1573:39029:x1731745946519744:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 727us (770us total) trans 12885080128 rc 0/0 00010000:00010000:1.0:1651529344.689180:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8c6a7f2/0x3234de053c5230e lrc: 4/0,1 mode: PW/PW res: [0x2b95a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.689183:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212073 00010000:00010000:1.0:1651529344.689186:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.689190:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52307 lrc: 2/0,0 mode: PW/PW res: [0x2b959:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.689192:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+493:41278:x1731746396400960:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 41us (142us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.689194:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000048ee8765 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.689195:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12856 00010000:00010000:0.0:1651529344.689195:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52307 lrc: 2/0,0 mode: PW/PW res: [0x2b959:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.689198:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52307 lrc: 3/0,0 mode: PW/PW res: [0x2b959:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.689199:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12857 00000100:00100000:1.0:1651529344.689201:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+492:41278:x1731746396401088:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.689202:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52307 lrc: 1/0,0 mode: --/PW res: [0x2b959:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.689203:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.689204:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000769aa8eb/0x3234de053c4d2c6 lrc: 4/0,0 mode: PR/PR res: [0x2b95c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd22 expref: 492 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.689205:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52307 lrc: 0/0,0 mode: --/PW res: [0x2b959:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.689208:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000769aa8eb/0x3234de053c4d2c6 lrc: 3/0,0 mode: PR/PR res: [0x2b95c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd22 expref: 492 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.689212:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000769aa8eb/0x3234de053c4d2c6 lrc: 0/0,0 mode: --/PR res: [0x2b95c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd22 expref: 492 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.689218:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.689218:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.689219:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000094a0ec28/0x3234de053c5231c lrc: 3/0,1 mode: PW/PW res: [0x2b95c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.689233:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094a0ec28/0x3234de053c5231c lrc: 4/0,1 mode: PW/PW res: [0x2b95c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.689243:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.689249:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+491:41278:x1731746396401088:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 48us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.689252:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12857 00000100:00100000:1.0:1651529344.689256:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12858 00000100:00100000:1.0:1651529344.689257:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+490:41279:x1731746396401024:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.689260:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.689269:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000044a7b260/0x3234de053c4d305 lrc: 4/0,0 mode: PR/PR res: [0x2b95b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe1e expref: 490 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.689273:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000044a7b260/0x3234de053c4d305 lrc: 3/0,0 mode: PR/PR res: [0x2b95b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe1e expref: 490 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.689278:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044a7b260/0x3234de053c4d305 lrc: 0/0,0 mode: --/PR res: [0x2b95b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe1e expref: 490 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.689281:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.689285:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.689287:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.689288:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c52315 lrc: 3/0,1 mode: PW/PW res: [0x2b95b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.689291:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c52315 lrc: 4/0,1 mode: PW/PW res: [0x2b95b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.689300:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.689306:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+489:41279:x1731746396401024:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 48us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.689308:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12858 00000100:00100000:0.0:1651529344.689320:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.689325:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000094a0ec28/0x3234de053c5231c lrc: 3/0,1 mode: PW/PW res: [0x2b95c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.689329:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094a0ec28/0x3234de053c5231c lrc: 3/0,1 mode: PW/PW res: [0x2b95c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.689332:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094a0ec28/0x3234de053c5231c lrc: 3/0,1 mode: PW/PW res: [0x2b95c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.689335:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094a0ec28/0x3234de053c5231c lrc: 2/0,0 mode: PW/PW res: [0x2b95c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.689341:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.689358:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.689370:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006e3eb319 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997039744:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.689374:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c5232a lrc: 3/0,1 mode: --/PW res: [0x2b95e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.689380:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094a0ec28/0x3234de053c5231c lrc: 2/0,0 mode: PW/PW res: [0x2b95c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.689384:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000094a0ec28 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.689385:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094a0ec28/0x3234de053c5231c lrc: 2/0,0 mode: PW/PW res: [0x2b95c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.689388:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094a0ec28/0x3234de053c5231c lrc: 3/0,0 mode: PW/PW res: [0x2b95c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.689395:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1573:39030:x1731745946519936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 750us (885us total) trans 12885080129 rc 0/0 00000100:00100000:1.0:1651529344.689398:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212076 00000100:00100000:1.0:1651529344.689403:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946520192 00000100:00100000:1.0:1651529344.689409:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946520128 00000100:00100000:1.0:1651529344.689412:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212079 00010000:00010000:0.0:1651529344.689413:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094a0ec28/0x3234de053c5231c lrc: 1/0,0 mode: --/PW res: [0x2b95c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.689414:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1574:39030:x1731745946520192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.689416:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094a0ec28/0x3234de053c5231c lrc: 0/0,0 mode: --/PW res: [0x2b95c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.689419:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178528 count 1 00010000:00010000:1.0:1651529344.689423:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000437ad37b/0x3234de053c52331 lrc: 3/0,1 mode: --/PW res: [0x2b960:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.689426:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000057329b82 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997039680:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.689428:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000010b94550/0x3234de053c4f5db lrc: 2/0,0 mode: PR/PR res: [0x2b960:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89ca expref: 488 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.689429:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c52323 lrc: 3/0,1 mode: --/PW res: [0x2b95d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.689431:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.689431:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.689432:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000437ad37b/0x3234de053c52331 lrc: 4/0,1 mode: --/PW res: [0x2b960:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.689434:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c52315 lrc: 3/0,1 mode: PW/PW res: [0x2b95b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.689436:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c52315 lrc: 3/0,1 mode: PW/PW res: [0x2b95b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.689438:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000010b94550/0x3234de053c4f5db lrc: 3/0,0 mode: PR/PR res: [0x2b960:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89ca expref: 488 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.689440:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c52315 lrc: 3/0,1 mode: PW/PW res: [0x2b95b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.689442:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000010b94550/0x3234de053c4f5db lrc: 4/0,0 mode: PR/PR res: [0x2b960:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89ca expref: 488 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.689445:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c52315 lrc: 2/0,0 mode: PW/PW res: [0x2b95b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.689446:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000088fa78f8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997039808:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.689454:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f79d8146 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.689460:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212080 00000100:00100000:1.0:1651529344.689462:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1574:39029:x1731745946520128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.689466:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178527 count 1 00010000:00010000:1.0:1651529344.689469:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005206389b/0x3234de053c52338 lrc: 3/0,1 mode: --/PW res: [0x2b95f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.689475:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d2f0294b/0x3234de053c4ce90 lrc: 2/0,0 mode: PR/PR res: [0x2b95f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec58 expref: 488 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.689478:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.689479:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.689479:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005206389b/0x3234de053c52338 lrc: 4/0,1 mode: --/PW res: [0x2b95f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.689483:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1575:39029:x1731745946519872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 890us (992us total) trans 12885080130 rc 0/0 00010000:00010000:1.0:1651529344.689485:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d2f0294b/0x3234de053c4ce90 lrc: 3/0,0 mode: PR/PR res: [0x2b95f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec58 expref: 488 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.689486:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212075 00010000:00010000:1.0:1651529344.689488:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d2f0294b/0x3234de053c4ce90 lrc: 4/0,0 mode: PR/PR res: [0x2b95f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec58 expref: 488 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.689491:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005cc6463a pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997039872:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.689493:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c52315 lrc: 2/0,0 mode: PW/PW res: [0x2b95b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.689497:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d09f5ee1 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.689497:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000323a7bf8 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.689498:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c52315 lrc: 2/0,0 mode: PW/PW res: [0x2b95b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.689500:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c52315 lrc: 3/0,0 mode: PW/PW res: [0x2b95b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.689503:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396401152 00010000:00010000:0.0:1651529344.689505:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c52315 lrc: 1/0,0 mode: --/PW res: [0x2b95b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.689507:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005c8ce251/0x3234de053c4de7a lrc: 4/0,0 mode: PR/PR res: [0x2b95d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2abe expref: 489 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.689507:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000323a7bf8/0x3234de053c52315 lrc: 0/0,0 mode: --/PW res: [0x2b95b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.689514:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396401216 00010000:00010000:1.0:1651529344.689516:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cab2bcca/0x3234de053c4f40d lrc: 4/0,0 mode: PR/PR res: [0x2b95e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d828b expref: 490 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.689521:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12859 00000100:00100000:1.0:1651529344.689522:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+490:41279:x1731746396401152:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.689523:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.689526:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.689527:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005c8ce251/0x3234de053c4de7a lrc: 4/0,0 mode: PR/PR res: [0x2b95d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2abe expref: 490 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.689530:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005c8ce251/0x3234de053c4de7a lrc: 3/0,0 mode: PR/PR res: [0x2b95d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2abe expref: 490 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.689536:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c8ce251/0x3234de053c4de7a lrc: 0/0,0 mode: --/PR res: [0x2b95d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2abe expref: 490 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.689539:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.689540:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.689541:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c52323 lrc: 3/0,1 mode: PW/PW res: [0x2b95d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.689544:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c52323 lrc: 4/0,1 mode: PW/PW res: [0x2b95d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.689566:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.689571:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c52323 lrc: 3/0,1 mode: PW/PW res: [0x2b95d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.689578:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c52323 lrc: 3/0,1 mode: PW/PW res: [0x2b95d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.689583:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+489:41279:x1731746396401152:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 60us (241us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.689585:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c52323 lrc: 3/0,1 mode: PW/PW res: [0x2b95d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.689586:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12859 00010000:00010000:0.0:1651529344.689588:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c52323 lrc: 2/0,0 mode: PW/PW res: [0x2b95d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.689591:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12860 00000100:00100000:1.0:1651529344.689592:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+488:41278:x1731746396401216:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.689595:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.689596:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cab2bcca/0x3234de053c4f40d lrc: 4/0,0 mode: PR/PR res: [0x2b95e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d828b expref: 488 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.689602:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cab2bcca/0x3234de053c4f40d lrc: 3/0,0 mode: PR/PR res: [0x2b95e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d828b expref: 488 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.689607:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cab2bcca/0x3234de053c4f40d lrc: 0/0,0 mode: --/PR res: [0x2b95e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d828b expref: 488 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.689610:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.689611:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.689611:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c5232a lrc: 3/0,1 mode: PW/PW res: [0x2b95e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.689614:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c5232a lrc: 4/0,1 mode: PW/PW res: [0x2b95e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.689622:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.689627:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+487:41278:x1731746396401216:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 34us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.689629:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12860 00000100:00100000:0.0:1651529344.689634:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1575:39030:x1731745946520000:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 849us (949us total) trans 12885080131 rc 0/0 00010000:00010000:1.0:1651529344.689636:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d8c6a7f2/0x3234de053c5230e lrc: 3/0,1 mode: PW/PW res: [0x2b95a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.689637:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212077 00010000:00010000:1.0:1651529344.689640:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8c6a7f2/0x3234de053c5230e lrc: 3/0,1 mode: PW/PW res: [0x2b95a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.689642:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946520256 00010000:00010000:1.0:1651529344.689643:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8c6a7f2/0x3234de053c5230e lrc: 3/0,1 mode: PW/PW res: [0x2b95a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.689648:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8c6a7f2/0x3234de053c5230e lrc: 2/0,0 mode: PW/PW res: [0x2b95a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.689649:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212081 00000100:00100000:0.0:1651529344.689650:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1575:39030:x1731745946520256:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.689661:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178529 count 1 00010000:00010000:0.0:1651529344.689665:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000933c22d6/0x3234de053c5233f lrc: 3/0,1 mode: --/PW res: [0x2b961:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.689670:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c4cc0c lrc: 2/0,0 mode: PR/PR res: [0x2b961:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce217 expref: 486 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.689673:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.689674:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.689675:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000933c22d6/0x3234de053c5233f lrc: 4/0,1 mode: --/PW res: [0x2b961:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.689688:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1576:39030:x1731745946519808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1115us (1251us total) trans 12885080132 rc 0/0 00000100:00100000:1.0:1651529344.689691:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212074 00010000:00010000:0.0:1651529344.689699:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c4cc0c lrc: 3/0,0 mode: PR/PR res: [0x2b961:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce217 expref: 486 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.689703:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c4cc0c lrc: 4/0,0 mode: PR/PR res: [0x2b961:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce217 expref: 486 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.689706:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.689707:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006e3eb319 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997039936:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.689716:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 000000003c8b0daf going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.689720:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.689720:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c5232a lrc: 3/0,1 mode: PW/PW res: [0x2b95e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.689723:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c5232a lrc: 3/0,1 mode: PW/PW res: [0x2b95e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.689727:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c5232a lrc: 3/0,1 mode: PW/PW res: [0x2b95e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.689729:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c5232a lrc: 2/0,0 mode: PW/PW res: [0x2b95e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.689766:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946520320 00000100:00100000:1.0:1651529344.689777:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946520384 00000100:00100000:1.0:1651529344.689782:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212082 00000100:00100000:1.0:1651529344.689783:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1578:39030:x1731745946520320:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.689789:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178530 count 1 00010000:00010000:1.0:1651529344.689793:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099a3e2d9/0x3234de053c52346 lrc: 3/0,1 mode: --/PW res: [0x2b962:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.689803:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000090b66157/0x3234de053c4f47d lrc: 2/0,0 mode: PR/PR res: [0x2b962:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84a6 expref: 486 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.689804:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1578:39030:x1731745946520064:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 960us (1076us total) trans 12885080133 rc 0/0 00010000:00010000:1.0:1651529344.689807:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.689807:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.689807:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212078 00010000:00010000:1.0:1651529344.689808:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099a3e2d9/0x3234de053c52346 lrc: 4/0,1 mode: --/PW res: [0x2b962:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.689812:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212083 00000100:00100000:0.0:1651529344.689814:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1577:39029:x1731745946520384:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.689815:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000090b66157/0x3234de053c4f47d lrc: 3/0,0 mode: PR/PR res: [0x2b962:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84a6 expref: 486 pid: 72396 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.689819:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178531 count 1 00010000:00010000:1.0:1651529344.689821:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000090b66157/0x3234de053c4f47d lrc: 4/0,0 mode: PR/PR res: [0x2b962:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84a6 expref: 486 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.689823:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e69b5582/0x3234de053c5234d lrc: 3/0,1 mode: --/PW res: [0x2b963:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.689825:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000078f9a278 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997040000:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.689828:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000079a414b7/0x3234de053c4d8ca lrc: 2/0,0 mode: PR/PR res: [0x2b963:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d13e2 expref: 486 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.689831:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.689832:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.689832:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e69b5582/0x3234de053c5234d lrc: 4/0,1 mode: --/PW res: [0x2b963:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.689834:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e5f43e7 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.689839:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000079a414b7/0x3234de053c4d8ca lrc: 3/0,0 mode: PR/PR res: [0x2b963:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d13e2 expref: 486 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.689842:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000079a414b7/0x3234de053c4d8ca lrc: 4/0,0 mode: PR/PR res: [0x2b963:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d13e2 expref: 486 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.689846:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a9e254e pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997040064:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.689855:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 0000000009370c1d going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.689860:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c52323 lrc: 2/0,0 mode: PW/PW res: [0x2b95d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.689863:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2a53ada already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.689864:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c52323 lrc: 2/0,0 mode: PW/PW res: [0x2b95d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.689867:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c52323 lrc: 3/0,0 mode: PW/PW res: [0x2b95d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.689891:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c52323 lrc: 1/0,0 mode: --/PW res: [0x2b95d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.689894:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2a53ada/0x3234de053c52323 lrc: 0/0,0 mode: --/PW res: [0x2b95d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.689899:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8c6a7f2/0x3234de053c5230e lrc: 2/0,0 mode: PW/PW res: [0x2b95a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.689901:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d8c6a7f2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.689902:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8c6a7f2/0x3234de053c5230e lrc: 2/0,0 mode: PW/PW res: [0x2b95a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.689903:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.689905:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8c6a7f2/0x3234de053c5230e lrc: 3/0,0 mode: PW/PW res: [0x2b95a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.689908:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8c6a7f2/0x3234de053c5230e lrc: 1/0,0 mode: --/PW res: [0x2b95a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.689911:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8c6a7f2/0x3234de053c5230e lrc: 0/0,0 mode: --/PW res: [0x2b95a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.689914:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c5232a lrc: 2/0,0 mode: PW/PW res: [0x2b95e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.689917:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000022a594ce already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.689917:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c5232a lrc: 2/0,0 mode: PW/PW res: [0x2b95e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.689920:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c5232a lrc: 3/0,0 mode: PW/PW res: [0x2b95e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.689924:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c5232a lrc: 1/0,0 mode: --/PW res: [0x2b95e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.689926:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022a594ce/0x3234de053c5232a lrc: 0/0,0 mode: --/PW res: [0x2b95e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.689930:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.689935:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946520448 00000100:00100000:1.0:1651529344.689938:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.689947:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946520512 00000100:00100000:1.0:1651529344.689950:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.689964:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212084 00000100:00100000:1.0:1651529344.689971:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.689972:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1579:39030:x1731745946520448:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.689976:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178532 count 1 00000100:00100000:1.0:1651529344.689980:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000088fa78f8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997039808:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.689980:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c52354 lrc: 3/0,1 mode: --/PW res: [0x2b964:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.689985:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000437ad37b/0x3234de053c52331 lrc: 3/0,1 mode: --/PW res: [0x2b960:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.689991:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005cc6463a pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997039872:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.689994:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005206389b/0x3234de053c52338 lrc: 3/0,1 mode: --/PW res: [0x2b95f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.690000:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212085 00000100:00100000:1.0:1651529344.690002:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1579:39029:x1731745946520512:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.690010:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003ae95e9b/0x3234de053c4d042 lrc: 2/0,0 mode: PR/PR res: [0x2b964:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf25c expref: 486 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.690013:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.690014:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.690015:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c52354 lrc: 4/0,1 mode: --/PW res: [0x2b964:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.690019:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178533 count 1 00010000:00010000:0.0:1651529344.690022:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003ae95e9b/0x3234de053c4d042 lrc: 3/0,0 mode: PR/PR res: [0x2b964:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf25c expref: 486 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.690024:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5280238/0x3234de053c5235b lrc: 3/0,1 mode: --/PW res: [0x2b965:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.690028:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003ae95e9b/0x3234de053c4d042 lrc: 4/0,0 mode: PR/PR res: [0x2b964:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf25c expref: 486 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.690030:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000035328d21/0x3234de053c4cd9b lrc: 2/0,0 mode: PR/PR res: [0x2b965:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce83e expref: 486 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.690032:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d718cfe4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997040128:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.690034:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.690034:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.690035:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5280238/0x3234de053c5235b lrc: 4/0,1 mode: --/PW res: [0x2b965:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.690041:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000035328d21/0x3234de053c4cd9b lrc: 3/0,0 mode: PR/PR res: [0x2b965:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce83e expref: 486 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.690045:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000035328d21/0x3234de053c4cd9b lrc: 4/0,0 mode: PR/PR res: [0x2b965:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce83e expref: 486 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.690049:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029abc941 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997040192:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.690053:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c0dff858 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.690057:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d09f5ee1 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.690063:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006e3eb319 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997039936:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.690065:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396401280 00010000:00010000:0.0:1651529344.690067:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000933c22d6/0x3234de053c5233f lrc: 3/0,1 mode: --/PW res: [0x2b961:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.690069:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000010b94550/0x3234de053c4f5db lrc: 4/0,0 mode: PR/PR res: [0x2b960:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89ca expref: 487 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.690075:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396401344 00010000:00010000:1.0:1651529344.690077:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d2f0294b/0x3234de053c4ce90 lrc: 4/0,0 mode: PR/PR res: [0x2b95f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec58 expref: 488 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.690081:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396401408 00000100:00100000:0.0:1651529344.690082:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.690083:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c4cc0c lrc: 4/0,0 mode: PR/PR res: [0x2b961:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce217 expref: 489 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.690090:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12861 00000100:00100000:1.0:1651529344.690092:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+489:41278:x1731746396401280:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.690094:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.690096:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000010b94550/0x3234de053c4f5db lrc: 4/0,0 mode: PR/PR res: [0x2b960:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89ca expref: 489 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.690107:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000010b94550/0x3234de053c4f5db lrc: 3/0,0 mode: PR/PR res: [0x2b960:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89ca expref: 489 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.690113:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010b94550/0x3234de053c4f5db lrc: 0/0,0 mode: --/PR res: [0x2b960:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89ca expref: 489 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.690116:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.690117:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.690118:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000437ad37b/0x3234de053c52331 lrc: 3/0,1 mode: PW/PW res: [0x2b960:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.690121:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000437ad37b/0x3234de053c52331 lrc: 4/0,1 mode: PW/PW res: [0x2b960:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.690133:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.690145:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.690146:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+488:41278:x1731746396401280:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 53us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.690149:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12861 00000100:00100000:1.0:1651529344.690154:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396401472 00010000:00010000:1.0:1651529344.690157:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000090b66157/0x3234de053c4f47d lrc: 5/0,0 mode: PR/PR res: [0x2b962:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84a6 expref: 488 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.690164:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.690169:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396401536 00010000:00010000:1.0:1651529344.690172:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000079a414b7/0x3234de053c4d8ca lrc: 4/0,0 mode: PR/PR res: [0x2b963:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d13e2 expref: 489 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.690173:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a9e254e pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997040064:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.690176:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e69b5582/0x3234de053c5234d lrc: 3/0,1 mode: --/PW res: [0x2b963:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.690177:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12862 00000100:00100000:1.0:1651529344.690178:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d036941 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+489:41278:x1731746396401344:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.690180:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.690182:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d2f0294b/0x3234de053c4ce90 lrc: 4/0,0 mode: PR/PR res: [0x2b95f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec58 expref: 489 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.690183:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946520576 00010000:00010000:1.0:1651529344.690185:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d2f0294b/0x3234de053c4ce90 lrc: 3/0,0 mode: PR/PR res: [0x2b95f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec58 expref: 489 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.690194:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212086 00010000:00010000:1.0:1651529344.690196:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2f0294b/0x3234de053c4ce90 lrc: 0/0,0 mode: --/PR res: [0x2b95f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec58 expref: 489 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.690199:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.690200:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.690201:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005206389b/0x3234de053c52338 lrc: 3/0,1 mode: PW/PW res: [0x2b95f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.690204:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005206389b/0x3234de053c52338 lrc: 4/0,1 mode: PW/PW res: [0x2b95f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.690210:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.690210:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000020b2ad76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1580:39030:x1731745946520576:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.690215:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178534 count 1 00000100:00100000:1.0:1651529344.690220:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d036941 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+488:41278:x1731746396401344:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 41us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.690237:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12862 00000100:00100000:1.0:1651529344.690245:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12863 00000100:00100000:1.0:1651529344.690247:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+487:41279:x1731746396401408:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.690250:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.690251:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c4cc0c lrc: 4/0,0 mode: PR/PR res: [0x2b961:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce217 expref: 487 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.690255:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c4cc0c lrc: 3/0,0 mode: PR/PR res: [0x2b961:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce217 expref: 487 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.690260:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c4cc0c lrc: 0/0,0 mode: --/PR res: [0x2b961:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce217 expref: 487 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.690263:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.690263:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6711731/0x3234de053c52362 lrc: 3/0,1 mode: --/PW res: [0x2b966:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.690264:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.690265:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000933c22d6/0x3234de053c5233f lrc: 3/0,1 mode: PW/PW res: [0x2b961:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.690268:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000933c22d6/0x3234de053c5233f lrc: 4/0,1 mode: PW/PW res: [0x2b961:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.690268:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001c3e5e9f/0x3234de053c4b974 lrc: 2/0,0 mode: PR/PR res: [0x2b966:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc46c expref: 486 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.690271:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.690272:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.690273:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6711731/0x3234de053c52362 lrc: 4/0,1 mode: --/PW res: [0x2b966:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.690276:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.690282:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+486:41279:x1731746396401408:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 34us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.690284:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12863 00010000:00010000:0.0:1651529344.690286:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001c3e5e9f/0x3234de053c4b974 lrc: 3/0,0 mode: PR/PR res: [0x2b966:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc46c expref: 486 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.690288:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12864 00010000:00010000:0.0:1651529344.690289:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001c3e5e9f/0x3234de053c4b974 lrc: 4/0,0 mode: PR/PR res: [0x2b966:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc46c expref: 485 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.690290:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+485:41278:x1731746396401472:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.690292:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.690293:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000090b66157/0x3234de053c4f47d lrc: 5/0,0 mode: PR/PR res: [0x2b962:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84a6 expref: 485 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.690294:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005912c4a3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997040256:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.690297:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000090b66157/0x3234de053c4f47d lrc: 4/0,0 mode: PR/PR res: [0x2b962:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84a6 expref: 485 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.690302:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.690302:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.690302:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 000000003c8b0daf going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.690303:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000099a3e2d9/0x3234de053c52346 lrc: 3/0,1 mode: PW/PW res: [0x2b962:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.690306:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099a3e2d9/0x3234de053c52346 lrc: 4/0,1 mode: PW/PW res: [0x2b962:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.690307:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000933c22d6/0x3234de053c5233f lrc: 3/0,1 mode: PW/PW res: [0x2b961:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.690310:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.690310:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000933c22d6/0x3234de053c5233f lrc: 3/0,1 mode: PW/PW res: [0x2b961:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.690313:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000933c22d6/0x3234de053c5233f lrc: 3/0,1 mode: PW/PW res: [0x2b961:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.690314:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+485:41278:x1731746396401472:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 24us (170us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.690316:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000933c22d6/0x3234de053c5233f lrc: 2/0,0 mode: PW/PW res: [0x2b961:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.690317:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12864 00000100:00100000:1.0:1651529344.690320:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12865 00000100:00100000:1.0:1651529344.690322:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+484:41278:x1731746396401536:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.690324:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.690325:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000079a414b7/0x3234de053c4d8ca lrc: 4/0,0 mode: PR/PR res: [0x2b963:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d13e2 expref: 484 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.690331:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000079a414b7/0x3234de053c4d8ca lrc: 3/0,0 mode: PR/PR res: [0x2b963:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d13e2 expref: 484 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.690335:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079a414b7/0x3234de053c4d8ca lrc: 0/0,0 mode: --/PR res: [0x2b963:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d13e2 expref: 484 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.690338:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.690338:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.690339:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e69b5582/0x3234de053c5234d lrc: 3/0,1 mode: PW/PW res: [0x2b963:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.690342:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e69b5582/0x3234de053c5234d lrc: 4/0,1 mode: PW/PW res: [0x2b963:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.690350:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.690363:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+483:41278:x1731746396401536:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.690365:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12865 00010000:00010000:1.0:1651529344.690376:0:80278:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090b66157/0x3234de053c4f47d lrc: 0/0,0 mode: --/PR res: [0x2b962:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84a6 expref: 482 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.690380:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000078f9a278 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997040000:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.690383:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000099a3e2d9/0x3234de053c52346 lrc: 3/0,1 mode: PW/PW res: [0x2b962:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.690383:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1581:39030:x1731745946520256:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 732us (860us total) trans 12885080134 rc 0/0 00010000:00010000:1.0:1651529344.690386:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000099a3e2d9/0x3234de053c52346 lrc: 3/0,1 mode: PW/PW res: [0x2b962:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.690387:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212081 00010000:00010000:1.0:1651529344.690389:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099a3e2d9/0x3234de053c52346 lrc: 3/0,1 mode: PW/PW res: [0x2b962:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.690393:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099a3e2d9/0x3234de053c52346 lrc: 3/0,1 mode: PW/PW res: [0x2b962:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.690394:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000933c22d6/0x3234de053c5233f lrc: 2/0,0 mode: PW/PW res: [0x2b961:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.690395:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099a3e2d9/0x3234de053c52346 lrc: 2/0,0 mode: PW/PW res: [0x2b962:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.690397:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000933c22d6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.690399:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000933c22d6/0x3234de053c5233f lrc: 2/0,0 mode: PW/PW res: [0x2b961:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.690402:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000933c22d6/0x3234de053c5233f lrc: 3/0,0 mode: PW/PW res: [0x2b961:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.690419:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000933c22d6/0x3234de053c5233f lrc: 1/0,0 mode: --/PW res: [0x2b961:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.690422:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000933c22d6/0x3234de053c5233f lrc: 0/0,0 mode: --/PW res: [0x2b961:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.690426:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099a3e2d9/0x3234de053c52346 lrc: 2/0,0 mode: PW/PW res: [0x2b962:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.690429:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000099a3e2d9 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.690430:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099a3e2d9/0x3234de053c52346 lrc: 2/0,0 mode: PW/PW res: [0x2b962:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.690432:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099a3e2d9/0x3234de053c52346 lrc: 3/0,0 mode: PW/PW res: [0x2b962:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.690438:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099a3e2d9/0x3234de053c52346 lrc: 1/0,0 mode: --/PW res: [0x2b962:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.690439:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1581:39030:x1731745946520320:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 655us (732us total) trans 12885080135 rc 0/0 00010000:00010000:0.0:1651529344.690440:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099a3e2d9/0x3234de053c52346 lrc: 0/0,0 mode: --/PW res: [0x2b962:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.690442:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212082 00010000:00010000:0.0:1651529344.690446:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e69b5582/0x3234de053c5234d lrc: 3/0,1 mode: PW/PW res: [0x2b963:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.690449:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e69b5582/0x3234de053c5234d lrc: 3/0,1 mode: PW/PW res: [0x2b963:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.690450:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005206389b/0x3234de053c52338 lrc: 3/0,1 mode: PW/PW res: [0x2b95f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.690452:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e69b5582/0x3234de053c5234d lrc: 3/0,1 mode: PW/PW res: [0x2b963:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.690454:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005206389b/0x3234de053c52338 lrc: 3/0,1 mode: PW/PW res: [0x2b95f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.690455:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e69b5582/0x3234de053c5234d lrc: 2/0,0 mode: PW/PW res: [0x2b963:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.690457:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005206389b/0x3234de053c52338 lrc: 3/0,1 mode: PW/PW res: [0x2b95f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.690459:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005206389b/0x3234de053c52338 lrc: 2/0,0 mode: PW/PW res: [0x2b95f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.690497:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1582:39029:x1731745946520384:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 681us (776us total) trans 12885080136 rc 0/0 00000100:00100000:1.0:1651529344.690498:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1582:39029:x1731745946520128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1035us (1177us total) trans 12885080137 rc 0/0 00000100:00100000:0.0:1651529344.690499:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212083 00000100:00100000:1.0:1651529344.690502:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212080 00010000:00010000:0.0:1651529344.690506:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e69b5582/0x3234de053c5234d lrc: 2/0,0 mode: PW/PW res: [0x2b963:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.690509:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000437ad37b/0x3234de053c52331 lrc: 3/0,1 mode: PW/PW res: [0x2b960:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.690510:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e69b5582 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.690511:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e69b5582/0x3234de053c5234d lrc: 2/0,0 mode: PW/PW res: [0x2b963:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.690512:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000437ad37b/0x3234de053c52331 lrc: 3/0,1 mode: PW/PW res: [0x2b960:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.690514:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e69b5582/0x3234de053c5234d lrc: 3/0,0 mode: PW/PW res: [0x2b963:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.690515:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000437ad37b/0x3234de053c52331 lrc: 3/0,1 mode: PW/PW res: [0x2b960:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.690518:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000437ad37b/0x3234de053c52331 lrc: 2/0,0 mode: PW/PW res: [0x2b960:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.690518:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e69b5582/0x3234de053c5234d lrc: 1/0,0 mode: --/PW res: [0x2b963:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.690521:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e69b5582/0x3234de053c5234d lrc: 0/0,0 mode: --/PW res: [0x2b963:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.690532:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005206389b/0x3234de053c52338 lrc: 2/0,0 mode: PW/PW res: [0x2b95f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.690535:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005206389b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.690536:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005206389b/0x3234de053c52338 lrc: 2/0,0 mode: PW/PW res: [0x2b95f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.690538:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005206389b/0x3234de053c52338 lrc: 3/0,0 mode: PW/PW res: [0x2b95f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.690541:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005206389b/0x3234de053c52338 lrc: 1/0,0 mode: --/PW res: [0x2b95f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.690544:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005206389b/0x3234de053c52338 lrc: 0/0,0 mode: --/PW res: [0x2b95f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.690548:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000437ad37b/0x3234de053c52331 lrc: 2/0,0 mode: PW/PW res: [0x2b960:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.690551:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000437ad37b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.690551:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000437ad37b/0x3234de053c52331 lrc: 2/0,0 mode: PW/PW res: [0x2b960:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.690554:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1581:39030:x1731745946520192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1138us (1269us total) trans 12885080138 rc 0/0 00010000:00010000:0.0:1651529344.690554:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000437ad37b/0x3234de053c52331 lrc: 3/0,0 mode: PW/PW res: [0x2b960:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.690556:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212079 00010000:00010000:0.0:1651529344.690557:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000437ad37b/0x3234de053c52331 lrc: 1/0,0 mode: --/PW res: [0x2b960:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.690559:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000437ad37b/0x3234de053c52331 lrc: 0/0,0 mode: --/PW res: [0x2b960:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.690616:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.690628:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.690658:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d718cfe4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997040128:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.690662:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c52354 lrc: 3/0,1 mode: --/PW res: [0x2b964:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.690676:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396401600 00010000:00010000:0.0:1651529344.690681:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003ae95e9b/0x3234de053c4d042 lrc: 4/0,0 mode: PR/PR res: [0x2b964:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf25c expref: 482 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.690703:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029abc941 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997040192:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.690705:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396401664 00010000:00010000:1.0:1651529344.690707:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e5280238/0x3234de053c5235b lrc: 3/0,1 mode: --/PW res: [0x2b965:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.690709:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000035328d21/0x3234de053c4cd9b lrc: 4/0,0 mode: PR/PR res: [0x2b965:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce83e expref: 483 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.690715:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12866 00000100:00100000:1.0:1651529344.690717:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+483:41279:x1731746396401600:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.690718:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12867 00000100:00100000:0.0:1651529344.690720:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+483:41279:x1731746396401664:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.690721:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.690722:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003ae95e9b/0x3234de053c4d042 lrc: 4/0,0 mode: PR/PR res: [0x2b964:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf25c expref: 483 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.690723:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.690725:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000035328d21/0x3234de053c4cd9b lrc: 4/0,0 mode: PR/PR res: [0x2b965:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce83e expref: 483 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.690726:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003ae95e9b/0x3234de053c4d042 lrc: 3/0,0 mode: PR/PR res: [0x2b964:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf25c expref: 483 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.690728:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000035328d21/0x3234de053c4cd9b lrc: 3/0,0 mode: PR/PR res: [0x2b965:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce83e expref: 483 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.690732:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ae95e9b/0x3234de053c4d042 lrc: 0/0,0 mode: --/PR res: [0x2b964:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf25c expref: 483 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.690746:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.690746:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.690747:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c52354 lrc: 3/0,1 mode: PW/PW res: [0x2b964:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.690750:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c52354 lrc: 4/0,1 mode: PW/PW res: [0x2b964:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.690756:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035328d21/0x3234de053c4cd9b lrc: 0/0,0 mode: --/PR res: [0x2b965:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce83e expref: 482 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.690759:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.690766:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.690767:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.690768:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+481:41279:x1731746396401600:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 51us (153us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.690768:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e5280238/0x3234de053c5235b lrc: 3/0,1 mode: PW/PW res: [0x2b965:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.690771:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12866 00010000:00010000:0.0:1651529344.690771:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5280238/0x3234de053c5235b lrc: 4/0,1 mode: PW/PW res: [0x2b965:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.690780:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.690788:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+480:41279:x1731746396401664:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 67us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.690791:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12867 00010000:00010000:1.0:1651529344.690808:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e5280238/0x3234de053c5235b lrc: 3/0,1 mode: PW/PW res: [0x2b965:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.690824:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5280238/0x3234de053c5235b lrc: 3/0,1 mode: PW/PW res: [0x2b965:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.690824:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c52354 lrc: 3/0,1 mode: PW/PW res: [0x2b964:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.690827:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5280238/0x3234de053c5235b lrc: 3/0,1 mode: PW/PW res: [0x2b965:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.690828:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c52354 lrc: 3/0,1 mode: PW/PW res: [0x2b964:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.690833:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5280238/0x3234de053c5235b lrc: 2/0,0 mode: PW/PW res: [0x2b965:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.690846:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c52354 lrc: 3/0,1 mode: PW/PW res: [0x2b964:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.690849:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c52354 lrc: 2/0,0 mode: PW/PW res: [0x2b964:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.690875:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1582:39029:x1731745946520512:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 873us (937us total) trans 12885080139 rc 0/0 00000100:00100000:1.0:1651529344.690878:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212085 00000100:00100000:1.0:1651529344.690909:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.690913:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1581:39030:x1731745946520448:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 941us (1011us total) trans 12885080140 rc 0/0 00000100:00100000:0.0:1651529344.690916:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212084 00000100:00100000:1.0:1651529344.690922:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.690922:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946520640 00000100:00100000:0.0:1651529344.690932:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946520704 00000100:00100000:0.0:1651529344.690937:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212087 00000100:00100000:0.0:1651529344.690939:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1582:39029:x1731745946520640:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.690944:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178535 count 1 00010000:00010000:0.0:1651529344.690948:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000053520ee/0x3234de053c52369 lrc: 3/0,1 mode: --/PW res: [0x2b967:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.690952:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000182773b4/0x3234de053c4e940 lrc: 2/0,0 mode: PR/PR res: [0x2b967:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5607 expref: 479 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.690954:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.690956:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.690956:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.690957:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000053520ee/0x3234de053c52369 lrc: 4/0,1 mode: --/PW res: [0x2b967:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.690962:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.690964:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000182773b4/0x3234de053c4e940 lrc: 3/0,0 mode: PR/PR res: [0x2b967:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5607 expref: 479 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.690968:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000182773b4/0x3234de053c4e940 lrc: 4/0,0 mode: PR/PR res: [0x2b967:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5607 expref: 479 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.690969:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.690972:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d718cfe4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997040320:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.690979:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946520768 00000100:00100000:1.0:1651529344.690986:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946520832 00000100:00100000:1.0:1651529344.690989:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946520896 00000100:00100000:0.0:1651529344.690991:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000abca413e going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.690997:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5280238/0x3234de053c5235b lrc: 2/0,0 mode: PW/PW res: [0x2b965:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.691001:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212088 00000100:00100000:1.0:1651529344.691003:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1585:39030:x1731745946520704:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.691004:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e5280238 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.691006:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5280238/0x3234de053c5235b lrc: 2/0,0 mode: PW/PW res: [0x2b965:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.691008:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178536 count 1 00010000:00010000:0.0:1651529344.691009:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5280238/0x3234de053c5235b lrc: 3/0,0 mode: PW/PW res: [0x2b965:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.691012:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba3ddc6f/0x3234de053c52370 lrc: 3/0,1 mode: --/PW res: [0x2b968:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.691013:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5280238/0x3234de053c5235b lrc: 1/0,0 mode: --/PW res: [0x2b965:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.691016:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5280238/0x3234de053c5235b lrc: 0/0,0 mode: --/PW res: [0x2b965:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.691017:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000edb77ee5/0x3234de053c4c250 lrc: 2/0,0 mode: PR/PR res: [0x2b968:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc88d expref: 479 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.691020:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.691020:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c52354 lrc: 2/0,0 mode: PW/PW res: [0x2b964:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.691021:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.691021:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba3ddc6f/0x3234de053c52370 lrc: 4/0,1 mode: --/PW res: [0x2b968:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.691025:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d065f972 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.691026:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c52354 lrc: 2/0,0 mode: PW/PW res: [0x2b964:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.691029:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c52354 lrc: 3/0,0 mode: PW/PW res: [0x2b964:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.691030:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000edb77ee5/0x3234de053c4c250 lrc: 3/0,0 mode: PR/PR res: [0x2b968:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc88d expref: 479 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.691032:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c52354 lrc: 1/0,0 mode: --/PW res: [0x2b964:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.691034:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000edb77ee5/0x3234de053c4c250 lrc: 4/0,0 mode: PR/PR res: [0x2b968:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc88d expref: 479 pid: 151609 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.691034:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d065f972/0x3234de053c52354 lrc: 0/0,0 mode: --/PW res: [0x2b964:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.691038:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005cc6463a pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997040384:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.691042:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212089 00000100:00100000:0.0:1651529344.691044:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1585:39029:x1731745946520768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.691047:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cfa1ca05 going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.691048:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178537 count 1 00010000:00010000:0.0:1651529344.691051:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083a35be2/0x3234de053c52377 lrc: 3/0,1 mode: --/PW res: [0x2b969:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.691053:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212090 00000100:00100000:1.0:1651529344.691055:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1585:39030:x1731745946520832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.691055:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d33d4a29/0x3234de053c4f396 lrc: 2/0,0 mode: PR/PR res: [0x2b969:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80fc expref: 479 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.691058:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1651529344.691059:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178538 count 1 00010000:00010000:0.0:1651529344.691059:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.691059:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083a35be2/0x3234de053c52377 lrc: 4/0,1 mode: --/PW res: [0x2b969:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.691062:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002056e733/0x3234de053c5237e lrc: 3/0,1 mode: --/PW res: [0x2b96a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.691066:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a74eb226/0x3234de053c4e286 lrc: 2/0,0 mode: PR/PR res: [0x2b96a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b65 expref: 479 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.691068:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d33d4a29/0x3234de053c4f396 lrc: 3/0,0 mode: PR/PR res: [0x2b969:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80fc expref: 479 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.691069:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.691070:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.691070:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002056e733/0x3234de053c5237e lrc: 4/0,1 mode: --/PW res: [0x2b96a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.691076:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a74eb226/0x3234de053c4e286 lrc: 3/0,0 mode: PR/PR res: [0x2b96a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b65 expref: 479 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.691080:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a74eb226/0x3234de053c4e286 lrc: 4/0,0 mode: PR/PR res: [0x2b96a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b65 expref: 479 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.691084:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000088fa78f8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997040512:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.691088:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d33d4a29/0x3234de053c4f396 lrc: 4/0,0 mode: PR/PR res: [0x2b969:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80fc expref: 479 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.691090:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e5f43e7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.691095:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212091 00000100:00100000:1.0:1651529344.691097:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1585:39029:x1731745946520896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.691100:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178539 count 1 00010000:00010000:1.0:1651529344.691103:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba00fdd7/0x3234de053c52385 lrc: 3/0,1 mode: --/PW res: [0x2b96b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.691107:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f7cb3d9d/0x3234de053c4f2f5 lrc: 2/0,0 mode: PR/PR res: [0x2b96b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e8d expref: 479 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.691112:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006aa45e66 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997040448:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.691120:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.691120:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.691121:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba00fdd7/0x3234de053c52385 lrc: 4/0,1 mode: --/PW res: [0x2b96b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.691121:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060852af0 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.691128:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f7cb3d9d/0x3234de053c4f2f5 lrc: 3/0,0 mode: PR/PR res: [0x2b96b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e8d expref: 479 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.691131:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f7cb3d9d/0x3234de053c4f2f5 lrc: 4/0,0 mode: PR/PR res: [0x2b96b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e8d expref: 479 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.691135:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f39ca9ea pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997040576:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.691143:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a6b79b05 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.691148:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.691161:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946520960 00000100:00100000:1.0:1651529344.691168:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212092 00000100:00100000:1.0:1651529344.691170:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1586:39030:x1731745946520960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.691173:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:1.0:1651529344.691174:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178540 count 1 00010000:00010000:1.0:1651529344.691185:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b19bfe47/0x3234de053c5238c lrc: 3/0,1 mode: --/PW res: [0x2b96c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.691185:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.691195:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a643e872/0x3234de053c4ed68 lrc: 2/0,0 mode: PR/PR res: [0x2b96c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d67b8 expref: 479 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.691198:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.691199:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.691199:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b19bfe47/0x3234de053c5238c lrc: 4/0,1 mode: --/PW res: [0x2b96c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.691213:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005912c4a3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997040256:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.691217:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f6711731/0x3234de053c52362 lrc: 3/0,1 mode: --/PW res: [0x2b966:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.691240:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396401728 00010000:00010000:1.0:1651529344.691243:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a643e872/0x3234de053c4ed68 lrc: 3/0,0 mode: PR/PR res: [0x2b96c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d67b8 expref: 479 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.691245:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001c3e5e9f/0x3234de053c4b974 lrc: 4/0,0 mode: PR/PR res: [0x2b966:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc46c expref: 480 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.691247:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a643e872/0x3234de053c4ed68 lrc: 4/0,0 mode: PR/PR res: [0x2b96c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d67b8 expref: 480 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.691255:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12868 00000100:00100000:1.0:1651529344.691256:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029d739c8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997040640:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.691257:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+480:41278:x1731746396401728:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.691259:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.691270:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 0000000089d75f07 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.691278:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946521024 00010000:00010000:0.0:1651529344.691280:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001c3e5e9f/0x3234de053c4b974 lrc: 4/0,0 mode: PR/PR res: [0x2b966:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc46c expref: 480 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.691287:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212093 00000100:00100000:1.0:1651529344.691289:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1587:39029:x1731745946521024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.691292:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001c3e5e9f/0x3234de053c4b974 lrc: 3/0,0 mode: PR/PR res: [0x2b966:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc46c expref: 480 pid: 72396 timeout: 20103 lvb_type: 1 00002000:00080000:1.0:1651529344.691294:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178541 count 1 00010000:00010000:1.0:1651529344.691297:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006325442a/0x3234de053c52393 lrc: 3/0,1 mode: --/PW res: [0x2b96d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.691298:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c3e5e9f/0x3234de053c4b974 lrc: 0/0,0 mode: --/PR res: [0x2b966:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc46c expref: 480 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.691302:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005ea7bfa7/0x3234de053c4e7fe lrc: 2/0,0 mode: PR/PR res: [0x2b96d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d50ab expref: 479 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.691302:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.691302:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.691303:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f6711731/0x3234de053c52362 lrc: 3/0,1 mode: PW/PW res: [0x2b966:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.691305:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.691306:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.691306:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006325442a/0x3234de053c52393 lrc: 4/0,1 mode: --/PW res: [0x2b96d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.691306:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6711731/0x3234de053c52362 lrc: 4/0,1 mode: PW/PW res: [0x2b966:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.691312:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005ea7bfa7/0x3234de053c4e7fe lrc: 3/0,0 mode: PR/PR res: [0x2b96d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d50ab expref: 479 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.691313:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.691316:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005ea7bfa7/0x3234de053c4e7fe lrc: 4/0,0 mode: PR/PR res: [0x2b96d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d50ab expref: 479 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.691320:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005b3c5aba pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997040704:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.691320:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+479:41278:x1731746396401728:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 63us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.691323:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12868 00000100:00100000:1.0:1651529344.691327:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 0000000018ebe812 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.691330:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f6711731/0x3234de053c52362 lrc: 3/0,1 mode: PW/PW res: [0x2b966:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.691333:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6711731/0x3234de053c52362 lrc: 3/0,1 mode: PW/PW res: [0x2b966:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.691336:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6711731/0x3234de053c52362 lrc: 3/0,1 mode: PW/PW res: [0x2b966:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.691342:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6711731/0x3234de053c52362 lrc: 2/0,0 mode: PW/PW res: [0x2b966:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.691385:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000020b2ad76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1588:39030:x1731745946520576:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1174us (1302us total) trans 12885080141 rc 0/0 00000100:00100000:0.0:1651529344.691388:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212086 00010000:00010000:0.0:1651529344.691408:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6711731/0x3234de053c52362 lrc: 2/0,0 mode: PW/PW res: [0x2b966:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.691412:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f6711731 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.691413:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6711731/0x3234de053c52362 lrc: 2/0,0 mode: PW/PW res: [0x2b966:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.691416:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6711731/0x3234de053c52362 lrc: 3/0,0 mode: PW/PW res: [0x2b966:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.691420:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6711731/0x3234de053c52362 lrc: 1/0,0 mode: --/PW res: [0x2b966:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.691423:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6711731/0x3234de053c52362 lrc: 0/0,0 mode: --/PW res: [0x2b966:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.691536:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.691596:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005cc6463a pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997040384:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.691605:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ba3ddc6f/0x3234de053c52370 lrc: 3/0,1 mode: --/PW res: [0x2b968:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.691606:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.691615:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.691619:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000088fa78f8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997040512:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.691622:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002056e733/0x3234de053c5237e lrc: 3/0,1 mode: --/PW res: [0x2b96a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.691622:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.691631:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.691639:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f39ca9ea pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997040576:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.691642:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ba00fdd7/0x3234de053c52385 lrc: 3/0,1 mode: --/PW res: [0x2b96b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.691642:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006aa45e66 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997040448:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.691647:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000083a35be2/0x3234de053c52377 lrc: 3/0,1 mode: --/PW res: [0x2b969:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.691649:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396401792 00010000:00010000:1.0:1651529344.691654:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000182773b4/0x3234de053c4e940 lrc: 4/0,0 mode: PR/PR res: [0x2b967:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5607 expref: 479 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.691659:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396401856 00010000:00010000:1.0:1651529344.691661:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a74eb226/0x3234de053c4e286 lrc: 4/0,0 mode: PR/PR res: [0x2b96a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b65 expref: 480 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.691665:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396401920 00010000:00010000:1.0:1651529344.691667:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000edb77ee5/0x3234de053c4c250 lrc: 4/0,0 mode: PR/PR res: [0x2b968:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc88d expref: 481 pid: 151609 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.691671:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396401984 00010000:00010000:1.0:1651529344.691673:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d33d4a29/0x3234de053c4f396 lrc: 4/0,0 mode: PR/PR res: [0x2b969:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80fc expref: 482 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.691683:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d718cfe4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997040320:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.691686:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000053520ee/0x3234de053c52369 lrc: 3/0,1 mode: --/PW res: [0x2b967:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.691690:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12869 00000100:00100000:1.0:1651529344.691691:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000091b9484 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+482:41279:x1731746396401792:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.691694:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.691695:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000182773b4/0x3234de053c4e940 lrc: 4/0,0 mode: PR/PR res: [0x2b967:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5607 expref: 482 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.691695:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946521088 00000100:00100000:0.0:1651529344.691706:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212094 00010000:00010000:1.0:1651529344.691707:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000182773b4/0x3234de053c4e940 lrc: 3/0,0 mode: PR/PR res: [0x2b967:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5607 expref: 482 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.691708:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1588:39030:x1731745946521088:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.691713:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000182773b4/0x3234de053c4e940 lrc: 0/0,0 mode: --/PR res: [0x2b967:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5607 expref: 482 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:0.0:1651529344.691713:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178542 count 1 00010000:00010000:0.0:1651529344.691716:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e3070d2/0x3234de053c5239a lrc: 3/0,1 mode: --/PW res: [0x2b96e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.691717:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.691717:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.691718:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000053520ee/0x3234de053c52369 lrc: 3/0,1 mode: PW/PW res: [0x2b967:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.691721:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000053520ee/0x3234de053c52369 lrc: 4/0,1 mode: PW/PW res: [0x2b967:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.691721:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ed943f93/0x3234de053c4cd94 lrc: 2/0,0 mode: PR/PR res: [0x2b96e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce822 expref: 481 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.691724:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.691724:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.691725:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e3070d2/0x3234de053c5239a lrc: 4/0,1 mode: --/PW res: [0x2b96e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.691730:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.691749:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000091b9484 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+481:41279:x1731746396401792:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 57us (143us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.691751:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ed943f93/0x3234de053c4cd94 lrc: 3/0,0 mode: PR/PR res: [0x2b96e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce822 expref: 481 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.691752:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12869 00010000:00010000:0.0:1651529344.691755:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ed943f93/0x3234de053c4cd94 lrc: 4/0,0 mode: PR/PR res: [0x2b96e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce822 expref: 480 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.691759:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006aa45e66 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997040768:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.691761:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12870 00000100:00100000:1.0:1651529344.691763:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+480:41278:x1731746396401856:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.691766:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.691768:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a74eb226/0x3234de053c4e286 lrc: 4/0,0 mode: PR/PR res: [0x2b96a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b65 expref: 480 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.691769:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060852af0 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.691771:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a74eb226/0x3234de053c4e286 lrc: 3/0,0 mode: PR/PR res: [0x2b96a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b65 expref: 480 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.691773:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000053520ee/0x3234de053c52369 lrc: 3/0,1 mode: PW/PW res: [0x2b967:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.691776:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a74eb226/0x3234de053c4e286 lrc: 0/0,0 mode: --/PR res: [0x2b96a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b65 expref: 480 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.691776:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000053520ee/0x3234de053c52369 lrc: 3/0,1 mode: PW/PW res: [0x2b967:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.691779:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000053520ee/0x3234de053c52369 lrc: 3/0,1 mode: PW/PW res: [0x2b967:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.691780:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.691780:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.691781:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002056e733/0x3234de053c5237e lrc: 3/0,1 mode: PW/PW res: [0x2b96a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.691782:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000053520ee/0x3234de053c52369 lrc: 2/0,0 mode: PW/PW res: [0x2b967:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.691784:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002056e733/0x3234de053c5237e lrc: 4/0,1 mode: PW/PW res: [0x2b96a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.691791:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.691796:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+479:41278:x1731746396401856:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 32us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.691798:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12870 00000100:00100000:1.0:1651529344.691802:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12871 00000100:00100000:1.0:1651529344.691804:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+478:41279:x1731746396401920:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.691806:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.691807:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000edb77ee5/0x3234de053c4c250 lrc: 4/0,0 mode: PR/PR res: [0x2b968:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc88d expref: 478 pid: 151609 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.691810:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000edb77ee5/0x3234de053c4c250 lrc: 3/0,0 mode: PR/PR res: [0x2b968:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc88d expref: 478 pid: 151609 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.691815:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000edb77ee5/0x3234de053c4c250 lrc: 0/0,0 mode: --/PR res: [0x2b968:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc88d expref: 478 pid: 151609 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.691820:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.691820:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1589:39029:x1731745946520640:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 880us (911us total) trans 12885080142 rc 0/0 00010000:00010000:1.0:1651529344.691821:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.691821:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba3ddc6f/0x3234de053c52370 lrc: 3/0,1 mode: PW/PW res: [0x2b968:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.691823:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212087 00010000:00010000:1.0:1651529344.691824:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba3ddc6f/0x3234de053c52370 lrc: 4/0,1 mode: PW/PW res: [0x2b968:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.691829:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.691830:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000053520ee/0x3234de053c52369 lrc: 2/0,0 mode: PW/PW res: [0x2b967:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.691833:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000053520ee already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.691834:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000053520ee/0x3234de053c52369 lrc: 2/0,0 mode: PW/PW res: [0x2b967:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.691835:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+477:41279:x1731746396401920:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 30us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.691837:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12871 00010000:00010000:0.0:1651529344.691837:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000053520ee/0x3234de053c52369 lrc: 3/0,0 mode: PW/PW res: [0x2b967:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.691840:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12872 00000100:00100000:1.0:1651529344.691842:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+476:41278:x1731746396401984:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.691842:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000053520ee/0x3234de053c52369 lrc: 1/0,0 mode: --/PW res: [0x2b967:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.691844:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.691845:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d33d4a29/0x3234de053c4f396 lrc: 4/0,0 mode: PR/PR res: [0x2b969:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80fc expref: 476 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.691845:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000053520ee/0x3234de053c52369 lrc: 0/0,0 mode: --/PW res: [0x2b967:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.691848:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d33d4a29/0x3234de053c4f396 lrc: 3/0,0 mode: PR/PR res: [0x2b969:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80fc expref: 476 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.691852:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d33d4a29/0x3234de053c4f396 lrc: 0/0,0 mode: --/PR res: [0x2b969:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80fc expref: 476 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.691856:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.691857:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.691857:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000083a35be2/0x3234de053c52377 lrc: 3/0,1 mode: PW/PW res: [0x2b969:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.691859:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.691860:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083a35be2/0x3234de053c52377 lrc: 4/0,1 mode: PW/PW res: [0x2b969:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.691868:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.691874:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+475:41278:x1731746396401984:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 31us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.691876:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12872 00000100:00100000:1.0:1651529344.691879:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396402048 00010000:00010000:1.0:1651529344.691889:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f7cb3d9d/0x3234de053c4f2f5 lrc: 4/0,0 mode: PR/PR res: [0x2b96b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e8d expref: 475 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.691895:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12873 00000100:00100000:1.0:1651529344.691896:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+475:41279:x1731746396402048:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.691898:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.691900:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f7cb3d9d/0x3234de053c4f2f5 lrc: 4/0,0 mode: PR/PR res: [0x2b96b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e8d expref: 475 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.691914:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.691919:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f7cb3d9d/0x3234de053c4f2f5 lrc: 3/0,0 mode: PR/PR res: [0x2b96b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e8d expref: 475 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.691922:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.691924:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7cb3d9d/0x3234de053c4f2f5 lrc: 0/0,0 mode: --/PR res: [0x2b96b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e8d expref: 475 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.691927:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.691928:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.691929:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba00fdd7/0x3234de053c52385 lrc: 3/0,1 mode: PW/PW res: [0x2b96b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.691932:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba00fdd7/0x3234de053c52385 lrc: 4/0,1 mode: PW/PW res: [0x2b96b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.691937:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.691941:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000083a35be2/0x3234de053c52377 lrc: 3/0,1 mode: PW/PW res: [0x2b969:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.691945:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083a35be2/0x3234de053c52377 lrc: 3/0,1 mode: PW/PW res: [0x2b969:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.691948:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083a35be2/0x3234de053c52377 lrc: 3/0,1 mode: PW/PW res: [0x2b969:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.691951:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083a35be2/0x3234de053c52377 lrc: 2/0,0 mode: PW/PW res: [0x2b969:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.691971:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+474:41279:x1731746396402048:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 74us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.691974:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12873 00000100:00100000:1.0:1651529344.691979:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396402112 00010000:00010000:1.0:1651529344.691982:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a643e872/0x3234de053c4ed68 lrc: 5/0,0 mode: PR/PR res: [0x2b96c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d67b8 expref: 474 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.691987:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396402176 00010000:00010000:1.0:1651529344.691989:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005ea7bfa7/0x3234de053c4e7fe lrc: 5/0,0 mode: PR/PR res: [0x2b96d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d50ab expref: 475 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.691994:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12874 00000100:00100000:1.0:1651529344.691995:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+475:41278:x1731746396402112:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.691998:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.691999:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a643e872/0x3234de053c4ed68 lrc: 5/0,0 mode: PR/PR res: [0x2b96c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d67b8 expref: 475 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.692002:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a643e872/0x3234de053c4ed68 lrc: 4/0,0 mode: PR/PR res: [0x2b96c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d67b8 expref: 475 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.692010:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.692010:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.692011:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b19bfe47/0x3234de053c5238c lrc: 3/0,1 mode: PW/PW res: [0x2b96c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.692011:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1589:39029:x1731745946520768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 966us (1057us total) trans 12885080143 rc 0/0 00010000:00010000:1.0:1651529344.692014:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b19bfe47/0x3234de053c5238c lrc: 4/0,1 mode: PW/PW res: [0x2b96c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.692014:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212089 00010000:00010000:1.0:1651529344.692018:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.692022:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083a35be2/0x3234de053c52377 lrc: 2/0,0 mode: PW/PW res: [0x2b969:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.692024:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+475:41278:x1731746396402112:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 28us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.692026:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12874 00000100:00100000:1.0:1651529344.692030:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12875 00000100:00100000:1.0:1651529344.692031:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+474:41278:x1731746396402176:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.692033:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.692034:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005ea7bfa7/0x3234de053c4e7fe lrc: 5/0,0 mode: PR/PR res: [0x2b96d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d50ab expref: 474 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.692038:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005ea7bfa7/0x3234de053c4e7fe lrc: 4/0,0 mode: PR/PR res: [0x2b96d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d50ab expref: 474 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.692040:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000083a35be2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.692041:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083a35be2/0x3234de053c52377 lrc: 2/0,0 mode: PW/PW res: [0x2b969:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.692042:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.692042:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.692043:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006325442a/0x3234de053c52393 lrc: 3/0,1 mode: PW/PW res: [0x2b96d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.692044:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083a35be2/0x3234de053c52377 lrc: 3/0,0 mode: PW/PW res: [0x2b969:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.692046:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006325442a/0x3234de053c52393 lrc: 4/0,1 mode: PW/PW res: [0x2b96d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.692048:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083a35be2/0x3234de053c52377 lrc: 1/0,0 mode: --/PW res: [0x2b969:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.692050:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.692051:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083a35be2/0x3234de053c52377 lrc: 0/0,0 mode: --/PW res: [0x2b969:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.692054:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+474:41278:x1731746396402176:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 22us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.692056:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12875 00000100:00100000:0.0:1651529344.692066:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.692068:0:80280:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a643e872/0x3234de053c4ed68 lrc: 0/0,0 mode: --/PR res: [0x2b96c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d67b8 expref: 473 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.692072:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029d739c8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997040640:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.692082:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b19bfe47/0x3234de053c5238c lrc: 3/0,1 mode: PW/PW res: [0x2b96c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.692085:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b19bfe47/0x3234de053c5238c lrc: 3/0,1 mode: PW/PW res: [0x2b96c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.692088:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b19bfe47/0x3234de053c5238c lrc: 3/0,1 mode: PW/PW res: [0x2b96c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.692091:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b19bfe47/0x3234de053c5238c lrc: 3/0,1 mode: PW/PW res: [0x2b96c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.692094:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b19bfe47/0x3234de053c5238c lrc: 2/0,0 mode: PW/PW res: [0x2b96c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.692147:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b19bfe47/0x3234de053c5238c lrc: 2/0,0 mode: PW/PW res: [0x2b96c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.692150:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1589:39030:x1731745946520960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 979us (1002us total) trans 12885080144 rc 0/0 00010000:00010000:0.0:1651529344.692151:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b19bfe47 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.692152:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b19bfe47/0x3234de053c5238c lrc: 2/0,0 mode: PW/PW res: [0x2b96c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.692155:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212092 00010000:00010000:0.0:1651529344.692155:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b19bfe47/0x3234de053c5238c lrc: 3/0,0 mode: PW/PW res: [0x2b96c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.692159:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946521152 00010000:00010000:0.0:1651529344.692160:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b19bfe47/0x3234de053c5238c lrc: 1/0,0 mode: --/PW res: [0x2b96c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.692165:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b19bfe47/0x3234de053c5238c lrc: 0/0,0 mode: --/PW res: [0x2b96c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.692169:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212095 00000100:00100000:1.0:1651529344.692170:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1589:39030:x1731745946521152:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.692175:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178543 count 1 00010000:00010000:1.0:1651529344.692179:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c523a1 lrc: 3/0,1 mode: --/PW res: [0x2b96f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.692182:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006aa45e66 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997040768:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.692184:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d127a1d8/0x3234de053c4d5e4 lrc: 2/0,0 mode: PR/PR res: [0x2b96f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d08f9 expref: 472 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.692185:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008e3070d2/0x3234de053c5239a lrc: 3/0,1 mode: --/PW res: [0x2b96e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.692187:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.692187:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.692188:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c523a1 lrc: 4/0,1 mode: --/PW res: [0x2b96f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.692194:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d127a1d8/0x3234de053c4d5e4 lrc: 3/0,0 mode: PR/PR res: [0x2b96f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d08f9 expref: 472 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.692198:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d127a1d8/0x3234de053c4d5e4 lrc: 4/0,0 mode: PR/PR res: [0x2b96f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d08f9 expref: 472 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.692199:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.692202:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029d739c8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997040832:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.692218:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 0000000089d75f07 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.692248:0:72396:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ea7bfa7/0x3234de053c4e7fe lrc: 0/0,0 mode: --/PR res: [0x2b96d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d50ab expref: 472 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.692254:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005b3c5aba pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997040704:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.692257:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006325442a/0x3234de053c52393 lrc: 3/0,1 mode: PW/PW res: [0x2b96d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.692261:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006325442a/0x3234de053c52393 lrc: 3/0,1 mode: PW/PW res: [0x2b96d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.692263:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006325442a/0x3234de053c52393 lrc: 3/0,1 mode: PW/PW res: [0x2b96d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.692267:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006325442a/0x3234de053c52393 lrc: 3/0,1 mode: PW/PW res: [0x2b96d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.692269:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006325442a/0x3234de053c52393 lrc: 2/0,0 mode: PW/PW res: [0x2b96d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.692278:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.692293:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946521216 00000100:00100000:0.0:1651529344.692300:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212096 00000100:00100000:0.0:1651529344.692302:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1591:39030:x1731745946521216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.692307:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178544 count 1 00000100:00100000:1.0:1651529344.692323:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1591:39029:x1731745946521024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1033us (1137us total) trans 12885080145 rc 0/0 00000100:00100000:1.0:1651529344.692326:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212093 00010000:00010000:0.0:1651529344.692330:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b8823b9/0x3234de053c523a8 lrc: 3/0,1 mode: --/PW res: [0x2b970:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.692335:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396402240 00010000:00010000:0.0:1651529344.692335:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c961580f/0x3234de053c4f5cd lrc: 2/0,0 mode: PR/PR res: [0x2b970:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89a0 expref: 471 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.692339:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ed943f93/0x3234de053c4cd94 lrc: 4/0,0 mode: PR/PR res: [0x2b96e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce822 expref: 472 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.692346:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12876 00000100:00100000:1.0:1651529344.692348:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bbd85ac9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+472:41279:x1731746396402240:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.692351:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.692352:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ed943f93/0x3234de053c4cd94 lrc: 4/0,0 mode: PR/PR res: [0x2b96e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce822 expref: 472 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.692356:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ed943f93/0x3234de053c4cd94 lrc: 3/0,0 mode: PR/PR res: [0x2b96e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce822 expref: 472 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.692357:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.692358:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.692359:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b8823b9/0x3234de053c523a8 lrc: 4/0,1 mode: --/PW res: [0x2b970:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.692370:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed943f93/0x3234de053c4cd94 lrc: 0/0,0 mode: --/PR res: [0x2b96e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce822 expref: 472 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.692373:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.692374:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.692375:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008e3070d2/0x3234de053c5239a lrc: 3/0,1 mode: PW/PW res: [0x2b96e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.692376:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c961580f/0x3234de053c4f5cd lrc: 3/0,0 mode: PR/PR res: [0x2b970:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89a0 expref: 471 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.692378:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e3070d2/0x3234de053c5239a lrc: 4/0,1 mode: PW/PW res: [0x2b96e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.692382:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c961580f/0x3234de053c4f5cd lrc: 4/0,0 mode: PR/PR res: [0x2b970:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89a0 expref: 471 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.692387:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.692393:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a9e254e pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997040896:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.692394:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bbd85ac9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+471:41279:x1731746396402240:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 45us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.692397:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12876 00000100:00100000:0.0:1651529344.692402:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 0000000070e666f7 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.692410:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ba00fdd7/0x3234de053c52385 lrc: 3/0,1 mode: PW/PW res: [0x2b96b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.692413:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba00fdd7/0x3234de053c52385 lrc: 3/0,1 mode: PW/PW res: [0x2b96b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.692418:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba00fdd7/0x3234de053c52385 lrc: 3/0,1 mode: PW/PW res: [0x2b96b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.692420:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006325442a/0x3234de053c52393 lrc: 2/0,0 mode: PW/PW res: [0x2b96d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.692421:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba00fdd7/0x3234de053c52385 lrc: 2/0,0 mode: PW/PW res: [0x2b96b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.692423:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006325442a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.692425:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006325442a/0x3234de053c52393 lrc: 2/0,0 mode: PW/PW res: [0x2b96d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.692438:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006325442a/0x3234de053c52393 lrc: 3/0,0 mode: PW/PW res: [0x2b96d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.692443:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006325442a/0x3234de053c52393 lrc: 1/0,0 mode: --/PW res: [0x2b96d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.692446:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006325442a/0x3234de053c52393 lrc: 0/0,0 mode: --/PW res: [0x2b96d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.692450:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba00fdd7/0x3234de053c52385 lrc: 2/0,0 mode: PW/PW res: [0x2b96b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.692453:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba00fdd7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.692454:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba00fdd7/0x3234de053c52385 lrc: 2/0,0 mode: PW/PW res: [0x2b96b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.692457:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba00fdd7/0x3234de053c52385 lrc: 3/0,0 mode: PW/PW res: [0x2b96b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.692460:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1591:39029:x1731745946520896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1362us (1491us total) trans 12885080146 rc 0/0 00010000:00010000:0.0:1651529344.692460:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba00fdd7/0x3234de053c52385 lrc: 1/0,0 mode: --/PW res: [0x2b96b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.692463:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212091 00010000:00010000:0.0:1651529344.692463:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba00fdd7/0x3234de053c52385 lrc: 0/0,0 mode: --/PW res: [0x2b96b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.692469:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002056e733/0x3234de053c5237e lrc: 3/0,1 mode: PW/PW res: [0x2b96a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.692470:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008e3070d2/0x3234de053c5239a lrc: 3/0,1 mode: PW/PW res: [0x2b96e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.692472:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002056e733/0x3234de053c5237e lrc: 3/0,1 mode: PW/PW res: [0x2b96a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.692473:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e3070d2/0x3234de053c5239a lrc: 3/0,1 mode: PW/PW res: [0x2b96e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.692476:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002056e733/0x3234de053c5237e lrc: 3/0,1 mode: PW/PW res: [0x2b96a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.692476:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e3070d2/0x3234de053c5239a lrc: 3/0,1 mode: PW/PW res: [0x2b96e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.692478:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002056e733/0x3234de053c5237e lrc: 2/0,0 mode: PW/PW res: [0x2b96a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.692478:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e3070d2/0x3234de053c5239a lrc: 2/0,0 mode: PW/PW res: [0x2b96e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.692514:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1592:39030:x1731745946520832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1458us (1551us total) trans 12885080147 rc 0/0 00000100:00100000:1.0:1651529344.692516:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212090 00010000:00010000:1.0:1651529344.692523:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ba3ddc6f/0x3234de053c52370 lrc: 3/0,1 mode: PW/PW res: [0x2b968:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.692528:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba3ddc6f/0x3234de053c52370 lrc: 3/0,1 mode: PW/PW res: [0x2b968:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.692528:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1591:39030:x1731745946521088:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 820us (992us total) trans 12885080148 rc 0/0 00010000:00010000:1.0:1651529344.692531:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba3ddc6f/0x3234de053c52370 lrc: 3/0,1 mode: PW/PW res: [0x2b968:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.692532:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212094 00010000:00010000:1.0:1651529344.692534:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba3ddc6f/0x3234de053c52370 lrc: 2/0,0 mode: PW/PW res: [0x2b968:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.692549:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002056e733/0x3234de053c5237e lrc: 2/0,0 mode: PW/PW res: [0x2b96a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.692555:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002056e733 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.692556:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002056e733/0x3234de053c5237e lrc: 2/0,0 mode: PW/PW res: [0x2b96a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.692559:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002056e733/0x3234de053c5237e lrc: 3/0,0 mode: PW/PW res: [0x2b96a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.692563:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002056e733/0x3234de053c5237e lrc: 1/0,0 mode: --/PW res: [0x2b96a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.692566:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002056e733/0x3234de053c5237e lrc: 0/0,0 mode: --/PW res: [0x2b96a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.692569:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1591:39030:x1731745946520704:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1565us (1647us total) trans 12885080149 rc 0/0 00010000:00010000:0.0:1651529344.692570:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e3070d2/0x3234de053c5239a lrc: 2/0,0 mode: PW/PW res: [0x2b96e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.692571:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212088 00010000:00010000:0.0:1651529344.692573:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008e3070d2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.692574:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e3070d2/0x3234de053c5239a lrc: 2/0,0 mode: PW/PW res: [0x2b96e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.692577:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e3070d2/0x3234de053c5239a lrc: 3/0,0 mode: PW/PW res: [0x2b96e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.692580:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e3070d2/0x3234de053c5239a lrc: 1/0,0 mode: --/PW res: [0x2b96e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.692582:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e3070d2/0x3234de053c5239a lrc: 0/0,0 mode: --/PW res: [0x2b96e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.692586:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba3ddc6f/0x3234de053c52370 lrc: 2/0,0 mode: PW/PW res: [0x2b968:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.692587:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.692588:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba3ddc6f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.692589:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba3ddc6f/0x3234de053c52370 lrc: 2/0,0 mode: PW/PW res: [0x2b968:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.692592:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba3ddc6f/0x3234de053c52370 lrc: 3/0,0 mode: PW/PW res: [0x2b968:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.692595:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba3ddc6f/0x3234de053c52370 lrc: 1/0,0 mode: --/PW res: [0x2b968:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.692597:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba3ddc6f/0x3234de053c52370 lrc: 0/0,0 mode: --/PW res: [0x2b968:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.692631:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.692647:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396402304 00010000:00010000:0.0:1651529344.692653:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d127a1d8/0x3234de053c4d5e4 lrc: 5/0,0 mode: PR/PR res: [0x2b96f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d08f9 expref: 471 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.692665:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12877 00000100:00100000:0.0:1651529344.692667:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+471:41279:x1731746396402304:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.692670:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.692671:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d127a1d8/0x3234de053c4d5e4 lrc: 5/0,0 mode: PR/PR res: [0x2b96f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d08f9 expref: 471 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.692677:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d127a1d8/0x3234de053c4d5e4 lrc: 4/0,0 mode: PR/PR res: [0x2b96f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d08f9 expref: 471 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.692683:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.692683:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.692684:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c523a1 lrc: 3/0,1 mode: PW/PW res: [0x2b96f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.692687:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c523a1 lrc: 4/0,1 mode: PW/PW res: [0x2b96f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.692692:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.692701:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+471:41279:x1731746396402304:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 34us (70us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.692704:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12877 00000100:00100000:1.0:1651529344.692706:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946521280 00000100:00100000:1.0:1651529344.692717:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212097 00000100:00100000:1.0:1651529344.692718:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1591:39030:x1731745946521280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.692723:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178545 count 1 00010000:00010000:1.0:1651529344.692728:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021901d62/0x3234de053c523af lrc: 3/0,1 mode: --/PW res: [0x2b971:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.692732:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe34e28f/0x3234de053c4d8bc lrc: 2/0,0 mode: PR/PR res: [0x2b971:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d13b8 expref: 470 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.692744:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.692745:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.692746:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021901d62/0x3234de053c523af lrc: 4/0,1 mode: --/PW res: [0x2b971:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.692753:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fe34e28f/0x3234de053c4d8bc lrc: 3/0,0 mode: PR/PR res: [0x2b971:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d13b8 expref: 470 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.692764:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fe34e28f/0x3234de053c4d8bc lrc: 4/0,0 mode: PR/PR res: [0x2b971:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d13b8 expref: 470 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.692768:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a9b051f pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997040960:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.692780:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 0000000099c1da85 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.692787:0:80280:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d127a1d8/0x3234de053c4d5e4 lrc: 0/0,0 mode: --/PR res: [0x2b96f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d08f9 expref: 470 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.692791:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029d739c8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997040832:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.692794:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c523a1 lrc: 3/0,1 mode: PW/PW res: [0x2b96f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.692798:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c523a1 lrc: 3/0,1 mode: PW/PW res: [0x2b96f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.692800:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c523a1 lrc: 3/0,1 mode: PW/PW res: [0x2b96f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.692803:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c523a1 lrc: 3/0,1 mode: PW/PW res: [0x2b96f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.692808:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c523a1 lrc: 2/0,0 mode: PW/PW res: [0x2b96f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.692827:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c523a1 lrc: 2/0,0 mode: PW/PW res: [0x2b96f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.692832:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ade4813a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.692833:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c523a1 lrc: 2/0,0 mode: PW/PW res: [0x2b96f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.692857:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1592:39030:x1731745946521152:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 686us (791us total) trans 12885080150 rc 0/0 00000100:00100000:1.0:1651529344.692860:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212095 00010000:00010000:0.0:1651529344.692861:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c523a1 lrc: 3/0,0 mode: PW/PW res: [0x2b96f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.692866:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c523a1 lrc: 1/0,0 mode: --/PW res: [0x2b96f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.692876:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.692886:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c523a1 lrc: 0/0,0 mode: --/PW res: [0x2b96f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.692897:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a9e254e pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997040896:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.692900:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000b8823b9/0x3234de053c523a8 lrc: 3/0,1 mode: --/PW res: [0x2b970:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.692909:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396402368 00000100:00100000:1.0:1651529344.692913:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.692913:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c961580f/0x3234de053c4f5cd lrc: 4/0,0 mode: PR/PR res: [0x2b970:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89a0 expref: 470 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.692925:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12878 00000100:00100000:1.0:1651529344.692926:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.692927:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+470:41278:x1731746396402368:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.692935:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.692936:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.692936:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c961580f/0x3234de053c4f5cd lrc: 4/0,0 mode: PR/PR res: [0x2b970:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89a0 expref: 470 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.692940:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c961580f/0x3234de053c4f5cd lrc: 3/0,0 mode: PR/PR res: [0x2b970:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89a0 expref: 470 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.692942:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.692950:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.692958:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946521344 00000100:00100000:1.0:1651529344.692964:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946521408 00000100:00100000:1.0:1651529344.692967:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946521472 00010000:00010000:0.0:1651529344.692967:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c961580f/0x3234de053c4f5cd lrc: 0/0,0 mode: --/PR res: [0x2b970:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d89a0 expref: 470 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.692970:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946521536 00010000:00010000:0.0:1651529344.692971:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.692972:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.692973:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000b8823b9/0x3234de053c523a8 lrc: 3/0,1 mode: PW/PW res: [0x2b970:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.692976:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946521600 00000100:00100000:1.0:1651529344.692982:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212098 00000100:00100000:1.0:1651529344.692983:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1596:39030:x1731745946521344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.692985:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b8823b9/0x3234de053c523a8 lrc: 4/0,1 mode: PW/PW res: [0x2b970:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.692989:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178546 count 1 00010000:00010000:0.0:1651529344.692992:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.692993:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c523b6 lrc: 3/0,1 mode: --/PW res: [0x2b972:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.692998:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000029cf31df/0x3234de053c4f54f lrc: 2/0,0 mode: PR/PR res: [0x2b972:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d879a expref: 469 pid: 156655 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.693004:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+469:41278:x1731746396402368:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 76us (128us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.693007:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.693007:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12878 00010000:00010000:1.0:1651529344.693008:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.693008:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c523b6 lrc: 4/0,1 mode: --/PW res: [0x2b972:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.693015:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212099 00010000:00010000:1.0:1651529344.693016:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000029cf31df/0x3234de053c4f54f lrc: 3/0,0 mode: PR/PR res: [0x2b972:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d879a expref: 468 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.693019:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000029cf31df/0x3234de053c4f54f lrc: 4/0,0 mode: PR/PR res: [0x2b972:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d879a expref: 468 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.693024:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004be0190 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997041024:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.693030:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1596:39029:x1731745946521408:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.693032:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.693036:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178547 count 1 00000100:00100000:1.0:1651529344.693038:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212100 00010000:00010000:0.0:1651529344.693039:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fa78486/0x3234de053c523bd lrc: 3/0,1 mode: --/PW res: [0x2b973:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.693040:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1596:39030:x1731745946521472:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.693044:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000abbab97e/0x3234de053c4e45b lrc: 2/0,0 mode: PR/PR res: [0x2b973:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4296 expref: 468 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.693045:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178548 count 1 00010000:00010000:0.0:1651529344.693047:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.693048:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c523c4 lrc: 3/0,1 mode: --/PW res: [0x2b974:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.693048:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.693048:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fa78486/0x3234de053c523bd lrc: 4/0,1 mode: --/PW res: [0x2b973:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.693052:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000023ef1563/0x3234de053c4f4b5 lrc: 2/0,0 mode: PR/PR res: [0x2b974:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d856a expref: 468 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.693055:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000abbab97e/0x3234de053c4e45b lrc: 3/0,0 mode: PR/PR res: [0x2b973:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4296 expref: 468 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.693056:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.693056:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.693057:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c523c4 lrc: 4/0,1 mode: --/PW res: [0x2b974:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.693058:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000abbab97e/0x3234de053c4e45b lrc: 4/0,0 mode: PR/PR res: [0x2b973:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4296 expref: 468 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.693063:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000023ef1563/0x3234de053c4f4b5 lrc: 3/0,0 mode: PR/PR res: [0x2b974:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d856a expref: 468 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.693065:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a9e254e pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997041088:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.693068:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000023ef1563/0x3234de053c4f4b5 lrc: 4/0,0 mode: PR/PR res: [0x2b974:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d856a expref: 468 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.693072:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f39ca9ea pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997041152:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.693074:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 0000000070e666f7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.693078:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e5f43e7 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.693080:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212101 00000100:00100000:0.0:1651529344.693082:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1596:39029:x1731745946521536:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.693084:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212102 00000100:00100000:1.0:1651529344.693085:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1596:39030:x1731745946521600:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.693086:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178549 count 1 00002000:00080000:1.0:1651529344.693089:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178550 count 1 00010000:00010000:0.0:1651529344.693089:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f192428c/0x3234de053c523cb lrc: 3/0,1 mode: --/PW res: [0x2b975:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.693092:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c523d2 lrc: 3/0,1 mode: --/PW res: [0x2b976:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.693093:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000371f2e4/0x3234de053c4cd08 lrc: 2/0,0 mode: PR/PR res: [0x2b975:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce646 expref: 468 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.693096:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fa028f6a/0x3234de053c4a0bc lrc: 2/0,0 mode: PR/PR res: [0x2b976:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb880 expref: 468 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.693097:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.693097:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.693098:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f192428c/0x3234de053c523cb lrc: 4/0,1 mode: --/PW res: [0x2b975:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.693099:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.693099:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.693100:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c523d2 lrc: 4/0,1 mode: --/PW res: [0x2b976:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.693103:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000371f2e4/0x3234de053c4cd08 lrc: 3/0,0 mode: PR/PR res: [0x2b975:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce646 expref: 468 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.693106:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fa028f6a/0x3234de053c4a0bc lrc: 3/0,0 mode: PR/PR res: [0x2b976:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb880 expref: 468 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.693107:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000371f2e4/0x3234de053c4cd08 lrc: 4/0,0 mode: PR/PR res: [0x2b975:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce646 expref: 468 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.693109:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fa028f6a/0x3234de053c4a0bc lrc: 4/0,0 mode: PR/PR res: [0x2b976:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb880 expref: 468 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.693111:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000075b025a pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997041216:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.693116:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000088fa78f8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997041280:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.693117:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000abca413e going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.693121:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000b8823b9/0x3234de053c523a8 lrc: 3/0,1 mode: PW/PW res: [0x2b970:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.693122:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a6b79b05 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.693124:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b8823b9/0x3234de053c523a8 lrc: 3/0,1 mode: PW/PW res: [0x2b970:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.693127:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b8823b9/0x3234de053c523a8 lrc: 3/0,1 mode: PW/PW res: [0x2b970:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.693130:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b8823b9/0x3234de053c523a8 lrc: 2/0,0 mode: PW/PW res: [0x2b970:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.693146:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.693169:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.693169:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1597:39030:x1731745946521216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 866us (891us total) trans 12885080151 rc 0/0 00000100:00100000:0.0:1651529344.693172:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212096 00000100:00100000:0.0:1651529344.693177:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946521664 00000100:00100000:0.0:1651529344.693195:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212103 00000100:00100000:0.0:1651529344.693197:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1597:39030:x1731745946521664:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.693201:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178551 count 1 00010000:00010000:0.0:1651529344.693205:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009273683/0x3234de053c523d9 lrc: 3/0,1 mode: --/PW res: [0x2b977:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.693209:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000943c1249/0x3234de053c4f246 lrc: 2/0,0 mode: PR/PR res: [0x2b977:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7bdf expref: 468 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.693213:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.693213:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.693214:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009273683/0x3234de053c523d9 lrc: 4/0,1 mode: --/PW res: [0x2b977:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.693239:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000943c1249/0x3234de053c4f246 lrc: 3/0,0 mode: PR/PR res: [0x2b977:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7bdf expref: 468 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.693243:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000943c1249/0x3234de053c4f246 lrc: 4/0,0 mode: PR/PR res: [0x2b977:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7bdf expref: 468 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.693247:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000673bcbe2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997041344:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.693256:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 0000000009370c1d going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.693261:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b8823b9/0x3234de053c523a8 lrc: 2/0,0 mode: PW/PW res: [0x2b970:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.693264:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000b8823b9 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.693265:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b8823b9/0x3234de053c523a8 lrc: 2/0,0 mode: PW/PW res: [0x2b970:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.693268:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b8823b9/0x3234de053c523a8 lrc: 3/0,0 mode: PW/PW res: [0x2b970:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.693273:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b8823b9/0x3234de053c523a8 lrc: 1/0,0 mode: --/PW res: [0x2b970:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.693275:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b8823b9/0x3234de053c523a8 lrc: 0/0,0 mode: --/PW res: [0x2b970:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.693284:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396402432 00000100:00100000:1.0:1651529344.693286:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a9b051f pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997040960:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.693291:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000021901d62/0x3234de053c523af lrc: 3/0,1 mode: --/PW res: [0x2b971:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.693305:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fe34e28f/0x3234de053c4d8bc lrc: 4/0,0 mode: PR/PR res: [0x2b971:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d13b8 expref: 469 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.693317:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12879 00000100:00100000:0.0:1651529344.693319:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+469:41278:x1731746396402432:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.693337:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.693339:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fe34e28f/0x3234de053c4d8bc lrc: 4/0,0 mode: PR/PR res: [0x2b971:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d13b8 expref: 469 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.693343:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fe34e28f/0x3234de053c4d8bc lrc: 3/0,0 mode: PR/PR res: [0x2b971:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d13b8 expref: 469 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.693344:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.693350:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946521728 00000100:00100000:1.0:1651529344.693357:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212104 00000100:00100000:1.0:1651529344.693358:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1598:39030:x1731745946521728:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.693361:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe34e28f/0x3234de053c4d8bc lrc: 0/0,0 mode: --/PR res: [0x2b971:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d13b8 expref: 469 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:1.0:1651529344.693364:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178552 count 1 00010000:00010000:0.0:1651529344.693365:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.693366:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.693366:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000021901d62/0x3234de053c523af lrc: 3/0,1 mode: PW/PW res: [0x2b971:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.693367:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c523e0 lrc: 3/0,1 mode: --/PW res: [0x2b978:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.693369:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021901d62/0x3234de053c523af lrc: 4/0,1 mode: PW/PW res: [0x2b971:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.693372:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002502e16f/0x3234de053c4c61d lrc: 2/0,0 mode: PR/PR res: [0x2b978:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca69 expref: 468 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.693375:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.693376:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.693376:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c523e0 lrc: 4/0,1 mode: --/PW res: [0x2b978:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.693389:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.693390:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002502e16f/0x3234de053c4c61d lrc: 3/0,0 mode: PR/PR res: [0x2b978:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca69 expref: 468 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.693394:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002502e16f/0x3234de053c4c61d lrc: 4/0,0 mode: PR/PR res: [0x2b978:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca69 expref: 468 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.693398:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ee8cd7c9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997041408:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.693401:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+468:41278:x1731746396402432:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 82us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.693404:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12879 00000100:00100000:1.0:1651529344.693411:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 000000007e004c12 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.693417:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000021901d62/0x3234de053c523af lrc: 3/0,1 mode: PW/PW res: [0x2b971:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.693425:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021901d62/0x3234de053c523af lrc: 3/0,1 mode: PW/PW res: [0x2b971:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.693428:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021901d62/0x3234de053c523af lrc: 3/0,1 mode: PW/PW res: [0x2b971:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.693431:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021901d62/0x3234de053c523af lrc: 2/0,0 mode: PW/PW res: [0x2b971:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.693501:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1599:39030:x1731745946521280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 781us (914us total) trans 12885080152 rc 0/0 00000100:00100000:1.0:1651529344.693504:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212097 00010000:00010000:0.0:1651529344.693515:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021901d62/0x3234de053c523af lrc: 2/0,0 mode: PW/PW res: [0x2b971:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.693519:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000021901d62 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.693521:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004be0190 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997041024:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.693521:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021901d62/0x3234de053c523af lrc: 2/0,0 mode: PW/PW res: [0x2b971:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.693524:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021901d62/0x3234de053c523af lrc: 3/0,0 mode: PW/PW res: [0x2b971:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.693525:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c523b6 lrc: 3/0,1 mode: --/PW res: [0x2b972:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.693528:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021901d62/0x3234de053c523af lrc: 1/0,0 mode: --/PW res: [0x2b971:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.693531:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021901d62/0x3234de053c523af lrc: 0/0,0 mode: --/PW res: [0x2b971:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.693534:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f39ca9ea pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997041152:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.693536:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c523c4 lrc: 3/0,1 mode: --/PW res: [0x2b974:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.693540:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a9e254e pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997041088:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.693543:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000088fa78f8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997041280:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.693544:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007fa78486/0x3234de053c523bd lrc: 3/0,1 mode: --/PW res: [0x2b973:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.693545:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c523d2 lrc: 3/0,1 mode: --/PW res: [0x2b976:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.693550:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000075b025a pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997041216:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.693553:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f192428c/0x3234de053c523cb lrc: 3/0,1 mode: --/PW res: [0x2b975:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.693655:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.693665:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946521792 00000100:00100000:1.0:1651529344.693672:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212105 00000100:00100000:1.0:1651529344.693673:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1599:39030:x1731745946521792:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.693678:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178553 count 1 00010000:00010000:1.0:1651529344.693687:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c523e7 lrc: 3/0,1 mode: --/PW res: [0x2b979:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.693692:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000abc8fd8f/0x3234de053c4d8a7 lrc: 2/0,0 mode: PR/PR res: [0x2b979:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1372 expref: 467 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.693695:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.693696:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.693696:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c523e7 lrc: 4/0,1 mode: --/PW res: [0x2b979:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.693703:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000abc8fd8f/0x3234de053c4d8a7 lrc: 3/0,0 mode: PR/PR res: [0x2b979:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1372 expref: 467 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.693706:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000abc8fd8f/0x3234de053c4d8a7 lrc: 4/0,0 mode: PR/PR res: [0x2b979:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1372 expref: 467 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.693713:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000095d7eb1a pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997041472:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.693726:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e5f43e7 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.693764:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.693773:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000673bcbe2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997041344:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.693777:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000009273683/0x3234de053c523d9 lrc: 3/0,1 mode: --/PW res: [0x2b977:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.693795:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.693804:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.693805:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396402496 00000100:00100000:0.0:1651529344.693814:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.693816:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000029cf31df/0x3234de053c4f54f lrc: 4/0,0 mode: PR/PR res: [0x2b972:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d879a expref: 468 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.693822:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.693826:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.693827:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396402624 00010000:00010000:1.0:1651529344.693829:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000371f2e4/0x3234de053c4cd08 lrc: 4/0,0 mode: PR/PR res: [0x2b975:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce646 expref: 469 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.693838:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.693839:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396402688 00010000:00010000:1.0:1651529344.693842:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000023ef1563/0x3234de053c4f4b5 lrc: 4/0,0 mode: PR/PR res: [0x2b974:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d856a expref: 470 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.693844:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396402560 00000100:00100000:1.0:1651529344.693846:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396402752 00010000:00010000:1.0:1651529344.693849:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fa028f6a/0x3234de053c4a0bc lrc: 4/0,0 mode: PR/PR res: [0x2b976:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb880 expref: 472 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.693849:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000abbab97e/0x3234de053c4e45b lrc: 4/0,0 mode: PR/PR res: [0x2b973:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4296 expref: 472 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.693853:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396402816 00010000:00010000:1.0:1651529344.693855:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000943c1249/0x3234de053c4f246 lrc: 4/0,0 mode: PR/PR res: [0x2b977:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7bdf expref: 473 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.693855:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396402880 00010000:00010000:0.0:1651529344.693857:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002502e16f/0x3234de053c4c61d lrc: 5/0,0 mode: PR/PR res: [0x2b978:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca69 expref: 474 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.693860:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12880 00000100:00100000:1.0:1651529344.693861:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+474:41278:x1731746396402496:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.693863:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12881 00010000:00010000:1.0:1651529344.693864:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.693864:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+474:41278:x1731746396402624:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.693865:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000029cf31df/0x3234de053c4f54f lrc: 4/0,0 mode: PR/PR res: [0x2b972:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d879a expref: 474 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.693867:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.693869:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000029cf31df/0x3234de053c4f54f lrc: 3/0,0 mode: PR/PR res: [0x2b972:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d879a expref: 474 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.693869:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000371f2e4/0x3234de053c4cd08 lrc: 4/0,0 mode: PR/PR res: [0x2b975:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce646 expref: 474 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.693873:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000371f2e4/0x3234de053c4cd08 lrc: 3/0,0 mode: PR/PR res: [0x2b975:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce646 expref: 474 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.693875:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029cf31df/0x3234de053c4f54f lrc: 0/0,0 mode: --/PR res: [0x2b972:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d879a expref: 474 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.693878:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000371f2e4/0x3234de053c4cd08 lrc: 0/0,0 mode: --/PR res: [0x2b975:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce646 expref: 473 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.693879:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.693879:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.693880:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c523b6 lrc: 3/0,1 mode: PW/PW res: [0x2b972:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.693883:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c523b6 lrc: 4/0,1 mode: PW/PW res: [0x2b972:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.693885:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.693885:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.693886:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f192428c/0x3234de053c523cb lrc: 3/0,1 mode: PW/PW res: [0x2b975:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.693889:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f192428c/0x3234de053c523cb lrc: 4/0,1 mode: PW/PW res: [0x2b975:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.693890:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.693896:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.693898:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+472:41278:x1731746396402496:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 36us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.693900:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12880 00000100:00100000:0.0:1651529344.693903:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+471:41278:x1731746396402624:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 38us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.693905:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12882 00000100:00100000:1.0:1651529344.693906:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+471:41278:x1731746396402688:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.693906:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12881 00010000:00010000:1.0:1651529344.693909:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.693910:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000023ef1563/0x3234de053c4f4b5 lrc: 4/0,0 mode: PR/PR res: [0x2b974:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d856a expref: 470 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.693911:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12883 00000100:00100000:0.0:1651529344.693913:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+470:41279:x1731746396402752:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.693914:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000023ef1563/0x3234de053c4f4b5 lrc: 3/0,0 mode: PR/PR res: [0x2b974:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d856a expref: 470 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.693915:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.693917:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fa028f6a/0x3234de053c4a0bc lrc: 4/0,0 mode: PR/PR res: [0x2b976:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb880 expref: 470 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.693919:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023ef1563/0x3234de053c4f4b5 lrc: 0/0,0 mode: --/PR res: [0x2b974:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d856a expref: 470 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.693921:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fa028f6a/0x3234de053c4a0bc lrc: 3/0,0 mode: PR/PR res: [0x2b976:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb880 expref: 470 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.693922:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.693923:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.693923:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c523c4 lrc: 3/0,1 mode: PW/PW res: [0x2b974:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.693926:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c523c4 lrc: 4/0,1 mode: PW/PW res: [0x2b974:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.693931:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.693936:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+469:41278:x1731746396402688:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 29us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.693938:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12882 00000100:00100000:1.0:1651529344.693942:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12884 00000100:00100000:1.0:1651529344.693943:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ede49ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+468:41279:x1731746396402560:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.693945:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.693946:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa028f6a/0x3234de053c4a0bc lrc: 0/0,0 mode: --/PR res: [0x2b976:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb880 expref: 468 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.693947:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000abbab97e/0x3234de053c4e45b lrc: 4/0,0 mode: PR/PR res: [0x2b973:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4296 expref: 468 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.693950:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000abbab97e/0x3234de053c4e45b lrc: 3/0,0 mode: PR/PR res: [0x2b973:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4296 expref: 467 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.693950:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.693951:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.693951:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c523d2 lrc: 3/0,1 mode: PW/PW res: [0x2b976:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.693954:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c523d2 lrc: 4/0,1 mode: PW/PW res: [0x2b976:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.693955:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abbab97e/0x3234de053c4e45b lrc: 0/0,0 mode: --/PR res: [0x2b973:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4296 expref: 467 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.693960:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.693961:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.693964:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.693968:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007fa78486/0x3234de053c523bd lrc: 3/0,1 mode: PW/PW res: [0x2b973:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.693971:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+466:41279:x1731746396402752:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 57us (149us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.693972:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fa78486/0x3234de053c523bd lrc: 4/0,1 mode: PW/PW res: [0x2b973:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.693974:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12883 00010000:00010000:1.0:1651529344.693980:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.693986:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ede49ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+465:41279:x1731746396402560:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.693986:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12885 00000100:00100000:0.0:1651529344.693988:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+465:41279:x1731746396402816:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.693989:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12884 00010000:00010000:0.0:1651529344.693991:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.693993:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000943c1249/0x3234de053c4f246 lrc: 4/0,0 mode: PR/PR res: [0x2b977:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7bdf expref: 464 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.693997:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12886 00010000:00010000:0.0:1651529344.693997:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000943c1249/0x3234de053c4f246 lrc: 3/0,0 mode: PR/PR res: [0x2b977:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7bdf expref: 464 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.693999:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+464:41279:x1731746396402880:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.694001:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.694002:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000943c1249/0x3234de053c4f246 lrc: 0/0,0 mode: --/PR res: [0x2b977:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7bdf expref: 464 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.694003:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002502e16f/0x3234de053c4c61d lrc: 5/0,0 mode: PR/PR res: [0x2b978:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca69 expref: 464 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.694005:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.694006:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.694007:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002502e16f/0x3234de053c4c61d lrc: 4/0,0 mode: PR/PR res: [0x2b978:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca69 expref: 463 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.694007:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009273683/0x3234de053c523d9 lrc: 3/0,1 mode: PW/PW res: [0x2b977:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.694011:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.694012:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.694012:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c523e0 lrc: 3/0,1 mode: PW/PW res: [0x2b978:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.694012:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009273683/0x3234de053c523d9 lrc: 4/0,1 mode: PW/PW res: [0x2b977:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.694018:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c523e0 lrc: 4/0,1 mode: PW/PW res: [0x2b978:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.694018:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.694022:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.694023:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+463:41279:x1731746396402816:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.694026:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+463:41279:x1731746396402880:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 27us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.694026:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12885 00000100:00100000:1.0:1651529344.694028:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12886 00010000:00010000:0.0:1651529344.694033:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f192428c/0x3234de053c523cb lrc: 3/0,1 mode: PW/PW res: [0x2b975:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.694036:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c523b6 lrc: 3/0,1 mode: PW/PW res: [0x2b972:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.694036:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f192428c/0x3234de053c523cb lrc: 3/0,1 mode: PW/PW res: [0x2b975:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.694039:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c523b6 lrc: 3/0,1 mode: PW/PW res: [0x2b972:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.694039:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f192428c/0x3234de053c523cb lrc: 3/0,1 mode: PW/PW res: [0x2b975:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.694041:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f192428c/0x3234de053c523cb lrc: 2/0,0 mode: PW/PW res: [0x2b975:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.694042:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c523b6 lrc: 3/0,1 mode: PW/PW res: [0x2b972:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.694044:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c523b6 lrc: 2/0,0 mode: PW/PW res: [0x2b972:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.694086:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1601:39030:x1731745946521344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1101us (1173us total) trans 12885080153 rc 0/0 00000100:00100000:1.0:1651529344.694088:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212098 00000100:00100000:0.0:1651529344.694090:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1601:39029:x1731745946521536:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1007us (1148us total) trans 12885080154 rc 0/0 00000100:00100000:0.0:1651529344.694093:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212101 00010000:00010000:1.0:1651529344.694095:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c523c4 lrc: 3/0,1 mode: PW/PW res: [0x2b974:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.694098:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c523c4 lrc: 3/0,1 mode: PW/PW res: [0x2b974:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.694100:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007fa78486/0x3234de053c523bd lrc: 3/0,1 mode: PW/PW res: [0x2b973:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.694102:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c523c4 lrc: 3/0,1 mode: PW/PW res: [0x2b974:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.694103:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007fa78486/0x3234de053c523bd lrc: 3/0,1 mode: PW/PW res: [0x2b973:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.694104:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c523c4 lrc: 2/0,0 mode: PW/PW res: [0x2b974:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.694107:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fa78486/0x3234de053c523bd lrc: 3/0,1 mode: PW/PW res: [0x2b973:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.694110:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007fa78486/0x3234de053c523bd lrc: 2/0,0 mode: PW/PW res: [0x2b973:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.694140:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1601:39030:x1731745946521472:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1099us (1204us total) trans 12885080155 rc 0/0 00000100:00100000:1.0:1651529344.694143:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212100 00010000:00010000:1.0:1651529344.694150:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c523d2 lrc: 3/0,1 mode: PW/PW res: [0x2b976:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.694150:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1600:39029:x1731745946521408:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1120us (1229us total) trans 12885080156 rc 0/0 00010000:00010000:1.0:1651529344.694153:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c523d2 lrc: 3/0,1 mode: PW/PW res: [0x2b976:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.694153:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212099 00010000:00010000:1.0:1651529344.694156:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c523d2 lrc: 3/0,1 mode: PW/PW res: [0x2b976:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.694158:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c523d2 lrc: 2/0,0 mode: PW/PW res: [0x2b976:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.694160:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f192428c/0x3234de053c523cb lrc: 2/0,0 mode: PW/PW res: [0x2b975:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.694164:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f192428c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.694165:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f192428c/0x3234de053c523cb lrc: 2/0,0 mode: PW/PW res: [0x2b975:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.694168:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f192428c/0x3234de053c523cb lrc: 3/0,0 mode: PW/PW res: [0x2b975:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.694172:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f192428c/0x3234de053c523cb lrc: 1/0,0 mode: --/PW res: [0x2b975:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.694175:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f192428c/0x3234de053c523cb lrc: 0/0,0 mode: --/PW res: [0x2b975:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.694179:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c523b6 lrc: 2/0,0 mode: PW/PW res: [0x2b972:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.694182:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000048ee8765 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.694183:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c523b6 lrc: 2/0,0 mode: PW/PW res: [0x2b972:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.694186:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c523b6 lrc: 3/0,0 mode: PW/PW res: [0x2b972:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.694188:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1600:39030:x1731745946521600:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1102us (1237us total) trans 12885080157 rc 0/0 00010000:00010000:0.0:1651529344.694189:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c523b6 lrc: 1/0,0 mode: --/PW res: [0x2b972:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.694191:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212102 00010000:00010000:0.0:1651529344.694192:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c523b6 lrc: 0/0,0 mode: --/PW res: [0x2b972:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.694195:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c523c4 lrc: 2/0,0 mode: PW/PW res: [0x2b974:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.694197:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c5599f68 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.694198:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c523c4 lrc: 2/0,0 mode: PW/PW res: [0x2b974:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.694201:0:80280:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002502e16f/0x3234de053c4c61d lrc: 0/0,0 mode: --/PR res: [0x2b978:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cca69 expref: 461 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.694201:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c523c4 lrc: 3/0,0 mode: PW/PW res: [0x2b974:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.694204:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c523c4 lrc: 1/0,0 mode: --/PW res: [0x2b974:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.694206:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c523c4 lrc: 0/0,0 mode: --/PW res: [0x2b974:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.694207:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ee8cd7c9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997041408:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.694210:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007fa78486/0x3234de053c523bd lrc: 2/0,0 mode: PW/PW res: [0x2b973:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.694211:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c523e0 lrc: 3/0,1 mode: PW/PW res: [0x2b978:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.694213:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007fa78486 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.694213:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007fa78486/0x3234de053c523bd lrc: 2/0,0 mode: PW/PW res: [0x2b973:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.694214:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c523e0 lrc: 3/0,1 mode: PW/PW res: [0x2b978:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.694216:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007fa78486/0x3234de053c523bd lrc: 3/0,0 mode: PW/PW res: [0x2b973:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.694217:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c523e0 lrc: 3/0,1 mode: PW/PW res: [0x2b978:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.694219:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c523e0 lrc: 3/0,1 mode: PW/PW res: [0x2b978:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.694219:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007fa78486/0x3234de053c523bd lrc: 1/0,0 mode: --/PW res: [0x2b973:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.694221:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fa78486/0x3234de053c523bd lrc: 0/0,0 mode: --/PW res: [0x2b973:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.694239:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c523e0 lrc: 2/0,0 mode: PW/PW res: [0x2b978:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.694246:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c523d2 lrc: 2/0,0 mode: PW/PW res: [0x2b976:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.694248:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000091ee0f93 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.694249:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c523d2 lrc: 2/0,0 mode: PW/PW res: [0x2b976:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.694252:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c523d2 lrc: 3/0,0 mode: PW/PW res: [0x2b976:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.694255:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c523d2 lrc: 1/0,0 mode: --/PW res: [0x2b976:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.694258:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c523d2 lrc: 0/0,0 mode: --/PW res: [0x2b976:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.694262:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c523e0 lrc: 2/0,0 mode: PW/PW res: [0x2b978:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.694264:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fc4c513 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.694265:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c523e0 lrc: 2/0,0 mode: PW/PW res: [0x2b978:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.694267:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c523e0 lrc: 3/0,0 mode: PW/PW res: [0x2b978:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.694270:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c523e0 lrc: 1/0,0 mode: --/PW res: [0x2b978:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.694273:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1600:39030:x1731745946521728:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 913us (929us total) trans 12885080158 rc 0/0 00010000:00010000:0.0:1651529344.694273:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c523e0 lrc: 0/0,0 mode: --/PW res: [0x2b978:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.694275:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212104 00010000:00010000:0.0:1651529344.694280:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000009273683/0x3234de053c523d9 lrc: 3/0,1 mode: PW/PW res: [0x2b977:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.694282:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009273683/0x3234de053c523d9 lrc: 3/0,1 mode: PW/PW res: [0x2b977:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.694285:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009273683/0x3234de053c523d9 lrc: 3/0,1 mode: PW/PW res: [0x2b977:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.694288:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009273683/0x3234de053c523d9 lrc: 2/0,0 mode: PW/PW res: [0x2b977:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.694314:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.694325:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1600:39030:x1731745946521664:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1127us (1179us total) trans 12885080159 rc 0/0 00000100:00100000:0.0:1651529344.694328:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212103 00010000:00010000:0.0:1651529344.694335:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009273683/0x3234de053c523d9 lrc: 2/0,0 mode: PW/PW res: [0x2b977:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.694338:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000009273683 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.694339:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009273683/0x3234de053c523d9 lrc: 2/0,0 mode: PW/PW res: [0x2b977:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.694342:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009273683/0x3234de053c523d9 lrc: 3/0,0 mode: PW/PW res: [0x2b977:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.694346:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009273683/0x3234de053c523d9 lrc: 1/0,0 mode: --/PW res: [0x2b977:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.694349:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009273683/0x3234de053c523d9 lrc: 0/0,0 mode: --/PW res: [0x2b977:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.694415:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396402944 00010000:00010000:1.0:1651529344.694420:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000abc8fd8f/0x3234de053c4d8a7 lrc: 5/0,0 mode: PR/PR res: [0x2b979:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1372 expref: 461 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.694429:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12887 00000100:00100000:1.0:1651529344.694431:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+461:41279:x1731746396402944:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.694433:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.694435:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000abc8fd8f/0x3234de053c4d8a7 lrc: 5/0,0 mode: PR/PR res: [0x2b979:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1372 expref: 461 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.694438:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000abc8fd8f/0x3234de053c4d8a7 lrc: 4/0,0 mode: PR/PR res: [0x2b979:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1372 expref: 461 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.694444:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.694445:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.694445:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c523e7 lrc: 3/0,1 mode: PW/PW res: [0x2b979:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.694448:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c523e7 lrc: 4/0,1 mode: PW/PW res: [0x2b979:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.694453:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.694465:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+461:41279:x1731746396402944:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 34us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.694468:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12887 00010000:00010000:1.0:1651529344.694479:0:80279:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abc8fd8f/0x3234de053c4d8a7 lrc: 0/0,0 mode: --/PR res: [0x2b979:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1372 expref: 460 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.694483:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000095d7eb1a pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997041472:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.694494:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c523e7 lrc: 3/0,1 mode: PW/PW res: [0x2b979:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.694500:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c523e7 lrc: 3/0,1 mode: PW/PW res: [0x2b979:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.694503:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c523e7 lrc: 3/0,1 mode: PW/PW res: [0x2b979:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.694506:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c523e7 lrc: 3/0,1 mode: PW/PW res: [0x2b979:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.694508:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c523e7 lrc: 2/0,0 mode: PW/PW res: [0x2b979:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.694519:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c523e7 lrc: 2/0,0 mode: PW/PW res: [0x2b979:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.694523:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008517b233 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.694525:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c523e7 lrc: 2/0,0 mode: PW/PW res: [0x2b979:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.694528:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c523e7 lrc: 3/0,0 mode: PW/PW res: [0x2b979:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.694532:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c523e7 lrc: 1/0,0 mode: --/PW res: [0x2b979:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.694535:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c523e7 lrc: 0/0,0 mode: --/PW res: [0x2b979:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.694551:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1600:39030:x1731745946521792:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 877us (897us total) trans 12885080160 rc 0/0 00000100:00100000:1.0:1651529344.694554:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212105 00000100:00100000:1.0:1651529344.694611:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.694628:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.694641:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946521856 00000100:00100000:1.0:1651529344.694648:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.694652:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946521920 00000100:00100000:0.0:1651529344.694656:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212106 00000100:00100000:0.0:1651529344.694657:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1601:39030:x1731745946521856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.694669:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.694670:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178554 count 1 00010000:00010000:0.0:1651529344.694674:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8c6a7f2/0x3234de053c523ee lrc: 3/0,1 mode: --/PW res: [0x2b97a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.694676:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.694684:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.694684:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009c96826c/0x3234de053c4cef9 lrc: 2/0,0 mode: PR/PR res: [0x2b97a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cedc4 expref: 459 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.694687:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.694688:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.694689:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8c6a7f2/0x3234de053c523ee lrc: 4/0,1 mode: --/PW res: [0x2b97a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.694691:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.694696:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009c96826c/0x3234de053c4cef9 lrc: 3/0,0 mode: PR/PR res: [0x2b97a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cedc4 expref: 459 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.694698:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946521984 00010000:00010000:0.0:1651529344.694700:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009c96826c/0x3234de053c4cef9 lrc: 4/0,0 mode: PR/PR res: [0x2b97a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cedc4 expref: 459 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.694707:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946522048 00000100:00100000:0.0:1651529344.694709:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a9e254e pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997041536:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.694712:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946522112 00000100:00100000:1.0:1651529344.694715:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946522176 00000100:00100000:1.0:1651529344.694717:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946522240 00000100:00100000:1.0:1651529344.694721:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212107 00000100:00100000:1.0:1651529344.694722:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1606:39029:x1731745946521920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.694728:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178555 count 1 00010000:00010000:1.0:1651529344.694732:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c523f5 lrc: 3/0,1 mode: --/PW res: [0x2b97b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.694745:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009a68b833/0x3234de053c4cbe9 lrc: 2/0,0 mode: PR/PR res: [0x2b97b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce184 expref: 459 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.694750:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000003c8b0daf going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.694755:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.694755:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.694756:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c523f5 lrc: 4/0,1 mode: --/PW res: [0x2b97b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.694758:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212108 00000100:00100000:0.0:1651529344.694759:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1606:39030:x1731745946521984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.694763:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009a68b833/0x3234de053c4cbe9 lrc: 3/0,0 mode: PR/PR res: [0x2b97b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce184 expref: 459 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.694764:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178556 count 1 00010000:00010000:1.0:1651529344.694767:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009a68b833/0x3234de053c4cbe9 lrc: 4/0,0 mode: PR/PR res: [0x2b97b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce184 expref: 459 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.694768:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094a0ec28/0x3234de053c523fc lrc: 3/0,1 mode: --/PW res: [0x2b97c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.694772:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004be0190 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997041600:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.694772:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c4ecb2 lrc: 2/0,0 mode: PR/PR res: [0x2b97c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d64b6 expref: 459 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.694775:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.694776:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.694777:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094a0ec28/0x3234de053c523fc lrc: 4/0,1 mode: --/PW res: [0x2b97c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.694780:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aeda71fe going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.694783:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c4ecb2 lrc: 3/0,0 mode: PR/PR res: [0x2b97c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d64b6 expref: 459 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.694787:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212109 00010000:00010000:0.0:1651529344.694787:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c4ecb2 lrc: 4/0,0 mode: PR/PR res: [0x2b97c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d64b6 expref: 459 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.694789:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1606:39029:x1731745946522048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.694793:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178557 count 1 00000100:00100000:0.0:1651529344.694793:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000673bcbe2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997041664:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.694797:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52403 lrc: 3/0,1 mode: --/PW res: [0x2b97d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.694801:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b81e4a0 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.694803:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006967343c/0x3234de053c4d2e2 lrc: 2/0,0 mode: PR/PR res: [0x2b97d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd68 expref: 459 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.694806:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.694807:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.694807:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212110 00010000:00010000:1.0:1651529344.694808:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52403 lrc: 4/0,1 mode: --/PW res: [0x2b97d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.694808:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1606:39030:x1731745946522112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.694812:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178558 count 1 00010000:00010000:1.0:1651529344.694813:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006967343c/0x3234de053c4d2e2 lrc: 3/0,0 mode: PR/PR res: [0x2b97d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd68 expref: 459 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.694815:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000345d04ae/0x3234de053c5240a lrc: 3/0,1 mode: --/PW res: [0x2b97e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.694817:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006967343c/0x3234de053c4d2e2 lrc: 4/0,0 mode: PR/PR res: [0x2b97d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd68 expref: 459 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.694819:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000014ff9ea4/0x3234de053c4ce6d lrc: 2/0,0 mode: PR/PR res: [0x2b97e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cebe8 expref: 459 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.694821:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a9b051f pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997041728:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.694822:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.694823:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.694823:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000345d04ae/0x3234de053c5240a lrc: 4/0,1 mode: --/PW res: [0x2b97e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.694827:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f79d8146 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.694829:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000014ff9ea4/0x3234de053c4ce6d lrc: 3/0,0 mode: PR/PR res: [0x2b97e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cebe8 expref: 459 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.694832:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212111 00010000:00010000:0.0:1651529344.694832:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000014ff9ea4/0x3234de053c4ce6d lrc: 4/0,0 mode: PR/PR res: [0x2b97e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cebe8 expref: 459 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.694834:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1606:39029:x1731745946522176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.694836:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000037ac96ac pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997041792:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.694838:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178559 count 1 00010000:00010000:1.0:1651529344.694841:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52411 lrc: 3/0,1 mode: --/PW res: [0x2b97f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.694842:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed830649 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.694845:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008014f71b/0x3234de053c4dac2 lrc: 2/0,0 mode: PR/PR res: [0x2b97f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b52 expref: 459 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.694848:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.694848:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.694848:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212112 00010000:00010000:1.0:1651529344.694849:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52411 lrc: 4/0,1 mode: --/PW res: [0x2b97f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.694850:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1606:39030:x1731745946522240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.694854:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178560 count 1 00010000:00010000:1.0:1651529344.694855:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008014f71b/0x3234de053c4dac2 lrc: 3/0,0 mode: PR/PR res: [0x2b97f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b52 expref: 459 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.694857:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c52418 lrc: 3/0,1 mode: --/PW res: [0x2b980:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.694859:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008014f71b/0x3234de053c4dac2 lrc: 4/0,0 mode: PR/PR res: [0x2b97f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b52 expref: 459 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.694861:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002a35c0ca/0x3234de053c4eaf9 lrc: 2/0,0 mode: PR/PR res: [0x2b980:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5daf expref: 459 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.694863:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000027e31dd1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997041856:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.694864:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.694864:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.694865:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c52418 lrc: 4/0,1 mode: --/PW res: [0x2b980:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.694868:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d09f5ee1 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.694870:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002a35c0ca/0x3234de053c4eaf9 lrc: 3/0,0 mode: PR/PR res: [0x2b980:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5daf expref: 459 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.694874:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002a35c0ca/0x3234de053c4eaf9 lrc: 4/0,0 mode: PR/PR res: [0x2b980:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5daf expref: 459 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.694878:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002f77bb41 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997041920:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.694884:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c2b2b59c going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.694885:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.694889:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946522304 00000100:00100000:0.0:1651529344.694899:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212113 00000100:00100000:0.0:1651529344.694901:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1607:39030:x1731745946522304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.694905:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178561 count 1 00010000:00010000:0.0:1651529344.694908:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c5241f lrc: 3/0,1 mode: --/PW res: [0x2b981:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.694915:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000342b0c35/0x3234de053c4ef05 lrc: 2/0,0 mode: PR/PR res: [0x2b981:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e64 expref: 459 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.694918:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.694919:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.694919:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c5241f lrc: 4/0,1 mode: --/PW res: [0x2b981:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.694925:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000342b0c35/0x3234de053c4ef05 lrc: 3/0,0 mode: PR/PR res: [0x2b981:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e64 expref: 459 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.694928:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000342b0c35/0x3234de053c4ef05 lrc: 4/0,0 mode: PR/PR res: [0x2b981:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e64 expref: 459 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.694932:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002f363f4a pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997041984:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.694939:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 000000000e7e66c4 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.695060:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a9e254e pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997041536:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.695065:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d8c6a7f2/0x3234de053c523ee lrc: 3/0,1 mode: --/PW res: [0x2b97a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.695119:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000673bcbe2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997041664:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.695120:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004be0190 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997041600:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.695123:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000094a0ec28/0x3234de053c523fc lrc: 3/0,1 mode: --/PW res: [0x2b97c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.695125:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c523f5 lrc: 3/0,1 mode: --/PW res: [0x2b97b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.695366:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a9b051f pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997041728:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.695374:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52403 lrc: 3/0,1 mode: --/PW res: [0x2b97d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.695377:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.695386:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.695387:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000027e31dd1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997041856:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.695395:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52411 lrc: 3/0,1 mode: --/PW res: [0x2b97f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.695395:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.695403:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.695406:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396403008 00010000:00010000:1.0:1651529344.695412:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009c96826c/0x3234de053c4cef9 lrc: 4/0,0 mode: PR/PR res: [0x2b97a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cedc4 expref: 460 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.695417:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396403072 00010000:00010000:1.0:1651529344.695419:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009a68b833/0x3234de053c4cbe9 lrc: 4/0,0 mode: PR/PR res: [0x2b97b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce184 expref: 461 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.695421:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.695423:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396403136 00010000:00010000:1.0:1651529344.695425:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c4ecb2 lrc: 4/0,0 mode: PR/PR res: [0x2b97c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d64b6 expref: 462 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.695427:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.695429:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396403200 00010000:00010000:1.0:1651529344.695431:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006967343c/0x3234de053c4d2e2 lrc: 4/0,0 mode: PR/PR res: [0x2b97d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd68 expref: 463 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.695432:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.695435:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396403264 00010000:00010000:1.0:1651529344.695437:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000014ff9ea4/0x3234de053c4ce6d lrc: 5/0,0 mode: PR/PR res: [0x2b97e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cebe8 expref: 464 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.695441:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396403392 00010000:00010000:1.0:1651529344.695444:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002a35c0ca/0x3234de053c4eaf9 lrc: 5/0,0 mode: PR/PR res: [0x2b980:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5daf expref: 465 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.695446:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000037ac96ac pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997041792:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.695447:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396403328 00010000:00010000:1.0:1651529344.695449:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008014f71b/0x3234de053c4dac2 lrc: 4/0,0 mode: PR/PR res: [0x2b97f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b52 expref: 466 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.695450:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000345d04ae/0x3234de053c5240a lrc: 3/0,1 mode: --/PW res: [0x2b97e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.695454:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12888 00000100:00100000:1.0:1651529344.695455:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+466:41278:x1731746396403008:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.695457:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002f77bb41 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997041920:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.695458:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.695459:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009c96826c/0x3234de053c4cef9 lrc: 4/0,0 mode: PR/PR res: [0x2b97a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cedc4 expref: 466 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.695463:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009c96826c/0x3234de053c4cef9 lrc: 3/0,0 mode: PR/PR res: [0x2b97a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cedc4 expref: 466 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.695469:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c96826c/0x3234de053c4cef9 lrc: 0/0,0 mode: --/PR res: [0x2b97a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cedc4 expref: 466 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.695476:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c52418 lrc: 3/0,1 mode: --/PW res: [0x2b980:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.695480:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.695481:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.695482:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d8c6a7f2/0x3234de053c523ee lrc: 3/0,1 mode: PW/PW res: [0x2b97a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.695485:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8c6a7f2/0x3234de053c523ee lrc: 4/0,1 mode: PW/PW res: [0x2b97a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.695485:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002f363f4a pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997041984:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.695488:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c5241f lrc: 3/0,1 mode: --/PW res: [0x2b981:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.695494:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.695500:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12889 00000100:00100000:0.0:1651529344.695501:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+465:41279:x1731746396403072:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.695505:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+465:41278:x1731746396403008:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 49us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.695508:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12888 00010000:00010000:0.0:1651529344.695510:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.695512:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009a68b833/0x3234de053c4cbe9 lrc: 4/0,0 mode: PR/PR res: [0x2b97b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce184 expref: 464 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.695513:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12890 00000100:00100000:1.0:1651529344.695514:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050ef6a3e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+464:41278:x1731746396403136:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.695515:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009a68b833/0x3234de053c4cbe9 lrc: 3/0,0 mode: PR/PR res: [0x2b97b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce184 expref: 464 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.695517:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.695519:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c4ecb2 lrc: 4/0,0 mode: PR/PR res: [0x2b97c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d64b6 expref: 464 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.695521:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a68b833/0x3234de053c4cbe9 lrc: 0/0,0 mode: --/PR res: [0x2b97b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce184 expref: 464 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.695525:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c4ecb2 lrc: 3/0,0 mode: PR/PR res: [0x2b97c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d64b6 expref: 463 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.695525:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.695526:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.695527:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c523f5 lrc: 3/0,1 mode: PW/PW res: [0x2b97b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.695530:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c4ecb2 lrc: 0/0,0 mode: --/PR res: [0x2b97c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d64b6 expref: 463 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.695530:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c523f5 lrc: 4/0,1 mode: PW/PW res: [0x2b97b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.695533:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.695533:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.695534:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000094a0ec28/0x3234de053c523fc lrc: 3/0,1 mode: PW/PW res: [0x2b97c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.695539:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.695543:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094a0ec28/0x3234de053c523fc lrc: 4/0,1 mode: PW/PW res: [0x2b97c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.695546:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+462:41279:x1731746396403072:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 44us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.695549:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12889 00010000:00010000:1.0:1651529344.695552:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.695558:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050ef6a3e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+461:41278:x1731746396403136:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 43us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.695561:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12891 00000100:00100000:1.0:1651529344.695562:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12890 00000100:00100000:0.0:1651529344.695563:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+461:41279:x1731746396403200:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.695565:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.695567:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006967343c/0x3234de053c4d2e2 lrc: 4/0,0 mode: PR/PR res: [0x2b97d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd68 expref: 460 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.695571:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12892 00010000:00010000:0.0:1651529344.695571:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006967343c/0x3234de053c4d2e2 lrc: 3/0,0 mode: PR/PR res: [0x2b97d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd68 expref: 460 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.695573:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+460:41278:x1731746396403264:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.695575:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.695576:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006967343c/0x3234de053c4d2e2 lrc: 0/0,0 mode: --/PR res: [0x2b97d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfd68 expref: 460 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.695577:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000014ff9ea4/0x3234de053c4ce6d lrc: 4/0,0 mode: PR/PR res: [0x2b97e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cebe8 expref: 460 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.695580:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000014ff9ea4/0x3234de053c4ce6d lrc: 3/0,0 mode: PR/PR res: [0x2b97e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cebe8 expref: 460 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.695582:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.695582:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.695583:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52403 lrc: 3/0,1 mode: PW/PW res: [0x2b97d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.695585:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014ff9ea4/0x3234de053c4ce6d lrc: 0/0,0 mode: --/PR res: [0x2b97e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cebe8 expref: 459 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.695586:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52403 lrc: 4/0,1 mode: PW/PW res: [0x2b97d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.695589:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.695589:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.695590:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000345d04ae/0x3234de053c5240a lrc: 3/0,1 mode: PW/PW res: [0x2b97e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.695595:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.695599:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000345d04ae/0x3234de053c5240a lrc: 4/0,1 mode: PW/PW res: [0x2b97e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.695600:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+458:41279:x1731746396403200:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 37us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.695603:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12891 00010000:00010000:1.0:1651529344.695608:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.695613:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+457:41278:x1731746396403264:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 40us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.695613:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12893 00000100:00100000:0.0:1651529344.695615:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+457:41279:x1731746396403392:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.695616:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12892 00010000:00010000:0.0:1651529344.695618:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.695620:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002a35c0ca/0x3234de053c4eaf9 lrc: 4/0,0 mode: PR/PR res: [0x2b980:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5daf expref: 456 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.695621:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12894 00000100:00100000:1.0:1651529344.695622:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+456:41278:x1731746396403328:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.695623:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002a35c0ca/0x3234de053c4eaf9 lrc: 3/0,0 mode: PR/PR res: [0x2b980:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5daf expref: 456 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.695625:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.695626:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008014f71b/0x3234de053c4dac2 lrc: 4/0,0 mode: PR/PR res: [0x2b97f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b52 expref: 456 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.695628:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a35c0ca/0x3234de053c4eaf9 lrc: 0/0,0 mode: --/PR res: [0x2b980:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5daf expref: 456 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.695630:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008014f71b/0x3234de053c4dac2 lrc: 3/0,0 mode: PR/PR res: [0x2b97f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b52 expref: 456 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.695631:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.695632:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.695633:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c52418 lrc: 3/0,1 mode: PW/PW res: [0x2b980:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.695635:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008014f71b/0x3234de053c4dac2 lrc: 0/0,0 mode: --/PR res: [0x2b97f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b52 expref: 455 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.695636:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c52418 lrc: 4/0,1 mode: PW/PW res: [0x2b980:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.695640:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.695641:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.695641:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52411 lrc: 3/0,1 mode: PW/PW res: [0x2b97f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.695641:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.695644:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52411 lrc: 4/0,1 mode: PW/PW res: [0x2b97f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.695646:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+454:41279:x1731746396403392:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 31us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.695649:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12893 00010000:00010000:1.0:1651529344.695650:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.695655:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+453:41278:x1731746396403328:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 32us (223us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.695655:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000094a0ec28/0x3234de053c523fc lrc: 3/0,1 mode: PW/PW res: [0x2b97c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.695657:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12894 00010000:00010000:0.0:1651529344.695658:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094a0ec28/0x3234de053c523fc lrc: 3/0,1 mode: PW/PW res: [0x2b97c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.695661:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094a0ec28/0x3234de053c523fc lrc: 3/0,1 mode: PW/PW res: [0x2b97c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.695664:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c523f5 lrc: 3/0,1 mode: PW/PW res: [0x2b97b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.695664:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094a0ec28/0x3234de053c523fc lrc: 2/0,0 mode: PW/PW res: [0x2b97c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.695667:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c523f5 lrc: 3/0,1 mode: PW/PW res: [0x2b97b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.695671:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c523f5 lrc: 3/0,1 mode: PW/PW res: [0x2b97b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.695673:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c523f5 lrc: 2/0,0 mode: PW/PW res: [0x2b97b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.695711:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1609:39030:x1731745946521984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 951us (1063us total) trans 12885080161 rc 0/0 00000100:00100000:0.0:1651529344.695715:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212108 00000100:00100000:1.0:1651529344.695716:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1609:39029:x1731745946521920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 993us (1088us total) trans 12885080162 rc 0/0 00000100:00100000:1.0:1651529344.695719:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212107 00010000:00010000:0.0:1651529344.695722:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000345d04ae/0x3234de053c5240a lrc: 3/0,1 mode: PW/PW res: [0x2b97e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.695727:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52403 lrc: 3/0,1 mode: PW/PW res: [0x2b97d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.695727:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000345d04ae/0x3234de053c5240a lrc: 3/0,1 mode: PW/PW res: [0x2b97e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.695730:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52403 lrc: 3/0,1 mode: PW/PW res: [0x2b97d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.695730:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000345d04ae/0x3234de053c5240a lrc: 3/0,1 mode: PW/PW res: [0x2b97e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.695733:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52403 lrc: 3/0,1 mode: PW/PW res: [0x2b97d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.695733:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000345d04ae/0x3234de053c5240a lrc: 2/0,0 mode: PW/PW res: [0x2b97e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.695745:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52403 lrc: 2/0,0 mode: PW/PW res: [0x2b97d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.695782:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1609:39030:x1731745946522112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 973us (1105us total) trans 12885080163 rc 0/0 00000100:00100000:1.0:1651529344.695784:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1609:39029:x1731745946522048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 994us (1114us total) trans 12885080164 rc 0/0 00000100:00100000:0.0:1651529344.695785:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212110 00000100:00100000:1.0:1651529344.695787:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212109 00010000:00010000:0.0:1651529344.695792:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c52418 lrc: 3/0,1 mode: PW/PW res: [0x2b980:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.695794:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52411 lrc: 3/0,1 mode: PW/PW res: [0x2b97f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.695795:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c52418 lrc: 3/0,1 mode: PW/PW res: [0x2b980:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.695797:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52411 lrc: 3/0,1 mode: PW/PW res: [0x2b97f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.695798:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c52418 lrc: 3/0,1 mode: PW/PW res: [0x2b980:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.695800:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52411 lrc: 3/0,1 mode: PW/PW res: [0x2b97f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.695801:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c52418 lrc: 2/0,0 mode: PW/PW res: [0x2b980:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.695803:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52411 lrc: 2/0,0 mode: PW/PW res: [0x2b97f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.695830:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1609:39030:x1731745946522240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 980us (1139us total) trans 12885080165 rc 0/0 00000100:00100000:1.0:1651529344.695833:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1609:39029:x1731745946522176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 998us (1148us total) trans 12885080166 rc 0/0 00000100:00100000:0.0:1651529344.695835:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212112 00000100:00100000:1.0:1651529344.695836:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212111 00010000:00010000:0.0:1651529344.695841:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094a0ec28/0x3234de053c523fc lrc: 2/0,0 mode: PW/PW res: [0x2b97c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.695845:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000094a0ec28 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.695846:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094a0ec28/0x3234de053c523fc lrc: 2/0,0 mode: PW/PW res: [0x2b97c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.695848:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094a0ec28/0x3234de053c523fc lrc: 3/0,0 mode: PW/PW res: [0x2b97c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.695853:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094a0ec28/0x3234de053c523fc lrc: 1/0,0 mode: --/PW res: [0x2b97c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.695856:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094a0ec28/0x3234de053c523fc lrc: 0/0,0 mode: --/PW res: [0x2b97c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.695860:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c523f5 lrc: 2/0,0 mode: PW/PW res: [0x2b97b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.695862:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000576f1f12 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.695863:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.695863:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c523f5 lrc: 2/0,0 mode: PW/PW res: [0x2b97b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.695866:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c523f5 lrc: 3/0,0 mode: PW/PW res: [0x2b97b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.695871:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c523f5 lrc: 1/0,0 mode: --/PW res: [0x2b97b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.695874:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c523f5 lrc: 0/0,0 mode: --/PW res: [0x2b97b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.695878:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000345d04ae/0x3234de053c5240a lrc: 2/0,0 mode: PW/PW res: [0x2b97e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.695880:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000345d04ae already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.695881:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000345d04ae/0x3234de053c5240a lrc: 2/0,0 mode: PW/PW res: [0x2b97e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.695884:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000345d04ae/0x3234de053c5240a lrc: 3/0,0 mode: PW/PW res: [0x2b97e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.695887:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000345d04ae/0x3234de053c5240a lrc: 1/0,0 mode: --/PW res: [0x2b97e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.695889:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000345d04ae/0x3234de053c5240a lrc: 0/0,0 mode: --/PW res: [0x2b97e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.695893:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52403 lrc: 2/0,0 mode: PW/PW res: [0x2b97d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.695895:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001391dc6d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.695896:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52403 lrc: 2/0,0 mode: PW/PW res: [0x2b97d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.695899:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52403 lrc: 3/0,0 mode: PW/PW res: [0x2b97d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.695902:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52403 lrc: 1/0,0 mode: --/PW res: [0x2b97d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.695904:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52403 lrc: 0/0,0 mode: --/PW res: [0x2b97d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.695908:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c52418 lrc: 2/0,0 mode: PW/PW res: [0x2b980:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.695910:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001c46cc6d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.695911:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c52418 lrc: 2/0,0 mode: PW/PW res: [0x2b980:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.695913:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c52418 lrc: 3/0,0 mode: PW/PW res: [0x2b980:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.695916:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c52418 lrc: 1/0,0 mode: --/PW res: [0x2b980:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.695919:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c46cc6d/0x3234de053c52418 lrc: 0/0,0 mode: --/PW res: [0x2b980:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.695922:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52411 lrc: 2/0,0 mode: PW/PW res: [0x2b97f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.695925:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006401eb97 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.695926:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52411 lrc: 2/0,0 mode: PW/PW res: [0x2b97f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.695929:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52411 lrc: 3/0,0 mode: PW/PW res: [0x2b97f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.695932:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52411 lrc: 1/0,0 mode: --/PW res: [0x2b97f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.695934:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52411 lrc: 0/0,0 mode: --/PW res: [0x2b97f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.695940:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d8c6a7f2/0x3234de053c523ee lrc: 3/0,1 mode: PW/PW res: [0x2b97a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.695943:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8c6a7f2/0x3234de053c523ee lrc: 3/0,1 mode: PW/PW res: [0x2b97a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.695946:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8c6a7f2/0x3234de053c523ee lrc: 3/0,1 mode: PW/PW res: [0x2b97a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.695948:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8c6a7f2/0x3234de053c523ee lrc: 2/0,0 mode: PW/PW res: [0x2b97a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.695970:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396403456 00010000:00010000:1.0:1651529344.695976:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000342b0c35/0x3234de053c4ef05 lrc: 4/0,0 mode: PR/PR res: [0x2b981:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e64 expref: 453 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.695991:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12895 00000100:00100000:1.0:1651529344.695993:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+453:41279:x1731746396403456:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.695996:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.695997:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000342b0c35/0x3234de053c4ef05 lrc: 4/0,0 mode: PR/PR res: [0x2b981:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e64 expref: 453 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.696001:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000342b0c35/0x3234de053c4ef05 lrc: 3/0,0 mode: PR/PR res: [0x2b981:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e64 expref: 453 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.696006:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1608:39030:x1731745946521856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1347us (1395us total) trans 12885080167 rc 0/0 00010000:00010000:1.0:1651529344.696007:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000342b0c35/0x3234de053c4ef05 lrc: 0/0,0 mode: --/PR res: [0x2b981:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6e64 expref: 453 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.696009:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212106 00010000:00010000:1.0:1651529344.696010:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.696011:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.696012:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c5241f lrc: 3/0,1 mode: PW/PW res: [0x2b981:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.696015:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c5241f lrc: 4/0,1 mode: PW/PW res: [0x2b981:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.696017:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8c6a7f2/0x3234de053c523ee lrc: 2/0,0 mode: PW/PW res: [0x2b97a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.696020:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d8c6a7f2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.696022:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8c6a7f2/0x3234de053c523ee lrc: 2/0,0 mode: PW/PW res: [0x2b97a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.696025:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.696030:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8c6a7f2/0x3234de053c523ee lrc: 3/0,0 mode: PW/PW res: [0x2b97a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.696032:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+452:41279:x1731746396403456:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 38us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.696035:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12895 00010000:00010000:0.0:1651529344.696035:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8c6a7f2/0x3234de053c523ee lrc: 1/0,0 mode: --/PW res: [0x2b97a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.696038:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8c6a7f2/0x3234de053c523ee lrc: 0/0,0 mode: --/PW res: [0x2b97a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.696044:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c5241f lrc: 3/0,1 mode: PW/PW res: [0x2b981:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.696047:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c5241f lrc: 3/0,1 mode: PW/PW res: [0x2b981:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.696050:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c5241f lrc: 3/0,1 mode: PW/PW res: [0x2b981:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.696053:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c5241f lrc: 2/0,0 mode: PW/PW res: [0x2b981:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.696104:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1608:39030:x1731745946522304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1202us (1218us total) trans 12885080168 rc 0/0 00000100:00100000:0.0:1651529344.696107:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212113 00010000:00010000:0.0:1651529344.696114:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c5241f lrc: 2/0,0 mode: PW/PW res: [0x2b981:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.696117:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000015737583 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.696119:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c5241f lrc: 2/0,0 mode: PW/PW res: [0x2b981:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.696121:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c5241f lrc: 3/0,0 mode: PW/PW res: [0x2b981:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.696148:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.696158:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c5241f lrc: 1/0,0 mode: --/PW res: [0x2b981:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.696161:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015737583/0x3234de053c5241f lrc: 0/0,0 mode: --/PW res: [0x2b981:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.696175:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.696183:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946522432 00000100:00100000:1.0:1651529344.696185:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.696191:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946522368 00000100:00100000:1.0:1651529344.696192:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.696204:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946522560 00000100:00100000:0.0:1651529344.696211:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946522496 00000100:00100000:1.0:1651529344.696214:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.696215:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212114 00000100:00100000:0.0:1651529344.696217:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1611:39029:x1731745946522432:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.696238:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.696239:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178563 count 1 00010000:00010000:0.0:1651529344.696243:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1848133/0x3234de053c52426 lrc: 3/0,1 mode: --/PW res: [0x2b983:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.696246:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946522624 00010000:00010000:0.0:1651529344.696248:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000486c27d2/0x3234de053c4a28a lrc: 2/0,0 mode: PR/PR res: [0x2b983:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb998 expref: 451 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.696251:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.696252:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946522688 00010000:00010000:0.0:1651529344.696252:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.696253:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1848133/0x3234de053c52426 lrc: 4/0,1 mode: --/PW res: [0x2b983:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.696256:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212115 00000100:00100000:1.0:1651529344.696258:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000241b8252 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1613:39030:x1731745946522368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.696260:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000486c27d2/0x3234de053c4a28a lrc: 3/0,0 mode: PR/PR res: [0x2b983:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb998 expref: 451 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.696263:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178562 count 1 00010000:00010000:0.0:1651529344.696263:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000486c27d2/0x3234de053c4a28a lrc: 4/0,0 mode: PR/PR res: [0x2b983:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb998 expref: 451 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.696267:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c5242d lrc: 3/0,1 mode: --/PW res: [0x2b982:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.696268:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fc130417 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997042048:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.696272:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000052c5136b/0x3234de053c4f4bc lrc: 2/0,0 mode: PR/PR res: [0x2b982:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8586 expref: 451 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.696275:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.696276:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.696277:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c5242d lrc: 4/0,1 mode: --/PW res: [0x2b982:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.696291:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000052c5136b/0x3234de053c4f4bc lrc: 3/0,0 mode: PR/PR res: [0x2b982:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8586 expref: 451 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.696294:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000052c5136b/0x3234de053c4f4bc lrc: 4/0,0 mode: PR/PR res: [0x2b982:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8586 expref: 451 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.696299:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000913beefe pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997042112:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.696310:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed830649 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.696316:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000412e5d26 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.696317:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212116 00000100:00100000:0.0:1651529344.696319:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1613:39029:x1731745946522560:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.696323:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212117 00002000:00080000:0.0:1651529344.696324:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178565 count 1 00000100:00100000:1.0:1651529344.696325:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1613:39030:x1731745946522496:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.696328:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052977309/0x3234de053c52434 lrc: 3/0,1 mode: --/PW res: [0x2b985:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.696329:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178564 count 1 00010000:00010000:0.0:1651529344.696332:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006cdb6dc5/0x3234de053c4eb15 lrc: 2/0,0 mode: PR/PR res: [0x2b985:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e18 expref: 451 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.696333:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5243b lrc: 3/0,1 mode: --/PW res: [0x2b984:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.696337:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a27208a5/0x3234de053c4b9ac lrc: 2/0,0 mode: PR/PR res: [0x2b984:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc47a expref: 451 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.696338:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.696339:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.696339:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052977309/0x3234de053c52434 lrc: 4/0,1 mode: --/PW res: [0x2b985:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.696340:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.696341:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.696341:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5243b lrc: 4/0,1 mode: --/PW res: [0x2b984:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.696345:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006cdb6dc5/0x3234de053c4eb15 lrc: 3/0,0 mode: PR/PR res: [0x2b985:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e18 expref: 451 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.696347:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a27208a5/0x3234de053c4b9ac lrc: 3/0,0 mode: PR/PR res: [0x2b984:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc47a expref: 451 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.696349:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006cdb6dc5/0x3234de053c4eb15 lrc: 4/0,0 mode: PR/PR res: [0x2b985:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e18 expref: 451 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.696351:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a27208a5/0x3234de053c4b9ac lrc: 4/0,0 mode: PR/PR res: [0x2b984:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc47a expref: 451 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.696353:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000117fbeca pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997042176:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.696355:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000012863683 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997042240:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.696361:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b81e4a0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.696363:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 0000000071742acc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.696367:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212118 00000100:00100000:0.0:1651529344.696368:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1613:39030:x1731745946522624:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.696369:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212119 00000100:00100000:1.0:1651529344.696371:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1613:39030:x1731745946522688:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.696372:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178566 count 1 00002000:00080000:1.0:1651529344.696374:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178567 count 1 00010000:00010000:0.0:1651529344.696375:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a2a8776/0x3234de053c52442 lrc: 3/0,1 mode: --/PW res: [0x2b986:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.696377:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52449 lrc: 3/0,1 mode: --/PW res: [0x2b987:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.696379:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d78ee3b1/0x3234de053c4b871 lrc: 2/0,0 mode: PR/PR res: [0x2b986:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc3d9 expref: 451 pid: 80278 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.696381:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000064ba86ec/0x3234de053c4d87d lrc: 2/0,0 mode: PR/PR res: [0x2b987:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d12d8 expref: 451 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.696383:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.696383:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.696384:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.696384:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a2a8776/0x3234de053c52442 lrc: 4/0,1 mode: --/PW res: [0x2b986:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.696385:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.696386:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52449 lrc: 4/0,1 mode: --/PW res: [0x2b987:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.696391:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000064ba86ec/0x3234de053c4d87d lrc: 3/0,0 mode: PR/PR res: [0x2b987:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d12d8 expref: 451 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.696392:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d78ee3b1/0x3234de053c4b871 lrc: 3/0,0 mode: PR/PR res: [0x2b986:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc3d9 expref: 451 pid: 80278 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.696394:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000064ba86ec/0x3234de053c4d87d lrc: 4/0,0 mode: PR/PR res: [0x2b987:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d12d8 expref: 451 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.696396:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d78ee3b1/0x3234de053c4b871 lrc: 4/0,0 mode: PR/PR res: [0x2b986:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc3d9 expref: 451 pid: 80278 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.696398:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000023afca5e pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997042304:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.696399:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000824ca843 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997042368:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.696404:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aeda71fe going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.696405:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000003c8b0daf going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.696419:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.696432:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.696438:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946522752 00000100:00100000:1.0:1651529344.696454:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946522816 00000100:00100000:1.0:1651529344.696460:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212120 00000100:00100000:1.0:1651529344.696461:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1615:39030:x1731745946522752:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.696468:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212121 00000100:00100000:0.0:1651529344.696470:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1615:39029:x1731745946522816:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.696473:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178568 count 1 00002000:00080000:0.0:1651529344.696475:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178569 count 1 00010000:00010000:1.0:1651529344.696477:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52450 lrc: 3/0,1 mode: --/PW res: [0x2b988:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.696479:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c52457 lrc: 3/0,1 mode: --/PW res: [0x2b989:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.696482:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d22778db/0x3234de053c4d3c9 lrc: 2/0,0 mode: PR/PR res: [0x2b988:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00fd expref: 451 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.696485:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.696485:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.696486:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52450 lrc: 4/0,1 mode: --/PW res: [0x2b988:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.696493:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d22778db/0x3234de053c4d3c9 lrc: 3/0,0 mode: PR/PR res: [0x2b988:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00fd expref: 451 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.696496:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d22778db/0x3234de053c4d3c9 lrc: 4/0,0 mode: PR/PR res: [0x2b988:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00fd expref: 451 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.696498:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d7211b41/0x3234de053c4e5f8 lrc: 2/0,0 mode: PR/PR res: [0x2b989:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d492d expref: 451 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.696500:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a9b051f pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997042432:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.696502:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.696502:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.696503:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c52457 lrc: 4/0,1 mode: --/PW res: [0x2b989:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.696510:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b52d0f36 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.696510:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d7211b41/0x3234de053c4e5f8 lrc: 3/0,0 mode: PR/PR res: [0x2b989:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d492d expref: 451 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.696514:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d7211b41/0x3234de053c4e5f8 lrc: 4/0,0 mode: PR/PR res: [0x2b989:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d492d expref: 451 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.696518:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ebb53b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997042496:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.696526:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 000000000d706dff going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.696915:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000913beefe pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997042112:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.696919:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c5242d lrc: 3/0,1 mode: --/PW res: [0x2b982:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.696955:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000023afca5e pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997042304:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.696957:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.696959:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52449 lrc: 3/0,1 mode: --/PW res: [0x2b987:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.696967:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.696975:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.696977:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000012863683 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997042240:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.696984:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5243b lrc: 3/0,1 mode: --/PW res: [0x2b984:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.696990:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396403584 00000100:00100000:0.0:1651529344.696992:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.696995:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000486c27d2/0x3234de053c4a28a lrc: 5/0,0 mode: PR/PR res: [0x2b983:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb998 expref: 452 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.697001:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396403712 00010000:00010000:1.0:1651529344.697003:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a27208a5/0x3234de053c4b9ac lrc: 4/0,0 mode: PR/PR res: [0x2b984:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc47a expref: 453 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.697007:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396403520 00010000:00010000:1.0:1651529344.697009:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000052c5136b/0x3234de053c4f4bc lrc: 4/0,0 mode: PR/PR res: [0x2b982:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8586 expref: 454 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.697011:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.697016:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.697022:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396403840 00010000:00010000:1.0:1651529344.697029:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d78ee3b1/0x3234de053c4b871 lrc: 5/0,0 mode: PR/PR res: [0x2b986:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc3d9 expref: 455 pid: 80278 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.697032:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.697034:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396403648 00010000:00010000:1.0:1651529344.697036:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006cdb6dc5/0x3234de053c4eb15 lrc: 5/0,0 mode: PR/PR res: [0x2b985:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e18 expref: 456 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.697039:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.697041:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396403776 00010000:00010000:1.0:1651529344.697043:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000064ba86ec/0x3234de053c4d87d lrc: 4/0,0 mode: PR/PR res: [0x2b987:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d12d8 expref: 457 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.697047:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396403904 00000100:00100000:0.0:1651529344.697047:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000117fbeca pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997042176:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.697049:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d22778db/0x3234de053c4d3c9 lrc: 5/0,0 mode: PR/PR res: [0x2b988:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00fd expref: 458 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.697052:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000052977309/0x3234de053c52434 lrc: 3/0,1 mode: --/PW res: [0x2b985:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.697053:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396403968 00010000:00010000:1.0:1651529344.697055:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d7211b41/0x3234de053c4e5f8 lrc: 5/0,0 mode: PR/PR res: [0x2b989:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d492d expref: 459 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.697059:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12896 00000100:00100000:0.0:1651529344.697059:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000824ca843 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997042368:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.697060:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+459:41279:x1731746396403584:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.697061:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005a2a8776/0x3234de053c52442 lrc: 3/0,1 mode: --/PW res: [0x2b986:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.697063:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.697064:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000486c27d2/0x3234de053c4a28a lrc: 5/0,0 mode: PR/PR res: [0x2b983:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb998 expref: 459 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.697067:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ebb53b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997042496:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.697068:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000486c27d2/0x3234de053c4a28a lrc: 4/0,0 mode: PR/PR res: [0x2b983:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb998 expref: 459 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.697069:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c52457 lrc: 3/0,1 mode: --/PW res: [0x2b989:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.697074:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.697074:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.697075:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b1848133/0x3234de053c52426 lrc: 3/0,1 mode: PW/PW res: [0x2b983:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.697075:0:151609:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000486c27d2/0x3234de053c4a28a lrc: 0/0,0 mode: --/PR res: [0x2b983:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb998 expref: 459 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.697078:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1848133/0x3234de053c52426 lrc: 4/0,1 mode: PW/PW res: [0x2b983:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.697082:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fc130417 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997042048:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.697083:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.697084:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b1848133/0x3234de053c52426 lrc: 3/0,1 mode: PW/PW res: [0x2b983:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.697087:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b1848133/0x3234de053c52426 lrc: 3/0,1 mode: PW/PW res: [0x2b983:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.697090:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1848133/0x3234de053c52426 lrc: 3/0,1 mode: PW/PW res: [0x2b983:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.697092:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+458:41279:x1731746396403584:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 31us (136us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.697093:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1848133/0x3234de053c52426 lrc: 3/0,1 mode: PW/PW res: [0x2b983:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.697095:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12896 00010000:00010000:0.0:1651529344.697096:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b1848133/0x3234de053c52426 lrc: 2/0,0 mode: PW/PW res: [0x2b983:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.697099:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12897 00000100:00100000:1.0:1651529344.697101:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cd5e5a1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+457:41279:x1731746396403712:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.697103:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.697104:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a27208a5/0x3234de053c4b9ac lrc: 4/0,0 mode: PR/PR res: [0x2b984:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc47a expref: 457 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.697108:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a27208a5/0x3234de053c4b9ac lrc: 3/0,0 mode: PR/PR res: [0x2b984:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc47a expref: 457 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.697112:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a27208a5/0x3234de053c4b9ac lrc: 0/0,0 mode: --/PR res: [0x2b984:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc47a expref: 457 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.697116:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.697116:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.697117:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5243b lrc: 3/0,1 mode: PW/PW res: [0x2b984:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.697120:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5243b lrc: 4/0,1 mode: PW/PW res: [0x2b984:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.697125:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.697129:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cd5e5a1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+456:41279:x1731746396403712:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 28us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.697131:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12897 00000100:00100000:0.0:1651529344.697138:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1616:39029:x1731745946522432:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 920us (990us total) trans 12885080169 rc 0/0 00000100:00100000:1.0:1651529344.697139:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12898 00000100:00100000:1.0:1651529344.697141:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+455:41278:x1731746396403520:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.697141:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212114 00010000:00010000:1.0:1651529344.697143:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.697144:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000052c5136b/0x3234de053c4f4bc lrc: 4/0,0 mode: PR/PR res: [0x2b982:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8586 expref: 455 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.697148:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000052c5136b/0x3234de053c4f4bc lrc: 3/0,0 mode: PR/PR res: [0x2b982:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8586 expref: 455 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.697148:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b1848133/0x3234de053c52426 lrc: 2/0,0 mode: PW/PW res: [0x2b983:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.697151:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b1848133 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.697152:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052c5136b/0x3234de053c4f4bc lrc: 0/0,0 mode: --/PR res: [0x2b982:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8586 expref: 455 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.697152:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1848133/0x3234de053c52426 lrc: 2/0,0 mode: PW/PW res: [0x2b983:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.697155:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.697156:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.697156:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c5242d lrc: 3/0,1 mode: PW/PW res: [0x2b982:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.697157:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1848133/0x3234de053c52426 lrc: 3/0,0 mode: PW/PW res: [0x2b983:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.697159:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c5242d lrc: 4/0,1 mode: PW/PW res: [0x2b982:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.697162:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b1848133/0x3234de053c52426 lrc: 1/0,0 mode: --/PW res: [0x2b983:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.697165:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.697165:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1848133/0x3234de053c52426 lrc: 0/0,0 mode: --/PW res: [0x2b983:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.697169:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+454:41278:x1731746396403520:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 28us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.697171:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12898 00000100:00100000:1.0:1651529344.697175:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12899 00000100:00100000:1.0:1651529344.697176:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+453:41279:x1731746396403840:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.697178:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.697179:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d78ee3b1/0x3234de053c4b871 lrc: 4/0,0 mode: PR/PR res: [0x2b986:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc3d9 expref: 453 pid: 80278 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.697183:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d78ee3b1/0x3234de053c4b871 lrc: 3/0,0 mode: PR/PR res: [0x2b986:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc3d9 expref: 453 pid: 80278 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.697187:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d78ee3b1/0x3234de053c4b871 lrc: 0/0,0 mode: --/PR res: [0x2b986:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc3d9 expref: 453 pid: 80278 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.697190:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.697191:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.697191:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005a2a8776/0x3234de053c52442 lrc: 3/0,1 mode: PW/PW res: [0x2b986:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.697194:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a2a8776/0x3234de053c52442 lrc: 4/0,1 mode: PW/PW res: [0x2b986:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.697215:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.697215:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12900 00000100:00100000:0.0:1651529344.697217:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+452:41278:x1731746396403648:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.697221:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.697234:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+452:41279:x1731746396403840:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 57us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.697237:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12899 00010000:00010000:0.0:1651529344.697242:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006cdb6dc5/0x3234de053c4eb15 lrc: 4/0,0 mode: PR/PR res: [0x2b985:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e18 expref: 452 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.697246:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006cdb6dc5/0x3234de053c4eb15 lrc: 3/0,0 mode: PR/PR res: [0x2b985:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e18 expref: 451 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.697247:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12901 00000100:00100000:1.0:1651529344.697248:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+451:41278:x1731746396403776:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.697251:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.697252:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cdb6dc5/0x3234de053c4eb15 lrc: 0/0,0 mode: --/PR res: [0x2b985:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e18 expref: 451 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.697253:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000064ba86ec/0x3234de053c4d87d lrc: 4/0,0 mode: PR/PR res: [0x2b987:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d12d8 expref: 451 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.697256:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.697257:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000064ba86ec/0x3234de053c4d87d lrc: 3/0,0 mode: PR/PR res: [0x2b987:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d12d8 expref: 450 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.697257:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.697257:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000052977309/0x3234de053c52434 lrc: 3/0,1 mode: PW/PW res: [0x2b985:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.697262:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064ba86ec/0x3234de053c4d87d lrc: 0/0,0 mode: --/PR res: [0x2b987:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d12d8 expref: 450 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.697263:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052977309/0x3234de053c52434 lrc: 4/0,1 mode: PW/PW res: [0x2b985:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.697266:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.697266:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.697267:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52449 lrc: 3/0,1 mode: PW/PW res: [0x2b987:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.697270:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52449 lrc: 4/0,1 mode: PW/PW res: [0x2b987:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.697270:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.697276:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.697277:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+449:41278:x1731746396403648:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 59us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.697280:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12900 00000100:00100000:1.0:1651529344.697281:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+449:41278:x1731746396403776:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 32us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.697284:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12901 00000100:00100000:0.0:1651529344.697286:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12902 00000100:00100000:1.0:1651529344.697288:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12903 00000100:00100000:0.0:1651529344.697288:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+447:41278:x1731746396403904:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.697290:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+447:41279:x1731746396403968:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.697290:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.697292:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.697292:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d22778db/0x3234de053c4d3c9 lrc: 5/0,0 mode: PR/PR res: [0x2b988:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00fd expref: 447 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.697293:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d7211b41/0x3234de053c4e5f8 lrc: 4/0,0 mode: PR/PR res: [0x2b989:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d492d expref: 447 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.697295:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d22778db/0x3234de053c4d3c9 lrc: 4/0,0 mode: PR/PR res: [0x2b988:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00fd expref: 447 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.697297:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d7211b41/0x3234de053c4e5f8 lrc: 3/0,0 mode: PR/PR res: [0x2b989:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d492d expref: 447 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.697300:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.697301:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7211b41/0x3234de053c4e5f8 lrc: 0/0,0 mode: --/PR res: [0x2b989:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d492d expref: 447 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.697301:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.697301:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52450 lrc: 3/0,1 mode: PW/PW res: [0x2b988:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.697304:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52450 lrc: 4/0,1 mode: PW/PW res: [0x2b988:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.697307:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.697308:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.697308:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c52457 lrc: 3/0,1 mode: PW/PW res: [0x2b989:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.697308:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.697311:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c52457 lrc: 4/0,1 mode: PW/PW res: [0x2b989:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.697320:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.697325:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+446:41279:x1731746396403968:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.697327:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12903 00000100:00100000:0.0:1651529344.697336:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+445:41278:x1731746396403904:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 47us (303us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.697338:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52449 lrc: 3/0,1 mode: PW/PW res: [0x2b987:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.697339:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12902 00010000:00010000:1.0:1651529344.697341:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52449 lrc: 3/0,1 mode: PW/PW res: [0x2b987:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.697344:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52449 lrc: 3/0,1 mode: PW/PW res: [0x2b987:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.697346:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52449 lrc: 2/0,0 mode: PW/PW res: [0x2b987:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.697346:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005a2a8776/0x3234de053c52442 lrc: 3/0,1 mode: PW/PW res: [0x2b986:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.697350:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a2a8776/0x3234de053c52442 lrc: 3/0,1 mode: PW/PW res: [0x2b986:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.697364:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a2a8776/0x3234de053c52442 lrc: 3/0,1 mode: PW/PW res: [0x2b986:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.697367:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a2a8776/0x3234de053c52442 lrc: 2/0,0 mode: PW/PW res: [0x2b986:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.697389:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1617:39030:x1731745946522688:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1018us (1167us total) trans 12885080170 rc 0/0 00000100:00100000:1.0:1651529344.697393:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212119 00010000:00010000:1.0:1651529344.697400:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5243b lrc: 3/0,1 mode: PW/PW res: [0x2b984:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.697403:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5243b lrc: 3/0,1 mode: PW/PW res: [0x2b984:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.697406:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5243b lrc: 3/0,1 mode: PW/PW res: [0x2b984:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.697407:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1616:39030:x1731745946522624:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1038us (1197us total) trans 12885080171 rc 0/0 00010000:00010000:1.0:1651529344.697409:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5243b lrc: 2/0,0 mode: PW/PW res: [0x2b984:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.697410:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212118 00010000:00010000:0.0:1651529344.697425:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000052977309/0x3234de053c52434 lrc: 3/0,1 mode: PW/PW res: [0x2b985:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.697429:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052977309/0x3234de053c52434 lrc: 3/0,1 mode: PW/PW res: [0x2b985:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.697432:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052977309/0x3234de053c52434 lrc: 3/0,1 mode: PW/PW res: [0x2b985:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.697434:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000052977309/0x3234de053c52434 lrc: 2/0,0 mode: PW/PW res: [0x2b985:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.697446:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1616:39030:x1731745946522496:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1121us (1253us total) trans 12885080172 rc 0/0 00000100:00100000:1.0:1651529344.697449:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212117 00010000:00010000:1.0:1651529344.697455:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c5242d lrc: 3/0,1 mode: PW/PW res: [0x2b982:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.697458:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c5242d lrc: 3/0,1 mode: PW/PW res: [0x2b982:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.697461:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c5242d lrc: 3/0,1 mode: PW/PW res: [0x2b982:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.697464:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c5242d lrc: 2/0,0 mode: PW/PW res: [0x2b982:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.697470:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1616:39029:x1731745946522560:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1150us (1284us total) trans 12885080173 rc 0/0 00000100:00100000:0.0:1651529344.697473:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212116 00010000:00010000:0.0:1651529344.697479:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c52457 lrc: 3/0,1 mode: PW/PW res: [0x2b989:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.697483:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c52457 lrc: 3/0,1 mode: PW/PW res: [0x2b989:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.697486:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c52457 lrc: 3/0,1 mode: PW/PW res: [0x2b989:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.697489:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c52457 lrc: 2/0,0 mode: PW/PW res: [0x2b989:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.697493:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000241b8252 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1616:39030:x1731745946522368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1235us (1319us total) trans 12885080174 rc 0/0 00000100:00100000:1.0:1651529344.697496:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212115 00010000:00010000:1.0:1651529344.697518:0:72397:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d22778db/0x3234de053c4d3c9 lrc: 0/0,0 mode: --/PR res: [0x2b988:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00fd expref: 444 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.697518:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1616:39029:x1731745946522816:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1048us (1086us total) trans 12885080175 rc 0/0 00000100:00100000:0.0:1651529344.697521:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212121 00000100:00100000:1.0:1651529344.697522:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a9b051f pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997042432:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.697526:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52450 lrc: 3/0,1 mode: PW/PW res: [0x2b988:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.697527:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52449 lrc: 2/0,0 mode: PW/PW res: [0x2b987:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.697529:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52450 lrc: 3/0,1 mode: PW/PW res: [0x2b988:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.697530:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fafb79d3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.697531:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52449 lrc: 2/0,0 mode: PW/PW res: [0x2b987:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.697532:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52450 lrc: 3/0,1 mode: PW/PW res: [0x2b988:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.697534:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52449 lrc: 3/0,0 mode: PW/PW res: [0x2b987:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.697535:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52450 lrc: 3/0,1 mode: PW/PW res: [0x2b988:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.697538:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52450 lrc: 2/0,0 mode: PW/PW res: [0x2b988:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.697539:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52449 lrc: 1/0,0 mode: --/PW res: [0x2b987:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.697542:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52449 lrc: 0/0,0 mode: --/PW res: [0x2b987:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.697546:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a2a8776/0x3234de053c52442 lrc: 2/0,0 mode: PW/PW res: [0x2b986:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.697548:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005a2a8776 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.697549:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a2a8776/0x3234de053c52442 lrc: 2/0,0 mode: PW/PW res: [0x2b986:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.697552:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a2a8776/0x3234de053c52442 lrc: 3/0,0 mode: PW/PW res: [0x2b986:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.697555:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a2a8776/0x3234de053c52442 lrc: 1/0,0 mode: --/PW res: [0x2b986:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.697558:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a2a8776/0x3234de053c52442 lrc: 0/0,0 mode: --/PW res: [0x2b986:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.697561:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5243b lrc: 2/0,0 mode: PW/PW res: [0x2b984:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.697564:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f0bd9bfb already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.697564:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5243b lrc: 2/0,0 mode: PW/PW res: [0x2b984:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.697567:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5243b lrc: 3/0,0 mode: PW/PW res: [0x2b984:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.697569:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1616:39030:x1731745946522752:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1107us (1150us total) trans 12885080176 rc 0/0 00010000:00010000:0.0:1651529344.697571:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5243b lrc: 1/0,0 mode: --/PW res: [0x2b984:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.697572:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212120 00010000:00010000:0.0:1651529344.697573:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5243b lrc: 0/0,0 mode: --/PW res: [0x2b984:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.697576:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000052977309/0x3234de053c52434 lrc: 2/0,0 mode: PW/PW res: [0x2b985:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.697579:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000052977309 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.697580:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000052977309/0x3234de053c52434 lrc: 2/0,0 mode: PW/PW res: [0x2b985:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.697582:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000052977309/0x3234de053c52434 lrc: 3/0,0 mode: PW/PW res: [0x2b985:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.697585:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000052977309/0x3234de053c52434 lrc: 1/0,0 mode: --/PW res: [0x2b985:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.697587:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.697588:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052977309/0x3234de053c52434 lrc: 0/0,0 mode: --/PW res: [0x2b985:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.697591:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c5242d lrc: 2/0,0 mode: PW/PW res: [0x2b982:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.697594:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004dda5a3f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.697595:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c5242d lrc: 2/0,0 mode: PW/PW res: [0x2b982:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.697597:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c5242d lrc: 3/0,0 mode: PW/PW res: [0x2b982:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.697600:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c5242d lrc: 1/0,0 mode: --/PW res: [0x2b982:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.697603:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c5242d lrc: 0/0,0 mode: --/PW res: [0x2b982:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.697606:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c52457 lrc: 2/0,0 mode: PW/PW res: [0x2b989:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.697609:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000587473f4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.697610:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c52457 lrc: 2/0,0 mode: PW/PW res: [0x2b989:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.697612:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c52457 lrc: 3/0,0 mode: PW/PW res: [0x2b989:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.697615:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c52457 lrc: 1/0,0 mode: --/PW res: [0x2b989:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.697618:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000587473f4/0x3234de053c52457 lrc: 0/0,0 mode: --/PW res: [0x2b989:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.697621:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52450 lrc: 2/0,0 mode: PW/PW res: [0x2b988:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.697624:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f9b62460 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.697624:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52450 lrc: 2/0,0 mode: PW/PW res: [0x2b988:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.697627:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52450 lrc: 3/0,0 mode: PW/PW res: [0x2b988:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.697630:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52450 lrc: 1/0,0 mode: --/PW res: [0x2b988:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.697633:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52450 lrc: 0/0,0 mode: --/PW res: [0x2b988:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.697668:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946522880 00000100:00100000:1.0:1651529344.697679:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212122 00000100:00100000:1.0:1651529344.697681:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1616:39030:x1731745946522880:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.697687:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178570 count 1 00010000:00010000:1.0:1651529344.697692:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d08b2c6/0x3234de053c5245e lrc: 3/0,1 mode: --/PW res: [0x2b98a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.697696:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008e005198/0x3234de053c4d4b0 lrc: 2/0,0 mode: PR/PR res: [0x2b98a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d04bc expref: 443 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.697699:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.697700:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.697701:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d08b2c6/0x3234de053c5245e lrc: 4/0,1 mode: --/PW res: [0x2b98a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.697707:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008e005198/0x3234de053c4d4b0 lrc: 3/0,0 mode: PR/PR res: [0x2b98a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d04bc expref: 443 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.697711:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008e005198/0x3234de053c4d4b0 lrc: 4/0,0 mode: PR/PR res: [0x2b98a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d04bc expref: 443 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.697715:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000703c0db9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997042560:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.697729:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b52d0f36 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.697873:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.697884:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.697891:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.697902:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946523008 00000100:00100000:1.0:1651529344.697906:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.697914:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.697931:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946522944 00000100:00100000:1.0:1651529344.697934:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.697937:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946523136 00000100:00100000:0.0:1651529344.697940:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946523072 00000100:00100000:0.0:1651529344.697949:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946523264 00000100:00100000:0.0:1651529344.697954:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946523200 00000100:00100000:0.0:1651529344.697958:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212123 00000100:00100000:0.0:1651529344.697959:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1622:39030:x1731745946523008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.697965:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178572 count 1 00000100:00100000:1.0:1651529344.697968:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.697969:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c52465 lrc: 3/0,1 mode: --/PW res: [0x2b98c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.697982:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000070653347/0x3234de053c4b96d lrc: 2/0,0 mode: PR/PR res: [0x2b98c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc457 expref: 443 pid: 80278 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.697986:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.697986:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.697986:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.697987:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c52465 lrc: 4/0,1 mode: --/PW res: [0x2b98c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.697993:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946523328 00010000:00010000:0.0:1651529344.697994:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000070653347/0x3234de053c4b96d lrc: 3/0,0 mode: PR/PR res: [0x2b98c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc457 expref: 443 pid: 80278 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.697997:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000070653347/0x3234de053c4b96d lrc: 4/0,0 mode: PR/PR res: [0x2b98c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc457 expref: 443 pid: 80278 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.698000:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212124 00000100:00100000:1.0:1651529344.698001:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1623:39029:x1731745946522944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.698002:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001d1586f2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997042624:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.698006:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178571 count 1 00010000:00010000:1.0:1651529344.698011:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2c0ea84/0x3234de053c5246c lrc: 3/0,1 mode: --/PW res: [0x2b98b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.698017:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 000000003003c8b0 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.698022:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e6becaac/0x3234de053c4eded lrc: 2/0,0 mode: PR/PR res: [0x2b98b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a12 expref: 443 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.698024:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212125 00000100:00100000:0.0:1651529344.698025:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1623:39030:x1731745946523136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.698026:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.698027:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.698027:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2c0ea84/0x3234de053c5246c lrc: 4/0,1 mode: --/PW res: [0x2b98b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.698030:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178574 count 1 00010000:00010000:1.0:1651529344.698034:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e6becaac/0x3234de053c4eded lrc: 3/0,0 mode: PR/PR res: [0x2b98b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a12 expref: 443 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.698034:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba3ddc6f/0x3234de053c52473 lrc: 3/0,1 mode: --/PW res: [0x2b98e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.698038:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e6becaac/0x3234de053c4eded lrc: 4/0,0 mode: PR/PR res: [0x2b98b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a12 expref: 443 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.698038:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d18e8744/0x3234de053c4cbb8 lrc: 2/0,0 mode: PR/PR res: [0x2b98e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce09d expref: 443 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.698041:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.698042:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997042688:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.698042:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.698043:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba3ddc6f/0x3234de053c52473 lrc: 4/0,1 mode: --/PW res: [0x2b98e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.698049:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d18e8744/0x3234de053c4cbb8 lrc: 3/0,0 mode: PR/PR res: [0x2b98e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce09d expref: 443 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.698051:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000567ee0ef going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.698053:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d18e8744/0x3234de053c4cbb8 lrc: 4/0,0 mode: PR/PR res: [0x2b98e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce09d expref: 443 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.698057:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212126 00000100:00100000:0.0:1651529344.698057:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029abc941 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997042752:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.698059:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1623:39029:x1731745946523072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.698063:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178573 count 1 00000100:00100000:0.0:1651529344.698064:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 0000000076b354b3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.698066:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070278b0c/0x3234de053c5247a lrc: 3/0,1 mode: --/PW res: [0x2b98d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.698070:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212127 00010000:00010000:1.0:1651529344.698071:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000888c0789/0x3234de053c4bcf4 lrc: 2/0,0 mode: PR/PR res: [0x2b98d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5fb expref: 443 pid: 80280 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.698071:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1623:39030:x1731745946523264:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.698074:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.698074:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.698075:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070278b0c/0x3234de053c5247a lrc: 4/0,1 mode: --/PW res: [0x2b98d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.698075:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178576 count 1 00010000:00010000:0.0:1651529344.698078:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002056e733/0x3234de053c52481 lrc: 3/0,1 mode: --/PW res: [0x2b990:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.698081:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000888c0789/0x3234de053c4bcf4 lrc: 3/0,0 mode: PR/PR res: [0x2b98d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5fb expref: 443 pid: 80280 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.698083:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000dd6e8c5/0x3234de053c4e34a lrc: 2/0,0 mode: PR/PR res: [0x2b990:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e13 expref: 443 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.698084:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000888c0789/0x3234de053c4bcf4 lrc: 4/0,0 mode: PR/PR res: [0x2b98d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5fb expref: 443 pid: 80280 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.698086:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.698086:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.698087:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002056e733/0x3234de053c52481 lrc: 4/0,1 mode: --/PW res: [0x2b990:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.698088:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004be0190 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997042816:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.698093:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000dd6e8c5/0x3234de053c4e34a lrc: 3/0,0 mode: PR/PR res: [0x2b990:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e13 expref: 443 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.698094:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a4eb401d going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.698098:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000dd6e8c5/0x3234de053c4e34a lrc: 4/0,0 mode: PR/PR res: [0x2b990:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e13 expref: 443 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.698100:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212128 00000100:00100000:1.0:1651529344.698102:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1623:39029:x1731745946523200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.698102:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000974b675b pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997042880:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.698105:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178575 count 1 00010000:00010000:1.0:1651529344.698108:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016627d6e/0x3234de053c52488 lrc: 3/0,1 mode: --/PW res: [0x2b98f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.698109:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 0000000049203969 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.698112:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000088596046/0x3234de053c4c918 lrc: 2/0,0 mode: PR/PR res: [0x2b98f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd5ad expref: 443 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.698114:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212129 00000100:00100000:0.0:1651529344.698116:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1623:39029:x1731745946523328:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.698118:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.698118:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.698119:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016627d6e/0x3234de053c52488 lrc: 4/0,1 mode: --/PW res: [0x2b98f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.698119:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178577 count 1 00010000:00010000:0.0:1651529344.698122:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba00fdd7/0x3234de053c5248f lrc: 3/0,1 mode: --/PW res: [0x2b991:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.698125:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000088596046/0x3234de053c4c918 lrc: 3/0,0 mode: PR/PR res: [0x2b98f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd5ad expref: 443 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.698127:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000a9f5e78/0x3234de053c4f580 lrc: 2/0,0 mode: PR/PR res: [0x2b991:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d886c expref: 443 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.698128:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000088596046/0x3234de053c4c918 lrc: 4/0,0 mode: PR/PR res: [0x2b98f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd5ad expref: 443 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.698129:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.698130:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.698131:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba00fdd7/0x3234de053c5248f lrc: 4/0,1 mode: --/PW res: [0x2b991:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.698132:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f39ca9ea pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997042944:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.698136:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000a9f5e78/0x3234de053c4f580 lrc: 3/0,0 mode: PR/PR res: [0x2b991:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d886c expref: 443 pid: 156655 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.698138:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 0000000020dd7827 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.698140:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000a9f5e78/0x3234de053c4f580 lrc: 4/0,0 mode: PR/PR res: [0x2b991:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d886c expref: 443 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.698147:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000703c0db9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997042560:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.698147:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a573b31 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997043008:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.698151:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002d08b2c6/0x3234de053c5245e lrc: 3/0,1 mode: --/PW res: [0x2b98a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.698153:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a3b00cf3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.698159:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396404032 00010000:00010000:0.0:1651529344.698164:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008e005198/0x3234de053c4d4b0 lrc: 4/0,0 mode: PR/PR res: [0x2b98a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d04bc expref: 444 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.698175:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12904 00000100:00100000:0.0:1651529344.698177:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ce633b1f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+444:41278:x1731746396404032:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.698180:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.698181:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008e005198/0x3234de053c4d4b0 lrc: 4/0,0 mode: PR/PR res: [0x2b98a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d04bc expref: 444 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.698185:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008e005198/0x3234de053c4d4b0 lrc: 3/0,0 mode: PR/PR res: [0x2b98a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d04bc expref: 444 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.698190:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e005198/0x3234de053c4d4b0 lrc: 0/0,0 mode: --/PR res: [0x2b98a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d04bc expref: 444 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.698194:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.698194:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.698195:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002d08b2c6/0x3234de053c5245e lrc: 3/0,1 mode: PW/PW res: [0x2b98a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.698198:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d08b2c6/0x3234de053c5245e lrc: 4/0,1 mode: PW/PW res: [0x2b98a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.698209:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.698215:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ce633b1f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+443:41278:x1731746396404032:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 37us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.698217:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12904 00010000:00010000:1.0:1651529344.698258:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002d08b2c6/0x3234de053c5245e lrc: 3/0,1 mode: PW/PW res: [0x2b98a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.698263:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d08b2c6/0x3234de053c5245e lrc: 3/0,1 mode: PW/PW res: [0x2b98a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.698266:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d08b2c6/0x3234de053c5245e lrc: 3/0,1 mode: PW/PW res: [0x2b98a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.698271:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d08b2c6/0x3234de053c5245e lrc: 2/0,0 mode: PW/PW res: [0x2b98a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.698283:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d08b2c6/0x3234de053c5245e lrc: 2/0,0 mode: PW/PW res: [0x2b98a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.698288:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002d08b2c6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.698289:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d08b2c6/0x3234de053c5245e lrc: 2/0,0 mode: PW/PW res: [0x2b98a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.698292:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d08b2c6/0x3234de053c5245e lrc: 3/0,0 mode: PW/PW res: [0x2b98a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.698297:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d08b2c6/0x3234de053c5245e lrc: 1/0,0 mode: --/PW res: [0x2b98a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.698300:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d08b2c6/0x3234de053c5245e lrc: 0/0,0 mode: --/PW res: [0x2b98a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.698319:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1624:39030:x1731745946522880:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 636us (731us total) trans 12885080177 rc 0/0 00000100:00100000:1.0:1651529344.698322:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212122 00000100:00100000:1.0:1651529344.698487:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.698494:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946523392 00000100:00100000:1.0:1651529344.698506:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212130 00000100:00100000:1.0:1651529344.698507:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1624:39030:x1731745946523392:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.698512:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178578 count 1 00010000:00010000:1.0:1651529344.698517:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000111401ed/0x3234de053c52496 lrc: 3/0,1 mode: --/PW res: [0x2b992:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.698521:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000049c5c3fe/0x3234de053c4da36 lrc: 2/0,0 mode: PR/PR res: [0x2b992:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1968 expref: 442 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.698525:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.698525:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.698526:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000111401ed/0x3234de053c52496 lrc: 4/0,1 mode: --/PW res: [0x2b992:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.698539:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000049c5c3fe/0x3234de053c4da36 lrc: 3/0,0 mode: PR/PR res: [0x2b992:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1968 expref: 442 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.698543:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000049c5c3fe/0x3234de053c4da36 lrc: 4/0,0 mode: PR/PR res: [0x2b992:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1968 expref: 442 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.698547:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003e3f0f77 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997043072:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.698570:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b52d0f36 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.698577:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997042688:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.698581:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d2c0ea84/0x3234de053c5246c lrc: 3/0,1 mode: --/PW res: [0x2b98b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.698592:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.698596:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004be0190 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997042816:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.698599:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000070278b0c/0x3234de053c5247a lrc: 3/0,1 mode: --/PW res: [0x2b98d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.698599:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.698608:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.698617:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.698618:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396404096 00010000:00010000:1.0:1651529344.698627:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000070653347/0x3234de053c4b96d lrc: 5/0,0 mode: PR/PR res: [0x2b98c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc457 expref: 443 pid: 80278 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.698638:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396404224 00010000:00010000:1.0:1651529344.698640:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000888c0789/0x3234de053c4bcf4 lrc: 4/0,0 mode: PR/PR res: [0x2b98d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5fb expref: 444 pid: 80280 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.698644:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396404160 00010000:00010000:1.0:1651529344.698646:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e6becaac/0x3234de053c4eded lrc: 4/0,0 mode: PR/PR res: [0x2b98b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a12 expref: 445 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.698650:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396404288 00010000:00010000:1.0:1651529344.698652:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d18e8744/0x3234de053c4cbb8 lrc: 5/0,0 mode: PR/PR res: [0x2b98e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce09d expref: 446 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.698660:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001d1586f2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997042624:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.698665:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12905 00000100:00100000:1.0:1651529344.698667:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+446:41279:x1731746396404096:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.698670:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.698671:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000070653347/0x3234de053c4b96d lrc: 4/0,0 mode: PR/PR res: [0x2b98c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc457 expref: 446 pid: 80278 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.698675:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000070653347/0x3234de053c4b96d lrc: 3/0,0 mode: PR/PR res: [0x2b98c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc457 expref: 446 pid: 80278 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.698687:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070653347/0x3234de053c4b96d lrc: 0/0,0 mode: --/PR res: [0x2b98c:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc457 expref: 446 pid: 80278 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.698688:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c52465 lrc: 3/0,1 mode: --/PW res: [0x2b98c:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.698691:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.698692:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.698693:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c52465 lrc: 3/0,1 mode: PW/PW res: [0x2b98c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.698696:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c52465 lrc: 4/0,1 mode: PW/PW res: [0x2b98c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.698705:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.698722:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029abc941 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997042752:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.698727:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+445:41279:x1731746396404096:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 60us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.698730:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12905 00010000:00010000:0.0:1651529344.698730:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ba3ddc6f/0x3234de053c52473 lrc: 3/0,1 mode: --/PW res: [0x2b98e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.698744:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12906 00000100:00100000:1.0:1651529344.698746:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+444:41279:x1731746396404224:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.698747:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000974b675b pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997042880:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.698749:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.698750:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000888c0789/0x3234de053c4bcf4 lrc: 4/0,0 mode: PR/PR res: [0x2b98d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5fb expref: 444 pid: 80280 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.698750:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002056e733/0x3234de053c52481 lrc: 3/0,1 mode: --/PW res: [0x2b990:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.698754:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000888c0789/0x3234de053c4bcf4 lrc: 3/0,0 mode: PR/PR res: [0x2b98d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5fb expref: 444 pid: 80280 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.698756:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a573b31 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997043008:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.698758:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000888c0789/0x3234de053c4bcf4 lrc: 0/0,0 mode: --/PR res: [0x2b98d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5fb expref: 444 pid: 80280 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.698759:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ba00fdd7/0x3234de053c5248f lrc: 3/0,1 mode: --/PW res: [0x2b991:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.698762:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.698762:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.698763:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000070278b0c/0x3234de053c5247a lrc: 3/0,1 mode: PW/PW res: [0x2b98d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.698764:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c52465 lrc: 3/0,1 mode: PW/PW res: [0x2b98c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.698766:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070278b0c/0x3234de053c5247a lrc: 4/0,1 mode: PW/PW res: [0x2b98d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.698767:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c52465 lrc: 3/0,1 mode: PW/PW res: [0x2b98c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.698770:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c52465 lrc: 3/0,1 mode: PW/PW res: [0x2b98c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.698773:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.698773:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c52465 lrc: 2/0,0 mode: PW/PW res: [0x2b98c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.698778:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+443:41279:x1731746396404224:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 32us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.698780:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12906 00000100:00100000:1.0:1651529344.698784:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12907 00000100:00100000:1.0:1651529344.698786:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+442:41278:x1731746396404160:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.698788:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.698789:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e6becaac/0x3234de053c4eded lrc: 4/0,0 mode: PR/PR res: [0x2b98b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a12 expref: 442 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.698795:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e6becaac/0x3234de053c4eded lrc: 3/0,0 mode: PR/PR res: [0x2b98b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a12 expref: 442 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.698799:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6becaac/0x3234de053c4eded lrc: 0/0,0 mode: --/PR res: [0x2b98b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a12 expref: 442 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.698803:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.698803:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.698804:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d2c0ea84/0x3234de053c5246c lrc: 3/0,1 mode: PW/PW res: [0x2b98b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.698807:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2c0ea84/0x3234de053c5246c lrc: 4/0,1 mode: PW/PW res: [0x2b98b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.698812:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.698813:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1625:39030:x1731745946523008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 853us (940us total) trans 12885080178 rc 0/0 00000100:00100000:1.0:1651529344.698817:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+441:41278:x1731746396404160:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 30us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.698817:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212123 00000100:00100000:1.0:1651529344.698819:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12907 00000100:00100000:1.0:1651529344.698822:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12908 00000100:00100000:1.0:1651529344.698824:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+440:41278:x1731746396404288:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.698824:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c52465 lrc: 2/0,0 mode: PW/PW res: [0x2b98c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.698826:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.698827:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d18e8744/0x3234de053c4cbb8 lrc: 4/0,0 mode: PR/PR res: [0x2b98e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce09d expref: 440 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.698827:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ade4813a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.698828:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c52465 lrc: 2/0,0 mode: PW/PW res: [0x2b98c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.698831:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d18e8744/0x3234de053c4cbb8 lrc: 3/0,0 mode: PR/PR res: [0x2b98e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce09d expref: 440 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.698831:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c52465 lrc: 3/0,0 mode: PW/PW res: [0x2b98c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.698835:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d18e8744/0x3234de053c4cbb8 lrc: 0/0,0 mode: --/PR res: [0x2b98e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce09d expref: 440 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.698836:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c52465 lrc: 1/0,0 mode: --/PW res: [0x2b98c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.698838:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.698839:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.698839:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba3ddc6f/0x3234de053c52473 lrc: 3/0,1 mode: PW/PW res: [0x2b98e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.698839:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c52465 lrc: 0/0,0 mode: --/PW res: [0x2b98c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.698842:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba3ddc6f/0x3234de053c52473 lrc: 4/0,1 mode: PW/PW res: [0x2b98e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.698850:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.698855:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+439:41278:x1731746396404288:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 31us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.698858:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12908 00000100:00100000:0.0:1651529344.698862:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.698874:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396404416 00010000:00010000:1.0:1651529344.698878:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000088596046/0x3234de053c4c918 lrc: 5/0,0 mode: PR/PR res: [0x2b98f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd5ad expref: 439 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.698878:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.698883:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396404352 00010000:00010000:1.0:1651529344.698885:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000dd6e8c5/0x3234de053c4e34a lrc: 4/0,0 mode: PR/PR res: [0x2b990:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e13 expref: 440 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.698890:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12909 00000100:00100000:1.0:1651529344.698891:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+440:41278:x1731746396404416:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.698894:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.698895:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000088596046/0x3234de053c4c918 lrc: 5/0,0 mode: PR/PR res: [0x2b98f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd5ad expref: 440 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.698900:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.698906:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000088596046/0x3234de053c4c918 lrc: 4/0,0 mode: PR/PR res: [0x2b98f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd5ad expref: 440 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.698916:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.698917:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.698918:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000016627d6e/0x3234de053c52488 lrc: 3/0,1 mode: PW/PW res: [0x2b98f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.698919:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.698921:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016627d6e/0x3234de053c52488 lrc: 4/0,1 mode: PW/PW res: [0x2b98f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.698925:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.698931:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+440:41278:x1731746396404416:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 39us (70us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.698933:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12909 00010000:00010000:0.0:1651529344.698938:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ba3ddc6f/0x3234de053c52473 lrc: 3/0,1 mode: PW/PW res: [0x2b98e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.698942:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba3ddc6f/0x3234de053c52473 lrc: 3/0,1 mode: PW/PW res: [0x2b98e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.698947:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba3ddc6f/0x3234de053c52473 lrc: 3/0,1 mode: PW/PW res: [0x2b98e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.698950:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba3ddc6f/0x3234de053c52473 lrc: 2/0,0 mode: PW/PW res: [0x2b98e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.698962:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396404480 00010000:00010000:1.0:1651529344.698966:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000a9f5e78/0x3234de053c4f580 lrc: 4/0,0 mode: PR/PR res: [0x2b991:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d886c expref: 440 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.698971:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396404544 00010000:00010000:1.0:1651529344.698973:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000049c5c3fe/0x3234de053c4da36 lrc: 5/0,0 mode: PR/PR res: [0x2b992:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1968 expref: 441 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.698978:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12910 00000100:00100000:1.0:1651529344.698979:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+441:41279:x1731746396404352:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.698983:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.698984:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000dd6e8c5/0x3234de053c4e34a lrc: 4/0,0 mode: PR/PR res: [0x2b990:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e13 expref: 441 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.698988:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000dd6e8c5/0x3234de053c4e34a lrc: 3/0,0 mode: PR/PR res: [0x2b990:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e13 expref: 441 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.698993:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000dd6e8c5/0x3234de053c4e34a lrc: 0/0,0 mode: --/PR res: [0x2b990:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e13 expref: 441 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.698996:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.698996:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.698997:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002056e733/0x3234de053c52481 lrc: 3/0,1 mode: PW/PW res: [0x2b990:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.699000:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002056e733/0x3234de053c52481 lrc: 4/0,1 mode: PW/PW res: [0x2b990:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.699010:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.699017:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+440:41279:x1731746396404352:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 37us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.699019:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12910 00000100:00100000:1.0:1651529344.699023:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12911 00000100:00100000:1.0:1651529344.699025:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000039bebb6e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+439:41279:x1731746396404480:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.699026:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1625:39030:x1731745946523136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 982us (1117us total) trans 12885080179 rc 0/0 00010000:00010000:1.0:1651529344.699027:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.699028:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000a9f5e78/0x3234de053c4f580 lrc: 4/0,0 mode: PR/PR res: [0x2b991:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d886c expref: 439 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.699029:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212125 00010000:00010000:1.0:1651529344.699034:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000a9f5e78/0x3234de053c4f580 lrc: 3/0,0 mode: PR/PR res: [0x2b991:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d886c expref: 439 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.699036:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba3ddc6f/0x3234de053c52473 lrc: 2/0,0 mode: PW/PW res: [0x2b98e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.699039:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a9f5e78/0x3234de053c4f580 lrc: 0/0,0 mode: --/PR res: [0x2b991:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d886c expref: 439 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.699039:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba3ddc6f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.699040:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba3ddc6f/0x3234de053c52473 lrc: 2/0,0 mode: PW/PW res: [0x2b98e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.699042:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.699043:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.699043:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba00fdd7/0x3234de053c5248f lrc: 3/0,1 mode: PW/PW res: [0x2b991:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.699043:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba3ddc6f/0x3234de053c52473 lrc: 3/0,0 mode: PW/PW res: [0x2b98e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.699046:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba00fdd7/0x3234de053c5248f lrc: 4/0,1 mode: PW/PW res: [0x2b991:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.699048:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba3ddc6f/0x3234de053c52473 lrc: 1/0,0 mode: --/PW res: [0x2b98e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.699050:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba3ddc6f/0x3234de053c52473 lrc: 0/0,0 mode: --/PW res: [0x2b98e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.699054:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.699059:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000039bebb6e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+438:41279:x1731746396404480:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.699061:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12911 00010000:00010000:0.0:1651529344.699062:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ba00fdd7/0x3234de053c5248f lrc: 3/0,1 mode: PW/PW res: [0x2b991:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.699065:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba00fdd7/0x3234de053c5248f lrc: 3/0,1 mode: PW/PW res: [0x2b991:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.699068:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12912 00010000:00010000:0.0:1651529344.699068:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba00fdd7/0x3234de053c5248f lrc: 3/0,1 mode: PW/PW res: [0x2b991:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.699070:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+437:41279:x1731746396404544:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.699071:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba00fdd7/0x3234de053c5248f lrc: 2/0,0 mode: PW/PW res: [0x2b991:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.699072:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.699074:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000049c5c3fe/0x3234de053c4da36 lrc: 5/0,0 mode: PR/PR res: [0x2b992:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1968 expref: 437 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.699077:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000049c5c3fe/0x3234de053c4da36 lrc: 4/0,0 mode: PR/PR res: [0x2b992:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1968 expref: 437 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.699082:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.699082:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.699083:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000111401ed/0x3234de053c52496 lrc: 3/0,1 mode: PW/PW res: [0x2b992:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.699086:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000111401ed/0x3234de053c52496 lrc: 4/0,1 mode: PW/PW res: [0x2b992:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.699090:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.699094:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+437:41279:x1731746396404544:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 23us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.699096:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12912 00010000:00010000:1.0:1651529344.699105:0:80278:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088596046/0x3234de053c4c918 lrc: 0/0,0 mode: --/PR res: [0x2b98f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd5ad expref: 436 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.699108:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1625:39029:x1731745946523328:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 991us (1122us total) trans 12885080180 rc 0/0 00000100:00100000:1.0:1651529344.699109:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f39ca9ea pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997042944:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.699111:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212129 00010000:00010000:1.0:1651529344.699113:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000016627d6e/0x3234de053c52488 lrc: 3/0,1 mode: PW/PW res: [0x2b98f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.699116:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000016627d6e/0x3234de053c52488 lrc: 3/0,1 mode: PW/PW res: [0x2b98f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.699117:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002056e733/0x3234de053c52481 lrc: 3/0,1 mode: PW/PW res: [0x2b990:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.699119:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016627d6e/0x3234de053c52488 lrc: 3/0,1 mode: PW/PW res: [0x2b98f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.699120:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002056e733/0x3234de053c52481 lrc: 3/0,1 mode: PW/PW res: [0x2b990:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.699122:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016627d6e/0x3234de053c52488 lrc: 3/0,1 mode: PW/PW res: [0x2b98f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.699123:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002056e733/0x3234de053c52481 lrc: 3/0,1 mode: PW/PW res: [0x2b990:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.699125:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016627d6e/0x3234de053c52488 lrc: 2/0,0 mode: PW/PW res: [0x2b98f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.699126:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002056e733/0x3234de053c52481 lrc: 2/0,0 mode: PW/PW res: [0x2b990:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.699168:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1626:39029:x1731745946523200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1066us (1234us total) trans 12885080181 rc 0/0 00000100:00100000:1.0:1651529344.699171:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212128 00000100:00100000:0.0:1651529344.699171:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1626:39030:x1731745946523264:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1099us (1256us total) trans 12885080182 rc 0/0 00000100:00100000:0.0:1651529344.699175:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212127 00010000:00010000:1.0:1651529344.699178:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d2c0ea84/0x3234de053c5246c lrc: 3/0,1 mode: PW/PW res: [0x2b98b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.699181:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2c0ea84/0x3234de053c5246c lrc: 3/0,1 mode: PW/PW res: [0x2b98b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.699182:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba00fdd7/0x3234de053c5248f lrc: 2/0,0 mode: PW/PW res: [0x2b991:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.699184:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2c0ea84/0x3234de053c5246c lrc: 3/0,1 mode: PW/PW res: [0x2b98b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.699186:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba00fdd7 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.699187:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2c0ea84/0x3234de053c5246c lrc: 2/0,0 mode: PW/PW res: [0x2b98b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.699187:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba00fdd7/0x3234de053c5248f lrc: 2/0,0 mode: PW/PW res: [0x2b991:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.699190:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba00fdd7/0x3234de053c5248f lrc: 3/0,0 mode: PW/PW res: [0x2b991:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.699194:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba00fdd7/0x3234de053c5248f lrc: 1/0,0 mode: --/PW res: [0x2b991:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.699197:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba00fdd7/0x3234de053c5248f lrc: 0/0,0 mode: --/PW res: [0x2b991:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.699201:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016627d6e/0x3234de053c52488 lrc: 2/0,0 mode: PW/PW res: [0x2b98f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.699204:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000016627d6e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.699204:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016627d6e/0x3234de053c52488 lrc: 2/0,0 mode: PW/PW res: [0x2b98f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.699207:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016627d6e/0x3234de053c52488 lrc: 3/0,0 mode: PW/PW res: [0x2b98f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.699213:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016627d6e/0x3234de053c52488 lrc: 1/0,0 mode: --/PW res: [0x2b98f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.699216:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016627d6e/0x3234de053c52488 lrc: 0/0,0 mode: --/PW res: [0x2b98f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.699217:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1625:39029:x1731745946522944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1215us (1333us total) trans 12885080183 rc 0/0 00010000:00010000:0.0:1651529344.699219:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002056e733/0x3234de053c52481 lrc: 2/0,0 mode: PW/PW res: [0x2b990:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.699220:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212124 00010000:00010000:0.0:1651529344.699238:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002056e733 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.699239:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002056e733/0x3234de053c52481 lrc: 2/0,0 mode: PW/PW res: [0x2b990:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.699242:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002056e733/0x3234de053c52481 lrc: 3/0,0 mode: PW/PW res: [0x2b990:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.699245:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000070278b0c/0x3234de053c5247a lrc: 3/0,1 mode: PW/PW res: [0x2b98d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.699246:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002056e733/0x3234de053c52481 lrc: 1/0,0 mode: --/PW res: [0x2b990:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.699248:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002056e733/0x3234de053c52481 lrc: 0/0,0 mode: --/PW res: [0x2b990:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.699249:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070278b0c/0x3234de053c5247a lrc: 3/0,1 mode: PW/PW res: [0x2b98d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.699252:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2c0ea84/0x3234de053c5246c lrc: 2/0,0 mode: PW/PW res: [0x2b98b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.699254:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070278b0c/0x3234de053c5247a lrc: 3/0,1 mode: PW/PW res: [0x2b98d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.699255:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d2c0ea84 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.699256:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2c0ea84/0x3234de053c5246c lrc: 2/0,0 mode: PW/PW res: [0x2b98b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.699257:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070278b0c/0x3234de053c5247a lrc: 2/0,0 mode: PW/PW res: [0x2b98d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.699259:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2c0ea84/0x3234de053c5246c lrc: 3/0,0 mode: PW/PW res: [0x2b98b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.699262:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2c0ea84/0x3234de053c5246c lrc: 1/0,0 mode: --/PW res: [0x2b98b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.699265:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2c0ea84/0x3234de053c5246c lrc: 0/0,0 mode: --/PW res: [0x2b98b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.699268:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070278b0c/0x3234de053c5247a lrc: 2/0,0 mode: PW/PW res: [0x2b98d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.699271:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000070278b0c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.699272:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070278b0c/0x3234de053c5247a lrc: 2/0,0 mode: PW/PW res: [0x2b98d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.699274:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070278b0c/0x3234de053c5247a lrc: 3/0,0 mode: PW/PW res: [0x2b98d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.699277:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070278b0c/0x3234de053c5247a lrc: 1/0,0 mode: --/PW res: [0x2b98d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.699280:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070278b0c/0x3234de053c5247a lrc: 0/0,0 mode: --/PW res: [0x2b98d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.699289:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1625:39029:x1731745946523072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1229us (1383us total) trans 12885080184 rc 0/0 00000100:00100000:1.0:1651529344.699292:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212126 00000100:00100000:0.0:1651529344.699296:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.699310:0:72397:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049c5c3fe/0x3234de053c4da36 lrc: 0/0,0 mode: --/PR res: [0x2b992:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1968 expref: 435 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.699314:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003e3f0f77 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997043072:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.699317:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000111401ed/0x3234de053c52496 lrc: 3/0,1 mode: PW/PW res: [0x2b992:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.699320:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000111401ed/0x3234de053c52496 lrc: 3/0,1 mode: PW/PW res: [0x2b992:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.699323:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000111401ed/0x3234de053c52496 lrc: 3/0,1 mode: PW/PW res: [0x2b992:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.699326:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000111401ed/0x3234de053c52496 lrc: 3/0,1 mode: PW/PW res: [0x2b992:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.699331:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000111401ed/0x3234de053c52496 lrc: 2/0,0 mode: PW/PW res: [0x2b992:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.699361:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000111401ed/0x3234de053c52496 lrc: 2/0,0 mode: PW/PW res: [0x2b992:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.699366:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000111401ed already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.699367:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000111401ed/0x3234de053c52496 lrc: 2/0,0 mode: PW/PW res: [0x2b992:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.699370:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000111401ed/0x3234de053c52496 lrc: 3/0,0 mode: PW/PW res: [0x2b992:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.699374:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000111401ed/0x3234de053c52496 lrc: 1/0,0 mode: --/PW res: [0x2b992:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.699377:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000111401ed/0x3234de053c52496 lrc: 0/0,0 mode: --/PW res: [0x2b992:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.699392:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1625:39030:x1731745946523392:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 883us (905us total) trans 12885080185 rc 0/0 00000100:00100000:1.0:1651529344.699395:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212130 00000100:00100000:1.0:1651529344.699400:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946523456 00000100:00100000:1.0:1651529344.699407:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212131 00000100:00100000:1.0:1651529344.699408:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1625:39030:x1731745946523456:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.699413:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178579 count 1 00010000:00010000:1.0:1651529344.699417:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4b5c5d1/0x3234de053c5249d lrc: 3/0,1 mode: --/PW res: [0x2b993:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.699422:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ffae8206/0x3234de053c4af2c lrc: 2/0,0 mode: PR/PR res: [0x2b993:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbfa3 expref: 434 pid: 80281 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.699425:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.699426:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.699426:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4b5c5d1/0x3234de053c5249d lrc: 4/0,1 mode: --/PW res: [0x2b993:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.699441:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ffae8206/0x3234de053c4af2c lrc: 3/0,0 mode: PR/PR res: [0x2b993:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbfa3 expref: 434 pid: 80281 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.699445:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ffae8206/0x3234de053c4af2c lrc: 4/0,0 mode: PR/PR res: [0x2b993:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbfa3 expref: 434 pid: 80281 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.699452:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003e3f0f77 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997043136:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.699466:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b52d0f36 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.699537:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.699563:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.699572:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.699582:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.699583:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946523520 00000100:00100000:1.0:1651529344.699588:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.699596:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946523584 00000100:00100000:1.0:1651529344.699598:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.699607:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946523648 00000100:00100000:0.0:1651529344.699609:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946523712 00000100:00100000:1.0:1651529344.699614:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946523776 00000100:00100000:0.0:1651529344.699617:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946523840 00000100:00100000:1.0:1651529344.699629:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212132 00000100:00100000:1.0:1651529344.699631:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1631:39030:x1731745946523520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.699636:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178580 count 1 00010000:00010000:1.0:1651529344.699641:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064e26837/0x3234de053c524a4 lrc: 3/0,1 mode: --/PW res: [0x2b994:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.699651:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212133 00000100:00100000:0.0:1651529344.699653:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1631:39029:x1731745946523584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.699659:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178581 count 1 00010000:00010000:1.0:1651529344.699660:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000162c695c/0x3234de053c4cd01 lrc: 2/0,0 mode: PR/PR res: [0x2b994:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce638 expref: 434 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.699663:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.699663:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021901d62/0x3234de053c524ab lrc: 3/0,1 mode: --/PW res: [0x2b995:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.699664:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.699665:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064e26837/0x3234de053c524a4 lrc: 4/0,1 mode: --/PW res: [0x2b994:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.699668:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ae455ecf/0x3234de053c4ebaf lrc: 2/0,0 mode: PR/PR res: [0x2b995:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d606b expref: 434 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.699671:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000162c695c/0x3234de053c4cd01 lrc: 3/0,0 mode: PR/PR res: [0x2b994:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce638 expref: 434 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.699672:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.699672:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.699673:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021901d62/0x3234de053c524ab lrc: 4/0,1 mode: --/PW res: [0x2b995:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.699677:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000162c695c/0x3234de053c4cd01 lrc: 4/0,0 mode: PR/PR res: [0x2b994:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce638 expref: 434 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.699680:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ae455ecf/0x3234de053c4ebaf lrc: 3/0,0 mode: PR/PR res: [0x2b995:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d606b expref: 434 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.699682:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997043200:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.699684:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ae455ecf/0x3234de053c4ebaf lrc: 4/0,0 mode: PR/PR res: [0x2b995:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d606b expref: 434 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.699688:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fc130417 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997043264:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.699690:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aeda71fe going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.699697:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212134 00000100:00100000:0.0:1651529344.699697:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 0000000049203969 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.699698:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1631:39030:x1731745946523648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.699703:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178582 count 1 00000100:00100000:0.0:1651529344.699704:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212135 00010000:00010000:1.0:1651529344.699706:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f86d1dc/0x3234de053c524b2 lrc: 3/0,1 mode: --/PW res: [0x2b996:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.699706:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1631:39029:x1731745946523712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.699710:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e50942f6/0x3234de053c4e7aa lrc: 2/0,0 mode: PR/PR res: [0x2b996:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f46 expref: 434 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.699710:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178583 count 1 00010000:00010000:1.0:1651529344.699713:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.699713:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006325442a/0x3234de053c524b9 lrc: 3/0,1 mode: --/PW res: [0x2b997:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.699714:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.699714:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f86d1dc/0x3234de053c524b2 lrc: 4/0,1 mode: --/PW res: [0x2b996:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.699717:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e78a7d44/0x3234de053c4bc4c lrc: 2/0,0 mode: PR/PR res: [0x2b997:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5b5 expref: 434 pid: 80280 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.699720:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e50942f6/0x3234de053c4e7aa lrc: 3/0,0 mode: PR/PR res: [0x2b996:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f46 expref: 434 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.699720:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.699721:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.699721:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006325442a/0x3234de053c524b9 lrc: 4/0,1 mode: --/PW res: [0x2b997:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.699724:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e50942f6/0x3234de053c4e7aa lrc: 4/0,0 mode: PR/PR res: [0x2b996:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f46 expref: 434 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.699727:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e78a7d44/0x3234de053c4bc4c lrc: 3/0,0 mode: PR/PR res: [0x2b997:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5b5 expref: 434 pid: 80280 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.699730:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000716b388d pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997043328:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.699733:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e78a7d44/0x3234de053c4bc4c lrc: 4/0,0 mode: PR/PR res: [0x2b997:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5b5 expref: 434 pid: 80280 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.699746:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ebb53b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997043392:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.699748:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000412e5d26 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.699753:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 0000000076b354b3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.699755:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212136 00000100:00100000:1.0:1651529344.699757:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1631:39029:x1731745946523840:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.699760:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212137 00002000:00080000:1.0:1651529344.699761:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178585 count 1 00000100:00100000:0.0:1651529344.699762:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1631:39030:x1731745946523776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.699764:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003e92419/0x3234de053c524c0 lrc: 3/0,1 mode: --/PW res: [0x2b999:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.699766:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178584 count 1 00010000:00010000:1.0:1651529344.699769:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009526c053/0x3234de053c4d359 lrc: 2/0,0 mode: PR/PR res: [0x2b999:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff2f expref: 434 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.699770:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b19bfe47/0x3234de053c524c7 lrc: 3/0,1 mode: --/PW res: [0x2b998:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.699772:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.699772:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.699773:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003e92419/0x3234de053c524c0 lrc: 4/0,1 mode: --/PW res: [0x2b999:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.699774:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003c303b27/0x3234de053c4e4e0 lrc: 2/0,0 mode: PR/PR res: [0x2b998:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d44db expref: 434 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.699777:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.699777:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.699778:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b19bfe47/0x3234de053c524c7 lrc: 4/0,1 mode: --/PW res: [0x2b998:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.699779:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009526c053/0x3234de053c4d359 lrc: 3/0,0 mode: PR/PR res: [0x2b999:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff2f expref: 434 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.699782:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009526c053/0x3234de053c4d359 lrc: 4/0,0 mode: PR/PR res: [0x2b999:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff2f expref: 434 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.699784:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003c303b27/0x3234de053c4e4e0 lrc: 3/0,0 mode: PR/PR res: [0x2b998:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d44db expref: 434 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.699786:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000999005e pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997043456:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.699787:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003c303b27/0x3234de053c4e4e0 lrc: 4/0,0 mode: PR/PR res: [0x2b998:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d44db expref: 434 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.699792:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a4eb401d going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.699794:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000824ca843 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997043520:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.699800:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000003003c8b0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.699815:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.699821:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946523904 00000100:00100000:0.0:1651529344.699828:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212138 00000100:00100000:0.0:1651529344.699837:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1632:39029:x1731745946523904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.699841:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:0.0:1651529344.699841:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178586 count 1 00010000:00010000:0.0:1651529344.699845:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5280238/0x3234de053c524ce lrc: 3/0,1 mode: --/PW res: [0x2b99a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.699849:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e489761b/0x3234de053c4f5b1 lrc: 2/0,0 mode: PR/PR res: [0x2b99a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8937 expref: 434 pid: 156655 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.699852:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003e3f0f77 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997043136:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.699852:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.699853:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.699854:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5280238/0x3234de053c524ce lrc: 4/0,1 mode: --/PW res: [0x2b99a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.699857:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e4b5c5d1/0x3234de053c5249d lrc: 3/0,1 mode: --/PW res: [0x2b993:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.699863:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396404608 00010000:00010000:0.0:1651529344.699863:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e489761b/0x3234de053c4f5b1 lrc: 3/0,0 mode: PR/PR res: [0x2b99a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8937 expref: 434 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.699866:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e489761b/0x3234de053c4f5b1 lrc: 4/0,0 mode: PR/PR res: [0x2b99a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8937 expref: 435 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.699868:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ffae8206/0x3234de053c4af2c lrc: 4/0,0 mode: PR/PR res: [0x2b993:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbfa3 expref: 435 pid: 80281 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.699870:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003de40890 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997043584:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.699879:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12913 00000100:00100000:1.0:1651529344.699881:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+435:41278:x1731746396404608:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.699884:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.699885:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ffae8206/0x3234de053c4af2c lrc: 4/0,0 mode: PR/PR res: [0x2b993:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbfa3 expref: 435 pid: 80281 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.699885:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000000a4def41 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.699889:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ffae8206/0x3234de053c4af2c lrc: 3/0,0 mode: PR/PR res: [0x2b993:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbfa3 expref: 435 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.699894:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ffae8206/0x3234de053c4af2c lrc: 0/0,0 mode: --/PR res: [0x2b993:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbfa3 expref: 435 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.699898:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.699898:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.699899:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e4b5c5d1/0x3234de053c5249d lrc: 3/0,1 mode: PW/PW res: [0x2b993:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.699902:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4b5c5d1/0x3234de053c5249d lrc: 4/0,1 mode: PW/PW res: [0x2b993:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.699911:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.699945:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+434:41278:x1731746396404608:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 56us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.699949:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12913 00010000:00010000:1.0:1651529344.699962:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e4b5c5d1/0x3234de053c5249d lrc: 3/0,1 mode: PW/PW res: [0x2b993:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.699966:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4b5c5d1/0x3234de053c5249d lrc: 3/0,1 mode: PW/PW res: [0x2b993:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.699969:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4b5c5d1/0x3234de053c5249d lrc: 3/0,1 mode: PW/PW res: [0x2b993:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.699972:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4b5c5d1/0x3234de053c5249d lrc: 2/0,0 mode: PW/PW res: [0x2b993:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.699992:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4b5c5d1/0x3234de053c5249d lrc: 2/0,0 mode: PW/PW res: [0x2b993:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.699996:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e4b5c5d1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.699997:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4b5c5d1/0x3234de053c5249d lrc: 2/0,0 mode: PW/PW res: [0x2b993:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.700000:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4b5c5d1/0x3234de053c5249d lrc: 3/0,0 mode: PW/PW res: [0x2b993:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.700005:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4b5c5d1/0x3234de053c5249d lrc: 1/0,0 mode: --/PW res: [0x2b993:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.700008:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4b5c5d1/0x3234de053c5249d lrc: 0/0,0 mode: --/PW res: [0x2b993:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.700016:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1633:39030:x1731745946523456:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 607us (720us total) trans 12885080186 rc 0/0 00000100:00100000:1.0:1651529344.700019:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212131 00000100:00100000:1.0:1651529344.700071:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997043200:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.700075:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000064e26837/0x3234de053c524a4 lrc: 3/0,1 mode: --/PW res: [0x2b994:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.700190:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.700197:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946523968 00000100:00100000:1.0:1651529344.700208:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212139 00000100:00100000:1.0:1651529344.700209:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1633:39030:x1731745946523968:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.700214:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178587 count 1 00010000:00010000:1.0:1651529344.700219:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085cf969e/0x3234de053c524d5 lrc: 3/0,1 mode: --/PW res: [0x2b99b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.700239:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000088e7ee5/0x3234de053c4e041 lrc: 2/0,0 mode: PR/PR res: [0x2b99b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d320b expref: 433 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.700242:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.700243:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.700243:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085cf969e/0x3234de053c524d5 lrc: 4/0,1 mode: --/PW res: [0x2b99b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.700250:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000088e7ee5/0x3234de053c4e041 lrc: 3/0,0 mode: PR/PR res: [0x2b99b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d320b expref: 433 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.700254:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000088e7ee5/0x3234de053c4e041 lrc: 4/0,0 mode: PR/PR res: [0x2b99b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d320b expref: 433 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.700263:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997043648:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.700275:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d09f5ee1 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.700351:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000716b388d pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997043328:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.700356:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002f86d1dc/0x3234de053c524b2 lrc: 3/0,1 mode: --/PW res: [0x2b996:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.700358:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.700363:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000999005e pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997043456:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.700365:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.700366:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000003e92419/0x3234de053c524c0 lrc: 3/0,1 mode: --/PW res: [0x2b999:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.700373:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.700381:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.700388:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396404672 00000100:00100000:0.0:1651529344.700390:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.700393:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000162c695c/0x3234de053c4cd01 lrc: 4/0,0 mode: PR/PR res: [0x2b994:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce638 expref: 434 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.700395:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.700399:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396404800 00010000:00010000:1.0:1651529344.700401:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e50942f6/0x3234de053c4e7aa lrc: 4/0,0 mode: PR/PR res: [0x2b996:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f46 expref: 435 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.700401:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.700405:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396404928 00010000:00010000:1.0:1651529344.700407:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009526c053/0x3234de053c4d359 lrc: 4/0,0 mode: PR/PR res: [0x2b999:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff2f expref: 436 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.700408:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ebb53b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997043392:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.700411:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396404736 00010000:00010000:1.0:1651529344.700413:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ae455ecf/0x3234de053c4ebaf lrc: 5/0,0 mode: PR/PR res: [0x2b995:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d606b expref: 437 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.700413:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006325442a/0x3234de053c524b9 lrc: 3/0,1 mode: --/PW res: [0x2b997:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.700417:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396405056 00010000:00010000:1.0:1651529344.700418:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e489761b/0x3234de053c4f5b1 lrc: 5/0,0 mode: PR/PR res: [0x2b99a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8937 expref: 438 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.700422:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396404864 00000100:00100000:0.0:1651529344.700422:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000824ca843 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997043520:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.700424:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e78a7d44/0x3234de053c4bc4c lrc: 4/0,0 mode: PR/PR res: [0x2b997:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5b5 expref: 439 pid: 80280 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.700425:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b19bfe47/0x3234de053c524c7 lrc: 3/0,1 mode: --/PW res: [0x2b998:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.700428:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396404992 00010000:00010000:1.0:1651529344.700430:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003c303b27/0x3234de053c4e4e0 lrc: 4/0,0 mode: PR/PR res: [0x2b998:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d44db expref: 440 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.700431:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fc130417 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997043264:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.700433:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000021901d62/0x3234de053c524ab lrc: 3/0,1 mode: --/PW res: [0x2b995:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.700435:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12914 00000100:00100000:1.0:1651529344.700437:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+440:41278:x1731746396404672:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.700439:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.700439:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003de40890 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997043584:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.700440:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000162c695c/0x3234de053c4cd01 lrc: 4/0,0 mode: PR/PR res: [0x2b994:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce638 expref: 440 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.700441:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e5280238/0x3234de053c524ce lrc: 3/0,1 mode: --/PW res: [0x2b99a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.700444:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000162c695c/0x3234de053c4cd01 lrc: 3/0,0 mode: PR/PR res: [0x2b994:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce638 expref: 440 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.700447:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12915 00000100:00100000:0.0:1651529344.700449:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+440:41278:x1731746396404800:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.700450:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000162c695c/0x3234de053c4cd01 lrc: 0/0,0 mode: --/PR res: [0x2b994:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce638 expref: 440 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.700453:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.700453:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.700454:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.700455:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000064e26837/0x3234de053c524a4 lrc: 3/0,1 mode: PW/PW res: [0x2b994:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.700455:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e50942f6/0x3234de053c4e7aa lrc: 4/0,0 mode: PR/PR res: [0x2b996:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f46 expref: 439 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.700458:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064e26837/0x3234de053c524a4 lrc: 4/0,1 mode: PW/PW res: [0x2b994:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.700464:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.700472:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+439:41278:x1731746396404672:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.700474:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12914 00000100:00100000:1.0:1651529344.700479:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12916 00010000:00010000:0.0:1651529344.700480:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e50942f6/0x3234de053c4e7aa lrc: 3/0,0 mode: PR/PR res: [0x2b996:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f46 expref: 438 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.700481:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+438:41278:x1731746396404928:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.700483:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.700484:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009526c053/0x3234de053c4d359 lrc: 4/0,0 mode: PR/PR res: [0x2b999:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff2f expref: 438 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.700486:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e50942f6/0x3234de053c4e7aa lrc: 0/0,0 mode: --/PR res: [0x2b996:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f46 expref: 438 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.700488:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009526c053/0x3234de053c4d359 lrc: 3/0,0 mode: PR/PR res: [0x2b999:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff2f expref: 438 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.700492:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009526c053/0x3234de053c4d359 lrc: 0/0,0 mode: --/PR res: [0x2b999:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff2f expref: 437 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.700492:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.700493:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.700494:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002f86d1dc/0x3234de053c524b2 lrc: 3/0,1 mode: PW/PW res: [0x2b996:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.700496:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.700496:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.700497:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000003e92419/0x3234de053c524c0 lrc: 3/0,1 mode: PW/PW res: [0x2b999:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.700497:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f86d1dc/0x3234de053c524b2 lrc: 4/0,1 mode: PW/PW res: [0x2b996:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.700500:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003e92419/0x3234de053c524c0 lrc: 4/0,1 mode: PW/PW res: [0x2b999:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.700507:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.700511:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.700515:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+436:41278:x1731746396404800:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 65us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.700517:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+436:41278:x1731746396404928:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.700518:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12915 00000100:00100000:1.0:1651529344.700520:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12916 00000100:00100000:1.0:1651529344.700524:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12917 00000100:00100000:1.0:1651529344.700526:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+434:41279:x1731746396404736:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.700526:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12918 00010000:00010000:1.0:1651529344.700528:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.700528:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000f76b19f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+434:41278:x1731746396405056:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.700530:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ae455ecf/0x3234de053c4ebaf lrc: 4/0,0 mode: PR/PR res: [0x2b995:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d606b expref: 434 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.700531:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.700532:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e489761b/0x3234de053c4f5b1 lrc: 4/0,0 mode: PR/PR res: [0x2b99a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8937 expref: 434 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.700534:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ae455ecf/0x3234de053c4ebaf lrc: 3/0,0 mode: PR/PR res: [0x2b995:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d606b expref: 434 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.700536:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e489761b/0x3234de053c4f5b1 lrc: 3/0,0 mode: PR/PR res: [0x2b99a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8937 expref: 434 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.700538:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae455ecf/0x3234de053c4ebaf lrc: 0/0,0 mode: --/PR res: [0x2b995:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d606b expref: 434 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.700541:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.700541:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e489761b/0x3234de053c4f5b1 lrc: 0/0,0 mode: --/PR res: [0x2b99a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8937 expref: 433 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.700542:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.700543:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000021901d62/0x3234de053c524ab lrc: 3/0,1 mode: PW/PW res: [0x2b995:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.700544:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.700545:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.700546:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021901d62/0x3234de053c524ab lrc: 4/0,1 mode: PW/PW res: [0x2b995:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.700546:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e5280238/0x3234de053c524ce lrc: 3/0,1 mode: PW/PW res: [0x2b99a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.700549:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5280238/0x3234de053c524ce lrc: 4/0,1 mode: PW/PW res: [0x2b99a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.700555:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.700560:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+432:41279:x1731746396404736:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 33us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.700562:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12917 00010000:00010000:0.0:1651529344.700562:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.700567:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12919 00000100:00100000:1.0:1651529344.700568:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+431:41279:x1731746396404864:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.700568:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000f76b19f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+431:41278:x1731746396405056:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (178us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.700571:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.700571:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12918 00010000:00010000:1.0:1651529344.700572:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e78a7d44/0x3234de053c4bc4c lrc: 4/0,0 mode: PR/PR res: [0x2b997:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5b5 expref: 431 pid: 80280 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.700576:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e78a7d44/0x3234de053c4bc4c lrc: 3/0,0 mode: PR/PR res: [0x2b997:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5b5 expref: 430 pid: 80280 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.700580:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e78a7d44/0x3234de053c4bc4c lrc: 0/0,0 mode: --/PR res: [0x2b997:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc5b5 expref: 430 pid: 80280 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.700580:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12920 00000100:00100000:0.0:1651529344.700581:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+430:41279:x1731746396404992:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.700584:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.700584:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.700584:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.700585:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006325442a/0x3234de053c524b9 lrc: 3/0,1 mode: PW/PW res: [0x2b997:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.700585:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003c303b27/0x3234de053c4e4e0 lrc: 4/0,0 mode: PR/PR res: [0x2b998:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d44db expref: 429 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.700588:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006325442a/0x3234de053c524b9 lrc: 4/0,1 mode: PW/PW res: [0x2b997:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.700589:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003c303b27/0x3234de053c4e4e0 lrc: 3/0,0 mode: PR/PR res: [0x2b998:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d44db expref: 429 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.700596:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.700600:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+429:41279:x1731746396404864:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 32us (205us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.700600:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c303b27/0x3234de053c4e4e0 lrc: 0/0,0 mode: --/PR res: [0x2b998:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d44db expref: 429 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.700603:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12919 00010000:00010000:0.0:1651529344.700604:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.700605:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.700605:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b19bfe47/0x3234de053c524c7 lrc: 3/0,1 mode: PW/PW res: [0x2b998:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.700610:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000064e26837/0x3234de053c524a4 lrc: 3/0,1 mode: PW/PW res: [0x2b994:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.700610:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b19bfe47/0x3234de053c524c7 lrc: 4/0,1 mode: PW/PW res: [0x2b998:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.700613:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064e26837/0x3234de053c524a4 lrc: 3/0,1 mode: PW/PW res: [0x2b994:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.700616:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064e26837/0x3234de053c524a4 lrc: 3/0,1 mode: PW/PW res: [0x2b994:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.700616:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.700619:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000064e26837/0x3234de053c524a4 lrc: 2/0,0 mode: PW/PW res: [0x2b994:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.700622:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+427:41279:x1731746396404992:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 40us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.700624:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12920 00010000:00010000:0.0:1651529344.700636:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000064e26837/0x3234de053c524a4 lrc: 2/0,0 mode: PW/PW res: [0x2b994:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.700639:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000064e26837 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.700640:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000064e26837/0x3234de053c524a4 lrc: 2/0,0 mode: PW/PW res: [0x2b994:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.700643:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000064e26837/0x3234de053c524a4 lrc: 3/0,0 mode: PW/PW res: [0x2b994:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.700647:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000064e26837/0x3234de053c524a4 lrc: 1/0,0 mode: --/PW res: [0x2b994:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.700650:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064e26837/0x3234de053c524a4 lrc: 0/0,0 mode: --/PW res: [0x2b994:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.700656:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006325442a/0x3234de053c524b9 lrc: 3/0,1 mode: PW/PW res: [0x2b997:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.700659:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006325442a/0x3234de053c524b9 lrc: 3/0,1 mode: PW/PW res: [0x2b997:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.700662:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006325442a/0x3234de053c524b9 lrc: 3/0,1 mode: PW/PW res: [0x2b997:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.700663:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1634:39030:x1731745946523520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1031us (1125us total) trans 12885080187 rc 0/0 00010000:00010000:0.0:1651529344.700665:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006325442a/0x3234de053c524b9 lrc: 2/0,0 mode: PW/PW res: [0x2b997:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.700666:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212132 00010000:00010000:1.0:1651529344.700673:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000003e92419/0x3234de053c524c0 lrc: 3/0,1 mode: PW/PW res: [0x2b999:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.700676:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003e92419/0x3234de053c524c0 lrc: 3/0,1 mode: PW/PW res: [0x2b999:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.700679:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003e92419/0x3234de053c524c0 lrc: 3/0,1 mode: PW/PW res: [0x2b999:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.700682:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003e92419/0x3234de053c524c0 lrc: 2/0,0 mode: PW/PW res: [0x2b999:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.700715:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1635:39029:x1731745946523712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1008us (1132us total) trans 12885080188 rc 0/0 00000100:00100000:0.0:1651529344.700718:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212135 00000100:00100000:1.0:1651529344.700719:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1635:39029:x1731745946523840:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 962us (1121us total) trans 12885080189 rc 0/0 00000100:00100000:1.0:1651529344.700722:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212136 00010000:00010000:0.0:1651529344.700725:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006325442a/0x3234de053c524b9 lrc: 2/0,0 mode: PW/PW res: [0x2b997:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.700728:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006325442a already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.700729:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002f86d1dc/0x3234de053c524b2 lrc: 3/0,1 mode: PW/PW res: [0x2b996:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.700729:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006325442a/0x3234de053c524b9 lrc: 2/0,0 mode: PW/PW res: [0x2b997:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.700732:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f86d1dc/0x3234de053c524b2 lrc: 3/0,1 mode: PW/PW res: [0x2b996:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.700732:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006325442a/0x3234de053c524b9 lrc: 3/0,0 mode: PW/PW res: [0x2b997:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.700745:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f86d1dc/0x3234de053c524b2 lrc: 3/0,1 mode: PW/PW res: [0x2b996:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.700748:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006325442a/0x3234de053c524b9 lrc: 1/0,0 mode: --/PW res: [0x2b997:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.700750:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f86d1dc/0x3234de053c524b2 lrc: 2/0,0 mode: PW/PW res: [0x2b996:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.700751:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006325442a/0x3234de053c524b9 lrc: 0/0,0 mode: --/PW res: [0x2b997:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.700756:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003e92419/0x3234de053c524c0 lrc: 2/0,0 mode: PW/PW res: [0x2b999:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.700764:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000003e92419 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.700765:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003e92419/0x3234de053c524c0 lrc: 2/0,0 mode: PW/PW res: [0x2b999:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.700768:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003e92419/0x3234de053c524c0 lrc: 3/0,0 mode: PW/PW res: [0x2b999:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.700771:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003e92419/0x3234de053c524c0 lrc: 1/0,0 mode: --/PW res: [0x2b999:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.700774:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003e92419/0x3234de053c524c0 lrc: 0/0,0 mode: --/PW res: [0x2b999:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.700778:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f86d1dc/0x3234de053c524b2 lrc: 2/0,0 mode: PW/PW res: [0x2b996:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.700780:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002f86d1dc already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.700781:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f86d1dc/0x3234de053c524b2 lrc: 2/0,0 mode: PW/PW res: [0x2b996:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.700783:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f86d1dc/0x3234de053c524b2 lrc: 3/0,0 mode: PW/PW res: [0x2b996:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.700786:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f86d1dc/0x3234de053c524b2 lrc: 1/0,0 mode: --/PW res: [0x2b996:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.700787:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1634:39030:x1731745946523648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1088us (1215us total) trans 12885080190 rc 0/0 00010000:00010000:0.0:1651529344.700789:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f86d1dc/0x3234de053c524b2 lrc: 0/0,0 mode: --/PW res: [0x2b996:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.700790:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212134 00010000:00010000:0.0:1651529344.700795:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b19bfe47/0x3234de053c524c7 lrc: 3/0,1 mode: PW/PW res: [0x2b998:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.700799:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b19bfe47/0x3234de053c524c7 lrc: 3/0,1 mode: PW/PW res: [0x2b998:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.700802:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b19bfe47/0x3234de053c524c7 lrc: 3/0,1 mode: PW/PW res: [0x2b998:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.700804:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b19bfe47/0x3234de053c524c7 lrc: 2/0,0 mode: PW/PW res: [0x2b998:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.700829:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.700840:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1634:39030:x1731745946523776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1078us (1252us total) trans 12885080191 rc 0/0 00000100:00100000:0.0:1651529344.700843:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212137 00010000:00010000:0.0:1651529344.700850:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b19bfe47/0x3234de053c524c7 lrc: 2/0,0 mode: PW/PW res: [0x2b998:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.700853:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b19bfe47 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.700854:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b19bfe47/0x3234de053c524c7 lrc: 2/0,0 mode: PW/PW res: [0x2b998:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.700857:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b19bfe47/0x3234de053c524c7 lrc: 3/0,0 mode: PW/PW res: [0x2b998:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.700861:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b19bfe47/0x3234de053c524c7 lrc: 1/0,0 mode: --/PW res: [0x2b998:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.700864:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b19bfe47/0x3234de053c524c7 lrc: 0/0,0 mode: --/PW res: [0x2b998:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.700870:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000021901d62/0x3234de053c524ab lrc: 3/0,1 mode: PW/PW res: [0x2b995:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.700873:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021901d62/0x3234de053c524ab lrc: 3/0,1 mode: PW/PW res: [0x2b995:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.700876:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021901d62/0x3234de053c524ab lrc: 3/0,1 mode: PW/PW res: [0x2b995:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.700878:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021901d62/0x3234de053c524ab lrc: 2/0,0 mode: PW/PW res: [0x2b995:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.700911:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1634:39029:x1731745946523584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1257us (1347us total) trans 12885080192 rc 0/0 00000100:00100000:0.0:1651529344.700914:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212133 00010000:00010000:0.0:1651529344.700920:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021901d62/0x3234de053c524ab lrc: 2/0,0 mode: PW/PW res: [0x2b995:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.700923:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000021901d62 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.700924:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021901d62/0x3234de053c524ab lrc: 2/0,0 mode: PW/PW res: [0x2b995:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.700944:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021901d62/0x3234de053c524ab lrc: 3/0,0 mode: PW/PW res: [0x2b995:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.700949:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021901d62/0x3234de053c524ab lrc: 1/0,0 mode: --/PW res: [0x2b995:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.700952:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021901d62/0x3234de053c524ab lrc: 0/0,0 mode: --/PW res: [0x2b995:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.700957:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396405120 00010000:00010000:0.0:1651529344.700959:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e5280238/0x3234de053c524ce lrc: 3/0,1 mode: PW/PW res: [0x2b99a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.700961:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5280238/0x3234de053c524ce lrc: 3/0,1 mode: PW/PW res: [0x2b99a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.700963:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000088e7ee5/0x3234de053c4e041 lrc: 5/0,0 mode: PR/PR res: [0x2b99b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d320b expref: 427 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.700964:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5280238/0x3234de053c524ce lrc: 3/0,1 mode: PW/PW res: [0x2b99a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.700967:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5280238/0x3234de053c524ce lrc: 2/0,0 mode: PW/PW res: [0x2b99a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.700975:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12921 00000100:00100000:1.0:1651529344.700976:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+427:41279:x1731746396405120:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.700979:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.700980:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000088e7ee5/0x3234de053c4e041 lrc: 5/0,0 mode: PR/PR res: [0x2b99b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d320b expref: 427 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.700984:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000088e7ee5/0x3234de053c4e041 lrc: 4/0,0 mode: PR/PR res: [0x2b99b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d320b expref: 427 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.700990:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.700990:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.700991:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000085cf969e/0x3234de053c524d5 lrc: 3/0,1 mode: PW/PW res: [0x2b99b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.700994:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085cf969e/0x3234de053c524d5 lrc: 4/0,1 mode: PW/PW res: [0x2b99b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.700999:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.701008:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+427:41279:x1731746396405120:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 31us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.701011:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12921 00010000:00010000:1.0:1651529344.701019:0:72397:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000088e7ee5/0x3234de053c4e041 lrc: 0/0,0 mode: --/PR res: [0x2b99b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d320b expref: 426 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.701023:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997043648:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.701027:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000085cf969e/0x3234de053c524d5 lrc: 3/0,1 mode: PW/PW res: [0x2b99b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.701030:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000085cf969e/0x3234de053c524d5 lrc: 3/0,1 mode: PW/PW res: [0x2b99b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.701033:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085cf969e/0x3234de053c524d5 lrc: 3/0,1 mode: PW/PW res: [0x2b99b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.701035:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085cf969e/0x3234de053c524d5 lrc: 3/0,1 mode: PW/PW res: [0x2b99b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.701038:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085cf969e/0x3234de053c524d5 lrc: 2/0,0 mode: PW/PW res: [0x2b99b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.701053:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1634:39029:x1731745946523904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1222us (1238us total) trans 12885080193 rc 0/0 00000100:00100000:0.0:1651529344.701056:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212138 00010000:00010000:0.0:1651529344.701063:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5280238/0x3234de053c524ce lrc: 2/0,0 mode: PW/PW res: [0x2b99a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.701066:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e5280238 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.701067:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5280238/0x3234de053c524ce lrc: 2/0,0 mode: PW/PW res: [0x2b99a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.701071:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5280238/0x3234de053c524ce lrc: 3/0,0 mode: PW/PW res: [0x2b99a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.701075:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5280238/0x3234de053c524ce lrc: 1/0,0 mode: --/PW res: [0x2b99a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.701078:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5280238/0x3234de053c524ce lrc: 0/0,0 mode: --/PW res: [0x2b99a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.701079:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1634:39030:x1731745946523968:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 869us (889us total) trans 12885080194 rc 0/0 00010000:00010000:0.0:1651529344.701082:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085cf969e/0x3234de053c524d5 lrc: 2/0,0 mode: PW/PW res: [0x2b99b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.701084:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212139 00010000:00010000:0.0:1651529344.701085:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000085cf969e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.701086:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085cf969e/0x3234de053c524d5 lrc: 2/0,0 mode: PW/PW res: [0x2b99b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.701088:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085cf969e/0x3234de053c524d5 lrc: 3/0,0 mode: PW/PW res: [0x2b99b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.701099:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.701120:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085cf969e/0x3234de053c524d5 lrc: 1/0,0 mode: --/PW res: [0x2b99b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.701123:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085cf969e/0x3234de053c524d5 lrc: 0/0,0 mode: --/PW res: [0x2b99b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.701148:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.701161:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946524032 00000100:00100000:1.0:1651529344.701175:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946524160 00000100:00100000:1.0:1651529344.701186:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212140 00000100:00100000:1.0:1651529344.701188:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1635:39030:x1731745946524032:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.701189:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212141 00000100:00100000:0.0:1651529344.701191:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1635:39030:x1731745946524160:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.701193:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178588 count 1 00002000:00080000:0.0:1651529344.701197:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178590 count 1 00010000:00010000:1.0:1651529344.701198:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070346c06/0x3234de053c524dc lrc: 3/0,1 mode: --/PW res: [0x2b99c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.701201:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000437ad37b/0x3234de053c524e3 lrc: 3/0,1 mode: --/PW res: [0x2b99e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.701203:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000096ef4f27/0x3234de053c4f667 lrc: 2/0,0 mode: PR/PR res: [0x2b99c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c47 expref: 425 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.701206:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.701206:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000431bd54f/0x3234de053c4cc4b lrc: 2/0,0 mode: PR/PR res: [0x2b99e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce2b1 expref: 425 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.701207:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.701207:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070346c06/0x3234de053c524dc lrc: 4/0,1 mode: --/PW res: [0x2b99c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.701209:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.701210:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.701210:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000437ad37b/0x3234de053c524e3 lrc: 4/0,1 mode: --/PW res: [0x2b99e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.701214:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000096ef4f27/0x3234de053c4f667 lrc: 3/0,0 mode: PR/PR res: [0x2b99c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c47 expref: 425 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.701218:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000096ef4f27/0x3234de053c4f667 lrc: 4/0,0 mode: PR/PR res: [0x2b99c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c47 expref: 425 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.701218:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000431bd54f/0x3234de053c4cc4b lrc: 3/0,0 mode: PR/PR res: [0x2b99e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce2b1 expref: 425 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.701221:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000431bd54f/0x3234de053c4cc4b lrc: 4/0,0 mode: PR/PR res: [0x2b99e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce2b1 expref: 425 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.701233:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997043712:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.701241:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005d3fb3ef pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997043776:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.701252:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 0000000020dd7827 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.701257:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000003678d25f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.701266:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.701276:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.701285:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.701293:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.701297:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946524096 00000100:00100000:0.0:1651529344.701305:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946524288 00000100:00100000:1.0:1651529344.701307:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946524224 00000100:00100000:1.0:1651529344.701315:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946524352 00000100:00100000:1.0:1651529344.701323:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212142 00000100:00100000:1.0:1651529344.701324:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1639:39029:x1731745946524096:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.701329:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178589 count 1 00000100:00100000:0.0:1651529344.701335:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212143 00000100:00100000:0.0:1651529344.701337:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004b1864ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1639:39029:x1731745946524224:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.701338:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c524ea lrc: 3/0,1 mode: --/PW res: [0x2b99d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.701343:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000061dc25ab/0x3234de053c4cc59 lrc: 2/0,0 mode: PR/PR res: [0x2b99d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce313 expref: 425 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.701343:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178591 count 1 00010000:00010000:1.0:1651529344.701346:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.701347:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.701347:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005206389b/0x3234de053c524f1 lrc: 3/0,1 mode: --/PW res: [0x2b99f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.701348:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c524ea lrc: 4/0,1 mode: --/PW res: [0x2b99d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.701354:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000061dc25ab/0x3234de053c4cc59 lrc: 3/0,0 mode: PR/PR res: [0x2b99d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce313 expref: 425 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.701354:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000598b89a9/0x3234de053c4d623 lrc: 2/0,0 mode: PR/PR res: [0x2b99f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a18 expref: 425 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.701357:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.701358:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000061dc25ab/0x3234de053c4cc59 lrc: 4/0,0 mode: PR/PR res: [0x2b99d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce313 expref: 425 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.701358:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.701358:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005206389b/0x3234de053c524f1 lrc: 4/0,1 mode: --/PW res: [0x2b99f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.701362:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000027e31dd1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997043840:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.701365:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000598b89a9/0x3234de053c4d623 lrc: 3/0,0 mode: PR/PR res: [0x2b99f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a18 expref: 425 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.701368:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000598b89a9/0x3234de053c4d623 lrc: 4/0,0 mode: PR/PR res: [0x2b99f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a18 expref: 425 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.701372:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b52d0f36 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.701377:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212144 00000100:00100000:1.0:1651529344.701379:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1639:39030:x1731745946524352:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.701383:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178593 count 1 00010000:00010000:1.0:1651529344.701386:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c524f8 lrc: 3/0,1 mode: --/PW res: [0x2b9a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.701386:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002f77bb41 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997043904:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.701390:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b076020b/0x3234de053c4ee8e lrc: 2/0,0 mode: PR/PR res: [0x2b9a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c34 expref: 425 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.701393:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.701394:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.701395:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c524f8 lrc: 4/0,1 mode: --/PW res: [0x2b9a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.701396:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 000000000a4def41 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.701400:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b076020b/0x3234de053c4ee8e lrc: 3/0,0 mode: PR/PR res: [0x2b9a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c34 expref: 425 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.701403:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212145 00010000:00010000:1.0:1651529344.701404:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b076020b/0x3234de053c4ee8e lrc: 4/0,0 mode: PR/PR res: [0x2b9a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c34 expref: 425 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.701405:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1639:39030:x1731745946524288:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.701408:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000012863683 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997043968:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.701414:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a4eb401d going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.701422:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178592 count 1 00010000:00010000:0.0:1651529344.701426:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099a3e2d9/0x3234de053c524ff lrc: 3/0,1 mode: --/PW res: [0x2b9a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.701427:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.701430:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006420cb61/0x3234de053c4e4fc lrc: 2/0,0 mode: PR/PR res: [0x2b9a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4521 expref: 425 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.701433:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.701434:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.701435:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099a3e2d9/0x3234de053c524ff lrc: 4/0,1 mode: --/PW res: [0x2b9a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.701441:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006420cb61/0x3234de053c4e4fc lrc: 3/0,0 mode: PR/PR res: [0x2b9a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4521 expref: 425 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.701445:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006420cb61/0x3234de053c4e4fc lrc: 4/0,0 mode: PR/PR res: [0x2b9a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4521 expref: 425 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.701449:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.701449:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002f363f4a pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997044032:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.701457:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 0000000049203969 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.701463:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946524416 00000100:00100000:0.0:1651529344.701473:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946524480 00000100:00100000:0.0:1651529344.701479:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212146 00000100:00100000:0.0:1651529344.701481:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1641:39030:x1731745946524416:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.701496:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178594 count 1 00010000:00010000:0.0:1651529344.701500:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52506 lrc: 3/0,1 mode: --/PW res: [0x2b9a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.701505:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000054170bb5/0x3234de053c4d31a lrc: 2/0,0 mode: PR/PR res: [0x2b9a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe56 expref: 425 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.701508:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.701509:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.701509:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52506 lrc: 4/0,1 mode: --/PW res: [0x2b9a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.701522:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000054170bb5/0x3234de053c4d31a lrc: 3/0,0 mode: PR/PR res: [0x2b9a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe56 expref: 425 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.701523:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.701532:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.701532:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000054170bb5/0x3234de053c4d31a lrc: 4/0,0 mode: PR/PR res: [0x2b9a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe56 expref: 425 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.701536:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029abc941 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997044096:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.701540:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212147 00000100:00100000:1.0:1651529344.701542:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1641:39029:x1731745946524480:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.701548:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178595 count 1 00010000:00010000:1.0:1651529344.701551:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c5250d lrc: 3/0,1 mode: --/PW res: [0x2b9a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.701556:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000064e77e0b/0x3234de053c4cd8d lrc: 2/0,0 mode: PR/PR res: [0x2b9a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce814 expref: 425 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.701559:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.701562:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c086aae3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.701566:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.701567:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c5250d lrc: 4/0,1 mode: --/PW res: [0x2b9a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.701570:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005d3fb3ef pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997043776:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.701593:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000064e77e0b/0x3234de053c4cd8d lrc: 3/0,0 mode: PR/PR res: [0x2b9a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce814 expref: 425 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.701595:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000437ad37b/0x3234de053c524e3 lrc: 3/0,1 mode: --/PW res: [0x2b99e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.701603:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000064e77e0b/0x3234de053c4cd8d lrc: 4/0,0 mode: PR/PR res: [0x2b9a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce814 expref: 425 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.701607:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997044160:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.701616:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8a0b704 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.701630:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396405184 00010000:00010000:1.0:1651529344.701635:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000096ef4f27/0x3234de053c4f667 lrc: 5/0,0 mode: PR/PR res: [0x2b99c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c47 expref: 426 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.701642:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396405248 00010000:00010000:1.0:1651529344.701644:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000431bd54f/0x3234de053c4cc4b lrc: 4/0,0 mode: PR/PR res: [0x2b99e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce2b1 expref: 427 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.701653:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12922 00000100:00100000:0.0:1651529344.701666:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002f77bb41 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997043904:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.701669:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+427:41278:x1731746396405184:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.701670:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005206389b/0x3234de053c524f1 lrc: 3/0,1 mode: --/PW res: [0x2b99f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.701672:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.701673:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000096ef4f27/0x3234de053c4f667 lrc: 5/0,0 mode: PR/PR res: [0x2b99c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c47 expref: 427 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.701678:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000096ef4f27/0x3234de053c4f667 lrc: 4/0,0 mode: PR/PR res: [0x2b99c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c47 expref: 427 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.701678:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12923 00000100:00100000:0.0:1651529344.701680:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+427:41278:x1731746396405248:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.701683:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.701683:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.701684:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.701685:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000070346c06/0x3234de053c524dc lrc: 3/0,1 mode: PW/PW res: [0x2b99c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.701685:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000431bd54f/0x3234de053c4cc4b lrc: 4/0,0 mode: PR/PR res: [0x2b99e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce2b1 expref: 427 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.701688:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070346c06/0x3234de053c524dc lrc: 4/0,1 mode: PW/PW res: [0x2b99c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.701688:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000431bd54f/0x3234de053c4cc4b lrc: 3/0,0 mode: PR/PR res: [0x2b99e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce2b1 expref: 427 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.701693:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.701694:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000431bd54f/0x3234de053c4cc4b lrc: 0/0,0 mode: --/PR res: [0x2b99e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce2b1 expref: 427 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.701698:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.701699:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.701700:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000437ad37b/0x3234de053c524e3 lrc: 3/0,1 mode: PW/PW res: [0x2b99e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.701703:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+426:41278:x1731746396405184:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 48us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.701706:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12922 00010000:00010000:0.0:1651529344.701709:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000437ad37b/0x3234de053c524e3 lrc: 4/0,1 mode: PW/PW res: [0x2b99e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.701715:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.701718:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000012863683 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997043968:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.701721:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c524f8 lrc: 3/0,1 mode: --/PW res: [0x2b9a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.701722:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+425:41278:x1731746396405248:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.701725:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12923 00000100:00100000:1.0:1651529344.701731:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000027e31dd1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997043840:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.701732:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000437ad37b/0x3234de053c524e3 lrc: 3/0,1 mode: PW/PW res: [0x2b99e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.701733:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c524ea lrc: 3/0,1 mode: --/PW res: [0x2b99d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.701745:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000437ad37b/0x3234de053c524e3 lrc: 3/0,1 mode: PW/PW res: [0x2b99e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.701748:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000437ad37b/0x3234de053c524e3 lrc: 3/0,1 mode: PW/PW res: [0x2b99e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.701749:0:72397:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096ef4f27/0x3234de053c4f667 lrc: 0/0,0 mode: --/PR res: [0x2b99c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8c47 expref: 424 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.701751:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000437ad37b/0x3234de053c524e3 lrc: 2/0,0 mode: PW/PW res: [0x2b99e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.701753:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997043712:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.701756:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000070346c06/0x3234de053c524dc lrc: 3/0,1 mode: PW/PW res: [0x2b99c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.701759:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000070346c06/0x3234de053c524dc lrc: 3/0,1 mode: PW/PW res: [0x2b99c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.701762:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070346c06/0x3234de053c524dc lrc: 3/0,1 mode: PW/PW res: [0x2b99c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.701765:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070346c06/0x3234de053c524dc lrc: 3/0,1 mode: PW/PW res: [0x2b99c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.701768:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070346c06/0x3234de053c524dc lrc: 2/0,0 mode: PW/PW res: [0x2b99c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.701799:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1643:39030:x1731745946524160:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 607us (651us total) trans 12885080195 rc 0/0 00000100:00100000:0.0:1651529344.701802:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212141 00000100:00100000:1.0:1651529344.701810:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1642:39030:x1731745946524032:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 621us (711us total) trans 12885080196 rc 0/0 00010000:00010000:0.0:1651529344.701810:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000437ad37b/0x3234de053c524e3 lrc: 2/0,0 mode: PW/PW res: [0x2b99e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.701813:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000437ad37b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.701814:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000437ad37b/0x3234de053c524e3 lrc: 2/0,0 mode: PW/PW res: [0x2b99e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.701815:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212140 00010000:00010000:0.0:1651529344.701817:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000437ad37b/0x3234de053c524e3 lrc: 3/0,0 mode: PW/PW res: [0x2b99e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.701821:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000437ad37b/0x3234de053c524e3 lrc: 1/0,0 mode: --/PW res: [0x2b99e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.701824:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000437ad37b/0x3234de053c524e3 lrc: 0/0,0 mode: --/PW res: [0x2b99e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.701829:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070346c06/0x3234de053c524dc lrc: 2/0,0 mode: PW/PW res: [0x2b99c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.701832:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000070346c06 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.701832:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070346c06/0x3234de053c524dc lrc: 2/0,0 mode: PW/PW res: [0x2b99c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.701835:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070346c06/0x3234de053c524dc lrc: 3/0,0 mode: PW/PW res: [0x2b99c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.701838:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070346c06/0x3234de053c524dc lrc: 1/0,0 mode: --/PW res: [0x2b99c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.701843:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070346c06/0x3234de053c524dc lrc: 0/0,0 mode: --/PW res: [0x2b99c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.701921:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.701931:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396405312 00000100:00100000:0.0:1651529344.701933:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.701937:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000061dc25ab/0x3234de053c4cc59 lrc: 4/0,0 mode: PR/PR res: [0x2b99d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce313 expref: 424 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.701959:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396405440 00010000:00010000:1.0:1651529344.701968:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b076020b/0x3234de053c4ee8e lrc: 4/0,0 mode: PR/PR res: [0x2b9a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c34 expref: 425 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.701974:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.701975:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12924 00000100:00100000:1.0:1651529344.701977:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+425:41278:x1731746396405312:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.701980:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.701980:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.701981:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000061dc25ab/0x3234de053c4cc59 lrc: 4/0,0 mode: PR/PR res: [0x2b99d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce313 expref: 425 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.701985:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000061dc25ab/0x3234de053c4cc59 lrc: 3/0,0 mode: PR/PR res: [0x2b99d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce313 expref: 425 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.701990:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061dc25ab/0x3234de053c4cc59 lrc: 0/0,0 mode: --/PR res: [0x2b99d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce313 expref: 425 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.701999:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.702000:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.702000:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.702001:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c524ea lrc: 3/0,1 mode: PW/PW res: [0x2b99d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.702004:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c524ea lrc: 4/0,1 mode: PW/PW res: [0x2b99d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.702004:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.702011:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.702012:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002f363f4a pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997044032:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.702016:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000099a3e2d9/0x3234de053c524ff lrc: 3/0,1 mode: --/PW res: [0x2b9a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.702019:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+424:41278:x1731746396405312:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.702022:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12924 00000100:00100000:1.0:1651529344.702027:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396405376 00010000:00010000:1.0:1651529344.702030:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000598b89a9/0x3234de053c4d623 lrc: 4/0,0 mode: PR/PR res: [0x2b99f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a18 expref: 424 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.702034:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396405504 00010000:00010000:1.0:1651529344.702036:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006420cb61/0x3234de053c4e4fc lrc: 4/0,0 mode: PR/PR res: [0x2b9a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4521 expref: 425 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.702040:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396405568 00000100:00100000:0.0:1651529344.702040:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029abc941 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997044096:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.702042:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000054170bb5/0x3234de053c4d31a lrc: 4/0,0 mode: PR/PR res: [0x2b9a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe56 expref: 426 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.702043:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52506 lrc: 3/0,1 mode: --/PW res: [0x2b9a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.702046:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396405632 00010000:00010000:1.0:1651529344.702048:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000064e77e0b/0x3234de053c4cd8d lrc: 5/0,0 mode: PR/PR res: [0x2b9a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce814 expref: 427 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.702052:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12925 00000100:00100000:1.0:1651529344.702054:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000e855587 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+427:41278:x1731746396405440:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.702055:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.702056:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.702057:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b076020b/0x3234de053c4ee8e lrc: 4/0,0 mode: PR/PR res: [0x2b9a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c34 expref: 427 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.702070:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b076020b/0x3234de053c4ee8e lrc: 3/0,0 mode: PR/PR res: [0x2b9a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c34 expref: 427 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.702075:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b076020b/0x3234de053c4ee8e lrc: 0/0,0 mode: --/PR res: [0x2b9a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c34 expref: 427 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.702078:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.702079:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.702079:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c524f8 lrc: 3/0,1 mode: PW/PW res: [0x2b9a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.702084:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.702089:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c524f8 lrc: 4/0,1 mode: PW/PW res: [0x2b9a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.702092:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946524544 00010000:00010000:1.0:1651529344.702096:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.702101:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946524608 00000100:00100000:0.0:1651529344.702107:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212148 00000100:00100000:0.0:1651529344.702109:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1643:39030:x1731745946524544:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.702114:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000e855587 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+426:41278:x1731746396405440:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 60us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.702117:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12925 00002000:00080000:0.0:1651529344.702120:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178596 count 1 00010000:00010000:0.0:1651529344.702124:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52514 lrc: 3/0,1 mode: --/PW res: [0x2b9a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.702126:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12926 00000100:00100000:1.0:1651529344.702128:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+425:41279:x1731746396405376:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.702129:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000abd19bdc/0x3234de053c4d899 lrc: 2/0,0 mode: PR/PR res: [0x2b9a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1317 expref: 425 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.702131:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.702132:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000598b89a9/0x3234de053c4d623 lrc: 4/0,0 mode: PR/PR res: [0x2b99f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a18 expref: 425 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.702132:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.702133:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.702134:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52514 lrc: 4/0,1 mode: --/PW res: [0x2b9a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.702136:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000598b89a9/0x3234de053c4d623 lrc: 3/0,0 mode: PR/PR res: [0x2b99f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a18 expref: 425 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.702140:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000abd19bdc/0x3234de053c4d899 lrc: 3/0,0 mode: PR/PR res: [0x2b9a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1317 expref: 425 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.702141:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000598b89a9/0x3234de053c4d623 lrc: 0/0,0 mode: --/PR res: [0x2b99f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0a18 expref: 425 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.702144:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000abd19bdc/0x3234de053c4d899 lrc: 4/0,0 mode: PR/PR res: [0x2b9a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1317 expref: 425 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.702145:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.702145:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.702146:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005206389b/0x3234de053c524f1 lrc: 3/0,1 mode: PW/PW res: [0x2b99f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.702148:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000824ca843 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997044224:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.702149:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005206389b/0x3234de053c524f1 lrc: 4/0,1 mode: PW/PW res: [0x2b99f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.702157:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.702162:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+424:41279:x1731746396405376:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 34us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.702163:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000000a4def41 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.702165:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12926 00010000:00010000:0.0:1651529344.702168:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005206389b/0x3234de053c524f1 lrc: 3/0,1 mode: PW/PW res: [0x2b99f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.702169:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12927 00000100:00100000:1.0:1651529344.702170:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+423:41279:x1731746396405504:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.702171:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005206389b/0x3234de053c524f1 lrc: 3/0,1 mode: PW/PW res: [0x2b99f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.702173:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.702174:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006420cb61/0x3234de053c4e4fc lrc: 4/0,0 mode: PR/PR res: [0x2b9a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4521 expref: 423 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.702174:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005206389b/0x3234de053c524f1 lrc: 3/0,1 mode: PW/PW res: [0x2b99f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.702177:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006420cb61/0x3234de053c4e4fc lrc: 3/0,0 mode: PR/PR res: [0x2b9a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4521 expref: 423 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.702177:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005206389b/0x3234de053c524f1 lrc: 2/0,0 mode: PW/PW res: [0x2b99f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.702182:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006420cb61/0x3234de053c4e4fc lrc: 0/0,0 mode: --/PR res: [0x2b9a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4521 expref: 423 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.702188:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.702188:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.702189:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000099a3e2d9/0x3234de053c524ff lrc: 3/0,1 mode: PW/PW res: [0x2b9a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.702192:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099a3e2d9/0x3234de053c524ff lrc: 4/0,1 mode: PW/PW res: [0x2b9a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.702200:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.702204:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+422:41279:x1731746396405504:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.702206:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12927 00000100:00100000:1.0:1651529344.702210:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12928 00000100:00100000:1.0:1651529344.702211:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+421:41279:x1731746396405568:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.702213:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.702215:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000054170bb5/0x3234de053c4d31a lrc: 4/0,0 mode: PR/PR res: [0x2b9a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe56 expref: 421 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.702218:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000054170bb5/0x3234de053c4d31a lrc: 3/0,0 mode: PR/PR res: [0x2b9a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe56 expref: 421 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.702240:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054170bb5/0x3234de053c4d31a lrc: 0/0,0 mode: --/PR res: [0x2b9a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfe56 expref: 421 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.702244:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.702244:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.702245:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52506 lrc: 3/0,1 mode: PW/PW res: [0x2b9a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.702245:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004b1864ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1644:39029:x1731745946524224:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 907us (960us total) trans 12885080197 rc 0/0 00010000:00010000:1.0:1651529344.702248:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52506 lrc: 4/0,1 mode: PW/PW res: [0x2b9a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.702249:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212143 00010000:00010000:1.0:1651529344.702256:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.702260:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212149 00000100:00100000:1.0:1651529344.702262:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+420:41279:x1731746396405568:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 50us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.702262:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1643:39029:x1731745946524608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.702264:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12928 00002000:00080000:0.0:1651529344.702267:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178597 count 1 00000100:00100000:1.0:1651529344.702268:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12929 00000100:00100000:1.0:1651529344.702270:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+419:41279:x1731746396405632:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.702271:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c5251b lrc: 3/0,1 mode: --/PW res: [0x2b9a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.702272:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.702273:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000064e77e0b/0x3234de053c4cd8d lrc: 5/0,0 mode: PR/PR res: [0x2b9a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce814 expref: 419 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.702276:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006402a0e3/0x3234de053c49f5e lrc: 2/0,0 mode: PR/PR res: [0x2b9a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb3b0 expref: 419 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.702277:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000064e77e0b/0x3234de053c4cd8d lrc: 4/0,0 mode: PR/PR res: [0x2b9a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce814 expref: 419 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.702279:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.702279:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.702280:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c5251b lrc: 4/0,1 mode: --/PW res: [0x2b9a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.702281:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.702282:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.702283:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c5250d lrc: 3/0,1 mode: PW/PW res: [0x2b9a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.702286:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c5250d lrc: 4/0,1 mode: PW/PW res: [0x2b9a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.702287:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006402a0e3/0x3234de053c49f5e lrc: 3/0,0 mode: PR/PR res: [0x2b9a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb3b0 expref: 419 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.702290:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.702290:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006402a0e3/0x3234de053c49f5e lrc: 4/0,0 mode: PR/PR res: [0x2b9a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb3b0 expref: 419 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.702294:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+419:41279:x1731746396405632:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 23us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.702294:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ebb53b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997044288:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.702296:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12929 00000100:00100000:0.0:1651529344.702302:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 000000003678d25f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.702307:0:80278:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064e77e0b/0x3234de053c4cd8d lrc: 0/0,0 mode: --/PR res: [0x2b9a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce814 expref: 418 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.702307:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005206389b/0x3234de053c524f1 lrc: 2/0,0 mode: PW/PW res: [0x2b99f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.702310:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997044160:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.702310:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005206389b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.702311:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005206389b/0x3234de053c524f1 lrc: 2/0,0 mode: PW/PW res: [0x2b99f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.702314:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c5250d lrc: 3/0,1 mode: PW/PW res: [0x2b9a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.702314:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005206389b/0x3234de053c524f1 lrc: 3/0,0 mode: PW/PW res: [0x2b99f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.702317:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c5250d lrc: 3/0,1 mode: PW/PW res: [0x2b9a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.702319:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005206389b/0x3234de053c524f1 lrc: 1/0,0 mode: --/PW res: [0x2b99f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.702320:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c5250d lrc: 3/0,1 mode: PW/PW res: [0x2b9a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.702321:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005206389b/0x3234de053c524f1 lrc: 0/0,0 mode: --/PW res: [0x2b99f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.702323:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c5250d lrc: 3/0,1 mode: PW/PW res: [0x2b9a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.702325:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c5250d lrc: 2/0,0 mode: PW/PW res: [0x2b9a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.702327:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000099a3e2d9/0x3234de053c524ff lrc: 3/0,1 mode: PW/PW res: [0x2b9a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.702330:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099a3e2d9/0x3234de053c524ff lrc: 3/0,1 mode: PW/PW res: [0x2b9a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.702340:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099a3e2d9/0x3234de053c524ff lrc: 3/0,1 mode: PW/PW res: [0x2b9a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.702343:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099a3e2d9/0x3234de053c524ff lrc: 2/0,0 mode: PW/PW res: [0x2b9a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.702367:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1645:39029:x1731745946524480:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 824us (918us total) trans 12885080198 rc 0/0 00000100:00100000:1.0:1651529344.702370:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212147 00010000:00010000:1.0:1651529344.702377:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c524ea lrc: 3/0,1 mode: PW/PW res: [0x2b99d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.702381:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1644:39030:x1731745946524288:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 975us (1105us total) trans 12885080199 rc 0/0 00010000:00010000:1.0:1651529344.702383:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c524ea lrc: 3/0,1 mode: PW/PW res: [0x2b99d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.702385:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212145 00010000:00010000:1.0:1651529344.702386:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c524ea lrc: 3/0,1 mode: PW/PW res: [0x2b99d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.702388:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c524ea lrc: 2/0,0 mode: PW/PW res: [0x2b99d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.702392:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c5250d lrc: 2/0,0 mode: PW/PW res: [0x2b9a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.702402:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cde66bc6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.702403:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c5250d lrc: 2/0,0 mode: PW/PW res: [0x2b9a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.702406:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c5250d lrc: 3/0,0 mode: PW/PW res: [0x2b9a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.702411:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c5250d lrc: 1/0,0 mode: --/PW res: [0x2b9a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.702413:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c5250d lrc: 0/0,0 mode: --/PW res: [0x2b9a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.702417:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099a3e2d9/0x3234de053c524ff lrc: 2/0,0 mode: PW/PW res: [0x2b9a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.702420:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000099a3e2d9 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.702421:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099a3e2d9/0x3234de053c524ff lrc: 2/0,0 mode: PW/PW res: [0x2b9a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.702424:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099a3e2d9/0x3234de053c524ff lrc: 3/0,0 mode: PW/PW res: [0x2b9a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.702425:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1644:39029:x1731745946524096:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1100us (1159us total) trans 12885080200 rc 0/0 00000100:00100000:1.0:1651529344.702428:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212142 00010000:00010000:0.0:1651529344.702429:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099a3e2d9/0x3234de053c524ff lrc: 1/0,0 mode: --/PW res: [0x2b9a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.702432:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099a3e2d9/0x3234de053c524ff lrc: 0/0,0 mode: --/PW res: [0x2b9a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.702435:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c524ea lrc: 2/0,0 mode: PW/PW res: [0x2b99d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.702438:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000490515f1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.702439:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c524ea lrc: 2/0,0 mode: PW/PW res: [0x2b99d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.702441:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c524ea lrc: 3/0,0 mode: PW/PW res: [0x2b99d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.702445:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c524ea lrc: 1/0,0 mode: --/PW res: [0x2b99d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.702446:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c524f8 lrc: 3/0,1 mode: PW/PW res: [0x2b9a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.702447:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c524ea lrc: 0/0,0 mode: --/PW res: [0x2b99d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.702450:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c524f8 lrc: 3/0,1 mode: PW/PW res: [0x2b9a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.702453:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c524f8 lrc: 3/0,1 mode: PW/PW res: [0x2b9a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.702453:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52506 lrc: 3/0,1 mode: PW/PW res: [0x2b9a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.702456:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c524f8 lrc: 2/0,0 mode: PW/PW res: [0x2b9a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.702456:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52506 lrc: 3/0,1 mode: PW/PW res: [0x2b9a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.702461:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52506 lrc: 3/0,1 mode: PW/PW res: [0x2b9a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.702469:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52506 lrc: 2/0,0 mode: PW/PW res: [0x2b9a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.702493:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1645:39030:x1731745946524352:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1113us (1200us total) trans 12885080201 rc 0/0 00000100:00100000:1.0:1651529344.702497:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212144 00000100:00100000:0.0:1651529344.702505:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1644:39030:x1731745946524416:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1023us (1078us total) trans 12885080202 rc 0/0 00000100:00100000:0.0:1651529344.702508:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212146 00010000:00010000:0.0:1651529344.702515:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c524f8 lrc: 2/0,0 mode: PW/PW res: [0x2b9a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.702518:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009e44ce9d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.702519:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c524f8 lrc: 2/0,0 mode: PW/PW res: [0x2b9a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.702522:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c524f8 lrc: 3/0,0 mode: PW/PW res: [0x2b9a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.702526:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c524f8 lrc: 1/0,0 mode: --/PW res: [0x2b9a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.702529:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c524f8 lrc: 0/0,0 mode: --/PW res: [0x2b9a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.702533:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52506 lrc: 2/0,0 mode: PW/PW res: [0x2b9a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.702536:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006401eb97 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.702537:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52506 lrc: 2/0,0 mode: PW/PW res: [0x2b9a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.702540:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52506 lrc: 3/0,0 mode: PW/PW res: [0x2b9a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.702543:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52506 lrc: 1/0,0 mode: --/PW res: [0x2b9a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.702545:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52506 lrc: 0/0,0 mode: --/PW res: [0x2b9a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.702796:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000824ca843 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997044224:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.702801:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52514 lrc: 3/0,1 mode: --/PW res: [0x2b9a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.702814:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.702825:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.702827:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ebb53b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997044288:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.702832:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.702838:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.702844:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.702851:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c5251b lrc: 3/0,1 mode: --/PW res: [0x2b9a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.702859:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.702859:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946524736 00000100:00100000:1.0:1651529344.702869:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.702880:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946524864 00000100:00100000:0.0:1651529344.702887:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946524672 00000100:00100000:0.0:1651529344.702892:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946524992 00000100:00100000:1.0:1651529344.702894:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.702896:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946524800 00000100:00100000:0.0:1651529344.702898:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946524928 00000100:00100000:0.0:1651529344.702901:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212150 00000100:00100000:0.0:1651529344.702903:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1649:39029:x1731745946524736:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.702904:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212151 00000100:00100000:1.0:1651529344.702906:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1649:39029:x1731745946524864:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.702908:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178599 count 1 00002000:00080000:1.0:1651529344.702912:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178601 count 1 00010000:00010000:0.0:1651529344.702912:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52522 lrc: 3/0,1 mode: --/PW res: [0x2b9a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.702916:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000006893f6f/0x3234de053c4e588 lrc: 2/0,0 mode: PR/PR res: [0x2b9a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4797 expref: 417 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.702917:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52529 lrc: 3/0,1 mode: --/PW res: [0x2b9a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.702920:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.702920:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.702921:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c712a5b7/0x3234de053c4cb56 lrc: 2/0,0 mode: PR/PR res: [0x2b9a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdeba expref: 417 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.702921:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52522 lrc: 4/0,1 mode: --/PW res: [0x2b9a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.702924:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.702925:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.702926:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52529 lrc: 4/0,1 mode: --/PW res: [0x2b9a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.702928:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000006893f6f/0x3234de053c4e588 lrc: 3/0,0 mode: PR/PR res: [0x2b9a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4797 expref: 417 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.702931:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000006893f6f/0x3234de053c4e588 lrc: 4/0,0 mode: PR/PR res: [0x2b9a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4797 expref: 417 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.702933:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c712a5b7/0x3234de053c4cb56 lrc: 3/0,0 mode: PR/PR res: [0x2b9a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdeba expref: 417 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.702935:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ebb53b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997044352:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.702936:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c712a5b7/0x3234de053c4cb56 lrc: 4/0,0 mode: PR/PR res: [0x2b9a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdeba expref: 417 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.702941:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997044416:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.702950:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed830649 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.702956:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212152 00000100:00100000:1.0:1651529344.702957:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 0000000071742acc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.702958:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1649:39030:x1731745946524672:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.702962:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178598 count 1 00000100:00100000:1.0:1651529344.702964:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212153 00000100:00100000:1.0:1651529344.702966:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1649:39029:x1731745946524992:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.702966:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52530 lrc: 3/0,1 mode: --/PW res: [0x2b9a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.702970:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178603 count 1 00010000:00010000:0.0:1651529344.702970:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008f854e53/0x3234de053c4a03e lrc: 2/0,0 mode: PR/PR res: [0x2b9a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb6a4 expref: 417 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.702973:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52537 lrc: 3/0,1 mode: --/PW res: [0x2b9ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.702974:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.702974:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.702975:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52530 lrc: 4/0,1 mode: --/PW res: [0x2b9a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.702978:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000019453baf/0x3234de053c4d5c8 lrc: 2/0,0 mode: PR/PR res: [0x2b9ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d086d expref: 417 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.702981:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.702981:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.702981:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008f854e53/0x3234de053c4a03e lrc: 3/0,0 mode: PR/PR res: [0x2b9a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb6a4 expref: 417 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.702982:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52537 lrc: 4/0,1 mode: --/PW res: [0x2b9ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.702984:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008f854e53/0x3234de053c4a03e lrc: 4/0,0 mode: PR/PR res: [0x2b9a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb6a4 expref: 417 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.702988:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000019453baf/0x3234de053c4d5c8 lrc: 3/0,0 mode: PR/PR res: [0x2b9ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d086d expref: 417 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.702988:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000824ca843 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997044480:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.702991:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000019453baf/0x3234de053c4d5c8 lrc: 4/0,0 mode: PR/PR res: [0x2b9ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d086d expref: 417 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.702995:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a4b486d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997044544:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.702995:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 0000000076b354b3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.703000:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212154 00000100:00100000:1.0:1651529344.703002:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8a0b704 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.703002:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1649:39030:x1731745946524800:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.703006:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178600 count 1 00000100:00100000:1.0:1651529344.703008:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212155 00010000:00010000:0.0:1651529344.703009:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c5253e lrc: 3/0,1 mode: --/PW res: [0x2b9a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.703010:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1649:39030:x1731745946524928:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.703013:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000039ea2cb3/0x3234de053c4e3e4 lrc: 2/0,0 mode: PR/PR res: [0x2b9a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4089 expref: 417 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.703014:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178602 count 1 00010000:00010000:0.0:1651529344.703016:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.703016:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.703017:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52545 lrc: 3/0,1 mode: --/PW res: [0x2b9aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.703017:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c5253e lrc: 4/0,1 mode: --/PW res: [0x2b9a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.703021:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008f7828aa/0x3234de053c4e469 lrc: 2/0,0 mode: PR/PR res: [0x2b9aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42ea expref: 417 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.703023:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000039ea2cb3/0x3234de053c4e3e4 lrc: 3/0,0 mode: PR/PR res: [0x2b9a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4089 expref: 417 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.703024:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.703024:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.703025:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52545 lrc: 4/0,1 mode: --/PW res: [0x2b9aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.703026:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000039ea2cb3/0x3234de053c4e3e4 lrc: 4/0,0 mode: PR/PR res: [0x2b9a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4089 expref: 417 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.703030:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008f7828aa/0x3234de053c4e469 lrc: 3/0,0 mode: PR/PR res: [0x2b9aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42ea expref: 417 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.703030:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f2582a33 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997044608:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.703034:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008f7828aa/0x3234de053c4e469 lrc: 4/0,0 mode: PR/PR res: [0x2b9aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42ea expref: 417 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.703037:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ef7d105 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997044672:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.703037:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a3b00cf3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.703044:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fe434b1c going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.703051:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396405696 00010000:00010000:1.0:1651529344.703056:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000abd19bdc/0x3234de053c4d899 lrc: 4/0,0 mode: PR/PR res: [0x2b9a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1317 expref: 418 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.703063:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396405760 00010000:00010000:1.0:1651529344.703065:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006402a0e3/0x3234de053c49f5e lrc: 4/0,0 mode: PR/PR res: [0x2b9a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb3b0 expref: 419 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.703074:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12930 00000100:00100000:0.0:1651529344.703076:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+419:41278:x1731746396405696:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.703080:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.703082:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000abd19bdc/0x3234de053c4d899 lrc: 4/0,0 mode: PR/PR res: [0x2b9a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1317 expref: 419 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.703086:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000abd19bdc/0x3234de053c4d899 lrc: 3/0,0 mode: PR/PR res: [0x2b9a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1317 expref: 419 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.703091:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abd19bdc/0x3234de053c4d899 lrc: 0/0,0 mode: --/PR res: [0x2b9a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1317 expref: 419 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.703095:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.703095:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.703096:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52514 lrc: 3/0,1 mode: PW/PW res: [0x2b9a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.703099:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52514 lrc: 4/0,1 mode: PW/PW res: [0x2b9a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.703102:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12931 00000100:00100000:1.0:1651529344.703104:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+418:41278:x1731746396405760:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.703106:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.703107:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.703109:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006402a0e3/0x3234de053c49f5e lrc: 4/0,0 mode: PR/PR res: [0x2b9a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb3b0 expref: 418 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.703113:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006402a0e3/0x3234de053c49f5e lrc: 3/0,0 mode: PR/PR res: [0x2b9a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb3b0 expref: 418 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.703113:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+418:41278:x1731746396405696:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.703116:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12930 00010000:00010000:1.0:1651529344.703119:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006402a0e3/0x3234de053c49f5e lrc: 0/0,0 mode: --/PR res: [0x2b9a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb3b0 expref: 418 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.703122:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.703123:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.703123:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52514 lrc: 3/0,1 mode: PW/PW res: [0x2b9a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.703124:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c5251b lrc: 3/0,1 mode: PW/PW res: [0x2b9a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.703126:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52514 lrc: 3/0,1 mode: PW/PW res: [0x2b9a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.703127:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c5251b lrc: 4/0,1 mode: PW/PW res: [0x2b9a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.703129:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52514 lrc: 3/0,1 mode: PW/PW res: [0x2b9a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.703136:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.703144:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+416:41278:x1731746396405760:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 39us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.703146:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12931 00010000:00010000:0.0:1651529344.703153:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52514 lrc: 2/0,0 mode: PW/PW res: [0x2b9a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.703236:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52514 lrc: 2/0,0 mode: PW/PW res: [0x2b9a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.703240:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001391dc6d already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.703241:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52514 lrc: 2/0,0 mode: PW/PW res: [0x2b9a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.703250:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52514 lrc: 3/0,0 mode: PW/PW res: [0x2b9a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.703257:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1650:39030:x1731745946524544:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1146us (1199us total) trans 12885080203 rc 0/0 00010000:00010000:1.0:1651529344.703259:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52514 lrc: 1/0,0 mode: --/PW res: [0x2b9a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.703262:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52514 lrc: 0/0,0 mode: --/PW res: [0x2b9a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.703262:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212148 00010000:00010000:0.0:1651529344.703275:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c5251b lrc: 3/0,1 mode: PW/PW res: [0x2b9a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.703281:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c5251b lrc: 3/0,1 mode: PW/PW res: [0x2b9a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.703286:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c5251b lrc: 3/0,1 mode: PW/PW res: [0x2b9a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.703291:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c5251b lrc: 2/0,0 mode: PW/PW res: [0x2b9a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.703342:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1650:39029:x1731745946524608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1080us (1258us total) trans 12885080204 rc 0/0 00000100:00100000:0.0:1651529344.703346:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212149 00010000:00010000:0.0:1651529344.703353:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c5251b lrc: 2/0,0 mode: PW/PW res: [0x2b9a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.703357:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f9b62460 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.703358:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c5251b lrc: 2/0,0 mode: PW/PW res: [0x2b9a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.703361:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c5251b lrc: 3/0,0 mode: PW/PW res: [0x2b9a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.703365:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c5251b lrc: 1/0,0 mode: --/PW res: [0x2b9a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.703368:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c5251b lrc: 0/0,0 mode: --/PW res: [0x2b9a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.703455:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.703475:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.703477:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000824ca843 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997044480:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.703482:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.703482:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52530 lrc: 3/0,1 mode: --/PW res: [0x2b9a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.703487:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.703491:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f2582a33 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997044608:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.703494:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.703494:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c5253e lrc: 3/0,1 mode: --/PW res: [0x2b9a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.703502:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.703506:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ebb53b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997044352:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.703509:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52522 lrc: 3/0,1 mode: --/PW res: [0x2b9a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.703528:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997044416:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.703532:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52529 lrc: 3/0,1 mode: --/PW res: [0x2b9a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.703551:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a4b486d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997044544:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.703552:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946525056 00010000:00010000:1.0:1651529344.703554:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52537 lrc: 3/0,1 mode: --/PW res: [0x2b9ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.703560:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396405824 00000100:00100000:0.0:1651529344.703561:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212156 00000100:00100000:0.0:1651529344.703562:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1650:39030:x1731745946525056:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.703565:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000006893f6f/0x3234de053c4e588 lrc: 4/0,0 mode: PR/PR res: [0x2b9a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4797 expref: 416 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:0.0:1651529344.703568:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178604 count 1 00000100:00100000:1.0:1651529344.703570:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396405952 00010000:00010000:0.0:1651529344.703572:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c5254c lrc: 3/0,1 mode: --/PW res: [0x2b9ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.703573:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008f854e53/0x3234de053c4a03e lrc: 4/0,0 mode: PR/PR res: [0x2b9a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb6a4 expref: 417 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.703576:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000702cc2d5/0x3234de053c4cc83 lrc: 2/0,0 mode: PR/PR res: [0x2b9ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce3e5 expref: 417 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.703577:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396406080 00010000:00010000:1.0:1651529344.703579:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000039ea2cb3/0x3234de053c4e3e4 lrc: 4/0,0 mode: PR/PR res: [0x2b9a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4089 expref: 418 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.703579:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.703580:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.703581:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c5254c lrc: 4/0,1 mode: --/PW res: [0x2b9ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.703583:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396405888 00010000:00010000:1.0:1651529344.703584:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c712a5b7/0x3234de053c4cb56 lrc: 4/0,0 mode: PR/PR res: [0x2b9a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdeba expref: 419 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.703588:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396406016 00010000:00010000:0.0:1651529344.703588:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000702cc2d5/0x3234de053c4cc83 lrc: 3/0,0 mode: PR/PR res: [0x2b9ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce3e5 expref: 419 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.703590:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000019453baf/0x3234de053c4d5c8 lrc: 4/0,0 mode: PR/PR res: [0x2b9ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d086d expref: 420 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.703592:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000702cc2d5/0x3234de053c4cc83 lrc: 4/0,0 mode: PR/PR res: [0x2b9ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce3e5 expref: 420 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.703595:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12932 00000100:00100000:1.0:1651529344.703596:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e29becaf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+420:41278:x1731746396405824:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.703596:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ebb53b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997044736:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.703599:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.703600:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000006893f6f/0x3234de053c4e588 lrc: 4/0,0 mode: PR/PR res: [0x2b9a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4797 expref: 420 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.703605:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a3b00cf3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.703606:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000006893f6f/0x3234de053c4e588 lrc: 3/0,0 mode: PR/PR res: [0x2b9a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4797 expref: 420 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.703611:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006893f6f/0x3234de053c4e588 lrc: 0/0,0 mode: --/PR res: [0x2b9a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4797 expref: 420 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.703615:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.703616:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.703617:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52522 lrc: 3/0,1 mode: PW/PW res: [0x2b9a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.703620:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52522 lrc: 4/0,1 mode: PW/PW res: [0x2b9a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.703620:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.703630:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.703637:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e29becaf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+419:41278:x1731746396405824:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.703640:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12932 00000100:00100000:1.0:1651529344.703649:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12933 00000100:00100000:0.0:1651529344.703655:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.703658:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+418:41278:x1731746396405952:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.703661:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.703663:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008f854e53/0x3234de053c4a03e lrc: 4/0,0 mode: PR/PR res: [0x2b9a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb6a4 expref: 418 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.703667:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008f854e53/0x3234de053c4a03e lrc: 3/0,0 mode: PR/PR res: [0x2b9a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb6a4 expref: 418 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.703674:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52522 lrc: 3/0,1 mode: PW/PW res: [0x2b9a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.703677:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f854e53/0x3234de053c4a03e lrc: 0/0,0 mode: --/PR res: [0x2b9a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb6a4 expref: 418 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.703678:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52522 lrc: 3/0,1 mode: PW/PW res: [0x2b9a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.703681:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.703681:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52522 lrc: 3/0,1 mode: PW/PW res: [0x2b9a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.703682:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.703682:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52530 lrc: 3/0,1 mode: PW/PW res: [0x2b9a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.703684:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52522 lrc: 2/0,0 mode: PW/PW res: [0x2b9a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.703685:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52530 lrc: 4/0,1 mode: PW/PW res: [0x2b9a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.703694:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.703702:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+417:41278:x1731746396405952:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 44us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.703705:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12933 00000100:00100000:1.0:1651529344.703709:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396406144 00010000:00010000:1.0:1651529344.703712:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008f7828aa/0x3234de053c4e469 lrc: 5/0,0 mode: PR/PR res: [0x2b9aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42ea expref: 417 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.703717:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12934 00000100:00100000:1.0:1651529344.703719:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+417:41278:x1731746396406080:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.703721:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.703722:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000039ea2cb3/0x3234de053c4e3e4 lrc: 4/0,0 mode: PR/PR res: [0x2b9a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4089 expref: 417 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.703726:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000039ea2cb3/0x3234de053c4e3e4 lrc: 3/0,0 mode: PR/PR res: [0x2b9a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4089 expref: 417 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.703731:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039ea2cb3/0x3234de053c4e3e4 lrc: 0/0,0 mode: --/PR res: [0x2b9a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4089 expref: 417 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.703743:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.703744:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.703745:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c5253e lrc: 3/0,1 mode: PW/PW res: [0x2b9a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.703748:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c5253e lrc: 4/0,1 mode: PW/PW res: [0x2b9a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.703756:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.703765:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+416:41278:x1731746396406080:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 46us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.703765:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1651:39029:x1731745946524736:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 861us (951us total) trans 12885080205 rc 0/0 00000100:00100000:1.0:1651529344.703768:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12934 00000100:00100000:0.0:1651529344.703769:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212150 00000100:00100000:1.0:1651529344.703772:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12935 00000100:00100000:1.0:1651529344.703774:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+415:41279:x1731746396405888:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.703774:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946525120 00010000:00010000:1.0:1651529344.703776:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.703777:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c712a5b7/0x3234de053c4cb56 lrc: 4/0,0 mode: PR/PR res: [0x2b9a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdeba expref: 415 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.703788:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c712a5b7/0x3234de053c4cb56 lrc: 3/0,0 mode: PR/PR res: [0x2b9a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdeba expref: 415 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.703793:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c712a5b7/0x3234de053c4cb56 lrc: 0/0,0 mode: --/PR res: [0x2b9a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdeba expref: 415 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.703795:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212157 00000100:00100000:0.0:1651529344.703797:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1651:39029:x1731745946525120:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.703798:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.703799:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.703800:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52529 lrc: 3/0,1 mode: PW/PW res: [0x2b9a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.703802:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52529 lrc: 4/0,1 mode: PW/PW res: [0x2b9a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.703803:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178605 count 1 00010000:00010000:0.0:1651529344.703807:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52553 lrc: 3/0,1 mode: --/PW res: [0x2b9ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.703808:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.703812:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008afabef1/0x3234de053c4a029 lrc: 2/0,0 mode: PR/PR res: [0x2b9ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb642 expref: 414 pid: 72397 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.703813:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+414:41279:x1731746396405888:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 39us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.703815:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12935 00010000:00010000:0.0:1651529344.703815:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.703816:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.703817:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52553 lrc: 4/0,1 mode: --/PW res: [0x2b9ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.703819:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12936 00000100:00100000:1.0:1651529344.703821:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+413:41279:x1731746396406016:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.703823:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.703823:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008afabef1/0x3234de053c4a029 lrc: 3/0,0 mode: PR/PR res: [0x2b9ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb642 expref: 413 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.703824:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000019453baf/0x3234de053c4d5c8 lrc: 4/0,0 mode: PR/PR res: [0x2b9ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d086d expref: 413 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.703827:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008afabef1/0x3234de053c4a029 lrc: 4/0,0 mode: PR/PR res: [0x2b9ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb642 expref: 413 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.703828:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000019453baf/0x3234de053c4d5c8 lrc: 3/0,0 mode: PR/PR res: [0x2b9ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d086d expref: 413 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.703831:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000117fbeca pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997044800:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.703832:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019453baf/0x3234de053c4d5c8 lrc: 0/0,0 mode: --/PR res: [0x2b9ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d086d expref: 413 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.703835:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.703836:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.703836:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52537 lrc: 3/0,1 mode: PW/PW res: [0x2b9ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.703839:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52537 lrc: 4/0,1 mode: PW/PW res: [0x2b9ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.703840:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 0000000076b354b3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.703845:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.703845:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52522 lrc: 2/0,0 mode: PW/PW res: [0x2b9a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.703848:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004dda5a3f already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.703849:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+412:41279:x1731746396406016:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 28us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.703851:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12936 00000100:00100000:1.0:1651529344.703855:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12937 00000100:00100000:1.0:1651529344.703856:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+411:41279:x1731746396406144:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.703858:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.703860:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008f7828aa/0x3234de053c4e469 lrc: 5/0,0 mode: PR/PR res: [0x2b9aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42ea expref: 411 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.703863:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008f7828aa/0x3234de053c4e469 lrc: 4/0,0 mode: PR/PR res: [0x2b9aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42ea expref: 411 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.703863:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52522 lrc: 2/0,0 mode: PW/PW res: [0x2b9a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.703867:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.703867:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.703867:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52522 lrc: 3/0,0 mode: PW/PW res: [0x2b9a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.703868:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52545 lrc: 3/0,1 mode: PW/PW res: [0x2b9aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.703871:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52545 lrc: 4/0,1 mode: PW/PW res: [0x2b9aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.703872:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52522 lrc: 1/0,0 mode: --/PW res: [0x2b9a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.703875:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.703875:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52522 lrc: 0/0,0 mode: --/PW res: [0x2b9a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.703878:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+411:41279:x1731746396406144:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 22us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.703881:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12937 00010000:00010000:0.0:1651529344.703882:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52530 lrc: 3/0,1 mode: PW/PW res: [0x2b9a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.703885:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52530 lrc: 3/0,1 mode: PW/PW res: [0x2b9a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.703887:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52530 lrc: 3/0,1 mode: PW/PW res: [0x2b9a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.703890:0:106695:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f7828aa/0x3234de053c4e469 lrc: 0/0,0 mode: --/PR res: [0x2b9aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d42ea expref: 410 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.703890:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52530 lrc: 2/0,0 mode: PW/PW res: [0x2b9a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.703894:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ef7d105 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997044672:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.703903:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52545 lrc: 3/0,1 mode: PW/PW res: [0x2b9aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.703907:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52545 lrc: 3/0,1 mode: PW/PW res: [0x2b9aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.703910:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52545 lrc: 3/0,1 mode: PW/PW res: [0x2b9aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.703913:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52545 lrc: 3/0,1 mode: PW/PW res: [0x2b9aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.703916:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52545 lrc: 2/0,0 mode: PW/PW res: [0x2b9aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.703956:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1653:39030:x1731745946524672:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 996us (1122us total) trans 12885080206 rc 0/0 00000100:00100000:1.0:1651529344.703960:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1653:39030:x1731745946524928:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 949us (1091us total) trans 12885080207 rc 0/0 00000100:00100000:0.0:1651529344.703961:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212152 00000100:00100000:1.0:1651529344.703963:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212155 00010000:00010000:0.0:1651529344.703970:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52530 lrc: 2/0,0 mode: PW/PW res: [0x2b9a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.703972:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52545 lrc: 2/0,0 mode: PW/PW res: [0x2b9aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.703973:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f0bd9bfb already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.703974:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52530 lrc: 2/0,0 mode: PW/PW res: [0x2b9a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.703978:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000877aab61 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.703978:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52530 lrc: 3/0,0 mode: PW/PW res: [0x2b9a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.703979:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52545 lrc: 2/0,0 mode: PW/PW res: [0x2b9aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.703982:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52545 lrc: 3/0,0 mode: PW/PW res: [0x2b9aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.703983:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52530 lrc: 1/0,0 mode: --/PW res: [0x2b9a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.703985:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52530 lrc: 0/0,0 mode: --/PW res: [0x2b9a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.703987:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52545 lrc: 1/0,0 mode: --/PW res: [0x2b9aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.703989:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52545 lrc: 0/0,0 mode: --/PW res: [0x2b9aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.703991:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c5253e lrc: 3/0,1 mode: PW/PW res: [0x2b9a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.703994:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c5253e lrc: 3/0,1 mode: PW/PW res: [0x2b9a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.703995:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52537 lrc: 3/0,1 mode: PW/PW res: [0x2b9ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.703997:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c5253e lrc: 3/0,1 mode: PW/PW res: [0x2b9a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.703998:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52537 lrc: 3/0,1 mode: PW/PW res: [0x2b9ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.704000:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c5253e lrc: 2/0,0 mode: PW/PW res: [0x2b9a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.704001:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52537 lrc: 3/0,1 mode: PW/PW res: [0x2b9ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.704004:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52537 lrc: 2/0,0 mode: PW/PW res: [0x2b9ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.704042:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1653:39029:x1731745946524992:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1076us (1204us total) trans 12885080208 rc 0/0 00000100:00100000:1.0:1651529344.704045:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212153 00000100:00100000:0.0:1651529344.704046:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1653:39030:x1731745946524800:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1043us (1202us total) trans 12885080209 rc 0/0 00000100:00100000:0.0:1651529344.704049:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212154 00010000:00010000:1.0:1651529344.704052:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52529 lrc: 3/0,1 mode: PW/PW res: [0x2b9a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.704055:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52529 lrc: 3/0,1 mode: PW/PW res: [0x2b9a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.704057:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c5253e lrc: 2/0,0 mode: PW/PW res: [0x2b9a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.704058:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52529 lrc: 3/0,1 mode: PW/PW res: [0x2b9a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.704061:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52529 lrc: 2/0,0 mode: PW/PW res: [0x2b9a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.704063:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fafb79d3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.704064:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c5253e lrc: 2/0,0 mode: PW/PW res: [0x2b9a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.704066:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c5253e lrc: 3/0,0 mode: PW/PW res: [0x2b9a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.704071:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c5253e lrc: 1/0,0 mode: --/PW res: [0x2b9a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.704073:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c5253e lrc: 0/0,0 mode: --/PW res: [0x2b9a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.704078:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52537 lrc: 2/0,0 mode: PW/PW res: [0x2b9ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.704081:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000046fea5cc already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.704082:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52537 lrc: 2/0,0 mode: PW/PW res: [0x2b9ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.704084:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52537 lrc: 3/0,0 mode: PW/PW res: [0x2b9ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.704088:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52537 lrc: 1/0,0 mode: --/PW res: [0x2b9ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.704090:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52537 lrc: 0/0,0 mode: --/PW res: [0x2b9ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.704093:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1652:39029:x1731745946524864:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1187us (1268us total) trans 12885080210 rc 0/0 00010000:00010000:0.0:1651529344.704094:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52529 lrc: 2/0,0 mode: PW/PW res: [0x2b9a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.704096:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212151 00010000:00010000:0.0:1651529344.704097:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003551d5d1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.704097:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52529 lrc: 2/0,0 mode: PW/PW res: [0x2b9a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.704100:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52529 lrc: 3/0,0 mode: PW/PW res: [0x2b9a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.704103:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52529 lrc: 1/0,0 mode: --/PW res: [0x2b9a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.704105:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52529 lrc: 0/0,0 mode: --/PW res: [0x2b9a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.704149:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ebb53b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997044736:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.704159:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c5254c lrc: 3/0,1 mode: --/PW res: [0x2b9ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.704163:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.704181:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396406208 00010000:00010000:1.0:1651529344.704186:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000702cc2d5/0x3234de053c4cc83 lrc: 4/0,0 mode: PR/PR res: [0x2b9ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce3e5 expref: 410 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.704257:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12938 00000100:00100000:0.0:1651529344.704259:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+410:41279:x1731746396406208:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.704263:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.704280:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000702cc2d5/0x3234de053c4cc83 lrc: 4/0,0 mode: PR/PR res: [0x2b9ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce3e5 expref: 410 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.704288:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000702cc2d5/0x3234de053c4cc83 lrc: 3/0,0 mode: PR/PR res: [0x2b9ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce3e5 expref: 410 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.704291:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.704294:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000702cc2d5/0x3234de053c4cc83 lrc: 0/0,0 mode: --/PR res: [0x2b9ac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce3e5 expref: 410 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.704304:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.704304:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.704305:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c5254c lrc: 3/0,1 mode: PW/PW res: [0x2b9ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.704329:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c5254c lrc: 4/0,1 mode: PW/PW res: [0x2b9ac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.704350:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.704352:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.704366:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+409:41279:x1731746396406208:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 100us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.704379:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12938 00000100:00100000:0.0:1651529344.704389:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946525184 00000100:00100000:1.0:1651529344.704391:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.704406:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946525248 00000100:00100000:1.0:1651529344.704407:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.704420:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946525312 00000100:00100000:0.0:1651529344.704430:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212158 00000100:00100000:0.0:1651529344.704432:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1654:39030:x1731745946525184:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.704433:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212159 00000100:00100000:1.0:1651529344.704435:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1654:39029:x1731745946525248:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.704438:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178606 count 1 00002000:00080000:1.0:1651529344.704440:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178607 count 1 00010000:00010000:0.0:1651529344.704442:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c5255a lrc: 3/0,1 mode: --/PW res: [0x2b9ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.704445:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52561 lrc: 3/0,1 mode: --/PW res: [0x2b9af:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.704446:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bbf33489/0x3234de053c4c694 lrc: 2/0,0 mode: PR/PR res: [0x2b9ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc37 expref: 408 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.704449:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000034199503/0x3234de053c4dc51 lrc: 2/0,0 mode: PR/PR res: [0x2b9af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d219c expref: 408 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.704450:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.704450:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.704451:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c5255a lrc: 4/0,1 mode: --/PW res: [0x2b9ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.704453:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.704453:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.704454:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52561 lrc: 4/0,1 mode: --/PW res: [0x2b9af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.704457:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bbf33489/0x3234de053c4c694 lrc: 3/0,0 mode: PR/PR res: [0x2b9ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc37 expref: 408 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.704461:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000034199503/0x3234de053c4dc51 lrc: 3/0,0 mode: PR/PR res: [0x2b9af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d219c expref: 408 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.704461:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bbf33489/0x3234de053c4c694 lrc: 4/0,0 mode: PR/PR res: [0x2b9ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc37 expref: 408 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.704464:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000034199503/0x3234de053c4dc51 lrc: 4/0,0 mode: PR/PR res: [0x2b9af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d219c expref: 408 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.704465:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ebb53b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997044864:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.704469:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a4b486d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997044928:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.704474:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000003003c8b0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.704478:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 0000000020dd7827 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.704480:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212160 00000100:00100000:0.0:1651529344.704482:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1654:39029:x1731745946525312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.704486:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178608 count 1 00010000:00010000:0.0:1651529344.704489:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52568 lrc: 3/0,1 mode: --/PW res: [0x2b9b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.704494:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e5878ee7/0x3234de053c4d16f lrc: 2/0,0 mode: PR/PR res: [0x2b9b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf710 expref: 408 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.704497:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.704497:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.704498:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52568 lrc: 4/0,1 mode: --/PW res: [0x2b9b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.704506:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e5878ee7/0x3234de053c4d16f lrc: 3/0,0 mode: PR/PR res: [0x2b9b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf710 expref: 408 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.704509:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e5878ee7/0x3234de053c4d16f lrc: 4/0,0 mode: PR/PR res: [0x2b9b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf710 expref: 408 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.704512:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.704513:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000974b675b pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997044992:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.704519:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 0000000049203969 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.704526:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000117fbeca pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997044800:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.704527:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.704530:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52553 lrc: 3/0,1 mode: --/PW res: [0x2b9ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.704535:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c5254c lrc: 3/0,1 mode: PW/PW res: [0x2b9ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.704537:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.704538:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c5254c lrc: 3/0,1 mode: PW/PW res: [0x2b9ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.704541:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c5254c lrc: 3/0,1 mode: PW/PW res: [0x2b9ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.704544:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c5254c lrc: 2/0,0 mode: PW/PW res: [0x2b9ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.704569:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946525440 00000100:00100000:1.0:1651529344.704579:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946525376 00000100:00100000:1.0:1651529344.704583:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946525504 00000100:00100000:1.0:1651529344.704587:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212161 00000100:00100000:1.0:1651529344.704589:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1658:39030:x1731745946525440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.704594:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178610 count 1 00010000:00010000:1.0:1651529344.704598:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c5256f lrc: 3/0,1 mode: --/PW res: [0x2b9b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.704603:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d58220ef/0x3234de053c4d15a lrc: 2/0,0 mode: PR/PR res: [0x2b9b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf6ca expref: 408 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.704606:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.704606:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.704607:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c5256f lrc: 4/0,1 mode: --/PW res: [0x2b9b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.704612:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1658:39030:x1731745946525056:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1049us (1157us total) trans 12885080211 rc 0/0 00000100:00100000:0.0:1651529344.704616:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212156 00010000:00010000:1.0:1651529344.704620:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d58220ef/0x3234de053c4d15a lrc: 3/0,0 mode: PR/PR res: [0x2b9b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf6ca expref: 408 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.704622:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212162 00010000:00010000:1.0:1651529344.704623:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d58220ef/0x3234de053c4d15a lrc: 4/0,0 mode: PR/PR res: [0x2b9b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf6ca expref: 408 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.704624:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1657:39029:x1731745946525376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.704627:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000716b388d pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997045056:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.704629:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178609 count 1 00010000:00010000:0.0:1651529344.704633:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52576 lrc: 3/0,1 mode: --/PW res: [0x2b9b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.704636:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b7af823 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.704637:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000093493eb7/0x3234de053c49ff8 lrc: 2/0,0 mode: PR/PR res: [0x2b9b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5a1 expref: 408 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.704640:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.704641:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.704641:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52576 lrc: 4/0,1 mode: --/PW res: [0x2b9b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.704643:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212163 00000100:00100000:1.0:1651529344.704644:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1657:39029:x1731745946525504:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.704648:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000093493eb7/0x3234de053c49ff8 lrc: 3/0,0 mode: PR/PR res: [0x2b9b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5a1 expref: 408 pid: 72397 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.704649:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178611 count 1 00010000:00010000:0.0:1651529344.704651:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000093493eb7/0x3234de053c49ff8 lrc: 4/0,0 mode: PR/PR res: [0x2b9b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5a1 expref: 408 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.704652:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c5257d lrc: 3/0,1 mode: --/PW res: [0x2b9b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.704656:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000117fbeca pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997045120:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.704659:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008dea93f6/0x3234de053c4b878 lrc: 2/0,0 mode: PR/PR res: [0x2b9b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc3ee expref: 408 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.704662:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.704662:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.704663:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c5257d lrc: 4/0,1 mode: --/PW res: [0x2b9b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.704664:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed830649 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.704669:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008dea93f6/0x3234de053c4b878 lrc: 3/0,0 mode: PR/PR res: [0x2b9b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc3ee expref: 408 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.704672:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008dea93f6/0x3234de053c4b878 lrc: 4/0,0 mode: PR/PR res: [0x2b9b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc3ee expref: 408 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.704676:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000999005e pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997045184:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.704682:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c3caa148 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.704688:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c5254c lrc: 2/0,0 mode: PW/PW res: [0x2b9ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.704704:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000576f1f12 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.704705:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c5254c lrc: 2/0,0 mode: PW/PW res: [0x2b9ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.704709:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396406272 00010000:00010000:1.0:1651529344.704714:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c5254c lrc: 3/0,0 mode: PW/PW res: [0x2b9ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.704714:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008afabef1/0x3234de053c4a029 lrc: 4/0,0 mode: PR/PR res: [0x2b9ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb642 expref: 409 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.704719:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c5254c lrc: 1/0,0 mode: --/PW res: [0x2b9ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.704722:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c5254c lrc: 0/0,0 mode: --/PW res: [0x2b9ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.704728:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12939 00000100:00100000:0.0:1651529344.704730:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e45eb301 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+409:41278:x1731746396406272:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.704733:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.704742:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008afabef1/0x3234de053c4a029 lrc: 4/0,0 mode: PR/PR res: [0x2b9ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb642 expref: 409 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.704746:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008afabef1/0x3234de053c4a029 lrc: 3/0,0 mode: PR/PR res: [0x2b9ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb642 expref: 409 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.704751:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008afabef1/0x3234de053c4a029 lrc: 0/0,0 mode: --/PR res: [0x2b9ad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb642 expref: 409 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.704755:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.704755:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.704756:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52553 lrc: 3/0,1 mode: PW/PW res: [0x2b9ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.704759:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52553 lrc: 4/0,1 mode: PW/PW res: [0x2b9ad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.704766:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.704774:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e45eb301 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+408:41278:x1731746396406272:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 43us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.704777:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12939 00010000:00010000:0.0:1651529344.704786:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52553 lrc: 3/0,1 mode: PW/PW res: [0x2b9ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.704790:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52553 lrc: 3/0,1 mode: PW/PW res: [0x2b9ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.704793:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52553 lrc: 3/0,1 mode: PW/PW res: [0x2b9ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.704796:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52553 lrc: 2/0,0 mode: PW/PW res: [0x2b9ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.704830:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.704886:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1658:39029:x1731745946525120:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1088us (1266us total) trans 12885080212 rc 0/0 00000100:00100000:0.0:1651529344.704889:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212157 00000100:00100000:0.0:1651529344.704894:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946525568 00000100:00100000:0.0:1651529344.704904:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212164 00000100:00100000:0.0:1651529344.704905:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1658:39030:x1731745946525568:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.704911:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178612 count 1 00010000:00010000:0.0:1651529344.704917:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52584 lrc: 3/0,1 mode: --/PW res: [0x2b9b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.704927:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.704935:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.704939:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a11a0bb4/0x3234de053c4f06a lrc: 2/0,0 mode: PR/PR res: [0x2b9b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7484 expref: 407 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.704942:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.704944:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.704945:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.704946:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52584 lrc: 4/0,1 mode: --/PW res: [0x2b9b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.704953:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a4b486d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997044928:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.704957:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52561 lrc: 3/0,1 mode: --/PW res: [0x2b9af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.704959:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a11a0bb4/0x3234de053c4f06a lrc: 3/0,0 mode: PR/PR res: [0x2b9b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7484 expref: 407 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.704963:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a11a0bb4/0x3234de053c4f06a lrc: 4/0,0 mode: PR/PR res: [0x2b9b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7484 expref: 407 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.704964:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396406400 00000100:00100000:0.0:1651529344.704967:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000824ca843 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997045248:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.704968:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000034199503/0x3234de053c4dc51 lrc: 4/0,0 mode: PR/PR res: [0x2b9af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d219c expref: 408 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.704975:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396406336 00010000:00010000:1.0:1651529344.704977:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bbf33489/0x3234de053c4c694 lrc: 5/0,0 mode: PR/PR res: [0x2b9ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc37 expref: 409 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.704982:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 0000000076b354b3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.704988:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396406464 00010000:00010000:0.0:1651529344.704988:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52553 lrc: 2/0,0 mode: PW/PW res: [0x2b9ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.704991:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e5878ee7/0x3234de053c4d16f lrc: 5/0,0 mode: PR/PR res: [0x2b9b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf710 expref: 410 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.704991:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e7aaedb0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.704992:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52553 lrc: 2/0,0 mode: PW/PW res: [0x2b9ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.704995:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52553 lrc: 3/0,0 mode: PW/PW res: [0x2b9ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.704996:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12940 00000100:00100000:1.0:1651529344.704997:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+410:41279:x1731746396406400:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.705000:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52553 lrc: 1/0,0 mode: --/PW res: [0x2b9ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.705001:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.705003:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000034199503/0x3234de053c4dc51 lrc: 4/0,0 mode: PR/PR res: [0x2b9af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d219c expref: 410 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.705003:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52553 lrc: 0/0,0 mode: --/PW res: [0x2b9ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.705006:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000034199503/0x3234de053c4dc51 lrc: 3/0,0 mode: PR/PR res: [0x2b9af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d219c expref: 410 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.705012:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034199503/0x3234de053c4dc51 lrc: 0/0,0 mode: --/PR res: [0x2b9af:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d219c expref: 410 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.705012:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000974b675b pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997044992:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.705015:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.705015:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.705016:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52561 lrc: 3/0,1 mode: PW/PW res: [0x2b9af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.705017:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52568 lrc: 3/0,1 mode: --/PW res: [0x2b9b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.705019:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52561 lrc: 4/0,1 mode: PW/PW res: [0x2b9af:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.705023:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ebb53b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997044864:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.705025:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c5255a lrc: 3/0,1 mode: --/PW res: [0x2b9ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.705026:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.705032:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+409:41279:x1731746396406400:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.705035:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12940 00000100:00100000:1.0:1651529344.705039:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12941 00000100:00100000:1.0:1651529344.705041:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+408:41279:x1731746396406336:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.705043:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.705044:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bbf33489/0x3234de053c4c694 lrc: 4/0,0 mode: PR/PR res: [0x2b9ae:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc37 expref: 408 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.705050:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bbf33489/0x3234de053c4c694 lrc: 3/0,0 mode: PR/PR res: [0x2b9ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc37 expref: 408 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.705055:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bbf33489/0x3234de053c4c694 lrc: 0/0,0 mode: --/PR res: [0x2b9ae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccc37 expref: 408 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.705058:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.705058:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.705058:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.705059:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c5255a lrc: 3/0,1 mode: PW/PW res: [0x2b9ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.705069:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c5255a lrc: 4/0,1 mode: PW/PW res: [0x2b9ae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.705078:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.705083:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+407:41279:x1731746396406336:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.705086:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12941 00000100:00100000:1.0:1651529344.705090:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12942 00000100:00100000:1.0:1651529344.705092:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+406:41279:x1731746396406464:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.705098:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c5255a lrc: 3/0,1 mode: PW/PW res: [0x2b9ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.705102:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c5255a lrc: 3/0,1 mode: PW/PW res: [0x2b9ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.705106:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c5255a lrc: 3/0,1 mode: PW/PW res: [0x2b9ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.705109:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c5255a lrc: 2/0,0 mode: PW/PW res: [0x2b9ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.705114:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.705121:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e5878ee7/0x3234de053c4d16f lrc: 4/0,0 mode: PR/PR res: [0x2b9b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf710 expref: 406 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.705125:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e5878ee7/0x3234de053c4d16f lrc: 3/0,0 mode: PR/PR res: [0x2b9b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf710 expref: 406 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.705131:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5878ee7/0x3234de053c4d16f lrc: 0/0,0 mode: --/PR res: [0x2b9b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf710 expref: 406 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.705134:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.705135:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.705135:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52568 lrc: 3/0,1 mode: PW/PW res: [0x2b9b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.705138:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52568 lrc: 4/0,1 mode: PW/PW res: [0x2b9b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.705147:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.705157:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+405:41279:x1731746396406464:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 64us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.705160:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12942 00000100:00100000:1.0:1651529344.705170:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946525632 00000100:00100000:1.0:1651529344.705175:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212165 00000100:00100000:1.0:1651529344.705177:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1660:39030:x1731745946525632:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.705178:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1660:39030:x1731745946525184:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 744us (886us total) trans 12885080213 rc 0/0 00000100:00100000:0.0:1651529344.705181:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212158 00002000:00080000:1.0:1651529344.705182:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178613 count 1 00010000:00010000:1.0:1651529344.705185:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c5258b lrc: 3/0,1 mode: --/PW res: [0x2b9b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.705189:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c5255a lrc: 2/0,0 mode: PW/PW res: [0x2b9ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.705190:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008bfcc8ba/0x3234de053c4a099 lrc: 2/0,0 mode: PR/PR res: [0x2b9b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb81e expref: 404 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.705192:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008517b233 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.705193:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.705193:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c5255a lrc: 2/0,0 mode: PW/PW res: [0x2b9ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.705194:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.705194:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c5258b lrc: 4/0,1 mode: --/PW res: [0x2b9b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.705197:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c5255a lrc: 3/0,0 mode: PW/PW res: [0x2b9ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.705201:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008bfcc8ba/0x3234de053c4a099 lrc: 3/0,0 mode: PR/PR res: [0x2b9b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb81e expref: 404 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.705201:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c5255a lrc: 1/0,0 mode: --/PW res: [0x2b9ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.705204:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008bfcc8ba/0x3234de053c4a099 lrc: 4/0,0 mode: PR/PR res: [0x2b9b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb81e expref: 404 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.705204:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c5255a lrc: 0/0,0 mode: --/PW res: [0x2b9ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.705208:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029d739c8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997045312:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.705210:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52568 lrc: 3/0,1 mode: PW/PW res: [0x2b9b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.705213:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52568 lrc: 3/0,1 mode: PW/PW res: [0x2b9b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.705216:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fe434b1c going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.705216:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52568 lrc: 3/0,1 mode: PW/PW res: [0x2b9b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.705234:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52561 lrc: 3/0,1 mode: PW/PW res: [0x2b9af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.705238:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52561 lrc: 3/0,1 mode: PW/PW res: [0x2b9af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.705241:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52561 lrc: 3/0,1 mode: PW/PW res: [0x2b9af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.705247:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52568 lrc: 2/0,0 mode: PW/PW res: [0x2b9b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.705249:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52561 lrc: 2/0,0 mode: PW/PW res: [0x2b9af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.705292:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1661:39029:x1731745946525312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 809us (901us total) trans 12885080214 rc 0/0 00000100:00100000:0.0:1651529344.705295:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212160 00000100:00100000:1.0:1651529344.705298:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1660:39029:x1731745946525248:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 862us (947us total) trans 12885080215 rc 0/0 00000100:00100000:1.0:1651529344.705301:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212159 00010000:00010000:0.0:1651529344.705302:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52568 lrc: 2/0,0 mode: PW/PW res: [0x2b9b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.705306:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fc4c513 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.705307:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52568 lrc: 2/0,0 mode: PW/PW res: [0x2b9b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.705310:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52568 lrc: 3/0,0 mode: PW/PW res: [0x2b9b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.705311:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52561 lrc: 2/0,0 mode: PW/PW res: [0x2b9af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.705314:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52568 lrc: 1/0,0 mode: --/PW res: [0x2b9b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.705315:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000820e505a already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.705316:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52561 lrc: 2/0,0 mode: PW/PW res: [0x2b9af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.705317:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52568 lrc: 0/0,0 mode: --/PW res: [0x2b9b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.705319:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52561 lrc: 3/0,0 mode: PW/PW res: [0x2b9af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.705323:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52561 lrc: 1/0,0 mode: --/PW res: [0x2b9af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.705326:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52561 lrc: 0/0,0 mode: --/PW res: [0x2b9af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.705365:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000716b388d pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997045056:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.705370:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c5256f lrc: 3/0,1 mode: --/PW res: [0x2b9b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.705375:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.705422:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396406528 00010000:00010000:0.0:1651529344.705428:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d58220ef/0x3234de053c4d15a lrc: 4/0,0 mode: PR/PR res: [0x2b9b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf6ca expref: 405 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.705446:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12943 00000100:00100000:0.0:1651529344.705448:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+405:41279:x1731746396406528:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.705451:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.705452:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d58220ef/0x3234de053c4d15a lrc: 4/0,0 mode: PR/PR res: [0x2b9b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf6ca expref: 405 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.705466:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.705472:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.705475:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d58220ef/0x3234de053c4d15a lrc: 3/0,0 mode: PR/PR res: [0x2b9b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf6ca expref: 405 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.705480:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.705481:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d58220ef/0x3234de053c4d15a lrc: 0/0,0 mode: --/PR res: [0x2b9b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf6ca expref: 405 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.705485:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396406656 00010000:00010000:0.0:1651529344.705485:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.705485:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.705486:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c5256f lrc: 3/0,1 mode: PW/PW res: [0x2b9b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.705489:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c5256f lrc: 4/0,1 mode: PW/PW res: [0x2b9b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.705490:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008dea93f6/0x3234de053c4b878 lrc: 5/0,0 mode: PR/PR res: [0x2b9b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc3ee expref: 405 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.705496:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396406592 00010000:00010000:0.0:1651529344.705499:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.705504:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000093493eb7/0x3234de053c49ff8 lrc: 5/0,0 mode: PR/PR res: [0x2b9b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5a1 expref: 406 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.705509:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396406720 00000100:00100000:0.0:1651529344.705509:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+406:41279:x1731746396406528:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 61us (134us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.705512:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a11a0bb4/0x3234de053c4f06a lrc: 5/0,0 mode: PR/PR res: [0x2b9b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7484 expref: 407 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.705512:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12943 00000100:00100000:1.0:1651529344.705517:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12944 00000100:00100000:1.0:1651529344.705518:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+406:41279:x1731746396406656:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.705519:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12945 00000100:00100000:0.0:1651529344.705520:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+406:41278:x1731746396406592:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.705522:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.705523:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008dea93f6/0x3234de053c4b878 lrc: 5/0,0 mode: PR/PR res: [0x2b9b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc3ee expref: 406 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.705523:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.705525:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000093493eb7/0x3234de053c49ff8 lrc: 5/0,0 mode: PR/PR res: [0x2b9b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5a1 expref: 406 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.705527:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008dea93f6/0x3234de053c4b878 lrc: 4/0,0 mode: PR/PR res: [0x2b9b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc3ee expref: 406 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.705528:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000093493eb7/0x3234de053c49ff8 lrc: 4/0,0 mode: PR/PR res: [0x2b9b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5a1 expref: 406 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.705532:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.705533:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.705533:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.705534:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c5257d lrc: 3/0,1 mode: PW/PW res: [0x2b9b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.705534:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.705534:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52576 lrc: 3/0,1 mode: PW/PW res: [0x2b9b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.705537:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c5257d lrc: 4/0,1 mode: PW/PW res: [0x2b9b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.705541:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.705548:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+406:41279:x1731746396406656:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 29us (83us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.705550:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12944 00000100:00100000:1.0:1651529344.705562:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12946 00010000:00010000:0.0:1651529344.705562:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52576 lrc: 4/0,1 mode: PW/PW res: [0x2b9b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.705564:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d8aeac5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+405:41278:x1731746396406720:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.705567:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.705567:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.705568:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a11a0bb4/0x3234de053c4f06a lrc: 5/0,0 mode: PR/PR res: [0x2b9b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7484 expref: 405 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.705572:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a11a0bb4/0x3234de053c4f06a lrc: 4/0,0 mode: PR/PR res: [0x2b9b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7484 expref: 405 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.705574:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+405:41278:x1731746396406592:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 53us (102us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.705577:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.705577:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.705577:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12945 00010000:00010000:1.0:1651529344.705578:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52584 lrc: 3/0,1 mode: PW/PW res: [0x2b9b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.705581:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52584 lrc: 4/0,1 mode: PW/PW res: [0x2b9b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.705585:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.705589:0:156655:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093493eb7/0x3234de053c49ff8 lrc: 0/0,0 mode: --/PR res: [0x2b9b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb5a1 expref: 404 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.705590:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d8aeac5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+404:41278:x1731746396406720:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 25us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.705592:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12946 00000100:00100000:0.0:1651529344.705592:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000117fbeca pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997045120:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.705596:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52576 lrc: 3/0,1 mode: PW/PW res: [0x2b9b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.705599:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52576 lrc: 3/0,1 mode: PW/PW res: [0x2b9b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.705602:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52576 lrc: 3/0,1 mode: PW/PW res: [0x2b9b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.705604:0:80280:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008dea93f6/0x3234de053c4b878 lrc: 0/0,0 mode: --/PR res: [0x2b9b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc3ee expref: 402 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.705605:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52576 lrc: 3/0,1 mode: PW/PW res: [0x2b9b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.705608:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000999005e pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997045184:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.705608:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52576 lrc: 2/0,0 mode: PW/PW res: [0x2b9b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.705612:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c5257d lrc: 3/0,1 mode: PW/PW res: [0x2b9b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.705618:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c5257d lrc: 3/0,1 mode: PW/PW res: [0x2b9b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.705620:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c5257d lrc: 3/0,1 mode: PW/PW res: [0x2b9b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.705623:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c5257d lrc: 3/0,1 mode: PW/PW res: [0x2b9b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.705626:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c5257d lrc: 2/0,0 mode: PW/PW res: [0x2b9b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.705658:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1661:39029:x1731745946525376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1033us (1130us total) trans 12885080216 rc 0/0 00000100:00100000:0.0:1651529344.705661:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212162 00010000:00010000:0.0:1651529344.705668:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52576 lrc: 2/0,0 mode: PW/PW res: [0x2b9b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.705670:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1660:39029:x1731745946525504:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1024us (1133us total) trans 12885080217 rc 0/0 00010000:00010000:0.0:1651529344.705671:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000091ee0f93 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.705672:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52576 lrc: 2/0,0 mode: PW/PW res: [0x2b9b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.705673:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212163 00010000:00010000:0.0:1651529344.705675:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52576 lrc: 3/0,0 mode: PW/PW res: [0x2b9b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.705679:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52576 lrc: 1/0,0 mode: --/PW res: [0x2b9b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.705681:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c5256f lrc: 3/0,1 mode: PW/PW res: [0x2b9b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.705682:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52576 lrc: 0/0,0 mode: --/PW res: [0x2b9b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.705684:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c5256f lrc: 3/0,1 mode: PW/PW res: [0x2b9b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.705686:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c5257d lrc: 2/0,0 mode: PW/PW res: [0x2b9b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.705687:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c5256f lrc: 3/0,1 mode: PW/PW res: [0x2b9b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.705689:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f1b4c19f already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.705690:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c5256f lrc: 2/0,0 mode: PW/PW res: [0x2b9b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.705690:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c5257d lrc: 2/0,0 mode: PW/PW res: [0x2b9b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.705695:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c5257d lrc: 3/0,0 mode: PW/PW res: [0x2b9b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.705698:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c5257d lrc: 1/0,0 mode: --/PW res: [0x2b9b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.705701:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c5257d lrc: 0/0,0 mode: --/PW res: [0x2b9b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.705704:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c5256f lrc: 2/0,0 mode: PW/PW res: [0x2b9b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.705707:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000050e053bc already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.705708:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c5256f lrc: 2/0,0 mode: PW/PW res: [0x2b9b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.705710:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c5256f lrc: 3/0,0 mode: PW/PW res: [0x2b9b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.705713:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c5256f lrc: 1/0,0 mode: --/PW res: [0x2b9b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.705716:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c5256f lrc: 0/0,0 mode: --/PW res: [0x2b9b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.705723:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1660:39030:x1731745946525440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1133us (1212us total) trans 12885080218 rc 0/0 00010000:00010000:0.0:1651529344.705726:0:151609:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a11a0bb4/0x3234de053c4f06a lrc: 0/0,0 mode: --/PR res: [0x2b9b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7484 expref: 401 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.705727:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212161 00000100:00100000:0.0:1651529344.705732:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000824ca843 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997045248:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.705746:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52584 lrc: 3/0,1 mode: PW/PW res: [0x2b9b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.705750:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52584 lrc: 3/0,1 mode: PW/PW res: [0x2b9b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.705753:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52584 lrc: 3/0,1 mode: PW/PW res: [0x2b9b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.705756:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52584 lrc: 3/0,1 mode: PW/PW res: [0x2b9b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.705758:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52584 lrc: 2/0,0 mode: PW/PW res: [0x2b9b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.705784:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.705795:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1660:39030:x1731745946525568:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 889us (965us total) trans 12885080219 rc 0/0 00000100:00100000:0.0:1651529344.705799:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212164 00000100:00100000:0.0:1651529344.705803:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946525760 00000100:00100000:1.0:1651529344.705808:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.705813:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212166 00000100:00100000:0.0:1651529344.705815:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1660:39029:x1731745946525760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.705820:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178615 count 1 00010000:00010000:0.0:1651529344.705824:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52592 lrc: 3/0,1 mode: --/PW res: [0x2b9b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.705831:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b8d7c403/0x3234de053c4e25c lrc: 2/0,0 mode: PR/PR res: [0x2b9b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3acb expref: 400 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.705833:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.705834:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.705835:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.705835:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52592 lrc: 4/0,1 mode: --/PW res: [0x2b9b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.705849:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b8d7c403/0x3234de053c4e25c lrc: 3/0,0 mode: PR/PR res: [0x2b9b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3acb expref: 400 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.705850:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.705853:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b8d7c403/0x3234de053c4e25c lrc: 4/0,0 mode: PR/PR res: [0x2b9b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3acb expref: 400 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.705857:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000824ca843 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997045376:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.705865:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 0000000076b354b3 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.705870:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52584 lrc: 2/0,0 mode: PW/PW res: [0x2b9b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.705874:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c5599f68 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.705875:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52584 lrc: 2/0,0 mode: PW/PW res: [0x2b9b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.705877:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52584 lrc: 3/0,0 mode: PW/PW res: [0x2b9b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.705882:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52584 lrc: 1/0,0 mode: --/PW res: [0x2b9b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.705885:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52584 lrc: 0/0,0 mode: --/PW res: [0x2b9b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.705892:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946525824 00000100:00100000:0.0:1651529344.705898:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946525696 00000100:00100000:0.0:1651529344.705907:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212167 00000100:00100000:0.0:1651529344.705909:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1662:39030:x1731745946525824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.705916:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178616 count 1 00000100:00100000:1.0:1651529344.705922:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029d739c8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997045312:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.705926:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c5258b lrc: 3/0,1 mode: --/PW res: [0x2b9b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.705934:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212168 00000100:00100000:1.0:1651529344.705936:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1662:39029:x1731745946525696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.705941:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178614 count 1 00010000:00010000:0.0:1651529344.705943:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5280238/0x3234de053c52599 lrc: 3/0,1 mode: --/PW res: [0x2b9b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.705945:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c525a0 lrc: 3/0,1 mode: --/PW res: [0x2b9b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.705949:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000021412013/0x3234de053c4c8c4 lrc: 2/0,0 mode: PR/PR res: [0x2b9b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd4a3 expref: 400 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.705951:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d7fdf0a9/0x3234de053c4d8d1 lrc: 2/0,0 mode: PR/PR res: [0x2b9b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d141a expref: 400 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.705952:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.705953:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.705954:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c525a0 lrc: 4/0,1 mode: --/PW res: [0x2b9b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.705954:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.705960:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000021412013/0x3234de053c4c8c4 lrc: 3/0,0 mode: PR/PR res: [0x2b9b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd4a3 expref: 400 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.705964:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000021412013/0x3234de053c4c8c4 lrc: 4/0,0 mode: PR/PR res: [0x2b9b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd4a3 expref: 400 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.705967:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.705968:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029d739c8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997045440:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.705968:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5280238/0x3234de053c52599 lrc: 4/0,1 mode: --/PW res: [0x2b9b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.705977:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d7fdf0a9/0x3234de053c4d8d1 lrc: 3/0,0 mode: PR/PR res: [0x2b9b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d141a expref: 400 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.705978:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fe434b1c going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.705981:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d7fdf0a9/0x3234de053c4d8d1 lrc: 4/0,0 mode: PR/PR res: [0x2b9b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d141a expref: 400 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.705983:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396406784 00000100:00100000:0.0:1651529344.705985:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000117fbeca pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997045504:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.705987:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008bfcc8ba/0x3234de053c4a099 lrc: 4/0,0 mode: PR/PR res: [0x2b9b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb81e expref: 401 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.705994:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12947 00000100:00100000:0.0:1651529344.705995:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 000000003003c8b0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.705996:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+401:41278:x1731746396406784:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.705999:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.706000:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008bfcc8ba/0x3234de053c4a099 lrc: 4/0,0 mode: PR/PR res: [0x2b9b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb81e expref: 401 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.706003:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008bfcc8ba/0x3234de053c4a099 lrc: 3/0,0 mode: PR/PR res: [0x2b9b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb81e expref: 401 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.706009:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008bfcc8ba/0x3234de053c4a099 lrc: 0/0,0 mode: --/PR res: [0x2b9b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb81e expref: 401 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.706012:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.706013:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.706013:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c5258b lrc: 3/0,1 mode: PW/PW res: [0x2b9b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.706019:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c5258b lrc: 4/0,1 mode: PW/PW res: [0x2b9b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.706024:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.706045:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+400:41278:x1731746396406784:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 48us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.706048:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12947 00010000:00010000:1.0:1651529344.706057:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c5258b lrc: 3/0,1 mode: PW/PW res: [0x2b9b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.706060:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c5258b lrc: 3/0,1 mode: PW/PW res: [0x2b9b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.706063:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c5258b lrc: 3/0,1 mode: PW/PW res: [0x2b9b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.706066:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c5258b lrc: 2/0,0 mode: PW/PW res: [0x2b9b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.706107:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.706118:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.706132:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1663:39030:x1731745946525632:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 954us (1074us total) trans 12885080220 rc 0/0 00000100:00100000:1.0:1651529344.706135:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212165 00000100:00100000:1.0:1651529344.706140:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946525888 00000100:00100000:1.0:1651529344.706148:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946525952 00000100:00100000:1.0:1651529344.706162:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212169 00000100:00100000:1.0:1651529344.706163:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1664:39029:x1731745946525888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.706168:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178617 count 1 00010000:00010000:1.0:1651529344.706173:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c525a7 lrc: 3/0,1 mode: --/PW res: [0x2b9b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.706177:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000044196079/0x3234de053c4e343 lrc: 2/0,0 mode: PR/PR res: [0x2b9b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e05 expref: 399 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.706178:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.706180:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.706181:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.706182:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c525a7 lrc: 4/0,1 mode: --/PW res: [0x2b9b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.706189:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.706198:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.706199:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000044196079/0x3234de053c4e343 lrc: 3/0,0 mode: PR/PR res: [0x2b9b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e05 expref: 399 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.706203:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000044196079/0x3234de053c4e343 lrc: 4/0,0 mode: PR/PR res: [0x2b9b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e05 expref: 399 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.706207:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007ac35c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997045568:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.706241:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946526016 00000100:00100000:1.0:1651529344.706255:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8a0b704 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.706261:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946526080 00000100:00100000:1.0:1651529344.706267:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212170 00000100:00100000:1.0:1651529344.706269:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1666:39030:x1731745946525952:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.706270:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212171 00000100:00100000:0.0:1651529344.706272:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1666:39029:x1731745946526016:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.706273:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178618 count 1 00010000:00010000:1.0:1651529344.706277:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c525ae lrc: 3/0,1 mode: --/PW res: [0x2b9ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.706277:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178619 count 1 00010000:00010000:1.0:1651529344.706281:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b9fad4e0/0x3234de053c4e8ad lrc: 2/0,0 mode: PR/PR res: [0x2b9ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d538a expref: 399 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.706281:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099a3e2d9/0x3234de053c525b5 lrc: 3/0,1 mode: --/PW res: [0x2b9bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.706284:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.706285:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.706286:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c525ae lrc: 4/0,1 mode: --/PW res: [0x2b9ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.706286:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004b7705f0/0x3234de053c4c758 lrc: 2/0,0 mode: PR/PR res: [0x2b9bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccfb0 expref: 399 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.706289:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.706290:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.706290:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099a3e2d9/0x3234de053c525b5 lrc: 4/0,1 mode: --/PW res: [0x2b9bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.706292:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b9fad4e0/0x3234de053c4e8ad lrc: 3/0,0 mode: PR/PR res: [0x2b9ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d538a expref: 399 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.706295:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b9fad4e0/0x3234de053c4e8ad lrc: 4/0,0 mode: PR/PR res: [0x2b9ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d538a expref: 399 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.706297:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004b7705f0/0x3234de053c4c758 lrc: 3/0,0 mode: PR/PR res: [0x2b9bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccfb0 expref: 399 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.706299:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000007fba516 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997045632:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.706301:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004b7705f0/0x3234de053c4c758 lrc: 4/0,0 mode: PR/PR res: [0x2b9bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccfb0 expref: 399 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.706307:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000babe2d90 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.706313:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212172 00000100:00100000:1.0:1651529344.706315:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1666:39030:x1731745946526080:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.706318:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178620 count 1 00000100:00100000:0.0:1651529344.706318:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003de40890 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997045696:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.706321:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c525bc lrc: 3/0,1 mode: --/PW res: [0x2b9bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.706325:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000098b1bd42/0x3234de053c4cfee lrc: 2/0,0 mode: PR/PR res: [0x2b9bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf10c expref: 399 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.706328:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.706328:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c086aae3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.706329:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.706329:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c525bc lrc: 4/0,1 mode: --/PW res: [0x2b9bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.706333:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c5258b lrc: 2/0,0 mode: PW/PW res: [0x2b9b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.706337:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000098b1bd42/0x3234de053c4cfee lrc: 3/0,0 mode: PR/PR res: [0x2b9bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf10c expref: 399 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.706337:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000af20b5e7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.706338:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c5258b lrc: 2/0,0 mode: PW/PW res: [0x2b9b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.706341:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000098b1bd42/0x3234de053c4cfee lrc: 4/0,0 mode: PR/PR res: [0x2b9bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf10c expref: 399 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.706341:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c5258b lrc: 3/0,0 mode: PW/PW res: [0x2b9b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.706345:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000050bbb886 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997045760:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.706345:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c5258b lrc: 1/0,0 mode: --/PW res: [0x2b9b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.706348:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c5258b lrc: 0/0,0 mode: --/PW res: [0x2b9b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.706351:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b7af823 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.706355:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396406848 00010000:00010000:1.0:1651529344.706359:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b8d7c403/0x3234de053c4e25c lrc: 4/0,0 mode: PR/PR res: [0x2b9b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3acb expref: 400 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.706359:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000824ca843 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997045376:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.706363:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52592 lrc: 3/0,1 mode: --/PW res: [0x2b9b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.706367:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12948 00000100:00100000:1.0:1651529344.706369:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+400:41278:x1731746396406848:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.706371:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.706373:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b8d7c403/0x3234de053c4e25c lrc: 4/0,0 mode: PR/PR res: [0x2b9b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3acb expref: 400 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.706376:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b8d7c403/0x3234de053c4e25c lrc: 3/0,0 mode: PR/PR res: [0x2b9b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3acb expref: 400 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.706377:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.706382:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8d7c403/0x3234de053c4e25c lrc: 0/0,0 mode: --/PR res: [0x2b9b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3acb expref: 400 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.706385:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.706386:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.706387:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52592 lrc: 3/0,1 mode: PW/PW res: [0x2b9b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.706390:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52592 lrc: 4/0,1 mode: PW/PW res: [0x2b9b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.706392:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.706404:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.706410:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+399:41278:x1731746396406848:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 41us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.706413:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12948 00000100:00100000:1.0:1651529344.706417:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396406912 00010000:00010000:1.0:1651529344.706421:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000021412013/0x3234de053c4c8c4 lrc: 5/0,0 mode: PR/PR res: [0x2b9b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd4a3 expref: 399 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.706430:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12949 00000100:00100000:1.0:1651529344.706431:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+399:41278:x1731746396406912:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.706441:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.706441:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.706443:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000021412013/0x3234de053c4c8c4 lrc: 5/0,0 mode: PR/PR res: [0x2b9b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd4a3 expref: 399 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.706447:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000021412013/0x3234de053c4c8c4 lrc: 4/0,0 mode: PR/PR res: [0x2b9b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd4a3 expref: 399 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.706452:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.706452:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.706453:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c525a0 lrc: 3/0,1 mode: PW/PW res: [0x2b9b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.706460:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946526144 00010000:00010000:1.0:1651529344.706464:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c525a0 lrc: 4/0,1 mode: PW/PW res: [0x2b9b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.706467:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212173 00010000:00010000:1.0:1651529344.706469:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.706469:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004c9ab8d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1667:39030:x1731745946526144:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.706476:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178621 count 1 00000100:00100000:1.0:1651529344.706479:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+399:41278:x1731746396406912:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 47us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.706482:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12949 00000100:00100000:1.0:1651529344.706486:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396406976 00010000:00010000:0.0:1651529344.706487:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005206389b/0x3234de053c525c3 lrc: 3/0,1 mode: --/PW res: [0x2b9bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.706489:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d7fdf0a9/0x3234de053c4d8d1 lrc: 5/0,0 mode: PR/PR res: [0x2b9b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d141a expref: 399 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.706491:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009d24b2c9/0x3234de053c4c9d5 lrc: 2/0,0 mode: PR/PR res: [0x2b9bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd981 expref: 399 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.706494:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12950 00000100:00100000:1.0:1651529344.706496:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+399:41279:x1731746396406976:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.706498:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.706499:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d7fdf0a9/0x3234de053c4d8d1 lrc: 5/0,0 mode: PR/PR res: [0x2b9b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d141a expref: 399 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.706502:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d7fdf0a9/0x3234de053c4d8d1 lrc: 4/0,0 mode: PR/PR res: [0x2b9b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d141a expref: 399 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.706507:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.706508:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.706508:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.706509:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e5280238/0x3234de053c52599 lrc: 3/0,1 mode: PW/PW res: [0x2b9b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.706509:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.706510:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005206389b/0x3234de053c525c3 lrc: 4/0,1 mode: --/PW res: [0x2b9bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.706511:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5280238/0x3234de053c52599 lrc: 4/0,1 mode: PW/PW res: [0x2b9b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.706516:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.706517:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009d24b2c9/0x3234de053c4c9d5 lrc: 3/0,0 mode: PR/PR res: [0x2b9bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd981 expref: 399 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.706520:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+399:41279:x1731746396406976:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 24us (80us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.706521:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009d24b2c9/0x3234de053c4c9d5 lrc: 4/0,0 mode: PR/PR res: [0x2b9bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd981 expref: 399 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.706523:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12950 00000100:00100000:0.0:1651529344.706525:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000088fa78f8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997045824:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.706534:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000003c8b0daf going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.706535:0:106695:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021412013/0x3234de053c4c8c4 lrc: 0/0,0 mode: --/PR res: [0x2b9b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd4a3 expref: 398 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.706538:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029d739c8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997045440:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.706542:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c525a0 lrc: 3/0,1 mode: PW/PW res: [0x2b9b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.706543:0:156655:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7fdf0a9/0x3234de053c4d8d1 lrc: 0/0,0 mode: --/PR res: [0x2b9b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d141a expref: 397 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.706545:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c525a0 lrc: 3/0,1 mode: PW/PW res: [0x2b9b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.706547:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000117fbeca pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997045504:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.706548:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c525a0 lrc: 3/0,1 mode: PW/PW res: [0x2b9b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.706550:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e5280238/0x3234de053c52599 lrc: 3/0,1 mode: PW/PW res: [0x2b9b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.706551:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c525a0 lrc: 3/0,1 mode: PW/PW res: [0x2b9b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.706553:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c525a0 lrc: 2/0,0 mode: PW/PW res: [0x2b9b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.706556:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e5280238/0x3234de053c52599 lrc: 3/0,1 mode: PW/PW res: [0x2b9b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.706559:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5280238/0x3234de053c52599 lrc: 3/0,1 mode: PW/PW res: [0x2b9b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.706562:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5280238/0x3234de053c52599 lrc: 3/0,1 mode: PW/PW res: [0x2b9b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.706564:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5280238/0x3234de053c52599 lrc: 2/0,0 mode: PW/PW res: [0x2b9b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.706591:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1669:39029:x1731745946525696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 655us (741us total) trans 12885080221 rc 0/0 00000100:00100000:1.0:1651529344.706596:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212168 00010000:00010000:1.0:1651529344.706603:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c525a0 lrc: 2/0,0 mode: PW/PW res: [0x2b9b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.706605:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1668:39030:x1731745946525824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 695us (772us total) trans 12885080222 rc 0/0 00010000:00010000:1.0:1651529344.706606:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008ac1e27e already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.706607:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c525a0 lrc: 2/0,0 mode: PW/PW res: [0x2b9b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.706608:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212167 00010000:00010000:1.0:1651529344.706610:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c525a0 lrc: 3/0,0 mode: PW/PW res: [0x2b9b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.706615:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c525a0 lrc: 1/0,0 mode: --/PW res: [0x2b9b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.706616:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5280238/0x3234de053c52599 lrc: 2/0,0 mode: PW/PW res: [0x2b9b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.706617:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c525a0 lrc: 0/0,0 mode: --/PW res: [0x2b9b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.706619:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e5280238 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.706620:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5280238/0x3234de053c52599 lrc: 2/0,0 mode: PW/PW res: [0x2b9b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.706623:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5280238/0x3234de053c52599 lrc: 3/0,0 mode: PW/PW res: [0x2b9b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.706627:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5280238/0x3234de053c52599 lrc: 1/0,0 mode: --/PW res: [0x2b9b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.706630:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5280238/0x3234de053c52599 lrc: 0/0,0 mode: --/PW res: [0x2b9b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.706636:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52592 lrc: 3/0,1 mode: PW/PW res: [0x2b9b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.706639:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52592 lrc: 3/0,1 mode: PW/PW res: [0x2b9b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.706642:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52592 lrc: 3/0,1 mode: PW/PW res: [0x2b9b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.706645:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52592 lrc: 2/0,0 mode: PW/PW res: [0x2b9b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.706684:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1668:39029:x1731745946525760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 868us (908us total) trans 12885080223 rc 0/0 00000100:00100000:0.0:1651529344.706687:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212166 00010000:00010000:0.0:1651529344.706693:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52592 lrc: 2/0,0 mode: PW/PW res: [0x2b9b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.706697:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000048ee8765 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.706698:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52592 lrc: 2/0,0 mode: PW/PW res: [0x2b9b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.706700:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52592 lrc: 3/0,0 mode: PW/PW res: [0x2b9b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.706724:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52592 lrc: 1/0,0 mode: --/PW res: [0x2b9b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.706727:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52592 lrc: 0/0,0 mode: --/PW res: [0x2b9b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.706765:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007ac35c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997045568:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.706766:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003de40890 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997045696:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.706769:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c525a7 lrc: 3/0,1 mode: --/PW res: [0x2b9b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.706771:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000099a3e2d9/0x3234de053c525b5 lrc: 3/0,1 mode: --/PW res: [0x2b9bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.706776:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000007fba516 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997045632:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.706779:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c525ae lrc: 3/0,1 mode: --/PW res: [0x2b9ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.706785:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000050bbb886 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997045760:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.706787:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c525bc lrc: 3/0,1 mode: --/PW res: [0x2b9bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.706813:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.706816:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.706820:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946526208 00000100:00100000:1.0:1651529344.706835:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.706842:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212174 00000100:00100000:0.0:1651529344.706844:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1668:39030:x1731745946526208:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.706845:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:0.0:1651529344.706849:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178622 count 1 00000100:00100000:1.0:1651529344.706851:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.706853:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000437ad37b/0x3234de053c525ca lrc: 3/0,1 mode: --/PW res: [0x2b9be:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.706866:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396407040 00010000:00010000:1.0:1651529344.706871:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000044196079/0x3234de053c4e343 lrc: 4/0,0 mode: PR/PR res: [0x2b9b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e05 expref: 397 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.706877:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396407104 00010000:00010000:1.0:1651529344.706879:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b9fad4e0/0x3234de053c4e8ad lrc: 4/0,0 mode: PR/PR res: [0x2b9ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d538a expref: 398 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.706883:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396407168 00010000:00010000:1.0:1651529344.706885:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004b7705f0/0x3234de053c4c758 lrc: 4/0,0 mode: PR/PR res: [0x2b9bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccfb0 expref: 399 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.706889:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006d5f5234/0x3234de053c4f492 lrc: 2/0,0 mode: PR/PR res: [0x2b9be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84d0 expref: 399 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.706897:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396407232 00010000:00010000:1.0:1651529344.706900:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000098b1bd42/0x3234de053c4cfee lrc: 4/0,0 mode: PR/PR res: [0x2b9bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf10c expref: 400 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.706906:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.706907:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.706908:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000437ad37b/0x3234de053c525ca lrc: 4/0,1 mode: --/PW res: [0x2b9be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.706911:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12951 00000100:00100000:1.0:1651529344.706912:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+400:41279:x1731746396407040:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.706915:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.706917:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000044196079/0x3234de053c4e343 lrc: 4/0,0 mode: PR/PR res: [0x2b9b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e05 expref: 400 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.706921:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000044196079/0x3234de053c4e343 lrc: 3/0,0 mode: PR/PR res: [0x2b9b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e05 expref: 400 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.706925:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006d5f5234/0x3234de053c4f492 lrc: 3/0,0 mode: PR/PR res: [0x2b9be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84d0 expref: 400 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.706926:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044196079/0x3234de053c4e343 lrc: 0/0,0 mode: --/PR res: [0x2b9b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e05 expref: 400 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.706930:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.706930:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.706931:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c525a7 lrc: 3/0,1 mode: PW/PW res: [0x2b9b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.706931:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006d5f5234/0x3234de053c4f492 lrc: 4/0,0 mode: PR/PR res: [0x2b9be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84d0 expref: 399 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.706934:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c525a7 lrc: 4/0,1 mode: PW/PW res: [0x2b9b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.706938:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f9050c71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997045888:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.706940:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.706948:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+399:41279:x1731746396407040:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.706950:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12951 00000100:00100000:0.0:1651529344.706951:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 000000003678d25f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.706954:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12952 00000100:00100000:1.0:1651529344.706956:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+398:41278:x1731746396407104:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.706958:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.706960:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b9fad4e0/0x3234de053c4e8ad lrc: 4/0,0 mode: PR/PR res: [0x2b9ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d538a expref: 398 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.706960:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000088fa78f8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997045824:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.706963:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b9fad4e0/0x3234de053c4e8ad lrc: 3/0,0 mode: PR/PR res: [0x2b9ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d538a expref: 398 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.706964:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005206389b/0x3234de053c525c3 lrc: 3/0,1 mode: --/PW res: [0x2b9bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.706968:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9fad4e0/0x3234de053c4e8ad lrc: 0/0,0 mode: --/PR res: [0x2b9ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d538a expref: 398 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.706971:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.706971:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.706972:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c525ae lrc: 3/0,1 mode: PW/PW res: [0x2b9ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.706975:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c525ae lrc: 4/0,1 mode: PW/PW res: [0x2b9ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.706978:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.706980:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.706985:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+397:41278:x1731746396407104:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 28us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.706988:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12952 00000100:00100000:1.0:1651529344.706991:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12953 00000100:00100000:1.0:1651529344.706993:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045c93b49 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+396:41279:x1731746396407168:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.706995:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.706996:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004b7705f0/0x3234de053c4c758 lrc: 4/0,0 mode: PR/PR res: [0x2b9bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccfb0 expref: 396 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.706999:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004b7705f0/0x3234de053c4c758 lrc: 3/0,0 mode: PR/PR res: [0x2b9bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccfb0 expref: 396 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.707003:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b7705f0/0x3234de053c4c758 lrc: 0/0,0 mode: --/PR res: [0x2b9bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccfb0 expref: 396 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.707004:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.707015:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.707023:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.707024:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.707024:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000099a3e2d9/0x3234de053c525b5 lrc: 3/0,1 mode: PW/PW res: [0x2b9bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.707027:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099a3e2d9/0x3234de053c525b5 lrc: 4/0,1 mode: PW/PW res: [0x2b9bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.707040:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.707044:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946526336 00000100:00100000:1.0:1651529344.707050:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045c93b49 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+395:41279:x1731746396407168:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 56us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.707053:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12953 00000100:00100000:0.0:1651529344.707056:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946526272 00000100:00100000:0.0:1651529344.707063:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212175 00000100:00100000:0.0:1651529344.707065:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1670:39030:x1731745946526336:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.707066:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396407296 00010000:00010000:1.0:1651529344.707070:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009d24b2c9/0x3234de053c4c9d5 lrc: 4/0,0 mode: PR/PR res: [0x2b9bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd981 expref: 395 pid: 72396 timeout: 20103 lvb_type: 1 00002000:00080000:0.0:1651529344.707070:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178624 count 1 00010000:00010000:0.0:1651529344.707075:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021901d62/0x3234de053c525d1 lrc: 3/0,1 mode: --/PW res: [0x2b9c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.707076:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12954 00000100:00100000:1.0:1651529344.707077:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+395:41278:x1731746396407232:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.707079:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.707079:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000082be9f5f/0x3234de053c4d106 lrc: 2/0,0 mode: PR/PR res: [0x2b9c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf5c0 expref: 395 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.707081:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000098b1bd42/0x3234de053c4cfee lrc: 4/0,0 mode: PR/PR res: [0x2b9bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf10c expref: 395 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.707084:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000098b1bd42/0x3234de053c4cfee lrc: 3/0,0 mode: PR/PR res: [0x2b9bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf10c expref: 395 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.707085:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.707085:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.707086:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021901d62/0x3234de053c525d1 lrc: 4/0,1 mode: --/PW res: [0x2b9c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.707089:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098b1bd42/0x3234de053c4cfee lrc: 0/0,0 mode: --/PR res: [0x2b9bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf10c expref: 395 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.707093:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.707093:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.707093:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000082be9f5f/0x3234de053c4d106 lrc: 3/0,0 mode: PR/PR res: [0x2b9c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf5c0 expref: 394 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.707094:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c525bc lrc: 3/0,1 mode: PW/PW res: [0x2b9bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.707096:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000082be9f5f/0x3234de053c4d106 lrc: 4/0,0 mode: PR/PR res: [0x2b9c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf5c0 expref: 394 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.707097:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c525bc lrc: 4/0,1 mode: PW/PW res: [0x2b9bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.707100:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000117fbeca pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997045952:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.707102:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.707109:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 000000003003c8b0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.707110:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+394:41278:x1731746396407232:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 33us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.707113:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12954 00010000:00010000:0.0:1651529344.707114:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000099a3e2d9/0x3234de053c525b5 lrc: 3/0,1 mode: PW/PW res: [0x2b9bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.707117:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12955 00010000:00010000:0.0:1651529344.707117:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099a3e2d9/0x3234de053c525b5 lrc: 3/0,1 mode: PW/PW res: [0x2b9bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.707118:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+393:41278:x1731746396407296:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.707120:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.707120:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099a3e2d9/0x3234de053c525b5 lrc: 3/0,1 mode: PW/PW res: [0x2b9bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.707122:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009d24b2c9/0x3234de053c4c9d5 lrc: 4/0,0 mode: PR/PR res: [0x2b9bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd981 expref: 393 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.707123:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099a3e2d9/0x3234de053c525b5 lrc: 2/0,0 mode: PW/PW res: [0x2b9bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.707125:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009d24b2c9/0x3234de053c4c9d5 lrc: 3/0,0 mode: PR/PR res: [0x2b9bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd981 expref: 393 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.707136:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d24b2c9/0x3234de053c4c9d5 lrc: 0/0,0 mode: --/PR res: [0x2b9bd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd981 expref: 393 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.707140:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.707140:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.707141:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005206389b/0x3234de053c525c3 lrc: 3/0,1 mode: PW/PW res: [0x2b9bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.707144:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005206389b/0x3234de053c525c3 lrc: 4/0,1 mode: PW/PW res: [0x2b9bd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.707152:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.707158:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:41278:x1731746396407296:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 39us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.707160:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12955 00010000:00010000:1.0:1651529344.707168:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c525a7 lrc: 3/0,1 mode: PW/PW res: [0x2b9b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.707171:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c525a7 lrc: 3/0,1 mode: PW/PW res: [0x2b9b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.707174:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c525a7 lrc: 3/0,1 mode: PW/PW res: [0x2b9b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.707177:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c525a7 lrc: 2/0,0 mode: PW/PW res: [0x2b9b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.707205:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1672:39029:x1731745946526016:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 932us (1027us total) trans 12885080224 rc 0/0 00000100:00100000:0.0:1651529344.707208:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212171 00000100:00100000:0.0:1651529344.707214:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212176 00000100:00100000:0.0:1651529344.707216:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1671:39029:x1731745946526272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.707218:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1671:39029:x1731745946525888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1054us (1111us total) trans 12885080225 rc 0/0 00002000:00080000:0.0:1651529344.707220:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178623 count 1 00000100:00100000:1.0:1651529344.707221:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212169 00010000:00010000:0.0:1651529344.707241:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b19bfe47/0x3234de053c525d8 lrc: 3/0,1 mode: --/PW res: [0x2b9bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.707244:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c525ae lrc: 3/0,1 mode: PW/PW res: [0x2b9ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.707246:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000c10aa9d/0x3234de053c4cedd lrc: 2/0,0 mode: PR/PR res: [0x2b9bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced46 expref: 391 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.707250:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c525ae lrc: 3/0,1 mode: PW/PW res: [0x2b9ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.707250:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.707250:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.707251:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b19bfe47/0x3234de053c525d8 lrc: 4/0,1 mode: --/PW res: [0x2b9bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.707253:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c525ae lrc: 3/0,1 mode: PW/PW res: [0x2b9ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.707256:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c525ae lrc: 2/0,0 mode: PW/PW res: [0x2b9ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.707258:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000c10aa9d/0x3234de053c4cedd lrc: 3/0,0 mode: PR/PR res: [0x2b9bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced46 expref: 391 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.707262:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000c10aa9d/0x3234de053c4cedd lrc: 4/0,0 mode: PR/PR res: [0x2b9bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced46 expref: 391 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.707272:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000055e03b4f pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997046016:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.707280:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 0000000049203969 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.707286:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099a3e2d9/0x3234de053c525b5 lrc: 2/0,0 mode: PW/PW res: [0x2b9bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.707292:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000099a3e2d9 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.707293:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099a3e2d9/0x3234de053c525b5 lrc: 2/0,0 mode: PW/PW res: [0x2b9bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.707294:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1671:39030:x1731745946525952:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1024us (1176us total) trans 12885080226 rc 0/0 00010000:00010000:0.0:1651529344.707296:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099a3e2d9/0x3234de053c525b5 lrc: 3/0,0 mode: PW/PW res: [0x2b9bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.707297:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212170 00010000:00010000:0.0:1651529344.707301:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099a3e2d9/0x3234de053c525b5 lrc: 1/0,0 mode: --/PW res: [0x2b9bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.707303:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099a3e2d9/0x3234de053c525b5 lrc: 0/0,0 mode: --/PW res: [0x2b9bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.707305:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c525bc lrc: 3/0,1 mode: PW/PW res: [0x2b9bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.707307:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c525a7 lrc: 2/0,0 mode: PW/PW res: [0x2b9b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.707308:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c525bc lrc: 3/0,1 mode: PW/PW res: [0x2b9bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.707310:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003c075ac0 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.707311:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c525bc lrc: 3/0,1 mode: PW/PW res: [0x2b9bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.707311:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c525a7 lrc: 2/0,0 mode: PW/PW res: [0x2b9b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.707314:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c525bc lrc: 2/0,0 mode: PW/PW res: [0x2b9bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.707314:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c525a7 lrc: 3/0,0 mode: PW/PW res: [0x2b9b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.707317:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c525a7 lrc: 1/0,0 mode: --/PW res: [0x2b9b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.707319:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c525a7 lrc: 0/0,0 mode: --/PW res: [0x2b9b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.707324:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c525ae lrc: 2/0,0 mode: PW/PW res: [0x2b9ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.707326:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009e44ce9d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.707327:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c525ae lrc: 2/0,0 mode: PW/PW res: [0x2b9ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.707330:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c525ae lrc: 3/0,0 mode: PW/PW res: [0x2b9ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.707333:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c525ae lrc: 1/0,0 mode: --/PW res: [0x2b9ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.707335:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c525ae lrc: 0/0,0 mode: --/PW res: [0x2b9ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.707339:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c525bc lrc: 2/0,0 mode: PW/PW res: [0x2b9bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.707341:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000490515f1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.707342:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c525bc lrc: 2/0,0 mode: PW/PW res: [0x2b9bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.707343:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1671:39030:x1731745946526080:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1027us (1144us total) trans 12885080227 rc 0/0 00010000:00010000:0.0:1651529344.707345:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c525bc lrc: 3/0,0 mode: PW/PW res: [0x2b9bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.707347:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212172 00010000:00010000:0.0:1651529344.707348:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c525bc lrc: 1/0,0 mode: --/PW res: [0x2b9bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.707351:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c525bc lrc: 0/0,0 mode: --/PW res: [0x2b9bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.707356:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005206389b/0x3234de053c525c3 lrc: 3/0,1 mode: PW/PW res: [0x2b9bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.707359:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005206389b/0x3234de053c525c3 lrc: 3/0,1 mode: PW/PW res: [0x2b9bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.707362:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005206389b/0x3234de053c525c3 lrc: 3/0,1 mode: PW/PW res: [0x2b9bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.707365:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005206389b/0x3234de053c525c3 lrc: 2/0,0 mode: PW/PW res: [0x2b9bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.707398:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.707413:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004c9ab8d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1671:39030:x1731745946526144:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 943us (1036us total) trans 12885080228 rc 0/0 00000100:00100000:0.0:1651529344.707417:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212173 00000100:00100000:0.0:1651529344.707440:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f9050c71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997045888:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.707444:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000437ad37b/0x3234de053c525ca lrc: 3/0,1 mode: --/PW res: [0x2b9be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.707472:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396407360 00010000:00010000:1.0:1651529344.707474:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005206389b/0x3234de053c525c3 lrc: 2/0,0 mode: PW/PW res: [0x2b9bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.707477:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006d5f5234/0x3234de053c4f492 lrc: 4/0,0 mode: PR/PR res: [0x2b9be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84d0 expref: 392 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.707478:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005206389b already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.707480:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005206389b/0x3234de053c525c3 lrc: 2/0,0 mode: PW/PW res: [0x2b9bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.707483:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005206389b/0x3234de053c525c3 lrc: 3/0,0 mode: PW/PW res: [0x2b9bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.707491:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12956 00010000:00010000:1.0:1651529344.707493:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005206389b/0x3234de053c525c3 lrc: 1/0,0 mode: --/PW res: [0x2b9bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.707493:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:41278:x1731746396407360:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.707496:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005206389b/0x3234de053c525c3 lrc: 0/0,0 mode: --/PW res: [0x2b9bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.707496:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.707497:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006d5f5234/0x3234de053c4f492 lrc: 4/0,0 mode: PR/PR res: [0x2b9be:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84d0 expref: 392 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.707501:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006d5f5234/0x3234de053c4f492 lrc: 3/0,0 mode: PR/PR res: [0x2b9be:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84d0 expref: 392 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.707524:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d5f5234/0x3234de053c4f492 lrc: 0/0,0 mode: --/PR res: [0x2b9be:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84d0 expref: 392 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.707528:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.707529:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.707530:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000437ad37b/0x3234de053c525ca lrc: 3/0,1 mode: PW/PW res: [0x2b9be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.707533:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000437ad37b/0x3234de053c525ca lrc: 4/0,1 mode: PW/PW res: [0x2b9be:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.707540:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.707553:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+391:41278:x1731746396407360:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 60us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.707556:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12956 00010000:00010000:0.0:1651529344.707563:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000437ad37b/0x3234de053c525ca lrc: 3/0,1 mode: PW/PW res: [0x2b9be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.707567:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000437ad37b/0x3234de053c525ca lrc: 3/0,1 mode: PW/PW res: [0x2b9be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.707570:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000437ad37b/0x3234de053c525ca lrc: 3/0,1 mode: PW/PW res: [0x2b9be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.707572:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000437ad37b/0x3234de053c525ca lrc: 2/0,0 mode: PW/PW res: [0x2b9be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.707611:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1671:39030:x1731745946526208:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 766us (799us total) trans 12885080229 rc 0/0 00000100:00100000:0.0:1651529344.707638:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212174 00010000:00010000:0.0:1651529344.707657:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000437ad37b/0x3234de053c525ca lrc: 2/0,0 mode: PW/PW res: [0x2b9be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.707661:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000437ad37b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.707662:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000437ad37b/0x3234de053c525ca lrc: 2/0,0 mode: PW/PW res: [0x2b9be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.707672:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000437ad37b/0x3234de053c525ca lrc: 3/0,0 mode: PW/PW res: [0x2b9be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.707676:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.707693:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.707695:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000437ad37b/0x3234de053c525ca lrc: 1/0,0 mode: --/PW res: [0x2b9be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.707703:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000437ad37b/0x3234de053c525ca lrc: 0/0,0 mode: --/PW res: [0x2b9be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.707713:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.707719:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000055e03b4f pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997046016:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.707722:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b19bfe47/0x3234de053c525d8 lrc: 3/0,1 mode: --/PW res: [0x2b9bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.707729:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.707729:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946526400 00000100:00100000:1.0:1651529344.707749:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.707764:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946526464 00000100:00100000:1.0:1651529344.707765:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.707770:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946526528 00000100:00100000:1.0:1651529344.707773:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.707777:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946526592 00000100:00100000:0.0:1651529344.707780:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946526656 00000100:00100000:0.0:1651529344.707786:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212177 00000100:00100000:0.0:1651529344.707787:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1675:39029:x1731745946526400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.707792:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212178 00002000:00080000:0.0:1651529344.707793:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178625 count 1 00000100:00100000:1.0:1651529344.707794:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1675:39030:x1731745946526464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.707797:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006325442a/0x3234de053c525df lrc: 3/0,1 mode: --/PW res: [0x2b9c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.707800:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178626 count 1 00010000:00010000:1.0:1651529344.707804:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c525e6 lrc: 3/0,1 mode: --/PW res: [0x2b9c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.707809:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fa031f64/0x3234de053c4ed5a lrc: 2/0,0 mode: PR/PR res: [0x2b9c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6756 expref: 390 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.707812:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.707813:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.707819:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c525e6 lrc: 4/0,1 mode: --/PW res: [0x2b9c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.707819:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000376045ea/0x3234de053c4bf47 lrc: 2/0,0 mode: PR/PR res: [0x2b9c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc713 expref: 390 pid: 80281 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.707823:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.707823:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.707824:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006325442a/0x3234de053c525df lrc: 4/0,1 mode: --/PW res: [0x2b9c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.707827:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fa031f64/0x3234de053c4ed5a lrc: 3/0,0 mode: PR/PR res: [0x2b9c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6756 expref: 390 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.707831:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fa031f64/0x3234de053c4ed5a lrc: 4/0,0 mode: PR/PR res: [0x2b9c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6756 expref: 390 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.707831:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000376045ea/0x3234de053c4bf47 lrc: 3/0,0 mode: PR/PR res: [0x2b9c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc713 expref: 390 pid: 80281 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.707835:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000097928145 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997046080:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.707835:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000376045ea/0x3234de053c4bf47 lrc: 4/0,0 mode: PR/PR res: [0x2b9c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc713 expref: 390 pid: 80281 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.707840:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000055e03b4f pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997046144:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.707844:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c3caa148 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.707849:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000afe7ff7b going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.707850:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212179 00000100:00100000:1.0:1651529344.707852:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1675:39029:x1731745946526528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.707856:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178627 count 1 00000100:00100000:0.0:1651529344.707856:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212180 00000100:00100000:0.0:1651529344.707857:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1675:39030:x1731745946526592:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.707859:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c525ed lrc: 3/0,1 mode: --/PW res: [0x2b9c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.707862:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178628 count 1 00010000:00010000:1.0:1651529344.707864:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001db46651/0x3234de053c4d4a2 lrc: 2/0,0 mode: PR/PR res: [0x2b9c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0468 expref: 390 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.707865:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002056e733/0x3234de053c525f4 lrc: 3/0,1 mode: --/PW res: [0x2b9c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.707867:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.707867:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.707868:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c525ed lrc: 4/0,1 mode: --/PW res: [0x2b9c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.707870:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c948a019/0x3234de053c4da9f lrc: 2/0,0 mode: PR/PR res: [0x2b9c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ac6 expref: 390 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.707872:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.707873:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.707874:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001db46651/0x3234de053c4d4a2 lrc: 3/0,0 mode: PR/PR res: [0x2b9c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0468 expref: 390 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.707874:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002056e733/0x3234de053c525f4 lrc: 4/0,1 mode: --/PW res: [0x2b9c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.707877:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001db46651/0x3234de053c4d4a2 lrc: 4/0,0 mode: PR/PR res: [0x2b9c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0468 expref: 390 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.707879:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c948a019/0x3234de053c4da9f lrc: 3/0,0 mode: PR/PR res: [0x2b9c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ac6 expref: 390 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.707881:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a9b051f pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997046208:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.707883:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c948a019/0x3234de053c4da9f lrc: 4/0,0 mode: PR/PR res: [0x2b9c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ac6 expref: 390 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.707887:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aeda71fe going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.707887:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029abc941 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997046272:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.707893:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212181 00000100:00100000:0.0:1651529344.707893:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b81e4a0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.707895:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1675:39029:x1731745946526656:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.707898:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178629 count 1 00000100:00100000:0.0:1651529344.707900:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000117fbeca pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997045952:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.707901:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c525fb lrc: 3/0,1 mode: --/PW res: [0x2b9c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.707904:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000021901d62/0x3234de053c525d1 lrc: 3/0,1 mode: --/PW res: [0x2b9c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.707906:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b6fc1d80/0x3234de053c4cbaa lrc: 2/0,0 mode: PR/PR res: [0x2b9c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce06c expref: 390 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.707909:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.707909:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.707910:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c525fb lrc: 4/0,1 mode: --/PW res: [0x2b9c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.707918:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b6fc1d80/0x3234de053c4cbaa lrc: 3/0,0 mode: PR/PR res: [0x2b9c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce06c expref: 390 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.707921:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b6fc1d80/0x3234de053c4cbaa lrc: 4/0,0 mode: PR/PR res: [0x2b9c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce06c expref: 390 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.707925:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f9050c71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997046336:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.707925:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.707931:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a4eb401d going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.707936:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946526720 00000100:00100000:1.0:1651529344.707942:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212182 00000100:00100000:1.0:1651529344.707943:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1676:39030:x1731745946526720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.707947:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178630 count 1 00010000:00010000:1.0:1651529344.707950:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c52602 lrc: 3/0,1 mode: --/PW res: [0x2b9c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.707954:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef512242/0x3234de053c4e0fe lrc: 2/0,0 mode: PR/PR res: [0x2b9c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3488 expref: 390 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.707957:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.707958:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.707958:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c52602 lrc: 4/0,1 mode: --/PW res: [0x2b9c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.707964:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ef512242/0x3234de053c4e0fe lrc: 3/0,0 mode: PR/PR res: [0x2b9c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3488 expref: 390 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.707969:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ef512242/0x3234de053c4e0fe lrc: 4/0,0 mode: PR/PR res: [0x2b9c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3488 expref: 390 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.707980:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396407424 00010000:00010000:0.0:1651529344.707986:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000082be9f5f/0x3234de053c4d106 lrc: 4/0,0 mode: PR/PR res: [0x2b9c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf5c0 expref: 391 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.707997:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396407488 00010000:00010000:0.0:1651529344.707999:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000c10aa9d/0x3234de053c4cedd lrc: 4/0,0 mode: PR/PR res: [0x2b9bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced46 expref: 392 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.708007:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12957 00000100:00100000:0.0:1651529344.708009:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:41278:x1731746396407424:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.708010:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004972eb27 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997046400:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.708012:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.708014:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000082be9f5f/0x3234de053c4d106 lrc: 4/0,0 mode: PR/PR res: [0x2b9c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf5c0 expref: 392 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.708018:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000082be9f5f/0x3234de053c4d106 lrc: 3/0,0 mode: PR/PR res: [0x2b9c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf5c0 expref: 392 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.708024:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fe434b1c going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.708030:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12958 00010000:00010000:0.0:1651529344.708030:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082be9f5f/0x3234de053c4d106 lrc: 0/0,0 mode: --/PR res: [0x2b9c0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf5c0 expref: 392 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.708032:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:41278:x1731746396407488:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.708036:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.708038:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000c10aa9d/0x3234de053c4cedd lrc: 4/0,0 mode: PR/PR res: [0x2b9bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced46 expref: 392 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.708042:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000c10aa9d/0x3234de053c4cedd lrc: 3/0,0 mode: PR/PR res: [0x2b9bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced46 expref: 392 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.708047:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c10aa9d/0x3234de053c4cedd lrc: 0/0,0 mode: --/PR res: [0x2b9bf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced46 expref: 391 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.708048:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.708048:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.708049:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000021901d62/0x3234de053c525d1 lrc: 3/0,1 mode: PW/PW res: [0x2b9c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.708051:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.708051:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.708052:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b19bfe47/0x3234de053c525d8 lrc: 3/0,1 mode: PW/PW res: [0x2b9bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.708053:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021901d62/0x3234de053c525d1 lrc: 4/0,1 mode: PW/PW res: [0x2b9c0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.708055:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b19bfe47/0x3234de053c525d8 lrc: 4/0,1 mode: PW/PW res: [0x2b9bf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.708060:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.708066:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.708074:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+390:41278:x1731746396407488:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.708074:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+390:41278:x1731746396407424:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 64us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.708077:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12957 00000100:00100000:1.0:1651529344.708078:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12958 00010000:00010000:0.0:1651529344.708084:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b19bfe47/0x3234de053c525d8 lrc: 3/0,1 mode: PW/PW res: [0x2b9bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.708087:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b19bfe47/0x3234de053c525d8 lrc: 3/0,1 mode: PW/PW res: [0x2b9bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.708090:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b19bfe47/0x3234de053c525d8 lrc: 3/0,1 mode: PW/PW res: [0x2b9bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.708093:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b19bfe47/0x3234de053c525d8 lrc: 2/0,0 mode: PW/PW res: [0x2b9bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.708138:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1677:39029:x1731745946526272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 921us (1123us total) trans 12885080230 rc 0/0 00000100:00100000:0.0:1651529344.708141:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212176 00010000:00010000:0.0:1651529344.708149:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b19bfe47/0x3234de053c525d8 lrc: 2/0,0 mode: PW/PW res: [0x2b9bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.708152:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b19bfe47 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.708153:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b19bfe47/0x3234de053c525d8 lrc: 2/0,0 mode: PW/PW res: [0x2b9bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.708156:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b19bfe47/0x3234de053c525d8 lrc: 3/0,0 mode: PW/PW res: [0x2b9bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.708161:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b19bfe47/0x3234de053c525d8 lrc: 1/0,0 mode: --/PW res: [0x2b9bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.708163:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b19bfe47/0x3234de053c525d8 lrc: 0/0,0 mode: --/PW res: [0x2b9bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.708169:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000021901d62/0x3234de053c525d1 lrc: 3/0,1 mode: PW/PW res: [0x2b9c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.708172:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021901d62/0x3234de053c525d1 lrc: 3/0,1 mode: PW/PW res: [0x2b9c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.708175:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021901d62/0x3234de053c525d1 lrc: 3/0,1 mode: PW/PW res: [0x2b9c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.708178:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021901d62/0x3234de053c525d1 lrc: 2/0,0 mode: PW/PW res: [0x2b9c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.708188:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021901d62/0x3234de053c525d1 lrc: 2/0,0 mode: PW/PW res: [0x2b9c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.708192:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000021901d62 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.708193:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021901d62/0x3234de053c525d1 lrc: 2/0,0 mode: PW/PW res: [0x2b9c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.708196:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021901d62/0x3234de053c525d1 lrc: 3/0,0 mode: PW/PW res: [0x2b9c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.708201:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021901d62/0x3234de053c525d1 lrc: 1/0,0 mode: --/PW res: [0x2b9c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.708204:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021901d62/0x3234de053c525d1 lrc: 0/0,0 mode: --/PW res: [0x2b9c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.708219:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1677:39030:x1731745946526336:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1153us (1240us total) trans 12885080231 rc 0/0 00000100:00100000:0.0:1651529344.708241:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212175 00000100:00100000:1.0:1651529344.708304:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.708338:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000097928145 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997046080:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.708342:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c525e6 lrc: 3/0,1 mode: --/PW res: [0x2b9c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.708363:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a9b051f pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997046208:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.708370:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.708371:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c525ed lrc: 3/0,1 mode: --/PW res: [0x2b9c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.708378:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f9050c71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997046336:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.708381:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c525fb lrc: 3/0,1 mode: --/PW res: [0x2b9c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.708404:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.708410:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396407552 00000100:00100000:0.0:1651529344.708413:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.708416:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fa031f64/0x3234de053c4ed5a lrc: 4/0,0 mode: PR/PR res: [0x2b9c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6756 expref: 389 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.708428:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396407680 00010000:00010000:1.0:1651529344.708431:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001db46651/0x3234de053c4d4a2 lrc: 4/0,0 mode: PR/PR res: [0x2b9c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0468 expref: 390 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.708435:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.708445:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396407808 00010000:00010000:1.0:1651529344.708448:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b6fc1d80/0x3234de053c4cbaa lrc: 4/0,0 mode: PR/PR res: [0x2b9c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce06c expref: 391 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.708450:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.708452:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396407616 00010000:00010000:1.0:1651529344.708454:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000376045ea/0x3234de053c4bf47 lrc: 5/0,0 mode: PR/PR res: [0x2b9c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc713 expref: 392 pid: 80281 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.708455:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.708458:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396407744 00010000:00010000:1.0:1651529344.708460:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c948a019/0x3234de053c4da9f lrc: 5/0,0 mode: PR/PR res: [0x2b9c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ac6 expref: 393 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.708468:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.708470:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396407872 00010000:00010000:1.0:1651529344.708472:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ef512242/0x3234de053c4e0fe lrc: 5/0,0 mode: PR/PR res: [0x2b9c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3488 expref: 394 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.708477:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12959 00000100:00100000:0.0:1651529344.708477:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029abc941 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997046272:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.708479:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+394:41279:x1731746396407552:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.708481:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002056e733/0x3234de053c525f4 lrc: 3/0,1 mode: --/PW res: [0x2b9c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.708482:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.708483:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fa031f64/0x3234de053c4ed5a lrc: 4/0,0 mode: PR/PR res: [0x2b9c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6756 expref: 394 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.708486:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fa031f64/0x3234de053c4ed5a lrc: 3/0,0 mode: PR/PR res: [0x2b9c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6756 expref: 394 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.708489:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946526784 00010000:00010000:1.0:1651529344.708492:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa031f64/0x3234de053c4ed5a lrc: 0/0,0 mode: --/PR res: [0x2b9c2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6756 expref: 394 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.708498:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946526848 00000100:00100000:0.0:1651529344.708504:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212183 00010000:00010000:1.0:1651529344.708505:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.708505:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1678:39030:x1731745946526784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.708506:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.708507:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c525e6 lrc: 3/0,1 mode: PW/PW res: [0x2b9c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.708510:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c525e6 lrc: 4/0,1 mode: PW/PW res: [0x2b9c2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.708511:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178631 count 1 00010000:00010000:0.0:1651529344.708515:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba00fdd7/0x3234de053c52609 lrc: 3/0,1 mode: --/PW res: [0x2b9c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.708516:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.708519:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e1b6e603/0x3234de053c4dd85 lrc: 2/0,0 mode: PR/PR res: [0x2b9c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d275a expref: 393 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.708522:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.708523:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.708523:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba00fdd7/0x3234de053c52609 lrc: 4/0,1 mode: --/PW res: [0x2b9c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.708528:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+393:41279:x1731746396407552:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 48us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.708530:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12959 00000100:00100000:1.0:1651529344.708535:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12960 00000100:00100000:1.0:1651529344.708537:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002017d1f9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:41279:x1731746396407680:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.708537:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e1b6e603/0x3234de053c4dd85 lrc: 3/0,0 mode: PR/PR res: [0x2b9c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d275a expref: 392 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.708540:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.708541:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001db46651/0x3234de053c4d4a2 lrc: 4/0,0 mode: PR/PR res: [0x2b9c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0468 expref: 392 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.708543:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e1b6e603/0x3234de053c4dd85 lrc: 4/0,0 mode: PR/PR res: [0x2b9c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d275a expref: 392 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.708544:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001db46651/0x3234de053c4d4a2 lrc: 3/0,0 mode: PR/PR res: [0x2b9c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0468 expref: 392 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.708547:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029abc941 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997046464:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.708549:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001db46651/0x3234de053c4d4a2 lrc: 0/0,0 mode: --/PR res: [0x2b9c3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0468 expref: 392 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.708553:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.708553:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.708554:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c525ed lrc: 3/0,1 mode: PW/PW res: [0x2b9c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.708556:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed830649 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.708557:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c525ed lrc: 4/0,1 mode: PW/PW res: [0x2b9c3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.708563:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.708563:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000055e03b4f pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997046144:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.708566:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006325442a/0x3234de053c525df lrc: 3/0,1 mode: --/PW res: [0x2b9c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.708568:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002017d1f9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+391:41279:x1731746396407680:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 31us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.708571:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12960 00000100:00100000:0.0:1651529344.708573:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212184 00000100:00100000:0.0:1651529344.708574:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1678:39030:x1731745946526848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.708578:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12961 00002000:00080000:0.0:1651529344.708579:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178632 count 1 00000100:00100000:1.0:1651529344.708580:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+390:41279:x1731746396407808:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.708582:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba3ddc6f/0x3234de053c52610 lrc: 3/0,1 mode: --/PW res: [0x2b9c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.708583:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.708584:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b6fc1d80/0x3234de053c4cbaa lrc: 4/0,0 mode: PR/PR res: [0x2b9c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce06c expref: 390 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.708586:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008c2e244f/0x3234de053c4ab97 lrc: 2/0,0 mode: PR/PR res: [0x2b9c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe14 expref: 390 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.708587:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b6fc1d80/0x3234de053c4cbaa lrc: 3/0,0 mode: PR/PR res: [0x2b9c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce06c expref: 390 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.708589:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.708590:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.708590:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba3ddc6f/0x3234de053c52610 lrc: 4/0,1 mode: --/PW res: [0x2b9c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.708592:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6fc1d80/0x3234de053c4cbaa lrc: 0/0,0 mode: --/PR res: [0x2b9c5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce06c expref: 390 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.708595:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.708595:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.708596:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c525fb lrc: 3/0,1 mode: PW/PW res: [0x2b9c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.708596:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008c2e244f/0x3234de053c4ab97 lrc: 3/0,0 mode: PR/PR res: [0x2b9c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe14 expref: 389 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.708599:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c525fb lrc: 4/0,1 mode: PW/PW res: [0x2b9c5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.708602:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008c2e244f/0x3234de053c4ab97 lrc: 4/0,0 mode: PR/PR res: [0x2b9c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe14 expref: 389 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.708605:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.708606:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000055e03b4f pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997046528:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.708609:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+389:41279:x1731746396407808:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 28us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.708611:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12961 00000100:00100000:0.0:1651529344.708612:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000afe7ff7b going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.708614:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12962 00000100:00100000:1.0:1651529344.708616:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+388:41278:x1731746396407616:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.708618:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.708619:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000376045ea/0x3234de053c4bf47 lrc: 4/0,0 mode: PR/PR res: [0x2b9c1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc713 expref: 388 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.708623:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000376045ea/0x3234de053c4bf47 lrc: 3/0,0 mode: PR/PR res: [0x2b9c1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc713 expref: 388 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.708627:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000376045ea/0x3234de053c4bf47 lrc: 0/0,0 mode: --/PR res: [0x2b9c1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc713 expref: 388 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.708631:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.708631:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.708632:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006325442a/0x3234de053c525df lrc: 3/0,1 mode: PW/PW res: [0x2b9c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.708634:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006325442a/0x3234de053c525df lrc: 4/0,1 mode: PW/PW res: [0x2b9c1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.708642:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.708652:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006325442a/0x3234de053c525df lrc: 3/0,1 mode: PW/PW res: [0x2b9c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.708656:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006325442a/0x3234de053c525df lrc: 3/0,1 mode: PW/PW res: [0x2b9c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.708660:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006325442a/0x3234de053c525df lrc: 3/0,1 mode: PW/PW res: [0x2b9c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.708662:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006325442a/0x3234de053c525df lrc: 2/0,0 mode: PW/PW res: [0x2b9c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.708674:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+387:41278:x1731746396407616:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 57us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.708677:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12962 00000100:00100000:1.0:1651529344.708682:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12963 00000100:00100000:1.0:1651529344.708684:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+386:41278:x1731746396407744:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.708686:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.708688:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c948a019/0x3234de053c4da9f lrc: 4/0,0 mode: PR/PR res: [0x2b9c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ac6 expref: 386 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.708692:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c948a019/0x3234de053c4da9f lrc: 3/0,0 mode: PR/PR res: [0x2b9c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ac6 expref: 386 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.708696:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c948a019/0x3234de053c4da9f lrc: 0/0,0 mode: --/PR res: [0x2b9c4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ac6 expref: 386 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.708703:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.708703:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.708704:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002056e733/0x3234de053c525f4 lrc: 3/0,1 mode: PW/PW res: [0x2b9c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.708707:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002056e733/0x3234de053c525f4 lrc: 4/0,1 mode: PW/PW res: [0x2b9c4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.708715:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.708721:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+385:41278:x1731746396407744:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.708724:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12963 00000100:00100000:1.0:1651529344.708728:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12964 00000100:00100000:0.0:1651529344.708728:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1679:39029:x1731745946526400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 939us (1052us total) trans 12885080232 rc 0/0 00000100:00100000:1.0:1651529344.708729:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+384:41279:x1731746396407872:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.708731:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212177 00010000:00010000:1.0:1651529344.708732:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.708733:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ef512242/0x3234de053c4e0fe lrc: 5/0,0 mode: PR/PR res: [0x2b9c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3488 expref: 384 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.708745:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ef512242/0x3234de053c4e0fe lrc: 4/0,0 mode: PR/PR res: [0x2b9c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3488 expref: 384 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.708748:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006325442a/0x3234de053c525df lrc: 2/0,0 mode: PW/PW res: [0x2b9c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.708750:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.708750:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.708751:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c52602 lrc: 3/0,1 mode: PW/PW res: [0x2b9c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.708751:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006325442a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.708752:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006325442a/0x3234de053c525df lrc: 2/0,0 mode: PW/PW res: [0x2b9c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.708756:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c52602 lrc: 4/0,1 mode: PW/PW res: [0x2b9c6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.708756:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006325442a/0x3234de053c525df lrc: 3/0,0 mode: PW/PW res: [0x2b9c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.708761:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.708761:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006325442a/0x3234de053c525df lrc: 1/0,0 mode: --/PW res: [0x2b9c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.708763:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006325442a/0x3234de053c525df lrc: 0/0,0 mode: --/PW res: [0x2b9c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.708765:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+384:41279:x1731746396407872:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.708768:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12964 00010000:00010000:0.0:1651529344.708769:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002056e733/0x3234de053c525f4 lrc: 3/0,1 mode: PW/PW res: [0x2b9c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.708772:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002056e733/0x3234de053c525f4 lrc: 3/0,1 mode: PW/PW res: [0x2b9c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.708775:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002056e733/0x3234de053c525f4 lrc: 3/0,1 mode: PW/PW res: [0x2b9c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.708778:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002056e733/0x3234de053c525f4 lrc: 2/0,0 mode: PW/PW res: [0x2b9c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.708779:0:80277:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef512242/0x3234de053c4e0fe lrc: 0/0,0 mode: --/PR res: [0x2b9c6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3488 expref: 383 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.708783:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004972eb27 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997046400:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.708786:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c52602 lrc: 3/0,1 mode: PW/PW res: [0x2b9c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.708790:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c52602 lrc: 3/0,1 mode: PW/PW res: [0x2b9c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.708793:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c52602 lrc: 3/0,1 mode: PW/PW res: [0x2b9c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.708796:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c52602 lrc: 3/0,1 mode: PW/PW res: [0x2b9c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.708799:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c52602 lrc: 2/0,0 mode: PW/PW res: [0x2b9c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.708814:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1679:39030:x1731745946526592:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 956us (1064us total) trans 12885080233 rc 0/0 00000100:00100000:0.0:1651529344.708817:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212180 00010000:00010000:0.0:1651529344.708823:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002056e733/0x3234de053c525f4 lrc: 2/0,0 mode: PW/PW res: [0x2b9c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.708828:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002056e733 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.708829:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002056e733/0x3234de053c525f4 lrc: 2/0,0 mode: PW/PW res: [0x2b9c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.708832:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002056e733/0x3234de053c525f4 lrc: 3/0,0 mode: PW/PW res: [0x2b9c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.708836:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002056e733/0x3234de053c525f4 lrc: 1/0,0 mode: --/PW res: [0x2b9c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.708839:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002056e733/0x3234de053c525f4 lrc: 0/0,0 mode: --/PW res: [0x2b9c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.708843:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c52602 lrc: 2/0,0 mode: PW/PW res: [0x2b9c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.708845:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1679:39030:x1731745946526720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 901us (921us total) trans 12885080234 rc 0/0 00010000:00010000:0.0:1651529344.708846:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ebdbebae already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.708847:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c52602 lrc: 2/0,0 mode: PW/PW res: [0x2b9c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.708848:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212182 00010000:00010000:0.0:1651529344.708849:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c52602 lrc: 3/0,0 mode: PW/PW res: [0x2b9c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.708853:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c52602 lrc: 1/0,0 mode: --/PW res: [0x2b9c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.708855:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c52602 lrc: 0/0,0 mode: --/PW res: [0x2b9c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.708858:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c525fb lrc: 3/0,1 mode: PW/PW res: [0x2b9c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.708861:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c525fb lrc: 3/0,1 mode: PW/PW res: [0x2b9c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.708864:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c525fb lrc: 3/0,1 mode: PW/PW res: [0x2b9c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.708867:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c525fb lrc: 2/0,0 mode: PW/PW res: [0x2b9c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.708904:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1679:39029:x1731745946526656:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1009us (1139us total) trans 12885080235 rc 0/0 00000100:00100000:1.0:1651529344.708928:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212181 00010000:00010000:1.0:1651529344.708941:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c525e6 lrc: 3/0,1 mode: PW/PW res: [0x2b9c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.708944:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c525e6 lrc: 3/0,1 mode: PW/PW res: [0x2b9c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.708947:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c525e6 lrc: 3/0,1 mode: PW/PW res: [0x2b9c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.708952:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c525e6 lrc: 2/0,0 mode: PW/PW res: [0x2b9c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.708996:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.709009:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1679:39030:x1731745946526464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1214us (1316us total) trans 12885080236 rc 0/0 00000100:00100000:1.0:1651529344.709012:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212178 00000100:00100000:1.0:1651529344.709020:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396408000 00000100:00100000:0.0:1651529344.709021:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.709029:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008c2e244f/0x3234de053c4ab97 lrc: 5/0,0 mode: PR/PR res: [0x2b9c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe14 expref: 383 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.709036:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396407936 00010000:00010000:1.0:1651529344.709039:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e1b6e603/0x3234de053c4dd85 lrc: 5/0,0 mode: PR/PR res: [0x2b9c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d275a expref: 384 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.709045:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c525fb lrc: 2/0,0 mode: PW/PW res: [0x2b9c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.709049:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000029958df2 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.709050:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12965 00010000:00010000:0.0:1651529344.709050:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c525fb lrc: 2/0,0 mode: PW/PW res: [0x2b9c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.709052:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+384:41278:x1731746396408000:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.709054:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c525fb lrc: 3/0,0 mode: PW/PW res: [0x2b9c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.709055:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.709056:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008c2e244f/0x3234de053c4ab97 lrc: 5/0,0 mode: PR/PR res: [0x2b9c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe14 expref: 384 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.709059:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c525fb lrc: 1/0,0 mode: --/PW res: [0x2b9c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.709060:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008c2e244f/0x3234de053c4ab97 lrc: 4/0,0 mode: PR/PR res: [0x2b9c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe14 expref: 384 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.709061:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c525fb lrc: 0/0,0 mode: --/PW res: [0x2b9c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.709066:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.709066:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.709066:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c525e6 lrc: 2/0,0 mode: PW/PW res: [0x2b9c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.709067:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba3ddc6f/0x3234de053c52610 lrc: 3/0,1 mode: PW/PW res: [0x2b9c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.709068:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cde66bc6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.709069:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c525e6 lrc: 2/0,0 mode: PW/PW res: [0x2b9c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.709071:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba3ddc6f/0x3234de053c52610 lrc: 4/0,1 mode: PW/PW res: [0x2b9c8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.709072:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c525e6 lrc: 3/0,0 mode: PW/PW res: [0x2b9c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.709075:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.709075:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c525e6 lrc: 1/0,0 mode: --/PW res: [0x2b9c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.709078:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c525e6 lrc: 0/0,0 mode: --/PW res: [0x2b9c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.709087:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+384:41278:x1731746396408000:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 34us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.709089:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12965 00000100:00100000:1.0:1651529344.709094:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12966 00000100:00100000:0.0:1651529344.709094:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029abc941 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997046464:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.709095:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+383:41279:x1731746396407936:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.709098:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.709098:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ba00fdd7/0x3234de053c52609 lrc: 3/0,1 mode: --/PW res: [0x2b9c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.709099:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e1b6e603/0x3234de053c4dd85 lrc: 4/0,0 mode: PR/PR res: [0x2b9c7:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d275a expref: 383 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.709103:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e1b6e603/0x3234de053c4dd85 lrc: 3/0,0 mode: PR/PR res: [0x2b9c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d275a expref: 383 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.709105:0:156655:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c2e244f/0x3234de053c4ab97 lrc: 0/0,0 mode: --/PR res: [0x2b9c8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbe14 expref: 383 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.709108:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1b6e603/0x3234de053c4dd85 lrc: 0/0,0 mode: --/PR res: [0x2b9c7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d275a expref: 383 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.709108:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000055e03b4f pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997046528:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.709111:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.709111:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ba3ddc6f/0x3234de053c52610 lrc: 3/0,1 mode: PW/PW res: [0x2b9c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.709112:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.709113:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba00fdd7/0x3234de053c52609 lrc: 3/0,1 mode: PW/PW res: [0x2b9c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.709114:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ba3ddc6f/0x3234de053c52610 lrc: 3/0,1 mode: PW/PW res: [0x2b9c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.709116:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba00fdd7/0x3234de053c52609 lrc: 4/0,1 mode: PW/PW res: [0x2b9c7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.709116:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba3ddc6f/0x3234de053c52610 lrc: 3/0,1 mode: PW/PW res: [0x2b9c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.709119:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba3ddc6f/0x3234de053c52610 lrc: 3/0,1 mode: PW/PW res: [0x2b9c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.709124:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.709129:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+381:41279:x1731746396407936:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 33us (108us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.709130:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba3ddc6f/0x3234de053c52610 lrc: 2/0,0 mode: PW/PW res: [0x2b9c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.709131:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12966 00010000:00010000:1.0:1651529344.709138:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba3ddc6f/0x3234de053c52610 lrc: 2/0,0 mode: PW/PW res: [0x2b9c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.709141:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba3ddc6f already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.709142:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba3ddc6f/0x3234de053c52610 lrc: 2/0,0 mode: PW/PW res: [0x2b9c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.709145:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba3ddc6f/0x3234de053c52610 lrc: 3/0,0 mode: PW/PW res: [0x2b9c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.709149:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba3ddc6f/0x3234de053c52610 lrc: 1/0,0 mode: --/PW res: [0x2b9c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.709151:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba3ddc6f/0x3234de053c52610 lrc: 0/0,0 mode: --/PW res: [0x2b9c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.709158:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c525ed lrc: 3/0,1 mode: PW/PW res: [0x2b9c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.709161:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c525ed lrc: 3/0,1 mode: PW/PW res: [0x2b9c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.709166:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c525ed lrc: 3/0,1 mode: PW/PW res: [0x2b9c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.709169:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c525ed lrc: 2/0,0 mode: PW/PW res: [0x2b9c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.709201:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1680:39030:x1731745946526848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 626us (797us total) trans 12885080237 rc 0/0 00000100:00100000:1.0:1651529344.709208:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1680:39029:x1731745946526528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1356us (1494us total) trans 12885080238 rc 0/0 00000100:00100000:1.0:1651529344.709211:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212179 00000100:00100000:0.0:1651529344.709216:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212184 00010000:00010000:0.0:1651529344.709243:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c525ed lrc: 2/0,0 mode: PW/PW res: [0x2b9c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.709247:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dd6b1be4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.709248:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c525ed lrc: 2/0,0 mode: PW/PW res: [0x2b9c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.709251:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c525ed lrc: 3/0,0 mode: PW/PW res: [0x2b9c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.709256:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c525ed lrc: 1/0,0 mode: --/PW res: [0x2b9c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.709259:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c525ed lrc: 0/0,0 mode: --/PW res: [0x2b9c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.709260:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.709273:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ba00fdd7/0x3234de053c52609 lrc: 3/0,1 mode: PW/PW res: [0x2b9c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.709276:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba00fdd7/0x3234de053c52609 lrc: 3/0,1 mode: PW/PW res: [0x2b9c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.709277:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.709279:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba00fdd7/0x3234de053c52609 lrc: 3/0,1 mode: PW/PW res: [0x2b9c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.709282:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba00fdd7/0x3234de053c52609 lrc: 2/0,0 mode: PW/PW res: [0x2b9c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.709293:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.709321:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.709321:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1679:39030:x1731745946526784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 814us (1017us total) trans 12885080239 rc 0/0 00000100:00100000:0.0:1651529344.709324:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212183 00000100:00100000:0.0:1651529344.709329:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946526976 00000100:00100000:1.0:1651529344.709333:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.709344:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946526912 00000100:00100000:0.0:1651529344.709349:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946527104 00000100:00100000:0.0:1651529344.709353:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946527040 00000100:00100000:0.0:1651529344.709357:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946527168 00000100:00100000:0.0:1651529344.709362:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212185 00000100:00100000:0.0:1651529344.709364:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1683:39030:x1731745946526976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.709369:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178634 count 1 00010000:00010000:0.0:1651529344.709373:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c52617 lrc: 3/0,1 mode: --/PW res: [0x2b9ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.709378:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212186 00010000:00010000:0.0:1651529344.709378:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c4e087 lrc: 2/0,0 mode: PR/PR res: [0x2b9ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d32dd expref: 380 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.709380:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1683:39029:x1731745946526912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.709381:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.709382:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.709383:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c52617 lrc: 4/0,1 mode: --/PW res: [0x2b9ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.709386:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178633 count 1 00010000:00010000:1.0:1651529344.709390:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c5261e lrc: 3/0,1 mode: --/PW res: [0x2b9c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.709391:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c4e087 lrc: 3/0,0 mode: PR/PR res: [0x2b9ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d32dd expref: 380 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.709395:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006b5ed74c/0x3234de053c4edf4 lrc: 2/0,0 mode: PR/PR res: [0x2b9c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a20 expref: 380 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.709396:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c4e087 lrc: 4/0,0 mode: PR/PR res: [0x2b9ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d32dd expref: 380 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.709398:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.709399:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.709400:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c5261e lrc: 4/0,1 mode: --/PW res: [0x2b9c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.709400:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000055e03b4f pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997046592:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.709407:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006b5ed74c/0x3234de053c4edf4 lrc: 3/0,0 mode: PR/PR res: [0x2b9c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a20 expref: 380 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.709411:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006b5ed74c/0x3234de053c4edf4 lrc: 4/0,0 mode: PR/PR res: [0x2b9c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a20 expref: 380 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.709415:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003e3f0f77 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997046656:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.709429:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 0000000049203969 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.709434:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fe434b1c going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.709436:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212187 00000100:00100000:0.0:1651529344.709438:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1683:39030:x1731745946527104:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.709441:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212188 00000100:00100000:1.0:1651529344.709442:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1683:39029:x1731745946527040:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.709443:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178636 count 1 00002000:00080000:1.0:1651529344.709447:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178635 count 1 00010000:00010000:0.0:1651529344.709447:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52625 lrc: 3/0,1 mode: --/PW res: [0x2b9cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.709450:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c5262c lrc: 3/0,1 mode: --/PW res: [0x2b9cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.709451:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000567cc12e/0x3234de053c4d49b lrc: 2/0,0 mode: PR/PR res: [0x2b9cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d044c expref: 380 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.709454:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.709455:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001bb8acb2/0x3234de053c4ec2d lrc: 2/0,0 mode: PR/PR res: [0x2b9cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d624e expref: 380 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.709455:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.709456:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52625 lrc: 4/0,1 mode: --/PW res: [0x2b9cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.709458:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.709458:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.709459:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c5262c lrc: 4/0,1 mode: --/PW res: [0x2b9cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.709462:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000567cc12e/0x3234de053c4d49b lrc: 3/0,0 mode: PR/PR res: [0x2b9cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d044c expref: 380 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.709465:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001bb8acb2/0x3234de053c4ec2d lrc: 3/0,0 mode: PR/PR res: [0x2b9cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d624e expref: 380 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.709466:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000567cc12e/0x3234de053c4d49b lrc: 4/0,0 mode: PR/PR res: [0x2b9cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d044c expref: 380 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.709468:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001bb8acb2/0x3234de053c4ec2d lrc: 4/0,0 mode: PR/PR res: [0x2b9cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d624e expref: 380 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.709470:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029abc941 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997046720:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.709473:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f9050c71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997046784:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.709478:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 000000003003c8b0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.709480:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8a0b704 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.709483:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212189 00000100:00100000:0.0:1651529344.709485:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1683:39030:x1731745946527168:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.709486:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba00fdd7/0x3234de053c52609 lrc: 2/0,0 mode: PW/PW res: [0x2b9c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.709489:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178637 count 1 00010000:00010000:1.0:1651529344.709490:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba00fdd7 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.709491:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba00fdd7/0x3234de053c52609 lrc: 2/0,0 mode: PW/PW res: [0x2b9c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.709492:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52633 lrc: 3/0,1 mode: --/PW res: [0x2b9cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.709494:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba00fdd7/0x3234de053c52609 lrc: 3/0,0 mode: PW/PW res: [0x2b9c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.709496:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000025c25dc7/0x3234de053c4dc43 lrc: 2/0,0 mode: PR/PR res: [0x2b9cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d213a expref: 380 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.709498:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba00fdd7/0x3234de053c52609 lrc: 1/0,0 mode: --/PW res: [0x2b9c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.709499:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.709500:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.709500:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52633 lrc: 4/0,1 mode: --/PW res: [0x2b9cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.709501:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba00fdd7/0x3234de053c52609 lrc: 0/0,0 mode: --/PW res: [0x2b9c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.709506:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000025c25dc7/0x3234de053c4dc43 lrc: 3/0,0 mode: PR/PR res: [0x2b9cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d213a expref: 380 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.709509:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000025c25dc7/0x3234de053c4dc43 lrc: 4/0,0 mode: PR/PR res: [0x2b9cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d213a expref: 380 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.709513:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fc130417 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997046848:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.709535:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c2b2b59c going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.709560:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.709578:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.709586:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946527296 00000100:00100000:1.0:1651529344.709591:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.709601:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946527232 00000100:00100000:1.0:1651529344.709606:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946527360 00000100:00100000:1.0:1651529344.709613:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212190 00000100:00100000:1.0:1651529344.709615:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1686:39029:x1731745946527296:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.709623:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212191 00002000:00080000:1.0:1651529344.709625:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178639 count 1 00000100:00100000:0.0:1651529344.709625:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1686:39030:x1731745946527360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.709630:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5263a lrc: 3/0,1 mode: --/PW res: [0x2b9cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.709630:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178640 count 1 00010000:00010000:0.0:1651529344.709634:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52641 lrc: 3/0,1 mode: --/PW res: [0x2b9d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.709635:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007d0388e3/0x3234de053c4e503 lrc: 2/0,0 mode: PR/PR res: [0x2b9cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d454b expref: 380 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.709638:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.709638:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.709639:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5263a lrc: 4/0,1 mode: --/PW res: [0x2b9cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.709639:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d0394e1d/0x3234de053c4ccb4 lrc: 2/0,0 mode: PR/PR res: [0x2b9d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce49b expref: 380 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.709642:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.709642:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.709643:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52641 lrc: 4/0,1 mode: --/PW res: [0x2b9d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.709645:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007d0388e3/0x3234de053c4e503 lrc: 3/0,0 mode: PR/PR res: [0x2b9cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d454b expref: 380 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.709649:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007d0388e3/0x3234de053c4e503 lrc: 4/0,0 mode: PR/PR res: [0x2b9cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d454b expref: 380 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.709650:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d0394e1d/0x3234de053c4ccb4 lrc: 3/0,0 mode: PR/PR res: [0x2b9d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce49b expref: 380 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.709653:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004089c807 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997046912:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.709653:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d0394e1d/0x3234de053c4ccb4 lrc: 4/0,0 mode: PR/PR res: [0x2b9d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce49b expref: 380 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.709657:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f39ca9ea pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997046976:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.709667:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b7af823 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.709673:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 0000000009370c1d going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.709674:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212192 00000100:00100000:1.0:1651529344.709675:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1686:39030:x1731745946527232:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.709680:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178638 count 1 00010000:00010000:1.0:1651529344.709683:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52648 lrc: 3/0,1 mode: --/PW res: [0x2b9ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.709687:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008ab35b9f/0x3234de053c4e009 lrc: 2/0,0 mode: PR/PR res: [0x2b9ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d312b expref: 380 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.709693:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.709693:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.709694:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52648 lrc: 4/0,1 mode: --/PW res: [0x2b9ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.709708:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008ab35b9f/0x3234de053c4e009 lrc: 3/0,0 mode: PR/PR res: [0x2b9ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d312b expref: 380 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.709711:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008ab35b9f/0x3234de053c4e009 lrc: 4/0,0 mode: PR/PR res: [0x2b9ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d312b expref: 380 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.709715:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a9b051f pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997047040:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.709726:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000babe2d90 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.710109:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003e3f0f77 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997046656:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.710110:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.710114:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c5261e lrc: 3/0,1 mode: --/PW res: [0x2b9c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.710117:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.710125:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.710133:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f9050c71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997046784:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.710133:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.710140:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c5262c lrc: 3/0,1 mode: --/PW res: [0x2b9cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.710141:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.710152:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396408064 00010000:00010000:1.0:1651529344.710162:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c4e087 lrc: 5/0,0 mode: PR/PR res: [0x2b9ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d32dd expref: 381 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.710162:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.710166:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.710170:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396408192 00000100:00100000:0.0:1651529344.710172:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.710173:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006b5ed74c/0x3234de053c4edf4 lrc: 4/0,0 mode: PR/PR res: [0x2b9c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a20 expref: 382 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.710177:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396408128 00010000:00010000:1.0:1651529344.710179:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000567cc12e/0x3234de053c4d49b lrc: 4/0,0 mode: PR/PR res: [0x2b9cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d044c expref: 383 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.710180:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029abc941 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997046720:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.710183:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396408320 00010000:00010000:0.0:1651529344.710184:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52625 lrc: 3/0,1 mode: --/PW res: [0x2b9cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.710185:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000025c25dc7/0x3234de053c4dc43 lrc: 5/0,0 mode: PR/PR res: [0x2b9cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d213a expref: 384 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.710189:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396408256 00010000:00010000:1.0:1651529344.710191:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001bb8acb2/0x3234de053c4ec2d lrc: 4/0,0 mode: PR/PR res: [0x2b9cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d624e expref: 385 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.710191:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000055e03b4f pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997046592:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.710194:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396408384 00010000:00010000:0.0:1651529344.710194:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c52617 lrc: 3/0,1 mode: --/PW res: [0x2b9ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.710196:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007d0388e3/0x3234de053c4e503 lrc: 5/0,0 mode: PR/PR res: [0x2b9cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d454b expref: 386 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.710199:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fc130417 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997046848:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.710200:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396408512 00010000:00010000:1.0:1651529344.710202:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008ab35b9f/0x3234de053c4e009 lrc: 5/0,0 mode: PR/PR res: [0x2b9ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d312b expref: 387 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.710202:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52633 lrc: 3/0,1 mode: --/PW res: [0x2b9cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.710206:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396408448 00000100:00100000:0.0:1651529344.710207:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f39ca9ea pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997046976:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.710208:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d0394e1d/0x3234de053c4ccb4 lrc: 4/0,0 mode: PR/PR res: [0x2b9d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce49b expref: 388 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.710210:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52641 lrc: 3/0,1 mode: --/PW res: [0x2b9d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.710215:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12967 00000100:00100000:1.0:1651529344.710216:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cd81e40c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+388:41279:x1731746396408064:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.710217:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12968 00010000:00010000:1.0:1651529344.710219:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.710219:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+388:41279:x1731746396408192:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.710220:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c4e087 lrc: 4/0,0 mode: PR/PR res: [0x2b9ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d32dd expref: 388 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.710243:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.710245:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c4e087 lrc: 3/0,0 mode: PR/PR res: [0x2b9ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d32dd expref: 388 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.710245:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006b5ed74c/0x3234de053c4edf4 lrc: 4/0,0 mode: PR/PR res: [0x2b9c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a20 expref: 388 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.710251:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c4e087 lrc: 0/0,0 mode: --/PR res: [0x2b9ca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d32dd expref: 388 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.710252:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006b5ed74c/0x3234de053c4edf4 lrc: 3/0,0 mode: PR/PR res: [0x2b9c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a20 expref: 388 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.710255:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.710255:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.710256:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c52617 lrc: 3/0,1 mode: PW/PW res: [0x2b9ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.710258:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b5ed74c/0x3234de053c4edf4 lrc: 0/0,0 mode: --/PR res: [0x2b9c9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a20 expref: 387 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.710259:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c52617 lrc: 4/0,1 mode: PW/PW res: [0x2b9ca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.710261:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.710262:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.710263:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c5261e lrc: 3/0,1 mode: PW/PW res: [0x2b9c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.710268:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.710271:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c5261e lrc: 4/0,1 mode: PW/PW res: [0x2b9c9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.710278:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cd81e40c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+386:41279:x1731746396408064:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 61us (169us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.710281:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.710286:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12967 00000100:00100000:0.0:1651529344.710289:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+385:41279:x1731746396408192:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 69us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.710292:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12968 00000100:00100000:1.0:1651529344.710295:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12969 00000100:00100000:1.0:1651529344.710297:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+384:41278:x1731746396408128:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.710298:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12970 00010000:00010000:1.0:1651529344.710300:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.710300:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+384:41279:x1731746396408320:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.710301:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000567cc12e/0x3234de053c4d49b lrc: 4/0,0 mode: PR/PR res: [0x2b9cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d044c expref: 384 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.710303:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.710304:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000025c25dc7/0x3234de053c4dc43 lrc: 4/0,0 mode: PR/PR res: [0x2b9cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d213a expref: 384 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.710305:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000567cc12e/0x3234de053c4d49b lrc: 3/0,0 mode: PR/PR res: [0x2b9cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d044c expref: 384 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.710308:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000025c25dc7/0x3234de053c4dc43 lrc: 3/0,0 mode: PR/PR res: [0x2b9cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d213a expref: 384 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.710310:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000567cc12e/0x3234de053c4d49b lrc: 0/0,0 mode: --/PR res: [0x2b9cc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d044c expref: 384 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.710313:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.710313:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025c25dc7/0x3234de053c4dc43 lrc: 0/0,0 mode: --/PR res: [0x2b9cd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d213a expref: 383 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.710314:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.710315:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52625 lrc: 3/0,1 mode: PW/PW res: [0x2b9cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.710317:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.710317:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.710318:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52625 lrc: 4/0,1 mode: PW/PW res: [0x2b9cc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.710318:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52633 lrc: 3/0,1 mode: PW/PW res: [0x2b9cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.710321:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52633 lrc: 4/0,1 mode: PW/PW res: [0x2b9cd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.710327:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.710333:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+382:41278:x1731746396408128:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (208us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.710334:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.710336:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12969 00000100:00100000:1.0:1651529344.710340:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12971 00000100:00100000:0.0:1651529344.710340:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+381:41279:x1731746396408320:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 39us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.710342:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+381:41278:x1731746396408256:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.710342:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12970 00010000:00010000:1.0:1651529344.710344:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.710346:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001bb8acb2/0x3234de053c4ec2d lrc: 4/0,0 mode: PR/PR res: [0x2b9cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d624e expref: 380 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.710347:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12972 00000100:00100000:0.0:1651529344.710349:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+380:41278:x1731746396408384:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.710351:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.710352:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001bb8acb2/0x3234de053c4ec2d lrc: 3/0,0 mode: PR/PR res: [0x2b9cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d624e expref: 380 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.710353:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007d0388e3/0x3234de053c4e503 lrc: 5/0,0 mode: PR/PR res: [0x2b9cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d454b expref: 380 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.710356:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bb8acb2/0x3234de053c4ec2d lrc: 0/0,0 mode: --/PR res: [0x2b9cb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d624e expref: 380 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.710357:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007d0388e3/0x3234de053c4e503 lrc: 4/0,0 mode: PR/PR res: [0x2b9cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d454b expref: 380 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.710359:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.710360:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.710361:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c5262c lrc: 3/0,1 mode: PW/PW res: [0x2b9cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.710361:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.710362:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.710363:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5263a lrc: 3/0,1 mode: PW/PW res: [0x2b9cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.710364:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c5262c lrc: 4/0,1 mode: PW/PW res: [0x2b9cb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.710366:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5263a lrc: 4/0,1 mode: PW/PW res: [0x2b9cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.710370:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.710370:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.710374:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+379:41278:x1731746396408384:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 24us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.710375:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+379:41278:x1731746396408256:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.710376:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12972 00000100:00100000:1.0:1651529344.710377:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12971 00000100:00100000:0.0:1651529344.710380:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12973 00000100:00100000:1.0:1651529344.710381:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12974 00000100:00100000:0.0:1651529344.710381:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+377:41278:x1731746396408512:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.710383:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a37852a8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+377:41279:x1731746396408448:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.710383:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.710385:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.710385:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008ab35b9f/0x3234de053c4e009 lrc: 5/0,0 mode: PR/PR res: [0x2b9ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d312b expref: 377 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.710387:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d0394e1d/0x3234de053c4ccb4 lrc: 4/0,0 mode: PR/PR res: [0x2b9d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce49b expref: 377 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.710388:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008ab35b9f/0x3234de053c4e009 lrc: 4/0,0 mode: PR/PR res: [0x2b9ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d312b expref: 377 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.710391:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d0394e1d/0x3234de053c4ccb4 lrc: 3/0,0 mode: PR/PR res: [0x2b9d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce49b expref: 377 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.710392:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.710393:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.710393:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52648 lrc: 3/0,1 mode: PW/PW res: [0x2b9ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.710395:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0394e1d/0x3234de053c4ccb4 lrc: 0/0,0 mode: --/PR res: [0x2b9d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce49b expref: 377 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.710396:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52648 lrc: 4/0,1 mode: PW/PW res: [0x2b9ce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.710398:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.710399:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.710399:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52641 lrc: 3/0,1 mode: PW/PW res: [0x2b9d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.710400:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.710402:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52641 lrc: 4/0,1 mode: PW/PW res: [0x2b9d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.710404:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+376:41278:x1731746396408512:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 23us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.710407:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12973 00010000:00010000:1.0:1651529344.710411:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.710416:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a37852a8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+375:41279:x1731746396408448:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 32us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.710419:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12974 00010000:00010000:0.0:1651529344.710419:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52625 lrc: 3/0,1 mode: PW/PW res: [0x2b9cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.710423:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52625 lrc: 3/0,1 mode: PW/PW res: [0x2b9cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.710426:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52625 lrc: 3/0,1 mode: PW/PW res: [0x2b9cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.710429:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52625 lrc: 2/0,0 mode: PW/PW res: [0x2b9cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.710432:0:106695:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ab35b9f/0x3234de053c4e009 lrc: 0/0,0 mode: --/PR res: [0x2b9ce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d312b expref: 374 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.710436:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a9b051f pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997047040:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.710439:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52648 lrc: 3/0,1 mode: PW/PW res: [0x2b9ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.710442:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52648 lrc: 3/0,1 mode: PW/PW res: [0x2b9ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.710445:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52648 lrc: 3/0,1 mode: PW/PW res: [0x2b9ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.710448:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52648 lrc: 3/0,1 mode: PW/PW res: [0x2b9ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.710451:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52648 lrc: 2/0,0 mode: PW/PW res: [0x2b9ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.710478:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1688:39030:x1731745946527104:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1038us (1189us total) trans 12885080240 rc 0/0 00000100:00100000:0.0:1651529344.710481:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212187 00010000:00010000:0.0:1651529344.710487:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52625 lrc: 2/0,0 mode: PW/PW res: [0x2b9cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.710490:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008517b233 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.710491:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52625 lrc: 2/0,0 mode: PW/PW res: [0x2b9cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.710494:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52625 lrc: 3/0,0 mode: PW/PW res: [0x2b9cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.710495:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1687:39030:x1731745946527232:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 818us (917us total) trans 12885080241 rc 0/0 00000100:00100000:1.0:1651529344.710498:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212192 00010000:00010000:0.0:1651529344.710501:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52625 lrc: 1/0,0 mode: --/PW res: [0x2b9cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.710504:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52625 lrc: 0/0,0 mode: --/PW res: [0x2b9cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.710508:0:80279:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d0388e3/0x3234de053c4e503 lrc: 0/0,0 mode: --/PR res: [0x2b9cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d454b expref: 373 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.710508:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52648 lrc: 2/0,0 mode: PW/PW res: [0x2b9ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.710511:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e48e0bfd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.710511:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52648 lrc: 2/0,0 mode: PW/PW res: [0x2b9ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.710512:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004089c807 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997046912:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.710514:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52648 lrc: 3/0,0 mode: PW/PW res: [0x2b9ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.710516:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5263a lrc: 3/0,1 mode: PW/PW res: [0x2b9cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.710517:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52648 lrc: 1/0,0 mode: --/PW res: [0x2b9ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.710519:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5263a lrc: 3/0,1 mode: PW/PW res: [0x2b9cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.710520:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52648 lrc: 0/0,0 mode: --/PW res: [0x2b9ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.710521:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5263a lrc: 3/0,1 mode: PW/PW res: [0x2b9cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.710524:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5263a lrc: 3/0,1 mode: PW/PW res: [0x2b9cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.710526:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c52617 lrc: 3/0,1 mode: PW/PW res: [0x2b9ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.710529:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5263a lrc: 2/0,0 mode: PW/PW res: [0x2b9cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.710529:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c52617 lrc: 3/0,1 mode: PW/PW res: [0x2b9ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.710534:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c52617 lrc: 3/0,1 mode: PW/PW res: [0x2b9ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.710537:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c52617 lrc: 2/0,0 mode: PW/PW res: [0x2b9ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.710562:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1688:39029:x1731745946527296:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 946us (1003us total) trans 12885080242 rc 0/0 00000100:00100000:1.0:1651529344.710565:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212190 00010000:00010000:1.0:1651529344.710572:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5263a lrc: 2/0,0 mode: PW/PW res: [0x2b9cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.710572:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1687:39030:x1731745946526976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1207us (1312us total) trans 12885080243 rc 0/0 00010000:00010000:1.0:1651529344.710575:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004b2a6b06 already unused, calling callback (0000000049fddea7) 00000100:00100000:0.0:1651529344.710575:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212185 00010000:00010000:1.0:1651529344.710576:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5263a lrc: 2/0,0 mode: PW/PW res: [0x2b9cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.710579:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5263a lrc: 3/0,0 mode: PW/PW res: [0x2b9cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.710582:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c52617 lrc: 2/0,0 mode: PW/PW res: [0x2b9ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.710584:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5263a lrc: 1/0,0 mode: --/PW res: [0x2b9cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.710585:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ade4813a already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.710586:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5263a lrc: 0/0,0 mode: --/PW res: [0x2b9cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.710586:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c52617 lrc: 2/0,0 mode: PW/PW res: [0x2b9ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.710589:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c52617 lrc: 3/0,0 mode: PW/PW res: [0x2b9ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.710592:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c5261e lrc: 3/0,1 mode: PW/PW res: [0x2b9c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.710593:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c52617 lrc: 1/0,0 mode: --/PW res: [0x2b9ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.710595:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c5261e lrc: 3/0,1 mode: PW/PW res: [0x2b9c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.710596:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ade4813a/0x3234de053c52617 lrc: 0/0,0 mode: --/PW res: [0x2b9ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.710598:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c5261e lrc: 3/0,1 mode: PW/PW res: [0x2b9c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.710601:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c5261e lrc: 2/0,0 mode: PW/PW res: [0x2b9c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.710601:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52633 lrc: 3/0,1 mode: PW/PW res: [0x2b9cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.710605:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52633 lrc: 3/0,1 mode: PW/PW res: [0x2b9cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.710615:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52633 lrc: 3/0,1 mode: PW/PW res: [0x2b9cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.710618:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52633 lrc: 2/0,0 mode: PW/PW res: [0x2b9cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.710646:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1688:39029:x1731745946526912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1265us (1368us total) trans 12885080244 rc 0/0 00000100:00100000:1.0:1651529344.710649:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212186 00010000:00010000:1.0:1651529344.710656:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c5261e lrc: 2/0,0 mode: PW/PW res: [0x2b9c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.710657:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1687:39030:x1731745946527168:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1171us (1324us total) trans 12885080245 rc 0/0 00010000:00010000:1.0:1651529344.710659:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cd5f3a7c already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.710660:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c5261e lrc: 2/0,0 mode: PW/PW res: [0x2b9c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.710660:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212189 00010000:00010000:1.0:1651529344.710663:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c5261e lrc: 3/0,0 mode: PW/PW res: [0x2b9c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.710667:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c5261e lrc: 1/0,0 mode: --/PW res: [0x2b9c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.710668:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52633 lrc: 2/0,0 mode: PW/PW res: [0x2b9cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.710670:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c5261e lrc: 0/0,0 mode: --/PW res: [0x2b9c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.710671:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e7aaedb0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.710672:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52633 lrc: 2/0,0 mode: PW/PW res: [0x2b9cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.710675:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c5262c lrc: 3/0,1 mode: PW/PW res: [0x2b9cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.710675:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52633 lrc: 3/0,0 mode: PW/PW res: [0x2b9cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.710678:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c5262c lrc: 3/0,1 mode: PW/PW res: [0x2b9cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.710679:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52633 lrc: 1/0,0 mode: --/PW res: [0x2b9cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.710681:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c5262c lrc: 3/0,1 mode: PW/PW res: [0x2b9cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.710682:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52633 lrc: 0/0,0 mode: --/PW res: [0x2b9cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.710684:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c5262c lrc: 2/0,0 mode: PW/PW res: [0x2b9cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.710687:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52641 lrc: 3/0,1 mode: PW/PW res: [0x2b9d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.710697:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52641 lrc: 3/0,1 mode: PW/PW res: [0x2b9d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.710701:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52641 lrc: 3/0,1 mode: PW/PW res: [0x2b9d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.710703:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52641 lrc: 2/0,0 mode: PW/PW res: [0x2b9d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.710729:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1688:39029:x1731745946527040:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1286us (1409us total) trans 12885080246 rc 0/0 00000100:00100000:1.0:1651529344.710732:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212188 00010000:00010000:1.0:1651529344.710750:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c5262c lrc: 2/0,0 mode: PW/PW res: [0x2b9cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.710753:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000066921086 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.710754:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c5262c lrc: 2/0,0 mode: PW/PW res: [0x2b9cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.710754:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1687:39030:x1731745946527360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1128us (1162us total) trans 12885080247 rc 0/0 00010000:00010000:1.0:1651529344.710757:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c5262c lrc: 3/0,0 mode: PW/PW res: [0x2b9cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.710757:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212191 00010000:00010000:1.0:1651529344.710762:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c5262c lrc: 1/0,0 mode: --/PW res: [0x2b9cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.710764:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52641 lrc: 2/0,0 mode: PW/PW res: [0x2b9d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.710765:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c5262c lrc: 0/0,0 mode: --/PW res: [0x2b9cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.710768:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fafb79d3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.710769:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52641 lrc: 2/0,0 mode: PW/PW res: [0x2b9d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.710772:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52641 lrc: 3/0,0 mode: PW/PW res: [0x2b9d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.710776:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52641 lrc: 1/0,0 mode: --/PW res: [0x2b9d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.710779:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52641 lrc: 0/0,0 mode: --/PW res: [0x2b9d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.711086:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.711096:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.711114:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946527424 00000100:00100000:1.0:1651529344.711124:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946527488 00000100:00100000:0.0:1651529344.711132:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.711144:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946527552 00000100:00100000:0.0:1651529344.711146:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.711154:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946527616 00000100:00100000:0.0:1651529344.711156:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.711166:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946527680 00000100:00100000:0.0:1651529344.711171:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.711172:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212193 00000100:00100000:1.0:1651529344.711173:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1691:39029:x1731745946527424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.711180:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529344.711184:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178641 count 1 00010000:00010000:1.0:1651529344.711188:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c5264f lrc: 3/0,1 mode: --/PW res: [0x2b9d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.711188:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.711193:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000113ae371/0x3234de053c4eb8c lrc: 2/0,0 mode: PR/PR res: [0x2b9d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5fb5 expref: 372 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.711194:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946527744 00010000:00010000:1.0:1651529344.711196:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.711197:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.711198:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c5264f lrc: 4/0,1 mode: --/PW res: [0x2b9d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.711200:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946527808 00000100:00100000:0.0:1651529344.711202:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946527872 00010000:00010000:1.0:1651529344.711204:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000113ae371/0x3234de053c4eb8c lrc: 3/0,0 mode: PR/PR res: [0x2b9d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5fb5 expref: 372 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.711205:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212194 00000100:00100000:0.0:1651529344.711207:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1694:39030:x1731745946527488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.711208:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000113ae371/0x3234de053c4eb8c lrc: 4/0,0 mode: PR/PR res: [0x2b9d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5fb5 expref: 372 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.711212:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004089c807 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997047104:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.711212:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178642 count 1 00010000:00010000:0.0:1651529344.711216:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52656 lrc: 3/0,1 mode: --/PW res: [0x2b9d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.711237:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007b2ed404/0x3234de053c4e3c1 lrc: 2/0,0 mode: PR/PR res: [0x2b9d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4019 expref: 372 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.711241:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d8a0b704 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.711241:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.711242:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.711243:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52656 lrc: 4/0,1 mode: --/PW res: [0x2b9d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.711247:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212195 00000100:00100000:1.0:1651529344.711249:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1694:39029:x1731745946527552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.711253:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007b2ed404/0x3234de053c4e3c1 lrc: 3/0,0 mode: PR/PR res: [0x2b9d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4019 expref: 372 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.711254:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178643 count 1 00010000:00010000:0.0:1651529344.711257:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007b2ed404/0x3234de053c4e3c1 lrc: 4/0,0 mode: PR/PR res: [0x2b9d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4019 expref: 372 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.711258:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c5265d lrc: 3/0,1 mode: --/PW res: [0x2b9d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.711261:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000037ac96ac pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997047168:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.711262:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007f5ebae4/0x3234de053c4e8f3 lrc: 2/0,0 mode: PR/PR res: [0x2b9d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5471 expref: 372 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.711265:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.711266:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.711266:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c5265d lrc: 4/0,1 mode: --/PW res: [0x2b9d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.711271:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 0000000009370c1d going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.711272:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007f5ebae4/0x3234de053c4e8f3 lrc: 3/0,0 mode: PR/PR res: [0x2b9d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5471 expref: 372 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.711276:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007f5ebae4/0x3234de053c4e8f3 lrc: 4/0,0 mode: PR/PR res: [0x2b9d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5471 expref: 372 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.711277:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212196 00000100:00100000:0.0:1651529344.711279:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1694:39030:x1731745946527616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.711280:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a9b051f pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997047232:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.711284:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178644 count 1 00000100:00100000:1.0:1651529344.711287:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000499d0377 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.711287:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52664 lrc: 3/0,1 mode: --/PW res: [0x2b9d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.711291:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003c1547ed/0x3234de053c4eb07 lrc: 2/0,0 mode: PR/PR res: [0x2b9d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5dcb expref: 372 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.711293:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212197 00010000:00010000:0.0:1651529344.711294:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.711295:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1694:39029:x1731745946527680:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.711295:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.711296:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52664 lrc: 4/0,1 mode: --/PW res: [0x2b9d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.711299:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178645 count 1 00010000:00010000:1.0:1651529344.711302:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c5266b lrc: 3/0,1 mode: --/PW res: [0x2b9d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.711302:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003c1547ed/0x3234de053c4eb07 lrc: 3/0,0 mode: PR/PR res: [0x2b9d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5dcb expref: 372 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.711305:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003c1547ed/0x3234de053c4eb07 lrc: 4/0,0 mode: PR/PR res: [0x2b9d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5dcb expref: 372 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.711308:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006882750a/0x3234de053c4edc3 lrc: 2/0,0 mode: PR/PR res: [0x2b9d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6963 expref: 372 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.711309:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bca72234 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997047296:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.711311:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.711311:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.711312:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c5266b lrc: 4/0,1 mode: --/PW res: [0x2b9d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.711316:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c2b2b59c going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.711318:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006882750a/0x3234de053c4edc3 lrc: 3/0,0 mode: PR/PR res: [0x2b9d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6963 expref: 372 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.711321:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006882750a/0x3234de053c4edc3 lrc: 4/0,0 mode: PR/PR res: [0x2b9d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6963 expref: 372 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.711321:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212198 00000100:00100000:0.0:1651529344.711323:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1694:39030:x1731745946527744:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.711325:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000097928145 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997047360:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.711326:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178646 count 1 00010000:00010000:0.0:1651529344.711329:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52672 lrc: 3/0,1 mode: --/PW res: [0x2b9d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.711331:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000412e5d26 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.711333:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c4d589 lrc: 2/0,0 mode: PR/PR res: [0x2b9d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d07d3 expref: 372 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.711336:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.711337:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212199 00010000:00010000:0.0:1651529344.711337:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.711337:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52672 lrc: 4/0,1 mode: --/PW res: [0x2b9d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.711338:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1694:39029:x1731745946527808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.711342:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178647 count 1 00010000:00010000:0.0:1651529344.711343:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c4d589 lrc: 3/0,0 mode: PR/PR res: [0x2b9d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d07d3 expref: 372 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.711345:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c52679 lrc: 3/0,1 mode: --/PW res: [0x2b9d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.711347:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c4d589 lrc: 4/0,0 mode: PR/PR res: [0x2b9d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d07d3 expref: 372 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.711349:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000095b0616/0x3234de053c4a5ee lrc: 2/0,0 mode: PR/PR res: [0x2b9d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb5f expref: 372 pid: 151609 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.711350:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006e3eb319 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997047424:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.711352:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.711352:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.711353:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c52679 lrc: 4/0,1 mode: --/PW res: [0x2b9d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.711356:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 0000000049203969 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.711359:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000095b0616/0x3234de053c4a5ee lrc: 3/0,0 mode: PR/PR res: [0x2b9d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb5f expref: 372 pid: 151609 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.711361:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212200 00010000:00010000:1.0:1651529344.711363:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000095b0616/0x3234de053c4a5ee lrc: 4/0,0 mode: PR/PR res: [0x2b9d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb5f expref: 372 pid: 151609 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.711363:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1694:39030:x1731745946527872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.711367:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001d1586f2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997047488:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.711367:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178648 count 1 00010000:00010000:0.0:1651529344.711370:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52680 lrc: 3/0,1 mode: --/PW res: [0x2b9d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.711373:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e5f43e7 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.711374:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ae877a7b/0x3234de053c4b331 lrc: 2/0,0 mode: PR/PR res: [0x2b9d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc17f expref: 372 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.711377:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.711377:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.711378:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52680 lrc: 4/0,1 mode: --/PW res: [0x2b9d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.711384:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ae877a7b/0x3234de053c4b331 lrc: 3/0,0 mode: PR/PR res: [0x2b9d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc17f expref: 372 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.711387:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ae877a7b/0x3234de053c4b331 lrc: 4/0,0 mode: PR/PR res: [0x2b9d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc17f expref: 372 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.711391:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f39ca9ea pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997047552:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.711397:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000003003c8b0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.711793:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004089c807 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997047104:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.711798:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c5264f lrc: 3/0,1 mode: --/PW res: [0x2b9d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.711823:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a9b051f pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997047232:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.711824:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.711826:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c5265d lrc: 3/0,1 mode: --/PW res: [0x2b9d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.711833:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.711841:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.711849:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.711850:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396408576 00010000:00010000:1.0:1651529344.711860:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000113ae371/0x3234de053c4eb8c lrc: 4/0,0 mode: PR/PR res: [0x2b9d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5fb5 expref: 373 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.711872:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396408704 00010000:00010000:1.0:1651529344.711875:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007f5ebae4/0x3234de053c4e8f3 lrc: 4/0,0 mode: PR/PR res: [0x2b9d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5471 expref: 374 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.711879:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000037ac96ac pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997047168:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.711882:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396408640 00010000:00010000:0.0:1651529344.711883:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52656 lrc: 3/0,1 mode: --/PW res: [0x2b9d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.711884:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007b2ed404/0x3234de053c4e3c1 lrc: 4/0,0 mode: PR/PR res: [0x2b9d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4019 expref: 375 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.711888:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396408768 00010000:00010000:1.0:1651529344.711890:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003c1547ed/0x3234de053c4eb07 lrc: 5/0,0 mode: PR/PR res: [0x2b9d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5dcb expref: 376 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.711890:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bca72234 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997047296:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.711894:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12975 00000100:00100000:1.0:1651529344.711896:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+376:41279:x1731746396408576:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.711899:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.711900:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000113ae371/0x3234de053c4eb8c lrc: 4/0,0 mode: PR/PR res: [0x2b9d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5fb5 expref: 376 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.711903:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000113ae371/0x3234de053c4eb8c lrc: 3/0,0 mode: PR/PR res: [0x2b9d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5fb5 expref: 376 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.711909:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000113ae371/0x3234de053c4eb8c lrc: 0/0,0 mode: --/PR res: [0x2b9d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5fb5 expref: 376 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.711913:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.711913:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.711914:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c5264f lrc: 3/0,1 mode: PW/PW res: [0x2b9d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.711917:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c5264f lrc: 4/0,1 mode: PW/PW res: [0x2b9d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.711921:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52664 lrc: 3/0,1 mode: --/PW res: [0x2b9d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.711937:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.711938:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006e3eb319 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997047424:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.711944:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52672 lrc: 3/0,1 mode: --/PW res: [0x2b9d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.711949:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+375:41279:x1731746396408576:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 52us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.711952:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12975 00000100:00100000:1.0:1651529344.711957:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12976 00000100:00100000:1.0:1651529344.711958:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+374:41279:x1731746396408704:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.711961:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.711963:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007f5ebae4/0x3234de053c4e8f3 lrc: 4/0,0 mode: PR/PR res: [0x2b9d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5471 expref: 374 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.711965:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f39ca9ea pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997047552:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.711966:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007f5ebae4/0x3234de053c4e8f3 lrc: 3/0,0 mode: PR/PR res: [0x2b9d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5471 expref: 374 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.711970:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52680 lrc: 3/0,1 mode: --/PW res: [0x2b9d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.711971:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f5ebae4/0x3234de053c4e8f3 lrc: 0/0,0 mode: --/PR res: [0x2b9d3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5471 expref: 374 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.711974:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.711975:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.711976:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c5265d lrc: 3/0,1 mode: PW/PW res: [0x2b9d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.711979:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c5265d lrc: 4/0,1 mode: PW/PW res: [0x2b9d3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.711979:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12977 00000100:00100000:0.0:1651529344.711981:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+373:41278:x1731746396408640:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.711985:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.711985:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.711986:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007b2ed404/0x3234de053c4e3c1 lrc: 4/0,0 mode: PR/PR res: [0x2b9d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4019 expref: 373 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.711990:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+373:41279:x1731746396408704:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 31us (156us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.711990:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007b2ed404/0x3234de053c4e3c1 lrc: 3/0,0 mode: PR/PR res: [0x2b9d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4019 expref: 373 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.711992:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12976 00000100:00100000:1.0:1651529344.711996:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12978 00010000:00010000:0.0:1651529344.711996:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b2ed404/0x3234de053c4e3c1 lrc: 0/0,0 mode: --/PR res: [0x2b9d2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4019 expref: 372 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.711998:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+372:41278:x1731746396408768:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.712000:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.712001:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003c1547ed/0x3234de053c4eb07 lrc: 4/0,0 mode: PR/PR res: [0x2b9d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5dcb expref: 372 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.712003:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.712003:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.712004:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52656 lrc: 3/0,1 mode: PW/PW res: [0x2b9d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.712005:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003c1547ed/0x3234de053c4eb07 lrc: 3/0,0 mode: PR/PR res: [0x2b9d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5dcb expref: 371 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.712007:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52656 lrc: 4/0,1 mode: PW/PW res: [0x2b9d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.712009:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c1547ed/0x3234de053c4eb07 lrc: 0/0,0 mode: --/PR res: [0x2b9d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5dcb expref: 371 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.712012:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.712013:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.712013:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52664 lrc: 3/0,1 mode: PW/PW res: [0x2b9d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.712013:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.712016:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52664 lrc: 4/0,1 mode: PW/PW res: [0x2b9d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.712021:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+370:41278:x1731746396408640:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 40us (180us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.712024:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.712029:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+370:41278:x1731746396408768:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 31us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.712032:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12977 00000100:00100000:1.0:1651529344.712033:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12978 00010000:00010000:0.0:1651529344.712039:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52656 lrc: 3/0,1 mode: PW/PW res: [0x2b9d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.712043:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52656 lrc: 3/0,1 mode: PW/PW res: [0x2b9d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.712044:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000097928145 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997047360:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.712046:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52656 lrc: 3/0,1 mode: PW/PW res: [0x2b9d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.712047:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c5266b lrc: 3/0,1 mode: --/PW res: [0x2b9d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.712048:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52656 lrc: 2/0,0 mode: PW/PW res: [0x2b9d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.712054:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001d1586f2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997047488:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.712056:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c52679 lrc: 3/0,1 mode: --/PW res: [0x2b9d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.712061:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c5265d lrc: 3/0,1 mode: PW/PW res: [0x2b9d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.712063:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c5265d lrc: 3/0,1 mode: PW/PW res: [0x2b9d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.712067:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c5265d lrc: 3/0,1 mode: PW/PW res: [0x2b9d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.712069:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c5265d lrc: 2/0,0 mode: PW/PW res: [0x2b9d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.712087:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1696:39030:x1731745946527488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 880us (991us total) trans 12885080248 rc 0/0 00000100:00100000:0.0:1651529344.712091:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212194 00010000:00010000:0.0:1651529344.712098:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52656 lrc: 2/0,0 mode: PW/PW res: [0x2b9d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.712101:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000048ee8765 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.712102:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52656 lrc: 2/0,0 mode: PW/PW res: [0x2b9d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.712105:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52656 lrc: 3/0,0 mode: PW/PW res: [0x2b9d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.712108:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1695:39029:x1731745946527552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 858us (977us total) trans 12885080249 rc 0/0 00010000:00010000:0.0:1651529344.712109:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52656 lrc: 1/0,0 mode: --/PW res: [0x2b9d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.712111:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212195 00010000:00010000:0.0:1651529344.712112:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52656 lrc: 0/0,0 mode: --/PW res: [0x2b9d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.712116:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c5265d lrc: 2/0,0 mode: PW/PW res: [0x2b9d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.712119:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c5264f lrc: 3/0,1 mode: PW/PW res: [0x2b9d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.712119:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000090e99444 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.712120:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c5265d lrc: 2/0,0 mode: PW/PW res: [0x2b9d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.712122:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c5264f lrc: 3/0,1 mode: PW/PW res: [0x2b9d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.712122:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c5265d lrc: 3/0,0 mode: PW/PW res: [0x2b9d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.712126:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c5265d lrc: 1/0,0 mode: --/PW res: [0x2b9d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.712128:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c5264f lrc: 3/0,1 mode: PW/PW res: [0x2b9d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.712130:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c5264f lrc: 2/0,0 mode: PW/PW res: [0x2b9d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.712131:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c5265d lrc: 0/0,0 mode: --/PW res: [0x2b9d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.712134:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c5264f lrc: 3/0,0 mode: PW/PW res: [0x2b9d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.712144:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bdf2b6c4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.712145:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c5264f lrc: 2/0,0 mode: PW/PW res: [0x2b9d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.712148:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c5264f lrc: 3/0,0 mode: PW/PW res: [0x2b9d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.712151:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c5264f lrc: 1/0,0 mode: --/PW res: [0x2b9d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.712154:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c5264f lrc: 0/0,0 mode: --/PW res: [0x2b9d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.712160:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52664 lrc: 3/0,1 mode: PW/PW res: [0x2b9d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.712163:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52664 lrc: 3/0,1 mode: PW/PW res: [0x2b9d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.712166:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52664 lrc: 3/0,1 mode: PW/PW res: [0x2b9d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.712167:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1695:39029:x1731745946527424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 993us (1090us total) trans 12885080250 rc 0/0 00010000:00010000:0.0:1651529344.712169:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52664 lrc: 2/0,0 mode: PW/PW res: [0x2b9d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.712170:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212193 00010000:00010000:1.0:1651529344.712185:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52664 lrc: 2/0,0 mode: PW/PW res: [0x2b9d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.712189:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c5599f68 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.712190:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52664 lrc: 2/0,0 mode: PW/PW res: [0x2b9d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.712193:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52664 lrc: 3/0,0 mode: PW/PW res: [0x2b9d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.712197:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52664 lrc: 1/0,0 mode: --/PW res: [0x2b9d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.712200:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52664 lrc: 0/0,0 mode: --/PW res: [0x2b9d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.712208:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1695:39030:x1731745946527616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 928us (1062us total) trans 12885080251 rc 0/0 00000100:00100000:0.0:1651529344.712211:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212196 00000100:00100000:1.0:1651529344.712215:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.712252:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396408896 00010000:00010000:1.0:1651529344.712257:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c4d589 lrc: 4/0,0 mode: PR/PR res: [0x2b9d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d07d3 expref: 369 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.712265:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12979 00000100:00100000:1.0:1651529344.712266:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+369:41278:x1731746396408896:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.712269:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.712270:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c4d589 lrc: 4/0,0 mode: PR/PR res: [0x2b9d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d07d3 expref: 369 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.712280:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c4d589 lrc: 3/0,0 mode: PR/PR res: [0x2b9d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d07d3 expref: 369 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.712292:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c4d589 lrc: 0/0,0 mode: --/PR res: [0x2b9d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d07d3 expref: 369 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.712296:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.712297:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.712298:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52672 lrc: 3/0,1 mode: PW/PW res: [0x2b9d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.712301:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52672 lrc: 4/0,1 mode: PW/PW res: [0x2b9d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.712313:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.712323:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+368:41278:x1731746396408896:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 56us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.712326:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12979 00010000:00010000:0.0:1651529344.712329:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52672 lrc: 3/0,1 mode: PW/PW res: [0x2b9d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.712340:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.712347:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52672 lrc: 3/0,1 mode: PW/PW res: [0x2b9d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.712351:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52672 lrc: 3/0,1 mode: PW/PW res: [0x2b9d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.712354:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52672 lrc: 2/0,0 mode: PW/PW res: [0x2b9d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.712373:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.712381:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.712392:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396409024 00010000:00010000:1.0:1651529344.712396:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ae877a7b/0x3234de053c4b331 lrc: 4/0,0 mode: PR/PR res: [0x2b9d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc17f expref: 368 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.712403:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396408832 00010000:00010000:1.0:1651529344.712405:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006882750a/0x3234de053c4edc3 lrc: 4/0,0 mode: PR/PR res: [0x2b9d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6963 expref: 369 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.712409:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396408960 00010000:00010000:1.0:1651529344.712412:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000095b0616/0x3234de053c4a5ee lrc: 4/0,0 mode: PR/PR res: [0x2b9d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb5f expref: 370 pid: 151609 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.712420:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1695:39030:x1731745946527744:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1096us (1248us total) trans 12885080252 rc 0/0 00000100:00100000:1.0:1651529344.712421:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12980 00000100:00100000:1.0:1651529344.712423:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+370:41278:x1731746396409024:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.712423:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212198 00010000:00010000:1.0:1651529344.712426:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.712427:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ae877a7b/0x3234de053c4b331 lrc: 4/0,0 mode: PR/PR res: [0x2b9d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc17f expref: 370 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.712430:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52672 lrc: 2/0,0 mode: PW/PW res: [0x2b9d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.712431:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ae877a7b/0x3234de053c4b331 lrc: 3/0,0 mode: PR/PR res: [0x2b9d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc17f expref: 370 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.712434:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000091ee0f93 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.712435:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52672 lrc: 2/0,0 mode: PW/PW res: [0x2b9d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.712436:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae877a7b/0x3234de053c4b331 lrc: 0/0,0 mode: --/PR res: [0x2b9d8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc17f expref: 370 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.712438:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52672 lrc: 3/0,0 mode: PW/PW res: [0x2b9d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.712440:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.712440:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.712441:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52680 lrc: 3/0,1 mode: PW/PW res: [0x2b9d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.712444:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52680 lrc: 4/0,1 mode: PW/PW res: [0x2b9d8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.712454:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.712460:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+369:41278:x1731746396409024:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (120us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.712460:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52672 lrc: 1/0,0 mode: --/PW res: [0x2b9d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.712463:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12980 00000100:00100000:1.0:1651529344.712467:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12981 00000100:00100000:1.0:1651529344.712469:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001e35645b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+368:41278:x1731746396408832:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.712471:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.712472:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52672 lrc: 0/0,0 mode: --/PW res: [0x2b9d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.712473:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006882750a/0x3234de053c4edc3 lrc: 4/0,0 mode: PR/PR res: [0x2b9d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6963 expref: 368 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.712476:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006882750a/0x3234de053c4edc3 lrc: 3/0,0 mode: PR/PR res: [0x2b9d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6963 expref: 368 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.712479:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52680 lrc: 3/0,1 mode: PW/PW res: [0x2b9d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.712481:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006882750a/0x3234de053c4edc3 lrc: 0/0,0 mode: --/PR res: [0x2b9d5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6963 expref: 368 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.712482:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52680 lrc: 3/0,1 mode: PW/PW res: [0x2b9d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.712484:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.712485:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.712485:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52680 lrc: 3/0,1 mode: PW/PW res: [0x2b9d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.712486:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c5266b lrc: 3/0,1 mode: PW/PW res: [0x2b9d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.712488:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52680 lrc: 2/0,0 mode: PW/PW res: [0x2b9d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.712491:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c5266b lrc: 4/0,1 mode: PW/PW res: [0x2b9d5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.712497:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.712501:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001e35645b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+367:41278:x1731746396408832:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 32us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.712503:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12981 00000100:00100000:1.0:1651529344.712510:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12982 00000100:00100000:1.0:1651529344.712512:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+366:41278:x1731746396408960:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.712514:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.712516:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000095b0616/0x3234de053c4a5ee lrc: 4/0,0 mode: PR/PR res: [0x2b9d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb5f expref: 366 pid: 151609 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.712519:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000095b0616/0x3234de053c4a5ee lrc: 3/0,0 mode: PR/PR res: [0x2b9d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb5f expref: 366 pid: 151609 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.712523:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1695:39030:x1731745946527872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1159us (1335us total) trans 12885080253 rc 0/0 00010000:00010000:1.0:1651529344.712524:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000095b0616/0x3234de053c4a5ee lrc: 0/0,0 mode: --/PR res: [0x2b9d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb5f expref: 366 pid: 151609 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.712526:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212200 00010000:00010000:1.0:1651529344.712527:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.712527:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.712528:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c52679 lrc: 3/0,1 mode: PW/PW res: [0x2b9d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.712531:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c52679 lrc: 4/0,1 mode: PW/PW res: [0x2b9d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.712533:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52680 lrc: 2/0,0 mode: PW/PW res: [0x2b9d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.712538:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fc4c513 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.712539:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.712539:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52680 lrc: 2/0,0 mode: PW/PW res: [0x2b9d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.712542:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52680 lrc: 3/0,0 mode: PW/PW res: [0x2b9d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.712543:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+365:41278:x1731746396408960:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 31us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.712546:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12982 00010000:00010000:0.0:1651529344.712547:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52680 lrc: 1/0,0 mode: --/PW res: [0x2b9d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.712549:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52680 lrc: 0/0,0 mode: --/PW res: [0x2b9d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.712551:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c5266b lrc: 3/0,1 mode: PW/PW res: [0x2b9d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.712554:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c5266b lrc: 3/0,1 mode: PW/PW res: [0x2b9d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.712557:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c5266b lrc: 3/0,1 mode: PW/PW res: [0x2b9d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.712560:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c5266b lrc: 2/0,0 mode: PW/PW res: [0x2b9d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.712577:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.712591:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.712603:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.712608:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1695:39029:x1731745946527680:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1312us (1452us total) trans 12885080254 rc 0/0 00000100:00100000:1.0:1651529344.712611:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212197 00000100:00100000:0.0:1651529344.712613:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.712624:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946528000 00000100:00100000:1.0:1651529344.712630:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946527936 00000100:00100000:1.0:1651529344.712637:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946528128 00000100:00100000:1.0:1651529344.712650:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946528064 00000100:00100000:1.0:1651529344.712661:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212201 00000100:00100000:1.0:1651529344.712662:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1698:39030:x1731745946528000:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.712663:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212202 00000100:00100000:0.0:1651529344.712665:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005329f5eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1698:39029:x1731745946527936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.712667:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178650 count 1 00010000:00010000:1.0:1651529344.712672:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52687 lrc: 3/0,1 mode: --/PW res: [0x2b9da:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.712672:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178649 count 1 00010000:00010000:1.0:1651529344.712676:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000a5c0741/0x3234de053c4e7b8 lrc: 2/0,0 mode: PR/PR res: [0x2b9da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f62 expref: 364 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.712676:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5268e lrc: 3/0,1 mode: --/PW res: [0x2b9d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.712680:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.712680:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.712681:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52687 lrc: 4/0,1 mode: --/PW res: [0x2b9da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.712687:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000a5c0741/0x3234de053c4e7b8 lrc: 3/0,0 mode: PR/PR res: [0x2b9da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f62 expref: 364 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.712691:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000a5c0741/0x3234de053c4e7b8 lrc: 4/0,0 mode: PR/PR res: [0x2b9da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f62 expref: 364 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.712694:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000915c645b/0x3234de053c4ee3a lrc: 2/0,0 mode: PR/PR res: [0x2b9d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b0e expref: 364 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.712695:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001d1586f2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997047616:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.712700:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.712701:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.712702:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5268e lrc: 4/0,1 mode: --/PW res: [0x2b9d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.712710:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000412e5d26 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.712715:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c52679 lrc: 3/0,1 mode: PW/PW res: [0x2b9d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.712716:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000915c645b/0x3234de053c4ee3a lrc: 3/0,0 mode: PR/PR res: [0x2b9d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b0e expref: 364 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.712719:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c52679 lrc: 3/0,1 mode: PW/PW res: [0x2b9d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.712719:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000915c645b/0x3234de053c4ee3a lrc: 4/0,0 mode: PR/PR res: [0x2b9d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b0e expref: 364 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.712722:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c52679 lrc: 3/0,1 mode: PW/PW res: [0x2b9d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.712724:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c52679 lrc: 2/0,0 mode: PW/PW res: [0x2b9d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.712724:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000055e03b4f pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997047680:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.712747:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000afe7ff7b going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.712753:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212203 00000100:00100000:0.0:1651529344.712755:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1699:39030:x1731745946528128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.712760:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178652 count 1 00010000:00010000:0.0:1651529344.712764:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52695 lrc: 3/0,1 mode: --/PW res: [0x2b9dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.712768:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000041098c37/0x3234de053c4dc20 lrc: 2/0,0 mode: PR/PR res: [0x2b9dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d20e6 expref: 364 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.712771:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.712772:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1699:39029:x1731745946527808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1433us (1591us total) trans 12885080255 rc 0/0 00010000:00010000:0.0:1651529344.712772:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.712772:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52695 lrc: 4/0,1 mode: --/PW res: [0x2b9dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.712775:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212199 00000100:00100000:1.0:1651529344.712780:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212204 00010000:00010000:0.0:1651529344.712781:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000041098c37/0x3234de053c4dc20 lrc: 3/0,0 mode: PR/PR res: [0x2b9dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d20e6 expref: 364 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.712782:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1698:39029:x1731745946528064:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.712787:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178651 count 1 00010000:00010000:1.0:1651529344.712791:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5269c lrc: 3/0,1 mode: --/PW res: [0x2b9db:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.712795:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000061362ed2/0x3234de053c4ca6f lrc: 2/0,0 mode: PR/PR res: [0x2b9db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb6b expref: 364 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.712798:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.712799:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.712799:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5269c lrc: 4/0,1 mode: --/PW res: [0x2b9db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.712799:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000041098c37/0x3234de053c4dc20 lrc: 4/0,0 mode: PR/PR res: [0x2b9dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d20e6 expref: 364 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.712803:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029abc941 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997047744:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.712806:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000061362ed2/0x3234de053c4ca6f lrc: 3/0,0 mode: PR/PR res: [0x2b9db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb6b expref: 364 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.712809:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000061362ed2/0x3234de053c4ca6f lrc: 4/0,0 mode: PR/PR res: [0x2b9db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb6b expref: 364 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.712812:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 0000000076b354b3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.712813:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002f363f4a pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997047808:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.712817:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c5266b lrc: 2/0,0 mode: PW/PW res: [0x2b9d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.712820:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000014fe598c already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.712821:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 000000007e004c12 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.712821:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c5266b lrc: 2/0,0 mode: PW/PW res: [0x2b9d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.712824:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c5266b lrc: 3/0,0 mode: PW/PW res: [0x2b9d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.712827:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c52679 lrc: 2/0,0 mode: PW/PW res: [0x2b9d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.712828:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c5266b lrc: 1/0,0 mode: --/PW res: [0x2b9d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.712830:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000314b5fa1 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.712831:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c52679 lrc: 2/0,0 mode: PW/PW res: [0x2b9d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.712831:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c5266b lrc: 0/0,0 mode: --/PW res: [0x2b9d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.712834:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c52679 lrc: 3/0,0 mode: PW/PW res: [0x2b9d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.712838:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c52679 lrc: 1/0,0 mode: --/PW res: [0x2b9d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.712841:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c52679 lrc: 0/0,0 mode: --/PW res: [0x2b9d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.712860:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.712879:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946528256 00000100:00100000:1.0:1651529344.712909:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212205 00000100:00100000:1.0:1651529344.712911:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1699:39030:x1731745946528256:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.712915:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178654 count 1 00010000:00010000:1.0:1651529344.712919:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c526a3 lrc: 3/0,1 mode: --/PW res: [0x2b9de:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.712924:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000861e5c2b/0x3234de053c4cf93 lrc: 2/0,0 mode: PR/PR res: [0x2b9de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cefd8 expref: 364 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.712927:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.712927:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.712928:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c526a3 lrc: 4/0,1 mode: --/PW res: [0x2b9de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.712935:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000861e5c2b/0x3234de053c4cf93 lrc: 3/0,0 mode: PR/PR res: [0x2b9de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cefd8 expref: 364 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.712938:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000861e5c2b/0x3234de053c4cf93 lrc: 4/0,0 mode: PR/PR res: [0x2b9de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cefd8 expref: 364 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.712942:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005d3fb3ef pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997047872:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.712958:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000499d0377 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.712972:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.712991:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.713012:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946528192 00000100:00100000:0.0:1651529344.713019:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.713022:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946528320 00000100:00100000:1.0:1651529344.713033:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946528384 00000100:00100000:1.0:1651529344.713038:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212206 00000100:00100000:1.0:1651529344.713040:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1702:39029:x1731745946528192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.713040:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212207 00000100:00100000:0.0:1651529344.713042:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1702:39029:x1731745946528320:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.713044:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178653 count 1 00002000:00080000:0.0:1651529344.713048:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178655 count 1 00010000:00010000:1.0:1651529344.713049:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c526aa lrc: 3/0,1 mode: --/PW res: [0x2b9dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.713052:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c526b1 lrc: 3/0,1 mode: --/PW res: [0x2b9df:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.713053:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a9dab47c/0x3234de053c4e1bb lrc: 2/0,0 mode: PR/PR res: [0x2b9dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3840 expref: 364 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.713056:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.713057:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.713057:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000038454b3d/0x3234de053c4e390 lrc: 2/0,0 mode: PR/PR res: [0x2b9df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f39 expref: 364 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.713058:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c526aa lrc: 4/0,1 mode: --/PW res: [0x2b9dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.713060:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.713060:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.713061:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c526b1 lrc: 4/0,1 mode: --/PW res: [0x2b9df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.713066:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a9dab47c/0x3234de053c4e1bb lrc: 3/0,0 mode: PR/PR res: [0x2b9dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3840 expref: 364 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.713068:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000038454b3d/0x3234de053c4e390 lrc: 3/0,0 mode: PR/PR res: [0x2b9df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f39 expref: 364 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.713070:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a9dab47c/0x3234de053c4e1bb lrc: 4/0,0 mode: PR/PR res: [0x2b9dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3840 expref: 364 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.713071:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000038454b3d/0x3234de053c4e390 lrc: 4/0,0 mode: PR/PR res: [0x2b9df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f39 expref: 364 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.713074:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a9b051f pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997047936:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.713076:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000974b675b pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997048000:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.713084:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 0000000099c1da85 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.713084:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000003003c8b0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.713090:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212208 00000100:00100000:1.0:1651529344.713092:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1702:39030:x1731745946528384:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.713095:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178656 count 1 00010000:00010000:1.0:1651529344.713098:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c526b8 lrc: 3/0,1 mode: --/PW res: [0x2b9e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.713102:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c73ca422/0x3234de053c4d9aa lrc: 2/0,0 mode: PR/PR res: [0x2b9e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d171c expref: 364 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.713105:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.713106:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.713107:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c526b8 lrc: 4/0,1 mode: --/PW res: [0x2b9e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.713112:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c73ca422/0x3234de053c4d9aa lrc: 3/0,0 mode: PR/PR res: [0x2b9e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d171c expref: 364 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.713116:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c73ca422/0x3234de053c4d9aa lrc: 4/0,0 mode: PR/PR res: [0x2b9e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d171c expref: 364 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.713120:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004089c807 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997048064:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.713126:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a6b79b05 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.713257:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001d1586f2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997047616:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.713261:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52687 lrc: 3/0,1 mode: --/PW res: [0x2b9da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.713286:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002f363f4a pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997047808:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.713289:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5269c lrc: 3/0,1 mode: --/PW res: [0x2b9db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.713297:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.713306:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396409152 00000100:00100000:0.0:1651529344.713308:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.713316:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000915c645b/0x3234de053c4ee3a lrc: 5/0,0 mode: PR/PR res: [0x2b9d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b0e expref: 365 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.713316:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.713323:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.713324:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396409088 00010000:00010000:1.0:1651529344.713327:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000a5c0741/0x3234de053c4e7b8 lrc: 4/0,0 mode: PR/PR res: [0x2b9da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f62 expref: 366 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.713336:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.713337:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396409280 00010000:00010000:1.0:1651529344.713339:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000061362ed2/0x3234de053c4ca6f lrc: 4/0,0 mode: PR/PR res: [0x2b9db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb6b expref: 367 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.713344:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396409216 00010000:00010000:1.0:1651529344.713346:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000041098c37/0x3234de053c4dc20 lrc: 5/0,0 mode: PR/PR res: [0x2b9dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d20e6 expref: 368 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.713358:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396409344 00010000:00010000:1.0:1651529344.713360:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000861e5c2b/0x3234de053c4cf93 lrc: 5/0,0 mode: PR/PR res: [0x2b9de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cefd8 expref: 369 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.713365:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12983 00000100:00100000:1.0:1651529344.713367:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+369:41278:x1731746396409152:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.713370:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.713371:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000915c645b/0x3234de053c4ee3a lrc: 5/0,0 mode: PR/PR res: [0x2b9d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b0e expref: 369 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.713389:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000915c645b/0x3234de053c4ee3a lrc: 4/0,0 mode: PR/PR res: [0x2b9d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b0e expref: 369 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.713391:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000055e03b4f pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997047680:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.713396:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000915c645b/0x3234de053c4ee3a lrc: 0/0,0 mode: --/PR res: [0x2b9d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b0e expref: 369 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.713396:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5268e lrc: 3/0,1 mode: --/PW res: [0x2b9d9:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.713400:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.713400:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.713401:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5268e lrc: 3/0,1 mode: PW/PW res: [0x2b9d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.713404:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5268e lrc: 4/0,1 mode: PW/PW res: [0x2b9d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.713413:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.713417:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029abc941 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997047744:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.713420:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52695 lrc: 3/0,1 mode: --/PW res: [0x2b9dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.713424:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+368:41278:x1731746396409152:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 57us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.713427:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12983 00000100:00100000:0.0:1651529344.713431:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000974b675b pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997048000:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.713432:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12984 00010000:00010000:0.0:1651529344.713433:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c526b1 lrc: 3/0,1 mode: --/PW res: [0x2b9df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.713434:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+367:41279:x1731746396409088:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.713436:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.713438:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000a5c0741/0x3234de053c4e7b8 lrc: 4/0,0 mode: PR/PR res: [0x2b9da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f62 expref: 367 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.713438:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5268e lrc: 3/0,1 mode: PW/PW res: [0x2b9d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.713440:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5268e lrc: 3/0,1 mode: PW/PW res: [0x2b9d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.713441:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000a5c0741/0x3234de053c4e7b8 lrc: 3/0,0 mode: PR/PR res: [0x2b9da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f62 expref: 367 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.713444:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5268e lrc: 3/0,1 mode: PW/PW res: [0x2b9d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.713446:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a5c0741/0x3234de053c4e7b8 lrc: 0/0,0 mode: --/PR res: [0x2b9da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f62 expref: 367 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.713446:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5268e lrc: 2/0,0 mode: PW/PW res: [0x2b9d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.713450:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.713450:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.713451:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52687 lrc: 3/0,1 mode: PW/PW res: [0x2b9da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.713454:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52687 lrc: 4/0,1 mode: PW/PW res: [0x2b9da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.713460:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.713464:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+366:41279:x1731746396409088:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 30us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.713467:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12984 00000100:00100000:1.0:1651529344.713470:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12985 00000100:00100000:1.0:1651529344.713472:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+365:41278:x1731746396409280:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.713474:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.713475:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000061362ed2/0x3234de053c4ca6f lrc: 4/0,0 mode: PR/PR res: [0x2b9db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb6b expref: 365 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.713478:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000061362ed2/0x3234de053c4ca6f lrc: 3/0,0 mode: PR/PR res: [0x2b9db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb6b expref: 365 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.713483:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061362ed2/0x3234de053c4ca6f lrc: 0/0,0 mode: --/PR res: [0x2b9db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdb6b expref: 365 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.713486:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.713486:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.713487:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5269c lrc: 3/0,1 mode: PW/PW res: [0x2b9db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.713490:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5269c lrc: 4/0,1 mode: PW/PW res: [0x2b9db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.713495:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.713500:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+364:41278:x1731746396409280:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 28us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.713501:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005329f5eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1703:39029:x1731745946527936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 834us (909us total) trans 12885080256 rc 0/0 00000100:00100000:1.0:1651529344.713502:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12985 00000100:00100000:1.0:1651529344.713506:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12986 00000100:00100000:0.0:1651529344.713506:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212202 00000100:00100000:1.0:1651529344.713507:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+363:41279:x1731746396409216:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.713509:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.713511:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000041098c37/0x3234de053c4dc20 lrc: 4/0,0 mode: PR/PR res: [0x2b9dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d20e6 expref: 363 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.713514:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000041098c37/0x3234de053c4dc20 lrc: 3/0,0 mode: PR/PR res: [0x2b9dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d20e6 expref: 363 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.713514:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5268e lrc: 2/0,0 mode: PW/PW res: [0x2b9d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.713517:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f0bd9bfb already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.713519:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041098c37/0x3234de053c4dc20 lrc: 0/0,0 mode: --/PR res: [0x2b9dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d20e6 expref: 363 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.713519:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5268e lrc: 2/0,0 mode: PW/PW res: [0x2b9d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.713521:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5268e lrc: 3/0,0 mode: PW/PW res: [0x2b9d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.713522:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.713522:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.713523:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52695 lrc: 3/0,1 mode: PW/PW res: [0x2b9dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.713526:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52695 lrc: 4/0,1 mode: PW/PW res: [0x2b9dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.713526:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5268e lrc: 1/0,0 mode: --/PW res: [0x2b9d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.713529:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5268e lrc: 0/0,0 mode: --/PW res: [0x2b9d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.713534:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.713538:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+362:41279:x1731746396409216:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 30us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.713541:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12986 00010000:00010000:0.0:1651529344.713542:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52695 lrc: 3/0,1 mode: PW/PW res: [0x2b9dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.713544:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12987 00010000:00010000:0.0:1651529344.713545:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52695 lrc: 3/0,1 mode: PW/PW res: [0x2b9dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.713546:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+361:41279:x1731746396409344:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.713548:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.713548:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52695 lrc: 3/0,1 mode: PW/PW res: [0x2b9dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.713550:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000861e5c2b/0x3234de053c4cf93 lrc: 5/0,0 mode: PR/PR res: [0x2b9de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cefd8 expref: 361 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.713551:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52695 lrc: 2/0,0 mode: PW/PW res: [0x2b9dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.713553:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000861e5c2b/0x3234de053c4cf93 lrc: 4/0,0 mode: PR/PR res: [0x2b9de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cefd8 expref: 361 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.713558:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.713558:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.713559:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c526a3 lrc: 3/0,1 mode: PW/PW res: [0x2b9de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.713562:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c526a3 lrc: 4/0,1 mode: PW/PW res: [0x2b9de:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.713566:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.713569:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+361:41279:x1731746396409344:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 23us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.713572:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12987 00010000:00010000:1.0:1651529344.713577:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5269c lrc: 3/0,1 mode: PW/PW res: [0x2b9db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.713580:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5269c lrc: 3/0,1 mode: PW/PW res: [0x2b9db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.713583:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5269c lrc: 3/0,1 mode: PW/PW res: [0x2b9db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.713586:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5269c lrc: 2/0,0 mode: PW/PW res: [0x2b9db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.713587:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1703:39030:x1731745946528128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 831us (983us total) trans 12885080257 rc 0/0 00000100:00100000:0.0:1651529344.713590:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212203 00010000:00010000:0.0:1651529344.713596:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52695 lrc: 2/0,0 mode: PW/PW res: [0x2b9dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.713600:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000576f1f12 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.713601:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52695 lrc: 2/0,0 mode: PW/PW res: [0x2b9dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.713603:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52695 lrc: 3/0,0 mode: PW/PW res: [0x2b9dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.713608:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52695 lrc: 1/0,0 mode: --/PW res: [0x2b9dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.713610:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52695 lrc: 0/0,0 mode: --/PW res: [0x2b9dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.713614:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5269c lrc: 2/0,0 mode: PW/PW res: [0x2b9db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.713617:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000029958df2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.713618:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5269c lrc: 2/0,0 mode: PW/PW res: [0x2b9db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.713623:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5269c lrc: 3/0,0 mode: PW/PW res: [0x2b9db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.713625:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1703:39029:x1731745946528064:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 842us (1011us total) trans 12885080258 rc 0/0 00010000:00010000:0.0:1651529344.713627:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5269c lrc: 1/0,0 mode: --/PW res: [0x2b9db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.713628:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212204 00010000:00010000:0.0:1651529344.713629:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5269c lrc: 0/0,0 mode: --/PW res: [0x2b9db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.713639:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a9b051f pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997047936:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.713643:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c526aa lrc: 3/0,1 mode: --/PW res: [0x2b9dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.713650:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52687 lrc: 3/0,1 mode: PW/PW res: [0x2b9da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.713670:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52687 lrc: 3/0,1 mode: PW/PW res: [0x2b9da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.713670:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.713678:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52687 lrc: 3/0,1 mode: PW/PW res: [0x2b9da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.713681:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52687 lrc: 2/0,0 mode: PW/PW res: [0x2b9da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.713683:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.713702:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.713723:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1703:39030:x1731745946528000:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1060us (1146us total) trans 12885080259 rc 0/0 00000100:00100000:1.0:1651529344.713733:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212201 00010000:00010000:0.0:1651529344.713754:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52687 lrc: 2/0,0 mode: PW/PW res: [0x2b9da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.713758:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006cbd0d09 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.713759:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52687 lrc: 2/0,0 mode: PW/PW res: [0x2b9da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.713762:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52687 lrc: 3/0,0 mode: PW/PW res: [0x2b9da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.713767:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52687 lrc: 1/0,0 mode: --/PW res: [0x2b9da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.713770:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52687 lrc: 0/0,0 mode: --/PW res: [0x2b9da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.713775:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004089c807 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997048064:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.713779:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c526b8 lrc: 3/0,1 mode: --/PW res: [0x2b9e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.713780:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396409472 00000100:00100000:1.0:1651529344.713785:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396409408 00010000:00010000:0.0:1651529344.713785:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000038454b3d/0x3234de053c4e390 lrc: 4/0,0 mode: PR/PR res: [0x2b9df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f39 expref: 361 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.713789:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a9dab47c/0x3234de053c4e1bb lrc: 4/0,0 mode: PR/PR res: [0x2b9dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3840 expref: 362 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.713798:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396409536 00010000:00010000:1.0:1651529344.713800:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c73ca422/0x3234de053c4d9aa lrc: 4/0,0 mode: PR/PR res: [0x2b9e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d171c expref: 363 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.713805:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12988 00000100:00100000:1.0:1651529344.713806:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+363:41278:x1731746396409408:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.713809:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.713809:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12989 00010000:00010000:1.0:1651529344.713810:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a9dab47c/0x3234de053c4e1bb lrc: 4/0,0 mode: PR/PR res: [0x2b9dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3840 expref: 363 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.713811:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+363:41278:x1731746396409536:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.713814:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a9dab47c/0x3234de053c4e1bb lrc: 3/0,0 mode: PR/PR res: [0x2b9dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3840 expref: 363 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.713815:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.713816:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c73ca422/0x3234de053c4d9aa lrc: 4/0,0 mode: PR/PR res: [0x2b9e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d171c expref: 363 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.713819:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9dab47c/0x3234de053c4e1bb lrc: 0/0,0 mode: --/PR res: [0x2b9dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3840 expref: 363 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.713820:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c73ca422/0x3234de053c4d9aa lrc: 3/0,0 mode: PR/PR res: [0x2b9e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d171c expref: 363 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.713823:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.713823:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.713824:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c526aa lrc: 3/0,1 mode: PW/PW res: [0x2b9dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.713826:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c73ca422/0x3234de053c4d9aa lrc: 0/0,0 mode: --/PR res: [0x2b9e0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d171c expref: 362 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.713827:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c526aa lrc: 4/0,1 mode: PW/PW res: [0x2b9dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.713829:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.713830:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.713831:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c526b8 lrc: 3/0,1 mode: PW/PW res: [0x2b9e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.713833:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.713834:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c526b8 lrc: 4/0,1 mode: PW/PW res: [0x2b9e0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.713849:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+361:41278:x1731746396409408:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 41us (165us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.713849:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.713852:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12988 00000100:00100000:1.0:1651529344.713857:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12990 00000100:00100000:0.0:1651529344.713857:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+360:41278:x1731746396409536:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 45us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.713858:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000461918a5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+360:41278:x1731746396409472:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.713860:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12989 00010000:00010000:1.0:1651529344.713861:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.713863:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000038454b3d/0x3234de053c4e390 lrc: 4/0,0 mode: PR/PR res: [0x2b9df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f39 expref: 359 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.713867:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000038454b3d/0x3234de053c4e390 lrc: 3/0,0 mode: PR/PR res: [0x2b9df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f39 expref: 359 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.713871:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038454b3d/0x3234de053c4e390 lrc: 0/0,0 mode: --/PR res: [0x2b9df:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3f39 expref: 359 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.713875:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.713875:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.713876:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c526b1 lrc: 3/0,1 mode: PW/PW res: [0x2b9df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.713879:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c526b1 lrc: 4/0,1 mode: PW/PW res: [0x2b9df:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.713888:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.713894:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c526b1 lrc: 3/0,1 mode: PW/PW res: [0x2b9df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.713898:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c526b1 lrc: 3/0,1 mode: PW/PW res: [0x2b9df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.713904:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000461918a5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+358:41278:x1731746396409472:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 45us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.713907:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12990 00010000:00010000:1.0:1651529344.713918:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c526b8 lrc: 3/0,1 mode: PW/PW res: [0x2b9e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.713922:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c526b8 lrc: 3/0,1 mode: PW/PW res: [0x2b9e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.713925:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c526b8 lrc: 3/0,1 mode: PW/PW res: [0x2b9e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.713927:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c526b8 lrc: 2/0,0 mode: PW/PW res: [0x2b9e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.713928:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c526b1 lrc: 3/0,1 mode: PW/PW res: [0x2b9df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.713932:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c526b1 lrc: 2/0,0 mode: PW/PW res: [0x2b9df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.713975:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1704:39030:x1731745946528384:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 883us (956us total) trans 12885080260 rc 0/0 00000100:00100000:1.0:1651529344.713978:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212208 00000100:00100000:0.0:1651529344.713981:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1703:39029:x1731745946528320:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 938us (990us total) trans 12885080261 rc 0/0 00000100:00100000:0.0:1651529344.713984:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212207 00010000:00010000:1.0:1651529344.713986:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c526b8 lrc: 2/0,0 mode: PW/PW res: [0x2b9e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.713989:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000490515f1 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.713991:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c526b8 lrc: 2/0,0 mode: PW/PW res: [0x2b9e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.713992:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c526b1 lrc: 2/0,0 mode: PW/PW res: [0x2b9df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.713993:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c526b8 lrc: 3/0,0 mode: PW/PW res: [0x2b9e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.713996:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004dda5a3f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.713997:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c526b1 lrc: 2/0,0 mode: PW/PW res: [0x2b9df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.713998:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c526b8 lrc: 1/0,0 mode: --/PW res: [0x2b9e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.713999:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c526b1 lrc: 3/0,0 mode: PW/PW res: [0x2b9df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.714001:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c526b8 lrc: 0/0,0 mode: --/PW res: [0x2b9e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.714004:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c526b1 lrc: 1/0,0 mode: --/PW res: [0x2b9df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.714006:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c526aa lrc: 3/0,1 mode: PW/PW res: [0x2b9dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.714007:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c526b1 lrc: 0/0,0 mode: --/PW res: [0x2b9df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.714009:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c526aa lrc: 3/0,1 mode: PW/PW res: [0x2b9dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.714012:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c526aa lrc: 3/0,1 mode: PW/PW res: [0x2b9dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.714015:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c526aa lrc: 2/0,0 mode: PW/PW res: [0x2b9dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.714036:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.714061:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.714074:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1703:39029:x1731745946528192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1033us (1101us total) trans 12885080262 rc 0/0 00000100:00100000:1.0:1651529344.714077:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212206 00000100:00100000:0.0:1651529344.714077:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.714087:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946528512 00000100:00100000:0.0:1651529344.714089:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.714102:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946528448 00000100:00100000:1.0:1651529344.714108:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946528640 00000100:00100000:1.0:1651529344.714112:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946528576 00000100:00100000:1.0:1651529344.714117:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212209 00000100:00100000:1.0:1651529344.714119:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1706:39030:x1731745946528512:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.714130:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178658 count 1 00010000:00010000:1.0:1651529344.714134:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c526bf lrc: 3/0,1 mode: --/PW res: [0x2b9e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.714134:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c526aa lrc: 2/0,0 mode: PW/PW res: [0x2b9dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.714138:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cde66bc6 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.714139:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001f126f8e/0x3234de053c4d512 lrc: 2/0,0 mode: PR/PR res: [0x2b9e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0667 expref: 357 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.714139:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c526aa lrc: 2/0,0 mode: PW/PW res: [0x2b9dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.714142:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c526aa lrc: 3/0,0 mode: PW/PW res: [0x2b9dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.714144:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.714145:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.714146:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c526bf lrc: 4/0,1 mode: --/PW res: [0x2b9e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.714147:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c526aa lrc: 1/0,0 mode: --/PW res: [0x2b9dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.714149:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c526aa lrc: 0/0,0 mode: --/PW res: [0x2b9dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.714152:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001f126f8e/0x3234de053c4d512 lrc: 3/0,0 mode: PR/PR res: [0x2b9e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0667 expref: 357 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.714156:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001f126f8e/0x3234de053c4d512 lrc: 4/0,0 mode: PR/PR res: [0x2b9e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0667 expref: 357 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.714157:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212210 00000100:00100000:0.0:1651529344.714159:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1706:39029:x1731745946528448:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.714160:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004089c807 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997048128:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.714165:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178657 count 1 00000100:00100000:1.0:1651529344.714175:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b7af823 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.714182:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212211 00000100:00100000:1.0:1651529344.714183:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1706:39030:x1731745946528640:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.714188:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178660 count 1 00010000:00010000:0.0:1651529344.714191:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c526c6 lrc: 3/0,1 mode: --/PW res: [0x2b9e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.714192:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c526cd lrc: 3/0,1 mode: --/PW res: [0x2b9e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.714196:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000043b5184/0x3234de053c4cd5c lrc: 2/0,0 mode: PR/PR res: [0x2b9e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce75e expref: 357 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.714196:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009467668b/0x3234de053c4e97f lrc: 2/0,0 mode: PR/PR res: [0x2b9e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d578f expref: 357 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.714199:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.714199:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.714200:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.714200:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.714201:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c526cd lrc: 4/0,1 mode: --/PW res: [0x2b9e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.714201:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c526c6 lrc: 4/0,1 mode: --/PW res: [0x2b9e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.714208:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009467668b/0x3234de053c4e97f lrc: 3/0,0 mode: PR/PR res: [0x2b9e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d578f expref: 357 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.714209:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000043b5184/0x3234de053c4cd5c lrc: 3/0,0 mode: PR/PR res: [0x2b9e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce75e expref: 357 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.714212:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009467668b/0x3234de053c4e97f lrc: 4/0,0 mode: PR/PR res: [0x2b9e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d578f expref: 357 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.714213:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000043b5184/0x3234de053c4cd5c lrc: 4/0,0 mode: PR/PR res: [0x2b9e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce75e expref: 357 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.714216:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002a957ba7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997048192:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.714217:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000050bbb886 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997048256:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.714245:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 0000000076b354b3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.714247:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f79d8146 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.714252:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212212 00000100:00100000:0.0:1651529344.714254:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1706:39029:x1731745946528576:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.714260:0:80278:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000861e5c2b/0x3234de053c4cf93 lrc: 0/0,0 mode: --/PR res: [0x2b9de:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cefd8 expref: 357 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.714264:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005d3fb3ef pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997047872:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.714267:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c526a3 lrc: 3/0,1 mode: PW/PW res: [0x2b9de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.714270:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c526a3 lrc: 3/0,1 mode: PW/PW res: [0x2b9de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.714273:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c526a3 lrc: 3/0,1 mode: PW/PW res: [0x2b9de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.714273:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178659 count 1 00010000:00010000:1.0:1651529344.714276:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c526a3 lrc: 3/0,1 mode: PW/PW res: [0x2b9de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.714277:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c526d4 lrc: 3/0,1 mode: --/PW res: [0x2b9e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.714279:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c526a3 lrc: 2/0,0 mode: PW/PW res: [0x2b9de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.714282:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007785087c/0x3234de053c4c727 lrc: 2/0,0 mode: PR/PR res: [0x2b9e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccea6 expref: 356 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.714288:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.714288:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.714289:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c526d4 lrc: 4/0,1 mode: --/PW res: [0x2b9e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.714296:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007785087c/0x3234de053c4c727 lrc: 3/0,0 mode: PR/PR res: [0x2b9e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccea6 expref: 356 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.714299:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007785087c/0x3234de053c4c727 lrc: 4/0,0 mode: PR/PR res: [0x2b9e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccea6 expref: 356 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.714303:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000059363096 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997048320:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.714311:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000afe7ff7b going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.714316:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1707:39030:x1731745946528256:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1405us (1457us total) trans 12885080263 rc 0/0 00000100:00100000:1.0:1651529344.714319:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212205 00010000:00010000:1.0:1651529344.714327:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c526a3 lrc: 2/0,0 mode: PW/PW res: [0x2b9de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.714330:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ebdbebae already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.714331:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c526a3 lrc: 2/0,0 mode: PW/PW res: [0x2b9de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.714337:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.714348:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c526a3 lrc: 3/0,0 mode: PW/PW res: [0x2b9de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.714353:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c526a3 lrc: 1/0,0 mode: --/PW res: [0x2b9de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.714355:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.714356:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c526a3 lrc: 0/0,0 mode: --/PW res: [0x2b9de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.714364:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946528768 00000100:00100000:1.0:1651529344.714379:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946528704 00000100:00100000:0.0:1651529344.714382:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.714391:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946528832 00000100:00100000:1.0:1651529344.714398:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212213 00000100:00100000:1.0:1651529344.714400:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1709:39030:x1731745946528768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.714405:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178662 count 1 00010000:00010000:1.0:1651529344.714409:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c526db lrc: 3/0,1 mode: --/PW res: [0x2b9e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.714413:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009a38d70c/0x3234de053c4d85a lrc: 2/0,0 mode: PR/PR res: [0x2b9e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1276 expref: 356 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.714417:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212214 00000100:00100000:0.0:1651529344.714419:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1709:39029:x1731745946528704:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.714423:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.714424:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:0.0:1651529344.714424:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178661 count 1 00010000:00010000:1.0:1651529344.714425:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c526db lrc: 4/0,1 mode: --/PW res: [0x2b9e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.714428:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c526e2 lrc: 3/0,1 mode: --/PW res: [0x2b9e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.714431:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009a38d70c/0x3234de053c4d85a lrc: 3/0,0 mode: PR/PR res: [0x2b9e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1276 expref: 356 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.714433:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000055f75fe8/0x3234de053c4ec96 lrc: 2/0,0 mode: PR/PR res: [0x2b9e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6415 expref: 356 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.714435:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009a38d70c/0x3234de053c4d85a lrc: 4/0,0 mode: PR/PR res: [0x2b9e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1276 expref: 356 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.714436:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.714437:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.714437:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c526e2 lrc: 4/0,1 mode: --/PW res: [0x2b9e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.714439:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004be0190 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997048384:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.714444:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000055f75fe8/0x3234de053c4ec96 lrc: 3/0,0 mode: PR/PR res: [0x2b9e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6415 expref: 356 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.714448:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000055f75fe8/0x3234de053c4ec96 lrc: 4/0,0 mode: PR/PR res: [0x2b9e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6415 expref: 356 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.714453:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fb6c773d going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.714458:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f2582a33 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997048448:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.714460:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212215 00000100:00100000:1.0:1651529344.714462:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1709:39029:x1731745946528832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.714466:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178663 count 1 00000100:00100000:0.0:1651529344.714467:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 0000000049203969 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.714470:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c526e9 lrc: 3/0,1 mode: --/PW res: [0x2b9e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.714474:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000002a2d0aa/0x3234de053c4eedb lrc: 2/0,0 mode: PR/PR res: [0x2b9e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d5a expref: 356 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.714477:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.714478:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.714478:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c526e9 lrc: 4/0,1 mode: --/PW res: [0x2b9e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.714484:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000002a2d0aa/0x3234de053c4eedb lrc: 3/0,0 mode: PR/PR res: [0x2b9e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d5a expref: 356 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.714488:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000002a2d0aa/0x3234de053c4eedb lrc: 4/0,0 mode: PR/PR res: [0x2b9e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d5a expref: 356 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.714492:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997048512:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.714498:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.714499:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000412e5d26 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.714504:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946528896 00000100:00100000:1.0:1651529344.714514:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212216 00000100:00100000:1.0:1651529344.714516:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1710:39030:x1731745946528896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.714520:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178664 count 1 00010000:00010000:1.0:1651529344.714523:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c526f0 lrc: 3/0,1 mode: --/PW res: [0x2b9e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.714527:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009b651c99/0x3234de053c4ef28 lrc: 2/0,0 mode: PR/PR res: [0x2b9e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6eb8 expref: 356 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.714538:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.714539:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.714540:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c526f0 lrc: 4/0,1 mode: --/PW res: [0x2b9e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.714546:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009b651c99/0x3234de053c4ef28 lrc: 3/0,0 mode: PR/PR res: [0x2b9e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6eb8 expref: 356 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.714550:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009b651c99/0x3234de053c4ef28 lrc: 4/0,0 mode: PR/PR res: [0x2b9e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6eb8 expref: 356 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.714554:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000007fba516 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997048576:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.714566:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 0000000089d75f07 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.714662:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004089c807 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997048128:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.714663:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002a957ba7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997048192:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.714667:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c526bf lrc: 3/0,1 mode: --/PW res: [0x2b9e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.714668:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c526c6 lrc: 3/0,1 mode: --/PW res: [0x2b9e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.714940:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.714951:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396409600 00000100:00100000:0.0:1651529344.714951:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.714966:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001f126f8e/0x3234de053c4d512 lrc: 4/0,0 mode: PR/PR res: [0x2b9e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0667 expref: 357 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.714978:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396409664 00010000:00010000:1.0:1651529344.714989:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009467668b/0x3234de053c4e97f lrc: 4/0,0 mode: PR/PR res: [0x2b9e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d578f expref: 358 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.714990:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.714994:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396409792 00010000:00010000:1.0:1651529344.714997:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007785087c/0x3234de053c4c727 lrc: 5/0,0 mode: PR/PR res: [0x2b9e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccea6 expref: 359 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.714997:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.715001:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396409920 00010000:00010000:1.0:1651529344.715003:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000055f75fe8/0x3234de053c4ec96 lrc: 5/0,0 mode: PR/PR res: [0x2b9e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6415 expref: 360 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.715003:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.715007:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396410048 00000100:00100000:0.0:1651529344.715008:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.715010:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009b651c99/0x3234de053c4ef28 lrc: 5/0,0 mode: PR/PR res: [0x2b9e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6eb8 expref: 361 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.715012:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.715014:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396409728 00010000:00010000:1.0:1651529344.715016:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000043b5184/0x3234de053c4cd5c lrc: 5/0,0 mode: PR/PR res: [0x2b9e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce75e expref: 362 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.715018:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.715020:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396409856 00010000:00010000:1.0:1651529344.715023:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009a38d70c/0x3234de053c4d85a lrc: 5/0,0 mode: PR/PR res: [0x2b9e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1276 expref: 363 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.715026:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000059363096 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997048320:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.715027:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396409984 00010000:00010000:1.0:1651529344.715029:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000002a2d0aa/0x3234de053c4eedb lrc: 5/0,0 mode: PR/PR res: [0x2b9e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d5a expref: 364 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.715030:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c526d4 lrc: 3/0,1 mode: --/PW res: [0x2b9e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.715033:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12991 00000100:00100000:1.0:1651529344.715035:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+364:41279:x1731746396409600:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.715037:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.715037:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f2582a33 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997048448:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.715039:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001f126f8e/0x3234de053c4d512 lrc: 4/0,0 mode: PR/PR res: [0x2b9e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0667 expref: 364 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.715040:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c526e2 lrc: 3/0,1 mode: --/PW res: [0x2b9e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.715042:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001f126f8e/0x3234de053c4d512 lrc: 3/0,0 mode: PR/PR res: [0x2b9e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0667 expref: 364 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.715046:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12992 00010000:00010000:1.0:1651529344.715048:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f126f8e/0x3234de053c4d512 lrc: 0/0,0 mode: --/PR res: [0x2b9e2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0667 expref: 364 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.715048:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+364:41279:x1731746396409664:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.715052:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.715052:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.715053:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.715053:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c526bf lrc: 3/0,1 mode: PW/PW res: [0x2b9e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.715053:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009467668b/0x3234de053c4e97f lrc: 4/0,0 mode: PR/PR res: [0x2b9e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d578f expref: 363 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.715057:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c526bf lrc: 4/0,1 mode: PW/PW res: [0x2b9e2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.715057:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009467668b/0x3234de053c4e97f lrc: 3/0,0 mode: PR/PR res: [0x2b9e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d578f expref: 363 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.715063:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.715063:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009467668b/0x3234de053c4e97f lrc: 0/0,0 mode: --/PR res: [0x2b9e1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d578f expref: 363 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.715067:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.715067:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.715068:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c526c6 lrc: 3/0,1 mode: PW/PW res: [0x2b9e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.715071:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+362:41279:x1731746396409600:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 36us (131us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.715071:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c526c6 lrc: 4/0,1 mode: PW/PW res: [0x2b9e1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.715074:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12991 00000100:00100000:1.0:1651529344.715078:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12993 00010000:00010000:0.0:1651529344.715078:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.715080:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+361:41278:x1731746396409792:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.715082:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.715084:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007785087c/0x3234de053c4c727 lrc: 4/0,0 mode: PR/PR res: [0x2b9e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccea6 expref: 361 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.715085:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+361:41279:x1731746396409664:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 36us (133us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.715087:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007785087c/0x3234de053c4c727 lrc: 3/0,0 mode: PR/PR res: [0x2b9e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccea6 expref: 361 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.715088:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12992 00010000:00010000:1.0:1651529344.715092:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007785087c/0x3234de053c4c727 lrc: 0/0,0 mode: --/PR res: [0x2b9e3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccea6 expref: 360 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.715094:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12994 00010000:00010000:1.0:1651529344.715095:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.715095:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+359:41278:x1731746396409920:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.715096:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.715096:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c526d4 lrc: 3/0,1 mode: PW/PW res: [0x2b9e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.715098:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.715099:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000055f75fe8/0x3234de053c4ec96 lrc: 4/0,0 mode: PR/PR res: [0x2b9e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6415 expref: 359 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.715102:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c526d4 lrc: 4/0,1 mode: PW/PW res: [0x2b9e3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.715103:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000055f75fe8/0x3234de053c4ec96 lrc: 3/0,0 mode: PR/PR res: [0x2b9e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6415 expref: 359 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.715108:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055f75fe8/0x3234de053c4ec96 lrc: 0/0,0 mode: --/PR res: [0x2b9e5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6415 expref: 359 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.715112:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.715117:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+359:41278:x1731746396409792:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (127us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.715119:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.715119:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.715120:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12993 00010000:00010000:0.0:1651529344.715120:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c526e2 lrc: 3/0,1 mode: PW/PW res: [0x2b9e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.715123:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c526e2 lrc: 4/0,1 mode: PW/PW res: [0x2b9e5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.715125:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12995 00000100:00100000:1.0:1651529344.715126:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f53a84c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+357:41278:x1731746396410048:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.715128:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.715129:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.715130:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009b651c99/0x3234de053c4ef28 lrc: 5/0,0 mode: PR/PR res: [0x2b9e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6eb8 expref: 357 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.715134:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009b651c99/0x3234de053c4ef28 lrc: 4/0,0 mode: PR/PR res: [0x2b9e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6eb8 expref: 357 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.715134:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+357:41278:x1731746396409920:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 39us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.715137:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12994 00010000:00010000:1.0:1651529344.715138:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.715139:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.715139:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c526f0 lrc: 3/0,1 mode: PW/PW res: [0x2b9e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.715142:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c526f0 lrc: 4/0,1 mode: PW/PW res: [0x2b9e8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.715142:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12996 00000100:00100000:0.0:1651529344.715144:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+356:41279:x1731746396409728:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.715146:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.715146:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.715148:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000043b5184/0x3234de053c4cd5c lrc: 5/0,0 mode: PR/PR res: [0x2b9e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce75e expref: 356 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.715151:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f53a84c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+356:41278:x1731746396410048:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 24us (148us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.715151:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000043b5184/0x3234de053c4cd5c lrc: 4/0,0 mode: PR/PR res: [0x2b9e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce75e expref: 356 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.715153:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12995 00010000:00010000:0.0:1651529344.715156:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.715157:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.715157:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c526cd lrc: 3/0,1 mode: PW/PW res: [0x2b9e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.715160:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c526cd lrc: 4/0,1 mode: PW/PW res: [0x2b9e4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.715161:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12997 00000100:00100000:1.0:1651529344.715162:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+355:41279:x1731746396409856:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.715164:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.715165:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.715166:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009a38d70c/0x3234de053c4d85a lrc: 5/0,0 mode: PR/PR res: [0x2b9e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1276 expref: 355 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.715169:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+355:41279:x1731746396409728:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 25us (161us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.715170:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009a38d70c/0x3234de053c4d85a lrc: 4/0,0 mode: PR/PR res: [0x2b9e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1276 expref: 355 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.715171:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12996 00010000:00010000:1.0:1651529344.715174:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.715174:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.715175:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c526db lrc: 3/0,1 mode: PW/PW res: [0x2b9e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.715175:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12998 00000100:00100000:0.0:1651529344.715176:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+354:41279:x1731746396409984:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.715178:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c526db lrc: 4/0,1 mode: PW/PW res: [0x2b9e6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.715178:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.715180:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000002a2d0aa/0x3234de053c4eedb lrc: 5/0,0 mode: PR/PR res: [0x2b9e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d5a expref: 354 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.715182:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.715186:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+354:41279:x1731746396409856:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 24us (174us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.715186:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000002a2d0aa/0x3234de053c4eedb lrc: 4/0,0 mode: PR/PR res: [0x2b9e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d5a expref: 354 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.715189:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12997 00010000:00010000:0.0:1651529344.715190:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.715191:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.715191:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c526e9 lrc: 3/0,1 mode: PW/PW res: [0x2b9e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.715194:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c526e9 lrc: 4/0,1 mode: PW/PW res: [0x2b9e7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.715198:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.715199:0:80279:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000043b5184/0x3234de053c4cd5c lrc: 0/0,0 mode: --/PR res: [0x2b9e4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce75e expref: 353 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.715202:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+353:41279:x1731746396409984:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 26us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.715203:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000050bbb886 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997048256:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.715205:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12998 00010000:00010000:1.0:1651529344.715207:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c526cd lrc: 3/0,1 mode: PW/PW res: [0x2b9e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.715210:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c526cd lrc: 3/0,1 mode: PW/PW res: [0x2b9e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.715210:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c526c6 lrc: 3/0,1 mode: PW/PW res: [0x2b9e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.715213:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c526cd lrc: 3/0,1 mode: PW/PW res: [0x2b9e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.715214:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c526c6 lrc: 3/0,1 mode: PW/PW res: [0x2b9e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.715216:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c526cd lrc: 3/0,1 mode: PW/PW res: [0x2b9e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.715217:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c526c6 lrc: 3/0,1 mode: PW/PW res: [0x2b9e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.715218:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c526cd lrc: 2/0,0 mode: PW/PW res: [0x2b9e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.715219:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c526c6 lrc: 2/0,0 mode: PW/PW res: [0x2b9e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.715280:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1712:39030:x1731745946528640:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1096us (1203us total) trans 12885080264 rc 0/0 00000100:00100000:1.0:1651529344.715283:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212211 00000100:00100000:0.0:1651529344.715290:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1711:39029:x1731745946528448:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1130us (1229us total) trans 12885080265 rc 0/0 00000100:00100000:0.0:1651529344.715293:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212210 00010000:00010000:1.0:1651529344.715297:0:80277:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002a2d0aa/0x3234de053c4eedb lrc: 0/0,0 mode: --/PR res: [0x2b9e7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6d5a expref: 351 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.715301:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997048512:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.715301:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c526cd lrc: 2/0,0 mode: PW/PW res: [0x2b9e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.715304:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c526e9 lrc: 3/0,1 mode: PW/PW res: [0x2b9e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.715304:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003c075ac0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.715305:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c526cd lrc: 2/0,0 mode: PW/PW res: [0x2b9e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.715307:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c526e9 lrc: 3/0,1 mode: PW/PW res: [0x2b9e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.715308:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c526cd lrc: 3/0,0 mode: PW/PW res: [0x2b9e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.715313:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c526e9 lrc: 3/0,1 mode: PW/PW res: [0x2b9e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.715313:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c526cd lrc: 1/0,0 mode: --/PW res: [0x2b9e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.715316:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c526e9 lrc: 3/0,1 mode: PW/PW res: [0x2b9e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.715316:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c526cd lrc: 0/0,0 mode: --/PW res: [0x2b9e4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.715318:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c526e9 lrc: 2/0,0 mode: PW/PW res: [0x2b9e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.715320:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c526c6 lrc: 2/0,0 mode: PW/PW res: [0x2b9e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.715323:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f9b62460 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.715324:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c526c6 lrc: 2/0,0 mode: PW/PW res: [0x2b9e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.715329:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c526c6 lrc: 3/0,0 mode: PW/PW res: [0x2b9e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.715332:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c526c6 lrc: 1/0,0 mode: --/PW res: [0x2b9e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.715334:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c526c6 lrc: 0/0,0 mode: --/PW res: [0x2b9e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.715338:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c526e9 lrc: 2/0,0 mode: PW/PW res: [0x2b9e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.715341:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000af20b5e7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.715341:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c526e9 lrc: 2/0,0 mode: PW/PW res: [0x2b9e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.715344:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c526e9 lrc: 3/0,0 mode: PW/PW res: [0x2b9e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.715347:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c526e9 lrc: 1/0,0 mode: --/PW res: [0x2b9e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.715350:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c526e9 lrc: 0/0,0 mode: --/PW res: [0x2b9e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.715355:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1711:39029:x1731745946528832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 892us (972us total) trans 12885080266 rc 0/0 00010000:00010000:0.0:1651529344.715356:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c526e2 lrc: 3/0,1 mode: PW/PW res: [0x2b9e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.715358:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212215 00010000:00010000:0.0:1651529344.715361:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c526e2 lrc: 3/0,1 mode: PW/PW res: [0x2b9e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.715364:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c526e2 lrc: 3/0,1 mode: PW/PW res: [0x2b9e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.715366:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c526e2 lrc: 2/0,0 mode: PW/PW res: [0x2b9e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.715369:0:72396:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b651c99/0x3234de053c4ef28 lrc: 0/0,0 mode: --/PR res: [0x2b9e8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6eb8 expref: 350 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.715372:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000007fba516 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997048576:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.715375:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c526f0 lrc: 3/0,1 mode: PW/PW res: [0x2b9e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.715378:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c526f0 lrc: 3/0,1 mode: PW/PW res: [0x2b9e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.715381:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c526f0 lrc: 3/0,1 mode: PW/PW res: [0x2b9e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.715387:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c526f0 lrc: 3/0,1 mode: PW/PW res: [0x2b9e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.715389:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c526f0 lrc: 2/0,0 mode: PW/PW res: [0x2b9e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.715410:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1712:39029:x1731745946528704:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 990us (1055us total) trans 12885080267 rc 0/0 00000100:00100000:0.0:1651529344.715413:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212214 00010000:00010000:0.0:1651529344.715419:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c526e2 lrc: 2/0,0 mode: PW/PW res: [0x2b9e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.715423:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e7aaedb0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.715423:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c526e2 lrc: 2/0,0 mode: PW/PW res: [0x2b9e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.715426:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c526e2 lrc: 3/0,0 mode: PW/PW res: [0x2b9e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.715428:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1711:39030:x1731745946528896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 912us (931us total) trans 12885080268 rc 0/0 00010000:00010000:0.0:1651529344.715430:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c526e2 lrc: 1/0,0 mode: --/PW res: [0x2b9e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.715431:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212216 00010000:00010000:0.0:1651529344.715433:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c526e2 lrc: 0/0,0 mode: --/PW res: [0x2b9e5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.715438:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c526f0 lrc: 2/0,0 mode: PW/PW res: [0x2b9e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.715439:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c526bf lrc: 3/0,1 mode: PW/PW res: [0x2b9e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.715440:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000050e053bc already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.715441:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c526f0 lrc: 2/0,0 mode: PW/PW res: [0x2b9e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.715442:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c526bf lrc: 3/0,1 mode: PW/PW res: [0x2b9e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.715444:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c526f0 lrc: 3/0,0 mode: PW/PW res: [0x2b9e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.715445:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c526bf lrc: 3/0,1 mode: PW/PW res: [0x2b9e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.715447:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c526f0 lrc: 1/0,0 mode: --/PW res: [0x2b9e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.715448:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c526bf lrc: 2/0,0 mode: PW/PW res: [0x2b9e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.715449:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c526f0 lrc: 0/0,0 mode: --/PW res: [0x2b9e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.715453:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c526bf lrc: 2/0,0 mode: PW/PW res: [0x2b9e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.715456:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009e44ce9d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.715456:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c526bf lrc: 2/0,0 mode: PW/PW res: [0x2b9e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.715459:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c526bf lrc: 3/0,0 mode: PW/PW res: [0x2b9e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.715462:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c526bf lrc: 1/0,0 mode: --/PW res: [0x2b9e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.715465:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c526bf lrc: 0/0,0 mode: --/PW res: [0x2b9e2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.715470:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c526d4 lrc: 3/0,1 mode: PW/PW res: [0x2b9e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.715472:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c526d4 lrc: 3/0,1 mode: PW/PW res: [0x2b9e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.715475:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c526d4 lrc: 3/0,1 mode: PW/PW res: [0x2b9e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.715478:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c526d4 lrc: 2/0,0 mode: PW/PW res: [0x2b9e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.715479:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1711:39030:x1731745946528512:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1359us (1443us total) trans 12885080269 rc 0/0 00000100:00100000:1.0:1651529344.715482:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212209 00010000:00010000:1.0:1651529344.715488:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c526d4 lrc: 2/0,0 mode: PW/PW res: [0x2b9e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.715493:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fafb79d3 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.715494:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c526d4 lrc: 2/0,0 mode: PW/PW res: [0x2b9e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.715497:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c526d4 lrc: 3/0,0 mode: PW/PW res: [0x2b9e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.715502:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c526d4 lrc: 1/0,0 mode: --/PW res: [0x2b9e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.715504:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c526d4 lrc: 0/0,0 mode: --/PW res: [0x2b9e3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.715512:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1711:39029:x1731745946528576:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1258us (1423us total) trans 12885080270 rc 0/0 00010000:00010000:1.0:1651529344.715513:0:80280:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a38d70c/0x3234de053c4d85a lrc: 0/0,0 mode: --/PR res: [0x2b9e6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1276 expref: 349 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.715515:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212212 00000100:00100000:1.0:1651529344.715517:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004be0190 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997048384:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.715520:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c526db lrc: 3/0,1 mode: PW/PW res: [0x2b9e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.715523:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c526db lrc: 3/0,1 mode: PW/PW res: [0x2b9e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.715526:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c526db lrc: 3/0,1 mode: PW/PW res: [0x2b9e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.715531:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c526db lrc: 3/0,1 mode: PW/PW res: [0x2b9e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.715534:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c526db lrc: 2/0,0 mode: PW/PW res: [0x2b9e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.715618:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1711:39030:x1731745946528768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1212us (1275us total) trans 12885080271 rc 0/0 00000100:00100000:1.0:1651529344.715621:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212213 00010000:00010000:1.0:1651529344.715628:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c526db lrc: 2/0,0 mode: PW/PW res: [0x2b9e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.715632:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000575eb734 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.715633:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c526db lrc: 2/0,0 mode: PW/PW res: [0x2b9e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.715635:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c526db lrc: 3/0,0 mode: PW/PW res: [0x2b9e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.715640:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c526db lrc: 1/0,0 mode: --/PW res: [0x2b9e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.715643:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c526db lrc: 0/0,0 mode: --/PW res: [0x2b9e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.715839:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.715850:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946528960 00000100:00100000:1.0:1651529344.715861:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212217 00000100:00100000:1.0:1651529344.715862:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1711:39029:x1731745946528960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.715870:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529344.715879:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178665 count 1 00000100:00100000:0.0:1651529344.715880:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.715888:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c526f7 lrc: 3/0,1 mode: --/PW res: [0x2b9e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.715888:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.715893:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006fe51d44/0x3234de053c4ee72 lrc: 2/0,0 mode: PR/PR res: [0x2b9e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6bee expref: 348 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.715895:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.715896:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.715897:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.715901:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c526f7 lrc: 4/0,1 mode: --/PW res: [0x2b9e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.715903:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.715909:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006fe51d44/0x3234de053c4ee72 lrc: 3/0,0 mode: PR/PR res: [0x2b9e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6bee expref: 348 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.715909:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.715918:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006fe51d44/0x3234de053c4ee72 lrc: 4/0,0 mode: PR/PR res: [0x2b9e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6bee expref: 348 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.715918:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.715927:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004be0190 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997048640:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.715928:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946529024 00000100:00100000:0.0:1651529344.715935:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946529088 00000100:00100000:1.0:1651529344.715938:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fb6c773d going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.715938:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946529216 00000100:00100000:0.0:1651529344.715944:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946529152 00000100:00100000:0.0:1651529344.715947:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946529344 00000100:00100000:0.0:1651529344.715949:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946529280 00000100:00100000:1.0:1651529344.715951:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946529408 00000100:00100000:0.0:1651529344.715952:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212218 00000100:00100000:0.0:1651529344.715953:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1718:39030:x1731745946529024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.715957:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212219 00000100:00100000:1.0:1651529344.715959:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1718:39029:x1731745946529088:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.715959:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178666 count 1 00002000:00080000:1.0:1651529344.715963:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178667 count 1 00010000:00010000:0.0:1651529344.715964:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c526fe lrc: 3/0,1 mode: --/PW res: [0x2b9ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.715967:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52705 lrc: 3/0,1 mode: --/PW res: [0x2b9eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.715969:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000068ac235c/0x3234de053c4cb64 lrc: 2/0,0 mode: PR/PR res: [0x2b9ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf00 expref: 348 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.715971:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dbc825d3/0x3234de053c4d7f8 lrc: 2/0,0 mode: PR/PR res: [0x2b9eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1126 expref: 348 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.715972:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.715973:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.715974:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.715974:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c526fe lrc: 4/0,1 mode: --/PW res: [0x2b9ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.715975:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.715976:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52705 lrc: 4/0,1 mode: --/PW res: [0x2b9eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.715981:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000068ac235c/0x3234de053c4cb64 lrc: 3/0,0 mode: PR/PR res: [0x2b9ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf00 expref: 348 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.715982:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dbc825d3/0x3234de053c4d7f8 lrc: 3/0,0 mode: PR/PR res: [0x2b9eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1126 expref: 348 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.715984:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000068ac235c/0x3234de053c4cb64 lrc: 4/0,0 mode: PR/PR res: [0x2b9ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf00 expref: 348 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.715985:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dbc825d3/0x3234de053c4d7f8 lrc: 4/0,0 mode: PR/PR res: [0x2b9eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1126 expref: 348 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.715988:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002a957ba7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997048704:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.715989:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000007fba516 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997048768:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.715998:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ff7bf023 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.716003:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 000000007e004c12 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.716004:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212220 00000100:00100000:0.0:1651529344.716006:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1718:39029:x1731745946529216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.716009:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212221 00002000:00080000:0.0:1651529344.716010:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178669 count 1 00000100:00100000:1.0:1651529344.716011:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1718:39030:x1731745946529152:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.716014:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c5270c lrc: 3/0,1 mode: --/PW res: [0x2b9ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.716015:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178668 count 1 00010000:00010000:1.0:1651529344.716018:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52713 lrc: 3/0,1 mode: --/PW res: [0x2b9ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.716018:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c4d597 lrc: 2/0,0 mode: PR/PR res: [0x2b9ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d07ef expref: 348 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.716021:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.716021:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.716022:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000087e237b3/0x3234de053c4f16d lrc: 2/0,0 mode: PR/PR res: [0x2b9ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d784a expref: 348 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.716022:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c5270c lrc: 4/0,1 mode: --/PW res: [0x2b9ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.716026:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.716026:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.716027:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52713 lrc: 4/0,1 mode: --/PW res: [0x2b9ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.716028:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c4d597 lrc: 3/0,0 mode: PR/PR res: [0x2b9ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d07ef expref: 348 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.716031:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c4d597 lrc: 4/0,0 mode: PR/PR res: [0x2b9ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d07ef expref: 348 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.716033:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000087e237b3/0x3234de053c4f16d lrc: 3/0,0 mode: PR/PR res: [0x2b9ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d784a expref: 348 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.716035:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000059363096 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997048832:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.716037:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000087e237b3/0x3234de053c4f16d lrc: 4/0,0 mode: PR/PR res: [0x2b9ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d784a expref: 348 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.716041:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997048896:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.716041:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c0dff858 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.716047:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000089d75f07 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.716047:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212222 00000100:00100000:0.0:1651529344.716048:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1718:39029:x1731745946529344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.716052:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212223 00002000:00080000:0.0:1651529344.716052:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178671 count 1 00000100:00100000:1.0:1651529344.716054:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1718:39030:x1731745946529280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.716055:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c5271a lrc: 3/0,1 mode: --/PW res: [0x2b9ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.716058:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178670 count 1 00010000:00010000:1.0:1651529344.716061:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52721 lrc: 3/0,1 mode: --/PW res: [0x2b9ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.716061:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004f78a720/0x3234de053c4e2f6 lrc: 2/0,0 mode: PR/PR res: [0x2b9ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3cdf expref: 348 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.716064:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.716065:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001abf63f1/0x3234de053c4e5b9 lrc: 2/0,0 mode: PR/PR res: [0x2b9ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d483f expref: 348 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.716065:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.716065:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c5271a lrc: 4/0,1 mode: --/PW res: [0x2b9ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.716068:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.716068:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.716069:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52721 lrc: 4/0,1 mode: --/PW res: [0x2b9ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.716071:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004f78a720/0x3234de053c4e2f6 lrc: 3/0,0 mode: PR/PR res: [0x2b9ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3cdf expref: 348 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.716075:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001abf63f1/0x3234de053c4e5b9 lrc: 3/0,0 mode: PR/PR res: [0x2b9ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d483f expref: 348 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.716075:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004f78a720/0x3234de053c4e2f6 lrc: 4/0,0 mode: PR/PR res: [0x2b9ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3cdf expref: 348 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.716078:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cee35a0c pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997048960:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.716081:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001abf63f1/0x3234de053c4e5b9 lrc: 4/0,0 mode: PR/PR res: [0x2b9ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d483f expref: 348 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.716084:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000050bbb886 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997049024:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.716084:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 000000003ad73843 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.716090:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212224 00000100:00100000:1.0:1651529344.716091:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.716091:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1718:39030:x1731745946529408:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.716095:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178672 count 1 00010000:00010000:0.0:1651529344.716098:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c52728 lrc: 3/0,1 mode: --/PW res: [0x2b9f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.716102:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002ce3ca2f/0x3234de053c4d287 lrc: 2/0,0 mode: PR/PR res: [0x2b9f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb77 expref: 348 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.716105:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.716106:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.716106:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c52728 lrc: 4/0,1 mode: --/PW res: [0x2b9f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.716112:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002ce3ca2f/0x3234de053c4d287 lrc: 3/0,0 mode: PR/PR res: [0x2b9f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb77 expref: 348 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.716116:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002ce3ca2f/0x3234de053c4d287 lrc: 4/0,0 mode: PR/PR res: [0x2b9f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb77 expref: 348 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.716119:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ffb5d0a pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997049088:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.716126:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aac87b31 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.716320:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004be0190 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997048640:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.716329:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c526f7 lrc: 3/0,1 mode: --/PW res: [0x2b9e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.716370:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002a957ba7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997048704:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.716374:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c526fe lrc: 3/0,1 mode: --/PW res: [0x2b9ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.716378:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000007fba516 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997048768:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.716382:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52705 lrc: 3/0,1 mode: --/PW res: [0x2b9eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.716657:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.716676:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.716681:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997048896:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.716683:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.716684:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52713 lrc: 3/0,1 mode: --/PW res: [0x2b9ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.716701:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396410176 00000100:00100000:0.0:1651529344.716705:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.716706:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000068ac235c/0x3234de053c4cb64 lrc: 4/0,0 mode: PR/PR res: [0x2b9ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf00 expref: 349 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.716714:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.716717:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396410112 00000100:00100000:0.0:1651529344.716718:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.716720:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006fe51d44/0x3234de053c4ee72 lrc: 4/0,0 mode: PR/PR res: [0x2b9e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6bee expref: 350 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.716723:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.716726:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396410240 00010000:00010000:1.0:1651529344.716728:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dbc825d3/0x3234de053c4d7f8 lrc: 4/0,0 mode: PR/PR res: [0x2b9eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1126 expref: 351 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.716729:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.716732:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396410304 00010000:00010000:1.0:1651529344.716744:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c4d597 lrc: 4/0,0 mode: PR/PR res: [0x2b9ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d07ef expref: 352 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.716745:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000059363096 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997048832:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.716749:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396410432 00010000:00010000:0.0:1651529344.716749:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c5270c lrc: 3/0,1 mode: --/PW res: [0x2b9ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.716752:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004f78a720/0x3234de053c4e2f6 lrc: 5/0,0 mode: PR/PR res: [0x2b9ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3cdf expref: 353 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.716756:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396410560 00010000:00010000:1.0:1651529344.716757:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002ce3ca2f/0x3234de053c4d287 lrc: 5/0,0 mode: PR/PR res: [0x2b9f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb77 expref: 354 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.716759:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cee35a0c pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997048960:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.716761:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396410368 00010000:00010000:0.0:1651529344.716762:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c5271a lrc: 3/0,1 mode: --/PW res: [0x2b9ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.716763:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000087e237b3/0x3234de053c4f16d lrc: 4/0,0 mode: PR/PR res: [0x2b9ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d784a expref: 355 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.716767:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396410496 00000100:00100000:0.0:1651529344.716768:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ffb5d0a pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997049088:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.716769:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001abf63f1/0x3234de053c4e5b9 lrc: 5/0,0 mode: PR/PR res: [0x2b9ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d483f expref: 356 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.716770:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c52728 lrc: 3/0,1 mode: --/PW res: [0x2b9f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.716773:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12999 00000100:00100000:1.0:1651529344.716775:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+356:41278:x1731746396410176:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.716776:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13000 00000100:00100000:0.0:1651529344.716778:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+356:41278:x1731746396410112:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.716779:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.716780:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000068ac235c/0x3234de053c4cb64 lrc: 4/0,0 mode: PR/PR res: [0x2b9ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf00 expref: 356 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.716782:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.716784:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000068ac235c/0x3234de053c4cb64 lrc: 3/0,0 mode: PR/PR res: [0x2b9ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf00 expref: 356 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.716784:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006fe51d44/0x3234de053c4ee72 lrc: 4/0,0 mode: PR/PR res: [0x2b9e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6bee expref: 356 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.716788:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006fe51d44/0x3234de053c4ee72 lrc: 3/0,0 mode: PR/PR res: [0x2b9e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6bee expref: 356 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.716790:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068ac235c/0x3234de053c4cb64 lrc: 0/0,0 mode: --/PR res: [0x2b9ea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdf00 expref: 356 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.716793:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.716794:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.716794:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006fe51d44/0x3234de053c4ee72 lrc: 0/0,0 mode: --/PR res: [0x2b9e9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6bee expref: 355 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.716795:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c526fe lrc: 3/0,1 mode: PW/PW res: [0x2b9ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.716797:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.716798:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c526fe lrc: 4/0,1 mode: PW/PW res: [0x2b9ea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.716798:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.716799:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c526f7 lrc: 3/0,1 mode: PW/PW res: [0x2b9e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.716804:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c526f7 lrc: 4/0,1 mode: PW/PW res: [0x2b9e9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.716807:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.716817:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+354:41278:x1731746396410176:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (160us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.716821:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.716825:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12999 00000100:00100000:0.0:1651529344.716828:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+353:41278:x1731746396410112:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 49us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.716830:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13001 00000100:00100000:1.0:1651529344.716833:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+353:41278:x1731746396410240:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.716833:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13000 00010000:00010000:1.0:1651529344.716836:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.716837:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dbc825d3/0x3234de053c4d7f8 lrc: 4/0,0 mode: PR/PR res: [0x2b9eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1126 expref: 352 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.716839:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13002 00000100:00100000:0.0:1651529344.716841:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bbea9917 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+352:41278:x1731746396410304:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.716843:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dbc825d3/0x3234de053c4d7f8 lrc: 3/0,0 mode: PR/PR res: [0x2b9eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1126 expref: 352 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.716844:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.716845:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c4d597 lrc: 4/0,0 mode: PR/PR res: [0x2b9ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d07ef expref: 352 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.716848:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dbc825d3/0x3234de053c4d7f8 lrc: 0/0,0 mode: --/PR res: [0x2b9eb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1126 expref: 352 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.716849:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c4d597 lrc: 3/0,0 mode: PR/PR res: [0x2b9ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d07ef expref: 352 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.716851:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.716852:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.716853:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52705 lrc: 3/0,1 mode: PW/PW res: [0x2b9eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.716854:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c4d597 lrc: 0/0,0 mode: --/PR res: [0x2b9ed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d07ef expref: 351 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.716856:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52705 lrc: 4/0,1 mode: PW/PW res: [0x2b9eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.716858:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.716858:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.716859:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c5270c lrc: 3/0,1 mode: PW/PW res: [0x2b9ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.716862:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.716862:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c5270c lrc: 4/0,1 mode: PW/PW res: [0x2b9ed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.716867:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+350:41278:x1731746396410240:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 35us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.716870:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13001 00010000:00010000:0.0:1651529344.716871:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.716874:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13003 00000100:00100000:1.0:1651529344.716875:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+349:41278:x1731746396410432:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.716876:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bbea9917 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+349:41278:x1731746396410304:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 34us (170us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.716877:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.716878:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13002 00010000:00010000:1.0:1651529344.716879:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004f78a720/0x3234de053c4e2f6 lrc: 4/0,0 mode: PR/PR res: [0x2b9ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3cdf expref: 349 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.716882:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004f78a720/0x3234de053c4e2f6 lrc: 3/0,0 mode: PR/PR res: [0x2b9ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3cdf expref: 348 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.716886:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13004 00010000:00010000:1.0:1651529344.716887:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f78a720/0x3234de053c4e2f6 lrc: 0/0,0 mode: --/PR res: [0x2b9ef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3cdf expref: 348 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.716888:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+348:41278:x1731746396410560:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.716890:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.716891:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.716891:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c5271a lrc: 3/0,1 mode: PW/PW res: [0x2b9ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.716891:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.716892:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002ce3ca2f/0x3234de053c4d287 lrc: 4/0,0 mode: PR/PR res: [0x2b9f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb77 expref: 347 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.716894:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c5271a lrc: 4/0,1 mode: PW/PW res: [0x2b9ef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.716896:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002ce3ca2f/0x3234de053c4d287 lrc: 3/0,0 mode: PR/PR res: [0x2b9f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb77 expref: 347 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.716900:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ce3ca2f/0x3234de053c4d287 lrc: 0/0,0 mode: --/PR res: [0x2b9f0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb77 expref: 347 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.716904:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.716909:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+347:41278:x1731746396410432:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (195us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.716911:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.716911:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.716912:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13003 00010000:00010000:0.0:1651529344.716912:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c52728 lrc: 3/0,1 mode: PW/PW res: [0x2b9f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.716915:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c52728 lrc: 4/0,1 mode: PW/PW res: [0x2b9f0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.716916:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13005 00000100:00100000:1.0:1651529344.716917:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+345:41279:x1731746396410368:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.716920:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.716921:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000087e237b3/0x3234de053c4f16d lrc: 4/0,0 mode: PR/PR res: [0x2b9ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d784a expref: 345 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.716921:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.716925:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000087e237b3/0x3234de053c4f16d lrc: 3/0,0 mode: PR/PR res: [0x2b9ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d784a expref: 345 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.716927:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+345:41278:x1731746396410560:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (208us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.716929:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087e237b3/0x3234de053c4f16d lrc: 0/0,0 mode: --/PR res: [0x2b9ec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d784a expref: 345 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.716929:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13004 00000100:00100000:0.0:1651529344.716934:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13006 00010000:00010000:1.0:1651529344.716935:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.716935:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.716936:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52713 lrc: 3/0,1 mode: PW/PW res: [0x2b9ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.716936:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+343:41279:x1731746396410496:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.716938:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.716939:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52713 lrc: 4/0,1 mode: PW/PW res: [0x2b9ec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.716940:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001abf63f1/0x3234de053c4e5b9 lrc: 5/0,0 mode: PR/PR res: [0x2b9ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d483f expref: 343 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.716944:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001abf63f1/0x3234de053c4e5b9 lrc: 4/0,0 mode: PR/PR res: [0x2b9ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d483f expref: 343 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.716945:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.716948:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.716949:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+343:41279:x1731746396410368:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 31us (226us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.716949:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.716950:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52721 lrc: 3/0,1 mode: PW/PW res: [0x2b9ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.716952:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13005 00010000:00010000:0.0:1651529344.716953:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52721 lrc: 4/0,1 mode: PW/PW res: [0x2b9ee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.716956:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.716957:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52713 lrc: 3/0,1 mode: PW/PW res: [0x2b9ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.716960:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52713 lrc: 3/0,1 mode: PW/PW res: [0x2b9ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.716961:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+342:41279:x1731746396410496:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 24us (232us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.716963:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52713 lrc: 3/0,1 mode: PW/PW res: [0x2b9ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.716963:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13006 00010000:00010000:1.0:1651529344.716966:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52713 lrc: 2/0,0 mode: PW/PW res: [0x2b9ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.716969:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c526fe lrc: 3/0,1 mode: PW/PW res: [0x2b9ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.716972:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c526fe lrc: 3/0,1 mode: PW/PW res: [0x2b9ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.716983:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c526fe lrc: 3/0,1 mode: PW/PW res: [0x2b9ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.716986:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c526fe lrc: 2/0,0 mode: PW/PW res: [0x2b9ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.717013:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1720:39030:x1731745946529152:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1001us (1117us total) trans 12885080272 rc 0/0 00000100:00100000:1.0:1651529344.717016:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212221 00010000:00010000:1.0:1651529344.717028:0:80278:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001abf63f1/0x3234de053c4e5b9 lrc: 0/0,0 mode: --/PR res: [0x2b9ee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d483f expref: 341 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.717032:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000050bbb886 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997049024:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.717034:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1719:39030:x1731745946529024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1080us (1164us total) trans 12885080273 rc 0/0 00010000:00010000:1.0:1651529344.717036:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52721 lrc: 3/0,1 mode: PW/PW res: [0x2b9ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.717038:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212218 00010000:00010000:1.0:1651529344.717039:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52721 lrc: 3/0,1 mode: PW/PW res: [0x2b9ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.717042:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52721 lrc: 3/0,1 mode: PW/PW res: [0x2b9ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.717045:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52721 lrc: 3/0,1 mode: PW/PW res: [0x2b9ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.717045:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52713 lrc: 2/0,0 mode: PW/PW res: [0x2b9ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.717047:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52721 lrc: 2/0,0 mode: PW/PW res: [0x2b9ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.717048:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000820e505a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.717049:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52713 lrc: 2/0,0 mode: PW/PW res: [0x2b9ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.717052:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52713 lrc: 3/0,0 mode: PW/PW res: [0x2b9ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.717056:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52713 lrc: 1/0,0 mode: --/PW res: [0x2b9ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.717059:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52713 lrc: 0/0,0 mode: --/PW res: [0x2b9ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.717064:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c526fe lrc: 2/0,0 mode: PW/PW res: [0x2b9ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.717067:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008517b233 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.717068:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c526fe lrc: 2/0,0 mode: PW/PW res: [0x2b9ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.717070:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c526fe lrc: 3/0,0 mode: PW/PW res: [0x2b9ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.717073:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c526fe lrc: 1/0,0 mode: --/PW res: [0x2b9ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.717076:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c526fe lrc: 0/0,0 mode: --/PW res: [0x2b9ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.717079:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52721 lrc: 2/0,0 mode: PW/PW res: [0x2b9ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.717082:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003551d5d1 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.717083:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1719:39030:x1731745946529280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1028us (1173us total) trans 12885080274 rc 0/0 00010000:00010000:0.0:1651529344.717083:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52721 lrc: 2/0,0 mode: PW/PW res: [0x2b9ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.717085:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52721 lrc: 3/0,0 mode: PW/PW res: [0x2b9ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.717086:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212223 00010000:00010000:0.0:1651529344.717088:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52721 lrc: 1/0,0 mode: --/PW res: [0x2b9ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.717091:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52721 lrc: 0/0,0 mode: --/PW res: [0x2b9ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.717093:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52705 lrc: 3/0,1 mode: PW/PW res: [0x2b9eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.717096:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52705 lrc: 3/0,1 mode: PW/PW res: [0x2b9eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.717097:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c52728 lrc: 3/0,1 mode: PW/PW res: [0x2b9f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.717100:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c52728 lrc: 3/0,1 mode: PW/PW res: [0x2b9f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.717102:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52705 lrc: 3/0,1 mode: PW/PW res: [0x2b9eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.717103:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c52728 lrc: 3/0,1 mode: PW/PW res: [0x2b9f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.717104:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52705 lrc: 2/0,0 mode: PW/PW res: [0x2b9eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.717106:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c52728 lrc: 2/0,0 mode: PW/PW res: [0x2b9f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.717135:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1720:39029:x1731745946529088:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1176us (1255us total) trans 12885080275 rc 0/0 00000100:00100000:1.0:1651529344.717138:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212219 00000100:00100000:0.0:1651529344.717142:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1719:39030:x1731745946529408:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1050us (1224us total) trans 12885080276 rc 0/0 00010000:00010000:1.0:1651529344.717144:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52705 lrc: 2/0,0 mode: PW/PW res: [0x2b9eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.717145:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212224 00010000:00010000:1.0:1651529344.717147:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008ac1e27e already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.717148:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52705 lrc: 2/0,0 mode: PW/PW res: [0x2b9eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.717151:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52705 lrc: 3/0,0 mode: PW/PW res: [0x2b9eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.717152:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c5271a lrc: 3/0,1 mode: PW/PW res: [0x2b9ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.717155:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c5271a lrc: 3/0,1 mode: PW/PW res: [0x2b9ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.717156:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52705 lrc: 1/0,0 mode: --/PW res: [0x2b9eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.717158:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52705 lrc: 0/0,0 mode: --/PW res: [0x2b9eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.717158:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c5271a lrc: 3/0,1 mode: PW/PW res: [0x2b9ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.717161:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c5271a lrc: 2/0,0 mode: PW/PW res: [0x2b9ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.717163:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c52728 lrc: 2/0,0 mode: PW/PW res: [0x2b9f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.717166:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000066921086 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.717167:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c52728 lrc: 2/0,0 mode: PW/PW res: [0x2b9f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.717169:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c52728 lrc: 3/0,0 mode: PW/PW res: [0x2b9f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.717172:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c52728 lrc: 1/0,0 mode: --/PW res: [0x2b9f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.717175:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c52728 lrc: 0/0,0 mode: --/PW res: [0x2b9f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.717179:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c5271a lrc: 2/0,0 mode: PW/PW res: [0x2b9ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.717181:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006401eb97 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.717182:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c5271a lrc: 2/0,0 mode: PW/PW res: [0x2b9ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.717184:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c5271a lrc: 3/0,0 mode: PW/PW res: [0x2b9ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.717188:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c5271a lrc: 1/0,0 mode: --/PW res: [0x2b9ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.717190:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c5271a lrc: 0/0,0 mode: --/PW res: [0x2b9ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.717194:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1719:39029:x1731745946529344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1145us (1291us total) trans 12885080277 rc 0/0 00010000:00010000:1.0:1651529344.717195:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c526f7 lrc: 3/0,1 mode: PW/PW res: [0x2b9e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.717197:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212222 00010000:00010000:1.0:1651529344.717198:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c526f7 lrc: 3/0,1 mode: PW/PW res: [0x2b9e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.717201:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c526f7 lrc: 3/0,1 mode: PW/PW res: [0x2b9e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.717204:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c526f7 lrc: 2/0,0 mode: PW/PW res: [0x2b9e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.717204:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c5270c lrc: 3/0,1 mode: PW/PW res: [0x2b9ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.717207:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c5270c lrc: 3/0,1 mode: PW/PW res: [0x2b9ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.717210:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c5270c lrc: 3/0,1 mode: PW/PW res: [0x2b9ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.717213:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c5270c lrc: 2/0,0 mode: PW/PW res: [0x2b9ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.717256:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1720:39029:x1731745946528960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1392us (1417us total) trans 12885080278 rc 0/0 00000100:00100000:1.0:1651529344.717259:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212217 00010000:00010000:1.0:1651529344.717268:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c526f7 lrc: 2/0,0 mode: PW/PW res: [0x2b9e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.717269:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1719:39029:x1731745946529216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1262us (1381us total) trans 12885080279 rc 0/0 00010000:00010000:1.0:1651529344.717271:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f1b4c19f already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.717272:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c526f7 lrc: 2/0,0 mode: PW/PW res: [0x2b9e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.717273:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212220 00010000:00010000:1.0:1651529344.717275:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c526f7 lrc: 3/0,0 mode: PW/PW res: [0x2b9e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.717280:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c526f7 lrc: 1/0,0 mode: --/PW res: [0x2b9e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.717280:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c5270c lrc: 2/0,0 mode: PW/PW res: [0x2b9ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.717283:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c526f7 lrc: 0/0,0 mode: --/PW res: [0x2b9e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.717283:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001391dc6d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.717284:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c5270c lrc: 2/0,0 mode: PW/PW res: [0x2b9ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.717287:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c5270c lrc: 3/0,0 mode: PW/PW res: [0x2b9ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.717292:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c5270c lrc: 1/0,0 mode: --/PW res: [0x2b9ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.717295:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c5270c lrc: 0/0,0 mode: --/PW res: [0x2b9ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.717578:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.717614:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.717626:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946529472 00000100:00100000:1.0:1651529344.717638:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212225 00000100:00100000:1.0:1651529344.717645:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1719:39029:x1731745946529472:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.717645:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529344.717651:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178673 count 1 00000100:00100000:0.0:1651529344.717651:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.717661:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c5272f lrc: 3/0,1 mode: --/PW res: [0x2b9f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.717661:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.717669:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.717670:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000760b6950/0x3234de053c4d646 lrc: 2/0,0 mode: PR/PR res: [0x2b9f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ab9 expref: 340 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.717673:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.717674:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.717675:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c5272f lrc: 4/0,1 mode: --/PW res: [0x2b9f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.717677:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.717686:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000760b6950/0x3234de053c4d646 lrc: 3/0,0 mode: PR/PR res: [0x2b9f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ab9 expref: 340 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.717686:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.717690:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000760b6950/0x3234de053c4d646 lrc: 4/0,0 mode: PR/PR res: [0x2b9f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ab9 expref: 340 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.717694:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946529536 00000100:00100000:1.0:1651529344.717695:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000050bbb886 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997049152:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.717703:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946529600 00000100:00100000:0.0:1651529344.717708:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946529728 00000100:00100000:0.0:1651529344.717713:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946529664 00000100:00100000:0.0:1651529344.717716:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946529792 00000100:00100000:0.0:1651529344.717718:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946529856 00000100:00100000:1.0:1651529344.717720:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.717720:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946529920 00000100:00100000:0.0:1651529344.717723:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212226 00000100:00100000:0.0:1651529344.717724:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1726:39030:x1731745946529536:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.717727:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212227 00000100:00100000:1.0:1651529344.717729:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1726:39029:x1731745946529600:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.717730:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178674 count 1 00002000:00080000:1.0:1651529344.717733:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178675 count 1 00010000:00010000:0.0:1651529344.717743:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c52736 lrc: 3/0,1 mode: --/PW res: [0x2b9f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.717748:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c5273d lrc: 3/0,1 mode: --/PW res: [0x2b9f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.717748:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b2ae508d/0x3234de053c4aa78 lrc: 2/0,0 mode: PR/PR res: [0x2b9f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd88 expref: 340 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.717751:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.717752:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.717753:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004e503090/0x3234de053c4d711 lrc: 2/0,0 mode: PR/PR res: [0x2b9f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e01 expref: 340 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.717753:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c52736 lrc: 4/0,1 mode: --/PW res: [0x2b9f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.717756:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.717757:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.717757:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c5273d lrc: 4/0,1 mode: --/PW res: [0x2b9f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.717760:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b2ae508d/0x3234de053c4aa78 lrc: 3/0,0 mode: PR/PR res: [0x2b9f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd88 expref: 340 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.717763:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b2ae508d/0x3234de053c4aa78 lrc: 4/0,0 mode: PR/PR res: [0x2b9f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd88 expref: 340 pid: 151609 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.717764:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004e503090/0x3234de053c4d711 lrc: 3/0,0 mode: PR/PR res: [0x2b9f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e01 expref: 340 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.717767:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004e503090/0x3234de053c4d711 lrc: 4/0,0 mode: PR/PR res: [0x2b9f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e01 expref: 340 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.717768:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ffb5d0a pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997049216:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.717771:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997049280:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.717777:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e1aa6a77 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.717779:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c3caa148 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.717784:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212228 00000100:00100000:1.0:1651529344.717786:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212229 00000100:00100000:0.0:1651529344.717786:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1726:39029:x1731745946529728:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.717788:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1726:39030:x1731745946529664:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.717790:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178677 count 1 00002000:00080000:1.0:1651529344.717792:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178676 count 1 00010000:00010000:0.0:1651529344.717794:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c52744 lrc: 3/0,1 mode: --/PW res: [0x2b9f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.717796:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c5274b lrc: 3/0,1 mode: --/PW res: [0x2b9f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.717798:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007ad53d96/0x3234de053c4de3b lrc: 2/0,0 mode: PR/PR res: [0x2b9f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d29de expref: 340 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.717801:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.717802:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001fe2d1f7/0x3234de053c4e240 lrc: 2/0,0 mode: PR/PR res: [0x2b9f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a4d expref: 340 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.717802:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.717802:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c52744 lrc: 4/0,1 mode: --/PW res: [0x2b9f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.717805:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.717805:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.717806:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c5274b lrc: 4/0,1 mode: --/PW res: [0x2b9f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.717810:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007ad53d96/0x3234de053c4de3b lrc: 3/0,0 mode: PR/PR res: [0x2b9f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d29de expref: 340 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.717812:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001fe2d1f7/0x3234de053c4e240 lrc: 3/0,0 mode: PR/PR res: [0x2b9f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a4d expref: 340 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.717814:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007ad53d96/0x3234de053c4de3b lrc: 4/0,0 mode: PR/PR res: [0x2b9f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d29de expref: 340 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.717816:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001fe2d1f7/0x3234de053c4e240 lrc: 4/0,0 mode: PR/PR res: [0x2b9f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a4d expref: 340 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.717818:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cee35a0c pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997049344:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.717819:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000007fba516 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997049408:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.717824:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 0000000029ae2bb2 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.717826:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a6b79b05 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.717830:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212230 00000100:00100000:0.0:1651529344.717831:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1726:39030:x1731745946529792:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.717832:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212231 00000100:00100000:1.0:1651529344.717833:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008c9304ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1726:39029:x1731745946529856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.717835:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178678 count 1 00002000:00080000:1.0:1651529344.717837:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178679 count 1 00010000:00010000:0.0:1651529344.717838:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c52752 lrc: 3/0,1 mode: --/PW res: [0x2b9f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.717840:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52759 lrc: 3/0,1 mode: --/PW res: [0x2b9f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.717842:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c6649eef/0x3234de053c4f311 lrc: 2/0,0 mode: PR/PR res: [0x2b9f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ee1 expref: 340 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.717844:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1f7cde8/0x3234de053c4cdb7 lrc: 2/0,0 mode: PR/PR res: [0x2b9f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce876 expref: 340 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.717845:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.717846:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.717847:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.717847:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c52752 lrc: 4/0,1 mode: --/PW res: [0x2b9f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.717848:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.717848:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52759 lrc: 4/0,1 mode: --/PW res: [0x2b9f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.717853:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c6649eef/0x3234de053c4f311 lrc: 3/0,0 mode: PR/PR res: [0x2b9f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ee1 expref: 340 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.717854:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f1f7cde8/0x3234de053c4cdb7 lrc: 3/0,0 mode: PR/PR res: [0x2b9f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce876 expref: 340 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.717856:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c6649eef/0x3234de053c4f311 lrc: 4/0,0 mode: PR/PR res: [0x2b9f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ee1 expref: 340 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.717858:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f1f7cde8/0x3234de053c4cdb7 lrc: 4/0,0 mode: PR/PR res: [0x2b9f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce876 expref: 340 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.717860:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005914c920 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997049472:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.717862:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004be0190 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997049536:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.717866:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e7e12492 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.717868:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fb6c773d going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.717872:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212232 00000100:00100000:0.0:1651529344.717873:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1726:39030:x1731745946529920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.717877:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178680 count 1 00010000:00010000:0.0:1651529344.717880:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52760 lrc: 3/0,1 mode: --/PW res: [0x2b9f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.717884:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c4c678 lrc: 2/0,0 mode: PR/PR res: [0x2b9f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccbc7 expref: 340 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.717887:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.717887:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.717888:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52760 lrc: 4/0,1 mode: --/PW res: [0x2b9f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.717893:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c4c678 lrc: 3/0,0 mode: PR/PR res: [0x2b9f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccbc7 expref: 340 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.717897:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c4c678 lrc: 4/0,0 mode: PR/PR res: [0x2b9f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccbc7 expref: 340 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.717901:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dfc79d4e pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997049600:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.717907:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000504ef660 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.718356:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000050bbb886 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997049152:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.718361:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c5272f lrc: 3/0,1 mode: --/PW res: [0x2b9f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.718419:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.718420:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997049280:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.718427:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.718429:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c5273d lrc: 3/0,1 mode: --/PW res: [0x2b9f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.718436:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.718441:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396410688 00000100:00100000:0.0:1651529344.718444:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.718446:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b2ae508d/0x3234de053c4aa78 lrc: 5/0,0 mode: PR/PR res: [0x2b9f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd88 expref: 341 pid: 151609 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.718452:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.718457:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396410624 00000100:00100000:0.0:1651529344.718457:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.718460:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000760b6950/0x3234de053c4d646 lrc: 4/0,0 mode: PR/PR res: [0x2b9f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ab9 expref: 342 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.718462:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.718467:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396410816 00010000:00010000:1.0:1651529344.718469:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007ad53d96/0x3234de053c4de3b lrc: 5/0,0 mode: PR/PR res: [0x2b9f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d29de expref: 343 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.718471:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.718472:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396410752 00010000:00010000:1.0:1651529344.718474:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004e503090/0x3234de053c4d711 lrc: 4/0,0 mode: PR/PR res: [0x2b9f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e01 expref: 344 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.718478:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396410944 00000100:00100000:0.0:1651529344.718479:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ffb5d0a pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997049216:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.718480:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c6649eef/0x3234de053c4f311 lrc: 5/0,0 mode: PR/PR res: [0x2b9f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ee1 expref: 345 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.718484:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396410880 00010000:00010000:0.0:1651529344.718484:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c52736 lrc: 3/0,1 mode: --/PW res: [0x2b9f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.718486:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001fe2d1f7/0x3234de053c4e240 lrc: 5/0,0 mode: PR/PR res: [0x2b9f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a4d expref: 346 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.718490:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396411008 00000100:00100000:0.0:1651529344.718491:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cee35a0c pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997049344:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.718492:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f1f7cde8/0x3234de053c4cdb7 lrc: 5/0,0 mode: PR/PR res: [0x2b9f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce876 expref: 347 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.718494:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c52744 lrc: 3/0,1 mode: --/PW res: [0x2b9f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.718496:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396411072 00010000:00010000:1.0:1651529344.718497:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c4c678 lrc: 5/0,0 mode: PR/PR res: [0x2b9f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccbc7 expref: 348 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.718499:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005914c920 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997049472:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.718502:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13007 00010000:00010000:0.0:1651529344.718502:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c52752 lrc: 3/0,1 mode: --/PW res: [0x2b9f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.718503:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007fca8239 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+348:41278:x1731746396410688:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.718507:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.718508:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dfc79d4e pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997049600:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.718509:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b2ae508d/0x3234de053c4aa78 lrc: 4/0,0 mode: PR/PR res: [0x2b9f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd88 expref: 348 pid: 151609 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.718510:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52760 lrc: 3/0,1 mode: --/PW res: [0x2b9f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.718512:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b2ae508d/0x3234de053c4aa78 lrc: 3/0,0 mode: PR/PR res: [0x2b9f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd88 expref: 348 pid: 151609 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.718516:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13008 00010000:00010000:1.0:1651529344.718518:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2ae508d/0x3234de053c4aa78 lrc: 0/0,0 mode: --/PR res: [0x2b9f2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd88 expref: 348 pid: 151609 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.718518:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ea32140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+348:41279:x1731746396410624:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.718521:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.718522:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.718523:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c52736 lrc: 3/0,1 mode: PW/PW res: [0x2b9f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.718523:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.718525:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000760b6950/0x3234de053c4d646 lrc: 4/0,0 mode: PR/PR res: [0x2b9f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ab9 expref: 347 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.718526:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c52736 lrc: 4/0,1 mode: PW/PW res: [0x2b9f2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.718529:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000760b6950/0x3234de053c4d646 lrc: 3/0,0 mode: PR/PR res: [0x2b9f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ab9 expref: 347 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.718536:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.718541:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000760b6950/0x3234de053c4d646 lrc: 0/0,0 mode: --/PR res: [0x2b9f1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0ab9 expref: 347 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.718546:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007fca8239 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+346:41278:x1731746396410688:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (128us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.718546:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.718546:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.718547:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c5272f lrc: 3/0,1 mode: PW/PW res: [0x2b9f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.718549:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13007 00010000:00010000:0.0:1651529344.718550:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c5272f lrc: 4/0,1 mode: PW/PW res: [0x2b9f1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.718554:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13009 00000100:00100000:1.0:1651529344.718555:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d9169e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+345:41278:x1731746396410816:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.718559:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.718564:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.718566:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007ad53d96/0x3234de053c4de3b lrc: 4/0,0 mode: PR/PR res: [0x2b9f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d29de expref: 345 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.718567:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ea32140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+345:41279:x1731746396410624:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 48us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.718570:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13008 00010000:00010000:1.0:1651529344.718572:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007ad53d96/0x3234de053c4de3b lrc: 3/0,0 mode: PR/PR res: [0x2b9f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d29de expref: 345 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.718576:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13010 00010000:00010000:1.0:1651529344.718577:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ad53d96/0x3234de053c4de3b lrc: 0/0,0 mode: --/PR res: [0x2b9f5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d29de expref: 344 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.718577:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+344:41279:x1731746396410752:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.718580:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.718580:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.718581:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.718582:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c52744 lrc: 3/0,1 mode: PW/PW res: [0x2b9f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.718582:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004e503090/0x3234de053c4d711 lrc: 4/0,0 mode: PR/PR res: [0x2b9f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e01 expref: 343 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.718584:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c52744 lrc: 4/0,1 mode: PW/PW res: [0x2b9f5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.718588:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004e503090/0x3234de053c4d711 lrc: 3/0,0 mode: PR/PR res: [0x2b9f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e01 expref: 343 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.718593:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.718599:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d9169e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+343:41278:x1731746396410816:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 43us (162us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.718599:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e503090/0x3234de053c4d711 lrc: 0/0,0 mode: --/PR res: [0x2b9f3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e01 expref: 343 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.718601:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13009 00010000:00010000:0.0:1651529344.718603:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.718603:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.718604:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c5273d lrc: 3/0,1 mode: PW/PW res: [0x2b9f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.718607:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c5273d lrc: 4/0,1 mode: PW/PW res: [0x2b9f3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.718610:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13011 00000100:00100000:1.0:1651529344.718612:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+341:41278:x1731746396410944:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.718616:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.718621:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.718622:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c6649eef/0x3234de053c4f311 lrc: 4/0,0 mode: PR/PR res: [0x2b9f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ee1 expref: 341 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.718622:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+341:41279:x1731746396410752:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 44us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.718624:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13010 00010000:00010000:1.0:1651529344.718626:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c6649eef/0x3234de053c4f311 lrc: 3/0,0 mode: PR/PR res: [0x2b9f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ee1 expref: 341 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.718629:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13012 00000100:00100000:0.0:1651529344.718631:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+340:41279:x1731746396410880:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.718632:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6649eef/0x3234de053c4f311 lrc: 0/0,0 mode: --/PR res: [0x2b9f6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7ee1 expref: 340 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.718633:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.718635:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.718635:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001fe2d1f7/0x3234de053c4e240 lrc: 5/0,0 mode: PR/PR res: [0x2b9f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a4d expref: 340 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.718636:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.718637:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c52752 lrc: 3/0,1 mode: PW/PW res: [0x2b9f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.718638:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001fe2d1f7/0x3234de053c4e240 lrc: 4/0,0 mode: PR/PR res: [0x2b9f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a4d expref: 339 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.718640:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c52752 lrc: 4/0,1 mode: PW/PW res: [0x2b9f6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.718643:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.718644:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.718644:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c5274b lrc: 3/0,1 mode: PW/PW res: [0x2b9f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.718648:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.718654:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+339:41278:x1731746396410944:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (202us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.718654:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c5274b lrc: 4/0,1 mode: PW/PW res: [0x2b9f4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.718656:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13011 00010000:00010000:0.0:1651529344.718658:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.718661:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13013 00000100:00100000:1.0:1651529344.718663:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+338:41279:x1731746396411008:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.718664:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+338:41279:x1731746396410880:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (207us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.718665:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.718666:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f1f7cde8/0x3234de053c4cdb7 lrc: 5/0,0 mode: PR/PR res: [0x2b9f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce876 expref: 338 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.718666:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13012 00010000:00010000:1.0:1651529344.718670:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f1f7cde8/0x3234de053c4cdb7 lrc: 4/0,0 mode: PR/PR res: [0x2b9f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce876 expref: 337 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.718671:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13014 00000100:00100000:0.0:1651529344.718672:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+337:41278:x1731746396411072:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.718675:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.718675:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.718675:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.718676:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52759 lrc: 3/0,1 mode: PW/PW res: [0x2b9f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.718676:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c4c678 lrc: 4/0,0 mode: PR/PR res: [0x2b9f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccbc7 expref: 337 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.718679:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52759 lrc: 4/0,1 mode: PW/PW res: [0x2b9f7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.718680:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c4c678 lrc: 3/0,0 mode: PR/PR res: [0x2b9f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccbc7 expref: 337 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.718683:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.718684:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c4c678 lrc: 0/0,0 mode: --/PR res: [0x2b9f8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccbc7 expref: 337 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.718687:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+336:41279:x1731746396411008:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 24us (226us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.718688:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.718688:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.718689:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52760 lrc: 3/0,1 mode: PW/PW res: [0x2b9f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.718690:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13013 00010000:00010000:0.0:1651529344.718692:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52760 lrc: 4/0,1 mode: PW/PW res: [0x2b9f8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.718698:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.718699:0:72396:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fe2d1f7/0x3234de053c4e240 lrc: 0/0,0 mode: --/PR res: [0x2b9f4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3a4d expref: 335 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.718702:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+334:41278:x1731746396411072:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 29us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.718703:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000007fba516 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997049408:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.718705:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13014 00010000:00010000:1.0:1651529344.718706:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c5274b lrc: 3/0,1 mode: PW/PW res: [0x2b9f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.718709:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c5274b lrc: 3/0,1 mode: PW/PW res: [0x2b9f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.718710:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52760 lrc: 3/0,1 mode: PW/PW res: [0x2b9f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.718712:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c5274b lrc: 3/0,1 mode: PW/PW res: [0x2b9f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.718713:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52760 lrc: 3/0,1 mode: PW/PW res: [0x2b9f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.718715:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c5274b lrc: 3/0,1 mode: PW/PW res: [0x2b9f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.718716:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52760 lrc: 3/0,1 mode: PW/PW res: [0x2b9f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.718718:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c5274b lrc: 2/0,0 mode: PW/PW res: [0x2b9f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.718719:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52760 lrc: 2/0,0 mode: PW/PW res: [0x2b9f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.718783:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1728:39030:x1731745946529664:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 994us (1122us total) trans 12885080281 rc 0/0 00000100:00100000:0.0:1651529344.718783:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1728:39030:x1731745946529920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 909us (1096us total) trans 12885080280 rc 0/0 00000100:00100000:0.0:1651529344.718787:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212232 00000100:00100000:1.0:1651529344.718788:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212229 00010000:00010000:0.0:1651529344.718793:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52760 lrc: 2/0,0 mode: PW/PW res: [0x2b9f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.718796:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c5274b lrc: 2/0,0 mode: PW/PW res: [0x2b9f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.718796:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e48e0bfd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.718798:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52760 lrc: 2/0,0 mode: PW/PW res: [0x2b9f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.718800:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fc4c513 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.718801:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c5274b lrc: 2/0,0 mode: PW/PW res: [0x2b9f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.718801:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52760 lrc: 3/0,0 mode: PW/PW res: [0x2b9f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.718804:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c5274b lrc: 3/0,0 mode: PW/PW res: [0x2b9f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.718805:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52760 lrc: 1/0,0 mode: --/PW res: [0x2b9f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.718808:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c5274b lrc: 1/0,0 mode: --/PW res: [0x2b9f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.718808:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52760 lrc: 0/0,0 mode: --/PW res: [0x2b9f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.718811:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c5274b lrc: 0/0,0 mode: --/PW res: [0x2b9f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.718814:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c52752 lrc: 3/0,1 mode: PW/PW res: [0x2b9f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.718817:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c52752 lrc: 3/0,1 mode: PW/PW res: [0x2b9f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.718820:0:106695:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1f7cde8/0x3234de053c4cdb7 lrc: 0/0,0 mode: --/PR res: [0x2b9f7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce876 expref: 333 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.718820:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c52752 lrc: 3/0,1 mode: PW/PW res: [0x2b9f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.718823:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c52752 lrc: 2/0,0 mode: PW/PW res: [0x2b9f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.718824:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004be0190 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997049536:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.718827:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52759 lrc: 3/0,1 mode: PW/PW res: [0x2b9f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.718833:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52759 lrc: 3/0,1 mode: PW/PW res: [0x2b9f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.718836:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52759 lrc: 3/0,1 mode: PW/PW res: [0x2b9f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.718839:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52759 lrc: 3/0,1 mode: PW/PW res: [0x2b9f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.718841:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52759 lrc: 2/0,0 mode: PW/PW res: [0x2b9f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.718865:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1728:39030:x1731745946529792:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1033us (1195us total) trans 12885080282 rc 0/0 00000100:00100000:0.0:1651529344.718868:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212230 00010000:00010000:0.0:1651529344.718875:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c52752 lrc: 2/0,0 mode: PW/PW res: [0x2b9f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.718879:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000090e99444 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.718880:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c52752 lrc: 2/0,0 mode: PW/PW res: [0x2b9f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.718881:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008c9304ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1727:39029:x1731745946529856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1047us (1204us total) trans 12885080283 rc 0/0 00010000:00010000:0.0:1651529344.718882:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c52752 lrc: 3/0,0 mode: PW/PW res: [0x2b9f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.718884:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212231 00010000:00010000:0.0:1651529344.718887:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c52752 lrc: 1/0,0 mode: --/PW res: [0x2b9f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.718889:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c52752 lrc: 0/0,0 mode: --/PW res: [0x2b9f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.718891:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c5273d lrc: 3/0,1 mode: PW/PW res: [0x2b9f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.718894:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c5273d lrc: 3/0,1 mode: PW/PW res: [0x2b9f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.718894:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52759 lrc: 2/0,0 mode: PW/PW res: [0x2b9f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.718896:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000091ee0f93 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.718897:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c5273d lrc: 3/0,1 mode: PW/PW res: [0x2b9f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.718897:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52759 lrc: 2/0,0 mode: PW/PW res: [0x2b9f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.718900:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c5273d lrc: 2/0,0 mode: PW/PW res: [0x2b9f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.718900:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52759 lrc: 3/0,0 mode: PW/PW res: [0x2b9f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.718903:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52759 lrc: 1/0,0 mode: --/PW res: [0x2b9f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.718906:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52759 lrc: 0/0,0 mode: --/PW res: [0x2b9f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.718910:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c5273d lrc: 2/0,0 mode: PW/PW res: [0x2b9f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.718912:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000877aab61 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.718913:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c5273d lrc: 2/0,0 mode: PW/PW res: [0x2b9f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.718916:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c5273d lrc: 3/0,0 mode: PW/PW res: [0x2b9f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.718919:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c5273d lrc: 1/0,0 mode: --/PW res: [0x2b9f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.718921:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c5273d lrc: 0/0,0 mode: --/PW res: [0x2b9f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.718926:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c52744 lrc: 3/0,1 mode: PW/PW res: [0x2b9f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.718929:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c52744 lrc: 3/0,1 mode: PW/PW res: [0x2b9f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.718932:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1727:39029:x1731745946529600:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1203us (1287us total) trans 12885080284 rc 0/0 00010000:00010000:0.0:1651529344.718932:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c52744 lrc: 3/0,1 mode: PW/PW res: [0x2b9f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.718934:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c52744 lrc: 2/0,0 mode: PW/PW res: [0x2b9f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.718935:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212227 00010000:00010000:1.0:1651529344.718941:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c52744 lrc: 2/0,0 mode: PW/PW res: [0x2b9f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.718944:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bdf2b6c4 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.718945:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c52744 lrc: 2/0,0 mode: PW/PW res: [0x2b9f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.718948:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c52744 lrc: 3/0,0 mode: PW/PW res: [0x2b9f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.718952:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c52744 lrc: 1/0,0 mode: --/PW res: [0x2b9f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.718955:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c52744 lrc: 0/0,0 mode: --/PW res: [0x2b9f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.718962:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c5272f lrc: 3/0,1 mode: PW/PW res: [0x2b9f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.718965:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c5272f lrc: 3/0,1 mode: PW/PW res: [0x2b9f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.718968:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c5272f lrc: 3/0,1 mode: PW/PW res: [0x2b9f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.718969:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1727:39029:x1731745946529728:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1182us (1317us total) trans 12885080285 rc 0/0 00010000:00010000:1.0:1651529344.718971:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c5272f lrc: 2/0,0 mode: PW/PW res: [0x2b9f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.718972:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212228 00010000:00010000:0.0:1651529344.718978:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c52736 lrc: 3/0,1 mode: PW/PW res: [0x2b9f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.718982:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c52736 lrc: 3/0,1 mode: PW/PW res: [0x2b9f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.718985:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c52736 lrc: 3/0,1 mode: PW/PW res: [0x2b9f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.718987:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c52736 lrc: 2/0,0 mode: PW/PW res: [0x2b9f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.719004:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1728:39029:x1731745946529472:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1364us (1427us total) trans 12885080286 rc 0/0 00000100:00100000:1.0:1651529344.719007:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212225 00010000:00010000:1.0:1651529344.719013:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c5272f lrc: 2/0,0 mode: PW/PW res: [0x2b9f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.719016:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000046fea5cc already unused, calling callback (0000000049fddea7) 00000100:00100000:0.0:1651529344.719016:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1727:39030:x1731745946529536:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1291us (1411us total) trans 12885080287 rc 0/0 00010000:00010000:1.0:1651529344.719017:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c5272f lrc: 2/0,0 mode: PW/PW res: [0x2b9f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.719019:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212226 00010000:00010000:1.0:1651529344.719020:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c5272f lrc: 3/0,0 mode: PW/PW res: [0x2b9f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.719024:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c5272f lrc: 1/0,0 mode: --/PW res: [0x2b9f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.719027:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c5272f lrc: 0/0,0 mode: --/PW res: [0x2b9f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.719031:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c52736 lrc: 2/0,0 mode: PW/PW res: [0x2b9f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.719034:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000014fe598c already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.719035:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c52736 lrc: 2/0,0 mode: PW/PW res: [0x2b9f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.719037:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c52736 lrc: 3/0,0 mode: PW/PW res: [0x2b9f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.719041:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c52736 lrc: 1/0,0 mode: --/PW res: [0x2b9f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.719043:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c52736 lrc: 0/0,0 mode: --/PW res: [0x2b9f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.719288:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.719308:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946529984 00000100:00100000:0.0:1651529344.719320:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212233 00000100:00100000:0.0:1651529344.719321:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1727:39029:x1731745946529984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.719325:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529344.719327:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178681 count 1 00000100:00100000:1.0:1651529344.719335:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.719337:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52767 lrc: 3/0,1 mode: --/PW res: [0x2b9f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.719342:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.719342:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9bcfb2d/0x3234de053c49f96 lrc: 2/0,0 mode: PR/PR res: [0x2b9f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb466 expref: 332 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.719345:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.719346:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.719347:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52767 lrc: 4/0,1 mode: --/PW res: [0x2b9f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.719348:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.719356:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.719359:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e9bcfb2d/0x3234de053c49f96 lrc: 3/0,0 mode: PR/PR res: [0x2b9f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb466 expref: 332 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.719362:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.719363:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e9bcfb2d/0x3234de053c49f96 lrc: 4/0,0 mode: PR/PR res: [0x2b9f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb466 expref: 332 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.719371:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.719372:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000076d5f96b pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997049664:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.719381:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946530112 00000100:00100000:1.0:1651529344.719387:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946530240 00000100:00100000:0.0:1651529344.719387:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 0000000049203969 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.719391:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946530368 00000100:00100000:0.0:1651529344.719393:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946530048 00000100:00100000:1.0:1651529344.719394:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946530176 00000100:00100000:1.0:1651529344.719396:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946530304 00000100:00100000:0.0:1651529344.719398:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946530432 00000100:00100000:1.0:1651529344.719400:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212234 00000100:00100000:1.0:1651529344.719401:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1734:39029:x1731745946530112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.719402:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212235 00000100:00100000:0.0:1651529344.719404:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1734:39029:x1731745946530240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.719407:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178683 count 1 00002000:00080000:0.0:1651529344.719409:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178685 count 1 00010000:00010000:1.0:1651529344.719411:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c5276e lrc: 3/0,1 mode: --/PW res: [0x2b9fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.719412:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c52775 lrc: 3/0,1 mode: --/PW res: [0x2b9fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.719416:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ac02e23e/0x3234de053c4a5bd lrc: 2/0,0 mode: PR/PR res: [0x2b9fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb51 expref: 332 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.719416:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000894a0fac/0x3234de053c4c91f lrc: 2/0,0 mode: PR/PR res: [0x2b9fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd5d7 expref: 332 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.719419:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.719419:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.719420:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.719420:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.719421:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c5276e lrc: 4/0,1 mode: --/PW res: [0x2b9fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.719421:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c52775 lrc: 4/0,1 mode: --/PW res: [0x2b9fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.719427:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000894a0fac/0x3234de053c4c91f lrc: 3/0,0 mode: PR/PR res: [0x2b9fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd5d7 expref: 332 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.719428:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ac02e23e/0x3234de053c4a5bd lrc: 3/0,0 mode: PR/PR res: [0x2b9fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb51 expref: 332 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.719431:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ac02e23e/0x3234de053c4a5bd lrc: 4/0,0 mode: PR/PR res: [0x2b9fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb51 expref: 332 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.719431:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000894a0fac/0x3234de053c4c91f lrc: 4/0,0 mode: PR/PR res: [0x2b9fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd5d7 expref: 332 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.719435:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000be0ace91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997049728:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.719436:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000703c0db9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997049792:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.719441:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000504ef660 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.719445:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 0000000089d75f07 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.719447:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212236 00000100:00100000:0.0:1651529344.719449:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1734:39029:x1731745946530368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.719451:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212237 00000100:00100000:1.0:1651529344.719453:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1734:39029:x1731745946530176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.719453:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178687 count 1 00010000:00010000:0.0:1651529344.719456:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c5277c lrc: 3/0,1 mode: --/PW res: [0x2b9ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.719457:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178684 count 1 00010000:00010000:1.0:1651529344.719460:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52783 lrc: 3/0,1 mode: --/PW res: [0x2b9fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.719460:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c41a7e6c/0x3234de053c4e94e lrc: 2/0,0 mode: PR/PR res: [0x2b9ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d56a1 expref: 332 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.719463:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.719463:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.719464:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000067a5ac39/0x3234de053c4c004 lrc: 2/0,0 mode: PR/PR res: [0x2b9fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc783 expref: 332 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.719464:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c5277c lrc: 4/0,1 mode: --/PW res: [0x2b9ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.719467:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.719468:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.719469:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52783 lrc: 4/0,1 mode: --/PW res: [0x2b9fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.719469:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c41a7e6c/0x3234de053c4e94e lrc: 3/0,0 mode: PR/PR res: [0x2b9ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d56a1 expref: 332 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.719474:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000067a5ac39/0x3234de053c4c004 lrc: 3/0,0 mode: PR/PR res: [0x2b9fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc783 expref: 332 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.719476:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c41a7e6c/0x3234de053c4e94e lrc: 4/0,0 mode: PR/PR res: [0x2b9ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d56a1 expref: 332 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.719478:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000067a5ac39/0x3234de053c4c004 lrc: 4/0,0 mode: PR/PR res: [0x2b9fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc783 expref: 332 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.719479:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000066de8c9f pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997049856:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.719482:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a9b051f pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997049920:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.719485:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e7e12492 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.719488:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c3caa148 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.719491:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212238 00000100:00100000:0.0:1651529344.719492:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1734:39029:x1731745946530048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.719494:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212239 00000100:00100000:1.0:1651529344.719496:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1734:39029:x1731745946530304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.719496:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178682 count 1 00010000:00010000:0.0:1651529344.719499:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5278a lrc: 3/0,1 mode: --/PW res: [0x2b9fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.719500:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178686 count 1 00010000:00010000:1.0:1651529344.719503:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52791 lrc: 3/0,1 mode: --/PW res: [0x2b9fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.719503:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000823fb6ca/0x3234de053c4d01f lrc: 2/0,0 mode: PR/PR res: [0x2b9fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf1d0 expref: 332 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.719506:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.719506:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.719507:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000000a75ad7/0x3234de053c4db08 lrc: 2/0,0 mode: PR/PR res: [0x2b9fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c4e expref: 332 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.719507:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5278a lrc: 4/0,1 mode: --/PW res: [0x2b9fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.719510:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.719510:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.719511:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52791 lrc: 4/0,1 mode: --/PW res: [0x2b9fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.719513:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000823fb6ca/0x3234de053c4d01f lrc: 3/0,0 mode: PR/PR res: [0x2b9fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf1d0 expref: 332 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.719516:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000823fb6ca/0x3234de053c4d01f lrc: 4/0,0 mode: PR/PR res: [0x2b9fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf1d0 expref: 332 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.719517:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000000a75ad7/0x3234de053c4db08 lrc: 3/0,0 mode: PR/PR res: [0x2b9fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c4e expref: 332 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.719523:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000000a75ad7/0x3234de053c4db08 lrc: 4/0,0 mode: PR/PR res: [0x2b9fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c4e expref: 332 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.719523:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e7f02909 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997049984:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.719526:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000097928145 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997050048:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.719529:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 0000000029ae2bb2 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.719532:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 0000000053a0cffa going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.719534:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212240 00000100:00100000:0.0:1651529344.719536:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1734:39029:x1731745946530432:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.719539:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178688 count 1 00010000:00010000:0.0:1651529344.719542:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c52798 lrc: 3/0,1 mode: --/PW res: [0x2ba00:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.719546:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2a15bba/0x3234de053c4e3c8 lrc: 2/0,0 mode: PR/PR res: [0x2ba00:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4035 expref: 332 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.719550:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.719550:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.719551:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c52798 lrc: 4/0,1 mode: --/PW res: [0x2ba00:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.719556:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c2a15bba/0x3234de053c4e3c8 lrc: 3/0,0 mode: PR/PR res: [0x2ba00:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4035 expref: 332 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.719560:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c2a15bba/0x3234de053c4e3c8 lrc: 4/0,0 mode: PR/PR res: [0x2ba00:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4035 expref: 332 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.719564:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000824ca843 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997050112:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.719570:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e1aa6a77 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.720049:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000076d5f96b pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997049664:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.720072:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.720079:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52767 lrc: 3/0,1 mode: --/PW res: [0x2b9f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.720090:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.720101:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000066de8c9f pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997049856:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.720103:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.720104:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c5277c lrc: 3/0,1 mode: --/PW res: [0x2b9ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.720113:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.720118:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e7f02909 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997049984:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.720119:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.720120:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5278a lrc: 3/0,1 mode: --/PW res: [0x2b9fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.720124:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.720126:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000be0ace91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997049728:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.720129:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c52775 lrc: 3/0,1 mode: --/PW res: [0x2b9fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.720135:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396411200 00000100:00100000:1.0:1651529344.720140:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.720153:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000894a0fac/0x3234de053c4c91f lrc: 4/0,0 mode: PR/PR res: [0x2b9fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd5d7 expref: 333 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.720155:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000703c0db9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997049792:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.720160:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c5276e lrc: 3/0,1 mode: --/PW res: [0x2b9fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.720161:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396411328 00010000:00010000:0.0:1651529344.720164:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c41a7e6c/0x3234de053c4e94e lrc: 4/0,0 mode: PR/PR res: [0x2b9ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d56a1 expref: 334 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.720168:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a9b051f pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997049920:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.720168:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396411136 00010000:00010000:1.0:1651529344.720170:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52783 lrc: 3/0,1 mode: --/PW res: [0x2b9fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.720170:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e9bcfb2d/0x3234de053c49f96 lrc: 4/0,0 mode: PR/PR res: [0x2b9f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb466 expref: 335 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.720176:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396411456 00000100:00100000:0.0:1651529344.720177:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396411264 00010000:00010000:0.0:1651529344.720179:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ac02e23e/0x3234de053c4a5bd lrc: 4/0,0 mode: PR/PR res: [0x2b9fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb51 expref: 337 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.720181:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000823fb6ca/0x3234de053c4d01f lrc: 4/0,0 mode: PR/PR res: [0x2b9fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf1d0 expref: 337 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.720183:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396411392 00010000:00010000:0.0:1651529344.720185:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000067a5ac39/0x3234de053c4c004 lrc: 4/0,0 mode: PR/PR res: [0x2b9fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc783 expref: 338 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.720187:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396411520 00010000:00010000:1.0:1651529344.720189:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000000a75ad7/0x3234de053c4db08 lrc: 5/0,0 mode: PR/PR res: [0x2b9fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c4e expref: 339 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.720190:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13015 00000100:00100000:0.0:1651529344.720192:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+339:41278:x1731746396411200:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.720194:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13016 00010000:00010000:0.0:1651529344.720195:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.720196:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b5574957 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+339:41278:x1731746396411328:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.720196:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000894a0fac/0x3234de053c4c91f lrc: 4/0,0 mode: PR/PR res: [0x2b9fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd5d7 expref: 339 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.720199:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.720200:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000894a0fac/0x3234de053c4c91f lrc: 3/0,0 mode: PR/PR res: [0x2b9fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd5d7 expref: 339 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.720201:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c41a7e6c/0x3234de053c4e94e lrc: 4/0,0 mode: PR/PR res: [0x2b9ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d56a1 expref: 339 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.720204:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c41a7e6c/0x3234de053c4e94e lrc: 3/0,0 mode: PR/PR res: [0x2b9ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d56a1 expref: 339 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.720205:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000894a0fac/0x3234de053c4c91f lrc: 0/0,0 mode: --/PR res: [0x2b9fd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd5d7 expref: 339 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.720209:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.720209:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.720210:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c41a7e6c/0x3234de053c4e94e lrc: 0/0,0 mode: --/PR res: [0x2b9ff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d56a1 expref: 338 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.720210:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c52775 lrc: 3/0,1 mode: PW/PW res: [0x2b9fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.720213:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c52775 lrc: 4/0,1 mode: PW/PW res: [0x2b9fd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.720214:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.720214:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.720215:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c5277c lrc: 3/0,1 mode: PW/PW res: [0x2b9ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.720218:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c5277c lrc: 4/0,1 mode: PW/PW res: [0x2b9ff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.720246:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.720256:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b5574957 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+337:41278:x1731746396411328:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 59us (165us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.720256:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.720258:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13016 00000100:00100000:1.0:1651529344.720264:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13017 00000100:00100000:0.0:1651529344.720264:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+336:41278:x1731746396411200:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 72us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.720265:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+336:41279:x1731746396411136:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.720267:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13015 00010000:00010000:1.0:1651529344.720268:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.720270:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e9bcfb2d/0x3234de053c49f96 lrc: 4/0,0 mode: PR/PR res: [0x2b9f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb466 expref: 336 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.720274:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e9bcfb2d/0x3234de053c49f96 lrc: 3/0,0 mode: PR/PR res: [0x2b9f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb466 expref: 335 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.720277:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13018 00010000:00010000:1.0:1651529344.720279:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9bcfb2d/0x3234de053c49f96 lrc: 0/0,0 mode: --/PR res: [0x2b9f9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb466 expref: 335 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.720279:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+335:41279:x1731746396411264:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.720281:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.720282:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.720283:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.720283:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52767 lrc: 3/0,1 mode: PW/PW res: [0x2b9f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.720283:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ac02e23e/0x3234de053c4a5bd lrc: 4/0,0 mode: PR/PR res: [0x2b9fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb51 expref: 334 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.720286:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52767 lrc: 4/0,1 mode: PW/PW res: [0x2b9f9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.720287:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ac02e23e/0x3234de053c4a5bd lrc: 3/0,0 mode: PR/PR res: [0x2b9fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb51 expref: 334 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.720292:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac02e23e/0x3234de053c4a5bd lrc: 0/0,0 mode: --/PR res: [0x2b9fb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb51 expref: 334 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.720295:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.720301:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+334:41279:x1731746396411136:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 35us (198us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.720302:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.720303:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13017 00010000:00010000:0.0:1651529344.720303:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.720304:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c5276e lrc: 3/0,1 mode: PW/PW res: [0x2b9fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.720307:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c5276e lrc: 4/0,1 mode: PW/PW res: [0x2b9fb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.720308:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13019 00000100:00100000:1.0:1651529344.720309:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+332:41278:x1731746396411456:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.720312:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.720313:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000823fb6ca/0x3234de053c4d01f lrc: 4/0,0 mode: PR/PR res: [0x2b9fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf1d0 expref: 332 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.720316:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.720322:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+332:41279:x1731746396411264:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 43us (203us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.720323:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000823fb6ca/0x3234de053c4d01f lrc: 3/0,0 mode: PR/PR res: [0x2b9fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf1d0 expref: 332 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.720325:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13018 00010000:00010000:1.0:1651529344.720328:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000823fb6ca/0x3234de053c4d01f lrc: 0/0,0 mode: --/PR res: [0x2b9fa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf1d0 expref: 331 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.720330:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13020 00010000:00010000:1.0:1651529344.720332:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.720332:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+330:41279:x1731746396411392:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.720333:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.720333:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5278a lrc: 3/0,1 mode: PW/PW res: [0x2b9fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.720334:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.720336:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5278a lrc: 4/0,1 mode: PW/PW res: [0x2b9fa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.720336:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000067a5ac39/0x3234de053c4c004 lrc: 4/0,0 mode: PR/PR res: [0x2b9fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc783 expref: 330 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.720339:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000067a5ac39/0x3234de053c4c004 lrc: 3/0,0 mode: PR/PR res: [0x2b9fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc783 expref: 330 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.720345:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.720350:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+330:41278:x1731746396411456:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (237us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.720350:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067a5ac39/0x3234de053c4c004 lrc: 0/0,0 mode: --/PR res: [0x2b9fc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc783 expref: 330 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.720353:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13019 00010000:00010000:0.0:1651529344.720354:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.720354:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.720355:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52783 lrc: 3/0,1 mode: PW/PW res: [0x2b9fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.720357:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13021 00010000:00010000:0.0:1651529344.720358:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52783 lrc: 4/0,1 mode: PW/PW res: [0x2b9fc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.720359:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+328:41278:x1731746396411520:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.720361:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.720363:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000000a75ad7/0x3234de053c4db08 lrc: 5/0,0 mode: PR/PR res: [0x2b9fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c4e expref: 328 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.720366:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.720372:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+328:41279:x1731746396411392:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 39us (247us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.720373:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000000a75ad7/0x3234de053c4db08 lrc: 4/0,0 mode: PR/PR res: [0x2b9fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c4e expref: 328 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.720374:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13020 00010000:00010000:1.0:1651529344.720377:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.720378:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.720379:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52791 lrc: 3/0,1 mode: PW/PW res: [0x2b9fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.720381:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5278a lrc: 3/0,1 mode: PW/PW res: [0x2b9fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.720382:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52791 lrc: 4/0,1 mode: PW/PW res: [0x2b9fe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.720384:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5278a lrc: 3/0,1 mode: PW/PW res: [0x2b9fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.720386:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.720388:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5278a lrc: 3/0,1 mode: PW/PW res: [0x2b9fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.720390:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5278a lrc: 2/0,0 mode: PW/PW res: [0x2b9fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.720391:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+327:41278:x1731746396411520:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 31us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.720393:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13021 00010000:00010000:1.0:1651529344.720402:0:80279:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000a75ad7/0x3234de053c4db08 lrc: 0/0,0 mode: --/PR res: [0x2b9fe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c4e expref: 326 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.720406:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000097928145 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997050048:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.720409:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52791 lrc: 3/0,1 mode: PW/PW res: [0x2b9fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.720413:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52791 lrc: 3/0,1 mode: PW/PW res: [0x2b9fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.720415:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52791 lrc: 3/0,1 mode: PW/PW res: [0x2b9fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.720419:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52791 lrc: 3/0,1 mode: PW/PW res: [0x2b9fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.720422:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52791 lrc: 2/0,0 mode: PW/PW res: [0x2b9fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.720437:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1735:39029:x1731745946530048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 936us (1081us total) trans 12885080288 rc 0/0 00000100:00100000:0.0:1651529344.720440:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212238 00010000:00010000:0.0:1651529344.720447:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5278a lrc: 2/0,0 mode: PW/PW res: [0x2b9fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.720450:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004b2a6b06 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.720451:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5278a lrc: 2/0,0 mode: PW/PW res: [0x2b9fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.720454:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5278a lrc: 3/0,0 mode: PW/PW res: [0x2b9fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.720458:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5278a lrc: 1/0,0 mode: --/PW res: [0x2b9fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.720461:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5278a lrc: 0/0,0 mode: --/PW res: [0x2b9fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.720466:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52791 lrc: 2/0,0 mode: PW/PW res: [0x2b9fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.720468:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004dda5a3f already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.720469:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1735:39029:x1731745946530304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 972us (1106us total) trans 12885080289 rc 0/0 00010000:00010000:0.0:1651529344.720469:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52791 lrc: 2/0,0 mode: PW/PW res: [0x2b9fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.720472:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212239 00010000:00010000:0.0:1651529344.720472:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52791 lrc: 3/0,0 mode: PW/PW res: [0x2b9fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.720475:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52791 lrc: 1/0,0 mode: --/PW res: [0x2b9fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.720478:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52791 lrc: 0/0,0 mode: --/PW res: [0x2b9fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.720479:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52783 lrc: 3/0,1 mode: PW/PW res: [0x2b9fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.720482:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52783 lrc: 3/0,1 mode: PW/PW res: [0x2b9fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.720483:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c52775 lrc: 3/0,1 mode: PW/PW res: [0x2b9fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.720485:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52783 lrc: 3/0,1 mode: PW/PW res: [0x2b9fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.720486:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c52775 lrc: 3/0,1 mode: PW/PW res: [0x2b9fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.720488:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52783 lrc: 2/0,0 mode: PW/PW res: [0x2b9fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.720489:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c52775 lrc: 3/0,1 mode: PW/PW res: [0x2b9fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.720492:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c52775 lrc: 2/0,0 mode: PW/PW res: [0x2b9fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.720519:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1736:39029:x1731745946530176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1066us (1163us total) trans 12885080290 rc 0/0 00000100:00100000:1.0:1651529344.720522:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212237 00010000:00010000:1.0:1651529344.720528:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52783 lrc: 2/0,0 mode: PW/PW res: [0x2b9fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.720528:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1735:39029:x1731745946530240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1123us (1193us total) trans 12885080291 rc 0/0 00010000:00010000:1.0:1651529344.720531:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c5599f68 already unused, calling callback (0000000049fddea7) 00000100:00100000:0.0:1651529344.720531:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212235 00010000:00010000:1.0:1651529344.720532:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52783 lrc: 2/0,0 mode: PW/PW res: [0x2b9fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.720536:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52783 lrc: 3/0,0 mode: PW/PW res: [0x2b9fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.720538:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c5277c lrc: 3/0,1 mode: PW/PW res: [0x2b9ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.720540:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52783 lrc: 1/0,0 mode: --/PW res: [0x2b9fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.720541:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c5277c lrc: 3/0,1 mode: PW/PW res: [0x2b9ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.720543:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52783 lrc: 0/0,0 mode: --/PW res: [0x2b9fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.720545:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c5277c lrc: 3/0,1 mode: PW/PW res: [0x2b9ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.720547:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c52775 lrc: 2/0,0 mode: PW/PW res: [0x2b9fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.720547:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c5277c lrc: 2/0,0 mode: PW/PW res: [0x2b9ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.720550:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000029958df2 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.720551:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c52775 lrc: 2/0,0 mode: PW/PW res: [0x2b9fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.720553:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c52775 lrc: 3/0,0 mode: PW/PW res: [0x2b9fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.720557:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c52775 lrc: 1/0,0 mode: --/PW res: [0x2b9fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.720559:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c52775 lrc: 0/0,0 mode: --/PW res: [0x2b9fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.720563:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c5277c lrc: 2/0,0 mode: PW/PW res: [0x2b9ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.720568:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cd5f3a7c already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.720569:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c5277c lrc: 2/0,0 mode: PW/PW res: [0x2b9ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.720571:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c5277c lrc: 3/0,0 mode: PW/PW res: [0x2b9ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.720574:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c5277c lrc: 1/0,0 mode: --/PW res: [0x2b9ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.720577:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c5277c lrc: 0/0,0 mode: --/PW res: [0x2b9ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.720577:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1735:39029:x1731745946530368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1127us (1235us total) trans 12885080292 rc 0/0 00000100:00100000:0.0:1651529344.720580:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212236 00010000:00010000:1.0:1651529344.720582:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c5276e lrc: 3/0,1 mode: PW/PW res: [0x2b9fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.720585:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c5276e lrc: 3/0,1 mode: PW/PW res: [0x2b9fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.720587:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52767 lrc: 3/0,1 mode: PW/PW res: [0x2b9f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.720588:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c5276e lrc: 3/0,1 mode: PW/PW res: [0x2b9fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.720590:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c5276e lrc: 2/0,0 mode: PW/PW res: [0x2b9fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.720590:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52767 lrc: 3/0,1 mode: PW/PW res: [0x2b9f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.720593:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52767 lrc: 3/0,1 mode: PW/PW res: [0x2b9f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.720599:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52767 lrc: 2/0,0 mode: PW/PW res: [0x2b9f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.720623:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1736:39029:x1731745946530112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1221us (1310us total) trans 12885080293 rc 0/0 00000100:00100000:1.0:1651529344.720626:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212234 00000100:00100000:0.0:1651529344.720631:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1735:39029:x1731745946529984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1308us (1343us total) trans 12885080294 rc 0/0 00010000:00010000:1.0:1651529344.720633:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c5276e lrc: 2/0,0 mode: PW/PW res: [0x2b9fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.720633:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212233 00010000:00010000:1.0:1651529344.720636:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000048ee8765 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.720637:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c5276e lrc: 2/0,0 mode: PW/PW res: [0x2b9fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.720639:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52767 lrc: 2/0,0 mode: PW/PW res: [0x2b9f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.720640:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c5276e lrc: 3/0,0 mode: PW/PW res: [0x2b9fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.720643:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006cbd0d09 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.720644:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c5276e lrc: 1/0,0 mode: --/PW res: [0x2b9fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.720644:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52767 lrc: 2/0,0 mode: PW/PW res: [0x2b9f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.720646:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c5276e lrc: 0/0,0 mode: --/PW res: [0x2b9fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.720647:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52767 lrc: 3/0,0 mode: PW/PW res: [0x2b9f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.720651:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52767 lrc: 1/0,0 mode: --/PW res: [0x2b9f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.720654:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52767 lrc: 0/0,0 mode: --/PW res: [0x2b9f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.720684:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000824ca843 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997050112:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.720688:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c52798 lrc: 3/0,1 mode: --/PW res: [0x2ba00:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.720700:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.720794:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396411584 00010000:00010000:1.0:1651529344.720805:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a15bba/0x3234de053c4e3c8 lrc: 4/0,0 mode: PR/PR res: [0x2ba00:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4035 expref: 326 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.720814:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13022 00000100:00100000:1.0:1651529344.720816:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+326:41278:x1731746396411584:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.720819:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.720820:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c2a15bba/0x3234de053c4e3c8 lrc: 4/0,0 mode: PR/PR res: [0x2ba00:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4035 expref: 326 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.720824:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c2a15bba/0x3234de053c4e3c8 lrc: 3/0,0 mode: PR/PR res: [0x2ba00:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4035 expref: 326 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.720830:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2a15bba/0x3234de053c4e3c8 lrc: 0/0,0 mode: --/PR res: [0x2ba00:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4035 expref: 326 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.720833:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.720834:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.720835:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c52798 lrc: 3/0,1 mode: PW/PW res: [0x2ba00:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.720838:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c52798 lrc: 4/0,1 mode: PW/PW res: [0x2ba00:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.720847:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.720851:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c52798 lrc: 3/0,1 mode: PW/PW res: [0x2ba00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.720855:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c52798 lrc: 3/0,1 mode: PW/PW res: [0x2ba00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.720858:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+325:41278:x1731746396411584:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 41us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.720860:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13022 00010000:00010000:0.0:1651529344.720863:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c52798 lrc: 3/0,1 mode: PW/PW res: [0x2ba00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.720866:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c52798 lrc: 2/0,0 mode: PW/PW res: [0x2ba00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.720912:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1735:39029:x1731745946530432:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1375us (1541us total) trans 12885080295 rc 0/0 00000100:00100000:0.0:1651529344.720916:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212240 00010000:00010000:0.0:1651529344.720923:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c52798 lrc: 2/0,0 mode: PW/PW res: [0x2ba00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.720927:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dd6b1be4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.720928:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c52798 lrc: 2/0,0 mode: PW/PW res: [0x2ba00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.720930:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c52798 lrc: 3/0,0 mode: PW/PW res: [0x2ba00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.720935:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c52798 lrc: 1/0,0 mode: --/PW res: [0x2ba00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.720938:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c52798 lrc: 0/0,0 mode: --/PW res: [0x2ba00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.720993:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.721003:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946530496 00000100:00100000:1.0:1651529344.721004:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.721013:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.721029:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.721042:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.721048:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946530560 00000100:00100000:0.0:1651529344.721056:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946530624 00000100:00100000:0.0:1651529344.721061:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946530752 00000100:00100000:0.0:1651529344.721066:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946530688 00000100:00100000:0.0:1651529344.721072:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212241 00000100:00100000:0.0:1651529344.721074:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1739:39029:x1731745946530496:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.721079:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178689 count 1 00010000:00010000:0.0:1651529344.721083:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c5279f lrc: 3/0,1 mode: --/PW res: [0x2ba01:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.721085:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.721088:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000becec6a/0x3234de053c4d0b9 lrc: 2/0,0 mode: PR/PR res: [0x2ba01:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf48c expref: 324 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.721092:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.721092:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.721093:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c5279f lrc: 4/0,1 mode: --/PW res: [0x2ba01:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.721094:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.721100:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000becec6a/0x3234de053c4d0b9 lrc: 3/0,0 mode: PR/PR res: [0x2ba01:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf48c expref: 324 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.721101:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946530880 00010000:00010000:0.0:1651529344.721103:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000becec6a/0x3234de053c4d0b9 lrc: 4/0,0 mode: PR/PR res: [0x2ba01:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf48c expref: 324 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.721106:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946530816 00000100:00100000:1.0:1651529344.721109:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212242 00000100:00100000:1.0:1651529344.721111:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1741:39030:x1731745946530560:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.721111:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000824ca843 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997050176:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.721116:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178690 count 1 00010000:00010000:1.0:1651529344.721120:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c527a6 lrc: 3/0,1 mode: --/PW res: [0x2ba02:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.721125:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000db55a158/0x3234de053c4e7bf lrc: 2/0,0 mode: PR/PR res: [0x2ba02:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f77 expref: 324 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.721128:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.721129:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.721129:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c527a6 lrc: 4/0,1 mode: --/PW res: [0x2ba02:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.721136:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000db55a158/0x3234de053c4e7bf lrc: 3/0,0 mode: PR/PR res: [0x2ba02:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f77 expref: 324 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.721140:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 0000000049203969 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.721147:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000db55a158/0x3234de053c4e7bf lrc: 4/0,0 mode: PR/PR res: [0x2ba02:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f77 expref: 324 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.721147:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212243 00000100:00100000:0.0:1651529344.721149:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1741:39029:x1731745946530624:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.721152:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a223a622 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997050240:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.721154:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178691 count 1 00010000:00010000:0.0:1651529344.721157:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c527ad lrc: 3/0,1 mode: --/PW res: [0x2ba03:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.721161:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b7af823 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.721162:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001f005b0e/0x3234de053c4f381 lrc: 2/0,0 mode: PR/PR res: [0x2ba03:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80c4 expref: 324 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.721165:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.721166:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.721166:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c527ad lrc: 4/0,1 mode: --/PW res: [0x2ba03:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.721168:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212244 00000100:00100000:1.0:1651529344.721170:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1741:39029:x1731745946530752:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.721172:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001f005b0e/0x3234de053c4f381 lrc: 3/0,0 mode: PR/PR res: [0x2ba03:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80c4 expref: 324 pid: 72396 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.721174:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178693 count 1 00010000:00010000:0.0:1651529344.721176:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001f005b0e/0x3234de053c4f381 lrc: 4/0,0 mode: PR/PR res: [0x2ba03:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80c4 expref: 324 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.721177:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c527b4 lrc: 3/0,1 mode: --/PW res: [0x2ba05:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.721180:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fc130417 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997050304:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.721184:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003a1ec154/0x3234de053c4da52 lrc: 2/0,0 mode: PR/PR res: [0x2ba05:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d19ae expref: 324 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.721187:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.721188:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.721188:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c527b4 lrc: 4/0,1 mode: --/PW res: [0x2ba05:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.721188:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000504ef660 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.721194:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003a1ec154/0x3234de053c4da52 lrc: 3/0,0 mode: PR/PR res: [0x2ba05:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d19ae expref: 324 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.721194:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212245 00000100:00100000:0.0:1651529344.721196:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1741:39030:x1731745946530688:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.721198:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003a1ec154/0x3234de053c4da52 lrc: 4/0,0 mode: PR/PR res: [0x2ba05:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d19ae expref: 324 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:0.0:1651529344.721200:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178692 count 1 00000100:00100000:1.0:1651529344.721201:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000093ddaf92 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997050368:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.721202:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c527bb lrc: 3/0,1 mode: --/PW res: [0x2ba04:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.721207:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000063ccc731/0x3234de053c4da7c lrc: 2/0,0 mode: PR/PR res: [0x2ba04:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a64 expref: 324 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.721208:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 0000000053a0cffa going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.721209:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.721210:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.721211:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c527bb lrc: 4/0,1 mode: --/PW res: [0x2ba04:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.721213:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212246 00000100:00100000:1.0:1651529344.721215:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1741:39029:x1731745946530880:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.721216:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000063ccc731/0x3234de053c4da7c lrc: 3/0,0 mode: PR/PR res: [0x2ba04:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a64 expref: 324 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.721219:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178695 count 1 00010000:00010000:0.0:1651529344.721220:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000063ccc731/0x3234de053c4da7c lrc: 4/0,0 mode: PR/PR res: [0x2ba04:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a64 expref: 324 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.721221:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c527c2 lrc: 3/0,1 mode: --/PW res: [0x2ba07:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.721242:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ac8dec6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997050432:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.721243:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008d5b403f/0x3234de053c4e198 lrc: 2/0,0 mode: PR/PR res: [0x2ba07:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d37a6 expref: 324 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.721246:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.721247:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.721247:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c527c2 lrc: 4/0,1 mode: --/PW res: [0x2ba07:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.721250:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c4075652 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.721254:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008d5b403f/0x3234de053c4e198 lrc: 3/0,0 mode: PR/PR res: [0x2ba07:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d37a6 expref: 324 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.721256:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212247 00010000:00010000:1.0:1651529344.721257:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008d5b403f/0x3234de053c4e198 lrc: 4/0,0 mode: PR/PR res: [0x2ba07:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d37a6 expref: 324 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.721258:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1741:39030:x1731745946530816:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.721261:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a13808c6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997050496:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.721262:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178694 count 1 00010000:00010000:0.0:1651529344.721266:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c527c9 lrc: 3/0,1 mode: --/PW res: [0x2ba06:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.721269:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 0000000089d75f07 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.721273:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001c7986d5/0x3234de053c4e278 lrc: 2/0,0 mode: PR/PR res: [0x2ba06:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b3b expref: 324 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.721276:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.721277:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.721277:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c527c9 lrc: 4/0,1 mode: --/PW res: [0x2ba06:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.721283:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001c7986d5/0x3234de053c4e278 lrc: 3/0,0 mode: PR/PR res: [0x2ba06:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b3b expref: 324 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.721287:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001c7986d5/0x3234de053c4e278 lrc: 4/0,0 mode: PR/PR res: [0x2ba06:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b3b expref: 324 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.721288:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.721291:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000533fe698 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997050560:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.721297:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e7e12492 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.721302:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946530944 00000100:00100000:0.0:1651529344.721313:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212248 00000100:00100000:0.0:1651529344.721314:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1742:39030:x1731745946530944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.721318:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178696 count 1 00010000:00010000:0.0:1651529344.721322:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c527d0 lrc: 3/0,1 mode: --/PW res: [0x2ba08:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.721326:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005e56573c/0x3234de053c4ba46 lrc: 2/0,0 mode: PR/PR res: [0x2ba08:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc4c0 expref: 324 pid: 80280 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.721332:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.721332:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.721333:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c527d0 lrc: 4/0,1 mode: --/PW res: [0x2ba08:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.721339:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005e56573c/0x3234de053c4ba46 lrc: 3/0,0 mode: PR/PR res: [0x2ba08:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc4c0 expref: 324 pid: 80280 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.721342:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005e56573c/0x3234de053c4ba46 lrc: 4/0,0 mode: PR/PR res: [0x2ba08:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc4c0 expref: 324 pid: 80280 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.721346:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ebb53b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997050624:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.721368:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 0000000009370c1d going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.721500:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000824ca843 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997050176:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.721505:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c5279f lrc: 3/0,1 mode: --/PW res: [0x2ba01:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.721536:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a223a622 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997050240:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.721541:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c527a6 lrc: 3/0,1 mode: --/PW res: [0x2ba02:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.721790:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000093ddaf92 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997050368:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.721794:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c527b4 lrc: 3/0,1 mode: --/PW res: [0x2ba05:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.721806:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a13808c6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997050496:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.721809:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c527c2 lrc: 3/0,1 mode: --/PW res: [0x2ba07:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.721844:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.721855:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396411648 00010000:00010000:1.0:1651529344.721861:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000becec6a/0x3234de053c4d0b9 lrc: 4/0,0 mode: PR/PR res: [0x2ba01:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf48c expref: 325 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.721864:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.721876:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396411776 00010000:00010000:1.0:1651529344.721879:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001f005b0e/0x3234de053c4f381 lrc: 5/0,0 mode: PR/PR res: [0x2ba03:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80c4 expref: 326 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.721882:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.721886:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396411904 00010000:00010000:1.0:1651529344.721888:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000063ccc731/0x3234de053c4da7c lrc: 5/0,0 mode: PR/PR res: [0x2ba04:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a64 expref: 327 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.721890:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.721892:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396411712 00010000:00010000:1.0:1651529344.721894:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000db55a158/0x3234de053c4e7bf lrc: 4/0,0 mode: PR/PR res: [0x2ba02:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f77 expref: 328 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.721895:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.721898:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396412032 00010000:00010000:1.0:1651529344.721900:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001c7986d5/0x3234de053c4e278 lrc: 5/0,0 mode: PR/PR res: [0x2ba06:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b3b expref: 329 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.721900:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.721904:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396411840 00000100:00100000:0.0:1651529344.721904:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.721906:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003a1ec154/0x3234de053c4da52 lrc: 4/0,0 mode: PR/PR res: [0x2ba05:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d19ae expref: 330 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.721910:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396411968 00010000:00010000:1.0:1651529344.721912:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008d5b403f/0x3234de053c4e198 lrc: 4/0,0 mode: PR/PR res: [0x2ba07:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d37a6 expref: 331 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.721917:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13023 00000100:00100000:1.0:1651529344.721918:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e3dc394f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+331:41279:x1731746396411648:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.721920:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.721928:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.721929:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fc130417 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997050304:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.721930:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000becec6a/0x3234de053c4d0b9 lrc: 4/0,0 mode: PR/PR res: [0x2ba01:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf48c expref: 331 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.721933:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c527ad lrc: 3/0,1 mode: --/PW res: [0x2ba03:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.721934:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000becec6a/0x3234de053c4d0b9 lrc: 3/0,0 mode: PR/PR res: [0x2ba01:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf48c expref: 331 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.721940:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000becec6a/0x3234de053c4d0b9 lrc: 0/0,0 mode: --/PR res: [0x2ba01:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf48c expref: 331 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.721940:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ac8dec6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997050432:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.721943:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.721943:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c527bb lrc: 3/0,1 mode: --/PW res: [0x2ba04:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.721944:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.721945:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c5279f lrc: 3/0,1 mode: PW/PW res: [0x2ba01:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.721948:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c5279f lrc: 4/0,1 mode: PW/PW res: [0x2ba01:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.721949:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000533fe698 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997050560:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.721951:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c527c9 lrc: 3/0,1 mode: --/PW res: [0x2ba06:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.721958:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.721965:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ebb53b0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997050624:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.721968:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e3dc394f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+330:41279:x1731746396411648:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 48us (124us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.721968:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c527d0 lrc: 3/0,1 mode: --/PW res: [0x2ba08:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.721970:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13023 00010000:00010000:0.0:1651529344.721973:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c5279f lrc: 3/0,1 mode: PW/PW res: [0x2ba01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.721976:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c5279f lrc: 3/0,1 mode: PW/PW res: [0x2ba01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.721979:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396412096 00010000:00010000:0.0:1651529344.721979:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c5279f lrc: 3/0,1 mode: PW/PW res: [0x2ba01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.721982:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005e56573c/0x3234de053c4ba46 lrc: 4/0,0 mode: PR/PR res: [0x2ba08:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc4c0 expref: 330 pid: 80280 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.721982:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c5279f lrc: 2/0,0 mode: PW/PW res: [0x2ba01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.721988:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13024 00000100:00100000:1.0:1651529344.721989:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+330:41279:x1731746396411776:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.721997:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.721999:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001f005b0e/0x3234de053c4f381 lrc: 4/0,0 mode: PR/PR res: [0x2ba03:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80c4 expref: 330 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.722003:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001f005b0e/0x3234de053c4f381 lrc: 3/0,0 mode: PR/PR res: [0x2ba03:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80c4 expref: 330 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.722008:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f005b0e/0x3234de053c4f381 lrc: 0/0,0 mode: --/PR res: [0x2ba03:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d80c4 expref: 330 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.722011:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.722012:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.722013:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c527ad lrc: 3/0,1 mode: PW/PW res: [0x2ba03:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.722016:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c527ad lrc: 4/0,1 mode: PW/PW res: [0x2ba03:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.722025:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.722035:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+329:41279:x1731746396411776:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 46us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.722036:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1743:39029:x1731745946530496:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 961us (1049us total) trans 12885080296 rc 0/0 00000100:00100000:1.0:1651529344.722038:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13024 00000100:00100000:0.0:1651529344.722040:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212241 00000100:00100000:1.0:1651529344.722042:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13025 00000100:00100000:1.0:1651529344.722044:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+328:41279:x1731746396411904:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.722046:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.722047:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c527ad lrc: 3/0,1 mode: PW/PW res: [0x2ba03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.722048:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000063ccc731/0x3234de053c4da7c lrc: 4/0,0 mode: PR/PR res: [0x2ba04:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a64 expref: 328 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.722050:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c527ad lrc: 3/0,1 mode: PW/PW res: [0x2ba03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.722053:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c527ad lrc: 3/0,1 mode: PW/PW res: [0x2ba03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.722054:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000063ccc731/0x3234de053c4da7c lrc: 3/0,0 mode: PR/PR res: [0x2ba04:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a64 expref: 328 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.722056:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c527ad lrc: 2/0,0 mode: PW/PW res: [0x2ba03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.722058:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063ccc731/0x3234de053c4da7c lrc: 0/0,0 mode: --/PR res: [0x2ba04:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1a64 expref: 328 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.722062:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.722062:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.722063:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c527bb lrc: 3/0,1 mode: PW/PW res: [0x2ba04:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.722066:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c527bb lrc: 4/0,1 mode: PW/PW res: [0x2ba04:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.722074:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.722079:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+327:41279:x1731746396411904:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 34us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.722081:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13025 00000100:00100000:1.0:1651529344.722085:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13026 00000100:00100000:1.0:1651529344.722086:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+326:41278:x1731746396411712:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.722088:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.722090:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000db55a158/0x3234de053c4e7bf lrc: 4/0,0 mode: PR/PR res: [0x2ba02:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f77 expref: 326 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.722093:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000db55a158/0x3234de053c4e7bf lrc: 3/0,0 mode: PR/PR res: [0x2ba02:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f77 expref: 326 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.722096:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1743:39029:x1731745946530624:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 946us (1082us total) trans 12885080297 rc 0/0 00010000:00010000:1.0:1651529344.722098:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db55a158/0x3234de053c4e7bf lrc: 0/0,0 mode: --/PR res: [0x2ba02:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4f77 expref: 326 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.722099:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212243 00010000:00010000:1.0:1651529344.722101:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.722102:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.722102:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c527a6 lrc: 3/0,1 mode: PW/PW res: [0x2ba02:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.722105:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c527a6 lrc: 4/0,1 mode: PW/PW res: [0x2ba02:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.722106:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c5279f lrc: 2/0,0 mode: PW/PW res: [0x2ba01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.722109:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000066921086 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.722111:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.722111:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c5279f lrc: 2/0,0 mode: PW/PW res: [0x2ba01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.722113:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c5279f lrc: 3/0,0 mode: PW/PW res: [0x2ba01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.722116:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+325:41278:x1731746396411712:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 29us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.722118:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13026 00010000:00010000:0.0:1651529344.722118:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c5279f lrc: 1/0,0 mode: --/PW res: [0x2ba01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.722122:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13027 00010000:00010000:0.0:1651529344.722122:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c5279f lrc: 0/0,0 mode: --/PW res: [0x2ba01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.722124:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+324:41279:x1731746396412032:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.722126:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.722126:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c527ad lrc: 2/0,0 mode: PW/PW res: [0x2ba03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.722127:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001c7986d5/0x3234de053c4e278 lrc: 4/0,0 mode: PR/PR res: [0x2ba06:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b3b expref: 324 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.722128:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ebdbebae already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.722129:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c527ad lrc: 2/0,0 mode: PW/PW res: [0x2ba03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.722130:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001c7986d5/0x3234de053c4e278 lrc: 3/0,0 mode: PR/PR res: [0x2ba06:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b3b expref: 324 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.722132:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c527ad lrc: 3/0,0 mode: PW/PW res: [0x2ba03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.722134:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c7986d5/0x3234de053c4e278 lrc: 0/0,0 mode: --/PR res: [0x2ba06:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b3b expref: 324 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.722135:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c527ad lrc: 1/0,0 mode: --/PW res: [0x2ba03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.722138:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c527ad lrc: 0/0,0 mode: --/PW res: [0x2ba03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.722140:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.722140:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.722141:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c527c9 lrc: 3/0,1 mode: PW/PW res: [0x2ba06:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.722143:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c527bb lrc: 3/0,1 mode: PW/PW res: [0x2ba04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.722144:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c527c9 lrc: 4/0,1 mode: PW/PW res: [0x2ba06:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.722145:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c527bb lrc: 3/0,1 mode: PW/PW res: [0x2ba04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.722151:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.722156:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+323:41279:x1731746396412032:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 32us (261us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.722157:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c527bb lrc: 3/0,1 mode: PW/PW res: [0x2ba04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.722158:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13027 00010000:00010000:0.0:1651529344.722160:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c527bb lrc: 2/0,0 mode: PW/PW res: [0x2ba04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.722162:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13028 00000100:00100000:1.0:1651529344.722163:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+322:41278:x1731746396411840:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.722165:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.722167:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003a1ec154/0x3234de053c4da52 lrc: 4/0,0 mode: PR/PR res: [0x2ba05:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d19ae expref: 322 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.722170:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003a1ec154/0x3234de053c4da52 lrc: 3/0,0 mode: PR/PR res: [0x2ba05:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d19ae expref: 322 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.722174:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a1ec154/0x3234de053c4da52 lrc: 0/0,0 mode: --/PR res: [0x2ba05:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d19ae expref: 322 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.722177:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.722178:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.722179:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c527b4 lrc: 3/0,1 mode: PW/PW res: [0x2ba05:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.722182:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c527b4 lrc: 4/0,1 mode: PW/PW res: [0x2ba05:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.722187:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.722192:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+321:41278:x1731746396411840:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 28us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.722194:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13028 00000100:00100000:0.0:1651529344.722194:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1743:39030:x1731745946530688:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 998us (1152us total) trans 12885080298 rc 0/0 00000100:00100000:1.0:1651529344.722197:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13029 00000100:00100000:0.0:1651529344.722197:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212245 00000100:00100000:1.0:1651529344.722199:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+320:41278:x1731746396411968:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.722201:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.722202:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008d5b403f/0x3234de053c4e198 lrc: 4/0,0 mode: PR/PR res: [0x2ba07:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d37a6 expref: 320 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.722203:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c527bb lrc: 2/0,0 mode: PW/PW res: [0x2ba04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.722206:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008d5b403f/0x3234de053c4e198 lrc: 3/0,0 mode: PR/PR res: [0x2ba07:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d37a6 expref: 320 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.722207:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000314b5fa1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.722208:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c527bb lrc: 2/0,0 mode: PW/PW res: [0x2ba04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.722210:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d5b403f/0x3234de053c4e198 lrc: 0/0,0 mode: --/PR res: [0x2ba07:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d37a6 expref: 320 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.722211:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c527bb lrc: 3/0,0 mode: PW/PW res: [0x2ba04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.722213:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.722214:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.722214:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c527c2 lrc: 3/0,1 mode: PW/PW res: [0x2ba07:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.722215:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c527bb lrc: 1/0,0 mode: --/PW res: [0x2ba04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.722218:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c527bb lrc: 0/0,0 mode: --/PW res: [0x2ba04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.722219:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c527c2 lrc: 4/0,1 mode: PW/PW res: [0x2ba07:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.722243:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.722244:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c527c9 lrc: 3/0,1 mode: PW/PW res: [0x2ba06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.722248:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+319:41278:x1731746396411968:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 49us (344us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.722248:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c527c9 lrc: 3/0,1 mode: PW/PW res: [0x2ba06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.722251:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13029 00010000:00010000:0.0:1651529344.722251:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c527c9 lrc: 3/0,1 mode: PW/PW res: [0x2ba06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.722253:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c527c9 lrc: 2/0,0 mode: PW/PW res: [0x2ba06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.722255:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13030 00000100:00100000:1.0:1651529344.722257:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001743f524 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+318:41278:x1731746396412096:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.722259:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.722261:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005e56573c/0x3234de053c4ba46 lrc: 4/0,0 mode: PR/PR res: [0x2ba08:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc4c0 expref: 318 pid: 80280 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.722264:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005e56573c/0x3234de053c4ba46 lrc: 3/0,0 mode: PR/PR res: [0x2ba08:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc4c0 expref: 318 pid: 80280 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.722269:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e56573c/0x3234de053c4ba46 lrc: 0/0,0 mode: --/PR res: [0x2ba08:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc4c0 expref: 318 pid: 80280 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.722273:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.722273:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.722274:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c527d0 lrc: 3/0,1 mode: PW/PW res: [0x2ba08:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.722277:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c527d0 lrc: 4/0,1 mode: PW/PW res: [0x2ba08:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.722287:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.722292:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001743f524 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+317:41278:x1731746396412096:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 34us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.722294:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13030 00000100:00100000:0.0:1651529344.722298:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1743:39030:x1731745946530816:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1039us (1203us total) trans 12885080299 rc 0/0 00000100:00100000:0.0:1651529344.722301:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212247 00010000:00010000:1.0:1651529344.722305:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c527c9 lrc: 2/0,0 mode: PW/PW res: [0x2ba06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.722308:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009fff0bd3 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.722309:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c527c9 lrc: 2/0,0 mode: PW/PW res: [0x2ba06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.722309:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c527d0 lrc: 3/0,1 mode: PW/PW res: [0x2ba08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.722312:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c527c9 lrc: 3/0,0 mode: PW/PW res: [0x2ba06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.722312:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c527d0 lrc: 3/0,1 mode: PW/PW res: [0x2ba08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.722315:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c527d0 lrc: 3/0,1 mode: PW/PW res: [0x2ba08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.722316:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c527c9 lrc: 1/0,0 mode: --/PW res: [0x2ba06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.722318:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c527d0 lrc: 2/0,0 mode: PW/PW res: [0x2ba08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.722319:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c527c9 lrc: 0/0,0 mode: --/PW res: [0x2ba06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.722323:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c527d0 lrc: 2/0,0 mode: PW/PW res: [0x2ba08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.722326:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cde7e11a already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.722327:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c527d0 lrc: 2/0,0 mode: PW/PW res: [0x2ba08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.722331:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c527d0 lrc: 3/0,0 mode: PW/PW res: [0x2ba08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.722335:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c527d0 lrc: 1/0,0 mode: --/PW res: [0x2ba08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.722337:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c527d0 lrc: 0/0,0 mode: --/PW res: [0x2ba08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.722342:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c527c2 lrc: 3/0,1 mode: PW/PW res: [0x2ba07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.722345:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c527c2 lrc: 3/0,1 mode: PW/PW res: [0x2ba07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.722348:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c527c2 lrc: 3/0,1 mode: PW/PW res: [0x2ba07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.722350:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1743:39030:x1731745946530944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1035us (1063us total) trans 12885080300 rc 0/0 00010000:00010000:1.0:1651529344.722351:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c527c2 lrc: 2/0,0 mode: PW/PW res: [0x2ba07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.722355:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212248 00010000:00010000:0.0:1651529344.722368:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c527c2 lrc: 2/0,0 mode: PW/PW res: [0x2ba07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.722372:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000576f1f12 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.722373:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c527c2 lrc: 2/0,0 mode: PW/PW res: [0x2ba07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.722376:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c527c2 lrc: 3/0,0 mode: PW/PW res: [0x2ba07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.722380:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c527c2 lrc: 1/0,0 mode: --/PW res: [0x2ba07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.722383:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c527c2 lrc: 0/0,0 mode: --/PW res: [0x2ba07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.722394:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1743:39029:x1731745946530880:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1179us (1309us total) trans 12885080301 rc 0/0 00000100:00100000:1.0:1651529344.722398:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212246 00010000:00010000:1.0:1651529344.722405:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c527a6 lrc: 3/0,1 mode: PW/PW res: [0x2ba02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.722411:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c527a6 lrc: 3/0,1 mode: PW/PW res: [0x2ba02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.722414:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c527a6 lrc: 3/0,1 mode: PW/PW res: [0x2ba02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.722417:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c527a6 lrc: 2/0,0 mode: PW/PW res: [0x2ba02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.722490:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1743:39030:x1731745946530560:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1378us (1485us total) trans 12885080302 rc 0/0 00000100:00100000:1.0:1651529344.722493:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212242 00010000:00010000:1.0:1651529344.722500:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c527b4 lrc: 3/0,1 mode: PW/PW res: [0x2ba05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.722503:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c527b4 lrc: 3/0,1 mode: PW/PW res: [0x2ba05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.722506:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c527b4 lrc: 3/0,1 mode: PW/PW res: [0x2ba05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.722509:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c527b4 lrc: 2/0,0 mode: PW/PW res: [0x2ba05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.722532:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c527a6 lrc: 2/0,0 mode: PW/PW res: [0x2ba02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.722536:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006401eb97 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.722537:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c527a6 lrc: 2/0,0 mode: PW/PW res: [0x2ba02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.722540:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c527a6 lrc: 3/0,0 mode: PW/PW res: [0x2ba02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.722547:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c527a6 lrc: 1/0,0 mode: --/PW res: [0x2ba02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.722550:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c527a6 lrc: 0/0,0 mode: --/PW res: [0x2ba02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.722554:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c527b4 lrc: 2/0,0 mode: PW/PW res: [0x2ba05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.722558:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1743:39029:x1731745946530752:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1388us (1529us total) trans 12885080303 rc 0/0 00010000:00010000:0.0:1651529344.722562:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fafb79d3 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.722563:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212244 00010000:00010000:0.0:1651529344.722563:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c527b4 lrc: 2/0,0 mode: PW/PW res: [0x2ba05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.722566:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c527b4 lrc: 3/0,0 mode: PW/PW res: [0x2ba05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.722569:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c527b4 lrc: 1/0,0 mode: --/PW res: [0x2ba05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.722571:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c527b4 lrc: 0/0,0 mode: --/PW res: [0x2ba05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.722693:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.722705:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.722714:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.722720:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946531072 00000100:00100000:0.0:1651529344.722722:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.722731:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946531200 00000100:00100000:1.0:1651529344.722743:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946531328 00000100:00100000:0.0:1651529344.722745:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.722754:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946531008 00000100:00100000:1.0:1651529344.722758:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946531136 00000100:00100000:1.0:1651529344.722762:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212249 00000100:00100000:1.0:1651529344.722764:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1747:39030:x1731745946531072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.722769:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178698 count 1 00010000:00010000:1.0:1651529344.722774:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c527d7 lrc: 3/0,1 mode: --/PW res: [0x2ba0a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.722779:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.722790:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.722796:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f0f877f9/0x3234de053c4dde7 lrc: 2/0,0 mode: PR/PR res: [0x2ba0a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d28b8 expref: 316 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.722800:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.722800:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946531264 00010000:00010000:1.0:1651529344.722801:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.722802:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c527d7 lrc: 4/0,1 mode: --/PW res: [0x2ba0a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.722806:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946531392 00010000:00010000:1.0:1651529344.722809:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f0f877f9/0x3234de053c4dde7 lrc: 3/0,0 mode: PR/PR res: [0x2ba0a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d28b8 expref: 316 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.722809:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212250 00000100:00100000:0.0:1651529344.722811:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1749:39030:x1731745946531200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.722813:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f0f877f9/0x3234de053c4dde7 lrc: 4/0,0 mode: PR/PR res: [0x2ba0a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d28b8 expref: 316 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.722817:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a13808c6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997050688:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.722832:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178700 count 1 00000100:00100000:1.0:1651529344.722837:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c3caa148 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.722842:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c527de lrc: 3/0,1 mode: --/PW res: [0x2ba0c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.722844:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212251 00000100:00100000:1.0:1651529344.722846:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1749:39030:x1731745946531328:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.722847:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ae5fa4ef/0x3234de053c4de5e lrc: 2/0,0 mode: PR/PR res: [0x2ba0c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a24 expref: 316 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.722850:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1651529344.722851:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178702 count 1 00010000:00010000:0.0:1651529344.722851:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.722852:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c527de lrc: 4/0,1 mode: --/PW res: [0x2ba0c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.722855:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c527e5 lrc: 3/0,1 mode: --/PW res: [0x2ba0e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.722859:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ebb782e3/0x3234de053c4ca14 lrc: 2/0,0 mode: PR/PR res: [0x2ba0e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda29 expref: 316 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.722859:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ae5fa4ef/0x3234de053c4de5e lrc: 3/0,0 mode: PR/PR res: [0x2ba0c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a24 expref: 316 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.722862:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.722862:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ae5fa4ef/0x3234de053c4de5e lrc: 4/0,0 mode: PR/PR res: [0x2ba0c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a24 expref: 316 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.722863:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.722863:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c527e5 lrc: 4/0,1 mode: --/PW res: [0x2ba0e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.722867:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000117fbeca pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997050752:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.722869:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ebb782e3/0x3234de053c4ca14 lrc: 3/0,0 mode: PR/PR res: [0x2ba0e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda29 expref: 316 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.722873:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ebb782e3/0x3234de053c4ca14 lrc: 4/0,0 mode: PR/PR res: [0x2ba0e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda29 expref: 316 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.722876:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 0000000076b354b3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.722877:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000093ddaf92 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997050816:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.722883:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212252 00000100:00100000:1.0:1651529344.722884:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b7af823 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.722885:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1749:39030:x1731745946531008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.722889:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178697 count 1 00000100:00100000:1.0:1651529344.722890:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212253 00000100:00100000:1.0:1651529344.722891:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1749:39030:x1731745946531136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.722893:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c527ec lrc: 3/0,1 mode: --/PW res: [0x2ba09:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.722895:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178699 count 1 00010000:00010000:0.0:1651529344.722897:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d5e25f9e/0x3234de053c4d026 lrc: 2/0,0 mode: PR/PR res: [0x2ba09:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf1ec expref: 316 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.722898:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c527f3 lrc: 3/0,1 mode: --/PW res: [0x2ba0b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.722900:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.722901:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.722901:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c527ec lrc: 4/0,1 mode: --/PW res: [0x2ba09:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.722903:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e1ad0075/0x3234de053c4b1fd lrc: 2/0,0 mode: PR/PR res: [0x2ba0b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc101 expref: 316 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.722906:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.722906:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.722907:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c527f3 lrc: 4/0,1 mode: --/PW res: [0x2ba0b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.722907:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d5e25f9e/0x3234de053c4d026 lrc: 3/0,0 mode: PR/PR res: [0x2ba09:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf1ec expref: 316 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.722910:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d5e25f9e/0x3234de053c4d026 lrc: 4/0,0 mode: PR/PR res: [0x2ba09:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf1ec expref: 316 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.722913:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e1ad0075/0x3234de053c4b1fd lrc: 3/0,0 mode: PR/PR res: [0x2ba0b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc101 expref: 316 pid: 151609 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.722914:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003de40890 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997050880:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.722916:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e1ad0075/0x3234de053c4b1fd lrc: 4/0,0 mode: PR/PR res: [0x2ba0b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc101 expref: 316 pid: 151609 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.722920:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a223a622 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997050944:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.722921:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ff7bf023 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.722926:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 0000000053a0cffa going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.722926:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212254 00000100:00100000:0.0:1651529344.722928:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1749:39030:x1731745946531264:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.722931:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212255 00002000:00080000:0.0:1651529344.722932:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178701 count 1 00000100:00100000:1.0:1651529344.722933:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1749:39029:x1731745946531392:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.722935:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c527fa lrc: 3/0,1 mode: --/PW res: [0x2ba0d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.722937:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178703 count 1 00010000:00010000:0.0:1651529344.722939:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f3cf0723/0x3234de053c4eb7e lrc: 2/0,0 mode: PR/PR res: [0x2ba0d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f8b expref: 316 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.722940:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52801 lrc: 3/0,1 mode: --/PW res: [0x2ba0f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.722942:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.722943:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.722944:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000f94b1ec/0x3234de053c4d2b1 lrc: 2/0,0 mode: PR/PR res: [0x2ba0f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfcb2 expref: 316 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.722944:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c527fa lrc: 4/0,1 mode: --/PW res: [0x2ba0d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.722949:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f3cf0723/0x3234de053c4eb7e lrc: 3/0,0 mode: PR/PR res: [0x2ba0d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f8b expref: 316 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.722950:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.722950:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.722951:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52801 lrc: 4/0,1 mode: --/PW res: [0x2ba0f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.722952:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f3cf0723/0x3234de053c4eb7e lrc: 4/0,0 mode: PR/PR res: [0x2ba0d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f8b expref: 316 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.722956:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a573b31 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997051008:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.722957:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000f94b1ec/0x3234de053c4d2b1 lrc: 3/0,0 mode: PR/PR res: [0x2ba0f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfcb2 expref: 316 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.722960:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000f94b1ec/0x3234de053c4d2b1 lrc: 4/0,0 mode: PR/PR res: [0x2ba0f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfcb2 expref: 316 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.722962:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 0000000009370c1d going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.722964:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000089d7f5d6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997051072:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.722970:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aeda71fe going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.722976:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.723056:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946531456 00000100:00100000:1.0:1651529344.723064:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212256 00000100:00100000:1.0:1651529344.723066:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1750:39030:x1731745946531456:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.723071:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178704 count 1 00010000:00010000:1.0:1651529344.723075:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52808 lrc: 3/0,1 mode: --/PW res: [0x2ba10:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.723079:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000046ed6f14/0x3234de053c4d8d8 lrc: 2/0,0 mode: PR/PR res: [0x2ba10:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1428 expref: 316 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.723082:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.723083:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.723083:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52808 lrc: 4/0,1 mode: --/PW res: [0x2ba10:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.723090:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000046ed6f14/0x3234de053c4d8d8 lrc: 3/0,0 mode: PR/PR res: [0x2ba10:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1428 expref: 316 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.723094:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000046ed6f14/0x3234de053c4d8d8 lrc: 4/0,0 mode: PR/PR res: [0x2ba10:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1428 expref: 316 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.723098:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002c4168d4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997051136:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.723111:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b52d0f36 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.723322:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000117fbeca pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997050752:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.723327:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000093ddaf92 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997050816:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.723327:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c527de lrc: 3/0,1 mode: --/PW res: [0x2ba0c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.723332:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c527e5 lrc: 3/0,1 mode: --/PW res: [0x2ba0e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.723335:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003de40890 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997050880:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.723337:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c527ec lrc: 3/0,1 mode: --/PW res: [0x2ba09:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.723339:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a13808c6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997050688:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.723342:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c527d7 lrc: 3/0,1 mode: --/PW res: [0x2ba0a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.723478:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.723531:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.723542:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396412160 00000100:00100000:0.0:1651529344.723543:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.723552:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.723553:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f0f877f9/0x3234de053c4dde7 lrc: 4/0,0 mode: PR/PR res: [0x2ba0a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d28b8 expref: 317 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.723567:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396412288 00010000:00010000:1.0:1651529344.723570:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ebb782e3/0x3234de053c4ca14 lrc: 4/0,0 mode: PR/PR res: [0x2ba0e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda29 expref: 318 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.723571:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.723574:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396412224 00010000:00010000:1.0:1651529344.723586:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ae5fa4ef/0x3234de053c4de5e lrc: 4/0,0 mode: PR/PR res: [0x2ba0c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a24 expref: 319 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.723587:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.723591:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396412352 00010000:00010000:1.0:1651529344.723593:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d5e25f9e/0x3234de053c4d026 lrc: 4/0,0 mode: PR/PR res: [0x2ba09:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf1ec expref: 320 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.723593:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.723597:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396412416 00010000:00010000:1.0:1651529344.723600:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e1ad0075/0x3234de053c4b1fd lrc: 5/0,0 mode: PR/PR res: [0x2ba0b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc101 expref: 321 pid: 151609 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.723604:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396412480 00010000:00010000:1.0:1651529344.723606:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f3cf0723/0x3234de053c4eb7e lrc: 5/0,0 mode: PR/PR res: [0x2ba0d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f8b expref: 322 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.723606:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.723615:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a573b31 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997051008:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.723618:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396412544 00010000:00010000:0.0:1651529344.723619:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c527fa lrc: 3/0,1 mode: --/PW res: [0x2ba0d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.723621:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000f94b1ec/0x3234de053c4d2b1 lrc: 5/0,0 mode: PR/PR res: [0x2ba0f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfcb2 expref: 323 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.723626:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13031 00000100:00100000:0.0:1651529344.723626:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396412608 00000100:00100000:1.0:1651529344.723628:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+324:41279:x1731746396412160:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.723631:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.723631:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000046ed6f14/0x3234de053c4d8d8 lrc: 5/0,0 mode: PR/PR res: [0x2ba10:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1428 expref: 324 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.723632:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f0f877f9/0x3234de053c4dde7 lrc: 4/0,0 mode: PR/PR res: [0x2ba0a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d28b8 expref: 324 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.723636:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f0f877f9/0x3234de053c4dde7 lrc: 3/0,0 mode: PR/PR res: [0x2ba0a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d28b8 expref: 324 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.723637:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13032 00000100:00100000:0.0:1651529344.723639:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+324:41279:x1731746396412288:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.723642:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.723643:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ebb782e3/0x3234de053c4ca14 lrc: 4/0,0 mode: PR/PR res: [0x2ba0e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda29 expref: 324 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.723645:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0f877f9/0x3234de053c4dde7 lrc: 0/0,0 mode: --/PR res: [0x2ba0a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d28b8 expref: 324 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.723647:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ebb782e3/0x3234de053c4ca14 lrc: 3/0,0 mode: PR/PR res: [0x2ba0e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda29 expref: 324 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.723648:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.723649:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.723650:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c527d7 lrc: 3/0,1 mode: PW/PW res: [0x2ba0a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.723653:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c527d7 lrc: 4/0,1 mode: PW/PW res: [0x2ba0a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.723653:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ebb782e3/0x3234de053c4ca14 lrc: 0/0,0 mode: --/PR res: [0x2ba0e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cda29 expref: 323 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.723657:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.723657:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.723658:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c527e5 lrc: 3/0,1 mode: PW/PW res: [0x2ba0e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.723660:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.723661:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c527e5 lrc: 4/0,1 mode: PW/PW res: [0x2ba0e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.723668:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+322:41279:x1731746396412160:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 39us (190us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.723671:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.723676:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13031 00000100:00100000:0.0:1651529344.723678:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+322:41279:x1731746396412288:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 39us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.723681:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13032 00000100:00100000:1.0:1651529344.723683:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13033 00000100:00100000:1.0:1651529344.723685:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+320:41279:x1731746396412224:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.723686:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13034 00010000:00010000:1.0:1651529344.723687:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.723688:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+320:41279:x1731746396412352:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.723689:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ae5fa4ef/0x3234de053c4de5e lrc: 4/0,0 mode: PR/PR res: [0x2ba0c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a24 expref: 320 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.723691:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.723692:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d5e25f9e/0x3234de053c4d026 lrc: 4/0,0 mode: PR/PR res: [0x2ba09:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf1ec expref: 320 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.723693:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ae5fa4ef/0x3234de053c4de5e lrc: 3/0,0 mode: PR/PR res: [0x2ba0c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a24 expref: 320 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.723696:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d5e25f9e/0x3234de053c4d026 lrc: 3/0,0 mode: PR/PR res: [0x2ba09:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf1ec expref: 320 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.723698:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae5fa4ef/0x3234de053c4de5e lrc: 0/0,0 mode: --/PR res: [0x2ba0c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a24 expref: 320 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.723701:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5e25f9e/0x3234de053c4d026 lrc: 0/0,0 mode: --/PR res: [0x2ba09:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf1ec expref: 320 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.723704:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.723704:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.723704:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.723705:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c527de lrc: 3/0,1 mode: PW/PW res: [0x2ba0c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.723705:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.723706:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c527ec lrc: 3/0,1 mode: PW/PW res: [0x2ba09:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.723708:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c527de lrc: 4/0,1 mode: PW/PW res: [0x2ba0c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.723708:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c527ec lrc: 4/0,1 mode: PW/PW res: [0x2ba09:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.723717:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.723720:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.723723:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+318:41279:x1731746396412224:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 38us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.723726:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13033 00000100:00100000:0.0:1651529344.723726:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+318:41279:x1731746396412352:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 37us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.723729:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13034 00000100:00100000:1.0:1651529344.723731:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13035 00000100:00100000:1.0:1651529344.723732:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+316:41279:x1731746396412416:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.723744:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.723744:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13036 00010000:00010000:1.0:1651529344.723746:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e1ad0075/0x3234de053c4b1fd lrc: 5/0,0 mode: PR/PR res: [0x2ba0b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc101 expref: 316 pid: 151609 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.723746:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+316:41278:x1731746396412480:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.723749:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.723750:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e1ad0075/0x3234de053c4b1fd lrc: 4/0,0 mode: PR/PR res: [0x2ba0b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc101 expref: 316 pid: 151609 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.723750:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f3cf0723/0x3234de053c4eb7e lrc: 4/0,0 mode: PR/PR res: [0x2ba0d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f8b expref: 316 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.723754:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.723754:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f3cf0723/0x3234de053c4eb7e lrc: 3/0,0 mode: PR/PR res: [0x2ba0d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f8b expref: 316 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.723755:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.723756:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c527f3 lrc: 3/0,1 mode: PW/PW res: [0x2ba0b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.723759:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3cf0723/0x3234de053c4eb7e lrc: 0/0,0 mode: --/PR res: [0x2ba0d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5f8b expref: 316 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.723761:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c527f3 lrc: 4/0,1 mode: PW/PW res: [0x2ba0b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.723762:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.723763:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.723764:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c527fa lrc: 3/0,1 mode: PW/PW res: [0x2ba0d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.723765:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.723767:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c527fa lrc: 4/0,1 mode: PW/PW res: [0x2ba0d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.723770:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+315:41279:x1731746396412416:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 37us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.723773:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13035 00010000:00010000:0.0:1651529344.723774:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.723777:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13037 00000100:00100000:1.0:1651529344.723779:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005649b5c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+314:41279:x1731746396412544:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.723780:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+314:41278:x1731746396412480:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (193us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.723781:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.723782:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000f94b1ec/0x3234de053c4d2b1 lrc: 5/0,0 mode: PR/PR res: [0x2ba0f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfcb2 expref: 314 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.723782:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13036 00010000:00010000:1.0:1651529344.723786:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000f94b1ec/0x3234de053c4d2b1 lrc: 4/0,0 mode: PR/PR res: [0x2ba0f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfcb2 expref: 313 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.723787:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13038 00000100:00100000:0.0:1651529344.723789:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+313:41278:x1731746396412608:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.723790:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.723790:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.723791:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52801 lrc: 3/0,1 mode: PW/PW res: [0x2ba0f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.723791:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.723792:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000046ed6f14/0x3234de053c4d8d8 lrc: 5/0,0 mode: PR/PR res: [0x2ba10:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1428 expref: 313 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.723794:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52801 lrc: 4/0,1 mode: PW/PW res: [0x2ba0f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.723796:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000046ed6f14/0x3234de053c4d8d8 lrc: 4/0,0 mode: PR/PR res: [0x2ba10:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1428 expref: 313 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.723798:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.723800:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.723801:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.723801:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52808 lrc: 3/0,1 mode: PW/PW res: [0x2ba10:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.723802:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005649b5c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+313:41279:x1731746396412544:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 23us (209us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.723804:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52808 lrc: 4/0,1 mode: PW/PW res: [0x2ba10:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.723805:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13037 00010000:00010000:0.0:1651529344.723808:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.723813:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+312:41278:x1731746396412608:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 24us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.723815:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13038 00010000:00010000:1.0:1651529344.723818:0:72397:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1ad0075/0x3234de053c4b1fd lrc: 0/0,0 mode: --/PR res: [0x2ba0b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc101 expref: 311 pid: 151609 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.723821:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c527ec lrc: 3/0,1 mode: PW/PW res: [0x2ba09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.723822:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a223a622 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997050944:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.723824:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c527ec lrc: 3/0,1 mode: PW/PW res: [0x2ba09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.723825:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c527f3 lrc: 3/0,1 mode: PW/PW res: [0x2ba0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.723828:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c527f3 lrc: 3/0,1 mode: PW/PW res: [0x2ba0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.723830:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c527ec lrc: 3/0,1 mode: PW/PW res: [0x2ba09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.723831:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c527f3 lrc: 3/0,1 mode: PW/PW res: [0x2ba0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.723833:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c527ec lrc: 2/0,0 mode: PW/PW res: [0x2ba09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.723834:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c527f3 lrc: 3/0,1 mode: PW/PW res: [0x2ba0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.723837:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c527f3 lrc: 2/0,0 mode: PW/PW res: [0x2ba0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.723874:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1752:39030:x1731745946531008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 988us (1152us total) trans 12885080304 rc 0/0 00000100:00100000:0.0:1651529344.723877:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212252 00000100:00100000:1.0:1651529344.723878:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1752:39030:x1731745946531136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 986us (1149us total) trans 12885080305 rc 0/0 00000100:00100000:1.0:1651529344.723881:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212253 00010000:00010000:0.0:1651529344.723884:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c527ec lrc: 2/0,0 mode: PW/PW res: [0x2ba09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.723887:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f56810a1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.723888:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c527ec lrc: 2/0,0 mode: PW/PW res: [0x2ba09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.723891:0:72396:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f94b1ec/0x3234de053c4d2b1 lrc: 0/0,0 mode: --/PR res: [0x2ba0f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfcb2 expref: 310 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.723891:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c527ec lrc: 3/0,0 mode: PW/PW res: [0x2ba09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.723895:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c527ec lrc: 1/0,0 mode: --/PW res: [0x2ba09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.723898:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000089d7f5d6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997051072:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.723898:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c527ec lrc: 0/0,0 mode: --/PW res: [0x2ba09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.723901:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52801 lrc: 3/0,1 mode: PW/PW res: [0x2ba0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.723902:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c527f3 lrc: 2/0,0 mode: PW/PW res: [0x2ba0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.723904:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52801 lrc: 3/0,1 mode: PW/PW res: [0x2ba0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.723905:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000091ee0f93 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.723906:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c527f3 lrc: 2/0,0 mode: PW/PW res: [0x2ba0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.723907:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52801 lrc: 3/0,1 mode: PW/PW res: [0x2ba0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.723908:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c527f3 lrc: 3/0,0 mode: PW/PW res: [0x2ba0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.723910:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52801 lrc: 3/0,1 mode: PW/PW res: [0x2ba0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.723911:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c527f3 lrc: 1/0,0 mode: --/PW res: [0x2ba0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.723913:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52801 lrc: 2/0,0 mode: PW/PW res: [0x2ba0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.723914:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c527f3 lrc: 0/0,0 mode: --/PW res: [0x2ba0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.723918:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52801 lrc: 3/0,0 mode: PW/PW res: [0x2ba0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.723927:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001391dc6d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.723928:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52801 lrc: 2/0,0 mode: PW/PW res: [0x2ba0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.723931:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52801 lrc: 3/0,0 mode: PW/PW res: [0x2ba0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.723934:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52801 lrc: 1/0,0 mode: --/PW res: [0x2ba0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.723937:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52801 lrc: 0/0,0 mode: --/PW res: [0x2ba0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.723943:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c527de lrc: 3/0,1 mode: PW/PW res: [0x2ba0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.723946:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c527de lrc: 3/0,1 mode: PW/PW res: [0x2ba0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.723949:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c527de lrc: 3/0,1 mode: PW/PW res: [0x2ba0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.723952:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c527de lrc: 2/0,0 mode: PW/PW res: [0x2ba0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.723953:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1751:39029:x1731745946531392:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1019us (1162us total) trans 12885080306 rc 0/0 00000100:00100000:1.0:1651529344.723955:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212255 00010000:00010000:1.0:1651529344.723963:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c527de lrc: 2/0,0 mode: PW/PW res: [0x2ba0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.723966:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002d7487dc already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.723967:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c527de lrc: 2/0,0 mode: PW/PW res: [0x2ba0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.723972:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c527de lrc: 3/0,0 mode: PW/PW res: [0x2ba0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.723977:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c527de lrc: 1/0,0 mode: --/PW res: [0x2ba0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.723980:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c527de lrc: 0/0,0 mode: --/PW res: [0x2ba0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.723986:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c527e5 lrc: 3/0,1 mode: PW/PW res: [0x2ba0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.723988:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1751:39030:x1731745946531200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1176us (1282us total) trans 12885080307 rc 0/0 00010000:00010000:1.0:1651529344.723989:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c527e5 lrc: 3/0,1 mode: PW/PW res: [0x2ba0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.723991:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212250 00010000:00010000:1.0:1651529344.723992:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c527e5 lrc: 3/0,1 mode: PW/PW res: [0x2ba0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.723994:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c527e5 lrc: 2/0,0 mode: PW/PW res: [0x2ba0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.723997:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c527fa lrc: 3/0,1 mode: PW/PW res: [0x2ba0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.724007:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c527fa lrc: 3/0,1 mode: PW/PW res: [0x2ba0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.724010:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c527fa lrc: 3/0,1 mode: PW/PW res: [0x2ba0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.724013:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c527fa lrc: 2/0,0 mode: PW/PW res: [0x2ba0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.724040:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1752:39030:x1731745946531328:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1193us (1326us total) trans 12885080308 rc 0/0 00000100:00100000:1.0:1651529344.724043:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212251 00010000:00010000:1.0:1651529344.724050:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c527e5 lrc: 2/0,0 mode: PW/PW res: [0x2ba0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.724054:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1751:39030:x1731745946531264:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1125us (1276us total) trans 12885080309 rc 0/0 00010000:00010000:1.0:1651529344.724056:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f0bd9bfb already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.724057:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c527e5 lrc: 2/0,0 mode: PW/PW res: [0x2ba0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.724057:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212254 00010000:00010000:1.0:1651529344.724060:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c527e5 lrc: 3/0,0 mode: PW/PW res: [0x2ba0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.724064:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c527e5 lrc: 1/0,0 mode: --/PW res: [0x2ba0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.724064:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c527fa lrc: 2/0,0 mode: PW/PW res: [0x2ba0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.724067:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c527e5 lrc: 0/0,0 mode: --/PW res: [0x2ba0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.724067:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001d04fb0a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.724068:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c527fa lrc: 2/0,0 mode: PW/PW res: [0x2ba0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.724071:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c527fa lrc: 3/0,0 mode: PW/PW res: [0x2ba0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.724076:0:80277:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046ed6f14/0x3234de053c4d8d8 lrc: 0/0,0 mode: --/PR res: [0x2ba10:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1428 expref: 309 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.724076:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c527fa lrc: 1/0,0 mode: --/PW res: [0x2ba0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.724078:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c527fa lrc: 0/0,0 mode: --/PW res: [0x2ba0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.724079:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002c4168d4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997051136:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.724083:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52808 lrc: 3/0,1 mode: PW/PW res: [0x2ba10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.724086:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52808 lrc: 3/0,1 mode: PW/PW res: [0x2ba10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.724088:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52808 lrc: 3/0,1 mode: PW/PW res: [0x2ba10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.724094:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52808 lrc: 3/0,1 mode: PW/PW res: [0x2ba10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.724096:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52808 lrc: 2/0,0 mode: PW/PW res: [0x2ba10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.724176:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1751:39030:x1731745946531456:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1103us (1194us total) trans 12885080310 rc 0/0 00000100:00100000:1.0:1651529344.724179:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212256 00010000:00010000:1.0:1651529344.724194:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52808 lrc: 2/0,0 mode: PW/PW res: [0x2ba10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.724197:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008517b233 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.724198:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52808 lrc: 2/0,0 mode: PW/PW res: [0x2ba10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.724201:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52808 lrc: 3/0,0 mode: PW/PW res: [0x2ba10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.724206:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52808 lrc: 1/0,0 mode: --/PW res: [0x2ba10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.724209:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52808 lrc: 0/0,0 mode: --/PW res: [0x2ba10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.724215:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c527d7 lrc: 3/0,1 mode: PW/PW res: [0x2ba0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.724218:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c527d7 lrc: 3/0,1 mode: PW/PW res: [0x2ba0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.724236:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c527d7 lrc: 3/0,1 mode: PW/PW res: [0x2ba0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.724239:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c527d7 lrc: 2/0,0 mode: PW/PW res: [0x2ba0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.724258:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c527d7 lrc: 2/0,0 mode: PW/PW res: [0x2ba0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.724263:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fc4c513 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.724264:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c527d7 lrc: 2/0,0 mode: PW/PW res: [0x2ba0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.724270:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c527d7 lrc: 3/0,0 mode: PW/PW res: [0x2ba0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.724275:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c527d7 lrc: 1/0,0 mode: --/PW res: [0x2ba0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.724277:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c527d7 lrc: 0/0,0 mode: --/PW res: [0x2ba0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.724282:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1751:39030:x1731745946531072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1518us (1590us total) trans 12885080311 rc 0/0 00000100:00100000:1.0:1651529344.724286:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212249 00000100:00100000:1.0:1651529344.724349:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.724356:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.724362:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.724374:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.724380:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946531520 00000100:00100000:1.0:1651529344.724389:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946531648 00000100:00100000:1.0:1651529344.724392:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946531776 00000100:00100000:0.0:1651529344.724405:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946531584 00000100:00100000:1.0:1651529344.724406:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212257 00000100:00100000:1.0:1651529344.724408:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1754:39029:x1731745946531520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.724413:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178705 count 1 00000100:00100000:0.0:1651529344.724415:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212258 00010000:00010000:1.0:1651529344.724417:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c5280f lrc: 3/0,1 mode: --/PW res: [0x2ba11:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.724417:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1754:39029:x1731745946531648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.724422:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000010bb6023/0x3234de053c4e7e9 lrc: 2/0,0 mode: PR/PR res: [0x2ba11:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5050 expref: 308 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.724422:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178707 count 1 00010000:00010000:1.0:1651529344.724426:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.724426:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.724427:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c5280f lrc: 4/0,1 mode: --/PW res: [0x2ba11:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.724427:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c52816 lrc: 3/0,1 mode: --/PW res: [0x2ba13:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.724432:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002f103cd7/0x3234de053c4a98a lrc: 2/0,0 mode: PR/PR res: [0x2ba13:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd18 expref: 308 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.724434:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000010bb6023/0x3234de053c4e7e9 lrc: 3/0,0 mode: PR/PR res: [0x2ba11:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5050 expref: 308 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.724435:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.724436:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.724436:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c52816 lrc: 4/0,1 mode: --/PW res: [0x2ba13:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.724437:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000010bb6023/0x3234de053c4e7e9 lrc: 4/0,0 mode: PR/PR res: [0x2ba11:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5050 expref: 308 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.724442:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000078f9a278 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997051200:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.724443:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002f103cd7/0x3234de053c4a98a lrc: 3/0,0 mode: PR/PR res: [0x2ba13:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd18 expref: 308 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.724450:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002f103cd7/0x3234de053c4a98a lrc: 4/0,0 mode: PR/PR res: [0x2ba13:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd18 expref: 308 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.724453:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 000000004698fefb going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.724454:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000822949b3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997051264:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.724459:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212259 00000100:00100000:1.0:1651529344.724461:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1754:39029:x1731745946531776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.724463:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 0000000009370c1d going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.724465:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178709 count 1 00010000:00010000:1.0:1651529344.724468:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c5281d lrc: 3/0,1 mode: --/PW res: [0x2ba15:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.724470:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212260 00000100:00100000:0.0:1651529344.724471:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089bf9ab9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1754:39029:x1731745946531584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.724472:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000084cc32f3/0x3234de053c4dab4 lrc: 2/0,0 mode: PR/PR res: [0x2ba15:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b0c expref: 308 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.724475:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.724476:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.724476:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c5281d lrc: 4/0,1 mode: --/PW res: [0x2ba15:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.724476:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178706 count 1 00010000:00010000:0.0:1651529344.724479:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c52824 lrc: 3/0,1 mode: --/PW res: [0x2ba12:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.724483:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006763a101/0x3234de053c4cec1 lrc: 2/0,0 mode: PR/PR res: [0x2ba12:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced0e expref: 308 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.724484:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000084cc32f3/0x3234de053c4dab4 lrc: 3/0,0 mode: PR/PR res: [0x2ba15:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b0c expref: 308 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.724488:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000084cc32f3/0x3234de053c4dab4 lrc: 4/0,0 mode: PR/PR res: [0x2ba15:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b0c expref: 308 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.724491:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014f8af45 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997051328:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.724498:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aeda71fe going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.724501:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.724502:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.724502:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c52824 lrc: 4/0,1 mode: --/PW res: [0x2ba12:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.724510:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006763a101/0x3234de053c4cec1 lrc: 3/0,0 mode: PR/PR res: [0x2ba12:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced0e expref: 308 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.724514:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006763a101/0x3234de053c4cec1 lrc: 4/0,0 mode: PR/PR res: [0x2ba12:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced0e expref: 308 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.724521:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000be0ace91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997051392:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.724528:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ff7bf023 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.724533:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.724544:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.724551:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.724558:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.724564:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946531712 00000100:00100000:0.0:1651529344.724575:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946531840 00000100:00100000:1.0:1651529344.724579:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946531904 00000100:00100000:0.0:1651529344.724585:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946531968 00000100:00100000:1.0:1651529344.724594:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212261 00000100:00100000:1.0:1651529344.724596:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1758:39029:x1731745946531712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.724596:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212262 00000100:00100000:0.0:1651529344.724598:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1758:39029:x1731745946531840:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.724601:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178708 count 1 00002000:00080000:0.0:1651529344.724603:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178710 count 1 00010000:00010000:1.0:1651529344.724605:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c5282b lrc: 3/0,1 mode: --/PW res: [0x2ba14:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.724607:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c52832 lrc: 3/0,1 mode: --/PW res: [0x2ba16:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.724609:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001b40f9f7/0x3234de053c4e52d lrc: 2/0,0 mode: PR/PR res: [0x2ba14:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d45bb expref: 308 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.724612:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.724612:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000ef7974a/0x3234de053c4ee1e lrc: 2/0,0 mode: PR/PR res: [0x2ba16:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a90 expref: 308 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.724613:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.724614:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c5282b lrc: 4/0,1 mode: --/PW res: [0x2ba14:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.724615:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.724616:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.724617:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c52832 lrc: 4/0,1 mode: --/PW res: [0x2ba16:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.724621:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001b40f9f7/0x3234de053c4e52d lrc: 3/0,0 mode: PR/PR res: [0x2ba14:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d45bb expref: 308 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.724624:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001b40f9f7/0x3234de053c4e52d lrc: 4/0,0 mode: PR/PR res: [0x2ba14:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d45bb expref: 308 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.724628:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006731397d pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997051456:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.724637:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000ef7974a/0x3234de053c4ee1e lrc: 3/0,0 mode: PR/PR res: [0x2ba16:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a90 expref: 308 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.724639:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fb6c773d going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.724641:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000ef7974a/0x3234de053c4ee1e lrc: 4/0,0 mode: PR/PR res: [0x2ba16:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a90 expref: 308 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.724645:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212263 00000100:00100000:1.0:1651529344.724646:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a13808c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1758:39029:x1731745946531904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.724646:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e7f02909 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997051520:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.724650:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178711 count 1 00010000:00010000:1.0:1651529344.724653:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52839 lrc: 3/0,1 mode: --/PW res: [0x2ba17:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.724656:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c4075652 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.724657:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c4e0aa lrc: 2/0,0 mode: PR/PR res: [0x2ba17:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3323 expref: 308 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.724660:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.724661:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.724661:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52839 lrc: 4/0,1 mode: --/PW res: [0x2ba17:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.724663:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212264 00000100:00100000:0.0:1651529344.724664:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1758:39030:x1731745946531968:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.724667:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c4e0aa lrc: 3/0,0 mode: PR/PR res: [0x2ba17:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3323 expref: 308 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.724669:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178712 count 1 00010000:00010000:1.0:1651529344.724670:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c4e0aa lrc: 4/0,0 mode: PR/PR res: [0x2ba17:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3323 expref: 308 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.724672:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c52840 lrc: 3/0,1 mode: --/PW res: [0x2ba18:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.724674:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b0d9532a pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997051584:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.724676:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e73e2287/0x3234de053c4dde0 lrc: 2/0,0 mode: PR/PR res: [0x2ba18:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d28aa expref: 308 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.724680:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.724680:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.724681:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a4eb401d going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.724681:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c52840 lrc: 4/0,1 mode: --/PW res: [0x2ba18:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.724687:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e73e2287/0x3234de053c4dde0 lrc: 3/0,0 mode: PR/PR res: [0x2ba18:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d28aa expref: 308 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.724690:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e73e2287/0x3234de053c4dde0 lrc: 4/0,0 mode: PR/PR res: [0x2ba18:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d28aa expref: 308 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.724694:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000066de8c9f pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997051648:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.724701:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000504ef660 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.724906:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000078f9a278 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997051200:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.724911:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c5280f lrc: 3/0,1 mode: --/PW res: [0x2ba11:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.724939:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014f8af45 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997051328:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.724941:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.724942:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c5281d lrc: 3/0,1 mode: --/PW res: [0x2ba15:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.724953:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.724954:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396412672 00010000:00010000:1.0:1651529344.724959:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000010bb6023/0x3234de053c4e7e9 lrc: 4/0,0 mode: PR/PR res: [0x2ba11:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5050 expref: 309 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.724960:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.724971:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396412800 00010000:00010000:1.0:1651529344.724974:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002f103cd7/0x3234de053c4a98a lrc: 5/0,0 mode: PR/PR res: [0x2ba13:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd18 expref: 310 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.724977:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000be0ace91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997051392:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.724978:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396412736 00010000:00010000:1.0:1651529344.724980:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000084cc32f3/0x3234de053c4dab4 lrc: 4/0,0 mode: PR/PR res: [0x2ba15:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b0c expref: 311 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.724982:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c52824 lrc: 3/0,1 mode: --/PW res: [0x2ba12:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.724984:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13039 00000100:00100000:1.0:1651529344.724986:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+311:41279:x1731746396412672:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.724988:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000822949b3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997051264:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.724990:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.724991:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000010bb6023/0x3234de053c4e7e9 lrc: 4/0,0 mode: PR/PR res: [0x2ba11:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5050 expref: 311 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.724991:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c52816 lrc: 3/0,1 mode: --/PW res: [0x2ba13:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.724995:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000010bb6023/0x3234de053c4e7e9 lrc: 3/0,0 mode: PR/PR res: [0x2ba11:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5050 expref: 311 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.724997:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13040 00000100:00100000:0.0:1651529344.724999:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+311:41279:x1731746396412800:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.725000:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010bb6023/0x3234de053c4e7e9 lrc: 0/0,0 mode: --/PR res: [0x2ba11:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5050 expref: 311 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.725002:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.725004:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.725004:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.725004:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002f103cd7/0x3234de053c4a98a lrc: 4/0,0 mode: PR/PR res: [0x2ba13:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd18 expref: 310 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.725005:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c5280f lrc: 3/0,1 mode: PW/PW res: [0x2ba11:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.725008:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c5280f lrc: 4/0,1 mode: PW/PW res: [0x2ba11:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.725008:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002f103cd7/0x3234de053c4a98a lrc: 3/0,0 mode: PR/PR res: [0x2ba13:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd18 expref: 310 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.725014:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.725014:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f103cd7/0x3234de053c4a98a lrc: 0/0,0 mode: --/PR res: [0x2ba13:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd18 expref: 310 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.725017:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.725018:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.725019:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c52816 lrc: 3/0,1 mode: PW/PW res: [0x2ba13:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.725022:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c52816 lrc: 4/0,1 mode: PW/PW res: [0x2ba13:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.725023:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+309:41279:x1731746396412672:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (82us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.725025:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13039 00000100:00100000:1.0:1651529344.725030:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13041 00000100:00100000:1.0:1651529344.725031:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+308:41278:x1731746396412736:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.725031:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.725034:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.725035:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000084cc32f3/0x3234de053c4dab4 lrc: 4/0,0 mode: PR/PR res: [0x2ba15:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b0c expref: 308 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.725037:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+308:41279:x1731746396412800:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 37us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.725040:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13040 00010000:00010000:1.0:1651529344.725041:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000084cc32f3/0x3234de053c4dab4 lrc: 3/0,0 mode: PR/PR res: [0x2ba15:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b0c expref: 308 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.725046:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084cc32f3/0x3234de053c4dab4 lrc: 0/0,0 mode: --/PR res: [0x2ba15:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b0c expref: 307 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.725047:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c52816 lrc: 3/0,1 mode: PW/PW res: [0x2ba13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.725049:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.725049:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.725050:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c5281d lrc: 3/0,1 mode: PW/PW res: [0x2ba15:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.725050:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c52816 lrc: 3/0,1 mode: PW/PW res: [0x2ba13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.725053:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c5281d lrc: 4/0,1 mode: PW/PW res: [0x2ba15:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.725053:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c52816 lrc: 3/0,1 mode: PW/PW res: [0x2ba13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.725056:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c52816 lrc: 2/0,0 mode: PW/PW res: [0x2ba13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.725058:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.725063:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+306:41278:x1731746396412736:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 31us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.725065:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13041 00010000:00010000:1.0:1651529344.725071:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c5281d lrc: 3/0,1 mode: PW/PW res: [0x2ba15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.725074:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c5281d lrc: 3/0,1 mode: PW/PW res: [0x2ba15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.725077:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c5281d lrc: 3/0,1 mode: PW/PW res: [0x2ba15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.725082:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c5281d lrc: 2/0,0 mode: PW/PW res: [0x2ba15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.725096:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1759:39029:x1731745946531648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 678us (739us total) trans 12885080312 rc 0/0 00000100:00100000:0.0:1651529344.725099:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212258 00010000:00010000:0.0:1651529344.725105:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c52816 lrc: 2/0,0 mode: PW/PW res: [0x2ba13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.725109:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ac14729e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.725109:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c52816 lrc: 2/0,0 mode: PW/PW res: [0x2ba13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.725115:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c52816 lrc: 3/0,0 mode: PW/PW res: [0x2ba13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.725119:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c52816 lrc: 1/0,0 mode: --/PW res: [0x2ba13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.725122:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c52816 lrc: 0/0,0 mode: --/PW res: [0x2ba13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.725123:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1759:39029:x1731745946531776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 662us (760us total) trans 12885080313 rc 0/0 00000100:00100000:1.0:1651529344.725126:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212259 00010000:00010000:0.0:1651529344.725126:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c5281d lrc: 2/0,0 mode: PW/PW res: [0x2ba15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.725134:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c5280f lrc: 3/0,1 mode: PW/PW res: [0x2ba11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.725137:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c5280f lrc: 3/0,1 mode: PW/PW res: [0x2ba11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.725140:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c5280f lrc: 3/0,1 mode: PW/PW res: [0x2ba11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.725143:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c5280f lrc: 2/0,0 mode: PW/PW res: [0x2ba11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.725174:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c5599f68 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.725175:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c5281d lrc: 2/0,0 mode: PW/PW res: [0x2ba15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.725178:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c5281d lrc: 3/0,0 mode: PW/PW res: [0x2ba15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.725187:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1759:39029:x1731745946531520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 779us (838us total) trans 12885080314 rc 0/0 00000100:00100000:1.0:1651529344.725190:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212257 00010000:00010000:0.0:1651529344.725190:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c5281d lrc: 1/0,0 mode: --/PW res: [0x2ba15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.725193:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c5281d lrc: 0/0,0 mode: --/PW res: [0x2ba15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.725198:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c5280f lrc: 2/0,0 mode: PW/PW res: [0x2ba11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.725201:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000048ee8765 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.725202:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c5280f lrc: 2/0,0 mode: PW/PW res: [0x2ba11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.725204:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c5280f lrc: 3/0,0 mode: PW/PW res: [0x2ba11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.725207:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c5280f lrc: 1/0,0 mode: --/PW res: [0x2ba11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.725210:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c5280f lrc: 0/0,0 mode: --/PW res: [0x2ba11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.725240:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.725296:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.725305:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.725314:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.725315:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006731397d pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997051456:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.725319:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c5282b lrc: 3/0,1 mode: --/PW res: [0x2ba14:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.725321:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.725328:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e7f02909 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997051520:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.725329:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b0d9532a pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997051584:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.725332:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52839 lrc: 3/0,1 mode: --/PW res: [0x2ba17:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.725332:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c52832 lrc: 3/0,1 mode: --/PW res: [0x2ba16:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.725338:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396412864 00000100:00100000:0.0:1651529344.725339:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000066de8c9f pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997051648:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.725343:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006763a101/0x3234de053c4cec1 lrc: 4/0,0 mode: PR/PR res: [0x2ba12:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced0e expref: 306 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.725348:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396412928 00010000:00010000:1.0:1651529344.725350:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001b40f9f7/0x3234de053c4e52d lrc: 4/0,0 mode: PR/PR res: [0x2ba14:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d45bb expref: 307 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.725354:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396412992 00010000:00010000:1.0:1651529344.725356:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000ef7974a/0x3234de053c4ee1e lrc: 4/0,0 mode: PR/PR res: [0x2ba16:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a90 expref: 308 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.725357:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c52840 lrc: 3/0,1 mode: --/PW res: [0x2ba18:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.725360:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396413056 00010000:00010000:1.0:1651529344.725362:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c4e0aa lrc: 4/0,0 mode: PR/PR res: [0x2ba17:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3323 expref: 309 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.725366:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396413120 00010000:00010000:1.0:1651529344.725368:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e73e2287/0x3234de053c4dde0 lrc: 4/0,0 mode: PR/PR res: [0x2ba18:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d28aa expref: 310 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.725368:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13042 00000100:00100000:0.0:1651529344.725370:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+310:41278:x1731746396412864:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.725373:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13043 00010000:00010000:0.0:1651529344.725373:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.725374:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+310:41279:x1731746396412928:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.725375:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006763a101/0x3234de053c4cec1 lrc: 4/0,0 mode: PR/PR res: [0x2ba12:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced0e expref: 310 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.725377:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.725378:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001b40f9f7/0x3234de053c4e52d lrc: 4/0,0 mode: PR/PR res: [0x2ba14:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d45bb expref: 310 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.725379:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006763a101/0x3234de053c4cec1 lrc: 3/0,0 mode: PR/PR res: [0x2ba12:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced0e expref: 310 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.725382:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001b40f9f7/0x3234de053c4e52d lrc: 3/0,0 mode: PR/PR res: [0x2ba14:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d45bb expref: 310 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.725385:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006763a101/0x3234de053c4cec1 lrc: 0/0,0 mode: --/PR res: [0x2ba12:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ced0e expref: 310 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.725388:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b40f9f7/0x3234de053c4e52d lrc: 0/0,0 mode: --/PR res: [0x2ba14:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d45bb expref: 310 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.725389:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.725389:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.725390:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c52824 lrc: 3/0,1 mode: PW/PW res: [0x2ba12:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.725391:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.725392:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.725393:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c5282b lrc: 3/0,1 mode: PW/PW res: [0x2ba14:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.725393:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c52824 lrc: 4/0,1 mode: PW/PW res: [0x2ba12:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.725396:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c5282b lrc: 4/0,1 mode: PW/PW res: [0x2ba14:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.725400:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.725402:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.725412:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+308:41278:x1731746396412864:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.725416:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13042 00000100:00100000:1.0:1651529344.725417:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+308:41279:x1731746396412928:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.725420:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13043 00000100:00100000:0.0:1651529344.725422:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13044 00000100:00100000:0.0:1651529344.725424:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d696796e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+306:41278:x1731746396412992:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.725425:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13045 00010000:00010000:0.0:1651529344.725426:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.725427:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+306:41279:x1731746396413056:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.725428:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000ef7974a/0x3234de053c4ee1e lrc: 4/0,0 mode: PR/PR res: [0x2ba16:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a90 expref: 306 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.725429:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.725431:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c4e0aa lrc: 4/0,0 mode: PR/PR res: [0x2ba17:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3323 expref: 306 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.725432:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000ef7974a/0x3234de053c4ee1e lrc: 3/0,0 mode: PR/PR res: [0x2ba16:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a90 expref: 306 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.725437:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c4e0aa lrc: 3/0,0 mode: PR/PR res: [0x2ba17:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3323 expref: 306 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.725437:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ef7974a/0x3234de053c4ee1e lrc: 0/0,0 mode: --/PR res: [0x2ba16:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6a90 expref: 306 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.725440:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.725441:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.725442:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c4e0aa lrc: 0/0,0 mode: --/PR res: [0x2ba17:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3323 expref: 305 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.725442:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c52832 lrc: 3/0,1 mode: PW/PW res: [0x2ba16:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.725445:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.725445:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c52832 lrc: 4/0,1 mode: PW/PW res: [0x2ba16:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.725446:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.725447:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52839 lrc: 3/0,1 mode: PW/PW res: [0x2ba17:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.725450:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52839 lrc: 4/0,1 mode: PW/PW res: [0x2ba17:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.725451:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.725455:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.725473:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+304:41279:x1731746396413056:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 45us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.725473:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d696796e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+304:41278:x1731746396412992:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 48us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.725475:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13045 00000100:00100000:0.0:1651529344.725477:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13044 00000100:00100000:1.0:1651529344.725480:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13046 00000100:00100000:1.0:1651529344.725481:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+302:41278:x1731746396413120:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.725484:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.725485:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e73e2287/0x3234de053c4dde0 lrc: 4/0,0 mode: PR/PR res: [0x2ba18:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d28aa expref: 302 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.725488:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c52824 lrc: 3/0,1 mode: PW/PW res: [0x2ba12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.725489:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e73e2287/0x3234de053c4dde0 lrc: 3/0,0 mode: PR/PR res: [0x2ba18:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d28aa expref: 302 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.725491:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c52824 lrc: 3/0,1 mode: PW/PW res: [0x2ba12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.725493:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e73e2287/0x3234de053c4dde0 lrc: 0/0,0 mode: --/PR res: [0x2ba18:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d28aa expref: 302 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.725497:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.725497:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.725497:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c52824 lrc: 3/0,1 mode: PW/PW res: [0x2ba12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.725498:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c52840 lrc: 3/0,1 mode: PW/PW res: [0x2ba18:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.725500:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c52824 lrc: 2/0,0 mode: PW/PW res: [0x2ba12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.725501:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c52840 lrc: 4/0,1 mode: PW/PW res: [0x2ba18:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.725514:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.725519:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:41278:x1731746396413120:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 37us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.725522:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13046 00010000:00010000:1.0:1651529344.725528:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c52824 lrc: 2/0,0 mode: PW/PW res: [0x2ba12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.725532:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000f18bca1 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.725533:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c52824 lrc: 2/0,0 mode: PW/PW res: [0x2ba12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.725536:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c52824 lrc: 3/0,0 mode: PW/PW res: [0x2ba12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.725540:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c52824 lrc: 1/0,0 mode: --/PW res: [0x2ba12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.725545:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c52824 lrc: 0/0,0 mode: --/PW res: [0x2ba12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.725548:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089bf9ab9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1759:39029:x1731745946531584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1075us (1174us total) trans 12885080315 rc 0/0 00010000:00010000:1.0:1651529344.725550:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52839 lrc: 3/0,1 mode: PW/PW res: [0x2ba17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.725551:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212260 00010000:00010000:1.0:1651529344.725553:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52839 lrc: 3/0,1 mode: PW/PW res: [0x2ba17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.725556:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52839 lrc: 3/0,1 mode: PW/PW res: [0x2ba17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.725559:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52839 lrc: 2/0,0 mode: PW/PW res: [0x2ba17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.725576:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52839 lrc: 2/0,0 mode: PW/PW res: [0x2ba17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.725580:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f9b62460 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.725581:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52839 lrc: 2/0,0 mode: PW/PW res: [0x2ba17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.725584:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52839 lrc: 3/0,0 mode: PW/PW res: [0x2ba17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.725589:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52839 lrc: 1/0,0 mode: --/PW res: [0x2ba17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.725591:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52839 lrc: 0/0,0 mode: --/PW res: [0x2ba17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.725597:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c52832 lrc: 3/0,1 mode: PW/PW res: [0x2ba16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.725600:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c52832 lrc: 3/0,1 mode: PW/PW res: [0x2ba16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.725601:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a13808c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1759:39029:x1731745946531904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 954us (1049us total) trans 12885080316 rc 0/0 00010000:00010000:0.0:1651529344.725603:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c52832 lrc: 3/0,1 mode: PW/PW res: [0x2ba16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.725604:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212263 00010000:00010000:0.0:1651529344.725606:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c52832 lrc: 2/0,0 mode: PW/PW res: [0x2ba16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.725610:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c5282b lrc: 3/0,1 mode: PW/PW res: [0x2ba14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.725613:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c5282b lrc: 3/0,1 mode: PW/PW res: [0x2ba14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.725617:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c5282b lrc: 3/0,1 mode: PW/PW res: [0x2ba14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.725622:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c5282b lrc: 2/0,0 mode: PW/PW res: [0x2ba14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.725642:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1760:39029:x1731745946531840:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1043us (1098us total) trans 12885080317 rc 0/0 00000100:00100000:0.0:1651529344.725645:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212262 00010000:00010000:0.0:1651529344.725652:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c52832 lrc: 2/0,0 mode: PW/PW res: [0x2ba16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.725654:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1759:39029:x1731745946531712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1058us (1121us total) trans 12885080318 rc 0/0 00010000:00010000:0.0:1651529344.725655:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000215144f2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.725656:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c52832 lrc: 2/0,0 mode: PW/PW res: [0x2ba16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.725657:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212261 00010000:00010000:0.0:1651529344.725658:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c52832 lrc: 3/0,0 mode: PW/PW res: [0x2ba16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.725663:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c5282b lrc: 2/0,0 mode: PW/PW res: [0x2ba14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.725663:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c52832 lrc: 1/0,0 mode: --/PW res: [0x2ba16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.725665:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c52832 lrc: 0/0,0 mode: --/PW res: [0x2ba16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.725667:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e7aaedb0 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.725668:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c5282b lrc: 2/0,0 mode: PW/PW res: [0x2ba14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.725671:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c5282b lrc: 3/0,0 mode: PW/PW res: [0x2ba14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.725671:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c52840 lrc: 3/0,1 mode: PW/PW res: [0x2ba18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.725674:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c52840 lrc: 3/0,1 mode: PW/PW res: [0x2ba18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.725675:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c5282b lrc: 1/0,0 mode: --/PW res: [0x2ba14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.725677:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c52840 lrc: 3/0,1 mode: PW/PW res: [0x2ba18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.725678:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c5282b lrc: 0/0,0 mode: --/PW res: [0x2ba14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.725679:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c52840 lrc: 2/0,0 mode: PW/PW res: [0x2ba18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.725684:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c52840 lrc: 2/0,0 mode: PW/PW res: [0x2ba18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.725687:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a032e9d0 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.725688:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c52840 lrc: 2/0,0 mode: PW/PW res: [0x2ba18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.725691:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c52840 lrc: 3/0,0 mode: PW/PW res: [0x2ba18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.725694:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c52840 lrc: 1/0,0 mode: --/PW res: [0x2ba18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.725697:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c52840 lrc: 0/0,0 mode: --/PW res: [0x2ba18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.725712:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1759:39030:x1731745946531968:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1047us (1154us total) trans 12885080319 rc 0/0 00000100:00100000:0.0:1651529344.725715:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212264 00000100:00100000:1.0:1651529344.725732:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.725759:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946532096 00000100:00100000:0.0:1651529344.725773:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212265 00000100:00100000:0.0:1651529344.725775:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1759:39030:x1731745946532096:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.725780:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178714 count 1 00010000:00010000:0.0:1651529344.725785:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c52847 lrc: 3/0,1 mode: --/PW res: [0x2ba1a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.725789:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000046a8479f/0x3234de053c4ee87 lrc: 2/0,0 mode: PR/PR res: [0x2ba1a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c1f expref: 300 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.725793:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.725793:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.725794:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c52847 lrc: 4/0,1 mode: --/PW res: [0x2ba1a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.725801:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000046a8479f/0x3234de053c4ee87 lrc: 3/0,0 mode: PR/PR res: [0x2ba1a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c1f expref: 300 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.725805:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000046a8479f/0x3234de053c4ee87 lrc: 4/0,0 mode: PR/PR res: [0x2ba1a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c1f expref: 300 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.725809:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d28c414b pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997051712:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.725824:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 0000000076b354b3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.725833:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.725852:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946532032 00000100:00100000:1.0:1651529344.725863:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212266 00000100:00100000:1.0:1651529344.725865:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1760:39030:x1731745946532032:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.725870:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178713 count 1 00010000:00010000:1.0:1651529344.725875:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c5284e lrc: 3/0,1 mode: --/PW res: [0x2ba19:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.725878:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.725879:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000969476e2/0x3234de053c4ccc9 lrc: 2/0,0 mode: PR/PR res: [0x2ba19:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce4ef expref: 300 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.725888:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.725889:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.725889:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c5284e lrc: 4/0,1 mode: --/PW res: [0x2ba19:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.725889:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946532160 00010000:00010000:1.0:1651529344.725897:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000969476e2/0x3234de053c4ccc9 lrc: 3/0,0 mode: PR/PR res: [0x2ba19:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce4ef expref: 300 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.725897:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212267 00000100:00100000:0.0:1651529344.725898:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1761:39030:x1731745946532160:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.725901:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000969476e2/0x3234de053c4ccc9 lrc: 4/0,0 mode: PR/PR res: [0x2ba19:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce4ef expref: 300 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:0.0:1651529344.725903:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178715 count 1 00000100:00100000:1.0:1651529344.725905:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006731397d pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997051776:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.725916:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 0000000053a0cffa going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.725921:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c52855 lrc: 3/0,1 mode: --/PW res: [0x2ba1b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.725926:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007dc8e624/0x3234de053c4d693 lrc: 2/0,0 mode: PR/PR res: [0x2ba1b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c09 expref: 300 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.725929:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.725929:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.725930:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.725931:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c52855 lrc: 4/0,1 mode: --/PW res: [0x2ba1b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.725940:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007dc8e624/0x3234de053c4d693 lrc: 3/0,0 mode: PR/PR res: [0x2ba1b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c09 expref: 300 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.725944:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007dc8e624/0x3234de053c4d693 lrc: 4/0,0 mode: PR/PR res: [0x2ba1b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c09 expref: 300 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.725948:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000064719963 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997051840:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.725972:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.725972:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000504ef660 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.725994:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946532224 00000100:00100000:1.0:1651529344.726012:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.726030:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.726040:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.726051:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946532288 00000100:00100000:1.0:1651529344.726055:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946532352 00000100:00100000:0.0:1651529344.726059:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946532480 00000100:00100000:0.0:1651529344.726064:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946532416 00000100:00100000:0.0:1651529344.726068:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212268 00000100:00100000:0.0:1651529344.726069:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1766:39030:x1731745946532224:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.726072:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212269 00000100:00100000:1.0:1651529344.726073:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085af61db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1766:39030:x1731745946532288:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.726074:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178716 count 1 00002000:00080000:1.0:1651529344.726078:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178717 count 1 00010000:00010000:0.0:1651529344.726078:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5285c lrc: 3/0,1 mode: --/PW res: [0x2ba1c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.726083:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c52863 lrc: 3/0,1 mode: --/PW res: [0x2ba1d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.726083:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000050c800b/0x3234de053c4ee2c lrc: 2/0,0 mode: PR/PR res: [0x2ba1c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ad6 expref: 300 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.726086:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.726087:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ecd4185b/0x3234de053c4d1c3 lrc: 2/0,0 mode: PR/PR res: [0x2ba1d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf8ad expref: 300 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.726087:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.726087:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5285c lrc: 4/0,1 mode: --/PW res: [0x2ba1c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.726090:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.726091:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.726092:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c52863 lrc: 4/0,1 mode: --/PW res: [0x2ba1d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.726093:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000050c800b/0x3234de053c4ee2c lrc: 3/0,0 mode: PR/PR res: [0x2ba1c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ad6 expref: 300 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.726097:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000050c800b/0x3234de053c4ee2c lrc: 4/0,0 mode: PR/PR res: [0x2ba1c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ad6 expref: 300 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.726098:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ecd4185b/0x3234de053c4d1c3 lrc: 3/0,0 mode: PR/PR res: [0x2ba1d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf8ad expref: 300 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.726101:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000822949b3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997051904:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.726102:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ecd4185b/0x3234de053c4d1c3 lrc: 4/0,0 mode: PR/PR res: [0x2ba1d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf8ad expref: 300 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.726106:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000de0edbdc pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997051968:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.726122:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c0dff858 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.726123:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b52d0f36 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.726130:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212270 00000100:00100000:0.0:1651529344.726131:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1766:39030:x1731745946532480:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.726132:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212271 00000100:00100000:1.0:1651529344.726133:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1766:39030:x1731745946532416:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.726136:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178720 count 1 00002000:00080000:1.0:1651529344.726137:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178719 count 1 00010000:00010000:0.0:1651529344.726139:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c5286a lrc: 3/0,1 mode: --/PW res: [0x2ba20:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.726140:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52871 lrc: 3/0,1 mode: --/PW res: [0x2ba1f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.726144:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000afed2b26/0x3234de053c4a05a lrc: 2/0,0 mode: PR/PR res: [0x2ba20:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb73e expref: 300 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.726145:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000097839e7/0x3234de053c4e35f lrc: 2/0,0 mode: PR/PR res: [0x2ba1f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e75 expref: 300 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.726147:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.726148:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.726148:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.726148:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.726148:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c5286a lrc: 4/0,1 mode: --/PW res: [0x2ba20:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.726149:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52871 lrc: 4/0,1 mode: --/PW res: [0x2ba1f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.726154:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000097839e7/0x3234de053c4e35f lrc: 3/0,0 mode: PR/PR res: [0x2ba1f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e75 expref: 300 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.726154:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000afed2b26/0x3234de053c4a05a lrc: 3/0,0 mode: PR/PR res: [0x2ba20:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb73e expref: 300 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.726157:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000097839e7/0x3234de053c4e35f lrc: 4/0,0 mode: PR/PR res: [0x2ba1f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e75 expref: 300 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.726158:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000afed2b26/0x3234de053c4a05a lrc: 4/0,0 mode: PR/PR res: [0x2ba20:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb73e expref: 300 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.726164:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b4acf60d pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997052032:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.726165:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000066de8c9f pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997052096:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.726170:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fb6c773d going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.726172:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aac87b31 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.726176:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212272 00000100:00100000:1.0:1651529344.726177:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1766:39030:x1731745946532352:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.726181:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178718 count 1 00010000:00010000:1.0:1651529344.726184:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c52878 lrc: 3/0,1 mode: --/PW res: [0x2ba1e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.726188:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c032d348/0x3234de053c4d941 lrc: 2/0,0 mode: PR/PR res: [0x2ba1e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d15b0 expref: 300 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.726191:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.726191:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.726192:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c52878 lrc: 4/0,1 mode: --/PW res: [0x2ba1e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.726197:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c032d348/0x3234de053c4d941 lrc: 3/0,0 mode: PR/PR res: [0x2ba1e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d15b0 expref: 300 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.726197:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d28c414b pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997051712:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.726201:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c032d348/0x3234de053c4d941 lrc: 4/0,0 mode: PR/PR res: [0x2ba1e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d15b0 expref: 300 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.726201:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c52847 lrc: 3/0,1 mode: --/PW res: [0x2ba1a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.726205:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002a1f5cf2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997052160:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.726210:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aeda71fe going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.726244:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.726263:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396413184 00000100:00100000:0.0:1651529344.726266:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.726274:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000046a8479f/0x3234de053c4ee87 lrc: 4/0,0 mode: PR/PR res: [0x2ba1a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c1f expref: 301 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.726275:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.726288:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396413248 00010000:00010000:1.0:1651529344.726291:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000969476e2/0x3234de053c4ccc9 lrc: 5/0,0 mode: PR/PR res: [0x2ba19:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce4ef expref: 302 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.726291:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000064719963 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997051840:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.726295:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c52855 lrc: 3/0,1 mode: --/PW res: [0x2ba1b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.726296:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396413312 00010000:00010000:1.0:1651529344.726298:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007dc8e624/0x3234de053c4d693 lrc: 4/0,0 mode: PR/PR res: [0x2ba1b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c09 expref: 303 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.726303:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13047 00000100:00100000:1.0:1651529344.726304:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13048 00000100:00100000:0.0:1651529344.726305:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+303:41278:x1731746396413184:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.726306:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+303:41279:x1731746396413248:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.726308:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.726309:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.726310:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000969476e2/0x3234de053c4ccc9 lrc: 5/0,0 mode: PR/PR res: [0x2ba19:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce4ef expref: 303 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.726310:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000046a8479f/0x3234de053c4ee87 lrc: 4/0,0 mode: PR/PR res: [0x2ba1a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c1f expref: 303 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.726314:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000969476e2/0x3234de053c4ccc9 lrc: 4/0,0 mode: PR/PR res: [0x2ba19:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce4ef expref: 303 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.726314:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000046a8479f/0x3234de053c4ee87 lrc: 3/0,0 mode: PR/PR res: [0x2ba1a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c1f expref: 303 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.726319:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046a8479f/0x3234de053c4ee87 lrc: 0/0,0 mode: --/PR res: [0x2ba1a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c1f expref: 303 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.726320:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.726320:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.726321:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c5284e lrc: 3/0,1 mode: PW/PW res: [0x2ba19:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.726323:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.726324:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c5284e lrc: 4/0,1 mode: PW/PW res: [0x2ba19:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.726324:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.726325:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c52847 lrc: 3/0,1 mode: PW/PW res: [0x2ba1a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.726327:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c52847 lrc: 4/0,1 mode: PW/PW res: [0x2ba1a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.726331:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.726334:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.726338:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+302:41279:x1731746396413248:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 31us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.726340:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+302:41278:x1731746396413184:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.726341:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13048 00000100:00100000:0.0:1651529344.726343:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13047 00000100:00100000:1.0:1651529344.726345:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13049 00000100:00100000:1.0:1651529344.726347:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+300:41279:x1731746396413312:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.726349:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.726350:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007dc8e624/0x3234de053c4d693 lrc: 4/0,0 mode: PR/PR res: [0x2ba1b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c09 expref: 300 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.726350:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c52847 lrc: 3/0,1 mode: PW/PW res: [0x2ba1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.726353:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c52847 lrc: 3/0,1 mode: PW/PW res: [0x2ba1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.726354:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007dc8e624/0x3234de053c4d693 lrc: 3/0,0 mode: PR/PR res: [0x2ba1b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c09 expref: 300 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.726356:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c52847 lrc: 3/0,1 mode: PW/PW res: [0x2ba1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.726358:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007dc8e624/0x3234de053c4d693 lrc: 0/0,0 mode: --/PR res: [0x2ba1b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0c09 expref: 300 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.726359:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c52847 lrc: 2/0,0 mode: PW/PW res: [0x2ba1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.726361:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.726362:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.726363:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c52855 lrc: 3/0,1 mode: PW/PW res: [0x2ba1b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.726366:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c52855 lrc: 4/0,1 mode: PW/PW res: [0x2ba1b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.726374:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.726379:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+299:41279:x1731746396413312:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 32us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.726382:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13049 00010000:00010000:1.0:1651529344.726392:0:72396:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000969476e2/0x3234de053c4ccc9 lrc: 0/0,0 mode: --/PR res: [0x2ba19:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce4ef expref: 298 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.726395:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006731397d pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997051776:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.726399:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c5284e lrc: 3/0,1 mode: PW/PW res: [0x2ba19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.726402:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c5284e lrc: 3/0,1 mode: PW/PW res: [0x2ba19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.726405:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c5284e lrc: 3/0,1 mode: PW/PW res: [0x2ba19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.726407:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1767:39030:x1731745946532096:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 630us (675us total) trans 12885080320 rc 0/0 00010000:00010000:1.0:1651529344.726408:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c5284e lrc: 3/0,1 mode: PW/PW res: [0x2ba19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.726410:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c5284e lrc: 2/0,0 mode: PW/PW res: [0x2ba19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.726410:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212265 00010000:00010000:0.0:1651529344.726416:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c52847 lrc: 2/0,0 mode: PW/PW res: [0x2ba1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.726420:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d1167ce5 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.726421:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c52847 lrc: 2/0,0 mode: PW/PW res: [0x2ba1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.726424:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c52847 lrc: 3/0,0 mode: PW/PW res: [0x2ba1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.726428:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c52847 lrc: 1/0,0 mode: --/PW res: [0x2ba1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.726431:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c52847 lrc: 0/0,0 mode: --/PW res: [0x2ba1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.726435:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c5284e lrc: 2/0,0 mode: PW/PW res: [0x2ba19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.726438:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004dda5a3f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.726439:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c5284e lrc: 2/0,0 mode: PW/PW res: [0x2ba19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.726442:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c5284e lrc: 3/0,0 mode: PW/PW res: [0x2ba19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.726445:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c5284e lrc: 1/0,0 mode: --/PW res: [0x2ba19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.726449:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1767:39030:x1731745946532032:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 583us (616us total) trans 12885080321 rc 0/0 00010000:00010000:0.0:1651529344.726450:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c5284e lrc: 0/0,0 mode: --/PW res: [0x2ba19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.726452:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212266 00010000:00010000:0.0:1651529344.726455:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c52855 lrc: 3/0,1 mode: PW/PW res: [0x2ba1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.726457:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c52855 lrc: 3/0,1 mode: PW/PW res: [0x2ba1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.726461:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c52855 lrc: 3/0,1 mode: PW/PW res: [0x2ba1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.726463:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c52855 lrc: 2/0,0 mode: PW/PW res: [0x2ba1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.726497:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1767:39030:x1731745946532160:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 598us (620us total) trans 12885080322 rc 0/0 00000100:00100000:0.0:1651529344.726500:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212267 00010000:00010000:0.0:1651529344.726507:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c52855 lrc: 2/0,0 mode: PW/PW res: [0x2ba1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.726510:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e4f40ecf already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.726511:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c52855 lrc: 2/0,0 mode: PW/PW res: [0x2ba1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.726514:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c52855 lrc: 3/0,0 mode: PW/PW res: [0x2ba1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.726518:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c52855 lrc: 1/0,0 mode: --/PW res: [0x2ba1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.726521:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c52855 lrc: 0/0,0 mode: --/PW res: [0x2ba1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.726662:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000822949b3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997051904:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.726666:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5285c lrc: 3/0,1 mode: --/PW res: [0x2ba1c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.726680:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.726697:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.726709:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.726729:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946532608 00000100:00100000:1.0:1651529344.726733:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000de0edbdc pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997051968:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.726745:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946532544 00000100:00100000:0.0:1651529344.726751:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946532672 00000100:00100000:0.0:1651529344.726757:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212273 00010000:00010000:1.0:1651529344.726758:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c52863 lrc: 3/0,1 mode: --/PW res: [0x2ba1d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.726759:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1769:39030:x1731745946532608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.726764:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178722 count 1 00000100:00100000:1.0:1651529344.726767:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212274 00010000:00010000:0.0:1651529344.726768:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c5287f lrc: 3/0,1 mode: --/PW res: [0x2ba22:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.726769:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1769:39030:x1731745946532544:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.726773:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000441232d4/0x3234de053c4f2b6 lrc: 2/0,0 mode: PR/PR res: [0x2ba22:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7dad expref: 297 pid: 72396 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.726774:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178721 count 1 00010000:00010000:0.0:1651529344.726776:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.726777:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.726778:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c52886 lrc: 3/0,1 mode: --/PW res: [0x2ba21:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.726778:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c5287f lrc: 4/0,1 mode: --/PW res: [0x2ba22:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.726782:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000023d83c3/0x3234de053c4dbb7 lrc: 2/0,0 mode: PR/PR res: [0x2ba21:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ee0 expref: 297 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.726785:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.726786:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.726786:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c52886 lrc: 4/0,1 mode: --/PW res: [0x2ba21:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.726787:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000441232d4/0x3234de053c4f2b6 lrc: 3/0,0 mode: PR/PR res: [0x2ba22:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7dad expref: 297 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.726790:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000441232d4/0x3234de053c4f2b6 lrc: 4/0,0 mode: PR/PR res: [0x2ba22:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7dad expref: 297 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.726793:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000023d83c3/0x3234de053c4dbb7 lrc: 3/0,0 mode: PR/PR res: [0x2ba21:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ee0 expref: 297 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.726794:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005a17dd72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997052224:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.726796:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000023d83c3/0x3234de053c4dbb7 lrc: 4/0,0 mode: PR/PR res: [0x2ba21:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ee0 expref: 297 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.726801:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ea0220b6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997052288:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.726808:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000504ef660 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.726815:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212275 00000100:00100000:1.0:1651529344.726816:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b52d0f36 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.726816:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1769:39030:x1731745946532672:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.726821:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178723 count 1 00000100:00100000:1.0:1651529344.726823:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b4acf60d pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997052032:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.726824:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c5288d lrc: 3/0,1 mode: --/PW res: [0x2ba23:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.726827:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52871 lrc: 3/0,1 mode: --/PW res: [0x2ba1f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.726828:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000092b30684/0x3234de053c4f365 lrc: 2/0,0 mode: PR/PR res: [0x2ba23:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8054 expref: 297 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.726831:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.726832:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.726832:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c5288d lrc: 4/0,1 mode: --/PW res: [0x2ba23:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.726839:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000092b30684/0x3234de053c4f365 lrc: 3/0,0 mode: PR/PR res: [0x2ba23:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8054 expref: 297 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.726842:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000092b30684/0x3234de053c4f365 lrc: 4/0,0 mode: PR/PR res: [0x2ba23:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8054 expref: 297 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.726846:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000822949b3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997052352:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.726853:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 0000000076b354b3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.726919:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000066de8c9f pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997052096:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.726922:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.726923:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c5286a lrc: 3/0,1 mode: --/PW res: [0x2ba20:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.726930:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.726936:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.726942:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.726950:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.726950:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396413504 00010000:00010000:0.0:1651529344.726955:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000097839e7/0x3234de053c4e35f lrc: 4/0,0 mode: PR/PR res: [0x2ba1f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e75 expref: 298 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.726958:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002a1f5cf2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997052160:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.726961:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396413376 00010000:00010000:1.0:1651529344.726962:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c52878 lrc: 3/0,1 mode: --/PW res: [0x2ba1e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.726963:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000050c800b/0x3234de053c4ee2c lrc: 4/0,0 mode: PR/PR res: [0x2ba1c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ad6 expref: 299 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.726968:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396413568 00000100:00100000:1.0:1651529344.726969:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396413440 00010000:00010000:0.0:1651529344.726970:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000afed2b26/0x3234de053c4a05a lrc: 4/0,0 mode: PR/PR res: [0x2ba20:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb73e expref: 300 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.726974:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ecd4185b/0x3234de053c4d1c3 lrc: 4/0,0 mode: PR/PR res: [0x2ba1d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf8ad expref: 301 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.726974:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396413632 00010000:00010000:0.0:1651529344.726976:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c032d348/0x3234de053c4d941 lrc: 4/0,0 mode: PR/PR res: [0x2ba1e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d15b0 expref: 302 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.726980:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13050 00000100:00100000:1.0:1651529344.726982:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+302:41279:x1731746396413504:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.726983:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13051 00010000:00010000:1.0:1651529344.726984:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.726986:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000097839e7/0x3234de053c4e35f lrc: 4/0,0 mode: PR/PR res: [0x2ba1f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e75 expref: 302 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.726989:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000097839e7/0x3234de053c4e35f lrc: 3/0,0 mode: PR/PR res: [0x2ba1f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e75 expref: 302 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.726995:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000097839e7/0x3234de053c4e35f lrc: 0/0,0 mode: --/PR res: [0x2ba1f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e75 expref: 302 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.726999:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.726999:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.727000:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52871 lrc: 3/0,1 mode: PW/PW res: [0x2ba1f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.727001:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000534d68d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:41278:x1731746396413376:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.727003:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52871 lrc: 4/0,1 mode: PW/PW res: [0x2ba1f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.727005:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.727006:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000050c800b/0x3234de053c4ee2c lrc: 4/0,0 mode: PR/PR res: [0x2ba1c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ad6 expref: 301 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.727009:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.727010:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000050c800b/0x3234de053c4ee2c lrc: 3/0,0 mode: PR/PR res: [0x2ba1c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ad6 expref: 301 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.727017:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+301:41279:x1731746396413504:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.727020:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13050 00000100:00100000:1.0:1651529344.727025:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13052 00000100:00100000:1.0:1651529344.727026:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+300:41279:x1731746396413568:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.727026:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000050c800b/0x3234de053c4ee2c lrc: 0/0,0 mode: --/PR res: [0x2ba1c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ad6 expref: 300 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.727029:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.727030:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000afed2b26/0x3234de053c4a05a lrc: 4/0,0 mode: PR/PR res: [0x2ba20:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb73e expref: 299 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.727030:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.727031:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.727032:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5285c lrc: 3/0,1 mode: PW/PW res: [0x2ba1c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.727034:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000afed2b26/0x3234de053c4a05a lrc: 3/0,0 mode: PR/PR res: [0x2ba20:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb73e expref: 299 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.727035:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5285c lrc: 4/0,1 mode: PW/PW res: [0x2ba1c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.727038:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000afed2b26/0x3234de053c4a05a lrc: 0/0,0 mode: --/PR res: [0x2ba20:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb73e expref: 299 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.727042:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.727042:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.727042:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.727043:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c5286a lrc: 3/0,1 mode: PW/PW res: [0x2ba20:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.727046:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c5286a lrc: 4/0,1 mode: PW/PW res: [0x2ba20:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.727049:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000534d68d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+298:41278:x1731746396413376:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 48us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.727052:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13051 00010000:00010000:1.0:1651529344.727055:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.727061:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+298:41279:x1731746396413568:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 33us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.727063:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13052 00000100:00100000:1.0:1651529344.727067:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13053 00000100:00100000:1.0:1651529344.727069:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+296:41278:x1731746396413440:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.727069:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13054 00010000:00010000:1.0:1651529344.727071:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.727071:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+296:41278:x1731746396413632:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.727073:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ecd4185b/0x3234de053c4d1c3 lrc: 4/0,0 mode: PR/PR res: [0x2ba1d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf8ad expref: 296 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.727074:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.727076:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ecd4185b/0x3234de053c4d1c3 lrc: 3/0,0 mode: PR/PR res: [0x2ba1d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf8ad expref: 296 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.727076:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c032d348/0x3234de053c4d941 lrc: 4/0,0 mode: PR/PR res: [0x2ba1e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d15b0 expref: 296 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.727079:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c032d348/0x3234de053c4d941 lrc: 3/0,0 mode: PR/PR res: [0x2ba1e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d15b0 expref: 296 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.727081:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ecd4185b/0x3234de053c4d1c3 lrc: 0/0,0 mode: --/PR res: [0x2ba1d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf8ad expref: 296 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.727084:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.727084:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.727085:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c52863 lrc: 3/0,1 mode: PW/PW res: [0x2ba1d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.727085:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c032d348/0x3234de053c4d941 lrc: 0/0,0 mode: --/PR res: [0x2ba1e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d15b0 expref: 295 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.727088:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.727089:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.727089:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c52878 lrc: 3/0,1 mode: PW/PW res: [0x2ba1e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.727091:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c52863 lrc: 4/0,1 mode: PW/PW res: [0x2ba1d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.727092:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c52878 lrc: 4/0,1 mode: PW/PW res: [0x2ba1e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.727096:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.727107:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+294:41278:x1731746396413440:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 37us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.727110:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13053 00010000:00010000:0.0:1651529344.727112:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.727117:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52871 lrc: 3/0,1 mode: PW/PW res: [0x2ba1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.727119:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+293:41278:x1731746396413632:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 47us (168us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.727120:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52871 lrc: 3/0,1 mode: PW/PW res: [0x2ba1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.727123:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52871 lrc: 3/0,1 mode: PW/PW res: [0x2ba1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.727126:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52871 lrc: 2/0,0 mode: PW/PW res: [0x2ba1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.727137:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13054 00010000:00010000:0.0:1651529344.727144:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5285c lrc: 3/0,1 mode: PW/PW res: [0x2ba1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.727148:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5285c lrc: 3/0,1 mode: PW/PW res: [0x2ba1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.727151:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5285c lrc: 3/0,1 mode: PW/PW res: [0x2ba1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.727153:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5285c lrc: 2/0,0 mode: PW/PW res: [0x2ba1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.727176:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1770:39030:x1731745946532416:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1041us (1135us total) trans 12885080323 rc 0/0 00000100:00100000:1.0:1651529344.727179:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212271 00010000:00010000:1.0:1651529344.727185:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c52863 lrc: 3/0,1 mode: PW/PW res: [0x2ba1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.727188:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c52863 lrc: 3/0,1 mode: PW/PW res: [0x2ba1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.727192:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c52863 lrc: 3/0,1 mode: PW/PW res: [0x2ba1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.727195:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c52863 lrc: 2/0,0 mode: PW/PW res: [0x2ba1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.727217:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1771:39030:x1731745946532224:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1146us (1287us total) trans 12885080324 rc 0/0 00000100:00100000:0.0:1651529344.727220:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212268 00010000:00010000:0.0:1651529344.727243:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52871 lrc: 2/0,0 mode: PW/PW res: [0x2ba1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.727247:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006cbd0d09 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.727248:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52871 lrc: 2/0,0 mode: PW/PW res: [0x2ba1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.727251:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085af61db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1770:39030:x1731745946532288:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1176us (1278us total) trans 12885080325 rc 0/0 00010000:00010000:0.0:1651529344.727251:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52871 lrc: 3/0,0 mode: PW/PW res: [0x2ba1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.727254:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212269 00010000:00010000:0.0:1651529344.727256:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52871 lrc: 1/0,0 mode: --/PW res: [0x2ba1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.727258:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52871 lrc: 0/0,0 mode: --/PW res: [0x2ba1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.727261:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5285c lrc: 2/0,0 mode: PW/PW res: [0x2ba1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.727263:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c52863 lrc: 2/0,0 mode: PW/PW res: [0x2ba1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.727264:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d37a9fd1 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.727265:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5285c lrc: 2/0,0 mode: PW/PW res: [0x2ba1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.727266:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dd6b1be4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.727267:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c52863 lrc: 2/0,0 mode: PW/PW res: [0x2ba1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.727268:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5285c lrc: 3/0,0 mode: PW/PW res: [0x2ba1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.727272:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c52863 lrc: 3/0,0 mode: PW/PW res: [0x2ba1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.727273:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5285c lrc: 1/0,0 mode: --/PW res: [0x2ba1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.727275:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c52863 lrc: 1/0,0 mode: --/PW res: [0x2ba1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.727276:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5285c lrc: 0/0,0 mode: --/PW res: [0x2ba1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.727278:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c52863 lrc: 0/0,0 mode: --/PW res: [0x2ba1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.727284:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c52878 lrc: 3/0,1 mode: PW/PW res: [0x2ba1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.727284:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c5286a lrc: 3/0,1 mode: PW/PW res: [0x2ba20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.727286:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c5286a lrc: 3/0,1 mode: PW/PW res: [0x2ba20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.727287:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c52878 lrc: 3/0,1 mode: PW/PW res: [0x2ba1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.727289:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c5286a lrc: 3/0,1 mode: PW/PW res: [0x2ba20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.727290:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c52878 lrc: 3/0,1 mode: PW/PW res: [0x2ba1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.727292:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c5286a lrc: 2/0,0 mode: PW/PW res: [0x2ba20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.727293:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c52878 lrc: 2/0,0 mode: PW/PW res: [0x2ba1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.727339:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1771:39030:x1731745946532480:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1206us (1308us total) trans 12885080326 rc 0/0 00000100:00100000:1.0:1651529344.727340:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1771:39030:x1731745946532352:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1162us (1328us total) trans 12885080327 rc 0/0 00000100:00100000:0.0:1651529344.727342:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212270 00000100:00100000:1.0:1651529344.727343:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212272 00010000:00010000:0.0:1651529344.727349:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c5286a lrc: 2/0,0 mode: PW/PW res: [0x2ba20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.727351:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c52878 lrc: 2/0,0 mode: PW/PW res: [0x2ba1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.727354:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004b2a6b06 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.727354:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c660975a already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.727355:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c52878 lrc: 2/0,0 mode: PW/PW res: [0x2ba1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.727356:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c5286a lrc: 2/0,0 mode: PW/PW res: [0x2ba20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.727358:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c52878 lrc: 3/0,0 mode: PW/PW res: [0x2ba1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.727358:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c5286a lrc: 3/0,0 mode: PW/PW res: [0x2ba20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.727362:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c52878 lrc: 1/0,0 mode: --/PW res: [0x2ba1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.727363:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c5286a lrc: 1/0,0 mode: --/PW res: [0x2ba20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.727365:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c52878 lrc: 0/0,0 mode: --/PW res: [0x2ba1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.727365:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c5286a lrc: 0/0,0 mode: --/PW res: [0x2ba20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.727450:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005a17dd72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997052224:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.727454:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c5287f lrc: 3/0,1 mode: --/PW res: [0x2ba22:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.727458:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.727463:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396413696 00010000:00010000:0.0:1651529344.727468:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000441232d4/0x3234de053c4f2b6 lrc: 4/0,0 mode: PR/PR res: [0x2ba22:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7dad expref: 293 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.727471:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.727483:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396413760 00010000:00010000:0.0:1651529344.727486:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000023d83c3/0x3234de053c4dbb7 lrc: 5/0,0 mode: PR/PR res: [0x2ba21:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ee0 expref: 294 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.727496:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.727511:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ea0220b6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997052288:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.727515:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c52886 lrc: 3/0,1 mode: --/PW res: [0x2ba21:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.727515:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396413824 00010000:00010000:0.0:1651529344.727518:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000092b30684/0x3234de053c4f365 lrc: 5/0,0 mode: PR/PR res: [0x2ba23:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8054 expref: 295 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.727523:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13055 00000100:00100000:1.0:1651529344.727525:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+295:41278:x1731746396413696:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.727526:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13056 00000100:00100000:0.0:1651529344.727527:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+295:41278:x1731746396413760:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.727528:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.727530:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000441232d4/0x3234de053c4f2b6 lrc: 4/0,0 mode: PR/PR res: [0x2ba22:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7dad expref: 295 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.727531:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.727532:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000023d83c3/0x3234de053c4dbb7 lrc: 4/0,0 mode: PR/PR res: [0x2ba21:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ee0 expref: 295 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.727534:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000441232d4/0x3234de053c4f2b6 lrc: 3/0,0 mode: PR/PR res: [0x2ba22:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7dad expref: 295 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.727536:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000023d83c3/0x3234de053c4dbb7 lrc: 3/0,0 mode: PR/PR res: [0x2ba21:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ee0 expref: 295 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.727539:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000441232d4/0x3234de053c4f2b6 lrc: 0/0,0 mode: --/PR res: [0x2ba22:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7dad expref: 295 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.727541:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000023d83c3/0x3234de053c4dbb7 lrc: 0/0,0 mode: --/PR res: [0x2ba21:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1ee0 expref: 295 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.727543:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.727544:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.727544:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c5287f lrc: 3/0,1 mode: PW/PW res: [0x2ba22:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.727545:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.727545:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.727546:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c52886 lrc: 3/0,1 mode: PW/PW res: [0x2ba21:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.727547:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c5287f lrc: 4/0,1 mode: PW/PW res: [0x2ba22:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.727549:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c52886 lrc: 4/0,1 mode: PW/PW res: [0x2ba21:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.727562:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.727564:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.727573:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+293:41278:x1731746396413696:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 47us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.727576:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13055 00000100:00100000:0.0:1651529344.727577:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+293:41278:x1731746396413760:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 48us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.727579:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13056 00000100:00100000:1.0:1651529344.727582:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13057 00000100:00100000:1.0:1651529344.727583:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+291:41278:x1731746396413824:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.727586:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.727588:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000092b30684/0x3234de053c4f365 lrc: 5/0,0 mode: PR/PR res: [0x2ba23:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8054 expref: 291 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.727589:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000822949b3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997052352:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.727592:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000092b30684/0x3234de053c4f365 lrc: 3/0,0 mode: PR/PR res: [0x2ba23:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8054 expref: 291 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.727595:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c5288d lrc: 3/0,1 mode: --/PW res: [0x2ba23:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.727597:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092b30684/0x3234de053c4f365 lrc: 0/0,0 mode: --/PR res: [0x2ba23:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8054 expref: 291 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.727600:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.727601:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.727602:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c5288d lrc: 3/0,1 mode: PW/PW res: [0x2ba23:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.727604:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c5288d lrc: 4/0,1 mode: PW/PW res: [0x2ba23:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.727609:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.727617:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c5288d lrc: 3/0,1 mode: PW/PW res: [0x2ba23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.727620:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+290:41278:x1731746396413824:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.727623:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13057 00010000:00010000:0.0:1651529344.727628:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c5288d lrc: 3/0,1 mode: PW/PW res: [0x2ba23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.727629:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c52886 lrc: 3/0,1 mode: PW/PW res: [0x2ba21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.727632:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c5288d lrc: 3/0,1 mode: PW/PW res: [0x2ba23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.727633:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c52886 lrc: 3/0,1 mode: PW/PW res: [0x2ba21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.727634:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c5288d lrc: 2/0,0 mode: PW/PW res: [0x2ba23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.727636:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c52886 lrc: 3/0,1 mode: PW/PW res: [0x2ba21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.727638:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c52886 lrc: 2/0,0 mode: PW/PW res: [0x2ba21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.727675:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1771:39030:x1731745946532544:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 906us (978us total) trans 12885080329 rc 0/0 00000100:00100000:1.0:1651529344.727678:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212274 00010000:00010000:1.0:1651529344.727685:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c5288d lrc: 2/0,0 mode: PW/PW res: [0x2ba23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.727686:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1770:39030:x1731745946532672:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 869us (976us total) trans 12885080328 rc 0/0 00010000:00010000:1.0:1651529344.727688:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009fff0bd3 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.727689:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c5288d lrc: 2/0,0 mode: PW/PW res: [0x2ba23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.727689:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212275 00010000:00010000:1.0:1651529344.727692:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c5288d lrc: 3/0,0 mode: PW/PW res: [0x2ba23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.727696:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c5288d lrc: 1/0,0 mode: --/PW res: [0x2ba23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.727697:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c52886 lrc: 2/0,0 mode: PW/PW res: [0x2ba21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.727699:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c5288d lrc: 0/0,0 mode: --/PW res: [0x2ba23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.727700:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cd5f3a7c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.727701:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c52886 lrc: 2/0,0 mode: PW/PW res: [0x2ba21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.727704:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c52886 lrc: 3/0,0 mode: PW/PW res: [0x2ba21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.727711:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c52886 lrc: 1/0,0 mode: --/PW res: [0x2ba21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.727714:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c52886 lrc: 0/0,0 mode: --/PW res: [0x2ba21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.727720:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c5287f lrc: 3/0,1 mode: PW/PW res: [0x2ba22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.727723:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c5287f lrc: 3/0,1 mode: PW/PW res: [0x2ba22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.727726:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c5287f lrc: 3/0,1 mode: PW/PW res: [0x2ba22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.727728:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c5287f lrc: 2/0,0 mode: PW/PW res: [0x2ba22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.727744:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.727761:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.727772:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.727781:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1770:39030:x1731745946532608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1021us (1101us total) trans 12885080330 rc 0/0 00000100:00100000:1.0:1651529344.727783:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.727784:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212273 00000100:00100000:1.0:1651529344.727796:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.727796:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946532800 00000100:00100000:0.0:1651529344.727802:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946532928 00000100:00100000:0.0:1651529344.727808:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946532736 00000100:00100000:0.0:1651529344.727814:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946532864 00000100:00100000:0.0:1651529344.727818:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946532992 00000100:00100000:0.0:1651529344.727822:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212276 00000100:00100000:0.0:1651529344.727824:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1774:39029:x1731745946532800:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.727829:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178725 count 1 00010000:00010000:0.0:1651529344.727833:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52894 lrc: 3/0,1 mode: --/PW res: [0x2ba25:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.727838:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000854e993d/0x3234de053c4c766 lrc: 2/0,0 mode: PR/PR res: [0x2ba25:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccfda expref: 289 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.727841:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.727842:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.727843:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52894 lrc: 4/0,1 mode: --/PW res: [0x2ba25:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.727849:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000854e993d/0x3234de053c4c766 lrc: 3/0,0 mode: PR/PR res: [0x2ba25:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccfda expref: 289 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.727853:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000854e993d/0x3234de053c4c766 lrc: 4/0,0 mode: PR/PR res: [0x2ba25:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccfda expref: 289 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.727856:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212277 00000100:00100000:0.0:1651529344.727857:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000822949b3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997052416:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.727858:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1774:39029:x1731745946532928:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.727864:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178727 count 1 00000100:00100000:0.0:1651529344.727870:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000afe7ff7b going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.727874:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5289b lrc: 3/0,1 mode: --/PW res: [0x2ba27:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.727876:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c5287f lrc: 2/0,0 mode: PW/PW res: [0x2ba22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.727879:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c3080ea5/0x3234de053c4c7eb lrc: 2/0,0 mode: PR/PR res: [0x2ba27:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd1e0 expref: 289 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.727879:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cde7e11a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.727880:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c5287f lrc: 2/0,0 mode: PW/PW res: [0x2ba22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.727882:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.727883:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.727883:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5289b lrc: 4/0,1 mode: --/PW res: [0x2ba27:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.727885:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c5287f lrc: 3/0,0 mode: PW/PW res: [0x2ba22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.727890:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c3080ea5/0x3234de053c4c7eb lrc: 3/0,0 mode: PR/PR res: [0x2ba27:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd1e0 expref: 289 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.727894:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c3080ea5/0x3234de053c4c7eb lrc: 4/0,0 mode: PR/PR res: [0x2ba27:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd1e0 expref: 289 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.727898:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bc420ca1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997052480:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.727905:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c5287f lrc: 1/0,0 mode: --/PW res: [0x2ba22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.727907:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b52d0f36 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.727908:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c5287f lrc: 0/0,0 mode: --/PW res: [0x2ba22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.727913:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212278 00000100:00100000:1.0:1651529344.727915:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1774:39029:x1731745946532736:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.727918:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212279 00002000:00080000:1.0:1651529344.727919:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178724 count 1 00000100:00100000:0.0:1651529344.727920:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1774:39029:x1731745946532864:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.727923:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c528a2 lrc: 3/0,1 mode: --/PW res: [0x2ba24:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.727925:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178726 count 1 00010000:00010000:1.0:1651529344.727927:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000112d61c0/0x3234de053c4ee80 lrc: 2/0,0 mode: PR/PR res: [0x2ba24:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c0a expref: 289 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.727928:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c528a9 lrc: 3/0,1 mode: --/PW res: [0x2ba26:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.727930:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.727930:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.727931:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c528a2 lrc: 4/0,1 mode: --/PW res: [0x2ba24:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.727932:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004ea2468b/0x3234de053c4f6a6 lrc: 2/0,0 mode: PR/PR res: [0x2ba26:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d74 expref: 289 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.727935:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.727935:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.727936:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000112d61c0/0x3234de053c4ee80 lrc: 3/0,0 mode: PR/PR res: [0x2ba24:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c0a expref: 289 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.727936:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c528a9 lrc: 4/0,1 mode: --/PW res: [0x2ba26:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.727940:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000112d61c0/0x3234de053c4ee80 lrc: 4/0,0 mode: PR/PR res: [0x2ba24:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c0a expref: 289 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.727943:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c9f4ec84 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997052544:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.727943:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004ea2468b/0x3234de053c4f6a6 lrc: 3/0,0 mode: PR/PR res: [0x2ba26:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d74 expref: 289 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.727946:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004ea2468b/0x3234de053c4f6a6 lrc: 4/0,0 mode: PR/PR res: [0x2ba26:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d74 expref: 289 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.727949:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 0000000020dd7827 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.727951:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000be0ace91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997052608:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.727955:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212280 00000100:00100000:1.0:1651529344.727957:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1774:39029:x1731745946532992:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.727959:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000003003c8b0 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.727961:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178728 count 1 00010000:00010000:1.0:1651529344.727964:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c528b0 lrc: 3/0,1 mode: --/PW res: [0x2ba28:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.727968:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dc73c07f/0x3234de053c4e573 lrc: 2/0,0 mode: PR/PR res: [0x2ba28:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4719 expref: 289 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.727970:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.727971:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.727972:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c528b0 lrc: 4/0,1 mode: --/PW res: [0x2ba28:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.727977:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dc73c07f/0x3234de053c4e573 lrc: 3/0,0 mode: PR/PR res: [0x2ba28:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4719 expref: 289 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.727981:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dc73c07f/0x3234de053c4e573 lrc: 4/0,0 mode: PR/PR res: [0x2ba28:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4719 expref: 289 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.727984:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009acffcb8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997052672:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.727990:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aeda71fe going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.728031:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.728057:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.728067:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.728073:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946533056 00000100:00100000:1.0:1651529344.728080:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946533120 00000100:00100000:1.0:1651529344.728087:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946533184 00000100:00100000:1.0:1651529344.728093:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212281 00000100:00100000:1.0:1651529344.728095:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1777:39029:x1731745946533056:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.728099:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212282 00002000:00080000:1.0:1651529344.728100:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178729 count 1 00000100:00100000:0.0:1651529344.728102:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1777:39029:x1731745946533120:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.728104:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c528b7 lrc: 3/0,1 mode: --/PW res: [0x2ba29:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.728107:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178730 count 1 00010000:00010000:1.0:1651529344.728108:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000158a383a/0x3234de053c4c0c8 lrc: 2/0,0 mode: PR/PR res: [0x2ba29:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc7c9 expref: 289 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.728111:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.728111:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c528be lrc: 3/0,1 mode: --/PW res: [0x2ba2a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.728112:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.728113:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c528b7 lrc: 4/0,1 mode: --/PW res: [0x2ba29:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.728116:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000770c80bc/0x3234de053c4d876 lrc: 2/0,0 mode: PR/PR res: [0x2ba2a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d12c3 expref: 289 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.728119:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000158a383a/0x3234de053c4c0c8 lrc: 3/0,0 mode: PR/PR res: [0x2ba29:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc7c9 expref: 289 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.728119:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.728120:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.728120:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c528be lrc: 4/0,1 mode: --/PW res: [0x2ba2a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.728122:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000158a383a/0x3234de053c4c0c8 lrc: 4/0,0 mode: PR/PR res: [0x2ba29:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc7c9 expref: 289 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.728126:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000086eaa330 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997052736:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.728127:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000770c80bc/0x3234de053c4d876 lrc: 3/0,0 mode: PR/PR res: [0x2ba2a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d12c3 expref: 289 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.728131:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000770c80bc/0x3234de053c4d876 lrc: 4/0,0 mode: PR/PR res: [0x2ba2a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d12c3 expref: 289 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.728135:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004534b316 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997052800:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.728139:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e5f43e7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.728145:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212283 00000100:00100000:1.0:1651529344.728147:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1777:39029:x1731745946533184:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.728149:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b81e4a0 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.728151:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178731 count 1 00010000:00010000:1.0:1651529344.728154:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c528c5 lrc: 3/0,1 mode: --/PW res: [0x2ba2b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.728161:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c77a8fb3/0x3234de053c4eb54 lrc: 2/0,0 mode: PR/PR res: [0x2ba2b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ed5 expref: 289 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.728164:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.728165:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.728165:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c528c5 lrc: 4/0,1 mode: --/PW res: [0x2ba2b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.728171:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c77a8fb3/0x3234de053c4eb54 lrc: 3/0,0 mode: PR/PR res: [0x2ba2b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ed5 expref: 289 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.728174:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c77a8fb3/0x3234de053c4eb54 lrc: 4/0,0 mode: PR/PR res: [0x2ba2b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ed5 expref: 289 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.728187:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006929eb96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997052864:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.728197:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000babe2d90 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.728459:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bc420ca1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997052480:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.728464:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5289b lrc: 3/0,1 mode: --/PW res: [0x2ba27:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.728483:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c9f4ec84 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997052544:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.728486:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c528a2 lrc: 3/0,1 mode: --/PW res: [0x2ba24:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.728511:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009acffcb8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997052672:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.728512:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.728515:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c528b0 lrc: 3/0,1 mode: --/PW res: [0x2ba28:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.728522:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.728530:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.728537:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396413952 00000100:00100000:0.0:1651529344.728538:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.728542:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c3080ea5/0x3234de053c4c7eb lrc: 4/0,0 mode: PR/PR res: [0x2ba27:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd1e0 expref: 290 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.728545:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.728548:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396414080 00010000:00010000:1.0:1651529344.728550:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004ea2468b/0x3234de053c4f6a6 lrc: 5/0,0 mode: PR/PR res: [0x2ba26:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d74 expref: 291 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.728564:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396413888 00000100:00100000:0.0:1651529344.728565:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.728567:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000854e993d/0x3234de053c4c766 lrc: 5/0,0 mode: PR/PR res: [0x2ba25:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccfda expref: 292 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.728569:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.728571:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396414016 00010000:00010000:1.0:1651529344.728573:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000112d61c0/0x3234de053c4ee80 lrc: 4/0,0 mode: PR/PR res: [0x2ba24:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c0a expref: 293 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.728575:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.728577:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396414144 00010000:00010000:1.0:1651529344.728579:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dc73c07f/0x3234de053c4e573 lrc: 4/0,0 mode: PR/PR res: [0x2ba28:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4719 expref: 294 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.728582:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396414272 00000100:00100000:0.0:1651529344.728583:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000be0ace91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997052608:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.728584:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c77a8fb3/0x3234de053c4eb54 lrc: 5/0,0 mode: PR/PR res: [0x2ba2b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ed5 expref: 295 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.728588:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396414208 00010000:00010000:0.0:1651529344.728588:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c528a9 lrc: 3/0,1 mode: --/PW res: [0x2ba26:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.728591:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000158a383a/0x3234de053c4c0c8 lrc: 5/0,0 mode: PR/PR res: [0x2ba29:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc7c9 expref: 296 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.728594:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396414336 00000100:00100000:0.0:1651529344.728595:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004534b316 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997052800:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.728596:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000770c80bc/0x3234de053c4d876 lrc: 4/0,0 mode: PR/PR res: [0x2ba2a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d12c3 expref: 297 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.728597:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c528be lrc: 3/0,1 mode: --/PW res: [0x2ba2a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.728601:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13058 00000100:00100000:1.0:1651529344.728603:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c680c11 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+297:41279:x1731746396413952:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.728603:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000822949b3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997052416:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.728605:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.728605:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52894 lrc: 3/0,1 mode: --/PW res: [0x2ba25:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.728607:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c3080ea5/0x3234de053c4c7eb lrc: 4/0,0 mode: PR/PR res: [0x2ba27:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd1e0 expref: 297 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.728610:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c3080ea5/0x3234de053c4c7eb lrc: 3/0,0 mode: PR/PR res: [0x2ba27:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd1e0 expref: 297 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.728612:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13059 00000100:00100000:0.0:1651529344.728614:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+297:41279:x1731746396414080:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.728616:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3080ea5/0x3234de053c4c7eb lrc: 0/0,0 mode: --/PR res: [0x2ba27:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd1e0 expref: 297 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.728617:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.728619:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004ea2468b/0x3234de053c4f6a6 lrc: 4/0,0 mode: PR/PR res: [0x2ba26:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d74 expref: 297 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.728620:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.728620:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.728621:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5289b lrc: 3/0,1 mode: PW/PW res: [0x2ba27:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.728622:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004ea2468b/0x3234de053c4f6a6 lrc: 3/0,0 mode: PR/PR res: [0x2ba26:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d74 expref: 296 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.728624:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5289b lrc: 4/0,1 mode: PW/PW res: [0x2ba27:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.728628:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ea2468b/0x3234de053c4f6a6 lrc: 0/0,0 mode: --/PR res: [0x2ba26:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8d74 expref: 296 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.728631:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.728632:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.728633:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.728634:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c528a9 lrc: 3/0,1 mode: PW/PW res: [0x2ba26:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.728636:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c528a9 lrc: 4/0,1 mode: PW/PW res: [0x2ba26:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.728639:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c680c11 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+295:41279:x1731746396413952:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.728642:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13058 00010000:00010000:0.0:1651529344.728643:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.728650:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+294:41279:x1731746396414080:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.728651:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13060 00000100:00100000:0.0:1651529344.728652:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13059 00000100:00100000:1.0:1651529344.728653:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+294:41279:x1731746396413888:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.728655:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.728656:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000854e993d/0x3234de053c4c766 lrc: 4/0,0 mode: PR/PR res: [0x2ba25:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccfda expref: 293 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.728658:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13061 00010000:00010000:1.0:1651529344.728660:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000854e993d/0x3234de053c4c766 lrc: 3/0,0 mode: PR/PR res: [0x2ba25:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccfda expref: 293 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.728660:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+293:41279:x1731746396414016:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.728662:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.728664:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000112d61c0/0x3234de053c4ee80 lrc: 4/0,0 mode: PR/PR res: [0x2ba24:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c0a expref: 293 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.728665:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000854e993d/0x3234de053c4c766 lrc: 0/0,0 mode: --/PR res: [0x2ba25:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccfda expref: 293 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.728667:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000112d61c0/0x3234de053c4ee80 lrc: 3/0,0 mode: PR/PR res: [0x2ba24:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c0a expref: 293 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.728669:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.728670:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.728670:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52894 lrc: 3/0,1 mode: PW/PW res: [0x2ba25:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.728672:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000112d61c0/0x3234de053c4ee80 lrc: 0/0,0 mode: --/PR res: [0x2ba24:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6c0a expref: 292 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.728673:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52894 lrc: 4/0,1 mode: PW/PW res: [0x2ba25:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.728678:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.728678:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.728679:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c528a2 lrc: 3/0,1 mode: PW/PW res: [0x2ba24:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.728683:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.728688:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+291:41279:x1731746396413888:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 35us (158us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.728689:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c528a2 lrc: 4/0,1 mode: PW/PW res: [0x2ba24:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.728691:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13060 00000100:00100000:1.0:1651529344.728696:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13062 00010000:00010000:0.0:1651529344.728698:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.728703:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+290:41279:x1731746396414144:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.728704:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+290:41279:x1731746396414016:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 44us (166us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.728706:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.728707:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dc73c07f/0x3234de053c4e573 lrc: 4/0,0 mode: PR/PR res: [0x2ba28:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4719 expref: 290 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.728707:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13061 00010000:00010000:1.0:1651529344.728711:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dc73c07f/0x3234de053c4e573 lrc: 3/0,0 mode: PR/PR res: [0x2ba28:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4719 expref: 289 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.728712:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13063 00000100:00100000:0.0:1651529344.728713:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+289:41278:x1731746396414272:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.728716:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc73c07f/0x3234de053c4e573 lrc: 0/0,0 mode: --/PR res: [0x2ba28:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4719 expref: 289 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.728716:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.728717:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c77a8fb3/0x3234de053c4eb54 lrc: 5/0,0 mode: PR/PR res: [0x2ba2b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ed5 expref: 289 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.728719:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.728720:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.728720:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c528b0 lrc: 3/0,1 mode: PW/PW res: [0x2ba28:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.728721:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c77a8fb3/0x3234de053c4eb54 lrc: 4/0,0 mode: PR/PR res: [0x2ba2b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ed5 expref: 288 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.728723:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c528b0 lrc: 4/0,1 mode: PW/PW res: [0x2ba28:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.728726:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.728726:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.728727:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c528c5 lrc: 3/0,1 mode: PW/PW res: [0x2ba2b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.728729:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.728732:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c528c5 lrc: 4/0,1 mode: PW/PW res: [0x2ba2b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.728745:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+288:41279:x1731746396414144:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 31us (190us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.728746:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.728748:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13062 00000100:00100000:0.0:1651529344.728751:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+287:41278:x1731746396414272:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 37us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.728753:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13064 00000100:00100000:0.0:1651529344.728754:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13063 00000100:00100000:1.0:1651529344.728755:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+287:41279:x1731746396414208:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.728757:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.728759:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000158a383a/0x3234de053c4c0c8 lrc: 5/0,0 mode: PR/PR res: [0x2ba29:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc7c9 expref: 286 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.728759:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13065 00000100:00100000:0.0:1651529344.728761:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009f0728c5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+286:41279:x1731746396414336:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.728763:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000158a383a/0x3234de053c4c0c8 lrc: 4/0,0 mode: PR/PR res: [0x2ba29:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc7c9 expref: 286 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.728763:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.728765:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000770c80bc/0x3234de053c4d876 lrc: 4/0,0 mode: PR/PR res: [0x2ba2a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d12c3 expref: 286 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.728767:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.728768:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.728768:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000770c80bc/0x3234de053c4d876 lrc: 3/0,0 mode: PR/PR res: [0x2ba2a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d12c3 expref: 286 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.728769:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c528b7 lrc: 3/0,1 mode: PW/PW res: [0x2ba29:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.728772:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c528b7 lrc: 4/0,1 mode: PW/PW res: [0x2ba29:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.728773:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000770c80bc/0x3234de053c4d876 lrc: 0/0,0 mode: --/PR res: [0x2ba2a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d12c3 expref: 286 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.728776:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.728777:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.728777:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.728778:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c528be lrc: 3/0,1 mode: PW/PW res: [0x2ba2a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.728781:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+285:41279:x1731746396414208:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 26us (212us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.728781:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c528be lrc: 4/0,1 mode: PW/PW res: [0x2ba2a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.728784:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13064 00010000:00010000:0.0:1651529344.728789:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.728794:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009f0728c5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+284:41279:x1731746396414336:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 33us (218us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.728795:0:80280:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c77a8fb3/0x3234de053c4eb54 lrc: 0/0,0 mode: --/PR res: [0x2ba2b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5ed5 expref: 284 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.728797:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13065 00000100:00100000:1.0:1651529344.728799:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006929eb96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997052864:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.728802:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c528c5 lrc: 3/0,1 mode: PW/PW res: [0x2ba2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.728805:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c528c5 lrc: 3/0,1 mode: PW/PW res: [0x2ba2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.728806:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c528a9 lrc: 3/0,1 mode: PW/PW res: [0x2ba26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.728809:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c528a9 lrc: 3/0,1 mode: PW/PW res: [0x2ba26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.728811:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c528c5 lrc: 3/0,1 mode: PW/PW res: [0x2ba2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.728812:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c528a9 lrc: 3/0,1 mode: PW/PW res: [0x2ba26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.728814:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c528c5 lrc: 3/0,1 mode: PW/PW res: [0x2ba2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.728815:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c528a9 lrc: 2/0,0 mode: PW/PW res: [0x2ba26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.728816:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c528c5 lrc: 2/0,0 mode: PW/PW res: [0x2ba2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.728866:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1779:39029:x1731745946532864:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 946us (1082us total) trans 12885080331 rc 0/0 00000100:00100000:1.0:1651529344.728869:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1779:39029:x1731745946533184:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 722us (802us total) trans 12885080332 rc 0/0 00000100:00100000:0.0:1651529344.728869:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212279 00000100:00100000:1.0:1651529344.728872:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212283 00010000:00010000:0.0:1651529344.728876:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c528a9 lrc: 2/0,0 mode: PW/PW res: [0x2ba26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.728879:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006401eb97 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.728880:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c528c5 lrc: 2/0,0 mode: PW/PW res: [0x2ba2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.728880:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c528a9 lrc: 2/0,0 mode: PW/PW res: [0x2ba26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.728883:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bdf2b6c4 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.728884:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c528c5 lrc: 2/0,0 mode: PW/PW res: [0x2ba2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.728886:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c528a9 lrc: 3/0,0 mode: PW/PW res: [0x2ba26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.728887:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c528c5 lrc: 3/0,0 mode: PW/PW res: [0x2ba2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.728890:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c528a9 lrc: 1/0,0 mode: --/PW res: [0x2ba26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.728891:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c528c5 lrc: 1/0,0 mode: --/PW res: [0x2ba2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.728893:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c528a9 lrc: 0/0,0 mode: --/PW res: [0x2ba26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.728894:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c528c5 lrc: 0/0,0 mode: --/PW res: [0x2ba2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.728899:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c528be lrc: 3/0,1 mode: PW/PW res: [0x2ba2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.728902:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c528be lrc: 3/0,1 mode: PW/PW res: [0x2ba2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.728904:0:80277:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000158a383a/0x3234de053c4c0c8 lrc: 0/0,0 mode: --/PR res: [0x2ba29:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc7c9 expref: 282 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.728905:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c528be lrc: 3/0,1 mode: PW/PW res: [0x2ba2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.728907:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000086eaa330 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997052736:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.728907:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c528be lrc: 2/0,0 mode: PW/PW res: [0x2ba2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.728910:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c528b7 lrc: 3/0,1 mode: PW/PW res: [0x2ba29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.728914:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c528b7 lrc: 3/0,1 mode: PW/PW res: [0x2ba29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.728917:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c528b7 lrc: 3/0,1 mode: PW/PW res: [0x2ba29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.728919:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c528b7 lrc: 3/0,1 mode: PW/PW res: [0x2ba29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.728922:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c528b7 lrc: 2/0,0 mode: PW/PW res: [0x2ba29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.728950:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1779:39029:x1731745946533120:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 848us (899us total) trans 12885080333 rc 0/0 00000100:00100000:0.0:1651529344.728953:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212282 00010000:00010000:0.0:1651529344.728960:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c528be lrc: 2/0,0 mode: PW/PW res: [0x2ba2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.728963:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1778:39029:x1731745946533056:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 867us (932us total) trans 12885080334 rc 0/0 00010000:00010000:0.0:1651529344.728965:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000576f1f12 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.728966:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212281 00010000:00010000:0.0:1651529344.728966:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c528be lrc: 2/0,0 mode: PW/PW res: [0x2ba2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.728969:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c528be lrc: 3/0,0 mode: PW/PW res: [0x2ba2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.728973:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c528b0 lrc: 3/0,1 mode: PW/PW res: [0x2ba28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.728973:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c528be lrc: 1/0,0 mode: --/PW res: [0x2ba2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.728976:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c528b0 lrc: 3/0,1 mode: PW/PW res: [0x2ba28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.728976:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c528be lrc: 0/0,0 mode: --/PW res: [0x2ba2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.728979:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c528b0 lrc: 3/0,1 mode: PW/PW res: [0x2ba28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.728980:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c528b7 lrc: 2/0,0 mode: PW/PW res: [0x2ba29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.728982:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c528b0 lrc: 2/0,0 mode: PW/PW res: [0x2ba28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.728983:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000014fe598c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.728984:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c528b7 lrc: 2/0,0 mode: PW/PW res: [0x2ba29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.728986:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c528b7 lrc: 3/0,0 mode: PW/PW res: [0x2ba29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.728990:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c528b7 lrc: 1/0,0 mode: --/PW res: [0x2ba29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.728992:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c528b7 lrc: 0/0,0 mode: --/PW res: [0x2ba29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.728996:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c528b0 lrc: 2/0,0 mode: PW/PW res: [0x2ba28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.728999:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e48e0bfd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.728999:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c528b0 lrc: 2/0,0 mode: PW/PW res: [0x2ba28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.729002:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c528b0 lrc: 3/0,0 mode: PW/PW res: [0x2ba28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.729005:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c528b0 lrc: 1/0,0 mode: --/PW res: [0x2ba28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.729008:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c528b0 lrc: 0/0,0 mode: --/PW res: [0x2ba28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.729012:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1778:39029:x1731745946532992:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1055us (1216us total) trans 12885080335 rc 0/0 00010000:00010000:0.0:1651529344.729013:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52894 lrc: 3/0,1 mode: PW/PW res: [0x2ba25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.729015:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212280 00010000:00010000:0.0:1651529344.729016:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52894 lrc: 3/0,1 mode: PW/PW res: [0x2ba25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.729019:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52894 lrc: 3/0,1 mode: PW/PW res: [0x2ba25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.729021:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5289b lrc: 3/0,1 mode: PW/PW res: [0x2ba27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.729021:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52894 lrc: 2/0,0 mode: PW/PW res: [0x2ba25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.729024:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5289b lrc: 3/0,1 mode: PW/PW res: [0x2ba27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.729027:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5289b lrc: 3/0,1 mode: PW/PW res: [0x2ba27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.729030:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5289b lrc: 2/0,0 mode: PW/PW res: [0x2ba27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.729064:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1779:39029:x1731745946532800:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1239us (1329us total) trans 12885080336 rc 0/0 00000100:00100000:1.0:1651529344.729067:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1779:39029:x1731745946532928:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1208us (1305us total) trans 12885080337 rc 0/0 00000100:00100000:0.0:1651529344.729067:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212276 00000100:00100000:1.0:1651529344.729070:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212277 00010000:00010000:0.0:1651529344.729074:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52894 lrc: 2/0,0 mode: PW/PW res: [0x2ba25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.729077:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c528a2 lrc: 3/0,1 mode: PW/PW res: [0x2ba24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.729078:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fafb79d3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.729079:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52894 lrc: 2/0,0 mode: PW/PW res: [0x2ba25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.729081:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52894 lrc: 3/0,0 mode: PW/PW res: [0x2ba25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.729082:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c528a2 lrc: 3/0,1 mode: PW/PW res: [0x2ba24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.729085:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c528a2 lrc: 3/0,1 mode: PW/PW res: [0x2ba24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.729086:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52894 lrc: 1/0,0 mode: --/PW res: [0x2ba25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.729088:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c528a2 lrc: 2/0,0 mode: PW/PW res: [0x2ba24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.729089:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52894 lrc: 0/0,0 mode: --/PW res: [0x2ba25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.729093:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5289b lrc: 2/0,0 mode: PW/PW res: [0x2ba27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.729096:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000029958df2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.729097:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5289b lrc: 2/0,0 mode: PW/PW res: [0x2ba27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.729102:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5289b lrc: 3/0,0 mode: PW/PW res: [0x2ba27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.729105:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5289b lrc: 1/0,0 mode: --/PW res: [0x2ba27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.729108:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5289b lrc: 0/0,0 mode: --/PW res: [0x2ba27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.729111:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c528a2 lrc: 2/0,0 mode: PW/PW res: [0x2ba24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.729114:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000090e99444 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.729114:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c528a2 lrc: 2/0,0 mode: PW/PW res: [0x2ba24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.729115:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1778:39029:x1731745946532736:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1199us (1343us total) trans 12885080338 rc 0/0 00010000:00010000:0.0:1651529344.729117:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c528a2 lrc: 3/0,0 mode: PW/PW res: [0x2ba24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.729118:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212278 00010000:00010000:0.0:1651529344.729120:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c528a2 lrc: 1/0,0 mode: --/PW res: [0x2ba24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.729122:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c528a2 lrc: 0/0,0 mode: --/PW res: [0x2ba24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.729360:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.729384:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.729391:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.729401:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.729402:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946533312 00000100:00100000:1.0:1651529344.729407:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.729425:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.729431:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946533440 00000100:00100000:0.0:1651529344.729437:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946533568 00000100:00100000:1.0:1651529344.729438:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.729445:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946533696 00000100:00100000:0.0:1651529344.729449:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946533248 00000100:00100000:1.0:1651529344.729450:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.729460:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946533376 00000100:00100000:0.0:1651529344.729460:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946533504 00000100:00100000:0.0:1651529344.729463:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946533632 00000100:00100000:1.0:1651529344.729467:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212284 00000100:00100000:1.0:1651529344.729468:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1785:39029:x1731745946533312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.729469:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212285 00000100:00100000:0.0:1651529344.729470:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1785:39029:x1731745946533440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.729474:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178733 count 1 00002000:00080000:0.0:1651529344.729476:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178735 count 1 00010000:00010000:1.0:1651529344.729478:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c528cc lrc: 3/0,1 mode: --/PW res: [0x2ba2d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.729481:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c528d3 lrc: 3/0,1 mode: --/PW res: [0x2ba2f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.729485:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003d912c26/0x3234de053c4f0d3 lrc: 2/0,0 mode: PR/PR res: [0x2ba2d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d75c6 expref: 281 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.729486:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000af49774e/0x3234de053c4a378 lrc: 2/0,0 mode: PR/PR res: [0x2ba2f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba08 expref: 281 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.729488:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.729489:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.729489:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.729490:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c528cc lrc: 4/0,1 mode: --/PW res: [0x2ba2d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.729490:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.729490:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c528d3 lrc: 4/0,1 mode: --/PW res: [0x2ba2f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.729496:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003d912c26/0x3234de053c4f0d3 lrc: 3/0,0 mode: PR/PR res: [0x2ba2d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d75c6 expref: 281 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.729497:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000af49774e/0x3234de053c4a378 lrc: 3/0,0 mode: PR/PR res: [0x2ba2f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba08 expref: 281 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.729500:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003d912c26/0x3234de053c4f0d3 lrc: 4/0,0 mode: PR/PR res: [0x2ba2d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d75c6 expref: 281 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.729501:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000af49774e/0x3234de053c4a378 lrc: 4/0,0 mode: PR/PR res: [0x2ba2f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba08 expref: 281 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.729504:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014f8af45 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997052928:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.729505:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005a17dd72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997052992:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.729519:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e5f43e7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.729525:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212286 00000100:00100000:0.0:1651529344.729525:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 0000000070e666f7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.729527:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1785:39029:x1731745946533568:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.729531:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178737 count 1 00000100:00100000:0.0:1651529344.729531:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212287 00000100:00100000:0.0:1651529344.729533:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1785:39029:x1731745946533696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.729535:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c528da lrc: 3/0,1 mode: --/PW res: [0x2ba31:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.729538:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178739 count 1 00010000:00010000:1.0:1651529344.729539:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c4c6da lrc: 2/0,0 mode: PR/PR res: [0x2ba31:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd64 expref: 281 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.729541:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c528e1 lrc: 3/0,1 mode: --/PW res: [0x2ba33:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.729542:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.729543:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.729543:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c528da lrc: 4/0,1 mode: --/PW res: [0x2ba31:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.729545:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c4d56d lrc: 2/0,0 mode: PR/PR res: [0x2ba33:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0755 expref: 281 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.729549:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c4c6da lrc: 3/0,0 mode: PR/PR res: [0x2ba31:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd64 expref: 281 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.729549:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.729549:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.729550:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c528e1 lrc: 4/0,1 mode: --/PW res: [0x2ba33:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.729553:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c4c6da lrc: 4/0,0 mode: PR/PR res: [0x2ba31:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd64 expref: 281 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.729556:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000078f9a278 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997053056:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.729556:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c4d56d lrc: 3/0,0 mode: PR/PR res: [0x2ba33:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0755 expref: 281 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.729560:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c4d56d lrc: 4/0,0 mode: PR/PR res: [0x2ba33:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0755 expref: 281 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.729563:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 0000000053a0cffa going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.729563:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006647e4ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997053120:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.729569:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212288 00000100:00100000:1.0:1651529344.729570:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1785:39029:x1731745946533248:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.729571:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000abca413e going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.729574:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178732 count 1 00000100:00100000:0.0:1651529344.729576:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212289 00010000:00010000:1.0:1651529344.729577:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c528e8 lrc: 3/0,1 mode: --/PW res: [0x2ba2c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.729578:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1785:39029:x1731745946533504:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.729581:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c4ecea lrc: 2/0,0 mode: PR/PR res: [0x2ba2c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d655e expref: 281 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.729582:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178736 count 1 00010000:00010000:1.0:1651529344.729584:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.729584:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.729585:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c528e8 lrc: 4/0,1 mode: --/PW res: [0x2ba2c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.729585:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c528ef lrc: 3/0,1 mode: --/PW res: [0x2ba30:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.729590:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c4ecea lrc: 3/0,0 mode: PR/PR res: [0x2ba2c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d655e expref: 281 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.729591:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d37ee464/0x3234de053c4c9ff lrc: 2/0,0 mode: PR/PR res: [0x2ba30:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd9ff expref: 281 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.729594:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.729594:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.729595:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c528ef lrc: 4/0,1 mode: --/PW res: [0x2ba30:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.729596:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c4ecea lrc: 4/0,0 mode: PR/PR res: [0x2ba2c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d655e expref: 281 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.729600:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002a957ba7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997053184:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.729601:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d37ee464/0x3234de053c4c9ff lrc: 3/0,0 mode: PR/PR res: [0x2ba30:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd9ff expref: 281 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.729605:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d37ee464/0x3234de053c4c9ff lrc: 4/0,0 mode: PR/PR res: [0x2ba30:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd9ff expref: 281 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.729606:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000babe2d90 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.729608:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e7f02909 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997053248:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.729611:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212290 00000100:00100000:1.0:1651529344.729613:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eabbd58a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1785:39029:x1731745946533376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.729615:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000003678d25f going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.729617:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178734 count 1 00010000:00010000:1.0:1651529344.729620:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c528f6 lrc: 3/0,1 mode: --/PW res: [0x2ba2e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.729620:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212291 00000100:00100000:0.0:1651529344.729622:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1785:39029:x1731745946533632:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.729624:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b65edda5/0x3234de053c4cfe0 lrc: 2/0,0 mode: PR/PR res: [0x2ba2e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf0f0 expref: 281 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.729625:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178738 count 1 00010000:00010000:1.0:1651529344.729627:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.729627:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.729628:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c528f6 lrc: 4/0,1 mode: --/PW res: [0x2ba2e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.729628:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c528fd lrc: 3/0,1 mode: --/PW res: [0x2ba32:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.729632:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000003992be5/0x3234de053c4e159 lrc: 2/0,0 mode: PR/PR res: [0x2ba32:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3664 expref: 281 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.729633:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b65edda5/0x3234de053c4cfe0 lrc: 3/0,0 mode: PR/PR res: [0x2ba2e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf0f0 expref: 281 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.729635:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.729636:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.729637:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b65edda5/0x3234de053c4cfe0 lrc: 4/0,0 mode: PR/PR res: [0x2ba2e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf0f0 expref: 281 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.729637:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c528fd lrc: 4/0,1 mode: --/PW res: [0x2ba32:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.729643:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000086eaa330 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997053312:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.729643:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000003992be5/0x3234de053c4e159 lrc: 3/0,0 mode: PR/PR res: [0x2ba32:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3664 expref: 281 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.729646:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000003992be5/0x3234de053c4e159 lrc: 4/0,0 mode: PR/PR res: [0x2ba32:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3664 expref: 281 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.729649:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 0000000057299e7f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.729650:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d28c414b pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997053376:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.729656:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c086aae3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.730250:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005a17dd72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997052992:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.730255:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.730255:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c528d3 lrc: 3/0,1 mode: --/PW res: [0x2ba2f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.730265:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.730271:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006647e4ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997053120:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.730273:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.730274:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c528e1 lrc: 3/0,1 mode: --/PW res: [0x2ba33:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.730279:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.730280:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396414400 00010000:00010000:0.0:1651529344.730285:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003d912c26/0x3234de053c4f0d3 lrc: 5/0,0 mode: PR/PR res: [0x2ba2d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d75c6 expref: 282 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.730298:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396414464 00000100:00100000:1.0:1651529344.730305:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.730305:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000af49774e/0x3234de053c4a378 lrc: 4/0,0 mode: PR/PR res: [0x2ba2f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba08 expref: 283 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.730309:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.730313:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396414528 00000100:00100000:1.0:1651529344.730315:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.730315:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c4c6da lrc: 5/0,0 mode: PR/PR res: [0x2ba31:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd64 expref: 284 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.730320:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396414592 00000100:00100000:1.0:1651529344.730321:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.730322:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c4d56d lrc: 4/0,0 mode: PR/PR res: [0x2ba33:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0755 expref: 285 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.730326:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396414656 00010000:00010000:0.0:1651529344.730327:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c4ecea lrc: 5/0,0 mode: PR/PR res: [0x2ba2c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d655e expref: 286 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.730330:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014f8af45 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997052928:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.730331:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396414784 00010000:00010000:0.0:1651529344.730333:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b65edda5/0x3234de053c4cfe0 lrc: 5/0,0 mode: PR/PR res: [0x2ba2e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf0f0 expref: 287 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.730334:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c528cc lrc: 3/0,1 mode: --/PW res: [0x2ba2d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.730337:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396414720 00010000:00010000:0.0:1651529344.730339:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d37ee464/0x3234de053c4c9ff lrc: 5/0,0 mode: PR/PR res: [0x2ba30:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd9ff expref: 288 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.730341:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000078f9a278 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997053056:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.730343:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396414848 00010000:00010000:1.0:1651529344.730344:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c528da lrc: 3/0,1 mode: --/PW res: [0x2ba31:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.730345:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000003992be5/0x3234de053c4e159 lrc: 5/0,0 mode: PR/PR res: [0x2ba32:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3664 expref: 289 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.730350:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13066 00000100:00100000:1.0:1651529344.730352:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13067 00000100:00100000:0.0:1651529344.730352:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+289:41278:x1731746396414400:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.730354:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+289:41279:x1731746396414464:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.730356:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.730357:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003d912c26/0x3234de053c4f0d3 lrc: 4/0,0 mode: PR/PR res: [0x2ba2d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d75c6 expref: 289 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.730358:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.730359:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000af49774e/0x3234de053c4a378 lrc: 4/0,0 mode: PR/PR res: [0x2ba2f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba08 expref: 289 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.730361:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003d912c26/0x3234de053c4f0d3 lrc: 3/0,0 mode: PR/PR res: [0x2ba2d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d75c6 expref: 289 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.730366:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000af49774e/0x3234de053c4a378 lrc: 3/0,0 mode: PR/PR res: [0x2ba2f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba08 expref: 289 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.730367:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d912c26/0x3234de053c4f0d3 lrc: 0/0,0 mode: --/PR res: [0x2ba2d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d75c6 expref: 289 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.730371:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.730371:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.730372:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af49774e/0x3234de053c4a378 lrc: 0/0,0 mode: --/PR res: [0x2ba2f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cba08 expref: 288 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.730372:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c528cc lrc: 3/0,1 mode: PW/PW res: [0x2ba2d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.730375:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.730375:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c528cc lrc: 4/0,1 mode: PW/PW res: [0x2ba2d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.730376:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.730377:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c528d3 lrc: 3/0,1 mode: PW/PW res: [0x2ba2f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.730380:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c528d3 lrc: 4/0,1 mode: PW/PW res: [0x2ba2f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.730386:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.730395:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.730402:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+287:41279:x1731746396414464:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 48us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.730402:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+287:41278:x1731746396414400:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 49us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.730405:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13066 00000100:00100000:1.0:1651529344.730407:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13067 00000100:00100000:0.0:1651529344.730410:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13068 00000100:00100000:0.0:1651529344.730411:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+285:41278:x1731746396414528:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529344.730413:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13069 00010000:00010000:0.0:1651529344.730414:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.730415:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+285:41279:x1731746396414592:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.730416:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c4c6da lrc: 4/0,0 mode: PR/PR res: [0x2ba31:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd64 expref: 285 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.730417:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.730419:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c4d56d lrc: 4/0,0 mode: PR/PR res: [0x2ba33:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0755 expref: 285 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.730422:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c4d56d lrc: 3/0,0 mode: PR/PR res: [0x2ba33:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0755 expref: 285 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.730422:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c4c6da lrc: 3/0,0 mode: PR/PR res: [0x2ba31:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd64 expref: 285 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.730427:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c4c6da lrc: 0/0,0 mode: --/PR res: [0x2ba31:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd64 expref: 285 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.730428:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c4d56d lrc: 0/0,0 mode: --/PR res: [0x2ba33:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0755 expref: 285 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.730430:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.730431:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.730431:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.730432:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.730432:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c528e1 lrc: 3/0,1 mode: PW/PW res: [0x2ba33:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.730432:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c528da lrc: 3/0,1 mode: PW/PW res: [0x2ba31:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.730435:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c528e1 lrc: 4/0,1 mode: PW/PW res: [0x2ba33:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.730435:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c528da lrc: 4/0,1 mode: PW/PW res: [0x2ba31:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.730446:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.730448:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.730452:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+283:41278:x1731746396414528:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 40us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.730454:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+283:41279:x1731746396414592:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.730455:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13068 00000100:00100000:1.0:1651529344.730457:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13069 00000100:00100000:0.0:1651529344.730459:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13070 00000100:00100000:1.0:1651529344.730461:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13071 00000100:00100000:0.0:1651529344.730461:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+281:41278:x1731746396414656:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.730463:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+281:41278:x1731746396414784:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.730463:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.730465:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.730465:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c4ecea lrc: 5/0,0 mode: PR/PR res: [0x2ba2c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d655e expref: 281 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.730467:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b65edda5/0x3234de053c4cfe0 lrc: 5/0,0 mode: PR/PR res: [0x2ba2e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf0f0 expref: 281 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.730468:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c4ecea lrc: 4/0,0 mode: PR/PR res: [0x2ba2c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d655e expref: 281 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.730470:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b65edda5/0x3234de053c4cfe0 lrc: 4/0,0 mode: PR/PR res: [0x2ba2e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf0f0 expref: 281 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.730473:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.730474:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.730475:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.730475:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c528e8 lrc: 3/0,1 mode: PW/PW res: [0x2ba2c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.730476:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.730477:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c528f6 lrc: 3/0,1 mode: PW/PW res: [0x2ba2e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.730478:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c528e8 lrc: 4/0,1 mode: PW/PW res: [0x2ba2c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.730480:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c528f6 lrc: 4/0,1 mode: PW/PW res: [0x2ba2e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.730482:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.730484:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.730486:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+281:41278:x1731746396414656:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 24us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.730488:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+281:41278:x1731746396414784:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 24us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.730488:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13070 00000100:00100000:1.0:1651529344.730490:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13071 00000100:00100000:0.0:1651529344.730492:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13072 00000100:00100000:0.0:1651529344.730493:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bdd4fa38 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+279:41279:x1731746396414720:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.730494:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13073 00000100:00100000:1.0:1651529344.730496:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+279:41279:x1731746396414848:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.730496:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.730497:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d37ee464/0x3234de053c4c9ff lrc: 5/0,0 mode: PR/PR res: [0x2ba30:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd9ff expref: 279 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.730498:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.730499:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000003992be5/0x3234de053c4e159 lrc: 5/0,0 mode: PR/PR res: [0x2ba32:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3664 expref: 279 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.730500:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d37ee464/0x3234de053c4c9ff lrc: 4/0,0 mode: PR/PR res: [0x2ba30:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd9ff expref: 279 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.730503:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000003992be5/0x3234de053c4e159 lrc: 4/0,0 mode: PR/PR res: [0x2ba32:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3664 expref: 279 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.730504:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.730505:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.730505:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c528ef lrc: 3/0,1 mode: PW/PW res: [0x2ba30:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.730507:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.730508:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.730508:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c528fd lrc: 3/0,1 mode: PW/PW res: [0x2ba32:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.730508:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c528ef lrc: 4/0,1 mode: PW/PW res: [0x2ba30:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.730511:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c528fd lrc: 4/0,1 mode: PW/PW res: [0x2ba32:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.730513:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.730515:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.730517:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bdd4fa38 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+279:41279:x1731746396414720:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 23us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.730519:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+279:41279:x1731746396414848:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 23us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.730519:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13072 00000100:00100000:1.0:1651529344.730521:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13073 00010000:00010000:1.0:1651529344.730532:0:80279:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c4ecea lrc: 0/0,0 mode: --/PR res: [0x2ba2c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d655e expref: 277 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.730532:0:80276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d37ee464/0x3234de053c4c9ff lrc: 0/0,0 mode: --/PR res: [0x2ba30:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd9ff expref: 277 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.730536:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002a957ba7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997053184:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.730536:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e7f02909 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997053248:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.730539:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c528e8 lrc: 3/0,1 mode: PW/PW res: [0x2ba2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.730540:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c528ef lrc: 3/0,1 mode: PW/PW res: [0x2ba30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.730542:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c528e8 lrc: 3/0,1 mode: PW/PW res: [0x2ba2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.730543:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c528ef lrc: 3/0,1 mode: PW/PW res: [0x2ba30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.730545:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c528e8 lrc: 3/0,1 mode: PW/PW res: [0x2ba2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.730546:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c528ef lrc: 3/0,1 mode: PW/PW res: [0x2ba30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.730548:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c528e8 lrc: 3/0,1 mode: PW/PW res: [0x2ba2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.730549:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c528ef lrc: 3/0,1 mode: PW/PW res: [0x2ba30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.730551:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c528e8 lrc: 2/0,0 mode: PW/PW res: [0x2ba2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.730551:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c528ef lrc: 2/0,0 mode: PW/PW res: [0x2ba30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.730592:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1787:39029:x1731745946533248:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1020us (1184us total) trans 12885080339 rc 0/0 00000100:00100000:1.0:1651529344.730595:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212288 00000100:00100000:0.0:1651529344.730595:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1787:39029:x1731745946533504:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1016us (1157us total) trans 12885080340 rc 0/0 00000100:00100000:0.0:1651529344.730599:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212289 00010000:00010000:1.0:1651529344.730604:0:72397:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b65edda5/0x3234de053c4cfe0 lrc: 0/0,0 mode: --/PR res: [0x2ba2e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf0f0 expref: 275 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.730610:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000086eaa330 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997053312:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.730610:0:156655:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003992be5/0x3234de053c4e159 lrc: 0/0,0 mode: --/PR res: [0x2ba32:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3664 expref: 274 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.730614:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c528f6 lrc: 3/0,1 mode: PW/PW res: [0x2ba2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.730614:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d28c414b pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997053376:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.730617:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c528f6 lrc: 3/0,1 mode: PW/PW res: [0x2ba2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.730618:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c528fd lrc: 3/0,1 mode: PW/PW res: [0x2ba32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.730620:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c528f6 lrc: 3/0,1 mode: PW/PW res: [0x2ba2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.730621:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c528fd lrc: 3/0,1 mode: PW/PW res: [0x2ba32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.730623:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c528f6 lrc: 3/0,1 mode: PW/PW res: [0x2ba2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.730624:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c528fd lrc: 3/0,1 mode: PW/PW res: [0x2ba32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.730625:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c528f6 lrc: 2/0,0 mode: PW/PW res: [0x2ba2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.730627:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c528fd lrc: 3/0,1 mode: PW/PW res: [0x2ba32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.730630:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c528fd lrc: 2/0,0 mode: PW/PW res: [0x2ba32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.730666:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eabbd58a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1787:39029:x1731745946533376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1052us (1241us total) trans 12885080341 rc 0/0 00000100:00100000:1.0:1651529344.730669:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212290 00000100:00100000:0.0:1651529344.730673:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1786:39029:x1731745946533632:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1050us (1223us total) trans 12885080342 rc 0/0 00010000:00010000:1.0:1651529344.730676:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c528e8 lrc: 2/0,0 mode: PW/PW res: [0x2ba2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.730676:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212291 00010000:00010000:1.0:1651529344.730679:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000066921086 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.730680:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c528e8 lrc: 2/0,0 mode: PW/PW res: [0x2ba2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.730683:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c528ef lrc: 2/0,0 mode: PW/PW res: [0x2ba30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.730685:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c528e8 lrc: 3/0,0 mode: PW/PW res: [0x2ba2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.730689:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fc4c513 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.730690:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c528e8 lrc: 1/0,0 mode: --/PW res: [0x2ba2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.730690:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c528ef lrc: 2/0,0 mode: PW/PW res: [0x2ba30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.730693:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c528e8 lrc: 0/0,0 mode: --/PW res: [0x2ba2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.730693:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c528ef lrc: 3/0,0 mode: PW/PW res: [0x2ba30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.730697:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c528f6 lrc: 2/0,0 mode: PW/PW res: [0x2ba2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.730697:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c528ef lrc: 1/0,0 mode: --/PW res: [0x2ba30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.730700:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000877aab61 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.730700:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c528ef lrc: 0/0,0 mode: --/PW res: [0x2ba30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.730701:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c528f6 lrc: 2/0,0 mode: PW/PW res: [0x2ba2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.730703:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c528f6 lrc: 3/0,0 mode: PW/PW res: [0x2ba2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.730704:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c528fd lrc: 2/0,0 mode: PW/PW res: [0x2ba32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.730706:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c528f6 lrc: 1/0,0 mode: --/PW res: [0x2ba2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.730707:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001391dc6d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.730708:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c528fd lrc: 2/0,0 mode: PW/PW res: [0x2ba32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.730709:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c528f6 lrc: 0/0,0 mode: --/PW res: [0x2ba2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.730711:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c528fd lrc: 3/0,0 mode: PW/PW res: [0x2ba32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.730714:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c528da lrc: 3/0,1 mode: PW/PW res: [0x2ba31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.730714:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c528fd lrc: 1/0,0 mode: --/PW res: [0x2ba32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.730716:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c528fd lrc: 0/0,0 mode: --/PW res: [0x2ba32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.730719:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c528da lrc: 3/0,1 mode: PW/PW res: [0x2ba31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.730722:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c528da lrc: 3/0,1 mode: PW/PW res: [0x2ba31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.730723:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c528e1 lrc: 3/0,1 mode: PW/PW res: [0x2ba33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.730725:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c528da lrc: 2/0,0 mode: PW/PW res: [0x2ba31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.730726:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c528e1 lrc: 3/0,1 mode: PW/PW res: [0x2ba33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.730729:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c528e1 lrc: 3/0,1 mode: PW/PW res: [0x2ba33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.730731:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c528e1 lrc: 2/0,0 mode: PW/PW res: [0x2ba33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.730771:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1787:39029:x1731745946533568:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1243us (1379us total) trans 12885080343 rc 0/0 00000100:00100000:1.0:1651529344.730773:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212286 00010000:00010000:1.0:1651529344.730780:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c528cc lrc: 3/0,1 mode: PW/PW res: [0x2ba2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.730781:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1786:39029:x1731745946533696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1247us (1380us total) trans 12885080344 rc 0/0 00010000:00010000:1.0:1651529344.730783:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c528cc lrc: 3/0,1 mode: PW/PW res: [0x2ba2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.730784:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212287 00010000:00010000:1.0:1651529344.730786:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c528cc lrc: 3/0,1 mode: PW/PW res: [0x2ba2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.730789:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c528cc lrc: 2/0,0 mode: PW/PW res: [0x2ba2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.730791:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c528da lrc: 2/0,0 mode: PW/PW res: [0x2ba31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.730794:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ebdbebae already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.730795:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c528da lrc: 2/0,0 mode: PW/PW res: [0x2ba31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.730805:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c528da lrc: 3/0,0 mode: PW/PW res: [0x2ba31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.730810:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c528da lrc: 1/0,0 mode: --/PW res: [0x2ba31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.730813:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c528da lrc: 0/0,0 mode: --/PW res: [0x2ba31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.730817:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c528e1 lrc: 2/0,0 mode: PW/PW res: [0x2ba33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.730820:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c5599f68 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.730820:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c528e1 lrc: 2/0,0 mode: PW/PW res: [0x2ba33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.730823:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c528e1 lrc: 3/0,0 mode: PW/PW res: [0x2ba33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.730826:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1786:39029:x1731745946533312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1357us (1466us total) trans 12885080345 rc 0/0 00010000:00010000:0.0:1651529344.730826:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c528e1 lrc: 1/0,0 mode: --/PW res: [0x2ba33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.730829:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c528e1 lrc: 0/0,0 mode: --/PW res: [0x2ba33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.730830:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212284 00010000:00010000:0.0:1651529344.730832:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c528cc lrc: 2/0,0 mode: PW/PW res: [0x2ba2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.730835:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000314b5fa1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.730836:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c528cc lrc: 2/0,0 mode: PW/PW res: [0x2ba2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.730841:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c528cc lrc: 3/0,0 mode: PW/PW res: [0x2ba2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.730844:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c528cc lrc: 1/0,0 mode: --/PW res: [0x2ba2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.730847:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c528cc lrc: 0/0,0 mode: --/PW res: [0x2ba2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.730852:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c528d3 lrc: 3/0,1 mode: PW/PW res: [0x2ba2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.730855:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c528d3 lrc: 3/0,1 mode: PW/PW res: [0x2ba2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.730858:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c528d3 lrc: 3/0,1 mode: PW/PW res: [0x2ba2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.730861:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c528d3 lrc: 2/0,0 mode: PW/PW res: [0x2ba2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.730900:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1786:39029:x1731745946533440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1428us (1521us total) trans 12885080346 rc 0/0 00000100:00100000:0.0:1651529344.730903:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212285 00010000:00010000:1.0:1651529344.730936:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c528d3 lrc: 2/0,0 mode: PW/PW res: [0x2ba2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.730940:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000048ee8765 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.730942:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c528d3 lrc: 2/0,0 mode: PW/PW res: [0x2ba2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.730960:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c528d3 lrc: 3/0,0 mode: PW/PW res: [0x2ba2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.730969:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c528d3 lrc: 1/0,0 mode: --/PW res: [0x2ba2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.730973:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c528d3 lrc: 0/0,0 mode: --/PW res: [0x2ba2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.731071:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.731085:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.731090:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946533760 00000100:00100000:1.0:1651529344.731092:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946533824 00000100:00100000:0.0:1651529344.731099:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212292 00000100:00100000:1.0:1651529344.731101:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212293 00000100:00100000:0.0:1651529344.731101:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1787:39030:x1731745946533760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.731103:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1787:39030:x1731745946533824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.731107:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178740 count 1 00002000:00080000:1.0:1651529344.731108:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178741 count 1 00010000:00010000:0.0:1651529344.731111:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52904 lrc: 3/0,1 mode: --/PW res: [0x2ba34:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.731113:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c5290b lrc: 3/0,1 mode: --/PW res: [0x2ba35:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.731116:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000990ef3e/0x3234de053c4e6ae lrc: 2/0,0 mode: PR/PR res: [0x2ba34:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b64 expref: 273 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.731117:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d8e16635/0x3234de053c4d471 lrc: 2/0,0 mode: PR/PR res: [0x2ba35:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d03ce expref: 273 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.731119:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.731120:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.731120:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52904 lrc: 4/0,1 mode: --/PW res: [0x2ba34:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.731121:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.731121:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.731122:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c5290b lrc: 4/0,1 mode: --/PW res: [0x2ba35:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.731129:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d8e16635/0x3234de053c4d471 lrc: 3/0,0 mode: PR/PR res: [0x2ba35:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d03ce expref: 273 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.731133:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d8e16635/0x3234de053c4d471 lrc: 4/0,0 mode: PR/PR res: [0x2ba35:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d03ce expref: 273 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.731137:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006e255cae pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997053440:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.731148:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000057299e7f going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.731155:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000990ef3e/0x3234de053c4e6ae lrc: 3/0,0 mode: PR/PR res: [0x2ba34:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b64 expref: 273 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.731167:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000990ef3e/0x3234de053c4e6ae lrc: 4/0,0 mode: PR/PR res: [0x2ba34:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b64 expref: 273 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.731172:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000076d5f96b pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997053504:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.731181:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b81e4a0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.731183:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.731188:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946533888 00000100:00100000:0.0:1651529344.731195:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212294 00000100:00100000:1.0:1651529344.731197:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.731197:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1788:39030:x1731745946533888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.731202:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178742 count 1 00010000:00010000:0.0:1651529344.731205:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52912 lrc: 3/0,1 mode: --/PW res: [0x2ba36:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.731212:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000095947c5f/0x3234de053c4eb0e lrc: 2/0,0 mode: PR/PR res: [0x2ba36:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5dd9 expref: 273 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.731215:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.731216:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.731216:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52912 lrc: 4/0,1 mode: --/PW res: [0x2ba36:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.731235:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.731246:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000095947c5f/0x3234de053c4eb0e lrc: 3/0,0 mode: PR/PR res: [0x2ba36:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5dd9 expref: 273 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.731249:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.731250:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000095947c5f/0x3234de053c4eb0e lrc: 4/0,0 mode: PR/PR res: [0x2ba36:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5dd9 expref: 273 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.731254:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005fb0ec6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997053568:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.731255:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.731265:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.731267:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c086aae3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.731273:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946534016 00000100:00100000:0.0:1651529344.731283:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946534144 00000100:00100000:0.0:1651529344.731288:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946533952 00000100:00100000:0.0:1651529344.731290:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946534080 00000100:00100000:0.0:1651529344.731292:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946534208 00000100:00100000:0.0:1651529344.731296:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212295 00000100:00100000:0.0:1651529344.731297:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1793:39030:x1731745946534016:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.731302:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178744 count 1 00010000:00010000:0.0:1651529344.731305:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52919 lrc: 3/0,1 mode: --/PW res: [0x2ba38:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.731306:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212296 00000100:00100000:1.0:1651529344.731308:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1793:39030:x1731745946534144:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.731312:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001b709cd0/0x3234de053c4e867 lrc: 2/0,0 mode: PR/PR res: [0x2ba38:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d52aa expref: 273 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.731313:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178746 count 1 00010000:00010000:0.0:1651529344.731315:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.731316:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.731316:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52919 lrc: 4/0,1 mode: --/PW res: [0x2ba38:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.731317:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52920 lrc: 3/0,1 mode: --/PW res: [0x2ba3a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.731322:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c82283d8/0x3234de053c4d726 lrc: 2/0,0 mode: PR/PR res: [0x2ba3a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e32 expref: 273 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.731322:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001b709cd0/0x3234de053c4e867 lrc: 3/0,0 mode: PR/PR res: [0x2ba38:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d52aa expref: 273 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.731325:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.731325:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001b709cd0/0x3234de053c4e867 lrc: 4/0,0 mode: PR/PR res: [0x2ba38:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d52aa expref: 273 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.731326:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.731327:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52920 lrc: 4/0,1 mode: --/PW res: [0x2ba3a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.731329:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d28c414b pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997053632:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.731333:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c82283d8/0x3234de053c4d726 lrc: 3/0,0 mode: PR/PR res: [0x2ba3a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e32 expref: 273 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.731337:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c82283d8/0x3234de053c4d726 lrc: 4/0,0 mode: PR/PR res: [0x2ba3a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e32 expref: 273 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.731341:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000abca413e going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.731348:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002a957ba7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997053696:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.731357:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000babe2d90 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.731363:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212297 00000100:00100000:1.0:1651529344.731365:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1793:39030:x1731745946533952:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.731366:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212298 00000100:00100000:0.0:1651529344.731368:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1793:39030:x1731745946534080:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.731370:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178743 count 1 00010000:00010000:1.0:1651529344.731373:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52927 lrc: 3/0,1 mode: --/PW res: [0x2ba37:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.731377:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000886d403b/0x3234de053c4d814 lrc: 2/0,0 mode: PR/PR res: [0x2ba37:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d117a expref: 273 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.731380:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.731381:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.731381:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52927 lrc: 4/0,1 mode: --/PW res: [0x2ba37:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.731383:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178745 count 1 00010000:00010000:0.0:1651529344.731387:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c5292e lrc: 3/0,1 mode: --/PW res: [0x2ba39:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.731389:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000886d403b/0x3234de053c4d814 lrc: 3/0,0 mode: PR/PR res: [0x2ba37:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d117a expref: 273 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.731391:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d234cfa5/0x3234de053c4e0cd lrc: 2/0,0 mode: PR/PR res: [0x2ba39:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d33e0 expref: 273 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.731393:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000886d403b/0x3234de053c4d814 lrc: 4/0,0 mode: PR/PR res: [0x2ba37:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d117a expref: 273 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.731394:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.731395:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.731396:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c5292e lrc: 4/0,1 mode: --/PW res: [0x2ba39:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.731397:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000078f9a278 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997053760:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.731402:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d234cfa5/0x3234de053c4e0cd lrc: 3/0,0 mode: PR/PR res: [0x2ba39:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d33e0 expref: 273 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.731403:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 0000000053a0cffa going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.731406:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d234cfa5/0x3234de053c4e0cd lrc: 4/0,0 mode: PR/PR res: [0x2ba39:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d33e0 expref: 273 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.731410:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e7f02909 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997053824:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.731411:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212299 00000100:00100000:1.0:1651529344.731412:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1793:39030:x1731745946534208:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.731416:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178747 count 1 00000100:00100000:0.0:1651529344.731418:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 000000008dd99533 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.731419:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52935 lrc: 3/0,1 mode: --/PW res: [0x2ba3b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.731423:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000080a9b35b/0x3234de053c4cf07 lrc: 2/0,0 mode: PR/PR res: [0x2ba3b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cedee expref: 273 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.731426:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.731427:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.731428:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52935 lrc: 4/0,1 mode: --/PW res: [0x2ba3b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.731433:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000080a9b35b/0x3234de053c4cf07 lrc: 3/0,0 mode: PR/PR res: [0x2ba3b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cedee expref: 273 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.731436:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000080a9b35b/0x3234de053c4cf07 lrc: 4/0,0 mode: PR/PR res: [0x2ba3b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cedee expref: 273 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.731441:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014f8af45 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997053888:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.731447:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e5f43e7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.731487:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006e255cae pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997053440:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.731492:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c5290b lrc: 3/0,1 mode: --/PW res: [0x2ba35:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.731494:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.731513:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000076d5f96b pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997053504:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.731517:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52904 lrc: 3/0,1 mode: --/PW res: [0x2ba34:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.731546:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.731548:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396414912 00010000:00010000:1.0:1651529344.731559:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000990ef3e/0x3234de053c4e6ae lrc: 4/0,0 mode: PR/PR res: [0x2ba34:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b64 expref: 274 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.731561:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.731566:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396414976 00010000:00010000:1.0:1651529344.731568:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d8e16635/0x3234de053c4d471 lrc: 4/0,0 mode: PR/PR res: [0x2ba35:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d03ce expref: 275 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.731568:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005fb0ec6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997053568:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.731571:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52912 lrc: 3/0,1 mode: --/PW res: [0x2ba36:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.731573:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396415040 00010000:00010000:1.0:1651529344.731575:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000095947c5f/0x3234de053c4eb0e lrc: 4/0,0 mode: PR/PR res: [0x2ba36:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5dd9 expref: 276 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.731578:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13074 00000100:00100000:0.0:1651529344.731580:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+276:41279:x1731746396414912:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.731581:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13075 00000100:00100000:1.0:1651529344.731583:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+276:41279:x1731746396414976:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.731584:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.731585:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000990ef3e/0x3234de053c4e6ae lrc: 4/0,0 mode: PR/PR res: [0x2ba34:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b64 expref: 276 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.731586:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.731587:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d8e16635/0x3234de053c4d471 lrc: 4/0,0 mode: PR/PR res: [0x2ba35:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d03ce expref: 276 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.731589:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000990ef3e/0x3234de053c4e6ae lrc: 3/0,0 mode: PR/PR res: [0x2ba34:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b64 expref: 276 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.731593:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d8e16635/0x3234de053c4d471 lrc: 3/0,0 mode: PR/PR res: [0x2ba35:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d03ce expref: 276 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.731595:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000990ef3e/0x3234de053c4e6ae lrc: 0/0,0 mode: --/PR res: [0x2ba34:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b64 expref: 276 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.731598:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.731599:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8e16635/0x3234de053c4d471 lrc: 0/0,0 mode: --/PR res: [0x2ba35:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d03ce expref: 275 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.731599:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.731600:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52904 lrc: 3/0,1 mode: PW/PW res: [0x2ba34:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.731603:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.731603:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.731603:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52904 lrc: 4/0,1 mode: PW/PW res: [0x2ba34:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.731604:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c5290b lrc: 3/0,1 mode: PW/PW res: [0x2ba35:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.731608:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c5290b lrc: 4/0,1 mode: PW/PW res: [0x2ba35:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.731609:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.731614:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.731615:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+274:41279:x1731746396414912:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 34us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.731618:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13074 00000100:00100000:1.0:1651529344.731620:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+274:41279:x1731746396414976:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 37us (74us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.731623:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13075 00000100:00100000:0.0:1651529344.731624:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13076 00000100:00100000:0.0:1651529344.731626:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+272:41279:x1731746396415040:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.731628:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.731630:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c5290b lrc: 3/0,1 mode: PW/PW res: [0x2ba35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.731630:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000095947c5f/0x3234de053c4eb0e lrc: 4/0,0 mode: PR/PR res: [0x2ba36:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5dd9 expref: 272 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.731633:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000095947c5f/0x3234de053c4eb0e lrc: 3/0,0 mode: PR/PR res: [0x2ba36:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5dd9 expref: 272 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.731634:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c5290b lrc: 3/0,1 mode: PW/PW res: [0x2ba35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.731637:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c5290b lrc: 3/0,1 mode: PW/PW res: [0x2ba35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.731638:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095947c5f/0x3234de053c4eb0e lrc: 0/0,0 mode: --/PR res: [0x2ba36:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5dd9 expref: 272 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.731642:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c5290b lrc: 2/0,0 mode: PW/PW res: [0x2ba35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.731642:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.731642:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.731643:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52912 lrc: 3/0,1 mode: PW/PW res: [0x2ba36:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.731646:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52912 lrc: 4/0,1 mode: PW/PW res: [0x2ba36:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.731658:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.731663:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+271:41279:x1731746396415040:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 37us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.731666:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13076 00010000:00010000:0.0:1651529344.731672:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c5290b lrc: 2/0,0 mode: PW/PW res: [0x2ba35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.731675:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f183a40b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.731676:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c5290b lrc: 2/0,0 mode: PW/PW res: [0x2ba35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.731679:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c5290b lrc: 3/0,0 mode: PW/PW res: [0x2ba35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.731683:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c5290b lrc: 1/0,0 mode: --/PW res: [0x2ba35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.731691:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1794:39030:x1731745946533824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 587us (606us total) trans 12885080347 rc 0/0 00010000:00010000:0.0:1651529344.731694:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c5290b lrc: 0/0,0 mode: --/PW res: [0x2ba35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.731695:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212293 00010000:00010000:0.0:1651529344.731700:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52912 lrc: 3/0,1 mode: PW/PW res: [0x2ba36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.731703:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52912 lrc: 3/0,1 mode: PW/PW res: [0x2ba36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.731706:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52912 lrc: 3/0,1 mode: PW/PW res: [0x2ba36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.731709:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52912 lrc: 2/0,0 mode: PW/PW res: [0x2ba36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.731787:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1794:39030:x1731745946533888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 588us (604us total) trans 12885080348 rc 0/0 00000100:00100000:0.0:1651529344.731790:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212294 00010000:00010000:0.0:1651529344.731810:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52912 lrc: 2/0,0 mode: PW/PW res: [0x2ba36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.731813:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f9b62460 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.731814:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52912 lrc: 2/0,0 mode: PW/PW res: [0x2ba36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.731818:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52912 lrc: 3/0,0 mode: PW/PW res: [0x2ba36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.731823:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52912 lrc: 1/0,0 mode: --/PW res: [0x2ba36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.731826:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.731826:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52912 lrc: 0/0,0 mode: --/PW res: [0x2ba36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.731837:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.731844:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d28c414b pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997053632:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.731845:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.731848:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52919 lrc: 3/0,1 mode: --/PW res: [0x2ba38:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.731854:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002a957ba7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997053696:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.731858:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52920 lrc: 3/0,1 mode: --/PW res: [0x2ba3a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.731865:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000078f9a278 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997053760:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.731867:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52927 lrc: 3/0,1 mode: --/PW res: [0x2ba37:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.731867:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52904 lrc: 3/0,1 mode: PW/PW res: [0x2ba34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.731870:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52904 lrc: 3/0,1 mode: PW/PW res: [0x2ba34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.731873:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396415168 00010000:00010000:0.0:1651529344.731873:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52904 lrc: 3/0,1 mode: PW/PW res: [0x2ba34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.731875:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52904 lrc: 2/0,0 mode: PW/PW res: [0x2ba34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.731877:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c82283d8/0x3234de053c4d726 lrc: 4/0,0 mode: PR/PR res: [0x2ba3a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e32 expref: 271 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.731883:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396415104 00010000:00010000:1.0:1651529344.731892:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001b709cd0/0x3234de053c4e867 lrc: 4/0,0 mode: PR/PR res: [0x2ba38:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d52aa expref: 272 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.731904:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396415232 00010000:00010000:1.0:1651529344.731907:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000886d403b/0x3234de053c4d814 lrc: 4/0,0 mode: PR/PR res: [0x2ba37:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d117a expref: 273 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.731912:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13077 00000100:00100000:1.0:1651529344.731913:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+273:41278:x1731746396415168:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.731916:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.731917:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c82283d8/0x3234de053c4d726 lrc: 4/0,0 mode: PR/PR res: [0x2ba3a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e32 expref: 273 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.731921:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c82283d8/0x3234de053c4d726 lrc: 3/0,0 mode: PR/PR res: [0x2ba3a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e32 expref: 273 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.731926:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c82283d8/0x3234de053c4d726 lrc: 0/0,0 mode: --/PR res: [0x2ba3a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e32 expref: 273 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.731930:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.731930:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.731931:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52920 lrc: 3/0,1 mode: PW/PW res: [0x2ba3a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.731934:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52920 lrc: 4/0,1 mode: PW/PW res: [0x2ba3a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.731940:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.731942:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1794:39030:x1731745946533760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 840us (871us total) trans 12885080349 rc 0/0 00000100:00100000:0.0:1651529344.731945:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212292 00000100:00100000:1.0:1651529344.731947:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+272:41278:x1731746396415168:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 33us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.731950:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13077 00000100:00100000:1.0:1651529344.731954:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13078 00000100:00100000:1.0:1651529344.731956:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+271:41278:x1731746396415104:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.731958:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.731959:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001b709cd0/0x3234de053c4e867 lrc: 4/0,0 mode: PR/PR res: [0x2ba38:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d52aa expref: 271 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.731963:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001b709cd0/0x3234de053c4e867 lrc: 3/0,0 mode: PR/PR res: [0x2ba38:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d52aa expref: 271 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.731966:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13079 00010000:00010000:1.0:1651529344.731967:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b709cd0/0x3234de053c4e867 lrc: 0/0,0 mode: --/PR res: [0x2ba38:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d52aa expref: 271 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.731968:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000969ab41d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+271:41278:x1731746396415232:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.731970:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.731971:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.731972:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52919 lrc: 3/0,1 mode: PW/PW res: [0x2ba38:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.731972:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.731974:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52919 lrc: 4/0,1 mode: PW/PW res: [0x2ba38:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.731974:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000886d403b/0x3234de053c4d814 lrc: 4/0,0 mode: PR/PR res: [0x2ba37:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d117a expref: 270 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.731984:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.731990:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+270:41278:x1731746396415104:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.731992:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13078 00010000:00010000:1.0:1651529344.732000:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52904 lrc: 2/0,0 mode: PW/PW res: [0x2ba34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.732003:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000886d403b/0x3234de053c4d814 lrc: 3/0,0 mode: PR/PR res: [0x2ba37:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d117a expref: 269 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.732009:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000886d403b/0x3234de053c4d814 lrc: 0/0,0 mode: --/PR res: [0x2ba37:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d117a expref: 269 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.732011:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004dda5a3f already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.732012:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52904 lrc: 2/0,0 mode: PW/PW res: [0x2ba34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.732013:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.732014:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.732015:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52904 lrc: 3/0,0 mode: PW/PW res: [0x2ba34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.732015:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52927 lrc: 3/0,1 mode: PW/PW res: [0x2ba37:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.732018:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52927 lrc: 4/0,1 mode: PW/PW res: [0x2ba37:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.732020:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52904 lrc: 1/0,0 mode: --/PW res: [0x2ba34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.732023:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52904 lrc: 0/0,0 mode: --/PW res: [0x2ba34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.732027:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.732034:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52927 lrc: 3/0,1 mode: PW/PW res: [0x2ba37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.732034:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000969ab41d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+268:41278:x1731746396415232:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 66us (190us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.732037:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52927 lrc: 3/0,1 mode: PW/PW res: [0x2ba37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.732037:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13079 00010000:00010000:1.0:1651529344.732040:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52927 lrc: 3/0,1 mode: PW/PW res: [0x2ba37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.732043:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52927 lrc: 2/0,0 mode: PW/PW res: [0x2ba37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.732056:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52919 lrc: 3/0,1 mode: PW/PW res: [0x2ba38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.732060:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52919 lrc: 3/0,1 mode: PW/PW res: [0x2ba38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.732065:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52919 lrc: 3/0,1 mode: PW/PW res: [0x2ba38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.732068:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52919 lrc: 2/0,0 mode: PW/PW res: [0x2ba38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.732083:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1794:39030:x1731745946533952:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 717us (834us total) trans 12885080350 rc 0/0 00000100:00100000:1.0:1651529344.732086:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212297 00010000:00010000:1.0:1651529344.732093:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52920 lrc: 3/0,1 mode: PW/PW res: [0x2ba3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.732096:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52920 lrc: 3/0,1 mode: PW/PW res: [0x2ba3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.732100:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52920 lrc: 3/0,1 mode: PW/PW res: [0x2ba3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.732102:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52920 lrc: 2/0,0 mode: PW/PW res: [0x2ba3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.732105:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1794:39030:x1731745946534016:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 807us (908us total) trans 12885080351 rc 0/0 00000100:00100000:0.0:1651529344.732108:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212295 00010000:00010000:0.0:1651529344.732115:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52927 lrc: 2/0,0 mode: PW/PW res: [0x2ba37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.732118:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f1b4c19f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.732119:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52927 lrc: 2/0,0 mode: PW/PW res: [0x2ba37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.732122:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52927 lrc: 3/0,0 mode: PW/PW res: [0x2ba37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.732127:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52927 lrc: 1/0,0 mode: --/PW res: [0x2ba37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.732129:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52927 lrc: 0/0,0 mode: --/PW res: [0x2ba37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.732134:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1794:39030:x1731745946534144:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 826us (900us total) trans 12885080352 rc 0/0 00010000:00010000:0.0:1651529344.732134:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52919 lrc: 2/0,0 mode: PW/PW res: [0x2ba38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.732137:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212296 00010000:00010000:0.0:1651529344.732137:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000091ee0f93 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.732138:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52919 lrc: 2/0,0 mode: PW/PW res: [0x2ba38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.732140:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52919 lrc: 3/0,0 mode: PW/PW res: [0x2ba38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.732143:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52920 lrc: 2/0,0 mode: PW/PW res: [0x2ba3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.732143:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52919 lrc: 1/0,0 mode: --/PW res: [0x2ba38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.732146:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000046fea5cc already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.732146:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52919 lrc: 0/0,0 mode: --/PW res: [0x2ba38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.732147:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52920 lrc: 2/0,0 mode: PW/PW res: [0x2ba3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.732150:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52920 lrc: 3/0,0 mode: PW/PW res: [0x2ba3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.732154:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52920 lrc: 1/0,0 mode: --/PW res: [0x2ba3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.732157:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52920 lrc: 0/0,0 mode: --/PW res: [0x2ba3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.732174:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.732198:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.732210:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.732252:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.732261:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946534272 00000100:00100000:0.0:1651529344.732269:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e7f02909 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997053824:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.732273:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c5292e lrc: 3/0,1 mode: --/PW res: [0x2ba39:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.732275:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946534336 00000100:00100000:1.0:1651529344.732283:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212300 00000100:00100000:1.0:1651529344.732285:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1795:39030:x1731745946534272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.732289:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212301 00002000:00080000:1.0:1651529344.732290:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178748 count 1 00000100:00100000:0.0:1651529344.732290:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1795:39030:x1731745946534336:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.732295:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c5293c lrc: 3/0,1 mode: --/PW res: [0x2ba3c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.732299:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000018f8f210/0x3234de053c4d685 lrc: 2/0,0 mode: PR/PR res: [0x2ba3c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b99 expref: 267 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.732302:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.732303:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.732304:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c5293c lrc: 4/0,1 mode: --/PW res: [0x2ba3c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.732310:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000018f8f210/0x3234de053c4d685 lrc: 3/0,0 mode: PR/PR res: [0x2ba3c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b99 expref: 267 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.732310:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178749 count 1 00010000:00010000:1.0:1651529344.732313:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000018f8f210/0x3234de053c4d685 lrc: 4/0,0 mode: PR/PR res: [0x2ba3c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b99 expref: 267 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.732314:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52943 lrc: 3/0,1 mode: --/PW res: [0x2ba3d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.732319:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008547b276/0x3234de053c4dd4d lrc: 2/0,0 mode: PR/PR res: [0x2ba3d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2657 expref: 267 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.732321:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002a957ba7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997053952:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.732322:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.732323:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.732323:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52943 lrc: 4/0,1 mode: --/PW res: [0x2ba3d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.732330:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008547b276/0x3234de053c4dd4d lrc: 3/0,0 mode: PR/PR res: [0x2ba3d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2657 expref: 267 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.732332:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.732333:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008547b276/0x3234de053c4dd4d lrc: 4/0,0 mode: PR/PR res: [0x2ba3d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2657 expref: 267 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.732338:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014f8af45 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997053888:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.732338:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e7f02909 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997054016:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.732342:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52935 lrc: 3/0,1 mode: --/PW res: [0x2ba3b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.732347:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 000000008dd99533 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.732348:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396415296 00010000:00010000:1.0:1651529344.732352:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d234cfa5/0x3234de053c4e0cd lrc: 4/0,0 mode: PR/PR res: [0x2ba39:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d33e0 expref: 268 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.732354:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396415360 00000100:00100000:1.0:1651529344.732359:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13080 00010000:00010000:0.0:1651529344.732359:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000080a9b35b/0x3234de053c4cf07 lrc: 4/0,0 mode: PR/PR res: [0x2ba3b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cedee expref: 269 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.732361:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+269:41279:x1731746396415296:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.732363:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.732365:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d234cfa5/0x3234de053c4e0cd lrc: 4/0,0 mode: PR/PR res: [0x2ba39:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d33e0 expref: 269 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.732368:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d234cfa5/0x3234de053c4e0cd lrc: 3/0,0 mode: PR/PR res: [0x2ba39:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d33e0 expref: 269 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.732374:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d234cfa5/0x3234de053c4e0cd lrc: 0/0,0 mode: --/PR res: [0x2ba39:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d33e0 expref: 269 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.732377:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.732378:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.732379:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c5292e lrc: 3/0,1 mode: PW/PW res: [0x2ba39:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.732382:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c5292e lrc: 4/0,1 mode: PW/PW res: [0x2ba39:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.732387:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13081 00000100:00100000:0.0:1651529344.732389:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+268:41279:x1731746396415360:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.732393:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.732394:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000080a9b35b/0x3234de053c4cf07 lrc: 4/0,0 mode: PR/PR res: [0x2ba3b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cedee expref: 268 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.732398:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.732403:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000080a9b35b/0x3234de053c4cf07 lrc: 3/0,0 mode: PR/PR res: [0x2ba3b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cedee expref: 268 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.732405:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+268:41279:x1731746396415296:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 43us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.732408:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13080 00010000:00010000:0.0:1651529344.732421:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080a9b35b/0x3234de053c4cf07 lrc: 0/0,0 mode: --/PR res: [0x2ba3b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cedee expref: 267 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.732425:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.732426:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.732427:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52935 lrc: 3/0,1 mode: PW/PW res: [0x2ba3b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.732430:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52935 lrc: 4/0,1 mode: PW/PW res: [0x2ba3b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.732440:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.732447:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+266:41279:x1731746396415360:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 57us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.732450:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13081 00000100:00100000:1.0:1651529344.732452:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.732457:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c5292e lrc: 3/0,1 mode: PW/PW res: [0x2ba39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.732460:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c5292e lrc: 3/0,1 mode: PW/PW res: [0x2ba39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.732463:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c5292e lrc: 3/0,1 mode: PW/PW res: [0x2ba39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.732466:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.732466:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c5292e lrc: 2/0,0 mode: PW/PW res: [0x2ba39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.732479:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.732491:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.732516:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52935 lrc: 3/0,1 mode: PW/PW res: [0x2ba3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.732523:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1796:39030:x1731745946534080:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1154us (1267us total) trans 12885080353 rc 0/0 00010000:00010000:1.0:1651529344.732524:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52935 lrc: 3/0,1 mode: PW/PW res: [0x2ba3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.732526:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212298 00010000:00010000:1.0:1651529344.732528:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52935 lrc: 3/0,1 mode: PW/PW res: [0x2ba3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.732531:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52935 lrc: 2/0,0 mode: PW/PW res: [0x2ba3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.732531:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946534464 00000100:00100000:0.0:1651529344.732544:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946534400 00000100:00100000:0.0:1651529344.732551:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946534528 00000100:00100000:0.0:1651529344.732569:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946534592 00000100:00100000:0.0:1651529344.732575:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212302 00000100:00100000:0.0:1651529344.732577:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1800:39029:x1731745946534464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.732582:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178751 count 1 00000100:00100000:1.0:1651529344.732585:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1800:39030:x1731745946534208:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1171us (1320us total) trans 12885080354 rc 0/0 00010000:00010000:0.0:1651529344.732586:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c5294a lrc: 3/0,1 mode: --/PW res: [0x2ba3f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.732588:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212299 00010000:00010000:0.0:1651529344.732590:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000088555a90/0x3234de053c4bdbf lrc: 2/0,0 mode: PR/PR res: [0x2ba3f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc65d expref: 265 pid: 72395 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.732593:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212303 00010000:00010000:0.0:1651529344.732594:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.732594:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.732595:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1799:39029:x1731745946534400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.732595:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c5294a lrc: 4/0,1 mode: --/PW res: [0x2ba3f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.732600:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178750 count 1 00010000:00010000:0.0:1651529344.732601:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000088555a90/0x3234de053c4bdbf lrc: 3/0,0 mode: PR/PR res: [0x2ba3f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc65d expref: 265 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.732603:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52951 lrc: 3/0,1 mode: --/PW res: [0x2ba3e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.732605:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000088555a90/0x3234de053c4bdbf lrc: 4/0,0 mode: PR/PR res: [0x2ba3f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc65d expref: 265 pid: 72395 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.732608:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a22b9192/0x3234de053c4e748 lrc: 2/0,0 mode: PR/PR res: [0x2ba3e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e04 expref: 265 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.732611:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.732612:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.732612:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52951 lrc: 4/0,1 mode: --/PW res: [0x2ba3e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.732612:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000064719963 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997054080:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.732619:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a22b9192/0x3234de053c4e748 lrc: 3/0,0 mode: PR/PR res: [0x2ba3e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e04 expref: 265 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.732621:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 000000003c8b0daf going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.732622:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a22b9192/0x3234de053c4e748 lrc: 4/0,0 mode: PR/PR res: [0x2ba3e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e04 expref: 265 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.732626:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c5292e lrc: 2/0,0 mode: PW/PW res: [0x2ba39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.732627:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ba0b61e6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997054144:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.732629:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e7aaedb0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.732630:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c5292e lrc: 2/0,0 mode: PW/PW res: [0x2ba39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.732633:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c5292e lrc: 3/0,0 mode: PW/PW res: [0x2ba39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.732634:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e5f43e7 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.732637:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c5292e lrc: 1/0,0 mode: --/PW res: [0x2ba39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.732640:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c5292e lrc: 0/0,0 mode: --/PW res: [0x2ba39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.732641:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212304 00000100:00100000:1.0:1651529344.732642:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1799:39030:x1731745946534528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.732644:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52935 lrc: 2/0,0 mode: PW/PW res: [0x2ba3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.732646:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178752 count 1 00010000:00010000:0.0:1651529344.732647:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003551d5d1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.732648:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52935 lrc: 2/0,0 mode: PW/PW res: [0x2ba3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.732649:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52958 lrc: 3/0,1 mode: --/PW res: [0x2ba40:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.732650:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52935 lrc: 3/0,0 mode: PW/PW res: [0x2ba3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.732654:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52935 lrc: 1/0,0 mode: --/PW res: [0x2ba3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.732655:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000026eedb61/0x3234de053c4efd0 lrc: 2/0,0 mode: PR/PR res: [0x2ba40:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d71e4 expref: 265 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.732657:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52935 lrc: 0/0,0 mode: --/PW res: [0x2ba3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.732658:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.732659:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.732660:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52958 lrc: 4/0,1 mode: --/PW res: [0x2ba40:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.732664:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212305 00010000:00010000:1.0:1651529344.732665:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000026eedb61/0x3234de053c4efd0 lrc: 3/0,0 mode: PR/PR res: [0x2ba40:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d71e4 expref: 265 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.732665:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1799:39030:x1731745946534592:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.732668:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000026eedb61/0x3234de053c4efd0 lrc: 4/0,0 mode: PR/PR res: [0x2ba40:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d71e4 expref: 265 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:0.0:1651529344.732670:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178753 count 1 00000100:00100000:1.0:1651529344.732672:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000716b388d pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997054208:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.732672:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c5295f lrc: 3/0,1 mode: --/PW res: [0x2ba41:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.732676:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bbab018b/0x3234de053c4f0fd lrc: 2/0,0 mode: PR/PR res: [0x2ba41:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7660 expref: 265 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.732678:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aeda71fe going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.732679:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.732680:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.732680:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c5295f lrc: 4/0,1 mode: --/PW res: [0x2ba41:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.732686:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bbab018b/0x3234de053c4f0fd lrc: 3/0,0 mode: PR/PR res: [0x2ba41:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7660 expref: 265 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.732690:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bbab018b/0x3234de053c4f0fd lrc: 4/0,0 mode: PR/PR res: [0x2ba41:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7660 expref: 265 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.732696:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d28c414b pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997054272:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.732703:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c086aae3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.732788:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.732797:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002a957ba7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997053952:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.732802:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c5293c lrc: 3/0,1 mode: --/PW res: [0x2ba3c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.732807:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.732817:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396415424 00000100:00100000:0.0:1651529344.732821:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e7f02909 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997054016:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.732822:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000018f8f210/0x3234de053c4d685 lrc: 4/0,0 mode: PR/PR res: [0x2ba3c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b99 expref: 266 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.732825:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52943 lrc: 3/0,1 mode: --/PW res: [0x2ba3d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.732829:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396415488 00010000:00010000:1.0:1651529344.732832:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008547b276/0x3234de053c4dd4d lrc: 4/0,0 mode: PR/PR res: [0x2ba3d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2657 expref: 267 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.732833:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13082 00000100:00100000:0.0:1651529344.732835:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+267:41278:x1731746396415424:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.732838:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13083 00010000:00010000:0.0:1651529344.732838:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.732840:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+267:41278:x1731746396415488:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.732840:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000018f8f210/0x3234de053c4d685 lrc: 4/0,0 mode: PR/PR res: [0x2ba3c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b99 expref: 267 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.732843:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.732843:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000018f8f210/0x3234de053c4d685 lrc: 3/0,0 mode: PR/PR res: [0x2ba3c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b99 expref: 267 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.732844:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008547b276/0x3234de053c4dd4d lrc: 4/0,0 mode: PR/PR res: [0x2ba3d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2657 expref: 267 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.732848:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008547b276/0x3234de053c4dd4d lrc: 3/0,0 mode: PR/PR res: [0x2ba3d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2657 expref: 267 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.732849:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018f8f210/0x3234de053c4d685 lrc: 0/0,0 mode: --/PR res: [0x2ba3c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b99 expref: 267 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.732853:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008547b276/0x3234de053c4dd4d lrc: 0/0,0 mode: --/PR res: [0x2ba3d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2657 expref: 267 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.732857:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.732857:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.732858:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52943 lrc: 3/0,1 mode: PW/PW res: [0x2ba3d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.732861:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52943 lrc: 4/0,1 mode: PW/PW res: [0x2ba3d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.732875:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.732877:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.732877:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.732878:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c5293c lrc: 3/0,1 mode: PW/PW res: [0x2ba3c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.732886:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+265:41278:x1731746396415488:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 46us (91us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.732888:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c5293c lrc: 4/0,1 mode: PW/PW res: [0x2ba3c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.732889:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13083 00010000:00010000:0.0:1651529344.732898:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.732903:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c5293c lrc: 3/0,1 mode: PW/PW res: [0x2ba3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.732905:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+264:41278:x1731746396415424:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 70us (118us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.732907:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c5293c lrc: 3/0,1 mode: PW/PW res: [0x2ba3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.732908:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13082 00010000:00010000:1.0:1651529344.732910:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c5293c lrc: 3/0,1 mode: PW/PW res: [0x2ba3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.732913:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c5293c lrc: 2/0,0 mode: PW/PW res: [0x2ba3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.732916:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52943 lrc: 3/0,1 mode: PW/PW res: [0x2ba3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.732920:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52943 lrc: 3/0,1 mode: PW/PW res: [0x2ba3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.732923:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52943 lrc: 3/0,1 mode: PW/PW res: [0x2ba3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.732925:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52943 lrc: 2/0,0 mode: PW/PW res: [0x2ba3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.732954:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1801:39030:x1731745946534272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 669us (781us total) trans 12885080355 rc 0/0 00000100:00100000:1.0:1651529344.732957:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212300 00010000:00010000:1.0:1651529344.732964:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c5293c lrc: 2/0,0 mode: PW/PW res: [0x2ba3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.732966:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1800:39030:x1731745946534336:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 675us (768us total) trans 12885080356 rc 0/0 00010000:00010000:1.0:1651529344.732967:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000820e505a already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.732968:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c5293c lrc: 2/0,0 mode: PW/PW res: [0x2ba3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.732969:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212301 00010000:00010000:1.0:1651529344.732971:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c5293c lrc: 3/0,0 mode: PW/PW res: [0x2ba3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.732976:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c5293c lrc: 1/0,0 mode: --/PW res: [0x2ba3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.732977:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52943 lrc: 2/0,0 mode: PW/PW res: [0x2ba3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.732978:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c5293c lrc: 0/0,0 mode: --/PW res: [0x2ba3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.732980:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fafb79d3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.732981:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52943 lrc: 2/0,0 mode: PW/PW res: [0x2ba3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.732993:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.733012:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52943 lrc: 3/0,0 mode: PW/PW res: [0x2ba3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.733026:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.733034:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52943 lrc: 1/0,0 mode: --/PW res: [0x2ba3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.733037:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52943 lrc: 0/0,0 mode: --/PW res: [0x2ba3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.733048:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000064719963 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997054080:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.733052:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c5294a lrc: 3/0,1 mode: --/PW res: [0x2ba3f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.733058:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946534720 00000100:00100000:0.0:1651529344.733064:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946534656 00000100:00100000:0.0:1651529344.733068:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212306 00000100:00100000:0.0:1651529344.733070:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1801:39029:x1731745946534720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.733075:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178755 count 1 00010000:00010000:0.0:1651529344.733078:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52966 lrc: 3/0,1 mode: --/PW res: [0x2ba43:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.733082:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006549e73a/0x3234de053c4d37c lrc: 2/0,0 mode: PR/PR res: [0x2ba43:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0016 expref: 263 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.733085:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.733086:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.733094:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.733094:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52966 lrc: 4/0,1 mode: --/PW res: [0x2ba43:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.733102:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.733105:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006549e73a/0x3234de053c4d37c lrc: 3/0,0 mode: PR/PR res: [0x2ba43:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0016 expref: 263 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.733109:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.733109:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006549e73a/0x3234de053c4d37c lrc: 4/0,0 mode: PR/PR res: [0x2ba43:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0016 expref: 263 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.733113:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000064719963 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997054336:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.733116:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.733121:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b81e4a0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.733128:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d28c414b pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997054272:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.733132:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c5295f lrc: 3/0,1 mode: --/PW res: [0x2ba41:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.733139:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212307 00000100:00100000:0.0:1651529344.733140:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1801:39029:x1731745946534656:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.733145:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178754 count 1 00010000:00010000:0.0:1651529344.733148:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5296d lrc: 3/0,1 mode: --/PW res: [0x2ba42:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.733150:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ba0b61e6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997054144:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.733152:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bd6eb0da/0x3234de053c4ed92 lrc: 2/0,0 mode: PR/PR res: [0x2ba42:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d68de expref: 263 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.733154:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52951 lrc: 3/0,1 mode: --/PW res: [0x2ba3e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.733155:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.733155:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.733156:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5296d lrc: 4/0,1 mode: --/PW res: [0x2ba42:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.733162:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000716b388d pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997054208:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.733162:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bd6eb0da/0x3234de053c4ed92 lrc: 3/0,0 mode: PR/PR res: [0x2ba42:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d68de expref: 263 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.733164:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52958 lrc: 3/0,1 mode: --/PW res: [0x2ba40:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.733165:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bd6eb0da/0x3234de053c4ed92 lrc: 4/0,0 mode: PR/PR res: [0x2ba42:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d68de expref: 263 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.733169:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d28c414b pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997054400:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.733170:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396415616 00010000:00010000:1.0:1651529344.733174:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a22b9192/0x3234de053c4e748 lrc: 4/0,0 mode: PR/PR res: [0x2ba3e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e04 expref: 264 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.733182:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c086aae3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.733186:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396415744 00010000:00010000:1.0:1651529344.733189:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bbab018b/0x3234de053c4f0fd lrc: 4/0,0 mode: PR/PR res: [0x2ba41:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7660 expref: 265 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.733193:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396415680 00010000:00010000:1.0:1651529344.733195:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000026eedb61/0x3234de053c4efd0 lrc: 4/0,0 mode: PR/PR res: [0x2ba40:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d71e4 expref: 266 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.733203:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13084 00000100:00100000:1.0:1651529344.733204:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+266:41279:x1731746396415616:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.733205:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396415552 00010000:00010000:1.0:1651529344.733207:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.733208:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a22b9192/0x3234de053c4e748 lrc: 4/0,0 mode: PR/PR res: [0x2ba3e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e04 expref: 267 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.733211:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000088555a90/0x3234de053c4bdbf lrc: 4/0,0 mode: PR/PR res: [0x2ba3f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc65d expref: 267 pid: 72395 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.733212:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a22b9192/0x3234de053c4e748 lrc: 3/0,0 mode: PR/PR res: [0x2ba3e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e04 expref: 267 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.733217:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a22b9192/0x3234de053c4e748 lrc: 0/0,0 mode: --/PR res: [0x2ba3e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4e04 expref: 267 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.733217:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13085 00000100:00100000:0.0:1651529344.733219:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+267:41279:x1731746396415744:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.733221:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.733232:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.733234:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52951 lrc: 3/0,1 mode: PW/PW res: [0x2ba3e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.733238:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.733240:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bbab018b/0x3234de053c4f0fd lrc: 4/0,0 mode: PR/PR res: [0x2ba41:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7660 expref: 266 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.733241:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52951 lrc: 4/0,1 mode: PW/PW res: [0x2ba3e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.733244:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bbab018b/0x3234de053c4f0fd lrc: 3/0,0 mode: PR/PR res: [0x2ba41:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7660 expref: 266 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.733248:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.733249:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bbab018b/0x3234de053c4f0fd lrc: 0/0,0 mode: --/PR res: [0x2ba41:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7660 expref: 266 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.733255:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+266:41279:x1731746396415616:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 50us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.733258:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13084 00000100:00100000:1.0:1651529344.733262:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13086 00000100:00100000:1.0:1651529344.733264:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+265:41278:x1731746396415680:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.733267:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.733267:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.733267:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.733268:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000026eedb61/0x3234de053c4efd0 lrc: 4/0,0 mode: PR/PR res: [0x2ba40:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d71e4 expref: 264 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.733268:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c5295f lrc: 3/0,1 mode: PW/PW res: [0x2ba41:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.733271:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c5295f lrc: 4/0,1 mode: PW/PW res: [0x2ba41:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.733272:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000026eedb61/0x3234de053c4efd0 lrc: 3/0,0 mode: PR/PR res: [0x2ba40:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d71e4 expref: 264 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.733276:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026eedb61/0x3234de053c4efd0 lrc: 0/0,0 mode: --/PR res: [0x2ba40:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d71e4 expref: 264 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.733278:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.733279:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.733280:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.733281:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52958 lrc: 3/0,1 mode: PW/PW res: [0x2ba40:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.733284:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52958 lrc: 4/0,1 mode: PW/PW res: [0x2ba40:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.733286:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+263:41279:x1731746396415744:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 66us (184us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.733289:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.733289:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13085 00000100:00100000:1.0:1651529344.733294:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+263:41278:x1731746396415680:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 29us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.733296:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13086 00000100:00100000:1.0:1651529344.733300:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13087 00000100:00100000:1.0:1651529344.733301:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de23fde4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+262:41278:x1731746396415552:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.733303:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.733305:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000088555a90/0x3234de053c4bdbf lrc: 4/0,0 mode: PR/PR res: [0x2ba3f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc65d expref: 261 pid: 72395 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.733307:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c5295f lrc: 3/0,1 mode: PW/PW res: [0x2ba41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.733311:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000088555a90/0x3234de053c4bdbf lrc: 3/0,0 mode: PR/PR res: [0x2ba3f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc65d expref: 261 pid: 72395 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.733311:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c5295f lrc: 3/0,1 mode: PW/PW res: [0x2ba41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.733314:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c5295f lrc: 3/0,1 mode: PW/PW res: [0x2ba41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.733315:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088555a90/0x3234de053c4bdbf lrc: 0/0,0 mode: --/PR res: [0x2ba3f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc65d expref: 261 pid: 72395 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.733317:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c5295f lrc: 2/0,0 mode: PW/PW res: [0x2ba41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.733318:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.733319:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.733319:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c5294a lrc: 3/0,1 mode: PW/PW res: [0x2ba3f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.733322:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c5294a lrc: 4/0,1 mode: PW/PW res: [0x2ba3f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.733332:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.733337:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de23fde4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+260:41278:x1731746396415552:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.733339:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13087 00010000:00010000:1.0:1651529344.733353:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52958 lrc: 3/0,1 mode: PW/PW res: [0x2ba40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.733356:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52958 lrc: 3/0,1 mode: PW/PW res: [0x2ba40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.733359:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52958 lrc: 3/0,1 mode: PW/PW res: [0x2ba40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.733361:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1802:39030:x1731745946534592:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 695us (870us total) trans 12885080357 rc 0/0 00010000:00010000:1.0:1651529344.733364:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52958 lrc: 2/0,0 mode: PW/PW res: [0x2ba40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.733364:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212305 00010000:00010000:0.0:1651529344.733372:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c5295f lrc: 2/0,0 mode: PW/PW res: [0x2ba41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.733375:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006401eb97 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.733376:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c5295f lrc: 2/0,0 mode: PW/PW res: [0x2ba41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.733379:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c5295f lrc: 3/0,0 mode: PW/PW res: [0x2ba41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.733383:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c5295f lrc: 1/0,0 mode: --/PW res: [0x2ba41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.733386:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c5295f lrc: 0/0,0 mode: --/PW res: [0x2ba41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.733391:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52958 lrc: 2/0,0 mode: PW/PW res: [0x2ba40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.733393:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000050e053bc already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.733394:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52958 lrc: 2/0,0 mode: PW/PW res: [0x2ba40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.733397:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52958 lrc: 3/0,0 mode: PW/PW res: [0x2ba40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.733400:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52958 lrc: 1/0,0 mode: --/PW res: [0x2ba40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.733403:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1802:39030:x1731745946534528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 760us (924us total) trans 12885080358 rc 0/0 00010000:00010000:0.0:1651529344.733405:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52958 lrc: 0/0,0 mode: --/PW res: [0x2ba40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.733406:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212304 00010000:00010000:0.0:1651529344.733410:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c5294a lrc: 3/0,1 mode: PW/PW res: [0x2ba3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.733413:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c5294a lrc: 3/0,1 mode: PW/PW res: [0x2ba3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.733414:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52951 lrc: 3/0,1 mode: PW/PW res: [0x2ba3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.733416:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c5294a lrc: 3/0,1 mode: PW/PW res: [0x2ba3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.733417:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52951 lrc: 3/0,1 mode: PW/PW res: [0x2ba3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.733419:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c5294a lrc: 2/0,0 mode: PW/PW res: [0x2ba3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.733420:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52951 lrc: 3/0,1 mode: PW/PW res: [0x2ba3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.733423:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52951 lrc: 2/0,0 mode: PW/PW res: [0x2ba3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.733462:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1803:39029:x1731745946534400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 867us (996us total) trans 12885080360 rc 0/0 00000100:00100000:0.0:1651529344.733462:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1803:39029:x1731745946534464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 884us (1010us total) trans 12885080359 rc 0/0 00000100:00100000:0.0:1651529344.733464:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212302 00000100:00100000:1.0:1651529344.733466:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212303 00010000:00010000:0.0:1651529344.733472:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c5294a lrc: 2/0,0 mode: PW/PW res: [0x2ba3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.733475:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000576f1f12 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.733476:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c5294a lrc: 2/0,0 mode: PW/PW res: [0x2ba3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.733478:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c5294a lrc: 3/0,0 mode: PW/PW res: [0x2ba3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.733482:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.733483:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c5294a lrc: 1/0,0 mode: --/PW res: [0x2ba3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.733486:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c5294a lrc: 0/0,0 mode: --/PW res: [0x2ba3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.733490:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52951 lrc: 2/0,0 mode: PW/PW res: [0x2ba3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.733493:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009e44ce9d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.733494:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52951 lrc: 2/0,0 mode: PW/PW res: [0x2ba3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.733496:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52951 lrc: 3/0,0 mode: PW/PW res: [0x2ba3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.733507:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52951 lrc: 1/0,0 mode: --/PW res: [0x2ba3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.733509:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.733510:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52951 lrc: 0/0,0 mode: --/PW res: [0x2ba3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.733520:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000064719963 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997054336:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.733524:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52966 lrc: 3/0,1 mode: --/PW res: [0x2ba43:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.733531:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.733558:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946534848 00000100:00100000:1.0:1651529344.733591:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946534784 00000100:00100000:0.0:1651529344.733597:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212308 00000100:00100000:1.0:1651529344.733599:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212309 00000100:00100000:0.0:1651529344.733599:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1803:39029:x1731745946534848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.733601:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1803:39029:x1731745946534784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.733605:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178757 count 1 00002000:00080000:1.0:1651529344.733606:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178756 count 1 00010000:00010000:0.0:1651529344.733609:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c52974 lrc: 3/0,1 mode: --/PW res: [0x2ba45:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.733611:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c5297b lrc: 3/0,1 mode: --/PW res: [0x2ba44:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.733613:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001663c068/0x3234de053c4f6bb lrc: 2/0,0 mode: PR/PR res: [0x2ba45:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8dac expref: 259 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.733615:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001c58dbdd/0x3234de053c4e6e6 lrc: 2/0,0 mode: PR/PR res: [0x2ba44:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c60 expref: 259 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.733618:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.733619:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.733620:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c5297b lrc: 4/0,1 mode: --/PW res: [0x2ba44:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.733626:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001c58dbdd/0x3234de053c4e6e6 lrc: 3/0,0 mode: PR/PR res: [0x2ba44:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c60 expref: 259 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.733629:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001c58dbdd/0x3234de053c4e6e6 lrc: 4/0,0 mode: PR/PR res: [0x2ba44:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c60 expref: 259 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.733634:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000075b025a pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997054464:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.733635:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.733636:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.733637:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c52974 lrc: 4/0,1 mode: --/PW res: [0x2ba45:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.733644:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000412e5d26 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.733645:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001663c068/0x3234de053c4f6bb lrc: 3/0,0 mode: PR/PR res: [0x2ba45:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8dac expref: 259 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.733649:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001663c068/0x3234de053c4f6bb lrc: 4/0,0 mode: PR/PR res: [0x2ba45:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8dac expref: 259 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.733650:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396415808 00000100:00100000:0.0:1651529344.733653:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000064719963 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997054528:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.733655:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006549e73a/0x3234de053c4d37c lrc: 4/0,0 mode: PR/PR res: [0x2ba43:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0016 expref: 260 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.733662:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13088 00000100:00100000:0.0:1651529344.733662:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b81e4a0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.733663:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+260:41278:x1731746396415808:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.733666:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.733667:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006549e73a/0x3234de053c4d37c lrc: 4/0,0 mode: PR/PR res: [0x2ba43:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0016 expref: 260 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.733671:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006549e73a/0x3234de053c4d37c lrc: 3/0,0 mode: PR/PR res: [0x2ba43:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0016 expref: 260 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.733676:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006549e73a/0x3234de053c4d37c lrc: 0/0,0 mode: --/PR res: [0x2ba43:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0016 expref: 260 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.733679:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.733680:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.733681:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52966 lrc: 3/0,1 mode: PW/PW res: [0x2ba43:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.733684:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52966 lrc: 4/0,1 mode: PW/PW res: [0x2ba43:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.733693:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.733696:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52966 lrc: 3/0,1 mode: PW/PW res: [0x2ba43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.733699:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+259:41278:x1731746396415808:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (168us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.733700:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52966 lrc: 3/0,1 mode: PW/PW res: [0x2ba43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.733702:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13088 00010000:00010000:0.0:1651529344.733703:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52966 lrc: 3/0,1 mode: PW/PW res: [0x2ba43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.733720:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52966 lrc: 2/0,0 mode: PW/PW res: [0x2ba43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.733727:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.733763:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.733789:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.733795:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52966 lrc: 2/0,0 mode: PW/PW res: [0x2ba43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.733801:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008517b233 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.733802:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52966 lrc: 2/0,0 mode: PW/PW res: [0x2ba43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.733805:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52966 lrc: 3/0,0 mode: PW/PW res: [0x2ba43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.733815:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52966 lrc: 1/0,0 mode: --/PW res: [0x2ba43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.733818:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52966 lrc: 0/0,0 mode: --/PW res: [0x2ba43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.733826:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946534912 00000100:00100000:0.0:1651529344.733829:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1805:39029:x1731745946534720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 758us (835us total) trans 12885080361 rc 0/0 00000100:00100000:0.0:1651529344.733838:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212306 00000100:00100000:1.0:1651529344.733841:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212310 00000100:00100000:1.0:1651529344.733842:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1804:39030:x1731745946534912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.733844:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946534976 00002000:00080000:1.0:1651529344.733847:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178758 count 1 00010000:00010000:1.0:1651529344.733851:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52982 lrc: 3/0,1 mode: --/PW res: [0x2ba46:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.733851:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212311 00000100:00100000:0.0:1651529344.733852:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1805:39030:x1731745946534976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.733855:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000012ec4a1e/0x3234de053c4d2aa lrc: 2/0,0 mode: PR/PR res: [0x2ba46:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc57 expref: 258 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.733858:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.733859:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.733860:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52982 lrc: 4/0,1 mode: --/PW res: [0x2ba46:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.733866:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000012ec4a1e/0x3234de053c4d2aa lrc: 3/0,0 mode: PR/PR res: [0x2ba46:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc57 expref: 258 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.733870:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000012ec4a1e/0x3234de053c4d2aa lrc: 4/0,0 mode: PR/PR res: [0x2ba46:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc57 expref: 258 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:0.0:1651529344.733871:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178759 count 1 00000100:00100000:1.0:1651529344.733874:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000673bcbe2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997054592:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.733875:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c52989 lrc: 3/0,1 mode: --/PW res: [0x2ba47:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.733880:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ae7e587b/0x3234de053c4d520 lrc: 2/0,0 mode: PR/PR res: [0x2ba47:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0683 expref: 258 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.733882:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 0000000099c1da85 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.733883:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.733884:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.733885:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c52989 lrc: 4/0,1 mode: --/PW res: [0x2ba47:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.733889:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396415872 00010000:00010000:1.0:1651529344.733893:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bd6eb0da/0x3234de053c4ed92 lrc: 5/0,0 mode: PR/PR res: [0x2ba42:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d68de expref: 259 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.733901:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13089 00000100:00100000:1.0:1651529344.733902:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+259:41278:x1731746396415872:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.733902:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ae7e587b/0x3234de053c4d520 lrc: 3/0,0 mode: PR/PR res: [0x2ba47:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0683 expref: 259 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.733905:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.733906:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bd6eb0da/0x3234de053c4ed92 lrc: 5/0,0 mode: PR/PR res: [0x2ba42:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d68de expref: 259 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.733909:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ae7e587b/0x3234de053c4d520 lrc: 4/0,0 mode: PR/PR res: [0x2ba47:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0683 expref: 259 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.733910:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bd6eb0da/0x3234de053c4ed92 lrc: 4/0,0 mode: PR/PR res: [0x2ba42:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d68de expref: 259 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.733913:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e7f02909 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997054656:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.733915:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.733915:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.733916:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5296d lrc: 3/0,1 mode: PW/PW res: [0x2ba42:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.733921:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5296d lrc: 4/0,1 mode: PW/PW res: [0x2ba42:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.733922:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a3b00cf3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.733926:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.733931:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+259:41278:x1731746396415872:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 28us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.733933:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13089 00010000:00010000:0.0:1651529344.733942:0:72395:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd6eb0da/0x3234de053c4ed92 lrc: 0/0,0 mode: --/PR res: [0x2ba42:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d68de expref: 258 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.733947:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d28c414b pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997054400:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.733950:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5296d lrc: 3/0,1 mode: PW/PW res: [0x2ba42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.733954:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5296d lrc: 3/0,1 mode: PW/PW res: [0x2ba42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.733956:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5296d lrc: 3/0,1 mode: PW/PW res: [0x2ba42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.733960:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5296d lrc: 3/0,1 mode: PW/PW res: [0x2ba42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.733962:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5296d lrc: 2/0,0 mode: PW/PW res: [0x2ba42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.733967:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.734011:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1806:39029:x1731745946534656:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 870us (986us total) trans 12885080362 rc 0/0 00000100:00100000:0.0:1651529344.734015:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212307 00000100:00100000:0.0:1651529344.734020:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946535104 00000100:00100000:1.0:1651529344.734023:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.734035:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946535040 00000100:00100000:0.0:1651529344.734042:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212312 00000100:00100000:0.0:1651529344.734044:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1807:39029:x1731745946535104:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.734049:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178761 count 1 00010000:00010000:0.0:1651529344.734052:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52990 lrc: 3/0,1 mode: --/PW res: [0x2ba49:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.734057:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ec9a9356/0x3234de053c4d13e lrc: 2/0,0 mode: PR/PR res: [0x2ba49:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf676 expref: 257 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.734060:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.734061:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.734061:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52990 lrc: 4/0,1 mode: --/PW res: [0x2ba49:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.734074:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ec9a9356/0x3234de053c4d13e lrc: 3/0,0 mode: PR/PR res: [0x2ba49:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf676 expref: 257 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.734078:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ec9a9356/0x3234de053c4d13e lrc: 4/0,0 mode: PR/PR res: [0x2ba49:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf676 expref: 257 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.734082:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d28c414b pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997054720:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.734094:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.734106:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000abca413e going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.734110:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.734113:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212313 00000100:00100000:0.0:1651529344.734125:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1807:39029:x1731745946535040:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.734131:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178760 count 1 00010000:00010000:0.0:1651529344.734135:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c52997 lrc: 3/0,1 mode: --/PW res: [0x2ba48:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.734139:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008c45287a/0x3234de053c4f135 lrc: 2/0,0 mode: PR/PR res: [0x2ba48:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7778 expref: 257 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.734140:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.734142:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.734143:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.734143:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c52997 lrc: 4/0,1 mode: --/PW res: [0x2ba48:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.734147:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946535168 00010000:00010000:0.0:1651529344.734149:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008c45287a/0x3234de053c4f135 lrc: 3/0,0 mode: PR/PR res: [0x2ba48:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7778 expref: 257 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.734152:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008c45287a/0x3234de053c4f135 lrc: 4/0,0 mode: PR/PR res: [0x2ba48:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7778 expref: 257 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.734153:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212314 00000100:00100000:1.0:1651529344.734155:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1808:39030:x1731745946535168:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.734156:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004534b316 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997054784:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.734160:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178762 count 1 00010000:00010000:1.0:1651529344.734164:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c5299e lrc: 3/0,1 mode: --/PW res: [0x2ba4a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.734169:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006c0d3581/0x3234de053c4f2d9 lrc: 2/0,0 mode: PR/PR res: [0x2ba4a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e2b expref: 257 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.734172:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.734173:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.734173:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c5299e lrc: 4/0,1 mode: --/PW res: [0x2ba4a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.734182:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006c0d3581/0x3234de053c4f2d9 lrc: 3/0,0 mode: PR/PR res: [0x2ba4a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e2b expref: 257 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.734186:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006c0d3581/0x3234de053c4f2d9 lrc: 4/0,0 mode: PR/PR res: [0x2ba4a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e2b expref: 257 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.734194:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000003678d25f going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.734200:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5296d lrc: 2/0,0 mode: PW/PW res: [0x2ba42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.734203:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f0bd9bfb already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.734204:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5296d lrc: 2/0,0 mode: PW/PW res: [0x2ba42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.734205:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ba0b61e6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997054848:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.734207:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5296d lrc: 3/0,0 mode: PW/PW res: [0x2ba42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.734212:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5296d lrc: 1/0,0 mode: --/PW res: [0x2ba42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.734214:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cfa1ca05 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.734215:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5296d lrc: 0/0,0 mode: --/PW res: [0x2ba42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.734238:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000075b025a pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997054464:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.734242:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c5297b lrc: 3/0,1 mode: --/PW res: [0x2ba44:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.734244:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000064719963 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997054528:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.734248:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c52974 lrc: 3/0,1 mode: --/PW res: [0x2ba45:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.734251:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396415936 00010000:00010000:1.0:1651529344.734256:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001c58dbdd/0x3234de053c4e6e6 lrc: 4/0,0 mode: PR/PR res: [0x2ba44:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c60 expref: 258 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.734263:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396416000 00000100:00100000:0.0:1651529344.734264:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.734265:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001663c068/0x3234de053c4f6bb lrc: 4/0,0 mode: PR/PR res: [0x2ba45:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8dac expref: 259 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.734280:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13090 00000100:00100000:1.0:1651529344.734282:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+259:41279:x1731746396415936:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.734285:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.734286:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001c58dbdd/0x3234de053c4e6e6 lrc: 4/0,0 mode: PR/PR res: [0x2ba44:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c60 expref: 259 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.734290:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001c58dbdd/0x3234de053c4e6e6 lrc: 3/0,0 mode: PR/PR res: [0x2ba44:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c60 expref: 259 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.734296:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c58dbdd/0x3234de053c4e6e6 lrc: 0/0,0 mode: --/PR res: [0x2ba44:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4c60 expref: 259 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.734299:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.734303:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13091 00010000:00010000:1.0:1651529344.734306:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.734306:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+258:41279:x1731746396416000:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.734308:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c5297b lrc: 3/0,1 mode: PW/PW res: [0x2ba44:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.734310:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.734311:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c5297b lrc: 4/0,1 mode: PW/PW res: [0x2ba44:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.734318:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.734329:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+258:41279:x1731746396415936:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 47us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.734332:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13090 00000100:00100000:1.0:1651529344.734340:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946535232 00010000:00010000:0.0:1651529344.734342:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001663c068/0x3234de053c4f6bb lrc: 4/0,0 mode: PR/PR res: [0x2ba45:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8dac expref: 257 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.734346:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212315 00000100:00100000:1.0:1651529344.734347:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1809:39030:x1731745946535232:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.734347:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001663c068/0x3234de053c4f6bb lrc: 3/0,0 mode: PR/PR res: [0x2ba45:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8dac expref: 257 pid: 156655 timeout: 20103 lvb_type: 1 00002000:00080000:1.0:1651529344.734352:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178763 count 1 00010000:00010000:0.0:1651529344.734353:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001663c068/0x3234de053c4f6bb lrc: 0/0,0 mode: --/PR res: [0x2ba45:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8dac expref: 257 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.734356:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c529a5 lrc: 3/0,1 mode: --/PW res: [0x2ba4b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.734357:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.734357:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.734358:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c52974 lrc: 3/0,1 mode: PW/PW res: [0x2ba45:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.734360:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000179eda80/0x3234de053c4ee33 lrc: 2/0,0 mode: PR/PR res: [0x2ba4b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ae4 expref: 256 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.734362:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c52974 lrc: 4/0,1 mode: PW/PW res: [0x2ba45:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.734363:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.734364:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.734364:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c529a5 lrc: 4/0,1 mode: --/PW res: [0x2ba4b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.734368:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.734371:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000179eda80/0x3234de053c4ee33 lrc: 3/0,0 mode: PR/PR res: [0x2ba4b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ae4 expref: 256 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.734374:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000179eda80/0x3234de053c4ee33 lrc: 4/0,0 mode: PR/PR res: [0x2ba4b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ae4 expref: 256 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.734376:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+256:41279:x1731746396416000:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 69us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.734378:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000075b025a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997054912:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.734378:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13091 00000100:00100000:1.0:1651529344.734386:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd96f074 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.734386:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c52974 lrc: 3/0,1 mode: PW/PW res: [0x2ba45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.734389:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c52974 lrc: 3/0,1 mode: PW/PW res: [0x2ba45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.734392:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c52974 lrc: 3/0,1 mode: PW/PW res: [0x2ba45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.734393:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c5297b lrc: 3/0,1 mode: PW/PW res: [0x2ba44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.734395:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c52974 lrc: 2/0,0 mode: PW/PW res: [0x2ba45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.734396:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c5297b lrc: 3/0,1 mode: PW/PW res: [0x2ba44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.734399:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c5297b lrc: 3/0,1 mode: PW/PW res: [0x2ba44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.734402:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c5297b lrc: 2/0,0 mode: PW/PW res: [0x2ba44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.734434:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1811:39029:x1731745946534848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 835us (952us total) trans 12885080363 rc 0/0 00000100:00100000:0.0:1651529344.734437:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212308 00000100:00100000:1.0:1651529344.734442:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1810:39029:x1731745946534784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 840us (932us total) trans 12885080364 rc 0/0 00010000:00010000:0.0:1651529344.734444:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c52974 lrc: 2/0,0 mode: PW/PW res: [0x2ba45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.734445:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212309 00010000:00010000:0.0:1651529344.734447:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000090e99444 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.734449:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c52974 lrc: 2/0,0 mode: PW/PW res: [0x2ba45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.734452:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c5297b lrc: 2/0,0 mode: PW/PW res: [0x2ba44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.734452:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c52974 lrc: 3/0,0 mode: PW/PW res: [0x2ba45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.734455:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000af20b5e7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.734456:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c52974 lrc: 1/0,0 mode: --/PW res: [0x2ba45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.734457:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c5297b lrc: 2/0,0 mode: PW/PW res: [0x2ba44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.734459:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c5297b lrc: 3/0,0 mode: PW/PW res: [0x2ba44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.734459:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c52974 lrc: 0/0,0 mode: --/PW res: [0x2ba45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.734464:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c5297b lrc: 1/0,0 mode: --/PW res: [0x2ba44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.734467:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c5297b lrc: 0/0,0 mode: --/PW res: [0x2ba44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.734510:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000673bcbe2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997054592:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.734514:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52982 lrc: 3/0,1 mode: --/PW res: [0x2ba46:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.734567:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e7f02909 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997054656:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.734572:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c52989 lrc: 3/0,1 mode: --/PW res: [0x2ba47:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.734581:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.734586:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d28c414b pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997054720:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.734589:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.734589:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52990 lrc: 3/0,1 mode: --/PW res: [0x2ba49:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.734598:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.734601:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396416064 00010000:00010000:0.0:1651529344.734610:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000012ec4a1e/0x3234de053c4d2aa lrc: 4/0,0 mode: PR/PR res: [0x2ba46:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc57 expref: 256 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.734614:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.734624:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396416192 00010000:00010000:0.0:1651529344.734627:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ec9a9356/0x3234de053c4d13e lrc: 4/0,0 mode: PR/PR res: [0x2ba49:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf676 expref: 257 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.734629:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.734634:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396416128 00000100:00100000:1.0:1651529344.734635:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396416256 00010000:00010000:0.0:1651529344.734636:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ae7e587b/0x3234de053c4d520 lrc: 4/0,0 mode: PR/PR res: [0x2ba47:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0683 expref: 258 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.734640:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008c45287a/0x3234de053c4f135 lrc: 5/0,0 mode: PR/PR res: [0x2ba48:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7778 expref: 259 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.734640:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396416320 00010000:00010000:0.0:1651529344.734642:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006c0d3581/0x3234de053c4f2d9 lrc: 5/0,0 mode: PR/PR res: [0x2ba4a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e2b expref: 260 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.734647:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13092 00000100:00100000:1.0:1651529344.734649:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+260:41278:x1731746396416064:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.734649:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13093 00000100:00100000:0.0:1651529344.734651:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d46d0fc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+260:41278:x1731746396416192:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.734652:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.734653:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000012ec4a1e/0x3234de053c4d2aa lrc: 4/0,0 mode: PR/PR res: [0x2ba46:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc57 expref: 260 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.734654:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.734655:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ec9a9356/0x3234de053c4d13e lrc: 4/0,0 mode: PR/PR res: [0x2ba49:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf676 expref: 260 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.734657:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000012ec4a1e/0x3234de053c4d2aa lrc: 3/0,0 mode: PR/PR res: [0x2ba46:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc57 expref: 260 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.734659:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ec9a9356/0x3234de053c4d13e lrc: 3/0,0 mode: PR/PR res: [0x2ba49:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf676 expref: 260 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.734662:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012ec4a1e/0x3234de053c4d2aa lrc: 0/0,0 mode: --/PR res: [0x2ba46:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfc57 expref: 260 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.734664:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec9a9356/0x3234de053c4d13e lrc: 0/0,0 mode: --/PR res: [0x2ba49:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf676 expref: 260 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.734666:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.734666:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.734667:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52982 lrc: 3/0,1 mode: PW/PW res: [0x2ba46:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.734668:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.734668:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.734669:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52990 lrc: 3/0,1 mode: PW/PW res: [0x2ba49:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.734670:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52982 lrc: 4/0,1 mode: PW/PW res: [0x2ba46:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.734672:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52990 lrc: 4/0,1 mode: PW/PW res: [0x2ba49:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.734676:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.734688:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+258:41278:x1731746396416064:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 39us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.734691:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13092 00000100:00100000:1.0:1651529344.734701:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13094 00000100:00100000:1.0:1651529344.734703:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+257:41278:x1731746396416128:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.734706:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.734707:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ae7e587b/0x3234de053c4d520 lrc: 4/0,0 mode: PR/PR res: [0x2ba47:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0683 expref: 257 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.734708:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.734711:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ae7e587b/0x3234de053c4d520 lrc: 3/0,0 mode: PR/PR res: [0x2ba47:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0683 expref: 257 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.734716:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae7e587b/0x3234de053c4d520 lrc: 0/0,0 mode: --/PR res: [0x2ba47:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0683 expref: 257 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.734719:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.734720:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.734721:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c52989 lrc: 3/0,1 mode: PW/PW res: [0x2ba47:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.734724:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c52989 lrc: 4/0,1 mode: PW/PW res: [0x2ba47:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.734725:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d46d0fc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+256:41278:x1731746396416192:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 74us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.734729:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13093 00010000:00010000:1.0:1651529344.734732:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.734746:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+256:41278:x1731746396416128:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.734748:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13094 00000100:00100000:1.0:1651529344.734753:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13095 00000100:00100000:1.0:1651529344.734755:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+254:41279:x1731746396416256:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.734756:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13096 00010000:00010000:1.0:1651529344.734758:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.734758:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+254:41279:x1731746396416320:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.734759:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008c45287a/0x3234de053c4f135 lrc: 5/0,0 mode: PR/PR res: [0x2ba48:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7778 expref: 254 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.734761:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.734763:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008c45287a/0x3234de053c4f135 lrc: 4/0,0 mode: PR/PR res: [0x2ba48:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7778 expref: 254 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.734763:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006c0d3581/0x3234de053c4f2d9 lrc: 5/0,0 mode: PR/PR res: [0x2ba4a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e2b expref: 254 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.734767:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006c0d3581/0x3234de053c4f2d9 lrc: 4/0,0 mode: PR/PR res: [0x2ba4a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e2b expref: 254 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.734768:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.734768:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.734769:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c52997 lrc: 3/0,1 mode: PW/PW res: [0x2ba48:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.734772:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c52997 lrc: 4/0,1 mode: PW/PW res: [0x2ba48:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.734772:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.734773:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.734773:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c5299e lrc: 3/0,1 mode: PW/PW res: [0x2ba4a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.734776:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.734776:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c5299e lrc: 4/0,1 mode: PW/PW res: [0x2ba4a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.734780:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+254:41279:x1731746396416256:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 25us (167us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.734781:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.734782:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13095 00000100:00100000:0.0:1651529344.734787:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+253:41279:x1731746396416320:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 29us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.734789:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13096 00010000:00010000:1.0:1651529344.734792:0:80279:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c0d3581/0x3234de053c4f2d9 lrc: 0/0,0 mode: --/PR res: [0x2ba4a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7e2b expref: 252 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.734796:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ba0b61e6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997054848:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.734799:0:80276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c45287a/0x3234de053c4f135 lrc: 0/0,0 mode: --/PR res: [0x2ba48:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7778 expref: 251 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.734800:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c5299e lrc: 3/0,1 mode: PW/PW res: [0x2ba4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.734803:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c5299e lrc: 3/0,1 mode: PW/PW res: [0x2ba4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.734803:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004534b316 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997054784:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.734806:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c5299e lrc: 3/0,1 mode: PW/PW res: [0x2ba4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.734807:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c52997 lrc: 3/0,1 mode: PW/PW res: [0x2ba48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.734809:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c5299e lrc: 3/0,1 mode: PW/PW res: [0x2ba4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.734810:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c52997 lrc: 3/0,1 mode: PW/PW res: [0x2ba48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.734812:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c5299e lrc: 2/0,0 mode: PW/PW res: [0x2ba4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.734813:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c52997 lrc: 3/0,1 mode: PW/PW res: [0x2ba48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.734816:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c52997 lrc: 3/0,1 mode: PW/PW res: [0x2ba48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.734825:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c52997 lrc: 2/0,0 mode: PW/PW res: [0x2ba48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.734854:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1811:39030:x1731745946535168:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 698us (714us total) trans 12885080365 rc 0/0 00000100:00100000:1.0:1651529344.734857:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212314 00010000:00010000:1.0:1651529344.734864:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52982 lrc: 3/0,1 mode: PW/PW res: [0x2ba46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.734865:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1810:39029:x1731745946535040:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 749us (842us total) trans 12885080366 rc 0/0 00010000:00010000:1.0:1651529344.734867:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52982 lrc: 3/0,1 mode: PW/PW res: [0x2ba46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.734868:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212313 00010000:00010000:1.0:1651529344.734870:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52982 lrc: 3/0,1 mode: PW/PW res: [0x2ba46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.734873:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52982 lrc: 2/0,0 mode: PW/PW res: [0x2ba46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.734875:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c5299e lrc: 2/0,0 mode: PW/PW res: [0x2ba4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.734878:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003c075ac0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.734880:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c5299e lrc: 2/0,0 mode: PW/PW res: [0x2ba4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.734885:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c5299e lrc: 3/0,0 mode: PW/PW res: [0x2ba4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.734889:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c5299e lrc: 1/0,0 mode: --/PW res: [0x2ba4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.734892:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c5299e lrc: 0/0,0 mode: --/PW res: [0x2ba4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.734896:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c52997 lrc: 2/0,0 mode: PW/PW res: [0x2ba48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.734899:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bdf2b6c4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.734900:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c52997 lrc: 2/0,0 mode: PW/PW res: [0x2ba48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.734903:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c52997 lrc: 3/0,0 mode: PW/PW res: [0x2ba48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.734904:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1810:39030:x1731745946534912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1061us (1178us total) trans 12885080367 rc 0/0 00010000:00010000:0.0:1651529344.734906:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c52997 lrc: 1/0,0 mode: --/PW res: [0x2ba48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.734907:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212310 00010000:00010000:0.0:1651529344.734908:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c52997 lrc: 0/0,0 mode: --/PW res: [0x2ba48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.734912:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52982 lrc: 2/0,0 mode: PW/PW res: [0x2ba46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.734917:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008ac1e27e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.734918:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52982 lrc: 2/0,0 mode: PW/PW res: [0x2ba46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.734920:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52982 lrc: 3/0,0 mode: PW/PW res: [0x2ba46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.734923:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52982 lrc: 1/0,0 mode: --/PW res: [0x2ba46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.734926:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52982 lrc: 0/0,0 mode: --/PW res: [0x2ba46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.734931:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52990 lrc: 3/0,1 mode: PW/PW res: [0x2ba49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.734933:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.734934:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52990 lrc: 3/0,1 mode: PW/PW res: [0x2ba49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.734937:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52990 lrc: 3/0,1 mode: PW/PW res: [0x2ba49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.734940:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52990 lrc: 2/0,0 mode: PW/PW res: [0x2ba49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.734967:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.734979:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1810:39029:x1731745946535104:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 935us (1012us total) trans 12885080368 rc 0/0 00000100:00100000:1.0:1651529344.734981:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.734983:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212312 00000100:00100000:0.0:1651529344.735000:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946535296 00000100:00100000:0.0:1651529344.735009:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946535360 00000100:00100000:0.0:1651529344.735013:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212316 00000100:00100000:0.0:1651529344.735014:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1811:39030:x1731745946535296:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.735019:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178764 count 1 00010000:00010000:0.0:1651529344.735023:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c529ac lrc: 3/0,1 mode: --/PW res: [0x2ba4c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.735028:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a5fe7e98/0x3234de053c4d176 lrc: 2/0,0 mode: PR/PR res: [0x2ba4c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf717 expref: 250 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.735031:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.735032:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.735032:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c529ac lrc: 4/0,1 mode: --/PW res: [0x2ba4c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.735039:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a5fe7e98/0x3234de053c4d176 lrc: 3/0,0 mode: PR/PR res: [0x2ba4c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf717 expref: 250 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.735042:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a5fe7e98/0x3234de053c4d176 lrc: 4/0,0 mode: PR/PR res: [0x2ba4c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf717 expref: 250 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.735046:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004534b316 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997054976:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.735060:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000075b025a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997054912:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.735065:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000003678d25f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.735069:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c529a5 lrc: 3/0,1 mode: --/PW res: [0x2ba4b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.735078:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212317 00000100:00100000:1.0:1651529344.735079:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1811:39030:x1731745946535360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.735084:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178765 count 1 00010000:00010000:1.0:1651529344.735088:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c529b3 lrc: 3/0,1 mode: --/PW res: [0x2ba4d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.735088:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c52989 lrc: 3/0,1 mode: PW/PW res: [0x2ba47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.735093:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002c1f1994/0x3234de053c4d26b lrc: 2/0,0 mode: PR/PR res: [0x2ba4d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb15 expref: 250 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.735096:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.735096:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.735097:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c529b3 lrc: 4/0,1 mode: --/PW res: [0x2ba4d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.735103:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002c1f1994/0x3234de053c4d26b lrc: 3/0,0 mode: PR/PR res: [0x2ba4d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb15 expref: 250 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.735104:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c52989 lrc: 3/0,1 mode: PW/PW res: [0x2ba47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.735106:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002c1f1994/0x3234de053c4d26b lrc: 4/0,0 mode: PR/PR res: [0x2ba4d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb15 expref: 250 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.735107:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c52989 lrc: 3/0,1 mode: PW/PW res: [0x2ba47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.735110:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000088fa78f8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997055040:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.735110:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c52989 lrc: 2/0,0 mode: PW/PW res: [0x2ba47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.735119:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd96f074 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.735124:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52990 lrc: 2/0,0 mode: PW/PW res: [0x2ba49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.735127:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e48e0bfd already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.735128:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52990 lrc: 2/0,0 mode: PW/PW res: [0x2ba49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.735131:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52990 lrc: 3/0,0 mode: PW/PW res: [0x2ba49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.735135:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52990 lrc: 1/0,0 mode: --/PW res: [0x2ba49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.735138:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52990 lrc: 0/0,0 mode: --/PW res: [0x2ba49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.735142:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c52989 lrc: 2/0,0 mode: PW/PW res: [0x2ba47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.735145:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000029958df2 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.735146:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c52989 lrc: 2/0,0 mode: PW/PW res: [0x2ba47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.735148:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1812:39030:x1731745946534976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1295us (1385us total) trans 12885080369 rc 0/0 00010000:00010000:1.0:1651529344.735149:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c52989 lrc: 3/0,0 mode: PW/PW res: [0x2ba47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.735151:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212311 00010000:00010000:1.0:1651529344.735152:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c52989 lrc: 1/0,0 mode: --/PW res: [0x2ba47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.735157:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c52989 lrc: 0/0,0 mode: --/PW res: [0x2ba47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.735163:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396416384 00010000:00010000:1.0:1651529344.735168:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000179eda80/0x3234de053c4ee33 lrc: 4/0,0 mode: PR/PR res: [0x2ba4b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ae4 expref: 251 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.735180:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13097 00000100:00100000:1.0:1651529344.735182:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+251:41278:x1731746396416384:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.735184:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.735186:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000179eda80/0x3234de053c4ee33 lrc: 4/0,0 mode: PR/PR res: [0x2ba4b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ae4 expref: 251 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.735189:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000179eda80/0x3234de053c4ee33 lrc: 3/0,0 mode: PR/PR res: [0x2ba4b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ae4 expref: 251 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.735194:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000179eda80/0x3234de053c4ee33 lrc: 0/0,0 mode: --/PR res: [0x2ba4b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ae4 expref: 251 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.735197:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.735198:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.735199:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c529a5 lrc: 3/0,1 mode: PW/PW res: [0x2ba4b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.735202:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c529a5 lrc: 4/0,1 mode: PW/PW res: [0x2ba4b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.735211:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.735218:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.735240:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+250:41278:x1731746396416384:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 53us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.735243:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13097 00000100:00100000:1.0:1651529344.735251:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946535488 00000100:00100000:0.0:1651529344.735255:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.735274:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946535424 00000100:00100000:1.0:1651529344.735279:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212318 00000100:00100000:1.0:1651529344.735280:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000098b3c8df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1813:39029:x1731745946535488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.735285:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178767 count 1 00010000:00010000:1.0:1651529344.735289:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c529ba lrc: 3/0,1 mode: --/PW res: [0x2ba4f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.735295:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.735306:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000825a3f3/0x3234de053c4e1a6 lrc: 2/0,0 mode: PR/PR res: [0x2ba4f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d37c2 expref: 249 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.735309:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.735310:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.735310:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c529ba lrc: 4/0,1 mode: --/PW res: [0x2ba4f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.735310:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.735322:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000825a3f3/0x3234de053c4e1a6 lrc: 3/0,0 mode: PR/PR res: [0x2ba4f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d37c2 expref: 249 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.735325:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000825a3f3/0x3234de053c4e1a6 lrc: 4/0,0 mode: PR/PR res: [0x2ba4f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d37c2 expref: 249 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.735331:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946535552 00000100:00100000:1.0:1651529344.735334:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004972eb27 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997055104:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.735338:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946535616 00000100:00100000:0.0:1651529344.735341:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212319 00000100:00100000:0.0:1651529344.735343:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1815:39029:x1731745946535424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.735348:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cfa1ca05 going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.735355:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178766 count 1 00000100:00100000:1.0:1651529344.735357:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212320 00000100:00100000:1.0:1651529344.735359:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1815:39030:x1731745946535552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.735359:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c529c1 lrc: 3/0,1 mode: --/PW res: [0x2ba4e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.735363:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178768 count 1 00010000:00010000:0.0:1651529344.735364:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c4cf5b lrc: 2/0,0 mode: PR/PR res: [0x2ba4e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef22 expref: 249 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.735367:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c529c8 lrc: 3/0,1 mode: --/PW res: [0x2ba50:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.735369:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.735370:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.735371:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c529c1 lrc: 4/0,1 mode: --/PW res: [0x2ba4e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.735372:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006e494d37/0x3234de053c4ef59 lrc: 2/0,0 mode: PR/PR res: [0x2ba50:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f44 expref: 249 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.735375:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.735375:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.735376:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c529c8 lrc: 4/0,1 mode: --/PW res: [0x2ba50:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.735377:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c4cf5b lrc: 3/0,0 mode: PR/PR res: [0x2ba4e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef22 expref: 249 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.735381:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c4cf5b lrc: 4/0,0 mode: PR/PR res: [0x2ba4e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef22 expref: 249 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.735382:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006e494d37/0x3234de053c4ef59 lrc: 3/0,0 mode: PR/PR res: [0x2ba50:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f44 expref: 249 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.735385:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006e494d37/0x3234de053c4ef59 lrc: 4/0,0 mode: PR/PR res: [0x2ba50:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f44 expref: 249 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.735385:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000822949b3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997055168:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.735389:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f9050c71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997055232:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.735394:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a3b00cf3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.735397:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 0000000099c1da85 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.735400:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212321 00010000:00010000:1.0:1651529344.735405:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c529a5 lrc: 3/0,1 mode: PW/PW res: [0x2ba4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.735409:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c529a5 lrc: 3/0,1 mode: PW/PW res: [0x2ba4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.735412:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c529a5 lrc: 3/0,1 mode: PW/PW res: [0x2ba4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.735415:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c529a5 lrc: 2/0,0 mode: PW/PW res: [0x2ba4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.735418:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1815:39030:x1731745946535616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.735429:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178769 count 1 00010000:00010000:0.0:1651529344.735433:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c529cf lrc: 3/0,1 mode: --/PW res: [0x2ba51:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.735438:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001d4e57f9/0x3234de053c4c782 lrc: 2/0,0 mode: PR/PR res: [0x2ba51:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd058 expref: 249 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.735441:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.735441:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.735442:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c529cf lrc: 4/0,1 mode: --/PW res: [0x2ba51:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.735450:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001d4e57f9/0x3234de053c4c782 lrc: 3/0,0 mode: PR/PR res: [0x2ba51:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd058 expref: 249 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.735454:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001d4e57f9/0x3234de053c4c782 lrc: 4/0,0 mode: PR/PR res: [0x2ba51:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd058 expref: 249 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.735457:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1816:39030:x1731745946535232:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1109us (1193us total) trans 12885080370 rc 0/0 00000100:00100000:0.0:1651529344.735458:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005fb0ec6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997055296:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.735460:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212315 00000100:00100000:0.0:1651529344.735466:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c0dff858 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.735471:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c529a5 lrc: 2/0,0 mode: PW/PW res: [0x2ba4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.735474:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000877aab61 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.735475:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.735475:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c529a5 lrc: 2/0,0 mode: PW/PW res: [0x2ba4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.735478:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c529a5 lrc: 3/0,0 mode: PW/PW res: [0x2ba4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.735482:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c529a5 lrc: 1/0,0 mode: --/PW res: [0x2ba4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.735485:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c529a5 lrc: 0/0,0 mode: --/PW res: [0x2ba4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.735492:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946535680 00000100:00100000:0.0:1651529344.735504:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212322 00000100:00100000:0.0:1651529344.735506:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1816:39029:x1731745946535680:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.735510:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178770 count 1 00010000:00010000:0.0:1651529344.735514:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c529d6 lrc: 3/0,1 mode: --/PW res: [0x2ba52:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.735518:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c879a2a7/0x3234de053c4cdb0 lrc: 2/0,0 mode: PR/PR res: [0x2ba52:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce868 expref: 249 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.735521:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.735521:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.735522:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c529d6 lrc: 4/0,1 mode: --/PW res: [0x2ba52:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.735528:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c879a2a7/0x3234de053c4cdb0 lrc: 3/0,0 mode: PR/PR res: [0x2ba52:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce868 expref: 249 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.735532:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c879a2a7/0x3234de053c4cdb0 lrc: 4/0,0 mode: PR/PR res: [0x2ba52:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce868 expref: 249 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.735536:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007c534a1e pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997055360:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.735565:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 000000003003c8b0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.735602:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004534b316 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997054976:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.735603:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.735612:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.735621:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000088fa78f8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997055040:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.735628:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c529ac lrc: 3/0,1 mode: --/PW res: [0x2ba4c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.735630:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c529b3 lrc: 3/0,1 mode: --/PW res: [0x2ba4d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.735637:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396416448 00000100:00100000:1.0:1651529344.735638:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396416512 00010000:00010000:0.0:1651529344.735642:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a5fe7e98/0x3234de053c4d176 lrc: 4/0,0 mode: PR/PR res: [0x2ba4c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf717 expref: 251 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.735643:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002c1f1994/0x3234de053c4d26b lrc: 4/0,0 mode: PR/PR res: [0x2ba4d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb15 expref: 251 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.735652:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13098 00000100:00100000:0.0:1651529344.735653:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+251:41278:x1731746396416448:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.735656:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.735657:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a5fe7e98/0x3234de053c4d176 lrc: 4/0,0 mode: PR/PR res: [0x2ba4c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf717 expref: 251 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.735658:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13099 00000100:00100000:1.0:1651529344.735660:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+251:41279:x1731746396416512:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.735661:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a5fe7e98/0x3234de053c4d176 lrc: 3/0,0 mode: PR/PR res: [0x2ba4c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf717 expref: 251 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.735663:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.735664:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002c1f1994/0x3234de053c4d26b lrc: 4/0,0 mode: PR/PR res: [0x2ba4d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb15 expref: 251 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.735667:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5fe7e98/0x3234de053c4d176 lrc: 0/0,0 mode: --/PR res: [0x2ba4c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf717 expref: 251 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.735670:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.735671:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002c1f1994/0x3234de053c4d26b lrc: 3/0,0 mode: PR/PR res: [0x2ba4d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb15 expref: 250 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.735671:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.735672:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c529ac lrc: 3/0,1 mode: PW/PW res: [0x2ba4c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.735675:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c529ac lrc: 4/0,1 mode: PW/PW res: [0x2ba4c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.735677:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c1f1994/0x3234de053c4d26b lrc: 0/0,0 mode: --/PR res: [0x2ba4d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb15 expref: 250 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.735680:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.735681:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.735681:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.735682:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c529b3 lrc: 3/0,1 mode: PW/PW res: [0x2ba4d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.735685:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c529b3 lrc: 4/0,1 mode: PW/PW res: [0x2ba4d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.735688:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+249:41278:x1731746396416448:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 34us (85us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.735690:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.735690:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13098 00010000:00010000:0.0:1651529344.735696:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c529ac lrc: 3/0,1 mode: PW/PW res: [0x2ba4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.735697:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+248:41279:x1731746396416512:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 36us (85us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.735699:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13099 00010000:00010000:0.0:1651529344.735700:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c529ac lrc: 3/0,1 mode: PW/PW res: [0x2ba4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.735703:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c529ac lrc: 3/0,1 mode: PW/PW res: [0x2ba4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.735705:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c529ac lrc: 2/0,0 mode: PW/PW res: [0x2ba4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.735707:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c529b3 lrc: 3/0,1 mode: PW/PW res: [0x2ba4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.735710:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c529b3 lrc: 3/0,1 mode: PW/PW res: [0x2ba4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.735719:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c529b3 lrc: 3/0,1 mode: PW/PW res: [0x2ba4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.735724:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c529b3 lrc: 2/0,0 mode: PW/PW res: [0x2ba4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.735765:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1818:39030:x1731745946535296:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 749us (831us total) trans 12885080371 rc 0/0 00000100:00100000:0.0:1651529344.735768:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212316 00010000:00010000:0.0:1651529344.735775:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c529ac lrc: 2/0,0 mode: PW/PW res: [0x2ba4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.735776:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1817:39030:x1731745946535360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 695us (794us total) trans 12885080372 rc 0/0 00010000:00010000:0.0:1651529344.735778:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000314b5fa1 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.735779:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212317 00010000:00010000:0.0:1651529344.735779:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c529ac lrc: 2/0,0 mode: PW/PW res: [0x2ba4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.735782:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c529ac lrc: 3/0,0 mode: PW/PW res: [0x2ba4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.735786:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c529b3 lrc: 2/0,0 mode: PW/PW res: [0x2ba4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.735786:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c529ac lrc: 1/0,0 mode: --/PW res: [0x2ba4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.735789:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000575eb734 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.735789:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c529ac lrc: 0/0,0 mode: --/PW res: [0x2ba4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.735791:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c529b3 lrc: 2/0,0 mode: PW/PW res: [0x2ba4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.735793:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c529b3 lrc: 3/0,0 mode: PW/PW res: [0x2ba4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.735798:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c529b3 lrc: 1/0,0 mode: --/PW res: [0x2ba4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.735801:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c529b3 lrc: 0/0,0 mode: --/PW res: [0x2ba4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.735815:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.735865:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004972eb27 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997055104:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.735869:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c529ba lrc: 3/0,1 mode: --/PW res: [0x2ba4f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.735891:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946535744 00000100:00100000:1.0:1651529344.735901:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212323 00000100:00100000:1.0:1651529344.735903:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1817:39029:x1731745946535744:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.735908:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178771 count 1 00010000:00010000:1.0:1651529344.735912:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c529dd lrc: 3/0,1 mode: --/PW res: [0x2ba53:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.735916:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002e4def97/0x3234de053c4d33d lrc: 2/0,0 mode: PR/PR res: [0x2ba53:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfecd expref: 247 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.735919:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.735920:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.735920:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c529dd lrc: 4/0,1 mode: --/PW res: [0x2ba53:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.735926:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002e4def97/0x3234de053c4d33d lrc: 3/0,0 mode: PR/PR res: [0x2ba53:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfecd expref: 247 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.735930:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002e4def97/0x3234de053c4d33d lrc: 4/0,0 mode: PR/PR res: [0x2ba53:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfecd expref: 247 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.735934:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997055424:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.735947:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd96f074 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.736003:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.736011:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.736020:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.736032:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000822949b3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997055168:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.736036:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.736037:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c529c1 lrc: 3/0,1 mode: --/PW res: [0x2ba4e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.736046:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.736054:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.736072:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f9050c71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997055232:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.736073:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005fb0ec6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997055296:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.736076:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c529c8 lrc: 3/0,1 mode: --/PW res: [0x2ba50:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.736083:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396416576 00010000:00010000:0.0:1651529344.736090:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c529cf lrc: 3/0,1 mode: --/PW res: [0x2ba51:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.736093:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000825a3f3/0x3234de053c4e1a6 lrc: 4/0,0 mode: PR/PR res: [0x2ba4f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d37c2 expref: 248 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.736099:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396416640 00010000:00010000:1.0:1651529344.736102:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c4cf5b lrc: 4/0,0 mode: PR/PR res: [0x2ba4e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef22 expref: 249 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.736106:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396416704 00000100:00100000:0.0:1651529344.736107:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007c534a1e pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997055360:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.736108:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001d4e57f9/0x3234de053c4c782 lrc: 4/0,0 mode: PR/PR res: [0x2ba51:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd058 expref: 250 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.736110:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c529d6 lrc: 3/0,1 mode: --/PW res: [0x2ba52:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.736112:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396416768 00010000:00010000:1.0:1651529344.736114:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006e494d37/0x3234de053c4ef59 lrc: 4/0,0 mode: PR/PR res: [0x2ba50:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f44 expref: 251 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.736116:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946535872 00000100:00100000:1.0:1651529344.736118:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13100 00000100:00100000:1.0:1651529344.736119:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1fb0a67 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+251:41278:x1731746396416576:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.736122:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.736127:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946535808 00010000:00010000:1.0:1651529344.736129:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000825a3f3/0x3234de053c4e1a6 lrc: 4/0,0 mode: PR/PR res: [0x2ba4f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d37c2 expref: 251 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.736133:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212324 00000100:00100000:0.0:1651529344.736134:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1819:39029:x1731745946535872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.736137:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000825a3f3/0x3234de053c4e1a6 lrc: 3/0,0 mode: PR/PR res: [0x2ba4f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d37c2 expref: 251 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.736143:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000825a3f3/0x3234de053c4e1a6 lrc: 0/0,0 mode: --/PR res: [0x2ba4f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d37c2 expref: 251 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.736147:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.736147:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.736148:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c529ba lrc: 3/0,1 mode: PW/PW res: [0x2ba4f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.736150:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178773 count 1 00010000:00010000:1.0:1651529344.736151:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c529ba lrc: 4/0,1 mode: PW/PW res: [0x2ba4f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.736154:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c529e4 lrc: 3/0,1 mode: --/PW res: [0x2ba55:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.736157:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.736158:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f4899641/0x3234de053c4cd4e lrc: 2/0,0 mode: PR/PR res: [0x2ba55:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce742 expref: 250 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.736162:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.736162:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.736163:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c529e4 lrc: 4/0,1 mode: --/PW res: [0x2ba55:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.736164:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1fb0a67 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+250:41278:x1731746396416576:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 44us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.736167:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13100 00010000:00010000:0.0:1651529344.736170:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f4899641/0x3234de053c4cd4e lrc: 3/0,0 mode: PR/PR res: [0x2ba55:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce742 expref: 249 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.736174:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f4899641/0x3234de053c4cd4e lrc: 4/0,0 mode: PR/PR res: [0x2ba55:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce742 expref: 249 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.736175:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13101 00000100:00100000:1.0:1651529344.736177:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+249:41279:x1731746396416640:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.736178:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007c534a1e pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997055488:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.736180:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.736181:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c4cf5b lrc: 4/0,0 mode: PR/PR res: [0x2ba4e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef22 expref: 249 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.736185:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c4cf5b lrc: 3/0,0 mode: PR/PR res: [0x2ba4e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef22 expref: 249 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.736187:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a3b00cf3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.736189:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c4cf5b lrc: 0/0,0 mode: --/PR res: [0x2ba4e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef22 expref: 249 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.736193:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.736193:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.736193:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212325 00010000:00010000:1.0:1651529344.736194:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c529c1 lrc: 3/0,1 mode: PW/PW res: [0x2ba4e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.736195:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1819:39029:x1731745946535808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.736196:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c529c1 lrc: 4/0,1 mode: PW/PW res: [0x2ba4e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.736199:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178772 count 1 00010000:00010000:0.0:1651529344.736202:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c529eb lrc: 3/0,1 mode: --/PW res: [0x2ba54:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.736206:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.736212:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+248:41279:x1731746396416640:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.736215:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13101 00010000:00010000:0.0:1651529344.736215:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000099911bc3/0x3234de053c4eb23 lrc: 2/0,0 mode: PR/PR res: [0x2ba54:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e3b expref: 248 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.736218:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.736218:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.736219:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13102 00010000:00010000:0.0:1651529344.736219:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c529eb lrc: 4/0,1 mode: --/PW res: [0x2ba54:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.736220:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+247:41278:x1731746396416704:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.736241:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.736243:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001d4e57f9/0x3234de053c4c782 lrc: 4/0,0 mode: PR/PR res: [0x2ba51:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd058 expref: 247 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.736245:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000099911bc3/0x3234de053c4eb23 lrc: 3/0,0 mode: PR/PR res: [0x2ba54:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e3b expref: 247 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.736247:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001d4e57f9/0x3234de053c4c782 lrc: 3/0,0 mode: PR/PR res: [0x2ba51:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd058 expref: 247 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.736251:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d4e57f9/0x3234de053c4c782 lrc: 0/0,0 mode: --/PR res: [0x2ba51:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd058 expref: 247 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.736251:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000099911bc3/0x3234de053c4eb23 lrc: 4/0,0 mode: PR/PR res: [0x2ba54:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e3b expref: 247 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.736255:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005fb0ec6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997055552:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.736257:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.736258:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.736258:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c529cf lrc: 3/0,1 mode: PW/PW res: [0x2ba51:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.736261:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c529cf lrc: 4/0,1 mode: PW/PW res: [0x2ba51:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.736263:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000008dd99533 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.736269:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.736273:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c529c1 lrc: 3/0,1 mode: PW/PW res: [0x2ba4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.736275:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+246:41278:x1731746396416704:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 54us (229us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.736277:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c529c1 lrc: 3/0,1 mode: PW/PW res: [0x2ba4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.736278:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13102 00010000:00010000:0.0:1651529344.736280:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c529c1 lrc: 3/0,1 mode: PW/PW res: [0x2ba4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.736282:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13103 00010000:00010000:0.0:1651529344.736283:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c529c1 lrc: 2/0,0 mode: PW/PW res: [0x2ba4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.736284:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+245:41279:x1731746396416768:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.736286:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.736287:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006e494d37/0x3234de053c4ef59 lrc: 4/0,0 mode: PR/PR res: [0x2ba50:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f44 expref: 245 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.736291:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006e494d37/0x3234de053c4ef59 lrc: 3/0,0 mode: PR/PR res: [0x2ba50:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f44 expref: 245 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.736296:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e494d37/0x3234de053c4ef59 lrc: 0/0,0 mode: --/PR res: [0x2ba50:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f44 expref: 245 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.736299:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.736300:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.736300:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c529c8 lrc: 3/0,1 mode: PW/PW res: [0x2ba50:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.736303:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c529c8 lrc: 4/0,1 mode: PW/PW res: [0x2ba50:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.736309:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.736313:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+244:41279:x1731746396416768:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 29us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.736316:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13103 00000100:00100000:0.0:1651529344.736321:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1820:39029:x1731745946535424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 978us (1066us total) trans 12885080373 rc 0/0 00010000:00010000:1.0:1651529344.736324:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c529ba lrc: 3/0,1 mode: PW/PW res: [0x2ba4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.736324:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212319 00010000:00010000:1.0:1651529344.736327:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c529ba lrc: 3/0,1 mode: PW/PW res: [0x2ba4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.736330:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c529ba lrc: 3/0,1 mode: PW/PW res: [0x2ba4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.736332:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c529c1 lrc: 2/0,0 mode: PW/PW res: [0x2ba4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.736333:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c529ba lrc: 2/0,0 mode: PW/PW res: [0x2ba4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.736335:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ebdbebae already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.736336:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c529c1 lrc: 2/0,0 mode: PW/PW res: [0x2ba4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.736346:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c529c1 lrc: 3/0,0 mode: PW/PW res: [0x2ba4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.736352:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c529c1 lrc: 1/0,0 mode: --/PW res: [0x2ba4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.736354:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c529c1 lrc: 0/0,0 mode: --/PW res: [0x2ba4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.736359:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c529ba lrc: 2/0,0 mode: PW/PW res: [0x2ba4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.736361:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cde66bc6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.736362:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c529ba lrc: 2/0,0 mode: PW/PW res: [0x2ba4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.736365:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c529ba lrc: 3/0,0 mode: PW/PW res: [0x2ba4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.736368:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c529ba lrc: 1/0,0 mode: --/PW res: [0x2ba4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.736371:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c529ba lrc: 0/0,0 mode: --/PW res: [0x2ba4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.736374:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000098b3c8df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1820:39029:x1731745946535488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1092us (1163us total) trans 12885080374 rc 0/0 00000100:00100000:1.0:1651529344.736377:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212318 00010000:00010000:0.0:1651529344.736377:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c529cf lrc: 3/0,1 mode: PW/PW res: [0x2ba51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.736382:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c529cf lrc: 3/0,1 mode: PW/PW res: [0x2ba51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.736385:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c529cf lrc: 3/0,1 mode: PW/PW res: [0x2ba51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.736388:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c529cf lrc: 2/0,0 mode: PW/PW res: [0x2ba51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.736404:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c529c8 lrc: 3/0,1 mode: PW/PW res: [0x2ba50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.736410:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c529c8 lrc: 3/0,1 mode: PW/PW res: [0x2ba50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.736413:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c529c8 lrc: 3/0,1 mode: PW/PW res: [0x2ba50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.736416:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c529c8 lrc: 2/0,0 mode: PW/PW res: [0x2ba50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.736434:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1820:39030:x1731745946535616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1030us (1123us total) trans 12885080375 rc 0/0 00000100:00100000:0.0:1651529344.736436:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212321 00010000:00010000:0.0:1651529344.736443:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c529cf lrc: 2/0,0 mode: PW/PW res: [0x2ba51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.736446:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000014fe598c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.736447:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c529cf lrc: 2/0,0 mode: PW/PW res: [0x2ba51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.736450:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c529cf lrc: 3/0,0 mode: PW/PW res: [0x2ba51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.736454:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c529cf lrc: 1/0,0 mode: --/PW res: [0x2ba51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.736455:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1820:39030:x1731745946535552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1095us (1160us total) trans 12885080376 rc 0/0 00010000:00010000:0.0:1651529344.736457:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c529cf lrc: 0/0,0 mode: --/PW res: [0x2ba51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.736458:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212320 00010000:00010000:0.0:1651529344.736462:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c529c8 lrc: 2/0,0 mode: PW/PW res: [0x2ba50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.736465:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000490515f1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.736465:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c529c8 lrc: 2/0,0 mode: PW/PW res: [0x2ba50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.736468:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c529c8 lrc: 3/0,0 mode: PW/PW res: [0x2ba50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.736471:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c529c8 lrc: 1/0,0 mode: --/PW res: [0x2ba50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.736474:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c529c8 lrc: 0/0,0 mode: --/PW res: [0x2ba50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.736509:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.736515:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396416832 00010000:00010000:0.0:1651529344.736520:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c879a2a7/0x3234de053c4cdb0 lrc: 4/0,0 mode: PR/PR res: [0x2ba52:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce868 expref: 244 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.736531:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13104 00000100:00100000:0.0:1651529344.736533:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+244:41278:x1731746396416832:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.736535:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.736537:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c879a2a7/0x3234de053c4cdb0 lrc: 4/0,0 mode: PR/PR res: [0x2ba52:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce868 expref: 244 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.736543:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c879a2a7/0x3234de053c4cdb0 lrc: 3/0,0 mode: PR/PR res: [0x2ba52:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce868 expref: 244 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.736548:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c879a2a7/0x3234de053c4cdb0 lrc: 0/0,0 mode: --/PR res: [0x2ba52:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce868 expref: 244 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.736551:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.736552:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.736553:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c529d6 lrc: 3/0,1 mode: PW/PW res: [0x2ba52:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.736554:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.736556:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c529d6 lrc: 4/0,1 mode: PW/PW res: [0x2ba52:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.736563:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.736570:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+243:41278:x1731746396416832:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 36us (61us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.736572:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13104 00000100:00100000:0.0:1651529344.736576:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396416896 00010000:00010000:0.0:1651529344.736579:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002e4def97/0x3234de053c4d33d lrc: 5/0,0 mode: PR/PR res: [0x2ba53:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfecd expref: 243 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.736584:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000071f18c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997055424:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.736589:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13105 00000100:00100000:0.0:1651529344.736590:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+243:41279:x1731746396416896:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.736593:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c529dd lrc: 3/0,1 mode: --/PW res: [0x2ba53:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.736593:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.736594:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002e4def97/0x3234de053c4d33d lrc: 4/0,0 mode: PR/PR res: [0x2ba53:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfecd expref: 243 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.736598:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002e4def97/0x3234de053c4d33d lrc: 3/0,0 mode: PR/PR res: [0x2ba53:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfecd expref: 243 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.736620:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e4def97/0x3234de053c4d33d lrc: 0/0,0 mode: --/PR res: [0x2ba53:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfecd expref: 243 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.736623:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.736624:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.736625:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c529dd lrc: 3/0,1 mode: PW/PW res: [0x2ba53:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.736628:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c529dd lrc: 4/0,1 mode: PW/PW res: [0x2ba53:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.736640:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.736647:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+242:41279:x1731746396416896:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 56us (93us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.736649:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c529dd lrc: 3/0,1 mode: PW/PW res: [0x2ba53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.736649:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13105 00010000:00010000:1.0:1651529344.736653:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c529dd lrc: 3/0,1 mode: PW/PW res: [0x2ba53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.736656:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c529dd lrc: 3/0,1 mode: PW/PW res: [0x2ba53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.736656:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c529d6 lrc: 3/0,1 mode: PW/PW res: [0x2ba52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.736659:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c529dd lrc: 2/0,0 mode: PW/PW res: [0x2ba53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.736659:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c529d6 lrc: 3/0,1 mode: PW/PW res: [0x2ba52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.736662:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c529d6 lrc: 3/0,1 mode: PW/PW res: [0x2ba52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.736674:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c529d6 lrc: 2/0,0 mode: PW/PW res: [0x2ba52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.736713:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1820:39029:x1731745946535744:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 809us (897us total) trans 12885080377 rc 0/0 00000100:00100000:1.0:1651529344.736716:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212323 00010000:00010000:1.0:1651529344.736723:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c529dd lrc: 2/0,0 mode: PW/PW res: [0x2ba53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.736726:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c5599f68 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.736727:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c529dd lrc: 2/0,0 mode: PW/PW res: [0x2ba53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.736730:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c529dd lrc: 3/0,0 mode: PW/PW res: [0x2ba53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.736743:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c529dd lrc: 1/0,0 mode: --/PW res: [0x2ba53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.736746:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c529dd lrc: 0/0,0 mode: --/PW res: [0x2ba53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.736751:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c529d6 lrc: 2/0,0 mode: PW/PW res: [0x2ba52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.736753:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cd5f3a7c already unused, calling callback (0000000049fddea7) 00000100:00100000:0.0:1651529344.736753:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1820:39029:x1731745946535680:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1246us (1278us total) trans 12885080378 rc 0/0 00010000:00010000:1.0:1651529344.736754:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c529d6 lrc: 2/0,0 mode: PW/PW res: [0x2ba52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.736756:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212322 00010000:00010000:1.0:1651529344.736757:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c529d6 lrc: 3/0,0 mode: PW/PW res: [0x2ba52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.736760:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c529d6 lrc: 1/0,0 mode: --/PW res: [0x2ba52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.736763:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c529d6 lrc: 0/0,0 mode: --/PW res: [0x2ba52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.736809:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.736831:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.736846:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.736856:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.736863:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946536000 00000100:00100000:1.0:1651529344.736867:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946535936 00000100:00100000:0.0:1651529344.736872:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946536064 00000100:00100000:0.0:1651529344.736875:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946536128 00000100:00100000:1.0:1651529344.736884:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212326 00000100:00100000:1.0:1651529344.736886:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1823:39029:x1731745946536000:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.736887:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212327 00000100:00100000:0.0:1651529344.736888:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1823:39030:x1731745946536064:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.736891:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178775 count 1 00002000:00080000:0.0:1651529344.736893:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178776 count 1 00010000:00010000:1.0:1651529344.736896:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c529f2 lrc: 3/0,1 mode: --/PW res: [0x2ba57:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.736898:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c529f9 lrc: 3/0,1 mode: --/PW res: [0x2ba58:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.736900:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f5027568/0x3234de053c4d3a6 lrc: 2/0,0 mode: PR/PR res: [0x2ba57:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00a2 expref: 241 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.736903:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.736904:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.736904:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c529f2 lrc: 4/0,1 mode: --/PW res: [0x2ba57:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.736911:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f5027568/0x3234de053c4d3a6 lrc: 3/0,0 mode: PR/PR res: [0x2ba57:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00a2 expref: 241 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.736914:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f5027568/0x3234de053c4d3a6 lrc: 4/0,0 mode: PR/PR res: [0x2ba57:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00a2 expref: 241 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.736917:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000074c8ee4c/0x3234de053c4e8b4 lrc: 2/0,0 mode: PR/PR res: [0x2ba58:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d539f expref: 241 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.736918:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997055616:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.736921:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.736922:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.736922:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c529f9 lrc: 4/0,1 mode: --/PW res: [0x2ba58:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.736930:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd96f074 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.736930:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000074c8ee4c/0x3234de053c4e8b4 lrc: 3/0,0 mode: PR/PR res: [0x2ba58:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d539f expref: 241 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.736936:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212328 00000100:00100000:1.0:1651529344.736937:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1823:39029:x1731745946535936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.736941:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178774 count 1 00010000:00010000:1.0:1651529344.736944:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52a00 lrc: 3/0,1 mode: --/PW res: [0x2ba56:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.736949:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c4df06 lrc: 2/0,0 mode: PR/PR res: [0x2ba56:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d3b expref: 241 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.736952:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.736952:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.736953:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52a00 lrc: 4/0,1 mode: --/PW res: [0x2ba56:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.736957:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000074c8ee4c/0x3234de053c4e8b4 lrc: 4/0,0 mode: PR/PR res: [0x2ba58:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d539f expref: 241 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.736958:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c4df06 lrc: 3/0,0 mode: PR/PR res: [0x2ba56:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d3b expref: 241 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.736962:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c4df06 lrc: 4/0,0 mode: PR/PR res: [0x2ba56:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d3b expref: 241 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.736962:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000076d5f96b pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997055680:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.736968:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a4b486d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997055744:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.736972:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 000000000e7e66c4 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.736975:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 000000007e004c12 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.736979:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212329 00000100:00100000:0.0:1651529344.736981:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1823:39030:x1731745946536128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.736985:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178777 count 1 00000100:00100000:1.0:1651529344.736992:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.737001:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c52a07 lrc: 3/0,1 mode: --/PW res: [0x2ba59:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.737007:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c4c6e8 lrc: 2/0,0 mode: PR/PR res: [0x2ba59:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd9c expref: 241 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.737015:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.737016:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.737017:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c52a07 lrc: 4/0,1 mode: --/PW res: [0x2ba59:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.737020:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.737024:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c4c6e8 lrc: 3/0,0 mode: PR/PR res: [0x2ba59:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd9c expref: 241 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.737027:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c4c6e8 lrc: 4/0,0 mode: PR/PR res: [0x2ba59:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd9c expref: 241 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.737034:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000064719963 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997055808:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.737042:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e68b7e1f going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.737048:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946536256 00000100:00100000:0.0:1651529344.737062:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946536192 00000100:00100000:0.0:1651529344.737069:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212330 00000100:00100000:0.0:1651529344.737071:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1825:39029:x1731745946536256:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.737075:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178779 count 1 00000100:00100000:1.0:1651529344.737087:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212331 00000100:00100000:1.0:1651529344.737089:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1825:39029:x1731745946536192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.737094:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178778 count 1 00010000:00010000:1.0:1651529344.737104:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52a0e lrc: 3/0,1 mode: --/PW res: [0x2ba5a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.737109:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d1644b4c/0x3234de053c4e542 lrc: 2/0,0 mode: PR/PR res: [0x2ba5a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d460f expref: 241 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.737109:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52a15 lrc: 3/0,1 mode: --/PW res: [0x2ba5b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.737112:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.737112:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.737113:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52a0e lrc: 4/0,1 mode: --/PW res: [0x2ba5a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.737114:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009fa0c0b8/0x3234de053c4db1d lrc: 2/0,0 mode: PR/PR res: [0x2ba5b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c78 expref: 241 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.737117:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.737117:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.737118:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52a15 lrc: 4/0,1 mode: --/PW res: [0x2ba5b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.737119:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d1644b4c/0x3234de053c4e542 lrc: 3/0,0 mode: PR/PR res: [0x2ba5a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d460f expref: 241 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.737123:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d1644b4c/0x3234de053c4e542 lrc: 4/0,0 mode: PR/PR res: [0x2ba5a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d460f expref: 241 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.737126:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009fa0c0b8/0x3234de053c4db1d lrc: 3/0,0 mode: PR/PR res: [0x2ba5b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c78 expref: 241 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.737127:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005d3fb3ef pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997055872:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.737129:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009fa0c0b8/0x3234de053c4db1d lrc: 4/0,0 mode: PR/PR res: [0x2ba5b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c78 expref: 241 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.737133:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000053ee5af1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997055936:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.737135:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 000000007d8fabda going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.737143:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 0000000076b354b3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.737150:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.737150:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007c534a1e pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997055488:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.737154:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c529e4 lrc: 3/0,1 mode: --/PW res: [0x2ba55:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.737168:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005fb0ec6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997055552:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.737171:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c529eb lrc: 3/0,1 mode: --/PW res: [0x2ba54:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.737177:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396416960 00000100:00100000:1.0:1651529344.737179:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.737182:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f4899641/0x3234de053c4cd4e lrc: 4/0,0 mode: PR/PR res: [0x2ba55:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce742 expref: 242 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.737194:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396417024 00010000:00010000:0.0:1651529344.737197:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000099911bc3/0x3234de053c4eb23 lrc: 4/0,0 mode: PR/PR res: [0x2ba54:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e3b expref: 243 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.737204:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13106 00000100:00100000:0.0:1651529344.737206:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+243:41278:x1731746396416960:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.737209:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.737210:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f4899641/0x3234de053c4cd4e lrc: 4/0,0 mode: PR/PR res: [0x2ba55:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce742 expref: 243 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.737214:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f4899641/0x3234de053c4cd4e lrc: 3/0,0 mode: PR/PR res: [0x2ba55:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce742 expref: 243 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.737220:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13107 00000100:00100000:1.0:1651529344.737232:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000515bc9a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+243:41279:x1731746396417024:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.737237:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4899641/0x3234de053c4cd4e lrc: 0/0,0 mode: --/PR res: [0x2ba55:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce742 expref: 243 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.737240:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.737241:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.737241:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.737242:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000099911bc3/0x3234de053c4eb23 lrc: 4/0,0 mode: PR/PR res: [0x2ba54:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e3b expref: 242 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.737242:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c529e4 lrc: 3/0,1 mode: PW/PW res: [0x2ba55:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.737245:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c529e4 lrc: 4/0,1 mode: PW/PW res: [0x2ba55:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.737247:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000099911bc3/0x3234de053c4eb23 lrc: 3/0,0 mode: PR/PR res: [0x2ba54:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e3b expref: 242 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.737251:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.737253:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099911bc3/0x3234de053c4eb23 lrc: 0/0,0 mode: --/PR res: [0x2ba54:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e3b expref: 242 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.737256:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.737257:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.737258:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c529eb lrc: 3/0,1 mode: PW/PW res: [0x2ba54:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.737262:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+241:41278:x1731746396416960:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 55us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.737265:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13106 00010000:00010000:1.0:1651529344.737266:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c529eb lrc: 4/0,1 mode: PW/PW res: [0x2ba54:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.737272:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c529e4 lrc: 3/0,1 mode: PW/PW res: [0x2ba55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.737275:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.737280:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c529e4 lrc: 3/0,1 mode: PW/PW res: [0x2ba55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.737282:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000515bc9a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+240:41279:x1731746396417024:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 60us (104us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.737283:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c529e4 lrc: 3/0,1 mode: PW/PW res: [0x2ba55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.737285:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13107 00010000:00010000:0.0:1651529344.737286:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c529e4 lrc: 2/0,0 mode: PW/PW res: [0x2ba55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.737330:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1826:39029:x1731745946535872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1195us (1319us total) trans 12885080379 rc 0/0 00000100:00100000:0.0:1651529344.737333:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212324 00010000:00010000:0.0:1651529344.737380:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c529e4 lrc: 2/0,0 mode: PW/PW res: [0x2ba55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.737384:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004b2a6b06 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.737385:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c529e4 lrc: 2/0,0 mode: PW/PW res: [0x2ba55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.737388:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c529e4 lrc: 3/0,0 mode: PW/PW res: [0x2ba55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.737392:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c529e4 lrc: 1/0,0 mode: --/PW res: [0x2ba55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.737401:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c529e4 lrc: 0/0,0 mode: --/PW res: [0x2ba55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.737411:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.737416:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000064719963 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997055808:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.737417:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.737420:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c52a07 lrc: 3/0,1 mode: --/PW res: [0x2ba59:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.737424:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.737425:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c529eb lrc: 3/0,1 mode: PW/PW res: [0x2ba54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.737429:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.737431:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c529eb lrc: 3/0,1 mode: PW/PW res: [0x2ba54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.737439:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c529eb lrc: 3/0,1 mode: PW/PW res: [0x2ba54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.737445:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997055616:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.737449:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c529f2 lrc: 3/0,1 mode: --/PW res: [0x2ba57:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.737456:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a4b486d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997055744:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.737458:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52a00 lrc: 3/0,1 mode: --/PW res: [0x2ba56:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.737474:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396417152 00010000:00010000:0.0:1651529344.737477:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c529eb lrc: 2/0,0 mode: PW/PW res: [0x2ba54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.737479:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f5027568/0x3234de053c4d3a6 lrc: 4/0,0 mode: PR/PR res: [0x2ba57:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00a2 expref: 240 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.737484:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396417280 00010000:00010000:1.0:1651529344.737487:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c4c6e8 lrc: 4/0,0 mode: PR/PR res: [0x2ba59:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd9c expref: 241 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.737491:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396417088 00010000:00010000:1.0:1651529344.737493:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000074c8ee4c/0x3234de053c4e8b4 lrc: 5/0,0 mode: PR/PR res: [0x2ba58:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d539f expref: 242 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.737496:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396417216 00010000:00010000:1.0:1651529344.737498:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c4df06 lrc: 4/0,0 mode: PR/PR res: [0x2ba56:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d3b expref: 243 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.737505:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13108 00000100:00100000:1.0:1651529344.737507:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+243:41279:x1731746396417152:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.737509:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.737511:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f5027568/0x3234de053c4d3a6 lrc: 4/0,0 mode: PR/PR res: [0x2ba57:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00a2 expref: 243 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.737514:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f5027568/0x3234de053c4d3a6 lrc: 3/0,0 mode: PR/PR res: [0x2ba57:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00a2 expref: 243 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.737516:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1826:39029:x1731745946535808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1320us (1486us total) trans 12885080380 rc 0/0 00010000:00010000:1.0:1651529344.737519:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5027568/0x3234de053c4d3a6 lrc: 0/0,0 mode: --/PR res: [0x2ba57:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d00a2 expref: 243 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.737519:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212325 00010000:00010000:1.0:1651529344.737523:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.737524:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.737525:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c529f2 lrc: 3/0,1 mode: PW/PW res: [0x2ba57:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.737526:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c529eb lrc: 2/0,0 mode: PW/PW res: [0x2ba54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.737528:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c529f2 lrc: 4/0,1 mode: PW/PW res: [0x2ba57:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.737530:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dd6b1be4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.737531:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c529eb lrc: 2/0,0 mode: PW/PW res: [0x2ba54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.737533:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c529eb lrc: 3/0,0 mode: PW/PW res: [0x2ba54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.737534:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.737538:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c529eb lrc: 1/0,0 mode: --/PW res: [0x2ba54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.737541:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+242:41279:x1731746396417152:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 33us (130us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.737541:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c529eb lrc: 0/0,0 mode: --/PW res: [0x2ba54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.737543:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13108 00000100:00100000:1.0:1651529344.737547:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13109 00000100:00100000:1.0:1651529344.737549:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+241:41279:x1731746396417280:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.737550:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000076d5f96b pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997055680:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.737551:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.737552:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c4c6e8 lrc: 4/0,0 mode: PR/PR res: [0x2ba59:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd9c expref: 241 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.737554:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c529f9 lrc: 3/0,1 mode: --/PW res: [0x2ba58:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.737556:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c4c6e8 lrc: 3/0,0 mode: PR/PR res: [0x2ba59:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd9c expref: 241 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.737560:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c4c6e8 lrc: 0/0,0 mode: --/PR res: [0x2ba59:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccd9c expref: 241 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.737560:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13110 00000100:00100000:0.0:1651529344.737562:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+241:41278:x1731746396417088:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.737563:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.737564:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.737564:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c52a07 lrc: 3/0,1 mode: PW/PW res: [0x2ba59:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.737565:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.737567:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c52a07 lrc: 4/0,1 mode: PW/PW res: [0x2ba59:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.737567:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000074c8ee4c/0x3234de053c4e8b4 lrc: 4/0,0 mode: PR/PR res: [0x2ba58:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d539f expref: 240 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.737571:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000074c8ee4c/0x3234de053c4e8b4 lrc: 3/0,0 mode: PR/PR res: [0x2ba58:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d539f expref: 240 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.737577:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.737582:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+240:41279:x1731746396417280:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 33us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.737584:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13109 00000100:00100000:1.0:1651529344.737588:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13111 00000100:00100000:1.0:1651529344.737590:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+239:41278:x1731746396417216:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.737592:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.737594:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c4df06 lrc: 4/0,0 mode: PR/PR res: [0x2ba56:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d3b expref: 239 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.737599:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074c8ee4c/0x3234de053c4e8b4 lrc: 0/0,0 mode: --/PR res: [0x2ba58:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d539f expref: 239 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.737600:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c4df06 lrc: 3/0,0 mode: PR/PR res: [0x2ba56:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d3b expref: 239 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.737603:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.737603:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.737604:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c4df06 lrc: 0/0,0 mode: --/PR res: [0x2ba56:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d3b expref: 238 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.737604:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c529f9 lrc: 3/0,1 mode: PW/PW res: [0x2ba58:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.737607:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.737607:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c529f9 lrc: 4/0,1 mode: PW/PW res: [0x2ba58:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.737608:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.737609:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52a00 lrc: 3/0,1 mode: PW/PW res: [0x2ba56:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.737612:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52a00 lrc: 4/0,1 mode: PW/PW res: [0x2ba56:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.737614:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.737618:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.737621:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+237:41278:x1731746396417088:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 59us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.737622:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+237:41278:x1731746396417216:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 32us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.737624:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13110 00000100:00100000:1.0:1651529344.737626:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13111 00010000:00010000:0.0:1651529344.737632:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c52a07 lrc: 3/0,1 mode: PW/PW res: [0x2ba59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.737635:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c52a07 lrc: 3/0,1 mode: PW/PW res: [0x2ba59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.737636:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005d3fb3ef pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997055872:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.737638:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c52a07 lrc: 3/0,1 mode: PW/PW res: [0x2ba59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.737639:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52a0e lrc: 3/0,1 mode: --/PW res: [0x2ba5a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.737641:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c52a07 lrc: 2/0,0 mode: PW/PW res: [0x2ba59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.737644:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52a00 lrc: 3/0,1 mode: PW/PW res: [0x2ba56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.737647:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52a00 lrc: 3/0,1 mode: PW/PW res: [0x2ba56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.737657:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52a00 lrc: 3/0,1 mode: PW/PW res: [0x2ba56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.737660:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52a00 lrc: 2/0,0 mode: PW/PW res: [0x2ba56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.737689:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1827:39030:x1731745946536128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 707us (833us total) trans 12885080381 rc 0/0 00000100:00100000:0.0:1651529344.737692:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212329 00010000:00010000:0.0:1651529344.737698:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c52a07 lrc: 2/0,0 mode: PW/PW res: [0x2ba59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.737702:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000066921086 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.737702:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c52a07 lrc: 2/0,0 mode: PW/PW res: [0x2ba59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.737703:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1826:39029:x1731745946535936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 765us (873us total) trans 12885080382 rc 0/0 00010000:00010000:0.0:1651529344.737705:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c52a07 lrc: 3/0,0 mode: PW/PW res: [0x2ba59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.737706:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212328 00010000:00010000:0.0:1651529344.737712:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c52a07 lrc: 1/0,0 mode: --/PW res: [0x2ba59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.737714:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52a00 lrc: 2/0,0 mode: PW/PW res: [0x2ba56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.737715:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c52a07 lrc: 0/0,0 mode: --/PW res: [0x2ba59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.737717:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001391dc6d already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.737718:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52a00 lrc: 2/0,0 mode: PW/PW res: [0x2ba56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.737721:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52a00 lrc: 3/0,0 mode: PW/PW res: [0x2ba56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.737721:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c529f9 lrc: 3/0,1 mode: PW/PW res: [0x2ba58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.737723:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c529f9 lrc: 3/0,1 mode: PW/PW res: [0x2ba58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.737725:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52a00 lrc: 1/0,0 mode: --/PW res: [0x2ba56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.737726:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c529f9 lrc: 3/0,1 mode: PW/PW res: [0x2ba58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.737728:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52a00 lrc: 0/0,0 mode: --/PW res: [0x2ba56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.737729:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c529f9 lrc: 2/0,0 mode: PW/PW res: [0x2ba58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.737733:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c529f9 lrc: 3/0,0 mode: PW/PW res: [0x2ba58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.737745:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006cbd0d09 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.737746:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c529f9 lrc: 2/0,0 mode: PW/PW res: [0x2ba58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.737748:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c529f9 lrc: 3/0,0 mode: PW/PW res: [0x2ba58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.737752:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c529f9 lrc: 1/0,0 mode: --/PW res: [0x2ba58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.737754:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c529f9 lrc: 0/0,0 mode: --/PW res: [0x2ba58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.737760:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c529f2 lrc: 3/0,1 mode: PW/PW res: [0x2ba57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.737763:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c529f2 lrc: 3/0,1 mode: PW/PW res: [0x2ba57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.737766:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c529f2 lrc: 3/0,1 mode: PW/PW res: [0x2ba57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.737769:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c529f2 lrc: 2/0,0 mode: PW/PW res: [0x2ba57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.737781:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1826:39030:x1731745946536064:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 885us (928us total) trans 12885080383 rc 0/0 00000100:00100000:0.0:1651529344.737784:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212327 00010000:00010000:0.0:1651529344.737791:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c529f2 lrc: 2/0,0 mode: PW/PW res: [0x2ba57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.737794:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004dda5a3f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.737795:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c529f2 lrc: 2/0,0 mode: PW/PW res: [0x2ba57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.737798:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c529f2 lrc: 3/0,0 mode: PW/PW res: [0x2ba57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.737803:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c529f2 lrc: 1/0,0 mode: --/PW res: [0x2ba57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.737805:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c529f2 lrc: 0/0,0 mode: --/PW res: [0x2ba57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.737807:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1826:39029:x1731745946536000:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 920us (999us total) trans 12885080384 rc 0/0 00000100:00100000:1.0:1651529344.737811:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212326 00000100:00100000:0.0:1651529344.737821:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.737833:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.737864:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.737880:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000053ee5af1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997055936:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.737884:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52a15 lrc: 3/0,1 mode: --/PW res: [0x2ba5b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.737909:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396417344 00010000:00010000:1.0:1651529344.737915:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d1644b4c/0x3234de053c4e542 lrc: 4/0,0 mode: PR/PR res: [0x2ba5a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d460f expref: 236 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.737930:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396417408 00010000:00010000:1.0:1651529344.737933:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009fa0c0b8/0x3234de053c4db1d lrc: 4/0,0 mode: PR/PR res: [0x2ba5b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c78 expref: 237 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.737939:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13112 00000100:00100000:1.0:1651529344.737941:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+237:41279:x1731746396417344:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.737944:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.737945:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d1644b4c/0x3234de053c4e542 lrc: 4/0,0 mode: PR/PR res: [0x2ba5a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d460f expref: 237 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.737947:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13113 00010000:00010000:1.0:1651529344.737949:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d1644b4c/0x3234de053c4e542 lrc: 3/0,0 mode: PR/PR res: [0x2ba5a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d460f expref: 237 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.737949:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+237:41279:x1731746396417408:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.737953:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.737955:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1644b4c/0x3234de053c4e542 lrc: 0/0,0 mode: --/PR res: [0x2ba5a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d460f expref: 237 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.737955:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009fa0c0b8/0x3234de053c4db1d lrc: 4/0,0 mode: PR/PR res: [0x2ba5b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c78 expref: 237 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.737958:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.737959:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.737959:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009fa0c0b8/0x3234de053c4db1d lrc: 3/0,0 mode: PR/PR res: [0x2ba5b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c78 expref: 236 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.737960:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52a0e lrc: 3/0,1 mode: PW/PW res: [0x2ba5a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.737965:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52a0e lrc: 4/0,1 mode: PW/PW res: [0x2ba5a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.737965:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fa0c0b8/0x3234de053c4db1d lrc: 0/0,0 mode: --/PR res: [0x2ba5b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c78 expref: 236 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.737969:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.737969:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.737970:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52a15 lrc: 3/0,1 mode: PW/PW res: [0x2ba5b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.737971:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.737973:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52a15 lrc: 4/0,1 mode: PW/PW res: [0x2ba5b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.737979:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+235:41279:x1731746396417344:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 37us (158us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.737980:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.737981:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13112 00000100:00100000:0.0:1651529344.737987:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+234:41279:x1731746396417408:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 38us (124us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.737988:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52a0e lrc: 3/0,1 mode: PW/PW res: [0x2ba5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.737990:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13113 00010000:00010000:1.0:1651529344.737991:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52a0e lrc: 3/0,1 mode: PW/PW res: [0x2ba5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.737994:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52a0e lrc: 3/0,1 mode: PW/PW res: [0x2ba5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.737996:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52a0e lrc: 2/0,0 mode: PW/PW res: [0x2ba5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.737997:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52a15 lrc: 3/0,1 mode: PW/PW res: [0x2ba5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.738000:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52a15 lrc: 3/0,1 mode: PW/PW res: [0x2ba5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.738003:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52a15 lrc: 3/0,1 mode: PW/PW res: [0x2ba5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.738006:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52a15 lrc: 2/0,0 mode: PW/PW res: [0x2ba5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.738038:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1827:39029:x1731745946536192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 949us (1018us total) trans 12885080385 rc 0/0 00000100:00100000:1.0:1651529344.738041:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212331 00000100:00100000:1.0:1651529344.738046:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946536320 00000100:00100000:1.0:1651529344.738054:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212332 00000100:00100000:1.0:1651529344.738055:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1827:39030:x1731745946536320:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.738060:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178780 count 1 00010000:00010000:1.0:1651529344.738064:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52a1c lrc: 3/0,1 mode: --/PW res: [0x2ba5c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.738068:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000087acb1b3/0x3234de053c4dc9e lrc: 2/0,0 mode: PR/PR res: [0x2ba5c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d22d0 expref: 233 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.738072:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.738072:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.738073:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52a1c lrc: 4/0,1 mode: --/PW res: [0x2ba5c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.738075:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1827:39029:x1731745946536256:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1003us (1083us total) trans 12885080386 rc 0/0 00000100:00100000:0.0:1651529344.738078:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212330 00010000:00010000:1.0:1651529344.738079:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000087acb1b3/0x3234de053c4dc9e lrc: 3/0,0 mode: PR/PR res: [0x2ba5c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d22d0 expref: 233 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.738083:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000087acb1b3/0x3234de053c4dc9e lrc: 4/0,0 mode: PR/PR res: [0x2ba5c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d22d0 expref: 233 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.738086:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52a0e lrc: 2/0,0 mode: PW/PW res: [0x2ba5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.738087:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997056000:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.738096:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000412e5d26 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.738101:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52a15 lrc: 2/0,0 mode: PW/PW res: [0x2ba5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.738102:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fc4c513 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.738103:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52a0e lrc: 2/0,0 mode: PW/PW res: [0x2ba5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.738104:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003551d5d1 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.738105:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52a15 lrc: 2/0,0 mode: PW/PW res: [0x2ba5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.738106:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52a0e lrc: 3/0,0 mode: PW/PW res: [0x2ba5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.738108:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52a15 lrc: 3/0,0 mode: PW/PW res: [0x2ba5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.738111:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52a0e lrc: 1/0,0 mode: --/PW res: [0x2ba5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.738114:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52a0e lrc: 0/0,0 mode: --/PW res: [0x2ba5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.738115:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52a15 lrc: 1/0,0 mode: --/PW res: [0x2ba5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.738118:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52a15 lrc: 0/0,0 mode: --/PW res: [0x2ba5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.738146:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.738157:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946536448 00000100:00100000:0.0:1651529344.738160:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.738169:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946536384 00000100:00100000:1.0:1651529344.738174:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212333 00000100:00100000:1.0:1651529344.738175:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1828:39030:x1731745946536448:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.738180:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178782 count 1 00000100:00100000:0.0:1651529344.738188:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.738191:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c52a23 lrc: 3/0,1 mode: --/PW res: [0x2ba5e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.738195:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d0ff9132/0x3234de053c4d67e lrc: 2/0,0 mode: PR/PR res: [0x2ba5e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b8b expref: 233 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.738195:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.738198:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.738199:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.738200:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c52a23 lrc: 4/0,1 mode: --/PW res: [0x2ba5e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.738201:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.738206:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d0ff9132/0x3234de053c4d67e lrc: 3/0,0 mode: PR/PR res: [0x2ba5e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b8b expref: 233 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.738208:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946536512 00010000:00010000:1.0:1651529344.738209:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d0ff9132/0x3234de053c4d67e lrc: 4/0,0 mode: PR/PR res: [0x2ba5e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b8b expref: 233 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.738217:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946536576 00000100:00100000:1.0:1651529344.738245:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997056064:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.738259:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 0000000099c1da85 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.738266:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946536640 00000100:00100000:0.0:1651529344.738272:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212334 00000100:00100000:1.0:1651529344.738274:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212335 00000100:00100000:0.0:1651529344.738274:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1831:39030:x1731745946536384:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.738276:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1831:39030:x1731745946536512:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.738279:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178781 count 1 00002000:00080000:1.0:1651529344.738280:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178783 count 1 00010000:00010000:1.0:1651529344.738284:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52a31 lrc: 3/0,1 mode: --/PW res: [0x2ba5f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.738284:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52a2a lrc: 3/0,1 mode: --/PW res: [0x2ba5d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.738288:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002bc2df9a/0x3234de053c4d7b2 lrc: 2/0,0 mode: PR/PR res: [0x2ba5f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1046 expref: 233 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.738291:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.738291:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e728a393/0x3234de053c4c8f5 lrc: 2/0,0 mode: PR/PR res: [0x2ba5d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd559 expref: 233 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.738292:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.738293:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52a31 lrc: 4/0,1 mode: --/PW res: [0x2ba5f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.738294:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.738295:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.738296:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52a2a lrc: 4/0,1 mode: --/PW res: [0x2ba5d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.738299:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002bc2df9a/0x3234de053c4d7b2 lrc: 3/0,0 mode: PR/PR res: [0x2ba5f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1046 expref: 233 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.738302:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002bc2df9a/0x3234de053c4d7b2 lrc: 4/0,0 mode: PR/PR res: [0x2ba5f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1046 expref: 233 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.738306:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997056128:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.738313:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 000000007d8fabda going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.738316:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e728a393/0x3234de053c4c8f5 lrc: 3/0,0 mode: PR/PR res: [0x2ba5d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd559 expref: 233 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.738319:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212336 00010000:00010000:0.0:1651529344.738320:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e728a393/0x3234de053c4c8f5 lrc: 4/0,0 mode: PR/PR res: [0x2ba5d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd559 expref: 233 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.738321:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1831:39030:x1731745946536576:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.738324:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002a957ba7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997056192:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.738325:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178784 count 1 00010000:00010000:1.0:1651529344.738328:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52a38 lrc: 3/0,1 mode: --/PW res: [0x2ba60:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.738332:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000047daaedf/0x3234de053c4e932 lrc: 2/0,0 mode: PR/PR res: [0x2ba60:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d55eb expref: 233 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.738333:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 000000000a4def41 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.738335:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.738336:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.738336:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52a38 lrc: 4/0,1 mode: --/PW res: [0x2ba60:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.738340:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212337 00010000:00010000:1.0:1651529344.738342:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000047daaedf/0x3234de053c4e932 lrc: 3/0,0 mode: PR/PR res: [0x2ba60:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d55eb expref: 233 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.738342:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1831:39030:x1731745946536640:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.738346:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000047daaedf/0x3234de053c4e932 lrc: 4/0,0 mode: PR/PR res: [0x2ba60:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d55eb expref: 233 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:0.0:1651529344.738346:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178785 count 1 00000100:00100000:1.0:1651529344.738350:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dfef64e7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997056256:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.738350:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52a3f lrc: 3/0,1 mode: --/PW res: [0x2ba61:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.738356:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aeda71fe going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.738368:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fea12661/0x3234de053c4e2e8 lrc: 2/0,0 mode: PR/PR res: [0x2ba61:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3cc3 expref: 233 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.738371:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.738372:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.738373:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52a3f lrc: 4/0,1 mode: --/PW res: [0x2ba61:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.738380:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fea12661/0x3234de053c4e2e8 lrc: 3/0,0 mode: PR/PR res: [0x2ba61:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3cc3 expref: 233 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.738383:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fea12661/0x3234de053c4e2e8 lrc: 4/0,0 mode: PR/PR res: [0x2ba61:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3cc3 expref: 233 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.738387:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000078f9a278 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997056320:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.738395:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000003678d25f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.738404:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.738451:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396417472 00010000:00010000:1.0:1651529344.738456:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000087acb1b3/0x3234de053c4dc9e lrc: 5/0,0 mode: PR/PR res: [0x2ba5c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d22d0 expref: 234 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.738467:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13114 00000100:00100000:1.0:1651529344.738469:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e392dfeb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+234:41279:x1731746396417472:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.738472:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.738473:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000087acb1b3/0x3234de053c4dc9e lrc: 5/0,0 mode: PR/PR res: [0x2ba5c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d22d0 expref: 234 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.738477:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000087acb1b3/0x3234de053c4dc9e lrc: 4/0,0 mode: PR/PR res: [0x2ba5c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d22d0 expref: 234 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.738482:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.738483:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.738484:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52a1c lrc: 3/0,1 mode: PW/PW res: [0x2ba5c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.738487:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52a1c lrc: 4/0,1 mode: PW/PW res: [0x2ba5c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.738492:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.738502:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e392dfeb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+234:41279:x1731746396417472:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 32us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.738504:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13114 00010000:00010000:1.0:1651529344.738518:0:80279:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087acb1b3/0x3234de053c4dc9e lrc: 0/0,0 mode: --/PR res: [0x2ba5c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d22d0 expref: 233 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.738531:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997056000:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.738534:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52a1c lrc: 3/0,1 mode: PW/PW res: [0x2ba5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.738540:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52a1c lrc: 3/0,1 mode: PW/PW res: [0x2ba5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.738542:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52a1c lrc: 3/0,1 mode: PW/PW res: [0x2ba5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.738546:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52a1c lrc: 3/0,1 mode: PW/PW res: [0x2ba5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.738548:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52a1c lrc: 2/0,0 mode: PW/PW res: [0x2ba5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.738569:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52a1c lrc: 2/0,0 mode: PW/PW res: [0x2ba5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.738573:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000048ee8765 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.738574:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52a1c lrc: 2/0,0 mode: PW/PW res: [0x2ba5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.738577:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52a1c lrc: 3/0,0 mode: PW/PW res: [0x2ba5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.738582:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52a1c lrc: 1/0,0 mode: --/PW res: [0x2ba5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.738585:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52a1c lrc: 0/0,0 mode: --/PW res: [0x2ba5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.738601:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1832:39030:x1731745946536320:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 545us (775us total) trans 12885080387 rc 0/0 00000100:00100000:1.0:1651529344.738604:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212332 00000100:00100000:0.0:1651529344.738611:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.738647:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.738651:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946536704 00000100:00100000:0.0:1651529344.738654:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946536768 00000100:00100000:1.0:1651529344.738662:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212338 00000100:00100000:1.0:1651529344.738663:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1833:39030:x1731745946536704:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.738667:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212339 00002000:00080000:1.0:1651529344.738668:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178786 count 1 00000100:00100000:0.0:1651529344.738669:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1833:39030:x1731745946536768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.738672:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52a46 lrc: 3/0,1 mode: --/PW res: [0x2ba62:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.738674:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178787 count 1 00010000:00010000:1.0:1651529344.738677:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d03cb0ac/0x3234de053c4e4b6 lrc: 2/0,0 mode: PR/PR res: [0x2ba62:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d441e expref: 232 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.738678:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52a4d lrc: 3/0,1 mode: --/PW res: [0x2ba63:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.738680:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.738681:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.738681:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52a46 lrc: 4/0,1 mode: --/PW res: [0x2ba62:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.738682:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b1292acb/0x3234de053c4f09b lrc: 2/0,0 mode: PR/PR res: [0x2ba63:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7548 expref: 232 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.738685:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.738686:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.738687:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52a4d lrc: 4/0,1 mode: --/PW res: [0x2ba63:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.738688:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d03cb0ac/0x3234de053c4e4b6 lrc: 3/0,0 mode: PR/PR res: [0x2ba62:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d441e expref: 232 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.738692:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d03cb0ac/0x3234de053c4e4b6 lrc: 4/0,0 mode: PR/PR res: [0x2ba62:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d441e expref: 232 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.738693:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b1292acb/0x3234de053c4f09b lrc: 3/0,0 mode: PR/PR res: [0x2ba63:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7548 expref: 232 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.738696:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997056384:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.738697:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b1292acb/0x3234de053c4f09b lrc: 4/0,0 mode: PR/PR res: [0x2ba63:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7548 expref: 232 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.738701:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000076d5f96b pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997056448:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.738706:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000412e5d26 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.738710:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c0dff858 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.738800:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.738815:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d5b6cdf pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997056064:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.738819:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c52a23 lrc: 3/0,1 mode: --/PW res: [0x2ba5e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.738826:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997056128:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.738829:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52a31 lrc: 3/0,1 mode: --/PW res: [0x2ba5f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.738835:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dfef64e7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997056256:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.738837:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52a38 lrc: 3/0,1 mode: --/PW res: [0x2ba60:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.738843:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002a957ba7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997056192:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.738848:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52a2a lrc: 3/0,1 mode: --/PW res: [0x2ba5d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.738859:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.738869:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.738869:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946536832 00000100:00100000:1.0:1651529344.738878:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.738882:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212340 00000100:00100000:0.0:1651529344.738884:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1834:39029:x1731745946536832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.738885:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:0.0:1651529344.738889:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178788 count 1 00000100:00100000:1.0:1651529344.738897:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.738898:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52a54 lrc: 3/0,1 mode: --/PW res: [0x2ba64:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.738902:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002883c9e6/0x3234de053c4df53 lrc: 2/0,0 mode: PR/PR res: [0x2ba64:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e7d expref: 232 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.738906:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.738906:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.738907:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396417536 00010000:00010000:0.0:1651529344.738907:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52a54 lrc: 4/0,1 mode: --/PW res: [0x2ba64:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.738912:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d0ff9132/0x3234de053c4d67e lrc: 4/0,0 mode: PR/PR res: [0x2ba5e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b8b expref: 233 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.738913:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002883c9e6/0x3234de053c4df53 lrc: 3/0,0 mode: PR/PR res: [0x2ba64:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e7d expref: 233 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.738917:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002883c9e6/0x3234de053c4df53 lrc: 4/0,0 mode: PR/PR res: [0x2ba64:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e7d expref: 233 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.738918:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396417664 00010000:00010000:1.0:1651529344.738920:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e728a393/0x3234de053c4c8f5 lrc: 4/0,0 mode: PR/PR res: [0x2ba5d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd559 expref: 234 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.738921:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000064719963 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997056512:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.738924:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396417600 00010000:00010000:1.0:1651529344.738926:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002bc2df9a/0x3234de053c4d7b2 lrc: 4/0,0 mode: PR/PR res: [0x2ba5f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1046 expref: 235 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.738930:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396417728 00000100:00100000:0.0:1651529344.738931:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e68b7e1f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.738932:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000047daaedf/0x3234de053c4e932 lrc: 4/0,0 mode: PR/PR res: [0x2ba60:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d55eb expref: 236 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.738935:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396417792 00010000:00010000:1.0:1651529344.738937:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fea12661/0x3234de053c4e2e8 lrc: 5/0,0 mode: PR/PR res: [0x2ba61:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3cc3 expref: 237 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.738942:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13115 00000100:00100000:1.0:1651529344.738943:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+237:41279:x1731746396417536:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.738946:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.738947:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d0ff9132/0x3234de053c4d67e lrc: 4/0,0 mode: PR/PR res: [0x2ba5e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b8b expref: 237 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.738951:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d0ff9132/0x3234de053c4d67e lrc: 3/0,0 mode: PR/PR res: [0x2ba5e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b8b expref: 237 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.738956:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0ff9132/0x3234de053c4d67e lrc: 0/0,0 mode: --/PR res: [0x2ba5e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0b8b expref: 237 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.738960:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.738960:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.738961:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c52a23 lrc: 3/0,1 mode: PW/PW res: [0x2ba5e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.738966:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000078f9a278 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997056320:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.738970:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52a3f lrc: 3/0,1 mode: --/PW res: [0x2ba61:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.738979:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c52a23 lrc: 4/0,1 mode: PW/PW res: [0x2ba5e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.738979:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13116 00000100:00100000:0.0:1651529344.738981:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+236:41279:x1731746396417664:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.738984:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.738985:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.738986:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e728a393/0x3234de053c4c8f5 lrc: 4/0,0 mode: PR/PR res: [0x2ba5d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd559 expref: 236 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.738990:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e728a393/0x3234de053c4c8f5 lrc: 3/0,0 mode: PR/PR res: [0x2ba5d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd559 expref: 236 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.738993:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+236:41279:x1731746396417536:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 49us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.738995:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13115 00010000:00010000:0.0:1651529344.738996:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e728a393/0x3234de053c4c8f5 lrc: 0/0,0 mode: --/PR res: [0x2ba5d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd559 expref: 236 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.738999:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.739000:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13117 00010000:00010000:0.0:1651529344.739000:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.739001:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52a2a lrc: 3/0,1 mode: PW/PW res: [0x2ba5d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.739002:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+234:41279:x1731746396417600:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.739004:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.739004:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52a2a lrc: 4/0,1 mode: PW/PW res: [0x2ba5d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.739006:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002bc2df9a/0x3234de053c4d7b2 lrc: 4/0,0 mode: PR/PR res: [0x2ba5f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1046 expref: 234 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.739009:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002bc2df9a/0x3234de053c4d7b2 lrc: 3/0,0 mode: PR/PR res: [0x2ba5f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1046 expref: 234 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.739010:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.739014:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002bc2df9a/0x3234de053c4d7b2 lrc: 0/0,0 mode: --/PR res: [0x2ba5f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1046 expref: 234 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.739017:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+233:41279:x1731746396417664:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (148us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.739018:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.739018:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.739019:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52a31 lrc: 3/0,1 mode: PW/PW res: [0x2ba5f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.739020:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13116 00010000:00010000:1.0:1651529344.739022:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52a31 lrc: 4/0,1 mode: PW/PW res: [0x2ba5f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.739026:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13118 00010000:00010000:1.0:1651529344.739027:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.739027:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+232:41279:x1731746396417728:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.739030:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.739031:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000047daaedf/0x3234de053c4e932 lrc: 4/0,0 mode: PR/PR res: [0x2ba60:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d55eb expref: 232 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.739032:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+232:41279:x1731746396417600:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 29us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.739034:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13117 00010000:00010000:0.0:1651529344.739035:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000047daaedf/0x3234de053c4e932 lrc: 3/0,0 mode: PR/PR res: [0x2ba60:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d55eb expref: 232 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.739038:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13119 00010000:00010000:0.0:1651529344.739039:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047daaedf/0x3234de053c4e932 lrc: 0/0,0 mode: --/PR res: [0x2ba60:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d55eb expref: 231 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.739040:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+231:41279:x1731746396417792:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.739042:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.739043:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fea12661/0x3234de053c4e2e8 lrc: 4/0,0 mode: PR/PR res: [0x2ba61:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3cc3 expref: 230 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.739043:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.739043:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.739044:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52a38 lrc: 3/0,1 mode: PW/PW res: [0x2ba60:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.739047:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fea12661/0x3234de053c4e2e8 lrc: 3/0,0 mode: PR/PR res: [0x2ba61:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3cc3 expref: 230 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.739047:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52a38 lrc: 4/0,1 mode: PW/PW res: [0x2ba60:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.739051:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fea12661/0x3234de053c4e2e8 lrc: 0/0,0 mode: --/PR res: [0x2ba61:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3cc3 expref: 230 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.739056:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.739061:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+230:41279:x1731746396417728:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 33us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.739063:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13118 00010000:00010000:1.0:1651529344.739064:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.739065:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.739065:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52a3f lrc: 3/0,1 mode: PW/PW res: [0x2ba61:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.739068:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52a3f lrc: 4/0,1 mode: PW/PW res: [0x2ba61:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.739069:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52a2a lrc: 3/0,1 mode: PW/PW res: [0x2ba5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.739073:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52a2a lrc: 3/0,1 mode: PW/PW res: [0x2ba5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.739077:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.739082:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+228:41279:x1731746396417792:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (185us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.739082:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52a2a lrc: 3/0,1 mode: PW/PW res: [0x2ba5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.739085:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13119 00010000:00010000:0.0:1651529344.739085:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52a2a lrc: 2/0,0 mode: PW/PW res: [0x2ba5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.739093:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c52a23 lrc: 3/0,1 mode: PW/PW res: [0x2ba5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.739096:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c52a23 lrc: 3/0,1 mode: PW/PW res: [0x2ba5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.739099:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c52a23 lrc: 3/0,1 mode: PW/PW res: [0x2ba5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.739102:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c52a23 lrc: 2/0,0 mode: PW/PW res: [0x2ba5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.739125:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1836:39030:x1731745946536384:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 851us (965us total) trans 12885080388 rc 0/0 00000100:00100000:0.0:1651529344.739128:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212334 00010000:00010000:0.0:1651529344.739135:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52a2a lrc: 2/0,0 mode: PW/PW res: [0x2ba5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.739139:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008ac1e27e already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.739140:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1835:39030:x1731745946536448:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 964us (994us total) trans 12885080389 rc 0/0 00010000:00010000:0.0:1651529344.739140:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52a2a lrc: 2/0,0 mode: PW/PW res: [0x2ba5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.739143:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212333 00010000:00010000:0.0:1651529344.739143:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52a2a lrc: 3/0,0 mode: PW/PW res: [0x2ba5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.739147:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52a2a lrc: 1/0,0 mode: --/PW res: [0x2ba5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.739150:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52a31 lrc: 3/0,1 mode: PW/PW res: [0x2ba5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.739150:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52a2a lrc: 0/0,0 mode: --/PW res: [0x2ba5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.739153:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52a31 lrc: 3/0,1 mode: PW/PW res: [0x2ba5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.739154:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c52a23 lrc: 2/0,0 mode: PW/PW res: [0x2ba5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.739156:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52a31 lrc: 3/0,1 mode: PW/PW res: [0x2ba5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.739157:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e85485c6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.739158:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c52a23 lrc: 2/0,0 mode: PW/PW res: [0x2ba5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.739159:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52a31 lrc: 2/0,0 mode: PW/PW res: [0x2ba5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.739161:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c52a23 lrc: 3/0,0 mode: PW/PW res: [0x2ba5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.739164:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c52a23 lrc: 1/0,0 mode: --/PW res: [0x2ba5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.739174:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c52a23 lrc: 0/0,0 mode: --/PW res: [0x2ba5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.739177:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52a31 lrc: 2/0,0 mode: PW/PW res: [0x2ba5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.739180:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008517b233 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.739181:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52a31 lrc: 2/0,0 mode: PW/PW res: [0x2ba5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.739184:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52a31 lrc: 3/0,0 mode: PW/PW res: [0x2ba5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.739187:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52a31 lrc: 1/0,0 mode: --/PW res: [0x2ba5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.739190:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52a31 lrc: 0/0,0 mode: --/PW res: [0x2ba5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.739194:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1835:39030:x1731745946536512:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 917us (1006us total) trans 12885080390 rc 0/0 00000100:00100000:1.0:1651529344.739196:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212335 00010000:00010000:0.0:1651529344.739196:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52a3f lrc: 3/0,1 mode: PW/PW res: [0x2ba61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.739199:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52a3f lrc: 3/0,1 mode: PW/PW res: [0x2ba61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.739202:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52a3f lrc: 3/0,1 mode: PW/PW res: [0x2ba61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.739203:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52a38 lrc: 3/0,1 mode: PW/PW res: [0x2ba60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.739204:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52a3f lrc: 2/0,0 mode: PW/PW res: [0x2ba61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.739206:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52a38 lrc: 3/0,1 mode: PW/PW res: [0x2ba60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.739209:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52a38 lrc: 3/0,1 mode: PW/PW res: [0x2ba60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.739211:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52a38 lrc: 2/0,0 mode: PW/PW res: [0x2ba60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.739264:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1836:39030:x1731745946536640:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 921us (1062us total) trans 12885080391 rc 0/0 00000100:00100000:1.0:1651529344.739266:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1836:39030:x1731745946536576:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 944us (1071us total) trans 12885080392 rc 0/0 00000100:00100000:0.0:1651529344.739267:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212337 00000100:00100000:1.0:1651529344.739269:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212336 00010000:00010000:0.0:1651529344.739274:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52a3f lrc: 2/0,0 mode: PW/PW res: [0x2ba61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.739277:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52a38 lrc: 2/0,0 mode: PW/PW res: [0x2ba60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.739277:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003c075ac0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.739278:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52a3f lrc: 2/0,0 mode: PW/PW res: [0x2ba61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.739280:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f0bd9bfb already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.739281:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52a38 lrc: 2/0,0 mode: PW/PW res: [0x2ba60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.739281:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52a3f lrc: 3/0,0 mode: PW/PW res: [0x2ba61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.739284:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52a38 lrc: 3/0,0 mode: PW/PW res: [0x2ba60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.739285:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52a3f lrc: 1/0,0 mode: --/PW res: [0x2ba61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.739288:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52a3f lrc: 0/0,0 mode: --/PW res: [0x2ba61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.739289:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52a38 lrc: 1/0,0 mode: --/PW res: [0x2ba60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.739292:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52a38 lrc: 0/0,0 mode: --/PW res: [0x2ba60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.739304:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997056384:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.739307:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52a46 lrc: 3/0,1 mode: --/PW res: [0x2ba62:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.739314:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.739338:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.739359:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000076d5f96b pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997056448:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.739363:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52a4d lrc: 3/0,1 mode: --/PW res: [0x2ba63:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.739397:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396417856 00010000:00010000:1.0:1651529344.739403:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d03cb0ac/0x3234de053c4e4b6 lrc: 4/0,0 mode: PR/PR res: [0x2ba62:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d441e expref: 228 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.739410:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396417920 00010000:00010000:1.0:1651529344.739412:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b1292acb/0x3234de053c4f09b lrc: 4/0,0 mode: PR/PR res: [0x2ba63:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7548 expref: 229 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.739422:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13120 00000100:00100000:1.0:1651529344.739424:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+229:41279:x1731746396417856:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.739427:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.739428:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d03cb0ac/0x3234de053c4e4b6 lrc: 4/0,0 mode: PR/PR res: [0x2ba62:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d441e expref: 229 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.739432:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d03cb0ac/0x3234de053c4e4b6 lrc: 3/0,0 mode: PR/PR res: [0x2ba62:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d441e expref: 229 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.739437:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d03cb0ac/0x3234de053c4e4b6 lrc: 0/0,0 mode: --/PR res: [0x2ba62:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d441e expref: 229 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.739438:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13121 00000100:00100000:0.0:1651529344.739440:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000db7aa2bf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+229:41279:x1731746396417920:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.739441:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.739441:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.739442:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52a46 lrc: 3/0,1 mode: PW/PW res: [0x2ba62:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.739443:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.739445:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52a46 lrc: 4/0,1 mode: PW/PW res: [0x2ba62:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.739445:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b1292acb/0x3234de053c4f09b lrc: 4/0,0 mode: PR/PR res: [0x2ba63:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7548 expref: 228 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.739449:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b1292acb/0x3234de053c4f09b lrc: 3/0,0 mode: PR/PR res: [0x2ba63:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7548 expref: 228 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.739451:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.739454:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1292acb/0x3234de053c4f09b lrc: 0/0,0 mode: --/PR res: [0x2ba63:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7548 expref: 228 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.739458:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.739459:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.739462:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+227:41279:x1731746396417856:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 37us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.739464:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13120 00010000:00010000:0.0:1651529344.739466:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52a4d lrc: 3/0,1 mode: PW/PW res: [0x2ba63:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.739471:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52a46 lrc: 3/0,1 mode: PW/PW res: [0x2ba62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.739472:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52a4d lrc: 4/0,1 mode: PW/PW res: [0x2ba63:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.739475:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52a46 lrc: 3/0,1 mode: PW/PW res: [0x2ba62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.739478:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52a46 lrc: 3/0,1 mode: PW/PW res: [0x2ba62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.739478:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.739480:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52a46 lrc: 2/0,0 mode: PW/PW res: [0x2ba62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.739485:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000db7aa2bf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+226:41279:x1731746396417920:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 45us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.739493:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13121 00010000:00010000:0.0:1651529344.739522:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52a46 lrc: 2/0,0 mode: PW/PW res: [0x2ba62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.739526:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000576f1f12 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.739527:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52a46 lrc: 2/0,0 mode: PW/PW res: [0x2ba62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.739532:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1835:39030:x1731745946536704:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 867us (920us total) trans 12885080393 rc 0/0 00000100:00100000:1.0:1651529344.739535:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212338 00010000:00010000:0.0:1651529344.739540:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52a46 lrc: 3/0,0 mode: PW/PW res: [0x2ba62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.739560:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52a46 lrc: 1/0,0 mode: --/PW res: [0x2ba62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.739563:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52a46 lrc: 0/0,0 mode: --/PW res: [0x2ba62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.739569:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52a4d lrc: 3/0,1 mode: PW/PW res: [0x2ba63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.739572:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52a4d lrc: 3/0,1 mode: PW/PW res: [0x2ba63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.739575:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52a4d lrc: 3/0,1 mode: PW/PW res: [0x2ba63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.739578:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52a4d lrc: 2/0,0 mode: PW/PW res: [0x2ba63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.739585:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.739618:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1835:39030:x1731745946536768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 948us (970us total) trans 12885080394 rc 0/0 00000100:00100000:0.0:1651529344.739621:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212339 00000100:00100000:1.0:1651529344.739622:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.739625:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946536896 00000100:00100000:0.0:1651529344.739637:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212341 00000100:00100000:0.0:1651529344.739638:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1835:39029:x1731745946536896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.739643:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178789 count 1 00010000:00010000:0.0:1651529344.739647:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52a5b lrc: 3/0,1 mode: --/PW res: [0x2ba65:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.739651:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004ac527af/0x3234de053c4cbc6 lrc: 2/0,0 mode: PR/PR res: [0x2ba65:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce0ea expref: 225 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.739654:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.739655:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.739656:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52a5b lrc: 4/0,1 mode: --/PW res: [0x2ba65:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.739660:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.739662:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004ac527af/0x3234de053c4cbc6 lrc: 3/0,0 mode: PR/PR res: [0x2ba65:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce0ea expref: 225 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.739675:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004ac527af/0x3234de053c4cbc6 lrc: 4/0,0 mode: PR/PR res: [0x2ba65:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce0ea expref: 225 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.739679:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005fb0ec6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997056576:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.739688:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c0dff858 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.739691:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.739693:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52a4d lrc: 2/0,0 mode: PW/PW res: [0x2ba63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.739696:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009e44ce9d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.739697:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52a4d lrc: 2/0,0 mode: PW/PW res: [0x2ba63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.739700:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52a4d lrc: 3/0,0 mode: PW/PW res: [0x2ba63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.739705:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52a4d lrc: 1/0,0 mode: --/PW res: [0x2ba63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.739707:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52a4d lrc: 0/0,0 mode: --/PW res: [0x2ba63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.739720:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.739731:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.739747:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946537024 00000100:00100000:0.0:1651529344.739748:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000064719963 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997056512:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.739755:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946537152 00000100:00100000:1.0:1651529344.739759:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946536960 00000100:00100000:1.0:1651529344.739762:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946537088 00000100:00100000:1.0:1651529344.739766:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212342 00000100:00100000:1.0:1651529344.739768:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1839:39029:x1731745946537024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.739772:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52a54 lrc: 3/0,1 mode: --/PW res: [0x2ba64:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.739779:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178791 count 1 00010000:00010000:1.0:1651529344.739783:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52a62 lrc: 3/0,1 mode: --/PW res: [0x2ba67:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.739788:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000082cd4d13/0x3234de053c4a768 lrc: 2/0,0 mode: PR/PR res: [0x2ba67:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc1c expref: 225 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.739791:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.739792:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.739792:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52a62 lrc: 4/0,1 mode: --/PW res: [0x2ba67:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.739794:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212343 00000100:00100000:0.0:1651529344.739796:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1839:39029:x1731745946537152:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.739799:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000082cd4d13/0x3234de053c4a768 lrc: 3/0,0 mode: PR/PR res: [0x2ba67:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc1c expref: 225 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.739802:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000082cd4d13/0x3234de053c4a768 lrc: 4/0,0 mode: PR/PR res: [0x2ba67:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc1c expref: 225 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.739807:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009b8db73b pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997056640:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.739815:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aeda71fe going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.739821:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178793 count 1 00000100:00100000:1.0:1651529344.739822:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212344 00010000:00010000:0.0:1651529344.739825:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52a69 lrc: 3/0,1 mode: --/PW res: [0x2ba69:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.739830:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009c9a66eb/0x3234de053c4d424 lrc: 2/0,0 mode: PR/PR res: [0x2ba69:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0254 expref: 225 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.739833:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1839:39029:x1731745946536960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.739833:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.739834:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.739834:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52a69 lrc: 4/0,1 mode: --/PW res: [0x2ba69:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.739838:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178790 count 1 00010000:00010000:1.0:1651529344.739841:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52a70 lrc: 3/0,1 mode: --/PW res: [0x2ba66:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.739841:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009c9a66eb/0x3234de053c4d424 lrc: 3/0,0 mode: PR/PR res: [0x2ba69:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0254 expref: 225 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.739845:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009c9a66eb/0x3234de053c4d424 lrc: 4/0,0 mode: PR/PR res: [0x2ba69:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0254 expref: 225 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.739846:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004496a02d/0x3234de053c4bbb2 lrc: 2/0,0 mode: PR/PR res: [0x2ba66:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc576 expref: 225 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.739849:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.739849:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000064719963 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997056704:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.739850:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.739850:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52a70 lrc: 4/0,1 mode: --/PW res: [0x2ba66:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.739856:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004496a02d/0x3234de053c4bbb2 lrc: 3/0,0 mode: PR/PR res: [0x2ba66:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc576 expref: 225 pid: 151609 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.739858:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e68b7e1f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.739860:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004496a02d/0x3234de053c4bbb2 lrc: 4/0,0 mode: PR/PR res: [0x2ba66:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc576 expref: 225 pid: 151609 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.739864:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997056768:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.739865:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212345 00000100:00100000:0.0:1651529344.739867:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1839:39029:x1731745946537088:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.739871:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 000000004ca54b8a going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.739871:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178792 count 1 00010000:00010000:0.0:1651529344.739874:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52a77 lrc: 3/0,1 mode: --/PW res: [0x2ba68:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.739880:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396417984 00010000:00010000:1.0:1651529344.739884:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002883c9e6/0x3234de053c4df53 lrc: 4/0,0 mode: PR/PR res: [0x2ba64:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e7d expref: 226 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.739897:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13122 00000100:00100000:1.0:1651529344.739898:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+226:41279:x1731746396417984:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.739898:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006462f892/0x3234de053c4d352 lrc: 2/0,0 mode: PR/PR res: [0x2ba68:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff28 expref: 226 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.739901:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.739901:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.739902:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.739903:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002883c9e6/0x3234de053c4df53 lrc: 4/0,0 mode: PR/PR res: [0x2ba64:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e7d expref: 226 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.739903:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52a77 lrc: 4/0,1 mode: --/PW res: [0x2ba68:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.739906:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002883c9e6/0x3234de053c4df53 lrc: 3/0,0 mode: PR/PR res: [0x2ba64:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e7d expref: 226 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.739910:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006462f892/0x3234de053c4d352 lrc: 3/0,0 mode: PR/PR res: [0x2ba68:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff28 expref: 226 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.739912:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002883c9e6/0x3234de053c4df53 lrc: 0/0,0 mode: --/PR res: [0x2ba64:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2e7d expref: 226 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.739913:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006462f892/0x3234de053c4d352 lrc: 4/0,0 mode: PR/PR res: [0x2ba68:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff28 expref: 226 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.739917:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000076d5f96b pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997056832:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.739918:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.739918:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.739919:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52a54 lrc: 3/0,1 mode: PW/PW res: [0x2ba64:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.739922:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52a54 lrc: 4/0,1 mode: PW/PW res: [0x2ba64:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.739925:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000003678d25f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.739930:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.739937:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+225:41279:x1731746396417984:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 38us (316us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.739937:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52a54 lrc: 3/0,1 mode: PW/PW res: [0x2ba64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.739940:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13122 00010000:00010000:0.0:1651529344.739941:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52a54 lrc: 3/0,1 mode: PW/PW res: [0x2ba64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.739944:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52a54 lrc: 3/0,1 mode: PW/PW res: [0x2ba64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.739947:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52a54 lrc: 2/0,0 mode: PW/PW res: [0x2ba64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.739960:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.739990:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.740002:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.740003:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1840:39029:x1731745946536832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1118us (1204us total) trans 12885080395 rc 0/0 00000100:00100000:0.0:1651529344.740006:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212340 00000100:00100000:0.0:1651529344.740012:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946537216 00000100:00100000:0.0:1651529344.740021:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946537280 00000100:00100000:0.0:1651529344.740027:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212346 00000100:00100000:0.0:1651529344.740029:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1841:39029:x1731745946537216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.740033:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178794 count 1 00010000:00010000:0.0:1651529344.740037:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52a7e lrc: 3/0,1 mode: --/PW res: [0x2ba6a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.740042:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000438c1816/0x3234de053c4d168 lrc: 2/0,0 mode: PR/PR res: [0x2ba6a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf702 expref: 224 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.740045:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.740046:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.740046:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52a7e lrc: 4/0,1 mode: --/PW res: [0x2ba6a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.740053:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000438c1816/0x3234de053c4d168 lrc: 3/0,0 mode: PR/PR res: [0x2ba6a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf702 expref: 224 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.740056:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000438c1816/0x3234de053c4d168 lrc: 4/0,0 mode: PR/PR res: [0x2ba6a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf702 expref: 224 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.740060:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000078f9a278 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997056896:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.740073:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000008dd99533 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.740080:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212347 00000100:00100000:0.0:1651529344.740081:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050b3b776 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1841:39029:x1731745946537280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.740082:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52a54 lrc: 2/0,0 mode: PW/PW res: [0x2ba64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.740086:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000050e053bc already unused, calling callback (0000000049fddea7) 00002000:00080000:0.0:1651529344.740086:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178795 count 1 00010000:00010000:1.0:1651529344.740087:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52a54 lrc: 2/0,0 mode: PW/PW res: [0x2ba64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.740089:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52a85 lrc: 3/0,1 mode: --/PW res: [0x2ba6b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.740090:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52a54 lrc: 3/0,0 mode: PW/PW res: [0x2ba64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.740093:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004b69a420/0x3234de053c4d1d8 lrc: 2/0,0 mode: PR/PR res: [0x2ba6b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf939 expref: 224 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.740095:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52a54 lrc: 1/0,0 mode: --/PW res: [0x2ba64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.740096:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.740097:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.740097:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52a85 lrc: 4/0,1 mode: --/PW res: [0x2ba6b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.740101:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52a54 lrc: 0/0,0 mode: --/PW res: [0x2ba64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.740110:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396418048 00010000:00010000:1.0:1651529344.740114:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004ac527af/0x3234de053c4cbc6 lrc: 5/0,0 mode: PR/PR res: [0x2ba65:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce0ea expref: 225 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.740118:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004b69a420/0x3234de053c4d1d8 lrc: 3/0,0 mode: PR/PR res: [0x2ba6b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf939 expref: 225 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.740121:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13123 00000100:00100000:1.0:1651529344.740123:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+225:41278:x1731746396418048:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.740123:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004b69a420/0x3234de053c4d1d8 lrc: 4/0,0 mode: PR/PR res: [0x2ba6b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf939 expref: 225 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.740126:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.740127:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004ac527af/0x3234de053c4cbc6 lrc: 5/0,0 mode: PR/PR res: [0x2ba65:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce0ea expref: 225 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.740127:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002a957ba7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997056960:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.740131:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004ac527af/0x3234de053c4cbc6 lrc: 4/0,0 mode: PR/PR res: [0x2ba65:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce0ea expref: 225 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.740135:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.740135:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e7e12492 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.740136:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.740136:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52a5b lrc: 3/0,1 mode: PW/PW res: [0x2ba65:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.740139:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52a5b lrc: 4/0,1 mode: PW/PW res: [0x2ba65:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.740143:0:156655:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ac527af/0x3234de053c4cbc6 lrc: 0/0,0 mode: --/PR res: [0x2ba65:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce0ea expref: 225 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.740144:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.740147:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005fb0ec6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997056576:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.740151:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+224:41278:x1731746396418048:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 27us (149us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.740151:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52a5b lrc: 3/0,1 mode: PW/PW res: [0x2ba65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.740153:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13123 00010000:00010000:0.0:1651529344.740154:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52a5b lrc: 3/0,1 mode: PW/PW res: [0x2ba65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.740157:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52a5b lrc: 3/0,1 mode: PW/PW res: [0x2ba65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.740160:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52a5b lrc: 3/0,1 mode: PW/PW res: [0x2ba65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.740163:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52a5b lrc: 2/0,0 mode: PW/PW res: [0x2ba65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.740213:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.740220:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946537344 00000100:00100000:1.0:1651529344.740245:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212348 00000100:00100000:0.0:1651529344.740249:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1843:39029:x1731745946536896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 609us (671us total) trans 12885080396 rc 0/0 00000100:00100000:1.0:1651529344.740251:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1843:39029:x1731745946537344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.740252:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212341 00002000:00080000:1.0:1651529344.740257:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178796 count 1 00010000:00010000:0.0:1651529344.740260:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52a5b lrc: 2/0,0 mode: PW/PW res: [0x2ba65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.740261:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52a8c lrc: 3/0,1 mode: --/PW res: [0x2ba6c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.740263:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f1b4c19f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.740264:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52a5b lrc: 2/0,0 mode: PW/PW res: [0x2ba65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.740265:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ac835c15/0x3234de053c4f0da lrc: 2/0,0 mode: PR/PR res: [0x2ba6c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d75d4 expref: 223 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.740267:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52a5b lrc: 3/0,0 mode: PW/PW res: [0x2ba65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.740268:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.740269:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.740270:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52a8c lrc: 4/0,1 mode: --/PW res: [0x2ba6c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.740274:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52a5b lrc: 1/0,0 mode: --/PW res: [0x2ba65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.740276:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ac835c15/0x3234de053c4f0da lrc: 3/0,0 mode: PR/PR res: [0x2ba6c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d75d4 expref: 223 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.740277:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52a5b lrc: 0/0,0 mode: --/PW res: [0x2ba65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.740280:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ac835c15/0x3234de053c4f0da lrc: 4/0,0 mode: PR/PR res: [0x2ba6c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d75d4 expref: 223 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.740284:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000716b388d pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997057024:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.740292:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000053a0cffa going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.740377:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009b8db73b pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997056640:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.740383:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52a62 lrc: 3/0,1 mode: --/PW res: [0x2ba67:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.740395:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.740396:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997056768:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.740398:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52a70 lrc: 3/0,1 mode: --/PW res: [0x2ba66:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.740402:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.740406:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396418176 00000100:00100000:0.0:1651529344.740407:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.740415:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.740416:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009c9a66eb/0x3234de053c4d424 lrc: 5/0,0 mode: PR/PR res: [0x2ba69:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0254 expref: 224 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.740427:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396418112 00010000:00010000:1.0:1651529344.740429:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000082cd4d13/0x3234de053c4a768 lrc: 4/0,0 mode: PR/PR res: [0x2ba67:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc1c expref: 225 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.740433:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396418304 00010000:00010000:1.0:1651529344.740435:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004496a02d/0x3234de053c4bbb2 lrc: 4/0,0 mode: PR/PR res: [0x2ba66:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc576 expref: 226 pid: 151609 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.740445:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396418240 00010000:00010000:1.0:1651529344.740447:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006462f892/0x3234de053c4d352 lrc: 5/0,0 mode: PR/PR res: [0x2ba68:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff28 expref: 227 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.740451:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.740452:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13124 00000100:00100000:1.0:1651529344.740453:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+227:41279:x1731746396418176:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.740461:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.740462:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009c9a66eb/0x3234de053c4d424 lrc: 4/0,0 mode: PR/PR res: [0x2ba69:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0254 expref: 227 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.740463:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000064719963 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997056704:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.740466:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009c9a66eb/0x3234de053c4d424 lrc: 3/0,0 mode: PR/PR res: [0x2ba69:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0254 expref: 227 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.740470:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52a69 lrc: 3/0,1 mode: --/PW res: [0x2ba69:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.740472:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c9a66eb/0x3234de053c4d424 lrc: 0/0,0 mode: --/PR res: [0x2ba69:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0254 expref: 227 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.740476:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.740477:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.740477:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000076d5f96b pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997056832:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.740478:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52a69 lrc: 3/0,1 mode: PW/PW res: [0x2ba69:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.740480:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52a77 lrc: 3/0,1 mode: --/PW res: [0x2ba68:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.740481:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52a69 lrc: 4/0,1 mode: PW/PW res: [0x2ba69:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.740485:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002a957ba7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997056960:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.740490:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.740494:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52a85 lrc: 3/0,1 mode: --/PW res: [0x2ba6b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.740500:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+226:41279:x1731746396418176:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 46us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.740502:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13124 00000100:00100000:1.0:1651529344.740507:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13125 00000100:00100000:1.0:1651529344.740509:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+225:41278:x1731746396418112:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.740511:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.740512:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000082cd4d13/0x3234de053c4a768 lrc: 4/0,0 mode: PR/PR res: [0x2ba67:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc1c expref: 225 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.740516:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000082cd4d13/0x3234de053c4a768 lrc: 3/0,0 mode: PR/PR res: [0x2ba67:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc1c expref: 225 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.740521:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082cd4d13/0x3234de053c4a768 lrc: 0/0,0 mode: --/PR res: [0x2ba67:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbc1c expref: 225 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.740524:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.740525:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.740526:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52a62 lrc: 3/0,1 mode: PW/PW res: [0x2ba67:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.740526:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52a69 lrc: 3/0,1 mode: PW/PW res: [0x2ba69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.740532:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52a69 lrc: 3/0,1 mode: PW/PW res: [0x2ba69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.740536:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52a62 lrc: 4/0,1 mode: PW/PW res: [0x2ba67:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.740536:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52a69 lrc: 3/0,1 mode: PW/PW res: [0x2ba69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.740538:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52a69 lrc: 2/0,0 mode: PW/PW res: [0x2ba69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.740543:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.740548:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+224:41278:x1731746396418112:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 39us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.740551:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13125 00000100:00100000:1.0:1651529344.740555:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13126 00000100:00100000:1.0:1651529344.740556:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+223:41279:x1731746396418304:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.740559:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.740560:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004496a02d/0x3234de053c4bbb2 lrc: 4/0,0 mode: PR/PR res: [0x2ba66:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc576 expref: 223 pid: 151609 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.740564:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004496a02d/0x3234de053c4bbb2 lrc: 3/0,0 mode: PR/PR res: [0x2ba66:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc576 expref: 223 pid: 151609 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.740568:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004496a02d/0x3234de053c4bbb2 lrc: 0/0,0 mode: --/PR res: [0x2ba66:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc576 expref: 223 pid: 151609 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.740574:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.740574:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.740575:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52a70 lrc: 3/0,1 mode: PW/PW res: [0x2ba66:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.740578:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52a70 lrc: 4/0,1 mode: PW/PW res: [0x2ba66:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.740578:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1843:39029:x1731745946537152:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 781us (887us total) trans 12885080397 rc 0/0 00000100:00100000:0.0:1651529344.740581:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212343 00010000:00010000:1.0:1651529344.740583:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.740586:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946537408 00000100:00100000:1.0:1651529344.740588:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+222:41279:x1731746396418304:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 31us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.740590:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13126 00000100:00100000:0.0:1651529344.740593:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212349 00000100:00100000:1.0:1651529344.740594:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13127 00000100:00100000:1.0:1651529344.740595:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+221:41278:x1731746396418240:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.740595:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1843:39030:x1731745946537408:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.740597:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.740598:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006462f892/0x3234de053c4d352 lrc: 4/0,0 mode: PR/PR res: [0x2ba68:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff28 expref: 221 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:0.0:1651529344.740600:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178797 count 1 00010000:00010000:1.0:1651529344.740602:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006462f892/0x3234de053c4d352 lrc: 3/0,0 mode: PR/PR res: [0x2ba68:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff28 expref: 221 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.740603:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52a93 lrc: 3/0,1 mode: --/PW res: [0x2ba6d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.740606:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006462f892/0x3234de053c4d352 lrc: 0/0,0 mode: --/PR res: [0x2ba68:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cff28 expref: 221 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.740608:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000097dca834/0x3234de053c4e0db lrc: 2/0,0 mode: PR/PR res: [0x2ba6d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d33fc expref: 221 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.740609:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.740610:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.740610:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52a77 lrc: 3/0,1 mode: PW/PW res: [0x2ba68:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.740611:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.740612:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.740612:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52a93 lrc: 4/0,1 mode: --/PW res: [0x2ba6d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.740613:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52a77 lrc: 4/0,1 mode: PW/PW res: [0x2ba68:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.740622:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.740627:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+220:41278:x1731746396418240:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 32us (212us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.740629:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000097dca834/0x3234de053c4e0db lrc: 3/0,0 mode: PR/PR res: [0x2ba6d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d33fc expref: 220 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.740630:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13127 00010000:00010000:0.0:1651529344.740633:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000097dca834/0x3234de053c4e0db lrc: 4/0,0 mode: PR/PR res: [0x2ba6d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d33fc expref: 219 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.740638:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52a70 lrc: 3/0,1 mode: PW/PW res: [0x2ba66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.740638:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000043b7984f pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997057088:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.740641:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52a70 lrc: 3/0,1 mode: PW/PW res: [0x2ba66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.740644:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52a70 lrc: 3/0,1 mode: PW/PW res: [0x2ba66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.740646:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 000000003678d25f going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.740647:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52a70 lrc: 2/0,0 mode: PW/PW res: [0x2ba66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.740652:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52a69 lrc: 2/0,0 mode: PW/PW res: [0x2ba69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.740655:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000820e505a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.740656:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52a69 lrc: 2/0,0 mode: PW/PW res: [0x2ba69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.740659:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52a69 lrc: 3/0,0 mode: PW/PW res: [0x2ba69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.740664:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52a69 lrc: 1/0,0 mode: --/PW res: [0x2ba69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.740667:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52a69 lrc: 0/0,0 mode: --/PW res: [0x2ba69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.740670:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52a70 lrc: 2/0,0 mode: PW/PW res: [0x2ba66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.740675:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fafb79d3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.740676:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52a70 lrc: 2/0,0 mode: PW/PW res: [0x2ba66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.740679:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52a70 lrc: 3/0,0 mode: PW/PW res: [0x2ba66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.740682:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52a70 lrc: 1/0,0 mode: --/PW res: [0x2ba66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.740685:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52a70 lrc: 0/0,0 mode: --/PW res: [0x2ba66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.740686:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1844:39029:x1731745946536960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 852us (965us total) trans 12885080398 rc 0/0 00000100:00100000:1.0:1651529344.740689:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212344 00010000:00010000:0.0:1651529344.740690:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52a77 lrc: 3/0,1 mode: PW/PW res: [0x2ba68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.740693:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52a77 lrc: 3/0,1 mode: PW/PW res: [0x2ba68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.740695:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52a77 lrc: 3/0,1 mode: PW/PW res: [0x2ba68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.740696:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52a62 lrc: 3/0,1 mode: PW/PW res: [0x2ba67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.740698:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52a77 lrc: 2/0,0 mode: PW/PW res: [0x2ba68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.740701:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52a62 lrc: 3/0,1 mode: PW/PW res: [0x2ba67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.740704:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52a62 lrc: 3/0,1 mode: PW/PW res: [0x2ba67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.740707:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52a62 lrc: 2/0,0 mode: PW/PW res: [0x2ba67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.740754:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1845:39029:x1731745946537088:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 886us (1022us total) trans 12885080399 rc 0/0 00000100:00100000:1.0:1651529344.740755:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1845:39029:x1731745946537024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 986us (1095us total) trans 12885080400 rc 0/0 00000100:00100000:0.0:1651529344.740757:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212345 00000100:00100000:1.0:1651529344.740759:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212342 00010000:00010000:0.0:1651529344.740765:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52a77 lrc: 2/0,0 mode: PW/PW res: [0x2ba68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.740768:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000046fea5cc already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.740769:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52a77 lrc: 2/0,0 mode: PW/PW res: [0x2ba68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.740772:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52a77 lrc: 3/0,0 mode: PW/PW res: [0x2ba68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.740774:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.740777:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52a77 lrc: 1/0,0 mode: --/PW res: [0x2ba68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.740780:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52a77 lrc: 0/0,0 mode: --/PW res: [0x2ba68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.740784:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52a62 lrc: 2/0,0 mode: PW/PW res: [0x2ba67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.740787:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006401eb97 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.740788:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52a62 lrc: 2/0,0 mode: PW/PW res: [0x2ba67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.740791:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52a62 lrc: 3/0,0 mode: PW/PW res: [0x2ba67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.740795:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.740796:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52a62 lrc: 1/0,0 mode: --/PW res: [0x2ba67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.740799:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52a62 lrc: 0/0,0 mode: --/PW res: [0x2ba67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.740804:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.740809:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000078f9a278 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997056896:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.740812:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52a7e lrc: 3/0,1 mode: --/PW res: [0x2ba6a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.740819:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396418368 00010000:00010000:0.0:1651529344.740823:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000438c1816/0x3234de053c4d168 lrc: 4/0,0 mode: PR/PR res: [0x2ba6a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf702 expref: 220 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.740828:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396418432 00010000:00010000:0.0:1651529344.740830:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004b69a420/0x3234de053c4d1d8 lrc: 4/0,0 mode: PR/PR res: [0x2ba6b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf939 expref: 221 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.740835:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396418496 00010000:00010000:0.0:1651529344.740837:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ac835c15/0x3234de053c4f0da lrc: 5/0,0 mode: PR/PR res: [0x2ba6c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d75d4 expref: 222 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.740842:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13128 00000100:00100000:0.0:1651529344.740843:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000066a4e147 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+222:41278:x1731746396418368:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.740846:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.740847:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000438c1816/0x3234de053c4d168 lrc: 4/0,0 mode: PR/PR res: [0x2ba6a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf702 expref: 222 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.740851:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000438c1816/0x3234de053c4d168 lrc: 3/0,0 mode: PR/PR res: [0x2ba6a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf702 expref: 222 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.740856:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000438c1816/0x3234de053c4d168 lrc: 0/0,0 mode: --/PR res: [0x2ba6a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf702 expref: 222 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.740859:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.740859:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.740860:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52a7e lrc: 3/0,1 mode: PW/PW res: [0x2ba6a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.740863:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52a7e lrc: 4/0,1 mode: PW/PW res: [0x2ba6a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.740870:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.740872:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13129 00000100:00100000:1.0:1651529344.740874:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+221:41279:x1731746396418432:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.740878:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.740882:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000066a4e147 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+221:41278:x1731746396418368:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (107us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.740885:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004b69a420/0x3234de053c4d1d8 lrc: 4/0,0 mode: PR/PR res: [0x2ba6b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf939 expref: 221 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.740885:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13128 00010000:00010000:1.0:1651529344.740889:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004b69a420/0x3234de053c4d1d8 lrc: 3/0,0 mode: PR/PR res: [0x2ba6b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf939 expref: 221 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.740895:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b69a420/0x3234de053c4d1d8 lrc: 0/0,0 mode: --/PR res: [0x2ba6b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf939 expref: 221 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.740899:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.740900:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.740901:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52a85 lrc: 3/0,1 mode: PW/PW res: [0x2ba6b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.740903:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52a85 lrc: 4/0,1 mode: PW/PW res: [0x2ba6b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.740913:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.740920:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+219:41279:x1731746396418432:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 46us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.740923:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13129 00000100:00100000:0.0:1651529344.740925:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13130 00000100:00100000:0.0:1651529344.740927:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+218:41278:x1731746396418496:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.740930:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.740932:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ac835c15/0x3234de053c4f0da lrc: 5/0,0 mode: PR/PR res: [0x2ba6c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d75d4 expref: 218 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.740935:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000716b388d pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997057024:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.740936:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ac835c15/0x3234de053c4f0da lrc: 3/0,0 mode: PR/PR res: [0x2ba6c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d75d4 expref: 218 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.740940:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52a8c lrc: 3/0,1 mode: --/PW res: [0x2ba6c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.740942:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac835c15/0x3234de053c4f0da lrc: 0/0,0 mode: --/PR res: [0x2ba6c:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d75d4 expref: 218 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.740945:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.740946:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.740947:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52a8c lrc: 3/0,1 mode: PW/PW res: [0x2ba6c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.740950:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52a8c lrc: 4/0,1 mode: PW/PW res: [0x2ba6c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.740960:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.740966:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+217:41278:x1731746396418496:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 39us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.740969:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13130 00010000:00010000:0.0:1651529344.740975:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52a85 lrc: 3/0,1 mode: PW/PW res: [0x2ba6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.740979:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52a85 lrc: 3/0,1 mode: PW/PW res: [0x2ba6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.740982:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52a85 lrc: 3/0,1 mode: PW/PW res: [0x2ba6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.740984:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52a85 lrc: 2/0,0 mode: PW/PW res: [0x2ba6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.740990:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52a8c lrc: 3/0,1 mode: PW/PW res: [0x2ba6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.740998:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52a8c lrc: 3/0,1 mode: PW/PW res: [0x2ba6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.741002:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52a8c lrc: 3/0,1 mode: PW/PW res: [0x2ba6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.741009:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52a8c lrc: 2/0,0 mode: PW/PW res: [0x2ba6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.741057:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1845:39029:x1731745946537344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 810us (844us total) trans 12885080401 rc 0/0 00000100:00100000:1.0:1651529344.741060:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212348 00010000:00010000:1.0:1651529344.741068:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52a85 lrc: 2/0,0 mode: PW/PW res: [0x2ba6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.741071:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000af20b5e7 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.741072:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52a85 lrc: 2/0,0 mode: PW/PW res: [0x2ba6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.741075:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52a85 lrc: 3/0,0 mode: PW/PW res: [0x2ba6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.741078:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050b3b776 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1844:39029:x1731745946537280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 996us (1088us total) trans 12885080402 rc 0/0 00010000:00010000:1.0:1651529344.741080:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52a85 lrc: 1/0,0 mode: --/PW res: [0x2ba6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.741082:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52a85 lrc: 0/0,0 mode: --/PW res: [0x2ba6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.741082:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212347 00010000:00010000:1.0:1651529344.741087:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52a8c lrc: 2/0,0 mode: PW/PW res: [0x2ba6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.741089:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c5599f68 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.741090:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52a8c lrc: 2/0,0 mode: PW/PW res: [0x2ba6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.741090:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52a7e lrc: 3/0,1 mode: PW/PW res: [0x2ba6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.741094:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52a7e lrc: 3/0,1 mode: PW/PW res: [0x2ba6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.741095:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52a8c lrc: 3/0,0 mode: PW/PW res: [0x2ba6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.741097:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52a7e lrc: 3/0,1 mode: PW/PW res: [0x2ba6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.741099:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52a8c lrc: 1/0,0 mode: --/PW res: [0x2ba6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.741099:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52a7e lrc: 2/0,0 mode: PW/PW res: [0x2ba6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.741101:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52a8c lrc: 0/0,0 mode: --/PW res: [0x2ba6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.741105:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52a7e lrc: 2/0,0 mode: PW/PW res: [0x2ba6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.741107:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f183a40b already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.741108:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52a7e lrc: 2/0,0 mode: PW/PW res: [0x2ba6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.741111:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52a7e lrc: 3/0,0 mode: PW/PW res: [0x2ba6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.741114:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52a7e lrc: 1/0,0 mode: --/PW res: [0x2ba6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.741116:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52a7e lrc: 0/0,0 mode: --/PW res: [0x2ba6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.741141:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1844:39029:x1731745946537216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1111us (1187us total) trans 12885080403 rc 0/0 00000100:00100000:0.0:1651529344.741144:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212346 00000100:00100000:1.0:1651529344.741163:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.741174:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000043b7984f pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997057088:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.741178:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52a93 lrc: 3/0,1 mode: --/PW res: [0x2ba6d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.741184:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946537472 00000100:00100000:1.0:1651529344.741187:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.741191:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212350 00000100:00100000:0.0:1651529344.741192:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1844:39030:x1731745946537472:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.741203:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178798 count 1 00010000:00010000:0.0:1651529344.741206:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52a9a lrc: 3/0,1 mode: --/PW res: [0x2ba6e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.741211:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000356fc356/0x3234de053c4d75e lrc: 2/0,0 mode: PR/PR res: [0x2ba6e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f2e expref: 216 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.741214:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.741215:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.741215:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52a9a lrc: 4/0,1 mode: --/PW res: [0x2ba6e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.741234:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.741237:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000356fc356/0x3234de053c4d75e lrc: 3/0,0 mode: PR/PR res: [0x2ba6e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f2e expref: 216 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.741242:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000356fc356/0x3234de053c4d75e lrc: 4/0,0 mode: PR/PR res: [0x2ba6e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f2e expref: 216 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.741246:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000043b7984f pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997057152:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.741248:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.741261:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000000a4def41 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.741264:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.741284:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946537600 00000100:00100000:0.0:1651529344.741291:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946537536 00000100:00100000:1.0:1651529344.741294:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946537664 00000100:00100000:0.0:1651529344.741300:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212351 00000100:00100000:0.0:1651529344.741301:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1847:39030:x1731745946537600:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.741307:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212352 00002000:00080000:0.0:1651529344.741307:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178800 count 1 00000100:00100000:1.0:1651529344.741309:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1847:39030:x1731745946537536:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.741310:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52aa1 lrc: 3/0,1 mode: --/PW res: [0x2ba70:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.741314:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178799 count 1 00010000:00010000:0.0:1651529344.741317:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e71292e1/0x3234de053c4f277 lrc: 2/0,0 mode: PR/PR res: [0x2ba70:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d05 expref: 216 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.741318:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52aa8 lrc: 3/0,1 mode: --/PW res: [0x2ba6f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.741320:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.741321:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.741321:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52aa1 lrc: 4/0,1 mode: --/PW res: [0x2ba70:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.741323:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c929cbcc/0x3234de053c4f12e lrc: 2/0,0 mode: PR/PR res: [0x2ba6f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d776a expref: 216 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.741326:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.741326:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.741327:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52aa8 lrc: 4/0,1 mode: --/PW res: [0x2ba6f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.741327:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e71292e1/0x3234de053c4f277 lrc: 3/0,0 mode: PR/PR res: [0x2ba70:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d05 expref: 216 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.741331:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e71292e1/0x3234de053c4f277 lrc: 4/0,0 mode: PR/PR res: [0x2ba70:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d05 expref: 216 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.741334:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c929cbcc/0x3234de053c4f12e lrc: 3/0,0 mode: PR/PR res: [0x2ba6f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d776a expref: 216 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.741335:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006e3eb319 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997057216:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.741337:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c929cbcc/0x3234de053c4f12e lrc: 4/0,0 mode: PR/PR res: [0x2ba6f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d776a expref: 216 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.741341:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a4b486d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997057280:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.741347:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 000000008dd99533 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.741354:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212353 00000100:00100000:0.0:1651529344.741355:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1847:39030:x1731745946537664:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.741357:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000053a0cffa going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.741360:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178801 count 1 00010000:00010000:0.0:1651529344.741363:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52aaf lrc: 3/0,1 mode: --/PW res: [0x2ba71:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.741367:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007396a2d4/0x3234de053c4d3de lrc: 2/0,0 mode: PR/PR res: [0x2ba71:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d014a expref: 216 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.741370:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.741371:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.741371:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52aaf lrc: 4/0,1 mode: --/PW res: [0x2ba71:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.741397:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007396a2d4/0x3234de053c4d3de lrc: 3/0,0 mode: PR/PR res: [0x2ba71:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d014a expref: 216 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.741401:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007396a2d4/0x3234de053c4d3de lrc: 4/0,0 mode: PR/PR res: [0x2ba71:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d014a expref: 216 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.741403:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.741404:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bca72234 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997057344:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.741413:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.741413:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c0dff858 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.741419:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946537728 00000100:00100000:0.0:1651529344.741444:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946537856 00000100:00100000:1.0:1651529344.741445:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.741468:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946537792 00000100:00100000:0.0:1651529344.741476:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212354 00000100:00100000:0.0:1651529344.741478:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1850:39030:x1731745946537728:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.741483:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178802 count 1 00000100:00100000:1.0:1651529344.741485:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.741487:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c52ab6 lrc: 3/0,1 mode: --/PW res: [0x2ba72:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.741491:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dca1a889/0x3234de053c4f0a2 lrc: 2/0,0 mode: PR/PR res: [0x2ba72:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7556 expref: 216 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.741494:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212355 00010000:00010000:0.0:1651529344.741494:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.741495:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.741495:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c52ab6 lrc: 4/0,1 mode: --/PW res: [0x2ba72:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.741496:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1850:39030:x1731745946537856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.741501:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178804 count 1 00010000:00010000:0.0:1651529344.741504:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dca1a889/0x3234de053c4f0a2 lrc: 3/0,0 mode: PR/PR res: [0x2ba72:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7556 expref: 216 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.741505:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52abd lrc: 3/0,1 mode: --/PW res: [0x2ba74:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.741508:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dca1a889/0x3234de053c4f0a2 lrc: 4/0,0 mode: PR/PR res: [0x2ba72:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7556 expref: 216 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.741510:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009d44ade1/0x3234de053c4e136 lrc: 2/0,0 mode: PR/PR res: [0x2ba74:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d35a0 expref: 216 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.741511:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ad6d0877 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997057408:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.741513:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.741513:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.741514:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52abd lrc: 4/0,1 mode: --/PW res: [0x2ba74:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.741521:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009d44ade1/0x3234de053c4e136 lrc: 3/0,0 mode: PR/PR res: [0x2ba74:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d35a0 expref: 216 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.741524:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000504ef660 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.741531:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009d44ade1/0x3234de053c4e136 lrc: 4/0,0 mode: PR/PR res: [0x2ba74:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d35a0 expref: 216 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.741532:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000043b7984f pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997057152:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.741535:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003e3f0f77 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997057472:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.741536:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52a9a lrc: 3/0,1 mode: --/PW res: [0x2ba6e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.741542:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396418560 00000100:00100000:1.0:1651529344.741544:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cfa1ca05 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.741546:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000097dca834/0x3234de053c4e0db lrc: 4/0,0 mode: PR/PR res: [0x2ba6d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d33fc expref: 217 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.741550:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212356 00000100:00100000:1.0:1651529344.741552:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1850:39030:x1731745946537792:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.741555:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396418624 00010000:00010000:0.0:1651529344.741558:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000356fc356/0x3234de053c4d75e lrc: 4/0,0 mode: PR/PR res: [0x2ba6e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f2e expref: 218 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:1.0:1651529344.741562:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178803 count 1 00000100:00100000:0.0:1651529344.741566:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13131 00000100:00100000:0.0:1651529344.741567:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+218:41279:x1731746396418560:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.741570:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.741571:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52ac4 lrc: 3/0,1 mode: --/PW res: [0x2ba73:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.741571:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000097dca834/0x3234de053c4e0db lrc: 4/0,0 mode: PR/PR res: [0x2ba6d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d33fc expref: 218 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.741575:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c8a15aec/0x3234de053c4dad7 lrc: 2/0,0 mode: PR/PR res: [0x2ba73:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b98 expref: 218 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.741575:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000097dca834/0x3234de053c4e0db lrc: 3/0,0 mode: PR/PR res: [0x2ba6d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d33fc expref: 218 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.741578:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.741579:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.741579:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52ac4 lrc: 4/0,1 mode: --/PW res: [0x2ba73:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.741581:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097dca834/0x3234de053c4e0db lrc: 0/0,0 mode: --/PR res: [0x2ba6d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d33fc expref: 218 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.741584:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.741585:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c8a15aec/0x3234de053c4dad7 lrc: 3/0,0 mode: PR/PR res: [0x2ba73:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b98 expref: 217 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.741585:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.741586:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52a93 lrc: 3/0,1 mode: PW/PW res: [0x2ba6d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.741589:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c8a15aec/0x3234de053c4dad7 lrc: 4/0,0 mode: PR/PR res: [0x2ba73:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b98 expref: 217 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.741589:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52a93 lrc: 4/0,1 mode: PW/PW res: [0x2ba6d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.741593:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005cc6463a pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997057536:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.741595:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.741599:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000babe2d90 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.741602:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+217:41279:x1731746396418560:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 34us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.741604:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13131 00000100:00100000:1.0:1651529344.741608:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13132 00000100:00100000:1.0:1651529344.741610:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+216:41278:x1731746396418624:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.741613:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.741615:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000356fc356/0x3234de053c4d75e lrc: 4/0,0 mode: PR/PR res: [0x2ba6e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f2e expref: 216 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.741619:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000356fc356/0x3234de053c4d75e lrc: 3/0,0 mode: PR/PR res: [0x2ba6e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f2e expref: 216 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.741627:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000356fc356/0x3234de053c4d75e lrc: 0/0,0 mode: --/PR res: [0x2ba6e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f2e expref: 216 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.741630:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52a93 lrc: 3/0,1 mode: PW/PW res: [0x2ba6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.741631:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.741631:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.741632:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52a9a lrc: 3/0,1 mode: PW/PW res: [0x2ba6e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.741635:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52a9a lrc: 4/0,1 mode: PW/PW res: [0x2ba6e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.741645:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.741648:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52a93 lrc: 3/0,1 mode: PW/PW res: [0x2ba6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.741652:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+215:41278:x1731746396418624:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 41us (167us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.741652:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52a93 lrc: 3/0,1 mode: PW/PW res: [0x2ba6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.741654:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13132 00010000:00010000:0.0:1651529344.741657:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52a93 lrc: 2/0,0 mode: PW/PW res: [0x2ba6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.741704:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1851:39030:x1731745946537408:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1108us (1253us total) trans 12885080404 rc 0/0 00000100:00100000:0.0:1651529344.741707:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212349 00010000:00010000:0.0:1651529344.741721:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52a93 lrc: 2/0,0 mode: PW/PW res: [0x2ba6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.741724:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000490515f1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.741725:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52a93 lrc: 2/0,0 mode: PW/PW res: [0x2ba6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.741729:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52a93 lrc: 3/0,0 mode: PW/PW res: [0x2ba6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.741733:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52a93 lrc: 1/0,0 mode: --/PW res: [0x2ba6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.741744:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52a93 lrc: 0/0,0 mode: --/PW res: [0x2ba6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.741749:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.741756:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bca72234 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997057344:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.741759:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52aaf lrc: 3/0,1 mode: --/PW res: [0x2ba71:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.741761:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.741768:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006e3eb319 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997057216:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.741770:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52aa1 lrc: 3/0,1 mode: --/PW res: [0x2ba70:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.741774:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52a9a lrc: 3/0,1 mode: PW/PW res: [0x2ba6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.741777:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52a9a lrc: 3/0,1 mode: PW/PW res: [0x2ba6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.741780:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52a9a lrc: 3/0,1 mode: PW/PW res: [0x2ba6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.741783:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52a9a lrc: 2/0,0 mode: PW/PW res: [0x2ba6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.741796:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.741827:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1851:39030:x1731745946537472:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 634us (671us total) trans 12885080405 rc 0/0 00000100:00100000:1.0:1651529344.741830:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a4b486d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997057280:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.741830:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212350 00010000:00010000:1.0:1651529344.741835:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52aa8 lrc: 3/0,1 mode: --/PW res: [0x2ba6f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.741841:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396418752 00010000:00010000:1.0:1651529344.741846:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c929cbcc/0x3234de053c4f12e lrc: 4/0,0 mode: PR/PR res: [0x2ba6f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d776a expref: 215 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.741866:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396418688 00010000:00010000:1.0:1651529344.741869:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e71292e1/0x3234de053c4f277 lrc: 4/0,0 mode: PR/PR res: [0x2ba70:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d05 expref: 216 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.741873:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396418816 00010000:00010000:1.0:1651529344.741875:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007396a2d4/0x3234de053c4d3de lrc: 4/0,0 mode: PR/PR res: [0x2ba71:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d014a expref: 217 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.741880:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13133 00000100:00100000:1.0:1651529344.741881:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+217:41278:x1731746396418752:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.741884:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.741885:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c929cbcc/0x3234de053c4f12e lrc: 4/0,0 mode: PR/PR res: [0x2ba6f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d776a expref: 217 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.741886:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.741889:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c929cbcc/0x3234de053c4f12e lrc: 3/0,0 mode: PR/PR res: [0x2ba6f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d776a expref: 217 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.741894:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c929cbcc/0x3234de053c4f12e lrc: 0/0,0 mode: --/PR res: [0x2ba6f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d776a expref: 217 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.741894:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946537920 00010000:00010000:1.0:1651529344.741898:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.741898:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.741899:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52aa8 lrc: 3/0,1 mode: PW/PW res: [0x2ba6f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.741901:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212357 00010000:00010000:1.0:1651529344.741902:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52aa8 lrc: 4/0,1 mode: PW/PW res: [0x2ba6f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.741902:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1851:39029:x1731745946537920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.741908:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178805 count 1 00010000:00010000:1.0:1651529344.741909:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.741912:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c52acb lrc: 3/0,1 mode: --/PW res: [0x2ba75:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.741916:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000013b4168/0x3234de053c4d137 lrc: 2/0,0 mode: PR/PR res: [0x2ba75:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf668 expref: 216 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.741921:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+216:41278:x1731746396418752:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 39us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.741924:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13133 00010000:00010000:0.0:1651529344.741927:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.741928:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.741929:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13134 00010000:00010000:0.0:1651529344.741929:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c52acb lrc: 4/0,1 mode: --/PW res: [0x2ba75:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.741930:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+215:41279:x1731746396418688:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.741933:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.741934:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e71292e1/0x3234de053c4f277 lrc: 4/0,0 mode: PR/PR res: [0x2ba70:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d05 expref: 215 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.741936:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000013b4168/0x3234de053c4d137 lrc: 3/0,0 mode: PR/PR res: [0x2ba75:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf668 expref: 215 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.741938:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e71292e1/0x3234de053c4f277 lrc: 3/0,0 mode: PR/PR res: [0x2ba70:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d05 expref: 215 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.741940:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000013b4168/0x3234de053c4d137 lrc: 4/0,0 mode: PR/PR res: [0x2ba75:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf668 expref: 215 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.741943:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e71292e1/0x3234de053c4f277 lrc: 0/0,0 mode: --/PR res: [0x2ba70:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d05 expref: 215 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.741944:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bca72234 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997057600:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.741946:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.741946:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.741947:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52aa1 lrc: 3/0,1 mode: PW/PW res: [0x2ba70:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.741950:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52aa1 lrc: 4/0,1 mode: PW/PW res: [0x2ba70:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.741953:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000008dd99533 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.741958:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.741963:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+214:41279:x1731746396418688:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 32us (202us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.741965:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52aa1 lrc: 3/0,1 mode: PW/PW res: [0x2ba70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.741966:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13134 00010000:00010000:0.0:1651529344.741969:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52aa1 lrc: 3/0,1 mode: PW/PW res: [0x2ba70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.741970:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13135 00000100:00100000:1.0:1651529344.741971:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ccd58b65 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+213:41279:x1731746396418816:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.741972:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52aa1 lrc: 3/0,1 mode: PW/PW res: [0x2ba70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.741973:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.741975:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007396a2d4/0x3234de053c4d3de lrc: 4/0,0 mode: PR/PR res: [0x2ba71:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d014a expref: 213 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.741978:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007396a2d4/0x3234de053c4d3de lrc: 3/0,0 mode: PR/PR res: [0x2ba71:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d014a expref: 213 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.741983:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007396a2d4/0x3234de053c4d3de lrc: 0/0,0 mode: --/PR res: [0x2ba71:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d014a expref: 213 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.741986:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.741986:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.741987:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52aaf lrc: 3/0,1 mode: PW/PW res: [0x2ba71:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.741990:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52aaf lrc: 4/0,1 mode: PW/PW res: [0x2ba71:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.741998:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.742010:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ccd58b65 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+212:41279:x1731746396418816:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 38us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.742013:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13135 00010000:00010000:0.0:1651529344.742013:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52aa1 lrc: 2/0,0 mode: PW/PW res: [0x2ba70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.742023:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52a9a lrc: 2/0,0 mode: PW/PW res: [0x2ba6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.742027:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cde66bc6 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.742028:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52a9a lrc: 2/0,0 mode: PW/PW res: [0x2ba6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.742031:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52a9a lrc: 3/0,0 mode: PW/PW res: [0x2ba6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.742035:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52a9a lrc: 1/0,0 mode: --/PW res: [0x2ba6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.742038:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52a9a lrc: 0/0,0 mode: --/PW res: [0x2ba6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.742042:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52aa1 lrc: 2/0,0 mode: PW/PW res: [0x2ba70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.742045:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000877aab61 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.742046:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52aa1 lrc: 2/0,0 mode: PW/PW res: [0x2ba70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.742049:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52aa1 lrc: 3/0,0 mode: PW/PW res: [0x2ba70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.742052:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52aa1 lrc: 1/0,0 mode: --/PW res: [0x2ba70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.742054:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52aa1 lrc: 0/0,0 mode: --/PW res: [0x2ba70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.742060:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52aa8 lrc: 3/0,1 mode: PW/PW res: [0x2ba6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.742061:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1852:39030:x1731745946537600:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 758us (827us total) trans 12885080406 rc 0/0 00010000:00010000:1.0:1651529344.742063:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52aa8 lrc: 3/0,1 mode: PW/PW res: [0x2ba6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.742064:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212351 00010000:00010000:1.0:1651529344.742066:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52aa8 lrc: 3/0,1 mode: PW/PW res: [0x2ba6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.742069:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52aa8 lrc: 2/0,0 mode: PW/PW res: [0x2ba6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.742072:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52aaf lrc: 3/0,1 mode: PW/PW res: [0x2ba71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.742082:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52aaf lrc: 3/0,1 mode: PW/PW res: [0x2ba71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.742086:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52aaf lrc: 3/0,1 mode: PW/PW res: [0x2ba71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.742089:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52aaf lrc: 2/0,0 mode: PW/PW res: [0x2ba71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.742119:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1853:39030:x1731745946537536:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 809us (870us total) trans 12885080407 rc 0/0 00000100:00100000:1.0:1651529344.742122:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212352 00000100:00100000:0.0:1651529344.742128:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1852:39030:x1731745946537664:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 772us (863us total) trans 12885080408 rc 0/0 00010000:00010000:1.0:1651529344.742129:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52aa8 lrc: 2/0,0 mode: PW/PW res: [0x2ba6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.742131:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212353 00010000:00010000:1.0:1651529344.742132:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e7aaedb0 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.742133:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52aa8 lrc: 2/0,0 mode: PW/PW res: [0x2ba6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.742136:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52aa8 lrc: 3/0,0 mode: PW/PW res: [0x2ba6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.742138:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52aaf lrc: 2/0,0 mode: PW/PW res: [0x2ba71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.742140:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52aa8 lrc: 1/0,0 mode: --/PW res: [0x2ba6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.742141:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000575eb734 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.742142:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52aaf lrc: 2/0,0 mode: PW/PW res: [0x2ba71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.742143:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52aa8 lrc: 0/0,0 mode: --/PW res: [0x2ba6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.742145:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52aaf lrc: 3/0,0 mode: PW/PW res: [0x2ba71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.742150:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52aaf lrc: 1/0,0 mode: --/PW res: [0x2ba71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.742153:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52aaf lrc: 0/0,0 mode: --/PW res: [0x2ba71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.742157:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.742245:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.742254:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946537984 00000100:00100000:1.0:1651529344.742277:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003e3f0f77 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997057472:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.742281:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52abd lrc: 3/0,1 mode: --/PW res: [0x2ba74:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.742281:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212358 00000100:00100000:0.0:1651529344.742283:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1852:39029:x1731745946537984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.742288:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005cc6463a pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997057536:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.742288:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178806 count 1 00010000:00010000:1.0:1651529344.742290:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52ac4 lrc: 3/0,1 mode: --/PW res: [0x2ba73:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.742292:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c52ad2 lrc: 3/0,1 mode: --/PW res: [0x2ba76:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.742297:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009ebdb83f/0x3234de053c4e2a9 lrc: 2/0,0 mode: PR/PR res: [0x2ba76:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3bf1 expref: 211 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.742300:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.742301:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.742301:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c52ad2 lrc: 4/0,1 mode: --/PW res: [0x2ba76:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.742308:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009ebdb83f/0x3234de053c4e2a9 lrc: 3/0,0 mode: PR/PR res: [0x2ba76:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3bf1 expref: 211 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.742311:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009ebdb83f/0x3234de053c4e2a9 lrc: 4/0,0 mode: PR/PR res: [0x2ba76:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3bf1 expref: 211 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.742318:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a9e254e pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997057664:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.742333:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c0dff858 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.742341:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ad6d0877 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997057408:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.742345:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c52ab6 lrc: 3/0,1 mode: --/PW res: [0x2ba72:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.742351:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396418944 00010000:00010000:0.0:1651529344.742356:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009d44ade1/0x3234de053c4e136 lrc: 4/0,0 mode: PR/PR res: [0x2ba74:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d35a0 expref: 212 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.742366:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13136 00000100:00100000:0.0:1651529344.742368:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+212:41279:x1731746396418944:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.742393:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.742395:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009d44ade1/0x3234de053c4e136 lrc: 4/0,0 mode: PR/PR res: [0x2ba74:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d35a0 expref: 212 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.742399:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009d44ade1/0x3234de053c4e136 lrc: 3/0,0 mode: PR/PR res: [0x2ba74:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d35a0 expref: 212 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.742405:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d44ade1/0x3234de053c4e136 lrc: 0/0,0 mode: --/PR res: [0x2ba74:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d35a0 expref: 212 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.742408:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.742408:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.742409:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.742410:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52abd lrc: 3/0,1 mode: PW/PW res: [0x2ba74:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.742413:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52abd lrc: 4/0,1 mode: PW/PW res: [0x2ba74:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.742416:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.742426:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.742430:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.742439:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+211:41279:x1731746396418944:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 70us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.742451:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13136 00000100:00100000:0.0:1651529344.742459:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946538048 00000100:00100000:0.0:1651529344.742468:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946538176 00000100:00100000:0.0:1651529344.742474:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946538112 00000100:00100000:0.0:1651529344.742478:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212359 00000100:00100000:0.0:1651529344.742479:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1855:39029:x1731745946538048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.742480:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212360 00000100:00100000:1.0:1651529344.742483:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1855:39029:x1731745946538176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.742488:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178809 count 1 00010000:00010000:1.0:1651529344.742493:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52ad9 lrc: 3/0,1 mode: --/PW res: [0x2ba79:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.742495:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178807 count 1 00010000:00010000:1.0:1651529344.742497:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000095f466f1/0x3234de053c4df6f lrc: 2/0,0 mode: PR/PR res: [0x2ba79:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2eed expref: 210 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.742499:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c52ae0 lrc: 3/0,1 mode: --/PW res: [0x2ba77:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.742500:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.742501:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.742502:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52ad9 lrc: 4/0,1 mode: --/PW res: [0x2ba79:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.742504:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e60a1001/0x3234de053c4ec81 lrc: 2/0,0 mode: PR/PR res: [0x2ba77:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d63a5 expref: 210 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.742507:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.742507:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.742508:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c52ae0 lrc: 4/0,1 mode: --/PW res: [0x2ba77:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.742509:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000095f466f1/0x3234de053c4df6f lrc: 3/0,0 mode: PR/PR res: [0x2ba79:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2eed expref: 210 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.742512:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000095f466f1/0x3234de053c4df6f lrc: 4/0,0 mode: PR/PR res: [0x2ba79:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2eed expref: 210 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.742515:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e60a1001/0x3234de053c4ec81 lrc: 3/0,0 mode: PR/PR res: [0x2ba77:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d63a5 expref: 210 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.742517:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000088fa78f8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997057728:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.742521:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e60a1001/0x3234de053c4ec81 lrc: 4/0,0 mode: PR/PR res: [0x2ba77:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d63a5 expref: 210 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.742525:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ad6d0877 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997057792:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.742527:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000babe2d90 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.742531:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52abd lrc: 3/0,1 mode: PW/PW res: [0x2ba74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.742533:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 0000000049203969 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.742535:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52abd lrc: 3/0,1 mode: PW/PW res: [0x2ba74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.742538:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52abd lrc: 3/0,1 mode: PW/PW res: [0x2ba74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.742540:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52abd lrc: 2/0,0 mode: PW/PW res: [0x2ba74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.742540:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212361 00000100:00100000:0.0:1651529344.742542:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1855:39029:x1731745946538112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.742546:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178808 count 1 00010000:00010000:0.0:1651529344.742556:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c52ae7 lrc: 3/0,1 mode: --/PW res: [0x2ba78:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.742560:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000084325e35/0x3234de053c4ee4f lrc: 2/0,0 mode: PR/PR res: [0x2ba78:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b54 expref: 210 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.742563:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.742564:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.742565:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c52ae7 lrc: 4/0,1 mode: --/PW res: [0x2ba78:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.742570:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000084325e35/0x3234de053c4ee4f lrc: 3/0,0 mode: PR/PR res: [0x2ba78:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b54 expref: 210 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.742583:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1856:39030:x1731745946537856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1087us (1170us total) trans 12885080409 rc 0/0 00000100:00100000:1.0:1651529344.742586:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212355 00010000:00010000:0.0:1651529344.742588:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000084325e35/0x3234de053c4ee4f lrc: 4/0,0 mode: PR/PR res: [0x2ba78:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b54 expref: 210 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.742595:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000075b025a pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997057856:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.742603:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bff8744a going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.742608:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52abd lrc: 2/0,0 mode: PW/PW res: [0x2ba74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.742611:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000091ee0f93 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.742612:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52abd lrc: 2/0,0 mode: PW/PW res: [0x2ba74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.742615:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52abd lrc: 3/0,0 mode: PW/PW res: [0x2ba74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.742620:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52abd lrc: 1/0,0 mode: --/PW res: [0x2ba74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.742622:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52abd lrc: 0/0,0 mode: --/PW res: [0x2ba74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.742653:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.742660:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396418880 00010000:00010000:0.0:1651529344.742665:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dca1a889/0x3234de053c4f0a2 lrc: 4/0,0 mode: PR/PR res: [0x2ba72:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7556 expref: 211 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.742678:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13137 00000100:00100000:0.0:1651529344.742680:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+211:41279:x1731746396418880:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.742684:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.742686:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dca1a889/0x3234de053c4f0a2 lrc: 4/0,0 mode: PR/PR res: [0x2ba72:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7556 expref: 211 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.742689:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dca1a889/0x3234de053c4f0a2 lrc: 3/0,0 mode: PR/PR res: [0x2ba72:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7556 expref: 211 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.742695:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dca1a889/0x3234de053c4f0a2 lrc: 0/0,0 mode: --/PR res: [0x2ba72:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7556 expref: 211 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.742698:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.742698:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.742699:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c52ab6 lrc: 3/0,1 mode: PW/PW res: [0x2ba72:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.742702:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c52ab6 lrc: 4/0,1 mode: PW/PW res: [0x2ba72:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.742709:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.742720:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+210:41279:x1731746396418880:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 39us (68us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.742723:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13137 00010000:00010000:0.0:1651529344.742729:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c52ab6 lrc: 3/0,1 mode: PW/PW res: [0x2ba72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.742732:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c52ab6 lrc: 3/0,1 mode: PW/PW res: [0x2ba72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.742765:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c52ab6 lrc: 3/0,1 mode: PW/PW res: [0x2ba72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.742768:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c52ab6 lrc: 2/0,0 mode: PW/PW res: [0x2ba72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.742771:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.742783:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946538240 00000100:00100000:1.0:1651529344.742790:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212362 00000100:00100000:1.0:1651529344.742792:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1856:39029:x1731745946538240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.742797:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178810 count 1 00010000:00010000:1.0:1651529344.742801:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52aee lrc: 3/0,1 mode: --/PW res: [0x2ba7a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.742806:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000091ef533a/0x3234de053c4d398 lrc: 2/0,0 mode: PR/PR res: [0x2ba7a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0086 expref: 209 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.742809:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.742809:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.742810:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52aee lrc: 4/0,1 mode: --/PW res: [0x2ba7a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.742816:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000091ef533a/0x3234de053c4d398 lrc: 3/0,0 mode: PR/PR res: [0x2ba7a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0086 expref: 209 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.742820:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000091ef533a/0x3234de053c4d398 lrc: 4/0,0 mode: PR/PR res: [0x2ba7a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0086 expref: 209 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.742824:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997057920:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.742828:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1857:39030:x1731745946537728:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1349us (1425us total) trans 12885080410 rc 0/0 00000100:00100000:0.0:1651529344.742831:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212354 00000100:00100000:1.0:1651529344.742840:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.742844:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c52ab6 lrc: 2/0,0 mode: PW/PW res: [0x2ba72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.742846:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.742848:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009882f227 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.742849:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c52ab6 lrc: 2/0,0 mode: PW/PW res: [0x2ba72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.742852:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c52ab6 lrc: 3/0,0 mode: PW/PW res: [0x2ba72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.742857:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c52ab6 lrc: 1/0,0 mode: --/PW res: [0x2ba72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.742859:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c52ab6 lrc: 0/0,0 mode: --/PW res: [0x2ba72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.742887:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396419008 00010000:00010000:0.0:1651529344.742893:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c8a15aec/0x3234de053c4dad7 lrc: 4/0,0 mode: PR/PR res: [0x2ba73:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b98 expref: 210 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.742908:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13138 00000100:00100000:0.0:1651529344.742910:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+210:41279:x1731746396419008:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529344.742912:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.742913:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.742914:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c8a15aec/0x3234de053c4dad7 lrc: 4/0,0 mode: PR/PR res: [0x2ba73:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b98 expref: 210 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.742927:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.742933:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396419072 00010000:00010000:0.0:1651529344.742938:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c8a15aec/0x3234de053c4dad7 lrc: 3/0,0 mode: PR/PR res: [0x2ba73:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b98 expref: 211 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.742939:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000013b4168/0x3234de053c4d137 lrc: 5/0,0 mode: PR/PR res: [0x2ba75:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf668 expref: 211 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.742944:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396419136 00010000:00010000:1.0:1651529344.742946:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009ebdb83f/0x3234de053c4e2a9 lrc: 5/0,0 mode: PR/PR res: [0x2ba76:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3bf1 expref: 212 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.742951:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13139 00000100:00100000:1.0:1651529344.742953:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+212:41278:x1731746396419072:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.742955:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.742956:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000013b4168/0x3234de053c4d137 lrc: 5/0,0 mode: PR/PR res: [0x2ba75:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf668 expref: 212 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.742960:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000013b4168/0x3234de053c4d137 lrc: 4/0,0 mode: PR/PR res: [0x2ba75:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf668 expref: 212 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.742963:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8a15aec/0x3234de053c4dad7 lrc: 0/0,0 mode: --/PR res: [0x2ba73:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b98 expref: 212 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.742970:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.742971:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.742972:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52ac4 lrc: 3/0,1 mode: PW/PW res: [0x2ba73:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.742975:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.742975:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52ac4 lrc: 4/0,1 mode: PW/PW res: [0x2ba73:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.742976:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.742977:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c52acb lrc: 3/0,1 mode: PW/PW res: [0x2ba75:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.742980:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c52acb lrc: 4/0,1 mode: PW/PW res: [0x2ba75:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.742984:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.742990:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.743002:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+211:41278:x1731746396419072:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 48us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.743004:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13139 00000100:00100000:0.0:1651529344.743007:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+210:41279:x1731746396419008:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 96us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.743009:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13140 00000100:00100000:1.0:1651529344.743011:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+210:41278:x1731746396419136:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.743011:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13138 00010000:00010000:1.0:1651529344.743013:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.743015:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009ebdb83f/0x3234de053c4e2a9 lrc: 5/0,0 mode: PR/PR res: [0x2ba76:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3bf1 expref: 209 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.743018:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009ebdb83f/0x3234de053c4e2a9 lrc: 4/0,0 mode: PR/PR res: [0x2ba76:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3bf1 expref: 209 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.743023:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ebdb83f/0x3234de053c4e2a9 lrc: 0/0,0 mode: --/PR res: [0x2ba76:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3bf1 expref: 209 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.743023:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a9e254e pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997057664:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.743027:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.743027:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.743027:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c52ad2 lrc: 3/0,1 mode: --/PW res: [0x2ba76:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.743028:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c52ad2 lrc: 3/0,1 mode: PW/PW res: [0x2ba76:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.743031:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c52ad2 lrc: 4/0,1 mode: PW/PW res: [0x2ba76:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.743038:0:72395:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000013b4168/0x3234de053c4d137 lrc: 0/0,0 mode: --/PR res: [0x2ba75:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf668 expref: 208 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.743041:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.743046:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+208:41278:x1731746396419136:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.743048:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13140 00000100:00100000:0.0:1651529344.743048:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bca72234 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997057600:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.743051:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c52acb lrc: 3/0,1 mode: PW/PW res: [0x2ba75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.743056:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52ac4 lrc: 3/0,1 mode: PW/PW res: [0x2ba73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.743059:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52ac4 lrc: 3/0,1 mode: PW/PW res: [0x2ba73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.743062:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52ac4 lrc: 3/0,1 mode: PW/PW res: [0x2ba73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.743065:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52ac4 lrc: 2/0,0 mode: PW/PW res: [0x2ba73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.743065:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c52acb lrc: 3/0,1 mode: PW/PW res: [0x2ba75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.743070:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c52acb lrc: 3/0,1 mode: PW/PW res: [0x2ba75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.743079:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c52acb lrc: 3/0,1 mode: PW/PW res: [0x2ba75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.743082:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c52acb lrc: 2/0,0 mode: PW/PW res: [0x2ba75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.743105:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1858:39030:x1731745946537792:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1553us (1660us total) trans 12885080411 rc 0/0 00000100:00100000:1.0:1651529344.743108:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212356 00000100:00100000:0.0:1651529344.743124:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1857:39029:x1731745946537920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1221us (1238us total) trans 12885080412 rc 0/0 00000100:00100000:0.0:1651529344.743127:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212357 00010000:00010000:0.0:1651529344.743134:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52ac4 lrc: 2/0,0 mode: PW/PW res: [0x2ba73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.743135:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.743138:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f9b62460 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.743145:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52ac4 lrc: 2/0,0 mode: PW/PW res: [0x2ba73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.743149:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52ac4 lrc: 3/0,0 mode: PW/PW res: [0x2ba73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.743164:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52ac4 lrc: 1/0,0 mode: --/PW res: [0x2ba73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.743167:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52ac4 lrc: 0/0,0 mode: --/PW res: [0x2ba73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.743171:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c52acb lrc: 2/0,0 mode: PW/PW res: [0x2ba75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.743174:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cde7e11a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.743175:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c52acb lrc: 2/0,0 mode: PW/PW res: [0x2ba75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.743182:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c52acb lrc: 3/0,0 mode: PW/PW res: [0x2ba75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.743186:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c52acb lrc: 1/0,0 mode: --/PW res: [0x2ba75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.743188:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c52acb lrc: 0/0,0 mode: --/PW res: [0x2ba75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.743194:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c52ad2 lrc: 3/0,1 mode: PW/PW res: [0x2ba76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.743197:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c52ad2 lrc: 3/0,1 mode: PW/PW res: [0x2ba76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.743200:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c52ad2 lrc: 3/0,1 mode: PW/PW res: [0x2ba76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.743203:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c52ad2 lrc: 2/0,0 mode: PW/PW res: [0x2ba76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.743205:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.743219:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.743242:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.743252:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.743265:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000088fa78f8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997057728:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.743268:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1857:39029:x1731745946537984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 984us (1110us total) trans 12885080413 rc 0/0 00000100:00100000:0.0:1651529344.743271:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212358 00010000:00010000:1.0:1651529344.743274:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52ad9 lrc: 3/0,1 mode: --/PW res: [0x2ba79:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.743277:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946538304 00000100:00100000:1.0:1651529344.743281:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396419200 00010000:00010000:1.0:1651529344.743290:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000095f466f1/0x3234de053c4df6f lrc: 4/0,0 mode: PR/PR res: [0x2ba79:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2eed expref: 207 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.743296:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396419264 00010000:00010000:1.0:1651529344.743298:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e60a1001/0x3234de053c4ec81 lrc: 5/0,0 mode: PR/PR res: [0x2ba77:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d63a5 expref: 208 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.743298:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212363 00000100:00100000:0.0:1651529344.743300:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1857:39029:x1731745946538304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.743302:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396419328 00010000:00010000:1.0:1651529344.743304:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000084325e35/0x3234de053c4ee4f lrc: 5/0,0 mode: PR/PR res: [0x2ba78:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b54 expref: 209 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.743308:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396419392 00010000:00010000:1.0:1651529344.743310:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000091ef533a/0x3234de053c4d398 lrc: 5/0,0 mode: PR/PR res: [0x2ba7a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0086 expref: 210 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.743314:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13141 00002000:00080000:0.0:1651529344.743315:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178811 count 1 00000100:00100000:1.0:1651529344.743316:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+210:41279:x1731746396419200:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.743318:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.743320:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000095f466f1/0x3234de053c4df6f lrc: 4/0,0 mode: PR/PR res: [0x2ba79:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2eed expref: 210 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.743320:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c52af5 lrc: 3/0,1 mode: --/PW res: [0x2ba7b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.743324:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c53753be/0x3234de053c4d884 lrc: 2/0,0 mode: PR/PR res: [0x2ba7b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d12e6 expref: 210 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.743326:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000095f466f1/0x3234de053c4df6f lrc: 3/0,0 mode: PR/PR res: [0x2ba79:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2eed expref: 210 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.743328:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.743328:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.743329:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c52af5 lrc: 4/0,1 mode: --/PW res: [0x2ba7b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.743331:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095f466f1/0x3234de053c4df6f lrc: 0/0,0 mode: --/PR res: [0x2ba79:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2eed expref: 210 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.743335:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.743336:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.743336:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52ad9 lrc: 3/0,1 mode: PW/PW res: [0x2ba79:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.743336:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c53753be/0x3234de053c4d884 lrc: 3/0,0 mode: PR/PR res: [0x2ba7b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d12e6 expref: 209 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.743339:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c53753be/0x3234de053c4d884 lrc: 4/0,0 mode: PR/PR res: [0x2ba7b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d12e6 expref: 209 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.743340:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52ad9 lrc: 4/0,1 mode: PW/PW res: [0x2ba79:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.743344:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bca72234 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997057984:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.743346:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.743353:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+209:41279:x1731746396419200:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 36us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.743355:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13141 00000100:00100000:0.0:1651529344.743355:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000003678d25f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.743359:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13142 00000100:00100000:1.0:1651529344.743361:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6d06412 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+208:41278:x1731746396419264:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.743363:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.743363:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ad6d0877 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997057792:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.743364:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e60a1001/0x3234de053c4ec81 lrc: 4/0,0 mode: PR/PR res: [0x2ba77:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d63a5 expref: 208 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.743366:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c52ae0 lrc: 3/0,1 mode: --/PW res: [0x2ba77:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.743368:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e60a1001/0x3234de053c4ec81 lrc: 3/0,0 mode: PR/PR res: [0x2ba77:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d63a5 expref: 208 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.743373:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e60a1001/0x3234de053c4ec81 lrc: 0/0,0 mode: --/PR res: [0x2ba77:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d63a5 expref: 208 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.743376:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.743376:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000075b025a pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997057856:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.743377:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.743377:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c52ae0 lrc: 3/0,1 mode: PW/PW res: [0x2ba77:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.743378:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c52ae7 lrc: 3/0,1 mode: --/PW res: [0x2ba78:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.743380:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c52ae0 lrc: 4/0,1 mode: PW/PW res: [0x2ba77:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.743385:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13143 00000100:00100000:0.0:1651529344.743387:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+207:41279:x1731746396419328:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.743390:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.743395:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6d06412 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+207:41278:x1731746396419264:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 34us (176us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.743397:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.743398:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13142 00010000:00010000:0.0:1651529344.743399:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000084325e35/0x3234de053c4ee4f lrc: 4/0,0 mode: PR/PR res: [0x2ba78:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b54 expref: 207 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.743403:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000084325e35/0x3234de053c4ee4f lrc: 3/0,0 mode: PR/PR res: [0x2ba78:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b54 expref: 206 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.743406:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13144 00000100:00100000:1.0:1651529344.743408:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+206:41278:x1731746396419392:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.743408:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084325e35/0x3234de053c4ee4f lrc: 0/0,0 mode: --/PR res: [0x2ba78:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6b54 expref: 206 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.743410:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.743412:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000091ef533a/0x3234de053c4d398 lrc: 5/0,0 mode: PR/PR res: [0x2ba7a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0086 expref: 205 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.743412:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.743413:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.743413:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c52ae7 lrc: 3/0,1 mode: PW/PW res: [0x2ba78:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.743415:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000091ef533a/0x3234de053c4d398 lrc: 4/0,0 mode: PR/PR res: [0x2ba7a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0086 expref: 205 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.743417:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c52ae7 lrc: 4/0,1 mode: PW/PW res: [0x2ba78:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.743420:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.743421:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.743422:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52aee lrc: 3/0,1 mode: PW/PW res: [0x2ba7a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.743423:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.743425:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52aee lrc: 4/0,1 mode: PW/PW res: [0x2ba7a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.743429:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.743430:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+205:41279:x1731746396419328:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.743433:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+205:41278:x1731746396419392:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 25us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.743433:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13143 00000100:00100000:1.0:1651529344.743435:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13144 00010000:00010000:0.0:1651529344.743439:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c52ae7 lrc: 3/0,1 mode: PW/PW res: [0x2ba78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.743441:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c52ad2 lrc: 2/0,0 mode: PW/PW res: [0x2ba76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.743442:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c52ae7 lrc: 3/0,1 mode: PW/PW res: [0x2ba78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.743445:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009fff0bd3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.743445:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c52ae7 lrc: 3/0,1 mode: PW/PW res: [0x2ba78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.743446:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c52ad2 lrc: 2/0,0 mode: PW/PW res: [0x2ba76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.743448:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c52ad2 lrc: 3/0,0 mode: PW/PW res: [0x2ba76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.743448:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c52ae7 lrc: 2/0,0 mode: PW/PW res: [0x2ba78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.743452:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c52ad2 lrc: 1/0,0 mode: --/PW res: [0x2ba76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.743455:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c52ad2 lrc: 0/0,0 mode: --/PW res: [0x2ba76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.743459:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c52ae7 lrc: 2/0,0 mode: PW/PW res: [0x2ba78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.743464:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e4f40ecf already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.743465:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c52ae7 lrc: 2/0,0 mode: PW/PW res: [0x2ba78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.743468:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c52ae7 lrc: 3/0,0 mode: PW/PW res: [0x2ba78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.743471:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c52ae7 lrc: 1/0,0 mode: --/PW res: [0x2ba78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.743473:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c52ae7 lrc: 0/0,0 mode: --/PW res: [0x2ba78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.743484:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1858:39029:x1731745946538112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 941us (1054us total) trans 12885080414 rc 0/0 00010000:00010000:1.0:1651529344.743486:0:72397:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091ef533a/0x3234de053c4d398 lrc: 0/0,0 mode: --/PR res: [0x2ba7a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0086 expref: 203 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.743487:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212361 00000100:00100000:1.0:1651529344.743489:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997057920:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.743492:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52aee lrc: 3/0,1 mode: PW/PW res: [0x2ba7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.743494:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c52ae0 lrc: 3/0,1 mode: PW/PW res: [0x2ba77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.743495:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52aee lrc: 3/0,1 mode: PW/PW res: [0x2ba7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.743498:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52aee lrc: 3/0,1 mode: PW/PW res: [0x2ba7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.743498:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c52ae0 lrc: 3/0,1 mode: PW/PW res: [0x2ba77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.743500:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c52ae0 lrc: 3/0,1 mode: PW/PW res: [0x2ba77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.743503:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52aee lrc: 3/0,1 mode: PW/PW res: [0x2ba7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.743504:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c52ae0 lrc: 2/0,0 mode: PW/PW res: [0x2ba77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.743506:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52aee lrc: 2/0,0 mode: PW/PW res: [0x2ba7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.743535:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1859:39029:x1731745946538048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1055us (1127us total) trans 12885080415 rc 0/0 00000100:00100000:0.0:1651529344.743538:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212359 00010000:00010000:0.0:1651529344.743544:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c52ae0 lrc: 2/0,0 mode: PW/PW res: [0x2ba77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.743545:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1858:39029:x1731745946538240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 752us (775us total) trans 12885080416 rc 0/0 00010000:00010000:0.0:1651529344.743547:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c660975a already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.743548:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212362 00010000:00010000:0.0:1651529344.743548:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c52ae0 lrc: 2/0,0 mode: PW/PW res: [0x2ba77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.743551:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c52ae0 lrc: 3/0,0 mode: PW/PW res: [0x2ba77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.743555:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c52ae0 lrc: 1/0,0 mode: --/PW res: [0x2ba77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.743556:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52ad9 lrc: 3/0,1 mode: PW/PW res: [0x2ba79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.743558:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c52ae0 lrc: 0/0,0 mode: --/PW res: [0x2ba77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.743559:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52ad9 lrc: 3/0,1 mode: PW/PW res: [0x2ba79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.743562:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52ad9 lrc: 3/0,1 mode: PW/PW res: [0x2ba79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.743562:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52aee lrc: 2/0,0 mode: PW/PW res: [0x2ba7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.743564:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52ad9 lrc: 2/0,0 mode: PW/PW res: [0x2ba79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.743564:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001391dc6d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.743565:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52aee lrc: 2/0,0 mode: PW/PW res: [0x2ba7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.743568:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52aee lrc: 3/0,0 mode: PW/PW res: [0x2ba7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.743579:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52aee lrc: 1/0,0 mode: --/PW res: [0x2ba7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.743582:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52aee lrc: 0/0,0 mode: --/PW res: [0x2ba7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.743586:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52ad9 lrc: 2/0,0 mode: PW/PW res: [0x2ba79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.743588:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f0bd9bfb already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.743589:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52ad9 lrc: 2/0,0 mode: PW/PW res: [0x2ba79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.743592:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52ad9 lrc: 3/0,0 mode: PW/PW res: [0x2ba79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.743595:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52ad9 lrc: 1/0,0 mode: --/PW res: [0x2ba79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.743597:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52ad9 lrc: 0/0,0 mode: --/PW res: [0x2ba79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.743600:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1858:39029:x1731745946538176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1117us (1183us total) trans 12885080417 rc 0/0 00000100:00100000:1.0:1651529344.743603:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212360 00000100:00100000:0.0:1651529344.743628:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.743640:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946538368 00000100:00100000:0.0:1651529344.743646:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.743647:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212364 00000100:00100000:1.0:1651529344.743653:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1858:39029:x1731745946538368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.743659:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178812 count 1 00010000:00010000:1.0:1651529344.743663:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52afc lrc: 3/0,1 mode: --/PW res: [0x2ba7c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.743668:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d95da09e/0x3234de053c4f143 lrc: 2/0,0 mode: PR/PR res: [0x2ba7c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77a2 expref: 202 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.743671:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.743672:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.743672:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52afc lrc: 4/0,1 mode: --/PW res: [0x2ba7c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.743705:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d95da09e/0x3234de053c4f143 lrc: 3/0,0 mode: PR/PR res: [0x2ba7c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77a2 expref: 202 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.743708:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d95da09e/0x3234de053c4f143 lrc: 4/0,0 mode: PR/PR res: [0x2ba7c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77a2 expref: 202 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.743712:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d523a75 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997058048:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.743727:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.743733:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946538432 00000100:00100000:1.0:1651529344.743750:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212365 00000100:00100000:1.0:1651529344.743752:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1859:39030:x1731745946538432:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.743756:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178813 count 1 00010000:00010000:1.0:1651529344.743760:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c52b03 lrc: 3/0,1 mode: --/PW res: [0x2ba7d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.743767:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf141ba0/0x3234de053c4ea97 lrc: 2/0,0 mode: PR/PR res: [0x2ba7d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c35 expref: 202 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.743770:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.743771:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.743772:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c52b03 lrc: 4/0,1 mode: --/PW res: [0x2ba7d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.743785:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bf141ba0/0x3234de053c4ea97 lrc: 3/0,0 mode: PR/PR res: [0x2ba7d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c35 expref: 202 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.743789:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bf141ba0/0x3234de053c4ea97 lrc: 4/0,0 mode: PR/PR res: [0x2ba7d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c35 expref: 202 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.743793:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000264aecf8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997058112:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.743806:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000053a0cffa going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.743891:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bca72234 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997057984:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.743895:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c52af5 lrc: 3/0,1 mode: --/PW res: [0x2ba7b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.743951:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.743981:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396419456 00010000:00010000:1.0:1651529344.743987:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c53753be/0x3234de053c4d884 lrc: 4/0,0 mode: PR/PR res: [0x2ba7b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d12e6 expref: 203 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.743995:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13145 00000100:00100000:1.0:1651529344.743996:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+203:41278:x1731746396419456:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.744005:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.744006:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c53753be/0x3234de053c4d884 lrc: 4/0,0 mode: PR/PR res: [0x2ba7b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d12e6 expref: 203 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.744013:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c53753be/0x3234de053c4d884 lrc: 3/0,0 mode: PR/PR res: [0x2ba7b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d12e6 expref: 203 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.744019:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c53753be/0x3234de053c4d884 lrc: 0/0,0 mode: --/PR res: [0x2ba7b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d12e6 expref: 203 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.744023:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.744023:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.744024:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c52af5 lrc: 3/0,1 mode: PW/PW res: [0x2ba7b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.744027:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c52af5 lrc: 4/0,1 mode: PW/PW res: [0x2ba7b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.744041:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.744058:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+202:41278:x1731746396419456:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 61us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.744061:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13145 00000100:00100000:0.0:1651529344.744073:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.744083:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000264aecf8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997058112:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.744088:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c52b03 lrc: 3/0,1 mode: --/PW res: [0x2ba7d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.744094:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396419520 00010000:00010000:1.0:1651529344.744103:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d95da09e/0x3234de053c4f143 lrc: 5/0,0 mode: PR/PR res: [0x2ba7c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77a2 expref: 202 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.744106:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.744116:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.744124:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.744126:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396419584 00010000:00010000:1.0:1651529344.744129:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bf141ba0/0x3234de053c4ea97 lrc: 4/0,0 mode: PR/PR res: [0x2ba7d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c35 expref: 203 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.744132:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.744138:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13146 00000100:00100000:1.0:1651529344.744140:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+203:41279:x1731746396419520:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.744142:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.744144:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d95da09e/0x3234de053c4f143 lrc: 5/0,0 mode: PR/PR res: [0x2ba7c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77a2 expref: 203 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.744144:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.744148:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d95da09e/0x3234de053c4f143 lrc: 4/0,0 mode: PR/PR res: [0x2ba7c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77a2 expref: 203 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.744151:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.744153:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.744153:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.744154:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52afc lrc: 3/0,1 mode: PW/PW res: [0x2ba7c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.744161:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946538496 00010000:00010000:1.0:1651529344.744162:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52afc lrc: 4/0,1 mode: PW/PW res: [0x2ba7c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.744167:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.744168:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946538624 00000100:00100000:0.0:1651529344.744174:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946538752 00000100:00100000:0.0:1651529344.744179:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946538560 00000100:00100000:1.0:1651529344.744189:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+203:41279:x1731746396419520:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 49us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.744189:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946538688 00000100:00100000:1.0:1651529344.744192:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13146 00000100:00100000:0.0:1651529344.744193:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212366 00000100:00100000:0.0:1651529344.744194:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1864:39030:x1731745946538496:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.744197:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13147 00000100:00100000:1.0:1651529344.744199:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+202:41278:x1731746396419584:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00002000:00080000:0.0:1651529344.744200:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178814 count 1 00010000:00010000:1.0:1651529344.744201:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.744203:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bf141ba0/0x3234de053c4ea97 lrc: 4/0,0 mode: PR/PR res: [0x2ba7d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c35 expref: 202 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.744204:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c52b0a lrc: 3/0,1 mode: --/PW res: [0x2ba7e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.744206:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bf141ba0/0x3234de053c4ea97 lrc: 3/0,0 mode: PR/PR res: [0x2ba7d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c35 expref: 202 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.744209:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001f1d421b/0x3234de053c4a991 lrc: 2/0,0 mode: PR/PR res: [0x2ba7e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd1f expref: 202 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.744211:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf141ba0/0x3234de053c4ea97 lrc: 0/0,0 mode: --/PR res: [0x2ba7d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5c35 expref: 202 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.744212:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.744212:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.744213:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c52b0a lrc: 4/0,1 mode: --/PW res: [0x2ba7e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.744215:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.744215:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.744216:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c52b03 lrc: 3/0,1 mode: PW/PW res: [0x2ba7d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.744219:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c52b03 lrc: 4/0,1 mode: PW/PW res: [0x2ba7d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.744220:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001f1d421b/0x3234de053c4a991 lrc: 3/0,0 mode: PR/PR res: [0x2ba7e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd1f expref: 201 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.744247:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.744251:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001f1d421b/0x3234de053c4a991 lrc: 4/0,0 mode: PR/PR res: [0x2ba7e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd1f expref: 201 pid: 80276 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.744253:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+201:41278:x1731746396419584:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 54us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.744256:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13147 00000100:00100000:0.0:1651529344.744256:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f39ca9ea pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997058176:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.744263:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212367 00000100:00100000:1.0:1651529344.744265:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1864:39030:x1731745946538624:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.744266:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 000000008dd99533 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.744270:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178816 count 1 00000100:00100000:0.0:1651529344.744272:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212368 00010000:00010000:1.0:1651529344.744273:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52b11 lrc: 3/0,1 mode: --/PW res: [0x2ba80:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.744274:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1864:39030:x1731745946538752:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.744278:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000652f2444/0x3234de053c4b5ca lrc: 2/0,0 mode: PR/PR res: [0x2ba80:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc2c1 expref: 200 pid: 151609 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.744279:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178818 count 1 00010000:00010000:1.0:1651529344.744281:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.744282:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.744282:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52b11 lrc: 4/0,1 mode: --/PW res: [0x2ba80:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.744282:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c52b18 lrc: 3/0,1 mode: --/PW res: [0x2ba82:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.744287:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0f055f1/0x3234de053c4ce9e lrc: 2/0,0 mode: PR/PR res: [0x2ba82:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec74 expref: 200 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.744289:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000652f2444/0x3234de053c4b5ca lrc: 3/0,0 mode: PR/PR res: [0x2ba80:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc2c1 expref: 200 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.744290:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.744290:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.744291:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c52b18 lrc: 4/0,1 mode: --/PW res: [0x2ba82:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.744292:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000652f2444/0x3234de053c4b5ca lrc: 4/0,0 mode: PR/PR res: [0x2ba80:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc2c1 expref: 200 pid: 151609 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.744296:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000264aecf8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997058240:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.744298:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a0f055f1/0x3234de053c4ce9e lrc: 3/0,0 mode: PR/PR res: [0x2ba82:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec74 expref: 200 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.744301:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a0f055f1/0x3234de053c4ce9e lrc: 4/0,0 mode: PR/PR res: [0x2ba82:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec74 expref: 200 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.744304:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000babe2d90 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.744306:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001d1586f2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997058304:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.744311:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212369 00000100:00100000:0.0:1651529344.744312:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c0dff858 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.744313:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1864:39030:x1731745946538560:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.744316:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178815 count 1 00000100:00100000:0.0:1651529344.744318:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212370 00010000:00010000:1.0:1651529344.744319:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52b1f lrc: 3/0,1 mode: --/PW res: [0x2ba7f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.744319:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1864:39030:x1731745946538688:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.744323:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178817 count 1 00010000:00010000:1.0:1651529344.744324:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cf3292c2/0x3234de053c4c751 lrc: 2/0,0 mode: PR/PR res: [0x2ba7f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf94 expref: 200 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.744326:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c52b26 lrc: 3/0,1 mode: --/PW res: [0x2ba81:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.744327:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.744328:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.744328:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52b1f lrc: 4/0,1 mode: --/PW res: [0x2ba7f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.744330:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001cae1e96/0x3234de053c4ed37 lrc: 2/0,0 mode: PR/PR res: [0x2ba81:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d66ae expref: 200 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.744333:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.744333:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.744334:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cf3292c2/0x3234de053c4c751 lrc: 3/0,0 mode: PR/PR res: [0x2ba7f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf94 expref: 200 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.744334:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c52b26 lrc: 4/0,1 mode: --/PW res: [0x2ba81:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.744338:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cf3292c2/0x3234de053c4c751 lrc: 4/0,0 mode: PR/PR res: [0x2ba7f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf94 expref: 200 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.744340:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001cae1e96/0x3234de053c4ed37 lrc: 3/0,0 mode: PR/PR res: [0x2ba81:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d66ae expref: 200 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.744341:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd68fdd5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997058368:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.744343:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001cae1e96/0x3234de053c4ed37 lrc: 4/0,0 mode: PR/PR res: [0x2ba81:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d66ae expref: 200 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.744347:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002f363f4a pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997058432:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.744348:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 0000000053a0cffa going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.744353:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c2b2b59c going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.744357:0:80277:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d95da09e/0x3234de053c4f143 lrc: 0/0,0 mode: --/PR res: [0x2ba7c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d77a2 expref: 200 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.744357:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c52af5 lrc: 3/0,1 mode: PW/PW res: [0x2ba7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.744360:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c52af5 lrc: 3/0,1 mode: PW/PW res: [0x2ba7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.744361:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d523a75 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997058048:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.744363:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c52af5 lrc: 3/0,1 mode: PW/PW res: [0x2ba7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.744364:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52afc lrc: 3/0,1 mode: PW/PW res: [0x2ba7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.744366:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c52af5 lrc: 2/0,0 mode: PW/PW res: [0x2ba7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.744367:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52afc lrc: 3/0,1 mode: PW/PW res: [0x2ba7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.744370:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52afc lrc: 3/0,1 mode: PW/PW res: [0x2ba7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.744373:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52afc lrc: 3/0,1 mode: PW/PW res: [0x2ba7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.744378:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52afc lrc: 2/0,0 mode: PW/PW res: [0x2ba7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.744413:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1866:39029:x1731745946538304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1112us (1278us total) trans 12885080418 rc 0/0 00000100:00100000:0.0:1651529344.744416:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212363 00000100:00100000:1.0:1651529344.744421:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1865:39029:x1731745946538368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 771us (793us total) trans 12885080419 rc 0/0 00000100:00100000:1.0:1651529344.744424:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212364 00010000:00010000:0.0:1651529344.744424:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c52af5 lrc: 2/0,0 mode: PW/PW res: [0x2ba7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.744427:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d1167ce5 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.744428:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c52af5 lrc: 2/0,0 mode: PW/PW res: [0x2ba7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.744431:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c52b03 lrc: 3/0,1 mode: PW/PW res: [0x2ba7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.744431:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c52af5 lrc: 3/0,0 mode: PW/PW res: [0x2ba7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.744435:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c52b03 lrc: 3/0,1 mode: PW/PW res: [0x2ba7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.744435:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c52af5 lrc: 1/0,0 mode: --/PW res: [0x2ba7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.744438:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c52b03 lrc: 3/0,1 mode: PW/PW res: [0x2ba7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.744438:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c52af5 lrc: 0/0,0 mode: --/PW res: [0x2ba7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.744441:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c52b03 lrc: 2/0,0 mode: PW/PW res: [0x2ba7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.744443:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52afc lrc: 2/0,0 mode: PW/PW res: [0x2ba7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.744446:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008517b233 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.744447:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52afc lrc: 2/0,0 mode: PW/PW res: [0x2ba7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.744449:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52afc lrc: 3/0,0 mode: PW/PW res: [0x2ba7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.744453:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52afc lrc: 1/0,0 mode: --/PW res: [0x2ba7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.744455:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52afc lrc: 0/0,0 mode: --/PW res: [0x2ba7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.744459:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c52b03 lrc: 2/0,0 mode: PW/PW res: [0x2ba7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.744461:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e85485c6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.744462:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c52b03 lrc: 2/0,0 mode: PW/PW res: [0x2ba7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.744465:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c52b03 lrc: 3/0,0 mode: PW/PW res: [0x2ba7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.744468:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c52b03 lrc: 1/0,0 mode: --/PW res: [0x2ba7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.744471:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c52b03 lrc: 0/0,0 mode: --/PW res: [0x2ba7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.744473:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1865:39030:x1731745946538432:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 720us (827us total) trans 12885080420 rc 0/0 00000100:00100000:1.0:1651529344.744476:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212365 00000100:00100000:1.0:1651529344.744682:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.744690:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.744706:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946538880 00000100:00100000:1.0:1651529344.744713:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.744723:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946538816 00000100:00100000:0.0:1651529344.744731:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212371 00000100:00100000:1.0:1651529344.744732:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946538944 00000100:00100000:0.0:1651529344.744733:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1866:39030:x1731745946538880:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.744747:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178820 count 1 00000100:00100000:1.0:1651529344.744748:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212372 00000100:00100000:1.0:1651529344.744750:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1867:39030:x1731745946538816:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.744751:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c52b2d lrc: 3/0,1 mode: --/PW res: [0x2ba84:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.744755:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178819 count 1 00010000:00010000:0.0:1651529344.744756:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c4cc3d lrc: 2/0,0 mode: PR/PR res: [0x2ba84:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce295 expref: 199 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.744759:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.744760:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52b34 lrc: 3/0,1 mode: --/PW res: [0x2ba83:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.744760:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.744760:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c52b2d lrc: 4/0,1 mode: --/PW res: [0x2ba84:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.744764:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f6cd1dd7/0x3234de053c4dcf9 lrc: 2/0,0 mode: PR/PR res: [0x2ba83:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2490 expref: 199 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.744767:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c4cc3d lrc: 3/0,0 mode: PR/PR res: [0x2ba84:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce295 expref: 199 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.744768:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.744768:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.744769:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52b34 lrc: 4/0,1 mode: --/PW res: [0x2ba83:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.744771:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c4cc3d lrc: 4/0,0 mode: PR/PR res: [0x2ba84:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce295 expref: 199 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.744775:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002f77bb41 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997058496:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.744776:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f6cd1dd7/0x3234de053c4dcf9 lrc: 3/0,0 mode: PR/PR res: [0x2ba83:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2490 expref: 199 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.744779:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f6cd1dd7/0x3234de053c4dcf9 lrc: 4/0,0 mode: PR/PR res: [0x2ba83:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2490 expref: 199 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.744784:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000027e31dd1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997058560:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.744787:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a82c4968 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.744792:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cfa1ca05 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.744794:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212373 00000100:00100000:0.0:1651529344.744795:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1867:39029:x1731745946538944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.744800:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178821 count 1 00010000:00010000:0.0:1651529344.744803:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c52b3b lrc: 3/0,1 mode: --/PW res: [0x2ba85:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.744807:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d7827fc7/0x3234de053c4f231 lrc: 2/0,0 mode: PR/PR res: [0x2ba85:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b7d expref: 199 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.744810:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.744810:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.744811:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c52b3b lrc: 4/0,1 mode: --/PW res: [0x2ba85:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.744860:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d7827fc7/0x3234de053c4f231 lrc: 3/0,0 mode: PR/PR res: [0x2ba85:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b7d expref: 199 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.744864:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d7827fc7/0x3234de053c4f231 lrc: 4/0,0 mode: PR/PR res: [0x2ba85:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b7d expref: 199 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.744891:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005d3fb3ef pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997058624:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.744900:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000003ad73843 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.744907:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f39ca9ea pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997058176:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.744911:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c52b0a lrc: 3/0,1 mode: --/PW res: [0x2ba7e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.744928:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001d1586f2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997058304:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.744930:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c52b18 lrc: 3/0,1 mode: --/PW res: [0x2ba82:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.744952:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.744952:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002f363f4a pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997058432:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.744955:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c52b26 lrc: 3/0,1 mode: --/PW res: [0x2ba81:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.744960:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.744968:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.744968:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396419648 00010000:00010000:0.0:1651529344.744974:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000652f2444/0x3234de053c4b5ca lrc: 5/0,0 mode: PR/PR res: [0x2ba80:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc2c1 expref: 200 pid: 151609 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.744975:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.744979:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396419776 00000100:00100000:1.0:1651529344.744982:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.744982:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a0f055f1/0x3234de053c4ce9e lrc: 4/0,0 mode: PR/PR res: [0x2ba82:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec74 expref: 201 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.744986:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396419904 00010000:00010000:0.0:1651529344.744988:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001cae1e96/0x3234de053c4ed37 lrc: 4/0,0 mode: PR/PR res: [0x2ba81:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d66ae expref: 202 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.744990:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000264aecf8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997058240:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.744992:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396419712 00010000:00010000:0.0:1651529344.744995:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001f1d421b/0x3234de053c4a991 lrc: 4/0,0 mode: PR/PR res: [0x2ba7e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd1f expref: 203 pid: 80276 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.744996:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52b11 lrc: 3/0,1 mode: --/PW res: [0x2ba80:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.744999:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396419840 00010000:00010000:0.0:1651529344.745001:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cf3292c2/0x3234de053c4c751 lrc: 5/0,0 mode: PR/PR res: [0x2ba7f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf94 expref: 204 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.745003:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd68fdd5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997058368:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.745006:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52b1f lrc: 3/0,1 mode: --/PW res: [0x2ba7f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.745006:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13148 00000100:00100000:0.0:1651529344.745008:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+204:41278:x1731746396419648:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.745010:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.745012:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13149 00010000:00010000:0.0:1651529344.745012:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000652f2444/0x3234de053c4b5ca lrc: 4/0,0 mode: PR/PR res: [0x2ba80:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc2c1 expref: 204 pid: 151609 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.745014:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040f63b09 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+204:41278:x1731746396419776:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.745015:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000652f2444/0x3234de053c4b5ca lrc: 3/0,0 mode: PR/PR res: [0x2ba80:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc2c1 expref: 204 pid: 151609 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.745018:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.745019:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a0f055f1/0x3234de053c4ce9e lrc: 4/0,0 mode: PR/PR res: [0x2ba82:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec74 expref: 204 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.745023:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a0f055f1/0x3234de053c4ce9e lrc: 3/0,0 mode: PR/PR res: [0x2ba82:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec74 expref: 204 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.745029:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0f055f1/0x3234de053c4ce9e lrc: 0/0,0 mode: --/PR res: [0x2ba82:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec74 expref: 204 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.745032:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.745033:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.745034:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c52b18 lrc: 3/0,1 mode: PW/PW res: [0x2ba82:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.745037:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c52b18 lrc: 4/0,1 mode: PW/PW res: [0x2ba82:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745039:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000652f2444/0x3234de053c4b5ca lrc: 0/0,0 mode: --/PR res: [0x2ba80:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc2c1 expref: 203 pid: 151609 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.745049:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.745058:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040f63b09 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+202:41278:x1731746396419776:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 43us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.745060:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13149 00010000:00010000:0.0:1651529344.745060:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.745061:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.745062:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52b11 lrc: 3/0,1 mode: PW/PW res: [0x2ba80:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745065:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52b11 lrc: 4/0,1 mode: PW/PW res: [0x2ba80:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.745066:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13150 00000100:00100000:1.0:1651529344.745067:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+201:41278:x1731746396419904:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.745070:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.745072:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001cae1e96/0x3234de053c4ed37 lrc: 4/0,0 mode: PR/PR res: [0x2ba81:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d66ae expref: 201 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.745075:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.745082:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001cae1e96/0x3234de053c4ed37 lrc: 3/0,0 mode: PR/PR res: [0x2ba81:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d66ae expref: 201 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.745083:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+201:41278:x1731746396419648:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 75us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.745086:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13148 00010000:00010000:1.0:1651529344.745087:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cae1e96/0x3234de053c4ed37 lrc: 0/0,0 mode: --/PR res: [0x2ba81:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d66ae expref: 201 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.745090:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.745091:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.745092:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c52b26 lrc: 3/0,1 mode: PW/PW res: [0x2ba81:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.745095:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c52b26 lrc: 4/0,1 mode: PW/PW res: [0x2ba81:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.745095:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13151 00000100:00100000:0.0:1651529344.745097:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+199:41279:x1731746396419712:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.745100:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.745103:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.745108:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001f1d421b/0x3234de053c4a991 lrc: 4/0,0 mode: PR/PR res: [0x2ba7e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd1f expref: 199 pid: 80276 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.745109:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+199:41278:x1731746396419904:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 41us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.745112:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13150 00010000:00010000:0.0:1651529344.745112:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001f1d421b/0x3234de053c4a991 lrc: 3/0,0 mode: PR/PR res: [0x2ba7e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd1f expref: 199 pid: 80276 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.745117:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13152 00010000:00010000:0.0:1651529344.745117:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f1d421b/0x3234de053c4a991 lrc: 0/0,0 mode: --/PR res: [0x2ba7e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd1f expref: 198 pid: 80276 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.745119:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+198:41279:x1731746396419840:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.745120:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.745121:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.745121:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.745122:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cf3292c2/0x3234de053c4c751 lrc: 4/0,0 mode: PR/PR res: [0x2ba7f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf94 expref: 197 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.745122:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c52b0a lrc: 3/0,1 mode: PW/PW res: [0x2ba7e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745125:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c52b0a lrc: 4/0,1 mode: PW/PW res: [0x2ba7e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.745126:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cf3292c2/0x3234de053c4c751 lrc: 3/0,0 mode: PR/PR res: [0x2ba7f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf94 expref: 197 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.745130:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.745131:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf3292c2/0x3234de053c4c751 lrc: 0/0,0 mode: --/PR res: [0x2ba7f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccf94 expref: 197 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.745134:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.745135:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.745136:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52b1f lrc: 3/0,1 mode: PW/PW res: [0x2ba7f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.745136:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+196:41279:x1731746396419712:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 39us (161us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.745138:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52b1f lrc: 4/0,1 mode: PW/PW res: [0x2ba7f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.745144:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.745149:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+196:41279:x1731746396419840:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 30us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.745151:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13151 00000100:00100000:1.0:1651529344.745153:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13152 00010000:00010000:0.0:1651529344.745159:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c52b18 lrc: 3/0,1 mode: PW/PW res: [0x2ba82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.745160:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52b1f lrc: 3/0,1 mode: PW/PW res: [0x2ba7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745162:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c52b18 lrc: 3/0,1 mode: PW/PW res: [0x2ba82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.745163:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52b1f lrc: 3/0,1 mode: PW/PW res: [0x2ba7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.745167:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52b1f lrc: 3/0,1 mode: PW/PW res: [0x2ba7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745168:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c52b18 lrc: 3/0,1 mode: PW/PW res: [0x2ba82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.745169:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52b1f lrc: 2/0,0 mode: PW/PW res: [0x2ba7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745171:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c52b18 lrc: 2/0,0 mode: PW/PW res: [0x2ba82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.745211:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1869:39030:x1731745946538560:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 897us (1066us total) trans 12885080421 rc 0/0 00000100:00100000:1.0:1651529344.745214:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212369 00010000:00010000:1.0:1651529344.745220:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52b11 lrc: 3/0,1 mode: PW/PW res: [0x2ba80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.745220:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1868:39030:x1731745946538752:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 945us (1087us total) trans 12885080422 rc 0/0 00010000:00010000:1.0:1651529344.745235:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52b11 lrc: 3/0,1 mode: PW/PW res: [0x2ba80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.745240:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212368 00010000:00010000:0.0:1651529344.745248:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52b1f lrc: 2/0,0 mode: PW/PW res: [0x2ba7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.745249:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52b11 lrc: 3/0,1 mode: PW/PW res: [0x2ba80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745251:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000048ee8765 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.745252:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52b11 lrc: 2/0,0 mode: PW/PW res: [0x2ba80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745252:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52b1f lrc: 2/0,0 mode: PW/PW res: [0x2ba7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745256:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52b1f lrc: 3/0,0 mode: PW/PW res: [0x2ba7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745261:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52b1f lrc: 1/0,0 mode: --/PW res: [0x2ba7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745263:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52b1f lrc: 0/0,0 mode: --/PW res: [0x2ba7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745268:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c52b18 lrc: 2/0,0 mode: PW/PW res: [0x2ba82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745271:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d37a9fd1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.745272:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c52b18 lrc: 2/0,0 mode: PW/PW res: [0x2ba82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745275:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c52b18 lrc: 3/0,0 mode: PW/PW res: [0x2ba82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745278:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c52b18 lrc: 1/0,0 mode: --/PW res: [0x2ba82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745280:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c52b18 lrc: 0/0,0 mode: --/PW res: [0x2ba82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745284:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52b11 lrc: 2/0,0 mode: PW/PW res: [0x2ba80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745286:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c5599f68 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.745287:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1868:39030:x1731745946538624:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1021us (1162us total) trans 12885080423 rc 0/0 00010000:00010000:0.0:1651529344.745287:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52b11 lrc: 2/0,0 mode: PW/PW res: [0x2ba80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745290:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52b11 lrc: 3/0,0 mode: PW/PW res: [0x2ba80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.745291:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212367 00010000:00010000:0.0:1651529344.745293:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52b11 lrc: 1/0,0 mode: --/PW res: [0x2ba80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745295:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52b11 lrc: 0/0,0 mode: --/PW res: [0x2ba80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745301:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c52b26 lrc: 3/0,1 mode: PW/PW res: [0x2ba81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745304:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c52b26 lrc: 3/0,1 mode: PW/PW res: [0x2ba81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745307:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c52b26 lrc: 3/0,1 mode: PW/PW res: [0x2ba81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745310:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c52b26 lrc: 2/0,0 mode: PW/PW res: [0x2ba81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.745354:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1868:39030:x1731745946538688:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1034us (1202us total) trans 12885080424 rc 0/0 00000100:00100000:0.0:1651529344.745363:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212370 00000100:00100000:1.0:1651529344.745365:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.745370:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c52b0a lrc: 3/0,1 mode: PW/PW res: [0x2ba7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745373:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c52b0a lrc: 3/0,1 mode: PW/PW res: [0x2ba7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.745374:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.745376:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c52b0a lrc: 3/0,1 mode: PW/PW res: [0x2ba7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745378:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c52b0a lrc: 2/0,0 mode: PW/PW res: [0x2ba7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.745383:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.745412:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1868:39030:x1731745946538496:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1217us (1306us total) trans 12885080425 rc 0/0 00000100:00100000:0.0:1651529344.745415:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212366 00010000:00010000:0.0:1651529344.745421:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c52b26 lrc: 2/0,0 mode: PW/PW res: [0x2ba81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745424:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a032e9d0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.745425:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c52b26 lrc: 2/0,0 mode: PW/PW res: [0x2ba81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745428:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c52b26 lrc: 3/0,0 mode: PW/PW res: [0x2ba81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745432:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c52b26 lrc: 1/0,0 mode: --/PW res: [0x2ba81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745435:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c52b26 lrc: 0/0,0 mode: --/PW res: [0x2ba81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745439:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c52b0a lrc: 2/0,0 mode: PW/PW res: [0x2ba7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745441:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000215144f2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.745442:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c52b0a lrc: 2/0,0 mode: PW/PW res: [0x2ba7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745447:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c52b0a lrc: 3/0,0 mode: PW/PW res: [0x2ba7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745450:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c52b0a lrc: 1/0,0 mode: --/PW res: [0x2ba7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745453:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c52b0a lrc: 0/0,0 mode: --/PW res: [0x2ba7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.745462:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000027e31dd1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997058560:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.745467:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52b34 lrc: 3/0,1 mode: --/PW res: [0x2ba83:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.745474:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396419968 00010000:00010000:1.0:1651529344.745479:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c4cc3d lrc: 5/0,0 mode: PR/PR res: [0x2ba84:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce295 expref: 195 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.745489:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396420096 00010000:00010000:1.0:1651529344.745492:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d7827fc7/0x3234de053c4f231 lrc: 5/0,0 mode: PR/PR res: [0x2ba85:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b7d expref: 196 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.745496:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396420032 00000100:00100000:0.0:1651529344.745497:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002f77bb41 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997058496:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.745498:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f6cd1dd7/0x3234de053c4dcf9 lrc: 4/0,0 mode: PR/PR res: [0x2ba83:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2490 expref: 197 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.745501:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c52b2d lrc: 3/0,1 mode: --/PW res: [0x2ba84:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.745503:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13153 00000100:00100000:1.0:1651529344.745504:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+197:41279:x1731746396419968:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.745507:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.745508:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c4cc3d lrc: 4/0,0 mode: PR/PR res: [0x2ba84:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce295 expref: 197 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.745509:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005d3fb3ef pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997058624:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.745512:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c52b3b lrc: 3/0,1 mode: --/PW res: [0x2ba85:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.745515:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c4cc3d lrc: 3/0,0 mode: PR/PR res: [0x2ba84:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce295 expref: 197 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.745518:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13154 00010000:00010000:1.0:1651529344.745520:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c4cc3d lrc: 0/0,0 mode: --/PR res: [0x2ba84:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce295 expref: 197 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.745520:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+197:41279:x1731746396420096:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.745523:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.745524:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.745525:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.745525:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d7827fc7/0x3234de053c4f231 lrc: 4/0,0 mode: PR/PR res: [0x2ba85:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b7d expref: 196 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.745526:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c52b2d lrc: 3/0,1 mode: PW/PW res: [0x2ba84:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.745529:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c52b2d lrc: 4/0,1 mode: PW/PW res: [0x2ba84:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745529:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d7827fc7/0x3234de053c4f231 lrc: 3/0,0 mode: PR/PR res: [0x2ba85:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b7d expref: 196 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.745534:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7827fc7/0x3234de053c4f231 lrc: 0/0,0 mode: --/PR res: [0x2ba85:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7b7d expref: 196 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.745537:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.745544:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.745545:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.745546:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+195:41279:x1731746396419968:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (182us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.745546:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c52b3b lrc: 3/0,1 mode: PW/PW res: [0x2ba85:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.745549:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13153 00010000:00010000:0.0:1651529344.745549:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c52b3b lrc: 4/0,1 mode: PW/PW res: [0x2ba85:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.745553:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13155 00000100:00100000:1.0:1651529344.745555:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+194:41278:x1731746396420032:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.745555:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.745557:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.745559:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f6cd1dd7/0x3234de053c4dcf9 lrc: 4/0,0 mode: PR/PR res: [0x2ba83:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2490 expref: 194 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.745562:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+194:41279:x1731746396420096:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (188us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.745563:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f6cd1dd7/0x3234de053c4dcf9 lrc: 3/0,0 mode: PR/PR res: [0x2ba83:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2490 expref: 194 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.745565:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13154 00010000:00010000:1.0:1651529344.745568:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6cd1dd7/0x3234de053c4dcf9 lrc: 0/0,0 mode: --/PR res: [0x2ba83:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2490 expref: 194 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.745571:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.745572:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.745572:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52b34 lrc: 3/0,1 mode: PW/PW res: [0x2ba83:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.745575:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52b34 lrc: 4/0,1 mode: PW/PW res: [0x2ba83:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.745580:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.745585:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+193:41278:x1731746396420032:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 29us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.745587:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13155 00010000:00010000:1.0:1651529344.745593:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52b34 lrc: 3/0,1 mode: PW/PW res: [0x2ba83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745594:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c52b2d lrc: 3/0,1 mode: PW/PW res: [0x2ba84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.745596:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52b34 lrc: 3/0,1 mode: PW/PW res: [0x2ba83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745598:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c52b2d lrc: 3/0,1 mode: PW/PW res: [0x2ba84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.745599:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52b34 lrc: 3/0,1 mode: PW/PW res: [0x2ba83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745601:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c52b2d lrc: 3/0,1 mode: PW/PW res: [0x2ba84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.745602:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52b34 lrc: 2/0,0 mode: PW/PW res: [0x2ba83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745604:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c52b2d lrc: 2/0,0 mode: PW/PW res: [0x2ba84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.745641:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1869:39030:x1731745946538816:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 890us (950us total) trans 12885080426 rc 0/0 00000100:00100000:1.0:1651529344.745644:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212372 00000100:00100000:0.0:1651529344.745645:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1869:39030:x1731745946538880:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 911us (963us total) trans 12885080427 rc 0/0 00000100:00100000:0.0:1651529344.745648:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212371 00010000:00010000:1.0:1651529344.745651:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52b34 lrc: 2/0,0 mode: PW/PW res: [0x2ba83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.745654:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fc4c513 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.745655:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52b34 lrc: 2/0,0 mode: PW/PW res: [0x2ba83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745655:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c52b2d lrc: 2/0,0 mode: PW/PW res: [0x2ba84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.745658:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52b34 lrc: 3/0,0 mode: PW/PW res: [0x2ba83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745658:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000f18bca1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.745659:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c52b2d lrc: 2/0,0 mode: PW/PW res: [0x2ba84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.745662:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52b34 lrc: 1/0,0 mode: --/PW res: [0x2ba83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745662:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c52b2d lrc: 3/0,0 mode: PW/PW res: [0x2ba84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.745665:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52b34 lrc: 0/0,0 mode: --/PW res: [0x2ba83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745667:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c52b2d lrc: 1/0,0 mode: --/PW res: [0x2ba84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745669:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c52b2d lrc: 0/0,0 mode: --/PW res: [0x2ba84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745674:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c52b3b lrc: 3/0,1 mode: PW/PW res: [0x2ba85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745677:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c52b3b lrc: 3/0,1 mode: PW/PW res: [0x2ba85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745680:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c52b3b lrc: 3/0,1 mode: PW/PW res: [0x2ba85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745683:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c52b3b lrc: 2/0,0 mode: PW/PW res: [0x2ba85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.745699:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.745716:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.745727:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1868:39029:x1731745946538944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 930us (1014us total) trans 12885080428 rc 0/0 00000100:00100000:1.0:1651529344.745729:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.745730:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212373 00000100:00100000:1.0:1651529344.745748:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.745756:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946539072 00000100:00100000:1.0:1651529344.745760:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.745773:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946539200 00000100:00100000:0.0:1651529344.745779:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946539008 00000100:00100000:0.0:1651529344.745785:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946539136 00000100:00100000:0.0:1651529344.745790:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946539264 00000100:00100000:0.0:1651529344.745796:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212374 00000100:00100000:0.0:1651529344.745797:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1872:39029:x1731745946539072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.745802:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178823 count 1 00010000:00010000:0.0:1651529344.745806:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c52b42 lrc: 3/0,1 mode: --/PW res: [0x2ba87:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745811:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000831fd1e9/0x3234de053c4a0a7 lrc: 2/0,0 mode: PR/PR res: [0x2ba87:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb841 expref: 191 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.745814:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.745815:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.745815:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c52b42 lrc: 4/0,1 mode: --/PW res: [0x2ba87:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745822:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000831fd1e9/0x3234de053c4a0a7 lrc: 3/0,0 mode: PR/PR res: [0x2ba87:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb841 expref: 191 pid: 72397 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.745827:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212375 00010000:00010000:0.0:1651529344.745828:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000831fd1e9/0x3234de053c4a0a7 lrc: 4/0,0 mode: PR/PR res: [0x2ba87:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb841 expref: 191 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.745829:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1872:39029:x1731745946539200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.745833:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005d3fb3ef pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997058688:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.745835:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178825 count 1 00010000:00010000:1.0:1651529344.745839:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52b49 lrc: 3/0,1 mode: --/PW res: [0x2ba89:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.745844:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007a00d597/0x3234de053c4dbe1 lrc: 2/0,0 mode: PR/PR res: [0x2ba89:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f96 expref: 191 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.745846:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000000a4def41 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.745852:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c52b3b lrc: 2/0,0 mode: PW/PW res: [0x2ba85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.745853:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.745854:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.745855:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52b49 lrc: 4/0,1 mode: --/PW res: [0x2ba89:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745855:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002d7487dc already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.745856:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c52b3b lrc: 2/0,0 mode: PW/PW res: [0x2ba85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745859:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c52b3b lrc: 3/0,0 mode: PW/PW res: [0x2ba85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.745862:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007a00d597/0x3234de053c4dbe1 lrc: 3/0,0 mode: PR/PR res: [0x2ba89:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f96 expref: 191 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.745866:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007a00d597/0x3234de053c4dbe1 lrc: 4/0,0 mode: PR/PR res: [0x2ba89:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f96 expref: 191 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.745870:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000088fa78f8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997058752:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.745878:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c52b3b lrc: 1/0,0 mode: --/PW res: [0x2ba85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.745879:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000babe2d90 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.745882:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c52b3b lrc: 0/0,0 mode: --/PW res: [0x2ba85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.745885:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212376 00000100:00100000:1.0:1651529344.745887:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000650a05a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1872:39029:x1731745946539008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.745891:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178822 count 1 00000100:00100000:0.0:1651529344.745891:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212377 00000100:00100000:0.0:1651529344.745893:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1872:39029:x1731745946539136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.745895:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52b50 lrc: 3/0,1 mode: --/PW res: [0x2ba86:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.745898:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178824 count 1 00010000:00010000:1.0:1651529344.745899:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000043afb435/0x3234de053c49f88 lrc: 2/0,0 mode: PR/PR res: [0x2ba86:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb497 expref: 191 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.745900:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c52b57 lrc: 3/0,1 mode: --/PW res: [0x2ba88:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.745902:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.745903:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.745903:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52b50 lrc: 4/0,1 mode: --/PW res: [0x2ba86:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.745905:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000026e18d60/0x3234de053c4e19f lrc: 2/0,0 mode: PR/PR res: [0x2ba88:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d37ad expref: 191 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.745908:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.745909:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000043afb435/0x3234de053c49f88 lrc: 3/0,0 mode: PR/PR res: [0x2ba86:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb497 expref: 191 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.745909:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.745909:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c52b57 lrc: 4/0,1 mode: --/PW res: [0x2ba88:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.745913:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000043afb435/0x3234de053c49f88 lrc: 4/0,0 mode: PR/PR res: [0x2ba86:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb497 expref: 191 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.745915:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000026e18d60/0x3234de053c4e19f lrc: 3/0,0 mode: PR/PR res: [0x2ba88:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d37ad expref: 191 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.745916:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000065f5e47d pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997058816:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.745919:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000026e18d60/0x3234de053c4e19f lrc: 4/0,0 mode: PR/PR res: [0x2ba88:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d37ad expref: 191 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.745922:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cfa1ca05 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.745923:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002f77bb41 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997058880:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.745928:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212378 00000100:00100000:1.0:1651529344.745930:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1872:39029:x1731745946539264:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.745931:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e1aa6a77 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.745934:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178826 count 1 00010000:00010000:1.0:1651529344.745937:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52b5e lrc: 3/0,1 mode: --/PW res: [0x2ba8a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.745941:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d90c7ffd/0x3234de053c4a0d1 lrc: 2/0,0 mode: PR/PR res: [0x2ba8a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb8aa expref: 191 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.745944:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.745944:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.745945:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52b5e lrc: 4/0,1 mode: --/PW res: [0x2ba8a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.745953:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d90c7ffd/0x3234de053c4a0d1 lrc: 3/0,0 mode: PR/PR res: [0x2ba8a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb8aa expref: 191 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.745956:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d90c7ffd/0x3234de053c4a0d1 lrc: 4/0,0 mode: PR/PR res: [0x2ba8a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb8aa expref: 191 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.745960:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c9f4ec84 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997058944:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.745966:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.745972:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.745998:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946539328 00000100:00100000:0.0:1651529344.746006:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.746034:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946539392 00000100:00100000:1.0:1651529344.746043:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212379 00000100:00100000:1.0:1651529344.746044:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1874:39029:x1731745946539328:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.746049:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178827 count 1 00010000:00010000:1.0:1651529344.746053:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52b65 lrc: 3/0,1 mode: --/PW res: [0x2ba8b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.746063:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006289e696/0x3234de053c4ea04 lrc: 2/0,0 mode: PR/PR res: [0x2ba8b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d599c expref: 191 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.746066:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.746067:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.746067:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212380 00010000:00010000:1.0:1651529344.746068:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52b65 lrc: 4/0,1 mode: --/PW res: [0x2ba8b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.746069:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1874:39029:x1731745946539392:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.746074:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006289e696/0x3234de053c4ea04 lrc: 3/0,0 mode: PR/PR res: [0x2ba8b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d599c expref: 191 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.746075:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178828 count 1 00010000:00010000:0.0:1651529344.746079:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c52b6c lrc: 3/0,1 mode: --/PW res: [0x2ba8c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.746080:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006289e696/0x3234de053c4ea04 lrc: 4/0,0 mode: PR/PR res: [0x2ba8b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d599c expref: 191 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.746083:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000015595898/0x3234de053c4edca lrc: 2/0,0 mode: PR/PR res: [0x2ba8c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6978 expref: 191 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.746084:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bc420ca1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997059008:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.746089:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.746089:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.746090:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c52b6c lrc: 4/0,1 mode: --/PW res: [0x2ba8c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.746097:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 0000000057299e7f going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.746105:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000015595898/0x3234de053c4edca lrc: 3/0,0 mode: PR/PR res: [0x2ba8c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6978 expref: 191 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.746109:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000015595898/0x3234de053c4edca lrc: 4/0,0 mode: PR/PR res: [0x2ba8c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6978 expref: 191 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.746113:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.746113:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bca72234 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997059072:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.746122:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c2b2b59c going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.746162:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946539456 00000100:00100000:1.0:1651529344.746170:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212381 00000100:00100000:1.0:1651529344.746172:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a13808c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1875:39030:x1731745946539456:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.746177:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178829 count 1 00010000:00010000:1.0:1651529344.746181:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52b73 lrc: 3/0,1 mode: --/PW res: [0x2ba8d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.746185:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000be73e774/0x3234de053c4d703 lrc: 2/0,0 mode: PR/PR res: [0x2ba8d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0dc2 expref: 191 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.746188:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.746189:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.746190:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52b73 lrc: 4/0,1 mode: --/PW res: [0x2ba8d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.746196:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000be73e774/0x3234de053c4d703 lrc: 3/0,0 mode: PR/PR res: [0x2ba8d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0dc2 expref: 191 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.746199:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000be73e774/0x3234de053c4d703 lrc: 4/0,0 mode: PR/PR res: [0x2ba8d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0dc2 expref: 191 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.746206:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a223a622 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997059136:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.746239:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f79d8146 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.746553:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005d3fb3ef pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997058688:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.746558:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c52b42 lrc: 3/0,1 mode: --/PW res: [0x2ba87:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.746580:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002f77bb41 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997058880:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.746583:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c52b57 lrc: 3/0,1 mode: --/PW res: [0x2ba88:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.746585:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.746592:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.746598:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.746606:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.746606:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396420160 00010000:00010000:0.0:1651529344.746611:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000831fd1e9/0x3234de053c4a0a7 lrc: 4/0,0 mode: PR/PR res: [0x2ba87:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb841 expref: 192 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.746612:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.746620:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396420224 00010000:00010000:0.0:1651529344.746628:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007a00d597/0x3234de053c4dbe1 lrc: 5/0,0 mode: PR/PR res: [0x2ba89:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f96 expref: 193 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.746630:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.746633:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396420288 00000100:00100000:1.0:1651529344.746635:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.746636:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000043afb435/0x3234de053c49f88 lrc: 5/0,0 mode: PR/PR res: [0x2ba86:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb497 expref: 194 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.746640:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396420352 00000100:00100000:1.0:1651529344.746642:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.746642:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000026e18d60/0x3234de053c4e19f lrc: 4/0,0 mode: PR/PR res: [0x2ba88:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d37ad expref: 195 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.746646:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396420416 00010000:00010000:0.0:1651529344.746648:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d90c7ffd/0x3234de053c4a0d1 lrc: 5/0,0 mode: PR/PR res: [0x2ba8a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb8aa expref: 196 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.746650:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000088fa78f8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997058752:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.746652:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396420544 00010000:00010000:0.0:1651529344.746654:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000015595898/0x3234de053c4edca lrc: 5/0,0 mode: PR/PR res: [0x2ba8c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6978 expref: 197 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.746655:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52b49 lrc: 3/0,1 mode: --/PW res: [0x2ba89:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.746658:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396420480 00010000:00010000:0.0:1651529344.746660:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006289e696/0x3234de053c4ea04 lrc: 5/0,0 mode: PR/PR res: [0x2ba8b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d599c expref: 198 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.746662:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000065f5e47d pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997058816:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.746664:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52b50 lrc: 3/0,1 mode: --/PW res: [0x2ba86:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.746664:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396420608 00010000:00010000:0.0:1651529344.746666:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000be73e774/0x3234de053c4d703 lrc: 5/0,0 mode: PR/PR res: [0x2ba8d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0dc2 expref: 199 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.746670:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c9f4ec84 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997058944:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.746673:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52b5e lrc: 3/0,1 mode: --/PW res: [0x2ba8a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.746673:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13156 00000100:00100000:0.0:1651529344.746675:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a253639 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+199:41278:x1731746396420160:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.746678:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.746679:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13157 00010000:00010000:0.0:1651529344.746679:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000831fd1e9/0x3234de053c4a0a7 lrc: 4/0,0 mode: PR/PR res: [0x2ba87:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb841 expref: 199 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.746681:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+199:41279:x1731746396420224:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.746682:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000831fd1e9/0x3234de053c4a0a7 lrc: 3/0,0 mode: PR/PR res: [0x2ba87:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb841 expref: 199 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.746685:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.746686:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007a00d597/0x3234de053c4dbe1 lrc: 4/0,0 mode: PR/PR res: [0x2ba89:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f96 expref: 199 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.746688:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000831fd1e9/0x3234de053c4a0a7 lrc: 0/0,0 mode: --/PR res: [0x2ba87:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb841 expref: 199 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.746690:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007a00d597/0x3234de053c4dbe1 lrc: 3/0,0 mode: PR/PR res: [0x2ba89:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f96 expref: 199 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.746692:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.746693:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.746694:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c52b42 lrc: 3/0,1 mode: PW/PW res: [0x2ba87:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.746696:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a00d597/0x3234de053c4dbe1 lrc: 0/0,0 mode: --/PR res: [0x2ba89:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1f96 expref: 198 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.746697:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c52b42 lrc: 4/0,1 mode: PW/PW res: [0x2ba87:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.746700:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.746700:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.746701:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52b49 lrc: 3/0,1 mode: PW/PW res: [0x2ba89:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.746703:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.746704:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52b49 lrc: 4/0,1 mode: PW/PW res: [0x2ba89:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.746710:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.746712:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a253639 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+197:41278:x1731746396420160:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 37us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.746715:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13156 00000100:00100000:1.0:1651529344.746717:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+196:41279:x1731746396420224:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 35us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.746720:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13157 00000100:00100000:0.0:1651529344.746723:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13158 00000100:00100000:0.0:1651529344.746725:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+195:41278:x1731746396420288:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.746726:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13159 00000100:00100000:1.0:1651529344.746727:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+195:41279:x1731746396420352:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.746728:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.746730:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.746730:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000043afb435/0x3234de053c49f88 lrc: 4/0,0 mode: PR/PR res: [0x2ba86:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb497 expref: 195 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.746732:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000026e18d60/0x3234de053c4e19f lrc: 4/0,0 mode: PR/PR res: [0x2ba88:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d37ad expref: 195 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.746733:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000043afb435/0x3234de053c49f88 lrc: 3/0,0 mode: PR/PR res: [0x2ba86:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb497 expref: 195 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.746748:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000026e18d60/0x3234de053c4e19f lrc: 3/0,0 mode: PR/PR res: [0x2ba88:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d37ad expref: 195 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.746750:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043afb435/0x3234de053c49f88 lrc: 0/0,0 mode: --/PR res: [0x2ba86:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb497 expref: 195 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.746753:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026e18d60/0x3234de053c4e19f lrc: 0/0,0 mode: --/PR res: [0x2ba88:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d37ad expref: 195 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.746754:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.746755:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.746756:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52b50 lrc: 3/0,1 mode: PW/PW res: [0x2ba86:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.746757:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.746757:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.746758:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c52b57 lrc: 3/0,1 mode: PW/PW res: [0x2ba88:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.746759:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52b50 lrc: 4/0,1 mode: PW/PW res: [0x2ba86:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.746761:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c52b57 lrc: 4/0,1 mode: PW/PW res: [0x2ba88:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.746768:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.746777:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.746780:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+193:41278:x1731746396420288:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 54us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.746782:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13158 00000100:00100000:1.0:1651529344.746783:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+193:41279:x1731746396420352:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 55us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.746786:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13159 00000100:00100000:0.0:1651529344.746787:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13160 00000100:00100000:0.0:1651529344.746789:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+191:41278:x1731746396420416:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.746791:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13161 00010000:00010000:0.0:1651529344.746792:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.746793:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+191:41278:x1731746396420544:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.746793:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d90c7ffd/0x3234de053c4a0d1 lrc: 4/0,0 mode: PR/PR res: [0x2ba8a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb8aa expref: 191 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.746795:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.746797:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000015595898/0x3234de053c4edca lrc: 5/0,0 mode: PR/PR res: [0x2ba8c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6978 expref: 191 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.746800:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d90c7ffd/0x3234de053c4a0d1 lrc: 3/0,0 mode: PR/PR res: [0x2ba8a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb8aa expref: 191 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.746801:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000015595898/0x3234de053c4edca lrc: 4/0,0 mode: PR/PR res: [0x2ba8c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6978 expref: 191 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.746804:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d90c7ffd/0x3234de053c4a0d1 lrc: 0/0,0 mode: --/PR res: [0x2ba8a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb8aa expref: 191 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.746807:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.746807:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.746808:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c52b6c lrc: 3/0,1 mode: PW/PW res: [0x2ba8c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.746808:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.746808:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.746809:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52b5e lrc: 3/0,1 mode: PW/PW res: [0x2ba8a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.746811:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c52b6c lrc: 4/0,1 mode: PW/PW res: [0x2ba8c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.746812:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52b5e lrc: 4/0,1 mode: PW/PW res: [0x2ba8a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.746815:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.746821:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.746825:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+190:41278:x1731746396420544:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 25us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.746827:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+190:41278:x1731746396420416:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 37us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.746828:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13161 00000100:00100000:0.0:1651529344.746829:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13160 00000100:00100000:1.0:1651529344.746832:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13162 00000100:00100000:1.0:1651529344.746834:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+188:41278:x1731746396420480:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.746834:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13163 00010000:00010000:1.0:1651529344.746836:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.746836:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b8f0043c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+188:41278:x1731746396420608:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.746838:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006289e696/0x3234de053c4ea04 lrc: 5/0,0 mode: PR/PR res: [0x2ba8b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d599c expref: 188 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.746838:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.746840:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000be73e774/0x3234de053c4d703 lrc: 5/0,0 mode: PR/PR res: [0x2ba8d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0dc2 expref: 188 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.746841:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006289e696/0x3234de053c4ea04 lrc: 4/0,0 mode: PR/PR res: [0x2ba8b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d599c expref: 188 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.746843:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000be73e774/0x3234de053c4d703 lrc: 4/0,0 mode: PR/PR res: [0x2ba8d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0dc2 expref: 188 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.746846:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.746846:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.746847:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52b65 lrc: 3/0,1 mode: PW/PW res: [0x2ba8b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.746848:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.746849:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.746850:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52b65 lrc: 4/0,1 mode: PW/PW res: [0x2ba8b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.746850:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52b73 lrc: 3/0,1 mode: PW/PW res: [0x2ba8d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.746853:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52b73 lrc: 4/0,1 mode: PW/PW res: [0x2ba8d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.746855:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.746857:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.746860:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+188:41278:x1731746396420480:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 25us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.746861:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b8f0043c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+188:41278:x1731746396420608:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 24us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.746862:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13162 00000100:00100000:0.0:1651529344.746864:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13163 00010000:00010000:1.0:1651529344.746872:0:80279:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006289e696/0x3234de053c4ea04 lrc: 0/0,0 mode: --/PR res: [0x2ba8b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d599c expref: 186 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.746873:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c52b57 lrc: 3/0,1 mode: PW/PW res: [0x2ba88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.746876:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bc420ca1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997059008:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.746876:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c52b57 lrc: 3/0,1 mode: PW/PW res: [0x2ba88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.746879:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c52b57 lrc: 3/0,1 mode: PW/PW res: [0x2ba88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.746880:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52b65 lrc: 3/0,1 mode: PW/PW res: [0x2ba8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.746882:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c52b57 lrc: 2/0,0 mode: PW/PW res: [0x2ba88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.746883:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52b65 lrc: 3/0,1 mode: PW/PW res: [0x2ba8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.746886:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52b65 lrc: 3/0,1 mode: PW/PW res: [0x2ba8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.746895:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52b65 lrc: 3/0,1 mode: PW/PW res: [0x2ba8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.746898:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52b65 lrc: 2/0,0 mode: PW/PW res: [0x2ba8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.746936:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1877:39029:x1731745946539136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1043us (1188us total) trans 12885080429 rc 0/0 00000100:00100000:0.0:1651529344.746940:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212377 00010000:00010000:0.0:1651529344.746947:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c52b57 lrc: 2/0,0 mode: PW/PW res: [0x2ba88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.746949:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1876:39029:x1731745946539328:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 903us (977us total) trans 12885080430 rc 0/0 00010000:00010000:0.0:1651529344.746951:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001d04fb0a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.746952:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c52b57 lrc: 2/0,0 mode: PW/PW res: [0x2ba88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.746954:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212379 00010000:00010000:0.0:1651529344.746955:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c52b57 lrc: 3/0,0 mode: PW/PW res: [0x2ba88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.746959:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c52b57 lrc: 1/0,0 mode: --/PW res: [0x2ba88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.746962:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c52b57 lrc: 0/0,0 mode: --/PW res: [0x2ba88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.746964:0:80277:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be73e774/0x3234de053c4d703 lrc: 0/0,0 mode: --/PR res: [0x2ba8d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0dc2 expref: 185 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.746966:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52b65 lrc: 2/0,0 mode: PW/PW res: [0x2ba8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.746968:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a223a622 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997059136:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.746969:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000576f1f12 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.746970:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52b65 lrc: 2/0,0 mode: PW/PW res: [0x2ba8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.746971:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52b73 lrc: 3/0,1 mode: PW/PW res: [0x2ba8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.746973:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52b65 lrc: 3/0,0 mode: PW/PW res: [0x2ba8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.746974:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52b73 lrc: 3/0,1 mode: PW/PW res: [0x2ba8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.746976:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52b65 lrc: 1/0,0 mode: --/PW res: [0x2ba8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.746977:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52b73 lrc: 3/0,1 mode: PW/PW res: [0x2ba8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.746980:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52b73 lrc: 3/0,1 mode: PW/PW res: [0x2ba8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.746981:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52b65 lrc: 0/0,0 mode: --/PW res: [0x2ba8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.746983:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52b73 lrc: 2/0,0 mode: PW/PW res: [0x2ba8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.746996:0:72395:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015595898/0x3234de053c4edca lrc: 0/0,0 mode: --/PR res: [0x2ba8c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6978 expref: 184 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.747000:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bca72234 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997059072:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.747003:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c52b6c lrc: 3/0,1 mode: PW/PW res: [0x2ba8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.747007:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c52b6c lrc: 3/0,1 mode: PW/PW res: [0x2ba8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.747009:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c52b6c lrc: 3/0,1 mode: PW/PW res: [0x2ba8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.747012:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c52b6c lrc: 3/0,1 mode: PW/PW res: [0x2ba8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.747015:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c52b6c lrc: 2/0,0 mode: PW/PW res: [0x2ba8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.747024:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a13808c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1876:39030:x1731745946539456:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 851us (911us total) trans 12885080431 rc 0/0 00000100:00100000:1.0:1651529344.747026:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212381 00010000:00010000:1.0:1651529344.747033:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52b73 lrc: 2/0,0 mode: PW/PW res: [0x2ba8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.747039:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f183a40b already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.747040:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52b73 lrc: 2/0,0 mode: PW/PW res: [0x2ba8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.747043:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52b73 lrc: 3/0,0 mode: PW/PW res: [0x2ba8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.747047:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52b73 lrc: 1/0,0 mode: --/PW res: [0x2ba8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.747050:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52b73 lrc: 0/0,0 mode: --/PW res: [0x2ba8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.747051:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1876:39029:x1731745946539392:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 982us (1045us total) trans 12885080432 rc 0/0 00010000:00010000:1.0:1651529344.747054:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c52b6c lrc: 2/0,0 mode: PW/PW res: [0x2ba8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.747054:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212380 00010000:00010000:1.0:1651529344.747057:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f56810a1 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.747058:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c52b6c lrc: 2/0,0 mode: PW/PW res: [0x2ba8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.747061:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c52b6c lrc: 3/0,0 mode: PW/PW res: [0x2ba8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.747063:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c52b42 lrc: 3/0,1 mode: PW/PW res: [0x2ba87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.747064:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c52b6c lrc: 1/0,0 mode: --/PW res: [0x2ba8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.747066:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c52b42 lrc: 3/0,1 mode: PW/PW res: [0x2ba87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.747067:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c52b6c lrc: 0/0,0 mode: --/PW res: [0x2ba8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.747070:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c52b42 lrc: 3/0,1 mode: PW/PW res: [0x2ba87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.747072:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c52b42 lrc: 2/0,0 mode: PW/PW res: [0x2ba87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.747073:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52b5e lrc: 3/0,1 mode: PW/PW res: [0x2ba8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.747076:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52b5e lrc: 3/0,1 mode: PW/PW res: [0x2ba8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.747079:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52b5e lrc: 3/0,1 mode: PW/PW res: [0x2ba8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.747082:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52b5e lrc: 2/0,0 mode: PW/PW res: [0x2ba8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.747113:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1877:39029:x1731745946539072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1314us (1414us total) trans 12885080433 rc 0/0 00000100:00100000:0.0:1651529344.747116:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212374 00000100:00100000:1.0:1651529344.747120:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1876:39029:x1731745946539264:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1190us (1360us total) trans 12885080434 rc 0/0 00010000:00010000:0.0:1651529344.747122:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c52b42 lrc: 2/0,0 mode: PW/PW res: [0x2ba87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.747123:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212378 00010000:00010000:0.0:1651529344.747125:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ac14729e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.747126:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c52b42 lrc: 2/0,0 mode: PW/PW res: [0x2ba87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.747129:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c52b42 lrc: 3/0,0 mode: PW/PW res: [0x2ba87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.747130:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52b50 lrc: 3/0,1 mode: PW/PW res: [0x2ba86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.747133:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52b50 lrc: 3/0,1 mode: PW/PW res: [0x2ba86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.747133:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c52b42 lrc: 1/0,0 mode: --/PW res: [0x2ba87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.747136:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52b50 lrc: 3/0,1 mode: PW/PW res: [0x2ba86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.747139:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52b50 lrc: 2/0,0 mode: PW/PW res: [0x2ba86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.747139:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c52b42 lrc: 0/0,0 mode: --/PW res: [0x2ba87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.747143:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52b5e lrc: 2/0,0 mode: PW/PW res: [0x2ba8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.747145:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fafb79d3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.747146:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52b5e lrc: 2/0,0 mode: PW/PW res: [0x2ba8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.747149:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52b5e lrc: 3/0,0 mode: PW/PW res: [0x2ba8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.747152:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52b5e lrc: 1/0,0 mode: --/PW res: [0x2ba8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.747155:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52b5e lrc: 0/0,0 mode: --/PW res: [0x2ba8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.747158:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52b50 lrc: 2/0,0 mode: PW/PW res: [0x2ba86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.747161:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006401eb97 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.747162:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52b50 lrc: 2/0,0 mode: PW/PW res: [0x2ba86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.747167:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52b50 lrc: 3/0,0 mode: PW/PW res: [0x2ba86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.747170:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52b50 lrc: 1/0,0 mode: --/PW res: [0x2ba86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.747172:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000650a05a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1876:39029:x1731745946539008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1284us (1443us total) trans 12885080435 rc 0/0 00010000:00010000:0.0:1651529344.747172:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52b50 lrc: 0/0,0 mode: --/PW res: [0x2ba86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.747175:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212376 00010000:00010000:1.0:1651529344.747181:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52b49 lrc: 3/0,1 mode: PW/PW res: [0x2ba89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.747184:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52b49 lrc: 3/0,1 mode: PW/PW res: [0x2ba89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.747187:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52b49 lrc: 3/0,1 mode: PW/PW res: [0x2ba89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.747190:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52b49 lrc: 2/0,0 mode: PW/PW res: [0x2ba89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.747281:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52b49 lrc: 2/0,0 mode: PW/PW res: [0x2ba89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.747286:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004dda5a3f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.747286:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52b49 lrc: 2/0,0 mode: PW/PW res: [0x2ba89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.747292:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1876:39029:x1731745946539200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1446us (1559us total) trans 12885080436 rc 0/0 00000100:00100000:1.0:1651529344.747306:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212375 00010000:00010000:0.0:1651529344.747307:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52b49 lrc: 3/0,0 mode: PW/PW res: [0x2ba89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.747322:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52b49 lrc: 1/0,0 mode: --/PW res: [0x2ba89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.747326:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52b49 lrc: 0/0,0 mode: --/PW res: [0x2ba89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.747387:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.747400:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.747415:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946539520 00000100:00100000:1.0:1651529344.747422:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946539584 00000100:00100000:1.0:1651529344.747430:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212382 00000100:00100000:1.0:1651529344.747431:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1877:39030:x1731745946539520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.747434:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212383 00002000:00080000:1.0:1651529344.747436:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178830 count 1 00000100:00100000:0.0:1651529344.747436:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1877:39029:x1731745946539584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.747441:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52b7a lrc: 3/0,1 mode: --/PW res: [0x2ba8e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.747442:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178831 count 1 00010000:00010000:0.0:1651529344.747446:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c52b81 lrc: 3/0,1 mode: --/PW res: [0x2ba8f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.747448:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000735a60bc/0x3234de053c4ef2f lrc: 2/0,0 mode: PR/PR res: [0x2ba8e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ec6 expref: 183 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.747451:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.747452:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.747453:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52b7a lrc: 4/0,1 mode: --/PW res: [0x2ba8e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.747459:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000735a60bc/0x3234de053c4ef2f lrc: 3/0,0 mode: PR/PR res: [0x2ba8e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ec6 expref: 183 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.747463:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000735a60bc/0x3234de053c4ef2f lrc: 4/0,0 mode: PR/PR res: [0x2ba8e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ec6 expref: 183 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.747469:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000021ecd403/0x3234de053c49fdc lrc: 2/0,0 mode: PR/PR res: [0x2ba8f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb57e expref: 183 pid: 80281 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.747474:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997059200:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.747480:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.747481:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.747482:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c52b81 lrc: 4/0,1 mode: --/PW res: [0x2ba8f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.747488:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 000000004ca54b8a going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.747496:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000021ecd403/0x3234de053c49fdc lrc: 3/0,0 mode: PR/PR res: [0x2ba8f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb57e expref: 183 pid: 80281 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.747500:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000021ecd403/0x3234de053c49fdc lrc: 4/0,0 mode: PR/PR res: [0x2ba8f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb57e expref: 183 pid: 80281 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.747504:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dff6a73d pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997059264:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.747513:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000003003c8b0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.747521:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.747530:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.747535:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.747548:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946539648 00000100:00100000:1.0:1651529344.747551:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.747560:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946539776 00000100:00100000:1.0:1651529344.747562:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.747565:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946539904 00000100:00100000:0.0:1651529344.747568:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946539712 00000100:00100000:1.0:1651529344.747570:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.747572:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946539840 00000100:00100000:0.0:1651529344.747575:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946539968 00000100:00100000:1.0:1651529344.747577:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212384 00000100:00100000:1.0:1651529344.747579:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1883:39030:x1731745946539648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.747580:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212385 00000100:00100000:0.0:1651529344.747582:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1883:39030:x1731745946539776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.747585:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178832 count 1 00002000:00080000:0.0:1651529344.747587:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178834 count 1 00010000:00010000:1.0:1651529344.747589:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52b88 lrc: 3/0,1 mode: --/PW res: [0x2ba90:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.747591:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c52b8f lrc: 3/0,1 mode: --/PW res: [0x2ba92:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.747593:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009300c77b/0x3234de053c4e67d lrc: 2/0,0 mode: PR/PR res: [0x2ba90:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a99 expref: 183 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.747596:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a30bee33/0x3234de053c4cd47 lrc: 2/0,0 mode: PR/PR res: [0x2ba92:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce6fc expref: 183 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.747597:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.747597:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.747598:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52b88 lrc: 4/0,1 mode: --/PW res: [0x2ba90:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.747604:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009300c77b/0x3234de053c4e67d lrc: 3/0,0 mode: PR/PR res: [0x2ba90:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a99 expref: 183 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.747608:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009300c77b/0x3234de053c4e67d lrc: 4/0,0 mode: PR/PR res: [0x2ba90:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a99 expref: 183 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.747612:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000097928145 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997059328:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.747614:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.747615:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.747616:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c52b8f lrc: 4/0,1 mode: --/PW res: [0x2ba92:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.747626:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000057299e7f going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.747629:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a30bee33/0x3234de053c4cd47 lrc: 3/0,0 mode: PR/PR res: [0x2ba92:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce6fc expref: 183 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.747632:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212386 00010000:00010000:0.0:1651529344.747633:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a30bee33/0x3234de053c4cd47 lrc: 4/0,0 mode: PR/PR res: [0x2ba92:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce6fc expref: 183 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.747634:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1883:39030:x1731745946539904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.747638:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006e3eb319 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997059392:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.747639:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178836 count 1 00010000:00010000:1.0:1651529344.747642:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52b96 lrc: 3/0,1 mode: --/PW res: [0x2ba94:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.747646:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007bb75637/0x3234de053c4d1ca lrc: 2/0,0 mode: PR/PR res: [0x2ba94:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf8d7 expref: 183 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.747647:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060852af0 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.747649:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.747650:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.747651:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52b96 lrc: 4/0,1 mode: --/PW res: [0x2ba94:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.747653:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212387 00000100:00100000:0.0:1651529344.747654:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1883:39030:x1731745946539712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.747657:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007bb75637/0x3234de053c4d1ca lrc: 3/0,0 mode: PR/PR res: [0x2ba94:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf8d7 expref: 183 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.747659:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178833 count 1 00010000:00010000:1.0:1651529344.747660:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007bb75637/0x3234de053c4d1ca lrc: 4/0,0 mode: PR/PR res: [0x2ba94:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf8d7 expref: 183 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.747663:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c52b9d lrc: 3/0,1 mode: --/PW res: [0x2ba91:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.747664:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005b3c5aba pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997059456:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.747669:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ab56fe74/0x3234de053c4d3d7 lrc: 2/0,0 mode: PR/PR res: [0x2ba91:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d013c expref: 183 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.747671:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.747677:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212388 00000100:00100000:1.0:1651529344.747678:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1883:39030:x1731745946539840:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.747682:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178835 count 1 00010000:00010000:1.0:1651529344.747691:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52ba4 lrc: 3/0,1 mode: --/PW res: [0x2ba93:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.747692:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.747692:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.747693:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c52b9d lrc: 4/0,1 mode: --/PW res: [0x2ba91:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.747696:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001deecd9c/0x3234de053c4f1a5 lrc: 2/0,0 mode: PR/PR res: [0x2ba93:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d797e expref: 183 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.747699:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.747699:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.747700:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52ba4 lrc: 4/0,1 mode: --/PW res: [0x2ba93:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.747700:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ab56fe74/0x3234de053c4d3d7 lrc: 3/0,0 mode: PR/PR res: [0x2ba91:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d013c expref: 183 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.747704:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ab56fe74/0x3234de053c4d3d7 lrc: 4/0,0 mode: PR/PR res: [0x2ba91:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d013c expref: 183 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.747706:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001deecd9c/0x3234de053c4f1a5 lrc: 3/0,0 mode: PR/PR res: [0x2ba93:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d797e expref: 183 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.747708:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000075b025a pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997059520:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.747712:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001deecd9c/0x3234de053c4f1a5 lrc: 4/0,0 mode: PR/PR res: [0x2ba93:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d797e expref: 183 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.747716:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004089c807 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997059584:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.747716:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 0000000070e666f7 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.747722:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212389 00000100:00100000:1.0:1651529344.747723:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cfa1ca05 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.747724:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1883:39030:x1731745946539968:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.747728:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178837 count 1 00010000:00010000:0.0:1651529344.747754:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c52bab lrc: 3/0,1 mode: --/PW res: [0x2ba95:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.747759:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000053e0755a/0x3234de053c4d77a lrc: 2/0,0 mode: PR/PR res: [0x2ba95:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f74 expref: 183 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.747762:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.747763:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.747763:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c52bab lrc: 4/0,1 mode: --/PW res: [0x2ba95:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.747770:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000053e0755a/0x3234de053c4d77a lrc: 3/0,0 mode: PR/PR res: [0x2ba95:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f74 expref: 183 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.747774:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000053e0755a/0x3234de053c4d77a lrc: 4/0,0 mode: PR/PR res: [0x2ba95:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f74 expref: 183 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.747784:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ad6d0877 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997059648:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.747792:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000afe7ff7b going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.747795:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.747807:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dff6a73d pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997059264:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.747809:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.747812:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c52b81 lrc: 3/0,1 mode: --/PW res: [0x2ba8f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.747818:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396420672 00010000:00010000:0.0:1651529344.747823:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000735a60bc/0x3234de053c4ef2f lrc: 5/0,0 mode: PR/PR res: [0x2ba8e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ec6 expref: 184 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.747834:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396420736 00010000:00010000:0.0:1651529344.747836:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000021ecd403/0x3234de053c49fdc lrc: 4/0,0 mode: PR/PR res: [0x2ba8f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb57e expref: 185 pid: 80281 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.747844:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13164 00000100:00100000:0.0:1651529344.747846:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+185:41279:x1731746396420672:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.747849:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.747851:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000735a60bc/0x3234de053c4ef2f lrc: 5/0,0 mode: PR/PR res: [0x2ba8e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ec6 expref: 185 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.747854:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000735a60bc/0x3234de053c4ef2f lrc: 4/0,0 mode: PR/PR res: [0x2ba8e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ec6 expref: 185 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.747860:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.747860:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.747861:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52b7a lrc: 3/0,1 mode: PW/PW res: [0x2ba8e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.747864:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52b7a lrc: 4/0,1 mode: PW/PW res: [0x2ba8e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.747869:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.747879:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+185:41279:x1731746396420672:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 32us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.747882:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13164 00010000:00010000:1.0:1651529344.747889:0:72397:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000735a60bc/0x3234de053c4ef2f lrc: 0/0,0 mode: --/PR res: [0x2ba8e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6ec6 expref: 184 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.747894:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997059200:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.747898:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52b7a lrc: 3/0,1 mode: PW/PW res: [0x2ba8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.747901:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52b7a lrc: 3/0,1 mode: PW/PW res: [0x2ba8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.747902:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13165 00010000:00010000:1.0:1651529344.747904:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52b7a lrc: 3/0,1 mode: PW/PW res: [0x2ba8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.747904:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+183:41279:x1731746396420736:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.747907:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52b7a lrc: 3/0,1 mode: PW/PW res: [0x2ba8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.747907:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.747909:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000021ecd403/0x3234de053c49fdc lrc: 4/0,0 mode: PR/PR res: [0x2ba8f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb57e expref: 183 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.747910:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52b7a lrc: 2/0,0 mode: PW/PW res: [0x2ba8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.747912:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000021ecd403/0x3234de053c49fdc lrc: 3/0,0 mode: PR/PR res: [0x2ba8f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb57e expref: 183 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.747917:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021ecd403/0x3234de053c49fdc lrc: 0/0,0 mode: --/PR res: [0x2ba8f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb57e expref: 183 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.747928:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.747929:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.747929:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c52b81 lrc: 3/0,1 mode: PW/PW res: [0x2ba8f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.747933:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c52b81 lrc: 4/0,1 mode: PW/PW res: [0x2ba8f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.747939:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.747945:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+182:41279:x1731746396420736:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 40us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.747947:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13165 00000100:00100000:1.0:1651529344.747954:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1884:39030:x1731745946539520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 522us (587us total) trans 12885080437 rc 0/0 00010000:00010000:0.0:1651529344.747954:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52b7a lrc: 2/0,0 mode: PW/PW res: [0x2ba8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.747957:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212382 00010000:00010000:0.0:1651529344.747957:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000877aab61 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.747958:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52b7a lrc: 2/0,0 mode: PW/PW res: [0x2ba8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.747961:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52b7a lrc: 3/0,0 mode: PW/PW res: [0x2ba8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.747965:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52b7a lrc: 1/0,0 mode: --/PW res: [0x2ba8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.747967:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52b7a lrc: 0/0,0 mode: --/PW res: [0x2ba8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.747975:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c52b81 lrc: 3/0,1 mode: PW/PW res: [0x2ba8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.747978:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c52b81 lrc: 3/0,1 mode: PW/PW res: [0x2ba8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.747981:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c52b81 lrc: 3/0,1 mode: PW/PW res: [0x2ba8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.747984:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c52b81 lrc: 2/0,0 mode: PW/PW res: [0x2ba8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.748007:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c52b81 lrc: 2/0,0 mode: PW/PW res: [0x2ba8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.748011:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d1167ce5 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.748012:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c52b81 lrc: 2/0,0 mode: PW/PW res: [0x2ba8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.748015:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c52b81 lrc: 3/0,0 mode: PW/PW res: [0x2ba8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.748030:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c52b81 lrc: 1/0,0 mode: --/PW res: [0x2ba8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.748033:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c52b81 lrc: 0/0,0 mode: --/PW res: [0x2ba8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.748074:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.748083:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1884:39029:x1731745946539584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 646us (683us total) trans 12885080438 rc 0/0 00000100:00100000:0.0:1651529344.748087:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212383 00000100:00100000:0.0:1651529344.748098:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006e3eb319 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997059392:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.748102:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c52b8f lrc: 3/0,1 mode: --/PW res: [0x2ba92:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.748111:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.748121:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000097928145 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997059328:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.748125:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52b88 lrc: 3/0,1 mode: --/PW res: [0x2ba90:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.748131:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396420864 00000100:00100000:0.0:1651529344.748135:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.748136:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a30bee33/0x3234de053c4cd47 lrc: 4/0,0 mode: PR/PR res: [0x2ba92:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce6fc expref: 182 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.748142:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946540032 00000100:00100000:1.0:1651529344.748143:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396420800 00010000:00010000:1.0:1651529344.748145:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009300c77b/0x3234de053c4e67d lrc: 4/0,0 mode: PR/PR res: [0x2ba90:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a99 expref: 183 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.748159:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212390 00000100:00100000:1.0:1651529344.748160:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13166 00000100:00100000:1.0:1651529344.748161:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+183:41279:x1731746396420864:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.748161:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1884:39029:x1731745946540032:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.748165:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.748166:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a30bee33/0x3234de053c4cd47 lrc: 4/0,0 mode: PR/PR res: [0x2ba92:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce6fc expref: 183 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:0.0:1651529344.748166:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178838 count 1 00010000:00010000:1.0:1651529344.748170:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a30bee33/0x3234de053c4cd47 lrc: 3/0,0 mode: PR/PR res: [0x2ba92:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce6fc expref: 183 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.748170:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c52bb2 lrc: 3/0,1 mode: --/PW res: [0x2ba96:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.748175:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a30bee33/0x3234de053c4cd47 lrc: 0/0,0 mode: --/PR res: [0x2ba92:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce6fc expref: 183 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.748175:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9cecf0c/0x3234de053c4f373 lrc: 2/0,0 mode: PR/PR res: [0x2ba96:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8077 expref: 183 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.748178:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.748179:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.748179:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.748179:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c52bb2 lrc: 4/0,1 mode: --/PW res: [0x2ba96:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.748180:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.748181:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c52b8f lrc: 3/0,1 mode: PW/PW res: [0x2ba92:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.748184:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c52b8f lrc: 4/0,1 mode: PW/PW res: [0x2ba92:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.748186:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e9cecf0c/0x3234de053c4f373 lrc: 3/0,0 mode: PR/PR res: [0x2ba96:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8077 expref: 182 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.748189:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e9cecf0c/0x3234de053c4f373 lrc: 4/0,0 mode: PR/PR res: [0x2ba96:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8077 expref: 182 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.748193:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.748202:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+182:41279:x1731746396420864:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.748205:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13166 00000100:00100000:1.0:1651529344.748210:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13167 00000100:00100000:1.0:1651529344.748211:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+181:41279:x1731746396420800:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.748214:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.748215:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009300c77b/0x3234de053c4e67d lrc: 4/0,0 mode: PR/PR res: [0x2ba90:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a99 expref: 181 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.748219:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009300c77b/0x3234de053c4e67d lrc: 3/0,0 mode: PR/PR res: [0x2ba90:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a99 expref: 181 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.748240:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dff6a73d pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997059712:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.748247:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009300c77b/0x3234de053c4e67d lrc: 0/0,0 mode: --/PR res: [0x2ba90:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a99 expref: 181 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.748250:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.748251:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.748252:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52b88 lrc: 3/0,1 mode: PW/PW res: [0x2ba90:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.748255:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52b88 lrc: 4/0,1 mode: PW/PW res: [0x2ba90:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.748261:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.748277:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a3b00cf3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.748279:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+180:41279:x1731746396420800:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 67us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.748282:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13167 00010000:00010000:1.0:1651529344.748292:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52b88 lrc: 3/0,1 mode: PW/PW res: [0x2ba90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.748292:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c52b8f lrc: 3/0,1 mode: PW/PW res: [0x2ba92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.748296:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52b88 lrc: 3/0,1 mode: PW/PW res: [0x2ba90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.748296:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c52b8f lrc: 3/0,1 mode: PW/PW res: [0x2ba92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.748299:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52b88 lrc: 3/0,1 mode: PW/PW res: [0x2ba90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.748301:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52b88 lrc: 2/0,0 mode: PW/PW res: [0x2ba90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.748307:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c52b8f lrc: 3/0,1 mode: PW/PW res: [0x2ba92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.748315:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c52b8f lrc: 2/0,0 mode: PW/PW res: [0x2ba92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.748343:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1886:39030:x1731745946539648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 763us (822us total) trans 12885080439 rc 0/0 00000100:00100000:1.0:1651529344.748346:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212384 00000100:00100000:0.0:1651529344.748355:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1885:39030:x1731745946539776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 772us (825us total) trans 12885080440 rc 0/0 00000100:00100000:0.0:1651529344.748359:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212385 00000100:00100000:1.0:1651529344.748361:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.748365:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946540096 00000100:00100000:0.0:1651529344.748376:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212391 00000100:00100000:0.0:1651529344.748377:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1885:39030:x1731745946540096:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.748382:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178839 count 1 00010000:00010000:0.0:1651529344.748386:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c52bb9 lrc: 3/0,1 mode: --/PW res: [0x2ba97:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.748391:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000022065871/0x3234de053c4d401 lrc: 2/0,0 mode: PR/PR res: [0x2ba97:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d01e4 expref: 179 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.748394:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.748395:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.748396:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c52bb9 lrc: 4/0,1 mode: --/PW res: [0x2ba97:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.748409:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000022065871/0x3234de053c4d401 lrc: 3/0,0 mode: PR/PR res: [0x2ba97:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d01e4 expref: 179 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.748413:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000022065871/0x3234de053c4d401 lrc: 4/0,0 mode: PR/PR res: [0x2ba97:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d01e4 expref: 179 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.748417:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000037ac96ac pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997059776:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.748425:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000003003c8b0 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.748431:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52b88 lrc: 2/0,0 mode: PW/PW res: [0x2ba90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.748434:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cde66bc6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.748435:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52b88 lrc: 2/0,0 mode: PW/PW res: [0x2ba90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.748438:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52b88 lrc: 3/0,0 mode: PW/PW res: [0x2ba90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.748442:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52b88 lrc: 1/0,0 mode: --/PW res: [0x2ba90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.748445:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52b88 lrc: 0/0,0 mode: --/PW res: [0x2ba90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.748454:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c52b8f lrc: 2/0,0 mode: PW/PW res: [0x2ba92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.748458:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c660975a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.748458:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c52b8f lrc: 2/0,0 mode: PW/PW res: [0x2ba92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.748461:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c52b8f lrc: 3/0,0 mode: PW/PW res: [0x2ba92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.748464:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c52b8f lrc: 1/0,0 mode: --/PW res: [0x2ba92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.748469:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c52b8f lrc: 0/0,0 mode: --/PW res: [0x2ba92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.748472:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.748479:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000075b025a pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997059520:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.748480:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.748482:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c52b9d lrc: 3/0,1 mode: --/PW res: [0x2ba91:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.748487:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.748489:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ad6d0877 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997059648:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.748491:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c52bab lrc: 3/0,1 mode: --/PW res: [0x2ba95:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.748494:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.748504:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005b3c5aba pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997059456:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.748508:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52b96 lrc: 3/0,1 mode: --/PW res: [0x2ba94:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.748512:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396420992 00000100:00100000:1.0:1651529344.748515:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004089c807 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997059584:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.748517:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ab56fe74/0x3234de053c4d3d7 lrc: 4/0,0 mode: PR/PR res: [0x2ba91:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d013c expref: 180 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.748518:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52ba4 lrc: 3/0,1 mode: --/PW res: [0x2ba93:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.748523:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396420928 00010000:00010000:0.0:1651529344.748525:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007bb75637/0x3234de053c4d1ca lrc: 4/0,0 mode: PR/PR res: [0x2ba94:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf8d7 expref: 181 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.748526:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396421056 00000100:00100000:0.0:1651529344.748529:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396421120 00010000:00010000:1.0:1651529344.748530:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000053e0755a/0x3234de053c4d77a lrc: 4/0,0 mode: PR/PR res: [0x2ba95:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f74 expref: 183 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.748532:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001deecd9c/0x3234de053c4f1a5 lrc: 4/0,0 mode: PR/PR res: [0x2ba93:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d797e expref: 183 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.748536:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13168 00000100:00100000:1.0:1651529344.748538:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+183:41279:x1731746396420992:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.748538:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13169 00000100:00100000:0.0:1651529344.748540:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+183:41278:x1731746396420928:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.748541:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.748542:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ab56fe74/0x3234de053c4d3d7 lrc: 4/0,0 mode: PR/PR res: [0x2ba91:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d013c expref: 183 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.748543:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.748546:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ab56fe74/0x3234de053c4d3d7 lrc: 3/0,0 mode: PR/PR res: [0x2ba91:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d013c expref: 183 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.748551:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab56fe74/0x3234de053c4d3d7 lrc: 0/0,0 mode: --/PR res: [0x2ba91:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d013c expref: 183 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.748555:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.748555:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.748556:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c52b9d lrc: 3/0,1 mode: PW/PW res: [0x2ba91:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.748561:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007bb75637/0x3234de053c4d1ca lrc: 4/0,0 mode: PR/PR res: [0x2ba94:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf8d7 expref: 183 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.748566:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007bb75637/0x3234de053c4d1ca lrc: 3/0,0 mode: PR/PR res: [0x2ba94:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf8d7 expref: 182 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.748567:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c52b9d lrc: 4/0,1 mode: PW/PW res: [0x2ba91:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.748572:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007bb75637/0x3234de053c4d1ca lrc: 0/0,0 mode: --/PR res: [0x2ba94:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf8d7 expref: 182 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.748576:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.748581:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.748582:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.748582:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52b96 lrc: 3/0,1 mode: PW/PW res: [0x2ba94:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.748584:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+181:41279:x1731746396420992:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 45us (112us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.748586:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52b96 lrc: 4/0,1 mode: PW/PW res: [0x2ba94:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.748587:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13168 00000100:00100000:1.0:1651529344.748592:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13170 00010000:00010000:0.0:1651529344.748595:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.748599:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000496e37f3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+180:41279:x1731746396421056:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.748602:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.748602:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+180:41278:x1731746396420928:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 62us (122us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.748603:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000053e0755a/0x3234de053c4d77a lrc: 4/0,0 mode: PR/PR res: [0x2ba95:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f74 expref: 180 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.748605:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13169 00010000:00010000:1.0:1651529344.748607:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000053e0755a/0x3234de053c4d77a lrc: 3/0,0 mode: PR/PR res: [0x2ba95:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f74 expref: 179 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.748610:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13171 00010000:00010000:1.0:1651529344.748612:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053e0755a/0x3234de053c4d77a lrc: 0/0,0 mode: --/PR res: [0x2ba95:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0f74 expref: 179 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.748612:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+179:41278:x1731746396421120:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.748614:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.748616:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.748616:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.748616:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001deecd9c/0x3234de053c4f1a5 lrc: 4/0,0 mode: PR/PR res: [0x2ba93:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d797e expref: 178 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.748617:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c52bab lrc: 3/0,1 mode: PW/PW res: [0x2ba95:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.748620:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c52bab lrc: 4/0,1 mode: PW/PW res: [0x2ba95:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.748622:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001deecd9c/0x3234de053c4f1a5 lrc: 3/0,0 mode: PR/PR res: [0x2ba93:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d797e expref: 178 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.748628:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.748632:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001deecd9c/0x3234de053c4f1a5 lrc: 0/0,0 mode: --/PR res: [0x2ba93:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d797e expref: 178 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.748634:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000496e37f3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+178:41279:x1731746396421056:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.748636:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13170 00010000:00010000:0.0:1651529344.748636:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.748637:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.748647:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52b96 lrc: 3/0,1 mode: PW/PW res: [0x2ba94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.748651:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52b96 lrc: 3/0,1 mode: PW/PW res: [0x2ba94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.748654:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52b96 lrc: 3/0,1 mode: PW/PW res: [0x2ba94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.748656:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52b96 lrc: 2/0,0 mode: PW/PW res: [0x2ba94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.748659:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52ba4 lrc: 3/0,1 mode: PW/PW res: [0x2ba93:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.748663:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52ba4 lrc: 4/0,1 mode: PW/PW res: [0x2ba93:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.748672:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.748679:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+176:41278:x1731746396421120:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 66us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.748681:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13171 00010000:00010000:0.0:1651529344.748689:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c52bab lrc: 3/0,1 mode: PW/PW res: [0x2ba95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.748692:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c52bab lrc: 3/0,1 mode: PW/PW res: [0x2ba95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.748695:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c52bab lrc: 3/0,1 mode: PW/PW res: [0x2ba95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.748700:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c52bab lrc: 2/0,0 mode: PW/PW res: [0x2ba95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.748706:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1886:39030:x1731745946539904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1071us (1170us total) trans 12885080441 rc 0/0 00000100:00100000:1.0:1651529344.748709:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212386 00010000:00010000:1.0:1651529344.748716:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52b96 lrc: 2/0,0 mode: PW/PW res: [0x2ba94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.748720:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000af20b5e7 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.748721:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52b96 lrc: 2/0,0 mode: PW/PW res: [0x2ba94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.748724:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52b96 lrc: 3/0,0 mode: PW/PW res: [0x2ba94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.748728:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52b96 lrc: 1/0,0 mode: --/PW res: [0x2ba94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.748731:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52b96 lrc: 0/0,0 mode: --/PW res: [0x2ba94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.748745:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c52bab lrc: 2/0,0 mode: PW/PW res: [0x2ba95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.748748:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e4f40ecf already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.748749:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c52bab lrc: 2/0,0 mode: PW/PW res: [0x2ba95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.748750:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1886:39030:x1731745946539968:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1024us (1179us total) trans 12885080442 rc 0/0 00010000:00010000:1.0:1651529344.748752:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c52bab lrc: 3/0,0 mode: PW/PW res: [0x2ba95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.748753:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212389 00010000:00010000:1.0:1651529344.748755:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c52bab lrc: 1/0,0 mode: --/PW res: [0x2ba95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.748758:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c52bab lrc: 0/0,0 mode: --/PW res: [0x2ba95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.748761:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c52b9d lrc: 3/0,1 mode: PW/PW res: [0x2ba91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.748763:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52ba4 lrc: 3/0,1 mode: PW/PW res: [0x2ba93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.748765:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c52b9d lrc: 3/0,1 mode: PW/PW res: [0x2ba91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.748766:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52ba4 lrc: 3/0,1 mode: PW/PW res: [0x2ba93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.748768:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c52b9d lrc: 3/0,1 mode: PW/PW res: [0x2ba91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.748769:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52ba4 lrc: 3/0,1 mode: PW/PW res: [0x2ba93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.748771:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52ba4 lrc: 2/0,0 mode: PW/PW res: [0x2ba93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.748771:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c52b9d lrc: 2/0,0 mode: PW/PW res: [0x2ba91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.748811:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1887:39030:x1731745946539840:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1131us (1253us total) trans 12885080443 rc 0/0 00000100:00100000:0.0:1651529344.748813:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1887:39030:x1731745946539712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1157us (1261us total) trans 12885080444 rc 0/0 00000100:00100000:1.0:1651529344.748814:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212388 00000100:00100000:0.0:1651529344.748816:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212387 00010000:00010000:0.0:1651529344.748823:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c52b9d lrc: 2/0,0 mode: PW/PW res: [0x2ba91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.748826:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cde7e11a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.748827:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c52b9d lrc: 2/0,0 mode: PW/PW res: [0x2ba91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.748829:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.748830:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c52b9d lrc: 3/0,0 mode: PW/PW res: [0x2ba91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.748842:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c52b9d lrc: 1/0,0 mode: --/PW res: [0x2ba91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.748845:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c52b9d lrc: 0/0,0 mode: --/PW res: [0x2ba91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.748853:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52ba4 lrc: 2/0,0 mode: PW/PW res: [0x2ba93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.748857:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.748857:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000046fea5cc already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.748857:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52ba4 lrc: 2/0,0 mode: PW/PW res: [0x2ba93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.748860:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52ba4 lrc: 3/0,0 mode: PW/PW res: [0x2ba93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.748864:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52ba4 lrc: 1/0,0 mode: --/PW res: [0x2ba93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.748866:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52ba4 lrc: 0/0,0 mode: --/PW res: [0x2ba93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.748879:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.748879:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946540224 00000100:00100000:0.0:1651529344.748885:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946540160 00000100:00100000:0.0:1651529344.748892:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212392 00000100:00100000:0.0:1651529344.748894:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1887:39029:x1731745946540224:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.748899:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178841 count 1 00010000:00010000:0.0:1651529344.748903:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52bc0 lrc: 3/0,1 mode: --/PW res: [0x2ba99:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.748908:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009b714b3b/0x3234de053c4e12f lrc: 2/0,0 mode: PR/PR res: [0x2ba99:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3592 expref: 175 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.748911:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.748912:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.748912:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.748912:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52bc0 lrc: 4/0,1 mode: --/PW res: [0x2ba99:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.748925:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009b714b3b/0x3234de053c4e12f lrc: 3/0,0 mode: PR/PR res: [0x2ba99:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3592 expref: 175 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.748928:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009b714b3b/0x3234de053c4e12f lrc: 4/0,0 mode: PR/PR res: [0x2ba99:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3592 expref: 175 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.748932:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ad6d0877 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997059840:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.748942:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 000000003c8b0daf going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.748948:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212393 00000100:00100000:0.0:1651529344.748949:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1887:39029:x1731745946540160:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.748954:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178840 count 1 00010000:00010000:0.0:1651529344.748957:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c52bc7 lrc: 3/0,1 mode: --/PW res: [0x2ba98:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.748961:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004935cd3e/0x3234de053c4e26a lrc: 2/0,0 mode: PR/PR res: [0x2ba98:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3af5 expref: 175 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.748964:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.748965:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.748965:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c52bc7 lrc: 4/0,1 mode: --/PW res: [0x2ba98:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.748971:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004935cd3e/0x3234de053c4e26a lrc: 3/0,0 mode: PR/PR res: [0x2ba98:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3af5 expref: 175 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.748975:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396421248 00010000:00010000:0.0:1651529344.748975:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004935cd3e/0x3234de053c4e26a lrc: 4/0,0 mode: PR/PR res: [0x2ba98:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3af5 expref: 175 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.748981:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000022065871/0x3234de053c4d401 lrc: 5/0,0 mode: PR/PR res: [0x2ba97:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d01e4 expref: 176 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.748988:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396421184 00010000:00010000:1.0:1651529344.748990:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e9cecf0c/0x3234de053c4f373 lrc: 5/0,0 mode: PR/PR res: [0x2ba96:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8077 expref: 177 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.748995:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000075b025a pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997059904:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.748996:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13172 00000100:00100000:1.0:1651529344.748997:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+177:41279:x1731746396421248:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.749000:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.749001:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000022065871/0x3234de053c4d401 lrc: 5/0,0 mode: PR/PR res: [0x2ba97:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d01e4 expref: 177 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.749005:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000022065871/0x3234de053c4d401 lrc: 4/0,0 mode: PR/PR res: [0x2ba97:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d01e4 expref: 177 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.749011:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.749012:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.749012:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c52bb9 lrc: 3/0,1 mode: PW/PW res: [0x2ba97:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.749021:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c52bb9 lrc: 4/0,1 mode: PW/PW res: [0x2ba97:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.749025:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 0000000070e666f7 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.749027:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.749034:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+177:41279:x1731746396421248:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (155us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.749035:0:72395:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022065871/0x3234de053c4d401 lrc: 0/0,0 mode: --/PR res: [0x2ba97:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d01e4 expref: 177 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.749036:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13172 00000100:00100000:0.0:1651529344.749039:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000037ac96ac pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997059776:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.749041:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13173 00000100:00100000:1.0:1651529344.749042:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+175:41278:x1731746396421184:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.749042:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c52bb9 lrc: 3/0,1 mode: PW/PW res: [0x2ba97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.749045:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.749046:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e9cecf0c/0x3234de053c4f373 lrc: 5/0,0 mode: PR/PR res: [0x2ba96:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8077 expref: 175 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.749046:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c52bb9 lrc: 3/0,1 mode: PW/PW res: [0x2ba97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.749050:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e9cecf0c/0x3234de053c4f373 lrc: 4/0,0 mode: PR/PR res: [0x2ba96:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8077 expref: 175 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.749051:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c52bb9 lrc: 3/0,1 mode: PW/PW res: [0x2ba97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.749054:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.749054:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c52bb9 lrc: 3/0,1 mode: PW/PW res: [0x2ba97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.749055:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.749055:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c52bb2 lrc: 3/0,1 mode: PW/PW res: [0x2ba96:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.749057:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c52bb9 lrc: 2/0,0 mode: PW/PW res: [0x2ba97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.749058:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c52bb2 lrc: 4/0,1 mode: PW/PW res: [0x2ba96:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.749062:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.749073:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+175:41278:x1731746396421184:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 30us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.749076:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13173 00010000:00010000:1.0:1651529344.749084:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c52bb9 lrc: 2/0,0 mode: PW/PW res: [0x2ba97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.749087:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009882f227 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.749088:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c52bb9 lrc: 2/0,0 mode: PW/PW res: [0x2ba97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.749091:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c52bb9 lrc: 3/0,0 mode: PW/PW res: [0x2ba97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.749095:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c52bb9 lrc: 1/0,0 mode: --/PW res: [0x2ba97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.749098:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c52bb9 lrc: 0/0,0 mode: --/PW res: [0x2ba97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.749111:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1888:39030:x1731745946540096:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 733us (750us total) trans 12885080445 rc 0/0 00000100:00100000:0.0:1651529344.749114:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212391 00010000:00010000:0.0:1651529344.749125:0:80276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9cecf0c/0x3234de053c4f373 lrc: 0/0,0 mode: --/PR res: [0x2ba96:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8077 expref: 174 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.749130:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.749147:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.749160:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dff6a73d pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997059712:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.749164:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c52bb2 lrc: 3/0,1 mode: PW/PW res: [0x2ba96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.749167:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c52bb2 lrc: 3/0,1 mode: PW/PW res: [0x2ba96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.749170:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c52bb2 lrc: 3/0,1 mode: PW/PW res: [0x2ba96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.749181:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c52bb2 lrc: 3/0,1 mode: PW/PW res: [0x2ba96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.749183:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.749184:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c52bb2 lrc: 2/0,0 mode: PW/PW res: [0x2ba96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.749210:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.749218:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.749221:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1888:39029:x1731745946540032:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1059us (1086us total) trans 12885080446 rc 0/0 00000100:00100000:0.0:1651529344.749243:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212390 00000100:00100000:0.0:1651529344.749248:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946540288 00000100:00100000:0.0:1651529344.749256:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946540352 00000100:00100000:0.0:1651529344.749260:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946540480 00000100:00100000:0.0:1651529344.749265:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946540416 00000100:00100000:0.0:1651529344.749270:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212394 00000100:00100000:0.0:1651529344.749271:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1891:39029:x1731745946540288:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.749273:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212395 00000100:00100000:1.0:1651529344.749275:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1891:39029:x1731745946540352:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.749281:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178843 count 1 00010000:00010000:1.0:1651529344.749285:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52bce lrc: 3/0,1 mode: --/PW res: [0x2ba9b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.749290:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f7efe66d/0x3234de053c4e89f lrc: 2/0,0 mode: PR/PR res: [0x2ba9b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d536e expref: 173 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.749298:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.749299:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.749300:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52bce lrc: 4/0,1 mode: --/PW res: [0x2ba9b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.749307:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f7efe66d/0x3234de053c4e89f lrc: 3/0,0 mode: PR/PR res: [0x2ba9b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d536e expref: 173 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.749309:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178842 count 1 00010000:00010000:1.0:1651529344.749311:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f7efe66d/0x3234de053c4e89f lrc: 4/0,0 mode: PR/PR res: [0x2ba9b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d536e expref: 173 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.749314:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c52bd5 lrc: 3/0,1 mode: --/PW res: [0x2ba9a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.749315:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004089c807 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997059968:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.749319:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bdbb0967/0x3234de053c4dac9 lrc: 2/0,0 mode: PR/PR res: [0x2ba9a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b75 expref: 173 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.749322:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.749323:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.749324:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.749324:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c52bd5 lrc: 4/0,1 mode: --/PW res: [0x2ba9a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.749330:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212396 00000100:00100000:1.0:1651529344.749332:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1891:39029:x1731745946540480:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.749333:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bdbb0967/0x3234de053c4dac9 lrc: 3/0,0 mode: PR/PR res: [0x2ba9a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b75 expref: 173 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.749336:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178845 count 1 00010000:00010000:0.0:1651529344.749337:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bdbb0967/0x3234de053c4dac9 lrc: 4/0,0 mode: PR/PR res: [0x2ba9a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b75 expref: 173 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.749339:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52bdc lrc: 3/0,1 mode: --/PW res: [0x2ba9d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.749341:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dff6a73d pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997060032:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.749344:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cdf98eee/0x3234de053c4e630 lrc: 2/0,0 mode: PR/PR res: [0x2ba9d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d49ce expref: 173 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.749349:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.749350:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.749350:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52bdc lrc: 4/0,1 mode: --/PW res: [0x2ba9d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.749350:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c086aae3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.749356:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cdf98eee/0x3234de053c4e630 lrc: 3/0,0 mode: PR/PR res: [0x2ba9d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d49ce expref: 173 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.749359:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cdf98eee/0x3234de053c4e630 lrc: 4/0,0 mode: PR/PR res: [0x2ba9d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d49ce expref: 173 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.749363:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005b3c5aba pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997060096:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.749369:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cfa1ca05 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.749371:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212397 00000100:00100000:0.0:1651529344.749373:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1891:39029:x1731745946540416:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.749374:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396421312 00002000:00080000:0.0:1651529344.749378:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178844 count 1 00010000:00010000:1.0:1651529344.749379:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009b714b3b/0x3234de053c4e12f lrc: 5/0,0 mode: PR/PR res: [0x2ba99:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3592 expref: 174 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.749382:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c52be3 lrc: 3/0,1 mode: --/PW res: [0x2ba9c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.749386:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13174 00010000:00010000:0.0:1651529344.749386:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001faa7f64/0x3234de053c4d0a4 lrc: 2/0,0 mode: PR/PR res: [0x2ba9c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf454 expref: 174 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.749388:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+174:41278:x1731746396421312:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.749389:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.749390:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.749390:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.749391:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c52be3 lrc: 4/0,1 mode: --/PW res: [0x2ba9c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.749392:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009b714b3b/0x3234de053c4e12f lrc: 5/0,0 mode: PR/PR res: [0x2ba99:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3592 expref: 174 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.749395:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009b714b3b/0x3234de053c4e12f lrc: 4/0,0 mode: PR/PR res: [0x2ba99:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3592 expref: 174 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.749397:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001faa7f64/0x3234de053c4d0a4 lrc: 3/0,0 mode: PR/PR res: [0x2ba9c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf454 expref: 174 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.749401:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001faa7f64/0x3234de053c4d0a4 lrc: 4/0,0 mode: PR/PR res: [0x2ba9c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf454 expref: 174 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.749403:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.749404:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.749405:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52bc0 lrc: 3/0,1 mode: PW/PW res: [0x2ba99:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.749405:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000037ac96ac pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997060160:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.749408:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52bc0 lrc: 4/0,1 mode: PW/PW res: [0x2ba99:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.749412:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.749412:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b81e4a0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.749417:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+174:41278:x1731746396421312:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 29us (208us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.749417:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c52bb2 lrc: 2/0,0 mode: PW/PW res: [0x2ba96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.749420:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13174 00010000:00010000:0.0:1651529344.749420:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009fff0bd3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.749421:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c52bb2 lrc: 2/0,0 mode: PW/PW res: [0x2ba96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.749424:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c52bb2 lrc: 3/0,0 mode: PW/PW res: [0x2ba96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.749428:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c52bb2 lrc: 1/0,0 mode: --/PW res: [0x2ba96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.749431:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c52bb2 lrc: 0/0,0 mode: --/PW res: [0x2ba96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.749447:0:80281:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b714b3b/0x3234de053c4e12f lrc: 0/0,0 mode: --/PR res: [0x2ba99:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3592 expref: 173 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.749451:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ad6d0877 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997059840:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.749454:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52bc0 lrc: 3/0,1 mode: PW/PW res: [0x2ba99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.749460:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52bc0 lrc: 3/0,1 mode: PW/PW res: [0x2ba99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.749462:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52bc0 lrc: 3/0,1 mode: PW/PW res: [0x2ba99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.749465:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52bc0 lrc: 3/0,1 mode: PW/PW res: [0x2ba99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.749468:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52bc0 lrc: 2/0,0 mode: PW/PW res: [0x2ba99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.749472:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.749494:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.749505:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1892:39029:x1731745946540224:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 610us (675us total) trans 12885080447 rc 0/0 00000100:00100000:0.0:1651529344.749508:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212392 00000100:00100000:0.0:1651529344.749513:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946540544 00000100:00100000:1.0:1651529344.749514:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.749524:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946540608 00000100:00100000:0.0:1651529344.749530:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212398 00000100:00100000:0.0:1651529344.749531:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1893:39029:x1731745946540544:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.749536:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178846 count 1 00010000:00010000:0.0:1651529344.749540:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c52bea lrc: 3/0,1 mode: --/PW res: [0x2ba9e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.749544:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000aefcc4e8/0x3234de053c4d0ff lrc: 2/0,0 mode: PR/PR res: [0x2ba9e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf59d expref: 172 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.749550:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.749551:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.749551:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c52bea lrc: 4/0,1 mode: --/PW res: [0x2ba9e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.749558:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000aefcc4e8/0x3234de053c4d0ff lrc: 3/0,0 mode: PR/PR res: [0x2ba9e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf59d expref: 172 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.749561:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000aefcc4e8/0x3234de053c4d0ff lrc: 4/0,0 mode: PR/PR res: [0x2ba9e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf59d expref: 172 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.749565:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ad6d0877 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997060224:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.749577:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000abca413e going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.749583:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52bc0 lrc: 2/0,0 mode: PW/PW res: [0x2ba99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.749586:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212399 00010000:00010000:0.0:1651529344.749586:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002f450f42 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.749587:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52bc0 lrc: 2/0,0 mode: PW/PW res: [0x2ba99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.749588:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1893:39030:x1731745946540608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.749590:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52bc0 lrc: 3/0,0 mode: PW/PW res: [0x2ba99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.749594:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178847 count 1 00010000:00010000:0.0:1651529344.749595:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52bc0 lrc: 1/0,0 mode: --/PW res: [0x2ba99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.749599:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52bf1 lrc: 3/0,1 mode: --/PW res: [0x2ba9f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.749600:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52bc0 lrc: 0/0,0 mode: --/PW res: [0x2ba99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.749603:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007dd1354c/0x3234de053c4e36d lrc: 2/0,0 mode: PR/PR res: [0x2ba9f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e9f expref: 172 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.749606:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.749607:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.749608:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52bf1 lrc: 4/0,1 mode: --/PW res: [0x2ba9f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.749608:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000075b025a pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997059904:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.749612:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c52bc7 lrc: 3/0,1 mode: --/PW res: [0x2ba98:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.749615:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007dd1354c/0x3234de053c4e36d lrc: 3/0,0 mode: PR/PR res: [0x2ba9f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e9f expref: 172 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.749618:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007dd1354c/0x3234de053c4e36d lrc: 4/0,0 mode: PR/PR res: [0x2ba9f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e9f expref: 172 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.749623:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000533fe698 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997060288:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.749631:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d09f5ee1 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.749635:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396421376 00010000:00010000:0.0:1651529344.749651:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004935cd3e/0x3234de053c4e26a lrc: 4/0,0 mode: PR/PR res: [0x2ba98:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3af5 expref: 173 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.749663:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13175 00000100:00100000:0.0:1651529344.749675:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+173:41278:x1731746396421376:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.749678:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.749680:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.749680:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004935cd3e/0x3234de053c4e26a lrc: 4/0,0 mode: PR/PR res: [0x2ba98:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3af5 expref: 173 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.749698:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946540672 00010000:00010000:0.0:1651529344.749698:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004935cd3e/0x3234de053c4e26a lrc: 3/0,0 mode: PR/PR res: [0x2ba98:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3af5 expref: 173 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.749703:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004935cd3e/0x3234de053c4e26a lrc: 0/0,0 mode: --/PR res: [0x2ba98:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3af5 expref: 173 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.749705:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212400 00000100:00100000:1.0:1651529344.749707:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1894:39030:x1731745946540672:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.749707:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.749708:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.749709:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c52bc7 lrc: 3/0,1 mode: PW/PW res: [0x2ba98:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.749712:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178848 count 1 00010000:00010000:0.0:1651529344.749712:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c52bc7 lrc: 4/0,1 mode: PW/PW res: [0x2ba98:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.749716:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52bf8 lrc: 3/0,1 mode: --/PW res: [0x2baa0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.749719:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.749720:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b16b9c44/0x3234de053c4c647 lrc: 2/0,0 mode: PR/PR res: [0x2baa0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb11 expref: 172 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.749723:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.749724:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.749725:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52bf8 lrc: 4/0,1 mode: --/PW res: [0x2baa0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.749726:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+172:41278:x1731746396421376:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 51us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.749729:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13175 00010000:00010000:1.0:1651529344.749731:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b16b9c44/0x3234de053c4c647 lrc: 3/0,0 mode: PR/PR res: [0x2baa0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb11 expref: 172 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.749744:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c52bc7 lrc: 3/0,1 mode: PW/PW res: [0x2ba98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.749747:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b16b9c44/0x3234de053c4c647 lrc: 4/0,0 mode: PR/PR res: [0x2baa0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb11 expref: 171 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.749748:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c52bc7 lrc: 3/0,1 mode: PW/PW res: [0x2ba98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.749751:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029abc941 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997060352:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.749751:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c52bc7 lrc: 3/0,1 mode: PW/PW res: [0x2ba98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.749753:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c52bc7 lrc: 2/0,0 mode: PW/PW res: [0x2ba98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.749765:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 000000004ca54b8a going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.749773:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004089c807 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997059968:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.749777:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52bce lrc: 3/0,1 mode: --/PW res: [0x2ba9b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.749783:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c52bc7 lrc: 2/0,0 mode: PW/PW res: [0x2ba98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.749786:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b0407aaf already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.749787:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c52bc7 lrc: 2/0,0 mode: PW/PW res: [0x2ba98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.749790:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c52bc7 lrc: 3/0,0 mode: PW/PW res: [0x2ba98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.749794:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c52bc7 lrc: 1/0,0 mode: --/PW res: [0x2ba98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.749794:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1895:39029:x1731745946540160:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 844us (936us total) trans 12885080448 rc 0/0 00010000:00010000:1.0:1651529344.749797:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c52bc7 lrc: 0/0,0 mode: --/PW res: [0x2ba98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.749797:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212393 00000100:00100000:0.0:1651529344.749862:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dff6a73d pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997060032:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.749866:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c52bd5 lrc: 3/0,1 mode: --/PW res: [0x2ba9a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.749936:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005b3c5aba pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997060096:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.749940:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52bdc lrc: 3/0,1 mode: --/PW res: [0x2ba9d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.750003:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.750026:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.750044:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.750054:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396421440 00000100:00100000:0.0:1651529344.750054:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.750062:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.750064:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f7efe66d/0x3234de053c4e89f lrc: 4/0,0 mode: PR/PR res: [0x2ba9b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d536e expref: 172 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.750079:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396421568 00010000:00010000:1.0:1651529344.750082:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cdf98eee/0x3234de053c4e630 lrc: 4/0,0 mode: PR/PR res: [0x2ba9d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d49ce expref: 173 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.750087:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396421504 00010000:00010000:1.0:1651529344.750089:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bdbb0967/0x3234de053c4dac9 lrc: 4/0,0 mode: PR/PR res: [0x2ba9a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b75 expref: 174 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.750098:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396421632 00010000:00010000:1.0:1651529344.750101:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001faa7f64/0x3234de053c4d0a4 lrc: 5/0,0 mode: PR/PR res: [0x2ba9c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf454 expref: 175 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.750105:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13176 00000100:00100000:1.0:1651529344.750107:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+175:41278:x1731746396421440:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.750115:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.750116:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000037ac96ac pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997060160:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.750117:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f7efe66d/0x3234de053c4e89f lrc: 4/0,0 mode: PR/PR res: [0x2ba9b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d536e expref: 175 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.750120:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f7efe66d/0x3234de053c4e89f lrc: 3/0,0 mode: PR/PR res: [0x2ba9b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d536e expref: 175 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.750120:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c52be3 lrc: 3/0,1 mode: --/PW res: [0x2ba9c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.750126:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7efe66d/0x3234de053c4e89f lrc: 0/0,0 mode: --/PR res: [0x2ba9b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d536e expref: 175 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.750129:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946540736 00010000:00010000:1.0:1651529344.750130:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.750130:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.750131:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52bce lrc: 3/0,1 mode: PW/PW res: [0x2ba9b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.750134:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52bce lrc: 4/0,1 mode: PW/PW res: [0x2ba9b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.750139:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212401 00000100:00100000:0.0:1651529344.750141:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1895:39030:x1731745946540736:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.750145:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00080000:0.0:1651529344.750146:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178849 count 1 00010000:00010000:0.0:1651529344.750150:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c52bff lrc: 3/0,1 mode: --/PW res: [0x2baa1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.750156:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+174:41278:x1731746396421440:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 49us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.750159:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13176 00010000:00010000:0.0:1651529344.750161:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c473d13f/0x3234de053c4c384 lrc: 2/0,0 mode: PR/PR res: [0x2baa1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc912 expref: 174 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.750164:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13177 00010000:00010000:0.0:1651529344.750164:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.750165:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.750165:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c52bff lrc: 4/0,1 mode: --/PW res: [0x2baa1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.750166:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d177f8a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+173:41278:x1731746396421568:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.750168:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.750170:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cdf98eee/0x3234de053c4e630 lrc: 4/0,0 mode: PR/PR res: [0x2ba9d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d49ce expref: 173 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.750172:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c473d13f/0x3234de053c4c384 lrc: 3/0,0 mode: PR/PR res: [0x2baa1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc912 expref: 173 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.750173:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cdf98eee/0x3234de053c4e630 lrc: 3/0,0 mode: PR/PR res: [0x2ba9d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d49ce expref: 173 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.750178:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cdf98eee/0x3234de053c4e630 lrc: 0/0,0 mode: --/PR res: [0x2ba9d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d49ce expref: 173 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.750178:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c473d13f/0x3234de053c4c384 lrc: 4/0,0 mode: PR/PR res: [0x2baa1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc912 expref: 173 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.750181:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.750182:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.750182:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000037ac96ac pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997060416:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.750183:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52bdc lrc: 3/0,1 mode: PW/PW res: [0x2ba9d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.750186:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52bdc lrc: 4/0,1 mode: PW/PW res: [0x2ba9d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.750191:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.750191:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c086aae3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.750197:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d177f8a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+172:41278:x1731746396421568:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 30us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.750198:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ad6d0877 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997060224:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.750199:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13177 00010000:00010000:0.0:1651529344.750201:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c52bea lrc: 3/0,1 mode: --/PW res: [0x2ba9e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.750207:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13178 00000100:00100000:1.0:1651529344.750209:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+171:41279:x1731746396421504:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.750209:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13179 00010000:00010000:1.0:1651529344.750211:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.750211:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+171:41279:x1731746396421632:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.750212:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bdbb0967/0x3234de053c4dac9 lrc: 4/0,0 mode: PR/PR res: [0x2ba9a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b75 expref: 171 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.750214:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.750215:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001faa7f64/0x3234de053c4d0a4 lrc: 4/0,0 mode: PR/PR res: [0x2ba9c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf454 expref: 171 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.750216:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bdbb0967/0x3234de053c4dac9 lrc: 3/0,0 mode: PR/PR res: [0x2ba9a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b75 expref: 171 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.750219:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001faa7f64/0x3234de053c4d0a4 lrc: 3/0,0 mode: PR/PR res: [0x2ba9c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf454 expref: 171 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.750232:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bdbb0967/0x3234de053c4dac9 lrc: 0/0,0 mode: --/PR res: [0x2ba9a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1b75 expref: 171 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.750242:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001faa7f64/0x3234de053c4d0a4 lrc: 0/0,0 mode: --/PR res: [0x2ba9c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf454 expref: 171 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.750243:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.750244:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.750245:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c52bd5 lrc: 3/0,1 mode: PW/PW res: [0x2ba9a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.750246:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.750246:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.750247:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c52be3 lrc: 3/0,1 mode: PW/PW res: [0x2ba9c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.750248:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c52bd5 lrc: 4/0,1 mode: PW/PW res: [0x2ba9a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.750251:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c52be3 lrc: 4/0,1 mode: PW/PW res: [0x2ba9c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.750256:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.750261:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.750262:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+169:41279:x1731746396421504:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 53us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.750265:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13178 00000100:00100000:0.0:1651529344.750268:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+168:41279:x1731746396421632:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 57us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.750271:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13179 00000100:00100000:1.0:1651529344.750276:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000533fe698 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997060288:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.750279:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c52be3 lrc: 3/0,1 mode: PW/PW res: [0x2ba9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.750280:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52bf1 lrc: 3/0,1 mode: --/PW res: [0x2ba9f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.750282:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c52be3 lrc: 3/0,1 mode: PW/PW res: [0x2ba9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.750285:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c52be3 lrc: 3/0,1 mode: PW/PW res: [0x2ba9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.750286:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029abc941 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997060352:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.750287:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c52be3 lrc: 2/0,0 mode: PW/PW res: [0x2ba9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.750289:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52bf8 lrc: 3/0,1 mode: --/PW res: [0x2baa0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.750294:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52bce lrc: 3/0,1 mode: PW/PW res: [0x2ba9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.750297:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52bce lrc: 3/0,1 mode: PW/PW res: [0x2ba9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.750302:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52bce lrc: 3/0,1 mode: PW/PW res: [0x2ba9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.750305:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52bce lrc: 2/0,0 mode: PW/PW res: [0x2ba9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.750334:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1897:39029:x1731745946540416:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 959us (1115us total) trans 12885080449 rc 0/0 00000100:00100000:0.0:1651529344.750336:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212397 00010000:00010000:0.0:1651529344.750344:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c52be3 lrc: 2/0,0 mode: PW/PW res: [0x2ba9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.750347:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c822bd1c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.750348:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c52be3 lrc: 2/0,0 mode: PW/PW res: [0x2ba9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.750349:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1896:39029:x1731745946540352:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1074us (1202us total) trans 12885080450 rc 0/0 00010000:00010000:0.0:1651529344.750351:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c52be3 lrc: 3/0,0 mode: PW/PW res: [0x2ba9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.750352:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212395 00010000:00010000:0.0:1651529344.750356:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c52be3 lrc: 1/0,0 mode: --/PW res: [0x2ba9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.750358:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c52be3 lrc: 0/0,0 mode: --/PW res: [0x2ba9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.750360:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52bdc lrc: 3/0,1 mode: PW/PW res: [0x2ba9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.750362:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52bce lrc: 2/0,0 mode: PW/PW res: [0x2ba9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.750363:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52bdc lrc: 3/0,1 mode: PW/PW res: [0x2ba9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.750365:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000820e505a already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.750366:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52bdc lrc: 3/0,1 mode: PW/PW res: [0x2ba9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.750366:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52bce lrc: 2/0,0 mode: PW/PW res: [0x2ba9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.750369:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52bdc lrc: 2/0,0 mode: PW/PW res: [0x2ba9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.750369:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52bce lrc: 3/0,0 mode: PW/PW res: [0x2ba9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.750372:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52bce lrc: 1/0,0 mode: --/PW res: [0x2ba9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.750374:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52bce lrc: 0/0,0 mode: --/PW res: [0x2ba9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.750378:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52bdc lrc: 2/0,0 mode: PW/PW res: [0x2ba9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.750381:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f1b4c19f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.750382:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52bdc lrc: 2/0,0 mode: PW/PW res: [0x2ba9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.750384:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52bdc lrc: 3/0,0 mode: PW/PW res: [0x2ba9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.750387:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52bdc lrc: 1/0,0 mode: --/PW res: [0x2ba9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.750390:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52bdc lrc: 0/0,0 mode: --/PW res: [0x2ba9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.750396:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c52bd5 lrc: 3/0,1 mode: PW/PW res: [0x2ba9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.750398:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c52bd5 lrc: 3/0,1 mode: PW/PW res: [0x2ba9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.750401:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c52bd5 lrc: 3/0,1 mode: PW/PW res: [0x2ba9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.750404:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c52bd5 lrc: 2/0,0 mode: PW/PW res: [0x2ba9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.750406:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1896:39029:x1731745946540480:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1073us (1223us total) trans 12885080451 rc 0/0 00000100:00100000:1.0:1651529344.750409:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212396 00010000:00010000:1.0:1651529344.750418:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c52bd5 lrc: 2/0,0 mode: PW/PW res: [0x2ba9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.750423:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000096ab8041 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.750424:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c52bd5 lrc: 2/0,0 mode: PW/PW res: [0x2ba9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.750427:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c52bd5 lrc: 3/0,0 mode: PW/PW res: [0x2ba9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.750432:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c52bd5 lrc: 1/0,0 mode: --/PW res: [0x2ba9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.750435:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c52bd5 lrc: 0/0,0 mode: --/PW res: [0x2ba9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.750438:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1896:39029:x1731745946540288:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1166us (1308us total) trans 12885080452 rc 0/0 00000100:00100000:0.0:1651529344.750441:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212394 00000100:00100000:1.0:1651529344.750446:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.750481:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.750481:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396421760 00010000:00010000:0.0:1651529344.750487:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007dd1354c/0x3234de053c4e36d lrc: 4/0,0 mode: PR/PR res: [0x2ba9f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e9f expref: 168 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.750496:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396421696 00010000:00010000:0.0:1651529344.750499:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000aefcc4e8/0x3234de053c4d0ff lrc: 4/0,0 mode: PR/PR res: [0x2ba9e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf59d expref: 169 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.750507:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13180 00000100:00100000:0.0:1651529344.750508:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+169:41279:x1731746396421760:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.750511:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.750512:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007dd1354c/0x3234de053c4e36d lrc: 4/0,0 mode: PR/PR res: [0x2ba9f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e9f expref: 169 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.750516:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007dd1354c/0x3234de053c4e36d lrc: 3/0,0 mode: PR/PR res: [0x2ba9f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e9f expref: 169 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.750521:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007dd1354c/0x3234de053c4e36d lrc: 0/0,0 mode: --/PR res: [0x2ba9f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e9f expref: 169 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.750525:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.750526:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.750526:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52bf1 lrc: 3/0,1 mode: PW/PW res: [0x2ba9f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.750529:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.750529:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52bf1 lrc: 4/0,1 mode: PW/PW res: [0x2ba9f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.750538:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.750545:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+168:41279:x1731746396421760:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.750548:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13180 00000100:00100000:0.0:1651529344.750552:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396421824 00010000:00010000:0.0:1651529344.750555:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b16b9c44/0x3234de053c4c647 lrc: 4/0,0 mode: PR/PR res: [0x2baa0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb11 expref: 168 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.750560:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13181 00000100:00100000:0.0:1651529344.750561:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+168:41278:x1731746396421696:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.750563:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.750564:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000aefcc4e8/0x3234de053c4d0ff lrc: 4/0,0 mode: PR/PR res: [0x2ba9e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf59d expref: 168 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.750566:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13182 00010000:00010000:0.0:1651529344.750568:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000aefcc4e8/0x3234de053c4d0ff lrc: 3/0,0 mode: PR/PR res: [0x2ba9e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf59d expref: 168 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.750569:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+168:41278:x1731746396421824:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.750572:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aefcc4e8/0x3234de053c4d0ff lrc: 0/0,0 mode: --/PR res: [0x2ba9e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf59d expref: 168 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.750573:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.750575:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b16b9c44/0x3234de053c4c647 lrc: 4/0,0 mode: PR/PR res: [0x2baa0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb11 expref: 168 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.750576:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.750577:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.750577:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c52bea lrc: 3/0,1 mode: PW/PW res: [0x2ba9e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.750579:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b16b9c44/0x3234de053c4c647 lrc: 3/0,0 mode: PR/PR res: [0x2baa0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb11 expref: 167 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.750580:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c52bea lrc: 4/0,1 mode: PW/PW res: [0x2ba9e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.750584:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b16b9c44/0x3234de053c4c647 lrc: 0/0,0 mode: --/PR res: [0x2baa0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ccb11 expref: 167 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.750587:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.750588:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.750589:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.750590:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52bf8 lrc: 3/0,1 mode: PW/PW res: [0x2baa0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.750593:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52bf8 lrc: 4/0,1 mode: PW/PW res: [0x2baa0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.750600:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.750606:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+166:41278:x1731746396421824:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 38us (77us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.750608:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+166:41278:x1731746396421696:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 45us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.750609:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13182 00000100:00100000:0.0:1651529344.750611:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13181 00010000:00010000:1.0:1651529344.750617:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52bf1 lrc: 3/0,1 mode: PW/PW res: [0x2ba9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.750618:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c52bea lrc: 3/0,1 mode: PW/PW res: [0x2ba9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.750620:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52bf1 lrc: 3/0,1 mode: PW/PW res: [0x2ba9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.750623:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52bf1 lrc: 3/0,1 mode: PW/PW res: [0x2ba9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.750626:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52bf1 lrc: 2/0,0 mode: PW/PW res: [0x2ba9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.750639:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c52bea lrc: 3/0,1 mode: PW/PW res: [0x2ba9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.750652:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c52bea lrc: 3/0,1 mode: PW/PW res: [0x2ba9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.750655:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c52bea lrc: 2/0,0 mode: PW/PW res: [0x2ba9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.750678:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1897:39030:x1731745946540608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1088us (1163us total) trans 12885080453 rc 0/0 00000100:00100000:1.0:1651529344.750681:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212399 00010000:00010000:1.0:1651529344.750688:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52bf8 lrc: 3/0,1 mode: PW/PW res: [0x2baa0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.750691:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52bf8 lrc: 3/0,1 mode: PW/PW res: [0x2baa0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.750694:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52bf8 lrc: 3/0,1 mode: PW/PW res: [0x2baa0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.750696:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52bf8 lrc: 2/0,0 mode: PW/PW res: [0x2baa0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.750696:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1896:39029:x1731745946540544:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1164us (1232us total) trans 12885080454 rc 0/0 00000100:00100000:0.0:1651529344.750699:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212398 00010000:00010000:0.0:1651529344.750729:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52bf1 lrc: 2/0,0 mode: PW/PW res: [0x2ba9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.750733:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000050e053bc already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.750743:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52bf1 lrc: 2/0,0 mode: PW/PW res: [0x2ba9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.750744:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1896:39030:x1731745946540672:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1027us (1055us total) trans 12885080455 rc 0/0 00000100:00100000:1.0:1651529344.750747:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212400 00010000:00010000:0.0:1651529344.750749:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52bf1 lrc: 3/0,0 mode: PW/PW res: [0x2ba9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.750754:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52bf1 lrc: 1/0,0 mode: --/PW res: [0x2ba9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.750755:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c52bea lrc: 2/0,0 mode: PW/PW res: [0x2ba9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.750756:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52bf1 lrc: 0/0,0 mode: --/PW res: [0x2ba9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.750758:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042bde05b already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.750759:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c52bea lrc: 2/0,0 mode: PW/PW res: [0x2ba9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.750761:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52bf8 lrc: 2/0,0 mode: PW/PW res: [0x2baa0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.750762:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c52bea lrc: 3/0,0 mode: PW/PW res: [0x2ba9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.750764:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009e44ce9d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.750765:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52bf8 lrc: 2/0,0 mode: PW/PW res: [0x2baa0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.750766:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c52bea lrc: 1/0,0 mode: --/PW res: [0x2ba9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.750767:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52bf8 lrc: 3/0,0 mode: PW/PW res: [0x2baa0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.750770:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52bf8 lrc: 1/0,0 mode: --/PW res: [0x2baa0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.750772:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c52bea lrc: 0/0,0 mode: --/PW res: [0x2ba9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.750773:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52bf8 lrc: 0/0,0 mode: --/PW res: [0x2baa0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.750824:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.750839:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946540800 00000100:00100000:1.0:1651529344.750878:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212402 00000100:00100000:1.0:1651529344.750880:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1896:39030:x1731745946540800:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.750885:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178850 count 1 00010000:00010000:1.0:1651529344.750889:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52c06 lrc: 3/0,1 mode: --/PW res: [0x2baa2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.750894:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000778d3bd8/0x3234de053c4cfd2 lrc: 2/0,0 mode: PR/PR res: [0x2baa2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf0cd expref: 164 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.750897:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.750898:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.750898:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52c06 lrc: 4/0,1 mode: --/PW res: [0x2baa2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.750905:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000778d3bd8/0x3234de053c4cfd2 lrc: 3/0,0 mode: PR/PR res: [0x2baa2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf0cd expref: 164 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.750909:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000778d3bd8/0x3234de053c4cfd2 lrc: 4/0,0 mode: PR/PR res: [0x2baa2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf0cd expref: 164 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.750913:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003de40890 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997060480:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.750928:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 000000004ca54b8a going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.750940:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.750960:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.750965:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946540864 00000100:00100000:1.0:1651529344.750968:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.750983:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946540928 00000100:00100000:1.0:1651529344.750984:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.750988:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946540992 00000100:00100000:1.0:1651529344.750991:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946541056 00000100:00100000:0.0:1651529344.750995:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212403 00000100:00100000:0.0:1651529344.750997:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1900:39030:x1731745946540864:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.751002:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178851 count 1 00000100:00100000:1.0:1651529344.751003:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212404 00000100:00100000:1.0:1651529344.751004:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1900:39030:x1731745946540928:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.751009:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178852 count 1 00010000:00010000:1.0:1651529344.751013:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52c0d lrc: 3/0,1 mode: --/PW res: [0x2baa4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.751017:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e19889c9/0x3234de053c4e191 lrc: 2/0,0 mode: PR/PR res: [0x2baa4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3798 expref: 164 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.751020:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.751021:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.751022:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52c0d lrc: 4/0,1 mode: --/PW res: [0x2baa4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.751043:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e19889c9/0x3234de053c4e191 lrc: 3/0,0 mode: PR/PR res: [0x2baa4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3798 expref: 164 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.751046:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e19889c9/0x3234de053c4e191 lrc: 4/0,0 mode: PR/PR res: [0x2baa4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3798 expref: 164 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.751048:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c52c14 lrc: 3/0,1 mode: --/PW res: [0x2baa3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.751050:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004972eb27 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997060544:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.751053:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c49f57 lrc: 2/0,0 mode: PR/PR res: [0x2baa3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb3a9 expref: 164 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.751057:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.751057:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.751058:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c52c14 lrc: 4/0,1 mode: --/PW res: [0x2baa3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.751059:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000babe2d90 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.751065:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212405 00010000:00010000:0.0:1651529344.751066:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c49f57 lrc: 3/0,0 mode: PR/PR res: [0x2baa3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb3a9 expref: 164 pid: 80277 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.751067:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d3f0e749 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1900:39030:x1731745946540992:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.751069:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c49f57 lrc: 4/0,0 mode: PR/PR res: [0x2baa3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb3a9 expref: 164 pid: 80277 timeout: 20103 lvb_type: 1 00002000:00080000:1.0:1651529344.751071:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178853 count 1 00000100:00100000:0.0:1651529344.751073:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ad6d0877 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997060608:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.751074:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52c1b lrc: 3/0,1 mode: --/PW res: [0x2baa5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.751079:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004d872ea8/0x3234de053c4cd16 lrc: 2/0,0 mode: PR/PR res: [0x2baa5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce670 expref: 164 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.751082:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.751082:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.751083:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52c1b lrc: 4/0,1 mode: --/PW res: [0x2baa5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.751083:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e1aa6a77 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.751088:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004d872ea8/0x3234de053c4cd16 lrc: 3/0,0 mode: PR/PR res: [0x2baa5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce670 expref: 164 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.751092:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004d872ea8/0x3234de053c4cd16 lrc: 4/0,0 mode: PR/PR res: [0x2baa5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce670 expref: 164 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.751096:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003e3f0f77 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997060672:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.751102:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.751103:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212406 00000100:00100000:0.0:1651529344.751105:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1900:39030:x1731745946541056:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.751110:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178854 count 1 00010000:00010000:0.0:1651529344.751114:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c52c22 lrc: 3/0,1 mode: --/PW res: [0x2baa6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.751115:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.751118:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000116bf26f/0x3234de053c4a04c lrc: 2/0,0 mode: PR/PR res: [0x2baa6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb706 expref: 164 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.751137:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.751138:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.751139:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c52c22 lrc: 4/0,1 mode: --/PW res: [0x2baa6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.751143:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.751146:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000116bf26f/0x3234de053c4a04c lrc: 3/0,0 mode: PR/PR res: [0x2baa6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb706 expref: 164 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.751150:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000116bf26f/0x3234de053c4a04c lrc: 4/0,0 mode: PR/PR res: [0x2baa6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb706 expref: 164 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.751154:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000673bcbe2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997060736:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.751162:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 0000000070e666f7 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.751169:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000037ac96ac pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997060416:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.751172:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c52bff lrc: 3/0,1 mode: --/PW res: [0x2baa1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.751179:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946541120 00000100:00100000:0.0:1651529344.751190:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946541184 00000100:00100000:0.0:1651529344.751195:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212407 00000100:00100000:0.0:1651529344.751196:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1902:39029:x1731745946541120:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.751201:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178855 count 1 00010000:00010000:0.0:1651529344.751204:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c52c29 lrc: 3/0,1 mode: --/PW res: [0x2baa7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.751209:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.751209:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c8f47df5/0x3234de053c4c949 lrc: 2/0,0 mode: PR/PR res: [0x2baa7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd6a9 expref: 164 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.751212:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.751212:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.751213:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c52c29 lrc: 4/0,1 mode: --/PW res: [0x2baa7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.751217:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.751243:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212408 00000100:00100000:1.0:1651529344.751245:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1902:39029:x1731745946541184:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.751251:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178856 count 1 00010000:00010000:0.0:1651529344.751254:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c8f47df5/0x3234de053c4c949 lrc: 3/0,0 mode: PR/PR res: [0x2baa7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd6a9 expref: 164 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.751255:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52c30 lrc: 3/0,1 mode: --/PW res: [0x2baa8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.751258:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c8f47df5/0x3234de053c4c949 lrc: 4/0,0 mode: PR/PR res: [0x2baa7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd6a9 expref: 164 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.751259:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003e145e11/0x3234de053c4f44c lrc: 2/0,0 mode: PR/PR res: [0x2baa8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83f0 expref: 164 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.751263:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.751263:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.751263:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000037ac96ac pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997060800:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.751264:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52c30 lrc: 4/0,1 mode: --/PW res: [0x2baa8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.751270:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003e145e11/0x3234de053c4f44c lrc: 3/0,0 mode: PR/PR res: [0x2baa8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83f0 expref: 164 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.751274:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003e145e11/0x3234de053c4f44c lrc: 4/0,0 mode: PR/PR res: [0x2baa8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83f0 expref: 164 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.751277:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ff7bf023 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.751285:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004089c807 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997060864:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.751294:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cfa1ca05 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.751301:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396421888 00010000:00010000:1.0:1651529344.751331:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c473d13f/0x3234de053c4c384 lrc: 4/0,0 mode: PR/PR res: [0x2baa1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc912 expref: 165 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.751341:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396421952 00010000:00010000:1.0:1651529344.751345:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000778d3bd8/0x3234de053c4cfd2 lrc: 5/0,0 mode: PR/PR res: [0x2baa2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf0cd expref: 166 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.751347:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13183 00000100:00100000:0.0:1651529344.751349:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+166:41278:x1731746396421888:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.751352:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.751354:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13184 00010000:00010000:0.0:1651529344.751354:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c473d13f/0x3234de053c4c384 lrc: 4/0,0 mode: PR/PR res: [0x2baa1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc912 expref: 166 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.751356:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082df86ec pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+166:41278:x1731746396421952:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.751359:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.751359:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c473d13f/0x3234de053c4c384 lrc: 3/0,0 mode: PR/PR res: [0x2baa1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc912 expref: 166 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.751360:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000778d3bd8/0x3234de053c4cfd2 lrc: 5/0,0 mode: PR/PR res: [0x2baa2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf0cd expref: 166 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.751364:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000778d3bd8/0x3234de053c4cfd2 lrc: 4/0,0 mode: PR/PR res: [0x2baa2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf0cd expref: 166 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.751367:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c473d13f/0x3234de053c4c384 lrc: 0/0,0 mode: --/PR res: [0x2baa1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc912 expref: 166 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.751369:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.751370:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.751370:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52c06 lrc: 3/0,1 mode: PW/PW res: [0x2baa2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.751371:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.751371:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.751372:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c52bff lrc: 3/0,1 mode: PW/PW res: [0x2baa1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.751373:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52c06 lrc: 4/0,1 mode: PW/PW res: [0x2baa2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.751375:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c52bff lrc: 4/0,1 mode: PW/PW res: [0x2baa1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.751378:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.751382:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.751389:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082df86ec pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+165:41278:x1731746396421952:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 32us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.751392:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13184 00000100:00100000:0.0:1651529344.751395:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+164:41278:x1731746396421888:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 46us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.751398:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13183 00010000:00010000:1.0:1651529344.751404:0:72397:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000778d3bd8/0x3234de053c4cfd2 lrc: 0/0,0 mode: --/PR res: [0x2baa2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf0cd expref: 163 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.751408:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003de40890 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997060480:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.751409:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c52bff lrc: 3/0,1 mode: PW/PW res: [0x2baa1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.751413:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52c06 lrc: 3/0,1 mode: PW/PW res: [0x2baa2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.751413:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c52bff lrc: 3/0,1 mode: PW/PW res: [0x2baa1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.751416:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52c06 lrc: 3/0,1 mode: PW/PW res: [0x2baa2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.751416:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c52bff lrc: 3/0,1 mode: PW/PW res: [0x2baa1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.751418:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c52bff lrc: 2/0,0 mode: PW/PW res: [0x2baa1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.751419:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52c06 lrc: 3/0,1 mode: PW/PW res: [0x2baa2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.751422:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52c06 lrc: 3/0,1 mode: PW/PW res: [0x2baa2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.751424:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52c06 lrc: 2/0,0 mode: PW/PW res: [0x2baa2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.751486:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1904:39030:x1731745946540800:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 606us (663us total) trans 12885080457 rc 0/0 00000100:00100000:0.0:1651529344.751486:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1904:39030:x1731745946540736:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1343us (1489us total) trans 12885080456 rc 0/0 00000100:00100000:0.0:1651529344.751489:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212401 00000100:00100000:1.0:1651529344.751490:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212402 00010000:00010000:1.0:1651529344.751498:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c52bff lrc: 2/0,0 mode: PW/PW res: [0x2baa1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.751501:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000916cff2 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.751502:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c52bff lrc: 2/0,0 mode: PW/PW res: [0x2baa1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.751505:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c52bff lrc: 3/0,0 mode: PW/PW res: [0x2baa1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.751505:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52c06 lrc: 2/0,0 mode: PW/PW res: [0x2baa2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.751509:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003c075ac0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.751510:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52c06 lrc: 2/0,0 mode: PW/PW res: [0x2baa2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.751512:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c52bff lrc: 1/0,0 mode: --/PW res: [0x2baa1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.751513:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52c06 lrc: 3/0,0 mode: PW/PW res: [0x2baa2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.751515:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c52bff lrc: 0/0,0 mode: --/PW res: [0x2baa1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.751518:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52c06 lrc: 1/0,0 mode: --/PW res: [0x2baa2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.751521:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52c06 lrc: 0/0,0 mode: --/PW res: [0x2baa2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.751572:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004972eb27 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997060544:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.751577:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52c0d lrc: 3/0,1 mode: --/PW res: [0x2baa4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.751647:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.751653:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.751655:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003e3f0f77 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997060672:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.751662:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.751664:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52c1b lrc: 3/0,1 mode: --/PW res: [0x2baa5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.751670:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.751681:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396422016 00000100:00100000:0.0:1651529344.751684:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.751686:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c49f57 lrc: 5/0,0 mode: PR/PR res: [0x2baa3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb3a9 expref: 163 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.751700:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396422080 00010000:00010000:1.0:1651529344.751702:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e19889c9/0x3234de053c4e191 lrc: 4/0,0 mode: PR/PR res: [0x2baa4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3798 expref: 164 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.751706:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396422144 00010000:00010000:1.0:1651529344.751714:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004d872ea8/0x3234de053c4cd16 lrc: 4/0,0 mode: PR/PR res: [0x2baa5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce670 expref: 165 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.751714:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.751721:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396422208 00000100:00100000:0.0:1651529344.751723:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000673bcbe2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997060736:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.751724:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000116bf26f/0x3234de053c4a04c lrc: 4/0,0 mode: PR/PR res: [0x2baa6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb706 expref: 166 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.751727:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c52c22 lrc: 3/0,1 mode: --/PW res: [0x2baa6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.751728:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396422272 00010000:00010000:1.0:1651529344.751730:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c8f47df5/0x3234de053c4c949 lrc: 5/0,0 mode: PR/PR res: [0x2baa7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd6a9 expref: 167 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.751742:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396422336 00000100:00100000:0.0:1651529344.751743:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ad6d0877 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997060608:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.751745:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003e145e11/0x3234de053c4f44c lrc: 5/0,0 mode: PR/PR res: [0x2baa8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83f0 expref: 168 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.751746:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c52c14 lrc: 3/0,1 mode: --/PW res: [0x2baa3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.751750:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13185 00000100:00100000:1.0:1651529344.751752:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+168:41279:x1731746396422016:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.751753:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000037ac96ac pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997060800:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.751755:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.751756:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c49f57 lrc: 4/0,0 mode: PR/PR res: [0x2baa3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb3a9 expref: 168 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.751756:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c52c29 lrc: 3/0,1 mode: --/PW res: [0x2baa7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.751760:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c49f57 lrc: 3/0,0 mode: PR/PR res: [0x2baa3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb3a9 expref: 168 pid: 80277 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.751762:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13186 00000100:00100000:0.0:1651529344.751764:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+168:41278:x1731746396422080:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.751765:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c49f57 lrc: 0/0,0 mode: --/PR res: [0x2baa3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb3a9 expref: 168 pid: 80277 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.751768:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.751769:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.751769:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.751770:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c52c14 lrc: 3/0,1 mode: PW/PW res: [0x2baa3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.751770:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e19889c9/0x3234de053c4e191 lrc: 4/0,0 mode: PR/PR res: [0x2baa4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3798 expref: 167 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.751773:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e19889c9/0x3234de053c4e191 lrc: 3/0,0 mode: PR/PR res: [0x2baa4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3798 expref: 167 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.751774:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c52c14 lrc: 4/0,1 mode: PW/PW res: [0x2baa3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.751779:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e19889c9/0x3234de053c4e191 lrc: 0/0,0 mode: --/PR res: [0x2baa4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3798 expref: 167 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.751783:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.751790:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.751792:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+166:41279:x1731746396422016:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 39us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.751795:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13185 00000100:00100000:1.0:1651529344.751800:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13187 00000100:00100000:1.0:1651529344.751801:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+165:41279:x1731746396422144:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.751804:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.751805:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004d872ea8/0x3234de053c4cd16 lrc: 4/0,0 mode: PR/PR res: [0x2baa5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce670 expref: 165 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.751806:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.751807:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52c0d lrc: 3/0,1 mode: PW/PW res: [0x2baa4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.751809:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004d872ea8/0x3234de053c4cd16 lrc: 3/0,0 mode: PR/PR res: [0x2baa5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce670 expref: 165 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.751810:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52c0d lrc: 4/0,1 mode: PW/PW res: [0x2baa4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.751814:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d872ea8/0x3234de053c4cd16 lrc: 0/0,0 mode: --/PR res: [0x2baa5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce670 expref: 165 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.751817:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.751820:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.751824:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.751825:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52c1b lrc: 3/0,1 mode: PW/PW res: [0x2baa5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.751828:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+164:41278:x1731746396422080:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 63us (174us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.751830:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52c1b lrc: 4/0,1 mode: PW/PW res: [0x2baa5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.751831:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13186 00010000:00010000:1.0:1651529344.751836:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.751837:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13188 00000100:00100000:0.0:1651529344.751839:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+163:41278:x1731746396422208:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.751841:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.751842:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+163:41279:x1731746396422144:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (180us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.751843:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000116bf26f/0x3234de053c4a04c lrc: 4/0,0 mode: PR/PR res: [0x2baa6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb706 expref: 163 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.751844:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13187 00010000:00010000:0.0:1651529344.751847:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000116bf26f/0x3234de053c4a04c lrc: 3/0,0 mode: PR/PR res: [0x2baa6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb706 expref: 162 pid: 72397 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.751849:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13189 00000100:00100000:1.0:1651529344.751850:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+162:41278:x1731746396422272:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.751852:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000116bf26f/0x3234de053c4a04c lrc: 0/0,0 mode: --/PR res: [0x2baa6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb706 expref: 162 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.751853:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.751854:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c8f47df5/0x3234de053c4c949 lrc: 4/0,0 mode: PR/PR res: [0x2baa7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd6a9 expref: 162 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.751855:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.751856:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.751857:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c52c22 lrc: 3/0,1 mode: PW/PW res: [0x2baa6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.751858:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c8f47df5/0x3234de053c4c949 lrc: 3/0,0 mode: PR/PR res: [0x2baa7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd6a9 expref: 161 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.751859:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c52c22 lrc: 4/0,1 mode: PW/PW res: [0x2baa6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.751863:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8f47df5/0x3234de053c4c949 lrc: 0/0,0 mode: --/PR res: [0x2baa7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd6a9 expref: 161 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.751866:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.751866:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.751867:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.751867:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c52c29 lrc: 3/0,1 mode: PW/PW res: [0x2baa7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.751870:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c52c29 lrc: 4/0,1 mode: PW/PW res: [0x2baa7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.751871:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+160:41278:x1731746396422208:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 32us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.751874:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13188 00000100:00100000:0.0:1651529344.751878:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13190 00010000:00010000:1.0:1651529344.751882:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.751885:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+159:41279:x1731746396422336:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.751887:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+159:41278:x1731746396422272:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (203us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.751889:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.751890:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13189 00010000:00010000:0.0:1651529344.751890:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003e145e11/0x3234de053c4f44c lrc: 5/0,0 mode: PR/PR res: [0x2baa8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83f0 expref: 159 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.751894:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003e145e11/0x3234de053c4f44c lrc: 4/0,0 mode: PR/PR res: [0x2baa8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83f0 expref: 158 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.751899:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.751900:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.751900:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52c30 lrc: 3/0,1 mode: PW/PW res: [0x2baa8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.751902:0:80280:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e145e11/0x3234de053c4f44c lrc: 0/0,0 mode: --/PR res: [0x2baa8:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d83f0 expref: 158 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.751903:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52c30 lrc: 4/0,1 mode: PW/PW res: [0x2baa8:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.751906:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004089c807 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997060864:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.751908:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.751909:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52c30 lrc: 3/0,1 mode: PW/PW res: [0x2baa8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.751912:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52c30 lrc: 3/0,1 mode: PW/PW res: [0x2baa8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.751913:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+157:41279:x1731746396422336:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 33us (199us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.751915:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52c30 lrc: 3/0,1 mode: PW/PW res: [0x2baa8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.751916:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13190 00010000:00010000:1.0:1651529344.751918:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52c30 lrc: 3/0,1 mode: PW/PW res: [0x2baa8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.751921:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52c30 lrc: 2/0,0 mode: PW/PW res: [0x2baa8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.751922:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c52c22 lrc: 3/0,1 mode: PW/PW res: [0x2baa6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.751925:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c52c22 lrc: 3/0,1 mode: PW/PW res: [0x2baa6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.751935:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c52c22 lrc: 3/0,1 mode: PW/PW res: [0x2baa6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.751937:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c52c22 lrc: 2/0,0 mode: PW/PW res: [0x2baa6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.751971:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1904:39029:x1731745946541184:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 725us (827us total) trans 12885080458 rc 0/0 00000100:00100000:1.0:1651529344.751975:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212408 00000100:00100000:0.0:1651529344.751980:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1903:39030:x1731745946541056:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 875us (997us total) trans 12885080459 rc 0/0 00010000:00010000:1.0:1651529344.751982:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52c0d lrc: 3/0,1 mode: PW/PW res: [0x2baa4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.751983:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212406 00010000:00010000:1.0:1651529344.751985:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52c0d lrc: 3/0,1 mode: PW/PW res: [0x2baa4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.751989:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52c0d lrc: 3/0,1 mode: PW/PW res: [0x2baa4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.751991:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52c0d lrc: 2/0,0 mode: PW/PW res: [0x2baa4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.751991:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52c30 lrc: 2/0,0 mode: PW/PW res: [0x2baa8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.751994:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f183a40b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.751995:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52c30 lrc: 2/0,0 mode: PW/PW res: [0x2baa8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.752005:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52c30 lrc: 3/0,0 mode: PW/PW res: [0x2baa8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.752010:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52c30 lrc: 1/0,0 mode: --/PW res: [0x2baa8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.752013:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52c30 lrc: 0/0,0 mode: --/PW res: [0x2baa8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.752018:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c52c22 lrc: 2/0,0 mode: PW/PW res: [0x2baa6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.752021:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000a7c37b9 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.752022:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c52c22 lrc: 2/0,0 mode: PW/PW res: [0x2baa6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.752024:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c52c22 lrc: 3/0,0 mode: PW/PW res: [0x2baa6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.752027:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c52c22 lrc: 1/0,0 mode: --/PW res: [0x2baa6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.752030:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1903:39030:x1731745946540928:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1025us (1070us total) trans 12885080460 rc 0/0 00010000:00010000:0.0:1651529344.752030:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c52c22 lrc: 0/0,0 mode: --/PW res: [0x2baa6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.752033:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212404 00010000:00010000:0.0:1651529344.752033:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52c0d lrc: 2/0,0 mode: PW/PW res: [0x2baa4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.752036:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008ac1e27e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.752037:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52c0d lrc: 2/0,0 mode: PW/PW res: [0x2baa4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.752039:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52c0d lrc: 3/0,0 mode: PW/PW res: [0x2baa4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.752040:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52c1b lrc: 3/0,1 mode: PW/PW res: [0x2baa5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.752042:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52c0d lrc: 1/0,0 mode: --/PW res: [0x2baa4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.752043:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52c1b lrc: 3/0,1 mode: PW/PW res: [0x2baa5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.752045:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52c0d lrc: 0/0,0 mode: --/PW res: [0x2baa4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.752046:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52c1b lrc: 3/0,1 mode: PW/PW res: [0x2baa5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.752049:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52c1b lrc: 2/0,0 mode: PW/PW res: [0x2baa5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.752055:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c52c14 lrc: 3/0,1 mode: PW/PW res: [0x2baa3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.752058:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c52c14 lrc: 3/0,1 mode: PW/PW res: [0x2baa3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.752061:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c52c14 lrc: 3/0,1 mode: PW/PW res: [0x2baa3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.752064:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c52c14 lrc: 2/0,0 mode: PW/PW res: [0x2baa3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.752082:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d3f0e749 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1904:39030:x1731745946540992:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1014us (1113us total) trans 12885080461 rc 0/0 00000100:00100000:1.0:1651529344.752085:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212405 00010000:00010000:1.0:1651529344.752091:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52c1b lrc: 2/0,0 mode: PW/PW res: [0x2baa5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.752094:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003551d5d1 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.752095:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52c1b lrc: 2/0,0 mode: PW/PW res: [0x2baa5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.752098:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52c1b lrc: 3/0,0 mode: PW/PW res: [0x2baa5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.752099:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1903:39030:x1731745946540864:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1102us (1159us total) trans 12885080462 rc 0/0 00010000:00010000:1.0:1651529344.752102:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52c1b lrc: 1/0,0 mode: --/PW res: [0x2baa5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.752102:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212403 00010000:00010000:1.0:1651529344.752105:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52c1b lrc: 0/0,0 mode: --/PW res: [0x2baa5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.752109:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c52c14 lrc: 2/0,0 mode: PW/PW res: [0x2baa3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.752112:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005e711cee already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.752113:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c52c14 lrc: 2/0,0 mode: PW/PW res: [0x2baa3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.752118:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c52c14 lrc: 3/0,0 mode: PW/PW res: [0x2baa3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.752121:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c52c14 lrc: 1/0,0 mode: --/PW res: [0x2baa3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.752122:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c52c29 lrc: 3/0,1 mode: PW/PW res: [0x2baa7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.752124:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c52c14 lrc: 0/0,0 mode: --/PW res: [0x2baa3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.752126:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c52c29 lrc: 3/0,1 mode: PW/PW res: [0x2baa7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.752129:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c52c29 lrc: 3/0,1 mode: PW/PW res: [0x2baa7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.752134:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c52c29 lrc: 2/0,0 mode: PW/PW res: [0x2baa7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.752140:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.752159:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.752176:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1903:39029:x1731745946541120:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 979us (1061us total) trans 12885080463 rc 0/0 00000100:00100000:0.0:1651529344.752179:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212407 00000100:00100000:0.0:1651529344.752184:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946541248 00000100:00100000:0.0:1651529344.752194:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946541312 00000100:00100000:0.0:1651529344.752200:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212409 00000100:00100000:0.0:1651529344.752202:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1904:39029:x1731745946541248:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.752207:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178857 count 1 00010000:00010000:0.0:1651529344.752211:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c52c37 lrc: 3/0,1 mode: --/PW res: [0x2baa9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.752216:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f7beb859/0x3234de053c4c9e3 lrc: 2/0,0 mode: PR/PR res: [0x2baa9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd99d expref: 156 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.752219:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.752219:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.752220:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c52c37 lrc: 4/0,1 mode: --/PW res: [0x2baa9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.752243:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f7beb859/0x3234de053c4c9e3 lrc: 3/0,0 mode: PR/PR res: [0x2baa9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd99d expref: 156 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.752247:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f7beb859/0x3234de053c4c9e3 lrc: 4/0,0 mode: PR/PR res: [0x2baa9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd99d expref: 156 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.752252:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000824ca843 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997060928:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.752261:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ff7bf023 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.752266:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c52c29 lrc: 2/0,0 mode: PW/PW res: [0x2baa7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.752269:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000055fddd81 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.752270:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c52c29 lrc: 2/0,0 mode: PW/PW res: [0x2baa7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.752273:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c52c29 lrc: 3/0,0 mode: PW/PW res: [0x2baa7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.752277:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c52c29 lrc: 1/0,0 mode: --/PW res: [0x2baa7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.752280:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c52c29 lrc: 0/0,0 mode: --/PW res: [0x2baa7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.752287:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212410 00000100:00100000:0.0:1651529344.752306:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1904:39029:x1731745946541312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.752311:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178858 count 1 00010000:00010000:0.0:1651529344.752315:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52c3e lrc: 3/0,1 mode: --/PW res: [0x2baaa:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.752331:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c089cac7/0x3234de053c4e7f0 lrc: 2/0,0 mode: PR/PR res: [0x2baaa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d505e expref: 156 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.752334:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.752335:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.752335:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52c3e lrc: 4/0,1 mode: --/PW res: [0x2baaa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.752342:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c089cac7/0x3234de053c4e7f0 lrc: 3/0,0 mode: PR/PR res: [0x2baaa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d505e expref: 156 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.752363:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c089cac7/0x3234de053c4e7f0 lrc: 4/0,0 mode: PR/PR res: [0x2baaa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d505e expref: 156 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.752368:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fc130417 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997060992:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.752377:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e1aa6a77 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.752381:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.752385:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946541376 00000100:00100000:0.0:1651529344.752396:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212411 00000100:00100000:0.0:1651529344.752397:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1905:39030:x1731745946541376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.752402:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178859 count 1 00010000:00010000:0.0:1651529344.752406:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c52c45 lrc: 3/0,1 mode: --/PW res: [0x2baab:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.752410:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000032f4cb39/0x3234de053c4b43b lrc: 2/0,0 mode: PR/PR res: [0x2baab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc1f6 expref: 156 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.752413:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.752414:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.752414:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c52c45 lrc: 4/0,1 mode: --/PW res: [0x2baab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.752417:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.752421:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000032f4cb39/0x3234de053c4b43b lrc: 3/0,0 mode: PR/PR res: [0x2baab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc1f6 expref: 156 pid: 72395 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.752424:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946541440 00010000:00010000:0.0:1651529344.752424:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000032f4cb39/0x3234de053c4b43b lrc: 4/0,0 mode: PR/PR res: [0x2baab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc1f6 expref: 156 pid: 72395 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.752428:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ac8dec6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997061056:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.752436:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212412 00000100:00100000:1.0:1651529344.752438:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1906:39029:x1731745946541440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.752443:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178860 count 1 00010000:00010000:1.0:1651529344.752448:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52c4c lrc: 3/0,1 mode: --/PW res: [0x2baac:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.752452:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000021e9f623/0x3234de053c4dfd8 lrc: 2/0,0 mode: PR/PR res: [0x2baac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3091 expref: 156 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.752462:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.752462:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.752463:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52c4c lrc: 4/0,1 mode: --/PW res: [0x2baac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.752480:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000021e9f623/0x3234de053c4dfd8 lrc: 3/0,0 mode: PR/PR res: [0x2baac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3091 expref: 156 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.752481:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b81e4a0 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.752484:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000021e9f623/0x3234de053c4dfd8 lrc: 4/0,0 mode: PR/PR res: [0x2baac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3091 expref: 156 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.752488:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000703c0db9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997061120:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.752497:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 0000000020dd7827 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.752498:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.752504:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946541504 00000100:00100000:1.0:1651529344.752510:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212413 00000100:00100000:1.0:1651529344.752511:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1907:39029:x1731745946541504:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.752516:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178861 count 1 00010000:00010000:1.0:1651529344.752519:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52c53 lrc: 3/0,1 mode: --/PW res: [0x2baad:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.752524:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000057550c66/0x3234de053c4d47f lrc: 2/0,0 mode: PR/PR res: [0x2baad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d03f8 expref: 156 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.752534:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.752534:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.752535:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52c53 lrc: 4/0,1 mode: --/PW res: [0x2baad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.752542:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000057550c66/0x3234de053c4d47f lrc: 3/0,0 mode: PR/PR res: [0x2baad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d03f8 expref: 156 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.752548:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000057550c66/0x3234de053c4d47f lrc: 4/0,0 mode: PR/PR res: [0x2baad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d03f8 expref: 156 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.752552:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.752563:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.752564:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a9b051f pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997061184:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.752572:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.752572:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.752584:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946541632 00000100:00100000:1.0:1651529344.752597:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946541568 00000100:00100000:1.0:1651529344.752602:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212414 00000100:00100000:1.0:1651529344.752604:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1909:39029:x1731745946541632:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.752609:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178863 count 1 00010000:00010000:1.0:1651529344.752612:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52c5a lrc: 3/0,1 mode: --/PW res: [0x2baaf:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.752616:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000081b3faed/0x3234de053c4dc4a lrc: 2/0,0 mode: PR/PR res: [0x2baaf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2180 expref: 156 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.752618:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.752619:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.752620:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.752621:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52c5a lrc: 4/0,1 mode: --/PW res: [0x2baaf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.752624:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.752627:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000081b3faed/0x3234de053c4dc4a lrc: 3/0,0 mode: PR/PR res: [0x2baaf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2180 expref: 156 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.752635:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946541696 00010000:00010000:1.0:1651529344.752636:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000081b3faed/0x3234de053c4dc4a lrc: 4/0,0 mode: PR/PR res: [0x2baaf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2180 expref: 156 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.752642:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212415 00000100:00100000:1.0:1651529344.752643:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007ac35c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997061248:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.752643:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1910:39029:x1731745946541568:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.752649:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178862 count 1 00010000:00010000:0.0:1651529344.752653:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c52c61 lrc: 3/0,1 mode: --/PW res: [0x2baae:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.752656:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fe434b1c going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.752662:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212416 00000100:00100000:1.0:1651529344.752664:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1910:39030:x1731745946541696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.752668:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178864 count 1 00010000:00010000:1.0:1651529344.752672:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52c68 lrc: 3/0,1 mode: --/PW res: [0x2bab0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.752676:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000002c43423/0x3234de053c4e614 lrc: 2/0,0 mode: PR/PR res: [0x2bab0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4988 expref: 156 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.752677:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b388b573/0x3234de053c4d23a lrc: 2/0,0 mode: PR/PR res: [0x2baae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa97 expref: 156 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.752679:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.752679:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.752680:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52c68 lrc: 4/0,1 mode: --/PW res: [0x2bab0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.752681:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.752681:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.752682:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c52c61 lrc: 4/0,1 mode: --/PW res: [0x2baae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.752685:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000002c43423/0x3234de053c4e614 lrc: 3/0,0 mode: PR/PR res: [0x2bab0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4988 expref: 156 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.752689:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000002c43423/0x3234de053c4e614 lrc: 4/0,0 mode: PR/PR res: [0x2bab0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4988 expref: 156 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.752690:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b388b573/0x3234de053c4d23a lrc: 3/0,0 mode: PR/PR res: [0x2baae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa97 expref: 156 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.752693:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000097928145 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997061312:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.752693:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b388b573/0x3234de053c4d23a lrc: 4/0,0 mode: PR/PR res: [0x2baae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa97 expref: 156 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.752698:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f2582a33 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997061376:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.752699:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 000000004698fefb going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.752706:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396422400 00000100:00100000:0.0:1651529344.752706:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000abca413e going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.752711:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f7beb859/0x3234de053c4c9e3 lrc: 5/0,0 mode: PR/PR res: [0x2baa9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd99d expref: 157 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.752715:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fc130417 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997060992:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.752717:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396422464 00010000:00010000:0.0:1651529344.752719:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52c3e lrc: 3/0,1 mode: --/PW res: [0x2baaa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.752720:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c089cac7/0x3234de053c4e7f0 lrc: 4/0,0 mode: PR/PR res: [0x2baaa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d505e expref: 158 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.752725:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13191 00000100:00100000:0.0:1651529344.752725:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000824ca843 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997060928:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.752727:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000619c18c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+158:41279:x1731746396422400:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.752727:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c52c37 lrc: 3/0,1 mode: --/PW res: [0x2baa9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.752729:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.752731:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f7beb859/0x3234de053c4c9e3 lrc: 4/0,0 mode: PR/PR res: [0x2baa9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd99d expref: 158 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.752744:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f7beb859/0x3234de053c4c9e3 lrc: 3/0,0 mode: PR/PR res: [0x2baa9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd99d expref: 158 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.752744:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13192 00000100:00100000:0.0:1651529344.752746:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+158:41279:x1731746396422464:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.752750:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7beb859/0x3234de053c4c9e3 lrc: 0/0,0 mode: --/PR res: [0x2baa9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd99d expref: 158 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.752750:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.752751:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c089cac7/0x3234de053c4e7f0 lrc: 4/0,0 mode: PR/PR res: [0x2baaa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d505e expref: 158 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.752754:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.752755:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.752755:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c52c37 lrc: 3/0,1 mode: PW/PW res: [0x2baa9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.752758:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c089cac7/0x3234de053c4e7f0 lrc: 3/0,0 mode: PR/PR res: [0x2baaa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d505e expref: 157 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.752759:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c52c37 lrc: 4/0,1 mode: PW/PW res: [0x2baa9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.752764:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c089cac7/0x3234de053c4e7f0 lrc: 0/0,0 mode: --/PR res: [0x2baaa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d505e expref: 157 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.752767:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.752773:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.752774:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000619c18c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+156:41279:x1731746396422400:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 47us (211us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.752774:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.752775:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52c3e lrc: 3/0,1 mode: PW/PW res: [0x2baaa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.752777:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13191 00010000:00010000:0.0:1651529344.752778:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52c3e lrc: 4/0,1 mode: PW/PW res: [0x2baaa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.752784:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.752791:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+155:41279:x1731746396422464:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 44us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.752793:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13192 00010000:00010000:0.0:1651529344.752800:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52c3e lrc: 3/0,1 mode: PW/PW res: [0x2baaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.752830:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52c3e lrc: 3/0,1 mode: PW/PW res: [0x2baaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.752834:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52c3e lrc: 3/0,1 mode: PW/PW res: [0x2baaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.752839:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.752839:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52c3e lrc: 2/0,0 mode: PW/PW res: [0x2baaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.752883:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1911:39029:x1731745946541312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 577us (725us total) trans 12885080464 rc 0/0 00000100:00100000:0.0:1651529344.752886:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212410 00000100:00100000:1.0:1651529344.752893:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.752894:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52c3e lrc: 2/0,0 mode: PW/PW res: [0x2baaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.752897:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000082ae179c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.752898:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52c3e lrc: 2/0,0 mode: PW/PW res: [0x2baaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.752901:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52c3e lrc: 3/0,0 mode: PW/PW res: [0x2baaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.752905:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52c3e lrc: 1/0,0 mode: --/PW res: [0x2baaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.752908:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52c3e lrc: 0/0,0 mode: --/PW res: [0x2baaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.752918:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ac8dec6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997061056:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.752921:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.752921:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c52c45 lrc: 3/0,1 mode: --/PW res: [0x2baab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.752928:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c52c37 lrc: 3/0,1 mode: PW/PW res: [0x2baa9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.752931:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c52c37 lrc: 3/0,1 mode: PW/PW res: [0x2baa9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.752934:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c52c37 lrc: 3/0,1 mode: PW/PW res: [0x2baa9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.752937:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c52c37 lrc: 2/0,0 mode: PW/PW res: [0x2baa9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.752955:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000703c0db9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997061120:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.752960:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52c4c lrc: 3/0,1 mode: --/PW res: [0x2baac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.752968:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a9b051f pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997061184:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.752970:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52c53 lrc: 3/0,1 mode: --/PW res: [0x2baad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.752976:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396422528 00010000:00010000:1.0:1651529344.752980:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000032f4cb39/0x3234de053c4b43b lrc: 4/0,0 mode: PR/PR res: [0x2baab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc1f6 expref: 155 pid: 72395 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.752987:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396422656 00010000:00010000:1.0:1651529344.752989:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000057550c66/0x3234de053c4d47f lrc: 4/0,0 mode: PR/PR res: [0x2baad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d03f8 expref: 156 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.752993:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396422592 00000100:00100000:0.0:1651529344.752998:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1911:39029:x1731745946541248:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 795us (857us total) trans 12885080465 rc 0/0 00010000:00010000:1.0:1651529344.753001:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000021e9f623/0x3234de053c4dfd8 lrc: 4/0,0 mode: PR/PR res: [0x2baac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3091 expref: 157 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.753001:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212409 00000100:00100000:1.0:1651529344.753007:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13193 00000100:00100000:1.0:1651529344.753008:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+157:41278:x1731746396422528:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.753009:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13194 00010000:00010000:1.0:1651529344.753011:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.753011:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+157:41279:x1731746396422656:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.753012:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000032f4cb39/0x3234de053c4b43b lrc: 4/0,0 mode: PR/PR res: [0x2baab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc1f6 expref: 157 pid: 72395 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.753014:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.753016:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000032f4cb39/0x3234de053c4b43b lrc: 3/0,0 mode: PR/PR res: [0x2baab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc1f6 expref: 157 pid: 72395 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.753016:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000057550c66/0x3234de053c4d47f lrc: 4/0,0 mode: PR/PR res: [0x2baad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d03f8 expref: 157 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.753020:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000057550c66/0x3234de053c4d47f lrc: 3/0,0 mode: PR/PR res: [0x2baad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d03f8 expref: 157 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.753021:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032f4cb39/0x3234de053c4b43b lrc: 0/0,0 mode: --/PR res: [0x2baab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc1f6 expref: 157 pid: 72395 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.753025:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.753026:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.753026:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c52c45 lrc: 3/0,1 mode: PW/PW res: [0x2baab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.753026:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057550c66/0x3234de053c4d47f lrc: 0/0,0 mode: --/PR res: [0x2baad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d03f8 expref: 156 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.753029:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c52c45 lrc: 4/0,1 mode: PW/PW res: [0x2baab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.753030:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.753031:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.753031:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52c53 lrc: 3/0,1 mode: PW/PW res: [0x2baad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.753034:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52c53 lrc: 4/0,1 mode: PW/PW res: [0x2baad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.753039:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.753046:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+155:41278:x1731746396422528:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (207us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.753050:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.753055:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13193 00000100:00100000:0.0:1651529344.753056:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+155:41279:x1731746396422656:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 45us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.753059:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13194 00000100:00100000:1.0:1651529344.753061:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13195 00000100:00100000:1.0:1651529344.753063:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+154:41279:x1731746396422592:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.753065:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.753067:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000021e9f623/0x3234de053c4dfd8 lrc: 4/0,0 mode: PR/PR res: [0x2baac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3091 expref: 154 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.753071:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000021e9f623/0x3234de053c4dfd8 lrc: 3/0,0 mode: PR/PR res: [0x2baac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3091 expref: 154 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.753076:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021e9f623/0x3234de053c4dfd8 lrc: 0/0,0 mode: --/PR res: [0x2baac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3091 expref: 153 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.753080:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.753080:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.753081:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52c4c lrc: 3/0,1 mode: PW/PW res: [0x2baac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.753081:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c52c45 lrc: 3/0,1 mode: PW/PW res: [0x2baab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.753084:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52c4c lrc: 4/0,1 mode: PW/PW res: [0x2baac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.753085:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c52c45 lrc: 3/0,1 mode: PW/PW res: [0x2baab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.753088:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c52c45 lrc: 3/0,1 mode: PW/PW res: [0x2baab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.753090:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.753090:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c52c45 lrc: 2/0,0 mode: PW/PW res: [0x2baab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.753095:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+152:41279:x1731746396422592:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 32us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.753097:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13195 00010000:00010000:1.0:1651529344.753104:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c52c37 lrc: 2/0,0 mode: PW/PW res: [0x2baa9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.753107:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000009fe5580 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.753108:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c52c37 lrc: 2/0,0 mode: PW/PW res: [0x2baa9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.753111:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c52c37 lrc: 3/0,0 mode: PW/PW res: [0x2baa9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.753115:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c52c37 lrc: 1/0,0 mode: --/PW res: [0x2baa9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.753118:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c52c37 lrc: 0/0,0 mode: --/PW res: [0x2baa9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.753122:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c52c45 lrc: 2/0,0 mode: PW/PW res: [0x2baab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.753125:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000036d87bb6 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.753126:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c52c45 lrc: 2/0,0 mode: PW/PW res: [0x2baab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.753129:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c52c45 lrc: 3/0,0 mode: PW/PW res: [0x2baab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.753132:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c52c45 lrc: 1/0,0 mode: --/PW res: [0x2baab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.753135:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c52c45 lrc: 0/0,0 mode: --/PW res: [0x2baab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.753140:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52c53 lrc: 3/0,1 mode: PW/PW res: [0x2baad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.753143:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52c53 lrc: 3/0,1 mode: PW/PW res: [0x2baad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.753148:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52c53 lrc: 3/0,1 mode: PW/PW res: [0x2baad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.753160:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52c53 lrc: 2/0,0 mode: PW/PW res: [0x2baad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.753163:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1911:39030:x1731745946541376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 764us (782us total) trans 12885080466 rc 0/0 00000100:00100000:0.0:1651529344.753166:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212411 00010000:00010000:0.0:1651529344.753180:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52c53 lrc: 2/0,0 mode: PW/PW res: [0x2baad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.753183:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000575eb734 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.753184:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52c53 lrc: 2/0,0 mode: PW/PW res: [0x2baad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.753188:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52c53 lrc: 3/0,0 mode: PW/PW res: [0x2baad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.753192:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52c53 lrc: 1/0,0 mode: --/PW res: [0x2baad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.753195:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52c53 lrc: 0/0,0 mode: --/PW res: [0x2baad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.753205:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1911:39029:x1731745946541504:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 693us (707us total) trans 12885080467 rc 0/0 00000100:00100000:1.0:1651529344.753208:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212413 00000100:00100000:0.0:1651529344.753212:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.753216:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52c4c lrc: 3/0,1 mode: PW/PW res: [0x2baac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.753244:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52c4c lrc: 3/0,1 mode: PW/PW res: [0x2baac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.753247:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52c4c lrc: 3/0,1 mode: PW/PW res: [0x2baac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.753250:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52c4c lrc: 2/0,0 mode: PW/PW res: [0x2baac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.753292:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.753308:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1911:39029:x1731745946541440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 870us (891us total) trans 12885080468 rc 0/0 00000100:00100000:1.0:1651529344.753311:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212412 00000100:00100000:0.0:1651529344.753314:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.753326:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946541760 00000100:00100000:1.0:1651529344.753340:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212417 00000100:00100000:1.0:1651529344.753342:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1911:39030:x1731745946541760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.753347:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178865 count 1 00010000:00010000:1.0:1651529344.753351:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52c6f lrc: 3/0,1 mode: --/PW res: [0x2bab1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.753356:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009a5b09c3/0x3234de053c4d718 lrc: 2/0,0 mode: PR/PR res: [0x2bab1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e0f expref: 151 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.753358:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.753359:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.753359:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.753360:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52c6f lrc: 4/0,1 mode: --/PW res: [0x2bab1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.753372:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f2582a33 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997061376:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.753373:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009a5b09c3/0x3234de053c4d718 lrc: 3/0,0 mode: PR/PR res: [0x2bab1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e0f expref: 151 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.753377:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009a5b09c3/0x3234de053c4d718 lrc: 4/0,0 mode: PR/PR res: [0x2bab1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e0f expref: 151 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.753377:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c52c61 lrc: 3/0,1 mode: --/PW res: [0x2baae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.753381:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005cc6463a pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997061440:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.753395:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 0000000057299e7f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.753403:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007ac35c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997061248:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.753406:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52c5a lrc: 3/0,1 mode: --/PW res: [0x2baaf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.753413:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000097928145 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997061312:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.753423:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52c68 lrc: 3/0,1 mode: --/PW res: [0x2bab0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.753430:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396422784 00010000:00010000:1.0:1651529344.753434:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000002c43423/0x3234de053c4e614 lrc: 4/0,0 mode: PR/PR res: [0x2bab0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4988 expref: 152 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.753444:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396422720 00010000:00010000:1.0:1651529344.753447:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000081b3faed/0x3234de053c4dc4a lrc: 4/0,0 mode: PR/PR res: [0x2baaf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2180 expref: 153 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.753451:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396422848 00010000:00010000:1.0:1651529344.753453:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b388b573/0x3234de053c4d23a lrc: 4/0,0 mode: PR/PR res: [0x2baae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa97 expref: 154 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.753459:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13196 00000100:00100000:1.0:1651529344.753461:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+154:41279:x1731746396422784:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.753463:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.753464:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000002c43423/0x3234de053c4e614 lrc: 4/0,0 mode: PR/PR res: [0x2bab0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4988 expref: 154 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.753468:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000002c43423/0x3234de053c4e614 lrc: 3/0,0 mode: PR/PR res: [0x2bab0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4988 expref: 154 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.753471:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13197 00010000:00010000:1.0:1651529344.753473:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002c43423/0x3234de053c4e614 lrc: 0/0,0 mode: --/PR res: [0x2bab0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4988 expref: 154 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.753473:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+154:41279:x1731746396422720:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.753477:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.753477:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.753478:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.753478:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52c68 lrc: 3/0,1 mode: PW/PW res: [0x2bab0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.753479:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000081b3faed/0x3234de053c4dc4a lrc: 4/0,0 mode: PR/PR res: [0x2baaf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2180 expref: 153 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.753481:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52c68 lrc: 4/0,1 mode: PW/PW res: [0x2bab0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.753483:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000081b3faed/0x3234de053c4dc4a lrc: 3/0,0 mode: PR/PR res: [0x2baaf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2180 expref: 153 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.753487:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.753489:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081b3faed/0x3234de053c4dc4a lrc: 0/0,0 mode: --/PR res: [0x2baaf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2180 expref: 153 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.753493:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.753493:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.753494:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+152:41279:x1731746396422784:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (202us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.753494:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52c5a lrc: 3/0,1 mode: PW/PW res: [0x2baaf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.753496:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13196 00010000:00010000:0.0:1651529344.753497:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52c5a lrc: 4/0,1 mode: PW/PW res: [0x2baaf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.753500:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13198 00000100:00100000:1.0:1651529344.753502:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b9d7b776 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+151:41279:x1731746396422848:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.753504:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.753506:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b388b573/0x3234de053c4d23a lrc: 4/0,0 mode: PR/PR res: [0x2baae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa97 expref: 151 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.753509:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b388b573/0x3234de053c4d23a lrc: 3/0,0 mode: PR/PR res: [0x2baae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa97 expref: 151 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.753514:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b388b573/0x3234de053c4d23a lrc: 0/0,0 mode: --/PR res: [0x2baae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfa97 expref: 151 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.753519:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.753524:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.753524:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.753525:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c52c61 lrc: 3/0,1 mode: PW/PW res: [0x2baae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.753527:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+150:41279:x1731746396422720:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 54us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.753530:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13197 00010000:00010000:1.0:1651529344.753531:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c52c61 lrc: 4/0,1 mode: PW/PW res: [0x2baae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.753539:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.753545:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b9d7b776 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+149:41279:x1731746396422848:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.753548:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13198 00010000:00010000:1.0:1651529344.753559:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52c5a lrc: 3/0,1 mode: PW/PW res: [0x2baaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.753570:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52c5a lrc: 3/0,1 mode: PW/PW res: [0x2baaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.753570:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.753573:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52c5a lrc: 3/0,1 mode: PW/PW res: [0x2baaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.753576:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52c5a lrc: 2/0,0 mode: PW/PW res: [0x2baaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.753603:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.753625:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.753635:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.753636:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1912:39029:x1731745946541632:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1031us (1084us total) trans 12885080469 rc 0/0 00000100:00100000:1.0:1651529344.753639:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212414 00000100:00100000:1.0:1651529344.753644:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946541824 00000100:00100000:1.0:1651529344.753653:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946541952 00000100:00100000:0.0:1651529344.753662:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.753669:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946541888 00010000:00010000:0.0:1651529344.753672:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c52c61 lrc: 3/0,1 mode: PW/PW res: [0x2baae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.753673:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946542016 00000100:00100000:1.0:1651529344.753676:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212418 00000100:00100000:1.0:1651529344.753678:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1915:39030:x1731745946541824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.753678:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c52c61 lrc: 3/0,1 mode: PW/PW res: [0x2baae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.753681:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c52c61 lrc: 3/0,1 mode: PW/PW res: [0x2baae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.753683:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178866 count 1 00010000:00010000:0.0:1651529344.753684:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c52c61 lrc: 2/0,0 mode: PW/PW res: [0x2baae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.753687:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52c76 lrc: 3/0,1 mode: --/PW res: [0x2bab2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.753692:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000081c22fa3/0x3234de053c4ea58 lrc: 2/0,0 mode: PR/PR res: [0x2bab2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5abb expref: 148 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.753695:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.753695:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.753696:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52c76 lrc: 4/0,1 mode: --/PW res: [0x2bab2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.753703:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000081c22fa3/0x3234de053c4ea58 lrc: 3/0,0 mode: PR/PR res: [0x2bab2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5abb expref: 148 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.753706:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000081c22fa3/0x3234de053c4ea58 lrc: 4/0,0 mode: PR/PR res: [0x2bab2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5abb expref: 148 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.753710:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f9050c71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997061504:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.753724:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a6b79b05 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.753731:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212419 00000100:00100000:0.0:1651529344.753731:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1916:39029:x1731745946541568:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1086us (1158us total) trans 12885080470 rc 0/0 00000100:00100000:1.0:1651529344.753733:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1916:39030:x1731745946541952:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.753744:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212415 00002000:00080000:1.0:1651529344.753746:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178868 count 1 00010000:00010000:1.0:1651529344.753749:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52c7d lrc: 3/0,1 mode: --/PW res: [0x2bab4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.753750:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212420 00000100:00100000:0.0:1651529344.753751:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1915:39030:x1731745946541888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.753756:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ad4922c5/0x3234de053c4e8fa lrc: 2/0,0 mode: PR/PR res: [0x2bab4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d547f expref: 148 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.753757:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178867 count 1 00010000:00010000:1.0:1651529344.753759:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.753760:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.753761:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52c7d lrc: 4/0,1 mode: --/PW res: [0x2bab4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.753761:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52c84 lrc: 3/0,1 mode: --/PW res: [0x2bab3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.753765:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005a5881ba/0x3234de053c4c9dc lrc: 2/0,0 mode: PR/PR res: [0x2bab3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd98f expref: 148 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.753766:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ad4922c5/0x3234de053c4e8fa lrc: 3/0,0 mode: PR/PR res: [0x2bab4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d547f expref: 148 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.753770:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ad4922c5/0x3234de053c4e8fa lrc: 4/0,0 mode: PR/PR res: [0x2bab4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d547f expref: 148 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.753774:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003e3f0f77 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997061568:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.753781:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 0000000071742acc going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.753784:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.753785:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.753785:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52c84 lrc: 4/0,1 mode: --/PW res: [0x2bab3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.753787:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212421 00000100:00100000:1.0:1651529344.753789:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1915:39029:x1731745946542016:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.753793:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178869 count 1 00010000:00010000:1.0:1651529344.753795:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52c8b lrc: 3/0,1 mode: --/PW res: [0x2bab5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.753796:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005a5881ba/0x3234de053c4c9dc lrc: 3/0,0 mode: PR/PR res: [0x2bab3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd98f expref: 148 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.753799:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000081866327/0x3234de053c4d925 lrc: 2/0,0 mode: PR/PR res: [0x2bab5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1555 expref: 148 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.753799:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005a5881ba/0x3234de053c4c9dc lrc: 4/0,0 mode: PR/PR res: [0x2bab3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd98f expref: 148 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.753802:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.753803:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.753804:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52c8b lrc: 4/0,1 mode: --/PW res: [0x2bab5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.753804:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003de40890 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997061632:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.753809:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000081866327/0x3234de053c4d925 lrc: 3/0,0 mode: PR/PR res: [0x2bab5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1555 expref: 148 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.753812:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000abca413e going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.753813:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000081866327/0x3234de053c4d925 lrc: 4/0,0 mode: PR/PR res: [0x2bab5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1555 expref: 148 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.753817:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004972eb27 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997061696:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.753818:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52c4c lrc: 2/0,0 mode: PW/PW res: [0x2baac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.753821:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000877aab61 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.753822:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52c4c lrc: 2/0,0 mode: PW/PW res: [0x2baac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.753823:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b7af823 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.753825:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52c4c lrc: 3/0,0 mode: PW/PW res: [0x2baac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.753829:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396422912 00010000:00010000:0.0:1651529344.753830:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52c4c lrc: 1/0,0 mode: --/PW res: [0x2baac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.753832:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52c4c lrc: 0/0,0 mode: --/PW res: [0x2baac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.753833:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009a5b09c3/0x3234de053c4d718 lrc: 5/0,0 mode: PR/PR res: [0x2bab1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e0f expref: 149 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.753837:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52c5a lrc: 2/0,0 mode: PW/PW res: [0x2baaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.753841:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13199 00000100:00100000:1.0:1651529344.753842:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+149:41279:x1731746396422912:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.753843:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000490515f1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.753843:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52c5a lrc: 2/0,0 mode: PW/PW res: [0x2baaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.753845:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.753846:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009a5b09c3/0x3234de053c4d718 lrc: 5/0,0 mode: PR/PR res: [0x2bab1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e0f expref: 149 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.753846:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52c5a lrc: 3/0,0 mode: PW/PW res: [0x2baaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.753849:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52c5a lrc: 1/0,0 mode: --/PW res: [0x2baaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.753850:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009a5b09c3/0x3234de053c4d718 lrc: 4/0,0 mode: PR/PR res: [0x2bab1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e0f expref: 149 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.753852:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52c5a lrc: 0/0,0 mode: --/PW res: [0x2baaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.753855:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.753855:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.753855:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c52c61 lrc: 2/0,0 mode: PW/PW res: [0x2baae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.753856:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52c6f lrc: 3/0,1 mode: PW/PW res: [0x2bab1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.753858:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d9cfe902 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.753859:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52c6f lrc: 4/0,1 mode: PW/PW res: [0x2bab1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.753859:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c52c61 lrc: 2/0,0 mode: PW/PW res: [0x2baae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.753861:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c52c61 lrc: 3/0,0 mode: PW/PW res: [0x2baae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.753864:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.753864:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c52c61 lrc: 1/0,0 mode: --/PW res: [0x2baae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.753867:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c52c61 lrc: 0/0,0 mode: --/PW res: [0x2baae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.753869:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+149:41279:x1731746396422912:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 26us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.753871:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13199 00010000:00010000:1.0:1651529344.753876:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52c68 lrc: 3/0,1 mode: PW/PW res: [0x2bab0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.753880:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52c68 lrc: 3/0,1 mode: PW/PW res: [0x2bab0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.753882:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52c68 lrc: 3/0,1 mode: PW/PW res: [0x2bab0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.753885:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52c68 lrc: 2/0,0 mode: PW/PW res: [0x2bab0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.753885:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.753933:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1916:39030:x1731745946541696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1269us (1315us total) trans 12885080471 rc 0/0 00000100:00100000:1.0:1651529344.753941:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212416 00000100:00100000:1.0:1651529344.753945:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946542080 00010000:00010000:0.0:1651529344.753951:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52c68 lrc: 2/0,0 mode: PW/PW res: [0x2bab0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.753955:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004dda5a3f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.753956:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52c68 lrc: 2/0,0 mode: PW/PW res: [0x2bab0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.753961:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212422 00000100:00100000:1.0:1651529344.753963:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1916:39030:x1731745946542080:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.753965:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52c68 lrc: 3/0,0 mode: PW/PW res: [0x2bab0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.753969:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178870 count 1 00010000:00010000:0.0:1651529344.753969:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52c68 lrc: 1/0,0 mode: --/PW res: [0x2bab0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.753972:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c52c68 lrc: 0/0,0 mode: --/PW res: [0x2bab0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.753973:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52c92 lrc: 3/0,1 mode: --/PW res: [0x2bab6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.753977:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000094ee04de/0x3234de053c4e9b7 lrc: 2/0,0 mode: PR/PR res: [0x2bab6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5845 expref: 148 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.753981:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.753981:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.753982:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52c92 lrc: 4/0,1 mode: --/PW res: [0x2bab6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.753988:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000094ee04de/0x3234de053c4e9b7 lrc: 3/0,0 mode: PR/PR res: [0x2bab6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5845 expref: 148 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.753992:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000094ee04de/0x3234de053c4e9b7 lrc: 4/0,0 mode: PR/PR res: [0x2bab6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5845 expref: 148 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.753996:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997061760:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.754008:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fe434b1c going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.754021:0:80277:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a5b09c3/0x3234de053c4d718 lrc: 0/0,0 mode: --/PR res: [0x2bab1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0e0f expref: 148 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.754025:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005cc6463a pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997061440:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.754037:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52c6f lrc: 3/0,1 mode: PW/PW res: [0x2bab1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.754043:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52c6f lrc: 3/0,1 mode: PW/PW res: [0x2bab1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.754046:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52c6f lrc: 3/0,1 mode: PW/PW res: [0x2bab1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.754049:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52c6f lrc: 3/0,1 mode: PW/PW res: [0x2bab1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.754051:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52c6f lrc: 2/0,0 mode: PW/PW res: [0x2bab1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.754069:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52c6f lrc: 2/0,0 mode: PW/PW res: [0x2bab1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.754074:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006401eb97 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.754075:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52c6f lrc: 2/0,0 mode: PW/PW res: [0x2bab1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.754078:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52c6f lrc: 3/0,0 mode: PW/PW res: [0x2bab1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.754085:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52c6f lrc: 1/0,0 mode: --/PW res: [0x2bab1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.754090:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1917:39030:x1731745946541760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 748us (879us total) trans 12885080472 rc 0/0 00000100:00100000:1.0:1651529344.754093:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212417 00010000:00010000:0.0:1651529344.754098:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c52c6f lrc: 0/0,0 mode: --/PW res: [0x2bab1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.754161:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.754170:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.754176:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946542144 00000100:00100000:1.0:1651529344.754185:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946542208 00000100:00100000:0.0:1651529344.754208:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212423 00000100:00100000:1.0:1651529344.754211:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212424 00000100:00100000:0.0:1651529344.754211:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1918:39030:x1731745946542144:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.754212:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1918:39030:x1731745946542208:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.754217:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178871 count 1 00002000:00080000:1.0:1651529344.754218:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178872 count 1 00010000:00010000:1.0:1651529344.754232:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52c99 lrc: 3/0,1 mode: --/PW res: [0x2bab8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.754237:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000037b134c4/0x3234de053c4e95c lrc: 2/0,0 mode: PR/PR res: [0x2bab8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d56d2 expref: 147 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.754240:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.754241:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.754242:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52c99 lrc: 4/0,1 mode: --/PW res: [0x2bab8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.754248:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000037b134c4/0x3234de053c4e95c lrc: 3/0,0 mode: PR/PR res: [0x2bab8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d56d2 expref: 147 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.754252:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000037b134c4/0x3234de053c4e95c lrc: 4/0,0 mode: PR/PR res: [0x2bab8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d56d2 expref: 147 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.754264:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c52ca0 lrc: 3/0,1 mode: --/PW res: [0x2bab7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.754265:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007ac35c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997061824:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.754270:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000079c91ad8/0x3234de053c4d9fe lrc: 2/0,0 mode: PR/PR res: [0x2bab7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1896 expref: 147 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.754273:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.754273:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.754274:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c52ca0 lrc: 4/0,1 mode: --/PW res: [0x2bab7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.754275:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 0000000020dd7827 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.754281:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000079c91ad8/0x3234de053c4d9fe lrc: 3/0,0 mode: PR/PR res: [0x2bab7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1896 expref: 147 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.754285:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000079c91ad8/0x3234de053c4d9fe lrc: 4/0,0 mode: PR/PR res: [0x2bab7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1896 expref: 147 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.754292:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000065f5e47d pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997061888:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.754301:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 0000000070e666f7 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.754329:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.754336:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946542272 00000100:00100000:1.0:1651529344.754359:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003e3f0f77 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997061568:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.754364:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52c7d lrc: 3/0,1 mode: --/PW res: [0x2bab4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.754371:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f9050c71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997061504:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.754372:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212425 00010000:00010000:1.0:1651529344.754373:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52c76 lrc: 3/0,1 mode: --/PW res: [0x2bab2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.754374:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1919:39029:x1731745946542272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.754379:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178873 count 1 00010000:00010000:0.0:1651529344.754383:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52ca7 lrc: 3/0,1 mode: --/PW res: [0x2bab9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.754387:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004e30f4bd/0x3234de053c4b3f5 lrc: 2/0,0 mode: PR/PR res: [0x2bab9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc1cc expref: 147 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.754391:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.754391:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.754392:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52ca7 lrc: 4/0,1 mode: --/PW res: [0x2bab9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.754398:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004e30f4bd/0x3234de053c4b3f5 lrc: 3/0,0 mode: PR/PR res: [0x2bab9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc1cc expref: 147 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.754402:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004e30f4bd/0x3234de053c4b3f5 lrc: 4/0,0 mode: PR/PR res: [0x2bab9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc1cc expref: 147 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.754406:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005912c4a3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997061952:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.754421:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b81e4a0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.754458:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.754468:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396423040 00000100:00100000:0.0:1651529344.754468:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.754476:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.754483:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000081c22fa3/0x3234de053c4ea58 lrc: 4/0,0 mode: PR/PR res: [0x2bab2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5abb expref: 148 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.754495:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.754500:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396422976 00010000:00010000:1.0:1651529344.754503:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ad4922c5/0x3234de053c4e8fa lrc: 4/0,0 mode: PR/PR res: [0x2bab4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d547f expref: 149 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.754503:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.754507:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396423104 00010000:00010000:1.0:1651529344.754509:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005a5881ba/0x3234de053c4c9dc lrc: 5/0,0 mode: PR/PR res: [0x2bab3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd98f expref: 150 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.754513:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396423168 00010000:00010000:1.0:1651529344.754515:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000081866327/0x3234de053c4d925 lrc: 5/0,0 mode: PR/PR res: [0x2bab5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1555 expref: 151 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.754519:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396423232 00010000:00010000:1.0:1651529344.754521:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000094ee04de/0x3234de053c4e9b7 lrc: 5/0,0 mode: PR/PR res: [0x2bab6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5845 expref: 152 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.754525:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13200 00000100:00100000:1.0:1651529344.754527:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+152:41279:x1731746396423040:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.754527:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003de40890 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997061632:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.754529:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.754530:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000081c22fa3/0x3234de053c4ea58 lrc: 4/0,0 mode: PR/PR res: [0x2bab2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5abb expref: 152 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.754531:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52c84 lrc: 3/0,1 mode: --/PW res: [0x2bab3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.754534:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000081c22fa3/0x3234de053c4ea58 lrc: 3/0,0 mode: PR/PR res: [0x2bab2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5abb expref: 152 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.754540:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081c22fa3/0x3234de053c4ea58 lrc: 0/0,0 mode: --/PR res: [0x2bab2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5abb expref: 152 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.754544:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.754544:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.754545:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52c76 lrc: 3/0,1 mode: PW/PW res: [0x2bab2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.754548:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52c76 lrc: 4/0,1 mode: PW/PW res: [0x2bab2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.754564:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13201 00000100:00100000:0.0:1651529344.754566:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+151:41279:x1731746396422976:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.754568:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.754570:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.754572:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ad4922c5/0x3234de053c4e8fa lrc: 4/0,0 mode: PR/PR res: [0x2bab4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d547f expref: 151 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.754575:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ad4922c5/0x3234de053c4e8fa lrc: 3/0,0 mode: PR/PR res: [0x2bab4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d547f expref: 151 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.754580:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+151:41279:x1731746396423040:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 52us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.754583:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13200 00000100:00100000:1.0:1651529344.754588:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13202 00010000:00010000:0.0:1651529344.754588:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad4922c5/0x3234de053c4e8fa lrc: 0/0,0 mode: --/PR res: [0x2bab4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d547f expref: 150 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.754589:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+150:41279:x1731746396423104:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.754592:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.754592:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.754592:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.754593:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52c7d lrc: 3/0,1 mode: PW/PW res: [0x2bab4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.754594:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005a5881ba/0x3234de053c4c9dc lrc: 4/0,0 mode: PR/PR res: [0x2bab3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd98f expref: 149 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.754598:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005a5881ba/0x3234de053c4c9dc lrc: 3/0,0 mode: PR/PR res: [0x2bab3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd98f expref: 149 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.754598:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52c7d lrc: 4/0,1 mode: PW/PW res: [0x2bab4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.754602:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a5881ba/0x3234de053c4c9dc lrc: 0/0,0 mode: --/PR res: [0x2bab3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd98f expref: 149 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.754608:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.754612:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.754613:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.754613:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52c84 lrc: 3/0,1 mode: PW/PW res: [0x2bab3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.754615:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+148:41279:x1731746396422976:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 49us (147us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.754617:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52c84 lrc: 4/0,1 mode: PW/PW res: [0x2bab3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.754618:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13201 00010000:00010000:1.0:1651529344.754625:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.754631:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+147:41279:x1731746396423104:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.754631:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13203 00000100:00100000:1.0:1651529344.754633:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13202 00000100:00100000:0.0:1651529344.754633:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+147:41278:x1731746396423168:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.754636:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.754638:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13204 00000100:00100000:1.0:1651529344.754640:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007fca8239 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+146:41278:x1731746396423232:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.754642:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.754643:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000094ee04de/0x3234de053c4e9b7 lrc: 5/0,0 mode: PR/PR res: [0x2bab6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5845 expref: 146 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.754647:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000094ee04de/0x3234de053c4e9b7 lrc: 4/0,0 mode: PR/PR res: [0x2bab6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5845 expref: 146 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.754651:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.754651:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000081866327/0x3234de053c4d925 lrc: 5/0,0 mode: PR/PR res: [0x2bab5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1555 expref: 146 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.754652:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.754653:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52c92 lrc: 3/0,1 mode: PW/PW res: [0x2bab6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.754655:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000081866327/0x3234de053c4d925 lrc: 4/0,0 mode: PR/PR res: [0x2bab5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1555 expref: 146 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.754656:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52c92 lrc: 4/0,1 mode: PW/PW res: [0x2bab6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.754660:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.754660:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.754661:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.754662:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52c8b lrc: 3/0,1 mode: PW/PW res: [0x2bab5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.754664:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007fca8239 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+146:41278:x1731746396423232:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 23us (161us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.754665:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52c8b lrc: 4/0,1 mode: PW/PW res: [0x2bab5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.754666:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13204 00010000:00010000:0.0:1651529344.754669:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.754675:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+145:41278:x1731746396423168:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (180us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.754677:0:106695:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081866327/0x3234de053c4d925 lrc: 0/0,0 mode: --/PR res: [0x2bab5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1555 expref: 145 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.754678:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13203 00000100:00100000:1.0:1651529344.754681:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004972eb27 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997061696:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.754684:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52c8b lrc: 3/0,1 mode: PW/PW res: [0x2bab5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.754685:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52c84 lrc: 3/0,1 mode: PW/PW res: [0x2bab3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.754687:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52c8b lrc: 3/0,1 mode: PW/PW res: [0x2bab5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.754689:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52c84 lrc: 3/0,1 mode: PW/PW res: [0x2bab3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.754690:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52c8b lrc: 3/0,1 mode: PW/PW res: [0x2bab5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.754692:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52c84 lrc: 3/0,1 mode: PW/PW res: [0x2bab3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.754693:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52c8b lrc: 3/0,1 mode: PW/PW res: [0x2bab5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.754694:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52c84 lrc: 2/0,0 mode: PW/PW res: [0x2bab3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.754696:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52c8b lrc: 2/0,0 mode: PW/PW res: [0x2bab5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.754733:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1921:39030:x1731745946541888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 980us (1097us total) trans 12885080473 rc 0/0 00000100:00100000:1.0:1651529344.754744:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1921:39029:x1731745946542016:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 954us (1082us total) trans 12885080474 rc 0/0 00000100:00100000:0.0:1651529344.754747:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212420 00000100:00100000:1.0:1651529344.754748:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212421 00010000:00010000:0.0:1651529344.754755:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52c84 lrc: 2/0,0 mode: PW/PW res: [0x2bab3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.754758:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002f450f42 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.754759:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52c84 lrc: 2/0,0 mode: PW/PW res: [0x2bab3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.754760:0:72397:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094ee04de/0x3234de053c4e9b7 lrc: 0/0,0 mode: --/PR res: [0x2bab6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5845 expref: 143 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.754761:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52c84 lrc: 3/0,0 mode: PW/PW res: [0x2bab3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.754766:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997061760:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.754766:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52c84 lrc: 1/0,0 mode: --/PW res: [0x2bab3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.754769:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52c84 lrc: 0/0,0 mode: --/PW res: [0x2bab3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.754770:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52c92 lrc: 3/0,1 mode: PW/PW res: [0x2bab6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.754773:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52c92 lrc: 3/0,1 mode: PW/PW res: [0x2bab6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.754773:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52c8b lrc: 2/0,0 mode: PW/PW res: [0x2bab5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.754776:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52c92 lrc: 3/0,1 mode: PW/PW res: [0x2bab6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.754776:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c5599f68 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.754777:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52c8b lrc: 2/0,0 mode: PW/PW res: [0x2bab5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.754779:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52c92 lrc: 3/0,1 mode: PW/PW res: [0x2bab6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.754780:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52c8b lrc: 3/0,0 mode: PW/PW res: [0x2bab5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.754781:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52c92 lrc: 2/0,0 mode: PW/PW res: [0x2bab6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.754783:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52c8b lrc: 1/0,0 mode: --/PW res: [0x2bab5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.754785:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c52c8b lrc: 0/0,0 mode: --/PW res: [0x2bab5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.754795:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52c92 lrc: 2/0,0 mode: PW/PW res: [0x2bab6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.754798:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000048ee8765 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.754798:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52c92 lrc: 2/0,0 mode: PW/PW res: [0x2bab6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.754804:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52c92 lrc: 3/0,0 mode: PW/PW res: [0x2bab6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.754807:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52c92 lrc: 1/0,0 mode: --/PW res: [0x2bab6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.754810:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c52c92 lrc: 0/0,0 mode: --/PW res: [0x2bab6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.754819:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1920:39030:x1731745946542080:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 856us (934us total) trans 12885080475 rc 0/0 00000100:00100000:1.0:1651529344.754822:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212422 00010000:00010000:1.0:1651529344.754837:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52c76 lrc: 3/0,1 mode: PW/PW res: [0x2bab2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.754840:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52c76 lrc: 3/0,1 mode: PW/PW res: [0x2bab2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.754846:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52c76 lrc: 3/0,1 mode: PW/PW res: [0x2bab2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.754848:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52c76 lrc: 2/0,0 mode: PW/PW res: [0x2bab2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.754849:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.754864:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.754891:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1920:39030:x1731745946541824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1212us (1321us total) trans 12885080476 rc 0/0 00000100:00100000:1.0:1651529344.754894:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212418 00000100:00100000:0.0:1651529344.754895:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.754912:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52c7d lrc: 3/0,1 mode: PW/PW res: [0x2bab4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.754915:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52c7d lrc: 3/0,1 mode: PW/PW res: [0x2bab4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.754928:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52c7d lrc: 3/0,1 mode: PW/PW res: [0x2bab4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.754936:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000065f5e47d pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997061888:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.754937:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52c7d lrc: 2/0,0 mode: PW/PW res: [0x2bab4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.754940:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c52ca0 lrc: 3/0,1 mode: --/PW res: [0x2bab7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.754953:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52c76 lrc: 2/0,0 mode: PW/PW res: [0x2bab2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.754956:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fafb79d3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.754957:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52c76 lrc: 2/0,0 mode: PW/PW res: [0x2bab2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.754960:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52c76 lrc: 3/0,0 mode: PW/PW res: [0x2bab2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.754967:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52c76 lrc: 1/0,0 mode: --/PW res: [0x2bab2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.754970:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c52c76 lrc: 0/0,0 mode: --/PW res: [0x2bab2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.754978:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1920:39030:x1731745946541952:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1243us (1374us total) trans 12885080477 rc 0/0 00000100:00100000:1.0:1651529344.754980:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212419 00000100:00100000:1.0:1651529344.754992:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007ac35c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997061824:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.754994:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52c7d lrc: 2/0,0 mode: PW/PW res: [0x2bab4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.754997:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52c99 lrc: 3/0,1 mode: --/PW res: [0x2bab8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.754997:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000576f1f12 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.754998:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52c7d lrc: 2/0,0 mode: PW/PW res: [0x2bab4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.755001:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52c7d lrc: 3/0,0 mode: PW/PW res: [0x2bab4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.755004:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396423296 00010000:00010000:0.0:1651529344.755005:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52c7d lrc: 1/0,0 mode: --/PW res: [0x2bab4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.755008:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000037b134c4/0x3234de053c4e95c lrc: 4/0,0 mode: PR/PR res: [0x2bab8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d56d2 expref: 143 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.755008:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c52c7d lrc: 0/0,0 mode: --/PW res: [0x2bab4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.755014:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396423360 00010000:00010000:1.0:1651529344.755017:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000079c91ad8/0x3234de053c4d9fe lrc: 4/0,0 mode: PR/PR res: [0x2bab7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1896 expref: 144 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.755017:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005912c4a3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997061952:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.755020:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52ca7 lrc: 3/0,1 mode: --/PW res: [0x2bab9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.755021:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396423424 00010000:00010000:1.0:1651529344.755023:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004e30f4bd/0x3234de053c4b3f5 lrc: 4/0,0 mode: PR/PR res: [0x2bab9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc1cc expref: 145 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.755028:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13205 00000100:00100000:1.0:1651529344.755029:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de6bf351 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+145:41279:x1731746396423296:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529344.755031:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13206 00010000:00010000:1.0:1651529344.755032:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.755032:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ea32140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+145:41279:x1731746396423360:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.755033:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000037b134c4/0x3234de053c4e95c lrc: 4/0,0 mode: PR/PR res: [0x2bab8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d56d2 expref: 145 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.755036:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.755037:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000037b134c4/0x3234de053c4e95c lrc: 3/0,0 mode: PR/PR res: [0x2bab8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d56d2 expref: 145 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.755037:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000079c91ad8/0x3234de053c4d9fe lrc: 4/0,0 mode: PR/PR res: [0x2bab7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1896 expref: 145 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.755041:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000079c91ad8/0x3234de053c4d9fe lrc: 3/0,0 mode: PR/PR res: [0x2bab7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1896 expref: 145 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.755042:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037b134c4/0x3234de053c4e95c lrc: 0/0,0 mode: --/PR res: [0x2bab8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d56d2 expref: 145 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.755046:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079c91ad8/0x3234de053c4d9fe lrc: 0/0,0 mode: --/PR res: [0x2bab7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1896 expref: 145 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.755048:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.755049:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.755050:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52c99 lrc: 3/0,1 mode: PW/PW res: [0x2bab8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.755050:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.755051:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.755051:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c52ca0 lrc: 3/0,1 mode: PW/PW res: [0x2bab7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.755053:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52c99 lrc: 4/0,1 mode: PW/PW res: [0x2bab8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.755054:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c52ca0 lrc: 4/0,1 mode: PW/PW res: [0x2bab7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.755059:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.755065:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de6bf351 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+143:41279:x1731746396423296:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.755068:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13205 00000100:00100000:1.0:1651529344.755076:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13207 00010000:00010000:0.0:1651529344.755076:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.755077:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfc79d4e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+142:41279:x1731746396423424:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.755080:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.755081:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004e30f4bd/0x3234de053c4b3f5 lrc: 4/0,0 mode: PR/PR res: [0x2bab9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc1cc expref: 142 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.755084:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ea32140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+142:41279:x1731746396423360:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 51us (220us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.755085:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004e30f4bd/0x3234de053c4b3f5 lrc: 3/0,0 mode: PR/PR res: [0x2bab9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc1cc expref: 142 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.755087:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13206 00010000:00010000:1.0:1651529344.755089:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e30f4bd/0x3234de053c4b3f5 lrc: 0/0,0 mode: --/PR res: [0x2bab9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc1cc expref: 142 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.755093:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.755093:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.755094:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52ca7 lrc: 3/0,1 mode: PW/PW res: [0x2bab9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.755095:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c52ca0 lrc: 3/0,1 mode: PW/PW res: [0x2bab7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.755097:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52ca7 lrc: 4/0,1 mode: PW/PW res: [0x2bab9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.755100:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c52ca0 lrc: 3/0,1 mode: PW/PW res: [0x2bab7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.755103:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c52ca0 lrc: 3/0,1 mode: PW/PW res: [0x2bab7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.755106:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.755112:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfc79d4e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+140:41279:x1731746396423424:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 34us (217us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.755112:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c52ca0 lrc: 2/0,0 mode: PW/PW res: [0x2bab7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.755114:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13207 00010000:00010000:1.0:1651529344.755121:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52c99 lrc: 3/0,1 mode: PW/PW res: [0x2bab8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.755124:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52c99 lrc: 3/0,1 mode: PW/PW res: [0x2bab8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.755128:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52c99 lrc: 3/0,1 mode: PW/PW res: [0x2bab8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.755137:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52c99 lrc: 2/0,0 mode: PW/PW res: [0x2bab8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.755171:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1921:39030:x1731745946542144:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 960us (1010us total) trans 12885080478 rc 0/0 00000100:00100000:0.0:1651529344.755174:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212423 00000100:00100000:1.0:1651529344.755177:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1920:39030:x1731745946542208:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 964us (1007us total) trans 12885080479 rc 0/0 00000100:00100000:1.0:1651529344.755180:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212424 00010000:00010000:0.0:1651529344.755182:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52ca7 lrc: 3/0,1 mode: PW/PW res: [0x2bab9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.755185:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52ca7 lrc: 3/0,1 mode: PW/PW res: [0x2bab9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.755187:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c52ca0 lrc: 2/0,0 mode: PW/PW res: [0x2bab7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.755188:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52ca7 lrc: 3/0,1 mode: PW/PW res: [0x2bab9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.755191:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52ca7 lrc: 2/0,0 mode: PW/PW res: [0x2bab9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.755193:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b0407aaf already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.755194:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c52ca0 lrc: 2/0,0 mode: PW/PW res: [0x2bab7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.755197:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c52ca0 lrc: 3/0,0 mode: PW/PW res: [0x2bab7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.755202:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c52ca0 lrc: 1/0,0 mode: --/PW res: [0x2bab7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.755205:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c52ca0 lrc: 0/0,0 mode: --/PW res: [0x2bab7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.755210:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52c99 lrc: 2/0,0 mode: PW/PW res: [0x2bab8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.755213:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fc4c513 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.755214:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52c99 lrc: 2/0,0 mode: PW/PW res: [0x2bab8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.755216:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52c99 lrc: 3/0,0 mode: PW/PW res: [0x2bab8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.755219:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52c99 lrc: 1/0,0 mode: --/PW res: [0x2bab8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.755242:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c52c99 lrc: 0/0,0 mode: --/PW res: [0x2bab8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.755247:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52ca7 lrc: 2/0,0 mode: PW/PW res: [0x2bab9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.755247:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1920:39029:x1731745946542272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 872us (918us total) trans 12885080480 rc 0/0 00010000:00010000:1.0:1651529344.755250:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000af20b5e7 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.755251:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52ca7 lrc: 2/0,0 mode: PW/PW res: [0x2bab9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.755251:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212425 00010000:00010000:1.0:1651529344.755253:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52ca7 lrc: 3/0,0 mode: PW/PW res: [0x2bab9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.755257:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52ca7 lrc: 1/0,0 mode: --/PW res: [0x2bab9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.755259:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52ca7 lrc: 0/0,0 mode: --/PW res: [0x2bab9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.755283:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.755298:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.755315:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.755323:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946542336 00000100:00100000:0.0:1651529344.755338:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946542400 00000100:00100000:0.0:1651529344.755344:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946542528 00000100:00100000:0.0:1651529344.755348:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212426 00000100:00100000:0.0:1651529344.755349:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005914c920 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1922:39030:x1731745946542336:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.755355:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178874 count 1 00010000:00010000:0.0:1651529344.755359:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52cae lrc: 3/0,1 mode: --/PW res: [0x2baba:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.755364:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c93448e7/0x3234de053c4e557 lrc: 2/0,0 mode: PR/PR res: [0x2baba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d467f expref: 139 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.755367:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.755367:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.755368:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52cae lrc: 4/0,1 mode: --/PW res: [0x2baba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.755375:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212427 00000100:00100000:1.0:1651529344.755377:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007fca8239 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1922:39029:x1731745946542400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.755382:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178875 count 1 00010000:00010000:1.0:1651529344.755387:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c52cb5 lrc: 3/0,1 mode: --/PW res: [0x2babb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.755391:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007c0c914b/0x3234de053c4e2b0 lrc: 2/0,0 mode: PR/PR res: [0x2babb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3bff expref: 139 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.755391:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c93448e7/0x3234de053c4e557 lrc: 3/0,0 mode: PR/PR res: [0x2baba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d467f expref: 139 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.755394:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.755395:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.755395:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c52cb5 lrc: 4/0,1 mode: --/PW res: [0x2babb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.755395:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c93448e7/0x3234de053c4e557 lrc: 4/0,0 mode: PR/PR res: [0x2baba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d467f expref: 139 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.755400:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a130088 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997062016:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.755402:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007c0c914b/0x3234de053c4e2b0 lrc: 3/0,0 mode: PR/PR res: [0x2babb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3bff expref: 139 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.755406:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007c0c914b/0x3234de053c4e2b0 lrc: 4/0,0 mode: PR/PR res: [0x2babb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3bff expref: 139 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.755410:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007ac35c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997062080:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.755415:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000abca413e going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.755422:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212428 00000100:00100000:0.0:1651529344.755424:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1922:39029:x1731745946542528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.755426:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 0000000057299e7f going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.755428:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178877 count 1 00010000:00010000:0.0:1651529344.755432:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52cbc lrc: 3/0,1 mode: --/PW res: [0x2babd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.755436:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000094942e5/0x3234de053c4ddcb lrc: 2/0,0 mode: PR/PR res: [0x2babd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2872 expref: 139 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.755439:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.755440:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.755440:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52cbc lrc: 4/0,1 mode: --/PW res: [0x2babd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.755446:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000094942e5/0x3234de053c4ddcb lrc: 3/0,0 mode: PR/PR res: [0x2babd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2872 expref: 139 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.755450:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000094942e5/0x3234de053c4ddcb lrc: 4/0,0 mode: PR/PR res: [0x2babd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2872 expref: 139 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.755454:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000900b179f pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997062144:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.755490:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000000e7e66c4 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.755533:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.755542:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946542464 00000100:00100000:0.0:1651529344.755544:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.755553:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.755561:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946542656 00000100:00100000:0.0:1651529344.755561:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.755567:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946542592 00000100:00100000:0.0:1651529344.755569:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.755578:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946542720 00000100:00100000:1.0:1651529344.755583:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946542784 00000100:00100000:0.0:1651529344.755585:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212429 00000100:00100000:0.0:1651529344.755587:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1927:39029:x1731745946542464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.755588:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212430 00000100:00100000:1.0:1651529344.755590:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1927:39029:x1731745946542656:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.755593:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178876 count 1 00002000:00080000:1.0:1651529344.755595:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178879 count 1 00010000:00010000:0.0:1651529344.755596:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52cc3 lrc: 3/0,1 mode: --/PW res: [0x2babc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.755599:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52cca lrc: 3/0,1 mode: --/PW res: [0x2babf:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.755601:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000042b763/0x3234de053c4c528 lrc: 2/0,0 mode: PR/PR res: [0x2babc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc9c1 expref: 139 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.755604:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000049575d5b/0x3234de053c4eaf2 lrc: 2/0,0 mode: PR/PR res: [0x2babf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5da1 expref: 139 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.755604:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.755605:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.755605:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52cc3 lrc: 4/0,1 mode: --/PW res: [0x2babc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.755607:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.755607:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.755608:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52cca lrc: 4/0,1 mode: --/PW res: [0x2babf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.755612:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000042b763/0x3234de053c4c528 lrc: 3/0,0 mode: PR/PR res: [0x2babc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc9c1 expref: 139 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.755615:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000049575d5b/0x3234de053c4eaf2 lrc: 3/0,0 mode: PR/PR res: [0x2babf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5da1 expref: 139 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.755615:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000042b763/0x3234de053c4c528 lrc: 4/0,0 mode: PR/PR res: [0x2babc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc9c1 expref: 139 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.755619:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000049575d5b/0x3234de053c4eaf2 lrc: 4/0,0 mode: PR/PR res: [0x2babf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5da1 expref: 139 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.755619:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005384a251 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997062208:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.755623:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997062272:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.755641:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b7af823 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.755648:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212431 00000100:00100000:1.0:1651529344.755649:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1927:39029:x1731745946542592:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.755650:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ff7bf023 going to sleep for 6 seconds 00002000:00080000:1.0:1651529344.755654:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178878 count 1 00010000:00010000:1.0:1651529344.755657:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52cd1 lrc: 3/0,1 mode: --/PW res: [0x2babe:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.755661:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a577fe73/0x3234de053c4e27f lrc: 2/0,0 mode: PR/PR res: [0x2babe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b49 expref: 139 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.755664:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.755665:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.755666:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52cd1 lrc: 4/0,1 mode: --/PW res: [0x2babe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.755667:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212432 00000100:00100000:0.0:1651529344.755669:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1927:39029:x1731745946542720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.755671:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a577fe73/0x3234de053c4e27f lrc: 3/0,0 mode: PR/PR res: [0x2babe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b49 expref: 139 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.755674:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178880 count 1 00010000:00010000:1.0:1651529344.755675:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a577fe73/0x3234de053c4e27f lrc: 4/0,0 mode: PR/PR res: [0x2babe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b49 expref: 139 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.755677:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52cd8 lrc: 3/0,1 mode: --/PW res: [0x2bac0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.755679:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a9b051f pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997062336:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.755682:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000049c8015d/0x3234de053c4e351 lrc: 2/0,0 mode: PR/PR res: [0x2bac0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e21 expref: 139 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.755685:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c3caa148 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.755685:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.755686:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.755686:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52cd8 lrc: 4/0,1 mode: --/PW res: [0x2bac0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.755691:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212433 00000100:00100000:1.0:1651529344.755692:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1927:39030:x1731745946542784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.755693:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000049c8015d/0x3234de053c4e351 lrc: 3/0,0 mode: PR/PR res: [0x2bac0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e21 expref: 139 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.755696:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178881 count 1 00010000:00010000:0.0:1651529344.755696:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000049c8015d/0x3234de053c4e351 lrc: 4/0,0 mode: PR/PR res: [0x2bac0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e21 expref: 139 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.755699:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52cdf lrc: 3/0,1 mode: --/PW res: [0x2bac1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.755700:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000075e1000f pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997062400:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.755703:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001d2e3221/0x3234de053c4e9e8 lrc: 2/0,0 mode: PR/PR res: [0x2bac1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5925 expref: 139 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.755706:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.755706:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.755707:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52cdf lrc: 4/0,1 mode: --/PW res: [0x2bac1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.755708:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e1aa6a77 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.755713:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001d2e3221/0x3234de053c4e9e8 lrc: 3/0,0 mode: PR/PR res: [0x2bac1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5925 expref: 139 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.755716:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001d2e3221/0x3234de053c4e9e8 lrc: 4/0,0 mode: PR/PR res: [0x2bac1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5925 expref: 139 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.755720:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000703c0db9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997062464:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.755726:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000567ee0ef going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.755776:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a130088 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997062016:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.755780:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52cae lrc: 3/0,1 mode: --/PW res: [0x2baba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.755807:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.755816:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.755822:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007ac35c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997062080:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.755825:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.755827:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c52cb5 lrc: 3/0,1 mode: --/PW res: [0x2babb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.755834:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000900b179f pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997062144:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.755838:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52cbc lrc: 3/0,1 mode: --/PW res: [0x2babd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.755839:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396423552 00010000:00010000:1.0:1651529344.755844:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007c0c914b/0x3234de053c4e2b0 lrc: 4/0,0 mode: PR/PR res: [0x2babb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3bff expref: 140 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.755854:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396423488 00010000:00010000:1.0:1651529344.755857:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c93448e7/0x3234de053c4e557 lrc: 4/0,0 mode: PR/PR res: [0x2baba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d467f expref: 141 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.755861:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396423616 00010000:00010000:1.0:1651529344.755863:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000094942e5/0x3234de053c4ddcb lrc: 4/0,0 mode: PR/PR res: [0x2babd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2872 expref: 142 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.755867:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13208 00000100:00100000:0.0:1651529344.755869:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+142:41279:x1731746396423552:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.755870:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13209 00000100:00100000:1.0:1651529344.755871:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+142:41278:x1731746396423488:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.755873:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.755874:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.755874:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007c0c914b/0x3234de053c4e2b0 lrc: 4/0,0 mode: PR/PR res: [0x2babb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3bff expref: 142 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.755875:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c93448e7/0x3234de053c4e557 lrc: 4/0,0 mode: PR/PR res: [0x2baba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d467f expref: 142 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.755878:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007c0c914b/0x3234de053c4e2b0 lrc: 3/0,0 mode: PR/PR res: [0x2babb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3bff expref: 142 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.755879:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c93448e7/0x3234de053c4e557 lrc: 3/0,0 mode: PR/PR res: [0x2baba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d467f expref: 142 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.755884:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c0c914b/0x3234de053c4e2b0 lrc: 0/0,0 mode: --/PR res: [0x2babb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3bff expref: 142 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.755885:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c93448e7/0x3234de053c4e557 lrc: 0/0,0 mode: --/PR res: [0x2baba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d467f expref: 142 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.755888:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.755889:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.755890:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c52cb5 lrc: 3/0,1 mode: PW/PW res: [0x2babb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.755891:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.755892:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.755892:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52cae lrc: 3/0,1 mode: PW/PW res: [0x2baba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.755893:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c52cb5 lrc: 4/0,1 mode: PW/PW res: [0x2babb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.755895:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52cae lrc: 4/0,1 mode: PW/PW res: [0x2baba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.755903:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.755910:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.755919:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+140:41279:x1731746396423552:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 50us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.755922:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13208 00000100:00100000:1.0:1651529344.755923:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+140:41278:x1731746396423488:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 51us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.755926:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13209 00000100:00100000:0.0:1651529344.755928:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13210 00000100:00100000:0.0:1651529344.755930:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+138:41278:x1731746396423616:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.755933:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c52cb5 lrc: 3/0,1 mode: PW/PW res: [0x2babb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.755933:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.755935:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000094942e5/0x3234de053c4ddcb lrc: 4/0,0 mode: PR/PR res: [0x2babd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2872 expref: 138 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.755937:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c52cb5 lrc: 3/0,1 mode: PW/PW res: [0x2babb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.755938:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000094942e5/0x3234de053c4ddcb lrc: 3/0,0 mode: PR/PR res: [0x2babd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2872 expref: 138 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.755940:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c52cb5 lrc: 3/0,1 mode: PW/PW res: [0x2babb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.755942:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c52cb5 lrc: 2/0,0 mode: PW/PW res: [0x2babb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.755943:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000094942e5/0x3234de053c4ddcb lrc: 0/0,0 mode: --/PR res: [0x2babd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2872 expref: 138 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.755946:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.755947:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.755948:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52cbc lrc: 3/0,1 mode: PW/PW res: [0x2babd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.755956:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52cbc lrc: 4/0,1 mode: PW/PW res: [0x2babd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.755962:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.755968:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+137:41278:x1731746396423616:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 37us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.755970:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13210 00010000:00010000:0.0:1651529344.755976:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52cae lrc: 3/0,1 mode: PW/PW res: [0x2baba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.755979:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52cae lrc: 3/0,1 mode: PW/PW res: [0x2baba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.755988:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007fca8239 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1928:39029:x1731745946542400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 610us (689us total) trans 12885080481 rc 0/0 00010000:00010000:0.0:1651529344.755990:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52cae lrc: 3/0,1 mode: PW/PW res: [0x2baba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.755991:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212427 00010000:00010000:0.0:1651529344.755993:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52cae lrc: 2/0,0 mode: PW/PW res: [0x2baba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.756032:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005914c920 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1928:39030:x1731745946542336:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 682us (749us total) trans 12885080482 rc 0/0 00000100:00100000:0.0:1651529344.756035:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212426 00010000:00010000:0.0:1651529344.756042:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c52cb5 lrc: 2/0,0 mode: PW/PW res: [0x2babb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.756046:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e85485c6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.756047:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c52cb5 lrc: 2/0,0 mode: PW/PW res: [0x2babb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.756050:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c52cb5 lrc: 3/0,0 mode: PW/PW res: [0x2babb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.756084:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c52cb5 lrc: 1/0,0 mode: --/PW res: [0x2babb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.756103:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c52cb5 lrc: 0/0,0 mode: --/PW res: [0x2babb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.756121:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52cae lrc: 2/0,0 mode: PW/PW res: [0x2baba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.756124:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008ac1e27e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.756125:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52cae lrc: 2/0,0 mode: PW/PW res: [0x2baba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.756127:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.756128:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52cae lrc: 3/0,0 mode: PW/PW res: [0x2baba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.756131:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52cae lrc: 1/0,0 mode: --/PW res: [0x2baba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.756134:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52cae lrc: 0/0,0 mode: --/PW res: [0x2baba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.756135:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.756143:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.756156:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997062272:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.756160:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52cca lrc: 3/0,1 mode: --/PW res: [0x2babf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.756167:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a9b051f pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997062336:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.756180:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52cd1 lrc: 3/0,1 mode: --/PW res: [0x2babe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.756188:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000703c0db9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997062464:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.756190:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52cdf lrc: 3/0,1 mode: --/PW res: [0x2bac1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.756196:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396423680 00000100:00100000:0.0:1651529344.756196:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000075e1000f pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997062400:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.756200:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000042b763/0x3234de053c4c528 lrc: 5/0,0 mode: PR/PR res: [0x2babc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc9c1 expref: 137 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.756201:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52cd8 lrc: 3/0,1 mode: --/PW res: [0x2bac0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.756207:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396423808 00000100:00100000:0.0:1651529344.756208:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005384a251 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997062208:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.756209:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a577fe73/0x3234de053c4e27f lrc: 4/0,0 mode: PR/PR res: [0x2babe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b49 expref: 138 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.756210:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52cc3 lrc: 3/0,1 mode: --/PW res: [0x2babc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.756213:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396423936 00010000:00010000:0.0:1651529344.756214:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52cbc lrc: 3/0,1 mode: PW/PW res: [0x2babd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.756215:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001d2e3221/0x3234de053c4e9e8 lrc: 4/0,0 mode: PR/PR res: [0x2bac1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5925 expref: 139 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.756217:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52cbc lrc: 3/0,1 mode: PW/PW res: [0x2babd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.756221:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52cbc lrc: 3/0,1 mode: PW/PW res: [0x2babd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.756233:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13211 00000100:00100000:1.0:1651529344.756239:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+139:41279:x1731746396423680:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.756239:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52cbc lrc: 2/0,0 mode: PW/PW res: [0x2babd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.756243:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.756244:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000042b763/0x3234de053c4c528 lrc: 4/0,0 mode: PR/PR res: [0x2babc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc9c1 expref: 139 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.756253:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000042b763/0x3234de053c4c528 lrc: 3/0,0 mode: PR/PR res: [0x2babc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc9c1 expref: 139 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.756259:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000042b763/0x3234de053c4c528 lrc: 0/0,0 mode: --/PR res: [0x2babc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc9c1 expref: 139 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.756263:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.756263:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.756264:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52cc3 lrc: 3/0,1 mode: PW/PW res: [0x2babc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.756267:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52cc3 lrc: 4/0,1 mode: PW/PW res: [0x2babc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.756276:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.756283:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+138:41279:x1731746396423680:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 48us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.756286:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13211 00000100:00100000:0.0:1651529344.756288:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1928:39029:x1731745946542528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 863us (972us total) trans 12885080483 rc 0/0 00000100:00100000:1.0:1651529344.756291:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13212 00000100:00100000:0.0:1651529344.756291:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212428 00000100:00100000:1.0:1651529344.756292:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000d49c4f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+137:41279:x1731746396423808:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.756295:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.756296:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a577fe73/0x3234de053c4e27f lrc: 4/0,0 mode: PR/PR res: [0x2babe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b49 expref: 137 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.756298:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52cc3 lrc: 3/0,1 mode: PW/PW res: [0x2babc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.756300:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a577fe73/0x3234de053c4e27f lrc: 3/0,0 mode: PR/PR res: [0x2babe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b49 expref: 137 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.756301:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52cc3 lrc: 3/0,1 mode: PW/PW res: [0x2babc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.756304:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52cc3 lrc: 3/0,1 mode: PW/PW res: [0x2babc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.756305:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a577fe73/0x3234de053c4e27f lrc: 0/0,0 mode: --/PR res: [0x2babe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3b49 expref: 137 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.756307:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52cc3 lrc: 2/0,0 mode: PW/PW res: [0x2babc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.756308:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.756309:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.756309:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52cd1 lrc: 3/0,1 mode: PW/PW res: [0x2babe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.756312:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52cd1 lrc: 4/0,1 mode: PW/PW res: [0x2babe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.756318:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.756323:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000d49c4f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+136:41279:x1731746396423808:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 30us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.756325:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13212 00000100:00100000:1.0:1651529344.756332:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13213 00000100:00100000:1.0:1651529344.756334:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+135:41279:x1731746396423936:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.756336:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.756338:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001d2e3221/0x3234de053c4e9e8 lrc: 4/0,0 mode: PR/PR res: [0x2bac1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5925 expref: 135 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.756339:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1928:39029:x1731745946542464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 751us (817us total) trans 12885080484 rc 0/0 00000100:00100000:0.0:1651529344.756342:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212429 00010000:00010000:1.0:1651529344.756344:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001d2e3221/0x3234de053c4e9e8 lrc: 3/0,0 mode: PR/PR res: [0x2bac1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5925 expref: 135 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.756348:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d2e3221/0x3234de053c4e9e8 lrc: 0/0,0 mode: --/PR res: [0x2bac1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5925 expref: 135 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.756348:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52cbc lrc: 2/0,0 mode: PW/PW res: [0x2babd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.756351:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.756352:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.756352:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52cdf lrc: 3/0,1 mode: PW/PW res: [0x2bac1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.756354:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f183a40b already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.756355:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52cdf lrc: 4/0,1 mode: PW/PW res: [0x2bac1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.756355:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52cbc lrc: 2/0,0 mode: PW/PW res: [0x2babd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.756358:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52cbc lrc: 3/0,0 mode: PW/PW res: [0x2babd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.756361:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.756362:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52cbc lrc: 1/0,0 mode: --/PW res: [0x2babd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.756365:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+134:41279:x1731746396423936:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 31us (222us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.756365:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52cbc lrc: 0/0,0 mode: --/PW res: [0x2babd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.756368:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13213 00010000:00010000:0.0:1651529344.756370:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52cc3 lrc: 2/0,0 mode: PW/PW res: [0x2babc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.756372:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003c075ac0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.756373:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52cc3 lrc: 2/0,0 mode: PW/PW res: [0x2babc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.756376:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52cc3 lrc: 3/0,0 mode: PW/PW res: [0x2babc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.756378:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52cdf lrc: 3/0,1 mode: PW/PW res: [0x2bac1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.756379:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52cc3 lrc: 1/0,0 mode: --/PW res: [0x2babc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.756381:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52cdf lrc: 3/0,1 mode: PW/PW res: [0x2bac1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.756382:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52cc3 lrc: 0/0,0 mode: --/PW res: [0x2babc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.756384:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52cdf lrc: 3/0,1 mode: PW/PW res: [0x2bac1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.756389:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52cdf lrc: 2/0,0 mode: PW/PW res: [0x2bac1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.756394:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.756431:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.756442:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1928:39030:x1731745946542784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 748us (871us total) trans 12885080485 rc 0/0 00000100:00100000:1.0:1651529344.756445:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212433 00000100:00100000:0.0:1651529344.756445:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.756456:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946542848 00000100:00100000:0.0:1651529344.756459:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.756471:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946542912 00000100:00100000:1.0:1651529344.756476:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212434 00000100:00100000:1.0:1651529344.756477:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001e283857 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1929:39030:x1731745946542848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.756482:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178882 count 1 00010000:00010000:1.0:1651529344.756486:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52ce6 lrc: 3/0,1 mode: --/PW res: [0x2bac2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.756497:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000741f3503/0x3234de053c4d4e8 lrc: 2/0,0 mode: PR/PR res: [0x2bac2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d05bf expref: 133 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.756500:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.756500:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52cdf lrc: 2/0,0 mode: PW/PW res: [0x2bac1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.756501:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.756504:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001391dc6d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.756505:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52cdf lrc: 2/0,0 mode: PW/PW res: [0x2bac1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.756507:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52ce6 lrc: 4/0,1 mode: --/PW res: [0x2bac2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.756509:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52cdf lrc: 3/0,0 mode: PW/PW res: [0x2bac1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.756513:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52cdf lrc: 1/0,0 mode: --/PW res: [0x2bac1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.756514:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000741f3503/0x3234de053c4d4e8 lrc: 3/0,0 mode: PR/PR res: [0x2bac2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d05bf expref: 133 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.756516:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c52cdf lrc: 0/0,0 mode: --/PW res: [0x2bac1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.756518:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000741f3503/0x3234de053c4d4e8 lrc: 4/0,0 mode: PR/PR res: [0x2bac2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d05bf expref: 133 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.756522:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f9050c71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997062528:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.756524:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212435 00000100:00100000:0.0:1651529344.756526:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1929:39030:x1731745946542912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.756531:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178883 count 1 00000100:00100000:1.0:1651529344.756536:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c3caa148 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.756541:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52ced lrc: 3/0,1 mode: --/PW res: [0x2bac3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.756544:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396423744 00010000:00010000:1.0:1651529344.756548:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000049575d5b/0x3234de053c4eaf2 lrc: 4/0,0 mode: PR/PR res: [0x2babf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5da1 expref: 134 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.756555:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396423872 00010000:00010000:1.0:1651529344.756557:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000049c8015d/0x3234de053c4e351 lrc: 4/0,0 mode: PR/PR res: [0x2bac0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e21 expref: 135 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.756561:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001be1acee/0x3234de053c4ea7b lrc: 2/0,0 mode: PR/PR res: [0x2bac3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5bb7 expref: 135 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.756563:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13214 00000100:00100000:1.0:1651529344.756564:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+135:41278:x1731746396423744:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.756565:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.756565:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.756566:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52ced lrc: 4/0,1 mode: --/PW res: [0x2bac3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.756567:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.756568:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000049575d5b/0x3234de053c4eaf2 lrc: 4/0,0 mode: PR/PR res: [0x2babf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5da1 expref: 135 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.756571:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000049575d5b/0x3234de053c4eaf2 lrc: 3/0,0 mode: PR/PR res: [0x2babf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5da1 expref: 135 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.756574:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001be1acee/0x3234de053c4ea7b lrc: 3/0,0 mode: PR/PR res: [0x2bac3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5bb7 expref: 135 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.756577:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049575d5b/0x3234de053c4eaf2 lrc: 0/0,0 mode: --/PR res: [0x2babf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5da1 expref: 135 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.756577:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001be1acee/0x3234de053c4ea7b lrc: 4/0,0 mode: PR/PR res: [0x2bac3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5bb7 expref: 135 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.756580:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.756581:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.756581:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cee35a0c pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997062592:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.756582:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52cca lrc: 3/0,1 mode: PW/PW res: [0x2babf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.756585:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52cca lrc: 4/0,1 mode: PW/PW res: [0x2babf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.756590:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.756590:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 0000000070e666f7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.756597:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+134:41278:x1731746396423744:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 32us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.756598:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13215 00000100:00100000:1.0:1651529344.756600:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13214 00000100:00100000:0.0:1651529344.756600:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+134:41278:x1731746396423872:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.756603:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.756605:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000049c8015d/0x3234de053c4e351 lrc: 4/0,0 mode: PR/PR res: [0x2bac0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e21 expref: 133 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.756606:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52cca lrc: 3/0,1 mode: PW/PW res: [0x2babf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.756609:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000049c8015d/0x3234de053c4e351 lrc: 3/0,0 mode: PR/PR res: [0x2bac0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e21 expref: 133 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.756610:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52cca lrc: 3/0,1 mode: PW/PW res: [0x2babf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.756613:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52cca lrc: 3/0,1 mode: PW/PW res: [0x2babf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.756615:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52cca lrc: 2/0,0 mode: PW/PW res: [0x2babf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.756617:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049c8015d/0x3234de053c4e351 lrc: 0/0,0 mode: --/PR res: [0x2bac0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3e21 expref: 133 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.756620:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.756621:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.756622:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52cd8 lrc: 3/0,1 mode: PW/PW res: [0x2bac0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.756625:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52cd8 lrc: 4/0,1 mode: PW/PW res: [0x2bac0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.756631:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.756653:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1930:39029:x1731745946542656:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1063us (1109us total) trans 12885080486 rc 0/0 00000100:00100000:0.0:1651529344.756653:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+132:41278:x1731746396423872:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 52us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.756656:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212430 00010000:00010000:1.0:1651529344.756662:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52cca lrc: 2/0,0 mode: PW/PW res: [0x2babf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.756665:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008517b233 already unused, calling callback (0000000049fddea7) 00000100:00100000:0.0:1651529344.756665:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13215 00010000:00010000:1.0:1651529344.756667:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52cca lrc: 2/0,0 mode: PW/PW res: [0x2babf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.756670:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52cca lrc: 3/0,0 mode: PW/PW res: [0x2babf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.756673:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52cd8 lrc: 3/0,1 mode: PW/PW res: [0x2bac0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.756674:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52cca lrc: 1/0,0 mode: --/PW res: [0x2babf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.756676:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52cd8 lrc: 3/0,1 mode: PW/PW res: [0x2bac0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.756677:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c52cca lrc: 0/0,0 mode: --/PW res: [0x2babf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.756679:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52cd8 lrc: 3/0,1 mode: PW/PW res: [0x2bac0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.756682:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52cd1 lrc: 3/0,1 mode: PW/PW res: [0x2babe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.756682:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52cd8 lrc: 2/0,0 mode: PW/PW res: [0x2bac0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.756685:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52cd1 lrc: 3/0,1 mode: PW/PW res: [0x2babe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.756688:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52cd1 lrc: 3/0,1 mode: PW/PW res: [0x2babe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.756691:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52cd1 lrc: 2/0,0 mode: PW/PW res: [0x2babe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.756728:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1931:39029:x1731745946542592:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1078us (1175us total) trans 12885080487 rc 0/0 00000100:00100000:1.0:1651529344.756731:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212431 00000100:00100000:0.0:1651529344.756754:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1930:39029:x1731745946542720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1084us (1192us total) trans 12885080488 rc 0/0 00000100:00100000:0.0:1651529344.756757:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212432 00010000:00010000:0.0:1651529344.756765:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52cd8 lrc: 2/0,0 mode: PW/PW res: [0x2bac0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.756769:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009e44ce9d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.756770:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52cd8 lrc: 2/0,0 mode: PW/PW res: [0x2bac0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.756772:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52cd8 lrc: 3/0,0 mode: PW/PW res: [0x2bac0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.756774:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.756777:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52cd8 lrc: 1/0,0 mode: --/PW res: [0x2bac0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.756786:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52cd8 lrc: 0/0,0 mode: --/PW res: [0x2bac0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.756790:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52cd1 lrc: 2/0,0 mode: PW/PW res: [0x2babe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.756792:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.756793:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f0bd9bfb already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.756794:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52cd1 lrc: 2/0,0 mode: PW/PW res: [0x2babe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.756799:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52cd1 lrc: 3/0,0 mode: PW/PW res: [0x2babe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.756803:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52cd1 lrc: 1/0,0 mode: --/PW res: [0x2babe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.756804:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.756805:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c52cd1 lrc: 0/0,0 mode: --/PW res: [0x2babe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.756813:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946542976 00000100:00100000:0.0:1651529344.756819:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946543040 00000100:00100000:0.0:1651529344.756822:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946543104 00000100:00100000:0.0:1651529344.756830:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212436 00000100:00100000:0.0:1651529344.756832:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1932:39030:x1731745946542976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.756836:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178884 count 1 00010000:00010000:0.0:1651529344.756840:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52cf4 lrc: 3/0,1 mode: --/PW res: [0x2bac4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.756844:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000032e7d059/0x3234de053c4cb95 lrc: 2/0,0 mode: PR/PR res: [0x2bac4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce026 expref: 131 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.756847:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.756848:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.756849:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52cf4 lrc: 4/0,1 mode: --/PW res: [0x2bac4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.756855:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000032e7d059/0x3234de053c4cb95 lrc: 3/0,0 mode: PR/PR res: [0x2bac4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce026 expref: 131 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.756859:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000032e7d059/0x3234de053c4cb95 lrc: 4/0,0 mode: PR/PR res: [0x2bac4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce026 expref: 131 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.756861:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212437 00000100:00100000:0.0:1651529344.756863:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ffb5d0a pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997062656:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.756864:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1932:39030:x1731745946543040:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.756869:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178885 count 1 00010000:00010000:1.0:1651529344.756874:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52cfb lrc: 3/0,1 mode: --/PW res: [0x2bac5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.756878:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007025fff4/0x3234de053c4d519 lrc: 2/0,0 mode: PR/PR res: [0x2bac5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0675 expref: 131 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.756881:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.756882:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.756882:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52cfb lrc: 4/0,1 mode: --/PW res: [0x2bac5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.756889:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007025fff4/0x3234de053c4d519 lrc: 3/0,0 mode: PR/PR res: [0x2bac5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0675 expref: 131 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.756892:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 000000000e7e66c4 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.756899:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007025fff4/0x3234de053c4d519 lrc: 4/0,0 mode: PR/PR res: [0x2bac5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0675 expref: 131 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.756904:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dfc79d4e pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997062720:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.756913:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a4eb401d going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.756913:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212438 00000100:00100000:0.0:1651529344.756914:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ea32140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1932:39029:x1731745946543104:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.756919:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178886 count 1 00010000:00010000:0.0:1651529344.756923:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52d02 lrc: 3/0,1 mode: --/PW res: [0x2bac6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.756928:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007bea1bc5/0x3234de053c4dd1c lrc: 2/0,0 mode: PR/PR res: [0x2bac6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2531 expref: 131 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.756931:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.756931:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.756932:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52d02 lrc: 4/0,1 mode: --/PW res: [0x2bac6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.756938:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007bea1bc5/0x3234de053c4dd1c lrc: 3/0,0 mode: PR/PR res: [0x2bac6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2531 expref: 131 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.756942:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007bea1bc5/0x3234de053c4dd1c lrc: 4/0,0 mode: PR/PR res: [0x2bac6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2531 expref: 131 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.756948:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000fb8e412 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997062784:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.756980:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.756982:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000abca413e going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.756989:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946543232 00000100:00100000:0.0:1651529344.757014:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212439 00000100:00100000:0.0:1651529344.757016:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1933:39030:x1731745946543232:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.757021:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178888 count 1 00010000:00010000:0.0:1651529344.757024:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52d09 lrc: 3/0,1 mode: --/PW res: [0x2bac8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.757029:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.757029:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000750fd34e/0x3234de053c49fc0 lrc: 2/0,0 mode: PR/PR res: [0x2bac8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb546 expref: 131 pid: 80281 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.757032:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.757033:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.757033:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52d09 lrc: 4/0,1 mode: --/PW res: [0x2bac8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.757044:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.757051:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946543168 00010000:00010000:0.0:1651529344.757057:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000750fd34e/0x3234de053c49fc0 lrc: 3/0,0 mode: PR/PR res: [0x2bac8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb546 expref: 131 pid: 80281 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.757062:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000750fd34e/0x3234de053c49fc0 lrc: 4/0,0 mode: PR/PR res: [0x2bac8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb546 expref: 131 pid: 80281 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.757063:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212440 00000100:00100000:1.0:1651529344.757065:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1934:39030:x1731745946543168:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.757066:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bddc5ca7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997062848:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529344.757070:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178887 count 1 00010000:00010000:1.0:1651529344.757074:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52d10 lrc: 3/0,1 mode: --/PW res: [0x2bac7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.757078:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bcd16fd7/0x3234de053c4e6c3 lrc: 2/0,0 mode: PR/PR res: [0x2bac7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b8e expref: 131 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.757081:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.757082:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.757083:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52d10 lrc: 4/0,1 mode: --/PW res: [0x2bac7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.757085:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed830649 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.757089:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bcd16fd7/0x3234de053c4e6c3 lrc: 3/0,0 mode: PR/PR res: [0x2bac7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b8e expref: 131 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.757092:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bcd16fd7/0x3234de053c4e6c3 lrc: 4/0,0 mode: PR/PR res: [0x2bac7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b8e expref: 131 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.757096:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997062912:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.757098:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.757112:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000567ee0ef going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.757117:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946543296 00000100:00100000:1.0:1651529344.757128:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212441 00000100:00100000:1.0:1651529344.757129:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1935:39030:x1731745946543296:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.757134:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178889 count 1 00010000:00010000:1.0:1651529344.757137:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c52d17 lrc: 3/0,1 mode: --/PW res: [0x2bac9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.757147:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009b3cc1b4/0x3234de053c4e526 lrc: 2/0,0 mode: PR/PR res: [0x2bac9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d459f expref: 131 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.757150:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.757151:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.757152:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c52d17 lrc: 4/0,1 mode: --/PW res: [0x2bac9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.757160:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cee35a0c pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997062592:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.757164:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52ced lrc: 3/0,1 mode: --/PW res: [0x2bac3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.757165:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009b3cc1b4/0x3234de053c4e526 lrc: 3/0,0 mode: PR/PR res: [0x2bac9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d459f expref: 131 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.757168:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009b3cc1b4/0x3234de053c4e526 lrc: 4/0,0 mode: PR/PR res: [0x2bac9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d459f expref: 131 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.757172:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007c534a1e pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997062976:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.757185:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a5495eb going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.757194:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f9050c71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997062528:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.757198:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52ce6 lrc: 3/0,1 mode: --/PW res: [0x2bac2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.757213:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396424000 00010000:00010000:1.0:1651529344.757218:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000741f3503/0x3234de053c4d4e8 lrc: 4/0,0 mode: PR/PR res: [0x2bac2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d05bf expref: 132 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.757245:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13216 00000100:00100000:1.0:1651529344.757252:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+132:41279:x1731746396424000:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.757255:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.757257:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000741f3503/0x3234de053c4d4e8 lrc: 4/0,0 mode: PR/PR res: [0x2bac2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d05bf expref: 132 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.757261:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000741f3503/0x3234de053c4d4e8 lrc: 3/0,0 mode: PR/PR res: [0x2bac2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d05bf expref: 132 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.757266:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000741f3503/0x3234de053c4d4e8 lrc: 0/0,0 mode: --/PR res: [0x2bac2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d05bf expref: 132 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.757270:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.757271:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.757271:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52ce6 lrc: 3/0,1 mode: PW/PW res: [0x2bac2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.757274:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52ce6 lrc: 4/0,1 mode: PW/PW res: [0x2bac2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.757281:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.757292:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+131:41279:x1731746396424000:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 45us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.757294:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13216 00010000:00010000:1.0:1651529344.757303:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52ce6 lrc: 3/0,1 mode: PW/PW res: [0x2bac2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.757307:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52ce6 lrc: 3/0,1 mode: PW/PW res: [0x2bac2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.757325:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52ce6 lrc: 3/0,1 mode: PW/PW res: [0x2bac2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.757328:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52ce6 lrc: 2/0,0 mode: PW/PW res: [0x2bac2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.757372:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001e283857 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1936:39030:x1731745946542848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 894us (941us total) trans 12885080489 rc 0/0 00000100:00100000:1.0:1651529344.757375:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212434 00010000:00010000:1.0:1651529344.757402:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52ce6 lrc: 2/0,0 mode: PW/PW res: [0x2bac2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.757406:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f9b62460 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.757407:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52ce6 lrc: 2/0,0 mode: PW/PW res: [0x2bac2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.757410:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52ce6 lrc: 3/0,0 mode: PW/PW res: [0x2bac2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.757414:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52ce6 lrc: 1/0,0 mode: --/PW res: [0x2bac2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.757417:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c52ce6 lrc: 0/0,0 mode: --/PW res: [0x2bac2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.757501:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.757509:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dfc79d4e pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997062720:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.757513:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52cfb lrc: 3/0,1 mode: --/PW res: [0x2bac5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.757524:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396424192 00000100:00100000:0.0:1651529344.757527:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.757528:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007bea1bc5/0x3234de053c4dd1c lrc: 5/0,0 mode: PR/PR res: [0x2bac6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2531 expref: 131 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.757535:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396424256 00000100:00100000:0.0:1651529344.757536:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.757537:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007025fff4/0x3234de053c4d519 lrc: 4/0,0 mode: PR/PR res: [0x2bac5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0675 expref: 132 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.757546:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.757548:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396424064 00010000:00010000:1.0:1651529344.757551:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001be1acee/0x3234de053c4ea7b lrc: 4/0,0 mode: PR/PR res: [0x2bac3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5bb7 expref: 133 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.757552:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.757556:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396424128 00010000:00010000:1.0:1651529344.757558:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000032e7d059/0x3234de053c4cb95 lrc: 5/0,0 mode: PR/PR res: [0x2bac4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce026 expref: 134 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.757570:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13217 00000100:00100000:0.0:1651529344.757570:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.757572:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+134:41278:x1731746396424192:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.757575:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.757575:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.757576:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007bea1bc5/0x3234de053c4dd1c lrc: 5/0,0 mode: PR/PR res: [0x2bac6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2531 expref: 134 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.757580:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007bea1bc5/0x3234de053c4dd1c lrc: 4/0,0 mode: PR/PR res: [0x2bac6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2531 expref: 134 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.757581:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.757588:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.757589:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.757589:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52d02 lrc: 3/0,1 mode: PW/PW res: [0x2bac6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.757589:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ffb5d0a pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997062656:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.757593:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52d02 lrc: 4/0,1 mode: PW/PW res: [0x2bac6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.757593:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52cf4 lrc: 3/0,1 mode: --/PW res: [0x2bac4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.757597:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.757601:0:80281:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007bea1bc5/0x3234de053c4dd1c lrc: 0/0,0 mode: --/PR res: [0x2bac6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2531 expref: 134 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.757605:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000fb8e412 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997062784:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.757609:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+133:41278:x1731746396424192:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.757612:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13217 00010000:00010000:0.0:1651529344.757613:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52d02 lrc: 3/0,1 mode: PW/PW res: [0x2bac6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.757616:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396424384 00010000:00010000:0.0:1651529344.757617:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52d02 lrc: 3/0,1 mode: PW/PW res: [0x2bac6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.757620:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bcd16fd7/0x3234de053c4e6c3 lrc: 5/0,0 mode: PR/PR res: [0x2bac7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b8e expref: 133 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.757622:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52d02 lrc: 3/0,1 mode: PW/PW res: [0x2bac6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.757624:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396424320 00010000:00010000:0.0:1651529344.757625:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52d02 lrc: 3/0,1 mode: PW/PW res: [0x2bac6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.757627:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000750fd34e/0x3234de053c49fc0 lrc: 5/0,0 mode: PR/PR res: [0x2bac8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb546 expref: 134 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.757628:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52d02 lrc: 2/0,0 mode: PW/PW res: [0x2bac6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.757631:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396424448 00010000:00010000:1.0:1651529344.757633:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009b3cc1b4/0x3234de053c4e526 lrc: 5/0,0 mode: PR/PR res: [0x2bac9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d459f expref: 135 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.757637:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13218 00000100:00100000:1.0:1651529344.757638:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+135:41278:x1731746396424256:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.757642:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.757643:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007025fff4/0x3234de053c4d519 lrc: 4/0,0 mode: PR/PR res: [0x2bac5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0675 expref: 135 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.757646:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007025fff4/0x3234de053c4d519 lrc: 3/0,0 mode: PR/PR res: [0x2bac5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0675 expref: 135 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.757651:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007025fff4/0x3234de053c4d519 lrc: 0/0,0 mode: --/PR res: [0x2bac5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0675 expref: 135 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.757654:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.757655:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.757655:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52cfb lrc: 3/0,1 mode: PW/PW res: [0x2bac5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.757658:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52cfb lrc: 4/0,1 mode: PW/PW res: [0x2bac5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.757665:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.757668:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ea32140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1936:39029:x1731745946543104:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 753us (864us total) trans 12885080490 rc 0/0 00000100:00100000:1.0:1651529344.757670:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+134:41278:x1731746396424256:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 31us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.757672:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212438 00000100:00100000:1.0:1651529344.757673:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13218 00000100:00100000:1.0:1651529344.757676:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13219 00000100:00100000:0.0:1651529344.757677:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946543360 00000100:00100000:1.0:1651529344.757678:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7bfdb64 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+133:41279:x1731746396424064:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.757680:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.757681:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001be1acee/0x3234de053c4ea7b lrc: 4/0,0 mode: PR/PR res: [0x2bac3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5bb7 expref: 133 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.757688:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212442 00000100:00100000:0.0:1651529344.757689:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1936:39029:x1731745946543360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.757694:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001be1acee/0x3234de053c4ea7b lrc: 3/0,0 mode: PR/PR res: [0x2bac3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5bb7 expref: 133 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:0.0:1651529344.757694:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178890 count 1 00010000:00010000:0.0:1651529344.757698:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52d1e lrc: 3/0,1 mode: --/PW res: [0x2baca:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.757700:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001be1acee/0x3234de053c4ea7b lrc: 0/0,0 mode: --/PR res: [0x2bac3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5bb7 expref: 133 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.757703:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.757703:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f5acca5a/0x3234de053c4ec9d lrc: 2/0,0 mode: PR/PR res: [0x2baca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6462 expref: 132 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.757704:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.757704:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52ced lrc: 3/0,1 mode: PW/PW res: [0x2bac3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.757706:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.757706:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.757707:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52ced lrc: 4/0,1 mode: PW/PW res: [0x2bac3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.757707:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52d1e lrc: 4/0,1 mode: --/PW res: [0x2baca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.757716:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.757721:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7bfdb64 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+132:41279:x1731746396424064:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 43us (175us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.757723:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f5acca5a/0x3234de053c4ec9d lrc: 3/0,0 mode: PR/PR res: [0x2baca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6462 expref: 132 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.757724:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13219 00010000:00010000:0.0:1651529344.757727:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f5acca5a/0x3234de053c4ec9d lrc: 4/0,0 mode: PR/PR res: [0x2baca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6462 expref: 131 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.757731:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13220 00000100:00100000:0.0:1651529344.757731:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000be0ace91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997063040:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.757733:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+131:41279:x1731746396424128:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.757744:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.757746:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000032e7d059/0x3234de053c4cb95 lrc: 4/0,0 mode: PR/PR res: [0x2bac4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce026 expref: 131 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.757749:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000abca413e going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.757750:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000032e7d059/0x3234de053c4cb95 lrc: 3/0,0 mode: PR/PR res: [0x2bac4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce026 expref: 131 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.757756:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032e7d059/0x3234de053c4cb95 lrc: 0/0,0 mode: --/PR res: [0x2bac4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce026 expref: 131 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.757757:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bddc5ca7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997062848:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.757759:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.757760:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.757760:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52d09 lrc: 3/0,1 mode: --/PW res: [0x2bac8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.757761:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52cf4 lrc: 3/0,1 mode: PW/PW res: [0x2bac4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.757764:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52cf4 lrc: 4/0,1 mode: PW/PW res: [0x2bac4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.757766:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52d02 lrc: 2/0,0 mode: PW/PW res: [0x2bac6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.757769:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000820e505a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.757770:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52d02 lrc: 2/0,0 mode: PW/PW res: [0x2bac6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.757772:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.757778:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+130:41279:x1731746396424128:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 44us (226us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.757779:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52d02 lrc: 3/0,0 mode: PW/PW res: [0x2bac6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.757780:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13220 00010000:00010000:0.0:1651529344.757784:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52d02 lrc: 1/0,0 mode: --/PW res: [0x2bac6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.757785:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13221 00000100:00100000:1.0:1651529344.757786:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+129:41278:x1731746396424384:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.757789:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.757789:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52d02 lrc: 0/0,0 mode: --/PW res: [0x2bac6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.757790:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bcd16fd7/0x3234de053c4e6c3 lrc: 5/0,0 mode: PR/PR res: [0x2bac7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b8e expref: 129 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.757793:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bcd16fd7/0x3234de053c4e6c3 lrc: 4/0,0 mode: PR/PR res: [0x2bac7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b8e expref: 129 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.757798:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.757798:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.757798:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52ced lrc: 3/0,1 mode: PW/PW res: [0x2bac3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.757799:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52d10 lrc: 3/0,1 mode: PW/PW res: [0x2bac7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.757801:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52ced lrc: 3/0,1 mode: PW/PW res: [0x2bac3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.757802:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52d10 lrc: 4/0,1 mode: PW/PW res: [0x2bac7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.757804:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52ced lrc: 3/0,1 mode: PW/PW res: [0x2bac3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.757806:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.757807:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52ced lrc: 2/0,0 mode: PW/PW res: [0x2bac3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.757809:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+129:41278:x1731746396424384:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 22us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.757812:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13221 00000100:00100000:1.0:1651529344.757815:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13222 00000100:00100000:1.0:1651529344.757816:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+128:41278:x1731746396424320:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.757818:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.757819:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000750fd34e/0x3234de053c49fc0 lrc: 4/0,0 mode: PR/PR res: [0x2bac8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb546 expref: 128 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.757823:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000750fd34e/0x3234de053c49fc0 lrc: 3/0,0 mode: PR/PR res: [0x2bac8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb546 expref: 128 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.757827:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000750fd34e/0x3234de053c49fc0 lrc: 0/0,0 mode: --/PR res: [0x2bac8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb546 expref: 128 pid: 80281 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.757830:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.757830:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.757831:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52d09 lrc: 3/0,1 mode: PW/PW res: [0x2bac8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.757834:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52d09 lrc: 4/0,1 mode: PW/PW res: [0x2bac8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.757842:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.757852:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+127:41278:x1731746396424320:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 35us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.757852:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1937:39030:x1731745946542912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1325us (1392us total) trans 12885080491 rc 0/0 00000100:00100000:1.0:1651529344.757854:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13222 00000100:00100000:0.0:1651529344.757855:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212435 00000100:00100000:1.0:1651529344.757858:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13223 00000100:00100000:1.0:1651529344.757860:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+126:41278:x1731746396424448:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.757862:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.757862:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52ced lrc: 2/0,0 mode: PW/PW res: [0x2bac3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.757863:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009b3cc1b4/0x3234de053c4e526 lrc: 5/0,0 mode: PR/PR res: [0x2bac9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d459f expref: 126 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.757865:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000050e053bc already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.757866:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52ced lrc: 2/0,0 mode: PW/PW res: [0x2bac3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.757867:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009b3cc1b4/0x3234de053c4e526 lrc: 4/0,0 mode: PR/PR res: [0x2bac9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d459f expref: 126 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.757869:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52ced lrc: 3/0,0 mode: PW/PW res: [0x2bac3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.757871:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.757871:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.757872:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c52d17 lrc: 3/0,1 mode: PW/PW res: [0x2bac9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.757874:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52ced lrc: 1/0,0 mode: --/PW res: [0x2bac3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.757875:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c52d17 lrc: 4/0,1 mode: PW/PW res: [0x2bac9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.757877:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52ced lrc: 0/0,0 mode: --/PW res: [0x2bac3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.757879:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.757882:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+126:41278:x1731746396424448:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 22us (301us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.757882:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52d09 lrc: 3/0,1 mode: PW/PW res: [0x2bac8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.757884:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13223 00010000:00010000:0.0:1651529344.757885:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52d09 lrc: 3/0,1 mode: PW/PW res: [0x2bac8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.757888:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52d09 lrc: 3/0,1 mode: PW/PW res: [0x2bac8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.757891:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52d09 lrc: 2/0,0 mode: PW/PW res: [0x2bac8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.757896:0:80279:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bcd16fd7/0x3234de053c4e6c3 lrc: 0/0,0 mode: --/PR res: [0x2bac7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4b8e expref: 125 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.757907:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997062912:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.757910:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52d10 lrc: 3/0,1 mode: PW/PW res: [0x2bac7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.757913:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52d10 lrc: 3/0,1 mode: PW/PW res: [0x2bac7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.757916:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52d10 lrc: 3/0,1 mode: PW/PW res: [0x2bac7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.757919:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52d10 lrc: 3/0,1 mode: PW/PW res: [0x2bac7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.757922:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52d10 lrc: 2/0,0 mode: PW/PW res: [0x2bac7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.757936:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1937:39030:x1731745946543232:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 919us (956us total) trans 12885080492 rc 0/0 00000100:00100000:0.0:1651529344.757939:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212439 00010000:00010000:0.0:1651529344.757946:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52cf4 lrc: 3/0,1 mode: PW/PW res: [0x2bac4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.757949:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52cf4 lrc: 3/0,1 mode: PW/PW res: [0x2bac4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.757954:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52cf4 lrc: 3/0,1 mode: PW/PW res: [0x2bac4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.757957:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52cf4 lrc: 2/0,0 mode: PW/PW res: [0x2bac4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.757964:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1937:39030:x1731745946543168:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 899us (941us total) trans 12885080493 rc 0/0 00000100:00100000:1.0:1651529344.757967:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212440 00010000:00010000:1.0:1651529344.757974:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52d09 lrc: 2/0,0 mode: PW/PW res: [0x2bac8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.757978:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000046fea5cc already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.757979:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52d09 lrc: 2/0,0 mode: PW/PW res: [0x2bac8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.757984:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52d09 lrc: 3/0,0 mode: PW/PW res: [0x2bac8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.757988:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52d09 lrc: 1/0,0 mode: --/PW res: [0x2bac8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.757990:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1937:39030:x1731745946542976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1158us (1216us total) trans 12885080494 rc 0/0 00010000:00010000:1.0:1651529344.757991:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52d09 lrc: 0/0,0 mode: --/PW res: [0x2bac8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.757993:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212436 00010000:00010000:1.0:1651529344.757995:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52d10 lrc: 2/0,0 mode: PW/PW res: [0x2bac7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.757998:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e7aaedb0 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.757999:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52d10 lrc: 2/0,0 mode: PW/PW res: [0x2bac7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.757999:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52cf4 lrc: 2/0,0 mode: PW/PW res: [0x2bac4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.758002:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52d10 lrc: 3/0,0 mode: PW/PW res: [0x2bac7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.758003:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f1b4c19f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.758004:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52cf4 lrc: 2/0,0 mode: PW/PW res: [0x2bac4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.758005:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52d10 lrc: 1/0,0 mode: --/PW res: [0x2bac7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.758006:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52cf4 lrc: 3/0,0 mode: PW/PW res: [0x2bac4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.758007:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c52d10 lrc: 0/0,0 mode: --/PW res: [0x2bac7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.758011:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52cf4 lrc: 1/0,0 mode: --/PW res: [0x2bac4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.758013:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52cf4 lrc: 0/0,0 mode: --/PW res: [0x2bac4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.758016:0:80280:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b3cc1b4/0x3234de053c4e526 lrc: 0/0,0 mode: --/PR res: [0x2bac9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d459f expref: 124 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.758022:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007c534a1e pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997062976:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.758025:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c52d17 lrc: 3/0,1 mode: PW/PW res: [0x2bac9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.758028:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c52d17 lrc: 3/0,1 mode: PW/PW res: [0x2bac9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.758031:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c52d17 lrc: 3/0,1 mode: PW/PW res: [0x2bac9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.758034:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c52d17 lrc: 3/0,1 mode: PW/PW res: [0x2bac9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.758036:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c52d17 lrc: 2/0,0 mode: PW/PW res: [0x2bac9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.758112:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1937:39030:x1731745946543296:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 981us (1068us total) trans 12885080495 rc 0/0 00000100:00100000:1.0:1651529344.758115:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212441 00010000:00010000:1.0:1651529344.758123:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52cfb lrc: 3/0,1 mode: PW/PW res: [0x2bac5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.758126:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52cfb lrc: 3/0,1 mode: PW/PW res: [0x2bac5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.758137:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52cfb lrc: 3/0,1 mode: PW/PW res: [0x2bac5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.758139:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52cfb lrc: 2/0,0 mode: PW/PW res: [0x2bac5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.758157:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c52d17 lrc: 2/0,0 mode: PW/PW res: [0x2bac9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.758162:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000a7c37b9 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.758163:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c52d17 lrc: 2/0,0 mode: PW/PW res: [0x2bac9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.758166:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c52d17 lrc: 3/0,0 mode: PW/PW res: [0x2bac9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.758171:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c52d17 lrc: 1/0,0 mode: --/PW res: [0x2bac9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.758173:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c52d17 lrc: 0/0,0 mode: --/PW res: [0x2bac9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.758178:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52cfb lrc: 2/0,0 mode: PW/PW res: [0x2bac5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.758182:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1937:39030:x1731745946543040:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1318us (1389us total) trans 12885080496 rc 0/0 00000100:00100000:1.0:1651529344.758185:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212437 00010000:00010000:0.0:1651529344.758186:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000091ee0f93 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.758187:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52cfb lrc: 2/0,0 mode: PW/PW res: [0x2bac5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.758190:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52cfb lrc: 3/0,0 mode: PW/PW res: [0x2bac5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.758193:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52cfb lrc: 1/0,0 mode: --/PW res: [0x2bac5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.758196:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c52cfb lrc: 0/0,0 mode: --/PW res: [0x2bac5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.758304:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.758325:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946543424 00000100:00100000:1.0:1651529344.758333:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212443 00000100:00100000:1.0:1651529344.758334:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1937:39030:x1731745946543424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.758339:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178891 count 1 00000100:00100000:0.0:1651529344.758345:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.758349:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c52d25 lrc: 3/0,1 mode: --/PW res: [0x2bacb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.758354:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000497518ba/0x3234de053c4d065 lrc: 2/0,0 mode: PR/PR res: [0x2bacb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf33c expref: 123 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.758357:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.758357:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.758358:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c52d25 lrc: 4/0,1 mode: --/PW res: [0x2bacb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.758364:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.758374:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.758376:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000497518ba/0x3234de053c4d065 lrc: 3/0,0 mode: PR/PR res: [0x2bacb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf33c expref: 123 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.758381:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.758383:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000497518ba/0x3234de053c4d065 lrc: 4/0,0 mode: PR/PR res: [0x2bacb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf33c expref: 123 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.758389:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.758393:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007c534a1e pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997063104:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.758395:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.758408:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a5495eb going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.758409:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.758414:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946543552 00000100:00100000:1.0:1651529344.758420:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946543680 00000100:00100000:1.0:1651529344.758423:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946543488 00000100:00100000:1.0:1651529344.758436:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946543616 00000100:00100000:1.0:1651529344.758439:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946543744 00000100:00100000:0.0:1651529344.758441:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000be0ace91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997063040:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.758442:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946543808 00000100:00100000:1.0:1651529344.758445:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212444 00010000:00010000:0.0:1651529344.758445:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52d1e lrc: 3/0,1 mode: --/PW res: [0x2baca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.758447:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1943:39029:x1731745946543552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.758451:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178893 count 1 00000100:00100000:0.0:1651529344.758453:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212445 00010000:00010000:1.0:1651529344.758455:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c52d2c lrc: 3/0,1 mode: --/PW res: [0x2bacd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.758455:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1943:39029:x1731745946543680:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.758459:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000075b1ab9d/0x3234de053c4e5e3 lrc: 2/0,0 mode: PR/PR res: [0x2bacd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4903 expref: 123 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.758460:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178895 count 1 00010000:00010000:1.0:1651529344.758462:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.758463:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.758464:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c52d2c lrc: 4/0,1 mode: --/PW res: [0x2bacd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.758464:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52d33 lrc: 3/0,1 mode: --/PW res: [0x2bacf:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.758469:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b17ab984/0x3234de053c4de96 lrc: 2/0,0 mode: PR/PR res: [0x2bacf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b19 expref: 123 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.758470:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000075b1ab9d/0x3234de053c4e5e3 lrc: 3/0,0 mode: PR/PR res: [0x2bacd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4903 expref: 123 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.758472:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.758472:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.758473:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52d33 lrc: 4/0,1 mode: --/PW res: [0x2bacf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.758476:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000075b1ab9d/0x3234de053c4e5e3 lrc: 4/0,0 mode: PR/PR res: [0x2bacd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4903 expref: 123 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.758480:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d718cfe4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997063168:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.758482:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b17ab984/0x3234de053c4de96 lrc: 3/0,0 mode: PR/PR res: [0x2bacf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b19 expref: 123 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.758486:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b17ab984/0x3234de053c4de96 lrc: 4/0,0 mode: PR/PR res: [0x2bacf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b19 expref: 123 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.758490:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005384a251 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997063232:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.758493:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c3caa148 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.758500:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212446 00000100:00100000:1.0:1651529344.758502:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1943:39029:x1731745946543488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.758506:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178892 count 1 00000100:00100000:0.0:1651529344.758506:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000abca413e going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.758510:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c52d3a lrc: 3/0,1 mode: --/PW res: [0x2bacc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.758512:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212447 00010000:00010000:1.0:1651529344.758514:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000accdc5e9/0x3234de053c4a603 lrc: 2/0,0 mode: PR/PR res: [0x2bacc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb74 expref: 123 pid: 80280 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.758514:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1943:39029:x1731745946543616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.758517:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.758517:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.758518:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c52d3a lrc: 4/0,1 mode: --/PW res: [0x2bacc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.758518:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178894 count 1 00010000:00010000:0.0:1651529344.758522:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52d41 lrc: 3/0,1 mode: --/PW res: [0x2bace:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.758524:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000accdc5e9/0x3234de053c4a603 lrc: 3/0,0 mode: PR/PR res: [0x2bacc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb74 expref: 123 pid: 80280 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.758526:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000a1d22a9/0x3234de053c4d217 lrc: 2/0,0 mode: PR/PR res: [0x2bace:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf9fd expref: 123 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.758527:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000accdc5e9/0x3234de053c4a603 lrc: 4/0,0 mode: PR/PR res: [0x2bacc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb74 expref: 123 pid: 80280 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.758529:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.758530:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.758531:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52d41 lrc: 4/0,1 mode: --/PW res: [0x2bace:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.758534:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997063296:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.758541:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.758547:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212448 00000100:00100000:1.0:1651529344.758548:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1943:39029:x1731745946543744:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.758552:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178896 count 1 00010000:00010000:0.0:1651529344.758554:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000a1d22a9/0x3234de053c4d217 lrc: 3/0,0 mode: PR/PR res: [0x2bace:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf9fd expref: 123 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.758555:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c52d48 lrc: 3/0,1 mode: --/PW res: [0x2bad0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.758557:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000a1d22a9/0x3234de053c4d217 lrc: 4/0,0 mode: PR/PR res: [0x2bace:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf9fd expref: 123 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.758559:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005c2cfadf/0x3234de053c4d6fc lrc: 2/0,0 mode: PR/PR res: [0x2bad0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d9f expref: 123 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.758562:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.758562:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000075e1000f pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997063360:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.758563:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.758563:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c52d48 lrc: 4/0,1 mode: --/PW res: [0x2bad0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.758569:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005c2cfadf/0x3234de053c4d6fc lrc: 3/0,0 mode: PR/PR res: [0x2bad0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d9f expref: 123 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.758570:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ff7bf023 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.758572:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005c2cfadf/0x3234de053c4d6fc lrc: 4/0,0 mode: PR/PR res: [0x2bad0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d9f expref: 123 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.758576:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029d739c8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997063424:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.758582:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aeda71fe going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.758588:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212449 00000100:00100000:1.0:1651529344.758590:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1943:39030:x1731745946543808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.758594:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178897 count 1 00000100:00100000:0.0:1651529344.758595:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396424512 00010000:00010000:1.0:1651529344.758596:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c52d4f lrc: 3/0,1 mode: --/PW res: [0x2bad1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.758600:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000033e32e61/0x3234de053c4ef21 lrc: 2/0,0 mode: PR/PR res: [0x2bad1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6eaa expref: 124 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.758600:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f5acca5a/0x3234de053c4ec9d lrc: 4/0,0 mode: PR/PR res: [0x2baca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6462 expref: 124 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.758603:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.758604:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.758604:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c52d4f lrc: 4/0,1 mode: --/PW res: [0x2bad1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.758612:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13224 00000100:00100000:0.0:1651529344.758613:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+124:41278:x1731746396424512:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.758617:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000033e32e61/0x3234de053c4ef21 lrc: 3/0,0 mode: PR/PR res: [0x2bad1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6eaa expref: 124 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.758617:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.758618:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f5acca5a/0x3234de053c4ec9d lrc: 4/0,0 mode: PR/PR res: [0x2baca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6462 expref: 124 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.758621:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000033e32e61/0x3234de053c4ef21 lrc: 4/0,0 mode: PR/PR res: [0x2bad1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6eaa expref: 124 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.758622:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f5acca5a/0x3234de053c4ec9d lrc: 3/0,0 mode: PR/PR res: [0x2baca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6462 expref: 124 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.758625:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000050bbb886 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997063488:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.758628:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5acca5a/0x3234de053c4ec9d lrc: 0/0,0 mode: --/PR res: [0x2baca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6462 expref: 124 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.758631:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 0000000053a0cffa going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.758631:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.758632:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.758632:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52d1e lrc: 3/0,1 mode: PW/PW res: [0x2baca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.758636:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52d1e lrc: 4/0,1 mode: PW/PW res: [0x2baca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.758645:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.758652:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+123:41278:x1731746396424512:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 38us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.758655:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13224 00010000:00010000:0.0:1651529344.758661:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52d1e lrc: 3/0,1 mode: PW/PW res: [0x2baca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.758664:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52d1e lrc: 3/0,1 mode: PW/PW res: [0x2baca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.758667:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52d1e lrc: 3/0,1 mode: PW/PW res: [0x2baca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.758669:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.758669:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52d1e lrc: 2/0,0 mode: PW/PW res: [0x2baca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.758714:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1944:39029:x1731745946543360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1024us (1178us total) trans 12885080497 rc 0/0 00000100:00100000:0.0:1651529344.758717:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212442 00010000:00010000:0.0:1651529344.758725:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52d1e lrc: 2/0,0 mode: PW/PW res: [0x2baca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.758728:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000490515f1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.758729:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52d1e lrc: 2/0,0 mode: PW/PW res: [0x2baca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.758744:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52d1e lrc: 3/0,0 mode: PW/PW res: [0x2baca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.758750:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52d1e lrc: 1/0,0 mode: --/PW res: [0x2baca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.758752:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52d1e lrc: 0/0,0 mode: --/PW res: [0x2baca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.758761:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396424576 00010000:00010000:0.0:1651529344.758766:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000497518ba/0x3234de053c4d065 lrc: 5/0,0 mode: PR/PR res: [0x2bacb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf33c expref: 123 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.758772:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007c534a1e pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997063104:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.758776:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c52d25 lrc: 3/0,1 mode: --/PW res: [0x2bacb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.758792:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13225 00000100:00100000:0.0:1651529344.758794:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+123:41278:x1731746396424576:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.758798:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.758799:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000497518ba/0x3234de053c4d065 lrc: 4/0,0 mode: PR/PR res: [0x2bacb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf33c expref: 123 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.758803:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000497518ba/0x3234de053c4d065 lrc: 3/0,0 mode: PR/PR res: [0x2bacb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf33c expref: 123 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.758808:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000497518ba/0x3234de053c4d065 lrc: 0/0,0 mode: --/PR res: [0x2bacb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf33c expref: 123 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.758812:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.758812:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.758813:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c52d25 lrc: 3/0,1 mode: PW/PW res: [0x2bacb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.758816:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c52d25 lrc: 4/0,1 mode: PW/PW res: [0x2bacb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.758824:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.758826:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c52d25 lrc: 3/0,1 mode: PW/PW res: [0x2bacb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.758830:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c52d25 lrc: 3/0,1 mode: PW/PW res: [0x2bacb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.758835:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+122:41278:x1731746396424576:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 40us (166us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.758837:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c52d25 lrc: 3/0,1 mode: PW/PW res: [0x2bacb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.758838:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13225 00010000:00010000:1.0:1651529344.758840:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c52d25 lrc: 2/0,0 mode: PW/PW res: [0x2bacb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.758882:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.758891:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1944:39030:x1731745946543424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 555us (587us total) trans 12885080498 rc 0/0 00000100:00100000:1.0:1651529344.758894:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212443 00000100:00100000:1.0:1651529344.758899:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946543872 00000100:00100000:1.0:1651529344.758905:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212450 00000100:00100000:1.0:1651529344.758915:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1944:39030:x1731745946543872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.758921:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178898 count 1 00010000:00010000:1.0:1651529344.758925:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c52d56 lrc: 3/0,1 mode: --/PW res: [0x2bad2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.758929:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb101edb/0x3234de053c4d749 lrc: 2/0,0 mode: PR/PR res: [0x2bad2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0eb7 expref: 121 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.758932:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.758933:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.758933:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c52d56 lrc: 4/0,1 mode: --/PW res: [0x2bad2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.758942:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fb101edb/0x3234de053c4d749 lrc: 3/0,0 mode: PR/PR res: [0x2bad2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0eb7 expref: 121 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.758946:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fb101edb/0x3234de053c4d749 lrc: 4/0,0 mode: PR/PR res: [0x2bad2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0eb7 expref: 121 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.758950:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000007fba516 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997063552:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.758964:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a5495eb going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.758969:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c52d25 lrc: 2/0,0 mode: PW/PW res: [0x2bacb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.758972:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b0407aaf already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.758973:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c52d25 lrc: 2/0,0 mode: PW/PW res: [0x2bacb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.758976:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c52d25 lrc: 3/0,0 mode: PW/PW res: [0x2bacb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.758981:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c52d25 lrc: 1/0,0 mode: --/PW res: [0x2bacb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.758991:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c52d25 lrc: 0/0,0 mode: --/PW res: [0x2bacb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.759039:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.759049:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946543936 00000100:00100000:1.0:1651529344.759060:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212451 00000100:00100000:1.0:1651529344.759061:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1945:39029:x1731745946543936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.759066:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178899 count 1 00010000:00010000:1.0:1651529344.759069:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c52d5d lrc: 3/0,1 mode: --/PW res: [0x2bad3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.759074:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000045a04653/0x3234de053c4f548 lrc: 2/0,0 mode: PR/PR res: [0x2bad3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8770 expref: 121 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.759077:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.759077:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.759078:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c52d5d lrc: 4/0,1 mode: --/PW res: [0x2bad3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.759084:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000045a04653/0x3234de053c4f548 lrc: 3/0,0 mode: PR/PR res: [0x2bad3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8770 expref: 121 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.759087:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000045a04653/0x3234de053c4f548 lrc: 4/0,0 mode: PR/PR res: [0x2bad3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8770 expref: 121 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.759091:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004be0190 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997063616:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.759102:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e5f43e7 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.759165:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d718cfe4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997063168:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.759174:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c52d2c lrc: 3/0,1 mode: --/PW res: [0x2bacd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.759184:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.759187:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997063296:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.759190:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c52d3a lrc: 3/0,1 mode: --/PW res: [0x2bacc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.759191:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.759199:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.759201:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029d739c8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997063424:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.759208:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c52d48 lrc: 3/0,1 mode: --/PW res: [0x2bad0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.759215:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396424704 00000100:00100000:0.0:1651529344.759219:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.759220:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000accdc5e9/0x3234de053c4a603 lrc: 4/0,0 mode: PR/PR res: [0x2bacc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb74 expref: 122 pid: 80280 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.759243:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396424640 00010000:00010000:1.0:1651529344.759246:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000075b1ab9d/0x3234de053c4e5e3 lrc: 4/0,0 mode: PR/PR res: [0x2bacd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4903 expref: 123 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.759250:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396424832 00010000:00010000:1.0:1651529344.759252:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000a1d22a9/0x3234de053c4d217 lrc: 5/0,0 mode: PR/PR res: [0x2bace:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf9fd expref: 124 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.759254:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.759271:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.759273:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396424768 00010000:00010000:1.0:1651529344.759276:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b17ab984/0x3234de053c4de96 lrc: 5/0,0 mode: PR/PR res: [0x2bacf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b19 expref: 125 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.759277:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.759281:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396424896 00010000:00010000:1.0:1651529344.759283:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005c2cfadf/0x3234de053c4d6fc lrc: 4/0,0 mode: PR/PR res: [0x2bad0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d9f expref: 126 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.759287:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396424960 00000100:00100000:0.0:1651529344.759287:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005384a251 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997063232:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.759288:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000033e32e61/0x3234de053c4ef21 lrc: 5/0,0 mode: PR/PR res: [0x2bad1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6eaa expref: 127 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.759291:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52d33 lrc: 3/0,1 mode: --/PW res: [0x2bacf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.759293:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396425024 00010000:00010000:1.0:1651529344.759295:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fb101edb/0x3234de053c4d749 lrc: 5/0,0 mode: PR/PR res: [0x2bad2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0eb7 expref: 128 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.759298:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000075e1000f pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997063360:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.759299:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13226 00000100:00100000:1.0:1651529344.759301:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031e6b9e0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+128:41279:x1731746396424704:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.759301:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52d41 lrc: 3/0,1 mode: --/PW res: [0x2bace:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.759303:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.759304:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000accdc5e9/0x3234de053c4a603 lrc: 4/0,0 mode: PR/PR res: [0x2bacc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb74 expref: 128 pid: 80280 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.759308:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000accdc5e9/0x3234de053c4a603 lrc: 3/0,0 mode: PR/PR res: [0x2bacc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb74 expref: 128 pid: 80280 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.759309:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13227 00000100:00100000:0.0:1651529344.759311:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+128:41278:x1731746396424640:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.759314:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000accdc5e9/0x3234de053c4a603 lrc: 0/0,0 mode: --/PR res: [0x2bacc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbb74 expref: 128 pid: 80280 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.759317:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.759318:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.759319:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c52d3a lrc: 3/0,1 mode: PW/PW res: [0x2bacc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.759322:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c52d3a lrc: 4/0,1 mode: PW/PW res: [0x2bacc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.759328:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.759332:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.759335:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000075b1ab9d/0x3234de053c4e5e3 lrc: 4/0,0 mode: PR/PR res: [0x2bacd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4903 expref: 127 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.759339:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000075b1ab9d/0x3234de053c4e5e3 lrc: 3/0,0 mode: PR/PR res: [0x2bacd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4903 expref: 127 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.759345:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031e6b9e0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+127:41279:x1731746396424704:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 43us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.759348:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13226 00010000:00010000:0.0:1651529344.759349:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075b1ab9d/0x3234de053c4e5e3 lrc: 0/0,0 mode: --/PR res: [0x2bacd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4903 expref: 127 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.759353:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.759354:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.759355:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c52d2c lrc: 3/0,1 mode: PW/PW res: [0x2bacd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.759358:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13228 00010000:00010000:0.0:1651529344.759358:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c52d2c lrc: 4/0,1 mode: PW/PW res: [0x2bacd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.759360:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+125:41279:x1731746396424832:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.759362:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.759364:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000a1d22a9/0x3234de053c4d217 lrc: 4/0,0 mode: PR/PR res: [0x2bace:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf9fd expref: 125 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.759366:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.759374:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000a1d22a9/0x3234de053c4d217 lrc: 3/0,0 mode: PR/PR res: [0x2bace:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf9fd expref: 125 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.759374:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+125:41278:x1731746396424640:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 62us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.759377:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13227 00010000:00010000:1.0:1651529344.759380:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a1d22a9/0x3234de053c4d217 lrc: 0/0,0 mode: --/PR res: [0x2bace:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf9fd expref: 124 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.759383:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.759383:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13229 00010000:00010000:1.0:1651529344.759384:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.759384:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+123:41278:x1731746396424768:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.759385:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52d41 lrc: 3/0,1 mode: PW/PW res: [0x2bace:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.759387:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.759388:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52d41 lrc: 4/0,1 mode: PW/PW res: [0x2bace:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.759388:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b17ab984/0x3234de053c4de96 lrc: 4/0,0 mode: PR/PR res: [0x2bacf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b19 expref: 123 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.759392:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b17ab984/0x3234de053c4de96 lrc: 3/0,0 mode: PR/PR res: [0x2bacf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b19 expref: 123 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.759396:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.759402:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+123:41279:x1731746396424832:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (203us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.759403:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b17ab984/0x3234de053c4de96 lrc: 0/0,0 mode: --/PR res: [0x2bacf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2b19 expref: 123 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.759405:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13228 00010000:00010000:0.0:1651529344.759407:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.759408:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.759409:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52d33 lrc: 3/0,1 mode: PW/PW res: [0x2bacf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.759410:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13230 00010000:00010000:0.0:1651529344.759411:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52d33 lrc: 4/0,1 mode: PW/PW res: [0x2bacf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.759412:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+121:41278:x1731746396424896:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.759414:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.759416:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005c2cfadf/0x3234de053c4d6fc lrc: 4/0,0 mode: PR/PR res: [0x2bad0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d9f expref: 121 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.759417:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.759419:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005c2cfadf/0x3234de053c4d6fc lrc: 3/0,0 mode: PR/PR res: [0x2bad0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d9f expref: 121 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.759423:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+121:41278:x1731746396424768:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 38us (204us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.759424:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c2cfadf/0x3234de053c4d6fc lrc: 0/0,0 mode: --/PR res: [0x2bad0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0d9f expref: 121 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.759426:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13229 00010000:00010000:1.0:1651529344.759427:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.759428:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.759429:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c52d48 lrc: 3/0,1 mode: PW/PW res: [0x2bad0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.759430:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13231 00010000:00010000:1.0:1651529344.759431:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c52d48 lrc: 4/0,1 mode: PW/PW res: [0x2bad0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.759432:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+119:41279:x1731746396424960:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.759434:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.759436:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000033e32e61/0x3234de053c4ef21 lrc: 5/0,0 mode: PR/PR res: [0x2bad1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6eaa expref: 119 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.759437:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.759442:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+119:41278:x1731746396424896:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 30us (189us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.759442:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000033e32e61/0x3234de053c4ef21 lrc: 4/0,0 mode: PR/PR res: [0x2bad1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6eaa expref: 119 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.759445:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13230 00010000:00010000:0.0:1651529344.759447:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.759447:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.759448:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13232 00010000:00010000:0.0:1651529344.759448:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c52d4f lrc: 3/0,1 mode: PW/PW res: [0x2bad1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.759450:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+118:41279:x1731746396425024:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.759451:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c52d4f lrc: 4/0,1 mode: PW/PW res: [0x2bad1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.759452:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.759453:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fb101edb/0x3234de053c4d749 lrc: 5/0,0 mode: PR/PR res: [0x2bad2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0eb7 expref: 118 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.759455:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.759457:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fb101edb/0x3234de053c4d749 lrc: 4/0,0 mode: PR/PR res: [0x2bad2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0eb7 expref: 118 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.759459:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+118:41279:x1731746396424960:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 27us (188us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.759462:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.759462:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13231 00010000:00010000:1.0:1651529344.759463:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.759463:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c52d56 lrc: 3/0,1 mode: PW/PW res: [0x2bad2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.759466:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c52d56 lrc: 4/0,1 mode: PW/PW res: [0x2bad2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.759467:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52d41 lrc: 3/0,1 mode: PW/PW res: [0x2bace:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.759470:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52d41 lrc: 3/0,1 mode: PW/PW res: [0x2bace:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.759471:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.759473:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52d41 lrc: 3/0,1 mode: PW/PW res: [0x2bace:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.759475:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+117:41279:x1731746396425024:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 24us (198us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.759476:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52d41 lrc: 2/0,0 mode: PW/PW res: [0x2bace:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.759477:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13232 00010000:00010000:1.0:1651529344.759490:0:80279:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033e32e61/0x3234de053c4ef21 lrc: 0/0,0 mode: --/PR res: [0x2bad1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6eaa expref: 116 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.759494:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000050bbb886 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997063488:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.759497:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c52d4f lrc: 3/0,1 mode: PW/PW res: [0x2bad1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.759500:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c52d4f lrc: 3/0,1 mode: PW/PW res: [0x2bad1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.759503:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c52d4f lrc: 3/0,1 mode: PW/PW res: [0x2bad1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.759506:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c52d4f lrc: 3/0,1 mode: PW/PW res: [0x2bad1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.759509:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c52d4f lrc: 2/0,0 mode: PW/PW res: [0x2bad1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.759527:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1946:39029:x1731745946543616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1012us (1138us total) trans 12885080499 rc 0/0 00000100:00100000:0.0:1651529344.759530:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212447 00010000:00010000:0.0:1651529344.759537:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52d41 lrc: 2/0,0 mode: PW/PW res: [0x2bace:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.759541:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000877aab61 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.759542:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52d41 lrc: 2/0,0 mode: PW/PW res: [0x2bace:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.759545:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52d41 lrc: 3/0,0 mode: PW/PW res: [0x2bace:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.759549:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52d41 lrc: 1/0,0 mode: --/PW res: [0x2bace:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.759552:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1946:39030:x1731745946543808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 962us (1143us total) trans 12885080500 rc 0/0 00010000:00010000:0.0:1651529344.759552:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52d41 lrc: 0/0,0 mode: --/PW res: [0x2bace:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.759555:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212449 00010000:00010000:0.0:1651529344.759556:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c52d4f lrc: 2/0,0 mode: PW/PW res: [0x2bad1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.759559:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000916cff2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.759560:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c52d4f lrc: 2/0,0 mode: PW/PW res: [0x2bad1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.759563:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c52d48 lrc: 3/0,1 mode: PW/PW res: [0x2bad0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.759565:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c52d4f lrc: 3/0,0 mode: PW/PW res: [0x2bad1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.759566:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c52d48 lrc: 3/0,1 mode: PW/PW res: [0x2bad0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.759568:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c52d4f lrc: 1/0,0 mode: --/PW res: [0x2bad1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.759569:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c52d48 lrc: 3/0,1 mode: PW/PW res: [0x2bad0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.759571:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c52d4f lrc: 0/0,0 mode: --/PW res: [0x2bad1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.759572:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c52d48 lrc: 2/0,0 mode: PW/PW res: [0x2bad0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.759576:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52d33 lrc: 3/0,1 mode: PW/PW res: [0x2bacf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.759579:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52d33 lrc: 3/0,1 mode: PW/PW res: [0x2bacf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.759582:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52d33 lrc: 3/0,1 mode: PW/PW res: [0x2bacf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.759584:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52d33 lrc: 2/0,0 mode: PW/PW res: [0x2bacf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.759603:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1947:39029:x1731745946543744:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1054us (1208us total) trans 12885080501 rc 0/0 00000100:00100000:1.0:1651529344.759606:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212448 00010000:00010000:1.0:1651529344.759612:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c52d48 lrc: 2/0,0 mode: PW/PW res: [0x2bad0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.759618:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005e711cee already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.759619:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c52d48 lrc: 2/0,0 mode: PW/PW res: [0x2bad0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.759620:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1946:39029:x1731745946543680:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1164us (1246us total) trans 12885080502 rc 0/0 00010000:00010000:1.0:1651529344.759622:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c52d48 lrc: 3/0,0 mode: PW/PW res: [0x2bad0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.759623:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212445 00010000:00010000:1.0:1651529344.759627:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c52d48 lrc: 1/0,0 mode: --/PW res: [0x2bad0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.759629:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c52d48 lrc: 0/0,0 mode: --/PW res: [0x2bad0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.759630:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52d33 lrc: 2/0,0 mode: PW/PW res: [0x2bacf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.759635:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008ac1e27e already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.759636:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c52d3a lrc: 3/0,1 mode: PW/PW res: [0x2bacc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.759636:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52d33 lrc: 2/0,0 mode: PW/PW res: [0x2bacf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.759639:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c52d3a lrc: 3/0,1 mode: PW/PW res: [0x2bacc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.759639:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52d33 lrc: 3/0,0 mode: PW/PW res: [0x2bacf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.759642:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c52d3a lrc: 3/0,1 mode: PW/PW res: [0x2bacc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.759643:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52d33 lrc: 1/0,0 mode: --/PW res: [0x2bacf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.759644:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c52d3a lrc: 2/0,0 mode: PW/PW res: [0x2bacc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.759646:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52d33 lrc: 0/0,0 mode: --/PW res: [0x2bacf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.759650:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c52d3a lrc: 3/0,0 mode: PW/PW res: [0x2bacc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.759660:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000009fe5580 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.759661:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c52d3a lrc: 2/0,0 mode: PW/PW res: [0x2bacc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.759664:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c52d3a lrc: 3/0,0 mode: PW/PW res: [0x2bacc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.759667:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c52d3a lrc: 1/0,0 mode: --/PW res: [0x2bacc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.759670:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c52d3a lrc: 0/0,0 mode: --/PW res: [0x2bacc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.759682:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1946:39029:x1731745946543488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1180us (1301us total) trans 12885080503 rc 0/0 00000100:00100000:1.0:1651529344.759686:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212446 00010000:00010000:1.0:1651529344.759700:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c52d2c lrc: 3/0,1 mode: PW/PW res: [0x2bacd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.759701:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529344.759703:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c52d2c lrc: 3/0,1 mode: PW/PW res: [0x2bacd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.759711:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c52d2c lrc: 3/0,1 mode: PW/PW res: [0x2bacd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.759714:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c52d2c lrc: 2/0,0 mode: PW/PW res: [0x2bacd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.759798:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1946:39029:x1731745946543552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1350us (1434us total) trans 12885080504 rc 0/0 00000100:00100000:1.0:1651529344.759801:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212444 00000100:00100000:1.0:1651529344.759810:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396425088 00010000:00010000:1.0:1651529344.759814:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000045a04653/0x3234de053c4f548 lrc: 5/0,0 mode: PR/PR res: [0x2bad3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8770 expref: 116 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.759822:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13233 00000100:00100000:1.0:1651529344.759823:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d17e32b2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+116:41279:x1731746396425088:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.759826:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.759827:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000045a04653/0x3234de053c4f548 lrc: 5/0,0 mode: PR/PR res: [0x2bad3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8770 expref: 116 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.759842:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000045a04653/0x3234de053c4f548 lrc: 4/0,0 mode: PR/PR res: [0x2bad3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8770 expref: 116 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.759848:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.759848:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.759849:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c52d5d lrc: 3/0,1 mode: PW/PW res: [0x2bad3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.759852:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c52d5d lrc: 4/0,1 mode: PW/PW res: [0x2bad3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.759857:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.759868:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d17e32b2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+116:41279:x1731746396425088:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 44us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.759871:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13233 00010000:00010000:1.0:1651529344.759882:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c52d2c lrc: 2/0,0 mode: PW/PW res: [0x2bacd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.759885:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000036d87bb6 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.759886:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c52d2c lrc: 2/0,0 mode: PW/PW res: [0x2bacd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.759889:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c52d2c lrc: 3/0,0 mode: PW/PW res: [0x2bacd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.759893:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c52d2c lrc: 1/0,0 mode: --/PW res: [0x2bacd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.759905:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c52d2c lrc: 0/0,0 mode: --/PW res: [0x2bacd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.759917:0:80280:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045a04653/0x3234de053c4f548 lrc: 0/0,0 mode: --/PR res: [0x2bad3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8770 expref: 115 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.759921:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004be0190 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997063616:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.759924:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c52d5d lrc: 3/0,1 mode: PW/PW res: [0x2bad3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.759927:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c52d5d lrc: 3/0,1 mode: PW/PW res: [0x2bad3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.759928:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.759930:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c52d5d lrc: 3/0,1 mode: PW/PW res: [0x2bad3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.759938:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c52d5d lrc: 3/0,1 mode: PW/PW res: [0x2bad3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.759941:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c52d5d lrc: 2/0,0 mode: PW/PW res: [0x2bad3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.759954:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.759965:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.759971:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c52d5d lrc: 2/0,0 mode: PW/PW res: [0x2bad3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.759975:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042bde05b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.759976:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c52d5d lrc: 2/0,0 mode: PW/PW res: [0x2bad3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.759979:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c52d5d lrc: 3/0,0 mode: PW/PW res: [0x2bad3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.759997:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1946:39029:x1731745946543936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 935us (958us total) trans 12885080505 rc 0/0 00000100:00100000:1.0:1651529344.760000:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212451 00010000:00010000:0.0:1651529344.760001:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c52d5d lrc: 1/0,0 mode: --/PW res: [0x2bad3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.760006:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946544000 00000100:00100000:1.0:1651529344.760012:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946544128 00000100:00100000:1.0:1651529344.760015:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946544064 00000100:00100000:1.0:1651529344.760021:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212452 00000100:00100000:1.0:1651529344.760023:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1948:39030:x1731745946544000:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.760025:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c52d5d lrc: 0/0,0 mode: --/PW res: [0x2bad3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.760035:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178900 count 1 00000100:00100000:0.0:1651529344.760035:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212453 00000100:00100000:0.0:1651529344.760037:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1948:39030:x1731745946544128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.760039:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c52d64 lrc: 3/0,1 mode: --/PW res: [0x2bad4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.760042:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178902 count 1 00010000:00010000:1.0:1651529344.760044:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c70378c8/0x3234de053c4d60e lrc: 2/0,0 mode: PR/PR res: [0x2bad4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d09bd expref: 114 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.760046:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52d6b lrc: 3/0,1 mode: --/PW res: [0x2bad6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.760047:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.760047:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.760048:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c52d64 lrc: 4/0,1 mode: --/PW res: [0x2bad4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.760053:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005ad0ef0b/0x3234de053c4c7e4 lrc: 2/0,0 mode: PR/PR res: [0x2bad6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd1d2 expref: 114 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.760054:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c70378c8/0x3234de053c4d60e lrc: 3/0,0 mode: PR/PR res: [0x2bad4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d09bd expref: 114 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.760056:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.760057:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.760057:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52d6b lrc: 4/0,1 mode: --/PW res: [0x2bad6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.760058:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c70378c8/0x3234de053c4d60e lrc: 4/0,0 mode: PR/PR res: [0x2bad4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d09bd expref: 114 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.760063:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004be0190 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997063680:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.760071:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b52d0f36 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.760077:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005ad0ef0b/0x3234de053c4c7e4 lrc: 3/0,0 mode: PR/PR res: [0x2bad6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd1d2 expref: 114 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.760078:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212454 00000100:00100000:1.0:1651529344.760079:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1948:39030:x1731745946544064:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.760081:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005ad0ef0b/0x3234de053c4c7e4 lrc: 4/0,0 mode: PR/PR res: [0x2bad6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd1d2 expref: 114 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:1.0:1651529344.760083:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178901 count 1 00000100:00100000:0.0:1651529344.760085:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003562cf4d pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997063744:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.760087:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52d72 lrc: 3/0,1 mode: --/PW res: [0x2bad5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.760091:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009a3805a2/0x3234de053c4d3e5 lrc: 2/0,0 mode: PR/PR res: [0x2bad5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0174 expref: 114 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.760094:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.760094:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.760095:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52d72 lrc: 4/0,1 mode: --/PW res: [0x2bad5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.760095:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ff7bf023 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.760101:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009a3805a2/0x3234de053c4d3e5 lrc: 3/0,0 mode: PR/PR res: [0x2bad5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0174 expref: 114 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.760104:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009a3805a2/0x3234de053c4d3e5 lrc: 4/0,0 mode: PR/PR res: [0x2bad5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0174 expref: 114 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.760108:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000050bbb886 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997063808:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.760108:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.760114:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a4eb401d going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.760119:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946544192 00000100:00100000:1.0:1651529344.760138:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212455 00000100:00100000:1.0:1651529344.760140:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1949:39030:x1731745946544192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.760140:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529344.760152:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178903 count 1 00010000:00010000:1.0:1651529344.760155:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c52d79 lrc: 3/0,1 mode: --/PW res: [0x2bad7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.760157:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.760160:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e2e2d9e6/0x3234de053c4e9a2 lrc: 2/0,0 mode: PR/PR res: [0x2bad7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d57f8 expref: 114 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.760165:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.760166:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.760166:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c52d79 lrc: 4/0,1 mode: --/PW res: [0x2bad7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.760172:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e2e2d9e6/0x3234de053c4e9a2 lrc: 3/0,0 mode: PR/PR res: [0x2bad7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d57f8 expref: 114 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.760176:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e2e2d9e6/0x3234de053c4e9a2 lrc: 4/0,0 mode: PR/PR res: [0x2bad7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d57f8 expref: 114 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.760179:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946544256 00000100:00100000:1.0:1651529344.760186:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004089c807 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997063872:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.760186:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946544320 00000100:00100000:0.0:1651529344.760189:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212456 00000100:00100000:0.0:1651529344.760191:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1951:39029:x1731745946544256:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.760196:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178904 count 1 00000100:00100000:1.0:1651529344.760199:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 0000000053a0cffa going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.760205:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212457 00010000:00010000:0.0:1651529344.760206:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52d80 lrc: 3/0,1 mode: --/PW res: [0x2bad8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.760207:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1951:39029:x1731745946544320:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.760212:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178905 count 1 00010000:00010000:1.0:1651529344.760215:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52d87 lrc: 3/0,1 mode: --/PW res: [0x2bad9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.760220:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006a91017a/0x3234de053c4caae lrc: 2/0,0 mode: PR/PR res: [0x2bad9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc83 expref: 114 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.760237:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.760238:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.760239:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52d87 lrc: 4/0,1 mode: --/PW res: [0x2bad9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.760248:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006a91017a/0x3234de053c4caae lrc: 3/0,0 mode: PR/PR res: [0x2bad9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc83 expref: 114 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.760251:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006a91017a/0x3234de053c4caae lrc: 4/0,0 mode: PR/PR res: [0x2bad9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc83 expref: 114 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.760255:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029d739c8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997063936:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.760255:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000e462b76/0x3234de053c4ae6f lrc: 2/0,0 mode: PR/PR res: [0x2bad8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf4f expref: 114 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.760259:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.760260:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.760261:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52d80 lrc: 4/0,1 mode: --/PW res: [0x2bad8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.760262:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 0000000018ebe812 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.760268:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000e462b76/0x3234de053c4ae6f lrc: 3/0,0 mode: PR/PR res: [0x2bad8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf4f expref: 114 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.760271:0:80278:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb101edb/0x3234de053c4d749 lrc: 0/0,0 mode: --/PR res: [0x2bad2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0eb7 expref: 114 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.760272:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000e462b76/0x3234de053c4ae6f lrc: 4/0,0 mode: PR/PR res: [0x2bad8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf4f expref: 114 pid: 151609 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.760275:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000007fba516 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997063552:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.760277:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ffb5d0a pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997064000:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.760278:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c52d56 lrc: 3/0,1 mode: PW/PW res: [0x2bad2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.760281:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c52d56 lrc: 3/0,1 mode: PW/PW res: [0x2bad2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.760284:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c52d56 lrc: 3/0,1 mode: PW/PW res: [0x2bad2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.760285:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000003003c8b0 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.760287:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c52d56 lrc: 3/0,1 mode: PW/PW res: [0x2bad2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.760290:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c52d56 lrc: 2/0,0 mode: PW/PW res: [0x2bad2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.760308:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.760331:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1952:39030:x1731745946543872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1415us (1448us total) trans 12885080506 rc 0/0 00000100:00100000:1.0:1651529344.760334:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212450 00000100:00100000:1.0:1651529344.760346:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946544384 00010000:00010000:0.0:1651529344.760347:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c52d56 lrc: 2/0,0 mode: PW/PW res: [0x2bad2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.760351:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c822bd1c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.760352:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c52d56 lrc: 2/0,0 mode: PW/PW res: [0x2bad2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.760356:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c52d56 lrc: 3/0,0 mode: PW/PW res: [0x2bad2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.760362:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212458 00000100:00100000:1.0:1651529344.760363:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1952:39030:x1731745946544384:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.760368:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178906 count 1 00010000:00010000:0.0:1651529344.760369:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c52d56 lrc: 1/0,0 mode: --/PW res: [0x2bad2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.760372:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c52d8e lrc: 3/0,1 mode: --/PW res: [0x2bada:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.760372:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c52d56 lrc: 0/0,0 mode: --/PW res: [0x2bad2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.760376:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef37b779/0x3234de053c4e7cd lrc: 2/0,0 mode: PR/PR res: [0x2bada:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4fc4 expref: 113 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.760380:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.760380:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.760381:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c52d8e lrc: 4/0,1 mode: --/PW res: [0x2bada:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.760387:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ef37b779/0x3234de053c4e7cd lrc: 3/0,0 mode: PR/PR res: [0x2bada:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4fc4 expref: 113 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.760390:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ef37b779/0x3234de053c4e7cd lrc: 4/0,0 mode: PR/PR res: [0x2bada:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4fc4 expref: 113 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.760395:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000007fba516 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997064064:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.760407:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a5495eb going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.760483:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.760490:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946544448 00000100:00100000:1.0:1651529344.760501:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212459 00000100:00100000:1.0:1651529344.760502:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1953:39029:x1731745946544448:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.760507:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178907 count 1 00010000:00010000:1.0:1651529344.760511:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c52d95 lrc: 3/0,1 mode: --/PW res: [0x2badb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.760516:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000aa989262/0x3234de053c4d440 lrc: 2/0,0 mode: PR/PR res: [0x2badb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d02d2 expref: 113 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.760519:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.760519:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.760520:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c52d95 lrc: 4/0,1 mode: --/PW res: [0x2badb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.760526:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000aa989262/0x3234de053c4d440 lrc: 3/0,0 mode: PR/PR res: [0x2badb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d02d2 expref: 113 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.760529:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000aa989262/0x3234de053c4d440 lrc: 4/0,0 mode: PR/PR res: [0x2badb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d02d2 expref: 113 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.760533:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005b3c5aba pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997064128:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.760545:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c3caa148 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.760697:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.760705:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.760708:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003562cf4d pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997063744:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.760711:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.760722:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52d6b lrc: 3/0,1 mode: --/PW res: [0x2bad6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.760775:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ffb5d0a pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997064000:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.760779:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52d80 lrc: 3/0,1 mode: --/PW res: [0x2bad8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.760781:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.760791:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.760795:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396425216 00000100:00100000:1.0:1651529344.760796:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.760801:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.760801:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009a3805a2/0x3234de053c4d3e5 lrc: 5/0,0 mode: PR/PR res: [0x2bad5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0174 expref: 114 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.760806:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396425152 00010000:00010000:0.0:1651529344.760809:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c70378c8/0x3234de053c4d60e lrc: 5/0,0 mode: PR/PR res: [0x2bad4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d09bd expref: 115 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.760813:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396425280 00000100:00100000:1.0:1651529344.760814:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029d739c8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997063936:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.760815:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005ad0ef0b/0x3234de053c4c7e4 lrc: 4/0,0 mode: PR/PR res: [0x2bad6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd1d2 expref: 116 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.760819:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52d87 lrc: 3/0,1 mode: --/PW res: [0x2bad9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.760822:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396425344 00010000:00010000:0.0:1651529344.760824:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e2e2d9e6/0x3234de053c4e9a2 lrc: 5/0,0 mode: PR/PR res: [0x2bad7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d57f8 expref: 117 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.760826:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396425472 00010000:00010000:1.0:1651529344.760831:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000e462b76/0x3234de053c4ae6f lrc: 4/0,0 mode: PR/PR res: [0x2bad8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf4f expref: 118 pid: 151609 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.760836:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396425408 00010000:00010000:1.0:1651529344.760838:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006a91017a/0x3234de053c4caae lrc: 4/0,0 mode: PR/PR res: [0x2bad9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc83 expref: 119 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.760842:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396425536 00000100:00100000:1.0:1651529344.760843:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13234 00000100:00100000:1.0:1651529344.760845:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+120:41279:x1731746396425216:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.760846:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ef37b779/0x3234de053c4e7cd lrc: 5/0,0 mode: PR/PR res: [0x2bada:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4fc4 expref: 120 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.760847:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.760849:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009a3805a2/0x3234de053c4d3e5 lrc: 5/0,0 mode: PR/PR res: [0x2bad5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0174 expref: 120 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.760851:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13235 00010000:00010000:1.0:1651529344.760852:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009a3805a2/0x3234de053c4d3e5 lrc: 4/0,0 mode: PR/PR res: [0x2bad5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0174 expref: 120 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.760853:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+120:41279:x1731746396425152:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.760856:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.760858:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c70378c8/0x3234de053c4d60e lrc: 5/0,0 mode: PR/PR res: [0x2bad4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d09bd expref: 120 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.760859:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.760860:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.760860:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52d72 lrc: 3/0,1 mode: PW/PW res: [0x2bad5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.760861:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c70378c8/0x3234de053c4d60e lrc: 4/0,0 mode: PR/PR res: [0x2bad4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d09bd expref: 120 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.760864:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52d72 lrc: 4/0,1 mode: PW/PW res: [0x2bad5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.760867:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.760868:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.760868:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.760868:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c52d64 lrc: 3/0,1 mode: PW/PW res: [0x2bad4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.760871:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c52d64 lrc: 4/0,1 mode: PW/PW res: [0x2bad4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.760876:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.760877:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+120:41279:x1731746396425216:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 31us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.760879:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13234 00000100:00100000:1.0:1651529344.760884:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13236 00000100:00100000:0.0:1651529344.760884:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+119:41279:x1731746396425152:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 30us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.760886:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+119:41279:x1731746396425280:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529344.760886:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13235 00010000:00010000:1.0:1651529344.760888:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.760890:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005ad0ef0b/0x3234de053c4c7e4 lrc: 4/0,0 mode: PR/PR res: [0x2bad6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd1d2 expref: 118 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.760891:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13237 00010000:00010000:1.0:1651529344.760893:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005ad0ef0b/0x3234de053c4c7e4 lrc: 3/0,0 mode: PR/PR res: [0x2bad6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd1d2 expref: 118 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.760893:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+118:41279:x1731746396425344:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.760895:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.760896:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e2e2d9e6/0x3234de053c4e9a2 lrc: 5/0,0 mode: PR/PR res: [0x2bad7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d57f8 expref: 118 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.760898:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ad0ef0b/0x3234de053c4c7e4 lrc: 0/0,0 mode: --/PR res: [0x2bad6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd1d2 expref: 118 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.760900:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e2e2d9e6/0x3234de053c4e9a2 lrc: 4/0,0 mode: PR/PR res: [0x2bad7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d57f8 expref: 118 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.760901:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.760902:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.760902:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52d6b lrc: 3/0,1 mode: PW/PW res: [0x2bad6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.760905:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52d6b lrc: 4/0,1 mode: PW/PW res: [0x2bad6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.760905:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.760905:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.760906:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c52d79 lrc: 3/0,1 mode: PW/PW res: [0x2bad7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.760909:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c52d79 lrc: 4/0,1 mode: PW/PW res: [0x2bad7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.760913:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.760916:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.760925:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+117:41279:x1731746396425280:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 39us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.760925:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+117:41279:x1731746396425344:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 31us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.760927:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13237 00000100:00100000:1.0:1651529344.760929:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13236 00000100:00100000:0.0:1651529344.760932:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13238 00000100:00100000:1.0:1651529344.760933:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13239 00000100:00100000:0.0:1651529344.760933:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+115:41279:x1731746396425472:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.760935:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+115:41279:x1731746396425408:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.760936:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.760937:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000e462b76/0x3234de053c4ae6f lrc: 4/0,0 mode: PR/PR res: [0x2bad8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf4f expref: 115 pid: 151609 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.760938:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.760939:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006a91017a/0x3234de053c4caae lrc: 4/0,0 mode: PR/PR res: [0x2bad9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc83 expref: 115 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.760941:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000e462b76/0x3234de053c4ae6f lrc: 3/0,0 mode: PR/PR res: [0x2bad8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf4f expref: 115 pid: 151609 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.760943:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006a91017a/0x3234de053c4caae lrc: 3/0,0 mode: PR/PR res: [0x2bad9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc83 expref: 115 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.760946:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e462b76/0x3234de053c4ae6f lrc: 0/0,0 mode: --/PR res: [0x2bad8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf4f expref: 115 pid: 151609 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.760949:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.760950:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a91017a/0x3234de053c4caae lrc: 0/0,0 mode: --/PR res: [0x2bad9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cdc83 expref: 114 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.760950:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.760951:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52d80 lrc: 3/0,1 mode: PW/PW res: [0x2bad8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.760953:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52d80 lrc: 4/0,1 mode: PW/PW res: [0x2bad8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.760954:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.760954:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.760955:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52d87 lrc: 3/0,1 mode: PW/PW res: [0x2bad9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.760958:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52d87 lrc: 4/0,1 mode: PW/PW res: [0x2bad9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.760960:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.760963:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.760964:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+113:41279:x1731746396425472:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 30us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.760967:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13238 00000100:00100000:1.0:1651529344.760968:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+113:41279:x1731746396425408:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 32us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.760971:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13239 00000100:00100000:0.0:1651529344.760973:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13240 00000100:00100000:0.0:1651529344.760974:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071577dd8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+111:41279:x1731746396425536:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.760976:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.760977:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52d87 lrc: 3/0,1 mode: PW/PW res: [0x2bad9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.760977:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ef37b779/0x3234de053c4e7cd lrc: 5/0,0 mode: PR/PR res: [0x2bada:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4fc4 expref: 111 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.760980:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52d87 lrc: 3/0,1 mode: PW/PW res: [0x2bad9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.760981:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ef37b779/0x3234de053c4e7cd lrc: 4/0,0 mode: PR/PR res: [0x2bada:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4fc4 expref: 111 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.760983:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52d87 lrc: 3/0,1 mode: PW/PW res: [0x2bad9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.760986:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52d87 lrc: 2/0,0 mode: PW/PW res: [0x2bad9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.760986:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.760986:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.760987:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c52d8e lrc: 3/0,1 mode: PW/PW res: [0x2bada:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.760990:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c52d8e lrc: 4/0,1 mode: PW/PW res: [0x2bada:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.760994:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.760998:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071577dd8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+111:41279:x1731746396425536:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 23us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.761000:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13240 00010000:00010000:0.0:1651529344.761009:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52d80 lrc: 3/0,1 mode: PW/PW res: [0x2bad8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.761013:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52d80 lrc: 3/0,1 mode: PW/PW res: [0x2bad8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.761016:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52d80 lrc: 3/0,1 mode: PW/PW res: [0x2bad8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.761018:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52d80 lrc: 2/0,0 mode: PW/PW res: [0x2bad8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.761024:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1954:39029:x1731745946544320:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 817us (867us total) trans 12885080507 rc 0/0 00000100:00100000:1.0:1651529344.761027:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212457 00010000:00010000:1.0:1651529344.761034:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52d87 lrc: 2/0,0 mode: PW/PW res: [0x2bad9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.761037:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000082ae179c already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.761038:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52d87 lrc: 2/0,0 mode: PW/PW res: [0x2bad9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.761041:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52d87 lrc: 3/0,0 mode: PW/PW res: [0x2bad9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.761045:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52d87 lrc: 1/0,0 mode: --/PW res: [0x2bad9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.761048:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52d87 lrc: 0/0,0 mode: --/PW res: [0x2bad9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.761053:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52d80 lrc: 2/0,0 mode: PW/PW res: [0x2bad8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.761056:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cde66bc6 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.761057:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52d80 lrc: 2/0,0 mode: PW/PW res: [0x2bad8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.761059:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1954:39029:x1731745946544256:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 867us (919us total) trans 12885080508 rc 0/0 00010000:00010000:1.0:1651529344.761060:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52d80 lrc: 3/0,0 mode: PW/PW res: [0x2bad8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.761062:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212456 00010000:00010000:1.0:1651529344.761063:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52d80 lrc: 1/0,0 mode: --/PW res: [0x2bad8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.761066:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52d80 lrc: 0/0,0 mode: --/PW res: [0x2bad8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.761070:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52d6b lrc: 3/0,1 mode: PW/PW res: [0x2bad6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.761073:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52d6b lrc: 3/0,1 mode: PW/PW res: [0x2bad6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.761075:0:72396:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a3805a2/0x3234de053c4d3e5 lrc: 0/0,0 mode: --/PR res: [0x2bad5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d0174 expref: 110 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.761076:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52d6b lrc: 3/0,1 mode: PW/PW res: [0x2bad6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.761078:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000050bbb886 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997063808:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.761079:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52d6b lrc: 2/0,0 mode: PW/PW res: [0x2bad6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.761081:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52d72 lrc: 3/0,1 mode: PW/PW res: [0x2bad5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.761086:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52d72 lrc: 3/0,1 mode: PW/PW res: [0x2bad5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.761089:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52d72 lrc: 3/0,1 mode: PW/PW res: [0x2bad5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.761092:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52d72 lrc: 3/0,1 mode: PW/PW res: [0x2bad5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.761095:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52d72 lrc: 2/0,0 mode: PW/PW res: [0x2bad5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.761120:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1955:39030:x1731745946544128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1082us (1165us total) trans 12885080509 rc 0/0 00000100:00100000:0.0:1651529344.761123:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212453 00010000:00010000:0.0:1651529344.761129:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52d6b lrc: 2/0,0 mode: PW/PW res: [0x2bad6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.761133:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000575eb734 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.761134:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52d6b lrc: 2/0,0 mode: PW/PW res: [0x2bad6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.761135:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1954:39030:x1731745946544064:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1055us (1170us total) trans 12885080510 rc 0/0 00010000:00010000:0.0:1651529344.761137:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52d6b lrc: 3/0,0 mode: PW/PW res: [0x2bad6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.761138:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212454 00010000:00010000:0.0:1651529344.761141:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52d6b lrc: 1/0,0 mode: --/PW res: [0x2bad6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.761146:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52d6b lrc: 0/0,0 mode: --/PW res: [0x2bad6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.761148:0:80279:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2e2d9e6/0x3234de053c4e9a2 lrc: 0/0,0 mode: --/PR res: [0x2bad7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d57f8 expref: 109 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.761152:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004089c807 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997063872:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.761152:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52d72 lrc: 2/0,0 mode: PW/PW res: [0x2bad5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.761154:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002f450f42 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.761155:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c52d79 lrc: 3/0,1 mode: PW/PW res: [0x2bad7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.761155:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52d72 lrc: 2/0,0 mode: PW/PW res: [0x2bad5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.761158:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c52d79 lrc: 3/0,1 mode: PW/PW res: [0x2bad7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.761158:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52d72 lrc: 3/0,0 mode: PW/PW res: [0x2bad5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.761161:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52d72 lrc: 1/0,0 mode: --/PW res: [0x2bad5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.761163:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c52d79 lrc: 3/0,1 mode: PW/PW res: [0x2bad7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.761164:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52d72 lrc: 0/0,0 mode: --/PW res: [0x2bad5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.761166:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c52d79 lrc: 3/0,1 mode: PW/PW res: [0x2bad7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.761169:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c52d79 lrc: 2/0,0 mode: PW/PW res: [0x2bad7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.761179:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.761201:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1954:39030:x1731745946544192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1060us (1093us total) trans 12885080511 rc 0/0 00000100:00100000:1.0:1651529344.761203:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212455 00010000:00010000:1.0:1651529344.761210:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c52d79 lrc: 2/0,0 mode: PW/PW res: [0x2bad7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.761213:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d9cfe902 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.761213:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c52d79 lrc: 2/0,0 mode: PW/PW res: [0x2bad7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.761240:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c52d79 lrc: 3/0,0 mode: PW/PW res: [0x2bad7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.761245:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c52d79 lrc: 1/0,0 mode: --/PW res: [0x2bad7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.761263:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c52d79 lrc: 0/0,0 mode: --/PW res: [0x2bad7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.761270:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396425600 00000100:00100000:1.0:1651529344.761282:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005b3c5aba pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997064128:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.761286:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c52d95 lrc: 3/0,1 mode: --/PW res: [0x2badb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.761291:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000aa989262/0x3234de053c4d440 lrc: 4/0,0 mode: PR/PR res: [0x2badb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d02d2 expref: 109 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.761292:0:80280:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c70378c8/0x3234de053c4d60e lrc: 0/0,0 mode: --/PR res: [0x2bad4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d09bd expref: 109 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.761296:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004be0190 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997063680:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.761298:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c52d64 lrc: 3/0,1 mode: PW/PW res: [0x2bad4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.761304:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13241 00010000:00010000:1.0:1651529344.761307:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c52d64 lrc: 3/0,1 mode: PW/PW res: [0x2bad4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.761309:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c52d64 lrc: 3/0,1 mode: PW/PW res: [0x2bad4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.761313:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c52d64 lrc: 3/0,1 mode: PW/PW res: [0x2bad4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.761315:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c52d64 lrc: 2/0,0 mode: PW/PW res: [0x2bad4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.761315:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+108:41278:x1731746396425600:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.761320:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.761327:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000aa989262/0x3234de053c4d440 lrc: 4/0,0 mode: PR/PR res: [0x2badb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d02d2 expref: 108 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.761331:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000aa989262/0x3234de053c4d440 lrc: 3/0,0 mode: PR/PR res: [0x2badb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d02d2 expref: 108 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.761337:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa989262/0x3234de053c4d440 lrc: 0/0,0 mode: --/PR res: [0x2badb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d02d2 expref: 108 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.761341:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.761341:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.761342:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c52d95 lrc: 3/0,1 mode: PW/PW res: [0x2badb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.761345:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c52d95 lrc: 4/0,1 mode: PW/PW res: [0x2badb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.761355:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.761365:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+1954:39030:x1731745946544000:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1341us (1446us total) trans 12885080512 rc 0/0 00000100:00100000:1.0:1651529344.761370:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212452 00010000:00010000:1.0:1651529344.761377:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c52d95 lrc: 3/0,1 mode: PW/PW res: [0x2badb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.761380:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c52d95 lrc: 3/0,1 mode: PW/PW res: [0x2badb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.761381:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+107:41278:x1731746396425600:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 66us (202us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.761383:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c52d95 lrc: 3/0,1 mode: PW/PW res: [0x2badb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.761384:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13241 00010000:00010000:1.0:1651529344.761386:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c52d95 lrc: 2/0,0 mode: PW/PW res: [0x2badb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.761408:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c52d64 lrc: 2/0,0 mode: PW/PW res: [0x2bad4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.761412:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000096ab8041 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.761413:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c52d64 lrc: 2/0,0 mode: PW/PW res: [0x2bad4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.761416:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c52d64 lrc: 3/0,0 mode: PW/PW res: [0x2bad4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.761421:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1954:39029:x1731745946544448:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 918us (938us total) trans 12885080513 rc 0/0 00010000:00010000:0.0:1651529344.761421:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c52d64 lrc: 1/0,0 mode: --/PW res: [0x2bad4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.761424:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212459 00010000:00010000:0.0:1651529344.761424:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c52d64 lrc: 0/0,0 mode: --/PW res: [0x2bad4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.761429:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c52d95 lrc: 2/0,0 mode: PW/PW res: [0x2badb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.761432:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba437fe0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.761432:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c52d95 lrc: 2/0,0 mode: PW/PW res: [0x2badb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.761435:0:80278:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef37b779/0x3234de053c4e7cd lrc: 0/0,0 mode: --/PR res: [0x2bada:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4fc4 expref: 106 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.761435:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c52d95 lrc: 3/0,0 mode: PW/PW res: [0x2badb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.761438:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c52d95 lrc: 1/0,0 mode: --/PW res: [0x2badb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.761439:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000007fba516 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997064064:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.761441:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c52d95 lrc: 0/0,0 mode: --/PW res: [0x2badb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.761443:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c52d8e lrc: 3/0,1 mode: PW/PW res: [0x2bada:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.761446:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c52d8e lrc: 3/0,1 mode: PW/PW res: [0x2bada:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.761451:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c52d8e lrc: 3/0,1 mode: PW/PW res: [0x2bada:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.761454:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c52d8e lrc: 3/0,1 mode: PW/PW res: [0x2bada:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.761457:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c52d8e lrc: 2/0,0 mode: PW/PW res: [0x2bada:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.761484:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.761500:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.761516:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1954:39030:x1731745946544384:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1151us (1207us total) trans 12885080514 rc 0/0 00000100:00100000:1.0:1651529344.761518:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212458 00000100:00100000:0.0:1651529344.761522:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.761535:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.761536:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946544512 00000100:00100000:1.0:1651529344.761549:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946544576 00000100:00100000:1.0:1651529344.761561:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946544704 00000100:00100000:1.0:1651529344.761565:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946544640 00000100:00100000:0.0:1651529344.761567:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.761577:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946544768 00000100:00100000:1.0:1651529344.761584:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212460 00000100:00100000:1.0:1651529344.761585:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1958:39030:x1731745946544512:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.761589:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212461 00002000:00080000:1.0:1651529344.761590:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178908 count 1 00000100:00100000:0.0:1651529344.761591:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1958:39030:x1731745946544576:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.761594:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c52d9c lrc: 3/0,1 mode: --/PW res: [0x2badc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.761599:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000092b1d4a6/0x3234de053c4f29a lrc: 2/0,0 mode: PR/PR res: [0x2badc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d59 expref: 105 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.761602:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.761603:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.761603:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c52d9c lrc: 4/0,1 mode: --/PW res: [0x2badc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.761609:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178909 count 1 00010000:00010000:1.0:1651529344.761610:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000092b1d4a6/0x3234de053c4f29a lrc: 3/0,0 mode: PR/PR res: [0x2badc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d59 expref: 105 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.761614:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000092b1d4a6/0x3234de053c4f29a lrc: 4/0,0 mode: PR/PR res: [0x2badc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d59 expref: 105 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.761614:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52da3 lrc: 3/0,1 mode: --/PW res: [0x2badd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.761618:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a130088 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997064192:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.761619:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee681ad3/0x3234de053c4e4af lrc: 2/0,0 mode: PR/PR res: [0x2badd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4410 expref: 105 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.761623:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.761623:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.761624:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52da3 lrc: 4/0,1 mode: --/PW res: [0x2badd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.761631:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c3caa148 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.761638:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212462 00010000:00010000:0.0:1651529344.761638:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ee681ad3/0x3234de053c4e4af lrc: 3/0,0 mode: PR/PR res: [0x2badd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4410 expref: 105 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.761640:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1958:39029:x1731745946544704:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.761642:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ee681ad3/0x3234de053c4e4af lrc: 4/0,0 mode: PR/PR res: [0x2badd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4410 expref: 105 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:1.0:1651529344.761644:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178911 count 1 00000100:00100000:0.0:1651529344.761646:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003562cf4d pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997064256:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.761648:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52daa lrc: 3/0,1 mode: --/PW res: [0x2badf:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.761652:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000013b5560/0x3234de053c4ccde lrc: 2/0,0 mode: PR/PR res: [0x2badf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce55f expref: 105 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.761655:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.761655:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000abca413e going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.761656:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.761656:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52daa lrc: 4/0,1 mode: --/PW res: [0x2badf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.761662:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000013b5560/0x3234de053c4ccde lrc: 3/0,0 mode: PR/PR res: [0x2badf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce55f expref: 105 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.761662:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212463 00000100:00100000:0.0:1651529344.761663:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e8ce7f0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1958:39029:x1731745946544640:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.761668:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000013b5560/0x3234de053c4ccde lrc: 4/0,0 mode: PR/PR res: [0x2badf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce55f expref: 105 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:0.0:1651529344.761669:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178910 count 1 00000100:00100000:1.0:1651529344.761672:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d718cfe4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997064320:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.761673:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52db1 lrc: 3/0,1 mode: --/PW res: [0x2bade:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.761679:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f9dac3f6 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.761683:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c52d8e lrc: 2/0,0 mode: PW/PW res: [0x2bada:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.761686:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000055fddd81 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.761687:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c52d8e lrc: 2/0,0 mode: PW/PW res: [0x2bada:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.761690:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c52d8e lrc: 3/0,0 mode: PW/PW res: [0x2bada:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.761691:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d395ab24/0x3234de053c4f1eb lrc: 2/0,0 mode: PR/PR res: [0x2bade:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a8f expref: 105 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.761695:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c52d8e lrc: 1/0,0 mode: --/PW res: [0x2bada:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.761695:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.761695:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.761696:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52db1 lrc: 4/0,1 mode: --/PW res: [0x2bade:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.761697:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c52d8e lrc: 0/0,0 mode: --/PW res: [0x2bada:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.761705:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212464 00000100:00100000:1.0:1651529344.761706:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1958:39029:x1731745946544768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.761711:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178912 count 1 00010000:00010000:1.0:1651529344.761714:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c52db8 lrc: 3/0,1 mode: --/PW res: [0x2bae0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.761722:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d395ab24/0x3234de053c4f1eb lrc: 3/0,0 mode: PR/PR res: [0x2bade:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a8f expref: 105 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.761726:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d395ab24/0x3234de053c4f1eb lrc: 4/0,0 mode: PR/PR res: [0x2bade:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a8f expref: 105 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.761727:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c974c514/0x3234de053c4f499 lrc: 2/0,0 mode: PR/PR res: [0x2bae0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84fa expref: 105 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.761730:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b0d9532a pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997064384:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.761731:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.761731:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.761732:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c52db8 lrc: 4/0,1 mode: --/PW res: [0x2bae0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.761747:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c974c514/0x3234de053c4f499 lrc: 3/0,0 mode: PR/PR res: [0x2bae0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84fa expref: 105 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.761747:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 0000000070e666f7 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.761751:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c974c514/0x3234de053c4f499 lrc: 4/0,0 mode: PR/PR res: [0x2bae0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84fa expref: 105 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.761755:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005912c4a3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997064448:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.761763:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 0000000053a0cffa going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.761780:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.761791:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.761804:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.761822:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946544832 00000100:00100000:0.0:1651529344.761834:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946544896 00000100:00100000:0.0:1651529344.761839:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946544960 00000100:00100000:0.0:1651529344.761845:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212465 00000100:00100000:0.0:1651529344.761847:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1961:39029:x1731745946544832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.761856:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212466 00000100:00100000:1.0:1651529344.761858:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1961:39029:x1731745946544896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.761864:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178914 count 1 00002000:00080000:0.0:1651529344.761866:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178913 count 1 00010000:00010000:1.0:1651529344.761868:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c52dbf lrc: 3/0,1 mode: --/PW res: [0x2bae2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.761870:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52dc6 lrc: 3/0,1 mode: --/PW res: [0x2bae1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.761872:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c4cd7f lrc: 2/0,0 mode: PR/PR res: [0x2bae2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce7f8 expref: 105 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.761875:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.761876:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.761876:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000c0a0acb/0x3234de053c4add5 lrc: 2/0,0 mode: PR/PR res: [0x2bae1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf10 expref: 105 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.761877:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c52dbf lrc: 4/0,1 mode: --/PW res: [0x2bae2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.761879:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.761879:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.761880:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52dc6 lrc: 4/0,1 mode: --/PW res: [0x2bae1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.761883:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c4cd7f lrc: 3/0,0 mode: PR/PR res: [0x2bae2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce7f8 expref: 105 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.761887:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c4cd7f lrc: 4/0,0 mode: PR/PR res: [0x2bae2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce7f8 expref: 105 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.761887:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000c0a0acb/0x3234de053c4add5 lrc: 3/0,0 mode: PR/PR res: [0x2bae1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf10 expref: 105 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.761890:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000c0a0acb/0x3234de053c4add5 lrc: 4/0,0 mode: PR/PR res: [0x2bae1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf10 expref: 105 pid: 151609 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.761891:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005b3c5aba pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997064512:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.761894:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000edfe60d3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997064576:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.761901:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 0000000020dd7827 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.761903:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060852af0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.761906:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212467 00000100:00100000:1.0:1651529344.761908:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1961:39030:x1731745946544960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.761912:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178915 count 1 00010000:00010000:1.0:1651529344.761915:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c52dcd lrc: 3/0,1 mode: --/PW res: [0x2bae3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.761919:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005ef44f23/0x3234de053c4b839 lrc: 2/0,0 mode: PR/PR res: [0x2bae3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc3c4 expref: 105 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.761922:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.761923:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.761923:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c52dcd lrc: 4/0,1 mode: --/PW res: [0x2bae3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.761932:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005ef44f23/0x3234de053c4b839 lrc: 3/0,0 mode: PR/PR res: [0x2bae3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc3c4 expref: 105 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.761935:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005ef44f23/0x3234de053c4b839 lrc: 4/0,0 mode: PR/PR res: [0x2bae3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc3c4 expref: 105 pid: 72395 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.761939:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004089c807 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997064640:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.761945:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a4eb401d going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.762036:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a130088 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997064192:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.762040:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c52d9c lrc: 3/0,1 mode: --/PW res: [0x2badc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.762057:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d718cfe4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997064320:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.762060:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52daa lrc: 3/0,1 mode: --/PW res: [0x2badf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.762090:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005912c4a3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997064448:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.762098:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c52db8 lrc: 3/0,1 mode: --/PW res: [0x2bae0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.762105:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003562cf4d pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997064256:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.762106:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005b3c5aba pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997064512:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.762108:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c52dbf lrc: 3/0,1 mode: --/PW res: [0x2bae2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.762110:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52da3 lrc: 3/0,1 mode: --/PW res: [0x2badd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.762117:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b0d9532a pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997064384:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.762119:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52db1 lrc: 3/0,1 mode: --/PW res: [0x2bade:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.762125:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000edfe60d3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997064576:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.762127:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52dc6 lrc: 3/0,1 mode: --/PW res: [0x2bae1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.762315:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.762323:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.762330:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.762336:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.762346:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.762346:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396425728 00000100:00100000:1.0:1651529344.762351:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.762352:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ee681ad3/0x3234de053c4e4af lrc: 4/0,0 mode: PR/PR res: [0x2badd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4410 expref: 106 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.762356:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.762358:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396425856 00010000:00010000:0.0:1651529344.762361:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d395ab24/0x3234de053c4f1eb lrc: 4/0,0 mode: PR/PR res: [0x2bade:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a8f expref: 107 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.762363:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.762365:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396425984 00010000:00010000:0.0:1651529344.762367:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c4cd7f lrc: 4/0,0 mode: PR/PR res: [0x2bae2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce7f8 expref: 108 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.762369:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396425664 00000100:00100000:0.0:1651529344.762371:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396426112 00010000:00010000:0.0:1651529344.762373:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005ef44f23/0x3234de053c4b839 lrc: 5/0,0 mode: PR/PR res: [0x2bae3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc3c4 expref: 110 pid: 72395 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.762375:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000092b1d4a6/0x3234de053c4f29a lrc: 4/0,0 mode: PR/PR res: [0x2badc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d59 expref: 110 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.762377:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396425792 00010000:00010000:0.0:1651529344.762380:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000013b5560/0x3234de053c4ccde lrc: 4/0,0 mode: PR/PR res: [0x2badf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce55f expref: 111 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.762381:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396425920 00010000:00010000:1.0:1651529344.762383:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c974c514/0x3234de053c4f499 lrc: 4/0,0 mode: PR/PR res: [0x2bae0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84fa expref: 112 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.762384:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396426048 00010000:00010000:0.0:1651529344.762386:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000c0a0acb/0x3234de053c4add5 lrc: 4/0,0 mode: PR/PR res: [0x2bae1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf10 expref: 113 pid: 151609 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.762389:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13242 00000100:00100000:1.0:1651529344.762390:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+113:41279:x1731746396425728:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.762392:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13243 00010000:00010000:1.0:1651529344.762393:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.762394:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+113:41279:x1731746396425856:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.762395:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ee681ad3/0x3234de053c4e4af lrc: 4/0,0 mode: PR/PR res: [0x2badd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4410 expref: 113 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.762396:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.762398:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d395ab24/0x3234de053c4f1eb lrc: 4/0,0 mode: PR/PR res: [0x2bade:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a8f expref: 113 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.762399:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ee681ad3/0x3234de053c4e4af lrc: 3/0,0 mode: PR/PR res: [0x2badd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4410 expref: 113 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.762401:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d395ab24/0x3234de053c4f1eb lrc: 3/0,0 mode: PR/PR res: [0x2bade:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a8f expref: 113 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.762404:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee681ad3/0x3234de053c4e4af lrc: 0/0,0 mode: --/PR res: [0x2badd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4410 expref: 113 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.762407:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d395ab24/0x3234de053c4f1eb lrc: 0/0,0 mode: --/PR res: [0x2bade:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7a8f expref: 113 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.762408:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.762409:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.762410:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52da3 lrc: 3/0,1 mode: PW/PW res: [0x2badd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.762410:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.762411:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.762412:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52db1 lrc: 3/0,1 mode: PW/PW res: [0x2bade:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.762413:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52da3 lrc: 4/0,1 mode: PW/PW res: [0x2badd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.762415:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52db1 lrc: 4/0,1 mode: PW/PW res: [0x2bade:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.762423:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.762429:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.762433:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+111:41279:x1731746396425728:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.762436:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13242 00000100:00100000:1.0:1651529344.762441:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13244 00000100:00100000:0.0:1651529344.762441:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+110:41279:x1731746396425856:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 46us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.762443:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+110:41279:x1731746396425984:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.762443:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13243 00010000:00010000:1.0:1651529344.762445:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.762447:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c4cd7f lrc: 4/0,0 mode: PR/PR res: [0x2bae2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce7f8 expref: 109 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.762449:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13245 00010000:00010000:1.0:1651529344.762450:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c4cd7f lrc: 3/0,0 mode: PR/PR res: [0x2bae2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce7f8 expref: 109 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.762450:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+109:41279:x1731746396426112:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.762453:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.762454:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005ef44f23/0x3234de053c4b839 lrc: 5/0,0 mode: PR/PR res: [0x2bae3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc3c4 expref: 109 pid: 72395 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.762455:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c4cd7f lrc: 0/0,0 mode: --/PR res: [0x2bae2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce7f8 expref: 109 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.762458:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.762458:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005ef44f23/0x3234de053c4b839 lrc: 4/0,0 mode: PR/PR res: [0x2bae3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc3c4 expref: 108 pid: 72395 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.762459:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.762460:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c52dbf lrc: 3/0,1 mode: PW/PW res: [0x2bae2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.762463:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c52dbf lrc: 4/0,1 mode: PW/PW res: [0x2bae2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.762464:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.762464:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.762465:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c52dcd lrc: 3/0,1 mode: PW/PW res: [0x2bae3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.762468:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c52dcd lrc: 4/0,1 mode: PW/PW res: [0x2bae3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.762469:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.762472:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.762474:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+108:41279:x1731746396425984:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 31us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.762477:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13244 00000100:00100000:0.0:1651529344.762477:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+108:41279:x1731746396426112:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 26us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.762479:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13245 00000100:00100000:1.0:1651529344.762481:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13246 00000100:00100000:1.0:1651529344.762483:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+106:41278:x1731746396425664:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.762483:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13247 00010000:00010000:1.0:1651529344.762485:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.762485:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea4c33b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+106:41278:x1731746396425792:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.762486:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000092b1d4a6/0x3234de053c4f29a lrc: 4/0,0 mode: PR/PR res: [0x2badc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d59 expref: 106 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.762487:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.762489:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000013b5560/0x3234de053c4ccde lrc: 4/0,0 mode: PR/PR res: [0x2badf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce55f expref: 106 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.762490:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000092b1d4a6/0x3234de053c4f29a lrc: 3/0,0 mode: PR/PR res: [0x2badc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d59 expref: 106 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.762492:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000013b5560/0x3234de053c4ccde lrc: 3/0,0 mode: PR/PR res: [0x2badf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce55f expref: 106 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.762494:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092b1d4a6/0x3234de053c4f29a lrc: 0/0,0 mode: --/PR res: [0x2badc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d59 expref: 106 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.762497:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000013b5560/0x3234de053c4ccde lrc: 0/0,0 mode: --/PR res: [0x2badf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce55f expref: 106 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.762498:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.762498:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.762499:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c52d9c lrc: 3/0,1 mode: PW/PW res: [0x2badc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.762503:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.762503:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.762504:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c52d9c lrc: 4/0,1 mode: PW/PW res: [0x2badc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.762504:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52daa lrc: 3/0,1 mode: PW/PW res: [0x2badf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.762507:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52daa lrc: 4/0,1 mode: PW/PW res: [0x2badf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.762510:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.762516:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.762522:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+104:41278:x1731746396425664:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 31us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.762522:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea4c33b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+104:41278:x1731746396425792:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 36us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.762524:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13247 00000100:00100000:1.0:1651529344.762525:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13246 00000100:00100000:0.0:1651529344.762528:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13248 00000100:00100000:0.0:1651529344.762529:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+102:41278:x1731746396425920:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.762531:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.762533:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c974c514/0x3234de053c4f499 lrc: 4/0,0 mode: PR/PR res: [0x2bae0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84fa expref: 102 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.762534:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13249 00000100:00100000:1.0:1651529344.762536:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+102:41278:x1731746396426048:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.762537:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c974c514/0x3234de053c4f499 lrc: 3/0,0 mode: PR/PR res: [0x2bae0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84fa expref: 102 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.762538:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.762540:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000c0a0acb/0x3234de053c4add5 lrc: 4/0,0 mode: PR/PR res: [0x2bae1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf10 expref: 102 pid: 151609 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.762541:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c974c514/0x3234de053c4f499 lrc: 0/0,0 mode: --/PR res: [0x2bae0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84fa expref: 102 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.762543:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000c0a0acb/0x3234de053c4add5 lrc: 3/0,0 mode: PR/PR res: [0x2bae1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf10 expref: 102 pid: 151609 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.762544:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.762545:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.762546:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c52db8 lrc: 3/0,1 mode: PW/PW res: [0x2bae0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.762548:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c52db8 lrc: 4/0,1 mode: PW/PW res: [0x2bae0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.762549:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c0a0acb/0x3234de053c4add5 lrc: 0/0,0 mode: --/PR res: [0x2bae1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbf10 expref: 101 pid: 151609 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.762553:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.762554:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.762556:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.762560:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52dc6 lrc: 3/0,1 mode: PW/PW res: [0x2bae1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.762561:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+100:41278:x1731746396425920:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 31us (205us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.762563:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52dc6 lrc: 4/0,1 mode: PW/PW res: [0x2bae1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.762563:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13248 00010000:00010000:0.0:1651529344.762570:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52db1 lrc: 3/0,1 mode: PW/PW res: [0x2bade:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.762574:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.762579:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52db1 lrc: 3/0,1 mode: PW/PW res: [0x2bade:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.762580:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+99:41278:x1731746396426048:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 44us (217us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.762582:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52db1 lrc: 3/0,1 mode: PW/PW res: [0x2bade:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.762583:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13249 00010000:00010000:0.0:1651529344.762585:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52db1 lrc: 2/0,0 mode: PW/PW res: [0x2bade:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.762590:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52daa lrc: 3/0,1 mode: PW/PW res: [0x2badf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.762594:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52daa lrc: 3/0,1 mode: PW/PW res: [0x2badf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.762597:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52daa lrc: 3/0,1 mode: PW/PW res: [0x2badf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.762599:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52daa lrc: 2/0,0 mode: PW/PW res: [0x2badf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.762638:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e8ce7f0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1963:39029:x1731745946544640:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 973us (1102us total) trans 12885080515 rc 0/0 00000100:00100000:0.0:1651529344.762641:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212463 00010000:00010000:0.0:1651529344.762648:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52db1 lrc: 2/0,0 mode: PW/PW res: [0x2bade:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.762650:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+1962:39029:x1731745946544704:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1009us (1127us total) trans 12885080516 rc 0/0 00000100:00100000:1.0:1651529344.762653:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212462 00010000:00010000:0.0:1651529344.762654:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003c075ac0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.762655:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52db1 lrc: 2/0,0 mode: PW/PW res: [0x2bade:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.762658:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52db1 lrc: 3/0,0 mode: PW/PW res: [0x2bade:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.762660:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c52db8 lrc: 3/0,1 mode: PW/PW res: [0x2bae0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.762662:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52db1 lrc: 1/0,0 mode: --/PW res: [0x2bade:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.762663:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c52db8 lrc: 3/0,1 mode: PW/PW res: [0x2bae0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.762665:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52db1 lrc: 0/0,0 mode: --/PW res: [0x2bade:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.762666:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c52db8 lrc: 3/0,1 mode: PW/PW res: [0x2bae0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.762669:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c52db8 lrc: 2/0,0 mode: PW/PW res: [0x2bae0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.762670:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52daa lrc: 2/0,0 mode: PW/PW res: [0x2badf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.762672:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006cbd0d09 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.762673:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52daa lrc: 2/0,0 mode: PW/PW res: [0x2badf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.762676:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52daa lrc: 3/0,0 mode: PW/PW res: [0x2badf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.762679:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52daa lrc: 1/0,0 mode: --/PW res: [0x2badf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.762682:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c52daa lrc: 0/0,0 mode: --/PW res: [0x2badf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.762689:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c52db8 lrc: 2/0,0 mode: PW/PW res: [0x2bae0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.762692:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dd6b1be4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.762692:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c52db8 lrc: 2/0,0 mode: PW/PW res: [0x2bae0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.762695:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c52db8 lrc: 3/0,0 mode: PW/PW res: [0x2bae0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.762698:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c52db8 lrc: 1/0,0 mode: --/PW res: [0x2bae0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.762701:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1962:39029:x1731745946544768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 994us (1134us total) trans 12885080517 rc 0/0 00010000:00010000:0.0:1651529344.762701:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c52db8 lrc: 0/0,0 mode: --/PW res: [0x2bae0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.762704:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212464 00010000:00010000:0.0:1651529344.762707:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52da3 lrc: 3/0,1 mode: PW/PW res: [0x2badd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.762709:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52da3 lrc: 3/0,1 mode: PW/PW res: [0x2badd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.762712:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52da3 lrc: 3/0,1 mode: PW/PW res: [0x2badd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.762715:0:106695:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ef44f23/0x3234de053c4b839 lrc: 0/0,0 mode: --/PR res: [0x2bae3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc3c4 expref: 98 pid: 72395 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.762715:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52da3 lrc: 2/0,0 mode: PW/PW res: [0x2badd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.762719:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004089c807 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997064640:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.762723:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c52dcd lrc: 3/0,1 mode: PW/PW res: [0x2bae3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.762726:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c52dcd lrc: 3/0,1 mode: PW/PW res: [0x2bae3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.762729:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c52dcd lrc: 3/0,1 mode: PW/PW res: [0x2bae3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.762732:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c52dcd lrc: 3/0,1 mode: PW/PW res: [0x2bae3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.762745:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c52dcd lrc: 2/0,0 mode: PW/PW res: [0x2bae3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.762768:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1963:39030:x1731745946544576:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1177us (1268us total) trans 12885080518 rc 0/0 00000100:00100000:0.0:1651529344.762772:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212461 00010000:00010000:0.0:1651529344.762779:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52da3 lrc: 2/0,0 mode: PW/PW res: [0x2badd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.762782:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009e44ce9d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.762783:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52da3 lrc: 2/0,0 mode: PW/PW res: [0x2badd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.762785:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1962:39030:x1731745946544960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 875us (980us total) trans 12885080519 rc 0/0 00010000:00010000:0.0:1651529344.762786:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52da3 lrc: 3/0,0 mode: PW/PW res: [0x2badd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.762788:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212467 00010000:00010000:0.0:1651529344.762790:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52da3 lrc: 1/0,0 mode: --/PW res: [0x2badd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.762793:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52da3 lrc: 0/0,0 mode: --/PW res: [0x2badd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.762795:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c52dbf lrc: 3/0,1 mode: PW/PW res: [0x2bae2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.762798:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c52dbf lrc: 3/0,1 mode: PW/PW res: [0x2bae2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.762798:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c52dcd lrc: 2/0,0 mode: PW/PW res: [0x2bae3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.762801:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c52dbf lrc: 3/0,1 mode: PW/PW res: [0x2bae2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.762801:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000014fe598c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.762802:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c52dcd lrc: 2/0,0 mode: PW/PW res: [0x2bae3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.762804:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c52dbf lrc: 2/0,0 mode: PW/PW res: [0x2bae2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.762807:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c52dcd lrc: 3/0,0 mode: PW/PW res: [0x2bae3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.762810:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c52dcd lrc: 1/0,0 mode: --/PW res: [0x2bae3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.762813:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c52dcd lrc: 0/0,0 mode: --/PW res: [0x2bae3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.762817:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c52dbf lrc: 2/0,0 mode: PW/PW res: [0x2bae2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.762819:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004b2a6b06 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.762820:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c52dbf lrc: 2/0,0 mode: PW/PW res: [0x2bae2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.762823:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c52dbf lrc: 3/0,0 mode: PW/PW res: [0x2bae2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.762826:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c52dbf lrc: 1/0,0 mode: --/PW res: [0x2bae2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.762828:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c52dbf lrc: 0/0,0 mode: --/PW res: [0x2bae2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.762834:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1962:39029:x1731745946544896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 976us (1043us total) trans 12885080520 rc 0/0 00010000:00010000:0.0:1651529344.762834:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52dc6 lrc: 3/0,1 mode: PW/PW res: [0x2bae1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.762837:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212466 00010000:00010000:0.0:1651529344.762837:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52dc6 lrc: 3/0,1 mode: PW/PW res: [0x2bae1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.762840:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52dc6 lrc: 3/0,1 mode: PW/PW res: [0x2bae1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.762843:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52dc6 lrc: 2/0,0 mode: PW/PW res: [0x2bae1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.762844:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c52d9c lrc: 3/0,1 mode: PW/PW res: [0x2badc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.762847:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c52d9c lrc: 3/0,1 mode: PW/PW res: [0x2badc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.762850:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c52d9c lrc: 3/0,1 mode: PW/PW res: [0x2badc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.762853:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c52d9c lrc: 2/0,0 mode: PW/PW res: [0x2badc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.762878:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1963:39029:x1731745946544832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1030us (1098us total) trans 12885080521 rc 0/0 00000100:00100000:0.0:1651529344.762881:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212465 00010000:00010000:0.0:1651529344.762887:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52dc6 lrc: 2/0,0 mode: PW/PW res: [0x2bae1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.762890:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f183a40b already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.762891:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1962:39030:x1731745946544512:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1305us (1407us total) trans 12885080522 rc 0/0 00010000:00010000:0.0:1651529344.762891:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52dc6 lrc: 2/0,0 mode: PW/PW res: [0x2bae1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.762894:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212460 00010000:00010000:0.0:1651529344.762894:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52dc6 lrc: 3/0,0 mode: PW/PW res: [0x2bae1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.762898:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52dc6 lrc: 1/0,0 mode: --/PW res: [0x2bae1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.762901:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52dc6 lrc: 0/0,0 mode: --/PW res: [0x2bae1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.762905:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c52d9c lrc: 2/0,0 mode: PW/PW res: [0x2badc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.762908:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000066921086 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.762909:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c52d9c lrc: 2/0,0 mode: PW/PW res: [0x2badc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.762911:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c52d9c lrc: 3/0,0 mode: PW/PW res: [0x2badc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.762914:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c52d9c lrc: 1/0,0 mode: --/PW res: [0x2badc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.762917:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c52d9c lrc: 0/0,0 mode: --/PW res: [0x2badc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.763132:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.763150:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946545024 00000100:00100000:1.0:1651529344.763160:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212468 00000100:00100000:1.0:1651529344.763162:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1962:39030:x1731745946545024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.763168:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529344.763178:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178916 count 1 00000100:00100000:0.0:1651529344.763179:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529344.763187:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c52dd4 lrc: 3/0,1 mode: --/PW res: [0x2bae4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.763189:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946545152 00010000:00010000:1.0:1651529344.763192:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a4b7100d/0x3234de053c4cf38 lrc: 2/0,0 mode: PR/PR res: [0x2bae4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceec0 expref: 97 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.763195:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.763195:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946545088 00010000:00010000:1.0:1651529344.763196:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.763197:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c52dd4 lrc: 4/0,1 mode: --/PW res: [0x2bae4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.763202:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212469 00000100:00100000:0.0:1651529344.763203:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1964:39030:x1731745946545152:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.763208:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a4b7100d/0x3234de053c4cf38 lrc: 3/0,0 mode: PR/PR res: [0x2bae4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceec0 expref: 97 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529344.763209:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178918 count 1 00010000:00010000:1.0:1651529344.763212:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a4b7100d/0x3234de053c4cf38 lrc: 4/0,0 mode: PR/PR res: [0x2bae4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceec0 expref: 97 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.763213:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52ddb lrc: 3/0,1 mode: --/PW res: [0x2bae6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.763216:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fe004e2b pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997064704:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.763238:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a4eb401d going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.763244:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212470 00000100:00100000:1.0:1651529344.763246:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1964:39030:x1731745946545088:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.763262:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f7e51f0e/0x3234de053c4e66f lrc: 2/0,0 mode: PR/PR res: [0x2bae6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a84 expref: 97 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.763265:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178917 count 1 00010000:00010000:0.0:1651529344.763265:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.763266:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.763267:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52ddb lrc: 4/0,1 mode: --/PW res: [0x2bae6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.763269:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c52de2 lrc: 3/0,1 mode: --/PW res: [0x2bae5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.763274:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b7c1a58b/0x3234de053c4e9be lrc: 2/0,0 mode: PR/PR res: [0x2bae5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d585a expref: 97 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.763275:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f7e51f0e/0x3234de053c4e66f lrc: 3/0,0 mode: PR/PR res: [0x2bae6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a84 expref: 97 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.763277:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.763277:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.763278:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c52de2 lrc: 4/0,1 mode: --/PW res: [0x2bae5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.763278:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f7e51f0e/0x3234de053c4e66f lrc: 4/0,0 mode: PR/PR res: [0x2bae6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a84 expref: 97 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.763283:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085af61db pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997064768:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.763284:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b7c1a58b/0x3234de053c4e9be lrc: 3/0,0 mode: PR/PR res: [0x2bae5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d585a expref: 97 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.763287:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b7c1a58b/0x3234de053c4e9be lrc: 4/0,0 mode: PR/PR res: [0x2bae5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d585a expref: 97 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.763291:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005912c4a3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997064832:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.763292:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 000000003678d25f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.763299:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b52d0f36 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.763305:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.763316:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.763324:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.763331:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.763340:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.763346:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946545216 00000100:00100000:0.0:1651529344.763354:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946545344 00000100:00100000:0.0:1651529344.763358:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946545280 00000100:00100000:1.0:1651529344.763360:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946545408 00000100:00100000:0.0:1651529344.763361:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946545472 00000100:00100000:0.0:1651529344.763367:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212471 00000100:00100000:0.0:1651529344.763369:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1969:39029:x1731745946545216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.763373:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212472 00000100:00100000:1.0:1651529344.763374:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1969:39029:x1731745946545344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.763374:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178919 count 1 00010000:00010000:0.0:1651529344.763378:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52de9 lrc: 3/0,1 mode: --/PW res: [0x2bae7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.763380:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178921 count 1 00010000:00010000:0.0:1651529344.763382:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000019047655/0x3234de053c4db01 lrc: 2/0,0 mode: PR/PR res: [0x2bae7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c40 expref: 97 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.763383:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c52df0 lrc: 3/0,1 mode: --/PW res: [0x2bae9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.763385:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.763386:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.763387:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52de9 lrc: 4/0,1 mode: --/PW res: [0x2bae7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.763388:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003cf1b4ee/0x3234de053c4e901 lrc: 2/0,0 mode: PR/PR res: [0x2bae9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d548d expref: 97 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.763391:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.763392:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.763392:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c52df0 lrc: 4/0,1 mode: --/PW res: [0x2bae9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.763393:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000019047655/0x3234de053c4db01 lrc: 3/0,0 mode: PR/PR res: [0x2bae7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c40 expref: 97 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.763396:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000019047655/0x3234de053c4db01 lrc: 4/0,0 mode: PR/PR res: [0x2bae7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c40 expref: 97 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.763399:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003cf1b4ee/0x3234de053c4e901 lrc: 3/0,0 mode: PR/PR res: [0x2bae9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d548d expref: 97 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.763400:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002a1f5cf2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997064896:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.763402:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003cf1b4ee/0x3234de053c4e901 lrc: 4/0,0 mode: PR/PR res: [0x2bae9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d548d expref: 97 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.763406:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e7f02909 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997064960:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.763410:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 000000003ad73843 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.763414:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 0000000020dd7827 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.763416:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212473 00000100:00100000:0.0:1651529344.763418:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1969:39029:x1731745946545280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.763421:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212474 00000100:00100000:1.0:1651529344.763422:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1969:39030:x1731745946545472:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.763422:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178920 count 1 00010000:00010000:0.0:1651529344.763425:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52df7 lrc: 3/0,1 mode: --/PW res: [0x2bae8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.763426:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178923 count 1 00010000:00010000:1.0:1651529344.763429:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c52dfe lrc: 3/0,1 mode: --/PW res: [0x2baeb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.763429:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009dbae3e9/0x3234de053c4e92b lrc: 2/0,0 mode: PR/PR res: [0x2bae8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d55c1 expref: 97 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.763432:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.763433:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000068248457/0x3234de053c4ce7b lrc: 2/0,0 mode: PR/PR res: [0x2baeb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec12 expref: 97 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.763433:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.763433:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52df7 lrc: 4/0,1 mode: --/PW res: [0x2bae8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.763436:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.763437:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.763438:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c52dfe lrc: 4/0,1 mode: --/PW res: [0x2baeb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.763439:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009dbae3e9/0x3234de053c4e92b lrc: 3/0,0 mode: PR/PR res: [0x2bae8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d55c1 expref: 97 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.763442:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009dbae3e9/0x3234de053c4e92b lrc: 4/0,0 mode: PR/PR res: [0x2bae8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d55c1 expref: 97 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.763443:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000068248457/0x3234de053c4ce7b lrc: 3/0,0 mode: PR/PR res: [0x2baeb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec12 expref: 97 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.763446:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b4acf60d pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997065024:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.763447:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000068248457/0x3234de053c4ce7b lrc: 4/0,0 mode: PR/PR res: [0x2baeb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec12 expref: 97 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.763451:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000076d5f96b pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997065088:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.763452:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a82c4968 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.763457:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f9dac3f6 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.763458:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212475 00000100:00100000:0.0:1651529344.763460:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1969:39030:x1731745946545408:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.763464:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178922 count 1 00010000:00010000:0.0:1651529344.763466:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52e05 lrc: 3/0,1 mode: --/PW res: [0x2baea:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.763470:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c4c704 lrc: 2/0,0 mode: PR/PR res: [0x2baea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce0c expref: 97 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.763473:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.763474:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.763474:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52e05 lrc: 4/0,1 mode: --/PW res: [0x2baea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.763504:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c4c704 lrc: 3/0,0 mode: PR/PR res: [0x2baea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce0c expref: 97 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.763508:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c4c704 lrc: 4/0,0 mode: PR/PR res: [0x2baea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce0c expref: 97 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.763521:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d9ef3c1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997065152:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.763536:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 0000000049203969 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.763545:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085af61db pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997064768:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.763549:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52ddb lrc: 3/0,1 mode: --/PW res: [0x2bae6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.763553:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.763570:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396426176 00010000:00010000:1.0:1651529344.763576:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a4b7100d/0x3234de053c4cf38 lrc: 5/0,0 mode: PR/PR res: [0x2bae4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceec0 expref: 98 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.763596:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13250 00000100:00100000:1.0:1651529344.763598:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+98:41278:x1731746396426176:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.763601:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.763602:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a4b7100d/0x3234de053c4cf38 lrc: 5/0,0 mode: PR/PR res: [0x2bae4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceec0 expref: 98 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.763607:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a4b7100d/0x3234de053c4cf38 lrc: 4/0,0 mode: PR/PR res: [0x2bae4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceec0 expref: 98 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.763612:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.763613:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.763614:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c52dd4 lrc: 3/0,1 mode: PW/PW res: [0x2bae4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.763623:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c52dd4 lrc: 4/0,1 mode: PW/PW res: [0x2bae4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.763629:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.763640:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+98:41278:x1731746396426176:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 41us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.763643:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13250 00010000:00010000:1.0:1651529344.763654:0:80278:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4b7100d/0x3234de053c4cf38 lrc: 0/0,0 mode: --/PR res: [0x2bae4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ceec0 expref: 97 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.763665:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fe004e2b pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997064704:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.763669:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c52dd4 lrc: 3/0,1 mode: PW/PW res: [0x2bae4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.763672:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c52dd4 lrc: 3/0,1 mode: PW/PW res: [0x2bae4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.763675:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c52dd4 lrc: 3/0,1 mode: PW/PW res: [0x2bae4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.763678:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c52dd4 lrc: 3/0,1 mode: PW/PW res: [0x2bae4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.763681:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c52dd4 lrc: 2/0,0 mode: PW/PW res: [0x2bae4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.763726:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1970:39030:x1731745946545024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 563us (594us total) trans 12885080523 rc 0/0 00000100:00100000:1.0:1651529344.763729:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212468 00010000:00010000:1.0:1651529344.763744:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c52dd4 lrc: 2/0,0 mode: PW/PW res: [0x2bae4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.763747:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cd5f3a7c already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.763749:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c52dd4 lrc: 2/0,0 mode: PW/PW res: [0x2bae4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.763759:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c52dd4 lrc: 3/0,0 mode: PW/PW res: [0x2bae4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.763764:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c52dd4 lrc: 1/0,0 mode: --/PW res: [0x2bae4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.763767:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c52dd4 lrc: 0/0,0 mode: --/PW res: [0x2bae4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.763781:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.763793:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396426240 00010000:00010000:1.0:1651529344.763798:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f7e51f0e/0x3234de053c4e66f lrc: 4/0,0 mode: PR/PR res: [0x2bae6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a84 expref: 97 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.763805:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13251 00000100:00100000:1.0:1651529344.763807:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+97:41278:x1731746396426240:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.763810:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.763811:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f7e51f0e/0x3234de053c4e66f lrc: 4/0,0 mode: PR/PR res: [0x2bae6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a84 expref: 97 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.763815:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f7e51f0e/0x3234de053c4e66f lrc: 3/0,0 mode: PR/PR res: [0x2bae6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a84 expref: 97 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.763820:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7e51f0e/0x3234de053c4e66f lrc: 0/0,0 mode: --/PR res: [0x2bae6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a84 expref: 97 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.763823:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.763824:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.763824:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52ddb lrc: 3/0,1 mode: PW/PW res: [0x2bae6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.763827:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52ddb lrc: 4/0,1 mode: PW/PW res: [0x2bae6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.763838:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.763840:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52ddb lrc: 3/0,1 mode: PW/PW res: [0x2bae6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.763844:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52ddb lrc: 3/0,1 mode: PW/PW res: [0x2bae6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.763848:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+96:41278:x1731746396426240:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (66us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.763850:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13251 00010000:00010000:0.0:1651529344.763852:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52ddb lrc: 3/0,1 mode: PW/PW res: [0x2bae6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.763855:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52ddb lrc: 2/0,0 mode: PW/PW res: [0x2bae6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.763860:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005912c4a3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997064832:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.763864:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c52de2 lrc: 3/0,1 mode: --/PW res: [0x2bae5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.763902:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.763956:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1970:39030:x1731745946545152:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 751us (787us total) trans 12885080524 rc 0/0 00000100:00100000:0.0:1651529344.763959:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212469 00000100:00100000:0.0:1651529344.763965:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946545536 00000100:00100000:1.0:1651529344.763966:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.763985:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212476 00000100:00100000:0.0:1651529344.763987:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1970:39029:x1731745946545536:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.763993:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178924 count 1 00010000:00010000:0.0:1651529344.763997:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52e0c lrc: 3/0,1 mode: --/PW res: [0x2baec:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.764012:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001e29b6aa/0x3234de053c4e1c9 lrc: 2/0,0 mode: PR/PR res: [0x2baec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d386a expref: 95 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.764016:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.764016:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.764021:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52e0c lrc: 4/0,1 mode: --/PW res: [0x2baec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.764023:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.764029:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001e29b6aa/0x3234de053c4e1c9 lrc: 3/0,0 mode: PR/PR res: [0x2baec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d386a expref: 95 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.764030:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.764032:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001e29b6aa/0x3234de053c4e1c9 lrc: 4/0,0 mode: PR/PR res: [0x2baec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d386a expref: 95 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.764037:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.764037:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a925fbf6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997065216:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.764046:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.764051:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 000000003678d25f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.764055:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.764056:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52ddb lrc: 2/0,0 mode: PW/PW res: [0x2bae6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.764062:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000490515f1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.764063:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52ddb lrc: 2/0,0 mode: PW/PW res: [0x2bae6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.764066:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52ddb lrc: 3/0,0 mode: PW/PW res: [0x2bae6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.764070:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52ddb lrc: 1/0,0 mode: --/PW res: [0x2bae6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.764073:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c52ddb lrc: 0/0,0 mode: --/PW res: [0x2bae6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.764083:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396426304 00000100:00100000:0.0:1651529344.764084:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002a1f5cf2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997064896:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.764087:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52de9 lrc: 3/0,1 mode: --/PW res: [0x2bae7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.764089:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b7c1a58b/0x3234de053c4e9be lrc: 4/0,0 mode: PR/PR res: [0x2bae5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d585a expref: 96 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.764093:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b4acf60d pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997065024:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.764095:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396426432 00010000:00010000:0.0:1651529344.764096:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52df7 lrc: 3/0,1 mode: --/PW res: [0x2bae8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.764097:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003cf1b4ee/0x3234de053c4e901 lrc: 5/0,0 mode: PR/PR res: [0x2bae9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d548d expref: 97 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.764101:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396426560 00000100:00100000:0.0:1651529344.764101:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d9ef3c1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997065152:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.764103:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000068248457/0x3234de053c4ce7b lrc: 5/0,0 mode: PR/PR res: [0x2baeb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec12 expref: 98 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.764104:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52e05 lrc: 3/0,1 mode: --/PW res: [0x2baea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.764107:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396426368 00010000:00010000:1.0:1651529344.764109:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000019047655/0x3234de053c4db01 lrc: 4/0,0 mode: PR/PR res: [0x2bae7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c40 expref: 99 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.764113:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396426496 00010000:00010000:1.0:1651529344.764115:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009dbae3e9/0x3234de053c4e92b lrc: 4/0,0 mode: PR/PR res: [0x2bae8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d55c1 expref: 100 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.764119:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396426624 00010000:00010000:1.0:1651529344.764121:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c4c704 lrc: 4/0,0 mode: PR/PR res: [0x2baea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce0c expref: 101 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.764135:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13252 00000100:00100000:1.0:1651529344.764136:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+101:41279:x1731746396426304:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.764137:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13253 00010000:00010000:1.0:1651529344.764139:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.764139:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+101:41278:x1731746396426432:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.764141:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b7c1a58b/0x3234de053c4e9be lrc: 4/0,0 mode: PR/PR res: [0x2bae5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d585a expref: 101 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.764143:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.764144:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b7c1a58b/0x3234de053c4e9be lrc: 3/0,0 mode: PR/PR res: [0x2bae5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d585a expref: 101 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.764144:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003cf1b4ee/0x3234de053c4e901 lrc: 5/0,0 mode: PR/PR res: [0x2bae9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d548d expref: 101 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.764148:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003cf1b4ee/0x3234de053c4e901 lrc: 4/0,0 mode: PR/PR res: [0x2bae9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d548d expref: 101 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.764150:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7c1a58b/0x3234de053c4e9be lrc: 0/0,0 mode: --/PR res: [0x2bae5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d585a expref: 101 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.764153:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.764154:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.764154:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.764155:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c52de2 lrc: 3/0,1 mode: PW/PW res: [0x2bae5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.764155:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.764155:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c52df0 lrc: 3/0,1 mode: PW/PW res: [0x2bae9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.764158:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c52de2 lrc: 4/0,1 mode: PW/PW res: [0x2bae5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.764158:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c52df0 lrc: 4/0,1 mode: PW/PW res: [0x2bae9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.764163:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.764164:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.764170:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+100:41278:x1731746396426432:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 30us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.764171:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+100:41279:x1731746396426304:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 34us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.764172:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13253 00000100:00100000:1.0:1651529344.764174:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13252 00000100:00100000:1.0:1651529344.764179:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13254 00000100:00100000:1.0:1651529344.764180:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1a0028d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+98:41278:x1731746396426560:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.764183:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.764184:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000068248457/0x3234de053c4ce7b lrc: 5/0,0 mode: PR/PR res: [0x2baeb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec12 expref: 98 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.764188:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000068248457/0x3234de053c4ce7b lrc: 4/0,0 mode: PR/PR res: [0x2baeb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec12 expref: 98 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.764193:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.764193:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.764194:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c52dfe lrc: 3/0,1 mode: PW/PW res: [0x2baeb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.764197:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c52dfe lrc: 4/0,1 mode: PW/PW res: [0x2baeb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.764201:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.764202:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13255 00000100:00100000:0.0:1651529344.764204:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+98:41278:x1731746396426368:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.764205:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1a0028d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+98:41278:x1731746396426560:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 24us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.764207:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13254 00010000:00010000:0.0:1651529344.764208:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.764209:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000019047655/0x3234de053c4db01 lrc: 4/0,0 mode: PR/PR res: [0x2bae7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c40 expref: 97 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.764214:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000019047655/0x3234de053c4db01 lrc: 3/0,0 mode: PR/PR res: [0x2bae7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c40 expref: 97 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.764215:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13256 00000100:00100000:1.0:1651529344.764216:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+97:41278:x1731746396426496:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.764219:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.764219:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019047655/0x3234de053c4db01 lrc: 0/0,0 mode: --/PR res: [0x2bae7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1c40 expref: 97 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.764220:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009dbae3e9/0x3234de053c4e92b lrc: 4/0,0 mode: PR/PR res: [0x2bae8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d55c1 expref: 97 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.764252:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009dbae3e9/0x3234de053c4e92b lrc: 3/0,0 mode: PR/PR res: [0x2bae8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d55c1 expref: 97 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.764253:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.764254:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.764255:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52de9 lrc: 3/0,1 mode: PW/PW res: [0x2bae7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.764258:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52de9 lrc: 4/0,1 mode: PW/PW res: [0x2bae7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.764262:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009dbae3e9/0x3234de053c4e92b lrc: 0/0,0 mode: --/PR res: [0x2bae8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d55c1 expref: 96 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.764265:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.764265:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.764266:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.764267:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52df7 lrc: 3/0,1 mode: PW/PW res: [0x2bae8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.764269:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52df7 lrc: 4/0,1 mode: PW/PW res: [0x2bae8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.764273:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+95:41278:x1731746396426368:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 68us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.764275:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13255 00010000:00010000:1.0:1651529344.764278:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.764284:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+94:41278:x1731746396426496:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 67us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.764287:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13257 00000100:00100000:1.0:1651529344.764289:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13256 00000100:00100000:0.0:1651529344.764289:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+94:41278:x1731746396426624:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.764291:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.764293:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c4c704 lrc: 4/0,0 mode: PR/PR res: [0x2baea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce0c expref: 93 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.764297:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c4c704 lrc: 3/0,0 mode: PR/PR res: [0x2baea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce0c expref: 93 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.764299:0:72396:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003cf1b4ee/0x3234de053c4e901 lrc: 0/0,0 mode: --/PR res: [0x2bae9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d548d expref: 93 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.764302:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c4c704 lrc: 0/0,0 mode: --/PR res: [0x2baea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cce0c expref: 93 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.764303:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e7f02909 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997064960:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.764305:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.764306:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.764307:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c52df0 lrc: 3/0,1 mode: PW/PW res: [0x2bae9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.764307:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52e05 lrc: 3/0,1 mode: PW/PW res: [0x2baea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.764309:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52e05 lrc: 4/0,1 mode: PW/PW res: [0x2baea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.764310:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c52df0 lrc: 3/0,1 mode: PW/PW res: [0x2bae9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.764313:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c52df0 lrc: 3/0,1 mode: PW/PW res: [0x2bae9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.764315:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.764316:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c52df0 lrc: 3/0,1 mode: PW/PW res: [0x2bae9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.764319:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c52df0 lrc: 2/0,0 mode: PW/PW res: [0x2bae9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.764321:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+91:41278:x1731746396426624:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 31us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.764323:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13257 00010000:00010000:0.0:1651529344.764335:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c52df0 lrc: 2/0,0 mode: PW/PW res: [0x2bae9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.764339:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000314b5fa1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.764340:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c52df0 lrc: 2/0,0 mode: PW/PW res: [0x2bae9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.764343:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c52df0 lrc: 3/0,0 mode: PW/PW res: [0x2bae9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.764347:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c52df0 lrc: 1/0,0 mode: --/PW res: [0x2bae9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.764352:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c52df0 lrc: 0/0,0 mode: --/PW res: [0x2bae9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.764358:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52df7 lrc: 3/0,1 mode: PW/PW res: [0x2bae8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.764360:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1971:39029:x1731745946545344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 985us (1044us total) trans 12885080525 rc 0/0 00010000:00010000:0.0:1651529344.764360:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52df7 lrc: 3/0,1 mode: PW/PW res: [0x2bae8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.764363:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212472 00010000:00010000:0.0:1651529344.764363:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52df7 lrc: 3/0,1 mode: PW/PW res: [0x2bae8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.764366:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52df7 lrc: 2/0,0 mode: PW/PW res: [0x2bae8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.764380:0:106695:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068248457/0x3234de053c4ce7b lrc: 0/0,0 mode: --/PR res: [0x2baeb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cec12 expref: 90 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.764385:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000076d5f96b pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997065088:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.764388:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c52dfe lrc: 3/0,1 mode: PW/PW res: [0x2baeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.764392:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c52dfe lrc: 3/0,1 mode: PW/PW res: [0x2baeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.764394:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c52dfe lrc: 3/0,1 mode: PW/PW res: [0x2baeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.764397:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c52dfe lrc: 3/0,1 mode: PW/PW res: [0x2baeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.764402:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c52dfe lrc: 2/0,0 mode: PW/PW res: [0x2baeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.764408:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1971:39029:x1731745946545280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 990us (1084us total) trans 12885080526 rc 0/0 00000100:00100000:0.0:1651529344.764419:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212473 00010000:00010000:0.0:1651529344.764425:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52de9 lrc: 3/0,1 mode: PW/PW res: [0x2bae7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.764428:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52de9 lrc: 3/0,1 mode: PW/PW res: [0x2bae7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.764432:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52de9 lrc: 3/0,1 mode: PW/PW res: [0x2bae7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.764436:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52de9 lrc: 2/0,0 mode: PW/PW res: [0x2bae7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.764442:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1971:39030:x1731745946545472:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1019us (1101us total) trans 12885080527 rc 0/0 00000100:00100000:1.0:1651529344.764445:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212474 00010000:00010000:1.0:1651529344.764453:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c52de2 lrc: 3/0,1 mode: PW/PW res: [0x2bae5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.764456:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c52de2 lrc: 3/0,1 mode: PW/PW res: [0x2bae5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.764459:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c52de2 lrc: 3/0,1 mode: PW/PW res: [0x2bae5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.764462:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c52de2 lrc: 2/0,0 mode: PW/PW res: [0x2bae5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.764470:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1971:39029:x1731745946545216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1100us (1164us total) trans 12885080528 rc 0/0 00000100:00100000:0.0:1651529344.764473:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212471 00010000:00010000:0.0:1651529344.764479:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52e05 lrc: 3/0,1 mode: PW/PW res: [0x2baea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.764482:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52e05 lrc: 3/0,1 mode: PW/PW res: [0x2baea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.764485:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52e05 lrc: 3/0,1 mode: PW/PW res: [0x2baea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.764488:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52e05 lrc: 2/0,0 mode: PW/PW res: [0x2baea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.764491:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1971:39030:x1731745946545088:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1245us (1312us total) trans 12885080529 rc 0/0 00000100:00100000:1.0:1651529344.764494:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212470 00010000:00010000:1.0:1651529344.764501:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52df7 lrc: 2/0,0 mode: PW/PW res: [0x2bae8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.764504:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000050e053bc already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.764505:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52df7 lrc: 2/0,0 mode: PW/PW res: [0x2bae8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.764508:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52df7 lrc: 3/0,0 mode: PW/PW res: [0x2bae8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.764513:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52df7 lrc: 1/0,0 mode: --/PW res: [0x2bae8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.764516:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c52df7 lrc: 0/0,0 mode: --/PW res: [0x2bae8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.764517:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1971:39030:x1731745946545408:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1057us (1186us total) trans 12885080530 rc 0/0 00010000:00010000:1.0:1651529344.764520:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c52dfe lrc: 2/0,0 mode: PW/PW res: [0x2baeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.764520:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212475 00010000:00010000:1.0:1651529344.764523:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bdf2b6c4 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.764524:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c52dfe lrc: 2/0,0 mode: PW/PW res: [0x2baeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.764527:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c52dfe lrc: 3/0,0 mode: PW/PW res: [0x2baeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.764527:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52de9 lrc: 2/0,0 mode: PW/PW res: [0x2bae7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.764530:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c52dfe lrc: 1/0,0 mode: --/PW res: [0x2baeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.764530:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f1b4c19f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.764530:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52de9 lrc: 2/0,0 mode: PW/PW res: [0x2bae7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.764532:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c52dfe lrc: 0/0,0 mode: --/PW res: [0x2baeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.764534:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52de9 lrc: 3/0,0 mode: PW/PW res: [0x2bae7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.764537:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c52de2 lrc: 2/0,0 mode: PW/PW res: [0x2bae5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.764538:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52de9 lrc: 1/0,0 mode: --/PW res: [0x2bae7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.764540:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ebdbebae already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.764541:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c52de2 lrc: 2/0,0 mode: PW/PW res: [0x2bae5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.764541:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c52de9 lrc: 0/0,0 mode: --/PW res: [0x2bae7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.764543:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c52de2 lrc: 3/0,0 mode: PW/PW res: [0x2bae5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.764546:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c52de2 lrc: 1/0,0 mode: --/PW res: [0x2bae5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.764546:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52e05 lrc: 2/0,0 mode: PW/PW res: [0x2baea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.764549:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c52de2 lrc: 0/0,0 mode: --/PW res: [0x2bae5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.764549:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000820e505a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.764550:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52e05 lrc: 2/0,0 mode: PW/PW res: [0x2baea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.764553:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52e05 lrc: 3/0,0 mode: PW/PW res: [0x2baea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.764556:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52e05 lrc: 1/0,0 mode: --/PW res: [0x2baea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.764558:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c52e05 lrc: 0/0,0 mode: --/PW res: [0x2baea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.764565:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.764583:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946545600 00000100:00100000:1.0:1651529344.764601:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212477 00000100:00100000:1.0:1651529344.764602:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1971:39029:x1731745946545600:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.764607:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178925 count 1 00010000:00010000:1.0:1651529344.764611:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c52e13 lrc: 3/0,1 mode: --/PW res: [0x2baed:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.764616:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000007c5640b/0x3234de053c49f7a lrc: 2/0,0 mode: PR/PR res: [0x2baed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb43c expref: 89 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.764629:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.764630:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.764631:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c52e13 lrc: 4/0,1 mode: --/PW res: [0x2baed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.764655:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000007c5640b/0x3234de053c49f7a lrc: 3/0,0 mode: PR/PR res: [0x2baed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb43c expref: 89 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.764656:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a925fbf6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997065216:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.764660:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000007c5640b/0x3234de053c49f7a lrc: 4/0,0 mode: PR/PR res: [0x2baed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb43c expref: 89 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.764661:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52e0c lrc: 3/0,1 mode: --/PW res: [0x2baec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.764664:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a130088 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997065280:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.764678:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 0000000020dd7827 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.764691:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.764751:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396426688 00010000:00010000:1.0:1651529344.764757:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001e29b6aa/0x3234de053c4e1c9 lrc: 4/0,0 mode: PR/PR res: [0x2baec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d386a expref: 90 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.764765:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13258 00000100:00100000:1.0:1651529344.764766:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+90:41279:x1731746396426688:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.764769:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.764770:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001e29b6aa/0x3234de053c4e1c9 lrc: 4/0,0 mode: PR/PR res: [0x2baec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d386a expref: 90 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.764774:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001e29b6aa/0x3234de053c4e1c9 lrc: 3/0,0 mode: PR/PR res: [0x2baec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d386a expref: 90 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.764780:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e29b6aa/0x3234de053c4e1c9 lrc: 0/0,0 mode: --/PR res: [0x2baec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d386a expref: 90 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.764786:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.764787:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.764788:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52e0c lrc: 3/0,1 mode: PW/PW res: [0x2baec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.764790:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52e0c lrc: 4/0,1 mode: PW/PW res: [0x2baec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.764801:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.764810:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+89:41279:x1731746396426688:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 43us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.764812:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13258 00000100:00100000:0.0:1651529344.764833:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.764842:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.764852:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946545728 00000100:00100000:0.0:1651529344.764852:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.764859:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946545664 00000100:00100000:0.0:1651529344.764860:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946545792 00000100:00100000:1.0:1651529344.764867:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212478 00000100:00100000:1.0:1651529344.764868:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1974:39029:x1731745946545728:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.764873:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178927 count 1 00010000:00010000:1.0:1651529344.764877:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c52e1a lrc: 3/0,1 mode: --/PW res: [0x2baef:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.764888:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004bc816c1/0x3234de053c4f484 lrc: 2/0,0 mode: PR/PR res: [0x2baef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84b4 expref: 88 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.764891:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.764892:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.764892:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c52e1a lrc: 4/0,1 mode: --/PW res: [0x2baef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.764906:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004bc816c1/0x3234de053c4f484 lrc: 3/0,0 mode: PR/PR res: [0x2baef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84b4 expref: 88 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.764910:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004bc816c1/0x3234de053c4f484 lrc: 4/0,0 mode: PR/PR res: [0x2baef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84b4 expref: 88 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.764911:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212479 00000100:00100000:0.0:1651529344.764913:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1974:39029:x1731745946545664:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.764914:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e7f02909 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997065344:10.240.43.64@tcp:104: 00002000:00080000:0.0:1651529344.764919:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178926 count 1 00000100:00100000:1.0:1651529344.764923:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b52d0f36 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.764923:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52e21 lrc: 3/0,1 mode: --/PW res: [0x2baee:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.764928:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000954bdde0/0x3234de053c4e374 lrc: 2/0,0 mode: PR/PR res: [0x2baee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ed7 expref: 88 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.764929:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212480 00000100:00100000:1.0:1651529344.764931:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1974:39029:x1731745946545792:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.764931:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.764931:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.764932:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52e21 lrc: 4/0,1 mode: --/PW res: [0x2baee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.764935:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178928 count 1 00010000:00010000:1.0:1651529344.764939:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52e28 lrc: 3/0,1 mode: --/PW res: [0x2baf0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.764939:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000954bdde0/0x3234de053c4e374 lrc: 3/0,0 mode: PR/PR res: [0x2baee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ed7 expref: 88 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.764942:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000954bdde0/0x3234de053c4e374 lrc: 4/0,0 mode: PR/PR res: [0x2baee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ed7 expref: 88 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.764943:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009a24dc11/0x3234de053c4bdd4 lrc: 2/0,0 mode: PR/PR res: [0x2baf0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc66b expref: 88 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.764946:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.764947:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.764947:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f7006631 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997065408:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.764948:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52e28 lrc: 4/0,1 mode: --/PW res: [0x2baf0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.764953:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009a24dc11/0x3234de053c4bdd4 lrc: 3/0,0 mode: PR/PR res: [0x2baf0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc66b expref: 88 pid: 80276 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.764956:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 0000000070e666f7 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.764957:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009a24dc11/0x3234de053c4bdd4 lrc: 4/0,0 mode: PR/PR res: [0x2baf0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc66b expref: 88 pid: 80276 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.764961:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000064719963 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997065472:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.764963:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52e0c lrc: 3/0,1 mode: PW/PW res: [0x2baec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.764966:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52e0c lrc: 3/0,1 mode: PW/PW res: [0x2baec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.764967:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000499d0377 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.764969:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52e0c lrc: 3/0,1 mode: PW/PW res: [0x2baec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.764972:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52e0c lrc: 2/0,0 mode: PW/PW res: [0x2baec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.765003:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.765019:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1975:39029:x1731745946545536:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1031us (1117us total) trans 12885080531 rc 0/0 00000100:00100000:0.0:1651529344.765022:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212476 00000100:00100000:1.0:1651529344.765026:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.765027:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946545920 00000100:00100000:0.0:1651529344.765042:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946545856 00000100:00100000:0.0:1651529344.765047:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212481 00000100:00100000:0.0:1651529344.765048:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1976:39030:x1731745946545920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.765053:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178930 count 1 00010000:00010000:0.0:1651529344.765057:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52e2f lrc: 3/0,1 mode: --/PW res: [0x2baf2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.765061:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c4df1b lrc: 2/0,0 mode: PR/PR res: [0x2baf2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d8f expref: 88 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.765064:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.765065:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.765065:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.765066:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52e2f lrc: 4/0,1 mode: --/PW res: [0x2baf2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.765072:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c4df1b lrc: 3/0,0 mode: PR/PR res: [0x2baf2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d8f expref: 88 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.765076:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c4df1b lrc: 4/0,0 mode: PR/PR res: [0x2baf2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d8f expref: 88 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.765080:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f99b3c22 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997065536:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.765088:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 0000000049203969 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.765094:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212482 00000100:00100000:0.0:1651529344.765096:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1976:39030:x1731745946545856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.765100:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178929 count 1 00000100:00100000:1.0:1651529344.765101:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.765103:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52e36 lrc: 3/0,1 mode: --/PW res: [0x2baf1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.765107:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f8a5f7a5/0x3234de053c4f5bf lrc: 2/0,0 mode: PR/PR res: [0x2baf1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8976 expref: 88 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.765110:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.765111:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.765111:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52e36 lrc: 4/0,1 mode: --/PW res: [0x2baf1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.765117:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f8a5f7a5/0x3234de053c4f5bf lrc: 3/0,0 mode: PR/PR res: [0x2baf1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8976 expref: 88 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.765123:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f8a5f7a5/0x3234de053c4f5bf lrc: 4/0,0 mode: PR/PR res: [0x2baf1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8976 expref: 88 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.765126:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003562cf4d pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997065600:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.765130:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52e0c lrc: 2/0,0 mode: PW/PW res: [0x2baec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.765134:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000046fea5cc already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.765135:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52e0c lrc: 2/0,0 mode: PW/PW res: [0x2baec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.765138:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a82c4968 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.765143:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52e0c lrc: 3/0,0 mode: PW/PW res: [0x2baec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.765145:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946545984 00010000:00010000:1.0:1651529344.765148:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52e0c lrc: 1/0,0 mode: --/PW res: [0x2baec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.765150:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c52e0c lrc: 0/0,0 mode: --/PW res: [0x2baec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.765162:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a130088 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997065280:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.765166:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c52e13 lrc: 3/0,1 mode: --/PW res: [0x2baed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.765179:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212483 00000100:00100000:1.0:1651529344.765181:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396426752 00000100:00100000:0.0:1651529344.765181:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1977:39030:x1731745946545984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.765185:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178931 count 1 00010000:00010000:1.0:1651529344.765186:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000007c5640b/0x3234de053c49f7a lrc: 4/0,0 mode: PR/PR res: [0x2baed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb43c expref: 89 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.765189:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52e3d lrc: 3/0,1 mode: --/PW res: [0x2baf3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.765193:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13259 00010000:00010000:0.0:1651529344.765193:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c01403d2/0x3234de053c4c877 lrc: 2/0,0 mode: PR/PR res: [0x2baf3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd3b5 expref: 89 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.765194:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+89:41279:x1731746396426752:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.765197:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.765197:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.765197:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.765198:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52e3d lrc: 4/0,1 mode: --/PW res: [0x2baf3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.765199:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000007c5640b/0x3234de053c49f7a lrc: 4/0,0 mode: PR/PR res: [0x2baed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb43c expref: 89 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.765202:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000007c5640b/0x3234de053c49f7a lrc: 3/0,0 mode: PR/PR res: [0x2baed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb43c expref: 89 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.765204:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c01403d2/0x3234de053c4c877 lrc: 3/0,0 mode: PR/PR res: [0x2baf3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd3b5 expref: 89 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.765207:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007c5640b/0x3234de053c49f7a lrc: 0/0,0 mode: --/PR res: [0x2baed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb43c expref: 89 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.765207:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c01403d2/0x3234de053c4c877 lrc: 4/0,0 mode: PR/PR res: [0x2baf3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd3b5 expref: 89 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.765211:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.765211:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.765212:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c52e13 lrc: 3/0,1 mode: PW/PW res: [0x2baed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.765214:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b4acf60d pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997065664:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.765215:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c52e13 lrc: 4/0,1 mode: PW/PW res: [0x2baed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.765221:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.765238:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e68b7e1f going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.765243:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+88:41279:x1731746396426752:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 47us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.765246:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13259 00000100:00100000:0.0:1651529344.765253:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.765264:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946546048 00000100:00100000:1.0:1651529344.765274:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212484 00000100:00100000:1.0:1651529344.765276:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1978:39030:x1731745946546048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.765281:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178932 count 1 00010000:00010000:1.0:1651529344.765285:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c52e44 lrc: 3/0,1 mode: --/PW res: [0x2baf4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.765289:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a6b7075e/0x3234de053c4eb1c lrc: 2/0,0 mode: PR/PR res: [0x2baf4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e2d expref: 87 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.765300:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.765301:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.765302:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c52e44 lrc: 4/0,1 mode: --/PW res: [0x2baf4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.765308:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a6b7075e/0x3234de053c4eb1c lrc: 3/0,0 mode: PR/PR res: [0x2baf4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e2d expref: 87 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.765312:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a6b7075e/0x3234de053c4eb1c lrc: 4/0,0 mode: PR/PR res: [0x2baf4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e2d expref: 87 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.765316:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000078a40aa9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997065728:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.765329:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 000000007d8fabda going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.765335:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c52e13 lrc: 3/0,1 mode: PW/PW res: [0x2baed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.765341:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c52e13 lrc: 3/0,1 mode: PW/PW res: [0x2baed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.765344:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c52e13 lrc: 3/0,1 mode: PW/PW res: [0x2baed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.765354:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c52e13 lrc: 2/0,0 mode: PW/PW res: [0x2baed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.765380:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c52e13 lrc: 2/0,0 mode: PW/PW res: [0x2baed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.765384:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000090e99444 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.765386:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c52e13 lrc: 2/0,0 mode: PW/PW res: [0x2baed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.765389:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c52e13 lrc: 3/0,0 mode: PW/PW res: [0x2baed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.765394:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c52e13 lrc: 1/0,0 mode: --/PW res: [0x2baed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.765396:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c52e13 lrc: 0/0,0 mode: --/PW res: [0x2baed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.765398:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1979:39029:x1731745946545600:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 795us (832us total) trans 12885080532 rc 0/0 00000100:00100000:1.0:1651529344.765401:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212477 00000100:00100000:0.0:1651529344.765437:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f7006631 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997065408:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.765442:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52e21 lrc: 3/0,1 mode: --/PW res: [0x2baee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.765449:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f99b3c22 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997065536:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.765450:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e7f02909 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997065344:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.765451:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52e2f lrc: 3/0,1 mode: --/PW res: [0x2baf2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.765454:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c52e1a lrc: 3/0,1 mode: --/PW res: [0x2baef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.765462:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000064719963 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997065472:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.765464:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52e28 lrc: 3/0,1 mode: --/PW res: [0x2baf0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.765586:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.765596:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.765601:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.765623:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.765633:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.765633:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396426816 00010000:00010000:0.0:1651529344.765639:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004bc816c1/0x3234de053c4f484 lrc: 4/0,0 mode: PR/PR res: [0x2baef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84b4 expref: 88 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.765655:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396426880 00000100:00100000:1.0:1651529344.765656:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.765658:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000954bdde0/0x3234de053c4e374 lrc: 4/0,0 mode: PR/PR res: [0x2baee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ed7 expref: 89 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.765661:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.765662:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396426944 00010000:00010000:0.0:1651529344.765665:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009a24dc11/0x3234de053c4bdd4 lrc: 4/0,0 mode: PR/PR res: [0x2baf0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc66b expref: 90 pid: 80276 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.765667:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.765669:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396427008 00010000:00010000:0.0:1651529344.765671:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c4df1b lrc: 4/0,0 mode: PR/PR res: [0x2baf2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d8f expref: 91 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.765673:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396427136 00000100:00100000:0.0:1651529344.765675:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396427072 00010000:00010000:0.0:1651529344.765677:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f8a5f7a5/0x3234de053c4f5bf lrc: 5/0,0 mode: PR/PR res: [0x2baf1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8976 expref: 93 pid: 156655 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.765679:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c01403d2/0x3234de053c4c877 lrc: 5/0,0 mode: PR/PR res: [0x2baf3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd3b5 expref: 93 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.765681:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396427200 00010000:00010000:0.0:1651529344.765684:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a6b7075e/0x3234de053c4eb1c lrc: 5/0,0 mode: PR/PR res: [0x2baf4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e2d expref: 94 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.765685:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13260 00000100:00100000:1.0:1651529344.765687:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+94:41278:x1731746396426816:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.765689:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13261 00010000:00010000:1.0:1651529344.765690:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.765690:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012f61efb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+94:41279:x1731746396426880:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.765691:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004bc816c1/0x3234de053c4f484 lrc: 4/0,0 mode: PR/PR res: [0x2baef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84b4 expref: 94 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.765694:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.765695:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004bc816c1/0x3234de053c4f484 lrc: 3/0,0 mode: PR/PR res: [0x2baef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84b4 expref: 94 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.765695:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000954bdde0/0x3234de053c4e374 lrc: 4/0,0 mode: PR/PR res: [0x2baee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ed7 expref: 94 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.765699:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000954bdde0/0x3234de053c4e374 lrc: 3/0,0 mode: PR/PR res: [0x2baee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ed7 expref: 94 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.765700:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004bc816c1/0x3234de053c4f484 lrc: 0/0,0 mode: --/PR res: [0x2baef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d84b4 expref: 94 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.765704:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.765704:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.765705:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c52e1a lrc: 3/0,1 mode: PW/PW res: [0x2baef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.765705:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000954bdde0/0x3234de053c4e374 lrc: 0/0,0 mode: --/PR res: [0x2baee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d3ed7 expref: 93 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.765708:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c52e1a lrc: 4/0,1 mode: PW/PW res: [0x2baef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.765709:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.765709:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.765710:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52e21 lrc: 3/0,1 mode: PW/PW res: [0x2baee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.765713:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52e21 lrc: 4/0,1 mode: PW/PW res: [0x2baee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.765714:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.765720:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.765726:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+92:41278:x1731746396426816:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 38us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.765729:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13260 00000100:00100000:0.0:1651529344.765733:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012f61efb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+91:41279:x1731746396426880:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.765742:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13262 00000100:00100000:1.0:1651529344.765744:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+91:41278:x1731746396426944:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529344.765746:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13261 00010000:00010000:1.0:1651529344.765747:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.765748:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009a24dc11/0x3234de053c4bdd4 lrc: 4/0,0 mode: PR/PR res: [0x2baf0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc66b expref: 91 pid: 80276 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.765752:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009a24dc11/0x3234de053c4bdd4 lrc: 3/0,0 mode: PR/PR res: [0x2baf0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc66b expref: 90 pid: 80276 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.765756:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13263 00010000:00010000:1.0:1651529344.765758:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a24dc11/0x3234de053c4bdd4 lrc: 0/0,0 mode: --/PR res: [0x2baf0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc66b expref: 90 pid: 80276 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.765758:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+90:41279:x1731746396427008:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.765760:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.765761:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.765762:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.765762:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c4df1b lrc: 4/0,0 mode: PR/PR res: [0x2baf2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d8f expref: 89 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.765763:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52e28 lrc: 3/0,1 mode: PW/PW res: [0x2baf0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.765766:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52e28 lrc: 4/0,1 mode: PW/PW res: [0x2baf0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.765769:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c4df1b lrc: 3/0,0 mode: PR/PR res: [0x2baf2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d8f expref: 89 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.765772:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.765774:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c4df1b lrc: 0/0,0 mode: --/PR res: [0x2baf2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2d8f expref: 89 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.765777:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.765777:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.765778:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+88:41278:x1731746396426944:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 34us (155us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.765778:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52e2f lrc: 3/0,1 mode: PW/PW res: [0x2baf2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.765780:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13262 00010000:00010000:0.0:1651529344.765781:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52e2f lrc: 4/0,1 mode: PW/PW res: [0x2baf2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.765785:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13264 00000100:00100000:1.0:1651529344.765787:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+87:41279:x1731746396427072:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.765788:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.765789:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.765790:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f8a5f7a5/0x3234de053c4f5bf lrc: 5/0,0 mode: PR/PR res: [0x2baf1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8976 expref: 87 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.765793:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+87:41279:x1731746396427008:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (160us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.765794:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f8a5f7a5/0x3234de053c4f5bf lrc: 4/0,0 mode: PR/PR res: [0x2baf1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8976 expref: 87 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.765796:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13263 00010000:00010000:1.0:1651529344.765798:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.765799:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.765799:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52e36 lrc: 3/0,1 mode: PW/PW res: [0x2baf1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.765800:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13265 00010000:00010000:1.0:1651529344.765802:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52e36 lrc: 4/0,1 mode: PW/PW res: [0x2baf1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.765802:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+86:41279:x1731746396427136:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.765804:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.765805:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c01403d2/0x3234de053c4c877 lrc: 5/0,0 mode: PR/PR res: [0x2baf3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd3b5 expref: 86 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.765806:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.765809:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c01403d2/0x3234de053c4c877 lrc: 4/0,0 mode: PR/PR res: [0x2baf3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd3b5 expref: 86 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.765810:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+86:41279:x1731746396427072:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 23us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.765813:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13264 00010000:00010000:0.0:1651529344.765814:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.765814:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.765815:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52e3d lrc: 3/0,1 mode: PW/PW res: [0x2baf3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.765817:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13266 00000100:00100000:1.0:1651529344.765818:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+85:41279:x1731746396427200:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529344.765818:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52e3d lrc: 4/0,1 mode: PW/PW res: [0x2baf3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.765820:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.765822:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a6b7075e/0x3234de053c4eb1c lrc: 5/0,0 mode: PR/PR res: [0x2baf4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e2d expref: 85 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.765822:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.765825:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a6b7075e/0x3234de053c4eb1c lrc: 4/0,0 mode: PR/PR res: [0x2baf4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e2d expref: 85 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.765826:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+85:41279:x1731746396427136:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 24us (170us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.765829:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.765829:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13265 00010000:00010000:1.0:1651529344.765830:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.765831:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c52e44 lrc: 3/0,1 mode: PW/PW res: [0x2baf4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.765833:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c52e44 lrc: 4/0,1 mode: PW/PW res: [0x2baf4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.765837:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.765838:0:156655:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8a5f7a5/0x3234de053c4f5bf lrc: 0/0,0 mode: --/PR res: [0x2baf1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8976 expref: 84 pid: 156655 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.765841:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+83:41279:x1731746396427200:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 22us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.765842:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003562cf4d pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997065600:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.765843:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13266 00010000:00010000:0.0:1651529344.765845:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52e36 lrc: 3/0,1 mode: PW/PW res: [0x2baf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.765849:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52e36 lrc: 3/0,1 mode: PW/PW res: [0x2baf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.765851:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946546112 00010000:00010000:0.0:1651529344.765851:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52e36 lrc: 3/0,1 mode: PW/PW res: [0x2baf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.765854:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52e36 lrc: 3/0,1 mode: PW/PW res: [0x2baf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.765856:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212485 00010000:00010000:0.0:1651529344.765857:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52e36 lrc: 2/0,0 mode: PW/PW res: [0x2baf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.765858:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085af61db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1979:39030:x1731745946546112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.765862:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178933 count 1 00010000:00010000:1.0:1651529344.765866:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c52e4b lrc: 3/0,1 mode: --/PW res: [0x2baf5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.765870:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001b452f61/0x3234de053c4de65 lrc: 2/0,0 mode: PR/PR res: [0x2baf5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a4e expref: 82 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.765873:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.765874:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.765874:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c52e4b lrc: 4/0,1 mode: --/PW res: [0x2baf5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.765883:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001b452f61/0x3234de053c4de65 lrc: 3/0,0 mode: PR/PR res: [0x2baf5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a4e expref: 82 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.765887:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001b452f61/0x3234de053c4de65 lrc: 4/0,0 mode: PR/PR res: [0x2baf5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a4e expref: 82 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.765891:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003e8ef62e pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997065792:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.765903:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1980:39030:x1731745946545856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 806us (876us total) trans 12885080533 rc 0/0 00000100:00100000:0.0:1651529344.765906:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212482 00000100:00100000:1.0:1651529344.765907:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f9dac3f6 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.765916:0:72396:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6b7075e/0x3234de053c4eb1c lrc: 0/0,0 mode: --/PR res: [0x2baf4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5e2d expref: 82 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.765916:0:80276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c01403d2/0x3234de053c4c877 lrc: 0/0,0 mode: --/PR res: [0x2baf3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd3b5 expref: 82 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.765920:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000078a40aa9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997065728:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.765921:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b4acf60d pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997065664:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.765923:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c52e44 lrc: 3/0,1 mode: PW/PW res: [0x2baf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.765924:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52e3d lrc: 3/0,1 mode: PW/PW res: [0x2baf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.765926:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c52e44 lrc: 3/0,1 mode: PW/PW res: [0x2baf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.765928:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52e3d lrc: 3/0,1 mode: PW/PW res: [0x2baf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.765929:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c52e44 lrc: 3/0,1 mode: PW/PW res: [0x2baf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.765930:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52e3d lrc: 3/0,1 mode: PW/PW res: [0x2baf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.765932:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c52e44 lrc: 3/0,1 mode: PW/PW res: [0x2baf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.765933:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52e3d lrc: 3/0,1 mode: PW/PW res: [0x2baf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.765935:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c52e44 lrc: 2/0,0 mode: PW/PW res: [0x2baf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.765936:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52e3d lrc: 2/0,0 mode: PW/PW res: [0x2baf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.765971:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1981:39030:x1731745946545984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 789us (870us total) trans 12885080534 rc 0/0 00000100:00100000:0.0:1651529344.765974:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212483 00000100:00100000:1.0:1651529344.765975:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+1981:39030:x1731745946546048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 698us (721us total) trans 12885080535 rc 0/0 00000100:00100000:1.0:1651529344.765978:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212484 00010000:00010000:0.0:1651529344.765980:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52e21 lrc: 3/0,1 mode: PW/PW res: [0x2baee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.765984:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52e21 lrc: 3/0,1 mode: PW/PW res: [0x2baee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.765985:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c52e1a lrc: 3/0,1 mode: PW/PW res: [0x2baef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.765987:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52e21 lrc: 3/0,1 mode: PW/PW res: [0x2baee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.765989:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c52e1a lrc: 3/0,1 mode: PW/PW res: [0x2baef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.765989:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52e21 lrc: 2/0,0 mode: PW/PW res: [0x2baee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.765992:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c52e1a lrc: 3/0,1 mode: PW/PW res: [0x2baef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.765994:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c52e1a lrc: 2/0,0 mode: PW/PW res: [0x2baef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.766019:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1981:39029:x1731745946545664:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1105us (1176us total) trans 12885080536 rc 0/0 00000100:00100000:0.0:1651529344.766021:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212479 00000100:00100000:1.0:1651529344.766025:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1980:39029:x1731745946545728:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1156us (1193us total) trans 12885080537 rc 0/0 00000100:00100000:1.0:1651529344.766028:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212478 00010000:00010000:0.0:1651529344.766028:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52e36 lrc: 2/0,0 mode: PW/PW res: [0x2baf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.766031:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000877aab61 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.766032:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52e36 lrc: 2/0,0 mode: PW/PW res: [0x2baf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.766034:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52e28 lrc: 3/0,1 mode: PW/PW res: [0x2baf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.766035:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52e36 lrc: 3/0,0 mode: PW/PW res: [0x2baf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.766037:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52e28 lrc: 3/0,1 mode: PW/PW res: [0x2baf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.766039:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52e36 lrc: 1/0,0 mode: --/PW res: [0x2baf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.766040:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52e28 lrc: 3/0,1 mode: PW/PW res: [0x2baf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.766043:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52e36 lrc: 0/0,0 mode: --/PW res: [0x2baf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.766045:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52e28 lrc: 2/0,0 mode: PW/PW res: [0x2baf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.766050:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c52e44 lrc: 2/0,0 mode: PW/PW res: [0x2baf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.766053:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b232c9bb already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.766054:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c52e44 lrc: 2/0,0 mode: PW/PW res: [0x2baf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.766057:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c52e44 lrc: 3/0,0 mode: PW/PW res: [0x2baf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.766060:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c52e44 lrc: 1/0,0 mode: --/PW res: [0x2baf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.766062:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c52e44 lrc: 0/0,0 mode: --/PW res: [0x2baf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.766066:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52e3d lrc: 2/0,0 mode: PW/PW res: [0x2baf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.766069:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000af20b5e7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.766070:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52e3d lrc: 2/0,0 mode: PW/PW res: [0x2baf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.766073:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1980:39029:x1731745946545792:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1142us (1221us total) trans 12885080538 rc 0/0 00010000:00010000:0.0:1651529344.766074:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52e3d lrc: 3/0,0 mode: PW/PW res: [0x2baf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.766076:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212480 00010000:00010000:0.0:1651529344.766078:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52e3d lrc: 1/0,0 mode: --/PW res: [0x2baf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.766080:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52e3d lrc: 0/0,0 mode: --/PW res: [0x2baf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.766083:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52e21 lrc: 2/0,0 mode: PW/PW res: [0x2baee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.766084:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c52e1a lrc: 2/0,0 mode: PW/PW res: [0x2baef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.766086:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000575eb734 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.766086:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000029958df2 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.766087:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52e21 lrc: 2/0,0 mode: PW/PW res: [0x2baee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.766087:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c52e1a lrc: 2/0,0 mode: PW/PW res: [0x2baef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.766090:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52e21 lrc: 3/0,0 mode: PW/PW res: [0x2baee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.766090:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c52e1a lrc: 3/0,0 mode: PW/PW res: [0x2baef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.766093:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c52e1a lrc: 1/0,0 mode: --/PW res: [0x2baef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.766095:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52e21 lrc: 1/0,0 mode: --/PW res: [0x2baee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.766095:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c52e1a lrc: 0/0,0 mode: --/PW res: [0x2baef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.766097:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52e21 lrc: 0/0,0 mode: --/PW res: [0x2baee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.766099:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52e28 lrc: 2/0,0 mode: PW/PW res: [0x2baf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.766104:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e48e0bfd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.766105:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52e28 lrc: 2/0,0 mode: PW/PW res: [0x2baf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.766108:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52e28 lrc: 3/0,0 mode: PW/PW res: [0x2baf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.766111:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52e28 lrc: 1/0,0 mode: --/PW res: [0x2baf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.766113:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c52e28 lrc: 0/0,0 mode: --/PW res: [0x2baf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.766120:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52e2f lrc: 3/0,1 mode: PW/PW res: [0x2baf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.766122:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52e2f lrc: 3/0,1 mode: PW/PW res: [0x2baf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.766125:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52e2f lrc: 3/0,1 mode: PW/PW res: [0x2baf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.766128:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52e2f lrc: 2/0,0 mode: PW/PW res: [0x2baf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.766166:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1980:39030:x1731745946545920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1117us (1164us total) trans 12885080539 rc 0/0 00000100:00100000:0.0:1651529344.766169:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212481 00010000:00010000:1.0:1651529344.766247:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52e2f lrc: 2/0,0 mode: PW/PW res: [0x2baf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.766251:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008ac1e27e already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.766253:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52e2f lrc: 2/0,0 mode: PW/PW res: [0x2baf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.766256:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52e2f lrc: 3/0,0 mode: PW/PW res: [0x2baf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.766260:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52e2f lrc: 1/0,0 mode: --/PW res: [0x2baf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.766263:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52e2f lrc: 0/0,0 mode: --/PW res: [0x2baf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.766276:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.766312:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946546240 00000100:00100000:0.0:1651529344.766323:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212486 00000100:00100000:0.0:1651529344.766325:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1980:39029:x1731745946546240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.766330:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178935 count 1 00000100:00100000:1.0:1651529344.766331:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.766335:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52e52 lrc: 3/0,1 mode: --/PW res: [0x2baf7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.766338:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946546176 00010000:00010000:0.0:1651529344.766340:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e2f3dfe3/0x3234de053c4d05e lrc: 2/0,0 mode: PR/PR res: [0x2baf7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf32e expref: 80 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.766343:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.766343:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.766344:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52e52 lrc: 4/0,1 mode: --/PW res: [0x2baf7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.766346:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212487 00000100:00100000:1.0:1651529344.766347:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1981:39029:x1731745946546176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.766351:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e2f3dfe3/0x3234de053c4d05e lrc: 3/0,0 mode: PR/PR res: [0x2baf7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf32e expref: 80 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529344.766352:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178934 count 1 00010000:00010000:0.0:1651529344.766354:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e2f3dfe3/0x3234de053c4d05e lrc: 4/0,0 mode: PR/PR res: [0x2baf7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf32e expref: 80 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.766356:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c52e59 lrc: 3/0,1 mode: --/PW res: [0x2baf6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.766358:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005912c4a3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997065856:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.766361:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009d236605/0x3234de053c4f4ae lrc: 2/0,0 mode: PR/PR res: [0x2baf6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8540 expref: 80 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.766364:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.766365:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.766365:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c52e59 lrc: 4/0,1 mode: --/PW res: [0x2baf6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.766372:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009d236605/0x3234de053c4f4ae lrc: 3/0,0 mode: PR/PR res: [0x2baf6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8540 expref: 80 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.766376:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009d236605/0x3234de053c4f4ae lrc: 4/0,0 mode: PR/PR res: [0x2baf6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8540 expref: 80 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.766380:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000086eaa330 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997065920:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.766394:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 000000003ad73843 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.766396:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 0000000020dd7827 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.766430:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.766450:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.766459:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.766464:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.766466:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.766476:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.766480:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003e8ef62e pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997065792:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.766483:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946546368 00010000:00010000:1.0:1651529344.766484:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c52e4b lrc: 3/0,1 mode: --/PW res: [0x2baf5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.766489:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946546304 00000100:00100000:1.0:1651529344.766492:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946546432 00000100:00100000:0.0:1651529344.766493:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946546560 00000100:00100000:0.0:1651529344.766499:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946546496 00000100:00100000:0.0:1651529344.766503:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212488 00000100:00100000:0.0:1651529344.766505:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1986:39029:x1731745946546368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.766507:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212489 00000100:00100000:1.0:1651529344.766509:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1986:39029:x1731745946546304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.766510:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178937 count 1 00002000:00080000:1.0:1651529344.766514:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178936 count 1 00010000:00010000:0.0:1651529344.766514:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52e60 lrc: 3/0,1 mode: --/PW res: [0x2baf9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.766518:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c52e67 lrc: 3/0,1 mode: --/PW res: [0x2baf8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.766519:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006dd920d5/0x3234de053c4d0c0 lrc: 2/0,0 mode: PR/PR res: [0x2baf9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf49a expref: 80 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.766522:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b5397e1a/0x3234de053c4d8f4 lrc: 2/0,0 mode: PR/PR res: [0x2baf8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d14de expref: 80 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.766522:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.766522:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.766523:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52e60 lrc: 4/0,1 mode: --/PW res: [0x2baf9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.766525:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.766525:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.766526:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c52e67 lrc: 4/0,1 mode: --/PW res: [0x2baf8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.766530:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006dd920d5/0x3234de053c4d0c0 lrc: 3/0,0 mode: PR/PR res: [0x2baf9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf49a expref: 80 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.766533:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006dd920d5/0x3234de053c4d0c0 lrc: 4/0,0 mode: PR/PR res: [0x2baf9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf49a expref: 80 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.766535:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b5397e1a/0x3234de053c4d8f4 lrc: 3/0,0 mode: PR/PR res: [0x2baf8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d14de expref: 80 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.766537:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000078a40aa9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997065984:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.766539:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b5397e1a/0x3234de053c4d8f4 lrc: 4/0,0 mode: PR/PR res: [0x2baf8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d14de expref: 80 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.766543:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003e8ef62e pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997066048:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.766550:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 0000000070e666f7 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.766556:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212490 00000100:00100000:1.0:1651529344.766558:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 000000007d8fabda going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.766558:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1986:39030:x1731745946546560:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.766563:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178940 count 1 00000100:00100000:1.0:1651529344.766564:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212491 00000100:00100000:1.0:1651529344.766565:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1986:39030:x1731745946546432:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.766566:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52e6e lrc: 3/0,1 mode: --/PW res: [0x2bafc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.766570:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178938 count 1 00010000:00010000:0.0:1651529344.766570:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005af188a3/0x3234de053c4a08b lrc: 2/0,0 mode: PR/PR res: [0x2bafc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7df expref: 80 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.766573:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c52e75 lrc: 3/0,1 mode: --/PW res: [0x2bafa:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.766574:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.766574:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.766575:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52e6e lrc: 4/0,1 mode: --/PW res: [0x2bafc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.766577:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c4cc2f lrc: 2/0,0 mode: PR/PR res: [0x2bafa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce279 expref: 80 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.766580:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.766581:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.766581:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005af188a3/0x3234de053c4a08b lrc: 3/0,0 mode: PR/PR res: [0x2bafc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7df expref: 80 pid: 72397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.766582:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c52e75 lrc: 4/0,1 mode: --/PW res: [0x2bafa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.766584:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005af188a3/0x3234de053c4a08b lrc: 4/0,0 mode: PR/PR res: [0x2bafc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7df expref: 80 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.766588:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c4cc2f lrc: 3/0,0 mode: PR/PR res: [0x2bafa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce279 expref: 80 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529344.766588:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006929eb96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997066112:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.766592:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c4cc2f lrc: 4/0,0 mode: PR/PR res: [0x2bafa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce279 expref: 80 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.766595:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000504ef660 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.766596:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000075b025a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997066176:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.766600:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212492 00000100:00100000:0.0:1651529344.766602:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009faff76b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1986:39030:x1731745946546496:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529344.766603:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a4eb401d going to sleep for 6 seconds 00002000:00080000:0.0:1651529344.766606:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178939 count 1 00000100:00100000:1.0:1651529344.766608:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396427264 00010000:00010000:0.0:1651529344.766609:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52e7c lrc: 3/0,1 mode: --/PW res: [0x2bafb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.766612:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001b452f61/0x3234de053c4de65 lrc: 4/0,0 mode: PR/PR res: [0x2baf5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a4e expref: 81 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.766619:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13267 00000100:00100000:1.0:1651529344.766621:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+81:41278:x1731746396427264:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.766624:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.766625:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001b452f61/0x3234de053c4de65 lrc: 4/0,0 mode: PR/PR res: [0x2baf5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a4e expref: 81 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.766629:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001b452f61/0x3234de053c4de65 lrc: 3/0,0 mode: PR/PR res: [0x2baf5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a4e expref: 81 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.766633:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000060fa75d6/0x3234de053c4f510 lrc: 2/0,0 mode: PR/PR res: [0x2bafb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d86ba expref: 81 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.766634:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b452f61/0x3234de053c4de65 lrc: 0/0,0 mode: --/PR res: [0x2baf5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d2a4e expref: 81 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.766637:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.766637:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.766638:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.766638:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.766639:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c52e4b lrc: 3/0,1 mode: PW/PW res: [0x2baf5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.766639:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52e7c lrc: 4/0,1 mode: --/PW res: [0x2bafb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.766642:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c52e4b lrc: 4/0,1 mode: PW/PW res: [0x2baf5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.766646:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000060fa75d6/0x3234de053c4f510 lrc: 3/0,0 mode: PR/PR res: [0x2bafb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d86ba expref: 80 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.766649:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000060fa75d6/0x3234de053c4f510 lrc: 4/0,0 mode: PR/PR res: [0x2bafb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d86ba expref: 80 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.766650:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.766653:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003562cf4d pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997066240:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.766655:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+80:41278:x1731746396427264:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 33us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.766658:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13267 00000100:00100000:0.0:1651529344.766661:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bff8744a going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.766666:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c52e4b lrc: 3/0,1 mode: PW/PW res: [0x2baf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.766669:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c52e4b lrc: 3/0,1 mode: PW/PW res: [0x2baf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.766672:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c52e4b lrc: 3/0,1 mode: PW/PW res: [0x2baf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.766675:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c52e4b lrc: 2/0,0 mode: PW/PW res: [0x2baf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.766714:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.766727:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.766752:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085af61db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1987:39030:x1731745946546112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 893us (1152us total) trans 12885080540 rc 0/0 00000100:00100000:1.0:1651529344.766755:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212485 00000100:00100000:1.0:1651529344.766769:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396427328 00010000:00010000:1.0:1651529344.766777:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e2f3dfe3/0x3234de053c4d05e lrc: 5/0,0 mode: PR/PR res: [0x2baf7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf32e expref: 80 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.766780:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c52e4b lrc: 2/0,0 mode: PW/PW res: [0x2baf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.766784:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a9b4b5b4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.766786:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c52e4b lrc: 2/0,0 mode: PW/PW res: [0x2baf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.766789:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c52e4b lrc: 3/0,0 mode: PW/PW res: [0x2baf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.766791:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396427392 00010000:00010000:1.0:1651529344.766794:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009d236605/0x3234de053c4f4ae lrc: 5/0,0 mode: PR/PR res: [0x2baf6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8540 expref: 81 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.766794:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c52e4b lrc: 1/0,0 mode: --/PW res: [0x2baf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.766797:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c52e4b lrc: 0/0,0 mode: --/PW res: [0x2baf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.766806:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13268 00000100:00100000:1.0:1651529344.766808:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001cec52dd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+81:41278:x1731746396427328:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.766811:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.766812:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e2f3dfe3/0x3234de053c4d05e lrc: 5/0,0 mode: PR/PR res: [0x2baf7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf32e expref: 81 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.766816:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e2f3dfe3/0x3234de053c4d05e lrc: 4/0,0 mode: PR/PR res: [0x2baf7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf32e expref: 81 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.766822:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.766822:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.766823:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52e52 lrc: 3/0,1 mode: PW/PW res: [0x2baf7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.766826:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52e52 lrc: 4/0,1 mode: PW/PW res: [0x2baf7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.766828:0:80281:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2f3dfe3/0x3234de053c4d05e lrc: 0/0,0 mode: --/PR res: [0x2baf7:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf32e expref: 81 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.766831:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.766832:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005912c4a3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997065856:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.766836:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52e52 lrc: 3/0,1 mode: PW/PW res: [0x2baf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.766841:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001cec52dd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+80:41278:x1731746396427328:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 32us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.766844:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13268 00010000:00010000:0.0:1651529344.766845:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52e52 lrc: 3/0,1 mode: PW/PW res: [0x2baf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.766848:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52e52 lrc: 3/0,1 mode: PW/PW res: [0x2baf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.766853:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13269 00000100:00100000:1.0:1651529344.766854:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+79:41279:x1731746396427392:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.766857:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.766858:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009d236605/0x3234de053c4f4ae lrc: 5/0,0 mode: PR/PR res: [0x2baf6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8540 expref: 79 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.766860:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52e52 lrc: 3/0,1 mode: PW/PW res: [0x2baf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.766862:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009d236605/0x3234de053c4f4ae lrc: 4/0,0 mode: PR/PR res: [0x2baf6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8540 expref: 79 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.766863:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52e52 lrc: 2/0,0 mode: PW/PW res: [0x2baf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.766867:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.766867:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.766868:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c52e59 lrc: 3/0,1 mode: PW/PW res: [0x2baf6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.766871:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c52e59 lrc: 4/0,1 mode: PW/PW res: [0x2baf6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.766875:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.766879:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+79:41279:x1731746396427392:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 24us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.766882:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13269 00010000:00010000:1.0:1651529344.766891:0:80277:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d236605/0x3234de053c4f4ae lrc: 0/0,0 mode: --/PR res: [0x2baf6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d8540 expref: 78 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.766895:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000086eaa330 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997065920:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.766899:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c52e59 lrc: 3/0,1 mode: PW/PW res: [0x2baf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.766902:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c52e59 lrc: 3/0,1 mode: PW/PW res: [0x2baf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.766905:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c52e59 lrc: 3/0,1 mode: PW/PW res: [0x2baf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.766908:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c52e59 lrc: 3/0,1 mode: PW/PW res: [0x2baf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.766911:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c52e59 lrc: 2/0,0 mode: PW/PW res: [0x2baf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.766921:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1987:39029:x1731745946546240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 595us (645us total) trans 12885080541 rc 0/0 00000100:00100000:0.0:1651529344.766925:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212486 00010000:00010000:0.0:1651529344.766932:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52e52 lrc: 2/0,0 mode: PW/PW res: [0x2baf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.766936:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f183a40b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.766937:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52e52 lrc: 2/0,0 mode: PW/PW res: [0x2baf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.766940:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52e52 lrc: 3/0,0 mode: PW/PW res: [0x2baf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.766944:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52e52 lrc: 1/0,0 mode: --/PW res: [0x2baf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.766947:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52e52 lrc: 0/0,0 mode: --/PW res: [0x2baf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.766948:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1987:39029:x1731745946546176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 599us (617us total) trans 12885080542 rc 0/0 00000100:00100000:1.0:1651529344.766951:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212487 00010000:00010000:0.0:1651529344.766952:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c52e59 lrc: 2/0,0 mode: PW/PW res: [0x2baf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.766954:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d09e97cf already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.766955:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c52e59 lrc: 2/0,0 mode: PW/PW res: [0x2baf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.766958:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c52e59 lrc: 3/0,0 mode: PW/PW res: [0x2baf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.766963:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c52e59 lrc: 1/0,0 mode: --/PW res: [0x2baf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.766966:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c52e59 lrc: 0/0,0 mode: --/PW res: [0x2baf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.766983:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000078a40aa9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997065984:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.766985:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.766987:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52e60 lrc: 3/0,1 mode: --/PW res: [0x2baf9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.767056:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003e8ef62e pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997066048:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.767060:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c52e67 lrc: 3/0,1 mode: --/PW res: [0x2baf8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.767067:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946546624 00000100:00100000:0.0:1651529344.767071:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006929eb96 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997066112:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.767078:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212493 00000100:00100000:1.0:1651529344.767080:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1987:39029:x1731745946546624:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.767081:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52e6e lrc: 3/0,1 mode: --/PW res: [0x2bafc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.767085:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178941 count 1 00010000:00010000:1.0:1651529344.767088:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c52e83 lrc: 3/0,1 mode: --/PW res: [0x2bafd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.767093:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009dd2ec76/0x3234de053c4f120 lrc: 2/0,0 mode: PR/PR res: [0x2bafd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7708 expref: 77 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.767096:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.767096:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.767097:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c52e83 lrc: 4/0,1 mode: --/PW res: [0x2bafd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.767104:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009dd2ec76/0x3234de053c4f120 lrc: 3/0,0 mode: PR/PR res: [0x2bafd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7708 expref: 77 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.767107:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009dd2ec76/0x3234de053c4f120 lrc: 4/0,0 mode: PR/PR res: [0x2bafd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7708 expref: 77 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.767111:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006aa45e66 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997066304:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.767122:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aeda71fe going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.767151:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000075b025a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997066176:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.767155:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c52e75 lrc: 3/0,1 mode: --/PW res: [0x2bafa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.767183:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.767191:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.767198:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.767202:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003562cf4d pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997066240:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.767205:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.767206:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52e7c lrc: 3/0,1 mode: --/PW res: [0x2bafb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.767213:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.767219:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946546688 00000100:00100000:1.0:1651529344.767220:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.767244:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.767253:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946546752 00000100:00100000:1.0:1651529344.767256:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396427520 00000100:00100000:0.0:1651529344.767262:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212494 00000100:00100000:0.0:1651529344.767264:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1989:39030:x1731745946546688:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.767267:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b5397e1a/0x3234de053c4d8f4 lrc: 4/0,0 mode: PR/PR res: [0x2baf8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d14de expref: 78 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:0.0:1651529344.767269:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178942 count 1 00000100:00100000:1.0:1651529344.767273:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396427456 00010000:00010000:0.0:1651529344.767274:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52e8a lrc: 3/0,1 mode: --/PW res: [0x2bafe:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.767275:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006dd920d5/0x3234de053c4d0c0 lrc: 4/0,0 mode: PR/PR res: [0x2baf9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf49a expref: 79 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.767278:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003c064b9c/0x3234de053c4ef4b lrc: 2/0,0 mode: PR/PR res: [0x2bafe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f1a expref: 79 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.767279:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396427648 00010000:00010000:1.0:1651529344.767281:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c4cc2f lrc: 4/0,0 mode: PR/PR res: [0x2bafa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce279 expref: 80 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.767281:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.767282:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.767283:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52e8a lrc: 4/0,1 mode: --/PW res: [0x2bafe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.767285:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396427584 00010000:00010000:1.0:1651529344.767286:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005af188a3/0x3234de053c4a08b lrc: 4/0,0 mode: PR/PR res: [0x2bafc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7df expref: 81 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.767289:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003c064b9c/0x3234de053c4ef4b lrc: 3/0,0 mode: PR/PR res: [0x2bafe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f1a expref: 81 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.767290:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396427712 00010000:00010000:1.0:1651529344.767292:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000060fa75d6/0x3234de053c4f510 lrc: 4/0,0 mode: PR/PR res: [0x2bafb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d86ba expref: 82 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.767293:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003c064b9c/0x3234de053c4ef4b lrc: 4/0,0 mode: PR/PR res: [0x2bafe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f1a expref: 82 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.767297:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13270 00000100:00100000:1.0:1651529344.767298:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+82:41279:x1731746396427520:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.767301:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.767302:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b5397e1a/0x3234de053c4d8f4 lrc: 4/0,0 mode: PR/PR res: [0x2baf8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d14de expref: 82 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.767305:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b5397e1a/0x3234de053c4d8f4 lrc: 3/0,0 mode: PR/PR res: [0x2baf8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d14de expref: 82 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.767313:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003562cf4d pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997066368:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.767317:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5397e1a/0x3234de053c4d8f4 lrc: 0/0,0 mode: --/PR res: [0x2baf8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d14de expref: 82 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.767321:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.767321:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.767322:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c52e67 lrc: 3/0,1 mode: PW/PW res: [0x2baf8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.767323:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 0000000070e666f7 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.767325:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c52e67 lrc: 4/0,1 mode: PW/PW res: [0x2baf8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.767330:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212495 00010000:00010000:1.0:1651529344.767331:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.767332:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1989:39030:x1731745946546752:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.767337:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178943 count 1 00000100:00100000:1.0:1651529344.767338:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+81:41279:x1731746396427520:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 39us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.767340:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13270 00010000:00010000:0.0:1651529344.767341:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c52e91 lrc: 3/0,1 mode: --/PW res: [0x2baff:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.767345:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13271 00010000:00010000:0.0:1651529344.767345:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2327a81/0x3234de053c4d7a4 lrc: 2/0,0 mode: PR/PR res: [0x2baff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d102a expref: 80 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.767346:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+80:41278:x1731746396427456:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.767348:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.767349:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.767349:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.767350:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006dd920d5/0x3234de053c4d0c0 lrc: 4/0,0 mode: PR/PR res: [0x2baf9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf49a expref: 80 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.767350:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c52e91 lrc: 4/0,1 mode: --/PW res: [0x2baff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.767354:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006dd920d5/0x3234de053c4d0c0 lrc: 3/0,0 mode: PR/PR res: [0x2baf9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf49a expref: 80 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.767356:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c2327a81/0x3234de053c4d7a4 lrc: 3/0,0 mode: PR/PR res: [0x2baff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d102a expref: 80 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.767359:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006dd920d5/0x3234de053c4d0c0 lrc: 0/0,0 mode: --/PR res: [0x2baf9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cf49a expref: 80 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.767359:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c2327a81/0x3234de053c4d7a4 lrc: 4/0,0 mode: PR/PR res: [0x2baff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d102a expref: 80 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.767363:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.767363:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.767363:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f7006631 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997066432:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.767364:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52e60 lrc: 3/0,1 mode: PW/PW res: [0x2baf9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.767369:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52e60 lrc: 4/0,1 mode: PW/PW res: [0x2baf9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.767369:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 000000000e7e66c4 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.767375:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13272 00010000:00010000:1.0:1651529344.767379:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.767383:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+79:41279:x1731746396427648:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.767385:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+79:41278:x1731746396427456:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 38us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.767387:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13271 00010000:00010000:0.0:1651529344.767387:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.767388:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c4cc2f lrc: 4/0,0 mode: PR/PR res: [0x2bafa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce279 expref: 79 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.767391:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13273 00010000:00010000:0.0:1651529344.767392:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c4cc2f lrc: 3/0,0 mode: PR/PR res: [0x2bafa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce279 expref: 78 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.767393:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+78:41278:x1731746396427584:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.767395:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.767396:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005af188a3/0x3234de053c4a08b lrc: 4/0,0 mode: PR/PR res: [0x2bafc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7df expref: 78 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.767399:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c4cc2f lrc: 0/0,0 mode: --/PR res: [0x2bafa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2ce279 expref: 78 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.767400:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005af188a3/0x3234de053c4a08b lrc: 3/0,0 mode: PR/PR res: [0x2bafc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7df expref: 78 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.767402:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.767403:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.767404:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c52e75 lrc: 3/0,1 mode: PW/PW res: [0x2bafa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.767405:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005af188a3/0x3234de053c4a08b lrc: 0/0,0 mode: --/PR res: [0x2bafc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cb7df expref: 77 pid: 72397 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.767408:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.767409:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.767409:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52e6e lrc: 3/0,1 mode: PW/PW res: [0x2bafc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.767409:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c52e75 lrc: 4/0,1 mode: PW/PW res: [0x2bafa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.767412:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52e6e lrc: 4/0,1 mode: PW/PW res: [0x2bafc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.767419:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.767425:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+76:41279:x1731746396427648:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 48us (227us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.767429:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.767433:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13272 00000100:00100000:1.0:1651529344.767435:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+76:41278:x1731746396427584:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.767438:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13273 00000100:00100000:0.0:1651529344.767439:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13274 00000100:00100000:0.0:1651529344.767441:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+74:41278:x1731746396427712:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.767444:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.767445:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000060fa75d6/0x3234de053c4f510 lrc: 4/0,0 mode: PR/PR res: [0x2bafb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d86ba expref: 74 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.767449:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000060fa75d6/0x3234de053c4f510 lrc: 3/0,0 mode: PR/PR res: [0x2bafb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d86ba expref: 74 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.767450:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c52e67 lrc: 3/0,1 mode: PW/PW res: [0x2baf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.767453:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c52e67 lrc: 3/0,1 mode: PW/PW res: [0x2baf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.767454:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060fa75d6/0x3234de053c4f510 lrc: 0/0,0 mode: --/PR res: [0x2bafb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d86ba expref: 74 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.767456:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c52e67 lrc: 3/0,1 mode: PW/PW res: [0x2baf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.767458:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.767458:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.767459:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c52e67 lrc: 2/0,0 mode: PW/PW res: [0x2baf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.767459:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52e7c lrc: 3/0,1 mode: PW/PW res: [0x2bafb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.767462:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52e7c lrc: 4/0,1 mode: PW/PW res: [0x2bafb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.767475:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.767481:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+73:41278:x1731746396427712:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 39us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.767483:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13274 00010000:00010000:0.0:1651529344.767490:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52e60 lrc: 3/0,1 mode: PW/PW res: [0x2baf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.767493:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52e60 lrc: 3/0,1 mode: PW/PW res: [0x2baf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.767496:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52e60 lrc: 3/0,1 mode: PW/PW res: [0x2baf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.767499:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52e60 lrc: 2/0,0 mode: PW/PW res: [0x2baf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.767500:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+1990:39029:x1731745946546304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 990us (1049us total) trans 12885080543 rc 0/0 00000100:00100000:1.0:1651529344.767502:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212489 00010000:00010000:1.0:1651529344.767515:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c52e75 lrc: 3/0,1 mode: PW/PW res: [0x2bafa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.767519:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c52e75 lrc: 3/0,1 mode: PW/PW res: [0x2bafa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.767522:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c52e75 lrc: 3/0,1 mode: PW/PW res: [0x2bafa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.767525:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c52e75 lrc: 2/0,0 mode: PW/PW res: [0x2bafa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.767548:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1991:39029:x1731745946546368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1042us (1118us total) trans 12885080544 rc 0/0 00000100:00100000:0.0:1651529344.767551:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212488 00010000:00010000:0.0:1651529344.767558:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c52e67 lrc: 2/0,0 mode: PW/PW res: [0x2baf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.767562:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f1a88dd0 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529344.767563:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1990:39030:x1731745946546432:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 997us (1103us total) trans 12885080545 rc 0/0 00010000:00010000:0.0:1651529344.767563:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c52e67 lrc: 2/0,0 mode: PW/PW res: [0x2baf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.767566:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212491 00010000:00010000:0.0:1651529344.767568:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c52e67 lrc: 3/0,0 mode: PW/PW res: [0x2baf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.767573:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52e60 lrc: 2/0,0 mode: PW/PW res: [0x2baf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.767573:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c52e67 lrc: 1/0,0 mode: --/PW res: [0x2baf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.767575:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c52e67 lrc: 0/0,0 mode: --/PW res: [0x2baf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.767576:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009e44ce9d already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.767577:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52e60 lrc: 2/0,0 mode: PW/PW res: [0x2baf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.767580:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52e60 lrc: 3/0,0 mode: PW/PW res: [0x2baf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.767580:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c52e75 lrc: 2/0,0 mode: PW/PW res: [0x2bafa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.767582:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027775c45 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.767583:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c52e75 lrc: 2/0,0 mode: PW/PW res: [0x2bafa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.767585:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52e60 lrc: 1/0,0 mode: --/PW res: [0x2baf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.767586:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c52e75 lrc: 3/0,0 mode: PW/PW res: [0x2bafa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.767587:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52e60 lrc: 0/0,0 mode: --/PW res: [0x2baf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.767589:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c52e75 lrc: 1/0,0 mode: --/PW res: [0x2bafa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.767592:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c52e75 lrc: 0/0,0 mode: --/PW res: [0x2bafa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.767598:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006aa45e66 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997066304:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.767599:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52e6e lrc: 3/0,1 mode: PW/PW res: [0x2bafc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.767601:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c52e83 lrc: 3/0,1 mode: --/PW res: [0x2bafd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.767602:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52e6e lrc: 3/0,1 mode: PW/PW res: [0x2bafc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.767605:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52e6e lrc: 3/0,1 mode: PW/PW res: [0x2bafc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.767607:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52e6e lrc: 2/0,0 mode: PW/PW res: [0x2bafc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.767637:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.767653:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1990:39030:x1731745946546560:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1087us (1180us total) trans 12885080546 rc 0/0 00000100:00100000:0.0:1651529344.767656:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212490 00010000:00010000:0.0:1651529344.767663:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52e7c lrc: 3/0,1 mode: PW/PW res: [0x2bafb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.767666:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52e7c lrc: 3/0,1 mode: PW/PW res: [0x2bafb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.767669:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52e7c lrc: 3/0,1 mode: PW/PW res: [0x2bafb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.767671:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52e7c lrc: 2/0,0 mode: PW/PW res: [0x2bafb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.767704:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009faff76b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1990:39030:x1731745946546496:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1101us (1227us total) trans 12885080547 rc 0/0 00000100:00100000:0.0:1651529344.767708:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212492 00010000:00010000:0.0:1651529344.767727:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52e6e lrc: 2/0,0 mode: PW/PW res: [0x2bafc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.767743:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52e7c lrc: 2/0,0 mode: PW/PW res: [0x2bafb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.767748:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003551d5d1 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.767749:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52e7c lrc: 2/0,0 mode: PW/PW res: [0x2bafb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.767752:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52e7c lrc: 3/0,0 mode: PW/PW res: [0x2bafb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.767757:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52e7c lrc: 1/0,0 mode: --/PW res: [0x2bafb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.767758:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003c075ac0 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.767759:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52e7c lrc: 0/0,0 mode: --/PW res: [0x2bafb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.767760:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52e6e lrc: 2/0,0 mode: PW/PW res: [0x2bafc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.767763:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52e6e lrc: 3/0,0 mode: PW/PW res: [0x2bafc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.767768:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52e6e lrc: 1/0,0 mode: --/PW res: [0x2bafc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.767770:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52e6e lrc: 0/0,0 mode: --/PW res: [0x2bafc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.767783:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396427776 00010000:00010000:0.0:1651529344.767787:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009dd2ec76/0x3234de053c4f120 lrc: 4/0,0 mode: PR/PR res: [0x2bafd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7708 expref: 73 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.767811:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13275 00000100:00100000:0.0:1651529344.767813:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000011803d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+73:41278:x1731746396427776:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.767816:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.767817:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009dd2ec76/0x3234de053c4f120 lrc: 4/0,0 mode: PR/PR res: [0x2bafd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7708 expref: 73 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.767824:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009dd2ec76/0x3234de053c4f120 lrc: 3/0,0 mode: PR/PR res: [0x2bafd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7708 expref: 73 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.767857:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.767882:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009dd2ec76/0x3234de053c4f120 lrc: 0/0,0 mode: --/PR res: [0x2bafd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7708 expref: 73 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.767887:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.767887:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.767888:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c52e83 lrc: 3/0,1 mode: PW/PW res: [0x2bafd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.767890:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.767891:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c52e83 lrc: 4/0,1 mode: PW/PW res: [0x2bafd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.767906:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.767908:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c52e83 lrc: 3/0,1 mode: PW/PW res: [0x2bafd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.767912:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c52e83 lrc: 3/0,1 mode: PW/PW res: [0x2bafd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.767917:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000011803d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+72:41278:x1731746396427776:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 104us (281us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.767920:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c52e83 lrc: 3/0,1 mode: PW/PW res: [0x2bafd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.767920:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13275 00010000:00010000:1.0:1651529344.767923:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c52e83 lrc: 2/0,0 mode: PW/PW res: [0x2bafd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.767949:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c52e83 lrc: 2/0,0 mode: PW/PW res: [0x2bafd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.767953:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c5d6b959 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.767954:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c52e83 lrc: 2/0,0 mode: PW/PW res: [0x2bafd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.767957:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c52e83 lrc: 3/0,0 mode: PW/PW res: [0x2bafd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.767962:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c52e83 lrc: 1/0,0 mode: --/PW res: [0x2bafd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.767965:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1990:39029:x1731745946546624:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 885us (981us total) trans 12885080548 rc 0/0 00010000:00010000:0.0:1651529344.767965:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c52e83 lrc: 0/0,0 mode: --/PW res: [0x2bafd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.767968:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212493 00000100:00100000:1.0:1651529344.767973:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946546816 00000100:00100000:0.0:1651529344.767975:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f7006631 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997066432:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.767979:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946546880 00010000:00010000:0.0:1651529344.767979:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c52e91 lrc: 3/0,1 mode: --/PW res: [0x2baff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.767987:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212496 00000100:00100000:1.0:1651529344.767989:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1991:39030:x1731745946546816:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.767994:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178944 count 1 00000100:00100000:0.0:1651529344.767994:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212497 00000100:00100000:0.0:1651529344.767995:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1991:39030:x1731745946546880:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.767998:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c52e98 lrc: 3/0,1 mode: --/PW res: [0x2bb00:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.768001:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178945 count 1 00010000:00010000:1.0:1651529344.768002:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000863dbb4c/0x3234de053c4e653 lrc: 2/0,0 mode: PR/PR res: [0x2bb00:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a3e expref: 71 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.768005:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c52e9f lrc: 3/0,1 mode: --/PW res: [0x2bb01:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.768006:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.768006:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.768007:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c52e98 lrc: 4/0,1 mode: --/PW res: [0x2bb00:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.768009:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002ff5da99/0x3234de053c4f024 lrc: 2/0,0 mode: PR/PR res: [0x2bb01:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d735e expref: 71 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.768012:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.768012:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.768013:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000863dbb4c/0x3234de053c4e653 lrc: 3/0,0 mode: PR/PR res: [0x2bb00:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a3e expref: 71 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.768013:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c52e9f lrc: 4/0,1 mode: --/PW res: [0x2bb01:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.768017:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000863dbb4c/0x3234de053c4e653 lrc: 4/0,0 mode: PR/PR res: [0x2bb00:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a3e expref: 71 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.768020:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002ff5da99/0x3234de053c4f024 lrc: 3/0,0 mode: PR/PR res: [0x2bb01:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d735e expref: 71 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.768021:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000673bcbe2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997066496:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.768026:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002ff5da99/0x3234de053c4f024 lrc: 4/0,0 mode: PR/PR res: [0x2bb01:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d735e expref: 71 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.768029:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f9dac3f6 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.768030:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f7006631 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997066560:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.768038:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000000e7e66c4 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.768048:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003562cf4d pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997066368:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.768051:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52e8a lrc: 3/0,1 mode: --/PW res: [0x2bafe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.768063:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.768064:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.768103:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.768116:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.768131:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946547008 00000100:00100000:1.0:1651529344.768132:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.768142:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946546944 00000100:00100000:0.0:1651529344.768147:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946547072 00000100:00100000:1.0:1651529344.768149:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396427904 00000100:00100000:0.0:1651529344.768153:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212498 00000100:00100000:0.0:1651529344.768155:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1994:39029:x1731745946547008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.768159:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c2327a81/0x3234de053c4d7a4 lrc: 4/0,0 mode: PR/PR res: [0x2baff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d102a expref: 72 pid: 80279 timeout: 20103 lvb_type: 1 00002000:00080000:0.0:1651529344.768160:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178947 count 1 00010000:00010000:0.0:1651529344.768164:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52ea6 lrc: 3/0,1 mode: --/PW res: [0x2bb03:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.768167:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396427840 00010000:00010000:0.0:1651529344.768168:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004df6544e/0x3234de053c4f2af lrc: 2/0,0 mode: PR/PR res: [0x2bb03:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d9f expref: 73 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.768169:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003c064b9c/0x3234de053c4ef4b lrc: 4/0,0 mode: PR/PR res: [0x2bafe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f1a expref: 73 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.768171:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.768172:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.768173:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52ea6 lrc: 4/0,1 mode: --/PW res: [0x2bb03:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.768175:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13276 00000100:00100000:1.0:1651529344.768176:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+73:41279:x1731746396427904:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.768179:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.768179:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004df6544e/0x3234de053c4f2af lrc: 3/0,0 mode: PR/PR res: [0x2bb03:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d9f expref: 73 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.768180:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c2327a81/0x3234de053c4d7a4 lrc: 4/0,0 mode: PR/PR res: [0x2baff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d102a expref: 73 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.768183:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004df6544e/0x3234de053c4f2af lrc: 4/0,0 mode: PR/PR res: [0x2bb03:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d9f expref: 73 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.768184:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c2327a81/0x3234de053c4d7a4 lrc: 3/0,0 mode: PR/PR res: [0x2baff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d102a expref: 73 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.768187:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d9ef3c1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997066624:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.768190:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2327a81/0x3234de053c4d7a4 lrc: 0/0,0 mode: --/PR res: [0x2baff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d102a expref: 73 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.768196:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.768197:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.768198:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c52e91 lrc: 3/0,1 mode: PW/PW res: [0x2baff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.768201:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c52e91 lrc: 4/0,1 mode: PW/PW res: [0x2baff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.768211:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.768218:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+72:41279:x1731746396427904:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 41us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.768240:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e68b7e1f going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.768245:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c52e91 lrc: 3/0,1 mode: PW/PW res: [0x2baff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.768249:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13276 00010000:00010000:0.0:1651529344.768249:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c52e91 lrc: 3/0,1 mode: PW/PW res: [0x2baff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.768252:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c52e91 lrc: 3/0,1 mode: PW/PW res: [0x2baff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.768253:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13277 00010000:00010000:0.0:1651529344.768254:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c52e91 lrc: 2/0,0 mode: PW/PW res: [0x2baff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.768255:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+71:41279:x1731746396427840:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.768258:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.768260:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003c064b9c/0x3234de053c4ef4b lrc: 4/0,0 mode: PR/PR res: [0x2bafe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f1a expref: 71 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.768269:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003c064b9c/0x3234de053c4ef4b lrc: 3/0,0 mode: PR/PR res: [0x2bafe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f1a expref: 71 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.768275:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c064b9c/0x3234de053c4ef4b lrc: 0/0,0 mode: --/PR res: [0x2bafe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d6f1a expref: 71 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.768278:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.768279:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.768280:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52e8a lrc: 3/0,1 mode: PW/PW res: [0x2bafe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.768283:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52e8a lrc: 4/0,1 mode: PW/PW res: [0x2bafe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.768292:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.768297:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+70:41279:x1731746396427840:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.768300:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13277 00000100:00100000:0.0:1651529344.768304:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1995:39030:x1731745946546752:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 971us (1083us total) trans 12885080549 rc 0/0 00000100:00100000:1.0:1651529344.768307:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212499 00000100:00100000:1.0:1651529344.768309:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1995:39029:x1731745946546944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.768309:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212495 00002000:00080000:1.0:1651529344.768314:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178946 count 1 00000100:00100000:0.0:1651529344.768315:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212500 00000100:00100000:0.0:1651529344.768316:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1994:39029:x1731745946547072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.768317:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c52ead lrc: 3/0,1 mode: --/PW res: [0x2bb02:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.768321:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178948 count 1 00010000:00010000:1.0:1651529344.768322:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000569be69/0x3234de053c4d279 lrc: 2/0,0 mode: PR/PR res: [0x2bb02:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb5b expref: 69 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.768325:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.768325:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c52eb4 lrc: 3/0,1 mode: --/PW res: [0x2bb04:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.768326:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.768326:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c52ead lrc: 4/0,1 mode: --/PW res: [0x2bb02:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.768332:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000569be69/0x3234de053c4d279 lrc: 3/0,0 mode: PR/PR res: [0x2bb02:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb5b expref: 69 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.768336:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000569be69/0x3234de053c4d279 lrc: 4/0,0 mode: PR/PR res: [0x2bb02:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb5b expref: 69 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.768340:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000057329b82 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997066688:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.768346:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c09304f9/0x3234de053c4d543 lrc: 2/0,0 mode: PR/PR res: [0x2bb04:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d06f3 expref: 69 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.768348:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000020dd7827 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.768349:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.768350:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.768351:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c52eb4 lrc: 4/0,1 mode: --/PW res: [0x2bb04:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.768356:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c52e91 lrc: 2/0,0 mode: PW/PW res: [0x2baff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.768358:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c09304f9/0x3234de053c4d543 lrc: 3/0,0 mode: PR/PR res: [0x2bb04:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d06f3 expref: 69 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.768359:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000096ab8041 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.768360:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c52e91 lrc: 2/0,0 mode: PW/PW res: [0x2baff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.768362:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c09304f9/0x3234de053c4d543 lrc: 4/0,0 mode: PR/PR res: [0x2bb04:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d06f3 expref: 69 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.768363:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c52e91 lrc: 3/0,0 mode: PW/PW res: [0x2baff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.768366:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a925fbf6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997066752:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.768367:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c52e91 lrc: 1/0,0 mode: --/PW res: [0x2baff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.768370:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c52e91 lrc: 0/0,0 mode: --/PW res: [0x2baff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.768374:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000504ef660 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.768380:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52e8a lrc: 3/0,1 mode: PW/PW res: [0x2bafe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.768383:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52e8a lrc: 3/0,1 mode: PW/PW res: [0x2bafe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.768386:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.768386:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52e8a lrc: 3/0,1 mode: PW/PW res: [0x2bafe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.768398:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52e8a lrc: 2/0,0 mode: PW/PW res: [0x2bafe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.768435:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1995:39030:x1731745946546688:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1170us (1229us total) trans 12885080550 rc 0/0 00000100:00100000:0.0:1651529344.768438:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212494 00000100:00100000:0.0:1651529344.768443:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946547136 00000100:00100000:0.0:1651529344.768454:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212501 00000100:00100000:0.0:1651529344.768455:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1995:39030:x1731745946547136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.768466:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178949 count 1 00010000:00010000:0.0:1651529344.768470:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c52ebb lrc: 3/0,1 mode: --/PW res: [0x2bb05:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.768475:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000077e9697/0x3234de053c4d933 lrc: 2/0,0 mode: PR/PR res: [0x2bb05:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1578 expref: 69 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.768478:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.768478:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.768479:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c52ebb lrc: 4/0,1 mode: --/PW res: [0x2bb05:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.768484:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.768485:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000077e9697/0x3234de053c4d933 lrc: 3/0,0 mode: PR/PR res: [0x2bb05:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1578 expref: 69 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.768489:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000077e9697/0x3234de053c4d933 lrc: 4/0,0 mode: PR/PR res: [0x2bb05:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1578 expref: 69 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.768495:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.768495:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006e255cae pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997066816:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.768504:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 000000003ad73843 going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.768527:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52e8a lrc: 2/0,0 mode: PW/PW res: [0x2bafe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.768531:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cde66bc6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.768532:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52e8a lrc: 2/0,0 mode: PW/PW res: [0x2bafe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.768535:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52e8a lrc: 3/0,0 mode: PW/PW res: [0x2bafe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.768539:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52e8a lrc: 1/0,0 mode: --/PW res: [0x2bafe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.768541:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396427968 00010000:00010000:0.0:1651529344.768542:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52e8a lrc: 0/0,0 mode: --/PW res: [0x2bafe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.768547:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000863dbb4c/0x3234de053c4e653 lrc: 5/0,0 mode: PR/PR res: [0x2bb00:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a3e expref: 70 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.768554:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396428032 00000100:00100000:0.0:1651529344.768554:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f7006631 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997066560:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.768557:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002ff5da99/0x3234de053c4f024 lrc: 4/0,0 mode: PR/PR res: [0x2bb01:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d735e expref: 71 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.768557:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c52e9f lrc: 3/0,1 mode: --/PW res: [0x2bb01:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.768562:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13278 00000100:00100000:1.0:1651529344.768564:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+71:41278:x1731746396427968:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529344.768566:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.768567:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000863dbb4c/0x3234de053c4e653 lrc: 5/0,0 mode: PR/PR res: [0x2bb00:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a3e expref: 71 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.768571:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000863dbb4c/0x3234de053c4e653 lrc: 4/0,0 mode: PR/PR res: [0x2bb00:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a3e expref: 71 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.768576:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.768577:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.768578:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c52e98 lrc: 3/0,1 mode: PW/PW res: [0x2bb00:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.768578:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13279 00000100:00100000:0.0:1651529344.768580:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+71:41279:x1731746396428032:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.768581:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c52e98 lrc: 4/0,1 mode: PW/PW res: [0x2bb00:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.768585:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.768585:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.768587:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002ff5da99/0x3234de053c4f024 lrc: 4/0,0 mode: PR/PR res: [0x2bb01:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d735e expref: 71 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.768590:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002ff5da99/0x3234de053c4f024 lrc: 3/0,0 mode: PR/PR res: [0x2bb01:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d735e expref: 71 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.768594:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+71:41278:x1731746396427968:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 30us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.768597:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13278 00010000:00010000:1.0:1651529344.768606:0:80277:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000863dbb4c/0x3234de053c4e653 lrc: 0/0,0 mode: --/PR res: [0x2bb00:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4a3e expref: 70 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.768606:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ff5da99/0x3234de053c4f024 lrc: 0/0,0 mode: --/PR res: [0x2bb01:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d735e expref: 70 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.768610:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000673bcbe2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997066496:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.768610:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.768611:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.768612:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c52e9f lrc: 3/0,1 mode: PW/PW res: [0x2bb01:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.768614:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c52e98 lrc: 3/0,1 mode: PW/PW res: [0x2bb00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.768615:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c52e9f lrc: 4/0,1 mode: PW/PW res: [0x2bb01:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.768617:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c52e98 lrc: 3/0,1 mode: PW/PW res: [0x2bb00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.768619:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c52e98 lrc: 3/0,1 mode: PW/PW res: [0x2bb00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.768622:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c52e98 lrc: 3/0,1 mode: PW/PW res: [0x2bb00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.768622:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.768625:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c52e98 lrc: 2/0,0 mode: PW/PW res: [0x2bb00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.768647:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+68:41279:x1731746396428032:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 66us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.768650:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13279 00010000:00010000:0.0:1651529344.768658:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c52e98 lrc: 2/0,0 mode: PW/PW res: [0x2bb00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.768661:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000337d9d20 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.768662:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c52e98 lrc: 2/0,0 mode: PW/PW res: [0x2bb00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.768665:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c52e98 lrc: 3/0,0 mode: PW/PW res: [0x2bb00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.768668:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1996:39030:x1731745946546816:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 678us (811us total) trans 12885080551 rc 0/0 00010000:00010000:0.0:1651529344.768669:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c52e98 lrc: 1/0,0 mode: --/PW res: [0x2bb00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.768671:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212496 00010000:00010000:0.0:1651529344.768672:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c52e98 lrc: 0/0,0 mode: --/PW res: [0x2bb00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.768678:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c52e9f lrc: 3/0,1 mode: PW/PW res: [0x2bb01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.768681:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c52e9f lrc: 3/0,1 mode: PW/PW res: [0x2bb01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.768684:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c52e9f lrc: 3/0,1 mode: PW/PW res: [0x2bb01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.768686:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.768687:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c52e9f lrc: 2/0,0 mode: PW/PW res: [0x2bb01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.768745:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1996:39030:x1731745946546880:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 749us (855us total) trans 12885080552 rc 0/0 00000100:00100000:1.0:1651529344.768746:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.768748:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212497 00000100:00100000:0.0:1651529344.768759:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946547264 00000100:00100000:0.0:1651529344.768768:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946547200 00000100:00100000:0.0:1651529344.768772:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212502 00000100:00100000:0.0:1651529344.768773:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+1997:39029:x1731745946547264:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.768778:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178951 count 1 00000100:00100000:1.0:1651529344.768796:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212503 00010000:00010000:0.0:1651529344.768800:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c52ec2 lrc: 3/0,1 mode: --/PW res: [0x2bb07:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.768803:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+1997:39029:x1731745946547200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529344.768808:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178950 count 1 00010000:00010000:1.0:1651529344.768812:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c52ec9 lrc: 3/0,1 mode: --/PW res: [0x2bb06:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.768817:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008aaf7843/0x3234de053c4f17b lrc: 2/0,0 mode: PR/PR res: [0x2bb06:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d789e expref: 67 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.768820:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.768821:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.768821:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c52ec9 lrc: 4/0,1 mode: --/PW res: [0x2bb06:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.768824:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000039b253a5/0x3234de053c4c9f1 lrc: 2/0,0 mode: PR/PR res: [0x2bb07:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd9d5 expref: 67 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.768828:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008aaf7843/0x3234de053c4f17b lrc: 3/0,0 mode: PR/PR res: [0x2bb06:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d789e expref: 67 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.768828:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.768828:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.768829:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c52ec2 lrc: 4/0,1 mode: --/PW res: [0x2bb07:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.768832:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008aaf7843/0x3234de053c4f17b lrc: 4/0,0 mode: PR/PR res: [0x2bb06:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d789e expref: 67 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.768836:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000673bcbe2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997066880:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.768837:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000039b253a5/0x3234de053c4c9f1 lrc: 3/0,0 mode: PR/PR res: [0x2bb07:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd9d5 expref: 67 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.768844:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 000000007d8fabda going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.768849:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c52e9f lrc: 2/0,0 mode: PW/PW res: [0x2bb01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.768850:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000039b253a5/0x3234de053c4c9f1 lrc: 4/0,0 mode: PR/PR res: [0x2bb07:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd9d5 expref: 67 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.768853:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000055fddd81 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.768854:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c52e9f lrc: 2/0,0 mode: PW/PW res: [0x2bb01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.768857:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c52e9f lrc: 3/0,0 mode: PW/PW res: [0x2bb01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.768861:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c52e9f lrc: 1/0,0 mode: --/PW res: [0x2bb01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.768863:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f7006631 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997066944:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.768866:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c52e9f lrc: 0/0,0 mode: --/PW res: [0x2bb01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.768873:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000008dd99533 going to sleep for 6 seconds 00000100:00100000:0.0:1651529344.768882:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d9ef3c1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997066624:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.768886:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52ea6 lrc: 3/0,1 mode: --/PW res: [0x2bb03:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.768926:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.768945:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529344.768946:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.768956:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946547328 00000100:00100000:1.0:1651529344.768960:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.768969:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946547392 00000100:00100000:0.0:1651529344.768977:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212504 00000100:00100000:1.0:1651529344.768978:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.768978:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+1999:39029:x1731745946547328:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.768983:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178952 count 1 00000100:00100000:1.0:1651529344.768986:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.768988:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c52ed0 lrc: 3/0,1 mode: --/PW res: [0x2bb08:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.768992:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c0c4b95b/0x3234de053c4f262 lrc: 2/0,0 mode: PR/PR res: [0x2bb08:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c48 expref: 67 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.768995:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000057329b82 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997066688:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.768995:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.768996:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.768996:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c52ed0 lrc: 4/0,1 mode: --/PW res: [0x2bb08:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.768999:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c52ead lrc: 3/0,1 mode: --/PW res: [0x2bb02:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.769003:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c0c4b95b/0x3234de053c4f262 lrc: 3/0,0 mode: PR/PR res: [0x2bb08:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c48 expref: 67 pid: 72396 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.769006:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396428096 00010000:00010000:0.0:1651529344.769006:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c0c4b95b/0x3234de053c4f262 lrc: 4/0,0 mode: PR/PR res: [0x2bb08:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c48 expref: 67 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.769010:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b0d9532a pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997067008:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.769011:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004df6544e/0x3234de053c4f2af lrc: 4/0,0 mode: PR/PR res: [0x2bb03:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d9f expref: 68 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.769016:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396428224 00010000:00010000:1.0:1651529344.769018:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c09304f9/0x3234de053c4d543 lrc: 5/0,0 mode: PR/PR res: [0x2bb04:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d06f3 expref: 69 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.769021:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000afe7ff7b going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.769022:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396428160 00010000:00010000:1.0:1651529344.769024:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000569be69/0x3234de053c4d279 lrc: 4/0,0 mode: PR/PR res: [0x2bb02:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb5b expref: 70 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.769027:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396428288 00000100:00100000:0.0:1651529344.769028:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a925fbf6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997066752:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.769030:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000077e9697/0x3234de053c4d933 lrc: 5/0,0 mode: PR/PR res: [0x2bb05:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1578 expref: 71 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.769032:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c52eb4 lrc: 3/0,1 mode: --/PW res: [0x2bb04:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.769037:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13280 00000100:00100000:1.0:1651529344.769038:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+71:41278:x1731746396428096:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529344.769040:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006e255cae pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997066816:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.769041:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.769042:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004df6544e/0x3234de053c4f2af lrc: 4/0,0 mode: PR/PR res: [0x2bb03:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d9f expref: 71 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.769043:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c52ebb lrc: 3/0,1 mode: --/PW res: [0x2bb05:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.769045:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004df6544e/0x3234de053c4f2af lrc: 3/0,0 mode: PR/PR res: [0x2bb03:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d9f expref: 71 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.769049:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13281 00010000:00010000:1.0:1651529344.769051:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004df6544e/0x3234de053c4f2af lrc: 0/0,0 mode: --/PR res: [0x2bb03:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7d9f expref: 71 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.769051:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+71:41278:x1731746396428224:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.769054:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.769055:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.769055:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.769055:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c09304f9/0x3234de053c4d543 lrc: 4/0,0 mode: PR/PR res: [0x2bb04:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d06f3 expref: 70 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.769056:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52ea6 lrc: 3/0,1 mode: PW/PW res: [0x2bb03:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.769059:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52ea6 lrc: 4/0,1 mode: PW/PW res: [0x2bb03:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.769059:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c09304f9/0x3234de053c4d543 lrc: 3/0,0 mode: PR/PR res: [0x2bb04:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d06f3 expref: 70 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.769065:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c09304f9/0x3234de053c4d543 lrc: 0/0,0 mode: --/PR res: [0x2bb04:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d06f3 expref: 70 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.769070:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.769075:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.769076:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529344.769077:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+69:41278:x1731746396428096:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (131us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529344.769077:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c52eb4 lrc: 3/0,1 mode: PW/PW res: [0x2bb04:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.769079:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13280 00010000:00010000:0.0:1651529344.769080:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c52eb4 lrc: 4/0,1 mode: PW/PW res: [0x2bb04:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.769084:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13282 00000100:00100000:1.0:1651529344.769086:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e75f071f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+68:41278:x1731746396428160:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.769086:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.769088:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.769089:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000569be69/0x3234de053c4d279 lrc: 4/0,0 mode: PR/PR res: [0x2bb02:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb5b expref: 68 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.769093:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000569be69/0x3234de053c4d279 lrc: 3/0,0 mode: PR/PR res: [0x2bb02:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb5b expref: 68 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.769099:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000569be69/0x3234de053c4d279 lrc: 0/0,0 mode: --/PR res: [0x2bb02:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cfb5b expref: 68 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.769102:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.769102:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.769103:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c52ead lrc: 3/0,1 mode: PW/PW res: [0x2bb02:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.769106:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c52ead lrc: 4/0,1 mode: PW/PW res: [0x2bb02:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.769113:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.769121:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+67:41278:x1731746396428224:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 41us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.769124:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13281 00000100:00100000:0.0:1651529344.769130:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13283 00000100:00100000:1.0:1651529344.769133:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e75f071f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+66:41278:x1731746396428160:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 46us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.769133:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+66:41278:x1731746396428288:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529344.769136:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13282 00010000:00010000:0.0:1651529344.769136:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.769137:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000077e9697/0x3234de053c4d933 lrc: 4/0,0 mode: PR/PR res: [0x2bb05:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1578 expref: 66 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.769141:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000077e9697/0x3234de053c4d933 lrc: 3/0,0 mode: PR/PR res: [0x2bb05:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1578 expref: 65 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.769147:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000077e9697/0x3234de053c4d933 lrc: 0/0,0 mode: --/PR res: [0x2bb05:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d1578 expref: 65 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.769148:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212505 00000100:00100000:1.0:1651529344.769149:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+1999:39029:x1731745946547392:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.769150:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.769151:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.769152:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c52ebb lrc: 3/0,1 mode: PW/PW res: [0x2bb05:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.769154:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178953 count 1 00010000:00010000:0.0:1651529344.769154:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c52ebb lrc: 4/0,1 mode: PW/PW res: [0x2bb05:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.769158:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c52ed7 lrc: 3/0,1 mode: --/PW res: [0x2bb09:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.769161:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.769165:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e816bb3f/0x3234de053c4e71e lrc: 2/0,0 mode: PR/PR res: [0x2bb09:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d86 expref: 64 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.769168:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.769168:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529344.769168:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+64:41278:x1731746396428288:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (182us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529344.769169:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c52ed7 lrc: 4/0,1 mode: --/PW res: [0x2bb09:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.769170:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13283 00010000:00010000:1.0:1651529344.769175:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e816bb3f/0x3234de053c4e71e lrc: 3/0,0 mode: PR/PR res: [0x2bb09:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d86 expref: 63 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.769176:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52ea6 lrc: 3/0,1 mode: PW/PW res: [0x2bb03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.769179:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e816bb3f/0x3234de053c4e71e lrc: 4/0,0 mode: PR/PR res: [0x2bb09:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d86 expref: 63 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.769180:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52ea6 lrc: 3/0,1 mode: PW/PW res: [0x2bb03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.769183:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d28c414b pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997067072:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.769183:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52ea6 lrc: 3/0,1 mode: PW/PW res: [0x2bb03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.769185:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52ea6 lrc: 2/0,0 mode: PW/PW res: [0x2bb03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.769190:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b52d0f36 going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.769198:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c52ead lrc: 3/0,1 mode: PW/PW res: [0x2bb02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.769201:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c52ead lrc: 3/0,1 mode: PW/PW res: [0x2bb02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.769204:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c52ead lrc: 3/0,1 mode: PW/PW res: [0x2bb02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.769207:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c52ead lrc: 2/0,0 mode: PW/PW res: [0x2bb02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.769246:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2000:39029:x1731745946547008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1090us (1183us total) trans 12885080553 rc 0/0 00000100:00100000:0.0:1651529344.769249:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212498 00010000:00010000:0.0:1651529344.769256:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52ea6 lrc: 2/0,0 mode: PW/PW res: [0x2bb03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.769259:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002f450f42 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.769260:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52ea6 lrc: 2/0,0 mode: PW/PW res: [0x2bb03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.769263:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52ea6 lrc: 3/0,0 mode: PW/PW res: [0x2bb03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.769268:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52ea6 lrc: 1/0,0 mode: --/PW res: [0x2bb03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.769269:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2000:39029:x1731745946546944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 959us (1152us total) trans 12885080554 rc 0/0 00010000:00010000:0.0:1651529344.769270:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52ea6 lrc: 0/0,0 mode: --/PW res: [0x2bb03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.769272:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212499 00010000:00010000:0.0:1651529344.769275:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c52ead lrc: 2/0,0 mode: PW/PW res: [0x2bb02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.769278:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d571c418 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.769279:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c52ead lrc: 2/0,0 mode: PW/PW res: [0x2bb02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.769281:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c52ead lrc: 3/0,0 mode: PW/PW res: [0x2bb02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.769285:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c52ead lrc: 1/0,0 mode: --/PW res: [0x2bb02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.769287:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c52ead lrc: 0/0,0 mode: --/PW res: [0x2bb02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.769301:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c52eb4 lrc: 3/0,1 mode: PW/PW res: [0x2bb04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.769304:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c52eb4 lrc: 3/0,1 mode: PW/PW res: [0x2bb04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.769307:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c52eb4 lrc: 3/0,1 mode: PW/PW res: [0x2bb04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.769310:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c52eb4 lrc: 2/0,0 mode: PW/PW res: [0x2bb04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.769315:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.769333:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.769349:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2000:39029:x1731745946547072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1031us (1222us total) trans 12885080555 rc 0/0 00000100:00100000:0.0:1651529344.769352:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212500 00010000:00010000:0.0:1651529344.769358:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c52ebb lrc: 3/0,1 mode: PW/PW res: [0x2bb05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.769362:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c52ebb lrc: 3/0,1 mode: PW/PW res: [0x2bb05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.769365:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c52ebb lrc: 3/0,1 mode: PW/PW res: [0x2bb05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.769367:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c52ebb lrc: 2/0,0 mode: PW/PW res: [0x2bb05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.769419:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2000:39030:x1731745946547136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 962us (1033us total) trans 12885080556 rc 0/0 00000100:00100000:0.0:1651529344.769422:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212501 00000100:00100000:1.0:1651529344.769424:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000673bcbe2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997066880:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.769429:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c52ec9 lrc: 3/0,1 mode: --/PW res: [0x2bb06:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.769429:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c52eb4 lrc: 2/0,0 mode: PW/PW res: [0x2bb04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.769432:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c822bd1c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.769433:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c52eb4 lrc: 2/0,0 mode: PW/PW res: [0x2bb04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.769436:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c52eb4 lrc: 3/0,0 mode: PW/PW res: [0x2bb04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.769437:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396428416 00010000:00010000:1.0:1651529344.769441:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008aaf7843/0x3234de053c4f17b lrc: 4/0,0 mode: PR/PR res: [0x2bb06:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d789e expref: 64 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.769441:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c52eb4 lrc: 1/0,0 mode: --/PW res: [0x2bb04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.769444:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c52eb4 lrc: 0/0,0 mode: --/PW res: [0x2bb04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.769451:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396428352 00010000:00010000:1.0:1651529344.769454:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000039b253a5/0x3234de053c4c9f1 lrc: 5/0,0 mode: PR/PR res: [0x2bb07:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd9d5 expref: 65 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.769455:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c52ebb lrc: 2/0,0 mode: PW/PW res: [0x2bb05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.769458:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042bde05b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.769459:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c52ebb lrc: 2/0,0 mode: PW/PW res: [0x2bb05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.769460:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13284 00000100:00100000:1.0:1651529344.769462:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+65:41279:x1731746396428416:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529344.769465:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.769466:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008aaf7843/0x3234de053c4f17b lrc: 4/0,0 mode: PR/PR res: [0x2bb06:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d789e expref: 65 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.769470:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008aaf7843/0x3234de053c4f17b lrc: 3/0,0 mode: PR/PR res: [0x2bb06:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d789e expref: 65 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.769473:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c52ebb lrc: 3/0,0 mode: PW/PW res: [0x2bb05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.769477:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c52ebb lrc: 1/0,0 mode: --/PW res: [0x2bb05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.769478:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008aaf7843/0x3234de053c4f17b lrc: 0/0,0 mode: --/PR res: [0x2bb06:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d789e expref: 65 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.769480:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c52ebb lrc: 0/0,0 mode: --/PW res: [0x2bb05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.769482:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.769483:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.769484:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c52ec9 lrc: 3/0,1 mode: PW/PW res: [0x2bb06:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.769486:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c52ec9 lrc: 4/0,1 mode: PW/PW res: [0x2bb06:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.769491:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f7006631 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997066944:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.769493:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.769495:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c52ec2 lrc: 3/0,1 mode: --/PW res: [0x2bb07:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.769499:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+64:41279:x1731746396428416:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 37us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.769502:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13284 00000100:00100000:0.0:1651529344.769518:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13285 00000100:00100000:0.0:1651529344.769520:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+63:41279:x1731746396428352:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.769524:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.769525:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c52ec9 lrc: 3/0,1 mode: PW/PW res: [0x2bb06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.769526:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000039b253a5/0x3234de053c4c9f1 lrc: 4/0,0 mode: PR/PR res: [0x2bb07:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd9d5 expref: 63 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.769529:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c52ec9 lrc: 3/0,1 mode: PW/PW res: [0x2bb06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.769529:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000039b253a5/0x3234de053c4c9f1 lrc: 3/0,0 mode: PR/PR res: [0x2bb07:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd9d5 expref: 63 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.769532:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c52ec9 lrc: 3/0,1 mode: PW/PW res: [0x2bb06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.769534:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c52ec9 lrc: 2/0,0 mode: PW/PW res: [0x2bb06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.769535:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039b253a5/0x3234de053c4c9f1 lrc: 0/0,0 mode: --/PR res: [0x2bb07:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cd9d5 expref: 63 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.769538:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.769539:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.769540:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c52ec2 lrc: 3/0,1 mode: PW/PW res: [0x2bb07:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.769549:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c52ec2 lrc: 4/0,1 mode: PW/PW res: [0x2bb07:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.769556:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.769562:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+62:41279:x1731746396428352:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.769565:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13285 00010000:00010000:0.0:1651529344.769573:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c52ec9 lrc: 2/0,0 mode: PW/PW res: [0x2bb06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.769577:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2000:39029:x1731745946547200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 778us (831us total) trans 12885080557 rc 0/0 00010000:00010000:0.0:1651529344.769578:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000037a4f3dc already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.769579:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c52ec9 lrc: 2/0,0 mode: PW/PW res: [0x2bb06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.769580:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212503 00010000:00010000:0.0:1651529344.769582:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c52ec9 lrc: 3/0,0 mode: PW/PW res: [0x2bb06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.769586:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c52ec9 lrc: 1/0,0 mode: --/PW res: [0x2bb06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.769588:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c52ec9 lrc: 0/0,0 mode: --/PW res: [0x2bb06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.769594:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c52ec2 lrc: 3/0,1 mode: PW/PW res: [0x2bb07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.769597:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c52ec2 lrc: 3/0,1 mode: PW/PW res: [0x2bb07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.769607:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c52ec2 lrc: 3/0,1 mode: PW/PW res: [0x2bb07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.769609:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c52ec2 lrc: 2/0,0 mode: PW/PW res: [0x2bb07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.769626:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.769671:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2000:39029:x1731745946547264:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 897us (985us total) trans 12885080558 rc 0/0 00000100:00100000:1.0:1651529344.769674:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.769674:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212502 00000100:00100000:0.0:1651529344.769687:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946547456 00000100:00100000:0.0:1651529344.769693:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946547584 00000100:00100000:0.0:1651529344.769701:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212506 00000100:00100000:0.0:1651529344.769702:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2001:39030:x1731745946547456:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.769707:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178954 count 1 00000100:00100000:1.0:1651529344.769710:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.769711:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52ede lrc: 3/0,1 mode: --/PW res: [0x2bb0a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.769716:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000656a2f5f/0x3234de053c4f31f lrc: 2/0,0 mode: PR/PR res: [0x2bb0a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7efd expref: 61 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.769719:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.769720:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.769720:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52ede lrc: 4/0,1 mode: --/PW res: [0x2bb0a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.769727:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000656a2f5f/0x3234de053c4f31f lrc: 3/0,0 mode: PR/PR res: [0x2bb0a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7efd expref: 61 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.769730:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000656a2f5f/0x3234de053c4f31f lrc: 4/0,0 mode: PR/PR res: [0x2bb0a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7efd expref: 61 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.769743:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e5997468 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997067136:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.769745:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529344.769759:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bff8744a going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.769763:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.769790:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b0d9532a pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997067008:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529344.769794:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946547520 00000100:00100000:1.0:1651529344.769802:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212507 00000100:00100000:1.0:1651529344.769804:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2002:39030:x1731745946547584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529344.769809:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c52ed0 lrc: 3/0,1 mode: --/PW res: [0x2bb08:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529344.769814:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178956 count 1 00010000:00010000:0.0:1651529344.769817:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c52ec2 lrc: 2/0,0 mode: PW/PW res: [0x2bb07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.769818:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c52ee5 lrc: 3/0,1 mode: --/PW res: [0x2bb0c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.769820:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000009fe5580 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.769821:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c52ec2 lrc: 2/0,0 mode: PW/PW res: [0x2bb07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.769823:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c4aa32 lrc: 2/0,0 mode: PR/PR res: [0x2bb0c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd6c expref: 61 pid: 80280 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.769826:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.769827:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.769828:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c52ee5 lrc: 4/0,1 mode: --/PW res: [0x2bb0c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.769834:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c4aa32 lrc: 3/0,0 mode: PR/PR res: [0x2bb0c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd6c expref: 61 pid: 80280 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.769840:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c4aa32 lrc: 4/0,0 mode: PR/PR res: [0x2bb0c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd6c expref: 61 pid: 80280 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.769842:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c52ec2 lrc: 3/0,0 mode: PW/PW res: [0x2bb07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.769845:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c20a6e11 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997067200:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.769847:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c52ec2 lrc: 1/0,0 mode: --/PW res: [0x2bb07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.769850:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c52ec2 lrc: 0/0,0 mode: --/PW res: [0x2bb07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.769853:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c3caa148 going to sleep for 6 seconds 00000100:00100000:1.0:1651529344.769861:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d28c414b pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997067072:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.769863:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212508 00010000:00010000:1.0:1651529344.769864:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c52ed7 lrc: 3/0,1 mode: --/PW res: [0x2bb09:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.769865:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2002:39030:x1731745946547520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529344.769870:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178955 count 1 00000100:00100000:1.0:1651529344.769872:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396428480 00010000:00010000:0.0:1651529344.769873:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c52eec lrc: 3/0,1 mode: --/PW res: [0x2bb0b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.769876:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c0c4b95b/0x3234de053c4f262 lrc: 4/0,0 mode: PR/PR res: [0x2bb08:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c48 expref: 62 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.769877:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005d1f4c36/0x3234de053c4bffd lrc: 2/0,0 mode: PR/PR res: [0x2bb0b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc76e expref: 62 pid: 80280 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.769882:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396428544 00010000:00010000:0.0:1651529344.769882:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.769883:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.769884:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c52eec lrc: 4/0,1 mode: --/PW res: [0x2bb0b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.769885:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e816bb3f/0x3234de053c4e71e lrc: 4/0,0 mode: PR/PR res: [0x2bb09:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d86 expref: 63 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.769890:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13286 00010000:00010000:0.0:1651529344.769890:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005d1f4c36/0x3234de053c4bffd lrc: 3/0,0 mode: PR/PR res: [0x2bb0b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc76e expref: 63 pid: 80280 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529344.769892:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+63:41279:x1731746396428480:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529344.769893:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005d1f4c36/0x3234de053c4bffd lrc: 4/0,0 mode: PR/PR res: [0x2bb0b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc76e expref: 63 pid: 80280 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.769894:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529344.769895:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c0c4b95b/0x3234de053c4f262 lrc: 4/0,0 mode: PR/PR res: [0x2bb08:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c48 expref: 63 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.769898:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b0d9532a pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997067264:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.769899:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c0c4b95b/0x3234de053c4f262 lrc: 3/0,0 mode: PR/PR res: [0x2bb08:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c48 expref: 63 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.769905:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0c4b95b/0x3234de053c4f262 lrc: 0/0,0 mode: --/PR res: [0x2bb08:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7c48 expref: 63 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.769906:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000afe7ff7b going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.769909:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.769909:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.769910:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c52ed0 lrc: 3/0,1 mode: PW/PW res: [0x2bb08:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.769913:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c52ed0 lrc: 4/0,1 mode: PW/PW res: [0x2bb08:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.769914:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13287 00000100:00100000:0.0:1651529344.769915:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+62:41279:x1731746396428544:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.769924:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.769931:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+62:41279:x1731746396428480:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 38us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.769933:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13286 00010000:00010000:0.0:1651529344.769941:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.769943:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e816bb3f/0x3234de053c4e71e lrc: 4/0,0 mode: PR/PR res: [0x2bb09:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d86 expref: 61 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.769947:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e816bb3f/0x3234de053c4e71e lrc: 3/0,0 mode: PR/PR res: [0x2bb09:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d86 expref: 61 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.769953:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e816bb3f/0x3234de053c4e71e lrc: 0/0,0 mode: --/PR res: [0x2bb09:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d4d86 expref: 61 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.769959:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.769960:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.769960:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c52ed7 lrc: 3/0,1 mode: PW/PW res: [0x2bb09:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.769963:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c52ed7 lrc: 4/0,1 mode: PW/PW res: [0x2bb09:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.769969:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.769973:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.769980:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+60:41279:x1731746396428544:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 64us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.769983:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13287 00010000:00010000:0.0:1651529344.769992:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c52ed0 lrc: 3/0,1 mode: PW/PW res: [0x2bb08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.770000:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c52ed0 lrc: 3/0,1 mode: PW/PW res: [0x2bb08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.770003:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529344.770004:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c52ed0 lrc: 3/0,1 mode: PW/PW res: [0x2bb08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.770011:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c52ed0 lrc: 2/0,0 mode: PW/PW res: [0x2bb08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.770015:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.770050:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946547648 00000100:00100000:1.0:1651529344.770063:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946547712 00000100:00100000:0.0:1651529344.770064:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+2005:39029:x1731745946547328:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1085us (1138us total) trans 12885080559 rc 0/0 00000100:00100000:1.0:1651529344.770067:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212509 00000100:00100000:1.0:1651529344.770069:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+2005:39030:x1731745946547648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529344.770069:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212504 00002000:00080000:1.0:1651529344.770074:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178957 count 1 00000100:00100000:0.0:1651529344.770075:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212510 00000100:00100000:0.0:1651529344.770077:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+2004:39029:x1731745946547712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529344.770078:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c52ef3 lrc: 3/0,1 mode: --/PW res: [0x2bb0d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529344.770082:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178958 count 1 00010000:00010000:1.0:1651529344.770083:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006317cd4c/0x3234de053c4cf54 lrc: 2/0,0 mode: PR/PR res: [0x2bb0d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef14 expref: 59 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.770086:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.770086:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c52efa lrc: 3/0,1 mode: --/PW res: [0x2bb0e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.770087:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.770087:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c52ef3 lrc: 4/0,1 mode: --/PW res: [0x2bb0d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.770094:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006317cd4c/0x3234de053c4cf54 lrc: 3/0,0 mode: PR/PR res: [0x2bb0d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef14 expref: 59 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.770097:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006317cd4c/0x3234de053c4cf54 lrc: 4/0,0 mode: PR/PR res: [0x2bb0d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef14 expref: 59 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.770101:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000057329b82 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997067328:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.770105:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ce10db4f/0x3234de053c4ead6 lrc: 2/0,0 mode: PR/PR res: [0x2bb0e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d07 expref: 59 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529344.770108:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.770109:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.770109:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c52efa lrc: 4/0,1 mode: --/PW res: [0x2bb0e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.770110:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fb6c773d going to sleep for 6 seconds 00010000:00010000:1.0:1651529344.770115:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c52ed7 lrc: 3/0,1 mode: PW/PW res: [0x2bb09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.770117:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ce10db4f/0x3234de053c4ead6 lrc: 3/0,0 mode: PR/PR res: [0x2bb0e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d07 expref: 59 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529344.770118:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c52ed7 lrc: 3/0,1 mode: PW/PW res: [0x2bb09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.770120:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ce10db4f/0x3234de053c4ead6 lrc: 4/0,0 mode: PR/PR res: [0x2bb0e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d07 expref: 59 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.770121:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c52ed7 lrc: 3/0,1 mode: PW/PW res: [0x2bb09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.770123:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c52ed7 lrc: 2/0,0 mode: PW/PW res: [0x2bb09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.770125:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae466fbb pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997067392:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529344.770141:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e68b7e1f going to sleep for 6 seconds 00010000:00010000:0.0:1651529344.770146:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c52ed0 lrc: 2/0,0 mode: PW/PW res: [0x2bb08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.770149:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d9cfe902 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.770150:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c52ed0 lrc: 2/0,0 mode: PW/PW res: [0x2bb08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.770153:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c52ed0 lrc: 3/0,0 mode: PW/PW res: [0x2bb08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.770158:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c52ed0 lrc: 1/0,0 mode: --/PW res: [0x2bb08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.770161:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c52ed0 lrc: 0/0,0 mode: --/PW res: [0x2bb08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.770166:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c52ed7 lrc: 2/0,0 mode: PW/PW res: [0x2bb09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.770167:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+2005:39029:x1731745946547392:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1016us (1222us total) trans 12885080560 rc 0/0 00010000:00010000:0.0:1651529344.770169:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000033d777ce already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.770169:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c52ed7 lrc: 2/0,0 mode: PW/PW res: [0x2bb09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.770170:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212505 00010000:00010000:0.0:1651529344.770172:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c52ed7 lrc: 3/0,0 mode: PW/PW res: [0x2bb09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.770175:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c52ed7 lrc: 1/0,0 mode: --/PW res: [0x2bb09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.770178:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c52ed7 lrc: 0/0,0 mode: --/PW res: [0x2bb09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.770189:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e5997468 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997067136:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.770193:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52ede lrc: 3/0,1 mode: --/PW res: [0x2bb0a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.770199:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396428608 00010000:00010000:0.0:1651529344.770203:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000656a2f5f/0x3234de053c4f31f lrc: 4/0,0 mode: PR/PR res: [0x2bb0a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7efd expref: 60 pid: 72396 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.770215:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13288 00000100:00100000:0.0:1651529344.770217:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+60:41278:x1731746396428608:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529344.770220:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.770261:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000656a2f5f/0x3234de053c4f31f lrc: 4/0,0 mode: PR/PR res: [0x2bb0a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7efd expref: 60 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.770266:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000656a2f5f/0x3234de053c4f31f lrc: 3/0,0 mode: PR/PR res: [0x2bb0a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7efd expref: 60 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.770272:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000656a2f5f/0x3234de053c4f31f lrc: 0/0,0 mode: --/PR res: [0x2bb0a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d7efd expref: 60 pid: 72396 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.770275:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.770276:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.770277:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52ede lrc: 3/0,1 mode: PW/PW res: [0x2bb0a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.770280:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52ede lrc: 4/0,1 mode: PW/PW res: [0x2bb0a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.770293:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.770294:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.770301:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+59:41278:x1731746396428608:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 84us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.770303:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529344.770304:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13288 00000100:00100000:0.0:1651529344.770309:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396428736 00010000:00010000:0.0:1651529344.770313:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005d1f4c36/0x3234de053c4bffd lrc: 5/0,0 mode: PR/PR res: [0x2bb0b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc76e expref: 59 pid: 80280 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.770323:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396428672 00000100:00100000:1.0:1651529344.770337:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c20a6e11 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997067200:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.770346:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c52ee5 lrc: 3/0,1 mode: --/PW res: [0x2bb0c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.770346:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c4aa32 lrc: 4/0,0 mode: PR/PR res: [0x2bb0c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd6c expref: 60 pid: 80280 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.770352:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13289 00000100:00100000:0.0:1651529344.770353:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000781af77d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+60:41278:x1731746396428736:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529344.770355:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13290 00010000:00010000:0.0:1651529344.770356:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529344.770357:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+60:41278:x1731746396428672:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529344.770357:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005d1f4c36/0x3234de053c4bffd lrc: 5/0,0 mode: PR/PR res: [0x2bb0b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc76e expref: 60 pid: 80280 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.770360:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.770361:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005d1f4c36/0x3234de053c4bffd lrc: 4/0,0 mode: PR/PR res: [0x2bb0b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc76e expref: 60 pid: 80280 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.770362:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c4aa32 lrc: 4/0,0 mode: PR/PR res: [0x2bb0c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd6c expref: 60 pid: 80280 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.770365:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c4aa32 lrc: 3/0,0 mode: PR/PR res: [0x2bb0c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd6c expref: 60 pid: 80280 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.770366:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.770366:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.770367:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c52eec lrc: 3/0,1 mode: PW/PW res: [0x2bb0b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.770371:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c4aa32 lrc: 0/0,0 mode: --/PR res: [0x2bb0c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cbd6c expref: 60 pid: 80280 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.770373:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c52eec lrc: 4/0,1 mode: PW/PW res: [0x2bb0b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.770374:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.770375:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.770376:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c52ee5 lrc: 3/0,1 mode: PW/PW res: [0x2bb0c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.770377:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529344.770379:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c52ee5 lrc: 4/0,1 mode: PW/PW res: [0x2bb0c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.770383:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000781af77d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+59:41278:x1731746396428736:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 29us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.770386:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13289 00010000:00010000:1.0:1651529344.770388:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529344.770394:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+58:41278:x1731746396428672:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 37us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.770397:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13290 00010000:00010000:0.0:1651529344.770400:0:72395:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d1f4c36/0x3234de053c4bffd lrc: 0/0,0 mode: --/PR res: [0x2bb0b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cc76e expref: 57 pid: 80280 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.770404:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b0d9532a pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997067264:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.770405:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c52ee5 lrc: 3/0,1 mode: PW/PW res: [0x2bb0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.770407:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c52eec lrc: 3/0,1 mode: PW/PW res: [0x2bb0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.770408:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c52ee5 lrc: 3/0,1 mode: PW/PW res: [0x2bb0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.770410:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c52eec lrc: 3/0,1 mode: PW/PW res: [0x2bb0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.770411:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c52ee5 lrc: 3/0,1 mode: PW/PW res: [0x2bb0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.770413:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c52eec lrc: 3/0,1 mode: PW/PW res: [0x2bb0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.770414:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c52ee5 lrc: 2/0,0 mode: PW/PW res: [0x2bb0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.770416:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c52eec lrc: 3/0,1 mode: PW/PW res: [0x2bb0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.770442:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c52eec lrc: 2/0,0 mode: PW/PW res: [0x2bb0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.770463:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2005:39030:x1731745946547584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 658us (789us total) trans 12885080561 rc 0/0 00000100:00100000:1.0:1651529344.770466:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212507 00010000:00010000:1.0:1651529344.770473:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c52ee5 lrc: 2/0,0 mode: PW/PW res: [0x2bb0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.770476:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006512b8a0 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.770477:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c52ee5 lrc: 2/0,0 mode: PW/PW res: [0x2bb0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.770482:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c52ee5 lrc: 3/0,0 mode: PW/PW res: [0x2bb0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.770487:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c52ee5 lrc: 1/0,0 mode: --/PW res: [0x2bb0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.770488:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2005:39030:x1731745946547520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 622us (742us total) trans 12885080562 rc 0/0 00010000:00010000:1.0:1651529344.770489:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c52ee5 lrc: 0/0,0 mode: --/PW res: [0x2bb0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.770491:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212508 00010000:00010000:1.0:1651529344.770495:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c52eec lrc: 2/0,0 mode: PW/PW res: [0x2bb0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.770498:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000916cff2 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.770499:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c52eec lrc: 2/0,0 mode: PW/PW res: [0x2bb0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.770500:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52ede lrc: 3/0,1 mode: PW/PW res: [0x2bb0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.770501:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c52eec lrc: 3/0,0 mode: PW/PW res: [0x2bb0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.770503:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52ede lrc: 3/0,1 mode: PW/PW res: [0x2bb0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.770504:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c52eec lrc: 1/0,0 mode: --/PW res: [0x2bb0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.770506:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52ede lrc: 3/0,1 mode: PW/PW res: [0x2bb0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.770507:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c52eec lrc: 0/0,0 mode: --/PW res: [0x2bb0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.770509:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52ede lrc: 2/0,0 mode: PW/PW res: [0x2bb0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.770540:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2005:39030:x1731745946547456:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 837us (914us total) trans 12885080563 rc 0/0 00000100:00100000:0.0:1651529344.770543:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212506 00010000:00010000:0.0:1651529344.770550:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52ede lrc: 2/0,0 mode: PW/PW res: [0x2bb0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.770553:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000082ae179c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.770561:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52ede lrc: 2/0,0 mode: PW/PW res: [0x2bb0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.770564:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52ede lrc: 3/0,0 mode: PW/PW res: [0x2bb0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.770565:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529344.770569:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52ede lrc: 1/0,0 mode: --/PW res: [0x2bb0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.770572:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52ede lrc: 0/0,0 mode: --/PW res: [0x2bb0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529344.770583:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae466fbb pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997067392:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529344.770586:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c52efa lrc: 3/0,1 mode: --/PW res: [0x2bb0e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.770592:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529344.770602:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000057329b82 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997067328:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529344.770606:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c52ef3 lrc: 3/0,1 mode: --/PW res: [0x2bb0d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.770613:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396428864 00010000:00010000:1.0:1651529344.770626:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ce10db4f/0x3234de053c4ead6 lrc: 4/0,0 mode: PR/PR res: [0x2bb0e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d07 expref: 57 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.770633:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396428800 00010000:00010000:1.0:1651529344.770635:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006317cd4c/0x3234de053c4cf54 lrc: 4/0,0 mode: PR/PR res: [0x2bb0d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef14 expref: 58 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.770645:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13291 00000100:00100000:1.0:1651529344.770646:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+58:41279:x1731746396428864:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529344.770649:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529344.770649:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13292 00010000:00010000:1.0:1651529344.770651:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ce10db4f/0x3234de053c4ead6 lrc: 4/0,0 mode: PR/PR res: [0x2bb0e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d07 expref: 58 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:0.0:1651529344.770651:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+58:41278:x1731746396428800:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529344.770654:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ce10db4f/0x3234de053c4ead6 lrc: 3/0,0 mode: PR/PR res: [0x2bb0e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d07 expref: 58 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.770655:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529344.770657:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006317cd4c/0x3234de053c4cf54 lrc: 4/0,0 mode: PR/PR res: [0x2bb0d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef14 expref: 58 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.770660:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce10db4f/0x3234de053c4ead6 lrc: 0/0,0 mode: --/PR res: [0x2bb0e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d5d07 expref: 58 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:1.0:1651529344.770663:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.770664:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529344.770664:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c52efa lrc: 3/0,1 mode: PW/PW res: [0x2bb0e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.770668:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c52efa lrc: 4/0,1 mode: PW/PW res: [0x2bb0e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.770676:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529344.770682:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006317cd4c/0x3234de053c4cf54 lrc: 3/0,0 mode: PR/PR res: [0x2bb0d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef14 expref: 57 pid: 80279 timeout: 20103 lvb_type: 1 00000100:00100000:1.0:1651529344.770684:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+57:41279:x1731746396428864:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529344.770687:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13291 00010000:00010000:0.0:1651529344.770688:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006317cd4c/0x3234de053c4cf54 lrc: 0/0,0 mode: --/PR res: [0x2bb0d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2cef14 expref: 57 pid: 80279 timeout: 20103 lvb_type: 1 00010000:00010000:0.0:1651529344.770692:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.770693:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529344.770694:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c52ef3 lrc: 3/0,1 mode: PW/PW res: [0x2bb0d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.770697:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c52ef3 lrc: 4/0,1 mode: PW/PW res: [0x2bb0d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.770706:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529344.770714:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+55:41278:x1731746396428800:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 62us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529344.770717:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13292 00010000:00010000:0.0:1651529344.770724:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c52efa lrc: 3/0,1 mode: PW/PW res: [0x2bb0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.770728:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c52efa lrc: 3/0,1 mode: PW/PW res: [0x2bb0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.770731:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c52efa lrc: 3/0,1 mode: PW/PW res: [0x2bb0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.770733:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c52efa lrc: 2/0,0 mode: PW/PW res: [0x2bb0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.770746:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c52ef3 lrc: 3/0,1 mode: PW/PW res: [0x2bb0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.770751:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c52ef3 lrc: 3/0,1 mode: PW/PW res: [0x2bb0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.770754:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c52ef3 lrc: 3/0,1 mode: PW/PW res: [0x2bb0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.770756:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c52ef3 lrc: 2/0,0 mode: PW/PW res: [0x2bb0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529344.770797:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+2006:39030:x1731745946547648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 726us (828us total) trans 12885080565 rc 0/0 00000100:00100000:1.0:1651529344.770800:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212509 00000100:00100000:0.0:1651529344.770801:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+2006:39029:x1731745946547712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 723us (798us total) trans 12885080564 rc 0/0 00000100:00100000:0.0:1651529344.770804:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212510 00010000:00010000:1.0:1651529344.770807:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c52efa lrc: 2/0,0 mode: PW/PW res: [0x2bb0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.770810:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000036d87bb6 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529344.770811:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c52efa lrc: 2/0,0 mode: PW/PW res: [0x2bb0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.770812:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c52ef3 lrc: 2/0,0 mode: PW/PW res: [0x2bb0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.770814:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c52efa lrc: 3/0,0 mode: PW/PW res: [0x2bb0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.770815:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b9e4c5a0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529344.770817:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c52ef3 lrc: 2/0,0 mode: PW/PW res: [0x2bb0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.770819:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c52efa lrc: 1/0,0 mode: --/PW res: [0x2bb0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.770820:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c52ef3 lrc: 3/0,0 mode: PW/PW res: [0x2bb0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529344.770822:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c52efa lrc: 0/0,0 mode: --/PW res: [0x2bb0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.770824:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c52ef3 lrc: 1/0,0 mode: --/PW res: [0x2bb0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529344.770827:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c52ef3 lrc: 0/0,0 mode: --/PW res: [0x2bb0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529348.320131:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529348.320158:0:72398:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946547776 00000100:00100000:0.0:1651529348.320175:0:72398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 569 00000100:00100000:0.0:1651529348.320178:0:72398:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+2005:39029:x1731745946547776:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651529348.320188:0:72398:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8580544 pending 0 free 81328046080 avail 77157335040 00000100:00100000:0.0:1651529348.320205:0:72398:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+2005:39029:x1731745946547776:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 27us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529348.320208:0:72398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 569 00000001:00080000:0.0:1651529350.384293:0:72382:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 12885080565 is committed 00000100:00100000:1.0:1651529353.440220:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529353.440262:0:72398:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946581376 00000100:00100000:0.0:1651529353.440286:0:72398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 570 00000100:00100000:0.0:1651529353.440288:0:72398:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946581376:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651529353.440307:0:72398:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8580544 pending 0 free 81328046080 avail 77157335040 00000100:00100000:0.0:1651529353.440333:0:72398:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946581376:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 44us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529353.440337:0:72398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 570 00000100:00100000:1.0:1651529358.560182:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529358.560199:0:72398:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946581504 00000100:00100000:1.0:1651529358.560217:0:72398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 571 00000100:00100000:1.0:1651529358.560220:0:72398:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946581504:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651529358.560253:0:72398:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8580544 pending 0 free 81328046080 avail 77157335040 00000100:00100000:1.0:1651529358.560287:0:72398:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c20a6e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946581504:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 67us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529358.560291:0:72398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 571 00000100:00100000:1.0:1651529363.680945:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529363.680963:0:72398:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946581632 00000100:00100000:1.0:1651529363.680987:0:72398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 572 00000100:00100000:1.0:1651529363.680989:0:72398:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a13808c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946581632:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651529363.681006:0:72398:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8580544 pending 0 free 81328046080 avail 77157335040 00000100:00100000:1.0:1651529363.681034:0:72398:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a13808c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946581632:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 44us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529363.681037:0:72398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 572 00000400:00000080:1.0:1651529364.502874:0:157358:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651529364.502876:0:157358:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 124d: cancel very aged locks if lru-resize diasbaled ========================================================== 22:09:24 (1651529364) 00000100:00100000:1.0:1651529364.563251:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529364.563285:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946581696 00000100:00100000:0.0:1651529364.563310:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212511 00000100:00100000:0.0:1651529364.563312:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:137466:x1731745946581696:12345-10.240.43.61@tcp:5:osp-pre-1-0.0 00002000:00080000:0.0:1651529364.563335:0:151609:0:(ofd_dev.c:1706:ofd_create_hdl()) lustre-OST0001: reserve 64 objects in group 0x0 at 179042 00000100:00100000:0.0:1651529364.564257:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:137466:x1731745946581696:12345-10.240.43.61@tcp:5:osp-pre-1-0.0 Request processed in 943us (1008us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.564261:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212511 00000100:00100000:1.0:1651529364.634061:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529364.634092:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946581952 00000100:00100000:0.0:1651529364.634110:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212512 00000100:00100000:0.0:1651529364.634112:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946581952:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529364.634122:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178959 count 1 00010000:00010000:0.0:1651529364.634134:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52f01 lrc: 3/0,1 mode: --/PW res: [0x2bb0f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529364.634144:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c4f7e1 lrc: 2/0,0 mode: PR/PR res: [0x2bb0f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94a5 expref: 54 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.634148:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.634149:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.634150:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52f01 lrc: 4/0,1 mode: --/PW res: [0x2bb0f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529364.634164:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c4f7e1 lrc: 3/0,0 mode: PR/PR res: [0x2bb0f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94a5 expref: 54 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.634170:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c4f7e1 lrc: 4/0,0 mode: PR/PR res: [0x2bb0f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94a5 expref: 54 pid: 80279 timeout: 20123 lvb_type: 1 00000100:00100000:0.0:1651529364.634179:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae466fbb pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997067456:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529364.634206:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bff8744a going to sleep for 6 seconds 00000100:00100000:1.0:1651529364.634558:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.634571:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae466fbb pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997067456:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529364.634575:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396504896 00010000:00010000:0.0:1651529364.634580:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52f01 lrc: 3/0,1 mode: --/PW res: [0x2bb0f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529364.634584:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c4f7e1 lrc: 4/0,0 mode: PR/PR res: [0x2bb0f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94a5 expref: 55 pid: 80279 timeout: 20123 lvb_type: 1 00000100:00100000:1.0:1651529364.634596:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13293 00000100:00100000:1.0:1651529364.634598:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+55:41279:x1731746396504896:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529364.634602:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529364.634604:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c4f7e1 lrc: 4/0,0 mode: PR/PR res: [0x2bb0f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94a5 expref: 55 pid: 80279 timeout: 20123 lvb_type: 1 00010000:00010000:1.0:1651529364.634608:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c4f7e1 lrc: 3/0,0 mode: PR/PR res: [0x2bb0f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94a5 expref: 55 pid: 80279 timeout: 20123 lvb_type: 1 00010000:00010000:1.0:1651529364.634617:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c4f7e1 lrc: 0/0,0 mode: --/PR res: [0x2bb0f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94a5 expref: 55 pid: 80279 timeout: 20123 lvb_type: 1 00010000:00010000:1.0:1651529364.634622:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529364.634622:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529364.634624:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52f01 lrc: 3/0,1 mode: PW/PW res: [0x2bb0f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529364.634628:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52f01 lrc: 4/0,1 mode: PW/PW res: [0x2bb0f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529364.634638:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529364.634644:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52f01 lrc: 3/0,1 mode: PW/PW res: [0x2bb0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529364.634648:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52f01 lrc: 3/0,1 mode: PW/PW res: [0x2bb0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529364.634650:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+54:41279:x1731746396504896:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 51us (93us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529364.634652:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52f01 lrc: 3/0,1 mode: PW/PW res: [0x2bb0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529364.634653:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13293 00010000:00010000:0.0:1651529364.634655:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52f01 lrc: 2/0,0 mode: PW/PW res: [0x2bb0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529364.634699:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52f01 lrc: 2/0,0 mode: PW/PW res: [0x2bb0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529364.634703:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000082ae179c already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529364.634705:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52f01 lrc: 2/0,0 mode: PW/PW res: [0x2bb0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529364.634709:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52f01 lrc: 3/0,0 mode: PW/PW res: [0x2bb0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529364.634714:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52f01 lrc: 1/0,0 mode: --/PW res: [0x2bb0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529364.634717:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52f01 lrc: 0/0,0 mode: --/PW res: [0x2bb0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529364.634728:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946581952:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 615us (669us total) trans 12885080566 rc 0/0 00000100:00100000:0.0:1651529364.634732:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212512 00000100:00100000:1.0:1651529364.654626:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.654645:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396508672 00000100:00100000:0.0:1651529364.654661:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212513 00000100:00100000:0.0:1651529364.654662:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+54:41278:x1731746396508672:12345-10.240.43.64@tcp:101:ls.0 00010000:00010000:0.0:1651529364.654669:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.654674:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c52f08 lrc: 2/0,0 mode: --/PR res: [0x2bb4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9c69 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.654682:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb4a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.654688:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.654688:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.654690:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c52f08 lrc: 3/0,0 mode: PR/PR res: [0x2bb4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9c69 expref: 55 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.654696:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c52f08 lrc: 3/0,0 mode: PR/PR res: [0x2bb4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9c69 expref: 55 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.654701:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9cfe902, rc 0) 00000100:00100000:0.0:1651529364.654718:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+55:41278:x1731746396508672:12345-10.240.43.64@tcp:101:ls.0 Request processed in 54us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.654721:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212513 00000100:00100000:1.0:1651529364.655104:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.655122:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396508736 00000100:00100000:0.0:1651529364.655135:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212514 00000100:00100000:0.0:1651529364.655137:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+55:41278:x1731746396508736:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:0.0:1651529364.655141:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.655145:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c52f0f lrc: 2/0,0 mode: --/PR res: [0x2bb47:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9c70 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.655151:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb47:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.655155:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.655156:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.655158:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c52f0f lrc: 3/0,0 mode: PR/PR res: [0x2bb47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9c70 expref: 56 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.655162:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c52f0f lrc: 3/0,0 mode: PR/PR res: [0x2bb47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9c70 expref: 56 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.655166:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000009fe5580, rc 0) 00000100:00100000:0.0:1651529364.655181:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+56:41278:x1731746396508736:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 43us (78us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.655184:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212514 00000100:00100000:1.0:1651529364.656660:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.656679:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396509568 00000100:00100000:0.0:1651529364.656693:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212515 00000100:00100000:0.0:1651529364.656694:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+56:41278:x1731746396509568:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:0.0:1651529364.656698:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.656703:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c52f16 lrc: 2/0,0 mode: --/PR res: [0x2bb52:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9cb6 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.656709:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb52:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.656712:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.656713:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.656715:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c52f16 lrc: 3/0,0 mode: PR/PR res: [0x2bb52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9cb6 expref: 57 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.656719:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c52f16 lrc: 3/0,0 mode: PR/PR res: [0x2bb52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9cb6 expref: 57 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.656723:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042bde05b, rc 0) 00000100:00100000:0.0:1651529364.656738:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+57:41278:x1731746396509568:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 43us (79us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.656741:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212515 00000100:00100000:1.0:1651529364.657637:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.657655:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396510592 00000100:00100000:0.0:1651529364.657668:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212516 00000100:00100000:0.0:1651529364.657670:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+57:41278:x1731746396510592:12345-10.240.43.64@tcp:101:ll_agl_412094.0 00010000:00010000:0.0:1651529364.657673:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.657678:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c52f1d lrc: 2/0,0 mode: --/PR res: [0x2bb61:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9d18 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.657683:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb61:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.657687:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.657687:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.657689:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c52f1d lrc: 3/0,0 mode: PR/PR res: [0x2bb61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9d18 expref: 58 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.657693:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c52f1d lrc: 3/0,0 mode: PR/PR res: [0x2bb61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9d18 expref: 58 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.657697:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c822bd1c, rc 0) 00000100:00100000:0.0:1651529364.657712:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+58:41278:x1731746396510592:12345-10.240.43.64@tcp:101:ll_agl_412094.0 Request processed in 41us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.657715:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212516 00000100:00100000:1.0:1651529364.657779:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529364.657789:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.657790:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396510656 00000100:00100000:0.0:1651529364.657798:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396510720 00000100:00100000:1.0:1651529364.657802:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212517 00000100:00100000:1.0:1651529364.657804:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+59:41278:x1731746396510656:12345-10.240.43.64@tcp:101:ll_agl_412094.0 00000100:00100000:0.0:1651529364.657804:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212518 00000100:00100000:0.0:1651529364.657806:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+59:41278:x1731746396510720:12345-10.240.43.64@tcp:101:ll_agl_412094.0 00010000:00010000:1.0:1651529364.657809:0:80279:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.657809:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.657814:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52f24 lrc: 2/0,0 mode: --/PR res: [0x2bb5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9d26 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529364.657815:0:80279:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c52f2b lrc: 2/0,0 mode: --/PR res: [0x2bb51:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9d1f expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.657819:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb5c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:1.0:1651529364.657822:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb51:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.657823:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.657824:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.657825:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52f24 lrc: 3/0,0 mode: PR/PR res: [0x2bb5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9d26 expref: 61 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529364.657827:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529364.657828:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529364.657830:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c52f2b lrc: 3/0,0 mode: PR/PR res: [0x2bb51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9d1f expref: 61 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.657830:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52f24 lrc: 3/0,0 mode: PR/PR res: [0x2bb5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9d26 expref: 61 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.657834:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002f450f42, rc 0) 00010000:00010000:1.0:1651529364.657835:0:80279:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c52f2b lrc: 3/0,0 mode: PR/PR res: [0x2bb51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9d1f expref: 61 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529364.657839:0:80279:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006512b8a0, rc 0) 00000100:00100000:0.0:1651529364.657848:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+61:41278:x1731746396510720:12345-10.240.43.64@tcp:101:ll_agl_412094.0 Request processed in 41us (58us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.657851:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212518 00000100:00100000:1.0:1651529364.657855:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+60:41278:x1731746396510656:12345-10.240.43.64@tcp:101:ll_agl_412094.0 Request processed in 50us (76us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529364.657858:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212517 00000100:00100000:1.0:1651529364.659404:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529364.659412:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529364.659423:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529364.659433:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396510976 00000100:00100000:0.0:1651529364.659436:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396511360 00000100:00100000:1.0:1651529364.659442:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396511232 00000100:00100000:1.0:1651529364.659449:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212519 00000100:00100000:1.0:1651529364.659451:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+62:41279:x1731746396510976:12345-10.240.43.64@tcp:101:ll_agl_412094.0 00000100:00100000:0.0:1651529364.659452:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212520 00010000:00010000:1.0:1651529364.659454:0:80279:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00000100:00100000:0.0:1651529364.659454:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+62:41279:x1731746396511232:12345-10.240.43.64@tcp:101:ll_agl_412094.0 00010000:00010000:0.0:1651529364.659457:0:72395:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529364.659459:0:80279:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c52f32 lrc: 2/0,0 mode: --/PR res: [0x2bb69:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9d3b expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529364.659462:0:72395:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c52f39 lrc: 2/0,0 mode: --/PR res: [0x2bb70:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9d50 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529364.659464:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb69:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529364.659468:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00010000:0.0:1651529364.659468:0:72395:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb70:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529364.659469:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529364.659471:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c52f32 lrc: 3/0,0 mode: PR/PR res: [0x2bb69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9d3b expref: 64 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.659471:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.659472:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.659474:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c52f39 lrc: 3/0,0 mode: PR/PR res: [0x2bb70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9d50 expref: 64 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529364.659475:0:80279:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c52f32 lrc: 3/0,0 mode: PR/PR res: [0x2bb69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9d3b expref: 64 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.659478:0:72395:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c52f39 lrc: 3/0,0 mode: PR/PR res: [0x2bb70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9d50 expref: 64 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529364.659479:0:80279:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000589cc6c, rc 0) 00010000:00010000:0.0:1651529364.659482:0:72395:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005b8e72f9, rc 0) 00000100:00100000:1.0:1651529364.659489:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+64:41279:x1731746396510976:12345-10.240.43.64@tcp:101:ll_agl_412094.0 Request processed in 38us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.659491:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+64:41279:x1731746396511232:12345-10.240.43.64@tcp:101:ll_agl_412094.0 Request processed in 37us (68us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529364.659492:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212519 00000100:00100000:0.0:1651529364.659494:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212520 00000100:00100000:1.0:1651529364.659497:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212521 00000100:00100000:1.0:1651529364.659499:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+62:41279:x1731746396511360:12345-10.240.43.64@tcp:101:ll_agl_412094.0 00010000:00010000:1.0:1651529364.659501:0:80279:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529364.659505:0:80279:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c52f40 lrc: 2/0,0 mode: --/PR res: [0x2bb44:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9d65 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529364.659510:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb44:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529364.659513:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529364.659513:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529364.659515:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c52f40 lrc: 3/0,0 mode: PR/PR res: [0x2bb44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9d65 expref: 63 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529364.659519:0:80279:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c52f40 lrc: 3/0,0 mode: PR/PR res: [0x2bb44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9d65 expref: 63 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529364.659522:0:80279:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b9e4c5a0, rc 0) 00000100:00100000:1.0:1651529364.659527:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+63:41279:x1731746396511360:12345-10.240.43.64@tcp:101:ll_agl_412094.0 Request processed in 28us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529364.659530:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212521 00000100:00100000:1.0:1651529364.661060:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529364.661068:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396512576 00000100:00100000:1.0:1651529364.661080:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212522 00000100:00100000:1.0:1651529364.661082:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+63:41278:x1731746396512576:12345-10.240.43.64@tcp:101:ll_agl_412094.0 00010000:00010000:1.0:1651529364.661085:0:80279:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529364.661089:0:80279:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006317cd4c/0x3234de053c52f47 lrc: 2/0,0 mode: --/PR res: [0x2bb49:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9ddc expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529364.661095:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb49:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529364.661098:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529364.661099:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529364.661101:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006317cd4c/0x3234de053c52f47 lrc: 3/0,0 mode: PR/PR res: [0x2bb49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9ddc expref: 64 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529364.661105:0:80279:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006317cd4c/0x3234de053c52f47 lrc: 3/0,0 mode: PR/PR res: [0x2bb49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9ddc expref: 64 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529364.661111:0:80279:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006317cd4c, rc 0) 00000100:00100000:1.0:1651529364.661125:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+64:41278:x1731746396512576:12345-10.240.43.64@tcp:101:ll_agl_412094.0 Request processed in 43us (65us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529364.661128:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212522 00000100:00100000:1.0:1651529364.661201:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529364.661208:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529364.661231:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.661231:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396512768 00000100:00100000:1.0:1651529364.661241:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396512832 00000100:00100000:0.0:1651529364.661244:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396512960 00000100:00100000:1.0:1651529364.661250:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212523 00000100:00100000:1.0:1651529364.661252:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+66:41278:x1731746396512768:12345-10.240.43.64@tcp:101:ll_agl_412094.0 00010000:00010000:1.0:1651529364.661255:0:80279:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00000100:00100000:0.0:1651529364.661257:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212524 00010000:00010000:1.0:1651529364.661259:0:80279:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c52f4e lrc: 2/0,0 mode: --/PR res: [0x2bb5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9df1 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529364.661259:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+66:41278:x1731746396512832:12345-10.240.43.64@tcp:101:ll_agl_412094.0 00010000:00010000:0.0:1651529364.661262:0:80277:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00002000:00010000:1.0:1651529364.661264:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb5b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.661267:0:80277:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c52f55 lrc: 2/0,0 mode: --/PR res: [0x2bb5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9df8 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529364.661268:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529364.661269:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529364.661270:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c52f4e lrc: 3/0,0 mode: PR/PR res: [0x2bb5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9df1 expref: 67 pid: 80279 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1651529364.661272:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb5a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529364.661275:0:80279:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c52f4e lrc: 3/0,0 mode: PR/PR res: [0x2bb5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9df1 expref: 68 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.661276:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.661277:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529364.661278:0:80279:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000033d777ce, rc 0) 00010000:00010000:0.0:1651529364.661279:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c52f55 lrc: 3/0,0 mode: PR/PR res: [0x2bb5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9df8 expref: 68 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.661283:0:80277:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c52f55 lrc: 3/0,0 mode: PR/PR res: [0x2bb5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9df8 expref: 68 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.661287:0:80277:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005e711cee, rc 0) 00000100:00100000:1.0:1651529364.661290:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+68:41278:x1731746396512768:12345-10.240.43.64@tcp:101:ll_agl_412094.0 Request processed in 37us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529364.661293:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212523 00000100:00100000:1.0:1651529364.661298:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212525 00000100:00100000:1.0:1651529364.661300:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+67:41278:x1731746396512960:12345-10.240.43.64@tcp:101:ll_agl_412094.0 00000100:00100000:0.0:1651529364.661302:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+67:41278:x1731746396512832:12345-10.240.43.64@tcp:101:ll_agl_412094.0 Request processed in 43us (94us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529364.661303:0:80279:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00000100:00100000:0.0:1651529364.661305:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212524 00010000:00010000:1.0:1651529364.661306:0:80279:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c52f5c lrc: 2/0,0 mode: --/PR res: [0x2bb5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9e06 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529364.661311:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb5d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529364.661314:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529364.661314:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529364.661316:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c52f5c lrc: 3/0,0 mode: PR/PR res: [0x2bb5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9e06 expref: 67 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529364.661320:0:80279:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c52f5c lrc: 3/0,0 mode: PR/PR res: [0x2bb5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9e06 expref: 67 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529364.661323:0:80279:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000037a4f3dc, rc 0) 00000100:00100000:1.0:1651529364.661329:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+67:41278:x1731746396512960:12345-10.240.43.64@tcp:101:ll_agl_412094.0 Request processed in 29us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529364.661332:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212525 00000100:00100000:1.0:1651529364.661838:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529364.661846:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396513152 00000100:00100000:1.0:1651529364.661853:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212526 00000100:00100000:1.0:1651529364.661854:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+67:41279:x1731746396513152:12345-10.240.43.64@tcp:101:ll_agl_412094.0 00010000:00010000:1.0:1651529364.661857:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529364.661862:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c52f63 lrc: 2/0,0 mode: --/PR res: [0x2bb58:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9e14 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529364.661867:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb58:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529364.661870:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529364.661871:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529364.661872:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c52f63 lrc: 3/0,0 mode: PR/PR res: [0x2bb58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9e14 expref: 68 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529364.661876:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c52f63 lrc: 3/0,0 mode: PR/PR res: [0x2bb58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9e14 expref: 68 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529364.661880:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d571c418, rc 0) 00000100:00100000:1.0:1651529364.661895:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+68:41279:x1731746396513152:12345-10.240.43.64@tcp:101:ll_agl_412094.0 Request processed in 40us (57us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529364.661898:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212526 00000100:00100000:1.0:1651529364.663052:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529364.663061:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529364.663067:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529364.663079:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529364.663088:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396513536 00000100:00100000:1.0:1651529364.663096:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396513728 00000100:00100000:1.0:1651529364.663102:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396513920 00000100:00100000:1.0:1651529364.663107:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396513984 00000100:00100000:0.0:1651529364.663110:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212527 00000100:00100000:0.0:1651529364.663112:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096d94b7b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+71:41279:x1731746396513536:12345-10.240.43.64@tcp:101:ll_agl_412094.0 00000100:00100000:1.0:1651529364.663116:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212528 00000100:00100000:1.0:1651529364.663118:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+71:41279:x1731746396513728:12345-10.240.43.64@tcp:101:ll_agl_412094.0 00010000:00010000:1.0:1651529364.663121:0:80279:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.663121:0:80276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529364.663126:0:80279:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c52f71 lrc: 2/0,0 mode: --/PR res: [0x2bb72:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9e45 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529364.663126:0:80276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c52f6a lrc: 2/0,0 mode: --/PR res: [0x2bb67:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9e37 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529364.663131:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb72:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:0.0:1651529364.663131:0:80276:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb67:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529364.663135:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529364.663135:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.663135:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.663136:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529364.663137:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c52f71 lrc: 3/0,0 mode: PR/PR res: [0x2bb72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9e45 expref: 73 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.663138:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c52f6a lrc: 3/0,0 mode: PR/PR res: [0x2bb67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9e37 expref: 73 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529364.663141:0:80279:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c52f71 lrc: 3/0,0 mode: PR/PR res: [0x2bb72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9e45 expref: 73 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.663142:0:80276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c52f6a lrc: 3/0,0 mode: PR/PR res: [0x2bb67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9e37 expref: 73 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529364.663145:0:80279:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000337d9d20, rc 0) 00010000:00010000:0.0:1651529364.663146:0:80276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b0407aaf, rc 0) 00000100:00100000:1.0:1651529364.663156:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+73:41279:x1731746396513728:12345-10.240.43.64@tcp:101:ll_agl_412094.0 Request processed in 37us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529364.663159:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212528 00000100:00100000:1.0:1651529364.663164:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212529 00000100:00100000:1.0:1651529364.663166:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+72:41279:x1731746396513920:12345-10.240.43.64@tcp:101:ll_agl_412094.0 00010000:00010000:1.0:1651529364.663168:0:80279:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529364.663171:0:80279:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c52f78 lrc: 2/0,0 mode: --/PR res: [0x2bb5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9e5a expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529364.663181:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096d94b7b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+72:41279:x1731746396513536:12345-10.240.43.64@tcp:101:ll_agl_412094.0 Request processed in 67us (129us total) trans 0 rc 0/0 00002000:00010000:1.0:1651529364.663183:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb5f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1651529364.663184:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212527 00010000:00010000:1.0:1651529364.663186:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529364.663187:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529364.663188:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c52f78 lrc: 3/0,0 mode: PR/PR res: [0x2bb5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9e5a expref: 72 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529364.663192:0:80279:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c52f78 lrc: 3/0,0 mode: PR/PR res: [0x2bb5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9e5a expref: 72 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529364.663196:0:80279:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c5d6b959, rc 0) 00000100:00100000:1.0:1651529364.663203:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+72:41279:x1731746396513920:12345-10.240.43.64@tcp:101:ll_agl_412094.0 Request processed in 37us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529364.663206:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212529 00000100:00100000:1.0:1651529364.663210:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212530 00000100:00100000:1.0:1651529364.663212:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+71:41279:x1731746396513984:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:1.0:1651529364.663214:0:80279:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529364.663217:0:80279:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c52f7f lrc: 2/0,0 mode: --/PR res: [0x2bb56:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9e68 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529364.663234:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb56:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529364.663238:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529364.663238:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529364.663240:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c52f7f lrc: 3/0,0 mode: PR/PR res: [0x2bb56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9e68 expref: 72 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529364.663243:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529364.663244:0:80279:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c52f7f lrc: 3/0,0 mode: PR/PR res: [0x2bb56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9e68 expref: 72 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529364.663248:0:80279:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000027775c45, rc 0) 00000100:00100000:1.0:1651529364.663255:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+72:41279:x1731746396513984:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 43us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529364.663258:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212530 00000100:00100000:1.0:1651529364.663262:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396514176 00000100:00100000:1.0:1651529364.663271:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212531 00000100:00100000:1.0:1651529364.663273:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+72:41279:x1731746396514176:12345-10.240.43.64@tcp:101:ll_agl_412094.0 00010000:00010000:1.0:1651529364.663300:0:80279:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529364.663304:0:80279:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c52f86 lrc: 2/0,0 mode: --/PR res: [0x2bb57:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9e76 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529364.663310:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb57:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529364.663313:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529364.663314:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529364.663315:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c52f86 lrc: 3/0,0 mode: PR/PR res: [0x2bb57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9e76 expref: 73 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529364.663319:0:80279:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c52f86 lrc: 3/0,0 mode: PR/PR res: [0x2bb57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9e76 expref: 73 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529364.663323:0:80279:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f1a88dd0, rc 0) 00000100:00100000:1.0:1651529364.663335:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+73:41279:x1731746396514176:12345-10.240.43.64@tcp:101:ll_agl_412094.0 Request processed in 62us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529364.663338:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212531 00000100:00100000:0.0:1651529364.664381:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.664391:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.664398:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529364.664403:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396514368 00000100:00100000:0.0:1651529364.664405:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529364.664413:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396514624 00000100:00100000:1.0:1651529364.664417:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396514752 00000100:00100000:1.0:1651529364.664423:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212532 00000100:00100000:0.0:1651529364.664424:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396514688 00000100:00100000:1.0:1651529364.664425:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+75:41278:x1731746396514368:12345-10.240.43.64@tcp:101:ll_agl_412094.0 00010000:00010000:1.0:1651529364.664428:0:80279:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00000100:00100000:0.0:1651529364.664436:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212533 00010000:00010000:1.0:1651529364.664438:0:80279:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c52f8d lrc: 2/0,0 mode: --/PR res: [0x2bb50:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9e84 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529364.664438:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+76:41278:x1731746396514624:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:0.0:1651529364.664441:0:72395:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00002000:00010000:1.0:1651529364.664446:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb50:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.664446:0:72395:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c52f94 lrc: 2/0,0 mode: --/PR res: [0x2bb4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9ea0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529364.664449:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529364.664450:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00010000:0.0:1651529364.664451:0:72395:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb4f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529364.664452:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c52f8d lrc: 3/0,0 mode: PR/PR res: [0x2bb50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9e84 expref: 77 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.664455:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529364.664456:0:80279:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c52f8d lrc: 3/0,0 mode: PR/PR res: [0x2bb50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9e84 expref: 78 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.664456:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.664457:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c52f94 lrc: 3/0,0 mode: PR/PR res: [0x2bb4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9ea0 expref: 78 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529364.664460:0:80279:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d09e97cf, rc 0) 00010000:00010000:0.0:1651529364.664462:0:72395:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c52f94 lrc: 3/0,0 mode: PR/PR res: [0x2bb4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9ea0 expref: 78 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.664466:0:72395:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000a7c37b9, rc 0) 00000100:00100000:1.0:1651529364.664469:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+78:41278:x1731746396514368:12345-10.240.43.64@tcp:101:ll_agl_412094.0 Request processed in 44us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529364.664472:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212532 00000100:00100000:0.0:1651529364.664474:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+78:41278:x1731746396514624:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 35us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.664476:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212533 00000100:00100000:1.0:1651529364.664478:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212534 00000100:00100000:1.0:1651529364.664480:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+76:41278:x1731746396514752:12345-10.240.43.64@tcp:101:ll_agl_412094.0 00010000:00010000:1.0:1651529364.664482:0:80279:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00000100:00100000:0.0:1651529364.664482:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212535 00000100:00100000:0.0:1651529364.664483:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+76:41278:x1731746396514688:12345-10.240.43.64@tcp:101:ll_agl_412094.0 00010000:00010000:1.0:1651529364.664486:0:80279:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c52f9b lrc: 2/0,0 mode: --/PR res: [0x2bb68:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9eae expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529364.664486:0:72395:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.664489:0:72395:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52fa2 lrc: 2/0,0 mode: --/PR res: [0x2bb4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9ea7 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529364.664490:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb68:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529364.664492:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529364.664493:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00010000:0.0:1651529364.664493:0:72395:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb4e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529364.664494:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c52f9b lrc: 3/0,0 mode: PR/PR res: [0x2bb68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9eae expref: 77 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.664496:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.664497:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529364.664498:0:80279:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c52f9b lrc: 3/0,0 mode: PR/PR res: [0x2bb68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9eae expref: 78 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.664498:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52fa2 lrc: 3/0,0 mode: PR/PR res: [0x2bb4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9ea7 expref: 78 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529364.664502:0:80279:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a9b4b5b4, rc 0) 00010000:00010000:0.0:1651529364.664502:0:72395:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52fa2 lrc: 3/0,0 mode: PR/PR res: [0x2bb4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9ea7 expref: 78 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.664505:0:72395:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000082ae179c, rc 0) 00000100:00100000:1.0:1651529364.664507:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+78:41278:x1731746396514752:12345-10.240.43.64@tcp:101:ll_agl_412094.0 Request processed in 27us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529364.664510:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212534 00000100:00100000:0.0:1651529364.664511:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+78:41278:x1731746396514688:12345-10.240.43.64@tcp:101:ll_agl_412094.0 Request processed in 27us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.664513:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212535 00000100:00100000:0.0:1651529364.665316:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.665323:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396514944 00000100:00100000:0.0:1651529364.665330:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212536 00000100:00100000:0.0:1651529364.665332:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+77:41278:x1731746396514944:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:0.0:1651529364.665335:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.665339:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c52fa9 lrc: 2/0,0 mode: --/PR res: [0x2bb55:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9ebc expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.665345:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb55:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.665348:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.665349:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.665350:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c52fa9 lrc: 3/0,0 mode: PR/PR res: [0x2bb55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9ebc expref: 78 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.665354:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c52fa9 lrc: 3/0,0 mode: PR/PR res: [0x2bb55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9ebc expref: 78 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.665361:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000036d87bb6, rc 0) 00000100:00100000:0.0:1651529364.665376:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+78:41278:x1731746396514944:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 43us (60us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.665379:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212536 00000100:00100000:0.0:1651529364.665932:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.665939:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396515328 00000100:00100000:0.0:1651529364.665946:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212537 00000100:00100000:0.0:1651529364.665947:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+78:41278:x1731746396515328:12345-10.240.43.64@tcp:101:ll_agl_412094.0 00010000:00010000:0.0:1651529364.665950:0:80276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.665955:0:80276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c52fb0 lrc: 2/0,0 mode: --/PR res: [0x2bb66:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9ed8 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.665959:0:80276:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb66:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.665963:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.665963:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.665965:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c52fb0 lrc: 3/0,0 mode: PR/PR res: [0x2bb66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9ed8 expref: 79 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.665969:0:80276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c52fb0 lrc: 3/0,0 mode: PR/PR res: [0x2bb66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9ed8 expref: 79 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.665973:0:80276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000916cff2, rc 0) 00000100:00100000:0.0:1651529364.665987:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+79:41278:x1731746396515328:12345-10.240.43.64@tcp:101:ll_agl_412094.0 Request processed in 39us (56us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.665990:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212537 00000100:00100000:0.0:1651529364.666352:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.666359:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396515392 00000100:00100000:0.0:1651529364.666365:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212538 00000100:00100000:0.0:1651529364.666367:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+79:41279:x1731746396515392:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:0.0:1651529364.666370:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.666374:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c52fb7 lrc: 2/0,0 mode: --/PR res: [0x2bb6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9edf expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.666379:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb6b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.666382:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.666382:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.666384:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c52fb7 lrc: 3/0,0 mode: PR/PR res: [0x2bb6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9edf expref: 80 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.666388:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c52fb7 lrc: 3/0,0 mode: PR/PR res: [0x2bb6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9edf expref: 80 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.666392:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000055fddd81, rc 0) 00000100:00100000:0.0:1651529364.666406:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+80:41279:x1731746396515392:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 38us (55us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.666409:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212538 00000100:00100000:0.0:1651529364.668605:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.668613:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396516160 00000100:00100000:0.0:1651529364.668619:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212539 00000100:00100000:0.0:1651529364.668621:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+80:41279:x1731746396516160:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:0.0:1651529364.668624:0:80276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.668628:0:80276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c52fbe lrc: 2/0,0 mode: --/PR res: [0x2bb6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9f17 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.668632:0:80276:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb6e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.668636:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.668636:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.668638:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c52fbe lrc: 3/0,0 mode: PR/PR res: [0x2bb6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9f17 expref: 81 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.668642:0:80276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c52fbe lrc: 3/0,0 mode: PR/PR res: [0x2bb6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9f17 expref: 81 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.668646:0:80276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000096ab8041, rc 0) 00000100:00100000:0.0:1651529364.668660:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+81:41279:x1731746396516160:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 39us (55us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.668663:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212539 00000100:00100000:0.0:1651529364.669767:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.669775:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396516544 00000100:00100000:0.0:1651529364.669781:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212540 00000100:00100000:0.0:1651529364.669783:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085af61db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+81:41278:x1731746396516544:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:0.0:1651529364.669786:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.669790:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52fc5 lrc: 2/0,0 mode: --/PR res: [0x2bb43:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9f33 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.669795:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb43:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.669799:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.669799:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.669801:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52fc5 lrc: 3/0,0 mode: PR/PR res: [0x2bb43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9f33 expref: 82 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.669808:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52fc5 lrc: 3/0,0 mode: PR/PR res: [0x2bb43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9f33 expref: 82 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.669811:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000cde66bc6, rc 0) 00000100:00100000:0.0:1651529364.669826:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085af61db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+82:41278:x1731746396516544:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 42us (59us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.669829:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212540 00000100:00100000:0.0:1651529364.670272:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.670279:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396516736 00000100:00100000:0.0:1651529364.670286:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212541 00000100:00100000:0.0:1651529364.670287:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+82:41279:x1731746396516736:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:0.0:1651529364.670290:0:80276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.670294:0:80276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52fcc lrc: 2/0,0 mode: --/PR res: [0x2bb4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9f41 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.670300:0:80276:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb4c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.670303:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.670303:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.670305:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52fcc lrc: 3/0,0 mode: PR/PR res: [0x2bb4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9f41 expref: 83 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.670309:0:80276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52fcc lrc: 3/0,0 mode: PR/PR res: [0x2bb4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9f41 expref: 83 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.670313:0:80276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003c075ac0, rc 0) 00000100:00100000:0.0:1651529364.670327:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+83:41279:x1731746396516736:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 39us (55us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.670330:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212541 00000100:00100000:0.0:1651529364.671018:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.671025:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396516928 00000100:00100000:0.0:1651529364.671032:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212542 00000100:00100000:0.0:1651529364.671033:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+83:41278:x1731746396516928:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:0.0:1651529364.671036:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.671040:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52fd3 lrc: 2/0,0 mode: --/PR res: [0x2bb62:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9f4f expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.671045:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb62:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.671048:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.671049:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.671050:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52fd3 lrc: 3/0,0 mode: PR/PR res: [0x2bb62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9f4f expref: 84 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.671054:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52fd3 lrc: 3/0,0 mode: PR/PR res: [0x2bb62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9f4f expref: 84 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.671058:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003551d5d1, rc 0) 00000100:00100000:0.0:1651529364.671072:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+84:41278:x1731746396516928:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 38us (55us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.671075:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212542 00000100:00100000:0.0:1651529364.672775:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.672783:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396517504 00000100:00100000:0.0:1651529364.672789:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212543 00000100:00100000:0.0:1651529364.672791:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+84:41279:x1731746396517504:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:0.0:1651529364.672795:0:80276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.672799:0:80276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52fda lrc: 2/0,0 mode: --/PR res: [0x2bb42:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9f79 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.672803:0:80276:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.672807:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.672808:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.672809:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52fda lrc: 3/0,0 mode: PR/PR res: [0x2bb42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9f79 expref: 85 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.672813:0:80276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52fda lrc: 3/0,0 mode: PR/PR res: [0x2bb42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9f79 expref: 85 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.672817:0:80276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009e44ce9d, rc 0) 00000100:00100000:0.0:1651529364.672832:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+85:41279:x1731746396517504:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 40us (57us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.672835:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212543 00000100:00100000:0.0:1651529364.673389:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.673396:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396517824 00000100:00100000:0.0:1651529364.673403:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212544 00000100:00100000:0.0:1651529364.673405:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+85:41278:x1731746396517824:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:0.0:1651529364.673408:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.673412:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52fe1 lrc: 2/0,0 mode: --/PR res: [0x2bb63:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9f8e expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.673416:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb63:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.673420:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.673421:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.673422:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52fe1 lrc: 3/0,0 mode: PR/PR res: [0x2bb63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9f8e expref: 86 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.673426:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52fe1 lrc: 3/0,0 mode: PR/PR res: [0x2bb63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9f8e expref: 86 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.673430:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f183a40b, rc 0) 00000100:00100000:0.0:1651529364.673444:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+86:41278:x1731746396517824:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 39us (55us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.673447:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212544 00000100:00100000:0.0:1651529364.673835:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.673842:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396517888 00000100:00100000:0.0:1651529364.673848:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212545 00000100:00100000:0.0:1651529364.673849:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+86:41279:x1731746396517888:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:0.0:1651529364.673852:0:80276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.673857:0:80276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52fe8 lrc: 2/0,0 mode: --/PR res: [0x2bb45:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9f95 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.673862:0:80276:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb45:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.673865:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.673865:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.673867:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52fe8 lrc: 3/0,0 mode: PR/PR res: [0x2bb45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9f95 expref: 87 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.673871:0:80276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52fe8 lrc: 3/0,0 mode: PR/PR res: [0x2bb45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9f95 expref: 87 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.673878:0:80276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000af20b5e7, rc 0) 00000100:00100000:0.0:1651529364.673893:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+87:41279:x1731746396517888:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 43us (59us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.673896:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212545 00000100:00100000:0.0:1651529364.674462:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.674469:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396518208 00000100:00100000:0.0:1651529364.674476:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212546 00000100:00100000:0.0:1651529364.674477:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+87:41278:x1731746396518208:12345-10.240.43.64@tcp:101:ll_agl_412094.0 00010000:00010000:0.0:1651529364.674481:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.674485:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52fef lrc: 2/0,0 mode: --/PR res: [0x2bb65:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9faa expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.674489:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb65:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.674493:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.674493:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.674495:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52fef lrc: 3/0,0 mode: PR/PR res: [0x2bb65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9faa expref: 88 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.674499:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52fef lrc: 3/0,0 mode: PR/PR res: [0x2bb65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9faa expref: 88 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.674503:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000877aab61, rc 0) 00000100:00100000:0.0:1651529364.674517:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+88:41278:x1731746396518208:12345-10.240.43.64@tcp:101:ll_agl_412094.0 Request processed in 39us (56us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.674520:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212546 00000100:00100000:0.0:1651529364.675908:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.675915:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396518656 00000100:00100000:0.0:1651529364.675921:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212547 00000100:00100000:0.0:1651529364.675923:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+88:41278:x1731746396518656:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:0.0:1651529364.675926:0:80276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.675930:0:80276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52ff6 lrc: 2/0,0 mode: --/PR res: [0x2bb41:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9fcd expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.675935:0:80276:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.675939:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.675939:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.675941:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52ff6 lrc: 3/0,0 mode: PR/PR res: [0x2bb41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9fcd expref: 89 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.675945:0:80276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52ff6 lrc: 3/0,0 mode: PR/PR res: [0x2bb41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9fcd expref: 89 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.675949:0:80276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008ac1e27e, rc 0) 00000100:00100000:0.0:1651529364.675963:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+89:41278:x1731746396518656:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 39us (56us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.675966:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212547 00000100:00100000:0.0:1651529364.676501:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.676508:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396518976 00000100:00100000:0.0:1651529364.676514:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212548 00000100:00100000:0.0:1651529364.676516:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+89:41278:x1731746396518976:12345-10.240.43.64@tcp:101:ll_agl_412094.0 00010000:00010000:0.0:1651529364.676519:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.676523:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52ffd lrc: 2/0,0 mode: --/PR res: [0x2bb4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2d9fe2 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.676528:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb4d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.676531:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.676532:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.676533:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52ffd lrc: 3/0,0 mode: PR/PR res: [0x2bb4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9fe2 expref: 90 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.676537:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52ffd lrc: 3/0,0 mode: PR/PR res: [0x2bb4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9fe2 expref: 90 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.676541:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000575eb734, rc 0) 00000100:00100000:0.0:1651529364.676555:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+90:41278:x1731746396518976:12345-10.240.43.64@tcp:101:ll_agl_412094.0 Request processed in 38us (55us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.676558:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212548 00000100:00100000:0.0:1651529364.679030:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.679037:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396519808 00000100:00100000:0.0:1651529364.679043:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212549 00000100:00100000:0.0:1651529364.679045:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+90:41279:x1731746396519808:12345-10.240.43.64@tcp:101:ll_agl_412094.0 00010000:00010000:0.0:1651529364.679048:0:80276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.679052:0:80276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c53004 lrc: 2/0,0 mode: --/PR res: [0x2bb6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da021 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.679057:0:80276:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb6f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.679060:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.679061:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.679062:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c53004 lrc: 3/0,0 mode: PR/PR res: [0x2bb6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da021 expref: 91 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.679069:0:80276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c53004 lrc: 3/0,0 mode: PR/PR res: [0x2bb6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da021 expref: 91 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.679073:0:80276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000046fea5cc, rc 0) 00000100:00100000:0.0:1651529364.679087:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+91:41279:x1731746396519808:12345-10.240.43.64@tcp:101:ll_agl_412094.0 Request processed in 41us (58us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.679090:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212549 00000100:00100000:0.0:1651529364.679892:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.679899:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396520128 00000100:00100000:0.0:1651529364.679905:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212550 00000100:00100000:0.0:1651529364.679907:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+91:41278:x1731746396520128:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:0.0:1651529364.679910:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.679914:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c5300b lrc: 2/0,0 mode: --/PR res: [0x2bb4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da036 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.679919:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb4b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.679922:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.679923:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.679924:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c5300b lrc: 3/0,0 mode: PR/PR res: [0x2bb4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da036 expref: 92 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.679928:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c5300b lrc: 3/0,0 mode: PR/PR res: [0x2bb4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da036 expref: 92 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.679932:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000050e053bc, rc 0) 00000100:00100000:0.0:1651529364.679947:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+92:41278:x1731746396520128:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 39us (55us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.679950:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212550 00000100:00100000:0.0:1651529364.680055:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.680062:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396520192 00000100:00100000:0.0:1651529364.680069:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212551 00000100:00100000:0.0:1651529364.680070:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+92:41278:x1731746396520192:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:0.0:1651529364.680074:0:80276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.680078:0:80276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c53012 lrc: 2/0,0 mode: --/PR res: [0x2bb53:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da03d expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.680083:0:80276:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb53:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.680086:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.680086:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.680088:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c53012 lrc: 3/0,0 mode: PR/PR res: [0x2bb53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da03d expref: 93 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.680092:0:80276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c53012 lrc: 3/0,0 mode: PR/PR res: [0x2bb53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da03d expref: 93 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.680096:0:80276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000820e505a, rc 0) 00000100:00100000:0.0:1651529364.680110:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+93:41278:x1731746396520192:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 38us (55us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.680113:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212551 00000100:00100000:0.0:1651529364.681927:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.681934:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396520768 00000100:00100000:0.0:1651529364.681941:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212552 00000100:00100000:0.0:1651529364.681943:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+93:41279:x1731746396520768:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:0.0:1651529364.681946:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.681949:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c53019 lrc: 2/0,0 mode: --/PR res: [0x2bb60:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da067 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.681954:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb60:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.681958:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.681958:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.681960:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c53019 lrc: 3/0,0 mode: PR/PR res: [0x2bb60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da067 expref: 94 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.681964:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c53019 lrc: 3/0,0 mode: PR/PR res: [0x2bb60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da067 expref: 94 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.681968:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f1b4c19f, rc 0) 00000100:00100000:0.0:1651529364.681982:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+94:41279:x1731746396520768:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 39us (56us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.681985:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212552 00000100:00100000:0.0:1651529364.685732:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.685739:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396522112 00000100:00100000:0.0:1651529364.685755:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212553 00000100:00100000:0.0:1651529364.685757:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+94:41278:x1731746396522112:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:0.0:1651529364.685760:0:80276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.685764:0:80276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c53020 lrc: 2/0,0 mode: --/PR res: [0x2bb6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da0c9 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.685769:0:80276:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb6a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.685772:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.685773:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.685774:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c53020 lrc: 3/0,0 mode: PR/PR res: [0x2bb6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da0c9 expref: 95 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.685779:0:80276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c53020 lrc: 3/0,0 mode: PR/PR res: [0x2bb6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da0c9 expref: 95 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.685782:0:80276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000490515f1, rc 0) 00000100:00100000:0.0:1651529364.685797:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+95:41278:x1731746396522112:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 39us (66us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.685800:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212553 00000100:00100000:0.0:1651529364.686234:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.686241:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396522304 00000100:00100000:0.0:1651529364.686247:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212554 00000100:00100000:0.0:1651529364.686249:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+95:41279:x1731746396522304:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:0.0:1651529364.686252:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.686256:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c53027 lrc: 2/0,0 mode: --/PR res: [0x2bb6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da0d7 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.686261:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb6d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.686265:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.686265:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.686267:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c53027 lrc: 3/0,0 mode: PR/PR res: [0x2bb6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da0d7 expref: 96 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.686271:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c53027 lrc: 3/0,0 mode: PR/PR res: [0x2bb6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da0d7 expref: 96 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.686277:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e7aaedb0, rc 0) 00000100:00100000:0.0:1651529364.686291:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+96:41279:x1731746396522304:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 41us (58us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.686294:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212554 00000100:00100000:0.0:1651529364.687860:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.687868:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396523008 00000100:00100000:0.0:1651529364.687874:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212555 00000100:00100000:0.0:1651529364.687876:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+96:41279:x1731746396523008:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:0.0:1651529364.687879:0:80276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.687883:0:80276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c5302e lrc: 2/0,0 mode: --/PR res: [0x2bb46:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da108 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.687888:0:80276:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb46:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.687891:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.687892:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.687893:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c5302e lrc: 3/0,0 mode: PR/PR res: [0x2bb46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da108 expref: 97 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.687898:0:80276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c5302e lrc: 3/0,0 mode: PR/PR res: [0x2bb46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da108 expref: 97 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.687901:0:80276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000091ee0f93, rc 0) 00000100:00100000:0.0:1651529364.687916:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+97:41279:x1731746396523008:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 39us (56us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.687919:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212555 00000100:00100000:0.0:1651529364.688306:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.688313:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396523072 00000100:00100000:0.0:1651529364.688319:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212556 00000100:00100000:0.0:1651529364.688321:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+97:41279:x1731746396523072:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:0.0:1651529364.688324:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.688328:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c53035 lrc: 2/0,0 mode: --/PR res: [0x2bb59:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da10f expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.688333:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb59:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.688336:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.688337:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.688338:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c53035 lrc: 3/0,0 mode: PR/PR res: [0x2bb59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da10f expref: 98 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.688342:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c53035 lrc: 3/0,0 mode: PR/PR res: [0x2bb59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da10f expref: 98 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.688346:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f9b62460, rc 0) 00000100:00100000:0.0:1651529364.688361:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+98:41279:x1731746396523072:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 39us (55us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.688363:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212556 00000100:00100000:0.0:1651529364.688853:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.688860:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396523264 00000100:00100000:0.0:1651529364.688866:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212557 00000100:00100000:0.0:1651529364.688868:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+98:41278:x1731746396523264:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:0.0:1651529364.688871:0:80276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.688876:0:80276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5303c lrc: 2/0,0 mode: --/PR res: [0x2bb48:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da11d expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.688880:0:80276:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb48:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.688884:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.688885:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.688886:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5303c lrc: 3/0,0 mode: PR/PR res: [0x2bb48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da11d expref: 99 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.688890:0:80276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5303c lrc: 3/0,0 mode: PR/PR res: [0x2bb48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da11d expref: 99 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.688894:0:80276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f0bd9bfb, rc 0) 00000100:00100000:0.0:1651529364.688908:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+99:41278:x1731746396523264:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 39us (56us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.688911:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212557 00000100:00100000:0.0:1651529364.690653:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.690661:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396523840 00000100:00100000:0.0:1651529364.690668:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212558 00000100:00100000:0.0:1651529364.690670:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+99:41279:x1731746396523840:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:0.0:1651529364.690674:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.690679:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c53043 lrc: 2/0,0 mode: --/PR res: [0x2bb64:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da147 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.690684:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb64:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.690688:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.690689:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.690690:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c53043 lrc: 3/0,0 mode: PR/PR res: [0x2bb64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da147 expref: 100 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.690697:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c53043 lrc: 3/0,0 mode: PR/PR res: [0x2bb64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da147 expref: 100 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.690701:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001391dc6d, rc 0) 00000100:00100000:0.0:1651529364.690718:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+100:41279:x1731746396523840:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 47us (66us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.690721:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212558 00000100:00100000:0.0:1651529364.691179:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.691187:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396524032 00000100:00100000:0.0:1651529364.691194:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212559 00000100:00100000:0.0:1651529364.691195:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+100:41278:x1731746396524032:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:0.0:1651529364.691199:0:80276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.691203:0:80276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c5304a lrc: 2/0,0 mode: --/PR res: [0x2bb6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da155 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.691208:0:80276:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb6c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.691212:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.691212:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.691214:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c5304a lrc: 3/0,0 mode: PR/PR res: [0x2bb6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da155 expref: 101 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.691218:0:80276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c5304a lrc: 3/0,0 mode: PR/PR res: [0x2bb6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da155 expref: 101 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.691240:0:80276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008517b233, rc 0) 00000100:00100000:0.0:1651529364.691255:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+101:41278:x1731746396524032:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 58us (76us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.691258:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212559 00000100:00100000:0.0:1651529364.691619:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.691626:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396524224 00000100:00100000:0.0:1651529364.691632:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212560 00000100:00100000:0.0:1651529364.691634:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+101:41279:x1731746396524224:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:0.0:1651529364.691637:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.691641:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c53051 lrc: 2/0,0 mode: --/PR res: [0x2bb71:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da163 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.691646:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb71:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.691649:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.691650:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.691652:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c53051 lrc: 3/0,0 mode: PR/PR res: [0x2bb71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da163 expref: 102 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.691656:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c53051 lrc: 3/0,0 mode: PR/PR res: [0x2bb71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da163 expref: 102 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.691660:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e85485c6, rc 0) 00000100:00100000:0.0:1651529364.691675:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+102:41279:x1731746396524224:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 40us (57us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.691678:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212560 00000100:00100000:0.0:1651529364.692285:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.692292:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396524416 00000100:00100000:0.0:1651529364.692299:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212561 00000100:00100000:0.0:1651529364.692300:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+102:41278:x1731746396524416:12345-10.240.43.64@tcp:101:ll_sa_412094.0 00010000:00010000:0.0:1651529364.692304:0:80276:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.692308:0:80276:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c53058 lrc: 2/0,0 mode: --/PR res: [0x2bb54:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da171 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.692313:0:80276:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb54:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.692317:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.692318:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.692319:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c53058 lrc: 3/0,0 mode: PR/PR res: [0x2bb54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da171 expref: 103 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.692323:0:80276:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c53058 lrc: 3/0,0 mode: PR/PR res: [0x2bb54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da171 expref: 103 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.692327:0:80276:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000576f1f12, rc 0) 00000100:00100000:0.0:1651529364.692343:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+103:41278:x1731746396524416:12345-10.240.43.64@tcp:101:ll_sa_412094.0 Request processed in 42us (59us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.692346:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212561 00000100:00100000:0.0:1651529364.695739:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529364.695757:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396525696 00000100:00100000:0.0:1651529364.695764:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212562 00000100:00100000:0.0:1651529364.695766:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+103:41279:x1731746396525696:12345-10.240.43.64@tcp:101:ll_agl_412094.0 00010000:00010000:0.0:1651529364.695769:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529364.695774:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c5305f lrc: 2/0,0 mode: --/PR res: [0x2bb5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da1c5 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529364.695779:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb5e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529364.695783:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.695783:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529364.695785:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c5305f lrc: 3/0,0 mode: PR/PR res: [0x2bb5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da1c5 expref: 104 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.695789:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c5305f lrc: 3/0,0 mode: PR/PR res: [0x2bb5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da1c5 expref: 104 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529364.695793:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001fc4c513, rc 0) 00000100:00100000:0.0:1651529364.695809:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+104:41279:x1731746396525696:12345-10.240.43.64@tcp:101:ll_agl_412094.0 Request processed in 42us (70us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529364.695812:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212562 00000100:00100000:1.0:1651529365.629297:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000027e31dd1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:39099:1731745997067584:10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00100000:0.0:1651529365.629299:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004bb67ba4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0b51168f-0bcb-46b1-964e-9e88a09501f8:39100:1731745997067520:10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00100000:0.0:1651529365.629599:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004bb67ba4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0b51168f-0bcb-46b1-964e-9e88a09501f8:39100:1731745997067520:10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00100000:1.0:1651529365.629600:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000027e31dd1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:39099:1731745997067584:10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00100000:1.0:1651529368.800145:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529368.800155:0:87247:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946582144 00000100:00100000:1.0:1651529368.800166:0:87247:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 573 00000100:00100000:1.0:1651529368.800168:0:87247:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946582144:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651529368.800178:0:87247:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8578752 pending 0 free 81328046080 avail 77157335040 00000100:00100000:1.0:1651529368.800192:0:87247:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027e31dd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946582144:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 23us (48us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529368.800195:0:87247:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 573 00000100:00100000:1.0:1651529369.854605:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529369.854620:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529369.854626:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529369.854635:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529369.854635:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946582784 00000100:00100000:1.0:1651529369.854643:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529369.854652:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529369.854665:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946582912 00000100:00100000:1.0:1651529369.854666:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529369.854673:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946583040 00000100:00100000:0.0:1651529369.854679:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946583168 00000100:00100000:0.0:1651529369.854684:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946582848 00000100:00100000:0.0:1651529369.854690:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946582976 00000100:00100000:0.0:1651529369.854692:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946583104 00000100:00100000:1.0:1651529369.854694:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529369.854697:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212563 00000100:00100000:0.0:1651529369.854699:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946582784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529369.854703:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946583232 00002000:00080000:0.0:1651529369.854707:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178960 count 1 00000100:00100000:1.0:1651529369.854711:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212564 00000100:00100000:1.0:1651529369.854713:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946582912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529369.854715:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c53066 lrc: 3/0,1 mode: --/PW res: [0x2bb10:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529369.854720:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178962 count 1 00010000:00010000:0.0:1651529369.854722:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c4f7c5 lrc: 2/0,0 mode: PR/PR res: [0x2bb10:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9451 expref: 103 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.854726:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c5306d lrc: 3/0,1 mode: --/PW res: [0x2bb12:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.854727:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.854728:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.854729:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c53066 lrc: 4/0,1 mode: --/PW res: [0x2bb10:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.854734:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003f39df31/0x3234de053c4f724 lrc: 2/0,0 mode: PR/PR res: [0x2bb12:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91fe expref: 103 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.854738:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.854738:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.854738:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c4f7c5 lrc: 3/0,0 mode: PR/PR res: [0x2bb10:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9451 expref: 103 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.854739:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c5306d lrc: 4/0,1 mode: --/PW res: [0x2bb12:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.854743:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c4f7c5 lrc: 4/0,0 mode: PR/PR res: [0x2bb10:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9451 expref: 103 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:0.0:1651529369.854762:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000066de8c9f pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997067648:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.854765:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003f39df31/0x3234de053c4f724 lrc: 3/0,0 mode: PR/PR res: [0x2bb12:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91fe expref: 103 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.854770:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003f39df31/0x3234de053c4f724 lrc: 4/0,0 mode: PR/PR res: [0x2bb12:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91fe expref: 103 pid: 72396 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.854775:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002f363f4a pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997067712:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529369.854780:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c2b2b59c going to sleep for 6 seconds 00000100:00100000:0.0:1651529369.854788:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212565 00000100:00100000:0.0:1651529369.854790:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946583040:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529369.854793:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000567ee0ef going to sleep for 6 seconds 00002000:00080000:0.0:1651529369.854796:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178964 count 1 00010000:00010000:0.0:1651529369.854800:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c53074 lrc: 3/0,1 mode: --/PW res: [0x2bb14:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.854801:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212566 00000100:00100000:1.0:1651529369.854803:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946583168:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529369.854805:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c4f819 lrc: 2/0,0 mode: PR/PR res: [0x2bb14:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95d2 expref: 103 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.854808:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1651529369.854809:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178966 count 1 00010000:00010000:0.0:1651529369.854809:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.854810:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c53074 lrc: 4/0,1 mode: --/PW res: [0x2bb14:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.854813:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c5307b lrc: 3/0,1 mode: --/PW res: [0x2bb16:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.854820:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c4f819 lrc: 3/0,0 mode: PR/PR res: [0x2bb14:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95d2 expref: 103 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.854821:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c4f827 lrc: 2/0,0 mode: PR/PR res: [0x2bb16:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95ee expref: 103 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.854824:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c4f819 lrc: 4/0,0 mode: PR/PR res: [0x2bb14:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95d2 expref: 103 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.854825:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.854825:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.854826:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c5307b lrc: 4/0,1 mode: --/PW res: [0x2bb16:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.854828:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005fb0ec6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997067776:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.854833:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c4f827 lrc: 3/0,0 mode: PR/PR res: [0x2bb16:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95ee expref: 103 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529369.854836:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 0000000076b354b3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529369.854837:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c4f827 lrc: 4/0,0 mode: PR/PR res: [0x2bb16:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95ee expref: 103 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.854841:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001d1586f2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997067840:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529369.854842:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212567 00000100:00100000:0.0:1651529369.854844:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946582848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529369.854848:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f79d8146 going to sleep for 6 seconds 00002000:00080000:0.0:1651529369.854850:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178961 count 1 00010000:00010000:0.0:1651529369.854853:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c53082 lrc: 3/0,1 mode: --/PW res: [0x2bb11:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.854856:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212568 00010000:00010000:0.0:1651529369.854857:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c4f7b0 lrc: 2/0,0 mode: PR/PR res: [0x2bb11:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d940b expref: 103 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529369.854858:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946582976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529369.854860:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.854861:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.854862:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c53082 lrc: 4/0,1 mode: --/PW res: [0x2bb11:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529369.854863:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178963 count 1 00010000:00010000:1.0:1651529369.854866:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c53089 lrc: 3/0,1 mode: --/PW res: [0x2bb13:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.854868:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c4f7b0 lrc: 3/0,0 mode: PR/PR res: [0x2bb11:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d940b expref: 103 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.854871:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c4f7d3 lrc: 2/0,0 mode: PR/PR res: [0x2bb13:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d946d expref: 103 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.854872:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c4f7b0 lrc: 4/0,0 mode: PR/PR res: [0x2bb11:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d940b expref: 103 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.854874:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.854875:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.854876:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c53089 lrc: 4/0,1 mode: --/PW res: [0x2bb13:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.854876:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004534b316 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997067904:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.854882:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c4f7d3 lrc: 3/0,0 mode: PR/PR res: [0x2bb13:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d946d expref: 103 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529369.854883:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ff7bf023 going to sleep for 6 seconds 00010000:00010000:1.0:1651529369.854886:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c4f7d3 lrc: 4/0,0 mode: PR/PR res: [0x2bb13:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d946d expref: 103 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:0.0:1651529369.854889:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212569 00000100:00100000:1.0:1651529369.854890:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002f77bb41 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997067968:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529369.854891:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946583104:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529369.854895:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178965 count 1 00000100:00100000:1.0:1651529369.854897:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd96f074 going to sleep for 6 seconds 00010000:00010000:0.0:1651529369.854899:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c53090 lrc: 3/0,1 mode: --/PW res: [0x2bb15:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.854903:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212570 00010000:00010000:0.0:1651529369.854903:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eeab415c/0x3234de053c4f6fa lrc: 2/0,0 mode: PR/PR res: [0x2bb15:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d913a expref: 103 pid: 156655 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529369.854905:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b750793d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946583232:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529369.854906:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.854907:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.854907:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c53090 lrc: 4/0,1 mode: --/PW res: [0x2bb15:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529369.854910:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178967 count 1 00010000:00010000:1.0:1651529369.854913:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c53097 lrc: 3/0,1 mode: --/PW res: [0x2bb17:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.854913:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eeab415c/0x3234de053c4f6fa lrc: 3/0,0 mode: PR/PR res: [0x2bb15:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d913a expref: 103 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.854917:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eeab415c/0x3234de053c4f6fa lrc: 4/0,0 mode: PR/PR res: [0x2bb15:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d913a expref: 103 pid: 156655 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.854918:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c4f740 lrc: 2/0,0 mode: PR/PR res: [0x2bb17:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92d0 expref: 103 pid: 80281 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.854921:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.854921:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529369.854921:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000822949b3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997068032:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.854922:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c53097 lrc: 4/0,1 mode: --/PW res: [0x2bb17:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.854927:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 000000003c8b0daf going to sleep for 6 seconds 00010000:00010000:1.0:1651529369.854928:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c4f740 lrc: 3/0,0 mode: PR/PR res: [0x2bb17:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92d0 expref: 103 pid: 80281 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.854934:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c4f740 lrc: 4/0,0 mode: PR/PR res: [0x2bb17:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92d0 expref: 103 pid: 80281 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.854938:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005d3fb3ef pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997068096:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529369.854945:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 0000000099c1da85 going to sleep for 6 seconds 00000100:00100000:0.0:1651529369.855253:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000066de8c9f pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997067648:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.855259:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c53066 lrc: 3/0,1 mode: --/PW res: [0x2bb10:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.855611:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529369.855621:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529369.855628:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001d1586f2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997067840:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529369.855631:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529369.855638:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c5307b lrc: 3/0,1 mode: --/PW res: [0x2bb16:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.855641:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529369.855653:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396528000 00000100:00100000:0.0:1651529369.855657:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004534b316 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997067904:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.855660:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c4f7c5 lrc: 4/0,0 mode: PR/PR res: [0x2bb10:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9451 expref: 104 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.855662:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c53082 lrc: 3/0,1 mode: --/PW res: [0x2bb11:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.855666:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396528128 00010000:00010000:1.0:1651529369.855668:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003f39df31/0x3234de053c4f724 lrc: 5/0,0 mode: PR/PR res: [0x2bb12:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91fe expref: 105 pid: 72396 timeout: 20128 lvb_type: 1 00000100:00100000:0.0:1651529369.855669:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005fb0ec6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997067776:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.855672:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c53074 lrc: 3/0,1 mode: --/PW res: [0x2bb14:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.855673:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396528384 00010000:00010000:1.0:1651529369.855676:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c4f819 lrc: 4/0,0 mode: PR/PR res: [0x2bb14:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95d2 expref: 106 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.855680:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396528320 00010000:00010000:1.0:1651529369.855683:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c4f827 lrc: 4/0,0 mode: PR/PR res: [0x2bb16:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95ee expref: 107 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:0.0:1651529369.855684:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13294 00000100:00100000:0.0:1651529369.855686:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+107:41279:x1731746396528000:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529369.855688:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13295 00000100:00100000:1.0:1651529369.855690:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+107:41279:x1731746396528128:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529369.855691:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.855693:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529369.855693:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c4f7c5 lrc: 4/0,0 mode: PR/PR res: [0x2bb10:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9451 expref: 107 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.855695:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003f39df31/0x3234de053c4f724 lrc: 5/0,0 mode: PR/PR res: [0x2bb12:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91fe expref: 107 pid: 72396 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.855697:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c4f7c5 lrc: 3/0,0 mode: PR/PR res: [0x2bb10:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9451 expref: 107 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.855699:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003f39df31/0x3234de053c4f724 lrc: 4/0,0 mode: PR/PR res: [0x2bb12:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91fe expref: 107 pid: 72396 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.855704:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c4f7c5 lrc: 0/0,0 mode: --/PR res: [0x2bb10:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9451 expref: 107 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.855705:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.855705:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.855706:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c5306d lrc: 3/0,1 mode: PW/PW res: [0x2bb12:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.855709:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c5306d lrc: 4/0,1 mode: PW/PW res: [0x2bb12:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.855709:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.855709:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.855710:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c53066 lrc: 3/0,1 mode: PW/PW res: [0x2bb10:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.855713:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c53066 lrc: 4/0,1 mode: PW/PW res: [0x2bb10:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.855715:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529369.855720:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529369.855725:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+106:41279:x1731746396528128:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 35us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529369.855728:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13295 00000100:00100000:0.0:1651529369.855728:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+106:41279:x1731746396528000:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 41us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529369.855731:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13294 00000100:00100000:1.0:1651529369.855734:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13296 00000100:00100000:1.0:1651529369.855735:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de45c136 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+104:41279:x1731746396528384:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529369.855738:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529369.855738:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13297 00010000:00010000:1.0:1651529369.855739:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c4f819 lrc: 4/0,0 mode: PR/PR res: [0x2bb14:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95d2 expref: 104 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:0.0:1651529369.855740:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+104:41279:x1731746396528320:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529369.855742:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.855743:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c4f819 lrc: 3/0,0 mode: PR/PR res: [0x2bb14:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95d2 expref: 104 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.855744:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c4f827 lrc: 4/0,0 mode: PR/PR res: [0x2bb16:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95ee expref: 104 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.855757:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c4f827 lrc: 3/0,0 mode: PR/PR res: [0x2bb16:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95ee expref: 104 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.855759:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c4f819 lrc: 0/0,0 mode: --/PR res: [0x2bb14:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95d2 expref: 104 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.855763:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.855763:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.855763:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c4f827 lrc: 0/0,0 mode: --/PR res: [0x2bb16:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95ee expref: 103 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.855764:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c53074 lrc: 3/0,1 mode: PW/PW res: [0x2bb14:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.855766:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.855767:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c53074 lrc: 4/0,1 mode: PW/PW res: [0x2bb14:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.855767:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.855768:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c5307b lrc: 3/0,1 mode: PW/PW res: [0x2bb16:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.855771:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c5307b lrc: 4/0,1 mode: PW/PW res: [0x2bb16:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.855776:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529369.855783:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de45c136 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+102:41279:x1731746396528384:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 47us (151us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529369.855786:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529369.855791:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13296 00000100:00100000:0.0:1651529369.855793:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+102:41279:x1731746396528320:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 53us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529369.855796:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13297 00010000:00010000:0.0:1651529369.855803:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c53074 lrc: 3/0,1 mode: PW/PW res: [0x2bb14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.855807:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c5307b lrc: 3/0,1 mode: PW/PW res: [0x2bb16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.855807:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c53074 lrc: 3/0,1 mode: PW/PW res: [0x2bb14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.855810:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c53074 lrc: 3/0,1 mode: PW/PW res: [0x2bb14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.855811:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c5307b lrc: 3/0,1 mode: PW/PW res: [0x2bb16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.855813:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c53074 lrc: 2/0,0 mode: PW/PW res: [0x2bb14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.855814:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c5307b lrc: 3/0,1 mode: PW/PW res: [0x2bb16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.855817:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c5307b lrc: 2/0,0 mode: PW/PW res: [0x2bb16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.855899:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:39030:x1731745946583168:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1095us (1263us total) trans 12885080567 rc 0/0 00000100:00100000:1.0:1651529369.855902:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212566 00010000:00010000:1.0:1651529369.855920:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c53074 lrc: 2/0,0 mode: PW/PW res: [0x2bb14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.855922:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+14:39030:x1731745946583040:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1131us (1295us total) trans 12885080568 rc 0/0 00010000:00010000:1.0:1651529369.855924:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000048ee8765 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529369.855925:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c53074 lrc: 2/0,0 mode: PW/PW res: [0x2bb14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.855926:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212565 00010000:00010000:1.0:1651529369.855928:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c53074 lrc: 3/0,0 mode: PW/PW res: [0x2bb14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.855934:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c53074 lrc: 1/0,0 mode: --/PW res: [0x2bb14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.855936:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048ee8765/0x3234de053c53074 lrc: 0/0,0 mode: --/PW res: [0x2bb14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.855941:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c5307b lrc: 2/0,0 mode: PW/PW res: [0x2bb16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.855944:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eca832be already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529369.855945:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c5307b lrc: 2/0,0 mode: PW/PW res: [0x2bb16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.855951:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c5307b lrc: 3/0,0 mode: PW/PW res: [0x2bb16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.855954:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c5307b lrc: 1/0,0 mode: --/PW res: [0x2bb16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.855957:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c5307b lrc: 0/0,0 mode: --/PW res: [0x2bb16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.856006:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529369.856037:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529369.856049:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529369.856076:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529369.856087:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396528512 00010000:00010000:1.0:1651529369.856093:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c4f7b0 lrc: 4/0,0 mode: PR/PR res: [0x2bb11:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d940b expref: 101 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.856099:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396528704 00010000:00010000:1.0:1651529369.856101:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eeab415c/0x3234de053c4f6fa lrc: 5/0,0 mode: PR/PR res: [0x2bb15:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d913a expref: 102 pid: 156655 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.856106:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396528640 00010000:00010000:1.0:1651529369.856108:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c4f7d3 lrc: 5/0,0 mode: PR/PR res: [0x2bb13:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d946d expref: 103 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.856111:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396528896 00010000:00010000:1.0:1651529369.856113:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c4f740 lrc: 5/0,0 mode: PR/PR res: [0x2bb17:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92d0 expref: 104 pid: 80281 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.856118:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13298 00000100:00100000:1.0:1651529369.856120:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+104:41279:x1731746396528512:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529369.856123:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.856124:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c4f7b0 lrc: 4/0,0 mode: PR/PR res: [0x2bb11:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d940b expref: 104 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.856128:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c4f7b0 lrc: 3/0,0 mode: PR/PR res: [0x2bb11:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d940b expref: 104 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.856134:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c4f7b0 lrc: 0/0,0 mode: --/PR res: [0x2bb11:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d940b expref: 104 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.856138:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.856138:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.856139:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c53082 lrc: 3/0,1 mode: PW/PW res: [0x2bb11:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856142:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c53082 lrc: 4/0,1 mode: PW/PW res: [0x2bb11:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856152:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529369.856159:0:80278:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f39df31/0x3234de053c4f724 lrc: 0/0,0 mode: --/PR res: [0x2bb12:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91fe expref: 103 pid: 72396 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.856161:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+103:41279:x1731746396528512:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 40us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529369.856164:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13298 00000100:00100000:0.0:1651529369.856167:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002f363f4a pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997067712:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529369.856168:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13299 00000100:00100000:1.0:1651529369.856170:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+101:41278:x1731746396528704:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529369.856171:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c5306d lrc: 3/0,1 mode: PW/PW res: [0x2bb12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856173:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.856174:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eeab415c/0x3234de053c4f6fa lrc: 5/0,0 mode: PR/PR res: [0x2bb15:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d913a expref: 101 pid: 156655 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.856174:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c5306d lrc: 3/0,1 mode: PW/PW res: [0x2bb12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856177:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c5306d lrc: 3/0,1 mode: PW/PW res: [0x2bb12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856178:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eeab415c/0x3234de053c4f6fa lrc: 4/0,0 mode: PR/PR res: [0x2bb15:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d913a expref: 101 pid: 156655 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.856180:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c5306d lrc: 3/0,1 mode: PW/PW res: [0x2bb12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856182:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.856183:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.856183:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c53090 lrc: 3/0,1 mode: PW/PW res: [0x2bb15:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856183:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c5306d lrc: 2/0,0 mode: PW/PW res: [0x2bb12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856186:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c53090 lrc: 4/0,1 mode: PW/PW res: [0x2bb15:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856197:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529369.856203:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+101:41278:x1731746396528704:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (173us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529369.856203:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c53082 lrc: 3/0,1 mode: PW/PW res: [0x2bb11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.856205:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13299 00010000:00010000:0.0:1651529369.856207:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c53082 lrc: 3/0,1 mode: PW/PW res: [0x2bb11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.856209:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13300 00010000:00010000:0.0:1651529369.856209:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c53082 lrc: 3/0,1 mode: PW/PW res: [0x2bb11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.856211:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+100:41279:x1731746396528640:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529369.856212:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c53082 lrc: 2/0,0 mode: PW/PW res: [0x2bb11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856213:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.856215:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c4f7d3 lrc: 5/0,0 mode: PR/PR res: [0x2bb13:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d946d expref: 100 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.856239:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c4f7d3 lrc: 4/0,0 mode: PR/PR res: [0x2bb13:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d946d expref: 100 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.856247:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.856248:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.856249:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c53089 lrc: 3/0,1 mode: PW/PW res: [0x2bb13:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856252:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c53089 lrc: 4/0,1 mode: PW/PW res: [0x2bb13:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856256:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529369.856260:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13301 00000100:00100000:1.0:1651529369.856262:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+100:41279:x1731746396528640:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 50us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529369.856263:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+100:41279:x1731746396528896:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529369.856264:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13300 00010000:00010000:0.0:1651529369.856267:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529369.856269:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c4f740 lrc: 5/0,0 mode: PR/PR res: [0x2bb17:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92d0 expref: 99 pid: 80281 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.856271:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c5306d lrc: 2/0,0 mode: PW/PW res: [0x2bb12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856273:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c4f740 lrc: 4/0,0 mode: PR/PR res: [0x2bb17:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92d0 expref: 99 pid: 80281 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.856274:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b232c9bb already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529369.856275:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c5306d lrc: 2/0,0 mode: PW/PW res: [0x2bb12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856278:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c5306d lrc: 3/0,0 mode: PW/PW res: [0x2bb12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856279:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.856280:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.856280:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c53097 lrc: 3/0,1 mode: PW/PW res: [0x2bb17:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856282:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c5306d lrc: 1/0,0 mode: --/PW res: [0x2bb12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856284:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c5306d lrc: 0/0,0 mode: --/PW res: [0x2bb12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856284:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c53097 lrc: 4/0,1 mode: PW/PW res: [0x2bb17:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856289:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529369.856291:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c53082 lrc: 2/0,0 mode: PW/PW res: [0x2bb11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856294:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c5599f68 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529369.856295:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c53082 lrc: 2/0,0 mode: PW/PW res: [0x2bb11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.856296:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+99:41279:x1731746396528896:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 33us (220us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529369.856298:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c53082 lrc: 3/0,0 mode: PW/PW res: [0x2bb11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.856299:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13301 00010000:00010000:1.0:1651529369.856301:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c53082 lrc: 1/0,0 mode: --/PW res: [0x2bb11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856303:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5599f68/0x3234de053c53082 lrc: 0/0,0 mode: --/PW res: [0x2bb11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856310:0:80277:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eeab415c/0x3234de053c4f6fa lrc: 0/0,0 mode: --/PR res: [0x2bb15:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d913a expref: 98 pid: 156655 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.856312:0:72396:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c4f740 lrc: 0/0,0 mode: --/PR res: [0x2bb17:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92d0 expref: 98 pid: 80281 timeout: 20128 lvb_type: 1 00000100:00100000:0.0:1651529369.856314:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000822949b3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997068032:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529369.856316:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005d3fb3ef pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997068096:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.856319:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c53090 lrc: 3/0,1 mode: PW/PW res: [0x2bb15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856320:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c53097 lrc: 3/0,1 mode: PW/PW res: [0x2bb17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856322:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c53090 lrc: 3/0,1 mode: PW/PW res: [0x2bb15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856323:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c53097 lrc: 3/0,1 mode: PW/PW res: [0x2bb17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856325:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c53090 lrc: 3/0,1 mode: PW/PW res: [0x2bb15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856328:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c53097 lrc: 3/0,1 mode: PW/PW res: [0x2bb17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856328:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c53090 lrc: 3/0,1 mode: PW/PW res: [0x2bb15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856331:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c53090 lrc: 2/0,0 mode: PW/PW res: [0x2bb15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856332:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c53097 lrc: 3/0,1 mode: PW/PW res: [0x2bb17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856334:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c53097 lrc: 2/0,0 mode: PW/PW res: [0x2bb17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856346:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c53090 lrc: 2/0,0 mode: PW/PW res: [0x2bb15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856349:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006401eb97 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529369.856350:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c53090 lrc: 2/0,0 mode: PW/PW res: [0x2bb15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856352:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c53090 lrc: 3/0,0 mode: PW/PW res: [0x2bb15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856353:0:72397:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c4f7d3 lrc: 0/0,0 mode: --/PR res: [0x2bb13:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d946d expref: 96 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.856356:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002f77bb41 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997067968:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.856357:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c53090 lrc: 1/0,0 mode: --/PW res: [0x2bb15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856359:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c53089 lrc: 3/0,1 mode: PW/PW res: [0x2bb13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856362:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c53089 lrc: 3/0,1 mode: PW/PW res: [0x2bb13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856362:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006401eb97/0x3234de053c53090 lrc: 0/0,0 mode: --/PW res: [0x2bb15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856364:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c53089 lrc: 3/0,1 mode: PW/PW res: [0x2bb13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856366:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c53097 lrc: 2/0,0 mode: PW/PW res: [0x2bb17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856368:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c53089 lrc: 3/0,1 mode: PW/PW res: [0x2bb13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856369:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000029958df2 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529369.856370:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c53089 lrc: 2/0,0 mode: PW/PW res: [0x2bb13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856370:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c53097 lrc: 2/0,0 mode: PW/PW res: [0x2bb17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856373:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c53097 lrc: 3/0,0 mode: PW/PW res: [0x2bb17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856376:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c53097 lrc: 1/0,0 mode: --/PW res: [0x2bb17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856379:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c53097 lrc: 0/0,0 mode: --/PW res: [0x2bb17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856381:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c53089 lrc: 2/0,0 mode: PW/PW res: [0x2bb13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856384:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e48e0bfd already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529369.856385:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c53089 lrc: 2/0,0 mode: PW/PW res: [0x2bb13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856386:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c53066 lrc: 3/0,1 mode: PW/PW res: [0x2bb10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856388:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c53089 lrc: 3/0,0 mode: PW/PW res: [0x2bb13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856388:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c53066 lrc: 3/0,1 mode: PW/PW res: [0x2bb10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856391:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c53066 lrc: 3/0,1 mode: PW/PW res: [0x2bb10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856392:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c53089 lrc: 1/0,0 mode: --/PW res: [0x2bb13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856394:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c53066 lrc: 2/0,0 mode: PW/PW res: [0x2bb10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856395:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c53089 lrc: 0/0,0 mode: --/PW res: [0x2bb13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856398:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c53066 lrc: 2/0,0 mode: PW/PW res: [0x2bb10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856401:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fafb79d3 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529369.856402:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c53066 lrc: 2/0,0 mode: PW/PW res: [0x2bb10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856405:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c53066 lrc: 3/0,0 mode: PW/PW res: [0x2bb10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856408:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c53066 lrc: 1/0,0 mode: --/PW res: [0x2bb10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856411:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fafb79d3/0x3234de053c53066 lrc: 0/0,0 mode: --/PW res: [0x2bb10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.856416:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529369.856424:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529369.856441:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946583360 00000100:00100000:0.0:1651529369.856448:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946583296 00000100:00100000:0.0:1651529369.856452:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212571 00000100:00100000:0.0:1651529369.856454:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+15:39029:x1731745946583360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529369.856460:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178969 count 1 00000100:00100000:1.0:1651529369.856463:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212572 00010000:00010000:0.0:1651529369.856464:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c5309e lrc: 3/0,1 mode: --/PW res: [0x2bb19:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.856466:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:39030:x1731745946583296:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529369.856469:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c4f7f6 lrc: 2/0,0 mode: PR/PR res: [0x2bb19:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9507 expref: 95 pid: 80279 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529369.856472:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178968 count 1 00010000:00010000:0.0:1651529369.856473:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.856473:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.856474:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c5309e lrc: 4/0,1 mode: --/PW res: [0x2bb19:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856477:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c530a5 lrc: 3/0,1 mode: --/PW res: [0x2bb18:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856481:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c4f7f6 lrc: 3/0,0 mode: PR/PR res: [0x2bb19:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9507 expref: 95 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.856482:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004df86d30/0x3234de053c4f6f3 lrc: 2/0,0 mode: PR/PR res: [0x2bb18:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9133 expref: 95 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.856485:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.856485:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c4f7f6 lrc: 4/0,0 mode: PR/PR res: [0x2bb19:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9507 expref: 95 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.856486:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.856487:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c530a5 lrc: 4/0,1 mode: --/PW res: [0x2bb18:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.856492:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006aa45e66 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997068160:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.856494:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004df86d30/0x3234de053c4f6f3 lrc: 3/0,0 mode: PR/PR res: [0x2bb18:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9133 expref: 95 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.856497:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004df86d30/0x3234de053c4f6f3 lrc: 4/0,0 mode: PR/PR res: [0x2bb18:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9133 expref: 95 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.856502:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006647e4ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997068224:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529369.856521:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 0000000076b354b3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529369.856522:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd96f074 going to sleep for 6 seconds 00000100:00100000:1.0:1651529369.856768:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:39029:x1731745946582976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1909us (2115us total) trans 12885080569 rc 0/0 00000100:00100000:1.0:1651529369.856771:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212568 00000100:00100000:0.0:1651529369.856785:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+16:39029:x1731745946582848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1940us (2141us total) trans 12885080570 rc 0/0 00000100:00100000:0.0:1651529369.856789:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212567 00000100:00100000:1.0:1651529369.856809:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b750793d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+17:39029:x1731745946583232:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1903us (2115us total) trans 12885080571 rc 0/0 00000100:00100000:1.0:1651529369.856812:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212570 00000100:00100000:0.0:1651529369.856823:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+16:39030:x1731745946582912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 2109us (2203us total) trans 12885080572 rc 0/0 00000100:00100000:0.0:1651529369.856826:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212564 00000100:00100000:1.0:1651529369.856878:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529369.856886:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+16:39029:x1731745946583104:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1994us (2226us total) trans 12885080573 rc 0/0 00000100:00100000:0.0:1651529369.856889:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212569 00000100:00100000:1.0:1651529369.856909:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529369.856938:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396529024 00010000:00010000:1.0:1651529369.856944:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c4f7f6 lrc: 5/0,0 mode: PR/PR res: [0x2bb19:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9507 expref: 96 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.856955:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396529088 00010000:00010000:1.0:1651529369.856958:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004df86d30/0x3234de053c4f6f3 lrc: 5/0,0 mode: PR/PR res: [0x2bb18:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9133 expref: 97 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.856965:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13302 00000100:00100000:1.0:1651529369.856967:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+97:41279:x1731746396529024:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529369.856970:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529369.856971:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13303 00010000:00010000:1.0:1651529369.856972:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c4f7f6 lrc: 5/0,0 mode: PR/PR res: [0x2bb19:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9507 expref: 97 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:0.0:1651529369.856974:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005239dfe7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+97:41278:x1731746396529088:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529369.856975:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c4f7f6 lrc: 4/0,0 mode: PR/PR res: [0x2bb19:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9507 expref: 97 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.856978:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529369.856980:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004df86d30/0x3234de053c4f6f3 lrc: 5/0,0 mode: PR/PR res: [0x2bb18:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9133 expref: 97 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.856981:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.856982:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.856982:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c5309e lrc: 3/0,1 mode: PW/PW res: [0x2bb19:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856985:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004df86d30/0x3234de053c4f6f3 lrc: 4/0,0 mode: PR/PR res: [0x2bb18:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9133 expref: 97 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.856986:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c5309e lrc: 4/0,1 mode: PW/PW res: [0x2bb19:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.856991:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529369.856991:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.856992:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.856993:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c530a5 lrc: 3/0,1 mode: PW/PW res: [0x2bb18:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.856998:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c530a5 lrc: 4/0,1 mode: PW/PW res: [0x2bb18:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.856999:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+97:41279:x1731746396529024:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 32us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529369.857002:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13302 00010000:00010000:0.0:1651529369.857003:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529369.857011:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005239dfe7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+96:41278:x1731746396529088:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (102us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529369.857013:0:80280:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004df86d30/0x3234de053c4f6f3 lrc: 0/0,0 mode: --/PR res: [0x2bb18:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9133 expref: 96 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:0.0:1651529369.857013:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13303 00000100:00100000:1.0:1651529369.857017:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006647e4ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997068224:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.857021:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c530a5 lrc: 3/0,1 mode: PW/PW res: [0x2bb18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.857024:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c530a5 lrc: 3/0,1 mode: PW/PW res: [0x2bb18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.857027:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c530a5 lrc: 3/0,1 mode: PW/PW res: [0x2bb18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.857029:0:156655:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c4f7f6 lrc: 0/0,0 mode: --/PR res: [0x2bb19:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9507 expref: 94 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.857030:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c530a5 lrc: 3/0,1 mode: PW/PW res: [0x2bb18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.857032:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c530a5 lrc: 2/0,0 mode: PW/PW res: [0x2bb18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.857033:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006aa45e66 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997068160:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.857037:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c5309e lrc: 3/0,1 mode: PW/PW res: [0x2bb19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.857041:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c5309e lrc: 3/0,1 mode: PW/PW res: [0x2bb19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.857051:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c5309e lrc: 3/0,1 mode: PW/PW res: [0x2bb19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.857054:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c5309e lrc: 3/0,1 mode: PW/PW res: [0x2bb19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.857057:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c5309e lrc: 2/0,0 mode: PW/PW res: [0x2bb19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.857088:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:39030:x1731745946583296:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 622us (663us total) trans 12885080574 rc 0/0 00000100:00100000:1.0:1651529369.857091:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212572 00010000:00010000:1.0:1651529369.857099:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c530a5 lrc: 2/0,0 mode: PW/PW res: [0x2bb18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.857102:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000090e99444 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529369.857103:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c530a5 lrc: 2/0,0 mode: PW/PW res: [0x2bb18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.857105:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+16:39029:x1731745946583360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 650us (689us total) trans 12885080575 rc 0/0 00010000:00010000:1.0:1651529369.857106:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c530a5 lrc: 3/0,0 mode: PW/PW res: [0x2bb18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.857108:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212571 00010000:00010000:1.0:1651529369.857110:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c530a5 lrc: 1/0,0 mode: --/PW res: [0x2bb18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.857113:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c530a5 lrc: 0/0,0 mode: --/PW res: [0x2bb18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.857116:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c5309e lrc: 2/0,0 mode: PW/PW res: [0x2bb19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.857120:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004dda5a3f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529369.857121:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c5309e lrc: 2/0,0 mode: PW/PW res: [0x2bb19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.857124:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c5309e lrc: 3/0,0 mode: PW/PW res: [0x2bb19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.857128:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c5309e lrc: 1/0,0 mode: --/PW res: [0x2bb19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.857131:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004dda5a3f/0x3234de053c5309e lrc: 0/0,0 mode: --/PW res: [0x2bb19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.857184:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+16:39030:x1731745946582784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 2484us (2580us total) trans 12885080576 rc 0/0 00000100:00100000:0.0:1651529369.857187:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212563 00000100:00100000:1.0:1651529369.857219:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529369.857242:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529369.857250:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946583616 00000100:00100000:1.0:1651529369.857251:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529369.857257:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529369.857267:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529369.857274:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946583680 00000100:00100000:1.0:1651529369.857283:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946583808 00000100:00100000:1.0:1651529369.857287:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946583744 00000100:00100000:1.0:1651529369.857292:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946583872 00000100:00100000:1.0:1651529369.857298:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212573 00000100:00100000:1.0:1651529369.857299:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:39030:x1731745946583616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529369.857306:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212574 00000100:00100000:0.0:1651529369.857308:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:39029:x1731745946583680:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529369.857310:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178970 count 1 00010000:00010000:1.0:1651529369.857315:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c530ac lrc: 3/0,1 mode: --/PW res: [0x2bb1a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529369.857316:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178971 count 1 00010000:00010000:1.0:1651529369.857321:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c4f7b7 lrc: 2/0,0 mode: PR/PR res: [0x2bb1a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9419 expref: 93 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.857321:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c530b3 lrc: 3/0,1 mode: --/PW res: [0x2bb1b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.857324:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.857325:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.857325:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c530ac lrc: 4/0,1 mode: --/PW res: [0x2bb1a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.857326:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c4f7e8 lrc: 2/0,0 mode: PR/PR res: [0x2bb1b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94b3 expref: 93 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.857329:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.857330:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.857330:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c530b3 lrc: 4/0,1 mode: --/PW res: [0x2bb1b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.857333:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c4f7b7 lrc: 3/0,0 mode: PR/PR res: [0x2bb1a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9419 expref: 93 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.857337:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c4f7b7 lrc: 4/0,0 mode: PR/PR res: [0x2bb1a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9419 expref: 93 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.857337:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c4f7e8 lrc: 3/0,0 mode: PR/PR res: [0x2bb1b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94b3 expref: 93 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529369.857341:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ee8cd7c9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997068288:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.857341:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c4f7e8 lrc: 4/0,0 mode: PR/PR res: [0x2bb1b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94b3 expref: 93 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:0.0:1651529369.857345:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006aa45e66 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997068352:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529369.857351:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b7af823 going to sleep for 6 seconds 00000100:00100000:0.0:1651529369.857355:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000003c8b0daf going to sleep for 6 seconds 00000100:00100000:1.0:1651529369.857357:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212575 00000100:00100000:1.0:1651529369.857359:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:39030:x1731745946583808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529369.857363:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212576 00002000:00080000:1.0:1651529369.857364:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178973 count 1 00000100:00100000:0.0:1651529369.857365:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:39029:x1731745946583744:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529369.857367:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c530ba lrc: 3/0,1 mode: --/PW res: [0x2bb1d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529369.857369:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178972 count 1 00010000:00010000:1.0:1651529369.857372:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000990cd87d/0x3234de053c4f77f lrc: 2/0,0 mode: PR/PR res: [0x2bb1d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9347 expref: 93 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.857373:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c530c1 lrc: 3/0,1 mode: --/PW res: [0x2bb1c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.857375:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.857375:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.857376:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c530ba lrc: 4/0,1 mode: --/PW res: [0x2bb1d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.857382:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000990cd87d/0x3234de053c4f77f lrc: 3/0,0 mode: PR/PR res: [0x2bb1d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9347 expref: 93 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.857385:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000990cd87d/0x3234de053c4f77f lrc: 4/0,0 mode: PR/PR res: [0x2bb1d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9347 expref: 93 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.857389:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ba0b61e6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997068416:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529369.857395:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 000000004ca54b8a going to sleep for 6 seconds 00000100:00100000:1.0:1651529369.857401:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212577 00010000:00010000:0.0:1651529369.857402:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001c5425fe/0x3234de053c4f778 lrc: 2/0,0 mode: PR/PR res: [0x2bb1c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d934e expref: 93 pid: 80280 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529369.857403:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:39029:x1731745946583872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529369.857407:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.857407:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.857408:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c530c1 lrc: 4/0,1 mode: --/PW res: [0x2bb1c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.857416:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001c5425fe/0x3234de053c4f778 lrc: 3/0,0 mode: PR/PR res: [0x2bb1c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d934e expref: 93 pid: 80280 timeout: 0 lvb_type: 1 00002000:00080000:1.0:1651529369.857417:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178974 count 1 00010000:00010000:0.0:1651529369.857420:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001c5425fe/0x3234de053c4f778 lrc: 4/0,0 mode: PR/PR res: [0x2bb1c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d934e expref: 93 pid: 80280 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.857421:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c530c8 lrc: 3/0,1 mode: --/PW res: [0x2bb1e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.857424:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000043b7984f pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997068480:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.857425:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006c1cdcb2/0x3234de053c4f786 lrc: 2/0,0 mode: PR/PR res: [0x2bb1e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9371 expref: 93 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.857431:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.857432:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.857433:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c530c8 lrc: 4/0,1 mode: --/PW res: [0x2bb1e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.857433:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000076b354b3 going to sleep for 6 seconds 00010000:00010000:1.0:1651529369.857439:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006c1cdcb2/0x3234de053c4f786 lrc: 3/0,0 mode: PR/PR res: [0x2bb1e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9371 expref: 93 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.857442:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006c1cdcb2/0x3234de053c4f786 lrc: 4/0,0 mode: PR/PR res: [0x2bb1e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9371 expref: 93 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.857446:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000095d7eb1a pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997068544:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529369.857454:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 0000000057299e7f going to sleep for 6 seconds 00000100:00100000:1.0:1651529369.857466:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529369.857486:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946584256 00000100:00100000:1.0:1651529369.857487:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529369.857499:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946584320 00000100:00100000:1.0:1651529369.857500:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529369.857509:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946584384 00000100:00100000:0.0:1651529369.857514:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212578 00000100:00100000:0.0:1651529369.857516:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:39030:x1731745946584256:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529369.857521:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178975 count 1 00010000:00010000:0.0:1651529369.857525:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c530cf lrc: 3/0,1 mode: --/PW res: [0x2bb1f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.857530:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e65576dd/0x3234de053c4f70f lrc: 2/0,0 mode: PR/PR res: [0x2bb1f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91e9 expref: 93 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.857533:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.857533:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.857534:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c530cf lrc: 4/0,1 mode: --/PW res: [0x2bb1f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.857541:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e65576dd/0x3234de053c4f70f lrc: 3/0,0 mode: PR/PR res: [0x2bb1f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91e9 expref: 93 pid: 156655 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.857544:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e65576dd/0x3234de053c4f70f lrc: 4/0,0 mode: PR/PR res: [0x2bb1f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91e9 expref: 93 pid: 156655 timeout: 20128 lvb_type: 1 00000100:00100000:0.0:1651529369.857548:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ad6d0877 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997068608:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529369.857560:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212579 00000100:00100000:0.0:1651529369.857563:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ff7bf023 going to sleep for 6 seconds 00000100:00100000:1.0:1651529369.857567:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+23:39030:x1731745946584320:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529369.857572:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178976 count 1 00010000:00010000:1.0:1651529369.857577:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c530d6 lrc: 3/0,1 mode: --/PW res: [0x2bb20:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.857582:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000317be83e/0x3234de053c4f701 lrc: 2/0,0 mode: PR/PR res: [0x2bb20:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91b1 expref: 93 pid: 72396 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.857585:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.857586:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.857586:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c530d6 lrc: 4/0,1 mode: --/PW res: [0x2bb20:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.857586:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212580 00000100:00100000:0.0:1651529369.857588:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:39029:x1731745946584384:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529369.857593:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000317be83e/0x3234de053c4f701 lrc: 3/0,0 mode: PR/PR res: [0x2bb20:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91b1 expref: 93 pid: 72396 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1651529369.857593:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178977 count 1 00010000:00010000:1.0:1651529369.857597:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000317be83e/0x3234de053c4f701 lrc: 4/0,0 mode: PR/PR res: [0x2bb20:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91b1 expref: 93 pid: 72396 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.857597:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c530dd lrc: 3/0,1 mode: --/PW res: [0x2bb21:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.857601:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000053ee5af1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997068672:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.857602:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c4f7fd lrc: 2/0,0 mode: PR/PR res: [0x2bb21:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9515 expref: 93 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.857605:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.857606:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.857606:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c530dd lrc: 4/0,1 mode: --/PW res: [0x2bb21:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.857610:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cfa1ca05 going to sleep for 6 seconds 00010000:00010000:0.0:1651529369.857613:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c4f7fd lrc: 3/0,0 mode: PR/PR res: [0x2bb21:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9515 expref: 93 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.857619:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c4f7fd lrc: 4/0,0 mode: PR/PR res: [0x2bb21:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9515 expref: 93 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:0.0:1651529369.857623:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000075b025a pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997068736:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529369.857630:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c2b2b59c going to sleep for 6 seconds 00000100:00100000:1.0:1651529369.858079:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529369.858088:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529369.858094:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529369.858099:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000043b7984f pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997068480:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.858104:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c530c1 lrc: 3/0,1 mode: --/PW res: [0x2bb1c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.858112:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396529408 00000100:00100000:1.0:1651529369.858116:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529369.858117:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c4f7b7 lrc: 5/0,0 mode: PR/PR res: [0x2bb1a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9419 expref: 94 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:0.0:1651529369.858123:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396529536 00000100:00100000:1.0:1651529369.858125:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529369.858125:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000990cd87d/0x3234de053c4f77f lrc: 5/0,0 mode: PR/PR res: [0x2bb1d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9347 expref: 95 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:0.0:1651529369.858129:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396529472 00010000:00010000:0.0:1651529369.858132:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c4f7e8 lrc: 5/0,0 mode: PR/PR res: [0x2bb1b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94b3 expref: 96 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.858140:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396529600 00000100:00100000:0.0:1651529369.858143:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396529664 00010000:00010000:1.0:1651529369.858147:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006c1cdcb2/0x3234de053c4f786 lrc: 5/0,0 mode: PR/PR res: [0x2bb1e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9371 expref: 98 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.858147:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001c5425fe/0x3234de053c4f778 lrc: 4/0,0 mode: PR/PR res: [0x2bb1c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d934e expref: 98 pid: 80280 timeout: 20128 lvb_type: 1 00000100:00100000:0.0:1651529369.858151:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13304 00000100:00100000:0.0:1651529369.858153:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+98:41279:x1731746396529408:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529369.858155:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13305 00010000:00010000:0.0:1651529369.858156:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529369.858157:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+98:41279:x1731746396529536:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529369.858157:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c4f7b7 lrc: 5/0,0 mode: PR/PR res: [0x2bb1a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9419 expref: 98 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.858160:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529369.858161:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c4f7b7 lrc: 4/0,0 mode: PR/PR res: [0x2bb1a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9419 expref: 98 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.858162:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000990cd87d/0x3234de053c4f77f lrc: 5/0,0 mode: PR/PR res: [0x2bb1d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9347 expref: 98 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.858167:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.858167:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.858168:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000990cd87d/0x3234de053c4f77f lrc: 4/0,0 mode: PR/PR res: [0x2bb1d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9347 expref: 98 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.858168:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c530ac lrc: 3/0,1 mode: PW/PW res: [0x2bb1a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.858171:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c530ac lrc: 4/0,1 mode: PW/PW res: [0x2bb1a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858174:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.858175:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.858175:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c530ba lrc: 3/0,1 mode: PW/PW res: [0x2bb1d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.858176:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529369.858179:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c530ba lrc: 4/0,1 mode: PW/PW res: [0x2bb1d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858184:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529369.858189:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+98:41279:x1731746396529408:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 35us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529369.858192:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13304 00000100:00100000:1.0:1651529369.858197:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+97:41279:x1731746396529536:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529369.858198:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13306 00000100:00100000:0.0:1651529369.858199:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+97:41278:x1731746396529472:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529369.858200:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13305 00010000:00010000:0.0:1651529369.858202:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529369.858204:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c4f7e8 lrc: 5/0,0 mode: PR/PR res: [0x2bb1b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94b3 expref: 96 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.858206:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13307 00000100:00100000:1.0:1651529369.858208:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+96:41278:x1731746396529664:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529369.858208:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c4f7e8 lrc: 4/0,0 mode: PR/PR res: [0x2bb1b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94b3 expref: 96 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.858211:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.858212:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001c5425fe/0x3234de053c4f778 lrc: 4/0,0 mode: PR/PR res: [0x2bb1c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d934e expref: 96 pid: 80280 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.858213:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.858213:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.858214:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c530b3 lrc: 3/0,1 mode: PW/PW res: [0x2bb1b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858216:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001c5425fe/0x3234de053c4f778 lrc: 3/0,0 mode: PR/PR res: [0x2bb1c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d934e expref: 96 pid: 80280 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.858217:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c530b3 lrc: 4/0,1 mode: PW/PW res: [0x2bb1b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858221:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c5425fe/0x3234de053c4f778 lrc: 0/0,0 mode: --/PR res: [0x2bb1c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d934e expref: 96 pid: 80280 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.858233:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529369.858243:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.858243:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.858244:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c530c1 lrc: 3/0,1 mode: PW/PW res: [0x2bb1c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.858244:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+95:41278:x1731746396529472:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 43us (149us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529369.858247:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c530c1 lrc: 4/0,1 mode: PW/PW res: [0x2bb1c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.858247:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13306 00000100:00100000:0.0:1651529369.858252:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13308 00010000:00010000:1.0:1651529369.858255:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529369.858259:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+94:41279:x1731746396529600:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529369.858261:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+94:41278:x1731746396529664:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 53us (136us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529369.858261:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529369.858263:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006c1cdcb2/0x3234de053c4f786 lrc: 5/0,0 mode: PR/PR res: [0x2bb1e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9371 expref: 94 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.858264:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13307 00010000:00010000:0.0:1651529369.858267:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006c1cdcb2/0x3234de053c4f786 lrc: 4/0,0 mode: PR/PR res: [0x2bb1e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9371 expref: 93 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.858272:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.858272:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.858273:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c530c8 lrc: 3/0,1 mode: PW/PW res: [0x2bb1e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858276:0:72397:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000990cd87d/0x3234de053c4f77f lrc: 0/0,0 mode: --/PR res: [0x2bb1d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9347 expref: 93 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.858276:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c530c8 lrc: 4/0,1 mode: PW/PW res: [0x2bb1e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.858280:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ba0b61e6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997068416:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.858281:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529369.858284:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c530ba lrc: 3/0,1 mode: PW/PW res: [0x2bb1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.858286:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+92:41279:x1731746396529600:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (175us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529369.858287:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c530ba lrc: 3/0,1 mode: PW/PW res: [0x2bb1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.858289:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13308 00010000:00010000:1.0:1651529369.858290:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c530ba lrc: 3/0,1 mode: PW/PW res: [0x2bb1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858293:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c530ba lrc: 3/0,1 mode: PW/PW res: [0x2bb1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.858295:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c530c1 lrc: 3/0,1 mode: PW/PW res: [0x2bb1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858296:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c530ba lrc: 2/0,0 mode: PW/PW res: [0x2bb1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.858298:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c530c1 lrc: 3/0,1 mode: PW/PW res: [0x2bb1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.858302:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c530c1 lrc: 3/0,1 mode: PW/PW res: [0x2bb1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.858305:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c530c1 lrc: 2/0,0 mode: PW/PW res: [0x2bb1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.858350:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+25:39030:x1731745946583808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 990us (1098us total) trans 12885080577 rc 0/0 00000100:00100000:0.0:1651529369.858352:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+25:39029:x1731745946583744:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 987us (1094us total) trans 12885080578 rc 0/0 00000100:00100000:1.0:1651529369.858353:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212575 00000100:00100000:0.0:1651529369.858355:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212576 00010000:00010000:1.0:1651529369.858360:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c530ba lrc: 2/0,0 mode: PW/PW res: [0x2bb1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858363:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bdf2b6c4 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529369.858364:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c530ba lrc: 2/0,0 mode: PW/PW res: [0x2bb1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858367:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c530ba lrc: 3/0,0 mode: PW/PW res: [0x2bb1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.858369:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ad6d0877 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997068608:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.858372:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c530ba lrc: 1/0,0 mode: --/PW res: [0x2bb1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.858373:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c530cf lrc: 3/0,1 mode: --/PW res: [0x2bb1f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858375:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c530ba lrc: 0/0,0 mode: --/PW res: [0x2bb1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858379:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c530c1 lrc: 2/0,0 mode: PW/PW res: [0x2bb1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.858379:0:80276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c4f7e8 lrc: 0/0,0 mode: --/PR res: [0x2bb1b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94b3 expref: 91 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.858382:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009882f227 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529369.858383:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c530c1 lrc: 2/0,0 mode: PW/PW res: [0x2bb1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.858385:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006aa45e66 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997068352:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.858386:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c530c1 lrc: 3/0,0 mode: PW/PW res: [0x2bb1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.858388:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c530b3 lrc: 3/0,1 mode: PW/PW res: [0x2bb1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858389:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c530c1 lrc: 1/0,0 mode: --/PW res: [0x2bb1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.858391:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c530b3 lrc: 3/0,1 mode: PW/PW res: [0x2bb1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858392:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c530c1 lrc: 0/0,0 mode: --/PW res: [0x2bb1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.858394:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c530b3 lrc: 3/0,1 mode: PW/PW res: [0x2bb1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.858397:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c530b3 lrc: 3/0,1 mode: PW/PW res: [0x2bb1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.858399:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c530b3 lrc: 2/0,0 mode: PW/PW res: [0x2bb1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858401:0:72396:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c4f7b7 lrc: 0/0,0 mode: --/PR res: [0x2bb1a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9419 expref: 90 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.858405:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ee8cd7c9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997068288:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.858408:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c530ac lrc: 3/0,1 mode: PW/PW res: [0x2bb1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858411:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c530ac lrc: 3/0,1 mode: PW/PW res: [0x2bb1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858414:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c530ac lrc: 3/0,1 mode: PW/PW res: [0x2bb1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858417:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c530ac lrc: 3/0,1 mode: PW/PW res: [0x2bb1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858422:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c530ac lrc: 2/0,0 mode: PW/PW res: [0x2bb1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.858435:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+24:39029:x1731745946583680:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1125us (1193us total) trans 12885080579 rc 0/0 00000100:00100000:0.0:1651529369.858437:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212574 00010000:00010000:0.0:1651529369.858445:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c530b3 lrc: 2/0,0 mode: PW/PW res: [0x2bb1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.858461:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+24:39030:x1731745946583616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1161us (1242us total) trans 12885080580 rc 0/0 00010000:00010000:0.0:1651529369.858463:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009fff0bd3 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529369.858464:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212573 00010000:00010000:0.0:1651529369.858464:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c530b3 lrc: 2/0,0 mode: PW/PW res: [0x2bb1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.858470:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c530b3 lrc: 3/0,0 mode: PW/PW res: [0x2bb1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858471:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c530ac lrc: 2/0,0 mode: PW/PW res: [0x2bb1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858475:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ebdbebae already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529369.858475:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c530b3 lrc: 1/0,0 mode: --/PW res: [0x2bb1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858476:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c530ac lrc: 2/0,0 mode: PW/PW res: [0x2bb1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858478:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c530ac lrc: 3/0,0 mode: PW/PW res: [0x2bb1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858483:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c530ac lrc: 1/0,0 mode: --/PW res: [0x2bb1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858485:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c530ac lrc: 0/0,0 mode: --/PW res: [0x2bb1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858494:0:80280:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c1cdcb2/0x3234de053c4f786 lrc: 0/0,0 mode: --/PR res: [0x2bb1e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9371 expref: 89 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.858498:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000095d7eb1a pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997068544:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.858498:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c530b3 lrc: 0/0,0 mode: --/PW res: [0x2bb1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858512:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c530c8 lrc: 3/0,1 mode: PW/PW res: [0x2bb1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858515:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c530c8 lrc: 3/0,1 mode: PW/PW res: [0x2bb1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858518:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c530c8 lrc: 3/0,1 mode: PW/PW res: [0x2bb1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858526:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c530c8 lrc: 3/0,1 mode: PW/PW res: [0x2bb1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858529:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c530c8 lrc: 2/0,0 mode: PW/PW res: [0x2bb1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.858544:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529369.858554:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529369.858567:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529369.858578:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+24:39029:x1731745946583872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1175us (1311us total) trans 12885080581 rc 0/0 00000100:00100000:1.0:1651529369.858582:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212577 00010000:00010000:1.0:1651529369.858588:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c530c8 lrc: 2/0,0 mode: PW/PW res: [0x2bb1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858592:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cd5f3a7c already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529369.858593:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c530c8 lrc: 2/0,0 mode: PW/PW res: [0x2bb1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858596:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c530c8 lrc: 3/0,0 mode: PW/PW res: [0x2bb1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858609:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c530c8 lrc: 1/0,0 mode: --/PW res: [0x2bb1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.858619:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000075b025a pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997068736:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.858623:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c530dd lrc: 3/0,1 mode: --/PW res: [0x2bb21:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.858630:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396529728 00010000:00010000:1.0:1651529369.858631:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c530c8 lrc: 0/0,0 mode: --/PW res: [0x2bb1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.858635:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e65576dd/0x3234de053c4f70f lrc: 4/0,0 mode: PR/PR res: [0x2bb1f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91e9 expref: 89 pid: 156655 timeout: 20128 lvb_type: 1 00000100:00100000:0.0:1651529369.858645:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396529856 00010000:00010000:0.0:1651529369.858648:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000317be83e/0x3234de053c4f701 lrc: 5/0,0 mode: PR/PR res: [0x2bb20:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91b1 expref: 90 pid: 72396 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.858651:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396529984 00000100:00100000:0.0:1651529369.858652:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13309 00000100:00100000:0.0:1651529369.858654:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+91:41278:x1731746396529728:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529369.858657:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c4f7fd lrc: 4/0,0 mode: PR/PR res: [0x2bb21:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9515 expref: 91 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.858657:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529369.858659:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e65576dd/0x3234de053c4f70f lrc: 4/0,0 mode: PR/PR res: [0x2bb1f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91e9 expref: 91 pid: 156655 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.858663:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13310 00000100:00100000:1.0:1651529369.858665:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d036941 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+91:41278:x1731746396529856:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529369.858668:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.858669:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000317be83e/0x3234de053c4f701 lrc: 5/0,0 mode: PR/PR res: [0x2bb20:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91b1 expref: 91 pid: 72396 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.858673:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000317be83e/0x3234de053c4f701 lrc: 4/0,0 mode: PR/PR res: [0x2bb20:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91b1 expref: 91 pid: 72396 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.858678:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.858678:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.858679:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c530d6 lrc: 3/0,1 mode: PW/PW res: [0x2bb20:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.858680:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e65576dd/0x3234de053c4f70f lrc: 3/0,0 mode: PR/PR res: [0x2bb1f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91e9 expref: 91 pid: 156655 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.858682:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c530d6 lrc: 4/0,1 mode: PW/PW res: [0x2bb20:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.858686:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e65576dd/0x3234de053c4f70f lrc: 0/0,0 mode: --/PR res: [0x2bb1f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91e9 expref: 91 pid: 156655 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.858690:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529369.858690:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.858691:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.858692:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c530cf lrc: 3/0,1 mode: PW/PW res: [0x2bb1f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.858695:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c530cf lrc: 4/0,1 mode: PW/PW res: [0x2bb1f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.858702:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d036941 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+90:41278:x1731746396529856:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 37us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529369.858705:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13310 00010000:00010000:0.0:1651529369.858707:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529369.858710:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13311 00000100:00100000:1.0:1651529369.858712:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+89:41278:x1731746396529984:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529369.858714:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529369.858715:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+89:41278:x1731746396529728:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 60us (172us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529369.858716:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c4f7fd lrc: 4/0,0 mode: PR/PR res: [0x2bb21:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9515 expref: 89 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:0.0:1651529369.858718:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13309 00010000:00010000:1.0:1651529369.858720:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c4f7fd lrc: 3/0,0 mode: PR/PR res: [0x2bb21:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9515 expref: 89 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.858725:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c4f7fd lrc: 0/0,0 mode: --/PR res: [0x2bb21:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9515 expref: 88 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.858728:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.858728:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c530cf lrc: 3/0,1 mode: PW/PW res: [0x2bb1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858729:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.858730:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c530dd lrc: 3/0,1 mode: PW/PW res: [0x2bb21:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858732:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c530dd lrc: 4/0,1 mode: PW/PW res: [0x2bb21:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.858732:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c530cf lrc: 3/0,1 mode: PW/PW res: [0x2bb1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.858738:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c530cf lrc: 3/0,1 mode: PW/PW res: [0x2bb1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858740:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529369.858755:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+87:41278:x1731746396529984:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 33us (179us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529369.858756:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c530cf lrc: 2/0,0 mode: PW/PW res: [0x2bb1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.858759:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13311 00010000:00010000:1.0:1651529369.858773:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c530cf lrc: 2/0,0 mode: PW/PW res: [0x2bb1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858776:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e4f40ecf already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529369.858778:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c530cf lrc: 2/0,0 mode: PW/PW res: [0x2bb1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858780:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c530cf lrc: 3/0,0 mode: PW/PW res: [0x2bb1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858785:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c530cf lrc: 1/0,0 mode: --/PW res: [0x2bb1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.858787:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c530cf lrc: 0/0,0 mode: --/PW res: [0x2bb1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.858816:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529369.858825:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+24:39030:x1731745946584256:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1308us (1359us total) trans 12885080582 rc 0/0 00000100:00100000:0.0:1651529369.858828:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212578 00000100:00100000:0.0:1651529369.858834:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946584704 00000100:00100000:0.0:1651529369.858845:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212581 00000100:00100000:1.0:1651529369.858846:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529369.858846:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+24:39030:x1731745946584704:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529369.858858:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178978 count 1 00010000:00010000:0.0:1651529369.858862:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c530e4 lrc: 3/0,1 mode: --/PW res: [0x2bb22:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.858867:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c4f843 lrc: 2/0,0 mode: PR/PR res: [0x2bb22:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9642 expref: 86 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.858870:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.858871:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.858871:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c530e4 lrc: 4/0,1 mode: --/PW res: [0x2bb22:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.858878:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529369.858878:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c4f843 lrc: 3/0,0 mode: PR/PR res: [0x2bb22:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9642 expref: 86 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.858891:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c4f843 lrc: 4/0,0 mode: PR/PR res: [0x2bb22:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9642 expref: 86 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.858892:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529369.858895:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006aa45e66 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997068800:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529369.858904:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c2b2b59c going to sleep for 6 seconds 00000100:00100000:0.0:1651529369.858910:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946584768 00000100:00100000:0.0:1651529369.858916:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946584832 00000100:00100000:1.0:1651529369.858920:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529369.858920:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946584896 00000100:00100000:0.0:1651529369.858933:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946584960 00000100:00100000:0.0:1651529369.858937:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212582 00000100:00100000:0.0:1651529369.858938:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+28:39029:x1731745946584768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529369.858943:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178979 count 1 00010000:00010000:0.0:1651529369.858947:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c530eb lrc: 3/0,1 mode: --/PW res: [0x2bb23:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.858951:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000059de8c3d/0x3234de053c4f794 lrc: 2/0,0 mode: PR/PR res: [0x2bb23:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d938d expref: 86 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529369.858952:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212583 00000100:00100000:1.0:1651529369.858954:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:39030:x1731745946584832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529369.858954:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.858955:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.858956:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c530eb lrc: 4/0,1 mode: --/PW res: [0x2bb23:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529369.858960:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178980 count 1 00010000:00010000:0.0:1651529369.858962:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000059de8c3d/0x3234de053c4f794 lrc: 3/0,0 mode: PR/PR res: [0x2bb23:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d938d expref: 86 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.858964:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c530f2 lrc: 3/0,1 mode: --/PW res: [0x2bb24:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.858965:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000059de8c3d/0x3234de053c4f794 lrc: 4/0,0 mode: PR/PR res: [0x2bb23:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d938d expref: 86 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.858969:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c4f763 lrc: 2/0,0 mode: PR/PR res: [0x2bb24:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9316 expref: 86 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529369.858969:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000075b025a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997068864:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.858972:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.858973:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.858974:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c530f2 lrc: 4/0,1 mode: --/PW res: [0x2bb24:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.858982:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed830649 going to sleep for 6 seconds 00010000:00010000:1.0:1651529369.858987:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c4f763 lrc: 3/0,0 mode: PR/PR res: [0x2bb24:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9316 expref: 86 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.858991:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c4f763 lrc: 4/0,0 mode: PR/PR res: [0x2bb24:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9316 expref: 86 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.858995:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000059363096 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997068928:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529369.859005:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cdaa82fc going to sleep for 6 seconds 00000100:00100000:0.0:1651529369.859007:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212584 00000100:00100000:0.0:1651529369.859009:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:39029:x1731745946584896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529369.859011:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212585 00000100:00100000:1.0:1651529369.859013:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:39030:x1731745946584960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529369.859014:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178981 count 1 00002000:00080000:1.0:1651529369.859017:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178982 count 1 00010000:00010000:0.0:1651529369.859018:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c530f9 lrc: 3/0,1 mode: --/PW res: [0x2bb25:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859021:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53100 lrc: 3/0,1 mode: --/PW res: [0x2bb26:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.859022:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cab45436/0x3234de053c4f771 lrc: 2/0,0 mode: PR/PR res: [0x2bb25:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9332 expref: 86 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.859025:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a638527a/0x3234de053c4f74e lrc: 2/0,0 mode: PR/PR res: [0x2bb26:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92e5 expref: 86 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.859025:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.859026:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.859026:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c530f9 lrc: 4/0,1 mode: --/PW res: [0x2bb25:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859028:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.859029:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.859030:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53100 lrc: 4/0,1 mode: --/PW res: [0x2bb26:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.859033:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cab45436/0x3234de053c4f771 lrc: 3/0,0 mode: PR/PR res: [0x2bb25:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9332 expref: 86 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.859036:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a638527a/0x3234de053c4f74e lrc: 3/0,0 mode: PR/PR res: [0x2bb26:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92e5 expref: 86 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.859036:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cab45436/0x3234de053c4f771 lrc: 4/0,0 mode: PR/PR res: [0x2bb25:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9332 expref: 86 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.859039:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a638527a/0x3234de053c4f74e lrc: 4/0,0 mode: PR/PR res: [0x2bb26:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92e5 expref: 86 pid: 151609 timeout: 20128 lvb_type: 1 00000100:00100000:0.0:1651529369.859040:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000043b7984f pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997068992:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529369.859043:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002c4168d4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997069056:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529369.859049:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000003003c8b0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529369.859050:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 0000000057299e7f going to sleep for 6 seconds 00010000:00010000:0.0:1651529369.859055:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c530dd lrc: 3/0,1 mode: PW/PW res: [0x2bb21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.859058:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c530dd lrc: 3/0,1 mode: PW/PW res: [0x2bb21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.859061:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c530dd lrc: 3/0,1 mode: PW/PW res: [0x2bb21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.859063:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529369.859076:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c530dd lrc: 2/0,0 mode: PW/PW res: [0x2bb21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.859117:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946585024 00000100:00100000:1.0:1651529369.859132:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212586 00000100:00100000:1.0:1651529369.859134:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:39029:x1731745946585024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529369.859139:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178983 count 1 00010000:00010000:1.0:1651529369.859143:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53107 lrc: 3/0,1 mode: --/PW res: [0x2bb27:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.859144:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+30:39029:x1731745946584384:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1555us (1643us total) trans 12885080583 rc 0/0 00000100:00100000:0.0:1651529369.859147:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212580 00010000:00010000:1.0:1651529369.859148:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c4f820 lrc: 2/0,0 mode: PR/PR res: [0x2bb27:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95e0 expref: 86 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.859151:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.859151:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.859152:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53107 lrc: 4/0,1 mode: --/PW res: [0x2bb27:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859158:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c4f820 lrc: 3/0,0 mode: PR/PR res: [0x2bb27:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95e0 expref: 86 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.859162:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c4f820 lrc: 4/0,0 mode: PR/PR res: [0x2bb27:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95e0 expref: 86 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.859166:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ee8cd7c9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997069120:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.859167:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c530dd lrc: 2/0,0 mode: PW/PW res: [0x2bb21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.859171:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cde7e11a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529369.859172:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c530dd lrc: 2/0,0 mode: PW/PW res: [0x2bb21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.859175:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 0000000018ebe812 going to sleep for 6 seconds 00010000:00010000:0.0:1651529369.859175:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c530dd lrc: 3/0,0 mode: PW/PW res: [0x2bb21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.859180:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c530dd lrc: 1/0,0 mode: --/PW res: [0x2bb21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.859183:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c530dd lrc: 0/0,0 mode: --/PW res: [0x2bb21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.859187:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529369.859196:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006aa45e66 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997068800:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.859200:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c530e4 lrc: 3/0,1 mode: --/PW res: [0x2bb22:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.859244:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396530432 00010000:00010000:1.0:1651529369.859250:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c4f843 lrc: 4/0,0 mode: PR/PR res: [0x2bb22:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9642 expref: 87 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.859253:0:151609:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000317be83e/0x3234de053c4f701 lrc: 0/0,0 mode: --/PR res: [0x2bb20:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91b1 expref: 87 pid: 72396 timeout: 20128 lvb_type: 1 00000100:00100000:0.0:1651529369.859258:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000053ee5af1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997068672:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529369.859259:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13312 00000100:00100000:1.0:1651529369.859260:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+86:41278:x1731746396530432:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529369.859261:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c530d6 lrc: 3/0,1 mode: PW/PW res: [0x2bb20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859263:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.859264:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c4f843 lrc: 4/0,0 mode: PR/PR res: [0x2bb22:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9642 expref: 86 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.859265:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c530d6 lrc: 3/0,1 mode: PW/PW res: [0x2bb20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859268:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c4f843 lrc: 3/0,0 mode: PR/PR res: [0x2bb22:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9642 expref: 86 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.859268:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c530d6 lrc: 3/0,1 mode: PW/PW res: [0x2bb20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.859271:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c530d6 lrc: 3/0,1 mode: PW/PW res: [0x2bb20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.859273:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c530d6 lrc: 2/0,0 mode: PW/PW res: [0x2bb20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859274:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c4f843 lrc: 0/0,0 mode: --/PR res: [0x2bb22:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9642 expref: 86 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.859277:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.859278:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.859278:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c530e4 lrc: 3/0,1 mode: PW/PW res: [0x2bb22:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859288:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c530e4 lrc: 4/0,1 mode: PW/PW res: [0x2bb22:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859298:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529369.859307:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+85:41278:x1731746396530432:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 46us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529369.859309:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13312 00010000:00010000:1.0:1651529369.859316:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c530d6 lrc: 2/0,0 mode: PW/PW res: [0x2bb20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859319:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000314b5fa1 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529369.859320:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c530d6 lrc: 2/0,0 mode: PW/PW res: [0x2bb20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859323:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c530d6 lrc: 3/0,0 mode: PW/PW res: [0x2bb20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859327:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c530d6 lrc: 1/0,0 mode: --/PW res: [0x2bb20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.859327:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:39030:x1731745946584320:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1760us (1840us total) trans 12885080584 rc 0/0 00010000:00010000:1.0:1651529369.859330:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c530d6 lrc: 0/0,0 mode: --/PW res: [0x2bb20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.859332:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212579 00010000:00010000:0.0:1651529369.859338:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c530e4 lrc: 3/0,1 mode: PW/PW res: [0x2bb22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.859342:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c530e4 lrc: 3/0,1 mode: PW/PW res: [0x2bb22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.859345:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c530e4 lrc: 3/0,1 mode: PW/PW res: [0x2bb22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.859347:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c530e4 lrc: 2/0,0 mode: PW/PW res: [0x2bb22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859386:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c530e4 lrc: 2/0,0 mode: PW/PW res: [0x2bb22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.859393:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+30:39030:x1731745946584704:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 546us (577us total) trans 12885080585 rc 0/0 00010000:00010000:1.0:1651529369.859395:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c660975a already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529369.859396:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c530e4 lrc: 2/0,0 mode: PW/PW res: [0x2bb22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.859396:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212581 00010000:00010000:1.0:1651529369.859399:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c530e4 lrc: 3/0,0 mode: PW/PW res: [0x2bb22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859404:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c530e4 lrc: 1/0,0 mode: --/PW res: [0x2bb22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859406:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c530e4 lrc: 0/0,0 mode: --/PW res: [0x2bb22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.859535:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529369.859543:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529369.859551:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529369.859557:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529369.859563:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529369.859580:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529369.859580:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000075b025a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997068864:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.859589:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c530eb lrc: 3/0,1 mode: --/PW res: [0x2bb23:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.859596:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529369.859604:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000043b7984f pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997068992:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529369.859606:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396530496 00010000:00010000:0.0:1651529369.859607:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c530f9 lrc: 3/0,1 mode: --/PW res: [0x2bb25:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859611:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000059de8c3d/0x3234de053c4f794 lrc: 4/0,0 mode: PR/PR res: [0x2bb23:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d938d expref: 85 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.859617:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396530560 00010000:00010000:1.0:1651529369.859626:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cab45436/0x3234de053c4f771 lrc: 4/0,0 mode: PR/PR res: [0x2bb25:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9332 expref: 86 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:0.0:1651529369.859629:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396530624 00000100:00100000:1.0:1651529369.859631:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396530688 00010000:00010000:1.0:1651529369.859634:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a638527a/0x3234de053c4f74e lrc: 5/0,0 mode: PR/PR res: [0x2bb26:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92e5 expref: 88 pid: 151609 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.859634:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c4f763 lrc: 5/0,0 mode: PR/PR res: [0x2bb24:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9316 expref: 88 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:0.0:1651529369.859641:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13313 00000100:00100000:0.0:1651529369.859642:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+88:41278:x1731746396530496:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529369.859643:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13314 00000100:00100000:1.0:1651529369.859645:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+88:41279:x1731746396530560:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529369.859645:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529369.859647:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000059de8c3d/0x3234de053c4f794 lrc: 4/0,0 mode: PR/PR res: [0x2bb23:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d938d expref: 88 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.859648:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.859650:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cab45436/0x3234de053c4f771 lrc: 4/0,0 mode: PR/PR res: [0x2bb25:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9332 expref: 88 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.859651:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000059de8c3d/0x3234de053c4f794 lrc: 3/0,0 mode: PR/PR res: [0x2bb23:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d938d expref: 88 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.859653:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cab45436/0x3234de053c4f771 lrc: 3/0,0 mode: PR/PR res: [0x2bb25:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9332 expref: 88 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.859656:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059de8c3d/0x3234de053c4f794 lrc: 0/0,0 mode: --/PR res: [0x2bb23:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d938d expref: 88 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.859659:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cab45436/0x3234de053c4f771 lrc: 0/0,0 mode: --/PR res: [0x2bb25:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9332 expref: 88 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.859660:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.859660:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.859661:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c530eb lrc: 3/0,1 mode: PW/PW res: [0x2bb23:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859662:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.859663:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.859664:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c530f9 lrc: 3/0,1 mode: PW/PW res: [0x2bb25:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.859665:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c530eb lrc: 4/0,1 mode: PW/PW res: [0x2bb23:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859667:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c530f9 lrc: 4/0,1 mode: PW/PW res: [0x2bb25:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.859671:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529369.859677:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529369.859685:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+86:41278:x1731746396530496:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529369.859686:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+86:41279:x1731746396530560:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529369.859688:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13313 00000100:00100000:1.0:1651529369.859689:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13314 00000100:00100000:0.0:1651529369.859693:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13315 00000100:00100000:1.0:1651529369.859695:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13316 00000100:00100000:0.0:1651529369.859695:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+84:41278:x1731746396530624:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529369.859697:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+84:41279:x1731746396530688:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529369.859698:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529369.859699:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c4f763 lrc: 5/0,0 mode: PR/PR res: [0x2bb24:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9316 expref: 84 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.859700:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.859701:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a638527a/0x3234de053c4f74e lrc: 5/0,0 mode: PR/PR res: [0x2bb26:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92e5 expref: 84 pid: 151609 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.859703:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c4f763 lrc: 4/0,0 mode: PR/PR res: [0x2bb24:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9316 expref: 84 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.859705:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a638527a/0x3234de053c4f74e lrc: 4/0,0 mode: PR/PR res: [0x2bb26:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92e5 expref: 84 pid: 151609 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.859708:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.859708:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.859709:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.859709:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c530f2 lrc: 3/0,1 mode: PW/PW res: [0x2bb24:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859710:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.859710:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53100 lrc: 3/0,1 mode: PW/PW res: [0x2bb26:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.859712:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c530f2 lrc: 4/0,1 mode: PW/PW res: [0x2bb24:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859713:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53100 lrc: 4/0,1 mode: PW/PW res: [0x2bb26:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.859717:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529369.859718:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529369.859721:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+84:41278:x1731746396530624:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 26us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529369.859722:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+84:41279:x1731746396530688:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 25us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529369.859724:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13315 00000100:00100000:1.0:1651529369.859725:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13316 00010000:00010000:0.0:1651529369.859730:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c530f9 lrc: 3/0,1 mode: PW/PW res: [0x2bb25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.859733:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c530f9 lrc: 3/0,1 mode: PW/PW res: [0x2bb25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859735:0:72396:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a638527a/0x3234de053c4f74e lrc: 0/0,0 mode: --/PR res: [0x2bb26:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92e5 expref: 82 pid: 151609 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.859736:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c530f9 lrc: 3/0,1 mode: PW/PW res: [0x2bb25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.859739:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002c4168d4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997069056:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.859741:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c530f9 lrc: 2/0,0 mode: PW/PW res: [0x2bb25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859743:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53100 lrc: 3/0,1 mode: PW/PW res: [0x2bb26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859757:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53100 lrc: 3/0,1 mode: PW/PW res: [0x2bb26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859760:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53100 lrc: 3/0,1 mode: PW/PW res: [0x2bb26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859764:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53100 lrc: 3/0,1 mode: PW/PW res: [0x2bb26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859766:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53100 lrc: 2/0,0 mode: PW/PW res: [0x2bb26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.859794:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:39029:x1731745946584896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 785us (901us total) trans 12885080586 rc 0/0 00000100:00100000:0.0:1651529369.859797:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212584 00000100:00100000:0.0:1651529369.859801:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946585280 00000100:00100000:0.0:1651529369.859808:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946585600 00000100:00100000:1.0:1651529369.859811:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:39030:x1731745946584960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 797us (891us total) trans 12885080587 rc 0/0 00000100:00100000:0.0:1651529369.859811:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946585664 00000100:00100000:1.0:1651529369.859814:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212585 00000100:00100000:0.0:1651529369.859816:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212587 00000100:00100000:0.0:1651529369.859817:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+32:39030:x1731745946585280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529369.859819:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212588 00000100:00100000:1.0:1651529369.859821:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:39030:x1731745946585600:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529369.859822:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178984 count 1 00002000:00080000:1.0:1651529369.859826:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178985 count 1 00010000:00010000:0.0:1651529369.859827:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c5310e lrc: 3/0,1 mode: --/PW res: [0x2bb28:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859830:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c53115 lrc: 3/0,1 mode: --/PW res: [0x2bb29:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.859831:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0382f56/0x3234de053c4f732 lrc: 2/0,0 mode: PR/PR res: [0x2bb28:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9275 expref: 81 pid: 80281 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.859834:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.859835:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000049d4bb9b/0x3234de053c4f739 lrc: 2/0,0 mode: PR/PR res: [0x2bb29:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d929f expref: 81 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.859835:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.859836:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c5310e lrc: 4/0,1 mode: --/PW res: [0x2bb28:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859838:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.859838:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.859839:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c53115 lrc: 4/0,1 mode: --/PW res: [0x2bb29:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.859842:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b0382f56/0x3234de053c4f732 lrc: 3/0,0 mode: PR/PR res: [0x2bb28:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9275 expref: 81 pid: 80281 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.859845:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b0382f56/0x3234de053c4f732 lrc: 4/0,0 mode: PR/PR res: [0x2bb28:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9275 expref: 81 pid: 80281 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.859848:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000049d4bb9b/0x3234de053c4f739 lrc: 3/0,0 mode: PR/PR res: [0x2bb29:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d929f expref: 81 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529369.859850:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000043b7984f pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997069184:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.859852:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000049d4bb9b/0x3234de053c4f739 lrc: 4/0,0 mode: PR/PR res: [0x2bb29:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d929f expref: 81 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.859856:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005384a251 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997069248:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529369.859859:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a3b00cf3 going to sleep for 6 seconds 00010000:00010000:0.0:1651529369.859864:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c530f9 lrc: 2/0,0 mode: PW/PW res: [0x2bb25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.859865:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 0000000057299e7f going to sleep for 6 seconds 00010000:00010000:0.0:1651529369.859867:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001d04fb0a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529369.859868:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c530f9 lrc: 2/0,0 mode: PW/PW res: [0x2bb25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859870:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53100 lrc: 2/0,0 mode: PW/PW res: [0x2bb26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.859871:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c530f9 lrc: 3/0,0 mode: PW/PW res: [0x2bb25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859873:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004b2a6b06 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529369.859874:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53100 lrc: 2/0,0 mode: PW/PW res: [0x2bb26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.859876:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c530f9 lrc: 1/0,0 mode: --/PW res: [0x2bb25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859877:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53100 lrc: 3/0,0 mode: PW/PW res: [0x2bb26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.859878:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c530f9 lrc: 0/0,0 mode: --/PW res: [0x2bb25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859881:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53100 lrc: 1/0,0 mode: --/PW res: [0x2bb26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859884:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53100 lrc: 0/0,0 mode: --/PW res: [0x2bb26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.859886:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212589 00000100:00100000:0.0:1651529369.859888:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+32:39030:x1731745946585664:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529369.859892:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178986 count 1 00010000:00010000:1.0:1651529369.859893:0:72397:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c4f763 lrc: 0/0,0 mode: --/PR res: [0x2bb24:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9316 expref: 81 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.859895:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c5311c lrc: 3/0,1 mode: --/PW res: [0x2bb2a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.859899:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000adc29bfc/0x3234de053c4f71d lrc: 2/0,0 mode: PR/PR res: [0x2bb2a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9205 expref: 81 pid: 151609 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529369.859900:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000059363096 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997068928:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.859902:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.859903:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c530f2 lrc: 3/0,1 mode: PW/PW res: [0x2bb24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.859903:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.859904:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c5311c lrc: 4/0,1 mode: --/PW res: [0x2bb2a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859906:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c530f2 lrc: 3/0,1 mode: PW/PW res: [0x2bb24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859909:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c530f2 lrc: 3/0,1 mode: PW/PW res: [0x2bb24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.859909:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000adc29bfc/0x3234de053c4f71d lrc: 3/0,0 mode: PR/PR res: [0x2bb2a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9205 expref: 80 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.859912:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c530f2 lrc: 3/0,1 mode: PW/PW res: [0x2bb24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.859913:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000adc29bfc/0x3234de053c4f71d lrc: 4/0,0 mode: PR/PR res: [0x2bb2a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9205 expref: 80 pid: 151609 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.859914:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c530f2 lrc: 2/0,0 mode: PW/PW res: [0x2bb24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.859917:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000075b025a pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997069312:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529369.859924:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 000000003678d25f going to sleep for 6 seconds 00010000:00010000:0.0:1651529369.859929:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c530eb lrc: 3/0,1 mode: PW/PW res: [0x2bb23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.859932:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c530eb lrc: 3/0,1 mode: PW/PW res: [0x2bb23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.859935:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c530eb lrc: 3/0,1 mode: PW/PW res: [0x2bb23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.859938:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c530eb lrc: 2/0,0 mode: PW/PW res: [0x2bb23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.859953:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+33:39030:x1731745946584832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 998us (1075us total) trans 12885080588 rc 0/0 00000100:00100000:1.0:1651529369.859956:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212583 00010000:00010000:1.0:1651529369.859963:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c530f2 lrc: 2/0,0 mode: PW/PW res: [0x2bb24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859966:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000066921086 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529369.859967:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c530f2 lrc: 2/0,0 mode: PW/PW res: [0x2bb24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859972:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c530f2 lrc: 3/0,0 mode: PW/PW res: [0x2bb24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859977:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c530f2 lrc: 1/0,0 mode: --/PW res: [0x2bb24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.859977:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+33:39029:x1731745946584768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1038us (1137us total) trans 12885080589 rc 0/0 00010000:00010000:1.0:1651529369.859980:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c530f2 lrc: 0/0,0 mode: --/PW res: [0x2bb24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.859981:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212582 00010000:00010000:1.0:1651529369.859984:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c530eb lrc: 2/0,0 mode: PW/PW res: [0x2bb23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859987:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ac14729e already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529369.859988:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c530eb lrc: 2/0,0 mode: PW/PW res: [0x2bb23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859990:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c530eb lrc: 3/0,0 mode: PW/PW res: [0x2bb23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859993:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c530eb lrc: 1/0,0 mode: --/PW res: [0x2bb23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.859996:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c530eb lrc: 0/0,0 mode: --/PW res: [0x2bb23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.860005:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ee8cd7c9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997069120:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.860010:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53107 lrc: 3/0,1 mode: --/PW res: [0x2bb27:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.860013:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529369.860070:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396530752 00010000:00010000:1.0:1651529369.860081:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c4f820 lrc: 4/0,0 mode: PR/PR res: [0x2bb27:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95e0 expref: 81 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.860090:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13317 00000100:00100000:1.0:1651529369.860092:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000091b9484 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+81:41279:x1731746396530752:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529369.860095:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.860096:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c4f820 lrc: 4/0,0 mode: PR/PR res: [0x2bb27:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95e0 expref: 81 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.860100:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c4f820 lrc: 3/0,0 mode: PR/PR res: [0x2bb27:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95e0 expref: 81 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.860105:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c4f820 lrc: 0/0,0 mode: --/PR res: [0x2bb27:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95e0 expref: 81 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.860108:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.860109:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.860110:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53107 lrc: 3/0,1 mode: PW/PW res: [0x2bb27:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.860113:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53107 lrc: 4/0,1 mode: PW/PW res: [0x2bb27:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.860121:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529369.860129:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000091b9484 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+80:41279:x1731746396530752:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529369.860132:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13317 00010000:00010000:1.0:1651529369.860143:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53107 lrc: 3/0,1 mode: PW/PW res: [0x2bb27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.860146:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53107 lrc: 3/0,1 mode: PW/PW res: [0x2bb27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.860149:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53107 lrc: 3/0,1 mode: PW/PW res: [0x2bb27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.860152:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53107 lrc: 2/0,0 mode: PW/PW res: [0x2bb27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.860197:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+33:39029:x1731745946585024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1063us (1133us total) trans 12885080590 rc 0/0 00000100:00100000:1.0:1651529369.860200:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212586 00010000:00010000:1.0:1651529369.860207:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53107 lrc: 2/0,0 mode: PW/PW res: [0x2bb27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.860210:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000014fe598c already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529369.860211:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53107 lrc: 2/0,0 mode: PW/PW res: [0x2bb27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.860216:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53107 lrc: 3/0,0 mode: PW/PW res: [0x2bb27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.860243:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53107 lrc: 1/0,0 mode: --/PW res: [0x2bb27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.860252:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53107 lrc: 0/0,0 mode: --/PW res: [0x2bb27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.860271:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529369.860282:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946585856 00000100:00100000:1.0:1651529369.860298:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212590 00000100:00100000:0.0:1651529369.860298:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529369.860300:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+33:39030:x1731745946585856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529369.860305:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529369.860306:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178988 count 1 00010000:00010000:1.0:1651529369.860310:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53123 lrc: 3/0,1 mode: --/PW res: [0x2bb2c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.860312:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529369.860315:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c4f84a lrc: 2/0,0 mode: PR/PR res: [0x2bb2c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9696 expref: 79 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.860318:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.860319:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.860319:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53123 lrc: 4/0,1 mode: --/PW res: [0x2bb2c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.860319:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946585792 00000100:00100000:0.0:1651529369.860325:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946585984 00010000:00010000:1.0:1651529369.860326:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c4f84a lrc: 3/0,0 mode: PR/PR res: [0x2bb2c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9696 expref: 79 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1651529369.860333:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212591 00000100:00100000:0.0:1651529369.860335:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+35:39029:x1731745946585792:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529369.860339:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c4f84a lrc: 4/0,0 mode: PR/PR res: [0x2bb2c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9696 expref: 79 pid: 80279 timeout: 20128 lvb_type: 1 00002000:00080000:0.0:1651529369.860340:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178987 count 1 00000100:00100000:1.0:1651529369.860343:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000028589556 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997069376:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.860345:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c5312a lrc: 3/0,1 mode: --/PW res: [0x2bb2b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.860350:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000be333df1/0x3234de053c4f747 lrc: 2/0,0 mode: PR/PR res: [0x2bb2b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92d7 expref: 79 pid: 80281 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529369.860354:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 0000000018ebe812 going to sleep for 6 seconds 00000100:00100000:1.0:1651529369.860360:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946585920 00000100:00100000:1.0:1651529369.860371:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212592 00000100:00100000:1.0:1651529369.860373:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:39030:x1731745946585984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529369.860375:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.860376:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.860376:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c5312a lrc: 4/0,1 mode: --/PW res: [0x2bb2b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529369.860378:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178990 count 1 00010000:00010000:1.0:1651529369.860382:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c53131 lrc: 3/0,1 mode: --/PW res: [0x2bb2e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.860385:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000be333df1/0x3234de053c4f747 lrc: 3/0,0 mode: PR/PR res: [0x2bb2b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92d7 expref: 79 pid: 80281 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.860386:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c4f804 lrc: 2/0,0 mode: PR/PR res: [0x2bb2e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9538 expref: 79 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.860388:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000be333df1/0x3234de053c4f747 lrc: 4/0,0 mode: PR/PR res: [0x2bb2b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92d7 expref: 79 pid: 80281 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.860389:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.860390:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.860391:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c53131 lrc: 4/0,1 mode: --/PW res: [0x2bb2e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.860396:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000673bcbe2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997069440:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.860397:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c4f804 lrc: 3/0,0 mode: PR/PR res: [0x2bb2e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9538 expref: 79 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.860401:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c4f804 lrc: 4/0,0 mode: PR/PR res: [0x2bb2e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9538 expref: 79 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:0.0:1651529369.860405:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 0000000009370c1d going to sleep for 6 seconds 00000100:00100000:1.0:1651529369.860408:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bddc5ca7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997069504:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529369.860412:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212593 00000100:00100000:0.0:1651529369.860414:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:39029:x1731745946585920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529369.860416:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d09f5ee1 going to sleep for 6 seconds 00002000:00080000:0.0:1651529369.860418:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178989 count 1 00010000:00010000:0.0:1651529369.860422:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c53138 lrc: 3/0,1 mode: --/PW res: [0x2bb2d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.860426:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000070a6ad94/0x3234de053c4f755 lrc: 2/0,0 mode: PR/PR res: [0x2bb2d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d930f expref: 79 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.860429:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529369.860430:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529369.860430:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.860431:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c53138 lrc: 4/0,1 mode: --/PW res: [0x2bb2d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.860444:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000070a6ad94/0x3234de053c4f755 lrc: 3/0,0 mode: PR/PR res: [0x2bb2d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d930f expref: 79 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.860448:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000070a6ad94/0x3234de053c4f755 lrc: 4/0,0 mode: PR/PR res: [0x2bb2d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d930f expref: 79 pid: 151609 timeout: 20128 lvb_type: 1 00000100:00100000:0.0:1651529369.860452:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ad6d0877 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997069568:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529369.860460:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e1aa6a77 going to sleep for 6 seconds 00000100:00100000:0.0:1651529369.860466:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946586048 00000100:00100000:0.0:1651529369.860472:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212594 00000100:00100000:0.0:1651529369.860473:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+37:39029:x1731745946586048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529369.860478:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178991 count 1 00010000:00010000:0.0:1651529369.860481:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c5313f lrc: 3/0,1 mode: --/PW res: [0x2bb2f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.860485:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f9982452/0x3234de053c4f708 lrc: 2/0,0 mode: PR/PR res: [0x2bb2f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91e2 expref: 79 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.860488:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.860489:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.860490:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c5313f lrc: 4/0,1 mode: --/PW res: [0x2bb2f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.860495:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f9982452/0x3234de053c4f708 lrc: 3/0,0 mode: PR/PR res: [0x2bb2f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91e2 expref: 79 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.860515:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f9982452/0x3234de053c4f708 lrc: 4/0,0 mode: PR/PR res: [0x2bb2f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91e2 expref: 79 pid: 151609 timeout: 20128 lvb_type: 1 00000100:00100000:0.0:1651529369.860520:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000059363096 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997069632:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529369.860536:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 000000000d706dff going to sleep for 6 seconds 00000100:00100000:0.0:1651529369.860604:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000043b7984f pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997069184:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.860609:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c5310e lrc: 3/0,1 mode: --/PW res: [0x2bb28:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.860623:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000075b025a pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997069312:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529369.860624:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529369.860626:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c5311c lrc: 3/0,1 mode: --/PW res: [0x2bb2a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.860631:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529369.860643:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529369.860654:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396531328 00010000:00010000:1.0:1651529369.860660:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b0382f56/0x3234de053c4f732 lrc: 4/0,0 mode: PR/PR res: [0x2bb28:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9275 expref: 80 pid: 80281 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.860671:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396531392 00010000:00010000:1.0:1651529369.860674:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000049d4bb9b/0x3234de053c4f739 lrc: 5/0,0 mode: PR/PR res: [0x2bb29:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d929f expref: 81 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:0.0:1651529369.860674:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396531456 00000100:00100000:1.0:1651529369.860679:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13318 00010000:00010000:0.0:1651529369.860679:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000adc29bfc/0x3234de053c4f71d lrc: 4/0,0 mode: PR/PR res: [0x2bb2a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9205 expref: 82 pid: 151609 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.860681:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+82:41279:x1731746396531328:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529369.860684:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.860685:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b0382f56/0x3234de053c4f732 lrc: 4/0,0 mode: PR/PR res: [0x2bb28:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9275 expref: 82 pid: 80281 timeout: 20128 lvb_type: 1 00000100:00100000:0.0:1651529369.860685:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13319 00000100:00100000:0.0:1651529369.860687:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+82:41278:x1731746396531392:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529369.860689:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b0382f56/0x3234de053c4f732 lrc: 3/0,0 mode: PR/PR res: [0x2bb28:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9275 expref: 82 pid: 80281 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.860690:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529369.860691:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000049d4bb9b/0x3234de053c4f739 lrc: 5/0,0 mode: PR/PR res: [0x2bb29:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d929f expref: 82 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.860695:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0382f56/0x3234de053c4f732 lrc: 0/0,0 mode: --/PR res: [0x2bb28:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9275 expref: 82 pid: 80281 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.860695:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000049d4bb9b/0x3234de053c4f739 lrc: 4/0,0 mode: PR/PR res: [0x2bb29:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d929f expref: 82 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.860701:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.860701:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.860701:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.860702:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c5310e lrc: 3/0,1 mode: PW/PW res: [0x2bb28:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.860702:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.860702:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c53115 lrc: 3/0,1 mode: PW/PW res: [0x2bb29:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.860705:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c5310e lrc: 4/0,1 mode: PW/PW res: [0x2bb28:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.860705:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c53115 lrc: 4/0,1 mode: PW/PW res: [0x2bb29:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.860710:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529369.860714:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529369.860724:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+81:41279:x1731746396531328:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 43us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529369.860727:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13318 00000100:00100000:0.0:1651529369.860729:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+81:41278:x1731746396531392:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 40us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529369.860732:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13320 00000100:00100000:1.0:1651529369.860733:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+80:41279:x1731746396531456:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529369.860733:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13319 00010000:00010000:1.0:1651529369.860736:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.860737:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000adc29bfc/0x3234de053c4f71d lrc: 4/0,0 mode: PR/PR res: [0x2bb2a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9205 expref: 79 pid: 151609 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.860740:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c5310e lrc: 3/0,1 mode: PW/PW res: [0x2bb28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.860741:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000adc29bfc/0x3234de053c4f71d lrc: 3/0,0 mode: PR/PR res: [0x2bb2a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9205 expref: 79 pid: 151609 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.860743:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c5310e lrc: 3/0,1 mode: PW/PW res: [0x2bb28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.860755:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000adc29bfc/0x3234de053c4f71d lrc: 0/0,0 mode: --/PR res: [0x2bb2a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9205 expref: 79 pid: 151609 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.860757:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c5310e lrc: 3/0,1 mode: PW/PW res: [0x2bb28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.860759:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.860760:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.860760:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c5310e lrc: 2/0,0 mode: PW/PW res: [0x2bb28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.860761:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c5311c lrc: 3/0,1 mode: PW/PW res: [0x2bb2a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.860764:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c5311c lrc: 4/0,1 mode: PW/PW res: [0x2bb2a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.860772:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529369.860778:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+78:41279:x1731746396531456:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 44us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529369.860780:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13320 00010000:00010000:1.0:1651529369.860792:0:72396:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049d4bb9b/0x3234de053c4f739 lrc: 0/0,0 mode: --/PR res: [0x2bb29:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d929f expref: 77 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.860796:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005384a251 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997069248:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.860800:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c53115 lrc: 3/0,1 mode: PW/PW res: [0x2bb29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.860803:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c53115 lrc: 3/0,1 mode: PW/PW res: [0x2bb29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.860806:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c53115 lrc: 3/0,1 mode: PW/PW res: [0x2bb29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.860809:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c53115 lrc: 3/0,1 mode: PW/PW res: [0x2bb29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.860813:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+38:39030:x1731745946585280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 995us (1279us total) trans 12885080591 rc 0/0 00000100:00100000:0.0:1651529369.860816:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212587 00010000:00010000:1.0:1651529369.860819:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c53115 lrc: 2/0,0 mode: PW/PW res: [0x2bb29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.860825:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c5310e lrc: 2/0,0 mode: PW/PW res: [0x2bb28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.860828:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d1167ce5 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529369.860830:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c5310e lrc: 2/0,0 mode: PW/PW res: [0x2bb28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.860833:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c5310e lrc: 3/0,0 mode: PW/PW res: [0x2bb28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.860837:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c5310e lrc: 1/0,0 mode: --/PW res: [0x2bb28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.860840:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c5310e lrc: 0/0,0 mode: --/PW res: [0x2bb28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.860844:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c53115 lrc: 2/0,0 mode: PW/PW res: [0x2bb29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.860847:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dd6b1be4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529369.860848:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c53115 lrc: 2/0,0 mode: PW/PW res: [0x2bb29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.860851:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c53115 lrc: 3/0,0 mode: PW/PW res: [0x2bb29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.860854:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c53115 lrc: 1/0,0 mode: --/PW res: [0x2bb29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.860856:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c53115 lrc: 0/0,0 mode: --/PW res: [0x2bb29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.860861:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+38:39030:x1731745946585600:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1039us (1281us total) trans 12885080592 rc 0/0 00010000:00010000:0.0:1651529369.860862:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c5311c lrc: 3/0,1 mode: PW/PW res: [0x2bb2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.860864:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c5311c lrc: 3/0,1 mode: PW/PW res: [0x2bb2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.860865:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212588 00010000:00010000:0.0:1651529369.860867:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c5311c lrc: 3/0,1 mode: PW/PW res: [0x2bb2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.860870:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c5311c lrc: 2/0,0 mode: PW/PW res: [0x2bb2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.860883:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000028589556 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997069376:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.860887:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53123 lrc: 3/0,1 mode: --/PW res: [0x2bb2c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.860893:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c5311c lrc: 2/0,0 mode: PW/PW res: [0x2bb2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.860896:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f56810a1 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529369.860897:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c5311c lrc: 2/0,0 mode: PW/PW res: [0x2bb2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.860900:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c5311c lrc: 3/0,0 mode: PW/PW res: [0x2bb2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.860905:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c5311c lrc: 1/0,0 mode: --/PW res: [0x2bb2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.860907:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c5311c lrc: 0/0,0 mode: --/PW res: [0x2bb2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.860925:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+38:39030:x1731745946585664:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1036us (1328us total) trans 12885080593 rc 0/0 00000100:00100000:0.0:1651529369.860928:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212589 00000100:00100000:0.0:1651529369.860973:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000673bcbe2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997069440:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.860977:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c5312a lrc: 3/0,1 mode: --/PW res: [0x2bb2b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.861007:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529369.861015:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bddc5ca7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997069504:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529369.861016:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529369.861024:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c53131 lrc: 3/0,1 mode: --/PW res: [0x2bb2e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.861024:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529369.861033:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529369.861037:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396531584 00000100:00100000:0.0:1651529369.861040:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529369.861042:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000be333df1/0x3234de053c4f747 lrc: 4/0,0 mode: PR/PR res: [0x2bb2b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92d7 expref: 77 pid: 80281 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.861056:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396531648 00010000:00010000:1.0:1651529369.861059:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c4f804 lrc: 4/0,0 mode: PR/PR res: [0x2bb2e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9538 expref: 78 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.861064:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396531776 00000100:00100000:0.0:1651529369.861064:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ad6d0877 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997069568:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.861066:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f9982452/0x3234de053c4f708 lrc: 5/0,0 mode: PR/PR res: [0x2bb2f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91e2 expref: 79 pid: 151609 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.861068:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c53138 lrc: 3/0,1 mode: --/PW res: [0x2bb2d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.861070:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396531520 00010000:00010000:1.0:1651529369.861072:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c4f84a lrc: 4/0,0 mode: PR/PR res: [0x2bb2c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9696 expref: 80 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:0.0:1651529369.861074:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000059363096 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997069632:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529369.861076:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396531712 00010000:00010000:0.0:1651529369.861077:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c5313f lrc: 3/0,1 mode: --/PW res: [0x2bb2f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861078:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000070a6ad94/0x3234de053c4f755 lrc: 4/0,0 mode: PR/PR res: [0x2bb2d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d930f expref: 81 pid: 151609 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.861082:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13321 00000100:00100000:1.0:1651529369.861084:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+81:41278:x1731746396531584:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529369.861084:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13322 00010000:00010000:1.0:1651529369.861087:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529369.861087:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+81:41278:x1731746396531648:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529369.861088:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000be333df1/0x3234de053c4f747 lrc: 4/0,0 mode: PR/PR res: [0x2bb2b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92d7 expref: 81 pid: 80281 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.861090:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529369.861092:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c4f804 lrc: 4/0,0 mode: PR/PR res: [0x2bb2e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9538 expref: 81 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.861094:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000be333df1/0x3234de053c4f747 lrc: 3/0,0 mode: PR/PR res: [0x2bb2b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92d7 expref: 81 pid: 80281 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.861095:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c4f804 lrc: 3/0,0 mode: PR/PR res: [0x2bb2e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9538 expref: 81 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.861100:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be333df1/0x3234de053c4f747 lrc: 0/0,0 mode: --/PR res: [0x2bb2b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d92d7 expref: 81 pid: 80281 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.861101:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c4f804 lrc: 0/0,0 mode: --/PR res: [0x2bb2e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9538 expref: 81 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.861103:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.861104:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.861104:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c5312a lrc: 3/0,1 mode: PW/PW res: [0x2bb2b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.861105:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.861106:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.861107:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c53131 lrc: 3/0,1 mode: PW/PW res: [0x2bb2e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861108:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c5312a lrc: 4/0,1 mode: PW/PW res: [0x2bb2b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.861110:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c53131 lrc: 4/0,1 mode: PW/PW res: [0x2bb2e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861116:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529369.861126:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529369.861131:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+79:41278:x1731746396531584:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 46us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529369.861134:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13321 00000100:00100000:0.0:1651529369.861134:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+79:41278:x1731746396531648:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 47us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529369.861137:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13322 00000100:00100000:1.0:1651529369.861139:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13323 00000100:00100000:1.0:1651529369.861140:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+77:41278:x1731746396531776:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529369.861143:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529369.861143:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13324 00010000:00010000:1.0:1651529369.861144:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f9982452/0x3234de053c4f708 lrc: 4/0,0 mode: PR/PR res: [0x2bb2f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91e2 expref: 77 pid: 151609 timeout: 20128 lvb_type: 1 00000100:00100000:0.0:1651529369.861145:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bbd85ac9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+77:41279:x1731746396531520:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529369.861147:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.861148:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f9982452/0x3234de053c4f708 lrc: 3/0,0 mode: PR/PR res: [0x2bb2f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91e2 expref: 77 pid: 151609 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.861149:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c4f84a lrc: 4/0,0 mode: PR/PR res: [0x2bb2c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9696 expref: 77 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.861153:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9982452/0x3234de053c4f708 lrc: 0/0,0 mode: --/PR res: [0x2bb2f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91e2 expref: 77 pid: 151609 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.861157:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.861157:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.861158:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c5313f lrc: 3/0,1 mode: PW/PW res: [0x2bb2f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861161:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c5313f lrc: 4/0,1 mode: PW/PW res: [0x2bb2f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861170:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529369.861173:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c4f84a lrc: 3/0,0 mode: PR/PR res: [0x2bb2c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9696 expref: 76 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.861176:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+76:41278:x1731746396531776:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 35us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529369.861178:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13323 00010000:00010000:0.0:1651529369.861179:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c4f84a lrc: 0/0,0 mode: --/PR res: [0x2bb2c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9696 expref: 76 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.861183:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13325 00010000:00010000:0.0:1651529369.861183:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.861183:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.861184:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53123 lrc: 3/0,1 mode: PW/PW res: [0x2bb2c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.861185:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+74:41279:x1731746396531712:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529369.861187:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529369.861187:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53123 lrc: 4/0,1 mode: PW/PW res: [0x2bb2c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861188:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000070a6ad94/0x3234de053c4f755 lrc: 4/0,0 mode: PR/PR res: [0x2bb2d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d930f expref: 74 pid: 151609 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.861192:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000070a6ad94/0x3234de053c4f755 lrc: 3/0,0 mode: PR/PR res: [0x2bb2d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d930f expref: 74 pid: 151609 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.861196:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529369.861203:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070a6ad94/0x3234de053c4f755 lrc: 0/0,0 mode: --/PR res: [0x2bb2d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d930f expref: 74 pid: 151609 timeout: 20128 lvb_type: 1 00000100:00100000:0.0:1651529369.861203:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bbd85ac9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+74:41279:x1731746396531520:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 58us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529369.861206:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13324 00010000:00010000:1.0:1651529369.861208:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.861209:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.861210:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c53138 lrc: 3/0,1 mode: PW/PW res: [0x2bb2d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861212:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c53138 lrc: 4/0,1 mode: PW/PW res: [0x2bb2d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.861217:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c5313f lrc: 3/0,1 mode: PW/PW res: [0x2bb2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861221:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529369.861241:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+72:41279:x1731746396531712:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 56us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529369.861244:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13325 00010000:00010000:0.0:1651529369.861244:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c5313f lrc: 3/0,1 mode: PW/PW res: [0x2bb2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.861247:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c5313f lrc: 3/0,1 mode: PW/PW res: [0x2bb2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861252:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c53131 lrc: 3/0,1 mode: PW/PW res: [0x2bb2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.861253:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c5313f lrc: 2/0,0 mode: PW/PW res: [0x2bb2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861256:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c53131 lrc: 3/0,1 mode: PW/PW res: [0x2bb2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861259:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c53131 lrc: 3/0,1 mode: PW/PW res: [0x2bb2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861262:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c53131 lrc: 2/0,0 mode: PW/PW res: [0x2bb2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.861294:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:39029:x1731745946586048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 820us (864us total) trans 12885080594 rc 0/0 00000100:00100000:0.0:1651529369.861297:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212594 00000100:00100000:1.0:1651529369.861304:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+38:39030:x1731745946585984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 930us (998us total) trans 12885080595 rc 0/0 00010000:00010000:0.0:1651529369.861304:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c5313f lrc: 2/0,0 mode: PW/PW res: [0x2bb2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.861307:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212592 00010000:00010000:0.0:1651529369.861308:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000215144f2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529369.861309:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c5313f lrc: 2/0,0 mode: PW/PW res: [0x2bb2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.861312:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c5313f lrc: 3/0,0 mode: PW/PW res: [0x2bb2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861314:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c53131 lrc: 2/0,0 mode: PW/PW res: [0x2bb2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.861316:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c5313f lrc: 1/0,0 mode: --/PW res: [0x2bb2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861317:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba437fe0 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529369.861319:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c53131 lrc: 2/0,0 mode: PW/PW res: [0x2bb2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.861319:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c5313f lrc: 0/0,0 mode: --/PW res: [0x2bb2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861321:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c53131 lrc: 3/0,0 mode: PW/PW res: [0x2bb2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.861325:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c53138 lrc: 3/0,1 mode: PW/PW res: [0x2bb2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861326:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c53131 lrc: 1/0,0 mode: --/PW res: [0x2bb2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.861328:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c53138 lrc: 3/0,1 mode: PW/PW res: [0x2bb2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861329:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c53131 lrc: 0/0,0 mode: --/PW res: [0x2bb2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.861331:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c53138 lrc: 3/0,1 mode: PW/PW res: [0x2bb2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861334:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53123 lrc: 3/0,1 mode: PW/PW res: [0x2bb2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.861334:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c53138 lrc: 2/0,0 mode: PW/PW res: [0x2bb2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861337:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53123 lrc: 3/0,1 mode: PW/PW res: [0x2bb2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861340:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53123 lrc: 3/0,1 mode: PW/PW res: [0x2bb2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861350:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53123 lrc: 2/0,0 mode: PW/PW res: [0x2bb2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.861384:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+39:39029:x1731745946585920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 969us (1071us total) trans 12885080596 rc 0/0 00000100:00100000:0.0:1651529369.861387:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212593 00000100:00100000:1.0:1651529369.861393:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+38:39030:x1731745946585856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1092us (1122us total) trans 12885080597 rc 0/0 00010000:00010000:0.0:1651529369.861393:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c53138 lrc: 2/0,0 mode: PW/PW res: [0x2bb2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.861396:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212590 00010000:00010000:0.0:1651529369.861397:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000f18bca1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529369.861398:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c53138 lrc: 2/0,0 mode: PW/PW res: [0x2bb2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.861401:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c53138 lrc: 3/0,0 mode: PW/PW res: [0x2bb2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861403:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53123 lrc: 2/0,0 mode: PW/PW res: [0x2bb2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.861405:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c53138 lrc: 1/0,0 mode: --/PW res: [0x2bb2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861407:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006cbd0d09 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529369.861408:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53123 lrc: 2/0,0 mode: PW/PW res: [0x2bb2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.861408:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c53138 lrc: 0/0,0 mode: --/PW res: [0x2bb2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861410:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53123 lrc: 3/0,0 mode: PW/PW res: [0x2bb2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.861413:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c5312a lrc: 3/0,1 mode: PW/PW res: [0x2bb2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861415:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53123 lrc: 1/0,0 mode: --/PW res: [0x2bb2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.861417:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c5312a lrc: 3/0,1 mode: PW/PW res: [0x2bb2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861418:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53123 lrc: 0/0,0 mode: --/PW res: [0x2bb2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.861420:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c5312a lrc: 3/0,1 mode: PW/PW res: [0x2bb2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.861422:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c5312a lrc: 2/0,0 mode: PW/PW res: [0x2bb2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.861458:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529369.861463:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+38:39029:x1731745946585792:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1127us (1165us total) trans 12885080598 rc 0/0 00000100:00100000:0.0:1651529369.861466:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212591 00000100:00100000:0.0:1651529369.861470:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946586112 00000100:00100000:1.0:1651529369.861473:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529369.861478:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946586240 00000100:00100000:0.0:1651529369.861482:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212595 00000100:00100000:0.0:1651529369.861483:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+39:39030:x1731745946586112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529369.861487:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529369.861488:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178992 count 1 00010000:00010000:0.0:1651529369.861499:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c53146 lrc: 3/0,1 mode: --/PW res: [0x2bb30:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.861504:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c4f7be lrc: 2/0,0 mode: PR/PR res: [0x2bb30:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9427 expref: 71 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.861507:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.861507:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.861508:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c53146 lrc: 4/0,1 mode: --/PW res: [0x2bb30:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.861515:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c4f7be lrc: 3/0,0 mode: PR/PR res: [0x2bb30:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9427 expref: 71 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.861519:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c4f7be lrc: 4/0,0 mode: PR/PR res: [0x2bb30:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9427 expref: 71 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:0.0:1651529369.861523:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000673bcbe2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997069696:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529369.861532:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 000000000d706dff going to sleep for 6 seconds 00000100:00100000:0.0:1651529369.861538:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946586176 00000100:00100000:0.0:1651529369.861549:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212596 00000100:00100000:0.0:1651529369.861550:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+40:39030:x1731745946586240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529369.861556:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178994 count 1 00010000:00010000:0.0:1651529369.861560:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5314d lrc: 3/0,1 mode: --/PW res: [0x2bb32:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.861564:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c4f82e lrc: 2/0,0 mode: PR/PR res: [0x2bb32:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9618 expref: 71 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.861567:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.861567:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.861568:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5314d lrc: 4/0,1 mode: --/PW res: [0x2bb32:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861573:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c5312a lrc: 2/0,0 mode: PW/PW res: [0x2bb2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.861574:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c4f82e lrc: 3/0,0 mode: PR/PR res: [0x2bb32:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9618 expref: 71 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.861577:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002d7487dc already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529369.861578:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c5312a lrc: 2/0,0 mode: PW/PW res: [0x2bb2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.861580:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c4f82e lrc: 4/0,0 mode: PR/PR res: [0x2bb32:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9618 expref: 71 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.861583:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c5312a lrc: 3/0,0 mode: PW/PW res: [0x2bb2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.861584:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ad6d0877 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997069760:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.861588:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c5312a lrc: 1/0,0 mode: --/PW res: [0x2bb2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861591:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c5312a lrc: 0/0,0 mode: --/PW res: [0x2bb2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.861600:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212597 00000100:00100000:1.0:1651529369.861602:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+40:39029:x1731745946586176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529369.861608:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178993 count 1 00010000:00010000:1.0:1651529369.861611:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c53154 lrc: 3/0,1 mode: --/PW res: [0x2bb31:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.861616:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 0000000009370c1d going to sleep for 6 seconds 00010000:00010000:1.0:1651529369.861622:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c4f7cc lrc: 2/0,0 mode: PR/PR res: [0x2bb31:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d945f expref: 71 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.861626:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.861626:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.861627:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c53154 lrc: 4/0,1 mode: --/PW res: [0x2bb31:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861634:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c4f7cc lrc: 3/0,0 mode: PR/PR res: [0x2bb31:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d945f expref: 71 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.861637:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c4f7cc lrc: 4/0,0 mode: PR/PR res: [0x2bb31:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d945f expref: 71 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.861642:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ffb5d0a pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997069824:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529369.861659:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b7af823 going to sleep for 6 seconds 00000100:00100000:0.0:1651529369.861660:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529369.861665:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946586688 00000100:00100000:1.0:1651529369.861677:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212598 00000100:00100000:1.0:1651529369.861679:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+41:39030:x1731745946586688:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529369.861690:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178995 count 1 00010000:00010000:1.0:1651529369.861694:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c5315b lrc: 3/0,1 mode: --/PW res: [0x2bb33:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861699:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c4f7da lrc: 2/0,0 mode: PR/PR res: [0x2bb33:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d947b expref: 71 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.861702:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.861702:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.861703:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c5315b lrc: 4/0,1 mode: --/PW res: [0x2bb33:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861709:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c4f7da lrc: 3/0,0 mode: PR/PR res: [0x2bb33:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d947b expref: 71 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.861712:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c4f7da lrc: 4/0,0 mode: PR/PR res: [0x2bb33:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d947b expref: 71 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.861717:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bddc5ca7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997069888:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529369.861730:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 0000000057299e7f going to sleep for 6 seconds 00000100:00100000:1.0:1651529369.861807:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529369.861816:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529369.861826:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529369.861826:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946586752 00000100:00100000:1.0:1651529369.861835:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529369.861844:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946586944 00000100:00100000:1.0:1651529369.861855:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946587008 00000100:00100000:0.0:1651529369.861857:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946586880 00000100:00100000:1.0:1651529369.861862:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212599 00000100:00100000:1.0:1651529369.861863:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f412854c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+45:39030:x1731745946586752:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529369.861868:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212600 00002000:00080000:1.0:1651529369.861869:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178996 count 1 00000100:00100000:0.0:1651529369.861870:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+45:39029:x1731745946586944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529369.861873:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c53162 lrc: 3/0,1 mode: --/PW res: [0x2bb34:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529369.861875:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178998 count 1 00010000:00010000:1.0:1651529369.861877:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007126e775/0x3234de053c4f79b lrc: 2/0,0 mode: PR/PR res: [0x2bb34:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93a9 expref: 71 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.861880:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c53169 lrc: 3/0,1 mode: --/PW res: [0x2bb36:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861881:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.861881:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.861882:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c53162 lrc: 4/0,1 mode: --/PW res: [0x2bb34:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.861884:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003fb54722/0x3234de053c4f78d lrc: 2/0,0 mode: PR/PR res: [0x2bb36:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d937f expref: 71 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.861887:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.861888:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007126e775/0x3234de053c4f79b lrc: 3/0,0 mode: PR/PR res: [0x2bb34:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93a9 expref: 71 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.861888:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.861889:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c53169 lrc: 4/0,1 mode: --/PW res: [0x2bb36:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.861892:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007126e775/0x3234de053c4f79b lrc: 4/0,0 mode: PR/PR res: [0x2bb34:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93a9 expref: 71 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.861896:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000007fba516 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997069952:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.861896:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003fb54722/0x3234de053c4f78d lrc: 3/0,0 mode: PR/PR res: [0x2bb36:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d937f expref: 71 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.861899:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003fb54722/0x3234de053c4f78d lrc: 4/0,0 mode: PR/PR res: [0x2bb36:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d937f expref: 71 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:0.0:1651529369.861904:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002c4168d4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997070016:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529369.861906:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd96f074 going to sleep for 6 seconds 00000100:00100000:0.0:1651529369.861913:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a3b00cf3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529369.861926:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212601 00000100:00100000:0.0:1651529369.861928:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+45:39030:x1731745946587008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529369.861933:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00080000:0.0:1651529369.861933:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178999 count 1 00010000:00010000:0.0:1651529369.861936:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c53170 lrc: 3/0,1 mode: --/PW res: [0x2bb37:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.861941:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b740c8d9/0x3234de053c4f72b lrc: 2/0,0 mode: PR/PR res: [0x2bb37:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d923d expref: 71 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.861944:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.861963:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.861964:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c53170 lrc: 4/0,1 mode: --/PW res: [0x2bb37:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.861965:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396531840 00010000:00010000:1.0:1651529369.861971:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c4f7be lrc: 5/0,0 mode: PR/PR res: [0x2bb30:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9427 expref: 72 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.861972:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b740c8d9/0x3234de053c4f72b lrc: 3/0,0 mode: PR/PR res: [0x2bb37:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d923d expref: 72 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.861976:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b740c8d9/0x3234de053c4f72b lrc: 4/0,0 mode: PR/PR res: [0x2bb37:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d923d expref: 72 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.861979:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13326 00000100:00100000:0.0:1651529369.861980:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000053ee5af1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997070080:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529369.861981:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+72:41279:x1731746396531840:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529369.861983:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.861985:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c4f7be lrc: 5/0,0 mode: PR/PR res: [0x2bb30:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9427 expref: 72 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.861988:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c4f7be lrc: 4/0,0 mode: PR/PR res: [0x2bb30:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9427 expref: 72 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:0.0:1651529369.861988:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c2b2b59c going to sleep for 6 seconds 00010000:00010000:1.0:1651529369.861994:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.861994:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.861995:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c53146 lrc: 3/0,1 mode: PW/PW res: [0x2bb30:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.861995:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212602 00000100:00100000:0.0:1651529369.861997:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:39030:x1731745946586880:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529369.861998:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c53146 lrc: 4/0,1 mode: PW/PW res: [0x2bb30:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529369.862001:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:178997 count 1 00010000:00010000:1.0:1651529369.862003:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529369.862005:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c53177 lrc: 3/0,1 mode: --/PW res: [0x2bb35:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.862009:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005c2a9b2f/0x3234de053c4f76a lrc: 2/0,0 mode: PR/PR res: [0x2bb35:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d932b expref: 72 pid: 106695 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529369.862010:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+72:41279:x1731746396531840:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 28us (77us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529369.862012:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13326 00010000:00010000:0.0:1651529369.862012:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.862013:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.862013:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c53177 lrc: 4/0,1 mode: --/PW res: [0x2bb35:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.862019:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005c2a9b2f/0x3234de053c4f76a lrc: 3/0,0 mode: PR/PR res: [0x2bb35:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d932b expref: 71 pid: 106695 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.862022:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005c2a9b2f/0x3234de053c4f76a lrc: 4/0,0 mode: PR/PR res: [0x2bb35:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d932b expref: 71 pid: 106695 timeout: 20128 lvb_type: 1 00000100:00100000:0.0:1651529369.862026:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000059363096 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997070144:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529369.862041:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 000000003003c8b0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529369.862049:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ad6d0877 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997069760:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.862053:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5314d lrc: 3/0,1 mode: --/PW res: [0x2bb32:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.862061:0:156655:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c4f7be lrc: 0/0,0 mode: --/PR res: [0x2bb30:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9427 expref: 71 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:0.0:1651529369.862067:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000673bcbe2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997069696:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.862070:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c53146 lrc: 3/0,1 mode: PW/PW res: [0x2bb30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.862073:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c53146 lrc: 3/0,1 mode: PW/PW res: [0x2bb30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.862075:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ffb5d0a pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997069824:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.862076:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c53146 lrc: 3/0,1 mode: PW/PW res: [0x2bb30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.862079:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c53154 lrc: 3/0,1 mode: --/PW res: [0x2bb31:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.862079:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c53146 lrc: 3/0,1 mode: PW/PW res: [0x2bb30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.862081:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c53146 lrc: 2/0,0 mode: PW/PW res: [0x2bb30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.862127:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+46:39030:x1731745946586112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 643us (670us total) trans 12885080599 rc 0/0 00000100:00100000:0.0:1651529369.862131:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212595 00010000:00010000:0.0:1651529369.862152:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c53146 lrc: 2/0,0 mode: PW/PW res: [0x2bb30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.862156:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a032e9d0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529369.862157:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c53146 lrc: 2/0,0 mode: PW/PW res: [0x2bb30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.862163:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c53146 lrc: 3/0,0 mode: PW/PW res: [0x2bb30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.862167:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c53146 lrc: 1/0,0 mode: --/PW res: [0x2bb30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.862170:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c53146 lrc: 0/0,0 mode: --/PW res: [0x2bb30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.862274:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529369.862282:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529369.862293:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396531904 00010000:00010000:1.0:1651529369.862298:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c4f82e lrc: 4/0,0 mode: PR/PR res: [0x2bb32:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9618 expref: 71 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.862306:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13327 00000100:00100000:0.0:1651529369.862312:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529369.862321:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+71:41278:x1731746396531904:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529369.862322:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529369.862324:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.862325:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c4f82e lrc: 4/0,0 mode: PR/PR res: [0x2bb32:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9618 expref: 71 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.862329:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c4f82e lrc: 3/0,0 mode: PR/PR res: [0x2bb32:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9618 expref: 71 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:0.0:1651529369.862337:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396531968 00010000:00010000:1.0:1651529369.862340:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c4f82e lrc: 0/0,0 mode: --/PR res: [0x2bb32:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9618 expref: 72 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.862343:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c4f7cc lrc: 4/0,0 mode: PR/PR res: [0x2bb31:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d945f expref: 72 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.862344:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.862345:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.862346:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5314d lrc: 3/0,1 mode: PW/PW res: [0x2bb32:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.862348:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396532160 00010000:00010000:1.0:1651529369.862349:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5314d lrc: 4/0,1 mode: PW/PW res: [0x2bb32:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.862350:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c4f7da lrc: 5/0,0 mode: PR/PR res: [0x2bb33:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d947b expref: 72 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:0.0:1651529369.862355:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13328 00000100:00100000:0.0:1651529369.862357:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+72:41279:x1731746396531968:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529369.862361:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529369.862366:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529369.862368:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c4f7cc lrc: 4/0,0 mode: PR/PR res: [0x2bb31:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d945f expref: 72 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.862370:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+72:41278:x1731746396531904:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 62us (97us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529369.862372:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c4f7cc lrc: 3/0,0 mode: PR/PR res: [0x2bb31:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d945f expref: 72 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.862373:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13327 00000100:00100000:1.0:1651529369.862378:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13329 00010000:00010000:0.0:1651529369.862378:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c4f7cc lrc: 0/0,0 mode: --/PR res: [0x2bb31:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d945f expref: 71 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.862380:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+71:41278:x1731746396532160:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529369.862382:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529369.862382:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.862383:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.862384:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c4f7da lrc: 5/0,0 mode: PR/PR res: [0x2bb33:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d947b expref: 70 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.862384:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c53154 lrc: 3/0,1 mode: PW/PW res: [0x2bb31:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.862387:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c4f7da lrc: 4/0,0 mode: PR/PR res: [0x2bb33:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d947b expref: 70 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.862387:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c53154 lrc: 4/0,1 mode: PW/PW res: [0x2bb31:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.862392:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.862393:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.862394:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c5315b lrc: 3/0,1 mode: PW/PW res: [0x2bb33:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.862396:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529369.862403:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c5315b lrc: 4/0,1 mode: PW/PW res: [0x2bb33:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.862403:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+70:41279:x1731746396531968:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 46us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529369.862406:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13328 00010000:00010000:1.0:1651529369.862407:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529369.862412:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+69:41278:x1731746396532160:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 32us (90us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529369.862413:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5314d lrc: 3/0,1 mode: PW/PW res: [0x2bb32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.862415:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13329 00010000:00010000:0.0:1651529369.862416:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5314d lrc: 3/0,1 mode: PW/PW res: [0x2bb32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.862419:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5314d lrc: 3/0,1 mode: PW/PW res: [0x2bb32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.862422:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5314d lrc: 2/0,0 mode: PW/PW res: [0x2bb32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.862423:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c53154 lrc: 3/0,1 mode: PW/PW res: [0x2bb31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.862426:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c53154 lrc: 3/0,1 mode: PW/PW res: [0x2bb31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.862429:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c53154 lrc: 3/0,1 mode: PW/PW res: [0x2bb31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.862438:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c53154 lrc: 2/0,0 mode: PW/PW res: [0x2bb31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.862469:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+47:39030:x1731745946586240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 917us (996us total) trans 12885080600 rc 0/0 00000100:00100000:0.0:1651529369.862472:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212596 00000100:00100000:0.0:1651529369.862477:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946587136 00000100:00100000:1.0:1651529369.862479:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+47:39029:x1731745946586176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 877us (992us total) trans 12885080601 rc 0/0 00000100:00100000:0.0:1651529369.862482:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212603 00000100:00100000:1.0:1651529369.862484:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212597 00000100:00100000:0.0:1651529369.862484:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+47:39030:x1731745946587136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529369.862488:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179000 count 1 00010000:00010000:1.0:1651529369.862492:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5314d lrc: 2/0,0 mode: PW/PW res: [0x2bb32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.862492:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c5317e lrc: 3/0,1 mode: --/PW res: [0x2bb38:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.862495:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d37a9fd1 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529369.862496:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5314d lrc: 2/0,0 mode: PW/PW res: [0x2bb32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.862497:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c4f80b lrc: 2/0,0 mode: PR/PR res: [0x2bb38:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d959a expref: 68 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.862499:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5314d lrc: 3/0,0 mode: PW/PW res: [0x2bb32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.862500:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.862501:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.862502:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c5317e lrc: 4/0,1 mode: --/PW res: [0x2bb38:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.862503:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5314d lrc: 1/0,0 mode: --/PW res: [0x2bb32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.862506:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5314d lrc: 0/0,0 mode: --/PW res: [0x2bb32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.862508:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c4f80b lrc: 3/0,0 mode: PR/PR res: [0x2bb38:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d959a expref: 68 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.862511:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c53154 lrc: 2/0,0 mode: PW/PW res: [0x2bb31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.862511:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c4f80b lrc: 4/0,0 mode: PR/PR res: [0x2bb38:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d959a expref: 68 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.862514:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000090e99444 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529369.862514:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c53154 lrc: 2/0,0 mode: PW/PW res: [0x2bb31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.862516:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000edfe60d3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997070208:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.862517:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c53154 lrc: 3/0,0 mode: PW/PW res: [0x2bb31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.862520:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c53154 lrc: 1/0,0 mode: --/PW res: [0x2bb31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.862523:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c53154 lrc: 0/0,0 mode: --/PW res: [0x2bb31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.862524:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ff7bf023 going to sleep for 6 seconds 00010000:00010000:1.0:1651529369.862532:0:72397:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c4f7da lrc: 0/0,0 mode: --/PR res: [0x2bb33:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d947b expref: 68 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.862536:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bddc5ca7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997069888:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.862539:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c5315b lrc: 3/0,1 mode: PW/PW res: [0x2bb33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.862542:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c5315b lrc: 3/0,1 mode: PW/PW res: [0x2bb33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.862547:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c5315b lrc: 3/0,1 mode: PW/PW res: [0x2bb33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.862550:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c5315b lrc: 3/0,1 mode: PW/PW res: [0x2bb33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.862553:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c5315b lrc: 2/0,0 mode: PW/PW res: [0x2bb33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.862575:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c5315b lrc: 2/0,0 mode: PW/PW res: [0x2bb33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.862579:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e48e0bfd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529369.862580:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c5315b lrc: 2/0,0 mode: PW/PW res: [0x2bb33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.862583:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c5315b lrc: 3/0,0 mode: PW/PW res: [0x2bb33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.862588:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c5315b lrc: 1/0,0 mode: --/PW res: [0x2bb33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.862591:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c5315b lrc: 0/0,0 mode: --/PW res: [0x2bb33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.862613:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+47:39030:x1731745946586688:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 934us (953us total) trans 12885080602 rc 0/0 00000100:00100000:1.0:1651529369.862616:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212598 00000100:00100000:1.0:1651529369.862627:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000007fba516 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997069952:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.862631:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c53162 lrc: 3/0,1 mode: --/PW res: [0x2bb34:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.862646:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002c4168d4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997070016:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.862651:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c53169 lrc: 3/0,1 mode: --/PW res: [0x2bb36:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.862738:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529369.862755:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529369.862768:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529369.862771:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000053ee5af1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997070080:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529369.862776:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529369.862776:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c53170 lrc: 3/0,1 mode: --/PW res: [0x2bb37:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.862782:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529369.862783:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000059363096 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997070144:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529369.862789:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529369.862798:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396532224 00010000:00010000:1.0:1651529369.862804:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007126e775/0x3234de053c4f79b lrc: 4/0,0 mode: PR/PR res: [0x2bb34:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93a9 expref: 68 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.862809:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396532480 00010000:00010000:1.0:1651529369.862812:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b740c8d9/0x3234de053c4f72b lrc: 4/0,0 mode: PR/PR res: [0x2bb37:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d923d expref: 69 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.862812:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c53177 lrc: 3/0,1 mode: --/PW res: [0x2bb35:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.862821:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396532416 00000100:00100000:1.0:1651529369.862825:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396532672 00010000:00010000:0.0:1651529369.862826:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003fb54722/0x3234de053c4f78d lrc: 4/0,0 mode: PR/PR res: [0x2bb36:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d937f expref: 71 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.862828:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005c2a9b2f/0x3234de053c4f76a lrc: 4/0,0 mode: PR/PR res: [0x2bb35:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d932b expref: 71 pid: 106695 timeout: 20128 lvb_type: 1 00000100:00100000:0.0:1651529369.862833:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13330 00000100:00100000:1.0:1651529369.862834:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13331 00000100:00100000:0.0:1651529369.862834:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+71:41279:x1731746396532224:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529369.862836:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ede49ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+71:41279:x1731746396532480:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529369.862837:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.862839:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529369.862839:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007126e775/0x3234de053c4f79b lrc: 4/0,0 mode: PR/PR res: [0x2bb34:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93a9 expref: 71 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.862840:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b740c8d9/0x3234de053c4f72b lrc: 4/0,0 mode: PR/PR res: [0x2bb37:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d923d expref: 71 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.862842:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007126e775/0x3234de053c4f79b lrc: 3/0,0 mode: PR/PR res: [0x2bb34:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93a9 expref: 71 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.862844:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b740c8d9/0x3234de053c4f72b lrc: 3/0,0 mode: PR/PR res: [0x2bb37:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d923d expref: 71 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.862848:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007126e775/0x3234de053c4f79b lrc: 0/0,0 mode: --/PR res: [0x2bb34:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93a9 expref: 71 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.862850:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b740c8d9/0x3234de053c4f72b lrc: 0/0,0 mode: --/PR res: [0x2bb37:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d923d expref: 71 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.862851:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.862852:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.862853:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c53162 lrc: 3/0,1 mode: PW/PW res: [0x2bb34:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.862854:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.862854:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.862855:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c53170 lrc: 3/0,1 mode: PW/PW res: [0x2bb37:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.862856:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c53162 lrc: 4/0,1 mode: PW/PW res: [0x2bb34:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.862858:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c53170 lrc: 4/0,1 mode: PW/PW res: [0x2bb37:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.862872:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529369.862880:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ede49ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+69:41279:x1731746396532480:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 43us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529369.862883:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13331 00010000:00010000:0.0:1651529369.862883:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529369.862888:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13332 00000100:00100000:1.0:1651529369.862890:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+68:41278:x1731746396532416:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529369.862891:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+68:41279:x1731746396532224:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 56us (123us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529369.862892:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.862894:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003fb54722/0x3234de053c4f78d lrc: 4/0,0 mode: PR/PR res: [0x2bb36:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d937f expref: 68 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:0.0:1651529369.862894:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13330 00010000:00010000:1.0:1651529369.862898:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003fb54722/0x3234de053c4f78d lrc: 3/0,0 mode: PR/PR res: [0x2bb36:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d937f expref: 67 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.862903:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fb54722/0x3234de053c4f78d lrc: 0/0,0 mode: --/PR res: [0x2bb36:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d937f expref: 67 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:0.0:1651529369.862904:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13333 00000100:00100000:0.0:1651529369.862905:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+67:41278:x1731746396532672:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529369.862906:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.862907:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.862908:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c53169 lrc: 3/0,1 mode: PW/PW res: [0x2bb36:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.862908:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.862910:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c53169 lrc: 4/0,1 mode: PW/PW res: [0x2bb36:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.862910:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005c2a9b2f/0x3234de053c4f76a lrc: 4/0,0 mode: PR/PR res: [0x2bb35:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d932b expref: 66 pid: 106695 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.862913:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005c2a9b2f/0x3234de053c4f76a lrc: 3/0,0 mode: PR/PR res: [0x2bb35:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d932b expref: 66 pid: 106695 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.862919:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529369.862925:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+66:41278:x1731746396532416:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 35us (143us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529369.862926:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c2a9b2f/0x3234de053c4f76a lrc: 0/0,0 mode: --/PR res: [0x2bb35:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d932b expref: 66 pid: 106695 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.862928:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13332 00010000:00010000:0.0:1651529369.862929:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.862930:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.862931:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c53177 lrc: 3/0,1 mode: PW/PW res: [0x2bb35:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.862934:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c53177 lrc: 4/0,1 mode: PW/PW res: [0x2bb35:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.862937:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946587392 00010000:00010000:0.0:1651529369.862940:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529369.862945:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946587328 00000100:00100000:1.0:1651529369.862949:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212604 00000100:00100000:0.0:1651529369.862950:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+64:41278:x1731746396532672:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 44us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529369.862951:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+48:39030:x1731745946587392:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529369.862953:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13333 00002000:00080000:1.0:1651529369.862956:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179002 count 1 00010000:00010000:1.0:1651529369.862960:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c53185 lrc: 3/0,1 mode: --/PW res: [0x2bb3a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.862960:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c53170 lrc: 3/0,1 mode: PW/PW res: [0x2bb37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.862964:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c53170 lrc: 3/0,1 mode: PW/PW res: [0x2bb37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.862965:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c4f835 lrc: 2/0,0 mode: PR/PR res: [0x2bb3a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9626 expref: 63 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.862967:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c53170 lrc: 3/0,1 mode: PW/PW res: [0x2bb37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.862968:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.862968:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.862969:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c53185 lrc: 4/0,1 mode: --/PW res: [0x2bb3a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.862969:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c53170 lrc: 2/0,0 mode: PW/PW res: [0x2bb37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.862975:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c4f835 lrc: 3/0,0 mode: PR/PR res: [0x2bb3a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9626 expref: 63 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.862986:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c4f835 lrc: 4/0,0 mode: PR/PR res: [0x2bb3a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9626 expref: 63 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.862990:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005b3c5aba pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997070272:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529369.862999:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a6b79b05 going to sleep for 6 seconds 00010000:00010000:1.0:1651529369.863004:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c53170 lrc: 2/0,0 mode: PW/PW res: [0x2bb37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863007:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000721302df already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529369.863008:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c53170 lrc: 2/0,0 mode: PW/PW res: [0x2bb37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863011:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c53170 lrc: 3/0,0 mode: PW/PW res: [0x2bb37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863016:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c53170 lrc: 1/0,0 mode: --/PW res: [0x2bb37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863018:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c53170 lrc: 0/0,0 mode: --/PW res: [0x2bb37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.863027:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212605 00000100:00100000:1.0:1651529369.863028:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:39029:x1731745946587328:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529369.863028:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+49:39030:x1731745946587008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1099us (1192us total) trans 12885080603 rc 0/0 00000100:00100000:0.0:1651529369.863031:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212601 00002000:00080000:1.0:1651529369.863033:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179001 count 1 00010000:00010000:1.0:1651529369.863037:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c5318c lrc: 3/0,1 mode: --/PW res: [0x2bb39:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863038:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c53177 lrc: 3/0,1 mode: PW/PW res: [0x2bb35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863041:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000067d657cd/0x3234de053c4f7a2 lrc: 2/0,0 mode: PR/PR res: [0x2bb39:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93b7 expref: 63 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.863042:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c53177 lrc: 3/0,1 mode: PW/PW res: [0x2bb35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863044:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.863044:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.863045:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c5318c lrc: 4/0,1 mode: --/PW res: [0x2bb39:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863045:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c53177 lrc: 3/0,1 mode: PW/PW res: [0x2bb35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863047:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c53177 lrc: 2/0,0 mode: PW/PW res: [0x2bb35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863051:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000067d657cd/0x3234de053c4f7a2 lrc: 3/0,0 mode: PR/PR res: [0x2bb39:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93b7 expref: 63 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.863054:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000067d657cd/0x3234de053c4f7a2 lrc: 4/0,0 mode: PR/PR res: [0x2bb39:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93b7 expref: 63 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.863066:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000050bbb886 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997070336:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529369.863074:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 0000000089d75f07 going to sleep for 6 seconds 00010000:00010000:1.0:1651529369.863079:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c53177 lrc: 2/0,0 mode: PW/PW res: [0x2bb35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863082:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008393c644 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529369.863083:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c53177 lrc: 2/0,0 mode: PW/PW res: [0x2bb35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863086:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c53177 lrc: 3/0,0 mode: PW/PW res: [0x2bb35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863090:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c53177 lrc: 1/0,0 mode: --/PW res: [0x2bb35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.863090:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+49:39030:x1731745946586880:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1093us (1264us total) trans 12885080604 rc 0/0 00010000:00010000:1.0:1651529369.863092:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c53177 lrc: 0/0,0 mode: --/PW res: [0x2bb35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.863093:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212602 00010000:00010000:1.0:1651529369.863098:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c53162 lrc: 3/0,1 mode: PW/PW res: [0x2bb34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863100:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c53169 lrc: 3/0,1 mode: PW/PW res: [0x2bb36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863101:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c53162 lrc: 3/0,1 mode: PW/PW res: [0x2bb34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863103:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c53169 lrc: 3/0,1 mode: PW/PW res: [0x2bb36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863104:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c53162 lrc: 3/0,1 mode: PW/PW res: [0x2bb34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863106:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c53169 lrc: 3/0,1 mode: PW/PW res: [0x2bb36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863109:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c53162 lrc: 2/0,0 mode: PW/PW res: [0x2bb34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863109:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c53169 lrc: 2/0,0 mode: PW/PW res: [0x2bb36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.863141:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+50:39029:x1731745946586944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1271us (1325us total) trans 12885080605 rc 0/0 00000100:00100000:0.0:1651529369.863144:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212600 00000100:00100000:1.0:1651529369.863151:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f412854c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+49:39030:x1731745946586752:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1286us (1343us total) trans 12885080606 rc 0/0 00010000:00010000:0.0:1651529369.863151:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c53169 lrc: 2/0,0 mode: PW/PW res: [0x2bb36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.863154:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212599 00010000:00010000:0.0:1651529369.863154:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004926c34d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529369.863155:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c53169 lrc: 2/0,0 mode: PW/PW res: [0x2bb36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863158:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c53169 lrc: 3/0,0 mode: PW/PW res: [0x2bb36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863163:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c53169 lrc: 1/0,0 mode: --/PW res: [0x2bb36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863166:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c53169 lrc: 0/0,0 mode: --/PW res: [0x2bb36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863170:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c53162 lrc: 2/0,0 mode: PW/PW res: [0x2bb34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863172:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000feb9d3da already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529369.863173:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c53162 lrc: 2/0,0 mode: PW/PW res: [0x2bb34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863176:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c53162 lrc: 3/0,0 mode: PW/PW res: [0x2bb34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863179:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c53162 lrc: 1/0,0 mode: --/PW res: [0x2bb34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863182:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c53162 lrc: 0/0,0 mode: --/PW res: [0x2bb34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.863184:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529369.863188:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946587456 00000100:00100000:0.0:1651529369.863195:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212606 00000100:00100000:0.0:1651529369.863196:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+49:39030:x1731745946587456:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529369.863209:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179003 count 1 00010000:00010000:0.0:1651529369.863213:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c53193 lrc: 3/0,1 mode: --/PW res: [0x2bb3b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863218:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c4f812 lrc: 2/0,0 mode: PR/PR res: [0x2bb3b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95a8 expref: 63 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.863221:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.863221:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.863236:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c53193 lrc: 4/0,1 mode: --/PW res: [0x2bb3b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863244:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c4f812 lrc: 3/0,0 mode: PR/PR res: [0x2bb3b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95a8 expref: 63 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.863248:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c4f812 lrc: 4/0,0 mode: PR/PR res: [0x2bb3b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95a8 expref: 63 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.863251:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529369.863252:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e5997468 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997070400:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529369.863267:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c2b2b59c going to sleep for 6 seconds 00000100:00100000:0.0:1651529369.863275:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000edfe60d3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997070208:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.863278:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c5317e lrc: 3/0,1 mode: --/PW res: [0x2bb38:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.863285:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396532864 00010000:00010000:0.0:1651529369.863290:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c4f80b lrc: 4/0,0 mode: PR/PR res: [0x2bb38:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d959a expref: 64 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:0.0:1651529369.863302:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13334 00000100:00100000:0.0:1651529369.863304:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+64:41278:x1731746396532864:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529369.863306:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529369.863308:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c4f80b lrc: 4/0,0 mode: PR/PR res: [0x2bb38:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d959a expref: 64 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.863312:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c4f80b lrc: 3/0,0 mode: PR/PR res: [0x2bb38:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d959a expref: 64 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.863317:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c4f80b lrc: 0/0,0 mode: --/PR res: [0x2bb38:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d959a expref: 64 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.863320:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.863321:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.863321:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c5317e lrc: 3/0,1 mode: PW/PW res: [0x2bb38:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863324:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c5317e lrc: 4/0,1 mode: PW/PW res: [0x2bb38:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863331:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529369.863337:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+63:41278:x1731746396532864:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 33us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529369.863369:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13334 00010000:00010000:0.0:1651529369.863377:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c5317e lrc: 3/0,1 mode: PW/PW res: [0x2bb38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863393:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c5317e lrc: 3/0,1 mode: PW/PW res: [0x2bb38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863399:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c5317e lrc: 3/0,1 mode: PW/PW res: [0x2bb38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863402:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c5317e lrc: 2/0,0 mode: PW/PW res: [0x2bb38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863413:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c5317e lrc: 2/0,0 mode: PW/PW res: [0x2bb38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863417:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eca832be already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529369.863418:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c5317e lrc: 2/0,0 mode: PW/PW res: [0x2bb38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863422:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c5317e lrc: 3/0,0 mode: PW/PW res: [0x2bb38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863427:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c5317e lrc: 1/0,0 mode: --/PW res: [0x2bb38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863429:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c5317e lrc: 0/0,0 mode: --/PW res: [0x2bb38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.863450:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+50:39030:x1731745946587136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 965us (1167us total) trans 12885080607 rc 0/0 00000100:00100000:0.0:1651529369.863453:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212603 00000100:00100000:0.0:1651529369.863508:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529369.863528:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529369.863548:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529369.863558:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946587648 00000100:00100000:0.0:1651529369.863559:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529369.863568:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946587584 00000100:00100000:1.0:1651529369.863574:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946587712 00000100:00100000:1.0:1651529369.863579:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946587520 00000100:00100000:0.0:1651529369.863581:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212607 00000100:00100000:0.0:1651529369.863583:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+53:39030:x1731745946587648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529369.863587:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212608 00000100:00100000:1.0:1651529369.863588:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+53:39029:x1731745946587584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529369.863593:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179006 count 1 00002000:00080000:1.0:1651529369.863594:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179005 count 1 00010000:00010000:1.0:1651529369.863598:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c531a1 lrc: 3/0,1 mode: --/PW res: [0x2bb3d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863598:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c5319a lrc: 3/0,1 mode: --/PW res: [0x2bb3e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863603:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c4f7ef lrc: 2/0,0 mode: PR/PR res: [0x2bb3d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94f9 expref: 62 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.863603:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000062067bd8/0x3234de053c4f716 lrc: 2/0,0 mode: PR/PR res: [0x2bb3e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91f7 expref: 62 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.863606:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.863606:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.863607:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.863607:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.863607:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c5319a lrc: 4/0,1 mode: --/PW res: [0x2bb3e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863608:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c531a1 lrc: 4/0,1 mode: --/PW res: [0x2bb3d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863615:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c4f7ef lrc: 3/0,0 mode: PR/PR res: [0x2bb3d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94f9 expref: 62 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.863617:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000062067bd8/0x3234de053c4f716 lrc: 3/0,0 mode: PR/PR res: [0x2bb3e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91f7 expref: 62 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651529369.863618:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c4f7ef lrc: 4/0,0 mode: PR/PR res: [0x2bb3d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94f9 expref: 62 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.863621:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000062067bd8/0x3234de053c4f716 lrc: 4/0,0 mode: PR/PR res: [0x2bb3e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91f7 expref: 62 pid: 151609 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.863622:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007ac35c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997070464:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529369.863625:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006731397d pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997070528:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529369.863634:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f79d8146 going to sleep for 6 seconds 00000100:00100000:0.0:1651529369.863634:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b81e4a0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529369.863641:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212609 00000100:00100000:0.0:1651529369.863642:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+53:39030:x1731745946587712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529369.863647:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179007 count 1 00010000:00010000:0.0:1651529369.863650:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c531a8 lrc: 3/0,1 mode: --/PW res: [0x2bb3f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863674:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c4f83c lrc: 2/0,0 mode: PR/PR res: [0x2bb3f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9634 expref: 62 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.863678:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.863678:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.863679:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c531a8 lrc: 4/0,1 mode: --/PW res: [0x2bb3f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863686:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c4f83c lrc: 3/0,0 mode: PR/PR res: [0x2bb3f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9634 expref: 62 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.863706:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c4f83c lrc: 4/0,0 mode: PR/PR res: [0x2bb3f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9634 expref: 62 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:0.0:1651529369.863710:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002a1f5cf2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997070592:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529369.863719:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ff7bf023 going to sleep for 6 seconds 00000100:00100000:0.0:1651529369.863725:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212610 00000100:00100000:0.0:1651529369.863727:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+53:39029:x1731745946587520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529369.863732:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179004 count 1 00010000:00010000:0.0:1651529369.863735:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c531af lrc: 3/0,1 mode: --/PW res: [0x2bb3c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863739:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d2ef532c/0x3234de053c4f7a9 lrc: 2/0,0 mode: PR/PR res: [0x2bb3c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93ef expref: 62 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.863742:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.863743:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.863744:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c531af lrc: 4/0,1 mode: --/PW res: [0x2bb3c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863759:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d2ef532c/0x3234de053c4f7a9 lrc: 3/0,0 mode: PR/PR res: [0x2bb3c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93ef expref: 62 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.863762:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d2ef532c/0x3234de053c4f7a9 lrc: 4/0,0 mode: PR/PR res: [0x2bb3c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93ef expref: 62 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:0.0:1651529369.863766:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085af61db pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997070656:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529369.863768:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529369.863781:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a3b00cf3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529369.863786:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946587904 00000100:00100000:0.0:1651529369.863794:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212611 00000100:00100000:0.0:1651529369.863795:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+54:39030:x1731745946587904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529369.863800:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179008 count 1 00010000:00010000:0.0:1651529369.863804:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c531b6 lrc: 3/0,1 mode: --/PW res: [0x2bb40:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863808:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008ead1500/0x3234de053c4f75c lrc: 2/0,0 mode: PR/PR res: [0x2bb40:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9308 expref: 62 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529369.863811:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.863812:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.863812:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c531b6 lrc: 4/0,1 mode: --/PW res: [0x2bb40:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.863820:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529369.863829:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529369.863837:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529369.863844:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008ead1500/0x3234de053c4f75c lrc: 3/0,0 mode: PR/PR res: [0x2bb40:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9308 expref: 62 pid: 80279 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1651529369.863845:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396533120 00010000:00010000:0.0:1651529369.863848:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008ead1500/0x3234de053c4f75c lrc: 4/0,0 mode: PR/PR res: [0x2bb40:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9308 expref: 63 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.863850:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000067d657cd/0x3234de053c4f7a2 lrc: 5/0,0 mode: PR/PR res: [0x2bb39:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93b7 expref: 63 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:0.0:1651529369.863852:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b4acf60d pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997070720:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529369.863857:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396533056 00010000:00010000:1.0:1651529369.863860:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c4f835 lrc: 5/0,0 mode: PR/PR res: [0x2bb3a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9626 expref: 64 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.863864:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396533184 00010000:00010000:1.0:1651529369.863872:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c4f812 lrc: 5/0,0 mode: PR/PR res: [0x2bb3b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95a8 expref: 65 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.863878:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13335 00000100:00100000:0.0:1651529369.863878:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 000000003678d25f going to sleep for 6 seconds 00000100:00100000:1.0:1651529369.863880:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+65:41279:x1731746396533120:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529369.863883:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.863885:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000067d657cd/0x3234de053c4f7a2 lrc: 5/0,0 mode: PR/PR res: [0x2bb39:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93b7 expref: 65 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:0.0:1651529369.863887:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13336 00010000:00010000:1.0:1651529369.863888:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000067d657cd/0x3234de053c4f7a2 lrc: 4/0,0 mode: PR/PR res: [0x2bb39:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93b7 expref: 65 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:0.0:1651529369.863889:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+65:41279:x1731746396533056:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529369.863892:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.863894:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.863894:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c4f835 lrc: 5/0,0 mode: PR/PR res: [0x2bb3a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9626 expref: 65 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.863895:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.863895:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c5318c lrc: 3/0,1 mode: PW/PW res: [0x2bb39:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863899:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c5318c lrc: 4/0,1 mode: PW/PW res: [0x2bb39:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863900:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c4f835 lrc: 4/0,0 mode: PR/PR res: [0x2bb3a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9626 expref: 65 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.863906:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529369.863906:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.863907:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.863907:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c53185 lrc: 3/0,1 mode: PW/PW res: [0x2bb3a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863910:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c53185 lrc: 4/0,1 mode: PW/PW res: [0x2bb3a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.863913:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+65:41279:x1731746396533120:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 32us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529369.863915:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13335 00010000:00010000:0.0:1651529369.863915:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529369.863919:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13337 00000100:00100000:1.0:1651529369.863921:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+64:41279:x1731746396533184:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529369.863922:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+64:41279:x1731746396533056:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 32us (92us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529369.863924:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529369.863924:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13336 00010000:00010000:1.0:1651529369.863925:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c4f812 lrc: 5/0,0 mode: PR/PR res: [0x2bb3b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95a8 expref: 64 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.863929:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c4f812 lrc: 4/0,0 mode: PR/PR res: [0x2bb3b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95a8 expref: 63 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.863933:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.863933:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.863934:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c53193 lrc: 3/0,1 mode: PW/PW res: [0x2bb3b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863936:0:80276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c4f812 lrc: 0/0,0 mode: --/PR res: [0x2bb3b:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d95a8 expref: 63 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.863937:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c53193 lrc: 4/0,1 mode: PW/PW res: [0x2bb3b:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.863939:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e5997468 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997070400:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.863941:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529369.863943:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c53193 lrc: 3/0,1 mode: PW/PW res: [0x2bb3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.863945:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+62:41279:x1731746396533184:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 23us (108us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529369.863946:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c53193 lrc: 3/0,1 mode: PW/PW res: [0x2bb3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.863947:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13337 00010000:00010000:0.0:1651529369.863949:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c53193 lrc: 3/0,1 mode: PW/PW res: [0x2bb3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863952:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c53193 lrc: 3/0,1 mode: PW/PW res: [0x2bb3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.863955:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c53193 lrc: 2/0,0 mode: PW/PW res: [0x2bb3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863959:0:72396:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067d657cd/0x3234de053c4f7a2 lrc: 0/0,0 mode: --/PR res: [0x2bb39:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93b7 expref: 61 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.863971:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000050bbb886 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997070336:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.863975:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c5318c lrc: 3/0,1 mode: PW/PW res: [0x2bb39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863979:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c5318c lrc: 3/0,1 mode: PW/PW res: [0x2bb39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863981:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c5318c lrc: 3/0,1 mode: PW/PW res: [0x2bb39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863984:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c5318c lrc: 3/0,1 mode: PW/PW res: [0x2bb39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.863987:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c5318c lrc: 2/0,0 mode: PW/PW res: [0x2bb39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.864028:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+56:39030:x1731745946587456:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 831us (844us total) trans 12885080608 rc 0/0 00000100:00100000:0.0:1651529369.864031:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212606 00000100:00100000:1.0:1651529369.864032:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+56:39029:x1731745946587328:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1003us (1277us total) trans 12885080609 rc 0/0 00000100:00100000:1.0:1651529369.864036:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212605 00010000:00010000:0.0:1651529369.864039:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c53193 lrc: 2/0,0 mode: PW/PW res: [0x2bb3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.864042:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e270377c already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529369.864043:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c5318c lrc: 2/0,0 mode: PW/PW res: [0x2bb39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.864043:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c53193 lrc: 2/0,0 mode: PW/PW res: [0x2bb3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864046:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e943794 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529369.864046:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c53193 lrc: 3/0,0 mode: PW/PW res: [0x2bb3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864047:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c5318c lrc: 2/0,0 mode: PW/PW res: [0x2bb39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.864050:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c53193 lrc: 1/0,0 mode: --/PW res: [0x2bb3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864052:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c5318c lrc: 3/0,0 mode: PW/PW res: [0x2bb39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.864053:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c53193 lrc: 0/0,0 mode: --/PW res: [0x2bb3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864057:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c5318c lrc: 1/0,0 mode: --/PW res: [0x2bb39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864060:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c5318c lrc: 0/0,0 mode: --/PW res: [0x2bb39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864069:0:72397:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c4f835 lrc: 0/0,0 mode: --/PR res: [0x2bb3a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9626 expref: 60 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.864073:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005b3c5aba pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997070272:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.864083:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c53185 lrc: 3/0,1 mode: PW/PW res: [0x2bb3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864087:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c53185 lrc: 3/0,1 mode: PW/PW res: [0x2bb3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864090:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c53185 lrc: 3/0,1 mode: PW/PW res: [0x2bb3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864093:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c53185 lrc: 3/0,1 mode: PW/PW res: [0x2bb3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864101:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c53185 lrc: 2/0,0 mode: PW/PW res: [0x2bb3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.864125:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529369.864149:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529369.864159:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+55:39030:x1731745946587392:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1195us (1409us total) trans 12885080610 rc 0/0 00000100:00100000:1.0:1651529369.864162:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212604 00000100:00100000:0.0:1651529369.864162:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529369.864173:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c53185 lrc: 2/0,0 mode: PW/PW res: [0x2bb3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864177:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000029958df2 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529369.864178:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c53185 lrc: 2/0,0 mode: PW/PW res: [0x2bb3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864186:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c53185 lrc: 3/0,0 mode: PW/PW res: [0x2bb3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864191:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c53185 lrc: 1/0,0 mode: --/PW res: [0x2bb3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864194:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c53185 lrc: 0/0,0 mode: --/PW res: [0x2bb3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.864200:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529369.864207:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396533312 00000100:00100000:0.0:1651529369.864210:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002a1f5cf2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997070592:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.864212:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000062067bd8/0x3234de053c4f716 lrc: 5/0,0 mode: PR/PR res: [0x2bb3e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91f7 expref: 60 pid: 151609 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.864217:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396533248 00010000:00010000:1.0:1651529369.864219:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c4f7ef lrc: 5/0,0 mode: PR/PR res: [0x2bb3d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94f9 expref: 61 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.864237:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396533376 00010000:00010000:0.0:1651529369.864243:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c531a8 lrc: 3/0,1 mode: --/PW res: [0x2bb3f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864245:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c4f83c lrc: 4/0,0 mode: PR/PR res: [0x2bb3f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9634 expref: 62 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.864250:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396533440 00010000:00010000:1.0:1651529369.864253:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d2ef532c/0x3234de053c4f7a9 lrc: 5/0,0 mode: PR/PR res: [0x2bb3c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93ef expref: 63 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:0.0:1651529369.864253:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085af61db pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997070656:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.864256:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c531af lrc: 3/0,1 mode: --/PW res: [0x2bb3c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.864257:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13338 00000100:00100000:1.0:1651529369.864259:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050ef6a3e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+63:41278:x1731746396533312:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529369.864262:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529369.864262:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006731397d pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997070528:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529369.864263:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000062067bd8/0x3234de053c4f716 lrc: 4/0,0 mode: PR/PR res: [0x2bb3e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91f7 expref: 63 pid: 151609 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.864264:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c5319a lrc: 3/0,1 mode: --/PW res: [0x2bb3e:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864267:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000062067bd8/0x3234de053c4f716 lrc: 3/0,0 mode: PR/PR res: [0x2bb3e:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91f7 expref: 63 pid: 151609 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.864273:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062067bd8/0x3234de053c4f716 lrc: 0/0,0 mode: --/PR res: [0x2bb3e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d91f7 expref: 63 pid: 151609 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.864276:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.864277:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529369.864277:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13339 00010000:00010000:1.0:1651529369.864278:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c5319a lrc: 3/0,1 mode: PW/PW res: [0x2bb3e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.864279:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+62:41278:x1731746396533248:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529369.864281:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c5319a lrc: 4/0,1 mode: PW/PW res: [0x2bb3e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.864282:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529369.864284:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c4f7ef lrc: 5/0,0 mode: PR/PR res: [0x2bb3d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94f9 expref: 62 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.864288:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c4f7ef lrc: 4/0,0 mode: PR/PR res: [0x2bb3d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94f9 expref: 62 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.864291:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529369.864301:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050ef6a3e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+62:41278:x1731746396533312:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529369.864304:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13338 00010000:00010000:0.0:1651529369.864304:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.864305:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.864305:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c531a1 lrc: 3/0,1 mode: PW/PW res: [0x2bb3d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.864309:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c531a1 lrc: 4/0,1 mode: PW/PW res: [0x2bb3d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.864313:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13340 00010000:00010000:0.0:1651529369.864314:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529369.864315:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+61:41278:x1731746396533376:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529369.864317:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.864319:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c4f83c lrc: 4/0,0 mode: PR/PR res: [0x2bb3f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9634 expref: 61 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:0.0:1651529369.864321:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+61:41278:x1731746396533248:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (172us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529369.864323:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c4f83c lrc: 3/0,0 mode: PR/PR res: [0x2bb3f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9634 expref: 61 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:0.0:1651529369.864324:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13339 00010000:00010000:1.0:1651529369.864328:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c4f83c lrc: 0/0,0 mode: --/PR res: [0x2bb3f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9634 expref: 60 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:0.0:1651529369.864329:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13341 00010000:00010000:1.0:1651529369.864331:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529369.864331:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+59:41279:x1731746396533440:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529369.864332:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529369.864332:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c531a8 lrc: 3/0,1 mode: PW/PW res: [0x2bb3f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.864333:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529369.864335:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c531a8 lrc: 4/0,1 mode: PW/PW res: [0x2bb3f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.864335:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d2ef532c/0x3234de053c4f7a9 lrc: 4/0,0 mode: PR/PR res: [0x2bb3c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93ef expref: 59 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.864339:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d2ef532c/0x3234de053c4f7a9 lrc: 3/0,0 mode: PR/PR res: [0x2bb3c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93ef expref: 59 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:1.0:1651529369.864343:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529369.864349:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+59:41278:x1731746396533376:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 33us (187us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529369.864350:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2ef532c/0x3234de053c4f7a9 lrc: 0/0,0 mode: --/PR res: [0x2bb3c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d93ef expref: 59 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:1.0:1651529369.864352:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13340 00010000:00010000:0.0:1651529369.864354:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.864354:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.864355:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c531af lrc: 3/0,1 mode: PW/PW res: [0x2bb3c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.864360:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c531af lrc: 4/0,1 mode: PW/PW res: [0x2bb3c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864366:0:80280:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c4f7ef lrc: 0/0,0 mode: --/PR res: [0x2bb3d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d94f9 expref: 57 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.864366:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529369.864370:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007ac35c6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997070464:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529369.864371:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+56:41279:x1731746396533440:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 40us (172us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529369.864373:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c531a1 lrc: 3/0,1 mode: PW/PW res: [0x2bb3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.864374:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13341 00010000:00010000:1.0:1651529369.864377:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c531a1 lrc: 3/0,1 mode: PW/PW res: [0x2bb3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864379:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c531a1 lrc: 3/0,1 mode: PW/PW res: [0x2bb3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.864380:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c531a8 lrc: 3/0,1 mode: PW/PW res: [0x2bb3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864382:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c531a1 lrc: 3/0,1 mode: PW/PW res: [0x2bb3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.864384:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c531a8 lrc: 3/0,1 mode: PW/PW res: [0x2bb3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864385:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c531a1 lrc: 2/0,0 mode: PW/PW res: [0x2bb3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.864387:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c531a8 lrc: 3/0,1 mode: PW/PW res: [0x2bb3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.864389:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c531a8 lrc: 2/0,0 mode: PW/PW res: [0x2bb3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.864435:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+56:39029:x1731745946587584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 846us (919us total) trans 12885080611 rc 0/0 00000100:00100000:1.0:1651529369.864438:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212608 00000100:00100000:0.0:1651529369.864440:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+56:39030:x1731745946587712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 797us (891us total) trans 12885080612 rc 0/0 00000100:00100000:0.0:1651529369.864443:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212609 00010000:00010000:1.0:1651529369.864445:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c531a1 lrc: 2/0,0 mode: PW/PW res: [0x2bb3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864451:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007d55fe01 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529369.864452:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c531a1 lrc: 2/0,0 mode: PW/PW res: [0x2bb3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864455:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c531a1 lrc: 3/0,0 mode: PW/PW res: [0x2bb3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864459:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c531a1 lrc: 1/0,0 mode: --/PW res: [0x2bb3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864462:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c531a1 lrc: 0/0,0 mode: --/PW res: [0x2bb3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864466:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c531a8 lrc: 2/0,0 mode: PW/PW res: [0x2bb3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864468:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000092ad010c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529369.864468:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c531af lrc: 3/0,1 mode: PW/PW res: [0x2bb3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864469:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c531a8 lrc: 2/0,0 mode: PW/PW res: [0x2bb3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.864471:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c531af lrc: 3/0,1 mode: PW/PW res: [0x2bb3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864472:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c531a8 lrc: 3/0,0 mode: PW/PW res: [0x2bb3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864475:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c531a8 lrc: 1/0,0 mode: --/PW res: [0x2bb3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.864475:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c531af lrc: 3/0,1 mode: PW/PW res: [0x2bb3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864478:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c531a8 lrc: 0/0,0 mode: --/PW res: [0x2bb3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.864478:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c531af lrc: 2/0,0 mode: PW/PW res: [0x2bb3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864482:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c531af lrc: 3/0,0 mode: PW/PW res: [0x2bb3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864492:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008119f3a8 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529369.864493:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c531af lrc: 2/0,0 mode: PW/PW res: [0x2bb3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864496:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c531af lrc: 3/0,0 mode: PW/PW res: [0x2bb3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864499:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c531af lrc: 1/0,0 mode: --/PW res: [0x2bb3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864502:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c531af lrc: 0/0,0 mode: --/PW res: [0x2bb3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.864519:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+55:39029:x1731745946587520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 791us (960us total) trans 12885080613 rc 0/0 00000100:00100000:0.0:1651529369.864529:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212610 00010000:00010000:0.0:1651529369.864535:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c5319a lrc: 3/0,1 mode: PW/PW res: [0x2bb3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.864538:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c5319a lrc: 3/0,1 mode: PW/PW res: [0x2bb3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.864541:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c5319a lrc: 3/0,1 mode: PW/PW res: [0x2bb3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.864544:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c5319a lrc: 2/0,0 mode: PW/PW res: [0x2bb3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.864584:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+55:39030:x1731745946587648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1000us (1075us total) trans 12885080614 rc 0/0 00000100:00100000:0.0:1651529369.864586:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212607 00010000:00010000:0.0:1651529369.864609:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c5319a lrc: 2/0,0 mode: PW/PW res: [0x2bb3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.864616:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6999e11 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529369.864617:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c5319a lrc: 2/0,0 mode: PW/PW res: [0x2bb3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.864620:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c5319a lrc: 3/0,0 mode: PW/PW res: [0x2bb3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.864625:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c5319a lrc: 1/0,0 mode: --/PW res: [0x2bb3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.864627:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c5319a lrc: 0/0,0 mode: --/PW res: [0x2bb3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.864639:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b4acf60d pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997070720:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529369.864642:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c531b6 lrc: 3/0,1 mode: --/PW res: [0x2bb40:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529369.864720:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529369.864736:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396533952 00010000:00010000:0.0:1651529369.864745:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008ead1500/0x3234de053c4f75c lrc: 4/0,0 mode: PR/PR res: [0x2bb40:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9308 expref: 56 pid: 80279 timeout: 20128 lvb_type: 1 00000100:00100000:0.0:1651529369.864774:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13342 00000100:00100000:0.0:1651529369.864777:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+56:41278:x1731746396533952:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529369.864782:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529369.864785:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008ead1500/0x3234de053c4f75c lrc: 4/0,0 mode: PR/PR res: [0x2bb40:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9308 expref: 56 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.864791:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008ead1500/0x3234de053c4f75c lrc: 3/0,0 mode: PR/PR res: [0x2bb40:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9308 expref: 56 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.864801:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ead1500/0x3234de053c4f75c lrc: 0/0,0 mode: --/PR res: [0x2bb40:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9308 expref: 56 pid: 80279 timeout: 20128 lvb_type: 1 00010000:00010000:0.0:1651529369.864807:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.864808:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529369.864810:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c531b6 lrc: 3/0,1 mode: PW/PW res: [0x2bb40:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.864815:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c531b6 lrc: 4/0,1 mode: PW/PW res: [0x2bb40:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.864827:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529369.864843:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+55:41278:x1731746396533952:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 64us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529369.864846:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13342 00010000:00010000:0.0:1651529369.864854:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c531b6 lrc: 3/0,1 mode: PW/PW res: [0x2bb40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.864857:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c531b6 lrc: 3/0,1 mode: PW/PW res: [0x2bb40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.864860:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c531b6 lrc: 3/0,1 mode: PW/PW res: [0x2bb40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529369.864866:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c531b6 lrc: 2/0,0 mode: PW/PW res: [0x2bb40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864877:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c531b6 lrc: 2/0,0 mode: PW/PW res: [0x2bb40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864881:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ac14729e already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529369.864882:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c531b6 lrc: 2/0,0 mode: PW/PW res: [0x2bb40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864885:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c531b6 lrc: 3/0,0 mode: PW/PW res: [0x2bb40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864892:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c531b6 lrc: 1/0,0 mode: --/PW res: [0x2bb40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529369.864895:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c531b6 lrc: 0/0,0 mode: --/PW res: [0x2bb40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529369.864916:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+55:39030:x1731745946587904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1119us (1147us total) trans 12885080615 rc 0/0 00000100:00100000:0.0:1651529369.864922:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212611 00000001:00080000:0.0:1651529369.955610:0:72382:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 12885080568 is committed 00000100:00100000:1.0:1651529372.384140:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529372.384166:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946588608 00000100:00100000:0.0:1651529372.384178:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 87 00000100:00100000:0.0:1651529372.384180:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+52:39029:x1731745946588608:12345-10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00100000:0.0:1651529372.384199:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+52:39029:x1731745946588608:12345-10.240.43.61@tcp:400:kworker/u4:1.0 Request processed in 18us (60us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529372.384202:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 87 00000100:00100000:1.0:1651529373.920127:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529373.920138:0:72398:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946588672 00000100:00100000:1.0:1651529373.920147:0:72398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 574 00000100:00100000:1.0:1651529373.920150:0:72398:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+52:39030:x1731745946588672:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651529373.920159:0:72398:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8578752 pending 0 free 81328046080 avail 77157335040 00000100:00100000:1.0:1651529373.920176:0:72398:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a223a622 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+52:39030:x1731745946588672:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 26us (50us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529373.920180:0:72398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 574 00000001:00080000:0.0:1651529375.549903:0:72382:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 12885080615 is committed 00000100:00100000:1.0:1651529379.040129:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529379.040139:0:87247:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946588800 00000100:00100000:1.0:1651529379.040149:0:87247:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 575 00000100:00100000:1.0:1651529379.040151:0:87247:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946588800:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651529379.040159:0:87247:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8578752 pending 0 free 81328046080 avail 77157335040 00000100:00100000:1.0:1651529379.040178:0:87247:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006647e4ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946588800:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 26us (50us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529379.040181:0:87247:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 575 00000100:00100000:1.0:1651529384.160117:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529384.160131:0:72398:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946588928 00000100:00100000:1.0:1651529384.160140:0:72398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 576 00000100:00100000:1.0:1651529384.160142:0:72398:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946588928:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651529384.160150:0:72398:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8578752 pending 0 free 81328046080 avail 77157335040 00000100:00100000:1.0:1651529384.160168:0:72398:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f39ca9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946588928:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 25us (52us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529384.160171:0:72398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 576 00000400:00000080:1.0:1651529386.089031:0:157576:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651529386.089033:0:157576:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 125: don't return EPROTO when a dir has a non-default striping and ACLs ========================================================== 22:09:45 (1651529385) 00000100:00100000:1.0:1651529386.248917:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529386.248947:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946589184 00000100:00100000:0.0:1651529386.248969:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212612 00000100:00100000:0.0:1651529386.248971:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946589184:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529386.248988:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179009 count 1 00010000:00010000:0.0:1651529386.249001:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c531bd lrc: 3/0,1 mode: --/PW res: [0x2bb41:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529386.249011:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52ff6 lrc: 2/0,0 mode: PR/PR res: [0x2bb41:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9fcd expref: 54 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529386.249016:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529386.249017:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529386.249018:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c531bd lrc: 4/0,1 mode: --/PW res: [0x2bb41:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529386.249032:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52ff6 lrc: 3/0,0 mode: PR/PR res: [0x2bb41:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9fcd expref: 54 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529386.249037:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52ff6 lrc: 4/0,0 mode: PR/PR res: [0x2bb41:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9fcd expref: 54 pid: 80276 timeout: 20144 lvb_type: 1 00000100:00100000:0.0:1651529386.249044:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006aa45e66 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997070784:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529386.249073:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b81e4a0 going to sleep for 6 seconds 00000100:00100000:1.0:1651529386.249384:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529386.249398:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006aa45e66 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997070784:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529386.249405:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c531bd lrc: 3/0,1 mode: --/PW res: [0x2bb41:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529386.249415:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396554944 00010000:00010000:0.0:1651529386.249422:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52ff6 lrc: 4/0,0 mode: PR/PR res: [0x2bb41:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9fcd expref: 55 pid: 80276 timeout: 20144 lvb_type: 1 00000100:00100000:0.0:1651529386.249437:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13343 00000100:00100000:0.0:1651529386.249439:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+55:41278:x1731746396554944:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529386.249444:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529386.249445:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52ff6 lrc: 4/0,0 mode: PR/PR res: [0x2bb41:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9fcd expref: 55 pid: 80276 timeout: 20144 lvb_type: 1 00010000:00010000:0.0:1651529386.249450:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52ff6 lrc: 3/0,0 mode: PR/PR res: [0x2bb41:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9fcd expref: 55 pid: 80276 timeout: 20144 lvb_type: 1 00010000:00010000:0.0:1651529386.249460:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c52ff6 lrc: 0/0,0 mode: --/PR res: [0x2bb41:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9fcd expref: 55 pid: 80276 timeout: 20144 lvb_type: 1 00010000:00010000:0.0:1651529386.249464:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529386.249465:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529386.249466:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c531bd lrc: 3/0,1 mode: PW/PW res: [0x2bb41:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529386.249470:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c531bd lrc: 4/0,1 mode: PW/PW res: [0x2bb41:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529386.249478:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529386.249489:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+54:41278:x1731746396554944:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 49us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529386.249492:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13343 00010000:00010000:0.0:1651529386.249521:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c531bd lrc: 3/0,1 mode: PW/PW res: [0x2bb41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529386.249525:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c531bd lrc: 3/0,1 mode: PW/PW res: [0x2bb41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529386.249529:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c531bd lrc: 3/0,1 mode: PW/PW res: [0x2bb41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529386.249532:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c531bd lrc: 2/0,0 mode: PW/PW res: [0x2bb41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529386.249636:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946589184:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 664us (722us total) trans 12885080616 rc 0/0 00000100:00100000:0.0:1651529386.249639:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212612 00010000:00010000:0.0:1651529386.249648:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c531bd lrc: 2/0,0 mode: PW/PW res: [0x2bb41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529386.249652:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a032e9d0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529386.249654:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c531bd lrc: 2/0,0 mode: PW/PW res: [0x2bb41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529386.249657:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c531bd lrc: 3/0,0 mode: PW/PW res: [0x2bb41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529386.249662:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c531bd lrc: 1/0,0 mode: --/PW res: [0x2bb41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529386.249665:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c531bd lrc: 0/0,0 mode: --/PW res: [0x2bb41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000400:00000080:1.0:1651529388.690551:0:157794:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651529388.690554:0:157794:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 126: check that the fsgid provided by the client is taken into account ========================================================== 22:09:47 (1651529387) 00000100:00100000:0.0:1651529388.714971:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529388.714989:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396555648 00000100:00100000:0.0:1651529388.715007:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212613 00000100:00100000:0.0:1651529388.715010:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+54:41278:x1731746396555648:12345-10.240.43.64@tcp:2:touch.0 00000100:00100000:0.0:1651529388.715135:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+55:41278:x1731746396555648:12345-10.240.43.64@tcp:2:touch.0 Request processed in 124us (166us total) trans 12885080617 rc 0/0 00000100:00100000:0.0:1651529388.715141:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212613 00000100:00100000:0.0:1651529388.719987:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529388.719996:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396555904 00000100:00100000:0.0:1651529388.720004:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212614 00000100:00100000:0.0:1651529388.720006:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+55:41278:x1731746396555904:12345-10.240.43.64@tcp:101:ls.0 00010000:00010000:0.0:1651529388.720011:0:80278:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529388.720019:0:80278:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c531c4 lrc: 2/0,0 mode: --/PR res: [0x2bb73:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da4d5 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529388.720027:0:80278:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb73:0x0] initial LVB size: 0, mtime: 0x627056ac, atime: 0x627056ac, ctime: 0x627056ac, blocks: 0x0 00010000:00010000:0.0:1651529388.720035:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529388.720036:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529388.720040:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c531c4 lrc: 3/0,0 mode: PR/PR res: [0x2bb73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da4d5 expref: 56 pid: 80278 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529388.720048:0:80278:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c531c4 lrc: 3/0,0 mode: PR/PR res: [0x2bb73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da4d5 expref: 56 pid: 80278 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529388.720054:0:80278:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a032e9d0, rc 0) 00000100:00100000:0.0:1651529388.720073:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+56:41278:x1731746396555904:12345-10.240.43.64@tcp:101:ls.0 Request processed in 66us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529388.720076:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212614 00000100:00100000:0.0:1651529389.280161:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529389.280190:0:87247:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946589248 00000100:00100000:1.0:1651529389.280210:0:87247:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 577 00000100:00100000:1.0:1651529389.280212:0:87247:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946589248:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651529389.280243:0:87247:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8578752 pending 0 free 81328046080 avail 77157335040 00000100:00100000:1.0:1651529389.280269:0:87247:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057329b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946589248:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 56us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529389.280273:0:87247:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 577 00000100:00100000:1.0:1651529390.717295:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029d739c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:39099:1731745997070912:10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00100000:1.0:1651529390.717337:0:39099:0:(ptlrpcd.c:414:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1651529390.717340:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004089c807 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0b51168f-0bcb-46b1-964e-9e88a09501f8:39099:1731745997070848:10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00100000:1.0:1651529390.717735:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029d739c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:39099:1731745997070912:10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00100000:1.0:1651529390.717809:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004089c807 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0b51168f-0bcb-46b1-964e-9e88a09501f8:39099:1731745997070848:10.240.43.61@tcp:400:kworker/u4:1.0 00000400:00000080:1.0:1651529391.159635:0:158012:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651529391.159637:0:158012:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 127a: verify the client stats are sane ==== 22:09:50 (1651529390) 00000100:00100000:1.0:1651529391.221246:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529391.221268:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396557504 00000100:00100000:0.0:1651529391.221304:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 148 00000100:00100000:0.0:1651529391.221306:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003cd5e5a1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+56:342879:x1731746396557504:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529391.221315:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 50 locks, starting at 0 00010000:00010000:0.0:1651529391.221336:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c531c4 lrc: 0/0,0 mode: --/PR res: [0x2bb73:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da4d5 expref: 56 pid: 80278 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529391.221348:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fc4c513/0x3234de053c5305f lrc: 0/0,0 mode: --/PR res: [0x2bb5e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da1c5 expref: 55 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529391.221355:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000576f1f12/0x3234de053c53058 lrc: 0/0,0 mode: --/PR res: [0x2bb54:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da171 expref: 54 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529391.221362:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e85485c6/0x3234de053c53051 lrc: 0/0,0 mode: --/PR res: [0x2bb71:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da163 expref: 53 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529391.221368:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008517b233/0x3234de053c5304a lrc: 0/0,0 mode: --/PR res: [0x2bb6c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da155 expref: 52 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529391.221374:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001391dc6d/0x3234de053c53043 lrc: 0/0,0 mode: --/PR res: [0x2bb64:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da147 expref: 51 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529391.221380:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0bd9bfb/0x3234de053c5303c lrc: 0/0,0 mode: --/PR res: [0x2bb48:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da11d expref: 50 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529391.221387:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9b62460/0x3234de053c53035 lrc: 0/0,0 mode: --/PR res: [0x2bb59:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da10f expref: 49 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529391.221392:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091ee0f93/0x3234de053c5302e lrc: 0/0,0 mode: --/PR res: [0x2bb46:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da108 expref: 48 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529391.221399:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7aaedb0/0x3234de053c53027 lrc: 0/0,0 mode: --/PR res: [0x2bb6d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da0d7 expref: 47 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529391.221405:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c53020 lrc: 0/0,0 mode: --/PR res: [0x2bb6a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da0c9 expref: 46 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529391.221410:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c53019 lrc: 0/0,0 mode: --/PR res: [0x2bb60:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da067 expref: 45 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529391.221417:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c53012 lrc: 0/0,0 mode: --/PR res: [0x2bb53:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da03d expref: 44 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529391.221422:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c5300b lrc: 0/0,0 mode: --/PR res: [0x2bb4b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da036 expref: 43 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529391.221428:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c53004 lrc: 0/0,0 mode: --/PR res: [0x2bb6f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da021 expref: 42 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529391.221434:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c52ffd lrc: 0/0,0 mode: --/PR res: [0x2bb4d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9fe2 expref: 41 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529391.221439:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c52fef lrc: 0/0,0 mode: --/PR res: [0x2bb65:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9faa expref: 40 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529391.221445:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c52fe8 lrc: 0/0,0 mode: --/PR res: [0x2bb45:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9f95 expref: 39 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529391.221451:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c52fe1 lrc: 0/0,0 mode: --/PR res: [0x2bb63:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9f8e expref: 38 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529391.221457:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c52fda lrc: 0/0,0 mode: --/PR res: [0x2bb42:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9f79 expref: 37 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529391.221462:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c52fd3 lrc: 0/0,0 mode: --/PR res: [0x2bb62:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9f4f expref: 36 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529391.221468:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c52fcc lrc: 0/0,0 mode: --/PR res: [0x2bb4c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9f41 expref: 35 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529391.221474:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c52fc5 lrc: 0/0,0 mode: --/PR res: [0x2bb43:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9f33 expref: 34 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529391.221479:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c52fbe lrc: 0/0,0 mode: --/PR res: [0x2bb6e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9f17 expref: 33 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529391.221485:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c52fb7 lrc: 0/0,0 mode: --/PR res: [0x2bb6b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9edf expref: 32 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529391.221491:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c52fb0 lrc: 0/0,0 mode: --/PR res: [0x2bb66:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9ed8 expref: 31 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529391.221497:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c52fa9 lrc: 0/0,0 mode: --/PR res: [0x2bb55:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9ebc expref: 30 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529391.221503:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c52f9b lrc: 0/0,0 mode: --/PR res: [0x2bb68:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9eae expref: 29 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529391.221509:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c52f8d lrc: 0/0,0 mode: --/PR res: [0x2bb50:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9e84 expref: 28 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529391.221515:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c52fa2 lrc: 0/0,0 mode: --/PR res: [0x2bb4e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9ea7 expref: 27 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529391.221521:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c52f94 lrc: 0/0,0 mode: --/PR res: [0x2bb4f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9ea0 expref: 26 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529391.221527:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c52f86 lrc: 0/0,0 mode: --/PR res: [0x2bb57:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9e76 expref: 25 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529391.221533:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c52f6a lrc: 0/0,0 mode: --/PR res: [0x2bb67:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9e37 expref: 24 pid: 80276 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529391.221539:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c52f7f lrc: 0/0,0 mode: --/PR res: [0x2bb56:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9e68 expref: 23 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529391.221544:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c52f78 lrc: 0/0,0 mode: --/PR res: [0x2bb5f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9e5a expref: 22 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529391.221550:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c52f71 lrc: 0/0,0 mode: --/PR res: [0x2bb72:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9e45 expref: 21 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529391.221556:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c52f63 lrc: 0/0,0 mode: --/PR res: [0x2bb58:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9e14 expref: 20 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529391.221562:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c52f4e lrc: 0/0,0 mode: --/PR res: [0x2bb5b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9df1 expref: 19 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529391.221567:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c52f5c lrc: 0/0,0 mode: --/PR res: [0x2bb5d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9e06 expref: 18 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529391.221573:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006317cd4c/0x3234de053c52f47 lrc: 0/0,0 mode: --/PR res: [0x2bb49:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9ddc expref: 17 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529391.221579:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c52f55 lrc: 0/0,0 mode: --/PR res: [0x2bb5a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9df8 expref: 16 pid: 80277 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529391.221585:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c52f32 lrc: 0/0,0 mode: --/PR res: [0x2bb69:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9d3b expref: 15 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529391.221591:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c52f40 lrc: 0/0,0 mode: --/PR res: [0x2bb44:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9d65 expref: 14 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529391.221597:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c52f39 lrc: 0/0,0 mode: --/PR res: [0x2bb70:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9d50 expref: 13 pid: 72395 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529391.221603:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c52f24 lrc: 0/0,0 mode: --/PR res: [0x2bb5c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9d26 expref: 12 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529391.221608:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c52f2b lrc: 0/0,0 mode: --/PR res: [0x2bb51:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9d1f expref: 11 pid: 80279 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529391.221614:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c52f1d lrc: 0/0,0 mode: --/PR res: [0x2bb61:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9d18 expref: 10 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529391.221619:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c52f16 lrc: 0/0,0 mode: --/PR res: [0x2bb52:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9cb6 expref: 9 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529391.221625:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c52f0f lrc: 0/0,0 mode: --/PR res: [0x2bb47:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9c70 expref: 8 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529391.221631:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c52f08 lrc: 0/0,0 mode: --/PR res: [0x2bb4a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2d9c69 expref: 7 pid: 151609 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529391.221635:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529391.221661:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003cd5e5a1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:342879:x1731746396557504:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 354us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529391.221665:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 148 00000100:00100000:1.0:1651529391.286443:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529391.286469:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529391.286470:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946589440 00000100:00100000:1.0:1651529391.286486:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529391.286499:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529391.286507:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946589568 00000100:00100000:1.0:1651529391.286508:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529391.286518:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946589696 00000100:00100000:1.0:1651529391.286522:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529391.286524:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946589824 00000100:00100000:0.0:1651529391.286534:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946589504 00000100:00100000:1.0:1651529391.286538:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529391.286545:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946589632 00000100:00100000:1.0:1651529391.286547:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529391.286549:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946589760 00000100:00100000:0.0:1651529391.286551:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946589888 00000100:00100000:0.0:1651529391.286555:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212615 00000100:00100000:0.0:1651529391.286557:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946589440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529391.286558:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212616 00000100:00100000:1.0:1651529391.286560:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946589568:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529391.286569:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179012 count 1 00002000:00080000:0.0:1651529391.286569:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179010 count 1 00002000:00010000:0.0:1651529391.286577:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:1.0:1651529391.286578:0:80280:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb44:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.286580:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c531d2 lrc: 3/0,1 mode: --/PW res: [0x2bb44:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.286580:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c531cb lrc: 3/0,1 mode: --/PW res: [0x2bb42:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.286586:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.286586:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.286587:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.286587:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.286589:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c531d2 lrc: 3/0,1 mode: PW/PW res: [0x2bb44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.286589:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c531cb lrc: 3/0,1 mode: PW/PW res: [0x2bb42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.286594:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c531d2 lrc: 3/0,1 mode: PW/PW res: [0x2bb44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.286594:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c531cb lrc: 3/0,1 mode: PW/PW res: [0x2bb42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.286598:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c531d2 lrc: 3/0,1 mode: PW/PW res: [0x2bb44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.286598:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c531cb lrc: 3/0,1 mode: PW/PW res: [0x2bb42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.286601:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c531cb lrc: 2/0,0 mode: PW/PW res: [0x2bb42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.286604:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c531d2 lrc: 2/0,0 mode: PW/PW res: [0x2bb44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.286705:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+15:39030:x1731745946589440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 147us (263us total) trans 12885080619 rc 0/0 00000100:00100000:0.0:1651529391.286709:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212615 00000100:00100000:1.0:1651529391.286712:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:39030:x1731745946589568:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 150us (242us total) trans 12885080618 rc 0/0 00000100:00100000:0.0:1651529391.286714:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212617 00000100:00100000:1.0:1651529391.286716:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212616 00000100:00100000:0.0:1651529391.286716:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+14:39030:x1731745946589696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529391.286721:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179014 count 1 00000100:00100000:1.0:1651529391.286723:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212618 00000100:00100000:1.0:1651529391.286725:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946589824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00010000:0.0:1651529391.286726:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb46:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529391.286728:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c531d9 lrc: 3/0,1 mode: --/PW res: [0x2bb46:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529391.286730:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179016 count 1 00010000:00010000:0.0:1651529391.286732:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.286732:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.286733:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c531d9 lrc: 3/0,1 mode: PW/PW res: [0x2bb46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529391.286736:0:80280:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb48:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529391.286737:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c531d9 lrc: 3/0,1 mode: PW/PW res: [0x2bb46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.286738:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c531e0 lrc: 3/0,1 mode: --/PW res: [0x2bb48:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.286740:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c531d9 lrc: 3/0,1 mode: PW/PW res: [0x2bb46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.286742:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.286742:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.286742:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c531d9 lrc: 2/0,0 mode: PW/PW res: [0x2bb46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.286743:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c531e0 lrc: 3/0,1 mode: PW/PW res: [0x2bb48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.286747:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c531e0 lrc: 3/0,1 mode: PW/PW res: [0x2bb48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.286767:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c531e0 lrc: 3/0,1 mode: PW/PW res: [0x2bb48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.286770:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c531e0 lrc: 2/0,0 mode: PW/PW res: [0x2bb48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.286814:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+15:39030:x1731745946589696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 97us (327us total) trans 12885080620 rc 0/0 00000100:00100000:1.0:1651529391.286816:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:39030:x1731745946589824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 90us (317us total) trans 12885080621 rc 0/0 00000100:00100000:0.0:1651529391.286818:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212617 00000100:00100000:1.0:1651529391.286820:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212618 00000100:00100000:0.0:1651529391.286823:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212619 00000100:00100000:0.0:1651529391.286824:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946589504:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529391.286825:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212620 00000100:00100000:1.0:1651529391.286827:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946589632:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529391.286829:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179011 count 1 00002000:00080000:1.0:1651529391.286832:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179013 count 1 00002000:00010000:0.0:1651529391.286834:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb43:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529391.286836:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c531e7 lrc: 3/0,1 mode: --/PW res: [0x2bb43:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529391.286837:0:80280:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb45:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.286839:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067d657cd/0x3234de053c531ee lrc: 3/0,1 mode: --/PW res: [0x2bb45:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.286842:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.286842:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.286843:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.286843:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.286843:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c531e7 lrc: 3/0,1 mode: PW/PW res: [0x2bb43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.286844:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067d657cd/0x3234de053c531ee lrc: 3/0,1 mode: PW/PW res: [0x2bb45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.286847:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c531e7 lrc: 3/0,1 mode: PW/PW res: [0x2bb43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.286848:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067d657cd/0x3234de053c531ee lrc: 3/0,1 mode: PW/PW res: [0x2bb45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.286850:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c531e7 lrc: 3/0,1 mode: PW/PW res: [0x2bb43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.286851:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067d657cd/0x3234de053c531ee lrc: 3/0,1 mode: PW/PW res: [0x2bb45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.286852:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c531e7 lrc: 2/0,0 mode: PW/PW res: [0x2bb43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.286853:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067d657cd/0x3234de053c531ee lrc: 2/0,0 mode: PW/PW res: [0x2bb45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.286890:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+15:39030:x1731745946589504:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 65us (381us total) trans 12885080622 rc 0/0 00000100:00100000:1.0:1651529391.286892:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:39030:x1731745946589632:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 63us (370us total) trans 12885080623 rc 0/0 00000100:00100000:0.0:1651529391.286893:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212619 00000100:00100000:1.0:1651529391.286897:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212620 00000100:00100000:0.0:1651529391.286898:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212621 00000100:00100000:0.0:1651529391.286900:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946589760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529391.286902:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212622 00000100:00100000:1.0:1651529391.286904:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946589888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529391.286904:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179015 count 1 00002000:00080000:1.0:1651529391.286908:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179017 count 1 00002000:00010000:0.0:1651529391.286908:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb47:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529391.286910:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c531f5 lrc: 3/0,1 mode: --/PW res: [0x2bb47:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529391.286913:0:80280:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb49:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.286914:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fb54722/0x3234de053c531fc lrc: 3/0,1 mode: --/PW res: [0x2bb49:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.286914:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.286914:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.286915:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c531f5 lrc: 3/0,1 mode: PW/PW res: [0x2bb47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.286918:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.286918:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.286919:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fb54722/0x3234de053c531fc lrc: 3/0,1 mode: PW/PW res: [0x2bb49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.286919:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c531f5 lrc: 3/0,1 mode: PW/PW res: [0x2bb47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.286922:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c531f5 lrc: 3/0,1 mode: PW/PW res: [0x2bb47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.286923:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fb54722/0x3234de053c531fc lrc: 3/0,1 mode: PW/PW res: [0x2bb49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.286924:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c531f5 lrc: 2/0,0 mode: PW/PW res: [0x2bb47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.286926:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fb54722/0x3234de053c531fc lrc: 3/0,1 mode: PW/PW res: [0x2bb49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.286930:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003fb54722/0x3234de053c531fc lrc: 2/0,0 mode: PW/PW res: [0x2bb49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.286958:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+15:39030:x1731745946589760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 58us (421us total) trans 12885080624 rc 0/0 00000100:00100000:0.0:1651529391.286961:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212621 00000100:00100000:1.0:1651529391.286980:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:39030:x1731745946589888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 75us (432us total) trans 12885080625 rc 0/0 00010000:00010000:0.0:1651529391.286981:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c531cb lrc: 2/0,0 mode: PW/PW res: [0x2bb42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.286983:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212622 00010000:00010000:0.0:1651529391.286984:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a032e9d0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529391.286986:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c531cb lrc: 2/0,0 mode: PW/PW res: [0x2bb42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.286989:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c531cb lrc: 3/0,0 mode: PW/PW res: [0x2bb42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.286994:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c531cb lrc: 1/0,0 mode: --/PW res: [0x2bb42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.286995:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c531d2 lrc: 2/0,0 mode: PW/PW res: [0x2bb44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.286997:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c531cb lrc: 0/0,0 mode: --/PW res: [0x2bb42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287001:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007d55fe01 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529391.287002:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c531d2 lrc: 2/0,0 mode: PW/PW res: [0x2bb44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.287002:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c531d9 lrc: 2/0,0 mode: PW/PW res: [0x2bb46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287005:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c531d2 lrc: 3/0,0 mode: PW/PW res: [0x2bb44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.287005:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000f18bca1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529391.287006:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c531d9 lrc: 2/0,0 mode: PW/PW res: [0x2bb46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.287008:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c531d9 lrc: 3/0,0 mode: PW/PW res: [0x2bb46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287010:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c531d2 lrc: 1/0,0 mode: --/PW res: [0x2bb44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.287011:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c531d9 lrc: 1/0,0 mode: --/PW res: [0x2bb46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287013:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c531d2 lrc: 0/0,0 mode: --/PW res: [0x2bb44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.287014:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c531d9 lrc: 0/0,0 mode: --/PW res: [0x2bb46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.287017:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c531e0 lrc: 2/0,0 mode: PW/PW res: [0x2bb48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287018:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c531e7 lrc: 2/0,0 mode: PW/PW res: [0x2bb43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.287020:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e943794 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529391.287021:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000215144f2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529391.287021:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c531e0 lrc: 2/0,0 mode: PW/PW res: [0x2bb48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287022:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c531e7 lrc: 2/0,0 mode: PW/PW res: [0x2bb43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.287023:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c531e0 lrc: 3/0,0 mode: PW/PW res: [0x2bb48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287024:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c531e7 lrc: 3/0,0 mode: PW/PW res: [0x2bb43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.287026:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c531e0 lrc: 1/0,0 mode: --/PW res: [0x2bb48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287028:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c531e7 lrc: 1/0,0 mode: --/PW res: [0x2bb43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.287029:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c531e0 lrc: 0/0,0 mode: --/PW res: [0x2bb48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287030:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c531e7 lrc: 0/0,0 mode: --/PW res: [0x2bb43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.287033:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067d657cd/0x3234de053c531ee lrc: 2/0,0 mode: PW/PW res: [0x2bb45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287035:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c531f5 lrc: 2/0,0 mode: PW/PW res: [0x2bb47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.287036:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067d657cd already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529391.287037:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d1167ce5 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529391.287037:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067d657cd/0x3234de053c531ee lrc: 2/0,0 mode: PW/PW res: [0x2bb45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287038:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c531f5 lrc: 2/0,0 mode: PW/PW res: [0x2bb47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.287039:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067d657cd/0x3234de053c531ee lrc: 3/0,0 mode: PW/PW res: [0x2bb45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287041:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c531f5 lrc: 3/0,0 mode: PW/PW res: [0x2bb47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.287042:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067d657cd/0x3234de053c531ee lrc: 1/0,0 mode: --/PW res: [0x2bb45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287044:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c531f5 lrc: 1/0,0 mode: --/PW res: [0x2bb47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.287045:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067d657cd/0x3234de053c531ee lrc: 0/0,0 mode: --/PW res: [0x2bb45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287046:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c531f5 lrc: 0/0,0 mode: --/PW res: [0x2bb47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.287048:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003fb54722/0x3234de053c531fc lrc: 2/0,0 mode: PW/PW res: [0x2bb49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.287051:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003fb54722 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529391.287052:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003fb54722/0x3234de053c531fc lrc: 2/0,0 mode: PW/PW res: [0x2bb49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.287057:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003fb54722/0x3234de053c531fc lrc: 3/0,0 mode: PW/PW res: [0x2bb49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.287060:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003fb54722/0x3234de053c531fc lrc: 1/0,0 mode: --/PW res: [0x2bb49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.287063:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fb54722/0x3234de053c531fc lrc: 0/0,0 mode: --/PW res: [0x2bb49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.287351:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529391.287371:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529391.287381:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529391.287419:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529391.287430:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529391.287441:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529391.287450:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529391.287458:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529391.287467:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946590784 00000100:00100000:1.0:1651529391.287469:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946590720 00000100:00100000:1.0:1651529391.287481:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946590912 00000100:00100000:0.0:1651529391.287482:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946590848 00000100:00100000:1.0:1651529391.287486:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946591040 00000100:00100000:1.0:1651529391.287491:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946591168 00000100:00100000:0.0:1651529391.287492:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946590976 00000100:00100000:1.0:1651529391.287494:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946591104 00000100:00100000:0.0:1651529391.287497:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212623 00000100:00100000:0.0:1651529391.287499:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:39029:x1731745946590784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529391.287501:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212624 00000100:00100000:1.0:1651529391.287503:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:39029:x1731745946590720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529391.287506:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179019 count 1 00002000:00080000:1.0:1651529391.287509:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179018 count 1 00002000:00010000:0.0:1651529391.287512:0:72395:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb4b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529391.287514:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c53203 lrc: 3/0,1 mode: --/PW res: [0x2bb4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529391.287515:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb4a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.287517:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be333df1/0x3234de053c5320a lrc: 3/0,1 mode: --/PW res: [0x2bb4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.287519:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.287520:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.287521:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.287521:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c53203 lrc: 3/0,1 mode: PW/PW res: [0x2bb4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287522:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.287523:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be333df1/0x3234de053c5320a lrc: 3/0,1 mode: PW/PW res: [0x2bb4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.287525:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c53203 lrc: 3/0,1 mode: PW/PW res: [0x2bb4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287527:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be333df1/0x3234de053c5320a lrc: 3/0,1 mode: PW/PW res: [0x2bb4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287530:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be333df1/0x3234de053c5320a lrc: 3/0,1 mode: PW/PW res: [0x2bb4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.287531:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c53203 lrc: 3/0,1 mode: PW/PW res: [0x2bb4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287533:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be333df1/0x3234de053c5320a lrc: 2/0,0 mode: PW/PW res: [0x2bb4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.287534:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c53203 lrc: 2/0,0 mode: PW/PW res: [0x2bb4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.287583:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:39029:x1731745946590720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 79us (212us total) trans 12885080626 rc 0/0 00000100:00100000:1.0:1651529391.287586:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212624 00000100:00100000:0.0:1651529391.287586:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:39029:x1731745946590784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 86us (237us total) trans 12885080627 rc 0/0 00000100:00100000:0.0:1651529391.287590:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212623 00000100:00100000:1.0:1651529391.287592:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212625 00000100:00100000:1.0:1651529391.287593:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:39029:x1731745946590912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529391.287596:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212626 00000100:00100000:0.0:1651529391.287597:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:39029:x1731745946590848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529391.287599:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179021 count 1 00002000:00080000:0.0:1651529391.287602:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179020 count 1 00002000:00010000:1.0:1651529391.287604:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb4d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.287606:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049d4bb9b/0x3234de053c53211 lrc: 3/0,1 mode: --/PW res: [0x2bb4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529391.287607:0:72395:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb4c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.287609:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.287609:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c53218 lrc: 3/0,1 mode: --/PW res: [0x2bb4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287610:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.287611:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049d4bb9b/0x3234de053c53211 lrc: 3/0,1 mode: PW/PW res: [0x2bb4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.287613:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.287613:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.287614:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049d4bb9b/0x3234de053c53211 lrc: 3/0,1 mode: PW/PW res: [0x2bb4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.287614:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c53218 lrc: 3/0,1 mode: PW/PW res: [0x2bb4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287617:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049d4bb9b/0x3234de053c53211 lrc: 3/0,1 mode: PW/PW res: [0x2bb4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.287618:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c53218 lrc: 3/0,1 mode: PW/PW res: [0x2bb4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287620:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049d4bb9b/0x3234de053c53211 lrc: 2/0,0 mode: PW/PW res: [0x2bb4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.287621:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c53218 lrc: 3/0,1 mode: PW/PW res: [0x2bb4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.287626:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c53218 lrc: 2/0,0 mode: PW/PW res: [0x2bb4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.287664:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:39029:x1731745946590912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 70us (245us total) trans 12885080628 rc 0/0 00000100:00100000:1.0:1651529391.287667:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212625 00000100:00100000:1.0:1651529391.287672:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212627 00000100:00100000:1.0:1651529391.287673:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:39029:x1731745946591040:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529391.287676:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:39029:x1731745946590848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 77us (294us total) trans 12885080629 rc 0/0 00002000:00080000:1.0:1651529391.287678:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179023 count 1 00000100:00100000:0.0:1651529391.287679:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212626 00002000:00010000:1.0:1651529391.287682:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb4f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.287684:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0382f56/0x3234de053c5321f lrc: 3/0,1 mode: --/PW res: [0x2bb4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.287684:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212628 00000100:00100000:0.0:1651529391.287686:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004544c2e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:39029:x1731745946591168:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529391.287688:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.287688:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.287689:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0382f56/0x3234de053c5321f lrc: 3/0,1 mode: PW/PW res: [0x2bb4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529391.287690:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179025 count 1 00010000:00010000:1.0:1651529391.287693:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0382f56/0x3234de053c5321f lrc: 3/0,1 mode: PW/PW res: [0x2bb4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287695:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0382f56/0x3234de053c5321f lrc: 3/0,1 mode: PW/PW res: [0x2bb4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529391.287695:0:72395:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb51:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529391.287697:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c53226 lrc: 3/0,1 mode: --/PW res: [0x2bb51:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287698:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0382f56/0x3234de053c5321f lrc: 2/0,0 mode: PW/PW res: [0x2bb4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.287700:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.287701:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.287702:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c53226 lrc: 3/0,1 mode: PW/PW res: [0x2bb51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.287706:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c53226 lrc: 3/0,1 mode: PW/PW res: [0x2bb51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.287709:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c53226 lrc: 3/0,1 mode: PW/PW res: [0x2bb51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.287711:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c53226 lrc: 2/0,0 mode: PW/PW res: [0x2bb51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.287733:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:39029:x1731745946591040:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 58us (302us total) trans 12885080630 rc 0/0 00000100:00100000:1.0:1651529391.287736:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212627 00000100:00100000:1.0:1651529391.287740:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212629 00000100:00100000:1.0:1651529391.287742:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:39029:x1731745946590976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529391.287746:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179022 count 1 00000100:00100000:0.0:1651529391.287749:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004544c2e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:39029:x1731745946591168:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 62us (308us total) trans 12885080631 rc 0/0 00002000:00010000:1.0:1651529391.287750:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb4e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.287752:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cab45436/0x3234de053c5322d lrc: 3/0,1 mode: --/PW res: [0x2bb4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.287752:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212628 00010000:00010000:1.0:1651529391.287755:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.287766:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.287767:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cab45436/0x3234de053c5322d lrc: 3/0,1 mode: PW/PW res: [0x2bb4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287772:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cab45436/0x3234de053c5322d lrc: 3/0,1 mode: PW/PW res: [0x2bb4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287775:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cab45436/0x3234de053c5322d lrc: 3/0,1 mode: PW/PW res: [0x2bb4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287777:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cab45436/0x3234de053c5322d lrc: 2/0,0 mode: PW/PW res: [0x2bb4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.287792:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212630 00000100:00100000:0.0:1651529391.287794:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:39029:x1731745946591104:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529391.287798:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179024 count 1 00002000:00010000:0.0:1651529391.287803:0:72395:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb50:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529391.287805:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c53234 lrc: 3/0,1 mode: --/PW res: [0x2bb50:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.287808:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.287809:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.287810:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c53234 lrc: 3/0,1 mode: PW/PW res: [0x2bb50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.287813:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:39029:x1731745946590976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 71us (363us total) trans 12885080632 rc 0/0 00010000:00010000:0.0:1651529391.287813:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c53234 lrc: 3/0,1 mode: PW/PW res: [0x2bb50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.287816:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c53234 lrc: 3/0,1 mode: PW/PW res: [0x2bb50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.287817:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212629 00010000:00010000:0.0:1651529391.287819:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c53234 lrc: 2/0,0 mode: PW/PW res: [0x2bb50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287825:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be333df1/0x3234de053c5320a lrc: 2/0,0 mode: PW/PW res: [0x2bb4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287829:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000be333df1 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529391.287830:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be333df1/0x3234de053c5320a lrc: 2/0,0 mode: PW/PW res: [0x2bb4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287833:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be333df1/0x3234de053c5320a lrc: 3/0,0 mode: PW/PW res: [0x2bb4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287837:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be333df1/0x3234de053c5320a lrc: 1/0,0 mode: --/PW res: [0x2bb4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287840:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be333df1/0x3234de053c5320a lrc: 0/0,0 mode: --/PW res: [0x2bb4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287845:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c53203 lrc: 2/0,0 mode: PW/PW res: [0x2bb4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287848:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001d04fb0a already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529391.287849:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c53203 lrc: 2/0,0 mode: PW/PW res: [0x2bb4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287851:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c53203 lrc: 3/0,0 mode: PW/PW res: [0x2bb4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287854:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c53203 lrc: 1/0,0 mode: --/PW res: [0x2bb4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.287856:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:39029:x1731745946591104:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 61us (397us total) trans 12885080633 rc 0/0 00010000:00010000:1.0:1651529391.287857:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c53203 lrc: 0/0,0 mode: --/PW res: [0x2bb4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287860:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049d4bb9b/0x3234de053c53211 lrc: 2/0,0 mode: PW/PW res: [0x2bb4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.287860:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212630 00010000:00010000:1.0:1651529391.287863:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000049d4bb9b already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529391.287864:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049d4bb9b/0x3234de053c53211 lrc: 2/0,0 mode: PW/PW res: [0x2bb4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287866:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049d4bb9b/0x3234de053c53211 lrc: 3/0,0 mode: PW/PW res: [0x2bb4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287869:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049d4bb9b/0x3234de053c53211 lrc: 1/0,0 mode: --/PW res: [0x2bb4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287872:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049d4bb9b/0x3234de053c53211 lrc: 0/0,0 mode: --/PW res: [0x2bb4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.287873:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c53218 lrc: 2/0,0 mode: PW/PW res: [0x2bb4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287876:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0382f56/0x3234de053c5321f lrc: 2/0,0 mode: PW/PW res: [0x2bb4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.287877:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c660975a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529391.287878:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c53218 lrc: 2/0,0 mode: PW/PW res: [0x2bb4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287879:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b0382f56 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529391.287879:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0382f56/0x3234de053c5321f lrc: 2/0,0 mode: PW/PW res: [0x2bb4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.287881:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c53218 lrc: 3/0,0 mode: PW/PW res: [0x2bb4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287882:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0382f56/0x3234de053c5321f lrc: 3/0,0 mode: PW/PW res: [0x2bb4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287885:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0382f56/0x3234de053c5321f lrc: 1/0,0 mode: --/PW res: [0x2bb4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.287886:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c53218 lrc: 1/0,0 mode: --/PW res: [0x2bb4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287887:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0382f56/0x3234de053c5321f lrc: 0/0,0 mode: --/PW res: [0x2bb4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.287889:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c53218 lrc: 0/0,0 mode: --/PW res: [0x2bb4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287891:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c53226 lrc: 2/0,0 mode: PW/PW res: [0x2bb51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287893:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e4f40ecf already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529391.287894:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c53226 lrc: 2/0,0 mode: PW/PW res: [0x2bb51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.287894:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cab45436/0x3234de053c5322d lrc: 2/0,0 mode: PW/PW res: [0x2bb4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.287897:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cab45436 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529391.287898:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cab45436/0x3234de053c5322d lrc: 2/0,0 mode: PW/PW res: [0x2bb4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287899:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c53226 lrc: 3/0,0 mode: PW/PW res: [0x2bb51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.287900:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cab45436/0x3234de053c5322d lrc: 3/0,0 mode: PW/PW res: [0x2bb4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287903:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c53226 lrc: 1/0,0 mode: --/PW res: [0x2bb51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287905:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c53226 lrc: 0/0,0 mode: --/PW res: [0x2bb51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.287906:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cab45436/0x3234de053c5322d lrc: 1/0,0 mode: --/PW res: [0x2bb4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287909:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c53234 lrc: 2/0,0 mode: PW/PW res: [0x2bb50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.287909:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cab45436/0x3234de053c5322d lrc: 0/0,0 mode: --/PW res: [0x2bb4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287911:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009882f227 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529391.287912:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c53234 lrc: 2/0,0 mode: PW/PW res: [0x2bb50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287915:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c53234 lrc: 3/0,0 mode: PW/PW res: [0x2bb50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287918:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c53234 lrc: 1/0,0 mode: --/PW res: [0x2bb50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.287920:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c53234 lrc: 0/0,0 mode: --/PW res: [0x2bb50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.288127:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529391.288140:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946591552 00000100:00100000:0.0:1651529391.288150:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212631 00000100:00100000:0.0:1651529391.288151:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:39029:x1731745946591552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529391.288157:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179026 count 1 00002000:00010000:0.0:1651529391.288163:0:80280:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb52:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529391.288164:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c5323b lrc: 3/0,1 mode: --/PW res: [0x2bb52:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288168:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.288169:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.288170:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c5323b lrc: 3/0,1 mode: PW/PW res: [0x2bb52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288174:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c5323b lrc: 3/0,1 mode: PW/PW res: [0x2bb52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288177:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c5323b lrc: 3/0,1 mode: PW/PW res: [0x2bb52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288179:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c5323b lrc: 2/0,0 mode: PW/PW res: [0x2bb52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.288248:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:39029:x1731745946591552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 95us (121us total) trans 12885080634 rc 0/0 00000100:00100000:0.0:1651529391.288251:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212631 00010000:00010000:0.0:1651529391.288280:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c5323b lrc: 2/0,0 mode: PW/PW res: [0x2bb52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288284:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cde7e11a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529391.288285:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c5323b lrc: 2/0,0 mode: PW/PW res: [0x2bb52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288288:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c5323b lrc: 3/0,0 mode: PW/PW res: [0x2bb52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288293:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c5323b lrc: 1/0,0 mode: --/PW res: [0x2bb52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.288294:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529391.288296:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c5323b lrc: 0/0,0 mode: --/PW res: [0x2bb52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.288309:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946591744 00000100:00100000:0.0:1651529391.288316:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212632 00000100:00100000:0.0:1651529391.288318:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+23:39029:x1731745946591744:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529391.288323:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179027 count 1 00002000:00010000:0.0:1651529391.288328:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb53:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529391.288329:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c53242 lrc: 3/0,1 mode: --/PW res: [0x2bb53:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288333:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.288334:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.288335:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c53242 lrc: 3/0,1 mode: PW/PW res: [0x2bb53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288338:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c53242 lrc: 3/0,1 mode: PW/PW res: [0x2bb53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288341:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c53242 lrc: 3/0,1 mode: PW/PW res: [0x2bb53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288344:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c53242 lrc: 2/0,0 mode: PW/PW res: [0x2bb53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288356:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c53242 lrc: 3/0,0 mode: PW/PW res: [0x2bb53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288360:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009fff0bd3 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529391.288361:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c53242 lrc: 3/0,0 mode: PW/PW res: [0x2bb53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288364:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c53242 lrc: 4/0,0 mode: PW/PW res: [0x2bb53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288369:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c53242 lrc: 2/0,0 mode: --/PW res: [0x2bb53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288392:0:151609:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c53242 lrc: 0/0,0 mode: --/PW res: [0x2bb53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.288416:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529391.288427:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529391.288435:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529391.288443:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529391.288459:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+24:39029:x1731745946591744:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 140us (166us total) trans 12885080635 rc 0/0 00000100:00100000:0.0:1651529391.288462:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212632 00000100:00100000:1.0:1651529391.288465:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529391.288474:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946591936 00000100:00100000:0.0:1651529391.288479:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946592064 00000100:00100000:0.0:1651529391.288483:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946592192 00000100:00100000:0.0:1651529391.288489:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946591872 00000100:00100000:0.0:1651529391.288492:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946592000 00000100:00100000:0.0:1651529391.288495:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212633 00000100:00100000:0.0:1651529391.288497:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:39029:x1731745946591936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529391.288502:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529391.288503:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179029 count 1 00002000:00010000:0.0:1651529391.288508:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb55:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529391.288509:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529391.288509:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c53249 lrc: 3/0,1 mode: --/PW res: [0x2bb55:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288513:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.288514:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529391.288515:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946592128 00010000:00010000:0.0:1651529391.288515:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c53249 lrc: 3/0,1 mode: PW/PW res: [0x2bb55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288518:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c53249 lrc: 3/0,1 mode: PW/PW res: [0x2bb55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.288521:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946592256 00010000:00010000:0.0:1651529391.288521:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c53249 lrc: 3/0,1 mode: PW/PW res: [0x2bb55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288524:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c53249 lrc: 2/0,0 mode: PW/PW res: [0x2bb55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.288525:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212634 00000100:00100000:1.0:1651529391.288526:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:39029:x1731745946592064:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529391.288532:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179031 count 1 00002000:00010000:1.0:1651529391.288538:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb57:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.288539:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c1cdcb2/0x3234de053c53250 lrc: 3/0,1 mode: --/PW res: [0x2bb57:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288546:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.288546:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.288547:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c1cdcb2/0x3234de053c53250 lrc: 3/0,1 mode: PW/PW res: [0x2bb57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288551:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c1cdcb2/0x3234de053c53250 lrc: 3/0,1 mode: PW/PW res: [0x2bb57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288554:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c1cdcb2/0x3234de053c53250 lrc: 3/0,1 mode: PW/PW res: [0x2bb57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288557:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c1cdcb2/0x3234de053c53250 lrc: 2/0,0 mode: PW/PW res: [0x2bb57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.288608:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:39029:x1731745946592064:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 80us (181us total) trans 12885080636 rc 0/0 00000100:00100000:1.0:1651529391.288611:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212634 00000100:00100000:0.0:1651529391.288615:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:39029:x1731745946591936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 117us (198us total) trans 12885080637 rc 0/0 00000100:00100000:1.0:1651529391.288617:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212635 00000100:00100000:1.0:1651529391.288618:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:39029:x1731745946592192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529391.288618:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212633 00002000:00080000:1.0:1651529391.288623:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179033 count 1 00000100:00100000:0.0:1651529391.288624:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212636 00000100:00100000:0.0:1651529391.288626:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:39029:x1731745946591872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00010000:1.0:1651529391.288627:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb59:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.288629:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000990cd87d/0x3234de053c53257 lrc: 3/0,1 mode: --/PW res: [0x2bb59:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529391.288631:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179028 count 1 00010000:00010000:1.0:1651529391.288633:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.288633:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.288634:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000990cd87d/0x3234de053c53257 lrc: 3/0,1 mode: PW/PW res: [0x2bb59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529391.288635:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb54:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529391.288637:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5325e lrc: 3/0,1 mode: --/PW res: [0x2bb54:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288638:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000990cd87d/0x3234de053c53257 lrc: 3/0,1 mode: PW/PW res: [0x2bb59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288641:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000990cd87d/0x3234de053c53257 lrc: 3/0,1 mode: PW/PW res: [0x2bb59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288641:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.288642:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.288643:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5325e lrc: 3/0,1 mode: PW/PW res: [0x2bb54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288644:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000990cd87d/0x3234de053c53257 lrc: 2/0,0 mode: PW/PW res: [0x2bb59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288646:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5325e lrc: 3/0,1 mode: PW/PW res: [0x2bb54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288649:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5325e lrc: 3/0,1 mode: PW/PW res: [0x2bb54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288670:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5325e lrc: 2/0,0 mode: PW/PW res: [0x2bb54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.288680:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:39029:x1731745946592192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 61us (245us total) trans 12885080638 rc 0/0 00000100:00100000:1.0:1651529391.288683:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212635 00000100:00100000:1.0:1651529391.288688:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212637 00000100:00100000:1.0:1651529391.288689:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:39029:x1731745946592000:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529391.288693:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179030 count 1 00002000:00010000:1.0:1651529391.288698:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb56:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.288700:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ead1500/0x3234de053c53265 lrc: 3/0,1 mode: --/PW res: [0x2bb56:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288703:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.288703:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.288704:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ead1500/0x3234de053c53265 lrc: 3/0,1 mode: PW/PW res: [0x2bb56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288708:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ead1500/0x3234de053c53265 lrc: 3/0,1 mode: PW/PW res: [0x2bb56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.288708:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:39029:x1731745946591872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 81us (265us total) trans 12885080639 rc 0/0 00000100:00100000:0.0:1651529391.288711:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212636 00010000:00010000:1.0:1651529391.288713:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ead1500/0x3234de053c53265 lrc: 3/0,1 mode: PW/PW res: [0x2bb56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288716:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ead1500/0x3234de053c53265 lrc: 2/0,0 mode: PW/PW res: [0x2bb56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.288716:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212638 00000100:00100000:0.0:1651529391.288718:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ea32140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:39029:x1731745946592128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529391.288722:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179032 count 1 00002000:00010000:0.0:1651529391.288727:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb58:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529391.288729:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c5326c lrc: 3/0,1 mode: --/PW res: [0x2bb58:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288732:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.288733:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.288734:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c5326c lrc: 3/0,1 mode: PW/PW res: [0x2bb58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288737:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c5326c lrc: 3/0,1 mode: PW/PW res: [0x2bb58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288741:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c5326c lrc: 3/0,1 mode: PW/PW res: [0x2bb58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288743:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c5326c lrc: 2/0,0 mode: PW/PW res: [0x2bb58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.288749:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:39029:x1731745946592000:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 59us (284us total) trans 12885080640 rc 0/0 00000100:00100000:1.0:1651529391.288752:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212637 00000100:00100000:1.0:1651529391.288768:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212639 00000100:00100000:1.0:1651529391.288770:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfc79d4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:39030:x1731745946592256:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529391.288775:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179034 count 1 00002000:00010000:1.0:1651529391.288780:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb5a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.288781:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2ef532c/0x3234de053c53273 lrc: 3/0,1 mode: --/PW res: [0x2bb5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288785:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.288785:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.288786:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2ef532c/0x3234de053c53273 lrc: 3/0,1 mode: PW/PW res: [0x2bb5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288790:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2ef532c/0x3234de053c53273 lrc: 3/0,1 mode: PW/PW res: [0x2bb5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.288792:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ea32140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:39029:x1731745946592128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 73us (290us total) trans 12885080641 rc 0/0 00010000:00010000:1.0:1651529391.288793:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2ef532c/0x3234de053c53273 lrc: 3/0,1 mode: PW/PW res: [0x2bb5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.288795:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212638 00010000:00010000:1.0:1651529391.288798:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2ef532c/0x3234de053c53273 lrc: 2/0,0 mode: PW/PW res: [0x2bb5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288808:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c1cdcb2/0x3234de053c53250 lrc: 2/0,0 mode: PW/PW res: [0x2bb57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288811:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006c1cdcb2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529391.288812:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c1cdcb2/0x3234de053c53250 lrc: 2/0,0 mode: PW/PW res: [0x2bb57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288815:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c1cdcb2/0x3234de053c53250 lrc: 3/0,0 mode: PW/PW res: [0x2bb57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288820:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c1cdcb2/0x3234de053c53250 lrc: 1/0,0 mode: --/PW res: [0x2bb57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288823:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c1cdcb2/0x3234de053c53250 lrc: 0/0,0 mode: --/PW res: [0x2bb57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288828:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c53249 lrc: 2/0,0 mode: PW/PW res: [0x2bb55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288831:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ac14729e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529391.288832:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c53249 lrc: 2/0,0 mode: PW/PW res: [0x2bb55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.288834:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfc79d4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:39030:x1731745946592256:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 63us (325us total) trans 12885080642 rc 0/0 00010000:00010000:0.0:1651529391.288834:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c53249 lrc: 3/0,0 mode: PW/PW res: [0x2bb55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.288837:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212639 00010000:00010000:0.0:1651529391.288837:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c53249 lrc: 1/0,0 mode: --/PW res: [0x2bb55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288840:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c53249 lrc: 0/0,0 mode: --/PW res: [0x2bb55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288843:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000990cd87d/0x3234de053c53257 lrc: 2/0,0 mode: PW/PW res: [0x2bb59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288845:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5325e lrc: 2/0,0 mode: PW/PW res: [0x2bb54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288846:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000990cd87d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529391.288847:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000990cd87d/0x3234de053c53257 lrc: 2/0,0 mode: PW/PW res: [0x2bb59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288848:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d37a9fd1 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529391.288849:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5325e lrc: 2/0,0 mode: PW/PW res: [0x2bb54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288849:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000990cd87d/0x3234de053c53257 lrc: 3/0,0 mode: PW/PW res: [0x2bb59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288852:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5325e lrc: 3/0,0 mode: PW/PW res: [0x2bb54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288852:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000990cd87d/0x3234de053c53257 lrc: 1/0,0 mode: --/PW res: [0x2bb59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288855:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000990cd87d/0x3234de053c53257 lrc: 0/0,0 mode: --/PW res: [0x2bb59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288856:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5325e lrc: 1/0,0 mode: --/PW res: [0x2bb54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288859:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5325e lrc: 0/0,0 mode: --/PW res: [0x2bb54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288859:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ead1500/0x3234de053c53265 lrc: 2/0,0 mode: PW/PW res: [0x2bb56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288861:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008ead1500 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529391.288862:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ead1500/0x3234de053c53265 lrc: 2/0,0 mode: PW/PW res: [0x2bb56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288864:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c5326c lrc: 2/0,0 mode: PW/PW res: [0x2bb58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288865:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ead1500/0x3234de053c53265 lrc: 3/0,0 mode: PW/PW res: [0x2bb56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288867:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002d7487dc already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529391.288868:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c5326c lrc: 2/0,0 mode: PW/PW res: [0x2bb58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288868:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ead1500/0x3234de053c53265 lrc: 1/0,0 mode: --/PW res: [0x2bb56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288870:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ead1500/0x3234de053c53265 lrc: 0/0,0 mode: --/PW res: [0x2bb56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288871:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c5326c lrc: 3/0,0 mode: PW/PW res: [0x2bb58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.288874:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c5326c lrc: 1/0,0 mode: --/PW res: [0x2bb58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288874:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2ef532c/0x3234de053c53273 lrc: 2/0,0 mode: PW/PW res: [0x2bb5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288876:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d2ef532c already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529391.288877:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c5326c lrc: 0/0,0 mode: --/PW res: [0x2bb58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288877:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2ef532c/0x3234de053c53273 lrc: 2/0,0 mode: PW/PW res: [0x2bb5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288882:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2ef532c/0x3234de053c53273 lrc: 3/0,0 mode: PW/PW res: [0x2bb5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288886:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2ef532c/0x3234de053c53273 lrc: 1/0,0 mode: --/PW res: [0x2bb5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288888:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2ef532c/0x3234de053c53273 lrc: 0/0,0 mode: --/PW res: [0x2bb5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.288890:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529391.288896:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946592320 00000100:00100000:0.0:1651529391.288902:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212640 00000100:00100000:0.0:1651529391.288904:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007fca8239 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:39030:x1731745946592320:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529391.288909:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179035 count 1 00002000:00010000:0.0:1651529391.288913:0:72395:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb5b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529391.288914:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c5327a lrc: 3/0,1 mode: --/PW res: [0x2bb5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288918:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.288918:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.288919:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c5327a lrc: 3/0,1 mode: PW/PW res: [0x2bb5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288923:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c5327a lrc: 3/0,1 mode: PW/PW res: [0x2bb5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288925:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c5327a lrc: 3/0,1 mode: PW/PW res: [0x2bb5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.288931:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c5327a lrc: 2/0,0 mode: PW/PW res: [0x2bb5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.288973:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007fca8239 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+32:39030:x1731745946592320:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 68us (83us total) trans 12885080643 rc 0/0 00000100:00100000:0.0:1651529391.288976:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212640 00010000:00010000:1.0:1651529391.288998:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c5327a lrc: 2/0,0 mode: PW/PW res: [0x2bb5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289002:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f56810a1 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529391.289003:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c5327a lrc: 2/0,0 mode: PW/PW res: [0x2bb5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289006:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c5327a lrc: 3/0,0 mode: PW/PW res: [0x2bb5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289011:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c5327a lrc: 1/0,0 mode: --/PW res: [0x2bb5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289013:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c5327a lrc: 0/0,0 mode: --/PW res: [0x2bb5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.289161:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529391.289172:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529391.289182:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529391.289183:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946592896 00000100:00100000:1.0:1651529391.289192:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946592960 00000100:00100000:0.0:1651529391.289195:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946593088 00000100:00100000:1.0:1651529391.289202:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212641 00000100:00100000:1.0:1651529391.289203:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005914c920 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+34:39030:x1731745946592896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529391.289208:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212642 00002000:00080000:1.0:1651529391.289209:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179036 count 1 00000100:00100000:0.0:1651529391.289210:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+34:39030:x1731745946592960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00010000:1.0:1651529391.289214:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb5c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.289216:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007126e775/0x3234de053c53281 lrc: 3/0,1 mode: --/PW res: [0x2bb5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529391.289216:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179037 count 1 00010000:00010000:1.0:1651529391.289220:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.289220:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00010000:0.0:1651529391.289232:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb5d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529391.289234:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c53288 lrc: 3/0,1 mode: --/PW res: [0x2bb5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289237:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007126e775/0x3234de053c53281 lrc: 3/0,1 mode: PW/PW res: [0x2bb5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289242:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007126e775/0x3234de053c53281 lrc: 3/0,1 mode: PW/PW res: [0x2bb5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289245:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007126e775/0x3234de053c53281 lrc: 3/0,1 mode: PW/PW res: [0x2bb5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.289247:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.289248:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007126e775/0x3234de053c53281 lrc: 2/0,0 mode: PW/PW res: [0x2bb5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.289248:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.289249:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c53288 lrc: 3/0,1 mode: PW/PW res: [0x2bb5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.289259:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c53288 lrc: 3/0,1 mode: PW/PW res: [0x2bb5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.289262:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c53288 lrc: 3/0,1 mode: PW/PW res: [0x2bb5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.289265:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c53288 lrc: 2/0,0 mode: PW/PW res: [0x2bb5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.289294:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005914c920 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+35:39030:x1731745946592896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 89us (139us total) trans 12885080644 rc 0/0 00000100:00100000:1.0:1651529391.289313:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212641 00000100:00100000:1.0:1651529391.289318:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212643 00000100:00100000:1.0:1651529391.289320:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+35:39029:x1731745946593088:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529391.289325:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179039 count 1 00002000:00010000:1.0:1651529391.289329:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb5f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.289331:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059de8c3d/0x3234de053c5328f lrc: 3/0,1 mode: --/PW res: [0x2bb5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289335:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.289335:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.289336:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059de8c3d/0x3234de053c5328f lrc: 3/0,1 mode: PW/PW res: [0x2bb5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289340:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059de8c3d/0x3234de053c5328f lrc: 3/0,1 mode: PW/PW res: [0x2bb5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289343:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059de8c3d/0x3234de053c5328f lrc: 3/0,1 mode: PW/PW res: [0x2bb5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289345:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059de8c3d/0x3234de053c5328f lrc: 2/0,0 mode: PW/PW res: [0x2bb5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.289350:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+35:39030:x1731745946592960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 139us (178us total) trans 12885080645 rc 0/0 00000100:00100000:0.0:1651529391.289353:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212642 00010000:00010000:0.0:1651529391.289365:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007126e775/0x3234de053c53281 lrc: 2/0,0 mode: PW/PW res: [0x2bb5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.289369:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007126e775 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529391.289370:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007126e775/0x3234de053c53281 lrc: 2/0,0 mode: PW/PW res: [0x2bb5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.289373:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007126e775/0x3234de053c53281 lrc: 3/0,0 mode: PW/PW res: [0x2bb5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.289378:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007126e775/0x3234de053c53281 lrc: 1/0,0 mode: --/PW res: [0x2bb5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.289380:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007126e775/0x3234de053c53281 lrc: 0/0,0 mode: --/PW res: [0x2bb5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.289383:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+35:39029:x1731745946593088:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 62us (200us total) trans 12885080646 rc 0/0 00010000:00010000:0.0:1651529391.289385:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c53288 lrc: 2/0,0 mode: PW/PW res: [0x2bb5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.289386:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212643 00010000:00010000:0.0:1651529391.289388:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d9cfe902 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529391.289388:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c53288 lrc: 2/0,0 mode: PW/PW res: [0x2bb5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.289393:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c53288 lrc: 3/0,0 mode: PW/PW res: [0x2bb5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289394:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059de8c3d/0x3234de053c5328f lrc: 2/0,0 mode: PW/PW res: [0x2bb5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.289397:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c53288 lrc: 1/0,0 mode: --/PW res: [0x2bb5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289399:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000059de8c3d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529391.289399:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c53288 lrc: 0/0,0 mode: --/PW res: [0x2bb5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289400:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059de8c3d/0x3234de053c5328f lrc: 2/0,0 mode: PW/PW res: [0x2bb5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289403:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059de8c3d/0x3234de053c5328f lrc: 3/0,0 mode: PW/PW res: [0x2bb5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289408:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059de8c3d/0x3234de053c5328f lrc: 1/0,0 mode: --/PW res: [0x2bb5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289410:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059de8c3d/0x3234de053c5328f lrc: 0/0,0 mode: --/PW res: [0x2bb5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.289432:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529391.289443:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946593024 00000100:00100000:0.0:1651529391.289456:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212644 00000100:00100000:0.0:1651529391.289458:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+35:39029:x1731745946593024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529391.289463:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179038 count 1 00002000:00010000:0.0:1651529391.289468:0:72395:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb5e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529391.289469:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c53296 lrc: 3/0,1 mode: --/PW res: [0x2bb5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.289473:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.289473:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.289474:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c53296 lrc: 3/0,1 mode: PW/PW res: [0x2bb5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.289478:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c53296 lrc: 3/0,1 mode: PW/PW res: [0x2bb5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.289481:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c53296 lrc: 3/0,1 mode: PW/PW res: [0x2bb5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.289484:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c53296 lrc: 2/0,0 mode: PW/PW res: [0x2bb5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.289545:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+36:39029:x1731745946593024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 86us (112us total) trans 12885080647 rc 0/0 00000100:00100000:0.0:1651529391.289548:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212644 00010000:00010000:0.0:1651529391.289556:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c53296 lrc: 2/0,0 mode: PW/PW res: [0x2bb5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.289559:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000009fe5580 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529391.289560:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c53296 lrc: 2/0,0 mode: PW/PW res: [0x2bb5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.289563:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c53296 lrc: 3/0,0 mode: PW/PW res: [0x2bb5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.289568:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c53296 lrc: 1/0,0 mode: --/PW res: [0x2bb5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.289571:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c53296 lrc: 0/0,0 mode: --/PW res: [0x2bb5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.289584:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529391.289592:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529391.289598:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529391.289607:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946593152 00000100:00100000:0.0:1651529391.289608:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529391.289617:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946593280 00000100:00100000:1.0:1651529391.289621:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946593216 00000100:00100000:0.0:1651529391.289624:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946593344 00000100:00100000:1.0:1651529391.289627:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212645 00000100:00100000:1.0:1651529391.289629:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:39030:x1731745946593152:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529391.289634:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179040 count 1 00000100:00100000:0.0:1651529391.289635:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212646 00000100:00100000:0.0:1651529391.289637:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+39:39030:x1731745946593280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00010000:1.0:1651529391.289640:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb60:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.289641:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5329d lrc: 3/0,1 mode: --/PW res: [0x2bb60:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529391.289642:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179042 count 1 00010000:00010000:1.0:1651529391.289645:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.289646:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.289647:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5329d lrc: 3/0,1 mode: PW/PW res: [0x2bb60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529391.289648:0:106695:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb62:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529391.289649:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c532a4 lrc: 3/0,1 mode: --/PW res: [0x2bb62:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289653:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5329d lrc: 3/0,1 mode: PW/PW res: [0x2bb60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289656:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5329d lrc: 3/0,1 mode: PW/PW res: [0x2bb60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289658:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5329d lrc: 2/0,0 mode: PW/PW res: [0x2bb60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.289678:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.289679:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.289680:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c532a4 lrc: 3/0,1 mode: PW/PW res: [0x2bb62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.289684:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c532a4 lrc: 3/0,1 mode: PW/PW res: [0x2bb62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.289707:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c532a4 lrc: 3/0,1 mode: PW/PW res: [0x2bb62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.289716:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c532a4 lrc: 2/0,0 mode: PW/PW res: [0x2bb62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.289717:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:39030:x1731745946593152:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 87us (132us total) trans 12885080648 rc 0/0 00000100:00100000:1.0:1651529391.289721:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212645 00000100:00100000:1.0:1651529391.289731:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212647 00000100:00100000:1.0:1651529391.289733:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:39030:x1731745946593216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529391.289738:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179041 count 1 00002000:00010000:1.0:1651529391.289742:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb61:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.289744:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c532ab lrc: 3/0,1 mode: --/PW res: [0x2bb61:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289748:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.289748:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.289749:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c532ab lrc: 3/0,1 mode: PW/PW res: [0x2bb61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289753:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c532ab lrc: 3/0,1 mode: PW/PW res: [0x2bb61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289770:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c532ab lrc: 3/0,1 mode: PW/PW res: [0x2bb61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289773:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c532ab lrc: 2/0,0 mode: PW/PW res: [0x2bb61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.289793:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:39030:x1731745946593280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 154us (200us total) trans 12885080649 rc 0/0 00000100:00100000:0.0:1651529391.289796:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212646 00000100:00100000:0.0:1651529391.289801:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212648 00000100:00100000:0.0:1651529391.289803:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:39030:x1731745946593344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529391.289808:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179043 count 1 00002000:00010000:0.0:1651529391.289813:0:106695:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb63:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529391.289814:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c532b2 lrc: 3/0,1 mode: --/PW res: [0x2bb63:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.289816:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:39030:x1731745946593216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 82us (217us total) trans 12885080650 rc 0/0 00010000:00010000:0.0:1651529391.289818:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529391.289819:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212647 00010000:00010000:0.0:1651529391.289819:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.289819:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c532b2 lrc: 3/0,1 mode: PW/PW res: [0x2bb63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.289823:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c532b2 lrc: 3/0,1 mode: PW/PW res: [0x2bb63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289826:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5329d lrc: 2/0,0 mode: PW/PW res: [0x2bb60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.289826:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c532b2 lrc: 3/0,1 mode: PW/PW res: [0x2bb63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289829:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000029958df2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529391.289829:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c532b2 lrc: 2/0,0 mode: PW/PW res: [0x2bb63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289830:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5329d lrc: 2/0,0 mode: PW/PW res: [0x2bb60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289833:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5329d lrc: 3/0,0 mode: PW/PW res: [0x2bb60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289838:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5329d lrc: 1/0,0 mode: --/PW res: [0x2bb60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289841:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5329d lrc: 0/0,0 mode: --/PW res: [0x2bb60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289845:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c532a4 lrc: 2/0,0 mode: PW/PW res: [0x2bb62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289848:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042bde05b already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529391.289849:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c532a4 lrc: 2/0,0 mode: PW/PW res: [0x2bb62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289852:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c532a4 lrc: 3/0,0 mode: PW/PW res: [0x2bb62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289855:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c532a4 lrc: 1/0,0 mode: --/PW res: [0x2bb62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289857:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c532a4 lrc: 0/0,0 mode: --/PW res: [0x2bb62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289861:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c532ab lrc: 2/0,0 mode: PW/PW res: [0x2bb61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289864:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000feb9d3da already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529391.289864:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c532ab lrc: 2/0,0 mode: PW/PW res: [0x2bb61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.289864:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:39030:x1731745946593344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 60us (255us total) trans 12885080651 rc 0/0 00010000:00010000:1.0:1651529391.289867:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c532ab lrc: 3/0,0 mode: PW/PW res: [0x2bb61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.289867:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212648 00010000:00010000:1.0:1651529391.289870:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c532ab lrc: 1/0,0 mode: --/PW res: [0x2bb61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289872:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c532ab lrc: 0/0,0 mode: --/PW res: [0x2bb61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289876:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c532b2 lrc: 2/0,0 mode: PW/PW res: [0x2bb63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289879:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c822bd1c already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529391.289879:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c532b2 lrc: 2/0,0 mode: PW/PW res: [0x2bb63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289882:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c532b2 lrc: 3/0,0 mode: PW/PW res: [0x2bb63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289885:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c532b2 lrc: 1/0,0 mode: --/PW res: [0x2bb63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.289886:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529391.289887:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c532b2 lrc: 0/0,0 mode: --/PW res: [0x2bb63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.289912:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946593984 00000100:00100000:1.0:1651529391.289915:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529391.289924:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946593920 00000100:00100000:1.0:1651529391.289926:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529391.289934:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946594048 00000100:00100000:1.0:1651529391.289936:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529391.289948:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946594112 00000100:00100000:0.0:1651529391.289954:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212649 00000100:00100000:0.0:1651529391.289955:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+43:39029:x1731745946593984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529391.289956:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212650 00000100:00100000:1.0:1651529391.289958:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+43:39029:x1731745946593920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529391.289960:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179045 count 1 00002000:00080000:1.0:1651529391.289963:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179044 count 1 00002000:00010000:0.0:1651529391.289966:0:80278:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb65:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:1.0:1651529391.289968:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb64:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529391.289968:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c532b9 lrc: 3/0,1 mode: --/PW res: [0x2bb65:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289970:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c532c0 lrc: 3/0,1 mode: --/PW res: [0x2bb64:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.289971:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.289972:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.289973:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c532b9 lrc: 3/0,1 mode: PW/PW res: [0x2bb65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289976:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.289976:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.289976:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c532b9 lrc: 3/0,1 mode: PW/PW res: [0x2bb65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289977:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c532c0 lrc: 3/0,1 mode: PW/PW res: [0x2bb64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.289979:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c532b9 lrc: 3/0,1 mode: PW/PW res: [0x2bb65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289981:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c532c0 lrc: 3/0,1 mode: PW/PW res: [0x2bb64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.289982:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c532b9 lrc: 2/0,0 mode: PW/PW res: [0x2bb65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289984:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c532c0 lrc: 3/0,1 mode: PW/PW res: [0x2bb64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.289986:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c532c0 lrc: 2/0,0 mode: PW/PW res: [0x2bb64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.290030:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+45:39029:x1731745946593984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 73us (143us total) trans 12885080652 rc 0/0 00000100:00100000:1.0:1651529391.290032:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:39029:x1731745946593920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 73us (116us total) trans 12885080653 rc 0/0 00000100:00100000:0.0:1651529391.290033:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212649 00000100:00100000:1.0:1651529391.290035:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212650 00000100:00100000:0.0:1651529391.290038:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212651 00000100:00100000:0.0:1651529391.290039:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+43:39030:x1731745946594048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529391.290040:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212652 00000100:00100000:1.0:1651529391.290042:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+43:39030:x1731745946594112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529391.290044:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179046 count 1 00002000:00080000:1.0:1651529391.290047:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179047 count 1 00002000:00010000:0.0:1651529391.290048:0:80278:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb66:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529391.290050:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c532c7 lrc: 3/0,1 mode: --/PW res: [0x2bb66:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529391.290051:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb67:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.290053:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c532ce lrc: 3/0,1 mode: --/PW res: [0x2bb67:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290056:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.290056:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.290056:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.290057:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.290057:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c532c7 lrc: 3/0,1 mode: PW/PW res: [0x2bb66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290058:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c532ce lrc: 3/0,1 mode: PW/PW res: [0x2bb67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290061:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c532c7 lrc: 3/0,1 mode: PW/PW res: [0x2bb66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290062:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c532ce lrc: 3/0,1 mode: PW/PW res: [0x2bb67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290064:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c532c7 lrc: 3/0,1 mode: PW/PW res: [0x2bb66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290065:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c532ce lrc: 3/0,1 mode: PW/PW res: [0x2bb67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290066:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c532c7 lrc: 2/0,0 mode: PW/PW res: [0x2bb66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290067:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c532ce lrc: 2/0,0 mode: PW/PW res: [0x2bb67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.290107:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+45:39030:x1731745946594048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 67us (181us total) trans 12885080654 rc 0/0 00000100:00100000:0.0:1651529391.290110:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212651 00000100:00100000:1.0:1651529391.290112:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:39030:x1731745946594112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 69us (175us total) trans 12885080655 rc 0/0 00000100:00100000:1.0:1651529391.290115:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212652 00010000:00010000:0.0:1651529391.290120:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c532b9 lrc: 2/0,0 mode: PW/PW res: [0x2bb65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290122:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c532c0 lrc: 2/0,0 mode: PW/PW res: [0x2bb64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290124:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002f450f42 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529391.290125:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000090e99444 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529391.290125:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c532b9 lrc: 2/0,0 mode: PW/PW res: [0x2bb65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290126:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c532c0 lrc: 2/0,0 mode: PW/PW res: [0x2bb64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290128:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c532b9 lrc: 3/0,0 mode: PW/PW res: [0x2bb65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290129:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c532c0 lrc: 3/0,0 mode: PW/PW res: [0x2bb64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290134:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c532c0 lrc: 1/0,0 mode: --/PW res: [0x2bb64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290135:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c532b9 lrc: 1/0,0 mode: --/PW res: [0x2bb65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290136:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c532c0 lrc: 0/0,0 mode: --/PW res: [0x2bb64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290138:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c532b9 lrc: 0/0,0 mode: --/PW res: [0x2bb65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290141:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c532c7 lrc: 2/0,0 mode: PW/PW res: [0x2bb66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290142:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c532ce lrc: 2/0,0 mode: PW/PW res: [0x2bb67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290144:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005b8e72f9 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529391.290145:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c532c7 lrc: 2/0,0 mode: PW/PW res: [0x2bb66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290145:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e48e0bfd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529391.290146:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c532ce lrc: 2/0,0 mode: PW/PW res: [0x2bb67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290147:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c532c7 lrc: 3/0,0 mode: PW/PW res: [0x2bb66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290149:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c532ce lrc: 3/0,0 mode: PW/PW res: [0x2bb67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290150:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c532c7 lrc: 1/0,0 mode: --/PW res: [0x2bb66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290152:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c532ce lrc: 1/0,0 mode: --/PW res: [0x2bb67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290153:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c532c7 lrc: 0/0,0 mode: --/PW res: [0x2bb66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290155:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c532ce lrc: 0/0,0 mode: --/PW res: [0x2bb67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.290394:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529391.290405:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946594688 00000100:00100000:0.0:1651529391.290414:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212653 00000100:00100000:0.0:1651529391.290415:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+44:39030:x1731745946594688:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529391.290420:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179048 count 1 00002000:00010000:0.0:1651529391.290426:0:72395:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb68:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529391.290427:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c532d5 lrc: 3/0,1 mode: --/PW res: [0x2bb68:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290431:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.290432:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.290433:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c532d5 lrc: 3/0,1 mode: PW/PW res: [0x2bb68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290436:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c532d5 lrc: 3/0,1 mode: PW/PW res: [0x2bb68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290464:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c532d5 lrc: 3/0,1 mode: PW/PW res: [0x2bb68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290467:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c532d5 lrc: 2/0,0 mode: PW/PW res: [0x2bb68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290478:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c532d5 lrc: 2/0,0 mode: PW/PW res: [0x2bb68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290481:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005e711cee already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529391.290482:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c532d5 lrc: 2/0,0 mode: PW/PW res: [0x2bb68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290485:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c532d5 lrc: 3/0,0 mode: PW/PW res: [0x2bb68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290492:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c532d5 lrc: 1/0,0 mode: --/PW res: [0x2bb68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290495:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c532d5 lrc: 0/0,0 mode: --/PW res: [0x2bb68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.290527:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:39030:x1731745946594688:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 111us (133us total) trans 12885080656 rc 0/0 00000100:00100000:0.0:1651529391.290538:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212653 00000100:00100000:1.0:1651529391.290578:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529391.290589:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529391.290597:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529391.290604:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946594752 00000100:00100000:1.0:1651529391.290607:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529391.290620:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529391.290620:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946594880 00000100:00100000:1.0:1651529391.290630:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529391.290636:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946595008 00000100:00100000:1.0:1651529391.290639:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529391.290646:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946595136 00000100:00100000:1.0:1651529391.290648:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946594816 00000100:00100000:0.0:1651529391.290651:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946594944 00000100:00100000:1.0:1651529391.290657:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946595072 00000100:00100000:1.0:1651529391.290661:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212654 00000100:00100000:1.0:1651529391.290663:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+51:39030:x1731745946594752:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529391.290663:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212655 00000100:00100000:0.0:1651529391.290665:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+51:39029:x1731745946594880:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529391.290668:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179049 count 1 00002000:00080000:0.0:1651529391.290671:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179051 count 1 00002000:00010000:1.0:1651529391.290673:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb69:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.290675:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c532dc lrc: 3/0,1 mode: --/PW res: [0x2bb69:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529391.290676:0:80280:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb6b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.290678:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.290678:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c532e3 lrc: 3/0,1 mode: --/PW res: [0x2bb6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290679:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.290680:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c532dc lrc: 3/0,1 mode: PW/PW res: [0x2bb69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290681:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.290682:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.290683:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c532e3 lrc: 3/0,1 mode: PW/PW res: [0x2bb6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290686:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c532dc lrc: 3/0,1 mode: PW/PW res: [0x2bb69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290687:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c532e3 lrc: 3/0,1 mode: PW/PW res: [0x2bb6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290689:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c532dc lrc: 3/0,1 mode: PW/PW res: [0x2bb69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290690:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c532e3 lrc: 3/0,1 mode: PW/PW res: [0x2bb6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290692:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c532dc lrc: 2/0,0 mode: PW/PW res: [0x2bb69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290692:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c532e3 lrc: 2/0,0 mode: PW/PW res: [0x2bb6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.290738:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+53:39030:x1731745946594752:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 74us (160us total) trans 12885080657 rc 0/0 00000100:00100000:1.0:1651529391.290741:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212654 00000100:00100000:1.0:1651529391.290746:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212656 00000100:00100000:1.0:1651529391.290748:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+52:39029:x1731745946595008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529391.290772:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179053 count 1 00002000:00010000:1.0:1651529391.290778:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb6d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.290780:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c532ea lrc: 3/0,1 mode: --/PW res: [0x2bb6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290783:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.290784:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.290785:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c532ea lrc: 3/0,1 mode: PW/PW res: [0x2bb6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.290785:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+52:39029:x1731745946594880:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 118us (195us total) trans 12885080658 rc 0/0 00010000:00010000:1.0:1651529391.290788:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c532ea lrc: 3/0,1 mode: PW/PW res: [0x2bb6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.290788:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212655 00000100:00100000:0.0:1651529391.290793:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212657 00010000:00010000:1.0:1651529391.290794:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c532ea lrc: 3/0,1 mode: PW/PW res: [0x2bb6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.290795:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046772bfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+51:39029:x1731745946595136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529391.290796:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c532ea lrc: 2/0,0 mode: PW/PW res: [0x2bb6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529391.290799:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179055 count 1 00002000:00010000:0.0:1651529391.290804:0:80280:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb6f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529391.290806:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c532f1 lrc: 3/0,1 mode: --/PW res: [0x2bb6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290812:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.290813:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.290813:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c532f1 lrc: 3/0,1 mode: PW/PW res: [0x2bb6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290817:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c532f1 lrc: 3/0,1 mode: PW/PW res: [0x2bb6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290820:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c532f1 lrc: 3/0,1 mode: PW/PW res: [0x2bb6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290822:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c532f1 lrc: 2/0,0 mode: PW/PW res: [0x2bb6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.290835:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+52:39029:x1731745946595008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 86us (237us total) trans 12885080659 rc 0/0 00000100:00100000:1.0:1651529391.290837:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212656 00000100:00100000:1.0:1651529391.290843:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212658 00000100:00100000:1.0:1651529391.290844:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+52:39029:x1731745946594816:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529391.290848:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179050 count 1 00002000:00010000:1.0:1651529391.290853:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb6a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.290854:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c532f8 lrc: 3/0,1 mode: --/PW res: [0x2bb6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.290857:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046772bfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+52:39029:x1731745946595136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 61us (250us total) trans 12885080660 rc 0/0 00010000:00010000:1.0:1651529391.290858:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.290858:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.290859:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c532f8 lrc: 3/0,1 mode: PW/PW res: [0x2bb6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.290860:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212657 00010000:00010000:1.0:1651529391.290863:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c532f8 lrc: 3/0,1 mode: PW/PW res: [0x2bb6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290865:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c532f8 lrc: 3/0,1 mode: PW/PW res: [0x2bb6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290870:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c532f8 lrc: 2/0,0 mode: PW/PW res: [0x2bb6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.290878:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212659 00000100:00100000:0.0:1651529391.290880:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+51:39029:x1731745946594944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529391.290884:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179052 count 1 00002000:00010000:0.0:1651529391.290888:0:80280:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb6c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529391.290890:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c532ff lrc: 3/0,1 mode: --/PW res: [0x2bb6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290894:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.290894:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.290895:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c532ff lrc: 3/0,1 mode: PW/PW res: [0x2bb6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290899:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c532ff lrc: 3/0,1 mode: PW/PW res: [0x2bb6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290902:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c532ff lrc: 3/0,1 mode: PW/PW res: [0x2bb6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.290903:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+52:39029:x1731745946594816:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 58us (287us total) trans 12885080661 rc 0/0 00010000:00010000:0.0:1651529391.290904:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c532ff lrc: 2/0,0 mode: PW/PW res: [0x2bb6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.290905:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212658 00000100:00100000:1.0:1651529391.290910:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212660 00000100:00100000:1.0:1651529391.290912:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+51:39029:x1731745946595072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529391.290916:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179054 count 1 00002000:00010000:1.0:1651529391.290920:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb6e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.290921:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53306 lrc: 3/0,1 mode: --/PW res: [0x2bb6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290925:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.290925:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.290926:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53306 lrc: 3/0,1 mode: PW/PW res: [0x2bb6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290929:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53306 lrc: 3/0,1 mode: PW/PW res: [0x2bb6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290933:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53306 lrc: 3/0,1 mode: PW/PW res: [0x2bb6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290935:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53306 lrc: 2/0,0 mode: PW/PW res: [0x2bb6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.290937:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+52:39029:x1731745946594944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 57us (307us total) trans 12885080662 rc 0/0 00000100:00100000:0.0:1651529391.290940:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212659 00010000:00010000:0.0:1651529391.290951:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c532dc lrc: 2/0,0 mode: PW/PW res: [0x2bb69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290954:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dd6b1be4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529391.290955:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c532dc lrc: 2/0,0 mode: PW/PW res: [0x2bb69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290958:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c532dc lrc: 3/0,0 mode: PW/PW res: [0x2bb69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290962:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c532dc lrc: 1/0,0 mode: --/PW res: [0x2bb69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290965:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c532dc lrc: 0/0,0 mode: --/PW res: [0x2bb69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.290969:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+52:39029:x1731745946595072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 56us (330us total) trans 12885080663 rc 0/0 00010000:00010000:0.0:1651529391.290970:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c532e3 lrc: 2/0,0 mode: PW/PW res: [0x2bb6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.290972:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212660 00010000:00010000:0.0:1651529391.290972:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b0407aaf already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529391.290973:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c532e3 lrc: 2/0,0 mode: PW/PW res: [0x2bb6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290976:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c532e3 lrc: 3/0,0 mode: PW/PW res: [0x2bb6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290979:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c532ea lrc: 2/0,0 mode: PW/PW res: [0x2bb6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290979:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c532e3 lrc: 1/0,0 mode: --/PW res: [0x2bb6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290982:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006cbd0d09 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529391.290982:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c532e3 lrc: 0/0,0 mode: --/PW res: [0x2bb6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290983:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c532ea lrc: 2/0,0 mode: PW/PW res: [0x2bb6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290985:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c532f1 lrc: 2/0,0 mode: PW/PW res: [0x2bb6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290986:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c532ea lrc: 3/0,0 mode: PW/PW res: [0x2bb6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290988:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000a7c37b9 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529391.290988:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c532f1 lrc: 2/0,0 mode: PW/PW res: [0x2bb6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290991:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c532ea lrc: 1/0,0 mode: --/PW res: [0x2bb6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290991:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c532f1 lrc: 3/0,0 mode: PW/PW res: [0x2bb6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290993:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c532ea lrc: 0/0,0 mode: --/PW res: [0x2bb6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290994:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c532f1 lrc: 1/0,0 mode: --/PW res: [0x2bb6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.290997:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c532f1 lrc: 0/0,0 mode: --/PW res: [0x2bb6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.290998:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c532f8 lrc: 2/0,0 mode: PW/PW res: [0x2bb6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.291000:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c532ff lrc: 2/0,0 mode: PW/PW res: [0x2bb6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291001:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba437fe0 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529391.291001:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c532f8 lrc: 2/0,0 mode: PW/PW res: [0x2bb6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.291003:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000082ae179c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529391.291004:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c532ff lrc: 2/0,0 mode: PW/PW res: [0x2bb6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.291006:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c532ff lrc: 3/0,0 mode: PW/PW res: [0x2bb6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291007:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c532f8 lrc: 3/0,0 mode: PW/PW res: [0x2bb6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.291009:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c532ff lrc: 1/0,0 mode: --/PW res: [0x2bb6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291010:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c532f8 lrc: 1/0,0 mode: --/PW res: [0x2bb6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.291012:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c532ff lrc: 0/0,0 mode: --/PW res: [0x2bb6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291013:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c532f8 lrc: 0/0,0 mode: --/PW res: [0x2bb6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.291015:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53306 lrc: 2/0,0 mode: PW/PW res: [0x2bb6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.291018:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000014fe598c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529391.291018:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53306 lrc: 2/0,0 mode: PW/PW res: [0x2bb6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.291024:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53306 lrc: 3/0,0 mode: PW/PW res: [0x2bb6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.291027:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529391.291027:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53306 lrc: 1/0,0 mode: --/PW res: [0x2bb6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.291029:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53306 lrc: 0/0,0 mode: --/PW res: [0x2bb6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.291037:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946595520 00000100:00100000:0.0:1651529391.291043:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212661 00000100:00100000:0.0:1651529391.291045:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+52:39029:x1731745946595520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529391.291049:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179056 count 1 00002000:00010000:0.0:1651529391.291053:0:106695:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb70:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529391.291055:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c5330d lrc: 3/0,1 mode: --/PW res: [0x2bb70:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.291058:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.291059:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.291059:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c5330d lrc: 3/0,1 mode: PW/PW res: [0x2bb70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.291063:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c5330d lrc: 3/0,1 mode: PW/PW res: [0x2bb70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.291066:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c5330d lrc: 3/0,1 mode: PW/PW res: [0x2bb70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.291071:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c5330d lrc: 2/0,0 mode: PW/PW res: [0x2bb70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.291111:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+53:39029:x1731745946595520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 66us (85us total) trans 12885080664 rc 0/0 00000100:00100000:0.0:1651529391.291114:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212661 00010000:00010000:1.0:1651529391.291139:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c5330d lrc: 2/0,0 mode: PW/PW res: [0x2bb70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291143:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000036d87bb6 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529391.291144:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c5330d lrc: 2/0,0 mode: PW/PW res: [0x2bb70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291147:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c5330d lrc: 3/0,0 mode: PW/PW res: [0x2bb70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291151:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c5330d lrc: 1/0,0 mode: --/PW res: [0x2bb70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291154:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c5330d lrc: 0/0,0 mode: --/PW res: [0x2bb70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529391.291285:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529391.291295:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946595584 00000100:00100000:1.0:1651529391.291306:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212662 00000100:00100000:1.0:1651529391.291307:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+53:39029:x1731745946595584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529391.291313:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179057 count 1 00002000:00010000:1.0:1651529391.291318:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb71:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.291320:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c53314 lrc: 3/0,1 mode: --/PW res: [0x2bb71:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291323:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.291324:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.291340:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c53314 lrc: 3/0,1 mode: PW/PW res: [0x2bb71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291344:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c53314 lrc: 3/0,1 mode: PW/PW res: [0x2bb71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291347:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c53314 lrc: 3/0,1 mode: PW/PW res: [0x2bb71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291350:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c53314 lrc: 2/0,0 mode: PW/PW res: [0x2bb71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.291361:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c53314 lrc: 2/0,0 mode: PW/PW res: [0x2bb71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.291365:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000066921086 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529391.291366:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c53314 lrc: 2/0,0 mode: PW/PW res: [0x2bb71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.291369:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c53314 lrc: 3/0,0 mode: PW/PW res: [0x2bb71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.291375:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c53314 lrc: 1/0,0 mode: --/PW res: [0x2bb71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.291377:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c53314 lrc: 0/0,0 mode: --/PW res: [0x2bb71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.291394:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+54:39029:x1731745946595584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 86us (109us total) trans 12885080665 rc 0/0 00000100:00100000:1.0:1651529391.291397:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212662 00000100:00100000:0.0:1651529391.291403:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529391.291443:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946595712 00000100:00100000:0.0:1651529391.291445:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529391.291453:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946595648 00000100:00100000:1.0:1651529391.291460:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212663 00000100:00100000:1.0:1651529391.291461:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+55:39030:x1731745946595712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529391.291465:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212664 00000100:00100000:0.0:1651529391.291467:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+55:39030:x1731745946595648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529391.291468:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179059 count 1 00002000:00010000:1.0:1651529391.291473:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb73:0x0] initial LVB size: 0, mtime: 0x627056ac, atime: 0x627056ac, ctime: 0x627056ac, blocks: 0x0 00002000:00080000:0.0:1651529391.291473:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179058 count 1 00010000:00010000:1.0:1651529391.291475:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5331b lrc: 3/0,1 mode: --/PW res: [0x2bb73:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291478:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00010000:0.0:1651529391.291478:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb72:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529391.291479:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529391.291480:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5331b lrc: 3/0,1 mode: PW/PW res: [0x2bb73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.291480:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53322 lrc: 3/0,1 mode: --/PW res: [0x2bb72:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291483:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5331b lrc: 3/0,1 mode: PW/PW res: [0x2bb73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.291484:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.291484:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529391.291485:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53322 lrc: 3/0,1 mode: PW/PW res: [0x2bb72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291486:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5331b lrc: 3/0,1 mode: PW/PW res: [0x2bb73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291489:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5331b lrc: 2/0,0 mode: PW/PW res: [0x2bb73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.291489:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53322 lrc: 3/0,1 mode: PW/PW res: [0x2bb72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.291492:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53322 lrc: 3/0,1 mode: PW/PW res: [0x2bb72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.291495:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53322 lrc: 2/0,0 mode: PW/PW res: [0x2bb72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529391.291538:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+57:39030:x1731745946595712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 75us (134us total) trans 12885080666 rc 0/0 00000100:00100000:1.0:1651529391.291541:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212663 00000100:00100000:0.0:1651529391.291544:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+56:39030:x1731745946595648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 76us (99us total) trans 12885080667 rc 0/0 00000100:00100000:0.0:1651529391.291547:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212664 00010000:00010000:1.0:1651529391.291548:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5331b lrc: 2/0,0 mode: PW/PW res: [0x2bb73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291551:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004b2a6b06 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529391.291552:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5331b lrc: 2/0,0 mode: PW/PW res: [0x2bb73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.291555:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53322 lrc: 2/0,0 mode: PW/PW res: [0x2bb72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291558:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5331b lrc: 3/0,0 mode: PW/PW res: [0x2bb73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.291558:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000916cff2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529391.291559:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53322 lrc: 2/0,0 mode: PW/PW res: [0x2bb72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291562:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5331b lrc: 1/0,0 mode: --/PW res: [0x2bb73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.291563:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53322 lrc: 3/0,0 mode: PW/PW res: [0x2bb72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529391.291565:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5331b lrc: 0/0,0 mode: --/PW res: [0x2bb73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.291567:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53322 lrc: 1/0,0 mode: --/PW res: [0x2bb72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529391.291570:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53322 lrc: 0/0,0 mode: --/PW res: [0x2bb72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1651529391.479368:0:72382:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 12885080625 is committed 00000001:00080000:0.0:1651529391.479377:0:72382:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 12885080617 is committed 00000400:00000080:1.0:1651529392.613126:0:158230:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651529392.613128:0:158230:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 127b: verify the llite client stats are sane ========================================================== 22:09:52 (1651529392) 00000100:00100000:0.0:1651529392.665966:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529392.665983:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396558720 00000100:00100000:0.0:1651529392.666001:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212665 00000100:00100000:0.0:1651529392.666004:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:414491:x1731746396558720:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529392.666013:0:72395:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529392.666024:0:72395:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53329 lrc: 2/0,0 mode: --/PW res: [0x2bb74:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da545 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529392.666036:0:72395:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb74:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529392.666046:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529392.666046:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529392.666052:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53329 lrc: 3/0,0 mode: PW/PW res: [0x2bb74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da545 expref: 6 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529392.666060:0:72395:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53329 lrc: 3/0,0 mode: PW/PW res: [0x2bb74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da545 expref: 6 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529392.666069:0:72395:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000916cff2, rc 0) 00000100:00100000:0.0:1651529392.666096:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:414491:x1731746396558720:12345-10.240.43.64@tcp:101:dd.0 Request processed in 92us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529392.666100:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212665 00000100:00100000:0.0:1651529392.669802:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529392.669843:0:77219:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396559232 00002000:00010000:1.0:1651529392.669868:0:77219:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179060/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529392.669870:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009a9e254e with x1731746396559232 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529392.669874:0:77219:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000009a9e254e. 00000100:00100000:1.0:1651529392.669892:0:77219:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18655 00000100:00100000:1.0:1651529392.669894:0:77219:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:41278:x1731746396559232:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529392.669976:0:77219:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bb74:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529392.669978:0:77219:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bb74:0x0] updating lvb mtime from disk: 0 -> 1651529392 00002000:00010000:1.0:1651529392.669979:0:77219:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bb74:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529392.669979:0:77219:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bb74:0x0] updating lvb ctime from disk: 0 -> 1651529392 00002000:00010000:1.0:1651529392.669980:0:77219:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bb74:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529392.669995:0:77219:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a9e254e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+7:41278:x1731746396559232:12345-10.240.43.64@tcp:10:dd.0 Request processed in 101us (194us total) trans 12885080668 rc 0/0 00000100:00100000:1.0:1651529392.669999:0:77219:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18655 00002000:00010000:1.0:1651529392.670000:0:77219:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179060/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529392.670001:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009a9e254e with x1731746396559232 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529392.670003:0:77219:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000009a9e254e. 00000100:00100000:0.0:1651529392.675775:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529392.675800:0:77218:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396559424 00002000:00100000:1.0:1651529392.675825:0:77218:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x2bb74:0x0] (0->4095) req@00000000dff6a73d x1731746396559424/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:118/0 lens 4584/0 e 0 to 0 dl 1651529398 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529392.675834:0:77218:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000dff6a73d with x1731746396559424 ext(0->4095) 00002000:00010000:1.0:1651529392.675836:0:77218:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000dff6a73d 00000100:00100000:1.0:1651529392.675844:0:77218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18656 00000100:00100000:1.0:1651529392.675845:0:77218:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+7:41278:x1731746396559424:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529392.676255:0:77218:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dff6a73d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+9:41278:x1731746396559424:12345-10.240.43.64@tcp:4:dd.0 Request processed in 408us (481us total) trans 12885080669 rc 0/0 00000100:00100000:1.0:1651529392.676259:0:77218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18656 00002000:00100000:1.0:1651529392.676262:0:77218:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x2bb74:0x0] (0->4095) req@00000000dff6a73d x1731746396559424/t12885080669(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:118/0 lens 4584/448 e 0 to 0 dl 1651529398 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529392.676267:0:77218:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000dff6a73d with x1731746396559424 ext(0->4095) 00002000:00010000:1.0:1651529392.676268:0:77218:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000dff6a73d 00000100:00100000:0.0:1651529392.676497:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529392.676506:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396559488 00000100:00100000:0.0:1651529392.676524:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 149 00000100:00100000:0.0:1651529392.676526:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+9:347569:x1731746396559488:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529392.676530:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1651529392.676534:0:72388:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bb74:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:0.0:1651529392.676535:0:72388:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bb74:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1651529392.676542:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53329 lrc: 0/0,0 mode: --/PW res: [0x2bb74:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da545 expref: 9 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529392.676548:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529392.676562:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+8:347569:x1731746396559488:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 36us (66us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529392.676566:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 149 00000100:00100000:0.0:1651529392.683257:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529392.683265:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396559680 00000100:00100000:0.0:1651529392.683272:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212666 00000100:00100000:0.0:1651529392.683274:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+8:414496:x1731746396559680:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529392.683278:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529392.683282:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c53330 lrc: 2/0,0 mode: --/PR res: [0x2bb74:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da561 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529392.683288:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb74:0x0] initial LVB size: 4096, mtime: 0x627056b0, atime: 0x0, ctime: 0x627056b0, blocks: 0x8 00010000:00010000:0.0:1651529392.683292:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529392.683293:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529392.683295:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c53330 lrc: 3/0,0 mode: PR/PR res: [0x2bb74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da561 expref: 9 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529392.683300:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c53330 lrc: 3/0,0 mode: PR/PR res: [0x2bb74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da561 expref: 9 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529392.683304:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000082ae179c, rc 0) 00000100:00100000:0.0:1651529392.683320:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+9:414496:x1731746396559680:12345-10.240.43.64@tcp:101:dd.0 Request processed in 45us (63us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529392.683323:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212666 00000100:00100000:0.0:1651529392.683602:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529392.683624:0:77218:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396559808 00002000:00100000:1.0:1651529392.683632:0:77218:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x2bb74:0x0] (0->4095) req@00000000673bcbe2 x1731746396559808/t0(0) o3->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:118/0 lens 488/0 e 0 to 0 dl 1651529398 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529392.683637:0:77218:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000673bcbe2 with x1731746396559808 ext(0->4095) 00002000:00010000:1.0:1651529392.683638:0:77218:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000673bcbe2 00000100:00100000:1.0:1651529392.683643:0:77218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18657 00000100:00100000:1.0:1651529392.683645:0:77218:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+9:41278:x1731746396559808:12345-10.240.43.64@tcp:3:dd.0 00000100:00100000:1.0:1651529392.683696:0:77218:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000673bcbe2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+9:41278:x1731746396559808:12345-10.240.43.64@tcp:3:dd.0 Request processed in 50us (94us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1651529392.683700:0:77218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18657 00002000:00100000:1.0:1651529392.683702:0:77218:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x2bb74:0x0] (0->4095) req@00000000673bcbe2 x1731746396559808/t0(0) o3->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:118/0 lens 488/4536 e 0 to 0 dl 1651529398 ref 1 fl Complete:/0/0 rc 4096/4096 job:'dd.0' 00002000:00100000:1.0:1651529392.683705:0:77218:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000673bcbe2 with x1731746396559808 ext(0->4095) 00002000:00010000:1.0:1651529392.683707:0:77218:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000673bcbe2 00000400:00000080:0.0:1651529393.943963:0:158449:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651529393.943966:0:158449:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 127c: test llite extent stats with regular 00000100:00100000:0.0:1651529393.978330:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529393.978347:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396560832 00000100:00100000:0.0:1651529393.978366:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212667 00000100:00100000:0.0:1651529393.978369:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+9:415096:x1731746396560832:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529393.978378:0:72395:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529393.978389:0:72395:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53337 lrc: 2/0,0 mode: --/PW res: [0x2bb75:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da58b expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529393.978400:0:72395:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb75:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529393.978410:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529393.978411:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529393.978415:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53337 lrc: 3/0,0 mode: PW/PW res: [0x2bb75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da58b expref: 10 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529393.978423:0:72395:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53337 lrc: 3/0,0 mode: PW/PW res: [0x2bb75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da58b expref: 10 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529393.978429:0:72395:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000916cff2, rc 0) 00000100:00100000:0.0:1651529393.978455:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+10:415096:x1731746396560832:12345-10.240.43.64@tcp:101:dd.0 Request processed in 86us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529393.978459:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212667 00000100:00100000:0.0:1651529393.979151:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529393.979177:0:77219:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396560960 00002000:00010000:1.0:1651529393.979189:0:77219:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179061/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529393.979191:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000cee35a0c with x1731746396560960 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529393.979196:0:77219:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000cee35a0c. 00000100:00100000:1.0:1651529393.979204:0:77219:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18658 00000100:00100000:1.0:1651529393.979207:0:77219:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+10:41279:x1731746396560960:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529393.979282:0:77219:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bb75:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529393.979284:0:77219:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bb75:0x0] updating lvb mtime from disk: 0 -> 1651529393 00002000:00010000:1.0:1651529393.979285:0:77219:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bb75:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529393.979285:0:77219:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bb75:0x0] updating lvb ctime from disk: 0 -> 1651529393 00002000:00010000:1.0:1651529393.979286:0:77219:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bb75:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529393.979301:0:77219:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cee35a0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+11:41279:x1731746396560960:12345-10.240.43.64@tcp:10:dd.0 Request processed in 94us (150us total) trans 12885080670 rc 0/0 00000100:00100000:1.0:1651529393.979304:0:77219:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18658 00002000:00010000:1.0:1651529393.979306:0:77219:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179061/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529393.979307:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000cee35a0c with x1731746396560960 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529393.979309:0:77219:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000cee35a0c. 00000100:00100000:0.0:1651529393.982660:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529393.982682:0:77219:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396561472 00002000:00010000:1.0:1651529393.982688:0:77219:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179061/0 (30720->18446744073709551615) 00002000:00100000:1.0:1651529393.982690:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005d2b5bb3 with x1731746396561472 ext(30720->18446744073709551615) 00002000:00010000:1.0:1651529393.982692:0:77219:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000005d2b5bb3. 00000100:00100000:1.0:1651529393.982702:0:77219:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18659 00000100:00100000:1.0:1651529393.982704:0:77219:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+11:41278:x1731746396561472:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529393.982755:0:77219:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bb75:0x0] updating lvb size from disk: 0 -> 30720 00002000:00010000:1.0:1651529393.982757:0:77219:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bb75:0x0] updating lvb mtime from disk: 1651529393 -> 1651529393 00002000:00010000:1.0:1651529393.982767:0:77219:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bb75:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529393.982768:0:77219:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bb75:0x0] updating lvb ctime from disk: 1651529393 -> 1651529393 00002000:00010000:1.0:1651529393.982769:0:77219:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bb75:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529393.982782:0:77219:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d2b5bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+12:41278:x1731746396561472:12345-10.240.43.64@tcp:10:dd.0 Request processed in 77us (123us total) trans 12885080671 rc 0/0 00000100:00100000:1.0:1651529393.982785:0:77219:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18659 00002000:00010000:1.0:1651529393.982787:0:77219:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179061/0 (30720->18446744073709551615) 00002000:00100000:1.0:1651529393.982787:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005d2b5bb3 with x1731746396561472 ext(30720->18446744073709551615) 00002000:00010000:1.0:1651529393.982789:0:77219:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000005d2b5bb3. 00000100:00100000:0.0:1651529393.983117:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529393.983140:0:77219:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396561664 00002000:00100000:1.0:1651529393.983149:0:77219:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x100010000:0x2bb75:0x0] (28672->32767) req@00000000bddc5ca7 x1731746396561664/t0(0) o3->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:119/0 lens 488/0 e 0 to 0 dl 1651529399 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529393.983155:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000bddc5ca7 with x1731746396561664 ext(28672->32767) 00002000:00010000:1.0:1651529393.983156:0:77219:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000bddc5ca7 00000100:00100000:1.0:1651529393.983166:0:77219:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18660 00000100:00100000:1.0:1651529393.983168:0:77219:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+12:41278:x1731746396561664:12345-10.240.43.64@tcp:3:dd.0 00000100:00100000:1.0:1651529393.983241:0:77219:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bddc5ca7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+12:41278:x1731746396561664:12345-10.240.43.64@tcp:3:dd.0 Request processed in 71us (124us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1651529393.983246:0:77219:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18660 00002000:00100000:1.0:1651529393.983249:0:77219:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x100010000:0x2bb75:0x0] (28672->32767) req@00000000bddc5ca7 x1731746396561664/t0(0) o3->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:119/0 lens 488/4536 e 0 to 0 dl 1651529399 ref 1 fl Complete:/0/0 rc 4096/4096 job:'dd.0' 00002000:00100000:1.0:1651529393.983253:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000bddc5ca7 with x1731746396561664 ext(28672->32767) 00002000:00010000:1.0:1651529393.983254:0:77219:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000bddc5ca7 00000100:00100000:0.0:1651529393.994421:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529393.994430:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396562496 00000100:00100000:0.0:1651529393.994438:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212668 00000100:00100000:0.0:1651529393.994440:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+12:415101:x1731746396562496:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529393.994444:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529393.994448:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c5333e lrc: 2/0,0 mode: --/PW res: [0x2bb76:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da5b5 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529393.994454:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb76:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529393.994459:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529393.994460:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529393.994462:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c5333e lrc: 3/0,0 mode: PW/PW res: [0x2bb76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da5b5 expref: 13 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529393.994470:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c5333e lrc: 3/0,0 mode: PW/PW res: [0x2bb76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da5b5 expref: 13 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529393.994474:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000a7c37b9, rc 0) 00000100:00100000:0.0:1651529393.994489:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+13:415101:x1731746396562496:12345-10.240.43.64@tcp:101:dd.0 Request processed in 48us (68us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529393.994492:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212668 00000100:00100000:0.0:1651529393.998170:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529393.998193:0:77219:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396563008 00002000:00010000:1.0:1651529393.998199:0:77219:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179062/0 (61440->18446744073709551615) 00002000:00100000:1.0:1651529393.998200:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000028589556 with x1731746396563008 ext(61440->18446744073709551615) 00002000:00010000:1.0:1651529393.998203:0:77219:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000028589556. 00000100:00100000:1.0:1651529393.998212:0:77219:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18661 00000100:00100000:1.0:1651529393.998214:0:77219:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+13:41279:x1731746396563008:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529393.998254:0:77219:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bb76:0x0] updating lvb size from disk: 0 -> 61440 00002000:00010000:1.0:1651529393.998255:0:77219:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bb76:0x0] updating lvb mtime from disk: 0 -> 1651529393 00002000:00010000:1.0:1651529393.998256:0:77219:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bb76:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529393.998257:0:77219:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bb76:0x0] updating lvb ctime from disk: 0 -> 1651529393 00002000:00010000:1.0:1651529393.998258:0:77219:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bb76:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529393.998270:0:77219:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028589556 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+14:41279:x1731746396563008:12345-10.240.43.64@tcp:10:dd.0 Request processed in 55us (100us total) trans 12885080672 rc 0/0 00000100:00100000:1.0:1651529393.998273:0:77219:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18661 00002000:00010000:1.0:1651529393.998274:0:77219:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179062/0 (61440->18446744073709551615) 00002000:00100000:1.0:1651529393.998275:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000028589556 with x1731746396563008 ext(61440->18446744073709551615) 00002000:00010000:1.0:1651529393.998277:0:77219:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000028589556. 00000100:00100000:0.0:1651529394.024168:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529394.024175:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396565184 00000100:00100000:0.0:1651529394.024183:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212669 00000100:00100000:0.0:1651529394.024185:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+14:415111:x1731746396565184:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529394.024188:0:72395:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529394.024192:0:72395:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c53345 lrc: 2/0,0 mode: --/PW res: [0x2bb77:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da609 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529394.024198:0:72395:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb77:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529394.024202:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529394.024203:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529394.024205:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c53345 lrc: 3/0,0 mode: PW/PW res: [0x2bb77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da609 expref: 15 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529394.024209:0:72395:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c53345 lrc: 3/0,0 mode: PW/PW res: [0x2bb77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da609 expref: 15 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529394.024213:0:72395:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b0407aaf, rc 0) 00000100:00100000:0.0:1651529394.024242:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+15:415111:x1731746396565184:12345-10.240.43.64@tcp:101:dd.0 Request processed in 56us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529394.024245:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212669 00000100:00100000:0.0:1651529394.027883:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529394.027906:0:77219:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396565696 00002000:00010000:1.0:1651529394.027912:0:77219:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179063/0 (245760->18446744073709551615) 00002000:00100000:1.0:1651529394.027913:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000fb8e412 with x1731746396565696 ext(245760->18446744073709551615) 00002000:00010000:1.0:1651529394.027916:0:77219:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000000fb8e412. 00000100:00100000:1.0:1651529394.027925:0:77219:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18662 00000100:00100000:1.0:1651529394.027927:0:77219:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+15:41279:x1731746396565696:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529394.027955:0:77219:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bb77:0x0] updating lvb size from disk: 0 -> 245760 00002000:00010000:1.0:1651529394.027956:0:77219:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bb77:0x0] updating lvb mtime from disk: 0 -> 1651529394 00002000:00010000:1.0:1651529394.027957:0:77219:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bb77:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529394.027958:0:77219:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bb77:0x0] updating lvb ctime from disk: 0 -> 1651529394 00002000:00010000:1.0:1651529394.027959:0:77219:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bb77:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529394.027971:0:77219:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000fb8e412 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+16:41279:x1731746396565696:12345-10.240.43.64@tcp:10:dd.0 Request processed in 43us (88us total) trans 12885080673 rc 0/0 00000100:00100000:1.0:1651529394.027974:0:77219:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18662 00002000:00010000:1.0:1651529394.027975:0:77219:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179063/0 (245760->18446744073709551615) 00002000:00100000:1.0:1651529394.027975:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000fb8e412 with x1731746396565696 ext(245760->18446744073709551615) 00002000:00010000:1.0:1651529394.027977:0:77219:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000000fb8e412. 00000100:00100000:0.0:1651529394.054839:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529394.054847:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396567872 00000100:00100000:0.0:1651529394.054854:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212670 00000100:00100000:0.0:1651529394.054856:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+16:415121:x1731746396567872:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529394.054860:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529394.054864:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c5334c lrc: 2/0,0 mode: --/PW res: [0x2bb78:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da65d expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529394.054869:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb78:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529394.054873:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529394.054874:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529394.054876:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c5334c lrc: 3/0,0 mode: PW/PW res: [0x2bb78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->98303) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da65d expref: 17 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529394.054880:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c5334c lrc: 3/0,0 mode: PW/PW res: [0x2bb78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->98303) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da65d expref: 17 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529394.054884:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002f450f42, rc 0) 00000100:00100000:0.0:1651529394.054900:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+17:415121:x1731746396567872:12345-10.240.43.64@tcp:101:dd.0 Request processed in 43us (62us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529394.054903:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212670 00000100:00100000:0.0:1651529394.058938:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529394.058961:0:77219:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396568384 00002000:00010000:1.0:1651529394.058967:0:77219:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179064/0 (983040->18446744073709551615) 00002000:00100000:1.0:1651529394.058968:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000007c534a1e with x1731746396568384 ext(983040->18446744073709551615) 00002000:00010000:1.0:1651529394.058971:0:77219:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000007c534a1e. 00000100:00100000:1.0:1651529394.058981:0:77219:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18663 00000100:00100000:1.0:1651529394.058982:0:77219:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+17:41279:x1731746396568384:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529394.059011:0:77219:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bb78:0x0] updating lvb size from disk: 0 -> 983040 00002000:00010000:1.0:1651529394.059012:0:77219:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bb78:0x0] updating lvb mtime from disk: 0 -> 1651529394 00002000:00010000:1.0:1651529394.059013:0:77219:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bb78:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529394.059014:0:77219:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bb78:0x0] updating lvb ctime from disk: 0 -> 1651529394 00002000:00010000:1.0:1651529394.059015:0:77219:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bb78:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529394.059027:0:77219:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007c534a1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+18:41279:x1731746396568384:12345-10.240.43.64@tcp:10:dd.0 Request processed in 44us (90us total) trans 12885080674 rc 0/0 00000100:00100000:1.0:1651529394.059030:0:77219:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18663 00002000:00010000:1.0:1651529394.059031:0:77219:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179064/0 (983040->18446744073709551615) 00002000:00100000:1.0:1651529394.059032:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000007c534a1e with x1731746396568384 ext(983040->18446744073709551615) 00002000:00010000:1.0:1651529394.059034:0:77219:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000007c534a1e. 00000100:00100000:0.0:1651529394.087863:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529394.087870:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396570560 00000100:00100000:0.0:1651529394.087878:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212671 00000100:00100000:0.0:1651529394.087880:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ea32140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+18:415131:x1731746396570560:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529394.087883:0:72395:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529394.087888:0:72395:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c53353 lrc: 2/0,0 mode: --/PW res: [0x2bb79:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da6b1 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529394.087893:0:72395:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb79:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529394.087897:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529394.087898:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529394.087900:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c53353 lrc: 3/0,0 mode: PW/PW res: [0x2bb79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->393215) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da6b1 expref: 19 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529394.087904:0:72395:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c53353 lrc: 3/0,0 mode: PW/PW res: [0x2bb79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->393215) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da6b1 expref: 19 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529394.087908:0:72395:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000009fe5580, rc 0) 00000100:00100000:0.0:1651529394.087924:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ea32140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+19:415131:x1731746396570560:12345-10.240.43.64@tcp:101:dd.0 Request processed in 43us (62us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529394.087927:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212671 00000100:00100000:0.0:1651529394.093099:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529394.093121:0:77219:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396571072 00002000:00010000:1.0:1651529394.093127:0:77219:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179065/0 (3932160->18446744073709551615) 00002000:00100000:1.0:1651529394.093128:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000dfc79d4e with x1731746396571072 ext(3932160->18446744073709551615) 00002000:00010000:1.0:1651529394.093131:0:77219:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000dfc79d4e. 00000100:00100000:1.0:1651529394.093141:0:77219:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18664 00000100:00100000:1.0:1651529394.093142:0:77219:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfc79d4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+19:41279:x1731746396571072:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529394.093170:0:77219:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bb79:0x0] updating lvb size from disk: 0 -> 3932160 00002000:00010000:1.0:1651529394.093171:0:77219:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bb79:0x0] updating lvb mtime from disk: 0 -> 1651529394 00002000:00010000:1.0:1651529394.093172:0:77219:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bb79:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529394.093172:0:77219:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bb79:0x0] updating lvb ctime from disk: 0 -> 1651529394 00002000:00010000:1.0:1651529394.093173:0:77219:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bb79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529394.093185:0:77219:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfc79d4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+20:41279:x1731746396571072:12345-10.240.43.64@tcp:10:dd.0 Request processed in 42us (87us total) trans 12885080675 rc 0/0 00000100:00100000:1.0:1651529394.093188:0:77219:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18664 00002000:00010000:1.0:1651529394.093189:0:77219:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179065/0 (3932160->18446744073709551615) 00002000:00100000:1.0:1651529394.093190:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000dfc79d4e with x1731746396571072 ext(3932160->18446744073709551615) 00002000:00010000:1.0:1651529394.093192:0:77219:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000dfc79d4e. 00000100:00100000:0.0:1651529394.130333:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529394.130341:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396573248 00000100:00100000:0.0:1651529394.130348:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212672 00000100:00100000:0.0:1651529394.130350:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007fca8239 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+20:415141:x1731746396573248:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529394.130353:0:72396:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529394.130357:0:72396:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c5335a lrc: 2/0,0 mode: --/PW res: [0x2bb7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da705 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529394.130365:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb7a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529394.130369:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529394.130370:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529394.130372:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c5335a lrc: 3/0,0 mode: PW/PW res: [0x2bb7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1572863) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da705 expref: 21 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529394.130376:0:72396:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c5335a lrc: 3/0,0 mode: PW/PW res: [0x2bb7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1572863) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da705 expref: 21 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529394.130380:0:72396:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9cfe902, rc 0) 00000100:00100000:0.0:1651529394.130396:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007fca8239 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+21:415141:x1731746396573248:12345-10.240.43.64@tcp:101:dd.0 Request processed in 45us (63us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529394.130399:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212672 00000100:00100000:0.0:1651529394.140046:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529394.140069:0:77219:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396573760 00002000:00010000:1.0:1651529394.140075:0:77219:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179066/0 (15728640->18446744073709551615) 00002000:00100000:1.0:1651529394.140076:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005914c920 with x1731746396573760 ext(15728640->18446744073709551615) 00002000:00010000:1.0:1651529394.140079:0:77219:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000005914c920. 00000100:00100000:1.0:1651529394.140089:0:77219:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18665 00000100:00100000:1.0:1651529394.140091:0:77219:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005914c920 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+21:41279:x1731746396573760:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529394.140118:0:77219:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bb7a:0x0] updating lvb size from disk: 0 -> 15728640 00002000:00010000:1.0:1651529394.140119:0:77219:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bb7a:0x0] updating lvb mtime from disk: 0 -> 1651529394 00002000:00010000:1.0:1651529394.140120:0:77219:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bb7a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529394.140120:0:77219:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bb7a:0x0] updating lvb ctime from disk: 0 -> 1651529394 00002000:00010000:1.0:1651529394.140121:0:77219:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bb7a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529394.140133:0:77219:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005914c920 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+22:41279:x1731746396573760:12345-10.240.43.64@tcp:10:dd.0 Request processed in 42us (87us total) trans 12885080676 rc 0/0 00000100:00100000:1.0:1651529394.140136:0:77219:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18665 00002000:00010000:1.0:1651529394.140137:0:77219:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179066/0 (15728640->18446744073709551615) 00002000:00100000:1.0:1651529394.140138:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005914c920 with x1731746396573760 ext(15728640->18446744073709551615) 00002000:00010000:1.0:1651529394.140140:0:77219:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000005914c920. 00000100:00100000:0.0:1651529394.212207:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529394.212215:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396575936 00000100:00100000:0.0:1651529394.212239:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212673 00000100:00100000:0.0:1651529394.212241:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+22:415151:x1731746396575936:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529394.212244:0:72395:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529394.212248:0:72395:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c53361 lrc: 2/0,0 mode: --/PW res: [0x2bb7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da759 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529394.212254:0:72395:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb7b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529394.212258:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529394.212258:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529394.212260:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c53361 lrc: 3/0,0 mode: PW/PW res: [0x2bb7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->6291455) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da759 expref: 23 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529394.212265:0:72395:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c53361 lrc: 3/0,0 mode: PW/PW res: [0x2bb7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->6291455) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da759 expref: 23 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529394.212268:0:72395:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000055fddd81, rc 0) 00000100:00100000:0.0:1651529394.212282:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+23:415151:x1731746396575936:12345-10.240.43.64@tcp:101:dd.0 Request processed in 41us (76us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529394.212285:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212673 00000100:00100000:0.0:1651529394.234897:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529394.234920:0:77219:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396576064 00002000:00100000:1.0:1651529394.234928:0:77219:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x100010000:0x2bb7b:0x0] (0->4194303) req@000000005cc6463a x1731746396576064/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:120/0 lens 488/0 e 0 to 0 dl 1651529400 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529394.234933:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005cc6463a with x1731746396576064 ext(0->4194303) 00002000:00010000:1.0:1651529394.234934:0:77219:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000005cc6463a 00000100:00100000:1.0:1651529394.234944:0:77219:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18666 00000100:00100000:1.0:1651529394.234946:0:77219:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+23:41278:x1731746396576064:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529394.240420:0:77219:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+25:41278:x1731746396576064:12345-10.240.43.64@tcp:4:dd.0 Request processed in 5472us (5522us total) trans 12885080677 rc 0/0 00000100:00100000:1.0:1651529394.240429:0:77219:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18666 00002000:00100000:1.0:1651529394.240434:0:77219:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x100010000:0x2bb7b:0x0] (0->4194303) req@000000005cc6463a x1731746396576064/t12885080677(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:120/0 lens 488/448 e 0 to 0 dl 1651529400 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529394.240439:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005cc6463a with x1731746396576064 ext(0->4194303) 00002000:00010000:1.0:1651529394.240441:0:77219:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000005cc6463a 00000100:00100000:1.0:1651529394.241900:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529394.241910:0:77219:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396576576 00002000:00010000:1.0:1651529394.241918:0:77219:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179067/0 (62914560->18446744073709551615) 00002000:00100000:1.0:1651529394.241919:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003de40890 with x1731746396576576 ext(62914560->18446744073709551615) 00002000:00010000:1.0:1651529394.241924:0:77219:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000003de40890. 00000100:00100000:1.0:1651529394.241935:0:77219:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18667 00000100:00100000:1.0:1651529394.241938:0:77219:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+25:41279:x1731746396576576:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529394.241975:0:77219:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bb7b:0x0] updating lvb size from disk: 0 -> 62914560 00002000:00010000:1.0:1651529394.241976:0:77219:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bb7b:0x0] updating lvb mtime from disk: 0 -> 1651529394 00002000:00010000:1.0:1651529394.241977:0:77219:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bb7b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529394.241978:0:77219:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bb7b:0x0] updating lvb ctime from disk: 0 -> 1651529394 00002000:00010000:1.0:1651529394.241979:0:77219:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bb7b:0x0] updating lvb blocks from disk: 0 -> 8192 00000100:00100000:1.0:1651529394.241995:0:77219:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003de40890 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+26:41279:x1731746396576576:12345-10.240.43.64@tcp:10:dd.0 Request processed in 56us (95us total) trans 12885080678 rc 0/0 00000100:00100000:1.0:1651529394.241998:0:77219:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18667 00002000:00010000:1.0:1651529394.241999:0:77219:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179067/0 (62914560->18446744073709551615) 00002000:00100000:1.0:1651529394.242000:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003de40890 with x1731746396576576 ext(62914560->18446744073709551615) 00002000:00010000:1.0:1651529394.242002:0:77219:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000003de40890. 00000100:00100000:1.0:1651529394.269367:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529394.269375:0:77219:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396576704 00002000:00100000:1.0:1651529394.269383:0:77219:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x100010000:0x2bb7b:0x0] (62914560->67108863) req@0000000029abc941 x1731746396576704/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:120/0 lens 488/0 e 0 to 0 dl 1651529400 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529394.269387:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000029abc941 with x1731746396576704 ext(62914560->67108863) 00002000:00010000:1.0:1651529394.269388:0:77219:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000029abc941 00000100:00100000:1.0:1651529394.269399:0:77219:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18668 00000100:00100000:1.0:1651529394.269400:0:77219:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+26:41278:x1731746396576704:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529394.274512:0:77219:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029abc941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+28:41278:x1731746396576704:12345-10.240.43.64@tcp:4:dd.0 Request processed in 5109us (5144us total) trans 12885080679 rc 0/0 00000100:00100000:1.0:1651529394.274517:0:77219:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18668 00002000:00100000:1.0:1651529394.274521:0:77219:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x100010000:0x2bb7b:0x0] (62914560->67108863) req@0000000029abc941 x1731746396576704/t12885080679(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:120/0 lens 488/448 e 0 to 0 dl 1651529400 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529394.274526:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000029abc941 with x1731746396576704 ext(62914560->67108863) 00002000:00010000:1.0:1651529394.274528:0:77219:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000029abc941 00000100:00100000:0.0:1651529394.400103:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529394.400130:0:87247:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946596736 00000100:00100000:1.0:1651529394.400148:0:87247:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 578 00000100:00100000:1.0:1651529394.400150:0:87247:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+47:39030:x1731745946596736:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651529394.400161:0:87247:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 4243456 granted 29312704 pending 8466432 free 81319653376 avail 77148942336 00000100:00100000:1.0:1651529394.400177:0:87247:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+47:39030:x1731745946596736:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 26us (75us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529394.400180:0:87247:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 578 00000100:00100000:0.0:1651529394.452722:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529394.452733:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396579648 00000100:00100000:0.0:1651529394.452750:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212674 00000100:00100000:0.0:1651529394.452752:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+28:415161:x1731746396579648:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529394.452768:0:72395:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529394.452778:0:72395:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c53368 lrc: 2/0,0 mode: --/PW res: [0x2bb7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da7ad expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529394.452787:0:72395:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb7c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529394.452795:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529394.452796:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529394.452800:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c53368 lrc: 3/0,0 mode: PW/PW res: [0x2bb7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->25165823) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da7ad expref: 29 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529394.452808:0:72395:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c53368 lrc: 3/0,0 mode: PW/PW res: [0x2bb7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->25165823) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da7ad expref: 29 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529394.452817:0:72395:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000096ab8041, rc 0) 00000100:00100000:0.0:1651529394.452834:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+29:415161:x1731746396579648:12345-10.240.43.64@tcp:101:dd.0 Request processed in 81us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529394.452837:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212674 00000100:00100000:0.0:1651529394.563563:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529394.563586:0:77219:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396579776 00002000:00100000:1.0:1651529394.563597:0:77219:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x100010000:0x2bb7c:0x0] (0->4194303) req@00000000f9050c71 x1731746396579776/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:120/0 lens 488/0 e 0 to 0 dl 1651529400 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529394.563605:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f9050c71 with x1731746396579776 ext(0->4194303) 00002000:00010000:1.0:1651529394.563606:0:77219:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f9050c71 00000100:00100000:1.0:1651529394.563617:0:77219:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18669 00000100:00100000:1.0:1651529394.563619:0:77219:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+29:41278:x1731746396579776:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529394.567485:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529394.567517:0:77218:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396579904 00002000:00100000:0.0:1651529394.567529:0:77218:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x2bb7c:0x0] (4194304->8388607) req@000000001a573b31 x1731746396579904/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:120/0 lens 488/0 e 0 to 0 dl 1651529400 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529394.567535:0:77218:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001a573b31 with x1731746396579904 ext(4194304->8388607) 00002000:00010000:0.0:1651529394.567536:0:77218:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000001a573b31 00000100:00100000:0.0:1651529394.567554:0:77218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18670 00000100:00100000:0.0:1651529394.567556:0:77218:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+33:41279:x1731746396579904:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529394.568282:0:77219:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+33:41278:x1731746396579776:12345-10.240.43.64@tcp:4:dd.0 Request processed in 4662us (4719us total) trans 12885080680 rc 0/0 00000100:00100000:1.0:1651529394.568286:0:77219:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18669 00002000:00100000:1.0:1651529394.568289:0:77219:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x100010000:0x2bb7c:0x0] (0->4194303) req@00000000f9050c71 x1731746396579776/t12885080680(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:120/0 lens 488/448 e 0 to 0 dl 1651529400 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529394.568294:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f9050c71 with x1731746396579776 ext(0->4194303) 00002000:00010000:1.0:1651529394.568295:0:77219:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f9050c71 00000100:00100000:1.0:1651529394.571597:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529394.571607:0:77219:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396580032 00002000:00100000:1.0:1651529394.571616:0:77219:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x100010000:0x2bb7c:0x0] (8388608->12582911) req@000000000ebb53b0 x1731746396580032/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:120/0 lens 488/0 e 0 to 0 dl 1651529400 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529394.571621:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000ebb53b0 with x1731746396580032 ext(8388608->12582911) 00002000:00010000:1.0:1651529394.571622:0:77219:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000000ebb53b0 00000100:00100000:1.0:1651529394.571629:0:77219:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18671 00000100:00100000:1.0:1651529394.571631:0:77219:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+35:41279:x1731746396580032:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529394.572343:0:77218:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a573b31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+35:41279:x1731746396579904:12345-10.240.43.64@tcp:4:dd.0 Request processed in 4785us (4858us total) trans 12885080681 rc 0/0 00000100:00100000:1.0:1651529394.572347:0:77218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18670 00002000:00100000:1.0:1651529394.572350:0:77218:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x2bb7c:0x0] (4194304->8388607) req@000000001a573b31 x1731746396579904/t12885080681(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:120/0 lens 488/448 e 0 to 0 dl 1651529400 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529394.572354:0:77218:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001a573b31 with x1731746396579904 ext(4194304->8388607) 00002000:00010000:1.0:1651529394.572355:0:77218:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000001a573b31 00000100:00100000:1.0:1651529394.575612:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529394.575622:0:77218:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396580160 00002000:00100000:1.0:1651529394.575631:0:77218:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x2bb7c:0x0] (12582912->16777215) req@0000000055e03b4f x1731746396580160/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:120/0 lens 488/0 e 0 to 0 dl 1651529400 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529394.575635:0:77218:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000055e03b4f with x1731746396580160 ext(12582912->16777215) 00002000:00010000:1.0:1651529394.575636:0:77218:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000055e03b4f 00000100:00100000:1.0:1651529394.575643:0:77218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18672 00000100:00100000:1.0:1651529394.575645:0:77218:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+37:41278:x1731746396580160:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529394.576325:0:77219:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000ebb53b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+37:41279:x1731746396580032:12345-10.240.43.64@tcp:4:dd.0 Request processed in 4693us (4728us total) trans 12885080682 rc 0/0 00000100:00100000:1.0:1651529394.576329:0:77219:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18671 00002000:00100000:1.0:1651529394.576332:0:77219:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x100010000:0x2bb7c:0x0] (8388608->12582911) req@000000000ebb53b0 x1731746396580032/t12885080682(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:120/0 lens 488/448 e 0 to 0 dl 1651529400 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529394.576335:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000ebb53b0 with x1731746396580032 ext(8388608->12582911) 00002000:00010000:1.0:1651529394.576337:0:77219:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000000ebb53b0 00000100:00100000:1.0:1651529394.579657:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529394.579668:0:77219:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396580288 00002000:00100000:1.0:1651529394.579678:0:77219:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x100010000:0x2bb7c:0x0] (16777216->20971519) req@00000000974b675b x1731746396580288/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:120/0 lens 488/0 e 0 to 0 dl 1651529400 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529394.579682:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000974b675b with x1731746396580288 ext(16777216->20971519) 00002000:00010000:1.0:1651529394.579684:0:77219:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000974b675b 00000100:00100000:1.0:1651529394.579698:0:77219:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18673 00000100:00100000:1.0:1651529394.579700:0:77219:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+39:41278:x1731746396580288:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529394.580556:0:77218:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055e03b4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+39:41278:x1731746396580160:12345-10.240.43.64@tcp:4:dd.0 Request processed in 4909us (4943us total) trans 12885080683 rc 0/0 00000100:00100000:1.0:1651529394.580559:0:77218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18672 00002000:00100000:1.0:1651529394.580562:0:77218:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x2bb7c:0x0] (12582912->16777215) req@0000000055e03b4f x1731746396580160/t12885080683(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:120/0 lens 488/448 e 0 to 0 dl 1651529400 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529394.580567:0:77218:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000055e03b4f with x1731746396580160 ext(12582912->16777215) 00002000:00010000:1.0:1651529394.580568:0:77218:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000055e03b4f 00000100:00100000:1.0:1651529394.583671:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529394.583681:0:77218:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396580544 00002000:00100000:1.0:1651529394.583688:0:77218:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x2bb7c:0x0] (20971520->25165823) req@00000000117fbeca x1731746396580544/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:120/0 lens 488/0 e 0 to 0 dl 1651529400 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529394.583692:0:77218:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000117fbeca with x1731746396580544 ext(20971520->25165823) 00002000:00010000:1.0:1651529394.583694:0:77218:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000117fbeca 00000100:00100000:1.0:1651529394.583702:0:77218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18674 00000100:00100000:1.0:1651529394.583704:0:77218:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+39:41279:x1731746396580544:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529394.588313:0:77219:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000974b675b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+41:41278:x1731746396580288:12345-10.240.43.64@tcp:4:dd.0 Request processed in 8610us (8655us total) trans 12885080684 rc 0/0 00000100:00100000:1.0:1651529394.588318:0:77219:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18673 00002000:00100000:1.0:1651529394.588322:0:77219:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x100010000:0x2bb7c:0x0] (16777216->20971519) req@00000000974b675b x1731746396580288/t12885080684(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:120/0 lens 488/448 e 0 to 0 dl 1651529400 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529394.588327:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000974b675b with x1731746396580288 ext(16777216->20971519) 00002000:00010000:1.0:1651529394.588329:0:77219:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000974b675b 00000100:00100000:1.0:1651529394.589903:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529394.589912:0:77219:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396580928 00002000:00010000:1.0:1651529394.589921:0:77219:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179068/0 (251658240->18446744073709551615) 00002000:00100000:1.0:1651529394.589922:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009ac8dec6 with x1731746396580928 ext(251658240->18446744073709551615) 00002000:00010000:1.0:1651529394.589928:0:77219:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000009ac8dec6. 00000100:00100000:1.0:1651529394.589934:0:77219:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18675 00000100:00100000:1.0:1651529394.589937:0:77219:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+41:41279:x1731746396580928:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529394.589987:0:77219:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bb7c:0x0] updating lvb size from disk: 0 -> 251658240 00002000:00010000:1.0:1651529394.589989:0:77219:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bb7c:0x0] updating lvb mtime from disk: 0 -> 1651529394 00002000:00010000:1.0:1651529394.589990:0:77219:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bb7c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529394.589991:0:77219:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bb7c:0x0] updating lvb ctime from disk: 0 -> 1651529394 00002000:00010000:1.0:1651529394.589992:0:77219:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bb7c:0x0] updating lvb blocks from disk: 0 -> 40960 00000100:00100000:1.0:1651529394.590003:0:77219:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac8dec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+42:41279:x1731746396580928:12345-10.240.43.64@tcp:10:dd.0 Request processed in 66us (101us total) trans 12885080685 rc 0/0 00000100:00100000:1.0:1651529394.590006:0:77219:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18675 00002000:00010000:1.0:1651529394.590007:0:77219:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179068/0 (251658240->18446744073709551615) 00002000:00100000:1.0:1651529394.590008:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009ac8dec6 with x1731746396580928 ext(251658240->18446744073709551615) 00002000:00010000:1.0:1651529394.590010:0:77219:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000009ac8dec6. 00000100:00100000:1.0:1651529394.593039:0:77218:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000117fbeca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+42:41279:x1731746396580544:12345-10.240.43.64@tcp:4:dd.0 Request processed in 9334us (9367us total) trans 12885080686 rc 0/0 00000100:00100000:1.0:1651529394.593043:0:77218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18674 00002000:00100000:1.0:1651529394.593046:0:77218:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x2bb7c:0x0] (20971520->25165823) req@00000000117fbeca x1731746396580544/t12885080686(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:120/0 lens 488/448 e 0 to 0 dl 1651529400 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529394.593050:0:77218:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000117fbeca with x1731746396580544 ext(20971520->25165823) 00002000:00010000:1.0:1651529394.593052:0:77218:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000117fbeca 00000100:00100000:0.0:1651529394.709064:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529394.709086:0:77218:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396581056 00002000:00100000:1.0:1651529394.709096:0:77218:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x2bb7c:0x0] (251658240->255852543) req@000000009b8db73b x1731746396581056/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:120/0 lens 488/0 e 0 to 0 dl 1651529400 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529394.709100:0:77218:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009b8db73b with x1731746396581056 ext(251658240->255852543) 00002000:00010000:1.0:1651529394.709101:0:77218:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000009b8db73b 00000100:00100000:1.0:1651529394.709107:0:77218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18676 00000100:00100000:1.0:1651529394.709109:0:77218:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+42:41279:x1731746396581056:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529394.712807:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529394.712817:0:77221:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396581184 00002000:00100000:0.0:1651529394.712853:0:77221:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x2bb7c:0x0] (255852544->260046847) req@0000000006c4043a x1731746396581184/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:120/0 lens 488/0 e 0 to 0 dl 1651529400 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529394.712859:0:77221:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000006c4043a with x1731746396581184 ext(255852544->260046847) 00002000:00010000:0.0:1651529394.712861:0:77221:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000006c4043a 00000100:00100000:0.0:1651529394.712873:0:77221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18677 00000100:00100000:0.0:1651529394.712875:0:77221:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+44:41278:x1731746396581184:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529394.715325:0:77218:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+46:41279:x1731746396581056:12345-10.240.43.64@tcp:4:dd.0 Request processed in 6213us (6261us total) trans 12885080687 rc 0/0 00000100:00100000:1.0:1651529394.715330:0:77218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18676 00002000:00100000:1.0:1651529394.715334:0:77218:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x2bb7c:0x0] (251658240->255852543) req@000000009b8db73b x1731746396581056/t12885080687(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:120/0 lens 488/448 e 0 to 0 dl 1651529400 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529394.715338:0:77218:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009b8db73b with x1731746396581056 ext(251658240->255852543) 00002000:00010000:1.0:1651529394.715340:0:77218:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000009b8db73b 00000100:00100000:1.0:1651529394.717001:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529394.717010:0:77218:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396581312 00002000:00100000:1.0:1651529394.717018:0:77218:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x2bb7c:0x0] (260046848->264241151) req@00000000913beefe x1731746396581312/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:120/0 lens 488/0 e 0 to 0 dl 1651529400 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529394.717022:0:77218:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000913beefe with x1731746396581312 ext(260046848->264241151) 00002000:00010000:1.0:1651529394.717023:0:77218:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000913beefe 00000100:00100000:1.0:1651529394.717032:0:77218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18678 00000100:00100000:1.0:1651529394.717034:0:77218:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+46:41278:x1731746396581312:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529394.721070:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529394.721085:0:77219:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396581440 00002000:00100000:1.0:1651529394.721100:0:77219:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x100010000:0x2bb7c:0x0] (264241152->268435455) req@00000000a138afb6 x1731746396581440/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:120/0 lens 488/0 e 0 to 0 dl 1651529400 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529394.721107:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a138afb6 with x1731746396581440 ext(264241152->268435455) 00002000:00010000:1.0:1651529394.721110:0:77219:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000a138afb6 00000100:00100000:1.0:1651529394.721141:0:77219:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18679 00000100:00100000:1.0:1651529394.721177:0:77219:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+52:41278:x1731746396581440:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529394.721320:0:77221:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+51:41278:x1731746396581184:12345-10.240.43.64@tcp:4:dd.0 Request processed in 8444us (8513us total) trans 12885080688 rc 0/0 00000100:00100000:0.0:1651529394.721327:0:77221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18677 00002000:00100000:0.0:1651529394.721331:0:77221:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x2bb7c:0x0] (255852544->260046847) req@0000000006c4043a x1731746396581184/t12885080688(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:120/0 lens 488/448 e 0 to 0 dl 1651529400 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529394.721335:0:77221:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000006c4043a with x1731746396581184 ext(255852544->260046847) 00002000:00010000:0.0:1651529394.721337:0:77221:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000006c4043a 00000100:00100000:1.0:1651529394.723106:0:77218:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000913beefe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+50:41278:x1731746396581312:12345-10.240.43.64@tcp:4:dd.0 Request processed in 6070us (6104us total) trans 12885080689 rc 0/0 00000100:00100000:1.0:1651529394.723111:0:77218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18678 00002000:00100000:1.0:1651529394.723114:0:77218:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x2bb7c:0x0] (260046848->264241151) req@00000000913beefe x1731746396581312/t12885080689(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:120/0 lens 488/448 e 0 to 0 dl 1651529400 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529394.723119:0:77218:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000913beefe with x1731746396581312 ext(260046848->264241151) 00002000:00010000:1.0:1651529394.723121:0:77218:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000913beefe 00000100:00100000:1.0:1651529394.725119:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529394.725128:0:77218:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396581568 00002000:00100000:1.0:1651529394.725137:0:77218:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x2bb7c:0x0] (268435456->272629759) req@000000003d523a75 x1731746396581568/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:120/0 lens 488/0 e 0 to 0 dl 1651529400 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529394.725141:0:77218:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003d523a75 with x1731746396581568 ext(268435456->272629759) 00002000:00010000:1.0:1651529394.725143:0:77218:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000003d523a75 00000100:00100000:1.0:1651529394.725154:0:77218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18680 00000100:00100000:1.0:1651529394.725155:0:77218:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+50:41278:x1731746396581568:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529394.729126:0:77219:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a138afb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+52:41278:x1731746396581440:12345-10.240.43.64@tcp:4:dd.0 Request processed in 7980us (8058us total) trans 12885080690 rc 0/0 00000100:00100000:1.0:1651529394.729133:0:77219:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18679 00002000:00100000:1.0:1651529394.729138:0:77219:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x100010000:0x2bb7c:0x0] (264241152->268435455) req@00000000a138afb6 x1731746396581440/t12885080690(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:120/0 lens 488/448 e 0 to 0 dl 1651529400 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529394.729142:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a138afb6 with x1731746396581440 ext(264241152->268435455) 00002000:00010000:1.0:1651529394.729144:0:77219:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000a138afb6 00000100:00100000:1.0:1651529394.730275:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529394.730283:0:77219:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396581696 00002000:00100000:1.0:1651529394.730292:0:77219:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x100010000:0x2bb7c:0x0] (272629760->276824063) req@0000000034e35367 x1731746396581696/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:120/0 lens 488/0 e 0 to 0 dl 1651529400 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529394.730296:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000034e35367 with x1731746396581696 ext(272629760->276824063) 00002000:00010000:1.0:1651529394.730298:0:77219:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000034e35367 00000100:00100000:1.0:1651529394.730304:0:77219:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18681 00000100:00100000:1.0:1651529394.730306:0:77219:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+52:41278:x1731746396581696:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529394.734798:0:77218:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d523a75 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+54:41278:x1731746396581568:12345-10.240.43.64@tcp:4:dd.0 Request processed in 9640us (9678us total) trans 12885080691 rc 0/0 00000100:00100000:1.0:1651529394.734804:0:77218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18680 00002000:00100000:1.0:1651529394.734809:0:77218:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x2bb7c:0x0] (268435456->272629759) req@000000003d523a75 x1731746396581568/t12885080691(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:120/0 lens 488/448 e 0 to 0 dl 1651529400 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529394.734814:0:77218:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003d523a75 with x1731746396581568 ext(268435456->272629759) 00002000:00010000:1.0:1651529394.734816:0:77218:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000003d523a75 00000100:00100000:1.0:1651529394.739006:0:77219:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000034e35367 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+54:41278:x1731746396581696:12345-10.240.43.64@tcp:4:dd.0 Request processed in 8699us (8731us total) trans 12885080692 rc 0/0 00000100:00100000:1.0:1651529394.739010:0:77219:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18681 00002000:00100000:1.0:1651529394.739013:0:77219:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x100010000:0x2bb7c:0x0] (272629760->276824063) req@0000000034e35367 x1731746396581696/t12885080692(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:120/0 lens 488/448 e 0 to 0 dl 1651529400 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529394.739017:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000034e35367 with x1731746396581696 ext(272629760->276824063) 00002000:00010000:1.0:1651529394.739018:0:77219:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000034e35367 00000100:00100000:0.0:1651529395.674173:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529395.674184:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396587008 00000100:00100000:0.0:1651529395.674206:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212675 00000100:00100000:0.0:1651529395.674208:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+54:415308:x1731746396587008:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529395.674215:0:72395:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529395.674237:0:72395:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c5336f lrc: 2/0,0 mode: --/PW res: [0x2bb7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2da801 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529395.674248:0:72395:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb7d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529395.674258:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529395.674258:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529395.674263:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c5336f lrc: 3/0,0 mode: PW/PW res: [0x2bb7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->524287) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da801 expref: 55 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529395.674271:0:72395:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c5336f lrc: 3/0,0 mode: PW/PW res: [0x2bb7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->524287) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da801 expref: 55 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529395.674277:0:72395:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000036d87bb6, rc 0) 00000100:00100000:0.0:1651529395.674294:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+55:415308:x1731746396587008:12345-10.240.43.64@tcp:101:dd.0 Request processed in 85us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529395.674298:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212675 00000400:00000080:1.0:1651529397.111600:0:158668:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651529397.111602:0:158668:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 128: interactive lfs for 2 consecutive find's ========================================================== 22:09:56 (1651529396) 00000100:00100000:0.0:1651529397.985194:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529397.985232:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946597248 00000100:00100000:1.0:1651529397.985258:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 88 00000100:00100000:1.0:1651529397.985261:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+47:39029:x1731745946597248:12345-10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:1.0:1651529397.985294:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+47:39029:x1731745946597248:12345-10.240.43.61@tcp:400:kworker/u4:0.0 Request processed in 33us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529397.985298:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 88 00000001:00080000:0.0:1651529398.113970:0:72382:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 12885080692 is committed 00000001:00080000:0.0:1651529398.113990:0:72382:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 12885080667 is committed 00000400:00000080:0.0:1651529398.387844:0:158886:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651529398.387847:0:158886:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 129: test directory size limit ================================================================================== 22:09:58 (1651529398) 00000100:00100000:0.0:1651529398.498308:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529398.498346:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946597824 00000100:00100000:1.0:1651529398.498368:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212676 00000100:00100000:1.0:1651529398.498371:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946597824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529398.498387:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179061 count 1 00010000:00010000:1.0:1651529398.498401:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53376 lrc: 3/0,1 mode: --/PW res: [0x2bb75:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.498411:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53337 lrc: 2/0,0 mode: PW/PW res: [0x2bb75:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da58b expref: 14 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.498416:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529398.498416:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529398.498418:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53376 lrc: 4/0,1 mode: --/PW res: [0x2bb75:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.498435:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53337 lrc: 3/0,0 mode: PW/PW res: [0x2bb75:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da58b expref: 14 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.498441:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53337 lrc: 4/0,0 mode: PW/PW res: [0x2bb75:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da58b expref: 14 pid: 72395 timeout: 20157 lvb_type: 0 00000100:00100000:1.0:1651529398.498447:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d9cfef26 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997070976:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529398.498476:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 000000004ca54b8a going to sleep for 6 seconds 00000100:00100000:1.0:1651529398.498846:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d9cfef26 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997070976:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529398.498854:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53376 lrc: 3/0,1 mode: --/PW res: [0x2bb75:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529398.498937:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529398.498965:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396589056 00010000:00010000:0.0:1651529398.498976:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53337 lrc: 4/0,0 mode: PW/PW res: [0x2bb75:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da58b expref: 15 pid: 72395 timeout: 20157 lvb_type: 0 00000100:00100000:0.0:1651529398.498993:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13344 00000100:00100000:0.0:1651529398.498995:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+15:41279:x1731746396589056:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529398.499001:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529398.499002:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53337 lrc: 4/0,0 mode: PW/PW res: [0x2bb75:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da58b expref: 15 pid: 72395 timeout: 20157 lvb_type: 0 00010000:00010000:0.0:1651529398.499008:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53337 lrc: 3/0,0 mode: PW/PW res: [0x2bb75:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da58b expref: 15 pid: 72395 timeout: 20157 lvb_type: 0 00010000:00010000:0.0:1651529398.499018:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53337 lrc: 0/0,0 mode: --/PW res: [0x2bb75:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da58b expref: 15 pid: 72395 timeout: 20157 lvb_type: 0 00010000:00010000:0.0:1651529398.499023:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529398.499024:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529398.499025:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53376 lrc: 3/0,1 mode: PW/PW res: [0x2bb75:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.499029:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53376 lrc: 4/0,1 mode: PW/PW res: [0x2bb75:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.499041:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529398.499053:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53376 lrc: 3/0,1 mode: PW/PW res: [0x2bb75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529398.499055:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+14:41279:x1731746396589056:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 59us (119us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529398.499057:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53376 lrc: 3/0,1 mode: PW/PW res: [0x2bb75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529398.499059:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13344 00010000:00010000:1.0:1651529398.499061:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53376 lrc: 3/0,1 mode: PW/PW res: [0x2bb75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529398.499064:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53376 lrc: 2/0,0 mode: PW/PW res: [0x2bb75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.499097:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53376 lrc: 2/0,0 mode: PW/PW res: [0x2bb75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.499101:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004b2a6b06 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529398.499103:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53376 lrc: 2/0,0 mode: PW/PW res: [0x2bb75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.499106:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53376 lrc: 3/0,0 mode: PW/PW res: [0x2bb75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.499112:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53376 lrc: 1/0,0 mode: --/PW res: [0x2bb75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529398.499115:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53376 lrc: 0/0,0 mode: --/PW res: [0x2bb75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529398.499201:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946597824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 830us (896us total) trans 12885080693 rc 0/0 00000100:00100000:1.0:1651529398.499205:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212676 00000100:00100000:0.0:1651529399.520123:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529399.520166:0:87247:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946597952 00000100:00100000:1.0:1651529399.520197:0:87247:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 579 00000100:00100000:1.0:1651529399.520200:0:87247:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946597952:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651529399.520218:0:87247:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 8437760 granted 67229376 pending 0 free 81269321728 avail 77098610688 00000100:00100000:1.0:1651529399.520259:0:87247:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946597952:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 59us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529399.520263:0:87247:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 579 00000100:00100000:0.0:1651529401.536957:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529401.536987:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396670464 00000100:00100000:1.0:1651529401.537009:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 89 00000100:00100000:1.0:1651529401.537011:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+14:41279:x1731746396670464:12345-10.240.43.64@tcp:400:kworker/u4:2.0 00000100:00100000:1.0:1651529401.537044:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+14:41279:x1731746396670464:12345-10.240.43.64@tcp:400:kworker/u4:2.0 Request processed in 33us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529401.537048:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 89 00000100:00100000:1.0:1651529403.104289:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529403.104307:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946598080 00000100:00100000:1.0:1651529403.104326:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 90 00000100:00100000:1.0:1651529403.104328:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946598080:12345-10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00100000:1.0:1651529403.104360:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946598080:12345-10.240.43.61@tcp:400:kworker/u4:1.0 Request processed in 31us (75us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529403.104364:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 90 00000100:00100000:0.0:1651529404.323308:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529404.323322:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529404.323332:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529404.323339:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529404.323359:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529404.323368:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529404.323375:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529404.323389:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946598208 00000100:00100000:0.0:1651529404.323406:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946598336 00000100:00100000:0.0:1651529404.323410:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946598464 00000100:00100000:0.0:1651529404.323414:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946598144 00000100:00100000:0.0:1651529404.323418:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946598272 00000100:00100000:0.0:1651529404.323422:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946598400 00000100:00100000:0.0:1651529404.323424:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946598528 00000100:00100000:0.0:1651529404.323429:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212677 00000100:00100000:0.0:1651529404.323431:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946598208:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529404.323447:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179063 count 1 00010000:00010000:0.0:1651529404.323461:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c5337d lrc: 3/0,1 mode: --/PW res: [0x2bb77:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.323471:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c53345 lrc: 2/0,0 mode: PW/PW res: [0x2bb77:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da609 expref: 13 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.323475:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529404.323476:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529404.323477:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c5337d lrc: 4/0,1 mode: --/PW res: [0x2bb77:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.323492:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c53345 lrc: 3/0,0 mode: PW/PW res: [0x2bb77:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da609 expref: 13 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.323498:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c53345 lrc: 4/0,0 mode: PW/PW res: [0x2bb77:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da609 expref: 13 pid: 72395 timeout: 20162 lvb_type: 0 00000100:00100000:0.0:1651529404.323507:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001d1586f2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997071040:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529404.323538:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c2b2b59c going to sleep for 6 seconds 00000100:00100000:0.0:1651529404.323547:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212678 00000100:00100000:0.0:1651529404.323549:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946598336:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529404.323554:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179065 count 1 00010000:00010000:0.0:1651529404.323558:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c53384 lrc: 3/0,1 mode: --/PW res: [0x2bb79:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.323563:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c53353 lrc: 2/0,0 mode: PW/PW res: [0x2bb79:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->393215) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da6b1 expref: 13 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.323566:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529404.323567:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529404.323568:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c53384 lrc: 4/0,1 mode: --/PW res: [0x2bb79:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.323574:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c53353 lrc: 3/0,0 mode: PW/PW res: [0x2bb79:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->393215) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da6b1 expref: 13 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.323578:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c53353 lrc: 4/0,0 mode: PW/PW res: [0x2bb79:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->393215) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da6b1 expref: 13 pid: 72395 timeout: 20162 lvb_type: 0 00000100:00100000:0.0:1651529404.323582:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002f77bb41 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997071104:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529404.323590:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 000000003c8b0daf going to sleep for 6 seconds 00000100:00100000:0.0:1651529404.323597:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212679 00000100:00100000:0.0:1651529404.323599:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946598464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529404.323604:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179067 count 1 00010000:00010000:0.0:1651529404.323607:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c5338b lrc: 3/0,1 mode: --/PW res: [0x2bb7b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.323612:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c53361 lrc: 2/0,0 mode: PW/PW res: [0x2bb7b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->6291455) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da759 expref: 13 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.323615:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529404.323615:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529404.323616:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c5338b lrc: 4/0,1 mode: --/PW res: [0x2bb7b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.323622:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c53361 lrc: 3/0,0 mode: PW/PW res: [0x2bb7b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->6291455) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da759 expref: 13 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.323625:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c53361 lrc: 4/0,0 mode: PW/PW res: [0x2bb7b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->6291455) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da759 expref: 13 pid: 72395 timeout: 20162 lvb_type: 0 00000100:00100000:0.0:1651529404.323629:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005d3fb3ef pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997071168:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529404.323636:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000abca413e going to sleep for 6 seconds 00000100:00100000:0.0:1651529404.323642:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212680 00000100:00100000:0.0:1651529404.323644:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946598144:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529404.323648:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179062 count 1 00010000:00010000:0.0:1651529404.323652:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c53392 lrc: 3/0,1 mode: --/PW res: [0x2bb76:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.323656:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c5333e lrc: 2/0,0 mode: PW/PW res: [0x2bb76:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da5b5 expref: 13 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.323659:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529404.323660:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529404.323661:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c53392 lrc: 4/0,1 mode: --/PW res: [0x2bb76:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.323667:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c5333e lrc: 3/0,0 mode: PW/PW res: [0x2bb76:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da5b5 expref: 13 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.323670:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c5333e lrc: 4/0,0 mode: PW/PW res: [0x2bb76:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da5b5 expref: 13 pid: 72396 timeout: 20162 lvb_type: 0 00000100:00100000:0.0:1651529404.323674:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002f363f4a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997071232:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529404.323680:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000076b354b3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529404.323687:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212681 00000100:00100000:0.0:1651529404.323688:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946598272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529404.323693:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179064 count 1 00010000:00010000:0.0:1651529404.323696:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c53399 lrc: 3/0,1 mode: --/PW res: [0x2bb78:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.323700:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c5334c lrc: 2/0,0 mode: PW/PW res: [0x2bb78:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->98303) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da65d expref: 13 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.323703:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529404.323704:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529404.323704:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c53399 lrc: 4/0,1 mode: --/PW res: [0x2bb78:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.323714:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c5334c lrc: 3/0,0 mode: PW/PW res: [0x2bb78:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->98303) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da65d expref: 13 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.323717:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c5334c lrc: 4/0,0 mode: PW/PW res: [0x2bb78:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->98303) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da65d expref: 13 pid: 72396 timeout: 20162 lvb_type: 0 00000100:00100000:0.0:1651529404.323721:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000076d5f96b pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997071296:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529404.323727:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 000000001b81e4a0 going to sleep for 6 seconds 00000100:00100000:0.0:1651529404.323733:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212682 00000100:00100000:0.0:1651529404.323735:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946598400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529404.323739:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179066 count 1 00010000:00010000:0.0:1651529404.323743:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c533a0 lrc: 3/0,1 mode: --/PW res: [0x2bb7a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.323747:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c5335a lrc: 2/0,0 mode: PW/PW res: [0x2bb7a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1572863) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da705 expref: 13 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.323750:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529404.323751:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529404.323751:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c533a0 lrc: 4/0,1 mode: --/PW res: [0x2bb7a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.323757:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c5335a lrc: 3/0,0 mode: PW/PW res: [0x2bb7a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1572863) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da705 expref: 13 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.323760:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c5335a lrc: 4/0,0 mode: PW/PW res: [0x2bb7a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1572863) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da705 expref: 13 pid: 72396 timeout: 20162 lvb_type: 0 00000100:00100000:0.0:1651529404.323776:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000064719963 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997071360:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529404.323784:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 000000003678d25f going to sleep for 6 seconds 00000100:00100000:0.0:1651529404.323791:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212683 00000100:00100000:0.0:1651529404.323793:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946598528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529404.323799:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179068 count 1 00010000:00010000:0.0:1651529404.323802:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c533a7 lrc: 3/0,1 mode: --/PW res: [0x2bb7c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.323807:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c53368 lrc: 2/0,0 mode: PW/PW res: [0x2bb7c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->25165823) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da7ad expref: 13 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.323810:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529404.323810:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529404.323811:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c533a7 lrc: 4/0,1 mode: --/PW res: [0x2bb7c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.323817:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c53368 lrc: 3/0,0 mode: PW/PW res: [0x2bb7c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->25165823) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da7ad expref: 13 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.323820:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c53368 lrc: 4/0,0 mode: PW/PW res: [0x2bb7c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->25165823) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da7ad expref: 13 pid: 72395 timeout: 20162 lvb_type: 0 00000100:00100000:0.0:1651529404.323824:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000be0ace91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997071424:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529404.323831:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ff7bf023 going to sleep for 6 seconds 00000100:00100000:0.0:1651529404.324385:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002f363f4a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997071232:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529404.324393:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c53392 lrc: 3/0,1 mode: --/PW res: [0x2bb76:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529404.324402:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005d3fb3ef pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997071168:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529404.324404:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c5338b lrc: 3/0,1 mode: --/PW res: [0x2bb7b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529404.324410:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000be0ace91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997071424:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529404.324412:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c533a7 lrc: 3/0,1 mode: --/PW res: [0x2bb7c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529404.324418:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000076d5f96b pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997071296:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529404.324420:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c53399 lrc: 3/0,1 mode: --/PW res: [0x2bb78:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529404.324426:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002f77bb41 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997071104:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529404.324428:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c53384 lrc: 3/0,1 mode: --/PW res: [0x2bb79:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529404.324433:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000064719963 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997071360:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529404.324435:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c533a0 lrc: 3/0,1 mode: --/PW res: [0x2bb7a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529404.324441:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001d1586f2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997071040:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529404.324445:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c5337d lrc: 3/0,1 mode: --/PW res: [0x2bb77:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529404.324650:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529404.324659:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529404.324669:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529404.324678:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529404.324687:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529404.324692:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529404.324698:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529404.324704:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396677696 00010000:00010000:0.0:1651529404.324712:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c53353 lrc: 4/0,0 mode: PW/PW res: [0x2bb79:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->393215) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da6b1 expref: 14 pid: 72395 timeout: 20162 lvb_type: 0 00000100:00100000:0.0:1651529404.324719:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396677824 00010000:00010000:0.0:1651529404.324722:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c5333e lrc: 4/0,0 mode: PW/PW res: [0x2bb76:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da5b5 expref: 15 pid: 72396 timeout: 20162 lvb_type: 0 00000100:00100000:0.0:1651529404.324726:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396677952 00010000:00010000:0.0:1651529404.324728:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c5335a lrc: 4/0,0 mode: PW/PW res: [0x2bb7a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1572863) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da705 expref: 16 pid: 72396 timeout: 20162 lvb_type: 0 00000100:00100000:0.0:1651529404.324732:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396677632 00010000:00010000:0.0:1651529404.324734:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c53345 lrc: 4/0,0 mode: PW/PW res: [0x2bb77:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da609 expref: 17 pid: 72395 timeout: 20162 lvb_type: 0 00000100:00100000:0.0:1651529404.324738:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396677760 00010000:00010000:0.0:1651529404.324740:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c53361 lrc: 4/0,0 mode: PW/PW res: [0x2bb7b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->6291455) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da759 expref: 18 pid: 72395 timeout: 20162 lvb_type: 0 00000100:00100000:0.0:1651529404.324747:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396677888 00010000:00010000:0.0:1651529404.324749:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c5334c lrc: 4/0,0 mode: PW/PW res: [0x2bb78:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->98303) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da65d expref: 19 pid: 72396 timeout: 20162 lvb_type: 0 00000100:00100000:0.0:1651529404.324753:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396678016 00010000:00010000:0.0:1651529404.324754:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c53368 lrc: 4/0,0 mode: PW/PW res: [0x2bb7c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->25165823) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da7ad expref: 20 pid: 72395 timeout: 20162 lvb_type: 0 00000100:00100000:0.0:1651529404.324759:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13345 00000100:00100000:0.0:1651529404.324761:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+20:41278:x1731746396677696:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529404.324775:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529404.324776:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c53353 lrc: 4/0,0 mode: PW/PW res: [0x2bb79:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->393215) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da6b1 expref: 20 pid: 72395 timeout: 20162 lvb_type: 0 00010000:00010000:0.0:1651529404.324781:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c53353 lrc: 3/0,0 mode: PW/PW res: [0x2bb79:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->393215) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da6b1 expref: 20 pid: 72395 timeout: 20162 lvb_type: 0 00010000:00010000:0.0:1651529404.324791:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c53353 lrc: 0/0,0 mode: --/PW res: [0x2bb79:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->393215) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da6b1 expref: 20 pid: 72395 timeout: 20162 lvb_type: 0 00010000:00010000:0.0:1651529404.324795:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529404.324796:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529404.324797:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c53384 lrc: 3/0,1 mode: PW/PW res: [0x2bb79:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.324801:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c53384 lrc: 4/0,1 mode: PW/PW res: [0x2bb79:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.324809:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529404.324820:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+19:41278:x1731746396677696:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 58us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529404.324823:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13345 00000100:00100000:0.0:1651529404.324829:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13346 00000100:00100000:0.0:1651529404.324831:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+18:41278:x1731746396677824:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529404.324834:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529404.324835:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c5333e lrc: 4/0,0 mode: PW/PW res: [0x2bb76:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da5b5 expref: 18 pid: 72396 timeout: 20162 lvb_type: 0 00010000:00010000:0.0:1651529404.324839:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c5333e lrc: 3/0,0 mode: PW/PW res: [0x2bb76:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da5b5 expref: 18 pid: 72396 timeout: 20162 lvb_type: 0 00010000:00010000:0.0:1651529404.324843:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c5333e lrc: 0/0,0 mode: --/PW res: [0x2bb76:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da5b5 expref: 18 pid: 72396 timeout: 20162 lvb_type: 0 00010000:00010000:0.0:1651529404.324847:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529404.324848:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529404.324848:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c53392 lrc: 3/0,1 mode: PW/PW res: [0x2bb76:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.324851:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c53392 lrc: 4/0,1 mode: PW/PW res: [0x2bb76:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.324857:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529404.324861:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+17:41278:x1731746396677824:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 30us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529404.324864:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13346 00000100:00100000:0.0:1651529404.324868:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13347 00000100:00100000:0.0:1651529404.324869:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+16:41278:x1731746396677952:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529404.324871:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529404.324873:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c5335a lrc: 4/0,0 mode: PW/PW res: [0x2bb7a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1572863) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da705 expref: 16 pid: 72396 timeout: 20162 lvb_type: 0 00010000:00010000:0.0:1651529404.324876:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c5335a lrc: 3/0,0 mode: PW/PW res: [0x2bb7a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1572863) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da705 expref: 16 pid: 72396 timeout: 20162 lvb_type: 0 00010000:00010000:0.0:1651529404.324880:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c5335a lrc: 0/0,0 mode: --/PW res: [0x2bb7a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1572863) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da705 expref: 16 pid: 72396 timeout: 20162 lvb_type: 0 00010000:00010000:0.0:1651529404.324884:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529404.324884:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529404.324885:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c533a0 lrc: 3/0,1 mode: PW/PW res: [0x2bb7a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.324887:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c533a0 lrc: 4/0,1 mode: PW/PW res: [0x2bb7a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.324893:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529404.324897:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+15:41278:x1731746396677952:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 28us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529404.324900:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13347 00000100:00100000:0.0:1651529404.324903:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13348 00000100:00100000:0.0:1651529404.324905:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+14:41278:x1731746396677632:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529404.324907:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529404.324908:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c53345 lrc: 4/0,0 mode: PW/PW res: [0x2bb77:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da609 expref: 14 pid: 72395 timeout: 20162 lvb_type: 0 00010000:00010000:0.0:1651529404.324912:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c53345 lrc: 3/0,0 mode: PW/PW res: [0x2bb77:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da609 expref: 14 pid: 72395 timeout: 20162 lvb_type: 0 00010000:00010000:0.0:1651529404.324916:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c53345 lrc: 0/0,0 mode: --/PW res: [0x2bb77:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->24575) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da609 expref: 14 pid: 72395 timeout: 20162 lvb_type: 0 00010000:00010000:0.0:1651529404.324919:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529404.324920:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529404.324921:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c5337d lrc: 3/0,1 mode: PW/PW res: [0x2bb77:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.324923:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c5337d lrc: 4/0,1 mode: PW/PW res: [0x2bb77:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.324929:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529404.324933:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+13:41278:x1731746396677632:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 27us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529404.324935:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13348 00000100:00100000:0.0:1651529404.324938:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13349 00000100:00100000:0.0:1651529404.324940:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ce633b1f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+12:41278:x1731746396677760:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529404.324941:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529404.324943:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c53361 lrc: 4/0,0 mode: PW/PW res: [0x2bb7b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->6291455) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da759 expref: 12 pid: 72395 timeout: 20162 lvb_type: 0 00010000:00010000:0.0:1651529404.324949:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c53361 lrc: 3/0,0 mode: PW/PW res: [0x2bb7b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->6291455) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da759 expref: 12 pid: 72395 timeout: 20162 lvb_type: 0 00010000:00010000:0.0:1651529404.324953:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c53361 lrc: 0/0,0 mode: --/PW res: [0x2bb7b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->6291455) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da759 expref: 12 pid: 72395 timeout: 20162 lvb_type: 0 00010000:00010000:0.0:1651529404.324956:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529404.324957:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529404.324957:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c5338b lrc: 3/0,1 mode: PW/PW res: [0x2bb7b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.324960:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c5338b lrc: 4/0,1 mode: PW/PW res: [0x2bb7b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.324965:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529404.324969:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ce633b1f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+11:41278:x1731746396677760:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 29us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529404.324971:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13349 00000100:00100000:0.0:1651529404.324980:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13350 00000100:00100000:0.0:1651529404.324982:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+10:41278:x1731746396677888:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529404.324984:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529404.324985:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c5334c lrc: 4/0,0 mode: PW/PW res: [0x2bb78:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->98303) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da65d expref: 10 pid: 72396 timeout: 20162 lvb_type: 0 00010000:00010000:0.0:1651529404.324988:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c5334c lrc: 3/0,0 mode: PW/PW res: [0x2bb78:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->98303) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da65d expref: 10 pid: 72396 timeout: 20162 lvb_type: 0 00010000:00010000:0.0:1651529404.324996:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c5334c lrc: 0/0,0 mode: --/PW res: [0x2bb78:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->98303) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da65d expref: 10 pid: 72396 timeout: 20162 lvb_type: 0 00010000:00010000:0.0:1651529404.324999:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529404.325000:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529404.325000:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c53399 lrc: 3/0,1 mode: PW/PW res: [0x2bb78:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325003:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c53399 lrc: 4/0,1 mode: PW/PW res: [0x2bb78:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325008:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529404.325013:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+9:41278:x1731746396677888:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 30us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529404.325015:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13350 00000100:00100000:0.0:1651529404.325018:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13351 00000100:00100000:0.0:1651529404.325020:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+8:41278:x1731746396678016:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529404.325022:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529404.325023:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c53368 lrc: 4/0,0 mode: PW/PW res: [0x2bb7c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->25165823) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da7ad expref: 8 pid: 72395 timeout: 20162 lvb_type: 0 00010000:00010000:0.0:1651529404.325026:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c53368 lrc: 3/0,0 mode: PW/PW res: [0x2bb7c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->25165823) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da7ad expref: 8 pid: 72395 timeout: 20162 lvb_type: 0 00010000:00010000:0.0:1651529404.325031:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c53368 lrc: 0/0,0 mode: --/PW res: [0x2bb7c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->25165823) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da7ad expref: 8 pid: 72395 timeout: 20162 lvb_type: 0 00010000:00010000:0.0:1651529404.325036:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529404.325037:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529404.325038:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c533a7 lrc: 3/0,1 mode: PW/PW res: [0x2bb7c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325040:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c533a7 lrc: 4/0,1 mode: PW/PW res: [0x2bb7c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325045:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529404.325049:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+7:41278:x1731746396678016:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 29us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529404.325051:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13351 00010000:00010000:0.0:1651529404.325057:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c53399 lrc: 3/0,1 mode: PW/PW res: [0x2bb78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325060:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c53399 lrc: 3/0,1 mode: PW/PW res: [0x2bb78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325064:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c53399 lrc: 3/0,1 mode: PW/PW res: [0x2bb78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325067:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c53399 lrc: 2/0,0 mode: PW/PW res: [0x2bb78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529404.325174:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946598272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1484us (1814us total) trans 12885080694 rc 0/0 00000100:00100000:0.0:1651529404.325177:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212681 00010000:00010000:0.0:1651529404.325186:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c53399 lrc: 2/0,0 mode: PW/PW res: [0x2bb78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325190:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042bde05b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529404.325191:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c53399 lrc: 2/0,0 mode: PW/PW res: [0x2bb78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325195:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c53399 lrc: 3/0,0 mode: PW/PW res: [0x2bb78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325200:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c53399 lrc: 1/0,0 mode: --/PW res: [0x2bb78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325203:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c53399 lrc: 0/0,0 mode: --/PW res: [0x2bb78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325436:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c5338b lrc: 3/0,1 mode: PW/PW res: [0x2bb7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325440:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c5338b lrc: 3/0,1 mode: PW/PW res: [0x2bb7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325444:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c5338b lrc: 3/0,1 mode: PW/PW res: [0x2bb7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325447:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c5338b lrc: 2/0,0 mode: PW/PW res: [0x2bb7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325463:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c5338b lrc: 2/0,0 mode: PW/PW res: [0x2bb7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325466:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005b8e72f9 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529404.325467:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c5338b lrc: 2/0,0 mode: PW/PW res: [0x2bb7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325470:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c5338b lrc: 3/0,0 mode: PW/PW res: [0x2bb7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325475:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c5338b lrc: 1/0,0 mode: --/PW res: [0x2bb7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325478:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c5338b lrc: 0/0,0 mode: --/PW res: [0x2bb7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325483:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c533a7 lrc: 3/0,1 mode: PW/PW res: [0x2bb7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325486:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c533a7 lrc: 3/0,1 mode: PW/PW res: [0x2bb7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325489:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c533a7 lrc: 3/0,1 mode: PW/PW res: [0x2bb7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325492:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c533a7 lrc: 2/0,0 mode: PW/PW res: [0x2bb7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325524:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c533a7 lrc: 2/0,0 mode: PW/PW res: [0x2bb7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325527:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003c075ac0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529404.325528:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c533a7 lrc: 2/0,0 mode: PW/PW res: [0x2bb7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325531:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c533a7 lrc: 3/0,0 mode: PW/PW res: [0x2bb7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325535:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c533a7 lrc: 1/0,0 mode: --/PW res: [0x2bb7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325538:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c533a7 lrc: 0/0,0 mode: --/PW res: [0x2bb7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325544:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c53384 lrc: 3/0,1 mode: PW/PW res: [0x2bb79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325547:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c53384 lrc: 3/0,1 mode: PW/PW res: [0x2bb79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325550:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c53384 lrc: 3/0,1 mode: PW/PW res: [0x2bb79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325553:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c53384 lrc: 2/0,0 mode: PW/PW res: [0x2bb79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325564:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c53384 lrc: 2/0,0 mode: PW/PW res: [0x2bb79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325567:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005e711cee already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529404.325568:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c53384 lrc: 2/0,0 mode: PW/PW res: [0x2bb79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325571:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c53384 lrc: 3/0,0 mode: PW/PW res: [0x2bb79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325575:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c53384 lrc: 1/0,0 mode: --/PW res: [0x2bb79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325577:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c53384 lrc: 0/0,0 mode: --/PW res: [0x2bb79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325582:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c533a0 lrc: 3/0,1 mode: PW/PW res: [0x2bb7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325585:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c533a0 lrc: 3/0,1 mode: PW/PW res: [0x2bb7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325587:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c533a0 lrc: 3/0,1 mode: PW/PW res: [0x2bb7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325590:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c533a0 lrc: 2/0,0 mode: PW/PW res: [0x2bb7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325600:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c533a0 lrc: 2/0,0 mode: PW/PW res: [0x2bb7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325603:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cde66bc6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529404.325604:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c533a0 lrc: 2/0,0 mode: PW/PW res: [0x2bb7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325607:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c533a0 lrc: 3/0,0 mode: PW/PW res: [0x2bb7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325610:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c533a0 lrc: 1/0,0 mode: --/PW res: [0x2bb7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325613:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c533a0 lrc: 0/0,0 mode: --/PW res: [0x2bb7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325617:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c53392 lrc: 3/0,1 mode: PW/PW res: [0x2bb76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325620:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c53392 lrc: 3/0,1 mode: PW/PW res: [0x2bb76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325623:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c53392 lrc: 3/0,1 mode: PW/PW res: [0x2bb76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325625:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c53392 lrc: 2/0,0 mode: PW/PW res: [0x2bb76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325635:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c53392 lrc: 2/0,0 mode: PW/PW res: [0x2bb76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325638:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c822bd1c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529404.325639:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c53392 lrc: 2/0,0 mode: PW/PW res: [0x2bb76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325642:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c53392 lrc: 3/0,0 mode: PW/PW res: [0x2bb76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325645:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c53392 lrc: 1/0,0 mode: --/PW res: [0x2bb76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.325648:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c53392 lrc: 0/0,0 mode: --/PW res: [0x2bb76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529404.329565:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:39030:x1731745946598528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 5770us (6189us total) trans 12885080695 rc 0/0 00000100:00100000:0.0:1651529404.329569:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212683 00000100:00100000:0.0:1651529404.329600:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+16:39030:x1731745946598336:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 6050us (6277us total) trans 12885080696 rc 0/0 00000100:00100000:0.0:1651529404.329603:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212678 00000100:00100000:0.0:1651529404.330319:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+15:39030:x1731745946598464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 6719us (6987us total) trans 12885080697 rc 0/0 00000100:00100000:0.0:1651529404.330323:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212679 00000100:00100000:0.0:1651529404.330348:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:39030:x1731745946598400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 6613us (6980us total) trans 12885080698 rc 0/0 00000100:00100000:0.0:1651529404.330351:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212682 00000100:00100000:0.0:1651529404.330371:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946598144:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 6727us (7031us total) trans 12885080699 rc 0/0 00000100:00100000:0.0:1651529404.330374:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212680 00010000:00010000:0.0:1651529404.330379:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c5337d lrc: 3/0,1 mode: PW/PW res: [0x2bb77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.330384:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c5337d lrc: 3/0,1 mode: PW/PW res: [0x2bb77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.330387:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c5337d lrc: 3/0,1 mode: PW/PW res: [0x2bb77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.330390:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c5337d lrc: 2/0,0 mode: PW/PW res: [0x2bb77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529404.330438:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946598208:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 7006us (7134us total) trans 12885080700 rc 0/0 00000100:00100000:0.0:1651529404.330441:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212677 00010000:00010000:0.0:1651529404.330449:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c5337d lrc: 2/0,0 mode: PW/PW res: [0x2bb77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.330452:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000916cff2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529404.330454:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c5337d lrc: 2/0,0 mode: PW/PW res: [0x2bb77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.330457:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c5337d lrc: 3/0,0 mode: PW/PW res: [0x2bb77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.330464:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c5337d lrc: 1/0,0 mode: --/PW res: [0x2bb77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529404.330467:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c5337d lrc: 0/0,0 mode: --/PW res: [0x2bb77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000400:00000080:1.0:1651529405.984510:0:159212:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651529405.984512:0:159212:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 130a: FIEMAP (1-stripe file) ============== 22:10:05 (1651529405) 00000400:00000080:1.0:1651529407.307995:0:159430:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651529407.307998:0:159430:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 130b: FIEMAP (2-stripe file) ============== 22:10:07 (1651529407) 00000100:00100000:0.0:1651529407.342468:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529407.342486:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396767360 00000100:00100000:0.0:1651529407.342504:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212684 00000100:00100000:0.0:1651529407.342507:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+7:419000:x1731746396767360:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529407.342516:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529407.342527:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c533ae lrc: 2/0,0 mode: --/PW res: [0x2bb81:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc17d expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529407.342538:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb81:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529407.342547:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529407.342548:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529407.342552:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c533ae lrc: 3/0,0 mode: PW/PW res: [0x2bb81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc17d expref: 8 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529407.342559:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c533ae lrc: 3/0,0 mode: PW/PW res: [0x2bb81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc17d expref: 8 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529407.342565:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000cde66bc6, rc 0) 00000100:00100000:0.0:1651529407.342586:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+8:419000:x1731746396767360:12345-10.240.43.64@tcp:101:dd.0 Request processed in 78us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529407.342591:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212684 00000100:00100000:0.0:1651529407.342862:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529407.342889:0:77219:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396767488 00002000:00010000:1.0:1651529407.342902:0:77219:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179073/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529407.342903:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000be0ace91 with x1731746396767488 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529407.342908:0:77219:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000be0ace91. 00000100:00100000:1.0:1651529407.342917:0:77219:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18682 00000100:00100000:1.0:1651529407.342919:0:77219:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+8:41278:x1731746396767488:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529407.342978:0:77219:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bb81:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529407.342980:0:77219:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bb81:0x0] updating lvb mtime from disk: 0 -> 1651529407 00002000:00010000:1.0:1651529407.342981:0:77219:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bb81:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529407.342981:0:77219:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bb81:0x0] updating lvb ctime from disk: 0 -> 1651529407 00002000:00010000:1.0:1651529407.342982:0:77219:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bb81:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529407.343004:0:77219:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+9:41278:x1731746396767488:12345-10.240.43.64@tcp:10:dd.0 Request processed in 84us (142us total) trans 12885080701 rc 0/0 00000100:00100000:1.0:1651529407.343008:0:77219:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18682 00002000:00010000:1.0:1651529407.343009:0:77219:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179073/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529407.343010:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000be0ace91 with x1731746396767488 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529407.343012:0:77219:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000be0ace91. 00000100:00100000:0.0:1651529407.357422:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529407.357446:0:77218:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396768000 00002000:00100000:1.0:1651529407.357456:0:77218:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x2bb81:0x0] (0->1048575) req@00000000d28c414b x1731746396768000/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:133/0 lens 488/0 e 0 to 0 dl 1651529413 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529407.357461:0:77218:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d28c414b with x1731746396768000 ext(0->1048575) 00002000:00010000:1.0:1651529407.357463:0:77218:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000d28c414b 00000100:00100000:1.0:1651529407.357470:0:77218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18683 00000100:00100000:1.0:1651529407.357472:0:77218:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+9:41279:x1731746396768000:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529407.360061:0:77218:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+11:41279:x1731746396768000:12345-10.240.43.64@tcp:4:dd.0 Request processed in 2588us (2639us total) trans 12885080702 rc 0/0 00000100:00100000:1.0:1651529407.360066:0:77218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18683 00002000:00100000:1.0:1651529407.360069:0:77218:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x2bb81:0x0] (0->1048575) req@00000000d28c414b x1731746396768000/t12885080702(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:133/0 lens 488/448 e 0 to 0 dl 1651529413 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529407.360073:0:77218:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d28c414b with x1731746396768000 ext(0->1048575) 00002000:00010000:1.0:1651529407.360075:0:77218:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000d28c414b 00000100:00100000:0.0:1651529407.361036:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529407.361051:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396768192 00000100:00100000:0.0:1651529407.361060:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212685 00000100:00100000:0.0:1651529407.361062:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad15c052 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+11:419001:x1731746396768192:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529407.361104:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad15c052 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+11:419001:x1731746396768192:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 41us (69us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529407.361108:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212685 00000100:00100000:0.0:1651529407.367119:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529407.367127:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396768384 00000100:00100000:0.0:1651529407.367135:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212686 00000100:00100000:0.0:1651529407.367137:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+11:419003:x1731746396768384:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529407.367155:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+11:419003:x1731746396768384:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (37us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529407.367158:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212686 00000100:00100000:1.0:1651529408.224283:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529408.224372:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946598848 00000100:00100000:1.0:1651529408.224397:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 91 00000100:00100000:1.0:1651529408.224400:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:39029:x1731745946598848:12345-10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:1.0:1651529408.224434:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:39029:x1731745946598848:12345-10.240.43.61@tcp:400:kworker/u4:0.0 Request processed in 34us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529408.224438:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 91 00000400:00000080:1.0:1651529408.648606:0:159649:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651529408.648608:0:159649:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 130c: FIEMAP (2-stripe file with hole) ==== 22:10:08 (1651529408) 00000100:00100000:1.0:1651529408.674385:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529408.674402:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946598976 00000100:00100000:1.0:1651529408.674420:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212687 00000100:00100000:1.0:1651529408.674423:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:137466:x1731745946598976:12345-10.240.43.61@tcp:5:osp-pre-1-0.0 00002000:00080000:1.0:1651529408.674446:0:151609:0:(ofd_dev.c:1706:ofd_create_hdl()) lustre-OST0001: reserve 64 objects in group 0x0 at 179106 00000100:00100000:1.0:1651529408.675480:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:137466:x1731745946598976:12345-10.240.43.61@tcp:5:osp-pre-1-0.0 Request processed in 1056us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529408.675485:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212687 00000100:00100000:1.0:1651529408.691754:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529408.691763:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396769600 00000100:00100000:1.0:1651529408.691781:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212688 00000100:00100000:1.0:1651529408.691783:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+11:419624:x1731746396769600:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:1.0:1651529408.691789:0:106695:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529408.691799:0:106695:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c533b5 lrc: 2/0,0 mode: --/PW res: [0x2bb82:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc1bc expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529408.691809:0:106695:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb82:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529408.691817:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529408.691818:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529408.691822:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c533b5 lrc: 3/0,0 mode: PW/PW res: [0x2bb82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc1bc expref: 12 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529408.691829:0:106695:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c533b5 lrc: 3/0,0 mode: PW/PW res: [0x2bb82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc1bc expref: 12 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529408.691834:0:106695:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ba437fe0, rc 0) 00000100:00100000:1.0:1651529408.691845:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+12:419624:x1731746396769600:12345-10.240.43.64@tcp:101:dd.0 Request processed in 62us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529408.691849:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212688 00000100:00100000:1.0:1651529408.692481:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529408.692491:0:77218:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396769728 00002000:00010000:1.0:1651529408.692499:0:77218:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179074/0 (524288->18446744073709551615) 00002000:00100000:1.0:1651529408.692500:0:77218:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000012863683 with x1731746396769728 ext(524288->18446744073709551615) 00002000:00010000:1.0:1651529408.692504:0:77218:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000012863683. 00000100:00100000:1.0:1651529408.692511:0:77218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18684 00000100:00100000:1.0:1651529408.692512:0:77218:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+12:41279:x1731746396769728:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529408.692560:0:77218:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bb82:0x0] updating lvb size from disk: 0 -> 524288 00002000:00010000:1.0:1651529408.692562:0:77218:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bb82:0x0] updating lvb mtime from disk: 0 -> 1651529408 00002000:00010000:1.0:1651529408.692563:0:77218:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bb82:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529408.692564:0:77218:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bb82:0x0] updating lvb ctime from disk: 0 -> 1651529408 00002000:00010000:1.0:1651529408.692565:0:77218:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bb82:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529408.692577:0:77218:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012863683 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+13:41279:x1731746396769728:12345-10.240.43.64@tcp:10:dd.0 Request processed in 63us (96us total) trans 12885080703 rc 0/0 00000100:00100000:1.0:1651529408.692580:0:77218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18684 00002000:00010000:1.0:1651529408.692581:0:77218:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179074/0 (524288->18446744073709551615) 00002000:00100000:1.0:1651529408.692582:0:77218:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000012863683 with x1731746396769728 ext(524288->18446744073709551615) 00002000:00010000:1.0:1651529408.692583:0:77218:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000012863683. 00000100:00100000:1.0:1651529408.702702:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529408.702710:0:77219:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396770176 00002000:00100000:1.0:1651529408.702720:0:77219:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x100010000:0x2bb82:0x0] (524288->1048575) req@00000000dd68fdd5 x1731746396770176/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:134/0 lens 488/0 e 0 to 0 dl 1651529414 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529408.702724:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000dd68fdd5 with x1731746396770176 ext(524288->1048575) 00002000:00010000:1.0:1651529408.702726:0:77219:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000dd68fdd5 00000100:00100000:1.0:1651529408.702732:0:77219:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18685 00000100:00100000:1.0:1651529408.702734:0:77219:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+13:41278:x1731746396770176:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529408.704457:0:77219:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd68fdd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+15:41278:x1731746396770176:12345-10.240.43.64@tcp:4:dd.0 Request processed in 1721us (1755us total) trans 12885080704 rc 0/0 00000100:00100000:1.0:1651529408.704461:0:77219:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18685 00002000:00100000:1.0:1651529408.704464:0:77219:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x100010000:0x2bb82:0x0] (524288->1048575) req@00000000dd68fdd5 x1731746396770176/t12885080704(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:134/0 lens 488/448 e 0 to 0 dl 1651529414 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529408.704468:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000dd68fdd5 with x1731746396770176 ext(524288->1048575) 00002000:00010000:1.0:1651529408.704470:0:77219:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000dd68fdd5 00000100:00100000:1.0:1651529408.704941:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529408.704950:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396770304 00000100:00100000:1.0:1651529408.704957:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212689 00000100:00100000:1.0:1651529408.704959:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+15:419625:x1731746396770304:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:1.0:1651529408.704983:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+15:419625:x1731746396770304:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 23us (43us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529408.704986:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212689 00000100:00100000:1.0:1651529408.705232:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529408.705241:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396770368 00000100:00100000:1.0:1651529408.705248:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212690 00000100:00100000:1.0:1651529408.705249:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+15:419625:x1731746396770368:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:1.0:1651529408.705268:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+15:419625:x1731746396770368:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (47us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529408.705271:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212690 00000100:00100000:1.0:1651529408.710071:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529408.710079:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396770496 00000100:00100000:1.0:1651529408.710086:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212691 00000100:00100000:1.0:1651529408.710088:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000950a0e43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+15:419627:x1731746396770496:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:1.0:1651529408.710119:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000950a0e43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+15:419627:x1731746396770496:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 30us (49us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529408.710123:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212691 00000100:00100000:1.0:1651529408.711180:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529408.711188:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396770560 00000100:00100000:1.0:1651529408.711195:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212692 00000100:00100000:1.0:1651529408.711196:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+15:419627:x1731746396770560:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:1.0:1651529408.711213:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+15:419627:x1731746396770560:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 16us (33us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529408.711215:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212692 00000100:00100000:1.0:1651529409.760203:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529409.760219:0:87247:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946599040 00000100:00100000:1.0:1651529409.760251:0:87247:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 581 00000100:00100000:1.0:1651529409.760254:0:87247:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+11:39029:x1731745946599040:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651529409.760267:0:87247:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 548864 granted 84107200 pending 1622016 free 81326993408 avail 77156282368 00000100:00100000:1.0:1651529409.760293:0:87247:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+11:39029:x1731745946599040:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 39us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529409.760296:0:87247:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 581 00000400:00000080:1.0:1651529409.991553:0:159867:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651529409.991555:0:159867:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 130d: FIEMAP (N-stripe file) ============== 22:10:09 (1651529409) 00000001:00080000:0.0:1651529410.257302:0:72382:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 12885080704 is committed 00000001:00080000:0.0:1651529410.257312:0:72382:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 12885080700 is committed 00000400:00000080:0.0:1651529410.296966:0:159921:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651529410.296968:0:159921:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity test_130d needs >= 3 OSTs 00000400:00000080:0.0:1651529410.636448:0:159975:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651529410.636450:0:159975:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 130e: FIEMAP (test continuation FIEMAP calls) ========================================================== 22:10:10 (1651529410) 00000100:00100000:1.0:1651529410.670235:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529410.670266:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396771840 00000100:00100000:0.0:1651529410.670290:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212693 00000100:00100000:0.0:1651529410.670293:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+9:420547:x1731746396771840:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529410.670303:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529410.670314:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c533bc lrc: 2/0,0 mode: --/PW res: [0x2bb83:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc209 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529410.670325:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb83:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529410.670335:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529410.670336:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529410.670341:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c533bc lrc: 3/0,0 mode: PW/PW res: [0x2bb83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->65535) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc209 expref: 10 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529410.670349:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c533bc lrc: 3/0,0 mode: PW/PW res: [0x2bb83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->65535) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc209 expref: 10 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529410.670354:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003c075ac0, rc 0) 00000100:00100000:0.0:1651529410.670382:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+10:420547:x1731746396771840:12345-10.240.43.64@tcp:101:dd.0 Request processed in 88us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529410.670385:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212693 00000100:00100000:1.0:1651529411.860091:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529411.860103:0:77219:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396772608 00002000:00100000:1.0:1651529411.860117:0:77219:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x100010000:0x2bb83:0x0] (0->8323071) req@00000000f99b3c22 x1731746396772608/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:137/0 lens 1496/0 e 0 to 0 dl 1651529417 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529411.860123:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f99b3c22 with x1731746396772608 ext(0->8323071) 00002000:00010000:1.0:1651529411.860125:0:77219:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f99b3c22 00000100:00100000:1.0:1651529411.860133:0:77219:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18686 00000100:00100000:1.0:1651529411.860135:0:77219:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+10:41279:x1731746396772608:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529411.866418:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529411.866429:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529411.866437:0:77218:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396772672 00000100:00100000:1.0:1651529411.866439:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529411.866450:0:77221:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396772736 00002000:00100000:0.0:1651529411.866456:0:77218:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x2bb83:0x0] (8388608->16711679) req@000000006e255cae x1731746396772672/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:137/0 lens 1496/0 e 0 to 0 dl 1651529417 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529411.866459:0:77221:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x2bb83:0x0] (16777216->25100287) req@00000000a925fbf6 x1731746396772736/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:137/0 lens 1496/0 e 0 to 0 dl 1651529417 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529411.866461:0:77218:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006e255cae with x1731746396772672 ext(8388608->16711679) 00002000:00010000:0.0:1651529411.866463:0:77218:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000006e255cae 00002000:00100000:1.0:1651529411.866464:0:77221:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a925fbf6 with x1731746396772736 ext(16777216->25100287) 00002000:00010000:1.0:1651529411.866466:0:77221:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000a925fbf6 00000100:00100000:0.0:1651529411.866481:0:77218:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396772800 00002000:00100000:0.0:1651529411.866486:0:77218:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x2bb83:0x0] (25165824->33488895) req@000000004bb67ba4 x1731746396772800/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:137/0 lens 1496/0 e 0 to 0 dl 1651529417 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00000100:00100000:1.0:1651529411.866489:0:77221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18687 00002000:00100000:0.0:1651529411.866490:0:77218:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004bb67ba4 with x1731746396772800 ext(25165824->33488895) 00000100:00100000:1.0:1651529411.866491:0:77221:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+14:41278:x1731746396772672:12345-10.240.43.64@tcp:4:dd.0 00002000:00010000:0.0:1651529411.866491:0:77218:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000004bb67ba4 00000100:00100000:0.0:1651529411.866503:0:77218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18688 00000100:00100000:0.0:1651529411.866505:0:77218:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+14:41278:x1731746396772736:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529411.867248:0:72401:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18689 00000100:00100000:1.0:1651529411.867250:0:72401:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+16:41279:x1731746396772800:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529411.870454:0:77219:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+18:41279:x1731746396772608:12345-10.240.43.64@tcp:4:dd.0 Request processed in 10316us (10362us total) trans 12885080705 rc 0/0 00000100:00100000:0.0:1651529411.870460:0:77219:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18686 00002000:00100000:0.0:1651529411.870465:0:77219:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x100010000:0x2bb83:0x0] (0->8323071) req@00000000f99b3c22 x1731746396772608/t12885080705(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:137/0 lens 1496/696 e 0 to 0 dl 1651529417 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529411.870470:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f99b3c22 with x1731746396772608 ext(0->8323071) 00002000:00010000:0.0:1651529411.870472:0:77219:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f99b3c22 00000100:00100000:1.0:1651529411.876689:0:77221:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+18:41278:x1731746396772672:12345-10.240.43.64@tcp:4:dd.0 Request processed in 10195us (10270us total) trans 12885080706 rc 0/0 00000100:00100000:1.0:1651529411.876696:0:77221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18687 00002000:00100000:1.0:1651529411.876702:0:77221:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x2bb83:0x0] (8388608->16711679) req@000000006e255cae x1731746396772672/t12885080706(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:137/0 lens 1496/696 e 0 to 0 dl 1651529417 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529411.876707:0:77221:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006e255cae with x1731746396772672 ext(8388608->16711679) 00002000:00010000:1.0:1651529411.876710:0:77221:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000006e255cae 00000100:00100000:0.0:1651529411.882464:0:77218:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+18:41278:x1731746396772736:12345-10.240.43.64@tcp:4:dd.0 Request processed in 15954us (16031us total) trans 12885080707 rc 0/0 00000100:00100000:0.0:1651529411.882470:0:77218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18688 00002000:00100000:0.0:1651529411.882477:0:77218:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x2bb83:0x0] (16777216->25100287) req@00000000a925fbf6 x1731746396772736/t12885080707(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:137/0 lens 1496/696 e 0 to 0 dl 1651529417 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529411.882482:0:77218:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a925fbf6 with x1731746396772736 ext(16777216->25100287) 00002000:00010000:0.0:1651529411.882485:0:77218:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000a925fbf6 00000100:00100000:1.0:1651529411.884961:0:72401:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004bb67ba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+18:41279:x1731746396772800:12345-10.240.43.64@tcp:4:dd.0 Request processed in 17707us (18519us total) trans 12885080708 rc 0/0 00000100:00100000:1.0:1651529411.884968:0:72401:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18689 00002000:00100000:1.0:1651529411.884973:0:72401:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x100010000:0x2bb83:0x0] (25165824->33488895) req@000000004bb67ba4 x1731746396772800/t12885080708(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:137/0 lens 1496/696 e 0 to 0 dl 1651529417 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529411.884980:0:72401:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004bb67ba4 with x1731746396772800 ext(25165824->33488895) 00002000:00010000:1.0:1651529411.884983:0:72401:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000004bb67ba4 00000100:00100000:1.0:1651529411.888887:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529411.888921:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396773184 00000100:00100000:0.0:1651529411.888944:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212694 00000100:00100000:0.0:1651529411.888947:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+18:421058:x1731746396773184:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529411.889286:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+18:421058:x1731746396773184:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 338us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529411.889289:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212694 00000100:00100000:1.0:1651529411.889507:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529411.889528:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396773248 00000100:00100000:0.0:1651529411.889549:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212695 00000100:00100000:0.0:1651529411.889551:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+18:421058:x1731746396773248:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529411.889590:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+18:421058:x1731746396773248:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 38us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529411.889595:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212695 00000100:00100000:1.0:1651529411.890474:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529411.890503:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396773312 00000100:00100000:0.0:1651529411.890520:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212696 00000100:00100000:0.0:1651529411.890523:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+18:421058:x1731746396773312:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529411.890997:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+18:421058:x1731746396773312:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 473us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529411.891001:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212696 00000100:00100000:1.0:1651529412.070031:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529412.070063:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396773376 00000100:00100000:0.0:1651529412.070082:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212697 00000100:00100000:0.0:1651529412.070084:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000021c6310b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+18:421058:x1731746396773376:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529412.070412:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000021c6310b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+18:421058:x1731746396773376:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 327us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529412.070415:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212697 00000100:00100000:1.0:1651529412.070662:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529412.070691:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396773440 00000100:00100000:0.0:1651529412.070709:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212698 00000100:00100000:0.0:1651529412.070712:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+18:421058:x1731746396773440:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529412.070881:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+18:421058:x1731746396773440:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 168us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529412.070884:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212698 00000100:00100000:1.0:1651529412.071128:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529412.071149:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396773504 00000100:00100000:0.0:1651529412.071164:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212699 00000100:00100000:0.0:1651529412.071167:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+18:421058:x1731746396773504:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529412.071199:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+18:421058:x1731746396773504:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 31us (71us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529412.071203:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212699 00000100:00100000:1.0:1651529412.086321:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529412.086350:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396773888 00000100:00100000:0.0:1651529412.086368:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212700 00000100:00100000:0.0:1651529412.086370:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+18:421060:x1731746396773888:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529412.086675:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+18:421060:x1731746396773888:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 304us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529412.086678:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212700 00000100:00100000:1.0:1651529412.086879:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529412.086901:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396773952 00000100:00100000:0.0:1651529412.086916:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212701 00000100:00100000:0.0:1651529412.086919:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+18:421060:x1731746396773952:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529412.086956:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+18:421060:x1731746396773952:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 36us (77us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529412.086960:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212701 00000100:00100000:1.0:1651529412.087431:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529412.087460:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396774016 00000100:00100000:0.0:1651529412.087477:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212702 00000100:00100000:0.0:1651529412.087480:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000465868b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+18:421060:x1731746396774016:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529412.087954:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000465868b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+18:421060:x1731746396774016:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 473us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529412.087957:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212702 00000100:00100000:1.0:1651529412.088187:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529412.088215:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396774080 00000100:00100000:0.0:1651529412.088246:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212703 00000100:00100000:0.0:1651529412.088248:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+18:421060:x1731746396774080:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529412.088559:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+18:421060:x1731746396774080:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 310us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529412.088562:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212703 00000100:00100000:1.0:1651529412.088757:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529412.088789:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396774144 00000100:00100000:0.0:1651529412.088804:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212704 00000100:00100000:0.0:1651529412.088807:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+18:421060:x1731746396774144:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529412.088957:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+18:421060:x1731746396774144:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 150us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529412.088960:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212704 00000100:00100000:1.0:1651529412.089156:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529412.089177:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396774208 00000100:00100000:0.0:1651529412.089191:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212705 00000100:00100000:0.0:1651529412.089194:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+18:421060:x1731746396774208:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529412.089243:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+18:421060:x1731746396774208:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 48us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529412.089248:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212705 00000100:00100000:1.0:1651529414.880199:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529414.880214:0:87247:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946599296 00000100:00100000:1.0:1651529414.880252:0:87247:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 582 00000100:00100000:1.0:1651529414.880256:0:87247:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946599296:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651529414.880273:0:87247:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 17850368 granted 116236224 pending 23068672 free 81309687808 avail 77138976768 00000100:00100000:1.0:1651529414.880309:0:87247:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005912c4a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946599296:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 53us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529414.880316:0:87247:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 582 00000100:00100000:1.0:1651529415.805297:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000900b179f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0b51168f-0bcb-46b1-964e-9e88a09501f8:39100:1731745997071488:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:1.0:1651529415.805319:0:39100:0:(ptlrpcd.c:414:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1651529415.805322:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c9f4ec84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997071552:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:1.0:1651529415.805655:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c9f4ec84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997071552:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:1.0:1651529415.805661:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000900b179f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0b51168f-0bcb-46b1-964e-9e88a09501f8:39100:1731745997071488:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:1.0:1651529415.873963:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529415.873993:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396774400 00000100:00100000:0.0:1651529415.874014:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 92 00000100:00100000:0.0:1651529415.874017:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+18:41279:x1731746396774400:12345-10.240.43.64@tcp:400:kworker/u4:1.0 00000100:00100000:0.0:1651529415.874041:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+18:41279:x1731746396774400:12345-10.240.43.64@tcp:400:kworker/u4:1.0 Request processed in 22us (77us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529415.874045:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 92 00000400:00000080:1.0:1651529417.365590:0:160193:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651529417.365592:0:160193:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 130f: FIEMAP (unstriped file) ============= 22:10:17 (1651529417) 00000001:00080000:0.0:1651529417.390038:0:72382:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 12885080708 is committed 00000400:00000080:0.0:1651529418.654460:0:160411:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651529418.654462:0:160411:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 130g: FIEMAP (overstripe file) ============ 22:10:18 (1651529418) 00000100:00100000:1.0:1651529418.677466:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529418.677494:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946599680 00000100:00100000:0.0:1651529418.677519:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212706 00000100:00100000:0.0:1651529418.677522:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:137466:x1731745946599680:12345-10.240.43.61@tcp:5:osp-pre-1-0.0 00002000:00080000:0.0:1651529418.677544:0:151609:0:(ofd_dev.c:1706:ofd_create_hdl()) lustre-OST0001: reserve 64 objects in group 0x0 at 179170 00000100:00100000:0.0:1651529418.678525:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:137466:x1731745946599680:12345-10.240.43.61@tcp:5:osp-pre-1-0.0 Request processed in 1002us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.678529:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212706 00000100:00100000:1.0:1651529418.686042:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.686060:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396776512 00000100:00100000:0.0:1651529418.686075:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212707 00000100:00100000:0.0:1651529418.686077:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+10:425322:x1731746396776512:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.686082:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.686092:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c533c3 lrc: 2/0,0 mode: --/PW res: [0x2bb84:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc256 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.686101:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb84:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.686109:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.686110:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.686113:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c533c3 lrc: 3/0,0 mode: PW/PW res: [0x2bb84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc256 expref: 11 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.686120:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c533c3 lrc: 3/0,0 mode: PW/PW res: [0x2bb84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc256 expref: 11 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.686125:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003551d5d1, rc 0) 00000100:00100000:0.0:1651529418.686138:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+11:425322:x1731746396776512:12345-10.240.43.64@tcp:101:dd.0 Request processed in 60us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.686142:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212707 00000100:00100000:1.0:1651529418.687061:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.687079:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396776640 00000100:00100000:0.0:1651529418.687092:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212708 00000100:00100000:0.0:1651529418.687094:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+11:425322:x1731746396776640:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.687098:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.687102:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c533ca lrc: 2/0,0 mode: --/PW res: [0x2bb85:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc264 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.687107:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb85:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.687111:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.687112:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.687114:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c533ca lrc: 3/0,0 mode: PW/PW res: [0x2bb85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc264 expref: 12 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.687118:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c533ca lrc: 3/0,0 mode: PW/PW res: [0x2bb85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc264 expref: 12 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.687122:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009e44ce9d, rc 0) 00000100:00100000:0.0:1651529418.687133:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+12:425322:x1731746396776640:12345-10.240.43.64@tcp:101:dd.0 Request processed in 38us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.687135:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212708 00000100:00100000:1.0:1651529418.687649:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.687666:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396776768 00000100:00100000:0.0:1651529418.687679:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212709 00000100:00100000:0.0:1651529418.687681:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+12:425322:x1731746396776768:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.687685:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.687689:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c533d1 lrc: 2/0,0 mode: --/PW res: [0x2bb86:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc272 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.687695:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb86:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.687699:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.687699:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.687701:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c533d1 lrc: 3/0,0 mode: PW/PW res: [0x2bb86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc272 expref: 13 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.687705:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c533d1 lrc: 3/0,0 mode: PW/PW res: [0x2bb86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc272 expref: 13 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.687709:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f183a40b, rc 0) 00000100:00100000:0.0:1651529418.687720:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+13:425322:x1731746396776768:12345-10.240.43.64@tcp:101:dd.0 Request processed in 38us (71us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.687722:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212709 00000100:00100000:1.0:1651529418.688251:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.688269:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396776896 00000100:00100000:0.0:1651529418.688282:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212710 00000100:00100000:0.0:1651529418.688284:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076ec8e72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+13:425322:x1731746396776896:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.688287:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.688291:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c533d8 lrc: 2/0,0 mode: --/PW res: [0x2bb87:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc280 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.688296:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb87:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.688300:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.688301:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.688302:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c533d8 lrc: 3/0,0 mode: PW/PW res: [0x2bb87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc280 expref: 14 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.688309:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c533d8 lrc: 3/0,0 mode: PW/PW res: [0x2bb87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc280 expref: 14 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.688313:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000af20b5e7, rc 0) 00000100:00100000:0.0:1651529418.688324:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076ec8e72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+14:425322:x1731746396776896:12345-10.240.43.64@tcp:101:dd.0 Request processed in 39us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.688326:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212710 00000100:00100000:1.0:1651529418.688843:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.688860:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396777024 00000100:00100000:0.0:1651529418.688873:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212711 00000100:00100000:0.0:1651529418.688875:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+14:425322:x1731746396777024:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.688878:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.688882:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c533df lrc: 2/0,0 mode: --/PW res: [0x2bb88:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc28e expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.688888:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb88:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.688891:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.688892:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.688894:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c533df lrc: 3/0,0 mode: PW/PW res: [0x2bb88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc28e expref: 15 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.688898:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c533df lrc: 3/0,0 mode: PW/PW res: [0x2bb88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc28e expref: 15 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.688901:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000877aab61, rc 0) 00000100:00100000:0.0:1651529418.688912:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+15:425322:x1731746396777024:12345-10.240.43.64@tcp:101:dd.0 Request processed in 36us (69us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.688915:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212711 00000100:00100000:1.0:1651529418.689402:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.689418:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396777152 00000100:00100000:0.0:1651529418.689431:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212712 00000100:00100000:0.0:1651529418.689433:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+15:425322:x1731746396777152:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.689436:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.689440:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c533e6 lrc: 2/0,0 mode: --/PW res: [0x2bb89:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc29c expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.689446:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb89:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.689449:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.689450:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.689451:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c533e6 lrc: 3/0,0 mode: PW/PW res: [0x2bb89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc29c expref: 16 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.689456:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c533e6 lrc: 3/0,0 mode: PW/PW res: [0x2bb89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc29c expref: 16 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.689459:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000575eb734, rc 0) 00000100:00100000:0.0:1651529418.689470:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+16:425322:x1731746396777152:12345-10.240.43.64@tcp:101:dd.0 Request processed in 36us (68us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.689472:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212712 00000100:00100000:1.0:1651529418.689948:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.689965:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396777280 00000100:00100000:0.0:1651529418.689978:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212713 00000100:00100000:0.0:1651529418.689979:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+16:425322:x1731746396777280:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.689983:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.689987:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c533ed lrc: 2/0,0 mode: --/PW res: [0x2bb8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc2aa expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.689992:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb8a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.689996:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.689996:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.689998:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c533ed lrc: 3/0,0 mode: PW/PW res: [0x2bb8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2aa expref: 17 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.690002:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c533ed lrc: 3/0,0 mode: PW/PW res: [0x2bb8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2aa expref: 17 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.690006:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000046fea5cc, rc 0) 00000100:00100000:0.0:1651529418.690016:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+17:425322:x1731746396777280:12345-10.240.43.64@tcp:101:dd.0 Request processed in 36us (69us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.690019:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212713 00000100:00100000:1.0:1651529418.690488:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.690505:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396777408 00000100:00100000:0.0:1651529418.690517:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212714 00000100:00100000:0.0:1651529418.690519:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+17:425322:x1731746396777408:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.690523:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.690527:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c533f4 lrc: 2/0,0 mode: --/PW res: [0x2bb8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc2b8 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.690532:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb8b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.690536:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.690536:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.690538:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c533f4 lrc: 3/0,0 mode: PW/PW res: [0x2bb8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2b8 expref: 18 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.690545:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c533f4 lrc: 3/0,0 mode: PW/PW res: [0x2bb8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2b8 expref: 18 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.690548:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000050e053bc, rc 0) 00000100:00100000:0.0:1651529418.690558:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+18:425322:x1731746396777408:12345-10.240.43.64@tcp:101:dd.0 Request processed in 39us (71us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.690561:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212714 00000100:00100000:1.0:1651529418.691052:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.691069:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396777536 00000100:00100000:0.0:1651529418.691081:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212715 00000100:00100000:0.0:1651529418.691083:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+18:425322:x1731746396777536:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.691086:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.691090:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c533fb lrc: 2/0,0 mode: --/PW res: [0x2bb8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc2c6 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.691095:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb8c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.691099:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.691099:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.691101:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c533fb lrc: 3/0,0 mode: PW/PW res: [0x2bb8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2c6 expref: 19 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.691105:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c533fb lrc: 3/0,0 mode: PW/PW res: [0x2bb8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2c6 expref: 19 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.691109:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000820e505a, rc 0) 00000100:00100000:0.0:1651529418.691119:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+19:425322:x1731746396777536:12345-10.240.43.64@tcp:101:dd.0 Request processed in 35us (68us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.691122:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212715 00000100:00100000:1.0:1651529418.691578:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.691600:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396777664 00000100:00100000:0.0:1651529418.691612:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212716 00000100:00100000:0.0:1651529418.691614:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+19:425322:x1731746396777664:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.691617:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.691621:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c53402 lrc: 2/0,0 mode: --/PW res: [0x2bb8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc2d4 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.691626:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb8d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.691630:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.691631:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.691632:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c53402 lrc: 3/0,0 mode: PW/PW res: [0x2bb8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2d4 expref: 20 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.691636:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c53402 lrc: 3/0,0 mode: PW/PW res: [0x2bb8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2d4 expref: 20 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.691640:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f1b4c19f, rc 0) 00000100:00100000:0.0:1651529418.691651:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+20:425322:x1731746396777664:12345-10.240.43.64@tcp:101:dd.0 Request processed in 36us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.691653:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212716 00000100:00100000:1.0:1651529418.692156:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.692178:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396777792 00000100:00100000:0.0:1651529418.692190:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212717 00000100:00100000:0.0:1651529418.692191:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+20:425322:x1731746396777792:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.692194:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.692199:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c53409 lrc: 2/0,0 mode: --/PW res: [0x2bb8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc2e2 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.692204:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb8e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.692207:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.692208:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.692210:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c53409 lrc: 3/0,0 mode: PW/PW res: [0x2bb8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2e2 expref: 21 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.692214:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c53409 lrc: 3/0,0 mode: PW/PW res: [0x2bb8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2e2 expref: 21 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.692217:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000490515f1, rc 0) 00000100:00100000:0.0:1651529418.692240:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+21:425322:x1731746396777792:12345-10.240.43.64@tcp:101:dd.0 Request processed in 47us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.692243:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212717 00000100:00100000:1.0:1651529418.692699:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.692720:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396777920 00000100:00100000:0.0:1651529418.692732:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212718 00000100:00100000:0.0:1651529418.692734:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+21:425322:x1731746396777920:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.692737:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.692741:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c53410 lrc: 2/0,0 mode: --/PW res: [0x2bb8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc2f0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.692746:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb8f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.692750:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.692750:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.692752:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c53410 lrc: 3/0,0 mode: PW/PW res: [0x2bb8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2f0 expref: 22 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.692759:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c53410 lrc: 3/0,0 mode: PW/PW res: [0x2bb8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2f0 expref: 22 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.692762:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008ac1e27e, rc 0) 00000100:00100000:0.0:1651529418.692782:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+22:425322:x1731746396777920:12345-10.240.43.64@tcp:101:dd.0 Request processed in 47us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.692784:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212718 00000100:00100000:1.0:1651529418.693255:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.693277:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396778048 00000100:00100000:0.0:1651529418.693289:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212719 00000100:00100000:0.0:1651529418.693291:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+22:425322:x1731746396778048:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.693294:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.693298:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53417 lrc: 2/0,0 mode: --/PW res: [0x2bb90:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc2fe expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.693303:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb90:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.693307:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.693308:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.693309:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53417 lrc: 3/0,0 mode: PW/PW res: [0x2bb90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2fe expref: 23 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.693313:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53417 lrc: 3/0,0 mode: PW/PW res: [0x2bb90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2fe expref: 23 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.693317:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000916cff2, rc 0) 00000100:00100000:0.0:1651529418.693328:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+23:425322:x1731746396778048:12345-10.240.43.64@tcp:101:dd.0 Request processed in 36us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.693331:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212719 00000100:00100000:1.0:1651529418.693787:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.693809:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396778176 00000100:00100000:0.0:1651529418.693822:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212720 00000100:00100000:0.0:1651529418.693823:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+23:425322:x1731746396778176:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.693827:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.693830:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c5341e lrc: 2/0,0 mode: --/PW res: [0x2bb91:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc30c expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.693836:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb91:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.693839:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.693840:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.693841:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c5341e lrc: 3/0,0 mode: PW/PW res: [0x2bb91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc30c expref: 24 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.693845:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c5341e lrc: 3/0,0 mode: PW/PW res: [0x2bb91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc30c expref: 24 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.693849:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c822bd1c, rc 0) 00000100:00100000:0.0:1651529418.693859:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+24:425322:x1731746396778176:12345-10.240.43.64@tcp:101:dd.0 Request processed in 36us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.693862:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212720 00000100:00100000:1.0:1651529418.694336:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.694358:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396778304 00000100:00100000:0.0:1651529418.694369:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212721 00000100:00100000:0.0:1651529418.694371:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+24:425322:x1731746396778304:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.694374:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.694378:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c53425 lrc: 2/0,0 mode: --/PW res: [0x2bb92:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc31a expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.694383:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb92:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.694387:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.694387:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.694389:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c53425 lrc: 3/0,0 mode: PW/PW res: [0x2bb92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc31a expref: 25 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.694393:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c53425 lrc: 3/0,0 mode: PW/PW res: [0x2bb92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc31a expref: 25 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.694397:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005e711cee, rc 0) 00000100:00100000:0.0:1651529418.694407:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+25:425322:x1731746396778304:12345-10.240.43.64@tcp:101:dd.0 Request processed in 36us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.694410:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212721 00000100:00100000:1.0:1651529418.694884:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.694906:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396778432 00000100:00100000:0.0:1651529418.694917:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212722 00000100:00100000:0.0:1651529418.694919:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+25:425322:x1731746396778432:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.694922:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.694927:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c5342c lrc: 2/0,0 mode: --/PW res: [0x2bb93:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc328 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.694932:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb93:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.694935:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.694936:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.694937:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c5342c lrc: 3/0,0 mode: PW/PW res: [0x2bb93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc328 expref: 26 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.694944:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c5342c lrc: 3/0,0 mode: PW/PW res: [0x2bb93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc328 expref: 26 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.694948:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005b8e72f9, rc 0) 00000100:00100000:0.0:1651529418.694958:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+26:425322:x1731746396778432:12345-10.240.43.64@tcp:101:dd.0 Request processed in 38us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.694961:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212722 00000100:00100000:1.0:1651529418.695436:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.695458:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396778560 00000100:00100000:0.0:1651529418.695470:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212723 00000100:00100000:0.0:1651529418.695471:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+26:425322:x1731746396778560:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.695475:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.695479:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c53433 lrc: 2/0,0 mode: --/PW res: [0x2bb94:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc336 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.695484:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb94:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.695487:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.695488:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.695489:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c53433 lrc: 3/0,0 mode: PW/PW res: [0x2bb94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc336 expref: 27 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.695493:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c53433 lrc: 3/0,0 mode: PW/PW res: [0x2bb94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc336 expref: 27 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.695497:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000042bde05b, rc 0) 00000100:00100000:0.0:1651529418.695508:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+27:425322:x1731746396778560:12345-10.240.43.64@tcp:101:dd.0 Request processed in 35us (71us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.695510:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212723 00000100:00100000:1.0:1651529418.695976:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.695997:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396778688 00000100:00100000:0.0:1651529418.696009:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212724 00000100:00100000:0.0:1651529418.696011:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+27:425322:x1731746396778688:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.696014:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.696027:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c5343a lrc: 2/0,0 mode: --/PW res: [0x2bb95:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc344 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.696032:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb95:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.696036:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.696037:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.696038:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c5343a lrc: 3/0,0 mode: PW/PW res: [0x2bb95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc344 expref: 28 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.696042:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c5343a lrc: 3/0,0 mode: PW/PW res: [0x2bb95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc344 expref: 28 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.696046:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000096ab8041, rc 0) 00000100:00100000:0.0:1651529418.696057:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+28:425322:x1731746396778688:12345-10.240.43.64@tcp:101:dd.0 Request processed in 46us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.696060:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212724 00000100:00100000:1.0:1651529418.696516:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.696539:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396778816 00000100:00100000:0.0:1651529418.696550:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212725 00000100:00100000:0.0:1651529418.696552:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+28:425322:x1731746396778816:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.696555:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.696559:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c53441 lrc: 2/0,0 mode: --/PW res: [0x2bb96:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc352 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.696565:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb96:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.696568:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.696569:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.696570:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c53441 lrc: 3/0,0 mode: PW/PW res: [0x2bb96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc352 expref: 29 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.696574:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c53441 lrc: 3/0,0 mode: PW/PW res: [0x2bb96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc352 expref: 29 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.696578:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002f450f42, rc 0) 00000100:00100000:0.0:1651529418.696589:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+29:425322:x1731746396778816:12345-10.240.43.64@tcp:101:dd.0 Request processed in 36us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.696591:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212725 00000100:00100000:1.0:1651529418.697068:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.697091:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396778944 00000100:00100000:0.0:1651529418.697102:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212726 00000100:00100000:0.0:1651529418.697104:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+29:425322:x1731746396778944:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.697107:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.697111:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c53448 lrc: 2/0,0 mode: --/PW res: [0x2bb97:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc360 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.697116:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb97:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.697120:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.697121:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.697122:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c53448 lrc: 3/0,0 mode: PW/PW res: [0x2bb97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc360 expref: 30 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.697129:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c53448 lrc: 3/0,0 mode: PW/PW res: [0x2bb97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc360 expref: 30 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.697133:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000055fddd81, rc 0) 00000100:00100000:0.0:1651529418.697143:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+30:425322:x1731746396778944:12345-10.240.43.64@tcp:101:dd.0 Request processed in 38us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.697145:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212726 00000100:00100000:1.0:1651529418.697625:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.697647:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396779072 00000100:00100000:0.0:1651529418.697659:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212727 00000100:00100000:0.0:1651529418.697660:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085af61db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+30:425322:x1731746396779072:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.697664:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.697668:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c5344f lrc: 2/0,0 mode: --/PW res: [0x2bb98:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc36e expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.697672:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb98:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.697676:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.697677:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.697678:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c5344f lrc: 3/0,0 mode: PW/PW res: [0x2bb98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc36e expref: 31 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.697682:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c5344f lrc: 3/0,0 mode: PW/PW res: [0x2bb98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc36e expref: 31 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.697686:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b0407aaf, rc 0) 00000100:00100000:0.0:1651529418.697696:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085af61db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+31:425322:x1731746396779072:12345-10.240.43.64@tcp:101:dd.0 Request processed in 35us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.697700:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212727 00000100:00100000:1.0:1651529418.698213:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.698234:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396779200 00000100:00100000:0.0:1651529418.698246:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212728 00000100:00100000:0.0:1651529418.698248:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+31:425322:x1731746396779200:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.698251:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.698255:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c53456 lrc: 2/0,0 mode: --/PW res: [0x2bb99:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc37c expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.698260:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb99:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.698264:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.698264:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.698266:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c53456 lrc: 3/0,0 mode: PW/PW res: [0x2bb99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc37c expref: 32 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.698270:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c53456 lrc: 3/0,0 mode: PW/PW res: [0x2bb99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc37c expref: 32 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.698274:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9cfe902, rc 0) 00000100:00100000:0.0:1651529418.698284:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+32:425322:x1731746396779200:12345-10.240.43.64@tcp:101:dd.0 Request processed in 35us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.698287:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212728 00000100:00100000:1.0:1651529418.698783:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.698805:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396779328 00000100:00100000:0.0:1651529418.698817:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212729 00000100:00100000:0.0:1651529418.698818:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+32:425322:x1731746396779328:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.698822:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.698826:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c5345d lrc: 2/0,0 mode: --/PW res: [0x2bb9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc38a expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.698831:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb9a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.698835:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.698835:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.698837:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c5345d lrc: 3/0,0 mode: PW/PW res: [0x2bb9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc38a expref: 33 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.698841:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c5345d lrc: 3/0,0 mode: PW/PW res: [0x2bb9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc38a expref: 33 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.698844:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000a7c37b9, rc 0) 00000100:00100000:0.0:1651529418.698855:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+33:425322:x1731746396779328:12345-10.240.43.64@tcp:101:dd.0 Request processed in 36us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.698858:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212729 00000100:00100000:1.0:1651529418.699348:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.699369:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396779456 00000100:00100000:0.0:1651529418.699381:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212730 00000100:00100000:0.0:1651529418.699383:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+33:425322:x1731746396779456:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.699386:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.699390:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c53464 lrc: 2/0,0 mode: --/PW res: [0x2bb9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc398 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.699395:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb9b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.699398:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.699399:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.699400:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c53464 lrc: 3/0,0 mode: PW/PW res: [0x2bb9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc398 expref: 34 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.699408:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c53464 lrc: 3/0,0 mode: PW/PW res: [0x2bb9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc398 expref: 34 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.699411:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000009fe5580, rc 0) 00000100:00100000:0.0:1651529418.699422:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+34:425322:x1731746396779456:12345-10.240.43.64@tcp:101:dd.0 Request processed in 38us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.699424:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212730 00000100:00100000:1.0:1651529418.699912:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.699933:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396779584 00000100:00100000:0.0:1651529418.699945:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212731 00000100:00100000:0.0:1651529418.699947:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+34:425322:x1731746396779584:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.699950:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.699955:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c5346b lrc: 2/0,0 mode: --/PW res: [0x2bb9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc3a6 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.699960:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb9c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.699963:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.699964:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.699965:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c5346b lrc: 3/0,0 mode: PW/PW res: [0x2bb9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3a6 expref: 35 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.699970:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c5346b lrc: 3/0,0 mode: PW/PW res: [0x2bb9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3a6 expref: 35 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.699973:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6999e11, rc 0) 00000100:00100000:0.0:1651529418.699984:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+35:425322:x1731746396779584:12345-10.240.43.64@tcp:101:dd.0 Request processed in 36us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.699987:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212731 00000100:00100000:1.0:1651529418.700460:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.700481:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396779712 00000100:00100000:0.0:1651529418.700493:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212732 00000100:00100000:0.0:1651529418.700495:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+35:425322:x1731746396779712:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.700498:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.700502:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c53472 lrc: 2/0,0 mode: --/PW res: [0x2bb9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc3b4 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.700507:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb9d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.700511:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.700511:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.700513:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c53472 lrc: 3/0,0 mode: PW/PW res: [0x2bb9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3b4 expref: 36 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.700517:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c53472 lrc: 3/0,0 mode: PW/PW res: [0x2bb9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3b4 expref: 36 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.700521:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008119f3a8, rc 0) 00000100:00100000:0.0:1651529418.700531:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+36:425322:x1731746396779712:12345-10.240.43.64@tcp:101:dd.0 Request processed in 36us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.700534:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212732 00000100:00100000:1.0:1651529418.701036:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.701053:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396779840 00000100:00100000:0.0:1651529418.701065:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212733 00000100:00100000:0.0:1651529418.701067:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+36:425322:x1731746396779840:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.701070:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.701074:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c53479 lrc: 2/0,0 mode: --/PW res: [0x2bb9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc3c2 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.701079:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb9e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.701083:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.701084:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.701085:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c53479 lrc: 3/0,0 mode: PW/PW res: [0x2bb9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3c2 expref: 37 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.701103:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c53479 lrc: 3/0,0 mode: PW/PW res: [0x2bb9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3c2 expref: 37 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.701107:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000092ad010c, rc 0) 00000100:00100000:0.0:1651529418.701118:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+37:425322:x1731746396779840:12345-10.240.43.64@tcp:101:dd.0 Request processed in 50us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.701120:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212733 00000100:00100000:1.0:1651529418.701617:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.701634:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396779968 00000100:00100000:0.0:1651529418.701647:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212734 00000100:00100000:0.0:1651529418.701648:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+37:425322:x1731746396779968:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.701651:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.701656:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c53480 lrc: 2/0,0 mode: --/PW res: [0x2bb9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc3d0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.701661:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bb9f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.701664:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.701665:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.701666:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c53480 lrc: 3/0,0 mode: PW/PW res: [0x2bb9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3d0 expref: 38 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.701673:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c53480 lrc: 3/0,0 mode: PW/PW res: [0x2bb9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3d0 expref: 38 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.701677:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b5173ced, rc 0) 00000100:00100000:0.0:1651529418.701687:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+38:425322:x1731746396779968:12345-10.240.43.64@tcp:101:dd.0 Request processed in 38us (71us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.701689:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212734 00000100:00100000:1.0:1651529418.702190:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.702207:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396780096 00000100:00100000:0.0:1651529418.702219:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212735 00000100:00100000:0.0:1651529418.702221:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+38:425322:x1731746396780096:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.702233:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.702239:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c53487 lrc: 2/0,0 mode: --/PW res: [0x2bba0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc3de expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.702244:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bba0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.702247:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.702248:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.702250:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c53487 lrc: 3/0,0 mode: PW/PW res: [0x2bba0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3de expref: 39 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.702254:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c53487 lrc: 3/0,0 mode: PW/PW res: [0x2bba0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3de expref: 39 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.702257:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e270377c, rc 0) 00000100:00100000:0.0:1651529418.702268:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+39:425322:x1731746396780096:12345-10.240.43.64@tcp:101:dd.0 Request processed in 46us (78us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.702270:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212735 00000100:00100000:1.0:1651529418.702737:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.702754:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396780224 00000100:00100000:0.0:1651529418.702767:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212736 00000100:00100000:0.0:1651529418.702769:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+39:425322:x1731746396780224:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.702780:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.702784:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c5348e lrc: 2/0,0 mode: --/PW res: [0x2bba1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc3ec expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.702790:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bba1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.702793:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.702794:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.702795:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c5348e lrc: 3/0,0 mode: PW/PW res: [0x2bba1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3ec expref: 40 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.702799:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c5348e lrc: 3/0,0 mode: PW/PW res: [0x2bba1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3ec expref: 40 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.702803:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000eca832be, rc 0) 00000100:00100000:0.0:1651529418.702814:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+40:425322:x1731746396780224:12345-10.240.43.64@tcp:101:dd.0 Request processed in 45us (77us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.702816:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212736 00000100:00100000:1.0:1651529418.703293:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.703310:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396780352 00000100:00100000:0.0:1651529418.703323:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212737 00000100:00100000:0.0:1651529418.703324:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+40:425322:x1731746396780352:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.703328:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.703332:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c53495 lrc: 2/0,0 mode: --/PW res: [0x2bba2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc3fa expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.703337:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bba2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.703341:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.703342:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.703343:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c53495 lrc: 3/0,0 mode: PW/PW res: [0x2bba2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3fa expref: 41 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.703347:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c53495 lrc: 3/0,0 mode: PW/PW res: [0x2bba2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3fa expref: 41 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.703351:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b1b8f74, rc 0) 00000100:00100000:0.0:1651529418.703362:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+41:425322:x1731746396780352:12345-10.240.43.64@tcp:101:dd.0 Request processed in 37us (69us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.703364:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212737 00000100:00100000:1.0:1651529418.703839:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.703856:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396780480 00000100:00100000:0.0:1651529418.703869:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212738 00000100:00100000:0.0:1651529418.703870:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+41:425322:x1731746396780480:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.703873:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.703877:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c5349c lrc: 2/0,0 mode: --/PW res: [0x2bba3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc408 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.703883:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bba3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.703886:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.703887:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.703888:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c5349c lrc: 3/0,0 mode: PW/PW res: [0x2bba3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc408 expref: 42 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.703895:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c5349c lrc: 3/0,0 mode: PW/PW res: [0x2bba3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc408 expref: 42 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.703898:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004926c34d, rc 0) 00000100:00100000:0.0:1651529418.703909:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+42:425322:x1731746396780480:12345-10.240.43.64@tcp:101:dd.0 Request processed in 38us (70us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.703911:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212738 00000100:00100000:1.0:1651529418.704372:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.704389:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396780608 00000100:00100000:0.0:1651529418.704402:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212739 00000100:00100000:0.0:1651529418.704404:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+42:425322:x1731746396780608:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.704407:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.704411:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c534a3 lrc: 2/0,0 mode: --/PW res: [0x2bba4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc416 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.704416:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bba4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.704420:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.704420:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.704422:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c534a3 lrc: 3/0,0 mode: PW/PW res: [0x2bba4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc416 expref: 43 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.704426:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c534a3 lrc: 3/0,0 mode: PW/PW res: [0x2bba4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc416 expref: 43 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.704430:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008393c644, rc 0) 00000100:00100000:0.0:1651529418.704440:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+43:425322:x1731746396780608:12345-10.240.43.64@tcp:101:dd.0 Request processed in 36us (68us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.704443:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212739 00000100:00100000:1.0:1651529418.704919:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.704936:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396780736 00000100:00100000:0.0:1651529418.704948:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212740 00000100:00100000:0.0:1651529418.704950:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+43:425322:x1731746396780736:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.704953:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.704957:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c534aa lrc: 2/0,0 mode: --/PW res: [0x2bba5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc424 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.704962:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bba5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.704966:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.704966:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.704968:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c534aa lrc: 3/0,0 mode: PW/PW res: [0x2bba5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc424 expref: 44 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.704972:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c534aa lrc: 3/0,0 mode: PW/PW res: [0x2bba5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc424 expref: 44 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.704976:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000721302df, rc 0) 00000100:00100000:0.0:1651529418.704986:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+44:425322:x1731746396780736:12345-10.240.43.64@tcp:101:dd.0 Request processed in 35us (68us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.704989:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212740 00000100:00100000:1.0:1651529418.705447:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.705464:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396780864 00000100:00100000:0.0:1651529418.705475:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212741 00000100:00100000:0.0:1651529418.705476:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+44:425322:x1731746396780864:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.705480:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.705484:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c534b1 lrc: 2/0,0 mode: --/PW res: [0x2bba6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc432 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.705489:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bba6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.705492:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.705493:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.705495:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c534b1 lrc: 3/0,0 mode: PW/PW res: [0x2bba6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc432 expref: 45 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.705499:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c534b1 lrc: 3/0,0 mode: PW/PW res: [0x2bba6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc432 expref: 45 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.705502:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000cb70d261, rc 0) 00000100:00100000:0.0:1651529418.705513:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+45:425322:x1731746396780864:12345-10.240.43.64@tcp:101:dd.0 Request processed in 36us (66us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.705515:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212741 00000100:00100000:1.0:1651529418.705998:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.706015:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396780992 00000100:00100000:0.0:1651529418.706027:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212742 00000100:00100000:0.0:1651529418.706029:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+45:425322:x1731746396780992:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.706032:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.706036:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c534b8 lrc: 2/0,0 mode: --/PW res: [0x2bba7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc440 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.706041:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bba7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.706045:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.706045:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.706047:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c534b8 lrc: 3/0,0 mode: PW/PW res: [0x2bba7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc440 expref: 46 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.706053:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c534b8 lrc: 3/0,0 mode: PW/PW res: [0x2bba7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc440 expref: 46 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.706057:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002082f759, rc 0) 00000100:00100000:0.0:1651529418.706067:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+46:425322:x1731746396780992:12345-10.240.43.64@tcp:101:dd.0 Request processed in 38us (70us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.706070:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212742 00000100:00100000:1.0:1651529418.706536:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.706558:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396781120 00000100:00100000:0.0:1651529418.706570:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212743 00000100:00100000:0.0:1651529418.706571:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+46:425322:x1731746396781120:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.706575:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.706579:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c534bf lrc: 2/0,0 mode: --/PW res: [0x2bba8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc44e expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.706584:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bba8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.706587:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.706588:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.706589:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c534bf lrc: 3/0,0 mode: PW/PW res: [0x2bba8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc44e expref: 47 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.706593:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c534bf lrc: 3/0,0 mode: PW/PW res: [0x2bba8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc44e expref: 47 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.706597:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000d8e6a5e, rc 0) 00000100:00100000:0.0:1651529418.706608:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+47:425322:x1731746396781120:12345-10.240.43.64@tcp:101:dd.0 Request processed in 36us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.706611:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212743 00000100:00100000:1.0:1651529418.707088:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.707109:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396781248 00000100:00100000:0.0:1651529418.707121:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212744 00000100:00100000:0.0:1651529418.707123:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ea32140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+47:425322:x1731746396781248:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.707126:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.707138:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c534c6 lrc: 2/0,0 mode: --/PW res: [0x2bba9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc45c expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.707143:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bba9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.707147:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.707148:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.707149:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c534c6 lrc: 3/0,0 mode: PW/PW res: [0x2bba9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc45c expref: 48 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.707153:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c534c6 lrc: 3/0,0 mode: PW/PW res: [0x2bba9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc45c expref: 48 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.707157:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004cff9fc3, rc 0) 00000100:00100000:0.0:1651529418.707168:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ea32140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+48:425322:x1731746396781248:12345-10.240.43.64@tcp:101:dd.0 Request processed in 44us (80us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.707184:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212744 00000100:00100000:1.0:1651529418.707650:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.707667:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396781376 00000100:00100000:0.0:1651529418.707680:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212745 00000100:00100000:0.0:1651529418.707681:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007fca8239 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+48:425322:x1731746396781376:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.707685:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.707690:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c534cd lrc: 2/0,0 mode: --/PW res: [0x2bbaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc46a expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.707695:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbaa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.707699:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.707699:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.707701:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c534cd lrc: 3/0,0 mode: PW/PW res: [0x2bbaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc46a expref: 49 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.707705:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c534cd lrc: 3/0,0 mode: PW/PW res: [0x2bbaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc46a expref: 49 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.707709:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d52cc749, rc 0) 00000100:00100000:0.0:1651529418.707719:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007fca8239 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+49:425322:x1731746396781376:12345-10.240.43.64@tcp:101:dd.0 Request processed in 37us (69us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.707722:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212745 00000100:00100000:1.0:1651529418.708214:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.708243:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396781504 00000100:00100000:0.0:1651529418.708255:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212746 00000100:00100000:0.0:1651529418.708257:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+49:425322:x1731746396781504:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.708260:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.708264:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c534d4 lrc: 2/0,0 mode: --/PW res: [0x2bbab:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc478 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.708269:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.708272:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.708273:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.708275:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c534d4 lrc: 3/0,0 mode: PW/PW res: [0x2bbab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc478 expref: 50 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.708281:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c534d4 lrc: 3/0,0 mode: PW/PW res: [0x2bbab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc478 expref: 50 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.708285:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001b109cb1, rc 0) 00000100:00100000:0.0:1651529418.708296:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+50:425322:x1731746396781504:12345-10.240.43.64@tcp:101:dd.0 Request processed in 38us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.708298:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212746 00000100:00100000:1.0:1651529418.708756:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.708780:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396781632 00000100:00100000:0.0:1651529418.708792:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212747 00000100:00100000:0.0:1651529418.708793:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+50:425322:x1731746396781632:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.708797:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.708800:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c534db lrc: 2/0,0 mode: --/PW res: [0x2bbac:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc486 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.708806:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.708809:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.708810:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.708811:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c534db lrc: 3/0,0 mode: PW/PW res: [0x2bbac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc486 expref: 51 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.708815:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c534db lrc: 3/0,0 mode: PW/PW res: [0x2bbac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc486 expref: 51 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.708819:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000075f9ff9d, rc 0) 00000100:00100000:0.0:1651529418.708829:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+51:425322:x1731746396781632:12345-10.240.43.64@tcp:101:dd.0 Request processed in 35us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.708832:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212747 00000100:00100000:1.0:1651529418.709302:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.709319:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396781760 00000100:00100000:0.0:1651529418.709332:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212748 00000100:00100000:0.0:1651529418.709334:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+51:425322:x1731746396781760:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.709337:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.709341:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c534e2 lrc: 2/0,0 mode: --/PW res: [0x2bbad:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc494 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.709346:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.709350:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.709350:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.709352:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c534e2 lrc: 3/0,0 mode: PW/PW res: [0x2bbad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc494 expref: 52 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.709356:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c534e2 lrc: 3/0,0 mode: PW/PW res: [0x2bbad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc494 expref: 52 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.709360:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000294488b6, rc 0) 00000100:00100000:0.0:1651529418.709370:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+52:425322:x1731746396781760:12345-10.240.43.64@tcp:101:dd.0 Request processed in 36us (69us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.709373:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212748 00000100:00100000:1.0:1651529418.709848:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.709865:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396781888 00000100:00100000:0.0:1651529418.709878:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212749 00000100:00100000:0.0:1651529418.709879:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+52:425322:x1731746396781888:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.709883:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.709887:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c534e9 lrc: 2/0,0 mode: --/PW res: [0x2bbae:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc4a2 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.709892:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.709895:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.709896:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.709898:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c534e9 lrc: 3/0,0 mode: PW/PW res: [0x2bbae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4a2 expref: 53 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.709902:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c534e9 lrc: 3/0,0 mode: PW/PW res: [0x2bbae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4a2 expref: 53 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.709905:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f616ea25, rc 0) 00000100:00100000:0.0:1651529418.709915:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+53:425322:x1731746396781888:12345-10.240.43.64@tcp:101:dd.0 Request processed in 36us (68us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.709918:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212749 00000100:00100000:1.0:1651529418.710374:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.710391:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396782016 00000100:00100000:0.0:1651529418.710404:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212750 00000100:00100000:0.0:1651529418.710405:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+53:425322:x1731746396782016:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.710409:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.710412:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c534f0 lrc: 2/0,0 mode: --/PW res: [0x2bbaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc4b0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.710418:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbaf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.710421:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.710422:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.710423:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c534f0 lrc: 3/0,0 mode: PW/PW res: [0x2bbaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4b0 expref: 54 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.710430:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c534f0 lrc: 3/0,0 mode: PW/PW res: [0x2bbaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4b0 expref: 54 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.710434:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002e24dea3, rc 0) 00000100:00100000:0.0:1651529418.710444:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+54:425322:x1731746396782016:12345-10.240.43.64@tcp:101:dd.0 Request processed in 38us (70us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.710446:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212750 00000100:00100000:1.0:1651529418.710921:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.710939:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396782144 00000100:00100000:0.0:1651529418.710951:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212751 00000100:00100000:0.0:1651529418.710952:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+54:425322:x1731746396782144:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.710956:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.710959:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c534f7 lrc: 2/0,0 mode: --/PW res: [0x2bbb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc4be expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.710964:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbb0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.710968:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.710969:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.710970:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c534f7 lrc: 3/0,0 mode: PW/PW res: [0x2bbb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4be expref: 55 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.710974:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c534f7 lrc: 3/0,0 mode: PW/PW res: [0x2bbb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4be expref: 55 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.710978:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000093b5c984, rc 0) 00000100:00100000:0.0:1651529418.710988:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+55:425322:x1731746396782144:12345-10.240.43.64@tcp:101:dd.0 Request processed in 35us (67us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.710991:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212751 00000100:00100000:1.0:1651529418.711448:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.711465:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396782272 00000100:00100000:0.0:1651529418.711477:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212752 00000100:00100000:0.0:1651529418.711479:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+55:425322:x1731746396782272:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.711482:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.711486:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c534fe lrc: 2/0,0 mode: --/PW res: [0x2bbb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc4cc expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.711491:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbb1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.711495:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.711496:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.711497:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c534fe lrc: 3/0,0 mode: PW/PW res: [0x2bbb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4cc expref: 56 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.711501:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c534fe lrc: 3/0,0 mode: PW/PW res: [0x2bbb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4cc expref: 56 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.711505:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d2b9655c, rc 0) 00000100:00100000:0.0:1651529418.711515:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+56:425322:x1731746396782272:12345-10.240.43.64@tcp:101:dd.0 Request processed in 35us (68us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.711518:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212752 00000100:00100000:1.0:1651529418.712007:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.712025:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396782400 00000100:00100000:0.0:1651529418.712037:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212753 00000100:00100000:0.0:1651529418.712039:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+56:425322:x1731746396782400:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.712042:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.712046:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c53505 lrc: 2/0,0 mode: --/PW res: [0x2bbb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc4da expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.712051:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbb2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.712055:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.712055:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.712057:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c53505 lrc: 3/0,0 mode: PW/PW res: [0x2bbb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4da expref: 57 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.712061:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c53505 lrc: 3/0,0 mode: PW/PW res: [0x2bbb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4da expref: 57 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.712064:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000045fe8361, rc 0) 00000100:00100000:0.0:1651529418.712075:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+57:425322:x1731746396782400:12345-10.240.43.64@tcp:101:dd.0 Request processed in 35us (68us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.712077:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212753 00000100:00100000:1.0:1651529418.712533:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.712550:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396782528 00000100:00100000:0.0:1651529418.712563:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212754 00000100:00100000:0.0:1651529418.712564:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+57:425322:x1731746396782528:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.712567:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.712571:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c5350c lrc: 2/0,0 mode: --/PW res: [0x2bbb3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc4e8 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.712576:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbb3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.712580:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.712581:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.712582:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c5350c lrc: 3/0,0 mode: PW/PW res: [0x2bbb3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4e8 expref: 58 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.712589:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c5350c lrc: 3/0,0 mode: PW/PW res: [0x2bbb3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4e8 expref: 58 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.712592:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003c5315da, rc 0) 00000100:00100000:0.0:1651529418.712603:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+58:425322:x1731746396782528:12345-10.240.43.64@tcp:101:dd.0 Request processed in 38us (70us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.712605:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212754 00000100:00100000:1.0:1651529418.713090:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.713107:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396782656 00000100:00100000:0.0:1651529418.713119:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212755 00000100:00100000:0.0:1651529418.713121:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+58:425322:x1731746396782656:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.713124:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.713128:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c53513 lrc: 2/0,0 mode: --/PW res: [0x2bbb4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc4f6 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.713133:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbb4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.713136:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.713137:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.713138:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c53513 lrc: 3/0,0 mode: PW/PW res: [0x2bbb4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4f6 expref: 59 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.713143:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c53513 lrc: 3/0,0 mode: PW/PW res: [0x2bbb4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4f6 expref: 59 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.713146:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e35b0bde, rc 0) 00000100:00100000:0.0:1651529418.713157:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+59:425322:x1731746396782656:12345-10.240.43.64@tcp:101:dd.0 Request processed in 35us (67us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.713160:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212755 00000100:00100000:1.0:1651529418.713621:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.713642:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396782784 00000100:00100000:0.0:1651529418.713654:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212756 00000100:00100000:0.0:1651529418.713656:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+59:425322:x1731746396782784:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.713659:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.713663:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c5351a lrc: 2/0,0 mode: --/PW res: [0x2bbb5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc504 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.713668:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbb5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.713672:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.713673:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.713674:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c5351a lrc: 3/0,0 mode: PW/PW res: [0x2bbb5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc504 expref: 60 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.713678:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c5351a lrc: 3/0,0 mode: PW/PW res: [0x2bbb5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc504 expref: 60 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.713682:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b65e0a0d, rc 0) 00000100:00100000:0.0:1651529418.713692:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+60:425322:x1731746396782784:12345-10.240.43.64@tcp:101:dd.0 Request processed in 36us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.713695:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212756 00000100:00100000:1.0:1651529418.714205:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.714234:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396782912 00000100:00100000:0.0:1651529418.714246:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212757 00000100:00100000:0.0:1651529418.714248:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006a24970a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+60:425322:x1731746396782912:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.714251:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.714255:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c53521 lrc: 2/0,0 mode: --/PW res: [0x2bbb6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc512 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.714261:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbb6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.714264:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.714265:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.714266:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c53521 lrc: 3/0,0 mode: PW/PW res: [0x2bbb6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc512 expref: 61 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.714270:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c53521 lrc: 3/0,0 mode: PW/PW res: [0x2bbb6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc512 expref: 61 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.714274:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002731c8d2, rc 0) 00000100:00100000:0.0:1651529418.714284:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006a24970a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+61:425322:x1731746396782912:12345-10.240.43.64@tcp:101:dd.0 Request processed in 36us (80us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.714287:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212757 00000100:00100000:1.0:1651529418.714815:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.714837:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396783040 00000100:00100000:0.0:1651529418.714849:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212758 00000100:00100000:0.0:1651529418.714851:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+61:425322:x1731746396783040:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.714854:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.714858:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53528 lrc: 2/0,0 mode: --/PW res: [0x2bbb7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc520 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.714863:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbb7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.714867:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.714868:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.714869:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53528 lrc: 3/0,0 mode: PW/PW res: [0x2bbb7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc520 expref: 62 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.714876:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53528 lrc: 3/0,0 mode: PW/PW res: [0x2bbb7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc520 expref: 62 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.714879:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000041a7efd7, rc 0) 00000100:00100000:0.0:1651529418.714890:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+62:425322:x1731746396783040:12345-10.240.43.64@tcp:101:dd.0 Request processed in 38us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.714892:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212758 00000100:00100000:1.0:1651529418.715395:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.715417:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396783168 00000100:00100000:0.0:1651529418.715429:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212759 00000100:00100000:0.0:1651529418.715430:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+62:425322:x1731746396783168:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.715434:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.715438:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c5352f lrc: 2/0,0 mode: --/PW res: [0x2bbb8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc52e expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.715443:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbb8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.715446:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.715447:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.715449:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c5352f lrc: 3/0,0 mode: PW/PW res: [0x2bbb8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc52e expref: 63 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.715453:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c5352f lrc: 3/0,0 mode: PW/PW res: [0x2bbb8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc52e expref: 63 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.715456:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000676967d8, rc 0) 00000100:00100000:0.0:1651529418.715467:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+63:425322:x1731746396783168:12345-10.240.43.64@tcp:101:dd.0 Request processed in 36us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.715470:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212759 00000100:00100000:1.0:1651529418.715977:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.715999:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396783296 00000100:00100000:0.0:1651529418.716011:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212760 00000100:00100000:0.0:1651529418.716013:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+63:425322:x1731746396783296:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.716016:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.716020:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bbf33489/0x3234de053c53536 lrc: 2/0,0 mode: --/PW res: [0x2bbb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc53c expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.716025:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbb9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.716029:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.716029:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.716031:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bbf33489/0x3234de053c53536 lrc: 3/0,0 mode: PW/PW res: [0x2bbb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc53c expref: 64 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.716035:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bbf33489/0x3234de053c53536 lrc: 3/0,0 mode: PW/PW res: [0x2bbb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc53c expref: 64 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.716038:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000bbf33489, rc 0) 00000100:00100000:0.0:1651529418.716049:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+64:425322:x1731746396783296:12345-10.240.43.64@tcp:101:dd.0 Request processed in 35us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.716051:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212760 00000100:00100000:1.0:1651529418.716531:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.716552:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396783424 00000100:00100000:0.0:1651529418.716564:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212761 00000100:00100000:0.0:1651529418.716565:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+64:425322:x1731746396783424:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.716569:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.716572:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091069ebb/0x3234de053c5353d lrc: 2/0,0 mode: --/PW res: [0x2bbba:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc54a expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.716578:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.716581:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.716582:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.716583:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091069ebb/0x3234de053c5353d lrc: 3/0,0 mode: PW/PW res: [0x2bbba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc54a expref: 65 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.716588:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000091069ebb/0x3234de053c5353d lrc: 3/0,0 mode: PW/PW res: [0x2bbba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc54a expref: 65 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.716591:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000091069ebb, rc 0) 00000100:00100000:0.0:1651529418.716602:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+65:425322:x1731746396783424:12345-10.240.43.64@tcp:101:dd.0 Request processed in 36us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.716604:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212761 00000100:00100000:1.0:1651529418.717109:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.717130:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396783552 00000100:00100000:0.0:1651529418.717142:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212762 00000100:00100000:0.0:1651529418.717144:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+65:425322:x1731746396783552:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.717147:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.717151:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000066556eb/0x3234de053c53544 lrc: 2/0,0 mode: --/PW res: [0x2bbbb:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc558 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.717156:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbbb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.717159:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.717160:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.717161:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000066556eb/0x3234de053c53544 lrc: 3/0,0 mode: PW/PW res: [0x2bbbb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc558 expref: 66 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.717168:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000066556eb/0x3234de053c53544 lrc: 3/0,0 mode: PW/PW res: [0x2bbbb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc558 expref: 66 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.717172:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000066556eb, rc 0) 00000100:00100000:0.0:1651529418.717182:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+66:425322:x1731746396783552:12345-10.240.43.64@tcp:101:dd.0 Request processed in 38us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.717184:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212762 00000100:00100000:1.0:1651529418.717661:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.717683:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396783680 00000100:00100000:0.0:1651529418.717694:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212763 00000100:00100000:0.0:1651529418.717696:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+66:425322:x1731746396783680:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.717699:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.717703:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000485752e5/0x3234de053c5354b lrc: 2/0,0 mode: --/PW res: [0x2bbbc:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc566 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.717708:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbbc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.717712:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.717712:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.717714:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000485752e5/0x3234de053c5354b lrc: 3/0,0 mode: PW/PW res: [0x2bbbc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc566 expref: 67 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.717718:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000485752e5/0x3234de053c5354b lrc: 3/0,0 mode: PW/PW res: [0x2bbbc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc566 expref: 67 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.717721:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000485752e5, rc 0) 00000100:00100000:0.0:1651529418.717732:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+67:425322:x1731746396783680:12345-10.240.43.64@tcp:101:dd.0 Request processed in 35us (71us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.717735:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212763 00000100:00100000:1.0:1651529418.718237:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.718259:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396783808 00000100:00100000:0.0:1651529418.718271:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212764 00000100:00100000:0.0:1651529418.718272:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+67:425322:x1731746396783808:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.718276:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.718280:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a1913b4/0x3234de053c53552 lrc: 2/0,0 mode: --/PW res: [0x2bbbd:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc574 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.718286:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbbd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.718289:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.718290:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.718291:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a1913b4/0x3234de053c53552 lrc: 3/0,0 mode: PW/PW res: [0x2bbbd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc574 expref: 68 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.718295:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004a1913b4/0x3234de053c53552 lrc: 3/0,0 mode: PW/PW res: [0x2bbbd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc574 expref: 68 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.718299:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004a1913b4, rc 0) 00000100:00100000:0.0:1651529418.718309:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+68:425322:x1731746396783808:12345-10.240.43.64@tcp:101:dd.0 Request processed in 36us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.718312:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212764 00000100:00100000:1.0:1651529418.718776:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.718799:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396783936 00000100:00100000:0.0:1651529418.718811:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212765 00000100:00100000:0.0:1651529418.718812:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+68:425322:x1731746396783936:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.718816:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.718820:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000928e420a/0x3234de053c53559 lrc: 2/0,0 mode: --/PW res: [0x2bbbe:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc582 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.718825:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbbe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.718829:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.718829:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.718831:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000928e420a/0x3234de053c53559 lrc: 3/0,0 mode: PW/PW res: [0x2bbbe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc582 expref: 69 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.718835:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000928e420a/0x3234de053c53559 lrc: 3/0,0 mode: PW/PW res: [0x2bbbe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc582 expref: 69 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.718839:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000928e420a, rc 0) 00000100:00100000:0.0:1651529418.718849:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+69:425322:x1731746396783936:12345-10.240.43.64@tcp:101:dd.0 Request processed in 36us (79us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.718852:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212765 00000100:00100000:1.0:1651529418.719325:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.719346:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396784064 00000100:00100000:0.0:1651529418.719358:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212766 00000100:00100000:0.0:1651529418.719360:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+69:425322:x1731746396784064:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.719363:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.719367:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e600099f/0x3234de053c53560 lrc: 2/0,0 mode: --/PW res: [0x2bbbf:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc590 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.719372:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbbf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.719375:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.719376:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.719377:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e600099f/0x3234de053c53560 lrc: 3/0,0 mode: PW/PW res: [0x2bbbf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc590 expref: 70 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.719384:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e600099f/0x3234de053c53560 lrc: 3/0,0 mode: PW/PW res: [0x2bbbf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc590 expref: 70 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.719388:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e600099f, rc 0) 00000100:00100000:0.0:1651529418.719398:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+70:425322:x1731746396784064:12345-10.240.43.64@tcp:101:dd.0 Request processed in 38us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.719400:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212766 00000100:00100000:1.0:1651529418.719888:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.719909:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396784192 00000100:00100000:0.0:1651529418.719921:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212767 00000100:00100000:0.0:1651529418.719922:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+70:425322:x1731746396784192:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.719926:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.719930:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002bb34145/0x3234de053c53567 lrc: 2/0,0 mode: --/PW res: [0x2bbc0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc59e expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.719935:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbc0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.719939:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.719939:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.719941:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002bb34145/0x3234de053c53567 lrc: 3/0,0 mode: PW/PW res: [0x2bbc0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc59e expref: 71 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.719945:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002bb34145/0x3234de053c53567 lrc: 3/0,0 mode: PW/PW res: [0x2bbc0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc59e expref: 71 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.719949:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002bb34145, rc 0) 00000100:00100000:0.0:1651529418.719959:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+71:425322:x1731746396784192:12345-10.240.43.64@tcp:101:dd.0 Request processed in 36us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.719962:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212767 00000100:00100000:1.0:1651529418.720446:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.720467:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396784320 00000100:00100000:0.0:1651529418.720479:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212768 00000100:00100000:0.0:1651529418.720481:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+71:425322:x1731746396784320:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.720484:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.720488:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a091a01a/0x3234de053c5356e lrc: 2/0,0 mode: --/PW res: [0x2bbc1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc5ac expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.720493:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbc1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.720497:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.720497:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.720499:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a091a01a/0x3234de053c5356e lrc: 3/0,0 mode: PW/PW res: [0x2bbc1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5ac expref: 72 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.720503:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a091a01a/0x3234de053c5356e lrc: 3/0,0 mode: PW/PW res: [0x2bbc1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5ac expref: 72 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.720507:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a091a01a, rc 0) 00000100:00100000:0.0:1651529418.720517:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+72:425322:x1731746396784320:12345-10.240.43.64@tcp:101:dd.0 Request processed in 35us (71us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.720519:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212768 00000100:00100000:1.0:1651529418.721019:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.721041:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396784448 00000100:00100000:0.0:1651529418.721053:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212769 00000100:00100000:0.0:1651529418.721054:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+72:425322:x1731746396784448:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.721058:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.721061:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c53575 lrc: 2/0,0 mode: --/PW res: [0x2bbc2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc5ba expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.721067:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbc2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.721070:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.721071:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.721072:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c53575 lrc: 3/0,0 mode: PW/PW res: [0x2bbc2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5ba expref: 73 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.721076:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c53575 lrc: 3/0,0 mode: PW/PW res: [0x2bbc2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5ba expref: 73 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.721080:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ac1d189d, rc 0) 00000100:00100000:0.0:1651529418.721090:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+73:425322:x1731746396784448:12345-10.240.43.64@tcp:101:dd.0 Request processed in 35us (71us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.721093:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212769 00000100:00100000:1.0:1651529418.721572:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.721593:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396784576 00000100:00100000:0.0:1651529418.721605:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212770 00000100:00100000:0.0:1651529418.721607:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+73:425322:x1731746396784576:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.721610:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.721614:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c5357c lrc: 2/0,0 mode: --/PW res: [0x2bbc3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc5c8 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.721619:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbc3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.721623:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.721623:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.721625:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c5357c lrc: 3/0,0 mode: PW/PW res: [0x2bbc3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5c8 expref: 74 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.721632:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c5357c lrc: 3/0,0 mode: PW/PW res: [0x2bbc3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5c8 expref: 74 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.721635:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c8f63a78, rc 0) 00000100:00100000:0.0:1651529418.721645:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+74:425322:x1731746396784576:12345-10.240.43.64@tcp:101:dd.0 Request processed in 38us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.721648:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212770 00000100:00100000:1.0:1651529418.722155:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.722177:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396784704 00000100:00100000:0.0:1651529418.722188:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212771 00000100:00100000:0.0:1651529418.722190:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+74:425322:x1731746396784704:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.722193:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.722197:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c53583 lrc: 2/0,0 mode: --/PW res: [0x2bbc4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc5d6 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.722202:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbc4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.722206:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.722206:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.722208:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c53583 lrc: 3/0,0 mode: PW/PW res: [0x2bbc4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5d6 expref: 75 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.722212:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c53583 lrc: 3/0,0 mode: PW/PW res: [0x2bbc4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5d6 expref: 75 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.722215:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007f539dcd, rc 0) 00000100:00100000:0.0:1651529418.722238:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+75:425322:x1731746396784704:12345-10.240.43.64@tcp:101:dd.0 Request processed in 47us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.722241:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212771 00000100:00100000:1.0:1651529418.722717:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.722738:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396784832 00000100:00100000:0.0:1651529418.722750:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212772 00000100:00100000:0.0:1651529418.722752:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+75:425322:x1731746396784832:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.722755:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.722759:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c5358a lrc: 2/0,0 mode: --/PW res: [0x2bbc5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc5e4 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.722764:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbc5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.722768:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.722769:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.722770:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c5358a lrc: 3/0,0 mode: PW/PW res: [0x2bbc5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5e4 expref: 76 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.722782:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c5358a lrc: 3/0,0 mode: PW/PW res: [0x2bbc5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5e4 expref: 76 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.722786:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000baeec0a3, rc 0) 00000100:00100000:0.0:1651529418.722797:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+76:425322:x1731746396784832:12345-10.240.43.64@tcp:101:dd.0 Request processed in 44us (80us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.722799:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212772 00000100:00100000:1.0:1651529418.723002:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.723016:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396784896 00000100:00100000:0.0:1651529418.723026:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212773 00000100:00100000:0.0:1651529418.723027:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+76:425322:x1731746396784896:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.723031:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.723035:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c53591 lrc: 2/0,0 mode: --/PW res: [0x2bbc6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc5eb expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.723040:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbc6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.723044:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.723044:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.723046:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c53591 lrc: 3/0,0 mode: PW/PW res: [0x2bbc6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5eb expref: 77 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.723050:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c53591 lrc: 3/0,0 mode: PW/PW res: [0x2bbc6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5eb expref: 77 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.723054:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001ea46bb1, rc 0) 00000100:00100000:0.0:1651529418.723064:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+77:425322:x1731746396784896:12345-10.240.43.64@tcp:101:dd.0 Request processed in 36us (63us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.723067:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212773 00000100:00100000:1.0:1651529418.723259:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.723273:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396784960 00000100:00100000:0.0:1651529418.723283:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212774 00000100:00100000:0.0:1651529418.723285:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+77:425322:x1731746396784960:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.723288:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.723292:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c53598 lrc: 2/0,0 mode: --/PW res: [0x2bbc7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc5f2 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.723297:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbc7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.723300:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.723301:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.723302:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c53598 lrc: 3/0,0 mode: PW/PW res: [0x2bbc7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5f2 expref: 78 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.723309:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c53598 lrc: 3/0,0 mode: PW/PW res: [0x2bbc7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5f2 expref: 78 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.723313:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000062f8a534, rc 0) 00000100:00100000:0.0:1651529418.723323:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+78:425322:x1731746396784960:12345-10.240.43.64@tcp:101:dd.0 Request processed in 37us (64us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.723325:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212774 00000100:00100000:1.0:1651529418.723506:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.723520:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396785024 00000100:00100000:0.0:1651529418.723530:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212775 00000100:00100000:0.0:1651529418.723531:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+78:425322:x1731746396785024:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.723535:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.723538:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c5359f lrc: 2/0,0 mode: --/PW res: [0x2bbc8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc5f9 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.723543:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbc8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.723547:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.723547:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.723549:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c5359f lrc: 3/0,0 mode: PW/PW res: [0x2bbc8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5f9 expref: 79 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.723553:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c5359f lrc: 3/0,0 mode: PW/PW res: [0x2bbc8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5f9 expref: 79 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.723557:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000003af78ab, rc 0) 00000100:00100000:0.0:1651529418.723567:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+79:425322:x1731746396785024:12345-10.240.43.64@tcp:101:dd.0 Request processed in 34us (61us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.723570:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212775 00000100:00100000:1.0:1651529418.723752:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.723766:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396785088 00000100:00100000:0.0:1651529418.723782:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212776 00000100:00100000:0.0:1651529418.723784:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+79:425322:x1731746396785088:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.723787:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.723791:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c535a6 lrc: 2/0,0 mode: --/PW res: [0x2bbc9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc600 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.723796:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbc9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.723799:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.723800:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.723801:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c535a6 lrc: 3/0,0 mode: PW/PW res: [0x2bbc9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc600 expref: 80 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.723805:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c535a6 lrc: 3/0,0 mode: PW/PW res: [0x2bbc9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc600 expref: 80 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.723809:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007c1cad42, rc 0) 00000100:00100000:0.0:1651529418.723820:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+80:425322:x1731746396785088:12345-10.240.43.64@tcp:101:dd.0 Request processed in 35us (68us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.723822:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212776 00000100:00100000:1.0:1651529418.724002:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.724015:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396785152 00000100:00100000:0.0:1651529418.724025:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212777 00000100:00100000:0.0:1651529418.724026:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+80:425322:x1731746396785152:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.724029:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.724033:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c535ad lrc: 2/0,0 mode: --/PW res: [0x2bbca:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc607 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.724038:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.724042:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.724043:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.724044:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c535ad lrc: 3/0,0 mode: PW/PW res: [0x2bbca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc607 expref: 81 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.724048:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c535ad lrc: 3/0,0 mode: PW/PW res: [0x2bbca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc607 expref: 81 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.724052:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004f367ded, rc 0) 00000100:00100000:0.0:1651529418.724062:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+81:425322:x1731746396785152:12345-10.240.43.64@tcp:101:dd.0 Request processed in 35us (60us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.724064:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212777 00000100:00100000:1.0:1651529418.724245:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.724258:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396785216 00000100:00100000:0.0:1651529418.724268:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212778 00000100:00100000:0.0:1651529418.724270:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+81:425322:x1731746396785216:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.724273:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.724276:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c535b4 lrc: 2/0,0 mode: --/PW res: [0x2bbcb:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc60e expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.724281:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbcb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.724285:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.724285:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.724287:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c535b4 lrc: 3/0,0 mode: PW/PW res: [0x2bbcb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc60e expref: 82 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.724294:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c535b4 lrc: 3/0,0 mode: PW/PW res: [0x2bbcb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc60e expref: 82 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.724297:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000029b2a516, rc 0) 00000100:00100000:0.0:1651529418.724307:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+82:425322:x1731746396785216:12345-10.240.43.64@tcp:101:dd.0 Request processed in 37us (63us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.724309:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212778 00000100:00100000:1.0:1651529418.724485:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.724498:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396785280 00000100:00100000:0.0:1651529418.724508:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212779 00000100:00100000:0.0:1651529418.724509:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+82:425322:x1731746396785280:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.724513:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.724516:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c535bb lrc: 2/0,0 mode: --/PW res: [0x2bbcc:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc615 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.724521:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbcc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.724524:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.724525:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.724527:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c535bb lrc: 3/0,0 mode: PW/PW res: [0x2bbcc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc615 expref: 83 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.724531:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c535bb lrc: 3/0,0 mode: PW/PW res: [0x2bbcc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc615 expref: 83 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.724534:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c2d8d18b, rc 0) 00000100:00100000:0.0:1651529418.724544:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+83:425322:x1731746396785280:12345-10.240.43.64@tcp:101:dd.0 Request processed in 34us (59us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.724547:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212779 00000100:00100000:1.0:1651529418.724721:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.724734:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396785344 00000100:00100000:0.0:1651529418.724744:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212780 00000100:00100000:0.0:1651529418.724745:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+83:425322:x1731746396785344:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.724748:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.724752:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c535c2 lrc: 2/0,0 mode: --/PW res: [0x2bbcd:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc61c expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.724757:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbcd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.724760:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.724761:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.724763:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c535c2 lrc: 3/0,0 mode: PW/PW res: [0x2bbcd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc61c expref: 84 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.724767:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c535c2 lrc: 3/0,0 mode: PW/PW res: [0x2bbcd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc61c expref: 84 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.724770:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004678bff1, rc 0) 00000100:00100000:0.0:1651529418.724788:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+84:425322:x1731746396785344:12345-10.240.43.64@tcp:101:dd.0 Request processed in 42us (67us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.724791:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212780 00000100:00100000:1.0:1651529418.724981:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.724994:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396785408 00000100:00100000:0.0:1651529418.725003:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212781 00000100:00100000:0.0:1651529418.725005:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+84:425322:x1731746396785408:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.725008:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.725012:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c535c9 lrc: 2/0,0 mode: --/PW res: [0x2bbce:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc623 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.725017:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.725020:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.725021:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.725022:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c535c9 lrc: 3/0,0 mode: PW/PW res: [0x2bbce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc623 expref: 85 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.725026:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c535c9 lrc: 3/0,0 mode: PW/PW res: [0x2bbce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc623 expref: 85 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.725030:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c0de17df, rc 0) 00000100:00100000:0.0:1651529418.725040:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+85:425322:x1731746396785408:12345-10.240.43.64@tcp:101:dd.0 Request processed in 34us (60us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.725042:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212781 00000100:00100000:1.0:1651529418.725234:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.725248:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396785472 00000100:00100000:0.0:1651529418.725257:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212782 00000100:00100000:0.0:1651529418.725259:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+85:425322:x1731746396785472:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.725262:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.725265:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c535d0 lrc: 2/0,0 mode: --/PW res: [0x2bbcf:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc62a expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.725270:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbcf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.725274:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.725275:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.725276:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c535d0 lrc: 3/0,0 mode: PW/PW res: [0x2bbcf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc62a expref: 86 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.725283:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c535d0 lrc: 3/0,0 mode: PW/PW res: [0x2bbcf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc62a expref: 86 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.725286:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ba070658, rc 0) 00000100:00100000:0.0:1651529418.725296:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+86:425322:x1731746396785472:12345-10.240.43.64@tcp:101:dd.0 Request processed in 37us (62us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.725298:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212782 00000100:00100000:1.0:1651529418.725481:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.725494:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396785536 00000100:00100000:0.0:1651529418.725504:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212783 00000100:00100000:0.0:1651529418.725505:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+86:425322:x1731746396785536:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.725508:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.725512:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c535d7 lrc: 2/0,0 mode: --/PW res: [0x2bbd0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc631 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.725517:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbd0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.725520:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.725521:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.725522:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c535d7 lrc: 3/0,0 mode: PW/PW res: [0x2bbd0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc631 expref: 87 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.725526:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c535d7 lrc: 3/0,0 mode: PW/PW res: [0x2bbd0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc631 expref: 87 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.725530:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c2a86deb, rc 0) 00000100:00100000:0.0:1651529418.725540:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+87:425322:x1731746396785536:12345-10.240.43.64@tcp:101:dd.0 Request processed in 34us (59us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.725543:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212783 00000100:00100000:1.0:1651529418.725727:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.725740:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396785600 00000100:00100000:0.0:1651529418.725750:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212784 00000100:00100000:0.0:1651529418.725751:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+87:425322:x1731746396785600:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.725754:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.725758:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c535de lrc: 2/0,0 mode: --/PW res: [0x2bbd1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc638 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.725763:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbd1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.725767:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.725767:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.725769:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c535de lrc: 3/0,0 mode: PW/PW res: [0x2bbd1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc638 expref: 88 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.725781:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c535de lrc: 3/0,0 mode: PW/PW res: [0x2bbd1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc638 expref: 88 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.725785:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d84ad17b, rc 0) 00000100:00100000:0.0:1651529418.725795:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+88:425322:x1731746396785600:12345-10.240.43.64@tcp:101:dd.0 Request processed in 43us (69us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.725798:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212784 00000100:00100000:1.0:1651529418.725982:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.725996:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396785664 00000100:00100000:0.0:1651529418.726005:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212785 00000100:00100000:0.0:1651529418.726006:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+88:425322:x1731746396785664:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.726010:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.726013:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c535e5 lrc: 2/0,0 mode: --/PW res: [0x2bbd2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc63f expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.726018:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbd2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.726022:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.726023:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.726024:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c535e5 lrc: 3/0,0 mode: PW/PW res: [0x2bbd2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc63f expref: 89 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.726028:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c535e5 lrc: 3/0,0 mode: PW/PW res: [0x2bbd2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc63f expref: 89 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.726032:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005c863cd2, rc 0) 00000100:00100000:0.0:1651529418.726042:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+89:425322:x1731746396785664:12345-10.240.43.64@tcp:101:dd.0 Request processed in 35us (60us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.726044:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212785 00000100:00100000:1.0:1651529418.726220:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.726236:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396785728 00000100:00100000:0.0:1651529418.726245:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212786 00000100:00100000:0.0:1651529418.726247:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+89:425322:x1731746396785728:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.726250:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.726253:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c535ec lrc: 2/0,0 mode: --/PW res: [0x2bbd3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc646 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.726259:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbd3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.726262:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.726263:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.726264:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c535ec lrc: 3/0,0 mode: PW/PW res: [0x2bbd3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc646 expref: 90 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.726271:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c535ec lrc: 3/0,0 mode: PW/PW res: [0x2bbd3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc646 expref: 90 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.726275:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f149aa4b, rc 0) 00000100:00100000:0.0:1651529418.726284:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+90:425322:x1731746396785728:12345-10.240.43.64@tcp:101:dd.0 Request processed in 37us (65us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.726287:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212786 00000100:00100000:1.0:1651529418.726461:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.726474:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396785792 00000100:00100000:0.0:1651529418.726483:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212787 00000100:00100000:0.0:1651529418.726485:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+90:425322:x1731746396785792:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.726488:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.726491:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c535f3 lrc: 2/0,0 mode: --/PW res: [0x2bbd4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc64d expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.726496:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbd4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.726500:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.726500:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.726502:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c535f3 lrc: 3/0,0 mode: PW/PW res: [0x2bbd4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc64d expref: 91 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.726506:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c535f3 lrc: 3/0,0 mode: PW/PW res: [0x2bbd4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc64d expref: 91 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.726509:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000054295afd, rc 0) 00000100:00100000:0.0:1651529418.726519:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+91:425322:x1731746396785792:12345-10.240.43.64@tcp:101:dd.0 Request processed in 34us (59us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.726522:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212787 00000100:00100000:1.0:1651529418.726696:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.726709:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396785856 00000100:00100000:0.0:1651529418.726719:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212788 00000100:00100000:0.0:1651529418.726720:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+91:425322:x1731746396785856:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.726724:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.726727:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c535fa lrc: 2/0,0 mode: --/PW res: [0x2bbd5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc654 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.726732:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbd5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.726735:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.726736:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.726737:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c535fa lrc: 3/0,0 mode: PW/PW res: [0x2bbd5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc654 expref: 92 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.726741:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c535fa lrc: 3/0,0 mode: PW/PW res: [0x2bbd5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc654 expref: 92 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.726745:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ee128d1f, rc 0) 00000100:00100000:0.0:1651529418.726755:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+92:425322:x1731746396785856:12345-10.240.43.64@tcp:101:dd.0 Request processed in 34us (59us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.726757:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212788 00000100:00100000:1.0:1651529418.726946:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.726960:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396785920 00000100:00100000:0.0:1651529418.726969:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212789 00000100:00100000:0.0:1651529418.726970:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+92:425322:x1731746396785920:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.726974:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.726977:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c53601 lrc: 2/0,0 mode: --/PW res: [0x2bbd6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc65b expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.726982:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbd6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.726986:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.726986:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.726988:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c53601 lrc: 3/0,0 mode: PW/PW res: [0x2bbd6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc65b expref: 93 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.726992:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c53601 lrc: 3/0,0 mode: PW/PW res: [0x2bbd6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc65b expref: 93 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.726996:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000029e40f3d, rc 0) 00000100:00100000:0.0:1651529418.727006:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+93:425322:x1731746396785920:12345-10.240.43.64@tcp:101:dd.0 Request processed in 34us (60us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.727008:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212789 00000100:00100000:1.0:1651529418.727502:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.727524:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396786048 00000100:00100000:0.0:1651529418.727535:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212790 00000100:00100000:0.0:1651529418.727537:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+93:425322:x1731746396786048:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.727540:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.727544:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c53608 lrc: 2/0,0 mode: --/PW res: [0x2bbd7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc669 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.727549:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbd7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.727552:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.727553:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.727554:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c53608 lrc: 3/0,0 mode: PW/PW res: [0x2bbd7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc669 expref: 94 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.727561:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c53608 lrc: 3/0,0 mode: PW/PW res: [0x2bbd7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc669 expref: 94 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.727565:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000032eb11d3, rc 0) 00000100:00100000:0.0:1651529418.727575:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+94:425322:x1731746396786048:12345-10.240.43.64@tcp:101:dd.0 Request processed in 38us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.727577:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212790 00000100:00100000:1.0:1651529418.728084:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.728105:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396786176 00000100:00100000:0.0:1651529418.728117:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212791 00000100:00100000:0.0:1651529418.728119:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+94:425322:x1731746396786176:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.728122:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.728125:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c5360f lrc: 2/0,0 mode: --/PW res: [0x2bbd8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc677 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.728130:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbd8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.728134:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.728134:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.728136:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c5360f lrc: 3/0,0 mode: PW/PW res: [0x2bbd8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc677 expref: 95 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.728140:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c5360f lrc: 3/0,0 mode: PW/PW res: [0x2bbd8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc677 expref: 95 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.728144:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f3240ce7, rc 0) 00000100:00100000:0.0:1651529418.728154:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+95:425322:x1731746396786176:12345-10.240.43.64@tcp:101:dd.0 Request processed in 35us (71us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.728157:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212791 00000100:00100000:1.0:1651529418.728643:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.728665:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396786304 00000100:00100000:0.0:1651529418.728676:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212792 00000100:00100000:0.0:1651529418.728678:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+95:425322:x1731746396786304:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.728681:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.728685:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c53616 lrc: 2/0,0 mode: --/PW res: [0x2bbd9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc685 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.728690:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbd9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.728693:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.728694:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.728695:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c53616 lrc: 3/0,0 mode: PW/PW res: [0x2bbd9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc685 expref: 96 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.728699:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c53616 lrc: 3/0,0 mode: PW/PW res: [0x2bbd9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc685 expref: 96 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.728703:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005532ef34, rc 0) 00000100:00100000:0.0:1651529418.728713:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+96:425322:x1731746396786304:12345-10.240.43.64@tcp:101:dd.0 Request processed in 34us (70us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.728716:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212792 00000100:00100000:1.0:1651529418.729206:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.729241:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396786432 00000100:00100000:0.0:1651529418.729250:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212793 00000100:00100000:0.0:1651529418.729252:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+96:425322:x1731746396786432:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.729255:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.729259:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c5361d lrc: 2/0,0 mode: --/PW res: [0x2bbda:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc693 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.729264:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbda:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.729268:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.729268:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.729270:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c5361d lrc: 3/0,0 mode: PW/PW res: [0x2bbda:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc693 expref: 97 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.729274:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c5361d lrc: 3/0,0 mode: PW/PW res: [0x2bbda:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc693 expref: 97 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.729278:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000087f212ed, rc 0) 00000100:00100000:0.0:1651529418.729288:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+97:425322:x1731746396786432:12345-10.240.43.64@tcp:101:dd.0 Request processed in 35us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.729290:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212793 00000100:00100000:1.0:1651529418.729767:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.729790:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396786560 00000100:00100000:0.0:1651529418.729802:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212794 00000100:00100000:0.0:1651529418.729803:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+97:425322:x1731746396786560:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.729806:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.729810:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c53624 lrc: 2/0,0 mode: --/PW res: [0x2bbdb:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc6a1 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.729815:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbdb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.729818:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.729819:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.729821:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c53624 lrc: 3/0,0 mode: PW/PW res: [0x2bbdb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6a1 expref: 98 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.729827:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c53624 lrc: 3/0,0 mode: PW/PW res: [0x2bbdb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6a1 expref: 98 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.729831:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f10dea8, rc 0) 00000100:00100000:0.0:1651529418.729841:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+98:425322:x1731746396786560:12345-10.240.43.64@tcp:101:dd.0 Request processed in 37us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.729843:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212794 00000100:00100000:1.0:1651529418.730343:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.730365:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396786688 00000100:00100000:0.0:1651529418.730377:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212795 00000100:00100000:0.0:1651529418.730378:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+98:425322:x1731746396786688:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.730382:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.730385:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c5362b lrc: 2/0,0 mode: --/PW res: [0x2bbdc:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc6af expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.730390:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbdc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.730394:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.730394:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.730396:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c5362b lrc: 3/0,0 mode: PW/PW res: [0x2bbdc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6af expref: 99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.730400:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c5362b lrc: 3/0,0 mode: PW/PW res: [0x2bbdc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6af expref: 99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.730404:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001644aaad, rc 0) 00000100:00100000:0.0:1651529418.730414:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+99:425322:x1731746396786688:12345-10.240.43.64@tcp:101:dd.0 Request processed in 35us (71us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.730417:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212795 00000100:00100000:1.0:1651529418.730923:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.730945:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396786816 00000100:00100000:0.0:1651529418.730956:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212796 00000100:00100000:0.0:1651529418.730958:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+99:425322:x1731746396786816:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.730961:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.730967:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd0a8495/0x3234de053c53632 lrc: 2/0,0 mode: --/PW res: [0x2bbdd:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc6bd expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.730973:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbdd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.730976:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.730977:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.730978:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd0a8495/0x3234de053c53632 lrc: 3/0,0 mode: PW/PW res: [0x2bbdd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6bd expref: 100 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.730982:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cd0a8495/0x3234de053c53632 lrc: 3/0,0 mode: PW/PW res: [0x2bbdd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6bd expref: 100 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.730986:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000cd0a8495, rc 0) 00000100:00100000:0.0:1651529418.730997:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+100:425322:x1731746396786816:12345-10.240.43.64@tcp:101:dd.0 Request processed in 38us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.730999:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212796 00000100:00100000:1.0:1651529418.731500:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.731521:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396786944 00000100:00100000:0.0:1651529418.731533:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212797 00000100:00100000:0.0:1651529418.731535:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+100:425322:x1731746396786944:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651529418.731538:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529418.731542:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c70854b4/0x3234de053c53639 lrc: 2/0,0 mode: --/PW res: [0x2bbde:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc6cb expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529418.731548:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbde:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529418.731551:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.731552:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529418.731553:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c70854b4/0x3234de053c53639 lrc: 3/0,0 mode: PW/PW res: [0x2bbde:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6cb expref: 101 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.731557:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c70854b4/0x3234de053c53639 lrc: 3/0,0 mode: PW/PW res: [0x2bbde:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6cb expref: 101 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529418.731561:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c70854b4, rc 0) 00000100:00100000:0.0:1651529418.731571:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+101:425322:x1731746396786944:12345-10.240.43.64@tcp:101:dd.0 Request processed in 36us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529418.731574:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212797 00000100:00100000:1.0:1651529418.732295:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529418.732305:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529418.732326:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529418.732335:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529418.732345:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529418.732355:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529418.732366:0:72401:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396787008 00000100:00100000:0.0:1651529418.732378:0:77218:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396787136 00002000:00010000:1.0:1651529418.732383:0:72401:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179076/0 (0->18446744073709551615) 00002000:00010000:0.0:1651529418.732384:0:77218:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179077/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.732385:0:72401:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009a130088 with x1731746396787008 ext(0->18446744073709551615) 00002000:00100000:0.0:1651529418.732385:0:77218:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000900b179f with x1731746396787136 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.732389:0:72401:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000009a130088. 00002000:00010000:0.0:1651529418.732389:0:77218:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000900b179f. 00000100:00100000:0.0:1651529418.732395:0:77218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18690 00000100:00100000:1.0:1651529418.732407:0:72401:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396795392 00002000:00010000:1.0:1651529418.732411:0:72401:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179142/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.732412:0:72401:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000023afca5e with x1731746396795392 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.732414:0:72401:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000023afca5e. 00000100:00100000:1.0:1651529418.732425:0:72401:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396787264 00002000:00010000:1.0:1651529418.732428:0:72401:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179078/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.732429:0:72401:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000264aecf8 with x1731746396787264 ext(0->18446744073709551615) 00000100:00100000:0.0:1651529418.732429:0:77218:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+104:41278:x1731746396787136:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.732431:0:72401:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000264aecf8. 00000100:00100000:1.0:1651529418.732441:0:72401:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396795520 00002000:00010000:1.0:1651529418.732444:0:72401:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179144/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.732445:0:72401:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d9cfef26 with x1731746396795520 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.732447:0:72401:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000d9cfef26. 00000100:00100000:1.0:1651529418.732457:0:72401:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396787392 00002000:00010000:1.0:1651529418.732460:0:72401:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179079/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.732461:0:72401:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003d9ef3c1 with x1731746396787392 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.732463:0:72401:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000003d9ef3c1. 00000100:00100000:1.0:1651529418.732468:0:72401:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18691 00000100:00100000:1.0:1651529418.732470:0:72401:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+106:41278:x1731746396787008:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529418.732524:0:77218:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bb85:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.732526:0:72401:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bb84:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.732528:0:72401:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bb84:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.732529:0:72401:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bb84:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.732530:0:72401:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bb84:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.732531:0:72401:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bb84:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1651529418.732535:0:77218:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bb85:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.732536:0:77218:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bb85:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.732537:0:77218:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bb85:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.732537:0:77218:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bb85:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.732544:0:72401:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a130088 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+108:41278:x1731746396787008:12345-10.240.43.64@tcp:10:dd.0 Request processed in 73us (249us total) trans 12885080710 rc 0/0 00000100:00100000:1.0:1651529418.732547:0:72401:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18691 00002000:00010000:1.0:1651529418.732549:0:72401:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179076/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.732550:0:72401:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009a130088 with x1731746396787008 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.732552:0:72401:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000009a130088. 00000100:00100000:0.0:1651529418.732556:0:77218:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000900b179f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+107:41278:x1731746396787136:12345-10.240.43.64@tcp:10:dd.0 Request processed in 158us (251us total) trans 12885080709 rc 0/0 00000100:00100000:1.0:1651529418.732557:0:72401:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18692 00000100:00100000:1.0:1651529418.732559:0:72401:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+107:41279:x1731746396795392:12345-10.240.43.64@tcp:10:dd.0 00000100:00100000:0.0:1651529418.732560:0:77218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18690 00002000:00010000:0.0:1651529418.732561:0:77218:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179077/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.732562:0:77218:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000900b179f with x1731746396787136 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.732574:0:77218:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000900b179f. 00000100:00100000:0.0:1651529418.732580:0:77218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18693 00002000:00010000:1.0:1651529418.732581:0:72401:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbc6:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.732582:0:72401:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbc6:0x0] updating lvb mtime from disk: 0 -> 1651529418 00000100:00100000:0.0:1651529418.732582:0:77218:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+107:41278:x1731746396787264:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.732583:0:72401:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbc6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.732584:0:72401:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbc6:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.732585:0:72401:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbc6:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.732593:0:72401:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023afca5e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+107:41279:x1731746396795392:12345-10.240.43.64@tcp:10:dd.0 Request processed in 33us (267us total) trans 12885080711 rc 0/0 00000100:00100000:1.0:1651529418.732595:0:72401:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18692 00002000:00010000:1.0:1651529418.732597:0:72401:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179142/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.732597:0:72401:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000023afca5e with x1731746396795392 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.732599:0:72401:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000023afca5e. 00000100:00100000:1.0:1651529418.732603:0:72401:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18694 00000100:00100000:1.0:1651529418.732605:0:72401:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+107:41279:x1731746396795520:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529418.732605:0:77218:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bb86:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.732606:0:77218:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bb86:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.732607:0:77218:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bb86:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.732607:0:77218:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bb86:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.732608:0:77218:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bb86:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651529418.732616:0:77218:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000264aecf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+107:41278:x1731746396787264:12345-10.240.43.64@tcp:10:dd.0 Request processed in 34us (281us total) trans 12885080712 rc 0/0 00000100:00100000:0.0:1651529418.732619:0:77218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18693 00002000:00010000:0.0:1651529418.732620:0:77218:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179078/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.732621:0:77218:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000264aecf8 with x1731746396787264 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.732622:0:72401:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbc8:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.732623:0:72401:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbc8:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.732623:0:77218:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000264aecf8. 00002000:00010000:1.0:1651529418.732624:0:72401:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbc8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.732625:0:72401:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbc8:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.732626:0:72401:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbc8:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651529418.732627:0:77218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18695 00000100:00100000:0.0:1651529418.732629:0:77218:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+107:41278:x1731746396787392:12345-10.240.43.64@tcp:10:dd.0 00000100:00100000:1.0:1651529418.732632:0:72401:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9cfef26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+107:41279:x1731746396795520:12345-10.240.43.64@tcp:10:dd.0 Request processed in 27us (287us total) trans 12885080713 rc 0/0 00000100:00100000:1.0:1651529418.732635:0:72401:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18694 00002000:00010000:1.0:1651529418.732636:0:72401:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179144/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.732637:0:72401:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d9cfef26 with x1731746396795520 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.732638:0:72401:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000d9cfef26. 00002000:00010000:0.0:1651529418.732647:0:77218:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bb87:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.732648:0:77218:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bb87:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.732649:0:77218:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bb87:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.732649:0:77218:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bb87:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.732650:0:77218:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bb87:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651529418.732657:0:77218:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+107:41278:x1731746396787392:12345-10.240.43.64@tcp:10:dd.0 Request processed in 27us (302us total) trans 12885080714 rc 0/0 00000100:00100000:0.0:1651529418.732660:0:77218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18695 00002000:00010000:0.0:1651529418.732661:0:77218:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179079/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.732662:0:77218:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003d9ef3c1 with x1731746396787392 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.732663:0:77218:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000003d9ef3c1. 00000100:00100000:1.0:1651529418.732679:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.732694:0:77217:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396795648 00000100:00100000:1.0:1651529418.732699:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.732699:0:77217:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179146/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.732700:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003562cf4d with x1731746396795648 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.732702:0:77217:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000003562cf4d. 00000100:00100000:1.0:1651529418.732712:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.732749:0:77217:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396787520 00002000:00010000:0.0:1651529418.732754:0:77217:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179080/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.732755:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000824ca843 with x1731746396787520 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.732758:0:77217:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000824ca843. 00000100:00100000:1.0:1651529418.732759:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.732764:0:77217:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396795776 00002000:00010000:0.0:1651529418.732766:0:77217:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179148/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.732767:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000fc130417 with x1731746396795776 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.732769:0:77217:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000fc130417. 00000100:00100000:0.0:1651529418.732781:0:77217:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396787648 00002000:00010000:0.0:1651529418.732784:0:77217:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179081/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.732784:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f2582a33 with x1731746396787648 ext(0->18446744073709551615) 00000100:00100000:1.0:1651529418.732786:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.732786:0:77217:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f2582a33. 00000100:00100000:0.0:1651529418.732793:0:77217:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396795904 00002000:00010000:0.0:1651529418.732796:0:77217:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179150/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.732796:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000533fe698 with x1731746396795904 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.732798:0:77217:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000533fe698. 00000100:00100000:1.0:1651529418.732814:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.732827:0:77217:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396787776 00002000:00010000:0.0:1651529418.732832:0:77217:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179082/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.732833:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a9781da4 with x1731746396787776 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.732835:0:77217:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000a9781da4. 00000100:00100000:0.0:1651529418.732838:0:77217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18696 00000100:00100000:0.0:1651529418.732840:0:77217:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+112:41279:x1731746396795648:12345-10.240.43.64@tcp:10:dd.0 00000100:00100000:1.0:1651529418.732858:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529418.732863:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.732865:0:77217:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbca:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.732866:0:77217:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbca:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.732867:0:77217:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbca:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:1.0:1651529418.732868:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.732868:0:77217:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbca:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.732869:0:77217:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbca:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.732872:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529418.732880:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529418.732885:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529418.732894:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.732895:0:77217:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+113:41279:x1731746396795648:12345-10.240.43.64@tcp:10:dd.0 Request processed in 54us (216us total) trans 12885080715 rc 0/0 00000100:00100000:0.0:1651529418.732907:0:77217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18696 00002000:00010000:0.0:1651529418.732908:0:77217:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179146/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.732909:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003562cf4d with x1731746396795648 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.732911:0:77217:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000003562cf4d. 00000100:00100000:0.0:1651529418.732916:0:77217:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396796032 00002000:00010000:0.0:1651529418.732920:0:77217:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179152/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.732920:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000037915b7c with x1731746396796032 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.732922:0:77217:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000037915b7c. 00000100:00100000:0.0:1651529418.732924:0:77217:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396787904 00000100:00100000:1.0:1651529418.732926:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.732926:0:77217:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179083/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.732927:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000007cc482d1 with x1731746396787904 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.732928:0:77217:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000007cc482d1. 00000100:00100000:0.0:1651529418.732930:0:77217:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396796160 00002000:00010000:0.0:1651529418.732932:0:77217:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179154/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.732933:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000031af23e4 with x1731746396796160 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.732935:0:77217:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000031af23e4. 00000100:00100000:0.0:1651529418.732936:0:77217:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396788032 00000100:00100000:1.0:1651529418.732938:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.732938:0:77217:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179084/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.732939:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000064ae60d1 with x1731746396788032 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.732940:0:77217:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000064ae60d1. 00000100:00100000:0.0:1651529418.732942:0:77217:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396796288 00000100:00100000:1.0:1651529418.732944:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529418.732949:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529418.732953:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.732957:0:77217:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179156/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.732958:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000db8ebaee with x1731746396796288 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.732960:0:77217:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000db8ebaee. 00000100:00100000:0.0:1651529418.732963:0:77217:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396796416 00002000:00010000:0.0:1651529418.732966:0:77217:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179158/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.732967:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000fbe593e6 with x1731746396796416 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.732968:0:77217:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000fbe593e6. 00000100:00100000:0.0:1651529418.732970:0:77217:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396788160 00002000:00010000:0.0:1651529418.732973:0:77217:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179085/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.732973:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000032aa8f1f with x1731746396788160 ext(0->18446744073709551615) 00000100:00100000:1.0:1651529418.732975:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.732975:0:77217:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000032aa8f1f. 00000100:00100000:0.0:1651529418.732977:0:77217:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396796544 00002000:00010000:0.0:1651529418.732979:0:77217:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179159/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.732979:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000022c81dd8 with x1731746396796544 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.732981:0:77217:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000022c81dd8. 00000100:00100000:1.0:1651529418.732983:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.732983:0:77217:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396788288 00002000:00010000:0.0:1651529418.732985:0:77217:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179086/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.732986:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000082d2fd29 with x1731746396788288 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.732987:0:77217:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000082d2fd29. 00000100:00100000:1.0:1651529418.732988:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.732989:0:77217:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396796672 00002000:00010000:0.0:1651529418.732991:0:77217:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179160/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.732991:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000023692e44 with x1731746396796672 ext(0->18446744073709551615) 00000100:00100000:1.0:1651529418.732993:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.732993:0:77217:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000023692e44. 00000100:00100000:0.0:1651529418.732995:0:77217:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396788416 00002000:00010000:0.0:1651529418.732997:0:77217:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179087/0 (0->18446744073709551615) 00000100:00100000:1.0:1651529418.732998:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00100000:0.0:1651529418.732998:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000920d7c95 with x1731746396788416 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.732999:0:77217:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000920d7c95. 00000100:00100000:1.0:1651529418.733002:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.733013:0:77217:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396796800 00000100:00100000:1.0:1651529418.733016:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.733016:0:77217:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179161/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.733017:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009da5b251 with x1731746396796800 ext(0->18446744073709551615) 00000100:00100000:1.0:1651529418.733022:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529418.733027:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.733028:0:77217:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000009da5b251. 00000100:00100000:0.0:1651529418.733031:0:77217:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396788544 00002000:00010000:0.0:1651529418.733034:0:77217:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179088/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.733035:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d67aeedd with x1731746396788544 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.733036:0:77217:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000d67aeedd. 00000100:00100000:0.0:1651529418.733038:0:77217:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396796928 00002000:00010000:0.0:1651529418.733040:0:77217:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179162/0 (0->18446744073709551615) 00000100:00100000:1.0:1651529418.733041:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00100000:0.0:1651529418.733041:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000008e86d0b9 with x1731746396796928 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.733042:0:77217:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000008e86d0b9. 00000100:00100000:0.0:1651529418.733044:0:77217:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396788672 00002000:00010000:0.0:1651529418.733046:0:77217:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179089/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.733047:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005c057838 with x1731746396788672 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.733048:0:77217:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000005c057838. 00000100:00100000:0.0:1651529418.733050:0:77217:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396797056 00002000:00010000:0.0:1651529418.733052:0:77217:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179163/0 (0->18446744073709551615) 00000100:00100000:1.0:1651529418.733053:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00100000:0.0:1651529418.733053:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009cf0fcef with x1731746396797056 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.733054:0:77217:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000009cf0fcef. 00000100:00100000:0.0:1651529418.733056:0:77217:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396788800 00000100:00100000:1.0:1651529418.733058:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.733058:0:77217:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179090/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.733059:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000008a45af4d with x1731746396788800 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.733060:0:77217:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000008a45af4d. 00000100:00100000:0.0:1651529418.733062:0:77217:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396797184 00000100:00100000:1.0:1651529418.733063:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.733065:0:77217:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179164/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.733066:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e3b611c3 with x1731746396797184 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.733067:0:77217:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000e3b611c3. 00000100:00100000:1.0:1651529418.733068:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.733069:0:77217:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396797312 00002000:00010000:0.0:1651529418.733071:0:77217:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179165/0 (0->18446744073709551615) 00000100:00100000:1.0:1651529418.733074:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529418.733082:0:77220:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396788928 00002000:00100000:0.0:1651529418.733087:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000099b1c30a with x1731746396797312 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.733089:0:77217:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000099b1c30a. 00000100:00100000:0.0:1651529418.733092:0:77217:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396797440 00002000:00010000:0.0:1651529418.733099:0:77217:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179166/0 (0->18446744073709551615) 00002000:00010000:1.0:1651529418.733100:0:77220:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179091/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.733100:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001f4ded7d with x1731746396797440 ext(0->18446744073709551615) 00002000:00100000:1.0:1651529418.733101:0:77220:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000467abc4e with x1731746396788928 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.733102:0:77217:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000001f4ded7d. 00002000:00010000:1.0:1651529418.733104:0:77220:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000467abc4e. 00000100:00100000:0.0:1651529418.733104:0:77217:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396789056 00002000:00010000:0.0:1651529418.733106:0:77217:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179092/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.733107:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001ce222fa with x1731746396789056 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.733108:0:77217:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000001ce222fa. 00000100:00100000:0.0:1651529418.733110:0:77217:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396789184 00000100:00100000:1.0:1651529418.733112:0:77220:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396789312 00002000:00010000:0.0:1651529418.733112:0:77217:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179093/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.733113:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a79bdd7b with x1731746396789184 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.733114:0:77217:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000a79bdd7b. 00002000:00010000:1.0:1651529418.733115:0:77220:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179094/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.733116:0:77220:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a1e3d13f with x1731746396789312 ext(0->18446744073709551615) 00000100:00100000:0.0:1651529418.733116:0:77217:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396789440 00002000:00010000:1.0:1651529418.733117:0:77220:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000a1e3d13f. 00002000:00010000:0.0:1651529418.733118:0:77217:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179095/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.733119:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005f4fab27 with x1731746396789440 ext(0->18446744073709551615) 00000100:00100000:1.0:1651529418.733120:0:77220:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396789568 00002000:00010000:0.0:1651529418.733120:0:77217:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000005f4fab27. 00002000:00010000:1.0:1651529418.733122:0:77220:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179096/0 (0->18446744073709551615) 00000100:00100000:0.0:1651529418.733122:0:77217:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396789696 00002000:00100000:1.0:1651529418.733123:0:77220:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004cc6e7b3 with x1731746396789568 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.733124:0:77220:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000004cc6e7b3. 00000100:00100000:1.0:1651529418.733127:0:77220:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18697 00000100:00100000:1.0:1651529418.733129:0:77220:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+139:41278:x1731746396787520:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529418.733151:0:77217:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179097/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.733152:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001f657f31 with x1731746396789696 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.733154:0:77217:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000001f657f31. 00000100:00100000:0.0:1651529418.733158:0:77217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18698 00000100:00100000:0.0:1651529418.733160:0:77217:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+140:41279:x1731746396795776:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.733162:0:77220:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bb88:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733163:0:77220:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bb88:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733164:0:77220:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bb88:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733165:0:77220:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bb88:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733166:0:77220:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bb88:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.733175:0:77220:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000824ca843 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+140:41278:x1731746396787520:12345-10.240.43.64@tcp:10:dd.0 Request processed in 46us (476us total) trans 12885080716 rc 0/0 00000100:00100000:1.0:1651529418.733178:0:77220:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18697 00002000:00010000:1.0:1651529418.733179:0:77220:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179080/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.733180:0:77220:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000824ca843 with x1731746396787520 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.733182:0:77220:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000824ca843. 00000100:00100000:1.0:1651529418.733187:0:77220:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18699 00000100:00100000:1.0:1651529418.733189:0:77220:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+139:41278:x1731746396787648:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529418.733200:0:77217:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbcc:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733201:0:77217:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbcc:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.733202:0:77217:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbcc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733203:0:77217:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbcc:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.733204:0:77217:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbcc:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733207:0:77220:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bb89:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733208:0:77220:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bb89:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733209:0:77220:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bb89:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733210:0:77220:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bb89:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733211:0:77220:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bb89:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.733217:0:77220:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2582a33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+141:41278:x1731746396787648:12345-10.240.43.64@tcp:10:dd.0 Request processed in 28us (459us total) trans 12885080718 rc 0/0 00000100:00100000:1.0:1651529418.733220:0:77220:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18699 00002000:00010000:1.0:1651529418.733221:0:77220:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179081/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.733235:0:77220:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f2582a33 with x1731746396787648 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.733237:0:77220:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f2582a33. 00000100:00100000:0.0:1651529418.733238:0:77217:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc130417 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+141:41279:x1731746396795776:12345-10.240.43.64@tcp:10:dd.0 Request processed in 76us (525us total) trans 12885080717 rc 0/0 00000100:00100000:0.0:1651529418.733241:0:77217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18698 00002000:00010000:0.0:1651529418.733242:0:77217:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179148/0 (0->18446744073709551615) 00000100:00100000:1.0:1651529418.733243:0:77220:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18700 00002000:00100000:0.0:1651529418.733243:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000fc130417 with x1731746396795776 ext(0->18446744073709551615) 00000100:00100000:1.0:1651529418.733244:0:77220:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+140:41279:x1731746396795904:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529418.733245:0:77217:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000fc130417. 00000100:00100000:0.0:1651529418.733261:0:77217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18701 00000100:00100000:0.0:1651529418.733262:0:77217:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a9781da4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+140:41278:x1731746396787776:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.733266:0:77220:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbce:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733267:0:77220:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbce:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733268:0:77220:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbce:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733269:0:77220:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbce:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733270:0:77220:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbce:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.733277:0:77220:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000533fe698 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+140:41279:x1731746396795904:12345-10.240.43.64@tcp:10:dd.0 Request processed in 32us (491us total) trans 12885080719 rc 0/0 00000100:00100000:1.0:1651529418.733280:0:77220:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18700 00002000:00010000:1.0:1651529418.733281:0:77220:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179150/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.733282:0:77220:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000533fe698 with x1731746396795904 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.733283:0:77220:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000533fe698. 00000100:00100000:1.0:1651529418.733288:0:77220:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18702 00000100:00100000:1.0:1651529418.733289:0:77220:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037915b7c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+139:41279:x1731746396796032:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.733306:0:77220:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbd0:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733307:0:77220:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbd0:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733308:0:77220:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbd0:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733309:0:77220:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbd0:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733310:0:77220:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbd0:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733311:0:77217:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bb8a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733312:0:77217:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bb8a:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.733313:0:77217:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bb8a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733314:0:77217:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bb8a:0x0] updating lvb ctime from disk: 0 -> 1651529418 00000100:00100000:1.0:1651529418.733316:0:77220:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037915b7c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+141:41279:x1731746396796032:12345-10.240.43.64@tcp:10:dd.0 Request processed in 26us (458us total) trans 12885080721 rc 0/0 00000100:00100000:1.0:1651529418.733318:0:77220:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18702 00002000:00010000:1.0:1651529418.733319:0:77220:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179152/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.733320:0:77220:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000037915b7c with x1731746396796032 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.733321:0:77220:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000037915b7c. 00000100:00100000:1.0:1651529418.733325:0:77220:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18703 00000100:00100000:1.0:1651529418.733327:0:77220:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007cc482d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+140:41278:x1731746396787904:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529418.733331:0:77217:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bb8a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651529418.733340:0:77217:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a9781da4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+140:41278:x1731746396787776:12345-10.240.43.64@tcp:10:dd.0 Request processed in 77us (526us total) trans 12885080720 rc 0/0 00002000:00010000:1.0:1651529418.733345:0:77220:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bb8b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733346:0:77220:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bb8b:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733347:0:77220:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bb8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733348:0:77220:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bb8b:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733349:0:77220:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bb8b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651529418.733352:0:77217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18701 00002000:00010000:0.0:1651529418.733353:0:77217:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179082/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.733354:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a9781da4 with x1731746396787776 ext(0->18446744073709551615) 00000100:00100000:1.0:1651529418.733355:0:77220:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007cc482d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+141:41278:x1731746396787904:12345-10.240.43.64@tcp:10:dd.0 Request processed in 28us (492us total) trans 12885080722 rc 0/0 00002000:00010000:0.0:1651529418.733356:0:77217:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000a9781da4. 00000100:00100000:1.0:1651529418.733358:0:77220:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18703 00002000:00010000:1.0:1651529418.733359:0:77220:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179083/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.733360:0:77220:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000007cc482d1 with x1731746396787904 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.733361:0:77220:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000007cc482d1. 00000100:00100000:1.0:1651529418.733366:0:77220:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18704 00000100:00100000:1.0:1651529418.733367:0:77220:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031af23e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+139:41279:x1731746396796160:12345-10.240.43.64@tcp:10:dd.0 00000100:00100000:0.0:1651529418.733370:0:77217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18705 00000100:00100000:0.0:1651529418.733372:0:77217:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000064ae60d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+139:41278:x1731746396788032:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.733383:0:77220:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbd2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733384:0:77220:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbd2:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733385:0:77220:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbd2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733386:0:77220:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbd2:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733386:0:77220:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbd2:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.733393:0:77220:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031af23e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+140:41279:x1731746396796160:12345-10.240.43.64@tcp:10:dd.0 Request processed in 25us (524us total) trans 12885080723 rc 0/0 00000100:00100000:1.0:1651529418.733395:0:77220:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18704 00002000:00010000:1.0:1651529418.733396:0:77220:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179154/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.733397:0:77220:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000031af23e4 with x1731746396796160 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.733398:0:77220:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000031af23e4. 00000100:00100000:1.0:1651529418.733402:0:77220:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18706 00000100:00100000:1.0:1651529418.733404:0:77220:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000db8ebaee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+139:41279:x1731746396796288:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.733420:0:77220:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbd4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733421:0:77220:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbd4:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733422:0:77220:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbd4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733423:0:77220:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbd4:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733424:0:77220:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbd4:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.733429:0:77220:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000db8ebaee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+141:41279:x1731746396796288:12345-10.240.43.64@tcp:10:dd.0 Request processed in 24us (549us total) trans 12885080724 rc 0/0 00002000:00010000:0.0:1651529418.733432:0:77217:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bb8c:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1651529418.733433:0:77220:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18706 00002000:00010000:0.0:1651529418.733433:0:77217:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bb8c:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733434:0:77220:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179156/0 (0->18446744073709551615) 00002000:00010000:0.0:1651529418.733434:0:77217:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bb8c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00100000:1.0:1651529418.733435:0:77220:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000db8ebaee with x1731746396796288 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.733435:0:77217:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bb8c:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733436:0:77220:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000db8ebaee. 00002000:00010000:0.0:1651529418.733436:0:77217:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bb8c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.733440:0:77220:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18707 00000100:00100000:1.0:1651529418.733441:0:77220:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fbe593e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+140:41279:x1731746396796416:12345-10.240.43.64@tcp:10:dd.0 00000100:00100000:0.0:1651529418.733442:0:77217:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000064ae60d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+140:41278:x1731746396788032:12345-10.240.43.64@tcp:10:dd.0 Request processed in 70us (569us total) trans 12885080725 rc 0/0 00000100:00100000:0.0:1651529418.733445:0:77217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18705 00002000:00010000:0.0:1651529418.733446:0:77217:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179084/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.733447:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000064ae60d1 with x1731746396788032 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.733448:0:77217:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000064ae60d1. 00000100:00100000:0.0:1651529418.733453:0:77217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18708 00000100:00100000:0.0:1651529418.733455:0:77217:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000032aa8f1f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+139:41278:x1731746396788160:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.733459:0:77220:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbd6:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733460:0:77220:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbd6:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733461:0:77220:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbd6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733462:0:77220:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbd6:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733463:0:77220:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbd6:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.733468:0:77220:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fbe593e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+140:41279:x1731746396796416:12345-10.240.43.64@tcp:10:dd.0 Request processed in 26us (583us total) trans 12885080726 rc 0/0 00000100:00100000:1.0:1651529418.733471:0:77220:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18707 00002000:00010000:1.0:1651529418.733472:0:77220:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179158/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.733473:0:77220:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000fbe593e6 with x1731746396796416 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.733474:0:77220:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000fbe593e6. 00002000:00010000:0.0:1651529418.733474:0:77217:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bb8d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733475:0:77217:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bb8d:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.733476:0:77217:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bb8d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733476:0:77217:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bb8d:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.733477:0:77217:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bb8d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.733479:0:77220:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18709 00000100:00100000:1.0:1651529418.733480:0:77220:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000022c81dd8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+140:41279:x1731746396796544:12345-10.240.43.64@tcp:10:dd.0 00000100:00100000:0.0:1651529418.733483:0:77217:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000032aa8f1f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+140:41278:x1731746396788160:12345-10.240.43.64@tcp:10:dd.0 Request processed in 27us (588us total) trans 12885080727 rc 0/0 00000100:00100000:0.0:1651529418.733485:0:77217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18708 00002000:00010000:0.0:1651529418.733487:0:77217:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179085/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.733487:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000032aa8f1f with x1731746396788160 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.733489:0:77217:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000032aa8f1f. 00000100:00100000:0.0:1651529418.733493:0:77217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18710 00000100:00100000:0.0:1651529418.733495:0:77217:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082d2fd29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+140:41278:x1731746396788288:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.733497:0:77220:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbd7:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733498:0:77220:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbd7:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733498:0:77220:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbd7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733499:0:77220:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbd7:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733500:0:77220:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbd7:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.733506:0:77220:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000022c81dd8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+140:41279:x1731746396796544:12345-10.240.43.64@tcp:10:dd.0 Request processed in 25us (580us total) trans 12885080728 rc 0/0 00000100:00100000:1.0:1651529418.733508:0:77220:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18709 00002000:00010000:1.0:1651529418.733509:0:77220:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179159/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.733510:0:77220:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000022c81dd8 with x1731746396796544 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.733511:0:77220:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000022c81dd8. 00002000:00010000:0.0:1651529418.733511:0:77217:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bb8e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733512:0:77217:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bb8e:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.733513:0:77217:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bb8e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733514:0:77217:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bb8e:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.733514:0:77217:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bb8e:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.733516:0:77220:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18711 00000100:00100000:1.0:1651529418.733517:0:77220:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000023692e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+140:41279:x1731746396796672:12345-10.240.43.64@tcp:10:dd.0 00000100:00100000:0.0:1651529418.733520:0:77217:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082d2fd29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+140:41278:x1731746396788288:12345-10.240.43.64@tcp:10:dd.0 Request processed in 25us (581us total) trans 12885080729 rc 0/0 00000100:00100000:0.0:1651529418.733522:0:77217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18710 00002000:00010000:0.0:1651529418.733523:0:77217:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179086/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.733524:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000082d2fd29 with x1731746396788288 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.733525:0:77217:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000082d2fd29. 00000100:00100000:0.0:1651529418.733530:0:77217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18712 00000100:00100000:0.0:1651529418.733531:0:77217:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000920d7c95 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+140:41278:x1731746396788416:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.733533:0:77220:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbd8:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733534:0:77220:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbd8:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733535:0:77220:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbd8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733536:0:77220:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbd8:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733536:0:77220:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbd8:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.733542:0:77220:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000023692e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+140:41279:x1731746396796672:12345-10.240.43.64@tcp:10:dd.0 Request processed in 24us (597us total) trans 12885080730 rc 0/0 00000100:00100000:1.0:1651529418.733544:0:77220:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18711 00002000:00010000:1.0:1651529418.733545:0:77220:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179160/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.733546:0:77220:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000023692e44 with x1731746396796672 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.733547:0:77220:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000023692e44. 00002000:00010000:0.0:1651529418.733547:0:77217:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bb8f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733548:0:77217:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bb8f:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.733549:0:77217:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bb8f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733550:0:77217:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bb8f:0x0] updating lvb ctime from disk: 0 -> 1651529418 00000100:00100000:1.0:1651529418.733551:0:77220:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18713 00002000:00010000:0.0:1651529418.733551:0:77217:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bb8f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.733553:0:77220:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009da5b251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+140:41279:x1731746396796800:12345-10.240.43.64@tcp:10:dd.0 00000100:00100000:0.0:1651529418.733556:0:77217:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000920d7c95 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+140:41278:x1731746396788416:12345-10.240.43.64@tcp:10:dd.0 Request processed in 24us (607us total) trans 12885080731 rc 0/0 00000100:00100000:0.0:1651529418.733561:0:77217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18712 00002000:00010000:0.0:1651529418.733561:0:77217:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179087/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.733562:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000920d7c95 with x1731746396788416 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.733564:0:77217:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000920d7c95. 00000100:00100000:0.0:1651529418.733568:0:77217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18714 00002000:00010000:1.0:1651529418.733569:0:77220:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbd9:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1651529418.733569:0:77217:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d67aeedd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+140:41278:x1731746396788544:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.733570:0:77220:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbd9:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733571:0:77220:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbd9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733571:0:77220:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbd9:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733573:0:77220:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbd9:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.733578:0:77220:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009da5b251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+140:41279:x1731746396796800:12345-10.240.43.64@tcp:10:dd.0 Request processed in 24us (624us total) trans 12885080732 rc 0/0 00000100:00100000:1.0:1651529418.733580:0:77220:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18713 00002000:00010000:1.0:1651529418.733582:0:77220:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179161/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.733582:0:77220:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009da5b251 with x1731746396796800 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.733584:0:77220:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000009da5b251. 00002000:00010000:0.0:1651529418.733585:0:77217:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bb90:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733586:0:77217:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bb90:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.733587:0:77217:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bb90:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:1.0:1651529418.733588:0:77220:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18715 00002000:00010000:0.0:1651529418.733588:0:77217:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bb90:0x0] updating lvb ctime from disk: 0 -> 1651529418 00000100:00100000:1.0:1651529418.733589:0:77220:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008e86d0b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+140:41279:x1731746396796928:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529418.733589:0:77217:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bb90:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651529418.733594:0:77217:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d67aeedd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+140:41278:x1731746396788544:12345-10.240.43.64@tcp:10:dd.0 Request processed in 24us (625us total) trans 12885080733 rc 0/0 00000100:00100000:0.0:1651529418.733596:0:77217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18714 00002000:00010000:0.0:1651529418.733597:0:77217:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179088/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.733598:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d67aeedd with x1731746396788544 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.733599:0:77217:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000d67aeedd. 00000100:00100000:0.0:1651529418.733604:0:77217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18716 00002000:00010000:1.0:1651529418.733605:0:77220:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbda:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1651529418.733605:0:77217:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c057838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+140:41278:x1731746396788672:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.733606:0:77220:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbda:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733607:0:77220:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbda:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733607:0:77220:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbda:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733608:0:77220:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbda:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.733614:0:77220:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008e86d0b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+140:41279:x1731746396796928:12345-10.240.43.64@tcp:10:dd.0 Request processed in 24us (630us total) trans 12885080734 rc 0/0 00000100:00100000:1.0:1651529418.733616:0:77220:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18715 00002000:00010000:1.0:1651529418.733617:0:77220:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179162/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.733618:0:77220:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000008e86d0b9 with x1731746396796928 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.733619:0:77220:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000008e86d0b9. 00002000:00010000:0.0:1651529418.733621:0:77217:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bb91:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733622:0:77217:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bb91:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.733622:0:77217:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bb91:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:1.0:1651529418.733623:0:77220:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18717 00002000:00010000:0.0:1651529418.733623:0:77217:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bb91:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.733624:0:77217:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bb91:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.733625:0:77220:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009cf0fcef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+140:41279:x1731746396797056:12345-10.240.43.64@tcp:10:dd.0 00000100:00100000:0.0:1651529418.733630:0:77217:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c057838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+140:41278:x1731746396788672:12345-10.240.43.64@tcp:10:dd.0 Request processed in 24us (641us total) trans 12885080735 rc 0/0 00000100:00100000:0.0:1651529418.733632:0:77217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18716 00002000:00010000:0.0:1651529418.733633:0:77217:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179089/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.733634:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005c057838 with x1731746396788672 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.733635:0:77217:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000005c057838. 00000100:00100000:0.0:1651529418.733640:0:77217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18718 00002000:00010000:1.0:1651529418.733641:0:77220:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbdb:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1651529418.733641:0:77217:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008a45af4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+140:41278:x1731746396788800:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.733642:0:77220:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbdb:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733643:0:77220:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbdb:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733644:0:77220:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbdb:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733645:0:77220:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbdb:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.733650:0:77220:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009cf0fcef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+140:41279:x1731746396797056:12345-10.240.43.64@tcp:10:dd.0 Request processed in 24us (656us total) trans 12885080736 rc 0/0 00000100:00100000:1.0:1651529418.733653:0:77220:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18717 00002000:00010000:1.0:1651529418.733654:0:77220:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179163/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.733654:0:77220:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009cf0fcef with x1731746396797056 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.733656:0:77220:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000009cf0fcef. 00002000:00010000:0.0:1651529418.733657:0:77217:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bb92:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733658:0:77217:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bb92:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.733659:0:77217:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bb92:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733659:0:77217:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bb92:0x0] updating lvb ctime from disk: 0 -> 1651529418 00000100:00100000:1.0:1651529418.733660:0:77220:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18719 00002000:00010000:0.0:1651529418.733660:0:77217:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bb92:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.733661:0:77220:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e3b611c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+140:41279:x1731746396797184:12345-10.240.43.64@tcp:10:dd.0 00000100:00100000:0.0:1651529418.733666:0:77217:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008a45af4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+140:41278:x1731746396788800:12345-10.240.43.64@tcp:10:dd.0 Request processed in 24us (668us total) trans 12885080737 rc 0/0 00000100:00100000:0.0:1651529418.733668:0:77217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18718 00002000:00010000:0.0:1651529418.733669:0:77217:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179090/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.733670:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000008a45af4d with x1731746396788800 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.733671:0:77217:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000008a45af4d. 00002000:00010000:1.0:1651529418.733676:0:77220:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbdc:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1651529418.733676:0:77217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18720 00000100:00100000:0.0:1651529418.733677:0:77217:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000099b1c30a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+140:41279:x1731746396797312:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.733678:0:77220:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbdc:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733678:0:77220:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbdc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733679:0:77220:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbdc:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733680:0:77220:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbdc:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.733685:0:77220:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e3b611c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+140:41279:x1731746396797184:12345-10.240.43.64@tcp:10:dd.0 Request processed in 24us (683us total) trans 12885080738 rc 0/0 00000100:00100000:1.0:1651529418.733688:0:77220:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18719 00002000:00010000:1.0:1651529418.733689:0:77220:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179164/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.733690:0:77220:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e3b611c3 with x1731746396797184 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.733691:0:77220:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000e3b611c3. 00000100:00100000:1.0:1651529418.733695:0:77220:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18721 00002000:00010000:0.0:1651529418.733695:0:77217:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbdd:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733696:0:77217:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbdd:0x0] updating lvb mtime from disk: 0 -> 1651529418 00000100:00100000:1.0:1651529418.733697:0:77220:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f4ded7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+140:41279:x1731746396797440:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529418.733697:0:77217:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbdd:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733698:0:77217:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbdd:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.733699:0:77217:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbdd:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651529418.733704:0:77217:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000099b1c30a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+140:41279:x1731746396797312:12345-10.240.43.64@tcp:10:dd.0 Request processed in 26us (688us total) trans 12885080739 rc 0/0 00000100:00100000:0.0:1651529418.733707:0:77217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18720 00002000:00010000:0.0:1651529418.733708:0:77217:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179165/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.733709:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000099b1c30a with x1731746396797312 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.733710:0:77217:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000099b1c30a. 00002000:00010000:1.0:1651529418.733714:0:77220:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbde:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1651529418.733714:0:77217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18722 00002000:00010000:1.0:1651529418.733715:0:77220:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbde:0x0] updating lvb mtime from disk: 0 -> 1651529418 00000100:00100000:0.0:1651529418.733716:0:77217:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000467abc4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+140:41278:x1731746396788928:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.733717:0:77220:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbde:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733717:0:77220:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbde:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733718:0:77220:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbde:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.733723:0:77220:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f4ded7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+140:41279:x1731746396797440:12345-10.240.43.64@tcp:10:dd.0 Request processed in 26us (696us total) trans 12885080740 rc 0/0 00000100:00100000:1.0:1651529418.733726:0:77220:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18721 00002000:00010000:1.0:1651529418.733727:0:77220:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179166/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.733728:0:77220:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001f4ded7d with x1731746396797440 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.733729:0:77220:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000001f4ded7d. 00000100:00100000:1.0:1651529418.733733:0:77220:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18723 00002000:00010000:0.0:1651529418.733734:0:77217:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bb93:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1651529418.733735:0:77220:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001ce222fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+140:41278:x1731746396789056:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529418.733735:0:77217:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bb93:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.733736:0:77217:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bb93:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733737:0:77217:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bb93:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.733738:0:77217:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bb93:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651529418.733743:0:77217:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000467abc4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+140:41278:x1731746396788928:12345-10.240.43.64@tcp:10:dd.0 Request processed in 27us (721us total) trans 12885080741 rc 0/0 00000100:00100000:0.0:1651529418.733746:0:77217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18722 00002000:00010000:0.0:1651529418.733747:0:77217:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179091/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.733748:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000467abc4e with x1731746396788928 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.733749:0:77217:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000467abc4e. 00002000:00010000:1.0:1651529418.733752:0:77220:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bb94:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733753:0:77220:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bb94:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733754:0:77220:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bb94:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:0.0:1651529418.733754:0:77217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18724 00002000:00010000:1.0:1651529418.733755:0:77220:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bb94:0x0] updating lvb ctime from disk: 0 -> 1651529418 00000100:00100000:0.0:1651529418.733755:0:77217:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a79bdd7b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+140:41278:x1731746396789184:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.733756:0:77220:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bb94:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.733770:0:77220:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001ce222fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+141:41278:x1731746396789056:12345-10.240.43.64@tcp:10:dd.0 Request processed in 34us (728us total) trans 12885080742 rc 0/0 00000100:00100000:1.0:1651529418.733781:0:77220:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18723 00002000:00010000:0.0:1651529418.733782:0:77217:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bb95:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733783:0:77220:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179092/0 (0->18446744073709551615) 00002000:00010000:0.0:1651529418.733783:0:77217:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bb95:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00100000:1.0:1651529418.733784:0:77220:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001ce222fa with x1731746396789056 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.733784:0:77217:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bb95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733785:0:77220:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000001ce222fa. 00002000:00010000:0.0:1651529418.733785:0:77217:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bb95:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.733786:0:77217:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bb95:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.733790:0:77220:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18725 00000100:00100000:1.0:1651529418.733792:0:77220:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1e3d13f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+140:41278:x1731746396789312:12345-10.240.43.64@tcp:10:dd.0 00000100:00100000:0.0:1651529418.733793:0:77217:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a79bdd7b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+140:41278:x1731746396789184:12345-10.240.43.64@tcp:10:dd.0 Request processed in 37us (739us total) trans 12885080743 rc 0/0 00000100:00100000:0.0:1651529418.733796:0:77217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18724 00002000:00010000:0.0:1651529418.733797:0:77217:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179093/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.733798:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a79bdd7b with x1731746396789184 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.733799:0:77217:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000a79bdd7b. 00000100:00100000:0.0:1651529418.733804:0:77217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18726 00000100:00100000:0.0:1651529418.733806:0:77217:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005f4fab27 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+139:41278:x1731746396789440:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.733812:0:77220:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bb96:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733813:0:77220:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bb96:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733814:0:77220:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bb96:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733815:0:77220:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bb96:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733816:0:77220:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bb96:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.733822:0:77220:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1e3d13f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+141:41278:x1731746396789312:12345-10.240.43.64@tcp:10:dd.0 Request processed in 29us (763us total) trans 12885080744 rc 0/0 00000100:00100000:1.0:1651529418.733824:0:77220:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18725 00002000:00010000:1.0:1651529418.733825:0:77220:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179094/0 (0->18446744073709551615) 00002000:00010000:0.0:1651529418.733825:0:77217:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bb97:0x0] updating lvb size from disk: 0 -> 0 00002000:00100000:1.0:1651529418.733826:0:77220:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a1e3d13f with x1731746396789312 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.733827:0:77217:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bb97:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.733827:0:77217:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bb97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733828:0:77220:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000a1e3d13f. 00002000:00010000:0.0:1651529418.733828:0:77217:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bb97:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.733829:0:77217:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bb97:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.733832:0:77220:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18727 00000100:00100000:1.0:1651529418.733833:0:77220:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004cc6e7b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+140:41278:x1731746396789568:12345-10.240.43.64@tcp:10:dd.0 00000100:00100000:0.0:1651529418.733835:0:77217:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005f4fab27 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+140:41278:x1731746396789440:12345-10.240.43.64@tcp:10:dd.0 Request processed in 28us (771us total) trans 12885080745 rc 0/0 00000100:00100000:0.0:1651529418.733837:0:77217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18726 00002000:00010000:0.0:1651529418.733838:0:77217:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179095/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.733839:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005f4fab27 with x1731746396789440 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.733840:0:77217:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000005f4fab27. 00000100:00100000:0.0:1651529418.733844:0:77217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18728 00000100:00100000:0.0:1651529418.733846:0:77217:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f657f31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+140:41278:x1731746396789696:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.733850:0:77220:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bb98:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733851:0:77220:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bb98:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733852:0:77220:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bb98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.733853:0:77220:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bb98:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733853:0:77220:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bb98:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.733859:0:77220:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004cc6e7b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+141:41278:x1731746396789568:12345-10.240.43.64@tcp:10:dd.0 Request processed in 24us (790us total) trans 12885080746 rc 0/0 00000100:00100000:1.0:1651529418.733861:0:77220:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18727 00002000:00010000:1.0:1651529418.733862:0:77220:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179096/0 (0->18446744073709551615) 00002000:00010000:0.0:1651529418.733862:0:77217:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bb99:0x0] updating lvb size from disk: 0 -> 0 00002000:00100000:1.0:1651529418.733863:0:77220:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004cc6e7b3 with x1731746396789568 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.733863:0:77217:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bb99:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.733864:0:77220:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000004cc6e7b3. 00002000:00010000:0.0:1651529418.733865:0:77217:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bb99:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.733865:0:77217:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bb99:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.733866:0:77217:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bb99:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651529418.733872:0:77217:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f657f31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+140:41278:x1731746396789696:12345-10.240.43.64@tcp:10:dd.0 Request processed in 25us (797us total) trans 12885080747 rc 0/0 00000100:00100000:0.0:1651529418.733874:0:77217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18728 00002000:00010000:0.0:1651529418.733875:0:77217:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179097/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.733876:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001f657f31 with x1731746396789696 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.733877:0:77217:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000001f657f31. 00000100:00100000:1.0:1651529418.733914:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529418.733961:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529418.734076:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.734183:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396789824 00000100:00100000:1.0:1651529418.734193:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.734195:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179098/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734201:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000020908cf6 with x1731746396789824 ext(0->18446744073709551615) 00000100:00100000:1.0:1651529418.734202:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.734204:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000020908cf6. 00000100:00100000:1.0:1651529418.734211:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529418.734219:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529418.734239:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.734247:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396789952 00000100:00100000:1.0:1651529418.734248:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.734251:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179099/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734252:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000088a55a6e with x1731746396789952 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734254:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000088a55a6e. 00000100:00100000:0.0:1651529418.734261:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396790080 00002000:00010000:0.0:1651529418.734264:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179100/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734265:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b7648ec7 with x1731746396790080 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734266:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000b7648ec7. 00000100:00100000:1.0:1651529418.734267:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.734275:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396790208 00002000:00010000:0.0:1651529418.734278:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179101/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734279:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000989606cb with x1731746396790208 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734280:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000989606cb. 00000100:00100000:1.0:1651529418.734281:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.734282:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396790336 00002000:00010000:0.0:1651529418.734285:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179102/0 (0->18446744073709551615) 00000100:00100000:1.0:1651529418.734286:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00100000:0.0:1651529418.734286:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001ccb2f5b with x1731746396790336 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734287:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000001ccb2f5b. 00000100:00100000:0.0:1651529418.734289:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396790464 00000100:00100000:1.0:1651529418.734291:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.734291:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179103/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734292:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006338739c with x1731746396790464 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734293:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000006338739c. 00000100:00100000:0.0:1651529418.734295:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396790592 00000100:00100000:1.0:1651529418.734296:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.734297:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179104/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734297:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c4f7478a with x1731746396790592 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734299:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000c4f7478a. 00000100:00100000:0.0:1651529418.734301:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396790720 00002000:00010000:0.0:1651529418.734303:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179105/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734303:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ee1dee8f with x1731746396790720 ext(0->18446744073709551615) 00000100:00100000:1.0:1651529418.734304:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.734304:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000ee1dee8f. 00000100:00100000:0.0:1651529418.734306:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396790848 00002000:00010000:0.0:1651529418.734308:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179106/0 (0->18446744073709551615) 00000100:00100000:1.0:1651529418.734309:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00100000:0.0:1651529418.734309:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000105b4519 with x1731746396790848 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734310:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000105b4519. 00000100:00100000:0.0:1651529418.734312:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396790976 00000100:00100000:1.0:1651529418.734314:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.734314:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179107/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734314:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000cf182cfb with x1731746396790976 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734316:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000cf182cfb. 00000100:00100000:0.0:1651529418.734317:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396791104 00000100:00100000:1.0:1651529418.734319:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.734319:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179108/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734320:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001a104c53 with x1731746396791104 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734321:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000001a104c53. 00000100:00100000:0.0:1651529418.734323:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396791232 00000100:00100000:1.0:1651529418.734324:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.734325:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179109/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734326:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000bed7a23d with x1731746396791232 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734327:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000bed7a23d. 00000100:00100000:0.0:1651529418.734329:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396791360 00002000:00010000:0.0:1651529418.734331:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179110/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734331:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005498b421 with x1731746396791360 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734332:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000005498b421. 00000100:00100000:0.0:1651529418.734334:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396791488 00000100:00100000:1.0:1651529418.734336:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.734336:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179111/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734337:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000007bb30f0a with x1731746396791488 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734338:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000007bb30f0a. 00000100:00100000:0.0:1651529418.734340:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396791616 00000100:00100000:1.0:1651529418.734341:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.734342:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179112/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734342:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ebc7c705 with x1731746396791616 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734343:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000ebc7c705. 00000100:00100000:0.0:1651529418.734345:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396791744 00000100:00100000:1.0:1651529418.734346:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.734347:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179113/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734348:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e72851ea with x1731746396791744 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734349:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000e72851ea. 00000100:00100000:1.0:1651529418.734351:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.734351:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396791872 00002000:00010000:0.0:1651529418.734353:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179114/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734353:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000fb1ea01a with x1731746396791872 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734354:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000fb1ea01a. 00000100:00100000:1.0:1651529418.734355:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.734356:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396792000 00002000:00010000:0.0:1651529418.734358:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179115/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734359:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a7f9c6bc with x1731746396792000 ext(0->18446744073709551615) 00000100:00100000:1.0:1651529418.734360:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.734360:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000a7f9c6bc. 00000100:00100000:0.0:1651529418.734362:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396792128 00000100:00100000:1.0:1651529418.734365:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.734365:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179116/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734365:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000f097985 with x1731746396792128 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734367:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000000f097985. 00000100:00100000:1.0:1651529418.734369:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.734369:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396792256 00002000:00010000:0.0:1651529418.734371:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179117/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734372:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006c432db3 with x1731746396792256 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734373:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000006c432db3. 00000100:00100000:1.0:1651529418.734374:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.734375:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396792384 00002000:00010000:0.0:1651529418.734377:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179118/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734378:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e8a40a98 with x1731746396792384 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734379:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000e8a40a98. 00000100:00100000:0.0:1651529418.734381:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396792512 00002000:00010000:0.0:1651529418.734383:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179119/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734384:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003377f6f7 with x1731746396792512 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734385:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000003377f6f7. 00000100:00100000:1.0:1651529418.734387:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.734387:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396792640 00002000:00010000:0.0:1651529418.734388:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179120/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734389:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f841f810 with x1731746396792640 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734390:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f841f810. 00000100:00100000:0.0:1651529418.734392:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396792768 00000100:00100000:1.0:1651529418.734393:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.734394:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179121/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734395:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006164fe19 with x1731746396792768 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734396:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000006164fe19. 00000100:00100000:0.0:1651529418.734397:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396792896 00000100:00100000:1.0:1651529418.734398:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529418.734402:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.734402:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179122/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734403:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000088bc2eae with x1731746396792896 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734404:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000088bc2eae. 00000100:00100000:0.0:1651529418.734406:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396793024 00002000:00010000:0.0:1651529418.734408:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179123/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734408:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000008c20caf2 with x1731746396793024 ext(0->18446744073709551615) 00000100:00100000:1.0:1651529418.734409:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.734410:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000008c20caf2. 00000100:00100000:0.0:1651529418.734412:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396793152 00000100:00100000:1.0:1651529418.734414:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.734414:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179124/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734414:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000051b6f3e7 with x1731746396793152 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734416:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000051b6f3e7. 00000100:00100000:0.0:1651529418.734418:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396793280 00000100:00100000:1.0:1651529418.734419:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.734419:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179125/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734420:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004bd4ef34 with x1731746396793280 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734421:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000004bd4ef34. 00000100:00100000:1.0:1651529418.734423:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.734423:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396793408 00002000:00010000:0.0:1651529418.734425:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179126/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734426:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c6679da1 with x1731746396793408 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734427:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000c6679da1. 00000100:00100000:1.0:1651529418.734428:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.734429:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396793536 00002000:00010000:0.0:1651529418.734431:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179127/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734431:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000eef5accb with x1731746396793536 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734433:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000eef5accb. 00000100:00100000:0.0:1651529418.734434:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396793664 00002000:00010000:0.0:1651529418.734436:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179128/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734437:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005f7b42e2 with x1731746396793664 ext(0->18446744073709551615) 00000100:00100000:1.0:1651529418.734438:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.734438:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000005f7b42e2. 00000100:00100000:0.0:1651529418.734440:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396793792 00000100:00100000:1.0:1651529418.734443:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.734444:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179129/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734445:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001a6f524a with x1731746396793792 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734446:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000001a6f524a. 00000100:00100000:1.0:1651529418.734448:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.734448:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396793920 00002000:00010000:0.0:1651529418.734450:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179130/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734451:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000b878e15 with x1731746396793920 ext(0->18446744073709551615) 00000100:00100000:1.0:1651529418.734452:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.734452:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000000b878e15. 00000100:00100000:0.0:1651529418.734454:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396794048 00002000:00010000:0.0:1651529418.734456:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179131/0 (0->18446744073709551615) 00000100:00100000:1.0:1651529418.734457:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00100000:0.0:1651529418.734457:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000db0d30fc with x1731746396794048 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734458:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000db0d30fc. 00000100:00100000:0.0:1651529418.734460:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396794176 00002000:00010000:0.0:1651529418.734462:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179132/0 (0->18446744073709551615) 00000100:00100000:1.0:1651529418.734463:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00100000:0.0:1651529418.734463:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000047d64b8f with x1731746396794176 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734464:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000047d64b8f. 00000100:00100000:0.0:1651529418.734466:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396794304 00000100:00100000:1.0:1651529418.734468:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.734468:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179133/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734468:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d8d588f6 with x1731746396794304 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734470:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000d8d588f6. 00000100:00100000:0.0:1651529418.734471:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396794432 00000100:00100000:1.0:1651529418.734472:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.734473:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179134/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734474:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004596ef8d with x1731746396794432 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734475:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000004596ef8d. 00000100:00100000:1.0:1651529418.734477:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.734477:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396794560 00002000:00010000:0.0:1651529418.734478:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179135/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734479:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b83bc3b4 with x1731746396794560 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734481:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000b83bc3b4. 00000100:00100000:0.0:1651529418.734482:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396794688 00002000:00010000:0.0:1651529418.734484:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179136/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734485:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005f7c8411 with x1731746396794688 ext(0->18446744073709551615) 00000100:00100000:1.0:1651529418.734486:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.734486:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000005f7c8411. 00000100:00100000:0.0:1651529418.734488:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396794816 00002000:00010000:0.0:1651529418.734490:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179137/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734491:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000057441a08 with x1731746396794816 ext(0->18446744073709551615) 00000100:00100000:1.0:1651529418.734492:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.734492:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000057441a08. 00000100:00100000:0.0:1651529418.734494:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396794944 00002000:00010000:0.0:1651529418.734496:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179138/0 (0->18446744073709551615) 00000100:00100000:1.0:1651529418.734497:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00100000:0.0:1651529418.734497:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000084e16e13 with x1731746396794944 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734498:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000084e16e13. 00000100:00100000:0.0:1651529418.734500:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396795072 00000100:00100000:1.0:1651529418.734501:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.734502:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179139/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734502:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000654cd405 with x1731746396795072 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734503:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000654cd405. 00000100:00100000:0.0:1651529418.734505:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396795200 00000100:00100000:1.0:1651529418.734506:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00002000:00010000:0.0:1651529418.734507:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179140/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734508:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000008e05f0f0 with x1731746396795200 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734509:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000008e05f0f0. 00000100:00100000:1.0:1651529418.734511:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529418.734511:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396795328 00002000:00010000:0.0:1651529418.734513:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179141/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734513:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000073325c5f with x1731746396795328 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734515:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000073325c5f. 00000100:00100000:0.0:1651529418.734517:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396795456 00000100:00100000:1.0:1651529418.734519:0:77221:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396795584 00002000:00010000:0.0:1651529418.734519:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179143/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734519:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000264d42f3 with x1731746396795456 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734521:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000264d42f3. 00000100:00100000:0.0:1651529418.734523:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396795712 00002000:00010000:1.0:1651529418.734525:0:77221:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179145/0 (0->18446744073709551615) 00002000:00010000:0.0:1651529418.734525:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179147/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.734526:0:77221:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006d70e089 with x1731746396795584 ext(0->18446744073709551615) 00002000:00100000:0.0:1651529418.734526:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001d7705e4 with x1731746396795712 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734527:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000001d7705e4. 00002000:00010000:1.0:1651529418.734528:0:77221:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000006d70e089. 00000100:00100000:0.0:1651529418.734529:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396795840 00000100:00100000:1.0:1651529418.734531:0:77221:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396795968 00002000:00010000:0.0:1651529418.734531:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179149/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734532:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000006fb6696 with x1731746396795840 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734533:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000006fb6696. 00002000:00010000:1.0:1651529418.734534:0:77221:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179151/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.734534:0:77221:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006ad38701 with x1731746396795968 ext(0->18446744073709551615) 00000100:00100000:0.0:1651529418.734535:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396796096 00002000:00010000:1.0:1651529418.734536:0:77221:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000006ad38701. 00000100:00100000:1.0:1651529418.734538:0:77221:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396796224 00002000:00010000:0.0:1651529418.734539:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179153/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734540:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a86f3731 with x1731746396796096 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.734541:0:77221:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179155/0 (0->18446744073709551615) 00002000:00010000:0.0:1651529418.734541:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000a86f3731. 00002000:00100000:1.0:1651529418.734542:0:77221:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000cb5ba2c with x1731746396796224 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.734543:0:77221:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000000cb5ba2c. 00000100:00100000:0.0:1651529418.734543:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396796352 00000100:00100000:1.0:1651529418.734546:0:77221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18729 00000100:00100000:1.0:1651529418.734547:0:77221:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000020908cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+191:41278:x1731746396789824:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529418.734547:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179157/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734547:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000060ec2a09 with x1731746396796352 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734549:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000060ec2a09. 00000100:00100000:0.0:1651529418.734552:0:72402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18730 00000100:00100000:0.0:1651529418.734554:0:72402:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088a55a6e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+191:41278:x1731746396789952:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.734572:0:77221:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bb9a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734573:0:77221:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bb9a:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734574:0:77221:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bb9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734575:0:77221:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bb9a:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734575:0:77221:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bb9a:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1651529418.734581:0:72402:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bb9b:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1651529418.734582:0:77221:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000020908cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+193:41278:x1731746396789824:12345-10.240.43.64@tcp:10:dd.0 Request processed in 34us (669us total) trans 12885080748 rc 0/0 00002000:00010000:0.0:1651529418.734582:0:72402:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bb9b:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.734583:0:72402:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bb9b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.734584:0:72402:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bb9b:0x0] updating lvb ctime from disk: 0 -> 1651529418 00000100:00100000:1.0:1651529418.734585:0:77221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18729 00002000:00010000:1.0:1651529418.734585:0:77221:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179098/0 (0->18446744073709551615) 00002000:00010000:0.0:1651529418.734585:0:72402:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bb9b:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00100000:1.0:1651529418.734586:0:77221:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000020908cf6 with x1731746396789824 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.734588:0:77221:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000020908cf6. 00000100:00100000:0.0:1651529418.734592:0:72402:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088a55a6e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+192:41278:x1731746396789952:12345-10.240.43.64@tcp:10:dd.0 Request processed in 38us (631us total) trans 12885080749 rc 0/0 00000100:00100000:1.0:1651529418.734593:0:77221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18731 00000100:00100000:1.0:1651529418.734595:0:77221:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7648ec7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+192:41278:x1731746396790080:12345-10.240.43.64@tcp:10:dd.0 00000100:00100000:0.0:1651529418.734595:0:72402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18730 00002000:00010000:0.0:1651529418.734596:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179099/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734597:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000088a55a6e with x1731746396789952 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734599:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000088a55a6e. 00000100:00100000:0.0:1651529418.734604:0:72402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18732 00000100:00100000:0.0:1651529418.734605:0:72402:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000989606cb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+191:41278:x1731746396790208:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.734613:0:77221:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bb9c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734614:0:77221:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bb9c:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734615:0:77221:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bb9c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734616:0:77221:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bb9c:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734617:0:77221:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bb9c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.734622:0:77221:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7648ec7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+193:41278:x1731746396790080:12345-10.240.43.64@tcp:10:dd.0 Request processed in 27us (546us total) trans 12885080750 rc 0/0 00002000:00010000:0.0:1651529418.734623:0:72402:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bb9d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.734624:0:72402:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bb9d:0x0] updating lvb mtime from disk: 0 -> 1651529418 00000100:00100000:1.0:1651529418.734625:0:77221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18731 00002000:00010000:0.0:1651529418.734625:0:72402:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bb9d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734626:0:77221:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179100/0 (0->18446744073709551615) 00002000:00010000:0.0:1651529418.734626:0:72402:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bb9d:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00100000:1.0:1651529418.734627:0:77221:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b7648ec7 with x1731746396790080 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734627:0:72402:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bb9d:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734628:0:77221:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000b7648ec7. 00000100:00100000:1.0:1651529418.734632:0:77221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18733 00000100:00100000:0.0:1651529418.734632:0:72402:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000989606cb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+192:41278:x1731746396790208:12345-10.240.43.64@tcp:10:dd.0 Request processed in 26us (440us total) trans 12885080751 rc 0/0 00000100:00100000:1.0:1651529418.734634:0:77221:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001ccb2f5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+192:41278:x1731746396790336:12345-10.240.43.64@tcp:10:dd.0 00000100:00100000:0.0:1651529418.734635:0:72402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18732 00002000:00010000:0.0:1651529418.734636:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179101/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734637:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000989606cb with x1731746396790208 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734638:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000989606cb. 00000100:00100000:0.0:1651529418.734642:0:72402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18734 00000100:00100000:0.0:1651529418.734644:0:72402:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006338739c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+191:41278:x1731746396790464:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.734650:0:77221:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bb9e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734651:0:77221:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bb9e:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734652:0:77221:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bb9e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734653:0:77221:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bb9e:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734654:0:77221:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bb9e:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.734659:0:77221:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001ccb2f5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+193:41278:x1731746396790336:12345-10.240.43.64@tcp:10:dd.0 Request processed in 25us (457us total) trans 12885080752 rc 0/0 00002000:00010000:0.0:1651529418.734660:0:72402:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bb9f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.734661:0:72402:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bb9f:0x0] updating lvb mtime from disk: 0 -> 1651529418 00000100:00100000:1.0:1651529418.734662:0:77221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18733 00002000:00010000:0.0:1651529418.734662:0:72402:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bb9f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734663:0:77221:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179102/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.734663:0:77221:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001ccb2f5b with x1731746396790336 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734663:0:72402:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bb9f:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.734663:0:72402:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bb9f:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734665:0:77221:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000001ccb2f5b. 00000100:00100000:0.0:1651529418.734668:0:72402:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006338739c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+192:41278:x1731746396790464:12345-10.240.43.64@tcp:10:dd.0 Request processed in 24us (458us total) trans 12885080753 rc 0/0 00000100:00100000:1.0:1651529418.734669:0:77221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18735 00000100:00100000:1.0:1651529418.734670:0:77221:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4f7478a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+192:41278:x1731746396790592:12345-10.240.43.64@tcp:10:dd.0 00000100:00100000:0.0:1651529418.734671:0:72402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18734 00002000:00010000:0.0:1651529418.734672:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179103/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734673:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006338739c with x1731746396790464 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734674:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000006338739c. 00000100:00100000:0.0:1651529418.734678:0:72402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18736 00000100:00100000:0.0:1651529418.734680:0:72402:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee1dee8f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+191:41278:x1731746396790720:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.734687:0:77221:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bba0:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734688:0:77221:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bba0:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734688:0:77221:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bba0:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734689:0:77221:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bba0:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734690:0:77221:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bba0:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.734695:0:77221:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4f7478a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+193:41278:x1731746396790592:12345-10.240.43.64@tcp:10:dd.0 Request processed in 24us (476us total) trans 12885080754 rc 0/0 00002000:00010000:0.0:1651529418.734696:0:72402:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bba1:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.734697:0:72402:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bba1:0x0] updating lvb mtime from disk: 0 -> 1651529418 00000100:00100000:1.0:1651529418.734698:0:77221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18735 00002000:00010000:0.0:1651529418.734698:0:72402:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bba1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734699:0:77221:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179104/0 (0->18446744073709551615) 00002000:00010000:0.0:1651529418.734699:0:72402:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bba1:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00100000:1.0:1651529418.734700:0:77221:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c4f7478a with x1731746396790592 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734700:0:72402:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bba1:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734701:0:77221:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000c4f7478a. 00000100:00100000:0.0:1651529418.734705:0:72402:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee1dee8f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+192:41278:x1731746396790720:12345-10.240.43.64@tcp:10:dd.0 Request processed in 24us (466us total) trans 12885080755 rc 0/0 00000100:00100000:1.0:1651529418.734707:0:77221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18737 00000100:00100000:1.0:1651529418.734708:0:77221:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000105b4519 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+192:41278:x1731746396790848:12345-10.240.43.64@tcp:10:dd.0 00000100:00100000:0.0:1651529418.734708:0:72402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18736 00002000:00010000:0.0:1651529418.734709:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179105/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734710:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ee1dee8f with x1731746396790720 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.734711:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000ee1dee8f. 00000100:00100000:0.0:1651529418.734716:0:72402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18738 00000100:00100000:0.0:1651529418.734717:0:72402:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cf182cfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+191:41278:x1731746396790976:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.734727:0:77221:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bba2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734728:0:77221:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bba2:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734729:0:77221:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bba2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734730:0:77221:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bba2:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734731:0:77221:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bba2:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1651529418.734735:0:72402:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bba3:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1651529418.734736:0:77221:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000105b4519 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+193:41278:x1731746396790848:12345-10.240.43.64@tcp:10:dd.0 Request processed in 28us (488us total) trans 12885080756 rc 0/0 00002000:00010000:0.0:1651529418.734736:0:72402:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bba3:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.734737:0:72402:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bba3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.734738:0:72402:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bba3:0x0] updating lvb ctime from disk: 0 -> 1651529418 00000100:00100000:1.0:1651529418.734739:0:77221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18737 00002000:00010000:0.0:1651529418.734739:0:72402:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bba3:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734740:0:77221:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179106/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.734741:0:77221:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000105b4519 with x1731746396790848 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.734742:0:77221:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000105b4519. 00000100:00100000:0.0:1651529418.734744:0:72402:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cf182cfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+193:41278:x1731746396790976:12345-10.240.43.64@tcp:10:dd.0 Request processed in 26us (477us total) trans 12885080757 rc 0/0 00000100:00100000:0.0:1651529418.734746:0:72402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18738 00002000:00010000:0.0:1651529418.734747:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179107/0 (0->18446744073709551615) 00000100:00100000:1.0:1651529418.734748:0:77221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18739 00002000:00100000:0.0:1651529418.734748:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000cf182cfb with x1731746396790976 ext(0->18446744073709551615) 00000100:00100000:1.0:1651529418.734749:0:77221:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a104c53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+192:41278:x1731746396791104:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529418.734749:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000cf182cfb. 00000100:00100000:0.0:1651529418.734754:0:72402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18740 00000100:00100000:0.0:1651529418.734756:0:72402:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bed7a23d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+191:41278:x1731746396791232:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.734768:0:77221:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bba4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734769:0:77221:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bba4:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734770:0:77221:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bba4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734781:0:77221:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bba4:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734782:0:77221:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bba4:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1651529418.734786:0:72402:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bba5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.734787:0:72402:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bba5:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.734788:0:72402:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bba5:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:1.0:1651529418.734789:0:77221:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a104c53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+193:41278:x1731746396791104:12345-10.240.43.64@tcp:10:dd.0 Request processed in 39us (508us total) trans 12885080758 rc 0/0 00002000:00010000:0.0:1651529418.734789:0:72402:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bba5:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.734790:0:72402:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bba5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.734792:0:77221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18739 00002000:00010000:1.0:1651529418.734793:0:77221:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179108/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.734794:0:77221:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001a104c53 with x1731746396791104 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.734795:0:77221:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000001a104c53. 00000100:00100000:0.0:1651529418.734796:0:72402:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bed7a23d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+193:41278:x1731746396791232:12345-10.240.43.64@tcp:10:dd.0 Request processed in 39us (509us total) trans 12885080759 rc 0/0 00000100:00100000:0.0:1651529418.734799:0:72402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18740 00000100:00100000:1.0:1651529418.734800:0:77221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18741 00002000:00010000:0.0:1651529418.734800:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179109/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734800:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000bed7a23d with x1731746396791232 ext(0->18446744073709551615) 00000100:00100000:1.0:1651529418.734802:0:77221:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005498b421 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+192:41278:x1731746396791360:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529418.734802:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000bed7a23d. 00000100:00100000:0.0:1651529418.734807:0:72402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18742 00000100:00100000:0.0:1651529418.734808:0:72402:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007bb30f0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+191:41278:x1731746396791488:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.734821:0:77221:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bba6:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734822:0:77221:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bba6:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734823:0:77221:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bba6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734824:0:77221:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bba6:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734824:0:77221:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bba6:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1651529418.734828:0:72402:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bba7:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1651529418.734829:0:77221:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005498b421 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+193:41278:x1731746396791360:12345-10.240.43.64@tcp:10:dd.0 Request processed in 27us (538us total) trans 12885080760 rc 0/0 00002000:00010000:0.0:1651529418.734829:0:72402:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bba7:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.734830:0:72402:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bba7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.734830:0:72402:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bba7:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.734831:0:72402:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bba7:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.734832:0:77221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18741 00002000:00010000:1.0:1651529418.734833:0:77221:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179110/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.734834:0:77221:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005498b421 with x1731746396791360 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.734835:0:77221:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000005498b421. 00000100:00100000:0.0:1651529418.734837:0:72402:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007bb30f0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+193:41278:x1731746396791488:12345-10.240.43.64@tcp:10:dd.0 Request processed in 28us (541us total) trans 12885080761 rc 0/0 00000100:00100000:0.0:1651529418.734839:0:72402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18742 00002000:00010000:0.0:1651529418.734840:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179111/0 (0->18446744073709551615) 00000100:00100000:1.0:1651529418.734841:0:77221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18743 00002000:00100000:0.0:1651529418.734841:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000007bb30f0a with x1731746396791488 ext(0->18446744073709551615) 00000100:00100000:1.0:1651529418.734842:0:77221:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ebc7c705 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+192:41278:x1731746396791616:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529418.734843:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000007bb30f0a. 00000100:00100000:0.0:1651529418.734847:0:72402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18744 00000100:00100000:0.0:1651529418.734849:0:72402:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e72851ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+191:41278:x1731746396791744:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.734859:0:77221:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bba8:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734860:0:77221:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bba8:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734861:0:77221:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bba8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734862:0:77221:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bba8:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734863:0:77221:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bba8:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1651529418.734866:0:72402:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bba9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.734867:0:72402:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bba9:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.734867:0:72402:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bba9:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:1.0:1651529418.734868:0:77221:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ebc7c705 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+193:41278:x1731746396791616:12345-10.240.43.64@tcp:10:dd.0 Request processed in 25us (564us total) trans 12885080762 rc 0/0 00002000:00010000:0.0:1651529418.734868:0:72402:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bba9:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.734869:0:72402:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bba9:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.734871:0:77221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18743 00002000:00010000:1.0:1651529418.734872:0:77221:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179112/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.734873:0:77221:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ebc7c705 with x1731746396791616 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.734874:0:77221:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000ebc7c705. 00000100:00100000:0.0:1651529418.734874:0:72402:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e72851ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+193:41278:x1731746396791744:12345-10.240.43.64@tcp:10:dd.0 Request processed in 25us (565us total) trans 12885080763 rc 0/0 00000100:00100000:0.0:1651529418.734877:0:72402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18744 00002000:00010000:0.0:1651529418.734878:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179113/0 (0->18446744073709551615) 00000100:00100000:1.0:1651529418.734879:0:77221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18745 00002000:00100000:0.0:1651529418.734879:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e72851ea with x1731746396791744 ext(0->18446744073709551615) 00000100:00100000:1.0:1651529418.734880:0:77221:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fb1ea01a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+192:41278:x1731746396791872:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529418.734880:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000e72851ea. 00000100:00100000:0.0:1651529418.734885:0:72402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18746 00000100:00100000:0.0:1651529418.734886:0:72402:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a7f9c6bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+191:41278:x1731746396792000:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.734897:0:77221:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbaa:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734898:0:77221:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbaa:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734899:0:77221:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbaa:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734900:0:77221:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbaa:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734900:0:77221:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbaa:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1651529418.734902:0:72402:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbab:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.734903:0:72402:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbab:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.734904:0:72402:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbab:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:1.0:1651529418.734905:0:77221:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fb1ea01a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+193:41278:x1731746396791872:12345-10.240.43.64@tcp:10:dd.0 Request processed in 25us (591us total) trans 12885080764 rc 0/0 00002000:00010000:0.0:1651529418.734905:0:72402:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbab:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.734906:0:72402:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbab:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.734908:0:77221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18745 00002000:00010000:1.0:1651529418.734909:0:77221:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179114/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.734910:0:77221:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000fb1ea01a with x1731746396791872 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.734911:0:77221:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000fb1ea01a. 00000100:00100000:0.0:1651529418.734911:0:72402:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a7f9c6bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+193:41278:x1731746396792000:12345-10.240.43.64@tcp:10:dd.0 Request processed in 24us (591us total) trans 12885080765 rc 0/0 00000100:00100000:0.0:1651529418.734913:0:72402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18746 00002000:00010000:0.0:1651529418.734914:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179115/0 (0->18446744073709551615) 00000100:00100000:1.0:1651529418.734915:0:77221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18747 00002000:00100000:0.0:1651529418.734915:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a7f9c6bc with x1731746396792000 ext(0->18446744073709551615) 00000100:00100000:1.0:1651529418.734917:0:77221:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000f097985 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+192:41278:x1731746396792128:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529418.734917:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000a7f9c6bc. 00000100:00100000:0.0:1651529418.734921:0:72402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18748 00000100:00100000:0.0:1651529418.734923:0:72402:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c432db3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+191:41278:x1731746396792256:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.734935:0:77221:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbac:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734936:0:77221:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbac:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734937:0:77221:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbac:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734938:0:77221:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbac:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734939:0:77221:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbac:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1651529418.734941:0:72402:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbad:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.734942:0:72402:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbad:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.734943:0:72402:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbad:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:1.0:1651529418.734944:0:77221:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000f097985 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+193:41278:x1731746396792128:12345-10.240.43.64@tcp:10:dd.0 Request processed in 27us (620us total) trans 12885080766 rc 0/0 00002000:00010000:0.0:1651529418.734944:0:72402:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbad:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.734945:0:72402:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbad:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.734947:0:77221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18747 00002000:00010000:1.0:1651529418.734948:0:77221:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179116/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.734949:0:77221:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000f097985 with x1731746396792128 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.734950:0:77221:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000000f097985. 00000100:00100000:0.0:1651529418.734950:0:72402:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c432db3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+193:41278:x1731746396792256:12345-10.240.43.64@tcp:10:dd.0 Request processed in 26us (614us total) trans 12885080767 rc 0/0 00000100:00100000:0.0:1651529418.734952:0:72402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18748 00002000:00010000:0.0:1651529418.734953:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179117/0 (0->18446744073709551615) 00000100:00100000:1.0:1651529418.734954:0:77221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18749 00002000:00100000:0.0:1651529418.734954:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006c432db3 with x1731746396792256 ext(0->18446744073709551615) 00000100:00100000:1.0:1651529418.734956:0:77221:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e8a40a98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+192:41278:x1731746396792384:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529418.734956:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000006c432db3. 00000100:00100000:0.0:1651529418.734960:0:72402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18750 00000100:00100000:0.0:1651529418.734961:0:72402:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003377f6f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+191:41278:x1731746396792512:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.734972:0:77221:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbae:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734973:0:77221:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbae:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734974:0:77221:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbae:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.734975:0:77221:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbae:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.734976:0:77221:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbae:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1651529418.734978:0:72402:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbaf:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.734979:0:72402:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbaf:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.734980:0:72402:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbaf:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:1.0:1651529418.734981:0:77221:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e8a40a98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+193:41278:x1731746396792384:12345-10.240.43.64@tcp:10:dd.0 Request processed in 24us (639us total) trans 12885080768 rc 0/0 00002000:00010000:0.0:1651529418.734981:0:72402:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbaf:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.734982:0:72402:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbaf:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.734983:0:77221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18749 00002000:00010000:1.0:1651529418.734984:0:77221:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179118/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.734985:0:77221:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e8a40a98 with x1731746396792384 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.734986:0:77221:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000e8a40a98. 00000100:00100000:0.0:1651529418.734987:0:72402:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003377f6f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+193:41278:x1731746396792512:12345-10.240.43.64@tcp:10:dd.0 Request processed in 25us (641us total) trans 12885080769 rc 0/0 00000100:00100000:0.0:1651529418.734989:0:72402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18750 00000100:00100000:1.0:1651529418.734991:0:77221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18751 00002000:00010000:0.0:1651529418.734991:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179119/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.734992:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003377f6f7 with x1731746396792512 ext(0->18446744073709551615) 00000100:00100000:1.0:1651529418.734993:0:77221:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f841f810 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+192:41278:x1731746396792640:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529418.734993:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000003377f6f7. 00000100:00100000:0.0:1651529418.734997:0:72402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18752 00000100:00100000:0.0:1651529418.734999:0:72402:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006164fe19 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+191:41278:x1731746396792768:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.735009:0:77221:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbb0:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.735011:0:77221:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbb0:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.735012:0:77221:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbb0:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.735012:0:77221:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbb0:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.735013:0:77221:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbb0:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1651529418.735015:0:72402:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbb1:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.735016:0:72402:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbb1:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.735017:0:72402:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbb1:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:1.0:1651529418.735018:0:77221:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f841f810 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+193:41278:x1731746396792640:12345-10.240.43.64@tcp:10:dd.0 Request processed in 25us (667us total) trans 12885080770 rc 0/0 00002000:00010000:0.0:1651529418.735018:0:72402:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbb1:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.735019:0:72402:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbb1:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.735021:0:77221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18751 00002000:00010000:1.0:1651529418.735022:0:77221:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179120/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.735023:0:77221:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f841f810 with x1731746396792640 ext(0->18446744073709551615) 00000100:00100000:0.0:1651529418.735023:0:72402:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006164fe19 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+193:41278:x1731746396792768:12345-10.240.43.64@tcp:10:dd.0 Request processed in 24us (668us total) trans 12885080771 rc 0/0 00002000:00010000:1.0:1651529418.735024:0:77221:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f841f810. 00000100:00100000:0.0:1651529418.735026:0:72402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18752 00002000:00010000:0.0:1651529418.735027:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179121/0 (0->18446744073709551615) 00000100:00100000:1.0:1651529418.735028:0:77221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18753 00002000:00100000:0.0:1651529418.735028:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006164fe19 with x1731746396792768 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.735029:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000006164fe19. 00000100:00100000:1.0:1651529418.735030:0:77221:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088bc2eae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+192:41278:x1731746396792896:12345-10.240.43.64@tcp:10:dd.0 00000100:00100000:0.0:1651529418.735033:0:72402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18754 00000100:00100000:0.0:1651529418.735035:0:72402:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008c20caf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+191:41278:x1731746396793024:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.735046:0:77221:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbb2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.735047:0:77221:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbb2:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.735048:0:77221:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbb2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.735048:0:77221:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbb2:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.735049:0:77221:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbb2:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1651529418.735051:0:72402:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbb3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.735053:0:72402:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbb3:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.735053:0:72402:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbb3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.735054:0:72402:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbb3:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.735055:0:72402:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbb3:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.735057:0:77221:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088bc2eae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+193:41278:x1731746396792896:12345-10.240.43.64@tcp:10:dd.0 Request processed in 27us (696us total) trans 12885080772 rc 0/0 00000100:00100000:1.0:1651529418.735060:0:77221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18753 00000100:00100000:0.0:1651529418.735060:0:72402:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008c20caf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+193:41278:x1731746396793024:12345-10.240.43.64@tcp:10:dd.0 Request processed in 24us (695us total) trans 12885080773 rc 0/0 00002000:00010000:1.0:1651529418.735061:0:77221:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179122/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.735061:0:77221:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000088bc2eae with x1731746396792896 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.735063:0:77221:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000088bc2eae. 00000100:00100000:0.0:1651529418.735064:0:72402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18754 00002000:00010000:0.0:1651529418.735065:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179123/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.735066:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000008c20caf2 with x1731746396793024 ext(0->18446744073709551615) 00000100:00100000:1.0:1651529418.735067:0:77221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18755 00002000:00010000:0.0:1651529418.735067:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000008c20caf2. 00000100:00100000:1.0:1651529418.735069:0:77221:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051b6f3e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+192:41278:x1731746396793152:12345-10.240.43.64@tcp:10:dd.0 00000100:00100000:0.0:1651529418.735072:0:72402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18756 00000100:00100000:0.0:1651529418.735073:0:72402:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004bd4ef34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+191:41278:x1731746396793280:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.735089:0:77221:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbb4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.735090:0:77221:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbb4:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.735091:0:77221:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbb4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.735091:0:72402:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbb5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.735092:0:77221:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbb4:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.735092:0:72402:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbb5:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.735093:0:77221:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbb4:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1651529418.735093:0:72402:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbb5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.735094:0:72402:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbb5:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.735095:0:72402:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbb5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.735098:0:77221:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051b6f3e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+193:41278:x1731746396793152:12345-10.240.43.64@tcp:10:dd.0 Request processed in 29us (728us total) trans 12885080774 rc 0/0 00000100:00100000:0.0:1651529418.735100:0:72402:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004bd4ef34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+193:41278:x1731746396793280:12345-10.240.43.64@tcp:10:dd.0 Request processed in 26us (725us total) trans 12885080775 rc 0/0 00000100:00100000:1.0:1651529418.735101:0:77221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18755 00002000:00010000:1.0:1651529418.735102:0:77221:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179124/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.735102:0:77221:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000051b6f3e7 with x1731746396793152 ext(0->18446744073709551615) 00000100:00100000:0.0:1651529418.735102:0:72402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18756 00002000:00010000:0.0:1651529418.735103:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179125/0 (0->18446744073709551615) 00002000:00010000:1.0:1651529418.735104:0:77221:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000051b6f3e7. 00002000:00100000:0.0:1651529418.735104:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004bd4ef34 with x1731746396793280 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.735105:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000004bd4ef34. 00000100:00100000:1.0:1651529418.735108:0:77221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18757 00000100:00100000:1.0:1651529418.735110:0:77221:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c6679da1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+191:41278:x1731746396793408:12345-10.240.43.64@tcp:10:dd.0 00000100:00100000:0.0:1651529418.735110:0:72402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18758 00000100:00100000:0.0:1651529418.735112:0:72402:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eef5accb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+191:41278:x1731746396793536:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.735129:0:77221:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbb6:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.735130:0:77221:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbb6:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.735131:0:77221:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbb6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.735131:0:72402:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbb7:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.735132:0:77221:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbb6:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.735132:0:72402:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbb7:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.735133:0:77221:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbb6:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1651529418.735133:0:72402:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbb7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.735133:0:72402:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbb7:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.735134:0:72402:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbb7:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.735138:0:77221:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c6679da1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+193:41278:x1731746396793408:12345-10.240.43.64@tcp:10:dd.0 Request processed in 28us (751us total) trans 12885080776 rc 0/0 00000100:00100000:0.0:1651529418.735140:0:72402:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eef5accb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+193:41278:x1731746396793536:12345-10.240.43.64@tcp:10:dd.0 Request processed in 27us (747us total) trans 12885080777 rc 0/0 00000100:00100000:1.0:1651529418.735141:0:77221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18757 00002000:00010000:1.0:1651529418.735142:0:77221:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179126/0 (0->18446744073709551615) 00000100:00100000:0.0:1651529418.735142:0:72402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18758 00002000:00100000:1.0:1651529418.735143:0:77221:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c6679da1 with x1731746396793408 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.735143:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179127/0 (0->18446744073709551615) 00002000:00010000:1.0:1651529418.735144:0:77221:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000c6679da1. 00002000:00100000:0.0:1651529418.735144:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000eef5accb with x1731746396793536 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.735145:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000eef5accb. 00000100:00100000:1.0:1651529418.735148:0:77221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18759 00000100:00100000:1.0:1651529418.735150:0:77221:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005f7b42e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+191:41278:x1731746396793664:12345-10.240.43.64@tcp:10:dd.0 00000100:00100000:0.0:1651529418.735150:0:72402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18760 00000100:00100000:0.0:1651529418.735152:0:72402:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a6f524a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+191:41278:x1731746396793792:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.735167:0:77221:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbb8:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.735168:0:77221:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbb8:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.735169:0:77221:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbb8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.735169:0:72402:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbb9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.735170:0:77221:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbb8:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.735170:0:72402:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbb9:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.735171:0:77221:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbb8:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1651529418.735171:0:72402:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbb9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.735172:0:72402:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbb9:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.735173:0:72402:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbb9:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.735176:0:77221:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005f7b42e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+193:41278:x1731746396793664:12345-10.240.43.64@tcp:10:dd.0 Request processed in 25us (778us total) trans 12885080778 rc 0/0 00000100:00100000:0.0:1651529418.735178:0:72402:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a6f524a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+193:41278:x1731746396793792:12345-10.240.43.64@tcp:10:dd.0 Request processed in 25us (775us total) trans 12885080779 rc 0/0 00000100:00100000:1.0:1651529418.735179:0:77221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18759 00002000:00010000:1.0:1651529418.735180:0:77221:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179128/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.735180:0:77221:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005f7b42e2 with x1731746396793664 ext(0->18446744073709551615) 00000100:00100000:0.0:1651529418.735180:0:72402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18760 00002000:00010000:0.0:1651529418.735181:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179129/0 (0->18446744073709551615) 00002000:00010000:1.0:1651529418.735182:0:77221:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000005f7b42e2. 00002000:00100000:0.0:1651529418.735182:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001a6f524a with x1731746396793792 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.735184:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000001a6f524a. 00000100:00100000:1.0:1651529418.735186:0:77221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18761 00000100:00100000:1.0:1651529418.735188:0:77221:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000b878e15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+191:41278:x1731746396793920:12345-10.240.43.64@tcp:10:dd.0 00000100:00100000:0.0:1651529418.735188:0:72402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18762 00000100:00100000:0.0:1651529418.735190:0:72402:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000db0d30fc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+191:41278:x1731746396794048:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.735204:0:77221:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbba:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.735205:0:77221:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbba:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.735206:0:77221:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbba:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.735207:0:77221:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbba:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.735207:0:77221:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbba:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1651529418.735208:0:72402:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbbb:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.735209:0:72402:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbbb:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.735210:0:72402:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbbb:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.735211:0:72402:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbbb:0x0] updating lvb ctime from disk: 0 -> 1651529418 00000100:00100000:1.0:1651529418.735212:0:77221:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000b878e15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+193:41278:x1731746396793920:12345-10.240.43.64@tcp:10:dd.0 Request processed in 24us (803us total) trans 12885080780 rc 0/0 00002000:00010000:0.0:1651529418.735212:0:72402:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbbb:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.735215:0:77221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18761 00002000:00010000:1.0:1651529418.735216:0:77221:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179130/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.735217:0:77221:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000b878e15 with x1731746396793920 ext(0->18446744073709551615) 00000100:00100000:0.0:1651529418.735217:0:72402:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000db0d30fc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+193:41278:x1731746396794048:12345-10.240.43.64@tcp:10:dd.0 Request processed in 27us (803us total) trans 12885080781 rc 0/0 00002000:00010000:1.0:1651529418.735218:0:77221:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000000b878e15. 00000100:00100000:0.0:1651529418.735220:0:72402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18762 00002000:00010000:0.0:1651529418.735221:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179131/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.735222:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000db0d30fc with x1731746396794048 ext(0->18446744073709551615) 00000100:00100000:1.0:1651529418.735236:0:77221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18763 00002000:00010000:0.0:1651529418.735236:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000db0d30fc. 00000100:00100000:1.0:1651529418.735238:0:77221:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047d64b8f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+192:41278:x1731746396794176:12345-10.240.43.64@tcp:10:dd.0 00000100:00100000:0.0:1651529418.735241:0:72402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18764 00000100:00100000:0.0:1651529418.735243:0:72402:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d8d588f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+191:41278:x1731746396794304:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.735258:0:77221:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbbc:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.735259:0:77221:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbbc:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.735260:0:77221:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbbc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.735261:0:77221:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbbc:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.735262:0:77221:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbbc:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1651529418.735265:0:72402:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbbd:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.735266:0:72402:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbbd:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.735267:0:72402:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbbd:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:1.0:1651529418.735268:0:77221:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047d64b8f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+193:41278:x1731746396794176:12345-10.240.43.64@tcp:10:dd.0 Request processed in 30us (849us total) trans 12885080782 rc 0/0 00002000:00010000:0.0:1651529418.735268:0:72402:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbbd:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.735269:0:72402:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbbd:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.735270:0:77221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18763 00002000:00010000:1.0:1651529418.735271:0:77221:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179132/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.735272:0:77221:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000047d64b8f with x1731746396794176 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.735274:0:77221:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000047d64b8f. 00000100:00100000:0.0:1651529418.735275:0:72402:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d8d588f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+193:41278:x1731746396794304:12345-10.240.43.64@tcp:10:dd.0 Request processed in 31us (851us total) trans 12885080783 rc 0/0 00000100:00100000:0.0:1651529418.735277:0:72402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18764 00000100:00100000:1.0:1651529418.735279:0:77221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18765 00002000:00010000:0.0:1651529418.735279:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179133/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.735279:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d8d588f6 with x1731746396794304 ext(0->18446744073709551615) 00000100:00100000:1.0:1651529418.735281:0:77221:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004596ef8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+192:41278:x1731746396794432:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529418.735281:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000d8d588f6. 00000100:00100000:0.0:1651529418.735285:0:72402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18766 00000100:00100000:0.0:1651529418.735287:0:72402:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b83bc3b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+191:41278:x1731746396794560:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.735299:0:77221:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbbe:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.735300:0:77221:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbbe:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.735301:0:77221:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbbe:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.735301:0:77221:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbbe:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.735302:0:77221:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbbe:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1651529418.735305:0:72402:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbbf:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.735306:0:72402:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbbf:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.735306:0:72402:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbbf:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:1.0:1651529418.735307:0:77221:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004596ef8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+193:41278:x1731746396794432:12345-10.240.43.64@tcp:10:dd.0 Request processed in 26us (879us total) trans 12885080784 rc 0/0 00002000:00010000:0.0:1651529418.735307:0:72402:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbbf:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.735308:0:72402:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbbf:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.735310:0:77221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18765 00002000:00010000:1.0:1651529418.735311:0:77221:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179134/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.735312:0:77221:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004596ef8d with x1731746396794432 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.735313:0:77221:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000004596ef8d. 00000100:00100000:0.0:1651529418.735314:0:72402:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b83bc3b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+193:41278:x1731746396794560:12345-10.240.43.64@tcp:10:dd.0 Request processed in 26us (876us total) trans 12885080785 rc 0/0 00000100:00100000:0.0:1651529418.735316:0:72402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18766 00000100:00100000:1.0:1651529418.735318:0:77221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18767 00002000:00010000:0.0:1651529418.735318:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179135/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.735318:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b83bc3b4 with x1731746396794560 ext(0->18446744073709551615) 00000100:00100000:1.0:1651529418.735320:0:77221:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005f7c8411 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+192:41278:x1731746396794688:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529418.735320:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000b83bc3b4. 00000100:00100000:0.0:1651529418.735324:0:72402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18768 00000100:00100000:0.0:1651529418.735325:0:72402:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057441a08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+191:41278:x1731746396794816:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.735336:0:77221:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbc0:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.735337:0:77221:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbc0:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.735338:0:77221:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbc0:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.735339:0:77221:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbc0:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.735340:0:77221:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbc0:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1651529418.735342:0:72402:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbc1:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.735343:0:72402:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbc1:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.735344:0:72402:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbc1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.735344:0:72402:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbc1:0x0] updating lvb ctime from disk: 0 -> 1651529418 00000100:00100000:1.0:1651529418.735345:0:77221:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005f7c8411 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+193:41278:x1731746396794688:12345-10.240.43.64@tcp:10:dd.0 Request processed in 24us (901us total) trans 12885080786 rc 0/0 00002000:00010000:0.0:1651529418.735345:0:72402:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbc1:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.735347:0:77221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18767 00002000:00010000:1.0:1651529418.735348:0:77221:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179136/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.735349:0:77221:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005f7c8411 with x1731746396794688 ext(0->18446744073709551615) 00000100:00100000:0.0:1651529418.735350:0:72402:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057441a08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+193:41278:x1731746396794816:12345-10.240.43.64@tcp:10:dd.0 Request processed in 24us (902us total) trans 12885080787 rc 0/0 00002000:00010000:1.0:1651529418.735351:0:77221:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000005f7c8411. 00000100:00100000:0.0:1651529418.735353:0:72402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18768 00002000:00010000:0.0:1651529418.735354:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179137/0 (0->18446744073709551615) 00000100:00100000:1.0:1651529418.735355:0:77221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18769 00002000:00100000:0.0:1651529418.735355:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000057441a08 with x1731746396794816 ext(0->18446744073709551615) 00000100:00100000:1.0:1651529418.735356:0:77221:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000084e16e13 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+192:41278:x1731746396794944:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529418.735356:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000057441a08. 00000100:00100000:0.0:1651529418.735360:0:72402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18770 00000100:00100000:0.0:1651529418.735362:0:72402:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000654cd405 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+191:41278:x1731746396795072:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.735373:0:77221:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbc2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.735374:0:77221:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbc2:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.735375:0:77221:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbc2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.735376:0:77221:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbc2:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.735376:0:77221:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbc2:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1651529418.735378:0:72402:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbc3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.735380:0:72402:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbc3:0x0] updating lvb mtime from disk: 0 -> 1651529418 00000100:00100000:1.0:1651529418.735381:0:77221:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000084e16e13 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+193:41278:x1731746396794944:12345-10.240.43.64@tcp:10:dd.0 Request processed in 24us (929us total) trans 12885080788 rc 0/0 00002000:00010000:0.0:1651529418.735381:0:72402:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbc3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.735381:0:72402:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbc3:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.735382:0:72402:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbc3:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.735384:0:77221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18769 00002000:00010000:1.0:1651529418.735385:0:77221:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179138/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.735386:0:77221:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000084e16e13 with x1731746396794944 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.735387:0:77221:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000084e16e13. 00000100:00100000:0.0:1651529418.735388:0:72402:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000654cd405 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+193:41278:x1731746396795072:12345-10.240.43.64@tcp:10:dd.0 Request processed in 25us (931us total) trans 12885080789 rc 0/0 00000100:00100000:0.0:1651529418.735390:0:72402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18770 00002000:00010000:0.0:1651529418.735391:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179139/0 (0->18446744073709551615) 00000100:00100000:1.0:1651529418.735392:0:77221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18771 00002000:00100000:0.0:1651529418.735392:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000654cd405 with x1731746396795072 ext(0->18446744073709551615) 00000100:00100000:1.0:1651529418.735394:0:77221:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008e05f0f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+192:41278:x1731746396795200:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529418.735394:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000654cd405. 00000100:00100000:0.0:1651529418.735398:0:72402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18772 00000100:00100000:0.0:1651529418.735399:0:72402:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000073325c5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+191:41278:x1731746396795328:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.735410:0:77221:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbc4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.735411:0:77221:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbc4:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.735412:0:77221:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbc4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.735413:0:77221:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbc4:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.735413:0:77221:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbc4:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1651529418.735416:0:72402:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbc5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.735417:0:72402:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbc5:0x0] updating lvb mtime from disk: 0 -> 1651529418 00000100:00100000:1.0:1651529418.735418:0:77221:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008e05f0f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+193:41278:x1731746396795200:12345-10.240.43.64@tcp:10:dd.0 Request processed in 24us (955us total) trans 12885080790 rc 0/0 00002000:00010000:0.0:1651529418.735418:0:72402:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbc5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.735419:0:72402:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbc5:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.735420:0:72402:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbc5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.735421:0:77221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18771 00002000:00010000:1.0:1651529418.735422:0:77221:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179140/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.735422:0:77221:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000008e05f0f0 with x1731746396795200 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.735424:0:77221:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000008e05f0f0. 00000100:00100000:0.0:1651529418.735425:0:72402:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000073325c5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+193:41278:x1731746396795328:12345-10.240.43.64@tcp:10:dd.0 Request processed in 25us (957us total) trans 12885080791 rc 0/0 00000100:00100000:0.0:1651529418.735427:0:72402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18772 00000100:00100000:1.0:1651529418.735429:0:77221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18773 00002000:00010000:0.0:1651529418.735429:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179141/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.735429:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000073325c5f with x1731746396795328 ext(0->18446744073709551615) 00000100:00100000:1.0:1651529418.735431:0:77221:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000264d42f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+192:41278:x1731746396795456:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651529418.735431:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000073325c5f. 00000100:00100000:0.0:1651529418.735435:0:72402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18774 00000100:00100000:0.0:1651529418.735437:0:72402:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d7705e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+191:41278:x1731746396795712:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.735447:0:77221:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbc7:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.735448:0:77221:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbc7:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.735449:0:77221:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbc7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.735450:0:77221:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbc7:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.735450:0:77221:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbc7:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1651529418.735453:0:72402:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbcb:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.735454:0:72402:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbcb:0x0] updating lvb mtime from disk: 0 -> 1651529418 00000100:00100000:1.0:1651529418.735455:0:77221:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000264d42f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+193:41278:x1731746396795456:12345-10.240.43.64@tcp:10:dd.0 Request processed in 24us (982us total) trans 12885080792 rc 0/0 00002000:00010000:0.0:1651529418.735455:0:72402:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbcb:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529418.735456:0:72402:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbcb:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.735457:0:72402:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbcb:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.735458:0:77221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18773 00002000:00010000:1.0:1651529418.735459:0:77221:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179143/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.735460:0:77221:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000264d42f3 with x1731746396795456 ext(0->18446744073709551615) 00002000:00010000:1.0:1651529418.735461:0:77221:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000264d42f3. 00000100:00100000:1.0:1651529418.735465:0:77221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18775 00000100:00100000:0.0:1651529418.735465:0:72402:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d7705e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+192:41278:x1731746396795712:12345-10.240.43.64@tcp:10:dd.0 Request processed in 27us (978us total) trans 12885080793 rc 0/0 00000100:00100000:1.0:1651529418.735467:0:77221:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d70e089 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+192:41278:x1731746396795584:12345-10.240.43.64@tcp:10:dd.0 00000100:00100000:0.0:1651529418.735468:0:72402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18774 00002000:00010000:0.0:1651529418.735469:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179147/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.735470:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001d7705e4 with x1731746396795712 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.735471:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000001d7705e4. 00000100:00100000:0.0:1651529418.735475:0:72402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18776 00000100:00100000:0.0:1651529418.735477:0:72402:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006fb6696 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+191:41278:x1731746396795840:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.735483:0:77221:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbc9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.735484:0:77221:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbc9:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.735485:0:77221:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbc9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.735486:0:77221:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbc9:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.735486:0:77221:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbc9:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.735495:0:77221:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d70e089 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+193:41278:x1731746396795584:12345-10.240.43.64@tcp:10:dd.0 Request processed in 28us (1018us total) trans 12885080794 rc 0/0 00002000:00010000:0.0:1651529418.735495:0:72402:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbcd:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.735496:0:72402:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbcd:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.735497:0:72402:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbcd:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:1.0:1651529418.735498:0:77221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18775 00002000:00010000:0.0:1651529418.735498:0:72402:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbcd:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.735499:0:77221:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179145/0 (0->18446744073709551615) 00002000:00100000:1.0:1651529418.735499:0:77221:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006d70e089 with x1731746396795584 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.735499:0:72402:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbcd:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:1.0:1651529418.735501:0:77221:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000006d70e089. 00000100:00100000:0.0:1651529418.735504:0:72402:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006fb6696 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+192:41278:x1731746396795840:12345-10.240.43.64@tcp:10:dd.0 Request processed in 27us (1012us total) trans 12885080795 rc 0/0 00000100:00100000:1.0:1651529418.735505:0:77221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18777 00000100:00100000:1.0:1651529418.735507:0:77221:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006ad38701 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+192:41278:x1731746396795968:12345-10.240.43.64@tcp:10:dd.0 00000100:00100000:0.0:1651529418.735507:0:72402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18776 00002000:00010000:0.0:1651529418.735508:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179149/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.735509:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000006fb6696 with x1731746396795840 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.735510:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000006fb6696. 00000100:00100000:0.0:1651529418.735514:0:72402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18778 00000100:00100000:0.0:1651529418.735516:0:72402:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a86f3731 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+191:41278:x1731746396796096:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.735523:0:77221:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbcf:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.735525:0:77221:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbcf:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.735525:0:77221:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbcf:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.735526:0:77221:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbcf:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.735527:0:77221:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbcf:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.735532:0:77221:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006ad38701 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+193:41278:x1731746396795968:12345-10.240.43.64@tcp:10:dd.0 Request processed in 25us (1035us total) trans 12885080796 rc 0/0 00002000:00010000:0.0:1651529418.735534:0:72402:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbd1:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651529418.735535:0:72402:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbd1:0x0] updating lvb mtime from disk: 0 -> 1651529418 00000100:00100000:1.0:1651529418.735536:0:77221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18777 00002000:00010000:0.0:1651529418.735536:0:72402:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbd1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.735537:0:77221:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179151/0 (0->18446744073709551615) 00002000:00010000:0.0:1651529418.735537:0:72402:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbd1:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00100000:1.0:1651529418.735538:0:77221:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006ad38701 with x1731746396795968 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.735538:0:72402:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbd1:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:1.0:1651529418.735540:0:77221:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000006ad38701. 00000100:00100000:0.0:1651529418.735543:0:72402:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a86f3731 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+192:41278:x1731746396796096:12345-10.240.43.64@tcp:10:dd.0 Request processed in 26us (1041us total) trans 12885080797 rc 0/0 00000100:00100000:1.0:1651529418.735544:0:77221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18779 00000100:00100000:1.0:1651529418.735545:0:77221:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000cb5ba2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+192:41278:x1731746396796224:12345-10.240.43.64@tcp:10:dd.0 00000100:00100000:0.0:1651529418.735545:0:72402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18778 00002000:00010000:0.0:1651529418.735547:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179153/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.735547:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a86f3731 with x1731746396796096 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.735549:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000a86f3731. 00000100:00100000:0.0:1651529418.735553:0:72402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18780 00000100:00100000:0.0:1651529418.735554:0:72402:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000060ec2a09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+191:41278:x1731746396796352:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:1.0:1651529418.735561:0:77221:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbd3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.735562:0:77221:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbd3:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.735563:0:77221:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbd3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.735564:0:77221:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbd3:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:1.0:1651529418.735565:0:77221:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbd3:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651529418.735570:0:77221:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000cb5ba2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+193:41278:x1731746396796224:12345-10.240.43.64@tcp:10:dd.0 Request processed in 24us (1063us total) trans 12885080798 rc 0/0 00000100:00100000:1.0:1651529418.735572:0:77221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18779 00002000:00010000:0.0:1651529418.735572:0:72402:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bbd5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651529418.735573:0:77221:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179155/0 (0->18446744073709551615) 00002000:00010000:0.0:1651529418.735573:0:72402:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bbd5:0x0] updating lvb mtime from disk: 0 -> 1651529418 00002000:00100000:1.0:1651529418.735574:0:77221:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000cb5ba2c with x1731746396796224 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.735574:0:72402:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2bbd5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529418.735575:0:77221:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000000cb5ba2c. 00002000:00010000:0.0:1651529418.735575:0:72402:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bbd5:0x0] updating lvb ctime from disk: 0 -> 1651529418 00002000:00010000:0.0:1651529418.735576:0:72402:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bbd5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651529418.735581:0:72402:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000060ec2a09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+192:41278:x1731746396796352:12345-10.240.43.64@tcp:10:dd.0 Request processed in 26us (1070us total) trans 12885080799 rc 0/0 00000100:00100000:0.0:1651529418.735584:0:72402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18780 00002000:00010000:0.0:1651529418.735585:0:72402:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 179157/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529418.735586:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000060ec2a09 with x1731746396796352 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529418.735587:0:72402:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000060ec2a09. 00000100:00100000:1.0:1651529419.458932:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.458956:0:77217:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396797568 00002000:00100000:0.0:1651529419.458968:0:77217:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x100010000:0x2bb7d:0x0] (0->524287) req@000000003ac9a803 x1731746396797568/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.458973:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003ac9a803 with x1731746396797568 ext(0->524287) 00002000:00010000:0.0:1651529419.458975:0:77217:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000003ac9a803 00000100:00100000:0.0:1651529419.458983:0:77217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18781 00000100:00100000:0.0:1651529419.458985:0:77217:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003ac9a803 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+192:41279:x1731746396797568:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.459967:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.459979:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.459996:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.460009:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.460018:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.460030:0:77222:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396797632 00002000:00100000:0.0:1651529419.460046:0:77222:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x2bb84:0x0] (0->1048575) req@00000000505b033c x1731746396797632/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.460051:0:77222:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000505b033c with x1731746396797632 ext(0->1048575) 00002000:00010000:0.0:1651529419.460052:0:77222:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000505b033c 00000100:00100000:1.0:1651529419.460070:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.460089:0:72400:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396797696 00000100:00100000:0.0:1651529419.460096:0:77222:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396797824 00002000:00100000:0.0:1651529419.460102:0:77222:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x2bb87:0x0] (0->1048575) req@00000000a81b1204 x1731746396797824/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.460106:0:77222:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a81b1204 with x1731746396797824 ext(0->1048575) 00002000:00010000:0.0:1651529419.460107:0:77222:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000a81b1204 00000100:00100000:0.0:1651529419.460113:0:77222:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396797952 00002000:00100000:0.0:1651529419.460117:0:77222:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x2bb89:0x0] (0->1048575) req@00000000027b3faa x1731746396797952/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.460120:0:72400:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x100010000:0x2bb85:0x0] (0->1048575) req@0000000033e66d40 x1731746396797696/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.460120:0:77222:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000027b3faa with x1731746396797952 ext(0->1048575) 00002000:00010000:0.0:1651529419.460121:0:77222:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000027b3faa 00000100:00100000:0.0:1651529419.460126:0:77222:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396797760 00002000:00100000:0.0:1651529419.460129:0:77222:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x2bb86:0x0] (0->1048575) req@00000000e75bad7c x1731746396797760/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.460130:0:72400:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000033e66d40 with x1731746396797696 ext(0->1048575) 00002000:00010000:1.0:1651529419.460132:0:72400:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000033e66d40 00002000:00100000:0.0:1651529419.460133:0:77222:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e75bad7c with x1731746396797760 ext(0->1048575) 00002000:00010000:0.0:1651529419.460134:0:77222:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000e75bad7c 00000100:00100000:0.0:1651529419.460139:0:77222:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396797888 00002000:00100000:0.0:1651529419.460142:0:77222:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x2bb88:0x0] (0->1048575) req@000000007e8d7639 x1731746396797888/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.460145:0:77222:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000007e8d7639 with x1731746396797888 ext(0->1048575) 00000100:00100000:1.0:1651529419.460146:0:72400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18782 00002000:00010000:0.0:1651529419.460146:0:77222:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000007e8d7639 00000100:00100000:1.0:1651529419.460148:0:72400:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000505b033c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+199:41279:x1731746396797632:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.460150:0:77222:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18783 00000100:00100000:0.0:1651529419.460151:0:77222:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a81b1204 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+199:41279:x1731746396797824:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.460356:0:76182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18784 00000100:00100000:1.0:1651529419.460358:0:76182:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000027b3faa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+201:41279:x1731746396797952:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.460365:0:76181:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18785 00000100:00100000:0.0:1651529419.460367:0:76181:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000033e66d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+201:41279:x1731746396797696:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.460552:0:77219:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18786 00000100:00100000:1.0:1651529419.460554:0:77219:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e75bad7c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+203:41279:x1731746396797760:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.460692:0:77223:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18787 00000100:00100000:1.0:1651529419.460694:0:77223:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007e8d7639 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+204:41279:x1731746396797888:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.460720:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.460737:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.460761:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396798016 00002000:00100000:0.0:1651529419.460768:0:72402:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2bb8a:0x0] (0->1048575) req@0000000066de8c9f x1731746396798016/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.460781:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000066de8c9f with x1731746396798016 ext(0->1048575) 00002000:00010000:0.0:1651529419.460782:0:72402:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000066de8c9f 00000100:00100000:0.0:1651529419.460786:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396798080 00002000:00100000:0.0:1651529419.460789:0:72402:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2bb8b:0x0] (0->1048575) req@000000005fb0ec6a x1731746396798080/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.460793:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005fb0ec6a with x1731746396798080 ext(0->1048575) 00002000:00010000:0.0:1651529419.460794:0:72402:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000005fb0ec6a 00000100:00100000:0.0:1651529419.460797:0:72402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18788 00000100:00100000:0.0:1651529419.460798:0:72402:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+208:41279:x1731746396798016:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.460892:0:77218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18789 00000100:00100000:1.0:1651529419.460894:0:77218:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+209:41278:x1731746396798080:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.461324:0:77217:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003ac9a803 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+210:41279:x1731746396797568:12345-10.240.43.64@tcp:4:dd.0 Request processed in 2338us (2393us total) trans 12885080800 rc 0/0 00000100:00100000:0.0:1651529419.461346:0:77217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18781 00002000:00100000:0.0:1651529419.461349:0:77217:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x100010000:0x2bb7d:0x0] (0->524287) req@000000003ac9a803 x1731746396797568/t12885080800(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.461353:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003ac9a803 with x1731746396797568 ext(0->524287) 00002000:00010000:0.0:1651529419.461355:0:77217:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000003ac9a803 00000100:00100000:1.0:1651529419.462254:0:72400:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000505b033c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+210:41279:x1731746396797632:12345-10.240.43.64@tcp:4:dd.0 Request processed in 2104us (2286us total) trans 12885080801 rc 0/0 00000100:00100000:1.0:1651529419.462258:0:72400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18782 00002000:00100000:1.0:1651529419.462274:0:72400:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x100010000:0x2bb84:0x0] (0->1048575) req@00000000505b033c x1731746396797632/t12885080801(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.462279:0:72400:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000505b033c with x1731746396797632 ext(0->1048575) 00002000:00010000:1.0:1651529419.462280:0:72400:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000505b033c 00000100:00100000:0.0:1651529419.462822:0:77222:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a81b1204 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+210:41279:x1731746396797824:12345-10.240.43.64@tcp:4:dd.0 Request processed in 2669us (2824us total) trans 12885080802 rc 0/0 00000100:00100000:0.0:1651529419.462825:0:77222:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18783 00002000:00100000:0.0:1651529419.462829:0:77222:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x2bb87:0x0] (0->1048575) req@00000000a81b1204 x1731746396797824/t12885080802(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.462833:0:77222:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a81b1204 with x1731746396797824 ext(0->1048575) 00002000:00010000:0.0:1651529419.462834:0:77222:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000a81b1204 00000100:00100000:1.0:1651529419.463484:0:76182:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000027b3faa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+210:41279:x1731746396797952:12345-10.240.43.64@tcp:4:dd.0 Request processed in 3125us (3474us total) trans 12885080803 rc 0/0 00000100:00100000:1.0:1651529419.463488:0:76182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18784 00002000:00100000:1.0:1651529419.463491:0:76182:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x2bb89:0x0] (0->1048575) req@00000000027b3faa x1731746396797952/t12885080803(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.463495:0:76182:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000027b3faa with x1731746396797952 ext(0->1048575) 00002000:00010000:1.0:1651529419.463497:0:76182:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000027b3faa 00000100:00100000:0.0:1651529419.464322:0:76181:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000033e66d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+212:41279:x1731746396797696:12345-10.240.43.64@tcp:4:dd.0 Request processed in 3953us (4341us total) trans 12885080804 rc 0/0 00000100:00100000:0.0:1651529419.464325:0:76181:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18785 00002000:00100000:0.0:1651529419.464328:0:76181:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2bb85:0x0] (0->1048575) req@0000000033e66d40 x1731746396797696/t12885080804(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.464332:0:76181:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000033e66d40 with x1731746396797696 ext(0->1048575) 00002000:00010000:0.0:1651529419.464342:0:76181:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000033e66d40 00000100:00100000:1.0:1651529419.464768:0:77219:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e75bad7c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+212:41279:x1731746396797760:12345-10.240.43.64@tcp:4:dd.0 Request processed in 4212us (4749us total) trans 12885080805 rc 0/0 00000100:00100000:1.0:1651529419.464780:0:77219:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18786 00002000:00100000:1.0:1651529419.464784:0:77219:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x100010000:0x2bb86:0x0] (0->1048575) req@00000000e75bad7c x1731746396797760/t12885080805(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.464787:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e75bad7c with x1731746396797760 ext(0->1048575) 00002000:00010000:1.0:1651529419.464789:0:77219:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000e75bad7c 00000100:00100000:1.0:1651529419.465179:0:77223:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007e8d7639 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+212:41279:x1731746396797888:12345-10.240.43.64@tcp:4:dd.0 Request processed in 4484us (5109us total) trans 12885080806 rc 0/0 00000100:00100000:1.0:1651529419.465182:0:77223:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18787 00002000:00100000:1.0:1651529419.465185:0:77223:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x100010000:0x2bb88:0x0] (0->1048575) req@000000007e8d7639 x1731746396797888/t12885080806(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.465194:0:77223:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000007e8d7639 with x1731746396797888 ext(0->1048575) 00002000:00010000:1.0:1651529419.465195:0:77223:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000007e8d7639 00000100:00100000:0.0:1651529419.465549:0:72402:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+212:41279:x1731746396798016:12345-10.240.43.64@tcp:4:dd.0 Request processed in 4749us (4829us total) trans 12885080807 rc 0/0 00000100:00100000:0.0:1651529419.465553:0:72402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18788 00002000:00100000:0.0:1651529419.465556:0:72402:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2bb8a:0x0] (0->1048575) req@0000000066de8c9f x1731746396798016/t12885080807(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.465560:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000066de8c9f with x1731746396798016 ext(0->1048575) 00002000:00010000:0.0:1651529419.465562:0:72402:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000066de8c9f 00000100:00100000:1.0:1651529419.465895:0:77218:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+210:41278:x1731746396798080:12345-10.240.43.64@tcp:4:dd.0 Request processed in 5000us (5157us total) trans 12885080808 rc 0/0 00000100:00100000:1.0:1651529419.465899:0:77218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18789 00002000:00100000:1.0:1651529419.465902:0:77218:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x2bb8b:0x0] (0->1048575) req@000000005fb0ec6a x1731746396798080/t12885080808(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.465908:0:77218:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005fb0ec6a with x1731746396798080 ext(0->1048575) 00002000:00010000:1.0:1651529419.465910:0:77218:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000005fb0ec6a 00000100:00100000:1.0:1651529419.689063:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.689081:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.689093:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.689106:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396798272 00000100:00100000:1.0:1651529419.689110:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.689119:0:77219:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396798400 00002000:00100000:0.0:1651529419.689119:0:72402:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2bb84:0x0] (1048576->2097151) req@0000000084871aab x1731746396798272/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.689123:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000084871aab with x1731746396798272 ext(1048576->2097151) 00002000:00010000:0.0:1651529419.689125:0:72402:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000084871aab 00002000:00100000:1.0:1651529419.689128:0:77219:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x100010000:0x2bb85:0x0] (1048576->2097151) req@00000000f7eab247 x1731746396798400/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00000100:00100000:0.0:1651529419.689131:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396798528 00002000:00100000:1.0:1651529419.689132:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f7eab247 with x1731746396798400 ext(1048576->2097151) 00002000:00010000:1.0:1651529419.689133:0:77219:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f7eab247 00002000:00100000:0.0:1651529419.689134:0:72402:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2bb86:0x0] (1048576->2097151) req@0000000021196e62 x1731746396798528/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00000100:00100000:1.0:1651529419.689138:0:77219:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396798656 00002000:00100000:0.0:1651529419.689138:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000021196e62 with x1731746396798528 ext(1048576->2097151) 00002000:00010000:0.0:1651529419.689139:0:72402:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000021196e62 00002000:00100000:1.0:1651529419.689142:0:77219:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x100010000:0x2bb87:0x0] (1048576->2097151) req@000000005b215430 x1731746396798656/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00000100:00100000:0.0:1651529419.689144:0:72402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18790 00002000:00100000:1.0:1651529419.689145:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005b215430 with x1731746396798656 ext(1048576->2097151) 00002000:00010000:1.0:1651529419.689146:0:77219:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000005b215430 00000100:00100000:0.0:1651529419.689146:0:72402:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000084871aab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+213:41278:x1731746396798272:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.689151:0:77219:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18791 00000100:00100000:1.0:1651529419.689153:0:77219:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7eab247 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+213:41278:x1731746396798400:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.689345:0:77223:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18792 00000100:00100000:1.0:1651529419.689347:0:77223:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000021196e62 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+215:41278:x1731746396798528:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.689359:0:76181:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18793 00000100:00100000:0.0:1651529419.689361:0:76181:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b215430 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+215:41278:x1731746396798656:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.689527:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.689562:0:77222:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396798784 00002000:00100000:0.0:1651529419.689569:0:77222:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x2bb88:0x0] (1048576->2097151) req@000000007581f65a x1731746396798784/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.689573:0:77222:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000007581f65a with x1731746396798784 ext(1048576->2097151) 00002000:00010000:0.0:1651529419.689574:0:77222:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000007581f65a 00000100:00100000:0.0:1651529419.689583:0:77222:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18794 00000100:00100000:0.0:1651529419.689585:0:77222:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007581f65a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+218:41279:x1731746396798784:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.690937:0:77219:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7eab247 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+220:41278:x1731746396798400:12345-10.240.43.64@tcp:4:dd.0 Request processed in 1782us (1855us total) trans 12885080809 rc 0/0 00000100:00100000:1.0:1651529419.690943:0:77219:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18791 00002000:00100000:1.0:1651529419.690946:0:77219:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x100010000:0x2bb85:0x0] (1048576->2097151) req@00000000f7eab247 x1731746396798400/t12885080809(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.690950:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f7eab247 with x1731746396798400 ext(1048576->2097151) 00002000:00010000:1.0:1651529419.690951:0:77219:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f7eab247 00000100:00100000:1.0:1651529419.691816:0:72402:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000084871aab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+222:41278:x1731746396798272:12345-10.240.43.64@tcp:4:dd.0 Request processed in 2669us (2754us total) trans 12885080810 rc 0/0 00000100:00100000:1.0:1651529419.691820:0:72402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18790 00002000:00100000:1.0:1651529419.691823:0:72402:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2bb84:0x0] (1048576->2097151) req@0000000084871aab x1731746396798272/t12885080810(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.691826:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000084871aab with x1731746396798272 ext(1048576->2097151) 00002000:00010000:1.0:1651529419.691828:0:72402:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000084871aab 00000100:00100000:1.0:1651529419.692249:0:77223:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000021196e62 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+220:41278:x1731746396798528:12345-10.240.43.64@tcp:4:dd.0 Request processed in 2901us (3155us total) trans 12885080811 rc 0/0 00000100:00100000:1.0:1651529419.692252:0:77223:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18792 00002000:00100000:1.0:1651529419.692255:0:77223:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x100010000:0x2bb86:0x0] (1048576->2097151) req@0000000021196e62 x1731746396798528/t12885080811(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.692258:0:77223:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000021196e62 with x1731746396798528 ext(1048576->2097151) 00002000:00010000:1.0:1651529419.692259:0:77223:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000021196e62 00000100:00100000:1.0:1651529419.692853:0:76181:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b215430 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+222:41278:x1731746396798656:12345-10.240.43.64@tcp:4:dd.0 Request processed in 3491us (3742us total) trans 12885080812 rc 0/0 00000100:00100000:1.0:1651529419.692856:0:76181:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18793 00002000:00100000:1.0:1651529419.692859:0:76181:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2bb87:0x0] (1048576->2097151) req@000000005b215430 x1731746396798656/t12885080812(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.692863:0:76181:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005b215430 with x1731746396798656 ext(1048576->2097151) 00002000:00010000:1.0:1651529419.692864:0:76181:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000005b215430 00000100:00100000:0.0:1651529419.693199:0:77222:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007581f65a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+220:41279:x1731746396798784:12345-10.240.43.64@tcp:4:dd.0 Request processed in 3613us (3671us total) trans 12885080813 rc 0/0 00000100:00100000:0.0:1651529419.693204:0:77222:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18794 00002000:00100000:0.0:1651529419.693207:0:77222:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x2bb88:0x0] (1048576->2097151) req@000000007581f65a x1731746396798784/t12885080813(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.693211:0:77222:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000007581f65a with x1731746396798784 ext(1048576->2097151) 00002000:00010000:0.0:1651529419.693213:0:77222:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000007581f65a 00000100:00100000:1.0:1651529419.696354:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.696367:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.696378:0:76181:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396799040 00000100:00100000:0.0:1651529419.696378:0:77222:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396798912 00002000:00100000:1.0:1651529419.696387:0:76181:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2bb8a:0x0] (1048576->2097151) req@00000000d6c4957b x1731746396799040/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.696387:0:77222:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x2bb89:0x0] (1048576->2097151) req@0000000009acc169 x1731746396798912/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.696391:0:76181:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d6c4957b with x1731746396799040 ext(1048576->2097151) 00002000:00100000:0.0:1651529419.696391:0:77222:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000009acc169 with x1731746396798912 ext(1048576->2097151) 00002000:00010000:1.0:1651529419.696392:0:76181:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000d6c4957b 00002000:00010000:0.0:1651529419.696392:0:77222:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000009acc169 00000100:00100000:1.0:1651529419.696398:0:76181:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18795 00000100:00100000:1.0:1651529419.696406:0:76181:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6c4957b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+221:41278:x1731746396799040:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.696406:0:77222:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18796 00000100:00100000:0.0:1651529419.696408:0:77222:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009acc169 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+221:41278:x1731746396798912:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.696700:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.696708:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396799168 00002000:00100000:1.0:1651529419.696714:0:72402:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2bb8b:0x0] (1048576->2097151) req@000000004b0eb4b8 x1731746396799168/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.696718:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004b0eb4b8 with x1731746396799168 ext(1048576->2097151) 00002000:00010000:1.0:1651529419.696719:0:72402:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000004b0eb4b8 00000100:00100000:1.0:1651529419.696724:0:72402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18797 00000100:00100000:1.0:1651529419.696726:0:72402:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004b0eb4b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+224:41278:x1731746396799168:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.696981:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.696988:0:77223:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396799296 00002000:00100000:1.0:1651529419.696995:0:77223:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x100010000:0x2bb8c:0x0] (0->2097151) req@00000000f7d7cf49 x1731746396799296/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.697012:0:77223:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f7d7cf49 with x1731746396799296 ext(0->2097151) 00002000:00010000:1.0:1651529419.697013:0:77223:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f7d7cf49 00000100:00100000:1.0:1651529419.697018:0:77223:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18798 00000100:00100000:1.0:1651529419.697020:0:77223:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7d7cf49 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+226:41278:x1731746396799296:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.698280:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.698292:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.698300:0:77219:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396799424 00000100:00100000:1.0:1651529419.698301:0:77218:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396799552 00002000:00100000:1.0:1651529419.698309:0:77218:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x2bbb8:0x0] (0->1048575) req@00000000964dafd1 x1731746396799552/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.698309:0:77219:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x100010000:0x2bbb6:0x0] (0->1048575) req@0000000093ae3357 x1731746396799424/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.698313:0:77218:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000964dafd1 with x1731746396799552 ext(0->1048575) 00002000:00100000:0.0:1651529419.698314:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000093ae3357 with x1731746396799424 ext(0->1048575) 00002000:00010000:1.0:1651529419.698315:0:77218:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000964dafd1 00002000:00010000:0.0:1651529419.698316:0:77219:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000093ae3357 00000100:00100000:1.0:1651529419.698327:0:77218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18799 00000100:00100000:1.0:1651529419.698329:0:77218:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000964dafd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+231:41278:x1731746396799552:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.698330:0:77219:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18800 00000100:00100000:0.0:1651529419.698331:0:77219:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093ae3357 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+231:41278:x1731746396799424:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.698751:0:76181:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6c4957b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+232:41278:x1731746396799040:12345-10.240.43.64@tcp:4:dd.0 Request processed in 2344us (2383us total) trans 12885080814 rc 0/0 00000100:00100000:1.0:1651529419.698755:0:76181:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18795 00002000:00100000:1.0:1651529419.698758:0:76181:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2bb8a:0x0] (1048576->2097151) req@00000000d6c4957b x1731746396799040/t12885080814(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.698761:0:76181:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d6c4957b with x1731746396799040 ext(1048576->2097151) 00002000:00010000:1.0:1651529419.698763:0:76181:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000d6c4957b 00000100:00100000:0.0:1651529419.699426:0:77222:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009acc169 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+232:41278:x1731746396798912:12345-10.240.43.64@tcp:4:dd.0 Request processed in 3016us (3071us total) trans 12885080815 rc 0/0 00000100:00100000:0.0:1651529419.699430:0:77222:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18796 00002000:00100000:0.0:1651529419.699433:0:77222:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x2bb89:0x0] (1048576->2097151) req@0000000009acc169 x1731746396798912/t12885080815(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.699437:0:77222:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000009acc169 with x1731746396798912 ext(1048576->2097151) 00002000:00010000:0.0:1651529419.699438:0:77222:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000009acc169 00000100:00100000:1.0:1651529419.700278:0:72402:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004b0eb4b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+232:41278:x1731746396799168:12345-10.240.43.64@tcp:4:dd.0 Request processed in 3550us (3577us total) trans 12885080816 rc 0/0 00000100:00100000:1.0:1651529419.700282:0:72402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18797 00002000:00100000:1.0:1651529419.700285:0:72402:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2bb8b:0x0] (1048576->2097151) req@000000004b0eb4b8 x1731746396799168/t12885080816(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.700289:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004b0eb4b8 with x1731746396799168 ext(1048576->2097151) 00002000:00010000:1.0:1651529419.700290:0:72402:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000004b0eb4b8 00000100:00100000:0.0:1651529419.700324:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.700373:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.700386:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.700391:0:77222:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396799488 00000100:00100000:1.0:1651529419.700394:0:76181:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396799616 00002000:00100000:0.0:1651529419.700400:0:77222:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x2bbb7:0x0] (0->1048575) req@000000004534b316 x1731746396799488/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.700401:0:76181:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2bbb9:0x0] (0->1048575) req@0000000037b4d7f0 x1731746396799616/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.700404:0:77222:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004534b316 with x1731746396799488 ext(0->1048575) 00002000:00100000:1.0:1651529419.700405:0:76181:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000037b4d7f0 with x1731746396799616 ext(0->1048575) 00002000:00010000:0.0:1651529419.700405:0:77222:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000004534b316 00002000:00010000:1.0:1651529419.700406:0:76181:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000037b4d7f0 00000100:00100000:0.0:1651529419.700413:0:77222:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396799808 00002000:00100000:0.0:1651529419.700417:0:77222:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x2bbba:0x0] (0->1048575) req@00000000d1fb76f9 x1731746396799808/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.700420:0:77222:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d1fb76f9 with x1731746396799808 ext(0->1048575) 00000100:00100000:1.0:1651529419.700421:0:76181:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18801 00002000:00010000:0.0:1651529419.700421:0:77222:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000d1fb76f9 00000100:00100000:1.0:1651529419.700423:0:76181:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+234:41278:x1731746396799488:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.700427:0:77222:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18802 00000100:00100000:0.0:1651529419.700429:0:77222:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037b4d7f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+234:41278:x1731746396799616:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.700586:0:76182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18803 00000100:00100000:1.0:1651529419.700588:0:76182:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d1fb76f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+235:41278:x1731746396799808:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.701008:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.701016:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396799872 00002000:00100000:1.0:1651529419.701022:0:72402:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2bbbb:0x0] (0->1048575) req@00000000942780b9 x1731746396799872/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.701026:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000942780b9 with x1731746396799872 ext(0->1048575) 00002000:00010000:1.0:1651529419.701027:0:72402:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000942780b9 00000100:00100000:1.0:1651529419.701032:0:72402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18804 00000100:00100000:1.0:1651529419.701034:0:72402:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000942780b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+238:41279:x1731746396799872:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.701260:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.701272:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.701280:0:77217:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396799936 00002000:00100000:0.0:1651529419.701287:0:77217:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x100010000:0x2bba4:0x0] (0->1048575) req@0000000076d5f96b x1731746396799936/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.701291:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000076d5f96b with x1731746396799936 ext(0->1048575) 00002000:00010000:0.0:1651529419.701293:0:77217:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000076d5f96b 00000100:00100000:0.0:1651529419.701301:0:77217:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396800000 00002000:00100000:0.0:1651529419.701304:0:77217:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x100010000:0x2bbbc:0x0] (0->1048575) req@000000000999005e x1731746396800000/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.701307:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000999005e with x1731746396800000 ext(0->1048575) 00002000:00010000:0.0:1651529419.701308:0:77217:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000000999005e 00000100:00100000:0.0:1651529419.701315:0:77217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18805 00000100:00100000:0.0:1651529419.701317:0:77217:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+241:41279:x1731746396799936:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.701330:0:72400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18806 00000100:00100000:1.0:1651529419.701333:0:72400:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+241:41278:x1731746396800000:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.702668:0:77223:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7d7cf49 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+244:41278:x1731746396799296:12345-10.240.43.64@tcp:4:dd.0 Request processed in 5646us (5687us total) trans 12885080817 rc 0/0 00000100:00100000:1.0:1651529419.702671:0:77223:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18798 00002000:00100000:1.0:1651529419.702674:0:77223:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x100010000:0x2bb8c:0x0] (0->2097151) req@00000000f7d7cf49 x1731746396799296/t12885080817(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.702678:0:77223:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f7d7cf49 with x1731746396799296 ext(0->2097151) 00002000:00010000:1.0:1651529419.702680:0:77223:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f7d7cf49 00000100:00100000:1.0:1651529419.706953:0:77218:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000964dafd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+244:41278:x1731746396799552:12345-10.240.43.64@tcp:4:dd.0 Request processed in 8622us (8660us total) trans 12885080818 rc 0/0 00000100:00100000:1.0:1651529419.706956:0:77218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18799 00002000:00100000:1.0:1651529419.706959:0:77218:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x2bbb8:0x0] (0->1048575) req@00000000964dafd1 x1731746396799552/t12885080818(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.706963:0:77218:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000964dafd1 with x1731746396799552 ext(0->1048575) 00002000:00010000:1.0:1651529419.706965:0:77218:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000964dafd1 00000100:00100000:1.0:1651529419.707550:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.707559:0:77218:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396800320 00002000:00100000:1.0:1651529419.707568:0:77218:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x2bbbe:0x0] (0->1048575) req@00000000dc8c102b x1731746396800320/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.707571:0:77218:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000dc8c102b with x1731746396800320 ext(0->1048575) 00002000:00010000:1.0:1651529419.707573:0:77218:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000dc8c102b 00000100:00100000:1.0:1651529419.707578:0:77218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18807 00000100:00100000:1.0:1651529419.707580:0:77218:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc8c102b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+246:41278:x1731746396800320:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.707783:0:77219:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093ae3357 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+246:41278:x1731746396799424:12345-10.240.43.64@tcp:4:dd.0 Request processed in 9439us (9493us total) trans 12885080819 rc 0/0 00000100:00100000:0.0:1651529419.707787:0:77219:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18800 00002000:00100000:0.0:1651529419.707791:0:77219:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x100010000:0x2bbb6:0x0] (0->1048575) req@0000000093ae3357 x1731746396799424/t12885080819(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.707795:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000093ae3357 with x1731746396799424 ext(0->1048575) 00002000:00010000:0.0:1651529419.707797:0:77219:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000093ae3357 00000100:00100000:1.0:1651529419.708514:0:76181:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+246:41278:x1731746396799488:12345-10.240.43.64@tcp:4:dd.0 Request processed in 8090us (8190us total) trans 12885080820 rc 0/0 00000100:00100000:1.0:1651529419.708519:0:76181:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18801 00002000:00100000:1.0:1651529419.708521:0:76181:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2bbb7:0x0] (0->1048575) req@000000004534b316 x1731746396799488/t12885080820(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.708525:0:76181:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004534b316 with x1731746396799488 ext(0->1048575) 00002000:00010000:1.0:1651529419.708527:0:76181:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000004534b316 00000100:00100000:1.0:1651529419.709081:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.709089:0:76181:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396800384 00002000:00100000:1.0:1651529419.709096:0:76181:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2bbbf:0x0] (0->1048575) req@000000009cc93081 x1731746396800384/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.709100:0:76181:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009cc93081 with x1731746396800384 ext(0->1048575) 00002000:00010000:1.0:1651529419.709101:0:76181:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000009cc93081 00000100:00100000:1.0:1651529419.709110:0:76181:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18808 00000100:00100000:1.0:1651529419.709117:0:76181:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009cc93081 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+248:41279:x1731746396800384:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.709652:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.709655:0:77222:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037b4d7f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+250:41278:x1731746396799616:12345-10.240.43.64@tcp:4:dd.0 Request processed in 9225us (9282us total) trans 12885080821 rc 0/0 00000100:00100000:0.0:1651529419.709676:0:77222:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18802 00002000:00100000:0.0:1651529419.709679:0:77222:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x2bbb9:0x0] (0->1048575) req@0000000037b4d7f0 x1731746396799616/t12885080821(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.709683:0:77222:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000037b4d7f0 with x1731746396799616 ext(0->1048575) 00002000:00010000:0.0:1651529419.709685:0:77222:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000037b4d7f0 00000100:00100000:0.0:1651529419.709691:0:77222:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396800448 00002000:00100000:0.0:1651529419.709697:0:77222:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x2bbc0:0x0] (0->1048575) req@00000000da822db3 x1731746396800448/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.709704:0:77222:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000da822db3 with x1731746396800448 ext(0->1048575) 00002000:00010000:0.0:1651529419.709705:0:77222:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000da822db3 00000100:00100000:0.0:1651529419.709714:0:77222:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18809 00000100:00100000:0.0:1651529419.709716:0:77222:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000da822db3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+250:41278:x1731746396800448:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.710259:0:76182:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d1fb76f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+250:41278:x1731746396799808:12345-10.240.43.64@tcp:4:dd.0 Request processed in 9670us (9872us total) trans 12885080822 rc 0/0 00000100:00100000:1.0:1651529419.710263:0:76182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18803 00002000:00100000:1.0:1651529419.710266:0:76182:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x2bbba:0x0] (0->1048575) req@00000000d1fb76f9 x1731746396799808/t12885080822(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.710269:0:76182:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d1fb76f9 with x1731746396799808 ext(0->1048575) 00002000:00010000:1.0:1651529419.710271:0:76182:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000d1fb76f9 00000100:00100000:1.0:1651529419.710947:0:72402:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000942780b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+250:41279:x1731746396799872:12345-10.240.43.64@tcp:4:dd.0 Request processed in 9912us (9939us total) trans 12885080823 rc 0/0 00000100:00100000:1.0:1651529419.710953:0:72402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18804 00002000:00100000:1.0:1651529419.710956:0:72402:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2bbbb:0x0] (0->1048575) req@00000000942780b9 x1731746396799872/t12885080823(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.710959:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000942780b9 with x1731746396799872 ext(0->1048575) 00002000:00010000:1.0:1651529419.710960:0:72402:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000942780b9 00000100:00100000:0.0:1651529419.711794:0:77217:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+250:41279:x1731746396799936:12345-10.240.43.64@tcp:4:dd.0 Request processed in 10475us (10534us total) trans 12885080824 rc 0/0 00000100:00100000:0.0:1651529419.711798:0:77217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18805 00002000:00100000:0.0:1651529419.711801:0:77217:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x100010000:0x2bba4:0x0] (0->1048575) req@0000000076d5f96b x1731746396799936/t12885080824(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.711806:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000076d5f96b with x1731746396799936 ext(0->1048575) 00002000:00010000:0.0:1651529419.711807:0:77217:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000076d5f96b 00000100:00100000:1.0:1651529419.712611:0:72400:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000999005e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+250:41278:x1731746396800000:12345-10.240.43.64@tcp:4:dd.0 Request processed in 11277us (11338us total) trans 12885080825 rc 0/0 00000100:00100000:1.0:1651529419.712615:0:72400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18806 00002000:00100000:1.0:1651529419.712618:0:72400:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x100010000:0x2bbbc:0x0] (0->1048575) req@000000000999005e x1731746396800000/t12885080825(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.712621:0:72400:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000999005e with x1731746396800000 ext(0->1048575) 00002000:00010000:1.0:1651529419.712623:0:72400:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000000999005e 00000100:00100000:0.0:1651529419.712740:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.712784:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.712793:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.712803:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.712828:0:77217:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396800576 00002000:00100000:0.0:1651529419.712837:0:77217:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x100010000:0x2bbc1:0x0] (0->1048575) req@00000000ee8cd7c9 x1731746396800576/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.712841:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ee8cd7c9 with x1731746396800576 ext(0->1048575) 00002000:00010000:0.0:1651529419.712843:0:77217:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000ee8cd7c9 00000100:00100000:0.0:1651529419.712848:0:77217:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396800704 00002000:00100000:0.0:1651529419.712851:0:77217:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x100010000:0x2bbc3:0x0] (0->1048575) req@0000000095d7eb1a x1731746396800704/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.712854:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000095d7eb1a with x1731746396800704 ext(0->1048575) 00002000:00010000:0.0:1651529419.712856:0:77217:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000095d7eb1a 00000100:00100000:0.0:1651529419.712875:0:77217:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396800640 00002000:00100000:0.0:1651529419.712879:0:77217:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x100010000:0x2bbc2:0x0] (0->1048575) req@00000000ba0b61e6 x1731746396800640/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.712883:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ba0b61e6 with x1731746396800640 ext(0->1048575) 00002000:00010000:0.0:1651529419.712884:0:77217:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000ba0b61e6 00000100:00100000:0.0:1651529419.712891:0:77217:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396800768 00002000:00100000:0.0:1651529419.712894:0:77217:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x100010000:0x2bbc4:0x0] (0->1048575) req@00000000716b388d x1731746396800768/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.712906:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000716b388d with x1731746396800768 ext(0->1048575) 00002000:00010000:0.0:1651529419.712908:0:77217:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000716b388d 00000100:00100000:0.0:1651529419.712916:0:77217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18810 00000100:00100000:0.0:1651529419.712918:0:77217:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+253:41278:x1731746396800576:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.713115:0:77219:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18811 00000100:00100000:0.0:1651529419.713118:0:77219:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+254:41278:x1731746396800704:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.713136:0:72400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18812 00000100:00100000:1.0:1651529419.713138:0:72400:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+256:41278:x1731746396800640:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.713324:0:76182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18813 00000100:00100000:1.0:1651529419.713326:0:76182:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+258:41279:x1731746396800768:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.713693:0:77218:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc8c102b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+260:41278:x1731746396800320:12345-10.240.43.64@tcp:4:dd.0 Request processed in 6112us (6142us total) trans 12885080826 rc 0/0 00000100:00100000:1.0:1651529419.713696:0:77218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18807 00002000:00100000:1.0:1651529419.713699:0:77218:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x2bbbe:0x0] (0->1048575) req@00000000dc8c102b x1731746396800320/t12885080826(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.713703:0:77218:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000dc8c102b with x1731746396800320 ext(0->1048575) 00002000:00010000:1.0:1651529419.713705:0:77218:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000dc8c102b 00000100:00100000:1.0:1651529419.714143:0:76181:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009cc93081 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+260:41279:x1731746396800384:12345-10.240.43.64@tcp:4:dd.0 Request processed in 5025us (5063us total) trans 12885080827 rc 0/0 00000100:00100000:1.0:1651529419.714147:0:76181:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18808 00002000:00100000:1.0:1651529419.714149:0:76181:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2bbbf:0x0] (0->1048575) req@000000009cc93081 x1731746396800384/t12885080827(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.714153:0:76181:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009cc93081 with x1731746396800384 ext(0->1048575) 00002000:00010000:1.0:1651529419.714154:0:76181:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000009cc93081 00000100:00100000:0.0:1651529419.714395:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.714406:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.714416:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.714448:0:76181:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396800896 00002000:00100000:1.0:1651529419.714456:0:76181:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2bbc5:0x0] (0->1048575) req@000000005a17dd72 x1731746396800896/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.714460:0:76181:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005a17dd72 with x1731746396800896 ext(0->1048575) 00002000:00010000:1.0:1651529419.714462:0:76181:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000005a17dd72 00000100:00100000:1.0:1651529419.714467:0:76181:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396800960 00002000:00100000:1.0:1651529419.714470:0:76181:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2bba9:0x0] (0->1048575) req@0000000093ddaf92 x1731746396800960/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.714473:0:76181:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000093ddaf92 with x1731746396800960 ext(0->1048575) 00002000:00010000:1.0:1651529419.714475:0:76181:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000093ddaf92 00000100:00100000:1.0:1651529419.714478:0:76181:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396801024 00002000:00100000:1.0:1651529419.714481:0:76181:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2bbc6:0x0] (0->1048575) req@00000000b0d9532a x1731746396801024/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.714484:0:76181:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b0d9532a with x1731746396801024 ext(0->1048575) 00002000:00010000:1.0:1651529419.714485:0:76181:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000b0d9532a 00000100:00100000:1.0:1651529419.714494:0:76181:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18814 00000100:00100000:1.0:1651529419.714501:0:76181:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+262:41279:x1731746396800896:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.714667:0:77218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18815 00000100:00100000:1.0:1651529419.714669:0:77218:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+263:41279:x1731746396800960:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.714681:0:77222:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000da822db3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+262:41278:x1731746396800448:12345-10.240.43.64@tcp:4:dd.0 Request processed in 4964us (5029us total) trans 12885080828 rc 0/0 00000100:00100000:0.0:1651529419.714685:0:77222:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18809 00002000:00100000:0.0:1651529419.714688:0:77222:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x2bbc0:0x0] (0->1048575) req@00000000da822db3 x1731746396800448/t12885080828(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.714692:0:77222:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000da822db3 with x1731746396800448 ext(0->1048575) 00002000:00010000:0.0:1651529419.714694:0:77222:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000da822db3 00000100:00100000:0.0:1651529419.714700:0:77222:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18816 00000100:00100000:0.0:1651529419.714702:0:77222:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+261:41278:x1731746396801024:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.715890:0:77217:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee8cd7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+264:41278:x1731746396800576:12345-10.240.43.64@tcp:4:dd.0 Request processed in 2971us (3150us total) trans 12885080829 rc 0/0 00000100:00100000:1.0:1651529419.715894:0:77217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18810 00002000:00100000:1.0:1651529419.715897:0:77217:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x100010000:0x2bbc1:0x0] (0->1048575) req@00000000ee8cd7c9 x1731746396800576/t12885080829(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.715900:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ee8cd7c9 with x1731746396800576 ext(0->1048575) 00002000:00010000:1.0:1651529419.715902:0:77217:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000ee8cd7c9 00000100:00100000:1.0:1651529419.716816:0:72400:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba0b61e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+264:41278:x1731746396800640:12345-10.240.43.64@tcp:4:dd.0 Request processed in 3676us (4022us total) trans 12885080830 rc 0/0 00000100:00100000:1.0:1651529419.716819:0:72400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18812 00002000:00100000:1.0:1651529419.716822:0:72400:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x100010000:0x2bbc2:0x0] (0->1048575) req@00000000ba0b61e6 x1731746396800640/t12885080830(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.716826:0:72400:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ba0b61e6 with x1731746396800640 ext(0->1048575) 00002000:00010000:1.0:1651529419.716827:0:72400:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000ba0b61e6 00000100:00100000:0.0:1651529419.717366:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.717406:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529419.717515:0:72400:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396801088 00002000:00100000:1.0:1651529419.717524:0:72400:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x100010000:0x2bbc8:0x0] (0->1048575) req@00000000ae466fbb x1731746396801088/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.717528:0:72400:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ae466fbb with x1731746396801088 ext(0->1048575) 00002000:00010000:1.0:1651529419.717529:0:72400:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000ae466fbb 00000100:00100000:1.0:1651529419.717534:0:72400:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396801216 00002000:00100000:1.0:1651529419.717538:0:72400:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x100010000:0x2bbc9:0x0] (0->1048575) req@00000000de0edbdc x1731746396801216/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651529419.717545:0:72400:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000de0edbdc with x1731746396801216 ext(0->1048575) 00002000:00010000:1.0:1651529419.717546:0:72400:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000de0edbdc 00000100:00100000:1.0:1651529419.717550:0:72400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18817 00000100:00100000:1.0:1651529419.717552:0:72400:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+267:41278:x1731746396801088:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.717729:0:77217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18818 00000100:00100000:1.0:1651529419.717731:0:77217:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+268:41278:x1731746396801216:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.718088:0:77219:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095d7eb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+270:41278:x1731746396800704:12345-10.240.43.64@tcp:4:dd.0 Request processed in 4969us (5303us total) trans 12885080831 rc 0/0 00000100:00100000:1.0:1651529419.718091:0:77219:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18811 00002000:00100000:1.0:1651529419.718094:0:77219:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x100010000:0x2bbc3:0x0] (0->1048575) req@0000000095d7eb1a x1731746396800704/t12885080831(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.718097:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000095d7eb1a with x1731746396800704 ext(0->1048575) 00002000:00010000:1.0:1651529419.718099:0:77219:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000095d7eb1a 00000100:00100000:0.0:1651529419.718938:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.719275:0:76182:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000716b388d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+268:41279:x1731746396800768:12345-10.240.43.64@tcp:4:dd.0 Request processed in 5948us (6471us total) trans 12885080832 rc 0/0 00000100:00100000:0.0:1651529419.719279:0:76182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18813 00002000:00100000:0.0:1651529419.719283:0:76182:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x2bbc4:0x0] (0->1048575) req@00000000716b388d x1731746396800768/t12885080832(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.719287:0:76182:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000716b388d with x1731746396800768 ext(0->1048575) 00002000:00010000:0.0:1651529419.719289:0:76182:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000716b388d 00000100:00100000:0.0:1651529419.719296:0:76182:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396801280 00002000:00100000:0.0:1651529419.719301:0:76182:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x2bbca:0x0] (0->1048575) req@0000000054e3a257 x1731746396801280/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.719305:0:76182:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000054e3a257 with x1731746396801280 ext(0->1048575) 00002000:00010000:0.0:1651529419.719307:0:76182:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000054e3a257 00000100:00100000:0.0:1651529419.719315:0:76182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18819 00000100:00100000:0.0:1651529419.719317:0:76182:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+268:41278:x1731746396801280:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.719742:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.720361:0:76181:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a17dd72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+272:41279:x1731746396800896:12345-10.240.43.64@tcp:4:dd.0 Request processed in 5863us (5966us total) trans 12885080833 rc 0/0 00000100:00100000:0.0:1651529419.720365:0:76181:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18814 00002000:00100000:0.0:1651529419.720368:0:76181:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2bbc5:0x0] (0->1048575) req@000000005a17dd72 x1731746396800896/t12885080833(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.720372:0:76181:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005a17dd72 with x1731746396800896 ext(0->1048575) 00002000:00010000:0.0:1651529419.720374:0:76181:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000005a17dd72 00000100:00100000:0.0:1651529419.720380:0:76181:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396801408 00002000:00100000:0.0:1651529419.720385:0:76181:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2bbcb:0x0] (0->1048575) req@00000000e124baf1 x1731746396801408/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.720389:0:76181:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e124baf1 with x1731746396801408 ext(0->1048575) 00002000:00010000:0.0:1651529419.720390:0:76181:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000e124baf1 00000100:00100000:0.0:1651529419.720400:0:76181:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18820 00000100:00100000:0.0:1651529419.720402:0:76181:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+272:41279:x1731746396801408:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.720658:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.720675:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.720692:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.720916:0:77222:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b0d9532a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+272:41278:x1731746396801024:12345-10.240.43.64@tcp:4:dd.0 Request processed in 6212us (6499us total) trans 12885080834 rc 0/0 00000100:00100000:0.0:1651529419.720919:0:77222:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18816 00002000:00100000:0.0:1651529419.720922:0:77222:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x2bbc6:0x0] (0->1048575) req@00000000b0d9532a x1731746396801024/t12885080834(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.720926:0:77222:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b0d9532a with x1731746396801024 ext(0->1048575) 00002000:00010000:0.0:1651529419.720928:0:77222:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000b0d9532a 00000100:00100000:0.0:1651529419.720933:0:77222:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396801472 00002000:00100000:0.0:1651529419.720938:0:77222:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x2bbcc:0x0] (0->1048575) req@00000000edfe60d3 x1731746396801472/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.720941:0:77222:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000edfe60d3 with x1731746396801472 ext(0->1048575) 00002000:00010000:0.0:1651529419.720943:0:77222:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000edfe60d3 00000100:00100000:0.0:1651529419.720945:0:77222:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396801536 00002000:00100000:0.0:1651529419.720948:0:77222:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x2bbcd:0x0] (0->1048575) req@00000000e5997468 x1731746396801536/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.720952:0:77222:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e5997468 with x1731746396801536 ext(0->1048575) 00002000:00010000:0.0:1651529419.720952:0:77222:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000e5997468 00000100:00100000:0.0:1651529419.720954:0:77222:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396801600 00002000:00100000:0.0:1651529419.720957:0:77222:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x2bb8d:0x0] (0->2097151) req@00000000b4acf60d x1731746396801600/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.720960:0:77222:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b4acf60d with x1731746396801600 ext(0->2097151) 00002000:00010000:0.0:1651529419.720961:0:77222:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000b4acf60d 00000100:00100000:0.0:1651529419.720964:0:77222:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18821 00000100:00100000:0.0:1651529419.720965:0:77222:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+274:41278:x1731746396801472:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.721257:0:77223:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18822 00000100:00100000:0.0:1651529419.721259:0:77223:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+275:41278:x1731746396801536:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.721533:0:77219:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18823 00000100:00100000:0.0:1651529419.721535:0:77219:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+278:41278:x1731746396801600:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.722094:0:77218:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000093ddaf92 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+278:41279:x1731746396800960:12345-10.240.43.64@tcp:4:dd.0 Request processed in 7424us (7687us total) trans 12885080835 rc 0/0 00000100:00100000:0.0:1651529419.722098:0:77218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18815 00002000:00100000:0.0:1651529419.722101:0:77218:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x2bba9:0x0] (0->1048575) req@0000000093ddaf92 x1731746396800960/t12885080835(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.722104:0:77218:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000093ddaf92 with x1731746396800960 ext(0->1048575) 00002000:00010000:0.0:1651529419.722107:0:77218:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000093ddaf92 00000100:00100000:0.0:1651529419.722335:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.722343:0:77218:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396801664 00002000:00100000:0.0:1651529419.722350:0:77218:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x2bbcf:0x0] (0->1048575) req@000000006731397d x1731746396801664/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.722354:0:77218:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006731397d with x1731746396801664 ext(0->1048575) 00002000:00010000:0.0:1651529419.722355:0:77218:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000006731397d 00000100:00100000:0.0:1651529419.722361:0:77218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18824 00000100:00100000:0.0:1651529419.722362:0:77218:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+278:41279:x1731746396801664:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.723800:0:76182:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054e3a257 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+280:41278:x1731746396801280:12345-10.240.43.64@tcp:4:dd.0 Request processed in 4482us (4862us total) trans 12885080836 rc 0/0 00000100:00100000:0.0:1651529419.723804:0:76182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18819 00002000:00100000:0.0:1651529419.723807:0:76182:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x2bbca:0x0] (0->1048575) req@0000000054e3a257 x1731746396801280/t12885080836(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.723811:0:76182:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000054e3a257 with x1731746396801280 ext(0->1048575) 00002000:00010000:0.0:1651529419.723813:0:76182:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000054e3a257 00000100:00100000:0.0:1651529419.724842:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.724852:0:76182:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396802048 00002000:00100000:0.0:1651529419.724859:0:76182:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x2bbd0:0x0] (0->1048575) req@0000000085af61db x1731746396802048/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.724863:0:76182:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000085af61db with x1731746396802048 ext(0->1048575) 00002000:00010000:0.0:1651529419.724865:0:76182:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000085af61db 00000100:00100000:0.0:1651529419.724870:0:76182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18825 00000100:00100000:0.0:1651529419.724872:0:76182:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085af61db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+282:41279:x1731746396802048:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.725143:0:76181:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e124baf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+282:41279:x1731746396801408:12345-10.240.43.64@tcp:4:dd.0 Request processed in 4740us (5402us total) trans 12885080837 rc 0/0 00000100:00100000:0.0:1651529419.725147:0:76181:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18820 00002000:00100000:0.0:1651529419.725149:0:76181:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2bbcb:0x0] (0->1048575) req@00000000e124baf1 x1731746396801408/t12885080837(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.725174:0:76181:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e124baf1 with x1731746396801408 ext(0->1048575) 00002000:00010000:0.0:1651529419.725175:0:76181:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000e124baf1 00000100:00100000:0.0:1651529419.725210:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.725246:0:76181:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396802112 00002000:00100000:0.0:1651529419.725253:0:76181:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2bbd1:0x0] (0->1048575) req@000000002a1f5cf2 x1731746396802112/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.725257:0:76181:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002a1f5cf2 with x1731746396802112 ext(0->1048575) 00002000:00010000:0.0:1651529419.725258:0:76181:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000002a1f5cf2 00000100:00100000:0.0:1651529419.725263:0:76181:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18826 00000100:00100000:0.0:1651529419.725265:0:76181:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+282:41278:x1731746396802112:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.726525:0:77222:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000edfe60d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+286:41278:x1731746396801472:12345-10.240.43.64@tcp:4:dd.0 Request processed in 5558us (5867us total) trans 12885080838 rc 0/0 00000100:00100000:0.0:1651529419.726529:0:77222:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18821 00002000:00100000:0.0:1651529419.726531:0:77222:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x2bbcc:0x0] (0->1048575) req@00000000edfe60d3 x1731746396801472/t12885080838(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.726535:0:77222:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000edfe60d3 with x1731746396801472 ext(0->1048575) 00002000:00010000:0.0:1651529419.726536:0:77222:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000edfe60d3 00000100:00100000:0.0:1651529419.727005:0:72400:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ae466fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+284:41278:x1731746396801088:12345-10.240.43.64@tcp:4:dd.0 Request processed in 9451us (9639us total) trans 12885080839 rc 0/0 00000100:00100000:0.0:1651529419.727010:0:72400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18817 00002000:00100000:0.0:1651529419.727013:0:72400:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x100010000:0x2bbc8:0x0] (0->1048575) req@00000000ae466fbb x1731746396801088/t12885080839(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.727016:0:72400:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ae466fbb with x1731746396801088 ext(0->1048575) 00002000:00010000:0.0:1651529419.727018:0:72400:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000ae466fbb 00000100:00100000:0.0:1651529419.727274:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.727282:0:72400:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396802176 00002000:00100000:0.0:1651529419.727289:0:72400:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x100010000:0x2bbd2:0x0] (0->1048575) req@000000004a6776b5 x1731746396802176/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.727293:0:72400:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004a6776b5 with x1731746396802176 ext(0->1048575) 00002000:00010000:0.0:1651529419.727295:0:72400:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000004a6776b5 00000100:00100000:0.0:1651529419.727300:0:72400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18827 00000100:00100000:0.0:1651529419.727302:0:72400:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+286:41278:x1731746396802176:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.727769:0:77223:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e5997468 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+288:41278:x1731746396801536:12345-10.240.43.64@tcp:4:dd.0 Request processed in 6508us (7093us total) trans 12885080840 rc 0/0 00000100:00100000:0.0:1651529419.727781:0:77223:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18822 00002000:00100000:0.0:1651529419.727784:0:77223:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x100010000:0x2bbcd:0x0] (0->1048575) req@00000000e5997468 x1731746396801536/t12885080840(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.727787:0:77223:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e5997468 with x1731746396801536 ext(0->1048575) 00002000:00010000:0.0:1651529419.727789:0:77223:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000e5997468 00000100:00100000:0.0:1651529419.728276:0:77217:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de0edbdc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+286:41278:x1731746396801216:12345-10.240.43.64@tcp:4:dd.0 Request processed in 10543us (10878us total) trans 12885080841 rc 0/0 00000100:00100000:0.0:1651529419.728279:0:77217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18818 00002000:00100000:0.0:1651529419.728282:0:77217:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x100010000:0x2bbc9:0x0] (0->1048575) req@00000000de0edbdc x1731746396801216/t12885080841(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.728285:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000de0edbdc with x1731746396801216 ext(0->1048575) 00002000:00010000:0.0:1651529419.728287:0:77217:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000de0edbdc 00000100:00100000:0.0:1651529419.728315:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.728340:0:77217:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396802240 00002000:00100000:0.0:1651529419.728347:0:77217:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x100010000:0x2bbd3:0x0] (0->1048575) req@0000000078f9a278 x1731746396802240/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.728351:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000078f9a278 with x1731746396802240 ext(0->1048575) 00002000:00010000:0.0:1651529419.728352:0:77217:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000078f9a278 00000100:00100000:0.0:1651529419.728357:0:77217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18828 00000100:00100000:0.0:1651529419.728359:0:77217:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+286:41279:x1731746396802240:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.730472:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.730492:0:77223:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396802560 00002000:00100000:0.0:1651529419.730501:0:77223:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x100010000:0x2bbd4:0x0] (0->1048575) req@0000000014f8af45 x1731746396802560/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.730505:0:77223:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000014f8af45 with x1731746396802560 ext(0->1048575) 00002000:00010000:0.0:1651529419.730507:0:77223:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000014f8af45 00000100:00100000:0.0:1651529419.730526:0:77223:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18829 00000100:00100000:0.0:1651529419.730528:0:77223:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+290:41279:x1731746396802560:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.731241:0:77219:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b4acf60d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+290:41278:x1731746396801600:12345-10.240.43.64@tcp:4:dd.0 Request processed in 9704us (10548us total) trans 12885080842 rc 0/0 00000100:00100000:0.0:1651529419.731245:0:77219:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18823 00002000:00100000:0.0:1651529419.731248:0:77219:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x100010000:0x2bb8d:0x0] (0->2097151) req@00000000b4acf60d x1731746396801600/t12885080842(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.731252:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b4acf60d with x1731746396801600 ext(0->2097151) 00002000:00010000:0.0:1651529419.731253:0:77219:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000b4acf60d 00000100:00100000:0.0:1651529419.732161:0:77218:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006731397d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+290:41279:x1731746396801664:12345-10.240.43.64@tcp:4:dd.0 Request processed in 9797us (9826us total) trans 12885080843 rc 0/0 00000100:00100000:0.0:1651529419.732165:0:77218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18824 00002000:00100000:0.0:1651529419.732168:0:77218:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x2bbcf:0x0] (0->1048575) req@000000006731397d x1731746396801664/t12885080843(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.732171:0:77218:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006731397d with x1731746396801664 ext(0->1048575) 00002000:00010000:0.0:1651529419.732173:0:77218:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000006731397d 00000100:00100000:0.0:1651529419.732408:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.732418:0:77218:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396802624 00002000:00100000:0.0:1651529419.732425:0:77218:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x2bbd5:0x0] (0->1048575) req@0000000089d7f5d6 x1731746396802624/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.732429:0:77218:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000089d7f5d6 with x1731746396802624 ext(0->1048575) 00002000:00010000:0.0:1651529419.732431:0:77218:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000089d7f5d6 00000100:00100000:0.0:1651529419.732436:0:77218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18830 00000100:00100000:0.0:1651529419.732437:0:77218:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+290:41278:x1731746396802624:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.733428:0:76182:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085af61db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+292:41279:x1731746396802048:12345-10.240.43.64@tcp:4:dd.0 Request processed in 8554us (8586us total) trans 12885080844 rc 0/0 00000100:00100000:0.0:1651529419.733432:0:76182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18825 00002000:00100000:0.0:1651529419.733434:0:76182:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x2bbd0:0x0] (0->1048575) req@0000000085af61db x1731746396802048/t12885080844(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.733438:0:76182:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000085af61db with x1731746396802048 ext(0->1048575) 00002000:00010000:0.0:1651529419.733440:0:76182:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000085af61db 00000100:00100000:0.0:1651529419.733804:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.733813:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.733819:0:77219:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396802816 00002000:00100000:0.0:1651529419.733826:0:77219:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x100010000:0x2bbd6:0x0] (0->1048575) req@00000000ea0220b6 x1731746396802816/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.733830:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ea0220b6 with x1731746396802816 ext(0->1048575) 00002000:00010000:0.0:1651529419.733832:0:77219:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000ea0220b6 00000100:00100000:0.0:1651529419.733837:0:77219:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396802880 00002000:00100000:0.0:1651529419.733840:0:77219:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x100010000:0x2bbd7:0x0] (0->1048575) req@000000002a957ba7 x1731746396802880/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.733844:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002a957ba7 with x1731746396802880 ext(0->1048575) 00002000:00010000:0.0:1651529419.733858:0:77219:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000002a957ba7 00000100:00100000:0.0:1651529419.733865:0:77219:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18831 00000100:00100000:0.0:1651529419.733867:0:77219:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+295:41279:x1731746396802816:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.734138:0:77221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18832 00000100:00100000:0.0:1651529419.734140:0:77221:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+296:41279:x1731746396802880:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.734383:0:76181:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a1f5cf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+296:41278:x1731746396802112:12345-10.240.43.64@tcp:4:dd.0 Request processed in 9117us (9173us total) trans 12885080845 rc 0/0 00000100:00100000:0.0:1651529419.734387:0:76181:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18826 00002000:00100000:0.0:1651529419.734389:0:76181:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2bbd1:0x0] (0->1048575) req@000000002a1f5cf2 x1731746396802112/t12885080845(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.734393:0:76181:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002a1f5cf2 with x1731746396802112 ext(0->1048575) 00002000:00010000:0.0:1651529419.734394:0:76181:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000002a1f5cf2 00000100:00100000:0.0:1651529419.734521:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.734529:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.734544:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.734552:0:77222:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396803008 00002000:00100000:0.0:1651529419.734558:0:77222:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x2bbd8:0x0] (0->1048575) req@0000000059363096 x1731746396803008/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.734562:0:77222:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000059363096 with x1731746396803008 ext(0->1048575) 00002000:00010000:0.0:1651529419.734563:0:77222:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000059363096 00000100:00100000:0.0:1651529419.734568:0:77222:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396803072 00002000:00100000:0.0:1651529419.734572:0:77222:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x2bb96:0x0] (0->1048575) req@0000000053ee5af1 x1731746396803072/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.734590:0:77222:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000053ee5af1 with x1731746396803072 ext(0->1048575) 00002000:00010000:0.0:1651529419.734592:0:77222:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000053ee5af1 00000100:00100000:0.0:1651529419.734597:0:77222:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396803136 00002000:00100000:0.0:1651529419.734602:0:77222:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x2bbd9:0x0] (0->1048575) req@000000002c4168d4 x1731746396803136/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.734605:0:77222:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002c4168d4 with x1731746396803136 ext(0->1048575) 00002000:00010000:0.0:1651529419.734606:0:77222:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000002c4168d4 00000100:00100000:0.0:1651529419.734611:0:77222:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18833 00000100:00100000:0.0:1651529419.734612:0:77222:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+298:41278:x1731746396803008:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.734844:0:77220:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18834 00000100:00100000:0.0:1651529419.734846:0:77220:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+299:41278:x1731746396803072:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.735092:0:72401:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18835 00000100:00100000:0.0:1651529419.735094:0:72401:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+300:41279:x1731746396803136:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.736037:0:72400:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+302:41278:x1731746396802176:12345-10.240.43.64@tcp:4:dd.0 Request processed in 8733us (8762us total) trans 12885080846 rc 0/0 00000100:00100000:0.0:1651529419.736040:0:72400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18827 00002000:00100000:0.0:1651529419.736044:0:72400:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x100010000:0x2bbd2:0x0] (0->1048575) req@000000004a6776b5 x1731746396802176/t12885080846(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.736048:0:72400:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004a6776b5 with x1731746396802176 ext(0->1048575) 00002000:00010000:0.0:1651529419.736049:0:72400:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000004a6776b5 00000100:00100000:0.0:1651529419.736753:0:77217:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+302:41279:x1731746396802240:12345-10.240.43.64@tcp:4:dd.0 Request processed in 8393us (8437us total) trans 12885080847 rc 0/0 00000100:00100000:0.0:1651529419.736757:0:77217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18828 00002000:00100000:0.0:1651529419.736759:0:77217:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x100010000:0x2bbd3:0x0] (0->1048575) req@0000000078f9a278 x1731746396802240/t12885080847(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.736763:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000078f9a278 with x1731746396802240 ext(0->1048575) 00002000:00010000:0.0:1651529419.736765:0:77217:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000078f9a278 00000100:00100000:0.0:1651529419.737651:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.737818:0:77217:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396803392 00002000:00100000:0.0:1651529419.737827:0:77217:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x100010000:0x2bbdb:0x0] (0->1048575) req@0000000027c41311 x1731746396803392/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.737831:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000027c41311 with x1731746396803392 ext(0->1048575) 00002000:00010000:0.0:1651529419.737833:0:77217:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000027c41311 00000100:00100000:0.0:1651529419.737854:0:77217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18836 00000100:00100000:0.0:1651529419.737856:0:77217:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+306:41278:x1731746396803392:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.738062:0:77223:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+306:41279:x1731746396802560:12345-10.240.43.64@tcp:4:dd.0 Request processed in 7533us (7591us total) trans 12885080848 rc 0/0 00000100:00100000:0.0:1651529419.738067:0:77223:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18829 00002000:00100000:0.0:1651529419.738070:0:77223:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x100010000:0x2bbd4:0x0] (0->1048575) req@0000000014f8af45 x1731746396802560/t12885080848(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.738074:0:77223:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000014f8af45 with x1731746396802560 ext(0->1048575) 00002000:00010000:0.0:1651529419.738075:0:77223:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000014f8af45 00000100:00100000:0.0:1651529419.738472:0:77218:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+304:41278:x1731746396802624:12345-10.240.43.64@tcp:4:dd.0 Request processed in 6033us (6082us total) trans 12885080849 rc 0/0 00000100:00100000:0.0:1651529419.738491:0:77218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18830 00002000:00100000:0.0:1651529419.738493:0:77218:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x2bbd5:0x0] (0->1048575) req@0000000089d7f5d6 x1731746396802624/t12885080849(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.738497:0:77218:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000089d7f5d6 with x1731746396802624 ext(0->1048575) 00002000:00010000:0.0:1651529419.738498:0:77218:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000089d7f5d6 00000100:00100000:0.0:1651529419.739146:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.739154:0:77218:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396803584 00002000:00100000:0.0:1651529419.739161:0:77218:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x2bbdc:0x0] (0->1048575) req@0000000078a40aa9 x1731746396803584/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.739165:0:77218:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000078a40aa9 with x1731746396803584 ext(0->1048575) 00002000:00010000:0.0:1651529419.739167:0:77218:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000078a40aa9 00000100:00100000:0.0:1651529419.739172:0:77218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18837 00000100:00100000:0.0:1651529419.739174:0:77218:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+306:41279:x1731746396803584:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.739486:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.739493:0:77223:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396803648 00002000:00100000:0.0:1651529419.739513:0:77223:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x100010000:0x2bbdd:0x0] (0->1048575) req@000000006929eb96 x1731746396803648/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.739520:0:77223:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006929eb96 with x1731746396803648 ext(0->1048575) 00002000:00010000:0.0:1651529419.739522:0:77223:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000006929eb96 00000100:00100000:0.0:1651529419.739528:0:77223:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18838 00000100:00100000:0.0:1651529419.739530:0:77223:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+308:41278:x1731746396803648:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.739850:0:77219:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+308:41279:x1731746396802816:12345-10.240.43.64@tcp:4:dd.0 Request processed in 5981us (6045us total) trans 12885080850 rc 0/0 00000100:00100000:0.0:1651529419.739853:0:77219:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18831 00002000:00100000:0.0:1651529419.739856:0:77219:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x100010000:0x2bbd6:0x0] (0->1048575) req@00000000ea0220b6 x1731746396802816/t12885080850(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.739860:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ea0220b6 with x1731746396802816 ext(0->1048575) 00002000:00010000:0.0:1651529419.739861:0:77219:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000ea0220b6 00000100:00100000:0.0:1651529419.740182:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.740190:0:77219:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396803712 00002000:00100000:0.0:1651529419.740197:0:77219:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x100010000:0x2bbde:0x0] (0->1048575) req@000000009ffb5d0a x1731746396803712/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.740201:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009ffb5d0a with x1731746396803712 ext(0->1048575) 00002000:00010000:0.0:1651529419.740202:0:77219:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000009ffb5d0a 00000100:00100000:0.0:1651529419.740207:0:77219:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18839 00000100:00100000:0.0:1651529419.740209:0:77219:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+308:41279:x1731746396803712:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.741509:0:77221:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+310:41279:x1731746396802880:12345-10.240.43.64@tcp:4:dd.0 Request processed in 7368us (7695us total) trans 12885080851 rc 0/0 00000100:00100000:0.0:1651529419.741513:0:77221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18832 00002000:00100000:0.0:1651529419.741515:0:77221:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x2bbd7:0x0] (0->1048575) req@000000002a957ba7 x1731746396802880/t12885080851(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.741543:0:77221:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002a957ba7 with x1731746396802880 ext(0->1048575) 00002000:00010000:0.0:1651529419.741545:0:77221:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000002a957ba7 00000100:00100000:0.0:1651529419.741606:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.741614:0:77221:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396804032 00002000:00100000:0.0:1651529419.741621:0:77221:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x2bb97:0x0] (0->1048575) req@000000005384a251 x1731746396804032/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.741625:0:77221:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005384a251 with x1731746396804032 ext(0->1048575) 00002000:00010000:0.0:1651529419.741626:0:77221:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000005384a251 00000100:00100000:0.0:1651529419.741631:0:77221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18840 00000100:00100000:0.0:1651529419.741633:0:77221:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+310:41279:x1731746396804032:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.742553:0:77222:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+312:41278:x1731746396803008:12345-10.240.43.64@tcp:4:dd.0 Request processed in 7938us (8031us total) trans 12885080852 rc 0/0 00000100:00100000:0.0:1651529419.742585:0:77222:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18833 00002000:00100000:0.0:1651529419.742588:0:77222:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x2bbd8:0x0] (0->1048575) req@0000000059363096 x1731746396803008/t12885080852(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.742592:0:77222:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000059363096 with x1731746396803008 ext(0->1048575) 00002000:00010000:0.0:1651529419.742593:0:77222:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000059363096 00000100:00100000:0.0:1651529419.743093:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.743103:0:77222:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396804096 00002000:00100000:0.0:1651529419.743121:0:77222:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x2bb92:0x0] (0->2097151) req@0000000075e1000f x1731746396804096/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.743125:0:77222:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000075e1000f with x1731746396804096 ext(0->2097151) 00002000:00010000:0.0:1651529419.743127:0:77222:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000075e1000f 00000100:00100000:0.0:1651529419.743133:0:77222:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18841 00000100:00100000:0.0:1651529419.743136:0:77222:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+314:41279:x1731746396804096:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.743553:0:77220:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+314:41278:x1731746396803072:12345-10.240.43.64@tcp:4:dd.0 Request processed in 8705us (9023us total) trans 12885080853 rc 0/0 00000100:00100000:0.0:1651529419.743556:0:77220:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18834 00002000:00100000:0.0:1651529419.743559:0:77220:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x2bb96:0x0] (0->1048575) req@0000000053ee5af1 x1731746396803072/t12885080853(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.743562:0:77220:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000053ee5af1 with x1731746396803072 ext(0->1048575) 00002000:00010000:0.0:1651529419.743564:0:77220:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000053ee5af1 00000100:00100000:0.0:1651529419.744336:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.744351:0:77220:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396804224 00002000:00100000:0.0:1651529419.744360:0:77220:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x2bb98:0x0] (0->1048575) req@000000005ea32140 x1731746396804224/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.744364:0:77220:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005ea32140 with x1731746396804224 ext(0->1048575) 00002000:00010000:0.0:1651529419.744365:0:77220:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000005ea32140 00000100:00100000:0.0:1651529419.744386:0:77220:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18842 00000100:00100000:0.0:1651529419.744388:0:77220:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ea32140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+316:41278:x1731746396804224:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.744624:0:72401:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+316:41279:x1731746396803136:12345-10.240.43.64@tcp:4:dd.0 Request processed in 9529us (10080us total) trans 12885080854 rc 0/0 00000100:00100000:0.0:1651529419.744628:0:72401:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18835 00002000:00100000:0.0:1651529419.744630:0:72401:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x100010000:0x2bbd9:0x0] (0->1048575) req@000000002c4168d4 x1731746396803136/t12885080854(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.744634:0:72401:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002c4168d4 with x1731746396803136 ext(0->1048575) 00002000:00010000:0.0:1651529419.744636:0:72401:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000002c4168d4 00000100:00100000:0.0:1651529419.745411:0:77217:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027c41311 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+316:41278:x1731746396803392:12345-10.240.43.64@tcp:4:dd.0 Request processed in 7554us (7759us total) trans 12885080855 rc 0/0 00000100:00100000:0.0:1651529419.745415:0:77217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18836 00002000:00100000:0.0:1651529419.745417:0:77217:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x100010000:0x2bbdb:0x0] (0->1048575) req@0000000027c41311 x1731746396803392/t12885080855(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.745421:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000027c41311 with x1731746396803392 ext(0->1048575) 00002000:00010000:0.0:1651529419.745423:0:77217:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000027c41311 00000100:00100000:0.0:1651529419.745538:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.745548:0:77217:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396804352 00002000:00100000:0.0:1651529419.745554:0:77217:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x100010000:0x2bbbd:0x0] (0->1048575) req@000000007fca8239 x1731746396804352/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.745558:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000007fca8239 with x1731746396804352 ext(0->1048575) 00002000:00010000:0.0:1651529419.745560:0:77217:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000007fca8239 00000100:00100000:0.0:1651529419.745565:0:77217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18843 00000100:00100000:0.0:1651529419.745567:0:77217:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007fca8239 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+316:41278:x1731746396804352:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.746320:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.746330:0:72401:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396804544 00002000:00100000:0.0:1651529419.746338:0:72401:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x100010000:0x2bb99:0x0] (0->1048575) req@000000003ab54056 x1731746396804544/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.746341:0:72401:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003ab54056 with x1731746396804544 ext(0->1048575) 00002000:00010000:0.0:1651529419.746343:0:72401:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000003ab54056 00000100:00100000:0.0:1651529419.746348:0:72401:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18844 00000100:00100000:0.0:1651529419.746350:0:72401:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003ab54056 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+320:41278:x1731746396804544:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.746533:0:77218:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078a40aa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+320:41279:x1731746396803584:12345-10.240.43.64@tcp:4:dd.0 Request processed in 7358us (7387us total) trans 12885080856 rc 0/0 00000100:00100000:0.0:1651529419.746539:0:77218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18837 00002000:00100000:0.0:1651529419.746541:0:77218:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x2bbdc:0x0] (0->1048575) req@0000000078a40aa9 x1731746396803584/t12885080856(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.746545:0:77218:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000078a40aa9 with x1731746396803584 ext(0->1048575) 00002000:00010000:0.0:1651529419.746546:0:77218:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000078a40aa9 00000100:00100000:0.0:1651529419.746678:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.746685:0:77218:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396804608 00002000:00100000:0.0:1651529419.746691:0:77218:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x2bb93:0x0] (0->2097151) req@000000000aa23cb4 x1731746396804608/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.746695:0:77218:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000aa23cb4 with x1731746396804608 ext(0->2097151) 00002000:00010000:0.0:1651529419.746697:0:77218:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000000aa23cb4 00000100:00100000:0.0:1651529419.746702:0:77218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18845 00000100:00100000:0.0:1651529419.746703:0:77218:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000aa23cb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+320:41279:x1731746396804608:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.747704:0:77223:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006929eb96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+322:41278:x1731746396803648:12345-10.240.43.64@tcp:4:dd.0 Request processed in 8173us (8218us total) trans 12885080857 rc 0/0 00000100:00100000:0.0:1651529419.747708:0:77223:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18838 00002000:00100000:0.0:1651529419.747711:0:77223:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x100010000:0x2bbdd:0x0] (0->1048575) req@000000006929eb96 x1731746396803648/t12885080857(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.747714:0:77223:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006929eb96 with x1731746396803648 ext(0->1048575) 00002000:00010000:0.0:1651529419.747716:0:77223:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000006929eb96 00000100:00100000:0.0:1651529419.748563:0:77219:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ffb5d0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+322:41279:x1731746396803712:12345-10.240.43.64@tcp:4:dd.0 Request processed in 8353us (8380us total) trans 12885080858 rc 0/0 00000100:00100000:0.0:1651529419.748567:0:77219:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18839 00002000:00100000:0.0:1651529419.748570:0:77219:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x100010000:0x2bbde:0x0] (0->1048575) req@000000009ffb5d0a x1731746396803712/t12885080858(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.748573:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009ffb5d0a with x1731746396803712 ext(0->1048575) 00002000:00010000:0.0:1651529419.748575:0:77219:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000009ffb5d0a 00000100:00100000:0.0:1651529419.748661:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.748669:0:77219:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396804736 00002000:00100000:0.0:1651529419.748676:0:77219:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x100010000:0x2bb9a:0x0] (0->1048575) req@00000000483535c3 x1731746396804736/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.748680:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000483535c3 with x1731746396804736 ext(0->1048575) 00002000:00010000:0.0:1651529419.748681:0:77219:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000483535c3 00000100:00100000:0.0:1651529419.748687:0:77219:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18846 00000100:00100000:0.0:1651529419.748689:0:77219:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000483535c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+322:41279:x1731746396804736:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.749191:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.749200:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.749208:0:72400:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396804864 00002000:00100000:0.0:1651529419.749215:0:72400:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x100010000:0x2bb90:0x0] (0->2097151) req@00000000f4c1ca2c x1731746396804864/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.749219:0:72400:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f4c1ca2c with x1731746396804864 ext(0->2097151) 00002000:00010000:0.0:1651529419.749220:0:72400:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f4c1ca2c 00000100:00100000:0.0:1651529419.749237:0:72400:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396804928 00002000:00100000:0.0:1651529419.749242:0:72400:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x100010000:0x2bbc7:0x0] (0->1048575) req@00000000f1c1ad2a x1731746396804928/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.749245:0:72400:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f1c1ad2a with x1731746396804928 ext(0->1048575) 00002000:00010000:0.0:1651529419.749246:0:72400:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f1c1ad2a 00000100:00100000:0.0:1651529419.749251:0:72400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18847 00000100:00100000:0.0:1651529419.749268:0:72400:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f4c1ca2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+327:41278:x1731746396804864:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.749660:0:76181:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18848 00000100:00100000:0.0:1651529419.749662:0:76181:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1c1ad2a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+328:41279:x1731746396804928:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.749903:0:77221:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005384a251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+328:41279:x1731746396804032:12345-10.240.43.64@tcp:4:dd.0 Request processed in 8269us (8297us total) trans 12885080859 rc 0/0 00000100:00100000:0.0:1651529419.749906:0:77221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18840 00002000:00100000:0.0:1651529419.749909:0:77221:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x2bb97:0x0] (0->1048575) req@000000005384a251 x1731746396804032/t12885080859(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.749912:0:77221:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005384a251 with x1731746396804032 ext(0->1048575) 00002000:00010000:0.0:1651529419.749914:0:77221:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000005384a251 00000100:00100000:0.0:1651529419.750918:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.750926:0:77221:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396804992 00002000:00100000:0.0:1651529419.750932:0:77221:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x2bb94:0x0] (0->2097151) req@00000000a664be5c x1731746396804992/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.750936:0:77221:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a664be5c with x1731746396804992 ext(0->2097151) 00002000:00010000:0.0:1651529419.750937:0:77221:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000a664be5c 00000100:00100000:0.0:1651529419.750943:0:77221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18849 00000100:00100000:0.0:1651529419.750945:0:77221:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a664be5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+328:41279:x1731746396804992:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.753285:0:77222:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000075e1000f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+332:41279:x1731746396804096:12345-10.240.43.64@tcp:4:dd.0 Request processed in 10148us (10191us total) trans 12885080860 rc 0/0 00000100:00100000:0.0:1651529419.753289:0:77222:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18841 00002000:00100000:0.0:1651529419.753292:0:77222:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x2bb92:0x0] (0->2097151) req@0000000075e1000f x1731746396804096/t12885080860(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.753300:0:77222:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000075e1000f with x1731746396804096 ext(0->2097151) 00002000:00010000:0.0:1651529419.753302:0:77222:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000075e1000f 00000100:00100000:0.0:1651529419.753718:0:77220:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ea32140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+332:41278:x1731746396804224:12345-10.240.43.64@tcp:4:dd.0 Request processed in 9328us (9382us total) trans 12885080861 rc 0/0 00000100:00100000:0.0:1651529419.753721:0:77220:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18842 00002000:00100000:0.0:1651529419.753724:0:77220:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x2bb98:0x0] (0->1048575) req@000000005ea32140 x1731746396804224/t12885080861(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.753727:0:77220:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005ea32140 with x1731746396804224 ext(0->1048575) 00002000:00010000:0.0:1651529419.753729:0:77220:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000005ea32140 00000100:00100000:0.0:1651529419.754282:0:77217:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007fca8239 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+330:41278:x1731746396804352:12345-10.240.43.64@tcp:4:dd.0 Request processed in 8714us (8744us total) trans 12885080862 rc 0/0 00000100:00100000:0.0:1651529419.754286:0:77217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18843 00002000:00100000:0.0:1651529419.754288:0:77217:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x100010000:0x2bbbd:0x0] (0->1048575) req@000000007fca8239 x1731746396804352/t12885080862(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.754292:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000007fca8239 with x1731746396804352 ext(0->1048575) 00002000:00010000:0.0:1651529419.754294:0:77217:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000007fca8239 00000100:00100000:0.0:1651529419.755242:0:72401:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003ab54056 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+330:41278:x1731746396804544:12345-10.240.43.64@tcp:4:dd.0 Request processed in 8891us (8922us total) trans 12885080863 rc 0/0 00000100:00100000:0.0:1651529419.755246:0:72401:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18844 00002000:00100000:0.0:1651529419.755249:0:72401:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x100010000:0x2bb99:0x0] (0->1048575) req@000000003ab54056 x1731746396804544/t12885080863(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.755253:0:72401:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003ab54056 with x1731746396804544 ext(0->1048575) 00002000:00010000:0.0:1651529419.755254:0:72401:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000003ab54056 00000100:00100000:0.0:1651529419.755629:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.755638:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.755654:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.755665:0:77220:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396805440 00002000:00100000:0.0:1651529419.755676:0:77220:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x2bb9c:0x0] (0->1048575) req@000000009526e5dd x1731746396805440/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.755680:0:77220:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009526e5dd with x1731746396805440 ext(0->1048575) 00002000:00010000:0.0:1651529419.755681:0:77220:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000009526e5dd 00000100:00100000:0.0:1651529419.755688:0:77220:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396805376 00002000:00100000:0.0:1651529419.755691:0:77220:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x2bbac:0x0] (0->1048575) req@000000001ecedc46 x1731746396805376/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.755694:0:77220:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001ecedc46 with x1731746396805376 ext(0->1048575) 00002000:00010000:0.0:1651529419.755696:0:77220:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000001ecedc46 00000100:00100000:0.0:1651529419.755699:0:77220:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396805504 00002000:00100000:0.0:1651529419.755702:0:77220:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x2bbad:0x0] (0->1048575) req@00000000f24790de x1731746396805504/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.755718:0:77220:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f24790de with x1731746396805504 ext(0->1048575) 00002000:00010000:0.0:1651529419.755719:0:77220:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f24790de 00000100:00100000:0.0:1651529419.755726:0:77220:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18850 00000100:00100000:0.0:1651529419.755728:0:77220:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009526e5dd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+334:41278:x1731746396805440:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.755952:0:77223:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18851 00000100:00100000:0.0:1651529419.755954:0:77223:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001ecedc46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+335:41278:x1731746396805376:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.756137:0:76182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18852 00000100:00100000:0.0:1651529419.756139:0:76182:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f24790de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+336:41279:x1731746396805504:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.756729:0:77218:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000aa23cb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+338:41279:x1731746396804608:12345-10.240.43.64@tcp:4:dd.0 Request processed in 10025us (10051us total) trans 12885080864 rc 0/0 00000100:00100000:0.0:1651529419.756733:0:77218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18845 00002000:00100000:0.0:1651529419.756736:0:77218:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x2bb93:0x0] (0->2097151) req@000000000aa23cb4 x1731746396804608/t12885080864(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.756740:0:77218:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000aa23cb4 with x1731746396804608 ext(0->2097151) 00002000:00010000:0.0:1651529419.756742:0:77218:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000000aa23cb4 00000100:00100000:1.0:1651529419.757216:0:77219:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000483535c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+338:41279:x1731746396804736:12345-10.240.43.64@tcp:4:dd.0 Request processed in 8524us (8553us total) trans 12885080865 rc 0/0 00000100:00100000:1.0:1651529419.757221:0:77219:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18846 00002000:00100000:1.0:1651529419.757235:0:77219:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x100010000:0x2bb9a:0x0] (0->1048575) req@00000000483535c3 x1731746396804736/t12885080865(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651529419.757240:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000483535c3 with x1731746396804736 ext(0->1048575) 00002000:00010000:1.0:1651529419.757242:0:77219:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000483535c3 00000100:00100000:0.0:1651529419.758540:0:72400:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f4c1ca2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+338:41278:x1731746396804864:12345-10.240.43.64@tcp:4:dd.0 Request processed in 9284us (9349us total) trans 12885080866 rc 0/0 00000100:00100000:0.0:1651529419.758544:0:72400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18847 00002000:00100000:0.0:1651529419.758547:0:72400:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x100010000:0x2bb90:0x0] (0->2097151) req@00000000f4c1ca2c x1731746396804864/t12885080866(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.758550:0:72400:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f4c1ca2c with x1731746396804864 ext(0->2097151) 00002000:00010000:0.0:1651529419.758552:0:72400:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f4c1ca2c 00000100:00100000:0.0:1651529419.759022:0:76181:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1c1ad2a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+336:41279:x1731746396804928:12345-10.240.43.64@tcp:4:dd.0 Request processed in 9358us (9821us total) trans 12885080867 rc 0/0 00000100:00100000:0.0:1651529419.759046:0:76181:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18848 00002000:00100000:0.0:1651529419.759049:0:76181:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2bbc7:0x0] (0->1048575) req@00000000f1c1ad2a x1731746396804928/t12885080867(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.759053:0:76181:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f1c1ad2a with x1731746396804928 ext(0->1048575) 00002000:00010000:0.0:1651529419.759054:0:76181:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f1c1ad2a 00000100:00100000:0.0:1651529419.759616:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.759626:0:76181:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396805696 00002000:00100000:0.0:1651529419.759636:0:76181:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2bb95:0x0] (0->2097151) req@000000002ba6820e x1731746396805696/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.759653:0:76181:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002ba6820e with x1731746396805696 ext(0->2097151) 00002000:00010000:0.0:1651529419.759654:0:76181:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000002ba6820e 00000100:00100000:0.0:1651529419.759661:0:76181:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18853 00000100:00100000:0.0:1651529419.759663:0:76181:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ba6820e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+336:41278:x1731746396805696:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.761277:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.761286:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.761299:0:72400:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396805760 00002000:00100000:0.0:1651529419.761308:0:72400:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x100010000:0x2bb9e:0x0] (0->1048575) req@00000000c94da484 x1731746396805760/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.761313:0:72400:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c94da484 with x1731746396805760 ext(0->1048575) 00002000:00010000:0.0:1651529419.761315:0:72400:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000c94da484 00000100:00100000:0.0:1651529419.761321:0:72400:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396805888 00002000:00100000:0.0:1651529419.761325:0:72400:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x100010000:0x2bb91:0x0] (0->2097151) req@00000000358a8cb7 x1731746396805888/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.761328:0:72400:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000358a8cb7 with x1731746396805888 ext(0->2097151) 00002000:00010000:0.0:1651529419.761329:0:72400:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000358a8cb7 00000100:00100000:0.0:1651529419.761336:0:72400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18854 00000100:00100000:0.0:1651529419.761338:0:72400:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c94da484 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+345:41279:x1731746396805760:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.761447:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.761556:0:77218:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396806016 00002000:00100000:0.0:1651529419.761563:0:77218:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x2bb9f:0x0] (0->1048575) req@00000000387e2651 x1731746396806016/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.761567:0:77218:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000387e2651 with x1731746396806016 ext(0->1048575) 00002000:00010000:0.0:1651529419.761568:0:77218:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000387e2651 00000100:00100000:0.0:1651529419.761631:0:77218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18855 00000100:00100000:0.0:1651529419.761633:0:77218:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000358a8cb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+347:41279:x1731746396805888:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.761682:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.762125:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396806080 00002000:00100000:0.0:1651529419.762132:0:72402:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2bbb3:0x0] (0->1048575) req@00000000919435f9 x1731746396806080/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.762136:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000919435f9 with x1731746396806080 ext(0->1048575) 00002000:00010000:0.0:1651529419.762137:0:72402:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000919435f9 00000100:00100000:0.0:1651529419.762141:0:72402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18856 00000100:00100000:0.0:1651529419.762143:0:72402:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000387e2651 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+349:41279:x1731746396806016:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.762616:0:77223:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001ecedc46 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+351:41278:x1731746396805376:12345-10.240.43.64@tcp:4:dd.0 Request processed in 6661us (6978us total) trans 12885080870 rc 0/0 00000100:00100000:0.0:1651529419.762620:0:77223:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18851 00002000:00100000:0.0:1651529419.762623:0:77223:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x100010000:0x2bbac:0x0] (0->1048575) req@000000001ecedc46 x1731746396805376/t12885080870(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.762627:0:77223:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001ecedc46 with x1731746396805376 ext(0->1048575) 00002000:00010000:0.0:1651529419.762629:0:77223:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000001ecedc46 00000100:00100000:0.0:1651529419.762635:0:77223:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18857 00000100:00100000:0.0:1651529419.762637:0:77223:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000919435f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+350:41278:x1731746396806080:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.762915:0:77220:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009526e5dd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+350:41278:x1731746396805440:12345-10.240.43.64@tcp:4:dd.0 Request processed in 7186us (7286us total) trans 12885080869 rc 0/0 00000100:00100000:0.0:1651529419.762919:0:77220:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18850 00002000:00100000:0.0:1651529419.762921:0:77220:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x2bb9c:0x0] (0->1048575) req@000000009526e5dd x1731746396805440/t12885080869(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.762928:0:77220:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009526e5dd with x1731746396805440 ext(0->1048575) 00002000:00010000:0.0:1651529419.762930:0:77220:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000009526e5dd 00000100:00100000:0.0:1651529419.762959:0:77221:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a664be5c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+348:41279:x1731746396804992:12345-10.240.43.64@tcp:4:dd.0 Request processed in 12013us (12042us total) trans 12885080868 rc 0/0 00000100:00100000:0.0:1651529419.762962:0:77221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18849 00002000:00100000:0.0:1651529419.762963:0:77221:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x2bb94:0x0] (0->2097151) req@00000000a664be5c x1731746396804992/t12885080868(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.762967:0:77221:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a664be5c with x1731746396804992 ext(0->2097151) 00002000:00010000:0.0:1651529419.762968:0:77221:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000a664be5c 00000100:00100000:0.0:1651529419.763165:0:76182:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f24790de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+346:41279:x1731746396805504:12345-10.240.43.64@tcp:4:dd.0 Request processed in 7025us (7511us total) trans 12885080871 rc 0/0 00000100:00100000:0.0:1651529419.763168:0:76182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18852 00002000:00100000:0.0:1651529419.763171:0:76182:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x2bbad:0x0] (0->1048575) req@00000000f24790de x1731746396805504/t12885080871(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.763174:0:76182:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f24790de with x1731746396805504 ext(0->1048575) 00002000:00010000:0.0:1651529419.763205:0:76182:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f24790de 00000100:00100000:0.0:1651529419.764846:0:76181:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ba6820e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+348:41278:x1731746396805696:12345-10.240.43.64@tcp:4:dd.0 Request processed in 5180us (5229us total) trans 12885080872 rc 0/0 00000100:00100000:0.0:1651529419.764849:0:76181:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18853 00002000:00100000:0.0:1651529419.764852:0:76181:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2bb95:0x0] (0->2097151) req@000000002ba6820e x1731746396805696/t12885080872(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.764856:0:76181:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002ba6820e with x1731746396805696 ext(0->2097151) 00002000:00010000:0.0:1651529419.764858:0:76181:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000002ba6820e 00000100:00100000:0.0:1651529419.765263:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.765272:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.765294:0:77219:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396806464 00002000:00100000:0.0:1651529419.765303:0:77219:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x100010000:0x2bb8f:0x0] (0->2097151) req@00000000224033fb x1731746396806464/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.765307:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000224033fb with x1731746396806464 ext(0->2097151) 00002000:00010000:0.0:1651529419.765309:0:77219:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000224033fb 00000100:00100000:0.0:1651529419.765314:0:77219:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396806272 00002000:00100000:0.0:1651529419.765317:0:77219:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x100010000:0x2bba0:0x0] (0->1048575) req@00000000301791d2 x1731746396806272/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.765320:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000301791d2 with x1731746396806272 ext(0->1048575) 00002000:00010000:0.0:1651529419.765321:0:77219:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000301791d2 00000100:00100000:0.0:1651529419.765325:0:77219:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18858 00000100:00100000:0.0:1651529419.765327:0:77219:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000224033fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+349:41278:x1731746396806464:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.765726:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.765743:0:77222:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396806400 00002000:00100000:0.0:1651529419.765750:0:77222:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x2bbb5:0x0] (0->1048575) req@0000000068d63c3c x1731746396806400/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.765754:0:77222:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000068d63c3c with x1731746396806400 ext(0->1048575) 00002000:00010000:0.0:1651529419.765755:0:77222:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000068d63c3c 00000100:00100000:0.0:1651529419.765761:0:77222:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18859 00000100:00100000:0.0:1651529419.765762:0:77222:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000301791d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+351:41279:x1731746396806272:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.765976:0:76182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18860 00000100:00100000:0.0:1651529419.765978:0:76182:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068d63c3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+352:41279:x1731746396806400:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.766179:0:72400:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c94da484 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+352:41279:x1731746396805760:12345-10.240.43.64@tcp:4:dd.0 Request processed in 4839us (4902us total) trans 12885080873 rc 0/0 00000100:00100000:0.0:1651529419.766182:0:72400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18854 00002000:00100000:0.0:1651529419.766185:0:72400:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x100010000:0x2bb9e:0x0] (0->1048575) req@00000000c94da484 x1731746396805760/t12885080873(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.766188:0:72400:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c94da484 with x1731746396805760 ext(0->1048575) 00002000:00010000:0.0:1651529419.766190:0:72400:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000c94da484 00000100:00100000:0.0:1651529419.766295:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.766323:0:72400:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396806528 00002000:00100000:0.0:1651529419.766330:0:72400:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x100010000:0x2bba1:0x0] (0->1048575) req@000000009fec919d x1731746396806528/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.766334:0:72400:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009fec919d with x1731746396806528 ext(0->1048575) 00002000:00010000:0.0:1651529419.766335:0:72400:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000009fec919d 00000100:00100000:0.0:1651529419.766340:0:72400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18861 00000100:00100000:0.0:1651529419.766342:0:72400:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009fec919d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+352:41279:x1731746396806528:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.766662:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.766670:0:76181:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396806592 00002000:00100000:0.0:1651529419.766676:0:76181:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2bba5:0x0] (0->1048575) req@0000000032c9ea04 x1731746396806592/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.766680:0:76181:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000032c9ea04 with x1731746396806592 ext(0->1048575) 00002000:00010000:0.0:1651529419.766681:0:76181:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000032c9ea04 00000100:00100000:0.0:1651529419.766686:0:76181:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18862 00000100:00100000:0.0:1651529419.766688:0:76181:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000032c9ea04 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+354:41278:x1731746396806592:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.768183:0:77218:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000358a8cb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+358:41279:x1731746396805888:12345-10.240.43.64@tcp:4:dd.0 Request processed in 6548us (6895us total) trans 12885080874 rc 0/0 00000100:00100000:0.0:1651529419.768245:0:77218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18855 00002000:00100000:0.0:1651529419.768249:0:77218:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x2bb91:0x0] (0->2097151) req@00000000358a8cb7 x1731746396805888/t12885080874(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.768252:0:77218:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000358a8cb7 with x1731746396805888 ext(0->2097151) 00002000:00010000:0.0:1651529419.768254:0:77218:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000358a8cb7 00000100:00100000:0.0:1651529419.768658:0:72402:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000387e2651 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+356:41279:x1731746396806016:12345-10.240.43.64@tcp:4:dd.0 Request processed in 6514us (7211us total) trans 12885080875 rc 0/0 00000100:00100000:0.0:1651529419.768688:0:72402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18856 00002000:00100000:0.0:1651529419.768691:0:72402:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2bb9f:0x0] (0->1048575) req@00000000387e2651 x1731746396806016/t12885080875(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.768694:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000387e2651 with x1731746396806016 ext(0->1048575) 00002000:00010000:0.0:1651529419.768696:0:72402:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000387e2651 00000100:00100000:0.0:1651529419.769978:0:77223:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000919435f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+356:41278:x1731746396806080:12345-10.240.43.64@tcp:4:dd.0 Request processed in 7339us (8295us total) trans 12885080876 rc 0/0 00000100:00100000:0.0:1651529419.769982:0:77223:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18857 00002000:00100000:0.0:1651529419.769984:0:77223:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x100010000:0x2bbb3:0x0] (0->1048575) req@00000000919435f9 x1731746396806080/t12885080876(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.770001:0:77223:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000919435f9 with x1731746396806080 ext(0->1048575) 00002000:00010000:0.0:1651529419.770003:0:77223:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000919435f9 00000100:00100000:0.0:1651529419.771018:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.771026:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.771036:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396807104 00002000:00100000:0.0:1651529419.771046:0:72402:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2bb9b:0x0] (0->1048575) req@00000000aef8b8e5 x1731746396807104/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.771054:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000aef8b8e5 with x1731746396807104 ext(0->1048575) 00002000:00010000:0.0:1651529419.771055:0:72402:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000aef8b8e5 00000100:00100000:0.0:1651529419.771061:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396807232 00002000:00100000:0.0:1651529419.771064:0:72402:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2bbaa:0x0] (0->1048575) req@00000000dd3d3fd1 x1731746396807232/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.771067:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000dd3d3fd1 with x1731746396807232 ext(0->1048575) 00002000:00010000:0.0:1651529419.771068:0:72402:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000dd3d3fd1 00000100:00100000:0.0:1651529419.771077:0:72402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18863 00000100:00100000:0.0:1651529419.771079:0:72402:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aef8b8e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+357:41278:x1731746396807104:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.771307:0:77223:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18864 00000100:00100000:0.0:1651529419.771309:0:77223:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd3d3fd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+358:41278:x1731746396807232:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.771570:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.771612:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.771632:0:77217:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396807040 00002000:00100000:0.0:1651529419.771639:0:77217:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x100010000:0x2bba7:0x0] (0->1048575) req@0000000080355561 x1731746396807040/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.771644:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000080355561 with x1731746396807040 ext(0->1048575) 00002000:00010000:0.0:1651529419.771645:0:77217:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000080355561 00000100:00100000:0.0:1651529419.771650:0:77217:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396807168 00002000:00100000:0.0:1651529419.771653:0:77217:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x100010000:0x2bbab:0x0] (0->1048575) req@0000000026c1d74d x1731746396807168/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.771657:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000026c1d74d with x1731746396807168 ext(0->1048575) 00002000:00010000:0.0:1651529419.771658:0:77217:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000026c1d74d 00000100:00100000:0.0:1651529419.771663:0:77217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18865 00000100:00100000:0.0:1651529419.771664:0:77217:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080355561 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+361:41278:x1731746396807040:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.772129:0:77220:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18866 00000100:00100000:0.0:1651529419.772132:0:77220:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000026c1d74d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+364:41278:x1731746396807168:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.773237:0:77219:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000224033fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+366:41278:x1731746396806464:12345-10.240.43.64@tcp:4:dd.0 Request processed in 7907us (7972us total) trans 12885080877 rc 0/0 00000100:00100000:0.0:1651529419.773241:0:77219:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18858 00002000:00100000:0.0:1651529419.773244:0:77219:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x100010000:0x2bb8f:0x0] (0->2097151) req@00000000224033fb x1731746396806464/t12885080877(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.773248:0:77219:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000224033fb with x1731746396806464 ext(0->2097151) 00002000:00010000:0.0:1651529419.773250:0:77219:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000224033fb 00000100:00100000:0.0:1651529419.773687:0:77222:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000301791d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+364:41279:x1731746396806272:12345-10.240.43.64@tcp:4:dd.0 Request processed in 7923us (8414us total) trans 12885080878 rc 0/0 00000100:00100000:0.0:1651529419.773690:0:77222:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18859 00002000:00100000:0.0:1651529419.773692:0:77222:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x2bba0:0x0] (0->1048575) req@00000000301791d2 x1731746396806272/t12885080878(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.773696:0:77222:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000301791d2 with x1731746396806272 ext(0->1048575) 00002000:00010000:0.0:1651529419.773698:0:77222:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000301791d2 00000100:00100000:0.0:1651529419.774561:0:76182:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068d63c3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+364:41279:x1731746396806400:12345-10.240.43.64@tcp:4:dd.0 Request processed in 8582us (8835us total) trans 12885080879 rc 0/0 00000100:00100000:0.0:1651529419.774565:0:76182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18860 00002000:00100000:0.0:1651529419.774568:0:76182:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x2bbb5:0x0] (0->1048575) req@0000000068d63c3c x1731746396806400/t12885080879(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.774608:0:76182:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000068d63c3c with x1731746396806400 ext(0->1048575) 00002000:00010000:0.0:1651529419.774610:0:76182:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000068d63c3c 00000100:00100000:0.0:1651529419.775002:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.775018:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.775037:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.775046:0:77222:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396807424 00002000:00100000:0.0:1651529419.775056:0:77222:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x2bbaf:0x0] (0->1048575) req@00000000301336fc x1731746396807424/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.775059:0:77222:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000301336fc with x1731746396807424 ext(0->1048575) 00002000:00010000:0.0:1651529419.775061:0:77222:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000301336fc 00000100:00100000:0.0:1651529419.775066:0:77222:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396807488 00002000:00100000:0.0:1651529419.775069:0:77222:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x2bbb1:0x0] (0->1048575) req@00000000da7fe637 x1731746396807488/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.775072:0:77222:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000da7fe637 with x1731746396807488 ext(0->1048575) 00002000:00010000:0.0:1651529419.775073:0:77222:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000da7fe637 00000100:00100000:0.0:1651529419.775076:0:77222:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396807552 00002000:00100000:0.0:1651529419.775079:0:77222:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x2bbb0:0x0] (0->1048575) req@00000000cbc31ea8 x1731746396807552/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.775082:0:77222:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000cbc31ea8 with x1731746396807552 ext(0->1048575) 00002000:00010000:0.0:1651529419.775083:0:77222:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000cbc31ea8 00000100:00100000:0.0:1651529419.775086:0:77222:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18867 00000100:00100000:0.0:1651529419.775087:0:77222:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000301336fc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+366:41279:x1731746396807424:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.775265:0:77221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18868 00000100:00100000:0.0:1651529419.775267:0:77221:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000da7fe637 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+367:41279:x1731746396807488:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651529419.775277:0:72401:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18869 00000100:00100000:1.0:1651529419.775280:0:72401:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cbc31ea8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+367:41278:x1731746396807552:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.776188:0:72400:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009fec919d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+370:41279:x1731746396806528:12345-10.240.43.64@tcp:4:dd.0 Request processed in 9845us (9893us total) trans 12885080880 rc 0/0 00000100:00100000:0.0:1651529419.776192:0:72400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18861 00002000:00100000:0.0:1651529419.776195:0:72400:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x100010000:0x2bba1:0x0] (0->1048575) req@000000009fec919d x1731746396806528/t12885080880(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.776198:0:72400:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009fec919d with x1731746396806528 ext(0->1048575) 00002000:00010000:0.0:1651529419.776200:0:72400:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000009fec919d 00000100:00100000:0.0:1651529419.777521:0:76181:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000032c9ea04 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+370:41278:x1731746396806592:12345-10.240.43.64@tcp:4:dd.0 Request processed in 10832us (10859us total) trans 12885080881 rc 0/0 00000100:00100000:0.0:1651529419.777525:0:76181:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18862 00002000:00100000:0.0:1651529419.777528:0:76181:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2bba5:0x0] (0->1048575) req@0000000032c9ea04 x1731746396806592/t12885080881(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.777531:0:76181:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000032c9ea04 with x1731746396806592 ext(0->1048575) 00002000:00010000:0.0:1651529419.777533:0:76181:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000032c9ea04 00000100:00100000:0.0:1651529419.778413:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.778422:0:76181:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396807744 00002000:00100000:0.0:1651529419.778442:0:76181:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2bba2:0x0] (0->1048575) req@000000003e6ccb0d x1731746396807744/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.778446:0:76181:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003e6ccb0d with x1731746396807744 ext(0->1048575) 00002000:00010000:0.0:1651529419.778447:0:76181:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000003e6ccb0d 00000100:00100000:0.0:1651529419.778454:0:76181:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18870 00000100:00100000:0.0:1651529419.778456:0:76181:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e6ccb0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+372:41279:x1731746396807744:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.779101:0:72402:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aef8b8e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+372:41278:x1731746396807104:12345-10.240.43.64@tcp:4:dd.0 Request processed in 8021us (8083us total) trans 12885080882 rc 0/0 00000100:00100000:0.0:1651529419.779106:0:72402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18863 00002000:00100000:0.0:1651529419.779109:0:72402:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2bb9b:0x0] (0->1048575) req@00000000aef8b8e5 x1731746396807104/t12885080882(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.779112:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000aef8b8e5 with x1731746396807104 ext(0->1048575) 00002000:00010000:0.0:1651529419.779114:0:72402:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000aef8b8e5 00000100:00100000:0.0:1651529419.779130:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.779157:0:72402:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396807872 00002000:00100000:0.0:1651529419.779164:0:72402:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2bb8e:0x0] (0->2097151) req@000000008c86ea6b x1731746396807872/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.779167:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000008c86ea6b with x1731746396807872 ext(0->2097151) 00002000:00010000:0.0:1651529419.779169:0:72402:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000008c86ea6b 00000100:00100000:0.0:1651529419.779174:0:72402:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18871 00000100:00100000:0.0:1651529419.779176:0:72402:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008c86ea6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+372:41278:x1731746396807872:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.780176:0:77223:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd3d3fd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+374:41278:x1731746396807232:12345-10.240.43.64@tcp:4:dd.0 Request processed in 8865us (9148us total) trans 12885080883 rc 0/0 00000100:00100000:0.0:1651529419.780180:0:77223:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18864 00002000:00100000:0.0:1651529419.780183:0:77223:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x100010000:0x2bbaa:0x0] (0->1048575) req@00000000dd3d3fd1 x1731746396807232/t12885080883(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.780186:0:77223:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000dd3d3fd1 with x1731746396807232 ext(0->1048575) 00002000:00010000:0.0:1651529419.780188:0:77223:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000dd3d3fd1 00000100:00100000:0.0:1651529419.780745:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.780753:0:77223:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396808000 00002000:00100000:0.0:1651529419.780760:0:77223:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x100010000:0x2bba8:0x0] (0->1048575) req@000000002c7da4dd x1731746396808000/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.780767:0:77223:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002c7da4dd with x1731746396808000 ext(0->1048575) 00002000:00010000:0.0:1651529419.780769:0:77223:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000002c7da4dd 00000100:00100000:0.0:1651529419.780785:0:77223:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18872 00000100:00100000:0.0:1651529419.780787:0:77223:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c7da4dd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+376:41278:x1731746396808000:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.781031:0:77217:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080355561 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+376:41278:x1731746396807040:12345-10.240.43.64@tcp:4:dd.0 Request processed in 9365us (9460us total) trans 12885080884 rc 0/0 00000100:00100000:0.0:1651529419.781034:0:77217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18865 00002000:00100000:0.0:1651529419.781037:0:77217:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x100010000:0x2bba7:0x0] (0->1048575) req@0000000080355561 x1731746396807040/t12885080884(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.781054:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000080355561 with x1731746396807040 ext(0->1048575) 00002000:00010000:0.0:1651529419.781055:0:77217:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000080355561 00000100:00100000:0.0:1651529419.781433:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.781441:0:72400:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396808128 00002000:00100000:0.0:1651529419.781449:0:72400:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x100010000:0x2bb9d:0x0] (0->1048575) req@000000001b3bb251 x1731746396808128/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.781453:0:72400:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001b3bb251 with x1731746396808128 ext(0->1048575) 00002000:00010000:0.0:1651529419.781454:0:72400:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000001b3bb251 00000100:00100000:0.0:1651529419.781459:0:72400:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18873 00000100:00100000:0.0:1651529419.781461:0:72400:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001b3bb251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+378:41279:x1731746396808128:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.781957:0:77220:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000026c1d74d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+378:41278:x1731746396807168:12345-10.240.43.64@tcp:4:dd.0 Request processed in 9824us (10344us total) trans 12885080885 rc 0/0 00000100:00100000:0.0:1651529419.781961:0:77220:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18866 00002000:00100000:0.0:1651529419.781963:0:77220:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x2bbab:0x0] (0->1048575) req@0000000026c1d74d x1731746396807168/t12885080885(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.781967:0:77220:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000026c1d74d with x1731746396807168 ext(0->1048575) 00002000:00010000:0.0:1651529419.781968:0:77220:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000026c1d74d 00000100:00100000:0.0:1651529419.783311:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.783320:0:77220:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396808256 00002000:00100000:0.0:1651529419.783327:0:77220:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x2bbb2:0x0] (0->1048575) req@0000000036255a7e x1731746396808256/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.783331:0:77220:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000036255a7e with x1731746396808256 ext(0->1048575) 00002000:00010000:0.0:1651529419.783333:0:77220:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000036255a7e 00000100:00100000:0.0:1651529419.783338:0:77220:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18874 00000100:00100000:0.0:1651529419.783340:0:77220:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000036255a7e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+380:41279:x1731746396808256:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.783557:0:77222:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000301336fc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+380:41279:x1731746396807424:12345-10.240.43.64@tcp:4:dd.0 Request processed in 8468us (8555us total) trans 12885080886 rc 0/0 00000100:00100000:0.0:1651529419.783560:0:77222:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18867 00002000:00100000:0.0:1651529419.783563:0:77222:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x2bbaf:0x0] (0->1048575) req@00000000301336fc x1731746396807424/t12885080886(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.783566:0:77222:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000301336fc with x1731746396807424 ext(0->1048575) 00002000:00010000:0.0:1651529419.783568:0:77222:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000301336fc 00000100:00100000:0.0:1651529419.783689:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.783698:0:77222:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396808384 00002000:00100000:0.0:1651529419.783705:0:77222:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x2bbb4:0x0] (0->1048575) req@0000000091d23b68 x1731746396808384/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.783708:0:77222:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000091d23b68 with x1731746396808384 ext(0->1048575) 00002000:00010000:0.0:1651529419.783710:0:77222:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000091d23b68 00000100:00100000:0.0:1651529419.783715:0:77222:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18875 00000100:00100000:0.0:1651529419.783717:0:77222:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091d23b68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+380:41278:x1731746396808384:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.784724:0:77221:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000da7fe637 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+382:41279:x1731746396807488:12345-10.240.43.64@tcp:4:dd.0 Request processed in 9455us (9705us total) trans 12885080887 rc 0/0 00000100:00100000:0.0:1651529419.784728:0:77221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18868 00002000:00100000:0.0:1651529419.784731:0:77221:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x2bbb1:0x0] (0->1048575) req@00000000da7fe637 x1731746396807488/t12885080887(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.784734:0:77221:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000da7fe637 with x1731746396807488 ext(0->1048575) 00002000:00010000:0.0:1651529419.784736:0:77221:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000da7fe637 00000100:00100000:0.0:1651529419.784817:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.784824:0:77221:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396808448 00002000:00100000:0.0:1651529419.784831:0:77221:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x2bba6:0x0] (0->1048575) req@0000000020f0e0b5 x1731746396808448/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.784835:0:77221:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000020f0e0b5 with x1731746396808448 ext(0->1048575) 00002000:00010000:0.0:1651529419.784836:0:77221:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000020f0e0b5 00000100:00100000:0.0:1651529419.784841:0:77221:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18876 00000100:00100000:0.0:1651529419.784843:0:77221:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000020f0e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+382:41279:x1731746396808448:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.785737:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.785745:0:77217:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396808512 00002000:00100000:0.0:1651529419.785752:0:77217:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x100010000:0x2bbae:0x0] (0->1048575) req@0000000051722b91 x1731746396808512/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.785756:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000051722b91 with x1731746396808512 ext(0->1048575) 00002000:00010000:0.0:1651529419.785757:0:77217:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000051722b91 00000100:00100000:0.0:1651529419.785763:0:77217:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18877 00000100:00100000:0.0:1651529419.785765:0:77217:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051722b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+384:41279:x1731746396808512:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.787278:0:72401:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cbc31ea8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+388:41278:x1731746396807552:12345-10.240.43.64@tcp:4:dd.0 Request processed in 11997us (12251us total) trans 12885080888 rc 0/0 00000100:00100000:0.0:1651529419.787282:0:72401:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18869 00002000:00100000:0.0:1651529419.787285:0:72401:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x100010000:0x2bbb0:0x0] (0->1048575) req@00000000cbc31ea8 x1731746396807552/t12885080888(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.787289:0:72401:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000cbc31ea8 with x1731746396807552 ext(0->1048575) 00002000:00010000:0.0:1651529419.787291:0:72401:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000cbc31ea8 00000100:00100000:0.0:1651529419.787453:0:76181:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e6ccb0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+386:41279:x1731746396807744:12345-10.240.43.64@tcp:4:dd.0 Request processed in 8996us (9040us total) trans 12885080889 rc 0/0 00000100:00100000:0.0:1651529419.787456:0:76181:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18870 00002000:00100000:0.0:1651529419.787458:0:76181:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2bba2:0x0] (0->1048575) req@000000003e6ccb0d x1731746396807744/t12885080889(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.787462:0:76181:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003e6ccb0d with x1731746396807744 ext(0->1048575) 00002000:00010000:0.0:1651529419.787463:0:76181:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000003e6ccb0d 00000100:00100000:0.0:1651529419.788374:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.788383:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.788389:0:72401:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396808640 00002000:00100000:0.0:1651529419.788397:0:72401:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x100010000:0x2bbce:0x0] (0->1048575) req@000000000c84c6c8 x1731746396808640/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.788400:0:72401:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000c84c6c8 with x1731746396808640 ext(0->1048575) 00002000:00010000:0.0:1651529419.788402:0:72401:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000000c84c6c8 00000100:00100000:0.0:1651529419.788406:0:72401:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396808576 00002000:00100000:0.0:1651529419.788409:0:72401:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x100010000:0x2bba3:0x0] (0->1048575) req@00000000dd71124e x1731746396808576/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.788416:0:72401:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000dd71124e with x1731746396808576 ext(0->1048575) 00002000:00010000:0.0:1651529419.788417:0:72401:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000dd71124e 00000100:00100000:0.0:1651529419.788421:0:72401:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18878 00000100:00100000:0.0:1651529419.788423:0:72401:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000c84c6c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+387:41278:x1731746396808640:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.788588:0:76182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18879 00000100:00100000:0.0:1651529419.788590:0:76182:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd71124e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+388:41278:x1731746396808576:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.788806:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.789039:0:76181:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396808704 00002000:00100000:0.0:1651529419.789046:0:76181:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2bbda:0x0] (0->1048575) req@00000000471073f9 x1731746396808704/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/0 e 0 to 0 dl 1651529425 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651529419.789050:0:76181:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000471073f9 with x1731746396808704 ext(0->1048575) 00002000:00010000:0.0:1651529419.789052:0:76181:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000471073f9 00000100:00100000:0.0:1651529419.789057:0:76181:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18880 00000100:00100000:0.0:1651529419.789059:0:76181:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000471073f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:41279:x1731746396808704:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651529419.790828:0:72402:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008c86ea6b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+394:41278:x1731746396807872:12345-10.240.43.64@tcp:4:dd.0 Request processed in 11650us (11696us total) trans 12885080890 rc 0/0 00000100:00100000:0.0:1651529419.790832:0:72402:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18871 00002000:00100000:0.0:1651529419.790835:0:72402:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2bb8e:0x0] (0->2097151) req@000000008c86ea6b x1731746396807872/t12885080890(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.790839:0:72402:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000008c86ea6b with x1731746396807872 ext(0->2097151) 00002000:00010000:0.0:1651529419.790841:0:72402:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000008c86ea6b 00000100:00100000:0.0:1651529419.791686:0:77223:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c7da4dd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+394:41278:x1731746396808000:12345-10.240.43.64@tcp:4:dd.0 Request processed in 10897us (10941us total) trans 12885080891 rc 0/0 00000100:00100000:0.0:1651529419.791692:0:77223:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18872 00002000:00100000:0.0:1651529419.791745:0:77223:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x100010000:0x2bba8:0x0] (0->1048575) req@000000002c7da4dd x1731746396808000/t12885080891(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.791750:0:77223:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002c7da4dd with x1731746396808000 ext(0->1048575) 00002000:00010000:0.0:1651529419.791752:0:77223:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000002c7da4dd 00000100:00100000:0.0:1651529419.792460:0:72400:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001b3bb251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:41279:x1731746396808128:12345-10.240.43.64@tcp:4:dd.0 Request processed in 10997us (11026us total) trans 12885080892 rc 0/0 00000100:00100000:0.0:1651529419.792463:0:72400:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18873 00002000:00100000:0.0:1651529419.792466:0:72400:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x100010000:0x2bb9d:0x0] (0->1048575) req@000000001b3bb251 x1731746396808128/t12885080892(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.792470:0:72400:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001b3bb251 with x1731746396808128 ext(0->1048575) 00002000:00010000:0.0:1651529419.792472:0:72400:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000001b3bb251 00000100:00100000:0.0:1651529419.793671:0:77220:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000036255a7e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:41279:x1731746396808256:12345-10.240.43.64@tcp:4:dd.0 Request processed in 10330us (10361us total) trans 12885080893 rc 0/0 00000100:00100000:0.0:1651529419.793675:0:77220:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18874 00002000:00100000:0.0:1651529419.793678:0:77220:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x2bbb2:0x0] (0->1048575) req@0000000036255a7e x1731746396808256/t12885080893(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.793682:0:77220:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000036255a7e with x1731746396808256 ext(0->1048575) 00002000:00010000:0.0:1651529419.793691:0:77220:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000036255a7e 00000100:00100000:0.0:1651529419.794842:0:77222:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091d23b68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+394:41278:x1731746396808384:12345-10.240.43.64@tcp:4:dd.0 Request processed in 11124us (11152us total) trans 12885080894 rc 0/0 00000100:00100000:0.0:1651529419.794857:0:77222:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18875 00002000:00100000:0.0:1651529419.794860:0:77222:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x2bbb4:0x0] (0->1048575) req@0000000091d23b68 x1731746396808384/t12885080894(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.794867:0:77222:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000091d23b68 with x1731746396808384 ext(0->1048575) 00002000:00010000:0.0:1651529419.794869:0:77222:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000091d23b68 00000100:00100000:0.0:1651529419.795745:0:77221:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000020f0e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:41279:x1731746396808448:12345-10.240.43.64@tcp:4:dd.0 Request processed in 10901us (10928us total) trans 12885080895 rc 0/0 00000100:00100000:0.0:1651529419.795748:0:77221:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18876 00002000:00100000:0.0:1651529419.795751:0:77221:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x2bba6:0x0] (0->1048575) req@0000000020f0e0b5 x1731746396808448/t12885080895(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.795755:0:77221:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000020f0e0b5 with x1731746396808448 ext(0->1048575) 00002000:00010000:0.0:1651529419.795756:0:77221:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000020f0e0b5 00000100:00100000:0.0:1651529419.796886:0:77217:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051722b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+394:41279:x1731746396808512:12345-10.240.43.64@tcp:4:dd.0 Request processed in 11119us (11149us total) trans 12885080896 rc 0/0 00000100:00100000:0.0:1651529419.796890:0:77217:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18877 00002000:00100000:0.0:1651529419.796893:0:77217:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x100010000:0x2bbae:0x0] (0->1048575) req@0000000051722b91 x1731746396808512/t12885080896(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.796897:0:77217:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000051722b91 with x1731746396808512 ext(0->1048575) 00002000:00010000:0.0:1651529419.796898:0:77217:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000051722b91 00000100:00100000:0.0:1651529419.797593:0:72401:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000c84c6c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:41278:x1731746396808640:12345-10.240.43.64@tcp:4:dd.0 Request processed in 9169us (9219us total) trans 12885080897 rc 0/0 00000100:00100000:0.0:1651529419.797597:0:72401:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18878 00002000:00100000:0.0:1651529419.797599:0:72401:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x100010000:0x2bbce:0x0] (0->1048575) req@000000000c84c6c8 x1731746396808640/t12885080897(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.797603:0:72401:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000c84c6c8 with x1731746396808640 ext(0->1048575) 00002000:00010000:0.0:1651529419.797605:0:72401:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000000c84c6c8 00000100:00100000:0.0:1651529419.798740:0:76182:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd71124e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+394:41278:x1731746396808576:12345-10.240.43.64@tcp:4:dd.0 Request processed in 10148us (10356us total) trans 12885080898 rc 0/0 00000100:00100000:0.0:1651529419.798743:0:76182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18879 00002000:00100000:0.0:1651529419.798746:0:76182:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x2bba3:0x0] (0->1048575) req@00000000dd71124e x1731746396808576/t12885080898(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.798749:0:76182:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000dd71124e with x1731746396808576 ext(0->1048575) 00002000:00010000:0.0:1651529419.798750:0:76182:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000dd71124e 00000100:00100000:0.0:1651529419.799795:0:76181:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000471073f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:41279:x1731746396808704:12345-10.240.43.64@tcp:4:dd.0 Request processed in 10734us (10989us total) trans 12885080899 rc 0/0 00000100:00100000:0.0:1651529419.799798:0:76181:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18880 00002000:00100000:0.0:1651529419.799801:0:76181:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2bbda:0x0] (0->1048575) req@00000000471073f9 x1731746396808704/t12885080899(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:145/0 lens 488/448 e 0 to 0 dl 1651529425 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651529419.799804:0:76181:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000471073f9 with x1731746396808704 ext(0->1048575) 00002000:00010000:0.0:1651529419.799806:0:76181:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000471073f9 00000100:00100000:0.0:1651529419.925891:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.925905:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396809152 00000100:00100000:0.0:1651529419.925923:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212798 00000100:00100000:0.0:1651529419.925926:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000123250a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396809152:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.925959:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000123250a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396809152:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 33us (70us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.925962:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212798 00000100:00100000:0.0:1651529419.926538:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.926547:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396809280 00000100:00100000:0.0:1651529419.926559:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212799 00000100:00100000:0.0:1651529419.926561:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396809280:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.926582:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396809280:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 21us (44us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.926585:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212799 00000100:00100000:0.0:1651529419.927102:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.927110:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396809408 00000100:00100000:0.0:1651529419.927122:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212800 00000100:00100000:0.0:1651529419.927124:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396809408:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.927145:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396809408:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 20us (43us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.927148:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212800 00000100:00100000:0.0:1651529419.927578:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.927586:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396809536 00000100:00100000:0.0:1651529419.927597:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212801 00000100:00100000:0.0:1651529419.927599:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396809536:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.927621:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396809536:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 21us (43us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.927624:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212801 00000100:00100000:0.0:1651529419.928076:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.928084:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396809664 00000100:00100000:0.0:1651529419.928096:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212802 00000100:00100000:0.0:1651529419.928098:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040ea0b53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396809664:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.928119:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040ea0b53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396809664:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 20us (44us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.928122:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212802 00000100:00100000:0.0:1651529419.928534:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.928542:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396809792 00000100:00100000:0.0:1651529419.928553:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212803 00000100:00100000:0.0:1651529419.928555:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396809792:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.928575:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396809792:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (41us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.928578:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212803 00000100:00100000:0.0:1651529419.929021:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.929028:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396809920 00000100:00100000:0.0:1651529419.929040:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212804 00000100:00100000:0.0:1651529419.929041:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396809920:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.929062:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396809920:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 20us (42us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.929065:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212804 00000100:00100000:0.0:1651529419.929469:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.929476:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396810048 00000100:00100000:0.0:1651529419.929488:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212805 00000100:00100000:0.0:1651529419.929489:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396810048:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.929510:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396810048:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (41us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.929512:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212805 00000100:00100000:0.0:1651529419.929940:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.929948:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396810176 00000100:00100000:0.0:1651529419.929960:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212806 00000100:00100000:0.0:1651529419.929962:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d1151437 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396810176:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.929983:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d1151437 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396810176:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 21us (43us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.929986:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212806 00000100:00100000:0.0:1651529419.930386:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.930393:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396810304 00000100:00100000:0.0:1651529419.930405:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212807 00000100:00100000:0.0:1651529419.930406:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396810304:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.930426:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396810304:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (41us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.930429:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212807 00000100:00100000:0.0:1651529419.930860:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.930867:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396810432 00000100:00100000:0.0:1651529419.930878:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212808 00000100:00100000:0.0:1651529419.930880:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396810432:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.930900:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396810432:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (40us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.930902:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212808 00000100:00100000:0.0:1651529419.931314:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.931321:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396810560 00000100:00100000:0.0:1651529419.931332:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212809 00000100:00100000:0.0:1651529419.931334:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396810560:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.931353:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396810560:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (40us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.931356:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212809 00000100:00100000:0.0:1651529419.931805:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.931813:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396810688 00000100:00100000:0.0:1651529419.931825:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212810 00000100:00100000:0.0:1651529419.931826:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000024fae69e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396810688:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.931846:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000024fae69e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396810688:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (41us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.931849:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212810 00000100:00100000:0.0:1651529419.932256:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.932264:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396810816 00000100:00100000:0.0:1651529419.932275:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212811 00000100:00100000:0.0:1651529419.932277:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396810816:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.932296:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396810816:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (41us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.932299:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212811 00000100:00100000:0.0:1651529419.932706:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.932714:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396810944 00000100:00100000:0.0:1651529419.932725:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212812 00000100:00100000:0.0:1651529419.932727:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396810944:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.932746:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396810944:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (40us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.932749:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212812 00000100:00100000:0.0:1651529419.933169:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.933177:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396811072 00000100:00100000:0.0:1651529419.933188:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212813 00000100:00100000:0.0:1651529419.933190:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396811072:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.933211:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396811072:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 20us (42us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.933214:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212813 00000100:00100000:0.0:1651529419.933631:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.933638:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396811200 00000100:00100000:0.0:1651529419.933650:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212814 00000100:00100000:0.0:1651529419.933652:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000083ef9200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396811200:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.933671:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000083ef9200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396811200:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (41us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.933674:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212814 00000100:00100000:0.0:1651529419.934098:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.934106:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396811328 00000100:00100000:0.0:1651529419.934117:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212815 00000100:00100000:0.0:1651529419.934119:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396811328:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.934138:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396811328:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (40us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.934141:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212815 00000100:00100000:0.0:1651529419.934565:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.934572:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396811456 00000100:00100000:0.0:1651529419.934584:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212816 00000100:00100000:0.0:1651529419.934586:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396811456:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.934606:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396811456:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (41us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.934608:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212816 00000100:00100000:0.0:1651529419.934771:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.934788:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396811520 00000100:00100000:0.0:1651529419.934801:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212817 00000100:00100000:0.0:1651529419.934803:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396811520:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.934822:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396811520:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (52us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.934825:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212817 00000100:00100000:0.0:1651529419.935248:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.935256:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396811648 00000100:00100000:0.0:1651529419.935268:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212818 00000100:00100000:0.0:1651529419.935270:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d88281f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396811648:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.935290:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d88281f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396811648:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (42us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.935293:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212818 00000100:00100000:0.0:1651529419.935694:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.935701:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396811776 00000100:00100000:0.0:1651529419.935712:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212819 00000100:00100000:0.0:1651529419.935714:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396811776:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.935733:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396811776:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (40us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.935736:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212819 00000100:00100000:0.0:1651529419.936151:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.936158:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396811904 00000100:00100000:0.0:1651529419.936169:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212820 00000100:00100000:0.0:1651529419.936171:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396811904:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.936191:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396811904:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 20us (41us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.936194:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212820 00000100:00100000:0.0:1651529419.936606:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.936613:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396812032 00000100:00100000:0.0:1651529419.936624:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212821 00000100:00100000:0.0:1651529419.936626:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396812032:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.936646:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396812032:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (40us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.936649:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212821 00000100:00100000:0.0:1651529419.937133:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.937142:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396812160 00000100:00100000:0.0:1651529419.937154:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212822 00000100:00100000:0.0:1651529419.937155:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f0d488f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396812160:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.937173:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f0d488f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396812160:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 17us (40us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.937176:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212822 00000100:00100000:0.0:1651529419.937592:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.937599:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396812288 00000100:00100000:0.0:1651529419.937611:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212823 00000100:00100000:0.0:1651529419.937613:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396812288:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.937633:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396812288:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (42us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.937636:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212823 00000100:00100000:0.0:1651529419.938077:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.938084:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396812416 00000100:00100000:0.0:1651529419.938096:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212824 00000100:00100000:0.0:1651529419.938097:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396812416:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.938117:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396812416:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (40us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.938120:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212824 00000100:00100000:0.0:1651529419.938535:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.938542:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396812544 00000100:00100000:0.0:1651529419.938554:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212825 00000100:00100000:0.0:1651529419.938556:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396812544:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.938575:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396812544:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (41us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.938578:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212825 00000100:00100000:0.0:1651529419.939007:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.939015:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396812672 00000100:00100000:0.0:1651529419.939027:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212826 00000100:00100000:0.0:1651529419.939028:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059df4489 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396812672:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.939048:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059df4489 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396812672:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (41us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.939051:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212826 00000100:00100000:0.0:1651529419.939450:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.939457:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396812800 00000100:00100000:0.0:1651529419.939469:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212827 00000100:00100000:0.0:1651529419.939471:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396812800:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.939492:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396812800:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 20us (42us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.939495:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212827 00000100:00100000:0.0:1651529419.939895:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.939902:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396812928 00000100:00100000:0.0:1651529419.939914:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212828 00000100:00100000:0.0:1651529419.939915:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396812928:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.939935:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396812928:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (40us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.939938:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212828 00000100:00100000:0.0:1651529419.940345:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.940352:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396813056 00000100:00100000:0.0:1651529419.940364:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212829 00000100:00100000:0.0:1651529419.940365:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396813056:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.940385:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396813056:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (41us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.940388:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212829 00000100:00100000:0.0:1651529419.940789:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.940797:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396813184 00000100:00100000:0.0:1651529419.940809:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212830 00000100:00100000:0.0:1651529419.940810:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000607f68ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396813184:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.940830:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000607f68ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396813184:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (42us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.940833:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212830 00000100:00100000:0.0:1651529419.941235:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.941245:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396813312 00000100:00100000:0.0:1651529419.941256:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212831 00000100:00100000:0.0:1651529419.941258:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396813312:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.941278:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396813312:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (56us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.941281:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212831 00000100:00100000:0.0:1651529419.941662:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.941669:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396813440 00000100:00100000:0.0:1651529419.941681:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212832 00000100:00100000:0.0:1651529419.941682:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396813440:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.941702:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396813440:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (41us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.941705:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212832 00000100:00100000:0.0:1651529419.942143:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.942150:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396813568 00000100:00100000:0.0:1651529419.942162:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212833 00000100:00100000:0.0:1651529419.942163:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396813568:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.942183:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396813568:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (40us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.942185:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212833 00000100:00100000:0.0:1651529419.942607:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.942616:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396813696 00000100:00100000:0.0:1651529419.942628:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212834 00000100:00100000:0.0:1651529419.942629:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000683df145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396813696:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.942651:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000683df145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396813696:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 20us (44us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.942654:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212834 00000100:00100000:0.0:1651529419.943069:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.943077:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396813824 00000100:00100000:0.0:1651529419.943088:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212835 00000100:00100000:0.0:1651529419.943090:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396813824:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.943110:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396813824:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (41us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.943113:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212835 00000100:00100000:0.0:1651529419.943510:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.943517:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396813952 00000100:00100000:0.0:1651529419.943528:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212836 00000100:00100000:0.0:1651529419.943530:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396813952:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.943549:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396813952:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (40us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.943552:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212836 00000100:00100000:0.0:1651529419.943992:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.944000:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396814080 00000100:00100000:0.0:1651529419.944011:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212837 00000100:00100000:0.0:1651529419.944013:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396814080:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.944032:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396814080:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (41us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.944035:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212837 00000100:00100000:0.0:1651529419.944436:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.944444:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396814208 00000100:00100000:0.0:1651529419.944455:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212838 00000100:00100000:0.0:1651529419.944457:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b71ab49a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396814208:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.944477:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b71ab49a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396814208:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (41us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.944480:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212838 00000100:00100000:0.0:1651529419.944875:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.944882:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396814336 00000100:00100000:0.0:1651529419.944894:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212839 00000100:00100000:0.0:1651529419.944895:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396814336:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.944915:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396814336:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (40us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.944918:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212839 00000100:00100000:0.0:1651529419.945315:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.945322:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396814464 00000100:00100000:0.0:1651529419.945333:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212840 00000100:00100000:0.0:1651529419.945335:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396814464:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.945355:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396814464:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (40us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.945357:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212840 00000100:00100000:0.0:1651529419.945754:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.945761:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396814592 00000100:00100000:0.0:1651529419.945778:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212841 00000100:00100000:0.0:1651529419.945780:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396814592:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.945802:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396814592:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 20us (48us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.945804:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212841 00000100:00100000:0.0:1651529419.946238:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.946246:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396814720 00000100:00100000:0.0:1651529419.946257:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212842 00000100:00100000:0.0:1651529419.946259:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc8a938e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396814720:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.946279:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc8a938e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396814720:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (42us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.946282:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212842 00000100:00100000:0.0:1651529419.946686:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.946693:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396814848 00000100:00100000:0.0:1651529419.946705:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212843 00000100:00100000:0.0:1651529419.946706:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396814848:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.946725:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396814848:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (40us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.946728:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212843 00000100:00100000:0.0:1651529419.947138:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.947146:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396814976 00000100:00100000:0.0:1651529419.947157:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212844 00000100:00100000:0.0:1651529419.947158:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396814976:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.947178:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396814976:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (40us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.947180:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212844 00000100:00100000:0.0:1651529419.947589:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.947596:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396815104 00000100:00100000:0.0:1651529419.947607:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212845 00000100:00100000:0.0:1651529419.947609:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396815104:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.947629:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396815104:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (40us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.947631:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212845 00000100:00100000:0.0:1651529419.948057:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.948065:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396815232 00000100:00100000:0.0:1651529419.948077:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212846 00000100:00100000:0.0:1651529419.948078:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006a20fa64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396815232:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.948098:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006a20fa64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396815232:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (42us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.948101:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212846 00000100:00100000:0.0:1651529419.948504:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.948511:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396815360 00000100:00100000:0.0:1651529419.948522:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212847 00000100:00100000:0.0:1651529419.948524:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396815360:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.948543:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396815360:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (40us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.948546:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212847 00000100:00100000:0.0:1651529419.948968:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.948975:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396815488 00000100:00100000:0.0:1651529419.948987:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212848 00000100:00100000:0.0:1651529419.948988:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396815488:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.949009:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396815488:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 20us (41us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.949012:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212848 00000100:00100000:0.0:1651529419.949418:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.949425:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396815616 00000100:00100000:0.0:1651529419.949436:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212849 00000100:00100000:0.0:1651529419.949438:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396815616:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.949458:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396815616:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (40us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.949461:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212849 00000100:00100000:0.0:1651529419.949883:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.949891:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396815744 00000100:00100000:0.0:1651529419.949903:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212850 00000100:00100000:0.0:1651529419.949904:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de69fa5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396815744:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.949924:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de69fa5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396815744:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (41us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.949926:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212850 00000100:00100000:0.0:1651529419.950327:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.950334:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396815872 00000100:00100000:0.0:1651529419.950346:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212851 00000100:00100000:0.0:1651529419.950347:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396815872:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.950367:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396815872:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (40us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.950370:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212851 00000100:00100000:0.0:1651529419.950762:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.950769:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396816000 00000100:00100000:0.0:1651529419.950789:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212852 00000100:00100000:0.0:1651529419.950791:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396816000:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.950810:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396816000:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (48us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.950813:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212852 00000100:00100000:0.0:1651529419.951239:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.951247:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396816128 00000100:00100000:0.0:1651529419.951258:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212853 00000100:00100000:0.0:1651529419.951260:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396816128:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.951280:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396816128:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (41us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.951283:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212853 00000100:00100000:0.0:1651529419.951685:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.951692:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396816256 00000100:00100000:0.0:1651529419.951704:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212854 00000100:00100000:0.0:1651529419.951706:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000e07233e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396816256:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.951726:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000e07233e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396816256:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (41us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.951728:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212854 00000100:00100000:0.0:1651529419.952135:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.952142:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396816384 00000100:00100000:0.0:1651529419.952154:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212855 00000100:00100000:0.0:1651529419.952155:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396816384:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.952176:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396816384:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (41us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.952179:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212855 00000100:00100000:0.0:1651529419.952572:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.952580:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396816512 00000100:00100000:0.0:1651529419.952591:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212856 00000100:00100000:0.0:1651529419.952592:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396816512:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.952612:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396816512:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (40us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.952615:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212856 00000100:00100000:0.0:1651529419.953040:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.953047:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396816640 00000100:00100000:0.0:1651529419.953058:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212857 00000100:00100000:0.0:1651529419.953060:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396816640:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.953080:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396816640:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (40us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.953083:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212857 00000100:00100000:0.0:1651529419.953495:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.953503:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396816768 00000100:00100000:0.0:1651529419.953515:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212858 00000100:00100000:0.0:1651529419.953516:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000020f79bc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396816768:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.953536:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000020f79bc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396816768:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (41us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.953539:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212858 00000100:00100000:0.0:1651529419.953951:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.953958:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396816896 00000100:00100000:0.0:1651529419.953969:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212859 00000100:00100000:0.0:1651529419.953971:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396816896:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.953990:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396816896:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (40us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.953993:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212859 00000100:00100000:0.0:1651529419.954387:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.954394:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396817024 00000100:00100000:0.0:1651529419.954405:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212860 00000100:00100000:0.0:1651529419.954407:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396817024:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.954426:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396817024:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (40us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.954429:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212860 00000100:00100000:0.0:1651529419.954857:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.954864:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396817152 00000100:00100000:0.0:1651529419.954876:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212861 00000100:00100000:0.0:1651529419.954878:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396817152:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.954897:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396817152:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (41us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.954900:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212861 00000100:00100000:0.0:1651529419.955306:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.955314:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396817280 00000100:00100000:0.0:1651529419.955326:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212862 00000100:00100000:0.0:1651529419.955328:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000073710b61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396817280:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.955348:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000073710b61 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396817280:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 20us (42us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.955351:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212862 00000100:00100000:0.0:1651529419.955751:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.955759:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396817408 00000100:00100000:0.0:1651529419.955770:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212863 00000100:00100000:0.0:1651529419.955778:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396817408:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.955798:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396817408:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 26us (47us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.955801:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212863 00000100:00100000:0.0:1651529419.956199:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.956206:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396817536 00000100:00100000:0.0:1651529419.956217:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212864 00000100:00100000:0.0:1651529419.956219:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396817536:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.956251:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396817536:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 31us (52us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.956254:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212864 00000100:00100000:0.0:1651529419.956422:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.956429:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396817600 00000100:00100000:0.0:1651529419.956439:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212865 00000100:00100000:0.0:1651529419.956440:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396817600:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.956460:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396817600:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (38us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.956463:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212865 00000100:00100000:0.0:1651529419.956634:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.956642:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396817664 00000100:00100000:0.0:1651529419.956652:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212866 00000100:00100000:0.0:1651529419.956653:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ada533bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396817664:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.956673:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ada533bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396817664:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (39us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.956676:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212866 00000100:00100000:0.0:1651529419.956858:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.956865:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396817728 00000100:00100000:0.0:1651529419.956874:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212867 00000100:00100000:0.0:1651529419.956876:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396817728:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.956895:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396817728:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (38us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.956898:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212867 00000100:00100000:0.0:1651529419.957059:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.957066:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396817792 00000100:00100000:0.0:1651529419.957075:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212868 00000100:00100000:0.0:1651529419.957076:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396817792:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.957095:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396817792:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (37us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.957098:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212868 00000100:00100000:0.0:1651529419.957252:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.957259:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396817856 00000100:00100000:0.0:1651529419.957268:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212869 00000100:00100000:0.0:1651529419.957270:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396817856:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.957290:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396817856:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 20us (38us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.957293:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212869 00000100:00100000:0.0:1651529419.957456:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.957463:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396817920 00000100:00100000:0.0:1651529419.957472:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212870 00000100:00100000:0.0:1651529419.957474:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e578d0c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396817920:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.957493:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e578d0c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396817920:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (38us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.957496:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212870 00000100:00100000:0.0:1651529419.957652:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.957659:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396817984 00000100:00100000:0.0:1651529419.957668:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212871 00000100:00100000:0.0:1651529419.957670:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396817984:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.957689:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396817984:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (37us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.957692:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212871 00000100:00100000:0.0:1651529419.957856:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.957864:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396818048 00000100:00100000:0.0:1651529419.957873:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212872 00000100:00100000:0.0:1651529419.957874:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396818048:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.957894:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396818048:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (38us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.957897:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212872 00000100:00100000:0.0:1651529419.958051:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.958058:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396818112 00000100:00100000:0.0:1651529419.958067:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212873 00000100:00100000:0.0:1651529419.958069:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396818112:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.958088:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396818112:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (37us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.958091:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212873 00000100:00100000:0.0:1651529419.958259:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.958267:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396818176 00000100:00100000:0.0:1651529419.958276:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212874 00000100:00100000:0.0:1651529419.958278:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f3433a83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396818176:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.958297:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f3433a83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396818176:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (39us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.958300:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212874 00000100:00100000:0.0:1651529419.958453:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.958460:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396818240 00000100:00100000:0.0:1651529419.958469:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212875 00000100:00100000:0.0:1651529419.958471:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396818240:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.958490:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396818240:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (37us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.958493:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212875 00000100:00100000:0.0:1651529419.958644:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.958651:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396818304 00000100:00100000:0.0:1651529419.958660:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212876 00000100:00100000:0.0:1651529419.958661:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396818304:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.958681:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396818304:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (38us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.958684:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212876 00000100:00100000:0.0:1651529419.958876:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.958884:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396818368 00000100:00100000:0.0:1651529419.958893:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212877 00000100:00100000:0.0:1651529419.958895:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396818368:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.958915:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396818368:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (39us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.958918:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212877 00000100:00100000:0.0:1651529419.959093:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.959101:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396818432 00000100:00100000:0.0:1651529419.959110:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212878 00000100:00100000:0.0:1651529419.959111:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000021fdd79f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396818432:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.959131:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000021fdd79f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396818432:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (39us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.959134:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212878 00000100:00100000:0.0:1651529419.959294:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.959302:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396818496 00000100:00100000:0.0:1651529419.959310:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212879 00000100:00100000:0.0:1651529419.959312:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396818496:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.959331:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396818496:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (38us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.959334:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212879 00000100:00100000:0.0:1651529419.959484:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.959491:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396818560 00000100:00100000:0.0:1651529419.959500:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212880 00000100:00100000:0.0:1651529419.959501:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396818560:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.959520:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396818560:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (37us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.959523:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212880 00000100:00100000:0.0:1651529419.959671:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.959678:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396818624 00000100:00100000:0.0:1651529419.959687:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212881 00000100:00100000:0.0:1651529419.959688:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396818624:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.959708:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396818624:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (37us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.959711:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212881 00000100:00100000:0.0:1651529419.960157:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.960166:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396818752 00000100:00100000:0.0:1651529419.960178:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212882 00000100:00100000:0.0:1651529419.960179:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d5e5262 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396818752:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.960199:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d5e5262 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396818752:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (42us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.960202:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212882 00000100:00100000:0.0:1651529419.960607:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.960614:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396818880 00000100:00100000:0.0:1651529419.960626:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212883 00000100:00100000:0.0:1651529419.960628:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396818880:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.960648:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396818880:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 20us (42us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.960651:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212883 00000100:00100000:0.0:1651529419.961079:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.961087:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396819008 00000100:00100000:0.0:1651529419.961098:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212884 00000100:00100000:0.0:1651529419.961099:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396819008:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.961118:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396819008:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (40us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.961121:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212884 00000100:00100000:0.0:1651529419.961521:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.961528:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396819136 00000100:00100000:0.0:1651529419.961540:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212885 00000100:00100000:0.0:1651529419.961541:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396819136:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.961560:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396819136:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 18us (40us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.961563:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212885 00000100:00100000:0.0:1651529419.962002:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.962010:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396819264 00000100:00100000:0.0:1651529419.962022:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212886 00000100:00100000:0.0:1651529419.962023:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050a0adb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396819264:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.962043:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050a0adb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396819264:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (42us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.962046:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212886 00000100:00100000:0.0:1651529419.962440:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.962448:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396819392 00000100:00100000:0.0:1651529419.962459:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212887 00000100:00100000:0.0:1651529419.962461:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396819392:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.962480:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396819392:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (40us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.962483:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212887 00000100:00100000:0.0:1651529419.962888:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.962896:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396819520 00000100:00100000:0.0:1651529419.962907:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212888 00000100:00100000:0.0:1651529419.962909:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396819520:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.962928:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396819520:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (41us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.962931:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212888 00000100:00100000:0.0:1651529419.963332:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529419.963339:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396819648 00000100:00100000:0.0:1651529419.963351:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212889 00000100:00100000:0.0:1651529419.963352:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396819648:12345-10.240.43.64@tcp:7:filefrag.0 00000100:00100000:0.0:1651529419.963372:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:425326:x1731746396819648:12345-10.240.43.64@tcp:7:filefrag.0 Request processed in 19us (40us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529419.963375:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212889 00000100:00100000:0.0:1651529420.000167:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529420.000198:0:87247:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946599744 00000100:00100000:1.0:1651529420.000217:0:87247:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 583 00000100:00100000:1.0:1651529420.000219:0:87247:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000f756e73 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946599744:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651529420.000237:0:87247:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 10706944 granted 476227776 pending 117276672 free 81309687808 avail 77138976768 00000100:00100000:1.0:1651529420.000255:0:87247:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000f756e73 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946599744:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 35us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529420.000258:0:87247:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 583 00000400:00000080:1.0:1651529422.474339:0:160629:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651529422.474342:0:160629:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 131a: test iov's crossing stripe boundary for writev/readv ========================================================== 22:10:20 (1651529420) 00000100:00100000:0.0:1651529423.350369:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529423.350388:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946600384 00000100:00100000:0.0:1651529423.350412:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212890 00000100:00100000:0.0:1651529423.350415:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004de851bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946600384:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529423.350431:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179076 count 1 00010000:00010000:0.0:1651529423.350445:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9068d9c/0x3234de053c53640 lrc: 3/0,1 mode: --/PW res: [0x2bb84:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.350455:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c533c3 lrc: 2/0,0 mode: PW/PW res: [0x2bb84:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc256 expref: 391 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.350460:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.350461:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529423.350462:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9068d9c/0x3234de053c53640 lrc: 4/0,1 mode: --/PW res: [0x2bb84:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.350476:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c533c3 lrc: 3/0,0 mode: PW/PW res: [0x2bb84:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc256 expref: 391 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.350481:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c533c3 lrc: 4/0,0 mode: PW/PW res: [0x2bb84:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc256 expref: 391 pid: 151609 timeout: 20182 lvb_type: 0 00000100:00100000:0.0:1651529423.350487:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000946e402f pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997071616:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529423.350518:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 000000006f708c4c going to sleep for 6 seconds 00000100:00100000:0.0:1651529423.351048:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000946e402f pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997071616:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529423.351055:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d9068d9c/0x3234de053c53640 lrc: 3/0,1 mode: --/PW res: [0x2bb84:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.351160:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.352243:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396820800 00010000:00010000:0.0:1651529423.352252:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c533c3 lrc: 4/0,0 mode: PW/PW res: [0x2bb84:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc256 expref: 392 pid: 151609 timeout: 20182 lvb_type: 0 00000100:00100000:0.0:1651529423.352265:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13352 00000100:00100000:0.0:1651529423.352267:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000946e402f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:41278:x1731746396820800:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529423.352271:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529423.352273:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c533c3 lrc: 4/0,0 mode: PW/PW res: [0x2bb84:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc256 expref: 392 pid: 151609 timeout: 20182 lvb_type: 0 00010000:00010000:0.0:1651529423.352277:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c533c3 lrc: 3/0,0 mode: PW/PW res: [0x2bb84:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc256 expref: 392 pid: 151609 timeout: 20182 lvb_type: 0 00010000:00010000:0.0:1651529423.352288:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c533c3 lrc: 0/0,0 mode: --/PW res: [0x2bb84:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc256 expref: 392 pid: 151609 timeout: 20182 lvb_type: 0 00010000:00010000:0.0:1651529423.352292:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.352293:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.352294:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d9068d9c/0x3234de053c53640 lrc: 3/0,1 mode: PW/PW res: [0x2bb84:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.352298:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9068d9c/0x3234de053c53640 lrc: 4/0,1 mode: PW/PW res: [0x2bb84:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.352306:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529423.352317:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000946e402f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+391:41278:x1731746396820800:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 49us (1157us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529423.352320:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13352 00010000:00010000:0.0:1651529423.352349:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d9068d9c/0x3234de053c53640 lrc: 3/0,1 mode: PW/PW res: [0x2bb84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.352354:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9068d9c/0x3234de053c53640 lrc: 3/0,1 mode: PW/PW res: [0x2bb84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.352358:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9068d9c/0x3234de053c53640 lrc: 3/0,1 mode: PW/PW res: [0x2bb84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.352361:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9068d9c/0x3234de053c53640 lrc: 2/0,0 mode: PW/PW res: [0x2bb84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529423.352636:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004de851bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946600384:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 2220us (2269us total) trans 12885080900 rc 0/0 00000100:00100000:0.0:1651529423.352640:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212890 00010000:00010000:0.0:1651529423.352648:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9068d9c/0x3234de053c53640 lrc: 2/0,0 mode: PW/PW res: [0x2bb84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.352652:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d9068d9c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529423.352653:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9068d9c/0x3234de053c53640 lrc: 2/0,0 mode: PW/PW res: [0x2bb84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.352657:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9068d9c/0x3234de053c53640 lrc: 3/0,0 mode: PW/PW res: [0x2bb84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.352662:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9068d9c/0x3234de053c53640 lrc: 1/0,0 mode: --/PW res: [0x2bb84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.352665:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9068d9c/0x3234de053c53640 lrc: 0/0,0 mode: --/PW res: [0x2bb84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000400:00000080:0.0:1651529423.787047:0:160847:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651529423.787049:0:160847:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 131b: test append writev ================== 22:10:23 (1651529423) 00000100:00100000:0.0:1651529423.808961:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.808978:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396825664 00000100:00100000:0.0:1651529423.808996:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212891 00000100:00100000:0.0:1651529423.808999:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000041d3f4d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+391:426507:x1731746396825664:12345-10.240.43.64@tcp:101:rwv.0 00010000:00010000:0.0:1651529423.809008:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529423.809018:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9068d9c/0x3234de053c53647 lrc: 2/0,0 mode: --/PW res: [0x2bbdf:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc703 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529423.809029:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbdf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529423.809039:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.809040:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529423.809044:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9068d9c/0x3234de053c53647 lrc: 3/0,0 mode: PW/PW res: [0x2bbdf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc703 expref: 392 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.809051:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d9068d9c/0x3234de053c53647 lrc: 3/0,0 mode: PW/PW res: [0x2bbdf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc703 expref: 392 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529423.809056:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9068d9c, rc 0) 00000100:00100000:0.0:1651529423.809078:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000041d3f4d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:426507:x1731746396825664:12345-10.240.43.64@tcp:101:rwv.0 Request processed in 79us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529423.809081:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212891 00000100:00100000:0.0:1651529423.841428:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529423.841438:0:76181:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396826240 00002000:00100000:0.0:1651529423.841450:0:76181:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2bbdf:0x0] (0->4194303) req@00000000fd6d3f0c x1731746396826240/t0(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:149/0 lens 488/0 e 0 to 0 dl 1651529429 ref 1 fl New:/0/ffffffff rc 0/-1 job:'rwv.0' 00002000:00100000:0.0:1651529423.841455:0:76181:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000fd6d3f0c with x1731746396826240 ext(0->4194303) 00002000:00010000:0.0:1651529423.841458:0:76181:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000fd6d3f0c 00000100:00100000:0.0:1651529423.841465:0:76181:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18881 00000100:00100000:0.0:1651529423.841467:0:76181:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fd6d3f0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+392:41279:x1731746396826240:12345-10.240.43.64@tcp:4:rwv.0 00000100:00100000:0.0:1651529423.849627:0:76181:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fd6d3f0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+394:41279:x1731746396826240:12345-10.240.43.64@tcp:4:rwv.0 Request processed in 8156us (8196us total) trans 12885080901 rc 0/0 00000100:00100000:0.0:1651529423.849634:0:76181:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18881 00002000:00100000:0.0:1651529423.849641:0:76181:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2bbdf:0x0] (0->4194303) req@00000000fd6d3f0c x1731746396826240/t12885080901(0) o4->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:149/0 lens 488/448 e 0 to 0 dl 1651529429 ref 1 fl Complete:/0/0 rc 0/0 job:'rwv.0' 00002000:00100000:0.0:1651529423.849646:0:76181:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000fd6d3f0c with x1731746396826240 ext(0->4194303) 00002000:00010000:0.0:1651529423.849649:0:76181:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000fd6d3f0c 00000001:00080000:0.0:1651529424.042301:0:72382:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 12885080901 is committed 00000001:00080000:0.0:1651529424.042309:0:72382:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 12885080900 is committed 00000400:00000080:1.0:1651529425.108287:0:161065:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651529425.108289:0:161065:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 131c: test read/write on file w/o objects ========================================================== 22:10:24 (1651529424) 00000100:00100000:0.0:1651529425.121959:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529425.123117:0:87247:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946604736 00000100:00100000:1.0:1651529425.123141:0:87247:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 584 00000100:00100000:1.0:1651529425.123144:0:87247:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946604736:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651529425.123158:0:87247:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 831488 granted 354732224 pending 0 free 81196965888 avail 76904759296 00000100:00100000:1.0:1651529425.123187:0:87247:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946604736:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 42us (1231us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529425.123191:0:87247:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 584 00000400:00000080:0.0:1651529426.387531:0:161283:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651529426.387534:0:161283:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 131d: test short read ===================== 22:10:26 (1651529426) 00000100:00100000:0.0:1651529427.138262:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529427.138280:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396827712 00000100:00100000:0.0:1651529427.138299:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 93 00000100:00100000:0.0:1651529427.138302:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+101:41278:x1731746396827712:12345-10.240.43.64@tcp:400:kworker/u4:1.0 00000100:00100000:0.0:1651529427.138332:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+101:41278:x1731746396827712:12345-10.240.43.64@tcp:400:kworker/u4:1.0 Request processed in 29us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529427.138335:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 93 00000400:00000080:1.0:1651529427.693498:0:161501:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651529427.693500:0:161501:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 131e: test read hitting hole ============== 22:10:27 (1651529427) 00000100:00100000:0.0:1651529427.720218:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529427.720247:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396827904 00000100:00100000:0.0:1651529427.720267:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212892 00000100:00100000:0.0:1651529427.720270:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+101:428279:x1731746396827904:12345-10.240.43.64@tcp:101:rwv.0 00010000:00010000:0.0:1651529427.720280:0:151609:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529427.720292:0:151609:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9aa8039/0x3234de053c5364e lrc: 2/0,0 mode: --/PW res: [0x2bbe0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x525ca385bf2dc750 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529427.720303:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbe0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529427.720313:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.720314:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.720319:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9aa8039/0x3234de053c5364e lrc: 3/0,0 mode: PW/PW res: [0x2bbe0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc750 expref: 102 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.720327:0:151609:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f9aa8039/0x3234de053c5364e lrc: 3/0,0 mode: PW/PW res: [0x2bbe0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc750 expref: 102 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.720333:0:151609:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f9aa8039, rc 0) 00000100:00100000:0.0:1651529427.720355:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+102:428279:x1731746396827904:12345-10.240.43.64@tcp:101:rwv.0 Request processed in 85us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529427.720358:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212892 00000100:00100000:0.0:1651529427.729072:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529427.729082:0:76181:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396828288 00002000:00100000:0.0:1651529427.729093:0:76181:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2bbe0:0x0] (0->524287) req@00000000dfef64e7 x1731746396828288/t0(0) o3->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:153/0 lens 488/0 e 0 to 0 dl 1651529433 ref 1 fl New:/0/ffffffff rc 0/-1 job:'rwv.0' 00002000:00100000:0.0:1651529427.729099:0:76181:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000dfef64e7 with x1731746396828288 ext(0->524287) 00002000:00010000:0.0:1651529427.729101:0:76181:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000dfef64e7 00000100:00100000:0.0:1651529427.729107:0:76181:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18882 00000100:00100000:0.0:1651529427.729110:0:76181:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+102:41278:x1731746396828288:12345-10.240.43.64@tcp:3:rwv.0 00000100:00100000:0.0:1651529427.729371:0:76181:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+102:41278:x1731746396828288:12345-10.240.43.64@tcp:3:rwv.0 Request processed in 260us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529427.729375:0:76181:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18882 00002000:00100000:0.0:1651529427.729377:0:76181:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2bbe0:0x0] (0->524287) req@00000000dfef64e7 x1731746396828288/t0(0) o3->a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp:153/0 lens 488/440 e 0 to 0 dl 1651529433 ref 1 fl Complete:/0/0 rc 0/0 job:'rwv.0' 00002000:00100000:0.0:1651529427.729381:0:76181:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000dfef64e7 with x1731746396828288 ext(0->524287) 00002000:00010000:0.0:1651529427.729383:0:76181:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000dfef64e7 00000100:00100000:0.0:1651529427.748382:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529427.748392:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529427.748398:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529427.748405:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529427.748412:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529427.748420:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529427.748426:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529427.748435:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529427.748443:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946604928 00000100:00100000:0.0:1651529427.748451:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946604992 00000100:00100000:0.0:1651529427.748455:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946605120 00000100:00100000:0.0:1651529427.748459:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946605056 00000100:00100000:0.0:1651529427.748462:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946605248 00000100:00100000:0.0:1651529427.748465:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946605184 00000100:00100000:0.0:1651529427.748467:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946605312 00000100:00100000:0.0:1651529427.748469:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946605376 00000100:00100000:0.0:1651529427.748473:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212893 00000100:00100000:0.0:1651529427.748475:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cb9f189a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946604928:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529427.748481:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179077 count 1 00010000:00010000:0.0:1651529427.748489:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b3021fe/0x3234de053c53655 lrc: 3/0,1 mode: --/PW res: [0x2bb85:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.748495:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c533ca lrc: 2/0,0 mode: PW/PW res: [0x2bb85:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc264 expref: 101 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.748499:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.748500:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.748501:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b3021fe/0x3234de053c53655 lrc: 4/0,1 mode: --/PW res: [0x2bb85:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.748513:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c533ca lrc: 3/0,0 mode: PW/PW res: [0x2bb85:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc264 expref: 101 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.748518:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c533ca lrc: 4/0,0 mode: PW/PW res: [0x2bb85:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc264 expref: 101 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.748524:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006e3eb319 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997071680:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529427.748542:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d5bb72eb going to sleep for 6 seconds 00000100:00100000:0.0:1651529427.748549:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212894 00000100:00100000:0.0:1651529427.748551:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745946604992:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529427.748556:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179078 count 1 00010000:00010000:0.0:1651529427.748560:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d62533f8/0x3234de053c5365c lrc: 3/0,1 mode: --/PW res: [0x2bb86:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.748564:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c533d1 lrc: 2/0,0 mode: PW/PW res: [0x2bb86:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc272 expref: 101 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.748570:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.748571:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.748572:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d62533f8/0x3234de053c5365c lrc: 4/0,1 mode: --/PW res: [0x2bb86:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.748578:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c533d1 lrc: 3/0,0 mode: PW/PW res: [0x2bb86:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc272 expref: 101 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.748581:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c533d1 lrc: 4/0,0 mode: PW/PW res: [0x2bb86:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc272 expref: 101 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.748585:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000075b025a pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997071744:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529427.748594:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000006ea0e913 going to sleep for 6 seconds 00000100:00100000:0.0:1651529427.748600:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212895 00000100:00100000:0.0:1651529427.748602:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745946605120:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529427.748607:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179080 count 1 00010000:00010000:0.0:1651529427.748610:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051c4eca7/0x3234de053c53663 lrc: 3/0,1 mode: --/PW res: [0x2bb88:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.748614:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c533df lrc: 2/0,0 mode: PW/PW res: [0x2bb88:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc28e expref: 101 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.748617:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.748618:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.748618:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051c4eca7/0x3234de053c53663 lrc: 4/0,1 mode: --/PW res: [0x2bb88:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.748628:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c533df lrc: 3/0,0 mode: PW/PW res: [0x2bb88:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc28e expref: 101 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.748631:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c533df lrc: 4/0,0 mode: PW/PW res: [0x2bb88:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc28e expref: 101 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.748635:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ad6d0877 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997071808:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529427.748642:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 0000000075259221 going to sleep for 6 seconds 00000100:00100000:0.0:1651529427.748648:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212896 00000100:00100000:0.0:1651529427.748650:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946605056:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529427.748654:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179079 count 1 00010000:00010000:0.0:1651529427.748657:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae9ffb85/0x3234de053c5366a lrc: 3/0,1 mode: --/PW res: [0x2bb87:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.748662:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c533d8 lrc: 2/0,0 mode: PW/PW res: [0x2bb87:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc280 expref: 101 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.748665:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.748665:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.748666:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae9ffb85/0x3234de053c5366a lrc: 4/0,1 mode: --/PW res: [0x2bb87:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.748672:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c533d8 lrc: 3/0,0 mode: PW/PW res: [0x2bb87:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc280 expref: 101 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.748675:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c533d8 lrc: 4/0,0 mode: PW/PW res: [0x2bb87:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc280 expref: 101 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.748680:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000043b7984f pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997071872:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529427.748686:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ecd79db8 going to sleep for 6 seconds 00000100:00100000:0.0:1651529427.748692:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212897 00000100:00100000:0.0:1651529427.748694:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745946605248:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529427.748699:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179082 count 1 00010000:00010000:0.0:1651529427.748702:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a2c192e/0x3234de053c53671 lrc: 3/0,1 mode: --/PW res: [0x2bb8a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.748706:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c533ed lrc: 2/0,0 mode: PW/PW res: [0x2bb8a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2aa expref: 101 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.748709:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.748709:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.748710:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a2c192e/0x3234de053c53671 lrc: 4/0,1 mode: --/PW res: [0x2bb8a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.748716:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c533ed lrc: 3/0,0 mode: PW/PW res: [0x2bb8a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2aa expref: 101 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.748720:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c533ed lrc: 4/0,0 mode: PW/PW res: [0x2bb8a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2aa expref: 101 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.748724:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001d1586f2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997071936:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529427.748730:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 0000000080004f0a going to sleep for 6 seconds 00000100:00100000:0.0:1651529427.748736:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212898 00000100:00100000:0.0:1651529427.748738:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946605184:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529427.748743:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179081 count 1 00010000:00010000:0.0:1651529427.748746:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000603760a0/0x3234de053c53678 lrc: 3/0,1 mode: --/PW res: [0x2bb89:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.748750:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c533e6 lrc: 2/0,0 mode: PW/PW res: [0x2bb89:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc29c expref: 101 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.748753:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.748753:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.748754:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000603760a0/0x3234de053c53678 lrc: 4/0,1 mode: --/PW res: [0x2bb89:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.748760:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c533e6 lrc: 3/0,0 mode: PW/PW res: [0x2bb89:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc29c expref: 101 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.748764:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c533e6 lrc: 4/0,0 mode: PW/PW res: [0x2bb89:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc29c expref: 101 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.748767:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002f77bb41 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997072000:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529427.748774:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 0000000048c640d6 going to sleep for 6 seconds 00000100:00100000:0.0:1651529427.748792:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212899 00000100:00100000:0.0:1651529427.748793:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946605312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529427.748799:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179083 count 1 00010000:00010000:0.0:1651529427.748802:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdf46c33/0x3234de053c5367f lrc: 3/0,1 mode: --/PW res: [0x2bb8b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.748809:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c533f4 lrc: 2/0,0 mode: PW/PW res: [0x2bb8b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2b8 expref: 101 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.748812:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.748813:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.748813:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdf46c33/0x3234de053c5367f lrc: 4/0,1 mode: --/PW res: [0x2bb8b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.748820:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c533f4 lrc: 3/0,0 mode: PW/PW res: [0x2bb8b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2b8 expref: 101 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.748823:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c533f4 lrc: 4/0,0 mode: PW/PW res: [0x2bb8b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2b8 expref: 101 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.748827:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005d3fb3ef pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997072064:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529427.748834:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd260f25 going to sleep for 6 seconds 00000100:00100000:0.0:1651529427.748840:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212900 00000100:00100000:0.0:1651529427.748842:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745946605376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529427.748847:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179084 count 1 00010000:00010000:0.0:1651529427.748850:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006819ac74/0x3234de053c53686 lrc: 3/0,1 mode: --/PW res: [0x2bb8c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.748854:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c533fb lrc: 2/0,0 mode: PW/PW res: [0x2bb8c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2c6 expref: 101 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.748857:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.748858:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.748859:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006819ac74/0x3234de053c53686 lrc: 4/0,1 mode: --/PW res: [0x2bb8c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.748865:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c533fb lrc: 3/0,0 mode: PW/PW res: [0x2bb8c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2c6 expref: 101 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.748868:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c533fb lrc: 4/0,0 mode: PW/PW res: [0x2bb8c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2c6 expref: 101 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.748872:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002f363f4a pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997072128:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529427.748879:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 000000004f7d2665 going to sleep for 6 seconds 00000100:00100000:0.0:1651529427.749169:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529427.749188:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006e3eb319 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997071680:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.749194:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003b3021fe/0x3234de053c53655 lrc: 3/0,1 mode: --/PW res: [0x2bb85:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.749196:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396828736 00010000:00010000:1.0:1651529427.749207:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c533ca lrc: 4/0,0 mode: PW/PW res: [0x2bb85:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc264 expref: 102 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.749234:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13353 00000100:00100000:0.0:1651529427.749236:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+102:41279:x1731746396828736:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529427.749241:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529427.749243:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c533ca lrc: 4/0,0 mode: PW/PW res: [0x2bb85:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc264 expref: 102 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.749247:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c533ca lrc: 3/0,0 mode: PW/PW res: [0x2bb85:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc264 expref: 102 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.749255:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e44ce9d/0x3234de053c533ca lrc: 0/0,0 mode: --/PW res: [0x2bb85:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc264 expref: 102 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.749259:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.749259:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.749260:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003b3021fe/0x3234de053c53655 lrc: 3/0,1 mode: PW/PW res: [0x2bb85:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.749263:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b3021fe/0x3234de053c53655 lrc: 4/0,1 mode: PW/PW res: [0x2bb85:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.749271:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529427.749280:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+101:41279:x1731746396828736:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 43us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529427.749283:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13353 00010000:00010000:0.0:1651529427.749312:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003b3021fe/0x3234de053c53655 lrc: 3/0,1 mode: PW/PW res: [0x2bb85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.749316:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b3021fe/0x3234de053c53655 lrc: 3/0,1 mode: PW/PW res: [0x2bb85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.749320:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b3021fe/0x3234de053c53655 lrc: 3/0,1 mode: PW/PW res: [0x2bb85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.749323:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b3021fe/0x3234de053c53655 lrc: 2/0,0 mode: PW/PW res: [0x2bb85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.749603:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cb9f189a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946604928:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1127us (1221us total) trans 12885080902 rc 0/0 00000100:00100000:0.0:1651529427.749606:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212893 00010000:00010000:0.0:1651529427.749626:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b3021fe/0x3234de053c53655 lrc: 2/0,0 mode: PW/PW res: [0x2bb85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.749630:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003b3021fe already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.749631:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b3021fe/0x3234de053c53655 lrc: 2/0,0 mode: PW/PW res: [0x2bb85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.749635:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b3021fe/0x3234de053c53655 lrc: 3/0,0 mode: PW/PW res: [0x2bb85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.749640:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b3021fe/0x3234de053c53655 lrc: 1/0,0 mode: --/PW res: [0x2bb85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.749643:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b3021fe/0x3234de053c53655 lrc: 0/0,0 mode: --/PW res: [0x2bb85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.749839:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529427.749846:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946605440 00000100:00100000:0.0:1651529427.749854:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212901 00000100:00100000:0.0:1651529427.749855:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946605440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529427.749861:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179085 count 1 00010000:00010000:0.0:1651529427.749865:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ac18092/0x3234de053c5368d lrc: 3/0,1 mode: --/PW res: [0x2bb8d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.749871:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c53402 lrc: 2/0,0 mode: PW/PW res: [0x2bb8d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2d4 expref: 100 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.749874:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.749875:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.749875:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ac18092/0x3234de053c5368d lrc: 4/0,1 mode: --/PW res: [0x2bb8d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.749882:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c53402 lrc: 3/0,0 mode: PW/PW res: [0x2bb8d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2d4 expref: 100 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.749886:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c53402 lrc: 4/0,0 mode: PW/PW res: [0x2bb8d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2d4 expref: 100 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.749890:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000097928145 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997072192:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529427.749901:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d5bb72eb going to sleep for 6 seconds 00000100:00100000:0.0:1651529427.749992:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001d1586f2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997071936:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.750022:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000a2c192e/0x3234de053c53671 lrc: 3/0,1 mode: --/PW res: [0x2bb8a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.750033:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000043b7984f pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997071872:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.750046:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ae9ffb85/0x3234de053c5366a lrc: 3/0,1 mode: --/PW res: [0x2bb87:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.750056:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ad6d0877 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997071808:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.750058:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000051c4eca7/0x3234de053c53663 lrc: 3/0,1 mode: --/PW res: [0x2bb88:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.750064:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000075b025a pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997071744:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.750066:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d62533f8/0x3234de053c5365c lrc: 3/0,1 mode: --/PW res: [0x2bb86:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.750102:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529427.750108:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529427.750119:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529427.750128:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529427.750129:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396828800 00010000:00010000:1.0:1651529427.750135:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c533d1 lrc: 4/0,0 mode: PW/PW res: [0x2bb86:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc272 expref: 101 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.750135:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529427.750141:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396828928 00010000:00010000:1.0:1651529427.750143:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c533d8 lrc: 4/0,0 mode: PW/PW res: [0x2bb87:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc280 expref: 102 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.750148:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396829056 00010000:00010000:1.0:1651529427.750150:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c533ed lrc: 4/0,0 mode: PW/PW res: [0x2bb8a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2aa expref: 103 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.750151:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529427.750154:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396829120 00010000:00010000:1.0:1651529427.750156:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c533f4 lrc: 5/0,0 mode: PW/PW res: [0x2bb8b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2b8 expref: 104 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.750158:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529427.750160:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396828864 00010000:00010000:1.0:1651529427.750162:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c533df lrc: 4/0,0 mode: PW/PW res: [0x2bb88:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc28e expref: 105 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.750167:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396828992 00000100:00100000:0.0:1651529427.750168:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529427.750169:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c533e6 lrc: 5/0,0 mode: PW/PW res: [0x2bb89:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc29c expref: 106 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.750173:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396829184 00000100:00100000:0.0:1651529427.750175:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396829248 00010000:00010000:1.0:1651529427.750176:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c533fb lrc: 5/0,0 mode: PW/PW res: [0x2bb8c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2c6 expref: 108 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.750181:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c53402 lrc: 5/0,0 mode: PW/PW res: [0x2bb8d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2d4 expref: 108 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.750184:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13354 00000100:00100000:1.0:1651529427.750186:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+108:41279:x1731746396828800:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529427.750188:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13355 00010000:00010000:1.0:1651529427.750190:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529427.750190:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+108:41279:x1731746396828928:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529427.750191:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c533d1 lrc: 4/0,0 mode: PW/PW res: [0x2bb86:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc272 expref: 108 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.750193:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529427.750194:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c533d8 lrc: 4/0,0 mode: PW/PW res: [0x2bb87:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc280 expref: 108 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.750195:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c533d1 lrc: 3/0,0 mode: PW/PW res: [0x2bb86:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc272 expref: 108 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.750198:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c533d8 lrc: 3/0,0 mode: PW/PW res: [0x2bb87:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc280 expref: 108 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.750203:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f183a40b/0x3234de053c533d1 lrc: 0/0,0 mode: --/PW res: [0x2bb86:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc272 expref: 108 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.750204:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af20b5e7/0x3234de053c533d8 lrc: 0/0,0 mode: --/PW res: [0x2bb87:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc280 expref: 108 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.750207:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.750208:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.750208:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.750209:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d62533f8/0x3234de053c5365c lrc: 3/0,1 mode: PW/PW res: [0x2bb86:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.750209:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.750210:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ae9ffb85/0x3234de053c5366a lrc: 3/0,1 mode: PW/PW res: [0x2bb87:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.750212:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d62533f8/0x3234de053c5365c lrc: 4/0,1 mode: PW/PW res: [0x2bb86:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.750213:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae9ffb85/0x3234de053c5366a lrc: 4/0,1 mode: PW/PW res: [0x2bb87:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.750219:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529427.750238:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529427.750253:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+106:41279:x1731746396828800:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 67us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529427.750257:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13354 00000100:00100000:0.0:1651529427.750257:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+106:41279:x1731746396828928:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 66us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529427.750260:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13355 00000100:00100000:1.0:1651529427.750263:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13356 00000100:00100000:1.0:1651529427.750264:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000039bebb6e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+104:41279:x1731746396829056:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529427.750266:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13357 00000100:00100000:0.0:1651529427.750267:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+104:41279:x1731746396829120:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529427.750268:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529427.750270:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c533ed lrc: 4/0,0 mode: PW/PW res: [0x2bb8a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2aa expref: 104 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.750270:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529427.750272:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c533f4 lrc: 5/0,0 mode: PW/PW res: [0x2bb8b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2b8 expref: 104 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.750273:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c533ed lrc: 3/0,0 mode: PW/PW res: [0x2bb8a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2aa expref: 104 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.750276:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c533f4 lrc: 4/0,0 mode: PW/PW res: [0x2bb8b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2b8 expref: 104 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.750279:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046fea5cc/0x3234de053c533ed lrc: 0/0,0 mode: --/PW res: [0x2bb8a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2aa expref: 104 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.750281:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.750282:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.750282:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.750282:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cdf46c33/0x3234de053c5367f lrc: 3/0,1 mode: PW/PW res: [0x2bb8b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.750283:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.750284:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000a2c192e/0x3234de053c53671 lrc: 3/0,1 mode: PW/PW res: [0x2bb8a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.750285:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdf46c33/0x3234de053c5367f lrc: 4/0,1 mode: PW/PW res: [0x2bb8b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.750287:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a2c192e/0x3234de053c53671 lrc: 4/0,1 mode: PW/PW res: [0x2bb8a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.750290:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529427.750295:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529427.750302:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000039bebb6e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+103:41279:x1731746396829056:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529427.750302:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+103:41279:x1731746396829120:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 34us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529427.750305:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13357 00000100:00100000:1.0:1651529427.750306:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13356 00000100:00100000:0.0:1651529427.750309:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13358 00000100:00100000:0.0:1651529427.750311:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+101:41279:x1731746396828864:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529427.750313:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529427.750315:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c533df lrc: 4/0,0 mode: PW/PW res: [0x2bb88:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc28e expref: 101 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.750318:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13359 00010000:00010000:0.0:1651529427.750319:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c533df lrc: 3/0,0 mode: PW/PW res: [0x2bb88:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc28e expref: 101 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.750320:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+101:41279:x1731746396828992:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529427.750323:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529427.750324:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c533e6 lrc: 5/0,0 mode: PW/PW res: [0x2bb89:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc29c expref: 101 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.750324:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000877aab61/0x3234de053c533df lrc: 0/0,0 mode: --/PW res: [0x2bb88:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc28e expref: 101 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.750327:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.750328:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.750329:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000051c4eca7/0x3234de053c53663 lrc: 3/0,1 mode: PW/PW res: [0x2bb88:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.750331:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c533e6 lrc: 4/0,0 mode: PW/PW res: [0x2bb89:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc29c expref: 100 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.750332:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051c4eca7/0x3234de053c53663 lrc: 4/0,1 mode: PW/PW res: [0x2bb88:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.750335:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.750336:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.750337:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000603760a0/0x3234de053c53678 lrc: 3/0,1 mode: PW/PW res: [0x2bb89:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.750337:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529427.750340:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000603760a0/0x3234de053c53678 lrc: 4/0,1 mode: PW/PW res: [0x2bb89:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.750342:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+100:41279:x1731746396828864:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 31us (208us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529427.750344:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529427.750345:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13358 00000100:00100000:1.0:1651529427.750349:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+99:41279:x1731746396828992:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 28us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529427.750349:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13360 00000100:00100000:0.0:1651529427.750351:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+99:41279:x1731746396829184:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529427.750352:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13359 00010000:00010000:0.0:1651529427.750353:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529427.750354:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c533fb lrc: 5/0,0 mode: PW/PW res: [0x2bb8c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2c6 expref: 98 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.750356:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13361 00000100:00100000:1.0:1651529427.750357:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+98:41278:x1731746396829248:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529427.750358:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c533fb lrc: 4/0,0 mode: PW/PW res: [0x2bb8c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2c6 expref: 98 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.750360:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529427.750361:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c53402 lrc: 5/0,0 mode: PW/PW res: [0x2bb8d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2d4 expref: 98 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.750363:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.750363:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.750364:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006819ac74/0x3234de053c53686 lrc: 3/0,1 mode: PW/PW res: [0x2bb8c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.750365:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c53402 lrc: 4/0,0 mode: PW/PW res: [0x2bb8d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2d4 expref: 98 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.750367:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006819ac74/0x3234de053c53686 lrc: 4/0,1 mode: PW/PW res: [0x2bb8c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.750369:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.750370:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.750371:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004ac18092/0x3234de053c5368d lrc: 3/0,1 mode: PW/PW res: [0x2bb8d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.750371:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529427.750374:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ac18092/0x3234de053c5368d lrc: 4/0,1 mode: PW/PW res: [0x2bb8d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.750375:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+98:41279:x1731746396829184:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 24us (217us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529427.750378:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529427.750378:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13360 00000100:00100000:1.0:1651529427.750382:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+97:41278:x1731746396829248:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 24us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529427.750384:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13361 00010000:00010000:0.0:1651529427.750389:0:72396:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000575eb734/0x3234de053c533e6 lrc: 0/0,0 mode: --/PW res: [0x2bb89:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc29c expref: 96 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.750392:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002f77bb41 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997072000:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.750396:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000603760a0/0x3234de053c53678 lrc: 3/0,1 mode: PW/PW res: [0x2bb89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.750402:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000603760a0/0x3234de053c53678 lrc: 3/0,1 mode: PW/PW res: [0x2bb89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.750403:0:72397:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820e505a/0x3234de053c533fb lrc: 0/0,0 mode: --/PW res: [0x2bb8c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2c6 expref: 95 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.750404:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000603760a0/0x3234de053c53678 lrc: 3/0,1 mode: PW/PW res: [0x2bb89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.750407:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002f363f4a pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997072128:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.750407:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000603760a0/0x3234de053c53678 lrc: 3/0,1 mode: PW/PW res: [0x2bb89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.750410:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000603760a0/0x3234de053c53678 lrc: 2/0,0 mode: PW/PW res: [0x2bb89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.750412:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006819ac74/0x3234de053c53686 lrc: 3/0,1 mode: PW/PW res: [0x2bb8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.750416:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006819ac74/0x3234de053c53686 lrc: 3/0,1 mode: PW/PW res: [0x2bb8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.750418:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006819ac74/0x3234de053c53686 lrc: 3/0,1 mode: PW/PW res: [0x2bb8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.750422:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006819ac74/0x3234de053c53686 lrc: 3/0,1 mode: PW/PW res: [0x2bb8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.750425:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006819ac74/0x3234de053c53686 lrc: 2/0,0 mode: PW/PW res: [0x2bb8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.750659:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+15:39030:x1731745946605184:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1919us (2238us total) trans 12885080903 rc 0/0 00000100:00100000:0.0:1651529427.750662:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212898 00010000:00010000:0.0:1651529427.750669:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000603760a0/0x3234de053c53678 lrc: 2/0,0 mode: PW/PW res: [0x2bb89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.750672:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000603760a0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.750673:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000603760a0/0x3234de053c53678 lrc: 2/0,0 mode: PW/PW res: [0x2bb89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.750676:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000603760a0/0x3234de053c53678 lrc: 3/0,0 mode: PW/PW res: [0x2bb89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.750681:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000603760a0/0x3234de053c53678 lrc: 1/0,0 mode: --/PW res: [0x2bb89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.750684:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000603760a0/0x3234de053c53678 lrc: 0/0,0 mode: --/PW res: [0x2bb89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.750688:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006819ac74/0x3234de053c53686 lrc: 2/0,0 mode: PW/PW res: [0x2bb8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.750690:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:39029:x1731745946605376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1846us (2254us total) trans 12885080904 rc 0/0 00010000:00010000:0.0:1651529427.750691:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006819ac74 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.750692:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006819ac74/0x3234de053c53686 lrc: 2/0,0 mode: PW/PW res: [0x2bb8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.750693:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212900 00010000:00010000:0.0:1651529427.750695:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006819ac74/0x3234de053c53686 lrc: 3/0,0 mode: PW/PW res: [0x2bb8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.750698:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006819ac74/0x3234de053c53686 lrc: 1/0,0 mode: --/PW res: [0x2bb8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.750701:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006819ac74/0x3234de053c53686 lrc: 0/0,0 mode: --/PW res: [0x2bb8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.750706:0:72395:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050e053bc/0x3234de053c533f4 lrc: 0/0,0 mode: --/PW res: [0x2bb8b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2b8 expref: 94 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.750707:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000051c4eca7/0x3234de053c53663 lrc: 3/0,1 mode: PW/PW res: [0x2bb88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.750709:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051c4eca7/0x3234de053c53663 lrc: 3/0,1 mode: PW/PW res: [0x2bb88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.750710:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005d3fb3ef pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997072064:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.750712:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051c4eca7/0x3234de053c53663 lrc: 3/0,1 mode: PW/PW res: [0x2bb88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.750715:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cdf46c33/0x3234de053c5367f lrc: 3/0,1 mode: PW/PW res: [0x2bb8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.750716:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051c4eca7/0x3234de053c53663 lrc: 2/0,0 mode: PW/PW res: [0x2bb88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.750718:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cdf46c33/0x3234de053c5367f lrc: 3/0,1 mode: PW/PW res: [0x2bb8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.750721:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cdf46c33/0x3234de053c5367f lrc: 3/0,1 mode: PW/PW res: [0x2bb8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.750724:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdf46c33/0x3234de053c5367f lrc: 3/0,1 mode: PW/PW res: [0x2bb8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.750727:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cdf46c33/0x3234de053c5367f lrc: 2/0,0 mode: PW/PW res: [0x2bb8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.750964:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+15:39029:x1731745946605120:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 2361us (2565us total) trans 12885080905 rc 0/0 00000100:00100000:0.0:1651529427.750967:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212895 00000100:00100000:1.0:1651529427.750970:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:39030:x1731745946605312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 2175us (2543us total) trans 12885080906 rc 0/0 00000100:00100000:1.0:1651529427.750973:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212899 00010000:00010000:0.0:1651529427.750975:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051c4eca7/0x3234de053c53663 lrc: 2/0,0 mode: PW/PW res: [0x2bb88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.750978:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000051c4eca7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.750979:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051c4eca7/0x3234de053c53663 lrc: 2/0,0 mode: PW/PW res: [0x2bb88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.750982:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051c4eca7/0x3234de053c53663 lrc: 3/0,0 mode: PW/PW res: [0x2bb88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.750987:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051c4eca7/0x3234de053c53663 lrc: 1/0,0 mode: --/PW res: [0x2bb88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.750988:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d62533f8/0x3234de053c5365c lrc: 3/0,1 mode: PW/PW res: [0x2bb86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.750990:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051c4eca7/0x3234de053c53663 lrc: 0/0,0 mode: --/PW res: [0x2bb88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.750992:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d62533f8/0x3234de053c5365c lrc: 3/0,1 mode: PW/PW res: [0x2bb86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.750994:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cdf46c33/0x3234de053c5367f lrc: 2/0,0 mode: PW/PW res: [0x2bb8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.750995:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d62533f8/0x3234de053c5365c lrc: 3/0,1 mode: PW/PW res: [0x2bb86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.750997:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cdf46c33 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529427.750998:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d62533f8/0x3234de053c5365c lrc: 2/0,0 mode: PW/PW res: [0x2bb86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.750998:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdf46c33/0x3234de053c5367f lrc: 2/0,0 mode: PW/PW res: [0x2bb8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.751001:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdf46c33/0x3234de053c5367f lrc: 3/0,0 mode: PW/PW res: [0x2bb8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.751004:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cdf46c33/0x3234de053c5367f lrc: 1/0,0 mode: --/PW res: [0x2bb8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.751013:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cdf46c33/0x3234de053c5367f lrc: 0/0,0 mode: --/PW res: [0x2bb8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.751017:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d62533f8/0x3234de053c5365c lrc: 2/0,0 mode: PW/PW res: [0x2bb86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.751020:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d62533f8 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.751021:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d62533f8/0x3234de053c5365c lrc: 2/0,0 mode: PW/PW res: [0x2bb86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.751024:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d62533f8/0x3234de053c5365c lrc: 3/0,0 mode: PW/PW res: [0x2bb86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.751027:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d62533f8/0x3234de053c5365c lrc: 1/0,0 mode: --/PW res: [0x2bb86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.751029:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d62533f8/0x3234de053c5365c lrc: 0/0,0 mode: --/PW res: [0x2bb86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.751036:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000a2c192e/0x3234de053c53671 lrc: 3/0,1 mode: PW/PW res: [0x2bb8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.751040:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a2c192e/0x3234de053c53671 lrc: 3/0,1 mode: PW/PW res: [0x2bb8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.751043:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a2c192e/0x3234de053c53671 lrc: 3/0,1 mode: PW/PW res: [0x2bb8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.751045:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a2c192e/0x3234de053c53671 lrc: 2/0,0 mode: PW/PW res: [0x2bb8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.751221:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+15:39029:x1731745946604992:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 2669us (2828us total) trans 12885080907 rc 0/0 00000100:00100000:1.0:1651529427.751240:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212894 00010000:00010000:1.0:1651529427.751247:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ae9ffb85/0x3234de053c5366a lrc: 3/0,1 mode: PW/PW res: [0x2bb87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.751250:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae9ffb85/0x3234de053c5366a lrc: 3/0,1 mode: PW/PW res: [0x2bb87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.751253:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae9ffb85/0x3234de053c5366a lrc: 3/0,1 mode: PW/PW res: [0x2bb87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.751256:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae9ffb85/0x3234de053c5366a lrc: 2/0,0 mode: PW/PW res: [0x2bb87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.751285:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+15:39029:x1731745946605248:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 2590us (2872us total) trans 12885080908 rc 0/0 00000100:00100000:0.0:1651529427.751288:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212897 00010000:00010000:0.0:1651529427.751296:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a2c192e/0x3234de053c53671 lrc: 2/0,0 mode: PW/PW res: [0x2bb8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.751299:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000a2c192e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.751300:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a2c192e/0x3234de053c53671 lrc: 2/0,0 mode: PW/PW res: [0x2bb8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.751303:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a2c192e/0x3234de053c53671 lrc: 3/0,0 mode: PW/PW res: [0x2bb8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.751307:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a2c192e/0x3234de053c53671 lrc: 1/0,0 mode: --/PW res: [0x2bb8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.751310:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a2c192e/0x3234de053c53671 lrc: 0/0,0 mode: --/PW res: [0x2bb8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.751315:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae9ffb85/0x3234de053c5366a lrc: 2/0,0 mode: PW/PW res: [0x2bb87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.751317:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ae9ffb85 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.751318:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae9ffb85/0x3234de053c5366a lrc: 2/0,0 mode: PW/PW res: [0x2bb87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.751321:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae9ffb85/0x3234de053c5366a lrc: 3/0,0 mode: PW/PW res: [0x2bb87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.751324:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae9ffb85/0x3234de053c5366a lrc: 1/0,0 mode: --/PW res: [0x2bb87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.751326:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae9ffb85/0x3234de053c5366a lrc: 0/0,0 mode: --/PW res: [0x2bb87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.751421:0:80277:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1b4c19f/0x3234de053c53402 lrc: 0/0,0 mode: --/PW res: [0x2bb8d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2d4 expref: 93 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.751425:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000097928145 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997072192:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.751429:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004ac18092/0x3234de053c5368d lrc: 3/0,1 mode: PW/PW res: [0x2bb8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.751432:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004ac18092/0x3234de053c5368d lrc: 3/0,1 mode: PW/PW res: [0x2bb8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.751454:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ac18092/0x3234de053c5368d lrc: 3/0,1 mode: PW/PW res: [0x2bb8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.751458:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ac18092/0x3234de053c5368d lrc: 3/0,1 mode: PW/PW res: [0x2bb8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.751460:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ac18092/0x3234de053c5368d lrc: 2/0,0 mode: PW/PW res: [0x2bb8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.751496:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+15:39030:x1731745946605056:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 2845us (3090us total) trans 12885080909 rc 0/0 00000100:00100000:1.0:1651529427.751500:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212896 00000100:00100000:0.0:1651529427.751714:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:39029:x1731745946605440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1857us (1875us total) trans 12885080910 rc 0/0 00000100:00100000:0.0:1651529427.751718:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212901 00010000:00010000:0.0:1651529427.751726:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ac18092/0x3234de053c5368d lrc: 2/0,0 mode: PW/PW res: [0x2bb8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.751730:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004ac18092 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.751731:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ac18092/0x3234de053c5368d lrc: 2/0,0 mode: PW/PW res: [0x2bb8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.751734:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ac18092/0x3234de053c5368d lrc: 3/0,0 mode: PW/PW res: [0x2bb8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.751738:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ac18092/0x3234de053c5368d lrc: 1/0,0 mode: --/PW res: [0x2bb8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.751741:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ac18092/0x3234de053c5368d lrc: 0/0,0 mode: --/PW res: [0x2bb8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.751769:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529427.751793:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529427.751815:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946605504 00000100:00100000:1.0:1651529427.751824:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946605568 00000100:00100000:1.0:1651529427.751829:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212902 00000100:00100000:0.0:1651529427.751836:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529427.751838:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+15:39029:x1731745946605504:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529427.751848:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529427.751850:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179086 count 1 00000100:00100000:0.0:1651529427.751854:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529427.751856:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53694 lrc: 3/0,1 mode: --/PW res: [0x2bb8e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.751864:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529427.751866:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c53409 lrc: 2/0,0 mode: PW/PW res: [0x2bb8e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2e2 expref: 92 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.751870:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.751871:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.751871:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53694 lrc: 4/0,1 mode: --/PW res: [0x2bb8e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.751872:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946605632 00010000:00010000:1.0:1651529427.751879:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c53409 lrc: 3/0,0 mode: PW/PW res: [0x2bb8e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2e2 expref: 92 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.751879:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946605760 00000100:00100000:0.0:1651529427.751882:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946605696 00010000:00010000:1.0:1651529427.751883:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c53409 lrc: 4/0,0 mode: PW/PW res: [0x2bb8e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2e2 expref: 92 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.751885:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946605824 00000100:00100000:1.0:1651529427.751888:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e2020717 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997072256:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529427.751889:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212903 00000100:00100000:0.0:1651529427.751891:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+19:39030:x1731745946605568:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529427.751897:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179087 count 1 00000100:00100000:1.0:1651529427.751905:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c3caa148 going to sleep for 6 seconds 00010000:00010000:0.0:1651529427.751908:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f468e9b8/0x3234de053c5369b lrc: 3/0,1 mode: --/PW res: [0x2bb8f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.751912:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212904 00000100:00100000:1.0:1651529427.751914:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:39029:x1731745946605632:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529427.751914:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c53410 lrc: 2/0,0 mode: PW/PW res: [0x2bb8f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2f0 expref: 92 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.751917:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.751918:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.751919:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f468e9b8/0x3234de053c5369b lrc: 4/0,1 mode: --/PW res: [0x2bb8f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529427.751920:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179088 count 1 00010000:00010000:1.0:1651529427.751924:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c536a2 lrc: 3/0,1 mode: --/PW res: [0x2bb90:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.751926:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c53410 lrc: 3/0,0 mode: PW/PW res: [0x2bb8f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2f0 expref: 92 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.751929:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53417 lrc: 2/0,0 mode: PW/PW res: [0x2bb90:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2fe expref: 92 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.751932:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.751932:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.751933:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c536a2 lrc: 4/0,1 mode: --/PW res: [0x2bb90:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.751933:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c53410 lrc: 4/0,0 mode: PW/PW res: [0x2bb8f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2f0 expref: 92 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.751937:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002f363f4a pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997072320:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529427.751939:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53417 lrc: 3/0,0 mode: PW/PW res: [0x2bb90:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2fe expref: 92 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.751943:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53417 lrc: 4/0,0 mode: PW/PW res: [0x2bb90:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2fe expref: 92 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.751947:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f55117eb pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997072384:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529427.751955:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 0000000053a0cffa going to sleep for 6 seconds 00000100:00100000:1.0:1651529427.751961:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212905 00000100:00100000:1.0:1651529427.751963:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+19:39029:x1731745946605760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529427.751963:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 0000000045cc2304 going to sleep for 6 seconds 00002000:00080000:1.0:1651529427.751967:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179090 count 1 00010000:00010000:1.0:1651529427.751970:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c536a9 lrc: 3/0,1 mode: --/PW res: [0x2bb92:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.751970:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212906 00000100:00100000:0.0:1651529427.751972:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:39030:x1731745946605696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529427.751974:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c53425 lrc: 2/0,0 mode: PW/PW res: [0x2bb92:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc31a expref: 92 pid: 151609 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529427.751977:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179089 count 1 00010000:00010000:1.0:1651529427.751978:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.751978:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.751979:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c536a9 lrc: 4/0,1 mode: --/PW res: [0x2bb92:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.751982:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c536b0 lrc: 3/0,1 mode: --/PW res: [0x2bb91:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.751985:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c53425 lrc: 3/0,0 mode: PW/PW res: [0x2bb92:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc31a expref: 92 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.751987:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c5341e lrc: 2/0,0 mode: PW/PW res: [0x2bb91:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc30c expref: 92 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.751988:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c53425 lrc: 4/0,0 mode: PW/PW res: [0x2bb92:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc31a expref: 92 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.751990:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.751990:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.751991:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c536b0 lrc: 4/0,1 mode: --/PW res: [0x2bb91:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.751992:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000b6aa823 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997072448:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.751997:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c5341e lrc: 3/0,0 mode: PW/PW res: [0x2bb91:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc30c expref: 92 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.751998:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000499d0377 going to sleep for 6 seconds 00010000:00010000:0.0:1651529427.752001:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c5341e lrc: 4/0,0 mode: PW/PW res: [0x2bb91:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc30c expref: 92 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.752004:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212907 00000100:00100000:1.0:1651529427.752005:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+19:39030:x1731745946605824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529427.752008:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002f77bb41 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997072512:10.240.43.64@tcp:104: 00002000:00080000:1.0:1651529427.752009:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179091 count 1 00010000:00010000:1.0:1651529427.752013:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c536b7 lrc: 3/0,1 mode: --/PW res: [0x2bb93:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.752015:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 0000000048c640d6 going to sleep for 6 seconds 00010000:00010000:1.0:1651529427.752017:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c5342c lrc: 2/0,0 mode: PW/PW res: [0x2bb93:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc328 expref: 92 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.752020:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.752020:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.752021:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c536b7 lrc: 4/0,1 mode: --/PW res: [0x2bb93:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.752029:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529427.752030:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c5342c lrc: 3/0,0 mode: PW/PW res: [0x2bb93:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc328 expref: 92 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.752033:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c5342c lrc: 4/0,0 mode: PW/PW res: [0x2bb93:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc328 expref: 92 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.752037:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000eb9cb61d pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997072576:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529427.752044:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000412e5d26 going to sleep for 6 seconds 00000100:00100000:0.0:1651529427.752045:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529427.752054:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946605888 00000100:00100000:1.0:1651529427.752064:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946605952 00000100:00100000:1.0:1651529427.752068:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212908 00000100:00100000:1.0:1651529427.752069:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:39029:x1731745946605888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529427.752081:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212909 00000100:00100000:0.0:1651529427.752083:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000946e402f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:39030:x1731745946605952:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529427.752089:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179093 count 1 00010000:00010000:0.0:1651529427.752098:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c536be lrc: 3/0,1 mode: --/PW res: [0x2bb95:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529427.752101:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179092 count 1 00010000:00010000:0.0:1651529427.752103:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c5343a lrc: 2/0,0 mode: PW/PW res: [0x2bb95:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc344 expref: 92 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.752106:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c536c5 lrc: 3/0,1 mode: --/PW res: [0x2bb94:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.752106:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.752107:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.752107:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c536be lrc: 4/0,1 mode: --/PW res: [0x2bb95:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.752110:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c53433 lrc: 2/0,0 mode: PW/PW res: [0x2bb94:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc336 expref: 92 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.752113:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.752114:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.752114:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c5343a lrc: 3/0,0 mode: PW/PW res: [0x2bb95:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc344 expref: 92 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.752115:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c536c5 lrc: 4/0,1 mode: --/PW res: [0x2bb94:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.752117:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c5343a lrc: 4/0,0 mode: PW/PW res: [0x2bb95:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc344 expref: 92 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.752121:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c7657c6f pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997072640:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529427.752122:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c53433 lrc: 3/0,0 mode: PW/PW res: [0x2bb94:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc336 expref: 92 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.752128:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c53433 lrc: 4/0,0 mode: PW/PW res: [0x2bb94:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc336 expref: 92 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.752132:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007f9b0c6d pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997072704:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529427.752132:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000075259221 going to sleep for 6 seconds 00000100:00100000:1.0:1651529427.752141:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f79d8146 going to sleep for 6 seconds 00000100:00100000:0.0:1651529427.753410:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002f363f4a pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997072320:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529427.753414:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f55117eb pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997072384:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.753415:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f468e9b8/0x3234de053c5369b lrc: 3/0,1 mode: --/PW res: [0x2bb8f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.753420:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c536a2 lrc: 3/0,1 mode: --/PW res: [0x2bb90:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.753424:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002f77bb41 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997072512:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.753426:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c536b0 lrc: 3/0,1 mode: --/PW res: [0x2bb91:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.753427:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000b6aa823 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997072448:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529427.753430:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c536a9 lrc: 3/0,1 mode: --/PW res: [0x2bb92:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.753436:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e2020717 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997072256:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529427.753437:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000eb9cb61d pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997072576:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529427.753439:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c536b7 lrc: 3/0,1 mode: --/PW res: [0x2bb93:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.753439:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53694 lrc: 3/0,1 mode: --/PW res: [0x2bb8e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.753606:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007f9b0c6d pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997072704:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529427.753610:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c536c5 lrc: 3/0,1 mode: --/PW res: [0x2bb94:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.753614:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529427.753628:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396829376 00010000:00010000:1.0:1651529427.753634:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53417 lrc: 4/0,0 mode: PW/PW res: [0x2bb90:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2fe expref: 93 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.753635:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529427.753645:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529427.753647:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396829504 00010000:00010000:1.0:1651529427.753650:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c53425 lrc: 4/0,0 mode: PW/PW res: [0x2bb92:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc31a expref: 94 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.753653:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529427.753655:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396829632 00010000:00010000:1.0:1651529427.753657:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c5342c lrc: 4/0,0 mode: PW/PW res: [0x2bb93:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc328 expref: 95 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.753658:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529427.753661:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396829760 00010000:00010000:1.0:1651529427.753663:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c53433 lrc: 4/0,0 mode: PW/PW res: [0x2bb94:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc336 expref: 96 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.753663:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529427.753667:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396829312 00000100:00100000:0.0:1651529427.753667:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529427.753669:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c53409 lrc: 4/0,0 mode: PW/PW res: [0x2bb8e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2e2 expref: 97 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.753674:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396829440 00000100:00100000:0.0:1651529427.753674:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529427.753676:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c53410 lrc: 4/0,0 mode: PW/PW res: [0x2bb8f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2f0 expref: 98 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.753680:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396829568 00010000:00010000:1.0:1651529427.753682:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c5341e lrc: 4/0,0 mode: PW/PW res: [0x2bb91:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc30c expref: 99 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.753682:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c7657c6f pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997072640:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529427.753686:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396829696 00010000:00010000:0.0:1651529427.753686:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c536be lrc: 3/0,1 mode: --/PW res: [0x2bb95:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.753688:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c5343a lrc: 4/0,0 mode: PW/PW res: [0x2bb95:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc344 expref: 100 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.753694:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13362 00000100:00100000:0.0:1651529427.753696:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+100:41278:x1731746396829376:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529427.753697:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13363 00000100:00100000:1.0:1651529427.753699:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000f76b19f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+100:41278:x1731746396829504:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529427.753700:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529427.753701:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53417 lrc: 4/0,0 mode: PW/PW res: [0x2bb90:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2fe expref: 100 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.753702:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529427.753703:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c53425 lrc: 4/0,0 mode: PW/PW res: [0x2bb92:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc31a expref: 100 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.753705:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53417 lrc: 3/0,0 mode: PW/PW res: [0x2bb90:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2fe expref: 100 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.753707:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c53425 lrc: 3/0,0 mode: PW/PW res: [0x2bb92:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc31a expref: 100 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.753711:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53417 lrc: 0/0,0 mode: --/PW res: [0x2bb90:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2fe expref: 100 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.753713:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c53425 lrc: 0/0,0 mode: --/PW res: [0x2bb92:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc31a expref: 100 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.753715:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.753716:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.753717:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.753717:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.753717:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c536a2 lrc: 3/0,1 mode: PW/PW res: [0x2bb90:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.753718:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c536a9 lrc: 3/0,1 mode: PW/PW res: [0x2bb92:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.753720:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c536a2 lrc: 4/0,1 mode: PW/PW res: [0x2bb90:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.753721:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c536a9 lrc: 4/0,1 mode: PW/PW res: [0x2bb92:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.753729:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529427.753735:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529427.753740:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+98:41278:x1731746396829376:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 44us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529427.753743:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13362 00000100:00100000:1.0:1651529427.753748:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000f76b19f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+97:41278:x1731746396829504:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 48us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529427.753749:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13364 00000100:00100000:1.0:1651529427.753751:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13363 00000100:00100000:0.0:1651529427.753751:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+97:41278:x1731746396829632:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529427.753754:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529427.753756:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c5342c lrc: 4/0,0 mode: PW/PW res: [0x2bb93:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc328 expref: 96 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.753759:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c5342c lrc: 3/0,0 mode: PW/PW res: [0x2bb93:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc328 expref: 96 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.753761:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13365 00000100:00100000:1.0:1651529427.753762:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004de851bb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+96:41278:x1731746396829760:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529427.753764:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c5342c lrc: 0/0,0 mode: --/PW res: [0x2bb93:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc328 expref: 96 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.753765:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529427.753767:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c53433 lrc: 4/0,0 mode: PW/PW res: [0x2bb94:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc336 expref: 96 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.753767:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.753768:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.753769:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c536b7 lrc: 3/0,1 mode: PW/PW res: [0x2bb93:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.753771:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c53433 lrc: 3/0,0 mode: PW/PW res: [0x2bb94:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc336 expref: 95 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.753772:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c536b7 lrc: 4/0,1 mode: PW/PW res: [0x2bb93:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.753776:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c53433 lrc: 0/0,0 mode: --/PW res: [0x2bb94:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc336 expref: 95 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.753790:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529427.753795:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.753796:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.753796:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c536c5 lrc: 3/0,1 mode: PW/PW res: [0x2bb94:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.753796:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+94:41278:x1731746396829632:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 44us (150us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529427.753799:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c536c5 lrc: 4/0,1 mode: PW/PW res: [0x2bb94:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.753799:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13364 00000100:00100000:0.0:1651529427.753803:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13366 00000100:00100000:0.0:1651529427.753805:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000041d3f4d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+93:41278:x1731746396829312:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529427.753806:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529427.753808:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529427.753809:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c53409 lrc: 4/0,0 mode: PW/PW res: [0x2bb8e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2e2 expref: 93 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.753812:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004de851bb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+93:41278:x1731746396829760:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 49us (159us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529427.753813:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c53409 lrc: 3/0,0 mode: PW/PW res: [0x2bb8e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2e2 expref: 93 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.753815:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13365 00010000:00010000:0.0:1651529427.753818:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000490515f1/0x3234de053c53409 lrc: 0/0,0 mode: --/PW res: [0x2bb8e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2e2 expref: 92 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.753820:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13367 00000100:00100000:1.0:1651529427.753822:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+91:41278:x1731746396829440:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529427.753822:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.753822:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.753823:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53694 lrc: 3/0,1 mode: PW/PW res: [0x2bb8e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.753824:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529427.753826:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c53410 lrc: 4/0,0 mode: PW/PW res: [0x2bb8f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2f0 expref: 91 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.753826:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53694 lrc: 4/0,1 mode: PW/PW res: [0x2bb8e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.753832:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529427.753833:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c53410 lrc: 3/0,0 mode: PW/PW res: [0x2bb8f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2f0 expref: 91 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.753837:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ac1e27e/0x3234de053c53410 lrc: 0/0,0 mode: --/PW res: [0x2bb8f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc2f0 expref: 91 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.753837:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000041d3f4d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+91:41278:x1731746396829312:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 31us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529427.753839:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13366 00010000:00010000:1.0:1651529427.753841:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.753841:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.753842:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f468e9b8/0x3234de053c5369b lrc: 3/0,1 mode: PW/PW res: [0x2bb8f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.753843:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13368 00000100:00100000:0.0:1651529427.753844:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+89:41278:x1731746396829568:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529427.753845:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f468e9b8/0x3234de053c5369b lrc: 4/0,1 mode: PW/PW res: [0x2bb8f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.753846:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529427.753848:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c5341e lrc: 4/0,0 mode: PW/PW res: [0x2bb91:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc30c expref: 89 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.753851:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c5341e lrc: 3/0,0 mode: PW/PW res: [0x2bb91:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc30c expref: 89 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.753854:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529427.753860:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+89:41278:x1731746396829440:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 38us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529427.753863:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13367 00010000:00010000:0.0:1651529427.753863:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c5341e lrc: 0/0,0 mode: --/PW res: [0x2bb91:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc30c expref: 89 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.753867:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13369 00000100:00100000:1.0:1651529427.753869:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+88:41278:x1731746396829696:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529427.753870:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.753870:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.753871:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529427.753871:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c536b0 lrc: 3/0,1 mode: PW/PW res: [0x2bb91:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.753873:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c5343a lrc: 4/0,0 mode: PW/PW res: [0x2bb95:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc344 expref: 87 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.753874:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c536b0 lrc: 4/0,1 mode: PW/PW res: [0x2bb91:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.753876:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c5343a lrc: 3/0,0 mode: PW/PW res: [0x2bb95:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc344 expref: 87 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.753879:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529427.753882:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c5343a lrc: 0/0,0 mode: --/PW res: [0x2bb95:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc344 expref: 87 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.753885:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529427.753885:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+86:41278:x1731746396829568:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (217us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529427.753886:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.753886:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c536be lrc: 3/0,1 mode: PW/PW res: [0x2bb95:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.753888:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13368 00010000:00010000:1.0:1651529427.753889:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c536be lrc: 4/0,1 mode: PW/PW res: [0x2bb95:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.753894:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c536b0 lrc: 3/0,1 mode: PW/PW res: [0x2bb91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.753897:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529427.753903:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+85:41278:x1731746396829696:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 33us (228us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529427.753903:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c536b0 lrc: 3/0,1 mode: PW/PW res: [0x2bb91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.753905:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13369 00010000:00010000:0.0:1651529427.753906:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c536b0 lrc: 3/0,1 mode: PW/PW res: [0x2bb91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.753909:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c536b0 lrc: 2/0,0 mode: PW/PW res: [0x2bb91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.753913:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c536a2 lrc: 3/0,1 mode: PW/PW res: [0x2bb90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.753916:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c536a2 lrc: 3/0,1 mode: PW/PW res: [0x2bb90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.753919:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c536a2 lrc: 3/0,1 mode: PW/PW res: [0x2bb90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.753922:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c536a2 lrc: 2/0,0 mode: PW/PW res: [0x2bb90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.754154:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:39030:x1731745946605696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 2181us (2299us total) trans 12885080911 rc 0/0 00000100:00100000:1.0:1651529427.754155:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:39029:x1731745946605632:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 2239us (2318us total) trans 12885080912 rc 0/0 00000100:00100000:0.0:1651529427.754158:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212906 00000100:00100000:1.0:1651529427.754163:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212904 00010000:00010000:0.0:1651529427.754165:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c536b0 lrc: 2/0,0 mode: PW/PW res: [0x2bb91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.754169:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003551d5d1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.754170:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c536b0 lrc: 2/0,0 mode: PW/PW res: [0x2bb91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.754171:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c536a9 lrc: 3/0,1 mode: PW/PW res: [0x2bb92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.754173:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c536b0 lrc: 3/0,0 mode: PW/PW res: [0x2bb91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.754174:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c536a9 lrc: 3/0,1 mode: PW/PW res: [0x2bb92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.754178:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c536a9 lrc: 3/0,1 mode: PW/PW res: [0x2bb92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.754178:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c536b0 lrc: 1/0,0 mode: --/PW res: [0x2bb91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.754180:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c536a9 lrc: 2/0,0 mode: PW/PW res: [0x2bb92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.754181:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003551d5d1/0x3234de053c536b0 lrc: 0/0,0 mode: --/PW res: [0x2bb91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.754185:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c536a2 lrc: 2/0,0 mode: PW/PW res: [0x2bb90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.754194:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000090e99444 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.754195:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c536a2 lrc: 2/0,0 mode: PW/PW res: [0x2bb90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.754198:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c536a2 lrc: 3/0,0 mode: PW/PW res: [0x2bb90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.754201:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c536a2 lrc: 1/0,0 mode: --/PW res: [0x2bb90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.754207:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c536a2 lrc: 0/0,0 mode: --/PW res: [0x2bb90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.754210:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c536a9 lrc: 2/0,0 mode: PW/PW res: [0x2bb92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.754213:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000feb9d3da already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.754214:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c536a9 lrc: 2/0,0 mode: PW/PW res: [0x2bb92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.754216:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c536a9 lrc: 3/0,0 mode: PW/PW res: [0x2bb92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.754219:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c536a9 lrc: 1/0,0 mode: --/PW res: [0x2bb92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.754232:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c536a9 lrc: 0/0,0 mode: --/PW res: [0x2bb92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.754245:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c536be lrc: 3/0,1 mode: PW/PW res: [0x2bb95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.754248:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c536be lrc: 3/0,1 mode: PW/PW res: [0x2bb95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.754251:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c536be lrc: 3/0,1 mode: PW/PW res: [0x2bb95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.754255:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c536be lrc: 2/0,0 mode: PW/PW res: [0x2bb95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.754413:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:39029:x1731745946605760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 2448us (2564us total) trans 12885080913 rc 0/0 00000100:00100000:1.0:1651529427.754416:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212905 00010000:00010000:1.0:1651529427.754424:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c536b7 lrc: 3/0,1 mode: PW/PW res: [0x2bb93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.754427:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c536b7 lrc: 3/0,1 mode: PW/PW res: [0x2bb93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.754430:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c536b7 lrc: 3/0,1 mode: PW/PW res: [0x2bb93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.754436:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c536b7 lrc: 2/0,0 mode: PW/PW res: [0x2bb93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.754480:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000946e402f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+23:39030:x1731745946605952:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 2395us (2434us total) trans 12885080914 rc 0/0 00000100:00100000:0.0:1651529427.754483:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212909 00010000:00010000:0.0:1651529427.754490:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c536be lrc: 2/0,0 mode: PW/PW res: [0x2bb95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.754494:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f146053f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.754495:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c536be lrc: 2/0,0 mode: PW/PW res: [0x2bb95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.754498:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c536be lrc: 3/0,0 mode: PW/PW res: [0x2bb95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.754502:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c536be lrc: 1/0,0 mode: --/PW res: [0x2bb95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.754505:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c536be lrc: 0/0,0 mode: --/PW res: [0x2bb95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.754509:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c536b7 lrc: 2/0,0 mode: PW/PW res: [0x2bb93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.754512:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000029958df2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.754513:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c536b7 lrc: 2/0,0 mode: PW/PW res: [0x2bb93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.754516:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c536b7 lrc: 3/0,0 mode: PW/PW res: [0x2bb93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.754519:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c536b7 lrc: 1/0,0 mode: --/PW res: [0x2bb93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.754522:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c536b7 lrc: 0/0,0 mode: --/PW res: [0x2bb93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.754528:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53694 lrc: 3/0,1 mode: PW/PW res: [0x2bb8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.754531:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53694 lrc: 3/0,1 mode: PW/PW res: [0x2bb8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.754533:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53694 lrc: 3/0,1 mode: PW/PW res: [0x2bb8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.754536:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53694 lrc: 2/0,0 mode: PW/PW res: [0x2bb8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.754643:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:39030:x1731745946605824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 2636us (2778us total) trans 12885080915 rc 0/0 00000100:00100000:1.0:1651529427.754646:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212907 00010000:00010000:1.0:1651529427.754653:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c536c5 lrc: 3/0,1 mode: PW/PW res: [0x2bb94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.754656:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c536c5 lrc: 3/0,1 mode: PW/PW res: [0x2bb94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.754659:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c536c5 lrc: 3/0,1 mode: PW/PW res: [0x2bb94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.754662:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c536c5 lrc: 2/0,0 mode: PW/PW res: [0x2bb94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.754756:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:39029:x1731745946605504:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 2917us (2986us total) trans 12885080916 rc 0/0 00000100:00100000:0.0:1651529427.754759:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212902 00010000:00010000:0.0:1651529427.754767:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53694 lrc: 2/0,0 mode: PW/PW res: [0x2bb8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.754770:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006cbd0d09 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.754771:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53694 lrc: 2/0,0 mode: PW/PW res: [0x2bb8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.754774:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53694 lrc: 3/0,0 mode: PW/PW res: [0x2bb8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.754789:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53694 lrc: 1/0,0 mode: --/PW res: [0x2bb8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.754792:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53694 lrc: 0/0,0 mode: --/PW res: [0x2bb8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.754796:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c536c5 lrc: 2/0,0 mode: PW/PW res: [0x2bb94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.754799:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000314b5fa1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.754800:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c536c5 lrc: 2/0,0 mode: PW/PW res: [0x2bb94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.754803:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c536c5 lrc: 3/0,0 mode: PW/PW res: [0x2bb94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.754806:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c536c5 lrc: 1/0,0 mode: --/PW res: [0x2bb94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.754809:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c536c5 lrc: 0/0,0 mode: --/PW res: [0x2bb94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.754815:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f468e9b8/0x3234de053c5369b lrc: 3/0,1 mode: PW/PW res: [0x2bb8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.754818:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f468e9b8/0x3234de053c5369b lrc: 3/0,1 mode: PW/PW res: [0x2bb8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.754821:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f468e9b8/0x3234de053c5369b lrc: 3/0,1 mode: PW/PW res: [0x2bb8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.754824:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f468e9b8/0x3234de053c5369b lrc: 2/0,0 mode: PW/PW res: [0x2bb8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.754873:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:39029:x1731745946605888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 2803us (2844us total) trans 12885080917 rc 0/0 00000100:00100000:1.0:1651529427.754876:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212908 00000100:00100000:0.0:1651529427.755060:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+22:39030:x1731745946605568:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 3167us (3267us total) trans 12885080918 rc 0/0 00000100:00100000:0.0:1651529427.755063:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212903 00010000:00010000:0.0:1651529427.755070:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f468e9b8/0x3234de053c5369b lrc: 2/0,0 mode: PW/PW res: [0x2bb8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.755074:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f468e9b8 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.755074:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f468e9b8/0x3234de053c5369b lrc: 2/0,0 mode: PW/PW res: [0x2bb8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.755077:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f468e9b8/0x3234de053c5369b lrc: 3/0,0 mode: PW/PW res: [0x2bb8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.755082:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f468e9b8/0x3234de053c5369b lrc: 1/0,0 mode: --/PW res: [0x2bb8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.755085:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f468e9b8/0x3234de053c5369b lrc: 0/0,0 mode: --/PW res: [0x2bb8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.755123:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529427.755135:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946606016 00000100:00100000:0.0:1651529427.755146:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212910 00000100:00100000:0.0:1651529427.755148:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007f9b0c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+22:39030:x1731745946606016:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529427.755153:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179094 count 1 00010000:00010000:0.0:1651529427.755158:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c536cc lrc: 3/0,1 mode: --/PW res: [0x2bb96:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.755163:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c53441 lrc: 2/0,0 mode: PW/PW res: [0x2bb96:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc352 expref: 84 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.755166:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.755167:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.755168:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c536cc lrc: 4/0,1 mode: --/PW res: [0x2bb96:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.755194:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c53441 lrc: 3/0,0 mode: PW/PW res: [0x2bb96:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc352 expref: 84 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.755209:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c53441 lrc: 4/0,0 mode: PW/PW res: [0x2bb96:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc352 expref: 84 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.755214:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ef7d105 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997072768:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529427.755215:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529427.755245:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529427.755273:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 0000000075259221 going to sleep for 6 seconds 00000100:00100000:1.0:1651529427.755278:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529427.755281:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946606080 00000100:00100000:0.0:1651529427.755288:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946606144 00000100:00100000:0.0:1651529427.755294:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946606208 00000100:00100000:0.0:1651529427.755300:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212911 00000100:00100000:0.0:1651529427.755302:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eb9cb61d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+25:39030:x1731745946606080:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529427.755307:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179095 count 1 00010000:00010000:0.0:1651529427.755311:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c536d3 lrc: 3/0,1 mode: --/PW res: [0x2bb97:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.755316:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c53448 lrc: 2/0,0 mode: PW/PW res: [0x2bb97:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc360 expref: 84 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.755317:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529427.755319:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.755320:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.755321:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c536d3 lrc: 4/0,1 mode: --/PW res: [0x2bb97:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.755328:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529427.755336:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529427.755338:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c53448 lrc: 3/0,0 mode: PW/PW res: [0x2bb97:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc360 expref: 84 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.755342:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c53448 lrc: 4/0,0 mode: PW/PW res: [0x2bb97:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc360 expref: 84 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.755345:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529427.755346:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a6ed4a31 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997072832:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529427.755355:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946606272 00000100:00100000:0.0:1651529427.755367:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 0000000080004f0a going to sleep for 6 seconds 00000100:00100000:1.0:1651529427.755369:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946606336 00000100:00100000:1.0:1651529427.755372:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946606400 00000100:00100000:0.0:1651529427.755373:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946606464 00000100:00100000:1.0:1651529427.755375:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212912 00000100:00100000:1.0:1651529427.755377:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000b6aa823 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:39029:x1731745946606144:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529427.755379:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212913 00000100:00100000:0.0:1651529427.755381:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f55117eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+29:39030:x1731745946606208:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529427.755383:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179096 count 1 00002000:00080000:0.0:1651529427.755387:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179097 count 1 00010000:00010000:1.0:1651529427.755389:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c536da lrc: 3/0,1 mode: --/PW res: [0x2bb98:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.755391:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fb1a013/0x3234de053c536e1 lrc: 3/0,1 mode: --/PW res: [0x2bb99:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.755394:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c5344f lrc: 2/0,0 mode: PW/PW res: [0x2bb98:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc36e expref: 84 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.755395:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c53456 lrc: 2/0,0 mode: PW/PW res: [0x2bb99:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc37c expref: 84 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.755397:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.755398:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.755398:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.755399:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c536da lrc: 4/0,1 mode: --/PW res: [0x2bb98:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.755399:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.755400:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fb1a013/0x3234de053c536e1 lrc: 4/0,1 mode: --/PW res: [0x2bb99:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.755406:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c5344f lrc: 3/0,0 mode: PW/PW res: [0x2bb98:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc36e expref: 84 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.755406:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c53456 lrc: 3/0,0 mode: PW/PW res: [0x2bb99:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc37c expref: 84 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.755409:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c53456 lrc: 4/0,0 mode: PW/PW res: [0x2bb99:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc37c expref: 84 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.755410:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c5344f lrc: 4/0,0 mode: PW/PW res: [0x2bb98:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc36e expref: 84 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.755413:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c7657c6f pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997072896:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529427.755415:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005b3c5aba pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997072960:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529427.755421:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b0ed27ba going to sleep for 6 seconds 00000100:00100000:1.0:1651529427.755425:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 0000000053a0cffa going to sleep for 6 seconds 00000100:00100000:0.0:1651529427.755426:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212914 00000100:00100000:0.0:1651529427.755428:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e2020717 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:39029:x1731745946606272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529427.755432:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179098 count 1 00010000:00010000:0.0:1651529427.755436:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c536e8 lrc: 3/0,1 mode: --/PW res: [0x2bb9a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.755440:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c5345d lrc: 2/0,0 mode: PW/PW res: [0x2bb9a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc38a expref: 84 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.755443:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.755444:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.755444:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c536e8 lrc: 4/0,1 mode: --/PW res: [0x2bb9a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.755450:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c5345d lrc: 3/0,0 mode: PW/PW res: [0x2bb9a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc38a expref: 84 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.755453:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c5345d lrc: 4/0,0 mode: PW/PW res: [0x2bb9a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc38a expref: 84 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.755457:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000075b025a pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997073024:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529427.755469:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 0000000066606c98 going to sleep for 6 seconds 00000100:00100000:1.0:1651529427.755472:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212915 00000100:00100000:1.0:1651529427.755474:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:39030:x1731745946606336:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529427.755476:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212916 00000100:00100000:0.0:1651529427.755478:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+29:39029:x1731745946606400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529427.755480:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179099 count 1 00002000:00080000:0.0:1651529427.755482:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179100 count 1 00010000:00010000:1.0:1651529427.755484:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c536ef lrc: 3/0,1 mode: --/PW res: [0x2bb9b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.755485:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c536f6 lrc: 3/0,1 mode: --/PW res: [0x2bb9c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.755489:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c53464 lrc: 2/0,0 mode: PW/PW res: [0x2bb9b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc398 expref: 84 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.755490:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c5346b lrc: 2/0,0 mode: PW/PW res: [0x2bb9c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3a6 expref: 84 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.755492:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.755493:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.755493:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c536ef lrc: 4/0,1 mode: --/PW res: [0x2bb9b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.755493:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.755493:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.755494:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c536f6 lrc: 4/0,1 mode: --/PW res: [0x2bb9c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.755500:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c53464 lrc: 3/0,0 mode: PW/PW res: [0x2bb9b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc398 expref: 84 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.755503:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c53464 lrc: 4/0,0 mode: PW/PW res: [0x2bb9b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc398 expref: 84 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.755503:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c5346b lrc: 3/0,0 mode: PW/PW res: [0x2bb9c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3a6 expref: 84 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.755506:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c5346b lrc: 4/0,0 mode: PW/PW res: [0x2bb9c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3a6 expref: 84 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.755508:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000050bbb886 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997073088:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529427.755510:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ad6d0877 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997073152:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529427.755517:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000412e5d26 going to sleep for 6 seconds 00000100:00100000:0.0:1651529427.755518:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b1b3d0f8 going to sleep for 6 seconds 00000100:00100000:0.0:1651529427.755524:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212917 00000100:00100000:0.0:1651529427.755525:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+29:39030:x1731745946606464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529427.755529:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179101 count 1 00010000:00010000:0.0:1651529427.755532:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c536fd lrc: 3/0,1 mode: --/PW res: [0x2bb9d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.755537:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c53472 lrc: 2/0,0 mode: PW/PW res: [0x2bb9d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3b4 expref: 84 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.755539:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.755540:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.755540:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c536fd lrc: 4/0,1 mode: --/PW res: [0x2bb9d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.755546:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c53472 lrc: 3/0,0 mode: PW/PW res: [0x2bb9d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3b4 expref: 84 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.755549:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c53472 lrc: 4/0,0 mode: PW/PW res: [0x2bb9d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3b4 expref: 84 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.755553:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000043b7984f pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997073216:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529427.755565:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bd9ed213 going to sleep for 6 seconds 00000100:00100000:0.0:1651529427.756120:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c7657c6f pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997072896:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529427.756125:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005b3c5aba pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997072960:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.756126:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001fb1a013/0x3234de053c536e1 lrc: 3/0,1 mode: --/PW res: [0x2bb99:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.756130:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c536da lrc: 3/0,1 mode: --/PW res: [0x2bb98:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.756134:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000075b025a pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997073024:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.756136:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c536e8 lrc: 3/0,1 mode: --/PW res: [0x2bb9a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.756142:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a6ed4a31 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997072832:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.756145:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c536d3 lrc: 3/0,1 mode: --/PW res: [0x2bb97:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.756150:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ef7d105 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997072768:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.756152:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c536cc lrc: 3/0,1 mode: --/PW res: [0x2bb96:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.756275:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ad6d0877 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997073152:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529427.756277:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000050bbb886 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997073088:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.756280:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c536f6 lrc: 3/0,1 mode: --/PW res: [0x2bb9c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.756282:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c536ef lrc: 3/0,1 mode: --/PW res: [0x2bb9b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.756287:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000043b7984f pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997073216:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.756290:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c536fd lrc: 3/0,1 mode: --/PW res: [0x2bb9d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.756662:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529427.756671:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529427.756677:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529427.756683:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529427.756695:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529427.756700:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529427.756701:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396829824 00000100:00100000:1.0:1651529427.756705:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529427.756708:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c53441 lrc: 4/0,0 mode: PW/PW res: [0x2bb96:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc352 expref: 85 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.756713:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529427.756714:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396829952 00010000:00010000:0.0:1651529427.756716:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c53456 lrc: 4/0,0 mode: PW/PW res: [0x2bb99:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc37c expref: 86 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.756719:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396830080 00000100:00100000:0.0:1651529427.756720:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396830208 00010000:00010000:0.0:1651529427.756722:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c5346b lrc: 4/0,0 mode: PW/PW res: [0x2bb9c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3a6 expref: 88 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.756725:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c5345d lrc: 4/0,0 mode: PW/PW res: [0x2bb9a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc38a expref: 88 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.756726:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396829888 00010000:00010000:0.0:1651529427.756728:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c53448 lrc: 4/0,0 mode: PW/PW res: [0x2bb97:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc360 expref: 89 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.756732:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396830016 00000100:00100000:0.0:1651529427.756733:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396830144 00010000:00010000:1.0:1651529427.756734:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c5344f lrc: 4/0,0 mode: PW/PW res: [0x2bb98:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc36e expref: 91 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.756735:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c53464 lrc: 4/0,0 mode: PW/PW res: [0x2bb9b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc398 expref: 91 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.756738:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396830272 00000100:00100000:0.0:1651529427.756740:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13370 00010000:00010000:1.0:1651529427.756741:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c53472 lrc: 4/0,0 mode: PW/PW res: [0x2bb9d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3b4 expref: 92 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.756742:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000e855587 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+92:41279:x1731746396829824:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529427.756745:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529427.756746:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13371 00010000:00010000:0.0:1651529427.756746:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c53441 lrc: 4/0,0 mode: PW/PW res: [0x2bb96:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc352 expref: 92 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.756748:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+92:41279:x1731746396829952:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529427.756750:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c53441 lrc: 3/0,0 mode: PW/PW res: [0x2bb96:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc352 expref: 92 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.756751:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529427.756752:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c53456 lrc: 4/0,0 mode: PW/PW res: [0x2bb99:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc37c expref: 92 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.756756:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c53456 lrc: 3/0,0 mode: PW/PW res: [0x2bb99:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc37c expref: 92 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.756756:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c53441 lrc: 0/0,0 mode: --/PW res: [0x2bb96:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc352 expref: 92 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.756760:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.756761:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.756761:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c536cc lrc: 3/0,1 mode: PW/PW res: [0x2bb96:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.756763:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c53456 lrc: 0/0,0 mode: --/PW res: [0x2bb99:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc37c expref: 91 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.756765:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c536cc lrc: 4/0,1 mode: PW/PW res: [0x2bb96:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.756766:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.756767:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.756768:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001fb1a013/0x3234de053c536e1 lrc: 3/0,1 mode: PW/PW res: [0x2bb99:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.756771:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fb1a013/0x3234de053c536e1 lrc: 4/0,1 mode: PW/PW res: [0x2bb99:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.756772:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529427.756790:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529427.756800:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000e855587 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+90:41279:x1731746396829824:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 57us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529427.756803:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13370 00000100:00100000:1.0:1651529427.756805:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+90:41279:x1731746396829952:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 56us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529427.756808:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13371 00000100:00100000:0.0:1651529427.756813:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13372 00000100:00100000:1.0:1651529427.756815:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13373 00000100:00100000:0.0:1651529427.756815:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+88:41279:x1731746396830208:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529427.756817:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+88:41279:x1731746396830080:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529427.756818:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529427.756820:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529427.756820:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c5346b lrc: 4/0,0 mode: PW/PW res: [0x2bb9c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3a6 expref: 88 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.756822:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c5345d lrc: 4/0,0 mode: PW/PW res: [0x2bb9a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc38a expref: 88 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.756824:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c5346b lrc: 3/0,0 mode: PW/PW res: [0x2bb9c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3a6 expref: 88 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.756825:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c5345d lrc: 3/0,0 mode: PW/PW res: [0x2bb9a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc38a expref: 88 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.756829:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c5346b lrc: 0/0,0 mode: --/PW res: [0x2bb9c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3a6 expref: 88 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.756831:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c5345d lrc: 0/0,0 mode: --/PW res: [0x2bb9a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc38a expref: 88 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.756833:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.756833:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.756834:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.756834:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c536f6 lrc: 3/0,1 mode: PW/PW res: [0x2bb9c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.756835:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.756836:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c536e8 lrc: 3/0,1 mode: PW/PW res: [0x2bb9a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.756837:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c536f6 lrc: 4/0,1 mode: PW/PW res: [0x2bb9c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.756839:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c536e8 lrc: 4/0,1 mode: PW/PW res: [0x2bb9a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.756844:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529427.756849:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529427.756856:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+86:41279:x1731746396830208:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529427.756857:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+86:41279:x1731746396830080:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 39us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529427.756859:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13372 00000100:00100000:1.0:1651529427.756860:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13373 00000100:00100000:0.0:1651529427.756863:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13374 00000100:00100000:0.0:1651529427.756865:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+84:41279:x1731746396829888:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529427.756866:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13375 00000100:00100000:1.0:1651529427.756867:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+84:41279:x1731746396830016:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529427.756868:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529427.756869:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c53448 lrc: 4/0,0 mode: PW/PW res: [0x2bb97:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc360 expref: 84 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.756870:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529427.756871:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c5344f lrc: 4/0,0 mode: PW/PW res: [0x2bb98:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc36e expref: 84 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.756873:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c53448 lrc: 3/0,0 mode: PW/PW res: [0x2bb97:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc360 expref: 84 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.756875:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c5344f lrc: 3/0,0 mode: PW/PW res: [0x2bb98:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc36e expref: 84 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.756878:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c53448 lrc: 0/0,0 mode: --/PW res: [0x2bb97:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc360 expref: 84 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.756879:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c5344f lrc: 0/0,0 mode: --/PW res: [0x2bb98:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc36e expref: 84 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.756884:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.756885:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.756886:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.756886:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.756886:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c536d3 lrc: 3/0,1 mode: PW/PW res: [0x2bb97:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.756887:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c536da lrc: 3/0,1 mode: PW/PW res: [0x2bb98:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.756889:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c536d3 lrc: 4/0,1 mode: PW/PW res: [0x2bb97:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.756890:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c536da lrc: 4/0,1 mode: PW/PW res: [0x2bb98:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.756894:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529427.756896:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529427.756900:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+82:41279:x1731746396829888:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 34us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529427.756901:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+82:41279:x1731746396830016:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529427.756902:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13374 00000100:00100000:1.0:1651529427.756904:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13375 00000100:00100000:0.0:1651529427.756906:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13376 00000100:00100000:1.0:1651529427.756908:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13377 00000100:00100000:0.0:1651529427.756908:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+80:41279:x1731746396830144:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529427.756909:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e29becaf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+80:41279:x1731746396830272:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529427.756910:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529427.756911:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c53464 lrc: 4/0,0 mode: PW/PW res: [0x2bb9b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc398 expref: 80 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.756912:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529427.756913:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c53472 lrc: 4/0,0 mode: PW/PW res: [0x2bb9d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3b4 expref: 80 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.756915:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c53464 lrc: 3/0,0 mode: PW/PW res: [0x2bb9b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc398 expref: 80 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.756917:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c53472 lrc: 3/0,0 mode: PW/PW res: [0x2bb9d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3b4 expref: 80 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.756920:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c53464 lrc: 0/0,0 mode: --/PW res: [0x2bb9b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc398 expref: 80 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.756921:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c53472 lrc: 0/0,0 mode: --/PW res: [0x2bb9d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3b4 expref: 80 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.756923:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.756923:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.756924:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.756924:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c536ef lrc: 3/0,1 mode: PW/PW res: [0x2bb9b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.756925:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.756926:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c536fd lrc: 3/0,1 mode: PW/PW res: [0x2bb9d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.756927:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c536ef lrc: 4/0,1 mode: PW/PW res: [0x2bb9b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.756929:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c536fd lrc: 4/0,1 mode: PW/PW res: [0x2bb9d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.756941:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529427.756942:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529427.756947:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e29becaf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+78:41279:x1731746396830272:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 37us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529427.756949:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+78:41279:x1731746396830144:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529427.756950:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13377 00000100:00100000:0.0:1651529427.756951:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13376 00010000:00010000:1.0:1651529427.756958:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c536da lrc: 3/0,1 mode: PW/PW res: [0x2bb98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.756961:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c536da lrc: 3/0,1 mode: PW/PW res: [0x2bb98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.756962:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001fb1a013/0x3234de053c536e1 lrc: 3/0,1 mode: PW/PW res: [0x2bb99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.756964:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c536da lrc: 3/0,1 mode: PW/PW res: [0x2bb98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.756965:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fb1a013/0x3234de053c536e1 lrc: 3/0,1 mode: PW/PW res: [0x2bb99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.756967:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c536da lrc: 2/0,0 mode: PW/PW res: [0x2bb98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.756968:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fb1a013/0x3234de053c536e1 lrc: 3/0,1 mode: PW/PW res: [0x2bb99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.756971:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fb1a013/0x3234de053c536e1 lrc: 2/0,0 mode: PW/PW res: [0x2bb99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.757115:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000b6aa823 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:39029:x1731745946606144:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1736us (1869us total) trans 12885080919 rc 0/0 00000100:00100000:1.0:1651529427.757118:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212912 00000100:00100000:0.0:1651529427.757120:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f55117eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:39030:x1731745946606208:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1737us (1842us total) trans 12885080920 rc 0/0 00000100:00100000:0.0:1651529427.757123:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212913 00010000:00010000:0.0:1651529427.757131:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c536da lrc: 2/0,0 mode: PW/PW res: [0x2bb98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.757137:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cd5f3a7c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.757138:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c536da lrc: 2/0,0 mode: PW/PW res: [0x2bb98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.757141:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c536da lrc: 3/0,0 mode: PW/PW res: [0x2bb98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.757146:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c536da lrc: 1/0,0 mode: --/PW res: [0x2bb98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.757148:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c536da lrc: 0/0,0 mode: --/PW res: [0x2bb98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.757153:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fb1a013/0x3234de053c536e1 lrc: 2/0,0 mode: PW/PW res: [0x2bb99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.757155:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fb1a013 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.757156:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fb1a013/0x3234de053c536e1 lrc: 2/0,0 mode: PW/PW res: [0x2bb99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.757159:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fb1a013/0x3234de053c536e1 lrc: 3/0,0 mode: PW/PW res: [0x2bb99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.757162:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fb1a013/0x3234de053c536e1 lrc: 1/0,0 mode: --/PW res: [0x2bb99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.757165:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fb1a013/0x3234de053c536e1 lrc: 0/0,0 mode: --/PW res: [0x2bb99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.757171:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c536e8 lrc: 3/0,1 mode: PW/PW res: [0x2bb9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.757174:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c536e8 lrc: 3/0,1 mode: PW/PW res: [0x2bb9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.757177:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c536e8 lrc: 3/0,1 mode: PW/PW res: [0x2bb9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.757179:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c536e8 lrc: 2/0,0 mode: PW/PW res: [0x2bb9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.757210:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c536ef lrc: 3/0,1 mode: PW/PW res: [0x2bb9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.757237:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c536ef lrc: 3/0,1 mode: PW/PW res: [0x2bb9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.757241:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c536ef lrc: 3/0,1 mode: PW/PW res: [0x2bb9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.757244:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c536ef lrc: 2/0,0 mode: PW/PW res: [0x2bb9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.757377:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e2020717 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:39029:x1731745946606272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1948us (2060us total) trans 12885080921 rc 0/0 00000100:00100000:0.0:1651529427.757380:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212914 00010000:00010000:0.0:1651529427.757388:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c536e8 lrc: 2/0,0 mode: PW/PW res: [0x2bb9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.757391:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1791842 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.757392:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c536e8 lrc: 2/0,0 mode: PW/PW res: [0x2bb9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.757395:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c536e8 lrc: 3/0,0 mode: PW/PW res: [0x2bb9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.757396:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+30:39030:x1731745946606336:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1921us (2067us total) trans 12885080922 rc 0/0 00010000:00010000:0.0:1651529427.757399:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c536e8 lrc: 1/0,0 mode: --/PW res: [0x2bb9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.757400:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212915 00010000:00010000:0.0:1651529427.757402:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c536e8 lrc: 0/0,0 mode: --/PW res: [0x2bb9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.757406:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c536ef lrc: 2/0,0 mode: PW/PW res: [0x2bb9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.757409:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ebdbebae already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.757410:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c536ef lrc: 2/0,0 mode: PW/PW res: [0x2bb9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.757413:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c536ef lrc: 3/0,0 mode: PW/PW res: [0x2bb9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.757415:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529427.757416:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c536ef lrc: 1/0,0 mode: --/PW res: [0x2bb9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.757418:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c536ef lrc: 0/0,0 mode: --/PW res: [0x2bb9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.757424:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c536f6 lrc: 3/0,1 mode: PW/PW res: [0x2bb9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.757427:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c536f6 lrc: 3/0,1 mode: PW/PW res: [0x2bb9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.757429:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529427.757430:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c536f6 lrc: 3/0,1 mode: PW/PW res: [0x2bb9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.757433:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c536f6 lrc: 2/0,0 mode: PW/PW res: [0x2bb9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.757462:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946606528 00000100:00100000:1.0:1651529427.757472:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946606592 00000100:00100000:1.0:1651529427.757477:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212918 00000100:00100000:1.0:1651529427.757479:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:39030:x1731745946606528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529427.757485:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179102 count 1 00010000:00010000:1.0:1651529427.757490:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c53704 lrc: 3/0,1 mode: --/PW res: [0x2bb9e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.757495:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c53479 lrc: 2/0,0 mode: PW/PW res: [0x2bb9e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3c2 expref: 76 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.757498:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.757499:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.757500:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c53704 lrc: 4/0,1 mode: --/PW res: [0x2bb9e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.757507:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c53479 lrc: 3/0,0 mode: PW/PW res: [0x2bb9e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3c2 expref: 76 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.757511:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c53479 lrc: 4/0,0 mode: PW/PW res: [0x2bb9e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3c2 expref: 76 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.757515:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d6486d55 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997073280:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529427.757527:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 0000000053a0cffa going to sleep for 6 seconds 00000100:00100000:1.0:1651529427.757533:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212919 00000100:00100000:1.0:1651529427.757535:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+32:39030:x1731745946606592:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529427.757539:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179103 count 1 00010000:00010000:1.0:1651529427.757543:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c5370b lrc: 3/0,1 mode: --/PW res: [0x2bb9f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.757547:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c53480 lrc: 2/0,0 mode: PW/PW res: [0x2bb9f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3d0 expref: 76 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.757550:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.757551:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.757551:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c5370b lrc: 4/0,1 mode: --/PW res: [0x2bb9f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.757557:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c53480 lrc: 3/0,0 mode: PW/PW res: [0x2bb9f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3d0 expref: 76 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.757563:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c53480 lrc: 4/0,0 mode: PW/PW res: [0x2bb9f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3d0 expref: 76 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.757567:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000086eaa330 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997073344:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529427.757573:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000412e5d26 going to sleep for 6 seconds 00000100:00100000:0.0:1651529427.757583:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+32:39029:x1731745946606400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 2104us (2245us total) trans 12885080923 rc 0/0 00000100:00100000:0.0:1651529427.757586:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212916 00010000:00010000:0.0:1651529427.757605:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c536f6 lrc: 2/0,0 mode: PW/PW res: [0x2bb9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.757609:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000050f78364 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.757610:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c536f6 lrc: 2/0,0 mode: PW/PW res: [0x2bb9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.757613:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c536f6 lrc: 3/0,0 mode: PW/PW res: [0x2bb9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.757618:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c536f6 lrc: 1/0,0 mode: --/PW res: [0x2bb9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.757620:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c536f6 lrc: 0/0,0 mode: --/PW res: [0x2bb9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.757627:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529427.757628:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c536fd lrc: 3/0,1 mode: PW/PW res: [0x2bb9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.757631:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c536fd lrc: 3/0,1 mode: PW/PW res: [0x2bb9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.757640:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c536fd lrc: 3/0,1 mode: PW/PW res: [0x2bb9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.757643:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c536fd lrc: 2/0,0 mode: PW/PW res: [0x2bb9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.757659:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529427.757792:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529427.757825:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+32:39030:x1731745946606464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 2298us (2479us total) trans 12885080924 rc 0/0 00000100:00100000:0.0:1651529427.757828:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212917 00000100:00100000:0.0:1651529427.757834:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946606656 00000100:00100000:0.0:1651529427.757841:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946606720 00000100:00100000:0.0:1651529427.757847:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946606784 00000100:00100000:0.0:1651529427.757852:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212920 00000100:00100000:0.0:1651529427.757854:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+34:39029:x1731745946606656:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529427.757859:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179104 count 1 00010000:00010000:0.0:1651529427.757864:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53712 lrc: 3/0,1 mode: --/PW res: [0x2bba0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.757869:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c53487 lrc: 2/0,0 mode: PW/PW res: [0x2bba0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3de expref: 76 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.757871:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212921 00010000:00010000:0.0:1651529427.757872:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1651529427.757873:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+34:39029:x1731745946606720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529427.757873:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.757874:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53712 lrc: 4/0,1 mode: --/PW res: [0x2bba0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529427.757879:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179105 count 1 00010000:00010000:0.0:1651529427.757881:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c53487 lrc: 3/0,0 mode: PW/PW res: [0x2bba0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3de expref: 76 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.757884:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c53719 lrc: 3/0,1 mode: --/PW res: [0x2bba1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.757885:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c53487 lrc: 4/0,0 mode: PW/PW res: [0x2bba0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3de expref: 76 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.757888:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c5348e lrc: 2/0,0 mode: PW/PW res: [0x2bba1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3ec expref: 76 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.757889:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000043b7984f pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997073408:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529427.757892:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.757892:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.757893:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c53719 lrc: 4/0,1 mode: --/PW res: [0x2bba1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.757902:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 0000000080004f0a going to sleep for 6 seconds 00010000:00010000:1.0:1651529427.757906:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c5348e lrc: 3/0,0 mode: PW/PW res: [0x2bba1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3ec expref: 76 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.757908:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c536fd lrc: 2/0,0 mode: PW/PW res: [0x2bb9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.757910:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c5348e lrc: 4/0,0 mode: PW/PW res: [0x2bba1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3ec expref: 76 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.757911:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6fcae44 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.757912:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c536fd lrc: 2/0,0 mode: PW/PW res: [0x2bb9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.757915:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bc420ca1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997073472:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.757915:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c536fd lrc: 3/0,0 mode: PW/PW res: [0x2bb9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.757920:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c536fd lrc: 1/0,0 mode: --/PW res: [0x2bb9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.757923:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c536fd lrc: 0/0,0 mode: --/PW res: [0x2bb9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.757925:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a5495eb going to sleep for 6 seconds 00000100:00100000:0.0:1651529427.757931:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212922 00000100:00100000:0.0:1651529427.757933:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012756c2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+34:39029:x1731745946606784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529427.757938:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179106 count 1 00010000:00010000:0.0:1651529427.757941:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c53720 lrc: 3/0,1 mode: --/PW res: [0x2bba2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.757945:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c53495 lrc: 2/0,0 mode: PW/PW res: [0x2bba2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3fa expref: 76 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.757948:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.757949:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.757949:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c53720 lrc: 4/0,1 mode: --/PW res: [0x2bba2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.757955:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c53495 lrc: 3/0,0 mode: PW/PW res: [0x2bba2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3fa expref: 76 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.757959:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c53495 lrc: 4/0,0 mode: PW/PW res: [0x2bba2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3fa expref: 76 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.757963:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ad6d0877 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997073536:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529427.757998:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 0000000075259221 going to sleep for 6 seconds 00010000:00010000:0.0:1651529427.758005:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c536d3 lrc: 3/0,1 mode: PW/PW res: [0x2bb97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.758009:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c536d3 lrc: 3/0,1 mode: PW/PW res: [0x2bb97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.758012:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c536d3 lrc: 3/0,1 mode: PW/PW res: [0x2bb97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.758014:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c536d3 lrc: 2/0,0 mode: PW/PW res: [0x2bb97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.758018:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529427.758155:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eb9cb61d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+35:39030:x1731745946606080:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 2852us (2946us total) trans 12885080925 rc 0/0 00000100:00100000:0.0:1651529427.758159:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212911 00000100:00100000:0.0:1651529427.758164:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946606848 00000100:00100000:0.0:1651529427.758171:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212923 00000100:00100000:0.0:1651529427.758173:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+35:39029:x1731745946606848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529427.758178:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179107 count 1 00010000:00010000:0.0:1651529427.758182:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c53727 lrc: 3/0,1 mode: --/PW res: [0x2bba3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.758186:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c5349c lrc: 2/0,0 mode: PW/PW res: [0x2bba3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc408 expref: 76 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.758190:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.758190:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.758191:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c53727 lrc: 4/0,1 mode: --/PW res: [0x2bba3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.758197:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c5349c lrc: 3/0,0 mode: PW/PW res: [0x2bba3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc408 expref: 76 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.758201:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c5349c lrc: 4/0,0 mode: PW/PW res: [0x2bba3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc408 expref: 76 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.758205:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000075b025a pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997073600:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529427.758218:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bd9ed213 going to sleep for 6 seconds 00010000:00010000:0.0:1651529427.758238:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c536d3 lrc: 2/0,0 mode: PW/PW res: [0x2bb97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.758242:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000819c7a2f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.758243:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c536d3 lrc: 2/0,0 mode: PW/PW res: [0x2bb97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.758246:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c536d3 lrc: 3/0,0 mode: PW/PW res: [0x2bb97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.758250:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c536d3 lrc: 1/0,0 mode: --/PW res: [0x2bb97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.758253:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c536d3 lrc: 0/0,0 mode: --/PW res: [0x2bb97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.758263:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c536cc lrc: 3/0,1 mode: PW/PW res: [0x2bb96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.758266:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c536cc lrc: 3/0,1 mode: PW/PW res: [0x2bb96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.758269:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c536cc lrc: 3/0,1 mode: PW/PW res: [0x2bb96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.758272:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c536cc lrc: 2/0,0 mode: PW/PW res: [0x2bb96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.758349:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529427.758389:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529427.758403:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529427.758410:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396830400 00010000:00010000:1.0:1651529427.758416:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c53480 lrc: 5/0,0 mode: PW/PW res: [0x2bb9f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3d0 expref: 77 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.758423:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396830336 00010000:00010000:1.0:1651529427.758425:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c53479 lrc: 5/0,0 mode: PW/PW res: [0x2bb9e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3c2 expref: 78 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.758431:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13378 00000100:00100000:1.0:1651529427.758433:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+78:41278:x1731746396830400:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529427.758436:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529427.758437:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c53480 lrc: 5/0,0 mode: PW/PW res: [0x2bb9f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3d0 expref: 78 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.758441:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c53480 lrc: 4/0,0 mode: PW/PW res: [0x2bb9f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3d0 expref: 78 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.758447:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.758447:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.758448:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c5370b lrc: 3/0,1 mode: PW/PW res: [0x2bb9f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.758453:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007f9b0c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+36:39030:x1731745946606016:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 3304us (3329us total) trans 12885080926 rc 0/0 00000100:00100000:0.0:1651529427.758457:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212910 00010000:00010000:1.0:1651529427.758459:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c5370b lrc: 4/0,1 mode: PW/PW res: [0x2bb9f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.758462:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946606912 00010000:00010000:1.0:1651529427.758464:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529427.758469:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212924 00000100:00100000:1.0:1651529427.758471:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+78:41278:x1731746396830400:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 38us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529427.758471:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+36:39029:x1731745946606912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529427.758474:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13378 00002000:00080000:0.0:1651529427.758475:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179108 count 1 00000100:00100000:1.0:1651529427.758479:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13379 00000100:00100000:1.0:1651529427.758480:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005529fd8d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+77:41278:x1731746396830336:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529427.758480:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c5372e lrc: 3/0,1 mode: --/PW res: [0x2bba4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.758483:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529427.758484:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c53479 lrc: 5/0,0 mode: PW/PW res: [0x2bb9e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3c2 expref: 77 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.758484:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c534a3 lrc: 2/0,0 mode: PW/PW res: [0x2bba4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc416 expref: 77 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.758488:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c53479 lrc: 4/0,0 mode: PW/PW res: [0x2bb9e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3c2 expref: 77 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.758488:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.758488:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.758489:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c5372e lrc: 4/0,1 mode: --/PW res: [0x2bba4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.758493:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.758493:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.758494:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c53704 lrc: 3/0,1 mode: PW/PW res: [0x2bb9e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.758495:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c534a3 lrc: 3/0,0 mode: PW/PW res: [0x2bba4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc416 expref: 77 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.758497:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c53704 lrc: 4/0,1 mode: PW/PW res: [0x2bb9e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.758499:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c534a3 lrc: 4/0,0 mode: PW/PW res: [0x2bba4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc416 expref: 77 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.758501:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529427.758503:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006e3eb319 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997073664:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529427.758506:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005529fd8d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+77:41278:x1731746396830336:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 25us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529427.758508:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13379 00010000:00010000:1.0:1651529427.758518:0:80278:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c53480 lrc: 0/0,0 mode: --/PW res: [0x2bb9f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3d0 expref: 76 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.758522:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000086eaa330 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997073344:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529427.758526:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c5370b lrc: 3/0,1 mode: PW/PW res: [0x2bb9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.758526:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b0ed27ba going to sleep for 6 seconds 00010000:00010000:1.0:1651529427.758530:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c5370b lrc: 3/0,1 mode: PW/PW res: [0x2bb9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.758532:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c5370b lrc: 3/0,1 mode: PW/PW res: [0x2bb9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.758532:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c536cc lrc: 2/0,0 mode: PW/PW res: [0x2bb96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.758536:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c5370b lrc: 3/0,1 mode: PW/PW res: [0x2bb9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.758538:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c5370b lrc: 2/0,0 mode: PW/PW res: [0x2bb9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.758538:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032c39b88 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.758539:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c536cc lrc: 2/0,0 mode: PW/PW res: [0x2bb96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.758542:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c536cc lrc: 3/0,0 mode: PW/PW res: [0x2bb96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.758552:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c536cc lrc: 1/0,0 mode: --/PW res: [0x2bb96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.758555:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c536cc lrc: 0/0,0 mode: --/PW res: [0x2bb96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.758559:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c5370b lrc: 2/0,0 mode: PW/PW res: [0x2bb9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.758562:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000feb9d3da already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.758563:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c5370b lrc: 2/0,0 mode: PW/PW res: [0x2bb9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.758566:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c5370b lrc: 3/0,0 mode: PW/PW res: [0x2bb9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.758569:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c5370b lrc: 1/0,0 mode: --/PW res: [0x2bb9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.758571:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c5370b lrc: 0/0,0 mode: --/PW res: [0x2bb9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.758675:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+37:39030:x1731745946606592:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1139us (1245us total) trans 12885080927 rc 0/0 00000100:00100000:1.0:1651529427.758678:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212919 00000100:00100000:0.0:1651529427.758732:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000043b7984f pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997073408:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.758737:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53712 lrc: 3/0,1 mode: --/PW res: [0x2bba0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.758738:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529427.758751:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396830528 00010000:00010000:0.0:1651529427.758756:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c5348e lrc: 5/0,0 mode: PW/PW res: [0x2bba1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3ec expref: 76 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.758767:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13380 00000100:00100000:0.0:1651529427.758769:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000020362888 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+76:41278:x1731746396830528:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529427.758772:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529427.758773:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c5348e lrc: 5/0,0 mode: PW/PW res: [0x2bba1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3ec expref: 76 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.758774:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529427.758785:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c5348e lrc: 4/0,0 mode: PW/PW res: [0x2bba1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3ec expref: 76 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.758791:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.758792:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.758793:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c53719 lrc: 3/0,1 mode: PW/PW res: [0x2bba1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.758796:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c53719 lrc: 4/0,1 mode: PW/PW res: [0x2bba1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.758807:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529427.758815:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000020362888 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+76:41278:x1731746396830528:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 46us (77us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529427.758818:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13380 00000100:00100000:0.0:1651529427.758823:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396830464 00010000:00010000:0.0:1651529427.758832:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c53487 lrc: 4/0,0 mode: PW/PW res: [0x2bba0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3de expref: 76 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.758843:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13381 00000100:00100000:0.0:1651529427.758844:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068b6c75f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+76:41278:x1731746396830464:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529427.758847:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529427.758848:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c53487 lrc: 4/0,0 mode: PW/PW res: [0x2bba0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3de expref: 76 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.758852:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c53487 lrc: 3/0,0 mode: PW/PW res: [0x2bba0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3de expref: 76 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.758856:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529427.758857:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c53487 lrc: 0/0,0 mode: --/PW res: [0x2bba0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3de expref: 76 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.758860:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.758861:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.758862:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53712 lrc: 3/0,1 mode: PW/PW res: [0x2bba0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.758863:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529427.758865:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53712 lrc: 4/0,1 mode: PW/PW res: [0x2bba0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.758869:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396830656 00010000:00010000:0.0:1651529427.758870:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529427.758875:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c5349c lrc: 5/0,0 mode: PW/PW res: [0x2bba3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc408 expref: 76 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.758881:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068b6c75f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+76:41278:x1731746396830464:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 35us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529427.758884:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13381 00000100:00100000:1.0:1651529427.758887:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396830592 00000100:00100000:0.0:1651529427.758888:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13382 00010000:00010000:1.0:1651529427.758890:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c53495 lrc: 5/0,0 mode: PW/PW res: [0x2bba2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3fa expref: 76 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.758890:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000036d32101 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+76:41278:x1731746396830656:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529427.758893:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529427.758894:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c5349c lrc: 5/0,0 mode: PW/PW res: [0x2bba3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc408 expref: 76 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.758895:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13383 00000100:00100000:1.0:1651529427.758897:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9b0314b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+76:41278:x1731746396830592:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529427.758898:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c5349c lrc: 4/0,0 mode: PW/PW res: [0x2bba3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc408 expref: 76 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.758900:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529427.758901:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c53495 lrc: 5/0,0 mode: PW/PW res: [0x2bba2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3fa expref: 76 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.758902:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.758903:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.758903:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c53727 lrc: 3/0,1 mode: PW/PW res: [0x2bba3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.758905:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c53495 lrc: 4/0,0 mode: PW/PW res: [0x2bba2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3fa expref: 76 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.758906:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c53727 lrc: 4/0,1 mode: PW/PW res: [0x2bba3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.758910:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529427.758911:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.758911:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.758912:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c53720 lrc: 3/0,1 mode: PW/PW res: [0x2bba2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.758915:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c53720 lrc: 4/0,1 mode: PW/PW res: [0x2bba2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.758920:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529427.758927:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9b0314b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+76:41278:x1731746396830592:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 29us (64us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529427.758930:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13383 00000100:00100000:0.0:1651529427.758932:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000036d32101 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+75:41278:x1731746396830656:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (76us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529427.758935:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13382 00010000:00010000:1.0:1651529427.758941:0:72397:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c5348e lrc: 0/0,0 mode: --/PW res: [0x2bba1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3ec expref: 74 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.758945:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bc420ca1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997073472:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.758946:0:80280:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c53495 lrc: 0/0,0 mode: --/PW res: [0x2bba2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3fa expref: 73 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.758949:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c53719 lrc: 3/0,1 mode: PW/PW res: [0x2bba1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.758950:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ad6d0877 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997073536:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529427.758952:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c53719 lrc: 3/0,1 mode: PW/PW res: [0x2bba1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.758955:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c53719 lrc: 3/0,1 mode: PW/PW res: [0x2bba1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.758955:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c53720 lrc: 3/0,1 mode: PW/PW res: [0x2bba2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.758958:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c53719 lrc: 3/0,1 mode: PW/PW res: [0x2bba1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.758958:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c53720 lrc: 3/0,1 mode: PW/PW res: [0x2bba2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.758961:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c53719 lrc: 2/0,0 mode: PW/PW res: [0x2bba1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.758961:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c53720 lrc: 3/0,1 mode: PW/PW res: [0x2bba2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.758964:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c53720 lrc: 3/0,1 mode: PW/PW res: [0x2bba2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.758966:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c53720 lrc: 2/0,0 mode: PW/PW res: [0x2bba2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.759107:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+38:39029:x1731745946606720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1233us (1447us total) trans 12885080928 rc 0/0 00000100:00100000:1.0:1651529427.759110:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212921 00000100:00100000:0.0:1651529427.759114:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012756c2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:39029:x1731745946606784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1180us (1322us total) trans 12885080929 rc 0/0 00000100:00100000:0.0:1651529427.759117:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212922 00000100:00100000:1.0:1651529427.759125:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529427.759125:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c53719 lrc: 2/0,0 mode: PW/PW res: [0x2bba1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.759128:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000090e99444 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.759136:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c53719 lrc: 2/0,0 mode: PW/PW res: [0x2bba1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.759140:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c53719 lrc: 3/0,0 mode: PW/PW res: [0x2bba1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.759142:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529427.759147:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c53719 lrc: 1/0,0 mode: --/PW res: [0x2bba1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.759150:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c53719 lrc: 0/0,0 mode: --/PW res: [0x2bba1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.759154:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c53720 lrc: 2/0,0 mode: PW/PW res: [0x2bba2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.759157:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005635b116 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.759158:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c53720 lrc: 2/0,0 mode: PW/PW res: [0x2bba2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.759161:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c53720 lrc: 3/0,0 mode: PW/PW res: [0x2bba2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.759164:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c53720 lrc: 1/0,0 mode: --/PW res: [0x2bba2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.759166:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c53720 lrc: 0/0,0 mode: --/PW res: [0x2bba2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.759174:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946607040 00000100:00100000:0.0:1651529427.759183:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946606976 00000100:00100000:0.0:1651529427.759188:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212925 00000100:00100000:0.0:1651529427.759190:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003132c0c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+38:39029:x1731745946607040:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529427.759196:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212926 00002000:00080000:0.0:1651529427.759196:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179110 count 1 00000100:00100000:1.0:1651529427.759199:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0bff89e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+38:39029:x1731745946606976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529427.759200:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c53735 lrc: 3/0,1 mode: --/PW res: [0x2bba6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.759204:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c534b1 lrc: 2/0,0 mode: PW/PW res: [0x2bba6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc432 expref: 72 pid: 151609 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529427.759205:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179109 count 1 00010000:00010000:0.0:1651529427.759208:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.759208:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.759209:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c53735 lrc: 4/0,1 mode: --/PW res: [0x2bba6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.759210:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5373c lrc: 3/0,1 mode: --/PW res: [0x2bba5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.759215:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c534aa lrc: 2/0,0 mode: PW/PW res: [0x2bba5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc424 expref: 72 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.759215:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c534b1 lrc: 3/0,0 mode: PW/PW res: [0x2bba6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc432 expref: 72 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.759218:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.759219:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.759219:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c534b1 lrc: 4/0,0 mode: PW/PW res: [0x2bba6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc432 expref: 72 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.759220:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5373c lrc: 4/0,1 mode: --/PW res: [0x2bba5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.759247:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c534aa lrc: 3/0,0 mode: PW/PW res: [0x2bba5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc424 expref: 72 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.759250:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c534aa lrc: 4/0,0 mode: PW/PW res: [0x2bba5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc424 expref: 72 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.759255:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000df603127 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997073792:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529427.759260:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ad6d0877 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997073728:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529427.759266:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a5495eb going to sleep for 6 seconds 00000100:00100000:0.0:1651529427.759270:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 0000000080004f0a going to sleep for 6 seconds 00010000:00010000:1.0:1651529427.759274:0:80276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c53479 lrc: 0/0,0 mode: --/PW res: [0x2bb9e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc3c2 expref: 72 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.759276:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53712 lrc: 3/0,1 mode: PW/PW res: [0x2bba0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.759279:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d6486d55 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997073280:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.759279:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53712 lrc: 3/0,1 mode: PW/PW res: [0x2bba0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.759282:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c53704 lrc: 3/0,1 mode: PW/PW res: [0x2bb9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.759283:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53712 lrc: 3/0,1 mode: PW/PW res: [0x2bba0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.759286:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c53704 lrc: 3/0,1 mode: PW/PW res: [0x2bb9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.759288:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c53704 lrc: 3/0,1 mode: PW/PW res: [0x2bb9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.759288:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53712 lrc: 2/0,0 mode: PW/PW res: [0x2bba0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.759292:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c53704 lrc: 3/0,1 mode: PW/PW res: [0x2bb9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.759294:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c53704 lrc: 2/0,0 mode: PW/PW res: [0x2bb9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.759436:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+40:39030:x1731745946606528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1955us (2020us total) trans 12885080930 rc 0/0 00000100:00100000:1.0:1651529427.759439:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212918 00000100:00100000:0.0:1651529427.759448:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+39:39029:x1731745946606656:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1592us (1820us total) trans 12885080931 rc 0/0 00000100:00100000:0.0:1651529427.759451:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212920 00000100:00100000:1.0:1651529427.759454:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529427.759469:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529427.759469:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946607168 00000100:00100000:0.0:1651529427.759487:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946607104 00000100:00100000:0.0:1651529427.759492:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212927 00000100:00100000:0.0:1651529427.759494:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dabd64d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+40:39029:x1731745946607168:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529427.759499:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179112 count 1 00010000:00010000:0.0:1651529427.759504:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c53743 lrc: 3/0,1 mode: --/PW res: [0x2bba8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.759509:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c534bf lrc: 2/0,0 mode: PW/PW res: [0x2bba8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc44e expref: 71 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.759512:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.759512:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.759513:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c53743 lrc: 4/0,1 mode: --/PW res: [0x2bba8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.759519:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c534bf lrc: 3/0,0 mode: PW/PW res: [0x2bba8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc44e expref: 71 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.759523:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c534bf lrc: 4/0,0 mode: PW/PW res: [0x2bba8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc44e expref: 71 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.759527:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006aa45e66 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997073856:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529427.759529:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212928 00000100:00100000:1.0:1651529427.759531:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000fe04db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:39029:x1731745946607104:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529427.759536:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179111 count 1 00000100:00100000:0.0:1651529427.759542:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 0000000059b4268b going to sleep for 6 seconds 00010000:00010000:1.0:1651529427.759547:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c5374a lrc: 3/0,1 mode: --/PW res: [0x2bba7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.759548:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53712 lrc: 2/0,0 mode: PW/PW res: [0x2bba0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.759551:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f0b0fa2c already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529427.759552:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c534b8 lrc: 2/0,0 mode: PW/PW res: [0x2bba7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc440 expref: 71 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.759552:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53712 lrc: 2/0,0 mode: PW/PW res: [0x2bba0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.759555:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53712 lrc: 3/0,0 mode: PW/PW res: [0x2bba0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.759558:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.759559:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.759559:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53712 lrc: 1/0,0 mode: --/PW res: [0x2bba0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.759560:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c5374a lrc: 4/0,1 mode: --/PW res: [0x2bba7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.759562:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53712 lrc: 0/0,0 mode: --/PW res: [0x2bba0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.759567:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c534b8 lrc: 3/0,0 mode: PW/PW res: [0x2bba7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc440 expref: 71 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.759567:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c53704 lrc: 2/0,0 mode: PW/PW res: [0x2bb9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.759569:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bdf2b6c4 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529427.759570:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c534b8 lrc: 4/0,0 mode: PW/PW res: [0x2bba7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc440 expref: 71 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.759570:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c53704 lrc: 2/0,0 mode: PW/PW res: [0x2bb9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.759573:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c53704 lrc: 3/0,0 mode: PW/PW res: [0x2bb9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.759575:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5ebc6ba pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997073920:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.759577:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c53704 lrc: 1/0,0 mode: --/PW res: [0x2bb9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.759579:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c53704 lrc: 0/0,0 mode: --/PW res: [0x2bb9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.759584:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 000000007e004c12 going to sleep for 6 seconds 00010000:00010000:0.0:1651529427.759590:0:80281:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c5349c lrc: 0/0,0 mode: --/PW res: [0x2bba3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc408 expref: 71 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.759594:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000075b025a pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997073600:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.759597:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c53727 lrc: 3/0,1 mode: PW/PW res: [0x2bba3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.759600:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c53727 lrc: 3/0,1 mode: PW/PW res: [0x2bba3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.759603:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c53727 lrc: 3/0,1 mode: PW/PW res: [0x2bba3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.759606:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c53727 lrc: 3/0,1 mode: PW/PW res: [0x2bba3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.759608:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c53727 lrc: 2/0,0 mode: PW/PW res: [0x2bba3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.759697:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529427.759714:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529427.759724:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529427.759733:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946607232 00000100:00100000:1.0:1651529427.759742:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946607296 00000100:00100000:1.0:1651529427.759747:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212929 00000100:00100000:1.0:1651529427.759749:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000597d93ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+43:39030:x1731745946607232:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529427.759754:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179113 count 1 00010000:00010000:1.0:1651529427.759759:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53751 lrc: 3/0,1 mode: --/PW res: [0x2bba9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.759764:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c534c6 lrc: 2/0,0 mode: PW/PW res: [0x2bba9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc45c expref: 70 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.759769:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.759770:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.759771:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53751 lrc: 4/0,1 mode: --/PW res: [0x2bba9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.759786:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c534c6 lrc: 3/0,0 mode: PW/PW res: [0x2bba9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc45c expref: 70 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.759790:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c534c6 lrc: 4/0,0 mode: PW/PW res: [0x2bba9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc45c expref: 70 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.759794:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000eff08db4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997073984:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529427.759805:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a6b79b05 going to sleep for 6 seconds 00000100:00100000:0.0:1651529427.759811:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+43:39029:x1731745946606848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1637us (1792us total) trans 12885080932 rc 0/0 00000100:00100000:0.0:1651529427.759814:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212923 00000100:00100000:1.0:1651529427.759818:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212930 00000100:00100000:1.0:1651529427.759820:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000056e45ef2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+42:39030:x1731745946607296:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529427.759823:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c53727 lrc: 2/0,0 mode: PW/PW res: [0x2bba3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529427.759825:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179114 count 1 00010000:00010000:0.0:1651529427.759826:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005a2cb180 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.759827:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c53727 lrc: 2/0,0 mode: PW/PW res: [0x2bba3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.759829:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c53758 lrc: 3/0,1 mode: --/PW res: [0x2bbaa:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.759830:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c53727 lrc: 3/0,0 mode: PW/PW res: [0x2bba3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.759833:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c534cd lrc: 2/0,0 mode: PW/PW res: [0x2bbaa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc46a expref: 70 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.759835:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c53727 lrc: 1/0,0 mode: --/PW res: [0x2bba3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.759836:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.759837:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.759837:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c53758 lrc: 4/0,1 mode: --/PW res: [0x2bbaa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.759838:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c53727 lrc: 0/0,0 mode: --/PW res: [0x2bba3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.759846:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c534cd lrc: 3/0,0 mode: PW/PW res: [0x2bbaa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc46a expref: 70 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.759846:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396830720 00010000:00010000:1.0:1651529427.759850:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c534cd lrc: 4/0,0 mode: PW/PW res: [0x2bbaa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc46a expref: 71 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.759850:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c534a3 lrc: 5/0,0 mode: PW/PW res: [0x2bba4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc416 expref: 71 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.759853:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c9f4ec84 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997074048:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529427.759860:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13384 00000100:00100000:0.0:1651529427.759862:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e45eb301 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+71:41279:x1731746396830720:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529427.759865:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529427.759866:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 0000000099c1da85 going to sleep for 6 seconds 00010000:00010000:0.0:1651529427.759866:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c534a3 lrc: 5/0,0 mode: PW/PW res: [0x2bba4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc416 expref: 71 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.759873:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c534a3 lrc: 4/0,0 mode: PW/PW res: [0x2bba4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc416 expref: 71 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.759878:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.759878:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.759879:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c5372e lrc: 3/0,1 mode: PW/PW res: [0x2bba4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.759882:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c5372e lrc: 4/0,1 mode: PW/PW res: [0x2bba4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.759887:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529427.759893:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e45eb301 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+71:41279:x1731746396830720:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 31us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529427.759896:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13384 00010000:00010000:0.0:1651529427.759909:0:156655:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c534a3 lrc: 0/0,0 mode: --/PW res: [0x2bba4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc416 expref: 70 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.759913:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006e3eb319 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997073664:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.759917:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c5372e lrc: 3/0,1 mode: PW/PW res: [0x2bba4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.759920:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c5372e lrc: 3/0,1 mode: PW/PW res: [0x2bba4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.759923:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c5372e lrc: 3/0,1 mode: PW/PW res: [0x2bba4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.759926:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c5372e lrc: 3/0,1 mode: PW/PW res: [0x2bba4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.759929:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c5372e lrc: 2/0,0 mode: PW/PW res: [0x2bba4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.760091:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529427.760118:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+43:39029:x1731745946606912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1646us (1768us total) trans 12885080933 rc 0/0 00000100:00100000:0.0:1651529427.760121:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212924 00000100:00100000:0.0:1651529427.760126:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946607360 00000100:00100000:0.0:1651529427.760132:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212931 00000100:00100000:0.0:1651529427.760133:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+43:39030:x1731745946607360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529427.760138:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179115 count 1 00010000:00010000:0.0:1651529427.760143:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c5375f lrc: 3/0,1 mode: --/PW res: [0x2bbab:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.760144:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529427.760147:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c534d4 lrc: 2/0,0 mode: PW/PW res: [0x2bbab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc478 expref: 69 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.760154:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529427.760157:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.760158:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.760159:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c5375f lrc: 4/0,1 mode: --/PW res: [0x2bbab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.760161:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529427.760165:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c534d4 lrc: 3/0,0 mode: PW/PW res: [0x2bbab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc478 expref: 69 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.760169:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529427.760172:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c534d4 lrc: 4/0,0 mode: PW/PW res: [0x2bbab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc478 expref: 69 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.760176:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006e3eb319 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997074112:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529427.760177:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396830848 00010000:00010000:1.0:1651529427.760182:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c534b1 lrc: 5/0,0 mode: PW/PW res: [0x2bba6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc432 expref: 70 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.760190:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b0ed27ba going to sleep for 6 seconds 00000100:00100000:1.0:1651529427.760194:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396830976 00010000:00010000:0.0:1651529427.760195:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c5372e lrc: 2/0,0 mode: PW/PW res: [0x2bba4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.760198:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c534b8 lrc: 5/0,0 mode: PW/PW res: [0x2bba7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc440 expref: 71 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.760198:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024627ba8 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.760199:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c5372e lrc: 2/0,0 mode: PW/PW res: [0x2bba4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.760202:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396830784 00010000:00010000:0.0:1651529427.760202:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c5372e lrc: 3/0,0 mode: PW/PW res: [0x2bba4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.760204:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c534aa lrc: 5/0,0 mode: PW/PW res: [0x2bba5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc424 expref: 72 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.760207:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c5372e lrc: 1/0,0 mode: --/PW res: [0x2bba4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.760208:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396830912 00010000:00010000:0.0:1651529427.760209:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c5372e lrc: 0/0,0 mode: --/PW res: [0x2bba4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.760211:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c534bf lrc: 5/0,0 mode: PW/PW res: [0x2bba8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc44e expref: 73 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.760216:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13385 00000100:00100000:1.0:1651529427.760217:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+73:41279:x1731746396830848:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529427.760221:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529427.760237:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c534b1 lrc: 5/0,0 mode: PW/PW res: [0x2bba6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc432 expref: 73 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.760241:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c534b1 lrc: 4/0,0 mode: PW/PW res: [0x2bba6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc432 expref: 73 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.760248:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.760249:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.760250:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c53735 lrc: 3/0,1 mode: PW/PW res: [0x2bba6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.760260:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c53735 lrc: 4/0,1 mode: PW/PW res: [0x2bba6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.760265:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529427.760273:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+73:41279:x1731746396830848:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 55us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529427.760276:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13385 00010000:00010000:0.0:1651529427.760280:0:80280:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c534b1 lrc: 0/0,0 mode: --/PW res: [0x2bba6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc432 expref: 72 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.760281:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13386 00000100:00100000:1.0:1651529427.760283:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+72:41279:x1731746396830976:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529427.760284:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ad6d0877 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997073728:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529427.760285:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529427.760287:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c534b8 lrc: 5/0,0 mode: PW/PW res: [0x2bba7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc440 expref: 71 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.760288:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c53735 lrc: 3/0,1 mode: PW/PW res: [0x2bba6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.760291:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c534b8 lrc: 4/0,0 mode: PW/PW res: [0x2bba7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc440 expref: 71 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.760292:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c53735 lrc: 3/0,1 mode: PW/PW res: [0x2bba6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.760294:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c53735 lrc: 3/0,1 mode: PW/PW res: [0x2bba6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.760295:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.760296:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.760296:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c5374a lrc: 3/0,1 mode: PW/PW res: [0x2bba7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.760297:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c53735 lrc: 3/0,1 mode: PW/PW res: [0x2bba6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.760299:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c5374a lrc: 4/0,1 mode: PW/PW res: [0x2bba7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.760300:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c53735 lrc: 2/0,0 mode: PW/PW res: [0x2bba6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.760303:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529427.760307:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+71:41279:x1731746396830976:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 24us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529427.760309:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13386 00000100:00100000:1.0:1651529427.760313:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13387 00000100:00100000:1.0:1651529427.760314:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+70:41279:x1731746396830784:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529427.760317:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529427.760318:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c534aa lrc: 5/0,0 mode: PW/PW res: [0x2bba5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc424 expref: 70 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.760321:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c534aa lrc: 4/0,0 mode: PW/PW res: [0x2bba5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc424 expref: 70 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.760325:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.760326:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.760326:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5373c lrc: 3/0,1 mode: PW/PW res: [0x2bba5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.760329:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5373c lrc: 4/0,1 mode: PW/PW res: [0x2bba5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.760333:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529427.760337:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+70:41279:x1731746396830784:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 22us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529427.760339:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13387 00000100:00100000:1.0:1651529427.760342:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13388 00000100:00100000:1.0:1651529427.760343:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000b6aa823 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+69:41279:x1731746396830912:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529427.760346:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529427.760347:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c534bf lrc: 5/0,0 mode: PW/PW res: [0x2bba8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc44e expref: 69 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.760350:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c534bf lrc: 4/0,0 mode: PW/PW res: [0x2bba8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc44e expref: 69 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.760354:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.760355:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.760355:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c53743 lrc: 3/0,1 mode: PW/PW res: [0x2bba8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.760358:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c53743 lrc: 4/0,1 mode: PW/PW res: [0x2bba8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.760362:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529427.760366:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000b6aa823 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+69:41279:x1731746396830912:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 22us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529427.760368:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13388 00010000:00010000:1.0:1651529427.760379:0:80278:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c534aa lrc: 0/0,0 mode: --/PW res: [0x2bba5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc424 expref: 68 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.760383:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000df603127 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997073792:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529427.760386:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5373c lrc: 3/0,1 mode: PW/PW res: [0x2bba5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.760389:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5373c lrc: 3/0,1 mode: PW/PW res: [0x2bba5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.760392:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5373c lrc: 3/0,1 mode: PW/PW res: [0x2bba5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.760395:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5373c lrc: 3/0,1 mode: PW/PW res: [0x2bba5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.760398:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5373c lrc: 2/0,0 mode: PW/PW res: [0x2bba5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.760435:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003132c0c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+45:39029:x1731745946607040:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1244us (1309us total) trans 12885080934 rc 0/0 00000100:00100000:0.0:1651529427.760438:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212925 00010000:00010000:0.0:1651529427.760446:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c53735 lrc: 2/0,0 mode: PW/PW res: [0x2bba6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.760449:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004f988dee already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.760450:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c53735 lrc: 2/0,0 mode: PW/PW res: [0x2bba6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.760452:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c53735 lrc: 3/0,0 mode: PW/PW res: [0x2bba6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.760460:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c53735 lrc: 1/0,0 mode: --/PW res: [0x2bba6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.760463:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c53735 lrc: 0/0,0 mode: --/PW res: [0x2bba6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.760467:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5373c lrc: 2/0,0 mode: PW/PW res: [0x2bba5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.760469:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004b2a6b06 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.760470:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5373c lrc: 2/0,0 mode: PW/PW res: [0x2bba5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.760473:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5373c lrc: 3/0,0 mode: PW/PW res: [0x2bba5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.760476:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5373c lrc: 1/0,0 mode: --/PW res: [0x2bba5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.760479:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5373c lrc: 0/0,0 mode: --/PW res: [0x2bba5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.760489:0:80279:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c534bf lrc: 0/0,0 mode: --/PW res: [0x2bba8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc44e expref: 67 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.760492:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006aa45e66 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997073856:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.760496:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c53743 lrc: 3/0,1 mode: PW/PW res: [0x2bba8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.760499:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c53743 lrc: 3/0,1 mode: PW/PW res: [0x2bba8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.760502:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c53743 lrc: 3/0,1 mode: PW/PW res: [0x2bba8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.760505:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c53743 lrc: 3/0,1 mode: PW/PW res: [0x2bba8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.760508:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c53743 lrc: 2/0,0 mode: PW/PW res: [0x2bba8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.760533:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0bff89e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+45:39029:x1731745946606976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1334us (1390us total) trans 12885080935 rc 0/0 00000100:00100000:1.0:1651529427.760536:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212926 00010000:00010000:1.0:1651529427.760547:0:72397:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c534b8 lrc: 0/0,0 mode: --/PW res: [0x2bba7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc440 expref: 66 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.760554:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5ebc6ba pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997073920:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529427.760558:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c5374a lrc: 3/0,1 mode: PW/PW res: [0x2bba7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.760561:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c5374a lrc: 3/0,1 mode: PW/PW res: [0x2bba7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.760564:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c5374a lrc: 3/0,1 mode: PW/PW res: [0x2bba7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.760567:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c5374a lrc: 3/0,1 mode: PW/PW res: [0x2bba7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.760570:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c5374a lrc: 2/0,0 mode: PW/PW res: [0x2bba7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.760647:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dabd64d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+45:39029:x1731745946607168:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1152us (1192us total) trans 12885080936 rc 0/0 00000100:00100000:0.0:1651529427.760650:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212927 00010000:00010000:0.0:1651529427.760657:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c53743 lrc: 2/0,0 mode: PW/PW res: [0x2bba8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.760661:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f146053f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.760661:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c53743 lrc: 2/0,0 mode: PW/PW res: [0x2bba8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.760664:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c53743 lrc: 3/0,0 mode: PW/PW res: [0x2bba8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.760671:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c53743 lrc: 1/0,0 mode: --/PW res: [0x2bba8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.760674:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c53743 lrc: 0/0,0 mode: --/PW res: [0x2bba8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.760678:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c5374a lrc: 2/0,0 mode: PW/PW res: [0x2bba7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.760681:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000066921086 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.760682:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c5374a lrc: 2/0,0 mode: PW/PW res: [0x2bba7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.760684:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c5374a lrc: 3/0,0 mode: PW/PW res: [0x2bba7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.760688:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c5374a lrc: 1/0,0 mode: --/PW res: [0x2bba7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.760690:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c5374a lrc: 0/0,0 mode: --/PW res: [0x2bba7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.760703:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000fe04db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+44:39029:x1731745946607104:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1171us (1233us total) trans 12885080937 rc 0/0 00000100:00100000:1.0:1651529427.760706:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212928 00000100:00100000:1.0:1651529427.760733:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529427.760752:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529427.760768:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529427.760773:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396831040 00010000:00010000:0.0:1651529427.760788:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c534c6 lrc: 5/0,0 mode: PW/PW res: [0x2bba9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc45c expref: 66 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.760798:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396831104 00010000:00010000:0.0:1651529427.760801:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c534cd lrc: 5/0,0 mode: PW/PW res: [0x2bbaa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc46a expref: 67 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.760809:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13389 00000100:00100000:0.0:1651529427.760810:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e2020717 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+67:41278:x1731746396831040:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529427.760814:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529427.760815:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c534c6 lrc: 5/0,0 mode: PW/PW res: [0x2bba9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc45c expref: 67 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.760819:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c534c6 lrc: 4/0,0 mode: PW/PW res: [0x2bba9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc45c expref: 67 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.760824:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.760825:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.760826:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53751 lrc: 3/0,1 mode: PW/PW res: [0x2bba9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.760829:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53751 lrc: 4/0,1 mode: PW/PW res: [0x2bba9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.760834:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529427.760841:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e2020717 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+67:41278:x1731746396831040:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 30us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529427.760843:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13389 00000100:00100000:0.0:1651529427.760848:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13390 00000100:00100000:0.0:1651529427.760849:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eb9cb61d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+66:41278:x1731746396831104:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529427.760851:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529427.760853:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c534cd lrc: 5/0,0 mode: PW/PW res: [0x2bbaa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc46a expref: 66 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.760856:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c534cd lrc: 4/0,0 mode: PW/PW res: [0x2bbaa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc46a expref: 66 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.760860:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.760861:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.760862:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c53758 lrc: 3/0,1 mode: PW/PW res: [0x2bbaa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.760876:0:80277:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c534cd lrc: 0/0,0 mode: --/PW res: [0x2bbaa:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc46a expref: 66 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.760881:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c53758 lrc: 4/0,1 mode: PW/PW res: [0x2bbaa:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.760883:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c9f4ec84 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997074048:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.760886:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529427.760888:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c53758 lrc: 3/0,1 mode: PW/PW res: [0x2bbaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.760891:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c53758 lrc: 3/0,1 mode: PW/PW res: [0x2bbaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.760894:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c53758 lrc: 3/0,1 mode: PW/PW res: [0x2bbaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.760898:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eb9cb61d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+65:41278:x1731746396831104:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 48us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529427.760901:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13390 00010000:00010000:1.0:1651529427.760903:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c53758 lrc: 3/0,1 mode: PW/PW res: [0x2bbaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.760905:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c53758 lrc: 2/0,0 mode: PW/PW res: [0x2bbaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.760917:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c53758 lrc: 2/0,0 mode: PW/PW res: [0x2bbaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.760921:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dd6b1be4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.760922:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c53758 lrc: 2/0,0 mode: PW/PW res: [0x2bbaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.760925:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c53758 lrc: 3/0,0 mode: PW/PW res: [0x2bbaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.760929:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c53758 lrc: 1/0,0 mode: --/PW res: [0x2bbaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.760932:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c53758 lrc: 0/0,0 mode: --/PW res: [0x2bbaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.761035:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000056e45ef2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:39030:x1731745946607296:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1214us (1320us total) trans 12885080938 rc 0/0 00000100:00100000:1.0:1651529427.761038:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212930 00000100:00100000:1.0:1651529427.761043:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946607424 00000100:00100000:1.0:1651529427.761053:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212932 00000100:00100000:1.0:1651529427.761055:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f55117eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:39030:x1731745946607424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529427.761060:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179116 count 1 00010000:00010000:1.0:1651529427.761065:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c53766 lrc: 3/0,1 mode: --/PW res: [0x2bbac:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.761072:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c534db lrc: 2/0,0 mode: PW/PW res: [0x2bbac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc486 expref: 64 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.761076:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.761076:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.761077:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c53766 lrc: 4/0,1 mode: --/PW res: [0x2bbac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.761084:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c534db lrc: 3/0,0 mode: PW/PW res: [0x2bbac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc486 expref: 64 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.761087:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c534db lrc: 4/0,0 mode: PW/PW res: [0x2bbac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc486 expref: 64 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.761091:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007f9b0c6d pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997074176:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529427.761100:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 0000000099c1da85 going to sleep for 6 seconds 00010000:00010000:1.0:1651529427.761109:0:80276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c534c6 lrc: 0/0,0 mode: --/PW res: [0x2bba9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc45c expref: 64 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.761113:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000eff08db4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997073984:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529427.761117:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53751 lrc: 3/0,1 mode: PW/PW res: [0x2bba9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.761120:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53751 lrc: 3/0,1 mode: PW/PW res: [0x2bba9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.761125:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53751 lrc: 3/0,1 mode: PW/PW res: [0x2bba9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.761128:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53751 lrc: 3/0,1 mode: PW/PW res: [0x2bba9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.761131:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53751 lrc: 2/0,0 mode: PW/PW res: [0x2bba9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.761142:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53751 lrc: 2/0,0 mode: PW/PW res: [0x2bba9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.761145:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000014fe598c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.761146:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53751 lrc: 2/0,0 mode: PW/PW res: [0x2bba9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.761149:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53751 lrc: 3/0,0 mode: PW/PW res: [0x2bba9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.761153:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53751 lrc: 1/0,0 mode: --/PW res: [0x2bba9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.761156:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53751 lrc: 0/0,0 mode: --/PW res: [0x2bba9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.761280:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529427.761297:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000597d93ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+45:39030:x1731745946607232:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1547us (1600us total) trans 12885080939 rc 0/0 00000100:00100000:1.0:1651529427.761300:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212929 00000100:00100000:1.0:1651529427.761306:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946607488 00000100:00100000:0.0:1651529427.761311:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529427.761323:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946607616 00000100:00100000:1.0:1651529427.761330:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212933 00000100:00100000:1.0:1651529427.761332:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+46:39030:x1731745946607488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529427.761337:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179117 count 1 00010000:00010000:1.0:1651529427.761342:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c5376d lrc: 3/0,1 mode: --/PW res: [0x2bbad:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.761351:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529427.761354:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c534e2 lrc: 2/0,0 mode: PW/PW res: [0x2bbad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc494 expref: 63 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.761357:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.761358:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.761358:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c5376d lrc: 4/0,1 mode: --/PW res: [0x2bbad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.761366:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c534e2 lrc: 3/0,0 mode: PW/PW res: [0x2bbad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc494 expref: 63 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.761371:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529427.761376:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c534e2 lrc: 4/0,0 mode: PW/PW res: [0x2bbad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc494 expref: 63 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.761379:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529427.761380:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c9f4ec84 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997074240:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529427.761386:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946607552 00000100:00100000:1.0:1651529427.761395:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 000000007e004c12 going to sleep for 6 seconds 00000100:00100000:0.0:1651529427.761398:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946607680 00000100:00100000:1.0:1651529427.761402:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212934 00000100:00100000:1.0:1651529427.761409:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+48:39030:x1731745946607616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529427.761409:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212935 00000100:00100000:0.0:1651529427.761411:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+48:39030:x1731745946607552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529427.761414:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179119 count 1 00010000:00010000:1.0:1651529427.761418:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c53774 lrc: 3/0,1 mode: --/PW res: [0x2bbaf:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529427.761418:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179118 count 1 00010000:00010000:1.0:1651529427.761422:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c534f0 lrc: 2/0,0 mode: PW/PW res: [0x2bbaf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4b0 expref: 63 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.761423:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c5377b lrc: 3/0,1 mode: --/PW res: [0x2bbae:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.761425:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.761426:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.761426:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c53774 lrc: 4/0,1 mode: --/PW res: [0x2bbaf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.761428:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c534e9 lrc: 2/0,0 mode: PW/PW res: [0x2bbae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4a2 expref: 63 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.761431:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.761432:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.761432:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c5377b lrc: 4/0,1 mode: --/PW res: [0x2bbae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.761433:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c534f0 lrc: 3/0,0 mode: PW/PW res: [0x2bbaf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4b0 expref: 63 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.761436:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c534f0 lrc: 4/0,0 mode: PW/PW res: [0x2bbaf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4b0 expref: 63 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.761439:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c534e9 lrc: 3/0,0 mode: PW/PW res: [0x2bbae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4a2 expref: 63 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.761441:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000088fa78f8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997074304:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.761443:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c534e9 lrc: 4/0,0 mode: PW/PW res: [0x2bbae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4a2 expref: 63 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.761447:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000037ac96ac pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997074368:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529427.761448:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a5495eb going to sleep for 6 seconds 00000100:00100000:1.0:1651529427.761454:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212936 00000100:00100000:1.0:1651529427.761456:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+48:39030:x1731745946607680:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529427.761457:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 0000000066606c98 going to sleep for 6 seconds 00002000:00080000:1.0:1651529427.761460:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179120 count 1 00010000:00010000:1.0:1651529427.761463:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c53782 lrc: 3/0,1 mode: --/PW res: [0x2bbb0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.761465:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396831168 00010000:00010000:1.0:1651529427.761467:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c534f7 lrc: 2/0,0 mode: PW/PW res: [0x2bbb0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4be expref: 64 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.761469:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c534d4 lrc: 5/0,0 mode: PW/PW res: [0x2bbab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc478 expref: 64 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.761470:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.761470:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.761471:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c53782 lrc: 4/0,1 mode: --/PW res: [0x2bbb0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.761480:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13391 00000100:00100000:0.0:1651529427.761481:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d8aeac5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+64:41278:x1731746396831168:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529427.761484:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c534f7 lrc: 3/0,0 mode: PW/PW res: [0x2bbb0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4be expref: 64 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.761485:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529427.761487:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c534d4 lrc: 5/0,0 mode: PW/PW res: [0x2bbab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc478 expref: 64 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.761488:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c534f7 lrc: 4/0,0 mode: PW/PW res: [0x2bbb0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4be expref: 64 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.761490:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c534d4 lrc: 4/0,0 mode: PW/PW res: [0x2bbab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc478 expref: 64 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.761492:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003e3f0f77 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997074432:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.761496:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.761496:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.761497:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c5375f lrc: 3/0,1 mode: PW/PW res: [0x2bbab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.761499:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 000000004698fefb going to sleep for 6 seconds 00010000:00010000:0.0:1651529427.761500:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c5375f lrc: 4/0,1 mode: PW/PW res: [0x2bbab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.761505:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529427.761529:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d8aeac5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+64:41278:x1731746396831168:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 47us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529427.761532:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13391 00010000:00010000:0.0:1651529427.761550:0:156655:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c534d4 lrc: 0/0,0 mode: --/PW res: [0x2bbab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc478 expref: 63 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.761551:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529427.761554:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006e3eb319 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997074112:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.761564:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c5375f lrc: 3/0,1 mode: PW/PW res: [0x2bbab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.761568:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c5375f lrc: 3/0,1 mode: PW/PW res: [0x2bbab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.761571:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c5375f lrc: 3/0,1 mode: PW/PW res: [0x2bbab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.761574:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c5375f lrc: 3/0,1 mode: PW/PW res: [0x2bbab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.761577:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c5375f lrc: 2/0,0 mode: PW/PW res: [0x2bbab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.761592:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529427.761603:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529427.761614:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007f9b0c6d pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997074176:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529427.761618:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c53766 lrc: 3/0,1 mode: --/PW res: [0x2bbac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.761722:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+49:39030:x1731745946607360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1588us (1631us total) trans 12885080940 rc 0/0 00000100:00100000:0.0:1651529427.761725:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212931 00000100:00100000:0.0:1651529427.761731:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946607808 00000100:00100000:0.0:1651529427.761737:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946607744 00000100:00100000:0.0:1651529427.761743:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212937 00000100:00100000:0.0:1651529427.761744:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+50:39029:x1731745946607808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529427.761750:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179122 count 1 00010000:00010000:0.0:1651529427.761754:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c53789 lrc: 3/0,1 mode: --/PW res: [0x2bbb2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.761755:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212938 00000100:00100000:1.0:1651529427.761758:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+50:39029:x1731745946607744:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529427.761759:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c53505 lrc: 2/0,0 mode: PW/PW res: [0x2bbb2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4da expref: 62 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.761762:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.761763:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.761763:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c53789 lrc: 4/0,1 mode: --/PW res: [0x2bbb2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529427.761764:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179121 count 1 00010000:00010000:1.0:1651529427.761768:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53790 lrc: 3/0,1 mode: --/PW res: [0x2bbb1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.761771:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c53505 lrc: 3/0,0 mode: PW/PW res: [0x2bbb2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4da expref: 62 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.761773:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c534fe lrc: 2/0,0 mode: PW/PW res: [0x2bbb1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4cc expref: 62 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.761774:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c53505 lrc: 4/0,0 mode: PW/PW res: [0x2bbb2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4da expref: 62 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.761785:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.761786:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.761787:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53790 lrc: 4/0,1 mode: --/PW res: [0x2bbb1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.761787:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006e3eb319 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997074496:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529427.761794:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c534fe lrc: 3/0,0 mode: PW/PW res: [0x2bbb1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4cc expref: 62 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.761798:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c534fe lrc: 4/0,0 mode: PW/PW res: [0x2bbb1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4cc expref: 62 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.761801:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 0000000080004f0a going to sleep for 6 seconds 00010000:00010000:0.0:1651529427.761806:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c5375f lrc: 2/0,0 mode: PW/PW res: [0x2bbab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.761808:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000703c0db9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997074560:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.761810:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000097255e6b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.761811:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c5375f lrc: 2/0,0 mode: PW/PW res: [0x2bbab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.761814:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c5375f lrc: 3/0,0 mode: PW/PW res: [0x2bbab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.761818:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 0000000099c1da85 going to sleep for 6 seconds 00010000:00010000:0.0:1651529427.761818:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c5375f lrc: 1/0,0 mode: --/PW res: [0x2bbab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.761821:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c5375f lrc: 0/0,0 mode: --/PW res: [0x2bbab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.761829:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396831232 00010000:00010000:0.0:1651529427.761834:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c534db lrc: 4/0,0 mode: PW/PW res: [0x2bbac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc486 expref: 63 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.761843:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13392 00000100:00100000:0.0:1651529427.761845:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+63:41279:x1731746396831232:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529427.761848:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529427.761849:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c534db lrc: 4/0,0 mode: PW/PW res: [0x2bbac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc486 expref: 63 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.761853:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c534db lrc: 3/0,0 mode: PW/PW res: [0x2bbac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc486 expref: 63 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.761858:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c534db lrc: 0/0,0 mode: --/PW res: [0x2bbac:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc486 expref: 63 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.761861:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.761861:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.761862:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c53766 lrc: 3/0,1 mode: PW/PW res: [0x2bbac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.761865:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c53766 lrc: 4/0,1 mode: PW/PW res: [0x2bbac:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.761873:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529427.761877:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c53766 lrc: 3/0,1 mode: PW/PW res: [0x2bbac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.761882:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+62:41279:x1731746396831232:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 36us (280us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529427.761885:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c53766 lrc: 3/0,1 mode: PW/PW res: [0x2bbac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.761885:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13392 00010000:00010000:1.0:1651529427.761889:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c53766 lrc: 3/0,1 mode: PW/PW res: [0x2bbac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.761891:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c53766 lrc: 2/0,0 mode: PW/PW res: [0x2bbac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.761921:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c53766 lrc: 2/0,0 mode: PW/PW res: [0x2bbac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.761925:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e48e0bfd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.761926:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c53766 lrc: 2/0,0 mode: PW/PW res: [0x2bbac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.761929:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c53766 lrc: 3/0,0 mode: PW/PW res: [0x2bbac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.761933:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c53766 lrc: 1/0,0 mode: --/PW res: [0x2bbac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.761953:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c53766 lrc: 0/0,0 mode: --/PW res: [0x2bbac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.761968:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529427.761975:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946607872 00000100:00100000:0.0:1651529427.761982:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212939 00000100:00100000:0.0:1651529427.761983:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+52:39029:x1731745946607872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529427.761988:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179123 count 1 00010000:00010000:0.0:1651529427.761992:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c53797 lrc: 3/0,1 mode: --/PW res: [0x2bbb3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.761997:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c5350c lrc: 2/0,0 mode: PW/PW res: [0x2bbb3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4e8 expref: 61 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.762000:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.762001:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.762002:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c53797 lrc: 4/0,1 mode: --/PW res: [0x2bbb3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.762008:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c5350c lrc: 3/0,0 mode: PW/PW res: [0x2bbb3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4e8 expref: 61 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.762012:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c5350c lrc: 4/0,0 mode: PW/PW res: [0x2bbb3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4e8 expref: 61 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.762016:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003e8ef62e pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997074624:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529427.762026:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bd9ed213 going to sleep for 6 seconds 00000100:00100000:1.0:1651529427.762033:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f55117eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+52:39030:x1731745946607424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 977us (1300us total) trans 12885080941 rc 0/0 00000100:00100000:1.0:1651529427.762037:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212932 00000100:00100000:1.0:1651529427.762251:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529427.762258:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946607936 00000100:00100000:1.0:1651529427.762268:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212940 00000100:00100000:1.0:1651529427.762270:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+52:39029:x1731745946607936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529427.762275:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179124 count 1 00010000:00010000:1.0:1651529427.762280:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5379e lrc: 3/0,1 mode: --/PW res: [0x2bbb4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.762284:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c53513 lrc: 2/0,0 mode: PW/PW res: [0x2bbb4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4f6 expref: 61 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.762288:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.762288:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.762289:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5379e lrc: 4/0,1 mode: --/PW res: [0x2bbb4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.762306:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c53513 lrc: 3/0,0 mode: PW/PW res: [0x2bbb4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4f6 expref: 61 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.762310:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c53513 lrc: 4/0,0 mode: PW/PW res: [0x2bbb4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4f6 expref: 61 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.762314:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997074688:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529427.762314:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000037ac96ac pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997074368:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.762319:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c5377b lrc: 3/0,1 mode: --/PW res: [0x2bbae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.762325:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b52d0f36 going to sleep for 6 seconds 00000100:00100000:1.0:1651529427.762332:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000088fa78f8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997074304:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529427.762336:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c53774 lrc: 3/0,1 mode: --/PW res: [0x2bbaf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.762375:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c9f4ec84 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997074240:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529427.762378:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c5376d lrc: 3/0,1 mode: --/PW res: [0x2bbad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.762637:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529427.762640:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003e3f0f77 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997074432:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529427.762643:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529427.762644:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c53782 lrc: 3/0,1 mode: --/PW res: [0x2bbb0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.762652:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529427.762660:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529427.762667:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396831360 00000100:00100000:0.0:1651529427.762668:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529427.762672:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c534f0 lrc: 4/0,0 mode: PW/PW res: [0x2bbaf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4b0 expref: 62 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.762674:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529427.762679:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529427.762681:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13393 00000100:00100000:1.0:1651529427.762682:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+62:41279:x1731746396831360:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529427.762685:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529427.762685:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396831488 00010000:00010000:1.0:1651529427.762687:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c534f0 lrc: 4/0,0 mode: PW/PW res: [0x2bbaf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4b0 expref: 62 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.762690:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c534f0 lrc: 3/0,0 mode: PW/PW res: [0x2bbaf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4b0 expref: 63 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.762696:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c534f0 lrc: 0/0,0 mode: --/PW res: [0x2bbaf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4b0 expref: 63 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.762699:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.762700:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.762701:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c53774 lrc: 3/0,1 mode: PW/PW res: [0x2bbaf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.762704:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c53774 lrc: 4/0,1 mode: PW/PW res: [0x2bbaf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.762714:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c534f7 lrc: 4/0,0 mode: PW/PW res: [0x2bbb0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4be expref: 62 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.762721:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396831616 00010000:00010000:1.0:1651529427.762723:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529427.762724:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c534fe lrc: 5/0,0 mode: PW/PW res: [0x2bbb1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4cc expref: 63 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.762728:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396831296 00010000:00010000:0.0:1651529427.762731:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c534e2 lrc: 4/0,0 mode: PW/PW res: [0x2bbad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc494 expref: 64 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.762735:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+64:41279:x1731746396831360:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 52us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529427.762738:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13393 00000100:00100000:0.0:1651529427.762741:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396831424 00000100:00100000:1.0:1651529427.762744:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396831552 00010000:00010000:0.0:1651529427.762744:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c534e9 lrc: 4/0,0 mode: PW/PW res: [0x2bbae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4a2 expref: 64 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.762747:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c53505 lrc: 5/0,0 mode: PW/PW res: [0x2bbb2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4da expref: 65 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.762748:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396831680 00010000:00010000:0.0:1651529427.762750:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c5350c lrc: 5/0,0 mode: PW/PW res: [0x2bbb3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4e8 expref: 66 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.762753:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13394 00000100:00100000:1.0:1651529427.762755:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+66:41279:x1731746396831488:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1651529427.762756:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13395 00010000:00010000:1.0:1651529427.762757:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529427.762758:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c534f7 lrc: 4/0,0 mode: PW/PW res: [0x2bbb0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4be expref: 66 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.762758:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+66:41279:x1731746396831616:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529427.762761:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529427.762762:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c534f7 lrc: 3/0,0 mode: PW/PW res: [0x2bbb0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4be expref: 66 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.762762:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c534fe lrc: 5/0,0 mode: PW/PW res: [0x2bbb1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4cc expref: 66 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.762766:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c534fe lrc: 4/0,0 mode: PW/PW res: [0x2bbb1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4cc expref: 66 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.762767:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c534f7 lrc: 0/0,0 mode: --/PW res: [0x2bbb0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4be expref: 66 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.762770:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.762771:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.762772:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c53782 lrc: 3/0,1 mode: PW/PW res: [0x2bbb0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.762772:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.762772:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.762773:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53790 lrc: 3/0,1 mode: PW/PW res: [0x2bbb1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.762775:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c53782 lrc: 4/0,1 mode: PW/PW res: [0x2bbb0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.762790:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53790 lrc: 4/0,1 mode: PW/PW res: [0x2bbb1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.762791:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529427.762795:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529427.762797:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+65:41279:x1731746396831488:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529427.762800:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13394 00000100:00100000:0.0:1651529427.762803:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+64:41279:x1731746396831616:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 45us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529427.762805:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13396 00000100:00100000:1.0:1651529427.762807:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007f9b0c6d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+64:41279:x1731746396831296:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529427.762807:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13395 00010000:00010000:1.0:1651529427.762809:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529427.762811:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c534e2 lrc: 4/0,0 mode: PW/PW res: [0x2bbad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc494 expref: 63 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.762812:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13397 00000100:00100000:0.0:1651529427.762814:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000b6aa823 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+63:41279:x1731746396831424:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529427.762815:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c534e2 lrc: 3/0,0 mode: PW/PW res: [0x2bbad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc494 expref: 63 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.762816:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529427.762818:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c534e9 lrc: 4/0,0 mode: PW/PW res: [0x2bbae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4a2 expref: 63 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.762819:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c534e2 lrc: 0/0,0 mode: --/PW res: [0x2bbad:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc494 expref: 63 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.762822:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c534e9 lrc: 3/0,0 mode: PW/PW res: [0x2bbae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4a2 expref: 63 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.762823:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.762823:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.762824:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c5376d lrc: 3/0,1 mode: PW/PW res: [0x2bbad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.762827:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c5376d lrc: 4/0,1 mode: PW/PW res: [0x2bbad:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.762827:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c534e9 lrc: 0/0,0 mode: --/PW res: [0x2bbae:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4a2 expref: 62 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.762830:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.762831:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.762832:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529427.762832:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c5377b lrc: 3/0,1 mode: PW/PW res: [0x2bbae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.762835:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c5377b lrc: 4/0,1 mode: PW/PW res: [0x2bbae:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.762837:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007f9b0c6d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+61:41279:x1731746396831296:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 29us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529427.762839:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13396 00000100:00100000:1.0:1651529427.762843:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13398 00000100:00100000:1.0:1651529427.762844:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045c93b49 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+60:41279:x1731746396831552:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529427.762844:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529427.762846:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529427.762848:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c53505 lrc: 5/0,0 mode: PW/PW res: [0x2bbb2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4da expref: 60 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.762849:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000b6aa823 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+60:41279:x1731746396831424:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 34us (181us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529427.762851:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c53505 lrc: 4/0,0 mode: PW/PW res: [0x2bbb2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4da expref: 60 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.762851:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13397 00000100:00100000:0.0:1651529427.762855:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13399 00010000:00010000:1.0:1651529427.762856:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.762857:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.762857:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c53789 lrc: 3/0,1 mode: PW/PW res: [0x2bbb2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.762857:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e2020717 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+59:41279:x1731746396831680:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529427.762859:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529427.762860:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c53789 lrc: 4/0,1 mode: PW/PW res: [0x2bbb2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.762861:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c5350c lrc: 5/0,0 mode: PW/PW res: [0x2bbb3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4e8 expref: 59 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.762864:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529427.762864:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c5350c lrc: 4/0,0 mode: PW/PW res: [0x2bbb3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4e8 expref: 59 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.762869:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045c93b49 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+59:41279:x1731746396831552:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 24us (195us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529427.762869:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.762869:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.762870:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c53797 lrc: 3/0,1 mode: PW/PW res: [0x2bbb3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.762871:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13398 00010000:00010000:0.0:1651529427.762873:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c53797 lrc: 4/0,1 mode: PW/PW res: [0x2bbb3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.762877:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529427.762881:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e2020717 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+58:41279:x1731746396831680:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 23us (201us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529427.762882:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c53782 lrc: 3/0,1 mode: PW/PW res: [0x2bbb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.762883:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13399 00010000:00010000:1.0:1651529427.762885:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c53782 lrc: 3/0,1 mode: PW/PW res: [0x2bbb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.762888:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c53782 lrc: 3/0,1 mode: PW/PW res: [0x2bbb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.762889:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c5377b lrc: 3/0,1 mode: PW/PW res: [0x2bbae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.762891:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c53782 lrc: 2/0,0 mode: PW/PW res: [0x2bbb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.762892:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c5377b lrc: 3/0,1 mode: PW/PW res: [0x2bbae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.762895:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c5377b lrc: 3/0,1 mode: PW/PW res: [0x2bbae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.762898:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c5377b lrc: 2/0,0 mode: PW/PW res: [0x2bbae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.763037:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+54:39030:x1731745946607680:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1581us (1658us total) trans 12885080942 rc 0/0 00000100:00100000:1.0:1651529427.763041:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212936 00000100:00100000:0.0:1651529427.763046:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+53:39030:x1731745946607552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1633us (1675us total) trans 12885080943 rc 0/0 00010000:00010000:1.0:1651529427.763049:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c53774 lrc: 3/0,1 mode: PW/PW res: [0x2bbaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.763049:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212935 00010000:00010000:1.0:1651529427.763052:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c53774 lrc: 3/0,1 mode: PW/PW res: [0x2bbaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.763055:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c53774 lrc: 3/0,1 mode: PW/PW res: [0x2bbaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763057:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c53782 lrc: 2/0,0 mode: PW/PW res: [0x2bbb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.763058:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c53774 lrc: 2/0,0 mode: PW/PW res: [0x2bbaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763060:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000314b5fa1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.763061:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c53782 lrc: 2/0,0 mode: PW/PW res: [0x2bbb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763064:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c53782 lrc: 3/0,0 mode: PW/PW res: [0x2bbb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763082:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c53782 lrc: 1/0,0 mode: --/PW res: [0x2bbb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763084:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c53782 lrc: 0/0,0 mode: --/PW res: [0x2bbb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763089:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c5377b lrc: 2/0,0 mode: PW/PW res: [0x2bbae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763092:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000819c7a2f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.763093:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c5377b lrc: 2/0,0 mode: PW/PW res: [0x2bbae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763095:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c5377b lrc: 3/0,0 mode: PW/PW res: [0x2bbae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763098:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c5377b lrc: 1/0,0 mode: --/PW res: [0x2bbae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763101:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c5377b lrc: 0/0,0 mode: --/PW res: [0x2bbae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763104:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c53774 lrc: 2/0,0 mode: PW/PW res: [0x2bbaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763107:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cd5f3a7c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.763108:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c53774 lrc: 2/0,0 mode: PW/PW res: [0x2bbaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763110:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c53774 lrc: 3/0,0 mode: PW/PW res: [0x2bbaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763113:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c53774 lrc: 1/0,0 mode: --/PW res: [0x2bbaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763116:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c53774 lrc: 0/0,0 mode: --/PW res: [0x2bbaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763128:0:80281:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c5350c lrc: 0/0,0 mode: --/PW res: [0x2bbb3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4e8 expref: 57 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.763131:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003e8ef62e pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997074624:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.763135:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c53797 lrc: 3/0,1 mode: PW/PW res: [0x2bbb3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763138:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c53797 lrc: 3/0,1 mode: PW/PW res: [0x2bbb3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763140:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c53797 lrc: 3/0,1 mode: PW/PW res: [0x2bbb3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763143:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c53797 lrc: 3/0,1 mode: PW/PW res: [0x2bbb3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763146:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c53797 lrc: 2/0,0 mode: PW/PW res: [0x2bbb3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.763183:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+54:39030:x1731745946607616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1773us (1872us total) trans 12885080944 rc 0/0 00000100:00100000:1.0:1651529427.763186:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212934 00010000:00010000:1.0:1651529427.763197:0:72397:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c534fe lrc: 0/0,0 mode: --/PW res: [0x2bbb1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4cc expref: 56 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.763201:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000703c0db9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997074560:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529427.763205:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53790 lrc: 3/0,1 mode: PW/PW res: [0x2bbb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.763210:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53790 lrc: 3/0,1 mode: PW/PW res: [0x2bbb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.763213:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53790 lrc: 3/0,1 mode: PW/PW res: [0x2bbb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.763216:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53790 lrc: 3/0,1 mode: PW/PW res: [0x2bbb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.763219:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53790 lrc: 2/0,0 mode: PW/PW res: [0x2bbb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.763306:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+54:39029:x1731745946607872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1322us (1337us total) trans 12885080945 rc 0/0 00000100:00100000:0.0:1651529427.763309:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212939 00010000:00010000:0.0:1651529427.763317:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c53797 lrc: 2/0,0 mode: PW/PW res: [0x2bbb3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763321:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000050f78364 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.763322:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c53797 lrc: 2/0,0 mode: PW/PW res: [0x2bbb3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763324:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c53797 lrc: 3/0,0 mode: PW/PW res: [0x2bbb3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763329:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c53797 lrc: 1/0,0 mode: --/PW res: [0x2bbb3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763332:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c53797 lrc: 0/0,0 mode: --/PW res: [0x2bbb3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763336:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53790 lrc: 2/0,0 mode: PW/PW res: [0x2bbb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763339:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006cbd0d09 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.763340:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53790 lrc: 2/0,0 mode: PW/PW res: [0x2bbb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763342:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53790 lrc: 3/0,0 mode: PW/PW res: [0x2bbb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763345:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53790 lrc: 1/0,0 mode: --/PW res: [0x2bbb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763350:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53790 lrc: 0/0,0 mode: --/PW res: [0x2bbb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763360:0:156655:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c53505 lrc: 0/0,0 mode: --/PW res: [0x2bbb2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4da expref: 55 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.763363:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006e3eb319 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997074496:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.763367:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c53789 lrc: 3/0,1 mode: PW/PW res: [0x2bbb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763370:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c53789 lrc: 3/0,1 mode: PW/PW res: [0x2bbb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763372:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c53789 lrc: 3/0,1 mode: PW/PW res: [0x2bbb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763375:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c53789 lrc: 3/0,1 mode: PW/PW res: [0x2bbb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.763377:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+53:39029:x1731745946607744:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1618us (1785us total) trans 12885080946 rc 0/0 00010000:00010000:0.0:1651529427.763378:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c53789 lrc: 2/0,0 mode: PW/PW res: [0x2bbb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.763380:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212938 00000100:00100000:1.0:1651529427.763410:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529427.763538:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+53:39029:x1731745946607808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1792us (1986us total) trans 12885080947 rc 0/0 00000100:00100000:0.0:1651529427.763541:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212937 00000100:00100000:1.0:1651529427.763543:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997074688:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529427.763547:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5379e lrc: 3/0,1 mode: --/PW res: [0x2bbb4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763548:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c53789 lrc: 2/0,0 mode: PW/PW res: [0x2bbb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.763553:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c5376d lrc: 3/0,1 mode: PW/PW res: [0x2bbad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.763556:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c5376d lrc: 3/0,1 mode: PW/PW res: [0x2bbad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.763562:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c5376d lrc: 3/0,1 mode: PW/PW res: [0x2bbad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763564:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6fcae44 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529427.763565:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c5376d lrc: 2/0,0 mode: PW/PW res: [0x2bbad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763565:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c53789 lrc: 2/0,0 mode: PW/PW res: [0x2bbb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763568:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c53789 lrc: 3/0,0 mode: PW/PW res: [0x2bbb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763578:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c53789 lrc: 1/0,0 mode: --/PW res: [0x2bbb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763581:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c53789 lrc: 0/0,0 mode: --/PW res: [0x2bbb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763586:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c5376d lrc: 2/0,0 mode: PW/PW res: [0x2bbad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763589:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ebdbebae already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.763590:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c5376d lrc: 2/0,0 mode: PW/PW res: [0x2bbad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763593:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c5376d lrc: 3/0,0 mode: PW/PW res: [0x2bbad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763596:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c5376d lrc: 1/0,0 mode: --/PW res: [0x2bbad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763601:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c5376d lrc: 0/0,0 mode: --/PW res: [0x2bbad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.763609:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396831744 00010000:00010000:0.0:1651529427.763614:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c53513 lrc: 4/0,0 mode: PW/PW res: [0x2bbb4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4f6 expref: 55 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.763624:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13400 00000100:00100000:0.0:1651529427.763639:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+55:41278:x1731746396831744:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529427.763643:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529427.763644:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c53513 lrc: 4/0,0 mode: PW/PW res: [0x2bbb4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4f6 expref: 55 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.763648:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c53513 lrc: 3/0,0 mode: PW/PW res: [0x2bbb4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4f6 expref: 55 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.763654:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c53513 lrc: 0/0,0 mode: --/PW res: [0x2bbb4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc4f6 expref: 55 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.763667:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.763668:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.763669:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5379e lrc: 3/0,1 mode: PW/PW res: [0x2bbb4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763672:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5379e lrc: 4/0,1 mode: PW/PW res: [0x2bbb4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763684:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529427.763692:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+54:41278:x1731746396831744:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 65us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529427.763695:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13400 00000100:00100000:1.0:1651529427.763711:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+53:39030:x1731745946607488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 2378us (2442us total) trans 12885080948 rc 0/0 00000100:00100000:1.0:1651529427.763714:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212933 00000100:00100000:0.0:1651529427.763723:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529427.763738:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5379e lrc: 3/0,1 mode: PW/PW res: [0x2bbb4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.763738:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529427.763742:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5379e lrc: 3/0,1 mode: PW/PW res: [0x2bbb4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.763745:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5379e lrc: 3/0,1 mode: PW/PW res: [0x2bbb4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.763748:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5379e lrc: 2/0,0 mode: PW/PW res: [0x2bbb4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.763766:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529427.763797:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529427.763806:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529427.763814:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5379e lrc: 2/0,0 mode: PW/PW res: [0x2bbb4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763818:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000029958df2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.763819:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5379e lrc: 2/0,0 mode: PW/PW res: [0x2bbb4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763822:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5379e lrc: 3/0,0 mode: PW/PW res: [0x2bbb4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763827:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5379e lrc: 1/0,0 mode: --/PW res: [0x2bbb4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763830:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5379e lrc: 0/0,0 mode: --/PW res: [0x2bbb4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.763837:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946608000 00000100:00100000:0.0:1651529427.763844:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946608128 00000100:00100000:0.0:1651529427.763850:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946608256 00000100:00100000:0.0:1651529427.763853:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946608064 00000100:00100000:0.0:1651529427.763857:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946608192 00000100:00100000:0.0:1651529427.763861:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212941 00000100:00100000:0.0:1651529427.763862:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eb9cb61d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+58:39030:x1731745946608000:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529427.763868:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179125 count 1 00010000:00010000:0.0:1651529427.763872:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c537a5 lrc: 3/0,1 mode: --/PW res: [0x2bbb5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763877:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c5351a lrc: 2/0,0 mode: PW/PW res: [0x2bbb5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc504 expref: 53 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763880:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.763881:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.763882:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c537a5 lrc: 4/0,1 mode: --/PW res: [0x2bbb5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763888:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c5351a lrc: 3/0,0 mode: PW/PW res: [0x2bbb5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc504 expref: 53 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763892:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c5351a lrc: 4/0,0 mode: PW/PW res: [0x2bbb5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc504 expref: 53 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.763896:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5ebc6ba pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997074752:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529427.763908:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 00000000365f1450 going to sleep for 6 seconds 00000100:00100000:0.0:1651529427.763913:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212942 00000100:00100000:0.0:1651529427.763915:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007f9b0c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+58:39030:x1731745946608128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529427.763916:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+58:39029:x1731745946607936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1645us (1665us total) trans 12885080949 rc 0/0 00000100:00100000:1.0:1651529427.763919:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212940 00002000:00080000:0.0:1651529427.763920:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179127 count 1 00000100:00100000:1.0:1651529427.763925:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212943 00000100:00100000:1.0:1651529427.763927:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000b6aa823 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+57:39030:x1731745946608256:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529427.763932:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179129 count 1 00010000:00010000:1.0:1651529427.763937:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c537ac lrc: 3/0,1 mode: --/PW res: [0x2bbb9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763941:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c537b3 lrc: 3/0,1 mode: --/PW res: [0x2bbb7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.763942:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bbf33489/0x3234de053c53536 lrc: 2/0,0 mode: PW/PW res: [0x2bbb9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc53c expref: 53 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.763945:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.763946:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.763946:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c537ac lrc: 4/0,1 mode: --/PW res: [0x2bbb9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763946:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53528 lrc: 2/0,0 mode: PW/PW res: [0x2bbb7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc520 expref: 53 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763949:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.763950:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.763951:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c537b3 lrc: 4/0,1 mode: --/PW res: [0x2bbb7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.763953:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bbf33489/0x3234de053c53536 lrc: 3/0,0 mode: PW/PW res: [0x2bbb9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc53c expref: 53 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.763957:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bbf33489/0x3234de053c53536 lrc: 4/0,0 mode: PW/PW res: [0x2bbb9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc53c expref: 53 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.763957:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53528 lrc: 3/0,0 mode: PW/PW res: [0x2bbb7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc520 expref: 53 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.763961:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997074816:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.763961:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53528 lrc: 4/0,0 mode: PW/PW res: [0x2bbb7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc520 expref: 53 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.763965:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000df603127 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997074880:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529427.763969:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000412e5d26 going to sleep for 6 seconds 00000100:00100000:0.0:1651529427.763973:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 000000008dbebba1 going to sleep for 6 seconds 00000100:00100000:1.0:1651529427.763976:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212944 00000100:00100000:1.0:1651529427.763978:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+57:39030:x1731745946608064:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529427.763980:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212945 00000100:00100000:0.0:1651529427.763982:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eff08db4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+57:39030:x1731745946608192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529427.763983:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179126 count 1 00010000:00010000:1.0:1651529427.763986:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c537ba lrc: 3/0,1 mode: --/PW res: [0x2bbb6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529427.763987:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179128 count 1 00010000:00010000:1.0:1651529427.763990:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c53521 lrc: 2/0,0 mode: PW/PW res: [0x2bbb6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc512 expref: 53 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763990:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c537c1 lrc: 3/0,1 mode: --/PW res: [0x2bbb8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.763994:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.763994:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.763994:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c5352f lrc: 2/0,0 mode: PW/PW res: [0x2bbb8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc52e expref: 53 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.763995:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c537ba lrc: 4/0,1 mode: --/PW res: [0x2bbb6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.763998:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.763998:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.763999:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c537c1 lrc: 4/0,1 mode: --/PW res: [0x2bbb8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.764000:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c53521 lrc: 3/0,0 mode: PW/PW res: [0x2bbb6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc512 expref: 53 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.764004:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c53521 lrc: 4/0,0 mode: PW/PW res: [0x2bbb6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc512 expref: 53 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.764004:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c5352f lrc: 3/0,0 mode: PW/PW res: [0x2bbb8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc52e expref: 53 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.764008:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004be0190 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997074944:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.764008:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c5352f lrc: 4/0,0 mode: PW/PW res: [0x2bbb8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc52e expref: 53 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.764012:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005529fd8d pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997075008:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529427.764014:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 0000000053a0cffa going to sleep for 6 seconds 00000100:00100000:0.0:1651529427.764018:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 000000005b4623d5 going to sleep for 6 seconds 00000100:00100000:1.0:1651529427.764028:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529427.764047:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946608320 00000100:00100000:1.0:1651529427.764069:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212946 00000100:00100000:1.0:1651529427.764071:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+58:39029:x1731745946608320:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529427.764076:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179130 count 1 00010000:00010000:1.0:1651529427.764104:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c537c8 lrc: 3/0,1 mode: --/PW res: [0x2bbba:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.764110:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000091069ebb/0x3234de053c5353d lrc: 2/0,0 mode: PW/PW res: [0x2bbba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc54a expref: 53 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.764113:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.764113:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.764114:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c537c8 lrc: 4/0,1 mode: --/PW res: [0x2bbba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.764121:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000091069ebb/0x3234de053c5353d lrc: 3/0,0 mode: PW/PW res: [0x2bbba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc54a expref: 53 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.764125:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000091069ebb/0x3234de053c5353d lrc: 4/0,0 mode: PW/PW res: [0x2bbba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc54a expref: 53 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.764129:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029d739c8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997075072:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529427.764143:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 0000000099c1da85 going to sleep for 6 seconds 00000100:00100000:1.0:1651529427.764157:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529427.764174:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946608384 00000100:00100000:0.0:1651529427.764201:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212947 00000100:00100000:1.0:1651529427.764202:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529427.764203:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+59:39029:x1731745946608384:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529427.764213:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179131 count 1 00010000:00010000:0.0:1651529427.764218:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c537cf lrc: 3/0,1 mode: --/PW res: [0x2bbbb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.764239:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000066556eb/0x3234de053c53544 lrc: 2/0,0 mode: PW/PW res: [0x2bbbb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc558 expref: 53 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.764242:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.764243:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.764244:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c537cf lrc: 4/0,1 mode: --/PW res: [0x2bbbb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.764251:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000066556eb/0x3234de053c53544 lrc: 3/0,0 mode: PW/PW res: [0x2bbbb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc558 expref: 53 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.764255:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000066556eb/0x3234de053c53544 lrc: 4/0,0 mode: PW/PW res: [0x2bbbb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc558 expref: 53 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.764259:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000020362888 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997075136:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529427.764270:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bb11f0ed going to sleep for 6 seconds 00000100:00100000:0.0:1651529427.764278:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946608448 00000100:00100000:0.0:1651529427.764291:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212948 00000100:00100000:0.0:1651529427.764293:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+60:39029:x1731745946608448:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529427.764298:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179132 count 1 00010000:00010000:0.0:1651529427.764302:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c537d6 lrc: 3/0,1 mode: --/PW res: [0x2bbbc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.764306:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000485752e5/0x3234de053c5354b lrc: 2/0,0 mode: PW/PW res: [0x2bbbc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc566 expref: 53 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.764309:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.764310:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.764310:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c537d6 lrc: 4/0,1 mode: --/PW res: [0x2bbbc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.764340:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000485752e5/0x3234de053c5354b lrc: 3/0,0 mode: PW/PW res: [0x2bbbc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc566 expref: 53 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.764347:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000485752e5/0x3234de053c5354b lrc: 4/0,0 mode: PW/PW res: [0x2bbbc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc566 expref: 53 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.764356:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000068b6c75f pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997075200:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529427.764365:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b0ed27ba going to sleep for 6 seconds 00000100:00100000:0.0:1651529427.764374:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5ebc6ba pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997074752:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.764378:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c537a5 lrc: 3/0,1 mode: --/PW res: [0x2bbb5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.764396:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997074816:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529427.764400:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c537ac lrc: 3/0,1 mode: --/PW res: [0x2bbb9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.764680:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000df603127 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997074880:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.764684:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c537b3 lrc: 3/0,1 mode: --/PW res: [0x2bbb7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.764685:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529427.764691:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529427.764692:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005529fd8d pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997075008:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.764699:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c537c1 lrc: 3/0,1 mode: --/PW res: [0x2bbb8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.764700:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529427.764706:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529427.764706:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396831808 00010000:00010000:0.0:1651529427.764711:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c5351a lrc: 4/0,0 mode: PW/PW res: [0x2bbb5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc504 expref: 54 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.764714:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529427.764717:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396831936 00000100:00100000:1.0:1651529427.764719:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529427.764719:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53528 lrc: 4/0,0 mode: PW/PW res: [0x2bbb7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc520 expref: 55 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.764725:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396832064 00000100:00100000:0.0:1651529427.764726:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396831872 00010000:00010000:0.0:1651529427.764728:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bbf33489/0x3234de053c53536 lrc: 4/0,0 mode: PW/PW res: [0x2bbb9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc53c expref: 57 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.764731:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c5352f lrc: 4/0,0 mode: PW/PW res: [0x2bbb8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc52e expref: 57 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.764732:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396832000 00010000:00010000:0.0:1651529427.764735:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c53521 lrc: 5/0,0 mode: PW/PW res: [0x2bbb6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc512 expref: 58 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.764737:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396832128 00000100:00100000:0.0:1651529427.764739:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13401 00010000:00010000:1.0:1651529427.764740:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000091069ebb/0x3234de053c5353d lrc: 5/0,0 mode: PW/PW res: [0x2bbba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc54a expref: 59 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.764741:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+59:41278:x1731746396831808:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529427.764744:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651529427.764745:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13402 00010000:00010000:0.0:1651529427.764745:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c5351a lrc: 4/0,0 mode: PW/PW res: [0x2bbb5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc504 expref: 59 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.764747:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+59:41278:x1731746396831936:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529427.764749:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c5351a lrc: 3/0,0 mode: PW/PW res: [0x2bbb5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc504 expref: 59 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.764750:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529427.764751:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53528 lrc: 4/0,0 mode: PW/PW res: [0x2bbb7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc520 expref: 59 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.764754:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c5351a lrc: 0/0,0 mode: --/PW res: [0x2bbb5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc504 expref: 59 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.764755:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53528 lrc: 3/0,0 mode: PW/PW res: [0x2bbb7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc520 expref: 59 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.764758:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.764759:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.764759:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c537a5 lrc: 3/0,1 mode: PW/PW res: [0x2bbb5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.764761:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53528 lrc: 0/0,0 mode: --/PW res: [0x2bbb7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc520 expref: 58 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.764763:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c537a5 lrc: 4/0,1 mode: PW/PW res: [0x2bbb5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.764765:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.764765:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.764766:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c537b3 lrc: 3/0,1 mode: PW/PW res: [0x2bbb7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.764769:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c537b3 lrc: 4/0,1 mode: PW/PW res: [0x2bbb7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.764769:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529427.764786:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529427.764793:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+57:41278:x1731746396831808:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 51us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529427.764794:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+57:41278:x1731746396831936:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 47us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529427.764796:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13401 00000100:00100000:1.0:1651529427.764798:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13402 00000100:00100000:0.0:1651529427.764801:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13403 00000100:00100000:1.0:1651529427.764803:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13404 00000100:00100000:0.0:1651529427.764803:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+55:41278:x1731746396831872:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529427.764805:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+55:41278:x1731746396832064:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529427.764806:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529427.764807:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bbf33489/0x3234de053c53536 lrc: 4/0,0 mode: PW/PW res: [0x2bbb9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc53c expref: 55 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.764808:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529427.764809:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c5352f lrc: 4/0,0 mode: PW/PW res: [0x2bbb8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc52e expref: 55 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.764811:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bbf33489/0x3234de053c53536 lrc: 3/0,0 mode: PW/PW res: [0x2bbb9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc53c expref: 55 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.764813:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c5352f lrc: 3/0,0 mode: PW/PW res: [0x2bbb8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc52e expref: 55 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.764816:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bbf33489/0x3234de053c53536 lrc: 0/0,0 mode: --/PW res: [0x2bbb9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc53c expref: 55 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.764818:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c5352f lrc: 0/0,0 mode: --/PW res: [0x2bbb8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc52e expref: 55 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.764820:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.764820:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.764821:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.764821:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c537ac lrc: 3/0,1 mode: PW/PW res: [0x2bbb9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.764822:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.764823:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c537c1 lrc: 3/0,1 mode: PW/PW res: [0x2bbb8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.764824:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c537ac lrc: 4/0,1 mode: PW/PW res: [0x2bbb9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.764826:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c537c1 lrc: 4/0,1 mode: PW/PW res: [0x2bbb8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.764839:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529427.764845:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+53:41278:x1731746396832064:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 39us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529427.764847:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13404 00000100:00100000:1.0:1651529427.764852:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13405 00000100:00100000:1.0:1651529427.764853:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002017d1f9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+52:41278:x1731746396832000:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529427.764856:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529427.764857:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c53521 lrc: 5/0,0 mode: PW/PW res: [0x2bbb6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc512 expref: 52 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.764862:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529427.764870:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+52:41278:x1731746396831872:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 66us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529427.764873:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13403 00010000:00010000:1.0:1651529427.764875:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c53521 lrc: 4/0,0 mode: PW/PW res: [0x2bbb6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc512 expref: 52 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.764878:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13406 00010000:00010000:1.0:1651529427.764880:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.764880:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529427.764880:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+51:41278:x1731746396832128:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651529427.764881:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c537ba lrc: 3/0,1 mode: PW/PW res: [0x2bbb6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.764883:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529427.764884:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c537ba lrc: 4/0,1 mode: PW/PW res: [0x2bbb6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.764884:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000091069ebb/0x3234de053c5353d lrc: 5/0,0 mode: PW/PW res: [0x2bbba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc54a expref: 51 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.764888:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000091069ebb/0x3234de053c5353d lrc: 4/0,0 mode: PW/PW res: [0x2bbba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc54a expref: 51 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.764889:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529427.764893:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529427.764894:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002017d1f9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+51:41278:x1731746396832000:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (181us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529427.764894:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.764895:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c537c8 lrc: 3/0,1 mode: PW/PW res: [0x2bbba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.764897:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13405 00010000:00010000:0.0:1651529427.764898:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c537c8 lrc: 4/0,1 mode: PW/PW res: [0x2bbba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.764902:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529427.764906:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+50:41278:x1731746396832128:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 26us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529427.764909:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13406 00010000:00010000:1.0:1651529427.764911:0:72396:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c53521 lrc: 0/0,0 mode: --/PW res: [0x2bbb6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc512 expref: 49 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.764915:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004be0190 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997074944:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.764915:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c537b3 lrc: 3/0,1 mode: PW/PW res: [0x2bbb7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.764919:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c537ba lrc: 3/0,1 mode: PW/PW res: [0x2bbb6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.764919:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c537b3 lrc: 3/0,1 mode: PW/PW res: [0x2bbb7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.764922:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c537ba lrc: 3/0,1 mode: PW/PW res: [0x2bbb6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.764924:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c537b3 lrc: 3/0,1 mode: PW/PW res: [0x2bbb7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.764925:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c537ba lrc: 3/0,1 mode: PW/PW res: [0x2bbb6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.764927:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c537b3 lrc: 2/0,0 mode: PW/PW res: [0x2bbb7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.764928:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c537ba lrc: 3/0,1 mode: PW/PW res: [0x2bbb6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.764931:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c537ba lrc: 2/0,0 mode: PW/PW res: [0x2bbb6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.765075:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+62:39030:x1731745946608064:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1095us (1277us total) trans 12885080951 rc 0/0 00000100:00100000:1.0:1651529427.765078:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212944 00000100:00100000:0.0:1651529427.765079:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007f9b0c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+62:39030:x1731745946608128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1163us (1340us total) trans 12885080950 rc 0/0 00000100:00100000:0.0:1651529427.765082:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212942 00010000:00010000:1.0:1651529427.765085:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c537ac lrc: 3/0,1 mode: PW/PW res: [0x2bbb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.765088:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c537ac lrc: 3/0,1 mode: PW/PW res: [0x2bbb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.765090:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c537b3 lrc: 2/0,0 mode: PW/PW res: [0x2bbb7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.765091:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c537ac lrc: 3/0,1 mode: PW/PW res: [0x2bbb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.765093:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005a2cb180 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529427.765094:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c537ac lrc: 2/0,0 mode: PW/PW res: [0x2bbb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.765094:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c537b3 lrc: 2/0,0 mode: PW/PW res: [0x2bbb7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.765097:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c537b3 lrc: 3/0,0 mode: PW/PW res: [0x2bbb7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.765109:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c537b3 lrc: 1/0,0 mode: --/PW res: [0x2bbb7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.765112:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c537b3 lrc: 0/0,0 mode: --/PW res: [0x2bbb7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.765117:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c537ba lrc: 2/0,0 mode: PW/PW res: [0x2bbb6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.765120:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000090e99444 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.765121:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c537ba lrc: 2/0,0 mode: PW/PW res: [0x2bbb6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.765124:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c537ba lrc: 3/0,0 mode: PW/PW res: [0x2bbb6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.765127:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c537ba lrc: 1/0,0 mode: --/PW res: [0x2bbb6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.765129:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c537ba lrc: 0/0,0 mode: --/PW res: [0x2bbb6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.765133:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c537ac lrc: 2/0,0 mode: PW/PW res: [0x2bbb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.765136:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bdf2b6c4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.765136:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c537ac lrc: 2/0,0 mode: PW/PW res: [0x2bbb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.765139:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c537ac lrc: 3/0,0 mode: PW/PW res: [0x2bbb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.765142:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c537ac lrc: 1/0,0 mode: --/PW res: [0x2bbb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.765144:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c537ac lrc: 0/0,0 mode: --/PW res: [0x2bbb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.765151:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c537c1 lrc: 3/0,1 mode: PW/PW res: [0x2bbb8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.765154:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c537c1 lrc: 3/0,1 mode: PW/PW res: [0x2bbb8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.765157:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c537c1 lrc: 3/0,1 mode: PW/PW res: [0x2bbb8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.765160:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c537c1 lrc: 2/0,0 mode: PW/PW res: [0x2bbb8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.765244:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000b6aa823 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+62:39030:x1731745946608256:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1316us (1477us total) trans 12885080952 rc 0/0 00000100:00100000:1.0:1651529427.765247:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212943 00010000:00010000:1.0:1651529427.765258:0:80276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091069ebb/0x3234de053c5353d lrc: 0/0,0 mode: --/PW res: [0x2bbba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc54a expref: 48 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.765265:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029d739c8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997075072:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529427.765268:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c537c8 lrc: 3/0,1 mode: PW/PW res: [0x2bbba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.765272:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c537c8 lrc: 3/0,1 mode: PW/PW res: [0x2bbba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.765274:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c537c8 lrc: 3/0,1 mode: PW/PW res: [0x2bbba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.765277:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c537c8 lrc: 3/0,1 mode: PW/PW res: [0x2bbba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.765280:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c537c8 lrc: 2/0,0 mode: PW/PW res: [0x2bbba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.765320:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eff08db4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+62:39030:x1731745946608192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1336us (1513us total) trans 12885080953 rc 0/0 00000100:00100000:0.0:1651529427.765323:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212945 00010000:00010000:0.0:1651529427.765330:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c537c1 lrc: 2/0,0 mode: PW/PW res: [0x2bbb8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.765333:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f0b0fa2c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.765334:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c537c1 lrc: 2/0,0 mode: PW/PW res: [0x2bbb8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.765337:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c537c1 lrc: 3/0,0 mode: PW/PW res: [0x2bbb8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.765341:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c537c1 lrc: 1/0,0 mode: --/PW res: [0x2bbb8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.765345:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c537c1 lrc: 0/0,0 mode: --/PW res: [0x2bbb8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.765349:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c537c8 lrc: 2/0,0 mode: PW/PW res: [0x2bbba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.765351:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000feb9d3da already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.765352:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c537c8 lrc: 2/0,0 mode: PW/PW res: [0x2bbba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.765355:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c537c8 lrc: 3/0,0 mode: PW/PW res: [0x2bbba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.765358:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c537c8 lrc: 1/0,0 mode: --/PW res: [0x2bbba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.765361:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c537c8 lrc: 0/0,0 mode: --/PW res: [0x2bbba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.765366:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c537a5 lrc: 3/0,1 mode: PW/PW res: [0x2bbb5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.765369:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c537a5 lrc: 3/0,1 mode: PW/PW res: [0x2bbb5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.765372:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c537a5 lrc: 3/0,1 mode: PW/PW res: [0x2bbb5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.765375:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c537a5 lrc: 2/0,0 mode: PW/PW res: [0x2bbb5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.765407:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+62:39029:x1731745946608320:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1334us (1378us total) trans 12885080954 rc 0/0 00000100:00100000:1.0:1651529427.765410:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212946 00000100:00100000:1.0:1651529427.765451:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529427.765463:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529427.765519:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eb9cb61d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+61:39030:x1731745946608000:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1655us (1796us total) trans 12885080955 rc 0/0 00000100:00100000:0.0:1651529427.765522:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212941 00010000:00010000:0.0:1651529427.765529:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c537a5 lrc: 2/0,0 mode: PW/PW res: [0x2bbb5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.765532:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024627ba8 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.765533:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c537a5 lrc: 2/0,0 mode: PW/PW res: [0x2bbb5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.765536:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c537a5 lrc: 3/0,0 mode: PW/PW res: [0x2bbb5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.765540:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c537a5 lrc: 1/0,0 mode: --/PW res: [0x2bbb5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.765543:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c537a5 lrc: 0/0,0 mode: --/PW res: [0x2bbb5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.765563:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396832256 00010000:00010000:1.0:1651529427.765569:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000485752e5/0x3234de053c5354b lrc: 4/0,0 mode: PW/PW res: [0x2bbbc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc566 expref: 48 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.765572:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000068b6c75f pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997075200:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529427.765577:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396832192 00010000:00010000:1.0:1651529427.765579:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000066556eb/0x3234de053c53544 lrc: 5/0,0 mode: PW/PW res: [0x2bbbb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc558 expref: 49 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.765585:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13407 00010000:00010000:0.0:1651529427.765586:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c537d6 lrc: 3/0,1 mode: --/PW res: [0x2bbbc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.765587:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+49:41279:x1731746396832256:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529427.765590:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529427.765591:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000485752e5/0x3234de053c5354b lrc: 4/0,0 mode: PW/PW res: [0x2bbbc:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc566 expref: 49 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.765595:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000485752e5/0x3234de053c5354b lrc: 3/0,0 mode: PW/PW res: [0x2bbbc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc566 expref: 49 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.765598:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13408 00000100:00100000:0.0:1651529427.765600:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+49:41279:x1731746396832192:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529427.765601:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000485752e5/0x3234de053c5354b lrc: 0/0,0 mode: --/PW res: [0x2bbbc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc566 expref: 49 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.765603:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529427.765604:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.765605:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.765605:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000066556eb/0x3234de053c53544 lrc: 5/0,0 mode: PW/PW res: [0x2bbbb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc558 expref: 48 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.765606:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c537d6 lrc: 3/0,1 mode: PW/PW res: [0x2bbbc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.765609:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c537d6 lrc: 4/0,1 mode: PW/PW res: [0x2bbbc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.765609:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000066556eb/0x3234de053c53544 lrc: 4/0,0 mode: PW/PW res: [0x2bbbb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc558 expref: 48 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.765615:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.765615:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.765616:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c537cf lrc: 3/0,1 mode: PW/PW res: [0x2bbbb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.765619:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529427.765626:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c537cf lrc: 4/0,1 mode: PW/PW res: [0x2bbbb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.765628:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+48:41279:x1731746396832256:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 41us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529427.765631:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13407 00010000:00010000:0.0:1651529427.765631:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529427.765638:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+47:41279:x1731746396832192:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 38us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529427.765641:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13408 00010000:00010000:0.0:1651529427.765666:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c537d6 lrc: 3/0,1 mode: PW/PW res: [0x2bbbc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.765679:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c537d6 lrc: 3/0,1 mode: PW/PW res: [0x2bbbc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.765684:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c537d6 lrc: 3/0,1 mode: PW/PW res: [0x2bbbc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.765687:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c537d6 lrc: 2/0,0 mode: PW/PW res: [0x2bbbc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.765696:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529427.765707:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529427.765715:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529427.765726:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529427.765733:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946608512 00000100:00100000:1.0:1651529427.765742:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946608640 00000100:00100000:1.0:1651529427.765746:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946608576 00000100:00100000:1.0:1651529427.765750:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946608704 00000100:00100000:1.0:1651529427.765755:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212949 00000100:00100000:1.0:1651529427.765756:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e2020717 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+65:39030:x1731745946608512:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529427.765762:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179133 count 1 00010000:00010000:1.0:1651529427.765789:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c537dd lrc: 3/0,1 mode: --/PW res: [0x2bbbd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.765794:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004a1913b4/0x3234de053c53552 lrc: 2/0,0 mode: PW/PW res: [0x2bbbd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc574 expref: 46 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.765797:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.765798:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.765799:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c537dd lrc: 4/0,1 mode: --/PW res: [0x2bbbd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.765806:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004a1913b4/0x3234de053c53552 lrc: 3/0,0 mode: PW/PW res: [0x2bbbd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc574 expref: 46 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.765810:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004a1913b4/0x3234de053c53552 lrc: 4/0,0 mode: PW/PW res: [0x2bbbd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc574 expref: 46 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.765814:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000703c0db9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997075264:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529427.765824:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 000000007e004c12 going to sleep for 6 seconds 00000100:00100000:1.0:1651529427.765831:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212950 00000100:00100000:1.0:1651529427.765833:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+65:39030:x1731745946608640:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529427.765837:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179135 count 1 00010000:00010000:1.0:1651529427.765841:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c537e4 lrc: 3/0,1 mode: --/PW res: [0x2bbbf:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.765845:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e600099f/0x3234de053c53560 lrc: 2/0,0 mode: PW/PW res: [0x2bbbf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc590 expref: 46 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.765848:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.765849:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.765850:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c537e4 lrc: 4/0,1 mode: --/PW res: [0x2bbbf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.765855:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e600099f/0x3234de053c53560 lrc: 3/0,0 mode: PW/PW res: [0x2bbbf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc590 expref: 46 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.765859:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e600099f/0x3234de053c53560 lrc: 4/0,0 mode: PW/PW res: [0x2bbbf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc590 expref: 46 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.765862:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997075328:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529427.765871:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a5495eb going to sleep for 6 seconds 00000100:00100000:0.0:1651529427.765872:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+65:39029:x1731745946608448:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1577us (1669us total) trans 12885080956 rc 0/0 00000100:00100000:0.0:1651529427.765875:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212948 00000100:00100000:1.0:1651529427.765877:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212951 00000100:00100000:1.0:1651529427.765878:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d777ba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+64:39030:x1731745946608576:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529427.765880:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212952 00002000:00080000:1.0:1651529427.765882:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179134 count 1 00000100:00100000:0.0:1651529427.765882:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+64:39030:x1731745946608704:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529427.765885:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c537eb lrc: 3/0,1 mode: --/PW res: [0x2bbbe:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529427.765887:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179136 count 1 00010000:00010000:1.0:1651529427.765892:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000928e420a/0x3234de053c53559 lrc: 2/0,0 mode: PW/PW res: [0x2bbbe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc582 expref: 46 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.765892:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c537f2 lrc: 3/0,1 mode: --/PW res: [0x2bbc0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.765895:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.765896:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.765896:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c537eb lrc: 4/0,1 mode: --/PW res: [0x2bbbe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.765897:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002bb34145/0x3234de053c53567 lrc: 2/0,0 mode: PW/PW res: [0x2bbc0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc59e expref: 46 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.765900:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.765901:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.765901:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c537f2 lrc: 4/0,1 mode: --/PW res: [0x2bbc0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.765902:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000928e420a/0x3234de053c53559 lrc: 3/0,0 mode: PW/PW res: [0x2bbbe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc582 expref: 46 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.765905:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000928e420a/0x3234de053c53559 lrc: 4/0,0 mode: PW/PW res: [0x2bbbe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc582 expref: 46 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.765908:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002bb34145/0x3234de053c53567 lrc: 3/0,0 mode: PW/PW res: [0x2bbc0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc59e expref: 46 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.765909:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005b3c5aba pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997075392:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529427.765914:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cfa1ca05 going to sleep for 6 seconds 00010000:00010000:0.0:1651529427.765915:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002bb34145/0x3234de053c53567 lrc: 4/0,0 mode: PW/PW res: [0x2bbc0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc59e expref: 46 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.765919:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000068b6c75f pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997075456:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529427.765927:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 000000009a3829ee going to sleep for 6 seconds 00000100:00100000:1.0:1651529427.765931:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529427.765933:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c537d6 lrc: 2/0,0 mode: PW/PW res: [0x2bbbc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.765936:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032c39b88 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.765937:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c537d6 lrc: 2/0,0 mode: PW/PW res: [0x2bbbc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.765940:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c537d6 lrc: 3/0,0 mode: PW/PW res: [0x2bbbc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.765944:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c537d6 lrc: 1/0,0 mode: --/PW res: [0x2bbbc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.765946:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529427.765947:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c537d6 lrc: 0/0,0 mode: --/PW res: [0x2bbbc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.765954:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946608768 00000100:00100000:0.0:1651529427.765965:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946608832 00000100:00100000:0.0:1651529427.765969:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212953 00000100:00100000:0.0:1651529427.765970:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+66:39029:x1731745946608768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529427.765976:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179137 count 1 00010000:00010000:0.0:1651529427.765980:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c537f9 lrc: 3/0,1 mode: --/PW res: [0x2bbc1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.765984:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a091a01a/0x3234de053c5356e lrc: 2/0,0 mode: PW/PW res: [0x2bbc1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5ac expref: 46 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.765987:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.765988:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.765989:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c537f9 lrc: 4/0,1 mode: --/PW res: [0x2bbc1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.765995:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a091a01a/0x3234de053c5356e lrc: 3/0,0 mode: PW/PW res: [0x2bbc1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5ac expref: 46 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.765998:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a091a01a/0x3234de053c5356e lrc: 4/0,0 mode: PW/PW res: [0x2bbc1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5ac expref: 46 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.766002:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005529fd8d pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997075520:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529427.766005:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212954 00000100:00100000:1.0:1651529427.766007:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+66:39029:x1731745946608832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529427.766015:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000059b4268b going to sleep for 6 seconds 00002000:00080000:1.0:1651529427.766018:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179138 count 1 00010000:00010000:1.0:1651529427.766023:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c53800 lrc: 3/0,1 mode: --/PW res: [0x2bbc2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.766025:0:156655:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000066556eb/0x3234de053c53544 lrc: 0/0,0 mode: --/PW res: [0x2bbbb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc558 expref: 46 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.766027:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c53575 lrc: 2/0,0 mode: PW/PW res: [0x2bbc2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5ba expref: 46 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.766030:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000020362888 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997075136:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529427.766033:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.766033:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.766033:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c537cf lrc: 3/0,1 mode: PW/PW res: [0x2bbbb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.766034:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c53800 lrc: 4/0,1 mode: --/PW res: [0x2bbc2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.766041:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c53575 lrc: 3/0,0 mode: PW/PW res: [0x2bbc2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5ba expref: 45 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.766045:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c53575 lrc: 4/0,0 mode: PW/PW res: [0x2bbc2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5ba expref: 45 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.766049:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c9f4ec84 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997075584:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.766055:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c537cf lrc: 3/0,1 mode: PW/PW res: [0x2bbbb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.766057:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000004ca54b8a going to sleep for 6 seconds 00010000:00010000:0.0:1651529427.766058:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c537cf lrc: 3/0,1 mode: PW/PW res: [0x2bbbb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.766061:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c537cf lrc: 3/0,1 mode: PW/PW res: [0x2bbbb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.766063:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c537cf lrc: 2/0,0 mode: PW/PW res: [0x2bbbb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.766140:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529427.766147:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946608896 00000100:00100000:1.0:1651529427.766154:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212955 00000100:00100000:1.0:1651529427.766156:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+68:39030:x1731745946608896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529427.766161:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179139 count 1 00010000:00010000:1.0:1651529427.766165:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53807 lrc: 3/0,1 mode: --/PW res: [0x2bbc3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.766170:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c5357c lrc: 2/0,0 mode: PW/PW res: [0x2bbc3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5c8 expref: 45 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.766173:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.766173:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.766174:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53807 lrc: 4/0,1 mode: --/PW res: [0x2bbc3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.766181:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c5357c lrc: 3/0,0 mode: PW/PW res: [0x2bbc3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5c8 expref: 45 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.766184:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c5357c lrc: 4/0,0 mode: PW/PW res: [0x2bbc3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5c8 expref: 45 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.766189:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000088fa78f8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997075648:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529427.766199:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d09f5ee1 going to sleep for 6 seconds 00000100:00100000:0.0:1651529427.766216:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+68:39029:x1731745946608384:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 2012us (2059us total) trans 12885080957 rc 0/0 00000100:00100000:0.0:1651529427.766220:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212947 00010000:00010000:0.0:1651529427.766260:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c537cf lrc: 2/0,0 mode: PW/PW res: [0x2bbbb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.766264:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005635b116 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.766265:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c537cf lrc: 2/0,0 mode: PW/PW res: [0x2bbbb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.766268:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c537cf lrc: 3/0,0 mode: PW/PW res: [0x2bbbb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.766273:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c537cf lrc: 1/0,0 mode: --/PW res: [0x2bbbb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.766276:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c537cf lrc: 0/0,0 mode: --/PW res: [0x2bbbb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.766280:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529427.766293:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000703c0db9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997075264:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529427.766294:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396832320 00010000:00010000:1.0:1651529427.766297:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c537dd lrc: 3/0,1 mode: --/PW res: [0x2bbbd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.766299:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004a1913b4/0x3234de053c53552 lrc: 4/0,0 mode: PW/PW res: [0x2bbbd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc574 expref: 46 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.766310:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13409 00000100:00100000:0.0:1651529427.766311:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+46:41279:x1731746396832320:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529427.766314:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529427.766316:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004a1913b4/0x3234de053c53552 lrc: 4/0,0 mode: PW/PW res: [0x2bbbd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc574 expref: 46 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.766319:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004a1913b4/0x3234de053c53552 lrc: 3/0,0 mode: PW/PW res: [0x2bbbd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc574 expref: 46 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.766324:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a1913b4/0x3234de053c53552 lrc: 0/0,0 mode: --/PW res: [0x2bbbd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc574 expref: 46 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.766328:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.766328:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.766329:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c537dd lrc: 3/0,1 mode: PW/PW res: [0x2bbbd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.766332:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c537dd lrc: 4/0,1 mode: PW/PW res: [0x2bbbd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.766345:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529427.766356:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+45:41279:x1731746396832320:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 45us (77us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529427.766358:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c537dd lrc: 3/0,1 mode: PW/PW res: [0x2bbbd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.766359:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13409 00010000:00010000:1.0:1651529427.766362:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c537dd lrc: 3/0,1 mode: PW/PW res: [0x2bbbd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.766365:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c537dd lrc: 3/0,1 mode: PW/PW res: [0x2bbbd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.766368:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c537dd lrc: 2/0,0 mode: PW/PW res: [0x2bbbd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.766390:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c537dd lrc: 2/0,0 mode: PW/PW res: [0x2bbbd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.766409:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e48e0bfd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.766411:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c537dd lrc: 2/0,0 mode: PW/PW res: [0x2bbbd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.766414:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c537dd lrc: 3/0,0 mode: PW/PW res: [0x2bbbd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.766419:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c537dd lrc: 1/0,0 mode: --/PW res: [0x2bbbd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.766421:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c537dd lrc: 0/0,0 mode: --/PW res: [0x2bbbd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.766437:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529427.766445:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946608960 00000100:00100000:0.0:1651529427.766456:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212956 00000100:00100000:0.0:1651529427.766458:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000020362888 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+69:39030:x1731745946608960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529427.766463:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179140 count 1 00010000:00010000:0.0:1651529427.766468:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c5380e lrc: 3/0,1 mode: --/PW res: [0x2bbc4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.766473:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c53583 lrc: 2/0,0 mode: PW/PW res: [0x2bbc4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5d6 expref: 44 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.766476:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.766477:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.766477:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c5380e lrc: 4/0,1 mode: --/PW res: [0x2bbc4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.766484:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c53583 lrc: 3/0,0 mode: PW/PW res: [0x2bbc4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5d6 expref: 44 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.766487:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c53583 lrc: 4/0,0 mode: PW/PW res: [0x2bbc4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5d6 expref: 44 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.766491:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000df603127 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997075712:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529427.766502:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bb11f0ed going to sleep for 6 seconds 00000100:00100000:1.0:1651529427.766520:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e2020717 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+69:39030:x1731745946608512:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 762us (824us total) trans 12885080958 rc 0/0 00000100:00100000:1.0:1651529427.766524:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212949 00000100:00100000:1.0:1651529427.766712:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529427.766724:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529427.766729:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c9f4ec84 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997075584:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529427.766731:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529427.766733:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c53800 lrc: 3/0,1 mode: --/PW res: [0x2bbc2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.766741:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529427.766750:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529427.766751:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396832448 00000100:00100000:0.0:1651529427.766759:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529427.766761:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000928e420a/0x3234de053c53559 lrc: 5/0,0 mode: PW/PW res: [0x2bbbe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc582 expref: 45 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.766764:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529427.766767:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396832576 00010000:00010000:1.0:1651529427.766769:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a091a01a/0x3234de053c5356e lrc: 5/0,0 mode: PW/PW res: [0x2bbc1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5ac expref: 46 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.766772:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005529fd8d pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997075520:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529427.766773:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396832704 00010000:00010000:1.0:1651529427.766775:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c5357c lrc: 5/0,0 mode: PW/PW res: [0x2bbc3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5c8 expref: 47 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.766786:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c537f9 lrc: 3/0,1 mode: --/PW res: [0x2bbc1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.766791:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396832384 00010000:00010000:1.0:1651529427.766794:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e600099f/0x3234de053c53560 lrc: 5/0,0 mode: PW/PW res: [0x2bbbf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc590 expref: 48 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.766797:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000068b6c75f pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997075456:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529427.766798:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396832512 00010000:00010000:0.0:1651529427.766799:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c537f2 lrc: 3/0,1 mode: --/PW res: [0x2bbc0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.766800:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002bb34145/0x3234de053c53567 lrc: 4/0,0 mode: PW/PW res: [0x2bbc0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc59e expref: 49 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.766804:0:72386:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396832640 00010000:00010000:1.0:1651529427.766806:0:72386:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c53575 lrc: 4/0,0 mode: PW/PW res: [0x2bbc2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5ba expref: 50 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.766806:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13410 00000100:00100000:0.0:1651529427.766808:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5ebc6ba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+50:41278:x1731746396832448:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1651529427.766811:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13411 00000100:00100000:1.0:1651529427.766813:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9b0314b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+50:41278:x1731746396832576:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529427.766816:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529427.766817:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a091a01a/0x3234de053c5356e lrc: 4/0,0 mode: PW/PW res: [0x2bbc1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5ac expref: 50 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.766821:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a091a01a/0x3234de053c5356e lrc: 3/0,0 mode: PW/PW res: [0x2bbc1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5ac expref: 50 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.766827:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a091a01a/0x3234de053c5356e lrc: 0/0,0 mode: --/PW res: [0x2bbc1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5ac expref: 50 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.766831:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.766831:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.766836:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529427.766839:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000928e420a/0x3234de053c53559 lrc: 5/0,0 mode: PW/PW res: [0x2bbbe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc582 expref: 49 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.766843:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000928e420a/0x3234de053c53559 lrc: 4/0,0 mode: PW/PW res: [0x2bbbe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc582 expref: 49 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.766846:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c537f9 lrc: 3/0,1 mode: PW/PW res: [0x2bbc1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.766849:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.766849:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.766850:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c537f9 lrc: 4/0,1 mode: PW/PW res: [0x2bbc1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.766850:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c537eb lrc: 3/0,1 mode: PW/PW res: [0x2bbbe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.766853:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c537eb lrc: 4/0,1 mode: PW/PW res: [0x2bbbe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.766859:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529427.766864:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529427.766870:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9b0314b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+49:41278:x1731746396832576:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 57us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529427.766873:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13411 00000100:00100000:0.0:1651529427.766877:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5ebc6ba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+48:41278:x1731746396832448:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 68us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529427.766878:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13412 00000100:00100000:1.0:1651529427.766880:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cd81e40c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+48:41278:x1731746396832704:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529427.766880:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13410 00010000:00010000:1.0:1651529427.766883:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529427.766885:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c5357c lrc: 5/0,0 mode: PW/PW res: [0x2bbc3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5c8 expref: 47 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.766887:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13413 00010000:00010000:1.0:1651529427.766888:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c5357c lrc: 4/0,0 mode: PW/PW res: [0x2bbc3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5c8 expref: 47 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.766889:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000036d32101 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+47:41278:x1731746396832384:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1651529427.766891:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529427.766893:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.766893:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e600099f/0x3234de053c53560 lrc: 5/0,0 mode: PW/PW res: [0x2bbbf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc590 expref: 47 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.766894:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.766895:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53807 lrc: 3/0,1 mode: PW/PW res: [0x2bbc3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.766896:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e600099f/0x3234de053c53560 lrc: 4/0,0 mode: PW/PW res: [0x2bbbf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc590 expref: 47 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.766898:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53807 lrc: 4/0,1 mode: PW/PW res: [0x2bbc3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.766901:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.766902:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529427.766902:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.766903:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c537e4 lrc: 3/0,1 mode: PW/PW res: [0x2bbbf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.766906:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c537e4 lrc: 4/0,1 mode: PW/PW res: [0x2bbbf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.766907:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cd81e40c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+47:41278:x1731746396832704:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 26us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529427.766909:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13412 00010000:00010000:0.0:1651529427.766910:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529427.766915:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000036d32101 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+46:41278:x1731746396832384:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 26us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529427.766917:0:72386:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13414 00000100:00100000:1.0:1651529427.766918:0:72386:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+46:41278:x1731746396832512:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1651529427.766918:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13413 00010000:00010000:1.0:1651529427.766921:0:72386:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529427.766922:0:72386:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002bb34145/0x3234de053c53567 lrc: 4/0,0 mode: PW/PW res: [0x2bbc0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc59e expref: 45 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.766922:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13415 00000100:00100000:0.0:1651529427.766924:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+45:41278:x1731746396832640:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529427.766926:0:72386:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002bb34145/0x3234de053c53567 lrc: 3/0,0 mode: PW/PW res: [0x2bbc0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc59e expref: 45 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.766926:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529427.766927:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c53575 lrc: 4/0,0 mode: PW/PW res: [0x2bbc2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5ba expref: 45 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.766931:0:72386:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002bb34145/0x3234de053c53567 lrc: 0/0,0 mode: --/PW res: [0x2bbc0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc59e expref: 45 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.766933:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c53575 lrc: 3/0,0 mode: PW/PW res: [0x2bbc2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5ba expref: 45 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.766934:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.766934:0:72386:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.766935:0:72386:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c537f2 lrc: 3/0,1 mode: PW/PW res: [0x2bbc0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.766938:0:72386:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c537f2 lrc: 4/0,1 mode: PW/PW res: [0x2bbc0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.766938:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c53575 lrc: 0/0,0 mode: --/PW res: [0x2bbc2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5ba expref: 44 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.766941:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.766941:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.766942:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c53800 lrc: 3/0,1 mode: PW/PW res: [0x2bbc2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.766946:0:72386:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529427.766951:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c53800 lrc: 4/0,1 mode: PW/PW res: [0x2bbc2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.766952:0:72386:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+43:41278:x1731746396832512:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529427.766954:0:72386:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13414 00010000:00010000:0.0:1651529427.766960:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529427.766966:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+42:41278:x1731746396832640:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 42us (202us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529427.766968:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c53800 lrc: 3/0,1 mode: PW/PW res: [0x2bbc2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.766969:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13415 00010000:00010000:1.0:1651529427.766971:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c53800 lrc: 3/0,1 mode: PW/PW res: [0x2bbc2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.766975:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c53800 lrc: 3/0,1 mode: PW/PW res: [0x2bbc2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.766975:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c537f9 lrc: 3/0,1 mode: PW/PW res: [0x2bbc1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.766979:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c537f9 lrc: 3/0,1 mode: PW/PW res: [0x2bbc1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.766980:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c53800 lrc: 2/0,0 mode: PW/PW res: [0x2bbc2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.766982:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c537f9 lrc: 3/0,1 mode: PW/PW res: [0x2bbc1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.766992:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c537f9 lrc: 2/0,0 mode: PW/PW res: [0x2bbc1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.767119:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+70:39029:x1731745946608832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1112us (1172us total) trans 12885080959 rc 0/0 00000100:00100000:1.0:1651529427.767122:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212954 00000100:00100000:1.0:1651529427.767127:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946609024 00000100:00100000:0.0:1651529427.767132:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+70:39029:x1731745946608768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1161us (1200us total) trans 12885080960 rc 0/0 00000100:00100000:1.0:1651529427.767135:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212957 00000100:00100000:1.0:1651529427.767136:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+70:39029:x1731745946609024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529427.767137:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212953 00002000:00080000:1.0:1651529427.767141:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179141 count 1 00010000:00010000:0.0:1651529427.767144:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c53800 lrc: 2/0,0 mode: PW/PW res: [0x2bbc2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.767146:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c53815 lrc: 3/0,1 mode: --/PW res: [0x2bbc5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.767148:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000066921086 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.767149:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c53800 lrc: 2/0,0 mode: PW/PW res: [0x2bbc2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.767151:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c5358a lrc: 2/0,0 mode: PW/PW res: [0x2bbc5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5e4 expref: 41 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.767152:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c53800 lrc: 3/0,0 mode: PW/PW res: [0x2bbc2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.767154:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.767154:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.767155:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c53815 lrc: 4/0,1 mode: --/PW res: [0x2bbc5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.767156:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c53800 lrc: 1/0,0 mode: --/PW res: [0x2bbc2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.767159:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c53800 lrc: 0/0,0 mode: --/PW res: [0x2bbc2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.767162:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c5358a lrc: 3/0,0 mode: PW/PW res: [0x2bbc5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5e4 expref: 41 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.767164:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c537f9 lrc: 2/0,0 mode: PW/PW res: [0x2bbc1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.767165:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c5358a lrc: 4/0,0 mode: PW/PW res: [0x2bbc5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5e4 expref: 41 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.767167:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f146053f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.767168:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c537f9 lrc: 2/0,0 mode: PW/PW res: [0x2bbc1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.767171:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c537f9 lrc: 3/0,0 mode: PW/PW res: [0x2bbc1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.767172:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000822949b3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997075776:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.767174:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c537f9 lrc: 1/0,0 mode: --/PW res: [0x2bbc1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.767176:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c537f9 lrc: 0/0,0 mode: --/PW res: [0x2bbc1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.767180:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000007e004c12 going to sleep for 6 seconds 00010000:00010000:0.0:1651529427.767182:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c537f2 lrc: 3/0,1 mode: PW/PW res: [0x2bbc0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.767184:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c537f2 lrc: 3/0,1 mode: PW/PW res: [0x2bbc0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.767187:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c537f2 lrc: 3/0,1 mode: PW/PW res: [0x2bbc0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.767189:0:72396:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e600099f/0x3234de053c53560 lrc: 0/0,0 mode: --/PW res: [0x2bbbf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc590 expref: 41 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.767190:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c537f2 lrc: 2/0,0 mode: PW/PW res: [0x2bbc0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.767193:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997075328:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529427.767196:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c537e4 lrc: 3/0,1 mode: PW/PW res: [0x2bbbf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.767200:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c537e4 lrc: 3/0,1 mode: PW/PW res: [0x2bbbf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.767202:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c537e4 lrc: 3/0,1 mode: PW/PW res: [0x2bbbf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.767205:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c537e4 lrc: 3/0,1 mode: PW/PW res: [0x2bbbf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.767208:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c537e4 lrc: 2/0,0 mode: PW/PW res: [0x2bbbf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.767353:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+71:39030:x1731745946608704:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1470us (1626us total) trans 12885080961 rc 0/0 00000100:00100000:0.0:1651529427.767357:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212952 00010000:00010000:0.0:1651529427.767364:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c537f2 lrc: 2/0,0 mode: PW/PW res: [0x2bbc0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.767368:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000097255e6b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.767369:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c537f2 lrc: 2/0,0 mode: PW/PW res: [0x2bbc0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.767370:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+70:39030:x1731745946608640:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1536us (1663us total) trans 12885080962 rc 0/0 00010000:00010000:0.0:1651529427.767371:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c537f2 lrc: 3/0,0 mode: PW/PW res: [0x2bbc0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.767373:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212950 00010000:00010000:0.0:1651529427.767376:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c537f2 lrc: 1/0,0 mode: --/PW res: [0x2bbc0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.767379:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c537f2 lrc: 0/0,0 mode: --/PW res: [0x2bbc0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.767383:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c537e4 lrc: 2/0,0 mode: PW/PW res: [0x2bbbf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.767385:0:72397:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000928e420a/0x3234de053c53559 lrc: 0/0,0 mode: --/PW res: [0x2bbbe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc582 expref: 40 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.767385:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000014fe598c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.767386:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c537e4 lrc: 2/0,0 mode: PW/PW res: [0x2bbbf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.767389:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005b3c5aba pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997075392:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.767389:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c537e4 lrc: 3/0,0 mode: PW/PW res: [0x2bbbf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.767392:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c537e4 lrc: 1/0,0 mode: --/PW res: [0x2bbbf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.767393:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c537eb lrc: 3/0,1 mode: PW/PW res: [0x2bbbe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.767395:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c537e4 lrc: 0/0,0 mode: --/PW res: [0x2bbbf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.767396:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c537eb lrc: 3/0,1 mode: PW/PW res: [0x2bbbe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.767399:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c537eb lrc: 3/0,1 mode: PW/PW res: [0x2bbbe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.767402:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c537eb lrc: 3/0,1 mode: PW/PW res: [0x2bbbe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.767405:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c537eb lrc: 2/0,0 mode: PW/PW res: [0x2bbbe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.767430:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529427.767486:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c537eb lrc: 2/0,0 mode: PW/PW res: [0x2bbbe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.767490:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dd6b1be4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.767491:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c537eb lrc: 2/0,0 mode: PW/PW res: [0x2bbbe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.767494:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c537eb lrc: 3/0,0 mode: PW/PW res: [0x2bbbe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.767498:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c537eb lrc: 1/0,0 mode: --/PW res: [0x2bbbe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.767501:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c537eb lrc: 0/0,0 mode: --/PW res: [0x2bbbe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.767511:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000df603127 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997075712:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.767515:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c5380e lrc: 3/0,1 mode: --/PW res: [0x2bbc4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.767585:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d777ba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+70:39030:x1731745946608576:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1705us (1869us total) trans 12885080963 rc 0/0 00000100:00100000:1.0:1651529427.767588:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212951 00000100:00100000:1.0:1651529427.767619:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396832768 00010000:00010000:1.0:1651529427.767625:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c53583 lrc: 4/0,0 mode: PW/PW res: [0x2bbc4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5d6 expref: 40 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.767635:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13416 00000100:00100000:1.0:1651529427.767637:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+40:41279:x1731746396832768:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1651529427.767640:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529427.767641:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c53583 lrc: 4/0,0 mode: PW/PW res: [0x2bbc4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5d6 expref: 40 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.767645:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c53583 lrc: 3/0,0 mode: PW/PW res: [0x2bbc4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5d6 expref: 40 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.767651:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c53583 lrc: 0/0,0 mode: --/PW res: [0x2bbc4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5d6 expref: 40 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.767654:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.767655:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.767656:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c5380e lrc: 3/0,1 mode: PW/PW res: [0x2bbc4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.767659:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c5380e lrc: 4/0,1 mode: PW/PW res: [0x2bbc4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.767667:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529427.767669:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c5380e lrc: 3/0,1 mode: PW/PW res: [0x2bbc4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.767673:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c5380e lrc: 3/0,1 mode: PW/PW res: [0x2bbc4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.767676:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+39:41279:x1731746396832768:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 39us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529427.767679:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13416 00010000:00010000:1.0:1651529427.767689:0:80276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c5357c lrc: 0/0,0 mode: --/PW res: [0x2bbc3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5c8 expref: 38 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.767693:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000088fa78f8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997075648:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529427.767697:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53807 lrc: 3/0,1 mode: PW/PW res: [0x2bbc3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.767698:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c5380e lrc: 3/0,1 mode: PW/PW res: [0x2bbc4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.767700:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53807 lrc: 3/0,1 mode: PW/PW res: [0x2bbc3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.767701:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c5380e lrc: 2/0,0 mode: PW/PW res: [0x2bbc4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.767703:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53807 lrc: 3/0,1 mode: PW/PW res: [0x2bbc3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.767706:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53807 lrc: 3/0,1 mode: PW/PW res: [0x2bbc3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.767708:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53807 lrc: 2/0,0 mode: PW/PW res: [0x2bbc3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.767851:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+71:39030:x1731745946608896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1695us (1712us total) trans 12885080964 rc 0/0 00000100:00100000:1.0:1651529427.767855:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212955 00000100:00100000:0.0:1651529427.767879:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000020362888 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+70:39030:x1731745946608960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1420us (1441us total) trans 12885080965 rc 0/0 00000100:00100000:0.0:1651529427.767882:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212956 00010000:00010000:0.0:1651529427.767890:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c5380e lrc: 2/0,0 mode: PW/PW res: [0x2bbc4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.767891:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529427.767894:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004f988dee already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.767895:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c5380e lrc: 2/0,0 mode: PW/PW res: [0x2bbc4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.767905:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c5380e lrc: 3/0,0 mode: PW/PW res: [0x2bbc4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.767910:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c5380e lrc: 1/0,0 mode: --/PW res: [0x2bbc4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.767913:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c5380e lrc: 0/0,0 mode: --/PW res: [0x2bbc4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.767917:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53807 lrc: 2/0,0 mode: PW/PW res: [0x2bbc3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.767920:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004b2a6b06 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.767921:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53807 lrc: 2/0,0 mode: PW/PW res: [0x2bbc3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.767924:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53807 lrc: 3/0,0 mode: PW/PW res: [0x2bbc3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.767925:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529427.767927:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53807 lrc: 1/0,0 mode: --/PW res: [0x2bbc3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.767929:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53807 lrc: 0/0,0 mode: --/PW res: [0x2bbc3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.767943:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529427.767944:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946609152 00000100:00100000:1.0:1651529427.767950:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529427.767959:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946609280 00000100:00100000:0.0:1651529427.767965:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946609088 00000100:00100000:1.0:1651529427.767969:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529427.767969:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946609216 00000100:00100000:1.0:1651529427.767979:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946609344 00000100:00100000:0.0:1651529427.767981:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212958 00000100:00100000:0.0:1651529427.767983:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+74:39030:x1731745946609152:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529427.767988:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212959 00000100:00100000:1.0:1651529427.767990:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+74:39030:x1731745946609280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529427.767993:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179143 count 1 00002000:00080000:1.0:1651529427.767996:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179145 count 1 00010000:00010000:0.0:1651529427.767998:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c5381c lrc: 3/0,1 mode: --/PW res: [0x2bbc7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.768000:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c53823 lrc: 3/0,1 mode: --/PW res: [0x2bbc9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.768002:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c53598 lrc: 2/0,0 mode: PW/PW res: [0x2bbc7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5f2 expref: 37 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.768005:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c535a6 lrc: 2/0,0 mode: PW/PW res: [0x2bbc9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc600 expref: 37 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.768005:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.768006:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.768007:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c5381c lrc: 4/0,1 mode: --/PW res: [0x2bbc7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.768009:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.768010:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.768010:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c53823 lrc: 4/0,1 mode: --/PW res: [0x2bbc9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.768014:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c53598 lrc: 3/0,0 mode: PW/PW res: [0x2bbc7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5f2 expref: 37 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.768017:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c535a6 lrc: 3/0,0 mode: PW/PW res: [0x2bbc9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc600 expref: 37 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.768018:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c53598 lrc: 4/0,0 mode: PW/PW res: [0x2bbc7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5f2 expref: 37 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.768021:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c535a6 lrc: 4/0,0 mode: PW/PW res: [0x2bbc9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc600 expref: 37 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.768023:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997075840:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529427.768025:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006aa45e66 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997075904:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529427.768038:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 0000000059b4268b going to sleep for 6 seconds 00000100:00100000:1.0:1651529427.768043:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d09f5ee1 going to sleep for 6 seconds 00000100:00100000:0.0:1651529427.768045:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212960 00000100:00100000:0.0:1651529427.768047:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+74:39030:x1731745946609088:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529427.768049:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212961 00000100:00100000:1.0:1651529427.768051:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+74:39030:x1731745946609216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529427.768052:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179142 count 1 00002000:00080000:1.0:1651529427.768056:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179144 count 1 00010000:00010000:0.0:1651529427.768056:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c5382a lrc: 3/0,1 mode: --/PW res: [0x2bbc6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.768059:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c53831 lrc: 3/0,1 mode: --/PW res: [0x2bbc8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.768060:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c53591 lrc: 2/0,0 mode: PW/PW res: [0x2bbc6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5eb expref: 37 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.768063:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.768063:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.768064:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c5359f lrc: 2/0,0 mode: PW/PW res: [0x2bbc8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5f9 expref: 37 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.768064:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c5382a lrc: 4/0,1 mode: --/PW res: [0x2bbc6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.768067:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.768068:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.768068:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c53831 lrc: 4/0,1 mode: --/PW res: [0x2bbc8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.768070:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c53591 lrc: 3/0,0 mode: PW/PW res: [0x2bbc6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5eb expref: 37 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.768075:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c5359f lrc: 3/0,0 mode: PW/PW res: [0x2bbc8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5f9 expref: 37 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.768076:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c53591 lrc: 4/0,0 mode: PW/PW res: [0x2bbc6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5eb expref: 37 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.768079:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c5359f lrc: 4/0,0 mode: PW/PW res: [0x2bbc8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5f9 expref: 37 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.768080:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997075968:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529427.768082:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d718cfe4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997076032:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529427.768087:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000080004f0a going to sleep for 6 seconds 00000100:00100000:1.0:1651529427.768089:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000412e5d26 going to sleep for 6 seconds 00000100:00100000:0.0:1651529427.768093:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212962 00000100:00100000:0.0:1651529427.768094:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+74:39029:x1731745946609344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529427.768098:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179146 count 1 00010000:00010000:0.0:1651529427.768101:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c53838 lrc: 3/0,1 mode: --/PW res: [0x2bbca:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.768106:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c535ad lrc: 2/0,0 mode: PW/PW res: [0x2bbca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc607 expref: 37 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.768108:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.768109:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.768109:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c53838 lrc: 4/0,1 mode: --/PW res: [0x2bbca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.768115:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c535ad lrc: 3/0,0 mode: PW/PW res: [0x2bbca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc607 expref: 37 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.768118:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c535ad lrc: 4/0,0 mode: PW/PW res: [0x2bbca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc607 expref: 37 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.768125:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ef7d105 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997076096:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529427.768136:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000365f1450 going to sleep for 6 seconds 00000100:00100000:0.0:1651529427.768335:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529427.768342:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529427.768349:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946609472 00000100:00100000:0.0:1651529427.768362:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946609408 00000100:00100000:0.0:1651529427.768366:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212963 00000100:00100000:0.0:1651529427.768368:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003132c0c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+76:39029:x1731745946609472:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529427.768372:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212964 00002000:00080000:0.0:1651529427.768373:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179148 count 1 00000100:00100000:1.0:1651529427.768374:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0bff89e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+76:39029:x1731745946609408:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529427.768377:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c5383f lrc: 3/0,1 mode: --/PW res: [0x2bbcc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529427.768380:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179147 count 1 00010000:00010000:0.0:1651529427.768382:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c535bb lrc: 2/0,0 mode: PW/PW res: [0x2bbcc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc615 expref: 37 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.768385:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c53846 lrc: 3/0,1 mode: --/PW res: [0x2bbcb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.768385:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.768386:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.768386:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c5383f lrc: 4/0,1 mode: --/PW res: [0x2bbcc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.768389:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c535b4 lrc: 2/0,0 mode: PW/PW res: [0x2bbcb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc60e expref: 37 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.768393:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.768393:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.768393:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c535bb lrc: 3/0,0 mode: PW/PW res: [0x2bbcc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc615 expref: 37 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.768394:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c53846 lrc: 4/0,1 mode: --/PW res: [0x2bbcb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.768396:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c535bb lrc: 4/0,0 mode: PW/PW res: [0x2bbcc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc615 expref: 37 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.768401:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c535b4 lrc: 3/0,0 mode: PW/PW res: [0x2bbcb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc60e expref: 37 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.768403:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dabd64d3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997076160:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529427.768407:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c535b4 lrc: 4/0,0 mode: PW/PW res: [0x2bbcb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc60e expref: 37 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.768411:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fe004e2b pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997076224:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529427.768417:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 0000000066606c98 going to sleep for 6 seconds 00000100:00100000:1.0:1651529427.768427:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cfa1ca05 going to sleep for 6 seconds 00000100:00100000:1.0:1651529427.769114:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000822949b3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997075776:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529427.769119:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c53815 lrc: 3/0,1 mode: --/PW res: [0x2bbc5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.769146:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006aa45e66 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997075904:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529427.769150:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c53823 lrc: 3/0,1 mode: --/PW res: [0x2bbc9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.769156:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d718cfe4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997076032:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529427.769157:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011ef1a28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997075968:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529427.769159:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c53831 lrc: 3/0,1 mode: --/PW res: [0x2bbc8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.769162:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c5382a lrc: 3/0,1 mode: --/PW res: [0x2bbc6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.769169:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ef7d105 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997076096:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.769172:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c53838 lrc: 3/0,1 mode: --/PW res: [0x2bbca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.769177:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dabd64d3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997076160:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.769179:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c5383f lrc: 3/0,1 mode: --/PW res: [0x2bbcc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.769185:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1adbe91 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997075840:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.769187:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c5381c lrc: 3/0,1 mode: --/PW res: [0x2bbc7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.769431:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529427.769438:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529427.769451:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529427.769456:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396832896 00000100:00100000:1.0:1651529427.769458:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529427.769462:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c53598 lrc: 4/0,0 mode: PW/PW res: [0x2bbc7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5f2 expref: 38 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.769464:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529427.769469:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529427.769477:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529427.769479:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396833024 00010000:00010000:0.0:1651529427.769483:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c53591 lrc: 4/0,0 mode: PW/PW res: [0x2bbc6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5eb expref: 39 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.769487:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396833152 00010000:00010000:0.0:1651529427.769489:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c535ad lrc: 4/0,0 mode: PW/PW res: [0x2bbca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc607 expref: 40 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.769491:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529427.769493:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396832832 00010000:00010000:0.0:1651529427.769495:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c5358a lrc: 4/0,0 mode: PW/PW res: [0x2bbc5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5e4 expref: 41 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.769499:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396832960 00010000:00010000:0.0:1651529427.769501:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c535a6 lrc: 4/0,0 mode: PW/PW res: [0x2bbc9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc600 expref: 42 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.769505:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396833216 00000100:00100000:1.0:1651529427.769506:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396833088 00010000:00010000:0.0:1651529427.769507:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c535bb lrc: 4/0,0 mode: PW/PW res: [0x2bbcc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc615 expref: 43 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.769511:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396833280 00010000:00010000:1.0:1651529427.769512:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c5359f lrc: 4/0,0 mode: PW/PW res: [0x2bbc8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5f9 expref: 45 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.769513:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c535b4 lrc: 5/0,0 mode: PW/PW res: [0x2bbcb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc60e expref: 45 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.769518:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13417 00000100:00100000:1.0:1651529427.769520:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13418 00000100:00100000:0.0:1651529427.769520:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+45:41279:x1731746396832896:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529427.769522:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+45:41279:x1731746396833024:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529427.769523:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529427.769524:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c53598 lrc: 4/0,0 mode: PW/PW res: [0x2bbc7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5f2 expref: 45 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.769525:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529427.769526:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c53591 lrc: 4/0,0 mode: PW/PW res: [0x2bbc6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5eb expref: 45 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.769530:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c53591 lrc: 3/0,0 mode: PW/PW res: [0x2bbc6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5eb expref: 45 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.769531:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c53598 lrc: 3/0,0 mode: PW/PW res: [0x2bbc7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5f2 expref: 45 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.769536:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c53591 lrc: 0/0,0 mode: --/PW res: [0x2bbc6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5eb expref: 45 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.769537:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c53598 lrc: 0/0,0 mode: --/PW res: [0x2bbc7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5f2 expref: 45 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.769539:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.769540:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.769541:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c5382a lrc: 3/0,1 mode: PW/PW res: [0x2bbc6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.769541:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.769541:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.769542:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c5381c lrc: 3/0,1 mode: PW/PW res: [0x2bbc7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.769544:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c5382a lrc: 4/0,1 mode: PW/PW res: [0x2bbc6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.769545:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c5381c lrc: 4/0,1 mode: PW/PW res: [0x2bbc7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.769555:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529427.769558:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529427.769565:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+43:41279:x1731746396833024:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 43us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529427.769570:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13418 00000100:00100000:0.0:1651529427.769571:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+43:41279:x1731746396832896:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 50us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529427.769574:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13417 00000100:00100000:1.0:1651529427.769576:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13419 00000100:00100000:1.0:1651529427.769577:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a37852a8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+41:41279:x1731746396833152:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529427.769579:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13420 00010000:00010000:1.0:1651529427.769580:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529427.769581:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+41:41279:x1731746396832832:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529427.769582:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c535ad lrc: 4/0,0 mode: PW/PW res: [0x2bbca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc607 expref: 41 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.769584:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529427.769585:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c535ad lrc: 3/0,0 mode: PW/PW res: [0x2bbca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc607 expref: 41 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.769585:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c5358a lrc: 4/0,0 mode: PW/PW res: [0x2bbc5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5e4 expref: 41 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.769589:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c5358a lrc: 3/0,0 mode: PW/PW res: [0x2bbc5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5e4 expref: 41 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.769590:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c535ad lrc: 0/0,0 mode: --/PW res: [0x2bbca:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc607 expref: 41 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.769594:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.769594:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.769594:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c5358a lrc: 0/0,0 mode: --/PW res: [0x2bbc5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5e4 expref: 40 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.769595:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c53838 lrc: 3/0,1 mode: PW/PW res: [0x2bbca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.769598:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c53838 lrc: 4/0,1 mode: PW/PW res: [0x2bbca:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.769598:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.769598:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.769599:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c53815 lrc: 3/0,1 mode: PW/PW res: [0x2bbc5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.769602:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c53815 lrc: 4/0,1 mode: PW/PW res: [0x2bbc5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.769605:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529427.769611:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a37852a8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+39:41279:x1731746396833152:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 33us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529427.769613:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13419 00010000:00010000:0.0:1651529427.769617:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529427.769623:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+38:41279:x1731746396832832:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529427.769626:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13420 00000100:00100000:1.0:1651529427.769629:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13421 00000100:00100000:1.0:1651529427.769631:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f55117eb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+37:41279:x1731746396832960:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529427.769631:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13422 00000100:00100000:0.0:1651529427.769633:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000b6aa823 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+37:41279:x1731746396833216:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529427.769634:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529427.769635:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c535a6 lrc: 4/0,0 mode: PW/PW res: [0x2bbc9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc600 expref: 37 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.769635:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529427.769636:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c535bb lrc: 4/0,0 mode: PW/PW res: [0x2bbcc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc615 expref: 37 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.769639:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c535a6 lrc: 3/0,0 mode: PW/PW res: [0x2bbc9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc600 expref: 37 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.769640:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c535bb lrc: 3/0,0 mode: PW/PW res: [0x2bbcc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc615 expref: 37 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.769644:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c535a6 lrc: 0/0,0 mode: --/PW res: [0x2bbc9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc600 expref: 37 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.769645:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c535bb lrc: 0/0,0 mode: --/PW res: [0x2bbcc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc615 expref: 37 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.769647:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.769648:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.769649:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c53823 lrc: 3/0,1 mode: PW/PW res: [0x2bbc9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.769651:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.769651:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.769652:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c53823 lrc: 4/0,1 mode: PW/PW res: [0x2bbc9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.769652:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c5383f lrc: 3/0,1 mode: PW/PW res: [0x2bbcc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.769655:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c5383f lrc: 4/0,1 mode: PW/PW res: [0x2bbcc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.769658:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529427.769661:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529427.769663:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f55117eb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+35:41279:x1731746396832960:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 32us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529427.769666:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13421 00000100:00100000:0.0:1651529427.769666:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000b6aa823 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+35:41279:x1731746396833216:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 33us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529427.769669:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13422 00000100:00100000:1.0:1651529427.769671:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13423 00000100:00100000:1.0:1651529427.769672:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007f9b0c6d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+33:41279:x1731746396833088:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529427.769673:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13424 00010000:00010000:1.0:1651529427.769674:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529427.769675:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eb9cb61d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+33:41278:x1731746396833280:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529427.769676:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c5359f lrc: 4/0,0 mode: PW/PW res: [0x2bbc8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5f9 expref: 33 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.769677:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529427.769678:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c535b4 lrc: 5/0,0 mode: PW/PW res: [0x2bbcb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc60e expref: 33 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.769680:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c5359f lrc: 3/0,0 mode: PW/PW res: [0x2bbc8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5f9 expref: 33 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.769682:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c535b4 lrc: 4/0,0 mode: PW/PW res: [0x2bbcb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc60e expref: 33 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.769684:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c5359f lrc: 0/0,0 mode: --/PW res: [0x2bbc8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc5f9 expref: 33 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.769686:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.769687:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.769687:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.769687:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c53846 lrc: 3/0,1 mode: PW/PW res: [0x2bbcb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.769688:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.769688:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c53831 lrc: 3/0,1 mode: PW/PW res: [0x2bbc8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.769691:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c53831 lrc: 4/0,1 mode: PW/PW res: [0x2bbc8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.769693:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c53846 lrc: 4/0,1 mode: PW/PW res: [0x2bbcb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.769697:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529427.769697:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529427.769700:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eb9cb61d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+32:41278:x1731746396833280:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 25us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529427.769702:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007f9b0c6d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+32:41279:x1731746396833088:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 29us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529427.769703:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13424 00000100:00100000:1.0:1651529427.769704:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13423 00010000:00010000:0.0:1651529427.769708:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c5382a lrc: 3/0,1 mode: PW/PW res: [0x2bbc6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.769711:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c5382a lrc: 3/0,1 mode: PW/PW res: [0x2bbc6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.769712:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c53815 lrc: 3/0,1 mode: PW/PW res: [0x2bbc5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.769714:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c5382a lrc: 3/0,1 mode: PW/PW res: [0x2bbc6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.769715:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c53815 lrc: 3/0,1 mode: PW/PW res: [0x2bbc5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.769717:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c5382a lrc: 2/0,0 mode: PW/PW res: [0x2bbc6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.769718:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c53815 lrc: 3/0,1 mode: PW/PW res: [0x2bbc5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.769724:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c53815 lrc: 2/0,0 mode: PW/PW res: [0x2bbc5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.769882:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+78:39030:x1731745946609088:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1834us (1938us total) trans 12885080966 rc 0/0 00000100:00100000:0.0:1651529427.769885:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212960 00000100:00100000:1.0:1651529427.769888:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+77:39029:x1731745946609024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 2751us (3176us total) trans 12885080967 rc 0/0 00000100:00100000:1.0:1651529427.769892:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212957 00010000:00010000:0.0:1651529427.769893:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c5382a lrc: 2/0,0 mode: PW/PW res: [0x2bbc6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.769896:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000050f78364 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.769897:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c5382a lrc: 2/0,0 mode: PW/PW res: [0x2bbc6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.769899:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c53823 lrc: 3/0,1 mode: PW/PW res: [0x2bbc9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.769900:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c5382a lrc: 3/0,0 mode: PW/PW res: [0x2bbc6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.769902:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c53823 lrc: 3/0,1 mode: PW/PW res: [0x2bbc9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.769905:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c53823 lrc: 3/0,1 mode: PW/PW res: [0x2bbc9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.769905:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c5382a lrc: 1/0,0 mode: --/PW res: [0x2bbc6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.769908:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c53823 lrc: 2/0,0 mode: PW/PW res: [0x2bbc9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.769908:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c5382a lrc: 0/0,0 mode: --/PW res: [0x2bbc6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.769913:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c53815 lrc: 2/0,0 mode: PW/PW res: [0x2bbc5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.769915:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000075f9ff9d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.769922:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c53815 lrc: 2/0,0 mode: PW/PW res: [0x2bbc5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.769926:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c53815 lrc: 3/0,0 mode: PW/PW res: [0x2bbc5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.769929:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c53815 lrc: 1/0,0 mode: --/PW res: [0x2bbc5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.769932:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c53815 lrc: 0/0,0 mode: --/PW res: [0x2bbc5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.769935:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c53823 lrc: 2/0,0 mode: PW/PW res: [0x2bbc9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.769938:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d2b9655c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.769939:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c53823 lrc: 2/0,0 mode: PW/PW res: [0x2bbc9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.769942:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c53823 lrc: 3/0,0 mode: PW/PW res: [0x2bbc9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.769945:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c53823 lrc: 1/0,0 mode: --/PW res: [0x2bbc9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.769947:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c53823 lrc: 0/0,0 mode: --/PW res: [0x2bbc9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.769954:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c53838 lrc: 3/0,1 mode: PW/PW res: [0x2bbca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.769957:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c53838 lrc: 3/0,1 mode: PW/PW res: [0x2bbca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.769960:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c53838 lrc: 3/0,1 mode: PW/PW res: [0x2bbca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.769962:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c53838 lrc: 2/0,0 mode: PW/PW res: [0x2bbca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.770041:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+78:39030:x1731745946609280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 2050us (2116us total) trans 12885080968 rc 0/0 00000100:00100000:1.0:1651529427.770044:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212959 00010000:00010000:1.0:1651529427.770051:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c53831 lrc: 3/0,1 mode: PW/PW res: [0x2bbc8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.770055:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c53831 lrc: 3/0,1 mode: PW/PW res: [0x2bbc8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.770061:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c53831 lrc: 3/0,1 mode: PW/PW res: [0x2bbc8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.770064:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c53831 lrc: 2/0,0 mode: PW/PW res: [0x2bbc8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.770099:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+78:39029:x1731745946609344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 2003us (2129us total) trans 12885080969 rc 0/0 00000100:00100000:0.0:1651529427.770102:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212962 00010000:00010000:0.0:1651529427.770110:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c53838 lrc: 2/0,0 mode: PW/PW res: [0x2bbca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.770113:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000819c7a2f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.770114:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c53838 lrc: 2/0,0 mode: PW/PW res: [0x2bbca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.770117:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c53838 lrc: 3/0,0 mode: PW/PW res: [0x2bbca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.770121:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c53838 lrc: 1/0,0 mode: --/PW res: [0x2bbca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.770124:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c53838 lrc: 0/0,0 mode: --/PW res: [0x2bbca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.770129:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c53831 lrc: 2/0,0 mode: PW/PW res: [0x2bbc8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.770131:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000294488b6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.770132:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c53831 lrc: 2/0,0 mode: PW/PW res: [0x2bbc8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.770135:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c53831 lrc: 3/0,0 mode: PW/PW res: [0x2bbc8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.770141:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c53831 lrc: 1/0,0 mode: --/PW res: [0x2bbc8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.770143:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c53831 lrc: 0/0,0 mode: --/PW res: [0x2bbc8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.770149:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c5383f lrc: 3/0,1 mode: PW/PW res: [0x2bbcc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.770152:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c5383f lrc: 3/0,1 mode: PW/PW res: [0x2bbcc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.770154:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c5383f lrc: 3/0,1 mode: PW/PW res: [0x2bbcc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.770157:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c5383f lrc: 2/0,0 mode: PW/PW res: [0x2bbcc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.770191:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+78:39030:x1731745946609216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 2138us (2240us total) trans 12885080970 rc 0/0 00000100:00100000:1.0:1651529427.770194:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212961 00010000:00010000:1.0:1651529427.770205:0:80277:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c535b4 lrc: 0/0,0 mode: --/PW res: [0x2bbcb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc60e expref: 30 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.770209:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fe004e2b pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997076224:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529427.770212:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c53846 lrc: 3/0,1 mode: PW/PW res: [0x2bbcb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.770216:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c53846 lrc: 3/0,1 mode: PW/PW res: [0x2bbcb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.770218:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c53846 lrc: 3/0,1 mode: PW/PW res: [0x2bbcb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.770237:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c53846 lrc: 3/0,1 mode: PW/PW res: [0x2bbcb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.770243:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c53846 lrc: 2/0,0 mode: PW/PW res: [0x2bbcb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.770309:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003132c0c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+78:39029:x1731745946609472:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1940us (1975us total) trans 12885080971 rc 0/0 00000100:00100000:0.0:1651529427.770312:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212963 00010000:00010000:0.0:1651529427.770322:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c5383f lrc: 2/0,0 mode: PW/PW res: [0x2bbcc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.770326:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1791842 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.770327:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c5383f lrc: 2/0,0 mode: PW/PW res: [0x2bbcc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.770330:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c5383f lrc: 3/0,0 mode: PW/PW res: [0x2bbcc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.770334:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c5383f lrc: 1/0,0 mode: --/PW res: [0x2bbcc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.770337:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c5383f lrc: 0/0,0 mode: --/PW res: [0x2bbcc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.770341:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c53846 lrc: 2/0,0 mode: PW/PW res: [0x2bbcb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.770344:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000093b5c984 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.770345:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c53846 lrc: 2/0,0 mode: PW/PW res: [0x2bbcb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.770348:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c53846 lrc: 3/0,0 mode: PW/PW res: [0x2bbcb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.770351:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c53846 lrc: 1/0,0 mode: --/PW res: [0x2bbcb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.770353:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c53846 lrc: 0/0,0 mode: --/PW res: [0x2bbcb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.770372:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0bff89e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+77:39029:x1731745946609408:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1997us (2029us total) trans 12885080972 rc 0/0 00000100:00100000:1.0:1651529427.770375:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212964 00010000:00010000:0.0:1651529427.770405:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c5381c lrc: 3/0,1 mode: PW/PW res: [0x2bbc7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.770411:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c5381c lrc: 3/0,1 mode: PW/PW res: [0x2bbc7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.770414:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c5381c lrc: 3/0,1 mode: PW/PW res: [0x2bbc7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.770417:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c5381c lrc: 2/0,0 mode: PW/PW res: [0x2bbc7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.770577:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+77:39030:x1731745946609152:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 2593us (2686us total) trans 12885080973 rc 0/0 00000100:00100000:0.0:1651529427.770580:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212958 00010000:00010000:0.0:1651529427.770586:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c5381c lrc: 2/0,0 mode: PW/PW res: [0x2bbc7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.770590:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6fcae44 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.770591:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c5381c lrc: 2/0,0 mode: PW/PW res: [0x2bbc7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.770594:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c5381c lrc: 3/0,0 mode: PW/PW res: [0x2bbc7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.770598:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c5381c lrc: 1/0,0 mode: --/PW res: [0x2bbc7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.770601:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c5381c lrc: 0/0,0 mode: --/PW res: [0x2bbc7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.770660:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529427.770672:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946609536 00000100:00100000:0.0:1651529427.770683:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212965 00000100:00100000:0.0:1651529427.770685:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e2020717 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+77:39030:x1731745946609536:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529427.770690:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179149 count 1 00000100:00100000:1.0:1651529427.770695:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529427.770695:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c5384d lrc: 3/0,1 mode: --/PW res: [0x2bbcd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.770706:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529427.770714:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529427.770732:0:156655:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c535c2 lrc: 2/0,0 mode: PW/PW res: [0x2bbcd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc61c expref: 29 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.770736:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.770737:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.770738:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c5384d lrc: 4/0,1 mode: --/PW res: [0x2bbcd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.770740:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529427.770746:0:156655:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c535c2 lrc: 3/0,0 mode: PW/PW res: [0x2bbcd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc61c expref: 29 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.770747:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529427.770750:0:156655:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c535c2 lrc: 4/0,0 mode: PW/PW res: [0x2bbcd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc61c expref: 29 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.770754:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529427.770754:0:156655:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dabd64d3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997076288:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529427.770764:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946609664 00000100:00100000:1.0:1651529427.770771:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946609792 00000100:00100000:1.0:1651529427.770784:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946609920 00000100:00100000:1.0:1651529427.770788:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946609600 00000100:00100000:1.0:1651529427.770793:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946609728 00000100:00100000:1.0:1651529427.770795:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946609856 00000100:00100000:1.0:1651529427.770799:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212966 00000100:00100000:1.0:1651529427.770800:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+83:39030:x1731745946609664:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529427.770804:0:156655:0:(client.c:2492:ptlrpc_set_wait()) set 000000005b4623d5 going to sleep for 6 seconds 00002000:00080000:1.0:1651529427.770811:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179151 count 1 00000100:00100000:0.0:1651529427.770811:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212967 00000100:00100000:0.0:1651529427.770813:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+83:39030:x1731745946609792:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529427.770816:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c53854 lrc: 3/0,1 mode: --/PW res: [0x2bbcf:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529427.770820:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179153 count 1 00010000:00010000:1.0:1651529427.770821:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c535d0 lrc: 2/0,0 mode: PW/PW res: [0x2bbcf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc62a expref: 29 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.770824:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c5385b lrc: 3/0,1 mode: --/PW res: [0x2bbd1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.770827:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.770828:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.770828:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c53854 lrc: 4/0,1 mode: --/PW res: [0x2bbcf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.770828:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c535de lrc: 2/0,0 mode: PW/PW res: [0x2bbd1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc638 expref: 29 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.770831:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.770832:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.770833:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c5385b lrc: 4/0,1 mode: --/PW res: [0x2bbd1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.770836:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c535d0 lrc: 3/0,0 mode: PW/PW res: [0x2bbcf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc62a expref: 29 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.770839:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c535d0 lrc: 4/0,0 mode: PW/PW res: [0x2bbcf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc62a expref: 29 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.770839:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c535de lrc: 3/0,0 mode: PW/PW res: [0x2bbd1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc638 expref: 29 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.770843:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c535de lrc: 4/0,0 mode: PW/PW res: [0x2bbd1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc638 expref: 29 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.770844:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000041d3f4d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997076352:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529427.770847:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000fe04db9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997076416:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529427.770853:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a5495eb going to sleep for 6 seconds 00000100:00100000:0.0:1651529427.770855:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b0ed27ba going to sleep for 6 seconds 00000100:00100000:1.0:1651529427.770860:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212968 00000100:00100000:1.0:1651529427.770862:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+83:39030:x1731745946609920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529427.770862:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212969 00000100:00100000:0.0:1651529427.770864:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000946e402f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+83:39030:x1731745946609600:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529427.770866:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179155 count 1 00002000:00080000:0.0:1651529427.770867:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179150 count 1 00010000:00010000:1.0:1651529427.770869:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53862 lrc: 3/0,1 mode: --/PW res: [0x2bbd3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.770871:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c53869 lrc: 3/0,1 mode: --/PW res: [0x2bbce:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.770873:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c535ec lrc: 2/0,0 mode: PW/PW res: [0x2bbd3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc646 expref: 29 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.770875:0:80279:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c535c9 lrc: 2/0,0 mode: PW/PW res: [0x2bbce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc623 expref: 29 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.770877:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.770877:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.770878:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53862 lrc: 4/0,1 mode: --/PW res: [0x2bbd3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.770878:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.770878:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.770879:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c53869 lrc: 4/0,1 mode: --/PW res: [0x2bbce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.770885:0:80279:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c535c9 lrc: 3/0,0 mode: PW/PW res: [0x2bbce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc623 expref: 29 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.770886:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c535ec lrc: 3/0,0 mode: PW/PW res: [0x2bbd3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc646 expref: 29 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.770888:0:80279:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c535c9 lrc: 4/0,0 mode: PW/PW res: [0x2bbce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc623 expref: 29 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.770890:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c535ec lrc: 4/0,0 mode: PW/PW res: [0x2bbd3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc646 expref: 29 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.770892:0:80279:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000056e45ef2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997076480:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529427.770894:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a6ed4a31 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997076544:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529427.770897:0:80279:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ecd79db8 going to sleep for 6 seconds 00000100:00100000:1.0:1651529427.770900:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b52d0f36 going to sleep for 6 seconds 00000100:00100000:0.0:1651529427.770903:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212970 00000100:00100000:0.0:1651529427.770905:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+83:39030:x1731745946609728:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529427.770906:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212971 00000100:00100000:1.0:1651529427.770908:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004de851bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+83:39030:x1731745946609856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529427.770908:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179152 count 1 00002000:00080000:1.0:1651529427.770911:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179154 count 1 00010000:00010000:0.0:1651529427.770911:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53870 lrc: 3/0,1 mode: --/PW res: [0x2bbd0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.770914:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c53877 lrc: 3/0,1 mode: --/PW res: [0x2bbd2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.770915:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c535d7 lrc: 2/0,0 mode: PW/PW res: [0x2bbd0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc631 expref: 29 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.770918:0:72396:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c535e5 lrc: 2/0,0 mode: PW/PW res: [0x2bbd2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc63f expref: 29 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.770918:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.770918:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.770919:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53870 lrc: 4/0,1 mode: --/PW res: [0x2bbd0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.770921:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.770922:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.770922:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c53877 lrc: 4/0,1 mode: --/PW res: [0x2bbd2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.770927:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c535d7 lrc: 3/0,0 mode: PW/PW res: [0x2bbd0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc631 expref: 29 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.770928:0:72396:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c535e5 lrc: 3/0,0 mode: PW/PW res: [0x2bbd2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc63f expref: 29 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.770931:0:72396:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c535e5 lrc: 4/0,0 mode: PW/PW res: [0x2bbd2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc63f expref: 29 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.770931:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c535d7 lrc: 4/0,0 mode: PW/PW res: [0x2bbd0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc631 expref: 29 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.770934:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000597d93ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997076608:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529427.770936:0:72396:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c7657c6f pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997076672:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529427.770940:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 0000000075259221 going to sleep for 6 seconds 00000100:00100000:1.0:1651529427.770942:0:72396:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd96f074 going to sleep for 6 seconds 00000100:00100000:0.0:1651529427.770969:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529427.771010:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946609984 00000100:00100000:1.0:1651529427.771018:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212972 00000100:00100000:1.0:1651529427.771020:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eff08db4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+84:39029:x1731745946609984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529427.771024:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179156 count 1 00010000:00010000:1.0:1651529427.771029:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c5387e lrc: 3/0,1 mode: --/PW res: [0x2bbd4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.771033:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c535f3 lrc: 2/0,0 mode: PW/PW res: [0x2bbd4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc64d expref: 29 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.771036:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.771037:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.771037:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c5387e lrc: 4/0,1 mode: --/PW res: [0x2bbd4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.771044:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c535f3 lrc: 3/0,0 mode: PW/PW res: [0x2bbd4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc64d expref: 29 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.771047:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c535f3 lrc: 4/0,0 mode: PW/PW res: [0x2bbd4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc64d expref: 29 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.771051:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000086eaa330 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997076736:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529427.771065:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 0000000018ebe812 going to sleep for 6 seconds 00000100:00100000:0.0:1651529427.771930:0:156655:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dabd64d3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:156655:1731745997076288:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.771959:0:156655:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c5384d lrc: 3/0,1 mode: --/PW res: [0x2bbcd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.771960:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529427.771968:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529427.771968:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000fe04db9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997076416:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.771971:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c5385b lrc: 3/0,1 mode: --/PW res: [0x2bbd1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.771975:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529427.771977:0:80279:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000056e45ef2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:80279:1731745997076480:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.771979:0:80279:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c53869 lrc: 3/0,1 mode: --/PW res: [0x2bbce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.771981:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529427.771990:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529427.771990:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000597d93ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997076608:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.771992:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53870 lrc: 3/0,1 mode: --/PW res: [0x2bbd0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.771995:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529427.771999:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396833344 00000100:00100000:1.0:1651529427.772001:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396833472 00010000:00010000:0.0:1651529427.772005:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c535c2 lrc: 4/0,0 mode: PW/PW res: [0x2bbcd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc61c expref: 31 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.772007:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c535de lrc: 4/0,0 mode: PW/PW res: [0x2bbd1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc638 expref: 31 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.772010:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396833600 00000100:00100000:1.0:1651529427.772013:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396833408 00010000:00010000:0.0:1651529427.772013:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c535ec lrc: 5/0,0 mode: PW/PW res: [0x2bbd3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc646 expref: 32 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.772016:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c535d0 lrc: 5/0,0 mode: PW/PW res: [0x2bbcf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc62a expref: 33 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.772017:0:72388:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396833536 00000100:00100000:1.0:1651529427.772020:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396833664 00010000:00010000:0.0:1651529427.772020:0:72388:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c535c9 lrc: 4/0,0 mode: PW/PW res: [0x2bbce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc623 expref: 34 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.772023:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c535d7 lrc: 4/0,0 mode: PW/PW res: [0x2bbd0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc631 expref: 35 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.772025:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13425 00000100:00100000:0.0:1651529427.772026:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+35:41278:x1731746396833344:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00000100:00100000:1.0:1651529427.772028:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13426 00000100:00100000:1.0:1651529427.772030:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001e35645b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+35:41278:x1731746396833472:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529427.772030:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529427.772031:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c535c2 lrc: 4/0,0 mode: PW/PW res: [0x2bbcd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc61c expref: 35 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.772033:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529427.772034:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c535de lrc: 4/0,0 mode: PW/PW res: [0x2bbd1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc638 expref: 35 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.772035:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c535c2 lrc: 3/0,0 mode: PW/PW res: [0x2bbcd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc61c expref: 35 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.772038:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c535de lrc: 3/0,0 mode: PW/PW res: [0x2bbd1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc638 expref: 35 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.772044:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c535de lrc: 0/0,0 mode: --/PW res: [0x2bbd1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc638 expref: 35 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.772048:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.772049:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.772049:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c5385b lrc: 3/0,1 mode: PW/PW res: [0x2bbd1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.772052:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c5385b lrc: 4/0,1 mode: PW/PW res: [0x2bbd1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.772070:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c535c2 lrc: 0/0,0 mode: --/PW res: [0x2bbcd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc61c expref: 34 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.772071:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529427.772074:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.772075:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.772076:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c5384d lrc: 3/0,1 mode: PW/PW res: [0x2bbcd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.772079:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c5384d lrc: 4/0,1 mode: PW/PW res: [0x2bbcd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.772081:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001e35645b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+33:41278:x1731746396833472:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 50us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529427.772084:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13426 00010000:00010000:0.0:1651529427.772085:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529427.772088:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13427 00000100:00100000:1.0:1651529427.772090:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+32:41278:x1731746396833600:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529427.772093:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529427.772093:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+32:41278:x1731746396833344:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 66us (133us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529427.772094:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c535ec lrc: 5/0,0 mode: PW/PW res: [0x2bbd3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc646 expref: 32 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.772096:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13425 00010000:00010000:1.0:1651529427.772098:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c535ec lrc: 4/0,0 mode: PW/PW res: [0x2bbd3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc646 expref: 31 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.772103:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.772104:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.772104:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53862 lrc: 3/0,1 mode: PW/PW res: [0x2bbd3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.772105:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13428 00000100:00100000:0.0:1651529427.772107:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+31:41278:x1731746396833408:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529427.772110:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53862 lrc: 4/0,1 mode: PW/PW res: [0x2bbd3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.772110:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529427.772111:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c535d0 lrc: 5/0,0 mode: PW/PW res: [0x2bbcf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc62a expref: 31 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.772114:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529427.772115:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c535d0 lrc: 4/0,0 mode: PW/PW res: [0x2bbcf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc62a expref: 31 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.772119:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+31:41278:x1731746396833600:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 28us (144us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529427.772120:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.772120:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529427.772121:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13427 00010000:00010000:0.0:1651529427.772121:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c53854 lrc: 3/0,1 mode: PW/PW res: [0x2bbcf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.772124:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c53854 lrc: 4/0,1 mode: PW/PW res: [0x2bbcf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.772125:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13429 00000100:00100000:1.0:1651529427.772127:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+30:41278:x1731746396833536:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651529427.772128:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529427.772129:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529427.772131:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c535c9 lrc: 4/0,0 mode: PW/PW res: [0x2bbce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc623 expref: 30 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.772133:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+30:41278:x1731746396833408:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 26us (152us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529427.772134:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c535c9 lrc: 3/0,0 mode: PW/PW res: [0x2bbce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc623 expref: 30 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.772136:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13428 00010000:00010000:1.0:1651529427.772139:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c535c9 lrc: 0/0,0 mode: --/PW res: [0x2bbce:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc623 expref: 29 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.772140:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13430 00010000:00010000:1.0:1651529427.772142:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.772142:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529427.772142:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+28:41278:x1731746396833664:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529427.772143:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c53869 lrc: 3/0,1 mode: PW/PW res: [0x2bbce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.772144:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529427.772145:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c535d7 lrc: 4/0,0 mode: PW/PW res: [0x2bbd0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc631 expref: 28 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.772146:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c53869 lrc: 4/0,1 mode: PW/PW res: [0x2bbce:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.772149:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c535d7 lrc: 3/0,0 mode: PW/PW res: [0x2bbd0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc631 expref: 28 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.772153:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c535d7 lrc: 0/0,0 mode: --/PW res: [0x2bbd0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc631 expref: 28 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.772158:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529427.772164:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+27:41278:x1731746396833536:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 36us (174us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529427.772164:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.772165:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.772165:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53870 lrc: 3/0,1 mode: PW/PW res: [0x2bbd0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.772166:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13429 00010000:00010000:0.0:1651529427.772168:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53870 lrc: 4/0,1 mode: PW/PW res: [0x2bbd0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.772174:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529427.772178:0:72395:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c535d0 lrc: 0/0,0 mode: --/PW res: [0x2bbcf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc62a expref: 26 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.772179:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+26:41278:x1731746396833664:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 37us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529427.772182:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000041d3f4d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997076352:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529427.772182:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13430 00010000:00010000:1.0:1651529427.772186:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c53854 lrc: 3/0,1 mode: PW/PW res: [0x2bbcf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.772189:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c53854 lrc: 3/0,1 mode: PW/PW res: [0x2bbcf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.772189:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c5385b lrc: 3/0,1 mode: PW/PW res: [0x2bbd1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.772192:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c53854 lrc: 3/0,1 mode: PW/PW res: [0x2bbcf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.772192:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c5385b lrc: 3/0,1 mode: PW/PW res: [0x2bbd1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.772195:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c53854 lrc: 3/0,1 mode: PW/PW res: [0x2bbcf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.772195:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c5385b lrc: 3/0,1 mode: PW/PW res: [0x2bbd1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.772198:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c53854 lrc: 2/0,0 mode: PW/PW res: [0x2bbcf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.772198:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c5385b lrc: 2/0,0 mode: PW/PW res: [0x2bbd1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.772373:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+86:39030:x1731745946609664:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1572us (1677us total) trans 12885080974 rc 0/0 00000100:00100000:1.0:1651529427.772378:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212966 00000100:00100000:0.0:1651529427.772378:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+86:39030:x1731745946609792:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1564us (1670us total) trans 12885080975 rc 0/0 00000100:00100000:0.0:1651529427.772381:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212967 00010000:00010000:1.0:1651529427.772389:0:80278:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c535ec lrc: 0/0,0 mode: --/PW res: [0x2bbd3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc646 expref: 24 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.772392:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c53854 lrc: 2/0,0 mode: PW/PW res: [0x2bbcf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.772393:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a6ed4a31 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997076544:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.772395:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002731c8d2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.772396:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c53854 lrc: 2/0,0 mode: PW/PW res: [0x2bbcf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.772397:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53862 lrc: 3/0,1 mode: PW/PW res: [0x2bbd3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.772399:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c53854 lrc: 3/0,0 mode: PW/PW res: [0x2bbcf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.772400:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53862 lrc: 3/0,1 mode: PW/PW res: [0x2bbd3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.772403:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53862 lrc: 3/0,1 mode: PW/PW res: [0x2bbd3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.772404:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c53854 lrc: 1/0,0 mode: --/PW res: [0x2bbcf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.772406:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53862 lrc: 3/0,1 mode: PW/PW res: [0x2bbd3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.772409:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53862 lrc: 2/0,0 mode: PW/PW res: [0x2bbd3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.772409:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c53854 lrc: 0/0,0 mode: --/PW res: [0x2bbcf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.772413:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c5385b lrc: 2/0,0 mode: PW/PW res: [0x2bbd1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.772423:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032c39b88 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.772424:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c5385b lrc: 2/0,0 mode: PW/PW res: [0x2bbd1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.772427:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c5385b lrc: 3/0,0 mode: PW/PW res: [0x2bbd1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.772430:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c5385b lrc: 1/0,0 mode: --/PW res: [0x2bbd1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.772433:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c5385b lrc: 0/0,0 mode: --/PW res: [0x2bbd1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.772436:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53862 lrc: 2/0,0 mode: PW/PW res: [0x2bbd3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.772439:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000041a7efd7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.772440:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53862 lrc: 2/0,0 mode: PW/PW res: [0x2bbd3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.772445:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53862 lrc: 3/0,0 mode: PW/PW res: [0x2bbd3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.772448:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53862 lrc: 1/0,0 mode: --/PW res: [0x2bbd3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.772450:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53862 lrc: 0/0,0 mode: --/PW res: [0x2bbd3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.772457:0:80279:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c53869 lrc: 3/0,1 mode: PW/PW res: [0x2bbce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.772460:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c53869 lrc: 3/0,1 mode: PW/PW res: [0x2bbce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.772463:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c53869 lrc: 3/0,1 mode: PW/PW res: [0x2bbce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.772465:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c53869 lrc: 2/0,0 mode: PW/PW res: [0x2bbce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.772538:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+86:39030:x1731745946609920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1676us (1824us total) trans 12885080976 rc 0/0 00000100:00100000:1.0:1651529427.772541:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212968 00000100:00100000:0.0:1651529427.772595:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000946e402f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+85:39030:x1731745946609600:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1730us (1860us total) trans 12885080977 rc 0/0 00000100:00100000:0.0:1651529427.772598:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212969 00010000:00010000:0.0:1651529427.772605:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c53869 lrc: 2/0,0 mode: PW/PW res: [0x2bbce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.772611:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024627ba8 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.772612:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c53869 lrc: 2/0,0 mode: PW/PW res: [0x2bbce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.772615:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c53869 lrc: 3/0,0 mode: PW/PW res: [0x2bbce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.772619:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c53869 lrc: 1/0,0 mode: --/PW res: [0x2bbce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.772622:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c53869 lrc: 0/0,0 mode: --/PW res: [0x2bbce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.772628:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53870 lrc: 3/0,1 mode: PW/PW res: [0x2bbd0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.772630:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53870 lrc: 3/0,1 mode: PW/PW res: [0x2bbd0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.772633:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53870 lrc: 3/0,1 mode: PW/PW res: [0x2bbd0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.772636:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53870 lrc: 2/0,0 mode: PW/PW res: [0x2bbd0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.772660:0:72396:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c7657c6f pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:72396:1731745997076672:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529427.772664:0:72396:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c53877 lrc: 3/0,1 mode: --/PW res: [0x2bbd2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.772673:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000086eaa330 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997076736:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529427.772675:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c5387e lrc: 3/0,1 mode: --/PW res: [0x2bbd4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.772816:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+85:39030:x1731745946609728:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1910us (2067us total) trans 12885080978 rc 0/0 00000100:00100000:1.0:1651529427.772832:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529427.772832:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212970 00000100:00100000:0.0:1651529427.772845:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946610112 00000100:00100000:0.0:1651529427.772856:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212973 00000100:00100000:0.0:1651529427.772857:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+85:39029:x1731745946610112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529427.772871:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529427.772874:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179158 count 1 00000100:00100000:1.0:1651529427.772882:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529427.772884:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c53885 lrc: 3/0,1 mode: --/PW res: [0x2bbd6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.772891:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529427.772894:0:106695:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c53601 lrc: 2/0,0 mode: PW/PW res: [0x2bbd6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc65b expref: 23 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.772897:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.772898:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1651529427.772899:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:0.0:1651529427.772899:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c53885 lrc: 4/0,1 mode: --/PW res: [0x2bbd6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.772905:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529427.772906:0:106695:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c53601 lrc: 3/0,0 mode: PW/PW res: [0x2bbd6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc65b expref: 23 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.772909:0:106695:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c53601 lrc: 4/0,0 mode: PW/PW res: [0x2bbd6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc65b expref: 23 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.772912:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396833728 00000100:00100000:0.0:1651529427.772913:0:106695:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000597d93ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997076800:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529427.772918:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c535e5 lrc: 4/0,0 mode: PW/PW res: [0x2bbd2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc63f expref: 24 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.772925:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396833792 00000100:00100000:0.0:1651529427.772929:0:106695:0:(client.c:2492:ptlrpc_set_wait()) set 000000005b4623d5 going to sleep for 6 seconds 00010000:00010000:1.0:1651529427.772933:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c535f3 lrc: 4/0,0 mode: PW/PW res: [0x2bbd4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc64d expref: 25 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.772934:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53870 lrc: 2/0,0 mode: PW/PW res: [0x2bbd0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.772939:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13431 00010000:00010000:0.0:1651529427.772940:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f0b0fa2c already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529427.772941:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000041d3f4d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+25:41278:x1731746396833728:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529427.772941:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53870 lrc: 2/0,0 mode: PW/PW res: [0x2bbd0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.772944:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529427.772944:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53870 lrc: 3/0,0 mode: PW/PW res: [0x2bbd0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.772945:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c535e5 lrc: 4/0,0 mode: PW/PW res: [0x2bbd2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc63f expref: 25 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.772949:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53870 lrc: 1/0,0 mode: --/PW res: [0x2bbd0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.772950:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c535e5 lrc: 3/0,0 mode: PW/PW res: [0x2bbd2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc63f expref: 25 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.772952:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53870 lrc: 0/0,0 mode: --/PW res: [0x2bbd0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.772956:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c535e5 lrc: 0/0,0 mode: --/PW res: [0x2bbd2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc63f expref: 25 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.772959:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946610240 00010000:00010000:1.0:1651529427.772960:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.772960:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.772961:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c53877 lrc: 3/0,1 mode: PW/PW res: [0x2bbd2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.772964:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c53877 lrc: 4/0,1 mode: PW/PW res: [0x2bbd2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.772968:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946610048 00000100:00100000:0.0:1651529427.772972:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946610176 00010000:00010000:1.0:1651529427.772976:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529427.772976:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212974 00000100:00100000:0.0:1651529427.772978:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+88:39029:x1731745946610240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529427.772984:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000041d3f4d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+24:41278:x1731746396833728:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529427.772986:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13431 00000100:00100000:1.0:1651529427.772991:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13432 00000100:00100000:1.0:1651529427.772993:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+23:41278:x1731746396833792:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529427.772995:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529427.772997:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c535f3 lrc: 4/0,0 mode: PW/PW res: [0x2bbd4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc64d expref: 23 pid: 151609 timeout: 20186 lvb_type: 0 00002000:00080000:0.0:1651529427.772998:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179160 count 1 00010000:00010000:1.0:1651529427.773000:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c535f3 lrc: 3/0,0 mode: PW/PW res: [0x2bbd4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc64d expref: 23 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.773002:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c5388c lrc: 3/0,1 mode: --/PW res: [0x2bbd8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.773005:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c535f3 lrc: 0/0,0 mode: --/PW res: [0x2bbd4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc64d expref: 23 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.773006:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c5360f lrc: 2/0,0 mode: PW/PW res: [0x2bbd8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc677 expref: 23 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.773009:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.773010:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.773011:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.773011:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.773011:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c5388c lrc: 4/0,1 mode: --/PW res: [0x2bbd8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.773012:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c5387e lrc: 3/0,1 mode: PW/PW res: [0x2bbd4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.773015:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c5387e lrc: 4/0,1 mode: PW/PW res: [0x2bbd4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.773017:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c5360f lrc: 3/0,0 mode: PW/PW res: [0x2bbd8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc677 expref: 22 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.773020:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529427.773021:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c5360f lrc: 4/0,0 mode: PW/PW res: [0x2bbd8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc677 expref: 22 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.773025:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+22:41278:x1731746396833792:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 31us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529427.773025:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000056e45ef2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997076864:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529427.773027:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13432 00000100:00100000:0.0:1651529427.773034:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b1b3d0f8 going to sleep for 6 seconds 00000100:00100000:1.0:1651529427.773035:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212975 00000100:00100000:1.0:1651529427.773037:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+88:39029:x1731745946610048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529427.773041:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212976 00002000:00080000:1.0:1651529427.773042:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179157 count 1 00000100:00100000:0.0:1651529427.773043:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+88:39029:x1731745946610176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529427.773046:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c53893 lrc: 3/0,1 mode: --/PW res: [0x2bbd5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529427.773047:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179159 count 1 00010000:00010000:1.0:1651529427.773050:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c535fa lrc: 2/0,0 mode: PW/PW res: [0x2bbd5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc654 expref: 21 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.773050:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c5389a lrc: 3/0,1 mode: --/PW res: [0x2bbd7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.773053:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.773054:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.773054:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c53893 lrc: 4/0,1 mode: --/PW res: [0x2bbd5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.773054:0:80280:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c53608 lrc: 2/0,0 mode: PW/PW res: [0x2bbd7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc669 expref: 21 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.773057:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.773057:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.773058:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c5389a lrc: 4/0,1 mode: --/PW res: [0x2bbd7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.773060:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c535fa lrc: 3/0,0 mode: PW/PW res: [0x2bbd5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc654 expref: 21 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.773064:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c535fa lrc: 4/0,0 mode: PW/PW res: [0x2bbd5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc654 expref: 21 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.773064:0:80280:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c53608 lrc: 3/0,0 mode: PW/PW res: [0x2bbd7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc669 expref: 21 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.773069:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004089c807 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997076928:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.773070:0:80280:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c53608 lrc: 4/0,0 mode: PW/PW res: [0x2bbd7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc669 expref: 21 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.773073:0:80280:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000fe04db9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997076992:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529427.773077:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd96f074 going to sleep for 6 seconds 00000100:00100000:0.0:1651529427.773080:0:80280:0:(client.c:2492:ptlrpc_set_wait()) set 000000009973ad87 going to sleep for 6 seconds 00010000:00010000:1.0:1651529427.773081:0:72396:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c53877 lrc: 3/0,1 mode: PW/PW res: [0x2bbd2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.773084:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c53877 lrc: 3/0,1 mode: PW/PW res: [0x2bbd2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.773087:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c53877 lrc: 3/0,1 mode: PW/PW res: [0x2bbd2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.773090:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c53877 lrc: 2/0,0 mode: PW/PW res: [0x2bbd2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.773095:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529427.773141:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c53877 lrc: 2/0,0 mode: PW/PW res: [0x2bbd2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.773145:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002e24dea3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.773146:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c53877 lrc: 2/0,0 mode: PW/PW res: [0x2bbd2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.773149:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c53877 lrc: 3/0,0 mode: PW/PW res: [0x2bbd2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.773154:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c53877 lrc: 1/0,0 mode: --/PW res: [0x2bbd2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.773157:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c53877 lrc: 0/0,0 mode: --/PW res: [0x2bbd2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.773164:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946610304 00000100:00100000:0.0:1651529427.773171:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212977 00000100:00100000:0.0:1651529427.773173:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dabd64d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+90:39029:x1731745946610304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529427.773179:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179161 count 1 00010000:00010000:0.0:1651529427.773182:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c538a1 lrc: 3/0,1 mode: --/PW res: [0x2bbd9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.773187:0:80281:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c53616 lrc: 2/0,0 mode: PW/PW res: [0x2bbd9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc685 expref: 21 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.773190:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.773190:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.773191:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c538a1 lrc: 4/0,1 mode: --/PW res: [0x2bbd9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.773197:0:80281:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c53616 lrc: 3/0,0 mode: PW/PW res: [0x2bbd9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc685 expref: 21 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.773217:0:80281:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c53616 lrc: 4/0,0 mode: PW/PW res: [0x2bbd9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc685 expref: 21 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.773240:0:80281:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000df603127 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997077056:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529427.773252:0:80281:0:(client.c:2492:ptlrpc_set_wait()) set 000000006f708c4c going to sleep for 6 seconds 00000100:00100000:1.0:1651529427.773272:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004de851bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+90:39030:x1731745946609856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 2363us (2517us total) trans 12885080979 rc 0/0 00000100:00100000:1.0:1651529427.773275:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212971 00010000:00010000:0.0:1651529427.773290:0:156655:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c5384d lrc: 3/0,1 mode: PW/PW res: [0x2bbcd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.773295:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c5384d lrc: 3/0,1 mode: PW/PW res: [0x2bbcd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.773298:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c5384d lrc: 3/0,1 mode: PW/PW res: [0x2bbcd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.773299:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c5387e lrc: 3/0,1 mode: PW/PW res: [0x2bbd4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.773303:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c5387e lrc: 3/0,1 mode: PW/PW res: [0x2bbd4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.773303:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c5384d lrc: 2/0,0 mode: PW/PW res: [0x2bbcd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.773309:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c5387e lrc: 3/0,1 mode: PW/PW res: [0x2bbd4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.773312:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c5387e lrc: 2/0,0 mode: PW/PW res: [0x2bbd4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.773459:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eff08db4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+91:39029:x1731745946609984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 2438us (2489us total) trans 12885080981 rc 0/0 00000100:00100000:1.0:1651529427.773462:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212972 00000100:00100000:0.0:1651529427.773495:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e2020717 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+90:39030:x1731745946609536:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 2809us (2835us total) trans 12885080980 rc 0/0 00000100:00100000:0.0:1651529427.773498:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212965 00010000:00010000:0.0:1651529427.773506:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c5384d lrc: 2/0,0 mode: PW/PW res: [0x2bbcd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.773509:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005635b116 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.773510:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c5384d lrc: 2/0,0 mode: PW/PW res: [0x2bbcd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.773513:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529427.773513:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c5384d lrc: 3/0,0 mode: PW/PW res: [0x2bbcd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.773524:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c5384d lrc: 1/0,0 mode: --/PW res: [0x2bbcd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.773527:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c5384d lrc: 0/0,0 mode: --/PW res: [0x2bbcd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.773532:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c5387e lrc: 2/0,0 mode: PW/PW res: [0x2bbd4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.773534:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001b109cb1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.773535:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c5387e lrc: 2/0,0 mode: PW/PW res: [0x2bbd4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.773538:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c5387e lrc: 3/0,0 mode: PW/PW res: [0x2bbd4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.773541:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c5387e lrc: 1/0,0 mode: --/PW res: [0x2bbd4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.773544:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c5387e lrc: 0/0,0 mode: --/PW res: [0x2bbd4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.773577:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000056e45ef2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997076864:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529427.773578:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004089c807 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997076928:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529427.773582:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c53893 lrc: 3/0,1 mode: --/PW res: [0x2bbd5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.773582:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c5388c lrc: 3/0,1 mode: --/PW res: [0x2bbd8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.773590:0:80280:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000fe04db9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:80280:1731745997076992:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.773593:0:80280:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c5389a lrc: 3/0,1 mode: --/PW res: [0x2bbd7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.773599:0:106695:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000597d93ff pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:106695:1731745997076800:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.773601:0:106695:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c53885 lrc: 3/0,1 mode: --/PW res: [0x2bbd6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.773607:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946610368 00000100:00100000:1.0:1651529427.773632:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212978 00000100:00100000:1.0:1651529427.773634:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+90:39029:x1731745946610368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529427.773651:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179162 count 1 00010000:00010000:1.0:1651529427.773656:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c538a8 lrc: 3/0,1 mode: --/PW res: [0x2bbda:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.773661:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c5361d lrc: 2/0,0 mode: PW/PW res: [0x2bbda:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc693 expref: 21 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.773662:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529427.773664:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.773664:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.773665:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c538a8 lrc: 4/0,1 mode: --/PW res: [0x2bbda:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.773671:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529427.773672:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c5361d lrc: 3/0,0 mode: PW/PW res: [0x2bbda:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc693 expref: 21 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.773676:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c5361d lrc: 4/0,0 mode: PW/PW res: [0x2bbda:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc693 expref: 21 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.773678:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529427.773681:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004089c807 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997077120:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529427.773690:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529427.773701:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd96f074 going to sleep for 6 seconds 00000100:00100000:0.0:1651529427.773704:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529427.773714:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396833920 00010000:00010000:1.0:1651529427.773719:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c5360f lrc: 4/0,0 mode: PW/PW res: [0x2bbd8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc677 expref: 22 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.773726:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396834048 00010000:00010000:1.0:1651529427.773729:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c53608 lrc: 4/0,0 mode: PW/PW res: [0x2bbd7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc669 expref: 23 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.773733:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396833856 00010000:00010000:1.0:1651529427.773735:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c53601 lrc: 4/0,0 mode: PW/PW res: [0x2bbd6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc65b expref: 24 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.773742:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529427.773748:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396833984 00010000:00010000:1.0:1651529427.773751:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c535fa lrc: 4/0,0 mode: PW/PW res: [0x2bbd5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc654 expref: 25 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.773754:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529427.773755:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396834112 00010000:00010000:1.0:1651529427.773758:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c53616 lrc: 5/0,0 mode: PW/PW res: [0x2bbd9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc685 expref: 26 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.773761:0:80281:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000df603127 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:80281:1731745997077056:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529427.773763:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13433 00000100:00100000:1.0:1651529427.773764:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000461918a5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+26:41279:x1731746396833920:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529427.773765:0:80281:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c538a1 lrc: 3/0,1 mode: --/PW res: [0x2bbd9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.773767:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529427.773768:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c5360f lrc: 4/0,0 mode: PW/PW res: [0x2bbd8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc677 expref: 26 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.773772:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c5360f lrc: 3/0,0 mode: PW/PW res: [0x2bbd8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc677 expref: 26 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.773773:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13434 00000100:00100000:0.0:1651529427.773775:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000fe04db9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+26:41279:x1731746396834048:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529427.773788:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c5360f lrc: 0/0,0 mode: --/PW res: [0x2bbd8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc677 expref: 26 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.773788:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529427.773790:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c53608 lrc: 4/0,0 mode: PW/PW res: [0x2bbd7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc669 expref: 26 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.773792:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.773792:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.773793:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c5388c lrc: 3/0,1 mode: PW/PW res: [0x2bbd8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.773794:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c53608 lrc: 3/0,0 mode: PW/PW res: [0x2bbd7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc669 expref: 25 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.773797:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c5388c lrc: 4/0,1 mode: PW/PW res: [0x2bbd8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.773800:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c53608 lrc: 0/0,0 mode: --/PW res: [0x2bbd7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc669 expref: 25 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.773803:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.773806:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529427.773810:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.773811:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c5389a lrc: 3/0,1 mode: PW/PW res: [0x2bbd7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.773816:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000461918a5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+24:41279:x1731746396833920:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 51us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529427.773819:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13433 00010000:00010000:0.0:1651529427.773819:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c5389a lrc: 4/0,1 mode: PW/PW res: [0x2bbd7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.773826:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529427.773829:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13435 00000100:00100000:1.0:1651529427.773831:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000056e45ef2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+23:41279:x1731746396833856:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529427.773833:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1651529427.773833:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000fe04db9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+23:41279:x1731746396834048:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 58us (155us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529427.773835:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c53601 lrc: 4/0,0 mode: PW/PW res: [0x2bbd6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc65b expref: 23 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.773836:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13434 00010000:00010000:1.0:1651529427.773839:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c53601 lrc: 3/0,0 mode: PW/PW res: [0x2bbd6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc65b expref: 23 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.773842:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13436 00010000:00010000:1.0:1651529427.773844:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c53601 lrc: 0/0,0 mode: --/PW res: [0x2bbd6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc65b expref: 22 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.773844:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9b0314b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+22:41279:x1731746396833984:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529427.773846:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529427.773847:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.773848:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.773848:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c53885 lrc: 3/0,1 mode: PW/PW res: [0x2bbd6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.773848:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c535fa lrc: 4/0,0 mode: PW/PW res: [0x2bbd5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc654 expref: 21 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.773851:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c53885 lrc: 4/0,1 mode: PW/PW res: [0x2bbd6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.773852:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c535fa lrc: 3/0,0 mode: PW/PW res: [0x2bbd5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc654 expref: 21 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.773856:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c535fa lrc: 0/0,0 mode: --/PW res: [0x2bbd5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc654 expref: 21 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.773860:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529427.773865:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000056e45ef2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+21:41279:x1731746396833856:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 34us (162us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529427.773867:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.773867:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529427.773868:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13435 00010000:00010000:0.0:1651529427.773868:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c53893 lrc: 3/0,1 mode: PW/PW res: [0x2bbd5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.773871:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c53893 lrc: 4/0,1 mode: PW/PW res: [0x2bbd5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.773872:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13437 00000100:00100000:1.0:1651529427.773874:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5ebc6ba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+19:41279:x1731746396834112:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529427.773876:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529427.773877:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c53616 lrc: 4/0,0 mode: PW/PW res: [0x2bbd9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc685 expref: 19 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.773880:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529427.773886:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9b0314b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+19:41279:x1731746396833984:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (144us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529427.773888:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c53616 lrc: 3/0,0 mode: PW/PW res: [0x2bbd9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc685 expref: 19 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.773889:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13436 00010000:00010000:1.0:1651529427.773893:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c53616 lrc: 0/0,0 mode: --/PW res: [0x2bbd9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc685 expref: 18 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.773896:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c5388c lrc: 3/0,1 mode: PW/PW res: [0x2bbd8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.773897:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.773897:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.773898:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c538a1 lrc: 3/0,1 mode: PW/PW res: [0x2bbd9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.773899:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c5388c lrc: 3/0,1 mode: PW/PW res: [0x2bbd8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.773901:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c538a1 lrc: 4/0,1 mode: PW/PW res: [0x2bbd9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.773902:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c5388c lrc: 3/0,1 mode: PW/PW res: [0x2bbd8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.773905:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c5388c lrc: 2/0,0 mode: PW/PW res: [0x2bbd8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.773909:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529427.773915:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5ebc6ba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+17:41279:x1731746396834112:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 41us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529427.773918:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13437 00010000:00010000:1.0:1651529427.773926:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c53893 lrc: 3/0,1 mode: PW/PW res: [0x2bbd5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.773929:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c53893 lrc: 3/0,1 mode: PW/PW res: [0x2bbd5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.773932:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c53893 lrc: 3/0,1 mode: PW/PW res: [0x2bbd5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.773938:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c53893 lrc: 2/0,0 mode: PW/PW res: [0x2bbd5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.774067:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+92:39029:x1731745946610240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1088us (1195us total) trans 12885080982 rc 0/0 00000100:00100000:0.0:1651529427.774070:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212974 00000100:00100000:0.0:1651529427.774075:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946610432 00000100:00100000:0.0:1651529427.774085:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946610496 00000100:00100000:0.0:1651529427.774090:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212979 00000100:00100000:0.0:1651529427.774092:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000597d93ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+93:39030:x1731745946610432:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529427.774097:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179163 count 1 00000100:00100000:1.0:1651529427.774099:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+93:39029:x1731745946610048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1061us (1207us total) trans 12885080983 rc 0/0 00000100:00100000:1.0:1651529427.774102:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212975 00010000:00010000:0.0:1651529427.774102:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c538af lrc: 3/0,1 mode: --/PW res: [0x2bbdb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.774107:0:151609:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c53624 lrc: 2/0,0 mode: PW/PW res: [0x2bbdb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6a1 expref: 16 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.774108:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212980 00000100:00100000:1.0:1651529427.774110:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000098d47485 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+92:39030:x1731745946610496:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529427.774113:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.774113:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529427.774114:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c538af lrc: 4/0,1 mode: --/PW res: [0x2bbdb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529427.774115:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179164 count 1 00010000:00010000:1.0:1651529427.774119:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c538b6 lrc: 3/0,1 mode: --/PW res: [0x2bbdc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.774120:0:151609:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c53624 lrc: 3/0,0 mode: PW/PW res: [0x2bbdb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6a1 expref: 16 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.774124:0:72395:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c5362b lrc: 2/0,0 mode: PW/PW res: [0x2bbdc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6af expref: 16 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.774124:0:151609:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c53624 lrc: 4/0,0 mode: PW/PW res: [0x2bbdb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6a1 expref: 16 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.774127:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.774127:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.774128:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c538b6 lrc: 4/0,1 mode: --/PW res: [0x2bbdc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.774128:0:151609:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000df603127 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997077184:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529427.774135:0:72395:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c5362b lrc: 3/0,0 mode: PW/PW res: [0x2bbdc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6af expref: 16 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.774137:0:151609:0:(client.c:2492:ptlrpc_set_wait()) set 000000009973ad87 going to sleep for 6 seconds 00010000:00010000:1.0:1651529427.774139:0:72395:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c5362b lrc: 4/0,0 mode: PW/PW res: [0x2bbdc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6af expref: 16 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.774142:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c5388c lrc: 2/0,0 mode: PW/PW res: [0x2bbd8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.774145:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000097255e6b already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529427.774146:0:72395:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a9b051f pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997077248:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.774146:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c5388c lrc: 2/0,0 mode: PW/PW res: [0x2bbd8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.774149:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c5388c lrc: 3/0,0 mode: PW/PW res: [0x2bbd8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.774154:0:72395:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b52d0f36 going to sleep for 6 seconds 00010000:00010000:0.0:1651529427.774154:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c5388c lrc: 1/0,0 mode: --/PW res: [0x2bbd8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.774159:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c5388c lrc: 0/0,0 mode: --/PW res: [0x2bbd8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.774163:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c53893 lrc: 2/0,0 mode: PW/PW res: [0x2bbd5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.774166:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d52cc749 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.774166:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c53893 lrc: 2/0,0 mode: PW/PW res: [0x2bbd5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.774169:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c53893 lrc: 3/0,0 mode: PW/PW res: [0x2bbd5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.774172:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c53893 lrc: 1/0,0 mode: --/PW res: [0x2bbd5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.774175:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c53893 lrc: 0/0,0 mode: --/PW res: [0x2bbd5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.774181:0:80280:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c5389a lrc: 3/0,1 mode: PW/PW res: [0x2bbd7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.774183:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c5389a lrc: 3/0,1 mode: PW/PW res: [0x2bbd7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.774186:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c5389a lrc: 3/0,1 mode: PW/PW res: [0x2bbd7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.774189:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c5389a lrc: 2/0,0 mode: PW/PW res: [0x2bbd7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.774358:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+93:39029:x1731745946610176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1314us (1452us total) trans 12885080984 rc 0/0 00000100:00100000:0.0:1651529427.774361:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212976 00010000:00010000:0.0:1651529427.774371:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c5389a lrc: 2/0,0 mode: PW/PW res: [0x2bbd7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.774375:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f146053f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.774376:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c5389a lrc: 2/0,0 mode: PW/PW res: [0x2bbd7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.774379:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c5389a lrc: 3/0,0 mode: PW/PW res: [0x2bbd7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.774383:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c5389a lrc: 1/0,0 mode: --/PW res: [0x2bbd7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.774385:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529427.774386:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c5389a lrc: 0/0,0 mode: --/PW res: [0x2bbd7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.774397:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529427.774399:0:106695:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c53885 lrc: 3/0,1 mode: PW/PW res: [0x2bbd6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.774402:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c53885 lrc: 3/0,1 mode: PW/PW res: [0x2bbd6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.774404:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946610624 00010000:00010000:0.0:1651529427.774406:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c53885 lrc: 3/0,1 mode: PW/PW res: [0x2bbd6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.774409:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c53885 lrc: 2/0,0 mode: PW/PW res: [0x2bbd6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.774411:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946610560 00000100:00100000:1.0:1651529427.774415:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212981 00000100:00100000:1.0:1651529427.774417:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+94:39029:x1731745946610624:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529427.774422:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179166 count 1 00010000:00010000:1.0:1651529427.774426:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c538bd lrc: 3/0,1 mode: --/PW res: [0x2bbde:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.774431:0:80276:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c70854b4/0x3234de053c53639 lrc: 2/0,0 mode: PW/PW res: [0x2bbde:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6cb expref: 16 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.774434:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.774435:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.774436:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c538bd lrc: 4/0,1 mode: --/PW res: [0x2bbde:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.774442:0:80276:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c70854b4/0x3234de053c53639 lrc: 3/0,0 mode: PW/PW res: [0x2bbde:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6cb expref: 16 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.774446:0:80276:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c70854b4/0x3234de053c53639 lrc: 4/0,0 mode: PW/PW res: [0x2bbde:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6cb expref: 16 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.774452:0:80276:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005b3c5aba pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997077312:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529427.774463:0:80276:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cfa1ca05 going to sleep for 6 seconds 00000100:00100000:1.0:1651529427.774468:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212982 00000100:00100000:1.0:1651529427.774470:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+95:39029:x1731745946610560:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529427.774474:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179165 count 1 00010000:00010000:1.0:1651529427.774477:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c538c4 lrc: 3/0,1 mode: --/PW res: [0x2bbdd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.774481:0:72397:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cd0a8495/0x3234de053c53632 lrc: 2/0,0 mode: PW/PW res: [0x2bbdd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6bd expref: 16 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.774484:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.774484:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.774485:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c538c4 lrc: 4/0,1 mode: --/PW res: [0x2bbdd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.774490:0:72397:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cd0a8495/0x3234de053c53632 lrc: 3/0,0 mode: PW/PW res: [0x2bbdd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6bd expref: 16 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.774494:0:72397:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cd0a8495/0x3234de053c53632 lrc: 4/0,0 mode: PW/PW res: [0x2bbdd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6bd expref: 16 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.774498:0:72397:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997077376:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529427.774504:0:72397:0:(client.c:2492:ptlrpc_set_wait()) set 000000007a5495eb going to sleep for 6 seconds 00000100:00100000:1.0:1651529427.774517:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529427.774553:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946610688 00000100:00100000:0.0:1651529427.774559:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+96:39029:x1731745946610112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1700us (1727us total) trans 12885080985 rc 0/0 00000100:00100000:0.0:1651529427.774562:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212973 00000100:00100000:1.0:1651529427.774567:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212983 00000100:00100000:1.0:1651529427.774568:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+95:39029:x1731745946610688:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529427.774572:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c53885 lrc: 2/0,0 mode: PW/PW res: [0x2bbd6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529427.774573:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179167 count 1 00010000:00010000:0.0:1651529427.774575:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004f988dee already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.774576:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c53885 lrc: 2/0,0 mode: PW/PW res: [0x2bbd6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.774577:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c538cb lrc: 3/0,1 mode: --/PW res: [0x2bbdf:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.774579:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c53885 lrc: 3/0,0 mode: PW/PW res: [0x2bbd6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.774582:0:80278:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d9068d9c/0x3234de053c53647 lrc: 2/0,0 mode: PW/PW res: [0x2bbdf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc703 expref: 16 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.774583:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c53885 lrc: 1/0,0 mode: --/PW res: [0x2bbd6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.774585:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.774585:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529427.774586:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c538cb lrc: 4/0,1 mode: --/PW res: [0x2bbdf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.774586:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c53885 lrc: 0/0,0 mode: --/PW res: [0x2bbd6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.774592:0:80278:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d9068d9c/0x3234de053c53647 lrc: 3/0,0 mode: PW/PW res: [0x2bbdf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc703 expref: 16 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.774593:0:80281:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c538a1 lrc: 3/0,1 mode: PW/PW res: [0x2bbd9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.774596:0:80278:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d9068d9c/0x3234de053c53647 lrc: 4/0,0 mode: PW/PW res: [0x2bbdf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc703 expref: 16 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.774596:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c538a1 lrc: 3/0,1 mode: PW/PW res: [0x2bbd9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.774599:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c538a1 lrc: 3/0,1 mode: PW/PW res: [0x2bbd9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.774600:0:80278:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000065f5e47d pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997077440:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.774602:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c538a1 lrc: 2/0,0 mode: PW/PW res: [0x2bbd9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.774608:0:80278:0:(client.c:2492:ptlrpc_set_wait()) set 000000004698fefb going to sleep for 6 seconds 00000100:00100000:0.0:1651529427.774728:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dabd64d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+96:39029:x1731745946610304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1554us (1633us total) trans 12885080986 rc 0/0 00000100:00100000:0.0:1651529427.774731:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212977 00010000:00010000:0.0:1651529427.774738:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c538a1 lrc: 2/0,0 mode: PW/PW res: [0x2bbd9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.774741:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005a2cb180 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.774742:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c538a1 lrc: 2/0,0 mode: PW/PW res: [0x2bbd9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.774745:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c538a1 lrc: 3/0,0 mode: PW/PW res: [0x2bbd9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.774749:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c538a1 lrc: 1/0,0 mode: --/PW res: [0x2bbd9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.774752:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c538a1 lrc: 0/0,0 mode: --/PW res: [0x2bbd9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.775121:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004089c807 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997077120:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529427.775125:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c538a8 lrc: 3/0,1 mode: --/PW res: [0x2bbda:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.775637:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529427.775649:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396834176 00010000:00010000:1.0:1651529427.775660:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c5361d lrc: 4/0,0 mode: PW/PW res: [0x2bbda:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc693 expref: 17 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.775677:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529427.775684:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396834304 00000100:00100000:0.0:1651529427.775686:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529427.775687:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c5362b lrc: 5/0,0 mode: PW/PW res: [0x2bbdc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6af expref: 18 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.775692:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396834432 00000100:00100000:0.0:1651529427.775693:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529427.775695:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cd0a8495/0x3234de053c53632 lrc: 5/0,0 mode: PW/PW res: [0x2bbdd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6bd expref: 19 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.775698:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529427.775699:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396834240 00010000:00010000:1.0:1651529427.775701:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c53624 lrc: 5/0,0 mode: PW/PW res: [0x2bbdb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6a1 expref: 20 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.775705:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396834368 00000100:00100000:0.0:1651529427.775705:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00010000:00010000:1.0:1651529427.775707:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c70854b4/0x3234de053c53639 lrc: 5/0,0 mode: PW/PW res: [0x2bbde:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6cb expref: 21 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.775711:0:80282:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396834496 00010000:00010000:1.0:1651529427.775713:0:80282:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d9068d9c/0x3234de053c53647 lrc: 5/0,0 mode: PW/PW res: [0x2bbdf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc703 expref: 22 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.775714:0:151609:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000df603127 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:151609:1731745997077184:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529427.775717:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13438 00010000:00010000:0.0:1651529427.775718:0:151609:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c538af lrc: 3/0,1 mode: --/PW res: [0x2bbdb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.775719:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068b6c75f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+22:41279:x1731746396834176:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529427.775723:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529427.775724:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c5361d lrc: 4/0,0 mode: PW/PW res: [0x2bbda:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc693 expref: 22 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.775726:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13439 00010000:00010000:1.0:1651529427.775728:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c5361d lrc: 3/0,0 mode: PW/PW res: [0x2bbda:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc693 expref: 22 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.775728:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005529fd8d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+22:41279:x1731746396834304:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529427.775732:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529427.775734:0:80282:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c5361d lrc: 0/0,0 mode: --/PW res: [0x2bbda:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc693 expref: 22 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.775734:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c5362b lrc: 5/0,0 mode: PW/PW res: [0x2bbdc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6af expref: 22 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.775737:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c5362b lrc: 4/0,0 mode: PW/PW res: [0x2bbdc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6af expref: 21 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.775738:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.775738:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.775739:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c538a8 lrc: 3/0,1 mode: PW/PW res: [0x2bbda:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.775742:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c538a8 lrc: 4/0,1 mode: PW/PW res: [0x2bbda:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.775743:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.775744:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.775745:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c538b6 lrc: 3/0,1 mode: PW/PW res: [0x2bbdc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.775748:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c538b6 lrc: 4/0,1 mode: PW/PW res: [0x2bbdc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.775749:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529427.775753:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529427.775757:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068b6c75f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+21:41279:x1731746396834176:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 38us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529427.775760:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13438 00000100:00100000:0.0:1651529427.775760:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005529fd8d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+21:41279:x1731746396834304:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 31us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529427.775763:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13439 00000100:00100000:1.0:1651529427.775765:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13440 00000100:00100000:1.0:1651529427.775766:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f53a84c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+19:41279:x1731746396834432:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529427.775768:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13441 00010000:00010000:1.0:1651529427.775769:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529427.775770:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cd0a8495/0x3234de053c53632 lrc: 5/0,0 mode: PW/PW res: [0x2bbdd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6bd expref: 19 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.775770:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000036d32101 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+19:41279:x1731746396834240:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529427.775773:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529427.775774:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c53624 lrc: 4/0,0 mode: PW/PW res: [0x2bbdb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6a1 expref: 19 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.775787:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cd0a8495/0x3234de053c53632 lrc: 4/0,0 mode: PW/PW res: [0x2bbdd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6bd expref: 19 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.775788:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c53624 lrc: 3/0,0 mode: PW/PW res: [0x2bbdb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6a1 expref: 19 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.775792:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.775793:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.775793:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c538c4 lrc: 3/0,1 mode: PW/PW res: [0x2bbdd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.775793:0:72388:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c53624 lrc: 0/0,0 mode: --/PW res: [0x2bbdb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6a1 expref: 19 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.775796:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c538c4 lrc: 4/0,1 mode: PW/PW res: [0x2bbdd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.775797:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.775797:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.775798:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c538af lrc: 3/0,1 mode: PW/PW res: [0x2bbdb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.775801:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529427.775801:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c538af lrc: 4/0,1 mode: PW/PW res: [0x2bbdb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.775806:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f53a84c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+18:41279:x1731746396834432:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 39us (120us total) trans 0 rc 0/0 00010000:00010000:0.0:1651529427.775808:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529427.775809:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13440 00000100:00100000:0.0:1651529427.775814:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000036d32101 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+17:41279:x1731746396834240:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 43us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529427.775817:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13441 00000100:00100000:1.0:1651529427.775819:0:80282:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13442 00000100:00100000:1.0:1651529427.775820:0:80282:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+16:41279:x1731746396834368:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1651529427.775822:0:72388:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13443 00010000:00010000:1.0:1651529427.775823:0:80282:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529427.775824:0:80282:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c70854b4/0x3234de053c53639 lrc: 5/0,0 mode: PW/PW res: [0x2bbde:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6cb expref: 16 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:0.0:1651529427.775824:0:72388:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f55117eb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+16:41279:x1731746396834496:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529427.775826:0:72388:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529427.775827:0:72388:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d9068d9c/0x3234de053c53647 lrc: 5/0,0 mode: PW/PW res: [0x2bbdf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc703 expref: 16 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.775828:0:80282:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c70854b4/0x3234de053c53639 lrc: 4/0,0 mode: PW/PW res: [0x2bbde:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6cb expref: 16 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.775831:0:72388:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d9068d9c/0x3234de053c53647 lrc: 4/0,0 mode: PW/PW res: [0x2bbdf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc703 expref: 16 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:1.0:1651529427.775832:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.775833:0:80282:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.775834:0:80282:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c538bd lrc: 3/0,1 mode: PW/PW res: [0x2bbde:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.775836:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529427.775836:0:72388:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529427.775837:0:80282:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c538bd lrc: 4/0,1 mode: PW/PW res: [0x2bbde:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.775837:0:72388:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c538cb lrc: 3/0,1 mode: PW/PW res: [0x2bbdf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.775840:0:72388:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c538cb lrc: 4/0,1 mode: PW/PW res: [0x2bbdf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.775841:0:80282:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651529427.775844:0:72388:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529427.775845:0:80282:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+16:41279:x1731746396834368:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 24us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529427.775847:0:80282:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13442 00000100:00100000:0.0:1651529427.775848:0:72388:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f55117eb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+16:41279:x1731746396834496:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 24us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529427.775850:0:72388:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13443 00010000:00010000:0.0:1651529427.775856:0:151609:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c538af lrc: 3/0,1 mode: PW/PW res: [0x2bbdb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.775859:0:72397:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd0a8495/0x3234de053c53632 lrc: 0/0,0 mode: --/PW res: [0x2bbdd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6bd expref: 14 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.775859:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c538af lrc: 3/0,1 mode: PW/PW res: [0x2bbdb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.775862:0:72397:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:72397:1731745997077376:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.775865:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c538af lrc: 3/0,1 mode: PW/PW res: [0x2bbdb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.775866:0:72397:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c538c4 lrc: 3/0,1 mode: PW/PW res: [0x2bbdd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.775868:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c538af lrc: 2/0,0 mode: PW/PW res: [0x2bbdb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.775870:0:72397:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c538c4 lrc: 3/0,1 mode: PW/PW res: [0x2bbdd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.775872:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c538c4 lrc: 3/0,1 mode: PW/PW res: [0x2bbdd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.775875:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c538c4 lrc: 3/0,1 mode: PW/PW res: [0x2bbdd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.775878:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c538c4 lrc: 2/0,0 mode: PW/PW res: [0x2bbdd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529427.776016:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000597d93ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+97:39030:x1731745946610432:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1922us (2344us total) trans 12885080987 rc 0/0 00000100:00100000:0.0:1651529427.776019:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212979 00010000:00010000:0.0:1651529427.776025:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c538af lrc: 2/0,0 mode: PW/PW res: [0x2bbdb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.776028:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000819c7a2f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.776029:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c538af lrc: 2/0,0 mode: PW/PW res: [0x2bbdb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.776032:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c538af lrc: 3/0,0 mode: PW/PW res: [0x2bbdb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.776036:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+96:39029:x1731745946610560:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1565us (1638us total) trans 12885080988 rc 0/0 00010000:00010000:0.0:1651529427.776037:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c538af lrc: 1/0,0 mode: --/PW res: [0x2bbdb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.776039:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212982 00010000:00010000:0.0:1651529427.776040:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c538af lrc: 0/0,0 mode: --/PW res: [0x2bbdb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.776044:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c538c4 lrc: 2/0,0 mode: PW/PW res: [0x2bbdd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.776047:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b65e0a0d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.776048:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c538c4 lrc: 2/0,0 mode: PW/PW res: [0x2bbdd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.776050:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c538c4 lrc: 3/0,0 mode: PW/PW res: [0x2bbdd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.776051:0:72395:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c5362b lrc: 0/0,0 mode: --/PW res: [0x2bbdc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6af expref: 13 pid: 151609 timeout: 20186 lvb_type: 0 00010000:00010000:0.0:1651529427.776053:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c538c4 lrc: 1/0,0 mode: --/PW res: [0x2bbdd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.776055:0:72395:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a9b051f pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:72395:1731745997077248:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529427.776056:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c538c4 lrc: 0/0,0 mode: --/PW res: [0x2bbdd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.776058:0:72395:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c538b6 lrc: 3/0,1 mode: PW/PW res: [0x2bbdc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.776062:0:72395:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c538b6 lrc: 3/0,1 mode: PW/PW res: [0x2bbdc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.776064:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c538b6 lrc: 3/0,1 mode: PW/PW res: [0x2bbdc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.776067:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c538b6 lrc: 3/0,1 mode: PW/PW res: [0x2bbdc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.776070:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c538b6 lrc: 2/0,0 mode: PW/PW res: [0x2bbdc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.776116:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c538b6 lrc: 2/0,0 mode: PW/PW res: [0x2bbdc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.776120:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d2b9655c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.776121:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c538b6 lrc: 2/0,0 mode: PW/PW res: [0x2bbdc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.776124:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c538b6 lrc: 3/0,0 mode: PW/PW res: [0x2bbdc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.776128:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c538b6 lrc: 1/0,0 mode: --/PW res: [0x2bbdc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.776131:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c538b6 lrc: 0/0,0 mode: --/PW res: [0x2bbdc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.776258:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000098d47485 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+96:39030:x1731745946610496:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 2147us (2567us total) trans 12885080989 rc 0/0 00000100:00100000:1.0:1651529427.776261:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212980 00010000:00010000:1.0:1651529427.776272:0:80278:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9068d9c/0x3234de053c53647 lrc: 0/0,0 mode: --/PW res: [0x2bbdf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc703 expref: 12 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.776284:0:80278:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000065f5e47d pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:80278:1731745997077440:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529427.776288:0:80278:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c538cb lrc: 3/0,1 mode: PW/PW res: [0x2bbdf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.776292:0:80278:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c538cb lrc: 3/0,1 mode: PW/PW res: [0x2bbdf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.776294:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c538cb lrc: 3/0,1 mode: PW/PW res: [0x2bbdf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.776297:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c538cb lrc: 3/0,1 mode: PW/PW res: [0x2bbdf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.776300:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c538cb lrc: 2/0,0 mode: PW/PW res: [0x2bbdf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.776329:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c538cb lrc: 2/0,0 mode: PW/PW res: [0x2bbdf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.776333:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e35b0bde already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.776334:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c538cb lrc: 2/0,0 mode: PW/PW res: [0x2bbdf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.776338:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c538cb lrc: 3/0,0 mode: PW/PW res: [0x2bbdf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.776342:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c538cb lrc: 1/0,0 mode: --/PW res: [0x2bbdf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.776345:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c538cb lrc: 0/0,0 mode: --/PW res: [0x2bbdf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.776664:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+96:39029:x1731745946610688:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 2095us (2147us total) trans 12885080990 rc 0/0 00000100:00100000:1.0:1651529427.776667:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212983 00010000:00010000:1.0:1651529427.776678:0:80276:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c70854b4/0x3234de053c53639 lrc: 0/0,0 mode: --/PW res: [0x2bbde:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc6cb expref: 11 pid: 151609 timeout: 20186 lvb_type: 0 00000100:00100000:1.0:1651529427.776682:0:80276:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005b3c5aba pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:80276:1731745997077312:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529427.776685:0:80276:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c538bd lrc: 3/0,1 mode: PW/PW res: [0x2bbde:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.776689:0:80276:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c538bd lrc: 3/0,1 mode: PW/PW res: [0x2bbde:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.776701:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c538bd lrc: 3/0,1 mode: PW/PW res: [0x2bbde:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.776704:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c538bd lrc: 3/0,1 mode: PW/PW res: [0x2bbde:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.776707:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c538bd lrc: 2/0,0 mode: PW/PW res: [0x2bbde:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.776725:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c538bd lrc: 2/0,0 mode: PW/PW res: [0x2bbde:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.776729:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000075f9ff9d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.776730:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c538bd lrc: 2/0,0 mode: PW/PW res: [0x2bbde:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.776733:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c538bd lrc: 3/0,0 mode: PW/PW res: [0x2bbde:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.776737:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c538bd lrc: 1/0,0 mode: --/PW res: [0x2bbde:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.776740:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c538bd lrc: 0/0,0 mode: --/PW res: [0x2bbde:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.776860:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+96:39029:x1731745946610624:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 2442us (2475us total) trans 12885080991 rc 0/0 00000100:00100000:1.0:1651529427.776863:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212981 00010000:00010000:1.0:1651529427.776871:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c538a8 lrc: 3/0,1 mode: PW/PW res: [0x2bbda:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.776874:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c538a8 lrc: 3/0,1 mode: PW/PW res: [0x2bbda:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.776877:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c538a8 lrc: 3/0,1 mode: PW/PW res: [0x2bbda:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529427.776880:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c538a8 lrc: 2/0,0 mode: PW/PW res: [0x2bbda:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.776902:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c538a8 lrc: 2/0,0 mode: PW/PW res: [0x2bbda:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.776906:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000294488b6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529427.776907:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c538a8 lrc: 2/0,0 mode: PW/PW res: [0x2bbda:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.776909:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c538a8 lrc: 3/0,0 mode: PW/PW res: [0x2bbda:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.776914:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c538a8 lrc: 1/0,0 mode: --/PW res: [0x2bbda:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529427.776930:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c538a8 lrc: 0/0,0 mode: --/PW res: [0x2bbda:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529427.777022:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+96:39029:x1731745946610368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 3387us (3509us total) trans 12885080992 rc 0/0 00000100:00100000:1.0:1651529427.777025:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212978 00000400:00000080:1.0:1651529429.219037:0:161719:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651529429.219039:0:161719:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 133a: Verifying MDT stats ================================================================================================== 22:10:28 (1651529428) 00000100:00100000:1.0:1651529430.240198:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529430.240240:0:72398:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946610752 00000100:00100000:0.0:1651529430.240267:0:72398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 585 00000100:00100000:0.0:1651529430.240270:0:72398:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+96:39029:x1731745946610752:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651529430.240288:0:72398:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 1073152 granted 353134784 pending 0 free 81309163520 avail 77138452480 00000100:00100000:0.0:1651529430.240318:0:72398:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+96:39029:x1731745946610752:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 48us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529430.240322:0:72398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 585 00000100:00100000:1.0:1651529431.239038:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529431.239058:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396836672 00000100:00100000:1.0:1651529431.239078:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212984 00000100:00100000:1.0:1651529431.239081:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+11:41279:x1731746396836672:12345-10.240.43.64@tcp:2:touch.0 00000100:00100000:1.0:1651529431.239188:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+12:41279:x1731746396836672:12345-10.240.43.64@tcp:2:touch.0 Request processed in 106us (154us total) trans 12885080993 rc 0/0 00000100:00100000:1.0:1651529431.239192:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212984 00000001:00080000:0.0:1651529433.316446:0:72382:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 12885080993 is committed 00000001:00080000:0.0:1651529433.316451:0:72382:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 12885080992 is committed 00000100:00100000:1.0:1651529433.339248:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529433.339261:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529433.339273:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946610944 00000100:00100000:1.0:1651529433.339289:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946611072 00000100:00100000:1.0:1651529433.339295:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212985 00000100:00100000:1.0:1651529433.339297:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946610944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529433.339313:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179168 count 1 00010000:00010000:1.0:1651529433.339326:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c538d2 lrc: 3/0,1 mode: --/PW res: [0x2bbe0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529433.339335:0:80277:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f9aa8039/0x3234de053c5364e lrc: 2/0,0 mode: PW/PW res: [0x2bbe0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc750 expref: 10 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529433.339343:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529433.339344:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529433.339345:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c538d2 lrc: 4/0,1 mode: --/PW res: [0x2bbe0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529433.339358:0:80277:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f9aa8039/0x3234de053c5364e lrc: 3/0,0 mode: PW/PW res: [0x2bbe0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc750 expref: 10 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529433.339363:0:80277:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f9aa8039/0x3234de053c5364e lrc: 4/0,0 mode: PW/PW res: [0x2bbe0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc750 expref: 10 pid: 151609 timeout: 20191 lvb_type: 0 00000100:00100000:1.0:1651529433.339370:0:80277:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003e3f0f77 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997077504:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529433.339402:0:80277:0:(client.c:2492:ptlrpc_set_wait()) set 0000000071742acc going to sleep for 6 seconds 00000100:00100000:1.0:1651529433.339411:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212986 00000100:00100000:1.0:1651529433.339413:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946611072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529433.339419:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179169 count 1 00002000:00010000:1.0:1651529433.339427:0:80278:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbe1:0x0] initial LVB size: 0, mtime: 0x627056d7, atime: 0x627056d7, ctime: 0x627056d7, blocks: 0x0 00010000:00010000:1.0:1651529433.339430:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c538d9 lrc: 3/0,1 mode: --/PW res: [0x2bbe1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529433.339433:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529433.339434:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529433.339436:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c538d9 lrc: 3/0,1 mode: PW/PW res: [0x2bbe1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529433.339441:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c538d9 lrc: 3/0,1 mode: PW/PW res: [0x2bbe1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529433.339445:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c538d9 lrc: 3/0,1 mode: PW/PW res: [0x2bbe1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529433.339448:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c538d9 lrc: 2/0,0 mode: PW/PW res: [0x2bbe1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529433.339473:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c538d9 lrc: 2/0,0 mode: PW/PW res: [0x2bbe1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529433.339480:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003c5315da already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529433.339482:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c538d9 lrc: 2/0,0 mode: PW/PW res: [0x2bbe1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529433.339486:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c538d9 lrc: 3/0,0 mode: PW/PW res: [0x2bbe1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529433.339495:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c538d9 lrc: 1/0,0 mode: --/PW res: [0x2bbe1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529433.339498:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c538d9 lrc: 0/0,0 mode: --/PW res: [0x2bbe1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529433.339549:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946611072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 134us (287us total) trans 12885080994 rc 0/0 00000100:00100000:1.0:1651529433.339553:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212986 00000100:00100000:1.0:1651529433.340315:0:80277:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003e3f0f77 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:80277:1731745997077504:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529433.340321:0:80277:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c538d2 lrc: 3/0,1 mode: --/PW res: [0x2bbe0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529433.340469:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529433.340486:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396839872 00010000:00010000:1.0:1651529433.340493:0:72387:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f9aa8039/0x3234de053c5364e lrc: 4/0,0 mode: PW/PW res: [0x2bbe0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc750 expref: 11 pid: 151609 timeout: 20191 lvb_type: 0 00000100:00100000:1.0:1651529433.340509:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13444 00000100:00100000:1.0:1651529433.340511:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+11:41278:x1731746396839872:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651529433.340515:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529433.340517:0:72387:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f9aa8039/0x3234de053c5364e lrc: 4/0,0 mode: PW/PW res: [0x2bbe0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc750 expref: 11 pid: 151609 timeout: 20191 lvb_type: 0 00010000:00010000:1.0:1651529433.340521:0:72387:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f9aa8039/0x3234de053c5364e lrc: 3/0,0 mode: PW/PW res: [0x2bbe0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc750 expref: 11 pid: 151609 timeout: 20191 lvb_type: 0 00010000:00010000:1.0:1651529433.340529:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9aa8039/0x3234de053c5364e lrc: 0/0,0 mode: --/PW res: [0x2bbe0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc750 expref: 11 pid: 151609 timeout: 20191 lvb_type: 0 00010000:00010000:1.0:1651529433.340533:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529433.340534:0:72387:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529433.340535:0:72387:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c538d2 lrc: 3/0,1 mode: PW/PW res: [0x2bbe0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529433.340538:0:72387:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c538d2 lrc: 4/0,1 mode: PW/PW res: [0x2bbe0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529433.340546:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529433.340557:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+10:41278:x1731746396839872:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 46us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529433.340560:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13444 00010000:00010000:1.0:1651529433.340568:0:80277:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c538d2 lrc: 3/0,1 mode: PW/PW res: [0x2bbe0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529433.340572:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c538d2 lrc: 3/0,1 mode: PW/PW res: [0x2bbe0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529433.340575:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c538d2 lrc: 3/0,1 mode: PW/PW res: [0x2bbe0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529433.340586:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c538d2 lrc: 2/0,0 mode: PW/PW res: [0x2bbe0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529433.340601:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c538d2 lrc: 2/0,0 mode: PW/PW res: [0x2bbe0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529433.340605:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000045fe8361 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529433.340606:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c538d2 lrc: 2/0,0 mode: PW/PW res: [0x2bbe0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529433.340610:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c538d2 lrc: 3/0,0 mode: PW/PW res: [0x2bbe0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529433.340615:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c538d2 lrc: 1/0,0 mode: --/PW res: [0x2bbe0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529433.340618:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c538d2 lrc: 0/0,0 mode: --/PW res: [0x2bbe0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529433.340701:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946610944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1403us (1456us total) trans 12885080995 rc 0/0 00000100:00100000:1.0:1651529433.340705:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212985 00000400:00000080:0.0:1651529434.103201:0:161937:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651529434.103203:0:161937:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 133b: Verifying extra MDT stats ============================================================================================ 22:10:33 (1651529433) 00000100:00100000:0.0:1651529435.360171:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529435.360189:0:72398:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946611136 00000100:00100000:0.0:1651529435.360216:0:72398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 586 00000100:00100000:0.0:1651529435.360218:0:72398:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000b6aa823 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946611136:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651529435.360247:0:72398:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 1073152 granted 353134784 pending 0 free 81309163520 avail 77138452480 00000100:00100000:0.0:1651529435.360276:0:72398:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000b6aa823 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946611136:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 57us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529435.360280:0:72398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 586 00000100:00100000:0.0:1651529438.815595:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529438.815613:0:72398:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396844800 00000100:00100000:0.0:1651529438.815641:0:72398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 587 00000100:00100000:0.0:1651529438.815643:0:72398:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eb9cb61d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+10:429787:x1731746396844800:12345-10.240.43.64@tcp:13:lfs.0 00002000:00000024:0.0:1651529438.815660:0:72398:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 1073152 granted 353134784 pending 0 free 81309163520 avail 77138452480 00000100:00100000:0.0:1651529438.815692:0:72398:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eb9cb61d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+10:429787:x1731746396844800:12345-10.240.43.64@tcp:13:lfs.0 Request processed in 49us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529438.815696:0:72398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 587 00000100:00100000:0.0:1651529439.456275:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529439.456305:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946611392 00000100:00100000:1.0:1651529439.456328:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 94 00000100:00100000:1.0:1651529439.456331:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007f9b0c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946611392:12345-10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:1.0:1651529439.456365:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007f9b0c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946611392:12345-10.240.43.61@tcp:400:kworker/u4:2.0 Request processed in 34us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529439.456368:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 94 00000001:00080000:0.0:1651529439.503089:0:72382:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 12885080995 is committed 00000100:00100000:0.0:1651529440.480091:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529440.480102:0:72398:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946611584 00000100:00100000:0.0:1651529440.480120:0:72398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 588 00000100:00100000:0.0:1651529440.480122:0:72398:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e2020717 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946611584:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651529440.480133:0:72398:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 1073152 granted 353134784 pending 0 free 81309163520 avail 77138452480 00000100:00100000:0.0:1651529440.480150:0:72398:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e2020717 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946611584:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 28us (61us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529440.480154:0:72398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 588 00000100:00100000:1.0:1651529440.893303:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003132c0c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:39099:1731745997077632:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:1.0:1651529440.893331:0:39099:0:(ptlrpcd.c:414:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1651529440.893334:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000020362888 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0b51168f-0bcb-46b1-964e-9e88a09501f8:39099:1731745997077568:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:1.0:1651529440.893588:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000020362888 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0b51168f-0bcb-46b1-964e-9e88a09501f8:39099:1731745997077568:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:1.0:1651529440.893593:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003132c0c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:39099:1731745997077632:10.240.43.61@tcp:400:kworker/u4:0.0 00000400:00000080:0.0:1651529443.059052:0:162155:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651529443.059055:0:162155:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 133c: Verifying OST stats ================================================================================================== 22:10:42 (1651529442) 00000100:00100000:0.0:1651529443.206582:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529443.206599:0:72387:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746396846272 00000100:00100000:0.0:1651529443.206623:0:72387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 150 00000100:00100000:0.0:1651529443.206626:0:72387:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0bff89e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+10:342879:x1731746396846272:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529443.206634:0:72387:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00002000:00010000:0.0:1651529443.206642:0:72387:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bb7d:0x0] updating lvb size from disk: 0 -> 524288 00002000:00010000:0.0:1651529443.206644:0:72387:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bb7d:0x0] updating lvb mtime from disk: 0 -> 1651529395 00002000:00010000:0.0:1651529443.206645:0:72387:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bb7d:0x0] updating lvb ctime from disk: 0 -> 1651529395 00002000:00010000:0.0:1651529443.206646:0:72387:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bb7d:0x0] updating lvb blocks from disk: 0 -> 1024 00010000:00010000:0.0:1651529443.206660:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c5336f lrc: 0/0,0 mode: --/PW res: [0x2bb7d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->524287) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da801 expref: 10 pid: 72395 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529443.206670:0:72387:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bb83:0x0] updating lvb size from disk: 0 -> 33488896 00002000:00010000:0.0:1651529443.206671:0:72387:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2bb83:0x0] updating lvb mtime from disk: 0 -> 1651529411 00002000:00010000:0.0:1651529443.206672:0:72387:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2bb83:0x0] updating lvb ctime from disk: 0 -> 1651529411 00002000:00010000:0.0:1651529443.206673:0:72387:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bb83:0x0] updating lvb blocks from disk: 0 -> 32776 00010000:00010000:0.0:1651529443.206676:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c075ac0/0x3234de053c533bc lrc: 0/0,0 mode: --/PW res: [0x2bb83:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->65535) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc209 expref: 9 pid: 151609 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529443.206681:0:72387:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bb82:0x0] updating lvb size from disk: 524288 -> 1048576 00002000:00010000:0.0:1651529443.206683:0:72387:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bb82:0x0] updating lvb blocks from disk: 0 -> 1024 00010000:00010000:0.0:1651529443.206685:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c533b5 lrc: 0/0,0 mode: --/PW res: [0x2bb82:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc1bc expref: 8 pid: 106695 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529443.206690:0:72387:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2bb81:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:0.0:1651529443.206691:0:72387:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2bb81:0x0] updating lvb blocks from disk: 0 -> 2048 00010000:00010000:0.0:1651529443.206693:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cde66bc6/0x3234de053c533ae lrc: 0/0,0 mode: --/PW res: [0x2bb81:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2dc17d expref: 7 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529443.206700:0:72387:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c53330 lrc: 0/0,0 mode: --/PR res: [0x2bb74:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x525ca385bf2da561 expref: 6 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529443.206704:0:72387:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529443.206729:0:72387:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0bff89e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:342879:x1731746396846272:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 103us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529443.206733:0:72387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 150 00000100:00100000:0.0:1651529445.600175:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529445.600193:0:72398:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946611776 00000100:00100000:0.0:1651529445.600218:0:72398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 589 00000100:00100000:0.0:1651529445.600221:0:72398:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eff08db4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946611776:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651529445.600251:0:72398:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 1073152 granted 353134784 pending 0 free 81309163520 avail 77138452480 00000100:00100000:0.0:1651529445.600281:0:72398:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eff08db4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946611776:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 59us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529445.600284:0:72398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 589 00000100:00100000:0.0:1651529450.720203:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529450.720234:0:72398:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946611968 00000100:00100000:0.0:1651529450.720259:0:72398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 590 00000100:00100000:0.0:1651529450.720262:0:72398:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dabd64d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946611968:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651529450.720280:0:72398:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 1073152 granted 353134784 pending 0 free 81309163520 avail 77138452480 00000100:00100000:0.0:1651529450.720310:0:72398:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dabd64d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946611968:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 47us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529450.720313:0:72398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 590 00000100:00100000:0.0:1651529455.840174:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529455.840192:0:72398:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946612096 00000100:00100000:0.0:1651529455.840218:0:72398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 591 00000100:00100000:0.0:1651529455.840220:0:72398:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000597d93ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946612096:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651529455.840249:0:72398:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 1073152 granted 353134784 pending 0 free 81309163520 avail 77138452480 00000100:00100000:0.0:1651529455.840279:0:72398:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000597d93ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946612096:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 58us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529455.840283:0:72398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 591 00000400:00000080:1.0:1651529460.666900:0:162374:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651529460.666902:0:162374:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 133d: Verifying rename_stats ================================================================================================== 22:11:00 (1651529460) 00000100:00100000:0.0:1651529460.960184:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529460.960205:0:72398:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946612224 00000100:00100000:0.0:1651529460.960249:0:72398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 592 00000100:00100000:0.0:1651529460.960251:0:72398:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000fe04db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946612224:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651529460.960270:0:72398:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 1073152 granted 353134784 pending 0 free 81309163520 avail 77138452480 00000100:00100000:0.0:1651529460.960300:0:72398:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000fe04db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946612224:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 48us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529460.960304:0:72398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 592 00000400:00000080:1.0:1651529465.412970:0:162700:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651529465.412972:0:162700:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 133e: Verifying OST read_bytes write_bytes nid stats =========================================================================== 22:11:05 (1651529465) 00000100:00100000:1.0:1651529465.981298:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000088fa78f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0b51168f-0bcb-46b1-964e-9e88a09501f8:39100:1731745997077696:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:1.0:1651529465.981343:0:39100:0:(ptlrpcd.c:414:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1651529465.981346:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000037ac96ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997077760:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:1.0:1651529465.981637:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000037ac96ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997077760:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:1.0:1651529465.981641:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000088fa78f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0b51168f-0bcb-46b1-964e-9e88a09501f8:39100:1731745997077696:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:0.0:1651529466.080104:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529466.080118:0:72398:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946613056 00000100:00100000:0.0:1651529466.080139:0:72398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 593 00000100:00100000:0.0:1651529466.080142:0:72398:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005529fd8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946613056:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651529466.080157:0:72398:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 1073152 granted 353135808 pending 0 free 81309163520 avail 77138452480 00000100:00100000:0.0:1651529466.080177:0:72398:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005529fd8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946613056:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 35us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529466.080181:0:72398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 593 00000100:00100000:0.0:1651529467.073084:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529467.073110:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397055808 00000100:00100000:0.0:1651529467.073130:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212991 00000100:00100000:0.0:1651529467.073133:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df603127 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:41277:x1731746397055808:12345-10.240.43.64@tcp:9:kworker/u4:0.0 00000020:00000080:0.0:1651529467.073150:0:80278:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0x3234de053c3b9c3 00000100:00080000:0.0:1651529467.073165:0:80278:0:(import.c:85:import_set_state_nolock()) 00000000e254bb62 ¶×à”ÿÿ: changing import state from FULL to CLOSED 00000001:00000004:0.0:1651529467.073190:0:80278:0:(tgt_lastrcvd.c:701:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12885080995 00000100:00100000:0.0:1651529467.073284:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df603127 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2:41277:x1731746397055808:12345-10.240.43.64@tcp:9:kworker/u4:0.0 Request processed in 150us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529467.073289:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212991 00000100:00100000:0.0:1651529467.227870:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.227882:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.227890:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.227897:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.227913:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946613760 00000100:00100000:0.0:1651529467.227935:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946613888 00000100:00100000:0.0:1651529467.227940:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946614016 00000100:00100000:0.0:1651529467.227944:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946614144 00000100:00100000:1.0:1651529467.227951:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212992 00000100:00100000:0.0:1651529467.227954:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212993 00000100:00100000:1.0:1651529467.227955:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003132c0c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946613760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529467.227957:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000020362888 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946613888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.227971:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179172 count 1 00002000:00080000:0.0:1651529467.227971:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179391 count 1 00002000:00010000:1.0:1651529467.227986:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbe4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:0.0:1651529467.227986:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcbf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.227990:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c538e7 lrc: 3/0,1 mode: --/PW res: [0x2bbe4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.227990:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c538e0 lrc: 3/0,1 mode: --/PW res: [0x2bcbf:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.227997:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.227997:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.227998:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.227998:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.228000:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c538e7 lrc: 3/0,1 mode: PW/PW res: [0x2bbe4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228000:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c538e0 lrc: 3/0,1 mode: PW/PW res: [0x2bcbf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228008:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c538e7 lrc: 3/0,1 mode: PW/PW res: [0x2bbe4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228008:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c538e0 lrc: 3/0,1 mode: PW/PW res: [0x2bcbf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228012:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c538e7 lrc: 3/0,1 mode: PW/PW res: [0x2bbe4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228012:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c538e0 lrc: 3/0,1 mode: PW/PW res: [0x2bcbf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228015:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c538e7 lrc: 2/0,0 mode: PW/PW res: [0x2bbe4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228015:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c538e0 lrc: 2/0,0 mode: PW/PW res: [0x2bcbf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.228123:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003132c0c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946613760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 168us (257us total) trans 12885080997 rc 0/0 00000100:00100000:0.0:1651529467.228123:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000020362888 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946613888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 165us (240us total) trans 12885080996 rc 0/0 00000100:00100000:0.0:1651529467.228127:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212993 00000100:00100000:1.0:1651529467.228129:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212992 00000100:00100000:0.0:1651529467.228134:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212994 00000100:00100000:1.0:1651529467.228136:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212995 00000100:00100000:0.0:1651529467.228136:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946614016:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529467.228138:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946614144:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.228141:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179318 count 1 00002000:00080000:1.0:1651529467.228144:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179198 count 1 00002000:00010000:0.0:1651529467.228147:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc76:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.228149:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c538ee lrc: 3/0,1 mode: --/PW res: [0x2bc76:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.228150:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbfe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.228152:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c538f5 lrc: 3/0,1 mode: --/PW res: [0x2bbfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228153:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.228154:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.228155:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c538ee lrc: 3/0,1 mode: PW/PW res: [0x2bc76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228156:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.228157:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.228157:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c538f5 lrc: 3/0,1 mode: PW/PW res: [0x2bbfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228158:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c538ee lrc: 3/0,1 mode: PW/PW res: [0x2bc76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228161:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c538f5 lrc: 3/0,1 mode: PW/PW res: [0x2bbfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228161:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c538ee lrc: 3/0,1 mode: PW/PW res: [0x2bc76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228164:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c538f5 lrc: 3/0,1 mode: PW/PW res: [0x2bbfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228164:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c538ee lrc: 2/0,0 mode: PW/PW res: [0x2bc76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228167:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c538f5 lrc: 2/0,0 mode: PW/PW res: [0x2bbfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.228205:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946614016:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 68us (314us total) trans 12885080998 rc 0/0 00000100:00100000:0.0:1651529467.228208:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212994 00000100:00100000:1.0:1651529467.228209:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946614144:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 70us (312us total) trans 12885080999 rc 0/0 00000100:00100000:1.0:1651529467.228213:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212995 00010000:00010000:0.0:1651529467.228239:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c538e7 lrc: 2/0,0 mode: PW/PW res: [0x2bbe4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228243:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f616ea25 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.228245:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c538e7 lrc: 2/0,0 mode: PW/PW res: [0x2bbe4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228247:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c538e0 lrc: 2/0,0 mode: PW/PW res: [0x2bcbf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228249:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c538e7 lrc: 3/0,0 mode: PW/PW res: [0x2bbe4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228251:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000819c7a2f already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.228252:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c538e0 lrc: 2/0,0 mode: PW/PW res: [0x2bcbf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228255:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c538e0 lrc: 3/0,0 mode: PW/PW res: [0x2bcbf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228259:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c538e7 lrc: 1/0,0 mode: --/PW res: [0x2bbe4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228261:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c538e0 lrc: 1/0,0 mode: --/PW res: [0x2bcbf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228262:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c538e7 lrc: 0/0,0 mode: --/PW res: [0x2bbe4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228264:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c538e0 lrc: 0/0,0 mode: --/PW res: [0x2bcbf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228267:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c538ee lrc: 2/0,0 mode: PW/PW res: [0x2bc76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228268:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c538f5 lrc: 2/0,0 mode: PW/PW res: [0x2bbfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228270:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005a2cb180 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.228271:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000045fe8361 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.228271:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c538ee lrc: 2/0,0 mode: PW/PW res: [0x2bc76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228272:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c538f5 lrc: 2/0,0 mode: PW/PW res: [0x2bbfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228274:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c538ee lrc: 3/0,0 mode: PW/PW res: [0x2bc76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228275:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c538f5 lrc: 3/0,0 mode: PW/PW res: [0x2bbfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228277:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c538ee lrc: 1/0,0 mode: --/PW res: [0x2bc76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228278:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c538f5 lrc: 1/0,0 mode: --/PW res: [0x2bbfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228280:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c538ee lrc: 0/0,0 mode: --/PW res: [0x2bc76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228281:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c538f5 lrc: 0/0,0 mode: --/PW res: [0x2bbfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.228337:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.228352:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.228387:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946613696 00000100:00100000:0.0:1651529467.228395:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946613824 00000100:00100000:0.0:1651529467.228399:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212996 00000100:00100000:0.0:1651529467.228401:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946613696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.228408:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179210 count 1 00000100:00100000:1.0:1651529467.228415:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.228423:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.228439:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946613952 00000100:00100000:1.0:1651529467.228450:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946614080 00000100:00100000:1.0:1651529467.228456:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212997 00002000:00010000:0.0:1651529467.228457:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc0a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529467.228458:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946613824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529467.228459:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c538fc lrc: 3/0,1 mode: --/PW res: [0x2bc0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529467.228464:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179228 count 1 00010000:00010000:0.0:1651529467.228464:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.228464:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.228465:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c538fc lrc: 3/0,1 mode: PW/PW res: [0x2bc0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228469:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c538fc lrc: 3/0,1 mode: PW/PW res: [0x2bc0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.228470:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.228472:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c53903 lrc: 3/0,1 mode: --/PW res: [0x2bc1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228472:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c538fc lrc: 3/0,1 mode: PW/PW res: [0x2bc0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228475:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c538fc lrc: 2/0,0 mode: PW/PW res: [0x2bc0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228476:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.228477:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.228478:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c53903 lrc: 3/0,1 mode: PW/PW res: [0x2bc1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228481:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c53903 lrc: 3/0,1 mode: PW/PW res: [0x2bc1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228484:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c53903 lrc: 3/0,1 mode: PW/PW res: [0x2bc1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228487:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c53903 lrc: 2/0,0 mode: PW/PW res: [0x2bc1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.228522:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+14:39030:x1731745946613696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 120us (185us total) trans 12885081000 rc 0/0 00000100:00100000:0.0:1651529467.228526:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212996 00000100:00100000:0.0:1651529467.228531:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212998 00000100:00100000:1.0:1651529467.228532:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946613824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 74us (179us total) trans 12885081001 rc 0/0 00000100:00100000:0.0:1651529467.228533:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946613952:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529467.228536:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212997 00002000:00080000:0.0:1651529467.228538:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179272 count 1 00000100:00100000:1.0:1651529467.228542:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 212999 00002000:00010000:0.0:1651529467.228543:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc48:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529467.228544:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946614080:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529467.228545:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c5390a lrc: 3/0,1 mode: --/PW res: [0x2bc48:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529467.228548:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179423 count 1 00010000:00010000:0.0:1651529467.228549:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.228550:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.228551:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c5390a lrc: 3/0,1 mode: PW/PW res: [0x2bc48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.228553:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcdf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.228554:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c5390a lrc: 3/0,1 mode: PW/PW res: [0x2bc48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228555:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c53911 lrc: 3/0,1 mode: --/PW res: [0x2bcdf:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228557:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c5390a lrc: 3/0,1 mode: PW/PW res: [0x2bc48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228559:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.228559:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.228560:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c53911 lrc: 3/0,1 mode: PW/PW res: [0x2bcdf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228560:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c5390a lrc: 2/0,0 mode: PW/PW res: [0x2bc48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228564:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c53911 lrc: 3/0,1 mode: PW/PW res: [0x2bcdf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228567:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c53911 lrc: 3/0,1 mode: PW/PW res: [0x2bcdf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228569:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c53911 lrc: 2/0,0 mode: PW/PW res: [0x2bcdf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.228599:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+14:39030:x1731745946613952:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 65us (184us total) trans 12885081002 rc 0/0 00000100:00100000:0.0:1651529467.228602:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212998 00000100:00100000:1.0:1651529467.228606:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946614080:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 61us (182us total) trans 12885081003 rc 0/0 00000100:00100000:1.0:1651529467.228609:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 212999 00010000:00010000:0.0:1651529467.228613:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c538fc lrc: 2/0,0 mode: PW/PW res: [0x2bc0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228616:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c53903 lrc: 2/0,0 mode: PW/PW res: [0x2bc1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228616:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004f988dee already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.228617:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c538fc lrc: 2/0,0 mode: PW/PW res: [0x2bc0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228620:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003c5315da already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.228620:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c538fc lrc: 3/0,0 mode: PW/PW res: [0x2bc0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228621:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c53903 lrc: 2/0,0 mode: PW/PW res: [0x2bc1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228624:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c53903 lrc: 3/0,0 mode: PW/PW res: [0x2bc1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228629:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c53903 lrc: 1/0,0 mode: --/PW res: [0x2bc1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228632:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c53903 lrc: 0/0,0 mode: --/PW res: [0x2bc1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228636:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c5390a lrc: 2/0,0 mode: PW/PW res: [0x2bc48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228639:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f146053f already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.228647:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c5390a lrc: 2/0,0 mode: PW/PW res: [0x2bc48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228650:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c5390a lrc: 3/0,0 mode: PW/PW res: [0x2bc48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228650:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c538fc lrc: 1/0,0 mode: --/PW res: [0x2bc0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228653:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c538fc lrc: 0/0,0 mode: --/PW res: [0x2bc0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228654:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c5390a lrc: 1/0,0 mode: --/PW res: [0x2bc48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228656:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c5390a lrc: 0/0,0 mode: --/PW res: [0x2bc48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228660:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c53911 lrc: 2/0,0 mode: PW/PW res: [0x2bcdf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228663:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000294488b6 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.228664:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c53911 lrc: 2/0,0 mode: PW/PW res: [0x2bcdf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228667:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c53911 lrc: 3/0,0 mode: PW/PW res: [0x2bcdf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228670:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c53911 lrc: 1/0,0 mode: --/PW res: [0x2bcdf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228672:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c53911 lrc: 0/0,0 mode: --/PW res: [0x2bcdf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.228696:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.228706:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946614208 00000100:00100000:0.0:1651529467.228718:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213000 00000100:00100000:0.0:1651529467.228720:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946614208:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.228725:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179365 count 1 00002000:00010000:0.0:1651529467.228731:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bca5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.228733:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c53918 lrc: 3/0,1 mode: --/PW res: [0x2bca5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228736:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.228737:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.228738:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c53918 lrc: 3/0,1 mode: PW/PW res: [0x2bca5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228742:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c53918 lrc: 3/0,1 mode: PW/PW res: [0x2bca5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228745:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c53918 lrc: 3/0,1 mode: PW/PW res: [0x2bca5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228747:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c53918 lrc: 2/0,0 mode: PW/PW res: [0x2bca5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.228817:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:39029:x1731745946614208:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 95us (121us total) trans 12885081004 rc 0/0 00000100:00100000:0.0:1651529467.228820:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213000 00010000:00010000:0.0:1651529467.228829:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c53918 lrc: 2/0,0 mode: PW/PW res: [0x2bca5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228832:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000097255e6b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.228834:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c53918 lrc: 2/0,0 mode: PW/PW res: [0x2bca5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228837:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c53918 lrc: 3/0,0 mode: PW/PW res: [0x2bca5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228841:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c53918 lrc: 1/0,0 mode: --/PW res: [0x2bca5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228844:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c53918 lrc: 0/0,0 mode: --/PW res: [0x2bca5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.228859:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.228867:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.228873:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.228891:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946614272 00000100:00100000:1.0:1651529467.228902:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946614336 00000100:00100000:1.0:1651529467.228908:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946614400 00000100:00100000:1.0:1651529467.228914:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213001 00000100:00100000:1.0:1651529467.228916:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+16:39030:x1731745946614272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529467.228917:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213002 00000100:00100000:0.0:1651529467.228919:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+16:39029:x1731745946614336:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.228921:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179244 count 1 00002000:00080000:0.0:1651529467.228925:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179409 count 1 00002000:00010000:1.0:1651529467.228927:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.228929:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c5391f lrc: 3/0,1 mode: --/PW res: [0x2bc2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.228931:0:80281:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcd1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.228932:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.228933:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.228933:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c53926 lrc: 3/0,1 mode: --/PW res: [0x2bcd1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228934:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c5391f lrc: 3/0,1 mode: PW/PW res: [0x2bc2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228937:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.228938:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.228938:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c53926 lrc: 3/0,1 mode: PW/PW res: [0x2bcd1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228940:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c5391f lrc: 3/0,1 mode: PW/PW res: [0x2bc2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228942:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c53926 lrc: 3/0,1 mode: PW/PW res: [0x2bcd1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228943:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c5391f lrc: 3/0,1 mode: PW/PW res: [0x2bc2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228945:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c53926 lrc: 3/0,1 mode: PW/PW res: [0x2bcd1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.228946:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c5391f lrc: 2/0,0 mode: PW/PW res: [0x2bc2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.228948:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c53926 lrc: 2/0,0 mode: PW/PW res: [0x2bcd1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.229010:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:39030:x1731745946614272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 93us (150us total) trans 12885081005 rc 0/0 00000100:00100000:1.0:1651529467.229013:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213001 00000100:00100000:1.0:1651529467.229026:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213003 00000100:00100000:1.0:1651529467.229027:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:39030:x1731745946614400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.229032:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179401 count 1 00002000:00010000:1.0:1651529467.229038:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcc9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.229039:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c5392d lrc: 3/0,1 mode: --/PW res: [0x2bcc9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.229041:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:39029:x1731745946614336:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 122us (174us total) trans 12885081006 rc 0/0 00010000:00010000:1.0:1651529467.229043:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.229043:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.229044:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c5392d lrc: 3/0,1 mode: PW/PW res: [0x2bcc9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.229045:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213002 00010000:00010000:1.0:1651529467.229048:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c5392d lrc: 3/0,1 mode: PW/PW res: [0x2bcc9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229054:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c5392d lrc: 3/0,1 mode: PW/PW res: [0x2bcc9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229056:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c5392d lrc: 2/0,0 mode: PW/PW res: [0x2bcc9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229073:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c5391f lrc: 2/0,0 mode: PW/PW res: [0x2bc2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229077:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000075f9ff9d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.229078:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c5391f lrc: 2/0,0 mode: PW/PW res: [0x2bc2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229081:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c5391f lrc: 3/0,0 mode: PW/PW res: [0x2bc2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229087:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c5391f lrc: 1/0,0 mode: --/PW res: [0x2bc2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229090:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c5391f lrc: 0/0,0 mode: --/PW res: [0x2bc2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229094:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c53926 lrc: 2/0,0 mode: PW/PW res: [0x2bcd1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229097:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005635b116 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529467.229098:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:39030:x1731745946614400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 70us (224us total) trans 12885081007 rc 0/0 00010000:00010000:0.0:1651529467.229098:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c53926 lrc: 2/0,0 mode: PW/PW res: [0x2bcd1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229100:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c53926 lrc: 3/0,0 mode: PW/PW res: [0x2bcd1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.229101:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213003 00010000:00010000:0.0:1651529467.229104:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c53926 lrc: 1/0,0 mode: --/PW res: [0x2bcd1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229106:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c53926 lrc: 0/0,0 mode: --/PW res: [0x2bcd1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229109:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c5392d lrc: 2/0,0 mode: PW/PW res: [0x2bcc9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229112:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e35b0bde already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.229113:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c5392d lrc: 2/0,0 mode: PW/PW res: [0x2bcc9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229116:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c5392d lrc: 3/0,0 mode: PW/PW res: [0x2bcc9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229121:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c5392d lrc: 1/0,0 mode: --/PW res: [0x2bcc9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.229121:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529467.229124:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c5392d lrc: 0/0,0 mode: --/PW res: [0x2bcc9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.229140:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.229153:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946614720 00000100:00100000:0.0:1651529467.229160:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946614784 00000100:00100000:0.0:1651529467.229164:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213004 00000100:00100000:0.0:1651529467.229166:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+18:39029:x1731745946614720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.229172:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179199 count 1 00000100:00100000:1.0:1651529467.229175:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213005 00000100:00100000:1.0:1651529467.229177:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+18:39030:x1731745946614784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00010000:0.0:1651529467.229177:0:80278:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.229179:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53934 lrc: 3/0,1 mode: --/PW res: [0x2bbff:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529467.229183:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179412 count 1 00010000:00010000:0.0:1651529467.229183:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.229183:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.229184:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53934 lrc: 3/0,1 mode: PW/PW res: [0x2bbff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.229188:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcd4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.229188:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53934 lrc: 3/0,1 mode: PW/PW res: [0x2bbff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229190:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c5393b lrc: 3/0,1 mode: --/PW res: [0x2bcd4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229191:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53934 lrc: 3/0,1 mode: PW/PW res: [0x2bbff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229193:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.229194:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.229194:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53934 lrc: 2/0,0 mode: PW/PW res: [0x2bbff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229195:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c5393b lrc: 3/0,1 mode: PW/PW res: [0x2bcd4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229199:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c5393b lrc: 3/0,1 mode: PW/PW res: [0x2bcd4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229202:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c5393b lrc: 3/0,1 mode: PW/PW res: [0x2bcd4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229204:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c5393b lrc: 2/0,0 mode: PW/PW res: [0x2bcd4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.229263:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:39030:x1731745946614784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 85us (123us total) trans 12885081009 rc 0/0 00000100:00100000:1.0:1651529467.229267:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213005 00000100:00100000:0.0:1651529467.229274:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+19:39029:x1731745946614720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 106us (152us total) trans 12885081008 rc 0/0 00000100:00100000:0.0:1651529467.229277:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213004 00010000:00010000:0.0:1651529467.229285:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53934 lrc: 2/0,0 mode: PW/PW res: [0x2bbff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229288:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f0b0fa2c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.229289:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53934 lrc: 2/0,0 mode: PW/PW res: [0x2bbff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229293:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53934 lrc: 3/0,0 mode: PW/PW res: [0x2bbff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229297:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53934 lrc: 1/0,0 mode: --/PW res: [0x2bbff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229300:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53934 lrc: 0/0,0 mode: --/PW res: [0x2bbff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229304:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c5393b lrc: 2/0,0 mode: PW/PW res: [0x2bcd4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229307:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d2b9655c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.229308:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c5393b lrc: 2/0,0 mode: PW/PW res: [0x2bcd4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229310:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c5393b lrc: 3/0,0 mode: PW/PW res: [0x2bcd4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229314:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c5393b lrc: 1/0,0 mode: --/PW res: [0x2bcd4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229316:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c5393b lrc: 0/0,0 mode: --/PW res: [0x2bcd4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.229330:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.229339:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.229346:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.229376:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946614848 00000100:00100000:0.0:1651529467.229385:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946614912 00000100:00100000:0.0:1651529467.229389:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946615232 00000100:00100000:0.0:1651529467.229394:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213006 00000100:00100000:1.0:1651529467.229396:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.229396:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:39029:x1731745946614848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.229407:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179349 count 1 00000100:00100000:1.0:1651529467.229408:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946615552 00002000:00010000:0.0:1651529467.229413:0:72395:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc95:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.229415:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c53942 lrc: 3/0,1 mode: --/PW res: [0x2bc95:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.229416:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213007 00000100:00100000:1.0:1651529467.229418:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:39030:x1731745946614912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529467.229418:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.229419:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.229420:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c53942 lrc: 3/0,1 mode: PW/PW res: [0x2bc95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529467.229423:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179351 count 1 00010000:00010000:0.0:1651529467.229424:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c53942 lrc: 3/0,1 mode: PW/PW res: [0x2bc95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229426:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c53942 lrc: 3/0,1 mode: PW/PW res: [0x2bc95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.229429:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc97:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.229429:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c53942 lrc: 2/0,0 mode: PW/PW res: [0x2bc95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229431:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c53949 lrc: 3/0,1 mode: --/PW res: [0x2bc97:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229441:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.229442:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.229443:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c53949 lrc: 3/0,1 mode: PW/PW res: [0x2bc97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229447:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c53949 lrc: 3/0,1 mode: PW/PW res: [0x2bc97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229450:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c53949 lrc: 3/0,1 mode: PW/PW res: [0x2bc97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229453:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c53949 lrc: 2/0,0 mode: PW/PW res: [0x2bc97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.229482:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+24:39029:x1731745946614848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 85us (151us total) trans 12885081010 rc 0/0 00000100:00100000:0.0:1651529467.229485:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213006 00000100:00100000:0.0:1651529467.229490:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213008 00000100:00100000:1.0:1651529467.229498:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:39030:x1731745946614912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 79us (159us total) trans 12885081011 rc 0/0 00000100:00100000:0.0:1651529467.229525:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:39030:x1731745946615232:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529467.229527:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213007 00002000:00080000:0.0:1651529467.229531:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179221 count 1 00000100:00100000:1.0:1651529467.229532:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213009 00000100:00100000:1.0:1651529467.229534:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:39030:x1731745946615552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00010000:0.0:1651529467.229537:0:72395:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.229538:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c53950 lrc: 3/0,1 mode: --/PW res: [0x2bc15:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529467.229539:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179389 count 1 00010000:00010000:0.0:1651529467.229542:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.229543:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.229544:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c53950 lrc: 3/0,1 mode: PW/PW res: [0x2bc15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.229545:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcbd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.229546:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c53957 lrc: 3/0,1 mode: --/PW res: [0x2bcbd:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229547:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c53950 lrc: 3/0,1 mode: PW/PW res: [0x2bc15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229550:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c53950 lrc: 3/0,1 mode: PW/PW res: [0x2bc15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229552:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.229553:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.229553:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c53950 lrc: 2/0,0 mode: PW/PW res: [0x2bc15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229554:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c53957 lrc: 3/0,1 mode: PW/PW res: [0x2bcbd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229557:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c53957 lrc: 3/0,1 mode: PW/PW res: [0x2bcbd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229560:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c53957 lrc: 3/0,1 mode: PW/PW res: [0x2bcbd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229563:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c53957 lrc: 2/0,0 mode: PW/PW res: [0x2bcbd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.229589:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+24:39030:x1731745946615232:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 64us (243us total) trans 12885081012 rc 0/0 00000100:00100000:0.0:1651529467.229593:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213008 00000100:00100000:1.0:1651529467.229600:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:39030:x1731745946615552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 65us (204us total) trans 12885081013 rc 0/0 00010000:00010000:0.0:1651529467.229601:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c53942 lrc: 2/0,0 mode: PW/PW res: [0x2bc95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.229603:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213009 00010000:00010000:0.0:1651529467.229604:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024627ba8 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.229605:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c53942 lrc: 2/0,0 mode: PW/PW res: [0x2bc95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229609:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c53942 lrc: 3/0,0 mode: PW/PW res: [0x2bc95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229612:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c53949 lrc: 2/0,0 mode: PW/PW res: [0x2bc97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229613:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c53942 lrc: 1/0,0 mode: --/PW res: [0x2bc95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229616:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b65e0a0d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.229616:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c53942 lrc: 0/0,0 mode: --/PW res: [0x2bc95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229617:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c53949 lrc: 2/0,0 mode: PW/PW res: [0x2bc97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229620:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c53949 lrc: 3/0,0 mode: PW/PW res: [0x2bc97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229620:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c53950 lrc: 2/0,0 mode: PW/PW res: [0x2bc15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229623:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032c39b88 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.229624:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c53950 lrc: 2/0,0 mode: PW/PW res: [0x2bc15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229626:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c53950 lrc: 3/0,0 mode: PW/PW res: [0x2bc15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229627:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c53949 lrc: 1/0,0 mode: --/PW res: [0x2bc97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229630:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c53949 lrc: 0/0,0 mode: --/PW res: [0x2bc97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229630:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c53950 lrc: 1/0,0 mode: --/PW res: [0x2bc15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229632:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c53950 lrc: 0/0,0 mode: --/PW res: [0x2bc15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229634:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c53957 lrc: 2/0,0 mode: PW/PW res: [0x2bcbd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229636:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d52cc749 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.229637:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c53957 lrc: 2/0,0 mode: PW/PW res: [0x2bcbd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229640:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c53957 lrc: 3/0,0 mode: PW/PW res: [0x2bcbd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229643:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c53957 lrc: 1/0,0 mode: --/PW res: [0x2bcbd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229646:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c53957 lrc: 0/0,0 mode: --/PW res: [0x2bcbd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.229649:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.229656:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946615680 00000100:00100000:0.0:1651529467.229669:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213010 00000100:00100000:0.0:1651529467.229671:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a8819a3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+23:39030:x1731745946615680:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.229676:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179204 count 1 00002000:00010000:0.0:1651529467.229682:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc04:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.229683:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c5395e lrc: 3/0,1 mode: --/PW res: [0x2bc04:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229687:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.229688:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.229688:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c5395e lrc: 3/0,1 mode: PW/PW res: [0x2bc04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229692:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c5395e lrc: 3/0,1 mode: PW/PW res: [0x2bc04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229695:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c5395e lrc: 3/0,1 mode: PW/PW res: [0x2bc04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229698:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c5395e lrc: 2/0,0 mode: PW/PW res: [0x2bc04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.229741:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a8819a3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+24:39030:x1731745946615680:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 69us (91us total) trans 12885081014 rc 0/0 00000100:00100000:0.0:1651529467.229756:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213010 00010000:00010000:0.0:1651529467.229785:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c5395e lrc: 2/0,0 mode: PW/PW res: [0x2bc04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229789:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6fcae44 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.229790:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c5395e lrc: 2/0,0 mode: PW/PW res: [0x2bc04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229793:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c5395e lrc: 3/0,0 mode: PW/PW res: [0x2bc04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229807:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c5395e lrc: 1/0,0 mode: --/PW res: [0x2bc04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229810:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c5395e lrc: 0/0,0 mode: --/PW res: [0x2bc04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.229826:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.229833:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.229840:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.229849:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946615616 00000100:00100000:1.0:1651529467.229850:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946615744 00000100:00100000:0.0:1651529467.229855:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946615808 00000100:00100000:1.0:1651529467.229865:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213011 00000100:00100000:1.0:1651529467.229866:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+26:39029:x1731745946615616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529467.229867:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213012 00000100:00100000:0.0:1651529467.229868:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+26:39029:x1731745946615744:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.229872:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179405 count 1 00002000:00080000:0.0:1651529467.229874:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179360 count 1 00002000:00010000:1.0:1651529467.229878:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bccd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.229880:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c53965 lrc: 3/0,1 mode: --/PW res: [0x2bccd:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229884:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.229884:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.229885:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c53965 lrc: 3/0,1 mode: PW/PW res: [0x2bccd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229889:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c53965 lrc: 3/0,1 mode: PW/PW res: [0x2bccd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229892:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c53965 lrc: 3/0,1 mode: PW/PW res: [0x2bccd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.229900:0:80281:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bca0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.229901:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c53965 lrc: 2/0,0 mode: PW/PW res: [0x2bccd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229902:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c5396c lrc: 3/0,1 mode: --/PW res: [0x2bca0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229906:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.229906:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.229913:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c5396c lrc: 3/0,1 mode: PW/PW res: [0x2bca0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229920:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c5396c lrc: 3/0,1 mode: PW/PW res: [0x2bca0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229923:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c5396c lrc: 3/0,1 mode: PW/PW res: [0x2bca0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229936:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c5396c lrc: 2/0,0 mode: PW/PW res: [0x2bca0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.229956:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+27:39029:x1731745946615616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 88us (129us total) trans 12885081015 rc 0/0 00000100:00100000:1.0:1651529467.229959:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213011 00000100:00100000:1.0:1651529467.229964:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213013 00000100:00100000:1.0:1651529467.229966:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+27:39030:x1731745946615808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.229970:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179215 count 1 00002000:00010000:1.0:1651529467.229976:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc0f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.229977:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c53973 lrc: 3/0,1 mode: --/PW res: [0x2bc0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229983:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.229984:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.229985:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c53973 lrc: 3/0,1 mode: PW/PW res: [0x2bc0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.229986:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+27:39029:x1731745946615744:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 116us (152us total) trans 12885081016 rc 0/0 00010000:00010000:1.0:1651529467.229988:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c53973 lrc: 3/0,1 mode: PW/PW res: [0x2bc0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.229989:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213012 00010000:00010000:1.0:1651529467.229991:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c53973 lrc: 3/0,1 mode: PW/PW res: [0x2bc0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.229994:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c53973 lrc: 2/0,0 mode: PW/PW res: [0x2bc0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.229997:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c53965 lrc: 2/0,0 mode: PW/PW res: [0x2bccd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230007:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001b109cb1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.230008:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c53965 lrc: 2/0,0 mode: PW/PW res: [0x2bccd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230011:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c53965 lrc: 3/0,0 mode: PW/PW res: [0x2bccd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230016:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c53965 lrc: 1/0,0 mode: --/PW res: [0x2bccd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230019:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c53965 lrc: 0/0,0 mode: --/PW res: [0x2bccd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230023:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c5396c lrc: 2/0,0 mode: PW/PW res: [0x2bca0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230026:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1791842 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.230027:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c5396c lrc: 2/0,0 mode: PW/PW res: [0x2bca0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230030:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c5396c lrc: 3/0,0 mode: PW/PW res: [0x2bca0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230033:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c5396c lrc: 1/0,0 mode: --/PW res: [0x2bca0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.230035:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+27:39030:x1731745946615808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 69us (195us total) trans 12885081017 rc 0/0 00010000:00010000:0.0:1651529467.230035:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c5396c lrc: 0/0,0 mode: --/PW res: [0x2bca0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.230038:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213013 00010000:00010000:0.0:1651529467.230038:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c53973 lrc: 2/0,0 mode: PW/PW res: [0x2bc0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230041:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002e24dea3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.230042:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c53973 lrc: 2/0,0 mode: PW/PW res: [0x2bc0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230044:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c53973 lrc: 3/0,0 mode: PW/PW res: [0x2bc0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230047:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c53973 lrc: 1/0,0 mode: --/PW res: [0x2bc0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230050:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c53973 lrc: 0/0,0 mode: --/PW res: [0x2bc0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.230092:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.230099:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946616192 00000100:00100000:0.0:1651529467.230117:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213014 00000100:00100000:0.0:1651529467.230119:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+27:39030:x1731745946616192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.230125:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179280 count 1 00000100:00100000:1.0:1651529467.230127:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00010000:0.0:1651529467.230131:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc50:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.230132:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c5397a lrc: 3/0,1 mode: --/PW res: [0x2bc50:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.230134:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529467.230136:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.230137:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529467.230143:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529467.230144:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c5397a lrc: 3/0,1 mode: PW/PW res: [0x2bc50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230148:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c5397a lrc: 3/0,1 mode: PW/PW res: [0x2bc50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.230151:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529467.230151:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c5397a lrc: 3/0,1 mode: PW/PW res: [0x2bc50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230154:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c5397a lrc: 2/0,0 mode: PW/PW res: [0x2bc50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.230157:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946616128 00000100:00100000:1.0:1651529467.230165:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946616320 00000100:00100000:1.0:1651529467.230170:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946616256 00000100:00100000:1.0:1651529467.230175:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946616384 00000100:00100000:1.0:1651529467.230181:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213015 00000100:00100000:1.0:1651529467.230183:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:39029:x1731745946616128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.230188:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179233 count 1 00002000:00010000:1.0:1651529467.230201:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.230202:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53981 lrc: 3/0,1 mode: --/PW res: [0x2bc21:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230206:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.230207:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.230208:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53981 lrc: 3/0,1 mode: PW/PW res: [0x2bc21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230212:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53981 lrc: 3/0,1 mode: PW/PW res: [0x2bc21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230215:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53981 lrc: 3/0,1 mode: PW/PW res: [0x2bc21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230217:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53981 lrc: 2/0,0 mode: PW/PW res: [0x2bc21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.230248:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+32:39030:x1731745946616192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 128us (156us total) trans 12885081018 rc 0/0 00000100:00100000:0.0:1651529467.230253:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213014 00000100:00100000:0.0:1651529467.230259:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213016 00000100:00100000:0.0:1651529467.230261:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+32:39030:x1731745946616320:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.230265:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179341 count 1 00002000:00010000:0.0:1651529467.230271:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc8d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.230272:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fb1a013/0x3234de053c53988 lrc: 3/0,1 mode: --/PW res: [0x2bc8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.230274:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:39029:x1731745946616128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 90us (147us total) trans 12885081019 rc 0/0 00010000:00010000:0.0:1651529467.230276:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529467.230277:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213015 00000100:00100000:1.0:1651529467.230283:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213017 00000100:00100000:1.0:1651529467.230285:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:39029:x1731745946616256:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.230289:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179300 count 1 00002000:00010000:1.0:1651529467.230302:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc64:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.230304:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c5398f lrc: 3/0,1 mode: --/PW res: [0x2bc64:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230304:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.230306:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fb1a013/0x3234de053c53988 lrc: 3/0,1 mode: PW/PW res: [0x2bc8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230308:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.230310:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fb1a013/0x3234de053c53988 lrc: 3/0,1 mode: PW/PW res: [0x2bc8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230313:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fb1a013/0x3234de053c53988 lrc: 3/0,1 mode: PW/PW res: [0x2bc8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230315:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.230316:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c5398f lrc: 3/0,1 mode: PW/PW res: [0x2bc64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230316:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fb1a013/0x3234de053c53988 lrc: 2/0,0 mode: PW/PW res: [0x2bc8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230321:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c5398f lrc: 3/0,1 mode: PW/PW res: [0x2bc64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230324:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c5398f lrc: 3/0,1 mode: PW/PW res: [0x2bc64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230327:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c5398f lrc: 2/0,0 mode: PW/PW res: [0x2bc64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.230356:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+32:39030:x1731745946616320:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 94us (222us total) trans 12885081020 rc 0/0 00000100:00100000:0.0:1651529467.230359:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213016 00000100:00100000:0.0:1651529467.230363:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213018 00000100:00100000:0.0:1651529467.230365:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+32:39029:x1731745946616384:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.230370:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179375 count 1 00002000:00010000:0.0:1651529467.230375:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcaf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.230376:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f71e4f3/0x3234de053c53996 lrc: 3/0,1 mode: --/PW res: [0x2bcaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.230379:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:39029:x1731745946616256:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 94us (236us total) trans 12885081021 rc 0/0 00010000:00010000:0.0:1651529467.230380:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.230381:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.230381:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f71e4f3/0x3234de053c53996 lrc: 3/0,1 mode: PW/PW res: [0x2bcaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.230382:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213017 00010000:00010000:0.0:1651529467.230385:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f71e4f3/0x3234de053c53996 lrc: 3/0,1 mode: PW/PW res: [0x2bcaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230388:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f71e4f3/0x3234de053c53996 lrc: 3/0,1 mode: PW/PW res: [0x2bcaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230390:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c5397a lrc: 2/0,0 mode: PW/PW res: [0x2bc50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230390:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f71e4f3/0x3234de053c53996 lrc: 2/0,0 mode: PW/PW res: [0x2bcaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230394:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000050f78364 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.230395:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c5397a lrc: 2/0,0 mode: PW/PW res: [0x2bc50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230398:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c5397a lrc: 3/0,0 mode: PW/PW res: [0x2bc50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230405:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c5397a lrc: 1/0,0 mode: --/PW res: [0x2bc50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230408:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c5397a lrc: 0/0,0 mode: --/PW res: [0x2bc50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230413:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53981 lrc: 2/0,0 mode: PW/PW res: [0x2bc21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230415:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000041a7efd7 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.230416:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53981 lrc: 2/0,0 mode: PW/PW res: [0x2bc21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230419:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53981 lrc: 3/0,0 mode: PW/PW res: [0x2bc21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230422:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53981 lrc: 1/0,0 mode: --/PW res: [0x2bc21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.230423:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+32:39029:x1731745946616384:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 57us (271us total) trans 12885081022 rc 0/0 00010000:00010000:1.0:1651529467.230425:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53981 lrc: 0/0,0 mode: --/PW res: [0x2bc21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.230426:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213018 00010000:00010000:1.0:1651529467.230428:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fb1a013/0x3234de053c53988 lrc: 2/0,0 mode: PW/PW res: [0x2bc8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230430:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fb1a013 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.230431:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fb1a013/0x3234de053c53988 lrc: 2/0,0 mode: PW/PW res: [0x2bc8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230434:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fb1a013/0x3234de053c53988 lrc: 3/0,0 mode: PW/PW res: [0x2bc8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230437:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fb1a013/0x3234de053c53988 lrc: 1/0,0 mode: --/PW res: [0x2bc8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230438:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c5398f lrc: 2/0,0 mode: PW/PW res: [0x2bc64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230440:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fb1a013/0x3234de053c53988 lrc: 0/0,0 mode: --/PW res: [0x2bc8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230441:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002731c8d2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.230442:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c5398f lrc: 2/0,0 mode: PW/PW res: [0x2bc64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230443:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f71e4f3/0x3234de053c53996 lrc: 2/0,0 mode: PW/PW res: [0x2bcaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230446:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002f71e4f3 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.230446:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f71e4f3/0x3234de053c53996 lrc: 2/0,0 mode: PW/PW res: [0x2bcaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230448:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c5398f lrc: 3/0,0 mode: PW/PW res: [0x2bc64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230449:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f71e4f3/0x3234de053c53996 lrc: 3/0,0 mode: PW/PW res: [0x2bcaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230452:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f71e4f3/0x3234de053c53996 lrc: 1/0,0 mode: --/PW res: [0x2bcaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230453:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c5398f lrc: 1/0,0 mode: --/PW res: [0x2bc64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230455:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f71e4f3/0x3234de053c53996 lrc: 0/0,0 mode: --/PW res: [0x2bcaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230456:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c5398f lrc: 0/0,0 mode: --/PW res: [0x2bc64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.230474:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.230480:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946616704 00000100:00100000:1.0:1651529467.230486:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213019 00000100:00100000:1.0:1651529467.230488:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:39030:x1731745946616704:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.230525:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179395 count 1 00002000:00010000:1.0:1651529467.230531:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcc3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.230533:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c5399d lrc: 3/0,1 mode: --/PW res: [0x2bcc3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230537:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.230538:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.230539:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c5399d lrc: 3/0,1 mode: PW/PW res: [0x2bcc3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230542:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c5399d lrc: 3/0,1 mode: PW/PW res: [0x2bcc3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230545:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c5399d lrc: 3/0,1 mode: PW/PW res: [0x2bcc3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230548:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c5399d lrc: 2/0,0 mode: PW/PW res: [0x2bcc3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.230594:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+33:39030:x1731745946616704:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 105us (119us total) trans 12885081023 rc 0/0 00000100:00100000:1.0:1651529467.230597:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213019 00010000:00010000:1.0:1651529467.230604:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c5399d lrc: 2/0,0 mode: PW/PW res: [0x2bcc3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230610:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000093b5c984 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.230611:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c5399d lrc: 2/0,0 mode: PW/PW res: [0x2bcc3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230622:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c5399d lrc: 3/0,0 mode: PW/PW res: [0x2bcc3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230627:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c5399d lrc: 1/0,0 mode: --/PW res: [0x2bcc3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230630:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c5399d lrc: 0/0,0 mode: --/PW res: [0x2bcc3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.230649:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.230658:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.230671:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946616768 00000100:00100000:0.0:1651529467.230676:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946616832 00000100:00100000:1.0:1651529467.230680:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213020 00000100:00100000:1.0:1651529467.230682:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+33:39029:x1731745946616768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.230687:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179281 count 1 00000100:00100000:0.0:1651529467.230690:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213021 00002000:00010000:1.0:1651529467.230692:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc51:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1651529467.230692:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+34:39030:x1731745946616832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529467.230694:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c539a4 lrc: 3/0,1 mode: --/PW res: [0x2bc51:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230697:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:0.0:1651529467.230697:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179371 count 1 00010000:00010000:1.0:1651529467.230698:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.230699:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c539a4 lrc: 3/0,1 mode: PW/PW res: [0x2bc51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230703:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c539a4 lrc: 3/0,1 mode: PW/PW res: [0x2bc51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.230703:0:80281:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.230706:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c539a4 lrc: 3/0,1 mode: PW/PW res: [0x2bc51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230708:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c539a4 lrc: 2/0,0 mode: PW/PW res: [0x2bc51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230728:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c539ab lrc: 3/0,1 mode: --/PW res: [0x2bcab:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230732:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.230733:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.230734:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c539ab lrc: 3/0,1 mode: PW/PW res: [0x2bcab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230738:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c539ab lrc: 3/0,1 mode: PW/PW res: [0x2bcab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230741:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c539ab lrc: 3/0,1 mode: PW/PW res: [0x2bcab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230746:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c539ab lrc: 2/0,0 mode: PW/PW res: [0x2bcab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.230750:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+35:39029:x1731745946616768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 67us (100us total) trans 12885081024 rc 0/0 00000100:00100000:1.0:1651529467.230753:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213020 00000100:00100000:1.0:1651529467.230767:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.230810:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+35:39030:x1731745946616832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 117us (152us total) trans 12885081025 rc 0/0 00000100:00100000:0.0:1651529467.230813:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213021 00000100:00100000:0.0:1651529467.230819:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946617152 00000100:00100000:0.0:1651529467.230825:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213022 00000100:00100000:1.0:1651529467.230826:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.230827:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+35:39029:x1731745946617152:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.230837:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179321 count 1 00002000:00010000:0.0:1651529467.230843:0:80281:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc79:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.230845:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c539b2 lrc: 3/0,1 mode: --/PW res: [0x2bc79:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230849:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.230849:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.230850:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c539b2 lrc: 3/0,1 mode: PW/PW res: [0x2bc79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230854:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c539b2 lrc: 3/0,1 mode: PW/PW res: [0x2bc79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.230857:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529467.230857:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c539b2 lrc: 3/0,1 mode: PW/PW res: [0x2bc79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230859:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c539b2 lrc: 2/0,0 mode: PW/PW res: [0x2bc79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.230867:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.230880:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.230890:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946617280 00000100:00100000:1.0:1651529467.230899:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946617408 00000100:00100000:1.0:1651529467.230903:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946617216 00000100:00100000:1.0:1651529467.230905:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946617344 00000100:00100000:1.0:1651529467.230913:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213023 00000100:00100000:1.0:1651529467.230915:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+39:39029:x1731745946617280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.230920:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179219 count 1 00002000:00010000:1.0:1651529467.230926:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.230928:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c539b9 lrc: 3/0,1 mode: --/PW res: [0x2bc13:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230932:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.230932:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.230933:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c539b9 lrc: 3/0,1 mode: PW/PW res: [0x2bc13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230936:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c539b9 lrc: 3/0,1 mode: PW/PW res: [0x2bc13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.230939:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c539b9 lrc: 3/0,1 mode: PW/PW res: [0x2bc13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.230940:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:39029:x1731745946617152:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 112us (172us total) trans 12885081026 rc 0/0 00010000:00010000:1.0:1651529467.230942:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c539b9 lrc: 2/0,0 mode: PW/PW res: [0x2bc13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.230943:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213022 00000100:00100000:0.0:1651529467.230948:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213024 00000100:00100000:0.0:1651529467.230950:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:39029:x1731745946617408:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.230954:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179267 count 1 00002000:00010000:0.0:1651529467.230959:0:80281:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc43:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.230961:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c539c0 lrc: 3/0,1 mode: --/PW res: [0x2bc43:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230965:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.230965:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.230966:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c539c0 lrc: 3/0,1 mode: PW/PW res: [0x2bc43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230970:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c539c0 lrc: 3/0,1 mode: PW/PW res: [0x2bc43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230973:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c539c0 lrc: 3/0,1 mode: PW/PW res: [0x2bc43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.230975:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c539c0 lrc: 2/0,0 mode: PW/PW res: [0x2bc43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.230980:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+40:39029:x1731745946617280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 64us (162us total) trans 12885081027 rc 0/0 00000100:00100000:1.0:1651529467.230983:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213023 00000100:00100000:1.0:1651529467.230988:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213025 00000100:00100000:1.0:1651529467.230990:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+39:39029:x1731745946617216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.230994:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179421 count 1 00002000:00010000:1.0:1651529467.230999:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcdd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.231000:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000928e420a/0x3234de053c539c7 lrc: 3/0,1 mode: --/PW res: [0x2bcdd:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231004:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.231004:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.231005:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000928e420a/0x3234de053c539c7 lrc: 3/0,1 mode: PW/PW res: [0x2bcdd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231020:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000928e420a/0x3234de053c539c7 lrc: 3/0,1 mode: PW/PW res: [0x2bcdd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231023:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000928e420a/0x3234de053c539c7 lrc: 3/0,1 mode: PW/PW res: [0x2bcdd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231026:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000928e420a/0x3234de053c539c7 lrc: 2/0,0 mode: PW/PW res: [0x2bcdd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.231051:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+41:39029:x1731745946617408:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 100us (193us total) trans 12885081028 rc 0/0 00000100:00100000:0.0:1651529467.231056:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213024 00000100:00100000:1.0:1651529467.231061:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+40:39029:x1731745946617216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 70us (194us total) trans 12885081029 rc 0/0 00000100:00100000:0.0:1651529467.231061:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213026 00000100:00100000:0.0:1651529467.231063:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:39029:x1731745946617344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529467.231064:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213025 00002000:00080000:0.0:1651529467.231067:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179230 count 1 00010000:00010000:1.0:1651529467.231071:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c539a4 lrc: 2/0,0 mode: PW/PW res: [0x2bc51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.231072:0:80281:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.231074:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c8f63a78 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.231074:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c539ce lrc: 3/0,1 mode: --/PW res: [0x2bc1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231075:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c539a4 lrc: 2/0,0 mode: PW/PW res: [0x2bc51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231077:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.231078:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c539a4 lrc: 3/0,0 mode: PW/PW res: [0x2bc51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231078:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.231079:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c539ce lrc: 3/0,1 mode: PW/PW res: [0x2bc1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231082:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c539ce lrc: 3/0,1 mode: PW/PW res: [0x2bc1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231083:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c539a4 lrc: 1/0,0 mode: --/PW res: [0x2bc51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231085:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c539a4 lrc: 0/0,0 mode: --/PW res: [0x2bc51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231085:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c539ce lrc: 3/0,1 mode: PW/PW res: [0x2bc1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231088:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c539ce lrc: 2/0,0 mode: PW/PW res: [0x2bc1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231090:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c539ab lrc: 2/0,0 mode: PW/PW res: [0x2bcab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231093:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001644aaad already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.231093:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c539ab lrc: 2/0,0 mode: PW/PW res: [0x2bcab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231096:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c539ab lrc: 3/0,0 mode: PW/PW res: [0x2bcab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231099:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c539ab lrc: 1/0,0 mode: --/PW res: [0x2bcab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231102:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c539ab lrc: 0/0,0 mode: --/PW res: [0x2bcab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231105:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c539b2 lrc: 2/0,0 mode: PW/PW res: [0x2bc79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231108:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000087f212ed already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.231109:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c539b2 lrc: 2/0,0 mode: PW/PW res: [0x2bc79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231111:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c539b2 lrc: 3/0,0 mode: PW/PW res: [0x2bc79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231114:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c539b2 lrc: 1/0,0 mode: --/PW res: [0x2bc79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231117:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c539b2 lrc: 0/0,0 mode: --/PW res: [0x2bc79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231120:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c539b9 lrc: 2/0,0 mode: PW/PW res: [0x2bc13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.231121:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:39029:x1731745946617344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 57us (240us total) trans 12885081030 rc 0/0 00010000:00010000:1.0:1651529467.231123:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007f539dcd already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.231124:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c539b9 lrc: 2/0,0 mode: PW/PW res: [0x2bc13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.231124:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213026 00010000:00010000:1.0:1651529467.231126:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c539b9 lrc: 3/0,0 mode: PW/PW res: [0x2bc13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231129:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c539b9 lrc: 1/0,0 mode: --/PW res: [0x2bc13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231132:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c539b9 lrc: 0/0,0 mode: --/PW res: [0x2bc13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231135:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c539c0 lrc: 2/0,0 mode: PW/PW res: [0x2bc43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231137:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f10dea8 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.231137:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000928e420a/0x3234de053c539c7 lrc: 2/0,0 mode: PW/PW res: [0x2bcdd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231138:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c539c0 lrc: 2/0,0 mode: PW/PW res: [0x2bc43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231143:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c539c0 lrc: 3/0,0 mode: PW/PW res: [0x2bc43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231143:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000928e420a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.231144:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000928e420a/0x3234de053c539c7 lrc: 2/0,0 mode: PW/PW res: [0x2bcdd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231146:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c539c0 lrc: 1/0,0 mode: --/PW res: [0x2bc43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231147:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000928e420a/0x3234de053c539c7 lrc: 3/0,0 mode: PW/PW res: [0x2bcdd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231149:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c539c0 lrc: 0/0,0 mode: --/PW res: [0x2bc43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231151:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000928e420a/0x3234de053c539c7 lrc: 1/0,0 mode: --/PW res: [0x2bcdd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231152:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c539ce lrc: 2/0,0 mode: PW/PW res: [0x2bc1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231154:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000928e420a/0x3234de053c539c7 lrc: 0/0,0 mode: --/PW res: [0x2bcdd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231155:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005532ef34 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.231155:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c539ce lrc: 2/0,0 mode: PW/PW res: [0x2bc1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231158:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c539ce lrc: 3/0,0 mode: PW/PW res: [0x2bc1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231161:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c539ce lrc: 1/0,0 mode: --/PW res: [0x2bc1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231164:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c539ce lrc: 0/0,0 mode: --/PW res: [0x2bc1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.231170:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.231180:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946617728 00000100:00100000:0.0:1651529467.231194:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213027 00000100:00100000:0.0:1651529467.231195:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:39030:x1731745946617728:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.231201:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179266 count 1 00002000:00010000:0.0:1651529467.231206:0:72395:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.231208:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c539d5 lrc: 3/0,1 mode: --/PW res: [0x2bc42:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231211:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.231212:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.231213:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c539d5 lrc: 3/0,1 mode: PW/PW res: [0x2bc42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231219:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c539d5 lrc: 3/0,1 mode: PW/PW res: [0x2bc42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231242:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c539d5 lrc: 3/0,1 mode: PW/PW res: [0x2bc42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231245:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c539d5 lrc: 2/0,0 mode: PW/PW res: [0x2bc42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.231308:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+41:39030:x1731745946617728:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 111us (137us total) trans 12885081031 rc 0/0 00000100:00100000:0.0:1651529467.231311:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213027 00010000:00010000:0.0:1651529467.231320:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c539d5 lrc: 2/0,0 mode: PW/PW res: [0x2bc42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231323:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000029e40f3d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.231324:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c539d5 lrc: 2/0,0 mode: PW/PW res: [0x2bc42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231327:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c539d5 lrc: 3/0,0 mode: PW/PW res: [0x2bc42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231331:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c539d5 lrc: 1/0,0 mode: --/PW res: [0x2bc42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231335:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c539d5 lrc: 0/0,0 mode: --/PW res: [0x2bc42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.231345:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.231370:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.231377:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.231394:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946617856 00000100:00100000:1.0:1651529467.231401:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946617920 00000100:00100000:1.0:1651529467.231413:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946618176 00000100:00100000:0.0:1651529467.231416:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.231426:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946618240 00000100:00100000:1.0:1651529467.231433:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213028 00000100:00100000:1.0:1651529467.231434:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+44:39030:x1731745946617856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529467.231435:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529467.231440:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179356 count 1 00000100:00100000:0.0:1651529467.231442:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00010000:1.0:1651529467.231445:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc9c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.231447:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e600099f/0x3234de053c539dc lrc: 3/0,1 mode: --/PW res: [0x2bc9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.231449:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529467.231451:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.231451:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.231458:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e600099f/0x3234de053c539dc lrc: 3/0,1 mode: PW/PW res: [0x2bc9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.231460:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946618304 00010000:00010000:1.0:1651529467.231463:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e600099f/0x3234de053c539dc lrc: 3/0,1 mode: PW/PW res: [0x2bc9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.231465:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946618368 00010000:00010000:1.0:1651529467.231466:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e600099f/0x3234de053c539dc lrc: 3/0,1 mode: PW/PW res: [0x2bc9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231468:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e600099f/0x3234de053c539dc lrc: 2/0,0 mode: PW/PW res: [0x2bc9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.231468:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946618432 00000100:00100000:0.0:1651529467.231471:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213029 00000100:00100000:0.0:1651529467.231473:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+47:39029:x1731745946617920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.231484:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179338 count 1 00002000:00010000:0.0:1651529467.231490:0:106695:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc8a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.231491:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c539e3 lrc: 3/0,1 mode: --/PW res: [0x2bc8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231495:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.231496:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.231497:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c539e3 lrc: 3/0,1 mode: PW/PW res: [0x2bc8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231501:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c539e3 lrc: 3/0,1 mode: PW/PW res: [0x2bc8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231504:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c539e3 lrc: 3/0,1 mode: PW/PW res: [0x2bc8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231509:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c539e3 lrc: 2/0,0 mode: PW/PW res: [0x2bc8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.231512:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+48:39030:x1731745946617856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 76us (166us total) trans 12885081032 rc 0/0 00000100:00100000:1.0:1651529467.231515:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213028 00000100:00100000:1.0:1651529467.231527:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213030 00000100:00100000:1.0:1651529467.231529:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+47:39029:x1731745946618176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.231535:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179232 count 1 00002000:00010000:1.0:1651529467.231540:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.231541:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bb34145/0x3234de053c539ea lrc: 3/0,1 mode: --/PW res: [0x2bc20:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231545:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.231545:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.231546:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002bb34145/0x3234de053c539ea lrc: 3/0,1 mode: PW/PW res: [0x2bc20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231550:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002bb34145/0x3234de053c539ea lrc: 3/0,1 mode: PW/PW res: [0x2bc20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231553:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bb34145/0x3234de053c539ea lrc: 3/0,1 mode: PW/PW res: [0x2bc20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231555:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002bb34145/0x3234de053c539ea lrc: 2/0,0 mode: PW/PW res: [0x2bc20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.231573:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+48:39029:x1731745946617920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 99us (203us total) trans 12885081033 rc 0/0 00000100:00100000:0.0:1651529467.231576:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213029 00000100:00100000:0.0:1651529467.231582:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213031 00000100:00100000:0.0:1651529467.231583:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007f9b0c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+48:39030:x1731745946618240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.231588:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179307 count 1 00002000:00010000:0.0:1651529467.231593:0:106695:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc6b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529467.231595:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+48:39029:x1731745946618176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 66us (218us total) trans 12885081034 rc 0/0 00010000:00010000:0.0:1651529467.231595:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c539f1 lrc: 3/0,1 mode: --/PW res: [0x2bc6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.231598:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213030 00010000:00010000:0.0:1651529467.231599:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.231599:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.231600:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c539f1 lrc: 3/0,1 mode: PW/PW res: [0x2bc6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.231604:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213032 00010000:00010000:0.0:1651529467.231604:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c539f1 lrc: 3/0,1 mode: PW/PW res: [0x2bc6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.231605:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000056e45ef2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+47:39029:x1731745946618304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529467.231607:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c539f1 lrc: 3/0,1 mode: PW/PW res: [0x2bc6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529467.231609:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179284 count 1 00010000:00010000:0.0:1651529467.231609:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c539f1 lrc: 2/0,0 mode: PW/PW res: [0x2bc6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.231614:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc54:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.231615:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a091a01a/0x3234de053c539f8 lrc: 3/0,1 mode: --/PW res: [0x2bc54:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231619:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.231619:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.231620:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a091a01a/0x3234de053c539f8 lrc: 3/0,1 mode: PW/PW res: [0x2bc54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231624:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a091a01a/0x3234de053c539f8 lrc: 3/0,1 mode: PW/PW res: [0x2bc54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231627:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a091a01a/0x3234de053c539f8 lrc: 3/0,1 mode: PW/PW res: [0x2bc54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231629:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a091a01a/0x3234de053c539f8 lrc: 2/0,0 mode: PW/PW res: [0x2bc54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.231647:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007f9b0c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+49:39030:x1731745946618240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 63us (231us total) trans 12885081035 rc 0/0 00000100:00100000:0.0:1651529467.231650:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213031 00000100:00100000:0.0:1651529467.231655:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213033 00000100:00100000:0.0:1651529467.231657:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9b0314b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+48:39030:x1731745946618368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.231661:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179317 count 1 00000100:00100000:1.0:1651529467.231662:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000056e45ef2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+48:39029:x1731745946618304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 56us (227us total) trans 12885081036 rc 0/0 00000100:00100000:1.0:1651529467.231665:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213032 00002000:00010000:0.0:1651529467.231666:0:106695:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc75:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.231667:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c539ff lrc: 3/0,1 mode: --/PW res: [0x2bc75:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.231670:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213034 00010000:00010000:0.0:1651529467.231671:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.231671:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529467.231672:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5ebc6ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+47:39029:x1731745946618432:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529467.231672:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c539ff lrc: 3/0,1 mode: PW/PW res: [0x2bc75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529467.231676:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179269 count 1 00010000:00010000:0.0:1651529467.231676:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c539ff lrc: 3/0,1 mode: PW/PW res: [0x2bc75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231679:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c539ff lrc: 3/0,1 mode: PW/PW res: [0x2bc75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.231681:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc45:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.231681:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c539ff lrc: 2/0,0 mode: PW/PW res: [0x2bc75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231683:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c53a06 lrc: 3/0,1 mode: --/PW res: [0x2bc45:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231686:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.231686:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.231687:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c53a06 lrc: 3/0,1 mode: PW/PW res: [0x2bc45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231691:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c53a06 lrc: 3/0,1 mode: PW/PW res: [0x2bc45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231694:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c53a06 lrc: 3/0,1 mode: PW/PW res: [0x2bc45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231697:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c53a06 lrc: 2/0,0 mode: PW/PW res: [0x2bc45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.231713:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9b0314b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+49:39030:x1731745946618368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 56us (270us total) trans 12885081037 rc 0/0 00000100:00100000:0.0:1651529467.231717:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213033 00010000:00010000:0.0:1651529467.231728:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e600099f/0x3234de053c539dc lrc: 2/0,0 mode: PW/PW res: [0x2bc9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.231729:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5ebc6ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+48:39029:x1731745946618432:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 57us (280us total) trans 12885081038 rc 0/0 00010000:00010000:0.0:1651529467.231731:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e600099f already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529467.231732:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213034 00010000:00010000:0.0:1651529467.231732:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e600099f/0x3234de053c539dc lrc: 2/0,0 mode: PW/PW res: [0x2bc9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231735:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e600099f/0x3234de053c539dc lrc: 3/0,0 mode: PW/PW res: [0x2bc9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231739:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c539e3 lrc: 2/0,0 mode: PW/PW res: [0x2bc8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231740:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e600099f/0x3234de053c539dc lrc: 1/0,0 mode: --/PW res: [0x2bc9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231742:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f3240ce7 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.231743:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c539e3 lrc: 2/0,0 mode: PW/PW res: [0x2bc8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231743:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e600099f/0x3234de053c539dc lrc: 0/0,0 mode: --/PW res: [0x2bc9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231746:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c539e3 lrc: 3/0,0 mode: PW/PW res: [0x2bc8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231747:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002bb34145/0x3234de053c539ea lrc: 2/0,0 mode: PW/PW res: [0x2bc20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231750:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002bb34145 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.231751:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c539e3 lrc: 1/0,0 mode: --/PW res: [0x2bc8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231751:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002bb34145/0x3234de053c539ea lrc: 2/0,0 mode: PW/PW res: [0x2bc20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231753:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c539e3 lrc: 0/0,0 mode: --/PW res: [0x2bc8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231753:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002bb34145/0x3234de053c539ea lrc: 3/0,0 mode: PW/PW res: [0x2bc20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231758:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c539f1 lrc: 2/0,0 mode: PW/PW res: [0x2bc6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231759:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002bb34145/0x3234de053c539ea lrc: 1/0,0 mode: --/PW res: [0x2bc20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231761:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054295afd already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.231762:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c539f1 lrc: 2/0,0 mode: PW/PW res: [0x2bc6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231762:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002bb34145/0x3234de053c539ea lrc: 0/0,0 mode: --/PW res: [0x2bc20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231764:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c539f1 lrc: 3/0,0 mode: PW/PW res: [0x2bc6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231766:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a091a01a/0x3234de053c539f8 lrc: 2/0,0 mode: PW/PW res: [0x2bc54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231767:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c539f1 lrc: 1/0,0 mode: --/PW res: [0x2bc6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231768:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a091a01a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.231769:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a091a01a/0x3234de053c539f8 lrc: 2/0,0 mode: PW/PW res: [0x2bc54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231770:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c539f1 lrc: 0/0,0 mode: --/PW res: [0x2bc6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231771:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a091a01a/0x3234de053c539f8 lrc: 3/0,0 mode: PW/PW res: [0x2bc54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231773:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c539ff lrc: 2/0,0 mode: PW/PW res: [0x2bc75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231775:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a091a01a/0x3234de053c539f8 lrc: 1/0,0 mode: --/PW res: [0x2bc54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231776:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005c863cd2 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.231777:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c539ff lrc: 2/0,0 mode: PW/PW res: [0x2bc75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231777:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a091a01a/0x3234de053c539f8 lrc: 0/0,0 mode: --/PW res: [0x2bc54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231779:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c539ff lrc: 3/0,0 mode: PW/PW res: [0x2bc75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231781:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c53a06 lrc: 2/0,0 mode: PW/PW res: [0x2bc45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231782:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c539ff lrc: 1/0,0 mode: --/PW res: [0x2bc75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231783:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ac1d189d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.231784:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c53a06 lrc: 2/0,0 mode: PW/PW res: [0x2bc45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231785:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c539ff lrc: 0/0,0 mode: --/PW res: [0x2bc75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231787:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c53a06 lrc: 3/0,0 mode: PW/PW res: [0x2bc45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231790:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c53a06 lrc: 1/0,0 mode: --/PW res: [0x2bc45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.231793:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c53a06 lrc: 0/0,0 mode: --/PW res: [0x2bc45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.231811:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.231822:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946618816 00000100:00100000:1.0:1651529467.231829:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213035 00000100:00100000:1.0:1651529467.231831:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+48:39029:x1731745946618816:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.231836:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179264 count 1 00002000:00010000:1.0:1651529467.231842:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.231850:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a1913b4/0x3234de053c53a0d lrc: 3/0,1 mode: --/PW res: [0x2bc40:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231854:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.231855:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.231855:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a1913b4/0x3234de053c53a0d lrc: 3/0,1 mode: PW/PW res: [0x2bc40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231884:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a1913b4/0x3234de053c53a0d lrc: 3/0,1 mode: PW/PW res: [0x2bc40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231887:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a1913b4/0x3234de053c53a0d lrc: 3/0,1 mode: PW/PW res: [0x2bc40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231890:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a1913b4/0x3234de053c53a0d lrc: 2/0,0 mode: PW/PW res: [0x2bc40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.231932:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+49:39029:x1731745946618816:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 100us (120us total) trans 12885081039 rc 0/0 00000100:00100000:1.0:1651529467.231935:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213035 00010000:00010000:1.0:1651529467.231942:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a1913b4/0x3234de053c53a0d lrc: 2/0,0 mode: PW/PW res: [0x2bc40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231945:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004a1913b4 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.231947:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a1913b4/0x3234de053c53a0d lrc: 2/0,0 mode: PW/PW res: [0x2bc40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231949:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a1913b4/0x3234de053c53a0d lrc: 3/0,0 mode: PW/PW res: [0x2bc40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231954:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a1913b4/0x3234de053c53a0d lrc: 1/0,0 mode: --/PW res: [0x2bc40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.231957:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a1913b4/0x3234de053c53a0d lrc: 0/0,0 mode: --/PW res: [0x2bc40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.232143:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.232153:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946619008 00000100:00100000:0.0:1651529467.232153:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.232162:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.232170:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946618944 00000100:00100000:1.0:1651529467.232175:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946619136 00000100:00100000:0.0:1651529467.232179:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.232180:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213036 00000100:00100000:1.0:1651529467.232182:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068b6c75f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+51:39030:x1731745946619008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.232187:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179385 count 1 00000100:00100000:0.0:1651529467.232187:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.232193:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.232199:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00010000:1.0:1651529467.232201:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcb9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.232203:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000066556eb/0x3234de053c53a14 lrc: 3/0,1 mode: --/PW res: [0x2bcb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.232206:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946619072 00010000:00010000:1.0:1651529467.232210:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.232211:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.232212:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000066556eb/0x3234de053c53a14 lrc: 3/0,1 mode: PW/PW res: [0x2bcb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.232213:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946619264 00010000:00010000:1.0:1651529467.232215:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000066556eb/0x3234de053c53a14 lrc: 3/0,1 mode: PW/PW res: [0x2bcb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.232216:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946619200 00010000:00010000:1.0:1651529467.232218:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000066556eb/0x3234de053c53a14 lrc: 3/0,1 mode: PW/PW res: [0x2bcb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.232218:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946619328 00010000:00010000:1.0:1651529467.232221:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000066556eb/0x3234de053c53a14 lrc: 2/0,0 mode: PW/PW res: [0x2bcb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.232221:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213037 00000100:00100000:0.0:1651529467.232240:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df603127 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+55:39029:x1731745946618944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.232250:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179348 count 1 00002000:00010000:0.0:1651529467.232274:0:80280:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc94:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.232276:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c53a1b lrc: 3/0,1 mode: --/PW res: [0x2bc94:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232282:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.232283:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.232284:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c53a1b lrc: 3/0,1 mode: PW/PW res: [0x2bc94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.232291:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068b6c75f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+56:39030:x1731745946619008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 107us (148us total) trans 12885081040 rc 0/0 00010000:00010000:0.0:1651529467.232293:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c53a1b lrc: 3/0,1 mode: PW/PW res: [0x2bc94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.232294:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213036 00010000:00010000:0.0:1651529467.232297:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c53a1b lrc: 3/0,1 mode: PW/PW res: [0x2bc94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232299:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c53a1b lrc: 2/0,0 mode: PW/PW res: [0x2bc94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.232300:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213038 00000100:00100000:1.0:1651529467.232301:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000020362888 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+55:39030:x1731745946619136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.232306:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179179 count 1 00002000:00010000:1.0:1651529467.232312:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbeb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.232314:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000485752e5/0x3234de053c53a22 lrc: 3/0,1 mode: --/PW res: [0x2bbeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232317:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.232318:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.232319:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000485752e5/0x3234de053c53a22 lrc: 3/0,1 mode: PW/PW res: [0x2bbeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232322:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000485752e5/0x3234de053c53a22 lrc: 3/0,1 mode: PW/PW res: [0x2bbeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232325:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000485752e5/0x3234de053c53a22 lrc: 3/0,1 mode: PW/PW res: [0x2bbeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232328:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000485752e5/0x3234de053c53a22 lrc: 2/0,0 mode: PW/PW res: [0x2bbeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.232340:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df603127 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+56:39029:x1731745946618944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 103us (186us total) trans 12885081041 rc 0/0 00000100:00100000:0.0:1651529467.232342:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213037 00000100:00100000:0.0:1651529467.232348:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213039 00000100:00100000:0.0:1651529467.232349:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b09b3bd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+56:39029:x1731745946619072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.232353:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179223 count 1 00002000:00010000:0.0:1651529467.232359:0:80280:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.232360:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c53a29 lrc: 3/0,1 mode: --/PW res: [0x2bc17:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232364:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.232364:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.232365:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c53a29 lrc: 3/0,1 mode: PW/PW res: [0x2bc17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.232366:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000020362888 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+56:39030:x1731745946619136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 64us (204us total) trans 12885081042 rc 0/0 00000100:00100000:1.0:1651529467.232369:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213038 00010000:00010000:0.0:1651529467.232369:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c53a29 lrc: 3/0,1 mode: PW/PW res: [0x2bc17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232372:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c53a29 lrc: 3/0,1 mode: PW/PW res: [0x2bc17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.232374:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213040 00000100:00100000:1.0:1651529467.232375:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003132c0c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+55:39030:x1731745946619264:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529467.232375:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c53a29 lrc: 2/0,0 mode: PW/PW res: [0x2bc17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529467.232380:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179259 count 1 00002000:00010000:1.0:1651529467.232384:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.232386:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091069ebb/0x3234de053c53a30 lrc: 3/0,1 mode: --/PW res: [0x2bc3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232389:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.232389:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.232390:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091069ebb/0x3234de053c53a30 lrc: 3/0,1 mode: PW/PW res: [0x2bc3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232394:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091069ebb/0x3234de053c53a30 lrc: 3/0,1 mode: PW/PW res: [0x2bc3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232400:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091069ebb/0x3234de053c53a30 lrc: 3/0,1 mode: PW/PW res: [0x2bc3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232402:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091069ebb/0x3234de053c53a30 lrc: 2/0,0 mode: PW/PW res: [0x2bc3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.232406:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b09b3bd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+56:39029:x1731745946619072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 56us (227us total) trans 12885081043 rc 0/0 00000100:00100000:0.0:1651529467.232409:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213039 00000100:00100000:0.0:1651529467.232427:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213041 00000100:00100000:0.0:1651529467.232428:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+56:39029:x1731745946619200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.232432:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179368 count 1 00000100:00100000:1.0:1651529467.232436:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003132c0c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+56:39030:x1731745946619264:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 60us (249us total) trans 12885081044 rc 0/0 00002000:00010000:0.0:1651529467.232437:0:80280:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bca8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.232438:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c53a37 lrc: 3/0,1 mode: --/PW res: [0x2bca8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.232439:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213040 00010000:00010000:0.0:1651529467.232442:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.232442:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.232443:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c53a37 lrc: 3/0,1 mode: PW/PW res: [0x2bca8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.232444:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213042 00000100:00100000:1.0:1651529467.232446:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+55:39029:x1731745946619328:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529467.232447:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c53a37 lrc: 3/0,1 mode: PW/PW res: [0x2bca8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529467.232450:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179261 count 1 00010000:00010000:0.0:1651529467.232452:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c53a37 lrc: 3/0,1 mode: PW/PW res: [0x2bca8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.232455:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.232455:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c53a37 lrc: 2/0,0 mode: PW/PW res: [0x2bca8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232456:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bbf33489/0x3234de053c53a3e lrc: 3/0,1 mode: --/PW res: [0x2bc3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232459:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.232460:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.232461:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bbf33489/0x3234de053c53a3e lrc: 3/0,1 mode: PW/PW res: [0x2bc3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232464:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bbf33489/0x3234de053c53a3e lrc: 3/0,1 mode: PW/PW res: [0x2bc3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232467:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bbf33489/0x3234de053c53a3e lrc: 3/0,1 mode: PW/PW res: [0x2bc3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232472:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bbf33489/0x3234de053c53a3e lrc: 2/0,0 mode: PW/PW res: [0x2bc3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.232488:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+57:39029:x1731745946619200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 58us (294us total) trans 12885081045 rc 0/0 00000100:00100000:0.0:1651529467.232490:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213041 00000100:00100000:1.0:1651529467.232503:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+56:39029:x1731745946619328:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 57us (304us total) trans 12885081046 rc 0/0 00010000:00010000:0.0:1651529467.232503:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000066556eb/0x3234de053c53a14 lrc: 2/0,0 mode: PW/PW res: [0x2bcb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.232506:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213042 00010000:00010000:0.0:1651529467.232506:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000066556eb already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.232507:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000066556eb/0x3234de053c53a14 lrc: 2/0,0 mode: PW/PW res: [0x2bcb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232511:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000066556eb/0x3234de053c53a14 lrc: 3/0,0 mode: PW/PW res: [0x2bcb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232514:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c53a1b lrc: 2/0,0 mode: PW/PW res: [0x2bc94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232515:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000066556eb/0x3234de053c53a14 lrc: 1/0,0 mode: --/PW res: [0x2bcb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232517:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f149aa4b already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.232518:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c53a1b lrc: 2/0,0 mode: PW/PW res: [0x2bc94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232518:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000066556eb/0x3234de053c53a14 lrc: 0/0,0 mode: --/PW res: [0x2bcb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232521:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c53a1b lrc: 3/0,0 mode: PW/PW res: [0x2bc94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232522:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000485752e5/0x3234de053c53a22 lrc: 2/0,0 mode: PW/PW res: [0x2bbeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232525:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000485752e5 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.232526:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c53a1b lrc: 1/0,0 mode: --/PW res: [0x2bc94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232526:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000485752e5/0x3234de053c53a22 lrc: 2/0,0 mode: PW/PW res: [0x2bbeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232528:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c53a1b lrc: 0/0,0 mode: --/PW res: [0x2bc94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232529:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000485752e5/0x3234de053c53a22 lrc: 3/0,0 mode: PW/PW res: [0x2bbeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232532:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c53a29 lrc: 2/0,0 mode: PW/PW res: [0x2bc17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232532:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000485752e5/0x3234de053c53a22 lrc: 1/0,0 mode: --/PW res: [0x2bbeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232535:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ee128d1f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.232535:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000485752e5/0x3234de053c53a22 lrc: 0/0,0 mode: --/PW res: [0x2bbeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232536:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c53a29 lrc: 2/0,0 mode: PW/PW res: [0x2bc17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232538:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091069ebb/0x3234de053c53a30 lrc: 2/0,0 mode: PW/PW res: [0x2bc3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232539:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c53a29 lrc: 3/0,0 mode: PW/PW res: [0x2bc17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232541:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000091069ebb already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.232541:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091069ebb/0x3234de053c53a30 lrc: 2/0,0 mode: PW/PW res: [0x2bc3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232542:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c53a29 lrc: 1/0,0 mode: --/PW res: [0x2bc17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232544:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091069ebb/0x3234de053c53a30 lrc: 3/0,0 mode: PW/PW res: [0x2bc3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232545:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c53a29 lrc: 0/0,0 mode: --/PW res: [0x2bc17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232547:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091069ebb/0x3234de053c53a30 lrc: 1/0,0 mode: --/PW res: [0x2bc3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232548:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c53a37 lrc: 2/0,0 mode: PW/PW res: [0x2bca8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232550:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091069ebb/0x3234de053c53a30 lrc: 0/0,0 mode: --/PW res: [0x2bc3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232551:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032eb11d3 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.232552:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c53a37 lrc: 2/0,0 mode: PW/PW res: [0x2bca8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232553:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bbf33489/0x3234de053c53a3e lrc: 2/0,0 mode: PW/PW res: [0x2bc3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232554:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c53a37 lrc: 3/0,0 mode: PW/PW res: [0x2bca8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232556:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bbf33489 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.232557:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c53a37 lrc: 1/0,0 mode: --/PW res: [0x2bca8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232557:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbf33489/0x3234de053c53a3e lrc: 2/0,0 mode: PW/PW res: [0x2bc3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232559:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbf33489/0x3234de053c53a3e lrc: 3/0,0 mode: PW/PW res: [0x2bc3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232560:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c53a37 lrc: 0/0,0 mode: --/PW res: [0x2bca8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232563:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bbf33489/0x3234de053c53a3e lrc: 1/0,0 mode: --/PW res: [0x2bc3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.232565:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bbf33489/0x3234de053c53a3e lrc: 0/0,0 mode: --/PW res: [0x2bc3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.232575:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.232593:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946619712 00000100:00100000:1.0:1651529467.232602:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213043 00000100:00100000:1.0:1651529467.232604:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+56:39029:x1731745946619712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.232618:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179305 count 1 00002000:00010000:1.0:1651529467.232624:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc69:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.232626:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c53a45 lrc: 3/0,1 mode: --/PW res: [0x2bc69:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232652:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.232653:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.232654:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c53a45 lrc: 3/0,1 mode: PW/PW res: [0x2bc69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232658:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c53a45 lrc: 3/0,1 mode: PW/PW res: [0x2bc69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232662:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c53a45 lrc: 3/0,1 mode: PW/PW res: [0x2bc69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232664:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c53a45 lrc: 2/0,0 mode: PW/PW res: [0x2bc69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.232706:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+57:39029:x1731745946619712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 101us (130us total) trans 12885081047 rc 0/0 00000100:00100000:1.0:1651529467.232709:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213043 00010000:00010000:1.0:1651529467.232715:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c53a45 lrc: 2/0,0 mode: PW/PW res: [0x2bc69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232721:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000676967d8 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.232722:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c53a45 lrc: 2/0,0 mode: PW/PW res: [0x2bc69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232725:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c53a45 lrc: 3/0,0 mode: PW/PW res: [0x2bc69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232729:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c53a45 lrc: 1/0,0 mode: --/PW res: [0x2bc69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232732:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c53a45 lrc: 0/0,0 mode: --/PW res: [0x2bc69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.232865:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.232882:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946619968 00000100:00100000:1.0:1651529467.232890:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213044 00000100:00100000:1.0:1651529467.232892:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+57:39029:x1731745946619968:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.232902:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179424 count 1 00002000:00010000:1.0:1651529467.232908:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bce0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.232909:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c53a4c lrc: 3/0,1 mode: --/PW res: [0x2bce0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.232912:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529467.232919:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.232920:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.232921:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c53a4c lrc: 3/0,1 mode: PW/PW res: [0x2bce0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.232921:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529467.232925:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c53a4c lrc: 3/0,1 mode: PW/PW res: [0x2bce0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.232927:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529467.232928:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c53a4c lrc: 3/0,1 mode: PW/PW res: [0x2bce0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.232931:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c53a4c lrc: 2/0,0 mode: PW/PW res: [0x2bce0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.232933:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.232944:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.232954:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.232962:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946620032 00000100:00100000:0.0:1651529467.232968:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946620096 00000100:00100000:0.0:1651529467.232971:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946620160 00000100:00100000:0.0:1651529467.232974:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946620288 00000100:00100000:0.0:1651529467.232977:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946620224 00000100:00100000:0.0:1651529467.232979:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946620352 00000100:00100000:1.0:1651529467.232980:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+64:39029:x1731745946619968:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 87us (115us total) trans 12885081048 rc 0/0 00000100:00100000:0.0:1651529467.232982:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213045 00000100:00100000:1.0:1651529467.232984:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213044 00000100:00100000:0.0:1651529467.232984:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+64:39030:x1731745946620032:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.232989:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179291 count 1 00000100:00100000:1.0:1651529467.232990:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213046 00000100:00100000:1.0:1651529467.232991:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+63:39029:x1731745946620096:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00010000:0.0:1651529467.232995:0:80278:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc5b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00080000:1.0:1651529467.232996:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179310 count 1 00010000:00010000:0.0:1651529467.232997:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c53a53 lrc: 3/0,1 mode: --/PW res: [0x2bc5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.233001:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc6e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.233001:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.233001:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.233002:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c53a53 lrc: 3/0,1 mode: PW/PW res: [0x2bc5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233003:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c53a5a lrc: 3/0,1 mode: --/PW res: [0x2bc6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233006:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.233006:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c53a53 lrc: 3/0,1 mode: PW/PW res: [0x2bc5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233007:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.233008:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c53a5a lrc: 3/0,1 mode: PW/PW res: [0x2bc6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233009:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c53a53 lrc: 3/0,1 mode: PW/PW res: [0x2bc5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233011:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c53a5a lrc: 3/0,1 mode: PW/PW res: [0x2bc6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233012:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c53a53 lrc: 2/0,0 mode: PW/PW res: [0x2bc5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233014:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c53a5a lrc: 3/0,1 mode: PW/PW res: [0x2bc6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233019:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c53a5a lrc: 2/0,0 mode: PW/PW res: [0x2bc6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.233056:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+65:39029:x1731745946620096:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 63us (134us total) trans 12885081050 rc 0/0 00000100:00100000:1.0:1651529467.233058:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213046 00000100:00100000:1.0:1651529467.233063:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213047 00000100:00100000:1.0:1651529467.233065:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+64:39030:x1731745946620160:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.233069:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179255 count 1 00000100:00100000:0.0:1651529467.233070:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+64:39030:x1731745946620032:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 85us (157us total) trans 12885081049 rc 0/0 00000100:00100000:0.0:1651529467.233073:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213045 00002000:00010000:1.0:1651529467.233074:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.233075:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c53a61 lrc: 3/0,1 mode: --/PW res: [0x2bc37:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.233078:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213048 00010000:00010000:1.0:1651529467.233079:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.233079:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.233080:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c53a61 lrc: 3/0,1 mode: PW/PW res: [0x2bc37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.233080:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+63:39030:x1731745946620288:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529467.233083:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c53a61 lrc: 3/0,1 mode: PW/PW res: [0x2bc37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233086:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c53a61 lrc: 3/0,1 mode: PW/PW res: [0x2bc37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529467.233086:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179314 count 1 00010000:00010000:1.0:1651529467.233089:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c53a61 lrc: 2/0,0 mode: PW/PW res: [0x2bc37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.233091:0:80278:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc72:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.233092:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c53a68 lrc: 3/0,1 mode: --/PW res: [0x2bc72:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233096:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.233097:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.233097:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c53a68 lrc: 3/0,1 mode: PW/PW res: [0x2bc72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233101:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c53a68 lrc: 3/0,1 mode: PW/PW res: [0x2bc72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233104:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c53a68 lrc: 3/0,1 mode: PW/PW res: [0x2bc72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233107:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c53a68 lrc: 2/0,0 mode: PW/PW res: [0x2bc72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.233124:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+65:39030:x1731745946620160:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 58us (196us total) trans 12885081051 rc 0/0 00000100:00100000:1.0:1651529467.233127:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213047 00000100:00100000:1.0:1651529467.233131:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213049 00000100:00100000:1.0:1651529467.233133:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+64:39029:x1731745946620224:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.233137:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179253 count 1 00000100:00100000:0.0:1651529467.233141:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+64:39030:x1731745946620288:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 61us (208us total) trans 12885081052 rc 0/0 00002000:00010000:1.0:1651529467.233142:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.233143:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c53a6f lrc: 3/0,1 mode: --/PW res: [0x2bc35:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.233144:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213048 00010000:00010000:1.0:1651529467.233146:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.233147:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.233148:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c53a6f lrc: 3/0,1 mode: PW/PW res: [0x2bc35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.233149:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213050 00010000:00010000:1.0:1651529467.233151:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c53a6f lrc: 3/0,1 mode: PW/PW res: [0x2bc35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.233151:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+63:39029:x1731745946620352:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529467.233154:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c53a6f lrc: 3/0,1 mode: PW/PW res: [0x2bc35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529467.233155:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179323 count 1 00010000:00010000:1.0:1651529467.233157:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c53a6f lrc: 2/0,0 mode: PW/PW res: [0x2bc35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.233160:0:80278:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc7b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.233161:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c53a76 lrc: 3/0,1 mode: --/PW res: [0x2bc7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233165:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.233165:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.233166:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c53a76 lrc: 3/0,1 mode: PW/PW res: [0x2bc7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233170:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c53a76 lrc: 3/0,1 mode: PW/PW res: [0x2bc7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233173:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c53a76 lrc: 3/0,1 mode: PW/PW res: [0x2bc7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233175:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c53a76 lrc: 2/0,0 mode: PW/PW res: [0x2bc7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.233188:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+64:39029:x1731745946620224:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 54us (243us total) trans 12885081053 rc 0/0 00000100:00100000:1.0:1651529467.233192:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213049 00010000:00010000:1.0:1651529467.233199:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c53a4c lrc: 2/0,0 mode: PW/PW res: [0x2bce0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233202:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000082ae179c already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.233203:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c53a4c lrc: 2/0,0 mode: PW/PW res: [0x2bce0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233206:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c53a4c lrc: 3/0,0 mode: PW/PW res: [0x2bce0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.233207:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+64:39029:x1731745946620352:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 55us (252us total) trans 12885081054 rc 0/0 00000100:00100000:0.0:1651529467.233210:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213050 00010000:00010000:1.0:1651529467.233211:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c53a4c lrc: 1/0,0 mode: --/PW res: [0x2bce0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233213:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c53a4c lrc: 0/0,0 mode: --/PW res: [0x2bce0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233217:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c53a53 lrc: 2/0,0 mode: PW/PW res: [0x2bc5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233219:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c53a5a lrc: 2/0,0 mode: PW/PW res: [0x2bc6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233220:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005a2cb180 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.233221:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c53a53 lrc: 2/0,0 mode: PW/PW res: [0x2bc5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233245:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c53a53 lrc: 3/0,0 mode: PW/PW res: [0x2bc5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233248:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000036d87bb6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.233249:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c53a5a lrc: 2/0,0 mode: PW/PW res: [0x2bc6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233252:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c53a53 lrc: 1/0,0 mode: --/PW res: [0x2bc5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233252:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c53a5a lrc: 3/0,0 mode: PW/PW res: [0x2bc6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233254:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c53a53 lrc: 0/0,0 mode: --/PW res: [0x2bc5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233258:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c53a61 lrc: 2/0,0 mode: PW/PW res: [0x2bc37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233260:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c53a5a lrc: 1/0,0 mode: --/PW res: [0x2bc6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233261:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b0407aaf already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.233262:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c53a61 lrc: 2/0,0 mode: PW/PW res: [0x2bc37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233263:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c53a5a lrc: 0/0,0 mode: --/PW res: [0x2bc6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233264:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c53a61 lrc: 3/0,0 mode: PW/PW res: [0x2bc37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233267:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c53a68 lrc: 2/0,0 mode: PW/PW res: [0x2bc72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233268:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c53a61 lrc: 1/0,0 mode: --/PW res: [0x2bc37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233270:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c53a61 lrc: 0/0,0 mode: --/PW res: [0x2bc37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233270:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f616ea25 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.233271:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c53a68 lrc: 2/0,0 mode: PW/PW res: [0x2bc72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233274:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c53a6f lrc: 2/0,0 mode: PW/PW res: [0x2bc35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233274:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c53a68 lrc: 3/0,0 mode: PW/PW res: [0x2bc72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233276:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000a7c37b9 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.233277:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c53a6f lrc: 2/0,0 mode: PW/PW res: [0x2bc35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233277:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c53a68 lrc: 1/0,0 mode: --/PW res: [0x2bc72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233280:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c53a6f lrc: 3/0,0 mode: PW/PW res: [0x2bc35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233280:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c53a68 lrc: 0/0,0 mode: --/PW res: [0x2bc72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233283:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c53a6f lrc: 1/0,0 mode: --/PW res: [0x2bc35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233283:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c53a76 lrc: 2/0,0 mode: PW/PW res: [0x2bc7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233286:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c53a6f lrc: 0/0,0 mode: --/PW res: [0x2bc35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233286:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba070658 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.233286:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c53a76 lrc: 2/0,0 mode: PW/PW res: [0x2bc7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233289:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c53a76 lrc: 3/0,0 mode: PW/PW res: [0x2bc7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233293:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c53a76 lrc: 1/0,0 mode: --/PW res: [0x2bc7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233295:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c53a76 lrc: 0/0,0 mode: --/PW res: [0x2bc7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.233302:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.233312:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946620608 00000100:00100000:0.0:1651529467.233319:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213051 00000100:00100000:0.0:1651529467.233321:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+64:39029:x1731745946620608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.233326:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179196 count 1 00002000:00010000:0.0:1651529467.233331:0:72395:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbfc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.233332:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c53a7d lrc: 3/0,1 mode: --/PW res: [0x2bbfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233335:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.233336:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.233337:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c53a7d lrc: 3/0,1 mode: PW/PW res: [0x2bbfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233340:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c53a7d lrc: 3/0,1 mode: PW/PW res: [0x2bbfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233343:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c53a7d lrc: 3/0,1 mode: PW/PW res: [0x2bbfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233348:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c53a7d lrc: 2/0,0 mode: PW/PW res: [0x2bbfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233380:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c53a7d lrc: 2/0,0 mode: PW/PW res: [0x2bbfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233384:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c0de17df already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.233385:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c53a7d lrc: 2/0,0 mode: PW/PW res: [0x2bbfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233388:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c53a7d lrc: 3/0,0 mode: PW/PW res: [0x2bbfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.233395:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+65:39029:x1731745946620608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 73us (93us total) trans 12885081055 rc 0/0 00010000:00010000:1.0:1651529467.233397:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c53a7d lrc: 1/0,0 mode: --/PW res: [0x2bbfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.233398:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213051 00010000:00010000:1.0:1651529467.233400:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c53a7d lrc: 0/0,0 mode: --/PW res: [0x2bbfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.233645:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.233656:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946620992 00000100:00100000:0.0:1651529467.233656:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.233663:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.233674:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946621120 00000100:00100000:1.0:1651529467.233681:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946621248 00000100:00100000:0.0:1651529467.233684:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.233687:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213052 00000100:00100000:1.0:1651529467.233689:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+67:39029:x1731745946620992:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.233694:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179282 count 1 00000100:00100000:0.0:1651529467.233695:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00010000:1.0:1651529467.233700:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc52:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1651529467.233701:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529467.233702:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c53a84 lrc: 3/0,1 mode: --/PW res: [0x2bc52:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233706:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.233706:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.233707:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c53a84 lrc: 3/0,1 mode: PW/PW res: [0x2bc52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.233707:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529467.233711:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c53a84 lrc: 3/0,1 mode: PW/PW res: [0x2bc52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233714:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c53a84 lrc: 3/0,1 mode: PW/PW res: [0x2bc52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.233715:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529467.233716:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c53a84 lrc: 2/0,0 mode: PW/PW res: [0x2bc52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.233727:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946621376 00000100:00100000:0.0:1651529467.233737:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946621056 00000100:00100000:0.0:1651529467.233740:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946621184 00000100:00100000:0.0:1651529467.233742:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946621312 00000100:00100000:0.0:1651529467.233744:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946621440 00000100:00100000:0.0:1651529467.233747:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213053 00000100:00100000:0.0:1651529467.233748:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+73:39029:x1731745946621120:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.233754:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179279 count 1 00002000:00010000:0.0:1651529467.233760:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc4f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.233762:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c53a8b lrc: 3/0,1 mode: --/PW res: [0x2bc4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233765:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.233766:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529467.233767:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+73:39029:x1731745946620992:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 77us (122us total) trans 12885081056 rc 0/0 00010000:00010000:0.0:1651529467.233767:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c53a8b lrc: 3/0,1 mode: PW/PW res: [0x2bc4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.233771:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213052 00010000:00010000:0.0:1651529467.233771:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c53a8b lrc: 3/0,1 mode: PW/PW res: [0x2bc4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233774:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c53a8b lrc: 3/0,1 mode: PW/PW res: [0x2bc4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.233776:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213054 00010000:00010000:0.0:1651529467.233776:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c53a8b lrc: 2/0,0 mode: PW/PW res: [0x2bc4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.233778:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+72:39029:x1731745946621248:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.233783:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179331 count 1 00002000:00010000:1.0:1651529467.233788:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc83:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.233790:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c53a92 lrc: 3/0,1 mode: --/PW res: [0x2bc83:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233793:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.233794:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.233795:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c53a92 lrc: 3/0,1 mode: PW/PW res: [0x2bc83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233809:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c53a92 lrc: 3/0,1 mode: PW/PW res: [0x2bc83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233813:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c53a92 lrc: 3/0,1 mode: PW/PW res: [0x2bc83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233816:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c53a92 lrc: 2/0,0 mode: PW/PW res: [0x2bc83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.233826:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+73:39029:x1731745946621120:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 76us (170us total) trans 12885081057 rc 0/0 00000100:00100000:0.0:1651529467.233829:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213053 00000100:00100000:0.0:1651529467.233835:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213055 00000100:00100000:0.0:1651529467.233836:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+73:39029:x1731745946621376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.233841:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179370 count 1 00002000:00010000:0.0:1651529467.233846:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcaa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.233848:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c53a99 lrc: 3/0,1 mode: --/PW res: [0x2bcaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233851:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.233852:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529467.233853:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+73:39029:x1731745946621248:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 75us (189us total) trans 12885081058 rc 0/0 00010000:00010000:0.0:1651529467.233853:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c53a99 lrc: 3/0,1 mode: PW/PW res: [0x2bcaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.233856:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213054 00010000:00010000:0.0:1651529467.233856:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c53a99 lrc: 3/0,1 mode: PW/PW res: [0x2bcaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233860:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c53a99 lrc: 3/0,1 mode: PW/PW res: [0x2bcaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.233861:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213056 00010000:00010000:0.0:1651529467.233862:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c53a99 lrc: 2/0,0 mode: PW/PW res: [0x2bcaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.233863:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+72:39030:x1731745946621056:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.233867:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179236 count 1 00002000:00010000:1.0:1651529467.233872:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.233874:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c53aa0 lrc: 3/0,1 mode: --/PW res: [0x2bc24:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233877:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.233878:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.233879:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c53aa0 lrc: 3/0,1 mode: PW/PW res: [0x2bc24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233882:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c53aa0 lrc: 3/0,1 mode: PW/PW res: [0x2bc24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233885:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c53aa0 lrc: 3/0,1 mode: PW/PW res: [0x2bc24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233888:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c53aa0 lrc: 2/0,0 mode: PW/PW res: [0x2bc24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.233896:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+73:39029:x1731745946621376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 58us (216us total) trans 12885081059 rc 0/0 00000100:00100000:0.0:1651529467.233898:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213055 00000100:00100000:0.0:1651529467.233903:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213057 00000100:00100000:0.0:1651529467.233905:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+73:39030:x1731745946621184:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.233909:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179208 count 1 00002000:00010000:0.0:1651529467.233913:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc08:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.233915:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c53aa7 lrc: 3/0,1 mode: --/PW res: [0x2bc08:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233918:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.233919:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.233920:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c53aa7 lrc: 3/0,1 mode: PW/PW res: [0x2bc08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.233921:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+73:39030:x1731745946621056:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 57us (225us total) trans 12885081060 rc 0/0 00010000:00010000:0.0:1651529467.233923:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c53aa7 lrc: 3/0,1 mode: PW/PW res: [0x2bc08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.233924:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213056 00010000:00010000:0.0:1651529467.233926:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c53aa7 lrc: 3/0,1 mode: PW/PW res: [0x2bc08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.233929:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213058 00000100:00100000:1.0:1651529467.233930:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+72:39030:x1731745946621312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529467.233931:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c53aa7 lrc: 2/0,0 mode: PW/PW res: [0x2bc08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529467.233934:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179242 count 1 00002000:00010000:1.0:1651529467.233939:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.233940:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c53aae lrc: 3/0,1 mode: --/PW res: [0x2bc2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233944:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.233944:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.233945:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c53aae lrc: 3/0,1 mode: PW/PW res: [0x2bc2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233949:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c53aae lrc: 3/0,1 mode: PW/PW res: [0x2bc2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233952:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c53aae lrc: 3/0,1 mode: PW/PW res: [0x2bc2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233955:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c53aae lrc: 2/0,0 mode: PW/PW res: [0x2bc2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.233962:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+73:39030:x1731745946621184:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 57us (260us total) trans 12885081061 rc 0/0 00000100:00100000:0.0:1651529467.233965:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213057 00000100:00100000:0.0:1651529467.233970:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213059 00000100:00100000:0.0:1651529467.233971:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+73:39030:x1731745946621440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.233975:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179212 count 1 00002000:00010000:0.0:1651529467.233980:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc0c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.233982:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c53ab5 lrc: 3/0,1 mode: --/PW res: [0x2bc0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.233985:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+73:39030:x1731745946621312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 54us (278us total) trans 12885081062 rc 0/0 00010000:00010000:0.0:1651529467.233985:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.233986:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.233986:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c53ab5 lrc: 3/0,1 mode: PW/PW res: [0x2bc0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.233988:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213058 00010000:00010000:0.0:1651529467.233990:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c53ab5 lrc: 3/0,1 mode: PW/PW res: [0x2bc0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233993:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c53ab5 lrc: 3/0,1 mode: PW/PW res: [0x2bc0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233995:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c53a84 lrc: 2/0,0 mode: PW/PW res: [0x2bc52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.233996:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c53ab5 lrc: 2/0,0 mode: PW/PW res: [0x2bc0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.233998:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d9cfe902 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.233999:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c53a84 lrc: 2/0,0 mode: PW/PW res: [0x2bc52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234002:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c53a84 lrc: 3/0,0 mode: PW/PW res: [0x2bc52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234006:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c53a84 lrc: 1/0,0 mode: --/PW res: [0x2bc52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234009:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c53a84 lrc: 0/0,0 mode: --/PW res: [0x2bc52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234014:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c53a8b lrc: 2/0,0 mode: PW/PW res: [0x2bc4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234016:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d84ad17b already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.234017:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c53a8b lrc: 2/0,0 mode: PW/PW res: [0x2bc4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234020:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c53a8b lrc: 3/0,0 mode: PW/PW res: [0x2bc4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234023:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c53a8b lrc: 1/0,0 mode: --/PW res: [0x2bc4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234026:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c53a8b lrc: 0/0,0 mode: --/PW res: [0x2bc4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234029:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c53a92 lrc: 2/0,0 mode: PW/PW res: [0x2bc83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.234029:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+73:39030:x1731745946621440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 57us (313us total) trans 12885081063 rc 0/0 00010000:00010000:1.0:1651529467.234031:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000009fe5580 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.234032:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c53a92 lrc: 2/0,0 mode: PW/PW res: [0x2bc83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.234032:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213059 00010000:00010000:1.0:1651529467.234035:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c53a92 lrc: 3/0,0 mode: PW/PW res: [0x2bc83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234038:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c53a92 lrc: 1/0,0 mode: --/PW res: [0x2bc83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234041:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c53a92 lrc: 0/0,0 mode: --/PW res: [0x2bc83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234041:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c53a99 lrc: 2/0,0 mode: PW/PW res: [0x2bcaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234044:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c53aa0 lrc: 2/0,0 mode: PW/PW res: [0x2bc24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234045:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2a86deb already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.234046:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c53a99 lrc: 2/0,0 mode: PW/PW res: [0x2bcaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234047:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000055fddd81 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.234047:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c53aa0 lrc: 2/0,0 mode: PW/PW res: [0x2bc24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234049:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c53a99 lrc: 3/0,0 mode: PW/PW res: [0x2bcaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234050:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c53aa0 lrc: 3/0,0 mode: PW/PW res: [0x2bc24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234053:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c53aa0 lrc: 1/0,0 mode: --/PW res: [0x2bc24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234053:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c53a99 lrc: 1/0,0 mode: --/PW res: [0x2bcaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234056:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c53aa0 lrc: 0/0,0 mode: --/PW res: [0x2bc24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234056:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c53a99 lrc: 0/0,0 mode: --/PW res: [0x2bcaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234059:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c53aa7 lrc: 2/0,0 mode: PW/PW res: [0x2bc08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234061:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004678bff1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.234061:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c53aae lrc: 2/0,0 mode: PW/PW res: [0x2bc2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234062:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c53aa7 lrc: 2/0,0 mode: PW/PW res: [0x2bc08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234064:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002f450f42 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.234064:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c53aae lrc: 2/0,0 mode: PW/PW res: [0x2bc2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234067:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c53aa7 lrc: 3/0,0 mode: PW/PW res: [0x2bc08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234070:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c53aae lrc: 3/0,0 mode: PW/PW res: [0x2bc2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234071:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c53aa7 lrc: 1/0,0 mode: --/PW res: [0x2bc08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234073:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c53aa7 lrc: 0/0,0 mode: --/PW res: [0x2bc08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234073:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c53aae lrc: 1/0,0 mode: --/PW res: [0x2bc2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234076:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c53aae lrc: 0/0,0 mode: --/PW res: [0x2bc2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234077:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c53ab5 lrc: 2/0,0 mode: PW/PW res: [0x2bc0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234079:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000029b2a516 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.234080:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c53ab5 lrc: 2/0,0 mode: PW/PW res: [0x2bc0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234082:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c53ab5 lrc: 3/0,0 mode: PW/PW res: [0x2bc0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234086:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c53ab5 lrc: 1/0,0 mode: --/PW res: [0x2bc0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234088:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c53ab5 lrc: 0/0,0 mode: --/PW res: [0x2bc0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.234464:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.234474:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.234483:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.234489:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946622208 00000100:00100000:0.0:1651529467.234490:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.234497:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.234500:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946622336 00000100:00100000:1.0:1651529467.234511:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946622272 00000100:00100000:1.0:1651529467.234516:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946622464 00000100:00100000:1.0:1651529467.234522:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946622400 00000100:00100000:0.0:1651529467.234524:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.234528:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213060 00000100:00100000:1.0:1651529467.234529:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+77:39029:x1731745946622208:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.234535:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179195 count 1 00000100:00100000:0.0:1651529467.234535:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.234544:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00010000:1.0:1651529467.234546:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbfb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.234548:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c53abc lrc: 3/0,1 mode: --/PW res: [0x2bbfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.234551:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946622592 00010000:00010000:1.0:1651529467.234552:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.234553:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.234553:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c53abc lrc: 3/0,1 mode: PW/PW res: [0x2bbfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234557:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c53abc lrc: 3/0,1 mode: PW/PW res: [0x2bbfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.234557:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946622528 00000100:00100000:0.0:1651529467.234559:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946622656 00010000:00010000:1.0:1651529467.234560:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c53abc lrc: 3/0,1 mode: PW/PW res: [0x2bbfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.234562:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213061 00010000:00010000:1.0:1651529467.234563:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c53abc lrc: 2/0,0 mode: PW/PW res: [0x2bbfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.234564:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007f9b0c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+80:39030:x1731745946622336:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.234575:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179298 count 1 00002000:00010000:0.0:1651529467.234581:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc62:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.234583:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c53ac3 lrc: 3/0,1 mode: --/PW res: [0x2bc62:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234589:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.234590:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.234591:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c53ac3 lrc: 3/0,1 mode: PW/PW res: [0x2bc62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234594:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c53ac3 lrc: 3/0,1 mode: PW/PW res: [0x2bc62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234597:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c53ac3 lrc: 3/0,1 mode: PW/PW res: [0x2bc62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234600:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c53ac3 lrc: 2/0,0 mode: PW/PW res: [0x2bc62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.234607:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+81:39029:x1731745946622208:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 77us (144us total) trans 12885081064 rc 0/0 00000100:00100000:1.0:1651529467.234611:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213060 00000100:00100000:1.0:1651529467.234616:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213062 00000100:00100000:1.0:1651529467.234618:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+80:39029:x1731745946622272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.234623:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179260 count 1 00002000:00010000:1.0:1651529467.234627:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.234629:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c53aca lrc: 3/0,1 mode: --/PW res: [0x2bc3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234632:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.234633:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.234634:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c53aca lrc: 3/0,1 mode: PW/PW res: [0x2bc3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234638:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c53aca lrc: 3/0,1 mode: PW/PW res: [0x2bc3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234640:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c53aca lrc: 3/0,1 mode: PW/PW res: [0x2bc3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.234640:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007f9b0c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+81:39030:x1731745946622336:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 75us (165us total) trans 12885081065 rc 0/0 00010000:00010000:1.0:1651529467.234643:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c53aca lrc: 2/0,0 mode: PW/PW res: [0x2bc3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.234643:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213061 00000100:00100000:0.0:1651529467.234648:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213063 00000100:00100000:0.0:1651529467.234649:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+80:39030:x1731745946622464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.234654:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179419 count 1 00002000:00010000:0.0:1651529467.234658:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcdb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.234660:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c53ad1 lrc: 3/0,1 mode: --/PW res: [0x2bcdb:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234663:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.234664:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.234665:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c53ad1 lrc: 3/0,1 mode: PW/PW res: [0x2bcdb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234668:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c53ad1 lrc: 3/0,1 mode: PW/PW res: [0x2bcdb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234671:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c53ad1 lrc: 3/0,1 mode: PW/PW res: [0x2bcdb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234674:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c53ad1 lrc: 2/0,0 mode: PW/PW res: [0x2bcdb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.234678:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+81:39029:x1731745946622272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 59us (194us total) trans 12885081066 rc 0/0 00000100:00100000:1.0:1651529467.234681:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213062 00000100:00100000:1.0:1651529467.234686:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213064 00000100:00100000:1.0:1651529467.234687:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000056e45ef2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+80:39029:x1731745946622400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.234691:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179178 count 1 00002000:00010000:1.0:1651529467.234696:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.234697:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53ad8 lrc: 3/0,1 mode: --/PW res: [0x2bbea:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234701:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.234701:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.234702:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53ad8 lrc: 3/0,1 mode: PW/PW res: [0x2bbea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234706:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53ad8 lrc: 3/0,1 mode: PW/PW res: [0x2bbea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.234707:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+81:39030:x1731745946622464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 56us (216us total) trans 12885081067 rc 0/0 00010000:00010000:1.0:1651529467.234709:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53ad8 lrc: 3/0,1 mode: PW/PW res: [0x2bbea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.234709:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213063 00010000:00010000:1.0:1651529467.234711:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53ad8 lrc: 2/0,0 mode: PW/PW res: [0x2bbea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.234714:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213065 00000100:00100000:0.0:1651529467.234716:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9b0314b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+80:39030:x1731745946622592:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.234719:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179322 count 1 00002000:00010000:0.0:1651529467.234724:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc7a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.234725:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c53adf lrc: 3/0,1 mode: --/PW res: [0x2bc7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234728:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.234729:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.234730:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c53adf lrc: 3/0,1 mode: PW/PW res: [0x2bc7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234733:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c53adf lrc: 3/0,1 mode: PW/PW res: [0x2bc7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234739:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c53adf lrc: 3/0,1 mode: PW/PW res: [0x2bc7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234741:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c53adf lrc: 2/0,0 mode: PW/PW res: [0x2bc7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.234742:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000056e45ef2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+81:39029:x1731745946622400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 54us (245us total) trans 12885081068 rc 0/0 00000100:00100000:1.0:1651529467.234745:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213064 00000100:00100000:1.0:1651529467.234750:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213066 00000100:00100000:1.0:1651529467.234751:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5ebc6ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+80:39029:x1731745946622528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.234755:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179359 count 1 00002000:00010000:1.0:1651529467.234760:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc9f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.234761:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c53ae6 lrc: 3/0,1 mode: --/PW res: [0x2bc9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234764:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.234765:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.234766:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c53ae6 lrc: 3/0,1 mode: PW/PW res: [0x2bc9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234769:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c53ae6 lrc: 3/0,1 mode: PW/PW res: [0x2bc9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234772:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c53ae6 lrc: 3/0,1 mode: PW/PW res: [0x2bc9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.234773:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9b0314b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+81:39030:x1731745946622592:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 57us (257us total) trans 12885081069 rc 0/0 00010000:00010000:1.0:1651529467.234775:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c53ae6 lrc: 2/0,0 mode: PW/PW res: [0x2bc9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.234776:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213065 00000100:00100000:0.0:1651529467.234780:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213067 00000100:00100000:0.0:1651529467.234782:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068b6c75f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+80:39029:x1731745946622656:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.234786:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179347 count 1 00002000:00010000:0.0:1651529467.234790:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc93:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.234792:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c53aed lrc: 3/0,1 mode: --/PW res: [0x2bc93:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234795:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.234795:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.234796:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c53aed lrc: 3/0,1 mode: PW/PW res: [0x2bc93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234810:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c53aed lrc: 3/0,1 mode: PW/PW res: [0x2bc93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234814:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c53aed lrc: 3/0,1 mode: PW/PW res: [0x2bc93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.234817:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5ebc6ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+81:39029:x1731745946622528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 65us (282us total) trans 12885081070 rc 0/0 00010000:00010000:0.0:1651529467.234819:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c53aed lrc: 2/0,0 mode: PW/PW res: [0x2bc93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.234820:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213066 00010000:00010000:1.0:1651529467.234828:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c53abc lrc: 2/0,0 mode: PW/PW res: [0x2bbfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234831:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c822bd1c already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.234832:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c53abc lrc: 2/0,0 mode: PW/PW res: [0x2bbfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234835:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c53abc lrc: 3/0,0 mode: PW/PW res: [0x2bbfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234839:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c53abc lrc: 1/0,0 mode: --/PW res: [0x2bbfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234845:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c53abc lrc: 0/0,0 mode: --/PW res: [0x2bbfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234849:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c53ac3 lrc: 2/0,0 mode: PW/PW res: [0x2bc62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234851:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000003af78ab already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.234852:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c53ac3 lrc: 2/0,0 mode: PW/PW res: [0x2bc62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.234853:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068b6c75f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+81:39029:x1731745946622656:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 70us (308us total) trans 12885081071 rc 0/0 00010000:00010000:1.0:1651529467.234855:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c53ac3 lrc: 3/0,0 mode: PW/PW res: [0x2bc62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.234856:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213067 00010000:00010000:1.0:1651529467.234858:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c53ac3 lrc: 1/0,0 mode: --/PW res: [0x2bc62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234861:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c53ac3 lrc: 0/0,0 mode: --/PW res: [0x2bc62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234864:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c53aca lrc: 2/0,0 mode: PW/PW res: [0x2bc3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234865:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c53ad1 lrc: 2/0,0 mode: PW/PW res: [0x2bcdb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234867:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005b8e72f9 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.234867:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c53aca lrc: 2/0,0 mode: PW/PW res: [0x2bc3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234869:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007c1cad42 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.234870:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c53ad1 lrc: 2/0,0 mode: PW/PW res: [0x2bcdb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234873:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c53aca lrc: 3/0,0 mode: PW/PW res: [0x2bc3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234873:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c53ad1 lrc: 3/0,0 mode: PW/PW res: [0x2bcdb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234876:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c53aca lrc: 1/0,0 mode: --/PW res: [0x2bc3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234877:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c53ad1 lrc: 1/0,0 mode: --/PW res: [0x2bcdb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234878:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c53aca lrc: 0/0,0 mode: --/PW res: [0x2bc3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234880:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c53ad1 lrc: 0/0,0 mode: --/PW res: [0x2bcdb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234882:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53ad8 lrc: 2/0,0 mode: PW/PW res: [0x2bbea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234884:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000916cff2 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.234885:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53ad8 lrc: 2/0,0 mode: PW/PW res: [0x2bbea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234885:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c53adf lrc: 2/0,0 mode: PW/PW res: [0x2bc7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234887:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53ad8 lrc: 3/0,0 mode: PW/PW res: [0x2bbea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234887:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004f367ded already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.234889:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c53adf lrc: 2/0,0 mode: PW/PW res: [0x2bc7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234890:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53ad8 lrc: 1/0,0 mode: --/PW res: [0x2bbea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234891:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c53adf lrc: 3/0,0 mode: PW/PW res: [0x2bc7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234893:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53ad8 lrc: 0/0,0 mode: --/PW res: [0x2bbea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234895:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c53adf lrc: 1/0,0 mode: --/PW res: [0x2bc7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234896:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c53ae6 lrc: 2/0,0 mode: PW/PW res: [0x2bc9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234897:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c53adf lrc: 0/0,0 mode: --/PW res: [0x2bc7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234900:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c53aed lrc: 2/0,0 mode: PW/PW res: [0x2bc93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234902:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000096ab8041 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.234903:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c53ae6 lrc: 2/0,0 mode: PW/PW res: [0x2bc9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234903:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001ea46bb1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.234904:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c53aed lrc: 2/0,0 mode: PW/PW res: [0x2bc93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234905:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c53ae6 lrc: 3/0,0 mode: PW/PW res: [0x2bc9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234906:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c53aed lrc: 3/0,0 mode: PW/PW res: [0x2bc93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234909:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c53ae6 lrc: 1/0,0 mode: --/PW res: [0x2bc9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234909:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c53aed lrc: 1/0,0 mode: --/PW res: [0x2bc93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.234911:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c53ae6 lrc: 0/0,0 mode: --/PW res: [0x2bc9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.234912:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c53aed lrc: 0/0,0 mode: --/PW res: [0x2bc93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.235302:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.235319:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946623296 00000100:00100000:1.0:1651529467.235328:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213068 00000100:00100000:1.0:1651529467.235330:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055050f08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+81:39029:x1731745946623296:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529467.235338:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529467.235341:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179400 count 1 00002000:00010000:1.0:1651529467.235347:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcc8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.235349:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c53af4 lrc: 3/0,1 mode: --/PW res: [0x2bcc8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235352:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.235353:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.235354:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c53af4 lrc: 3/0,1 mode: PW/PW res: [0x2bcc8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235357:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c53af4 lrc: 3/0,1 mode: PW/PW res: [0x2bcc8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235361:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c53af4 lrc: 3/0,1 mode: PW/PW res: [0x2bcc8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235363:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c53af4 lrc: 2/0,0 mode: PW/PW res: [0x2bcc8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.235368:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.235376:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.235382:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.235388:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.235394:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.235401:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.235407:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946623232 00000100:00100000:1.0:1651529467.235413:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055050f08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+83:39029:x1731745946623296:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 82us (111us total) trans 12885081072 rc 0/0 00000100:00100000:0.0:1651529467.235414:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946623360 00000100:00100000:1.0:1651529467.235416:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213068 00000100:00100000:0.0:1651529467.235417:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946623424 00000100:00100000:0.0:1651529467.235423:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946623552 00000100:00100000:0.0:1651529467.235426:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946623680 00000100:00100000:0.0:1651529467.235428:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946623488 00000100:00100000:0.0:1651529467.235430:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946623616 00000100:00100000:0.0:1651529467.235433:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213069 00000100:00100000:0.0:1651529467.235435:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df603127 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+88:39030:x1731745946623232:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.235440:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179250 count 1 00000100:00100000:1.0:1651529467.235444:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213070 00000100:00100000:1.0:1651529467.235445:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000020362888 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+88:39030:x1731745946623360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00010000:0.0:1651529467.235446:0:106695:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.235448:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c53afb lrc: 3/0,1 mode: --/PW res: [0x2bc32:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529467.235450:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179304 count 1 00010000:00010000:0.0:1651529467.235452:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.235452:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.235453:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c53afb lrc: 3/0,1 mode: PW/PW res: [0x2bc32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.235455:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc68:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.235457:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c53b02 lrc: 3/0,1 mode: --/PW res: [0x2bc68:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235457:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c53afb lrc: 3/0,1 mode: PW/PW res: [0x2bc32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235460:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.235460:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c53afb lrc: 3/0,1 mode: PW/PW res: [0x2bc32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235461:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.235462:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c53b02 lrc: 3/0,1 mode: PW/PW res: [0x2bc68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235463:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c53afb lrc: 2/0,0 mode: PW/PW res: [0x2bc32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235466:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c53b02 lrc: 3/0,1 mode: PW/PW res: [0x2bc68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235468:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c53b02 lrc: 3/0,1 mode: PW/PW res: [0x2bc68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235474:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c53b02 lrc: 2/0,0 mode: PW/PW res: [0x2bc68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.235511:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df603127 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+90:39030:x1731745946623232:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 75us (173us total) trans 12885081073 rc 0/0 00000100:00100000:0.0:1651529467.235514:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213069 00000100:00100000:1.0:1651529467.235515:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000020362888 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+90:39030:x1731745946623360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 69us (147us total) trans 12885081074 rc 0/0 00000100:00100000:1.0:1651529467.235518:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213070 00000100:00100000:0.0:1651529467.235520:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213071 00000100:00100000:0.0:1651529467.235522:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+88:39029:x1731745946623424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529467.235524:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213072 00000100:00100000:1.0:1651529467.235526:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+88:39029:x1731745946623552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.235526:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179182 count 1 00002000:00080000:1.0:1651529467.235530:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179369 count 1 00002000:00010000:0.0:1651529467.235531:0:106695:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.235532:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c53b09 lrc: 3/0,1 mode: --/PW res: [0x2bbee:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.235535:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bca9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.235536:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c53b10 lrc: 3/0,1 mode: --/PW res: [0x2bca9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235536:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.235537:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.235537:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c53b09 lrc: 3/0,1 mode: PW/PW res: [0x2bbee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235540:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.235540:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.235541:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c53b10 lrc: 3/0,1 mode: PW/PW res: [0x2bca9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235541:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c53b09 lrc: 3/0,1 mode: PW/PW res: [0x2bbee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235544:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c53b09 lrc: 3/0,1 mode: PW/PW res: [0x2bbee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235545:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c53b10 lrc: 3/0,1 mode: PW/PW res: [0x2bca9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235547:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c53b09 lrc: 2/0,0 mode: PW/PW res: [0x2bbee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235548:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c53b10 lrc: 3/0,1 mode: PW/PW res: [0x2bca9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235550:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c53b10 lrc: 2/0,0 mode: PW/PW res: [0x2bca9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.235582:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+90:39029:x1731745946623424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 59us (206us total) trans 12885081075 rc 0/0 00000100:00100000:1.0:1651529467.235585:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+90:39029:x1731745946623552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 58us (202us total) trans 12885081076 rc 0/0 00000100:00100000:0.0:1651529467.235585:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213071 00000100:00100000:1.0:1651529467.235588:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213072 00000100:00100000:0.0:1651529467.235590:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213073 00000100:00100000:0.0:1651529467.235591:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+88:39029:x1731745946623680:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529467.235593:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213074 00000100:00100000:1.0:1651529467.235594:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+88:39029:x1731745946623488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.235596:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179372 count 1 00002000:00080000:1.0:1651529467.235599:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179361 count 1 00002000:00010000:0.0:1651529467.235600:0:106695:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.235601:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c53b17 lrc: 3/0,1 mode: --/PW res: [0x2bcac:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.235604:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bca1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.235605:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c53b1e lrc: 3/0,1 mode: --/PW res: [0x2bca1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235605:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.235605:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.235606:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c53b17 lrc: 3/0,1 mode: PW/PW res: [0x2bcac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235608:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.235609:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.235610:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c53b1e lrc: 3/0,1 mode: PW/PW res: [0x2bca1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235610:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c53b17 lrc: 3/0,1 mode: PW/PW res: [0x2bcac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235613:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c53b1e lrc: 3/0,1 mode: PW/PW res: [0x2bca1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235613:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c53b17 lrc: 3/0,1 mode: PW/PW res: [0x2bcac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235615:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c53b17 lrc: 2/0,0 mode: PW/PW res: [0x2bcac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235616:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c53b1e lrc: 3/0,1 mode: PW/PW res: [0x2bca1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235619:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c53b1e lrc: 2/0,0 mode: PW/PW res: [0x2bca1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.235646:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+90:39029:x1731745946623680:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 54us (258us total) trans 12885081077 rc 0/0 00000100:00100000:1.0:1651529467.235650:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+90:39029:x1731745946623488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 54us (255us total) trans 12885081078 rc 0/0 00000100:00100000:0.0:1651529467.235651:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213073 00000100:00100000:1.0:1651529467.235654:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213074 00000100:00100000:0.0:1651529467.235656:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213075 00000100:00100000:0.0:1651529467.235658:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+88:39029:x1731745946623616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529467.235662:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c53af4 lrc: 2/0,0 mode: PW/PW res: [0x2bcc8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529467.235662:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179247 count 1 00010000:00010000:1.0:1651529467.235665:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042bde05b already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.235666:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c53af4 lrc: 2/0,0 mode: PW/PW res: [0x2bcc8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.235666:0:106695:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.235668:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c53b25 lrc: 3/0,1 mode: --/PW res: [0x2bc2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235669:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c53af4 lrc: 3/0,0 mode: PW/PW res: [0x2bcc8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235671:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.235672:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.235673:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c53af4 lrc: 1/0,0 mode: --/PW res: [0x2bcc8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235673:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c53b25 lrc: 3/0,1 mode: PW/PW res: [0x2bc2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235676:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c53af4 lrc: 0/0,0 mode: --/PW res: [0x2bcc8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235676:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c53b25 lrc: 3/0,1 mode: PW/PW res: [0x2bc2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235679:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c53b25 lrc: 3/0,1 mode: PW/PW res: [0x2bc2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235680:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c53afb lrc: 2/0,0 mode: PW/PW res: [0x2bc32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235682:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c53b25 lrc: 2/0,0 mode: PW/PW res: [0x2bc2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235683:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2d8d18b already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.235684:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c53afb lrc: 2/0,0 mode: PW/PW res: [0x2bc32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235687:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c53afb lrc: 3/0,0 mode: PW/PW res: [0x2bc32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235692:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c53afb lrc: 1/0,0 mode: --/PW res: [0x2bc32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235695:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c53afb lrc: 0/0,0 mode: --/PW res: [0x2bc32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235698:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c53b02 lrc: 2/0,0 mode: PW/PW res: [0x2bc68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235701:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005e711cee already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.235702:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c53b02 lrc: 2/0,0 mode: PW/PW res: [0x2bc68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235704:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c53b02 lrc: 3/0,0 mode: PW/PW res: [0x2bc68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235707:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c53b02 lrc: 1/0,0 mode: --/PW res: [0x2bc68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235710:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c53b02 lrc: 0/0,0 mode: --/PW res: [0x2bc68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.235712:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+89:39029:x1731745946623616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 53us (311us total) trans 12885081079 rc 0/0 00010000:00010000:1.0:1651529467.235713:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c53b09 lrc: 2/0,0 mode: PW/PW res: [0x2bbee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.235714:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213075 00010000:00010000:1.0:1651529467.235715:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000baeec0a3 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.235716:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c53b09 lrc: 2/0,0 mode: PW/PW res: [0x2bbee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235719:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c53b09 lrc: 3/0,0 mode: PW/PW res: [0x2bbee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235722:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c53b09 lrc: 1/0,0 mode: --/PW res: [0x2bbee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235724:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c53b10 lrc: 2/0,0 mode: PW/PW res: [0x2bca9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235725:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c53b09 lrc: 0/0,0 mode: --/PW res: [0x2bbee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235728:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c53b17 lrc: 2/0,0 mode: PW/PW res: [0x2bcac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235730:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005c863cd2 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.235731:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000062f8a534 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.235731:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c53b10 lrc: 2/0,0 mode: PW/PW res: [0x2bca9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235732:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c53b17 lrc: 2/0,0 mode: PW/PW res: [0x2bcac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235734:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c53b17 lrc: 3/0,0 mode: PW/PW res: [0x2bcac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235734:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c53b10 lrc: 3/0,0 mode: PW/PW res: [0x2bca9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235737:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c53b17 lrc: 1/0,0 mode: --/PW res: [0x2bcac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235738:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c53b10 lrc: 1/0,0 mode: --/PW res: [0x2bca9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235740:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c53b17 lrc: 0/0,0 mode: --/PW res: [0x2bcac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235741:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c53b10 lrc: 0/0,0 mode: --/PW res: [0x2bca9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235743:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c53b1e lrc: 2/0,0 mode: PW/PW res: [0x2bca1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235745:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c53b25 lrc: 2/0,0 mode: PW/PW res: [0x2bc2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235746:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054295afd already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.235747:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c53b1e lrc: 2/0,0 mode: PW/PW res: [0x2bca1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235748:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba437fe0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.235749:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c53b25 lrc: 2/0,0 mode: PW/PW res: [0x2bc2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235750:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c53b1e lrc: 3/0,0 mode: PW/PW res: [0x2bca1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235752:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c53b25 lrc: 3/0,0 mode: PW/PW res: [0x2bc2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235753:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c53b1e lrc: 1/0,0 mode: --/PW res: [0x2bca1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.235755:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c53b1e lrc: 0/0,0 mode: --/PW res: [0x2bca1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235755:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c53b25 lrc: 1/0,0 mode: --/PW res: [0x2bc2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.235757:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c53b25 lrc: 0/0,0 mode: --/PW res: [0x2bc2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.236026:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.236045:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946624256 00000100:00100000:1.0:1651529467.236053:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213076 00000100:00100000:1.0:1651529467.236055:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+89:39030:x1731745946624256:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.236060:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179404 count 1 00002000:00010000:1.0:1651529467.236066:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bccc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.236067:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c53b2c lrc: 3/0,1 mode: --/PW res: [0x2bccc:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236070:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.236071:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.236072:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c53b2c lrc: 3/0,1 mode: PW/PW res: [0x2bccc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236075:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c53b2c lrc: 3/0,1 mode: PW/PW res: [0x2bccc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236079:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c53b2c lrc: 3/0,1 mode: PW/PW res: [0x2bccc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236081:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c53b2c lrc: 2/0,0 mode: PW/PW res: [0x2bccc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.236139:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+90:39030:x1731745946624256:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 83us (113us total) trans 12885081080 rc 0/0 00000100:00100000:1.0:1651529467.236142:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213076 00010000:00010000:1.0:1651529467.236150:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c53b2c lrc: 2/0,0 mode: PW/PW res: [0x2bccc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236153:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f3240ce7 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.236154:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c53b2c lrc: 2/0,0 mode: PW/PW res: [0x2bccc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236157:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c53b2c lrc: 3/0,0 mode: PW/PW res: [0x2bccc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.236165:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529467.236173:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c53b2c lrc: 1/0,0 mode: --/PW res: [0x2bccc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236177:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c53b2c lrc: 0/0,0 mode: --/PW res: [0x2bccc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.236199:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.236209:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.236210:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946624320 00000100:00100000:1.0:1651529467.236218:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.236238:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.236247:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.236247:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946624448 00000100:00100000:1.0:1651529467.236256:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.236256:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946624384 00000100:00100000:1.0:1651529467.236266:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946624576 00000100:00100000:0.0:1651529467.236267:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946624512 00000100:00100000:1.0:1651529467.236272:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946624640 00000100:00100000:0.0:1651529467.236272:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946624704 00000100:00100000:0.0:1651529467.236276:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213077 00000100:00100000:0.0:1651529467.236278:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+96:39029:x1731745946624320:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529467.236280:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213078 00000100:00100000:1.0:1651529467.236282:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+96:39029:x1731745946624448:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.236283:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179294 count 1 00002000:00080000:1.0:1651529467.236287:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179417 count 1 00002000:00010000:1.0:1651529467.236293:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcd9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.236294:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c53b3a lrc: 3/0,1 mode: --/PW res: [0x2bcd9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236298:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.236298:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.236299:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c53b3a lrc: 3/0,1 mode: PW/PW res: [0x2bcd9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236303:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c53b3a lrc: 3/0,1 mode: PW/PW res: [0x2bcd9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.236305:0:80281:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc5e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.236306:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c53b3a lrc: 3/0,1 mode: PW/PW res: [0x2bcd9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236308:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c53b3a lrc: 2/0,0 mode: PW/PW res: [0x2bcd9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236308:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53b33 lrc: 3/0,1 mode: --/PW res: [0x2bc5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236312:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.236312:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.236313:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53b33 lrc: 3/0,1 mode: PW/PW res: [0x2bc5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236323:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53b33 lrc: 3/0,1 mode: PW/PW res: [0x2bc5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236326:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53b33 lrc: 3/0,1 mode: PW/PW res: [0x2bc5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236329:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53b33 lrc: 2/0,0 mode: PW/PW res: [0x2bc5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.236351:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+98:39029:x1731745946624448:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 68us (152us total) trans 12885081081 rc 0/0 00000100:00100000:1.0:1651529467.236354:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213078 00000100:00100000:1.0:1651529467.236359:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213079 00000100:00100000:1.0:1651529467.236361:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+97:39030:x1731745946624384:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.236365:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179209 count 1 00002000:00010000:1.0:1651529467.236370:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc09:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1651529467.236371:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+97:39029:x1731745946624320:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 92us (206us total) trans 12885081082 rc 0/0 00010000:00010000:1.0:1651529467.236372:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c53b41 lrc: 3/0,1 mode: --/PW res: [0x2bc09:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.236374:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213077 00010000:00010000:1.0:1651529467.236375:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.236376:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.236377:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c53b41 lrc: 3/0,1 mode: PW/PW res: [0x2bc09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.236379:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213080 00010000:00010000:1.0:1651529467.236380:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c53b41 lrc: 3/0,1 mode: PW/PW res: [0x2bc09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.236381:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+96:39029:x1731745946624576:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529467.236383:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c53b41 lrc: 3/0,1 mode: PW/PW res: [0x2bc09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529467.236385:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179328 count 1 00010000:00010000:1.0:1651529467.236386:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c53b41 lrc: 2/0,0 mode: PW/PW res: [0x2bc09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.236391:0:80281:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc80:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.236392:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c53b48 lrc: 3/0,1 mode: --/PW res: [0x2bc80:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236396:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.236396:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.236397:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c53b48 lrc: 3/0,1 mode: PW/PW res: [0x2bc80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236401:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c53b48 lrc: 3/0,1 mode: PW/PW res: [0x2bc80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236404:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c53b48 lrc: 3/0,1 mode: PW/PW res: [0x2bc80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236406:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c53b48 lrc: 2/0,0 mode: PW/PW res: [0x2bc80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.236421:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+98:39030:x1731745946624384:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 59us (211us total) trans 12885081083 rc 0/0 00000100:00100000:1.0:1651529467.236424:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213079 00000100:00100000:1.0:1651529467.236429:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213081 00000100:00100000:1.0:1651529467.236430:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+97:39030:x1731745946624512:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.236435:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179220 count 1 00002000:00010000:1.0:1651529467.236439:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1651529467.236440:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+97:39029:x1731745946624576:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 58us (221us total) trans 12885081084 rc 0/0 00010000:00010000:1.0:1651529467.236441:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c53b4f lrc: 3/0,1 mode: --/PW res: [0x2bc14:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236444:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529467.236444:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213080 00010000:00010000:1.0:1651529467.236445:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.236446:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c53b4f lrc: 3/0,1 mode: PW/PW res: [0x2bc14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.236449:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213082 00010000:00010000:1.0:1651529467.236450:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c53b4f lrc: 3/0,1 mode: PW/PW res: [0x2bc14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.236450:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+96:39029:x1731745946624704:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529467.236452:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c53b4f lrc: 3/0,1 mode: PW/PW res: [0x2bc14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236455:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c53b4f lrc: 2/0,0 mode: PW/PW res: [0x2bc14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529467.236455:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179194 count 1 00002000:00010000:0.0:1651529467.236459:0:80281:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbfa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.236461:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53b56 lrc: 3/0,1 mode: --/PW res: [0x2bbfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236464:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.236465:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.236466:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53b56 lrc: 3/0,1 mode: PW/PW res: [0x2bbfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236469:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53b56 lrc: 3/0,1 mode: PW/PW res: [0x2bbfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236472:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53b56 lrc: 3/0,1 mode: PW/PW res: [0x2bbfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236475:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53b56 lrc: 2/0,0 mode: PW/PW res: [0x2bbfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.236487:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+97:39030:x1731745946624512:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 56us (248us total) trans 12885081085 rc 0/0 00000100:00100000:1.0:1651529467.236490:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213081 00000100:00100000:1.0:1651529467.236495:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213083 00000100:00100000:1.0:1651529467.236496:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+97:39030:x1731745946624640:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.236500:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179214 count 1 00002000:00010000:1.0:1651529467.236505:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc0e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.236506:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c53b5d lrc: 3/0,1 mode: --/PW res: [0x2bc0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.236507:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+97:39029:x1731745946624704:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 56us (260us total) trans 12885081086 rc 0/0 00010000:00010000:1.0:1651529467.236510:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529467.236510:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213082 00010000:00010000:1.0:1651529467.236511:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.236511:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c53b5d lrc: 3/0,1 mode: PW/PW res: [0x2bc0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236515:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c53b5d lrc: 3/0,1 mode: PW/PW res: [0x2bc0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236518:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c53b5d lrc: 3/0,1 mode: PW/PW res: [0x2bc0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236520:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c53b5d lrc: 2/0,0 mode: PW/PW res: [0x2bc0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236522:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c53b3a lrc: 2/0,0 mode: PW/PW res: [0x2bcd9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236528:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000029e40f3d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.236529:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c53b3a lrc: 2/0,0 mode: PW/PW res: [0x2bcd9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236532:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c53b3a lrc: 3/0,0 mode: PW/PW res: [0x2bcd9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236536:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c53b3a lrc: 1/0,0 mode: --/PW res: [0x2bcd9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236539:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c53b3a lrc: 0/0,0 mode: --/PW res: [0x2bcd9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236543:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53b33 lrc: 2/0,0 mode: PW/PW res: [0x2bc5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236546:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004b2a6b06 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.236547:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53b33 lrc: 2/0,0 mode: PW/PW res: [0x2bc5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236549:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53b33 lrc: 3/0,0 mode: PW/PW res: [0x2bc5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.236552:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+97:39030:x1731745946624640:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 54us (295us total) trans 12885081087 rc 0/0 00010000:00010000:0.0:1651529467.236552:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53b33 lrc: 1/0,0 mode: --/PW res: [0x2bc5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.236554:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213083 00010000:00010000:0.0:1651529467.236555:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53b33 lrc: 0/0,0 mode: --/PW res: [0x2bc5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236559:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c53b41 lrc: 2/0,0 mode: PW/PW res: [0x2bc09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236562:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c53b48 lrc: 2/0,0 mode: PW/PW res: [0x2bc80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236562:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005532ef34 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.236562:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c53b41 lrc: 2/0,0 mode: PW/PW res: [0x2bc09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236565:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dd6b1be4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.236565:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c53b41 lrc: 3/0,0 mode: PW/PW res: [0x2bc09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236566:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c53b48 lrc: 2/0,0 mode: PW/PW res: [0x2bc80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236568:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c53b41 lrc: 1/0,0 mode: --/PW res: [0x2bc09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236569:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c53b48 lrc: 3/0,0 mode: PW/PW res: [0x2bc80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236570:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c53b41 lrc: 0/0,0 mode: --/PW res: [0x2bc09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236574:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c53b4f lrc: 2/0,0 mode: PW/PW res: [0x2bc14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236576:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c53b48 lrc: 1/0,0 mode: --/PW res: [0x2bc80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236577:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f10dea8 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.236577:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c53b4f lrc: 2/0,0 mode: PW/PW res: [0x2bc14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236579:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c53b48 lrc: 0/0,0 mode: --/PW res: [0x2bc80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236580:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c53b4f lrc: 3/0,0 mode: PW/PW res: [0x2bc14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236583:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53b56 lrc: 2/0,0 mode: PW/PW res: [0x2bbfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236583:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c53b4f lrc: 1/0,0 mode: --/PW res: [0x2bc14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236586:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000014fe598c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.236586:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c53b4f lrc: 0/0,0 mode: --/PW res: [0x2bc14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236587:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53b56 lrc: 2/0,0 mode: PW/PW res: [0x2bbfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236589:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c53b5d lrc: 2/0,0 mode: PW/PW res: [0x2bc0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236590:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53b56 lrc: 3/0,0 mode: PW/PW res: [0x2bbfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236592:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000087f212ed already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.236593:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53b56 lrc: 1/0,0 mode: --/PW res: [0x2bbfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236593:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c53b5d lrc: 2/0,0 mode: PW/PW res: [0x2bc0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236595:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53b56 lrc: 0/0,0 mode: --/PW res: [0x2bbfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236595:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c53b5d lrc: 3/0,0 mode: PW/PW res: [0x2bc0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236599:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c53b5d lrc: 1/0,0 mode: --/PW res: [0x2bc0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.236601:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c53b5d lrc: 0/0,0 mode: --/PW res: [0x2bc0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.236609:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.236620:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946624768 00000100:00100000:1.0:1651529467.236636:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213084 00000100:00100000:1.0:1651529467.236638:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+97:39030:x1731745946624768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.236644:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179386 count 1 00002000:00010000:1.0:1651529467.236649:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.236651:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c53b64 lrc: 3/0,1 mode: --/PW res: [0x2bcba:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236660:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.236660:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.236661:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c53b64 lrc: 3/0,1 mode: PW/PW res: [0x2bcba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236665:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c53b64 lrc: 3/0,1 mode: PW/PW res: [0x2bcba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236692:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c53b64 lrc: 3/0,1 mode: PW/PW res: [0x2bcba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236696:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c53b64 lrc: 2/0,0 mode: PW/PW res: [0x2bcba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.236740:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+98:39030:x1731745946624768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 101us (130us total) trans 12885081088 rc 0/0 00000100:00100000:1.0:1651529467.236743:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213084 00010000:00010000:1.0:1651529467.236750:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c53b64 lrc: 2/0,0 mode: PW/PW res: [0x2bcba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236754:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001644aaad already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.236755:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c53b64 lrc: 2/0,0 mode: PW/PW res: [0x2bcba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236768:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c53b64 lrc: 3/0,0 mode: PW/PW res: [0x2bcba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236773:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c53b64 lrc: 1/0,0 mode: --/PW res: [0x2bcba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.236775:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c53b64 lrc: 0/0,0 mode: --/PW res: [0x2bcba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.236936:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.236956:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946625408 00000100:00100000:1.0:1651529467.236964:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213085 00000100:00100000:0.0:1651529467.236967:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.236974:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+98:39030:x1731745946625408:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529467.236975:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529467.236979:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179416 count 1 00000100:00100000:0.0:1651529467.236981:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00010000:1.0:1651529467.236985:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcd8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.236986:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a1913b4/0x3234de053c53b6b lrc: 3/0,1 mode: --/PW res: [0x2bcd8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.236987:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529467.236990:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.236990:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.236991:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a1913b4/0x3234de053c53b6b lrc: 3/0,1 mode: PW/PW res: [0x2bcd8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.236993:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529467.236995:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a1913b4/0x3234de053c53b6b lrc: 3/0,1 mode: PW/PW res: [0x2bcd8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.237002:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529467.237004:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a1913b4/0x3234de053c53b6b lrc: 3/0,1 mode: PW/PW res: [0x2bcd8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237009:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a1913b4/0x3234de053c53b6b lrc: 2/0,0 mode: PW/PW res: [0x2bcd8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.237010:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.237022:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946625344 00000100:00100000:0.0:1651529467.237028:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946625536 00000100:00100000:0.0:1651529467.237031:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946625664 00000100:00100000:0.0:1651529467.237034:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946625472 00000100:00100000:0.0:1651529467.237037:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946625600 00000100:00100000:0.0:1651529467.237039:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946625728 00000100:00100000:0.0:1651529467.237041:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946625792 00000100:00100000:0.0:1651529467.237044:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213086 00000100:00100000:0.0:1651529467.237046:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+106:39029:x1731745946625344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.237051:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179217 count 1 00000100:00100000:1.0:1651529467.237053:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+106:39030:x1731745946625408:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 86us (138us total) trans 12885081089 rc 0/0 00000100:00100000:1.0:1651529467.237056:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213085 00002000:00010000:0.0:1651529467.237057:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.237058:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c53b72 lrc: 3/0,1 mode: --/PW res: [0x2bc11:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.237061:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213087 00010000:00010000:0.0:1651529467.237062:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529467.237063:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+105:39030:x1731745946625536:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529467.237063:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.237064:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c53b72 lrc: 3/0,1 mode: PW/PW res: [0x2bc11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529467.237067:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179218 count 1 00010000:00010000:0.0:1651529467.237067:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c53b72 lrc: 3/0,1 mode: PW/PW res: [0x2bc11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237070:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c53b72 lrc: 3/0,1 mode: PW/PW res: [0x2bc11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.237072:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.237073:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c53b79 lrc: 3/0,1 mode: --/PW res: [0x2bc12:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237073:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c53b72 lrc: 2/0,0 mode: PW/PW res: [0x2bc11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237077:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.237077:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.237078:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c53b79 lrc: 3/0,1 mode: PW/PW res: [0x2bc12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237082:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c53b79 lrc: 3/0,1 mode: PW/PW res: [0x2bc12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237085:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c53b79 lrc: 3/0,1 mode: PW/PW res: [0x2bc12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237087:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c53b79 lrc: 2/0,0 mode: PW/PW res: [0x2bc12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.237113:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+107:39029:x1731745946625344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 66us (145us total) trans 12885081090 rc 0/0 00000100:00100000:0.0:1651529467.237117:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213086 00000100:00100000:0.0:1651529467.237123:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213088 00000100:00100000:0.0:1651529467.237124:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+106:39030:x1731745946625664:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529467.237125:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+106:39030:x1731745946625536:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 61us (149us total) trans 12885081091 rc 0/0 00000100:00100000:1.0:1651529467.237128:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213087 00002000:00080000:0.0:1651529467.237129:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179287 count 1 00000100:00100000:1.0:1651529467.237133:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213089 00002000:00010000:0.0:1651529467.237133:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc57:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529467.237134:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+105:39029:x1731745946625472:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529467.237135:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c53b80 lrc: 3/0,1 mode: --/PW res: [0x2bc57:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237138:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1651529467.237139:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179276 count 1 00010000:00010000:0.0:1651529467.237139:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.237140:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c53b80 lrc: 3/0,1 mode: PW/PW res: [0x2bc57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.237143:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc4c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.237143:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c53b80 lrc: 3/0,1 mode: PW/PW res: [0x2bc57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237145:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a091a01a/0x3234de053c53b87 lrc: 3/0,1 mode: --/PW res: [0x2bc4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237146:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c53b80 lrc: 3/0,1 mode: PW/PW res: [0x2bc57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237148:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.237149:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.237149:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a091a01a/0x3234de053c53b87 lrc: 3/0,1 mode: PW/PW res: [0x2bc4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237149:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c53b80 lrc: 2/0,0 mode: PW/PW res: [0x2bc57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237153:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a091a01a/0x3234de053c53b87 lrc: 3/0,1 mode: PW/PW res: [0x2bc4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237156:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a091a01a/0x3234de053c53b87 lrc: 3/0,1 mode: PW/PW res: [0x2bc4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237158:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a091a01a/0x3234de053c53b87 lrc: 2/0,0 mode: PW/PW res: [0x2bc4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.237181:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+107:39030:x1731745946625664:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 55us (199us total) trans 12885081092 rc 0/0 00000100:00100000:0.0:1651529467.237183:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213088 00000100:00100000:0.0:1651529467.237188:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213090 00000100:00100000:0.0:1651529467.237189:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+106:39029:x1731745946625600:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529467.237191:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+106:39029:x1731745946625472:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 55us (203us total) trans 12885081093 rc 0/0 00002000:00080000:0.0:1651529467.237194:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179373 count 1 00000100:00100000:1.0:1651529467.237195:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213089 00002000:00010000:0.0:1651529467.237199:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529467.237200:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213091 00010000:00010000:0.0:1651529467.237200:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c53b8e lrc: 3/0,1 mode: --/PW res: [0x2bcad:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.237202:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+105:39029:x1731745946625728:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529467.237203:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.237204:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.237205:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c53b8e lrc: 3/0,1 mode: PW/PW res: [0x2bcad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529467.237206:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179256 count 1 00010000:00010000:0.0:1651529467.237208:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c53b8e lrc: 3/0,1 mode: PW/PW res: [0x2bcad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.237210:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.237211:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c53b8e lrc: 3/0,1 mode: PW/PW res: [0x2bcad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237212:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bb34145/0x3234de053c53b95 lrc: 3/0,1 mode: --/PW res: [0x2bc38:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237214:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c53b8e lrc: 2/0,0 mode: PW/PW res: [0x2bcad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237215:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.237216:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.237217:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002bb34145/0x3234de053c53b95 lrc: 3/0,1 mode: PW/PW res: [0x2bc38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237220:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002bb34145/0x3234de053c53b95 lrc: 3/0,1 mode: PW/PW res: [0x2bc38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237247:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bb34145/0x3234de053c53b95 lrc: 3/0,1 mode: PW/PW res: [0x2bc38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237250:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002bb34145/0x3234de053c53b95 lrc: 2/0,0 mode: PW/PW res: [0x2bc38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.237271:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+107:39029:x1731745946625600:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 80us (277us total) trans 12885081094 rc 0/0 00000100:00100000:0.0:1651529467.237274:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213090 00000100:00100000:0.0:1651529467.237279:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213092 00000100:00100000:0.0:1651529467.237280:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+106:39030:x1731745946625792:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529467.237285:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+106:39029:x1731745946625728:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 83us (282us total) trans 12885081095 rc 0/0 00002000:00080000:0.0:1651529467.237285:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179175 count 1 00000100:00100000:1.0:1651529467.237288:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213091 00002000:00010000:0.0:1651529467.237290:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbe7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.237291:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c53b9c lrc: 3/0,1 mode: --/PW res: [0x2bbe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237295:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a1913b4/0x3234de053c53b6b lrc: 2/0,0 mode: PW/PW res: [0x2bcd8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237295:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.237296:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.237296:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c53b9c lrc: 3/0,1 mode: PW/PW res: [0x2bbe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237300:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c53b9c lrc: 3/0,1 mode: PW/PW res: [0x2bbe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237301:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004a1913b4 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.237302:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a1913b4/0x3234de053c53b6b lrc: 2/0,0 mode: PW/PW res: [0x2bcd8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237303:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c53b9c lrc: 3/0,1 mode: PW/PW res: [0x2bbe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237305:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a1913b4/0x3234de053c53b6b lrc: 3/0,0 mode: PW/PW res: [0x2bcd8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237305:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c53b9c lrc: 2/0,0 mode: PW/PW res: [0x2bbe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237309:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a1913b4/0x3234de053c53b6b lrc: 1/0,0 mode: --/PW res: [0x2bcd8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237312:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a1913b4/0x3234de053c53b6b lrc: 0/0,0 mode: --/PW res: [0x2bcd8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237316:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c53b72 lrc: 2/0,0 mode: PW/PW res: [0x2bc11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237319:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000066921086 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.237320:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c53b72 lrc: 2/0,0 mode: PW/PW res: [0x2bc11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237322:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c53b72 lrc: 3/0,0 mode: PW/PW res: [0x2bc11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237325:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c53b72 lrc: 1/0,0 mode: --/PW res: [0x2bc11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237328:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c53b72 lrc: 0/0,0 mode: --/PW res: [0x2bc11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237332:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c53b79 lrc: 2/0,0 mode: PW/PW res: [0x2bc12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237334:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ac1d189d already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.237335:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c53b79 lrc: 2/0,0 mode: PW/PW res: [0x2bc12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237337:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c53b79 lrc: 3/0,0 mode: PW/PW res: [0x2bc12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.237338:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+106:39030:x1731745946625792:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 57us (328us total) trans 12885081096 rc 0/0 00010000:00010000:1.0:1651529467.237340:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c53b79 lrc: 1/0,0 mode: --/PW res: [0x2bc12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.237341:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213092 00010000:00010000:1.0:1651529467.237343:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c53b79 lrc: 0/0,0 mode: --/PW res: [0x2bc12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237346:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c53b80 lrc: 2/0,0 mode: PW/PW res: [0x2bc57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237349:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e48e0bfd already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.237350:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c53b80 lrc: 2/0,0 mode: PW/PW res: [0x2bc57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237352:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c53b80 lrc: 3/0,0 mode: PW/PW res: [0x2bc57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237352:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a091a01a/0x3234de053c53b87 lrc: 2/0,0 mode: PW/PW res: [0x2bc4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237355:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c53b80 lrc: 1/0,0 mode: --/PW res: [0x2bc57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237355:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a091a01a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.237356:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a091a01a/0x3234de053c53b87 lrc: 2/0,0 mode: PW/PW res: [0x2bc4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237358:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c53b80 lrc: 0/0,0 mode: --/PW res: [0x2bc57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237359:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a091a01a/0x3234de053c53b87 lrc: 3/0,0 mode: PW/PW res: [0x2bc4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237362:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c53b8e lrc: 2/0,0 mode: PW/PW res: [0x2bcad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237364:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000feb9d3da already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.237365:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c53b8e lrc: 2/0,0 mode: PW/PW res: [0x2bcad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237366:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a091a01a/0x3234de053c53b87 lrc: 1/0,0 mode: --/PW res: [0x2bc4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237368:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c53b8e lrc: 3/0,0 mode: PW/PW res: [0x2bcad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237369:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a091a01a/0x3234de053c53b87 lrc: 0/0,0 mode: --/PW res: [0x2bc4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237371:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c53b8e lrc: 1/0,0 mode: --/PW res: [0x2bcad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237373:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c53b8e lrc: 0/0,0 mode: --/PW res: [0x2bcad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237373:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002bb34145/0x3234de053c53b95 lrc: 2/0,0 mode: PW/PW res: [0x2bc38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237376:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c53b9c lrc: 2/0,0 mode: PW/PW res: [0x2bbe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237376:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002bb34145 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.237377:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002bb34145/0x3234de053c53b95 lrc: 2/0,0 mode: PW/PW res: [0x2bc38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237379:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bdf2b6c4 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.237380:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c53b9c lrc: 2/0,0 mode: PW/PW res: [0x2bbe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237380:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002bb34145/0x3234de053c53b95 lrc: 3/0,0 mode: PW/PW res: [0x2bc38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237383:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002bb34145/0x3234de053c53b95 lrc: 1/0,0 mode: --/PW res: [0x2bc38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237385:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c53b9c lrc: 3/0,0 mode: PW/PW res: [0x2bbe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237386:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002bb34145/0x3234de053c53b95 lrc: 0/0,0 mode: --/PW res: [0x2bc38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237388:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c53b9c lrc: 1/0,0 mode: --/PW res: [0x2bbe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237391:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c53b9c lrc: 0/0,0 mode: --/PW res: [0x2bbe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.237637:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.237666:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946626432 00000100:00100000:0.0:1651529467.237672:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.237681:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.237690:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946626560 00000100:00100000:1.0:1651529467.237696:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946626368 00000100:00100000:1.0:1651529467.237702:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213093 00000100:00100000:1.0:1651529467.237704:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007f9b0c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+108:39030:x1731745946626432:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.237709:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179183 count 1 00002000:00010000:1.0:1651529467.237714:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.237716:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c53ba3 lrc: 3/0,1 mode: --/PW res: [0x2bbef:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237719:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.237720:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.237721:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c53ba3 lrc: 3/0,1 mode: PW/PW res: [0x2bbef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237724:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c53ba3 lrc: 3/0,1 mode: PW/PW res: [0x2bbef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.237729:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529467.237737:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c53ba3 lrc: 3/0,1 mode: PW/PW res: [0x2bbef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237740:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c53ba3 lrc: 2/0,0 mode: PW/PW res: [0x2bbef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.237740:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.237753:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.237760:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.237766:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.237773:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946626496 00000100:00100000:0.0:1651529467.237783:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946626624 00000100:00100000:0.0:1651529467.237786:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946626752 00000100:00100000:0.0:1651529467.237788:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946626688 00000100:00100000:0.0:1651529467.237790:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946626816 00000100:00100000:1.0:1651529467.237791:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007f9b0c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+114:39030:x1731745946626432:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 86us (154us total) trans 12885081097 rc 0/0 00000100:00100000:0.0:1651529467.237793:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213094 00000100:00100000:1.0:1651529467.237795:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213093 00000100:00100000:0.0:1651529467.237795:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003132c0c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+114:39030:x1731745946626560:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.237808:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179205 count 1 00000100:00100000:1.0:1651529467.237809:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213095 00000100:00100000:1.0:1651529467.237811:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000056e45ef2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+113:39029:x1731745946626368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00010000:0.0:1651529467.237814:0:80276:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc05:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.237815:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c53baa lrc: 3/0,1 mode: --/PW res: [0x2bc05:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529467.237816:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179268 count 1 00010000:00010000:0.0:1651529467.237819:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.237820:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00010000:1.0:1651529467.237821:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc44:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.237821:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c53baa lrc: 3/0,1 mode: PW/PW res: [0x2bc05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237823:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e600099f/0x3234de053c53bb1 lrc: 3/0,1 mode: --/PW res: [0x2bc44:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237825:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c53baa lrc: 3/0,1 mode: PW/PW res: [0x2bc05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237827:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.237827:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.237828:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e600099f/0x3234de053c53bb1 lrc: 3/0,1 mode: PW/PW res: [0x2bc44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237828:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c53baa lrc: 3/0,1 mode: PW/PW res: [0x2bc05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237830:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c53baa lrc: 2/0,0 mode: PW/PW res: [0x2bc05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237832:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e600099f/0x3234de053c53bb1 lrc: 3/0,1 mode: PW/PW res: [0x2bc44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237835:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e600099f/0x3234de053c53bb1 lrc: 3/0,1 mode: PW/PW res: [0x2bc44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237840:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e600099f/0x3234de053c53bb1 lrc: 2/0,0 mode: PW/PW res: [0x2bc44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.237870:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003132c0c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+115:39030:x1731745946626560:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 74us (198us total) trans 12885081098 rc 0/0 00000100:00100000:0.0:1651529467.237873:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213094 00000100:00100000:1.0:1651529467.237877:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000056e45ef2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+114:39029:x1731745946626368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 65us (195us total) trans 12885081099 rc 0/0 00000100:00100000:0.0:1651529467.237879:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213096 00000100:00100000:1.0:1651529467.237881:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213095 00000100:00100000:0.0:1651529467.237881:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9b0314b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+114:39029:x1731745946626496:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.237885:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179295 count 1 00000100:00100000:1.0:1651529467.237886:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213097 00000100:00100000:1.0:1651529467.237887:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000802c76be pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+113:39029:x1731745946626624:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00010000:0.0:1651529467.237890:0:80276:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc5f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.237891:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c53bb8 lrc: 3/0,1 mode: --/PW res: [0x2bc5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529467.237892:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179397 count 1 00010000:00010000:0.0:1651529467.237895:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.237895:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00010000:1.0:1651529467.237896:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcc5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.237896:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c53bb8 lrc: 3/0,1 mode: PW/PW res: [0x2bc5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237898:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c53bbf lrc: 3/0,1 mode: --/PW res: [0x2bcc5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237900:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c53bb8 lrc: 3/0,1 mode: PW/PW res: [0x2bc5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237901:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.237902:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.237903:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c53bbf lrc: 3/0,1 mode: PW/PW res: [0x2bcc5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237903:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c53bb8 lrc: 3/0,1 mode: PW/PW res: [0x2bc5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237905:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c53bb8 lrc: 2/0,0 mode: PW/PW res: [0x2bc5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237907:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c53bbf lrc: 3/0,1 mode: PW/PW res: [0x2bcc5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237909:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c53bbf lrc: 3/0,1 mode: PW/PW res: [0x2bcc5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237912:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c53bbf lrc: 2/0,0 mode: PW/PW res: [0x2bcc5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.237937:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9b0314b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+115:39029:x1731745946626496:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 55us (208us total) trans 12885081100 rc 0/0 00000100:00100000:0.0:1651529467.237939:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213096 00000100:00100000:0.0:1651529467.237944:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213098 00000100:00100000:0.0:1651529467.237946:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5ebc6ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+114:39029:x1731745946626752:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529467.237947:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000802c76be pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+114:39029:x1731745946626624:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 58us (206us total) trans 12885081101 rc 0/0 00000100:00100000:1.0:1651529467.237950:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213097 00002000:00080000:0.0:1651529467.237950:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179411 count 1 00002000:00010000:0.0:1651529467.237955:0:80276:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcd3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.237956:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c53bc6 lrc: 3/0,1 mode: --/PW res: [0x2bcd3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237960:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.237960:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.237961:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c53bc6 lrc: 3/0,1 mode: PW/PW res: [0x2bcd3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.237965:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c53bc6 lrc: 3/0,1 mode: PW/PW res: [0x2bcd3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.237967:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213099 00010000:00010000:0.0:1651529467.237967:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c53bc6 lrc: 3/0,1 mode: PW/PW res: [0x2bcd3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.237969:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068b6c75f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+113:39030:x1731745946626688:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529467.237970:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c53bc6 lrc: 2/0,0 mode: PW/PW res: [0x2bcd3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529467.237973:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179418 count 1 00002000:00010000:1.0:1651529467.237978:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcda:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.237979:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000928e420a/0x3234de053c53bcd lrc: 3/0,1 mode: --/PW res: [0x2bcda:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237982:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.237983:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.237984:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000928e420a/0x3234de053c53bcd lrc: 3/0,1 mode: PW/PW res: [0x2bcda:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237987:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000928e420a/0x3234de053c53bcd lrc: 3/0,1 mode: PW/PW res: [0x2bcda:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237990:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000928e420a/0x3234de053c53bcd lrc: 3/0,1 mode: PW/PW res: [0x2bcda:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.237993:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000928e420a/0x3234de053c53bcd lrc: 2/0,0 mode: PW/PW res: [0x2bcda:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.238001:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5ebc6ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+114:39029:x1731745946626752:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 54us (253us total) trans 12885081102 rc 0/0 00000100:00100000:0.0:1651529467.238004:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213098 00000100:00100000:0.0:1651529467.238008:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213100 00000100:00100000:0.0:1651529467.238010:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000946e402f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+114:39030:x1731745946626816:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.238014:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179316 count 1 00002000:00010000:0.0:1651529467.238018:0:80276:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc74:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.238020:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53bd4 lrc: 3/0,1 mode: --/PW res: [0x2bc74:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238023:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.238024:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529467.238025:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068b6c75f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+114:39030:x1731745946626688:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 56us (265us total) trans 12885081103 rc 0/0 00010000:00010000:0.0:1651529467.238025:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53bd4 lrc: 3/0,1 mode: PW/PW res: [0x2bc74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238028:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53bd4 lrc: 3/0,1 mode: PW/PW res: [0x2bc74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.238030:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213099 00010000:00010000:0.0:1651529467.238031:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53bd4 lrc: 3/0,1 mode: PW/PW res: [0x2bc74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238034:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53bd4 lrc: 2/0,0 mode: PW/PW res: [0x2bc74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.238079:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000946e402f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+114:39030:x1731745946626816:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 68us (312us total) trans 12885081104 rc 0/0 00000100:00100000:0.0:1651529467.238082:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213100 00010000:00010000:0.0:1651529467.238092:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c53ba3 lrc: 2/0,0 mode: PW/PW res: [0x2bbef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238095:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000676967d8 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.238096:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c53ba3 lrc: 2/0,0 mode: PW/PW res: [0x2bbef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238099:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c53ba3 lrc: 3/0,0 mode: PW/PW res: [0x2bbef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238106:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c53ba3 lrc: 1/0,0 mode: --/PW res: [0x2bbef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238109:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c53ba3 lrc: 0/0,0 mode: --/PW res: [0x2bbef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238114:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c53baa lrc: 2/0,0 mode: PW/PW res: [0x2bc05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238116:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000090e99444 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.238117:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c53baa lrc: 2/0,0 mode: PW/PW res: [0x2bc05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238120:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c53baa lrc: 3/0,0 mode: PW/PW res: [0x2bc05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238123:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c53baa lrc: 1/0,0 mode: --/PW res: [0x2bc05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238136:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e600099f/0x3234de053c53bb1 lrc: 2/0,0 mode: PW/PW res: [0x2bc44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238140:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e600099f already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.238141:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e600099f/0x3234de053c53bb1 lrc: 2/0,0 mode: PW/PW res: [0x2bc44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238144:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e600099f/0x3234de053c53bb1 lrc: 3/0,0 mode: PW/PW res: [0x2bc44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238149:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e600099f/0x3234de053c53bb1 lrc: 1/0,0 mode: --/PW res: [0x2bc44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238152:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e600099f/0x3234de053c53bb1 lrc: 0/0,0 mode: --/PW res: [0x2bc44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238157:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c53baa lrc: 0/0,0 mode: --/PW res: [0x2bc05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238162:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c53bb8 lrc: 2/0,0 mode: PW/PW res: [0x2bc5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238165:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000029958df2 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.238166:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c53bb8 lrc: 2/0,0 mode: PW/PW res: [0x2bc5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238169:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c53bb8 lrc: 3/0,0 mode: PW/PW res: [0x2bc5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238173:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c53bbf lrc: 2/0,0 mode: PW/PW res: [0x2bcc5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238175:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c53bb8 lrc: 1/0,0 mode: --/PW res: [0x2bc5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238176:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007f539dcd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.238177:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c53bbf lrc: 2/0,0 mode: PW/PW res: [0x2bcc5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238178:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c53bb8 lrc: 0/0,0 mode: --/PW res: [0x2bc5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238180:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c53bbf lrc: 3/0,0 mode: PW/PW res: [0x2bcc5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238181:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c53bc6 lrc: 2/0,0 mode: PW/PW res: [0x2bcd3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238184:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ebdbebae already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.238184:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c53bbf lrc: 1/0,0 mode: --/PW res: [0x2bcc5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238185:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c53bc6 lrc: 2/0,0 mode: PW/PW res: [0x2bcd3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238187:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c53bbf lrc: 0/0,0 mode: --/PW res: [0x2bcc5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238188:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c53bc6 lrc: 3/0,0 mode: PW/PW res: [0x2bcd3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238191:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c53bc6 lrc: 1/0,0 mode: --/PW res: [0x2bcd3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238191:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000928e420a/0x3234de053c53bcd lrc: 2/0,0 mode: PW/PW res: [0x2bcda:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238193:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000928e420a already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.238194:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c53bc6 lrc: 0/0,0 mode: --/PW res: [0x2bcd3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238194:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000928e420a/0x3234de053c53bcd lrc: 2/0,0 mode: PW/PW res: [0x2bcda:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238197:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53bd4 lrc: 2/0,0 mode: PW/PW res: [0x2bc74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238197:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000928e420a/0x3234de053c53bcd lrc: 3/0,0 mode: PW/PW res: [0x2bcda:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238199:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006cbd0d09 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.238200:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53bd4 lrc: 2/0,0 mode: PW/PW res: [0x2bc74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238200:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000928e420a/0x3234de053c53bcd lrc: 1/0,0 mode: --/PW res: [0x2bcda:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238203:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53bd4 lrc: 3/0,0 mode: PW/PW res: [0x2bc74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238206:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53bd4 lrc: 1/0,0 mode: --/PW res: [0x2bc74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238209:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53bd4 lrc: 0/0,0 mode: --/PW res: [0x2bc74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238217:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000928e420a/0x3234de053c53bcd lrc: 0/0,0 mode: --/PW res: [0x2bcda:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.238277:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.238286:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.238293:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946627008 00000100:00100000:0.0:1651529467.238299:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946627136 00000100:00100000:0.0:1651529467.238303:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213101 00000100:00100000:0.0:1651529467.238305:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+115:39030:x1731745946627008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.238310:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179315 count 1 00002000:00010000:0.0:1651529467.238315:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc73:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.238317:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c53bdb lrc: 3/0,1 mode: --/PW res: [0x2bc73:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238320:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.238321:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.238322:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c53bdb lrc: 3/0,1 mode: PW/PW res: [0x2bc73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238326:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c53bdb lrc: 3/0,1 mode: PW/PW res: [0x2bc73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238329:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c53bdb lrc: 3/0,1 mode: PW/PW res: [0x2bc73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238331:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c53bdb lrc: 2/0,0 mode: PW/PW res: [0x2bc73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238342:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c53bdb lrc: 2/0,0 mode: PW/PW res: [0x2bc73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238345:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cd5f3a7c already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.238346:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c53bdb lrc: 2/0,0 mode: PW/PW res: [0x2bc73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238349:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c53bdb lrc: 3/0,0 mode: PW/PW res: [0x2bc73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238353:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c53bdb lrc: 1/0,0 mode: --/PW res: [0x2bc73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238356:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c53bdb lrc: 0/0,0 mode: --/PW res: [0x2bc73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.238406:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+116:39030:x1731745946627008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 100us (129us total) trans 12885081105 rc 0/0 00000100:00100000:0.0:1651529467.238409:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213101 00000100:00100000:0.0:1651529467.238415:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213102 00000100:00100000:0.0:1651529467.238416:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004de851bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+115:39030:x1731745946627136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.238421:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179420 count 1 00002000:00010000:0.0:1651529467.238426:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcdc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.238428:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c53be2 lrc: 3/0,1 mode: --/PW res: [0x2bcdc:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238431:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.238432:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.238433:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c53be2 lrc: 3/0,1 mode: PW/PW res: [0x2bcdc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.238436:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529467.238436:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c53be2 lrc: 3/0,1 mode: PW/PW res: [0x2bcdc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238439:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c53be2 lrc: 3/0,1 mode: PW/PW res: [0x2bcdc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.238446:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529467.238449:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c53be2 lrc: 2/0,0 mode: PW/PW res: [0x2bcdc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.238454:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.238460:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946627264 00000100:00100000:1.0:1651529467.238470:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946627200 00000100:00100000:1.0:1651529467.238473:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946627328 00000100:00100000:1.0:1651529467.238476:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213103 00000100:00100000:1.0:1651529467.238478:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+118:39029:x1731745946627264:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.238483:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179336 count 1 00002000:00010000:1.0:1651529467.238494:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc88:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.238496:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c53be9 lrc: 3/0,1 mode: --/PW res: [0x2bc88:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238500:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.238501:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.238502:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c53be9 lrc: 3/0,1 mode: PW/PW res: [0x2bc88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238505:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c53be9 lrc: 3/0,1 mode: PW/PW res: [0x2bc88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238509:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c53be9 lrc: 3/0,1 mode: PW/PW res: [0x2bc88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238511:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c53be9 lrc: 2/0,0 mode: PW/PW res: [0x2bc88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.238530:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004de851bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+119:39030:x1731745946627136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 113us (243us total) trans 12885081106 rc 0/0 00000100:00100000:0.0:1651529467.238533:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213102 00000100:00100000:0.0:1651529467.238538:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213104 00000100:00100000:0.0:1651529467.238540:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+119:39030:x1731745946627200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529467.238552:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+119:39029:x1731745946627264:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 73us (117us total) trans 12885081107 rc 0/0 00000100:00100000:1.0:1651529467.238555:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213103 00002000:00080000:0.0:1651529467.238557:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179319 count 1 00000100:00100000:1.0:1651529467.238560:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213105 00000100:00100000:1.0:1651529467.238562:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+118:39030:x1731745946627328:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00010000:0.0:1651529467.238563:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc77:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.238564:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c53bf0 lrc: 3/0,1 mode: --/PW res: [0x2bc77:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529467.238567:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179398 count 1 00010000:00010000:0.0:1651529467.238568:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.238569:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.238570:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c53bf0 lrc: 3/0,1 mode: PW/PW res: [0x2bc77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.238572:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcc6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.238573:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bbf33489/0x3234de053c53bf7 lrc: 3/0,1 mode: --/PW res: [0x2bcc6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238573:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c53bf0 lrc: 3/0,1 mode: PW/PW res: [0x2bc77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238576:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c53bf0 lrc: 3/0,1 mode: PW/PW res: [0x2bc77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238577:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.238577:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.238578:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bbf33489/0x3234de053c53bf7 lrc: 3/0,1 mode: PW/PW res: [0x2bcc6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238579:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c53bf0 lrc: 2/0,0 mode: PW/PW res: [0x2bc77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238582:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bbf33489/0x3234de053c53bf7 lrc: 3/0,1 mode: PW/PW res: [0x2bcc6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238585:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bbf33489/0x3234de053c53bf7 lrc: 3/0,1 mode: PW/PW res: [0x2bcc6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238587:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bbf33489/0x3234de053c53bf7 lrc: 2/0,0 mode: PW/PW res: [0x2bcc6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.238623:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+120:39030:x1731745946627328:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 60us (169us total) trans 12885081108 rc 0/0 00000100:00100000:1.0:1651529467.238626:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213105 00000100:00100000:0.0:1651529467.238627:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+120:39030:x1731745946627200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 86us (180us total) trans 12885081109 rc 0/0 00000100:00100000:0.0:1651529467.238630:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213104 00010000:00010000:1.0:1651529467.238633:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c53be2 lrc: 2/0,0 mode: PW/PW res: [0x2bcdc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238636:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000314b5fa1 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.238637:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c53be2 lrc: 2/0,0 mode: PW/PW res: [0x2bcdc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238640:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c53be2 lrc: 3/0,0 mode: PW/PW res: [0x2bcdc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238641:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c53be9 lrc: 2/0,0 mode: PW/PW res: [0x2bc88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238644:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c8f63a78 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.238645:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c53be2 lrc: 1/0,0 mode: --/PW res: [0x2bcdc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238645:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c53be9 lrc: 2/0,0 mode: PW/PW res: [0x2bc88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238648:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c53be2 lrc: 0/0,0 mode: --/PW res: [0x2bcdc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238648:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c53be9 lrc: 3/0,0 mode: PW/PW res: [0x2bc88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238652:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bbf33489/0x3234de053c53bf7 lrc: 2/0,0 mode: PW/PW res: [0x2bcc6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238655:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bbf33489 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.238655:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c53be9 lrc: 1/0,0 mode: --/PW res: [0x2bc88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238656:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbf33489/0x3234de053c53bf7 lrc: 2/0,0 mode: PW/PW res: [0x2bcc6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238658:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbf33489/0x3234de053c53bf7 lrc: 3/0,0 mode: PW/PW res: [0x2bcc6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238658:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8f63a78/0x3234de053c53be9 lrc: 0/0,0 mode: --/PW res: [0x2bc88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238661:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bbf33489/0x3234de053c53bf7 lrc: 1/0,0 mode: --/PW res: [0x2bcc6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238662:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c53bf0 lrc: 2/0,0 mode: PW/PW res: [0x2bc77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238664:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bbf33489/0x3234de053c53bf7 lrc: 0/0,0 mode: --/PW res: [0x2bcc6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238665:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000029b2a516 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.238665:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c53bf0 lrc: 2/0,0 mode: PW/PW res: [0x2bc77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238668:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c53bf0 lrc: 3/0,0 mode: PW/PW res: [0x2bc77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238672:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c53bf0 lrc: 1/0,0 mode: --/PW res: [0x2bc77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238674:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c53bf0 lrc: 0/0,0 mode: --/PW res: [0x2bc77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.238752:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.238761:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.238771:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.238772:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946627712 00000100:00100000:1.0:1651529467.238780:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.238789:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946627776 00000100:00100000:1.0:1651529467.238804:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946627840 00000100:00100000:1.0:1651529467.238811:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946627904 00000100:00100000:1.0:1651529467.238817:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213106 00000100:00100000:1.0:1651529467.238818:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+122:39029:x1731745946627776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.238823:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179254 count 1 00000100:00100000:0.0:1651529467.238826:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213107 00000100:00100000:0.0:1651529467.238828:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+122:39030:x1731745946627840:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00010000:1.0:1651529467.238829:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.238831:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091069ebb/0x3234de053c53bfe lrc: 3/0,1 mode: --/PW res: [0x2bc36:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529467.238833:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179332 count 1 00010000:00010000:1.0:1651529467.238834:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.238835:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.238836:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091069ebb/0x3234de053c53bfe lrc: 3/0,1 mode: PW/PW res: [0x2bc36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238839:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091069ebb/0x3234de053c53bfe lrc: 3/0,1 mode: PW/PW res: [0x2bc36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.238839:0:80281:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc84:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.238841:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c53c05 lrc: 3/0,1 mode: --/PW res: [0x2bc84:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238842:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091069ebb/0x3234de053c53bfe lrc: 3/0,1 mode: PW/PW res: [0x2bc36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238845:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091069ebb/0x3234de053c53bfe lrc: 2/0,0 mode: PW/PW res: [0x2bc36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238845:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.238845:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.238846:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c53c05 lrc: 3/0,1 mode: PW/PW res: [0x2bc84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238850:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c53c05 lrc: 3/0,1 mode: PW/PW res: [0x2bc84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238853:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c53c05 lrc: 3/0,1 mode: PW/PW res: [0x2bc84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238855:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c53c05 lrc: 2/0,0 mode: PW/PW res: [0x2bc84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.238888:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+124:39029:x1731745946627776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 69us (126us total) trans 12885081110 rc 0/0 00000100:00100000:1.0:1651529467.238892:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213106 00000100:00100000:1.0:1651529467.238897:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213108 00000100:00100000:1.0:1651529467.238905:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+123:39029:x1731745946627904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.238910:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179403 count 1 00002000:00010000:1.0:1651529467.238915:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bccb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.238917:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000485752e5/0x3234de053c53c0c lrc: 3/0,1 mode: --/PW res: [0x2bccb:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238920:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529467.238920:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+123:39030:x1731745946627840:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 91us (148us total) trans 12885081111 rc 0/0 00010000:00010000:1.0:1651529467.238921:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.238922:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000485752e5/0x3234de053c53c0c lrc: 3/0,1 mode: PW/PW res: [0x2bccb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.238923:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213107 00010000:00010000:1.0:1651529467.238925:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000485752e5/0x3234de053c53c0c lrc: 3/0,1 mode: PW/PW res: [0x2bccb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238928:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000485752e5/0x3234de053c53c0c lrc: 3/0,1 mode: PW/PW res: [0x2bccb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.238928:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213109 00000100:00100000:0.0:1651529467.238930:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+122:39030:x1731745946627712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529467.238931:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000485752e5/0x3234de053c53c0c lrc: 2/0,0 mode: PW/PW res: [0x2bccb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529467.238934:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179257 count 1 00002000:00010000:0.0:1651529467.238947:0:80281:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529467.238970:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+123:39029:x1731745946627904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 70us (189us total) trans 12885081112 rc 0/0 00010000:00010000:0.0:1651529467.238970:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c53c13 lrc: 3/0,1 mode: --/PW res: [0x2bc39:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238977:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.238977:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.238978:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c53c13 lrc: 3/0,1 mode: PW/PW res: [0x2bc39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.238982:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213108 00010000:00010000:0.0:1651529467.238982:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c53c13 lrc: 3/0,1 mode: PW/PW res: [0x2bc39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238985:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c53c13 lrc: 3/0,1 mode: PW/PW res: [0x2bc39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.238987:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c53c13 lrc: 2/0,0 mode: PW/PW res: [0x2bc39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238989:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091069ebb/0x3234de053c53bfe lrc: 2/0,0 mode: PW/PW res: [0x2bc36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238992:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000091069ebb already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.238994:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091069ebb/0x3234de053c53bfe lrc: 2/0,0 mode: PW/PW res: [0x2bc36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.238997:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091069ebb/0x3234de053c53bfe lrc: 3/0,0 mode: PW/PW res: [0x2bc36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239001:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091069ebb/0x3234de053c53bfe lrc: 1/0,0 mode: --/PW res: [0x2bc36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239004:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091069ebb/0x3234de053c53bfe lrc: 0/0,0 mode: --/PW res: [0x2bc36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239008:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c53c05 lrc: 2/0,0 mode: PW/PW res: [0x2bc84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239011:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004678bff1 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.239012:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c53c05 lrc: 2/0,0 mode: PW/PW res: [0x2bc84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239015:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c53c05 lrc: 3/0,0 mode: PW/PW res: [0x2bc84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239018:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c53c05 lrc: 1/0,0 mode: --/PW res: [0x2bc84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239020:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c53c05 lrc: 0/0,0 mode: --/PW res: [0x2bc84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239024:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000485752e5/0x3234de053c53c0c lrc: 2/0,0 mode: PW/PW res: [0x2bccb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.239024:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+123:39030:x1731745946627712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 93us (271us total) trans 12885081113 rc 0/0 00010000:00010000:1.0:1651529467.239027:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000485752e5 already unused, calling callback (0000000049fddea7) 00000100:00100000:0.0:1651529467.239027:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213109 00010000:00010000:1.0:1651529467.239028:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000485752e5/0x3234de053c53c0c lrc: 2/0,0 mode: PW/PW res: [0x2bccb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239030:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000485752e5/0x3234de053c53c0c lrc: 3/0,0 mode: PW/PW res: [0x2bccb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239033:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000485752e5/0x3234de053c53c0c lrc: 1/0,0 mode: --/PW res: [0x2bccb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239036:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000485752e5/0x3234de053c53c0c lrc: 0/0,0 mode: --/PW res: [0x2bccb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239037:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c53c13 lrc: 2/0,0 mode: PW/PW res: [0x2bc39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239040:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d84ad17b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.239042:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c53c13 lrc: 2/0,0 mode: PW/PW res: [0x2bc39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239044:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c53c13 lrc: 3/0,0 mode: PW/PW res: [0x2bc39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.239049:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529467.239051:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c53c13 lrc: 1/0,0 mode: --/PW res: [0x2bc39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239061:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c53c13 lrc: 0/0,0 mode: --/PW res: [0x2bc39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.239067:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.239077:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946628224 00000100:00100000:1.0:1651529467.239079:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.239090:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946628288 00000100:00100000:0.0:1651529467.239094:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946628352 00000100:00100000:0.0:1651529467.239101:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213110 00000100:00100000:0.0:1651529467.239103:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+125:39030:x1731745946628224:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.239107:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179343 count 1 00002000:00010000:0.0:1651529467.239113:0:72395:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc8f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.239114:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c53c1a lrc: 3/0,1 mode: --/PW res: [0x2bc8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239117:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529467.239118:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529467.239118:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.239119:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c53c1a lrc: 3/0,1 mode: PW/PW res: [0x2bc8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239128:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c53c1a lrc: 3/0,1 mode: PW/PW res: [0x2bc8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239132:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c53c1a lrc: 3/0,1 mode: PW/PW res: [0x2bc8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239137:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c53c1a lrc: 2/0,0 mode: PW/PW res: [0x2bc8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.239155:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946628416 00000100:00100000:1.0:1651529467.239162:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213111 00000100:00100000:1.0:1651529467.239164:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+127:39029:x1731745946628288:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.239169:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179283 count 1 00002000:00010000:1.0:1651529467.239174:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc53:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.239175:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000066556eb/0x3234de053c53c21 lrc: 3/0,1 mode: --/PW res: [0x2bc53:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239179:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.239180:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.239180:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000066556eb/0x3234de053c53c21 lrc: 3/0,1 mode: PW/PW res: [0x2bc53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239184:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000066556eb/0x3234de053c53c21 lrc: 3/0,1 mode: PW/PW res: [0x2bc53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239187:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000066556eb/0x3234de053c53c21 lrc: 3/0,1 mode: PW/PW res: [0x2bc53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239190:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000066556eb/0x3234de053c53c21 lrc: 2/0,0 mode: PW/PW res: [0x2bc53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.239197:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+127:39030:x1731745946628224:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 93us (147us total) trans 12885081114 rc 0/0 00000100:00100000:0.0:1651529467.239200:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213110 00000100:00100000:0.0:1651529467.239210:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213112 00000100:00100000:0.0:1651529467.239212:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+126:39030:x1731745946628352:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.239217:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179330 count 1 00002000:00010000:0.0:1651529467.239241:0:72395:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc82:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.239243:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c53c28 lrc: 3/0,1 mode: --/PW res: [0x2bc82:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239246:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.239247:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.239248:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c53c28 lrc: 3/0,1 mode: PW/PW res: [0x2bc82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.239258:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+127:39029:x1731745946628288:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 93us (190us total) trans 12885081115 rc 0/0 00000100:00100000:1.0:1651529467.239261:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213111 00010000:00010000:0.0:1651529467.239264:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c53c28 lrc: 3/0,1 mode: PW/PW res: [0x2bc82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.239266:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213113 00000100:00100000:1.0:1651529467.239267:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+126:39029:x1731745946628416:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529467.239268:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c53c28 lrc: 3/0,1 mode: PW/PW res: [0x2bc82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239271:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c53c28 lrc: 2/0,0 mode: PW/PW res: [0x2bc82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529467.239272:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179413 count 1 00002000:00010000:1.0:1651529467.239277:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcd5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.239278:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c53c2f lrc: 3/0,1 mode: --/PW res: [0x2bcd5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239282:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.239283:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.239283:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c53c2f lrc: 3/0,1 mode: PW/PW res: [0x2bcd5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239287:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c53c2f lrc: 3/0,1 mode: PW/PW res: [0x2bcd5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239290:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c53c2f lrc: 3/0,1 mode: PW/PW res: [0x2bcd5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239293:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c53c2f lrc: 2/0,0 mode: PW/PW res: [0x2bcd5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.239322:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+128:39030:x1731745946628352:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 109us (243us total) trans 12885081116 rc 0/0 00000100:00100000:1.0:1651529467.239326:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+128:39029:x1731745946628416:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 58us (208us total) trans 12885081117 rc 0/0 00000100:00100000:0.0:1651529467.239326:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213112 00000100:00100000:1.0:1651529467.239329:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213113 00010000:00010000:0.0:1651529467.239335:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c53c1a lrc: 2/0,0 mode: PW/PW res: [0x2bc8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239336:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000066556eb/0x3234de053c53c21 lrc: 2/0,0 mode: PW/PW res: [0x2bc53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239339:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000066556eb already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.239339:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2a86deb already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.239340:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c53c1a lrc: 2/0,0 mode: PW/PW res: [0x2bc8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239341:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000066556eb/0x3234de053c53c21 lrc: 2/0,0 mode: PW/PW res: [0x2bc53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239343:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000066556eb/0x3234de053c53c21 lrc: 3/0,0 mode: PW/PW res: [0x2bc53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239348:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000066556eb/0x3234de053c53c21 lrc: 1/0,0 mode: --/PW res: [0x2bc53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239351:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000066556eb/0x3234de053c53c21 lrc: 0/0,0 mode: --/PW res: [0x2bc53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239355:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c53c28 lrc: 2/0,0 mode: PW/PW res: [0x2bc82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239357:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c53c1a lrc: 3/0,0 mode: PW/PW res: [0x2bc8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239358:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c0de17df already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.239359:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c53c28 lrc: 2/0,0 mode: PW/PW res: [0x2bc82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239361:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c53c28 lrc: 3/0,0 mode: PW/PW res: [0x2bc82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239362:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c53c1a lrc: 1/0,0 mode: --/PW res: [0x2bc8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239364:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c53c28 lrc: 1/0,0 mode: --/PW res: [0x2bc82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239365:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c53c1a lrc: 0/0,0 mode: --/PW res: [0x2bc8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239367:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c53c28 lrc: 0/0,0 mode: --/PW res: [0x2bc82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239370:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c53c2f lrc: 2/0,0 mode: PW/PW res: [0x2bcd5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239373:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f3240ce7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.239374:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c53c2f lrc: 2/0,0 mode: PW/PW res: [0x2bcd5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239379:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c53c2f lrc: 3/0,0 mode: PW/PW res: [0x2bcd5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239382:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c53c2f lrc: 1/0,0 mode: --/PW res: [0x2bcd5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239385:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c53c2f lrc: 0/0,0 mode: --/PW res: [0x2bcd5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.239405:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.239414:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946628480 00000100:00100000:1.0:1651529467.239429:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213114 00000100:00100000:1.0:1651529467.239430:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+127:39030:x1731745946628480:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.239435:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179171 count 1 00002000:00010000:1.0:1651529467.239440:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbe3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.239442:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c53c36 lrc: 3/0,1 mode: --/PW res: [0x2bbe3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239464:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.239464:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.239470:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c53c36 lrc: 3/0,1 mode: PW/PW res: [0x2bbe3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239477:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c53c36 lrc: 3/0,1 mode: PW/PW res: [0x2bbe3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239480:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c53c36 lrc: 3/0,1 mode: PW/PW res: [0x2bbe3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239483:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c53c36 lrc: 2/0,0 mode: PW/PW res: [0x2bbe3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.239527:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+128:39030:x1731745946628480:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 96us (123us total) trans 12885081118 rc 0/0 00000100:00100000:1.0:1651529467.239531:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213114 00010000:00010000:1.0:1651529467.239538:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c53c36 lrc: 2/0,0 mode: PW/PW res: [0x2bbe3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239542:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005c863cd2 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.239543:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c53c36 lrc: 2/0,0 mode: PW/PW res: [0x2bbe3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239553:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c53c36 lrc: 3/0,0 mode: PW/PW res: [0x2bbe3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239558:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c53c36 lrc: 1/0,0 mode: --/PW res: [0x2bbe3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239561:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c53c36 lrc: 0/0,0 mode: --/PW res: [0x2bbe3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.239575:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.239582:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.239593:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.239602:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946628672 00000100:00100000:1.0:1651529467.239610:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946628608 00000100:00100000:1.0:1651529467.239615:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213115 00000100:00100000:1.0:1651529467.239617:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+129:39029:x1731745946628672:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.239622:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179346 count 1 00002000:00010000:1.0:1651529467.239627:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc92:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.239629:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c53c3d lrc: 3/0,1 mode: --/PW res: [0x2bc92:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239632:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529467.239632:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946628544 00010000:00010000:1.0:1651529467.239633:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.239634:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c53c3d lrc: 3/0,1 mode: PW/PW res: [0x2bc92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.239641:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213116 00000100:00100000:0.0:1651529467.239643:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+130:39029:x1731745946628608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529467.239646:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c53c3d lrc: 3/0,1 mode: PW/PW res: [0x2bc92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529467.239648:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179353 count 1 00010000:00010000:1.0:1651529467.239649:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c53c3d lrc: 3/0,1 mode: PW/PW res: [0x2bc92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239652:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c53c3d lrc: 2/0,0 mode: PW/PW res: [0x2bc92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.239653:0:80281:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc99:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.239655:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c53c44 lrc: 3/0,1 mode: --/PW res: [0x2bc99:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239664:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.239665:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.239666:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c53c44 lrc: 3/0,1 mode: PW/PW res: [0x2bc99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239670:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c53c44 lrc: 3/0,1 mode: PW/PW res: [0x2bc99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239673:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c53c44 lrc: 3/0,1 mode: PW/PW res: [0x2bc99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239690:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c53c44 lrc: 2/0,0 mode: PW/PW res: [0x2bc99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.239694:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+131:39029:x1731745946628672:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 76us (111us total) trans 12885081119 rc 0/0 00000100:00100000:1.0:1651529467.239698:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213115 00000100:00100000:1.0:1651529467.239703:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213117 00000100:00100000:1.0:1651529467.239704:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+130:39029:x1731745946628544:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.239709:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179251 count 1 00002000:00010000:1.0:1651529467.239714:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.239715:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c53c4b lrc: 3/0,1 mode: --/PW res: [0x2bc33:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239719:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.239719:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.239720:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c53c4b lrc: 3/0,1 mode: PW/PW res: [0x2bc33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239724:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c53c4b lrc: 3/0,1 mode: PW/PW res: [0x2bc33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239727:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c53c4b lrc: 3/0,1 mode: PW/PW res: [0x2bc33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239729:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c53c4b lrc: 2/0,0 mode: PW/PW res: [0x2bc33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.239729:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+131:39029:x1731745946628608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 85us (135us total) trans 12885081120 rc 0/0 00000100:00100000:0.0:1651529467.239732:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213116 00010000:00010000:0.0:1651529467.239740:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c53c3d lrc: 2/0,0 mode: PW/PW res: [0x2bc92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239743:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054295afd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.239744:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c53c3d lrc: 2/0,0 mode: PW/PW res: [0x2bc92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239747:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c53c3d lrc: 3/0,0 mode: PW/PW res: [0x2bc92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239752:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c53c3d lrc: 1/0,0 mode: --/PW res: [0x2bc92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239755:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c53c3d lrc: 0/0,0 mode: --/PW res: [0x2bc92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239759:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c53c44 lrc: 2/0,0 mode: PW/PW res: [0x2bc99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239762:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001ea46bb1 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529467.239763:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+131:39029:x1731745946628544:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 58us (187us total) trans 12885081121 rc 0/0 00010000:00010000:0.0:1651529467.239763:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c53c44 lrc: 2/0,0 mode: PW/PW res: [0x2bc99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.239766:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213117 00010000:00010000:0.0:1651529467.239766:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c53c44 lrc: 3/0,0 mode: PW/PW res: [0x2bc99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239769:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c53c44 lrc: 1/0,0 mode: --/PW res: [0x2bc99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239771:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c53c44 lrc: 0/0,0 mode: --/PW res: [0x2bc99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239773:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c53c4b lrc: 2/0,0 mode: PW/PW res: [0x2bc33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239779:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032eb11d3 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.239780:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c53c4b lrc: 2/0,0 mode: PW/PW res: [0x2bc33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239783:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c53c4b lrc: 3/0,0 mode: PW/PW res: [0x2bc33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239787:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c53c4b lrc: 1/0,0 mode: --/PW res: [0x2bc33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.239787:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529467.239790:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c53c4b lrc: 0/0,0 mode: --/PW res: [0x2bc33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.239814:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946629248 00000100:00100000:1.0:1651529467.239816:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.239825:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.239828:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946629376 00000100:00100000:1.0:1651529467.239832:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.239832:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946629312 00000100:00100000:1.0:1651529467.239841:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.239844:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946629440 00000100:00100000:1.0:1651529467.239848:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946629504 00000100:00100000:0.0:1651529467.239849:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213118 00000100:00100000:0.0:1651529467.239851:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+135:39030:x1731745946629248:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529467.239857:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213119 00000100:00100000:1.0:1651529467.239858:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+135:39030:x1731745946629376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.239861:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179377 count 1 00002000:00080000:1.0:1651529467.239864:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179293 count 1 00002000:00010000:0.0:1651529467.239867:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcb1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:1.0:1651529467.239869:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc5d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.239869:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c53c52 lrc: 3/0,1 mode: --/PW res: [0x2bcb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239871:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c53c59 lrc: 3/0,1 mode: --/PW res: [0x2bc5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239872:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.239873:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.239874:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c53c52 lrc: 3/0,1 mode: PW/PW res: [0x2bcb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239875:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.239875:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.239876:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c53c59 lrc: 3/0,1 mode: PW/PW res: [0x2bc5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239880:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c53c59 lrc: 3/0,1 mode: PW/PW res: [0x2bc5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239880:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c53c52 lrc: 3/0,1 mode: PW/PW res: [0x2bcb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239883:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c53c59 lrc: 3/0,1 mode: PW/PW res: [0x2bc5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239883:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c53c52 lrc: 3/0,1 mode: PW/PW res: [0x2bcb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239885:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c53c59 lrc: 2/0,0 mode: PW/PW res: [0x2bc5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239886:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c53c52 lrc: 2/0,0 mode: PW/PW res: [0x2bcb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.239923:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+137:39030:x1731745946629376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 63us (106us total) trans 12885081122 rc 0/0 00000100:00100000:1.0:1651529467.239926:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213119 00000100:00100000:1.0:1651529467.239931:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213120 00000100:00100000:1.0:1651529467.239933:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+136:39030:x1731745946629312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529467.239933:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+136:39030:x1731745946629248:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 82us (145us total) trans 12885081123 rc 0/0 00000100:00100000:0.0:1651529467.239936:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213118 00002000:00080000:1.0:1651529467.239937:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179174 count 1 00000100:00100000:0.0:1651529467.239941:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213121 00002000:00010000:1.0:1651529467.239942:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbe6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1651529467.239943:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+135:39030:x1731745946629440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529467.239944:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c53c60 lrc: 3/0,1 mode: --/PW res: [0x2bbe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239947:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:0.0:1651529467.239947:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179176 count 1 00010000:00010000:1.0:1651529467.239948:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.239948:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c53c60 lrc: 3/0,1 mode: PW/PW res: [0x2bbe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.239951:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbe8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.239952:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c53c60 lrc: 3/0,1 mode: PW/PW res: [0x2bbe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239953:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c53c67 lrc: 3/0,1 mode: --/PW res: [0x2bbe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.239955:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c53c60 lrc: 3/0,1 mode: PW/PW res: [0x2bbe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239957:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.239957:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.239958:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c53c60 lrc: 2/0,0 mode: PW/PW res: [0x2bbe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239958:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c53c67 lrc: 3/0,1 mode: PW/PW res: [0x2bbe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239962:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c53c67 lrc: 3/0,1 mode: PW/PW res: [0x2bbe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239967:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c53c67 lrc: 3/0,1 mode: PW/PW res: [0x2bbe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.239970:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c53c67 lrc: 2/0,0 mode: PW/PW res: [0x2bbe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.239993:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+137:39030:x1731745946629312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 59us (167us total) trans 12885081124 rc 0/0 00000100:00100000:1.0:1651529467.239996:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213120 00000100:00100000:1.0:1651529467.240001:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213122 00000100:00100000:1.0:1651529467.240002:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+136:39030:x1731745946629504:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529467.240002:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+136:39030:x1731745946629440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 59us (170us total) trans 12885081125 rc 0/0 00000100:00100000:0.0:1651529467.240005:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213121 00002000:00080000:1.0:1651529467.240006:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179240 count 1 00002000:00010000:1.0:1651529467.240011:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.240012:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c53c6e lrc: 3/0,1 mode: --/PW res: [0x2bc28:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240014:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c53c59 lrc: 2/0,0 mode: PW/PW res: [0x2bc5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240015:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.240016:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.240017:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c53c6e lrc: 3/0,1 mode: PW/PW res: [0x2bc28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240017:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ee128d1f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.240019:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c53c59 lrc: 2/0,0 mode: PW/PW res: [0x2bc5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240020:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c53c6e lrc: 3/0,1 mode: PW/PW res: [0x2bc28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240021:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c53c59 lrc: 3/0,0 mode: PW/PW res: [0x2bc5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240023:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c53c6e lrc: 3/0,1 mode: PW/PW res: [0x2bc28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240026:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c53c59 lrc: 1/0,0 mode: --/PW res: [0x2bc5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240028:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c53c6e lrc: 2/0,0 mode: PW/PW res: [0x2bc28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240029:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c53c59 lrc: 0/0,0 mode: --/PW res: [0x2bc5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240033:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c53c52 lrc: 2/0,0 mode: PW/PW res: [0x2bcb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240036:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004f367ded already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.240037:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c53c52 lrc: 2/0,0 mode: PW/PW res: [0x2bcb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240039:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c53c52 lrc: 3/0,0 mode: PW/PW res: [0x2bcb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240042:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c53c52 lrc: 1/0,0 mode: --/PW res: [0x2bcb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240045:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c53c52 lrc: 0/0,0 mode: --/PW res: [0x2bcb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240048:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c53c60 lrc: 2/0,0 mode: PW/PW res: [0x2bbe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240051:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f149aa4b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.240052:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c53c60 lrc: 2/0,0 mode: PW/PW res: [0x2bbe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240054:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c53c60 lrc: 3/0,0 mode: PW/PW res: [0x2bbe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240057:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c53c60 lrc: 1/0,0 mode: --/PW res: [0x2bbe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.240060:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+136:39030:x1731745946629504:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 57us (218us total) trans 12885081126 rc 0/0 00010000:00010000:0.0:1651529467.240060:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c53c60 lrc: 0/0,0 mode: --/PW res: [0x2bbe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.240062:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213122 00010000:00010000:0.0:1651529467.240063:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c53c67 lrc: 2/0,0 mode: PW/PW res: [0x2bbe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240066:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007c1cad42 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.240067:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c53c67 lrc: 2/0,0 mode: PW/PW res: [0x2bbe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240069:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c53c6e lrc: 2/0,0 mode: PW/PW res: [0x2bc28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240069:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c53c67 lrc: 3/0,0 mode: PW/PW res: [0x2bbe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240072:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f616ea25 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.240072:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c53c67 lrc: 1/0,0 mode: --/PW res: [0x2bbe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240073:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c53c6e lrc: 2/0,0 mode: PW/PW res: [0x2bc28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240075:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c53c67 lrc: 0/0,0 mode: --/PW res: [0x2bbe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240076:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c53c6e lrc: 3/0,0 mode: PW/PW res: [0x2bc28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240081:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c53c6e lrc: 1/0,0 mode: --/PW res: [0x2bc28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240084:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c53c6e lrc: 0/0,0 mode: --/PW res: [0x2bc28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.240363:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.240381:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.240398:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.240408:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.240427:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946630208 00000100:00100000:1.0:1651529467.240432:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.240436:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946630336 00000100:00100000:0.0:1651529467.240440:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946630464 00000100:00100000:1.0:1651529467.240442:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.240443:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946630592 00000100:00100000:1.0:1651529467.240452:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.240459:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946630144 00000100:00100000:1.0:1651529467.240461:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.240470:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946630272 00000100:00100000:0.0:1651529467.240473:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946630400 00000100:00100000:1.0:1651529467.240475:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946630528 00000100:00100000:0.0:1651529467.240477:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213123 00000100:00100000:0.0:1651529467.240478:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+143:39029:x1731745946630208:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529467.240482:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213124 00000100:00100000:1.0:1651529467.240484:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+143:39029:x1731745946630336:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.240484:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179325 count 1 00002000:00080000:1.0:1651529467.240489:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179243 count 1 00002000:00010000:0.0:1651529467.240489:0:72395:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc7d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.240491:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c53c75 lrc: 3/0,1 mode: --/PW res: [0x2bc7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.240494:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.240495:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.240495:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.240496:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c53c7c lrc: 3/0,1 mode: --/PW res: [0x2bc2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240496:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c53c75 lrc: 3/0,1 mode: PW/PW res: [0x2bc7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240499:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.240500:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.240500:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c53c75 lrc: 3/0,1 mode: PW/PW res: [0x2bc7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240501:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c53c7c lrc: 3/0,1 mode: PW/PW res: [0x2bc2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240503:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c53c75 lrc: 3/0,1 mode: PW/PW res: [0x2bc7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240505:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c53c7c lrc: 3/0,1 mode: PW/PW res: [0x2bc2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240505:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c53c75 lrc: 2/0,0 mode: PW/PW res: [0x2bc7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240508:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c53c7c lrc: 3/0,1 mode: PW/PW res: [0x2bc2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240510:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c53c7c lrc: 2/0,0 mode: PW/PW res: [0x2bc2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.240554:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+145:39029:x1731745946630336:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 69us (172us total) trans 12885081128 rc 0/0 00000100:00100000:0.0:1651529467.240554:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+145:39029:x1731745946630208:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 74us (190us total) trans 12885081127 rc 0/0 00000100:00100000:1.0:1651529467.240557:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213124 00000100:00100000:0.0:1651529467.240559:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213123 00000100:00100000:1.0:1651529467.240562:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213125 00000100:00100000:1.0:1651529467.240564:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+143:39029:x1731745946630464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529467.240564:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213126 00000100:00100000:0.0:1651529467.240566:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ede401b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+143:39029:x1731745946630592:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.240569:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179278 count 1 00002000:00080000:0.0:1651529467.240570:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179362 count 1 00002000:00010000:1.0:1651529467.240573:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc4e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.240575:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53c83 lrc: 3/0,1 mode: --/PW res: [0x2bc4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.240575:0:72395:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bca2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.240577:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c53c8a lrc: 3/0,1 mode: --/PW res: [0x2bca2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240578:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.240579:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.240580:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53c83 lrc: 3/0,1 mode: PW/PW res: [0x2bc4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240580:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.240581:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.240582:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c53c8a lrc: 3/0,1 mode: PW/PW res: [0x2bca2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240583:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53c83 lrc: 3/0,1 mode: PW/PW res: [0x2bc4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240586:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53c83 lrc: 3/0,1 mode: PW/PW res: [0x2bc4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240586:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c53c8a lrc: 3/0,1 mode: PW/PW res: [0x2bca2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240588:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c53c8a lrc: 3/0,1 mode: PW/PW res: [0x2bca2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240589:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53c83 lrc: 2/0,0 mode: PW/PW res: [0x2bc4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240591:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c53c8a lrc: 2/0,0 mode: PW/PW res: [0x2bca2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.240623:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+145:39029:x1731745946630464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 58us (225us total) trans 12885081129 rc 0/0 00000100:00100000:0.0:1651529467.240625:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ede401b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+145:39029:x1731745946630592:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 59us (217us total) trans 12885081130 rc 0/0 00000100:00100000:1.0:1651529467.240626:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213125 00000100:00100000:0.0:1651529467.240628:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213126 00000100:00100000:1.0:1651529467.240631:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213127 00000100:00100000:1.0:1651529467.240632:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+143:39030:x1731745946630144:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.240636:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179190 count 1 00002000:00010000:1.0:1651529467.240641:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbf6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.240642:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c53c91 lrc: 3/0,1 mode: --/PW res: [0x2bbf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240645:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529467.240645:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213128 00010000:00010000:1.0:1651529467.240646:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.240647:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c53c91 lrc: 3/0,1 mode: PW/PW res: [0x2bbf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.240647:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+143:39030:x1731745946630272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529467.240650:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c53c91 lrc: 3/0,1 mode: PW/PW res: [0x2bbf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529467.240652:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179308 count 1 00010000:00010000:1.0:1651529467.240653:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c53c91 lrc: 3/0,1 mode: PW/PW res: [0x2bbf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240656:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c53c91 lrc: 2/0,0 mode: PW/PW res: [0x2bbf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.240656:0:72395:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc6c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.240657:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c53c98 lrc: 3/0,1 mode: --/PW res: [0x2bc6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240661:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.240661:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.240662:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c53c98 lrc: 3/0,1 mode: PW/PW res: [0x2bc6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240666:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c53c98 lrc: 3/0,1 mode: PW/PW res: [0x2bc6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240669:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c53c98 lrc: 3/0,1 mode: PW/PW res: [0x2bc6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240672:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c53c98 lrc: 2/0,0 mode: PW/PW res: [0x2bc6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.240686:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+144:39030:x1731745946630144:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 53us (260us total) trans 12885081131 rc 0/0 00000100:00100000:1.0:1651529467.240689:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213127 00000100:00100000:1.0:1651529467.240693:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213129 00000100:00100000:1.0:1651529467.240695:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007f9b0c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+144:39030:x1731745946630400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.240699:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179337 count 1 00002000:00010000:1.0:1651529467.240703:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc89:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.240705:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c53c9f lrc: 3/0,1 mode: --/PW res: [0x2bc89:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.240705:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+144:39030:x1731745946630272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 57us (262us total) trans 12885081132 rc 0/0 00000100:00100000:0.0:1651529467.240707:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213128 00010000:00010000:1.0:1651529467.240710:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.240711:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.240712:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c53c9f lrc: 3/0,1 mode: PW/PW res: [0x2bc89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.240712:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213130 00000100:00100000:0.0:1651529467.240714:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+143:39030:x1731745946630528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529467.240715:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c53c9f lrc: 3/0,1 mode: PW/PW res: [0x2bc89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240718:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c53c9f lrc: 3/0,1 mode: PW/PW res: [0x2bc89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529467.240718:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179355 count 1 00010000:00010000:1.0:1651529467.240721:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c53c9f lrc: 2/0,0 mode: PW/PW res: [0x2bc89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.240722:0:72395:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc9b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.240724:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c53ca6 lrc: 3/0,1 mode: --/PW res: [0x2bc9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240727:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.240728:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.240729:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c53ca6 lrc: 3/0,1 mode: PW/PW res: [0x2bc9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240732:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c53ca6 lrc: 3/0,1 mode: PW/PW res: [0x2bc9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240735:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c53ca6 lrc: 3/0,1 mode: PW/PW res: [0x2bc9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240740:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c53ca6 lrc: 2/0,0 mode: PW/PW res: [0x2bc9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.240751:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007f9b0c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+144:39030:x1731745946630400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 55us (299us total) trans 12885081133 rc 0/0 00000100:00100000:1.0:1651529467.240754:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213129 00010000:00010000:1.0:1651529467.240761:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c53c75 lrc: 2/0,0 mode: PW/PW res: [0x2bc7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240764:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba070658 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.240765:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c53c75 lrc: 2/0,0 mode: PW/PW res: [0x2bc7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240768:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c53c75 lrc: 3/0,0 mode: PW/PW res: [0x2bc7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.240771:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+144:39030:x1731745946630528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 56us (309us total) trans 12885081134 rc 0/0 00000100:00100000:0.0:1651529467.240773:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213130 00010000:00010000:1.0:1651529467.240775:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c53c75 lrc: 1/0,0 mode: --/PW res: [0x2bc7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240778:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c53c75 lrc: 0/0,0 mode: --/PW res: [0x2bc7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240782:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c53c7c lrc: 2/0,0 mode: PW/PW res: [0x2bc2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240784:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000093b5c984 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.240784:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53c83 lrc: 2/0,0 mode: PW/PW res: [0x2bc4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240785:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c53c7c lrc: 2/0,0 mode: PW/PW res: [0x2bc2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240787:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000041a7efd7 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.240788:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c53c7c lrc: 3/0,0 mode: PW/PW res: [0x2bc2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240788:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53c83 lrc: 2/0,0 mode: PW/PW res: [0x2bc4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240791:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c53c7c lrc: 1/0,0 mode: --/PW res: [0x2bc2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240791:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53c83 lrc: 3/0,0 mode: PW/PW res: [0x2bc4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240794:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c53c7c lrc: 0/0,0 mode: --/PW res: [0x2bc2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240796:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53c83 lrc: 1/0,0 mode: --/PW res: [0x2bc4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240806:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c53c8a lrc: 2/0,0 mode: PW/PW res: [0x2bca2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240808:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53c83 lrc: 0/0,0 mode: --/PW res: [0x2bc4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240809:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000062f8a534 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.240810:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c53c8a lrc: 2/0,0 mode: PW/PW res: [0x2bca2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240813:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c53c8a lrc: 3/0,0 mode: PW/PW res: [0x2bca2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240813:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c53c91 lrc: 2/0,0 mode: PW/PW res: [0x2bbf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240816:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c53c8a lrc: 1/0,0 mode: --/PW res: [0x2bca2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240816:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002731c8d2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.240817:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c53c91 lrc: 2/0,0 mode: PW/PW res: [0x2bbf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240819:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c53c8a lrc: 0/0,0 mode: --/PW res: [0x2bca2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240820:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c53c91 lrc: 3/0,0 mode: PW/PW res: [0x2bbf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240822:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c53c98 lrc: 2/0,0 mode: PW/PW res: [0x2bc6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240824:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c53c91 lrc: 1/0,0 mode: --/PW res: [0x2bbf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240825:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000baeec0a3 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.240826:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c53c98 lrc: 2/0,0 mode: PW/PW res: [0x2bc6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240826:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c53c91 lrc: 0/0,0 mode: --/PW res: [0x2bbf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240828:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c53c98 lrc: 3/0,0 mode: PW/PW res: [0x2bc6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240829:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c53c9f lrc: 2/0,0 mode: PW/PW res: [0x2bc89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240831:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c53c98 lrc: 1/0,0 mode: --/PW res: [0x2bc6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240832:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002e24dea3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.240833:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c53c9f lrc: 2/0,0 mode: PW/PW res: [0x2bc89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240834:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c53c98 lrc: 0/0,0 mode: --/PW res: [0x2bc6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240835:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c53c9f lrc: 3/0,0 mode: PW/PW res: [0x2bc89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240838:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c53ca6 lrc: 2/0,0 mode: PW/PW res: [0x2bc9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240838:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c53c9f lrc: 1/0,0 mode: --/PW res: [0x2bc89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.240841:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c53c9f lrc: 0/0,0 mode: --/PW res: [0x2bc89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240843:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2d8d18b already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.240844:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c53ca6 lrc: 2/0,0 mode: PW/PW res: [0x2bc9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240846:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c53ca6 lrc: 3/0,0 mode: PW/PW res: [0x2bc9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240849:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c53ca6 lrc: 1/0,0 mode: --/PW res: [0x2bc9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.240852:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c53ca6 lrc: 0/0,0 mode: --/PW res: [0x2bc9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000001:00100000:0.0:1651529467.241144:0:72382:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a5e20e05-95ba-4d6f-a195-0604c0c0ff53 00000020:00000080:0.0:1651529467.241146:0:72382:0:(genops.c:985:class_export_put()) final put 000000002050d06a/a5e20e05-95ba-4d6f-a195-0604c0c0ff53 00000020:00000080:1.0:1651529467.241158:0:153568:0:(genops.c:944:class_export_destroy()) destroying export 000000002050d06a/a5e20e05-95ba-4d6f-a195-0604c0c0ff53 for lustre-OST0001 00000020:00000080:1.0:1651529467.241252:0:153568:0:(genops.c:1164:obd_zombie_import_free()) destroying import 00000000e254bb62 for lustre-OST0001 00000100:00100000:1.0:1651529467.241285:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.241293:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.241299:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.241309:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.241309:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946631232 00000100:00100000:1.0:1651529467.241317:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.241325:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.241332:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946631360 00000100:00100000:1.0:1651529467.241333:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.241342:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.241349:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946631488 00000100:00100000:1.0:1651529467.241352:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946631616 00000100:00100000:0.0:1651529467.241353:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946631168 00000100:00100000:0.0:1651529467.241360:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213131 00000100:00100000:0.0:1651529467.241362:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+148:39029:x1731745946631232:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529467.241366:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946631296 00002000:00080000:0.0:1651529467.241368:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179286 count 1 00000100:00100000:1.0:1651529467.241369:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946631424 00000100:00100000:1.0:1651529467.241371:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946631552 00002000:00010000:0.0:1651529467.241373:0:80281:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc56:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529467.241374:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213132 00010000:00010000:0.0:1651529467.241375:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c53cad lrc: 3/0,1 mode: --/PW res: [0x2bc56:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.241376:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5ebc6ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+151:39029:x1731745946631360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529467.241379:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.241380:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.241380:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c53cad lrc: 3/0,1 mode: PW/PW res: [0x2bc56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529467.241381:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179258 count 1 00010000:00010000:0.0:1651529467.241384:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c53cad lrc: 3/0,1 mode: PW/PW res: [0x2bc56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.241387:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.241387:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c53cad lrc: 3/0,1 mode: PW/PW res: [0x2bc56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241388:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c53cb4 lrc: 3/0,1 mode: --/PW res: [0x2bc3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241390:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c53cad lrc: 2/0,0 mode: PW/PW res: [0x2bc56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241392:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.241393:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.241394:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c53cb4 lrc: 3/0,1 mode: PW/PW res: [0x2bc3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241397:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c53cb4 lrc: 3/0,1 mode: PW/PW res: [0x2bc3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241400:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c53cb4 lrc: 3/0,1 mode: PW/PW res: [0x2bc3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241403:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c53cb4 lrc: 2/0,0 mode: PW/PW res: [0x2bc3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.241438:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+153:39029:x1731745946631232:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 75us (153us total) trans 12885081135 rc 0/0 00000100:00100000:0.0:1651529467.241441:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213131 00000100:00100000:1.0:1651529467.241447:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5ebc6ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+152:39029:x1731745946631360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 71us (153us total) trans 12885081136 rc 0/0 00000100:00100000:0.0:1651529467.241447:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213133 00000100:00100000:0.0:1651529467.241449:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068b6c75f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+152:39029:x1731745946631488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529467.241450:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213132 00002000:00080000:0.0:1651529467.241453:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179311 count 1 00000100:00100000:1.0:1651529467.241456:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213134 00000100:00100000:1.0:1651529467.241457:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000020362888 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+151:39029:x1731745946631168:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00010000:0.0:1651529467.241458:0:80281:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc6f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.241460:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e600099f/0x3234de053c53cbb lrc: 3/0,1 mode: --/PW res: [0x2bc6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529467.241462:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179407 count 1 00010000:00010000:0.0:1651529467.241463:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.241464:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.241465:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e600099f/0x3234de053c53cbb lrc: 3/0,1 mode: PW/PW res: [0x2bc6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.241466:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bccf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.241468:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c53cc2 lrc: 3/0,1 mode: --/PW res: [0x2bccf:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241468:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e600099f/0x3234de053c53cbb lrc: 3/0,1 mode: PW/PW res: [0x2bc6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241471:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.241471:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e600099f/0x3234de053c53cbb lrc: 3/0,1 mode: PW/PW res: [0x2bc6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241472:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.241473:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c53cc2 lrc: 3/0,1 mode: PW/PW res: [0x2bccf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241474:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e600099f/0x3234de053c53cbb lrc: 2/0,0 mode: PW/PW res: [0x2bc6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241476:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c53cc2 lrc: 3/0,1 mode: PW/PW res: [0x2bccf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241479:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c53cc2 lrc: 3/0,1 mode: PW/PW res: [0x2bccf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241490:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c53cc2 lrc: 2/0,0 mode: PW/PW res: [0x2bccf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.241514:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068b6c75f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+153:39029:x1731745946631488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 64us (214us total) trans 12885081137 rc 0/0 00000100:00100000:0.0:1651529467.241517:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213133 00000100:00100000:0.0:1651529467.241522:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213135 00000100:00100000:0.0:1651529467.241523:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df603127 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+152:39029:x1731745946631616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529467.241524:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000020362888 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+152:39029:x1731745946631168:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 66us (207us total) trans 12885081138 rc 0/0 00000100:00100000:1.0:1651529467.241527:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213134 00002000:00080000:0.0:1651529467.241528:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179249 count 1 00002000:00010000:0.0:1651529467.241532:0:80281:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529467.241533:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213136 00000100:00100000:1.0:1651529467.241534:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003132c0c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+151:39029:x1731745946631296:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529467.241534:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c53cc9 lrc: 3/0,1 mode: --/PW res: [0x2bc31:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241537:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.241538:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1651529467.241539:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179320 count 1 00010000:00010000:0.0:1651529467.241539:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c53cc9 lrc: 3/0,1 mode: PW/PW res: [0x2bc31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241542:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c53cc9 lrc: 3/0,1 mode: PW/PW res: [0x2bc31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.241543:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc78:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.241545:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c53cd0 lrc: 3/0,1 mode: --/PW res: [0x2bc78:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241545:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c53cc9 lrc: 3/0,1 mode: PW/PW res: [0x2bc31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241548:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c53cc9 lrc: 2/0,0 mode: PW/PW res: [0x2bc31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241551:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.241551:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.241552:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c53cd0 lrc: 3/0,1 mode: PW/PW res: [0x2bc78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241555:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c53cd0 lrc: 3/0,1 mode: PW/PW res: [0x2bc78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241558:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c53cd0 lrc: 3/0,1 mode: PW/PW res: [0x2bc78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241561:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c53cd0 lrc: 2/0,0 mode: PW/PW res: [0x2bc78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.241579:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df603127 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+153:39029:x1731745946631616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 54us (269us total) trans 12885081139 rc 0/0 00000100:00100000:0.0:1651529467.241581:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213135 00000100:00100000:0.0:1651529467.241586:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213137 00000100:00100000:0.0:1651529467.241587:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000056e45ef2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+152:39029:x1731745946631424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.241591:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179383 count 1 00000100:00100000:1.0:1651529467.241593:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003132c0c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+152:39029:x1731745946631296:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 58us (267us total) trans 12885081140 rc 0/0 00002000:00010000:0.0:1651529467.241595:0:80281:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcb7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529467.241596:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213136 00010000:00010000:0.0:1651529467.241597:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a1913b4/0x3234de053c53cd7 lrc: 3/0,1 mode: --/PW res: [0x2bcb7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.241601:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213138 00000100:00100000:1.0:1651529467.241602:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9b0314b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+151:39029:x1731745946631552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529467.241602:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.241603:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.241604:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a1913b4/0x3234de053c53cd7 lrc: 3/0,1 mode: PW/PW res: [0x2bcb7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529467.241606:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179408 count 1 00010000:00010000:0.0:1651529467.241607:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a1913b4/0x3234de053c53cd7 lrc: 3/0,1 mode: PW/PW res: [0x2bcb7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241610:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a1913b4/0x3234de053c53cd7 lrc: 3/0,1 mode: PW/PW res: [0x2bcb7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.241611:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcd0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.241612:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c53cde lrc: 3/0,1 mode: --/PW res: [0x2bcd0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241613:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a1913b4/0x3234de053c53cd7 lrc: 2/0,0 mode: PW/PW res: [0x2bcb7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241615:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.241616:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.241617:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c53cde lrc: 3/0,1 mode: PW/PW res: [0x2bcd0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241620:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c53cde lrc: 3/0,1 mode: PW/PW res: [0x2bcd0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241623:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c53cde lrc: 3/0,1 mode: PW/PW res: [0x2bcd0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241626:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c53cde lrc: 2/0,0 mode: PW/PW res: [0x2bcd0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.241643:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000056e45ef2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+153:39029:x1731745946631424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 54us (309us total) trans 12885081141 rc 0/0 00000100:00100000:0.0:1651529467.241645:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213137 00010000:00010000:0.0:1651529467.241656:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c53cad lrc: 2/0,0 mode: PW/PW res: [0x2bc56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.241657:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9b0314b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+152:39029:x1731745946631552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 54us (314us total) trans 12885081142 rc 0/0 00000100:00100000:1.0:1651529467.241660:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213138 00010000:00010000:0.0:1651529467.241660:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000003af78ab already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.241661:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c53cad lrc: 2/0,0 mode: PW/PW res: [0x2bc56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241664:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c53cad lrc: 3/0,0 mode: PW/PW res: [0x2bc56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241667:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c53cb4 lrc: 2/0,0 mode: PW/PW res: [0x2bc3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241670:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001b109cb1 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.241671:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c53cb4 lrc: 2/0,0 mode: PW/PW res: [0x2bc3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241671:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c53cad lrc: 1/0,0 mode: --/PW res: [0x2bc56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241674:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c53cb4 lrc: 3/0,0 mode: PW/PW res: [0x2bc3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241674:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c53cad lrc: 0/0,0 mode: --/PW res: [0x2bc56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241678:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c53cb4 lrc: 1/0,0 mode: --/PW res: [0x2bc3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241678:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e600099f/0x3234de053c53cbb lrc: 2/0,0 mode: PW/PW res: [0x2bc6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241680:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e600099f already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.241681:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c53cb4 lrc: 0/0,0 mode: --/PW res: [0x2bc3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241681:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e600099f/0x3234de053c53cbb lrc: 2/0,0 mode: PW/PW res: [0x2bc6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241684:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e600099f/0x3234de053c53cbb lrc: 3/0,0 mode: PW/PW res: [0x2bc6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241685:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c53cc2 lrc: 2/0,0 mode: PW/PW res: [0x2bccf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241687:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e600099f/0x3234de053c53cbb lrc: 1/0,0 mode: --/PW res: [0x2bc6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241688:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d2b9655c already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.241689:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c53cc2 lrc: 2/0,0 mode: PW/PW res: [0x2bccf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241690:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e600099f/0x3234de053c53cbb lrc: 0/0,0 mode: --/PW res: [0x2bc6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241692:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c53cc2 lrc: 3/0,0 mode: PW/PW res: [0x2bccf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241693:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c53cc9 lrc: 2/0,0 mode: PW/PW res: [0x2bc31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241695:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c53cc2 lrc: 1/0,0 mode: --/PW res: [0x2bccf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241696:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ac1d189d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.241696:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c53cc9 lrc: 2/0,0 mode: PW/PW res: [0x2bc31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241697:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c53cc2 lrc: 0/0,0 mode: --/PW res: [0x2bccf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241699:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c53cc9 lrc: 3/0,0 mode: PW/PW res: [0x2bc31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241701:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c53cd0 lrc: 2/0,0 mode: PW/PW res: [0x2bc78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241703:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d52cc749 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.241703:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c53cc9 lrc: 1/0,0 mode: --/PW res: [0x2bc31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241704:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c53cd0 lrc: 2/0,0 mode: PW/PW res: [0x2bc78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241705:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac1d189d/0x3234de053c53cc9 lrc: 0/0,0 mode: --/PW res: [0x2bc31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241706:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c53cd0 lrc: 3/0,0 mode: PW/PW res: [0x2bc78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241708:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a1913b4/0x3234de053c53cd7 lrc: 2/0,0 mode: PW/PW res: [0x2bcb7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241710:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c53cd0 lrc: 1/0,0 mode: --/PW res: [0x2bc78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241711:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004a1913b4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.241712:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a1913b4/0x3234de053c53cd7 lrc: 2/0,0 mode: PW/PW res: [0x2bcb7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241713:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c53cd0 lrc: 0/0,0 mode: --/PW res: [0x2bc78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241714:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a1913b4/0x3234de053c53cd7 lrc: 3/0,0 mode: PW/PW res: [0x2bcb7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241716:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c53cde lrc: 2/0,0 mode: PW/PW res: [0x2bcd0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241717:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a1913b4/0x3234de053c53cd7 lrc: 1/0,0 mode: --/PW res: [0x2bcb7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241718:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b65e0a0d already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.241719:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c53cde lrc: 2/0,0 mode: PW/PW res: [0x2bcd0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.241720:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a1913b4/0x3234de053c53cd7 lrc: 0/0,0 mode: --/PW res: [0x2bcb7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241722:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c53cde lrc: 3/0,0 mode: PW/PW res: [0x2bcd0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241725:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c53cde lrc: 1/0,0 mode: --/PW res: [0x2bcd0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.241727:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c53cde lrc: 0/0,0 mode: --/PW res: [0x2bcd0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.242037:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.242055:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.242061:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.242071:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.242072:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946631744 00000100:00100000:1.0:1651529467.242079:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.242084:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946631808 00000100:00100000:1.0:1651529467.242085:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.242094:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.242094:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946631872 00000100:00100000:1.0:1651529467.242103:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.242110:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946631936 00000100:00100000:1.0:1651529467.242113:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946632000 00000100:00100000:0.0:1651529467.242114:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946632064 00000100:00100000:0.0:1651529467.242117:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946632192 00000100:00100000:1.0:1651529467.242119:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946632128 00000100:00100000:0.0:1651529467.242121:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213139 00000100:00100000:0.0:1651529467.242122:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+159:39029:x1731745946631744:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529467.242123:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213140 00000100:00100000:1.0:1651529467.242125:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+159:39030:x1731745946631808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.242127:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179392 count 1 00002000:00080000:1.0:1651529467.242130:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179329 count 1 00002000:00010000:0.0:1651529467.242133:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcc0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.242134:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000928e420a/0x3234de053c53ce5 lrc: 3/0,1 mode: --/PW res: [0x2bcc0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.242135:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc81:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.242137:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c53cec lrc: 3/0,1 mode: --/PW res: [0x2bc81:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242138:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.242139:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.242140:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000928e420a/0x3234de053c53ce5 lrc: 3/0,1 mode: PW/PW res: [0x2bcc0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242141:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.242141:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.242142:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c53cec lrc: 3/0,1 mode: PW/PW res: [0x2bc81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242143:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000928e420a/0x3234de053c53ce5 lrc: 3/0,1 mode: PW/PW res: [0x2bcc0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242146:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c53cec lrc: 3/0,1 mode: PW/PW res: [0x2bc81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242146:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000928e420a/0x3234de053c53ce5 lrc: 3/0,1 mode: PW/PW res: [0x2bcc0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242149:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c53cec lrc: 3/0,1 mode: PW/PW res: [0x2bc81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242149:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000928e420a/0x3234de053c53ce5 lrc: 2/0,0 mode: PW/PW res: [0x2bcc0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242151:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c53cec lrc: 2/0,0 mode: PW/PW res: [0x2bc81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.242196:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+161:39030:x1731745946631808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 71us (141us total) trans 12885081144 rc 0/0 00000100:00100000:0.0:1651529467.242196:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+161:39029:x1731745946631744:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 72us (158us total) trans 12885081143 rc 0/0 00000100:00100000:0.0:1651529467.242199:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213139 00000100:00100000:1.0:1651529467.242201:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213140 00000100:00100000:0.0:1651529467.242204:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213141 00000100:00100000:1.0:1651529467.242206:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213142 00000100:00100000:0.0:1651529467.242206:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+159:39029:x1731745946631872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529467.242208:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+159:39030:x1731745946631936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.242210:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179200 count 1 00002000:00080000:1.0:1651529467.242213:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179184 count 1 00002000:00010000:0.0:1651529467.242215:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc00:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.242216:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c53cf3 lrc: 3/0,1 mode: --/PW res: [0x2bc00:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.242217:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbf0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.242219:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c53cfa lrc: 3/0,1 mode: --/PW res: [0x2bbf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242220:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.242220:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.242221:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c53cf3 lrc: 3/0,1 mode: PW/PW res: [0x2bc00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242239:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.242240:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.242241:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c53cfa lrc: 3/0,1 mode: PW/PW res: [0x2bbf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242243:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c53cf3 lrc: 3/0,1 mode: PW/PW res: [0x2bc00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242245:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c53cfa lrc: 3/0,1 mode: PW/PW res: [0x2bbf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242246:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c53cf3 lrc: 3/0,1 mode: PW/PW res: [0x2bc00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242248:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c53cfa lrc: 3/0,1 mode: PW/PW res: [0x2bbf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242249:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c53cf3 lrc: 2/0,0 mode: PW/PW res: [0x2bc00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242250:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c53cfa lrc: 2/0,0 mode: PW/PW res: [0x2bbf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.242288:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+161:39029:x1731745946631872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 81us (226us total) trans 12885081145 rc 0/0 00000100:00100000:0.0:1651529467.242291:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213141 00000100:00100000:1.0:1651529467.242295:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+160:39030:x1731745946631936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 86us (223us total) trans 12885081146 rc 0/0 00000100:00100000:0.0:1651529467.242295:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213143 00000100:00100000:0.0:1651529467.242297:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+160:39030:x1731745946632064:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529467.242298:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213142 00002000:00080000:0.0:1651529467.242301:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179193 count 1 00000100:00100000:1.0:1651529467.242303:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213144 00000100:00100000:1.0:1651529467.242305:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+159:39029:x1731745946632000:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00010000:0.0:1651529467.242306:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbf9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.242307:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c53d01 lrc: 3/0,1 mode: --/PW res: [0x2bbf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529467.242309:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179252 count 1 00010000:00010000:0.0:1651529467.242311:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.242311:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.242312:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c53d01 lrc: 3/0,1 mode: PW/PW res: [0x2bbf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.242313:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.242315:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c53d08 lrc: 3/0,1 mode: --/PW res: [0x2bc34:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242316:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c53d01 lrc: 3/0,1 mode: PW/PW res: [0x2bbf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242319:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.242319:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.242319:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c53d01 lrc: 3/0,1 mode: PW/PW res: [0x2bbf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242320:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c53d08 lrc: 3/0,1 mode: PW/PW res: [0x2bc34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242321:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c53d01 lrc: 2/0,0 mode: PW/PW res: [0x2bbf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242324:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c53d08 lrc: 3/0,1 mode: PW/PW res: [0x2bc34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242326:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c53d08 lrc: 3/0,1 mode: PW/PW res: [0x2bc34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242329:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c53d08 lrc: 2/0,0 mode: PW/PW res: [0x2bc34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.242352:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+161:39030:x1731745946632064:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 54us (266us total) trans 12885081147 rc 0/0 00000100:00100000:0.0:1651529467.242355:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213143 00000100:00100000:0.0:1651529467.242360:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213145 00000100:00100000:0.0:1651529467.242361:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+160:39030:x1731745946632192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529467.242362:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+160:39029:x1731745946632000:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 56us (282us total) trans 12885081148 rc 0/0 00000100:00100000:1.0:1651529467.242364:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213144 00002000:00080000:0.0:1651529467.242365:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179181 count 1 00000100:00100000:1.0:1651529467.242369:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213146 00002000:00010000:0.0:1651529467.242370:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529467.242371:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+159:39029:x1731745946632128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529467.242371:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bb34145/0x3234de053c53d0f lrc: 3/0,1 mode: --/PW res: [0x2bbed:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529467.242375:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179271 count 1 00010000:00010000:0.0:1651529467.242377:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.242378:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.242378:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002bb34145/0x3234de053c53d0f lrc: 3/0,1 mode: PW/PW res: [0x2bbed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.242379:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc47:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.242381:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c53d16 lrc: 3/0,1 mode: --/PW res: [0x2bc47:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242382:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002bb34145/0x3234de053c53d0f lrc: 3/0,1 mode: PW/PW res: [0x2bbed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242384:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.242385:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.242385:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bb34145/0x3234de053c53d0f lrc: 3/0,1 mode: PW/PW res: [0x2bbed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242386:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c53d16 lrc: 3/0,1 mode: PW/PW res: [0x2bc47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242387:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002bb34145/0x3234de053c53d0f lrc: 2/0,0 mode: PW/PW res: [0x2bbed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242389:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c53d16 lrc: 3/0,1 mode: PW/PW res: [0x2bc47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242393:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c53d16 lrc: 3/0,1 mode: PW/PW res: [0x2bc47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242395:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c53d16 lrc: 2/0,0 mode: PW/PW res: [0x2bc47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.242417:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+161:39030:x1731745946632192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 55us (323us total) trans 12885081149 rc 0/0 00000100:00100000:0.0:1651529467.242420:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213145 00000100:00100000:1.0:1651529467.242426:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+160:39029:x1731745946632128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 54us (322us total) trans 12885081150 rc 0/0 00000100:00100000:1.0:1651529467.242429:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213146 00010000:00010000:0.0:1651529467.242434:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000928e420a/0x3234de053c53ce5 lrc: 2/0,0 mode: PW/PW res: [0x2bcc0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242436:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c53cec lrc: 2/0,0 mode: PW/PW res: [0x2bc81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242438:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000928e420a already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.242439:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000075f9ff9d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.242439:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000928e420a/0x3234de053c53ce5 lrc: 2/0,0 mode: PW/PW res: [0x2bcc0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242440:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c53cec lrc: 2/0,0 mode: PW/PW res: [0x2bc81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242441:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000928e420a/0x3234de053c53ce5 lrc: 3/0,0 mode: PW/PW res: [0x2bcc0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242443:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c53cec lrc: 3/0,0 mode: PW/PW res: [0x2bc81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242447:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c53cec lrc: 1/0,0 mode: --/PW res: [0x2bc81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242449:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000928e420a/0x3234de053c53ce5 lrc: 1/0,0 mode: --/PW res: [0x2bcc0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242450:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c53cec lrc: 0/0,0 mode: --/PW res: [0x2bc81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242452:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000928e420a/0x3234de053c53ce5 lrc: 0/0,0 mode: --/PW res: [0x2bcc0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242455:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c53cf3 lrc: 2/0,0 mode: PW/PW res: [0x2bc00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242456:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c53cfa lrc: 2/0,0 mode: PW/PW res: [0x2bbf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242457:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007f539dcd already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.242458:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c53cf3 lrc: 2/0,0 mode: PW/PW res: [0x2bc00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242459:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e35b0bde already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.242459:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c53cfa lrc: 2/0,0 mode: PW/PW res: [0x2bbf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242461:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c53cf3 lrc: 3/0,0 mode: PW/PW res: [0x2bc00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242462:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c53cfa lrc: 3/0,0 mode: PW/PW res: [0x2bbf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242464:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c53cf3 lrc: 1/0,0 mode: --/PW res: [0x2bc00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242465:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c53cfa lrc: 1/0,0 mode: --/PW res: [0x2bbf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242467:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f539dcd/0x3234de053c53cf3 lrc: 0/0,0 mode: --/PW res: [0x2bc00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242468:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c53cfa lrc: 0/0,0 mode: --/PW res: [0x2bbf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242470:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c53d01 lrc: 2/0,0 mode: PW/PW res: [0x2bbf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242472:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c53d08 lrc: 2/0,0 mode: PW/PW res: [0x2bc34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242473:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000676967d8 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.242474:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c53d01 lrc: 2/0,0 mode: PW/PW res: [0x2bbf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242474:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000294488b6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.242475:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c53d08 lrc: 2/0,0 mode: PW/PW res: [0x2bc34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242476:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c53d01 lrc: 3/0,0 mode: PW/PW res: [0x2bbf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242478:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c53d08 lrc: 3/0,0 mode: PW/PW res: [0x2bc34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242479:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c53d01 lrc: 1/0,0 mode: --/PW res: [0x2bbf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242481:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c53d08 lrc: 1/0,0 mode: --/PW res: [0x2bc34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242482:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000676967d8/0x3234de053c53d01 lrc: 0/0,0 mode: --/PW res: [0x2bbf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242484:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c53d08 lrc: 0/0,0 mode: --/PW res: [0x2bc34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242486:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002bb34145/0x3234de053c53d0f lrc: 2/0,0 mode: PW/PW res: [0x2bbed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242487:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c53d16 lrc: 2/0,0 mode: PW/PW res: [0x2bc47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242488:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002bb34145 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.242489:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002bb34145/0x3234de053c53d0f lrc: 2/0,0 mode: PW/PW res: [0x2bbed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242490:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003c5315da already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.242490:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c53d16 lrc: 2/0,0 mode: PW/PW res: [0x2bc47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242492:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002bb34145/0x3234de053c53d0f lrc: 3/0,0 mode: PW/PW res: [0x2bbed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242493:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c53d16 lrc: 3/0,0 mode: PW/PW res: [0x2bc47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242495:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002bb34145/0x3234de053c53d0f lrc: 1/0,0 mode: --/PW res: [0x2bbed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242496:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c53d16 lrc: 1/0,0 mode: --/PW res: [0x2bc47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242498:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002bb34145/0x3234de053c53d0f lrc: 0/0,0 mode: --/PW res: [0x2bbed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242499:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c53d16 lrc: 0/0,0 mode: --/PW res: [0x2bc47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.242744:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.242755:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.242755:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946632768 00000100:00100000:1.0:1651529467.242763:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.242772:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946632832 00000100:00100000:0.0:1651529467.242776:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946632896 00000100:00100000:0.0:1651529467.242782:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213147 00000100:00100000:1.0:1651529467.242784:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.242784:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+162:39029:x1731745946632768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529467.242794:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946632960 00002000:00080000:0.0:1651529467.242794:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179275 count 1 00002000:00010000:0.0:1651529467.242807:0:80281:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc4b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529467.242812:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213148 00000100:00100000:1.0:1651529467.242814:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+163:39030:x1731745946632832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529467.242815:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a091a01a/0x3234de053c53d1d lrc: 3/0,1 mode: --/PW res: [0x2bc4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242819:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.242820:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1651529467.242821:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179396 count 1 00010000:00010000:0.0:1651529467.242821:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a091a01a/0x3234de053c53d1d lrc: 3/0,1 mode: PW/PW res: [0x2bc4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242824:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a091a01a/0x3234de053c53d1d lrc: 3/0,1 mode: PW/PW res: [0x2bc4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.242826:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcc4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.242827:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a091a01a/0x3234de053c53d1d lrc: 3/0,1 mode: PW/PW res: [0x2bc4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242828:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c53d24 lrc: 3/0,1 mode: --/PW res: [0x2bcc4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242830:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a091a01a/0x3234de053c53d1d lrc: 2/0,0 mode: PW/PW res: [0x2bc4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242832:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.242832:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.242833:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c53d24 lrc: 3/0,1 mode: PW/PW res: [0x2bcc4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242837:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c53d24 lrc: 3/0,1 mode: PW/PW res: [0x2bcc4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242840:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c53d24 lrc: 3/0,1 mode: PW/PW res: [0x2bcc4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242843:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c53d24 lrc: 2/0,0 mode: PW/PW res: [0x2bcc4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.242894:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+165:39030:x1731745946632832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 79us (139us total) trans 12885081151 rc 0/0 00000100:00100000:1.0:1651529467.242897:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213148 00000100:00100000:0.0:1651529467.242902:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+164:39029:x1731745946632768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 117us (158us total) trans 12885081152 rc 0/0 00000100:00100000:1.0:1651529467.242903:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213149 00000100:00100000:1.0:1651529467.242904:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+164:39029:x1731745946632896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529467.242905:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213147 00002000:00080000:1.0:1651529467.242909:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179352 count 1 00000100:00100000:0.0:1651529467.242911:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213150 00000100:00100000:0.0:1651529467.242913:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000520b3978 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+163:39030:x1731745946632960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00010000:1.0:1651529467.242914:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc98:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.242916:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c53d2b lrc: 3/0,1 mode: --/PW res: [0x2bc98:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529467.242919:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179335 count 1 00010000:00010000:1.0:1651529467.242920:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.242920:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.242921:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c53d2b lrc: 3/0,1 mode: PW/PW res: [0x2bc98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.242923:0:80281:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc87:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.242925:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c53d2b lrc: 3/0,1 mode: PW/PW res: [0x2bc98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242925:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c53d32 lrc: 3/0,1 mode: --/PW res: [0x2bc87:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242927:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c53d2b lrc: 3/0,1 mode: PW/PW res: [0x2bc98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242928:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.242929:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.242930:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c53d2b lrc: 2/0,0 mode: PW/PW res: [0x2bc98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242930:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c53d32 lrc: 3/0,1 mode: PW/PW res: [0x2bc87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242934:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c53d32 lrc: 3/0,1 mode: PW/PW res: [0x2bc87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242936:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c53d32 lrc: 3/0,1 mode: PW/PW res: [0x2bc87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242948:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c53d32 lrc: 2/0,0 mode: PW/PW res: [0x2bc87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.242971:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+165:39029:x1731745946632896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 66us (208us total) trans 12885081153 rc 0/0 00000100:00100000:1.0:1651529467.242974:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213149 00010000:00010000:1.0:1651529467.242982:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c53d24 lrc: 2/0,0 mode: PW/PW res: [0x2bcc4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.242984:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000520b3978 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+164:39030:x1731745946632960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 71us (204us total) trans 12885081154 rc 0/0 00010000:00010000:1.0:1651529467.242985:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000045fe8361 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.242986:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c53d24 lrc: 2/0,0 mode: PW/PW res: [0x2bcc4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.242987:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213150 00010000:00010000:1.0:1651529467.242989:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c53d24 lrc: 3/0,0 mode: PW/PW res: [0x2bcc4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242996:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c53d24 lrc: 1/0,0 mode: --/PW res: [0x2bcc4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.242997:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a091a01a/0x3234de053c53d1d lrc: 2/0,0 mode: PW/PW res: [0x2bc4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.242999:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045fe8361/0x3234de053c53d24 lrc: 0/0,0 mode: --/PW res: [0x2bcc4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243000:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a091a01a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.243001:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a091a01a/0x3234de053c53d1d lrc: 2/0,0 mode: PW/PW res: [0x2bc4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243003:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c53d2b lrc: 2/0,0 mode: PW/PW res: [0x2bc98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243006:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005a2cb180 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.243006:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c53d2b lrc: 2/0,0 mode: PW/PW res: [0x2bc98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243007:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a091a01a/0x3234de053c53d1d lrc: 3/0,0 mode: PW/PW res: [0x2bc4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243009:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c53d2b lrc: 3/0,0 mode: PW/PW res: [0x2bc98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243012:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c53d2b lrc: 1/0,0 mode: --/PW res: [0x2bc98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243012:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a091a01a/0x3234de053c53d1d lrc: 1/0,0 mode: --/PW res: [0x2bc4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243015:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c53d2b lrc: 0/0,0 mode: --/PW res: [0x2bc98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243015:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a091a01a/0x3234de053c53d1d lrc: 0/0,0 mode: --/PW res: [0x2bc4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243018:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c53d32 lrc: 2/0,0 mode: PW/PW res: [0x2bc87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243021:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001644aaad already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.243022:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c53d32 lrc: 2/0,0 mode: PW/PW res: [0x2bc87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243025:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c53d32 lrc: 3/0,0 mode: PW/PW res: [0x2bc87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243028:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c53d32 lrc: 1/0,0 mode: --/PW res: [0x2bc87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243031:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c53d32 lrc: 0/0,0 mode: --/PW res: [0x2bc87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.243031:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.243040:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946633088 00000100:00100000:1.0:1651529467.243056:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213151 00000100:00100000:1.0:1651529467.243058:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000946e402f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+164:39030:x1731745946633088:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.243063:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179302 count 1 00002000:00010000:1.0:1651529467.243068:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc66:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.243069:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f71e4f3/0x3234de053c53d39 lrc: 3/0,1 mode: --/PW res: [0x2bc66:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243097:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.243098:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.243098:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f71e4f3/0x3234de053c53d39 lrc: 3/0,1 mode: PW/PW res: [0x2bc66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243103:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f71e4f3/0x3234de053c53d39 lrc: 3/0,1 mode: PW/PW res: [0x2bc66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243106:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f71e4f3/0x3234de053c53d39 lrc: 3/0,1 mode: PW/PW res: [0x2bc66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243111:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f71e4f3/0x3234de053c53d39 lrc: 2/0,0 mode: PW/PW res: [0x2bc66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243137:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f71e4f3/0x3234de053c53d39 lrc: 2/0,0 mode: PW/PW res: [0x2bc66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243141:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002f71e4f3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.243142:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f71e4f3/0x3234de053c53d39 lrc: 2/0,0 mode: PW/PW res: [0x2bc66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243145:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f71e4f3/0x3234de053c53d39 lrc: 3/0,0 mode: PW/PW res: [0x2bc66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243150:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f71e4f3/0x3234de053c53d39 lrc: 1/0,0 mode: --/PW res: [0x2bc66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.243156:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000946e402f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+165:39030:x1731745946633088:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 97us (125us total) trans 12885081155 rc 0/0 00010000:00010000:0.0:1651529467.243158:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f71e4f3/0x3234de053c53d39 lrc: 0/0,0 mode: --/PW res: [0x2bc66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.243159:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213151 00000100:00100000:1.0:1651529467.243204:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.243212:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.243219:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.243246:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946633216 00000100:00100000:0.0:1651529467.243248:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946633024 00000100:00100000:1.0:1651529467.243255:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946633152 00000100:00100000:1.0:1651529467.243261:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213152 00000100:00100000:1.0:1651529467.243263:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008e0465ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+167:39030:x1731745946633216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.243268:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179192 count 1 00002000:00010000:1.0:1651529467.243274:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbf8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.243275:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fb1a013/0x3234de053c53d40 lrc: 3/0,1 mode: --/PW res: [0x2bbf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243279:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.243279:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.243280:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fb1a013/0x3234de053c53d40 lrc: 3/0,1 mode: PW/PW res: [0x2bbf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.243283:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213153 00010000:00010000:1.0:1651529467.243284:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fb1a013/0x3234de053c53d40 lrc: 3/0,1 mode: PW/PW res: [0x2bbf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.243285:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e788caed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+167:39029:x1731745946633152:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529467.243287:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fb1a013/0x3234de053c53d40 lrc: 3/0,1 mode: PW/PW res: [0x2bbf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243290:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fb1a013/0x3234de053c53d40 lrc: 2/0,0 mode: PW/PW res: [0x2bbf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529467.243314:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179246 count 1 00002000:00010000:0.0:1651529467.243321:0:72395:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.243322:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c53d47 lrc: 3/0,1 mode: --/PW res: [0x2bc2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243326:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.243327:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.243328:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c53d47 lrc: 3/0,1 mode: PW/PW res: [0x2bc2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243331:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c53d47 lrc: 3/0,1 mode: PW/PW res: [0x2bc2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243334:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c53d47 lrc: 3/0,1 mode: PW/PW res: [0x2bc2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243337:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c53d47 lrc: 2/0,0 mode: PW/PW res: [0x2bc2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.243341:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008e0465ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+168:39030:x1731745946633216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 77us (137us total) trans 12885081156 rc 0/0 00000100:00100000:1.0:1651529467.243350:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213152 00000100:00100000:1.0:1651529467.243355:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213154 00000100:00100000:1.0:1651529467.243357:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000079f8b444 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+167:39029:x1731745946633024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.243361:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179345 count 1 00002000:00010000:1.0:1651529467.243366:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc91:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.243368:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c53d4e lrc: 3/0,1 mode: --/PW res: [0x2bc91:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243371:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.243372:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.243373:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c53d4e lrc: 3/0,1 mode: PW/PW res: [0x2bc91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243376:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c53d4e lrc: 3/0,1 mode: PW/PW res: [0x2bc91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243379:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c53d4e lrc: 3/0,1 mode: PW/PW res: [0x2bc91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243382:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c53d4e lrc: 2/0,0 mode: PW/PW res: [0x2bc91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.243400:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e788caed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+168:39029:x1731745946633152:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 113us (180us total) trans 12885081157 rc 0/0 00000100:00100000:0.0:1651529467.243403:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213153 00010000:00010000:0.0:1651529467.243413:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fb1a013/0x3234de053c53d40 lrc: 2/0,0 mode: PW/PW res: [0x2bbf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243416:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fb1a013 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.243417:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fb1a013/0x3234de053c53d40 lrc: 2/0,0 mode: PW/PW res: [0x2bbf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243420:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fb1a013/0x3234de053c53d40 lrc: 3/0,0 mode: PW/PW res: [0x2bbf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.243424:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000079f8b444 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+168:39029:x1731745946633024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 66us (211us total) trans 12885081158 rc 0/0 00010000:00010000:0.0:1651529467.243425:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fb1a013/0x3234de053c53d40 lrc: 1/0,0 mode: --/PW res: [0x2bbf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.243427:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213154 00010000:00010000:0.0:1651529467.243428:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fb1a013/0x3234de053c53d40 lrc: 0/0,0 mode: --/PW res: [0x2bbf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243432:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c53d47 lrc: 2/0,0 mode: PW/PW res: [0x2bc2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243435:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c53d4e lrc: 2/0,0 mode: PW/PW res: [0x2bc91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243435:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f149aa4b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.243436:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c53d47 lrc: 2/0,0 mode: PW/PW res: [0x2bc2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243438:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000050f78364 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.243438:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c53d47 lrc: 3/0,0 mode: PW/PW res: [0x2bc2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243439:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c53d4e lrc: 2/0,0 mode: PW/PW res: [0x2bc91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243441:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c53d47 lrc: 1/0,0 mode: --/PW res: [0x2bc2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243442:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c53d4e lrc: 3/0,0 mode: PW/PW res: [0x2bc91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243444:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c53d47 lrc: 0/0,0 mode: --/PW res: [0x2bc2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243446:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c53d4e lrc: 1/0,0 mode: --/PW res: [0x2bc91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243449:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c53d4e lrc: 0/0,0 mode: --/PW res: [0x2bc91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.243459:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.243499:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.243504:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946633856 00000100:00100000:0.0:1651529467.243506:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.243514:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946633984 00000100:00100000:0.0:1651529467.243517:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.243519:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946633792 00000100:00100000:1.0:1651529467.243532:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946633920 00000100:00100000:1.0:1651529467.243540:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213155 00000100:00100000:1.0:1651529467.243542:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006501eb7b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+171:39030:x1731745946633856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.243547:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179239 count 1 00002000:00010000:1.0:1651529467.243553:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.243554:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c53d55 lrc: 3/0,1 mode: --/PW res: [0x2bc27:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.243556:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529467.243558:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.243559:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.243559:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c53d55 lrc: 3/0,1 mode: PW/PW res: [0x2bc27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243563:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c53d55 lrc: 3/0,1 mode: PW/PW res: [0x2bc27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.243565:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946634112 00010000:00010000:1.0:1651529467.243566:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c53d55 lrc: 3/0,1 mode: PW/PW res: [0x2bc27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243568:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c53d55 lrc: 2/0,0 mode: PW/PW res: [0x2bc27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.243572:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213156 00000100:00100000:0.0:1651529467.243574:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+172:39030:x1731745946633984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.243585:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179238 count 1 00002000:00010000:0.0:1651529467.243590:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.243592:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c53d5c lrc: 3/0,1 mode: --/PW res: [0x2bc26:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243596:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.243597:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.243597:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c53d5c lrc: 3/0,1 mode: PW/PW res: [0x2bc26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243601:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c53d5c lrc: 3/0,1 mode: PW/PW res: [0x2bc26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243604:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c53d5c lrc: 3/0,1 mode: PW/PW res: [0x2bc26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243607:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c53d5c lrc: 2/0,0 mode: PW/PW res: [0x2bc26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.243611:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006501eb7b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+173:39030:x1731745946633856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 68us (152us total) trans 12885081159 rc 0/0 00000100:00100000:1.0:1651529467.243614:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213155 00000100:00100000:1.0:1651529467.243633:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213157 00000100:00100000:1.0:1651529467.243634:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004de851bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+173:39029:x1731745946633792:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.243639:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179324 count 1 00002000:00010000:1.0:1651529467.243643:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc7c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.243645:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c53d63 lrc: 3/0,1 mode: --/PW res: [0x2bc7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243651:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.243652:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.243653:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c53d63 lrc: 3/0,1 mode: PW/PW res: [0x2bc7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243656:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c53d63 lrc: 3/0,1 mode: PW/PW res: [0x2bc7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243659:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c53d63 lrc: 3/0,1 mode: PW/PW res: [0x2bc7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243661:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c53d63 lrc: 2/0,0 mode: PW/PW res: [0x2bc7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.243673:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+173:39030:x1731745946633984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 97us (173us total) trans 12885081160 rc 0/0 00000100:00100000:0.0:1651529467.243678:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213156 00000100:00100000:0.0:1651529467.243683:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213158 00000100:00100000:0.0:1651529467.243685:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+172:39029:x1731745946633920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.243690:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179354 count 1 00002000:00010000:0.0:1651529467.243695:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc9a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.243697:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c53d6a lrc: 3/0,1 mode: --/PW res: [0x2bc9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243700:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.243701:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.243702:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c53d6a lrc: 3/0,1 mode: PW/PW res: [0x2bc9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243705:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c53d6a lrc: 3/0,1 mode: PW/PW res: [0x2bc9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.243708:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004de851bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+173:39029:x1731745946633792:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 73us (202us total) trans 12885081161 rc 0/0 00010000:00010000:0.0:1651529467.243708:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c53d6a lrc: 3/0,1 mode: PW/PW res: [0x2bc9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.243711:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213157 00010000:00010000:0.0:1651529467.243711:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c53d6a lrc: 2/0,0 mode: PW/PW res: [0x2bc9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.243717:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213159 00000100:00100000:1.0:1651529467.243718:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+172:39030:x1731745946634112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.243723:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179245 count 1 00002000:00010000:1.0:1651529467.243727:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.243729:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c53d71 lrc: 3/0,1 mode: --/PW res: [0x2bc2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243732:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.243733:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.243734:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c53d71 lrc: 3/0,1 mode: PW/PW res: [0x2bc2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243738:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c53d71 lrc: 3/0,1 mode: PW/PW res: [0x2bc2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243741:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c53d71 lrc: 3/0,1 mode: PW/PW res: [0x2bc2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243743:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c53d71 lrc: 2/0,0 mode: PW/PW res: [0x2bc2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.243746:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+173:39029:x1731745946633920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 60us (228us total) trans 12885081162 rc 0/0 00000100:00100000:0.0:1651529467.243748:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213158 00010000:00010000:0.0:1651529467.243759:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c53d55 lrc: 2/0,0 mode: PW/PW res: [0x2bc27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243765:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1791842 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.243767:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c53d55 lrc: 2/0,0 mode: PW/PW res: [0x2bc27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243769:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c53d55 lrc: 3/0,0 mode: PW/PW res: [0x2bc27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243774:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c53d55 lrc: 1/0,0 mode: --/PW res: [0x2bc27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.243775:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+173:39030:x1731745946634112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 56us (237us total) trans 12885081163 rc 0/0 00010000:00010000:0.0:1651529467.243777:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c53d55 lrc: 0/0,0 mode: --/PW res: [0x2bc27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.243778:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213159 00010000:00010000:0.0:1651529467.243781:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c53d5c lrc: 2/0,0 mode: PW/PW res: [0x2bc26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243784:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ee128d1f already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.243785:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c53d63 lrc: 2/0,0 mode: PW/PW res: [0x2bc7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243785:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c53d5c lrc: 2/0,0 mode: PW/PW res: [0x2bc26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243787:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c53d5c lrc: 3/0,0 mode: PW/PW res: [0x2bc26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243788:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6fcae44 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.243789:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c53d63 lrc: 2/0,0 mode: PW/PW res: [0x2bc7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243790:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c53d5c lrc: 1/0,0 mode: --/PW res: [0x2bc26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243792:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c53d63 lrc: 3/0,0 mode: PW/PW res: [0x2bc7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243793:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c53d5c lrc: 0/0,0 mode: --/PW res: [0x2bc26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243797:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c53d63 lrc: 1/0,0 mode: --/PW res: [0x2bc7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243797:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c53d6a lrc: 2/0,0 mode: PW/PW res: [0x2bc9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243808:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054295afd already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.243809:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c53d63 lrc: 0/0,0 mode: --/PW res: [0x2bc7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243809:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c53d6a lrc: 2/0,0 mode: PW/PW res: [0x2bc9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243812:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c53d6a lrc: 3/0,0 mode: PW/PW res: [0x2bc9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243814:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c53d71 lrc: 2/0,0 mode: PW/PW res: [0x2bc2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243815:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c53d6a lrc: 1/0,0 mode: --/PW res: [0x2bc9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243817:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032c39b88 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.243818:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c53d71 lrc: 2/0,0 mode: PW/PW res: [0x2bc2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243818:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c53d6a lrc: 0/0,0 mode: --/PW res: [0x2bc9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243821:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c53d71 lrc: 3/0,0 mode: PW/PW res: [0x2bc2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243824:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c53d71 lrc: 1/0,0 mode: --/PW res: [0x2bc2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243827:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c53d71 lrc: 0/0,0 mode: --/PW res: [0x2bc2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.243834:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.243848:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.243850:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946634240 00000100:00100000:0.0:1651529467.243855:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.243858:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213160 00000100:00100000:1.0:1651529467.243859:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000041d3f4d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+173:39030:x1731745946634240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529467.243862:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946634176 00002000:00080000:1.0:1651529467.243864:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179344 count 1 00000100:00100000:0.0:1651529467.243868:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946634304 00002000:00010000:1.0:1651529467.243869:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc90:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.243870:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c53d78 lrc: 3/0,1 mode: --/PW res: [0x2bc90:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.243872:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213161 00010000:00010000:1.0:1651529467.243873:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529467.243873:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000946e402f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+175:39030:x1731745946634176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529467.243874:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.243875:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c53d78 lrc: 3/0,1 mode: PW/PW res: [0x2bc90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243878:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c53d78 lrc: 3/0,1 mode: PW/PW res: [0x2bc90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529467.243878:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179380 count 1 00010000:00010000:1.0:1651529467.243881:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c53d78 lrc: 3/0,1 mode: PW/PW res: [0x2bc90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.243883:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcb4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.243884:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c53d78 lrc: 2/0,0 mode: PW/PW res: [0x2bc90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243885:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c53d7f lrc: 3/0,1 mode: --/PW res: [0x2bcb4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243889:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.243889:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.243890:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c53d7f lrc: 3/0,1 mode: PW/PW res: [0x2bcb4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243902:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c53d7f lrc: 3/0,1 mode: PW/PW res: [0x2bcb4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243905:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c53d7f lrc: 3/0,1 mode: PW/PW res: [0x2bcb4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243908:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c53d7f lrc: 2/0,0 mode: PW/PW res: [0x2bcb4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.243924:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000041d3f4d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+176:39030:x1731745946634240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 64us (89us total) trans 12885081164 rc 0/0 00000100:00100000:1.0:1651529467.243927:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213160 00000100:00100000:1.0:1651529467.243932:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213162 00000100:00100000:1.0:1651529467.243934:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+176:39030:x1731745946634304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.243938:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179189 count 1 00002000:00010000:1.0:1651529467.243943:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbf5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.243944:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53d86 lrc: 3/0,1 mode: --/PW res: [0x2bbf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.243945:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000946e402f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+176:39030:x1731745946634176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 71us (97us total) trans 12885081165 rc 0/0 00010000:00010000:1.0:1651529467.243948:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.243948:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529467.243948:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213161 00010000:00010000:1.0:1651529467.243949:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53d86 lrc: 3/0,1 mode: PW/PW res: [0x2bbf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243952:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53d86 lrc: 3/0,1 mode: PW/PW res: [0x2bbf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243956:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53d86 lrc: 3/0,1 mode: PW/PW res: [0x2bbf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243957:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c53d78 lrc: 2/0,0 mode: PW/PW res: [0x2bc90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.243959:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53d86 lrc: 2/0,0 mode: PW/PW res: [0x2bbf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243960:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024627ba8 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.243961:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c53d78 lrc: 2/0,0 mode: PW/PW res: [0x2bc90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243964:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c53d78 lrc: 3/0,0 mode: PW/PW res: [0x2bc90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243971:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c53d78 lrc: 1/0,0 mode: --/PW res: [0x2bc90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243974:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c53d78 lrc: 0/0,0 mode: --/PW res: [0x2bc90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243978:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c53d7f lrc: 2/0,0 mode: PW/PW res: [0x2bcb4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243981:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f3240ce7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.243981:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c53d7f lrc: 2/0,0 mode: PW/PW res: [0x2bcb4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243984:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c53d7f lrc: 3/0,0 mode: PW/PW res: [0x2bcb4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243987:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c53d7f lrc: 1/0,0 mode: --/PW res: [0x2bcb4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243990:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c53d7f lrc: 0/0,0 mode: --/PW res: [0x2bcb4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.243993:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+176:39030:x1731745946634304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 58us (137us total) trans 12885081166 rc 0/0 00010000:00010000:0.0:1651529467.243993:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53d86 lrc: 2/0,0 mode: PW/PW res: [0x2bbf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.243995:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213162 00010000:00010000:0.0:1651529467.243996:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f0b0fa2c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.243996:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53d86 lrc: 2/0,0 mode: PW/PW res: [0x2bbf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.243999:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53d86 lrc: 3/0,0 mode: PW/PW res: [0x2bbf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244003:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53d86 lrc: 1/0,0 mode: --/PW res: [0x2bbf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244005:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53d86 lrc: 0/0,0 mode: --/PW res: [0x2bbf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.244306:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.244316:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946634944 00000100:00100000:1.0:1651529467.244325:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213163 00000100:00100000:0.0:1651529467.244326:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.244333:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+176:39029:x1731745946634944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529467.244333:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529467.244338:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179186 count 1 00000100:00100000:0.0:1651529467.244339:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.244347:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00010000:1.0:1651529467.244349:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbf2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.244351:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c53d8d lrc: 3/0,1 mode: --/PW res: [0x2bbf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.244354:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529467.244355:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.244356:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.244357:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c53d8d lrc: 3/0,1 mode: PW/PW res: [0x2bbf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.244359:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529467.244361:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c53d8d lrc: 3/0,1 mode: PW/PW res: [0x2bbf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244363:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c53d8d lrc: 3/0,1 mode: PW/PW res: [0x2bbf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244367:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c53d8d lrc: 2/0,0 mode: PW/PW res: [0x2bbf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.244367:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.244373:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946634880 00000100:00100000:0.0:1651529467.244380:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946635072 00000100:00100000:0.0:1651529467.244383:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946635008 00000100:00100000:0.0:1651529467.244386:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946635200 00000100:00100000:0.0:1651529467.244388:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946635136 00000100:00100000:0.0:1651529467.244390:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946635328 00000100:00100000:0.0:1651529467.244392:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946635264 00000100:00100000:0.0:1651529467.244395:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213164 00000100:00100000:0.0:1651529467.244397:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+184:39030:x1731745946634880:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.244402:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179185 count 1 00000100:00100000:1.0:1651529467.244407:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+184:39029:x1731745946634944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 73us (109us total) trans 12885081167 rc 0/0 00002000:00010000:0.0:1651529467.244408:0:80276:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbf1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529467.244410:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213163 00010000:00010000:0.0:1651529467.244410:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c53d94 lrc: 3/0,1 mode: --/PW res: [0x2bbf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244413:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.244414:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529467.244415:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213165 00010000:00010000:0.0:1651529467.244415:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c53d94 lrc: 3/0,1 mode: PW/PW res: [0x2bbf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.244416:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+183:39029:x1731745946635072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529467.244418:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c53d94 lrc: 3/0,1 mode: PW/PW res: [0x2bbf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529467.244421:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179333 count 1 00010000:00010000:0.0:1651529467.244421:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c53d94 lrc: 3/0,1 mode: PW/PW res: [0x2bbf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244424:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c53d94 lrc: 2/0,0 mode: PW/PW res: [0x2bbf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.244425:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc85:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.244427:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c53d9b lrc: 3/0,1 mode: --/PW res: [0x2bc85:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244430:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.244431:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.244432:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c53d9b lrc: 3/0,1 mode: PW/PW res: [0x2bc85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244435:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c53d9b lrc: 3/0,1 mode: PW/PW res: [0x2bc85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244438:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c53d9b lrc: 3/0,1 mode: PW/PW res: [0x2bc85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244441:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c53d9b lrc: 2/0,0 mode: PW/PW res: [0x2bc85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.244470:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+185:39030:x1731745946634880:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 72us (144us total) trans 12885081168 rc 0/0 00000100:00100000:0.0:1651529467.244473:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213164 00000100:00100000:0.0:1651529467.244478:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213166 00000100:00100000:0.0:1651529467.244479:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+184:39030:x1731745946635008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.244484:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179357 count 1 00000100:00100000:1.0:1651529467.244485:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+184:39029:x1731745946635072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 67us (151us total) trans 12885081169 rc 0/0 00000100:00100000:1.0:1651529467.244488:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213165 00002000:00010000:0.0:1651529467.244489:0:80276:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc9d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.244490:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c53da2 lrc: 3/0,1 mode: --/PW res: [0x2bc9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.244493:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213167 00000100:00100000:1.0:1651529467.244494:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+183:39029:x1731745946635200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529467.244496:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.244497:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1651529467.244498:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179177 count 1 00010000:00010000:0.0:1651529467.244498:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c53da2 lrc: 3/0,1 mode: PW/PW res: [0x2bc9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244501:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c53da2 lrc: 3/0,1 mode: PW/PW res: [0x2bc9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.244503:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbe9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.244504:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c53da2 lrc: 3/0,1 mode: PW/PW res: [0x2bc9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244505:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c53da9 lrc: 3/0,1 mode: --/PW res: [0x2bbe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244507:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c53da2 lrc: 2/0,0 mode: PW/PW res: [0x2bc9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244508:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.244508:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.244509:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c53da9 lrc: 3/0,1 mode: PW/PW res: [0x2bbe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244513:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c53da9 lrc: 3/0,1 mode: PW/PW res: [0x2bbe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244516:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c53da9 lrc: 3/0,1 mode: PW/PW res: [0x2bbe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244518:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c53da9 lrc: 2/0,0 mode: PW/PW res: [0x2bbe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.244540:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+185:39030:x1731745946635008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 59us (200us total) trans 12885081170 rc 0/0 00000100:00100000:0.0:1651529467.244543:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213166 00000100:00100000:0.0:1651529467.244547:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213168 00000100:00100000:1.0:1651529467.244549:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+184:39029:x1731745946635200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 54us (201us total) trans 12885081171 rc 0/0 00000100:00100000:0.0:1651529467.244549:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+184:39030:x1731745946635136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529467.244553:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213167 00002000:00080000:0.0:1651529467.244553:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179394 count 1 00000100:00100000:1.0:1651529467.244558:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213169 00002000:00010000:0.0:1651529467.244558:0:80276:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcc2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.244559:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c53db0 lrc: 3/0,1 mode: --/PW res: [0x2bcc2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.244560:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+183:39029:x1731745946635328:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529467.244563:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.244563:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1651529467.244564:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179415 count 1 00010000:00010000:0.0:1651529467.244564:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c53db0 lrc: 3/0,1 mode: PW/PW res: [0x2bcc2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.244568:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcd7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.244568:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c53db0 lrc: 3/0,1 mode: PW/PW res: [0x2bcc2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244570:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c53db7 lrc: 3/0,1 mode: --/PW res: [0x2bcd7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244571:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c53db0 lrc: 3/0,1 mode: PW/PW res: [0x2bcc2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244573:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.244573:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.244574:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c53db7 lrc: 3/0,1 mode: PW/PW res: [0x2bcd7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244574:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c53db0 lrc: 2/0,0 mode: PW/PW res: [0x2bcc2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244577:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c53db7 lrc: 3/0,1 mode: PW/PW res: [0x2bcd7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244581:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c53db7 lrc: 3/0,1 mode: PW/PW res: [0x2bcd7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244583:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c53db7 lrc: 2/0,0 mode: PW/PW res: [0x2bcd7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.244605:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+185:39030:x1731745946635136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 55us (251us total) trans 12885081172 rc 0/0 00000100:00100000:0.0:1651529467.244608:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213168 00000100:00100000:0.0:1651529467.244612:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213170 00000100:00100000:1.0:1651529467.244614:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+184:39029:x1731745946635328:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 53us (254us total) trans 12885081173 rc 0/0 00000100:00100000:0.0:1651529467.244614:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+184:39030:x1731745946635264:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529467.244617:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213169 00002000:00080000:0.0:1651529467.244618:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179262 count 1 00002000:00010000:0.0:1651529467.244623:0:80276:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.244624:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c53d8d lrc: 2/0,0 mode: PW/PW res: [0x2bbf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244624:0:80276:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c53dbe lrc: 3/0,1 mode: --/PW res: [0x2bc3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244628:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.244628:0:80276:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.244629:0:80276:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c53dbe lrc: 3/0,1 mode: PW/PW res: [0x2bc3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244630:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005635b116 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.244631:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c53d8d lrc: 2/0,0 mode: PW/PW res: [0x2bbf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244632:0:80276:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c53dbe lrc: 3/0,1 mode: PW/PW res: [0x2bc3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244634:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c53d8d lrc: 3/0,0 mode: PW/PW res: [0x2bbf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244638:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c53d8d lrc: 1/0,0 mode: --/PW res: [0x2bbf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244638:0:80276:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c53dbe lrc: 3/0,1 mode: PW/PW res: [0x2bc3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244640:0:80276:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c53dbe lrc: 2/0,0 mode: PW/PW res: [0x2bc3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244641:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c53d8d lrc: 0/0,0 mode: --/PW res: [0x2bbf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244645:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c53d94 lrc: 2/0,0 mode: PW/PW res: [0x2bbf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244648:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000087f212ed already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.244649:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c53d94 lrc: 2/0,0 mode: PW/PW res: [0x2bbf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244651:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c53d94 lrc: 3/0,0 mode: PW/PW res: [0x2bbf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244655:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c53d94 lrc: 1/0,0 mode: --/PW res: [0x2bbf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244657:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c53d94 lrc: 0/0,0 mode: --/PW res: [0x2bbf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244661:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c53d9b lrc: 2/0,0 mode: PW/PW res: [0x2bc85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244664:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000097255e6b already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.244664:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c53d9b lrc: 2/0,0 mode: PW/PW res: [0x2bc85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244667:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c53d9b lrc: 3/0,0 mode: PW/PW res: [0x2bc85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244670:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c53d9b lrc: 1/0,0 mode: --/PW res: [0x2bc85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.244671:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+184:39030:x1731745946635264:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 56us (304us total) trans 12885081174 rc 0/0 00010000:00010000:1.0:1651529467.244672:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c53d9b lrc: 0/0,0 mode: --/PW res: [0x2bc85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.244673:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213170 00010000:00010000:1.0:1651529467.244676:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c53da2 lrc: 2/0,0 mode: PW/PW res: [0x2bc9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244678:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f10dea8 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.244679:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c53da2 lrc: 2/0,0 mode: PW/PW res: [0x2bc9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244682:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c53da2 lrc: 3/0,0 mode: PW/PW res: [0x2bc9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244684:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c53da9 lrc: 2/0,0 mode: PW/PW res: [0x2bbe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244685:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c53da2 lrc: 1/0,0 mode: --/PW res: [0x2bc9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244687:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004f988dee already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.244688:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c53da2 lrc: 0/0,0 mode: --/PW res: [0x2bc9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244688:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c53da9 lrc: 2/0,0 mode: PW/PW res: [0x2bbe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244691:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c53db0 lrc: 2/0,0 mode: PW/PW res: [0x2bcc2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244691:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c53da9 lrc: 3/0,0 mode: PW/PW res: [0x2bbe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244694:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005532ef34 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.244694:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c53db0 lrc: 2/0,0 mode: PW/PW res: [0x2bcc2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244695:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c53da9 lrc: 1/0,0 mode: --/PW res: [0x2bbe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244697:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c53db0 lrc: 3/0,0 mode: PW/PW res: [0x2bcc2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244698:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c53da9 lrc: 0/0,0 mode: --/PW res: [0x2bbe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244700:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c53db0 lrc: 1/0,0 mode: --/PW res: [0x2bcc2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244703:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c53db0 lrc: 0/0,0 mode: --/PW res: [0x2bcc2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244703:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c53db7 lrc: 2/0,0 mode: PW/PW res: [0x2bcd7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244706:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c53dbe lrc: 2/0,0 mode: PW/PW res: [0x2bc3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244706:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f146053f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.244707:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c53db7 lrc: 2/0,0 mode: PW/PW res: [0x2bcd7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244709:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000029e40f3d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.244709:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c53db7 lrc: 3/0,0 mode: PW/PW res: [0x2bcd7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244710:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c53dbe lrc: 2/0,0 mode: PW/PW res: [0x2bc3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244712:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c53db7 lrc: 1/0,0 mode: --/PW res: [0x2bcd7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244715:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c53dbe lrc: 3/0,0 mode: PW/PW res: [0x2bc3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.244715:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c53db7 lrc: 0/0,0 mode: --/PW res: [0x2bcd7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244718:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c53dbe lrc: 1/0,0 mode: --/PW res: [0x2bc3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.244720:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c53dbe lrc: 0/0,0 mode: --/PW res: [0x2bc3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.245021:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.245039:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946635968 00000100:00100000:1.0:1651529467.245053:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213171 00000100:00100000:1.0:1651529467.245054:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+184:39029:x1731745946635968:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529467.245060:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529467.245066:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179226 count 1 00000100:00100000:0.0:1651529467.245068:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00010000:1.0:1651529467.245071:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.245073:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c53dc5 lrc: 3/0,1 mode: --/PW res: [0x2bc1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.245074:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529467.245076:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.245077:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.245078:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c53dc5 lrc: 3/0,1 mode: PW/PW res: [0x2bc1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.245080:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529467.245081:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c53dc5 lrc: 3/0,1 mode: PW/PW res: [0x2bc1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245084:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c53dc5 lrc: 3/0,1 mode: PW/PW res: [0x2bc1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.245086:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529467.245089:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c53dc5 lrc: 2/0,0 mode: PW/PW res: [0x2bc1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.245092:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.245104:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.245111:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946635904 00000100:00100000:0.0:1651529467.245117:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946636096 00000100:00100000:0.0:1651529467.245120:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946636032 00000100:00100000:0.0:1651529467.245127:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946636224 00000100:00100000:0.0:1651529467.245130:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946636160 00000100:00100000:0.0:1651529467.245132:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946636352 00000100:00100000:0.0:1651529467.245134:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946636288 00000100:00100000:0.0:1651529467.245137:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213172 00000100:00100000:1.0:1651529467.245138:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+192:39029:x1731745946635968:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 83us (118us total) trans 12885081175 rc 0/0 00000100:00100000:0.0:1651529467.245139:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+192:39030:x1731745946635904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529467.245141:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213171 00002000:00080000:0.0:1651529467.245144:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179301 count 1 00000100:00100000:1.0:1651529467.245147:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213173 00000100:00100000:1.0:1651529467.245148:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+191:39029:x1731745946636096:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00010000:0.0:1651529467.245150:0:80278:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc65:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.245152:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c53dcc lrc: 3/0,1 mode: --/PW res: [0x2bc65:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529467.245153:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179309 count 1 00010000:00010000:0.0:1651529467.245155:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.245156:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.245157:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c53dcc lrc: 3/0,1 mode: PW/PW res: [0x2bc65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.245158:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc6d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.245159:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c53dd3 lrc: 3/0,1 mode: --/PW res: [0x2bc6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245161:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c53dcc lrc: 3/0,1 mode: PW/PW res: [0x2bc65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245163:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.245163:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c53dcc lrc: 3/0,1 mode: PW/PW res: [0x2bc65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245164:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.245164:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c53dd3 lrc: 3/0,1 mode: PW/PW res: [0x2bc6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245166:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c53dcc lrc: 2/0,0 mode: PW/PW res: [0x2bc65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245168:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c53dd3 lrc: 3/0,1 mode: PW/PW res: [0x2bc6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245171:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c53dd3 lrc: 3/0,1 mode: PW/PW res: [0x2bc6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245174:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c53dd3 lrc: 2/0,0 mode: PW/PW res: [0x2bc6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.245204:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+193:39030:x1731745946635904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 64us (143us total) trans 12885081176 rc 0/0 00000100:00100000:0.0:1651529467.245207:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213172 00000100:00100000:1.0:1651529467.245212:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+192:39029:x1731745946636096:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 63us (143us total) trans 12885081177 rc 0/0 00000100:00100000:0.0:1651529467.245212:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213174 00000100:00100000:0.0:1651529467.245214:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+192:39030:x1731745946636032:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529467.245215:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213173 00002000:00080000:0.0:1651529467.245218:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179270 count 1 00000100:00100000:1.0:1651529467.245220:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213175 00000100:00100000:1.0:1651529467.245241:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+191:39029:x1731745946636224:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00010000:0.0:1651529467.245244:0:80278:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc46:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00080000:1.0:1651529467.245246:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179231 count 1 00010000:00010000:0.0:1651529467.245246:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c53dda lrc: 3/0,1 mode: --/PW res: [0x2bc46:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245250:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.245250:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00010000:1.0:1651529467.245251:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.245251:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c53dda lrc: 3/0,1 mode: PW/PW res: [0x2bc46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245253:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c53de1 lrc: 3/0,1 mode: --/PW res: [0x2bc1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245255:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c53dda lrc: 3/0,1 mode: PW/PW res: [0x2bc46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245256:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.245257:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.245258:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c53de1 lrc: 3/0,1 mode: PW/PW res: [0x2bc1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245258:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c53dda lrc: 3/0,1 mode: PW/PW res: [0x2bc46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245260:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c53dda lrc: 2/0,0 mode: PW/PW res: [0x2bc46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245261:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c53de1 lrc: 3/0,1 mode: PW/PW res: [0x2bc1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245264:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c53de1 lrc: 3/0,1 mode: PW/PW res: [0x2bc1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245267:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c53de1 lrc: 2/0,0 mode: PW/PW res: [0x2bc1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.245294:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+193:39030:x1731745946636032:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 80us (219us total) trans 12885081178 rc 0/0 00000100:00100000:0.0:1651529467.245297:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213174 00000100:00100000:1.0:1651529467.245302:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+192:39029:x1731745946636224:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 79us (221us total) trans 12885081179 rc 0/0 00000100:00100000:0.0:1651529467.245302:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213176 00000100:00100000:0.0:1651529467.245304:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+192:39030:x1731745946636160:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529467.245306:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213175 00002000:00080000:0.0:1651529467.245308:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179390 count 1 00000100:00100000:1.0:1651529467.245312:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213177 00000100:00100000:1.0:1651529467.245313:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+191:39029:x1731745946636352:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00010000:0.0:1651529467.245313:0:80278:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcbe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.245315:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c53de8 lrc: 3/0,1 mode: --/PW res: [0x2bcbe:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529467.245318:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179303 count 1 00010000:00010000:0.0:1651529467.245320:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.245321:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00010000:1.0:1651529467.245322:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc67:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.245322:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c53de8 lrc: 3/0,1 mode: PW/PW res: [0x2bcbe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245324:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c53def lrc: 3/0,1 mode: --/PW res: [0x2bc67:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245325:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c53de8 lrc: 3/0,1 mode: PW/PW res: [0x2bcbe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245327:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.245327:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.245328:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c53def lrc: 3/0,1 mode: PW/PW res: [0x2bc67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245328:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c53de8 lrc: 3/0,1 mode: PW/PW res: [0x2bcbe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245331:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c53de8 lrc: 2/0,0 mode: PW/PW res: [0x2bcbe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245332:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c53def lrc: 3/0,1 mode: PW/PW res: [0x2bc67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245335:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c53def lrc: 3/0,1 mode: PW/PW res: [0x2bc67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245338:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c53def lrc: 2/0,0 mode: PW/PW res: [0x2bc67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.245361:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+193:39030:x1731745946636160:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 57us (275us total) trans 12885081180 rc 0/0 00000100:00100000:0.0:1651529467.245364:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213176 00000100:00100000:1.0:1651529467.245369:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+192:39029:x1731745946636352:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 55us (277us total) trans 12885081181 rc 0/0 00000100:00100000:0.0:1651529467.245369:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213178 00000100:00100000:0.0:1651529467.245370:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+192:39030:x1731745946636288:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529467.245372:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213177 00002000:00080000:0.0:1651529467.245374:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179191 count 1 00010000:00010000:1.0:1651529467.245379:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c53dc5 lrc: 2/0,0 mode: PW/PW res: [0x2bc1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.245379:0:80278:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbf7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.245380:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c53df6 lrc: 3/0,1 mode: --/PW res: [0x2bbf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245384:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.245384:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.245385:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000819c7a2f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.245385:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c53df6 lrc: 3/0,1 mode: PW/PW res: [0x2bbf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245386:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c53dc5 lrc: 2/0,0 mode: PW/PW res: [0x2bc1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245388:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c53dc5 lrc: 3/0,0 mode: PW/PW res: [0x2bc1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245389:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c53df6 lrc: 3/0,1 mode: PW/PW res: [0x2bbf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245392:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c53df6 lrc: 3/0,1 mode: PW/PW res: [0x2bbf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245393:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c53dc5 lrc: 1/0,0 mode: --/PW res: [0x2bc1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245394:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c53df6 lrc: 2/0,0 mode: PW/PW res: [0x2bbf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245395:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c53dc5 lrc: 0/0,0 mode: --/PW res: [0x2bc1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245400:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c53dcc lrc: 2/0,0 mode: PW/PW res: [0x2bc65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245402:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032eb11d3 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.245403:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c53dcc lrc: 2/0,0 mode: PW/PW res: [0x2bc65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245406:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c53dcc lrc: 3/0,0 mode: PW/PW res: [0x2bc65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245409:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c53dcc lrc: 1/0,0 mode: --/PW res: [0x2bc65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245412:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c53dcc lrc: 0/0,0 mode: --/PW res: [0x2bc65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245415:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c53dd3 lrc: 2/0,0 mode: PW/PW res: [0x2bc6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245418:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f616ea25 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.245419:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c53dd3 lrc: 2/0,0 mode: PW/PW res: [0x2bc6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245421:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c53dd3 lrc: 3/0,0 mode: PW/PW res: [0x2bc6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245424:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c53dd3 lrc: 1/0,0 mode: --/PW res: [0x2bc6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.245424:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+192:39030:x1731745946636288:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 53us (320us total) trans 12885081182 rc 0/0 00010000:00010000:1.0:1651529467.245427:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c53dd3 lrc: 0/0,0 mode: --/PW res: [0x2bc6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.245427:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213178 00010000:00010000:1.0:1651529467.245430:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c53dda lrc: 2/0,0 mode: PW/PW res: [0x2bc46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245433:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005c863cd2 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.245433:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c53dda lrc: 2/0,0 mode: PW/PW res: [0x2bc46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245436:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c53dda lrc: 3/0,0 mode: PW/PW res: [0x2bc46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245438:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c53de1 lrc: 2/0,0 mode: PW/PW res: [0x2bc1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245439:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c53dda lrc: 1/0,0 mode: --/PW res: [0x2bc46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245441:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b65e0a0d already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.245442:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c53dda lrc: 0/0,0 mode: --/PW res: [0x2bc46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245442:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c53de1 lrc: 2/0,0 mode: PW/PW res: [0x2bc1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245445:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c53de1 lrc: 3/0,0 mode: PW/PW res: [0x2bc1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245446:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c53de8 lrc: 2/0,0 mode: PW/PW res: [0x2bcbe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245448:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000314b5fa1 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.245449:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c53de8 lrc: 2/0,0 mode: PW/PW res: [0x2bcbe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245449:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c53de1 lrc: 1/0,0 mode: --/PW res: [0x2bc1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245451:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c53de8 lrc: 3/0,0 mode: PW/PW res: [0x2bcbe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245452:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c53de1 lrc: 0/0,0 mode: --/PW res: [0x2bc1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245454:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c53de8 lrc: 1/0,0 mode: --/PW res: [0x2bcbe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245457:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c53de8 lrc: 0/0,0 mode: --/PW res: [0x2bcbe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245457:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c53def lrc: 2/0,0 mode: PW/PW res: [0x2bc67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245460:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c53df6 lrc: 2/0,0 mode: PW/PW res: [0x2bbf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245460:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d52cc749 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.245461:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c53def lrc: 2/0,0 mode: PW/PW res: [0x2bc67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245463:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cd5f3a7c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.245463:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c53def lrc: 3/0,0 mode: PW/PW res: [0x2bc67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245464:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c53df6 lrc: 2/0,0 mode: PW/PW res: [0x2bbf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245467:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c53def lrc: 1/0,0 mode: --/PW res: [0x2bc67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245469:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c53df6 lrc: 3/0,0 mode: PW/PW res: [0x2bbf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245469:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c53def lrc: 0/0,0 mode: --/PW res: [0x2bc67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245472:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c53df6 lrc: 1/0,0 mode: --/PW res: [0x2bbf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245475:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c53df6 lrc: 0/0,0 mode: --/PW res: [0x2bbf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.245748:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.245767:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946636992 00000100:00100000:1.0:1651529467.245776:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213179 00000100:00100000:1.0:1651529467.245785:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+192:39029:x1731745946636992:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529467.245785:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529467.245790:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179206 count 1 00002000:00010000:1.0:1651529467.245796:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc06:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.245797:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c53dfd lrc: 3/0,1 mode: --/PW res: [0x2bc06:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245810:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.245810:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.245811:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c53dfd lrc: 3/0,1 mode: PW/PW res: [0x2bc06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245815:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c53dfd lrc: 3/0,1 mode: PW/PW res: [0x2bc06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245818:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c53dfd lrc: 3/0,1 mode: PW/PW res: [0x2bc06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.245822:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529467.245829:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c53dfd lrc: 2/0,0 mode: PW/PW res: [0x2bc06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.245829:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.245835:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.245850:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.245857:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.245867:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.245874:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+193:39029:x1731745946636992:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 88us (135us total) trans 12885081183 rc 0/0 00000100:00100000:1.0:1651529467.245877:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213179 00000100:00100000:1.0:1651529467.245882:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946637056 00000100:00100000:0.0:1651529467.245897:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946637120 00000100:00100000:1.0:1651529467.245899:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946637184 00000100:00100000:0.0:1651529467.245905:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946637248 00000100:00100000:1.0:1651529467.245906:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946637312 00000100:00100000:0.0:1651529467.245907:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946637376 00000100:00100000:1.0:1651529467.245909:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946637440 00000100:00100000:0.0:1651529467.245911:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213180 00000100:00100000:0.0:1651529467.245913:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+199:39030:x1731745946637056:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529467.245914:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213181 00000100:00100000:1.0:1651529467.245916:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+199:39029:x1731745946637120:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.245918:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179202 count 1 00002000:00080000:1.0:1651529467.245921:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179342 count 1 00002000:00010000:0.0:1651529467.245924:0:80280:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc02:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:1.0:1651529467.245926:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc8e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.245926:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53e04 lrc: 3/0,1 mode: --/PW res: [0x2bc02:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245927:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c53e0b lrc: 3/0,1 mode: --/PW res: [0x2bc8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245929:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.245930:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.245931:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.245931:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.245931:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53e04 lrc: 3/0,1 mode: PW/PW res: [0x2bc02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245932:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c53e0b lrc: 3/0,1 mode: PW/PW res: [0x2bc8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245934:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53e04 lrc: 3/0,1 mode: PW/PW res: [0x2bc02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245936:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c53e0b lrc: 3/0,1 mode: PW/PW res: [0x2bc8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245937:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53e04 lrc: 3/0,1 mode: PW/PW res: [0x2bc02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245939:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c53e0b lrc: 3/0,1 mode: PW/PW res: [0x2bc8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.245940:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53e04 lrc: 2/0,0 mode: PW/PW res: [0x2bc02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.245944:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c53e0b lrc: 2/0,0 mode: PW/PW res: [0x2bc8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.245979:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+201:39030:x1731745946637056:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 65us (194us total) trans 12885081184 rc 0/0 00000100:00100000:0.0:1651529467.245982:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213180 00000100:00100000:0.0:1651529467.245987:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213182 00000100:00100000:0.0:1651529467.245989:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+200:39030:x1731745946637184:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.245993:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179180 count 1 00000100:00100000:1.0:1651529467.245994:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+200:39029:x1731745946637120:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 77us (172us total) trans 12885081185 rc 0/0 00000100:00100000:1.0:1651529467.245997:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213181 00002000:00010000:0.0:1651529467.245998:0:80280:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.246000:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c53e12 lrc: 3/0,1 mode: --/PW res: [0x2bbec:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.246002:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213183 00010000:00010000:0.0:1651529467.246003:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529467.246004:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+199:39029:x1731745946637248:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529467.246004:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.246005:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c53e12 lrc: 3/0,1 mode: PW/PW res: [0x2bbec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529467.246008:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179207 count 1 00010000:00010000:0.0:1651529467.246008:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c53e12 lrc: 3/0,1 mode: PW/PW res: [0x2bbec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246011:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c53e12 lrc: 3/0,1 mode: PW/PW res: [0x2bbec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.246013:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc07:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.246014:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c53e12 lrc: 2/0,0 mode: PW/PW res: [0x2bbec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246015:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c53e19 lrc: 3/0,1 mode: --/PW res: [0x2bc07:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246018:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.246019:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.246020:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c53e19 lrc: 3/0,1 mode: PW/PW res: [0x2bc07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246023:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c53e19 lrc: 3/0,1 mode: PW/PW res: [0x2bc07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246026:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c53e19 lrc: 3/0,1 mode: PW/PW res: [0x2bc07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246029:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c53e19 lrc: 2/0,0 mode: PW/PW res: [0x2bc07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.246045:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+201:39030:x1731745946637184:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 55us (216us total) trans 12885081186 rc 0/0 00000100:00100000:0.0:1651529467.246048:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213182 00000100:00100000:0.0:1651529467.246053:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213184 00000100:00100000:0.0:1651529467.246054:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000002e08c45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+200:39030:x1731745946637312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.246059:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179224 count 1 00000100:00100000:1.0:1651529467.246063:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+200:39029:x1731745946637248:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 58us (227us total) trans 12885081187 rc 0/0 00002000:00010000:0.0:1651529467.246063:0:80280:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.246064:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c53e20 lrc: 3/0,1 mode: --/PW res: [0x2bc18:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.246066:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213183 00010000:00010000:0.0:1651529467.246070:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529467.246071:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213185 00010000:00010000:0.0:1651529467.246071:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.246071:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c53e20 lrc: 3/0,1 mode: PW/PW res: [0x2bc18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.246072:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+199:39029:x1731745946637376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529467.246075:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c53e20 lrc: 3/0,1 mode: PW/PW res: [0x2bc18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529467.246076:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179410 count 1 00010000:00010000:0.0:1651529467.246077:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c53e20 lrc: 3/0,1 mode: PW/PW res: [0x2bc18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246080:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c53e20 lrc: 2/0,0 mode: PW/PW res: [0x2bc18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.246081:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcd2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.246082:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c53e27 lrc: 3/0,1 mode: --/PW res: [0x2bcd2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246086:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.246086:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.246087:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c53e27 lrc: 3/0,1 mode: PW/PW res: [0x2bcd2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246091:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c53e27 lrc: 3/0,1 mode: PW/PW res: [0x2bcd2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246093:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c53e27 lrc: 3/0,1 mode: PW/PW res: [0x2bcd2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246096:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c53e27 lrc: 2/0,0 mode: PW/PW res: [0x2bcd2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.246112:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000002e08c45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+201:39030:x1731745946637312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 56us (261us total) trans 12885081188 rc 0/0 00000100:00100000:0.0:1651529467.246114:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213184 00000100:00100000:1.0:1651529467.246126:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+200:39029:x1731745946637376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 53us (269us total) trans 12885081189 rc 0/0 00000100:00100000:1.0:1651529467.246131:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213185 00000100:00100000:1.0:1651529467.246135:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213186 00000100:00100000:1.0:1651529467.246137:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009dfac288 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+199:39030:x1731745946637440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.246141:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179350 count 1 00002000:00010000:1.0:1651529467.246145:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc96:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.246147:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c53e2e lrc: 3/0,1 mode: --/PW res: [0x2bc96:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246150:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.246150:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.246151:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c53e2e lrc: 3/0,1 mode: PW/PW res: [0x2bc96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246155:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c53e2e lrc: 3/0,1 mode: PW/PW res: [0x2bc96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246156:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c53dfd lrc: 2/0,0 mode: PW/PW res: [0x2bc06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246158:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c53e2e lrc: 3/0,1 mode: PW/PW res: [0x2bc96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246160:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c53e2e lrc: 2/0,0 mode: PW/PW res: [0x2bc96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246160:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d2b9655c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.246161:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c53dfd lrc: 2/0,0 mode: PW/PW res: [0x2bc06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246164:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c53dfd lrc: 3/0,0 mode: PW/PW res: [0x2bc06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246172:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c53dfd lrc: 1/0,0 mode: --/PW res: [0x2bc06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246175:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c53dfd lrc: 0/0,0 mode: --/PW res: [0x2bc06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246179:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53e04 lrc: 2/0,0 mode: PW/PW res: [0x2bc02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246181:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006cbd0d09 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.246182:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53e04 lrc: 2/0,0 mode: PW/PW res: [0x2bc02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246185:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53e04 lrc: 3/0,0 mode: PW/PW res: [0x2bc02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246188:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53e04 lrc: 1/0,0 mode: --/PW res: [0x2bc02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.246190:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009dfac288 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+200:39030:x1731745946637440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 52us (323us total) trans 12885081190 rc 0/0 00010000:00010000:0.0:1651529467.246191:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53e04 lrc: 0/0,0 mode: --/PW res: [0x2bc02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.246193:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213186 00010000:00010000:0.0:1651529467.246194:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c53e0b lrc: 2/0,0 mode: PW/PW res: [0x2bc8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246197:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001b109cb1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.246197:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c53e0b lrc: 2/0,0 mode: PW/PW res: [0x2bc8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246200:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c53e12 lrc: 2/0,0 mode: PW/PW res: [0x2bbec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246200:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c53e0b lrc: 3/0,0 mode: PW/PW res: [0x2bc8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246203:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c53e0b lrc: 1/0,0 mode: --/PW res: [0x2bc8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246205:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ebdbebae already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.246206:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c53e12 lrc: 2/0,0 mode: PW/PW res: [0x2bbec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246206:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c53e0b lrc: 0/0,0 mode: --/PW res: [0x2bc8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246209:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c53e12 lrc: 3/0,0 mode: PW/PW res: [0x2bbec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246209:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c53e19 lrc: 2/0,0 mode: PW/PW res: [0x2bc07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246212:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000093b5c984 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.246213:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c53e12 lrc: 1/0,0 mode: --/PW res: [0x2bbec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246213:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c53e19 lrc: 2/0,0 mode: PW/PW res: [0x2bc07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246215:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c53e19 lrc: 3/0,0 mode: PW/PW res: [0x2bc07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246216:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c53e12 lrc: 0/0,0 mode: --/PW res: [0x2bbec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246218:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c53e19 lrc: 1/0,0 mode: --/PW res: [0x2bc07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246220:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c53e20 lrc: 2/0,0 mode: PW/PW res: [0x2bc18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246221:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c53e19 lrc: 0/0,0 mode: --/PW res: [0x2bc07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246238:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000029958df2 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.246239:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c53e20 lrc: 2/0,0 mode: PW/PW res: [0x2bc18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246241:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c53e27 lrc: 2/0,0 mode: PW/PW res: [0x2bcd2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246242:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c53e20 lrc: 3/0,0 mode: PW/PW res: [0x2bc18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246246:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c53e20 lrc: 1/0,0 mode: --/PW res: [0x2bc18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246247:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002e24dea3 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.246248:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c53e20 lrc: 0/0,0 mode: --/PW res: [0x2bc18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246248:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c53e27 lrc: 2/0,0 mode: PW/PW res: [0x2bcd2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246251:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c53e27 lrc: 3/0,0 mode: PW/PW res: [0x2bcd2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246253:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c53e2e lrc: 2/0,0 mode: PW/PW res: [0x2bc96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246254:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c53e27 lrc: 1/0,0 mode: --/PW res: [0x2bcd2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246256:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002731c8d2 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.246256:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c53e2e lrc: 2/0,0 mode: PW/PW res: [0x2bc96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246257:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c53e27 lrc: 0/0,0 mode: --/PW res: [0x2bcd2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246259:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c53e2e lrc: 3/0,0 mode: PW/PW res: [0x2bc96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246262:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c53e2e lrc: 1/0,0 mode: --/PW res: [0x2bc96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246265:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c53e2e lrc: 0/0,0 mode: --/PW res: [0x2bc96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.246290:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.246372:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946637888 00000100:00100000:1.0:1651529467.246380:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213187 00000100:00100000:1.0:1651529467.246381:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004c03f4d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+200:39029:x1731745946637888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.246393:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179367 count 1 00002000:00010000:1.0:1651529467.246399:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bca7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.246401:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53e35 lrc: 3/0,1 mode: --/PW res: [0x2bca7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246404:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.246405:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.246406:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53e35 lrc: 3/0,1 mode: PW/PW res: [0x2bca7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246409:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53e35 lrc: 3/0,1 mode: PW/PW res: [0x2bca7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246412:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53e35 lrc: 3/0,1 mode: PW/PW res: [0x2bca7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246415:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53e35 lrc: 2/0,0 mode: PW/PW res: [0x2bca7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246434:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53e35 lrc: 2/0,0 mode: PW/PW res: [0x2bca7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246438:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000041a7efd7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.246439:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53e35 lrc: 2/0,0 mode: PW/PW res: [0x2bca7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246442:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53e35 lrc: 3/0,0 mode: PW/PW res: [0x2bca7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246447:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53e35 lrc: 1/0,0 mode: --/PW res: [0x2bca7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246452:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c53e35 lrc: 0/0,0 mode: --/PW res: [0x2bca7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.246459:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004c03f4d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+201:39029:x1731745946637888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 76us (168us total) trans 12885081191 rc 0/0 00000100:00100000:1.0:1651529467.246462:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213187 00000100:00100000:1.0:1651529467.246516:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.246542:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.246551:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.246560:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.246572:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946638080 00000100:00100000:1.0:1651529467.246576:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.246591:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.246595:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946638144 00000100:00100000:0.0:1651529467.246605:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946638272 00000100:00100000:1.0:1651529467.246609:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.246610:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946638400 00000100:00100000:1.0:1651529467.246619:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946638208 00000100:00100000:0.0:1651529467.246621:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946638336 00000100:00100000:0.0:1651529467.246625:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946638464 00000100:00100000:1.0:1651529467.246626:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213188 00000100:00100000:1.0:1651529467.246628:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000520b3978 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+207:39030:x1731745946638080:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529467.246629:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213189 00000100:00100000:0.0:1651529467.246631:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008e0465ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+207:39029:x1731745946638144:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.246633:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179222 count 1 00002000:00080000:0.0:1651529467.246636:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179387 count 1 00002000:00010000:1.0:1651529467.246639:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.246641:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c53e3c lrc: 3/0,1 mode: --/PW res: [0x2bc16:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.246642:0:80281:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcbb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.246644:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c53e43 lrc: 3/0,1 mode: --/PW res: [0x2bcbb:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246645:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.246645:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.246646:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c53e3c lrc: 3/0,1 mode: PW/PW res: [0x2bc16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246647:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.246648:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.246649:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c53e43 lrc: 3/0,1 mode: PW/PW res: [0x2bcbb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246650:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c53e3c lrc: 3/0,1 mode: PW/PW res: [0x2bc16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246652:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c53e43 lrc: 3/0,1 mode: PW/PW res: [0x2bcbb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246653:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c53e3c lrc: 3/0,1 mode: PW/PW res: [0x2bc16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246655:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c53e3c lrc: 2/0,0 mode: PW/PW res: [0x2bc16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246655:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c53e43 lrc: 3/0,1 mode: PW/PW res: [0x2bcbb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246658:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c53e43 lrc: 2/0,0 mode: PW/PW res: [0x2bcbb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.246712:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000520b3978 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+209:39030:x1731745946638080:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 83us (196us total) trans 12885081192 rc 0/0 00000100:00100000:1.0:1651529467.246715:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213188 00000100:00100000:1.0:1651529467.246721:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213190 00000100:00100000:1.0:1651529467.246723:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e788caed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+208:39029:x1731745946638272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.246727:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179292 count 1 00000100:00100000:0.0:1651529467.246729:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008e0465ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+208:39029:x1731745946638144:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 97us (193us total) trans 12885081193 rc 0/0 00002000:00010000:1.0:1651529467.246732:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc5c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1651529467.246733:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213189 00010000:00010000:1.0:1651529467.246734:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c53e4a lrc: 3/0,1 mode: --/PW res: [0x2bc5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246738:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.246738:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529467.246738:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213191 00010000:00010000:1.0:1651529467.246739:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c53e4a lrc: 3/0,1 mode: PW/PW res: [0x2bc5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.246739:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000079f8b444 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+207:39029:x1731745946638400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529467.246743:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c53e4a lrc: 3/0,1 mode: PW/PW res: [0x2bc5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529467.246744:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179313 count 1 00010000:00010000:1.0:1651529467.246746:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c53e4a lrc: 3/0,1 mode: PW/PW res: [0x2bc5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246748:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c53e4a lrc: 2/0,0 mode: PW/PW res: [0x2bc5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.246749:0:80281:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc71:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.246750:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c53e51 lrc: 3/0,1 mode: --/PW res: [0x2bc71:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246754:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.246763:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.246764:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c53e51 lrc: 3/0,1 mode: PW/PW res: [0x2bc71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246768:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c53e51 lrc: 3/0,1 mode: PW/PW res: [0x2bc71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246771:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c53e51 lrc: 3/0,1 mode: PW/PW res: [0x2bc71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246774:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c53e51 lrc: 2/0,0 mode: PW/PW res: [0x2bc71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.246787:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e788caed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+208:39029:x1731745946638272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 64us (236us total) trans 12885081194 rc 0/0 00000100:00100000:1.0:1651529467.246790:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213190 00000100:00100000:1.0:1651529467.246795:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213192 00000100:00100000:1.0:1651529467.246797:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7dfc8bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+208:39029:x1731745946638336:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.246810:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179274 count 1 00002000:00010000:1.0:1651529467.246815:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc4a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.246816:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c53e58 lrc: 3/0,1 mode: --/PW res: [0x2bc4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.246819:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000079f8b444 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+208:39029:x1731745946638400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 78us (258us total) trans 12885081195 rc 0/0 00010000:00010000:1.0:1651529467.246820:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.246820:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.246821:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c53e58 lrc: 3/0,1 mode: PW/PW res: [0x2bc4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246824:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c53e58 lrc: 3/0,1 mode: PW/PW res: [0x2bc4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.246824:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213191 00000100:00100000:0.0:1651529467.246829:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213193 00010000:00010000:1.0:1651529467.246830:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c53e58 lrc: 3/0,1 mode: PW/PW res: [0x2bc4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.246831:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000380bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+207:39029:x1731745946638208:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529467.246832:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c53e58 lrc: 2/0,0 mode: PW/PW res: [0x2bc4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529467.246836:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179285 count 1 00002000:00010000:0.0:1651529467.246840:0:80281:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc55:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.246842:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c53e5f lrc: 3/0,1 mode: --/PW res: [0x2bc55:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246845:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.246846:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.246847:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c53e5f lrc: 3/0,1 mode: PW/PW res: [0x2bc55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246850:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c53e5f lrc: 3/0,1 mode: PW/PW res: [0x2bc55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246853:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c53e5f lrc: 3/0,1 mode: PW/PW res: [0x2bc55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246856:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c53e5f lrc: 2/0,0 mode: PW/PW res: [0x2bc55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.246865:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7dfc8bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+208:39029:x1731745946638336:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 68us (274us total) trans 12885081196 rc 0/0 00000100:00100000:1.0:1651529467.246868:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213192 00000100:00100000:1.0:1651529467.246873:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213194 00000100:00100000:1.0:1651529467.246874:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005954c7f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+208:39029:x1731745946638464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.246879:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179414 count 1 00002000:00010000:1.0:1651529467.246883:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcd6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.246884:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c53e66 lrc: 3/0,1 mode: --/PW res: [0x2bcd6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246888:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.246888:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.246889:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c53e66 lrc: 3/0,1 mode: PW/PW res: [0x2bcd6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.246889:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000380bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+208:39029:x1731745946638208:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 57us (313us total) trans 12885081197 rc 0/0 00000100:00100000:0.0:1651529467.246892:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213193 00010000:00010000:1.0:1651529467.246893:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c53e66 lrc: 3/0,1 mode: PW/PW res: [0x2bcd6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246896:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c53e66 lrc: 3/0,1 mode: PW/PW res: [0x2bcd6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246900:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c53e66 lrc: 2/0,0 mode: PW/PW res: [0x2bcd6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246903:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c53e3c lrc: 2/0,0 mode: PW/PW res: [0x2bc16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246909:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000003af78ab already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.246910:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c53e3c lrc: 2/0,0 mode: PW/PW res: [0x2bc16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246913:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c53e3c lrc: 3/0,0 mode: PW/PW res: [0x2bc16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246917:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c53e3c lrc: 1/0,0 mode: --/PW res: [0x2bc16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246920:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c53e3c lrc: 0/0,0 mode: --/PW res: [0x2bc16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246924:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c53e43 lrc: 2/0,0 mode: PW/PW res: [0x2bcbb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246926:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bdf2b6c4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.246927:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c53e43 lrc: 2/0,0 mode: PW/PW res: [0x2bcbb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246930:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c53e43 lrc: 3/0,0 mode: PW/PW res: [0x2bcbb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.246931:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005954c7f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+208:39029:x1731745946638464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 55us (321us total) trans 12885081198 rc 0/0 00010000:00010000:0.0:1651529467.246933:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c53e43 lrc: 1/0,0 mode: --/PW res: [0x2bcbb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.246934:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213194 00010000:00010000:0.0:1651529467.246936:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c53e43 lrc: 0/0,0 mode: --/PW res: [0x2bcbb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246939:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c53e4a lrc: 2/0,0 mode: PW/PW res: [0x2bc5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246941:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c53e51 lrc: 2/0,0 mode: PW/PW res: [0x2bc71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246942:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2d8d18b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.246943:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c53e4a lrc: 2/0,0 mode: PW/PW res: [0x2bc5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246944:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000feb9d3da already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.246945:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c53e4a lrc: 3/0,0 mode: PW/PW res: [0x2bc5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246946:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c53e51 lrc: 2/0,0 mode: PW/PW res: [0x2bc71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246948:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c53e51 lrc: 3/0,0 mode: PW/PW res: [0x2bc71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246948:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c53e4a lrc: 1/0,0 mode: --/PW res: [0x2bc5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246951:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c53e4a lrc: 0/0,0 mode: --/PW res: [0x2bc5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246953:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c53e51 lrc: 1/0,0 mode: --/PW res: [0x2bc71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246954:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c53e58 lrc: 2/0,0 mode: PW/PW res: [0x2bc4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246956:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c53e51 lrc: 0/0,0 mode: --/PW res: [0x2bc71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246957:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000baeec0a3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.246958:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c53e58 lrc: 2/0,0 mode: PW/PW res: [0x2bc4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246960:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c53e5f lrc: 2/0,0 mode: PW/PW res: [0x2bc55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246960:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c53e58 lrc: 3/0,0 mode: PW/PW res: [0x2bc4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246963:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e48e0bfd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.246963:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c53e58 lrc: 1/0,0 mode: --/PW res: [0x2bc4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246964:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c53e5f lrc: 2/0,0 mode: PW/PW res: [0x2bc55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246966:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c53e58 lrc: 0/0,0 mode: --/PW res: [0x2bc4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246967:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c53e5f lrc: 3/0,0 mode: PW/PW res: [0x2bc55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246970:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c53e5f lrc: 1/0,0 mode: --/PW res: [0x2bc55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246970:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c53e66 lrc: 2/0,0 mode: PW/PW res: [0x2bcd6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.246972:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c53e5f lrc: 0/0,0 mode: --/PW res: [0x2bc55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246972:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000062f8a534 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.246973:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c53e66 lrc: 2/0,0 mode: PW/PW res: [0x2bcd6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246976:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c53e66 lrc: 3/0,0 mode: PW/PW res: [0x2bcd6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246979:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c53e66 lrc: 1/0,0 mode: --/PW res: [0x2bcd6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.246981:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c53e66 lrc: 0/0,0 mode: --/PW res: [0x2bcd6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.246986:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.247001:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946638528 00000100:00100000:0.0:1651529467.247011:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213195 00000100:00100000:0.0:1651529467.247013:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0b5d3bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+208:39030:x1731745946638528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.247018:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179273 count 1 00002000:00010000:0.0:1651529467.247022:0:80279:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc49:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.247024:0:80279:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c53e6d lrc: 3/0,1 mode: --/PW res: [0x2bc49:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247030:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.247030:0:80279:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.247031:0:80279:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c53e6d lrc: 3/0,1 mode: PW/PW res: [0x2bc49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247034:0:80279:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c53e6d lrc: 3/0,1 mode: PW/PW res: [0x2bc49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247037:0:80279:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c53e6d lrc: 3/0,1 mode: PW/PW res: [0x2bc49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247040:0:80279:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c53e6d lrc: 2/0,0 mode: PW/PW res: [0x2bc49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247072:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c53e6d lrc: 2/0,0 mode: PW/PW res: [0x2bc49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247076:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000066921086 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.247076:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c53e6d lrc: 2/0,0 mode: PW/PW res: [0x2bc49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247079:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c53e6d lrc: 3/0,0 mode: PW/PW res: [0x2bc49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247084:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c53e6d lrc: 1/0,0 mode: --/PW res: [0x2bc49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247086:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c53e6d lrc: 0/0,0 mode: --/PW res: [0x2bc49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80279 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.247099:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0b5d3bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+209:39030:x1731745946638528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 85us (112us total) trans 12885081199 rc 0/0 00000100:00100000:0.0:1651529467.247102:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213195 00000100:00100000:0.0:1651529467.247274:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.247307:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.247315:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.247324:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946639168 00000100:00100000:0.0:1651529467.247324:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.247332:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.247345:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946639104 00000100:00100000:0.0:1651529467.247345:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.247352:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946639232 00000100:00100000:1.0:1651529467.247357:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946639360 00000100:00100000:1.0:1651529467.247361:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946639296 00000100:00100000:1.0:1651529467.247365:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946639424 00000100:00100000:1.0:1651529467.247369:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213196 00000100:00100000:1.0:1651529467.247371:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000f50c14a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+214:39029:x1731745946639168:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.247376:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179381 count 1 00000100:00100000:0.0:1651529467.247379:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00010000:1.0:1651529467.247382:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcb5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.247384:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c53e74 lrc: 3/0,1 mode: --/PW res: [0x2bcb5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.247385:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529467.247387:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.247388:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.247389:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c53e74 lrc: 3/0,1 mode: PW/PW res: [0x2bcb5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.247391:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946639552 00010000:00010000:1.0:1651529467.247393:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c53e74 lrc: 3/0,1 mode: PW/PW res: [0x2bcb5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247395:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c53e74 lrc: 3/0,1 mode: PW/PW res: [0x2bcb5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.247397:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946639680 00010000:00010000:1.0:1651529467.247398:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c53e74 lrc: 2/0,0 mode: PW/PW res: [0x2bcb5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.247400:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213197 00000100:00100000:0.0:1651529467.247402:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c810c14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+216:39030:x1731745946639104:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.247414:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179248 count 1 00002000:00010000:0.0:1651529467.247419:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.247421:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c53e7b lrc: 3/0,1 mode: --/PW res: [0x2bc30:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247425:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.247425:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.247426:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c53e7b lrc: 3/0,1 mode: PW/PW res: [0x2bc30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247430:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c53e7b lrc: 3/0,1 mode: PW/PW res: [0x2bc30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247433:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c53e7b lrc: 3/0,1 mode: PW/PW res: [0x2bc30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247435:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c53e7b lrc: 2/0,0 mode: PW/PW res: [0x2bc30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.247440:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000f50c14a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+217:39029:x1731745946639168:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 68us (167us total) trans 12885081200 rc 0/0 00000100:00100000:1.0:1651529467.247444:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213196 00000100:00100000:1.0:1651529467.247449:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213198 00000100:00100000:1.0:1651529467.247451:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fb8007ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+216:39030:x1731745946639232:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.247455:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179197 count 1 00002000:00010000:1.0:1651529467.247459:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbfd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.247461:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c53e82 lrc: 3/0,1 mode: --/PW res: [0x2bbfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247464:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.247465:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.247466:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c53e82 lrc: 3/0,1 mode: PW/PW res: [0x2bbfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247469:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c53e82 lrc: 3/0,1 mode: PW/PW res: [0x2bbfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247472:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c53e82 lrc: 3/0,1 mode: PW/PW res: [0x2bbfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.247474:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c810c14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+217:39030:x1731745946639104:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 72us (167us total) trans 12885081201 rc 0/0 00010000:00010000:1.0:1651529467.247475:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c53e82 lrc: 2/0,0 mode: PW/PW res: [0x2bbfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.247477:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213197 00000100:00100000:0.0:1651529467.247483:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213199 00000100:00100000:0.0:1651529467.247484:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000092e14270 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+216:39030:x1731745946639360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.247489:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179366 count 1 00002000:00010000:0.0:1651529467.247493:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bca6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.247495:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53e89 lrc: 3/0,1 mode: --/PW res: [0x2bca6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247499:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.247499:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.247500:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53e89 lrc: 3/0,1 mode: PW/PW res: [0x2bca6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247503:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53e89 lrc: 3/0,1 mode: PW/PW res: [0x2bca6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247506:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53e89 lrc: 3/0,1 mode: PW/PW res: [0x2bca6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.247508:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fb8007ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+217:39030:x1731745946639232:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 57us (193us total) trans 12885081202 rc 0/0 00010000:00010000:0.0:1651529467.247509:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53e89 lrc: 2/0,0 mode: PW/PW res: [0x2bca6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.247511:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213198 00000100:00100000:1.0:1651529467.247516:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213200 00000100:00100000:1.0:1651529467.247517:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007591e43c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+216:39029:x1731745946639296:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.247521:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179296 count 1 00002000:00010000:1.0:1651529467.247526:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc60:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.247528:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c53e90 lrc: 3/0,1 mode: --/PW res: [0x2bc60:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247531:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.247532:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.247532:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c53e90 lrc: 3/0,1 mode: PW/PW res: [0x2bc60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247536:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c53e90 lrc: 3/0,1 mode: PW/PW res: [0x2bc60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247539:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c53e90 lrc: 3/0,1 mode: PW/PW res: [0x2bc60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.247541:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000092e14270 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+217:39030:x1731745946639360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 55us (217us total) trans 12885081203 rc 0/0 00010000:00010000:1.0:1651529467.247542:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c53e90 lrc: 2/0,0 mode: PW/PW res: [0x2bc60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.247543:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213199 00000100:00100000:0.0:1651529467.247548:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213201 00000100:00100000:0.0:1651529467.247550:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008e33c77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+216:39030:x1731745946639424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.247554:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179216 count 1 00002000:00010000:0.0:1651529467.247558:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.247559:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c53e97 lrc: 3/0,1 mode: --/PW res: [0x2bc10:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247565:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.247566:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.247567:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c53e97 lrc: 3/0,1 mode: PW/PW res: [0x2bc10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247570:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c53e97 lrc: 3/0,1 mode: PW/PW res: [0x2bc10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247573:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c53e97 lrc: 3/0,1 mode: PW/PW res: [0x2bc10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.247574:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007591e43c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+217:39029:x1731745946639296:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 55us (241us total) trans 12885081204 rc 0/0 00000100:00100000:1.0:1651529467.247576:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213200 00010000:00010000:0.0:1651529467.247576:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c53e97 lrc: 2/0,0 mode: PW/PW res: [0x2bc10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.247581:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213202 00000100:00100000:1.0:1651529467.247583:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000abfc3f58 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+216:39030:x1731745946639552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.247587:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179425 count 1 00002000:00010000:1.0:1651529467.247591:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bce1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.247593:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c53e9e lrc: 3/0,1 mode: --/PW res: [0x2bce1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247596:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.247597:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.247597:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c53e9e lrc: 3/0,1 mode: PW/PW res: [0x2bce1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247601:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c53e9e lrc: 3/0,1 mode: PW/PW res: [0x2bce1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247603:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c53e9e lrc: 3/0,1 mode: PW/PW res: [0x2bce1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247606:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c53e9e lrc: 2/0,0 mode: PW/PW res: [0x2bce1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.247606:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008e33c77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+217:39030:x1731745946639424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 56us (265us total) trans 12885081205 rc 0/0 00000100:00100000:0.0:1651529467.247609:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213201 00000100:00100000:0.0:1651529467.247614:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213203 00000100:00100000:0.0:1651529467.247615:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000198be7e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+216:39030:x1731745946639680:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.247620:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179399 count 1 00002000:00010000:0.0:1651529467.247624:0:151609:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcc7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.247626:0:151609:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53ea5 lrc: 3/0,1 mode: --/PW res: [0x2bcc7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247629:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.247630:0:151609:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.247631:0:151609:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53ea5 lrc: 3/0,1 mode: PW/PW res: [0x2bcc7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247634:0:151609:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53ea5 lrc: 3/0,1 mode: PW/PW res: [0x2bcc7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247637:0:151609:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53ea5 lrc: 3/0,1 mode: PW/PW res: [0x2bcc7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.247638:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000abfc3f58 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+217:39030:x1731745946639552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 54us (259us total) trans 12885081206 rc 0/0 00000100:00100000:1.0:1651529467.247640:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213202 00010000:00010000:0.0:1651529467.247640:0:151609:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53ea5 lrc: 2/0,0 mode: PW/PW res: [0x2bcc7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247647:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c53e74 lrc: 2/0,0 mode: PW/PW res: [0x2bcb5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247651:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba070658 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.247652:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c53e74 lrc: 2/0,0 mode: PW/PW res: [0x2bcb5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247655:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c53e74 lrc: 3/0,0 mode: PW/PW res: [0x2bcb5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247661:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c53e74 lrc: 1/0,0 mode: --/PW res: [0x2bcb5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247664:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c53e74 lrc: 0/0,0 mode: --/PW res: [0x2bcb5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247669:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c53e7b lrc: 2/0,0 mode: PW/PW res: [0x2bc30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.247670:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000198be7e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+217:39030:x1731745946639680:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 54us (285us total) trans 12885081207 rc 0/0 00010000:00010000:1.0:1651529467.247671:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000090e99444 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.247672:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c53e7b lrc: 2/0,0 mode: PW/PW res: [0x2bc30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.247673:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213203 00010000:00010000:1.0:1651529467.247675:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c53e7b lrc: 3/0,0 mode: PW/PW res: [0x2bc30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247678:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c53e7b lrc: 1/0,0 mode: --/PW res: [0x2bc30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247680:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c53e7b lrc: 0/0,0 mode: --/PW res: [0x2bc30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247684:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53e89 lrc: 2/0,0 mode: PW/PW res: [0x2bca6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247684:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c53e82 lrc: 2/0,0 mode: PW/PW res: [0x2bbfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247687:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000014fe598c already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.247687:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53e89 lrc: 2/0,0 mode: PW/PW res: [0x2bca6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247687:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007c1cad42 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.247688:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c53e82 lrc: 2/0,0 mode: PW/PW res: [0x2bbfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247690:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53e89 lrc: 3/0,0 mode: PW/PW res: [0x2bca6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247691:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c53e82 lrc: 3/0,0 mode: PW/PW res: [0x2bbfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247693:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53e89 lrc: 1/0,0 mode: --/PW res: [0x2bca6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247696:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c53e89 lrc: 0/0,0 mode: --/PW res: [0x2bca6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247696:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c53e82 lrc: 1/0,0 mode: --/PW res: [0x2bbfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247698:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c53e82 lrc: 0/0,0 mode: --/PW res: [0x2bbfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247699:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c53e90 lrc: 2/0,0 mode: PW/PW res: [0x2bc60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247702:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004f367ded already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.247703:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c53e90 lrc: 2/0,0 mode: PW/PW res: [0x2bc60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247703:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c53e97 lrc: 2/0,0 mode: PW/PW res: [0x2bc10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247705:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c53e90 lrc: 3/0,0 mode: PW/PW res: [0x2bc60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247706:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dd6b1be4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.247707:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c53e97 lrc: 2/0,0 mode: PW/PW res: [0x2bc10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247708:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c53e90 lrc: 1/0,0 mode: --/PW res: [0x2bc60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247710:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c53e97 lrc: 3/0,0 mode: PW/PW res: [0x2bc10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247711:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c53e90 lrc: 0/0,0 mode: --/PW res: [0x2bc60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247713:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c53e97 lrc: 1/0,0 mode: --/PW res: [0x2bc10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247714:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c53e9e lrc: 2/0,0 mode: PW/PW res: [0x2bce1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247716:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c53e97 lrc: 0/0,0 mode: --/PW res: [0x2bc10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247717:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001ea46bb1 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.247718:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c53e9e lrc: 2/0,0 mode: PW/PW res: [0x2bce1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247719:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53ea5 lrc: 2/0,0 mode: PW/PW res: [0x2bcc7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247721:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c53e9e lrc: 3/0,0 mode: PW/PW res: [0x2bce1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247722:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004b2a6b06 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.247722:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53ea5 lrc: 2/0,0 mode: PW/PW res: [0x2bcc7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247724:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c53e9e lrc: 1/0,0 mode: --/PW res: [0x2bce1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247725:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53ea5 lrc: 3/0,0 mode: PW/PW res: [0x2bcc7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.247726:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c53e9e lrc: 0/0,0 mode: --/PW res: [0x2bce1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247728:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53ea5 lrc: 1/0,0 mode: --/PW res: [0x2bcc7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.247731:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c53ea5 lrc: 0/0,0 mode: --/PW res: [0x2bcc7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 151609 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.247988:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.247999:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946640192 00000100:00100000:1.0:1651529467.248007:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213204 00000100:00100000:1.0:1651529467.248009:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f4f9630 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+217:39029:x1731745946640192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.248014:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179312 count 1 00002000:00010000:1.0:1651529467.248019:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc70:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.248021:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c53eac lrc: 3/0,1 mode: --/PW res: [0x2bc70:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248024:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.248025:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.248025:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c53eac lrc: 3/0,1 mode: PW/PW res: [0x2bc70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248029:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c53eac lrc: 3/0,1 mode: PW/PW res: [0x2bc70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248050:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c53eac lrc: 3/0,1 mode: PW/PW res: [0x2bc70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248053:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c53eac lrc: 2/0,0 mode: PW/PW res: [0x2bc70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.248096:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f4f9630 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+218:39029:x1731745946640192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 86us (107us total) trans 12885081208 rc 0/0 00000100:00100000:1.0:1651529467.248099:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213204 00010000:00010000:1.0:1651529467.248106:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c53eac lrc: 2/0,0 mode: PW/PW res: [0x2bc70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248109:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2a86deb already unused, calling callback (0000000049fddea7) 00000100:00100000:0.0:1651529467.248112:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529467.248122:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c53eac lrc: 2/0,0 mode: PW/PW res: [0x2bc70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248126:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c53eac lrc: 3/0,0 mode: PW/PW res: [0x2bc70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248131:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c53eac lrc: 1/0,0 mode: --/PW res: [0x2bc70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.248136:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529467.248139:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c53eac lrc: 0/0,0 mode: --/PW res: [0x2bc70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.248143:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.248148:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946640320 00000100:00100000:0.0:1651529467.248149:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.248158:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946640448 00000100:00100000:1.0:1651529467.248163:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946640576 00000100:00100000:0.0:1651529467.248165:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.248174:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946640256 00000100:00100000:1.0:1651529467.248179:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946640384 00000100:00100000:1.0:1651529467.248185:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213205 00000100:00100000:1.0:1651529467.248187:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000036a3a267 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+222:39029:x1731745946640320:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529467.248187:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529467.248197:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179229 count 1 00000100:00100000:0.0:1651529467.248197:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00010000:1.0:1651529467.248202:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.248204:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c53eb3 lrc: 3/0,1 mode: --/PW res: [0x2bc1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.248204:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946640512 00010000:00010000:1.0:1651529467.248208:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.248208:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.248209:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c53eb3 lrc: 3/0,1 mode: PW/PW res: [0x2bc1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.248209:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946640640 00010000:00010000:1.0:1651529467.248213:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c53eb3 lrc: 3/0,1 mode: PW/PW res: [0x2bc1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.248213:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213206 00000100:00100000:0.0:1651529467.248214:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004b5f63ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+224:39029:x1731745946640448:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529467.248215:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c53eb3 lrc: 3/0,1 mode: PW/PW res: [0x2bc1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248218:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c53eb3 lrc: 2/0,0 mode: PW/PW res: [0x2bc1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529467.248219:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179290 count 1 00002000:00010000:0.0:1651529467.248267:0:80280:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc5a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.248269:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c53eba lrc: 3/0,1 mode: --/PW res: [0x2bc5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248273:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.248274:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.248275:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c53eba lrc: 3/0,1 mode: PW/PW res: [0x2bc5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.248282:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000036a3a267 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+225:39029:x1731745946640320:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 94us (170us total) trans 12885081209 rc 0/0 00010000:00010000:0.0:1651529467.248284:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c53eba lrc: 3/0,1 mode: PW/PW res: [0x2bc5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.248285:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213205 00010000:00010000:0.0:1651529467.248290:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c53eba lrc: 3/0,1 mode: PW/PW res: [0x2bc5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.248291:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213207 00000100:00100000:1.0:1651529467.248292:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d7328d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+224:39029:x1731745946640576:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529467.248293:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c53eba lrc: 2/0,0 mode: PW/PW res: [0x2bc5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529467.248297:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179211 count 1 00002000:00010000:1.0:1651529467.248302:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc0b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.248304:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c53ec1 lrc: 3/0,1 mode: --/PW res: [0x2bc0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248307:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.248308:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.248309:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c53ec1 lrc: 3/0,1 mode: PW/PW res: [0x2bc0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248312:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c53ec1 lrc: 3/0,1 mode: PW/PW res: [0x2bc0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248315:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c53ec1 lrc: 3/0,1 mode: PW/PW res: [0x2bc0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248318:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c53ec1 lrc: 2/0,0 mode: PW/PW res: [0x2bc0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.248332:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004b5f63ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+225:39029:x1731745946640448:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 116us (195us total) trans 12885081210 rc 0/0 00000100:00100000:0.0:1651529467.248335:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213206 00000100:00100000:0.0:1651529467.248340:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213208 00000100:00100000:0.0:1651529467.248342:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+225:39029:x1731745946640256:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.248346:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179187 count 1 00002000:00010000:0.0:1651529467.248351:0:80280:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbf3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.248352:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c53ec8 lrc: 3/0,1 mode: --/PW res: [0x2bbf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.248353:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d7328d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+225:39029:x1731745946640576:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 60us (210us total) trans 12885081211 rc 0/0 00010000:00010000:0.0:1651529467.248356:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529467.248357:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213207 00010000:00010000:0.0:1651529467.248357:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.248357:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c53ec8 lrc: 3/0,1 mode: PW/PW res: [0x2bbf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248361:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c53ec8 lrc: 3/0,1 mode: PW/PW res: [0x2bbf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.248362:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213209 00000100:00100000:1.0:1651529467.248363:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004de851bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+224:39029:x1731745946640384:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529467.248364:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c53ec8 lrc: 3/0,1 mode: PW/PW res: [0x2bbf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529467.248368:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179388 count 1 00010000:00010000:0.0:1651529467.248369:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c53ec8 lrc: 2/0,0 mode: PW/PW res: [0x2bbf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.248372:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcbc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.248374:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c53ecf lrc: 3/0,1 mode: --/PW res: [0x2bcbc:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248377:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.248378:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.248378:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c53ecf lrc: 3/0,1 mode: PW/PW res: [0x2bcbc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248382:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c53ecf lrc: 3/0,1 mode: PW/PW res: [0x2bcbc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248385:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c53ecf lrc: 3/0,1 mode: PW/PW res: [0x2bcbc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248387:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c53ecf lrc: 2/0,0 mode: PW/PW res: [0x2bcbc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.248401:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+225:39029:x1731745946640256:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 58us (251us total) trans 12885081212 rc 0/0 00000100:00100000:0.0:1651529467.248403:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213208 00000100:00100000:0.0:1651529467.248408:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213210 00000100:00100000:0.0:1651529467.248410:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+225:39029:x1731745946640512:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.248414:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179358 count 1 00000100:00100000:1.0:1651529467.248419:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004de851bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+225:39029:x1731745946640384:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 55us (263us total) trans 12885081213 rc 0/0 00002000:00010000:0.0:1651529467.248419:0:80280:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc9e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.248420:0:80280:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c53ed6 lrc: 3/0,1 mode: --/PW res: [0x2bc9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.248422:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213209 00010000:00010000:0.0:1651529467.248424:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.248424:0:80280:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.248425:0:80280:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c53ed6 lrc: 3/0,1 mode: PW/PW res: [0x2bc9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.248426:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213211 00000100:00100000:1.0:1651529467.248428:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+224:39029:x1731745946640640:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529467.248428:0:80280:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c53ed6 lrc: 3/0,1 mode: PW/PW res: [0x2bc9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248431:0:80280:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c53ed6 lrc: 3/0,1 mode: PW/PW res: [0x2bc9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529467.248432:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179263 count 1 00010000:00010000:0.0:1651529467.248434:0:80280:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c53ed6 lrc: 2/0,0 mode: PW/PW res: [0x2bc9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.248436:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.248438:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c53edd lrc: 3/0,1 mode: --/PW res: [0x2bc3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248441:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.248442:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.248443:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c53edd lrc: 3/0,1 mode: PW/PW res: [0x2bc3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248446:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c53edd lrc: 3/0,1 mode: PW/PW res: [0x2bc3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248449:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c53edd lrc: 3/0,1 mode: PW/PW res: [0x2bc3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248451:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c53edd lrc: 2/0,0 mode: PW/PW res: [0x2bc3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.248467:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+226:39029:x1731745946640512:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 56us (284us total) trans 12885081214 rc 0/0 00000100:00100000:0.0:1651529467.248470:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213210 00000100:00100000:1.0:1651529467.248483:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+225:39029:x1731745946640640:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 54us (285us total) trans 12885081215 rc 0/0 00010000:00010000:0.0:1651529467.248483:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c53eb3 lrc: 2/0,0 mode: PW/PW res: [0x2bc1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.248485:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213211 00010000:00010000:0.0:1651529467.248486:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d84ad17b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.248487:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c53eb3 lrc: 2/0,0 mode: PW/PW res: [0x2bc1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248490:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c53eb3 lrc: 3/0,0 mode: PW/PW res: [0x2bc1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248493:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c53eba lrc: 2/0,0 mode: PW/PW res: [0x2bc5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248495:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c53eb3 lrc: 1/0,0 mode: --/PW res: [0x2bc1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248496:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba437fe0 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.248497:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c53eba lrc: 2/0,0 mode: PW/PW res: [0x2bc5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248497:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c53eb3 lrc: 0/0,0 mode: --/PW res: [0x2bc1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248499:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c53eba lrc: 3/0,0 mode: PW/PW res: [0x2bc5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248502:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c53ec1 lrc: 2/0,0 mode: PW/PW res: [0x2bc0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248504:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c53eba lrc: 1/0,0 mode: --/PW res: [0x2bc5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248505:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000029b2a516 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.248506:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c53ec1 lrc: 2/0,0 mode: PW/PW res: [0x2bc0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248509:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c53eba lrc: 0/0,0 mode: --/PW res: [0x2bc5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248511:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c53ec1 lrc: 3/0,0 mode: PW/PW res: [0x2bc0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248513:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c53ec8 lrc: 2/0,0 mode: PW/PW res: [0x2bbf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248514:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c53ec1 lrc: 1/0,0 mode: --/PW res: [0x2bc0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248516:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005e711cee already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.248516:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c53ec1 lrc: 0/0,0 mode: --/PW res: [0x2bc0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248517:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c53ec8 lrc: 2/0,0 mode: PW/PW res: [0x2bbf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248520:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c53ec8 lrc: 3/0,0 mode: PW/PW res: [0x2bbf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248520:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c53ecf lrc: 2/0,0 mode: PW/PW res: [0x2bcbc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248522:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c0de17df already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.248523:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c53ec8 lrc: 1/0,0 mode: --/PW res: [0x2bbf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248523:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c53ecf lrc: 2/0,0 mode: PW/PW res: [0x2bcbc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248525:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c53ec8 lrc: 0/0,0 mode: --/PW res: [0x2bbf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248526:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c53ecf lrc: 3/0,0 mode: PW/PW res: [0x2bcbc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248529:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c53ed6 lrc: 2/0,0 mode: PW/PW res: [0x2bc9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248529:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c53ecf lrc: 1/0,0 mode: --/PW res: [0x2bcbc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248531:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042bde05b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.248531:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c53ecf lrc: 0/0,0 mode: --/PW res: [0x2bcbc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248532:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c53ed6 lrc: 2/0,0 mode: PW/PW res: [0x2bc9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248535:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c53edd lrc: 2/0,0 mode: PW/PW res: [0x2bc3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248537:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c53ed6 lrc: 3/0,0 mode: PW/PW res: [0x2bc9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248540:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c53ed6 lrc: 1/0,0 mode: --/PW res: [0x2bc9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248540:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004678bff1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.248541:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c53edd lrc: 2/0,0 mode: PW/PW res: [0x2bc3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248543:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c53ed6 lrc: 0/0,0 mode: --/PW res: [0x2bc9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80280 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248543:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c53edd lrc: 3/0,0 mode: PW/PW res: [0x2bc3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248546:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c53edd lrc: 1/0,0 mode: --/PW res: [0x2bc3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.248549:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c53edd lrc: 0/0,0 mode: --/PW res: [0x2bc3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.248557:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.248568:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946640768 00000100:00100000:1.0:1651529467.248583:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213212 00000100:00100000:1.0:1651529467.248585:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a8bfda0b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+225:39030:x1731745946640768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.248590:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179173 count 1 00002000:00010000:1.0:1651529467.248595:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbe5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.248597:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c53ee4 lrc: 3/0,1 mode: --/PW res: [0x2bbe5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248600:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.248606:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.248607:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c53ee4 lrc: 3/0,1 mode: PW/PW res: [0x2bbe5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248611:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c53ee4 lrc: 3/0,1 mode: PW/PW res: [0x2bbe5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248614:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c53ee4 lrc: 3/0,1 mode: PW/PW res: [0x2bbe5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248641:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c53ee4 lrc: 2/0,0 mode: PW/PW res: [0x2bbe5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.248686:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a8bfda0b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+226:39030:x1731745946640768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 100us (129us total) trans 12885081216 rc 0/0 00000100:00100000:1.0:1651529467.248689:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213212 00010000:00010000:1.0:1651529467.248696:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c53ee4 lrc: 2/0,0 mode: PW/PW res: [0x2bbe5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248699:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f3240ce7 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.248701:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c53ee4 lrc: 2/0,0 mode: PW/PW res: [0x2bbe5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248711:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c53ee4 lrc: 3/0,0 mode: PW/PW res: [0x2bbe5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248716:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c53ee4 lrc: 1/0,0 mode: --/PW res: [0x2bbe5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248719:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c53ee4 lrc: 0/0,0 mode: --/PW res: [0x2bbe5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.248898:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.248907:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946641344 00000100:00100000:0.0:1651529467.248908:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.248917:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.248927:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946641472 00000100:00100000:1.0:1651529467.248933:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946641408 00000100:00100000:0.0:1651529467.248937:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.248938:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213213 00000100:00100000:1.0:1651529467.248939:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cfdd1a6c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+228:39029:x1731745946641344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529467.248944:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529467.248945:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179235 count 1 00002000:00010000:1.0:1651529467.248950:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1651529467.248950:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529467.248952:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c53eeb lrc: 3/0,1 mode: --/PW res: [0x2bc23:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248955:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.248956:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529467.248956:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529467.248957:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c53eeb lrc: 3/0,1 mode: PW/PW res: [0x2bc23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248960:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c53eeb lrc: 3/0,1 mode: PW/PW res: [0x2bc23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.248962:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529467.248963:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c53eeb lrc: 3/0,1 mode: PW/PW res: [0x2bc23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.248966:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c53eeb lrc: 2/0,0 mode: PW/PW res: [0x2bc23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.248969:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946641600 00000100:00100000:0.0:1651529467.248981:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946641536 00000100:00100000:0.0:1651529467.248983:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946641728 00000100:00100000:0.0:1651529467.248985:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946641792 00000100:00100000:0.0:1651529467.248987:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946641856 00000100:00100000:0.0:1651529467.248990:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213214 00000100:00100000:0.0:1651529467.248991:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000041d3f4d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+234:39029:x1731745946641472:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.248997:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179241 count 1 00002000:00010000:0.0:1651529467.249003:0:106695:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.249004:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c53ef2 lrc: 3/0,1 mode: --/PW res: [0x2bc29:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.249008:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cfdd1a6c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+234:39029:x1731745946641344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 67us (110us total) trans 12885081217 rc 0/0 00010000:00010000:0.0:1651529467.249008:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.249009:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.249010:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c53ef2 lrc: 3/0,1 mode: PW/PW res: [0x2bc29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.249011:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213213 00010000:00010000:0.0:1651529467.249013:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c53ef2 lrc: 3/0,1 mode: PW/PW res: [0x2bc29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249016:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c53ef2 lrc: 3/0,1 mode: PW/PW res: [0x2bc29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249019:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c53ef2 lrc: 2/0,0 mode: PW/PW res: [0x2bc29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.249028:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213215 00000100:00100000:1.0:1651529467.249030:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000946e402f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+233:39030:x1731745946641408:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.249034:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179378 count 1 00002000:00010000:1.0:1651529467.249039:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcb2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.249040:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c53ef9 lrc: 3/0,1 mode: --/PW res: [0x2bcb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249044:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.249044:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.249045:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c53ef9 lrc: 3/0,1 mode: PW/PW res: [0x2bcb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249049:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c53ef9 lrc: 3/0,1 mode: PW/PW res: [0x2bcb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249051:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c53ef9 lrc: 3/0,1 mode: PW/PW res: [0x2bcb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249054:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c53ef9 lrc: 2/0,0 mode: PW/PW res: [0x2bcb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.249057:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000041d3f4d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+234:39029:x1731745946641472:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 65us (148us total) trans 12885081218 rc 0/0 00000100:00100000:0.0:1651529467.249060:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213214 00000100:00100000:0.0:1651529467.249065:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213216 00000100:00100000:0.0:1651529467.249067:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+233:39029:x1731745946641600:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.249071:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179289 count 1 00002000:00010000:0.0:1651529467.249076:0:106695:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc59:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.249077:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53f00 lrc: 3/0,1 mode: --/PW res: [0x2bc59:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249081:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.249082:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.249083:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53f00 lrc: 3/0,1 mode: PW/PW res: [0x2bc59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249086:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53f00 lrc: 3/0,1 mode: PW/PW res: [0x2bc59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249089:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53f00 lrc: 3/0,1 mode: PW/PW res: [0x2bc59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.249090:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000946e402f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+234:39030:x1731745946641408:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 59us (172us total) trans 12885081219 rc 0/0 00000100:00100000:1.0:1651529467.249092:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213215 00010000:00010000:0.0:1651529467.249092:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53f00 lrc: 2/0,0 mode: PW/PW res: [0x2bc59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.249098:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213217 00000100:00100000:1.0:1651529467.249099:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+233:39030:x1731745946641536:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.249104:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179382 count 1 00002000:00010000:1.0:1651529467.249108:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcb6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.249110:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c53f07 lrc: 3/0,1 mode: --/PW res: [0x2bcb6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249113:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.249114:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.249114:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c53f07 lrc: 3/0,1 mode: PW/PW res: [0x2bcb6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249118:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c53f07 lrc: 3/0,1 mode: PW/PW res: [0x2bcb6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249121:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c53f07 lrc: 3/0,1 mode: PW/PW res: [0x2bcb6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.249123:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+234:39029:x1731745946641600:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 56us (191us total) trans 12885081220 rc 0/0 00010000:00010000:1.0:1651529467.249124:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c53f07 lrc: 2/0,0 mode: PW/PW res: [0x2bcb6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.249126:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213216 00000100:00100000:0.0:1651529467.249131:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213218 00000100:00100000:0.0:1651529467.249132:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+233:39029:x1731745946641728:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.249137:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179326 count 1 00002000:00010000:0.0:1651529467.249141:0:106695:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc7e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.249143:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c53f0e lrc: 3/0,1 mode: --/PW res: [0x2bc7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249146:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.249147:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.249148:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c53f0e lrc: 3/0,1 mode: PW/PW res: [0x2bc7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249151:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c53f0e lrc: 3/0,1 mode: PW/PW res: [0x2bc7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.249154:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+234:39030:x1731745946641536:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 54us (210us total) trans 12885081221 rc 0/0 00010000:00010000:0.0:1651529467.249154:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c53f0e lrc: 3/0,1 mode: PW/PW res: [0x2bc7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.249157:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213217 00010000:00010000:0.0:1651529467.249157:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c53f0e lrc: 2/0,0 mode: PW/PW res: [0x2bc7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.249162:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213219 00000100:00100000:1.0:1651529467.249163:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+233:39030:x1731745946641792:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.249167:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179379 count 1 00002000:00010000:1.0:1651529467.249172:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcb3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.249173:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c53f15 lrc: 3/0,1 mode: --/PW res: [0x2bcb3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249176:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.249177:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.249177:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c53f15 lrc: 3/0,1 mode: PW/PW res: [0x2bcb3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249181:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c53f15 lrc: 3/0,1 mode: PW/PW res: [0x2bcb3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249186:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c53f15 lrc: 3/0,1 mode: PW/PW res: [0x2bcb3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.249187:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+234:39029:x1731745946641728:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 54us (237us total) trans 12885081222 rc 0/0 00010000:00010000:1.0:1651529467.249189:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c53f15 lrc: 2/0,0 mode: PW/PW res: [0x2bcb3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.249190:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213218 00000100:00100000:0.0:1651529467.249194:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213220 00000100:00100000:0.0:1651529467.249196:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+233:39030:x1731745946641856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.249200:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179288 count 1 00002000:00010000:0.0:1651529467.249204:0:106695:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc58:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.249206:0:106695:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c53f1c lrc: 3/0,1 mode: --/PW res: [0x2bc58:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249209:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.249210:0:106695:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.249210:0:106695:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c53f1c lrc: 3/0,1 mode: PW/PW res: [0x2bc58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249214:0:106695:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c53f1c lrc: 3/0,1 mode: PW/PW res: [0x2bc58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.249219:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+234:39030:x1731745946641792:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 55us (263us total) trans 12885081223 rc 0/0 00010000:00010000:0.0:1651529467.249219:0:106695:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c53f1c lrc: 3/0,1 mode: PW/PW res: [0x2bc58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249222:0:106695:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c53f1c lrc: 2/0,0 mode: PW/PW res: [0x2bc58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.249246:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213219 00010000:00010000:1.0:1651529467.249253:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c53eeb lrc: 2/0,0 mode: PW/PW res: [0x2bc23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249257:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054295afd already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.249257:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c53eeb lrc: 2/0,0 mode: PW/PW res: [0x2bc23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249260:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c53eeb lrc: 3/0,0 mode: PW/PW res: [0x2bc23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249265:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c53eeb lrc: 1/0,0 mode: --/PW res: [0x2bc23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249268:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c53eeb lrc: 0/0,0 mode: --/PW res: [0x2bc23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249272:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c53ef2 lrc: 2/0,0 mode: PW/PW res: [0x2bc29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249275:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000096ab8041 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.249276:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c53ef2 lrc: 2/0,0 mode: PW/PW res: [0x2bc29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.249278:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+234:39030:x1731745946641856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 81us (316us total) trans 12885081224 rc 0/0 00010000:00010000:1.0:1651529467.249279:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c53ef2 lrc: 3/0,0 mode: PW/PW res: [0x2bc29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.249281:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213220 00010000:00010000:1.0:1651529467.249282:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c53ef2 lrc: 1/0,0 mode: --/PW res: [0x2bc29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249284:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c53ef2 lrc: 0/0,0 mode: --/PW res: [0x2bc29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249288:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c53ef9 lrc: 2/0,0 mode: PW/PW res: [0x2bcb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249290:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ee128d1f already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.249291:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c53ef9 lrc: 2/0,0 mode: PW/PW res: [0x2bcb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249292:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53f00 lrc: 2/0,0 mode: PW/PW res: [0x2bc59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249294:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c53ef9 lrc: 3/0,0 mode: PW/PW res: [0x2bcb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249296:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000916cff2 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.249297:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c53ef9 lrc: 1/0,0 mode: --/PW res: [0x2bcb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249297:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53f00 lrc: 2/0,0 mode: PW/PW res: [0x2bc59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249299:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c53ef9 lrc: 0/0,0 mode: --/PW res: [0x2bcb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249300:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53f00 lrc: 3/0,0 mode: PW/PW res: [0x2bc59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249303:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c53f07 lrc: 2/0,0 mode: PW/PW res: [0x2bcb6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249304:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53f00 lrc: 1/0,0 mode: --/PW res: [0x2bc59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249306:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f149aa4b already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.249306:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c53f07 lrc: 2/0,0 mode: PW/PW res: [0x2bcb6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249307:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c53f00 lrc: 0/0,0 mode: --/PW res: [0x2bc59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249309:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c53f07 lrc: 3/0,0 mode: PW/PW res: [0x2bcb6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249312:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c53f07 lrc: 1/0,0 mode: --/PW res: [0x2bcb6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249312:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c53f0e lrc: 2/0,0 mode: PW/PW res: [0x2bc7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249314:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c53f07 lrc: 0/0,0 mode: --/PW res: [0x2bcb6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249315:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005b8e72f9 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.249316:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c53f0e lrc: 2/0,0 mode: PW/PW res: [0x2bc7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249318:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c53f15 lrc: 2/0,0 mode: PW/PW res: [0x2bcb3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249318:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c53f0e lrc: 3/0,0 mode: PW/PW res: [0x2bc7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249320:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001644aaad already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.249321:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c53f15 lrc: 2/0,0 mode: PW/PW res: [0x2bcb3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249321:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c53f0e lrc: 1/0,0 mode: --/PW res: [0x2bc7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249324:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c53f15 lrc: 3/0,0 mode: PW/PW res: [0x2bcb3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249324:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c53f0e lrc: 0/0,0 mode: --/PW res: [0x2bc7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249327:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c53f15 lrc: 1/0,0 mode: --/PW res: [0x2bcb3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249327:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c53f1c lrc: 2/0,0 mode: PW/PW res: [0x2bc58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249330:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c53f15 lrc: 0/0,0 mode: --/PW res: [0x2bcb3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249330:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c822bd1c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.249331:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c53f1c lrc: 2/0,0 mode: PW/PW res: [0x2bc58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249333:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c53f1c lrc: 3/0,0 mode: PW/PW res: [0x2bc58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249336:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c53f1c lrc: 1/0,0 mode: --/PW res: [0x2bc58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249339:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c53f1c lrc: 0/0,0 mode: --/PW res: [0x2bc58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 106695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.249552:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.249562:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946642432 00000100:00100000:1.0:1651529467.249570:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213221 00000100:00100000:1.0:1651529467.249572:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+234:39030:x1731745946642432:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.249577:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179363 count 1 00002000:00010000:1.0:1651529467.249582:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bca3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.249597:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c53f23 lrc: 3/0,1 mode: --/PW res: [0x2bca3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249601:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.249601:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.249602:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c53f23 lrc: 3/0,1 mode: PW/PW res: [0x2bca3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249606:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c53f23 lrc: 3/0,1 mode: PW/PW res: [0x2bca3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249609:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c53f23 lrc: 3/0,1 mode: PW/PW res: [0x2bca3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249612:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c53f23 lrc: 2/0,0 mode: PW/PW res: [0x2bca3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.249655:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+235:39030:x1731745946642432:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 82us (103us total) trans 12885081225 rc 0/0 00000100:00100000:1.0:1651529467.249660:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213221 00000100:00100000:0.0:1651529467.249664:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529467.249672:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c53f23 lrc: 2/0,0 mode: PW/PW res: [0x2bca3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249675:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005c863cd2 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.249677:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c53f23 lrc: 2/0,0 mode: PW/PW res: [0x2bca3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249679:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c53f23 lrc: 3/0,0 mode: PW/PW res: [0x2bca3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249684:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c53f23 lrc: 1/0,0 mode: --/PW res: [0x2bca3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249687:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c53f23 lrc: 0/0,0 mode: --/PW res: [0x2bca3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.249727:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.249738:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.249738:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946642496 00000100:00100000:1.0:1651529467.249746:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.249754:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.249762:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.249762:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946642560 00000100:00100000:1.0:1651529467.249771:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.249771:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946642624 00000100:00100000:1.0:1651529467.249781:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946642752 00000100:00100000:0.0:1651529467.249782:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946642880 00000100:00100000:0.0:1651529467.249789:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946642688 00000100:00100000:0.0:1651529467.249791:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946642816 00000100:00100000:0.0:1651529467.249795:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213222 00000100:00100000:0.0:1651529467.249796:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+241:39030:x1731745946642496:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529467.249797:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213223 00000100:00100000:1.0:1651529467.249808:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000520b3978 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+241:39030:x1731745946642560:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.249810:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179364 count 1 00002000:00080000:1.0:1651529467.249813:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179340 count 1 00002000:00010000:0.0:1651529467.249815:0:80281:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bca4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.249817:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c53f2a lrc: 3/0,1 mode: --/PW res: [0x2bca4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529467.249819:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc8c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.249820:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c53f31 lrc: 3/0,1 mode: --/PW res: [0x2bc8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249821:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.249822:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.249823:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c53f2a lrc: 3/0,1 mode: PW/PW res: [0x2bca4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249824:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.249825:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.249825:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c53f31 lrc: 3/0,1 mode: PW/PW res: [0x2bc8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249826:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c53f2a lrc: 3/0,1 mode: PW/PW res: [0x2bca4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249829:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c53f31 lrc: 3/0,1 mode: PW/PW res: [0x2bc8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249829:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c53f2a lrc: 3/0,1 mode: PW/PW res: [0x2bca4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249832:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c53f31 lrc: 3/0,1 mode: PW/PW res: [0x2bc8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249835:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c53f31 lrc: 2/0,0 mode: PW/PW res: [0x2bc8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249863:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c53f2a lrc: 2/0,0 mode: PW/PW res: [0x2bca4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.249887:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000520b3978 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+243:39030:x1731745946642560:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 78us (159us total) trans 12885081226 rc 0/0 00000100:00100000:1.0:1651529467.249890:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213223 00000100:00100000:1.0:1651529467.249895:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213224 00000100:00100000:1.0:1651529467.249897:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008e0465ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+242:39029:x1731745946642624:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.249901:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179203 count 1 00002000:00010000:1.0:1651529467.249906:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc03:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1651529467.249906:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+242:39030:x1731745946642496:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 109us (242us total) trans 12885081227 rc 0/0 00010000:00010000:1.0:1651529467.249908:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c53f38 lrc: 3/0,1 mode: --/PW res: [0x2bc03:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.249909:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213222 00010000:00010000:1.0:1651529467.249913:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.249914:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529467.249914:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213225 00010000:00010000:1.0:1651529467.249915:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c53f38 lrc: 3/0,1 mode: PW/PW res: [0x2bc03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.249916:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000079f8b444 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+241:39029:x1731745946642880:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529467.249918:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c53f38 lrc: 3/0,1 mode: PW/PW res: [0x2bc03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249921:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c53f38 lrc: 3/0,1 mode: PW/PW res: [0x2bc03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529467.249921:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179339 count 1 00010000:00010000:1.0:1651529467.249924:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c53f38 lrc: 2/0,0 mode: PW/PW res: [0x2bc03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.249925:0:80281:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc8b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.249927:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c53f3f lrc: 3/0,1 mode: --/PW res: [0x2bc8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249930:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.249931:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.249932:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c53f3f lrc: 3/0,1 mode: PW/PW res: [0x2bc8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249936:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c53f3f lrc: 3/0,1 mode: PW/PW res: [0x2bc8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249939:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c53f3f lrc: 3/0,1 mode: PW/PW res: [0x2bc8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249941:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c53f3f lrc: 2/0,0 mode: PW/PW res: [0x2bc8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.249959:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008e0465ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+243:39029:x1731745946642624:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 61us (221us total) trans 12885081228 rc 0/0 00000100:00100000:1.0:1651529467.249962:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213224 00000100:00100000:1.0:1651529467.249967:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213226 00000100:00100000:1.0:1651529467.249969:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e788caed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+242:39029:x1731745946642752:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.249974:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179374 count 1 00000100:00100000:0.0:1651529467.249974:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000079f8b444 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+242:39029:x1731745946642880:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 57us (219us total) trans 12885081229 rc 0/0 00002000:00010000:1.0:1651529467.249978:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1651529467.249979:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213225 00010000:00010000:1.0:1651529467.249980:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c53f46 lrc: 3/0,1 mode: --/PW res: [0x2bcae:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.249983:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529467.249983:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213227 00010000:00010000:1.0:1651529467.249984:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.249985:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c53f46 lrc: 3/0,1 mode: PW/PW res: [0x2bcae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.249985:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7dfc8bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+241:39029:x1731745946642688:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529467.249988:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c53f46 lrc: 3/0,1 mode: PW/PW res: [0x2bcae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529467.249989:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179334 count 1 00010000:00010000:1.0:1651529467.249991:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c53f46 lrc: 3/0,1 mode: PW/PW res: [0x2bcae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.249993:0:80281:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc86:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.249994:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c53f46 lrc: 2/0,0 mode: PW/PW res: [0x2bcae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249995:0:80281:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c53f4d lrc: 3/0,1 mode: --/PW res: [0x2bc86:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.249998:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.249999:0:80281:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.250000:0:80281:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c53f4d lrc: 3/0,1 mode: PW/PW res: [0x2bc86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250003:0:80281:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c53f4d lrc: 3/0,1 mode: PW/PW res: [0x2bc86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250006:0:80281:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c53f4d lrc: 3/0,1 mode: PW/PW res: [0x2bc86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250009:0:80281:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c53f4d lrc: 2/0,0 mode: PW/PW res: [0x2bc86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.250025:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e788caed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+243:39029:x1731745946642752:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 55us (278us total) trans 12885081230 rc 0/0 00000100:00100000:1.0:1651529467.250027:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213226 00000100:00100000:1.0:1651529467.250032:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213228 00000100:00100000:1.0:1651529467.250034:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000380bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+242:39029:x1731745946642816:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.250038:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179402 count 1 00000100:00100000:0.0:1651529467.250041:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7dfc8bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+242:39029:x1731745946642688:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 55us (278us total) trans 12885081231 rc 0/0 00002000:00010000:1.0:1651529467.250042:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.250043:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c53f54 lrc: 3/0,1 mode: --/PW res: [0x2bcca:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.250043:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213227 00010000:00010000:1.0:1651529467.250047:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.250047:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.250048:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c53f54 lrc: 3/0,1 mode: PW/PW res: [0x2bcca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250051:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c53f54 lrc: 3/0,1 mode: PW/PW res: [0x2bcca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250055:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c53f31 lrc: 2/0,0 mode: PW/PW res: [0x2bc8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250057:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c53f54 lrc: 3/0,1 mode: PW/PW res: [0x2bcca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250059:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c53f54 lrc: 2/0,0 mode: PW/PW res: [0x2bcca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250061:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032eb11d3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.250062:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c53f31 lrc: 2/0,0 mode: PW/PW res: [0x2bc8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250064:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c53f31 lrc: 3/0,0 mode: PW/PW res: [0x2bc8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250069:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c53f31 lrc: 1/0,0 mode: --/PW res: [0x2bc8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250072:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c53f31 lrc: 0/0,0 mode: --/PW res: [0x2bc8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250076:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c53f2a lrc: 2/0,0 mode: PW/PW res: [0x2bca4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250078:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000055fddd81 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.250079:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c53f2a lrc: 2/0,0 mode: PW/PW res: [0x2bca4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250082:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c53f2a lrc: 3/0,0 mode: PW/PW res: [0x2bca4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250085:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c53f2a lrc: 1/0,0 mode: --/PW res: [0x2bca4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250088:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c53f2a lrc: 0/0,0 mode: --/PW res: [0x2bca4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.250090:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000380bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+242:39029:x1731745946642816:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 56us (319us total) trans 12885081232 rc 0/0 00010000:00010000:0.0:1651529467.250091:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c53f38 lrc: 2/0,0 mode: PW/PW res: [0x2bc03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.250093:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213228 00010000:00010000:0.0:1651529467.250094:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000029e40f3d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.250095:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c53f38 lrc: 2/0,0 mode: PW/PW res: [0x2bc03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250097:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c53f38 lrc: 3/0,0 mode: PW/PW res: [0x2bc03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250100:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c53f3f lrc: 2/0,0 mode: PW/PW res: [0x2bc8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250100:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c53f38 lrc: 1/0,0 mode: --/PW res: [0x2bc03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250103:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000009fe5580 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.250103:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c53f38 lrc: 0/0,0 mode: --/PW res: [0x2bc03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250104:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c53f3f lrc: 2/0,0 mode: PW/PW res: [0x2bc8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250106:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c53f46 lrc: 2/0,0 mode: PW/PW res: [0x2bcae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250107:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c53f3f lrc: 3/0,0 mode: PW/PW res: [0x2bc8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250109:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005532ef34 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.250110:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c53f46 lrc: 2/0,0 mode: PW/PW res: [0x2bcae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250112:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c53f3f lrc: 1/0,0 mode: --/PW res: [0x2bc8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250112:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c53f46 lrc: 3/0,0 mode: PW/PW res: [0x2bcae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250115:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c53f3f lrc: 0/0,0 mode: --/PW res: [0x2bc8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250115:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c53f46 lrc: 1/0,0 mode: --/PW res: [0x2bcae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250118:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c53f46 lrc: 0/0,0 mode: --/PW res: [0x2bcae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250119:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c53f4d lrc: 2/0,0 mode: PW/PW res: [0x2bc86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250122:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d9cfe902 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.250122:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c53f4d lrc: 2/0,0 mode: PW/PW res: [0x2bc86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250122:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c53f54 lrc: 2/0,0 mode: PW/PW res: [0x2bcca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250124:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f10dea8 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.250125:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c53f4d lrc: 3/0,0 mode: PW/PW res: [0x2bc86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250125:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c53f54 lrc: 2/0,0 mode: PW/PW res: [0x2bcca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250128:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c53f4d lrc: 1/0,0 mode: --/PW res: [0x2bc86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250128:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c53f54 lrc: 3/0,0 mode: PW/PW res: [0x2bcca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250131:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c53f4d lrc: 0/0,0 mode: --/PW res: [0x2bc86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80281 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250131:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c53f54 lrc: 1/0,0 mode: --/PW res: [0x2bcca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250133:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c53f54 lrc: 0/0,0 mode: --/PW res: [0x2bcca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.250144:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.250157:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946643008 00000100:00100000:1.0:1651529467.250166:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213229 00000100:00100000:1.0:1651529467.250168:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005954c7f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+242:39030:x1731745946643008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.250173:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179327 count 1 00002000:00010000:1.0:1651529467.250178:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc7f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.250185:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c53f5b lrc: 3/0,1 mode: --/PW res: [0x2bc7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250189:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.250189:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.250190:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c53f5b lrc: 3/0,1 mode: PW/PW res: [0x2bc7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250220:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c53f5b lrc: 3/0,1 mode: PW/PW res: [0x2bc7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250238:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c53f5b lrc: 3/0,1 mode: PW/PW res: [0x2bc7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250241:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c53f5b lrc: 2/0,0 mode: PW/PW res: [0x2bc7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.250281:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005954c7f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+243:39030:x1731745946643008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 112us (136us total) trans 12885081233 rc 0/0 00000100:00100000:1.0:1651529467.250284:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213229 00010000:00010000:1.0:1651529467.250290:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c53f5b lrc: 2/0,0 mode: PW/PW res: [0x2bc7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250293:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000087f212ed already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.250294:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c53f5b lrc: 2/0,0 mode: PW/PW res: [0x2bc7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250297:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c53f5b lrc: 3/0,0 mode: PW/PW res: [0x2bc7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250302:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c53f5b lrc: 1/0,0 mode: --/PW res: [0x2bc7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250305:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c53f5b lrc: 0/0,0 mode: --/PW res: [0x2bc7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.250489:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.250499:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946643520 00000100:00100000:0.0:1651529467.250499:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.250508:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.250518:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946643584 00000100:00100000:1.0:1651529467.250523:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946643648 00000100:00100000:0.0:1651529467.250525:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213230 00000100:00100000:0.0:1651529467.250527:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+245:39029:x1731745946643520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529467.250531:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213231 00000100:00100000:1.0:1651529467.250533:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+245:39030:x1731745946643584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.250538:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179297 count 1 00002000:00010000:1.0:1651529467.250543:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc61:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.250545:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c53f62 lrc: 3/0,1 mode: --/PW res: [0x2bc61:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250554:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.250555:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.250556:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c53f62 lrc: 3/0,1 mode: PW/PW res: [0x2bc61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250560:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c53f62 lrc: 3/0,1 mode: PW/PW res: [0x2bc61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529467.250562:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179188 count 1 00010000:00010000:1.0:1651529467.250563:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c53f62 lrc: 3/0,1 mode: PW/PW res: [0x2bc61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250565:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c53f62 lrc: 2/0,0 mode: PW/PW res: [0x2bc61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.250567:0:72395:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbf4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.250569:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c53f69 lrc: 3/0,1 mode: --/PW res: [0x2bbf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250589:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.250590:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.250591:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c53f69 lrc: 3/0,1 mode: PW/PW res: [0x2bbf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250595:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c53f69 lrc: 3/0,1 mode: PW/PW res: [0x2bbf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250598:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c53f69 lrc: 3/0,1 mode: PW/PW res: [0x2bbf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250601:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c53f69 lrc: 2/0,0 mode: PW/PW res: [0x2bbf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.250610:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+246:39030:x1731745946643584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 76us (110us total) trans 12885081234 rc 0/0 00000100:00100000:1.0:1651529467.250612:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213231 00000100:00100000:1.0:1651529467.250618:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213232 00000100:00100000:1.0:1651529467.250620:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+245:39029:x1731745946643648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.250624:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179265 count 1 00002000:00010000:1.0:1651529467.250629:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.250631:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53f70 lrc: 3/0,1 mode: --/PW res: [0x2bc41:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250634:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.250635:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.250636:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53f70 lrc: 3/0,1 mode: PW/PW res: [0x2bc41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250639:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53f70 lrc: 3/0,1 mode: PW/PW res: [0x2bc41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250642:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53f70 lrc: 3/0,1 mode: PW/PW res: [0x2bc41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250644:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53f70 lrc: 2/0,0 mode: PW/PW res: [0x2bc41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.250645:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+246:39029:x1731745946643520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 117us (157us total) trans 12885081235 rc 0/0 00000100:00100000:0.0:1651529467.250648:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213230 00010000:00010000:0.0:1651529467.250657:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c53f62 lrc: 2/0,0 mode: PW/PW res: [0x2bc61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250660:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ebdbebae already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.250661:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c53f62 lrc: 2/0,0 mode: PW/PW res: [0x2bc61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250664:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c53f62 lrc: 3/0,0 mode: PW/PW res: [0x2bc61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250671:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c53f62 lrc: 1/0,0 mode: --/PW res: [0x2bc61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250674:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c53f62 lrc: 0/0,0 mode: --/PW res: [0x2bc61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250678:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c53f69 lrc: 2/0,0 mode: PW/PW res: [0x2bbf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.250679:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+246:39029:x1731745946643648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 58us (171us total) trans 12885081236 rc 0/0 00010000:00010000:0.0:1651529467.250681:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002f450f42 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.250681:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c53f69 lrc: 2/0,0 mode: PW/PW res: [0x2bbf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.250682:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213232 00010000:00010000:0.0:1651529467.250684:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c53f69 lrc: 3/0,0 mode: PW/PW res: [0x2bbf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250687:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c53f69 lrc: 1/0,0 mode: --/PW res: [0x2bbf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250689:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53f70 lrc: 2/0,0 mode: PW/PW res: [0x2bc41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250690:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c53f69 lrc: 0/0,0 mode: --/PW res: [0x2bbf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250692:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006cbd0d09 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.250693:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53f70 lrc: 2/0,0 mode: PW/PW res: [0x2bc41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250696:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53f70 lrc: 3/0,0 mode: PW/PW res: [0x2bc41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250701:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53f70 lrc: 1/0,0 mode: --/PW res: [0x2bc41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250703:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c53f70 lrc: 0/0,0 mode: --/PW res: [0x2bc41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.250742:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.250771:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.250779:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946643776 00000100:00100000:0.0:1651529467.250780:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.250786:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946643840 00000100:00100000:0.0:1651529467.250787:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.250804:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946643904 00000100:00100000:1.0:1651529467.250811:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946643968 00000100:00100000:1.0:1651529467.250815:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213233 00000100:00100000:1.0:1651529467.250817:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+249:39029:x1731745946643776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.250822:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179384 count 1 00002000:00010000:1.0:1651529467.250827:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcb8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.250829:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c53f77 lrc: 3/0,1 mode: --/PW res: [0x2bcb8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250832:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529467.250832:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529467.250833:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.250834:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c53f77 lrc: 3/0,1 mode: PW/PW res: [0x2bcb8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250838:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c53f77 lrc: 3/0,1 mode: PW/PW res: [0x2bcb8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250841:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c53f77 lrc: 3/0,1 mode: PW/PW res: [0x2bcb8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.250841:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946644032 00010000:00010000:1.0:1651529467.250843:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c53f77 lrc: 2/0,0 mode: PW/PW res: [0x2bcb8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.250848:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213234 00000100:00100000:0.0:1651529467.250856:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+250:39030:x1731745946643840:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.250861:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179299 count 1 00002000:00010000:0.0:1651529467.250867:0:80278:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc63:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.250869:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c53f7e lrc: 3/0,1 mode: --/PW res: [0x2bc63:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250872:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.250873:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.250874:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c53f7e lrc: 3/0,1 mode: PW/PW res: [0x2bc63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250877:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c53f7e lrc: 3/0,1 mode: PW/PW res: [0x2bc63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250880:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c53f7e lrc: 3/0,1 mode: PW/PW res: [0x2bc63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250883:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c53f7e lrc: 2/0,0 mode: PW/PW res: [0x2bc63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.250886:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+251:39029:x1731745946643776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 68us (144us total) trans 12885081237 rc 0/0 00000100:00100000:1.0:1651529467.250889:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213233 00000100:00100000:1.0:1651529467.250894:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213235 00000100:00100000:1.0:1651529467.250896:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+250:39029:x1731745946643904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.250900:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179422 count 1 00002000:00010000:1.0:1651529467.250905:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcde:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.250906:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c53f85 lrc: 3/0,1 mode: --/PW res: [0x2bcde:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250910:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.250910:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.250911:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c53f85 lrc: 3/0,1 mode: PW/PW res: [0x2bcde:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250915:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c53f85 lrc: 3/0,1 mode: PW/PW res: [0x2bcde:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250918:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c53f85 lrc: 3/0,1 mode: PW/PW res: [0x2bcde:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.250921:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+251:39030:x1731745946643840:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 64us (150us total) trans 12885081238 rc 0/0 00010000:00010000:1.0:1651529467.250923:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c53f85 lrc: 2/0,0 mode: PW/PW res: [0x2bcde:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.250941:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213234 00000100:00100000:0.0:1651529467.250947:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213236 00000100:00100000:1.0:1651529467.250957:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+251:39029:x1731745946643904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 60us (176us total) trans 12885081239 rc 0/0 00000100:00100000:0.0:1651529467.250978:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+251:39030:x1731745946643968:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529467.250979:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213235 00002000:00080000:0.0:1651529467.250983:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179306 count 1 00000100:00100000:1.0:1651529467.250984:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213237 00000100:00100000:1.0:1651529467.250986:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+250:39029:x1731745946644032:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00010000:0.0:1651529467.250989:0:80278:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc6a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00080000:1.0:1651529467.250990:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179406 count 1 00010000:00010000:0.0:1651529467.250990:0:80278:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c53f8c lrc: 3/0,1 mode: --/PW res: [0x2bc6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250994:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00010000:1.0:1651529467.250995:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.250995:0:80278:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.250996:0:80278:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c53f8c lrc: 3/0,1 mode: PW/PW res: [0x2bc6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.250997:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c53f93 lrc: 3/0,1 mode: --/PW res: [0x2bcce:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.250999:0:80278:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c53f8c lrc: 3/0,1 mode: PW/PW res: [0x2bc6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251001:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.251001:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.251002:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c53f93 lrc: 3/0,1 mode: PW/PW res: [0x2bcce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251002:0:80278:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c53f8c lrc: 3/0,1 mode: PW/PW res: [0x2bc6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251005:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c53f93 lrc: 3/0,1 mode: PW/PW res: [0x2bcce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251005:0:80278:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c53f8c lrc: 2/0,0 mode: PW/PW res: [0x2bc6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251008:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c53f93 lrc: 3/0,1 mode: PW/PW res: [0x2bcce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251011:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c53f93 lrc: 2/0,0 mode: PW/PW res: [0x2bcce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.251046:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+252:39029:x1731745946644032:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 59us (213us total) trans 12885081240 rc 0/0 00000100:00100000:1.0:1651529467.251049:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213237 00000100:00100000:0.0:1651529467.251052:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+251:39030:x1731745946643968:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 74us (265us total) trans 12885081241 rc 0/0 00000100:00100000:0.0:1651529467.251055:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213236 00010000:00010000:1.0:1651529467.251056:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c53f77 lrc: 2/0,0 mode: PW/PW res: [0x2bcb8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251059:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cd5f3a7c already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.251060:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c53f77 lrc: 2/0,0 mode: PW/PW res: [0x2bcb8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251063:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c53f77 lrc: 3/0,0 mode: PW/PW res: [0x2bcb8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251066:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c53f7e lrc: 2/0,0 mode: PW/PW res: [0x2bc63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251067:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c53f77 lrc: 1/0,0 mode: --/PW res: [0x2bcb8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251070:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c53f77 lrc: 0/0,0 mode: --/PW res: [0x2bcb8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251070:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000a7c37b9 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.251071:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c53f7e lrc: 2/0,0 mode: PW/PW res: [0x2bc63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251074:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c53f85 lrc: 2/0,0 mode: PW/PW res: [0x2bcde:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251074:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c53f7e lrc: 3/0,0 mode: PW/PW res: [0x2bc63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251077:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000314b5fa1 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.251078:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c53f85 lrc: 2/0,0 mode: PW/PW res: [0x2bcde:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251079:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c53f7e lrc: 1/0,0 mode: --/PW res: [0x2bc63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251082:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c53f7e lrc: 0/0,0 mode: --/PW res: [0x2bc63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251083:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c53f85 lrc: 3/0,0 mode: PW/PW res: [0x2bcde:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251086:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c53f8c lrc: 2/0,0 mode: PW/PW res: [0x2bc6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251087:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c53f85 lrc: 1/0,0 mode: --/PW res: [0x2bcde:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251088:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b0407aaf already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.251089:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c53f85 lrc: 0/0,0 mode: --/PW res: [0x2bcde:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251089:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c53f8c lrc: 2/0,0 mode: PW/PW res: [0x2bc6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251092:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c53f8c lrc: 3/0,0 mode: PW/PW res: [0x2bc6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251093:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c53f93 lrc: 2/0,0 mode: PW/PW res: [0x2bcce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251095:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000819c7a2f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.251095:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c53f8c lrc: 1/0,0 mode: --/PW res: [0x2bc6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251096:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c53f93 lrc: 2/0,0 mode: PW/PW res: [0x2bcce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251098:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c53f93 lrc: 3/0,0 mode: PW/PW res: [0x2bcce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251098:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c53f8c lrc: 0/0,0 mode: --/PW res: [0x2bc6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80278 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251101:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c53f93 lrc: 1/0,0 mode: --/PW res: [0x2bcce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251104:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c53f93 lrc: 0/0,0 mode: --/PW res: [0x2bcce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.251120:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.251146:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946644160 00000100:00100000:0.0:1651529467.251147:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.251156:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.251164:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946644096 00000100:00100000:1.0:1651529467.251171:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213238 00000100:00100000:1.0:1651529467.251173:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+252:39029:x1731745946644160:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529467.251173:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946644224 00002000:00080000:1.0:1651529467.251178:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179277 count 1 00000100:00100000:0.0:1651529467.251180:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213239 00000100:00100000:0.0:1651529467.251182:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+253:39029:x1731745946644096:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00010000:1.0:1651529467.251183:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc4d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.251185:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c53f9a lrc: 3/0,1 mode: --/PW res: [0x2bc4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529467.251187:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179376 count 1 00010000:00010000:1.0:1651529467.251188:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.251189:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.251190:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c53f9a lrc: 3/0,1 mode: PW/PW res: [0x2bc4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.251192:0:72395:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcb0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.251193:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c53f9a lrc: 3/0,1 mode: PW/PW res: [0x2bc4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251194:0:72395:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c53fa1 lrc: 3/0,1 mode: --/PW res: [0x2bcb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251196:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c53f9a lrc: 3/0,1 mode: PW/PW res: [0x2bc4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251198:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.251198:0:72395:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.251199:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c53f9a lrc: 2/0,0 mode: PW/PW res: [0x2bc4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251199:0:72395:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c53fa1 lrc: 3/0,1 mode: PW/PW res: [0x2bcb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251203:0:72395:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c53fa1 lrc: 3/0,1 mode: PW/PW res: [0x2bcb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251212:0:72395:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c53fa1 lrc: 3/0,1 mode: PW/PW res: [0x2bcb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251215:0:72395:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c53fa1 lrc: 2/0,0 mode: PW/PW res: [0x2bcb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.251259:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+255:39029:x1731745946644160:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 85us (139us total) trans 12885081242 rc 0/0 00000100:00100000:1.0:1651529467.251262:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213238 00000100:00100000:1.0:1651529467.251267:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213240 00000100:00100000:1.0:1651529467.251269:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+254:39029:x1731745946644224:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529467.251271:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+254:39029:x1731745946644096:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 88us (124us total) trans 12885081243 rc 0/0 00002000:00080000:1.0:1651529467.251273:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179393 count 1 00000100:00100000:0.0:1651529467.251275:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213239 00002000:00010000:1.0:1651529467.251278:0:80277:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcc1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.251279:0:80277:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c53fa8 lrc: 3/0,1 mode: --/PW res: [0x2bcc1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251283:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.251283:0:80277:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.251284:0:80277:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c53fa8 lrc: 3/0,1 mode: PW/PW res: [0x2bcc1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251284:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c53f9a lrc: 2/0,0 mode: PW/PW res: [0x2bc4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251287:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f146053f already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.251288:0:80277:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c53fa8 lrc: 3/0,1 mode: PW/PW res: [0x2bcc1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251288:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c53f9a lrc: 2/0,0 mode: PW/PW res: [0x2bc4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251291:0:80277:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c53fa8 lrc: 3/0,1 mode: PW/PW res: [0x2bcc1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251291:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c53f9a lrc: 3/0,0 mode: PW/PW res: [0x2bc4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251293:0:80277:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c53fa8 lrc: 2/0,0 mode: PW/PW res: [0x2bcc1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251296:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c53f9a lrc: 1/0,0 mode: --/PW res: [0x2bc4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251298:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c53f9a lrc: 0/0,0 mode: --/PW res: [0x2bc4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251303:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c53fa1 lrc: 2/0,0 mode: PW/PW res: [0x2bcb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251305:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000082ae179c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.251306:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c53fa1 lrc: 2/0,0 mode: PW/PW res: [0x2bcb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251309:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c53fa1 lrc: 3/0,0 mode: PW/PW res: [0x2bcb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251312:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c53fa1 lrc: 1/0,0 mode: --/PW res: [0x2bcb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251314:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c53fa1 lrc: 0/0,0 mode: --/PW res: [0x2bcb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251318:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c53fa8 lrc: 2/0,0 mode: PW/PW res: [0x2bcc1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251323:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004f988dee already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.251323:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c53fa8 lrc: 2/0,0 mode: PW/PW res: [0x2bcc1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251326:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c53fa8 lrc: 3/0,0 mode: PW/PW res: [0x2bcc1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251329:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c53fa8 lrc: 1/0,0 mode: --/PW res: [0x2bcc1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.251330:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+254:39029:x1731745946644224:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 60us (173us total) trans 12885081244 rc 0/0 00010000:00010000:0.0:1651529467.251332:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c53fa8 lrc: 0/0,0 mode: --/PW res: [0x2bcc1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 80277 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.251333:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213240 00000100:00100000:0.0:1651529467.251583:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529467.251593:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946644992 00000100:00100000:1.0:1651529467.251604:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213241 00000100:00100000:1.0:1651529467.251605:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+254:39030:x1731745946644992:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.251610:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179225 count 1 00002000:00010000:1.0:1651529467.251623:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.251625:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c53faf lrc: 3/0,1 mode: --/PW res: [0x2bc19:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.251625:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529467.251636:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529467.251636:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529467.251637:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.251638:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c53faf lrc: 3/0,1 mode: PW/PW res: [0x2bc19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251641:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c53faf lrc: 3/0,1 mode: PW/PW res: [0x2bc19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.251643:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529467.251644:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c53faf lrc: 3/0,1 mode: PW/PW res: [0x2bc19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251647:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c53faf lrc: 2/0,0 mode: PW/PW res: [0x2bc19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.251649:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.251660:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.251667:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529467.251674:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946644928 00000100:00100000:0.0:1651529467.251680:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946645120 00000100:00100000:0.0:1651529467.251687:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946645056 00000100:00100000:0.0:1651529467.251690:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946645184 00000100:00100000:0.0:1651529467.251693:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946645248 00000100:00100000:1.0:1651529467.251694:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+260:39030:x1731745946644992:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 88us (121us total) trans 12885081245 rc 0/0 00000100:00100000:0.0:1651529467.251696:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946645312 00000100:00100000:1.0:1651529467.251697:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213241 00000100:00100000:0.0:1651529467.251700:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213242 00000100:00100000:0.0:1651529467.251701:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005961f3ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+260:39029:x1731745946644928:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529467.251703:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213243 00000100:00100000:1.0:1651529467.251705:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+260:39030:x1731745946645120:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529467.251707:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179213 count 1 00002000:00080000:1.0:1651529467.251709:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179227 count 1 00002000:00010000:0.0:1651529467.251712:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc0d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:1.0:1651529467.251714:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.251714:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c53fb6 lrc: 3/0,1 mode: --/PW res: [0x2bc0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251716:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c53fbd lrc: 3/0,1 mode: --/PW res: [0x2bc1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251718:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.251718:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.251719:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.251719:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c53fb6 lrc: 3/0,1 mode: PW/PW res: [0x2bc0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251720:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.251721:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c53fbd lrc: 3/0,1 mode: PW/PW res: [0x2bc1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251723:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c53fb6 lrc: 3/0,1 mode: PW/PW res: [0x2bc0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251725:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c53fbd lrc: 3/0,1 mode: PW/PW res: [0x2bc1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251726:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c53fb6 lrc: 3/0,1 mode: PW/PW res: [0x2bc0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251728:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c53fbd lrc: 3/0,1 mode: PW/PW res: [0x2bc1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251729:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c53fb6 lrc: 2/0,0 mode: PW/PW res: [0x2bc0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251730:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c53fbd lrc: 2/0,0 mode: PW/PW res: [0x2bc1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.251767:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+262:39030:x1731745946645120:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 62us (131us total) trans 12885081247 rc 0/0 00000100:00100000:0.0:1651529467.251767:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005961f3ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+262:39029:x1731745946644928:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 64us (142us total) trans 12885081246 rc 0/0 00000100:00100000:0.0:1651529467.251770:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213242 00000100:00100000:1.0:1651529467.251771:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213243 00000100:00100000:1.0:1651529467.251776:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213244 00000100:00100000:1.0:1651529467.251778:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+260:39029:x1731745946645056:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529467.251782:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179234 count 1 00002000:00010000:1.0:1651529467.251786:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1651529467.251787:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213245 00010000:00010000:1.0:1651529467.251788:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53fc4 lrc: 3/0,1 mode: --/PW res: [0x2bc22:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.251789:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+260:39029:x1731745946645184:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529467.251791:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.251791:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.251792:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53fc4 lrc: 3/0,1 mode: PW/PW res: [0x2bc22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529467.251793:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179201 count 1 00010000:00010000:1.0:1651529467.251796:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53fc4 lrc: 3/0,1 mode: PW/PW res: [0x2bc22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.251807:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc01:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529467.251809:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c53fcb lrc: 3/0,1 mode: --/PW res: [0x2bc01:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251811:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53fc4 lrc: 3/0,1 mode: PW/PW res: [0x2bc22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251813:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53fc4 lrc: 2/0,0 mode: PW/PW res: [0x2bc22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251813:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.251813:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.251814:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c53fcb lrc: 3/0,1 mode: PW/PW res: [0x2bc01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251818:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c53fcb lrc: 3/0,1 mode: PW/PW res: [0x2bc01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251821:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c53fcb lrc: 3/0,1 mode: PW/PW res: [0x2bc01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251824:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c53fcb lrc: 2/0,0 mode: PW/PW res: [0x2bc01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.251846:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+262:39029:x1731745946645056:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 68us (203us total) trans 12885081248 rc 0/0 00000100:00100000:1.0:1651529467.251849:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213244 00000100:00100000:1.0:1651529467.251854:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213246 00000100:00100000:1.0:1651529467.251856:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+261:39029:x1731745946645248:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529467.251858:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+261:39029:x1731745946645184:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 68us (209us total) trans 12885081249 rc 0/0 00002000:00080000:1.0:1651529467.251860:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179237 count 1 00000100:00100000:0.0:1651529467.251861:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213245 00002000:00010000:1.0:1651529467.251864:0:72397:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bc25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.251866:0:72397:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c53fd2 lrc: 3/0,1 mode: --/PW res: [0x2bc25:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.251866:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213247 00000100:00100000:0.0:1651529467.251868:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+260:39030:x1731745946645312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529467.251869:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.251870:0:72397:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.251870:0:72397:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c53fd2 lrc: 3/0,1 mode: PW/PW res: [0x2bc25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529467.251872:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179170 count 1 00010000:00010000:1.0:1651529467.251874:0:72397:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c53fd2 lrc: 3/0,1 mode: PW/PW res: [0x2bc25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529467.251876:0:156655:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bbe2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529467.251877:0:72397:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c53fd2 lrc: 3/0,1 mode: PW/PW res: [0x2bc25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251878:0:156655:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c53fd9 lrc: 3/0,1 mode: --/PW res: [0x2bbe2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251881:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529467.251882:0:72397:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c53fd2 lrc: 2/0,0 mode: PW/PW res: [0x2bc25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251882:0:156655:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529467.251882:0:156655:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c53fd9 lrc: 3/0,1 mode: PW/PW res: [0x2bbe2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251886:0:156655:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c53fd9 lrc: 3/0,1 mode: PW/PW res: [0x2bbe2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251889:0:156655:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c53fd9 lrc: 3/0,1 mode: PW/PW res: [0x2bbe2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251892:0:156655:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c53fd9 lrc: 2/0,0 mode: PW/PW res: [0x2bbe2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529467.251912:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+262:39029:x1731745946645248:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 56us (252us total) trans 12885081250 rc 0/0 00000100:00100000:1.0:1651529467.251915:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213246 00010000:00010000:1.0:1651529467.251922:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c53faf lrc: 2/0,0 mode: PW/PW res: [0x2bc19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.251923:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+261:39030:x1731745946645312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 54us (255us total) trans 12885081251 rc 0/0 00010000:00010000:1.0:1651529467.251925:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000097255e6b already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.251926:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c53faf lrc: 2/0,0 mode: PW/PW res: [0x2bc19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529467.251926:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213247 00010000:00010000:1.0:1651529467.251929:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c53faf lrc: 3/0,0 mode: PW/PW res: [0x2bc19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251934:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c53faf lrc: 1/0,0 mode: --/PW res: [0x2bc19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251936:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c53faf lrc: 0/0,0 mode: --/PW res: [0x2bc19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251936:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c53fb6 lrc: 2/0,0 mode: PW/PW res: [0x2bc0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251939:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000036d87bb6 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.251940:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c53fbd lrc: 2/0,0 mode: PW/PW res: [0x2bc1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251940:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c53fb6 lrc: 2/0,0 mode: PW/PW res: [0x2bc0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251943:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005635b116 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.251943:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c53fb6 lrc: 3/0,0 mode: PW/PW res: [0x2bc0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251944:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c53fbd lrc: 2/0,0 mode: PW/PW res: [0x2bc1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251947:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c53fbd lrc: 3/0,0 mode: PW/PW res: [0x2bc1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251947:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c53fb6 lrc: 1/0,0 mode: --/PW res: [0x2bc0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251950:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c53fbd lrc: 1/0,0 mode: --/PW res: [0x2bc1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251950:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c53fb6 lrc: 0/0,0 mode: --/PW res: [0x2bc0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251953:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c53fbd lrc: 0/0,0 mode: --/PW res: [0x2bc1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251955:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53fc4 lrc: 2/0,0 mode: PW/PW res: [0x2bc22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251956:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c53fcb lrc: 2/0,0 mode: PW/PW res: [0x2bc01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251958:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f0b0fa2c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.251958:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53fc4 lrc: 2/0,0 mode: PW/PW res: [0x2bc22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251959:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2a86deb already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.251960:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c53fcb lrc: 2/0,0 mode: PW/PW res: [0x2bc01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251961:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53fc4 lrc: 3/0,0 mode: PW/PW res: [0x2bc22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251962:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c53fcb lrc: 3/0,0 mode: PW/PW res: [0x2bc01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251964:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53fc4 lrc: 1/0,0 mode: --/PW res: [0x2bc22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251965:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c53fcb lrc: 1/0,0 mode: --/PW res: [0x2bc01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251967:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c53fc4 lrc: 0/0,0 mode: --/PW res: [0x2bc22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251968:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c53fcb lrc: 0/0,0 mode: --/PW res: [0x2bc01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251970:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c53fd2 lrc: 2/0,0 mode: PW/PW res: [0x2bc25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251971:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c53fd9 lrc: 2/0,0 mode: PW/PW res: [0x2bbe2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251973:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024627ba8 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529467.251974:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001ea46bb1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529467.251974:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c53fd2 lrc: 2/0,0 mode: PW/PW res: [0x2bc25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251975:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c53fd9 lrc: 2/0,0 mode: PW/PW res: [0x2bbe2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251977:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c53fd2 lrc: 3/0,0 mode: PW/PW res: [0x2bc25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251978:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c53fd9 lrc: 3/0,0 mode: PW/PW res: [0x2bbe2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251980:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c53fd2 lrc: 1/0,0 mode: --/PW res: [0x2bc25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251981:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c53fd9 lrc: 1/0,0 mode: --/PW res: [0x2bbe2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529467.251983:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c53fd2 lrc: 0/0,0 mode: --/PW res: [0x2bc25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529467.251984:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c53fd9 lrc: 0/0,0 mode: --/PW res: [0x2bbe2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 156655 timeout: 0 lvb_type: 0 00000400:00000080:0.0:1651529467.809087:0:162918:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651529467.809090:0:162918:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 133f: Check reads/writes of client lustre proc files with bad area io ========================================================== 22:11:07 (1651529467) 00000100:00100000:0.0:1651529467.909409:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529467.909439:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397056000 00000100:00100000:1.0:1651529467.909457:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 213248 00000100:00100000:1.0:1651529467.909460:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:41277:x1731746397056000:12345-10.240.43.64@tcp:8:lctl.0 00010000:00080000:1.0:1651529467.909473:0:80277:0:(ldlm_lib.c:1365:target_handle_connect()) lustre-OST0001: connection from a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp t0 exp 0000000055bfac58 cur 20126 last 0 00000020:00000080:1.0:1651529467.909485:0:80277:0:(genops.c:1359:class_connect()) connect: client a5e20e05-95ba-4d6f-a195-0604c0c0ff53, cookie 0x3234de053c53fe0 00002000:00100000:1.0:1651529467.909490:0:80277:0:(ofd_obd.c:150:ofd_parse_connect_data()) lustre-OST0001: cli a5e20e05-95ba-4d6f-a195-0604c0c0ff53/0000000027c9d4bf ocd_connect_flags: 0xa0465af2e3640078 ocd_version: 20f0000 ocd_grant: 351920128 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1651529467.909498:0:80277:0:(ofd_obd.c:249:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000020:01000000:1.0:1651529467.909527:0:80277:0:(lprocfs_status_server.c:544:lprocfs_exp_setup()) using hash 000000008715afdc 00002000:00080000:1.0:1651529467.909530:0:80277:0:(ofd_obd.c:391:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1651529467.909542:0:80277:0:(import.c:85:import_set_state_nolock()) 00000000d75fadd9 ¶×à”ÿÿ: changing import state from RECOVER to FULL 00000100:00100000:1.0:1651529467.909568:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:41277:x1731746397056000:12345-10.240.43.64@tcp:8:lctl.0 Request processed in 108us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529467.909574:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 213248 00000100:00100000:0.0:1651529467.909950:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529467.909961:0:72398:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397056064 00000100:00100000:0.0:1651529467.909979:0:72398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 594 00000100:00100000:0.0:1651529467.909981:0:72398:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:0:x1731746397056064:12345-10.240.43.64@tcp:13:lctl.0 00002000:00000024:0.0:1651529467.909988:0:72398:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8580288 pending 0 free 81309163520 avail 77138452480 00000100:00100000:0.0:1651529467.910012:0:72398:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:0:x1731746397056064:12345-10.240.43.64@tcp:13:lctl.0 Request processed in 30us (62us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529467.910015:0:72398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 594 00000100:00100000:0.0:1651529467.914409:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529467.914432:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397056256 00000100:00100000:1.0:1651529467.914443:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 95 00000100:00100000:1.0:1651529467.914445:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:433543:x1731746397056256:12345-10.240.43.64@tcp:400:lctl.0 00000100:00100000:1.0:1651529467.914460:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:433543:x1731746397056256:12345-10.240.43.64@tcp:400:lctl.0 Request processed in 14us (51us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529467.914462:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 95 00000100:00100000:0.0:1651529467.921717:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529467.921740:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397056448 00000100:00100000:1.0:1651529467.921748:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 96 00000100:00100000:1.0:1651529467.921750:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:433543:x1731746397056448:12345-10.240.43.64@tcp:400:lctl.0 00000100:00100000:1.0:1651529467.921762:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:433543:x1731746397056448:12345-10.240.43.64@tcp:400:lctl.0 Request processed in 11us (45us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529467.921765:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 96 00000100:00100000:0.0:1651529467.927915:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529467.927937:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397056768 00000100:00100000:1.0:1651529467.927946:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 97 00000100:00100000:1.0:1651529467.927947:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:433543:x1731746397056768:12345-10.240.43.64@tcp:400:lctl.0 00000100:00100000:1.0:1651529467.927959:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:433543:x1731746397056768:12345-10.240.43.64@tcp:400:lctl.0 Request processed in 11us (45us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529467.927962:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 97 00000100:00100000:0.0:1651529467.930108:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529467.930130:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397056896 00000100:00100000:1.0:1651529467.930138:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 98 00000100:00100000:1.0:1651529467.930139:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:433543:x1731746397056896:12345-10.240.43.64@tcp:400:lctl.0 00000100:00100000:1.0:1651529467.930151:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:433543:x1731746397056896:12345-10.240.43.64@tcp:400:lctl.0 Request processed in 11us (44us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529467.930155:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 98 00000100:00100000:0.0:1651529467.932271:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529467.932293:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397057024 00000100:00100000:1.0:1651529467.932301:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 99 00000100:00100000:1.0:1651529467.932302:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:433543:x1731746397057024:12345-10.240.43.64@tcp:400:lctl.0 00000100:00100000:1.0:1651529467.932314:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:433543:x1731746397057024:12345-10.240.43.64@tcp:400:lctl.0 Request processed in 11us (44us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529467.932317:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 99 00000100:00100000:0.0:1651529467.939055:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529467.939078:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397057472 00000100:00100000:1.0:1651529467.939086:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 100 00000100:00100000:1.0:1651529467.939088:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:433543:x1731746397057472:12345-10.240.43.64@tcp:400:lctl.0 00000100:00100000:1.0:1651529467.939099:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:433543:x1731746397057472:12345-10.240.43.64@tcp:400:lctl.0 Request processed in 11us (44us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529467.939102:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 100 00000100:00100000:0.0:1651529467.941294:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529467.941316:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397057600 00000100:00100000:1.0:1651529467.941324:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 101 00000100:00100000:1.0:1651529467.941326:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:433543:x1731746397057600:12345-10.240.43.64@tcp:400:lctl.0 00000100:00100000:1.0:1651529467.941337:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:433543:x1731746397057600:12345-10.240.43.64@tcp:400:lctl.0 Request processed in 11us (44us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529467.941340:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 101 00000100:00100000:0.0:1651529467.943465:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529467.943487:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397057728 00000100:00100000:1.0:1651529467.943494:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 102 00000100:00100000:1.0:1651529467.943496:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:433543:x1731746397057728:12345-10.240.43.64@tcp:400:lctl.0 00000100:00100000:1.0:1651529467.943508:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:433543:x1731746397057728:12345-10.240.43.64@tcp:400:lctl.0 Request processed in 11us (43us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529467.943512:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 102 00000100:00100000:0.0:1651529467.963301:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529467.963323:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397057920 00000100:00100000:1.0:1651529467.963331:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 103 00000100:00100000:1.0:1651529467.963333:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:433543:x1731746397057920:12345-10.240.43.64@tcp:400:lctl.0 00000100:00100000:1.0:1651529467.963344:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:433543:x1731746397057920:12345-10.240.43.64@tcp:400:lctl.0 Request processed in 11us (44us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529467.963347:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 103 00000100:00100000:0.0:1651529467.967979:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529467.968001:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397058112 00000100:00100000:1.0:1651529467.968009:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 104 00000100:00100000:1.0:1651529467.968010:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:433543:x1731746397058112:12345-10.240.43.64@tcp:400:lctl.0 00000100:00100000:1.0:1651529467.968022:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:433543:x1731746397058112:12345-10.240.43.64@tcp:400:lctl.0 Request processed in 11us (43us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529467.968025:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 104 00000100:00100000:0.0:1651529467.974132:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529467.974154:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397058432 00000100:00100000:1.0:1651529467.974162:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 105 00000100:00100000:1.0:1651529467.974164:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:433543:x1731746397058432:12345-10.240.43.64@tcp:400:lctl.0 00000100:00100000:1.0:1651529467.974175:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:433543:x1731746397058432:12345-10.240.43.64@tcp:400:lctl.0 Request processed in 11us (44us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529467.974178:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 105 00000100:00100000:0.0:1651529467.976277:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529467.976298:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397058560 00000100:00100000:1.0:1651529467.976306:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 106 00000100:00100000:1.0:1651529467.976308:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:433543:x1731746397058560:12345-10.240.43.64@tcp:400:lctl.0 00000100:00100000:1.0:1651529467.976319:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:433543:x1731746397058560:12345-10.240.43.64@tcp:400:lctl.0 Request processed in 11us (43us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529467.976323:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 106 00000100:00100000:0.0:1651529467.978438:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529467.978458:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397058688 00000100:00100000:1.0:1651529467.978466:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 107 00000100:00100000:1.0:1651529467.978468:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:433543:x1731746397058688:12345-10.240.43.64@tcp:400:lctl.0 00000100:00100000:1.0:1651529467.978479:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:433543:x1731746397058688:12345-10.240.43.64@tcp:400:lctl.0 Request processed in 11us (41us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529467.978482:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 107 00000100:00100000:0.0:1651529467.984704:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529467.984725:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397059136 00000100:00100000:1.0:1651529467.984733:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 108 00000100:00100000:1.0:1651529467.984734:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:433543:x1731746397059136:12345-10.240.43.64@tcp:400:lctl.0 00000100:00100000:1.0:1651529467.984746:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:433543:x1731746397059136:12345-10.240.43.64@tcp:400:lctl.0 Request processed in 11us (43us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529467.984749:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 108 00000100:00100000:0.0:1651529467.986842:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529467.986863:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397059264 00000100:00100000:1.0:1651529467.986870:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 109 00000100:00100000:1.0:1651529467.986872:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:433543:x1731746397059264:12345-10.240.43.64@tcp:400:lctl.0 00000100:00100000:1.0:1651529467.986884:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:433543:x1731746397059264:12345-10.240.43.64@tcp:400:lctl.0 Request processed in 11us (42us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529467.986886:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 109 00000100:00100000:0.0:1651529467.988983:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529467.989004:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397059392 00000100:00100000:1.0:1651529467.989011:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 110 00000100:00100000:1.0:1651529467.989013:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:433543:x1731746397059392:12345-10.240.43.64@tcp:400:lctl.0 00000100:00100000:1.0:1651529467.989024:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:433543:x1731746397059392:12345-10.240.43.64@tcp:400:lctl.0 Request processed in 11us (42us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529467.989028:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 110 00000100:00100000:0.0:1651529467.994895:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529467.994916:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397059712 00000100:00100000:1.0:1651529467.994924:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 111 00000100:00100000:1.0:1651529467.994926:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:433543:x1731746397059712:12345-10.240.43.64@tcp:400:lctl.0 00000100:00100000:1.0:1651529467.994937:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:433543:x1731746397059712:12345-10.240.43.64@tcp:400:lctl.0 Request processed in 11us (42us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529467.994940:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 111 00000100:00100000:0.0:1651529467.997046:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529467.997067:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397059840 00000100:00100000:1.0:1651529467.997074:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 112 00000100:00100000:1.0:1651529467.997076:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:433543:x1731746397059840:12345-10.240.43.64@tcp:400:lctl.0 00000100:00100000:1.0:1651529467.997088:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:433543:x1731746397059840:12345-10.240.43.64@tcp:400:lctl.0 Request processed in 11us (42us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529467.997090:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 112 00000100:00100000:0.0:1651529467.999192:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529467.999214:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397059968 00000100:00100000:1.0:1651529467.999235:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 113 00000100:00100000:1.0:1651529467.999237:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:433543:x1731746397059968:12345-10.240.43.64@tcp:400:lctl.0 00000100:00100000:1.0:1651529467.999250:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:433543:x1731746397059968:12345-10.240.43.64@tcp:400:lctl.0 Request processed in 12us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529467.999252:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 113 00000100:00100000:0.0:1651529468.004353:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529468.004375:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397060288 00000100:00100000:1.0:1651529468.004385:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 114 00000100:00100000:1.0:1651529468.004387:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007f9b0c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:433543:x1731746397060288:12345-10.240.43.64@tcp:400:lctl.0 00000100:00100000:1.0:1651529468.004401:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007f9b0c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:433543:x1731746397060288:12345-10.240.43.64@tcp:400:lctl.0 Request processed in 13us (49us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529468.004405:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 114 00000100:00100000:0.0:1651529468.006544:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529468.006565:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397060416 00000100:00100000:1.0:1651529468.006575:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 115 00000100:00100000:1.0:1651529468.006577:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5ebc6ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:433543:x1731746397060416:12345-10.240.43.64@tcp:400:lctl.0 00000100:00100000:1.0:1651529468.006591:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5ebc6ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:433543:x1731746397060416:12345-10.240.43.64@tcp:400:lctl.0 Request processed in 13us (47us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529468.006593:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 115 00000100:00100000:0.0:1651529468.008701:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529468.008722:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397060544 00000100:00100000:1.0:1651529468.008733:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 116 00000100:00100000:1.0:1651529468.008734:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068b6c75f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:433543:x1731746397060544:12345-10.240.43.64@tcp:400:lctl.0 00000100:00100000:1.0:1651529468.008747:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068b6c75f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:433543:x1731746397060544:12345-10.240.43.64@tcp:400:lctl.0 Request processed in 13us (47us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529468.008750:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 116 00000100:00100000:0.0:1651529469.551395:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529469.551432:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946646464 00000100:00100000:1.0:1651529469.551460:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213249 00000100:00100000:1.0:1651529469.551463:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000020362888 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+261:204180:x1731745946646464:12345-10.240.43.61@tcp:9:umount.0 00000020:00000080:1.0:1651529469.551489:0:72396:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0x3234de053b4d612 00000100:00080000:1.0:1651529469.551498:0:72396:0:(import.c:85:import_set_state_nolock()) 000000001ba15799 ¶×à”ÿÿ: changing import state from FULL to CLOSED 00000001:00000004:1.0:1651529469.551524:0:72396:0:(tgt_lastrcvd.c:701:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12885081251 00000100:00100000:1.0:1651529469.551603:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000020362888 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+258:204180:x1731745946646464:12345-10.240.43.61@tcp:9:umount.0 Request processed in 140us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529469.551607:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213249 00000001:00100000:1.0:1651529473.344516:0:72382:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1651529473.344521:0:72382:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a5e20e05-95ba-4d6f-a195-0604c0c0ff53 00000001:00080000:1.0:1651529473.344524:0:72382:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 12885081251 is committed 00000020:00000080:1.0:1651529473.344620:0:72382:0:(genops.c:985:class_export_put()) final put 00000000c1602370/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1651529473.344631:0:153568:0:(genops.c:944:class_export_destroy()) destroying export 00000000c1602370/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1651529473.344664:0:153568:0:(genops.c:1164:obd_zombie_import_free()) destroying import 000000001ba15799 for lustre-OST0001 00000100:00100000:0.0:1651529490.213620:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.213680:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946648448 00000100:00100000:1.0:1651529490.213706:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213250 00000100:00100000:1.0:1651529490.213709:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df603127 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:39028:x1731745946648448:12345-10.240.43.61@tcp:8:llog_process_th.0 00010000:00080000:1.0:1651529490.213724:0:72396:0:(ldlm_lib.c:1365:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@10.240.43.61@tcp t0 exp 0000000055bfac58 cur 20148 last 0 00000020:00000080:1.0:1651529490.213737:0:72396:0:(genops.c:1359:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3234de053c53fe7 00002000:00100000:1.0:1651529490.213743:0:72396:0:(ofd_obd.c:150:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/00000000c19d32bc ocd_connect_flags: 0x2044401443000066 ocd_version: 20f0000 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1651529490.213744:0:72396:0:(ofd_obd.c:168:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1651529490.213745:0:72396:0:(ofd_obd.c:257:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000020:01000000:1.0:1651529490.213788:0:72396:0:(lprocfs_status_server.c:544:lprocfs_exp_setup()) using hash 000000008715afdc 00002000:00080000:1.0:1651529490.213792:0:72396:0:(ofd_obd.c:391:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1651529490.213820:0:72396:0:(import.c:85:import_set_state_nolock()) 00000000754c6bd3 ¶×à”ÿÿ: changing import state from RECOVER to FULL 00000100:00100000:1.0:1651529490.213854:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df603127 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39028:x1731745946648448:12345-10.240.43.61@tcp:8:llog_process_th.0 Request processed in 144us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529490.213858:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213250 00000100:00100000:0.0:1651529490.214158:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.214209:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946649152 00000100:00100000:1.0:1651529490.214220:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213251 00000100:00100000:1.0:1651529490.214248:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003132c0c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946649152:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.214257:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179210 count 1 00000100:00100000:0.0:1651529490.214264:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.214273:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.214281:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.214288:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.214299:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003132c0c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946649152:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 50us (143us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.214303:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213251 00000100:00100000:0.0:1651529490.214304:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.214309:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946649280 00000100:00100000:1.0:1651529490.214317:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946649216 00000100:00100000:1.0:1651529490.214323:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946649344 00000100:00100000:1.0:1651529490.214329:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946649408 00000100:00100000:1.0:1651529490.214333:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946649536 00000100:00100000:1.0:1651529490.214338:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213252 00000100:00100000:1.0:1651529490.214340:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000056e45ef2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745946649280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.214350:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179228 count 1 00000100:00100000:0.0:1651529490.214364:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.214369:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000056e45ef2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745946649280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 28us (106us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.214372:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213252 00000100:00100000:0.0:1651529490.214372:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.214377:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946649472 00000100:00100000:1.0:1651529490.214380:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946649600 00000100:00100000:1.0:1651529490.214383:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213253 00000100:00100000:1.0:1651529490.214385:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9b0314b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:39029:x1731745946649216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.214389:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179172 count 1 00000100:00100000:0.0:1651529490.214406:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.214413:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9b0314b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:39029:x1731745946649216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 27us (139us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.214416:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213253 00000100:00100000:1.0:1651529490.214420:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213254 00000100:00100000:1.0:1651529490.214422:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745946649344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.214426:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179391 count 1 00000100:00100000:1.0:1651529490.214453:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745946649344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 30us (171us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.214464:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213255 00000100:00100000:1.0:1651529490.214467:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213254 00000100:00100000:0.0:1651529490.214467:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745946649408:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529490.214472:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213256 00000100:00100000:1.0:1651529490.214473:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946649536:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.214477:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179272 count 1 00002000:00080000:1.0:1651529490.214479:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179423 count 1 00000100:00100000:1.0:1651529490.214492:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946649536:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 18us (189us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.214495:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213256 00000100:00100000:1.0:1651529490.214498:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213257 00000100:00100000:1.0:1651529490.214500:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946649472:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.214504:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179318 count 1 00000100:00100000:0.0:1651529490.214505:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946649408:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 38us (217us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.214509:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213255 00000100:00100000:1.0:1651529490.214516:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946649472:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 15us (152us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.214517:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213258 00000100:00100000:1.0:1651529490.214518:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213257 00000100:00100000:0.0:1651529490.214518:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946649600:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.214523:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179198 count 1 00000100:00100000:0.0:1651529490.214537:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946649600:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 18us (165us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.214540:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213258 00000100:00100000:0.0:1651529490.214554:0:72398:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946649664 00000100:00100000:0.0:1651529490.214571:0:72398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 595 00000100:00100000:0.0:1651529490.214574:0:72398:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946649664:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651529490.214585:0:72398:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8580288 pending 0 free 81309163520 avail 77138452480 00000100:00100000:0.0:1651529490.214603:0:72398:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ad6d0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946649664:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 28us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529490.214609:0:72398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 595 00000100:00100000:1.0:1651529490.214738:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.214750:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.214758:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946650240 00000100:00100000:1.0:1651529490.214759:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.214771:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946650304 00000100:00100000:0.0:1651529490.214775:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946650368 00000100:00100000:0.0:1651529490.214783:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213259 00000100:00100000:0.0:1651529490.214785:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0b5d3bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946650240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529490.214787:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213260 00000100:00100000:1.0:1651529490.214789:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a8bfda0b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946650304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.214790:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179365 count 1 00002000:00080000:1.0:1651529490.214796:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179244 count 1 00000100:00100000:0.0:1651529490.214825:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0b5d3bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946650240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 39us (94us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.214826:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a8bfda0b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946650304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 36us (76us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.214828:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213259 00000100:00100000:1.0:1651529490.214830:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213260 00000100:00100000:0.0:1651529490.214834:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213261 00000100:00100000:0.0:1651529490.214835:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082cd1a65 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946650368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.214840:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179409 count 1 00000100:00100000:0.0:1651529490.214856:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082cd1a65 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946650368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 20us (97us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.214859:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213261 00000100:00100000:1.0:1651529490.214958:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.214972:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946650496 00000100:00100000:0.0:1651529490.214981:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213262 00000100:00100000:0.0:1651529490.214982:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a4625808 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946650496:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.214988:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179401 count 1 00000100:00100000:0.0:1651529490.215008:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a4625808 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946650496:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 25us (51us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.215011:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213262 00000100:00100000:1.0:1651529490.215215:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.215241:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946651072 00000100:00100000:1.0:1651529490.215242:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.215254:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946651136 00000100:00100000:0.0:1651529490.215259:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213263 00000100:00100000:0.0:1651529490.215260:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008ba0025f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946651072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.215266:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179199 count 1 00000100:00100000:0.0:1651529490.215287:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008ba0025f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946651072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 26us (72us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.215290:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213263 00000100:00100000:0.0:1651529490.215294:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213264 00000100:00100000:0.0:1651529490.215296:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6d6e076 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946651136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.215299:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179412 count 1 00000100:00100000:0.0:1651529490.215312:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6d6e076 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946651136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 16us (71us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.215315:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213264 00000100:00100000:1.0:1651529490.215478:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.215500:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.215510:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.215518:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.215519:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946651200 00000100:00100000:1.0:1651529490.215526:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.215540:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946651328 00000100:00100000:1.0:1651529490.215541:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.215548:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946651456 00000100:00100000:0.0:1651529490.215551:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946651264 00000100:00100000:0.0:1651529490.215557:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946651392 00000100:00100000:1.0:1651529490.215560:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946651584 00000100:00100000:0.0:1651529490.215564:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213265 00000100:00100000:0.0:1651529490.215565:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a7ff2283 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946651200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.215571:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179349 count 1 00000100:00100000:1.0:1651529490.215575:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213266 00000100:00100000:1.0:1651529490.215577:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001ceb614c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946651328:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.215584:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179221 count 1 00000100:00100000:0.0:1651529490.215592:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a7ff2283 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946651200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 26us (115us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.215595:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213265 00000100:00100000:0.0:1651529490.215600:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213267 00000100:00100000:0.0:1651529490.215601:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0b5d3bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946651456:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.215605:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179405 count 1 00000100:00100000:1.0:1651529490.215606:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001ceb614c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946651328:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 28us (106us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.215609:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213266 00000100:00100000:1.0:1651529490.215615:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213268 00000100:00100000:1.0:1651529490.215617:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a8bfda0b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946651264:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529490.215618:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0b5d3bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946651456:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 16us (108us total) trans 0 rc -2/-2 00002000:00080000:1.0:1651529490.215621:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179351 count 1 00000100:00100000:0.0:1651529490.215621:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213267 00000100:00100000:0.0:1651529490.215625:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213269 00000100:00100000:0.0:1651529490.215626:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082cd1a65 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946651392:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.215630:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179389 count 1 00000100:00100000:1.0:1651529490.215635:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a8bfda0b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946651264:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 18us (117us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.215638:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213268 00000100:00100000:1.0:1651529490.215642:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213270 00000100:00100000:0.0:1651529490.215642:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082cd1a65 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946651392:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 15us (116us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.215644:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000520b3978 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946651584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529490.215645:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213269 00002000:00080000:1.0:1651529490.215647:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179204 count 1 00000100:00100000:1.0:1651529490.215659:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000520b3978 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946651584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 14us (118us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.215662:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213270 00000100:00100000:1.0:1651529490.215710:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.215723:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.215730:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946651648 00000100:00100000:1.0:1651529490.215735:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946651712 00000100:00100000:1.0:1651529490.215740:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213271 00000100:00100000:1.0:1651529490.215747:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008e0465ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946651648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.215758:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179360 count 1 00000100:00100000:1.0:1651529490.215781:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008e0465ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946651648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 39us (72us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.215784:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213271 00000100:00100000:1.0:1651529490.215789:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213272 00000100:00100000:1.0:1651529490.215791:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000079f8b444 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946651712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.215795:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179215 count 1 00000100:00100000:1.0:1651529490.215809:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000079f8b444 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946651712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 17us (86us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.215822:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213272 00000100:00100000:0.0:1651529490.216131:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.216169:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946652352 00000100:00100000:1.0:1651529490.216177:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213273 00000100:00100000:1.0:1651529490.216179:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946652352:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.216184:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179280 count 1 00000100:00100000:0.0:1651529490.216192:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.216206:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.216214:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.216238:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946652352:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 57us (107us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.216239:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.216241:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213273 00000100:00100000:1.0:1651529490.216250:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946652480 00000100:00100000:1.0:1651529490.216255:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946652608 00000100:00100000:1.0:1651529490.216261:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946652736 00000100:00100000:1.0:1651529490.216265:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946652288 00000100:00100000:1.0:1651529490.216276:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213274 00000100:00100000:1.0:1651529490.216278:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946652480:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.216283:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179341 count 1 00000100:00100000:0.0:1651529490.216284:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.216292:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.216298:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946652480:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 19us (108us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.216300:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.216301:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213274 00000100:00100000:1.0:1651529490.216305:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946652416 00000100:00100000:1.0:1651529490.216308:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946652544 00000100:00100000:1.0:1651529490.216311:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946652672 00000100:00100000:1.0:1651529490.216314:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213275 00000100:00100000:1.0:1651529490.216315:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:39029:x1731745946652608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.216319:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179395 count 1 00000100:00100000:0.0:1651529490.216329:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213276 00000100:00100000:0.0:1651529490.216332:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:39029:x1731745946652736:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.216338:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179371 count 1 00000100:00100000:1.0:1651529490.216346:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:39029:x1731745946652608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 30us (140us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.216349:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213275 00000100:00100000:1.0:1651529490.216353:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213277 00000100:00100000:1.0:1651529490.216355:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745946652288:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.216359:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179233 count 1 00000100:00100000:1.0:1651529490.216373:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745946652288:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 17us (134us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.216375:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213277 00000100:00100000:1.0:1651529490.216379:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213278 00000100:00100000:1.0:1651529490.216381:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946652416:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.216384:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179300 count 1 00000100:00100000:0.0:1651529490.216384:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946652736:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 52us (169us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.216388:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213276 00000100:00100000:1.0:1651529490.216394:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946652416:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 13us (111us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.216395:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213279 00000100:00100000:0.0:1651529490.216396:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946652544:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529490.216397:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213278 00000100:00100000:1.0:1651529490.216401:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213280 00002000:00080000:0.0:1651529490.216401:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179375 count 1 00000100:00100000:1.0:1651529490.216403:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946652672:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.216407:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179281 count 1 00000100:00100000:0.0:1651529490.216415:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946652544:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 18us (123us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.216417:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213279 00000100:00100000:1.0:1651529490.216419:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946652672:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 15us (119us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.216421:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213280 00000100:00100000:1.0:1651529490.217037:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.217051:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.217070:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.217084:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.217091:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.217097:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.217103:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.217117:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.217127:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946653568 00000100:00100000:0.0:1651529490.217129:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946653504 00000100:00100000:1.0:1651529490.217134:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946653696 00000100:00100000:0.0:1651529490.217138:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946653888 00000100:00100000:1.0:1651529490.217140:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946654016 00000100:00100000:1.0:1651529490.217146:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946653824 00000100:00100000:1.0:1651529490.217148:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946653952 00000100:00100000:1.0:1651529490.217151:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213281 00000100:00100000:0.0:1651529490.217151:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946654080 00000100:00100000:1.0:1651529490.217153:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e788caed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946653568:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529490.217155:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213282 00000100:00100000:0.0:1651529490.217156:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7dfc8bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946653504:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.217158:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179421 count 1 00002000:00080000:0.0:1651529490.217162:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179321 count 1 00000100:00100000:1.0:1651529490.217180:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e788caed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946653568:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 26us (144us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.217183:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213281 00000100:00100000:1.0:1651529490.217188:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213283 00000100:00100000:0.0:1651529490.217188:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7dfc8bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745946653504:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 31us (142us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.217190:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000380bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946653696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529490.217191:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213282 00002000:00080000:1.0:1651529490.217193:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179219 count 1 00000100:00100000:0.0:1651529490.217196:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213284 00000100:00100000:0.0:1651529490.217198:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009dfac288 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946654016:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.217202:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179356 count 1 00000100:00100000:1.0:1651529490.217207:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000380bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946653696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 17us (137us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.217210:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213283 00000100:00100000:1.0:1651529490.217214:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213285 00000100:00100000:1.0:1651529490.217215:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004c03f4d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946653824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529490.217215:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009dfac288 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946654016:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 17us (124us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.217218:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213284 00002000:00080000:1.0:1651529490.217219:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179230 count 1 00000100:00100000:0.0:1651529490.217238:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213286 00000100:00100000:0.0:1651529490.217240:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005954c7f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946653888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.217245:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179267 count 1 00000100:00100000:1.0:1651529490.217250:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004c03f4d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946653824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 34us (152us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.217253:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213285 00000100:00100000:1.0:1651529490.217258:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213287 00000100:00100000:0.0:1651529490.217258:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005954c7f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946653888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 18us (175us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.217260:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000f50c14a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946653952:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529490.217261:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213286 00002000:00080000:1.0:1651529490.217264:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179266 count 1 00000100:00100000:0.0:1651529490.217266:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213288 00000100:00100000:0.0:1651529490.217267:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c810c14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946654080:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.217271:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179338 count 1 00000100:00100000:1.0:1651529490.217276:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000f50c14a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946653952:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 16us (173us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.217279:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213287 00000100:00100000:0.0:1651529490.217283:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c810c14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946654080:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 15us (166us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.217286:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213288 00000100:00100000:1.0:1651529490.219306:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.219319:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.219329:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.219337:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946654848 00000100:00100000:1.0:1651529490.219338:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.219346:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.219358:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946654976 00000100:00100000:0.0:1651529490.219365:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946655104 00000100:00100000:1.0:1651529490.219367:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.219370:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946655232 00000100:00100000:0.0:1651529490.219380:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946654912 00000100:00100000:0.0:1651529490.219386:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946655040 00000100:00100000:0.0:1651529490.219393:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213289 00000100:00100000:0.0:1651529490.219394:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fb8007ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946654848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529490.219395:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529490.219400:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179232 count 1 00000100:00100000:1.0:1651529490.219402:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.219408:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946655168 00000100:00100000:1.0:1651529490.219414:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946655296 00000100:00100000:1.0:1651529490.219417:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213290 00000100:00100000:1.0:1651529490.219419:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000092e14270 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946654976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529490.219421:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fb8007ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946654848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 26us (124us total) trans 0 rc -2/-2 00002000:00080000:1.0:1651529490.219425:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179284 count 1 00000100:00100000:0.0:1651529490.219425:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213289 00000100:00100000:0.0:1651529490.219430:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213291 00000100:00100000:0.0:1651529490.219431:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a9519ec5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946655104:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.219435:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179269 count 1 00000100:00100000:1.0:1651529490.219442:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000092e14270 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946654976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 23us (124us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.219445:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213290 00000100:00100000:0.0:1651529490.219448:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a9519ec5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946655104:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 16us (119us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.219450:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213292 00000100:00100000:1.0:1651529490.219452:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007591e43c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946655232:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529490.219452:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213291 00002000:00080000:1.0:1651529490.219456:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179348 count 1 00000100:00100000:1.0:1651529490.219466:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007591e43c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946655232:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 14us (129us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.219468:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213293 00000100:00100000:1.0:1651529490.219470:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213292 00000100:00100000:0.0:1651529490.219470:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008e33c77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946654912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529490.219474:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213294 00002000:00080000:0.0:1651529490.219474:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179307 count 1 00000100:00100000:1.0:1651529490.219476:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000abfc3f58 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946655040:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.219479:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179317 count 1 00000100:00100000:0.0:1651529490.219486:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008e33c77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946654912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 15us (140us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.219489:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213293 00000100:00100000:1.0:1651529490.219490:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000abfc3f58 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946655040:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 14us (127us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.219493:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213295 00000100:00100000:1.0:1651529490.219495:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213294 00000100:00100000:0.0:1651529490.219495:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000198be7e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946655168:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.219498:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179264 count 1 00000100:00100000:1.0:1651529490.219499:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213296 00000100:00100000:1.0:1651529490.219500:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f4f9630 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946655296:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.219504:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179385 count 1 00000100:00100000:0.0:1651529490.219509:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000198be7e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946655168:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 14us (120us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.219512:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213295 00000100:00100000:1.0:1651529490.219515:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f4f9630 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946655296:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 14us (113us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.219517:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213296 00000100:00100000:1.0:1651529490.222069:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.222078:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.222085:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.222091:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.222096:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.222102:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.222108:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.222114:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.222127:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946655488 00000100:00100000:1.0:1651529490.222137:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946655616 00000100:00100000:1.0:1651529490.222140:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946655744 00000100:00100000:0.0:1651529490.222142:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946655872 00000100:00100000:1.0:1651529490.222145:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946655424 00000100:00100000:1.0:1651529490.222151:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946655552 00000100:00100000:1.0:1651529490.222156:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946655680 00000100:00100000:1.0:1651529490.222158:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946655808 00000100:00100000:1.0:1651529490.222162:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213297 00000100:00100000:1.0:1651529490.222163:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000036a3a267 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946655488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529490.222164:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213298 00000100:00100000:0.0:1651529490.222166:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004b5f63ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946655616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.222169:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179179 count 1 00002000:00080000:0.0:1651529490.222172:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179259 count 1 00000100:00100000:1.0:1651529490.222191:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000036a3a267 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946655488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 26us (121us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.222194:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213297 00000100:00100000:0.0:1651529490.222198:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004b5f63ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745946655616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 31us (120us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.222199:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213299 00000100:00100000:1.0:1651529490.222200:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d7328d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745946655744:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529490.222201:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213298 00002000:00080000:1.0:1651529490.222204:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179305 count 1 00000100:00100000:0.0:1651529490.222207:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213300 00000100:00100000:0.0:1651529490.222208:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004c03f4d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:39029:x1731745946655424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.222212:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179223 count 1 00000100:00100000:1.0:1651529490.222217:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d7328d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:39029:x1731745946655744:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 16us (132us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.222219:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213299 00000100:00100000:1.0:1651529490.222241:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213301 00000100:00100000:1.0:1651529490.222243:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000f50c14a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745946655552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529490.222243:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004c03f4d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745946655424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 33us (146us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.222246:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213300 00002000:00080000:1.0:1651529490.222249:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179368 count 1 00000100:00100000:0.0:1651529490.222251:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213302 00000100:00100000:0.0:1651529490.222252:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c810c14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946655680:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.222256:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179261 count 1 00000100:00100000:1.0:1651529490.222262:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000f50c14a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946655552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 19us (160us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.222265:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213301 00000100:00100000:1.0:1651529490.222269:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213303 00000100:00100000:0.0:1651529490.222269:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c810c14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946655680:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 16us (161us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.222271:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009dfac288 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946655872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529490.222272:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213302 00002000:00080000:1.0:1651529490.222274:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179291 count 1 00000100:00100000:0.0:1651529490.222276:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213304 00000100:00100000:0.0:1651529490.222277:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fb8007ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946655808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.222281:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179424 count 1 00000100:00100000:1.0:1651529490.222285:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009dfac288 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946655872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 13us (194us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.222288:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213303 00000100:00100000:0.0:1651529490.222291:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fb8007ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946655808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 13us (177us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.222294:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213304 00000100:00100000:1.0:1651529490.222711:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.222738:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.222756:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.222764:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946656512 00000100:00100000:1.0:1651529490.222765:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.222773:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.222785:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946656640 00000100:00100000:0.0:1651529490.222792:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946656768 00000100:00100000:1.0:1651529490.222794:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.222797:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946656896 00000100:00100000:0.0:1651529490.222807:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946656448 00000100:00100000:0.0:1651529490.222821:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946656576 00000100:00100000:0.0:1651529490.222828:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213305 00000100:00100000:1.0:1651529490.222829:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.222830:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000092e14270 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:39029:x1731745946656512:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.222835:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179255 count 1 00000100:00100000:1.0:1651529490.222838:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.222844:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946656704 00000100:00100000:1.0:1651529490.222850:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946656832 00000100:00100000:1.0:1651529490.222853:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213306 00000100:00100000:0.0:1651529490.222858:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000092e14270 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946656512:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 27us (148us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.222861:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000041d3f4d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946656640:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529490.222861:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213305 00000100:00100000:0.0:1651529490.222866:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213307 00002000:00080000:1.0:1651529490.222867:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179314 count 1 00000100:00100000:0.0:1651529490.222868:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000946e402f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745946656768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.222872:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179196 count 1 00000100:00100000:1.0:1651529490.222885:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000041d3f4d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745946656640:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 29us (147us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.222886:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000946e402f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745946656768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 17us (130us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.222888:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213306 00000100:00100000:0.0:1651529490.222890:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213307 00000100:00100000:1.0:1651529490.222893:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213308 00000100:00100000:1.0:1651529490.222895:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745946656896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529490.222895:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213309 00000100:00100000:0.0:1651529490.222897:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004de851bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745946656448:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.222899:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179236 count 1 00002000:00080000:0.0:1651529490.222900:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179310 count 1 00000100:00100000:1.0:1651529490.222911:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745946656896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 15us (145us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.222913:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213308 00000100:00100000:0.0:1651529490.222913:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004de851bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745946656448:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 15us (139us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.222915:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213309 00000100:00100000:1.0:1651529490.222917:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213310 00000100:00100000:1.0:1651529490.222919:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946656576:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529490.222919:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213311 00000100:00100000:0.0:1651529490.222921:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946656704:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.222923:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179253 count 1 00002000:00080000:0.0:1651529490.222925:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179323 count 1 00000100:00100000:1.0:1651529490.222933:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946656576:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 13us (143us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.222936:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213310 00000100:00100000:0.0:1651529490.222936:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946656704:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 14us (124us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.222938:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213311 00000100:00100000:1.0:1651529490.222940:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213312 00000100:00100000:1.0:1651529490.222942:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946656832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.222946:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179282 count 1 00000100:00100000:1.0:1651529490.222956:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946656832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 14us (118us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.222959:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213312 00000100:00100000:1.0:1651529490.223843:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.223871:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.223888:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946657600 00000100:00100000:1.0:1651529490.223889:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.223898:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.223907:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.223915:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.223915:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946657728 00000100:00100000:1.0:1651529490.223922:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.223923:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946657856 00000100:00100000:0.0:1651529490.223932:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946657984 00000100:00100000:1.0:1651529490.223933:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.223944:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946657664 00000100:00100000:0.0:1651529490.223944:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946657792 00000100:00100000:0.0:1651529490.223947:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946657920 00000100:00100000:0.0:1651529490.223949:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946658048 00000100:00100000:1.0:1651529490.223953:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213313 00000100:00100000:1.0:1651529490.223955:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946657600:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529490.223957:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213314 00000100:00100000:0.0:1651529490.223959:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946657728:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.223962:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179279 count 1 00002000:00080000:0.0:1651529490.223964:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179331 count 1 00000100:00100000:1.0:1651529490.223987:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946657600:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 32us (146us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.223991:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213313 00000100:00100000:0.0:1651529490.223993:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946657728:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 33us (121us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.223995:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213314 00000100:00100000:1.0:1651529490.223997:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213315 00000100:00100000:1.0:1651529490.223999:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946657856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529490.224001:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213316 00000100:00100000:0.0:1651529490.224002:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946657984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.224003:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179370 count 1 00002000:00080000:0.0:1651529490.224007:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179195 count 1 00000100:00100000:1.0:1651529490.224017:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946657856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 18us (128us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.224020:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213315 00000100:00100000:0.0:1651529490.224020:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946657984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 17us (121us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.224022:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213316 00000100:00100000:1.0:1651529490.224024:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213317 00000100:00100000:1.0:1651529490.224026:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946657792:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529490.224027:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213318 00000100:00100000:0.0:1651529490.224028:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946657920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.224030:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179242 count 1 00002000:00080000:0.0:1651529490.224032:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179212 count 1 00000100:00100000:1.0:1651529490.224041:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946657792:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 14us (126us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.224043:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946657920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 14us (120us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.224044:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213317 00000100:00100000:0.0:1651529490.224046:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213318 00000100:00100000:1.0:1651529490.224048:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213319 00000100:00100000:1.0:1651529490.224049:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946657664:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529490.224050:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213320 00000100:00100000:0.0:1651529490.224051:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000020b2ad76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946658048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.224053:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179208 count 1 00002000:00080000:0.0:1651529490.224055:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179260 count 1 00000100:00100000:1.0:1651529490.224063:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946657664:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 13us (156us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.224066:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000020b2ad76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946658048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 13us (133us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.224068:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213319 00000100:00100000:0.0:1651529490.224069:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213320 00000100:00100000:1.0:1651529490.224925:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.224946:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.224963:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.224972:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.224981:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.224983:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946659008 00000100:00100000:1.0:1651529490.224988:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.224999:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946659136 00000100:00100000:0.0:1651529490.225006:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946659264 00000100:00100000:1.0:1651529490.225008:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.225016:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946659392 00000100:00100000:0.0:1651529490.225021:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946658944 00000100:00100000:0.0:1651529490.225026:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946659072 00000100:00100000:0.0:1651529490.225029:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946659200 00000100:00100000:1.0:1651529490.225030:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.225032:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946659328 00000100:00100000:0.0:1651529490.225035:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213321 00000100:00100000:1.0:1651529490.225037:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213322 00000100:00100000:0.0:1651529490.225037:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946659008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529490.225040:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946659136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.225043:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179178 count 1 00002000:00080000:1.0:1651529490.225046:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179359 count 1 00000100:00100000:1.0:1651529490.225063:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946659136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 23us (117us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.225063:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946659008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 25us (138us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.225066:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213321 00000100:00100000:1.0:1651529490.225068:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213322 00000100:00100000:0.0:1651529490.225071:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213323 00000100:00100000:0.0:1651529490.225072:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:39029:x1731745946659264:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529490.225073:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213324 00000100:00100000:1.0:1651529490.225075:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:39029:x1731745946659392:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.225076:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179347 count 1 00002000:00080000:1.0:1651529490.225078:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179400 count 1 00000100:00100000:0.0:1651529490.225088:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:39029:x1731745946659264:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 15us (126us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.225090:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:39029:x1731745946659392:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 14us (117us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.225091:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213323 00000100:00100000:1.0:1651529490.225092:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213324 00000100:00100000:0.0:1651529490.225095:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213325 00000100:00100000:1.0:1651529490.225097:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213326 00000100:00100000:0.0:1651529490.225097:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946658944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529490.225099:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946659072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.225101:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179298 count 1 00002000:00080000:1.0:1651529490.225102:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179419 count 1 00000100:00100000:0.0:1651529490.225112:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946658944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 15us (131us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.225113:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946659072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 14us (125us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.225115:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213325 00000100:00100000:1.0:1651529490.225116:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213326 00000100:00100000:0.0:1651529490.225119:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213327 00000100:00100000:0.0:1651529490.225120:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946659200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529490.225121:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213328 00000100:00100000:1.0:1651529490.225122:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946659328:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.225124:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179322 count 1 00002000:00080000:1.0:1651529490.225126:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179250 count 1 00000100:00100000:0.0:1651529490.225135:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946659200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 14us (132us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.225137:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946659328:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 14us (107us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.225138:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213327 00000100:00100000:1.0:1651529490.225140:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213328 00000100:00100000:1.0:1651529490.226216:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.226235:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.226248:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946659712 00000100:00100000:1.0:1651529490.226256:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946659776 00000100:00100000:1.0:1651529490.226260:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213329 00000100:00100000:1.0:1651529490.226262:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946659712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.226267:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179304 count 1 00000100:00100000:1.0:1651529490.226291:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946659712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 29us (76us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.226294:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213329 00000100:00100000:1.0:1651529490.226299:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213330 00000100:00100000:1.0:1651529490.226301:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946659776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.226305:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179182 count 1 00000100:00100000:1.0:1651529490.226318:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946659776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 17us (84us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.226321:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213330 00000100:00100000:1.0:1651529490.226369:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.226387:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946660352 00000100:00100000:1.0:1651529490.226393:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213331 00000100:00100000:1.0:1651529490.226395:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946660352:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.226413:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179361 count 1 00000100:00100000:1.0:1651529490.226439:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946660352:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 43us (70us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.226442:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213331 00000100:00100000:1.0:1651529490.226492:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.226502:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.226508:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.226513:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.226520:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.226527:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946660480 00000100:00100000:1.0:1651529490.226532:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946660608 00000100:00100000:1.0:1651529490.226535:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946660416 00000100:00100000:1.0:1651529490.226538:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946660544 00000100:00100000:1.0:1651529490.226546:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946660672 00000100:00100000:1.0:1651529490.226552:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213332 00000100:00100000:1.0:1651529490.226554:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946660480:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.226559:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179247 count 1 00000100:00100000:0.0:1651529490.226559:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213333 00000100:00100000:0.0:1651529490.226562:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946660608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.226567:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179404 count 1 00000100:00100000:1.0:1651529490.226579:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946660480:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 24us (86us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.226582:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213332 00000100:00100000:1.0:1651529490.226587:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213334 00000100:00100000:1.0:1651529490.226588:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946660416:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.226592:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179369 count 1 00000100:00100000:0.0:1651529490.226592:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946660608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 29us (89us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.226595:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213333 00000100:00100000:0.0:1651529490.226600:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213335 00000100:00100000:0.0:1651529490.226602:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946660544:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529490.226605:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946660416:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 16us (97us total) trans 0 rc -2/-2 00002000:00080000:0.0:1651529490.226606:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179372 count 1 00000100:00100000:1.0:1651529490.226608:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213334 00000100:00100000:1.0:1651529490.226612:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213336 00000100:00100000:1.0:1651529490.226613:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946660672:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.226617:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179294 count 1 00000100:00100000:0.0:1651529490.226618:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946660544:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 15us (104us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.226620:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213335 00000100:00100000:1.0:1651529490.226628:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946660672:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 14us (107us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.226630:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213336 00000100:00100000:1.0:1651529490.226855:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.226864:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.226870:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946660800 00000100:00100000:1.0:1651529490.226875:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946660864 00000100:00100000:1.0:1651529490.226879:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213337 00000100:00100000:1.0:1651529490.226881:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946660800:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.226887:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179209 count 1 00000100:00100000:1.0:1651529490.226908:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946660800:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 26us (53us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.226911:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213337 00000100:00100000:1.0:1651529490.226915:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213338 00000100:00100000:1.0:1651529490.226917:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946660864:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.226921:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179417 count 1 00000100:00100000:1.0:1651529490.226941:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946660864:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 23us (77us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.226944:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213338 00000100:00100000:0.0:1651529490.226960:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.226989:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946661440 00000100:00100000:1.0:1651529490.227002:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213339 00000100:00100000:1.0:1651529490.227004:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946661440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.227009:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179220 count 1 00000100:00100000:1.0:1651529490.227026:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946661440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 22us (67us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.227029:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213339 00000100:00100000:0.0:1651529490.227242:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.227253:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.227262:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.227263:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946661504 00000100:00100000:0.0:1651529490.227270:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.227279:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.227286:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946661632 00000100:00100000:1.0:1651529490.227290:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946661760 00000100:00100000:1.0:1651529490.227294:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946661568 00000100:00100000:1.0:1651529490.227300:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946661696 00000100:00100000:1.0:1651529490.227306:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213340 00000100:00100000:1.0:1651529490.227308:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745946661504:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.227313:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179328 count 1 00000100:00100000:0.0:1651529490.227332:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213341 00000100:00100000:0.0:1651529490.227335:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745946661632:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529490.227340:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745946661504:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 31us (99us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.227343:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213340 00002000:00080000:0.0:1651529490.227346:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179194 count 1 00000100:00100000:1.0:1651529490.227349:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213342 00000100:00100000:1.0:1651529490.227350:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946661760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.227354:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179217 count 1 00000100:00100000:0.0:1651529490.227365:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946661632:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 30us (111us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.227368:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946661760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 17us (105us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.227368:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213341 00000100:00100000:1.0:1651529490.227370:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213342 00000100:00100000:0.0:1651529490.227373:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213343 00000100:00100000:1.0:1651529490.227375:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213344 00000100:00100000:0.0:1651529490.227375:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007591e43c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946661568:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529490.227377:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008e33c77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946661696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.227379:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179214 count 1 00002000:00080000:1.0:1651529490.227380:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179386 count 1 00000100:00100000:0.0:1651529490.227390:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007591e43c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946661568:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 14us (119us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.227391:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008e33c77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946661696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 14us (112us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.227393:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213343 00000100:00100000:1.0:1651529490.227394:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213344 00000100:00100000:0.0:1651529490.227445:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.227477:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946661824 00000100:00100000:0.0:1651529490.227489:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.227498:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946661952 00000100:00100000:0.0:1651529490.227501:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.227509:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946661888 00000100:00100000:1.0:1651529490.227514:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213345 00000100:00100000:1.0:1651529490.227515:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000abfc3f58 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946661824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.227521:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179416 count 1 00000100:00100000:1.0:1651529490.227539:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000abfc3f58 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946661824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 23us (95us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.227542:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213345 00000100:00100000:1.0:1651529490.227546:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213346 00000100:00100000:1.0:1651529490.227548:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000198be7e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946661952:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.227552:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179218 count 1 00000100:00100000:1.0:1651529490.227562:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000198be7e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946661952:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 14us (74us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.227565:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213346 00000100:00100000:1.0:1651529490.227568:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213347 00000100:00100000:1.0:1651529490.227570:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f4f9630 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946661888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.227573:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179276 count 1 00000100:00100000:1.0:1651529490.227583:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f4f9630 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946661888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 13us (82us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.227586:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213347 00000100:00100000:0.0:1651529490.227912:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.227927:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.227936:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.227938:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946662592 00000100:00100000:0.0:1651529490.227944:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.227953:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.227959:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946662720 00000100:00100000:1.0:1651529490.227963:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946662528 00000100:00100000:1.0:1651529490.227970:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946662656 00000100:00100000:1.0:1651529490.227974:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946662784 00000100:00100000:0.0:1651529490.227976:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213348 00000100:00100000:0.0:1651529490.227979:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000036a3a267 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946662592:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529490.227983:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213349 00000100:00100000:1.0:1651529490.227985:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000241b8252 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946662720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.227990:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179175 count 1 00002000:00080000:0.0:1651529490.227991:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179287 count 1 00000100:00100000:1.0:1651529490.228010:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000241b8252 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946662720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 24us (82us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.228011:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000036a3a267 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946662592:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 31us (100us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.228012:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213349 00000100:00100000:0.0:1651529490.228015:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213348 00000100:00100000:1.0:1651529490.228017:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213350 00000100:00100000:1.0:1651529490.228019:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004b5f63ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946662528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.228023:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179373 count 1 00000100:00100000:1.0:1651529490.228035:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004b5f63ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946662528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 16us (99us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.228038:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213350 00000100:00100000:1.0:1651529490.228042:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213351 00000100:00100000:1.0:1651529490.228043:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d7328d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946662656:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.228047:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179256 count 1 00000100:00100000:0.0:1651529490.228055:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213352 00000100:00100000:1.0:1651529490.228057:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d7328d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946662656:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 13us (112us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.228057:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004c03f4d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946662784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529490.228059:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213351 00002000:00080000:0.0:1651529490.228062:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179268 count 1 00000100:00100000:1.0:1651529490.228078:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.228078:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004c03f4d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946662784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 20us (125us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.228080:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213352 00000100:00100000:0.0:1651529490.228085:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946662912 00000100:00100000:0.0:1651529490.228097:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213353 00000100:00100000:0.0:1651529490.228098:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946662912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529490.228100:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529490.228102:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179295 count 1 00000100:00100000:0.0:1651529490.228116:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946662912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 17us (38us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.228120:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213353 00000100:00100000:0.0:1651529490.228126:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946662848 00000100:00100000:0.0:1651529490.228139:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213354 00000100:00100000:0.0:1651529490.228164:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946662848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.228171:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179183 count 1 00000100:00100000:1.0:1651529490.228181:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.228188:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946662848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 45us (95us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.228190:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213354 00000100:00100000:0.0:1651529490.228195:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946662976 00000100:00100000:0.0:1651529490.228209:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213355 00000100:00100000:0.0:1651529490.228212:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946662976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.228218:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179205 count 1 00000100:00100000:0.0:1651529490.228281:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946662976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 69us (99us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.228284:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213355 00000100:00100000:0.0:1651529490.228587:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.228599:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.228605:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.228617:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.228626:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.228633:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946663552 00000100:00100000:0.0:1651529490.228635:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946663680 00000100:00100000:1.0:1651529490.228640:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946663808 00000100:00100000:0.0:1651529490.228644:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946663616 00000100:00100000:0.0:1651529490.228649:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946663744 00000100:00100000:0.0:1651529490.228654:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213356 00000100:00100000:0.0:1651529490.228655:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007591e43c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745946663552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529490.228657:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213357 00000100:00100000:1.0:1651529490.228659:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008e33c77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745946663680:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.228661:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179397 count 1 00002000:00080000:1.0:1651529490.228664:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179411 count 1 00000100:00100000:1.0:1651529490.228683:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008e33c77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745946663680:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 24us (85us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.228686:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213357 00000100:00100000:1.0:1651529490.228691:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213358 00000100:00100000:1.0:1651529490.228693:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000198be7e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946663616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.228697:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179418 count 1 00000100:00100000:0.0:1651529490.228698:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007591e43c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946663552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 42us (112us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.228702:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213356 00000100:00100000:0.0:1651529490.228707:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213359 00000100:00100000:0.0:1651529490.228709:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000abfc3f58 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946663808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529490.228710:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000198be7e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946663616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 16us (92us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.228712:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213358 00002000:00080000:0.0:1651529490.228714:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179315 count 1 00000100:00100000:1.0:1651529490.228716:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213360 00000100:00100000:1.0:1651529490.228718:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f4f9630 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946663744:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.228722:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179316 count 1 00000100:00100000:0.0:1651529490.228728:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000abfc3f58 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946663808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 18us (122us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.228730:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213359 00000100:00100000:1.0:1651529490.228732:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f4f9630 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946663744:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 14us (107us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.228735:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213360 00000100:00100000:0.0:1651529490.228745:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.228758:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.228787:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946663872 00000100:00100000:1.0:1651529490.228822:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946663936 00000100:00100000:1.0:1651529490.228829:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213361 00000100:00100000:1.0:1651529490.228831:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000036a3a267 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946663872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.228836:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179420 count 1 00000100:00100000:0.0:1651529490.228843:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.228860:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000036a3a267 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946663872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 28us (114us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.228862:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213361 00000100:00100000:1.0:1651529490.228867:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946664000 00000100:00100000:1.0:1651529490.228872:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213362 00000100:00100000:1.0:1651529490.228874:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000f50c14a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946663936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.228878:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179319 count 1 00000100:00100000:1.0:1651529490.228904:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000f50c14a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946663936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 29us (146us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.228907:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213362 00000100:00100000:1.0:1651529490.228912:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213363 00000100:00100000:1.0:1651529490.228913:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c810c14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946664000:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.228918:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179336 count 1 00000100:00100000:1.0:1651529490.228942:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c810c14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946664000:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 28us (101us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.228945:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213363 00000100:00100000:1.0:1651529490.229297:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.229313:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.229319:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.229325:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.229331:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.229337:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.229354:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.229369:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.229376:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946664640 00000100:00100000:1.0:1651529490.229388:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946664768 00000100:00100000:1.0:1651529490.229391:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946664896 00000100:00100000:1.0:1651529490.229394:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946664576 00000100:00100000:1.0:1651529490.229400:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946664704 00000100:00100000:1.0:1651529490.229402:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946664832 00000100:00100000:1.0:1651529490.229405:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946664960 00000100:00100000:0.0:1651529490.229406:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946665024 00000100:00100000:1.0:1651529490.229408:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213364 00000100:00100000:1.0:1651529490.229410:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946664640:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529490.229414:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213365 00002000:00080000:1.0:1651529490.229415:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179257 count 1 00000100:00100000:0.0:1651529490.229416:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007f9b0c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946664768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.229421:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179332 count 1 00000100:00100000:1.0:1651529490.229435:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946664640:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 25us (139us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.229438:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213364 00000100:00100000:1.0:1651529490.229443:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213366 00000100:00100000:1.0:1651529490.229445:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5ebc6ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946664896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529490.229446:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007f9b0c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946664768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 29us (133us total) trans 0 rc -2/-2 00002000:00080000:1.0:1651529490.229449:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179343 count 1 00000100:00100000:0.0:1651529490.229449:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213365 00000100:00100000:0.0:1651529490.229454:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213367 00000100:00100000:0.0:1651529490.229456:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068b6c75f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946664576:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.229460:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179398 count 1 00000100:00100000:1.0:1651529490.229461:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5ebc6ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946664896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 16us (141us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.229464:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213366 00000100:00100000:1.0:1651529490.229468:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213368 00000100:00100000:1.0:1651529490.229470:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000020362888 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946664704:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.229473:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179254 count 1 00000100:00100000:0.0:1651529490.229473:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068b6c75f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946664576:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 16us (147us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.229475:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213367 00000100:00100000:0.0:1651529490.229480:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213369 00000100:00100000:0.0:1651529490.229481:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df603127 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946664832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529490.229484:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000020362888 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946664704:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 14us (152us total) trans 0 rc -2/-2 00002000:00080000:0.0:1651529490.229484:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179403 count 1 00000100:00100000:1.0:1651529490.229486:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213368 00000100:00100000:1.0:1651529490.229491:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213370 00000100:00100000:1.0:1651529490.229492:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003132c0c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946664960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529490.229495:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df603127 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946664832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 13us (157us total) trans 0 rc -2/-2 00002000:00080000:1.0:1651529490.229496:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179283 count 1 00000100:00100000:0.0:1651529490.229498:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213369 00000100:00100000:0.0:1651529490.229501:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213371 00000100:00100000:0.0:1651529490.229503:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000056e45ef2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946665024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529490.229506:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003132c0c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946664960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 13us (152us total) trans 0 rc -2/-2 00002000:00080000:0.0:1651529490.229506:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179330 count 1 00000100:00100000:1.0:1651529490.229509:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213370 00000100:00100000:0.0:1651529490.229517:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000056e45ef2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946665024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 13us (148us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.229520:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213371 00000100:00100000:1.0:1651529490.230446:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.230458:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.230479:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.230501:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946665984 00000100:00100000:1.0:1651529490.230505:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.230520:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946666112 00000100:00100000:0.0:1651529490.230526:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946666240 00000100:00100000:0.0:1651529490.230531:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946666368 00000100:00100000:1.0:1651529490.230534:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.230538:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213372 00000100:00100000:0.0:1651529490.230540:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9b0314b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946665984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.230545:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179413 count 1 00000100:00100000:1.0:1651529490.230546:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.230554:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.230562:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.230566:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9b0314b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946665984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 26us (120us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.230569:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213372 00000100:00100000:0.0:1651529490.230573:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946666048 00000100:00100000:0.0:1651529490.230578:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946666176 00000100:00100000:0.0:1651529490.230582:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946666304 00000100:00100000:1.0:1651529490.230586:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946666432 00000100:00100000:0.0:1651529490.230588:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213373 00000100:00100000:0.0:1651529490.230590:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745946666112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.230598:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179251 count 1 00000100:00100000:1.0:1651529490.230600:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213374 00000100:00100000:1.0:1651529490.230602:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745946666240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.230607:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179346 count 1 00000100:00100000:0.0:1651529490.230619:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745946666112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 28us (160us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.230622:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213373 00000100:00100000:0.0:1651529490.230627:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213375 00000100:00100000:0.0:1651529490.230629:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:39029:x1731745946666368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529490.230630:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:39029:x1731745946666240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 28us (151us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.230633:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213374 00002000:00080000:0.0:1651529490.230633:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179174 count 1 00000100:00100000:1.0:1651529490.230638:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213376 00000100:00100000:1.0:1651529490.230640:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745946666048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.230644:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179171 count 1 00000100:00100000:0.0:1651529490.230645:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745946666368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 16us (140us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.230650:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213375 00000100:00100000:0.0:1651529490.230654:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213377 00000100:00100000:0.0:1651529490.230655:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946666176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529490.230656:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946666048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 15us (130us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.230659:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213376 00002000:00080000:0.0:1651529490.230659:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179353 count 1 00000100:00100000:1.0:1651529490.230663:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213378 00000100:00100000:1.0:1651529490.230664:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004b1864ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946666304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.230668:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179377 count 1 00000100:00100000:0.0:1651529490.230670:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946666176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 13us (124us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.230672:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213377 00000100:00100000:0.0:1651529490.230676:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213379 00000100:00100000:1.0:1651529490.230678:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004b1864ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946666304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 13us (124us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.230678:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946666432:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529490.230681:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213378 00002000:00080000:0.0:1651529490.230681:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179293 count 1 00000100:00100000:0.0:1651529490.230692:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946666432:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 13us (129us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.230694:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213379 00000100:00100000:1.0:1651529490.232220:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.232240:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.232256:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.232270:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.232277:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.232283:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.232295:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.232303:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.232303:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946667840 00000100:00100000:1.0:1651529490.232312:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946667968 00000100:00100000:0.0:1651529490.232320:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946668096 00000100:00100000:0.0:1651529490.232324:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946668224 00000100:00100000:1.0:1651529490.232325:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946667776 00000100:00100000:0.0:1651529490.232330:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946667904 00000100:00100000:0.0:1651529490.232333:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946668032 00000100:00100000:1.0:1651529490.232334:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946668160 00000100:00100000:0.0:1651529490.232337:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213380 00000100:00100000:0.0:1651529490.232338:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946667840:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529490.232340:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213381 00000100:00100000:1.0:1651529490.232341:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946667968:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.232344:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179240 count 1 00002000:00080000:1.0:1651529490.232346:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179325 count 1 00000100:00100000:1.0:1651529490.232365:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946667968:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 23us (125us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.232365:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946667840:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 25us (152us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.232368:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213381 00000100:00100000:0.0:1651529490.232369:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213380 00000100:00100000:1.0:1651529490.232372:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213382 00000100:00100000:1.0:1651529490.232374:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946668096:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529490.232374:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213383 00000100:00100000:0.0:1651529490.232376:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946668224:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.232377:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179243 count 1 00002000:00080000:0.0:1651529490.232380:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179278 count 1 00000100:00100000:1.0:1651529490.232388:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946668096:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 13us (131us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.232390:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213382 00000100:00100000:0.0:1651529490.232392:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946668224:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 15us (128us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.232395:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213384 00000100:00100000:1.0:1651529490.232396:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946667904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529490.232399:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213383 00002000:00080000:1.0:1651529490.232400:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179190 count 1 00000100:00100000:0.0:1651529490.232403:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213385 00000100:00100000:0.0:1651529490.232405:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946667776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.232408:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179176 count 1 00000100:00100000:1.0:1651529490.232409:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946667904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 13us (126us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.232412:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213384 00000100:00100000:1.0:1651529490.232416:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213386 00000100:00100000:1.0:1651529490.232418:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946668032:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529490.232419:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946667776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 14us (142us total) trans 0 rc -2/-2 00002000:00080000:1.0:1651529490.232421:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179308 count 1 00000100:00100000:0.0:1651529490.232422:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213385 00000100:00100000:0.0:1651529490.232426:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213387 00000100:00100000:0.0:1651529490.232428:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946668160:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529490.232431:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946668032:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 13us (136us total) trans 0 rc -2/-2 00002000:00080000:0.0:1651529490.232431:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179337 count 1 00000100:00100000:1.0:1651529490.232434:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213386 00000100:00100000:0.0:1651529490.232442:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946668160:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 13us (139us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.232445:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213387 00000100:00100000:1.0:1651529490.233064:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.233077:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.233086:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.233093:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.233094:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946669184 00000100:00100000:1.0:1651529490.233100:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.233109:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946669248 00000100:00100000:0.0:1651529490.233114:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946669376 00000100:00100000:0.0:1651529490.233120:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946669504 00000100:00100000:1.0:1651529490.233122:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.233130:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946669632 00000100:00100000:0.0:1651529490.233135:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946669312 00000100:00100000:0.0:1651529490.233141:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213388 00000100:00100000:1.0:1651529490.233143:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.233143:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946669184:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.233148:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179355 count 1 00000100:00100000:1.0:1651529490.233150:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.233155:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946669440 00000100:00100000:1.0:1651529490.233160:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946669568 00000100:00100000:1.0:1651529490.233164:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213389 00000100:00100000:1.0:1651529490.233165:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007f9b0c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946669248:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529490.233169:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946669184:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 25us (105us total) trans 0 rc -2/-2 00002000:00080000:1.0:1651529490.233170:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179362 count 1 00000100:00100000:0.0:1651529490.233172:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213388 00000100:00100000:0.0:1651529490.233177:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213390 00000100:00100000:0.0:1651529490.233178:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5ebc6ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946669376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.233182:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179286 count 1 00000100:00100000:1.0:1651529490.233186:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007f9b0c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946669248:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 20us (109us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.233189:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213389 00000100:00100000:1.0:1651529490.233194:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213391 00000100:00100000:0.0:1651529490.233194:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5ebc6ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946669376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 15us (109us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.233195:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068b6c75f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946669504:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529490.233197:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213390 00002000:00080000:1.0:1651529490.233199:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179258 count 1 00000100:00100000:0.0:1651529490.233201:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213392 00000100:00100000:0.0:1651529490.233203:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000020362888 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946669632:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.233206:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179311 count 1 00000100:00100000:1.0:1651529490.233210:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068b6c75f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946669504:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 14us (116us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.233213:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213391 00000100:00100000:1.0:1651529490.233217:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213393 00000100:00100000:0.0:1651529490.233217:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000020362888 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946669632:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 14us (116us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.233219:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df603127 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946669312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529490.233220:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213392 00002000:00080000:1.0:1651529490.233240:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179407 count 1 00000100:00100000:0.0:1651529490.233240:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213394 00000100:00100000:0.0:1651529490.233242:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003132c0c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946669440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.233247:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179320 count 1 00000100:00100000:1.0:1651529490.233254:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df603127 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946669312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 35us (140us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.233257:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213393 00000100:00100000:0.0:1651529490.233260:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003132c0c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946669440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 17us (121us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.233262:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213395 00000100:00100000:1.0:1651529490.233263:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000056e45ef2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946669568:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529490.233263:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213394 00002000:00080000:1.0:1651529490.233267:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179383 count 1 00000100:00100000:1.0:1651529490.233278:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000056e45ef2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946669568:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 14us (128us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.233280:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213395 00000100:00100000:1.0:1651529490.233624:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.233653:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.233671:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.233686:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.233695:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.233701:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.233707:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.233714:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946669760 00000100:00100000:1.0:1651529490.233720:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946669888 00000100:00100000:1.0:1651529490.233723:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946670016 00000100:00100000:1.0:1651529490.233735:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946670144 00000100:00100000:0.0:1651529490.233739:0:80278:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946669696 00000100:00100000:1.0:1651529490.233742:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946669824 00000100:00100000:1.0:1651529490.233747:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946669952 00000100:00100000:1.0:1651529490.233751:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213396 00000100:00100000:1.0:1651529490.233752:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9b0314b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946669760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529490.233756:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213397 00002000:00080000:1.0:1651529490.233757:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179249 count 1 00000100:00100000:0.0:1651529490.233758:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946669888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.233763:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179329 count 1 00000100:00100000:1.0:1651529490.233776:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9b0314b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946669760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 23us (152us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.233779:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213396 00000100:00100000:0.0:1651529490.233782:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946669888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 23us (129us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.233784:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213398 00000100:00100000:0.0:1651529490.233785:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213397 00000100:00100000:1.0:1651529490.233786:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946670016:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.233790:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179184 count 1 00000100:00100000:0.0:1651529490.233790:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213399 00000100:00100000:0.0:1651529490.233792:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946670144:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.233796:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179193 count 1 00000100:00100000:1.0:1651529490.233802:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946670016:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 16us (131us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.233804:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213398 00000100:00100000:0.0:1651529490.233807:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946670144:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 14us (121us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.233808:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213400 00000100:00100000:1.0:1651529490.233810:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946669824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529490.233810:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213399 00002000:00080000:1.0:1651529490.233824:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179392 count 1 00000100:00100000:0.0:1651529490.233825:0:80278:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213401 00000100:00100000:0.0:1651529490.233826:0:80278:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946669952:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.233831:0:80278:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179200 count 1 00000100:00100000:1.0:1651529490.233837:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946669824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 26us (135us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.233839:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213400 00000100:00100000:1.0:1651529490.233844:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213402 00000100:00100000:0.0:1651529490.233844:0:80278:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946669952:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 17us (136us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.233845:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946669696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529490.233847:0:80278:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213401 00002000:00080000:1.0:1651529490.233849:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179408 count 1 00000100:00100000:1.0:1651529490.233859:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946669696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 13us (164us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.233862:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213402 00000100:00100000:0.0:1651529490.233864:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.233879:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946670080 00000100:00100000:1.0:1651529490.233888:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213403 00000100:00100000:1.0:1651529490.233890:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009dfac288 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946670080:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.233895:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179252 count 1 00000100:00100000:1.0:1651529490.233908:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009dfac288 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946670080:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 17us (44us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.233911:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213403 00000100:00100000:1.0:1651529490.234654:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.234670:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.234679:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946671424 00000100:00100000:1.0:1651529490.234687:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.234706:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946671552 00000100:00100000:0.0:1651529490.234714:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946671680 00000100:00100000:1.0:1651529490.234716:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.234720:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213404 00000100:00100000:0.0:1651529490.234722:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946671424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.234727:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179271 count 1 00000100:00100000:1.0:1651529490.234728:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.234734:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.234740:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.234748:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946671424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 25us (94us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.234750:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.234751:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213404 00000100:00100000:0.0:1651529490.234762:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946671808 00000100:00100000:0.0:1651529490.234769:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946671488 00000100:00100000:0.0:1651529490.234774:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946671616 00000100:00100000:1.0:1651529490.234776:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946671744 00000100:00100000:0.0:1651529490.234778:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946671872 00000100:00100000:0.0:1651529490.234784:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213405 00000100:00100000:0.0:1651529490.234786:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000041d3f4d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946671552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529490.234790:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213406 00000100:00100000:1.0:1651529490.234791:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000946e402f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946671680:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.234792:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179275 count 1 00002000:00080000:1.0:1651529490.234797:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179352 count 1 00000100:00100000:0.0:1651529490.234821:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000041d3f4d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946671552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 34us (150us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.234824:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213405 00000100:00100000:1.0:1651529490.234829:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000946e402f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946671680:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 36us (141us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.234830:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213407 00000100:00100000:0.0:1651529490.234831:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004c9ab8d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946671808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529490.234832:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213406 00002000:00080000:0.0:1651529490.234835:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179345 count 1 00000100:00100000:1.0:1651529490.234837:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213408 00000100:00100000:1.0:1651529490.234839:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946671488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.234844:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179181 count 1 00000100:00100000:0.0:1651529490.234849:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004c9ab8d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946671808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 17us (137us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.234852:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213407 00000100:00100000:1.0:1651529490.234857:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946671488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 18us (129us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.234860:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213408 00000100:00100000:1.0:1651529490.234863:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213409 00000100:00100000:1.0:1651529490.234865:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004de851bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946671616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.234869:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179396 count 1 00000100:00100000:0.0:1651529490.234869:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213410 00000100:00100000:0.0:1651529490.234871:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946671872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.234875:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179302 count 1 00000100:00100000:1.0:1651529490.234879:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004de851bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946671616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 13us (144us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.234881:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213409 00000100:00100000:1.0:1651529490.234885:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213411 00000100:00100000:0.0:1651529490.234886:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946671872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 15us (135us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.234887:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946671744:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529490.234889:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213410 00002000:00080000:1.0:1651529490.234890:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179335 count 1 00000100:00100000:1.0:1651529490.234901:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946671744:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 13us (160us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.234903:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213411 00000100:00100000:1.0:1651529490.235232:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.235239:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946672384 00000100:00100000:1.0:1651529490.235253:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213412 00000100:00100000:1.0:1651529490.235254:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000041d3f4d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946672384:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.235259:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179246 count 1 00000100:00100000:0.0:1651529490.235285:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.235286:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000041d3f4d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946672384:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 30us (63us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.235288:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213412 00000100:00100000:1.0:1651529490.235298:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946672512 00000100:00100000:1.0:1651529490.235303:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213413 00000100:00100000:1.0:1651529490.235305:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009dfac288 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946672512:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.235309:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179324 count 1 00000100:00100000:0.0:1651529490.235320:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.235336:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009dfac288 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946672512:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 29us (51us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.235336:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.235339:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213413 00000100:00100000:1.0:1651529490.235348:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946672640 00000100:00100000:1.0:1651529490.235353:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946672768 00000100:00100000:1.0:1651529490.235356:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213414 00000100:00100000:1.0:1651529490.235358:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fb8007ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946672640:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.235362:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179354 count 1 00000100:00100000:1.0:1651529490.235375:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fb8007ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946672640:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 16us (56us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.235378:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213414 00000100:00100000:1.0:1651529490.235381:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213415 00000100:00100000:1.0:1651529490.235383:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000092e14270 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946672768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.235386:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179245 count 1 00000100:00100000:1.0:1651529490.235406:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000092e14270 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946672768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 22us (71us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.235408:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.235409:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213415 00000100:00100000:1.0:1651529490.235421:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946672448 00000100:00100000:0.0:1651529490.235425:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.235436:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946672576 00000100:00100000:1.0:1651529490.235442:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213416 00000100:00100000:1.0:1651529490.235444:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004b5f63ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946672448:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.235448:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179192 count 1 00000100:00100000:1.0:1651529490.235462:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004b5f63ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946672448:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 17us (55us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.235468:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.235472:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213416 00000100:00100000:1.0:1651529490.235477:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946672704 00000100:00100000:1.0:1651529490.235480:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213417 00000100:00100000:1.0:1651529490.235482:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d7328d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946672576:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.235486:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179239 count 1 00000100:00100000:1.0:1651529490.235498:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d7328d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946672576:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 15us (73us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.235500:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213417 00000100:00100000:1.0:1651529490.235504:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213418 00000100:00100000:1.0:1651529490.235505:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004c03f4d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946672704:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529490.235517:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529490.235518:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179238 count 1 00000100:00100000:1.0:1651529490.235530:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004c03f4d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946672704:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 24us (64us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.235533:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213418 00000100:00100000:1.0:1651529490.235536:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946672832 00000100:00100000:1.0:1651529490.235540:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213419 00000100:00100000:1.0:1651529490.235542:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008e33c77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946672832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.235545:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179380 count 1 00000100:00100000:1.0:1651529490.235565:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008e33c77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946672832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 23us (49us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.235565:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.235568:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213419 00000100:00100000:1.0:1651529490.235572:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946672896 00000100:00100000:0.0:1651529490.235575:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.235576:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213420 00000100:00100000:1.0:1651529490.235577:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007591e43c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946672896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.235582:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179344 count 1 00000100:00100000:1.0:1651529490.235594:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007591e43c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946672896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 16us (29us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.235596:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213420 00000100:00100000:1.0:1651529490.235607:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946672960 00000100:00100000:1.0:1651529490.235612:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213421 00000100:00100000:1.0:1651529490.235613:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000198be7e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946672960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.235617:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179189 count 1 00000100:00100000:1.0:1651529490.235629:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000198be7e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946672960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 15us (53us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.235640:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213421 00000100:00100000:0.0:1651529490.235646:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.235659:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946673024 00000100:00100000:1.0:1651529490.235664:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213422 00000100:00100000:1.0:1651529490.235666:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000abfc3f58 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946673024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.235671:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179185 count 1 00000100:00100000:1.0:1651529490.235697:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000abfc3f58 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946673024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 30us (51us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.235700:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213422 00000100:00100000:1.0:1651529490.235779:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.235796:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.235803:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.235809:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946673088 00000100:00100000:1.0:1651529490.235825:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946673152 00000100:00100000:1.0:1651529490.235828:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946673216 00000100:00100000:1.0:1651529490.235832:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213423 00000100:00100000:1.0:1651529490.235834:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000946e402f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946673088:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.235839:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179186 count 1 00000100:00100000:0.0:1651529490.235847:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.235857:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000946e402f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946673088:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 22us (78us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.235860:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213423 00000100:00100000:1.0:1651529490.235864:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213424 00000100:00100000:1.0:1651529490.235866:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946673152:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.235869:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179357 count 1 00000100:00100000:1.0:1651529490.235890:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946673152:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 23us (93us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.235893:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213424 00000100:00100000:1.0:1651529490.235897:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946673344 00000100:00100000:1.0:1651529490.235910:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213425 00000100:00100000:1.0:1651529490.235912:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946673216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.235916:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179333 count 1 00000100:00100000:0.0:1651529490.235917:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.235930:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946673216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 17us (127us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.235932:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213425 00000100:00100000:1.0:1651529490.235936:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946673280 00000100:00100000:1.0:1651529490.235942:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213426 00000100:00100000:0.0:1651529490.235949:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.235952:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f4f9630 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946673344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.235961:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179177 count 1 00000100:00100000:1.0:1651529490.235985:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f4f9630 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946673344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 32us (139us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.235988:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213426 00000100:00100000:1.0:1651529490.235992:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946673408 00000100:00100000:1.0:1651529490.235998:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213427 00000100:00100000:1.0:1651529490.236000:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000036a3a267 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946673280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529490.236003:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213428 00002000:00080000:1.0:1651529490.236004:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179394 count 1 00000100:00100000:0.0:1651529490.236006:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000f50c14a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946673408:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.236012:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179262 count 1 00000100:00100000:1.0:1651529490.236017:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000036a3a267 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946673280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 16us (100us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.236020:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213427 00000100:00100000:1.0:1651529490.236039:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.236051:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000f50c14a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946673408:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 44us (102us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.236053:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.236054:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213428 00000100:00100000:0.0:1651529490.236059:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946673472 00000100:00100000:1.0:1651529490.236092:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946673536 00000100:00100000:0.0:1651529490.236095:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213429 00000100:00100000:0.0:1651529490.236097:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946673472:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529490.236100:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213430 00000100:00100000:1.0:1651529490.236101:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946673536:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.236103:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179415 count 1 00002000:00080000:1.0:1651529490.236106:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179301 count 1 00000100:00100000:1.0:1651529490.236121:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946673536:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 19us (68us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.236121:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946673472:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 22us (81us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.236124:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213430 00000100:00100000:1.0:1651529490.236144:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.236150:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213429 00000100:00100000:0.0:1651529490.236156:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946673600 00000100:00100000:0.0:1651529490.236169:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213431 00000100:00100000:0.0:1651529490.236172:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946673600:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.236202:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179226 count 1 00000100:00100000:1.0:1651529490.236216:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.236221:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946673600:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 48us (77us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.236252:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946673728 00000100:00100000:1.0:1651529490.236271:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213432 00000100:00100000:1.0:1651529490.236273:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946673728:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.236278:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179309 count 1 00000100:00100000:1.0:1651529490.236294:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946673728:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 20us (78us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.236295:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213431 00000100:00100000:1.0:1651529490.236297:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213432 00000100:00100000:1.0:1651529490.236335:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.236372:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.236383:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.236392:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.236402:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946673664 00000100:00100000:1.0:1651529490.236408:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.236424:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.236431:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946673856 00000100:00100000:1.0:1651529490.236437:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946673792 00000100:00100000:0.0:1651529490.236444:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946673920 00000100:00100000:1.0:1651529490.236446:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946673984 00000100:00100000:0.0:1651529490.236451:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946674112 00000100:00100000:0.0:1651529490.236458:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213433 00000100:00100000:0.0:1651529490.236459:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946673856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529490.236463:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213434 00000100:00100000:1.0:1651529490.236465:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946673664:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.236465:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179231 count 1 00002000:00080000:1.0:1651529490.236470:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179270 count 1 00000100:00100000:0.0:1651529490.236487:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946673856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 27us (114us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.236490:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213433 00000100:00100000:1.0:1651529490.236493:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946673664:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 27us (164us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.236496:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213434 00000100:00100000:0.0:1651529490.236498:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213435 00000100:00100000:1.0:1651529490.236501:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213436 00000100:00100000:0.0:1651529490.236502:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946673792:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529490.236503:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005329f5eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946673920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.236507:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179191 count 1 00000100:00100000:1.0:1651529490.236519:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005329f5eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946673920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 15us (127us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.236521:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213436 00000100:00100000:1.0:1651529490.236525:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213437 00000100:00100000:1.0:1651529490.236527:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946674112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.236531:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179202 count 1 00002000:00080000:0.0:1651529490.236536:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179390 count 1 00000100:00100000:1.0:1651529490.236551:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946674112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 23us (127us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.236554:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213437 00000100:00100000:0.0:1651529490.236556:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946673792:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 54us (172us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.236558:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213438 00000100:00100000:1.0:1651529490.236560:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946673984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529490.236560:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213435 00002000:00080000:1.0:1651529490.236564:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179303 count 1 00000100:00100000:1.0:1651529490.236576:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946673984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 15us (168us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.236579:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213438 00000100:00100000:0.0:1651529490.236590:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.236603:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.236645:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946674048 00000100:00100000:1.0:1651529490.236652:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946674176 00000100:00100000:1.0:1651529490.236656:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213439 00000100:00100000:1.0:1651529490.236658:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009dfac288 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946674048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.236662:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179206 count 1 00000100:00100000:1.0:1651529490.236682:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009dfac288 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946674048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 23us (92us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.236685:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213439 00000100:00100000:1.0:1651529490.236689:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213440 00000100:00100000:1.0:1651529490.236691:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fb8007ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946674176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.236695:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179342 count 1 00000100:00100000:1.0:1651529490.236707:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fb8007ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946674176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 15us (104us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.236709:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213440 00000100:00100000:1.0:1651529490.236845:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.236852:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946674304 00000100:00100000:1.0:1651529490.236858:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213441 00000100:00100000:1.0:1651529490.236859:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946674304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.236865:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179207 count 1 00000100:00100000:1.0:1651529490.236885:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946674304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 25us (40us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.236903:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213441 00000100:00100000:0.0:1651529490.236938:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.236972:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946674240 00000100:00100000:1.0:1651529490.236979:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213442 00000100:00100000:1.0:1651529490.236981:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000092e14270 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946674240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529490.236982:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529490.236986:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179180 count 1 00000100:00100000:1.0:1651529490.237009:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000092e14270 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946674240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 27us (72us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.237012:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213442 00000100:00100000:1.0:1651529490.237016:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946674432 00000100:00100000:1.0:1651529490.237021:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213443 00000100:00100000:1.0:1651529490.237022:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004b5f63ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946674432:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529490.237026:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529490.237041:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179410 count 1 00000100:00100000:1.0:1651529490.237055:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004b5f63ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946674432:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 32us (74us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.237061:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.237065:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213443 00000100:00100000:1.0:1651529490.237074:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946674560 00000100:00100000:1.0:1651529490.237079:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946674368 00000100:00100000:1.0:1651529490.237083:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213444 00000100:00100000:1.0:1651529490.237084:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d7328d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946674560:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529490.237094:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529490.237095:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179367 count 1 00000100:00100000:1.0:1651529490.237113:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d7328d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946674560:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 28us (89us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.237116:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213444 00000100:00100000:1.0:1651529490.237120:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946674496 00000100:00100000:1.0:1651529490.237129:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213445 00000100:00100000:1.0:1651529490.237131:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004c03f4d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946674368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.237135:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179224 count 1 00000100:00100000:1.0:1651529490.237148:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004c03f4d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946674368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 17us (88us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.237151:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213445 00000100:00100000:1.0:1651529490.237154:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213446 00000100:00100000:1.0:1651529490.237164:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008e33c77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946674496:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.237168:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179350 count 1 00000100:00100000:0.0:1651529490.237170:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.237180:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008e33c77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946674496:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 16us (88us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.237183:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213446 00000100:00100000:1.0:1651529490.237187:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946674624 00000100:00100000:1.0:1651529490.237196:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213447 00000100:00100000:1.0:1651529490.237204:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007591e43c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946674624:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.237208:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179222 count 1 00000100:00100000:0.0:1651529490.237209:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.237221:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007591e43c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946674624:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 23us (51us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.237241:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213447 00000100:00100000:1.0:1651529490.237245:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946674688 00000100:00100000:1.0:1651529490.237250:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213448 00000100:00100000:1.0:1651529490.237251:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000198be7e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946674688:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.237261:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179387 count 1 00000100:00100000:1.0:1651529490.237275:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000198be7e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946674688:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 23us (66us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.237277:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213448 00000100:00100000:0.0:1651529490.237286:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.237299:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946674752 00000100:00100000:1.0:1651529490.237305:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213449 00000100:00100000:0.0:1651529490.237305:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.237306:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000abfc3f58 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946674752:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.237316:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179285 count 1 00000100:00100000:1.0:1651529490.237331:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000abfc3f58 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946674752:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 23us (45us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.237334:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.237346:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213449 00000100:00100000:1.0:1651529490.237351:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946674816 00000100:00100000:1.0:1651529490.237355:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946674880 00000100:00100000:1.0:1651529490.237358:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213450 00000100:00100000:1.0:1651529490.237360:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f4f9630 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946674816:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.237364:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179292 count 1 00000100:00100000:1.0:1651529490.237377:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f4f9630 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946674816:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 16us (72us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.237388:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213450 00000100:00100000:1.0:1651529490.237392:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213451 00000100:00100000:1.0:1651529490.237393:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000036a3a267 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946674880:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.237397:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179274 count 1 00000100:00100000:0.0:1651529490.237400:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.237410:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000036a3a267 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946674880:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 16us (77us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.237412:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213451 00000100:00100000:1.0:1651529490.237416:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946675008 00000100:00100000:1.0:1651529490.237419:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213452 00000100:00100000:1.0:1651529490.237421:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000f50c14a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946675008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.237424:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179414 count 1 00000100:00100000:0.0:1651529490.237431:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.237445:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000f50c14a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946675008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 23us (45us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.237448:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213452 00000100:00100000:1.0:1651529490.237452:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946674944 00000100:00100000:1.0:1651529490.237462:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213453 00000100:00100000:0.0:1651529490.237463:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.237464:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c810c14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946674944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.237469:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179313 count 1 00000100:00100000:1.0:1651529490.237487:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c810c14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946674944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 22us (57us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.237490:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213453 00000100:00100000:1.0:1651529490.237494:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946675072 00000100:00100000:1.0:1651529490.237497:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213454 00000100:00100000:1.0:1651529490.237499:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946675072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.237502:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179273 count 1 00000100:00100000:1.0:1651529490.237547:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946675072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 47us (85us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.237550:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213454 00000100:00100000:0.0:1651529490.237600:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.237610:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946675200 00000100:00100000:1.0:1651529490.237617:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213455 00000100:00100000:1.0:1651529490.237619:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004de851bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946675200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.237624:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179381 count 1 00000100:00100000:1.0:1651529490.237648:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004de851bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946675200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 21us (41us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.237652:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213455 00000100:00100000:0.0:1651529490.237660:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.237687:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946675136 00000100:00100000:0.0:1651529490.237698:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.237707:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946675264 00000100:00100000:0.0:1651529490.237710:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.237717:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946675328 00000100:00100000:1.0:1651529490.237722:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213456 00000100:00100000:1.0:1651529490.237724:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946675136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.237729:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179248 count 1 00000100:00100000:1.0:1651529490.237746:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946675136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 21us (102us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.237748:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213456 00000100:00100000:1.0:1651529490.237752:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213457 00000100:00100000:1.0:1651529490.237754:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946675264:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.237758:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179197 count 1 00000100:00100000:1.0:1651529490.237768:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946675264:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 14us (71us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.237771:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213457 00000100:00100000:1.0:1651529490.237774:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213458 00000100:00100000:1.0:1651529490.237776:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000041d3f4d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946675328:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.237779:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179296 count 1 00000100:00100000:1.0:1651529490.237789:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000041d3f4d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946675328:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 12us (79us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.237791:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213458 00000100:00100000:0.0:1651529490.243428:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.243449:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946675392 00000100:00100000:1.0:1651529490.243457:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213459 00000100:00100000:1.0:1651529490.243459:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000946e402f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946675392:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.243464:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179366 count 1 00000100:00100000:0.0:1651529490.243473:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.243495:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000946e402f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946675392:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 35us (69us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.243500:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213459 00000100:00100000:0.0:1651529490.243500:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.243510:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946675520 00000100:00100000:1.0:1651529490.243515:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946675456 00000100:00100000:1.0:1651529490.243518:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213460 00000100:00100000:1.0:1651529490.243520:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946675520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.243524:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179425 count 1 00000100:00100000:0.0:1651529490.243532:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.243545:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.243556:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946675520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 35us (84us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.243559:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213460 00000100:00100000:0.0:1651529490.243559:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.243569:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946675648 00000100:00100000:1.0:1651529490.243577:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946675584 00000100:00100000:1.0:1651529490.243580:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946675776 00000100:00100000:1.0:1651529490.243593:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213461 00000100:00100000:1.0:1651529490.243595:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946675456:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.243599:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179216 count 1 00000100:00100000:0.0:1651529490.243603:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.243613:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946675456:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 17us (113us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.243615:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213461 00000100:00100000:1.0:1651529490.243619:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946675712 00000100:00100000:1.0:1651529490.243623:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213462 00000100:00100000:1.0:1651529490.243624:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946675648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.243628:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179312 count 1 00000100:00100000:0.0:1651529490.243629:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.243638:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946675648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 13us (108us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.243641:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213462 00000100:00100000:1.0:1651529490.243645:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946675840 00000100:00100000:1.0:1651529490.243648:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213463 00000100:00100000:1.0:1651529490.243650:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946675584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.243653:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179399 count 1 00000100:00100000:0.0:1651529490.243664:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213464 00000100:00100000:0.0:1651529490.243666:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946675776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.243673:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179229 count 1 00000100:00100000:1.0:1651529490.243697:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946675584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 47us (152us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.243700:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213463 00000100:00100000:1.0:1651529490.243705:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213465 00000100:00100000:1.0:1651529490.243707:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008c9304ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946675712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.243711:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179187 count 1 00000100:00100000:1.0:1651529490.243724:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008c9304ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946675712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 16us (121us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.243726:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213465 00000100:00100000:0.0:1651529490.243729:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946675776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 62us (169us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.243730:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213466 00000100:00100000:1.0:1651529490.243731:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946675840:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529490.243732:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213464 00002000:00080000:1.0:1651529490.243736:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179388 count 1 00000100:00100000:1.0:1651529490.243746:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b7984f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946675840:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 14us (133us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.243749:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213466 00000100:00100000:0.0:1651529490.243763:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.243798:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946676416 00000100:00100000:1.0:1651529490.243833:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213467 00000100:00100000:1.0:1651529490.243835:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946676416:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.243840:0:80281:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179290 count 1 00000100:00100000:1.0:1651529490.243862:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aa45e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946676416:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 26us (98us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.243866:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213467 00000100:00100000:1.0:1651529490.243948:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.243955:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.243962:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946676480 00000100:00100000:1.0:1651529490.243967:0:72397:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946676608 00000100:00100000:1.0:1651529490.243971:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213468 00000100:00100000:1.0:1651529490.243972:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946676480:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.243977:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179358 count 1 00000100:00100000:1.0:1651529490.244001:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946676480:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 27us (53us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.244004:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213468 00000100:00100000:1.0:1651529490.244008:0:72397:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213469 00000100:00100000:1.0:1651529490.244010:0:72397:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946676608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.244014:0:72397:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179211 count 1 00000100:00100000:1.0:1651529490.244026:0:72397:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d718cfe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946676608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 16us (71us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.244029:0:72397:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213469 00000100:00100000:1.0:1651529490.244152:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.244159:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.244177:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.244191:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.244198:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.244205:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.244212:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946677184 00000100:00100000:1.0:1651529490.244217:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946677312 00000100:00100000:1.0:1651529490.244220:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946677120 00000100:00100000:1.0:1651529490.244240:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946677248 00000100:00100000:0.0:1651529490.244242:0:80276:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946677440 00000100:00100000:1.0:1651529490.244246:0:151609:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946677376 00000100:00100000:1.0:1651529490.244252:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213470 00000100:00100000:1.0:1651529490.244253:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007f9b0c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946677184:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529490.244257:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213471 00002000:00080000:1.0:1651529490.244258:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179173 count 1 00000100:00100000:0.0:1651529490.244259:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5ebc6ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946677312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.244266:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179378 count 1 00000100:00100000:1.0:1651529490.244279:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007f9b0c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946677184:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 25us (127us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.244282:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213470 00000100:00100000:1.0:1651529490.244287:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213472 00000100:00100000:1.0:1651529490.244288:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068b6c75f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745946677120:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.244292:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179263 count 1 00000100:00100000:1.0:1651529490.244304:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068b6c75f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745946677120:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 16us (128us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.244307:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213472 00000100:00100000:1.0:1651529490.244311:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213473 00000100:00100000:1.0:1651529490.244326:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000020362888 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946677248:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529490.244327:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5ebc6ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946677312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 66us (166us total) trans 0 rc -2/-2 00002000:00080000:1.0:1651529490.244330:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179235 count 1 00000100:00100000:0.0:1651529490.244330:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213471 00000100:00100000:0.0:1651529490.244336:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213474 00000100:00100000:0.0:1651529490.244338:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003132c0c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946677376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529490.244343:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000020362888 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946677248:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 30us (152us total) trans 0 rc -2/-2 00002000:00080000:0.0:1651529490.244343:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179241 count 1 00000100:00100000:1.0:1651529490.244346:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213473 00000100:00100000:1.0:1651529490.244350:0:151609:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213475 00000100:00100000:1.0:1651529490.244352:0:151609:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df603127 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946677440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.244356:0:151609:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179382 count 1 00000100:00100000:0.0:1651529490.244358:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003132c0c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946677376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 19us (152us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.244360:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213474 00000100:00100000:1.0:1651529490.244366:0:151609:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df603127 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946677440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 14us (168us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.244370:0:151609:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213475 00000100:00100000:0.0:1651529490.244376:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.244387:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946677568 00000100:00100000:1.0:1651529490.244392:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213476 00000100:00100000:1.0:1651529490.244394:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946677568:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529490.244394:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:1.0:1651529490.244398:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179326 count 1 00000100:00100000:1.0:1651529490.244411:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e3eb319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946677568:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 17us (35us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.244414:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213476 00000100:00100000:1.0:1651529490.244418:0:80277:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946677504 00000100:00100000:1.0:1651529490.244433:0:80277:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213477 00000100:00100000:1.0:1651529490.244435:0:80277:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946677504:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.244439:0:80277:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179289 count 1 00000100:00100000:1.0:1651529490.244459:0:80277:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000037ac96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946677504:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 24us (66us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.244462:0:80277:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213477 00000100:00100000:1.0:1651529490.244802:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.244821:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.244831:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.244835:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946678144 00000100:00100000:1.0:1651529490.244838:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.244847:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946678272 00000100:00100000:1.0:1651529490.244849:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.244857:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946678400 00000100:00100000:0.0:1651529490.244863:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946678208 00000100:00100000:0.0:1651529490.244868:0:156655:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946678336 00000100:00100000:0.0:1651529490.244874:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213478 00000100:00100000:1.0:1651529490.244875:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.244875:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000056e45ef2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745946678144:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.244881:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179379 count 1 00000100:00100000:1.0:1651529490.244882:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.244893:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.244899:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946678464 00000100:00100000:1.0:1651529490.244904:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946678528 00000100:00100000:1.0:1651529490.244906:0:106695:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946678592 00000100:00100000:0.0:1651529490.244907:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000056e45ef2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946678144:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 30us (111us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.244909:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213479 00000100:00100000:1.0:1651529490.244910:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9b0314b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745946678272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529490.244911:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213478 00002000:00080000:1.0:1651529490.244915:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179363 count 1 00000100:00100000:0.0:1651529490.244916:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213480 00000100:00100000:0.0:1651529490.244917:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745946678400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.244921:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179340 count 1 00000100:00100000:1.0:1651529490.244931:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9b0314b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745946678272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 20us (110us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.244933:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745946678400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 15us (102us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.244934:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213479 00000100:00100000:0.0:1651529490.244936:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213480 00000100:00100000:1.0:1651529490.244939:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213481 00000100:00100000:1.0:1651529490.244940:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946678208:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529490.244941:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213482 00000100:00100000:0.0:1651529490.244942:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946678336:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.244944:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179288 count 1 00002000:00080000:0.0:1651529490.244946:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179364 count 1 00000100:00100000:1.0:1651529490.244954:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946678208:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 13us (116us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.244956:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946678336:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 13us (112us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.244957:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213481 00000100:00100000:0.0:1651529490.244959:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213482 00000100:00100000:1.0:1651529490.244961:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213483 00000100:00100000:1.0:1651529490.244963:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946678464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529490.244963:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213484 00000100:00100000:0.0:1651529490.244965:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946678528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.244966:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179203 count 1 00002000:00080000:0.0:1651529490.244968:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179334 count 1 00000100:00100000:1.0:1651529490.244976:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f363f4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946678464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 13us (109us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.244979:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213483 00000100:00100000:0.0:1651529490.244979:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d1586f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946678528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 13us (97us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.244981:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213484 00000100:00100000:1.0:1651529490.244983:0:106695:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213485 00000100:00100000:1.0:1651529490.244985:0:106695:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946678592:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.244988:0:106695:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179374 count 1 00000100:00100000:1.0:1651529490.244998:0:106695:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002f77bb41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946678592:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 12us (105us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.245000:0:106695:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213485 00000100:00100000:1.0:1651529490.245288:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.245312:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.245326:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.245332:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.245339:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.245345:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946679168 00000100:00100000:1.0:1651529490.245351:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946679232 00000100:00100000:1.0:1651529490.245354:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946679296 00000100:00100000:1.0:1651529490.245357:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946679360 00000100:00100000:1.0:1651529490.245360:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946679424 00000100:00100000:1.0:1651529490.245373:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213486 00000100:00100000:1.0:1651529490.245375:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745946679168:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.245380:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179402 count 1 00000100:00100000:0.0:1651529490.245382:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.245389:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529490.245396:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.245399:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d3fb3ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745946679168:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 23us (111us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.245402:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213486 00000100:00100000:1.0:1651529490.245406:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946679488 00000100:00100000:1.0:1651529490.245410:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946679552 00000100:00100000:1.0:1651529490.245412:0:80280:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946679616 00000100:00100000:1.0:1651529490.245415:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213487 00000100:00100000:1.0:1651529490.245416:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946679232:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.245420:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179339 count 1 00000100:00100000:0.0:1651529490.245426:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213488 00000100:00100000:0.0:1651529490.245429:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745946679296:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.245435:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179327 count 1 00000100:00100000:1.0:1651529490.245447:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946679232:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 29us (135us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.245450:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213487 00000100:00100000:1.0:1651529490.245455:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213489 00000100:00100000:1.0:1651529490.245456:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946679360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.245461:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179188 count 1 00000100:00100000:0.0:1651529490.245461:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+11:39029:x1731745946679296:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 32us (134us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.245464:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213488 00000100:00100000:0.0:1651529490.245469:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213490 00000100:00100000:0.0:1651529490.245471:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745946679424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529490.245473:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946679360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 16us (141us total) trans 0 rc -2/-2 00002000:00080000:0.0:1651529490.245475:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179297 count 1 00000100:00100000:1.0:1651529490.245476:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213489 00000100:00100000:1.0:1651529490.245480:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213491 00000100:00100000:1.0:1651529490.245482:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946679488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.245485:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179265 count 1 00000100:00100000:0.0:1651529490.245488:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946679424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 16us (149us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.245491:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213490 00000100:00100000:0.0:1651529490.245495:0:156655:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213492 00000100:00100000:1.0:1651529490.245496:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000075b025a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946679488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 13us (115us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.245496:0:156655:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946679552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529490.245498:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213491 00002000:00080000:0.0:1651529490.245500:0:156655:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179384 count 1 00000100:00100000:1.0:1651529490.245503:0:80280:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213493 00000100:00100000:1.0:1651529490.245504:0:80280:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009dfac288 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946679616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.245508:0:80280:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179299 count 1 00000100:00100000:0.0:1651529490.245510:0:156655:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bca72234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946679552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 13us (121us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.245512:0:156655:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213492 00000100:00100000:1.0:1651529490.245518:0:80280:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009dfac288 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946679616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 13us (121us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.245520:0:80280:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213493 00000100:00100000:1.0:1651529490.245674:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.245681:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946680192 00000100:00100000:1.0:1651529490.245687:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213494 00000100:00100000:1.0:1651529490.245689:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089bf9ab9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946680192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.245693:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179422 count 1 00000100:00100000:1.0:1651529490.245714:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089bf9ab9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946680192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 25us (40us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.245717:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213494 00000100:00100000:1.0:1651529490.245868:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.245883:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.245891:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.245897:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.245903:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.245909:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.245916:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.245922:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946680256 00000100:00100000:1.0:1651529490.245928:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946680384 00000100:00100000:1.0:1651529490.245931:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946680512 00000100:00100000:1.0:1651529490.245938:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946680320 00000100:00100000:1.0:1651529490.245943:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946680640 00000100:00100000:1.0:1651529490.245948:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946680576 00000100:00100000:1.0:1651529490.245951:0:72395:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946680448 00000100:00100000:1.0:1651529490.245955:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213495 00000100:00100000:1.0:1651529490.245956:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946680256:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529490.245958:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213496 00000100:00100000:0.0:1651529490.245960:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946680384:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.245961:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179306 count 1 00002000:00080000:0.0:1651529490.245966:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179376 count 1 00000100:00100000:1.0:1651529490.245980:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946680256:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 23us (112us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.245983:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213495 00000100:00100000:1.0:1651529490.245988:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213497 00000100:00100000:1.0:1651529490.245990:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946680512:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529490.245990:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745946680384:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 30us (113us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.245993:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213496 00002000:00080000:1.0:1651529490.245994:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179393 count 1 00000100:00100000:0.0:1651529490.245999:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213498 00000100:00100000:0.0:1651529490.246000:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745946680320:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529490.246004:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179406 count 1 00000100:00100000:1.0:1651529490.246006:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946680512:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 16us (115us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.246009:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213497 00000100:00100000:1.0:1651529490.246013:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213499 00000100:00100000:1.0:1651529490.246014:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946680640:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529490.246017:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946680320:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 16us (119us total) trans 0 rc -2/-2 00002000:00080000:1.0:1651529490.246018:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179225 count 1 00000100:00100000:0.0:1651529490.246021:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213498 00000100:00100000:1.0:1651529490.246028:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946680640:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 13us (125us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.246030:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213499 00000100:00100000:0.0:1651529490.246061:0:80276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213500 00000100:00100000:0.0:1651529490.246064:0:80276:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946680576:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529490.246069:0:72395:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213501 00002000:00080000:0.0:1651529490.246070:0:80276:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179213 count 1 00000100:00100000:1.0:1651529490.246071:0:72395:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946680448:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.246074:0:72395:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179277 count 1 00000100:00100000:0.0:1651529490.246086:0:80276:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946680576:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 22us (177us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.246089:0:72395:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946680448:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 18us (173us total) trans 0 rc -2/-2 00000100:00100000:0.0:1651529490.246089:0:80276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213500 00000100:00100000:1.0:1651529490.246091:0:72395:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213501 00000100:00100000:0.0:1651529490.246108:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.246166:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946681216 00000100:00100000:1.0:1651529490.246179:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213502 00000100:00100000:1.0:1651529490.246181:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fb8007ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946681216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.246186:0:72396:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179234 count 1 00000100:00100000:1.0:1651529490.246207:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fb8007ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946681216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 25us (98us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.246209:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213502 00000100:00100000:1.0:1651529490.246449:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.246464:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.246471:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.246477:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529490.246484:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946681344 00000100:00100000:1.0:1651529490.246489:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946681472 00000100:00100000:1.0:1651529490.246492:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946681280 00000100:00100000:1.0:1651529490.246495:0:80279:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946681408 00000100:00100000:1.0:1651529490.246499:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213503 00000100:00100000:1.0:1651529490.246501:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946681344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.246505:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179201 count 1 00000100:00100000:1.0:1651529490.246525:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946681344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 24us (77us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.246528:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213503 00000100:00100000:1.0:1651529490.246533:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213504 00000100:00100000:1.0:1651529490.246535:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946681472:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.246538:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179170 count 1 00000100:00100000:1.0:1651529490.246550:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946681472:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 15us (86us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.246553:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213504 00000100:00100000:1.0:1651529490.246556:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213505 00000100:00100000:1.0:1651529490.246577:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946681280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.246582:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179227 count 1 00000100:00100000:1.0:1651529490.246604:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946681280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 26us (132us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.246607:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213505 00000100:00100000:1.0:1651529490.246611:0:80279:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213506 00000100:00100000:1.0:1651529490.246613:0:80279:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946681408:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529490.246616:0:80279:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:179237 count 1 00000100:00100000:1.0:1651529490.246627:0:80279:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe004e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946681408:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 14us (149us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651529490.246629:0:80279:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213506 00000100:00100000:1.0:1651529491.069299:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d718cfe4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0b51168f-0bcb-46b1-964e-9e88a09501f8:39100:1731745997077824:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:1.0:1651529491.069348:0:39100:0:(ptlrpcd.c:414:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1651529491.069351:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007f9b0c6d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997077888:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00080000:1.0:1651529491.070591:0:39100:0:(recover.c:232:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@10.240.43.61@tcp abruptly disconnected: reconnecting 00000100:00080000:1.0:1651529491.070594:0:39100:0:(import.c:85:import_set_state_nolock()) 00000000dd3d9373 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1651529491.070596:0:39100:0:(import.c:199:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 10.240.43.61@tcp) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1651529491.073743:0:39100:0:(import.c:85:import_set_state_nolock()) 00000000dd3d9373 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1651529491.073750:0:39100:0:(import.c:533:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 10.240.43.61@tcp last attempt 18279 00000100:00080000:1.0:1651529491.073754:0:39100:0:(import.c:614:import_select_connection()) lustre-MDT0000-lwp-OST0001: import 00000000dd3d9373 using connection 10.240.43.61@tcp/10.240.43.61@tcp 00000100:00100000:1.0:1651529491.073774:0:39100:0:(import.c:806:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000068b6c75f x1731745997077952/t0(0) o38->lustre-MDT0000-lwp-OST0001@10.240.43.61@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1651529491.073792:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007f9b0c6d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997077888:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00080000:1.0:1651529491.073798:0:39100:0:(recover.c:232:ptlrpc_request_handle_notconn()) import MGC10.240.43.61@tcp of MGS@10.240.43.61@tcp abruptly disconnected: reconnecting 00000100:00080000:1.0:1651529491.073799:0:39100:0:(import.c:85:import_set_state_nolock()) 000000005bcf41a3 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1651529491.073800:0:39100:0:(import.c:205:ptlrpc_set_import_discon()) 166-1: MGC10.240.43.61@tcp: Connection to MGS (at 10.240.43.61@tcp) was lost; in progress operations using this service will fail 00000100:00100000:0.0:1651529491.073824:0:39098:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000068b6c75f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:39098:1731745997077952:10.240.43.61@tcp:38:ptlrpcd_00_01.0 00000100:00080000:1.0:1651529491.076335:0:39100:0:(import.c:211:ptlrpc_set_import_discon()) import MGS@10.240.43.61@tcp for MGC10.240.43.61@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1651529491.076336:0:39100:0:(import.c:156:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1651529491.076338:0:39100:0:(client.c:3319:ptlrpc_abort_inflight()) @@@ inflight req@00000000d718cfe4 x1731745997077824/t0(0) o400->MGC10.240.43.61@tcp@10.240.43.61@tcp:26/25 lens 224/224 e 0 to 0 dl 1651529498 ref 1 fl Rpc:RNQU/0/0 rc 0/-107 job:'kworker/u4:0.0' 10000000:01000000:1.0:1651529491.076365:0:39100:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1651529491.076367:0:39100:0:(pinger.c:214:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1651529491.076367:0:39100:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808002 00010000:00080000:0.0:1651529491.076367:0:39098:0:(ldlm_request.c:1448:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@0000000068b6c75f x1731745997077952/t0(0) o38->lustre-MDT0000-lwp-OST0001@10.240.43.61@tcp:12/10 lens 520/416 e 0 to 0 dl 1651529497 ref 1 fl Rpc:RNQU/0/0 rc 0/0 job:'ptlrpcd_00_01.0' 00000100:00080000:1.0:1651529491.076368:0:39100:0:(import.c:85:import_set_state_nolock()) 000000005bcf41a3 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1651529491.076370:0:39100:0:(import.c:533:import_select_connection()) MGC10.240.43.61@tcp: connect to NID 10.240.43.61@tcp last attempt 18274 00000100:00080000:1.0:1651529491.076372:0:39100:0:(import.c:614:import_select_connection()) MGC10.240.43.61@tcp: import 000000005bcf41a3 using connection MGC10.240.43.61@tcp_0/10.240.43.61@tcp 00000100:00100000:1.0:1651529491.076378:0:39100:0:(import.c:806:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a5ebc6ba x1731745997078016/t0(0) o250->MGC10.240.43.61@tcp@10.240.43.61@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1651529491.076381:0:39098:0:(import.c:1073:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 6 00000100:00100000:1.0:1651529491.076382:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d718cfe4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0b51168f-0bcb-46b1-964e-9e88a09501f8:39100:1731745997077824:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00080000:0.0:1651529491.079045:0:39098:0:(import.c:1279:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@0000000068b6c75f x1731745997077952/t0(0) o38->lustre-MDT0000-lwp-OST0001@10.240.43.61@tcp:12/10 lens 520/416 e 0 to 0 dl 1651529497 ref 1 fl Interpret:RNQU/0/0 rc 0/0 job:'ptlrpcd_00_01.0' 00000100:00080000:0.0:1651529491.079049:0:39098:0:(import.c:85:import_set_state_nolock()) 00000000dd3d9373 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1651529491.079051:0:39098:0:(import.c:85:import_set_state_nolock()) 00000000dd3d9373 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1651529491.079053:0:39098:0:(import.c:1642:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 10.240.43.61@tcp (at 10.240.43.61@tcp) 00000100:00100000:0.0:1651529491.080915:0:39098:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000068b6c75f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:39098:1731745997077952:10.240.43.61@tcp:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1651529491.080923:0:39098:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5ebc6ba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0b51168f-0bcb-46b1-964e-9e88a09501f8:39098:1731745997078016:10.240.43.61@tcp:250:ptlrpcd_00_01.0 00000100:00080000:0.0:1651529491.082206:0:39098:0:(import.c:1073:ptlrpc_connect_interpret()) MGC10.240.43.61@tcp: connect to target with instance 0 10000000:01000000:0.0:1651529491.082210:0:39098:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808005 00000100:02000400:0.0:1651529491.082211:0:39098:0:(import.c:1233:ptlrpc_connect_interpret()) Evicted from MGS (at 10.240.43.61@tcp) after server handle changed from 0x7e7b15855234af71 to 0x7e7b158553dd5e7e 00000100:00080000:0.0:1651529491.084407:0:39098:0:(import.c:85:import_set_state_nolock()) 000000005bcf41a3 MGS: changing import state from CONNECTING to EVICTED 00000100:00080000:0.0:1651529491.084410:0:39098:0:(import.c:1572:ptlrpc_import_recovery_state_machine()) evicted from MGS@10.240.43.61@tcp; invalidating 00000100:00100000:0.0:1651529491.084539:0:39098:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5ebc6ba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0b51168f-0bcb-46b1-964e-9e88a09501f8:39098:1731745997078016:10.240.43.61@tcp:250:ptlrpcd_00_01.0 00000100:00080000:0.0:1651529491.084549:0:162922:0:(import.c:1512:ptlrpc_invalidate_import_thread()) thread invalidate import MGC10.240.43.61@tcp to MGS@10.240.43.61@tcp 00000100:00100000:0.0:1651529491.084550:0:162922:0:(import.c:338:ptlrpc_invalidate_import()) Sleeping 100s for inflight to error out 10000000:01000000:0.0:1651529491.084551:0:162922:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808003 00010000:00010000:0.0:1651529491.084557:0:162922:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 0000000050243234/0x3234de053b4d6c8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x7e7b15855234affd expref: -99 pid: 72392 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1651529491.084572:0:162922:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 0000000050243234/0x3234de053b4d6c8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x7e7b15855234affd expref: -99 pid: 72392 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1651529491.084579:0:162922:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1651529491.084595:0:162922:0:(ldlm_request.c:1250:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1651529491.084598:0:162922:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 0000000050243234/0x3234de053b4d6c8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x7e7b15855234affd expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529491.084608:0:162922:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 000000007ba8c2cb/0x3234de053b53866 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x7e7b1585523e5712 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1651529491.084611:0:162922:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 000000007ba8c2cb/0x3234de053b53866 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x7e7b1585523e5712 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1651529491.084613:0:162922:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1651529491.084615:0:162922:0:(ldlm_request.c:1250:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1651529491.084615:0:162922:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 000000007ba8c2cb/0x3234de053b53866 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x7e7b1585523e5712 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529491.084618:0:162922:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 000000001fcafd1a/0x3234de053b5386d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x7e7b1585523e5719 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1651529491.084620:0:162922:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 000000001fcafd1a/0x3234de053b5386d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x7e7b1585523e5719 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1651529491.084622:0:162922:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1651529491.084623:0:162922:0:(ldlm_request.c:1250:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1651529491.084624:0:162922:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 000000001fcafd1a/0x3234de053b5386d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x7e7b1585523e5719 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529491.084627:0:162922:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 00000000820e2b3d/0x3234de053b53874 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x7e7b1585523e5720 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1651529491.084629:0:162922:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 00000000820e2b3d/0x3234de053b53874 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x7e7b1585523e5720 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1651529491.084631:0:162922:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1651529491.084632:0:162922:0:(ldlm_request.c:1250:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1651529491.084633:0:162922:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 00000000820e2b3d/0x3234de053b53874 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x7e7b1585523e5720 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529491.084636:0:162922:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 00000000ae57075e/0x3234de053b54031 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x7e7b1585523f389a expref: -99 pid: 72392 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1651529491.084639:0:162922:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 00000000ae57075e/0x3234de053b54031 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x7e7b1585523f389a expref: -99 pid: 72392 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1651529491.084641:0:162922:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1651529491.084642:0:162922:0:(ldlm_request.c:1250:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1651529491.084642:0:162922:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 00000000ae57075e/0x3234de053b54031 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x7e7b1585523f389a expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1651529491.084646:0:162922:0:(import.c:85:import_set_state_nolock()) 000000005bcf41a3 MGS: changing import state from EVICTED to RECOVER 00000100:00080000:0.0:1651529491.084647:0:162922:0:(import.c:85:import_set_state_nolock()) 000000005bcf41a3 MGS: changing import state from RECOVER to FULL 10000000:01000000:0.0:1651529491.084648:0:162922:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1651529491.084649:0:162922:0:(pinger.c:207:ptlrpc_pinger_ir_up()) IR up 00000100:02000000:0.0:1651529491.084650:0:162922:0:(import.c:1642:ptlrpc_import_recovery_state_machine()) MGC10.240.43.61@tcp: Connection restored to 10.240.43.61@tcp (at 10.240.43.61@tcp) 10000000:01000000:0.0:1651529492.349250:0:72392:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1651529492.349263:0:72392:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff94e0ca14e000 from 205 10000000:01000000:0.0:1651529492.349266:0:72392:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1651529492.349294:0:72392:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 00000000ae57075e/0x3234de053c53fee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529492.349300:0:72392:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 00000000ae57075e/0x3234de053c53fee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529492.349306:0:72392:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 00000000ae57075e/0x3234de053c53fee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529492.349318:0:72392:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000092e14270 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b51168f-0bcb-46b1-964e-9e88a09501f8:72392:1731745997078080:10.240.43.61@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1651529492.349354:0:72392:0:(client.c:2492:ptlrpc_set_wait()) set 0000000075259221 going to sleep for 6 seconds 00000100:00100000:0.0:1651529492.349724:0:72392:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000092e14270 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b51168f-0bcb-46b1-964e-9e88a09501f8:72392:1731745997078080:10.240.43.61@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1651529492.349740:0:72392:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 00000000ae57075e/0x3234de053c53fee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd5ea1 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529492.349744:0:72392:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 00000000ae57075e/0x3234de053c53fee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553dd5ea1 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529492.349793:0:72392:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000092e14270 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b51168f-0bcb-46b1-964e-9e88a09501f8:72392:1731745997078144:10.240.43.61@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1651529492.349805:0:72392:0:(client.c:2492:ptlrpc_set_wait()) set 0000000075259221 going to sleep for 6 seconds 00000100:00100000:0.0:1651529492.350086:0:72392:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000092e14270 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b51168f-0bcb-46b1-964e-9e88a09501f8:72392:1731745997078144:10.240.43.61@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1651529492.350105:0:72392:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000092e14270 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b51168f-0bcb-46b1-964e-9e88a09501f8:72392:1731745997078208:10.240.43.61@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1651529492.350124:0:72392:0:(client.c:2492:ptlrpc_set_wait()) set 0000000075259221 going to sleep for 6 seconds 00000100:00100000:0.0:1651529492.350390:0:72392:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000092e14270 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b51168f-0bcb-46b1-964e-9e88a09501f8:72392:1731745997078208:10.240.43.61@tcp:503:ll_cfg_requeue.0 00000040:00080000:0.0:1651529492.350747:0:162923:0:(llog.c:768:llog_process_thread()) stop processing plain 0x3:10:0 index 64768 count 201 00000020:01000000:0.0:1651529492.350835:0:72392:0:(obd_config.c:2042:class_config_parse_llog()) Processed log lustre-client gen 205-204 (rc=0) 10000000:01000000:0.0:1651529492.350846:0:72392:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1651529492.350848:0:72392:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000ae57075e/0x3234de053c53fee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd5ea1 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529492.350853:0:72392:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 00000000ae57075e/0x3234de053c53fee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd5ea1 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1651529492.350856:0:72392:0:(mgc_request.c:609:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1651529492.350857:0:72392:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1651529492.350858:0:72392:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1651529492.350864:0:72392:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 000000004678bff1/0x3234de053c53ff5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529492.350867:0:72392:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 000000004678bff1/0x3234de053c53ff5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529492.350870:0:72392:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 000000004678bff1/0x3234de053c53ff5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529492.350876:0:72392:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000092e14270 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b51168f-0bcb-46b1-964e-9e88a09501f8:72392:1731745997078272:10.240.43.61@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1651529492.350888:0:72392:0:(client.c:2492:ptlrpc_set_wait()) set 0000000080004f0a going to sleep for 6 seconds 00000100:00100000:0.0:1651529492.351115:0:72392:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000092e14270 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b51168f-0bcb-46b1-964e-9e88a09501f8:72392:1731745997078272:10.240.43.61@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1651529492.351120:0:72392:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 000000004678bff1/0x3234de053c53ff5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd5ea8 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529492.351124:0:72392:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 000000004678bff1/0x3234de053c53ff5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553dd5ea8 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529492.351139:0:72392:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000092e14270 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b51168f-0bcb-46b1-964e-9e88a09501f8:72392:1731745997078336:10.240.43.61@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1651529492.351149:0:72392:0:(client.c:2492:ptlrpc_set_wait()) set 0000000080004f0a going to sleep for 6 seconds 00000100:00100000:0.0:1651529492.351364:0:72392:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000092e14270 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b51168f-0bcb-46b1-964e-9e88a09501f8:72392:1731745997078336:10.240.43.61@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1651529492.351375:0:72392:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000092e14270 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b51168f-0bcb-46b1-964e-9e88a09501f8:72392:1731745997078400:10.240.43.61@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1651529492.351387:0:72392:0:(client.c:2492:ptlrpc_set_wait()) set 0000000080004f0a going to sleep for 6 seconds 00000100:00100000:0.0:1651529492.351812:0:72392:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000092e14270 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b51168f-0bcb-46b1-964e-9e88a09501f8:72392:1731745997078400:10.240.43.61@tcp:503:ll_cfg_requeue.0 00000040:00080000:0.0:1651529492.352128:0:162924:0:(llog.c:768:llog_process_thread()) stop processing plain 0x9:10:0 index 64768 count 8 00000020:01000000:0.0:1651529492.352155:0:72392:0:(obd_config.c:2042:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-7 (rc=0) 10000000:01000000:0.0:1651529492.352161:0:72392:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1651529492.352163:0:72392:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 000000004678bff1/0x3234de053c53ff5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd5ea8 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529492.352166:0:72392:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 000000004678bff1/0x3234de053c53ff5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd5ea8 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1651529492.352169:0:72392:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:0.0:1651529492.352170:0:72392:0:(mgc_request.c:2064:mgc_process_log()) Process log params-ffff94e0ca14e000 from 13 10000000:01000000:0.0:1651529492.352171:0:72392:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1651529492.352176:0:72392:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 00000000c0de17df/0x3234de053c53ffc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529492.352179:0:72392:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 00000000c0de17df/0x3234de053c53ffc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529492.352182:0:72392:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 00000000c0de17df/0x3234de053c53ffc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529492.352187:0:72392:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000092e14270 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b51168f-0bcb-46b1-964e-9e88a09501f8:72392:1731745997078464:10.240.43.61@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1651529492.352198:0:72392:0:(client.c:2492:ptlrpc_set_wait()) set 0000000045cc2304 going to sleep for 6 seconds 00000100:00100000:0.0:1651529492.352417:0:72392:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000092e14270 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b51168f-0bcb-46b1-964e-9e88a09501f8:72392:1731745997078464:10.240.43.61@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1651529492.352423:0:72392:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 00000000c0de17df/0x3234de053c53ffc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd5eaf expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529492.352427:0:72392:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 00000000c0de17df/0x3234de053c53ffc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553dd5eaf expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529492.352441:0:72392:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000092e14270 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b51168f-0bcb-46b1-964e-9e88a09501f8:72392:1731745997078528:10.240.43.61@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1651529492.352451:0:72392:0:(client.c:2492:ptlrpc_set_wait()) set 0000000045cc2304 going to sleep for 6 seconds 00000100:00100000:0.0:1651529492.352651:0:72392:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000092e14270 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b51168f-0bcb-46b1-964e-9e88a09501f8:72392:1731745997078528:10.240.43.61@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1651529492.352660:0:72392:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000092e14270 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b51168f-0bcb-46b1-964e-9e88a09501f8:72392:1731745997078592:10.240.43.61@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1651529492.352671:0:72392:0:(client.c:2492:ptlrpc_set_wait()) set 0000000045cc2304 going to sleep for 6 seconds 00000100:00100000:0.0:1651529492.352911:0:72392:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000092e14270 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b51168f-0bcb-46b1-964e-9e88a09501f8:72392:1731745997078592:10.240.43.61@tcp:503:ll_cfg_requeue.0 00000040:00080000:0.0:1651529492.353196:0:162925:0:(llog.c:768:llog_process_thread()) stop processing plain 0x2:10:0 index 64768 count 13 00000020:01000000:0.0:1651529492.353238:0:72392:0:(obd_config.c:2042:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1651529492.353243:0:72392:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1651529492.353245:0:72392:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000c0de17df/0x3234de053c53ffc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd5eaf expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529492.353248:0:72392:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 00000000c0de17df/0x3234de053c53ffc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd5eaf expref: -99 pid: 72392 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1651529492.353252:0:72392:0:(mgc_request.c:609:do_requeue()) updating log nodemap 10000000:01000000:0.0:1651529492.353252:0:72392:0:(mgc_request.c:2064:mgc_process_log()) Process log nodemap-ffff94e0d2ad2410 from 1 10000000:01000000:0.0:1651529492.353253:0:72392:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1651529492.353259:0:72392:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 0000000029b2a516/0x3234de053c54003 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529492.353262:0:72392:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 0000000029b2a516/0x3234de053c54003 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529492.353265:0:72392:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 0000000029b2a516/0x3234de053c54003 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529492.353270:0:72392:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000092e14270 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b51168f-0bcb-46b1-964e-9e88a09501f8:72392:1731745997078656:10.240.43.61@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1651529492.353281:0:72392:0:(client.c:2492:ptlrpc_set_wait()) set 000000005b4623d5 going to sleep for 6 seconds 00000100:00100000:0.0:1651529492.353492:0:72392:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000092e14270 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b51168f-0bcb-46b1-964e-9e88a09501f8:72392:1731745997078656:10.240.43.61@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1651529492.353497:0:72392:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 0000000029b2a516/0x3234de053c54003 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd5eb6 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529492.353501:0:72392:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 0000000029b2a516/0x3234de053c54003 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553dd5eb6 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529492.353576:0:72392:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000092e14270 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b51168f-0bcb-46b1-964e-9e88a09501f8:72392:1731745997078720:10.240.43.61@tcp:256:ll_cfg_requeue.0 00000100:00100000:0.0:1651529492.353595:0:72392:0:(client.c:2492:ptlrpc_set_wait()) set 0000000059b4268b going to sleep for 6 seconds 00000100:00100000:0.0:1651529492.354052:0:72392:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000092e14270 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b51168f-0bcb-46b1-964e-9e88a09501f8:72392:1731745997078720:10.240.43.61@tcp:256:ll_cfg_requeue.0 00080000:10000000:0.0:1651529492.354524:0:72392:0:(osd_handler.c:5198:osd_index_try()) lustre-OST0001: index object [0x200000003:0xf:0x0] (8/32) registered 10000000:01000000:0.0:1651529492.354589:0:72392:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1651529492.354591:0:72392:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 0000000029b2a516/0x3234de053c54003 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd5eb6 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529492.354595:0:72392:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 0000000029b2a516/0x3234de053c54003 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd5eb6 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1651529492.354598:0:72392:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1651529492.354599:0:72392:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff94e0d2ad2410 from 1 10000000:01000000:0.0:1651529492.354600:0:72392:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1651529492.354605:0:72392:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 00000000d84ad17b/0x3234de053c5400a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529492.354608:0:72392:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 00000000d84ad17b/0x3234de053c5400a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529492.354611:0:72392:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 00000000d84ad17b/0x3234de053c5400a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529492.354617:0:72392:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000092e14270 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b51168f-0bcb-46b1-964e-9e88a09501f8:72392:1731745997078784:10.240.43.61@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1651529492.354629:0:72392:0:(client.c:2492:ptlrpc_set_wait()) set 0000000075259221 going to sleep for 6 seconds 00000100:00100000:0.0:1651529492.354836:0:72392:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000092e14270 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b51168f-0bcb-46b1-964e-9e88a09501f8:72392:1731745997078784:10.240.43.61@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1651529492.354840:0:72392:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 00000000d84ad17b/0x3234de053c5400a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd5ebd expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529492.354844:0:72392:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 00000000d84ad17b/0x3234de053c5400a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553dd5ebd expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529492.354858:0:72392:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000092e14270 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b51168f-0bcb-46b1-964e-9e88a09501f8:72392:1731745997078848:10.240.43.61@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1651529492.354868:0:72392:0:(client.c:2492:ptlrpc_set_wait()) set 0000000075259221 going to sleep for 6 seconds 00000100:00100000:0.0:1651529492.355054:0:72392:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000092e14270 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b51168f-0bcb-46b1-964e-9e88a09501f8:72392:1731745997078848:10.240.43.61@tcp:501:ll_cfg_requeue.0 10000000:01000000:0.0:1651529492.355061:0:72392:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1651529492.355063:0:72392:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000d84ad17b/0x3234de053c5400a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd5ebd expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529492.355066:0:72392:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 00000000d84ad17b/0x3234de053c5400a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd5ebd expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529493.186716:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529493.186745:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397060864 00000100:00100000:1.0:1651529493.186764:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 213507 00000100:00100000:1.0:1651529493.186767:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000092e14270 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+5:41277:x1731746397060864:12345-10.240.43.64@tcp:9:kworker/u4:1.0 00000020:00000080:1.0:1651529493.186780:0:72396:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0x3234de053c53fe0 00000100:00080000:1.0:1651529493.186784:0:72396:0:(import.c:85:import_set_state_nolock()) 00000000d75fadd9 ¶×à”ÿÿ: changing import state from FULL to CLOSED 00000001:00000004:1.0:1651529493.186804:0:72396:0:(tgt_lastrcvd.c:701:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12885081251 00000100:00100000:1.0:1651529493.186887:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000092e14270 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+2:41277:x1731746397060864:12345-10.240.43.64@tcp:9:kworker/u4:1.0 Request processed in 119us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529493.186891:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 213507 00000100:00100000:0.0:1651529493.241140:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529493.241185:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397061376 00000100:00100000:1.0:1651529493.241209:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 213508 00000100:00100000:1.0:1651529493.241211:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004b5f63ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:41277:x1731746397061376:12345-10.240.43.64@tcp:8:lfs.0 00010000:00080000:1.0:1651529493.241239:0:72396:0:(ldlm_lib.c:1365:target_handle_connect()) lustre-OST0001: connection from a5e20e05-95ba-4d6f-a195-0604c0c0ff53@10.240.43.64@tcp t0 exp 0000000055bfac58 cur 20151 last 0 00000020:00000080:1.0:1651529493.241254:0:72396:0:(genops.c:1359:class_connect()) connect: client a5e20e05-95ba-4d6f-a195-0604c0c0ff53, cookie 0x3234de053c54011 00002000:00100000:1.0:1651529493.241259:0:72396:0:(ofd_obd.c:150:ofd_parse_connect_data()) lustre-OST0001: cli a5e20e05-95ba-4d6f-a195-0604c0c0ff53/00000000509355fa ocd_connect_flags: 0xa0465af2e3640078 ocd_version: 20f0000 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1651529493.241267:0:72396:0:(ofd_obd.c:249:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000020:01000000:1.0:1651529493.241293:0:72396:0:(lprocfs_status_server.c:544:lprocfs_exp_setup()) using hash 000000008715afdc 00002000:00080000:1.0:1651529493.241297:0:72396:0:(ofd_obd.c:391:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1651529493.241308:0:72396:0:(import.c:85:import_set_state_nolock()) 00000000b2b51b7a ¶×à”ÿÿ: changing import state from RECOVER to FULL 00000100:00100000:1.0:1651529493.241339:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004b5f63ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:41277:x1731746397061376:12345-10.240.43.64@tcp:8:lfs.0 Request processed in 127us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529493.241343:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 213508 00000100:00100000:0.0:1651529493.241558:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529493.241569:0:72398:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397061440 00000100:00100000:0.0:1651529493.241587:0:72398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 596 00000100:00100000:0.0:1651529493.241589:0:72398:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d7328d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:434248:x1731746397061440:12345-10.240.43.64@tcp:13:lfs.0 00002000:00000024:0.0:1651529493.241597:0:72398:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8580288 pending 0 free 81309163520 avail 77138452480 00000100:00100000:0.0:1651529493.241615:0:72398:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d7328d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:434248:x1731746397061440:12345-10.240.43.64@tcp:13:lfs.0 Request processed in 25us (58us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529493.241618:0:72398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 596 00000100:00100000:0.0:1651529493.257928:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529493.257959:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946682048 00000100:00100000:1.0:1651529493.257981:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213509 00000100:00100000:1.0:1651529493.257983:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004c03f4d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:205179:x1731745946682048:12345-10.240.43.61@tcp:5:osp-pre-1-0.0 00002000:00080000:1.0:1651529493.257997:0:72396:0:(ofd_dev.c:1586:ofd_create_hdl()) ofd_last_id() = 179489 -> diff = -64 00002000:02000040:1.0:1651529493.258008:0:72396:0:(ofd_dev.c:1442:ofd_orphans_destroy()) lustre-OST0001: deleting orphan objects from 0x0:179426 to 0x0:179489 00002000:00010000:1.0:1651529493.259699:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.259703:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c54018 lrc: 3/0,1 mode: --/PW res: [0x2bd21:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.259711:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.259712:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.259714:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c54018 lrc: 3/0,1 mode: PW/PW res: [0x2bd21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.259721:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c54018 lrc: 3/0,1 mode: PW/PW res: [0x2bd21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.259725:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c54018 lrc: 3/0,1 mode: PW/PW res: [0x2bd21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.259729:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c54018 lrc: 2/0,0 mode: PW/PW res: [0x2bd21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.259756:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c54018 lrc: 2/0,0 mode: PW/PW res: [0x2bd21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.259762:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005635b116 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.259764:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c54018 lrc: 2/0,0 mode: PW/PW res: [0x2bd21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.259768:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c54018 lrc: 3/0,0 mode: PW/PW res: [0x2bd21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.259777:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c54018 lrc: 1/0,0 mode: --/PW res: [0x2bd21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.259780:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005635b116/0x3234de053c54018 lrc: 0/0,0 mode: --/PW res: [0x2bd21:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.259823:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.259826:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c5401f lrc: 3/0,1 mode: --/PW res: [0x2bd20:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.259829:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.259830:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.259831:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c5401f lrc: 3/0,1 mode: PW/PW res: [0x2bd20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.259837:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c5401f lrc: 3/0,1 mode: PW/PW res: [0x2bd20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.259840:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c5401f lrc: 3/0,1 mode: PW/PW res: [0x2bd20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.259843:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c5401f lrc: 2/0,0 mode: PW/PW res: [0x2bd20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.259874:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.259875:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c54026 lrc: 3/0,1 mode: --/PW res: [0x2bd1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.259879:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.259879:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.259880:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c54026 lrc: 3/0,1 mode: PW/PW res: [0x2bd1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.259883:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c54026 lrc: 3/0,1 mode: PW/PW res: [0x2bd1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.259886:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c54026 lrc: 3/0,1 mode: PW/PW res: [0x2bd1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.259889:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c54026 lrc: 2/0,0 mode: PW/PW res: [0x2bd1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.259910:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c5401f lrc: 2/0,0 mode: PW/PW res: [0x2bd20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.259917:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000097255e6b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.259918:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c5401f lrc: 2/0,0 mode: PW/PW res: [0x2bd20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.259921:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c5401f lrc: 3/0,0 mode: PW/PW res: [0x2bd20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.259923:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.259925:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c5402d lrc: 3/0,1 mode: --/PW res: [0x2bd1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.259925:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c5401f lrc: 1/0,0 mode: --/PW res: [0x2bd20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.259927:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097255e6b/0x3234de053c5401f lrc: 0/0,0 mode: --/PW res: [0x2bd20:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.259928:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.259929:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.259930:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c5402d lrc: 3/0,1 mode: PW/PW res: [0x2bd1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.259931:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c54026 lrc: 2/0,0 mode: PW/PW res: [0x2bd1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.259933:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c5402d lrc: 3/0,1 mode: PW/PW res: [0x2bd1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.259934:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000819c7a2f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.259935:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c54026 lrc: 2/0,0 mode: PW/PW res: [0x2bd1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.259936:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c5402d lrc: 3/0,1 mode: PW/PW res: [0x2bd1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.259938:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c5402d lrc: 2/0,0 mode: PW/PW res: [0x2bd1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.259938:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c54026 lrc: 3/0,0 mode: PW/PW res: [0x2bd1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.259941:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c54026 lrc: 1/0,0 mode: --/PW res: [0x2bd1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.259943:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000819c7a2f/0x3234de053c54026 lrc: 0/0,0 mode: --/PW res: [0x2bd1f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.259953:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c5402d lrc: 2/0,0 mode: PW/PW res: [0x2bd1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.259955:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1791842 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.259956:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c5402d lrc: 2/0,0 mode: PW/PW res: [0x2bd1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.259959:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c5402d lrc: 3/0,0 mode: PW/PW res: [0x2bd1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.259962:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c5402d lrc: 1/0,0 mode: --/PW res: [0x2bd1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.259965:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1791842/0x3234de053c5402d lrc: 0/0,0 mode: --/PW res: [0x2bd1e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.259967:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.259968:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fb1a013/0x3234de053c54034 lrc: 3/0,1 mode: --/PW res: [0x2bd1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.259971:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.259972:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.259973:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fb1a013/0x3234de053c54034 lrc: 3/0,1 mode: PW/PW res: [0x2bd1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.259976:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fb1a013/0x3234de053c54034 lrc: 3/0,1 mode: PW/PW res: [0x2bd1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.259979:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fb1a013/0x3234de053c54034 lrc: 3/0,1 mode: PW/PW res: [0x2bd1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.259982:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fb1a013/0x3234de053c54034 lrc: 2/0,0 mode: PW/PW res: [0x2bd1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.259991:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fb1a013/0x3234de053c54034 lrc: 2/0,0 mode: PW/PW res: [0x2bd1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.259994:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fb1a013 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.259995:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fb1a013/0x3234de053c54034 lrc: 2/0,0 mode: PW/PW res: [0x2bd1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.259998:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fb1a013/0x3234de053c54034 lrc: 3/0,0 mode: PW/PW res: [0x2bd1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260001:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fb1a013/0x3234de053c54034 lrc: 1/0,0 mode: --/PW res: [0x2bd1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260005:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fb1a013/0x3234de053c54034 lrc: 0/0,0 mode: --/PW res: [0x2bd1d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.260008:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.260010:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f71e4f3/0x3234de053c5403b lrc: 3/0,1 mode: --/PW res: [0x2bd1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260013:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260013:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260014:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f71e4f3/0x3234de053c5403b lrc: 3/0,1 mode: PW/PW res: [0x2bd1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260017:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f71e4f3/0x3234de053c5403b lrc: 3/0,1 mode: PW/PW res: [0x2bd1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260020:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f71e4f3/0x3234de053c5403b lrc: 3/0,1 mode: PW/PW res: [0x2bd1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260023:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f71e4f3/0x3234de053c5403b lrc: 2/0,0 mode: PW/PW res: [0x2bd1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260039:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f71e4f3/0x3234de053c5403b lrc: 2/0,0 mode: PW/PW res: [0x2bd1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260043:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002f71e4f3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.260044:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f71e4f3/0x3234de053c5403b lrc: 2/0,0 mode: PW/PW res: [0x2bd1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260047:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f71e4f3/0x3234de053c5403b lrc: 3/0,0 mode: PW/PW res: [0x2bd1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.260051:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529493.260051:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f71e4f3/0x3234de053c5403b lrc: 1/0,0 mode: --/PW res: [0x2bd1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260053:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c54042 lrc: 3/0,1 mode: --/PW res: [0x2bd1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260053:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f71e4f3/0x3234de053c5403b lrc: 0/0,0 mode: --/PW res: [0x2bd1c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260059:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260060:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260060:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c54042 lrc: 3/0,1 mode: PW/PW res: [0x2bd1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260063:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c54042 lrc: 3/0,1 mode: PW/PW res: [0x2bd1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260066:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c54042 lrc: 3/0,1 mode: PW/PW res: [0x2bd1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260069:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c54042 lrc: 2/0,0 mode: PW/PW res: [0x2bd1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260078:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c54042 lrc: 2/0,0 mode: PW/PW res: [0x2bd1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260081:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032c39b88 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.260082:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c54042 lrc: 2/0,0 mode: PW/PW res: [0x2bd1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260087:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c54042 lrc: 3/0,0 mode: PW/PW res: [0x2bd1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260091:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c54042 lrc: 1/0,0 mode: --/PW res: [0x2bd1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260094:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032c39b88/0x3234de053c54042 lrc: 0/0,0 mode: --/PW res: [0x2bd1b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.260096:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.260097:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c54049 lrc: 3/0,1 mode: --/PW res: [0x2bd1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260100:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260101:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260101:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c54049 lrc: 3/0,1 mode: PW/PW res: [0x2bd1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260104:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c54049 lrc: 3/0,1 mode: PW/PW res: [0x2bd1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260107:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c54049 lrc: 3/0,1 mode: PW/PW res: [0x2bd1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260112:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c54049 lrc: 2/0,0 mode: PW/PW res: [0x2bd1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260122:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c54049 lrc: 2/0,0 mode: PW/PW res: [0x2bd1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260125:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6fcae44 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.260125:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c54049 lrc: 2/0,0 mode: PW/PW res: [0x2bd1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260128:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c54049 lrc: 3/0,0 mode: PW/PW res: [0x2bd1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260132:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c54049 lrc: 1/0,0 mode: --/PW res: [0x2bd1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260135:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6fcae44/0x3234de053c54049 lrc: 0/0,0 mode: --/PW res: [0x2bd1a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.260140:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.260142:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c54050 lrc: 3/0,1 mode: --/PW res: [0x2bd19:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260145:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260146:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260146:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c54050 lrc: 3/0,1 mode: PW/PW res: [0x2bd19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260149:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c54050 lrc: 3/0,1 mode: PW/PW res: [0x2bd19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260152:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c54050 lrc: 3/0,1 mode: PW/PW res: [0x2bd19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260155:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c54050 lrc: 2/0,0 mode: PW/PW res: [0x2bd19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260164:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c54050 lrc: 2/0,0 mode: PW/PW res: [0x2bd19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260169:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000050f78364 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.260170:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c54050 lrc: 2/0,0 mode: PW/PW res: [0x2bd19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260173:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c54050 lrc: 3/0,0 mode: PW/PW res: [0x2bd19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260176:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c54050 lrc: 1/0,0 mode: --/PW res: [0x2bd19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260179:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050f78364/0x3234de053c54050 lrc: 0/0,0 mode: --/PW res: [0x2bd19:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.260181:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.260182:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c54057 lrc: 3/0,1 mode: --/PW res: [0x2bd18:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260185:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260186:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260186:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c54057 lrc: 3/0,1 mode: PW/PW res: [0x2bd18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260190:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c54057 lrc: 3/0,1 mode: PW/PW res: [0x2bd18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260193:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c54057 lrc: 3/0,1 mode: PW/PW res: [0x2bd18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260195:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c54057 lrc: 2/0,0 mode: PW/PW res: [0x2bd18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260204:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c54057 lrc: 2/0,0 mode: PW/PW res: [0x2bd18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260207:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005a2cb180 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.260208:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c54057 lrc: 2/0,0 mode: PW/PW res: [0x2bd18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260211:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c54057 lrc: 3/0,0 mode: PW/PW res: [0x2bd18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260214:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c54057 lrc: 1/0,0 mode: --/PW res: [0x2bd18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260217:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a2cb180/0x3234de053c54057 lrc: 0/0,0 mode: --/PW res: [0x2bd18:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.260239:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.260246:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c5405e lrc: 3/0,1 mode: --/PW res: [0x2bd17:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260250:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260250:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260251:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c5405e lrc: 3/0,1 mode: PW/PW res: [0x2bd17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260254:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c5405e lrc: 3/0,1 mode: PW/PW res: [0x2bd17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260257:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c5405e lrc: 3/0,1 mode: PW/PW res: [0x2bd17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260260:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c5405e lrc: 2/0,0 mode: PW/PW res: [0x2bd17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.260292:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.260294:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c54065 lrc: 3/0,1 mode: --/PW res: [0x2bd16:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260297:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260298:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260299:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c54065 lrc: 3/0,1 mode: PW/PW res: [0x2bd16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260302:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c54065 lrc: 3/0,1 mode: PW/PW res: [0x2bd16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260304:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c54065 lrc: 3/0,1 mode: PW/PW res: [0x2bd16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260307:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c54065 lrc: 2/0,0 mode: PW/PW res: [0x2bd16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.260334:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.260335:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c5406c lrc: 3/0,1 mode: --/PW res: [0x2bd15:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260339:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260339:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260340:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c5406c lrc: 3/0,1 mode: PW/PW res: [0x2bd15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260343:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c5406c lrc: 3/0,1 mode: PW/PW res: [0x2bd15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260346:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c5406c lrc: 3/0,1 mode: PW/PW res: [0x2bd15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260349:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c5406c lrc: 2/0,0 mode: PW/PW res: [0x2bd15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.260376:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.260378:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c54073 lrc: 3/0,1 mode: --/PW res: [0x2bd14:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260381:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260381:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260382:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c54073 lrc: 3/0,1 mode: PW/PW res: [0x2bd14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260385:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c54073 lrc: 3/0,1 mode: PW/PW res: [0x2bd14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260388:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c54073 lrc: 3/0,1 mode: PW/PW res: [0x2bd14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260390:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c54073 lrc: 2/0,0 mode: PW/PW res: [0x2bd14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.260411:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.260413:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c5407a lrc: 3/0,1 mode: --/PW res: [0x2bd13:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260418:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260419:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260420:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c5407a lrc: 3/0,1 mode: PW/PW res: [0x2bd13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260423:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c5407a lrc: 3/0,1 mode: PW/PW res: [0x2bd13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260425:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c5407a lrc: 3/0,1 mode: PW/PW res: [0x2bd13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260428:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c5407a lrc: 2/0,0 mode: PW/PW res: [0x2bd13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260443:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c5405e lrc: 2/0,0 mode: PW/PW res: [0x2bd17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260447:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000024627ba8 already unused, calling callback (0000000049fddea7) 00002000:00010000:1.0:1651529493.260448:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529493.260448:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c5405e lrc: 2/0,0 mode: PW/PW res: [0x2bd17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260450:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c54081 lrc: 3/0,1 mode: --/PW res: [0x2bd12:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260452:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c5405e lrc: 3/0,0 mode: PW/PW res: [0x2bd17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260453:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260453:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260454:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c54081 lrc: 3/0,1 mode: PW/PW res: [0x2bd12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260457:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c54081 lrc: 3/0,1 mode: PW/PW res: [0x2bd12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260457:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c5405e lrc: 1/0,0 mode: --/PW res: [0x2bd17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260460:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c54081 lrc: 3/0,1 mode: PW/PW res: [0x2bd12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260460:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024627ba8/0x3234de053c5405e lrc: 0/0,0 mode: --/PW res: [0x2bd17:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260465:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c54081 lrc: 2/0,0 mode: PW/PW res: [0x2bd12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260465:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c54065 lrc: 2/0,0 mode: PW/PW res: [0x2bd16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260467:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f0b0fa2c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.260468:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c54065 lrc: 2/0,0 mode: PW/PW res: [0x2bd16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260471:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c54065 lrc: 3/0,0 mode: PW/PW res: [0x2bd16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260474:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c54065 lrc: 1/0,0 mode: --/PW res: [0x2bd16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260477:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0b0fa2c/0x3234de053c54065 lrc: 0/0,0 mode: --/PW res: [0x2bd16:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260481:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c5406c lrc: 2/0,0 mode: PW/PW res: [0x2bd15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260483:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004f988dee already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.260484:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c5406c lrc: 2/0,0 mode: PW/PW res: [0x2bd15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.260486:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529493.260487:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c5406c lrc: 3/0,0 mode: PW/PW res: [0x2bd15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260488:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ba8c2cb/0x3234de053c54088 lrc: 3/0,1 mode: --/PW res: [0x2bd11:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260490:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c5406c lrc: 1/0,0 mode: --/PW res: [0x2bd15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260491:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260492:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260492:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ba8c2cb/0x3234de053c54088 lrc: 3/0,1 mode: PW/PW res: [0x2bd11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260492:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f988dee/0x3234de053c5406c lrc: 0/0,0 mode: --/PW res: [0x2bd15:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260495:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ba8c2cb/0x3234de053c54088 lrc: 3/0,1 mode: PW/PW res: [0x2bd11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260495:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c54073 lrc: 2/0,0 mode: PW/PW res: [0x2bd14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260498:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ba8c2cb/0x3234de053c54088 lrc: 3/0,1 mode: PW/PW res: [0x2bd11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260498:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f146053f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.260499:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c54073 lrc: 2/0,0 mode: PW/PW res: [0x2bd14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260500:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ba8c2cb/0x3234de053c54088 lrc: 2/0,0 mode: PW/PW res: [0x2bd11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260504:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c54073 lrc: 3/0,0 mode: PW/PW res: [0x2bd14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260507:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c54073 lrc: 1/0,0 mode: --/PW res: [0x2bd14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260510:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f146053f/0x3234de053c54073 lrc: 0/0,0 mode: --/PW res: [0x2bd14:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260513:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c5407a lrc: 2/0,0 mode: PW/PW res: [0x2bd13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260516:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000820e2b3d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.260517:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c5407a lrc: 2/0,0 mode: PW/PW res: [0x2bd13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260519:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c5407a lrc: 3/0,0 mode: PW/PW res: [0x2bd13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.260521:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.260522:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c5408f lrc: 3/0,1 mode: --/PW res: [0x2bd10:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260522:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c5407a lrc: 1/0,0 mode: --/PW res: [0x2bd13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260525:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529493.260525:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c5407a lrc: 0/0,0 mode: --/PW res: [0x2bd13:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260526:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260526:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c5408f lrc: 3/0,1 mode: PW/PW res: [0x2bd10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260528:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c54081 lrc: 2/0,0 mode: PW/PW res: [0x2bd12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260530:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c5408f lrc: 3/0,1 mode: PW/PW res: [0x2bd10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260533:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c5408f lrc: 3/0,1 mode: PW/PW res: [0x2bd10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260533:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fcafd1a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.260534:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c54081 lrc: 2/0,0 mode: PW/PW res: [0x2bd12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260535:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c5408f lrc: 2/0,0 mode: PW/PW res: [0x2bd10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260537:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c54081 lrc: 3/0,0 mode: PW/PW res: [0x2bd12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260540:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c54081 lrc: 1/0,0 mode: --/PW res: [0x2bd12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260543:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c54081 lrc: 0/0,0 mode: --/PW res: [0x2bd12:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260546:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ba8c2cb/0x3234de053c54088 lrc: 2/0,0 mode: PW/PW res: [0x2bd11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260549:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007ba8c2cb already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.260549:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ba8c2cb/0x3234de053c54088 lrc: 2/0,0 mode: PW/PW res: [0x2bd11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260552:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ba8c2cb/0x3234de053c54088 lrc: 3/0,0 mode: PW/PW res: [0x2bd11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.260555:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd0f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529493.260555:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ba8c2cb/0x3234de053c54088 lrc: 1/0,0 mode: --/PW res: [0x2bd11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260557:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c54096 lrc: 3/0,1 mode: --/PW res: [0x2bd0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260558:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ba8c2cb/0x3234de053c54088 lrc: 0/0,0 mode: --/PW res: [0x2bd11:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260560:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260560:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260561:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c54096 lrc: 3/0,1 mode: PW/PW res: [0x2bd0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260561:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c5408f lrc: 2/0,0 mode: PW/PW res: [0x2bd10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260564:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c54096 lrc: 3/0,1 mode: PW/PW res: [0x2bd0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260564:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000087f212ed already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.260565:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c5408f lrc: 2/0,0 mode: PW/PW res: [0x2bd10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260567:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c54096 lrc: 3/0,1 mode: PW/PW res: [0x2bd0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260567:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c5408f lrc: 3/0,0 mode: PW/PW res: [0x2bd10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260569:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c54096 lrc: 2/0,0 mode: PW/PW res: [0x2bd0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260571:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c5408f lrc: 1/0,0 mode: --/PW res: [0x2bd10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260573:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c5408f lrc: 0/0,0 mode: --/PW res: [0x2bd10:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260576:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c54096 lrc: 2/0,0 mode: PW/PW res: [0x2bd0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260579:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f10dea8 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.260580:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c54096 lrc: 2/0,0 mode: PW/PW res: [0x2bd0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260582:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c54096 lrc: 3/0,0 mode: PW/PW res: [0x2bd0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260585:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c54096 lrc: 1/0,0 mode: --/PW res: [0x2bd0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260589:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c54096 lrc: 0/0,0 mode: --/PW res: [0x2bd0f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.260592:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd0e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.260593:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c5409d lrc: 3/0,1 mode: --/PW res: [0x2bd0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260596:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260597:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260598:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c5409d lrc: 3/0,1 mode: PW/PW res: [0x2bd0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260601:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c5409d lrc: 3/0,1 mode: PW/PW res: [0x2bd0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260603:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c5409d lrc: 3/0,1 mode: PW/PW res: [0x2bd0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260606:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c5409d lrc: 2/0,0 mode: PW/PW res: [0x2bd0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260617:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c5409d lrc: 2/0,0 mode: PW/PW res: [0x2bd0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260620:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005532ef34 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.260621:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c5409d lrc: 2/0,0 mode: PW/PW res: [0x2bd0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260624:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c5409d lrc: 3/0,0 mode: PW/PW res: [0x2bd0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260628:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c5409d lrc: 1/0,0 mode: --/PW res: [0x2bd0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260630:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c5409d lrc: 0/0,0 mode: --/PW res: [0x2bd0e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.260632:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd0d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.260634:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c540a4 lrc: 3/0,1 mode: --/PW res: [0x2bd0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260637:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260637:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260638:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c540a4 lrc: 3/0,1 mode: PW/PW res: [0x2bd0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260641:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c540a4 lrc: 3/0,1 mode: PW/PW res: [0x2bd0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260644:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c540a4 lrc: 3/0,1 mode: PW/PW res: [0x2bd0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260647:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c540a4 lrc: 2/0,0 mode: PW/PW res: [0x2bd0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260656:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c540a4 lrc: 2/0,0 mode: PW/PW res: [0x2bd0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260659:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000029e40f3d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.260660:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c540a4 lrc: 2/0,0 mode: PW/PW res: [0x2bd0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260665:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c540a4 lrc: 3/0,0 mode: PW/PW res: [0x2bd0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260669:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c540a4 lrc: 1/0,0 mode: --/PW res: [0x2bd0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260671:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c540a4 lrc: 0/0,0 mode: --/PW res: [0x2bd0d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.260673:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd0c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.260675:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c540ab lrc: 3/0,1 mode: --/PW res: [0x2bd0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260678:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260678:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260679:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c540ab lrc: 3/0,1 mode: PW/PW res: [0x2bd0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260682:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c540ab lrc: 3/0,1 mode: PW/PW res: [0x2bd0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260685:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c540ab lrc: 3/0,1 mode: PW/PW res: [0x2bd0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260687:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c540ab lrc: 2/0,0 mode: PW/PW res: [0x2bd0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260696:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c540ab lrc: 2/0,0 mode: PW/PW res: [0x2bd0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260699:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032eb11d3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.260700:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c540ab lrc: 2/0,0 mode: PW/PW res: [0x2bd0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260703:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c540ab lrc: 3/0,0 mode: PW/PW res: [0x2bd0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260706:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c540ab lrc: 1/0,0 mode: --/PW res: [0x2bd0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260709:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c540ab lrc: 0/0,0 mode: --/PW res: [0x2bd0c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.260713:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd0b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.260714:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c540b2 lrc: 3/0,1 mode: --/PW res: [0x2bd0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260719:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260720:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260721:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c540b2 lrc: 3/0,1 mode: PW/PW res: [0x2bd0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260724:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c540b2 lrc: 3/0,1 mode: PW/PW res: [0x2bd0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260727:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c540b2 lrc: 3/0,1 mode: PW/PW res: [0x2bd0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260729:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c540b2 lrc: 2/0,0 mode: PW/PW res: [0x2bd0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260738:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c540b2 lrc: 2/0,0 mode: PW/PW res: [0x2bd0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260743:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005c863cd2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.260744:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c540b2 lrc: 2/0,0 mode: PW/PW res: [0x2bd0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260747:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c540b2 lrc: 3/0,0 mode: PW/PW res: [0x2bd0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260750:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c540b2 lrc: 1/0,0 mode: --/PW res: [0x2bd0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260753:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c540b2 lrc: 0/0,0 mode: --/PW res: [0x2bd0b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.260755:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd0a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.260757:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c540b9 lrc: 3/0,1 mode: --/PW res: [0x2bd0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260760:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260760:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260761:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c540b9 lrc: 3/0,1 mode: PW/PW res: [0x2bd0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260764:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c540b9 lrc: 3/0,1 mode: PW/PW res: [0x2bd0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260766:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c540b9 lrc: 3/0,1 mode: PW/PW res: [0x2bd0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260771:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c540b9 lrc: 2/0,0 mode: PW/PW res: [0x2bd0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260780:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c540b9 lrc: 2/0,0 mode: PW/PW res: [0x2bd0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260783:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001644aaad already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.260784:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c540b9 lrc: 2/0,0 mode: PW/PW res: [0x2bd0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260787:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c540b9 lrc: 3/0,0 mode: PW/PW res: [0x2bd0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260790:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c540b9 lrc: 1/0,0 mode: --/PW res: [0x2bd0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260793:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c540b9 lrc: 0/0,0 mode: --/PW res: [0x2bd0a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.260798:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd09:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.260800:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c540c0 lrc: 3/0,1 mode: --/PW res: [0x2bd09:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260803:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260803:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260804:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c540c0 lrc: 3/0,1 mode: PW/PW res: [0x2bd09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260807:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c540c0 lrc: 3/0,1 mode: PW/PW res: [0x2bd09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260810:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c540c0 lrc: 3/0,1 mode: PW/PW res: [0x2bd09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260813:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c540c0 lrc: 2/0,0 mode: PW/PW res: [0x2bd09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260840:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c540c0 lrc: 2/0,0 mode: PW/PW res: [0x2bd09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260843:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f149aa4b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.260844:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c540c0 lrc: 2/0,0 mode: PW/PW res: [0x2bd09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260847:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c540c0 lrc: 3/0,0 mode: PW/PW res: [0x2bd09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.260851:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd08:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.260852:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c540c7 lrc: 3/0,1 mode: --/PW res: [0x2bd08:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260852:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c540c0 lrc: 1/0,0 mode: --/PW res: [0x2bd09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260855:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529493.260855:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c540c0 lrc: 0/0,0 mode: --/PW res: [0x2bd09:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260856:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260857:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c540c7 lrc: 3/0,1 mode: PW/PW res: [0x2bd08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260860:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c540c7 lrc: 3/0,1 mode: PW/PW res: [0x2bd08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260863:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c540c7 lrc: 3/0,1 mode: PW/PW res: [0x2bd08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260866:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c540c7 lrc: 2/0,0 mode: PW/PW res: [0x2bd08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260875:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c540c7 lrc: 2/0,0 mode: PW/PW res: [0x2bd08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260879:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ee128d1f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.260880:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c540c7 lrc: 2/0,0 mode: PW/PW res: [0x2bd08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260882:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c540c7 lrc: 3/0,0 mode: PW/PW res: [0x2bd08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260886:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c540c7 lrc: 1/0,0 mode: --/PW res: [0x2bd08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260889:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c540c7 lrc: 0/0,0 mode: --/PW res: [0x2bd08:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.260892:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd07:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.260893:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c540ce lrc: 3/0,1 mode: --/PW res: [0x2bd07:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260896:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260897:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260897:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c540ce lrc: 3/0,1 mode: PW/PW res: [0x2bd07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260900:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c540ce lrc: 3/0,1 mode: PW/PW res: [0x2bd07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260903:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c540ce lrc: 3/0,1 mode: PW/PW res: [0x2bd07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260906:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c540ce lrc: 2/0,0 mode: PW/PW res: [0x2bd07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260918:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c540ce lrc: 2/0,0 mode: PW/PW res: [0x2bd07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260921:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054295afd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.260921:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c540ce lrc: 2/0,0 mode: PW/PW res: [0x2bd07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260924:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c540ce lrc: 3/0,0 mode: PW/PW res: [0x2bd07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260928:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c540ce lrc: 1/0,0 mode: --/PW res: [0x2bd07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260930:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c540ce lrc: 0/0,0 mode: --/PW res: [0x2bd07:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.260934:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd06:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.260936:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c540d5 lrc: 3/0,1 mode: --/PW res: [0x2bd06:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260939:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260939:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260940:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c540d5 lrc: 3/0,1 mode: PW/PW res: [0x2bd06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260943:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c540d5 lrc: 3/0,1 mode: PW/PW res: [0x2bd06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260946:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c540d5 lrc: 3/0,1 mode: PW/PW res: [0x2bd06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260948:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c540d5 lrc: 2/0,0 mode: PW/PW res: [0x2bd06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260958:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c540d5 lrc: 2/0,0 mode: PW/PW res: [0x2bd06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260961:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f3240ce7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.260962:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c540d5 lrc: 2/0,0 mode: PW/PW res: [0x2bd06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260967:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c540d5 lrc: 3/0,0 mode: PW/PW res: [0x2bd06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260970:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c540d5 lrc: 1/0,0 mode: --/PW res: [0x2bd06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260973:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c540d5 lrc: 0/0,0 mode: --/PW res: [0x2bd06:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.260974:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd05:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.260976:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c540dc lrc: 3/0,1 mode: --/PW res: [0x2bd05:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260979:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260980:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.260980:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c540dc lrc: 3/0,1 mode: PW/PW res: [0x2bd05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260983:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c540dc lrc: 3/0,1 mode: PW/PW res: [0x2bd05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260987:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c540dc lrc: 3/0,1 mode: PW/PW res: [0x2bd05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.260989:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c540dc lrc: 2/0,0 mode: PW/PW res: [0x2bd05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.260999:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c540dc lrc: 2/0,0 mode: PW/PW res: [0x2bd05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261001:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000036d87bb6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.261002:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c540dc lrc: 2/0,0 mode: PW/PW res: [0x2bd05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261005:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c540dc lrc: 3/0,0 mode: PW/PW res: [0x2bd05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261008:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c540dc lrc: 1/0,0 mode: --/PW res: [0x2bd05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261011:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036d87bb6/0x3234de053c540dc lrc: 0/0,0 mode: --/PW res: [0x2bd05:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.261015:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd04:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.261017:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c540e3 lrc: 3/0,1 mode: --/PW res: [0x2bd04:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261020:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261020:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261021:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c540e3 lrc: 3/0,1 mode: PW/PW res: [0x2bd04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261024:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c540e3 lrc: 3/0,1 mode: PW/PW res: [0x2bd04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261027:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c540e3 lrc: 3/0,1 mode: PW/PW res: [0x2bd04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261030:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c540e3 lrc: 2/0,0 mode: PW/PW res: [0x2bd04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261039:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c540e3 lrc: 2/0,0 mode: PW/PW res: [0x2bd04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261044:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000082ae179c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.261045:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c540e3 lrc: 2/0,0 mode: PW/PW res: [0x2bd04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261047:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c540e3 lrc: 3/0,0 mode: PW/PW res: [0x2bd04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261051:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c540e3 lrc: 1/0,0 mode: --/PW res: [0x2bd04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261053:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082ae179c/0x3234de053c540e3 lrc: 0/0,0 mode: --/PW res: [0x2bd04:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.261055:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd03:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.261057:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c540ea lrc: 3/0,1 mode: --/PW res: [0x2bd03:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261062:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261062:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261063:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c540ea lrc: 3/0,1 mode: PW/PW res: [0x2bd03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261066:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c540ea lrc: 3/0,1 mode: PW/PW res: [0x2bd03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261069:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c540ea lrc: 3/0,1 mode: PW/PW res: [0x2bd03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261071:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c540ea lrc: 2/0,0 mode: PW/PW res: [0x2bd03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261080:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c540ea lrc: 2/0,0 mode: PW/PW res: [0x2bd03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261083:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b0407aaf already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.261084:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c540ea lrc: 2/0,0 mode: PW/PW res: [0x2bd03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261087:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c540ea lrc: 3/0,0 mode: PW/PW res: [0x2bd03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261090:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c540ea lrc: 1/0,0 mode: --/PW res: [0x2bd03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261093:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0407aaf/0x3234de053c540ea lrc: 0/0,0 mode: --/PW res: [0x2bd03:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.261096:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd02:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.261098:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c540f1 lrc: 3/0,1 mode: --/PW res: [0x2bd02:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261101:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261101:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261102:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c540f1 lrc: 3/0,1 mode: PW/PW res: [0x2bd02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261105:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c540f1 lrc: 3/0,1 mode: PW/PW res: [0x2bd02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261108:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c540f1 lrc: 3/0,1 mode: PW/PW res: [0x2bd02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261113:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c540f1 lrc: 2/0,0 mode: PW/PW res: [0x2bd02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261122:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c540f1 lrc: 2/0,0 mode: PW/PW res: [0x2bd02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261125:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000a7c37b9 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.261126:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c540f1 lrc: 2/0,0 mode: PW/PW res: [0x2bd02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261129:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c540f1 lrc: 3/0,0 mode: PW/PW res: [0x2bd02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261132:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c540f1 lrc: 1/0,0 mode: --/PW res: [0x2bd02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261135:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a7c37b9/0x3234de053c540f1 lrc: 0/0,0 mode: --/PW res: [0x2bd02:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.261139:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd01:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.261141:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c540f8 lrc: 3/0,1 mode: --/PW res: [0x2bd01:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261144:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261145:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261145:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c540f8 lrc: 3/0,1 mode: PW/PW res: [0x2bd01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261148:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c540f8 lrc: 3/0,1 mode: PW/PW res: [0x2bd01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261151:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c540f8 lrc: 3/0,1 mode: PW/PW res: [0x2bd01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261154:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c540f8 lrc: 2/0,0 mode: PW/PW res: [0x2bd01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261163:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c540f8 lrc: 2/0,0 mode: PW/PW res: [0x2bd01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261166:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002f450f42 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.261167:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c540f8 lrc: 2/0,0 mode: PW/PW res: [0x2bd01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261170:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c540f8 lrc: 3/0,0 mode: PW/PW res: [0x2bd01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261173:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c540f8 lrc: 1/0,0 mode: --/PW res: [0x2bd01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261176:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f450f42/0x3234de053c540f8 lrc: 0/0,0 mode: --/PW res: [0x2bd01:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.261178:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd00:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.261180:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c540ff lrc: 3/0,1 mode: --/PW res: [0x2bd00:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261183:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261183:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261184:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c540ff lrc: 3/0,1 mode: PW/PW res: [0x2bd00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261188:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c540ff lrc: 3/0,1 mode: PW/PW res: [0x2bd00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261191:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c540ff lrc: 3/0,1 mode: PW/PW res: [0x2bd00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261193:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c540ff lrc: 2/0,0 mode: PW/PW res: [0x2bd00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261202:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c540ff lrc: 2/0,0 mode: PW/PW res: [0x2bd00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261205:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d9cfe902 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.261206:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c540ff lrc: 2/0,0 mode: PW/PW res: [0x2bd00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261209:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c540ff lrc: 3/0,0 mode: PW/PW res: [0x2bd00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261212:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c540ff lrc: 1/0,0 mode: --/PW res: [0x2bd00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261215:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9cfe902/0x3234de053c540ff lrc: 0/0,0 mode: --/PW res: [0x2bd00:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.261218:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.261219:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c54106 lrc: 3/0,1 mode: --/PW res: [0x2bcff:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261237:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261238:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261238:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c54106 lrc: 3/0,1 mode: PW/PW res: [0x2bcff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261242:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c54106 lrc: 3/0,1 mode: PW/PW res: [0x2bcff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261245:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c54106 lrc: 3/0,1 mode: PW/PW res: [0x2bcff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261247:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c54106 lrc: 2/0,0 mode: PW/PW res: [0x2bcff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261258:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c54106 lrc: 2/0,0 mode: PW/PW res: [0x2bcff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261262:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000009fe5580 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.261262:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c54106 lrc: 2/0,0 mode: PW/PW res: [0x2bcff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261268:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c54106 lrc: 3/0,0 mode: PW/PW res: [0x2bcff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261272:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c54106 lrc: 1/0,0 mode: --/PW res: [0x2bcff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261274:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c54106 lrc: 0/0,0 mode: --/PW res: [0x2bcff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.261276:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcfe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.261278:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c5410d lrc: 3/0,1 mode: --/PW res: [0x2bcfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261281:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261282:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261283:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c5410d lrc: 3/0,1 mode: PW/PW res: [0x2bcfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261286:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c5410d lrc: 3/0,1 mode: PW/PW res: [0x2bcfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261289:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c5410d lrc: 3/0,1 mode: PW/PW res: [0x2bcfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261291:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c5410d lrc: 2/0,0 mode: PW/PW res: [0x2bcfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261300:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c5410d lrc: 2/0,0 mode: PW/PW res: [0x2bcfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261304:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000055fddd81 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.261304:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c5410d lrc: 2/0,0 mode: PW/PW res: [0x2bcfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261307:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c5410d lrc: 3/0,0 mode: PW/PW res: [0x2bcfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261311:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c5410d lrc: 1/0,0 mode: --/PW res: [0x2bcfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261313:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c5410d lrc: 0/0,0 mode: --/PW res: [0x2bcfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.261316:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcfd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.261318:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c54114 lrc: 3/0,1 mode: --/PW res: [0x2bcfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261321:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261321:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261322:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c54114 lrc: 3/0,1 mode: PW/PW res: [0x2bcfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261325:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c54114 lrc: 3/0,1 mode: PW/PW res: [0x2bcfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261328:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c54114 lrc: 3/0,1 mode: PW/PW res: [0x2bcfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261331:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c54114 lrc: 2/0,0 mode: PW/PW res: [0x2bcfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261339:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c54114 lrc: 2/0,0 mode: PW/PW res: [0x2bcfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261345:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c822bd1c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.261346:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c54114 lrc: 2/0,0 mode: PW/PW res: [0x2bcfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261348:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c54114 lrc: 3/0,0 mode: PW/PW res: [0x2bcfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261352:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c54114 lrc: 1/0,0 mode: --/PW res: [0x2bcfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261354:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c54114 lrc: 0/0,0 mode: --/PW res: [0x2bcfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.261355:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcfc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.261357:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c5411b lrc: 3/0,1 mode: --/PW res: [0x2bcfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261360:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261360:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261361:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c5411b lrc: 3/0,1 mode: PW/PW res: [0x2bcfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261364:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c5411b lrc: 3/0,1 mode: PW/PW res: [0x2bcfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261367:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c5411b lrc: 3/0,1 mode: PW/PW res: [0x2bcfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261369:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c5411b lrc: 2/0,0 mode: PW/PW res: [0x2bcfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261378:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c5411b lrc: 2/0,0 mode: PW/PW res: [0x2bcfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261381:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000096ab8041 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.261382:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c5411b lrc: 2/0,0 mode: PW/PW res: [0x2bcfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261385:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c5411b lrc: 3/0,0 mode: PW/PW res: [0x2bcfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261388:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c5411b lrc: 1/0,0 mode: --/PW res: [0x2bcfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261391:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c5411b lrc: 0/0,0 mode: --/PW res: [0x2bcfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.261394:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcfb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.261396:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c54122 lrc: 3/0,1 mode: --/PW res: [0x2bcfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261401:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261401:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261402:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c54122 lrc: 3/0,1 mode: PW/PW res: [0x2bcfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261405:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c54122 lrc: 3/0,1 mode: PW/PW res: [0x2bcfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261408:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c54122 lrc: 3/0,1 mode: PW/PW res: [0x2bcfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261410:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c54122 lrc: 2/0,0 mode: PW/PW res: [0x2bcfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261419:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c54122 lrc: 2/0,0 mode: PW/PW res: [0x2bcfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261422:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005b8e72f9 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.261423:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c54122 lrc: 2/0,0 mode: PW/PW res: [0x2bcfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261426:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c54122 lrc: 3/0,0 mode: PW/PW res: [0x2bcfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261429:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c54122 lrc: 1/0,0 mode: --/PW res: [0x2bcfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261432:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c54122 lrc: 0/0,0 mode: --/PW res: [0x2bcfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.261435:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcfa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.261436:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c54129 lrc: 3/0,1 mode: --/PW res: [0x2bcfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261439:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261440:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261441:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c54129 lrc: 3/0,1 mode: PW/PW res: [0x2bcfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261444:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c54129 lrc: 3/0,1 mode: PW/PW res: [0x2bcfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261446:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c54129 lrc: 3/0,1 mode: PW/PW res: [0x2bcfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261451:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c54129 lrc: 2/0,0 mode: PW/PW res: [0x2bcfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261460:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c54129 lrc: 2/0,0 mode: PW/PW res: [0x2bcfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261463:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000916cff2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.261464:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c54129 lrc: 2/0,0 mode: PW/PW res: [0x2bcfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261466:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c54129 lrc: 3/0,0 mode: PW/PW res: [0x2bcfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261470:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c54129 lrc: 1/0,0 mode: --/PW res: [0x2bcfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261473:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c54129 lrc: 0/0,0 mode: --/PW res: [0x2bcfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.261477:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcf9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.261479:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c54130 lrc: 3/0,1 mode: --/PW res: [0x2bcf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261482:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261482:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261483:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c54130 lrc: 3/0,1 mode: PW/PW res: [0x2bcf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261486:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c54130 lrc: 3/0,1 mode: PW/PW res: [0x2bcf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261489:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c54130 lrc: 3/0,1 mode: PW/PW res: [0x2bcf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261491:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c54130 lrc: 2/0,0 mode: PW/PW res: [0x2bcf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261500:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c54130 lrc: 2/0,0 mode: PW/PW res: [0x2bcf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261503:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042bde05b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.261504:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c54130 lrc: 2/0,0 mode: PW/PW res: [0x2bcf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261507:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c54130 lrc: 3/0,0 mode: PW/PW res: [0x2bcf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261510:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c54130 lrc: 1/0,0 mode: --/PW res: [0x2bcf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261513:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c54130 lrc: 0/0,0 mode: --/PW res: [0x2bcf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.261516:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcf8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.261518:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c54137 lrc: 3/0,1 mode: --/PW res: [0x2bcf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261521:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261521:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261522:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c54137 lrc: 3/0,1 mode: PW/PW res: [0x2bcf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261525:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c54137 lrc: 3/0,1 mode: PW/PW res: [0x2bcf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261528:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c54137 lrc: 3/0,1 mode: PW/PW res: [0x2bcf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261531:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c54137 lrc: 2/0,0 mode: PW/PW res: [0x2bcf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261539:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c54137 lrc: 2/0,0 mode: PW/PW res: [0x2bcf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261542:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005e711cee already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.261543:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c54137 lrc: 2/0,0 mode: PW/PW res: [0x2bcf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261548:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c54137 lrc: 3/0,0 mode: PW/PW res: [0x2bcf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261552:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c54137 lrc: 1/0,0 mode: --/PW res: [0x2bcf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261554:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c54137 lrc: 0/0,0 mode: --/PW res: [0x2bcf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.261557:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcf7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.261558:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c5413e lrc: 3/0,1 mode: --/PW res: [0x2bcf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261561:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261562:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261562:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c5413e lrc: 3/0,1 mode: PW/PW res: [0x2bcf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261565:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c5413e lrc: 3/0,1 mode: PW/PW res: [0x2bcf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261568:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c5413e lrc: 3/0,1 mode: PW/PW res: [0x2bcf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261571:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c5413e lrc: 2/0,0 mode: PW/PW res: [0x2bcf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261582:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c5413e lrc: 2/0,0 mode: PW/PW res: [0x2bcf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261585:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000314b5fa1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.261586:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c5413e lrc: 2/0,0 mode: PW/PW res: [0x2bcf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261589:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c5413e lrc: 3/0,0 mode: PW/PW res: [0x2bcf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261592:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c5413e lrc: 1/0,0 mode: --/PW res: [0x2bcf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261595:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c5413e lrc: 0/0,0 mode: --/PW res: [0x2bcf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.261597:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcf6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.261599:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c54145 lrc: 3/0,1 mode: --/PW res: [0x2bcf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261602:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261603:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261603:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c54145 lrc: 3/0,1 mode: PW/PW res: [0x2bcf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261606:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c54145 lrc: 3/0,1 mode: PW/PW res: [0x2bcf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261609:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c54145 lrc: 3/0,1 mode: PW/PW res: [0x2bcf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261611:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c54145 lrc: 2/0,0 mode: PW/PW res: [0x2bcf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261620:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c54145 lrc: 2/0,0 mode: PW/PW res: [0x2bcf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261625:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cd5f3a7c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.261626:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c54145 lrc: 2/0,0 mode: PW/PW res: [0x2bcf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261629:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c54145 lrc: 3/0,0 mode: PW/PW res: [0x2bcf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261632:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c54145 lrc: 1/0,0 mode: --/PW res: [0x2bcf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261635:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c54145 lrc: 0/0,0 mode: --/PW res: [0x2bcf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.261637:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcf5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.261638:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c5414c lrc: 3/0,1 mode: --/PW res: [0x2bcf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261641:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261642:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261642:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c5414c lrc: 3/0,1 mode: PW/PW res: [0x2bcf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261645:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c5414c lrc: 3/0,1 mode: PW/PW res: [0x2bcf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261648:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c5414c lrc: 3/0,1 mode: PW/PW res: [0x2bcf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261651:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c5414c lrc: 2/0,0 mode: PW/PW res: [0x2bcf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261660:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c5414c lrc: 2/0,0 mode: PW/PW res: [0x2bcf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261663:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006cbd0d09 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.261664:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c5414c lrc: 2/0,0 mode: PW/PW res: [0x2bcf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261666:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c5414c lrc: 3/0,0 mode: PW/PW res: [0x2bcf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261670:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c5414c lrc: 1/0,0 mode: --/PW res: [0x2bcf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261673:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c5414c lrc: 0/0,0 mode: --/PW res: [0x2bcf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.261676:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcf4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.261677:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c54153 lrc: 3/0,1 mode: --/PW res: [0x2bcf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261680:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261681:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261682:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c54153 lrc: 3/0,1 mode: PW/PW res: [0x2bcf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261685:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c54153 lrc: 3/0,1 mode: PW/PW res: [0x2bcf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261687:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c54153 lrc: 3/0,1 mode: PW/PW res: [0x2bcf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261690:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c54153 lrc: 2/0,0 mode: PW/PW res: [0x2bcf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261699:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c54153 lrc: 2/0,0 mode: PW/PW res: [0x2bcf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261702:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ebdbebae already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.261703:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c54153 lrc: 2/0,0 mode: PW/PW res: [0x2bcf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261706:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c54153 lrc: 3/0,0 mode: PW/PW res: [0x2bcf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261709:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c54153 lrc: 1/0,0 mode: --/PW res: [0x2bcf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261712:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c54153 lrc: 0/0,0 mode: --/PW res: [0x2bcf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.261714:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcf3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.261716:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c5415a lrc: 3/0,1 mode: --/PW res: [0x2bcf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261721:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261721:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261722:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c5415a lrc: 3/0,1 mode: PW/PW res: [0x2bcf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261725:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c5415a lrc: 3/0,1 mode: PW/PW res: [0x2bcf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261728:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c5415a lrc: 3/0,1 mode: PW/PW res: [0x2bcf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261731:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c5415a lrc: 2/0,0 mode: PW/PW res: [0x2bcf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261739:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c5415a lrc: 2/0,0 mode: PW/PW res: [0x2bcf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261742:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba437fe0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.261743:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c5415a lrc: 2/0,0 mode: PW/PW res: [0x2bcf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261746:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c5415a lrc: 3/0,0 mode: PW/PW res: [0x2bcf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261749:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c5415a lrc: 1/0,0 mode: --/PW res: [0x2bcf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261752:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c5415a lrc: 0/0,0 mode: --/PW res: [0x2bcf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.261755:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcf2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.261757:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c54161 lrc: 3/0,1 mode: --/PW res: [0x2bcf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261760:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261760:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261761:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c54161 lrc: 3/0,1 mode: PW/PW res: [0x2bcf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261764:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c54161 lrc: 3/0,1 mode: PW/PW res: [0x2bcf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261766:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c54161 lrc: 3/0,1 mode: PW/PW res: [0x2bcf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261771:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c54161 lrc: 2/0,0 mode: PW/PW res: [0x2bcf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261780:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c54161 lrc: 2/0,0 mode: PW/PW res: [0x2bcf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261783:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000014fe598c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.261784:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c54161 lrc: 2/0,0 mode: PW/PW res: [0x2bcf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261787:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c54161 lrc: 3/0,0 mode: PW/PW res: [0x2bcf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261790:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c54161 lrc: 1/0,0 mode: --/PW res: [0x2bcf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261793:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c54161 lrc: 0/0,0 mode: --/PW res: [0x2bcf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.261797:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcf1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.261798:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c54168 lrc: 3/0,1 mode: --/PW res: [0x2bcf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261801:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261802:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261802:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c54168 lrc: 3/0,1 mode: PW/PW res: [0x2bcf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261806:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c54168 lrc: 3/0,1 mode: PW/PW res: [0x2bcf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261809:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c54168 lrc: 3/0,1 mode: PW/PW res: [0x2bcf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261811:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c54168 lrc: 2/0,0 mode: PW/PW res: [0x2bcf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261829:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c54168 lrc: 2/0,0 mode: PW/PW res: [0x2bcf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261832:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000090e99444 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.261833:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c54168 lrc: 2/0,0 mode: PW/PW res: [0x2bcf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261838:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c54168 lrc: 3/0,0 mode: PW/PW res: [0x2bcf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261841:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c54168 lrc: 1/0,0 mode: --/PW res: [0x2bcf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261844:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c54168 lrc: 0/0,0 mode: --/PW res: [0x2bcf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.261846:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcf0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.261848:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5416f lrc: 3/0,1 mode: --/PW res: [0x2bcf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261851:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261851:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261852:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5416f lrc: 3/0,1 mode: PW/PW res: [0x2bcf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261856:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5416f lrc: 3/0,1 mode: PW/PW res: [0x2bcf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261859:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5416f lrc: 3/0,1 mode: PW/PW res: [0x2bcf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261861:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5416f lrc: 2/0,0 mode: PW/PW res: [0x2bcf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261871:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5416f lrc: 2/0,0 mode: PW/PW res: [0x2bcf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261874:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004b2a6b06 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.261874:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5416f lrc: 2/0,0 mode: PW/PW res: [0x2bcf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261877:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5416f lrc: 3/0,0 mode: PW/PW res: [0x2bcf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261881:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5416f lrc: 1/0,0 mode: --/PW res: [0x2bcf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261884:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c5416f lrc: 0/0,0 mode: --/PW res: [0x2bcf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.261886:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.261887:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c54176 lrc: 3/0,1 mode: --/PW res: [0x2bcef:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261890:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261891:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261891:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c54176 lrc: 3/0,1 mode: PW/PW res: [0x2bcef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261894:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c54176 lrc: 3/0,1 mode: PW/PW res: [0x2bcef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261897:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c54176 lrc: 3/0,1 mode: PW/PW res: [0x2bcef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261900:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c54176 lrc: 2/0,0 mode: PW/PW res: [0x2bcef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261911:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c54176 lrc: 2/0,0 mode: PW/PW res: [0x2bcef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261916:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dd6b1be4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.261917:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c54176 lrc: 2/0,0 mode: PW/PW res: [0x2bcef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261920:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c54176 lrc: 3/0,0 mode: PW/PW res: [0x2bcef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261923:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c54176 lrc: 1/0,0 mode: --/PW res: [0x2bcef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.261925:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529493.261926:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c54176 lrc: 0/0,0 mode: --/PW res: [0x2bcef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261927:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c5417d lrc: 3/0,1 mode: --/PW res: [0x2bcee:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261930:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261931:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261931:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c5417d lrc: 3/0,1 mode: PW/PW res: [0x2bcee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261934:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c5417d lrc: 3/0,1 mode: PW/PW res: [0x2bcee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261937:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c5417d lrc: 3/0,1 mode: PW/PW res: [0x2bcee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261940:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c5417d lrc: 2/0,0 mode: PW/PW res: [0x2bcee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261949:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c5417d lrc: 2/0,0 mode: PW/PW res: [0x2bcee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261952:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000066921086 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.261952:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c5417d lrc: 2/0,0 mode: PW/PW res: [0x2bcee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261955:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c5417d lrc: 3/0,0 mode: PW/PW res: [0x2bcee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261959:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c5417d lrc: 1/0,0 mode: --/PW res: [0x2bcee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261961:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c5417d lrc: 0/0,0 mode: --/PW res: [0x2bcee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.261964:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bced:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.261966:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c54184 lrc: 3/0,1 mode: --/PW res: [0x2bced:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261969:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261970:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.261970:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c54184 lrc: 3/0,1 mode: PW/PW res: [0x2bced:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261973:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c54184 lrc: 3/0,1 mode: PW/PW res: [0x2bced:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261976:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c54184 lrc: 3/0,1 mode: PW/PW res: [0x2bced:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.261979:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c54184 lrc: 2/0,0 mode: PW/PW res: [0x2bced:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261988:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c54184 lrc: 2/0,0 mode: PW/PW res: [0x2bced:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261991:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e48e0bfd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.261992:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c54184 lrc: 2/0,0 mode: PW/PW res: [0x2bced:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261995:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c54184 lrc: 3/0,0 mode: PW/PW res: [0x2bced:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.261998:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c54184 lrc: 1/0,0 mode: --/PW res: [0x2bced:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262001:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c54184 lrc: 0/0,0 mode: --/PW res: [0x2bced:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.262003:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.262004:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c5418b lrc: 3/0,1 mode: --/PW res: [0x2bcec:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262007:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.262008:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.262009:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c5418b lrc: 3/0,1 mode: PW/PW res: [0x2bcec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262012:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c5418b lrc: 3/0,1 mode: PW/PW res: [0x2bcec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262015:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c5418b lrc: 3/0,1 mode: PW/PW res: [0x2bcec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262017:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c5418b lrc: 2/0,0 mode: PW/PW res: [0x2bcec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262026:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c5418b lrc: 2/0,0 mode: PW/PW res: [0x2bcec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262029:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000feb9d3da already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.262030:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c5418b lrc: 2/0,0 mode: PW/PW res: [0x2bcec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262032:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c5418b lrc: 3/0,0 mode: PW/PW res: [0x2bcec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262036:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c5418b lrc: 1/0,0 mode: --/PW res: [0x2bcec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262039:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c5418b lrc: 0/0,0 mode: --/PW res: [0x2bcec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.262042:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bceb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.262043:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c54192 lrc: 3/0,1 mode: --/PW res: [0x2bceb:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262048:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.262049:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.262049:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c54192 lrc: 3/0,1 mode: PW/PW res: [0x2bceb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262053:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c54192 lrc: 3/0,1 mode: PW/PW res: [0x2bceb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262055:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c54192 lrc: 3/0,1 mode: PW/PW res: [0x2bceb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262058:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c54192 lrc: 2/0,0 mode: PW/PW res: [0x2bceb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262067:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c54192 lrc: 2/0,0 mode: PW/PW res: [0x2bceb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262070:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bdf2b6c4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.262071:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c54192 lrc: 2/0,0 mode: PW/PW res: [0x2bceb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262073:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c54192 lrc: 3/0,0 mode: PW/PW res: [0x2bceb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262077:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c54192 lrc: 1/0,0 mode: --/PW res: [0x2bceb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262080:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c54192 lrc: 0/0,0 mode: --/PW res: [0x2bceb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.262082:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bcea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.262084:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c54199 lrc: 3/0,1 mode: --/PW res: [0x2bcea:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262087:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.262087:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.262088:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c54199 lrc: 3/0,1 mode: PW/PW res: [0x2bcea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262091:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c54199 lrc: 3/0,1 mode: PW/PW res: [0x2bcea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262094:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c54199 lrc: 3/0,1 mode: PW/PW res: [0x2bcea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262099:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c54199 lrc: 2/0,0 mode: PW/PW res: [0x2bcea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262107:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c54199 lrc: 2/0,0 mode: PW/PW res: [0x2bcea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262110:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000029958df2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.262111:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c54199 lrc: 2/0,0 mode: PW/PW res: [0x2bcea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262116:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c54199 lrc: 3/0,0 mode: PW/PW res: [0x2bcea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262120:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c54199 lrc: 1/0,0 mode: --/PW res: [0x2bcea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262122:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c54199 lrc: 0/0,0 mode: --/PW res: [0x2bcea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.262124:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bce9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.262126:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c541a0 lrc: 3/0,1 mode: --/PW res: [0x2bce9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262129:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.262130:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.262130:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c541a0 lrc: 3/0,1 mode: PW/PW res: [0x2bce9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262134:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c541a0 lrc: 3/0,1 mode: PW/PW res: [0x2bce9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262136:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c541a0 lrc: 3/0,1 mode: PW/PW res: [0x2bce9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262139:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c541a0 lrc: 2/0,0 mode: PW/PW res: [0x2bce9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262148:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c541a0 lrc: 2/0,0 mode: PW/PW res: [0x2bce9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262151:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002731c8d2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.262152:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c541a0 lrc: 2/0,0 mode: PW/PW res: [0x2bce9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262154:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c541a0 lrc: 3/0,0 mode: PW/PW res: [0x2bce9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262158:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c541a0 lrc: 1/0,0 mode: --/PW res: [0x2bce9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262161:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c541a0 lrc: 0/0,0 mode: --/PW res: [0x2bce9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.262162:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bce8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.262164:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c541a7 lrc: 3/0,1 mode: --/PW res: [0x2bce8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262167:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.262168:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.262168:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c541a7 lrc: 3/0,1 mode: PW/PW res: [0x2bce8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262172:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c541a7 lrc: 3/0,1 mode: PW/PW res: [0x2bce8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262174:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c541a7 lrc: 3/0,1 mode: PW/PW res: [0x2bce8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262177:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c541a7 lrc: 2/0,0 mode: PW/PW res: [0x2bce8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262186:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c541a7 lrc: 2/0,0 mode: PW/PW res: [0x2bce8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262191:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000041a7efd7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.262192:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c541a7 lrc: 2/0,0 mode: PW/PW res: [0x2bce8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262195:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c541a7 lrc: 3/0,0 mode: PW/PW res: [0x2bce8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262198:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c541a7 lrc: 1/0,0 mode: --/PW res: [0x2bce8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.262201:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bce7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529493.262201:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c541a7 lrc: 0/0,0 mode: --/PW res: [0x2bce8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262202:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c541ae lrc: 3/0,1 mode: --/PW res: [0x2bce7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262205:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.262206:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.262207:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c541ae lrc: 3/0,1 mode: PW/PW res: [0x2bce7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262210:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c541ae lrc: 3/0,1 mode: PW/PW res: [0x2bce7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262212:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c541ae lrc: 3/0,1 mode: PW/PW res: [0x2bce7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262215:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c541ae lrc: 2/0,0 mode: PW/PW res: [0x2bce7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262236:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c541ae lrc: 3/0,0 mode: PW/PW res: [0x2bce7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262239:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002e24dea3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.262240:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c541ae lrc: 2/0,0 mode: PW/PW res: [0x2bce7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262242:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c541ae lrc: 3/0,0 mode: PW/PW res: [0x2bce7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262246:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c541ae lrc: 1/0,0 mode: --/PW res: [0x2bce7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262249:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c541ae lrc: 0/0,0 mode: --/PW res: [0x2bce7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.262258:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bce6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.262259:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c541b5 lrc: 3/0,1 mode: --/PW res: [0x2bce6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262263:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.262263:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.262264:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c541b5 lrc: 3/0,1 mode: PW/PW res: [0x2bce6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262267:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c541b5 lrc: 3/0,1 mode: PW/PW res: [0x2bce6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262270:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c541b5 lrc: 3/0,1 mode: PW/PW res: [0x2bce6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262273:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c541b5 lrc: 2/0,0 mode: PW/PW res: [0x2bce6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262282:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c541b5 lrc: 2/0,0 mode: PW/PW res: [0x2bce6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262285:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000093b5c984 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.262286:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c541b5 lrc: 2/0,0 mode: PW/PW res: [0x2bce6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262289:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c541b5 lrc: 3/0,0 mode: PW/PW res: [0x2bce6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262292:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c541b5 lrc: 1/0,0 mode: --/PW res: [0x2bce6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262295:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c541b5 lrc: 0/0,0 mode: --/PW res: [0x2bce6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.262298:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bce5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.262300:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c541bc lrc: 3/0,1 mode: --/PW res: [0x2bce5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262303:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.262303:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.262304:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c541bc lrc: 3/0,1 mode: PW/PW res: [0x2bce5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262307:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c541bc lrc: 3/0,1 mode: PW/PW res: [0x2bce5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262310:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c541bc lrc: 3/0,1 mode: PW/PW res: [0x2bce5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262313:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c541bc lrc: 2/0,0 mode: PW/PW res: [0x2bce5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262322:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c541bc lrc: 2/0,0 mode: PW/PW res: [0x2bce5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262325:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001b109cb1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.262325:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c541bc lrc: 2/0,0 mode: PW/PW res: [0x2bce5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262328:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c541bc lrc: 3/0,0 mode: PW/PW res: [0x2bce5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262332:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c541bc lrc: 1/0,0 mode: --/PW res: [0x2bce5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262335:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c541bc lrc: 0/0,0 mode: --/PW res: [0x2bce5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.262337:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bce4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.262339:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c541c3 lrc: 3/0,1 mode: --/PW res: [0x2bce4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262342:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.262342:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.262343:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c541c3 lrc: 3/0,1 mode: PW/PW res: [0x2bce4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262346:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c541c3 lrc: 3/0,1 mode: PW/PW res: [0x2bce4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262349:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c541c3 lrc: 3/0,1 mode: PW/PW res: [0x2bce4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262351:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c541c3 lrc: 2/0,0 mode: PW/PW res: [0x2bce4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262360:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c541c3 lrc: 2/0,0 mode: PW/PW res: [0x2bce4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262363:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d2b9655c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.262364:0:72390:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c541c3 lrc: 2/0,0 mode: PW/PW res: [0x2bce4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262367:0:72390:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c541c3 lrc: 3/0,0 mode: PW/PW res: [0x2bce4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262370:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c541c3 lrc: 1/0,0 mode: --/PW res: [0x2bce4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262373:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c541c3 lrc: 0/0,0 mode: --/PW res: [0x2bce4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.262376:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bce3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.262377:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c541ca lrc: 3/0,1 mode: --/PW res: [0x2bce3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262382:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.262383:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.262384:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c541ca lrc: 3/0,1 mode: PW/PW res: [0x2bce3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262387:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c541ca lrc: 3/0,1 mode: PW/PW res: [0x2bce3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262389:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c541ca lrc: 3/0,1 mode: PW/PW res: [0x2bce3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262392:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c541ca lrc: 2/0,0 mode: PW/PW res: [0x2bce3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262401:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c541ca lrc: 2/0,0 mode: PW/PW res: [0x2bce3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262404:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d52cc749 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.262405:0:72389:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c541ca lrc: 2/0,0 mode: PW/PW res: [0x2bce3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262410:0:72389:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c541ca lrc: 3/0,0 mode: PW/PW res: [0x2bce3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262413:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c541ca lrc: 1/0,0 mode: --/PW res: [0x2bce3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262416:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c541ca lrc: 0/0,0 mode: --/PW res: [0x2bce3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529493.262417:0:72396:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bce2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529493.262419:0:72396:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c541d1 lrc: 3/0,1 mode: --/PW res: [0x2bce2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262422:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.262422:0:72396:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529493.262423:0:72396:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c541d1 lrc: 3/0,1 mode: PW/PW res: [0x2bce2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262426:0:72396:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c541d1 lrc: 3/0,1 mode: PW/PW res: [0x2bce2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262429:0:72396:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c541d1 lrc: 3/0,1 mode: PW/PW res: [0x2bce2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529493.262433:0:72396:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c541d1 lrc: 2/0,0 mode: PW/PW res: [0x2bce2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262442:0:73268:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c541d1 lrc: 2/0,0 mode: PW/PW res: [0x2bce2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262445:0:73268:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f616ea25 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529493.262446:0:73268:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c541d1 lrc: 2/0,0 mode: PW/PW res: [0x2bce2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262449:0:73268:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c541d1 lrc: 3/0,0 mode: PW/PW res: [0x2bce2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262452:0:73268:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c541d1 lrc: 1/0,0 mode: --/PW res: [0x2bce2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529493.262455:0:73268:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c541d1 lrc: 0/0,0 mode: --/PW res: [0x2bce2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 72396 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529493.262459:0:72396:0:(ofd_dev.c:1469:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x0:179425 00000100:00100000:1.0:1651529493.262486:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004c03f4d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:205179:x1731745946682048:12345-10.240.43.61@tcp:5:osp-pre-1-0.0 Request processed in 4502us (4560us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529493.262490:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213509 00000100:00100000:0.0:1651529493.262673:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529493.262692:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946682240 00000100:00100000:1.0:1651529493.262704:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213510 00000100:00100000:1.0:1651529493.262706:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008e33c77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:205179:x1731745946682240:12345-10.240.43.61@tcp:5:osp-pre-1-0.0 00002000:00080000:1.0:1651529493.262717:0:72396:0:(ofd_dev.c:1706:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x0 at 179490 00000100:00100000:1.0:1651529493.263171:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008e33c77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:205179:x1731745946682240:12345-10.240.43.61@tcp:5:osp-pre-1-0.0 Request processed in 464us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529493.263175:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213510 00000400:00000080:1.0:1651529494.336297:0:162976:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651529494.336300:0:162976:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: trevis-87vm5.trevis.whamcloud.com: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 00000400:00000080:0.0:1651529494.654095:0:163030:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651529494.654097:0:163030:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00000100:00100000:0.0:1651529495.264212:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529495.264241:0:72398:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946682368 00000100:00100000:0.0:1651529495.264264:0:72398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 597 00000100:00100000:0.0:1651529495.264267:0:72398:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007591e43c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946682368:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651529495.264284:0:72398:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8579392 pending 0 free 81309163520 avail 77138452480 00000100:00100000:0.0:1651529495.264308:0:72398:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007591e43c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946682368:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 41us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529495.264312:0:72398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 597 00000100:00100000:0.0:1651529495.848611:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529495.848620:0:72398:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397062272 00000100:00100000:0.0:1651529495.848635:0:72398:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 598 00000100:00100000:0.0:1651529495.848637:0:72398:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000198be7e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:434782:x1731746397062272:12345-10.240.43.64@tcp:13:lfs.0 00002000:00000024:0.0:1651529495.848643:0:72398:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8579392 pending 0 free 81309163520 avail 77138452480 00000100:00100000:0.0:1651529495.848659:0:72398:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000198be7e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:434782:x1731746397062272:12345-10.240.43.64@tcp:13:lfs.0 Request processed in 21us (49us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529495.848662:0:72398:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 598 00000100:00100000:0.0:1651529496.081453:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529496.081463:0:72396:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731746397062528 00000100:00100000:0.0:1651529496.081472:0:72396:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 213511 00000100:00100000:0.0:1651529496.081474:0:72396:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000abfc3f58 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+6:434796:x1731746397062528:12345-10.240.43.64@tcp:9:umount.0 00000020:00000080:0.0:1651529496.081484:0:72396:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0x3234de053c54011 00000100:00080000:0.0:1651529496.081487:0:72396:0:(import.c:85:import_set_state_nolock()) 00000000b2b51b7a ¶×à”ÿÿ: changing import state from FULL to CLOSED 00000001:00000004:0.0:1651529496.081504:0:72396:0:(tgt_lastrcvd.c:701:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12885081251 00000100:00100000:0.0:1651529496.081560:0:72396:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000abfc3f58 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5e20e05-95ba-4d6f-a195-0604c0c0ff53+3:434796:x1731746397062528:12345-10.240.43.64@tcp:9:umount.0 Request processed in 85us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529496.081565:0:72396:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 213511 00000001:00100000:1.0:1651529496.192359:0:72382:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a5e20e05-95ba-4d6f-a195-0604c0c0ff53 00000001:00100000:1.0:1651529496.192383:0:72382:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a5e20e05-95ba-4d6f-a195-0604c0c0ff53 00000020:00000080:1.0:1651529496.192384:0:72382:0:(genops.c:985:class_export_put()) final put 00000000509355fa/a5e20e05-95ba-4d6f-a195-0604c0c0ff53 00000001:00100000:1.0:1651529496.192391:0:72382:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a5e20e05-95ba-4d6f-a195-0604c0c0ff53 00000020:00000080:1.0:1651529496.192392:0:72382:0:(genops.c:985:class_export_put()) final put 0000000027c9d4bf/a5e20e05-95ba-4d6f-a195-0604c0c0ff53 00000001:00100000:1.0:1651529496.192396:0:72382:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1651529496.192401:0:153568:0:(genops.c:944:class_export_destroy()) destroying export 00000000509355fa/a5e20e05-95ba-4d6f-a195-0604c0c0ff53 for lustre-OST0001 00000020:00000080:1.0:1651529496.192425:0:153568:0:(genops.c:944:class_export_destroy()) destroying export 0000000027c9d4bf/a5e20e05-95ba-4d6f-a195-0604c0c0ff53 for lustre-OST0001 00000020:00000080:1.0:1651529496.192431:0:153568:0:(genops.c:1164:obd_zombie_import_free()) destroying import 00000000b2b51b7a for lustre-OST0001 00000020:00000080:1.0:1651529496.192432:0:153568:0:(genops.c:1164:obd_zombie_import_free()) destroying import 00000000d75fadd9 for lustre-OST0001 00000100:00100000:0.0:1651529496.492872:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529496.492891:0:80281:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946682880 00000100:00100000:0.0:1651529496.492910:0:80281:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 213512 00000100:00100000:0.0:1651529496.492912:0:80281:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f4f9630 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:205981:x1731745946682880:12345-10.240.43.61@tcp:9:umount.0 00000020:00000080:0.0:1651529496.492929:0:80281:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0x3234de053c53fe7 00000100:00080000:0.0:1651529496.492933:0:80281:0:(import.c:85:import_set_state_nolock()) 00000000754c6bd3 ¶×à”ÿÿ: changing import state from FULL to CLOSED 00000001:00000004:0.0:1651529496.492951:0:80281:0:(tgt_lastrcvd.c:701:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12885081251 00000100:00100000:0.0:1651529496.493011:0:80281:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f4f9630 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2:205981:x1731745946682880:12345-10.240.43.61@tcp:9:umount.0 Request processed in 98us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529496.493014:0:80281:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 213512 00000001:00100000:1.0:1651529502.361409:0:72382:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1651529502.361412:0:72382:0:(genops.c:985:class_export_put()) final put 00000000c19d32bc/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1651529502.361421:0:153568:0:(genops.c:944:class_export_destroy()) destroying export 00000000c19d32bc/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1651529502.361441:0:153568:0:(genops.c:1164:obd_zombie_import_free()) destroying import 00000000754c6bd3 for lustre-OST0001 00000100:00100000:1.0:1651529516.157299:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000036a3a267 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0b51168f-0bcb-46b1-964e-9e88a09501f8:39100:1731745997078912:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:0.0:1651529516.157299:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000f50c14a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:39099:1731745997078976:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00080000:0.0:1651529516.157669:0:39099:0:(recover.c:232:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@10.240.43.61@tcp abruptly disconnected: reconnecting 00000100:00080000:0.0:1651529516.157671:0:39099:0:(import.c:85:import_set_state_nolock()) 00000000dd3d9373 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1651529516.157674:0:39099:0:(import.c:199:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 10.240.43.61@tcp) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1651529516.160759:0:39099:0:(import.c:85:import_set_state_nolock()) 00000000dd3d9373 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1651529516.160763:0:39099:0:(import.c:533:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 10.240.43.61@tcp last attempt 20149 00000100:00080000:0.0:1651529516.160767:0:39099:0:(import.c:614:import_select_connection()) lustre-MDT0000-lwp-OST0001: import 00000000dd3d9373 using connection 10.240.43.61@tcp/10.240.43.61@tcp 00000100:00100000:0.0:1651529516.160776:0:39099:0:(import.c:806:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000009c810c14 x1731745997079040/t0(0) o38->lustre-MDT0000-lwp-OST0001@10.240.43.61@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1651529516.160786:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000f50c14a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:39099:1731745997078976:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:0.0:1651529516.160796:0:39098:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c810c14 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:39098:1731745997079040:10.240.43.61@tcp:38:ptlrpcd_00_00.0 00000100:00080000:0.0:1651529516.165453:0:39098:0:(import.c:85:import_set_state_nolock()) 00000000dd3d9373 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1651529516.165457:0:39098:0:(import.c:1428:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 10.240.43.61@tcp failed (-19) 00000100:00100000:0.0:1651529516.165459:0:39098:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c810c14 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:39098:1731745997079040:10.240.43.61@tcp:38:ptlrpcd_00_00.0 00000100:00000400:1.0:1651529523.325265:0:39100:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1651529516/real 1651529516] req@0000000036a3a267 x1731745997078912/t0(0) o400->MGC10.240.43.61@tcp@10.240.43.61@tcp:26/25 lens 224/224 e 0 to 1 dl 1651529523 ref 1 fl Rpc:XNQr/0/ffffffff rc 0/-1 job:'kworker/u4:2.0' 00000100:00080000:0.0:1651529523.325267:0:159543:0:(pinger.c:250:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1651529523.325271:0:159543:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1651529523.325273:0:159543:0:(import.c:85:import_set_state_nolock()) 00000000dd3d9373 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1651529523.325277:0:159543:0:(import.c:533:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 10.240.43.61@tcp last attempt 20174 00000100:00080000:0.0:1651529523.325278:0:159543:0:(import.c:580:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1651529523.325282:0:159543:0:(import.c:614:import_select_connection()) lustre-MDT0000-lwp-OST0001: import 00000000dd3d9373 using connection 10.240.43.61@tcp/10.240.43.61@tcp 00000100:00100000:0.0:1651529523.325297:0:159543:0:(import.c:806:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000009c810c14 x1731745997079104/t0(0) o38->lustre-MDT0000-lwp-OST0001@10.240.43.61@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1651529523.325312:0:39098:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c810c14 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:39098:1731745997079104:10.240.43.61@tcp:38:kworker/u4:2.0 00000100:00100000:1.0:1651529523.330743:0:39100:0:(client.c:2339:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@0000000036a3a267 x1731745997078912/t0(0) o400->MGC10.240.43.61@tcp@10.240.43.61@tcp:26/25 lens 224/224 e 0 to 1 dl 1651529523 ref 1 fl Rpc:XNQU/0/ffffffff rc 0/-1 job:'kworker/u4:2.0' 00000100:00080000:1.0:1651529523.330748:0:39100:0:(import.c:85:import_set_state_nolock()) 000000005bcf41a3 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1651529523.330750:0:39100:0:(import.c:205:ptlrpc_set_import_discon()) 166-1: MGC10.240.43.61@tcp: Connection to MGS (at 10.240.43.61@tcp) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1651529523.333267:0:39100:0:(import.c:211:ptlrpc_set_import_discon()) import MGS@10.240.43.61@tcp for MGC10.240.43.61@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1651529523.333268:0:39100:0:(import.c:156:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1651529523.333270:0:39100:0:(client.c:3319:ptlrpc_abort_inflight()) @@@ inflight req@0000000036a3a267 x1731745997078912/t0(0) o400->MGC10.240.43.61@tcp@10.240.43.61@tcp:26/25 lens 224/224 e 0 to 1 dl 1651529523 ref 1 fl Rpc:XNQU/0/ffffffff rc 0/-1 job:'kworker/u4:2.0' 10000000:01000000:1.0:1651529523.333276:0:39100:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1651529523.333277:0:39100:0:(pinger.c:214:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1651529523.333277:0:39100:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1651529523.333278:0:39100:0:(import.c:433:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:1.0:1651529523.333287:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000036a3a267 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0b51168f-0bcb-46b1-964e-9e88a09501f8:39100:1731745997078912:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00080000:1.0:1651529523.333303:0:159543:0:(pinger.c:250:ptlrpc_pinger_process_import()) 0b51168f-0bcb-46b1-964e-9e88a09501f8->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1651529523.333305:0:159543:0:(recover.c:57:ptlrpc_initiate_recovery()) MGS: starting recovery 00000100:00080000:1.0:1651529523.333306:0:159543:0:(import.c:85:import_set_state_nolock()) 000000005bcf41a3 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1651529523.333307:0:159543:0:(import.c:533:import_select_connection()) MGC10.240.43.61@tcp: connect to NID 10.240.43.61@tcp last attempt 20149 00000100:00080000:1.0:1651529523.333310:0:159543:0:(import.c:614:import_select_connection()) MGC10.240.43.61@tcp: import 000000005bcf41a3 using connection MGC10.240.43.61@tcp_0/10.240.43.61@tcp 00000100:00100000:1.0:1651529523.333316:0:159543:0:(import.c:806:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000020362888 x1731745997079168/t0(0) o250->MGC10.240.43.61@tcp@10.240.43.61@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1651529523.333496:0:39098:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000020362888 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0b51168f-0bcb-46b1-964e-9e88a09501f8:39098:1731745997079168:10.240.43.61@tcp:250:kworker/u4:2.0 00000020:01000004:1.0:1651529527.345822:0:163139:0:(obd_mount_server.c:1699:server_umount_begin()) umount -f 00000020:01000004:1.0:1651529527.349300:0:163139:0:(obd_mount_server.c:1591:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1651529527.349328:0:163139:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 00000000ae57075e/0x3234de053c53fee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd5ea1 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529527.349336:0:163139:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000ae57075e/0x3234de053c53fee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553dd5ea1 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529527.349340:0:163139:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000ae57075e/0x3234de053c53fee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7e7b158553dd5ea1 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529527.349343:0:163139:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC10.240.43.61@tcp lock: 00000000ae57075e/0x3234de053c53fee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7e7b158553dd5ea1 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651529527.349354:0:163139:0:(mgc_request.c:544:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1651529527.349365:0:72390:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC10.240.43.61@tcp lock: 00000000ae57075e/0x3234de053c53fee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7e7b158553dd5ea1 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00000100:00080000:1.0:1651529527.349368:0:163139:0:(import.c:156:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:0.0:1651529527.349371:0:72390:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ae57075e already unused, calling callback (0000000083828851) 10000000:00010000:0.0:1651529527.349373:0:72390:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC10.240.43.61@tcp lock: 00000000ae57075e/0x3234de053c53fee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7e7b158553dd5ea1 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529527.349374:0:163139:0:(client.c:3319:ptlrpc_abort_inflight()) @@@ inflight req@000000009c810c14 x1731745997079104/t0(0) o38->lustre-MDT0000-lwp-OST0001@10.240.43.61@tcp:12/10 lens 520/544 e 0 to 0 dl 1651529534 ref 1 fl Rpc:NQr/0/ffffffff rc 0/-1 job:'kworker/u4:2.0' 00010000:00010000:0.0:1651529527.349377:0:72390:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 00000000ae57075e/0x3234de053c53fee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7e7b158553dd5ea1 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529527.349382:0:163139:0:(client.c:2892:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1651529527.349385:0:163139:0:(pinger.c:413:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 10000000:00010000:0.0:1651529527.349386:0:72390:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 00000000ae57075e/0x3234de053c53fee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7e7b158553dd5ea1 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1651529527.349391:0:72390:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1651529527.349392:0:72390:0:(mgc_request.c:1044:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1651529527.349393:0:72390:0:(mgc_request.c:153:config_log_put()) dropping config log lustre-client 00000100:00080000:1.0:1651529527.349398:0:163139:0:(import.c:85:import_set_state_nolock()) 00000000dd3d9373 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:0.0:1651529527.349399:0:72390:0:(ldlm_request.c:1339:ldlm_cli_cancel_req()) skipping cancel on invalid import 000000005bcf41a3 00000100:00080000:1.0:1651529527.349400:0:163139:0:(import.c:156:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:0.0:1651529527.349400:0:72390:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC10.240.43.61@tcp lock: 00000000ae57075e/0x3234de053c53fee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7e7b158553dd5ea1 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529527.349401:0:163139:0:(client.c:3319:ptlrpc_abort_inflight()) @@@ inflight req@000000009c810c14 x1731745997079104/t0(0) o38->lustre-MDT0000-lwp-OST0001@10.240.43.61@tcp:12/10 lens 520/544 e 0 to 0 dl 1651529534 ref 1 fl Rpc:ENQr/0/ffffffff rc -5/-1 job:'kworker/u4:2.0' 00010000:00010000:0.0:1651529527.349403:0:72390:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 00000000ae57075e/0x3234de053c53fee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7e7b158553dd5ea1 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529527.349404:0:163139:0:(client.c:2892:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1651529527.349405:0:163139:0:(import.c:338:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:0.0:1651529527.349420:0:39098:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c810c14 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:39098:1731745997079104:10.240.43.61@tcp:38:kworker/u4:2.0 00010000:00010000:1.0:1651529527.351149:0:163139:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 000000004678bff1/0x3234de053c53ff5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd5ea8 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529527.351154:0:163139:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 000000004678bff1/0x3234de053c53ff5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553dd5ea8 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529527.351157:0:163139:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 000000004678bff1/0x3234de053c53ff5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7e7b158553dd5ea8 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529527.351159:0:163139:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC10.240.43.61@tcp lock: 000000004678bff1/0x3234de053c53ff5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7e7b158553dd5ea8 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529527.351170:0:163139:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 00000000c0de17df/0x3234de053c53ffc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd5eaf expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529527.351172:0:163139:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000c0de17df/0x3234de053c53ffc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553dd5eaf expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529527.351175:0:163139:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000c0de17df/0x3234de053c53ffc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7e7b158553dd5eaf expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529527.351177:0:163139:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC10.240.43.61@tcp lock: 00000000c0de17df/0x3234de053c53ffc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7e7b158553dd5eaf expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529527.351178:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC10.240.43.61@tcp lock: 000000004678bff1/0x3234de053c53ff5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7e7b158553dd5ea8 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529527.351181:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004678bff1 already unused, calling callback (0000000083828851) 10000000:01000000:1.0:1651529527.351183:0:163139:0:(mgc_request.c:544:config_log_end()) end config log lustre-OST0001 (0) 10000000:00010000:0.0:1651529527.351187:0:72389:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC10.240.43.61@tcp lock: 000000004678bff1/0x3234de053c53ff5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7e7b158553dd5ea8 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529527.351190:0:72389:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 000000004678bff1/0x3234de053c53ff5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x7e7b158553dd5ea8 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1651529527.351193:0:72389:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 000000004678bff1/0x3234de053c53ff5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x7e7b158553dd5ea8 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1651529527.351195:0:72389:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000020:01000004:1.0:1651529527.351196:0:163139:0:(obd_mount_server.c:1629:server_put_super()) stopping lustre-OST0001 10000000:01000000:0.0:1651529527.351196:0:72389:0:(mgc_request.c:1044:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1651529527.351196:0:72389:0:(mgc_request.c:153:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1651529527.351199:0:72389:0:(ldlm_request.c:1339:ldlm_cli_cancel_req()) skipping cancel on invalid import 000000005bcf41a3 00010000:00010000:0.0:1651529527.351200:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC10.240.43.61@tcp lock: 000000004678bff1/0x3234de053c53ff5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7e7b158553dd5ea8 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00000020:01000000:1.0:1651529527.351201:0:163139:0:(obd_config.c:2322:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00010000:00010000:0.0:1651529527.351204:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 000000004678bff1/0x3234de053c53ff5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7e7b158553dd5ea8 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529527.351208:0:72389:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC10.240.43.61@tcp lock: 00000000c0de17df/0x3234de053c53ffc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7e7b158553dd5eaf expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529527.351210:0:72389:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c0de17df already unused, calling callback (0000000083828851) 10000000:00010000:0.0:1651529527.351211:0:72389:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC10.240.43.61@tcp lock: 00000000c0de17df/0x3234de053c53ffc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7e7b158553dd5eaf expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529527.351213:0:72389:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 00000000c0de17df/0x3234de053c53ffc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x7e7b158553dd5eaf expref: -99 pid: 72392 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1651529527.351215:0:72389:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 00000000c0de17df/0x3234de053c53ffc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x7e7b158553dd5eaf expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00000020:00000080:1.0:1651529527.351216:0:163139:0:(obd_config.c:1356:class_process_config()) processing cmd: cf004 10000000:01000000:0.0:1651529527.351217:0:72389:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1651529527.351218:0:72389:0:(mgc_request.c:1044:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1651529527.351219:0:72389:0:(mgc_request.c:153:config_log_put()) dropping config log params 00010000:00010000:0.0:1651529527.351220:0:72389:0:(ldlm_request.c:1339:ldlm_cli_cancel_req()) skipping cancel on invalid import 000000005bcf41a3 00010000:00010000:0.0:1651529527.351220:0:72389:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC10.240.43.61@tcp lock: 00000000c0de17df/0x3234de053c53ffc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x7e7b158553dd5eaf expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529527.351233:0:72389:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 00000000c0de17df/0x3234de053c53ffc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x7e7b158553dd5eaf expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00000020:00000080:1.0:1651529527.351266:0:163139:0:(obd_config.c:877:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/0 00000020:00080000:1.0:1651529527.351268:0:163139:0:(genops.c:1530:class_disconnect_exports()) OBD device 3 (0000000015b1c8bf) has no exports 00000020:00080000:1.0:1651529527.351331:0:163139:0:(genops.c:1530:class_disconnect_exports()) OBD device 3 (0000000015b1c8bf) has no exports 00000020:01000000:1.0:1651529527.354922:0:163139:0:(lprocfs_status_server.c:281:lprocfs_free_client_stats()) stat 00000000909f9702 - data 00000000caeb2949/000000009416eb05 00000020:01000000:1.0:1651529527.354957:0:163139:0:(lprocfs_status_server.c:281:lprocfs_free_client_stats()) stat 000000003d265f09 - data 00000000e6ef1715/00000000919e4336 00000020:00020000:1.0:1651529527.355024:0:163139:0:(lprocfs_jobstats.c:137:job_stat_exit()) should not have any items 00000020:00020000:1.0:1651529527.358717:0:163139:0:(lprocfs_jobstats.c:137:job_stat_exit()) should not have any items 00000020:00020000:1.0:1651529527.358725:0:163139:0:(lprocfs_jobstats.c:137:job_stat_exit()) should not have any items 00000020:00020000:1.0:1651529527.358727:0:163139:0:(lprocfs_jobstats.c:137:job_stat_exit()) should not have any items 00000020:00020000:1.0:1651529527.358729:0:163139:0:(lprocfs_jobstats.c:137:job_stat_exit()) should not have any items 00000020:00020000:1.0:1651529527.358731:0:163139:0:(lprocfs_jobstats.c:137:job_stat_exit()) should not have any items 00100000:10000000:1.0:1651529527.359036:0:163139:0:(lfsck_layout.c:764:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1651529527.380797:0:163139:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0x3234de053af2ab1 00000020:00000080:1.0:1651529527.380800:0:163139:0:(genops.c:985:class_export_put()) final put 000000009e2c5080/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1651529527.380812:0:163139:0:(obd_mount_server.c:201:server_put_mount()) put mount 00000000e510b9a9 from lustre-OST0001, refs=2 00000020:01000004:1.0:1651529527.380821:0:163139:0:(obd_mount.c:668:lustre_put_lsi()) put 00000000e510b9a9 2 00000020:00000080:0.0:1651529527.380821:0:159543:0:(genops.c:944:class_export_destroy()) destroying export 000000009e2c5080/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000004:1.0:1651529527.380822:0:163139:0:(obd_mount_server.c:135:server_deregister_mount()) deregister mount 00000000e510b9a9 from lustre-OST0001 00000020:00000080:1.0:1651529527.380847:0:163139:0:(obd_config.c:1356:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1651529527.380853:0:163139:0:(obd_config.c:805:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1651529527.380855:0:163139:0:(genops.c:985:class_export_put()) final put 00000000852b8524/lustre-OST0001_UUID 00000020:00000080:1.0:1651529527.380856:0:163139:0:(genops.c:944:class_export_destroy()) destroying export 00000000852b8524/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1651529527.380861:0:163139:0:(genops.c:447:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:01000000:1.0:1651529527.380942:0:163139:0:(obd_config.c:2322:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1651529527.380944:0:163139:0:(obd_config.c:1356:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1651529527.380945:0:163139:0:(obd_config.c:877:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/2 00000020:00080000:1.0:1651529527.380947:0:163139:0:(genops.c:1752:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE 0000000019d803c6 lustre-MDT0000-lwp-OST0001 10.240.43.61@tcp 3 (0 0 0) 0 0 0 0: 0000000055bfac58 0 stale:0 00000020:00080000:1.0:1651529527.380950:0:163139:0:(genops.c:1525:class_disconnect_exports()) OBD device 4 (0000000094fa7b20) has exports, disconnecting them 00000020:00080000:1.0:1651529527.380951:0:163139:0:(genops.c:1501:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 10.240.43.61@tcp (0000000019d803c6), last request at 1651526583 00000020:00000080:1.0:1651529527.380953:0:163139:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0x3234de053af2adb 00000020:00080000:1.0:1651529527.380955:0:163139:0:(genops.c:1506:class_disconnect_export_list()) disconnected export at 10.240.43.61@tcp (0000000019d803c6): rc 0 00000020:00000080:1.0:1651529527.380966:0:163139:0:(genops.c:985:class_export_put()) final put 0000000019d803c6/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1651529527.380982:0:159543:0:(genops.c:944:class_export_destroy()) destroying export 0000000019d803c6/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1651529527.381879:0:163139:0:(obd_class.h:647:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1651529527.381881:0:163139:0:(import.c:156:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1651529527.381882:0:163139:0:(client.c:2892:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1651529527.381884:0:163139:0:(import.c:338:ptlrpc_invalidate_import()) Sleeping 100s for inflight to error out 00000020:00000080:0.0:1651529527.381900:0:159543:0:(genops.c:1164:obd_zombie_import_free()) destroying import 00000000dd3d9373 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1651529527.381945:0:163139:0:(obd_config.c:1356:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1651529527.381946:0:163139:0:(obd_config.c:805:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1651529527.381947:0:163139:0:(genops.c:985:class_export_put()) final put 000000000507e7b8/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1651529527.381948:0:163139:0:(genops.c:944:class_export_destroy()) destroying export 000000000507e7b8/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1651529527.381950:0:163139:0:(genops.c:447:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1651529527.381959:0:163139:0:(obd_mount.c:926:lustre_common_put_super()) dropping sb 00000000e510b9a9 00000100:00080000:1.0:1651529527.381962:0:163139:0:(pinger.c:413:ptlrpc_pinger_del_import()) removing pingable import 0b51168f-0bcb-46b1-964e-9e88a09501f8->MGS 00010000:00010000:1.0:1651529527.381966:0:163139:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 0000000029b2a516/0x3234de053c54003 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7e7b158553dd5eb6 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1651529527.381970:0:163139:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 0000000029b2a516/0x3234de053c54003 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7e7b158553dd5eb6 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651529527.381973:0:163139:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1651529527.381974:0:163139:0:(mgc_request.c:1053:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1651529527.381974:0:163139:0:(mgc_request.c:153:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1651529527.381977:0:163139:0:(ldlm_request.c:1339:ldlm_cli_cancel_req()) skipping cancel on invalid import 000000005bcf41a3 00010000:00010000:1.0:1651529527.381978:0:163139:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 0000000029b2a516/0x3234de053c54003 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7e7b158553dd5eb6 expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529527.381982:0:163139:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 00000000d84ad17b/0x3234de053c5400a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7e7b158553dd5ebd expref: -99 pid: 72392 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1651529527.381985:0:163139:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 00000000d84ad17b/0x3234de053c5400a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7e7b158553dd5ebd expref: -99 pid: 72392 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651529527.381987:0:163139:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1651529527.381988:0:163139:0:(mgc_request.c:1053:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1651529527.381988:0:163139:0:(mgc_request.c:153:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1651529527.381991:0:163139:0:(ldlm_request.c:1339:ldlm_cli_cancel_req()) skipping cancel on invalid import 000000005bcf41a3 00010000:00010000:1.0:1651529527.381991:0:163139:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 00000000d84ad17b/0x3234de053c5400a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7e7b158553dd5ebd expref: -99 pid: 72392 timeout: 0 lvb_type: 0 00000100:00080000:1.0:1651529527.382003:0:163139:0:(import.c:85:import_set_state_nolock()) 000000005bcf41a3 MGS: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1651529527.382004:0:163139:0:(import.c:156:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1651529527.382006:0:163139:0:(client.c:3319:ptlrpc_abort_inflight()) @@@ inflight req@0000000020362888 x1731745997079168/t0(0) o250->MGC10.240.43.61@tcp@10.240.43.61@tcp:26/25 lens 520/544 e 0 to 0 dl 1651529529 ref 1 fl Rpc:NQr/0/ffffffff rc 0/-1 job:'kworker/u4:2.0' 10000000:01000000:1.0:1651529527.382017:0:163139:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1651529527.382018:0:163139:0:(import.c:338:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:0.0:1651529527.382030:0:39098:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000020362888 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0b51168f-0bcb-46b1-964e-9e88a09501f8:39098:1731745997079168:10.240.43.61@tcp:250:kworker/u4:2.0 10000000:01000000:1.0:1651529527.382930:0:163139:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1651529527.382934:0:163139:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0x3234de053af2a87 00000020:00000080:1.0:1651529527.382936:0:163139:0:(genops.c:985:class_export_put()) final put 00000000f62aa17f/0b51168f-0bcb-46b1-964e-9e88a09501f8 00000020:01000000:1.0:1651529527.382944:0:163139:0:(obd_config.c:2322:class_manual_cleanup()) Manual cleanup of MGC10.240.43.61@tcp (flags='') 00000020:00000080:1.0:1651529527.382946:0:163139:0:(obd_config.c:1356:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1651529527.382948:0:163139:0:(obd_config.c:877:class_cleanup()) MGC10.240.43.61@tcp: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1651529527.382949:0:163139:0:(genops.c:1530:class_disconnect_exports()) OBD device 1 (00000000e5be49b0) has no exports 00000020:00000080:0.0:1651529527.382958:0:159543:0:(genops.c:944:class_export_destroy()) destroying export 00000000f62aa17f/0b51168f-0bcb-46b1-964e-9e88a09501f8 for MGC10.240.43.61@tcp 10000000:01000000:0.0:1651529527.382969:0:72392:0:(mgc_request.c:704:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1651529527.382980:0:163139:0:(obd_class.h:647:obd_cleanup_client_import()) MGC10.240.43.61@tcp: client import never connected 00000100:00080000:1.0:1651529527.382981:0:163139:0:(import.c:156:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1651529527.382982:0:163139:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1651529527.382983:0:163139:0:(import.c:338:ptlrpc_invalidate_import()) Sleeping 100s for inflight to error out 10000000:01000000:1.0:1651529527.382984:0:163139:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1651529527.383012:0:159543:0:(genops.c:1164:obd_zombie_import_free()) destroying import 000000005bcf41a3 for MGC10.240.43.61@tcp 00000020:00000080:1.0:1651529527.383014:0:163139:0:(obd_config.c:1356:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1651529527.383015:0:163139:0:(obd_config.c:805:class_detach()) detach on obd MGC10.240.43.61@tcp (uuid 0b51168f-0bcb-46b1-964e-9e88a09501f8) 00000020:00000080:1.0:1651529527.383016:0:163139:0:(genops.c:985:class_export_put()) final put 000000009a2c0915/0b51168f-0bcb-46b1-964e-9e88a09501f8 00000020:00000080:1.0:1651529527.383018:0:163139:0:(genops.c:944:class_export_destroy()) destroying export 000000009a2c0915/0b51168f-0bcb-46b1-964e-9e88a09501f8 for MGC10.240.43.61@tcp 00000020:01000000:1.0:1651529527.383020:0:163139:0:(genops.c:447:class_free_dev()) finishing cleanup of obd MGC10.240.43.61@tcp (0b51168f-0bcb-46b1-964e-9e88a09501f8) 00000100:00100000:0.0:1651529527.383413:0:72384:0:(service.c:2915:ptlrpc_main()) ldlm_cb00_000: service thread [00000000fecca588:72384] 0 exiting: rc = 1 00000100:00100000:1.0:1651529527.383421:0:73099:0:(service.c:2915:ptlrpc_main()) ldlm_cb00_002: service thread [00000000ca6fdc29:73099] 2 exiting: rc = 0 00000100:00100000:0.0:1651529527.383481:0:72385:0:(service.c:2915:ptlrpc_main()) ldlm_cb00_001: service thread [000000005b703514:72385] 1 exiting: rc = 0 00000100:00100000:1.0:1651529527.383506:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.383717:0:72386:0:(service.c:2915:ptlrpc_main()) ldlm_cn00_000: service thread [000000004a10487a:72386] 0 exiting: rc = 1 00000100:00100000:0.0:1651529527.383727:0:72387:0:(service.c:2915:ptlrpc_main()) ldlm_cn00_001: service thread [0000000043d19f65:72387] 1 exiting: rc = 0 00000100:00100000:0.0:1651529527.383793:0:72388:0:(service.c:2915:ptlrpc_main()) ldlm_cn00_002: service thread [00000000c6ceaca1:72388] 2 exiting: rc = 0 00000100:00100000:1.0:1651529527.383796:0:80282:0:(service.c:2915:ptlrpc_main()) ldlm_cn00_003: service thread [00000000ab0d2cc4:80282] 3 exiting: rc = 0 00000100:00100000:1.0:1651529527.383895:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.383898:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.383901:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.383903:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.383906:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.383908:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.383910:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.383913:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.383915:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.383917:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.383919:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.383922:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.383924:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.383927:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.383929:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.383931:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.383934:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.383936:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.383938:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.383940:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.383943:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.383945:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.383947:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.383949:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.383951:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.383954:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.383956:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.383958:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.383960:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.383963:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.383965:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.383967:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.383969:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.383972:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.383974:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.383976:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.383979:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.383981:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.383983:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.383985:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.383987:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.383989:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.383991:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.383993:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.383996:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.383998:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.384000:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.384002:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.384004:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.384006:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.384008:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.384010:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.384012:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.384014:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.384016:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.384018:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.384020:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.384022:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.384024:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.384026:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.384028:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.384030:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.384032:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.384035:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1651529527.384806:0:163139:0:(obd_config.c:1356:class_process_config()) processing cmd: cf006 00000020:00000080:1.0:1651529527.384806:0:163139:0:(obd_config.c:1377:class_process_config()) removing mappings for uuid MGC10.240.43.61@tcp_0 00000020:01000004:1.0:1651529527.384816:0:163139:0:(obd_mount.c:668:lustre_put_lsi()) put 00000000e510b9a9 1 00000020:00000080:1.0:1651529527.384818:0:163139:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0x3234de053af2a79 00000020:00000080:1.0:1651529527.384820:0:163139:0:(genops.c:985:class_export_put()) final put 000000006aa2e4b5/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1651529527.384826:0:163139:0:(obd_config.c:2322:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1651529527.384828:0:163139:0:(obd_config.c:1356:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1651529527.384839:0:163139:0:(obd_config.c:877:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1651529527.384840:0:163139:0:(genops.c:1530:class_disconnect_exports()) OBD device 0 (00000000441124c0) has no exports 00000020:00000080:0.0:1651529527.384844:0:159543:0:(genops.c:944:class_export_destroy()) destroying export 000000006aa2e4b5/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1651529527.386196:0:163139:0:(obd_config.c:1356:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1651529527.386198:0:163139:0:(obd_config.c:805:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1651529527.386199:0:163139:0:(genops.c:985:class_export_put()) final put 000000005ad4e4b1/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1651529527.386200:0:163139:0:(genops.c:944:class_export_destroy()) destroying export 000000005ad4e4b1/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1651529527.386201:0:163139:0:(genops.c:447:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1651529527.387384:0:163139:0:(obd_mount.c:608:lustre_free_lsi()) Freeing lsi 000000007744f891 00000020:01000000:1.0:1651529527.387405:0:163139:0:(obd_config.c:2322:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1651529527.387406:0:163139:0:(obd_config.c:1356:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1651529527.387411:0:163139:0:(obd_config.c:877:class_cleanup()) OSS: forcing exports to disconnect: 0/0 00000020:00080000:1.0:1651529527.387412:0:163139:0:(genops.c:1530:class_disconnect_exports()) OBD device 2 (0000000099cd1bfe) has no exports 00000020:00000080:1.0:1651529527.387432:0:163139:0:(obd_config.c:1356:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1651529527.387433:0:163139:0:(obd_config.c:805:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1651529527.387434:0:163139:0:(genops.c:985:class_export_put()) final put 00000000aa2b7f22/OSS_uuid 00000020:00000080:1.0:1651529527.387435:0:163139:0:(genops.c:944:class_export_destroy()) destroying export 00000000aa2b7f22/OSS_uuid for OSS 00000020:01000000:1.0:1651529527.387436:0:163139:0:(genops.c:447:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1651529527.387486:0:72407:0:(pinger.c:538:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1651529527.387494:0:80281:0:(service.c:2915:ptlrpc_main()) ll_ost00_008: service thread [0000000034d555bf:80281] 8 exiting: rc = 0 00000100:00100000:1.0:1651529527.387538:0:72397:0:(service.c:2915:ptlrpc_main()) ll_ost00_002: service thread [000000008272e727:72397] 2 exiting: rc = 0 00000100:00100000:0.0:1651529527.387542:0:72396:0:(service.c:2915:ptlrpc_main()) ll_ost00_001: service thread [000000002a274c59:72396] 1 exiting: rc = 0 00000100:00100000:1.0:1651529527.387584:0:80280:0:(service.c:2915:ptlrpc_main()) ll_ost00_007: service thread [0000000063e2da8e:80280] 7 exiting: rc = 0 00000100:00100000:0.0:1651529527.387589:0:156655:0:(service.c:2915:ptlrpc_main()) ll_ost00_011: service thread [00000000cb3dc7fe:156655] 11 exiting: rc = 0 00000100:00100000:1.0:1651529527.387620:0:151609:0:(service.c:2915:ptlrpc_main()) ll_ost00_010: service thread [0000000079bbeaf5:151609] 10 exiting: rc = 0 00000100:00100000:0.0:1651529527.387623:0:80276:0:(service.c:2915:ptlrpc_main()) ll_ost00_003: service thread [000000009fcc6680:80276] 3 exiting: rc = 0 00000100:00100000:1.0:1651529527.387655:0:106695:0:(service.c:2915:ptlrpc_main()) ll_ost00_009: service thread [00000000ba4239f5:106695] 9 exiting: rc = 0 00000100:00100000:0.0:1651529527.387667:0:80278:0:(service.c:2915:ptlrpc_main()) ll_ost00_005: service thread [00000000b8cb0894:80278] 5 exiting: rc = 0 00000100:00100000:1.0:1651529527.387704:0:80277:0:(service.c:2915:ptlrpc_main()) ll_ost00_004: service thread [00000000109c0e79:80277] 4 exiting: rc = 0 00000100:00100000:1.0:1651529527.387732:0:80279:0:(service.c:2915:ptlrpc_main()) ll_ost00_006: service thread [00000000a54dc2ab:80279] 6 exiting: rc = 0 00000100:00100000:1.0:1651529527.387760:0:72395:0:(service.c:2915:ptlrpc_main()) ll_ost00_000: service thread [00000000fa0f239e:72395] 0 exiting: rc = 1 00000100:00100000:1.0:1651529527.387971:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.387974:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.387976:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.387978:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.387981:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.387983:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.387985:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.387987:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.387989:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.387992:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.387994:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.387996:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.387999:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.388003:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.388005:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.388008:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.388010:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.388013:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.388015:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.388017:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.388019:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.388022:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.388024:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.388026:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.388029:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.388031:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.388033:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.388035:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.388037:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.388039:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.388041:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.388043:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.388045:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.388047:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.388049:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.388052:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.388054:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.388056:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.388058:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.388060:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.388062:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.388064:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.388066:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.388069:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.388071:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.388073:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.388075:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.388078:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.388080:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.388082:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.388084:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.388087:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.388089:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.388091:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.388093:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.388096:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.388098:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.388100:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.388103:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.388105:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.388108:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.388110:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.388113:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.388115:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389585:0:87247:0:(service.c:2915:ptlrpc_main()) ll_ost_create00_002: service thread [00000000b1ade06b:87247] 2 exiting: rc = 0 00000100:00100000:0.0:1651529527.389587:0:72398:0:(service.c:2915:ptlrpc_main()) ll_ost_create00_000: service thread [00000000242b8df7:72398] 0 exiting: rc = 1 00000100:00100000:1.0:1651529527.389645:0:72399:0:(service.c:2915:ptlrpc_main()) ll_ost_create00_001: service thread [0000000039cb19bd:72399] 1 exiting: rc = 0 00000100:00100000:1.0:1651529527.389723:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389726:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389728:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389740:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389743:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389745:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389752:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389754:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389757:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389763:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389769:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389775:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389782:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389784:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389790:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389799:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389801:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389803:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389806:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389808:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389814:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389816:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389822:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389824:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389826:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389839:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389846:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389852:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389858:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389860:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389862:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389868:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389870:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389876:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389878:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389879:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389886:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389892:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389893:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389895:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389897:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389903:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389909:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389911:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389917:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389923:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389929:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389935:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389937:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389942:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389948:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389950:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389952:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389954:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389956:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389958:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389959:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389961:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389967:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389974:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389976:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389978:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389980:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.389982:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.393332:0:77223:0:(service.c:2915:ptlrpc_main()) ll_ost_io00_011: service thread [000000008fd7cd6c:77223] 11 exiting: rc = 0 00000100:00100000:1.0:1651529527.393346:0:72401:0:(service.c:2915:ptlrpc_main()) ll_ost_io00_001: service thread [0000000046dffdf2:72401] 1 exiting: rc = 0 00000100:00100000:1.0:1651529527.394437:0:77217:0:(service.c:2915:ptlrpc_main()) ll_ost_io00_005: service thread [00000000ecdfda06:77217] 5 exiting: rc = 0 00000100:00100000:0.0:1651529527.394438:0:76182:0:(service.c:2915:ptlrpc_main()) ll_ost_io00_004: service thread [00000000663e4895:76182] 4 exiting: rc = 0 00000100:00100000:1.0:1651529527.395463:0:77221:0:(service.c:2915:ptlrpc_main()) ll_ost_io00_009: service thread [0000000080fa44cc:77221] 9 exiting: rc = 0 00000100:00100000:0.0:1651529527.395479:0:76181:0:(service.c:2915:ptlrpc_main()) ll_ost_io00_003: service thread [00000000475a437c:76181] 3 exiting: rc = 0 00000100:00100000:0.0:1651529527.396515:0:77219:0:(service.c:2915:ptlrpc_main()) ll_ost_io00_007: service thread [000000008424dd37:77219] 7 exiting: rc = 0 00000100:00100000:1.0:1651529527.396522:0:77222:0:(service.c:2915:ptlrpc_main()) ll_ost_io00_010: service thread [00000000102003ba:77222] 10 exiting: rc = 0 00000100:00100000:0.0:1651529527.397554:0:77218:0:(service.c:2915:ptlrpc_main()) ll_ost_io00_006: service thread [000000005d32bff1:77218] 6 exiting: rc = 0 00000100:00100000:1.0:1651529527.397594:0:77220:0:(service.c:2915:ptlrpc_main()) ll_ost_io00_008: service thread [00000000d17aba39:77220] 8 exiting: rc = 0 00000100:00100000:0.0:1651529527.398611:0:72402:0:(service.c:2915:ptlrpc_main()) ll_ost_io00_002: service thread [00000000ceb3f8fb:72402] 2 exiting: rc = 0 00000100:00100000:1.0:1651529527.398649:0:72400:0:(service.c:2915:ptlrpc_main()) ll_ost_io00_000: service thread [000000004f875716:72400] 0 exiting: rc = 1 00000100:00100000:1.0:1651529527.398802:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.398811:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.398813:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.398820:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.398828:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.398841:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.398847:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.398851:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.398858:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.398860:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.398867:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.398873:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.398876:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.398882:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.398889:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.398891:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.398893:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.398895:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.398898:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.398900:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.398903:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.398906:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.398913:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.398920:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.398926:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.398933:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.398935:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.398938:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.398944:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.398951:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.398958:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.398960:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.398963:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.398969:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.398979:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.398983:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.398989:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.398996:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.399002:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.399004:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.399011:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.399017:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.399023:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.399025:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.399027:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.399030:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.399036:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.399038:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.399044:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.399046:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.399048:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.399050:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.399057:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.399063:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.399065:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.399067:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.399069:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.399075:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.399077:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.399083:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.399085:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.399087:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.399089:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529527.399091:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433437:0:72404:0:(service.c:2915:ptlrpc_main()) ll_ost_seq00_001: service thread [00000000819c4f0d:72404] 1 exiting: rc = 0 00000100:00100000:1.0:1651529527.433440:0:72403:0:(service.c:2915:ptlrpc_main()) ll_ost_seq00_000: service thread [000000003620314e:72403] 0 exiting: rc = 1 00000100:00100000:0.0:1651529527.433603:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433607:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433609:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433616:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433623:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433629:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433636:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433642:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433649:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433651:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433657:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433663:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433665:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433667:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433668:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433670:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433672:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433674:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433676:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433682:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433688:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433695:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433701:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433703:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433705:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433711:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433713:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433719:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433721:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433723:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433729:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433735:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433737:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433739:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433741:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433748:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433761:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433768:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433774:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433776:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433782:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433789:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433791:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433793:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433795:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433797:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433802:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433804:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433810:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433813:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433814:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433821:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433827:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433843:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433850:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433852:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433854:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433860:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433866:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433872:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433878:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433880:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433882:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.433884:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436196:0:72405:0:(service.c:2915:ptlrpc_main()) ll_ost_out00_000: service thread [00000000cc1bb6ce:72405] 0 exiting: rc = 1 00000100:00100000:1.0:1651529527.436197:0:110845:0:(service.c:2915:ptlrpc_main()) ll_ost_out00_002: service thread [00000000d7a126f9:110845] 2 exiting: rc = 0 00000100:00100000:0.0:1651529527.436261:0:72406:0:(service.c:2915:ptlrpc_main()) ll_ost_out00_001: service thread [000000002ba74bbf:72406] 1 exiting: rc = 0 00000100:00100000:0.0:1651529527.436362:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436373:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436381:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436387:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436394:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436403:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436413:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436423:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436433:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436442:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436452:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436462:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436468:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436474:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436480:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436486:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436496:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436506:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436512:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436519:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436526:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436536:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436545:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436552:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436561:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436571:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436580:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436586:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436592:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436598:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436608:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436622:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436632:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436638:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436644:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436650:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436656:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436666:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436675:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436685:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436694:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436704:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436710:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436717:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436723:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436733:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436742:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436752:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436758:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436764:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436770:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436776:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436783:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436792:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436798:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436805:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436815:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436821:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436830:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436843:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436849:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436855:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436861:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529527.436868:0:163139:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1651529527.503219:0:163139:0:(obd_mount_server.c:1687:server_put_super()) server umount lustre-OST0001 complete 00000400:00000100:0.0:1651529536.985778:0:39093:0:(lib-move.c:4234:lnet_parse_put()) Dropping PUT from 12345-10.240.43.61@tcp portal 28 match 1731745946683840 offset 0 length 520: 4 00000400:00000100:0.0:1651529542.368258:0:39094:0:(lib-move.c:4234:lnet_parse_put()) Dropping PUT from 12345-10.240.43.61@tcp portal 28 match 1731745946685824 offset 0 length 520: 4 00000080:01200004:0.0:1651529545.640648:0:164150:0:(super25.c:114:lustre_fill_super()) VFS Op: sb 00000000f465a35f 00000020:01000004:0.0:1651529545.640674:0:164150:0:(obd_mount.c:952:lmd_print()) mount data: 00000020:01000004:0.0:1651529545.640675:0:164150:0:(obd_mount.c:955:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1651529545.640675:0:164150:0:(obd_mount.c:956:lmd_print()) flags: 0 00000020:01000004:0.0:1651529545.640676:0:164150:0:(obd_mount.c:959:lmd_print()) options: errors=remount-ro 00000020:01000004:0.0:1651529545.640686:0:164150:0:(obd_mount_server.c:1916:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1651529545.640718:0:164150:0:(obd_mount.c:191:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1651529545.640721:0:164150:0:(obd_config.c:1356:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1651529545.640727:0:164150:0:(genops.c:417:class_newdev()) Allocate new device lustre-OST0001-osd (0000000099cd1bfe) 00000020:00000080:0.0:1651529545.640757:0:164150:0:(obd_config.c:648:class_attach()) OBD: dev 0 attached type osd-ldiskfs with refcount 1 00000020:00000080:0.0:1651529545.640759:0:164150:0:(obd_config.c:1356:class_process_config()) processing cmd: cf003 00100000:10000000:0.0:1651529545.665034:0:164150:0:(osd_scrub.c:1715:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1651529545.665320:0:164150:0:(osd_scrub.c:1715:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1651529545.665401:0:164150:0:(osd_scrub.c:1715:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1651529545.665541:0:164150:0:(osd_scrub.c:1715:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1651529545.665620:0:164150:0:(osd_scrub.c:1715:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1651529545.665697:0:164150:0:(osd_scrub.c:1715:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1651529545.665776:0:164150:0:(osd_scrub.c:1715:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:0.0:1651529545.666622:0:164150:0:(osd_lproc.c:834:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1651529545.666703:0:164150:0:(obd_config.c:752:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1651529545.666705:0:164150:0:(osd_handler.c:8440:osd_obd_connect()) connect #0 00000020:00000080:0.0:1651529545.666712:0:164150:0:(genops.c:1359:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x3234de053c541df 00000020:01000004:0.0:1651529545.666714:0:164150:0:(obd_mount_server.c:1999:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1651529545.666774:0:164150:0:(obd_mount.c:340:lustre_start_mgc()) Start MGC 'MGC10.240.43.61@tcp' 00000020:01000004:0.0:1651529545.666776:0:164150:0:(obd_mount.c:347:lustre_start_mgc()) mgs NIDs 10.240.43.61@tcp. 00000020:00000080:0.0:1651529545.666777:0:164150:0:(obd_config.c:1356:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1651529545.666779:0:164150:0:(obd_config.c:1368:class_process_config()) adding mapping from uuid MGC10.240.43.61@tcp_0 to nid 0x200000af02b3d (10.240.43.61@tcp) 00000020:01000004:0.0:1651529545.666795:0:164150:0:(obd_mount.c:191:lustre_start_simple()) Starting OBD MGC10.240.43.61@tcp (typ=mgc) 00000020:00000080:0.0:1651529545.666796:0:164150:0:(obd_config.c:1356:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1651529545.666804:0:164150:0:(genops.c:417:class_newdev()) Allocate new device MGC10.240.43.61@tcp (00000000442d66cc) 00000020:00000080:0.0:1651529545.666833:0:164150:0:(obd_config.c:648:class_attach()) OBD: dev 1 attached type mgc with refcount 1 00000020:00000080:0.0:1651529545.666834:0:164150:0:(obd_config.c:1356:class_process_config()) processing cmd: cf003 00000100:00100000:0.0:1651529545.666905:0:164150:0:(service.c:172:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1651529545.666969:0:164150:0:(service.c:3189:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 40 00000100:00100000:0.0:1651529545.666971:0:164150:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1651529545.667053:0:164150:0:(service.c:3189:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 40 00000100:00100000:0.0:1651529545.667056:0:164150:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1651529545.667446:0:164150:0:(service.c:172:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1651529545.667487:0:164150:0:(service.c:3189:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 40 00000100:00100000:0.0:1651529545.667489:0:164150:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1651529545.667882:0:164150:0:(service.c:3189:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 40 00000100:00100000:0.0:1651529545.667884:0:164150:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1651529545.668232:0:164150:0:(service.c:3189:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 40 00000100:00100000:0.0:1651529545.668235:0:164150:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00080000:0.0:1651529545.669596:0:164150:0:(ldlm_lib.c:115:import_set_conn()) imp 00000000a93ceb27@MGC10.240.43.61@tcp: add connection MGC10.240.43.61@tcp_0 at head 00010000:00010000:0.0:1651529545.669634:0:164150:0:(ldlm_pool.c:932:ldlm_pool_init()) Lock pool ldlm-pool-MGC10.240.43.61@tcp-0 is initialized 00000040:01000000:0.0:1651529545.669649:0:164150:0:(llog_obd.c:212:llog_setup()) obd MGC10.240.43.61@tcp ctxt 1 is initialized 10000000:01000000:1.0:1651529545.671871:0:164163:0:(mgc_request.c:628:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1651529545.671894:0:164150:0:(obd_config.c:752:class_setup()) finished setup of obd MGC10.240.43.61@tcp (uuid 80ea30fd-09f1-4f9c-9e17-5deadaf30925) 00000020:00000080:0.0:1651529545.671917:0:164150:0:(genops.c:1359:class_connect()) connect: client 80ea30fd-09f1-4f9c-9e17-5deadaf30925, cookie 0x3234de053c541ed 00000100:00080000:0.0:1651529545.671921:0:164150:0:(import.c:533:import_select_connection()) MGC10.240.43.61@tcp: connect to NID 10.240.43.61@tcp last attempt 0 00000100:00080000:0.0:1651529545.671924:0:164150:0:(import.c:614:import_select_connection()) MGC10.240.43.61@tcp: import 00000000a93ceb27 using connection MGC10.240.43.61@tcp_0/10.240.43.61@tcp 00000100:00100000:0.0:1651529545.671937:0:164150:0:(import.c:806:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000009c810c14 x1731745997079360/t0(0) o250->MGC10.240.43.61@tcp@10.240.43.61@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1651529545.671951:0:164150:0:(pinger.c:388:ptlrpc_pinger_add_import()) adding pingable import 80ea30fd-09f1-4f9c-9e17-5deadaf30925->MGS 00000020:01000004:0.0:1651529545.671964:0:164150:0:(obd_mount_server.c:1354:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1651529545.671990:0:164150:0:(obd_mount.c:191:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1651529545.671991:0:164150:0:(obd_config.c:1356:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1651529545.671995:0:164150:0:(genops.c:417:class_newdev()) Allocate new device OSS (00000000b5e079cd) 00000020:00000080:0.0:1651529545.672024:0:164150:0:(obd_config.c:648:class_attach()) OBD: dev 2 attached type ost with refcount 1 00000020:00000080:0.0:1651529545.672025:0:164150:0:(obd_config.c:1356:class_process_config()) processing cmd: cf003 00000100:00100000:1.0:1651529545.672263:0:39098:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c810c14 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:80ea30fd-09f1-4f9c-9e17-5deadaf30925:39098:1731745997079360:10.240.43.61@tcp:250:mount.lustre.0 00000100:00100000:0.0:1651529545.672493:0:164150:0:(service.c:172:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1651529545.672532:0:164150:0:(service.c:3189:ptlrpc_start_thread()) ost[0] started 0 min 3 max 80 00000100:00100000:0.0:1651529545.672534:0:164150:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1651529545.673871:0:39098:0:(client.c:2892:ptlrpc_free_committed()) MGC10.240.43.61@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1651529545.673876:0:39098:0:(import.c:1073:ptlrpc_connect_interpret()) MGC10.240.43.61@tcp: connect to target with instance 0 00000100:00080000:1.0:1651529545.673878:0:39098:0:(import.c:933:ptlrpc_connect_set_flags()) MGC10.240.43.61@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002020 10000000:01000000:1.0:1651529545.673880:0:39098:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1651529545.673882:0:39098:0:(import.c:85:import_set_state_nolock()) 00000000a93ceb27 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1651529545.673883:0:39098:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1651529545.673886:0:39098:0:(pinger.c:207:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1651529545.673889:0:39098:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c810c14 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:80ea30fd-09f1-4f9c-9e17-5deadaf30925:39098:1731745997079360:10.240.43.61@tcp:250:mount.lustre.0 00000100:00100000:0.0:1651529545.673967:0:164150:0:(service.c:3189:ptlrpc_start_thread()) ost[0] started 1 min 3 max 80 00000100:00100000:0.0:1651529545.673970:0:164150:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1651529545.674047:0:164150:0:(service.c:3189:ptlrpc_start_thread()) ost[0] started 2 min 3 max 80 00000100:00100000:0.0:1651529545.674049:0:164150:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1651529545.675835:0:164150:0:(service.c:172:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1651529545.675883:0:164150:0:(service.c:3189:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 10 00000100:00100000:0.0:1651529545.675885:0:164150:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1651529545.676298:0:164150:0:(service.c:3189:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 10 00000100:00100000:0.0:1651529545.676301:0:164150:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1651529545.682608:0:164150:0:(service.c:172:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1651529545.682710:0:164150:0:(service.c:3189:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 80 00000100:00100000:0.0:1651529545.682713:0:164150:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1651529545.683776:0:164150:0:(service.c:3189:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 80 00000100:00100000:0.0:1651529545.683779:0:164150:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1651529545.684365:0:164150:0:(service.c:3189:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 80 00000100:00100000:0.0:1651529545.684369:0:164150:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1651529545.686813:0:164150:0:(service.c:172:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1651529545.686866:0:164150:0:(service.c:3189:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 10 00000100:00100000:0.0:1651529545.686868:0:164150:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1651529545.687278:0:164150:0:(service.c:3189:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 10 00000100:00100000:0.0:1651529545.687281:0:164150:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1651529545.699332:0:164150:0:(service.c:172:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1651529545.699417:0:164150:0:(service.c:3189:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 10 00000100:00100000:0.0:1651529545.699420:0:164150:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1651529545.700278:0:164150:0:(service.c:3189:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 10 00000100:00100000:0.0:1651529545.700281:0:164150:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1651529545.700759:0:164150:0:(obd_config.c:752:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1651529545.700776:0:164150:0:(obd_mount_server.c:294:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 00000100:00080000:1.0:1651529545.701008:0:164177:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 00000040:01000000:0.0:1651529545.702060:0:164150:0:(llog_obd.c:212:llog_setup()) obd MGC10.240.43.61@tcp ctxt 0 is initialized 00000020:01000004:0.0:1651529545.702070:0:164150:0:(obd_mount_server.c:1245:server_register_target()) Registration lustre-OST0001, fs=lustre, 10.240.43.63@tcp, index=0001, flags=0x2 10000000:01000000:0.0:1651529545.702080:0:164150:0:(mgc_request.c:1239:mgc_set_info_async()) register_target lustre-OST0001 0x10000002 10000000:01000000:0.0:1651529545.702093:0:164150:0:(mgc_request.c:1175:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1651529545.702102:0:164150:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000f50c14a pname:cluuid:pid:xid:nid:opc:job mount.lustre:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164150:1731745997079424:10.240.43.61@tcp:253:mount.lustre.0 00000100:00100000:0.0:1651529545.702137:0:164150:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c75e1cd5 going to sleep for 6 seconds 00000100:00100000:0.0:1651529545.703612:0:164150:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000f50c14a pname:cluuid:pid:xid:nid:opc:job mount.lustre:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164150:1731745997079424:10.240.43.61@tcp:253:mount.lustre.0 10000000:01000000:0.0:1651529545.703617:0:164150:0:(mgc_request.c:1195:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1651529545.703632:0:164150:0:(obd_mount_server.c:116:server_register_mount()) register mount 00000000f465a35f from lustre-OST0001 10000000:01000000:0.0:1651529545.703635:0:164150:0:(mgc_request.c:2205:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1651529545.703636:0:164150:0:(mgc_request.c:334:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1651529545.703638:0:164150:0:(mgc_request.c:215:do_config_log_add()) do adding config log lustre-sptlrpc-ffff94e0d2ad4820 10000000:01000000:0.0:1651529545.703639:0:164150:0:(mgc_request.c:90:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1651529545.703642:0:164150:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff94e0d2ad4820 from 1 10000000:01000000:0.0:1651529545.703643:0:164150:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1651529545.703655:0:164150:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 00000000c0de17df/0x3234de053c541fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529545.703660:0:164150:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 00000000c0de17df/0x3234de053c541fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529545.703664:0:164150:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 00000000c0de17df/0x3234de053c541fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529545.703670:0:164150:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000f50c14a pname:cluuid:pid:xid:nid:opc:job mount.lustre:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164150:1731745997079488:10.240.43.61@tcp:101:mount.lustre.0 00000100:00100000:0.0:1651529545.703683:0:164150:0:(client.c:2492:ptlrpc_set_wait()) set 0000000022272409 going to sleep for 6 seconds 00000100:00100000:0.0:1651529545.703914:0:164150:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000f50c14a pname:cluuid:pid:xid:nid:opc:job mount.lustre:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164150:1731745997079488:10.240.43.61@tcp:101:mount.lustre.0 00010000:00010000:0.0:1651529545.703922:0:164150:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 00000000c0de17df/0x3234de053c541fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd608b expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529545.703926:0:164150:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 00000000c0de17df/0x3234de053c541fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553dd608b expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529545.703946:0:164150:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000f50c14a pname:cluuid:pid:xid:nid:opc:job mount.lustre:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164150:1731745997079552:10.240.43.61@tcp:501:mount.lustre.0 00000100:00100000:0.0:1651529545.703957:0:164150:0:(client.c:2492:ptlrpc_set_wait()) set 0000000022272409 going to sleep for 6 seconds 00000100:00100000:0.0:1651529545.704169:0:164150:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000f50c14a pname:cluuid:pid:xid:nid:opc:job mount.lustre:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164150:1731745997079552:10.240.43.61@tcp:501:mount.lustre.0 10000000:01000000:0.0:1651529545.704179:0:164150:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1651529545.704182:0:164150:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000c0de17df/0x3234de053c541fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd608b expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529545.704185:0:164150:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 00000000c0de17df/0x3234de053c541fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd608b expref: -99 pid: 164150 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1651529545.704188:0:164150:0:(mgc_request.c:215:do_config_log_add()) do adding config log nodemap-ffff94e0d2ad4820 10000000:01000000:0.0:1651529545.704190:0:164150:0:(mgc_request.c:90:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1651529545.704191:0:164150:0:(mgc_request.c:2064:mgc_process_log()) Process log nodemap-ffff94e0d2ad4820 from 1 10000000:01000000:0.0:1651529545.704192:0:164150:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1651529545.704197:0:164150:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 000000004678bff1/0x3234de053c54202 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529545.704199:0:164150:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 000000004678bff1/0x3234de053c54202 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529545.704203:0:164150:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 000000004678bff1/0x3234de053c54202 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529545.704207:0:164150:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000f50c14a pname:cluuid:pid:xid:nid:opc:job mount.lustre:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164150:1731745997079616:10.240.43.61@tcp:101:mount.lustre.0 00000100:00100000:0.0:1651529545.704218:0:164150:0:(client.c:2492:ptlrpc_set_wait()) set 0000000022272409 going to sleep for 6 seconds 00000100:00100000:0.0:1651529545.704448:0:164150:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000f50c14a pname:cluuid:pid:xid:nid:opc:job mount.lustre:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164150:1731745997079616:10.240.43.61@tcp:101:mount.lustre.0 00010000:00010000:0.0:1651529545.704453:0:164150:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 000000004678bff1/0x3234de053c54202 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd6092 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529545.704456:0:164150:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 000000004678bff1/0x3234de053c54202 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553dd6092 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529545.704521:0:164150:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000f50c14a pname:cluuid:pid:xid:nid:opc:job mount.lustre:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164150:1731745997079680:10.240.43.61@tcp:256:mount.lustre.0 00000100:00100000:0.0:1651529545.704534:0:164150:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e92eba8e going to sleep for 6 seconds 00000100:00100000:0.0:1651529545.705019:0:164150:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000f50c14a pname:cluuid:pid:xid:nid:opc:job mount.lustre:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164150:1731745997079680:10.240.43.61@tcp:256:mount.lustre.0 10000000:01000000:0.0:1651529545.705090:0:164150:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1651529545.705092:0:164150:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 000000004678bff1/0x3234de053c54202 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd6092 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529545.705095:0:164150:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 000000004678bff1/0x3234de053c54202 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd6092 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1651529545.705101:0:164150:0:(mgc_request.c:215:do_config_log_add()) do adding config log params-ffff94e0d5c4c000 10000000:01000000:0.0:1651529545.705102:0:164150:0:(mgc_request.c:90:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1651529545.705103:0:164150:0:(mgc_request.c:215:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1651529545.705104:0:164150:0:(mgc_request.c:90:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1651529545.705105:0:164150:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1651529545.705106:0:164150:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1651529545.705111:0:164150:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 00000000ae57075e/0x3234de053c54209 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529545.705114:0:164150:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 00000000ae57075e/0x3234de053c54209 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529545.705117:0:164150:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 00000000ae57075e/0x3234de053c54209 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529545.705121:0:164150:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000f50c14a pname:cluuid:pid:xid:nid:opc:job mount.lustre:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164150:1731745997079744:10.240.43.61@tcp:101:mount.lustre.0 00000100:00100000:0.0:1651529545.705134:0:164150:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e92eba8e going to sleep for 6 seconds 00000100:00100000:0.0:1651529545.705330:0:164150:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000f50c14a pname:cluuid:pid:xid:nid:opc:job mount.lustre:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164150:1731745997079744:10.240.43.61@tcp:101:mount.lustre.0 00010000:00010000:0.0:1651529545.705335:0:164150:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 00000000ae57075e/0x3234de053c54209 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd6099 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529545.705339:0:164150:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 00000000ae57075e/0x3234de053c54209 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553dd6099 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1651529545.706569:0:164150:0:(llog_osd.c:233:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1651529545.710489:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:0.0:1651529545.710500:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 128 off8544 00000040:00080000:0.0:1651529545.710505:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 112 off8656 00000040:00080000:0.0:1651529545.710510:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8880 00000040:00080000:0.0:1651529545.710514:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9104 00000040:00080000:0.0:1651529545.710518:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9224 00000040:00080000:0.0:1651529545.710525:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 224 off9448 00000040:00080000:0.0:1651529545.710527:0:164150:0:(llog.c:768:llog_process_thread()) stop processing plain 0xc:10:0 index 8 count 8 00000100:00100000:0.0:1651529545.710540:0:164150:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000f50c14a pname:cluuid:pid:xid:nid:opc:job mount.lustre:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164150:1731745997079808:10.240.43.61@tcp:501:mount.lustre.0 00000100:00100000:0.0:1651529545.710556:0:164150:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ee000b78 going to sleep for 6 seconds 00000100:00100000:0.0:1651529545.710781:0:164150:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000f50c14a pname:cluuid:pid:xid:nid:opc:job mount.lustre:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164150:1731745997079808:10.240.43.61@tcp:501:mount.lustre.0 00000100:00100000:0.0:1651529545.710792:0:164150:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000f50c14a pname:cluuid:pid:xid:nid:opc:job mount.lustre:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164150:1731745997079872:10.240.43.61@tcp:503:mount.lustre.0 00000100:00100000:0.0:1651529545.710828:0:164150:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ee000b78 going to sleep for 6 seconds 00000100:00100000:0.0:1651529545.711343:0:164150:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000f50c14a pname:cluuid:pid:xid:nid:opc:job mount.lustre:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164150:1731745997079872:10.240.43.61@tcp:503:mount.lustre.0 00000040:00080000:0.0:1651529545.711486:0:164150:0:(llog_osd.c:233:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1651529545.711503:0:164150:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000f50c14a pname:cluuid:pid:xid:nid:opc:job mount.lustre:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164150:1731745997079936:10.240.43.61@tcp:502:mount.lustre.0 00000100:00100000:0.0:1651529545.711519:0:164150:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e70c42f7 going to sleep for 6 seconds 00000100:00100000:0.0:1651529545.711880:0:164150:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000f50c14a pname:cluuid:pid:xid:nid:opc:job mount.lustre:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164150:1731745997079936:10.240.43.61@tcp:502:mount.lustre.0 00000040:00080000:0.0:1651529545.711947:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:0.0:1651529545.711955:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 128 off8544 00000040:00080000:0.0:1651529545.711960:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 112 off8656 00000040:00080000:0.0:1651529545.711964:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8880 00000040:00080000:0.0:1651529545.711969:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9104 00000040:00080000:0.0:1651529545.711973:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9224 00000100:00100000:0.0:1651529545.711980:0:164150:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000f50c14a pname:cluuid:pid:xid:nid:opc:job mount.lustre:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164150:1731745997080000:10.240.43.61@tcp:502:mount.lustre.0 00000100:00100000:0.0:1651529545.711995:0:164150:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e70c42f7 going to sleep for 6 seconds 00000100:00100000:0.0:1651529545.712214:0:164150:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000f50c14a pname:cluuid:pid:xid:nid:opc:job mount.lustre:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164150:1731745997080000:10.240.43.61@tcp:502:mount.lustre.0 00000040:00080000:0.0:1651529545.712243:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 224 off9448 00000040:00080000:0.0:1651529545.712246:0:164150:0:(llog.c:768:llog_process_thread()) stop processing plain 0x9:10:0 index 8 count 8 00000020:01000000:1.0:1651529545.712705:0:164178:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1651529545.712708:0:164178:0:(obd_mount.c:991:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1651529545.712715:0:164178:0:(obd_config.c:1356:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1651529545.712716:0:164178:0:(obd_config.c:1432:class_process_config()) marker 11 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1651529545.712719:0:164178:0:(obd_config.c:1356:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1651529545.712724:0:164178:0:(genops.c:417:class_newdev()) Allocate new device lustre-OST0001 (0000000094fa7b20) 00000020:00000080:1.0:1651529545.712757:0:164178:0:(obd_config.c:648:class_attach()) OBD: dev 3 attached type obdfilter with refcount 1 00000020:00000080:1.0:1651529545.712759:0:164178:0:(obd_config.c:1356:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1651529545.712801:0:164178:0:(obd_mount_server.c:167:server_get_mount()) get mount 00000000f465a35f from lustre-OST0001, refs=2 00080000:01000000:1.0:1651529545.712804:0:164178:0:(osd_handler.c:8440:osd_obd_connect()) connect #1 00000020:00000080:1.0:1651529545.712807:0:164178:0:(genops.c:1359:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x3234de053c54217 00010000:00010000:1.0:1651529545.715806:0:164178:0:(ldlm_pool.c:932:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-0 is initialized 00000001:00000004:1.0:1651529545.715940:0:164178:0:(tgt_lastrcvd.c:701:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 12885081251 00080000:10000000:1.0:1651529545.717164:0:164178:0:(osd_handler.c:5198:osd_index_try()) lustre-OST0001: index object [0x200000003:0x10:0x0] (8/32) registered 00000020:00000080:1.0:1651529545.717560:0:164178:0:(obd_config.c:752:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1651529545.717563:0:164178:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1651529545.717565:0:164178:0:(obd_config.c:1356:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1651529545.717566:0:164178:0:(obd_config.c:1432:class_process_config()) marker 11 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1651529545.717568:0:164178:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1651529545.717569:0:164178:0:(obd_config.c:1356:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1651529545.717569:0:164178:0:(obd_config.c:1432:class_process_config()) marker 16 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1651529545.717571:0:164178:0:(obd_config.c:1356:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1651529545.717578:0:164178:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1651529545.717579:0:164178:0:(obd_config.c:1356:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1651529545.717579:0:164178:0:(obd_config.c:1432:class_process_config()) marker 16 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1651529545.717580:0:164178:0:(llog.c:768:llog_process_thread()) stop processing plain 0x12:10:0 index 8 count 8 00000020:01000000:0.0:1651529545.717645:0:164150:0:(obd_config.c:2042:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1651529545.717655:0:164150:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1651529545.717657:0:164150:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000ae57075e/0x3234de053c54209 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd6099 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529545.717662:0:164150:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 00000000ae57075e/0x3234de053c54209 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd6099 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1651529545.717665:0:164150:0:(mgc_request.c:2064:mgc_process_log()) Process log params-ffff94e0d5c4c000 from 1 10000000:01000000:0.0:1651529545.717667:0:164150:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1651529545.717674:0:164150:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 000000004f367ded/0x3234de053c5421e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529545.717677:0:164150:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 000000004f367ded/0x3234de053c5421e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529545.717681:0:164150:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 000000004f367ded/0x3234de053c5421e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529545.717687:0:164150:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000f50c14a pname:cluuid:pid:xid:nid:opc:job mount.lustre:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164150:1731745997080064:10.240.43.61@tcp:101:mount.lustre.0 00000100:00100000:0.0:1651529545.717702:0:164150:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e70c42f7 going to sleep for 6 seconds 00000100:00100000:0.0:1651529545.718395:0:164150:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000f50c14a pname:cluuid:pid:xid:nid:opc:job mount.lustre:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164150:1731745997080064:10.240.43.61@tcp:101:mount.lustre.0 00010000:00010000:0.0:1651529545.718400:0:164150:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 000000004f367ded/0x3234de053c5421e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd60a0 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529545.718404:0:164150:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 000000004f367ded/0x3234de053c5421e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553dd60a0 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1651529545.740844:0:164150:0:(llog_osd.c:233:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1651529545.741038:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x13:0x0].1, 224 off8416 00000040:00080000:0.0:1651529545.741047:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x13:0x0].2, 112 off8528 00000040:00080000:0.0:1651529545.741054:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x13:0x0].3, 224 off8752 00000040:00080000:0.0:1651529545.741056:0:164150:0:(llog.c:768:llog_process_thread()) stop processing plain 0xe:10:0 index 4 count 4 00000100:00100000:0.0:1651529545.741068:0:164150:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000f50c14a pname:cluuid:pid:xid:nid:opc:job mount.lustre:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164150:1731745997080128:10.240.43.61@tcp:501:mount.lustre.0 00000100:00100000:0.0:1651529545.741083:0:164150:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e70c42f7 going to sleep for 6 seconds 00000100:00100000:0.0:1651529545.741298:0:164150:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000f50c14a pname:cluuid:pid:xid:nid:opc:job mount.lustre:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164150:1731745997080128:10.240.43.61@tcp:501:mount.lustre.0 00000100:00100000:0.0:1651529545.741308:0:164150:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000f50c14a pname:cluuid:pid:xid:nid:opc:job mount.lustre:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164150:1731745997080192:10.240.43.61@tcp:503:mount.lustre.0 00000100:00100000:0.0:1651529545.741324:0:164150:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e70c42f7 going to sleep for 6 seconds 00000100:00100000:0.0:1651529545.741549:0:164150:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000f50c14a pname:cluuid:pid:xid:nid:opc:job mount.lustre:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164150:1731745997080192:10.240.43.61@tcp:503:mount.lustre.0 00000040:00080000:0.0:1651529545.741632:0:164150:0:(llog_osd.c:233:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1651529545.741641:0:164150:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000f50c14a pname:cluuid:pid:xid:nid:opc:job mount.lustre:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164150:1731745997080256:10.240.43.61@tcp:502:mount.lustre.0 00000100:00100000:0.0:1651529545.741656:0:164150:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e70c42f7 going to sleep for 6 seconds 00000100:00100000:0.0:1651529545.741898:0:164150:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000f50c14a pname:cluuid:pid:xid:nid:opc:job mount.lustre:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164150:1731745997080256:10.240.43.61@tcp:502:mount.lustre.0 00000040:00080000:0.0:1651529545.741964:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x14:0x0].1, 224 off8416 00000040:00080000:0.0:1651529545.741972:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x14:0x0].2, 112 off8528 00000040:00080000:0.0:1651529545.741977:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x14:0x0].3, 224 off8752 00000040:00080000:0.0:1651529545.741981:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x14:0x0].4, 224 off8976 00000040:00080000:0.0:1651529545.741985:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x14:0x0].5, 112 off9088 00000040:00080000:0.0:1651529545.741990:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x14:0x0].6, 224 off9312 00000040:00080000:0.0:1651529545.741994:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x14:0x0].7, 224 off9536 00000040:00080000:0.0:1651529545.741998:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x14:0x0].8, 112 off9648 00000040:00080000:0.0:1651529545.742001:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x14:0x0].9, 224 off9872 00000040:00080000:0.0:1651529545.742005:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x14:0x0].10, 224 off10096 00000040:00080000:0.0:1651529545.742009:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x14:0x0].11, 112 off10208 00000100:00100000:0.0:1651529545.742017:0:164150:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000f50c14a pname:cluuid:pid:xid:nid:opc:job mount.lustre:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164150:1731745997080320:10.240.43.61@tcp:502:mount.lustre.0 00000100:00100000:0.0:1651529545.742031:0:164150:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e70c42f7 going to sleep for 6 seconds 00000100:00100000:0.0:1651529545.742275:0:164150:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000f50c14a pname:cluuid:pid:xid:nid:opc:job mount.lustre:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164150:1731745997080320:10.240.43.61@tcp:502:mount.lustre.0 00000040:00080000:0.0:1651529545.742296:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x14:0x0].12, 224 off10432 00000040:00080000:0.0:1651529545.742299:0:164150:0:(llog.c:768:llog_process_thread()) stop processing plain 0x2:10:0 index 13 count 13 00000020:01000000:0.0:1651529545.742416:0:164181:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1651529545.742419:0:164181:0:(obd_config.c:1356:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1651529545.742419:0:164181:0:(obd_config.c:1432:class_process_config()) marker 2 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1651529545.742421:0:164181:0:(obd_config.c:1885:class_config_llog_handler()) cmd ce032, instance name: general-ffff94e0d5c4c000 00000020:00000080:0.0:1651529545.742423:0:164181:0:(obd_config.c:1356:class_process_config()) processing cmd: ce032 00000020:00080000:0.0:1651529545.744620:0:164181:0:(obd_config.c:1330:process_param2_config()) lctl: invoked upcall /usr/sbin/lctl set_param lod.*.mdt_hash=crush, time 2194us 00000020:01000000:0.0:1651529545.744624:0:164181:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1651529545.744626:0:164181:0:(obd_config.c:1356:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1651529545.744627:0:164181:0:(obd_config.c:1432:class_process_config()) marker 2 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1651529545.744628:0:164181:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1651529545.744629:0:164181:0:(obd_config.c:1779:class_config_llog_handler()) SKIP #2 00000020:01000000:0.0:1651529545.744630:0:164181:0:(obd_config.c:1805:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1651529545.744630:0:164181:0:(obd_config.c:1805:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1651529545.744631:0:164181:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1651529545.744632:0:164181:0:(obd_config.c:1356:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1651529545.744632:0:164181:0:(obd_config.c:1432:class_process_config()) marker 2 (0x6) lustre osc.lustre*.checksums 00000020:01000000:0.0:1651529545.744633:0:164181:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1651529545.744634:0:164181:0:(obd_config.c:1779:class_config_llog_handler()) SKIP #3 00000020:01000000:0.0:1651529545.744634:0:164181:0:(obd_config.c:1805:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1651529545.744635:0:164181:0:(obd_config.c:1805:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1651529545.744635:0:164181:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1651529545.744636:0:164181:0:(obd_config.c:1356:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1651529545.744636:0:164181:0:(obd_config.c:1432:class_process_config()) marker 3 (0x6) lustre osc.lustre*.checksums 00000020:01000000:0.0:1651529545.744637:0:164181:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1651529545.744638:0:164181:0:(obd_config.c:1356:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1651529545.744638:0:164181:0:(obd_config.c:1432:class_process_config()) marker 4 (0x1) lustre osc.lustre*.checksums 00000020:01000000:0.0:1651529545.744640:0:164181:0:(obd_config.c:1885:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff94e0d5c4c000 00000020:00000080:0.0:1651529545.744641:0:164181:0:(obd_config.c:1356:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1651529545.744662:0:164181:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1651529545.744664:0:164181:0:(obd_config.c:1356:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1651529545.744664:0:164181:0:(obd_config.c:1432:class_process_config()) marker 4 (0x2) lustre osc.lustre*.checksums 00000040:00080000:0.0:1651529545.744665:0:164181:0:(llog.c:768:llog_process_thread()) stop processing plain 0x14:10:0 index 13 count 13 00000020:01000000:0.0:1651529545.744698:0:164150:0:(obd_config.c:2042:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1651529545.744705:0:164150:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1651529545.744707:0:164150:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 000000004f367ded/0x3234de053c5421e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd60a0 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529545.744711:0:164150:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 000000004f367ded/0x3234de053c5421e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd60a0 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1651529545.744718:0:164150:0:(mgc_request.c:2205:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1651529545.744718:0:164150:0:(mgc_request.c:334:config_log_add()) add config log lustre-client-ffff94e0d5c4c000 10000000:01000000:0.0:1651529545.744719:0:164150:0:(mgc_request.c:215:do_config_log_add()) do adding config log lustre-client-ffff94e0d5c4c000 10000000:01000000:0.0:1651529545.744720:0:164150:0:(mgc_request.c:90:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1651529545.744722:0:164150:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff94e0d5c4c000 from 1 10000000:01000000:0.0:1651529545.744723:0:164150:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1651529545.744729:0:164150:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 00000000ba070658/0x3234de053c54225 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529545.744732:0:164150:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 00000000ba070658/0x3234de053c54225 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529545.744735:0:164150:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 00000000ba070658/0x3234de053c54225 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529545.744741:0:164150:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000f50c14a pname:cluuid:pid:xid:nid:opc:job mount.lustre:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164150:1731745997080384:10.240.43.61@tcp:101:mount.lustre.0 00000100:00100000:0.0:1651529545.744755:0:164150:0:(client.c:2492:ptlrpc_set_wait()) set 00000000aeee3fea going to sleep for 6 seconds 00000100:00100000:0.0:1651529545.744968:0:164150:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000f50c14a pname:cluuid:pid:xid:nid:opc:job mount.lustre:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164150:1731745997080384:10.240.43.61@tcp:101:mount.lustre.0 00010000:00010000:0.0:1651529545.744973:0:164150:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 00000000ba070658/0x3234de053c54225 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd60a7 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529545.744979:0:164150:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 00000000ba070658/0x3234de053c54225 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553dd60a7 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1651529545.746583:0:164150:0:(llog_osd.c:233:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1651529545.747292:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].1, 224 off8416 00000040:00080000:1.0:1651529545.747301:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].2, 120 off8536 00000040:00080000:1.0:1651529545.747306:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].3, 168 off8704 00000040:00080000:1.0:1651529545.747311:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].4, 224 off8928 00000040:00080000:1.0:1651529545.747315:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].5, 224 off9152 00000040:00080000:1.0:1651529545.747319:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].6, 120 off9272 00000040:00080000:1.0:1651529545.747323:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].7, 168 off9440 00000040:00080000:1.0:1651529545.747327:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].8, 224 off9664 00000040:00080000:1.0:1651529545.747332:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].9, 224 off9888 00000040:00080000:1.0:1651529545.747336:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].10, 88 off9976 00000040:00080000:1.0:1651529545.747340:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].11, 128 off10104 00000040:00080000:1.0:1651529545.747344:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].12, 144 off10248 00000040:00080000:1.0:1651529545.747348:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].13, 160 off10408 00000040:00080000:1.0:1651529545.747352:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].14, 224 off10632 00000040:00080000:1.0:1651529545.747356:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].15, 224 off10856 00000040:00080000:1.0:1651529545.747360:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].16, 120 off10976 00000040:00080000:1.0:1651529545.747364:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].17, 224 off11200 00000040:00080000:1.0:1651529545.747368:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].18, 224 off11424 00000040:00080000:1.0:1651529545.747373:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].19, 88 off11512 00000040:00080000:1.0:1651529545.747377:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].20, 128 off11640 00000040:00080000:1.0:1651529545.747381:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].21, 144 off11784 00000040:00080000:1.0:1651529545.747385:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].22, 128 off11912 00000040:00080000:1.0:1651529545.747389:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].23, 224 off12136 00000040:00080000:1.0:1651529545.747403:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].24, 224 off12360 00000040:00080000:1.0:1651529545.747409:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].25, 88 off12448 00000040:00080000:1.0:1651529545.747413:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].26, 128 off12576 00000040:00080000:1.0:1651529545.747417:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].27, 144 off12720 00000040:00080000:1.0:1651529545.747421:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].28, 128 off12848 00000040:00080000:1.0:1651529545.747425:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].29, 224 off13072 00000040:00080000:1.0:1651529545.747429:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].30, 224 off13296 00000040:00080000:1.0:1651529545.747433:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].31, 120 off13416 00000040:00080000:1.0:1651529545.747437:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].32, 224 off13640 00000040:00080000:1.0:1651529545.747441:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].33, 224 off13864 00000040:00080000:1.0:1651529545.747446:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].34, 112 off13976 00000040:00080000:1.0:1651529545.747450:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].35, 224 off14200 00000040:00080000:1.0:1651529545.747454:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].36, 224 off14424 00000040:00080000:1.0:1651529545.747458:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].37, 136 off14560 00000040:00080000:1.0:1651529545.747462:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].38, 224 off14784 00000040:00080000:1.0:1651529545.747466:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].39, 224 off15008 00000040:00080000:1.0:1651529545.747470:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].40, 136 off15144 00000040:00080000:1.0:1651529545.747474:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].41, 224 off15368 00000040:00080000:1.0:1651529545.747478:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].42, 224 off15592 00000040:00080000:1.0:1651529545.747482:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].43, 112 off15704 00000040:00080000:1.0:1651529545.747486:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].44, 224 off15928 00000040:00080000:1.0:1651529545.747490:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].45, 224 off16152 00000040:00080000:1.0:1651529545.747494:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].46, 112 off16264 00000040:00080000:1.0:1651529545.747597:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].48, 224 off16608 00000040:00080000:1.0:1651529545.747604:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].49, 224 off16832 00000040:00080000:1.0:1651529545.747608:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].50, 136 off16968 00000040:00080000:1.0:1651529545.747612:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].51, 224 off17192 00000040:00080000:1.0:1651529545.747616:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].52, 224 off17416 00000040:00080000:1.0:1651529545.747621:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].53, 136 off17552 00000040:00080000:1.0:1651529545.747625:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].54, 224 off17776 00000040:00080000:1.0:1651529545.747629:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].55, 224 off18000 00000040:00080000:1.0:1651529545.747633:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].56, 136 off18136 00000040:00080000:1.0:1651529545.747637:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].57, 224 off18360 00000040:00080000:1.0:1651529545.747641:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].58, 224 off18584 00000040:00080000:1.0:1651529545.747645:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].59, 136 off18720 00000040:00080000:1.0:1651529545.747649:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].60, 224 off18944 00000040:00080000:1.0:1651529545.747653:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].61, 224 off19168 00000040:00080000:1.0:1651529545.747657:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].62, 112 off19280 00000040:00080000:1.0:1651529545.747662:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x15:0x0].63, 224 off19504 00000040:00080000:1.0:1651529545.747664:0:164150:0:(llog.c:768:llog_process_thread()) stop processing plain 0x10:10:0 index 64 count 63 00000100:00100000:1.0:1651529545.747678:0:164150:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000eff08db4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164150:1731745997080448:10.240.43.61@tcp:501:mount.lustre.0 00000100:00100000:1.0:1651529545.747700:0:164150:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e938bacd going to sleep for 6 seconds 00000100:00100000:1.0:1651529545.749118:0:164150:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000eff08db4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164150:1731745997080448:10.240.43.61@tcp:501:mount.lustre.0 00000100:00100000:1.0:1651529545.749130:0:164150:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000eff08db4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164150:1731745997080512:10.240.43.61@tcp:503:mount.lustre.0 00000100:00100000:1.0:1651529545.749145:0:164150:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e938bacd going to sleep for 6 seconds 00000100:00100000:1.0:1651529545.749965:0:164150:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000eff08db4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164150:1731745997080512:10.240.43.61@tcp:503:mount.lustre.0 00000040:00080000:1.0:1651529545.750072:0:164150:0:(llog_osd.c:233:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1651529545.750082:0:164150:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000eff08db4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164150:1731745997080576:10.240.43.61@tcp:502:mount.lustre.0 00000100:00100000:1.0:1651529545.750098:0:164150:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e938bacd going to sleep for 6 seconds 00000100:00100000:1.0:1651529545.750623:0:164150:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000eff08db4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164150:1731745997080576:10.240.43.61@tcp:502:mount.lustre.0 00000040:00080000:1.0:1651529545.750674:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].1, 224 off8416 00000040:00080000:1.0:1651529545.750683:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].2, 120 off8536 00000040:00080000:1.0:1651529545.750687:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].3, 168 off8704 00000040:00080000:1.0:1651529545.750692:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].4, 224 off8928 00000040:00080000:1.0:1651529545.750696:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].5, 224 off9152 00000040:00080000:1.0:1651529545.750700:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].6, 120 off9272 00000040:00080000:1.0:1651529545.750704:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].7, 168 off9440 00000040:00080000:1.0:1651529545.750708:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].8, 224 off9664 00000040:00080000:1.0:1651529545.750712:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].9, 224 off9888 00000040:00080000:1.0:1651529545.750716:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].10, 88 off9976 00000040:00080000:1.0:1651529545.750720:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].11, 128 off10104 00000040:00080000:1.0:1651529545.750724:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].12, 144 off10248 00000040:00080000:1.0:1651529545.750728:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].13, 160 off10408 00000040:00080000:1.0:1651529545.750732:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].14, 224 off10632 00000040:00080000:1.0:1651529545.750736:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].15, 224 off10856 00000040:00080000:1.0:1651529545.750740:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].16, 120 off10976 00000040:00080000:1.0:1651529545.750745:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].17, 224 off11200 00000040:00080000:1.0:1651529545.750749:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].18, 224 off11424 00000040:00080000:1.0:1651529545.750753:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].19, 88 off11512 00000040:00080000:1.0:1651529545.750757:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].20, 128 off11640 00000040:00080000:1.0:1651529545.750761:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].21, 144 off11784 00000040:00080000:1.0:1651529545.750765:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].22, 128 off11912 00000040:00080000:1.0:1651529545.750768:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].23, 224 off12136 00000040:00080000:1.0:1651529545.750782:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].24, 224 off12360 00000040:00080000:1.0:1651529545.750787:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].25, 88 off12448 00000040:00080000:1.0:1651529545.750791:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].26, 128 off12576 00000040:00080000:1.0:1651529545.750796:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].27, 144 off12720 00000040:00080000:1.0:1651529545.750800:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].28, 128 off12848 00000040:00080000:1.0:1651529545.750804:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].29, 224 off13072 00000040:00080000:1.0:1651529545.750808:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].30, 224 off13296 00000040:00080000:1.0:1651529545.750812:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].31, 120 off13416 00000040:00080000:1.0:1651529545.750816:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].32, 224 off13640 00000040:00080000:1.0:1651529545.750821:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].33, 224 off13864 00000040:00080000:1.0:1651529545.750825:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].34, 112 off13976 00000040:00080000:1.0:1651529545.750829:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].35, 224 off14200 00000040:00080000:1.0:1651529545.750832:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].36, 224 off14424 00000040:00080000:1.0:1651529545.750836:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].37, 136 off14560 00000040:00080000:1.0:1651529545.750840:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].38, 224 off14784 00000040:00080000:1.0:1651529545.750844:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].39, 224 off15008 00000040:00080000:1.0:1651529545.750863:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].40, 136 off15144 00000040:00080000:1.0:1651529545.750867:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].41, 224 off15368 00000040:00080000:1.0:1651529545.750871:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].42, 224 off15592 00000040:00080000:1.0:1651529545.750875:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].43, 112 off15704 00000040:00080000:1.0:1651529545.750879:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].44, 224 off15928 00000040:00080000:1.0:1651529545.750883:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].45, 224 off16152 00000040:00080000:1.0:1651529545.750887:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].46, 112 off16264 00000100:00100000:1.0:1651529545.750896:0:164150:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000eff08db4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164150:1731745997080640:10.240.43.61@tcp:502:mount.lustre.0 00000100:00100000:1.0:1651529545.750912:0:164150:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e938bacd going to sleep for 6 seconds 00000100:00100000:1.0:1651529545.751133:0:164150:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000eff08db4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164150:1731745997080640:10.240.43.61@tcp:502:mount.lustre.0 00000040:00080000:1.0:1651529545.751164:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].48, 224 off16608 00000040:00080000:1.0:1651529545.751170:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].49, 224 off16832 00000040:00080000:1.0:1651529545.751175:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].50, 136 off16968 00000040:00080000:1.0:1651529545.751179:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].51, 224 off17192 00000040:00080000:1.0:1651529545.751183:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].52, 224 off17416 00000040:00080000:1.0:1651529545.751187:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].53, 136 off17552 00000040:00080000:1.0:1651529545.751191:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].54, 224 off17776 00000040:00080000:1.0:1651529545.751196:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].55, 224 off18000 00000040:00080000:1.0:1651529545.751200:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].56, 136 off18136 00000040:00080000:1.0:1651529545.751204:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].57, 224 off18360 00000040:00080000:1.0:1651529545.751208:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].58, 224 off18584 00000040:00080000:1.0:1651529545.751212:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].59, 136 off18720 00000040:00080000:1.0:1651529545.751216:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].60, 224 off18944 00000040:00080000:1.0:1651529545.751220:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].61, 224 off19168 00000040:00080000:1.0:1651529545.751241:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].62, 112 off19280 00000040:00080000:1.0:1651529545.751247:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].63, 224 off19504 00000040:00080000:1.0:1651529545.751252:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].64, 224 off19728 00000040:00080000:1.0:1651529545.751256:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].65, 112 off19840 00000040:00080000:1.0:1651529545.751260:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].66, 224 off20064 00000040:00080000:1.0:1651529545.751264:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].67, 224 off20288 00000040:00080000:1.0:1651529545.751268:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].68, 136 off20424 00000040:00080000:1.0:1651529545.751288:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].69, 224 off20648 00000040:00080000:1.0:1651529545.751294:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].70, 224 off20872 00000040:00080000:1.0:1651529545.751298:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].71, 136 off21008 00000040:00080000:1.0:1651529545.751303:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].72, 224 off21232 00000040:00080000:1.0:1651529545.751307:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].73, 224 off21456 00000040:00080000:1.0:1651529545.751311:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].74, 112 off21568 00000040:00080000:1.0:1651529545.751315:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].75, 224 off21792 00000040:00080000:1.0:1651529545.751319:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].76, 224 off22016 00000040:00080000:1.0:1651529545.751323:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].77, 112 off22128 00000040:00080000:1.0:1651529545.751328:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].78, 224 off22352 00000040:00080000:1.0:1651529545.751332:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].79, 224 off22576 00000040:00080000:1.0:1651529545.751337:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].80, 136 off22712 00000040:00080000:1.0:1651529545.751341:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].81, 224 off22936 00000040:00080000:1.0:1651529545.751345:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].82, 224 off23160 00000040:00080000:1.0:1651529545.751349:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].83, 136 off23296 00000040:00080000:1.0:1651529545.751353:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].84, 224 off23520 00000040:00080000:1.0:1651529545.751357:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].85, 224 off23744 00000040:00080000:1.0:1651529545.751361:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].86, 112 off23856 00000040:00080000:1.0:1651529545.751366:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].87, 224 off24080 00000040:00080000:1.0:1651529545.751370:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].88, 224 off24304 00000040:00080000:1.0:1651529545.751374:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].89, 112 off24416 00000100:00100000:1.0:1651529545.751381:0:164150:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000eff08db4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164150:1731745997080704:10.240.43.61@tcp:502:mount.lustre.0 00000100:00100000:1.0:1651529545.751396:0:164150:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e938bacd going to sleep for 6 seconds 00000100:00100000:1.0:1651529545.751610:0:164150:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000eff08db4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164150:1731745997080704:10.240.43.61@tcp:502:mount.lustre.0 00000040:00080000:1.0:1651529545.751640:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].91, 224 off24800 00000040:00080000:1.0:1651529545.751646:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].92, 224 off25024 00000040:00080000:1.0:1651529545.751650:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].93, 112 off25136 00000040:00080000:1.0:1651529545.751655:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].94, 224 off25360 00000040:00080000:1.0:1651529545.751659:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].95, 224 off25584 00000040:00080000:1.0:1651529545.751664:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].96, 112 off25696 00000040:00080000:1.0:1651529545.751668:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].97, 224 off25920 00000040:00080000:1.0:1651529545.751672:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].98, 224 off26144 00000040:00080000:1.0:1651529545.751676:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].99, 136 off26280 00000040:00080000:1.0:1651529545.751680:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].100, 224 off26504 00000040:00080000:1.0:1651529545.751684:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].101, 224 off26728 00000040:00080000:1.0:1651529545.751688:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].102, 136 off26864 00000040:00080000:1.0:1651529545.751692:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].103, 224 off27088 00000040:00080000:1.0:1651529545.751696:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].104, 224 off27312 00000040:00080000:1.0:1651529545.751700:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].105, 136 off27448 00000040:00080000:1.0:1651529545.751704:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].106, 224 off27672 00000040:00080000:1.0:1651529545.751708:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].107, 224 off27896 00000040:00080000:1.0:1651529545.751712:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].108, 136 off28032 00000040:00080000:1.0:1651529545.751716:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].109, 224 off28256 00000040:00080000:1.0:1651529545.751721:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].110, 224 off28480 00000040:00080000:1.0:1651529545.751725:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].111, 112 off28592 00000040:00080000:1.0:1651529545.751749:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].112, 224 off28816 00000040:00080000:1.0:1651529545.751756:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].113, 224 off29040 00000040:00080000:1.0:1651529545.751760:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].114, 112 off29152 00000040:00080000:1.0:1651529545.751764:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].115, 224 off29376 00000040:00080000:1.0:1651529545.751768:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].116, 224 off29600 00000040:00080000:1.0:1651529545.751772:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].117, 136 off29736 00000040:00080000:1.0:1651529545.751776:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].118, 224 off29960 00000040:00080000:1.0:1651529545.751781:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].119, 224 off30184 00000040:00080000:1.0:1651529545.751785:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].120, 136 off30320 00000040:00080000:1.0:1651529545.751789:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].121, 224 off30544 00000040:00080000:1.0:1651529545.751793:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].122, 224 off30768 00000040:00080000:1.0:1651529545.751797:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].123, 112 off30880 00000040:00080000:1.0:1651529545.751801:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].124, 224 off31104 00000040:00080000:1.0:1651529545.751805:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].125, 224 off31328 00000040:00080000:1.0:1651529545.751809:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].126, 112 off31440 00000040:00080000:1.0:1651529545.751813:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].127, 224 off31664 00000040:00080000:1.0:1651529545.751817:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].128, 224 off31888 00000040:00080000:1.0:1651529545.751821:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].129, 136 off32024 00000040:00080000:1.0:1651529545.751825:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].130, 224 off32248 00000040:00080000:1.0:1651529545.751829:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].131, 224 off32472 00000040:00080000:1.0:1651529545.751833:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].132, 112 off32584 00000100:00100000:1.0:1651529545.751840:0:164150:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000eff08db4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164150:1731745997080768:10.240.43.61@tcp:502:mount.lustre.0 00000100:00100000:1.0:1651529545.751864:0:164150:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e938bacd going to sleep for 6 seconds 00000100:00100000:1.0:1651529545.752084:0:164150:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000eff08db4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164150:1731745997080768:10.240.43.61@tcp:502:mount.lustre.0 00000040:00080000:1.0:1651529545.752123:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].134, 224 off32992 00000040:00080000:1.0:1651529545.752131:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].135, 224 off33216 00000040:00080000:1.0:1651529545.752135:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].136, 136 off33352 00000040:00080000:1.0:1651529545.752139:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].137, 224 off33576 00000040:00080000:1.0:1651529545.752143:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].138, 224 off33800 00000040:00080000:1.0:1651529545.752148:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].139, 112 off33912 00000040:00080000:1.0:1651529545.752152:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].140, 224 off34136 00000040:00080000:1.0:1651529545.752156:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].141, 224 off34360 00000040:00080000:1.0:1651529545.752160:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].142, 136 off34496 00000040:00080000:1.0:1651529545.752164:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].143, 224 off34720 00000040:00080000:1.0:1651529545.752168:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].144, 224 off34944 00000040:00080000:1.0:1651529545.752173:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].145, 136 off35080 00000040:00080000:1.0:1651529545.752177:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].146, 224 off35304 00000040:00080000:1.0:1651529545.752181:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].147, 224 off35528 00000040:00080000:1.0:1651529545.752185:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].148, 136 off35664 00000040:00080000:1.0:1651529545.752189:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].149, 224 off35888 00000040:00080000:1.0:1651529545.752193:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].150, 224 off36112 00000040:00080000:1.0:1651529545.752197:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].151, 112 off36224 00000040:00080000:1.0:1651529545.752201:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].152, 224 off36448 00000040:00080000:1.0:1651529545.752205:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].153, 224 off36672 00000040:00080000:1.0:1651529545.752209:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].154, 136 off36808 00000040:00080000:1.0:1651529545.752239:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].155, 224 off37032 00000040:00080000:1.0:1651529545.752252:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].156, 224 off37256 00000040:00080000:1.0:1651529545.752256:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].157, 112 off37368 00000040:00080000:1.0:1651529545.752260:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].158, 224 off37592 00000040:00080000:1.0:1651529545.752264:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].159, 224 off37816 00000040:00080000:1.0:1651529545.752268:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].160, 136 off37952 00000040:00080000:1.0:1651529545.752273:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].161, 224 off38176 00000040:00080000:1.0:1651529545.752277:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].162, 224 off38400 00000040:00080000:1.0:1651529545.752281:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].163, 136 off38536 00000040:00080000:1.0:1651529545.752285:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].164, 224 off38760 00000040:00080000:1.0:1651529545.752289:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].165, 224 off38984 00000040:00080000:1.0:1651529545.752293:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].166, 112 off39096 00000040:00080000:1.0:1651529545.752297:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].167, 224 off39320 00000040:00080000:1.0:1651529545.752301:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].168, 224 off39544 00000040:00080000:1.0:1651529545.752304:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].169, 112 off39656 00000040:00080000:1.0:1651529545.752308:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].170, 224 off39880 00000040:00080000:1.0:1651529545.752313:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].171, 224 off40104 00000040:00080000:1.0:1651529545.752317:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].172, 136 off40240 00000040:00080000:1.0:1651529545.752321:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].173, 224 off40464 00000040:00080000:1.0:1651529545.752325:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].174, 224 off40688 00000040:00080000:1.0:1651529545.752329:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].175, 136 off40824 00000100:00100000:1.0:1651529545.752337:0:164150:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000eff08db4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164150:1731745997080832:10.240.43.61@tcp:502:mount.lustre.0 00000100:00100000:1.0:1651529545.752350:0:164150:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e938bacd going to sleep for 6 seconds 00000100:00100000:1.0:1651529545.752566:0:164150:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000eff08db4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164150:1731745997080832:10.240.43.61@tcp:502:mount.lustre.0 00000040:00080000:1.0:1651529545.752605:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].177, 224 off41184 00000040:00080000:1.0:1651529545.752613:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].178, 224 off41408 00000040:00080000:1.0:1651529545.752617:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].179, 136 off41544 00000040:00080000:1.0:1651529545.752621:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].180, 224 off41768 00000040:00080000:1.0:1651529545.752625:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].181, 224 off41992 00000040:00080000:1.0:1651529545.752630:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].182, 136 off42128 00000040:00080000:1.0:1651529545.752634:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].183, 224 off42352 00000040:00080000:1.0:1651529545.752638:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].184, 224 off42576 00000040:00080000:1.0:1651529545.752642:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].185, 112 off42688 00000040:00080000:1.0:1651529545.752646:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].186, 224 off42912 00000040:00080000:1.0:1651529545.752650:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].187, 224 off43136 00000040:00080000:1.0:1651529545.752654:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].188, 112 off43248 00000040:00080000:1.0:1651529545.752658:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].189, 224 off43472 00000040:00080000:1.0:1651529545.752662:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].190, 224 off43696 00000040:00080000:1.0:1651529545.752666:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].191, 136 off43832 00000040:00080000:1.0:1651529545.752670:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].192, 224 off44056 00000040:00080000:1.0:1651529545.752674:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].193, 224 off44280 00000040:00080000:1.0:1651529545.752678:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].194, 136 off44416 00000040:00080000:1.0:1651529545.752682:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].195, 224 off44640 00000040:00080000:1.0:1651529545.752687:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].196, 224 off44864 00000040:00080000:1.0:1651529545.752691:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].197, 136 off45000 00000040:00080000:1.0:1651529545.752706:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].198, 224 off45224 00000040:00080000:1.0:1651529545.752712:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].199, 224 off45448 00000040:00080000:1.0:1651529545.752716:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].200, 136 off45584 00000040:00080000:1.0:1651529545.752720:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].201, 224 off45808 00000040:00080000:1.0:1651529545.752724:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].202, 224 off46032 00000040:00080000:1.0:1651529545.752729:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].203, 112 off46144 00000100:00100000:1.0:1651529545.752736:0:164150:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000eff08db4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164150:1731745997080896:10.240.43.61@tcp:502:mount.lustre.0 00000100:00100000:1.0:1651529545.752749:0:164150:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e938bacd going to sleep for 6 seconds 00000100:00100000:1.0:1651529545.752961:0:164150:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000eff08db4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164150:1731745997080896:10.240.43.61@tcp:502:mount.lustre.0 00000040:00080000:1.0:1651529545.752976:0:164150:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x16:0x0].204, 224 off46368 00000040:00080000:1.0:1651529545.752979:0:164150:0:(llog.c:768:llog_process_thread()) stop processing plain 0x3:10:0 index 205 count 201 00000020:01000004:0.0:1651529545.753178:0:164185:0:(obd_mount.c:191:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1651529545.753180:0:164185:0:(obd_config.c:1356:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1651529545.753185:0:164185:0:(genops.c:417:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (00000000f358abc2) 00000020:00000080:0.0:1651529545.753215:0:164185:0:(obd_config.c:648:class_attach()) OBD: dev 4 attached type lwp with refcount 1 00000020:00000080:0.0:1651529545.753216:0:164185:0:(obd_config.c:1356:class_process_config()) processing cmd: cf003 00010000:00080000:0.0:1651529545.753318:0:164185:0:(ldlm_lib.c:115:import_set_conn()) imp 00000000bb021a01@lustre-MDT0000-lwp-OST0001: add connection 10.240.43.61@tcp at head 00010000:00010000:0.0:1651529545.754473:0:164185:0:(ldlm_pool.c:932:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-1 is initialized 00000020:00000080:0.0:1651529545.754492:0:164185:0:(obd_config.c:752:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1651529545.754511:0:164185:0:(lwp_dev.c:495:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1651529545.754514:0:164185:0:(genops.c:1359:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x3234de053c54233 00000100:00080000:0.0:1651529545.754517:0:164185:0:(import.c:533:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 10.240.43.61@tcp last attempt 0 00000100:00080000:0.0:1651529545.754519:0:164185:0:(import.c:614:import_select_connection()) lustre-MDT0000-lwp-OST0001: import 00000000bb021a01 using connection 10.240.43.61@tcp/10.240.43.61@tcp 00000100:00100000:0.0:1651529545.754528:0:164185:0:(import.c:806:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000f50c14a x1731745997080960/t0(0) o38->lustre-MDT0000-lwp-OST0001@10.240.43.61@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1651529545.754539:0:164185:0:(pinger.c:388:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1651529545.754766:0:39098:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000f50c14a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:39098:1731745997080960:10.240.43.61@tcp:38:llog_process_th.0 00000040:00080000:0.0:1651529545.754897:0:164185:0:(llog.c:768:llog_process_thread()) stop processing plain 0x16:10:0 index 205 count 201 00000100:00080000:0.0:1651529545.754946:0:164187:0:(client.c:1659:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@000000009c810c14 x1731745997081024/t0(0) o901->lustre-MDT0000-lwp-OST0001@10.240.43.61@tcp:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/0/ffffffff rc 0/-1 job:'lwp_notify_lust.0' 00000100:00100000:0.0:1651529545.754950:0:164187:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a5591467 going to sleep for 0 seconds 00000020:01000000:0.0:1651529545.755254:0:164150:0:(obd_config.c:2042:class_config_parse_llog()) Processed log lustre-client gen 1-204 (rc=0) 10000000:01000000:0.0:1651529545.755264:0:164150:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1651529545.755266:0:164150:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000ba070658/0x3234de053c54225 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd60a7 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00010000:00080000:1.0:1651529545.755267:0:39098:0:(ldlm_request.c:1448:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=133199) req@000000000f50c14a x1731745997080960/t0(0) o38->lustre-MDT0000-lwp-OST0001@10.240.43.61@tcp:12/10 lens 520/416 e 0 to 0 dl 1651529550 ref 1 fl Rpc:RNQU/0/0 rc 0/0 job:'llog_process_th.0' 00010000:00010000:0.0:1651529545.755270:0:164150:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 00000000ba070658/0x3234de053c54225 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd60a7 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529545.755272:0:39098:0:(client.c:2892:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1651529545.755274:0:39098:0:(import.c:1073:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 7 00000100:00080000:1.0:1651529545.755277:0:39098:0:(import.c:933:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1651529545.755278:0:39098:0:(import.c:1158:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 10000000:01000000:0.0:1651529545.755278:0:164150:0:(mgc_request.c:1239:mgc_set_info_async()) register_target lustre-OST0001 0x40000002 00000100:00080000:1.0:1651529545.755279:0:39098:0:(import.c:85:import_set_state_nolock()) 00000000bb021a01 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1651529545.755283:0:164150:0:(mgc_request.c:1175:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1651529545.755287:0:164150:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009d7328d5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164150:1731745997081088:10.240.43.61@tcp:253:mount.lustre.0 00000100:00080000:1.0:1651529545.755290:0:39098:0:(recover.c:218:ptlrpc_wake_delayed()) @@@ waking (set 00000000a5591467): req@000000009c810c14 x1731745997081024/t0(0) o901->lustre-MDT0000-lwp-OST0001@10.240.43.61@tcp:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/0/ffffffff rc 0/-1 job:'lwp_notify_lust.0' 00000100:00100000:1.0:1651529545.755299:0:39098:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000f50c14a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:39098:1731745997080960:10.240.43.61@tcp:38:llog_process_th.0 00000100:00100000:0.0:1651529545.755312:0:164150:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c75e1cd5 going to sleep for 6 seconds 00000100:00100000:0.0:1651529545.755332:0:164187:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a5591467 going to sleep for 11 seconds 00010000:00080000:0.0:1651529545.755619:0:164187:0:(ldlm_request.c:1448:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=133199) req@000000009c810c14 x1731745997081024/t0(0) o901->lustre-MDT0000-lwp-OST0001@10.240.43.61@tcp:29/10 lens 248/4320 e 0 to 0 dl 1651529557 ref 2 fl Rpc:RQU/0/0 rc 0/0 job:'lwp_notify_lust.0' 00000100:00100000:0.0:1651529545.755625:0:164187:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c810c14 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:164187:1731745997081024:10.240.43.61@tcp:901:lwp_notify_lust.0 00000100:00100000:0.0:1651529545.804692:0:164150:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009d7328d5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164150:1731745997081088:10.240.43.61@tcp:253:mount.lustre.0 10000000:01000000:0.0:1651529545.804696:0:164150:0:(mgc_request.c:1195:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:02000000:0.0:1651529545.804700:0:164150:0:(obd_mount_server.c:2104:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 300-900 00000001:00000004:0.0:1651529545.806967:0:164150:0:(tgt_lastrcvd.c:701:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179869184 00002000:00080000:0.0:1651529545.869884:0:164150:0:(ofd_obd.c:544:ofd_postrecov()) lustre-OST0001: recovery is over 00000020:01000004:0.0:1651529545.869902:0:164150:0:(obd_mount_server.c:312:server_mgc_clear_fs()) Unassign mgc disk 00000020:01000004:0.0:1651529545.869916:0:164150:0:(obd_mount_server.c:1875:server_fill_super_common()) Server sb, dev=51 00000080:00000004:0.0:1651529545.869920:0:164150:0:(super25.c:179:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000400:00000080:0.0:1651529546.961379:0:164532:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651529546.961381:0:164532:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: trevis-87vm4.trevis.whamcloud.com: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 48 00000100:00100000:1.0:1651529548.501845:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529548.501904:0:164167:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754229499392 00000100:00100000:0.0:1651529548.501920:0:164167:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 0 00000100:00100000:0.0:1651529548.501923:0:164167:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eff08db4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:435372:x1731754229499392:12345-10.240.43.64@tcp:8:mount.lustre.0 00010000:00080000:0.0:1651529548.501935:0:164167:0:(ldlm_lib.c:1365:target_handle_connect()) lustre-OST0001: connection from eacddb3a-cb08-4c6c-a06f-c475ab7fdef0@10.240.43.64@tcp t0 exp 0000000055bfac58 cur 20207 last 0 00000020:00000080:0.0:1651529548.501947:0:164167:0:(genops.c:1359:class_connect()) connect: client eacddb3a-cb08-4c6c-a06f-c475ab7fdef0, cookie 0x3234de053c5423a 00002000:00100000:0.0:1651529548.501952:0:164167:0:(ofd_obd.c:150:ofd_parse_connect_data()) lustre-OST0001: cli eacddb3a-cb08-4c6c-a06f-c475ab7fdef0/00000000159c47e3 ocd_connect_flags: 0xa0465af2e3640078 ocd_version: 20f0000 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1651529548.501960:0:164167:0:(ofd_obd.c:249:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000020:01000000:0.0:1651529548.501989:0:164167:0:(lprocfs_status_server.c:544:lprocfs_exp_setup()) using hash 00000000958a682c 00002000:00080000:0.0:1651529548.502001:0:164167:0:(ofd_obd.c:391:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1651529548.502012:0:164167:0:(import.c:85:import_set_state_nolock()) 000000008721bb0a ª;µà”ÿÿ: changing import state from RECOVER to FULL 00000100:00100000:0.0:1651529548.502033:0:164167:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eff08db4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eacddb3a-cb08-4c6c-a06f-c475ab7fdef0+6:435372:x1731754229499392:12345-10.240.43.64@tcp:8:mount.lustre.0 Request processed in 110us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529548.502037:0:164167:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 0 00000100:00100000:1.0:1651529550.985694:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529550.985711:0:164169:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754229499776 00000100:00100000:1.0:1651529550.985723:0:164169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 0 00000100:00100000:1.0:1651529550.985725:0:164169:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dabd64d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:eacddb3a-cb08-4c6c-a06f-c475ab7fdef0+6:436455:x1731754229499776:12345-10.240.43.64@tcp:13:lfs.0 00002000:00000024:1.0:1651529550.985735:0:164169:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8717760 pending 0 free 81309134848 avail 77138423808 00000100:00100000:1.0:1651529550.985760:0:164169:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dabd64d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:eacddb3a-cb08-4c6c-a06f-c475ab7fdef0+6:436455:x1731754229499776:12345-10.240.43.64@tcp:13:lfs.0 Request processed in 35us (67us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529550.985764:0:164169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 0 00000400:00000080:0.0:1651529551.521914:0:164701:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651529551.521916:0:164701:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=100 00000100:00100000:1.0:1651529552.250334:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529552.250370:0:164155:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946686656 00000100:00100000:0.0:1651529552.250392:0:164155:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 0 00000100:00100000:0.0:1651529552.250395:0:164155:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000597d93ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:80ea30fd-09f1-4f9c-9e17-5deadaf30925+3:207847:x1731745946686656:12345-10.240.43.61@tcp:104: 00000100:00100000:0.0:1651529552.250449:0:164155:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000597d93ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:80ea30fd-09f1-4f9c-9e17-5deadaf30925+3:207847:x1731745946686656:12345-10.240.43.61@tcp:104: Request processed in 54us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529552.250453:0:164155:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 0 00010000:00010000:1.0:1651529552.250465:0:164160:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC10.240.43.61@tcp lock: 000000004f367ded/0x3234de053c5421e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e7b158553dd60a0 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.250472:0:164160:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004f367ded already unused, calling callback (0000000083828851) 10000000:00010000:1.0:1651529552.250474:0:164160:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC10.240.43.61@tcp lock: 000000004f367ded/0x3234de053c5421e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7e7b158553dd60a0 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.250479:0:164160:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 000000004f367ded/0x3234de053c5421e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7e7b158553dd60a0 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1651529552.250482:0:164160:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 000000004f367ded/0x3234de053c5421e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7e7b158553dd60a0 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651529552.250484:0:164160:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1651529552.250501:0:164160:0:(ldlm_request.c:1300:ldlm_cancel_pack()) ### packing ns: MGC10.240.43.61@tcp lock: 000000004f367ded/0x3234de053c5421e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x7e7b158553dd60a0 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.250504:0:164160:0:(ldlm_request.c:1304:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1651529552.250526:0:164160:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC10.240.43.61@tcp lock: 000000004f367ded/0x3234de053c5421e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x7e7b158553dd60a0 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.250529:0:164160:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 000000004f367ded/0x3234de053c5421e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x7e7b158553dd60a0 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529552.250564:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000fe04db9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:80ea30fd-09f1-4f9c-9e17-5deadaf30925:39100:1731745997081152:10.240.43.61@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1651529552.251140:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000fe04db9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:80ea30fd-09f1-4f9c-9e17-5deadaf30925:39100:1731745997081152:10.240.43.61@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529552.608464:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529552.608496:0:164166:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946686976 00000100:00100000:0.0:1651529552.608509:0:164166:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 1 00000100:00100000:0.0:1651529552.608511:0:164166:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005529fd8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:39028:x1731745946686976:12345-10.240.43.61@tcp:8:kworker/u4:2.0 00010000:00080000:0.0:1651529552.608522:0:164166:0:(ldlm_lib.c:1365:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@10.240.43.61@tcp t0 exp 0000000055bfac58 cur 20211 last 0 00000020:00000080:0.0:1651529552.608535:0:164166:0:(genops.c:1359:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3234de053c54241 00002000:00100000:0.0:1651529552.608540:0:164166:0:(ofd_obd.c:150:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/00000000a5cb0f7c ocd_connect_flags: 0x2044401443000066 ocd_version: 20f0000 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1651529552.608541:0:164166:0:(ofd_obd.c:168:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1651529552.608543:0:164166:0:(ofd_obd.c:257:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000020:01000000:0.0:1651529552.608573:0:164166:0:(lprocfs_status_server.c:544:lprocfs_exp_setup()) using hash 00000000958a682c 00002000:00080000:0.0:1651529552.608591:0:164166:0:(ofd_obd.c:391:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1651529552.608602:0:164166:0:(import.c:85:import_set_state_nolock()) 0000000096996198 %óàà”ÿÿ: changing import state from RECOVER to FULL 00000100:00100000:0.0:1651529552.608624:0:164166:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005529fd8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39028:x1731745946686976:12345-10.240.43.61@tcp:8:kworker/u4:2.0 Request processed in 112us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529552.608627:0:164166:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 1 00000100:00100000:1.0:1651529552.608897:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529552.608909:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529552.608918:0:164167:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946687168 00000100:00100000:1.0:1651529552.608921:0:164168:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946687104 00000100:00100000:1.0:1651529552.608931:0:164168:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 1 00000100:00100000:1.0:1651529552.608934:0:164168:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0bff89e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946687104:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00000100:00100000:0.0:1651529552.608935:0:164167:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 2 00000100:00100000:0.0:1651529552.608938:0:164167:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000036d32101 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:207096:x1731745946687168:12345-10.240.43.61@tcp:5:osp-pre-1-0.0 00002000:00000024:1.0:1651529552.608944:0:164168:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8717760 pending 0 free 81309134848 avail 77138423808 00000100:00100000:1.0:1651529552.608961:0:164168:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0bff89e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946687104:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 27us (51us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529552.608965:0:164168:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 1 00002000:00080000:0.0:1651529552.609449:0:164167:0:(ofd_fs.c:445:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1651529552.609452:0:164167:0:(ofd_dev.c:1586:ofd_create_hdl()) ofd_last_id() = 179521 -> diff = -96 00002000:02000040:0.0:1651529552.609454:0:164167:0:(ofd_dev.c:1442:ofd_orphans_destroy()) lustre-OST0001: deleting orphan objects from 0x0:179426 to 0x0:179521 00002000:00010000:0.0:1651529552.611590:0:164167:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529552.611594:0:164167:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c54248 lrc: 3/0,1 mode: --/PW res: [0x2bd41:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.611601:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.611602:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.611604:0:164167:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c54248 lrc: 3/0,1 mode: PW/PW res: [0x2bd41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.611612:0:164167:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c54248 lrc: 3/0,1 mode: PW/PW res: [0x2bd41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.611616:0:164167:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c54248 lrc: 3/0,1 mode: PW/PW res: [0x2bd41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.611619:0:164167:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c54248 lrc: 2/0,0 mode: PW/PW res: [0x2bd41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.611645:0:164159:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c54248 lrc: 2/0,0 mode: PW/PW res: [0x2bd41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.611650:0:164159:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007c1cad42 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529552.611652:0:164159:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c54248 lrc: 2/0,0 mode: PW/PW res: [0x2bd41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.611656:0:164159:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c54248 lrc: 3/0,0 mode: PW/PW res: [0x2bd41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.611664:0:164159:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c54248 lrc: 1/0,0 mode: --/PW res: [0x2bd41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.611667:0:164159:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c54248 lrc: 0/0,0 mode: --/PW res: [0x2bd41:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529552.611925:0:164167:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529552.611928:0:164167:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c5424f lrc: 3/0,1 mode: --/PW res: [0x2bd40:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.611932:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.611932:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.611933:0:164167:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c5424f lrc: 3/0,1 mode: PW/PW res: [0x2bd40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.611937:0:164167:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c5424f lrc: 3/0,1 mode: PW/PW res: [0x2bd40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.611940:0:164167:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c5424f lrc: 3/0,1 mode: PW/PW res: [0x2bd40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.611943:0:164167:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c5424f lrc: 2/0,0 mode: PW/PW res: [0x2bd40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.611956:0:164160:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c5424f lrc: 2/0,0 mode: PW/PW res: [0x2bd40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.611960:0:164160:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000062f8a534 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529552.611961:0:164160:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c5424f lrc: 2/0,0 mode: PW/PW res: [0x2bd40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.611967:0:164160:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c5424f lrc: 3/0,0 mode: PW/PW res: [0x2bd40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.611972:0:164160:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c5424f lrc: 1/0,0 mode: --/PW res: [0x2bd40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.611974:0:164160:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c5424f lrc: 0/0,0 mode: --/PW res: [0x2bd40:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529552.612183:0:164167:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529552.612185:0:164167:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c54256 lrc: 3/0,1 mode: --/PW res: [0x2bd3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.612188:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.612189:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.612190:0:164167:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c54256 lrc: 3/0,1 mode: PW/PW res: [0x2bd3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.612194:0:164167:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c54256 lrc: 3/0,1 mode: PW/PW res: [0x2bd3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.612197:0:164167:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c54256 lrc: 3/0,1 mode: PW/PW res: [0x2bd3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.612200:0:164167:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c54256 lrc: 2/0,0 mode: PW/PW res: [0x2bd3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.612210:0:164159:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c54256 lrc: 2/0,0 mode: PW/PW res: [0x2bd3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.612214:0:164159:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000baeec0a3 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529552.612215:0:164159:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c54256 lrc: 2/0,0 mode: PW/PW res: [0x2bd3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.612217:0:164159:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c54256 lrc: 3/0,0 mode: PW/PW res: [0x2bd3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.612230:0:164159:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c54256 lrc: 1/0,0 mode: --/PW res: [0x2bd3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.612233:0:164159:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c54256 lrc: 0/0,0 mode: --/PW res: [0x2bd3f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529552.612445:0:164167:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529552.612447:0:164167:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c5425d lrc: 3/0,1 mode: --/PW res: [0x2bd3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.612451:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.612451:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.612452:0:164167:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c5425d lrc: 3/0,1 mode: PW/PW res: [0x2bd3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.612456:0:164167:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c5425d lrc: 3/0,1 mode: PW/PW res: [0x2bd3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.612459:0:164167:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c5425d lrc: 3/0,1 mode: PW/PW res: [0x2bd3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.612462:0:164167:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c5425d lrc: 2/0,0 mode: PW/PW res: [0x2bd3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.612472:0:164160:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c5425d lrc: 2/0,0 mode: PW/PW res: [0x2bd3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.612476:0:164160:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2d8d18b already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529552.612477:0:164160:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c5425d lrc: 2/0,0 mode: PW/PW res: [0x2bd3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.612480:0:164160:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c5425d lrc: 3/0,0 mode: PW/PW res: [0x2bd3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.612483:0:164160:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c5425d lrc: 1/0,0 mode: --/PW res: [0x2bd3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.612486:0:164160:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c5425d lrc: 0/0,0 mode: --/PW res: [0x2bd3e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529552.612695:0:164167:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529552.612697:0:164167:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c54264 lrc: 3/0,1 mode: --/PW res: [0x2bd3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.612703:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.612704:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.612705:0:164167:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c54264 lrc: 3/0,1 mode: PW/PW res: [0x2bd3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.612708:0:164167:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c54264 lrc: 3/0,1 mode: PW/PW res: [0x2bd3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.612711:0:164167:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c54264 lrc: 3/0,1 mode: PW/PW res: [0x2bd3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.612714:0:164167:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c54264 lrc: 2/0,0 mode: PW/PW res: [0x2bd3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.612724:0:164159:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c54264 lrc: 2/0,0 mode: PW/PW res: [0x2bd3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.612728:0:164159:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000003af78ab already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529552.612729:0:164159:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c54264 lrc: 2/0,0 mode: PW/PW res: [0x2bd3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.612732:0:164159:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c54264 lrc: 3/0,0 mode: PW/PW res: [0x2bd3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.612735:0:164159:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c54264 lrc: 1/0,0 mode: --/PW res: [0x2bd3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.612738:0:164159:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c54264 lrc: 0/0,0 mode: --/PW res: [0x2bd3d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529552.612957:0:164167:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529552.612959:0:164167:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c5426b lrc: 3/0,1 mode: --/PW res: [0x2bd3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.612963:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.612964:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.612965:0:164167:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c5426b lrc: 3/0,1 mode: PW/PW res: [0x2bd3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.612968:0:164167:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c5426b lrc: 3/0,1 mode: PW/PW res: [0x2bd3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.612972:0:164167:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c5426b lrc: 3/0,1 mode: PW/PW res: [0x2bd3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.612977:0:164167:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c5426b lrc: 2/0,0 mode: PW/PW res: [0x2bd3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.612988:0:164160:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c5426b lrc: 2/0,0 mode: PW/PW res: [0x2bd3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.612991:0:164160:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004f367ded already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529552.612992:0:164160:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c5426b lrc: 2/0,0 mode: PW/PW res: [0x2bd3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.612995:0:164160:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c5426b lrc: 3/0,0 mode: PW/PW res: [0x2bd3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.612999:0:164160:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c5426b lrc: 1/0,0 mode: --/PW res: [0x2bd3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.613001:0:164160:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c5426b lrc: 0/0,0 mode: --/PW res: [0x2bd3c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529552.613216:0:164167:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529552.613218:0:164167:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c54272 lrc: 3/0,1 mode: --/PW res: [0x2bd3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.613239:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.613240:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.613241:0:164167:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c54272 lrc: 3/0,1 mode: PW/PW res: [0x2bd3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.613245:0:164167:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c54272 lrc: 3/0,1 mode: PW/PW res: [0x2bd3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.613248:0:164167:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c54272 lrc: 3/0,1 mode: PW/PW res: [0x2bd3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.613251:0:164167:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c54272 lrc: 2/0,0 mode: PW/PW res: [0x2bd3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.613261:0:164159:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c54272 lrc: 2/0,0 mode: PW/PW res: [0x2bd3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.613264:0:164159:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d84ad17b already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529552.613265:0:164159:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c54272 lrc: 2/0,0 mode: PW/PW res: [0x2bd3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.613268:0:164159:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c54272 lrc: 3/0,0 mode: PW/PW res: [0x2bd3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.613272:0:164159:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c54272 lrc: 1/0,0 mode: --/PW res: [0x2bd3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.613275:0:164159:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c54272 lrc: 0/0,0 mode: --/PW res: [0x2bd3b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529552.613500:0:164167:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529552.613502:0:164167:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c54279 lrc: 3/0,1 mode: --/PW res: [0x2bd3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.613506:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.613506:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.613507:0:164167:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c54279 lrc: 3/0,1 mode: PW/PW res: [0x2bd3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.613511:0:164167:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c54279 lrc: 3/0,1 mode: PW/PW res: [0x2bd3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.613514:0:164167:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c54279 lrc: 3/0,1 mode: PW/PW res: [0x2bd3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.613517:0:164167:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c54279 lrc: 2/0,0 mode: PW/PW res: [0x2bd3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.613527:0:164160:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c54279 lrc: 2/0,0 mode: PW/PW res: [0x2bd3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.613530:0:164160:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000029b2a516 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529552.613531:0:164160:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c54279 lrc: 2/0,0 mode: PW/PW res: [0x2bd3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.613534:0:164160:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c54279 lrc: 3/0,0 mode: PW/PW res: [0x2bd3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.613538:0:164160:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c54279 lrc: 1/0,0 mode: --/PW res: [0x2bd3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.613540:0:164160:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c54279 lrc: 0/0,0 mode: --/PW res: [0x2bd3a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529552.613745:0:164167:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529552.613747:0:164167:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c54280 lrc: 3/0,1 mode: --/PW res: [0x2bd39:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.613751:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.613752:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.613753:0:164167:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c54280 lrc: 3/0,1 mode: PW/PW res: [0x2bd39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.613756:0:164167:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c54280 lrc: 3/0,1 mode: PW/PW res: [0x2bd39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.613759:0:164167:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c54280 lrc: 3/0,1 mode: PW/PW res: [0x2bd39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.613762:0:164167:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c54280 lrc: 2/0,0 mode: PW/PW res: [0x2bd39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.613775:0:164159:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c54280 lrc: 2/0,0 mode: PW/PW res: [0x2bd39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.613778:0:164159:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001ea46bb1 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529552.613779:0:164159:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c54280 lrc: 2/0,0 mode: PW/PW res: [0x2bd39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.613784:0:164159:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c54280 lrc: 3/0,0 mode: PW/PW res: [0x2bd39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.613788:0:164159:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c54280 lrc: 1/0,0 mode: --/PW res: [0x2bd39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.613791:0:164159:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c54280 lrc: 0/0,0 mode: --/PW res: [0x2bd39:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529552.614004:0:164167:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529552.614006:0:164167:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c54287 lrc: 3/0,1 mode: --/PW res: [0x2bd38:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.614010:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.614011:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.614011:0:164167:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c54287 lrc: 3/0,1 mode: PW/PW res: [0x2bd38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.614015:0:164167:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c54287 lrc: 3/0,1 mode: PW/PW res: [0x2bd38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.614018:0:164167:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c54287 lrc: 3/0,1 mode: PW/PW res: [0x2bd38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.614021:0:164167:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c54287 lrc: 2/0,0 mode: PW/PW res: [0x2bd38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.614032:0:164160:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c54287 lrc: 2/0,0 mode: PW/PW res: [0x2bd38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.614035:0:164160:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2a86deb already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529552.614036:0:164160:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c54287 lrc: 2/0,0 mode: PW/PW res: [0x2bd38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.614038:0:164160:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c54287 lrc: 3/0,0 mode: PW/PW res: [0x2bd38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.614042:0:164160:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c54287 lrc: 1/0,0 mode: --/PW res: [0x2bd38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.614045:0:164160:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c54287 lrc: 0/0,0 mode: --/PW res: [0x2bd38:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529552.614258:0:164167:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529552.614260:0:164167:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5428e lrc: 3/0,1 mode: --/PW res: [0x2bd37:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.614264:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.614264:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.614265:0:164167:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5428e lrc: 3/0,1 mode: PW/PW res: [0x2bd37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.614269:0:164167:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5428e lrc: 3/0,1 mode: PW/PW res: [0x2bd37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.614272:0:164167:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5428e lrc: 3/0,1 mode: PW/PW res: [0x2bd37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.614275:0:164167:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5428e lrc: 2/0,0 mode: PW/PW res: [0x2bd37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.614285:0:164159:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5428e lrc: 2/0,0 mode: PW/PW res: [0x2bd37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.614289:0:164159:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000029958df2 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529552.614290:0:164159:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5428e lrc: 2/0,0 mode: PW/PW res: [0x2bd37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.614293:0:164159:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5428e lrc: 3/0,0 mode: PW/PW res: [0x2bd37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.614297:0:164159:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5428e lrc: 1/0,0 mode: --/PW res: [0x2bd37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.614299:0:164159:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c5428e lrc: 0/0,0 mode: --/PW res: [0x2bd37:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529552.614505:0:164167:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529552.614507:0:164167:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c54295 lrc: 3/0,1 mode: --/PW res: [0x2bd36:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.614510:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.614511:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.614512:0:164167:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c54295 lrc: 3/0,1 mode: PW/PW res: [0x2bd36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.614516:0:164167:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c54295 lrc: 3/0,1 mode: PW/PW res: [0x2bd36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.614519:0:164167:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c54295 lrc: 3/0,1 mode: PW/PW res: [0x2bd36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.614521:0:164167:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c54295 lrc: 2/0,0 mode: PW/PW res: [0x2bd36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.614531:0:164160:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c54295 lrc: 2/0,0 mode: PW/PW res: [0x2bd36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.614535:0:164160:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bdf2b6c4 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529552.614536:0:164160:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c54295 lrc: 2/0,0 mode: PW/PW res: [0x2bd36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.614539:0:164160:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c54295 lrc: 3/0,0 mode: PW/PW res: [0x2bd36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.614542:0:164160:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c54295 lrc: 1/0,0 mode: --/PW res: [0x2bd36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.614545:0:164160:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c54295 lrc: 0/0,0 mode: --/PW res: [0x2bd36:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529552.614747:0:164167:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529552.614749:0:164167:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c5429c lrc: 3/0,1 mode: --/PW res: [0x2bd35:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.614755:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.614756:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.614757:0:164167:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c5429c lrc: 3/0,1 mode: PW/PW res: [0x2bd35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.614760:0:164167:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c5429c lrc: 3/0,1 mode: PW/PW res: [0x2bd35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.614763:0:164167:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c5429c lrc: 3/0,1 mode: PW/PW res: [0x2bd35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.614766:0:164167:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c5429c lrc: 2/0,0 mode: PW/PW res: [0x2bd35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.614776:0:164159:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c5429c lrc: 2/0,0 mode: PW/PW res: [0x2bd35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.614779:0:164159:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000feb9d3da already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529552.614780:0:164159:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c5429c lrc: 2/0,0 mode: PW/PW res: [0x2bd35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.614783:0:164159:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c5429c lrc: 3/0,0 mode: PW/PW res: [0x2bd35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.614787:0:164159:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c5429c lrc: 1/0,0 mode: --/PW res: [0x2bd35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.614789:0:164159:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c5429c lrc: 0/0,0 mode: --/PW res: [0x2bd35:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529552.615003:0:164167:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529552.615005:0:164167:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c542a3 lrc: 3/0,1 mode: --/PW res: [0x2bd34:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.615008:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.615009:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.615010:0:164167:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c542a3 lrc: 3/0,1 mode: PW/PW res: [0x2bd34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.615014:0:164167:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c542a3 lrc: 3/0,1 mode: PW/PW res: [0x2bd34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.615017:0:164167:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c542a3 lrc: 3/0,1 mode: PW/PW res: [0x2bd34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.615022:0:164167:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c542a3 lrc: 2/0,0 mode: PW/PW res: [0x2bd34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.615033:0:164160:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c542a3 lrc: 2/0,0 mode: PW/PW res: [0x2bd34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.615036:0:164160:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e48e0bfd already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529552.615037:0:164160:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c542a3 lrc: 2/0,0 mode: PW/PW res: [0x2bd34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.615039:0:164160:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c542a3 lrc: 3/0,0 mode: PW/PW res: [0x2bd34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.615043:0:164160:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c542a3 lrc: 1/0,0 mode: --/PW res: [0x2bd34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.615047:0:164160:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c542a3 lrc: 0/0,0 mode: --/PW res: [0x2bd34:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529552.615264:0:164167:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529552.615266:0:164167:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c542aa lrc: 3/0,1 mode: --/PW res: [0x2bd33:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.615270:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.615270:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.615271:0:164167:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c542aa lrc: 3/0,1 mode: PW/PW res: [0x2bd33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.615275:0:164167:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c542aa lrc: 3/0,1 mode: PW/PW res: [0x2bd33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.615278:0:164167:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c542aa lrc: 3/0,1 mode: PW/PW res: [0x2bd33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.615281:0:164167:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c542aa lrc: 2/0,0 mode: PW/PW res: [0x2bd33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.615290:0:164159:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c542aa lrc: 2/0,0 mode: PW/PW res: [0x2bd33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.615294:0:164159:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000066921086 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529552.615295:0:164159:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c542aa lrc: 2/0,0 mode: PW/PW res: [0x2bd33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.615298:0:164159:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c542aa lrc: 3/0,0 mode: PW/PW res: [0x2bd33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.615301:0:164159:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c542aa lrc: 1/0,0 mode: --/PW res: [0x2bd33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.615304:0:164159:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c542aa lrc: 0/0,0 mode: --/PW res: [0x2bd33:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529552.615507:0:164167:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529552.615509:0:164167:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c542b1 lrc: 3/0,1 mode: --/PW res: [0x2bd32:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.615512:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.615513:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.615514:0:164167:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c542b1 lrc: 3/0,1 mode: PW/PW res: [0x2bd32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.615518:0:164167:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c542b1 lrc: 3/0,1 mode: PW/PW res: [0x2bd32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.615521:0:164167:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c542b1 lrc: 3/0,1 mode: PW/PW res: [0x2bd32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.615523:0:164167:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c542b1 lrc: 2/0,0 mode: PW/PW res: [0x2bd32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.615533:0:164160:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c542b1 lrc: 2/0,0 mode: PW/PW res: [0x2bd32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.615536:0:164160:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dd6b1be4 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529552.615537:0:164160:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c542b1 lrc: 2/0,0 mode: PW/PW res: [0x2bd32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.615543:0:164160:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c542b1 lrc: 3/0,0 mode: PW/PW res: [0x2bd32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.615547:0:164160:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c542b1 lrc: 1/0,0 mode: --/PW res: [0x2bd32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.615549:0:164160:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c542b1 lrc: 0/0,0 mode: --/PW res: [0x2bd32:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529552.615749:0:164167:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529552.615751:0:164167:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c542b8 lrc: 3/0,1 mode: --/PW res: [0x2bd31:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.615755:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.615755:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.615756:0:164167:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c542b8 lrc: 3/0,1 mode: PW/PW res: [0x2bd31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.615760:0:164167:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c542b8 lrc: 3/0,1 mode: PW/PW res: [0x2bd31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.615763:0:164167:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c542b8 lrc: 3/0,1 mode: PW/PW res: [0x2bd31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.615766:0:164167:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c542b8 lrc: 2/0,0 mode: PW/PW res: [0x2bd31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.615779:0:164159:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c542b8 lrc: 2/0,0 mode: PW/PW res: [0x2bd31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.615782:0:164159:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004b2a6b06 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529552.615782:0:164159:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c542b8 lrc: 2/0,0 mode: PW/PW res: [0x2bd31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.615785:0:164159:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c542b8 lrc: 3/0,0 mode: PW/PW res: [0x2bd31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.615789:0:164159:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c542b8 lrc: 1/0,0 mode: --/PW res: [0x2bd31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.615791:0:164159:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c542b8 lrc: 0/0,0 mode: --/PW res: [0x2bd31:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529552.616003:0:164167:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529552.616005:0:164167:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c542bf lrc: 3/0,1 mode: --/PW res: [0x2bd30:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.616009:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.616009:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.616010:0:164167:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c542bf lrc: 3/0,1 mode: PW/PW res: [0x2bd30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.616014:0:164167:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c542bf lrc: 3/0,1 mode: PW/PW res: [0x2bd30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.616017:0:164167:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c542bf lrc: 3/0,1 mode: PW/PW res: [0x2bd30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.616020:0:164167:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c542bf lrc: 2/0,0 mode: PW/PW res: [0x2bd30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.616030:0:164160:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c542bf lrc: 2/0,0 mode: PW/PW res: [0x2bd30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.616034:0:164160:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000090e99444 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529552.616035:0:164160:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c542bf lrc: 2/0,0 mode: PW/PW res: [0x2bd30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.616037:0:164160:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c542bf lrc: 3/0,0 mode: PW/PW res: [0x2bd30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.616041:0:164160:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c542bf lrc: 1/0,0 mode: --/PW res: [0x2bd30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.616044:0:164160:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c542bf lrc: 0/0,0 mode: --/PW res: [0x2bd30:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529552.616252:0:164167:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529552.616254:0:164167:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c542c6 lrc: 3/0,1 mode: --/PW res: [0x2bd2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.616258:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.616258:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.616259:0:164167:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c542c6 lrc: 3/0,1 mode: PW/PW res: [0x2bd2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.616263:0:164167:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c542c6 lrc: 3/0,1 mode: PW/PW res: [0x2bd2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.616266:0:164167:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c542c6 lrc: 3/0,1 mode: PW/PW res: [0x2bd2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.616269:0:164167:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c542c6 lrc: 2/0,0 mode: PW/PW res: [0x2bd2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.616279:0:164159:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c542c6 lrc: 2/0,0 mode: PW/PW res: [0x2bd2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.616282:0:164159:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000014fe598c already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529552.616283:0:164159:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c542c6 lrc: 2/0,0 mode: PW/PW res: [0x2bd2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.616286:0:164159:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c542c6 lrc: 3/0,0 mode: PW/PW res: [0x2bd2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.616290:0:164159:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c542c6 lrc: 1/0,0 mode: --/PW res: [0x2bd2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.616292:0:164159:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c542c6 lrc: 0/0,0 mode: --/PW res: [0x2bd2f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529552.616498:0:164167:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529552.616500:0:164167:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c542cd lrc: 3/0,1 mode: --/PW res: [0x2bd2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.616503:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.616504:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.616504:0:164167:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c542cd lrc: 3/0,1 mode: PW/PW res: [0x2bd2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.616508:0:164167:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c542cd lrc: 3/0,1 mode: PW/PW res: [0x2bd2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.616511:0:164167:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c542cd lrc: 3/0,1 mode: PW/PW res: [0x2bd2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.616514:0:164167:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c542cd lrc: 2/0,0 mode: PW/PW res: [0x2bd2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.616524:0:164160:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c542cd lrc: 2/0,0 mode: PW/PW res: [0x2bd2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.616528:0:164160:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba437fe0 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529552.616528:0:164160:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c542cd lrc: 2/0,0 mode: PW/PW res: [0x2bd2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.616531:0:164160:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c542cd lrc: 3/0,0 mode: PW/PW res: [0x2bd2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.616535:0:164160:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c542cd lrc: 1/0,0 mode: --/PW res: [0x2bd2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.616537:0:164160:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c542cd lrc: 0/0,0 mode: --/PW res: [0x2bd2e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529552.616746:0:164167:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529552.616748:0:164167:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c542d4 lrc: 3/0,1 mode: --/PW res: [0x2bd2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.616754:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.616755:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.616756:0:164167:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c542d4 lrc: 3/0,1 mode: PW/PW res: [0x2bd2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.616759:0:164167:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c542d4 lrc: 3/0,1 mode: PW/PW res: [0x2bd2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.616762:0:164167:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c542d4 lrc: 3/0,1 mode: PW/PW res: [0x2bd2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.616765:0:164167:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c542d4 lrc: 2/0,0 mode: PW/PW res: [0x2bd2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.616776:0:164159:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c542d4 lrc: 2/0,0 mode: PW/PW res: [0x2bd2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.616779:0:164159:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ebdbebae already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529552.616780:0:164159:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c542d4 lrc: 2/0,0 mode: PW/PW res: [0x2bd2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.616782:0:164159:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c542d4 lrc: 3/0,0 mode: PW/PW res: [0x2bd2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.616786:0:164159:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c542d4 lrc: 1/0,0 mode: --/PW res: [0x2bd2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.616789:0:164159:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c542d4 lrc: 0/0,0 mode: --/PW res: [0x2bd2d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529552.617013:0:164167:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529552.617015:0:164167:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c542db lrc: 3/0,1 mode: --/PW res: [0x2bd2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.617019:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.617019:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.617020:0:164167:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c542db lrc: 3/0,1 mode: PW/PW res: [0x2bd2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.617024:0:164167:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c542db lrc: 3/0,1 mode: PW/PW res: [0x2bd2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.617027:0:164167:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c542db lrc: 3/0,1 mode: PW/PW res: [0x2bd2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.617032:0:164167:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c542db lrc: 2/0,0 mode: PW/PW res: [0x2bd2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.617043:0:164160:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c542db lrc: 2/0,0 mode: PW/PW res: [0x2bd2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.617046:0:164160:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006cbd0d09 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529552.617047:0:164160:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c542db lrc: 2/0,0 mode: PW/PW res: [0x2bd2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.617050:0:164160:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c542db lrc: 3/0,0 mode: PW/PW res: [0x2bd2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.617054:0:164160:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c542db lrc: 1/0,0 mode: --/PW res: [0x2bd2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.617056:0:164160:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c542db lrc: 0/0,0 mode: --/PW res: [0x2bd2c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529552.617267:0:164167:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529552.617269:0:164167:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c542e2 lrc: 3/0,1 mode: --/PW res: [0x2bd2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.617273:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.617273:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.617274:0:164167:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c542e2 lrc: 3/0,1 mode: PW/PW res: [0x2bd2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.617278:0:164167:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c542e2 lrc: 3/0,1 mode: PW/PW res: [0x2bd2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.617281:0:164167:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c542e2 lrc: 3/0,1 mode: PW/PW res: [0x2bd2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.617283:0:164167:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c542e2 lrc: 2/0,0 mode: PW/PW res: [0x2bd2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.617293:0:164159:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c542e2 lrc: 2/0,0 mode: PW/PW res: [0x2bd2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.617296:0:164159:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cd5f3a7c already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529552.617297:0:164159:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c542e2 lrc: 2/0,0 mode: PW/PW res: [0x2bd2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.617302:0:164159:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c542e2 lrc: 3/0,0 mode: PW/PW res: [0x2bd2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.617306:0:164159:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c542e2 lrc: 1/0,0 mode: --/PW res: [0x2bd2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.617309:0:164159:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c542e2 lrc: 0/0,0 mode: --/PW res: [0x2bd2b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529552.617511:0:164167:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529552.617513:0:164167:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c542e9 lrc: 3/0,1 mode: --/PW res: [0x2bd2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.617517:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.617517:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.617518:0:164167:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c542e9 lrc: 3/0,1 mode: PW/PW res: [0x2bd2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.617522:0:164167:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c542e9 lrc: 3/0,1 mode: PW/PW res: [0x2bd2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.617525:0:164167:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c542e9 lrc: 3/0,1 mode: PW/PW res: [0x2bd2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.617528:0:164167:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c542e9 lrc: 2/0,0 mode: PW/PW res: [0x2bd2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.617538:0:164160:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c542e9 lrc: 2/0,0 mode: PW/PW res: [0x2bd2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.617541:0:164160:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000314b5fa1 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529552.617542:0:164160:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c542e9 lrc: 2/0,0 mode: PW/PW res: [0x2bd2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.617545:0:164160:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c542e9 lrc: 3/0,0 mode: PW/PW res: [0x2bd2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.617548:0:164160:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c542e9 lrc: 1/0,0 mode: --/PW res: [0x2bd2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.617551:0:164160:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c542e9 lrc: 0/0,0 mode: --/PW res: [0x2bd2a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529552.617758:0:164167:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529552.617760:0:164167:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c542f0 lrc: 3/0,1 mode: --/PW res: [0x2bd29:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.617764:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.617764:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.617765:0:164167:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c542f0 lrc: 3/0,1 mode: PW/PW res: [0x2bd29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.617769:0:164167:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c542f0 lrc: 3/0,1 mode: PW/PW res: [0x2bd29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.617772:0:164167:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c542f0 lrc: 3/0,1 mode: PW/PW res: [0x2bd29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.617775:0:164167:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c542f0 lrc: 2/0,0 mode: PW/PW res: [0x2bd29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.617787:0:164159:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c542f0 lrc: 2/0,0 mode: PW/PW res: [0x2bd29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.617791:0:164159:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005e711cee already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529552.617792:0:164159:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c542f0 lrc: 2/0,0 mode: PW/PW res: [0x2bd29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.617795:0:164159:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c542f0 lrc: 3/0,0 mode: PW/PW res: [0x2bd29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.617798:0:164159:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c542f0 lrc: 1/0,0 mode: --/PW res: [0x2bd29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.617801:0:164159:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e711cee/0x3234de053c542f0 lrc: 0/0,0 mode: --/PW res: [0x2bd29:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529552.618011:0:164167:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529552.618013:0:164167:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c542f7 lrc: 3/0,1 mode: --/PW res: [0x2bd28:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.618017:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.618017:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.618018:0:164167:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c542f7 lrc: 3/0,1 mode: PW/PW res: [0x2bd28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.618022:0:164167:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c542f7 lrc: 3/0,1 mode: PW/PW res: [0x2bd28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.618025:0:164167:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c542f7 lrc: 3/0,1 mode: PW/PW res: [0x2bd28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.618028:0:164167:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c542f7 lrc: 2/0,0 mode: PW/PW res: [0x2bd28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.618038:0:164160:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c542f7 lrc: 2/0,0 mode: PW/PW res: [0x2bd28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.618041:0:164160:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000042bde05b already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529552.618042:0:164160:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c542f7 lrc: 2/0,0 mode: PW/PW res: [0x2bd28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.618045:0:164160:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c542f7 lrc: 3/0,0 mode: PW/PW res: [0x2bd28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.618049:0:164160:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c542f7 lrc: 1/0,0 mode: --/PW res: [0x2bd28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.618051:0:164160:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042bde05b/0x3234de053c542f7 lrc: 0/0,0 mode: --/PW res: [0x2bd28:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529552.618283:0:164167:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529552.618286:0:164167:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c542fe lrc: 3/0,1 mode: --/PW res: [0x2bd27:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.618290:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.618291:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.618292:0:164167:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c542fe lrc: 3/0,1 mode: PW/PW res: [0x2bd27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.618295:0:164167:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c542fe lrc: 3/0,1 mode: PW/PW res: [0x2bd27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.618299:0:164167:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c542fe lrc: 3/0,1 mode: PW/PW res: [0x2bd27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.618301:0:164167:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c542fe lrc: 2/0,0 mode: PW/PW res: [0x2bd27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.618318:0:164159:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c542fe lrc: 2/0,0 mode: PW/PW res: [0x2bd27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.618323:0:164159:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000916cff2 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529552.618324:0:164159:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c542fe lrc: 2/0,0 mode: PW/PW res: [0x2bd27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.618327:0:164159:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c542fe lrc: 3/0,0 mode: PW/PW res: [0x2bd27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.618332:0:164159:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c542fe lrc: 1/0,0 mode: --/PW res: [0x2bd27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.618334:0:164159:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000916cff2/0x3234de053c542fe lrc: 0/0,0 mode: --/PW res: [0x2bd27:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529552.618558:0:164167:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529552.618562:0:164167:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c54305 lrc: 3/0,1 mode: --/PW res: [0x2bd26:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.618568:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.618569:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.618570:0:164167:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c54305 lrc: 3/0,1 mode: PW/PW res: [0x2bd26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.618576:0:164167:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c54305 lrc: 3/0,1 mode: PW/PW res: [0x2bd26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.618579:0:164167:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c54305 lrc: 3/0,1 mode: PW/PW res: [0x2bd26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.618582:0:164167:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c54305 lrc: 2/0,0 mode: PW/PW res: [0x2bd26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.618596:0:164160:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c54305 lrc: 2/0,0 mode: PW/PW res: [0x2bd26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.618600:0:164160:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005b8e72f9 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529552.618601:0:164160:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c54305 lrc: 2/0,0 mode: PW/PW res: [0x2bd26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.618604:0:164160:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c54305 lrc: 3/0,0 mode: PW/PW res: [0x2bd26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.618608:0:164160:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c54305 lrc: 1/0,0 mode: --/PW res: [0x2bd26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.618611:0:164160:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b8e72f9/0x3234de053c54305 lrc: 0/0,0 mode: --/PW res: [0x2bd26:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529552.618819:0:164167:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529552.618822:0:164167:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c5430c lrc: 3/0,1 mode: --/PW res: [0x2bd25:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.618831:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.618832:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.618833:0:164167:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c5430c lrc: 3/0,1 mode: PW/PW res: [0x2bd25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.618840:0:164167:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c5430c lrc: 3/0,1 mode: PW/PW res: [0x2bd25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.618845:0:164167:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c5430c lrc: 3/0,1 mode: PW/PW res: [0x2bd25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.618863:0:164167:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c5430c lrc: 2/0,0 mode: PW/PW res: [0x2bd25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.618878:0:164159:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c5430c lrc: 2/0,0 mode: PW/PW res: [0x2bd25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.618881:0:164159:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000096ab8041 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529552.618882:0:164159:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c5430c lrc: 2/0,0 mode: PW/PW res: [0x2bd25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.618885:0:164159:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c5430c lrc: 3/0,0 mode: PW/PW res: [0x2bd25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.618888:0:164159:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c5430c lrc: 1/0,0 mode: --/PW res: [0x2bd25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.618891:0:164159:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096ab8041/0x3234de053c5430c lrc: 0/0,0 mode: --/PW res: [0x2bd25:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529552.619168:0:164167:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529552.619170:0:164167:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c54313 lrc: 3/0,1 mode: --/PW res: [0x2bd24:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.619174:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.619175:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.619176:0:164167:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c54313 lrc: 3/0,1 mode: PW/PW res: [0x2bd24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.619179:0:164167:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c54313 lrc: 3/0,1 mode: PW/PW res: [0x2bd24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.619182:0:164167:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c54313 lrc: 3/0,1 mode: PW/PW res: [0x2bd24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.619188:0:164167:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c54313 lrc: 2/0,0 mode: PW/PW res: [0x2bd24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.619200:0:164160:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c54313 lrc: 2/0,0 mode: PW/PW res: [0x2bd24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.619203:0:164160:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c822bd1c already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529552.619204:0:164160:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c54313 lrc: 2/0,0 mode: PW/PW res: [0x2bd24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.619209:0:164160:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c54313 lrc: 3/0,0 mode: PW/PW res: [0x2bd24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.619214:0:164160:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c54313 lrc: 1/0,0 mode: --/PW res: [0x2bd24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.619217:0:164160:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c822bd1c/0x3234de053c54313 lrc: 0/0,0 mode: --/PW res: [0x2bd24:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529552.619439:0:164167:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529552.619441:0:164167:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c5431a lrc: 3/0,1 mode: --/PW res: [0x2bd23:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.619445:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.619446:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.619446:0:164167:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c5431a lrc: 3/0,1 mode: PW/PW res: [0x2bd23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.619450:0:164167:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c5431a lrc: 3/0,1 mode: PW/PW res: [0x2bd23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.619453:0:164167:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c5431a lrc: 3/0,1 mode: PW/PW res: [0x2bd23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.619456:0:164167:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c5431a lrc: 2/0,0 mode: PW/PW res: [0x2bd23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.619466:0:164159:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c5431a lrc: 2/0,0 mode: PW/PW res: [0x2bd23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.619469:0:164159:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000055fddd81 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529552.619470:0:164159:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c5431a lrc: 2/0,0 mode: PW/PW res: [0x2bd23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.619473:0:164159:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c5431a lrc: 3/0,0 mode: PW/PW res: [0x2bd23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.619477:0:164159:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c5431a lrc: 1/0,0 mode: --/PW res: [0x2bd23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.619480:0:164159:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055fddd81/0x3234de053c5431a lrc: 0/0,0 mode: --/PW res: [0x2bd23:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529552.619690:0:164167:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529552.619692:0:164167:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c54321 lrc: 3/0,1 mode: --/PW res: [0x2bd22:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.619695:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.619696:0:164167:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529552.619696:0:164167:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c54321 lrc: 3/0,1 mode: PW/PW res: [0x2bd22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.619701:0:164167:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c54321 lrc: 3/0,1 mode: PW/PW res: [0x2bd22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.619704:0:164167:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c54321 lrc: 3/0,1 mode: PW/PW res: [0x2bd22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529552.619706:0:164167:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c54321 lrc: 2/0,0 mode: PW/PW res: [0x2bd22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.619716:0:164160:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c54321 lrc: 2/0,0 mode: PW/PW res: [0x2bd22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.619720:0:164160:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000009fe5580 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529552.619721:0:164160:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c54321 lrc: 2/0,0 mode: PW/PW res: [0x2bd22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.619724:0:164160:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c54321 lrc: 3/0,0 mode: PW/PW res: [0x2bd22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.619728:0:164160:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c54321 lrc: 1/0,0 mode: --/PW res: [0x2bd22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529552.619730:0:164160:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009fe5580/0x3234de053c54321 lrc: 0/0,0 mode: --/PW res: [0x2bd22:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 164167 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529552.623382:0:164167:0:(ofd_dev.c:1469:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x0:179425 00000100:00100000:0.0:1651529552.623403:0:164167:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000036d32101 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:207096:x1731745946687168:12345-10.240.43.61@tcp:5:osp-pre-1-0.0 Request processed in 14464us (14505us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529552.623407:0:164167:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 2 00000100:00100000:0.0:1651529552.623649:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529552.623657:0:164167:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946687232 00000100:00100000:0.0:1651529552.623665:0:164167:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 3 00000100:00100000:0.0:1651529552.623667:0:164167:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d7328d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:207096:x1731745946687232:12345-10.240.43.61@tcp:5:osp-pre-1-0.0 00002000:00080000:0.0:1651529552.623677:0:164167:0:(ofd_dev.c:1706:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x0 at 179522 00000100:00100000:0.0:1651529552.625541:0:164167:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d7328d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:207096:x1731745946687232:12345-10.240.43.61@tcp:5:osp-pre-1-0.0 Request processed in 1872us (1892us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529552.625544:0:164167:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 3 10000000:01000000:0.0:1651529553.277265:0:164163:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:0.0:1651529553.277267:0:164163:0:(mgc_request.c:2064:mgc_process_log()) Process log params-ffff94e0d5c4c000 from 13 10000000:01000000:0.0:1651529553.277268:0:164163:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1651529553.277280:0:164163:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 00000000d9cfe902/0x3234de053c54328 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 164163 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529553.277287:0:164163:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 00000000d9cfe902/0x3234de053c54328 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 164163 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529553.277291:0:164163:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 00000000d9cfe902/0x3234de053c54328 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 164163 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529553.277300:0:164163:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c810c14 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164163:1731745997081216:10.240.43.61@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1651529553.277318:0:164163:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a5591467 going to sleep for 6 seconds 00000100:00100000:0.0:1651529553.277614:0:164163:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c810c14 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164163:1731745997081216:10.240.43.61@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1651529553.277620:0:164163:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 00000000d9cfe902/0x3234de053c54328 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd6110 expref: -99 pid: 164163 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529553.277624:0:164163:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 00000000d9cfe902/0x3234de053c54328 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553dd6110 expref: -99 pid: 164163 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529553.277648:0:164163:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c810c14 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164163:1731745997081280:10.240.43.61@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1651529553.277660:0:164163:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a5591467 going to sleep for 6 seconds 00000100:00100000:0.0:1651529553.277906:0:164163:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c810c14 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164163:1731745997081280:10.240.43.61@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1651529553.277918:0:164163:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c810c14 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164163:1731745997081344:10.240.43.61@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1651529553.277934:0:164163:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a5591467 going to sleep for 6 seconds 00000100:00100000:0.0:1651529553.278186:0:164163:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c810c14 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164163:1731745997081344:10.240.43.61@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1651529553.278291:0:164759:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c810c14 pname:cluuid:pid:xid:nid:opc:job llog_process_th:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164759:1731745997081408:10.240.43.61@tcp:502:llog_process_th.0 00000100:00100000:0.0:1651529553.278304:0:164759:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d3b2f3f7 going to sleep for 6 seconds 00000100:00100000:0.0:1651529553.278711:0:164759:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c810c14 pname:cluuid:pid:xid:nid:opc:job llog_process_th:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164759:1731745997081408:10.240.43.61@tcp:502:llog_process_th.0 00000020:01000000:0.0:1651529553.278722:0:164759:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1651529553.278725:0:164759:0:(obd_config.c:1356:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1651529553.278726:0:164759:0:(obd_config.c:1432:class_process_config()) marker 2 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1651529553.278729:0:164759:0:(obd_config.c:1885:class_config_llog_handler()) cmd ce032, instance name: general-ffff94e0d5c4c000 00000020:00000080:0.0:1651529553.278730:0:164759:0:(obd_config.c:1356:class_process_config()) processing cmd: ce032 00000020:00080000:0.0:1651529553.281004:0:164759:0:(obd_config.c:1330:process_param2_config()) lctl: invoked upcall /usr/sbin/lctl set_param lod.*.mdt_hash=crush, time 2269us 00000100:00100000:0.0:1651529553.281016:0:164759:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c810c14 pname:cluuid:pid:xid:nid:opc:job llog_process_th:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164759:1731745997081472:10.240.43.61@tcp:502:llog_process_th.0 00000100:00100000:0.0:1651529553.281033:0:164759:0:(client.c:2492:ptlrpc_set_wait()) set 000000005fbd6525 going to sleep for 6 seconds 00000100:00100000:0.0:1651529553.281279:0:164759:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c810c14 pname:cluuid:pid:xid:nid:opc:job llog_process_th:80ea30fd-09f1-4f9c-9e17-5deadaf30925:164759:1731745997081472:10.240.43.61@tcp:502:llog_process_th.0 00000020:01000000:0.0:1651529553.281287:0:164759:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1651529553.281289:0:164759:0:(obd_config.c:1356:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1651529553.281290:0:164759:0:(obd_config.c:1432:class_process_config()) marker 2 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1651529553.281292:0:164759:0:(llog.c:768:llog_process_thread()) stop processing plain 0x2:10:0 index 16 count 16 00000020:01000000:0.0:1651529553.281328:0:164163:0:(obd_config.c:2042:class_config_parse_llog()) Processed log params gen 13-15 (rc=0) 10000000:01000000:0.0:1651529553.281334:0:164163:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1651529553.281337:0:164163:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000d9cfe902/0x3234de053c54328 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd6110 expref: -99 pid: 164163 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529553.281341:0:164163:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 00000000d9cfe902/0x3234de053c54328 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd6110 expref: -99 pid: 164163 timeout: 0 lvb_type: 0 00000001:00100000:0.0:1651529554.610416:0:164152:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1651529554.610419:0:164152:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of eacddb3a-cb08-4c6c-a06f-c475ab7fdef0 00000100:00100000:0.0:1651529557.728593:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529557.728620:0:164169:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946687616 00000100:00100000:1.0:1651529557.728642:0:164169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 2 00000100:00100000:1.0:1651529557.728645:0:164169:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c810c14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946687616:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651529557.728661:0:164169:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 81309134848 avail 77138423808 00000100:00100000:1.0:1651529557.728688:0:164169:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c810c14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946687616:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 43us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529557.728692:0:164169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 2 00000400:00000080:1.0:1651529558.542155:0:164975:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651529558.542157:0:164975:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 133g: Check reads/writes of server lustre proc files with bad area io ========================================================== 22:12:38 (1651529558) 00000100:00100000:0.0:1651529559.294764:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529559.294783:0:164167:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946687936 00000100:00100000:0.0:1651529559.294804:0:164167:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 0 00000100:00100000:0.0:1651529559.294806:0:164167:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007591e43c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:208179:x1731745946687936:12345-10.240.43.61@tcp:400:lctl.0 00000100:00100000:0.0:1651529559.294844:0:164167:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007591e43c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:208179:x1731745946687936:12345-10.240.43.61@tcp:400:lctl.0 Request processed in 37us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529559.294848:0:164167:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 0 00000100:00100000:0.0:1651529559.298726:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529559.298734:0:164166:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946688064 00000100:00100000:0.0:1651529559.298742:0:164166:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 1 00000100:00100000:0.0:1651529559.298744:0:164166:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000198be7e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:208179:x1731745946688064:12345-10.240.43.61@tcp:400:lctl.0 00000100:00100000:0.0:1651529559.298762:0:164166:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000198be7e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:208179:x1731745946688064:12345-10.240.43.61@tcp:400:lctl.0 Request processed in 18us (37us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529559.298765:0:164166:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 1 00000100:00100000:0.0:1651529559.311439:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529559.311447:0:164167:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946688192 00000100:00100000:0.0:1651529559.311454:0:164167:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 2 00000100:00100000:0.0:1651529559.311456:0:164167:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fb8007ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:208179:x1731745946688192:12345-10.240.43.61@tcp:400:lctl.0 00000100:00100000:0.0:1651529559.311474:0:164167:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fb8007ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:208179:x1731745946688192:12345-10.240.43.61@tcp:400:lctl.0 Request processed in 17us (35us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529559.311477:0:164167:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 2 00000100:00100000:0.0:1651529559.314831:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529559.314839:0:164166:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946688320 00000100:00100000:0.0:1651529559.314846:0:164166:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 3 00000100:00100000:0.0:1651529559.314848:0:164166:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000092e14270 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:208179:x1731745946688320:12345-10.240.43.61@tcp:400:lctl.0 00000100:00100000:0.0:1651529559.314874:0:164166:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000092e14270 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:208179:x1731745946688320:12345-10.240.43.61@tcp:400:lctl.0 Request processed in 25us (43us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529559.314877:0:164166:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 3 00000100:00100000:0.0:1651529559.418244:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529559.418253:0:164167:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946688576 00000100:00100000:0.0:1651529559.418261:0:164167:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 4 00000100:00100000:0.0:1651529559.418263:0:164167:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004b5f63ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:208179:x1731745946688576:12345-10.240.43.61@tcp:400:lctl.0 00000100:00100000:0.0:1651529559.418282:0:164167:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004b5f63ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:208179:x1731745946688576:12345-10.240.43.61@tcp:400:lctl.0 Request processed in 18us (39us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529559.418286:0:164167:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 4 00000100:00100000:0.0:1651529559.421245:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529559.421252:0:164166:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946688704 00000100:00100000:0.0:1651529559.421259:0:164166:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 5 00000100:00100000:0.0:1651529559.421261:0:164166:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004c03f4d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:208179:x1731745946688704:12345-10.240.43.61@tcp:400:lctl.0 00000100:00100000:0.0:1651529559.421279:0:164166:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004c03f4d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:208179:x1731745946688704:12345-10.240.43.61@tcp:400:lctl.0 Request processed in 17us (35us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529559.421282:0:164166:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 5 00000100:00100000:0.0:1651529559.430516:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529559.430524:0:164167:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946688832 00000100:00100000:0.0:1651529559.430531:0:164167:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 6 00000100:00100000:0.0:1651529559.430532:0:164167:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008e33c77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:208179:x1731745946688832:12345-10.240.43.61@tcp:400:lctl.0 00000100:00100000:0.0:1651529559.430550:0:164167:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008e33c77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:208179:x1731745946688832:12345-10.240.43.61@tcp:400:lctl.0 Request processed in 17us (35us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529559.430553:0:164167:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 6 00000100:00100000:0.0:1651529559.433161:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529559.433168:0:164166:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946688960 00000100:00100000:0.0:1651529559.433175:0:164166:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 7 00000100:00100000:0.0:1651529559.433177:0:164166:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000abfc3f58 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:208179:x1731745946688960:12345-10.240.43.61@tcp:400:lctl.0 00000100:00100000:0.0:1651529559.433195:0:164166:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000abfc3f58 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:208179:x1731745946688960:12345-10.240.43.61@tcp:400:lctl.0 Request processed in 18us (35us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529559.433200:0:164166:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 7 00000100:00100000:0.0:1651529559.481628:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529559.481636:0:164167:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946689088 00000100:00100000:0.0:1651529559.481643:0:164167:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 8 00000100:00100000:0.0:1651529559.481644:0:164167:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f4f9630 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:208179:x1731745946689088:12345-10.240.43.61@tcp:400:lctl.0 00000100:00100000:0.0:1651529559.481663:0:164167:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f4f9630 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:208179:x1731745946689088:12345-10.240.43.61@tcp:400:lctl.0 Request processed in 18us (35us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529559.481666:0:164167:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 8 00000100:00100000:0.0:1651529559.484469:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529559.484477:0:164166:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946689216 00000100:00100000:0.0:1651529559.484483:0:164166:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 9 00000100:00100000:0.0:1651529559.484485:0:164166:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000036a3a267 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:208179:x1731745946689216:12345-10.240.43.61@tcp:400:lctl.0 00000100:00100000:0.0:1651529559.484504:0:164166:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000036a3a267 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:208179:x1731745946689216:12345-10.240.43.61@tcp:400:lctl.0 Request processed in 18us (35us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529559.484507:0:164166:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 9 00000100:00100000:0.0:1651529562.848209:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529562.848239:0:164168:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946689280 00000100:00100000:1.0:1651529562.848261:0:164168:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 3 00000100:00100000:1.0:1651529562.848263:0:164168:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009dfac288 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946689280:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651529562.848281:0:164168:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 81309134848 avail 77138423808 00000100:00100000:1.0:1651529562.848305:0:164168:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009dfac288 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946689280:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 42us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529562.848309:0:164168:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 3 00000100:00100000:0.0:1651529567.968119:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529567.968143:0:164169:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946689408 00000100:00100000:1.0:1651529567.968155:0:164169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 4 00000100:00100000:1.0:1651529567.968157:0:164169:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000f50c14a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946689408:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651529567.968166:0:164169:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 81309134848 avail 77138423808 00000100:00100000:1.0:1651529567.968181:0:164169:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000f50c14a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946689408:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 23us (64us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529567.968184:0:164169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 4 00000100:00100000:1.0:1651529570.941296:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003132c0c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:39099:1731745997081536:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:1.0:1651529570.941583:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003132c0c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:39099:1731745997081536:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:0.0:1651529572.588532:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529572.588544:0:164167:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754229500352 00000100:00100000:0.0:1651529572.588557:0:164167:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4 00000100:00100000:0.0:1651529572.588559:0:164167:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091d23b68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eacddb3a-cb08-4c6c-a06f-c475ab7fdef0+5:435372:x1731754229500352:12345-10.240.43.64@tcp:9:kworker/u4:1.0 00000020:00000080:0.0:1651529572.588572:0:164167:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0x3234de053c5423a 00000100:00080000:0.0:1651529572.588575:0:164167:0:(import.c:85:import_set_state_nolock()) 000000008721bb0a %óàà”ÿÿ: changing import state from FULL to CLOSED 00000001:00000004:0.0:1651529572.588599:0:164167:0:(tgt_lastrcvd.c:701:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179869184 00000100:00100000:0.0:1651529572.588654:0:164167:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091d23b68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eacddb3a-cb08-4c6c-a06f-c475ab7fdef0+2:435372:x1731754229500352:12345-10.240.43.64@tcp:9:kworker/u4:1.0 Request processed in 94us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529572.588658:0:164167:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4 00000100:00100000:0.0:1651529573.088116:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529573.088139:0:164168:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946689600 00000100:00100000:1.0:1651529573.088151:0:164168:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 5 00000100:00100000:1.0:1651529573.088153:0:164168:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000020f0e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946689600:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651529573.088162:0:164168:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81309134848 avail 77138423808 00000100:00100000:1.0:1651529573.088174:0:164168:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000020f0e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946689600:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 20us (60us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529573.088178:0:164168:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 5 00000100:00100000:1.0:1651529578.109286:0:39099:0:(ptlrpcd.c:414:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1651529578.109294:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003132c0c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:80ea30fd-09f1-4f9c-9e17-5deadaf30925:39099:1731745997081600:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:1.0:1651529578.109609:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003132c0c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:80ea30fd-09f1-4f9c-9e17-5deadaf30925:39099:1731745997081600:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:0.0:1651529578.208173:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529578.208197:0:164169:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946689792 00000100:00100000:1.0:1651529578.208210:0:164169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 6 00000100:00100000:1.0:1651529578.208212:0:164169:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051722b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946689792:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651529578.208237:0:164169:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81309134848 avail 77138423808 00000100:00100000:1.0:1651529578.208251:0:164169:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051722b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946689792:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 39us (80us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529578.208255:0:164169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 6 00000001:00100000:0.0:1651529578.268467:0:164152:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of eacddb3a-cb08-4c6c-a06f-c475ab7fdef0 00000020:00000080:0.0:1651529578.268469:0:164152:0:(genops.c:985:class_export_put()) final put 00000000159c47e3/eacddb3a-cb08-4c6c-a06f-c475ab7fdef0 00000020:00000080:1.0:1651529578.268483:0:153568:0:(genops.c:944:class_export_destroy()) destroying export 00000000159c47e3/eacddb3a-cb08-4c6c-a06f-c475ab7fdef0 for lustre-OST0001 00000020:00000080:1.0:1651529578.268498:0:153568:0:(genops.c:1164:obd_zombie_import_free()) destroying import 000000008721bb0a for lustre-OST0001 00000100:00100000:0.0:1651529583.328098:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529583.328123:0:164169:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946689856 00000100:00100000:1.0:1651529583.328141:0:164169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 7 00000100:00100000:1.0:1651529583.328144:0:164169:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000c84c6c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946689856:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651529583.328154:0:164169:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81309134848 avail 77138423808 00000100:00100000:1.0:1651529583.328174:0:164169:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000c84c6c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946689856:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 30us (77us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529583.328177:0:164169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 7 00000100:00100000:0.0:1651529588.448107:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529588.448140:0:164169:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946690048 00000100:00100000:1.0:1651529588.448158:0:164169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 8 00000100:00100000:1.0:1651529588.448161:0:164169:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd71124e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946690048:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651529588.448170:0:164169:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81309134848 avail 77138423808 00000100:00100000:1.0:1651529588.448191:0:164169:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd71124e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946690048:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 29us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529588.448194:0:164169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 8 00000100:00100000:0.0:1651529593.568105:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529593.568130:0:164169:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946690240 00000100:00100000:1.0:1651529593.568147:0:164169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 9 00000100:00100000:1.0:1651529593.568150:0:164169:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000471073f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946690240:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651529593.568159:0:164169:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81309134848 avail 77138423808 00000100:00100000:1.0:1651529593.568179:0:164169:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000471073f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946690240:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 29us (76us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529593.568183:0:164169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 9 00000100:00100000:1.0:1651529596.541303:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003132c0c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:39099:1731745997081664:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:1.0:1651529596.541686:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003132c0c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:39099:1731745997081664:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:0.0:1651529598.688147:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529598.688171:0:164169:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946690304 00000100:00100000:1.0:1651529598.688194:0:164169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 10 00000100:00100000:1.0:1651529598.688196:0:164169:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fd6d3f0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946690304:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651529598.688204:0:164169:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81309134848 avail 77138423808 00000100:00100000:1.0:1651529598.688232:0:164169:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fd6d3f0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946690304:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 25us (75us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529598.688236:0:164169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 10 00000100:00100000:1.0:1651529602.685327:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000f756e73 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:80ea30fd-09f1-4f9c-9e17-5deadaf30925:39100:1731745997081728:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:1.0:1651529602.685693:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000f756e73 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:80ea30fd-09f1-4f9c-9e17-5deadaf30925:39100:1731745997081728:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:0.0:1651529603.808117:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529603.808145:0:164169:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946690560 00000100:00100000:1.0:1651529603.808167:0:164169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 11 00000100:00100000:1.0:1651529603.808169:0:164169:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946690560:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651529603.808181:0:164169:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81309134848 avail 77138423808 00000100:00100000:1.0:1651529603.808202:0:164169:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946690560:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 32us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529603.808207:0:164169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 11 00000100:00100000:0.0:1651529608.928125:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529608.928152:0:164169:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946690688 00000100:00100000:1.0:1651529608.928168:0:164169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 12 00000100:00100000:1.0:1651529608.928170:0:164169:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004de851bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946690688:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651529608.928177:0:164169:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81309134848 avail 77138423808 00000100:00100000:1.0:1651529608.928194:0:164169:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004de851bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946690688:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 23us (70us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529608.928197:0:164169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 12 00000100:00100000:0.0:1651529614.048144:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529614.048169:0:164169:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946690880 00000100:00100000:1.0:1651529614.048185:0:164169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 13 00000100:00100000:1.0:1651529614.048187:0:164169:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946690880:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651529614.048194:0:164169:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81309134848 avail 77138423808 00000100:00100000:1.0:1651529614.048211:0:164169:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946690880:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 23us (68us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529614.048214:0:164169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 13 00000100:00100000:0.0:1651529619.168091:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529619.168116:0:164169:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946691008 00000100:00100000:1.0:1651529619.168132:0:164169:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 14 00000100:00100000:1.0:1651529619.168134:0:164169:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946691008:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651529619.168141:0:164169:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81309134848 avail 77138423808 00000100:00100000:1.0:1651529619.168157:0:164169:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946691008:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 23us (67us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529619.168160:0:164169:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 14 00000100:00100000:0.0:1651529620.654973:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529620.654991:0:164167:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946691520 00000100:00100000:0.0:1651529620.655019:0:164167:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 5 00000100:00100000:0.0:1651529620.655021:0:164167:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000041d3f4d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:208861:x1731745946691520:12345-10.240.43.61@tcp:9:umount.0 00000020:00000080:0.0:1651529620.655039:0:164167:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0x3234de053c54241 00000100:00080000:0.0:1651529620.655042:0:164167:0:(import.c:85:import_set_state_nolock()) 0000000096996198 %óàà”ÿÿ: changing import state from FULL to CLOSED 00000001:00000004:0.0:1651529620.655063:0:164167:0:(tgt_lastrcvd.c:701:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179869184 00000100:00100000:0.0:1651529620.655125:0:164167:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000041d3f4d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:208861:x1731745946691520:12345-10.240.43.61@tcp:9:umount.0 Request processed in 103us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529620.655129:0:164167:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 5 00000100:00100000:1.0:1651529622.141308:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003132c0c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:39099:1731745997081792:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00080000:1.0:1651529622.141690:0:39099:0:(recover.c:232:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@10.240.43.61@tcp abruptly disconnected: reconnecting 00000100:00080000:1.0:1651529622.141693:0:39099:0:(import.c:85:import_set_state_nolock()) 00000000bb021a01 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1651529622.141695:0:39099:0:(import.c:199:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 10.240.43.61@tcp) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1651529622.144800:0:39099:0:(import.c:85:import_set_state_nolock()) 00000000bb021a01 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1651529622.144803:0:39099:0:(import.c:533:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 10.240.43.61@tcp last attempt 20204 00000100:00080000:1.0:1651529622.144806:0:39099:0:(import.c:614:import_select_connection()) lustre-MDT0000-lwp-OST0001: import 00000000bb021a01 using connection 10.240.43.61@tcp/10.240.43.61@tcp 00000100:00100000:1.0:1651529622.144816:0:39099:0:(import.c:806:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000df603127 x1731745997081856/t0(0) o38->lustre-MDT0000-lwp-OST0001@10.240.43.61@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1651529622.144826:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003132c0c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:39099:1731745997081792:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:1.0:1651529622.144836:0:39098:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000df603127 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:39098:1731745997081856:10.240.43.61@tcp:38:ptlrpcd_00_00.0 00000100:00080000:1.0:1651529622.146818:0:39098:0:(import.c:85:import_set_state_nolock()) 00000000bb021a01 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1651529622.146822:0:39098:0:(import.c:1428:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 10.240.43.61@tcp failed (-19) 00000100:00100000:1.0:1651529622.146824:0:39098:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000df603127 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:39098:1731745997081856:10.240.43.61@tcp:38:ptlrpcd_00_00.0 00000001:00100000:0.0:1651529626.262366:0:164152:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1651529626.262368:0:164152:0:(genops.c:985:class_export_put()) final put 00000000a5cb0f7c/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1651529626.262391:0:153568:0:(genops.c:944:class_export_destroy()) destroying export 00000000a5cb0f7c/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1651529626.262412:0:153568:0:(genops.c:1164:obd_zombie_import_free()) destroying import 0000000096996198 for lustre-OST0001 00000100:00080000:0.0:1651529628.285320:0:159543:0:(pinger.c:250:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1651529628.285324:0:159543:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1651529628.285326:0:159543:0:(import.c:85:import_set_state_nolock()) 00000000bb021a01 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1651529628.285332:0:159543:0:(import.c:533:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 10.240.43.61@tcp last attempt 20280 00000100:00080000:0.0:1651529628.285333:0:159543:0:(import.c:580:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1651529628.285337:0:159543:0:(import.c:614:import_select_connection()) lustre-MDT0000-lwp-OST0001: import 00000000bb021a01 using connection 10.240.43.61@tcp/10.240.43.61@tcp 00000100:00100000:0.0:1651529628.285346:0:159543:0:(import.c:806:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000f756e73 x1731745997081984/t0(0) o38->lustre-MDT0000-lwp-OST0001@10.240.43.61@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1651529628.285369:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000946e402f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:80ea30fd-09f1-4f9c-9e17-5deadaf30925:39100:1731745997081920:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:1.0:1651529628.285387:0:39098:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000f756e73 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:39098:1731745997081984:10.240.43.61@tcp:38:kworker/u4:2.0 00000100:00080000:1.0:1651529628.289142:0:39098:0:(import.c:85:import_set_state_nolock()) 00000000bb021a01 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1651529628.289145:0:39098:0:(import.c:1428:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 10.240.43.61@tcp failed (-19) 00000100:00100000:1.0:1651529628.289147:0:39098:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000f756e73 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:39098:1731745997081984:10.240.43.61@tcp:38:kworker/u4:2.0 00000100:00080000:0.0:1651529633.405252:0:159543:0:(pinger.c:250:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1651529633.405258:0:159543:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1651529633.405260:0:159543:0:(import.c:85:import_set_state_nolock()) 00000000bb021a01 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1651529633.405266:0:159543:0:(import.c:533:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 10.240.43.61@tcp last attempt 20286 00000100:00080000:0.0:1651529633.405268:0:159543:0:(import.c:580:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 11s 00000100:00080000:0.0:1651529633.405271:0:159543:0:(import.c:614:import_select_connection()) lustre-MDT0000-lwp-OST0001: import 00000000bb021a01 using connection 10.240.43.61@tcp/10.240.43.61@tcp 00000100:00100000:0.0:1651529633.405292:0:159543:0:(import.c:806:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000f756e73 x1731745997082048/t0(0) o38->lustre-MDT0000-lwp-OST0001@10.240.43.61@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1651529633.405330:0:39098:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000f756e73 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:39098:1731745997082048:10.240.43.61@tcp:38:kworker/u4:2.0 00000100:00000400:0.0:1651529635.453244:0:39100:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1651529628/real 1651529628] req@00000000946e402f x1731745997081920/t0(0) o400->MGC10.240.43.61@tcp@10.240.43.61@tcp:26/25 lens 224/224 e 0 to 1 dl 1651529635 ref 1 fl Rpc:XNQr/0/ffffffff rc 0/-1 job:'kworker/u4:2.0' 00000100:00100000:0.0:1651529635.458689:0:39100:0:(client.c:2339:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@00000000946e402f x1731745997081920/t0(0) o400->MGC10.240.43.61@tcp@10.240.43.61@tcp:26/25 lens 224/224 e 0 to 1 dl 1651529635 ref 1 fl Rpc:XNQU/0/ffffffff rc 0/-1 job:'kworker/u4:2.0' 00000100:00080000:0.0:1651529635.458695:0:39100:0:(import.c:85:import_set_state_nolock()) 00000000a93ceb27 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1651529635.458696:0:39100:0:(import.c:205:ptlrpc_set_import_discon()) 166-1: MGC10.240.43.61@tcp: Connection to MGS (at 10.240.43.61@tcp) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1651529635.461211:0:39100:0:(import.c:211:ptlrpc_set_import_discon()) import MGS@10.240.43.61@tcp for MGC10.240.43.61@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1651529635.461212:0:39100:0:(import.c:156:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1651529635.461215:0:39100:0:(client.c:3319:ptlrpc_abort_inflight()) @@@ inflight req@00000000946e402f x1731745997081920/t0(0) o400->MGC10.240.43.61@tcp@10.240.43.61@tcp:26/25 lens 224/224 e 0 to 1 dl 1651529635 ref 1 fl Rpc:XNQU/0/ffffffff rc 0/-1 job:'kworker/u4:2.0' 10000000:01000000:0.0:1651529635.461221:0:39100:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1651529635.461232:0:39100:0:(pinger.c:214:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1651529635.461232:0:39100:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1651529635.461233:0:39100:0:(import.c:433:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00080000:1.0:1651529635.461250:0:159543:0:(pinger.c:250:ptlrpc_pinger_process_import()) 80ea30fd-09f1-4f9c-9e17-5deadaf30925->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1651529635.461254:0:159543:0:(recover.c:57:ptlrpc_initiate_recovery()) MGS: starting recovery 00000100:00080000:1.0:1651529635.461255:0:159543:0:(import.c:85:import_set_state_nolock()) 00000000a93ceb27 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1651529635.461259:0:159543:0:(import.c:533:import_select_connection()) MGC10.240.43.61@tcp: connect to NID 10.240.43.61@tcp last attempt 20204 00000100:00080000:1.0:1651529635.461263:0:159543:0:(import.c:614:import_select_connection()) MGC10.240.43.61@tcp: import 00000000a93ceb27 using connection MGC10.240.43.61@tcp_0/10.240.43.61@tcp 00000100:00100000:1.0:1651529635.461278:0:159543:0:(import.c:806:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000df603127 x1731745997082112/t0(0) o250->MGC10.240.43.61@tcp@10.240.43.61@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:1.0:1651529635.461287:0:159543:0:(pinger.c:250:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1651529635.461288:0:159543:0:(pinger.c:264:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1651529635.461296:0:39098:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000df603127 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:80ea30fd-09f1-4f9c-9e17-5deadaf30925:39098:1731745997082112:10.240.43.61@tcp:250:kworker/u4:2.0 00000100:00100000:0.0:1651529635.461504:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000946e402f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:80ea30fd-09f1-4f9c-9e17-5deadaf30925:39100:1731745997081920:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00080000:1.0:1651529638.525251:0:159543:0:(pinger.c:250:ptlrpc_pinger_process_import()) 80ea30fd-09f1-4f9c-9e17-5deadaf30925->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1651529638.525254:0:159543:0:(pinger.c:264:ptlrpc_pinger_process_import()) 80ea30fd-09f1-4f9c-9e17-5deadaf30925->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1651529638.525255:0:159543:0:(pinger.c:250:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1651529638.525256:0:159543:0:(pinger.c:264:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1651529640.573260:0:159543:0:(pinger.c:250:ptlrpc_pinger_process_import()) 80ea30fd-09f1-4f9c-9e17-5deadaf30925->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1651529640.573262:0:159543:0:(pinger.c:264:ptlrpc_pinger_process_import()) 80ea30fd-09f1-4f9c-9e17-5deadaf30925->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1651529640.573263:0:159543:0:(pinger.c:250:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1651529640.573264:0:159543:0:(pinger.c:264:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1651529641.597265:0:39098:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1651529635/real 1651529635] req@00000000df603127 x1731745997082112/t0(0) o250->MGC10.240.43.61@tcp@10.240.43.61@tcp:26/25 lens 520/544 e 0 to 1 dl 1651529641 ref 1 fl Rpc:XNQr/0/ffffffff rc 0/-1 job:'kworker/u4:2.0' 00000100:00100000:1.0:1651529641.597274:0:39098:0:(client.c:2326:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@00000000df603127 x1731745997082112/t0(0) o250->MGC10.240.43.61@tcp@10.240.43.61@tcp:26/25 lens 520/544 e 0 to 1 dl 1651529641 ref 1 fl Rpc:XNQU/0/ffffffff rc 0/-1 job:'kworker/u4:2.0' 00000100:00080000:1.0:1651529641.597280:0:39098:0:(import.c:85:import_set_state_nolock()) 00000000a93ceb27 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1651529641.597282:0:39098:0:(import.c:1428:ptlrpc_connect_interpret()) recovery of MGS on 10.240.43.61@tcp failed (-110) 00000100:00100000:1.0:1651529641.597284:0:39098:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000df603127 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:80ea30fd-09f1-4f9c-9e17-5deadaf30925:39098:1731745997082112:10.240.43.61@tcp:250:kworker/u4:2.0 00000100:00080000:1.0:1651529641.597296:0:159543:0:(pinger.c:250:ptlrpc_pinger_process_import()) 80ea30fd-09f1-4f9c-9e17-5deadaf30925->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1651529641.597298:0:159543:0:(recover.c:57:ptlrpc_initiate_recovery()) MGS: starting recovery 00000100:00080000:1.0:1651529641.597298:0:159543:0:(import.c:85:import_set_state_nolock()) 00000000a93ceb27 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1651529641.597300:0:159543:0:(import.c:533:import_select_connection()) MGC10.240.43.61@tcp: connect to NID 10.240.43.61@tcp last attempt 20294 00000100:00080000:1.0:1651529641.597301:0:159543:0:(import.c:580:import_select_connection()) MGC10.240.43.61@tcp: tried all connections, increasing latency to 6s 00000100:00080000:1.0:1651529641.597303:0:159543:0:(import.c:614:import_select_connection()) MGC10.240.43.61@tcp: import 00000000a93ceb27 using connection MGC10.240.43.61@tcp_0/10.240.43.61@tcp 00000100:00100000:1.0:1651529641.597309:0:159543:0:(import.c:806:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000df603127 x1731745997082176/t0(0) o250->MGC10.240.43.61@tcp@10.240.43.61@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:1.0:1651529641.597314:0:159543:0:(pinger.c:250:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1651529641.597315:0:159543:0:(pinger.c:264:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1651529641.597322:0:39098:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000df603127 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:80ea30fd-09f1-4f9c-9e17-5deadaf30925:39098:1731745997082176:10.240.43.61@tcp:250:kworker/u4:2.0 00000020:01000004:1.0:1651529643.474957:0:165085:0:(obd_mount_server.c:1699:server_umount_begin()) umount -f 00000020:01000004:1.0:1651529643.479283:0:165085:0:(obd_mount_server.c:1591:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1651529643.479293:0:165085:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 00000000ba070658/0x3234de053c54225 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd60a7 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529643.479300:0:165085:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000ba070658/0x3234de053c54225 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553dd60a7 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529643.479304:0:165085:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000ba070658/0x3234de053c54225 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7e7b158553dd60a7 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529643.479306:0:165085:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC10.240.43.61@tcp lock: 00000000ba070658/0x3234de053c54225 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7e7b158553dd60a7 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651529643.479315:0:165085:0:(mgc_request.c:544:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1651529643.479320:0:165085:0:(import.c:156:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1651529643.479326:0:165085:0:(client.c:3319:ptlrpc_abort_inflight()) @@@ inflight req@000000000f756e73 x1731745997082048/t0(0) o38->lustre-MDT0000-lwp-OST0001@10.240.43.61@tcp:12/10 lens 520/544 e 0 to 0 dl 1651529649 ref 1 fl Rpc:NQr/0/ffffffff rc 0/-1 job:'kworker/u4:2.0' 00000100:00100000:1.0:1651529643.479333:0:165085:0:(client.c:2892:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1651529643.479335:0:165085:0:(pinger.c:413:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1651529643.479349:0:165085:0:(import.c:85:import_set_state_nolock()) 00000000bb021a01 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1651529643.479350:0:165085:0:(import.c:156:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1651529643.479351:0:165085:0:(client.c:3319:ptlrpc_abort_inflight()) @@@ inflight req@000000000f756e73 x1731745997082048/t0(0) o38->lustre-MDT0000-lwp-OST0001@10.240.43.61@tcp:12/10 lens 520/544 e 0 to 0 dl 1651529649 ref 1 fl Rpc:ENQr/0/ffffffff rc -5/-1 job:'kworker/u4:2.0' 00000100:00100000:1.0:1651529643.479355:0:165085:0:(client.c:2892:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1651529643.479356:0:165085:0:(import.c:338:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00010000:00010000:1.0:1651529643.479362:0:164160:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC10.240.43.61@tcp lock: 00000000ba070658/0x3234de053c54225 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7e7b158553dd60a7 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529643.479366:0:164160:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba070658 already unused, calling callback (0000000083828851) 10000000:00010000:1.0:1651529643.479367:0:164160:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC10.240.43.61@tcp lock: 00000000ba070658/0x3234de053c54225 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7e7b158553dd60a7 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529643.479371:0:164160:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 00000000ba070658/0x3234de053c54225 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7e7b158553dd60a7 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1651529643.479374:0:164160:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 00000000ba070658/0x3234de053c54225 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7e7b158553dd60a7 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651529643.479376:0:164160:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1651529643.479377:0:164160:0:(mgc_request.c:1044:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1651529643.479378:0:164160:0:(mgc_request.c:153:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1651529643.479383:0:164160:0:(ldlm_request.c:1339:ldlm_cli_cancel_req()) skipping cancel on invalid import 00000000a93ceb27 00010000:00010000:1.0:1651529643.479384:0:164160:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC10.240.43.61@tcp lock: 00000000ba070658/0x3234de053c54225 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7e7b158553dd60a7 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529643.479388:0:164160:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 00000000ba070658/0x3234de053c54225 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7e7b158553dd60a7 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529643.479404:0:39098:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000f756e73 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:39098:1731745997082048:10.240.43.61@tcp:38:kworker/u4:2.0 00010000:00010000:1.0:1651529643.481151:0:165085:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 00000000ae57075e/0x3234de053c54209 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd6099 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529643.481155:0:165085:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000ae57075e/0x3234de053c54209 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553dd6099 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529643.481158:0:165085:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000ae57075e/0x3234de053c54209 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7e7b158553dd6099 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529643.481160:0:165085:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC10.240.43.61@tcp lock: 00000000ae57075e/0x3234de053c54209 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7e7b158553dd6099 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529643.481166:0:165085:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 00000000d9cfe902/0x3234de053c54328 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd6110 expref: -99 pid: 164163 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529643.481169:0:165085:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000d9cfe902/0x3234de053c54328 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553dd6110 expref: -99 pid: 164163 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529643.481171:0:165085:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000d9cfe902/0x3234de053c54328 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7e7b158553dd6110 expref: -99 pid: 164163 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529643.481173:0:165085:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC10.240.43.61@tcp lock: 00000000d9cfe902/0x3234de053c54328 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7e7b158553dd6110 expref: -99 pid: 164163 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651529643.481177:0:165085:0:(mgc_request.c:544:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1651529643.481179:0:165085:0:(obd_mount_server.c:1629:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1651529643.481181:0:165085:0:(obd_config.c:2322:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1651529643.481182:0:165085:0:(obd_config.c:1356:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1651529643.481184:0:165085:0:(obd_config.c:877:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/0 00000020:00080000:1.0:1651529643.481186:0:165085:0:(genops.c:1530:class_disconnect_exports()) OBD device 3 (0000000094fa7b20) has no exports 00000020:00080000:1.0:1651529643.481209:0:165085:0:(genops.c:1530:class_disconnect_exports()) OBD device 3 (0000000094fa7b20) has no exports 00010000:00010000:0.0:1651529643.483256:0:164160:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC10.240.43.61@tcp lock: 00000000ae57075e/0x3234de053c54209 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7e7b158553dd6099 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529643.483262:0:164160:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ae57075e already unused, calling callback (0000000083828851) 10000000:00010000:0.0:1651529643.483264:0:164160:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC10.240.43.61@tcp lock: 00000000ae57075e/0x3234de053c54209 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7e7b158553dd6099 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529643.483267:0:164160:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 00000000ae57075e/0x3234de053c54209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x7e7b158553dd6099 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1651529643.483270:0:164160:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 00000000ae57075e/0x3234de053c54209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x7e7b158553dd6099 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1651529643.483272:0:164160:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1651529643.483273:0:164160:0:(mgc_request.c:1044:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1651529643.483274:0:164160:0:(mgc_request.c:153:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1651529643.483278:0:164160:0:(ldlm_request.c:1339:ldlm_cli_cancel_req()) skipping cancel on invalid import 00000000a93ceb27 00010000:00010000:0.0:1651529643.483279:0:164160:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC10.240.43.61@tcp lock: 00000000ae57075e/0x3234de053c54209 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7e7b158553dd6099 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529643.483281:0:164160:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 00000000ae57075e/0x3234de053c54209 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7e7b158553dd6099 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529643.483285:0:164160:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC10.240.43.61@tcp lock: 00000000d9cfe902/0x3234de053c54328 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7e7b158553dd6110 expref: -99 pid: 164163 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529643.483290:0:164160:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d9cfe902 already unused, calling callback (0000000083828851) 10000000:00010000:0.0:1651529643.483291:0:164160:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC10.240.43.61@tcp lock: 00000000d9cfe902/0x3234de053c54328 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7e7b158553dd6110 expref: -99 pid: 164163 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529643.483293:0:164160:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 00000000d9cfe902/0x3234de053c54328 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x7e7b158553dd6110 expref: -99 pid: 164163 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1651529643.483296:0:164160:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 00000000d9cfe902/0x3234de053c54328 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x7e7b158553dd6110 expref: -99 pid: 164163 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1651529643.483298:0:164160:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1651529643.483298:0:164160:0:(mgc_request.c:1044:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1651529643.483299:0:164160:0:(mgc_request.c:153:config_log_put()) dropping config log params 00010000:00010000:0.0:1651529643.483300:0:164160:0:(ldlm_request.c:1339:ldlm_cli_cancel_req()) skipping cancel on invalid import 00000000a93ceb27 00010000:00010000:0.0:1651529643.483301:0:164160:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC10.240.43.61@tcp lock: 00000000d9cfe902/0x3234de053c54328 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x7e7b158553dd6110 expref: -99 pid: 164163 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529643.483303:0:164160:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 00000000d9cfe902/0x3234de053c54328 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x7e7b158553dd6110 expref: -99 pid: 164163 timeout: 0 lvb_type: 0 00000020:01000000:1.0:1651529643.484654:0:165085:0:(lprocfs_status_server.c:281:lprocfs_free_client_stats()) stat 0000000002f901bc - data 00000000d432d097/00000000272af099 00000020:01000000:1.0:1651529643.484662:0:165085:0:(lprocfs_status_server.c:281:lprocfs_free_client_stats()) stat 0000000052992497 - data 00000000a3f42ee4/00000000871b1378 00000020:00020000:1.0:1651529643.484698:0:165085:0:(lprocfs_jobstats.c:137:job_stat_exit()) should not have any items 00100000:10000000:1.0:1651529643.488489:0:165085:0:(lfsck_layout.c:764:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1651529643.499555:0:165085:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0x3234de053c54217 00000020:00000080:1.0:1651529643.499558:0:165085:0:(genops.c:985:class_export_put()) final put 000000002050d06a/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1651529643.499569:0:165085:0:(obd_mount_server.c:201:server_put_mount()) put mount 00000000f465a35f from lustre-OST0001, refs=2 00000020:01000004:1.0:1651529643.499570:0:165085:0:(obd_mount.c:668:lustre_put_lsi()) put 00000000f465a35f 2 00000020:01000004:1.0:1651529643.499571:0:165085:0:(obd_mount_server.c:135:server_deregister_mount()) deregister mount 00000000f465a35f from lustre-OST0001 00000020:00000080:0.0:1651529643.499579:0:153568:0:(genops.c:944:class_export_destroy()) destroying export 000000002050d06a/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1651529643.499588:0:165085:0:(obd_config.c:1356:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1651529643.499590:0:165085:0:(obd_config.c:805:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1651529643.499591:0:165085:0:(genops.c:985:class_export_put()) final put 00000000fe08fa05/lustre-OST0001_UUID 00000020:00000080:1.0:1651529643.499592:0:165085:0:(genops.c:944:class_export_destroy()) destroying export 00000000fe08fa05/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1651529643.499594:0:165085:0:(genops.c:447:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:01000000:1.0:1651529643.499611:0:165085:0:(obd_config.c:2322:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1651529643.499613:0:165085:0:(obd_config.c:1356:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1651529643.499613:0:165085:0:(obd_config.c:877:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/2 00000020:00080000:1.0:1651529643.499616:0:165085:0:(genops.c:1752:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE 00000000acf48368 lustre-MDT0000-lwp-OST0001 10.240.43.61@tcp 3 (0 0 0) 0 0 0 0: 0000000055bfac58 0 stale:0 00000020:00080000:1.0:1651529643.499618:0:165085:0:(genops.c:1525:class_disconnect_exports()) OBD device 4 (00000000f358abc2) has exports, disconnecting them 00000020:00080000:1.0:1651529643.499620:0:165085:0:(genops.c:1501:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 10.240.43.61@tcp (00000000acf48368), last request at 1651529545 00000020:00000080:1.0:1651529643.499621:0:165085:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0x3234de053c54233 00000020:00080000:1.0:1651529643.499623:0:165085:0:(genops.c:1506:class_disconnect_export_list()) disconnected export at 10.240.43.61@tcp (00000000acf48368): rc 0 00000020:00000080:1.0:1651529643.499628:0:165085:0:(genops.c:985:class_export_put()) final put 00000000acf48368/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1651529643.499642:0:153568:0:(genops.c:944:class_export_destroy()) destroying export 00000000acf48368/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1651529643.500535:0:165085:0:(obd_class.h:647:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1651529643.500536:0:165085:0:(import.c:156:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1651529643.500537:0:165085:0:(client.c:2892:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1651529643.500538:0:165085:0:(import.c:338:ptlrpc_invalidate_import()) Sleeping 100s for inflight to error out 00000020:00000080:0.0:1651529643.500555:0:153568:0:(genops.c:1164:obd_zombie_import_free()) destroying import 00000000bb021a01 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1651529643.500574:0:165085:0:(obd_config.c:1356:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1651529643.500576:0:165085:0:(obd_config.c:805:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1651529643.500577:0:165085:0:(genops.c:985:class_export_put()) final put 00000000235c3ea6/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1651529643.500578:0:165085:0:(genops.c:944:class_export_destroy()) destroying export 00000000235c3ea6/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1651529643.500579:0:165085:0:(genops.c:447:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1651529643.500588:0:165085:0:(obd_mount.c:926:lustre_common_put_super()) dropping sb 00000000f465a35f 00000100:00080000:1.0:1651529643.500590:0:165085:0:(pinger.c:413:ptlrpc_pinger_del_import()) removing pingable import 80ea30fd-09f1-4f9c-9e17-5deadaf30925->MGS 00010000:00010000:1.0:1651529643.500594:0:165085:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 000000004678bff1/0x3234de053c54202 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7e7b158553dd6092 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1651529643.500598:0:165085:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 000000004678bff1/0x3234de053c54202 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7e7b158553dd6092 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651529643.500601:0:165085:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1651529643.500602:0:165085:0:(mgc_request.c:1053:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1651529643.500602:0:165085:0:(mgc_request.c:153:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1651529643.500605:0:165085:0:(ldlm_request.c:1339:ldlm_cli_cancel_req()) skipping cancel on invalid import 00000000a93ceb27 00010000:00010000:1.0:1651529643.500606:0:165085:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 000000004678bff1/0x3234de053c54202 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7e7b158553dd6092 expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529643.500609:0:165085:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 00000000c0de17df/0x3234de053c541fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7e7b158553dd608b expref: -99 pid: 164150 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1651529643.500612:0:165085:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 00000000c0de17df/0x3234de053c541fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7e7b158553dd608b expref: -99 pid: 164150 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651529643.500614:0:165085:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1651529643.500615:0:165085:0:(mgc_request.c:1053:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1651529643.500615:0:165085:0:(mgc_request.c:153:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1651529643.500618:0:165085:0:(ldlm_request.c:1339:ldlm_cli_cancel_req()) skipping cancel on invalid import 00000000a93ceb27 00010000:00010000:1.0:1651529643.500619:0:165085:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 00000000c0de17df/0x3234de053c541fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7e7b158553dd608b expref: -99 pid: 164150 timeout: 0 lvb_type: 0 00000100:00080000:1.0:1651529643.500627:0:165085:0:(import.c:85:import_set_state_nolock()) 00000000a93ceb27 MGS: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1651529643.500628:0:165085:0:(import.c:156:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1651529643.500630:0:165085:0:(client.c:3319:ptlrpc_abort_inflight()) @@@ inflight req@00000000df603127 x1731745997082176/t0(0) o250->MGC10.240.43.61@tcp@10.240.43.61@tcp:26/25 lens 520/544 e 0 to 0 dl 1651529652 ref 1 fl Rpc:NQr/0/ffffffff rc 0/-1 job:'kworker/u4:2.0' 10000000:01000000:1.0:1651529643.500637:0:165085:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1651529643.500638:0:165085:0:(import.c:338:ptlrpc_invalidate_import()) Sleeping 12s for inflight to error out 00000100:00100000:1.0:1651529643.500647:0:39098:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000df603127 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:80ea30fd-09f1-4f9c-9e17-5deadaf30925:39098:1731745997082176:10.240.43.61@tcp:250:kworker/u4:2.0 10000000:01000000:1.0:1651529643.500731:0:165085:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1651529643.500734:0:165085:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0x3234de053c541ed 00000020:00000080:1.0:1651529643.500735:0:165085:0:(genops.c:985:class_export_put()) final put 0000000097c0cf31/80ea30fd-09f1-4f9c-9e17-5deadaf30925 00000020:01000000:1.0:1651529643.500744:0:165085:0:(obd_config.c:2322:class_manual_cleanup()) Manual cleanup of MGC10.240.43.61@tcp (flags='') 00000020:00000080:1.0:1651529643.500746:0:165085:0:(obd_config.c:1356:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1651529643.500747:0:165085:0:(obd_config.c:877:class_cleanup()) MGC10.240.43.61@tcp: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1651529643.500748:0:165085:0:(genops.c:1530:class_disconnect_exports()) OBD device 1 (00000000442d66cc) has no exports 00000020:00000080:0.0:1651529643.500757:0:153568:0:(genops.c:944:class_export_destroy()) destroying export 0000000097c0cf31/80ea30fd-09f1-4f9c-9e17-5deadaf30925 for MGC10.240.43.61@tcp 10000000:01000000:0.0:1651529643.500767:0:164163:0:(mgc_request.c:704:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1651529643.500777:0:165085:0:(obd_class.h:647:obd_cleanup_client_import()) MGC10.240.43.61@tcp: client import never connected 00000100:00080000:1.0:1651529643.500778:0:165085:0:(import.c:156:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1651529643.500779:0:165085:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1651529643.500780:0:165085:0:(import.c:338:ptlrpc_invalidate_import()) Sleeping 100s for inflight to error out 10000000:01000000:1.0:1651529643.500781:0:165085:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1651529643.500794:0:153568:0:(genops.c:1164:obd_zombie_import_free()) destroying import 00000000a93ceb27 for MGC10.240.43.61@tcp 00000020:00000080:1.0:1651529643.500798:0:165085:0:(obd_config.c:1356:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1651529643.500799:0:165085:0:(obd_config.c:805:class_detach()) detach on obd MGC10.240.43.61@tcp (uuid 80ea30fd-09f1-4f9c-9e17-5deadaf30925) 00000020:00000080:1.0:1651529643.500801:0:165085:0:(genops.c:985:class_export_put()) final put 0000000085714f54/80ea30fd-09f1-4f9c-9e17-5deadaf30925 00000020:00000080:1.0:1651529643.500802:0:165085:0:(genops.c:944:class_export_destroy()) destroying export 0000000085714f54/80ea30fd-09f1-4f9c-9e17-5deadaf30925 for MGC10.240.43.61@tcp 00000020:01000000:1.0:1651529643.500803:0:165085:0:(genops.c:447:class_free_dev()) finishing cleanup of obd MGC10.240.43.61@tcp (80ea30fd-09f1-4f9c-9e17-5deadaf30925) 00000100:00100000:0.0:1651529643.500956:0:164155:0:(service.c:2915:ptlrpc_main()) ldlm_cb00_001: service thread [00000000e6d61fb1:164155] 1 exiting: rc = 0 00000100:00100000:1.0:1651529643.500990:0:164154:0:(service.c:2915:ptlrpc_main()) ldlm_cb00_000: service thread [000000008cf12a10:164154] 0 exiting: rc = 1 00000100:00100000:1.0:1651529643.501033:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501099:0:164158:0:(service.c:2915:ptlrpc_main()) ldlm_cn00_002: service thread [0000000046332621:164158] 2 exiting: rc = 0 00000100:00100000:1.0:1651529643.501139:0:164157:0:(service.c:2915:ptlrpc_main()) ldlm_cn00_001: service thread [00000000f30bee9c:164157] 1 exiting: rc = 0 00000100:00100000:0.0:1651529643.501174:0:164156:0:(service.c:2915:ptlrpc_main()) ldlm_cn00_000: service thread [00000000d4c322a7:164156] 0 exiting: rc = 1 00000100:00100000:1.0:1651529643.501183:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501186:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501188:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501190:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501192:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501195:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501197:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501199:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501201:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501204:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501206:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501208:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501210:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501212:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501214:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501216:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501217:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501220:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501237:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501240:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501242:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501245:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501247:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501249:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501251:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501253:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501255:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501257:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501259:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501261:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501263:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501265:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501267:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501269:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501271:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501274:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501276:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501278:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501280:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501282:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501284:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501286:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501288:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501290:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501293:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501295:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501297:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501299:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501301:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501303:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501306:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501308:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501310:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501312:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501314:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501316:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501318:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501321:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501323:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501325:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501327:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501329:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501331:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.501334:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1651529643.501523:0:165085:0:(obd_config.c:1356:class_process_config()) processing cmd: cf006 00000020:00000080:1.0:1651529643.501524:0:165085:0:(obd_config.c:1377:class_process_config()) removing mappings for uuid MGC10.240.43.61@tcp_0 00000020:01000004:1.0:1651529643.501526:0:165085:0:(obd_mount.c:668:lustre_put_lsi()) put 00000000f465a35f 1 00000020:00000080:1.0:1651529643.501528:0:165085:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0x3234de053c541df 00000020:00000080:1.0:1651529643.501529:0:165085:0:(genops.c:985:class_export_put()) final put 0000000087aabb39/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1651529643.501533:0:165085:0:(obd_config.c:2322:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1651529643.501535:0:165085:0:(obd_config.c:1356:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1651529643.501536:0:165085:0:(obd_config.c:877:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1651529643.501537:0:165085:0:(genops.c:1530:class_disconnect_exports()) OBD device 0 (0000000099cd1bfe) has no exports 00000020:00000080:0.0:1651529643.501538:0:153568:0:(genops.c:944:class_export_destroy()) destroying export 0000000087aabb39/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1651529643.502654:0:165085:0:(obd_config.c:1356:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1651529643.502655:0:165085:0:(obd_config.c:805:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1651529643.502657:0:165085:0:(genops.c:985:class_export_put()) final put 00000000165fdc1c/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1651529643.502658:0:165085:0:(genops.c:944:class_export_destroy()) destroying export 00000000165fdc1c/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1651529643.502659:0:165085:0:(genops.c:447:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1651529643.502714:0:165085:0:(obd_mount.c:608:lustre_free_lsi()) Freeing lsi 000000000b85f2bb 00000020:01000000:1.0:1651529643.502719:0:165085:0:(obd_config.c:2322:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1651529643.502721:0:165085:0:(obd_config.c:1356:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1651529643.502721:0:165085:0:(obd_config.c:877:class_cleanup()) OSS: forcing exports to disconnect: 0/0 00000020:00080000:1.0:1651529643.502722:0:165085:0:(genops.c:1530:class_disconnect_exports()) OBD device 2 (00000000b5e079cd) has no exports 00000020:00000080:1.0:1651529643.502731:0:165085:0:(obd_config.c:1356:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1651529643.502731:0:165085:0:(obd_config.c:805:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1651529643.502732:0:165085:0:(genops.c:985:class_export_put()) final put 000000009230b7da/OSS_uuid 00000020:00000080:1.0:1651529643.502733:0:165085:0:(genops.c:944:class_export_destroy()) destroying export 000000009230b7da/OSS_uuid for OSS 00000020:01000000:1.0:1651529643.502734:0:165085:0:(genops.c:447:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1651529643.502753:0:164177:0:(pinger.c:538:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1651529643.502762:0:164167:0:(service.c:2915:ptlrpc_main()) ll_ost00_002: service thread [0000000046b6694d:164167] 2 exiting: rc = 0 00000100:00100000:1.0:1651529643.502788:0:164166:0:(service.c:2915:ptlrpc_main()) ll_ost00_001: service thread [0000000091de55a1:164166] 1 exiting: rc = 0 00000100:00100000:1.0:1651529643.502812:0:164164:0:(service.c:2915:ptlrpc_main()) ll_ost00_000: service thread [00000000d906a74c:164164] 0 exiting: rc = 1 00000100:00100000:1.0:1651529643.502863:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502866:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502869:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502871:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502873:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502875:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502877:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502879:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502882:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502884:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502886:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502888:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502890:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502892:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502894:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502896:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502898:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502900:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502913:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502916:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502918:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502920:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502922:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502924:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502926:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502929:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502931:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502933:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502935:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502937:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502939:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502940:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502942:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502944:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502946:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502948:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502950:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502952:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502954:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502956:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502958:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502960:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502962:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502964:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502966:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502968:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502969:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502971:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502973:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502975:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502977:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502979:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502980:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502982:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502984:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502986:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502988:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502990:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502992:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502994:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502995:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502997:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.502999:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503001:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503410:0:164169:0:(service.c:2915:ptlrpc_main()) ll_ost_create00_001: service thread [0000000091a1e003:164169] 1 exiting: rc = 0 00000100:00100000:0.0:1651529643.503411:0:164168:0:(service.c:2915:ptlrpc_main()) ll_ost_create00_000: service thread [00000000e99192a2:164168] 0 exiting: rc = 1 00000100:00100000:1.0:1651529643.503451:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503453:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503455:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503457:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503460:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503462:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503463:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503466:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503468:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503470:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503472:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503474:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503476:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503479:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503481:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503483:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503485:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503487:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503489:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503491:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503493:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503495:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503497:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503499:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503501:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503503:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503505:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503507:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503509:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503511:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503513:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503515:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503517:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503519:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503521:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503523:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503525:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503527:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503529:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503530:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503532:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503535:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503538:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503541:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503542:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503545:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503547:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503549:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503551:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503553:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503555:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503557:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503559:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503561:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503563:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503565:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503567:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503569:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503571:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503573:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503575:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503577:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503579:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.503581:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504113:0:164172:0:(service.c:2915:ptlrpc_main()) ll_ost_io00_002: service thread [000000006aa59b47:164172] 2 exiting: rc = 0 00000100:00100000:1.0:1651529643.504315:0:164171:0:(service.c:2915:ptlrpc_main()) ll_ost_io00_001: service thread [00000000410829f6:164171] 1 exiting: rc = 0 00000100:00100000:0.0:1651529643.504402:0:164170:0:(service.c:2915:ptlrpc_main()) ll_ost_io00_000: service thread [00000000ffc8e81f:164170] 0 exiting: rc = 1 00000100:00100000:1.0:1651529643.504420:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504423:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504425:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504428:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504430:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504433:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504435:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504437:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504439:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504441:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504443:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504446:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504448:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504450:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504452:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504454:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504456:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504458:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504460:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504462:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504465:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504467:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504470:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504472:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504474:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504476:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504478:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504481:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504483:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504485:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504487:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504489:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504491:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504493:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504495:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504498:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504500:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504502:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504504:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504506:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504509:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504512:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504514:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504516:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504518:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504520:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504523:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504525:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504527:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504529:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504532:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504534:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504536:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504538:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504540:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504542:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504545:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504547:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504549:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504551:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504553:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504556:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504558:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.504560:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1651529643.509211:0:164174:0:(service.c:2915:ptlrpc_main()) ll_ost_seq00_001: service thread [00000000b617d83f:164174] 1 exiting: rc = 0 00000100:00100000:1.0:1651529643.509321:0:164173:0:(service.c:2915:ptlrpc_main()) ll_ost_seq00_000: service thread [000000009f2dba48:164173] 0 exiting: rc = 1 00000100:00100000:1.0:1651529643.509372:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509375:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509377:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509380:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509382:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509384:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509386:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509388:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509390:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509392:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509394:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509396:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509398:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509400:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509402:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509403:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509405:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509408:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509410:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509412:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509414:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509416:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509418:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509420:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509422:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509424:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509426:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509428:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509430:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509432:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509434:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509436:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509438:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509441:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509443:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509445:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509447:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509449:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509450:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509452:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509454:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509456:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509458:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509460:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509462:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509464:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509465:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509467:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509469:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509471:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509473:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509475:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509477:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509479:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509480:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509482:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509484:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509486:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509488:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509490:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509492:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509493:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509496:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509498:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509884:0:164176:0:(service.c:2915:ptlrpc_main()) ll_ost_out00_001: service thread [000000007aab6ff8:164176] 1 exiting: rc = 0 00000100:00100000:1.0:1651529643.509928:0:164175:0:(service.c:2915:ptlrpc_main()) ll_ost_out00_000: service thread [000000006beeae54:164175] 0 exiting: rc = 1 00000100:00100000:1.0:1651529643.509978:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509981:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509985:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509987:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509989:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509991:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509994:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509996:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.509998:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510000:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510002:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510006:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510008:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510010:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510012:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510015:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510017:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510020:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510022:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510024:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510026:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510028:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510031:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510034:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510036:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510039:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510041:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510043:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510045:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510048:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510050:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510052:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510054:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510056:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510059:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510062:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510065:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510067:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510069:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510071:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510074:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510076:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510078:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510081:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510083:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510085:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510088:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510091:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510093:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510095:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510097:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510100:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510102:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510104:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510107:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510109:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510111:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510113:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510115:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510119:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510121:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510123:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510125:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1651529643.510128:0:165085:0:(events.c:361:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1651529643.519087:0:165085:0:(obd_mount_server.c:1687:server_put_super()) server umount lustre-OST0001 complete 00000400:00000100:0.0:1651529655.451680:0:39094:0:(lib-move.c:4234:lnet_parse_put()) Dropping PUT from 12345-10.240.43.61@tcp portal 28 match 1731745946692480 offset 0 length 520: 4 00000400:00000100:0.0:1651529660.640260:0:39093:0:(lib-move.c:4234:lnet_parse_put()) Dropping PUT from 12345-10.240.43.61@tcp portal 28 match 1731745946694592 offset 0 length 520: 4 00000080:01200004:1.0:1651529662.688684:0:166096:0:(super25.c:114:lustre_fill_super()) VFS Op: sb 00000000c1f19955 00000020:01000004:1.0:1651529662.688702:0:166096:0:(obd_mount.c:952:lmd_print()) mount data: 00000020:01000004:1.0:1651529662.688703:0:166096:0:(obd_mount.c:955:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1651529662.688704:0:166096:0:(obd_mount.c:956:lmd_print()) flags: 0 00000020:01000004:1.0:1651529662.688704:0:166096:0:(obd_mount.c:959:lmd_print()) options: errors=remount-ro 00000020:01000004:1.0:1651529662.688707:0:166096:0:(obd_mount_server.c:1916:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1651529662.688736:0:166096:0:(obd_mount.c:191:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1651529662.688738:0:166096:0:(obd_config.c:1356:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1651529662.688744:0:166096:0:(genops.c:417:class_newdev()) Allocate new device lustre-OST0001-osd (0000000094fa7b20) 00000020:00000080:1.0:1651529662.688774:0:166096:0:(obd_config.c:648:class_attach()) OBD: dev 0 attached type osd-ldiskfs with refcount 1 00000020:00000080:1.0:1651529662.688776:0:166096:0:(obd_config.c:1356:class_process_config()) processing cmd: cf003 00100000:10000000:1.0:1651529662.720015:0:166096:0:(osd_scrub.c:1715:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1651529662.720391:0:166096:0:(osd_scrub.c:1715:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1651529662.720492:0:166096:0:(osd_scrub.c:1715:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1651529662.720647:0:166096:0:(osd_scrub.c:1715:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1651529662.720737:0:166096:0:(osd_scrub.c:1715:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1651529662.720827:0:166096:0:(osd_scrub.c:1715:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1651529662.720923:0:166096:0:(osd_scrub.c:1715:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:1.0:1651529662.721879:0:166096:0:(osd_lproc.c:834:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1651529662.722138:0:166096:0:(obd_config.c:752:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1651529662.722174:0:166096:0:(osd_handler.c:8440:osd_obd_connect()) connect #0 00000020:00000080:1.0:1651529662.722197:0:166096:0:(genops.c:1359:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x3234de053c54336 00000020:01000004:1.0:1651529662.722209:0:166096:0:(obd_mount_server.c:1999:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1651529662.722357:0:166096:0:(obd_mount.c:340:lustre_start_mgc()) Start MGC 'MGC10.240.43.61@tcp' 00000020:01000004:1.0:1651529662.722359:0:166096:0:(obd_mount.c:347:lustre_start_mgc()) mgs NIDs 10.240.43.61@tcp. 00000020:00000080:1.0:1651529662.722367:0:166096:0:(obd_config.c:1356:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1651529662.722373:0:166096:0:(obd_config.c:1368:class_process_config()) adding mapping from uuid MGC10.240.43.61@tcp_0 to nid 0x200000af02b3d (10.240.43.61@tcp) 00000020:01000004:1.0:1651529662.722430:0:166096:0:(obd_mount.c:191:lustre_start_simple()) Starting OBD MGC10.240.43.61@tcp (typ=mgc) 00000020:00000080:1.0:1651529662.722431:0:166096:0:(obd_config.c:1356:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1651529662.722445:0:166096:0:(genops.c:417:class_newdev()) Allocate new device MGC10.240.43.61@tcp (0000000015b1c8bf) 00000020:00000080:1.0:1651529662.722477:0:166096:0:(obd_config.c:648:class_attach()) OBD: dev 1 attached type mgc with refcount 1 00000020:00000080:1.0:1651529662.722479:0:166096:0:(obd_config.c:1356:class_process_config()) processing cmd: cf003 00000100:00100000:1.0:1651529662.722618:0:166096:0:(service.c:172:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1651529662.722728:0:166096:0:(service.c:3189:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 40 00000100:00100000:1.0:1651529662.722731:0:166096:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1651529662.722978:0:166096:0:(service.c:3189:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 40 00000100:00100000:1.0:1651529662.722986:0:166096:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1651529662.723524:0:166096:0:(service.c:172:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1651529662.723619:0:166096:0:(service.c:3189:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 40 00000100:00100000:1.0:1651529662.723621:0:166096:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1651529662.725298:0:166096:0:(service.c:3189:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 40 00000100:00100000:1.0:1651529662.725301:0:166096:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1651529662.725693:0:166096:0:(service.c:3189:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 40 00000100:00100000:1.0:1651529662.725695:0:166096:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00080000:1.0:1651529662.727258:0:166096:0:(ldlm_lib.c:115:import_set_conn()) imp 000000000aba9d44@MGC10.240.43.61@tcp: add connection MGC10.240.43.61@tcp_0 at head 00010000:00010000:1.0:1651529662.727328:0:166096:0:(ldlm_pool.c:932:ldlm_pool_init()) Lock pool ldlm-pool-MGC10.240.43.61@tcp-0 is initialized 00000040:01000000:1.0:1651529662.727342:0:166096:0:(llog_obd.c:212:llog_setup()) obd MGC10.240.43.61@tcp ctxt 1 is initialized 10000000:01000000:0.0:1651529662.730774:0:166108:0:(mgc_request.c:628:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1651529662.731193:0:166096:0:(obd_config.c:752:class_setup()) finished setup of obd MGC10.240.43.61@tcp (uuid c9063caa-b124-4cb6-99ef-d01a735595c3) 00000020:00000080:1.0:1651529662.731219:0:166096:0:(genops.c:1359:class_connect()) connect: client c9063caa-b124-4cb6-99ef-d01a735595c3, cookie 0x3234de053c54344 00000100:00080000:1.0:1651529662.731245:0:166096:0:(import.c:533:import_select_connection()) MGC10.240.43.61@tcp: connect to NID 10.240.43.61@tcp last attempt 0 00000100:00080000:1.0:1651529662.731248:0:166096:0:(import.c:614:import_select_connection()) MGC10.240.43.61@tcp: import 000000000aba9d44 using connection MGC10.240.43.61@tcp_0/10.240.43.61@tcp 00000100:00100000:1.0:1651529662.731268:0:166096:0:(import.c:806:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000dabd64d3 x1731745997082368/t0(0) o250->MGC10.240.43.61@tcp@10.240.43.61@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:1.0:1651529662.731292:0:166096:0:(pinger.c:388:ptlrpc_pinger_add_import()) adding pingable import c9063caa-b124-4cb6-99ef-d01a735595c3->MGS 00000020:01000004:1.0:1651529662.731301:0:166096:0:(obd_mount_server.c:1354:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1651529662.731330:0:166096:0:(obd_mount.c:191:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1651529662.731331:0:166096:0:(obd_config.c:1356:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1651529662.731350:0:166096:0:(genops.c:417:class_newdev()) Allocate new device OSS (0000000099510b15) 00000020:00000080:1.0:1651529662.731378:0:166096:0:(obd_config.c:648:class_attach()) OBD: dev 2 attached type ost with refcount 1 00000020:00000080:1.0:1651529662.731380:0:166096:0:(obd_config.c:1356:class_process_config()) processing cmd: cf003 00000100:00100000:1.0:1651529662.731929:0:166096:0:(service.c:172:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1651529662.732017:0:166096:0:(service.c:3189:ptlrpc_start_thread()) ost[0] started 0 min 3 max 80 00000100:00100000:1.0:1651529662.732019:0:166096:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1651529662.732040:0:39098:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dabd64d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9063caa-b124-4cb6-99ef-d01a735595c3:39098:1731745997082368:10.240.43.61@tcp:250:mount.lustre.0 00000100:00100000:1.0:1651529662.732339:0:166096:0:(service.c:3189:ptlrpc_start_thread()) ost[0] started 1 min 3 max 80 00000100:00100000:1.0:1651529662.732347:0:166096:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1651529662.732421:0:166096:0:(service.c:3189:ptlrpc_start_thread()) ost[0] started 2 min 3 max 80 00000100:00100000:1.0:1651529662.732423:0:166096:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1651529662.733053:0:166096:0:(service.c:172:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1651529662.733146:0:166096:0:(service.c:3189:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 10 00000100:00100000:1.0:1651529662.733148:0:166096:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1651529662.733294:0:166096:0:(service.c:3189:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 10 00000100:00100000:1.0:1651529662.733296:0:166096:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1651529662.734349:0:39098:0:(client.c:2892:ptlrpc_free_committed()) MGC10.240.43.61@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1651529662.734354:0:39098:0:(import.c:1073:ptlrpc_connect_interpret()) MGC10.240.43.61@tcp: connect to target with instance 0 00000100:00080000:0.0:1651529662.734366:0:39098:0:(import.c:933:ptlrpc_connect_set_flags()) MGC10.240.43.61@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002020 10000000:01000000:0.0:1651529662.734367:0:39098:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1651529662.734369:0:39098:0:(import.c:85:import_set_state_nolock()) 000000000aba9d44 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1651529662.734371:0:39098:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1651529662.734374:0:39098:0:(pinger.c:207:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1651529662.734377:0:39098:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dabd64d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9063caa-b124-4cb6-99ef-d01a735595c3:39098:1731745997082368:10.240.43.61@tcp:250:mount.lustre.0 00000100:00100000:1.0:1651529662.740556:0:166096:0:(service.c:172:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1651529662.740731:0:166096:0:(service.c:3189:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 80 00000100:00100000:1.0:1651529662.740733:0:166096:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1651529662.741808:0:166096:0:(service.c:3189:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 80 00000100:00100000:1.0:1651529662.741811:0:166096:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1651529662.742402:0:166096:0:(service.c:3189:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 80 00000100:00100000:1.0:1651529662.742405:0:166096:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1651529662.744538:0:166096:0:(service.c:172:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1651529662.744634:0:166096:0:(service.c:3189:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 10 00000100:00100000:1.0:1651529662.744635:0:166096:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1651529662.745106:0:166096:0:(service.c:3189:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 10 00000100:00100000:1.0:1651529662.745110:0:166096:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1651529662.762234:0:166096:0:(service.c:172:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1651529662.762372:0:166096:0:(service.c:3189:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 10 00000100:00100000:1.0:1651529662.762375:0:166096:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1651529662.763248:0:166096:0:(service.c:3189:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 10 00000100:00100000:1.0:1651529662.763251:0:166096:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1651529662.763749:0:166096:0:(obd_config.c:752:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1651529662.763766:0:166096:0:(obd_mount_server.c:294:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 00000100:00080000:0.0:1651529662.763993:0:166123:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 00000040:01000000:1.0:1651529662.765750:0:166096:0:(llog_obd.c:212:llog_setup()) obd MGC10.240.43.61@tcp ctxt 0 is initialized 00000020:01000004:1.0:1651529662.765771:0:166096:0:(obd_mount_server.c:1245:server_register_target()) Registration lustre-OST0001, fs=lustre, 10.240.43.63@tcp, index=0001, flags=0x2 10000000:01000000:1.0:1651529662.765773:0:166096:0:(mgc_request.c:1239:mgc_set_info_async()) register_target lustre-OST0001 0x10000002 10000000:01000000:1.0:1651529662.765786:0:166096:0:(mgc_request.c:1175:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1651529662.765795:0:166096:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e0bff89e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9063caa-b124-4cb6-99ef-d01a735595c3:166096:1731745997082432:10.240.43.61@tcp:253:mount.lustre.0 00000100:00100000:1.0:1651529662.765834:0:166096:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f9dd6aa3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529662.767348:0:166096:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e0bff89e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9063caa-b124-4cb6-99ef-d01a735595c3:166096:1731745997082432:10.240.43.61@tcp:253:mount.lustre.0 10000000:01000000:1.0:1651529662.767352:0:166096:0:(mgc_request.c:1195:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1651529662.767359:0:166096:0:(obd_mount_server.c:116:server_register_mount()) register mount 00000000c1f19955 from lustre-OST0001 10000000:01000000:1.0:1651529662.767361:0:166096:0:(mgc_request.c:2205:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1651529662.767362:0:166096:0:(mgc_request.c:334:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1651529662.767371:0:166096:0:(mgc_request.c:215:do_config_log_add()) do adding config log lustre-sptlrpc-ffff94e0b53b8000 10000000:01000000:1.0:1651529662.767373:0:166096:0:(mgc_request.c:90:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1651529662.767376:0:166096:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff94e0b53b8000 from 1 10000000:01000000:1.0:1651529662.767377:0:166096:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1651529662.767404:0:166096:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 00000000b65e0a0d/0x3234de053c54352 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 166096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529662.767409:0:166096:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 00000000b65e0a0d/0x3234de053c54352 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 166096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529662.767417:0:166096:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 00000000b65e0a0d/0x3234de053c54352 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 166096 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529662.767423:0:166096:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e0bff89e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9063caa-b124-4cb6-99ef-d01a735595c3:166096:1731745997082496:10.240.43.61@tcp:101:mount.lustre.0 00000100:00100000:1.0:1651529662.767440:0:166096:0:(client.c:2492:ptlrpc_set_wait()) set 00000000382571b5 going to sleep for 6 seconds 00000100:00100000:1.0:1651529662.767675:0:166096:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e0bff89e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9063caa-b124-4cb6-99ef-d01a735595c3:166096:1731745997082496:10.240.43.61@tcp:101:mount.lustre.0 00010000:00010000:1.0:1651529662.767692:0:166096:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 00000000b65e0a0d/0x3234de053c54352 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd629f expref: -99 pid: 166096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529662.767697:0:166096:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 00000000b65e0a0d/0x3234de053c54352 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553dd629f expref: -99 pid: 166096 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529662.767729:0:166096:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e0bff89e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9063caa-b124-4cb6-99ef-d01a735595c3:166096:1731745997082560:10.240.43.61@tcp:501:mount.lustre.0 00000100:00100000:1.0:1651529662.767744:0:166096:0:(client.c:2492:ptlrpc_set_wait()) set 00000000382571b5 going to sleep for 6 seconds 00000100:00100000:1.0:1651529662.767964:0:166096:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e0bff89e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9063caa-b124-4cb6-99ef-d01a735595c3:166096:1731745997082560:10.240.43.61@tcp:501:mount.lustre.0 10000000:01000000:1.0:1651529662.767974:0:166096:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1651529662.767983:0:166096:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000b65e0a0d/0x3234de053c54352 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd629f expref: -99 pid: 166096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529662.767987:0:166096:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 00000000b65e0a0d/0x3234de053c54352 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd629f expref: -99 pid: 166096 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651529662.767990:0:166096:0:(mgc_request.c:215:do_config_log_add()) do adding config log nodemap-ffff94e0b53b8000 10000000:01000000:1.0:1651529662.767991:0:166096:0:(mgc_request.c:90:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1651529662.767993:0:166096:0:(mgc_request.c:2064:mgc_process_log()) Process log nodemap-ffff94e0b53b8000 from 1 10000000:01000000:1.0:1651529662.767993:0:166096:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1651529662.767998:0:166096:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 0000000045fe8361/0x3234de053c54359 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 166096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529662.768000:0:166096:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 0000000045fe8361/0x3234de053c54359 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 166096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529662.768003:0:166096:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 0000000045fe8361/0x3234de053c54359 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 166096 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529662.768008:0:166096:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e0bff89e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9063caa-b124-4cb6-99ef-d01a735595c3:166096:1731745997082624:10.240.43.61@tcp:101:mount.lustre.0 00000100:00100000:1.0:1651529662.768021:0:166096:0:(client.c:2492:ptlrpc_set_wait()) set 00000000382571b5 going to sleep for 6 seconds 00000100:00100000:1.0:1651529662.768214:0:166096:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e0bff89e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9063caa-b124-4cb6-99ef-d01a735595c3:166096:1731745997082624:10.240.43.61@tcp:101:mount.lustre.0 00010000:00010000:1.0:1651529662.768218:0:166096:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 0000000045fe8361/0x3234de053c54359 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd62a6 expref: -99 pid: 166096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529662.768236:0:166096:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 0000000045fe8361/0x3234de053c54359 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553dd62a6 expref: -99 pid: 166096 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529662.768302:0:166096:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e0bff89e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9063caa-b124-4cb6-99ef-d01a735595c3:166096:1731745997082688:10.240.43.61@tcp:256:mount.lustre.0 00000100:00100000:1.0:1651529662.768325:0:166096:0:(client.c:2492:ptlrpc_set_wait()) set 0000000064b9c5f3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529662.768779:0:166096:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e0bff89e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9063caa-b124-4cb6-99ef-d01a735595c3:166096:1731745997082688:10.240.43.61@tcp:256:mount.lustre.0 10000000:01000000:1.0:1651529662.768870:0:166096:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1651529662.768872:0:166096:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 0000000045fe8361/0x3234de053c54359 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd62a6 expref: -99 pid: 166096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529662.768875:0:166096:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 0000000045fe8361/0x3234de053c54359 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd62a6 expref: -99 pid: 166096 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651529662.768878:0:166096:0:(mgc_request.c:215:do_config_log_add()) do adding config log params-ffff94e0d279b000 10000000:01000000:1.0:1651529662.768879:0:166096:0:(mgc_request.c:90:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1651529662.768880:0:166096:0:(mgc_request.c:215:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1651529662.768881:0:166096:0:(mgc_request.c:90:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1651529662.768882:0:166096:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1651529662.768883:0:166096:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1651529662.768888:0:166096:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 000000003c5315da/0x3234de053c54360 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 166096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529662.768891:0:166096:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 000000003c5315da/0x3234de053c54360 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 166096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529662.768894:0:166096:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 000000003c5315da/0x3234de053c54360 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 166096 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529662.768898:0:166096:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e0bff89e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9063caa-b124-4cb6-99ef-d01a735595c3:166096:1731745997082752:10.240.43.61@tcp:101:mount.lustre.0 00000100:00100000:1.0:1651529662.768913:0:166096:0:(client.c:2492:ptlrpc_set_wait()) set 0000000064b9c5f3 going to sleep for 6 seconds 00000100:00100000:1.0:1651529662.769106:0:166096:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e0bff89e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9063caa-b124-4cb6-99ef-d01a735595c3:166096:1731745997082752:10.240.43.61@tcp:101:mount.lustre.0 00010000:00010000:1.0:1651529662.769110:0:166096:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 000000003c5315da/0x3234de053c54360 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd62ad expref: -99 pid: 166096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529662.769113:0:166096:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 000000003c5315da/0x3234de053c54360 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553dd62ad expref: -99 pid: 166096 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1651529662.770408:0:166096:0:(llog_osd.c:233:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1651529662.773983:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x17:0x0].1, 224 off8416 00000040:00080000:1.0:1651529662.773994:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x17:0x0].2, 128 off8544 00000040:00080000:1.0:1651529662.773998:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x17:0x0].3, 112 off8656 00000040:00080000:1.0:1651529662.774003:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x17:0x0].4, 224 off8880 00000040:00080000:1.0:1651529662.774007:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x17:0x0].5, 224 off9104 00000040:00080000:1.0:1651529662.774019:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x17:0x0].6, 120 off9224 00000040:00080000:1.0:1651529662.774027:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x17:0x0].7, 224 off9448 00000040:00080000:1.0:1651529662.774033:0:166096:0:(llog.c:768:llog_process_thread()) stop processing plain 0x12:10:0 index 8 count 8 00000100:00100000:1.0:1651529662.774050:0:166096:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e0bff89e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9063caa-b124-4cb6-99ef-d01a735595c3:166096:1731745997082816:10.240.43.61@tcp:501:mount.lustre.0 00000100:00100000:1.0:1651529662.774069:0:166096:0:(client.c:2492:ptlrpc_set_wait()) set 000000001ec7f4cb going to sleep for 6 seconds 00000100:00100000:1.0:1651529662.774314:0:166096:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e0bff89e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9063caa-b124-4cb6-99ef-d01a735595c3:166096:1731745997082816:10.240.43.61@tcp:501:mount.lustre.0 00000100:00100000:1.0:1651529662.774324:0:166096:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e0bff89e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9063caa-b124-4cb6-99ef-d01a735595c3:166096:1731745997082880:10.240.43.61@tcp:503:mount.lustre.0 00000100:00100000:1.0:1651529662.774345:0:166096:0:(client.c:2492:ptlrpc_set_wait()) set 000000001ec7f4cb going to sleep for 6 seconds 00000100:00100000:1.0:1651529662.774802:0:166096:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e0bff89e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9063caa-b124-4cb6-99ef-d01a735595c3:166096:1731745997082880:10.240.43.61@tcp:503:mount.lustre.0 00000040:00080000:1.0:1651529662.774958:0:166096:0:(llog_osd.c:233:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1651529662.774967:0:166096:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e0bff89e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9063caa-b124-4cb6-99ef-d01a735595c3:166096:1731745997082944:10.240.43.61@tcp:502:mount.lustre.0 00000100:00100000:1.0:1651529662.774987:0:166096:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c34c0cde going to sleep for 6 seconds 00000100:00100000:1.0:1651529662.775316:0:166096:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e0bff89e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9063caa-b124-4cb6-99ef-d01a735595c3:166096:1731745997082944:10.240.43.61@tcp:502:mount.lustre.0 00000040:00080000:1.0:1651529662.775393:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x18:0x0].1, 224 off8416 00000040:00080000:1.0:1651529662.775402:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x18:0x0].2, 128 off8544 00000040:00080000:1.0:1651529662.775406:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x18:0x0].3, 112 off8656 00000040:00080000:1.0:1651529662.775410:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x18:0x0].4, 224 off8880 00000040:00080000:1.0:1651529662.775414:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x18:0x0].5, 224 off9104 00000040:00080000:1.0:1651529662.775419:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x18:0x0].6, 120 off9224 00000100:00100000:1.0:1651529662.775426:0:166096:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e0bff89e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9063caa-b124-4cb6-99ef-d01a735595c3:166096:1731745997083008:10.240.43.61@tcp:502:mount.lustre.0 00000100:00100000:1.0:1651529662.775445:0:166096:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c34c0cde going to sleep for 6 seconds 00000100:00100000:1.0:1651529662.775651:0:166096:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e0bff89e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9063caa-b124-4cb6-99ef-d01a735595c3:166096:1731745997083008:10.240.43.61@tcp:502:mount.lustre.0 00000040:00080000:1.0:1651529662.775666:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x18:0x0].7, 224 off9448 00000040:00080000:1.0:1651529662.775668:0:166096:0:(llog.c:768:llog_process_thread()) stop processing plain 0x9:10:0 index 8 count 8 00000020:01000000:0.0:1651529662.776119:0:166124:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1651529662.776126:0:166124:0:(obd_mount.c:991:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1651529662.776132:0:166124:0:(obd_config.c:1356:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1651529662.776134:0:166124:0:(obd_config.c:1432:class_process_config()) marker 11 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1651529662.776136:0:166124:0:(obd_config.c:1356:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1651529662.776145:0:166124:0:(genops.c:417:class_newdev()) Allocate new device lustre-OST0001 (00000000d5646a24) 00000020:00000080:0.0:1651529662.776178:0:166124:0:(obd_config.c:648:class_attach()) OBD: dev 3 attached type obdfilter with refcount 1 00000020:00000080:0.0:1651529662.776180:0:166124:0:(obd_config.c:1356:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1651529662.776221:0:166124:0:(obd_mount_server.c:167:server_get_mount()) get mount 00000000c1f19955 from lustre-OST0001, refs=2 00080000:01000000:0.0:1651529662.776240:0:166124:0:(osd_handler.c:8440:osd_obd_connect()) connect #1 00000020:00000080:0.0:1651529662.776243:0:166124:0:(genops.c:1359:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x3234de053c5436e 00010000:00010000:0.0:1651529662.778742:0:166124:0:(ldlm_pool.c:932:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-0 is initialized 00000001:00000004:0.0:1651529662.778897:0:166124:0:(tgt_lastrcvd.c:701:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 5, last_transno is 17179869184 00080000:10000000:0.0:1651529662.780135:0:166124:0:(osd_handler.c:5198:osd_index_try()) lustre-OST0001: index object [0x200000003:0x11:0x0] (8/32) registered 00000020:00000080:0.0:1651529662.780695:0:166124:0:(obd_config.c:752:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1651529662.780698:0:166124:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1651529662.780701:0:166124:0:(obd_config.c:1356:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1651529662.780701:0:166124:0:(obd_config.c:1432:class_process_config()) marker 11 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1651529662.780703:0:166124:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1651529662.780704:0:166124:0:(obd_config.c:1356:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1651529662.780705:0:166124:0:(obd_config.c:1432:class_process_config()) marker 16 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1651529662.780706:0:166124:0:(obd_config.c:1356:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1651529662.780713:0:166124:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1651529662.780713:0:166124:0:(obd_config.c:1356:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1651529662.780714:0:166124:0:(obd_config.c:1432:class_process_config()) marker 16 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1651529662.780715:0:166124:0:(llog.c:768:llog_process_thread()) stop processing plain 0x18:10:0 index 8 count 8 00000020:01000000:1.0:1651529662.781175:0:166096:0:(obd_config.c:2042:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1651529662.781184:0:166096:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1651529662.781186:0:166096:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 000000003c5315da/0x3234de053c54360 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd62ad expref: -99 pid: 166096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529662.781191:0:166096:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 000000003c5315da/0x3234de053c54360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd62ad expref: -99 pid: 166096 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651529662.781194:0:166096:0:(mgc_request.c:2064:mgc_process_log()) Process log params-ffff94e0d279b000 from 1 10000000:01000000:1.0:1651529662.781195:0:166096:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1651529662.781203:0:166096:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 00000000294488b6/0x3234de053c54375 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 166096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529662.781206:0:166096:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 00000000294488b6/0x3234de053c54375 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 166096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529662.781209:0:166096:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 00000000294488b6/0x3234de053c54375 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 166096 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529662.781218:0:166096:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e0bff89e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9063caa-b124-4cb6-99ef-d01a735595c3:166096:1731745997083072:10.240.43.61@tcp:101:mount.lustre.0 00000100:00100000:1.0:1651529662.781261:0:166096:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c34c0cde going to sleep for 6 seconds 00000100:00100000:1.0:1651529662.781549:0:166096:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e0bff89e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9063caa-b124-4cb6-99ef-d01a735595c3:166096:1731745997083072:10.240.43.61@tcp:101:mount.lustre.0 00010000:00010000:1.0:1651529662.781554:0:166096:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 00000000294488b6/0x3234de053c54375 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd62b4 expref: -99 pid: 166096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529662.781557:0:166096:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 00000000294488b6/0x3234de053c54375 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553dd62b4 expref: -99 pid: 166096 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1651529662.781782:0:166096:0:(llog_osd.c:233:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1651529662.781909:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x19:0x0].1, 224 off8416 00000040:00080000:1.0:1651529662.781930:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x19:0x0].2, 112 off8528 00000040:00080000:1.0:1651529662.781934:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x19:0x0].3, 224 off8752 00000040:00080000:1.0:1651529662.781938:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x19:0x0].4, 224 off8976 00000040:00080000:1.0:1651529662.781942:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x19:0x0].5, 112 off9088 00000040:00080000:1.0:1651529662.781946:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x19:0x0].6, 224 off9312 00000040:00080000:1.0:1651529662.781950:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x19:0x0].7, 224 off9536 00000040:00080000:1.0:1651529662.781954:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x19:0x0].8, 112 off9648 00000040:00080000:1.0:1651529662.781958:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x19:0x0].9, 224 off9872 00000040:00080000:1.0:1651529662.781961:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x19:0x0].10, 224 off10096 00000040:00080000:1.0:1651529662.781965:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x19:0x0].11, 112 off10208 00000040:00080000:1.0:1651529662.781971:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x19:0x0].12, 224 off10432 00000040:00080000:1.0:1651529662.781973:0:166096:0:(llog.c:768:llog_process_thread()) stop processing plain 0x14:10:0 index 13 count 13 00000100:00100000:1.0:1651529662.781984:0:166096:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e0bff89e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9063caa-b124-4cb6-99ef-d01a735595c3:166096:1731745997083136:10.240.43.61@tcp:501:mount.lustre.0 00000100:00100000:1.0:1651529662.782003:0:166096:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c34c0cde going to sleep for 6 seconds 00000100:00100000:1.0:1651529662.782239:0:166096:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e0bff89e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9063caa-b124-4cb6-99ef-d01a735595c3:166096:1731745997083136:10.240.43.61@tcp:501:mount.lustre.0 00000100:00100000:1.0:1651529662.782249:0:166096:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e0bff89e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9063caa-b124-4cb6-99ef-d01a735595c3:166096:1731745997083200:10.240.43.61@tcp:503:mount.lustre.0 00000100:00100000:1.0:1651529662.782277:0:166096:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c34c0cde going to sleep for 6 seconds 00000100:00100000:1.0:1651529662.782498:0:166096:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e0bff89e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9063caa-b124-4cb6-99ef-d01a735595c3:166096:1731745997083200:10.240.43.61@tcp:503:mount.lustre.0 00000040:00080000:1.0:1651529662.782576:0:166096:0:(llog_osd.c:233:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1651529662.782584:0:166096:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e0bff89e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9063caa-b124-4cb6-99ef-d01a735595c3:166096:1731745997083264:10.240.43.61@tcp:502:mount.lustre.0 00000100:00100000:1.0:1651529662.782608:0:166096:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c34c0cde going to sleep for 6 seconds 00000100:00100000:1.0:1651529662.782819:0:166096:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e0bff89e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9063caa-b124-4cb6-99ef-d01a735595c3:166096:1731745997083264:10.240.43.61@tcp:502:mount.lustre.0 00000040:00080000:1.0:1651529662.782882:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1a:0x0].1, 224 off8416 00000040:00080000:1.0:1651529662.782889:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1a:0x0].2, 112 off8528 00000040:00080000:1.0:1651529662.782894:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1a:0x0].3, 224 off8752 00000040:00080000:1.0:1651529662.782898:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1a:0x0].4, 224 off8976 00000040:00080000:1.0:1651529662.782902:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1a:0x0].5, 112 off9088 00000040:00080000:1.0:1651529662.782906:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1a:0x0].6, 224 off9312 00000040:00080000:1.0:1651529662.782910:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1a:0x0].7, 224 off9536 00000040:00080000:1.0:1651529662.782924:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1a:0x0].8, 112 off9648 00000040:00080000:1.0:1651529662.782930:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1a:0x0].9, 224 off9872 00000040:00080000:1.0:1651529662.782934:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1a:0x0].10, 224 off10096 00000040:00080000:1.0:1651529662.782938:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1a:0x0].11, 112 off10208 00000040:00080000:1.0:1651529662.782942:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1a:0x0].12, 224 off10432 00000040:00080000:1.0:1651529662.782946:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1a:0x0].13, 224 off10656 00000040:00080000:1.0:1651529662.782950:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1a:0x0].14, 112 off10768 00000100:00100000:1.0:1651529662.782957:0:166096:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e0bff89e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9063caa-b124-4cb6-99ef-d01a735595c3:166096:1731745997083328:10.240.43.61@tcp:502:mount.lustre.0 00000100:00100000:1.0:1651529662.782973:0:166096:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c34c0cde going to sleep for 6 seconds 00000100:00100000:1.0:1651529662.783169:0:166096:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e0bff89e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9063caa-b124-4cb6-99ef-d01a735595c3:166096:1731745997083328:10.240.43.61@tcp:502:mount.lustre.0 00000040:00080000:1.0:1651529662.783183:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1a:0x0].15, 224 off10992 00000040:00080000:1.0:1651529662.783185:0:166096:0:(llog.c:768:llog_process_thread()) stop processing plain 0x2:10:0 index 16 count 16 00000020:01000000:1.0:1651529662.783338:0:166127:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1651529662.783340:0:166127:0:(obd_config.c:1779:class_config_llog_handler()) SKIP #2 00000020:01000000:1.0:1651529662.783340:0:166127:0:(obd_config.c:1805:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1651529662.783341:0:166127:0:(obd_config.c:1805:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1651529662.783342:0:166127:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1651529662.783343:0:166127:0:(obd_config.c:1356:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1651529662.783344:0:166127:0:(obd_config.c:1432:class_process_config()) marker 2 (0x6) general lod.*.mdt_hash 00000020:01000000:1.0:1651529662.783345:0:166127:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1651529662.783346:0:166127:0:(obd_config.c:1779:class_config_llog_handler()) SKIP #2 00000020:01000000:1.0:1651529662.783346:0:166127:0:(obd_config.c:1805:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1651529662.783347:0:166127:0:(obd_config.c:1805:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1651529662.783347:0:166127:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1651529662.783348:0:166127:0:(obd_config.c:1356:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1651529662.783349:0:166127:0:(obd_config.c:1432:class_process_config()) marker 2 (0x6) lustre osc.lustre*.checksums 00000020:01000000:1.0:1651529662.783350:0:166127:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1651529662.783350:0:166127:0:(obd_config.c:1779:class_config_llog_handler()) SKIP #3 00000020:01000000:1.0:1651529662.783351:0:166127:0:(obd_config.c:1805:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1651529662.783351:0:166127:0:(obd_config.c:1805:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1651529662.783352:0:166127:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1651529662.783352:0:166127:0:(obd_config.c:1356:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1651529662.783353:0:166127:0:(obd_config.c:1432:class_process_config()) marker 3 (0x6) lustre osc.lustre*.checksums 00000020:01000000:1.0:1651529662.783353:0:166127:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1651529662.783354:0:166127:0:(obd_config.c:1356:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1651529662.783355:0:166127:0:(obd_config.c:1432:class_process_config()) marker 4 (0x1) lustre osc.lustre*.checksums 00000020:01000000:1.0:1651529662.783356:0:166127:0:(obd_config.c:1885:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff94e0d279b000 00000020:00000080:1.0:1651529662.783357:0:166127:0:(obd_config.c:1356:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1651529662.783373:0:166127:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1651529662.783374:0:166127:0:(obd_config.c:1356:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1651529662.783374:0:166127:0:(obd_config.c:1432:class_process_config()) marker 4 (0x2) lustre osc.lustre*.checksums 00000020:01000000:1.0:1651529662.783375:0:166127:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1651529662.783376:0:166127:0:(obd_config.c:1356:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1651529662.783376:0:166127:0:(obd_config.c:1432:class_process_config()) marker 2 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1651529662.783378:0:166127:0:(obd_config.c:1885:class_config_llog_handler()) cmd ce032, instance name: general-ffff94e0d279b000 00000020:00000080:1.0:1651529662.783378:0:166127:0:(obd_config.c:1356:class_process_config()) processing cmd: ce032 00000020:00080000:1.0:1651529662.787833:0:166127:0:(obd_config.c:1330:process_param2_config()) lctl: invoked upcall /usr/sbin/lctl set_param lod.*.mdt_hash=crush, time 4452us 00000020:01000000:1.0:1651529662.787841:0:166127:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1651529662.787842:0:166127:0:(obd_config.c:1356:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1651529662.787843:0:166127:0:(obd_config.c:1432:class_process_config()) marker 2 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1651529662.787844:0:166127:0:(llog.c:768:llog_process_thread()) stop processing plain 0x1a:10:0 index 16 count 16 00000020:01000000:1.0:1651529662.787875:0:166096:0:(obd_config.c:2042:class_config_parse_llog()) Processed log params gen 1-15 (rc=0) 10000000:01000000:1.0:1651529662.787882:0:166096:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1651529662.787884:0:166096:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000294488b6/0x3234de053c54375 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd62b4 expref: -99 pid: 166096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529662.787889:0:166096:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 00000000294488b6/0x3234de053c54375 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd62b4 expref: -99 pid: 166096 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651529662.787896:0:166096:0:(mgc_request.c:2205:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1651529662.787896:0:166096:0:(mgc_request.c:334:config_log_add()) add config log lustre-client-ffff94e0d279b000 10000000:01000000:1.0:1651529662.787897:0:166096:0:(mgc_request.c:215:do_config_log_add()) do adding config log lustre-client-ffff94e0d279b000 10000000:01000000:1.0:1651529662.787898:0:166096:0:(mgc_request.c:90:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1651529662.787900:0:166096:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff94e0d279b000 from 1 10000000:01000000:1.0:1651529662.787901:0:166096:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1651529662.787907:0:166096:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 00000000e35b0bde/0x3234de053c5437c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 166096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529662.787910:0:166096:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 00000000e35b0bde/0x3234de053c5437c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 166096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529662.787913:0:166096:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 00000000e35b0bde/0x3234de053c5437c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 166096 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529662.787931:0:166096:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e0bff89e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9063caa-b124-4cb6-99ef-d01a735595c3:166096:1731745997083392:10.240.43.61@tcp:101:mount.lustre.0 00000100:00100000:1.0:1651529662.787948:0:166096:0:(client.c:2492:ptlrpc_set_wait()) set 00000000efb6ae52 going to sleep for 6 seconds 00000100:00100000:1.0:1651529662.790808:0:166096:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e0bff89e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9063caa-b124-4cb6-99ef-d01a735595c3:166096:1731745997083392:10.240.43.61@tcp:101:mount.lustre.0 00010000:00010000:1.0:1651529662.790814:0:166096:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 00000000e35b0bde/0x3234de053c5437c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd62bb expref: -99 pid: 166096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529662.790821:0:166096:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 00000000e35b0bde/0x3234de053c5437c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553dd62bb expref: -99 pid: 166096 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1651529662.792086:0:166096:0:(llog_osd.c:233:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1651529662.792312:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].1, 224 off8416 00000040:00080000:1.0:1651529662.792321:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].2, 120 off8536 00000040:00080000:1.0:1651529662.792326:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].3, 168 off8704 00000040:00080000:1.0:1651529662.792330:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].4, 224 off8928 00000040:00080000:1.0:1651529662.792334:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].5, 224 off9152 00000040:00080000:1.0:1651529662.792338:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].6, 120 off9272 00000040:00080000:1.0:1651529662.792342:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].7, 168 off9440 00000040:00080000:1.0:1651529662.792347:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].8, 224 off9664 00000040:00080000:1.0:1651529662.792351:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].9, 224 off9888 00000040:00080000:1.0:1651529662.792355:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].10, 88 off9976 00000040:00080000:1.0:1651529662.792359:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].11, 128 off10104 00000040:00080000:1.0:1651529662.792363:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].12, 144 off10248 00000040:00080000:1.0:1651529662.792367:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].13, 160 off10408 00000040:00080000:1.0:1651529662.792371:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].14, 224 off10632 00000040:00080000:1.0:1651529662.792375:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].15, 224 off10856 00000040:00080000:1.0:1651529662.792379:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].16, 120 off10976 00000040:00080000:1.0:1651529662.792382:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].17, 224 off11200 00000040:00080000:1.0:1651529662.792386:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].18, 224 off11424 00000040:00080000:1.0:1651529662.792390:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].19, 88 off11512 00000040:00080000:1.0:1651529662.792394:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].20, 128 off11640 00000040:00080000:1.0:1651529662.792398:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].21, 144 off11784 00000040:00080000:1.0:1651529662.792402:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].22, 128 off11912 00000040:00080000:1.0:1651529662.792406:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].23, 224 off12136 00000040:00080000:1.0:1651529662.792425:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].24, 224 off12360 00000040:00080000:1.0:1651529662.792431:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].25, 88 off12448 00000040:00080000:1.0:1651529662.792435:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].26, 128 off12576 00000040:00080000:1.0:1651529662.792439:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].27, 144 off12720 00000040:00080000:1.0:1651529662.792444:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].28, 128 off12848 00000040:00080000:1.0:1651529662.792448:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].29, 224 off13072 00000040:00080000:1.0:1651529662.792452:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].30, 224 off13296 00000040:00080000:1.0:1651529662.792456:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].31, 120 off13416 00000040:00080000:1.0:1651529662.792460:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].32, 224 off13640 00000040:00080000:1.0:1651529662.792464:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].33, 224 off13864 00000040:00080000:1.0:1651529662.792468:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].34, 112 off13976 00000040:00080000:1.0:1651529662.792472:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].35, 224 off14200 00000040:00080000:1.0:1651529662.792476:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].36, 224 off14424 00000040:00080000:1.0:1651529662.792480:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].37, 136 off14560 00000040:00080000:1.0:1651529662.792484:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].38, 224 off14784 00000040:00080000:1.0:1651529662.792488:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].39, 224 off15008 00000040:00080000:1.0:1651529662.792492:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].40, 136 off15144 00000040:00080000:1.0:1651529662.792496:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].41, 224 off15368 00000040:00080000:1.0:1651529662.792500:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].42, 224 off15592 00000040:00080000:1.0:1651529662.792504:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].43, 112 off15704 00000040:00080000:1.0:1651529662.792508:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].44, 224 off15928 00000040:00080000:1.0:1651529662.792512:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].45, 224 off16152 00000040:00080000:1.0:1651529662.792515:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].46, 112 off16264 00000040:00080000:1.0:1651529662.792681:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].48, 224 off16608 00000040:00080000:1.0:1651529662.792689:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].49, 224 off16832 00000040:00080000:1.0:1651529662.792693:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].50, 136 off16968 00000040:00080000:1.0:1651529662.792697:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].51, 224 off17192 00000040:00080000:1.0:1651529662.792701:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].52, 224 off17416 00000040:00080000:1.0:1651529662.792706:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].53, 136 off17552 00000040:00080000:1.0:1651529662.792710:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].54, 224 off17776 00000040:00080000:1.0:1651529662.792714:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].55, 224 off18000 00000040:00080000:1.0:1651529662.792718:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].56, 136 off18136 00000040:00080000:1.0:1651529662.792722:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].57, 224 off18360 00000040:00080000:1.0:1651529662.792726:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].58, 224 off18584 00000040:00080000:1.0:1651529662.792729:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].59, 136 off18720 00000040:00080000:1.0:1651529662.792733:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].60, 224 off18944 00000040:00080000:1.0:1651529662.792737:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].61, 224 off19168 00000040:00080000:1.0:1651529662.792741:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].62, 112 off19280 00000040:00080000:1.0:1651529662.792745:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].63, 224 off19504 00000040:00080000:1.0:1651529662.792749:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].64, 224 off19728 00000040:00080000:1.0:1651529662.792753:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].65, 112 off19840 00000040:00080000:1.0:1651529662.792757:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].66, 224 off20064 00000040:00080000:1.0:1651529662.792761:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].67, 224 off20288 00000040:00080000:1.0:1651529662.792765:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].68, 136 off20424 00000040:00080000:1.0:1651529662.792784:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].69, 224 off20648 00000040:00080000:1.0:1651529662.792790:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].70, 224 off20872 00000040:00080000:1.0:1651529662.792794:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].71, 136 off21008 00000040:00080000:1.0:1651529662.792798:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].72, 224 off21232 00000040:00080000:1.0:1651529662.792802:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].73, 224 off21456 00000040:00080000:1.0:1651529662.792806:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].74, 112 off21568 00000040:00080000:1.0:1651529662.792810:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].75, 224 off21792 00000040:00080000:1.0:1651529662.792814:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].76, 224 off22016 00000040:00080000:1.0:1651529662.792818:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].77, 112 off22128 00000040:00080000:1.0:1651529662.792822:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].78, 224 off22352 00000040:00080000:1.0:1651529662.792826:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].79, 224 off22576 00000040:00080000:1.0:1651529662.792830:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].80, 136 off22712 00000040:00080000:1.0:1651529662.792834:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].81, 224 off22936 00000040:00080000:1.0:1651529662.792838:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].82, 224 off23160 00000040:00080000:1.0:1651529662.792842:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].83, 136 off23296 00000040:00080000:1.0:1651529662.792846:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].84, 224 off23520 00000040:00080000:1.0:1651529662.792850:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].85, 224 off23744 00000040:00080000:1.0:1651529662.792854:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].86, 112 off23856 00000040:00080000:1.0:1651529662.792858:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].87, 224 off24080 00000040:00080000:1.0:1651529662.792862:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].88, 224 off24304 00000040:00080000:1.0:1651529662.792866:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].89, 112 off24416 00000040:00080000:1.0:1651529662.793033:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].91, 224 off24800 00000040:00080000:1.0:1651529662.793041:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].92, 224 off25024 00000040:00080000:1.0:1651529662.793045:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].93, 112 off25136 00000040:00080000:1.0:1651529662.793049:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].94, 224 off25360 00000040:00080000:1.0:1651529662.793054:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].95, 224 off25584 00000040:00080000:1.0:1651529662.793058:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].96, 112 off25696 00000040:00080000:1.0:1651529662.793062:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].97, 224 off25920 00000040:00080000:1.0:1651529662.793066:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].98, 224 off26144 00000040:00080000:1.0:1651529662.793070:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].99, 136 off26280 00000040:00080000:1.0:1651529662.793074:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].100, 224 off26504 00000040:00080000:1.0:1651529662.793078:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].101, 224 off26728 00000040:00080000:1.0:1651529662.793082:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].102, 136 off26864 00000040:00080000:1.0:1651529662.793086:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].103, 224 off27088 00000040:00080000:1.0:1651529662.793090:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].104, 224 off27312 00000040:00080000:1.0:1651529662.793094:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].105, 136 off27448 00000040:00080000:1.0:1651529662.793098:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].106, 224 off27672 00000040:00080000:1.0:1651529662.793102:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].107, 224 off27896 00000040:00080000:1.0:1651529662.793106:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].108, 136 off28032 00000040:00080000:1.0:1651529662.793110:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].109, 224 off28256 00000040:00080000:1.0:1651529662.793114:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].110, 224 off28480 00000040:00080000:1.0:1651529662.793118:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].111, 112 off28592 00000040:00080000:1.0:1651529662.793137:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].112, 224 off28816 00000040:00080000:1.0:1651529662.793143:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].113, 224 off29040 00000040:00080000:1.0:1651529662.793147:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].114, 112 off29152 00000040:00080000:1.0:1651529662.793151:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].115, 224 off29376 00000040:00080000:1.0:1651529662.793155:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].116, 224 off29600 00000040:00080000:1.0:1651529662.793159:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].117, 136 off29736 00000040:00080000:1.0:1651529662.793163:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].118, 224 off29960 00000040:00080000:1.0:1651529662.793167:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].119, 224 off30184 00000040:00080000:1.0:1651529662.793171:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].120, 136 off30320 00000040:00080000:1.0:1651529662.793175:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].121, 224 off30544 00000040:00080000:1.0:1651529662.793178:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].122, 224 off30768 00000040:00080000:1.0:1651529662.793182:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].123, 112 off30880 00000040:00080000:1.0:1651529662.793186:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].124, 224 off31104 00000040:00080000:1.0:1651529662.793191:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].125, 224 off31328 00000040:00080000:1.0:1651529662.793195:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].126, 112 off31440 00000040:00080000:1.0:1651529662.793199:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].127, 224 off31664 00000040:00080000:1.0:1651529662.793203:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].128, 224 off31888 00000040:00080000:1.0:1651529662.793207:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].129, 136 off32024 00000040:00080000:1.0:1651529662.793211:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].130, 224 off32248 00000040:00080000:1.0:1651529662.793214:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].131, 224 off32472 00000040:00080000:1.0:1651529662.793218:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].132, 112 off32584 00000040:00080000:1.0:1651529662.793395:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].134, 224 off32992 00000040:00080000:1.0:1651529662.793402:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].135, 224 off33216 00000040:00080000:1.0:1651529662.793406:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].136, 136 off33352 00000040:00080000:1.0:1651529662.793410:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].137, 224 off33576 00000040:00080000:1.0:1651529662.793414:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].138, 224 off33800 00000040:00080000:1.0:1651529662.793418:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].139, 112 off33912 00000040:00080000:1.0:1651529662.793422:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].140, 224 off34136 00000040:00080000:1.0:1651529662.793427:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].141, 224 off34360 00000040:00080000:1.0:1651529662.793431:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].142, 136 off34496 00000040:00080000:1.0:1651529662.793434:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].143, 224 off34720 00000040:00080000:1.0:1651529662.793438:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].144, 224 off34944 00000040:00080000:1.0:1651529662.793442:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].145, 136 off35080 00000040:00080000:1.0:1651529662.793446:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].146, 224 off35304 00000040:00080000:1.0:1651529662.793450:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].147, 224 off35528 00000040:00080000:1.0:1651529662.793454:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].148, 136 off35664 00000040:00080000:1.0:1651529662.793458:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].149, 224 off35888 00000040:00080000:1.0:1651529662.793462:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].150, 224 off36112 00000040:00080000:1.0:1651529662.793466:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].151, 112 off36224 00000040:00080000:1.0:1651529662.793470:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].152, 224 off36448 00000040:00080000:1.0:1651529662.793474:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].153, 224 off36672 00000040:00080000:1.0:1651529662.793477:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].154, 136 off36808 00000040:00080000:1.0:1651529662.793498:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].155, 224 off37032 00000040:00080000:1.0:1651529662.793504:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].156, 224 off37256 00000040:00080000:1.0:1651529662.793508:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].157, 112 off37368 00000040:00080000:1.0:1651529662.793512:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].158, 224 off37592 00000040:00080000:1.0:1651529662.793516:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].159, 224 off37816 00000040:00080000:1.0:1651529662.793521:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].160, 136 off37952 00000040:00080000:1.0:1651529662.793525:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].161, 224 off38176 00000040:00080000:1.0:1651529662.793529:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].162, 224 off38400 00000040:00080000:1.0:1651529662.793533:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].163, 136 off38536 00000040:00080000:1.0:1651529662.793536:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].164, 224 off38760 00000040:00080000:1.0:1651529662.793540:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].165, 224 off38984 00000040:00080000:1.0:1651529662.793544:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].166, 112 off39096 00000040:00080000:1.0:1651529662.793548:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].167, 224 off39320 00000040:00080000:1.0:1651529662.793552:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].168, 224 off39544 00000040:00080000:1.0:1651529662.793556:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].169, 112 off39656 00000040:00080000:1.0:1651529662.793562:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].170, 224 off39880 00000040:00080000:1.0:1651529662.793566:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].171, 224 off40104 00000040:00080000:1.0:1651529662.793570:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].172, 136 off40240 00000040:00080000:1.0:1651529662.793573:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].173, 224 off40464 00000040:00080000:1.0:1651529662.793577:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].174, 224 off40688 00000040:00080000:1.0:1651529662.793581:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].175, 136 off40824 00000040:00080000:1.0:1651529662.793734:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].177, 224 off41184 00000040:00080000:1.0:1651529662.793741:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].178, 224 off41408 00000040:00080000:1.0:1651529662.793745:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].179, 136 off41544 00000040:00080000:1.0:1651529662.793749:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].180, 224 off41768 00000040:00080000:1.0:1651529662.793753:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].181, 224 off41992 00000040:00080000:1.0:1651529662.793757:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].182, 136 off42128 00000040:00080000:1.0:1651529662.793761:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].183, 224 off42352 00000040:00080000:1.0:1651529662.793765:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].184, 224 off42576 00000040:00080000:1.0:1651529662.793768:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].185, 112 off42688 00000040:00080000:1.0:1651529662.793772:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].186, 224 off42912 00000040:00080000:1.0:1651529662.793778:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].187, 224 off43136 00000040:00080000:1.0:1651529662.793782:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].188, 112 off43248 00000040:00080000:1.0:1651529662.793786:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].189, 224 off43472 00000040:00080000:1.0:1651529662.793790:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].190, 224 off43696 00000040:00080000:1.0:1651529662.793794:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].191, 136 off43832 00000040:00080000:1.0:1651529662.793798:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].192, 224 off44056 00000040:00080000:1.0:1651529662.793801:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].193, 224 off44280 00000040:00080000:1.0:1651529662.793805:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].194, 136 off44416 00000040:00080000:1.0:1651529662.793809:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].195, 224 off44640 00000040:00080000:1.0:1651529662.793813:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].196, 224 off44864 00000040:00080000:1.0:1651529662.793817:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].197, 136 off45000 00000040:00080000:1.0:1651529662.793837:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].198, 224 off45224 00000040:00080000:1.0:1651529662.793842:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].199, 224 off45448 00000040:00080000:1.0:1651529662.793847:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].200, 136 off45584 00000040:00080000:1.0:1651529662.793851:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].201, 224 off45808 00000040:00080000:1.0:1651529662.793855:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].202, 224 off46032 00000040:00080000:1.0:1651529662.793860:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].203, 112 off46144 00000040:00080000:1.0:1651529662.793866:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1b:0x0].204, 224 off46368 00000040:00080000:1.0:1651529662.793868:0:166096:0:(llog.c:768:llog_process_thread()) stop processing plain 0x16:10:0 index 205 count 201 00000100:00100000:1.0:1651529662.793881:0:166096:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e0bff89e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9063caa-b124-4cb6-99ef-d01a735595c3:166096:1731745997083456:10.240.43.61@tcp:501:mount.lustre.0 00000100:00100000:1.0:1651529662.793902:0:166096:0:(client.c:2492:ptlrpc_set_wait()) set 00000000efb6ae52 going to sleep for 6 seconds 00000100:00100000:1.0:1651529662.794143:0:166096:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e0bff89e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9063caa-b124-4cb6-99ef-d01a735595c3:166096:1731745997083456:10.240.43.61@tcp:501:mount.lustre.0 00000100:00100000:1.0:1651529662.794153:0:166096:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e0bff89e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9063caa-b124-4cb6-99ef-d01a735595c3:166096:1731745997083520:10.240.43.61@tcp:503:mount.lustre.0 00000100:00100000:1.0:1651529662.794171:0:166096:0:(client.c:2492:ptlrpc_set_wait()) set 00000000efb6ae52 going to sleep for 6 seconds 00000100:00100000:1.0:1651529662.794383:0:166096:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e0bff89e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9063caa-b124-4cb6-99ef-d01a735595c3:166096:1731745997083520:10.240.43.61@tcp:503:mount.lustre.0 00000040:00080000:1.0:1651529662.794471:0:166096:0:(llog_osd.c:233:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1651529662.794480:0:166096:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e0bff89e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9063caa-b124-4cb6-99ef-d01a735595c3:166096:1731745997083584:10.240.43.61@tcp:502:mount.lustre.0 00000100:00100000:1.0:1651529662.794501:0:166096:0:(client.c:2492:ptlrpc_set_wait()) set 00000000efb6ae52 going to sleep for 6 seconds 00000100:00100000:1.0:1651529662.794708:0:166096:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e0bff89e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9063caa-b124-4cb6-99ef-d01a735595c3:166096:1731745997083584:10.240.43.61@tcp:502:mount.lustre.0 00000040:00080000:1.0:1651529662.794771:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].1, 224 off8416 00000040:00080000:1.0:1651529662.794779:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].2, 120 off8536 00000040:00080000:1.0:1651529662.794784:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].3, 168 off8704 00000040:00080000:1.0:1651529662.794788:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].4, 224 off8928 00000040:00080000:1.0:1651529662.794792:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].5, 224 off9152 00000040:00080000:1.0:1651529662.794795:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].6, 120 off9272 00000040:00080000:1.0:1651529662.794799:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].7, 168 off9440 00000040:00080000:1.0:1651529662.794803:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].8, 224 off9664 00000040:00080000:1.0:1651529662.794807:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].9, 224 off9888 00000040:00080000:1.0:1651529662.794811:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].10, 88 off9976 00000040:00080000:1.0:1651529662.794815:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].11, 128 off10104 00000040:00080000:1.0:1651529662.794819:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].12, 144 off10248 00000040:00080000:1.0:1651529662.794823:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].13, 160 off10408 00000040:00080000:1.0:1651529662.794828:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].14, 224 off10632 00000040:00080000:1.0:1651529662.794832:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].15, 224 off10856 00000040:00080000:1.0:1651529662.794836:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].16, 120 off10976 00000040:00080000:1.0:1651529662.794840:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].17, 224 off11200 00000040:00080000:1.0:1651529662.794844:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].18, 224 off11424 00000040:00080000:1.0:1651529662.794848:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].19, 88 off11512 00000040:00080000:1.0:1651529662.794852:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].20, 128 off11640 00000040:00080000:1.0:1651529662.794856:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].21, 144 off11784 00000040:00080000:1.0:1651529662.794859:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].22, 128 off11912 00000040:00080000:1.0:1651529662.794863:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].23, 224 off12136 00000040:00080000:1.0:1651529662.794883:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].24, 224 off12360 00000040:00080000:1.0:1651529662.794889:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].25, 88 off12448 00000040:00080000:1.0:1651529662.794893:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].26, 128 off12576 00000040:00080000:1.0:1651529662.794897:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].27, 144 off12720 00000040:00080000:1.0:1651529662.794900:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].28, 128 off12848 00000040:00080000:1.0:1651529662.794904:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].29, 224 off13072 00000040:00080000:1.0:1651529662.794910:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].30, 224 off13296 00000040:00080000:1.0:1651529662.794925:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].31, 120 off13416 00000040:00080000:1.0:1651529662.794931:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].32, 224 off13640 00000040:00080000:1.0:1651529662.794935:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].33, 224 off13864 00000040:00080000:1.0:1651529662.794939:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].34, 112 off13976 00000040:00080000:1.0:1651529662.794943:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].35, 224 off14200 00000040:00080000:1.0:1651529662.794947:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].36, 224 off14424 00000040:00080000:1.0:1651529662.794951:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].37, 136 off14560 00000040:00080000:1.0:1651529662.794955:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].38, 224 off14784 00000040:00080000:1.0:1651529662.794959:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].39, 224 off15008 00000040:00080000:1.0:1651529662.794963:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].40, 136 off15144 00000040:00080000:1.0:1651529662.794967:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].41, 224 off15368 00000040:00080000:1.0:1651529662.794971:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].42, 224 off15592 00000040:00080000:1.0:1651529662.794975:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].43, 112 off15704 00000040:00080000:1.0:1651529662.794978:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].44, 224 off15928 00000040:00080000:1.0:1651529662.794982:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].45, 224 off16152 00000040:00080000:1.0:1651529662.794988:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].46, 112 off16264 00000100:00100000:1.0:1651529662.794995:0:166096:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e0bff89e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9063caa-b124-4cb6-99ef-d01a735595c3:166096:1731745997083648:10.240.43.61@tcp:502:mount.lustre.0 00000100:00100000:1.0:1651529662.795013:0:166096:0:(client.c:2492:ptlrpc_set_wait()) set 00000000efb6ae52 going to sleep for 6 seconds 00000100:00100000:1.0:1651529662.795241:0:166096:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e0bff89e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9063caa-b124-4cb6-99ef-d01a735595c3:166096:1731745997083648:10.240.43.61@tcp:502:mount.lustre.0 00000040:00080000:1.0:1651529662.795276:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].48, 224 off16608 00000040:00080000:1.0:1651529662.795282:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].49, 224 off16832 00000040:00080000:1.0:1651529662.795286:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].50, 136 off16968 00000040:00080000:1.0:1651529662.795290:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].51, 224 off17192 00000040:00080000:1.0:1651529662.795294:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].52, 224 off17416 00000040:00080000:1.0:1651529662.795298:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].53, 136 off17552 00000040:00080000:1.0:1651529662.795302:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].54, 224 off17776 00000040:00080000:1.0:1651529662.795306:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].55, 224 off18000 00000040:00080000:1.0:1651529662.795310:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].56, 136 off18136 00000040:00080000:1.0:1651529662.795314:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].57, 224 off18360 00000040:00080000:1.0:1651529662.795317:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].58, 224 off18584 00000040:00080000:1.0:1651529662.795321:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].59, 136 off18720 00000040:00080000:1.0:1651529662.795325:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].60, 224 off18944 00000040:00080000:1.0:1651529662.795329:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].61, 224 off19168 00000040:00080000:1.0:1651529662.795333:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].62, 112 off19280 00000040:00080000:1.0:1651529662.795338:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].63, 224 off19504 00000040:00080000:1.0:1651529662.795343:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].64, 224 off19728 00000040:00080000:1.0:1651529662.795347:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].65, 112 off19840 00000040:00080000:1.0:1651529662.795351:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].66, 224 off20064 00000040:00080000:1.0:1651529662.795354:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].67, 224 off20288 00000040:00080000:1.0:1651529662.795358:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].68, 136 off20424 00000040:00080000:1.0:1651529662.795378:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].69, 224 off20648 00000040:00080000:1.0:1651529662.795384:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].70, 224 off20872 00000040:00080000:1.0:1651529662.795388:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].71, 136 off21008 00000040:00080000:1.0:1651529662.795392:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].72, 224 off21232 00000040:00080000:1.0:1651529662.795396:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].73, 224 off21456 00000040:00080000:1.0:1651529662.795399:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].74, 112 off21568 00000040:00080000:1.0:1651529662.795403:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].75, 224 off21792 00000040:00080000:1.0:1651529662.795407:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].76, 224 off22016 00000040:00080000:1.0:1651529662.795411:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].77, 112 off22128 00000040:00080000:1.0:1651529662.795415:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].78, 224 off22352 00000040:00080000:1.0:1651529662.795420:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].79, 224 off22576 00000040:00080000:1.0:1651529662.795424:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].80, 136 off22712 00000040:00080000:1.0:1651529662.795428:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].81, 224 off22936 00000040:00080000:1.0:1651529662.795432:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].82, 224 off23160 00000040:00080000:1.0:1651529662.795436:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].83, 136 off23296 00000040:00080000:1.0:1651529662.795439:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].84, 224 off23520 00000040:00080000:1.0:1651529662.795443:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].85, 224 off23744 00000040:00080000:1.0:1651529662.795447:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].86, 112 off23856 00000040:00080000:1.0:1651529662.795451:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].87, 224 off24080 00000040:00080000:1.0:1651529662.795455:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].88, 224 off24304 00000040:00080000:1.0:1651529662.795458:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].89, 112 off24416 00000100:00100000:1.0:1651529662.795465:0:166096:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e0bff89e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9063caa-b124-4cb6-99ef-d01a735595c3:166096:1731745997083712:10.240.43.61@tcp:502:mount.lustre.0 00000100:00100000:1.0:1651529662.795483:0:166096:0:(client.c:2492:ptlrpc_set_wait()) set 00000000efb6ae52 going to sleep for 6 seconds 00000100:00100000:1.0:1651529662.795684:0:166096:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e0bff89e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9063caa-b124-4cb6-99ef-d01a735595c3:166096:1731745997083712:10.240.43.61@tcp:502:mount.lustre.0 00000040:00080000:1.0:1651529662.795717:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].91, 224 off24800 00000040:00080000:1.0:1651529662.795724:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].92, 224 off25024 00000040:00080000:1.0:1651529662.795729:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].93, 112 off25136 00000040:00080000:1.0:1651529662.795733:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].94, 224 off25360 00000040:00080000:1.0:1651529662.795737:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].95, 224 off25584 00000040:00080000:1.0:1651529662.795742:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].96, 112 off25696 00000040:00080000:1.0:1651529662.795746:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].97, 224 off25920 00000040:00080000:1.0:1651529662.795750:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].98, 224 off26144 00000040:00080000:1.0:1651529662.795754:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].99, 136 off26280 00000040:00080000:1.0:1651529662.795758:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].100, 224 off26504 00000040:00080000:1.0:1651529662.795762:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].101, 224 off26728 00000040:00080000:1.0:1651529662.795766:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].102, 136 off26864 00000040:00080000:1.0:1651529662.795770:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].103, 224 off27088 00000040:00080000:1.0:1651529662.795773:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].104, 224 off27312 00000040:00080000:1.0:1651529662.795777:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].105, 136 off27448 00000040:00080000:1.0:1651529662.795781:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].106, 224 off27672 00000040:00080000:1.0:1651529662.795785:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].107, 224 off27896 00000040:00080000:1.0:1651529662.795789:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].108, 136 off28032 00000040:00080000:1.0:1651529662.795793:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].109, 224 off28256 00000040:00080000:1.0:1651529662.795797:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].110, 224 off28480 00000040:00080000:1.0:1651529662.795800:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].111, 112 off28592 00000040:00080000:1.0:1651529662.795824:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].112, 224 off28816 00000040:00080000:1.0:1651529662.795831:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].113, 224 off29040 00000040:00080000:1.0:1651529662.795835:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].114, 112 off29152 00000040:00080000:1.0:1651529662.795839:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].115, 224 off29376 00000040:00080000:1.0:1651529662.795843:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].116, 224 off29600 00000040:00080000:1.0:1651529662.795847:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].117, 136 off29736 00000040:00080000:1.0:1651529662.795851:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].118, 224 off29960 00000040:00080000:1.0:1651529662.795855:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].119, 224 off30184 00000040:00080000:1.0:1651529662.795859:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].120, 136 off30320 00000040:00080000:1.0:1651529662.795863:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].121, 224 off30544 00000040:00080000:1.0:1651529662.795867:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].122, 224 off30768 00000040:00080000:1.0:1651529662.795871:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].123, 112 off30880 00000040:00080000:1.0:1651529662.795875:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].124, 224 off31104 00000040:00080000:1.0:1651529662.795879:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].125, 224 off31328 00000040:00080000:1.0:1651529662.795883:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].126, 112 off31440 00000040:00080000:1.0:1651529662.795887:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].127, 224 off31664 00000040:00080000:1.0:1651529662.795892:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].128, 224 off31888 00000040:00080000:1.0:1651529662.795897:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].129, 136 off32024 00000040:00080000:1.0:1651529662.795901:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].130, 224 off32248 00000040:00080000:1.0:1651529662.795905:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].131, 224 off32472 00000040:00080000:1.0:1651529662.795908:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].132, 112 off32584 00000100:00100000:1.0:1651529662.795925:0:166096:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e0bff89e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9063caa-b124-4cb6-99ef-d01a735595c3:166096:1731745997083776:10.240.43.61@tcp:502:mount.lustre.0 00000100:00100000:1.0:1651529662.795942:0:166096:0:(client.c:2492:ptlrpc_set_wait()) set 00000000efb6ae52 going to sleep for 6 seconds 00000100:00100000:1.0:1651529662.796143:0:166096:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e0bff89e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9063caa-b124-4cb6-99ef-d01a735595c3:166096:1731745997083776:10.240.43.61@tcp:502:mount.lustre.0 00000040:00080000:1.0:1651529662.796178:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].134, 224 off32992 00000040:00080000:1.0:1651529662.796185:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].135, 224 off33216 00000040:00080000:1.0:1651529662.796189:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].136, 136 off33352 00000040:00080000:1.0:1651529662.796193:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].137, 224 off33576 00000040:00080000:1.0:1651529662.796197:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].138, 224 off33800 00000040:00080000:1.0:1651529662.796201:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].139, 112 off33912 00000040:00080000:1.0:1651529662.796205:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].140, 224 off34136 00000040:00080000:1.0:1651529662.796209:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].141, 224 off34360 00000040:00080000:1.0:1651529662.796212:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].142, 136 off34496 00000040:00080000:1.0:1651529662.796216:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].143, 224 off34720 00000040:00080000:1.0:1651529662.796220:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].144, 224 off34944 00000040:00080000:1.0:1651529662.796258:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].145, 136 off35080 00000040:00080000:1.0:1651529662.796263:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].146, 224 off35304 00000040:00080000:1.0:1651529662.796267:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].147, 224 off35528 00000040:00080000:1.0:1651529662.796271:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].148, 136 off35664 00000040:00080000:1.0:1651529662.796274:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].149, 224 off35888 00000040:00080000:1.0:1651529662.796278:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].150, 224 off36112 00000040:00080000:1.0:1651529662.796282:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].151, 112 off36224 00000040:00080000:1.0:1651529662.796286:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].152, 224 off36448 00000040:00080000:1.0:1651529662.796290:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].153, 224 off36672 00000040:00080000:1.0:1651529662.796294:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].154, 136 off36808 00000040:00080000:1.0:1651529662.796316:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].155, 224 off37032 00000040:00080000:1.0:1651529662.796322:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].156, 224 off37256 00000040:00080000:1.0:1651529662.796327:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].157, 112 off37368 00000040:00080000:1.0:1651529662.796330:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].158, 224 off37592 00000040:00080000:1.0:1651529662.796334:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].159, 224 off37816 00000040:00080000:1.0:1651529662.796338:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].160, 136 off37952 00000040:00080000:1.0:1651529662.796344:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].161, 224 off38176 00000040:00080000:1.0:1651529662.796348:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].162, 224 off38400 00000040:00080000:1.0:1651529662.796352:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].163, 136 off38536 00000040:00080000:1.0:1651529662.796355:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].164, 224 off38760 00000040:00080000:1.0:1651529662.796359:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].165, 224 off38984 00000040:00080000:1.0:1651529662.796363:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].166, 112 off39096 00000040:00080000:1.0:1651529662.796367:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].167, 224 off39320 00000040:00080000:1.0:1651529662.796371:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].168, 224 off39544 00000040:00080000:1.0:1651529662.796375:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].169, 112 off39656 00000040:00080000:1.0:1651529662.796379:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].170, 224 off39880 00000040:00080000:1.0:1651529662.796382:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].171, 224 off40104 00000040:00080000:1.0:1651529662.796386:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].172, 136 off40240 00000040:00080000:1.0:1651529662.796390:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].173, 224 off40464 00000040:00080000:1.0:1651529662.796394:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].174, 224 off40688 00000040:00080000:1.0:1651529662.796398:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].175, 136 off40824 00000100:00100000:1.0:1651529662.796405:0:166096:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e0bff89e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9063caa-b124-4cb6-99ef-d01a735595c3:166096:1731745997083840:10.240.43.61@tcp:502:mount.lustre.0 00000100:00100000:1.0:1651529662.796422:0:166096:0:(client.c:2492:ptlrpc_set_wait()) set 00000000efb6ae52 going to sleep for 6 seconds 00000100:00100000:1.0:1651529662.796643:0:166096:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e0bff89e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9063caa-b124-4cb6-99ef-d01a735595c3:166096:1731745997083840:10.240.43.61@tcp:502:mount.lustre.0 00000040:00080000:1.0:1651529662.796677:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].177, 224 off41184 00000040:00080000:1.0:1651529662.796685:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].178, 224 off41408 00000040:00080000:1.0:1651529662.796690:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].179, 136 off41544 00000040:00080000:1.0:1651529662.796694:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].180, 224 off41768 00000040:00080000:1.0:1651529662.796698:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].181, 224 off41992 00000040:00080000:1.0:1651529662.796702:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].182, 136 off42128 00000040:00080000:1.0:1651529662.796706:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].183, 224 off42352 00000040:00080000:1.0:1651529662.796710:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].184, 224 off42576 00000040:00080000:1.0:1651529662.796714:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].185, 112 off42688 00000040:00080000:1.0:1651529662.796718:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].186, 224 off42912 00000040:00080000:1.0:1651529662.796722:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].187, 224 off43136 00000040:00080000:1.0:1651529662.796725:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].188, 112 off43248 00000040:00080000:1.0:1651529662.796729:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].189, 224 off43472 00000040:00080000:1.0:1651529662.796733:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].190, 224 off43696 00000040:00080000:1.0:1651529662.796737:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].191, 136 off43832 00000040:00080000:1.0:1651529662.796741:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].192, 224 off44056 00000040:00080000:1.0:1651529662.796745:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].193, 224 off44280 00000040:00080000:1.0:1651529662.796750:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].194, 136 off44416 00000040:00080000:1.0:1651529662.796754:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].195, 224 off44640 00000040:00080000:1.0:1651529662.796758:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].196, 224 off44864 00000040:00080000:1.0:1651529662.796762:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].197, 136 off45000 00000040:00080000:1.0:1651529662.796781:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].198, 224 off45224 00000040:00080000:1.0:1651529662.796787:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].199, 224 off45448 00000040:00080000:1.0:1651529662.796791:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].200, 136 off45584 00000040:00080000:1.0:1651529662.796795:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].201, 224 off45808 00000040:00080000:1.0:1651529662.796799:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].202, 224 off46032 00000040:00080000:1.0:1651529662.796803:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].203, 112 off46144 00000100:00100000:1.0:1651529662.796809:0:166096:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e0bff89e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9063caa-b124-4cb6-99ef-d01a735595c3:166096:1731745997083904:10.240.43.61@tcp:502:mount.lustre.0 00000100:00100000:1.0:1651529662.796828:0:166096:0:(client.c:2492:ptlrpc_set_wait()) set 00000000efb6ae52 going to sleep for 6 seconds 00000100:00100000:1.0:1651529662.797074:0:166096:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e0bff89e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9063caa-b124-4cb6-99ef-d01a735595c3:166096:1731745997083904:10.240.43.61@tcp:502:mount.lustre.0 00000040:00080000:1.0:1651529662.797088:0:166096:0:(llog_osd.c:737:llog_osd_write_rec()) added record [0xa:0x1c:0x0].204, 224 off46368 00000040:00080000:1.0:1651529662.797091:0:166096:0:(llog.c:768:llog_process_thread()) stop processing plain 0x3:10:0 index 205 count 201 00000020:01000004:1.0:1651529662.797245:0:166131:0:(obd_mount.c:191:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1651529662.797247:0:166131:0:(obd_config.c:1356:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1651529662.797251:0:166131:0:(genops.c:417:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (00000000657effa6) 00000020:00000080:1.0:1651529662.797281:0:166131:0:(obd_config.c:648:class_attach()) OBD: dev 4 attached type lwp with refcount 1 00000020:00000080:1.0:1651529662.797282:0:166131:0:(obd_config.c:1356:class_process_config()) processing cmd: cf003 00010000:00080000:1.0:1651529662.797349:0:166131:0:(ldlm_lib.c:115:import_set_conn()) imp 0000000070a36139@lustre-MDT0000-lwp-OST0001: add connection 10.240.43.61@tcp at head 00010000:00010000:1.0:1651529662.798581:0:166131:0:(ldlm_pool.c:932:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-1 is initialized 00000020:00000080:1.0:1651529662.798610:0:166131:0:(obd_config.c:752:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1651529662.798618:0:166131:0:(lwp_dev.c:495:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1651529662.798625:0:166131:0:(genops.c:1359:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x3234de053c5438a 00000100:00080000:1.0:1651529662.798629:0:166131:0:(import.c:533:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 10.240.43.61@tcp last attempt 0 00000100:00080000:1.0:1651529662.798630:0:166131:0:(import.c:614:import_select_connection()) lustre-MDT0000-lwp-OST0001: import 0000000070a36139 using connection 10.240.43.61@tcp/10.240.43.61@tcp 00000100:00100000:1.0:1651529662.798639:0:166131:0:(import.c:806:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e0bff89e x1731745997083968/t0(0) o38->lustre-MDT0000-lwp-OST0001@10.240.43.61@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:1.0:1651529662.798652:0:166131:0:(pinger.c:388:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1651529662.798674:0:39098:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e0bff89e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:39098:1731745997083968:10.240.43.61@tcp:38:llog_process_th.0 00010000:00080000:0.0:1651529662.799035:0:39098:0:(ldlm_request.c:1448:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=133199) req@00000000e0bff89e x1731745997083968/t0(0) o38->lustre-MDT0000-lwp-OST0001@10.240.43.61@tcp:12/10 lens 520/416 e 0 to 0 dl 1651529667 ref 1 fl Rpc:RNQU/0/0 rc 0/0 job:'llog_process_th.0' 00000100:00100000:0.0:1651529662.799040:0:39098:0:(client.c:2892:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1651529662.799043:0:39098:0:(import.c:1073:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 8 00000100:00080000:0.0:1651529662.799045:0:39098:0:(import.c:933:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1651529662.799047:0:39098:0:(import.c:1158:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1651529662.799048:0:39098:0:(import.c:85:import_set_state_nolock()) 0000000070a36139 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1651529662.799050:0:39098:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e0bff89e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:39098:1731745997083968:10.240.43.61@tcp:38:llog_process_th.0 00000040:00080000:1.0:1651529662.799407:0:166131:0:(llog.c:768:llog_process_thread()) stop processing plain 0x1c:10:0 index 205 count 201 00000020:01000000:1.0:1651529662.799437:0:166096:0:(obd_config.c:2042:class_config_parse_llog()) Processed log lustre-client gen 1-204 (rc=0) 10000000:01000000:1.0:1651529662.799445:0:166096:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1651529662.799446:0:166096:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000e35b0bde/0x3234de053c5437c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd62bb expref: -99 pid: 166096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529662.799451:0:166096:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 00000000e35b0bde/0x3234de053c5437c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd62bb expref: -99 pid: 166096 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651529662.799459:0:166096:0:(mgc_request.c:1239:mgc_set_info_async()) register_target lustre-OST0001 0x40000002 10000000:01000000:1.0:1651529662.799465:0:166096:0:(mgc_request.c:1175:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1651529662.799469:0:166096:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000eff08db4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9063caa-b124-4cb6-99ef-d01a735595c3:166096:1731745997084032:10.240.43.61@tcp:253:mount.lustre.0 00000100:00100000:1.0:1651529662.799487:0:166096:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f9dd6aa3 going to sleep for 6 seconds 00000100:00100000:0.0:1651529662.800145:0:166132:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000946e402f pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:166132:1731745997084096:10.240.43.61@tcp:901:lwp_notify_lust.0 00000100:00100000:0.0:1651529662.800161:0:166132:0:(client.c:2492:ptlrpc_set_wait()) set 000000000d7d4182 going to sleep for 11 seconds 00010000:00080000:0.0:1651529662.800969:0:166132:0:(ldlm_request.c:1448:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=133199) req@00000000946e402f x1731745997084096/t0(0) o901->lustre-MDT0000-lwp-OST0001@10.240.43.61@tcp:29/10 lens 248/4320 e 0 to 0 dl 1651529674 ref 2 fl Rpc:RQU/0/0 rc 0/0 job:'lwp_notify_lust.0' 00000100:00100000:0.0:1651529662.800975:0:166132:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000946e402f pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:166132:1731745997084096:10.240.43.61@tcp:901:lwp_notify_lust.0 00000100:00100000:1.0:1651529662.855209:0:166096:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000eff08db4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9063caa-b124-4cb6-99ef-d01a735595c3:166096:1731745997084032:10.240.43.61@tcp:253:mount.lustre.0 10000000:01000000:1.0:1651529662.855214:0:166096:0:(mgc_request.c:1195:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:02000000:1.0:1651529662.855219:0:166096:0:(obd_mount_server.c:2104:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 300-900 00000001:00000004:1.0:1651529662.857490:0:166096:0:(tgt_lastrcvd.c:701:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 5, last_transno is 21474836480 00002000:00080000:1.0:1651529662.919830:0:166096:0:(ofd_obd.c:544:ofd_postrecov()) lustre-OST0001: recovery is over 00000020:01000004:1.0:1651529662.919846:0:166096:0:(obd_mount_server.c:312:server_mgc_clear_fs()) Unassign mgc disk 00000020:01000004:1.0:1651529662.919865:0:166096:0:(obd_mount_server.c:1875:server_fill_super_common()) Server sb, dev=51 00000080:00000004:1.0:1651529662.919874:0:166096:0:(super25.c:179:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000400:00000080:1.0:1651529664.017161:0:166478:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651529664.017163:0:166478:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: trevis-87vm4.trevis.whamcloud.com: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 48 00000100:00100000:1.0:1651529666.020581:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529666.020602:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754352182784 00000100:00100000:1.0:1651529666.020616:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 0 00000100:00100000:1.0:1651529666.020618:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eff08db4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:438145:x1731754352182784:12345-10.240.43.64@tcp:8:mount.lustre.0 00010000:00080000:1.0:1651529666.020637:0:166113:0:(ldlm_lib.c:1365:target_handle_connect()) lustre-OST0001: connection from ec96cd77-f6e5-48c2-876b-61a646cc1c34@10.240.43.64@tcp t0 exp 0000000055bfac58 cur 20324 last 0 00000020:00000080:1.0:1651529666.020649:0:166113:0:(genops.c:1359:class_connect()) connect: client ec96cd77-f6e5-48c2-876b-61a646cc1c34, cookie 0x3234de053c54391 00002000:00100000:1.0:1651529666.020654:0:166113:0:(ofd_obd.c:150:ofd_parse_connect_data()) lustre-OST0001: cli ec96cd77-f6e5-48c2-876b-61a646cc1c34/00000000eb536226 ocd_connect_flags: 0xa0465af2e3640078 ocd_version: 20f0000 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1651529666.020662:0:166113:0:(ofd_obd.c:249:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000020:01000000:1.0:1651529666.020697:0:166113:0:(lprocfs_status_server.c:544:lprocfs_exp_setup()) using hash 00000000427049c0 00002000:00080000:1.0:1651529666.020714:0:166113:0:(ofd_obd.c:391:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1651529666.020725:0:166113:0:(import.c:85:import_set_state_nolock()) 00000000b89bf9a4 8r­Òà”ÿÿ: changing import state from RECOVER to FULL 00000100:00100000:1.0:1651529666.020750:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eff08db4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec96cd77-f6e5-48c2-876b-61a646cc1c34+6:438145:x1731754352182784:12345-10.240.43.64@tcp:8:mount.lustre.0 Request processed in 131us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529666.020753:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 0 00000100:00100000:1.0:1651529667.308242:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529667.308256:0:166115:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754352183104 00000100:00100000:1.0:1651529667.308267:0:166115:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 0 00000100:00100000:1.0:1651529667.308269:0:166115:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005529fd8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec96cd77-f6e5-48c2-876b-61a646cc1c34+6:439218:x1731754352183104:12345-10.240.43.64@tcp:13:lfs.0 00002000:00000024:1.0:1651529667.308276:0:166115:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8717760 pending 0 free 81309134848 avail 77138423808 00000100:00100000:1.0:1651529667.308304:0:166115:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005529fd8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec96cd77-f6e5-48c2-876b-61a646cc1c34+6:439218:x1731754352183104:12345-10.240.43.64@tcp:13:lfs.0 Request processed in 34us (63us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529667.308307:0:166115:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 0 00000400:00000080:0.0:1651529667.838939:0:166647:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651529667.838941:0:166647:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=100 00000100:00100000:1.0:1651529668.562464:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529668.562490:0:166101:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946695296 00000100:00100000:1.0:1651529668.562509:0:166101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 0 00000100:00100000:1.0:1651529668.562512:0:166101:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000036d32101 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9063caa-b124-4cb6-99ef-d01a735595c3+3:210728:x1731745946695296:12345-10.240.43.61@tcp:104: 00000100:00100000:1.0:1651529668.562544:0:166101:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000036d32101 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9063caa-b124-4cb6-99ef-d01a735595c3+3:210728:x1731745946695296:12345-10.240.43.61@tcp:104: Request processed in 32us (84us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529668.562548:0:166101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 0 00010000:00010000:1.0:1651529668.562599:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC10.240.43.61@tcp lock: 00000000294488b6/0x3234de053c54375 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e7b158553dd62b4 expref: -99 pid: 166096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529668.562614:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000294488b6 already unused, calling callback (0000000083828851) 10000000:00010000:1.0:1651529668.562616:0:166105:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC10.240.43.61@tcp lock: 00000000294488b6/0x3234de053c54375 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7e7b158553dd62b4 expref: -99 pid: 166096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529668.562620:0:166105:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 00000000294488b6/0x3234de053c54375 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7e7b158553dd62b4 expref: -99 pid: 166096 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1651529668.562623:0:166105:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 00000000294488b6/0x3234de053c54375 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7e7b158553dd62b4 expref: -99 pid: 166096 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651529668.562625:0:166105:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1651529668.562654:0:166105:0:(ldlm_request.c:1300:ldlm_cancel_pack()) ### packing ns: MGC10.240.43.61@tcp lock: 00000000294488b6/0x3234de053c54375 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x7e7b158553dd62b4 expref: -99 pid: 166096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529668.562658:0:166105:0:(ldlm_request.c:1304:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1651529668.562686:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC10.240.43.61@tcp lock: 00000000294488b6/0x3234de053c54375 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x7e7b158553dd62b4 expref: -99 pid: 166096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529668.562692:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 00000000294488b6/0x3234de053c54375 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x7e7b158553dd62b4 expref: -99 pid: 166096 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529668.562715:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000597d93ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997084160:10.240.43.61@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1651529668.563084:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000597d93ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997084160:10.240.43.61@tcp:103:ldlm_bl_01.0 10000000:01000000:1.0:1651529670.077249:0:166108:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:1.0:1651529670.077252:0:166108:0:(mgc_request.c:2064:mgc_process_log()) Process log params-ffff94e0d279b000 from 16 10000000:01000000:1.0:1651529670.077254:0:166108:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1651529670.077268:0:166108:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 00000000294488b6/0x3234de053c54398 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.077273:0:166108:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 00000000294488b6/0x3234de053c54398 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.077278:0:166108:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 00000000294488b6/0x3234de053c54398 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529670.077287:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000597d93ff pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997084224:10.240.43.61@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1651529670.077309:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c29d18ba going to sleep for 6 seconds 00000100:00100000:1.0:1651529670.077619:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000597d93ff pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997084224:10.240.43.61@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1651529670.077626:0:166108:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 00000000294488b6/0x3234de053c54398 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd631d expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.077630:0:166108:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 00000000294488b6/0x3234de053c54398 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553dd631d expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529670.077654:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000597d93ff pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997084288:10.240.43.61@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1651529670.077665:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c29d18ba going to sleep for 6 seconds 00000100:00100000:1.0:1651529670.077880:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000597d93ff pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997084288:10.240.43.61@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1651529670.077890:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000597d93ff pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997084352:10.240.43.61@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1651529670.077905:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c29d18ba going to sleep for 6 seconds 00000100:00100000:1.0:1651529670.078143:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000597d93ff pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997084352:10.240.43.61@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1651529670.078282:0:166705:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000946e402f pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9063caa-b124-4cb6-99ef-d01a735595c3:166705:1731745997084416:10.240.43.61@tcp:502:llog_process_th.0 00000100:00100000:0.0:1651529670.078304:0:166705:0:(client.c:2492:ptlrpc_set_wait()) set 000000009973ad87 going to sleep for 6 seconds 00000100:00100000:0.0:1651529670.078894:0:166705:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000946e402f pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9063caa-b124-4cb6-99ef-d01a735595c3:166705:1731745997084416:10.240.43.61@tcp:502:llog_process_th.0 00000020:01000000:0.0:1651529670.078904:0:166705:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1651529670.078908:0:166705:0:(obd_config.c:1356:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1651529670.078909:0:166705:0:(obd_config.c:1432:class_process_config()) marker 2 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1651529670.078912:0:166705:0:(obd_config.c:1885:class_config_llog_handler()) cmd ce032, instance name: general-ffff94e0d279b000 00000020:00000080:0.0:1651529670.078913:0:166705:0:(obd_config.c:1356:class_process_config()) processing cmd: ce032 00000020:00080000:0.0:1651529670.081153:0:166705:0:(obd_config.c:1330:process_param2_config()) lctl: invoked upcall /usr/sbin/lctl set_param lod.*.mdt_hash=crush, time 2225us 00000100:00100000:0.0:1651529670.081166:0:166705:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000946e402f pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9063caa-b124-4cb6-99ef-d01a735595c3:166705:1731745997084480:10.240.43.61@tcp:502:llog_process_th.0 00000100:00100000:0.0:1651529670.081189:0:166705:0:(client.c:2492:ptlrpc_set_wait()) set 000000009973ad87 going to sleep for 6 seconds 00000100:00100000:0.0:1651529670.081431:0:166705:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000946e402f pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9063caa-b124-4cb6-99ef-d01a735595c3:166705:1731745997084480:10.240.43.61@tcp:502:llog_process_th.0 00000020:01000000:0.0:1651529670.081439:0:166705:0:(obd_config.c:1770:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1651529670.081441:0:166705:0:(obd_config.c:1356:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1651529670.081442:0:166705:0:(obd_config.c:1432:class_process_config()) marker 2 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1651529670.081444:0:166705:0:(llog.c:768:llog_process_thread()) stop processing plain 0x2:10:0 index 19 count 19 00000020:01000000:1.0:1651529670.081468:0:166108:0:(obd_config.c:2042:class_config_parse_llog()) Processed log params gen 16-18 (rc=0) 10000000:01000000:1.0:1651529670.081481:0:166108:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1651529670.081484:0:166108:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000294488b6/0x3234de053c54398 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd631d expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.081488:0:166108:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 00000000294488b6/0x3234de053c54398 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553dd631d expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529670.880156:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529670.880170:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946695936 00000100:00100000:1.0:1651529670.880183:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 1 00000100:00100000:1.0:1651529670.880186:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000597d93ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:39028:x1731745946695936:12345-10.240.43.61@tcp:8:kworker/u4:1.0 00010000:00080000:1.0:1651529670.880196:0:166112:0:(ldlm_lib.c:1365:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@10.240.43.61@tcp t0 exp 0000000055bfac58 cur 20329 last 0 00000020:00000080:1.0:1651529670.880208:0:166112:0:(genops.c:1359:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3234de053c5439f 00002000:00100000:1.0:1651529670.880212:0:166112:0:(ofd_obd.c:150:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/00000000c3f67b84 ocd_connect_flags: 0x2044401443000066 ocd_version: 20f0000 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1651529670.880214:0:166112:0:(ofd_obd.c:168:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1651529670.880215:0:166112:0:(ofd_obd.c:257:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000020:01000000:1.0:1651529670.880262:0:166112:0:(lprocfs_status_server.c:544:lprocfs_exp_setup()) using hash 00000000427049c0 00002000:00080000:1.0:1651529670.880275:0:166112:0:(ofd_obd.c:391:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1651529670.880286:0:166112:0:(import.c:85:import_set_state_nolock()) 00000000e4bcd31c ãFÖà”ÿÿ: changing import state from RECOVER to FULL 00000100:00100000:1.0:1651529670.880306:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000597d93ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39028:x1731745946695936:12345-10.240.43.61@tcp:8:kworker/u4:1.0 Request processed in 119us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529670.880310:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 1 00000100:00100000:1.0:1651529670.880640:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529670.880653:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529670.880662:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946696064 00000100:00100000:1.0:1651529670.880670:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 1 00000100:00100000:1.0:1651529670.880672:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003132c0c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946696064:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651529670.880682:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8717760 pending 0 free 81309134848 avail 77138423808 00000100:00100000:1.0:1651529670.880693:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003132c0c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946696064:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 20us (40us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529670.880696:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 1 00000100:00100000:1.0:1651529670.880703:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946696128 00000100:00100000:1.0:1651529670.880715:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 2 00000100:00100000:1.0:1651529670.880717:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df603127 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:209978:x1731745946696128:12345-10.240.43.61@tcp:5:osp-pre-1-0.0 00002000:00080000:1.0:1651529670.881166:0:166112:0:(ofd_fs.c:445:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1651529670.881169:0:166112:0:(ofd_dev.c:1586:ofd_create_hdl()) ofd_last_id() = 179553 -> diff = -128 00002000:02000040:1.0:1651529670.881171:0:166112:0:(ofd_dev.c:1442:ofd_orphans_destroy()) lustre-OST0001: deleting orphan objects from 0x0:179426 to 0x0:179553 00002000:00010000:1.0:1651529670.883127:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd61:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529670.883131:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c543a6 lrc: 3/0,1 mode: --/PW res: [0x2bd61:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.883141:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.883142:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.883148:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c543a6 lrc: 3/0,1 mode: PW/PW res: [0x2bd61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.883155:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c543a6 lrc: 3/0,1 mode: PW/PW res: [0x2bd61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.883159:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c543a6 lrc: 3/0,1 mode: PW/PW res: [0x2bd61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.883162:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c543a6 lrc: 2/0,0 mode: PW/PW res: [0x2bd61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.883270:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c543a6 lrc: 2/0,0 mode: PW/PW res: [0x2bd61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.883277:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000075f9ff9d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529670.883278:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c543a6 lrc: 2/0,0 mode: PW/PW res: [0x2bd61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.883283:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c543a6 lrc: 3/0,0 mode: PW/PW res: [0x2bd61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.883295:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c543a6 lrc: 1/0,0 mode: --/PW res: [0x2bd61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.883298:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c543a6 lrc: 0/0,0 mode: --/PW res: [0x2bd61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529670.883439:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd60:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529670.883441:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c543ad lrc: 3/0,1 mode: --/PW res: [0x2bd60:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.883445:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.883446:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.883447:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c543ad lrc: 3/0,1 mode: PW/PW res: [0x2bd60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.883451:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c543ad lrc: 3/0,1 mode: PW/PW res: [0x2bd60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.883454:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c543ad lrc: 3/0,1 mode: PW/PW res: [0x2bd60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.883457:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c543ad lrc: 2/0,0 mode: PW/PW res: [0x2bd60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.883482:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c543ad lrc: 2/0,0 mode: PW/PW res: [0x2bd60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.883487:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f616ea25 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529670.883488:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c543ad lrc: 2/0,0 mode: PW/PW res: [0x2bd60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.883491:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c543ad lrc: 3/0,0 mode: PW/PW res: [0x2bd60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.883497:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c543ad lrc: 1/0,0 mode: --/PW res: [0x2bd60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.883500:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c543ad lrc: 0/0,0 mode: --/PW res: [0x2bd60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529670.883691:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd5f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529670.883694:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c543b4 lrc: 3/0,1 mode: --/PW res: [0x2bd5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.883700:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.883701:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.883702:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c543b4 lrc: 3/0,1 mode: PW/PW res: [0x2bd5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.883706:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c543b4 lrc: 3/0,1 mode: PW/PW res: [0x2bd5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.883709:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c543b4 lrc: 3/0,1 mode: PW/PW res: [0x2bd5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.883712:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c543b4 lrc: 2/0,0 mode: PW/PW res: [0x2bd5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.883733:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c543b4 lrc: 2/0,0 mode: PW/PW res: [0x2bd5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.883737:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d52cc749 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529670.883739:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c543b4 lrc: 2/0,0 mode: PW/PW res: [0x2bd5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.883742:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c543b4 lrc: 3/0,0 mode: PW/PW res: [0x2bd5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.883746:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c543b4 lrc: 1/0,0 mode: --/PW res: [0x2bd5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.883749:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c543b4 lrc: 0/0,0 mode: --/PW res: [0x2bd5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529670.883954:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd5e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529670.883956:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c543bb lrc: 3/0,1 mode: --/PW res: [0x2bd5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.883960:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.883961:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.883962:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c543bb lrc: 3/0,1 mode: PW/PW res: [0x2bd5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.883966:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c543bb lrc: 3/0,1 mode: PW/PW res: [0x2bd5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.883969:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c543bb lrc: 3/0,1 mode: PW/PW res: [0x2bd5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.883974:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c543bb lrc: 2/0,0 mode: PW/PW res: [0x2bd5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.883994:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c543bb lrc: 2/0,0 mode: PW/PW res: [0x2bd5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.883998:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d2b9655c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529670.883999:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c543bb lrc: 2/0,0 mode: PW/PW res: [0x2bd5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.884001:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c543bb lrc: 3/0,0 mode: PW/PW res: [0x2bd5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.884005:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c543bb lrc: 1/0,0 mode: --/PW res: [0x2bd5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.884008:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c543bb lrc: 0/0,0 mode: --/PW res: [0x2bd5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529670.884203:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd5d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529670.884205:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c543c2 lrc: 3/0,1 mode: --/PW res: [0x2bd5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.884209:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.884210:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.884210:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c543c2 lrc: 3/0,1 mode: PW/PW res: [0x2bd5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.884214:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c543c2 lrc: 3/0,1 mode: PW/PW res: [0x2bd5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.884217:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c543c2 lrc: 3/0,1 mode: PW/PW res: [0x2bd5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.884220:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c543c2 lrc: 2/0,0 mode: PW/PW res: [0x2bd5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.884243:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c543c2 lrc: 2/0,0 mode: PW/PW res: [0x2bd5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.884247:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001b109cb1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529670.884248:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c543c2 lrc: 2/0,0 mode: PW/PW res: [0x2bd5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.884251:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c543c2 lrc: 3/0,0 mode: PW/PW res: [0x2bd5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.884255:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c543c2 lrc: 1/0,0 mode: --/PW res: [0x2bd5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.884258:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c543c2 lrc: 0/0,0 mode: --/PW res: [0x2bd5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529670.884477:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd5c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529670.884479:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c543c9 lrc: 3/0,1 mode: --/PW res: [0x2bd5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.884483:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.884484:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.884485:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c543c9 lrc: 3/0,1 mode: PW/PW res: [0x2bd5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.884489:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c543c9 lrc: 3/0,1 mode: PW/PW res: [0x2bd5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.884492:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c543c9 lrc: 3/0,1 mode: PW/PW res: [0x2bd5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.884495:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c543c9 lrc: 2/0,0 mode: PW/PW res: [0x2bd5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.884513:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c543c9 lrc: 2/0,0 mode: PW/PW res: [0x2bd5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.884517:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000093b5c984 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529670.884518:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c543c9 lrc: 2/0,0 mode: PW/PW res: [0x2bd5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.884521:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c543c9 lrc: 3/0,0 mode: PW/PW res: [0x2bd5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.884525:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c543c9 lrc: 1/0,0 mode: --/PW res: [0x2bd5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.884527:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c543c9 lrc: 0/0,0 mode: --/PW res: [0x2bd5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529670.884726:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd5b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529670.884728:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c543d0 lrc: 3/0,1 mode: --/PW res: [0x2bd5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.884731:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.884732:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.884733:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c543d0 lrc: 3/0,1 mode: PW/PW res: [0x2bd5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.884737:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c543d0 lrc: 3/0,1 mode: PW/PW res: [0x2bd5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.884740:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c543d0 lrc: 3/0,1 mode: PW/PW res: [0x2bd5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.884743:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c543d0 lrc: 2/0,0 mode: PW/PW res: [0x2bd5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.884763:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c543d0 lrc: 2/0,0 mode: PW/PW res: [0x2bd5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.884767:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002e24dea3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529670.884768:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c543d0 lrc: 2/0,0 mode: PW/PW res: [0x2bd5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.884771:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c543d0 lrc: 3/0,0 mode: PW/PW res: [0x2bd5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.884775:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c543d0 lrc: 1/0,0 mode: --/PW res: [0x2bd5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.884777:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c543d0 lrc: 0/0,0 mode: --/PW res: [0x2bd5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529670.884992:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd5a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529670.884994:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c543d7 lrc: 3/0,1 mode: --/PW res: [0x2bd5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.884998:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.884999:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.884999:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c543d7 lrc: 3/0,1 mode: PW/PW res: [0x2bd5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.885003:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c543d7 lrc: 3/0,1 mode: PW/PW res: [0x2bd5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.885006:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c543d7 lrc: 3/0,1 mode: PW/PW res: [0x2bd5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.885009:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c543d7 lrc: 2/0,0 mode: PW/PW res: [0x2bd5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.885027:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c543d7 lrc: 2/0,0 mode: PW/PW res: [0x2bd5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.885030:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000041a7efd7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529670.885031:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c543d7 lrc: 2/0,0 mode: PW/PW res: [0x2bd5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.885034:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c543d7 lrc: 3/0,0 mode: PW/PW res: [0x2bd5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.885038:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c543d7 lrc: 1/0,0 mode: --/PW res: [0x2bd5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.885041:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c543d7 lrc: 0/0,0 mode: --/PW res: [0x2bd5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529670.885266:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd59:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529670.885268:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c543de lrc: 3/0,1 mode: --/PW res: [0x2bd59:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.885272:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.885272:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.885273:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c543de lrc: 3/0,1 mode: PW/PW res: [0x2bd59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.885277:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c543de lrc: 3/0,1 mode: PW/PW res: [0x2bd59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.885280:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c543de lrc: 3/0,1 mode: PW/PW res: [0x2bd59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.885283:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c543de lrc: 2/0,0 mode: PW/PW res: [0x2bd59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.885301:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c543de lrc: 2/0,0 mode: PW/PW res: [0x2bd59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.885304:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002731c8d2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529670.885305:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c543de lrc: 2/0,0 mode: PW/PW res: [0x2bd59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.885308:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c543de lrc: 3/0,0 mode: PW/PW res: [0x2bd59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.885312:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c543de lrc: 1/0,0 mode: --/PW res: [0x2bd59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.885315:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c543de lrc: 0/0,0 mode: --/PW res: [0x2bd59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529670.885517:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd58:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529670.885519:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c543e5 lrc: 3/0,1 mode: --/PW res: [0x2bd58:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.885522:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.885523:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.885524:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c543e5 lrc: 3/0,1 mode: PW/PW res: [0x2bd58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.885527:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c543e5 lrc: 3/0,1 mode: PW/PW res: [0x2bd58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.885530:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c543e5 lrc: 3/0,1 mode: PW/PW res: [0x2bd58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.885533:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c543e5 lrc: 2/0,0 mode: PW/PW res: [0x2bd58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.885550:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c543e5 lrc: 2/0,0 mode: PW/PW res: [0x2bd58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.885554:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000314b5fa1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529670.885555:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c543e5 lrc: 2/0,0 mode: PW/PW res: [0x2bd58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.885560:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c543e5 lrc: 3/0,0 mode: PW/PW res: [0x2bd58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.885564:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c543e5 lrc: 1/0,0 mode: --/PW res: [0x2bd58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.885567:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000314b5fa1/0x3234de053c543e5 lrc: 0/0,0 mode: --/PW res: [0x2bd58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529670.885767:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd57:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529670.885770:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c543ec lrc: 3/0,1 mode: --/PW res: [0x2bd57:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.885776:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.885777:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.885778:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c543ec lrc: 3/0,1 mode: PW/PW res: [0x2bd57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.885781:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c543ec lrc: 3/0,1 mode: PW/PW res: [0x2bd57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.885784:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c543ec lrc: 3/0,1 mode: PW/PW res: [0x2bd57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.885787:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c543ec lrc: 2/0,0 mode: PW/PW res: [0x2bd57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.885805:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c543ec lrc: 2/0,0 mode: PW/PW res: [0x2bd57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.885808:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cd5f3a7c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529670.885809:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c543ec lrc: 2/0,0 mode: PW/PW res: [0x2bd57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.885812:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c543ec lrc: 3/0,0 mode: PW/PW res: [0x2bd57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.885816:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c543ec lrc: 1/0,0 mode: --/PW res: [0x2bd57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.885818:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd5f3a7c/0x3234de053c543ec lrc: 0/0,0 mode: --/PW res: [0x2bd57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529670.886018:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd56:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529670.886020:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c543f3 lrc: 3/0,1 mode: --/PW res: [0x2bd56:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.886023:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.886024:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.886025:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c543f3 lrc: 3/0,1 mode: PW/PW res: [0x2bd56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.886029:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c543f3 lrc: 3/0,1 mode: PW/PW res: [0x2bd56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.886032:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c543f3 lrc: 3/0,1 mode: PW/PW res: [0x2bd56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.886037:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c543f3 lrc: 2/0,0 mode: PW/PW res: [0x2bd56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.886056:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c543f3 lrc: 2/0,0 mode: PW/PW res: [0x2bd56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.886060:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006cbd0d09 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529670.886061:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c543f3 lrc: 2/0,0 mode: PW/PW res: [0x2bd56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.886063:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c543f3 lrc: 3/0,0 mode: PW/PW res: [0x2bd56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.886067:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c543f3 lrc: 1/0,0 mode: --/PW res: [0x2bd56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.886070:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cbd0d09/0x3234de053c543f3 lrc: 0/0,0 mode: --/PW res: [0x2bd56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529670.886306:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd55:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529670.886308:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c543fa lrc: 3/0,1 mode: --/PW res: [0x2bd55:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.886312:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.886312:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.886313:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c543fa lrc: 3/0,1 mode: PW/PW res: [0x2bd55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.886317:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c543fa lrc: 3/0,1 mode: PW/PW res: [0x2bd55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.886320:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c543fa lrc: 3/0,1 mode: PW/PW res: [0x2bd55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.886322:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c543fa lrc: 2/0,0 mode: PW/PW res: [0x2bd55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.886339:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c543fa lrc: 2/0,0 mode: PW/PW res: [0x2bd55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.886343:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ebdbebae already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529670.886344:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c543fa lrc: 2/0,0 mode: PW/PW res: [0x2bd55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.886347:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c543fa lrc: 3/0,0 mode: PW/PW res: [0x2bd55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.886351:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c543fa lrc: 1/0,0 mode: --/PW res: [0x2bd55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.886353:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ebdbebae/0x3234de053c543fa lrc: 0/0,0 mode: --/PW res: [0x2bd55:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529670.886556:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd54:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529670.886558:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c54401 lrc: 3/0,1 mode: --/PW res: [0x2bd54:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.886562:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.886562:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.886563:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c54401 lrc: 3/0,1 mode: PW/PW res: [0x2bd54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.886567:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c54401 lrc: 3/0,1 mode: PW/PW res: [0x2bd54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.886570:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c54401 lrc: 3/0,1 mode: PW/PW res: [0x2bd54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.886573:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c54401 lrc: 2/0,0 mode: PW/PW res: [0x2bd54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.886591:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c54401 lrc: 2/0,0 mode: PW/PW res: [0x2bd54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.886595:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba437fe0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529670.886595:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c54401 lrc: 2/0,0 mode: PW/PW res: [0x2bd54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.886598:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c54401 lrc: 3/0,0 mode: PW/PW res: [0x2bd54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.886602:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c54401 lrc: 1/0,0 mode: --/PW res: [0x2bd54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.886605:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba437fe0/0x3234de053c54401 lrc: 0/0,0 mode: --/PW res: [0x2bd54:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529670.886797:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd53:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529670.886799:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c54408 lrc: 3/0,1 mode: --/PW res: [0x2bd53:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.886803:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.886804:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.886804:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c54408 lrc: 3/0,1 mode: PW/PW res: [0x2bd53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.886808:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c54408 lrc: 3/0,1 mode: PW/PW res: [0x2bd53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.886811:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c54408 lrc: 3/0,1 mode: PW/PW res: [0x2bd53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.886814:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c54408 lrc: 2/0,0 mode: PW/PW res: [0x2bd53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.886834:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c54408 lrc: 2/0,0 mode: PW/PW res: [0x2bd53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.886838:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000014fe598c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529670.886838:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c54408 lrc: 2/0,0 mode: PW/PW res: [0x2bd53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.886841:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c54408 lrc: 3/0,0 mode: PW/PW res: [0x2bd53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.886845:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c54408 lrc: 1/0,0 mode: --/PW res: [0x2bd53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.886848:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014fe598c/0x3234de053c54408 lrc: 0/0,0 mode: --/PW res: [0x2bd53:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529670.887063:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd52:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529670.887065:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c5440f lrc: 3/0,1 mode: --/PW res: [0x2bd52:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.887069:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.887070:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.887071:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c5440f lrc: 3/0,1 mode: PW/PW res: [0x2bd52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.887074:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c5440f lrc: 3/0,1 mode: PW/PW res: [0x2bd52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.887078:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c5440f lrc: 3/0,1 mode: PW/PW res: [0x2bd52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.887080:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c5440f lrc: 2/0,0 mode: PW/PW res: [0x2bd52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.887098:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c5440f lrc: 2/0,0 mode: PW/PW res: [0x2bd52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.887101:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000090e99444 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529670.887102:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c5440f lrc: 2/0,0 mode: PW/PW res: [0x2bd52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.887105:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c5440f lrc: 3/0,0 mode: PW/PW res: [0x2bd52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.887109:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c5440f lrc: 1/0,0 mode: --/PW res: [0x2bd52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.887111:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090e99444/0x3234de053c5440f lrc: 0/0,0 mode: --/PW res: [0x2bd52:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529670.887328:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd51:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529670.887330:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c54416 lrc: 3/0,1 mode: --/PW res: [0x2bd51:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.887334:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.887334:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.887335:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c54416 lrc: 3/0,1 mode: PW/PW res: [0x2bd51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.887339:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c54416 lrc: 3/0,1 mode: PW/PW res: [0x2bd51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.887342:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c54416 lrc: 3/0,1 mode: PW/PW res: [0x2bd51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.887345:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c54416 lrc: 2/0,0 mode: PW/PW res: [0x2bd51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.887362:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c54416 lrc: 2/0,0 mode: PW/PW res: [0x2bd51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.887365:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004b2a6b06 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529670.887366:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c54416 lrc: 2/0,0 mode: PW/PW res: [0x2bd51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.887372:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c54416 lrc: 3/0,0 mode: PW/PW res: [0x2bd51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.887376:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c54416 lrc: 1/0,0 mode: --/PW res: [0x2bd51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.887379:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b2a6b06/0x3234de053c54416 lrc: 0/0,0 mode: --/PW res: [0x2bd51:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529670.887578:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd50:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529670.887581:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c5441d lrc: 3/0,1 mode: --/PW res: [0x2bd50:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.887584:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.887585:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.887586:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c5441d lrc: 3/0,1 mode: PW/PW res: [0x2bd50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.887589:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c5441d lrc: 3/0,1 mode: PW/PW res: [0x2bd50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.887592:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c5441d lrc: 3/0,1 mode: PW/PW res: [0x2bd50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.887595:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c5441d lrc: 2/0,0 mode: PW/PW res: [0x2bd50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.887613:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c5441d lrc: 2/0,0 mode: PW/PW res: [0x2bd50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.887616:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dd6b1be4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529670.887617:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c5441d lrc: 2/0,0 mode: PW/PW res: [0x2bd50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.887620:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c5441d lrc: 3/0,0 mode: PW/PW res: [0x2bd50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.887624:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c5441d lrc: 1/0,0 mode: --/PW res: [0x2bd50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.887627:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd6b1be4/0x3234de053c5441d lrc: 0/0,0 mode: --/PW res: [0x2bd50:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529670.887825:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd4f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529670.887827:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c54424 lrc: 3/0,1 mode: --/PW res: [0x2bd4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.887833:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.887834:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.887835:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c54424 lrc: 3/0,1 mode: PW/PW res: [0x2bd4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.887838:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c54424 lrc: 3/0,1 mode: PW/PW res: [0x2bd4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.887841:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c54424 lrc: 3/0,1 mode: PW/PW res: [0x2bd4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.887844:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c54424 lrc: 2/0,0 mode: PW/PW res: [0x2bd4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.887862:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c54424 lrc: 2/0,0 mode: PW/PW res: [0x2bd4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.887866:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000066921086 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529670.887867:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c54424 lrc: 2/0,0 mode: PW/PW res: [0x2bd4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.887869:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c54424 lrc: 3/0,0 mode: PW/PW res: [0x2bd4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.887873:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c54424 lrc: 1/0,0 mode: --/PW res: [0x2bd4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.887876:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066921086/0x3234de053c54424 lrc: 0/0,0 mode: --/PW res: [0x2bd4f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529670.888090:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd4e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529670.888093:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c5442b lrc: 3/0,1 mode: --/PW res: [0x2bd4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.888096:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.888097:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.888098:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c5442b lrc: 3/0,1 mode: PW/PW res: [0x2bd4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.888102:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c5442b lrc: 3/0,1 mode: PW/PW res: [0x2bd4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.888105:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c5442b lrc: 3/0,1 mode: PW/PW res: [0x2bd4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.888110:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c5442b lrc: 2/0,0 mode: PW/PW res: [0x2bd4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.888128:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c5442b lrc: 2/0,0 mode: PW/PW res: [0x2bd4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.888131:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e48e0bfd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529670.888132:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c5442b lrc: 2/0,0 mode: PW/PW res: [0x2bd4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.888135:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c5442b lrc: 3/0,0 mode: PW/PW res: [0x2bd4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.888139:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c5442b lrc: 1/0,0 mode: --/PW res: [0x2bd4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.888141:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e48e0bfd/0x3234de053c5442b lrc: 0/0,0 mode: --/PW res: [0x2bd4e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529670.888355:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd4d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529670.888357:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c54432 lrc: 3/0,1 mode: --/PW res: [0x2bd4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.888361:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.888362:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.888363:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c54432 lrc: 3/0,1 mode: PW/PW res: [0x2bd4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.888366:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c54432 lrc: 3/0,1 mode: PW/PW res: [0x2bd4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.888369:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c54432 lrc: 3/0,1 mode: PW/PW res: [0x2bd4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.888372:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c54432 lrc: 2/0,0 mode: PW/PW res: [0x2bd4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.888390:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c54432 lrc: 2/0,0 mode: PW/PW res: [0x2bd4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.888394:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000feb9d3da already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529670.888394:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c54432 lrc: 2/0,0 mode: PW/PW res: [0x2bd4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.888397:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c54432 lrc: 3/0,0 mode: PW/PW res: [0x2bd4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.888402:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c54432 lrc: 1/0,0 mode: --/PW res: [0x2bd4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.888404:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000feb9d3da/0x3234de053c54432 lrc: 0/0,0 mode: --/PW res: [0x2bd4d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529670.888599:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd4c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529670.888601:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c54439 lrc: 3/0,1 mode: --/PW res: [0x2bd4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.888605:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.888605:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.888606:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c54439 lrc: 3/0,1 mode: PW/PW res: [0x2bd4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.888610:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c54439 lrc: 3/0,1 mode: PW/PW res: [0x2bd4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.888613:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c54439 lrc: 3/0,1 mode: PW/PW res: [0x2bd4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.888616:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c54439 lrc: 2/0,0 mode: PW/PW res: [0x2bd4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.888633:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c54439 lrc: 2/0,0 mode: PW/PW res: [0x2bd4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.888637:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bdf2b6c4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529670.888638:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c54439 lrc: 2/0,0 mode: PW/PW res: [0x2bd4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.888641:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c54439 lrc: 3/0,0 mode: PW/PW res: [0x2bd4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.888645:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c54439 lrc: 1/0,0 mode: --/PW res: [0x2bd4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.888648:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bdf2b6c4/0x3234de053c54439 lrc: 0/0,0 mode: --/PW res: [0x2bd4c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529670.888854:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd4b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529670.888857:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c54440 lrc: 3/0,1 mode: --/PW res: [0x2bd4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.888860:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.888861:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.888862:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c54440 lrc: 3/0,1 mode: PW/PW res: [0x2bd4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.888866:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c54440 lrc: 3/0,1 mode: PW/PW res: [0x2bd4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.888869:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c54440 lrc: 3/0,1 mode: PW/PW res: [0x2bd4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.888872:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c54440 lrc: 2/0,0 mode: PW/PW res: [0x2bd4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.888891:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c54440 lrc: 2/0,0 mode: PW/PW res: [0x2bd4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.888895:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000029958df2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529670.888895:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c54440 lrc: 2/0,0 mode: PW/PW res: [0x2bd4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.888898:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c54440 lrc: 3/0,0 mode: PW/PW res: [0x2bd4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.888902:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c54440 lrc: 1/0,0 mode: --/PW res: [0x2bd4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.888905:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029958df2/0x3234de053c54440 lrc: 0/0,0 mode: --/PW res: [0x2bd4b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529670.889116:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd4a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529670.889118:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c54447 lrc: 3/0,1 mode: --/PW res: [0x2bd4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.889122:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.889123:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.889123:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c54447 lrc: 3/0,1 mode: PW/PW res: [0x2bd4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.889127:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c54447 lrc: 3/0,1 mode: PW/PW res: [0x2bd4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.889130:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c54447 lrc: 3/0,1 mode: PW/PW res: [0x2bd4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.889133:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c54447 lrc: 2/0,0 mode: PW/PW res: [0x2bd4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.889151:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c54447 lrc: 2/0,0 mode: PW/PW res: [0x2bd4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.889154:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c0de17df already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529670.889155:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c54447 lrc: 2/0,0 mode: PW/PW res: [0x2bd4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.889160:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c54447 lrc: 3/0,0 mode: PW/PW res: [0x2bd4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.889164:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c54447 lrc: 1/0,0 mode: --/PW res: [0x2bd4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.889167:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c54447 lrc: 0/0,0 mode: --/PW res: [0x2bd4a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529670.889397:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd49:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529670.889399:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c5444e lrc: 3/0,1 mode: --/PW res: [0x2bd49:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.889402:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.889403:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.889404:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c5444e lrc: 3/0,1 mode: PW/PW res: [0x2bd49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.889407:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c5444e lrc: 3/0,1 mode: PW/PW res: [0x2bd49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.889411:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c5444e lrc: 3/0,1 mode: PW/PW res: [0x2bd49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.889414:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c5444e lrc: 2/0,0 mode: PW/PW res: [0x2bd49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.889431:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c5444e lrc: 2/0,0 mode: PW/PW res: [0x2bd49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.889434:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004678bff1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529670.889435:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c5444e lrc: 2/0,0 mode: PW/PW res: [0x2bd49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.889438:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c5444e lrc: 3/0,0 mode: PW/PW res: [0x2bd49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.889442:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c5444e lrc: 1/0,0 mode: --/PW res: [0x2bd49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.889445:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c5444e lrc: 0/0,0 mode: --/PW res: [0x2bd49:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529670.889646:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd48:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529670.889648:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c54455 lrc: 3/0,1 mode: --/PW res: [0x2bd48:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.889652:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.889652:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.889653:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c54455 lrc: 3/0,1 mode: PW/PW res: [0x2bd48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.889657:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c54455 lrc: 3/0,1 mode: PW/PW res: [0x2bd48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.889660:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c54455 lrc: 3/0,1 mode: PW/PW res: [0x2bd48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.889663:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c54455 lrc: 2/0,0 mode: PW/PW res: [0x2bd48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.889680:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c54455 lrc: 2/0,0 mode: PW/PW res: [0x2bd48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.889684:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba070658 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529670.889685:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c54455 lrc: 2/0,0 mode: PW/PW res: [0x2bd48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.889687:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c54455 lrc: 3/0,0 mode: PW/PW res: [0x2bd48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.889691:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c54455 lrc: 1/0,0 mode: --/PW res: [0x2bd48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.889694:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c54455 lrc: 0/0,0 mode: --/PW res: [0x2bd48:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529670.889879:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd47:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529670.889881:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae57075e/0x3234de053c5445c lrc: 3/0,1 mode: --/PW res: [0x2bd47:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.889888:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.889888:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.889889:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae57075e/0x3234de053c5445c lrc: 3/0,1 mode: PW/PW res: [0x2bd47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.889893:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae57075e/0x3234de053c5445c lrc: 3/0,1 mode: PW/PW res: [0x2bd47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.889895:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae57075e/0x3234de053c5445c lrc: 3/0,1 mode: PW/PW res: [0x2bd47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.889898:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae57075e/0x3234de053c5445c lrc: 2/0,0 mode: PW/PW res: [0x2bd47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.889916:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae57075e/0x3234de053c5445c lrc: 2/0,0 mode: PW/PW res: [0x2bd47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.889931:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ae57075e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529670.889932:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae57075e/0x3234de053c5445c lrc: 2/0,0 mode: PW/PW res: [0x2bd47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.889935:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae57075e/0x3234de053c5445c lrc: 3/0,0 mode: PW/PW res: [0x2bd47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.889939:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae57075e/0x3234de053c5445c lrc: 1/0,0 mode: --/PW res: [0x2bd47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.889942:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae57075e/0x3234de053c5445c lrc: 0/0,0 mode: --/PW res: [0x2bd47:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529670.890142:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd46:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529670.890144:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c54463 lrc: 3/0,1 mode: --/PW res: [0x2bd46:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.890148:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.890149:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.890150:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c54463 lrc: 3/0,1 mode: PW/PW res: [0x2bd46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.890153:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c54463 lrc: 3/0,1 mode: PW/PW res: [0x2bd46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.890156:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c54463 lrc: 3/0,1 mode: PW/PW res: [0x2bd46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.890162:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c54463 lrc: 2/0,0 mode: PW/PW res: [0x2bd46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.890180:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c54463 lrc: 2/0,0 mode: PW/PW res: [0x2bd46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.890183:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2a86deb already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529670.890184:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c54463 lrc: 2/0,0 mode: PW/PW res: [0x2bd46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.890187:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c54463 lrc: 3/0,0 mode: PW/PW res: [0x2bd46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.890191:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c54463 lrc: 1/0,0 mode: --/PW res: [0x2bd46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.890194:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c54463 lrc: 0/0,0 mode: --/PW res: [0x2bd46:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529670.890396:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd45:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529670.890398:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c5446a lrc: 3/0,1 mode: --/PW res: [0x2bd45:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.890402:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.890403:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.890403:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c5446a lrc: 3/0,1 mode: PW/PW res: [0x2bd45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.890407:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c5446a lrc: 3/0,1 mode: PW/PW res: [0x2bd45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.890410:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c5446a lrc: 3/0,1 mode: PW/PW res: [0x2bd45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.890413:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c5446a lrc: 2/0,0 mode: PW/PW res: [0x2bd45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.890431:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c5446a lrc: 2/0,0 mode: PW/PW res: [0x2bd45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.890435:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001ea46bb1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529670.890436:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c5446a lrc: 2/0,0 mode: PW/PW res: [0x2bd45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.890439:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c5446a lrc: 3/0,0 mode: PW/PW res: [0x2bd45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.890443:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c5446a lrc: 1/0,0 mode: --/PW res: [0x2bd45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.890446:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c5446a lrc: 0/0,0 mode: --/PW res: [0x2bd45:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529670.890635:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd44:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529670.890638:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c54471 lrc: 3/0,1 mode: --/PW res: [0x2bd44:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.890641:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.890642:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.890643:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c54471 lrc: 3/0,1 mode: PW/PW res: [0x2bd44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.890647:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c54471 lrc: 3/0,1 mode: PW/PW res: [0x2bd44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.890650:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c54471 lrc: 3/0,1 mode: PW/PW res: [0x2bd44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.890652:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c54471 lrc: 2/0,0 mode: PW/PW res: [0x2bd44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.890670:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c54471 lrc: 2/0,0 mode: PW/PW res: [0x2bd44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.890673:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000029b2a516 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529670.890674:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c54471 lrc: 2/0,0 mode: PW/PW res: [0x2bd44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.890677:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c54471 lrc: 3/0,0 mode: PW/PW res: [0x2bd44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.890681:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c54471 lrc: 1/0,0 mode: --/PW res: [0x2bd44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.890683:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c54471 lrc: 0/0,0 mode: --/PW res: [0x2bd44:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529670.890885:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd43:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529670.890887:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c54478 lrc: 3/0,1 mode: --/PW res: [0x2bd43:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.890891:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.890891:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.890892:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c54478 lrc: 3/0,1 mode: PW/PW res: [0x2bd43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.890896:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c54478 lrc: 3/0,1 mode: PW/PW res: [0x2bd43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.890899:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c54478 lrc: 3/0,1 mode: PW/PW res: [0x2bd43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.890902:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c54478 lrc: 2/0,0 mode: PW/PW res: [0x2bd43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.890930:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c54478 lrc: 2/0,0 mode: PW/PW res: [0x2bd43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.890934:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d84ad17b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529670.890935:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c54478 lrc: 2/0,0 mode: PW/PW res: [0x2bd43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.890940:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c54478 lrc: 3/0,0 mode: PW/PW res: [0x2bd43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.890944:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c54478 lrc: 1/0,0 mode: --/PW res: [0x2bd43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.890947:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c54478 lrc: 0/0,0 mode: --/PW res: [0x2bd43:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529670.891133:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bd42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529670.891135:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c5447f lrc: 3/0,1 mode: --/PW res: [0x2bd42:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.891139:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.891140:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529670.891141:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c5447f lrc: 3/0,1 mode: PW/PW res: [0x2bd42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.891144:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c5447f lrc: 3/0,1 mode: PW/PW res: [0x2bd42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.891147:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c5447f lrc: 3/0,1 mode: PW/PW res: [0x2bd42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529670.891150:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c5447f lrc: 2/0,0 mode: PW/PW res: [0x2bd42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.891168:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c5447f lrc: 2/0,0 mode: PW/PW res: [0x2bd42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.891171:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004f367ded already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529670.891172:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c5447f lrc: 2/0,0 mode: PW/PW res: [0x2bd42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.891175:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c5447f lrc: 3/0,0 mode: PW/PW res: [0x2bd42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.891179:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c5447f lrc: 1/0,0 mode: --/PW res: [0x2bd42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529670.891182:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c5447f lrc: 0/0,0 mode: --/PW res: [0x2bd42:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529670.896459:0:166112:0:(ofd_dev.c:1469:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x0:179425 00000100:00100000:1.0:1651529670.896475:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df603127 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:209978:x1731745946696128:12345-10.240.43.61@tcp:5:osp-pre-1-0.0 Request processed in 15756us (15841us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529670.896479:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 2 00000100:00100000:1.0:1651529670.896742:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529670.896749:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946696192 00000100:00100000:1.0:1651529670.896764:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 3 00000100:00100000:1.0:1651529670.896765:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000056e45ef2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:209978:x1731745946696192:12345-10.240.43.61@tcp:5:osp-pre-1-0.0 00002000:00080000:1.0:1651529670.896777:0:166112:0:(ofd_dev.c:1706:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x0 at 179554 00000100:00100000:1.0:1651529670.898355:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000056e45ef2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:209978:x1731745946696192:12345-10.240.43.61@tcp:5:osp-pre-1-0.0 Request processed in 1588us (1613us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529670.898359:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 3 00000001:00100000:1.0:1651529671.350270:0:166098:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1651529671.350272:0:166098:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ec96cd77-f6e5-48c2-876b-61a646cc1c34 00000100:00100000:0.0:1651529676.000309:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529676.000338:0:166115:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946696320 00000100:00100000:0.0:1651529676.000360:0:166115:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 2 00000100:00100000:0.0:1651529676.000363:0:166115:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000946e402f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946696320:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651529676.000380:0:166115:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 81309134848 avail 77138423808 00000100:00100000:0.0:1651529676.000407:0:166115:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000946e402f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946696320:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 44us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529676.000410:0:166115:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 2 00000400:00000080:1.0:1651529676.048998:0:166921:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651529676.049001:0:166921:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 133h: Proc files should end with newlines ========================================================== 22:14:35 (1651529675) 00000100:00100000:0.0:1651529677.996007:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529677.996038:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754352183680 00000100:00100000:1.0:1651529677.996063:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 0 00000100:00100000:1.0:1651529677.996066:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000020f0e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec96cd77-f6e5-48c2-876b-61a646cc1c34+5:441245:x1731754352183680:12345-10.240.43.64@tcp:400:lctl.0 00000100:00100000:1.0:1651529677.996103:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000020f0e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec96cd77-f6e5-48c2-876b-61a646cc1c34+5:441245:x1731754352183680:12345-10.240.43.64@tcp:400:lctl.0 Request processed in 36us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529677.996107:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 0 00000100:00100000:0.0:1651529679.130594:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529679.130618:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754352183872 00000100:00100000:1.0:1651529679.130633:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1 00000100:00100000:1.0:1651529679.130642:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051722b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec96cd77-f6e5-48c2-876b-61a646cc1c34+5:441875:x1731754352183872:12345-10.240.43.64@tcp:400:lctl.0 00000100:00100000:1.0:1651529679.130660:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051722b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec96cd77-f6e5-48c2-876b-61a646cc1c34+5:441875:x1731754352183872:12345-10.240.43.64@tcp:400:lctl.0 Request processed in 24us (67us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529679.130663:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1 00000100:00100000:0.0:1651529680.078681:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529680.078706:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754352184128 00000100:00100000:1.0:1651529680.078722:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2 00000100:00100000:1.0:1651529680.078723:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000c84c6c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec96cd77-f6e5-48c2-876b-61a646cc1c34+5:442406:x1731754352184128:12345-10.240.43.64@tcp:400:lctl.0 00000100:00100000:1.0:1651529680.078740:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000c84c6c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec96cd77-f6e5-48c2-876b-61a646cc1c34+5:442406:x1731754352184128:12345-10.240.43.64@tcp:400:lctl.0 Request processed in 16us (61us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529680.078744:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2 00000100:00100000:0.0:1651529681.120182:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529681.120199:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946696384 00000100:00100000:0.0:1651529681.120219:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 3 00000100:00100000:0.0:1651529681.120241:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd71124e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946696384:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651529681.120260:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 81309134848 avail 77138423808 00000100:00100000:0.0:1651529681.120287:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd71124e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946696384:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 64us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529681.120291:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 3 00000100:00100000:0.0:1651529686.240964:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529686.240985:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946696512 00000100:00100000:0.0:1651529686.241016:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 4 00000100:00100000:0.0:1651529686.241018:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000471073f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946696512:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651529686.241037:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 81309134848 avail 77138423808 00000100:00100000:0.0:1651529686.241064:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000471073f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946696512:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 45us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529686.241067:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 4 00000100:00100000:0.0:1651529688.189329:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fd6d3f0c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997084544:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:0.0:1651529688.193525:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fd6d3f0c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997084544:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:0.0:1651529691.360202:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529691.360231:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946696640 00000100:00100000:0.0:1651529691.360258:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 5 00000100:00100000:0.0:1651529691.360260:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fd6d3f0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946696640:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651529691.360278:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 81309134848 avail 77138423808 00000100:00100000:0.0:1651529691.360304:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fd6d3f0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946696640:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 44us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529691.360308:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 5 00000100:00100000:0.0:1651529695.357308:0:39100:0:(ptlrpcd.c:414:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1651529695.357322:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008b7a4fe3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9063caa-b124-4cb6-99ef-d01a735595c3:39100:1731745997084608:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:0.0:1651529695.357733:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008b7a4fe3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9063caa-b124-4cb6-99ef-d01a735595c3:39100:1731745997084608:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:0.0:1651529696.480218:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529696.480256:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946696896 00000100:00100000:0.0:1651529696.480281:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 6 00000100:00100000:0.0:1651529696.480293:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946696896:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651529696.480311:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 81309134848 avail 77138423808 00000100:00100000:0.0:1651529696.480338:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946696896:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 54us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529696.480342:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 6 00000100:00100000:0.0:1651529701.600250:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529701.600270:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946697024 00000100:00100000:0.0:1651529701.600300:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 7 00000100:00100000:0.0:1651529701.600303:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004de851bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946697024:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651529701.600322:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 81309134848 avail 77138423808 00000100:00100000:0.0:1651529701.600347:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004de851bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946697024:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 44us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529701.600351:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 7 00000100:00100000:0.0:1651529705.668333:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529705.668381:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754352184384 00000100:00100000:1.0:1651529705.668411:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4 00000100:00100000:1.0:1651529705.668414:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec96cd77-f6e5-48c2-876b-61a646cc1c34+5:438145:x1731754352184384:12345-10.240.43.64@tcp:9:kworker/u4:0.0 00000020:00000080:1.0:1651529705.668450:0:166112:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0x3234de053c54391 00000100:00080000:1.0:1651529705.668454:0:166112:0:(import.c:85:import_set_state_nolock()) 00000000b89bf9a4 ãFÖà”ÿÿ: changing import state from FULL to CLOSED 00000001:00000004:1.0:1651529705.668479:0:166112:0:(tgt_lastrcvd.c:701:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 5, last_transno is 21474836480 00000100:00100000:1.0:1651529705.668554:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec96cd77-f6e5-48c2-876b-61a646cc1c34+2:438145:x1731754352184384:12345-10.240.43.64@tcp:9:kworker/u4:0.0 Request processed in 139us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529705.668558:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4 00000100:00100000:0.0:1651529706.720190:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529706.720208:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946697152 00000100:00100000:0.0:1651529706.720247:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 8 00000100:00100000:0.0:1651529706.720250:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946697152:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651529706.720269:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81309134848 avail 77138423808 00000100:00100000:0.0:1651529706.720295:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946697152:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 45us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529706.720299:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 8 00000001:00100000:1.0:1651529711.253290:0:166098:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ec96cd77-f6e5-48c2-876b-61a646cc1c34 00000020:00000080:1.0:1651529711.253294:0:166098:0:(genops.c:985:class_export_put()) final put 00000000eb536226/ec96cd77-f6e5-48c2-876b-61a646cc1c34 00000020:00000080:0.0:1651529711.253340:0:159543:0:(genops.c:944:class_export_destroy()) destroying export 00000000eb536226/ec96cd77-f6e5-48c2-876b-61a646cc1c34 for lustre-OST0001 00000020:00000080:0.0:1651529711.253363:0:159543:0:(genops.c:1164:obd_zombie_import_free()) destroying import 00000000b89bf9a4 for lustre-OST0001 00000100:00100000:0.0:1651529711.841043:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529711.841063:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946697280 00000100:00100000:0.0:1651529711.841091:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 9 00000100:00100000:0.0:1651529711.841094:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091d23b68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946697280:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651529711.841113:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81309134848 avail 77138423808 00000100:00100000:0.0:1651529711.841139:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091d23b68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946697280:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 45us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529711.841143:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 9 00000100:00100000:0.0:1651529712.765309:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000041d3f4d5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997084672:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:0.0:1651529712.765654:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000041d3f4d5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997084672:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:0.0:1651529716.960291:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529716.960310:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946697408 00000100:00100000:0.0:1651529716.960337:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 10 00000100:00100000:0.0:1651529716.960339:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000041d3f4d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946697408:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651529716.960358:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81309134848 avail 77138423808 00000100:00100000:0.0:1651529716.960397:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000041d3f4d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946697408:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 50us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529716.960401:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 10 00000100:00100000:0.0:1651529720.957323:0:39100:0:(ptlrpcd.c:414:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1651529720.957337:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000f756e73 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9063caa-b124-4cb6-99ef-d01a735595c3:39100:1731745997084736:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:0.0:1651529720.958079:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000f756e73 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9063caa-b124-4cb6-99ef-d01a735595c3:39100:1731745997084736:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:0.0:1651529722.080274:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529722.080295:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946697664 00000100:00100000:0.0:1651529722.080322:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 11 00000100:00100000:0.0:1651529722.080324:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000f756e73 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946697664:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651529722.080344:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81309134848 avail 77138423808 00000100:00100000:0.0:1651529722.080371:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000f756e73 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946697664:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 46us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529722.080375:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 11 00000100:00100000:0.0:1651529727.202358:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529727.202406:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946697856 00000100:00100000:1.0:1651529727.202432:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 12 00000100:00100000:1.0:1651529727.202435:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9e38e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946697856:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651529727.202453:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81309134848 avail 77138423808 00000100:00100000:1.0:1651529727.202495:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9e38e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946697856:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 60us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529727.202499:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 12 00000100:00100000:0.0:1651529732.321177:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529732.321218:0:166115:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946697984 00000100:00100000:1.0:1651529732.321258:0:166115:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 13 00000100:00100000:1.0:1651529732.321260:0:166115:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008cca9da pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946697984:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651529732.321279:0:166115:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81309134848 avail 77138423808 00000100:00100000:1.0:1651529732.321313:0:166115:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008cca9da pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946697984:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 52us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529732.321317:0:166115:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 13 00000100:00100000:0.0:1651529737.440171:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529737.440207:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946698112 00000100:00100000:1.0:1651529737.440244:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 14 00000100:00100000:1.0:1651529737.440247:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001832a3d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946698112:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651529737.440266:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81309134848 avail 77138423808 00000100:00100000:1.0:1651529737.440301:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001832a3d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946698112:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 53us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529737.440305:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 14 00000100:00100000:0.0:1651529738.365306:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000095f2cd7b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997084800:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:0.0:1651529738.365731:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000095f2cd7b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997084800:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:0.0:1651529742.560173:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529742.560205:0:166115:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946698304 00000100:00100000:1.0:1651529742.560246:0:166115:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 15 00000100:00100000:1.0:1651529742.560249:0:166115:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095f2cd7b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946698304:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651529742.560266:0:166115:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81309134848 avail 77138423808 00000100:00100000:1.0:1651529742.560305:0:166115:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095f2cd7b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946698304:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 48us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529742.560309:0:166115:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 15 00000100:00100000:0.0:1651529745.533269:0:39100:0:(ptlrpcd.c:414:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1651529745.533279:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a4b08118 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9063caa-b124-4cb6-99ef-d01a735595c3:39100:1731745997084864:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:0.0:1651529745.533537:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a4b08118 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9063caa-b124-4cb6-99ef-d01a735595c3:39100:1731745997084864:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:0.0:1651529747.680138:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529747.680169:0:166115:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946698432 00000100:00100000:1.0:1651529747.680185:0:166115:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 16 00000100:00100000:1.0:1651529747.680187:0:166115:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a4b08118 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946698432:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651529747.680194:0:166115:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81309134848 avail 77138423808 00000100:00100000:1.0:1651529747.680210:0:166115:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a4b08118 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946698432:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 23us (73us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529747.680213:0:166115:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 16 00000100:00100000:0.0:1651529752.800093:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529752.800128:0:166115:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946698624 00000100:00100000:1.0:1651529752.800144:0:166115:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 17 00000100:00100000:1.0:1651529752.800147:0:166115:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d6be6ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946698624:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651529752.800154:0:166115:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81309134848 avail 77138423808 00000100:00100000:1.0:1651529752.800172:0:166115:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d6be6ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946698624:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 25us (80us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529752.800176:0:166115:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 17 00000100:00100000:0.0:1651529757.920103:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529757.920138:0:166115:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946698752 00000100:00100000:1.0:1651529757.920154:0:166115:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 18 00000100:00100000:1.0:1651529757.920156:0:166115:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004cb25697 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946698752:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651529757.920165:0:166115:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81309134848 avail 77138423808 00000100:00100000:1.0:1651529757.920182:0:166115:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004cb25697 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946698752:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 25us (81us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529757.920185:0:166115:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 18 00000100:00100000:0.0:1651529763.040130:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529763.040166:0:166115:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946698944 00000100:00100000:1.0:1651529763.040184:0:166115:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 19 00000100:00100000:1.0:1651529763.040186:0:166115:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000387f378b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946698944:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651529763.040194:0:166115:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81309134848 avail 77138423808 00000100:00100000:1.0:1651529763.040211:0:166115:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000387f378b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946698944:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 24us (82us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529763.040214:0:166115:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 19 00000100:00100000:0.0:1651529763.965290:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005cc6463a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997084928:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:0.0:1651529763.965550:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005cc6463a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997084928:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:0.0:1651529768.160145:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529768.160155:0:166115:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946699072 00000100:00100000:0.0:1651529768.160165:0:166115:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 20 00000100:00100000:0.0:1651529768.160167:0:166115:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946699072:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651529768.160175:0:166115:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81309134848 avail 77138423808 00000100:00100000:0.0:1651529768.160187:0:166115:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946699072:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 20us (43us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529768.160191:0:166115:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 20 00000100:00100000:0.0:1651529771.133263:0:39100:0:(ptlrpcd.c:414:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1651529771.133269:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f9050c71 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9063caa-b124-4cb6-99ef-d01a735595c3:39100:1731745997084992:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:0.0:1651529771.133533:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f9050c71 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9063caa-b124-4cb6-99ef-d01a735595c3:39100:1731745997084992:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:0.0:1651529773.280137:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529773.280146:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946699264 00000100:00100000:0.0:1651529773.280156:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 21 00000100:00100000:0.0:1651529773.280158:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946699264:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651529773.280165:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81309134848 avail 77138423808 00000100:00100000:0.0:1651529773.280177:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946699264:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 19us (42us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529773.280180:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 21 00000100:00100000:0.0:1651529778.400087:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529778.400097:0:166115:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946699392 00000100:00100000:0.0:1651529778.400106:0:166115:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 22 00000100:00100000:0.0:1651529778.400109:0:166115:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004be7c06d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946699392:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651529778.400116:0:166115:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81309134848 avail 77138423808 00000100:00100000:0.0:1651529778.400127:0:166115:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004be7c06d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946699392:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 18us (42us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529778.400131:0:166115:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 22 00000100:00100000:0.0:1651529783.520077:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529783.520087:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946699520 00000100:00100000:0.0:1651529783.520096:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 23 00000100:00100000:0.0:1651529783.520098:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946699520:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651529783.520105:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81309134848 avail 77138423808 00000100:00100000:0.0:1651529783.520116:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946699520:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 18us (40us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529783.520120:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 23 00000100:00100000:0.0:1651529788.640139:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529788.640148:0:166115:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946699712 00000100:00100000:0.0:1651529788.640158:0:166115:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 24 00000100:00100000:0.0:1651529788.640160:0:166115:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946699712:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651529788.640167:0:166115:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81309134848 avail 77138423808 00000100:00100000:0.0:1651529788.640179:0:166115:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946699712:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 19us (42us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529788.640182:0:166115:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 24 00000100:00100000:0.0:1651529789.565278:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000088fa78f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997085056:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:0.0:1651529789.565532:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000088fa78f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997085056:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:1.0:1651529793.760139:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529793.760168:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946699840 00000100:00100000:0.0:1651529793.760180:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 25 00000100:00100000:0.0:1651529793.760182:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9b0314b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946699840:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651529793.760189:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 81309134848 avail 77138423808 00000100:00100000:0.0:1651529793.760202:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9b0314b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946699840:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 20us (66us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529793.760205:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 25 00000100:00100000:0.0:1651529795.709266:0:39100:0:(ptlrpcd.c:414:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1651529795.709277:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000088fa78f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9063caa-b124-4cb6-99ef-d01a735595c3:39100:1731745997085120:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:0.0:1651529795.709622:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000088fa78f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9063caa-b124-4cb6-99ef-d01a735595c3:39100:1731745997085120:10.240.43.61@tcp:400:kworker/u4:0.0 00000400:00000080:0.0:1651529796.855688:0:167140:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651529796.855691:0:167140:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 134a: Server reclaims locks when reaching lock_reclaim_threshold ========================================================== 22:16:36 (1651529796) 00000100:00100000:0.0:1651529798.880138:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529798.880158:0:166115:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946734336 00000100:00100000:0.0:1651529798.880179:0:166115:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 26 00000100:00100000:0.0:1651529798.880181:0:166115:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000914b688f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946734336:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651529798.880195:0:166115:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 264768 pending 0 free 81309134848 avail 77138423808 00000100:00100000:0.0:1651529798.880220:0:166115:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000914b688f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946734336:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 38us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529798.880243:0:166115:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 26 00000100:00100000:0.0:1651529804.000134:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529804.000169:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946734528 00000100:00100000:1.0:1651529804.000191:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 27 00000100:00100000:1.0:1651529804.000193:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d985827e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946734528:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651529804.000206:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 264768 pending 0 free 81309134848 avail 77138423808 00000100:00100000:1.0:1651529804.000244:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d985827e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946734528:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 50us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529804.000249:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 27 00000100:00100000:0.0:1651529809.121169:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529809.121241:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946734720 00000100:00100000:1.0:1651529809.121270:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 28 00000100:00100000:1.0:1651529809.121273:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005804bd35 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946734720:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651529809.121292:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 264768 pending 0 free 81309134848 avail 77138423808 00000100:00100000:1.0:1651529809.121324:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005804bd35 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946734720:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 50us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529809.121328:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 28 00000400:00000080:0.0:1651529811.706820:0:167574:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651529811.706823:0:167574:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 134b: Server rejects lock request when reaching lock_limit_mb ========================================================== 22:16:51 (1651529811) 00000400:00000080:0.0:1651529916.201111:0:168010:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651529916.201114:0:168010:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity test_135 skipping SLOW test 135 00000400:00000080:0.0:1651529916.511775:0:168064:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651529916.511777:0:168064:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity test_136 skipping SLOW test 136 00000100:00100000:1.0:1651529916.541275:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008dcef4b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:39099:1731745997085760:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:0.0:1651529916.541275:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a4b486d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9063caa-b124-4cb6-99ef-d01a735595c3:39100:1731745997085696:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:1.0:1651529916.541694:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008dcef4b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:39099:1731745997085760:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:0.0:1651529916.541694:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a4b486d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9063caa-b124-4cb6-99ef-d01a735595c3:39100:1731745997085696:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:1.0:1651529916.640151:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529916.640164:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946802944 00000100:00100000:1.0:1651529916.640185:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 49 00000100:00100000:1.0:1651529916.640188:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008dcef4b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946802944:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651529916.640203:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 256704 pending 0 free 81309134848 avail 77138423808 00000100:00100000:1.0:1651529916.640219:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008dcef4b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946802944:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 30us (69us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529916.640239:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 49 00000100:00100000:1.0:1651529917.229359:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.229380:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946803584 00000100:00100000:1.0:1651529917.229388:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.229399:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.229404:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946803712 00000100:00100000:0.0:1651529917.229407:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946803840 00000100:00100000:1.0:1651529917.229408:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.229410:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946803968 00000100:00100000:1.0:1651529917.229414:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.229415:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 530 00000100:00100000:1.0:1651529917.229418:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.229418:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946803584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529917.229424:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.229429:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529917.229433:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180054 count 1 00000100:00100000:1.0:1651529917.229437:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946803648 00000100:00100000:1.0:1651529917.229445:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946803776 00000100:00100000:1.0:1651529917.229448:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946803904 00002000:00010000:0.0:1651529917.229449:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf56:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529917.229450:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946804032 00010000:00010000:0.0:1651529917.229452:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c55232 lrc: 3/0,1 mode: --/PW res: [0x2bf56:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.229454:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 531 00000100:00100000:1.0:1651529917.229456:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946803712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529917.229462:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1651529917.229463:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180056 count 1 00010000:00010000:0.0:1651529917.229463:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.229466:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c55232 lrc: 3/0,1 mode: PW/PW res: [0x2bf56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229472:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c55232 lrc: 3/0,1 mode: PW/PW res: [0x2bf56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.229473:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf58:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.229475:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c55239 lrc: 3/0,1 mode: --/PW res: [0x2bf58:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229476:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c55232 lrc: 3/0,1 mode: PW/PW res: [0x2bf56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229480:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c55232 lrc: 2/0,0 mode: PW/PW res: [0x2bf56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.229481:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.229481:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.229483:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c55239 lrc: 3/0,1 mode: PW/PW res: [0x2bf58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.229488:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c55239 lrc: 3/0,1 mode: PW/PW res: [0x2bf58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.229491:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c55239 lrc: 3/0,1 mode: PW/PW res: [0x2bf58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.229494:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c55239 lrc: 2/0,0 mode: PW/PW res: [0x2bf58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.229580:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:39030:x1731745946803712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 123us (198us total) trans 21474836981 rc 0/0 00000100:00100000:0.0:1651529917.229582:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:39030:x1731745946803584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 163us (225us total) trans 21474836982 rc 0/0 00000100:00100000:1.0:1651529917.229586:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 531 00000100:00100000:0.0:1651529917.229588:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 530 00000100:00100000:1.0:1651529917.229593:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 532 00000100:00100000:1.0:1651529917.229595:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946803840:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529917.229595:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 533 00000100:00100000:0.0:1651529917.229597:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946803968:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.229600:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180058 count 1 00002000:00080000:0.0:1651529917.229602:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180060 count 1 00002000:00010000:1.0:1651529917.229606:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf5a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.229608:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c55240 lrc: 3/0,1 mode: --/PW res: [0x2bf5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.229608:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf5c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.229610:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c55247 lrc: 3/0,1 mode: --/PW res: [0x2bf5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.229612:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.229613:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.229614:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c55240 lrc: 3/0,1 mode: PW/PW res: [0x2bf5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229614:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.229615:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.229616:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c55247 lrc: 3/0,1 mode: PW/PW res: [0x2bf5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.229617:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c55240 lrc: 3/0,1 mode: PW/PW res: [0x2bf5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.229620:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c55240 lrc: 3/0,1 mode: PW/PW res: [0x2bf5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229620:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c55247 lrc: 3/0,1 mode: PW/PW res: [0x2bf5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.229623:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c55240 lrc: 2/0,0 mode: PW/PW res: [0x2bf5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229623:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c55247 lrc: 3/0,1 mode: PW/PW res: [0x2bf5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229626:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c55247 lrc: 2/0,0 mode: PW/PW res: [0x2bf5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.229667:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:39030:x1731745946803840:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 72us (268us total) trans 21474836983 rc 0/0 00000100:00100000:1.0:1651529917.229671:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 532 00000100:00100000:1.0:1651529917.229676:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 534 00000100:00100000:0.0:1651529917.229677:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946803968:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 80us (269us total) trans 21474836984 rc 0/0 00000100:00100000:1.0:1651529917.229678:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946803648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529917.229681:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 533 00002000:00080000:1.0:1651529917.229683:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180055 count 1 00000100:00100000:0.0:1651529917.229686:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 535 00002000:00010000:1.0:1651529917.229688:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf57:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1651529917.229688:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946803776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529917.229690:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c5524e lrc: 3/0,1 mode: --/PW res: [0x2bf57:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.229692:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180057 count 1 00010000:00010000:1.0:1651529917.229693:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.229694:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.229695:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c5524e lrc: 3/0,1 mode: PW/PW res: [0x2bf57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.229698:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf59:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.229699:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c5524e lrc: 3/0,1 mode: PW/PW res: [0x2bf57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229699:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c55255 lrc: 3/0,1 mode: --/PW res: [0x2bf59:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.229702:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c5524e lrc: 3/0,1 mode: PW/PW res: [0x2bf57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229703:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.229704:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c5524e lrc: 2/0,0 mode: PW/PW res: [0x2bf57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229704:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.229705:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c55255 lrc: 3/0,1 mode: PW/PW res: [0x2bf59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229708:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c55255 lrc: 3/0,1 mode: PW/PW res: [0x2bf59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229714:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c55255 lrc: 3/0,1 mode: PW/PW res: [0x2bf59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229717:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c55255 lrc: 2/0,0 mode: PW/PW res: [0x2bf59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.229739:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:39030:x1731745946803648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 60us (325us total) trans 21474836985 rc 0/0 00000100:00100000:1.0:1651529917.229742:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 534 00000100:00100000:1.0:1651529917.229747:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 536 00000100:00100000:1.0:1651529917.229749:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946803904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529917.229752:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946803776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 63us (333us total) trans 21474836986 rc 0/0 00002000:00080000:1.0:1651529917.229753:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180059 count 1 00000100:00100000:0.0:1651529917.229755:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 535 00002000:00010000:1.0:1651529917.229758:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf5b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.229759:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c5525c lrc: 3/0,1 mode: --/PW res: [0x2bf5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.229760:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 537 00000100:00100000:0.0:1651529917.229762:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745946804032:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529917.229763:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.229764:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.229765:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c5525c lrc: 3/0,1 mode: PW/PW res: [0x2bf5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.229766:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180061 count 1 00010000:00010000:1.0:1651529917.229768:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c5525c lrc: 3/0,1 mode: PW/PW res: [0x2bf5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.229771:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c5525c lrc: 3/0,1 mode: PW/PW res: [0x2bf5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.229771:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf5d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.229772:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c55263 lrc: 3/0,1 mode: --/PW res: [0x2bf5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.229774:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c5525c lrc: 2/0,0 mode: PW/PW res: [0x2bf5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229776:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.229776:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.229777:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c55263 lrc: 3/0,1 mode: PW/PW res: [0x2bf5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229781:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c55263 lrc: 3/0,1 mode: PW/PW res: [0x2bf5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229784:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c55263 lrc: 3/0,1 mode: PW/PW res: [0x2bf5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229789:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c55263 lrc: 2/0,0 mode: PW/PW res: [0x2bf5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.229807:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:39030:x1731745946803904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 58us (383us total) trans 21474836987 rc 0/0 00000100:00100000:1.0:1651529917.229810:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 536 00010000:00010000:1.0:1651529917.229819:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c55232 lrc: 2/0,0 mode: PW/PW res: [0x2bf56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.229823:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f149aa4b already unused, calling callback (0000000049fddea7) 00000100:00100000:0.0:1651529917.229823:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:39030:x1731745946804032:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 60us (393us total) trans 21474836988 rc 0/0 00010000:00010000:1.0:1651529917.229824:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c55232 lrc: 2/0,0 mode: PW/PW res: [0x2bf56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.229826:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 537 00010000:00010000:1.0:1651529917.229828:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c55232 lrc: 3/0,0 mode: PW/PW res: [0x2bf56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229836:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c55239 lrc: 2/0,0 mode: PW/PW res: [0x2bf58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.229837:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c55232 lrc: 1/0,0 mode: --/PW res: [0x2bf56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.229840:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c55232 lrc: 0/0,0 mode: --/PW res: [0x2bf56:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229840:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e270377c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.229841:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c55239 lrc: 2/0,0 mode: PW/PW res: [0x2bf58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229844:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c55239 lrc: 3/0,0 mode: PW/PW res: [0x2bf58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.229845:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c55240 lrc: 2/0,0 mode: PW/PW res: [0x2bf5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.229848:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008393c644 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.229849:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c55240 lrc: 2/0,0 mode: PW/PW res: [0x2bf5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229850:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c55239 lrc: 1/0,0 mode: --/PW res: [0x2bf58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.229852:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c55240 lrc: 3/0,0 mode: PW/PW res: [0x2bf5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229853:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c55239 lrc: 0/0,0 mode: --/PW res: [0x2bf58:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.229855:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c55240 lrc: 1/0,0 mode: --/PW res: [0x2bf5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229857:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c55247 lrc: 2/0,0 mode: PW/PW res: [0x2bf5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.229858:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c55240 lrc: 0/0,0 mode: --/PW res: [0x2bf5a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229860:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001644aaad already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.229861:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c55247 lrc: 2/0,0 mode: PW/PW res: [0x2bf5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.229862:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c5524e lrc: 2/0,0 mode: PW/PW res: [0x2bf57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.229864:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b1b8f74 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.229864:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c55247 lrc: 3/0,0 mode: PW/PW res: [0x2bf5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.229865:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c5524e lrc: 2/0,0 mode: PW/PW res: [0x2bf57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.229868:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c5524e lrc: 3/0,0 mode: PW/PW res: [0x2bf57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229868:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c55247 lrc: 1/0,0 mode: --/PW res: [0x2bf5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229870:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c55247 lrc: 0/0,0 mode: --/PW res: [0x2bf5c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.229871:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c5524e lrc: 1/0,0 mode: --/PW res: [0x2bf57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.229874:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c5524e lrc: 0/0,0 mode: --/PW res: [0x2bf57:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229874:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c55255 lrc: 2/0,0 mode: PW/PW res: [0x2bf59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.229877:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c5525c lrc: 2/0,0 mode: PW/PW res: [0x2bf5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229877:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005c863cd2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.229877:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c55255 lrc: 2/0,0 mode: PW/PW res: [0x2bf59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.229880:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004926c34d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.229880:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c55255 lrc: 3/0,0 mode: PW/PW res: [0x2bf59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.229881:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c5525c lrc: 2/0,0 mode: PW/PW res: [0x2bf5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.229883:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c5525c lrc: 3/0,0 mode: PW/PW res: [0x2bf5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229883:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c55255 lrc: 1/0,0 mode: --/PW res: [0x2bf59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229886:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c55255 lrc: 0/0,0 mode: --/PW res: [0x2bf59:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.229887:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c5525c lrc: 1/0,0 mode: --/PW res: [0x2bf5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.229889:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c5525c lrc: 0/0,0 mode: --/PW res: [0x2bf5b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229889:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c55263 lrc: 2/0,0 mode: PW/PW res: [0x2bf5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229892:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032eb11d3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.229893:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c55263 lrc: 2/0,0 mode: PW/PW res: [0x2bf5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229896:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c55263 lrc: 3/0,0 mode: PW/PW res: [0x2bf5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229899:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c55263 lrc: 1/0,0 mode: --/PW res: [0x2bf5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.229902:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c55263 lrc: 0/0,0 mode: --/PW res: [0x2bf5d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.230249:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.230257:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.230266:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946804224 00000100:00100000:0.0:1651529917.230274:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946804288 00000100:00100000:0.0:1651529917.230283:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 538 00000100:00100000:0.0:1651529917.230285:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7fc4ed7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:39030:x1731745946804224:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529917.230286:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529917.230291:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180062 count 1 00000100:00100000:1.0:1651529917.230293:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00010000:0.0:1651529917.230297:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf5e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529917.230299:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.230299:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c5526a lrc: 3/0,1 mode: --/PW res: [0x2bf5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.230303:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.230303:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.230303:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.230304:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c5526a lrc: 3/0,1 mode: PW/PW res: [0x2bf5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.230310:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.230311:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c5526a lrc: 3/0,1 mode: PW/PW res: [0x2bf5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230314:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c5526a lrc: 3/0,1 mode: PW/PW res: [0x2bf5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.230316:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946804416 00000100:00100000:1.0:1651529917.230322:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946804352 00000100:00100000:1.0:1651529917.230324:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946804544 00000100:00100000:1.0:1651529917.230327:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946804480 00010000:00010000:0.0:1651529917.230334:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c5526a lrc: 2/0,0 mode: PW/PW res: [0x2bf5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.230335:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946804672 00000100:00100000:1.0:1651529917.230339:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 539 00000100:00100000:1.0:1651529917.230346:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d5b9490 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+19:39029:x1731745946804288:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.230352:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180063 count 1 00002000:00010000:1.0:1651529917.230358:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf5f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.230360:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c55271 lrc: 3/0,1 mode: --/PW res: [0x2bf5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230364:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.230365:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.230366:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c55271 lrc: 3/0,1 mode: PW/PW res: [0x2bf5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230370:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c55271 lrc: 3/0,1 mode: PW/PW res: [0x2bf5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230373:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c55271 lrc: 3/0,1 mode: PW/PW res: [0x2bf5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230375:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c55271 lrc: 2/0,0 mode: PW/PW res: [0x2bf5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.230397:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7fc4ed7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:39030:x1731745946804224:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 111us (148us total) trans 21474836989 rc 0/0 00000100:00100000:0.0:1651529917.230401:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 538 00000100:00100000:0.0:1651529917.230407:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 540 00000100:00100000:0.0:1651529917.230409:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:39029:x1731745946804416:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.230414:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180065 count 1 00002000:00010000:0.0:1651529917.230420:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf61:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.230422:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c55278 lrc: 3/0,1 mode: --/PW res: [0x2bf61:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230425:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.230426:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.230427:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c55278 lrc: 3/0,1 mode: PW/PW res: [0x2bf61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.230428:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d5b9490 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:39029:x1731745946804288:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 82us (170us total) trans 21474836990 rc 0/0 00010000:00010000:0.0:1651529917.230431:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c55278 lrc: 3/0,1 mode: PW/PW res: [0x2bf61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.230432:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 539 00010000:00010000:0.0:1651529917.230436:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c55278 lrc: 3/0,1 mode: PW/PW res: [0x2bf61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.230438:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 541 00000100:00100000:1.0:1651529917.230439:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+19:39030:x1731745946804352:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529917.230439:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c55278 lrc: 2/0,0 mode: PW/PW res: [0x2bf61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.230444:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180064 count 1 00002000:00010000:1.0:1651529917.230449:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf60:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.230451:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c5527f lrc: 3/0,1 mode: --/PW res: [0x2bf60:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230454:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.230455:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.230456:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c5527f lrc: 3/0,1 mode: PW/PW res: [0x2bf60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230460:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c5527f lrc: 3/0,1 mode: PW/PW res: [0x2bf60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230463:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c5527f lrc: 3/0,1 mode: PW/PW res: [0x2bf60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230466:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c5527f lrc: 2/0,0 mode: PW/PW res: [0x2bf60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.230478:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:39029:x1731745946804416:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 68us (203us total) trans 21474836991 rc 0/0 00000100:00100000:0.0:1651529917.230480:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 540 00000100:00100000:0.0:1651529917.230486:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 542 00000100:00100000:0.0:1651529917.230487:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078c6e720 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:39029:x1731745946804544:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.230492:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180067 count 1 00002000:00010000:0.0:1651529917.230497:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf63:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529917.230499:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:39030:x1731745946804352:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 59us (206us total) trans 21474836992 rc 0/0 00010000:00010000:0.0:1651529917.230499:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ba8c2cb/0x3234de053c55286 lrc: 3/0,1 mode: --/PW res: [0x2bf63:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230502:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.230503:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529917.230504:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 541 00010000:00010000:0.0:1651529917.230504:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ba8c2cb/0x3234de053c55286 lrc: 3/0,1 mode: PW/PW res: [0x2bf63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230507:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ba8c2cb/0x3234de053c55286 lrc: 3/0,1 mode: PW/PW res: [0x2bf63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.230509:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 543 00010000:00010000:0.0:1651529917.230510:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ba8c2cb/0x3234de053c55286 lrc: 3/0,1 mode: PW/PW res: [0x2bf63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.230511:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b3d379fe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+19:39030:x1731745946804480:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.230515:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180066 count 1 00010000:00010000:0.0:1651529917.230515:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ba8c2cb/0x3234de053c55286 lrc: 2/0,0 mode: PW/PW res: [0x2bf63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.230520:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf62:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.230521:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c5528d lrc: 3/0,1 mode: --/PW res: [0x2bf62:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230525:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.230525:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.230526:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c5528d lrc: 3/0,1 mode: PW/PW res: [0x2bf62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230530:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c5528d lrc: 3/0,1 mode: PW/PW res: [0x2bf62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230533:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c5528d lrc: 3/0,1 mode: PW/PW res: [0x2bf62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230535:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c5528d lrc: 2/0,0 mode: PW/PW res: [0x2bf62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.230549:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078c6e720 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:39029:x1731745946804544:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 61us (250us total) trans 21474836993 rc 0/0 00000100:00100000:0.0:1651529917.230552:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 542 00000100:00100000:0.0:1651529917.230556:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 544 00000100:00100000:0.0:1651529917.230558:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ab440250 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:39029:x1731745946804672:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.230562:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180069 count 1 00002000:00010000:0.0:1651529917.230567:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf65:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529917.230568:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b3d379fe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:39030:x1731745946804480:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 56us (264us total) trans 21474836994 rc 0/0 00010000:00010000:0.0:1651529917.230569:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c55294 lrc: 3/0,1 mode: --/PW res: [0x2bf65:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.230570:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 543 00010000:00010000:0.0:1651529917.230572:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.230573:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.230574:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c55294 lrc: 3/0,1 mode: PW/PW res: [0x2bf65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230577:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c55294 lrc: 3/0,1 mode: PW/PW res: [0x2bf65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230580:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c55294 lrc: 3/0,1 mode: PW/PW res: [0x2bf65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230583:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c55294 lrc: 2/0,0 mode: PW/PW res: [0x2bf65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.230599:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.230617:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ab440250 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:39029:x1731745946804672:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 58us (307us total) trans 21474836995 rc 0/0 00000100:00100000:0.0:1651529917.230620:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 544 00000100:00100000:0.0:1651529917.230625:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946804608 00000100:00100000:0.0:1651529917.230629:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 545 00000100:00100000:0.0:1651529917.230630:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:39030:x1731745946804608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.230635:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180068 count 1 00002000:00010000:0.0:1651529917.230640:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf64:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.230642:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c5529b lrc: 3/0,1 mode: --/PW res: [0x2bf64:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230645:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.230646:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.230646:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c5529b lrc: 3/0,1 mode: PW/PW res: [0x2bf64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230650:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c5529b lrc: 3/0,1 mode: PW/PW res: [0x2bf64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230653:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c5529b lrc: 3/0,1 mode: PW/PW res: [0x2bf64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230656:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c5529b lrc: 2/0,0 mode: PW/PW res: [0x2bf64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230674:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c5526a lrc: 2/0,0 mode: PW/PW res: [0x2bf5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230678:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f3240ce7 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.230679:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c5526a lrc: 2/0,0 mode: PW/PW res: [0x2bf5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230682:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c5526a lrc: 3/0,0 mode: PW/PW res: [0x2bf5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230688:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c5526a lrc: 1/0,0 mode: --/PW res: [0x2bf5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.230693:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:39030:x1731745946804608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 62us (94us total) trans 21474836996 rc 0/0 00010000:00010000:1.0:1651529917.230695:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c5526a lrc: 0/0,0 mode: --/PW res: [0x2bf5e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.230697:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 545 00010000:00010000:1.0:1651529917.230700:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c55271 lrc: 2/0,0 mode: PW/PW res: [0x2bf5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230703:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eca832be already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.230704:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c55271 lrc: 2/0,0 mode: PW/PW res: [0x2bf5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230705:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c55278 lrc: 2/0,0 mode: PW/PW res: [0x2bf61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230706:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c55271 lrc: 3/0,0 mode: PW/PW res: [0x2bf5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230708:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ee128d1f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.230709:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c55278 lrc: 2/0,0 mode: PW/PW res: [0x2bf61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230710:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c55271 lrc: 1/0,0 mode: --/PW res: [0x2bf5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230712:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c55271 lrc: 0/0,0 mode: --/PW res: [0x2bf5f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230712:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c55278 lrc: 3/0,0 mode: PW/PW res: [0x2bf61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230716:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c5527f lrc: 2/0,0 mode: PW/PW res: [0x2bf60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230719:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000092ad010c already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.230720:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c5527f lrc: 2/0,0 mode: PW/PW res: [0x2bf60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230723:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c5527f lrc: 3/0,0 mode: PW/PW res: [0x2bf60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230726:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c5527f lrc: 1/0,0 mode: --/PW res: [0x2bf60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230728:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c5527f lrc: 0/0,0 mode: --/PW res: [0x2bf60:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230731:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ba8c2cb/0x3234de053c55286 lrc: 2/0,0 mode: PW/PW res: [0x2bf63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230734:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007ba8c2cb already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.230734:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c55278 lrc: 1/0,0 mode: --/PW res: [0x2bf61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230735:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ba8c2cb/0x3234de053c55286 lrc: 2/0,0 mode: PW/PW res: [0x2bf63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230737:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ba8c2cb/0x3234de053c55286 lrc: 3/0,0 mode: PW/PW res: [0x2bf63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230737:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c55278 lrc: 0/0,0 mode: --/PW res: [0x2bf61:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230740:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ba8c2cb/0x3234de053c55286 lrc: 1/0,0 mode: --/PW res: [0x2bf63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230742:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c5528d lrc: 2/0,0 mode: PW/PW res: [0x2bf62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230743:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ba8c2cb/0x3234de053c55286 lrc: 0/0,0 mode: --/PW res: [0x2bf63:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230745:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008119f3a8 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.230746:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c5528d lrc: 2/0,0 mode: PW/PW res: [0x2bf62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230747:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c55294 lrc: 2/0,0 mode: PW/PW res: [0x2bf65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230748:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c5528d lrc: 3/0,0 mode: PW/PW res: [0x2bf62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230749:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000087f212ed already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.230750:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c55294 lrc: 2/0,0 mode: PW/PW res: [0x2bf65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230753:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c55294 lrc: 3/0,0 mode: PW/PW res: [0x2bf65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230754:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c5528d lrc: 1/0,0 mode: --/PW res: [0x2bf62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230756:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c55294 lrc: 1/0,0 mode: --/PW res: [0x2bf65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230757:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c5528d lrc: 0/0,0 mode: --/PW res: [0x2bf62:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230759:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c55294 lrc: 0/0,0 mode: --/PW res: [0x2bf65:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230761:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c5529b lrc: 2/0,0 mode: PW/PW res: [0x2bf64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230763:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f10dea8 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.230764:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c5529b lrc: 2/0,0 mode: PW/PW res: [0x2bf64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230767:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c5529b lrc: 3/0,0 mode: PW/PW res: [0x2bf64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230770:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c5529b lrc: 1/0,0 mode: --/PW res: [0x2bf64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230773:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c5529b lrc: 0/0,0 mode: --/PW res: [0x2bf64:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.230860:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.230878:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.230889:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.230889:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946805248 00000100:00100000:1.0:1651529917.230898:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.230901:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 546 00000100:00100000:0.0:1651529917.230902:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:39030:x1731745946805248:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529917.230905:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946805312 00002000:00080000:0.0:1651529917.230908:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180070 count 1 00000100:00100000:1.0:1651529917.230910:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946805376 00000100:00100000:1.0:1651529917.230912:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946805504 00002000:00010000:0.0:1651529917.230914:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf66:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.230915:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c552a2 lrc: 3/0,1 mode: --/PW res: [0x2bf66:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.230916:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 547 00000100:00100000:1.0:1651529917.230918:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+24:39029:x1731745946805312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529917.230919:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.230919:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.230920:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c552a2 lrc: 3/0,1 mode: PW/PW res: [0x2bf66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.230923:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180071 count 1 00002000:00010000:1.0:1651529917.230929:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf67:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.230931:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c552a9 lrc: 3/0,1 mode: --/PW res: [0x2bf67:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230935:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.230935:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.230936:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c552a9 lrc: 3/0,1 mode: PW/PW res: [0x2bf67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230940:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c552a9 lrc: 3/0,1 mode: PW/PW res: [0x2bf67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230943:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c552a9 lrc: 3/0,1 mode: PW/PW res: [0x2bf67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230952:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c552a2 lrc: 3/0,1 mode: PW/PW res: [0x2bf66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230956:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c552a2 lrc: 3/0,1 mode: PW/PW res: [0x2bf66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.230958:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c552a2 lrc: 2/0,0 mode: PW/PW res: [0x2bf66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.230961:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c552a9 lrc: 2/0,0 mode: PW/PW res: [0x2bf67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.231012:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+26:39030:x1731745946805248:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 108us (152us total) trans 21474836997 rc 0/0 00000100:00100000:1.0:1651529917.231018:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+26:39029:x1731745946805312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 100us (149us total) trans 21474836998 rc 0/0 00000100:00100000:1.0:1651529917.231022:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 547 00000100:00100000:1.0:1651529917.231027:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 548 00000100:00100000:1.0:1651529917.231029:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+25:39030:x1731745946805376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529917.231029:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 546 00002000:00080000:1.0:1651529917.231033:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180072 count 1 00000100:00100000:0.0:1651529917.231035:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 549 00000100:00100000:0.0:1651529917.231047:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+24:39030:x1731745946805504:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00010000:1.0:1651529917.231051:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf68:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.231053:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c552b0 lrc: 3/0,1 mode: --/PW res: [0x2bf68:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.231053:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180074 count 1 00010000:00010000:1.0:1651529917.231057:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.231057:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.231058:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c552b0 lrc: 3/0,1 mode: PW/PW res: [0x2bf68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.231059:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf6a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.231060:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c552b7 lrc: 3/0,1 mode: --/PW res: [0x2bf6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231062:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c552b0 lrc: 3/0,1 mode: PW/PW res: [0x2bf68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231065:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c552b0 lrc: 3/0,1 mode: PW/PW res: [0x2bf68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231067:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.231067:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.231068:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c552b0 lrc: 2/0,0 mode: PW/PW res: [0x2bf68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231068:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c552b7 lrc: 3/0,1 mode: PW/PW res: [0x2bf6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231072:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c552b7 lrc: 3/0,1 mode: PW/PW res: [0x2bf6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231081:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c552b7 lrc: 3/0,1 mode: PW/PW res: [0x2bf6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231084:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c552b7 lrc: 2/0,0 mode: PW/PW res: [0x2bf6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.231107:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+26:39030:x1731745946805376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 78us (218us total) trans 21474836999 rc 0/0 00000100:00100000:1.0:1651529917.231111:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 548 00010000:00010000:1.0:1651529917.231118:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c552a2 lrc: 2/0,0 mode: PW/PW res: [0x2bf66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231121:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005532ef34 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.231122:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c552a2 lrc: 2/0,0 mode: PW/PW res: [0x2bf66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.231123:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+25:39030:x1731745946805504:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 75us (224us total) trans 21474837000 rc 0/0 00010000:00010000:1.0:1651529917.231125:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c552a2 lrc: 3/0,0 mode: PW/PW res: [0x2bf66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.231126:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 549 00010000:00010000:1.0:1651529917.231133:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c552a2 lrc: 1/0,0 mode: --/PW res: [0x2bf66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231135:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c552a9 lrc: 2/0,0 mode: PW/PW res: [0x2bf67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231136:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c552a2 lrc: 0/0,0 mode: --/PW res: [0x2bf66:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231138:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b5173ced already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.231139:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c552a9 lrc: 2/0,0 mode: PW/PW res: [0x2bf67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231140:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c552b0 lrc: 2/0,0 mode: PW/PW res: [0x2bf68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231143:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6999e11 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.231143:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c552a9 lrc: 3/0,0 mode: PW/PW res: [0x2bf67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231144:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c552b0 lrc: 2/0,0 mode: PW/PW res: [0x2bf68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231146:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c552b0 lrc: 3/0,0 mode: PW/PW res: [0x2bf68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231149:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c552b0 lrc: 1/0,0 mode: --/PW res: [0x2bf68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231150:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c552a9 lrc: 1/0,0 mode: --/PW res: [0x2bf67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231152:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c552b0 lrc: 0/0,0 mode: --/PW res: [0x2bf68:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231153:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c552a9 lrc: 0/0,0 mode: --/PW res: [0x2bf67:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231155:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c552b7 lrc: 2/0,0 mode: PW/PW res: [0x2bf6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231158:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fcafd1a already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.231159:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c552b7 lrc: 2/0,0 mode: PW/PW res: [0x2bf6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231162:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c552b7 lrc: 3/0,0 mode: PW/PW res: [0x2bf6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231165:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c552b7 lrc: 1/0,0 mode: --/PW res: [0x2bf6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231168:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c552b7 lrc: 0/0,0 mode: --/PW res: [0x2bf6a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.231181:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.231192:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946805632 00000100:00100000:1.0:1651529917.231200:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.231200:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 550 00000100:00100000:0.0:1651529917.231201:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+25:39030:x1731745946805632:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529917.231211:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529917.231211:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180076 count 1 00002000:00010000:0.0:1651529917.231217:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf6c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.231219:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c552be lrc: 3/0,1 mode: --/PW res: [0x2bf6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231233:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.231234:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.231235:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c552be lrc: 3/0,1 mode: PW/PW res: [0x2bf6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231238:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c552be lrc: 3/0,1 mode: PW/PW res: [0x2bf6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231242:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c552be lrc: 3/0,1 mode: PW/PW res: [0x2bf6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231244:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c552be lrc: 2/0,0 mode: PW/PW res: [0x2bf6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.231257:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.231285:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946805440 00000100:00100000:0.0:1651529917.231292:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+27:39030:x1731745946805632:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 90us (111us total) trans 21474837001 rc 0/0 00000100:00100000:1.0:1651529917.231296:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946805568 00000100:00100000:0.0:1651529917.231304:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 550 00000100:00100000:1.0:1651529917.231307:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946805760 00000100:00100000:0.0:1651529917.231310:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 551 00000100:00100000:1.0:1651529917.231312:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 552 00000100:00100000:0.0:1651529917.231312:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:39030:x1731745946805440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529917.231314:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:39030:x1731745946805568:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.231317:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180073 count 1 00002000:00080000:1.0:1651529917.231319:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180075 count 1 00002000:00010000:0.0:1651529917.231323:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf69:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:1.0:1651529917.231324:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf6b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.231324:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c552c5 lrc: 3/0,1 mode: --/PW res: [0x2bf69:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231326:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c552cc lrc: 3/0,1 mode: --/PW res: [0x2bf6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231328:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.231328:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.231329:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c552c5 lrc: 3/0,1 mode: PW/PW res: [0x2bf69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231330:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.231330:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.231331:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c552cc lrc: 3/0,1 mode: PW/PW res: [0x2bf6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231333:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c552c5 lrc: 3/0,1 mode: PW/PW res: [0x2bf69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231335:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c552cc lrc: 3/0,1 mode: PW/PW res: [0x2bf6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231336:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c552c5 lrc: 3/0,1 mode: PW/PW res: [0x2bf69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231339:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c552cc lrc: 3/0,1 mode: PW/PW res: [0x2bf6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231341:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c552cc lrc: 2/0,0 mode: PW/PW res: [0x2bf6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231361:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c552c5 lrc: 2/0,0 mode: PW/PW res: [0x2bf69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.231391:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:39030:x1731745946805568:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 76us (179us total) trans 21474837002 rc 0/0 00000100:00100000:1.0:1651529917.231394:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 552 00000100:00100000:1.0:1651529917.231399:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 553 00000100:00100000:1.0:1651529917.231401:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:39029:x1731745946805760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529917.231404:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:39030:x1731745946805440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 92us (204us total) trans 21474837003 rc 0/0 00002000:00080000:1.0:1651529917.231405:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180077 count 1 00000100:00100000:0.0:1651529917.231409:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 551 00002000:00010000:1.0:1651529917.231410:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf6d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.231412:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c552d3 lrc: 3/0,1 mode: --/PW res: [0x2bf6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231416:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.231416:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.231417:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c552d3 lrc: 3/0,1 mode: PW/PW res: [0x2bf6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231418:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c552be lrc: 2/0,0 mode: PW/PW res: [0x2bf6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231421:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c552d3 lrc: 3/0,1 mode: PW/PW res: [0x2bf6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231422:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000820e2b3d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.231423:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c552be lrc: 2/0,0 mode: PW/PW res: [0x2bf6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231426:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c552d3 lrc: 3/0,1 mode: PW/PW res: [0x2bf6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231426:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c552be lrc: 3/0,0 mode: PW/PW res: [0x2bf6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231429:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c552d3 lrc: 2/0,0 mode: PW/PW res: [0x2bf6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231431:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c552be lrc: 1/0,0 mode: --/PW res: [0x2bf6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231433:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c552be lrc: 0/0,0 mode: --/PW res: [0x2bf6c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231438:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c552cc lrc: 2/0,0 mode: PW/PW res: [0x2bf6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231440:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004cff9fc3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.231441:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c552cc lrc: 2/0,0 mode: PW/PW res: [0x2bf6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231444:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c552cc lrc: 3/0,0 mode: PW/PW res: [0x2bf6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231450:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c552cc lrc: 1/0,0 mode: --/PW res: [0x2bf6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231453:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c552cc lrc: 0/0,0 mode: --/PW res: [0x2bf6b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231456:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c552c5 lrc: 2/0,0 mode: PW/PW res: [0x2bf69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231458:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054295afd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.231459:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c552c5 lrc: 2/0,0 mode: PW/PW res: [0x2bf69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.231463:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:39029:x1731745946805760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 61us (205us total) trans 21474837004 rc 0/0 00000100:00100000:1.0:1651529917.231465:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 553 00010000:00010000:1.0:1651529917.231473:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c552d3 lrc: 2/0,0 mode: PW/PW res: [0x2bf6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231476:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cb70d261 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.231484:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c552d3 lrc: 2/0,0 mode: PW/PW res: [0x2bf6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231488:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c552d3 lrc: 3/0,0 mode: PW/PW res: [0x2bf6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231493:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c552d3 lrc: 1/0,0 mode: --/PW res: [0x2bf6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231495:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c552d3 lrc: 0/0,0 mode: --/PW res: [0x2bf6d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231495:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c552c5 lrc: 3/0,0 mode: PW/PW res: [0x2bf69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231499:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c552c5 lrc: 1/0,0 mode: --/PW res: [0x2bf69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231502:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c552c5 lrc: 0/0,0 mode: --/PW res: [0x2bf69:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.231511:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.231516:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946805824 00000100:00100000:0.0:1651529917.231527:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 554 00000100:00100000:0.0:1651529917.231528:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d5e5262 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:39029:x1731745946805824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529917.231531:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529917.231533:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180078 count 1 00002000:00010000:0.0:1651529917.231544:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf6e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.231546:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c552da lrc: 3/0,1 mode: --/PW res: [0x2bf6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231550:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.231550:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.231551:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c552da lrc: 3/0,1 mode: PW/PW res: [0x2bf6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231555:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c552da lrc: 3/0,1 mode: PW/PW res: [0x2bf6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231558:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c552da lrc: 3/0,1 mode: PW/PW res: [0x2bf6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231560:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c552da lrc: 2/0,0 mode: PW/PW res: [0x2bf6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231581:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c552da lrc: 2/0,0 mode: PW/PW res: [0x2bf6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231590:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000029e40f3d already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.231591:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c552da lrc: 2/0,0 mode: PW/PW res: [0x2bf6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231594:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c552da lrc: 3/0,0 mode: PW/PW res: [0x2bf6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231599:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c552da lrc: 1/0,0 mode: --/PW res: [0x2bf6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231602:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c552da lrc: 0/0,0 mode: --/PW res: [0x2bf6e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.231615:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946806144 00000100:00100000:0.0:1651529917.231621:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d5e5262 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:39029:x1731745946805824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 92us (110us total) trans 21474837005 rc 0/0 00000100:00100000:0.0:1651529917.231625:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 554 00000100:00100000:1.0:1651529917.231630:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 555 00000100:00100000:1.0:1651529917.231631:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:39030:x1731745946806144:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.231636:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180079 count 1 00002000:00010000:1.0:1651529917.231642:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf6f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.231643:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c552e1 lrc: 3/0,1 mode: --/PW res: [0x2bf6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231647:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.231647:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.231648:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c552e1 lrc: 3/0,1 mode: PW/PW res: [0x2bf6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231652:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c552e1 lrc: 3/0,1 mode: PW/PW res: [0x2bf6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231655:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c552e1 lrc: 3/0,1 mode: PW/PW res: [0x2bf6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231658:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c552e1 lrc: 2/0,0 mode: PW/PW res: [0x2bf6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231677:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c552e1 lrc: 2/0,0 mode: PW/PW res: [0x2bf6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231681:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002082f759 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.231682:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c552e1 lrc: 2/0,0 mode: PW/PW res: [0x2bf6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231685:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c552e1 lrc: 3/0,0 mode: PW/PW res: [0x2bf6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231691:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c552e1 lrc: 1/0,0 mode: --/PW res: [0x2bf6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231694:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c552e1 lrc: 0/0,0 mode: --/PW res: [0x2bf6f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.231698:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:39030:x1731745946806144:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 66us (167us total) trans 21474837006 rc 0/0 00000100:00100000:1.0:1651529917.231701:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 555 00000100:00100000:1.0:1651529917.231715:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.231729:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.231739:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946806208 00000100:00100000:0.0:1651529917.231745:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946806272 00000100:00100000:0.0:1651529917.231750:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 556 00000100:00100000:0.0:1651529917.231751:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:39029:x1731745946806208:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.231756:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180080 count 1 00002000:00010000:0.0:1651529917.231762:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf70:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529917.231764:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 557 00010000:00010000:0.0:1651529917.231764:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c552e8 lrc: 3/0,1 mode: --/PW res: [0x2bf70:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231767:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.231768:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.231769:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c552e8 lrc: 3/0,1 mode: PW/PW res: [0x2bf70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231772:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c552e8 lrc: 3/0,1 mode: PW/PW res: [0x2bf70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.231774:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078c6e720 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+32:39030:x1731745946806272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529917.231775:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c552e8 lrc: 3/0,1 mode: PW/PW res: [0x2bf70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.231780:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180081 count 1 00002000:00010000:1.0:1651529917.231786:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf71:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.231788:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c552ef lrc: 3/0,1 mode: --/PW res: [0x2bf71:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231791:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.231792:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.231793:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c552ef lrc: 3/0,1 mode: PW/PW res: [0x2bf71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231798:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c552e8 lrc: 2/0,0 mode: PW/PW res: [0x2bf70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231806:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c552ef lrc: 3/0,1 mode: PW/PW res: [0x2bf71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231809:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c552ef lrc: 3/0,1 mode: PW/PW res: [0x2bf71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231811:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c552ef lrc: 2/0,0 mode: PW/PW res: [0x2bf71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.231861:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+34:39029:x1731745946806208:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 109us (145us total) trans 21474837007 rc 0/0 00000100:00100000:0.0:1651529917.231865:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 556 00000100:00100000:1.0:1651529917.231867:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078c6e720 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+34:39030:x1731745946806272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 100us (137us total) trans 21474837008 rc 0/0 00000100:00100000:1.0:1651529917.231870:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 557 00010000:00010000:0.0:1651529917.231873:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c552e8 lrc: 2/0,0 mode: PW/PW res: [0x2bf70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231877:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000041a7efd7 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.231878:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c552ef lrc: 2/0,0 mode: PW/PW res: [0x2bf71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231878:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c552e8 lrc: 2/0,0 mode: PW/PW res: [0x2bf70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231881:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c552e8 lrc: 3/0,0 mode: PW/PW res: [0x2bf70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231882:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000d8e6a5e already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.231883:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c552ef lrc: 2/0,0 mode: PW/PW res: [0x2bf71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231885:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c552e8 lrc: 1/0,0 mode: --/PW res: [0x2bf70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231886:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c552ef lrc: 3/0,0 mode: PW/PW res: [0x2bf71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231888:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c552e8 lrc: 0/0,0 mode: --/PW res: [0x2bf70:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231890:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c552ef lrc: 1/0,0 mode: --/PW res: [0x2bf71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.231893:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c552ef lrc: 0/0,0 mode: --/PW res: [0x2bf71:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.231925:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.231936:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946806592 00000100:00100000:1.0:1651529917.231942:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.231946:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 558 00000100:00100000:0.0:1651529917.231947:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b3d379fe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+33:39029:x1731745946806592:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.231958:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180082 count 1 00002000:00010000:0.0:1651529917.231963:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf72:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.231965:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c552f6 lrc: 3/0,1 mode: --/PW res: [0x2bf72:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231969:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.231969:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.231970:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c552f6 lrc: 3/0,1 mode: PW/PW res: [0x2bf72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231974:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c552f6 lrc: 3/0,1 mode: PW/PW res: [0x2bf72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.231977:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.231977:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c552f6 lrc: 3/0,1 mode: PW/PW res: [0x2bf72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.231979:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c552f6 lrc: 2/0,0 mode: PW/PW res: [0x2bf72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.231987:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.231992:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.231997:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.232004:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946806656 00000100:00100000:1.0:1651529917.232009:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946806720 00000100:00100000:1.0:1651529917.232011:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946806784 00000100:00100000:1.0:1651529917.232013:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946806848 00000100:00100000:1.0:1651529917.232016:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946806912 00000100:00100000:1.0:1651529917.232019:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 559 00000100:00100000:1.0:1651529917.232020:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ab440250 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:39030:x1731745946806656:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529917.232029:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b3d379fe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:39029:x1731745946806592:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 80us (109us total) trans 21474837009 rc 0/0 00002000:00080000:1.0:1651529917.232032:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180083 count 1 00000100:00100000:0.0:1651529917.232032:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 558 00002000:00010000:1.0:1651529917.232046:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf73:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1651529917.232046:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 560 00000100:00100000:0.0:1651529917.232047:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+38:39029:x1731745946806720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529917.232048:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c552fd lrc: 3/0,1 mode: --/PW res: [0x2bf73:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232052:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.232052:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:0.0:1651529917.232052:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180084 count 1 00010000:00010000:1.0:1651529917.232053:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c552fd lrc: 3/0,1 mode: PW/PW res: [0x2bf73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232057:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c552fd lrc: 3/0,1 mode: PW/PW res: [0x2bf73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.232058:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf74:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.232060:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c552fd lrc: 3/0,1 mode: PW/PW res: [0x2bf73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232060:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c55304 lrc: 3/0,1 mode: --/PW res: [0x2bf74:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232063:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c552fd lrc: 2/0,0 mode: PW/PW res: [0x2bf73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232063:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.232064:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.232065:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c55304 lrc: 3/0,1 mode: PW/PW res: [0x2bf74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232069:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c55304 lrc: 3/0,1 mode: PW/PW res: [0x2bf74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232079:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c55304 lrc: 3/0,1 mode: PW/PW res: [0x2bf74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232082:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c55304 lrc: 2/0,0 mode: PW/PW res: [0x2bf74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.232114:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ab440250 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:39030:x1731745946806656:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 92us (171us total) trans 21474837010 rc 0/0 00000100:00100000:1.0:1651529917.232116:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 559 00000100:00100000:1.0:1651529917.232122:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 561 00000100:00100000:1.0:1651529917.232123:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:39030:x1731745946806784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.232128:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180085 count 1 00002000:00010000:1.0:1651529917.232141:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf75:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.232143:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c5530b lrc: 3/0,1 mode: --/PW res: [0x2bf75:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.232143:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:39029:x1731745946806720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 95us (166us total) trans 21474837011 rc 0/0 00010000:00010000:1.0:1651529917.232146:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.232147:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529917.232147:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 560 00010000:00010000:1.0:1651529917.232148:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c5530b lrc: 3/0,1 mode: PW/PW res: [0x2bf75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232152:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c5530b lrc: 3/0,1 mode: PW/PW res: [0x2bf75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.232152:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 562 00000100:00100000:0.0:1651529917.232154:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+38:39029:x1731745946806848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529917.232155:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c5530b lrc: 3/0,1 mode: PW/PW res: [0x2bf75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232157:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c5530b lrc: 2/0,0 mode: PW/PW res: [0x2bf75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.232159:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180086 count 1 00002000:00010000:0.0:1651529917.232165:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf76:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.232166:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c55312 lrc: 3/0,1 mode: --/PW res: [0x2bf76:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232170:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.232170:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.232171:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c55312 lrc: 3/0,1 mode: PW/PW res: [0x2bf76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232175:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c55312 lrc: 3/0,1 mode: PW/PW res: [0x2bf76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232180:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c55312 lrc: 3/0,1 mode: PW/PW res: [0x2bf76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232183:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c55312 lrc: 2/0,0 mode: PW/PW res: [0x2bf76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.232196:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:39030:x1731745946806784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 71us (208us total) trans 21474837012 rc 0/0 00000100:00100000:1.0:1651529917.232199:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 561 00000100:00100000:1.0:1651529917.232204:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 563 00000100:00100000:1.0:1651529917.232205:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+38:39030:x1731745946806912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.232210:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180087 count 1 00002000:00010000:1.0:1651529917.232215:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf77:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.232216:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c55319 lrc: 3/0,1 mode: --/PW res: [0x2bf77:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232220:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.232220:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.232221:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c55319 lrc: 3/0,1 mode: PW/PW res: [0x2bf77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232251:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c55319 lrc: 3/0,1 mode: PW/PW res: [0x2bf77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232254:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c55319 lrc: 3/0,1 mode: PW/PW res: [0x2bf77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232257:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c55319 lrc: 2/0,0 mode: PW/PW res: [0x2bf77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.232265:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:39029:x1731745946806848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 110us (273us total) trans 21474837013 rc 0/0 00000100:00100000:0.0:1651529917.232269:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 562 00010000:00010000:0.0:1651529917.232279:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c552f6 lrc: 2/0,0 mode: PW/PW res: [0x2bf72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232282:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002e24dea3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.232283:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c552f6 lrc: 2/0,0 mode: PW/PW res: [0x2bf72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232286:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c552f6 lrc: 3/0,0 mode: PW/PW res: [0x2bf72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232291:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c552f6 lrc: 1/0,0 mode: --/PW res: [0x2bf72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.232292:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:39030:x1731745946806912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 86us (295us total) trans 21474837014 rc 0/0 00010000:00010000:0.0:1651529917.232294:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c552f6 lrc: 0/0,0 mode: --/PW res: [0x2bf72:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.232297:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 563 00010000:00010000:0.0:1651529917.232298:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c552fd lrc: 2/0,0 mode: PW/PW res: [0x2bf73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232301:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000721302df already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.232302:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c552fd lrc: 2/0,0 mode: PW/PW res: [0x2bf73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232304:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c55304 lrc: 2/0,0 mode: PW/PW res: [0x2bf74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232305:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c552fd lrc: 3/0,0 mode: PW/PW res: [0x2bf73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232308:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002731c8d2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.232308:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c552fd lrc: 1/0,0 mode: --/PW res: [0x2bf73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232309:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c55304 lrc: 2/0,0 mode: PW/PW res: [0x2bf74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232311:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c552fd lrc: 0/0,0 mode: --/PW res: [0x2bf73:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232312:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c55304 lrc: 3/0,0 mode: PW/PW res: [0x2bf74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232314:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c5530b lrc: 2/0,0 mode: PW/PW res: [0x2bf75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232316:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c55304 lrc: 1/0,0 mode: --/PW res: [0x2bf74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232317:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a032e9d0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.232318:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c5530b lrc: 2/0,0 mode: PW/PW res: [0x2bf75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232319:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c55304 lrc: 0/0,0 mode: --/PW res: [0x2bf74:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232320:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c5530b lrc: 3/0,0 mode: PW/PW res: [0x2bf75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232323:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c55312 lrc: 2/0,0 mode: PW/PW res: [0x2bf76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232323:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c5530b lrc: 1/0,0 mode: --/PW res: [0x2bf75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232326:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000093b5c984 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.232326:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c5530b lrc: 0/0,0 mode: --/PW res: [0x2bf75:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232327:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c55312 lrc: 2/0,0 mode: PW/PW res: [0x2bf76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232330:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c55312 lrc: 3/0,0 mode: PW/PW res: [0x2bf76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232330:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c55319 lrc: 2/0,0 mode: PW/PW res: [0x2bf77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232333:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000f18bca1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.232334:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c55319 lrc: 2/0,0 mode: PW/PW res: [0x2bf77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232335:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c55312 lrc: 1/0,0 mode: --/PW res: [0x2bf76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232336:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c55319 lrc: 3/0,0 mode: PW/PW res: [0x2bf77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232338:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c55312 lrc: 0/0,0 mode: --/PW res: [0x2bf76:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232339:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c55319 lrc: 1/0,0 mode: --/PW res: [0x2bf77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232342:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c55319 lrc: 0/0,0 mode: --/PW res: [0x2bf77:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.232351:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.232361:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946807104 00000100:00100000:0.0:1651529917.232372:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 564 00000100:00100000:0.0:1651529917.232374:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+39:39029:x1731745946807104:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529917.232375:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529917.232384:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180088 count 1 00002000:00010000:0.0:1651529917.232389:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf78:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.232391:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c55320 lrc: 3/0,1 mode: --/PW res: [0x2bf78:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232394:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.232395:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.232396:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c55320 lrc: 3/0,1 mode: PW/PW res: [0x2bf78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232400:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c55320 lrc: 3/0,1 mode: PW/PW res: [0x2bf78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232402:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c55320 lrc: 3/0,1 mode: PW/PW res: [0x2bf78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232405:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c55320 lrc: 2/0,0 mode: PW/PW res: [0x2bf78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232429:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c55320 lrc: 2/0,0 mode: PW/PW res: [0x2bf78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232433:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d52cc749 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.232434:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c55320 lrc: 2/0,0 mode: PW/PW res: [0x2bf78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232437:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c55320 lrc: 3/0,0 mode: PW/PW res: [0x2bf78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232442:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c55320 lrc: 1/0,0 mode: --/PW res: [0x2bf78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232445:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c55320 lrc: 0/0,0 mode: --/PW res: [0x2bf78:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.232450:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+40:39029:x1731745946807104:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 75us (98us total) trans 21474837015 rc 0/0 00000100:00100000:0.0:1651529917.232453:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 564 00000100:00100000:0.0:1651529917.232458:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946807360 00000100:00100000:0.0:1651529917.232483:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 565 00000100:00100000:0.0:1651529917.232485:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+40:39029:x1731745946807360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.232490:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180089 count 1 00002000:00010000:0.0:1651529917.232496:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf79:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.232497:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c55327 lrc: 3/0,1 mode: --/PW res: [0x2bf79:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232501:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.232502:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.232503:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c55327 lrc: 3/0,1 mode: PW/PW res: [0x2bf79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232506:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c55327 lrc: 3/0,1 mode: PW/PW res: [0x2bf79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232510:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c55327 lrc: 3/0,1 mode: PW/PW res: [0x2bf79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232512:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c55327 lrc: 2/0,0 mode: PW/PW res: [0x2bf79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.232559:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+41:39029:x1731745946807360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 73us (190us total) trans 21474837016 rc 0/0 00000100:00100000:0.0:1651529917.232562:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 565 00010000:00010000:0.0:1651529917.232570:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c55327 lrc: 2/0,0 mode: PW/PW res: [0x2bf79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232573:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001b109cb1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.232574:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c55327 lrc: 2/0,0 mode: PW/PW res: [0x2bf79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232577:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c55327 lrc: 3/0,0 mode: PW/PW res: [0x2bf79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232582:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c55327 lrc: 1/0,0 mode: --/PW res: [0x2bf79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232585:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c55327 lrc: 0/0,0 mode: --/PW res: [0x2bf79:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.232757:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.232768:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.232768:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946807680 00000100:00100000:1.0:1651529917.232776:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.232789:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946807616 00000100:00100000:1.0:1651529917.232790:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.232793:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946807808 00000100:00100000:0.0:1651529917.232795:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946807936 00000100:00100000:1.0:1651529917.232796:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.232798:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946807744 00000100:00100000:1.0:1651529917.232801:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.232801:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 566 00000100:00100000:0.0:1651529917.232803:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:39030:x1731745946807680:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529917.232807:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529917.232808:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180091 count 1 00000100:00100000:1.0:1651529917.232812:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946807872 00002000:00010000:0.0:1651529917.232814:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf7b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.232816:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c5532e lrc: 3/0,1 mode: --/PW res: [0x2bf7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.232818:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946808000 00010000:00010000:0.0:1651529917.232819:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.232820:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529917.232821:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 567 00010000:00010000:0.0:1651529917.232821:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c5532e lrc: 3/0,1 mode: PW/PW res: [0x2bf7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.232822:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+47:39029:x1731745946807616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529917.232825:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c5532e lrc: 3/0,1 mode: PW/PW res: [0x2bf7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.232827:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180090 count 1 00002000:00010000:1.0:1651529917.232834:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf7a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.232835:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c55335 lrc: 3/0,1 mode: --/PW res: [0x2bf7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232839:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.232839:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.232845:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c5532e lrc: 3/0,1 mode: PW/PW res: [0x2bf7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232847:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c55335 lrc: 3/0,1 mode: PW/PW res: [0x2bf7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232849:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c5532e lrc: 2/0,0 mode: PW/PW res: [0x2bf7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232852:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c55335 lrc: 3/0,1 mode: PW/PW res: [0x2bf7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232855:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c55335 lrc: 3/0,1 mode: PW/PW res: [0x2bf7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232857:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c55335 lrc: 2/0,0 mode: PW/PW res: [0x2bf7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.232894:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+49:39030:x1731745946807680:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 90us (137us total) trans 21474837017 rc 0/0 00000100:00100000:0.0:1651529917.232897:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 566 00000100:00100000:0.0:1651529917.232903:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 568 00000100:00100000:1.0:1651529917.232904:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+48:39029:x1731745946807616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 81us (135us total) trans 21474837018 rc 0/0 00000100:00100000:0.0:1651529917.232905:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+48:39030:x1731745946807808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529917.232909:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 567 00002000:00080000:0.0:1651529917.232909:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180093 count 1 00000100:00100000:1.0:1651529917.232914:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 569 00002000:00010000:0.0:1651529917.232915:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf7d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529917.232916:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c782cfa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+47:39030:x1731745946807936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529917.232917:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c5533c lrc: 3/0,1 mode: --/PW res: [0x2bf7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232920:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1651529917.232921:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180095 count 1 00010000:00010000:0.0:1651529917.232921:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.232922:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c5533c lrc: 3/0,1 mode: PW/PW res: [0x2bf7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.232926:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf7f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.232926:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c5533c lrc: 3/0,1 mode: PW/PW res: [0x2bf7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232927:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c55343 lrc: 3/0,1 mode: --/PW res: [0x2bf7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232929:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c5533c lrc: 3/0,1 mode: PW/PW res: [0x2bf7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232931:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.232931:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c5533c lrc: 2/0,0 mode: PW/PW res: [0x2bf7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232932:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.232933:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c55343 lrc: 3/0,1 mode: PW/PW res: [0x2bf7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232936:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c55343 lrc: 3/0,1 mode: PW/PW res: [0x2bf7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232939:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c55343 lrc: 3/0,1 mode: PW/PW res: [0x2bf7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232942:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c55343 lrc: 2/0,0 mode: PW/PW res: [0x2bf7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.232967:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+49:39030:x1731745946807808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 62us (191us total) trans 21474837019 rc 0/0 00000100:00100000:0.0:1651529917.232970:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 568 00000100:00100000:0.0:1651529917.232975:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 570 00000100:00100000:1.0:1651529917.232976:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c782cfa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+48:39030:x1731745946807936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 59us (186us total) trans 21474837020 rc 0/0 00000100:00100000:0.0:1651529917.232977:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000da591860 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+48:39029:x1731745946807744:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529917.232979:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 569 00002000:00080000:0.0:1651529917.232981:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180092 count 1 00000100:00100000:1.0:1651529917.232985:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 571 00000100:00100000:1.0:1651529917.232986:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005590f790 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+47:39029:x1731745946807872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00010000:0.0:1651529917.232986:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf7c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.232988:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c5534a lrc: 3/0,1 mode: --/PW res: [0x2bf7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.232991:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180094 count 1 00010000:00010000:0.0:1651529917.232991:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.232992:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.232993:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c5534a lrc: 3/0,1 mode: PW/PW res: [0x2bf7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.232996:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf7e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.232996:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c5534a lrc: 3/0,1 mode: PW/PW res: [0x2bf7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.232997:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c55351 lrc: 3/0,1 mode: --/PW res: [0x2bf7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.232999:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c5534a lrc: 3/0,1 mode: PW/PW res: [0x2bf7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233001:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.233001:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.233002:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c55351 lrc: 3/0,1 mode: PW/PW res: [0x2bf7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233002:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c5534a lrc: 2/0,0 mode: PW/PW res: [0x2bf7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233006:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c55351 lrc: 3/0,1 mode: PW/PW res: [0x2bf7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233009:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c55351 lrc: 3/0,1 mode: PW/PW res: [0x2bf7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233011:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c55351 lrc: 2/0,0 mode: PW/PW res: [0x2bf7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.233033:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000da591860 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+49:39029:x1731745946807744:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 55us (236us total) trans 21474837021 rc 0/0 00000100:00100000:0.0:1651529917.233045:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 570 00000100:00100000:0.0:1651529917.233051:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 572 00000100:00100000:0.0:1651529917.233052:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000073bc121d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+48:39029:x1731745946808000:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529917.233056:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005590f790 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+48:39029:x1731745946807872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 69us (254us total) trans 21474837022 rc 0/0 00002000:00080000:0.0:1651529917.233057:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180096 count 1 00000100:00100000:1.0:1651529917.233059:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 571 00002000:00010000:0.0:1651529917.233063:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf80:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.233064:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55358 lrc: 3/0,1 mode: --/PW res: [0x2bf80:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233067:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c5532e lrc: 2/0,0 mode: PW/PW res: [0x2bf7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233068:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.233069:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.233070:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f616ea25 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.233070:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55358 lrc: 3/0,1 mode: PW/PW res: [0x2bf80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233071:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c5532e lrc: 2/0,0 mode: PW/PW res: [0x2bf7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233073:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55358 lrc: 3/0,1 mode: PW/PW res: [0x2bf80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233076:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55358 lrc: 3/0,1 mode: PW/PW res: [0x2bf80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233077:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c5532e lrc: 3/0,0 mode: PW/PW res: [0x2bf7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233079:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55358 lrc: 2/0,0 mode: PW/PW res: [0x2bf80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233082:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c5532e lrc: 1/0,0 mode: --/PW res: [0x2bf7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233084:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c5532e lrc: 0/0,0 mode: --/PW res: [0x2bf7b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233089:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c55335 lrc: 2/0,0 mode: PW/PW res: [0x2bf7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233091:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cde7e11a already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.233092:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c55335 lrc: 2/0,0 mode: PW/PW res: [0x2bf7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233095:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c55335 lrc: 3/0,0 mode: PW/PW res: [0x2bf7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233098:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c55335 lrc: 1/0,0 mode: --/PW res: [0x2bf7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233101:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c55335 lrc: 0/0,0 mode: --/PW res: [0x2bf7a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233104:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c5533c lrc: 2/0,0 mode: PW/PW res: [0x2bf7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233107:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000075f9ff9d already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.233108:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c5533c lrc: 2/0,0 mode: PW/PW res: [0x2bf7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233111:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c5533c lrc: 3/0,0 mode: PW/PW res: [0x2bf7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.233113:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000073bc121d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+48:39029:x1731745946808000:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 60us (306us total) trans 21474837023 rc 0/0 00010000:00010000:1.0:1651529917.233114:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c5533c lrc: 1/0,0 mode: --/PW res: [0x2bf7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233116:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c5533c lrc: 0/0,0 mode: --/PW res: [0x2bf7d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.233116:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 572 00010000:00010000:1.0:1651529917.233119:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c55343 lrc: 2/0,0 mode: PW/PW res: [0x2bf7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233122:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009fff0bd3 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.233123:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c55343 lrc: 2/0,0 mode: PW/PW res: [0x2bf7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233124:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c5534a lrc: 2/0,0 mode: PW/PW res: [0x2bf7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233125:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c55343 lrc: 3/0,0 mode: PW/PW res: [0x2bf7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233127:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d2b9655c already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.233128:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c55343 lrc: 1/0,0 mode: --/PW res: [0x2bf7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233128:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c5534a lrc: 2/0,0 mode: PW/PW res: [0x2bf7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233131:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c55343 lrc: 0/0,0 mode: --/PW res: [0x2bf7f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233131:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c5534a lrc: 3/0,0 mode: PW/PW res: [0x2bf7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233135:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c55351 lrc: 2/0,0 mode: PW/PW res: [0x2bf7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233135:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c5534a lrc: 1/0,0 mode: --/PW res: [0x2bf7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233137:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d1167ce5 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.233138:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c55351 lrc: 2/0,0 mode: PW/PW res: [0x2bf7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233141:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c55351 lrc: 3/0,0 mode: PW/PW res: [0x2bf7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233141:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c5534a lrc: 0/0,0 mode: --/PW res: [0x2bf7c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233144:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c55351 lrc: 1/0,0 mode: --/PW res: [0x2bf7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233145:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55358 lrc: 2/0,0 mode: PW/PW res: [0x2bf80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233146:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c55351 lrc: 0/0,0 mode: --/PW res: [0x2bf7e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233148:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000029b2a516 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.233149:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55358 lrc: 2/0,0 mode: PW/PW res: [0x2bf80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233152:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55358 lrc: 3/0,0 mode: PW/PW res: [0x2bf80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233155:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55358 lrc: 1/0,0 mode: --/PW res: [0x2bf80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233157:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55358 lrc: 0/0,0 mode: --/PW res: [0x2bf80:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.233160:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.233174:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946808384 00000100:00100000:0.0:1651529917.233181:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 573 00000100:00100000:0.0:1651529917.233182:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000da71a327 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+48:39030:x1731745946808384:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.233187:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180097 count 1 00002000:00010000:0.0:1651529917.233192:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf81:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.233194:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c5535f lrc: 3/0,1 mode: --/PW res: [0x2bf81:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233199:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.233200:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.233201:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c5535f lrc: 3/0,1 mode: PW/PW res: [0x2bf81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233204:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c5535f lrc: 3/0,1 mode: PW/PW res: [0x2bf81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233207:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c5535f lrc: 3/0,1 mode: PW/PW res: [0x2bf81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233210:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c5535f lrc: 2/0,0 mode: PW/PW res: [0x2bf81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233271:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c5535f lrc: 2/0,0 mode: PW/PW res: [0x2bf81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233275:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d84ad17b already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.233276:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c5535f lrc: 2/0,0 mode: PW/PW res: [0x2bf81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233279:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c5535f lrc: 3/0,0 mode: PW/PW res: [0x2bf81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.233288:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000da71a327 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+49:39030:x1731745946808384:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 105us (127us total) trans 21474837024 rc 0/0 00010000:00010000:1.0:1651529917.233291:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c5535f lrc: 1/0,0 mode: --/PW res: [0x2bf81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.233292:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 573 00010000:00010000:1.0:1651529917.233294:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c5535f lrc: 0/0,0 mode: --/PW res: [0x2bf81:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.233483:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.233493:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.233494:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946808832 00000100:00100000:1.0:1651529917.233534:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.233538:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946808768 00000100:00100000:0.0:1651529917.233541:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946808896 00000100:00100000:1.0:1651529917.233542:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.233544:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 574 00000100:00100000:0.0:1651529917.233545:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003a823031 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+51:39030:x1731745946808832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529917.233547:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529917.233551:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180099 count 1 00000100:00100000:1.0:1651529917.233552:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00010000:0.0:1651529917.233556:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf83:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529917.233558:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946808960 00010000:00010000:0.0:1651529917.233558:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c55366 lrc: 3/0,1 mode: --/PW res: [0x2bf83:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.233563:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946809088 00010000:00010000:0.0:1651529917.233565:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.233565:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529917.233566:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946809024 00010000:00010000:0.0:1651529917.233566:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c55366 lrc: 3/0,1 mode: PW/PW res: [0x2bf83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.233568:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 575 00000100:00100000:1.0:1651529917.233570:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002133b09c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+54:39030:x1731745946808768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529917.233570:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c55366 lrc: 3/0,1 mode: PW/PW res: [0x2bf83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233573:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c55366 lrc: 3/0,1 mode: PW/PW res: [0x2bf83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233575:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c55366 lrc: 2/0,0 mode: PW/PW res: [0x2bf83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.233576:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180098 count 1 00002000:00010000:1.0:1651529917.233582:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf82:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.233584:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c5536d lrc: 3/0,1 mode: --/PW res: [0x2bf82:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233587:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.233588:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.233589:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c5536d lrc: 3/0,1 mode: PW/PW res: [0x2bf82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233595:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c5536d lrc: 3/0,1 mode: PW/PW res: [0x2bf82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233598:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c5536d lrc: 3/0,1 mode: PW/PW res: [0x2bf82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233601:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c5536d lrc: 2/0,0 mode: PW/PW res: [0x2bf82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.233652:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003a823031 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+56:39030:x1731745946808832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 106us (169us total) trans 21474837025 rc 0/0 00000100:00100000:0.0:1651529917.233656:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 574 00000100:00100000:0.0:1651529917.233661:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 576 00000100:00100000:0.0:1651529917.233663:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001e2d7e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+55:39030:x1731745946808896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529917.233665:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002133b09c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+55:39030:x1731745946808768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 94us (171us total) trans 21474837026 rc 0/0 00000100:00100000:1.0:1651529917.233668:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 575 00002000:00080000:0.0:1651529917.233668:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180100 count 1 00002000:00010000:0.0:1651529917.233673:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf84:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529917.233674:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 577 00010000:00010000:0.0:1651529917.233674:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae57075e/0x3234de053c55374 lrc: 3/0,1 mode: --/PW res: [0x2bf84:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.233675:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000236a2bac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+54:39030:x1731745946808960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529917.233678:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.233679:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.233679:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae57075e/0x3234de053c55374 lrc: 3/0,1 mode: PW/PW res: [0x2bf84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.233680:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180101 count 1 00010000:00010000:0.0:1651529917.233683:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae57075e/0x3234de053c55374 lrc: 3/0,1 mode: PW/PW res: [0x2bf84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.233685:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf85:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.233686:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5537b lrc: 3/0,1 mode: --/PW res: [0x2bf85:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233686:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae57075e/0x3234de053c55374 lrc: 3/0,1 mode: PW/PW res: [0x2bf84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233689:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae57075e/0x3234de053c55374 lrc: 2/0,0 mode: PW/PW res: [0x2bf84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233690:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.233690:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.233691:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5537b lrc: 3/0,1 mode: PW/PW res: [0x2bf85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233695:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5537b lrc: 3/0,1 mode: PW/PW res: [0x2bf85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233708:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5537b lrc: 3/0,1 mode: PW/PW res: [0x2bf85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233711:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5537b lrc: 2/0,0 mode: PW/PW res: [0x2bf85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.233743:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001e2d7e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+56:39030:x1731745946808896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 79us (208us total) trans 21474837027 rc 0/0 00000100:00100000:0.0:1651529917.233746:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 576 00000100:00100000:1.0:1651529917.233747:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000236a2bac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+56:39030:x1731745946808960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 71us (204us total) trans 21474837028 rc 0/0 00000100:00100000:1.0:1651529917.233750:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 577 00000100:00100000:0.0:1651529917.233752:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 578 00000100:00100000:0.0:1651529917.233753:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004e27828d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+54:39030:x1731745946809088:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529917.233755:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 579 00000100:00100000:1.0:1651529917.233757:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fbfcbb60 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+54:39029:x1731745946809024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.233758:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180103 count 1 00002000:00080000:1.0:1651529917.233761:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180102 count 1 00002000:00010000:0.0:1651529917.233763:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf87:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.233764:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c55382 lrc: 3/0,1 mode: --/PW res: [0x2bf87:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.233766:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf86:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.233768:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c55389 lrc: 3/0,1 mode: --/PW res: [0x2bf86:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233768:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.233768:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.233769:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c55382 lrc: 3/0,1 mode: PW/PW res: [0x2bf87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233771:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.233771:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.233772:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c55389 lrc: 3/0,1 mode: PW/PW res: [0x2bf86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233773:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c55382 lrc: 3/0,1 mode: PW/PW res: [0x2bf87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233776:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c55389 lrc: 3/0,1 mode: PW/PW res: [0x2bf86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233778:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c55382 lrc: 3/0,1 mode: PW/PW res: [0x2bf87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233779:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c55389 lrc: 3/0,1 mode: PW/PW res: [0x2bf86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233781:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c55382 lrc: 2/0,0 mode: PW/PW res: [0x2bf87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233784:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c55389 lrc: 2/0,0 mode: PW/PW res: [0x2bf86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.233812:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004e27828d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+56:39030:x1731745946809088:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 58us (265us total) trans 21474837029 rc 0/0 00000100:00100000:0.0:1651529917.233815:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 578 00000100:00100000:1.0:1651529917.233816:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fbfcbb60 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+56:39029:x1731745946809024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 59us (263us total) trans 21474837030 rc 0/0 00000100:00100000:1.0:1651529917.233819:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 579 00010000:00010000:0.0:1651529917.233823:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c55366 lrc: 2/0,0 mode: PW/PW res: [0x2bf83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233826:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c5536d lrc: 2/0,0 mode: PW/PW res: [0x2bf82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233827:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba070658 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.233828:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c55366 lrc: 2/0,0 mode: PW/PW res: [0x2bf83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233830:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001d04fb0a already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.233831:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c5536d lrc: 2/0,0 mode: PW/PW res: [0x2bf82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233831:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c55366 lrc: 3/0,0 mode: PW/PW res: [0x2bf83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233834:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c5536d lrc: 3/0,0 mode: PW/PW res: [0x2bf82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233836:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c55366 lrc: 1/0,0 mode: --/PW res: [0x2bf83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233838:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c5536d lrc: 1/0,0 mode: --/PW res: [0x2bf82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233839:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c55366 lrc: 0/0,0 mode: --/PW res: [0x2bf83:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233841:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c5536d lrc: 0/0,0 mode: --/PW res: [0x2bf82:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233843:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae57075e/0x3234de053c55374 lrc: 2/0,0 mode: PW/PW res: [0x2bf84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233846:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5537b lrc: 2/0,0 mode: PW/PW res: [0x2bf85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233846:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ae57075e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.233847:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae57075e/0x3234de053c55374 lrc: 2/0,0 mode: PW/PW res: [0x2bf84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233848:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d37a9fd1 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.233849:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5537b lrc: 2/0,0 mode: PW/PW res: [0x2bf85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233850:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae57075e/0x3234de053c55374 lrc: 3/0,0 mode: PW/PW res: [0x2bf84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233852:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5537b lrc: 3/0,0 mode: PW/PW res: [0x2bf85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233853:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae57075e/0x3234de053c55374 lrc: 1/0,0 mode: --/PW res: [0x2bf84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233855:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5537b lrc: 1/0,0 mode: --/PW res: [0x2bf85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233855:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae57075e/0x3234de053c55374 lrc: 0/0,0 mode: --/PW res: [0x2bf84:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233858:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5537b lrc: 0/0,0 mode: --/PW res: [0x2bf85:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233859:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c55382 lrc: 2/0,0 mode: PW/PW res: [0x2bf87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233861:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c55389 lrc: 2/0,0 mode: PW/PW res: [0x2bf86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233861:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c0de17df already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.233862:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c55382 lrc: 2/0,0 mode: PW/PW res: [0x2bf87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233864:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000215144f2 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.233865:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c55389 lrc: 2/0,0 mode: PW/PW res: [0x2bf86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233865:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c55382 lrc: 3/0,0 mode: PW/PW res: [0x2bf87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233867:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c55389 lrc: 3/0,0 mode: PW/PW res: [0x2bf86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233868:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c55382 lrc: 1/0,0 mode: --/PW res: [0x2bf87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233870:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c55389 lrc: 1/0,0 mode: --/PW res: [0x2bf86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233870:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c55382 lrc: 0/0,0 mode: --/PW res: [0x2bf87:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.233873:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c55389 lrc: 0/0,0 mode: --/PW res: [0x2bf86:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.233886:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.233898:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946809152 00000100:00100000:0.0:1651529917.233909:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 580 00000100:00100000:0.0:1651529917.233910:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe07abd6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+55:39030:x1731745946809152:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529917.233911:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529917.233923:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180104 count 1 00002000:00010000:0.0:1651529917.233928:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf88:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.233929:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55390 lrc: 3/0,1 mode: --/PW res: [0x2bf88:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233933:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.233934:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.233934:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55390 lrc: 3/0,1 mode: PW/PW res: [0x2bf88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233938:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55390 lrc: 3/0,1 mode: PW/PW res: [0x2bf88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233941:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55390 lrc: 3/0,1 mode: PW/PW res: [0x2bf88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.233943:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55390 lrc: 2/0,0 mode: PW/PW res: [0x2bf88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.233980:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946809216 00000100:00100000:0.0:1651529917.233985:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe07abd6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+56:39030:x1731745946809152:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 73us (98us total) trans 21474837031 rc 0/0 00000100:00100000:0.0:1651529917.233988:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 580 00000100:00100000:1.0:1651529917.233996:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 581 00000100:00100000:1.0:1651529917.233997:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b3e6d6ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+56:39030:x1731745946809216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.234003:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180105 count 1 00002000:00010000:1.0:1651529917.234009:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf89:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.234011:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c55397 lrc: 3/0,1 mode: --/PW res: [0x2bf89:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234014:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.234015:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.234016:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c55397 lrc: 3/0,1 mode: PW/PW res: [0x2bf89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234019:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c55397 lrc: 3/0,1 mode: PW/PW res: [0x2bf89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234019:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55390 lrc: 2/0,0 mode: PW/PW res: [0x2bf88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234022:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c55397 lrc: 3/0,1 mode: PW/PW res: [0x2bf89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234023:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004678bff1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.234024:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55390 lrc: 2/0,0 mode: PW/PW res: [0x2bf88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234025:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c55397 lrc: 2/0,0 mode: PW/PW res: [0x2bf89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234027:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55390 lrc: 3/0,0 mode: PW/PW res: [0x2bf88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234045:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55390 lrc: 1/0,0 mode: --/PW res: [0x2bf88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234049:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55390 lrc: 0/0,0 mode: --/PW res: [0x2bf88:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234053:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c55397 lrc: 2/0,0 mode: PW/PW res: [0x2bf89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234056:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ac14729e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.234057:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c55397 lrc: 2/0,0 mode: PW/PW res: [0x2bf89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234060:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c55397 lrc: 3/0,0 mode: PW/PW res: [0x2bf89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234063:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c55397 lrc: 1/0,0 mode: --/PW res: [0x2bf89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234066:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c55397 lrc: 0/0,0 mode: --/PW res: [0x2bf89:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.234073:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b3e6d6ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+57:39030:x1731745946809216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 75us (168us total) trans 21474837032 rc 0/0 00000100:00100000:1.0:1651529917.234076:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 581 00000100:00100000:1.0:1651529917.234159:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.234178:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.234193:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946809792 00000100:00100000:1.0:1651529917.234194:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.234203:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.234205:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946809856 00000100:00100000:1.0:1651529917.234208:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.234208:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946809984 00000100:00100000:0.0:1651529917.234210:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946810112 00000100:00100000:1.0:1651529917.234213:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.234213:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946809920 00000100:00100000:0.0:1651529917.234215:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946810048 00000100:00100000:0.0:1651529917.234218:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 582 00000100:00100000:0.0:1651529917.234220:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059681820 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+62:39030:x1731745946809792:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529917.234221:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 583 00000100:00100000:1.0:1651529917.234237:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050a0adb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+62:39030:x1731745946809856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.234240:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180106 count 1 00002000:00080000:1.0:1651529917.234242:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180107 count 1 00002000:00010000:0.0:1651529917.234246:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf8a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:1.0:1651529917.234248:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf8b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.234248:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c5539e lrc: 3/0,1 mode: --/PW res: [0x2bf8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234250:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c553a5 lrc: 3/0,1 mode: --/PW res: [0x2bf8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234252:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.234252:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.234253:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c5539e lrc: 3/0,1 mode: PW/PW res: [0x2bf8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234254:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.234254:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.234255:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c553a5 lrc: 3/0,1 mode: PW/PW res: [0x2bf8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234257:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c5539e lrc: 3/0,1 mode: PW/PW res: [0x2bf8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234259:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c553a5 lrc: 3/0,1 mode: PW/PW res: [0x2bf8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234260:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c5539e lrc: 3/0,1 mode: PW/PW res: [0x2bf8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234262:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c553a5 lrc: 3/0,1 mode: PW/PW res: [0x2bf8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234262:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c5539e lrc: 2/0,0 mode: PW/PW res: [0x2bf8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234265:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c553a5 lrc: 2/0,0 mode: PW/PW res: [0x2bf8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.234322:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050a0adb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+64:39030:x1731745946809856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 85us (144us total) trans 21474837034 rc 0/0 00000100:00100000:1.0:1651529917.234325:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 583 00000100:00100000:0.0:1651529917.234330:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059681820 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+64:39030:x1731745946809792:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 93us (156us total) trans 21474837033 rc 0/0 00000100:00100000:0.0:1651529917.234334:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 582 00000100:00100000:1.0:1651529917.234336:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 584 00000100:00100000:1.0:1651529917.234338:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000035de0fa0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+62:39030:x1731745946809984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.234343:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180109 count 1 00002000:00010000:1.0:1651529917.234348:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf8d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.234349:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c553ac lrc: 3/0,1 mode: --/PW res: [0x2bf8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234353:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529917.234353:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 585 00010000:00010000:1.0:1651529917.234354:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.234355:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c553ac lrc: 3/0,1 mode: PW/PW res: [0x2bf8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.234355:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000567318ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+62:39030:x1731745946810112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529917.234358:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c553ac lrc: 3/0,1 mode: PW/PW res: [0x2bf8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.234360:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180111 count 1 00010000:00010000:1.0:1651529917.234361:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c553ac lrc: 3/0,1 mode: PW/PW res: [0x2bf8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234364:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c553ac lrc: 2/0,0 mode: PW/PW res: [0x2bf8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.234365:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf8f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.234367:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c553b3 lrc: 3/0,1 mode: --/PW res: [0x2bf8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234378:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.234378:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.234379:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c553b3 lrc: 3/0,1 mode: PW/PW res: [0x2bf8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234383:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c553b3 lrc: 3/0,1 mode: PW/PW res: [0x2bf8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234387:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c553b3 lrc: 3/0,1 mode: PW/PW res: [0x2bf8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234389:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c553b3 lrc: 2/0,0 mode: PW/PW res: [0x2bf8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.234403:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000035de0fa0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+63:39030:x1731745946809984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 65us (209us total) trans 21474837035 rc 0/0 00000100:00100000:1.0:1651529917.234406:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 584 00000100:00100000:1.0:1651529917.234411:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 586 00000100:00100000:1.0:1651529917.234413:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003ffbc5dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+63:39030:x1731745946809920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.234417:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180108 count 1 00002000:00010000:1.0:1651529917.234423:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf8c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.234425:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c553ba lrc: 3/0,1 mode: --/PW res: [0x2bf8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.234426:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000567318ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+63:39030:x1731745946810112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 70us (222us total) trans 21474837036 rc 0/0 00010000:00010000:1.0:1651529917.234428:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.234428:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529917.234428:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 585 00010000:00010000:1.0:1651529917.234429:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c553ba lrc: 3/0,1 mode: PW/PW res: [0x2bf8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234433:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c553ba lrc: 3/0,1 mode: PW/PW res: [0x2bf8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.234433:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 587 00000100:00100000:0.0:1651529917.234435:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004c5dc988 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+62:39030:x1731745946810048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529917.234436:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c553ba lrc: 3/0,1 mode: PW/PW res: [0x2bf8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234439:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c553ba lrc: 2/0,0 mode: PW/PW res: [0x2bf8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.234439:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180110 count 1 00002000:00010000:0.0:1651529917.234444:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf8e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.234446:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c553c1 lrc: 3/0,1 mode: --/PW res: [0x2bf8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234450:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.234450:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.234451:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c553c1 lrc: 3/0,1 mode: PW/PW res: [0x2bf8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234455:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c553c1 lrc: 3/0,1 mode: PW/PW res: [0x2bf8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234458:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c553c1 lrc: 3/0,1 mode: PW/PW res: [0x2bf8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234460:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c553c1 lrc: 2/0,0 mode: PW/PW res: [0x2bf8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.234470:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003ffbc5dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+63:39030:x1731745946809920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 56us (261us total) trans 21474837037 rc 0/0 00000100:00100000:1.0:1651529917.234473:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 586 00010000:00010000:1.0:1651529917.234480:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c5539e lrc: 2/0,0 mode: PW/PW res: [0x2bf8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234483:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007c1cad42 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.234485:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c5539e lrc: 2/0,0 mode: PW/PW res: [0x2bf8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234487:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c5539e lrc: 3/0,0 mode: PW/PW res: [0x2bf8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.234492:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004c5dc988 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+63:39030:x1731745946810048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 56us (278us total) trans 21474837038 rc 0/0 00010000:00010000:1.0:1651529917.234493:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c5539e lrc: 1/0,0 mode: --/PW res: [0x2bf8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.234495:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 587 00010000:00010000:1.0:1651529917.234496:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c5539e lrc: 0/0,0 mode: --/PW res: [0x2bf8a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234500:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c553a5 lrc: 2/0,0 mode: PW/PW res: [0x2bf8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234503:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f56810a1 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.234503:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c553a5 lrc: 2/0,0 mode: PW/PW res: [0x2bf8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234506:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c553a5 lrc: 3/0,0 mode: PW/PW res: [0x2bf8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234506:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c553ac lrc: 2/0,0 mode: PW/PW res: [0x2bf8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234509:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c553a5 lrc: 1/0,0 mode: --/PW res: [0x2bf8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234510:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e4f40ecf already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.234511:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c553ac lrc: 2/0,0 mode: PW/PW res: [0x2bf8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234512:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c553a5 lrc: 0/0,0 mode: --/PW res: [0x2bf8b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234515:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c553b3 lrc: 2/0,0 mode: PW/PW res: [0x2bf8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234516:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c553ac lrc: 3/0,0 mode: PW/PW res: [0x2bf8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234518:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000003af78ab already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.234519:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c553b3 lrc: 2/0,0 mode: PW/PW res: [0x2bf8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234521:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c553ac lrc: 1/0,0 mode: --/PW res: [0x2bf8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234522:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c553b3 lrc: 3/0,0 mode: PW/PW res: [0x2bf8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234524:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c553ac lrc: 0/0,0 mode: --/PW res: [0x2bf8d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234525:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c553b3 lrc: 1/0,0 mode: --/PW res: [0x2bf8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234528:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c553b3 lrc: 0/0,0 mode: --/PW res: [0x2bf8f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234528:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c553ba lrc: 2/0,0 mode: PW/PW res: [0x2bf8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234531:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c553c1 lrc: 2/0,0 mode: PW/PW res: [0x2bf8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234531:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c660975a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.234532:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c553ba lrc: 2/0,0 mode: PW/PW res: [0x2bf8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234534:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000062f8a534 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.234534:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c553c1 lrc: 2/0,0 mode: PW/PW res: [0x2bf8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234534:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c553ba lrc: 3/0,0 mode: PW/PW res: [0x2bf8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234537:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c553c1 lrc: 3/0,0 mode: PW/PW res: [0x2bf8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234538:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c553ba lrc: 1/0,0 mode: --/PW res: [0x2bf8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234540:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c553c1 lrc: 1/0,0 mode: --/PW res: [0x2bf8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234540:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c553ba lrc: 0/0,0 mode: --/PW res: [0x2bf8c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234543:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c553c1 lrc: 0/0,0 mode: --/PW res: [0x2bf8e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.234556:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.234568:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946810176 00000100:00100000:1.0:1651529917.234575:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.234575:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 588 00000100:00100000:0.0:1651529917.234577:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+63:39029:x1731745946810176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.234587:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180112 count 1 00002000:00010000:0.0:1651529917.234592:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf90:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.234594:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c553c8 lrc: 3/0,1 mode: --/PW res: [0x2bf90:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234597:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.234598:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.234599:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c553c8 lrc: 3/0,1 mode: PW/PW res: [0x2bf90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234603:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c553c8 lrc: 3/0,1 mode: PW/PW res: [0x2bf90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234605:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c553c8 lrc: 3/0,1 mode: PW/PW res: [0x2bf90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234608:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c553c8 lrc: 2/0,0 mode: PW/PW res: [0x2bf90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.234650:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+64:39029:x1731745946810176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 72us (93us total) trans 21474837039 rc 0/0 00000100:00100000:0.0:1651529917.234653:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 588 00000100:00100000:0.0:1651529917.234657:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946810240 00000100:00100000:0.0:1651529917.234665:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 589 00000100:00100000:0.0:1651529917.234666:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+64:39030:x1731745946810240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.234687:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180113 count 1 00002000:00010000:0.0:1651529917.234693:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf91:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.234695:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c553cf lrc: 3/0,1 mode: --/PW res: [0x2bf91:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234699:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.234699:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.234700:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c553cf lrc: 3/0,1 mode: PW/PW res: [0x2bf91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234704:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c553cf lrc: 3/0,1 mode: PW/PW res: [0x2bf91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234707:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c553cf lrc: 3/0,1 mode: PW/PW res: [0x2bf91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234709:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c553cf lrc: 2/0,0 mode: PW/PW res: [0x2bf91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.234752:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+65:39030:x1731745946810240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 85us (176us total) trans 21474837040 rc 0/0 00000100:00100000:0.0:1651529917.234755:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 589 00010000:00010000:0.0:1651529917.234763:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c553c8 lrc: 2/0,0 mode: PW/PW res: [0x2bf90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234767:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000baeec0a3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.234768:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c553c8 lrc: 2/0,0 mode: PW/PW res: [0x2bf90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234771:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c553c8 lrc: 3/0,0 mode: PW/PW res: [0x2bf90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234776:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c553c8 lrc: 1/0,0 mode: --/PW res: [0x2bf90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234779:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c553c8 lrc: 0/0,0 mode: --/PW res: [0x2bf90:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234783:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c553cf lrc: 2/0,0 mode: PW/PW res: [0x2bf91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234806:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004f367ded already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.234807:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c553cf lrc: 2/0,0 mode: PW/PW res: [0x2bf91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234810:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c553cf lrc: 3/0,0 mode: PW/PW res: [0x2bf91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234814:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c553cf lrc: 1/0,0 mode: --/PW res: [0x2bf91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234816:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c553cf lrc: 0/0,0 mode: --/PW res: [0x2bf91:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.234824:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.234834:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946810880 00000100:00100000:1.0:1651529917.234835:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.234845:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.234845:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946810816 00000100:00100000:1.0:1651529917.234852:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946811008 00000100:00100000:1.0:1651529917.234858:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 590 00000100:00100000:1.0:1651529917.234860:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+67:39030:x1731745946810880:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.234871:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180115 count 1 00000100:00100000:0.0:1651529917.234876:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 591 00002000:00010000:1.0:1651529917.234877:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf93:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1651529917.234878:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+67:39030:x1731745946810816:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529917.234879:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c553d6 lrc: 3/0,1 mode: --/PW res: [0x2bf93:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234882:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.234883:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.234884:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c553d6 lrc: 3/0,1 mode: PW/PW res: [0x2bf93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.234885:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180114 count 1 00010000:00010000:1.0:1651529917.234888:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c553d6 lrc: 3/0,1 mode: PW/PW res: [0x2bf93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234891:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c553d6 lrc: 3/0,1 mode: PW/PW res: [0x2bf93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.234891:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf92:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.234892:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c553dd lrc: 3/0,1 mode: --/PW res: [0x2bf92:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234893:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c553d6 lrc: 2/0,0 mode: PW/PW res: [0x2bf93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234896:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.234896:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.234897:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c553dd lrc: 3/0,1 mode: PW/PW res: [0x2bf92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234901:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c553dd lrc: 3/0,1 mode: PW/PW res: [0x2bf92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234904:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c553dd lrc: 3/0,1 mode: PW/PW res: [0x2bf92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234907:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c553dd lrc: 2/0,0 mode: PW/PW res: [0x2bf92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.234934:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+69:39030:x1731745946810880:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 73us (109us total) trans 21474837041 rc 0/0 00000100:00100000:1.0:1651529917.234937:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 590 00000100:00100000:1.0:1651529917.234943:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 592 00000100:00100000:1.0:1651529917.234944:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+68:39030:x1731745946811008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529917.234947:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+68:39030:x1731745946810816:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 68us (111us total) trans 21474837042 rc 0/0 00002000:00080000:1.0:1651529917.234949:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180117 count 1 00002000:00010000:1.0:1651529917.234954:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf95:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.234955:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c553e4 lrc: 3/0,1 mode: --/PW res: [0x2bf95:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234959:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.234959:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.234960:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c553e4 lrc: 3/0,1 mode: PW/PW res: [0x2bf95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234964:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c553e4 lrc: 3/0,1 mode: PW/PW res: [0x2bf95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.234964:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 591 00010000:00010000:1.0:1651529917.234967:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c553e4 lrc: 3/0,1 mode: PW/PW res: [0x2bf95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.234970:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c553e4 lrc: 2/0,0 mode: PW/PW res: [0x2bf95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234973:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c553d6 lrc: 2/0,0 mode: PW/PW res: [0x2bf93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234976:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009882f227 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.234983:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c553d6 lrc: 2/0,0 mode: PW/PW res: [0x2bf93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234988:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c553d6 lrc: 3/0,0 mode: PW/PW res: [0x2bf93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234993:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c553d6 lrc: 1/0,0 mode: --/PW res: [0x2bf93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.234996:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c553d6 lrc: 0/0,0 mode: --/PW res: [0x2bf93:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235000:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c553dd lrc: 2/0,0 mode: PW/PW res: [0x2bf92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235003:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001ea46bb1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.235004:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c553dd lrc: 2/0,0 mode: PW/PW res: [0x2bf92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235007:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c553dd lrc: 3/0,0 mode: PW/PW res: [0x2bf92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235010:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c553dd lrc: 1/0,0 mode: --/PW res: [0x2bf92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.235011:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+68:39030:x1731745946811008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 66us (166us total) trans 21474837043 rc 0/0 00010000:00010000:0.0:1651529917.235012:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c553dd lrc: 0/0,0 mode: --/PW res: [0x2bf92:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.235014:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 592 00010000:00010000:0.0:1651529917.235016:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c553e4 lrc: 2/0,0 mode: PW/PW res: [0x2bf95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235019:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002d7487dc already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.235020:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c553e4 lrc: 2/0,0 mode: PW/PW res: [0x2bf95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235022:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c553e4 lrc: 3/0,0 mode: PW/PW res: [0x2bf95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235025:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c553e4 lrc: 1/0,0 mode: --/PW res: [0x2bf95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235028:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c553e4 lrc: 0/0,0 mode: --/PW res: [0x2bf95:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.235057:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.235067:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946811136 00000100:00100000:1.0:1651529917.235073:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.235084:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946810944 00000100:00100000:0.0:1651529917.235089:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 593 00000100:00100000:0.0:1651529917.235091:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ffcc974c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+69:39030:x1731745946811136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529917.235093:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529917.235096:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180119 count 1 00002000:00010000:0.0:1651529917.235101:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf97:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.235103:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c553eb lrc: 3/0,1 mode: --/PW res: [0x2bf97:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235106:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.235107:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.235108:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c553eb lrc: 3/0,1 mode: PW/PW res: [0x2bf97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235114:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c553eb lrc: 3/0,1 mode: PW/PW res: [0x2bf97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235117:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c553eb lrc: 3/0,1 mode: PW/PW res: [0x2bf97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.235119:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.235119:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c553eb lrc: 2/0,0 mode: PW/PW res: [0x2bf97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.235125:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529917.235135:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c553eb lrc: 2/0,0 mode: PW/PW res: [0x2bf97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235139:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2d8d18b already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.235140:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c553eb lrc: 2/0,0 mode: PW/PW res: [0x2bf97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235143:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c553eb lrc: 3/0,0 mode: PW/PW res: [0x2bf97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235148:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c553eb lrc: 1/0,0 mode: --/PW res: [0x2bf97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235151:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c553eb lrc: 0/0,0 mode: --/PW res: [0x2bf97:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.235159:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946811072 00000100:00100000:0.0:1651529917.235166:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ffcc974c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+71:39030:x1731745946811136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 74us (109us total) trans 21474837044 rc 0/0 00000100:00100000:1.0:1651529917.235170:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946811200 00000100:00100000:1.0:1651529917.235173:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946811264 00000100:00100000:1.0:1651529917.235175:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 594 00000100:00100000:1.0:1651529917.235177:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9e74b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+73:39030:x1731745946810944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.235182:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180116 count 1 00000100:00100000:0.0:1651529917.235183:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 593 00002000:00010000:1.0:1651529917.235188:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf94:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.235189:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0382f56/0x3234de053c553f2 lrc: 3/0,1 mode: --/PW res: [0x2bf94:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.235189:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 595 00000100:00100000:0.0:1651529917.235191:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054ed0749 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+72:39030:x1731745946811072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529917.235193:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.235193:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.235194:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0382f56/0x3234de053c553f2 lrc: 3/0,1 mode: PW/PW res: [0x2bf94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.235196:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180118 count 1 00010000:00010000:1.0:1651529917.235198:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0382f56/0x3234de053c553f2 lrc: 3/0,1 mode: PW/PW res: [0x2bf94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235201:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0382f56/0x3234de053c553f2 lrc: 3/0,1 mode: PW/PW res: [0x2bf94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.235201:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf96:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.235203:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0382f56/0x3234de053c553f2 lrc: 2/0,0 mode: PW/PW res: [0x2bf94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235203:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c553f9 lrc: 3/0,1 mode: --/PW res: [0x2bf96:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235206:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.235207:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.235208:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c553f9 lrc: 3/0,1 mode: PW/PW res: [0x2bf96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235219:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c553f9 lrc: 3/0,1 mode: PW/PW res: [0x2bf96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235244:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c553f9 lrc: 3/0,1 mode: PW/PW res: [0x2bf96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235247:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c553f9 lrc: 2/0,0 mode: PW/PW res: [0x2bf96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.235266:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9e74b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+74:39030:x1731745946810944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 88us (193us total) trans 21474837045 rc 0/0 00000100:00100000:1.0:1651529917.235269:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 594 00000100:00100000:1.0:1651529917.235274:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 596 00000100:00100000:1.0:1651529917.235276:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057d84ac9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+73:39030:x1731745946811200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.235280:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180120 count 1 00002000:00010000:1.0:1651529917.235285:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf98:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.235287:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c55400 lrc: 3/0,1 mode: --/PW res: [0x2bf98:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235298:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.235299:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.235300:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c55400 lrc: 3/0,1 mode: PW/PW res: [0x2bf98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235304:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c55400 lrc: 3/0,1 mode: PW/PW res: [0x2bf98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235315:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c55400 lrc: 3/0,1 mode: PW/PW res: [0x2bf98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.235316:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054ed0749 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+73:39030:x1731745946811072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 124us (223us total) trans 21474837046 rc 0/0 00010000:00010000:1.0:1651529917.235318:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c55400 lrc: 2/0,0 mode: PW/PW res: [0x2bf98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.235319:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 595 00000100:00100000:0.0:1651529917.235325:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 597 00000100:00100000:0.0:1651529917.235326:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a8bb9985 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+72:39029:x1731745946811264:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.235331:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180121 count 1 00002000:00010000:0.0:1651529917.235336:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf99:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.235338:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c55407 lrc: 3/0,1 mode: --/PW res: [0x2bf99:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235342:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.235342:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.235343:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c55407 lrc: 3/0,1 mode: PW/PW res: [0x2bf99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235347:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c55407 lrc: 3/0,1 mode: PW/PW res: [0x2bf99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235350:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c55407 lrc: 3/0,1 mode: PW/PW res: [0x2bf99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.235355:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057d84ac9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+73:39030:x1731745946811200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 78us (236us total) trans 21474837047 rc 0/0 00010000:00010000:0.0:1651529917.235355:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c55407 lrc: 2/0,0 mode: PW/PW res: [0x2bf99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.235358:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 596 00010000:00010000:1.0:1651529917.235365:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0382f56/0x3234de053c553f2 lrc: 2/0,0 mode: PW/PW res: [0x2bf94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235369:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b0382f56 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.235370:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0382f56/0x3234de053c553f2 lrc: 2/0,0 mode: PW/PW res: [0x2bf94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235373:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0382f56/0x3234de053c553f2 lrc: 3/0,0 mode: PW/PW res: [0x2bf94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235377:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0382f56/0x3234de053c553f2 lrc: 1/0,0 mode: --/PW res: [0x2bf94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235380:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0382f56/0x3234de053c553f2 lrc: 0/0,0 mode: --/PW res: [0x2bf94:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235384:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c553f9 lrc: 2/0,0 mode: PW/PW res: [0x2bf96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235387:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2a86deb already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.235388:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c553f9 lrc: 2/0,0 mode: PW/PW res: [0x2bf96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.235390:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a8bb9985 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+73:39029:x1731745946811264:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 63us (264us total) trans 21474837048 rc 0/0 00010000:00010000:1.0:1651529917.235391:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c553f9 lrc: 3/0,0 mode: PW/PW res: [0x2bf96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.235392:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 597 00010000:00010000:1.0:1651529917.235394:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c553f9 lrc: 1/0,0 mode: --/PW res: [0x2bf96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235397:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c553f9 lrc: 0/0,0 mode: --/PW res: [0x2bf96:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235400:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c55400 lrc: 2/0,0 mode: PW/PW res: [0x2bf98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235401:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c55407 lrc: 2/0,0 mode: PW/PW res: [0x2bf99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235402:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007d55fe01 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.235403:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c55400 lrc: 2/0,0 mode: PW/PW res: [0x2bf98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235404:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000041a7efd7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.235405:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c55407 lrc: 2/0,0 mode: PW/PW res: [0x2bf99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235406:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c55400 lrc: 3/0,0 mode: PW/PW res: [0x2bf98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235408:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c55407 lrc: 3/0,0 mode: PW/PW res: [0x2bf99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235409:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c55400 lrc: 1/0,0 mode: --/PW res: [0x2bf98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235412:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c55400 lrc: 0/0,0 mode: --/PW res: [0x2bf98:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235413:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c55407 lrc: 1/0,0 mode: --/PW res: [0x2bf99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235416:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c55407 lrc: 0/0,0 mode: --/PW res: [0x2bf99:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.235426:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.235438:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946811520 00000100:00100000:1.0:1651529917.235444:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.235445:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 598 00000100:00100000:0.0:1651529917.235446:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+73:39030:x1731745946811520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529917.235457:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529917.235457:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180122 count 1 00002000:00010000:0.0:1651529917.235462:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf9a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.235464:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c5540e lrc: 3/0,1 mode: --/PW res: [0x2bf9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235467:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.235468:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.235469:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c5540e lrc: 3/0,1 mode: PW/PW res: [0x2bf9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235472:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c5540e lrc: 3/0,1 mode: PW/PW res: [0x2bf9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235475:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c5540e lrc: 3/0,1 mode: PW/PW res: [0x2bf9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235478:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c5540e lrc: 2/0,0 mode: PW/PW res: [0x2bf9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.235523:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+74:39030:x1731745946811520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 75us (96us total) trans 21474837049 rc 0/0 00000100:00100000:0.0:1651529917.235526:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 598 00010000:00010000:1.0:1651529917.235527:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c5540e lrc: 2/0,0 mode: PW/PW res: [0x2bf9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235531:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000029e40f3d already unused, calling callback (0000000049fddea7) 00000100:00100000:0.0:1651529917.235531:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946811584 00010000:00010000:1.0:1651529917.235532:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c5540e lrc: 2/0,0 mode: PW/PW res: [0x2bf9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.235534:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946811648 00010000:00010000:1.0:1651529917.235535:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c5540e lrc: 3/0,0 mode: PW/PW res: [0x2bf9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.235537:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 599 00000100:00100000:0.0:1651529917.235539:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e093a181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+75:39029:x1731745946811584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529917.235540:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c5540e lrc: 1/0,0 mode: --/PW res: [0x2bf9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235543:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c5540e lrc: 0/0,0 mode: --/PW res: [0x2bf9a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.235543:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180123 count 1 00002000:00010000:0.0:1651529917.235548:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf9b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.235549:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c55415 lrc: 3/0,1 mode: --/PW res: [0x2bf9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235553:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.235554:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.235554:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c55415 lrc: 3/0,1 mode: PW/PW res: [0x2bf9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235558:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c55415 lrc: 3/0,1 mode: PW/PW res: [0x2bf9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235561:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c55415 lrc: 3/0,1 mode: PW/PW res: [0x2bf9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.235573:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 600 00000100:00100000:1.0:1651529917.235575:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054267da8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+75:39030:x1731745946811648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.235580:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180124 count 1 00010000:00010000:0.0:1651529917.235582:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c55415 lrc: 2/0,0 mode: PW/PW res: [0x2bf9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.235586:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf9c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.235587:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067d657cd/0x3234de053c5541c lrc: 3/0,1 mode: --/PW res: [0x2bf9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235593:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.235594:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.235595:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067d657cd/0x3234de053c5541c lrc: 3/0,1 mode: PW/PW res: [0x2bf9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235598:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067d657cd/0x3234de053c5541c lrc: 3/0,1 mode: PW/PW res: [0x2bf9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235601:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067d657cd/0x3234de053c5541c lrc: 3/0,1 mode: PW/PW res: [0x2bf9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235604:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067d657cd/0x3234de053c5541c lrc: 2/0,0 mode: PW/PW res: [0x2bf9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.235634:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e093a181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+77:39029:x1731745946811584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 93us (189us total) trans 21474837050 rc 0/0 00000100:00100000:0.0:1651529917.235636:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 599 00010000:00010000:0.0:1651529917.235645:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c55415 lrc: 2/0,0 mode: PW/PW res: [0x2bf9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235648:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fcafd1a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.235649:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c55415 lrc: 2/0,0 mode: PW/PW res: [0x2bf9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235652:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c55415 lrc: 3/0,0 mode: PW/PW res: [0x2bf9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.235654:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054267da8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+76:39030:x1731745946811648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 78us (197us total) trans 21474837051 rc 0/0 00000100:00100000:1.0:1651529917.235657:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 600 00010000:00010000:0.0:1651529917.235659:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c55415 lrc: 1/0,0 mode: --/PW res: [0x2bf9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235662:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c55415 lrc: 0/0,0 mode: --/PW res: [0x2bf9b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235666:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067d657cd/0x3234de053c5541c lrc: 2/0,0 mode: PW/PW res: [0x2bf9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235669:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067d657cd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.235670:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067d657cd/0x3234de053c5541c lrc: 2/0,0 mode: PW/PW res: [0x2bf9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235672:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067d657cd/0x3234de053c5541c lrc: 3/0,0 mode: PW/PW res: [0x2bf9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235676:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067d657cd/0x3234de053c5541c lrc: 1/0,0 mode: --/PW res: [0x2bf9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235678:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067d657cd/0x3234de053c5541c lrc: 0/0,0 mode: --/PW res: [0x2bf9c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.235716:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.235727:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.235731:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946812288 00000100:00100000:0.0:1651529917.235738:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946812416 00000100:00100000:0.0:1651529917.235742:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 601 00000100:00100000:0.0:1651529917.235744:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004e83cb77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+77:39030:x1731745946812288:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529917.235750:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529917.235750:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180126 count 1 00002000:00010000:0.0:1651529917.235755:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf9e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529917.235756:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.235756:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c55423 lrc: 3/0,1 mode: --/PW res: [0x2bf9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235760:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.235761:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.235761:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c55423 lrc: 3/0,1 mode: PW/PW res: [0x2bf9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.235762:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946812224 00010000:00010000:0.0:1651529917.235765:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c55423 lrc: 3/0,1 mode: PW/PW res: [0x2bf9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.235767:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946812352 00010000:00010000:0.0:1651529917.235768:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c55423 lrc: 3/0,1 mode: PW/PW res: [0x2bf9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.235770:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 602 00010000:00010000:0.0:1651529917.235771:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c55423 lrc: 2/0,0 mode: PW/PW res: [0x2bf9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.235772:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+79:39030:x1731745946812416:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.235777:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180128 count 1 00002000:00010000:1.0:1651529917.235782:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfa0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.235784:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000990cd87d/0x3234de053c5542a lrc: 3/0,1 mode: --/PW res: [0x2bfa0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235788:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.235795:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.235801:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000990cd87d/0x3234de053c5542a lrc: 3/0,1 mode: PW/PW res: [0x2bfa0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235805:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000990cd87d/0x3234de053c5542a lrc: 3/0,1 mode: PW/PW res: [0x2bfa0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235808:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000990cd87d/0x3234de053c5542a lrc: 3/0,1 mode: PW/PW res: [0x2bfa0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235811:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000990cd87d/0x3234de053c5542a lrc: 2/0,0 mode: PW/PW res: [0x2bfa0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.235843:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004e83cb77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+81:39030:x1731745946812288:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 99us (127us total) trans 21474837052 rc 0/0 00000100:00100000:0.0:1651529917.235846:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 601 00000100:00100000:0.0:1651529917.235852:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 603 00000100:00100000:0.0:1651529917.235853:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000081a471dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+80:39029:x1731745946812224:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529917.235858:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+80:39030:x1731745946812416:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 85us (131us total) trans 21474837053 rc 0/0 00002000:00080000:0.0:1651529917.235858:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180125 count 1 00000100:00100000:1.0:1651529917.235861:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 602 00002000:00010000:0.0:1651529917.235863:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf9d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.235865:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c55431 lrc: 3/0,1 mode: --/PW res: [0x2bf9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.235866:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 604 00000100:00100000:1.0:1651529917.235868:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6309896 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+79:39029:x1731745946812352:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.235872:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180127 count 1 00002000:00010000:1.0:1651529917.235877:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bf9f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.235878:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be333df1/0x3234de053c55438 lrc: 3/0,1 mode: --/PW res: [0x2bf9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235882:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.235883:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.235884:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be333df1/0x3234de053c55438 lrc: 3/0,1 mode: PW/PW res: [0x2bf9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235887:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be333df1/0x3234de053c55438 lrc: 3/0,1 mode: PW/PW res: [0x2bf9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235894:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.235894:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.235895:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c55431 lrc: 3/0,1 mode: PW/PW res: [0x2bf9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235899:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c55431 lrc: 3/0,1 mode: PW/PW res: [0x2bf9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235900:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be333df1/0x3234de053c55438 lrc: 3/0,1 mode: PW/PW res: [0x2bf9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235902:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be333df1/0x3234de053c55438 lrc: 2/0,0 mode: PW/PW res: [0x2bf9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235902:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c55431 lrc: 3/0,1 mode: PW/PW res: [0x2bf9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235905:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c55431 lrc: 2/0,0 mode: PW/PW res: [0x2bf9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.235941:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6309896 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+81:39029:x1731745946812352:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 73us (184us total) trans 21474837054 rc 0/0 00000100:00100000:1.0:1651529917.235944:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 604 00010000:00010000:1.0:1651529917.235951:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c55423 lrc: 2/0,0 mode: PW/PW res: [0x2bf9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.235951:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000081a471dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+80:39029:x1731745946812224:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 97us (208us total) trans 21474837055 rc 0/0 00010000:00010000:1.0:1651529917.235954:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054295afd already unused, calling callback (0000000049fddea7) 00000100:00100000:0.0:1651529917.235954:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 603 00010000:00010000:1.0:1651529917.235955:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c55423 lrc: 2/0,0 mode: PW/PW res: [0x2bf9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235958:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c55423 lrc: 3/0,0 mode: PW/PW res: [0x2bf9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235962:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000990cd87d/0x3234de053c5542a lrc: 2/0,0 mode: PW/PW res: [0x2bfa0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235963:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c55423 lrc: 1/0,0 mode: --/PW res: [0x2bf9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235966:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000990cd87d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.235967:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000990cd87d/0x3234de053c5542a lrc: 2/0,0 mode: PW/PW res: [0x2bfa0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235968:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c55423 lrc: 0/0,0 mode: --/PW res: [0x2bf9e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235970:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000990cd87d/0x3234de053c5542a lrc: 3/0,0 mode: PW/PW res: [0x2bfa0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235973:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be333df1/0x3234de053c55438 lrc: 2/0,0 mode: PW/PW res: [0x2bf9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235975:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000be333df1 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.235976:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be333df1/0x3234de053c55438 lrc: 2/0,0 mode: PW/PW res: [0x2bf9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235977:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000990cd87d/0x3234de053c5542a lrc: 1/0,0 mode: --/PW res: [0x2bfa0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235979:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be333df1/0x3234de053c55438 lrc: 3/0,0 mode: PW/PW res: [0x2bf9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235980:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000990cd87d/0x3234de053c5542a lrc: 0/0,0 mode: --/PW res: [0x2bfa0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235982:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be333df1/0x3234de053c55438 lrc: 1/0,0 mode: --/PW res: [0x2bf9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235984:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c55431 lrc: 2/0,0 mode: PW/PW res: [0x2bf9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.235985:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be333df1/0x3234de053c55438 lrc: 0/0,0 mode: --/PW res: [0x2bf9f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235987:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005532ef34 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.235988:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c55431 lrc: 2/0,0 mode: PW/PW res: [0x2bf9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235990:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c55431 lrc: 3/0,0 mode: PW/PW res: [0x2bf9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235994:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c55431 lrc: 1/0,0 mode: --/PW res: [0x2bf9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.235996:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c55431 lrc: 0/0,0 mode: --/PW res: [0x2bf9d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.235998:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.236013:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946812480 00000100:00100000:1.0:1651529917.236015:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.236028:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946812544 00000100:00100000:0.0:1651529917.236032:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 605 00000100:00100000:1.0:1651529917.236033:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.236034:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000362c2e4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+81:39029:x1731745946812480:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.236048:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180129 count 1 00002000:00010000:0.0:1651529917.236054:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfa1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.236056:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c5543f lrc: 3/0,1 mode: --/PW res: [0x2bfa1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236059:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.236060:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.236060:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c5543f lrc: 3/0,1 mode: PW/PW res: [0x2bfa1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236064:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c5543f lrc: 3/0,1 mode: PW/PW res: [0x2bfa1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236067:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c5543f lrc: 3/0,1 mode: PW/PW res: [0x2bfa1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236070:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c5543f lrc: 2/0,0 mode: PW/PW res: [0x2bfa1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.236072:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529917.236102:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c5543f lrc: 2/0,0 mode: PW/PW res: [0x2bfa1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236105:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000820e2b3d already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.236107:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c5543f lrc: 2/0,0 mode: PW/PW res: [0x2bfa1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236110:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c5543f lrc: 3/0,0 mode: PW/PW res: [0x2bfa1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.236114:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000362c2e4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+82:39029:x1731745946812480:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 79us (115us total) trans 21474837056 rc 0/0 00000100:00100000:0.0:1651529917.236117:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 605 00010000:00010000:1.0:1651529917.236119:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c5543f lrc: 1/0,0 mode: --/PW res: [0x2bfa1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236122:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c5543f lrc: 0/0,0 mode: --/PW res: [0x2bfa1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.236122:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946812672 00000100:00100000:0.0:1651529917.236125:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946812608 00000100:00100000:0.0:1651529917.236129:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 606 00000100:00100000:0.0:1651529917.236130:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+83:39029:x1731745946812544:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.236135:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180130 count 1 00000100:00100000:1.0:1651529917.236156:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 607 00002000:00010000:0.0:1651529917.236156:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfa2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529917.236158:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdd939a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+83:39030:x1731745946812672:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529917.236158:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c55446 lrc: 3/0,1 mode: --/PW res: [0x2bfa2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236162:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.236162:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1651529917.236163:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180132 count 1 00010000:00010000:0.0:1651529917.236163:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c55446 lrc: 3/0,1 mode: PW/PW res: [0x2bfa2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236167:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c55446 lrc: 3/0,1 mode: PW/PW res: [0x2bfa2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.236169:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfa4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.236170:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c55446 lrc: 3/0,1 mode: PW/PW res: [0x2bfa2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236171:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c1cdcb2/0x3234de053c5544d lrc: 3/0,1 mode: --/PW res: [0x2bfa4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236173:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c55446 lrc: 2/0,0 mode: PW/PW res: [0x2bfa2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236174:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.236175:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.236176:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c1cdcb2/0x3234de053c5544d lrc: 3/0,1 mode: PW/PW res: [0x2bfa4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236179:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c1cdcb2/0x3234de053c5544d lrc: 3/0,1 mode: PW/PW res: [0x2bfa4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236182:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c1cdcb2/0x3234de053c5544d lrc: 3/0,1 mode: PW/PW res: [0x2bfa4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236186:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c1cdcb2/0x3234de053c5544d lrc: 2/0,0 mode: PW/PW res: [0x2bfa4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.236232:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+85:39029:x1731745946812544:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 100us (216us total) trans 21474837057 rc 0/0 00000100:00100000:0.0:1651529917.236235:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 606 00000100:00100000:0.0:1651529917.236245:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 608 00000100:00100000:0.0:1651529917.236247:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002db8a000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+84:39030:x1731745946812608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.236252:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180131 count 1 00000100:00100000:1.0:1651529917.236253:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdd939a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+84:39030:x1731745946812672:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 94us (219us total) trans 21474837058 rc 0/0 00000100:00100000:1.0:1651529917.236256:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 607 00002000:00010000:0.0:1651529917.236257:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfa3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.236258:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ba8c2cb/0x3234de053c55454 lrc: 3/0,1 mode: --/PW res: [0x2bfa3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236262:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.236263:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.236264:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ba8c2cb/0x3234de053c55454 lrc: 3/0,1 mode: PW/PW res: [0x2bfa3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236267:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ba8c2cb/0x3234de053c55454 lrc: 3/0,1 mode: PW/PW res: [0x2bfa3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236270:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ba8c2cb/0x3234de053c55454 lrc: 3/0,1 mode: PW/PW res: [0x2bfa3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236273:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ba8c2cb/0x3234de053c55454 lrc: 2/0,0 mode: PW/PW res: [0x2bfa3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236298:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c55446 lrc: 2/0,0 mode: PW/PW res: [0x2bfa2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236302:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000087f212ed already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.236303:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c55446 lrc: 2/0,0 mode: PW/PW res: [0x2bfa2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236306:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c55446 lrc: 3/0,0 mode: PW/PW res: [0x2bfa2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236311:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c55446 lrc: 1/0,0 mode: --/PW res: [0x2bfa2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.236316:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002db8a000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+84:39030:x1731745946812608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 68us (244us total) trans 21474837059 rc 0/0 00010000:00010000:1.0:1651529917.236318:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c55446 lrc: 0/0,0 mode: --/PW res: [0x2bfa2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236323:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c1cdcb2/0x3234de053c5544d lrc: 2/0,0 mode: PW/PW res: [0x2bfa4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236326:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006c1cdcb2 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.236339:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c1cdcb2/0x3234de053c5544d lrc: 2/0,0 mode: PW/PW res: [0x2bfa4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.236339:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 608 00010000:00010000:1.0:1651529917.236342:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c1cdcb2/0x3234de053c5544d lrc: 3/0,0 mode: PW/PW res: [0x2bfa4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236346:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c1cdcb2/0x3234de053c5544d lrc: 1/0,0 mode: --/PW res: [0x2bfa4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236348:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c1cdcb2/0x3234de053c5544d lrc: 0/0,0 mode: --/PW res: [0x2bfa4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236351:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ba8c2cb/0x3234de053c55454 lrc: 2/0,0 mode: PW/PW res: [0x2bfa3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236354:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007ba8c2cb already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.236355:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ba8c2cb/0x3234de053c55454 lrc: 2/0,0 mode: PW/PW res: [0x2bfa3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236359:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ba8c2cb/0x3234de053c55454 lrc: 3/0,0 mode: PW/PW res: [0x2bfa3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.236363:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.236363:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ba8c2cb/0x3234de053c55454 lrc: 1/0,0 mode: --/PW res: [0x2bfa3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236374:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ba8c2cb/0x3234de053c55454 lrc: 0/0,0 mode: --/PW res: [0x2bfa3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.236382:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946813056 00000100:00100000:0.0:1651529917.236388:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 609 00000100:00100000:0.0:1651529917.236390:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009f35d921 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+84:39030:x1731745946813056:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.236395:0:166112:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180133 count 1 00000100:00100000:1.0:1651529917.236398:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00010000:0.0:1651529917.236400:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfa5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.236401:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c5545b lrc: 3/0,1 mode: --/PW res: [0x2bfa5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236404:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.236405:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.236406:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c5545b lrc: 3/0,1 mode: PW/PW res: [0x2bfa5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.236407:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946813120 00010000:00010000:0.0:1651529917.236410:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c5545b lrc: 3/0,1 mode: PW/PW res: [0x2bfa5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.236413:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 610 00010000:00010000:0.0:1651529917.236413:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c5545b lrc: 3/0,1 mode: PW/PW res: [0x2bfa5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.236415:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+85:39029:x1731745946813120:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529917.236415:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c5545b lrc: 2/0,0 mode: PW/PW res: [0x2bfa5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.236420:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180134 count 1 00002000:00010000:1.0:1651529917.236432:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfa6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.236434:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cab45436/0x3234de053c55462 lrc: 3/0,1 mode: --/PW res: [0x2bfa6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236438:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.236438:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.236439:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cab45436/0x3234de053c55462 lrc: 3/0,1 mode: PW/PW res: [0x2bfa6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236443:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cab45436/0x3234de053c55462 lrc: 3/0,1 mode: PW/PW res: [0x2bfa6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236449:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cab45436/0x3234de053c55462 lrc: 3/0,1 mode: PW/PW res: [0x2bfa6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236451:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cab45436/0x3234de053c55462 lrc: 2/0,0 mode: PW/PW res: [0x2bfa6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.236497:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009f35d921 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+87:39030:x1731745946813056:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 106us (133us total) trans 21474837060 rc 0/0 00000100:00100000:1.0:1651529917.236504:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+87:39029:x1731745946813120:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 88us (106us total) trans 21474837061 rc 0/0 00000100:00100000:1.0:1651529917.236507:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 610 00000100:00100000:0.0:1651529917.236511:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 609 00010000:00010000:1.0:1651529917.236514:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c5545b lrc: 2/0,0 mode: PW/PW res: [0x2bfa5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236517:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f10dea8 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.236518:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c5545b lrc: 2/0,0 mode: PW/PW res: [0x2bfa5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236519:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cab45436/0x3234de053c55462 lrc: 2/0,0 mode: PW/PW res: [0x2bfa6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236521:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c5545b lrc: 3/0,0 mode: PW/PW res: [0x2bfa5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236523:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cab45436 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.236524:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cab45436/0x3234de053c55462 lrc: 2/0,0 mode: PW/PW res: [0x2bfa6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236526:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c5545b lrc: 1/0,0 mode: --/PW res: [0x2bfa5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236527:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cab45436/0x3234de053c55462 lrc: 3/0,0 mode: PW/PW res: [0x2bfa6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236529:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c5545b lrc: 0/0,0 mode: --/PW res: [0x2bfa5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236531:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cab45436/0x3234de053c55462 lrc: 1/0,0 mode: --/PW res: [0x2bfa6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236534:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cab45436/0x3234de053c55462 lrc: 0/0,0 mode: --/PW res: [0x2bfa6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.236563:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.236580:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.236591:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946813312 00000100:00100000:0.0:1651529917.236597:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946813440 00000100:00100000:0.0:1651529917.236604:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 611 00000100:00100000:0.0:1651529917.236606:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+87:39030:x1731745946813312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.236611:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180135 count 1 00000100:00100000:1.0:1651529917.236615:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00010000:0.0:1651529917.236617:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfa7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.236618:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c55469 lrc: 3/0,1 mode: --/PW res: [0x2bfa7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.236621:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.236622:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.236623:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.236624:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c55469 lrc: 3/0,1 mode: PW/PW res: [0x2bfa7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.236626:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.236627:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c55469 lrc: 3/0,1 mode: PW/PW res: [0x2bfa7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236630:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c55469 lrc: 3/0,1 mode: PW/PW res: [0x2bfa7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.236631:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.236633:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c55469 lrc: 2/0,0 mode: PW/PW res: [0x2bfa7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.236638:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946813376 00000100:00100000:1.0:1651529917.236648:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946813504 00000100:00100000:1.0:1651529917.236651:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946813632 00000100:00100000:1.0:1651529917.236653:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946813696 00000100:00100000:1.0:1651529917.236656:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 612 00000100:00100000:1.0:1651529917.236657:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cb9f189a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+92:39030:x1731745946813440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.236662:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180137 count 1 00002000:00010000:1.0:1651529917.236668:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfa9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.236670:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fb54722/0x3234de053c55470 lrc: 3/0,1 mode: --/PW res: [0x2bfa9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.236676:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+92:39030:x1731745946813312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 69us (113us total) trans 21474837062 rc 0/0 00010000:00010000:1.0:1651529917.236679:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529917.236679:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 611 00010000:00010000:1.0:1651529917.236680:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.236681:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fb54722/0x3234de053c55470 lrc: 3/0,1 mode: PW/PW res: [0x2bfa9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236685:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fb54722/0x3234de053c55470 lrc: 3/0,1 mode: PW/PW res: [0x2bfa9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.236685:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 613 00000100:00100000:0.0:1651529917.236686:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+91:39029:x1731745946813376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529917.236688:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fb54722/0x3234de053c55470 lrc: 3/0,1 mode: PW/PW res: [0x2bfa9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236691:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003fb54722/0x3234de053c55470 lrc: 2/0,0 mode: PW/PW res: [0x2bfa9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.236691:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180136 count 1 00002000:00010000:0.0:1651529917.236696:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfa8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.236698:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c55477 lrc: 3/0,1 mode: --/PW res: [0x2bfa8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236708:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.236709:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.236710:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c55477 lrc: 3/0,1 mode: PW/PW res: [0x2bfa8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236714:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c55477 lrc: 3/0,1 mode: PW/PW res: [0x2bfa8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236717:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c55477 lrc: 3/0,1 mode: PW/PW res: [0x2bfa8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236720:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c55477 lrc: 2/0,0 mode: PW/PW res: [0x2bfa8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.236735:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cb9f189a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+92:39030:x1731745946813440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 77us (155us total) trans 21474837063 rc 0/0 00000100:00100000:1.0:1651529917.236738:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 612 00000100:00100000:1.0:1651529917.236755:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 614 00000100:00100000:1.0:1651529917.236757:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+92:39029:x1731745946813504:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.236762:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180138 count 1 00002000:00010000:1.0:1651529917.236774:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfaa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.236776:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c5547e lrc: 3/0,1 mode: --/PW res: [0x2bfaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.236777:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+92:39029:x1731745946813376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 89us (161us total) trans 21474837064 rc 0/0 00010000:00010000:1.0:1651529917.236780:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529917.236780:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 613 00010000:00010000:1.0:1651529917.236781:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.236781:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c5547e lrc: 3/0,1 mode: PW/PW res: [0x2bfaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236785:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c5547e lrc: 3/0,1 mode: PW/PW res: [0x2bfaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.236785:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 615 00000100:00100000:0.0:1651529917.236787:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+91:39029:x1731745946813632:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529917.236788:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c5547e lrc: 3/0,1 mode: PW/PW res: [0x2bfaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236791:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c5547e lrc: 2/0,0 mode: PW/PW res: [0x2bfaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.236791:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180139 count 1 00002000:00010000:0.0:1651529917.236796:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.236798:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c55485 lrc: 3/0,1 mode: --/PW res: [0x2bfab:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236801:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.236802:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.236803:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c55485 lrc: 3/0,1 mode: PW/PW res: [0x2bfab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236806:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c55485 lrc: 3/0,1 mode: PW/PW res: [0x2bfab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236809:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c55485 lrc: 3/0,1 mode: PW/PW res: [0x2bfab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236815:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c55485 lrc: 2/0,0 mode: PW/PW res: [0x2bfab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.236826:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+92:39029:x1731745946813504:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 68us (204us total) trans 21474837065 rc 0/0 00000100:00100000:1.0:1651529917.236830:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 614 00000100:00100000:1.0:1651529917.236836:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 616 00000100:00100000:1.0:1651529917.236837:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+92:39029:x1731745946813696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.236842:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180140 count 1 00002000:00010000:1.0:1651529917.236846:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.236848:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049d4bb9b/0x3234de053c5548c lrc: 3/0,1 mode: --/PW res: [0x2bfac:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236851:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529917.236851:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+92:39029:x1731745946813632:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 63us (224us total) trans 21474837066 rc 0/0 00010000:00010000:1.0:1651529917.236852:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.236853:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049d4bb9b/0x3234de053c5548c lrc: 3/0,1 mode: PW/PW res: [0x2bfac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.236853:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 615 00010000:00010000:1.0:1651529917.236856:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049d4bb9b/0x3234de053c5548c lrc: 3/0,1 mode: PW/PW res: [0x2bfac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236859:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049d4bb9b/0x3234de053c5548c lrc: 3/0,1 mode: PW/PW res: [0x2bfac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236861:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c55469 lrc: 2/0,0 mode: PW/PW res: [0x2bfa7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236862:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049d4bb9b/0x3234de053c5548c lrc: 2/0,0 mode: PW/PW res: [0x2bfac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236865:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f3240ce7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.236866:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c55469 lrc: 2/0,0 mode: PW/PW res: [0x2bfa7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236869:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c55469 lrc: 3/0,0 mode: PW/PW res: [0x2bfa7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236873:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c55469 lrc: 1/0,0 mode: --/PW res: [0x2bfa7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.236893:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+92:39029:x1731745946813696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 55us (262us total) trans 21474837067 rc 0/0 00000100:00100000:1.0:1651529917.236896:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 616 00010000:00010000:0.0:1651529917.236902:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c55469 lrc: 0/0,0 mode: --/PW res: [0x2bfa7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236903:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003fb54722/0x3234de053c55470 lrc: 2/0,0 mode: PW/PW res: [0x2bfa9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236907:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c55477 lrc: 2/0,0 mode: PW/PW res: [0x2bfa8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236910:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ee128d1f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.236912:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c55477 lrc: 2/0,0 mode: PW/PW res: [0x2bfa8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236915:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c55477 lrc: 3/0,0 mode: PW/PW res: [0x2bfa8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236918:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c55477 lrc: 1/0,0 mode: --/PW res: [0x2bfa8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236919:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003fb54722 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.236920:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003fb54722/0x3234de053c55470 lrc: 2/0,0 mode: PW/PW res: [0x2bfa9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236921:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c55477 lrc: 0/0,0 mode: --/PW res: [0x2bfa8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236923:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003fb54722/0x3234de053c55470 lrc: 3/0,0 mode: PW/PW res: [0x2bfa9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236924:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c5547e lrc: 2/0,0 mode: PW/PW res: [0x2bfaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236927:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e943794 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.236928:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003fb54722/0x3234de053c55470 lrc: 1/0,0 mode: --/PW res: [0x2bfa9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236928:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c5547e lrc: 2/0,0 mode: PW/PW res: [0x2bfaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236930:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fb54722/0x3234de053c55470 lrc: 0/0,0 mode: --/PW res: [0x2bfa9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236931:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c5547e lrc: 3/0,0 mode: PW/PW res: [0x2bfaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236934:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c5547e lrc: 1/0,0 mode: --/PW res: [0x2bfaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236935:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c55485 lrc: 2/0,0 mode: PW/PW res: [0x2bfab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236937:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c5547e lrc: 0/0,0 mode: --/PW res: [0x2bfaa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236938:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f149aa4b already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.236939:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c55485 lrc: 2/0,0 mode: PW/PW res: [0x2bfab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236940:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049d4bb9b/0x3234de053c5548c lrc: 2/0,0 mode: PW/PW res: [0x2bfac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236941:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c55485 lrc: 3/0,0 mode: PW/PW res: [0x2bfab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236943:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000049d4bb9b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.236944:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049d4bb9b/0x3234de053c5548c lrc: 2/0,0 mode: PW/PW res: [0x2bfac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236945:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c55485 lrc: 1/0,0 mode: --/PW res: [0x2bfab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.236947:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c55485 lrc: 0/0,0 mode: --/PW res: [0x2bfab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236947:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049d4bb9b/0x3234de053c5548c lrc: 3/0,0 mode: PW/PW res: [0x2bfac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236950:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049d4bb9b/0x3234de053c5548c lrc: 1/0,0 mode: --/PW res: [0x2bfac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.236952:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049d4bb9b/0x3234de053c5548c lrc: 0/0,0 mode: --/PW res: [0x2bfac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.236962:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.236972:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946813760 00000100:00100000:0.0:1651529917.236983:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 617 00000100:00100000:0.0:1651529917.236985:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002db8a000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+92:39030:x1731745946813760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529917.236986:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529917.236995:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180141 count 1 00002000:00010000:0.0:1651529917.237000:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.237002:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c55493 lrc: 3/0,1 mode: --/PW res: [0x2bfad:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237005:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.237005:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.237006:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c55493 lrc: 3/0,1 mode: PW/PW res: [0x2bfad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237010:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c55493 lrc: 3/0,1 mode: PW/PW res: [0x2bfad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237014:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c55493 lrc: 3/0,1 mode: PW/PW res: [0x2bfad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237016:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c55493 lrc: 2/0,0 mode: PW/PW res: [0x2bfad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237062:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c55493 lrc: 2/0,0 mode: PW/PW res: [0x2bfad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.237069:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002db8a000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+93:39030:x1731745946813760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 83us (107us total) trans 21474837068 rc 0/0 00010000:00010000:1.0:1651529917.237071:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032eb11d3 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.237072:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c55493 lrc: 2/0,0 mode: PW/PW res: [0x2bfad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.237072:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 617 00010000:00010000:1.0:1651529917.237075:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c55493 lrc: 3/0,0 mode: PW/PW res: [0x2bfad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.237077:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946814144 00010000:00010000:1.0:1651529917.237080:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c55493 lrc: 1/0,0 mode: --/PW res: [0x2bfad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237082:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c55493 lrc: 0/0,0 mode: --/PW res: [0x2bfad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.237083:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 618 00000100:00100000:0.0:1651529917.237085:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+93:39030:x1731745946814144:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.237089:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180142 count 1 00002000:00010000:0.0:1651529917.237094:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.237096:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c5549a lrc: 3/0,1 mode: --/PW res: [0x2bfae:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237099:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.237100:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.237101:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c5549a lrc: 3/0,1 mode: PW/PW res: [0x2bfae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237104:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c5549a lrc: 3/0,1 mode: PW/PW res: [0x2bfae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237107:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c5549a lrc: 3/0,1 mode: PW/PW res: [0x2bfae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237111:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c5549a lrc: 2/0,0 mode: PW/PW res: [0x2bfae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.237173:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+94:39030:x1731745946814144:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 87us (192us total) trans 21474837069 rc 0/0 00000100:00100000:0.0:1651529917.237176:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 618 00010000:00010000:0.0:1651529917.237184:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c5549a lrc: 2/0,0 mode: PW/PW res: [0x2bfae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237188:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005c863cd2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.237189:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c5549a lrc: 2/0,0 mode: PW/PW res: [0x2bfae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237192:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c5549a lrc: 3/0,0 mode: PW/PW res: [0x2bfae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237196:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c5549a lrc: 1/0,0 mode: --/PW res: [0x2bfae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237199:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c5549a lrc: 0/0,0 mode: --/PW res: [0x2bfae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.237285:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.237296:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.237296:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946814464 00000100:00100000:1.0:1651529917.237305:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.237308:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946814528 00000100:00100000:0.0:1651529917.237311:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946814400 00000100:00100000:1.0:1651529917.237313:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 619 00000100:00100000:1.0:1651529917.237315:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009f35d921 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+96:39030:x1731745946814464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529917.237316:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 620 00000100:00100000:0.0:1651529917.237318:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+96:39029:x1731745946814528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.237321:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180144 count 1 00002000:00080000:0.0:1651529917.237323:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180145 count 1 00002000:00010000:1.0:1651529917.237326:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfb0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.237328:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059de8c3d/0x3234de053c554a1 lrc: 3/0,1 mode: --/PW res: [0x2bfb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.237329:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfb1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.237330:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c554a8 lrc: 3/0,1 mode: --/PW res: [0x2bfb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237332:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.237333:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.237334:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059de8c3d/0x3234de053c554a1 lrc: 3/0,1 mode: PW/PW res: [0x2bfb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237337:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059de8c3d/0x3234de053c554a1 lrc: 3/0,1 mode: PW/PW res: [0x2bfb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237340:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059de8c3d/0x3234de053c554a1 lrc: 3/0,1 mode: PW/PW res: [0x2bfb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237343:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059de8c3d/0x3234de053c554a1 lrc: 2/0,0 mode: PW/PW res: [0x2bfb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237360:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.237360:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.237361:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c554a8 lrc: 3/0,1 mode: PW/PW res: [0x2bfb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237366:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c554a8 lrc: 3/0,1 mode: PW/PW res: [0x2bfb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237369:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c554a8 lrc: 3/0,1 mode: PW/PW res: [0x2bfb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237372:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c554a8 lrc: 2/0,0 mode: PW/PW res: [0x2bfb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.237397:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009f35d921 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+98:39030:x1731745946814464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 81us (112us total) trans 21474837070 rc 0/0 00000100:00100000:1.0:1651529917.237400:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 619 00000100:00100000:1.0:1651529917.237405:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 621 00000100:00100000:1.0:1651529917.237407:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+97:39030:x1731745946814400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.237412:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180143 count 1 00000100:00100000:0.0:1651529917.237414:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+97:39029:x1731745946814528:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 96us (118us total) trans 21474837071 rc 0/0 00002000:00010000:1.0:1651529917.237416:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfaf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1651529917.237417:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 620 00010000:00010000:1.0:1651529917.237418:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007126e775/0x3234de053c554af lrc: 3/0,1 mode: --/PW res: [0x2bfaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237421:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.237422:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.237423:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007126e775/0x3234de053c554af lrc: 3/0,1 mode: PW/PW res: [0x2bfaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237426:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059de8c3d/0x3234de053c554a1 lrc: 2/0,0 mode: PW/PW res: [0x2bfb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237427:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007126e775/0x3234de053c554af lrc: 3/0,1 mode: PW/PW res: [0x2bfaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237429:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000059de8c3d already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.237430:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007126e775/0x3234de053c554af lrc: 3/0,1 mode: PW/PW res: [0x2bfaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237430:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059de8c3d/0x3234de053c554a1 lrc: 2/0,0 mode: PW/PW res: [0x2bfb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237432:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007126e775/0x3234de053c554af lrc: 2/0,0 mode: PW/PW res: [0x2bfaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237435:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059de8c3d/0x3234de053c554a1 lrc: 3/0,0 mode: PW/PW res: [0x2bfb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237447:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059de8c3d/0x3234de053c554a1 lrc: 1/0,0 mode: --/PW res: [0x2bfb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237449:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059de8c3d/0x3234de053c554a1 lrc: 0/0,0 mode: --/PW res: [0x2bfb0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237454:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c554a8 lrc: 2/0,0 mode: PW/PW res: [0x2bfb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237457:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001644aaad already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.237458:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c554a8 lrc: 2/0,0 mode: PW/PW res: [0x2bfb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237460:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c554a8 lrc: 3/0,0 mode: PW/PW res: [0x2bfb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237464:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c554a8 lrc: 1/0,0 mode: --/PW res: [0x2bfb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237466:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c554a8 lrc: 0/0,0 mode: --/PW res: [0x2bfb1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237469:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007126e775/0x3234de053c554af lrc: 2/0,0 mode: PW/PW res: [0x2bfaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.237473:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+97:39030:x1731745946814400:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 65us (168us total) trans 21474837072 rc 0/0 00010000:00010000:0.0:1651529917.237473:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007126e775 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.237474:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007126e775/0x3234de053c554af lrc: 2/0,0 mode: PW/PW res: [0x2bfaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.237476:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 621 00010000:00010000:0.0:1651529917.237476:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007126e775/0x3234de053c554af lrc: 3/0,0 mode: PW/PW res: [0x2bfaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237479:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007126e775/0x3234de053c554af lrc: 1/0,0 mode: --/PW res: [0x2bfaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237482:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007126e775/0x3234de053c554af lrc: 0/0,0 mode: --/PW res: [0x2bfaf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.237512:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.237521:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946814592 00000100:00100000:1.0:1651529917.237527:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.237532:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 622 00000100:00100000:0.0:1651529917.237533:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+97:39030:x1731745946814592:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.237544:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180146 count 1 00000100:00100000:1.0:1651529917.237546:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00010000:0.0:1651529917.237554:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfb2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.237555:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c554b6 lrc: 3/0,1 mode: --/PW res: [0x2bfb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237559:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.237559:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.237560:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c554b6 lrc: 3/0,1 mode: PW/PW res: [0x2bfb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237564:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c554b6 lrc: 3/0,1 mode: PW/PW res: [0x2bfb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237567:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c554b6 lrc: 3/0,1 mode: PW/PW res: [0x2bfb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237570:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c554b6 lrc: 2/0,0 mode: PW/PW res: [0x2bfb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.237573:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.237586:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529917.237590:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c554b6 lrc: 2/0,0 mode: PW/PW res: [0x2bfb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237594:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000721302df already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.237595:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c554b6 lrc: 2/0,0 mode: PW/PW res: [0x2bfb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237599:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c554b6 lrc: 3/0,0 mode: PW/PW res: [0x2bfb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237606:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c554b6 lrc: 1/0,0 mode: --/PW res: [0x2bfb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237609:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c554b6 lrc: 0/0,0 mode: --/PW res: [0x2bfb2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.237613:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+98:39030:x1731745946814592:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 79us (101us total) trans 21474837073 rc 0/0 00000100:00100000:0.0:1651529917.237616:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 622 00000100:00100000:0.0:1651529917.237621:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946814656 00000100:00100000:0.0:1651529917.237624:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946814720 00000100:00100000:0.0:1651529917.237627:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946814848 00000100:00100000:0.0:1651529917.237644:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946814784 00000100:00100000:0.0:1651529917.237649:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 623 00000100:00100000:0.0:1651529917.237650:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000035f3f4bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+101:39029:x1731745946814656:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529917.237651:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 624 00000100:00100000:1.0:1651529917.237653:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+101:39030:x1731745946814720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.237655:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180147 count 1 00002000:00080000:1.0:1651529917.237659:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180148 count 1 00002000:00010000:0.0:1651529917.237661:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfb3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.237662:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c554bd lrc: 3/0,1 mode: --/PW res: [0x2bfb3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.237664:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfb4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.237666:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2ef532c/0x3234de053c554c4 lrc: 3/0,1 mode: --/PW res: [0x2bfb4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237666:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.237667:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.237667:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c554bd lrc: 3/0,1 mode: PW/PW res: [0x2bfb3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237669:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.237670:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.237671:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2ef532c/0x3234de053c554c4 lrc: 3/0,1 mode: PW/PW res: [0x2bfb4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237671:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c554bd lrc: 3/0,1 mode: PW/PW res: [0x2bfb3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237674:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2ef532c/0x3234de053c554c4 lrc: 3/0,1 mode: PW/PW res: [0x2bfb4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237676:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c554bd lrc: 3/0,1 mode: PW/PW res: [0x2bfb3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237677:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2ef532c/0x3234de053c554c4 lrc: 3/0,1 mode: PW/PW res: [0x2bfb4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237679:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c554bd lrc: 2/0,0 mode: PW/PW res: [0x2bfb3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237680:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2ef532c/0x3234de053c554c4 lrc: 2/0,0 mode: PW/PW res: [0x2bfb4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.237731:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000035f3f4bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+103:39029:x1731745946814656:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 79us (203us total) trans 21474837074 rc 0/0 00000100:00100000:0.0:1651529917.237734:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 623 00000100:00100000:1.0:1651529917.237737:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+102:39030:x1731745946814720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 82us (190us total) trans 21474837075 rc 0/0 00000100:00100000:0.0:1651529917.237739:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 625 00000100:00100000:1.0:1651529917.237741:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 624 00000100:00100000:0.0:1651529917.237741:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017e3b33f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+102:39030:x1731745946814848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.237745:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180150 count 1 00000100:00100000:1.0:1651529917.237747:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 626 00000100:00100000:1.0:1651529917.237749:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e30915ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+101:39029:x1731745946814784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00010000:0.0:1651529917.237750:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfb6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.237752:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c554cb lrc: 3/0,1 mode: --/PW res: [0x2bfb6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.237753:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180149 count 1 00010000:00010000:0.0:1651529917.237756:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.237756:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.237757:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c554cb lrc: 3/0,1 mode: PW/PW res: [0x2bfb6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.237758:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfb5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.237759:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ead1500/0x3234de053c554d2 lrc: 3/0,1 mode: --/PW res: [0x2bfb5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237761:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c554cb lrc: 3/0,1 mode: PW/PW res: [0x2bfb6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237763:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.237764:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.237764:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c554cb lrc: 3/0,1 mode: PW/PW res: [0x2bfb6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237765:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ead1500/0x3234de053c554d2 lrc: 3/0,1 mode: PW/PW res: [0x2bfb5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237768:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ead1500/0x3234de053c554d2 lrc: 3/0,1 mode: PW/PW res: [0x2bfb5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237769:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c554cb lrc: 2/0,0 mode: PW/PW res: [0x2bfb6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237771:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ead1500/0x3234de053c554d2 lrc: 3/0,1 mode: PW/PW res: [0x2bfb5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237780:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ead1500/0x3234de053c554d2 lrc: 2/0,0 mode: PW/PW res: [0x2bfb5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.237805:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017e3b33f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+103:39030:x1731745946814848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 63us (238us total) trans 21474837076 rc 0/0 00000100:00100000:0.0:1651529917.237808:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 625 00000100:00100000:1.0:1651529917.237816:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e30915ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+103:39029:x1731745946814784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 66us (230us total) trans 21474837077 rc 0/0 00000100:00100000:1.0:1651529917.237832:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 626 00010000:00010000:0.0:1651529917.237837:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c554bd lrc: 2/0,0 mode: PW/PW res: [0x2bfb3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237839:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2ef532c/0x3234de053c554c4 lrc: 2/0,0 mode: PW/PW res: [0x2bfb4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237841:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000d8e6a5e already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.237842:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d2ef532c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.237842:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c554bd lrc: 2/0,0 mode: PW/PW res: [0x2bfb3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237843:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2ef532c/0x3234de053c554c4 lrc: 2/0,0 mode: PW/PW res: [0x2bfb4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237845:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c554bd lrc: 3/0,0 mode: PW/PW res: [0x2bfb3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237846:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2ef532c/0x3234de053c554c4 lrc: 3/0,0 mode: PW/PW res: [0x2bfb4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237850:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c554bd lrc: 1/0,0 mode: --/PW res: [0x2bfb3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237851:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2ef532c/0x3234de053c554c4 lrc: 1/0,0 mode: --/PW res: [0x2bfb4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237853:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c554bd lrc: 0/0,0 mode: --/PW res: [0x2bfb3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237854:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2ef532c/0x3234de053c554c4 lrc: 0/0,0 mode: --/PW res: [0x2bfb4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237857:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c554cb lrc: 2/0,0 mode: PW/PW res: [0x2bfb6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237858:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ead1500/0x3234de053c554d2 lrc: 2/0,0 mode: PW/PW res: [0x2bfb5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237860:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cb70d261 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.237861:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008ead1500 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.237861:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c554cb lrc: 2/0,0 mode: PW/PW res: [0x2bfb6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237862:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ead1500/0x3234de053c554d2 lrc: 2/0,0 mode: PW/PW res: [0x2bfb5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237864:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ead1500/0x3234de053c554d2 lrc: 3/0,0 mode: PW/PW res: [0x2bfb5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237864:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c554cb lrc: 3/0,0 mode: PW/PW res: [0x2bfb6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237867:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c554cb lrc: 1/0,0 mode: --/PW res: [0x2bfb6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237870:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ead1500/0x3234de053c554d2 lrc: 1/0,0 mode: --/PW res: [0x2bfb5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237870:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c554cb lrc: 0/0,0 mode: --/PW res: [0x2bfb6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.237873:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ead1500/0x3234de053c554d2 lrc: 0/0,0 mode: --/PW res: [0x2bfb5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.237887:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.237901:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946815360 00000100:00100000:0.0:1651529917.237911:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 627 00000100:00100000:0.0:1651529917.237912:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000035de0fa0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+102:39030:x1731745946815360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.237917:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180151 count 1 00002000:00010000:0.0:1651529917.237923:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfb7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.237924:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c554d9 lrc: 3/0,1 mode: --/PW res: [0x2bfb7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.237927:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.237928:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.237928:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.237929:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c554d9 lrc: 3/0,1 mode: PW/PW res: [0x2bfb7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237939:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c554d9 lrc: 3/0,1 mode: PW/PW res: [0x2bfb7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.237940:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.237947:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c554d9 lrc: 3/0,1 mode: PW/PW res: [0x2bfb7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.237950:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c554d9 lrc: 2/0,0 mode: PW/PW res: [0x2bfb7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.237968:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.237993:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000035de0fa0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+103:39030:x1731745946815360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 79us (105us total) trans 21474837078 rc 0/0 00000100:00100000:0.0:1651529917.237996:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 627 00000100:00100000:0.0:1651529917.238001:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946815552 00000100:00100000:0.0:1651529917.238005:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946815488 00000100:00100000:0.0:1651529917.238007:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946815616 00000100:00100000:0.0:1651529917.238010:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 628 00000100:00100000:0.0:1651529917.238011:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000567318ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+105:39029:x1731745946815552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.238016:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180153 count 1 00000100:00100000:1.0:1651529917.238021:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 629 00002000:00010000:0.0:1651529917.238021:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfb9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529917.238023:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003ffbc5dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+105:39030:x1731745946815488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.238028:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180152 count 1 00002000:00010000:1.0:1651529917.238034:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfb8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.238044:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c554e7 lrc: 3/0,1 mode: --/PW res: [0x2bfb8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238048:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.238049:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.238049:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c554e0 lrc: 3/0,1 mode: --/PW res: [0x2bfb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238050:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c554e7 lrc: 3/0,1 mode: PW/PW res: [0x2bfb8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238053:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.238054:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c554e7 lrc: 3/0,1 mode: PW/PW res: [0x2bfb8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238054:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.238055:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c554e0 lrc: 3/0,1 mode: PW/PW res: [0x2bfb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238057:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c554e7 lrc: 3/0,1 mode: PW/PW res: [0x2bfb8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238059:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c554e0 lrc: 3/0,1 mode: PW/PW res: [0x2bfb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238060:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c554e7 lrc: 2/0,0 mode: PW/PW res: [0x2bfb8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238062:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c554e0 lrc: 3/0,1 mode: PW/PW res: [0x2bfb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238079:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c554e0 lrc: 2/0,0 mode: PW/PW res: [0x2bfb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.238110:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003ffbc5dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+107:39030:x1731745946815488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 86us (169us total) trans 21474837079 rc 0/0 00000100:00100000:1.0:1651529917.238113:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 629 00000100:00100000:1.0:1651529917.238118:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 630 00000100:00100000:1.0:1651529917.238120:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004c5dc988 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+106:39030:x1731745946815616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529917.238123:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000567318ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+106:39029:x1731745946815552:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 110us (196us total) trans 21474837080 rc 0/0 00002000:00080000:1.0:1651529917.238124:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180154 count 1 00000100:00100000:0.0:1651529917.238125:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 628 00002000:00010000:1.0:1651529917.238128:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.238130:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c554ee lrc: 3/0,1 mode: --/PW res: [0x2bfba:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238134:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.238134:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.238134:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c554d9 lrc: 2/0,0 mode: PW/PW res: [0x2bfb7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238135:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c554ee lrc: 3/0,1 mode: PW/PW res: [0x2bfba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238137:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002082f759 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.238138:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c554d9 lrc: 2/0,0 mode: PW/PW res: [0x2bfb7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238139:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c554ee lrc: 3/0,1 mode: PW/PW res: [0x2bfba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238141:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c554d9 lrc: 3/0,0 mode: PW/PW res: [0x2bfb7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238142:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c554ee lrc: 3/0,1 mode: PW/PW res: [0x2bfba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238144:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c554ee lrc: 2/0,0 mode: PW/PW res: [0x2bfba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238146:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c554d9 lrc: 1/0,0 mode: --/PW res: [0x2bfb7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238149:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c554d9 lrc: 0/0,0 mode: --/PW res: [0x2bfb7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238153:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c554e7 lrc: 2/0,0 mode: PW/PW res: [0x2bfb8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238156:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004678bff1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.238157:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c554e7 lrc: 2/0,0 mode: PW/PW res: [0x2bfb8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238160:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c554e7 lrc: 3/0,0 mode: PW/PW res: [0x2bfb8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.238190:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004c5dc988 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+106:39030:x1731745946815616:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 69us (221us total) trans 21474837081 rc 0/0 00000100:00100000:1.0:1651529917.238193:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 630 00010000:00010000:0.0:1651529917.238193:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c554e7 lrc: 1/0,0 mode: --/PW res: [0x2bfb8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238196:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c554e7 lrc: 0/0,0 mode: --/PW res: [0x2bfb8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238200:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c554e0 lrc: 2/0,0 mode: PW/PW res: [0x2bfb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238201:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c554ee lrc: 2/0,0 mode: PW/PW res: [0x2bfba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238203:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c0de17df already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.238204:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6999e11 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.238204:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c554ee lrc: 2/0,0 mode: PW/PW res: [0x2bfba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238205:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c554e0 lrc: 2/0,0 mode: PW/PW res: [0x2bfb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238207:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c554ee lrc: 3/0,0 mode: PW/PW res: [0x2bfba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238208:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c554e0 lrc: 3/0,0 mode: PW/PW res: [0x2bfb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238210:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c554ee lrc: 1/0,0 mode: --/PW res: [0x2bfba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238212:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c554e0 lrc: 1/0,0 mode: --/PW res: [0x2bfb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238213:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c554ee lrc: 0/0,0 mode: --/PW res: [0x2bfba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238215:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c554e0 lrc: 0/0,0 mode: --/PW res: [0x2bfb9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.238262:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.238270:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946815744 00000100:00100000:1.0:1651529917.238277:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.238281:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 631 00000100:00100000:0.0:1651529917.238283:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+106:39030:x1731745946815744:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.238293:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180156 count 1 00000100:00100000:1.0:1651529917.238296:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00010000:0.0:1651529917.238304:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfbc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.238305:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c554f5 lrc: 3/0,1 mode: --/PW res: [0x2bfbc:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238309:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.238310:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.238311:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c554f5 lrc: 3/0,1 mode: PW/PW res: [0x2bfbc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238314:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c554f5 lrc: 3/0,1 mode: PW/PW res: [0x2bfbc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238317:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c554f5 lrc: 3/0,1 mode: PW/PW res: [0x2bfbc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238320:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c554f5 lrc: 2/0,0 mode: PW/PW res: [0x2bfbc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.238323:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.238329:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.238336:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946815680 00000100:00100000:1.0:1651529917.238342:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946815872 00000100:00100000:1.0:1651529917.238344:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946815808 00000100:00100000:1.0:1651529917.238347:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946815936 00000100:00100000:1.0:1651529917.238350:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 632 00000100:00100000:1.0:1651529917.238351:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+111:39029:x1731745946815680:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.238356:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180155 count 1 00000100:00100000:0.0:1651529917.238364:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+111:39030:x1731745946815744:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 81us (103us total) trans 21474837082 rc 0/0 00000100:00100000:0.0:1651529917.238368:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 631 00002000:00010000:1.0:1651529917.238369:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfbb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.238371:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae57075e/0x3234de053c554fc lrc: 3/0,1 mode: --/PW res: [0x2bfbb:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.238373:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 633 00010000:00010000:1.0:1651529917.238374:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.238375:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.238376:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae57075e/0x3234de053c554fc lrc: 3/0,1 mode: PW/PW res: [0x2bfbb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238380:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae57075e/0x3234de053c554fc lrc: 3/0,1 mode: PW/PW res: [0x2bfbb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238383:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae57075e/0x3234de053c554fc lrc: 3/0,1 mode: PW/PW res: [0x2bfbb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238386:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae57075e/0x3234de053c554fc lrc: 2/0,0 mode: PW/PW res: [0x2bfbb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.238389:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+110:39030:x1731745946815872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.238400:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180158 count 1 00002000:00010000:0.0:1651529917.238406:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfbe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.238408:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c55503 lrc: 3/0,1 mode: --/PW res: [0x2bfbe:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238412:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.238413:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.238414:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c55503 lrc: 3/0,1 mode: PW/PW res: [0x2bfbe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238417:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c55503 lrc: 3/0,1 mode: PW/PW res: [0x2bfbe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238420:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c55503 lrc: 3/0,1 mode: PW/PW res: [0x2bfbe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238423:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c55503 lrc: 2/0,0 mode: PW/PW res: [0x2bfbe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.238426:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+111:39029:x1731745946815680:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 74us (148us total) trans 21474837083 rc 0/0 00000100:00100000:1.0:1651529917.238436:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 632 00000100:00100000:1.0:1651529917.238441:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 634 00000100:00100000:1.0:1651529917.238443:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+111:39029:x1731745946815808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.238449:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180157 count 1 00002000:00010000:1.0:1651529917.238454:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfbd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.238455:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c5550a lrc: 3/0,1 mode: --/PW res: [0x2bfbd:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238459:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.238460:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.238460:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c5550a lrc: 3/0,1 mode: PW/PW res: [0x2bfbd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.238461:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+111:39030:x1731745946815872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 86us (165us total) trans 21474837084 rc 0/0 00010000:00010000:1.0:1651529917.238464:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c5550a lrc: 3/0,1 mode: PW/PW res: [0x2bfbd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.238465:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 633 00010000:00010000:1.0:1651529917.238467:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c5550a lrc: 3/0,1 mode: PW/PW res: [0x2bfbd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238470:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c5550a lrc: 2/0,0 mode: PW/PW res: [0x2bfbd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.238470:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 635 00000100:00100000:0.0:1651529917.238472:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+110:39029:x1731745946815936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.238476:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180159 count 1 00002000:00010000:0.0:1651529917.238481:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfbf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.238483:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55511 lrc: 3/0,1 mode: --/PW res: [0x2bfbf:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238488:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.238489:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.238490:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55511 lrc: 3/0,1 mode: PW/PW res: [0x2bfbf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238493:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55511 lrc: 3/0,1 mode: PW/PW res: [0x2bfbf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238496:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55511 lrc: 3/0,1 mode: PW/PW res: [0x2bfbf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238499:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55511 lrc: 2/0,0 mode: PW/PW res: [0x2bfbf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.238503:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+111:39029:x1731745946815808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 60us (180us total) trans 21474837085 rc 0/0 00000100:00100000:1.0:1651529917.238506:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 634 00010000:00010000:1.0:1651529917.238513:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c554f5 lrc: 2/0,0 mode: PW/PW res: [0x2bfbc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238517:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004cff9fc3 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.238518:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c554f5 lrc: 2/0,0 mode: PW/PW res: [0x2bfbc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238530:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c554f5 lrc: 3/0,0 mode: PW/PW res: [0x2bfbc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238535:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c554f5 lrc: 1/0,0 mode: --/PW res: [0x2bfbc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238538:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c554f5 lrc: 0/0,0 mode: --/PW res: [0x2bfbc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238542:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae57075e/0x3234de053c554fc lrc: 2/0,0 mode: PW/PW res: [0x2bfbb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238545:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ae57075e already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.238546:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae57075e/0x3234de053c554fc lrc: 2/0,0 mode: PW/PW res: [0x2bfbb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238549:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae57075e/0x3234de053c554fc lrc: 3/0,0 mode: PW/PW res: [0x2bfbb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238552:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae57075e/0x3234de053c554fc lrc: 1/0,0 mode: --/PW res: [0x2bfbb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238554:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae57075e/0x3234de053c554fc lrc: 0/0,0 mode: --/PW res: [0x2bfbb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.238556:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+111:39029:x1731745946815936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 84us (226us total) trans 21474837086 rc 0/0 00010000:00010000:1.0:1651529917.238558:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c55503 lrc: 2/0,0 mode: PW/PW res: [0x2bfbe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.238559:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 635 00010000:00010000:1.0:1651529917.238561:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b5173ced already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.238562:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c55503 lrc: 2/0,0 mode: PW/PW res: [0x2bfbe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238564:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c55503 lrc: 3/0,0 mode: PW/PW res: [0x2bfbe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238567:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c55503 lrc: 1/0,0 mode: --/PW res: [0x2bfbe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238568:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c5550a lrc: 2/0,0 mode: PW/PW res: [0x2bfbd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238570:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c55503 lrc: 0/0,0 mode: --/PW res: [0x2bfbe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238573:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55511 lrc: 2/0,0 mode: PW/PW res: [0x2bfbf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238576:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000092ad010c already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.238576:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55511 lrc: 2/0,0 mode: PW/PW res: [0x2bfbf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238579:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55511 lrc: 3/0,0 mode: PW/PW res: [0x2bfbf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238582:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55511 lrc: 1/0,0 mode: --/PW res: [0x2bfbf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238585:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55511 lrc: 0/0,0 mode: --/PW res: [0x2bfbf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238596:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba070658 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.238598:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c5550a lrc: 2/0,0 mode: PW/PW res: [0x2bfbd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238601:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c5550a lrc: 3/0,0 mode: PW/PW res: [0x2bfbd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238608:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c5550a lrc: 1/0,0 mode: --/PW res: [0x2bfbd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.238610:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.238611:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c5550a lrc: 0/0,0 mode: --/PW res: [0x2bfbd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.238625:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946816384 00000100:00100000:1.0:1651529917.238627:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.238641:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946816512 00000100:00100000:1.0:1651529917.238645:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.238645:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 636 00000100:00100000:0.0:1651529917.238647:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ffcc974c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+112:39030:x1731745946816384:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.238652:0:166112:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180160 count 1 00002000:00010000:0.0:1651529917.238657:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfc0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.238658:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c55518 lrc: 3/0,1 mode: --/PW res: [0x2bfc0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238662:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.238662:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.238663:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c55518 lrc: 3/0,1 mode: PW/PW res: [0x2bfc0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238666:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c55518 lrc: 3/0,1 mode: PW/PW res: [0x2bfc0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238670:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c55518 lrc: 3/0,1 mode: PW/PW res: [0x2bfc0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238672:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c55518 lrc: 2/0,0 mode: PW/PW res: [0x2bfc0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.238713:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ffcc974c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+113:39030:x1731745946816384:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 65us (103us total) trans 21474837087 rc 0/0 00000100:00100000:0.0:1651529917.238717:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 636 00010000:00010000:1.0:1651529917.238718:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c55518 lrc: 2/0,0 mode: PW/PW res: [0x2bfc0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.238721:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946816448 00010000:00010000:1.0:1651529917.238722:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eca832be already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.238723:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c55518 lrc: 2/0,0 mode: PW/PW res: [0x2bfc0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.238725:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 637 00010000:00010000:1.0:1651529917.238726:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c55518 lrc: 3/0,0 mode: PW/PW res: [0x2bfc0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.238727:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9e74b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+113:39030:x1731745946816512:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529917.238731:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c55518 lrc: 1/0,0 mode: --/PW res: [0x2bfc0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.238731:0:166112:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180162 count 1 00010000:00010000:1.0:1651529917.238734:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c55518 lrc: 0/0,0 mode: --/PW res: [0x2bfc0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.238736:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfc2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.238738:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c5551f lrc: 3/0,1 mode: --/PW res: [0x2bfc2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238755:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.238756:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.238757:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c5551f lrc: 3/0,1 mode: PW/PW res: [0x2bfc2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238761:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c5551f lrc: 3/0,1 mode: PW/PW res: [0x2bfc2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238764:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c5551f lrc: 3/0,1 mode: PW/PW res: [0x2bfc2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238767:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c5551f lrc: 2/0,0 mode: PW/PW res: [0x2bfc2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.238769:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 638 00000100:00100000:1.0:1651529917.238771:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054ed0749 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+113:39030:x1731745946816448:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.238777:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180161 count 1 00002000:00010000:1.0:1651529917.238782:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfc1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.238784:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55526 lrc: 3/0,1 mode: --/PW res: [0x2bfc1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238790:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.238790:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.238791:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55526 lrc: 3/0,1 mode: PW/PW res: [0x2bfc1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238795:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55526 lrc: 3/0,1 mode: PW/PW res: [0x2bfc1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238798:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55526 lrc: 3/0,1 mode: PW/PW res: [0x2bfc1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238801:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55526 lrc: 2/0,0 mode: PW/PW res: [0x2bfc1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.238823:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9e74b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+114:39030:x1731745946816512:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 95us (195us total) trans 21474837088 rc 0/0 00000100:00100000:0.0:1651529917.238826:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 637 00010000:00010000:0.0:1651529917.238834:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c5551f lrc: 2/0,0 mode: PW/PW res: [0x2bfc2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238837:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008119f3a8 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.238838:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c5551f lrc: 2/0,0 mode: PW/PW res: [0x2bfc2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238841:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c5551f lrc: 3/0,0 mode: PW/PW res: [0x2bfc2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.238845:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054ed0749 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+114:39030:x1731745946816448:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 74us (200us total) trans 21474837089 rc 0/0 00010000:00010000:0.0:1651529917.238846:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c5551f lrc: 1/0,0 mode: --/PW res: [0x2bfc2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.238848:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 638 00010000:00010000:0.0:1651529917.238849:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c5551f lrc: 0/0,0 mode: --/PW res: [0x2bfc2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238853:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55526 lrc: 2/0,0 mode: PW/PW res: [0x2bfc1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238856:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000029b2a516 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.238857:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55526 lrc: 2/0,0 mode: PW/PW res: [0x2bfc1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238860:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55526 lrc: 3/0,0 mode: PW/PW res: [0x2bfc1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238865:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55526 lrc: 1/0,0 mode: --/PW res: [0x2bfc1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238868:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55526 lrc: 0/0,0 mode: --/PW res: [0x2bfc1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.238921:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.238931:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946816896 00000100:00100000:1.0:1651529917.238932:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.238941:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.238952:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946816960 00000100:00100000:0.0:1651529917.238955:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946816832 00000100:00100000:1.0:1651529917.238957:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 639 00000100:00100000:1.0:1651529917.238959:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057d84ac9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+116:39030:x1731745946816896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529917.238960:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 640 00000100:00100000:0.0:1651529917.238961:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a8bb9985 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+116:39029:x1731745946816960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.238964:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180164 count 1 00002000:00080000:0.0:1651529917.238967:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180165 count 1 00002000:00010000:1.0:1651529917.238970:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfc4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:0.0:1651529917.238971:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfc5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.238972:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c5552d lrc: 3/0,1 mode: --/PW res: [0x2bfc4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238973:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c55534 lrc: 3/0,1 mode: --/PW res: [0x2bfc5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238976:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.238977:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.238978:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.238978:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.238978:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c55534 lrc: 3/0,1 mode: PW/PW res: [0x2bfc5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238979:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c5552d lrc: 3/0,1 mode: PW/PW res: [0x2bfc4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238982:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c55534 lrc: 3/0,1 mode: PW/PW res: [0x2bfc5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238983:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c5552d lrc: 3/0,1 mode: PW/PW res: [0x2bfc4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238985:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c55534 lrc: 3/0,1 mode: PW/PW res: [0x2bfc5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238986:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c5552d lrc: 3/0,1 mode: PW/PW res: [0x2bfc4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.238988:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c5552d lrc: 2/0,0 mode: PW/PW res: [0x2bfc4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.238990:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c55534 lrc: 2/0,0 mode: PW/PW res: [0x2bfc5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.239028:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057d84ac9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+118:39030:x1731745946816896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 68us (107us total) trans 21474837090 rc 0/0 00000100:00100000:1.0:1651529917.239031:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 639 00000100:00100000:1.0:1651529917.239056:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 641 00000100:00100000:1.0:1651529917.239058:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012756c2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+117:39030:x1731745946816832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.239063:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180163 count 1 00002000:00010000:1.0:1651529917.239068:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfc3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.239070:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c5553b lrc: 3/0,1 mode: --/PW res: [0x2bfc3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239074:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.239074:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.239075:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c5553b lrc: 3/0,1 mode: PW/PW res: [0x2bfc3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239079:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c5553b lrc: 3/0,1 mode: PW/PW res: [0x2bfc3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.239081:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a8bb9985 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+117:39029:x1731745946816960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 118us (148us total) trans 21474837091 rc 0/0 00010000:00010000:1.0:1651529917.239082:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c5553b lrc: 3/0,1 mode: PW/PW res: [0x2bfc3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.239084:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 640 00010000:00010000:1.0:1651529917.239085:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c5553b lrc: 2/0,0 mode: PW/PW res: [0x2bfc3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239100:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c5552d lrc: 2/0,0 mode: PW/PW res: [0x2bfc4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239103:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d84ad17b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.239104:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c5552d lrc: 2/0,0 mode: PW/PW res: [0x2bfc4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239108:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c5552d lrc: 3/0,0 mode: PW/PW res: [0x2bfc4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239113:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c5552d lrc: 1/0,0 mode: --/PW res: [0x2bfc4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239116:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c5552d lrc: 0/0,0 mode: --/PW res: [0x2bfc4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239120:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c55534 lrc: 2/0,0 mode: PW/PW res: [0x2bfc5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239123:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004926c34d already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529917.239124:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012756c2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+117:39030:x1731745946816832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 65us (182us total) trans 21474837092 rc 0/0 00010000:00010000:0.0:1651529917.239124:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c55534 lrc: 2/0,0 mode: PW/PW res: [0x2bfc5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.239127:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 641 00010000:00010000:0.0:1651529917.239127:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c55534 lrc: 3/0,0 mode: PW/PW res: [0x2bfc5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239130:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c55534 lrc: 1/0,0 mode: --/PW res: [0x2bfc5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239133:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c55534 lrc: 0/0,0 mode: --/PW res: [0x2bfc5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239136:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c5553b lrc: 2/0,0 mode: PW/PW res: [0x2bfc3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239138:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ac14729e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.239139:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c5553b lrc: 2/0,0 mode: PW/PW res: [0x2bfc3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239142:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c5553b lrc: 3/0,0 mode: PW/PW res: [0x2bfc3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239145:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c5553b lrc: 1/0,0 mode: --/PW res: [0x2bfc3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239147:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c5553b lrc: 0/0,0 mode: --/PW res: [0x2bfc3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.239173:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.239183:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946817024 00000100:00100000:0.0:1651529917.239193:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 642 00000100:00100000:1.0:1651529917.239195:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.239195:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000035de0fa0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+117:39030:x1731745946817024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.239205:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180166 count 1 00000100:00100000:1.0:1651529917.239209:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00010000:0.0:1651529917.239210:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfc6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.239217:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55542 lrc: 3/0,1 mode: --/PW res: [0x2bfc6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239220:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.239221:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.239238:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55542 lrc: 3/0,1 mode: PW/PW res: [0x2bfc6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239242:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55542 lrc: 3/0,1 mode: PW/PW res: [0x2bfc6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239245:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55542 lrc: 3/0,1 mode: PW/PW res: [0x2bfc6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239248:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55542 lrc: 2/0,0 mode: PW/PW res: [0x2bfc6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.239264:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.239271:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529917.239275:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55542 lrc: 2/0,0 mode: PW/PW res: [0x2bfc6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239279:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b1b8f74 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.239280:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55542 lrc: 2/0,0 mode: PW/PW res: [0x2bfc6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239283:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55542 lrc: 3/0,0 mode: PW/PW res: [0x2bfc6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239291:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55542 lrc: 1/0,0 mode: --/PW res: [0x2bfc6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239294:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55542 lrc: 0/0,0 mode: --/PW res: [0x2bfc6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.239302:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946817152 00000100:00100000:0.0:1651529917.239310:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000035de0fa0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+119:39030:x1731745946817024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 114us (137us total) trans 21474837093 rc 0/0 00000100:00100000:1.0:1651529917.239314:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946817088 00000100:00100000:0.0:1651529917.239314:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 642 00000100:00100000:1.0:1651529917.239317:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946817216 00000100:00100000:0.0:1651529917.239319:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946817280 00000100:00100000:1.0:1651529917.239320:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 643 00000100:00100000:1.0:1651529917.239321:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003ffbc5dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+121:39030:x1731745946817152:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529917.239324:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 644 00000100:00100000:0.0:1651529917.239326:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000567318ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+121:39029:x1731745946817088:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.239327:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180168 count 1 00002000:00080000:0.0:1651529917.239331:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180167 count 1 00002000:00010000:1.0:1651529917.239332:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfc8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.239333:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c55549 lrc: 3/0,1 mode: --/PW res: [0x2bfc8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.239336:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfc7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.239337:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.239337:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.239338:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c55549 lrc: 3/0,1 mode: PW/PW res: [0x2bfc8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239338:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c55550 lrc: 3/0,1 mode: --/PW res: [0x2bfc7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239341:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c55549 lrc: 3/0,1 mode: PW/PW res: [0x2bfc8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239341:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.239342:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.239343:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c55550 lrc: 3/0,1 mode: PW/PW res: [0x2bfc7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239345:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c55549 lrc: 3/0,1 mode: PW/PW res: [0x2bfc8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239346:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c55550 lrc: 3/0,1 mode: PW/PW res: [0x2bfc7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239349:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c55550 lrc: 3/0,1 mode: PW/PW res: [0x2bfc7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239350:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c55549 lrc: 2/0,0 mode: PW/PW res: [0x2bfc8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239352:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c55550 lrc: 2/0,0 mode: PW/PW res: [0x2bfc7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.239392:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003ffbc5dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+123:39030:x1731745946817152:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 70us (202us total) trans 21474837094 rc 0/0 00000100:00100000:1.0:1651529917.239395:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 643 00000100:00100000:0.0:1651529917.239399:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000567318ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+122:39029:x1731745946817088:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 72us (190us total) trans 21474837095 rc 0/0 00000100:00100000:1.0:1651529917.239400:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 645 00000100:00100000:1.0:1651529917.239402:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004c5dc988 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+122:39029:x1731745946817216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529917.239402:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 644 00002000:00080000:1.0:1651529917.239406:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180169 count 1 00000100:00100000:0.0:1651529917.239408:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 646 00000100:00100000:0.0:1651529917.239409:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+121:39030:x1731745946817280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00010000:1.0:1651529917.239410:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfc9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.239412:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c55557 lrc: 3/0,1 mode: --/PW res: [0x2bfc9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.239413:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180170 count 1 00010000:00010000:1.0:1651529917.239415:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.239416:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.239417:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c55557 lrc: 3/0,1 mode: PW/PW res: [0x2bfc9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.239418:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.239419:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c5555e lrc: 3/0,1 mode: --/PW res: [0x2bfca:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239421:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c55557 lrc: 3/0,1 mode: PW/PW res: [0x2bfc9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239424:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c55557 lrc: 3/0,1 mode: PW/PW res: [0x2bfc9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239425:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.239426:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c55557 lrc: 2/0,0 mode: PW/PW res: [0x2bfc9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239426:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.239427:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c5555e lrc: 3/0,1 mode: PW/PW res: [0x2bfca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239430:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c5555e lrc: 3/0,1 mode: PW/PW res: [0x2bfca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239433:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c5555e lrc: 3/0,1 mode: PW/PW res: [0x2bfca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239436:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c5555e lrc: 2/0,0 mode: PW/PW res: [0x2bfca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.239462:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004c5dc988 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+123:39029:x1731745946817216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 59us (198us total) trans 21474837096 rc 0/0 00000100:00100000:1.0:1651529917.239465:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 645 00010000:00010000:1.0:1651529917.239472:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c55549 lrc: 2/0,0 mode: PW/PW res: [0x2bfc8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239482:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f56810a1 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.239483:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c55549 lrc: 2/0,0 mode: PW/PW res: [0x2bfc8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239487:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c55549 lrc: 3/0,0 mode: PW/PW res: [0x2bfc8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239491:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c55549 lrc: 1/0,0 mode: --/PW res: [0x2bfc8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.239493:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+122:39030:x1731745946817280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 82us (221us total) trans 21474837097 rc 0/0 00010000:00010000:1.0:1651529917.239494:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c55549 lrc: 0/0,0 mode: --/PW res: [0x2bfc8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.239496:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 646 00010000:00010000:1.0:1651529917.239498:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c55550 lrc: 2/0,0 mode: PW/PW res: [0x2bfc7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239501:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008393c644 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.239502:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c55550 lrc: 2/0,0 mode: PW/PW res: [0x2bfc7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239507:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c55550 lrc: 3/0,0 mode: PW/PW res: [0x2bfc7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239510:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c55550 lrc: 1/0,0 mode: --/PW res: [0x2bfc7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239513:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c55550 lrc: 0/0,0 mode: --/PW res: [0x2bfc7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239516:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c55557 lrc: 2/0,0 mode: PW/PW res: [0x2bfc9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239519:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000f18bca1 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.239520:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c55557 lrc: 2/0,0 mode: PW/PW res: [0x2bfc9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239522:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c55557 lrc: 3/0,0 mode: PW/PW res: [0x2bfc9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239525:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c55557 lrc: 1/0,0 mode: --/PW res: [0x2bfc9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239528:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c55557 lrc: 0/0,0 mode: --/PW res: [0x2bfc9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239529:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c5555e lrc: 2/0,0 mode: PW/PW res: [0x2bfca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239533:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e270377c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.239534:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c5555e lrc: 2/0,0 mode: PW/PW res: [0x2bfca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239538:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c5555e lrc: 3/0,0 mode: PW/PW res: [0x2bfca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239545:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c5555e lrc: 1/0,0 mode: --/PW res: [0x2bfca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239548:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c5555e lrc: 0/0,0 mode: --/PW res: [0x2bfca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.239554:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.239560:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946817792 00000100:00100000:1.0:1651529917.239566:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.239567:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 647 00000100:00100000:0.0:1651529917.239568:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+122:39030:x1731745946817792:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.239579:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180172 count 1 00000100:00100000:1.0:1651529917.239580:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00010000:0.0:1651529917.239584:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfcc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.239586:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be333df1/0x3234de053c55565 lrc: 3/0,1 mode: --/PW res: [0x2bfcc:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239589:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.239590:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.239591:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be333df1/0x3234de053c55565 lrc: 3/0,1 mode: PW/PW res: [0x2bfcc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239594:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be333df1/0x3234de053c55565 lrc: 3/0,1 mode: PW/PW res: [0x2bfcc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239597:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be333df1/0x3234de053c55565 lrc: 3/0,1 mode: PW/PW res: [0x2bfcc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239600:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be333df1/0x3234de053c55565 lrc: 2/0,0 mode: PW/PW res: [0x2bfcc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239639:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be333df1/0x3234de053c55565 lrc: 2/0,0 mode: PW/PW res: [0x2bfcc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.239648:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+123:39030:x1731745946817792:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 78us (93us total) trans 21474837098 rc 0/0 00000100:00100000:0.0:1651529917.239651:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 647 00010000:00010000:1.0:1651529917.239656:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000be333df1 already unused, calling callback (0000000049fddea7) 00000100:00100000:0.0:1651529917.239656:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946817728 00010000:00010000:1.0:1651529917.239657:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be333df1/0x3234de053c55565 lrc: 2/0,0 mode: PW/PW res: [0x2bfcc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239660:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be333df1/0x3234de053c55565 lrc: 3/0,0 mode: PW/PW res: [0x2bfcc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239665:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be333df1/0x3234de053c55565 lrc: 1/0,0 mode: --/PW res: [0x2bfcc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239668:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be333df1/0x3234de053c55565 lrc: 0/0,0 mode: --/PW res: [0x2bfcc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.239676:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946817984 00000100:00100000:0.0:1651529917.239679:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 648 00000100:00100000:0.0:1651529917.239681:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+124:39029:x1731745946817728:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.239686:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180171 count 1 00002000:00010000:0.0:1651529917.239690:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfcb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.239692:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c5556c lrc: 3/0,1 mode: --/PW res: [0x2bfcb:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239696:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.239696:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.239697:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c5556c lrc: 3/0,1 mode: PW/PW res: [0x2bfcb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.239701:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 649 00010000:00010000:0.0:1651529917.239701:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c5556c lrc: 3/0,1 mode: PW/PW res: [0x2bfcb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.239703:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+124:39030:x1731745946817984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529917.239704:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c5556c lrc: 3/0,1 mode: PW/PW res: [0x2bfcb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239707:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c5556c lrc: 2/0,0 mode: PW/PW res: [0x2bfcb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.239709:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180173 count 1 00002000:00010000:1.0:1651529917.239714:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfcd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.239716:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c55573 lrc: 3/0,1 mode: --/PW res: [0x2bfcd:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239719:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.239720:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.239721:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c55573 lrc: 3/0,1 mode: PW/PW res: [0x2bfcd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239725:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c55573 lrc: 3/0,1 mode: PW/PW res: [0x2bfcd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239728:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c55573 lrc: 3/0,1 mode: PW/PW res: [0x2bfcd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239730:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c55573 lrc: 2/0,0 mode: PW/PW res: [0x2bfcd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.239780:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+126:39030:x1731745946817984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 76us (199us total) trans 21474837100 rc 0/0 00000100:00100000:0.0:1651529917.239781:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+126:39029:x1731745946817728:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 98us (214us total) trans 21474837099 rc 0/0 00000100:00100000:1.0:1651529917.239783:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 649 00000100:00100000:0.0:1651529917.239784:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 648 00010000:00010000:0.0:1651529917.239793:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c5556c lrc: 2/0,0 mode: PW/PW res: [0x2bfcb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239797:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007d55fe01 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.239798:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c5556c lrc: 2/0,0 mode: PW/PW res: [0x2bfcb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239800:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c5556c lrc: 3/0,0 mode: PW/PW res: [0x2bfcb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239805:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c5556c lrc: 1/0,0 mode: --/PW res: [0x2bfcb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239808:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c5556c lrc: 0/0,0 mode: --/PW res: [0x2bfcb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239812:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c55573 lrc: 2/0,0 mode: PW/PW res: [0x2bfcd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239815:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a032e9d0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.239816:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c55573 lrc: 2/0,0 mode: PW/PW res: [0x2bfcd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.239817:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.239819:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c55573 lrc: 3/0,0 mode: PW/PW res: [0x2bfcd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239831:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c55573 lrc: 1/0,0 mode: --/PW res: [0x2bfcd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.239833:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.239834:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c55573 lrc: 0/0,0 mode: --/PW res: [0x2bfcd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.239845:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946818048 00000100:00100000:0.0:1651529917.239853:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946818112 00000100:00100000:0.0:1651529917.239857:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 650 00000100:00100000:0.0:1651529917.239859:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+126:39030:x1731745946818048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.239863:0:166112:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180174 count 1 00000100:00100000:1.0:1651529917.239867:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 651 00002000:00010000:0.0:1651529917.239868:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529917.239869:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ffcc974c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+126:39029:x1731745946818112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529917.239869:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0382f56/0x3234de053c5557a lrc: 3/0,1 mode: --/PW res: [0x2bfce:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239873:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.239873:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.239874:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0382f56/0x3234de053c5557a lrc: 3/0,1 mode: PW/PW res: [0x2bfce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.239875:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180175 count 1 00010000:00010000:0.0:1651529917.239878:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0382f56/0x3234de053c5557a lrc: 3/0,1 mode: PW/PW res: [0x2bfce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.239880:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfcf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.239881:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0382f56/0x3234de053c5557a lrc: 3/0,1 mode: PW/PW res: [0x2bfce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239882:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c55581 lrc: 3/0,1 mode: --/PW res: [0x2bfcf:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239883:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0382f56/0x3234de053c5557a lrc: 2/0,0 mode: PW/PW res: [0x2bfce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239886:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.239886:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.239887:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c55581 lrc: 3/0,1 mode: PW/PW res: [0x2bfcf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239900:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c55581 lrc: 3/0,1 mode: PW/PW res: [0x2bfcf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239903:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c55581 lrc: 3/0,1 mode: PW/PW res: [0x2bfcf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239906:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c55581 lrc: 2/0,0 mode: PW/PW res: [0x2bfcf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.239954:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+128:39030:x1731745946818048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 94us (144us total) trans 21474837101 rc 0/0 00000100:00100000:0.0:1651529917.239957:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 650 00000100:00100000:1.0:1651529917.239958:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ffcc974c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+128:39029:x1731745946818112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 88us (124us total) trans 21474837102 rc 0/0 00000100:00100000:1.0:1651529917.239961:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 651 00010000:00010000:0.0:1651529917.239965:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0382f56/0x3234de053c5557a lrc: 2/0,0 mode: PW/PW res: [0x2bfce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239968:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b0382f56 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.239969:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c55581 lrc: 2/0,0 mode: PW/PW res: [0x2bfcf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239969:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0382f56/0x3234de053c5557a lrc: 2/0,0 mode: PW/PW res: [0x2bfce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239972:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000215144f2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.239972:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0382f56/0x3234de053c5557a lrc: 3/0,0 mode: PW/PW res: [0x2bfce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239973:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c55581 lrc: 2/0,0 mode: PW/PW res: [0x2bfcf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239976:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c55581 lrc: 3/0,0 mode: PW/PW res: [0x2bfcf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239977:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0382f56/0x3234de053c5557a lrc: 1/0,0 mode: --/PW res: [0x2bfce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239980:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c55581 lrc: 1/0,0 mode: --/PW res: [0x2bfcf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.239980:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0382f56/0x3234de053c5557a lrc: 0/0,0 mode: --/PW res: [0x2bfce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.239983:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c55581 lrc: 0/0,0 mode: --/PW res: [0x2bfcf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.239997:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.240008:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946818176 00000100:00100000:0.0:1651529917.240014:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 652 00000100:00100000:1.0:1651529917.240015:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.240016:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9e74b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+127:39030:x1731745946818176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.240021:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180176 count 1 00002000:00010000:0.0:1651529917.240048:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfd0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.240050:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000990cd87d/0x3234de053c55588 lrc: 3/0,1 mode: --/PW res: [0x2bfd0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240054:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.240055:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.240056:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000990cd87d/0x3234de053c55588 lrc: 3/0,1 mode: PW/PW res: [0x2bfd0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.240060:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.240060:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000990cd87d/0x3234de053c55588 lrc: 3/0,1 mode: PW/PW res: [0x2bfd0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240063:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000990cd87d/0x3234de053c55588 lrc: 3/0,1 mode: PW/PW res: [0x2bfd0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.240070:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.240071:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000990cd87d/0x3234de053c55588 lrc: 2/0,0 mode: PW/PW res: [0x2bfd0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.240076:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946818240 00000100:00100000:1.0:1651529917.240081:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946818368 00000100:00100000:1.0:1651529917.240084:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946818304 00000100:00100000:1.0:1651529917.240087:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 653 00000100:00100000:1.0:1651529917.240088:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054ed0749 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+131:39030:x1731745946818240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.240093:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180177 count 1 00002000:00010000:1.0:1651529917.240098:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfd1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.240100:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5558f lrc: 3/0,1 mode: --/PW res: [0x2bfd1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240104:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.240104:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.240105:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5558f lrc: 3/0,1 mode: PW/PW res: [0x2bfd1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240109:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5558f lrc: 3/0,1 mode: PW/PW res: [0x2bfd1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.240115:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9e74b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+131:39030:x1731745946818176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 97us (117us total) trans 21474837103 rc 0/0 00000100:00100000:0.0:1651529917.240118:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 652 00010000:00010000:1.0:1651529917.240119:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5558f lrc: 3/0,1 mode: PW/PW res: [0x2bfd1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240122:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5558f lrc: 2/0,0 mode: PW/PW res: [0x2bfd1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.240124:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 654 00000100:00100000:0.0:1651529917.240125:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057d84ac9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+130:39029:x1731745946818368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.240166:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180179 count 1 00002000:00010000:0.0:1651529917.240172:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfd3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.240173:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067d657cd/0x3234de053c55596 lrc: 3/0,1 mode: --/PW res: [0x2bfd3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240177:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.240178:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529917.240179:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054ed0749 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+131:39030:x1731745946818240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 90us (164us total) trans 21474837104 rc 0/0 00010000:00010000:0.0:1651529917.240179:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067d657cd/0x3234de053c55596 lrc: 3/0,1 mode: PW/PW res: [0x2bfd3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.240182:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 653 00010000:00010000:0.0:1651529917.240183:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067d657cd/0x3234de053c55596 lrc: 3/0,1 mode: PW/PW res: [0x2bfd3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240186:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067d657cd/0x3234de053c55596 lrc: 3/0,1 mode: PW/PW res: [0x2bfd3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.240188:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 655 00010000:00010000:0.0:1651529917.240188:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067d657cd/0x3234de053c55596 lrc: 2/0,0 mode: PW/PW res: [0x2bfd3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.240189:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a8bb9985 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+130:39030:x1731745946818304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.240200:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180178 count 1 00002000:00010000:1.0:1651529917.240205:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfd2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.240207:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c5559d lrc: 3/0,1 mode: --/PW res: [0x2bfd2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240210:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.240211:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.240212:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c5559d lrc: 3/0,1 mode: PW/PW res: [0x2bfd2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240216:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c5559d lrc: 3/0,1 mode: PW/PW res: [0x2bfd2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240219:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c5559d lrc: 3/0,1 mode: PW/PW res: [0x2bfd2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240221:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c5559d lrc: 2/0,0 mode: PW/PW res: [0x2bfd2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.240245:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057d84ac9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+131:39029:x1731745946818368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 118us (185us total) trans 21474837105 rc 0/0 00000100:00100000:0.0:1651529917.240248:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 654 00010000:00010000:0.0:1651529917.240258:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000990cd87d/0x3234de053c55588 lrc: 2/0,0 mode: PW/PW res: [0x2bfd0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240262:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000990cd87d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.240263:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000990cd87d/0x3234de053c55588 lrc: 2/0,0 mode: PW/PW res: [0x2bfd0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240265:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000990cd87d/0x3234de053c55588 lrc: 3/0,0 mode: PW/PW res: [0x2bfd0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240270:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000990cd87d/0x3234de053c55588 lrc: 1/0,0 mode: --/PW res: [0x2bfd0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.240271:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a8bb9985 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+131:39030:x1731745946818304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 80us (200us total) trans 21474837106 rc 0/0 00010000:00010000:0.0:1651529917.240273:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000990cd87d/0x3234de053c55588 lrc: 0/0,0 mode: --/PW res: [0x2bfd0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.240275:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 655 00010000:00010000:0.0:1651529917.240277:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5558f lrc: 2/0,0 mode: PW/PW res: [0x2bfd1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240283:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067d657cd/0x3234de053c55596 lrc: 2/0,0 mode: PW/PW res: [0x2bfd3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240286:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067d657cd already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.240287:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067d657cd/0x3234de053c55596 lrc: 2/0,0 mode: PW/PW res: [0x2bfd3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240290:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067d657cd/0x3234de053c55596 lrc: 3/0,0 mode: PW/PW res: [0x2bfd3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240294:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d37a9fd1 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.240295:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067d657cd/0x3234de053c55596 lrc: 1/0,0 mode: --/PW res: [0x2bfd3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240296:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5558f lrc: 2/0,0 mode: PW/PW res: [0x2bfd1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240297:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067d657cd/0x3234de053c55596 lrc: 0/0,0 mode: --/PW res: [0x2bfd3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240299:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5558f lrc: 3/0,0 mode: PW/PW res: [0x2bfd1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240301:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c5559d lrc: 2/0,0 mode: PW/PW res: [0x2bfd2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240304:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001d04fb0a already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.240305:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c5559d lrc: 2/0,0 mode: PW/PW res: [0x2bfd2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240308:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c5559d lrc: 3/0,0 mode: PW/PW res: [0x2bfd2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240311:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5558f lrc: 1/0,0 mode: --/PW res: [0x2bfd1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240314:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c5559d lrc: 1/0,0 mode: --/PW res: [0x2bfd2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240314:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c5558f lrc: 0/0,0 mode: --/PW res: [0x2bfd1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240317:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c5559d lrc: 0/0,0 mode: --/PW res: [0x2bfd2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.240350:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.240361:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946818944 00000100:00100000:1.0:1651529917.240366:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.240378:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946819008 00000100:00100000:0.0:1651529917.240383:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 656 00000100:00100000:0.0:1651529917.240385:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+132:39030:x1731745946818944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529917.240386:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529917.240390:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180180 count 1 00002000:00010000:0.0:1651529917.240395:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfd4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.240396:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c555a4 lrc: 3/0,1 mode: --/PW res: [0x2bfd4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240400:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.240401:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.240402:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c555a4 lrc: 3/0,1 mode: PW/PW res: [0x2bfd4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240405:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c555a4 lrc: 3/0,1 mode: PW/PW res: [0x2bfd4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240408:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c555a4 lrc: 3/0,1 mode: PW/PW res: [0x2bfd4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240411:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c555a4 lrc: 2/0,0 mode: PW/PW res: [0x2bfd4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.240412:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.240438:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946819072 00000100:00100000:1.0:1651529917.240443:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946819136 00000100:00100000:1.0:1651529917.240446:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 657 00000100:00100000:1.0:1651529917.240448:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+135:39029:x1731745946819008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529917.240454:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+135:39030:x1731745946818944:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 68us (104us total) trans 21474837107 rc 0/0 00000100:00100000:0.0:1651529917.240457:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 656 00002000:00080000:1.0:1651529917.240458:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180181 count 1 00000100:00100000:0.0:1651529917.240463:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 658 00002000:00010000:1.0:1651529917.240464:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfd5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1651529917.240465:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+134:39030:x1731745946819072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529917.240466:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c555ab lrc: 3/0,1 mode: --/PW res: [0x2bfd5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240469:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.240470:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:0.0:1651529917.240470:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180182 count 1 00010000:00010000:1.0:1651529917.240471:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c555ab lrc: 3/0,1 mode: PW/PW res: [0x2bfd5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.240474:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfd6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.240475:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c555ab lrc: 3/0,1 mode: PW/PW res: [0x2bfd5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240476:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c555b2 lrc: 3/0,1 mode: --/PW res: [0x2bfd6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240479:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.240480:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c555ab lrc: 3/0,1 mode: PW/PW res: [0x2bfd5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240480:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.240481:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c555b2 lrc: 3/0,1 mode: PW/PW res: [0x2bfd6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240483:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c555ab lrc: 2/0,0 mode: PW/PW res: [0x2bfd5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240484:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c555b2 lrc: 3/0,1 mode: PW/PW res: [0x2bfd6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240503:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c555b2 lrc: 3/0,1 mode: PW/PW res: [0x2bfd6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240506:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c555b2 lrc: 2/0,0 mode: PW/PW res: [0x2bfd6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.240520:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+135:39029:x1731745946819008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 71us (154us total) trans 21474837108 rc 0/0 00000100:00100000:1.0:1651529917.240523:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 657 00000100:00100000:1.0:1651529917.240529:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 659 00000100:00100000:1.0:1651529917.240530:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+135:39030:x1731745946819136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.240534:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180183 count 1 00002000:00010000:1.0:1651529917.240539:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfd7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.240540:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c555b9 lrc: 3/0,1 mode: --/PW res: [0x2bfd7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.240543:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+135:39030:x1731745946819072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 78us (157us total) trans 21474837109 rc 0/0 00010000:00010000:1.0:1651529917.240544:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.240544:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.240545:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c555b9 lrc: 3/0,1 mode: PW/PW res: [0x2bfd7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.240546:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 658 00010000:00010000:1.0:1651529917.240549:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c555b9 lrc: 3/0,1 mode: PW/PW res: [0x2bfd7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240552:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c555b9 lrc: 3/0,1 mode: PW/PW res: [0x2bfd7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240554:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c555a4 lrc: 2/0,0 mode: PW/PW res: [0x2bfd4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240557:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c555b9 lrc: 2/0,0 mode: PW/PW res: [0x2bfd7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240557:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000820e2b3d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.240559:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c555a4 lrc: 2/0,0 mode: PW/PW res: [0x2bfd4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240561:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c555a4 lrc: 3/0,0 mode: PW/PW res: [0x2bfd4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240566:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c555a4 lrc: 1/0,0 mode: --/PW res: [0x2bfd4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240569:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c555a4 lrc: 0/0,0 mode: --/PW res: [0x2bfd4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240573:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c555ab lrc: 2/0,0 mode: PW/PW res: [0x2bfd5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240576:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d1167ce5 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.240577:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c555ab lrc: 2/0,0 mode: PW/PW res: [0x2bfd5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240580:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c555ab lrc: 3/0,0 mode: PW/PW res: [0x2bfd5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240583:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c555ab lrc: 1/0,0 mode: --/PW res: [0x2bfd5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240585:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c555ab lrc: 0/0,0 mode: --/PW res: [0x2bfd5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.240588:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+135:39030:x1731745946819136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 57us (176us total) trans 21474837110 rc 0/0 00010000:00010000:0.0:1651529917.240589:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c555b2 lrc: 2/0,0 mode: PW/PW res: [0x2bfd6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.240591:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 659 00010000:00010000:0.0:1651529917.240591:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054295afd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.240592:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c555b2 lrc: 2/0,0 mode: PW/PW res: [0x2bfd6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240598:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c555b9 lrc: 2/0,0 mode: PW/PW res: [0x2bfd7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240602:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009fff0bd3 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.240603:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c555b9 lrc: 2/0,0 mode: PW/PW res: [0x2bfd7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240606:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c555b9 lrc: 3/0,0 mode: PW/PW res: [0x2bfd7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240615:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c555b2 lrc: 3/0,0 mode: PW/PW res: [0x2bfd6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240617:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c555b9 lrc: 1/0,0 mode: --/PW res: [0x2bfd7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240619:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c555b2 lrc: 1/0,0 mode: --/PW res: [0x2bfd6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240621:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c555b9 lrc: 0/0,0 mode: --/PW res: [0x2bfd7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240622:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c555b2 lrc: 0/0,0 mode: --/PW res: [0x2bfd6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.240636:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.240653:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.240676:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946819328 00000100:00100000:1.0:1651529917.240678:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.240691:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946819392 00000100:00100000:0.0:1651529917.240694:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946819520 00000100:00100000:0.0:1651529917.240697:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 660 00000100:00100000:0.0:1651529917.240699:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002db8a000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+137:39030:x1731745946819328:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.240704:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180184 count 1 00002000:00010000:0.0:1651529917.240709:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfd8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529917.240711:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.240711:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c555c0 lrc: 3/0,1 mode: --/PW res: [0x2bfd8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240714:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.240715:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.240716:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c555c0 lrc: 3/0,1 mode: PW/PW res: [0x2bfd8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240719:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c555c0 lrc: 3/0,1 mode: PW/PW res: [0x2bfd8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240722:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c555c0 lrc: 3/0,1 mode: PW/PW res: [0x2bfd8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240725:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c555c0 lrc: 2/0,0 mode: PW/PW res: [0x2bfd8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240742:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c555c0 lrc: 2/0,0 mode: PW/PW res: [0x2bfd8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240746:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000029e40f3d already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.240747:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c555c0 lrc: 2/0,0 mode: PW/PW res: [0x2bfd8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240750:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c555c0 lrc: 3/0,0 mode: PW/PW res: [0x2bfd8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240755:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c555c0 lrc: 1/0,0 mode: --/PW res: [0x2bfd8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240758:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c555c0 lrc: 0/0,0 mode: --/PW res: [0x2bfd8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.240766:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946819584 00000100:00100000:1.0:1651529917.240777:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 661 00000100:00100000:1.0:1651529917.240779:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+139:39029:x1731745946819392:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.240784:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180185 count 1 00000100:00100000:0.0:1651529917.240785:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002db8a000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+139:39030:x1731745946819328:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 84us (148us total) trans 21474837111 rc 0/0 00002000:00010000:1.0:1651529917.240788:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfd9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1651529917.240788:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 660 00010000:00010000:1.0:1651529917.240790:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c555c7 lrc: 3/0,1 mode: --/PW res: [0x2bfd9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240793:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.240794:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529917.240794:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 662 00010000:00010000:1.0:1651529917.240795:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c555c7 lrc: 3/0,1 mode: PW/PW res: [0x2bfd9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.240795:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009f35d921 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+138:39029:x1731745946819520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529917.240800:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c555c7 lrc: 3/0,1 mode: PW/PW res: [0x2bfd9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.240800:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180186 count 1 00010000:00010000:1.0:1651529917.240803:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c555c7 lrc: 3/0,1 mode: PW/PW res: [0x2bfd9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.240805:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfda:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.240806:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c555c7 lrc: 2/0,0 mode: PW/PW res: [0x2bfd9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240807:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c555ce lrc: 3/0,1 mode: --/PW res: [0x2bfda:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240810:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.240811:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.240812:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c555ce lrc: 3/0,1 mode: PW/PW res: [0x2bfda:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240824:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c555ce lrc: 3/0,1 mode: PW/PW res: [0x2bfda:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240827:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c555ce lrc: 3/0,1 mode: PW/PW res: [0x2bfda:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240830:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c555ce lrc: 2/0,0 mode: PW/PW res: [0x2bfda:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.240848:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+140:39029:x1731745946819392:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 68us (195us total) trans 21474837112 rc 0/0 00000100:00100000:1.0:1651529917.240851:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 661 00000100:00100000:1.0:1651529917.240856:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 663 00000100:00100000:1.0:1651529917.240858:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+139:39030:x1731745946819584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.240862:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180187 count 1 00002000:00010000:1.0:1651529917.240866:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfdb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1651529917.240867:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009f35d921 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+139:39029:x1731745946819520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 70us (189us total) trans 21474837113 rc 0/0 00010000:00010000:1.0:1651529917.240868:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c555d5 lrc: 3/0,1 mode: --/PW res: [0x2bfdb:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.240870:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 662 00010000:00010000:1.0:1651529917.240871:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.240872:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.240873:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c555d5 lrc: 3/0,1 mode: PW/PW res: [0x2bfdb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240876:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c555d5 lrc: 3/0,1 mode: PW/PW res: [0x2bfdb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240878:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c555c7 lrc: 2/0,0 mode: PW/PW res: [0x2bfd9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240881:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cde7e11a already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.240882:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c555d5 lrc: 3/0,1 mode: PW/PW res: [0x2bfdb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240882:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c555c7 lrc: 2/0,0 mode: PW/PW res: [0x2bfd9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.240884:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c555d5 lrc: 2/0,0 mode: PW/PW res: [0x2bfdb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240885:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c555c7 lrc: 3/0,0 mode: PW/PW res: [0x2bfd9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240890:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c555c7 lrc: 1/0,0 mode: --/PW res: [0x2bfd9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240892:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c555c7 lrc: 0/0,0 mode: --/PW res: [0x2bfd9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240897:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c555ce lrc: 2/0,0 mode: PW/PW res: [0x2bfda:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240900:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005532ef34 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.240901:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c555ce lrc: 2/0,0 mode: PW/PW res: [0x2bfda:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240903:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c555ce lrc: 3/0,0 mode: PW/PW res: [0x2bfda:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240906:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c555ce lrc: 1/0,0 mode: --/PW res: [0x2bfda:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240909:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c555ce lrc: 0/0,0 mode: --/PW res: [0x2bfda:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240912:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c555d5 lrc: 2/0,0 mode: PW/PW res: [0x2bfdb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240915:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002d7487dc already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.240916:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c555d5 lrc: 2/0,0 mode: PW/PW res: [0x2bfdb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.240919:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+139:39030:x1731745946819584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 61us (208us total) trans 21474837114 rc 0/0 00010000:00010000:0.0:1651529917.240919:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c555d5 lrc: 3/0,0 mode: PW/PW res: [0x2bfdb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.240922:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 663 00010000:00010000:0.0:1651529917.240922:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c555d5 lrc: 1/0,0 mode: --/PW res: [0x2bfdb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.240924:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c555d5 lrc: 0/0,0 mode: --/PW res: [0x2bfdb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.240987:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.240998:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946819712 00000100:00100000:0.0:1651529917.241009:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 664 00000100:00100000:0.0:1651529917.241010:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+139:39030:x1731745946819712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.241016:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180189 count 1 00002000:00010000:0.0:1651529917.241021:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfdd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.241022:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c555dc lrc: 3/0,1 mode: --/PW res: [0x2bfdd:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.241025:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.241025:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.241026:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.241027:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c555dc lrc: 3/0,1 mode: PW/PW res: [0x2bfdd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.241035:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.241049:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c555dc lrc: 3/0,1 mode: PW/PW res: [0x2bfdd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.241052:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.241053:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c555dc lrc: 3/0,1 mode: PW/PW res: [0x2bfdd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241056:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c555dc lrc: 2/0,0 mode: PW/PW res: [0x2bfdd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.241058:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946819840 00000100:00100000:1.0:1651529917.241064:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946819648 00000100:00100000:1.0:1651529917.241066:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946819776 00000100:00100000:1.0:1651529917.241069:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 665 00000100:00100000:1.0:1651529917.241070:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+142:39030:x1731745946819840:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.241076:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180191 count 1 00002000:00010000:1.0:1651529917.241081:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfdf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.241082:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c555e3 lrc: 3/0,1 mode: --/PW res: [0x2bfdf:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241086:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.241087:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.241087:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c555e3 lrc: 3/0,1 mode: PW/PW res: [0x2bfdf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241094:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c555e3 lrc: 3/0,1 mode: PW/PW res: [0x2bfdf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241097:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c555e3 lrc: 3/0,1 mode: PW/PW res: [0x2bfdf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241099:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c555e3 lrc: 2/0,0 mode: PW/PW res: [0x2bfdf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.241117:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+143:39030:x1731745946819712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 105us (129us total) trans 21474837115 rc 0/0 00000100:00100000:0.0:1651529917.241120:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 664 00000100:00100000:0.0:1651529917.241125:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 666 00000100:00100000:0.0:1651529917.241127:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000035f3f4bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+143:39030:x1731745946819648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.241132:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180188 count 1 00002000:00010000:0.0:1651529917.241136:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfdc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.241138:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c555ea lrc: 3/0,1 mode: --/PW res: [0x2bfdc:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241142:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.241142:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.241143:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c555ea lrc: 3/0,1 mode: PW/PW res: [0x2bfdc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.241145:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+143:39030:x1731745946819840:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 73us (119us total) trans 21474837116 rc 0/0 00010000:00010000:0.0:1651529917.241147:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c555ea lrc: 3/0,1 mode: PW/PW res: [0x2bfdc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.241148:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 665 00010000:00010000:0.0:1651529917.241150:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c555ea lrc: 3/0,1 mode: PW/PW res: [0x2bfdc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.241153:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 667 00000100:00100000:1.0:1651529917.241155:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+142:39030:x1731745946819776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529917.241155:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c555ea lrc: 2/0,0 mode: PW/PW res: [0x2bfdc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.241159:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180190 count 1 00002000:00010000:1.0:1651529917.241164:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfde:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.241165:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c555f1 lrc: 3/0,1 mode: --/PW res: [0x2bfde:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241169:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.241169:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.241170:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c555f1 lrc: 3/0,1 mode: PW/PW res: [0x2bfde:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241174:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c555f1 lrc: 3/0,1 mode: PW/PW res: [0x2bfde:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241179:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c555f1 lrc: 3/0,1 mode: PW/PW res: [0x2bfde:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241182:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c555f1 lrc: 2/0,0 mode: PW/PW res: [0x2bfde:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.241192:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000035f3f4bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+143:39030:x1731745946819648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 64us (156us total) trans 21474837117 rc 0/0 00000100:00100000:0.0:1651529917.241195:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 666 00010000:00010000:0.0:1651529917.241203:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c555dc lrc: 2/0,0 mode: PW/PW res: [0x2bfdd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241206:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fcafd1a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.241207:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c555dc lrc: 2/0,0 mode: PW/PW res: [0x2bfdd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241210:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c555dc lrc: 3/0,0 mode: PW/PW res: [0x2bfdd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.241214:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+143:39030:x1731745946819776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 58us (162us total) trans 21474837118 rc 0/0 00010000:00010000:0.0:1651529917.241214:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c555dc lrc: 1/0,0 mode: --/PW res: [0x2bfdd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.241217:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 667 00010000:00010000:0.0:1651529917.241217:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c555dc lrc: 0/0,0 mode: --/PW res: [0x2bfdd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241242:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c555e3 lrc: 2/0,0 mode: PW/PW res: [0x2bfdf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241245:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009882f227 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.241246:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c555ea lrc: 2/0,0 mode: PW/PW res: [0x2bfdc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241246:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c555e3 lrc: 2/0,0 mode: PW/PW res: [0x2bfdf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241249:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c555e3 lrc: 3/0,0 mode: PW/PW res: [0x2bfdf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241250:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2a86deb already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.241251:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c555ea lrc: 2/0,0 mode: PW/PW res: [0x2bfdc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241252:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c555e3 lrc: 1/0,0 mode: --/PW res: [0x2bfdf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241254:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c555ea lrc: 3/0,0 mode: PW/PW res: [0x2bfdc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241255:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c555e3 lrc: 0/0,0 mode: --/PW res: [0x2bfdf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241259:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c555ea lrc: 1/0,0 mode: --/PW res: [0x2bfdc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241259:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c555f1 lrc: 2/0,0 mode: PW/PW res: [0x2bfde:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241262:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c555ea lrc: 0/0,0 mode: --/PW res: [0x2bfdc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241262:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c660975a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.241262:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c555f1 lrc: 2/0,0 mode: PW/PW res: [0x2bfde:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241265:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c555f1 lrc: 3/0,0 mode: PW/PW res: [0x2bfde:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241269:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c555f1 lrc: 1/0,0 mode: --/PW res: [0x2bfde:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241271:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c555f1 lrc: 0/0,0 mode: --/PW res: [0x2bfde:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.241340:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.241350:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946820480 00000100:00100000:1.0:1651529917.241351:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.241358:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.241358:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946820608 00000100:00100000:1.0:1651529917.241368:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.241373:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946820416 00000100:00100000:1.0:1651529917.241379:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946820544 00000100:00100000:0.0:1651529917.241382:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 668 00000100:00100000:0.0:1651529917.241383:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017e3b33f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+146:39030:x1731745946820480:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529917.241384:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 669 00000100:00100000:1.0:1651529917.241385:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e30915ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+146:39030:x1731745946820608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.241389:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180193 count 1 00002000:00080000:1.0:1651529917.241391:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180195 count 1 00002000:00010000:0.0:1651529917.241394:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfe1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:1.0:1651529917.241396:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfe3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.241396:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c555f8 lrc: 3/0,1 mode: --/PW res: [0x2bfe1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241398:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c555ff lrc: 3/0,1 mode: --/PW res: [0x2bfe3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241399:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.241400:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.241401:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.241401:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c555f8 lrc: 3/0,1 mode: PW/PW res: [0x2bfe1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241402:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.241403:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c555ff lrc: 3/0,1 mode: PW/PW res: [0x2bfe3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241404:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c555f8 lrc: 3/0,1 mode: PW/PW res: [0x2bfe1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241407:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c555ff lrc: 3/0,1 mode: PW/PW res: [0x2bfe3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241407:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c555f8 lrc: 3/0,1 mode: PW/PW res: [0x2bfe1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241410:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c555ff lrc: 3/0,1 mode: PW/PW res: [0x2bfe3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241410:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c555f8 lrc: 2/0,0 mode: PW/PW res: [0x2bfe1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241413:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c555ff lrc: 2/0,0 mode: PW/PW res: [0x2bfe3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.241463:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017e3b33f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+148:39030:x1731745946820480:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 78us (123us total) trans 21474837119 rc 0/0 00000100:00100000:0.0:1651529917.241466:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 668 00000100:00100000:1.0:1651529917.241469:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e30915ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+147:39030:x1731745946820608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 83us (118us total) trans 21474837120 rc 0/0 00000100:00100000:0.0:1651529917.241471:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 670 00000100:00100000:1.0:1651529917.241473:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 669 00000100:00100000:0.0:1651529917.241473:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008270c7c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+147:39029:x1731745946820416:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.241478:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180192 count 1 00000100:00100000:1.0:1651529917.241479:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 671 00000100:00100000:1.0:1651529917.241481:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+146:39029:x1731745946820544:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00010000:0.0:1651529917.241483:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfe0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00080000:1.0:1651529917.241485:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180194 count 1 00010000:00010000:0.0:1651529917.241485:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55606 lrc: 3/0,1 mode: --/PW res: [0x2bfe0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241488:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.241489:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00010000:1.0:1651529917.241490:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfe2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.241490:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55606 lrc: 3/0,1 mode: PW/PW res: [0x2bfe0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241491:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c5560d lrc: 3/0,1 mode: --/PW res: [0x2bfe2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241493:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55606 lrc: 3/0,1 mode: PW/PW res: [0x2bfe0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241495:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.241496:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.241496:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55606 lrc: 3/0,1 mode: PW/PW res: [0x2bfe0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241497:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c5560d lrc: 3/0,1 mode: PW/PW res: [0x2bfe2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241499:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55606 lrc: 2/0,0 mode: PW/PW res: [0x2bfe0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241500:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c5560d lrc: 3/0,1 mode: PW/PW res: [0x2bfe2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241503:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c5560d lrc: 3/0,1 mode: PW/PW res: [0x2bfe2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241506:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c5560d lrc: 2/0,0 mode: PW/PW res: [0x2bfe2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.241558:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+148:39029:x1731745946820544:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 77us (190us total) trans 21474837121 rc 0/0 00000100:00100000:1.0:1651529917.241561:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 671 00010000:00010000:1.0:1651529917.241568:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c555f8 lrc: 2/0,0 mode: PW/PW res: [0x2bfe1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241572:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c0de17df already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.241573:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c555f8 lrc: 2/0,0 mode: PW/PW res: [0x2bfe1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.241574:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008270c7c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+147:39029:x1731745946820416:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 100us (215us total) trans 21474837122 rc 0/0 00010000:00010000:1.0:1651529917.241576:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c555f8 lrc: 3/0,0 mode: PW/PW res: [0x2bfe1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.241577:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 670 00010000:00010000:1.0:1651529917.241581:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c555f8 lrc: 1/0,0 mode: --/PW res: [0x2bfe1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241584:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c555f8 lrc: 0/0,0 mode: --/PW res: [0x2bfe1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241588:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c555ff lrc: 2/0,0 mode: PW/PW res: [0x2bfe3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241591:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e4f40ecf already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.241591:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c555ff lrc: 2/0,0 mode: PW/PW res: [0x2bfe3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241594:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c555ff lrc: 3/0,0 mode: PW/PW res: [0x2bfe3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241597:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c555ff lrc: 1/0,0 mode: --/PW res: [0x2bfe3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241597:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c5560d lrc: 2/0,0 mode: PW/PW res: [0x2bfe2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241600:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c555ff lrc: 0/0,0 mode: --/PW res: [0x2bfe3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241601:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000041a7efd7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.241602:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c5560d lrc: 2/0,0 mode: PW/PW res: [0x2bfe2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241603:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55606 lrc: 2/0,0 mode: PW/PW res: [0x2bfe0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241605:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c5560d lrc: 3/0,0 mode: PW/PW res: [0x2bfe2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241606:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004678bff1 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.241607:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55606 lrc: 2/0,0 mode: PW/PW res: [0x2bfe0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241610:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55606 lrc: 3/0,0 mode: PW/PW res: [0x2bfe0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241610:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c5560d lrc: 1/0,0 mode: --/PW res: [0x2bfe2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241613:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55606 lrc: 1/0,0 mode: --/PW res: [0x2bfe0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241613:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c5560d lrc: 0/0,0 mode: --/PW res: [0x2bfe2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241615:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55606 lrc: 0/0,0 mode: --/PW res: [0x2bfe0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.241628:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.241640:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946820736 00000100:00100000:1.0:1651529917.241647:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.241647:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 672 00000100:00100000:0.0:1651529917.241649:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e093a181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+147:39030:x1731745946820736:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529917.241658:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529917.241659:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180196 count 1 00002000:00010000:0.0:1651529917.241664:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfe4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.241665:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55614 lrc: 3/0,1 mode: --/PW res: [0x2bfe4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241669:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.241670:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.241670:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55614 lrc: 3/0,1 mode: PW/PW res: [0x2bfe4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241674:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55614 lrc: 3/0,1 mode: PW/PW res: [0x2bfe4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241677:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55614 lrc: 3/0,1 mode: PW/PW res: [0x2bfe4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241679:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55614 lrc: 2/0,0 mode: PW/PW res: [0x2bfe4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.241689:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.241716:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946820800 00000100:00100000:1.0:1651529917.241721:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946820864 00000100:00100000:0.0:1651529917.241726:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e093a181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+149:39030:x1731745946820736:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 76us (97us total) trans 21474837123 rc 0/0 00000100:00100000:1.0:1651529917.241729:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946820928 00000100:00100000:0.0:1651529917.241729:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 672 00000100:00100000:1.0:1651529917.241732:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 673 00000100:00100000:1.0:1651529917.241734:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054267da8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+150:39030:x1731745946820800:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529917.241735:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 674 00000100:00100000:0.0:1651529917.241736:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004e83cb77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+150:39030:x1731745946820864:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.241739:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180197 count 1 00002000:00080000:0.0:1651529917.241741:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180198 count 1 00002000:00010000:1.0:1651529917.241743:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfe5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.241745:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c5561b lrc: 3/0,1 mode: --/PW res: [0x2bfe5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.241746:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfe6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.241748:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55622 lrc: 3/0,1 mode: --/PW res: [0x2bfe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241751:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.241751:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.241752:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.241752:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.241753:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c5561b lrc: 3/0,1 mode: PW/PW res: [0x2bfe5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241753:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55622 lrc: 3/0,1 mode: PW/PW res: [0x2bfe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241756:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c5561b lrc: 3/0,1 mode: PW/PW res: [0x2bfe5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241756:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55622 lrc: 3/0,1 mode: PW/PW res: [0x2bfe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241759:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c5561b lrc: 3/0,1 mode: PW/PW res: [0x2bfe5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241759:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55622 lrc: 3/0,1 mode: PW/PW res: [0x2bfe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241762:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c5561b lrc: 2/0,0 mode: PW/PW res: [0x2bfe5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241762:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55622 lrc: 2/0,0 mode: PW/PW res: [0x2bfe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.241802:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054267da8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+152:39030:x1731745946820800:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 67us (155us total) trans 21474837125 rc 0/0 00000100:00100000:1.0:1651529917.241805:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 673 00000100:00100000:1.0:1651529917.241810:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 675 00000100:00100000:1.0:1651529917.241811:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+151:39030:x1731745946820928:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.241815:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180199 count 1 00000100:00100000:0.0:1651529917.241816:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004e83cb77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+151:39030:x1731745946820864:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 78us (157us total) trans 21474837124 rc 0/0 00002000:00010000:1.0:1651529917.241820:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfe7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1651529917.241821:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 674 00010000:00010000:1.0:1651529917.241822:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c55629 lrc: 3/0,1 mode: --/PW res: [0x2bfe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241825:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.241826:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.241827:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c55629 lrc: 3/0,1 mode: PW/PW res: [0x2bfe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241829:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55614 lrc: 2/0,0 mode: PW/PW res: [0x2bfe4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241830:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c55629 lrc: 3/0,1 mode: PW/PW res: [0x2bfe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241832:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2d8d18b already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.241833:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c55629 lrc: 3/0,1 mode: PW/PW res: [0x2bfe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241833:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55614 lrc: 2/0,0 mode: PW/PW res: [0x2bfe4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241836:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c55629 lrc: 2/0,0 mode: PW/PW res: [0x2bfe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241836:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55614 lrc: 3/0,0 mode: PW/PW res: [0x2bfe4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241841:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55614 lrc: 1/0,0 mode: --/PW res: [0x2bfe4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241843:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55614 lrc: 0/0,0 mode: --/PW res: [0x2bfe4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241847:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55622 lrc: 2/0,0 mode: PW/PW res: [0x2bfe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241850:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000062f8a534 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.241851:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55622 lrc: 2/0,0 mode: PW/PW res: [0x2bfe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241854:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55622 lrc: 3/0,0 mode: PW/PW res: [0x2bfe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241859:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55622 lrc: 1/0,0 mode: --/PW res: [0x2bfe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241862:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55622 lrc: 0/0,0 mode: --/PW res: [0x2bfe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241865:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c5561b lrc: 2/0,0 mode: PW/PW res: [0x2bfe5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.241867:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+151:39030:x1731745946820928:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 55us (178us total) trans 21474837126 rc 0/0 00010000:00010000:0.0:1651529917.241868:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d2b9655c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.241869:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c5561b lrc: 2/0,0 mode: PW/PW res: [0x2bfe5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.241870:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 675 00010000:00010000:0.0:1651529917.241871:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c5561b lrc: 3/0,0 mode: PW/PW res: [0x2bfe5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241874:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c5561b lrc: 1/0,0 mode: --/PW res: [0x2bfe5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241877:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c55629 lrc: 2/0,0 mode: PW/PW res: [0x2bfe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.241877:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c5561b lrc: 0/0,0 mode: --/PW res: [0x2bfe5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241880:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001b109cb1 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.241881:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c55629 lrc: 2/0,0 mode: PW/PW res: [0x2bfe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241884:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c55629 lrc: 3/0,0 mode: PW/PW res: [0x2bfe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241888:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c55629 lrc: 1/0,0 mode: --/PW res: [0x2bfe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.241891:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c55629 lrc: 0/0,0 mode: --/PW res: [0x2bfe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.242016:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.242026:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946821440 00000100:00100000:1.0:1651529917.242027:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.242033:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946821376 00000100:00100000:1.0:1651529917.242035:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 676 00000100:00100000:1.0:1651529917.242045:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6309896 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+152:39029:x1731745946821440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529917.242048:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 677 00002000:00080000:1.0:1651529917.242050:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180201 count 1 00000100:00100000:0.0:1651529917.242050:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000081a471dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+152:39030:x1731745946821376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00010000:1.0:1651529917.242055:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfe9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.242057:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c55630 lrc: 3/0,1 mode: --/PW res: [0x2bfe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.242057:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180200 count 1 00010000:00010000:1.0:1651529917.242061:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.242061:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.242062:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c55630 lrc: 3/0,1 mode: PW/PW res: [0x2bfe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.242062:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfe8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.242063:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c55637 lrc: 3/0,1 mode: --/PW res: [0x2bfe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242066:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c55630 lrc: 3/0,1 mode: PW/PW res: [0x2bfe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242067:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.242068:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.242068:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c55637 lrc: 3/0,1 mode: PW/PW res: [0x2bfe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242069:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c55630 lrc: 3/0,1 mode: PW/PW res: [0x2bfe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242071:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c55630 lrc: 2/0,0 mode: PW/PW res: [0x2bfe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242072:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c55637 lrc: 3/0,1 mode: PW/PW res: [0x2bfe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242075:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c55637 lrc: 3/0,1 mode: PW/PW res: [0x2bfe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242084:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c55637 lrc: 2/0,0 mode: PW/PW res: [0x2bfe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.242113:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6309896 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+154:39029:x1731745946821440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 67us (97us total) trans 21474837127 rc 0/0 00000100:00100000:1.0:1651529917.242116:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 676 00000100:00100000:0.0:1651529917.242123:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000081a471dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+153:39030:x1731745946821376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 72us (96us total) trans 21474837128 rc 0/0 00000100:00100000:0.0:1651529917.242126:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 677 00010000:00010000:0.0:1651529917.242135:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c55630 lrc: 2/0,0 mode: PW/PW res: [0x2bfe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242168:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002e24dea3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.242170:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c55630 lrc: 2/0,0 mode: PW/PW res: [0x2bfe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242175:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c55630 lrc: 3/0,0 mode: PW/PW res: [0x2bfe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242180:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c55630 lrc: 1/0,0 mode: --/PW res: [0x2bfe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.242186:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.242199:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c55630 lrc: 0/0,0 mode: --/PW res: [0x2bfe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.242201:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.242209:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.242209:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c55637 lrc: 2/0,0 mode: PW/PW res: [0x2bfe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242212:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000003af78ab already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.242213:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c55637 lrc: 2/0,0 mode: PW/PW res: [0x2bfe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242216:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c55637 lrc: 3/0,0 mode: PW/PW res: [0x2bfe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.242217:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.242220:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c55637 lrc: 1/0,0 mode: --/PW res: [0x2bfe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.242236:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.242243:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946821632 00010000:00010000:0.0:1651529917.242251:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c55637 lrc: 0/0,0 mode: --/PW res: [0x2bfe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.242253:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946821568 00000100:00100000:1.0:1651529917.242256:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946821760 00000100:00100000:1.0:1651529917.242258:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946821888 00000100:00100000:1.0:1651529917.242260:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946821696 00000100:00100000:0.0:1651529917.242263:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 678 00000100:00100000:0.0:1651529917.242265:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000362c2e4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+157:39030:x1731745946821632:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529917.242266:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 679 00000100:00100000:1.0:1651529917.242267:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+157:39030:x1731745946821568:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.242270:0:166112:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180203 count 1 00002000:00080000:1.0:1651529917.242272:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180202 count 1 00002000:00010000:0.0:1651529917.242275:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfeb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:1.0:1651529917.242277:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.242277:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c5563e lrc: 3/0,1 mode: --/PW res: [0x2bfeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242279:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c55645 lrc: 3/0,1 mode: --/PW res: [0x2bfea:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242280:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.242280:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.242281:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c5563e lrc: 3/0,1 mode: PW/PW res: [0x2bfeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242283:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.242283:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.242284:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c55645 lrc: 3/0,1 mode: PW/PW res: [0x2bfea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242285:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c5563e lrc: 3/0,1 mode: PW/PW res: [0x2bfeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242288:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c55645 lrc: 3/0,1 mode: PW/PW res: [0x2bfea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242288:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c5563e lrc: 3/0,1 mode: PW/PW res: [0x2bfeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242291:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c55645 lrc: 3/0,1 mode: PW/PW res: [0x2bfea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242291:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c5563e lrc: 2/0,0 mode: PW/PW res: [0x2bfeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242294:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c55645 lrc: 2/0,0 mode: PW/PW res: [0x2bfea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.242343:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+159:39030:x1731745946821568:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 74us (141us total) trans 21474837130 rc 0/0 00000100:00100000:1.0:1651529917.242355:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 679 00000100:00100000:1.0:1651529917.242360:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 680 00000100:00100000:1.0:1651529917.242362:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdd939a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+158:39030:x1731745946821760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529917.242365:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000362c2e4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+158:39030:x1731745946821632:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 99us (185us total) trans 21474837129 rc 0/0 00002000:00080000:1.0:1651529917.242366:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180205 count 1 00000100:00100000:0.0:1651529917.242368:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 678 00002000:00010000:1.0:1651529917.242371:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.242373:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c5564c lrc: 3/0,1 mode: --/PW res: [0x2bfed:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.242374:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 681 00000100:00100000:0.0:1651529917.242375:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+157:39030:x1731745946821888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529917.242377:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.242377:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.242378:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c5564c lrc: 3/0,1 mode: PW/PW res: [0x2bfed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.242380:0:166112:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180207 count 1 00010000:00010000:1.0:1651529917.242382:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c5564c lrc: 3/0,1 mode: PW/PW res: [0x2bfed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.242384:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.242385:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c5564c lrc: 3/0,1 mode: PW/PW res: [0x2bfed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242386:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55653 lrc: 3/0,1 mode: --/PW res: [0x2bfef:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242387:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c5564c lrc: 2/0,0 mode: PW/PW res: [0x2bfed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242390:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.242390:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.242391:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55653 lrc: 3/0,1 mode: PW/PW res: [0x2bfef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242395:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55653 lrc: 3/0,1 mode: PW/PW res: [0x2bfef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242398:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55653 lrc: 3/0,1 mode: PW/PW res: [0x2bfef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242401:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55653 lrc: 2/0,0 mode: PW/PW res: [0x2bfef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.242421:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdd939a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+159:39030:x1731745946821760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 58us (211us total) trans 21474837131 rc 0/0 00000100:00100000:1.0:1651529917.242425:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 680 00000100:00100000:1.0:1651529917.242430:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 682 00000100:00100000:1.0:1651529917.242432:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000020f0e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+158:39030:x1731745946821696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529917.242434:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+158:39030:x1731745946821888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 58us (217us total) trans 21474837132 rc 0/0 00002000:00080000:1.0:1651529917.242436:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180204 count 1 00000100:00100000:0.0:1651529917.242437:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 681 00002000:00010000:1.0:1651529917.242440:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.242441:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c5565a lrc: 3/0,1 mode: --/PW res: [0x2bfec:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242445:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.242445:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.242445:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c5563e lrc: 2/0,0 mode: PW/PW res: [0x2bfeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242446:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c5565a lrc: 3/0,1 mode: PW/PW res: [0x2bfec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242448:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007c1cad42 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.242449:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c5563e lrc: 2/0,0 mode: PW/PW res: [0x2bfeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242450:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c5565a lrc: 3/0,1 mode: PW/PW res: [0x2bfec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242452:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c5563e lrc: 3/0,0 mode: PW/PW res: [0x2bfeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242453:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c5565a lrc: 3/0,1 mode: PW/PW res: [0x2bfec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242455:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c5565a lrc: 2/0,0 mode: PW/PW res: [0x2bfec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242459:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c5563e lrc: 1/0,0 mode: --/PW res: [0x2bfeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242462:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c5563e lrc: 0/0,0 mode: --/PW res: [0x2bfeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242466:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c55645 lrc: 2/0,0 mode: PW/PW res: [0x2bfea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242468:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000075f9ff9d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.242469:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c55645 lrc: 2/0,0 mode: PW/PW res: [0x2bfea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242472:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c55645 lrc: 3/0,0 mode: PW/PW res: [0x2bfea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242475:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c55645 lrc: 1/0,0 mode: --/PW res: [0x2bfea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242478:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c55645 lrc: 0/0,0 mode: --/PW res: [0x2bfea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242481:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c5564c lrc: 2/0,0 mode: PW/PW res: [0x2bfed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242484:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f616ea25 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.242485:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c5564c lrc: 2/0,0 mode: PW/PW res: [0x2bfed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.242486:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000020f0e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+158:39030:x1731745946821696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 54us (250us total) trans 21474837133 rc 0/0 00010000:00010000:0.0:1651529917.242488:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c5564c lrc: 3/0,0 mode: PW/PW res: [0x2bfed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.242489:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 682 00010000:00010000:0.0:1651529917.242491:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c5564c lrc: 1/0,0 mode: --/PW res: [0x2bfed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242493:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c5564c lrc: 0/0,0 mode: --/PW res: [0x2bfed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242496:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55653 lrc: 2/0,0 mode: PW/PW res: [0x2bfef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242497:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c5565a lrc: 2/0,0 mode: PW/PW res: [0x2bfec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242499:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d52cc749 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.242500:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c5565a lrc: 2/0,0 mode: PW/PW res: [0x2bfec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242502:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001ea46bb1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.242502:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c5565a lrc: 3/0,0 mode: PW/PW res: [0x2bfec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242503:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55653 lrc: 2/0,0 mode: PW/PW res: [0x2bfef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242505:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c5565a lrc: 1/0,0 mode: --/PW res: [0x2bfec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242506:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55653 lrc: 3/0,0 mode: PW/PW res: [0x2bfef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242508:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c5565a lrc: 0/0,0 mode: --/PW res: [0x2bfec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242510:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55653 lrc: 1/0,0 mode: --/PW res: [0x2bfef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242513:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55653 lrc: 0/0,0 mode: --/PW res: [0x2bfef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.242527:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.242539:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946821824 00000100:00100000:1.0:1651529917.242546:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.242546:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 683 00000100:00100000:0.0:1651529917.242548:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051722b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+158:39030:x1731745946821824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.242553:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180206 count 1 00000100:00100000:1.0:1651529917.242557:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00010000:0.0:1651529917.242557:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.242559:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c55661 lrc: 3/0,1 mode: --/PW res: [0x2bfee:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242569:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.242569:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.242570:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c55661 lrc: 3/0,1 mode: PW/PW res: [0x2bfee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242574:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c55661 lrc: 3/0,1 mode: PW/PW res: [0x2bfee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242577:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c55661 lrc: 3/0,1 mode: PW/PW res: [0x2bfee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242579:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c55661 lrc: 2/0,0 mode: PW/PW res: [0x2bfee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.242607:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946822016 00000100:00100000:1.0:1651529917.242613:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946822080 00000100:00100000:1.0:1651529917.242616:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 684 00000100:00100000:1.0:1651529917.242617:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000c84c6c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+161:39030:x1731745946822016:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529917.242623:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051722b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+161:39030:x1731745946821824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 74us (95us total) trans 21474837134 rc 0/0 00000100:00100000:0.0:1651529917.242626:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 683 00002000:00080000:1.0:1651529917.242627:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180208 count 1 00000100:00100000:0.0:1651529917.242632:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 685 00002000:00010000:1.0:1651529917.242633:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bff0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1651529917.242634:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0bff89e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+160:39029:x1731745946822080:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529917.242635:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c55668 lrc: 3/0,1 mode: --/PW res: [0x2bff0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242638:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:0.0:1651529917.242638:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180209 count 1 00010000:00010000:1.0:1651529917.242639:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.242640:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c55668 lrc: 3/0,1 mode: PW/PW res: [0x2bff0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.242643:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bff1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.242644:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c55668 lrc: 3/0,1 mode: PW/PW res: [0x2bff0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242645:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c5566f lrc: 3/0,1 mode: --/PW res: [0x2bff1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242647:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c55668 lrc: 3/0,1 mode: PW/PW res: [0x2bff0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242650:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c55668 lrc: 2/0,0 mode: PW/PW res: [0x2bff0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242669:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.242670:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.242671:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c5566f lrc: 3/0,1 mode: PW/PW res: [0x2bff1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242675:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c5566f lrc: 3/0,1 mode: PW/PW res: [0x2bff1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242678:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c5566f lrc: 3/0,1 mode: PW/PW res: [0x2bff1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242681:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c5566f lrc: 2/0,0 mode: PW/PW res: [0x2bff1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.242697:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000c84c6c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+161:39030:x1731745946822016:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 79us (151us total) trans 21474837135 rc 0/0 00000100:00100000:1.0:1651529917.242700:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 684 00010000:00010000:1.0:1651529917.242707:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c55661 lrc: 2/0,0 mode: PW/PW res: [0x2bfee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242710:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004f367ded already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.242711:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c55661 lrc: 2/0,0 mode: PW/PW res: [0x2bfee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242714:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c55661 lrc: 3/0,0 mode: PW/PW res: [0x2bfee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242719:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c55661 lrc: 1/0,0 mode: --/PW res: [0x2bfee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.242722:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0bff89e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+161:39029:x1731745946822080:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 87us (164us total) trans 21474837136 rc 0/0 00010000:00010000:1.0:1651529917.242724:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c55661 lrc: 0/0,0 mode: --/PW res: [0x2bfee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.242725:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 685 00010000:00010000:1.0:1651529917.242728:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c55668 lrc: 2/0,0 mode: PW/PW res: [0x2bff0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242731:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000093b5c984 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.242732:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c55668 lrc: 2/0,0 mode: PW/PW res: [0x2bff0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242733:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c5566f lrc: 2/0,0 mode: PW/PW res: [0x2bff1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242735:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c55668 lrc: 3/0,0 mode: PW/PW res: [0x2bff0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242737:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000baeec0a3 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.242738:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c55668 lrc: 1/0,0 mode: --/PW res: [0x2bff0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242738:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c5566f lrc: 2/0,0 mode: PW/PW res: [0x2bff1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242740:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c55668 lrc: 0/0,0 mode: --/PW res: [0x2bff0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242741:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c5566f lrc: 3/0,0 mode: PW/PW res: [0x2bff1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242746:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c5566f lrc: 1/0,0 mode: --/PW res: [0x2bff1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242749:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c5566f lrc: 0/0,0 mode: --/PW res: [0x2bff1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.242802:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.242812:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946822656 00000100:00100000:1.0:1651529917.242813:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.242835:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946822784 00000100:00100000:0.0:1651529917.242843:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 686 00000100:00100000:0.0:1651529917.242845:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000056e45ef2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+162:39030:x1731745946822656:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529917.242846:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 687 00000100:00100000:1.0:1651529917.242848:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000fe04db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+162:39030:x1731745946822784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.242850:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180211 count 1 00002000:00080000:1.0:1651529917.242853:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180213 count 1 00002000:00010000:0.0:1651529917.242855:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bff3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.242857:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c55676 lrc: 3/0,1 mode: --/PW res: [0x2bff3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.242858:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bff5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.242860:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c5567d lrc: 3/0,1 mode: --/PW res: [0x2bff5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242860:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.242861:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.242862:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c55676 lrc: 3/0,1 mode: PW/PW res: [0x2bff3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242864:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.242865:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.242865:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c55676 lrc: 3/0,1 mode: PW/PW res: [0x2bff3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242866:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c5567d lrc: 3/0,1 mode: PW/PW res: [0x2bff5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242868:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c55676 lrc: 3/0,1 mode: PW/PW res: [0x2bff3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242869:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c5567d lrc: 3/0,1 mode: PW/PW res: [0x2bff5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242871:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c55676 lrc: 2/0,0 mode: PW/PW res: [0x2bff3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242872:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c5567d lrc: 3/0,1 mode: PW/PW res: [0x2bff5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242875:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c5567d lrc: 2/0,0 mode: PW/PW res: [0x2bff5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.242930:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000fe04db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+164:39030:x1731745946822784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 81us (116us total) trans 21474837137 rc 0/0 00000100:00100000:1.0:1651529917.242932:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 687 00000100:00100000:0.0:1651529917.242936:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000056e45ef2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+163:39030:x1731745946822656:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 90us (134us total) trans 21474837138 rc 0/0 00010000:00010000:1.0:1651529917.242939:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c55676 lrc: 2/0,0 mode: PW/PW res: [0x2bff3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242943:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6999e11 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.242944:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c55676 lrc: 2/0,0 mode: PW/PW res: [0x2bff3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242946:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c55676 lrc: 3/0,0 mode: PW/PW res: [0x2bff3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.242951:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 686 00010000:00010000:1.0:1651529917.242953:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c55676 lrc: 1/0,0 mode: --/PW res: [0x2bff3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.242956:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c55676 lrc: 0/0,0 mode: --/PW res: [0x2bff3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242960:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c5567d lrc: 2/0,0 mode: PW/PW res: [0x2bff5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242964:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002731c8d2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.242965:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c5567d lrc: 2/0,0 mode: PW/PW res: [0x2bff5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242968:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c5567d lrc: 3/0,0 mode: PW/PW res: [0x2bff5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242973:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c5567d lrc: 1/0,0 mode: --/PW res: [0x2bff5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.242976:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c5567d lrc: 0/0,0 mode: --/PW res: [0x2bff5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.242991:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.243001:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946822592 00000100:00100000:1.0:1651529917.243007:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.243008:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 688 00000100:00100000:0.0:1651529917.243009:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000020362888 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+163:39030:x1731745946822592:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.243020:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180210 count 1 00002000:00010000:0.0:1651529917.243024:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bff2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.243026:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c55684 lrc: 3/0,1 mode: --/PW res: [0x2bff2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243029:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.243030:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.243031:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c55684 lrc: 3/0,1 mode: PW/PW res: [0x2bff2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.243034:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.243034:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c55684 lrc: 3/0,1 mode: PW/PW res: [0x2bff2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243046:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c55684 lrc: 3/0,1 mode: PW/PW res: [0x2bff2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243049:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c55684 lrc: 2/0,0 mode: PW/PW res: [0x2bff2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.243052:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.243056:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.243063:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.243069:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946822720 00000100:00100000:1.0:1651529917.243074:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946822848 00000100:00100000:1.0:1651529917.243076:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946823040 00000100:00100000:1.0:1651529917.243078:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946822976 00000100:00100000:1.0:1651529917.243080:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946823104 00000100:00100000:1.0:1651529917.243083:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 689 00000100:00100000:1.0:1651529917.243085:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5ebc6ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+169:39030:x1731745946822720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529917.243091:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000020362888 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+169:39030:x1731745946822592:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 81us (100us total) trans 21474837139 rc 0/0 00000100:00100000:0.0:1651529917.243094:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 688 00002000:00080000:1.0:1651529917.243097:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180212 count 1 00000100:00100000:0.0:1651529917.243100:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 690 00002000:00010000:1.0:1651529917.243102:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bff4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1651529917.243102:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068b6c75f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+168:39030:x1731745946822848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529917.243104:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c5568b lrc: 3/0,1 mode: --/PW res: [0x2bff4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.243106:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180214 count 1 00010000:00010000:1.0:1651529917.243108:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.243109:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.243110:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c5568b lrc: 3/0,1 mode: PW/PW res: [0x2bff4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.243111:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bff6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.243113:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c55692 lrc: 3/0,1 mode: --/PW res: [0x2bff6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243114:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c5568b lrc: 3/0,1 mode: PW/PW res: [0x2bff4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243116:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.243117:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c5568b lrc: 3/0,1 mode: PW/PW res: [0x2bff4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243117:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.243118:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c55692 lrc: 3/0,1 mode: PW/PW res: [0x2bff6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243119:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c5568b lrc: 2/0,0 mode: PW/PW res: [0x2bff4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243121:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c55692 lrc: 3/0,1 mode: PW/PW res: [0x2bff6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243124:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c55692 lrc: 3/0,1 mode: PW/PW res: [0x2bff6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243127:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c55692 lrc: 2/0,0 mode: PW/PW res: [0x2bff6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.243156:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5ebc6ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+170:39030:x1731745946822720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 70us (148us total) trans 21474837140 rc 0/0 00000100:00100000:1.0:1651529917.243159:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 689 00000100:00100000:0.0:1651529917.243162:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068b6c75f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+169:39030:x1731745946822848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 59us (127us total) trans 21474837141 rc 0/0 00000100:00100000:1.0:1651529917.243164:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 691 00000100:00100000:1.0:1651529917.243166:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000597d93ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+169:39030:x1731745946823040:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529917.243166:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 690 00002000:00080000:1.0:1651529917.243170:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180216 count 1 00000100:00100000:0.0:1651529917.243171:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 692 00000100:00100000:0.0:1651529917.243173:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eff08db4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+168:39030:x1731745946822976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00010000:1.0:1651529917.243175:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bff8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.243176:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c55699 lrc: 3/0,1 mode: --/PW res: [0x2bff8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.243177:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180215 count 1 00010000:00010000:1.0:1651529917.243180:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.243181:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.243181:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c55699 lrc: 3/0,1 mode: PW/PW res: [0x2bff8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.243181:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bff7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.243183:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c556a0 lrc: 3/0,1 mode: --/PW res: [0x2bff7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243185:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c55699 lrc: 3/0,1 mode: PW/PW res: [0x2bff8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243186:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.243187:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.243188:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c556a0 lrc: 3/0,1 mode: PW/PW res: [0x2bff7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243190:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c55699 lrc: 3/0,1 mode: PW/PW res: [0x2bff8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243191:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c556a0 lrc: 3/0,1 mode: PW/PW res: [0x2bff7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243193:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c55699 lrc: 2/0,0 mode: PW/PW res: [0x2bff8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243196:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c556a0 lrc: 3/0,1 mode: PW/PW res: [0x2bff7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243199:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c556a0 lrc: 2/0,0 mode: PW/PW res: [0x2bff7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.243258:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000597d93ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+170:39030:x1731745946823040:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 90us (205us total) trans 21474837142 rc 0/0 00000100:00100000:1.0:1651529917.243261:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 691 00000100:00100000:1.0:1651529917.243265:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 693 00000100:00100000:1.0:1651529917.243267:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dabd64d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+169:39030:x1731745946823104:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.243272:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180217 count 1 00002000:00010000:1.0:1651529917.243276:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bff9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.243278:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c556a7 lrc: 3/0,1 mode: --/PW res: [0x2bff9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.243278:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eff08db4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+169:39030:x1731745946822976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 104us (220us total) trans 21474837143 rc 0/0 00010000:00010000:1.0:1651529917.243281:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529917.243281:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 692 00010000:00010000:1.0:1651529917.243282:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.243283:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c556a7 lrc: 3/0,1 mode: PW/PW res: [0x2bff9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243287:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c556a7 lrc: 3/0,1 mode: PW/PW res: [0x2bff9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243289:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c55684 lrc: 2/0,0 mode: PW/PW res: [0x2bff2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243290:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c556a7 lrc: 3/0,1 mode: PW/PW res: [0x2bff9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243292:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000721302df already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.243293:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c55684 lrc: 2/0,0 mode: PW/PW res: [0x2bff2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243295:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c556a7 lrc: 2/0,0 mode: PW/PW res: [0x2bff9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243296:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c55684 lrc: 3/0,0 mode: PW/PW res: [0x2bff2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243301:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c55684 lrc: 1/0,0 mode: --/PW res: [0x2bff2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243304:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c55684 lrc: 0/0,0 mode: --/PW res: [0x2bff2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243308:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c5568b lrc: 2/0,0 mode: PW/PW res: [0x2bff4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243311:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006512b8a0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.243312:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c5568b lrc: 2/0,0 mode: PW/PW res: [0x2bff4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243314:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c5568b lrc: 3/0,0 mode: PW/PW res: [0x2bff4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243317:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c5568b lrc: 1/0,0 mode: --/PW res: [0x2bff4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243320:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c5568b lrc: 0/0,0 mode: --/PW res: [0x2bff4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243323:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c55692 lrc: 2/0,0 mode: PW/PW res: [0x2bff6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243326:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002082f759 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.243327:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c55692 lrc: 2/0,0 mode: PW/PW res: [0x2bff6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.243328:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dabd64d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+169:39030:x1731745946823104:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 60us (265us total) trans 21474837144 rc 0/0 00010000:00010000:0.0:1651529917.243329:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c55692 lrc: 3/0,0 mode: PW/PW res: [0x2bff6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.243331:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 693 00010000:00010000:0.0:1651529917.243332:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c55692 lrc: 1/0,0 mode: --/PW res: [0x2bff6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243335:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c55692 lrc: 0/0,0 mode: --/PW res: [0x2bff6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243338:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c55699 lrc: 2/0,0 mode: PW/PW res: [0x2bff8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243338:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c556a0 lrc: 2/0,0 mode: PW/PW res: [0x2bff7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243341:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b9e4c5a0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.243341:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cb70d261 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.243342:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c556a0 lrc: 2/0,0 mode: PW/PW res: [0x2bff7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243343:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c55699 lrc: 2/0,0 mode: PW/PW res: [0x2bff8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243344:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c556a0 lrc: 3/0,0 mode: PW/PW res: [0x2bff7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243345:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c55699 lrc: 3/0,0 mode: PW/PW res: [0x2bff8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243347:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c556a0 lrc: 1/0,0 mode: --/PW res: [0x2bff7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243350:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c55699 lrc: 1/0,0 mode: --/PW res: [0x2bff8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243350:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c556a0 lrc: 0/0,0 mode: --/PW res: [0x2bff7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243353:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c55699 lrc: 0/0,0 mode: --/PW res: [0x2bff8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243353:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c556a7 lrc: 2/0,0 mode: PW/PW res: [0x2bff9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243355:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000589cc6c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.243356:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c556a7 lrc: 2/0,0 mode: PW/PW res: [0x2bff9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243359:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c556a7 lrc: 3/0,0 mode: PW/PW res: [0x2bff9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243362:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c556a7 lrc: 1/0,0 mode: --/PW res: [0x2bff9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243365:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c556a7 lrc: 0/0,0 mode: --/PW res: [0x2bff9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.243367:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.243372:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946823488 00000100:00100000:0.0:1651529917.243379:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 694 00000100:00100000:0.0:1651529917.243380:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df603127 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+169:39029:x1731745946823488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529917.243381:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529917.243385:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180219 count 1 00002000:00010000:0.0:1651529917.243397:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bffb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.243399:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c556ae lrc: 3/0,1 mode: --/PW res: [0x2bffb:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243402:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.243403:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.243404:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c556ae lrc: 3/0,1 mode: PW/PW res: [0x2bffb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243407:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c556ae lrc: 3/0,1 mode: PW/PW res: [0x2bffb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243410:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c556ae lrc: 3/0,1 mode: PW/PW res: [0x2bffb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243413:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c556ae lrc: 2/0,0 mode: PW/PW res: [0x2bffb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243452:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c556ae lrc: 2/0,0 mode: PW/PW res: [0x2bffb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243458:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e270377c already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.243459:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c556ae lrc: 2/0,0 mode: PW/PW res: [0x2bffb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.243463:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df603127 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+170:39029:x1731745946823488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 82us (96us total) trans 21474837145 rc 0/0 00010000:00010000:1.0:1651529917.243467:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c556ae lrc: 3/0,0 mode: PW/PW res: [0x2bffb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.243468:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 694 00010000:00010000:1.0:1651529917.243472:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c556ae lrc: 1/0,0 mode: --/PW res: [0x2bffb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.243473:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946823424 00010000:00010000:1.0:1651529917.243475:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c556ae lrc: 0/0,0 mode: --/PW res: [0x2bffb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.243489:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 695 00000100:00100000:0.0:1651529917.243491:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+170:39030:x1731745946823424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.243496:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180218 count 1 00002000:00010000:0.0:1651529917.243501:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bffa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.243502:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c556b5 lrc: 3/0,1 mode: --/PW res: [0x2bffa:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243506:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.243507:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.243507:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c556b5 lrc: 3/0,1 mode: PW/PW res: [0x2bffa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243511:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c556b5 lrc: 3/0,1 mode: PW/PW res: [0x2bffa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243514:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c556b5 lrc: 3/0,1 mode: PW/PW res: [0x2bffa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243517:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c556b5 lrc: 2/0,0 mode: PW/PW res: [0x2bffa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.243574:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+171:39030:x1731745946823424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 82us (192us total) trans 21474837146 rc 0/0 00000100:00100000:0.0:1651529917.243577:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 695 00010000:00010000:0.0:1651529917.243585:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c556b5 lrc: 2/0,0 mode: PW/PW res: [0x2bffa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243589:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004926c34d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.243590:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c556b5 lrc: 2/0,0 mode: PW/PW res: [0x2bffa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243593:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c556b5 lrc: 3/0,0 mode: PW/PW res: [0x2bffa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243598:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c556b5 lrc: 1/0,0 mode: --/PW res: [0x2bffa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243601:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c556b5 lrc: 0/0,0 mode: --/PW res: [0x2bffa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.243818:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.243828:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.243828:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946823872 00000100:00100000:1.0:1651529917.243837:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.243841:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946824000 00000100:00100000:1.0:1651529917.243845:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.243851:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.243854:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946823808 00000100:00100000:0.0:1651529917.243857:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946824128 00000100:00100000:0.0:1651529917.243859:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946823936 00000100:00100000:0.0:1651529917.243862:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 696 00000100:00100000:0.0:1651529917.243864:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c96722fe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+175:39029:x1731745946823872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.243869:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180221 count 1 00000100:00100000:1.0:1651529917.243871:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00010000:0.0:1651529917.243874:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bffd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.243876:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c556bc lrc: 3/0,1 mode: --/PW res: [0x2bffd:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.243877:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.243879:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.243880:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.243881:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c556bc lrc: 3/0,1 mode: PW/PW res: [0x2bffd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.243882:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.243885:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c556bc lrc: 3/0,1 mode: PW/PW res: [0x2bffd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.243888:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946824064 00010000:00010000:0.0:1651529917.243888:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c556bc lrc: 3/0,1 mode: PW/PW res: [0x2bffd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243890:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c556bc lrc: 2/0,0 mode: PW/PW res: [0x2bffd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.243894:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 697 00000100:00100000:1.0:1651529917.243895:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d769ec1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+176:39029:x1731745946824000:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.243901:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180223 count 1 00002000:00010000:1.0:1651529917.243906:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bfff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.243908:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006317cd4c/0x3234de053c556c3 lrc: 3/0,1 mode: --/PW res: [0x2bfff:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243911:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.243912:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.243913:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006317cd4c/0x3234de053c556c3 lrc: 3/0,1 mode: PW/PW res: [0x2bfff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243917:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006317cd4c/0x3234de053c556c3 lrc: 3/0,1 mode: PW/PW res: [0x2bfff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243920:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006317cd4c/0x3234de053c556c3 lrc: 3/0,1 mode: PW/PW res: [0x2bfff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243922:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006317cd4c/0x3234de053c556c3 lrc: 2/0,0 mode: PW/PW res: [0x2bfff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.243934:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c96722fe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+177:39029:x1731745946823872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 69us (117us total) trans 21474837147 rc 0/0 00000100:00100000:0.0:1651529917.243937:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 696 00000100:00100000:0.0:1651529917.243942:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946824512 00000100:00100000:0.0:1651529917.243946:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946824448 00000100:00100000:0.0:1651529917.243948:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 698 00000100:00100000:0.0:1651529917.243950:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e38f3712 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+179:39030:x1731745946823808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.243954:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180220 count 1 00002000:00010000:0.0:1651529917.243959:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bffc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.243961:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c556ca lrc: 3/0,1 mode: --/PW res: [0x2bffc:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243964:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.243965:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.243966:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c556ca lrc: 3/0,1 mode: PW/PW res: [0x2bffc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.243969:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d769ec1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+179:39029:x1731745946824000:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 73us (141us total) trans 21474837148 rc 0/0 00000100:00100000:1.0:1651529917.243972:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 697 00010000:00010000:0.0:1651529917.243972:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c556ca lrc: 3/0,1 mode: PW/PW res: [0x2bffc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.243975:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c556ca lrc: 3/0,1 mode: PW/PW res: [0x2bffc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.243978:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 699 00010000:00010000:0.0:1651529917.243978:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c556ca lrc: 2/0,0 mode: PW/PW res: [0x2bffc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.243979:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000422b3f7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+178:39029:x1731745946824128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.243984:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180225 count 1 00002000:00010000:1.0:1651529917.243988:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c001:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.243990:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c556d1 lrc: 3/0,1 mode: --/PW res: [0x2c001:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243993:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.243994:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.243995:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c556d1 lrc: 3/0,1 mode: PW/PW res: [0x2c001:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.243998:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c556d1 lrc: 3/0,1 mode: PW/PW res: [0x2c001:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244001:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c556d1 lrc: 3/0,1 mode: PW/PW res: [0x2c001:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244004:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c556d1 lrc: 2/0,0 mode: PW/PW res: [0x2c001:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.244014:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e38f3712 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+179:39030:x1731745946823808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 63us (177us total) trans 21474837149 rc 0/0 00000100:00100000:0.0:1651529917.244017:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 698 00000100:00100000:0.0:1651529917.244021:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 700 00000100:00100000:0.0:1651529917.244023:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e48b2f5d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+179:39030:x1731745946823936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.244027:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180222 count 1 00002000:00010000:0.0:1651529917.244031:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2bffe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.244032:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c556d8 lrc: 3/0,1 mode: --/PW res: [0x2bffe:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.244035:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000422b3f7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+179:39029:x1731745946824128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 55us (190us total) trans 21474837150 rc 0/0 00010000:00010000:0.0:1651529917.244044:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.244045:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.244046:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c556d8 lrc: 3/0,1 mode: PW/PW res: [0x2bffe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.244050:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 699 00010000:00010000:0.0:1651529917.244050:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c556d8 lrc: 3/0,1 mode: PW/PW res: [0x2bffe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244055:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c556d8 lrc: 3/0,1 mode: PW/PW res: [0x2bffe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244058:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c556d8 lrc: 2/0,0 mode: PW/PW res: [0x2bffe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.244067:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 701 00000100:00100000:1.0:1651529917.244069:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057e0b04f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+178:39030:x1731745946824064:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.244074:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180224 count 1 00002000:00010000:1.0:1651529917.244079:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c000:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.244081:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c556df lrc: 3/0,1 mode: --/PW res: [0x2c000:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244084:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.244085:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.244086:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c556df lrc: 3/0,1 mode: PW/PW res: [0x2c000:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244089:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c556df lrc: 3/0,1 mode: PW/PW res: [0x2c000:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.244091:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e48b2f5d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+179:39030:x1731745946823936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 67us (240us total) trans 21474837151 rc 0/0 00010000:00010000:1.0:1651529917.244093:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c556df lrc: 3/0,1 mode: PW/PW res: [0x2c000:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.244094:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 700 00010000:00010000:1.0:1651529917.244095:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c556df lrc: 2/0,0 mode: PW/PW res: [0x2c000:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.244099:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 702 00000100:00100000:0.0:1651529917.244100:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000647915c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+178:39029:x1731745946824512:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.244104:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180227 count 1 00002000:00010000:0.0:1651529917.244109:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c003:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.244110:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c556e6 lrc: 3/0,1 mode: --/PW res: [0x2c003:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244114:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.244114:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.244115:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c556e6 lrc: 3/0,1 mode: PW/PW res: [0x2c003:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244119:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c556e6 lrc: 3/0,1 mode: PW/PW res: [0x2c003:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244122:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c556e6 lrc: 3/0,1 mode: PW/PW res: [0x2c003:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244127:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c556e6 lrc: 2/0,0 mode: PW/PW res: [0x2c003:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.244130:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057e0b04f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+179:39030:x1731745946824064:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 60us (265us total) trans 21474837152 rc 0/0 00000100:00100000:1.0:1651529917.244133:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 701 00000100:00100000:1.0:1651529917.244138:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 703 00000100:00100000:1.0:1651529917.244139:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f298fd3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+178:39030:x1731745946824448:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.244144:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180226 count 1 00002000:00010000:1.0:1651529917.244148:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c002:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.244150:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c556ed lrc: 3/0,1 mode: --/PW res: [0x2c002:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244153:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.244154:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.244155:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c556ed lrc: 3/0,1 mode: PW/PW res: [0x2c002:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244158:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c556ed lrc: 3/0,1 mode: PW/PW res: [0x2c002:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.244159:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000647915c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+179:39029:x1731745946824512:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 57us (281us total) trans 21474837153 rc 0/0 00010000:00010000:1.0:1651529917.244161:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c556ed lrc: 3/0,1 mode: PW/PW res: [0x2c002:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.244161:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 702 00010000:00010000:1.0:1651529917.244166:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c556ed lrc: 2/0,0 mode: PW/PW res: [0x2c002:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244169:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c556bc lrc: 2/0,0 mode: PW/PW res: [0x2bffd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244172:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008119f3a8 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.244173:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c556bc lrc: 2/0,0 mode: PW/PW res: [0x2bffd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244176:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c556bc lrc: 3/0,0 mode: PW/PW res: [0x2bffd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244181:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c556bc lrc: 1/0,0 mode: --/PW res: [0x2bffd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244183:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c556bc lrc: 0/0,0 mode: --/PW res: [0x2bffd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244187:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006317cd4c/0x3234de053c556c3 lrc: 2/0,0 mode: PW/PW res: [0x2bfff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244190:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006317cd4c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.244191:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006317cd4c/0x3234de053c556c3 lrc: 2/0,0 mode: PW/PW res: [0x2bfff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244194:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006317cd4c/0x3234de053c556c3 lrc: 3/0,0 mode: PW/PW res: [0x2bfff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.244197:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f298fd3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+179:39030:x1731745946824448:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 57us (314us total) trans 21474837154 rc 0/0 00010000:00010000:0.0:1651529917.244197:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006317cd4c/0x3234de053c556c3 lrc: 1/0,0 mode: --/PW res: [0x2bfff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.244199:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 703 00010000:00010000:0.0:1651529917.244200:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006317cd4c/0x3234de053c556c3 lrc: 0/0,0 mode: --/PW res: [0x2bfff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244203:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c556ca lrc: 2/0,0 mode: PW/PW res: [0x2bffc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244206:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000d8e6a5e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.244206:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c556ca lrc: 2/0,0 mode: PW/PW res: [0x2bffc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244207:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c556d1 lrc: 2/0,0 mode: PW/PW res: [0x2c001:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244209:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c556ca lrc: 3/0,0 mode: PW/PW res: [0x2bffc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244210:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000037a4f3dc already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.244211:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c556d1 lrc: 2/0,0 mode: PW/PW res: [0x2c001:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244212:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c556ca lrc: 1/0,0 mode: --/PW res: [0x2bffc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244214:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c556d1 lrc: 3/0,0 mode: PW/PW res: [0x2c001:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244215:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c556ca lrc: 0/0,0 mode: --/PW res: [0x2bffc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244218:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c556d8 lrc: 2/0,0 mode: PW/PW res: [0x2bffe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244219:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c556d1 lrc: 1/0,0 mode: --/PW res: [0x2c001:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244221:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008393c644 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.244222:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c556d1 lrc: 0/0,0 mode: --/PW res: [0x2c001:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244234:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c556d8 lrc: 2/0,0 mode: PW/PW res: [0x2bffe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244242:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c556d8 lrc: 3/0,0 mode: PW/PW res: [0x2bffe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244246:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c556d8 lrc: 1/0,0 mode: --/PW res: [0x2bffe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244249:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c556df lrc: 2/0,0 mode: PW/PW res: [0x2c000:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244249:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c556d8 lrc: 0/0,0 mode: --/PW res: [0x2bffe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244251:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000033d777ce already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.244252:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c556df lrc: 2/0,0 mode: PW/PW res: [0x2c000:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244253:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c556e6 lrc: 2/0,0 mode: PW/PW res: [0x2c003:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244255:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c556df lrc: 3/0,0 mode: PW/PW res: [0x2c000:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244256:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b1b8f74 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.244256:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c556e6 lrc: 2/0,0 mode: PW/PW res: [0x2c003:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244259:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c556df lrc: 1/0,0 mode: --/PW res: [0x2c000:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244259:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c556e6 lrc: 3/0,0 mode: PW/PW res: [0x2c003:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244262:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c556df lrc: 0/0,0 mode: --/PW res: [0x2c000:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244262:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c556e6 lrc: 1/0,0 mode: --/PW res: [0x2c003:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244265:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c556ed lrc: 2/0,0 mode: PW/PW res: [0x2c002:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244265:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c556e6 lrc: 0/0,0 mode: --/PW res: [0x2c003:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244268:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d571c418 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.244268:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c556ed lrc: 2/0,0 mode: PW/PW res: [0x2c002:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244271:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c556ed lrc: 3/0,0 mode: PW/PW res: [0x2c002:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244274:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c556ed lrc: 1/0,0 mode: --/PW res: [0x2c002:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244277:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c556ed lrc: 0/0,0 mode: --/PW res: [0x2c002:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.244567:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.244583:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946824832 00000100:00100000:1.0:1651529917.244584:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.244591:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.244591:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946824896 00000100:00100000:1.0:1651529917.244600:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.244602:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946824960 00000100:00100000:0.0:1651529917.244605:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946825024 00000100:00100000:1.0:1651529917.244607:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 704 00000100:00100000:1.0:1651529917.244609:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c96722fe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+182:39030:x1731745946824832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529917.244610:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 705 00000100:00100000:0.0:1651529917.244611:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d769ec1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+182:39029:x1731745946824896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.244615:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180228 count 1 00002000:00080000:0.0:1651529917.244617:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180229 count 1 00002000:00010000:1.0:1651529917.244620:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c004:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.244622:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c556f4 lrc: 3/0,1 mode: --/PW res: [0x2c004:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.244622:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c005:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.244624:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c556fb lrc: 3/0,1 mode: --/PW res: [0x2c005:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244626:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.244626:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.244627:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c556f4 lrc: 3/0,1 mode: PW/PW res: [0x2c004:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244627:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.244628:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.244629:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c556fb lrc: 3/0,1 mode: PW/PW res: [0x2c005:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244631:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c556f4 lrc: 3/0,1 mode: PW/PW res: [0x2c004:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244632:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c556fb lrc: 3/0,1 mode: PW/PW res: [0x2c005:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244634:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c556f4 lrc: 3/0,1 mode: PW/PW res: [0x2c004:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244635:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c556fb lrc: 3/0,1 mode: PW/PW res: [0x2c005:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244637:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c556f4 lrc: 2/0,0 mode: PW/PW res: [0x2c004:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244638:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c556fb lrc: 2/0,0 mode: PW/PW res: [0x2c005:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.244682:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c96722fe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+184:39030:x1731745946824832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 72us (116us total) trans 21474837155 rc 0/0 00000100:00100000:1.0:1651529917.244685:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 704 00000100:00100000:1.0:1651529917.244697:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 706 00000100:00100000:1.0:1651529917.244699:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e38f3712 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+183:39030:x1731745946824960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.244704:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180230 count 1 00000100:00100000:0.0:1651529917.244704:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d769ec1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+183:39029:x1731745946824896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 91us (119us total) trans 21474837156 rc 0/0 00002000:00010000:1.0:1651529917.244708:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c006:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1651529917.244709:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 705 00010000:00010000:1.0:1651529917.244710:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c55702 lrc: 3/0,1 mode: --/PW res: [0x2c006:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244713:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.244714:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529917.244714:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 707 00010000:00010000:1.0:1651529917.244715:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c55702 lrc: 3/0,1 mode: PW/PW res: [0x2c006:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.244716:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f114ed4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+182:39029:x1731745946825024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529917.244719:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c55702 lrc: 3/0,1 mode: PW/PW res: [0x2c006:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.244720:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180231 count 1 00010000:00010000:1.0:1651529917.244722:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c55702 lrc: 3/0,1 mode: PW/PW res: [0x2c006:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244725:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c55702 lrc: 2/0,0 mode: PW/PW res: [0x2c006:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.244725:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c007:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.244750:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55709 lrc: 3/0,1 mode: --/PW res: [0x2c007:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244755:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.244755:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.244756:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55709 lrc: 3/0,1 mode: PW/PW res: [0x2c007:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244760:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55709 lrc: 3/0,1 mode: PW/PW res: [0x2c007:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244763:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55709 lrc: 3/0,1 mode: PW/PW res: [0x2c007:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244766:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55709 lrc: 2/0,0 mode: PW/PW res: [0x2c007:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.244769:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e38f3712 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+183:39030:x1731745946824960:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 69us (177us total) trans 21474837157 rc 0/0 00000100:00100000:1.0:1651529917.244772:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 706 00010000:00010000:1.0:1651529917.244779:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c556f4 lrc: 2/0,0 mode: PW/PW res: [0x2c004:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244782:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000337d9d20 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.244783:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c556f4 lrc: 2/0,0 mode: PW/PW res: [0x2c004:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244787:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c556f4 lrc: 3/0,0 mode: PW/PW res: [0x2c004:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244791:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c556f4 lrc: 1/0,0 mode: --/PW res: [0x2c004:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244794:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c556f4 lrc: 0/0,0 mode: --/PW res: [0x2c004:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244798:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c556fb lrc: 2/0,0 mode: PW/PW res: [0x2c005:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244801:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eca832be already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.244802:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c556fb lrc: 2/0,0 mode: PW/PW res: [0x2c005:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.244802:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f114ed4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+183:39029:x1731745946825024:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 86us (202us total) trans 21474837158 rc 0/0 00010000:00010000:1.0:1651529917.244804:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c556fb lrc: 3/0,0 mode: PW/PW res: [0x2c005:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.244805:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 707 00010000:00010000:1.0:1651529917.244808:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c556fb lrc: 1/0,0 mode: --/PW res: [0x2c005:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244810:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c556fb lrc: 0/0,0 mode: --/PW res: [0x2c005:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244814:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c55702 lrc: 2/0,0 mode: PW/PW res: [0x2c006:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244814:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55709 lrc: 2/0,0 mode: PW/PW res: [0x2c007:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244817:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c5d6b959 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.244817:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c55702 lrc: 2/0,0 mode: PW/PW res: [0x2c006:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244820:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c55702 lrc: 3/0,0 mode: PW/PW res: [0x2c006:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244820:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000092ad010c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.244821:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55709 lrc: 2/0,0 mode: PW/PW res: [0x2c007:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244823:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c55702 lrc: 1/0,0 mode: --/PW res: [0x2c006:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244824:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55709 lrc: 3/0,0 mode: PW/PW res: [0x2c007:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.244826:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c55702 lrc: 0/0,0 mode: --/PW res: [0x2c006:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244828:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55709 lrc: 1/0,0 mode: --/PW res: [0x2c007:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244831:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55709 lrc: 0/0,0 mode: --/PW res: [0x2c007:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.244839:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.244850:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946825216 00000100:00100000:1.0:1651529917.244856:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.244857:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 708 00000100:00100000:0.0:1651529917.244858:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d4817c1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+183:39030:x1731745946825216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529917.244868:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529917.244869:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180232 count 1 00002000:00010000:0.0:1651529917.244873:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c008:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.244875:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c55710 lrc: 3/0,1 mode: --/PW res: [0x2c008:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244878:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.244879:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.244880:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c55710 lrc: 3/0,1 mode: PW/PW res: [0x2c008:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244884:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c55710 lrc: 3/0,1 mode: PW/PW res: [0x2c008:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244887:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c55710 lrc: 3/0,1 mode: PW/PW res: [0x2c008:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244890:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c55710 lrc: 2/0,0 mode: PW/PW res: [0x2c008:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.244904:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529917.244928:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c55710 lrc: 2/0,0 mode: PW/PW res: [0x2c008:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.244934:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d4817c1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+184:39030:x1731745946825216:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 74us (95us total) trans 21474837159 rc 0/0 00010000:00010000:1.0:1651529917.244936:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b5173ced already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.244937:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c55710 lrc: 2/0,0 mode: PW/PW res: [0x2c008:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.244937:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 708 00010000:00010000:1.0:1651529917.244940:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c55710 lrc: 3/0,0 mode: PW/PW res: [0x2c008:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.244942:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946825344 00000100:00100000:0.0:1651529917.244945:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946825280 00010000:00010000:1.0:1651529917.244947:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c55710 lrc: 1/0,0 mode: --/PW res: [0x2c008:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.244947:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946825408 00010000:00010000:1.0:1651529917.244950:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c55710 lrc: 0/0,0 mode: --/PW res: [0x2c008:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.244950:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 709 00000100:00100000:0.0:1651529917.244952:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003ce30d8e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+186:39030:x1731745946825344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.244956:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180234 count 1 00002000:00010000:0.0:1651529917.244960:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c00a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.244962:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c55717 lrc: 3/0,1 mode: --/PW res: [0x2c00a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244965:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.244966:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.244967:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c55717 lrc: 3/0,1 mode: PW/PW res: [0x2c00a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244971:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c55717 lrc: 3/0,1 mode: PW/PW res: [0x2c00a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244976:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c55717 lrc: 3/0,1 mode: PW/PW res: [0x2c00a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.244979:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c55717 lrc: 2/0,0 mode: PW/PW res: [0x2c00a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.244983:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 710 00000100:00100000:1.0:1651529917.244985:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000f1607b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+186:39029:x1731745946825280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.244990:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180233 count 1 00002000:00010000:1.0:1651529917.244996:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c009:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.244997:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c5571e lrc: 3/0,1 mode: --/PW res: [0x2c009:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245001:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.245001:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.245002:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c5571e lrc: 3/0,1 mode: PW/PW res: [0x2c009:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245006:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c5571e lrc: 3/0,1 mode: PW/PW res: [0x2c009:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245009:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c5571e lrc: 3/0,1 mode: PW/PW res: [0x2c009:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245012:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c5571e lrc: 2/0,0 mode: PW/PW res: [0x2c009:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.245019:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003ce30d8e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+187:39030:x1731745946825344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 66us (162us total) trans 21474837160 rc 0/0 00000100:00100000:0.0:1651529917.245022:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 709 00000100:00100000:0.0:1651529917.245026:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 711 00000100:00100000:0.0:1651529917.245056:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d5aac2fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+187:39029:x1731745946825408:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.245062:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180235 count 1 00002000:00010000:0.0:1651529917.245067:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c00b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.245069:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0382f56/0x3234de053c55725 lrc: 3/0,1 mode: --/PW res: [0x2c00b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.245071:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000f1607b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+187:39029:x1731745946825280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 85us (202us total) trans 21474837161 rc 0/0 00010000:00010000:0.0:1651529917.245072:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.245073:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1651529917.245074:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 710 00010000:00010000:0.0:1651529917.245074:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0382f56/0x3234de053c55725 lrc: 3/0,1 mode: PW/PW res: [0x2c00b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245077:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0382f56/0x3234de053c55725 lrc: 3/0,1 mode: PW/PW res: [0x2c00b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245080:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0382f56/0x3234de053c55725 lrc: 3/0,1 mode: PW/PW res: [0x2c00b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245085:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0382f56/0x3234de053c55725 lrc: 2/0,0 mode: PW/PW res: [0x2c00b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245116:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c55717 lrc: 2/0,0 mode: PW/PW res: [0x2c00a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245120:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004cff9fc3 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.245121:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c55717 lrc: 2/0,0 mode: PW/PW res: [0x2c00a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245124:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c55717 lrc: 3/0,0 mode: PW/PW res: [0x2c00a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.245131:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d5aac2fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+187:39029:x1731745946825408:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 74us (227us total) trans 21474837162 rc 0/0 00010000:00010000:1.0:1651529917.245134:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c55717 lrc: 1/0,0 mode: --/PW res: [0x2c00a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.245134:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 711 00010000:00010000:1.0:1651529917.245137:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c55717 lrc: 0/0,0 mode: --/PW res: [0x2c00a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245142:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c5571e lrc: 2/0,0 mode: PW/PW res: [0x2c009:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245143:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0382f56/0x3234de053c55725 lrc: 2/0,0 mode: PW/PW res: [0x2c00b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245145:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027775c45 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.245145:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c5571e lrc: 2/0,0 mode: PW/PW res: [0x2c009:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245147:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b0382f56 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.245148:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0382f56/0x3234de053c55725 lrc: 2/0,0 mode: PW/PW res: [0x2c00b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245151:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c5571e lrc: 3/0,0 mode: PW/PW res: [0x2c009:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245151:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0382f56/0x3234de053c55725 lrc: 3/0,0 mode: PW/PW res: [0x2c00b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245154:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c5571e lrc: 1/0,0 mode: --/PW res: [0x2c009:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245155:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0382f56/0x3234de053c55725 lrc: 1/0,0 mode: --/PW res: [0x2c00b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245157:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c5571e lrc: 0/0,0 mode: --/PW res: [0x2c009:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245158:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0382f56/0x3234de053c55725 lrc: 0/0,0 mode: --/PW res: [0x2c00b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.245214:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.245243:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946826048 00000100:00100000:1.0:1651529917.245244:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.245254:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946826112 00000100:00100000:0.0:1651529917.245287:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 712 00000100:00100000:0.0:1651529917.245289:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000069340bcb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+188:39029:x1731745946826048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529917.245290:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 713 00000100:00100000:1.0:1651529917.245292:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000880b0746 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+188:39030:x1731745946826112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.245296:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180236 count 1 00002000:00080000:1.0:1651529917.245298:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180237 count 1 00002000:00010000:0.0:1651529917.245301:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c00c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:1.0:1651529917.245303:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c00d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.245303:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000990cd87d/0x3234de053c5572c lrc: 3/0,1 mode: --/PW res: [0x2c00c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245305:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c55733 lrc: 3/0,1 mode: --/PW res: [0x2c00d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245306:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.245308:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.245309:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.245310:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c55733 lrc: 3/0,1 mode: PW/PW res: [0x2c00d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245313:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c55733 lrc: 3/0,1 mode: PW/PW res: [0x2c00d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245316:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c55733 lrc: 3/0,1 mode: PW/PW res: [0x2c00d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245318:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.245319:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c55733 lrc: 2/0,0 mode: PW/PW res: [0x2c00d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245319:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000990cd87d/0x3234de053c5572c lrc: 3/0,1 mode: PW/PW res: [0x2c00c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245324:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000990cd87d/0x3234de053c5572c lrc: 3/0,1 mode: PW/PW res: [0x2c00c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245327:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000990cd87d/0x3234de053c5572c lrc: 3/0,1 mode: PW/PW res: [0x2c00c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245330:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000990cd87d/0x3234de053c5572c lrc: 2/0,0 mode: PW/PW res: [0x2c00c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.245360:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000880b0746 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+190:39030:x1731745946826112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 67us (115us total) trans 21474837163 rc 0/0 00000100:00100000:1.0:1651529917.245362:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 713 00010000:00010000:1.0:1651529917.245369:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c55733 lrc: 2/0,0 mode: PW/PW res: [0x2c00d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245373:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f1a88dd0 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.245374:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c55733 lrc: 2/0,0 mode: PW/PW res: [0x2c00d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245377:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c55733 lrc: 3/0,0 mode: PW/PW res: [0x2c00d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245381:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c55733 lrc: 1/0,0 mode: --/PW res: [0x2c00d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245384:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c55733 lrc: 0/0,0 mode: --/PW res: [0x2c00d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.245384:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000069340bcb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+189:39029:x1731745946826048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 94us (170us total) trans 21474837164 rc 0/0 00000100:00100000:0.0:1651529917.245387:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 712 00010000:00010000:1.0:1651529917.245388:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000990cd87d/0x3234de053c5572c lrc: 2/0,0 mode: PW/PW res: [0x2c00c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245391:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000990cd87d already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.245392:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000990cd87d/0x3234de053c5572c lrc: 2/0,0 mode: PW/PW res: [0x2c00c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245395:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000990cd87d/0x3234de053c5572c lrc: 3/0,0 mode: PW/PW res: [0x2c00c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245398:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000990cd87d/0x3234de053c5572c lrc: 1/0,0 mode: --/PW res: [0x2c00c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245401:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000990cd87d/0x3234de053c5572c lrc: 0/0,0 mode: --/PW res: [0x2c00c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.245435:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.245445:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946826176 00000100:00100000:1.0:1651529917.245451:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.245451:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 714 00000100:00100000:0.0:1651529917.245453:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+189:39029:x1731745946826176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.245463:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180238 count 1 00002000:00010000:0.0:1651529917.245468:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c00e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.245471:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c5573a lrc: 3/0,1 mode: --/PW res: [0x2c00e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245475:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.245475:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.245476:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c5573a lrc: 3/0,1 mode: PW/PW res: [0x2c00e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.245477:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.245480:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c5573a lrc: 3/0,1 mode: PW/PW res: [0x2c00e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245483:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c5573a lrc: 3/0,1 mode: PW/PW res: [0x2c00e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.245485:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.245485:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c5573a lrc: 2/0,0 mode: PW/PW res: [0x2c00e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.245490:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.245495:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.245501:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946826240 00000100:00100000:1.0:1651529917.245506:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946826304 00000100:00100000:1.0:1651529917.245508:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946826368 00000100:00100000:1.0:1651529917.245510:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946826432 00000100:00100000:1.0:1651529917.245512:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946826496 00000100:00100000:1.0:1651529917.245515:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 715 00000100:00100000:1.0:1651529917.245517:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e093a181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+195:39030:x1731745946826240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.245521:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180239 count 1 00000100:00100000:0.0:1651529917.245527:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bc420ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+195:39029:x1731745946826176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 72us (92us total) trans 21474837165 rc 0/0 00000100:00100000:0.0:1651529917.245530:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 714 00002000:00010000:1.0:1651529917.245533:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c00f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.245535:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c55741 lrc: 3/0,1 mode: --/PW res: [0x2c00f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.245535:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 716 00000100:00100000:0.0:1651529917.245537:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054267da8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+194:39029:x1731745946826304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529917.245539:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.245540:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.245540:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c55741 lrc: 3/0,1 mode: PW/PW res: [0x2c00f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.245542:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180240 count 1 00010000:00010000:1.0:1651529917.245544:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c55741 lrc: 3/0,1 mode: PW/PW res: [0x2c00f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245547:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c55741 lrc: 3/0,1 mode: PW/PW res: [0x2c00f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.245547:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c010:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.245548:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be333df1/0x3234de053c55748 lrc: 3/0,1 mode: --/PW res: [0x2c010:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245550:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c55741 lrc: 2/0,0 mode: PW/PW res: [0x2c00f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245552:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.245553:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.245554:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be333df1/0x3234de053c55748 lrc: 3/0,1 mode: PW/PW res: [0x2c010:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245564:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be333df1/0x3234de053c55748 lrc: 3/0,1 mode: PW/PW res: [0x2c010:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245568:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be333df1/0x3234de053c55748 lrc: 3/0,1 mode: PW/PW res: [0x2c010:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245570:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be333df1/0x3234de053c55748 lrc: 2/0,0 mode: PW/PW res: [0x2c010:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.245598:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e093a181 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+195:39030:x1731745946826240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 80us (147us total) trans 21474837166 rc 0/0 00000100:00100000:1.0:1651529917.245606:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 715 00000100:00100000:1.0:1651529917.245612:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 717 00000100:00100000:1.0:1651529917.245614:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004e83cb77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+195:39030:x1731745946826368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.245618:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180241 count 1 00002000:00010000:1.0:1651529917.245623:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c011:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.245624:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c5574f lrc: 3/0,1 mode: --/PW res: [0x2c011:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245628:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.245629:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.245629:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c5574f lrc: 3/0,1 mode: PW/PW res: [0x2c011:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.245629:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054267da8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+195:39029:x1731745946826304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 91us (152us total) trans 21474837167 rc 0/0 00000100:00100000:0.0:1651529917.245632:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 716 00010000:00010000:1.0:1651529917.245633:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c5574f lrc: 3/0,1 mode: PW/PW res: [0x2c011:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245636:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c5574f lrc: 3/0,1 mode: PW/PW res: [0x2c011:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.245638:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 718 00010000:00010000:1.0:1651529917.245639:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c5574f lrc: 2/0,0 mode: PW/PW res: [0x2c011:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.245639:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+194:39029:x1731745946826432:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.245644:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180242 count 1 00002000:00010000:0.0:1651529917.245648:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c012:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.245650:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ead1500/0x3234de053c55756 lrc: 3/0,1 mode: --/PW res: [0x2c012:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245653:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.245654:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.245655:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ead1500/0x3234de053c55756 lrc: 3/0,1 mode: PW/PW res: [0x2c012:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245658:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ead1500/0x3234de053c55756 lrc: 3/0,1 mode: PW/PW res: [0x2c012:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245662:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ead1500/0x3234de053c55756 lrc: 3/0,1 mode: PW/PW res: [0x2c012:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245664:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ead1500/0x3234de053c55756 lrc: 2/0,0 mode: PW/PW res: [0x2c012:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.245682:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004e83cb77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+196:39030:x1731745946826368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 67us (196us total) trans 21474837168 rc 0/0 00000100:00100000:1.0:1651529917.245685:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 717 00000100:00100000:1.0:1651529917.245690:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 719 00000100:00100000:1.0:1651529917.245692:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6309896 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+195:39030:x1731745946826496:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529917.245695:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065f5e47d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+195:39029:x1731745946826432:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 55us (205us total) trans 21474837169 rc 0/0 00002000:00080000:1.0:1651529917.245696:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180243 count 1 00000100:00100000:0.0:1651529917.245698:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 718 00002000:00010000:1.0:1651529917.245701:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c013:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.245703:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c5575d lrc: 3/0,1 mode: --/PW res: [0x2c013:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245706:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.245706:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c5573a lrc: 2/0,0 mode: PW/PW res: [0x2c00e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245707:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.245708:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c5575d lrc: 3/0,1 mode: PW/PW res: [0x2c013:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245709:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007d55fe01 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.245711:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c5575d lrc: 3/0,1 mode: PW/PW res: [0x2c013:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245717:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c5575d lrc: 3/0,1 mode: PW/PW res: [0x2c013:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245719:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c5575d lrc: 2/0,0 mode: PW/PW res: [0x2c013:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245735:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c5573a lrc: 2/0,0 mode: PW/PW res: [0x2c00e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245739:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c5573a lrc: 3/0,0 mode: PW/PW res: [0x2c00e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245744:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c5573a lrc: 1/0,0 mode: --/PW res: [0x2c00e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245747:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d55fe01/0x3234de053c5573a lrc: 0/0,0 mode: --/PW res: [0x2c00e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245752:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c55741 lrc: 2/0,0 mode: PW/PW res: [0x2c00f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245755:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d09e97cf already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.245756:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c55741 lrc: 2/0,0 mode: PW/PW res: [0x2c00f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245759:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c55741 lrc: 3/0,0 mode: PW/PW res: [0x2c00f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245762:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c55741 lrc: 1/0,0 mode: --/PW res: [0x2c00f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.245764:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6309896 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+195:39030:x1731745946826496:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 71us (268us total) trans 21474837170 rc 0/0 00010000:00010000:0.0:1651529917.245764:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c55741 lrc: 0/0,0 mode: --/PW res: [0x2c00f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.245767:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 719 00010000:00010000:0.0:1651529917.245768:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be333df1/0x3234de053c55748 lrc: 2/0,0 mode: PW/PW res: [0x2c010:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245770:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000be333df1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.245771:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be333df1/0x3234de053c55748 lrc: 2/0,0 mode: PW/PW res: [0x2c010:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245774:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c5574f lrc: 2/0,0 mode: PW/PW res: [0x2c011:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245774:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be333df1/0x3234de053c55748 lrc: 3/0,0 mode: PW/PW res: [0x2c010:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245777:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a9b4b5b4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.245777:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be333df1/0x3234de053c55748 lrc: 1/0,0 mode: --/PW res: [0x2c010:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245778:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c5574f lrc: 2/0,0 mode: PW/PW res: [0x2c011:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245779:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be333df1/0x3234de053c55748 lrc: 0/0,0 mode: --/PW res: [0x2c010:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245781:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c5574f lrc: 3/0,0 mode: PW/PW res: [0x2c011:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245783:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ead1500/0x3234de053c55756 lrc: 2/0,0 mode: PW/PW res: [0x2c012:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245785:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008ead1500 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.245786:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c5574f lrc: 1/0,0 mode: --/PW res: [0x2c011:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245786:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ead1500/0x3234de053c55756 lrc: 2/0,0 mode: PW/PW res: [0x2c012:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245789:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c5574f lrc: 0/0,0 mode: --/PW res: [0x2c011:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245789:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ead1500/0x3234de053c55756 lrc: 3/0,0 mode: PW/PW res: [0x2c012:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245792:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ead1500/0x3234de053c55756 lrc: 1/0,0 mode: --/PW res: [0x2c012:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245793:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c5575d lrc: 2/0,0 mode: PW/PW res: [0x2c013:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245794:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ead1500/0x3234de053c55756 lrc: 0/0,0 mode: --/PW res: [0x2c012:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245796:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b232c9bb already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.245797:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c5575d lrc: 2/0,0 mode: PW/PW res: [0x2c013:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245800:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c5575d lrc: 3/0,0 mode: PW/PW res: [0x2c013:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245803:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c5575d lrc: 1/0,0 mode: --/PW res: [0x2c013:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245805:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c5575d lrc: 0/0,0 mode: --/PW res: [0x2c013:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.245818:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.245829:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946826688 00000100:00100000:0.0:1651529917.245840:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 720 00000100:00100000:0.0:1651529917.245842:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000081a471dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+195:39029:x1731745946826688:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529917.245843:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529917.245852:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180244 count 1 00002000:00010000:0.0:1651529917.245857:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c014:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.245859:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2ef532c/0x3234de053c55764 lrc: 3/0,1 mode: --/PW res: [0x2c014:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245862:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.245862:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.245863:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2ef532c/0x3234de053c55764 lrc: 3/0,1 mode: PW/PW res: [0x2c014:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245867:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2ef532c/0x3234de053c55764 lrc: 3/0,1 mode: PW/PW res: [0x2c014:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245870:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2ef532c/0x3234de053c55764 lrc: 3/0,1 mode: PW/PW res: [0x2c014:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245873:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2ef532c/0x3234de053c55764 lrc: 2/0,0 mode: PW/PW res: [0x2c014:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.245910:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946827008 00000100:00100000:0.0:1651529917.245916:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000081a471dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+197:39029:x1731745946826688:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 73us (97us total) trans 21474837171 rc 0/0 00000100:00100000:0.0:1651529917.245920:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 720 00000100:00100000:1.0:1651529917.245927:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 721 00000100:00100000:1.0:1651529917.245929:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+196:39030:x1731745946827008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.245934:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180245 count 1 00010000:00010000:0.0:1651529917.245934:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2ef532c/0x3234de053c55764 lrc: 2/0,0 mode: PW/PW res: [0x2c014:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245938:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d2ef532c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.245939:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2ef532c/0x3234de053c55764 lrc: 2/0,0 mode: PW/PW res: [0x2c014:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.245940:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c015:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.245941:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c5576b lrc: 3/0,1 mode: --/PW res: [0x2c015:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245942:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2ef532c/0x3234de053c55764 lrc: 3/0,0 mode: PW/PW res: [0x2c014:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245945:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.245945:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.245946:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c5576b lrc: 3/0,1 mode: PW/PW res: [0x2c015:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245950:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c5576b lrc: 3/0,1 mode: PW/PW res: [0x2c015:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245953:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c5576b lrc: 3/0,1 mode: PW/PW res: [0x2c015:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.245956:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c5576b lrc: 2/0,0 mode: PW/PW res: [0x2c015:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245967:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2ef532c/0x3234de053c55764 lrc: 1/0,0 mode: --/PW res: [0x2c014:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245970:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2ef532c/0x3234de053c55764 lrc: 0/0,0 mode: --/PW res: [0x2c014:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245976:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c5576b lrc: 2/0,0 mode: PW/PW res: [0x2c015:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245978:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c660975a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.245979:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c5576b lrc: 2/0,0 mode: PW/PW res: [0x2c015:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245982:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c5576b lrc: 3/0,0 mode: PW/PW res: [0x2c015:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245985:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c5576b lrc: 1/0,0 mode: --/PW res: [0x2c015:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.245988:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c5576b lrc: 0/0,0 mode: --/PW res: [0x2c015:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.245994:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9f4ec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+197:39030:x1731745946827008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 64us (157us total) trans 21474837172 rc 0/0 00000100:00100000:1.0:1651529917.245997:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 721 00000100:00100000:1.0:1651529917.246122:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.246130:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.246140:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946827264 00000100:00100000:1.0:1651529917.246148:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946827200 00000100:00100000:1.0:1651529917.246154:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 722 00000100:00100000:1.0:1651529917.246155:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000362c2e4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+198:39030:x1731745946827264:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.246160:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180247 count 1 00000100:00100000:0.0:1651529917.246170:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 723 00000100:00100000:0.0:1651529917.246172:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdd939a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+198:39029:x1731745946827200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.246178:0:166112:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180246 count 1 00002000:00010000:1.0:1651529917.246180:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c017:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.246183:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c55772 lrc: 3/0,1 mode: --/PW res: [0x2c017:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.246183:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c016:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.246185:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fb54722/0x3234de053c55779 lrc: 3/0,1 mode: --/PW res: [0x2c016:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246186:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.246187:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.246188:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c55772 lrc: 3/0,1 mode: PW/PW res: [0x2c017:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246188:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.246189:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.246189:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fb54722/0x3234de053c55779 lrc: 3/0,1 mode: PW/PW res: [0x2c016:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246192:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c55772 lrc: 3/0,1 mode: PW/PW res: [0x2c017:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246194:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fb54722/0x3234de053c55779 lrc: 3/0,1 mode: PW/PW res: [0x2c016:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246195:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c55772 lrc: 3/0,1 mode: PW/PW res: [0x2c017:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246197:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c55772 lrc: 2/0,0 mode: PW/PW res: [0x2c017:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246197:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fb54722/0x3234de053c55779 lrc: 3/0,1 mode: PW/PW res: [0x2c016:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246199:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003fb54722/0x3234de053c55779 lrc: 2/0,0 mode: PW/PW res: [0x2c016:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.246253:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000362c2e4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+200:39030:x1731745946827264:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 97us (131us total) trans 21474837173 rc 0/0 00000100:00100000:1.0:1651529917.246257:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 722 00010000:00010000:1.0:1651529917.246264:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c55772 lrc: 2/0,0 mode: PW/PW res: [0x2c017:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246267:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009882f227 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.246268:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c55772 lrc: 2/0,0 mode: PW/PW res: [0x2c017:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246271:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c55772 lrc: 3/0,0 mode: PW/PW res: [0x2c017:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.246273:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdd939a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+199:39029:x1731745946827200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 99us (142us total) trans 21474837174 rc 0/0 00010000:00010000:1.0:1651529917.246276:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c55772 lrc: 1/0,0 mode: --/PW res: [0x2c017:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.246276:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 723 00010000:00010000:1.0:1651529917.246279:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c55772 lrc: 0/0,0 mode: --/PW res: [0x2c017:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246283:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003fb54722/0x3234de053c55779 lrc: 2/0,0 mode: PW/PW res: [0x2c016:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246286:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003fb54722 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.246287:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003fb54722/0x3234de053c55779 lrc: 2/0,0 mode: PW/PW res: [0x2c016:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246289:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003fb54722/0x3234de053c55779 lrc: 3/0,0 mode: PW/PW res: [0x2c016:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246293:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003fb54722/0x3234de053c55779 lrc: 1/0,0 mode: --/PW res: [0x2c016:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246295:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fb54722/0x3234de053c55779 lrc: 0/0,0 mode: --/PW res: [0x2c016:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.246328:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.246338:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946827456 00000100:00100000:1.0:1651529917.246344:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.246346:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 724 00000100:00100000:0.0:1651529917.246352:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+199:39029:x1731745946827456:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.246357:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180248 count 1 00002000:00010000:0.0:1651529917.246363:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c018:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.246364:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c1cdcb2/0x3234de053c55780 lrc: 3/0,1 mode: --/PW res: [0x2c018:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246368:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.246369:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.246370:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c1cdcb2/0x3234de053c55780 lrc: 3/0,1 mode: PW/PW res: [0x2c018:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.246372:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.246373:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c1cdcb2/0x3234de053c55780 lrc: 3/0,1 mode: PW/PW res: [0x2c018:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246377:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c1cdcb2/0x3234de053c55780 lrc: 3/0,1 mode: PW/PW res: [0x2c018:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.246379:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.246380:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c1cdcb2/0x3234de053c55780 lrc: 2/0,0 mode: PW/PW res: [0x2c018:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.246385:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.246390:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.246396:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946827520 00000100:00100000:1.0:1651529917.246401:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946827584 00000100:00100000:1.0:1651529917.246403:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946827712 00000100:00100000:1.0:1651529917.246405:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946827648 00000100:00100000:1.0:1651529917.246407:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946827776 00000100:00100000:1.0:1651529917.246410:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 725 00000100:00100000:1.0:1651529917.246412:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000020f0e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+205:39030:x1731745946827520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529917.246421:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+205:39029:x1731745946827456:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 73us (93us total) trans 21474837175 rc 0/0 00002000:00080000:1.0:1651529917.246424:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180249 count 1 00000100:00100000:0.0:1651529917.246425:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 724 00002000:00010000:1.0:1651529917.246429:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c019:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1651529917.246430:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 726 00010000:00010000:1.0:1651529917.246431:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c55787 lrc: 3/0,1 mode: --/PW res: [0x2c019:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.246432:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051722b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+204:39029:x1731745946827584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529917.246435:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.246435:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.246436:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c55787 lrc: 3/0,1 mode: PW/PW res: [0x2c019:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.246436:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180250 count 1 00010000:00010000:1.0:1651529917.246440:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c55787 lrc: 3/0,1 mode: PW/PW res: [0x2c019:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.246441:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c01a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.246443:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c55787 lrc: 3/0,1 mode: PW/PW res: [0x2c019:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246443:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007126e775/0x3234de053c5578e lrc: 3/0,1 mode: --/PW res: [0x2c01a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246446:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c55787 lrc: 2/0,0 mode: PW/PW res: [0x2c019:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246446:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.246447:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.246448:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007126e775/0x3234de053c5578e lrc: 3/0,1 mode: PW/PW res: [0x2c01a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246451:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007126e775/0x3234de053c5578e lrc: 3/0,1 mode: PW/PW res: [0x2c01a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246461:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007126e775/0x3234de053c5578e lrc: 3/0,1 mode: PW/PW res: [0x2c01a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246467:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007126e775/0x3234de053c5578e lrc: 2/0,0 mode: PW/PW res: [0x2c01a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.246495:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000020f0e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+206:39030:x1731745946827520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 81us (150us total) trans 21474837176 rc 0/0 00000100:00100000:1.0:1651529917.246498:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 725 00000100:00100000:1.0:1651529917.246503:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 727 00000100:00100000:1.0:1651529917.246504:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000c84c6c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+205:39029:x1731745946827712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529917.246504:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051722b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+205:39029:x1731745946827584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 72us (132us total) trans 21474837177 rc 0/0 00000100:00100000:0.0:1651529917.246507:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 726 00002000:00080000:1.0:1651529917.246509:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180252 count 1 00000100:00100000:0.0:1651529917.246513:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 728 00002000:00010000:1.0:1651529917.246514:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c01c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1651529917.246514:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000067181b35 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+204:39030:x1731745946827648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529917.246515:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c55795 lrc: 3/0,1 mode: --/PW res: [0x2c01c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.246518:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180251 count 1 00010000:00010000:1.0:1651529917.246519:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.246519:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.246520:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c55795 lrc: 3/0,1 mode: PW/PW res: [0x2c01c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.246523:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c01b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.246524:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c55795 lrc: 3/0,1 mode: PW/PW res: [0x2c01c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246524:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059de8c3d/0x3234de053c5579c lrc: 3/0,1 mode: --/PW res: [0x2c01b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246527:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c55795 lrc: 3/0,1 mode: PW/PW res: [0x2c01c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246528:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.246529:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c55795 lrc: 2/0,0 mode: PW/PW res: [0x2c01c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246529:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.246530:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059de8c3d/0x3234de053c5579c lrc: 3/0,1 mode: PW/PW res: [0x2c01b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246533:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059de8c3d/0x3234de053c5579c lrc: 3/0,1 mode: PW/PW res: [0x2c01b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246536:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059de8c3d/0x3234de053c5579c lrc: 3/0,1 mode: PW/PW res: [0x2c01b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246539:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059de8c3d/0x3234de053c5579c lrc: 2/0,0 mode: PW/PW res: [0x2c01b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.246562:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000c84c6c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+205:39029:x1731745946827712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 57us (182us total) trans 21474837178 rc 0/0 00000100:00100000:1.0:1651529917.246564:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 727 00000100:00100000:1.0:1651529917.246569:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 729 00000100:00100000:1.0:1651529917.246571:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0bff89e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+204:39029:x1731745946827776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.246583:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180253 count 1 00002000:00010000:1.0:1651529917.246588:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c01d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.246589:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c557a3 lrc: 3/0,1 mode: --/PW res: [0x2c01d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246595:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.246596:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.246597:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c557a3 lrc: 3/0,1 mode: PW/PW res: [0x2c01d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.246599:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000067181b35 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+205:39030:x1731745946827648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 83us (213us total) trans 21474837179 rc 0/0 00010000:00010000:1.0:1651529917.246600:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c557a3 lrc: 3/0,1 mode: PW/PW res: [0x2c01d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.246602:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 728 00010000:00010000:1.0:1651529917.246603:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c557a3 lrc: 3/0,1 mode: PW/PW res: [0x2c01d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246606:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c557a3 lrc: 2/0,0 mode: PW/PW res: [0x2c01d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246622:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c1cdcb2/0x3234de053c55780 lrc: 2/0,0 mode: PW/PW res: [0x2c018:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246626:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006c1cdcb2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.246627:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c1cdcb2/0x3234de053c55780 lrc: 2/0,0 mode: PW/PW res: [0x2c018:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246630:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c1cdcb2/0x3234de053c55780 lrc: 3/0,0 mode: PW/PW res: [0x2c018:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246634:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c1cdcb2/0x3234de053c55780 lrc: 1/0,0 mode: --/PW res: [0x2c018:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246637:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c1cdcb2/0x3234de053c55780 lrc: 0/0,0 mode: --/PW res: [0x2c018:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.246639:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0bff89e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+205:39029:x1731745946827776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 68us (249us total) trans 21474837180 rc 0/0 00010000:00010000:0.0:1651529917.246641:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c55787 lrc: 2/0,0 mode: PW/PW res: [0x2c019:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.246642:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 729 00010000:00010000:0.0:1651529917.246644:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e4f40ecf already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.246645:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c55787 lrc: 2/0,0 mode: PW/PW res: [0x2c019:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246650:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007126e775/0x3234de053c5578e lrc: 2/0,0 mode: PW/PW res: [0x2c01a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246650:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c55787 lrc: 3/0,0 mode: PW/PW res: [0x2c019:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246653:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007126e775 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.246653:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c55787 lrc: 1/0,0 mode: --/PW res: [0x2c019:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246654:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007126e775/0x3234de053c5578e lrc: 2/0,0 mode: PW/PW res: [0x2c01a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246656:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c55787 lrc: 0/0,0 mode: --/PW res: [0x2c019:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246657:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007126e775/0x3234de053c5578e lrc: 3/0,0 mode: PW/PW res: [0x2c01a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246664:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007126e775/0x3234de053c5578e lrc: 1/0,0 mode: --/PW res: [0x2c01a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246667:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007126e775/0x3234de053c5578e lrc: 0/0,0 mode: --/PW res: [0x2c01a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246672:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c55795 lrc: 2/0,0 mode: PW/PW res: [0x2c01c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246674:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002d7487dc already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.246675:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c55795 lrc: 2/0,0 mode: PW/PW res: [0x2c01c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246678:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c55795 lrc: 3/0,0 mode: PW/PW res: [0x2c01c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246681:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c55795 lrc: 1/0,0 mode: --/PW res: [0x2c01c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246684:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c55795 lrc: 0/0,0 mode: --/PW res: [0x2c01c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246685:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059de8c3d/0x3234de053c5579c lrc: 2/0,0 mode: PW/PW res: [0x2c01b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246688:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000059de8c3d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.246689:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059de8c3d/0x3234de053c5579c lrc: 2/0,0 mode: PW/PW res: [0x2c01b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246692:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059de8c3d/0x3234de053c5579c lrc: 3/0,0 mode: PW/PW res: [0x2c01b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246695:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059de8c3d/0x3234de053c5579c lrc: 1/0,0 mode: --/PW res: [0x2c01b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246697:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c557a3 lrc: 2/0,0 mode: PW/PW res: [0x2c01d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246698:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059de8c3d/0x3234de053c5579c lrc: 0/0,0 mode: --/PW res: [0x2c01b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246700:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cde7e11a already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.246701:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c557a3 lrc: 2/0,0 mode: PW/PW res: [0x2c01d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246704:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c557a3 lrc: 3/0,0 mode: PW/PW res: [0x2c01d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246707:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c557a3 lrc: 1/0,0 mode: --/PW res: [0x2c01d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246710:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c557a3 lrc: 0/0,0 mode: --/PW res: [0x2c01d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.246724:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.246735:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946828160 00000100:00100000:0.0:1651529917.246746:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 730 00000100:00100000:0.0:1651529917.246747:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000fe04db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+205:39030:x1731745946828160:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529917.246748:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529917.246758:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180254 count 1 00002000:00010000:0.0:1651529917.246763:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c01e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.246764:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049d4bb9b/0x3234de053c557aa lrc: 3/0,1 mode: --/PW res: [0x2c01e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246768:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.246769:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.246769:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049d4bb9b/0x3234de053c557aa lrc: 3/0,1 mode: PW/PW res: [0x2c01e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246773:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049d4bb9b/0x3234de053c557aa lrc: 3/0,1 mode: PW/PW res: [0x2c01e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246776:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049d4bb9b/0x3234de053c557aa lrc: 3/0,1 mode: PW/PW res: [0x2c01e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246779:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049d4bb9b/0x3234de053c557aa lrc: 2/0,0 mode: PW/PW res: [0x2c01e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.246815:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946828224 00000100:00100000:0.0:1651529917.246821:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000fe04db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+207:39030:x1731745946828160:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 72us (96us total) trans 21474837181 rc 0/0 00000100:00100000:0.0:1651529917.246824:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 730 00000100:00100000:1.0:1651529917.246832:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 731 00000100:00100000:1.0:1651529917.246833:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000056e45ef2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+206:39029:x1731745946828224:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529917.246837:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049d4bb9b/0x3234de053c557aa lrc: 2/0,0 mode: PW/PW res: [0x2c01e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.246839:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180255 count 1 00010000:00010000:0.0:1651529917.246841:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000049d4bb9b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.246842:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049d4bb9b/0x3234de053c557aa lrc: 2/0,0 mode: PW/PW res: [0x2c01e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.246843:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c01f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.246845:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c557b1 lrc: 3/0,1 mode: --/PW res: [0x2c01f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246846:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049d4bb9b/0x3234de053c557aa lrc: 3/0,0 mode: PW/PW res: [0x2c01e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246848:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.246849:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.246850:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c557b1 lrc: 3/0,1 mode: PW/PW res: [0x2c01f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246850:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049d4bb9b/0x3234de053c557aa lrc: 1/0,0 mode: --/PW res: [0x2c01e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246853:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049d4bb9b/0x3234de053c557aa lrc: 0/0,0 mode: --/PW res: [0x2c01e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246854:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c557b1 lrc: 3/0,1 mode: PW/PW res: [0x2c01f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246859:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c557b1 lrc: 3/0,1 mode: PW/PW res: [0x2c01f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246862:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c557b1 lrc: 2/0,0 mode: PW/PW res: [0x2c01f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246881:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c557b1 lrc: 2/0,0 mode: PW/PW res: [0x2c01f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246898:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d1167ce5 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.246900:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c557b1 lrc: 2/0,0 mode: PW/PW res: [0x2c01f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246903:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c557b1 lrc: 3/0,0 mode: PW/PW res: [0x2c01f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.246907:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c557b1 lrc: 1/0,0 mode: --/PW res: [0x2c01f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.246909:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000056e45ef2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+207:39029:x1731745946828224:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 74us (166us total) trans 21474837182 rc 0/0 00010000:00010000:0.0:1651529917.246910:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c557b1 lrc: 0/0,0 mode: --/PW res: [0x2c01f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.246912:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 731 00000100:00100000:1.0:1651529917.246926:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.246962:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946828480 00000100:00100000:1.0:1651529917.246972:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 732 00000100:00100000:1.0:1651529917.246974:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000020362888 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+207:39030:x1731745946828480:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.246979:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180256 count 1 00002000:00010000:1.0:1651529917.246984:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c020:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.246985:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c557b8 lrc: 3/0,1 mode: --/PW res: [0x2c020:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246989:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.246990:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.246991:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c557b8 lrc: 3/0,1 mode: PW/PW res: [0x2c020:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.246994:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c557b8 lrc: 3/0,1 mode: PW/PW res: [0x2c020:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247000:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c557b8 lrc: 3/0,1 mode: PW/PW res: [0x2c020:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247002:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c557b8 lrc: 2/0,0 mode: PW/PW res: [0x2c020:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.247050:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000020362888 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+208:39030:x1731745946828480:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 75us (123us total) trans 21474837183 rc 0/0 00000100:00100000:1.0:1651529917.247053:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 732 00010000:00010000:1.0:1651529917.247059:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c557b8 lrc: 2/0,0 mode: PW/PW res: [0x2c020:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247063:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009fff0bd3 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.247064:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c557b8 lrc: 2/0,0 mode: PW/PW res: [0x2c020:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247067:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c557b8 lrc: 3/0,0 mode: PW/PW res: [0x2c020:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247071:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c557b8 lrc: 1/0,0 mode: --/PW res: [0x2c020:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247074:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c557b8 lrc: 0/0,0 mode: --/PW res: [0x2c020:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.247134:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.247142:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.247152:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.247153:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946828544 00000100:00100000:1.0:1651529917.247160:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.247169:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.247170:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946828608 00000100:00100000:0.0:1651529917.247173:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946828672 00000100:00100000:1.0:1651529917.247174:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946828800 00000100:00100000:0.0:1651529917.247176:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946828736 00000100:00100000:0.0:1651529917.247179:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 733 00000100:00100000:1.0:1651529917.247183:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 734 00000100:00100000:1.0:1651529917.247184:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068b6c75f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+212:39029:x1731745946828608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.247189:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180258 count 1 00000100:00100000:0.0:1651529917.247197:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5ebc6ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+212:39030:x1731745946828544:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00010000:1.0:1651529917.247201:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c022:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.247203:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c557bf lrc: 3/0,1 mode: --/PW res: [0x2c022:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.247203:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180257 count 1 00010000:00010000:1.0:1651529917.247206:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.247207:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.247208:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c557bf lrc: 3/0,1 mode: PW/PW res: [0x2c022:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.247209:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c021:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.247210:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c557c6 lrc: 3/0,1 mode: --/PW res: [0x2c021:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247212:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c557bf lrc: 3/0,1 mode: PW/PW res: [0x2c022:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247214:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.247214:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.247215:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c557bf lrc: 3/0,1 mode: PW/PW res: [0x2c022:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247215:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c557c6 lrc: 3/0,1 mode: PW/PW res: [0x2c021:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247217:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c557bf lrc: 2/0,0 mode: PW/PW res: [0x2c022:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247219:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c557c6 lrc: 3/0,1 mode: PW/PW res: [0x2c021:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247249:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c557c6 lrc: 3/0,1 mode: PW/PW res: [0x2c021:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247251:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c557c6 lrc: 2/0,0 mode: PW/PW res: [0x2c021:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.247281:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068b6c75f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+214:39029:x1731745946828608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 96us (138us total) trans 21474837184 rc 0/0 00000100:00100000:1.0:1651529917.247286:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 734 00000100:00100000:1.0:1651529917.247291:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 735 00000100:00100000:1.0:1651529917.247293:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000597d93ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+213:39030:x1731745946828672:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.247297:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180259 count 1 00002000:00010000:1.0:1651529917.247302:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c023:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.247304:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c557cd lrc: 3/0,1 mode: --/PW res: [0x2c023:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247317:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.247317:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.247318:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c557cd lrc: 3/0,1 mode: PW/PW res: [0x2c023:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247322:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c557cd lrc: 3/0,1 mode: PW/PW res: [0x2c023:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247325:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c557cd lrc: 3/0,1 mode: PW/PW res: [0x2c023:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247328:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c557cd lrc: 2/0,0 mode: PW/PW res: [0x2c023:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.247328:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5ebc6ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+213:39030:x1731745946828544:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 145us (193us total) trans 21474837185 rc 0/0 00000100:00100000:0.0:1651529917.247331:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 733 00000100:00100000:0.0:1651529917.247337:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 736 00000100:00100000:0.0:1651529917.247338:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dabd64d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+212:39029:x1731745946828736:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.247343:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180260 count 1 00002000:00010000:0.0:1651529917.247348:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c024:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.247350:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cab45436/0x3234de053c557d4 lrc: 3/0,1 mode: --/PW res: [0x2c024:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247354:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.247354:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.247355:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cab45436/0x3234de053c557d4 lrc: 3/0,1 mode: PW/PW res: [0x2c024:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247359:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cab45436/0x3234de053c557d4 lrc: 3/0,1 mode: PW/PW res: [0x2c024:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247362:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cab45436/0x3234de053c557d4 lrc: 3/0,1 mode: PW/PW res: [0x2c024:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.247365:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000597d93ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+213:39030:x1731745946828672:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 71us (213us total) trans 21474837186 rc 0/0 00010000:00010000:0.0:1651529917.247365:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cab45436/0x3234de053c557d4 lrc: 2/0,0 mode: PW/PW res: [0x2c024:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.247368:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 735 00000100:00100000:1.0:1651529917.247373:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 737 00000100:00100000:1.0:1651529917.247374:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eff08db4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+212:39030:x1731745946828800:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.247379:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180261 count 1 00002000:00010000:1.0:1651529917.247383:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c025:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.247385:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c557db lrc: 3/0,1 mode: --/PW res: [0x2c025:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247388:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.247389:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.247390:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c557db lrc: 3/0,1 mode: PW/PW res: [0x2c025:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247393:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c557db lrc: 3/0,1 mode: PW/PW res: [0x2c025:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247396:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c557db lrc: 3/0,1 mode: PW/PW res: [0x2c025:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247399:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c557db lrc: 2/0,0 mode: PW/PW res: [0x2c025:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.247399:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dabd64d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+213:39029:x1731745946828736:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 60us (230us total) trans 21474837187 rc 0/0 00000100:00100000:0.0:1651529917.247402:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 736 00000100:00100000:1.0:1651529917.247431:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eff08db4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+213:39030:x1731745946828800:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 56us (271us total) trans 21474837188 rc 0/0 00000100:00100000:1.0:1651529917.247434:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 737 00010000:00010000:0.0:1651529917.247437:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c557bf lrc: 2/0,0 mode: PW/PW res: [0x2c022:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247440:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001d04fb0a already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.247441:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c557c6 lrc: 2/0,0 mode: PW/PW res: [0x2c021:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247442:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c557bf lrc: 2/0,0 mode: PW/PW res: [0x2c022:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247444:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e943794 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.247445:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c557c6 lrc: 2/0,0 mode: PW/PW res: [0x2c021:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247447:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c557bf lrc: 3/0,0 mode: PW/PW res: [0x2c022:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247451:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c557c6 lrc: 3/0,0 mode: PW/PW res: [0x2c021:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247452:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c557bf lrc: 1/0,0 mode: --/PW res: [0x2c022:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247454:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c557bf lrc: 0/0,0 mode: --/PW res: [0x2c022:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247455:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c557c6 lrc: 1/0,0 mode: --/PW res: [0x2c021:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247458:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e943794/0x3234de053c557c6 lrc: 0/0,0 mode: --/PW res: [0x2c021:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247459:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c557cd lrc: 2/0,0 mode: PW/PW res: [0x2c023:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247462:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d37a9fd1 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.247463:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cab45436/0x3234de053c557d4 lrc: 2/0,0 mode: PW/PW res: [0x2c024:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247463:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c557cd lrc: 2/0,0 mode: PW/PW res: [0x2c023:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247465:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cab45436 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.247465:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c557cd lrc: 3/0,0 mode: PW/PW res: [0x2c023:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247466:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cab45436/0x3234de053c557d4 lrc: 2/0,0 mode: PW/PW res: [0x2c024:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247468:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c557cd lrc: 1/0,0 mode: --/PW res: [0x2c023:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247469:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cab45436/0x3234de053c557d4 lrc: 3/0,0 mode: PW/PW res: [0x2c024:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247471:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c557cd lrc: 0/0,0 mode: --/PW res: [0x2c023:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247472:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cab45436/0x3234de053c557d4 lrc: 1/0,0 mode: --/PW res: [0x2c024:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247474:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c557db lrc: 2/0,0 mode: PW/PW res: [0x2c025:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247475:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cab45436/0x3234de053c557d4 lrc: 0/0,0 mode: --/PW res: [0x2c024:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247477:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a032e9d0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.247478:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c557db lrc: 2/0,0 mode: PW/PW res: [0x2c025:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247481:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c557db lrc: 3/0,0 mode: PW/PW res: [0x2c025:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247484:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c557db lrc: 1/0,0 mode: --/PW res: [0x2c025:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247487:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c557db lrc: 0/0,0 mode: --/PW res: [0x2c025:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.247488:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.247494:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946828864 00000100:00100000:1.0:1651529917.247501:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.247501:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 738 00000100:00100000:0.0:1651529917.247502:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df603127 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+213:39029:x1731745946828864:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.247515:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180262 count 1 00000100:00100000:1.0:1651529917.247517:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00010000:0.0:1651529917.247520:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c026:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.247521:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067d657cd/0x3234de053c557e2 lrc: 3/0,1 mode: --/PW res: [0x2c026:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247525:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.247525:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.247526:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067d657cd/0x3234de053c557e2 lrc: 3/0,1 mode: PW/PW res: [0x2c026:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247529:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067d657cd/0x3234de053c557e2 lrc: 3/0,1 mode: PW/PW res: [0x2c026:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247533:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067d657cd/0x3234de053c557e2 lrc: 3/0,1 mode: PW/PW res: [0x2c026:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247536:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067d657cd/0x3234de053c557e2 lrc: 2/0,0 mode: PW/PW res: [0x2c026:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.247578:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df603127 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+214:39029:x1731745946828864:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 75us (90us total) trans 21474837189 rc 0/0 00000100:00100000:0.0:1651529917.247582:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 738 00010000:00010000:1.0:1651529917.247587:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067d657cd/0x3234de053c557e2 lrc: 2/0,0 mode: PW/PW res: [0x2c026:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.247587:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946829312 00010000:00010000:1.0:1651529917.247591:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000067d657cd already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.247592:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067d657cd/0x3234de053c557e2 lrc: 2/0,0 mode: PW/PW res: [0x2c026:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247595:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067d657cd/0x3234de053c557e2 lrc: 3/0,0 mode: PW/PW res: [0x2c026:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247600:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067d657cd/0x3234de053c557e2 lrc: 1/0,0 mode: --/PW res: [0x2c026:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247603:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067d657cd/0x3234de053c557e2 lrc: 0/0,0 mode: --/PW res: [0x2c026:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.247607:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946829376 00000100:00100000:0.0:1651529917.247611:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 739 00000100:00100000:0.0:1651529917.247612:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+215:39030:x1731745946829312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.247617:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180263 count 1 00002000:00010000:0.0:1651529917.247622:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c027:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.247624:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c557e9 lrc: 3/0,1 mode: --/PW res: [0x2c027:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247627:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.247628:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.247629:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c557e9 lrc: 3/0,1 mode: PW/PW res: [0x2c027:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247632:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c557e9 lrc: 3/0,1 mode: PW/PW res: [0x2c027:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247635:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c557e9 lrc: 3/0,1 mode: PW/PW res: [0x2c027:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.247636:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 740 00000100:00100000:1.0:1651529917.247638:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+215:39029:x1731745946829376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529917.247638:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c557e9 lrc: 2/0,0 mode: PW/PW res: [0x2c027:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.247644:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180264 count 1 00002000:00010000:1.0:1651529917.247649:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c028:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.247651:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c557f0 lrc: 3/0,1 mode: --/PW res: [0x2c028:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247654:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.247655:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.247656:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c557f0 lrc: 3/0,1 mode: PW/PW res: [0x2c028:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247660:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c557f0 lrc: 3/0,1 mode: PW/PW res: [0x2c028:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247663:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c557f0 lrc: 3/0,1 mode: PW/PW res: [0x2c028:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247665:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c557f0 lrc: 2/0,0 mode: PW/PW res: [0x2c028:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.247703:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+217:39030:x1731745946829312:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 90us (202us total) trans 21474837190 rc 0/0 00000100:00100000:0.0:1651529917.247706:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 739 00000100:00100000:1.0:1651529917.247714:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+216:39029:x1731745946829376:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 75us (197us total) trans 21474837191 rc 0/0 00000100:00100000:1.0:1651529917.247717:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 740 00010000:00010000:0.0:1651529917.247730:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c557e9 lrc: 2/0,0 mode: PW/PW res: [0x2c027:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247734:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002731c8d2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.247735:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c557e9 lrc: 2/0,0 mode: PW/PW res: [0x2c027:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247738:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c557e9 lrc: 3/0,0 mode: PW/PW res: [0x2c027:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.247741:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.247743:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c557e9 lrc: 1/0,0 mode: --/PW res: [0x2c027:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247745:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c557e9 lrc: 0/0,0 mode: --/PW res: [0x2c027:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247750:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c557f0 lrc: 2/0,0 mode: PW/PW res: [0x2c028:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247752:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000215144f2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.247753:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c557f0 lrc: 2/0,0 mode: PW/PW res: [0x2c028:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247756:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c557f0 lrc: 3/0,0 mode: PW/PW res: [0x2c028:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247759:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c557f0 lrc: 1/0,0 mode: --/PW res: [0x2c028:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.247762:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c557f0 lrc: 0/0,0 mode: --/PW res: [0x2c028:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.247770:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946829568 00000100:00100000:1.0:1651529917.247783:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 741 00000100:00100000:1.0:1651529917.247785:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000020f0e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+216:39030:x1731745946829568:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.247795:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180265 count 1 00002000:00010000:1.0:1651529917.247800:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c029:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.247802:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c557f7 lrc: 3/0,1 mode: --/PW res: [0x2c029:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247806:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.247806:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.247807:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c557f7 lrc: 3/0,1 mode: PW/PW res: [0x2c029:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247811:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c557f7 lrc: 3/0,1 mode: PW/PW res: [0x2c029:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247814:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c557f7 lrc: 3/0,1 mode: PW/PW res: [0x2c029:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247817:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c557f7 lrc: 2/0,0 mode: PW/PW res: [0x2c029:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.247855:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000020f0e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+217:39030:x1731745946829568:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 69us (114us total) trans 21474837192 rc 0/0 00000100:00100000:1.0:1651529917.247857:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 741 00010000:00010000:1.0:1651529917.247864:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c557f7 lrc: 2/0,0 mode: PW/PW res: [0x2c029:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247867:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ac14729e already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.247868:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c557f7 lrc: 2/0,0 mode: PW/PW res: [0x2c029:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247871:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c557f7 lrc: 3/0,0 mode: PW/PW res: [0x2c029:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247875:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c557f7 lrc: 1/0,0 mode: --/PW res: [0x2c029:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.247878:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c557f7 lrc: 0/0,0 mode: --/PW res: [0x2c029:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.247913:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.247942:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.247953:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.247961:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.247969:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.247969:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946829632 00000100:00100000:0.0:1651529917.247974:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946829760 00000100:00100000:1.0:1651529917.247976:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.247976:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946829696 00000100:00100000:0.0:1651529917.247979:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946829824 00000100:00100000:0.0:1651529917.247981:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946829888 00000100:00100000:1.0:1651529917.247983:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946830016 00000100:00100000:0.0:1651529917.247984:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 742 00000100:00100000:0.0:1651529917.247985:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051722b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+222:39029:x1731745946829632:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529917.247990:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 743 00002000:00080000:0.0:1651529917.247990:0:166112:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180266 count 1 00000100:00100000:1.0:1651529917.247991:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000c84c6c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+222:39029:x1731745946829760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00010000:0.0:1651529917.247995:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c02a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00080000:1.0:1651529917.247997:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180268 count 1 00010000:00010000:0.0:1651529917.247997:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c557fe lrc: 3/0,1 mode: --/PW res: [0x2c02a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248000:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.248001:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00010000:1.0:1651529917.248002:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c02c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.248002:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c557fe lrc: 3/0,1 mode: PW/PW res: [0x2c02a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248003:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c55805 lrc: 3/0,1 mode: --/PW res: [0x2c02c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248007:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.248008:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.248008:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c55805 lrc: 3/0,1 mode: PW/PW res: [0x2c02c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248008:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c557fe lrc: 3/0,1 mode: PW/PW res: [0x2c02a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248011:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c557fe lrc: 3/0,1 mode: PW/PW res: [0x2c02a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248012:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c55805 lrc: 3/0,1 mode: PW/PW res: [0x2c02c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248014:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c557fe lrc: 2/0,0 mode: PW/PW res: [0x2c02a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248015:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c55805 lrc: 3/0,1 mode: PW/PW res: [0x2c02c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248018:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c55805 lrc: 2/0,0 mode: PW/PW res: [0x2c02c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.248070:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000c84c6c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+224:39029:x1731745946829760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 78us (128us total) trans 21474837194 rc 0/0 00000100:00100000:1.0:1651529917.248075:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 743 00000100:00100000:1.0:1651529917.248080:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 744 00000100:00100000:1.0:1651529917.248082:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000035de0fa0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+223:39030:x1731745946829696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.248086:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180267 count 1 00002000:00010000:1.0:1651529917.248090:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c02b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.248092:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c5580c lrc: 3/0,1 mode: --/PW res: [0x2c02b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.248099:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051722b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+223:39029:x1731745946829632:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 84us (157us total) trans 21474837193 rc 0/0 00000100:00100000:0.0:1651529917.248103:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 742 00000100:00100000:0.0:1651529917.248109:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 745 00010000:00010000:1.0:1651529917.248110:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1651529917.248110:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003ffbc5dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+222:39030:x1731745946829824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529917.248111:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.248112:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c5580c lrc: 3/0,1 mode: PW/PW res: [0x2c02b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.248115:0:166112:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180269 count 1 00010000:00010000:1.0:1651529917.248116:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c5580c lrc: 3/0,1 mode: PW/PW res: [0x2c02b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248119:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c5580c lrc: 3/0,1 mode: PW/PW res: [0x2c02b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.248120:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c02d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.248122:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c5580c lrc: 2/0,0 mode: PW/PW res: [0x2c02b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248122:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c55813 lrc: 3/0,1 mode: --/PW res: [0x2c02d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248125:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.248126:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.248127:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c55813 lrc: 3/0,1 mode: PW/PW res: [0x2c02d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248131:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c55813 lrc: 3/0,1 mode: PW/PW res: [0x2c02d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248136:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c55813 lrc: 3/0,1 mode: PW/PW res: [0x2c02d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248139:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c55813 lrc: 2/0,0 mode: PW/PW res: [0x2c02d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.248156:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000035de0fa0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+224:39030:x1731745946829696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 74us (203us total) trans 21474837195 rc 0/0 00000100:00100000:1.0:1651529917.248159:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 744 00000100:00100000:1.0:1651529917.248164:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 746 00000100:00100000:1.0:1651529917.248166:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000567318ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+223:39030:x1731745946829888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.248170:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180270 count 1 00002000:00010000:1.0:1651529917.248174:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c02e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.248176:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006317cd4c/0x3234de053c5581a lrc: 3/0,1 mode: --/PW res: [0x2c02e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248179:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.248180:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.248181:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006317cd4c/0x3234de053c5581a lrc: 3/0,1 mode: PW/PW res: [0x2c02e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248184:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006317cd4c/0x3234de053c5581a lrc: 3/0,1 mode: PW/PW res: [0x2c02e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248187:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006317cd4c/0x3234de053c5581a lrc: 3/0,1 mode: PW/PW res: [0x2c02e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.248189:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003ffbc5dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+223:39030:x1731745946829824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 78us (227us total) trans 21474837196 rc 0/0 00010000:00010000:1.0:1651529917.248190:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006317cd4c/0x3234de053c5581a lrc: 2/0,0 mode: PW/PW res: [0x2c02e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.248192:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 745 00000100:00100000:0.0:1651529917.248198:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 747 00000100:00100000:0.0:1651529917.248199:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004c5dc988 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+222:39029:x1731745946830016:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.248204:0:166112:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180272 count 1 00002000:00010000:0.0:1651529917.248209:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c030:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.248211:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c55821 lrc: 3/0,1 mode: --/PW res: [0x2c030:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248214:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.248215:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.248216:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c55821 lrc: 3/0,1 mode: PW/PW res: [0x2c030:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248219:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c55821 lrc: 3/0,1 mode: PW/PW res: [0x2c030:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248235:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c55821 lrc: 3/0,1 mode: PW/PW res: [0x2c030:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.248239:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000567318ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+223:39030:x1731745946829888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 55us (252us total) trans 21474837197 rc 0/0 00000100:00100000:1.0:1651529917.248242:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 746 00010000:00010000:0.0:1651529917.248246:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c55821 lrc: 2/0,0 mode: PW/PW res: [0x2c030:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.248257:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.248270:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.248281:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004c5dc988 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+223:39029:x1731745946830016:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 81us (305us total) trans 21474837198 rc 0/0 00000100:00100000:0.0:1651529917.248284:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 747 00000100:00100000:0.0:1651529917.248289:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946829952 00000100:00100000:0.0:1651529917.248293:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946830464 00000100:00100000:0.0:1651529917.248296:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 748 00000100:00100000:0.0:1651529917.248298:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+224:39030:x1731745946829952:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.248302:0:166112:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180271 count 1 00002000:00010000:0.0:1651529917.248307:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c02f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.248308:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c55828 lrc: 3/0,1 mode: --/PW res: [0x2c02f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248312:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.248313:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.248313:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c55828 lrc: 3/0,1 mode: PW/PW res: [0x2c02f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248317:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c55828 lrc: 3/0,1 mode: PW/PW res: [0x2c02f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248320:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c55828 lrc: 3/0,1 mode: PW/PW res: [0x2c02f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248322:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c55828 lrc: 2/0,0 mode: PW/PW res: [0x2c02f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248333:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c557fe lrc: 2/0,0 mode: PW/PW res: [0x2c02a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248337:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d52cc749 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.248339:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c557fe lrc: 2/0,0 mode: PW/PW res: [0x2c02a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248342:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c557fe lrc: 3/0,0 mode: PW/PW res: [0x2c02a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248347:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c557fe lrc: 1/0,0 mode: --/PW res: [0x2c02a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248350:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d52cc749/0x3234de053c557fe lrc: 0/0,0 mode: --/PW res: [0x2c02a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248354:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c55805 lrc: 2/0,0 mode: PW/PW res: [0x2c02c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.248360:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+225:39030:x1731745946829952:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 61us (102us total) trans 21474837199 rc 0/0 00010000:00010000:1.0:1651529917.248362:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000f18bca1 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.248363:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c55805 lrc: 2/0,0 mode: PW/PW res: [0x2c02c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.248363:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 748 00010000:00010000:1.0:1651529917.248366:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c55805 lrc: 3/0,0 mode: PW/PW res: [0x2c02c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.248368:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 749 00010000:00010000:1.0:1651529917.248370:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c55805 lrc: 1/0,0 mode: --/PW res: [0x2c02c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.248370:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+224:39030:x1731745946830464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529917.248372:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c55805 lrc: 0/0,0 mode: --/PW res: [0x2c02c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.248374:0:166112:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180273 count 1 00010000:00010000:1.0:1651529917.248376:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c5580c lrc: 2/0,0 mode: PW/PW res: [0x2c02b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248379:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f56810a1 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.248379:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c5580c lrc: 2/0,0 mode: PW/PW res: [0x2c02b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248382:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c5580c lrc: 3/0,0 mode: PW/PW res: [0x2c02b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248385:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c5580c lrc: 1/0,0 mode: --/PW res: [0x2c02b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248388:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c5580c lrc: 0/0,0 mode: --/PW res: [0x2c02b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248391:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c55813 lrc: 2/0,0 mode: PW/PW res: [0x2c02d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248394:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f616ea25 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.248394:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c55813 lrc: 2/0,0 mode: PW/PW res: [0x2c02d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.248394:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c031:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.248396:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c5582f lrc: 3/0,1 mode: --/PW res: [0x2c031:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248397:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c55813 lrc: 3/0,0 mode: PW/PW res: [0x2c02d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248400:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c55813 lrc: 1/0,0 mode: --/PW res: [0x2c02d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248400:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.248401:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.248402:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f616ea25/0x3234de053c55813 lrc: 0/0,0 mode: --/PW res: [0x2c02d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248402:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c5582f lrc: 3/0,1 mode: PW/PW res: [0x2c031:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248405:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c5582f lrc: 3/0,1 mode: PW/PW res: [0x2c031:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248406:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006317cd4c/0x3234de053c5581a lrc: 2/0,0 mode: PW/PW res: [0x2c02e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248408:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c5582f lrc: 3/0,1 mode: PW/PW res: [0x2c031:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248409:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006317cd4c already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.248410:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006317cd4c/0x3234de053c5581a lrc: 2/0,0 mode: PW/PW res: [0x2c02e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248411:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c5582f lrc: 2/0,0 mode: PW/PW res: [0x2c031:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248412:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006317cd4c/0x3234de053c5581a lrc: 3/0,0 mode: PW/PW res: [0x2c02e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248415:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006317cd4c/0x3234de053c5581a lrc: 1/0,0 mode: --/PW res: [0x2c02e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248418:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006317cd4c/0x3234de053c5581a lrc: 0/0,0 mode: --/PW res: [0x2c02e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248421:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c55821 lrc: 2/0,0 mode: PW/PW res: [0x2c030:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248424:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000093b5c984 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.248424:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c55821 lrc: 2/0,0 mode: PW/PW res: [0x2c030:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248427:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c55821 lrc: 3/0,0 mode: PW/PW res: [0x2c030:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248430:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c55821 lrc: 1/0,0 mode: --/PW res: [0x2c030:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248433:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093b5c984/0x3234de053c55821 lrc: 0/0,0 mode: --/PW res: [0x2c030:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248436:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c55828 lrc: 2/0,0 mode: PW/PW res: [0x2c02f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248439:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000075f9ff9d already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.248439:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c55828 lrc: 2/0,0 mode: PW/PW res: [0x2c02f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248442:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c55828 lrc: 3/0,0 mode: PW/PW res: [0x2c02f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.248444:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+225:39030:x1731745946830464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 73us (173us total) trans 21474837200 rc 0/0 00010000:00010000:1.0:1651529917.248445:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c55828 lrc: 1/0,0 mode: --/PW res: [0x2c02f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248448:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075f9ff9d/0x3234de053c55828 lrc: 0/0,0 mode: --/PW res: [0x2c02f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.248449:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 749 00010000:00010000:1.0:1651529917.248451:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c5582f lrc: 2/0,0 mode: PW/PW res: [0x2c031:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248453:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002e24dea3 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.248454:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c5582f lrc: 2/0,0 mode: PW/PW res: [0x2c031:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248459:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c5582f lrc: 3/0,0 mode: PW/PW res: [0x2c031:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248462:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c5582f lrc: 1/0,0 mode: --/PW res: [0x2c031:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248465:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e24dea3/0x3234de053c5582f lrc: 0/0,0 mode: --/PW res: [0x2c031:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.248529:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.248536:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.248546:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.248546:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946830720 00000100:00100000:1.0:1651529917.248555:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946830848 00000100:00100000:0.0:1651529917.248558:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946830784 00000100:00100000:1.0:1651529917.248562:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 750 00000100:00100000:1.0:1651529917.248563:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+227:39030:x1731745946830720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.248568:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180274 count 1 00002000:00010000:1.0:1651529917.248573:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c032:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.248575:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c55836 lrc: 3/0,1 mode: --/PW res: [0x2c032:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248578:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.248579:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.248580:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c55836 lrc: 3/0,1 mode: PW/PW res: [0x2c032:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248583:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c55836 lrc: 3/0,1 mode: PW/PW res: [0x2c032:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.248589:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 751 00000100:00100000:0.0:1651529917.248591:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+227:39030:x1731745946830848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.248597:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180276 count 1 00002000:00010000:0.0:1651529917.248602:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c034:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.248603:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c55836 lrc: 3/0,1 mode: PW/PW res: [0x2c032:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248604:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c5583d lrc: 3/0,1 mode: --/PW res: [0x2c034:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248606:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c55836 lrc: 2/0,0 mode: PW/PW res: [0x2c032:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248608:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.248608:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.248609:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c5583d lrc: 3/0,1 mode: PW/PW res: [0x2c034:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248620:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c5583d lrc: 3/0,1 mode: PW/PW res: [0x2c034:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248623:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c5583d lrc: 3/0,1 mode: PW/PW res: [0x2c034:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248626:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c5583d lrc: 2/0,0 mode: PW/PW res: [0x2c034:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.248647:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+228:39030:x1731745946830720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 83us (119us total) trans 21474837201 rc 0/0 00000100:00100000:1.0:1651529917.248650:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 750 00000100:00100000:1.0:1651529917.248655:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 752 00000100:00100000:1.0:1651529917.248657:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+228:39029:x1731745946830784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.248661:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180275 count 1 00002000:00010000:1.0:1651529917.248665:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c033:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.248667:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c55844 lrc: 3/0,1 mode: --/PW res: [0x2c033:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248670:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.248671:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.248672:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c55844 lrc: 3/0,1 mode: PW/PW res: [0x2c033:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248676:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c55844 lrc: 3/0,1 mode: PW/PW res: [0x2c033:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.248678:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+228:39030:x1731745946830848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 86us (141us total) trans 21474837202 rc 0/0 00010000:00010000:1.0:1651529917.248679:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c55844 lrc: 3/0,1 mode: PW/PW res: [0x2c033:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.248681:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 751 00010000:00010000:1.0:1651529917.248684:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c55844 lrc: 2/0,0 mode: PW/PW res: [0x2c033:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248690:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c55836 lrc: 2/0,0 mode: PW/PW res: [0x2c032:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248693:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000589cc6c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.248694:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c55836 lrc: 2/0,0 mode: PW/PW res: [0x2c032:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248697:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c55836 lrc: 3/0,0 mode: PW/PW res: [0x2c032:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248702:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c55836 lrc: 1/0,0 mode: --/PW res: [0x2c032:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248705:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c55836 lrc: 0/0,0 mode: --/PW res: [0x2c032:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248709:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c5583d lrc: 2/0,0 mode: PW/PW res: [0x2c034:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248712:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d2b9655c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.248713:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c5583d lrc: 2/0,0 mode: PW/PW res: [0x2c034:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248716:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c5583d lrc: 3/0,0 mode: PW/PW res: [0x2c034:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.248718:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+228:39029:x1731745946830784:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 60us (171us total) trans 21474837203 rc 0/0 00010000:00010000:0.0:1651529917.248719:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c5583d lrc: 1/0,0 mode: --/PW res: [0x2c034:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.248720:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 752 00010000:00010000:0.0:1651529917.248724:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c5583d lrc: 0/0,0 mode: --/PW res: [0x2c034:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248727:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c55844 lrc: 2/0,0 mode: PW/PW res: [0x2c033:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248730:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006512b8a0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.248731:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c55844 lrc: 2/0,0 mode: PW/PW res: [0x2c033:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248733:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c55844 lrc: 3/0,0 mode: PW/PW res: [0x2c033:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.248735:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.248736:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c55844 lrc: 1/0,0 mode: --/PW res: [0x2c033:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248739:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c55844 lrc: 0/0,0 mode: --/PW res: [0x2c033:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.248746:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946830976 00000100:00100000:1.0:1651529917.248747:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.248760:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.248761:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946830912 00000100:00100000:0.0:1651529917.248764:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946831040 00000100:00100000:0.0:1651529917.248767:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 753 00000100:00100000:0.0:1651529917.248769:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ffcc974c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+230:39030:x1731745946830976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.248774:0:166112:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180278 count 1 00002000:00010000:0.0:1651529917.248778:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c036:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.248780:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c5584b lrc: 3/0,1 mode: --/PW res: [0x2c036:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248783:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.248784:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.248785:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c5584b lrc: 3/0,1 mode: PW/PW res: [0x2c036:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.248788:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.248788:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c5584b lrc: 3/0,1 mode: PW/PW res: [0x2c036:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248791:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c5584b lrc: 3/0,1 mode: PW/PW res: [0x2c036:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248794:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c5584b lrc: 2/0,0 mode: PW/PW res: [0x2c036:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.248795:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529917.248800:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c5584b lrc: 2/0,0 mode: PW/PW res: [0x2c036:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248804:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001b109cb1 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.248805:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c5584b lrc: 2/0,0 mode: PW/PW res: [0x2c036:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248808:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c5584b lrc: 3/0,0 mode: PW/PW res: [0x2c036:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248813:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c5584b lrc: 1/0,0 mode: --/PW res: [0x2c036:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248816:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b109cb1/0x3234de053c5584b lrc: 0/0,0 mode: --/PW res: [0x2c036:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.248827:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946831104 00000100:00100000:1.0:1651529917.248832:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946831168 00000100:00100000:1.0:1651529917.248835:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 754 00000100:00100000:1.0:1651529917.248837:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9e74b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+233:39030:x1731745946830912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.248841:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180277 count 1 00002000:00010000:1.0:1651529917.248846:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c035:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1651529917.248851:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ffcc974c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+233:39030:x1731745946830976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 81us (115us total) trans 21474837204 rc 0/0 00010000:00010000:1.0:1651529917.248854:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c55852 lrc: 3/0,1 mode: --/PW res: [0x2c035:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.248854:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 753 00010000:00010000:1.0:1651529917.248858:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.248859:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.248860:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c55852 lrc: 3/0,1 mode: PW/PW res: [0x2c035:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.248860:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 755 00000100:00100000:0.0:1651529917.248861:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054ed0749 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+232:39029:x1731745946831040:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529917.248863:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c55852 lrc: 3/0,1 mode: PW/PW res: [0x2c035:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.248866:0:166112:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180279 count 1 00010000:00010000:1.0:1651529917.248867:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c55852 lrc: 3/0,1 mode: PW/PW res: [0x2c035:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248869:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c55852 lrc: 2/0,0 mode: PW/PW res: [0x2c035:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.248871:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c037:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.248873:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c55859 lrc: 3/0,1 mode: --/PW res: [0x2c037:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248883:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.248884:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.248885:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c55859 lrc: 3/0,1 mode: PW/PW res: [0x2c037:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248889:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c55859 lrc: 3/0,1 mode: PW/PW res: [0x2c037:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248892:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c55859 lrc: 3/0,1 mode: PW/PW res: [0x2c037:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248895:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c55859 lrc: 2/0,0 mode: PW/PW res: [0x2c037:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.248915:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9e74b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+234:39030:x1731745946830912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 77us (167us total) trans 21474837205 rc 0/0 00000100:00100000:1.0:1651529917.248918:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 754 00000100:00100000:1.0:1651529917.248923:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 756 00000100:00100000:1.0:1651529917.248925:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057d84ac9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+233:39030:x1731745946831104:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.248929:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180280 count 1 00002000:00010000:1.0:1651529917.248934:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c038:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1651529917.248934:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054ed0749 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+233:39029:x1731745946831040:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 72us (174us total) trans 21474837206 rc 0/0 00010000:00010000:1.0:1651529917.248936:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55860 lrc: 3/0,1 mode: --/PW res: [0x2c038:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.248937:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 755 00010000:00010000:1.0:1651529917.248939:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.248940:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.248941:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55860 lrc: 3/0,1 mode: PW/PW res: [0x2c038:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.248942:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 757 00000100:00100000:0.0:1651529917.248943:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f6619aeb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+232:39029:x1731745946831168:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529917.248944:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55860 lrc: 3/0,1 mode: PW/PW res: [0x2c038:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.248947:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55860 lrc: 3/0,1 mode: PW/PW res: [0x2c038:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.248948:0:166112:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180281 count 1 00010000:00010000:1.0:1651529917.248950:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55860 lrc: 2/0,0 mode: PW/PW res: [0x2c038:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.248953:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c039:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.248954:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c55867 lrc: 3/0,1 mode: --/PW res: [0x2c039:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248958:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.248958:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.248959:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c55867 lrc: 3/0,1 mode: PW/PW res: [0x2c039:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248963:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c55867 lrc: 3/0,1 mode: PW/PW res: [0x2c039:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248966:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c55867 lrc: 3/0,1 mode: PW/PW res: [0x2c039:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.248969:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c55867 lrc: 2/0,0 mode: PW/PW res: [0x2c039:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.248982:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057d84ac9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+233:39030:x1731745946831104:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 56us (193us total) trans 21474837207 rc 0/0 00000100:00100000:1.0:1651529917.248984:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 756 00000100:00100000:0.0:1651529917.249000:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f6619aeb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+233:39029:x1731745946831168:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 56us (205us total) trans 21474837208 rc 0/0 00000100:00100000:0.0:1651529917.249016:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 757 00010000:00010000:0.0:1651529917.249046:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c55852 lrc: 2/0,0 mode: PW/PW res: [0x2c035:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249050:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b9e4c5a0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.249051:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c55852 lrc: 2/0,0 mode: PW/PW res: [0x2c035:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249054:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c55852 lrc: 3/0,0 mode: PW/PW res: [0x2c035:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.249057:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.249059:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c55852 lrc: 1/0,0 mode: --/PW res: [0x2c035:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249067:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c55852 lrc: 0/0,0 mode: --/PW res: [0x2c035:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249072:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c55859 lrc: 2/0,0 mode: PW/PW res: [0x2c037:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.249073:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.249075:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000041a7efd7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.249076:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c55859 lrc: 2/0,0 mode: PW/PW res: [0x2c037:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249078:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c55859 lrc: 3/0,0 mode: PW/PW res: [0x2c037:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249082:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c55859 lrc: 1/0,0 mode: --/PW res: [0x2c037:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249084:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c55859 lrc: 0/0,0 mode: --/PW res: [0x2c037:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249087:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55860 lrc: 2/0,0 mode: PW/PW res: [0x2c038:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249090:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b1b8f74 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.249091:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55860 lrc: 2/0,0 mode: PW/PW res: [0x2c038:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249093:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55860 lrc: 3/0,0 mode: PW/PW res: [0x2c038:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249097:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55860 lrc: 1/0,0 mode: --/PW res: [0x2c038:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249100:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c55867 lrc: 2/0,0 mode: PW/PW res: [0x2c039:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249107:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fcafd1a already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.249108:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c55867 lrc: 2/0,0 mode: PW/PW res: [0x2c039:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249111:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c55867 lrc: 3/0,0 mode: PW/PW res: [0x2c039:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249113:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55860 lrc: 0/0,0 mode: --/PW res: [0x2c038:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249116:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c55867 lrc: 1/0,0 mode: --/PW res: [0x2c039:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249119:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c55867 lrc: 0/0,0 mode: --/PW res: [0x2c039:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.249123:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946831424 00000100:00100000:1.0:1651529917.249128:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946831488 00000100:00100000:0.0:1651529917.249128:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 758 00000100:00100000:0.0:1651529917.249130:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a8bb9985 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+234:39029:x1731745946831424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529917.249134:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 759 00002000:00080000:0.0:1651529917.249135:0:166112:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180282 count 1 00000100:00100000:1.0:1651529917.249136:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000035de0fa0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+234:39030:x1731745946831488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.249140:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180283 count 1 00002000:00010000:1.0:1651529917.249145:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c03b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.249146:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c55875 lrc: 3/0,1 mode: --/PW res: [0x2c03b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249150:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.249150:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.249151:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c55875 lrc: 3/0,1 mode: PW/PW res: [0x2c03b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249155:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c55875 lrc: 3/0,1 mode: PW/PW res: [0x2c03b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.249162:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c03a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.249164:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c5586e lrc: 3/0,1 mode: --/PW res: [0x2c03a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249165:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c55875 lrc: 3/0,1 mode: PW/PW res: [0x2c03b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249168:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c55875 lrc: 2/0,0 mode: PW/PW res: [0x2c03b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249168:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.249169:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.249170:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c5586e lrc: 3/0,1 mode: PW/PW res: [0x2c03a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249173:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c5586e lrc: 3/0,1 mode: PW/PW res: [0x2c03a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249182:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c5586e lrc: 3/0,1 mode: PW/PW res: [0x2c03a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249185:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c5586e lrc: 2/0,0 mode: PW/PW res: [0x2c03a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.249212:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000035de0fa0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+236:39030:x1731745946831488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 75us (139us total) trans 21474837209 rc 0/0 00000100:00100000:1.0:1651529917.249215:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 759 00000100:00100000:0.0:1651529917.249243:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a8bb9985 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+235:39029:x1731745946831424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 91us (166us total) trans 21474837210 rc 0/0 00000100:00100000:0.0:1651529917.249246:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 758 00010000:00010000:0.0:1651529917.249253:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c55875 lrc: 2/0,0 mode: PW/PW res: [0x2c03b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249257:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008393c644 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.249258:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c55875 lrc: 2/0,0 mode: PW/PW res: [0x2c03b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249261:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c55875 lrc: 3/0,0 mode: PW/PW res: [0x2c03b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249265:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c55875 lrc: 1/0,0 mode: --/PW res: [0x2c03b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.249267:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.249268:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c55875 lrc: 0/0,0 mode: --/PW res: [0x2c03b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249291:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c5586e lrc: 2/0,0 mode: PW/PW res: [0x2c03a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249294:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005532ef34 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.249295:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c5586e lrc: 2/0,0 mode: PW/PW res: [0x2c03a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249298:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c5586e lrc: 3/0,0 mode: PW/PW res: [0x2c03a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249301:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c5586e lrc: 1/0,0 mode: --/PW res: [0x2c03a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249304:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c5586e lrc: 0/0,0 mode: --/PW res: [0x2c03a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.249312:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946831872 00000100:00100000:1.0:1651529917.249318:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.249323:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 760 00000100:00100000:0.0:1651529917.249324:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003ffbc5dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+235:39030:x1731745946831872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.249329:0:166112:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180284 count 1 00000100:00100000:1.0:1651529917.249330:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00010000:0.0:1651529917.249334:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c03c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529917.249335:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.249336:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c5587c lrc: 3/0,1 mode: --/PW res: [0x2c03c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.249339:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.249339:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.249340:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.249341:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c5587c lrc: 3/0,1 mode: PW/PW res: [0x2c03c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.249344:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.249344:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c5587c lrc: 3/0,1 mode: PW/PW res: [0x2c03c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249347:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c5587c lrc: 3/0,1 mode: PW/PW res: [0x2c03c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.249350:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946832000 00010000:00010000:0.0:1651529917.249350:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c5587c lrc: 2/0,0 mode: PW/PW res: [0x2c03c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.249361:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946831936 00000100:00100000:1.0:1651529917.249364:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946832128 00000100:00100000:1.0:1651529917.249366:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946832064 00000100:00100000:1.0:1651529917.249368:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946832192 00000100:00100000:1.0:1651529917.249371:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 761 00000100:00100000:1.0:1651529917.249372:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000567318ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+241:39030:x1731745946832000:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.249378:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180286 count 1 00002000:00010000:1.0:1651529917.249383:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c03e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.249385:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c55883 lrc: 3/0,1 mode: --/PW res: [0x2c03e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.249393:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003ffbc5dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+241:39030:x1731745946831872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 68us (133us total) trans 21474837211 rc 0/0 00000100:00100000:0.0:1651529917.249396:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 760 00010000:00010000:1.0:1651529917.249397:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.249397:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.249398:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c55883 lrc: 3/0,1 mode: PW/PW res: [0x2c03e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.249401:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 762 00010000:00010000:1.0:1651529917.249402:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c55883 lrc: 3/0,1 mode: PW/PW res: [0x2c03e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.249404:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004c5dc988 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+240:39029:x1731745946831936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529917.249405:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c55883 lrc: 3/0,1 mode: PW/PW res: [0x2c03e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249408:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c55883 lrc: 2/0,0 mode: PW/PW res: [0x2c03e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.249408:0:166112:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180285 count 1 00002000:00010000:0.0:1651529917.249413:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c03d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.249421:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c5588a lrc: 3/0,1 mode: --/PW res: [0x2c03d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249425:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.249426:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.249427:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c5588a lrc: 3/0,1 mode: PW/PW res: [0x2c03d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249430:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c5588a lrc: 3/0,1 mode: PW/PW res: [0x2c03d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249433:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c5588a lrc: 3/0,1 mode: PW/PW res: [0x2c03d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249436:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c5588a lrc: 2/0,0 mode: PW/PW res: [0x2c03d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.249448:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000567318ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+241:39030:x1731745946832000:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 75us (135us total) trans 21474837212 rc 0/0 00000100:00100000:1.0:1651529917.249451:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 761 00000100:00100000:1.0:1651529917.249456:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 763 00000100:00100000:1.0:1651529917.249458:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+240:39030:x1731745946832128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.249469:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180288 count 1 00002000:00010000:1.0:1651529917.249474:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c040:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.249476:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c55891 lrc: 3/0,1 mode: --/PW res: [0x2c040:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249479:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.249480:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.249481:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c55891 lrc: 3/0,1 mode: PW/PW res: [0x2c040:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249485:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c55891 lrc: 3/0,1 mode: PW/PW res: [0x2c040:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249488:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c55891 lrc: 3/0,1 mode: PW/PW res: [0x2c040:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249490:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c55891 lrc: 2/0,0 mode: PW/PW res: [0x2c040:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.249509:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004c5dc988 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+242:39029:x1731745946831936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 104us (178us total) trans 21474837213 rc 0/0 00000100:00100000:0.0:1651529917.249512:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 762 00000100:00100000:0.0:1651529917.249517:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 764 00000100:00100000:0.0:1651529917.249518:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+241:39029:x1731745946832064:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529917.249523:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+241:39030:x1731745946832128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 64us (188us total) trans 21474837214 rc 0/0 00002000:00080000:0.0:1651529917.249523:0:166112:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180287 count 1 00000100:00100000:1.0:1651529917.249526:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 763 00002000:00010000:0.0:1651529917.249527:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c03f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.249529:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c55898 lrc: 3/0,1 mode: --/PW res: [0x2c03f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.249531:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 765 00000100:00100000:1.0:1651529917.249532:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+240:39029:x1731745946832192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529917.249533:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.249533:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.249534:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c55898 lrc: 3/0,1 mode: PW/PW res: [0x2c03f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.249536:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180289 count 1 00010000:00010000:0.0:1651529917.249538:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c55898 lrc: 3/0,1 mode: PW/PW res: [0x2c03f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.249540:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c041:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.249541:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c55898 lrc: 3/0,1 mode: PW/PW res: [0x2c03f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249542:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c5589f lrc: 3/0,1 mode: --/PW res: [0x2c041:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249543:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c55898 lrc: 2/0,0 mode: PW/PW res: [0x2c03f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249545:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.249546:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.249546:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c5589f lrc: 3/0,1 mode: PW/PW res: [0x2c041:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249550:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c5589f lrc: 3/0,1 mode: PW/PW res: [0x2c041:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249555:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c5589f lrc: 3/0,1 mode: PW/PW res: [0x2c041:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249558:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c5589f lrc: 2/0,0 mode: PW/PW res: [0x2c041:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.249574:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+242:39029:x1731745946832064:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 55us (235us total) trans 21474837215 rc 0/0 00000100:00100000:0.0:1651529917.249577:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 764 00010000:00010000:0.0:1651529917.249584:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c5587c lrc: 2/0,0 mode: PW/PW res: [0x2c03c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.249588:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+241:39029:x1731745946832192:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 55us (244us total) trans 21474837216 rc 0/0 00010000:00010000:0.0:1651529917.249588:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054295afd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.249589:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c5587c lrc: 2/0,0 mode: PW/PW res: [0x2c03c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.249591:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 765 00010000:00010000:0.0:1651529917.249591:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c5587c lrc: 3/0,0 mode: PW/PW res: [0x2c03c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249598:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c55883 lrc: 2/0,0 mode: PW/PW res: [0x2c03e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249598:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c5587c lrc: 1/0,0 mode: --/PW res: [0x2c03c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249601:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004cff9fc3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.249601:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c5587c lrc: 0/0,0 mode: --/PW res: [0x2c03c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249602:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c55883 lrc: 2/0,0 mode: PW/PW res: [0x2c03e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249605:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c55883 lrc: 3/0,0 mode: PW/PW res: [0x2c03e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249605:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c5588a lrc: 2/0,0 mode: PW/PW res: [0x2c03d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249608:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000029e40f3d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.249609:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c5588a lrc: 2/0,0 mode: PW/PW res: [0x2c03d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249610:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c55883 lrc: 1/0,0 mode: --/PW res: [0x2c03e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249612:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c5588a lrc: 3/0,0 mode: PW/PW res: [0x2c03d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249613:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c55883 lrc: 0/0,0 mode: --/PW res: [0x2c03e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249615:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c5588a lrc: 1/0,0 mode: --/PW res: [0x2c03d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249617:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c55891 lrc: 2/0,0 mode: PW/PW res: [0x2c040:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249617:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c5588a lrc: 0/0,0 mode: --/PW res: [0x2c03d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249620:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b5173ced already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.249621:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c55891 lrc: 2/0,0 mode: PW/PW res: [0x2c040:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249621:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c55898 lrc: 2/0,0 mode: PW/PW res: [0x2c03f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249623:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c55891 lrc: 3/0,0 mode: PW/PW res: [0x2c040:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249623:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000820e2b3d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.249625:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c55898 lrc: 2/0,0 mode: PW/PW res: [0x2c03f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249626:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c55891 lrc: 1/0,0 mode: --/PW res: [0x2c040:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249628:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c55898 lrc: 3/0,0 mode: PW/PW res: [0x2c03f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249629:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c55891 lrc: 0/0,0 mode: --/PW res: [0x2c040:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249631:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c55898 lrc: 1/0,0 mode: --/PW res: [0x2c03f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249632:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c5589f lrc: 2/0,0 mode: PW/PW res: [0x2c041:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249633:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c55898 lrc: 0/0,0 mode: --/PW res: [0x2c03f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249635:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eca832be already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.249636:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c5589f lrc: 2/0,0 mode: PW/PW res: [0x2c041:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249638:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c5589f lrc: 3/0,0 mode: PW/PW res: [0x2c041:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249641:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c5589f lrc: 1/0,0 mode: --/PW res: [0x2c041:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249644:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c5589f lrc: 0/0,0 mode: --/PW res: [0x2c041:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.249657:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.249669:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946832320 00000100:00100000:0.0:1651529917.249676:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 766 00000100:00100000:0.0:1651529917.249677:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+241:39029:x1731745946832320:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.249682:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180291 count 1 00000100:00100000:1.0:1651529917.249686:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00010000:0.0:1651529917.249687:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c043:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.249688:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c558a6 lrc: 3/0,1 mode: --/PW res: [0x2c043:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249692:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.249692:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.249693:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c558a6 lrc: 3/0,1 mode: PW/PW res: [0x2c043:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249696:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c558a6 lrc: 3/0,1 mode: PW/PW res: [0x2c043:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249699:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c558a6 lrc: 3/0,1 mode: PW/PW res: [0x2c043:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249703:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c558a6 lrc: 2/0,0 mode: PW/PW res: [0x2c043:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.249755:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+242:39029:x1731745946832320:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 77us (97us total) trans 21474837217 rc 0/0 00000100:00100000:0.0:1651529917.249758:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 766 00000100:00100000:1.0:1651529917.249761:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946832256 00010000:00010000:0.0:1651529917.249766:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c558a6 lrc: 2/0,0 mode: PW/PW res: [0x2c043:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.249772:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 767 00000100:00100000:1.0:1651529917.249774:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+242:39029:x1731745946832256:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529917.249774:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032eb11d3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.249775:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c558a6 lrc: 2/0,0 mode: PW/PW res: [0x2c043:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249778:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c558a6 lrc: 3/0,0 mode: PW/PW res: [0x2c043:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.249779:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180290 count 1 00010000:00010000:0.0:1651529917.249783:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c558a6 lrc: 1/0,0 mode: --/PW res: [0x2c043:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.249784:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c042:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.249786:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c558ad lrc: 3/0,1 mode: --/PW res: [0x2c042:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249786:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c558a6 lrc: 0/0,0 mode: --/PW res: [0x2c043:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249789:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.249790:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.249791:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c558ad lrc: 3/0,1 mode: PW/PW res: [0x2c042:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249795:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c558ad lrc: 3/0,1 mode: PW/PW res: [0x2c042:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249798:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c558ad lrc: 3/0,1 mode: PW/PW res: [0x2c042:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.249801:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c558ad lrc: 2/0,0 mode: PW/PW res: [0x2c042:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249817:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c558ad lrc: 2/0,0 mode: PW/PW res: [0x2c042:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249820:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000d8e6a5e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.249822:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c558ad lrc: 2/0,0 mode: PW/PW res: [0x2c042:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249825:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c558ad lrc: 3/0,0 mode: PW/PW res: [0x2c042:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249829:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c558ad lrc: 1/0,0 mode: --/PW res: [0x2c042:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.249832:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c558ad lrc: 0/0,0 mode: --/PW res: [0x2c042:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.249840:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+243:39029:x1731745946832256:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 65us (154us total) trans 21474837218 rc 0/0 00000100:00100000:1.0:1651529917.249844:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 767 00000100:00100000:1.0:1651529917.250004:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.250021:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.250048:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946832640 00000100:00100000:1.0:1651529917.250049:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.250058:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.250060:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946832768 00000100:00100000:1.0:1651529917.250063:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.250063:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946832896 00000100:00100000:0.0:1651529917.250065:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946832576 00000100:00100000:0.0:1651529917.250067:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946832704 00000100:00100000:1.0:1651529917.250069:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.250071:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 768 00000100:00100000:0.0:1651529917.250072:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ffcc974c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+247:39030:x1731745946832640:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529917.250076:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946832832 00002000:00080000:0.0:1651529917.250077:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180293 count 1 00000100:00100000:1.0:1651529917.250082:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 769 00002000:00010000:0.0:1651529917.250082:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c045:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529917.250083:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9e74b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+248:39030:x1731745946832768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529917.250084:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c558b4 lrc: 3/0,1 mode: --/PW res: [0x2c045:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250088:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.250088:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1651529917.250089:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180295 count 1 00010000:00010000:0.0:1651529917.250089:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c558b4 lrc: 3/0,1 mode: PW/PW res: [0x2c045:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250093:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c558b4 lrc: 3/0,1 mode: PW/PW res: [0x2c045:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.250094:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c047:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.250096:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c558bb lrc: 3/0,1 mode: --/PW res: [0x2c047:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250096:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c558b4 lrc: 3/0,1 mode: PW/PW res: [0x2c045:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250099:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c558b4 lrc: 2/0,0 mode: PW/PW res: [0x2c045:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250100:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.250100:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.250101:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c558bb lrc: 3/0,1 mode: PW/PW res: [0x2c047:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250112:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c558bb lrc: 3/0,1 mode: PW/PW res: [0x2c047:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250116:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c558bb lrc: 3/0,1 mode: PW/PW res: [0x2c047:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250118:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c558bb lrc: 2/0,0 mode: PW/PW res: [0x2c047:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.250174:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ffcc974c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+250:39030:x1731745946832640:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 101us (170us total) trans 21474837219 rc 0/0 00000100:00100000:1.0:1651529917.250186:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9e74b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+250:39030:x1731745946832768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 102us (165us total) trans 21474837220 rc 0/0 00000100:00100000:0.0:1651529917.250187:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 768 00000100:00100000:1.0:1651529917.250190:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 769 00000100:00100000:0.0:1651529917.250192:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 770 00000100:00100000:0.0:1651529917.250194:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054ed0749 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+248:39030:x1731745946832896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529917.250195:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 771 00000100:00100000:1.0:1651529917.250197:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057d84ac9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+248:39030:x1731745946832576:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.250199:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180297 count 1 00002000:00080000:1.0:1651529917.250202:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180292 count 1 00002000:00010000:0.0:1651529917.250204:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c049:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.250205:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c558c2 lrc: 3/0,1 mode: --/PW res: [0x2c049:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.250207:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c044:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.250208:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c558c9 lrc: 3/0,1 mode: --/PW res: [0x2c044:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250209:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.250210:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.250210:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c558c2 lrc: 3/0,1 mode: PW/PW res: [0x2c049:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250212:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.250213:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.250214:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c558c9 lrc: 3/0,1 mode: PW/PW res: [0x2c044:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250214:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c558c2 lrc: 3/0,1 mode: PW/PW res: [0x2c049:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250217:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c558c9 lrc: 3/0,1 mode: PW/PW res: [0x2c044:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250217:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c558c2 lrc: 3/0,1 mode: PW/PW res: [0x2c049:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250220:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c558c9 lrc: 3/0,1 mode: PW/PW res: [0x2c044:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250235:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c558c2 lrc: 2/0,0 mode: PW/PW res: [0x2c049:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250240:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c558c9 lrc: 2/0,0 mode: PW/PW res: [0x2c044:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.250277:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057d84ac9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+250:39030:x1731745946832576:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 79us (219us total) trans 21474837221 rc 0/0 00000100:00100000:1.0:1651529917.250282:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 771 00000100:00100000:0.0:1651529917.250284:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054ed0749 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+250:39030:x1731745946832896:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 89us (234us total) trans 21474837222 rc 0/0 00000100:00100000:1.0:1651529917.250287:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 772 00000100:00100000:1.0:1651529917.250288:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+249:39030:x1731745946832704:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529917.250288:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 770 00002000:00080000:1.0:1651529917.250293:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180294 count 1 00000100:00100000:0.0:1651529917.250294:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 773 00000100:00100000:0.0:1651529917.250296:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+248:39030:x1731745946832832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00010000:1.0:1651529917.250297:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c046:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.250299:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c558d0 lrc: 3/0,1 mode: --/PW res: [0x2c046:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.250300:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180296 count 1 00010000:00010000:1.0:1651529917.250302:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.250303:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.250303:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c558d0 lrc: 3/0,1 mode: PW/PW res: [0x2c046:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.250305:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c048:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.250306:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c558d7 lrc: 3/0,1 mode: --/PW res: [0x2c048:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250307:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c558d0 lrc: 3/0,1 mode: PW/PW res: [0x2c046:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250310:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c558d0 lrc: 3/0,1 mode: PW/PW res: [0x2c046:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250310:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.250310:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.250311:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c558d7 lrc: 3/0,1 mode: PW/PW res: [0x2c048:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250312:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c558d0 lrc: 2/0,0 mode: PW/PW res: [0x2c046:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250315:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c558d7 lrc: 3/0,1 mode: PW/PW res: [0x2c048:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250318:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c558d7 lrc: 3/0,1 mode: PW/PW res: [0x2c048:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250320:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c558d7 lrc: 2/0,0 mode: PW/PW res: [0x2c048:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.250343:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+250:39030:x1731745946832704:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 54us (280us total) trans 21474837223 rc 0/0 00000100:00100000:1.0:1651529917.250346:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 772 00010000:00010000:1.0:1651529917.250353:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c558b4 lrc: 2/0,0 mode: PW/PW res: [0x2c045:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.250354:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+249:39030:x1731745946832832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 57us (284us total) trans 21474837224 rc 0/0 00000100:00100000:0.0:1651529917.250357:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 773 00010000:00010000:1.0:1651529917.250359:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f149aa4b already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.250360:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c558b4 lrc: 2/0,0 mode: PW/PW res: [0x2c045:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250363:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c558b4 lrc: 3/0,0 mode: PW/PW res: [0x2c045:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250367:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c558b4 lrc: 1/0,0 mode: --/PW res: [0x2c045:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250367:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c558bb lrc: 2/0,0 mode: PW/PW res: [0x2c047:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250370:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c558b4 lrc: 0/0,0 mode: --/PW res: [0x2c045:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250370:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008119f3a8 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.250371:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c558bb lrc: 2/0,0 mode: PW/PW res: [0x2c047:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250374:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c558c9 lrc: 2/0,0 mode: PW/PW res: [0x2c044:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250374:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c558bb lrc: 3/0,0 mode: PW/PW res: [0x2c047:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250377:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004926c34d already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.250378:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c558c9 lrc: 2/0,0 mode: PW/PW res: [0x2c044:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250379:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c558bb lrc: 1/0,0 mode: --/PW res: [0x2c047:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250380:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c558c9 lrc: 3/0,0 mode: PW/PW res: [0x2c044:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250381:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c558bb lrc: 0/0,0 mode: --/PW res: [0x2c047:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250383:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c558c9 lrc: 1/0,0 mode: --/PW res: [0x2c044:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250386:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004926c34d/0x3234de053c558c9 lrc: 0/0,0 mode: --/PW res: [0x2c044:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250386:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c558c2 lrc: 2/0,0 mode: PW/PW res: [0x2c049:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250388:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f10dea8 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.250389:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c558c2 lrc: 2/0,0 mode: PW/PW res: [0x2c049:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250390:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c558d0 lrc: 2/0,0 mode: PW/PW res: [0x2c046:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250393:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cb70d261 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.250393:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c558d0 lrc: 2/0,0 mode: PW/PW res: [0x2c046:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250394:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c558c2 lrc: 3/0,0 mode: PW/PW res: [0x2c049:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250396:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c558d0 lrc: 3/0,0 mode: PW/PW res: [0x2c046:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250398:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c558c2 lrc: 1/0,0 mode: --/PW res: [0x2c049:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250399:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c558d0 lrc: 1/0,0 mode: --/PW res: [0x2c046:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250400:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c558c2 lrc: 0/0,0 mode: --/PW res: [0x2c049:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250402:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c558d0 lrc: 0/0,0 mode: --/PW res: [0x2c046:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250404:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c558d7 lrc: 2/0,0 mode: PW/PW res: [0x2c048:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250406:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000087f212ed already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.250407:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c558d7 lrc: 2/0,0 mode: PW/PW res: [0x2c048:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250410:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c558d7 lrc: 3/0,0 mode: PW/PW res: [0x2c048:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250413:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c558d7 lrc: 1/0,0 mode: --/PW res: [0x2c048:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.250415:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.250416:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c558d7 lrc: 0/0,0 mode: --/PW res: [0x2c048:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.250430:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946833280 00000100:00100000:1.0:1651529917.250432:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.250436:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946833344 00000100:00100000:0.0:1651529917.250439:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 774 00000100:00100000:0.0:1651529917.250441:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+250:39030:x1731745946833280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.250445:0:166112:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180298 count 1 00002000:00010000:0.0:1651529917.250450:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c04a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.250451:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c558de lrc: 3/0,1 mode: --/PW res: [0x2c04a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250455:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.250455:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.250456:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c558de lrc: 3/0,1 mode: PW/PW res: [0x2c04a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250460:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c558de lrc: 3/0,1 mode: PW/PW res: [0x2c04a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250463:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c558de lrc: 3/0,1 mode: PW/PW res: [0x2c04a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250465:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c558de lrc: 2/0,0 mode: PW/PW res: [0x2c04a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.250504:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+251:39030:x1731745946833280:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 62us (89us total) trans 21474837225 rc 0/0 00000100:00100000:0.0:1651529917.250507:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 774 00000100:00100000:0.0:1651529917.250512:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 775 00000100:00100000:0.0:1651529917.250514:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+250:39030:x1731745946833344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.250518:0:166112:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180299 count 1 00002000:00010000:0.0:1651529917.250522:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c04b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.250524:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c558e5 lrc: 3/0,1 mode: --/PW res: [0x2c04b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250533:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c558de lrc: 2/0,0 mode: PW/PW res: [0x2c04a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250537:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001644aaad already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.250538:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c558de lrc: 2/0,0 mode: PW/PW res: [0x2c04a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250540:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c558de lrc: 3/0,0 mode: PW/PW res: [0x2c04a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250544:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.250545:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.250546:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c558de lrc: 1/0,0 mode: --/PW res: [0x2c04a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250546:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c558e5 lrc: 3/0,1 mode: PW/PW res: [0x2c04b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250549:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c558de lrc: 0/0,0 mode: --/PW res: [0x2c04a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250560:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c558e5 lrc: 3/0,1 mode: PW/PW res: [0x2c04b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250563:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c558e5 lrc: 3/0,1 mode: PW/PW res: [0x2c04b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250566:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c558e5 lrc: 2/0,0 mode: PW/PW res: [0x2c04b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.250609:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+251:39030:x1731745946833344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 94us (176us total) trans 21474837226 rc 0/0 00000100:00100000:0.0:1651529917.250612:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 775 00010000:00010000:0.0:1651529917.250619:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c558e5 lrc: 2/0,0 mode: PW/PW res: [0x2c04b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250622:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005c863cd2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.250624:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c558e5 lrc: 2/0,0 mode: PW/PW res: [0x2c04b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250626:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c558e5 lrc: 3/0,0 mode: PW/PW res: [0x2c04b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250632:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c558e5 lrc: 1/0,0 mode: --/PW res: [0x2c04b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250635:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c558e5 lrc: 0/0,0 mode: --/PW res: [0x2c04b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.250785:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.250794:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.250795:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946833600 00000100:00100000:0.0:1651529917.250806:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946834048 00000100:00100000:0.0:1651529917.250813:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 776 00000100:00100000:0.0:1651529917.250815:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002db8a000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+252:39029:x1731745946833600:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529917.250816:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 777 00000100:00100000:1.0:1651529917.250818:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+252:39030:x1731745946834048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.250824:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180302 count 1 00002000:00010000:1.0:1651529917.250829:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c04e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.250831:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c558ec lrc: 3/0,1 mode: --/PW res: [0x2c04e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250834:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.250835:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.250849:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c558ec lrc: 3/0,1 mode: PW/PW res: [0x2c04e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.250853:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c558ec lrc: 3/0,1 mode: PW/PW res: [0x2c04e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.250853:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180300 count 1 00010000:00010000:1.0:1651529917.250857:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c558ec lrc: 3/0,1 mode: PW/PW res: [0x2c04e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.250858:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c04c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.250859:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c558ec lrc: 2/0,0 mode: PW/PW res: [0x2c04e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250860:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c558f3 lrc: 3/0,1 mode: --/PW res: [0x2c04c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250864:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.250864:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.250865:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c558f3 lrc: 3/0,1 mode: PW/PW res: [0x2c04c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250875:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c558f3 lrc: 3/0,1 mode: PW/PW res: [0x2c04c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250879:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c558f3 lrc: 3/0,1 mode: PW/PW res: [0x2c04c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250881:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c558f3 lrc: 2/0,0 mode: PW/PW res: [0x2c04c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.250911:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+254:39030:x1731745946834048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 91us (116us total) trans 21474837227 rc 0/0 00000100:00100000:1.0:1651529917.250914:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 777 00000100:00100000:0.0:1651529917.250934:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002db8a000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+253:39029:x1731745946833600:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 118us (149us total) trans 21474837228 rc 0/0 00000100:00100000:0.0:1651529917.250937:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 776 00010000:00010000:0.0:1651529917.250945:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c558ec lrc: 2/0,0 mode: PW/PW res: [0x2c04e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.250946:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.250949:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002082f759 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.250955:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c558ec lrc: 2/0,0 mode: PW/PW res: [0x2c04e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250959:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c558ec lrc: 3/0,0 mode: PW/PW res: [0x2c04e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.250963:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.250964:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c558ec lrc: 1/0,0 mode: --/PW res: [0x2c04e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250966:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c558ec lrc: 0/0,0 mode: --/PW res: [0x2c04e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250971:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c558f3 lrc: 2/0,0 mode: PW/PW res: [0x2c04c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250974:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ee128d1f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.250975:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c558f3 lrc: 2/0,0 mode: PW/PW res: [0x2c04c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250980:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c558f3 lrc: 3/0,0 mode: PW/PW res: [0x2c04c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250983:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c558f3 lrc: 1/0,0 mode: --/PW res: [0x2c04c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.250985:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c558f3 lrc: 0/0,0 mode: --/PW res: [0x2c04c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.250990:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.250992:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946834176 00000100:00100000:1.0:1651529917.250995:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.250997:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946834304 00000100:00100000:0.0:1651529917.250999:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946833984 00000100:00100000:1.0:1651529917.251000:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.251002:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946834112 00000100:00100000:0.0:1651529917.251004:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946834240 00000100:00100000:1.0:1651529917.251005:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.251006:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946834368 00000100:00100000:0.0:1651529917.251009:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 778 00000100:00100000:0.0:1651529917.251010:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009f35d921 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+258:39030:x1731745946834176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529917.251013:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 779 00000100:00100000:1.0:1651529917.251015:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+258:39030:x1731745946834304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.251015:0:166112:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180304 count 1 00002000:00010000:0.0:1651529917.251019:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c050:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00080000:1.0:1651529917.251020:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180306 count 1 00010000:00010000:0.0:1651529917.251020:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c558fa lrc: 3/0,1 mode: --/PW res: [0x2c050:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251024:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.251024:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00010000:1.0:1651529917.251025:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c052:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.251025:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c558fa lrc: 3/0,1 mode: PW/PW res: [0x2c050:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251027:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c55901 lrc: 3/0,1 mode: --/PW res: [0x2c052:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251029:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c558fa lrc: 3/0,1 mode: PW/PW res: [0x2c050:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251030:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.251031:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.251032:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c55901 lrc: 3/0,1 mode: PW/PW res: [0x2c052:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251032:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c558fa lrc: 3/0,1 mode: PW/PW res: [0x2c050:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251035:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c558fa lrc: 2/0,0 mode: PW/PW res: [0x2c050:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251044:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c55901 lrc: 3/0,1 mode: PW/PW res: [0x2c052:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251048:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c55901 lrc: 3/0,1 mode: PW/PW res: [0x2c052:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251053:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c55901 lrc: 2/0,0 mode: PW/PW res: [0x2c052:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.251095:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009f35d921 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+260:39030:x1731745946834176:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 83us (149us total) trans 21474837229 rc 0/0 00000100:00100000:0.0:1651529917.251098:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 778 00000100:00100000:1.0:1651529917.251102:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+259:39030:x1731745946834304:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 87us (138us total) trans 21474837230 rc 0/0 00000100:00100000:0.0:1651529917.251104:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 780 00000100:00100000:1.0:1651529917.251105:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 779 00000100:00100000:0.0:1651529917.251105:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+259:39030:x1731745946833984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.251110:0:166112:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180301 count 1 00000100:00100000:1.0:1651529917.251111:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 781 00000100:00100000:1.0:1651529917.251113:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+258:39030:x1731745946834112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00010000:0.0:1651529917.251115:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c04d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.251116:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ba8c2cb/0x3234de053c55908 lrc: 3/0,1 mode: --/PW res: [0x2c04d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.251117:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180303 count 1 00010000:00010000:0.0:1651529917.251120:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.251120:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.251121:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ba8c2cb/0x3234de053c55908 lrc: 3/0,1 mode: PW/PW res: [0x2c04d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.251122:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c04f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.251123:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c5590f lrc: 3/0,1 mode: --/PW res: [0x2c04f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251125:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ba8c2cb/0x3234de053c55908 lrc: 3/0,1 mode: PW/PW res: [0x2c04d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251127:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.251128:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.251128:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ba8c2cb/0x3234de053c55908 lrc: 3/0,1 mode: PW/PW res: [0x2c04d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251129:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c5590f lrc: 3/0,1 mode: PW/PW res: [0x2c04f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251132:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c5590f lrc: 3/0,1 mode: PW/PW res: [0x2c04f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251133:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ba8c2cb/0x3234de053c55908 lrc: 2/0,0 mode: PW/PW res: [0x2c04d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251135:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c5590f lrc: 3/0,1 mode: PW/PW res: [0x2c04f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251138:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c5590f lrc: 2/0,0 mode: PW/PW res: [0x2c04f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.251185:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+260:39030:x1731745946834112:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 72us (189us total) trans 21474837231 rc 0/0 00000100:00100000:1.0:1651529917.251188:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 781 00000100:00100000:0.0:1651529917.251191:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+259:39030:x1731745946833984:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 85us (201us total) trans 21474837232 rc 0/0 00000100:00100000:1.0:1651529917.251193:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 782 00000100:00100000:1.0:1651529917.251195:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000035f3f4bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+259:39030:x1731745946834240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529917.251195:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 780 00002000:00080000:1.0:1651529917.251199:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180305 count 1 00000100:00100000:0.0:1651529917.251200:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 783 00000100:00100000:0.0:1651529917.251202:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+258:39029:x1731745946834368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00010000:1.0:1651529917.251204:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c051:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.251205:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c55916 lrc: 3/0,1 mode: --/PW res: [0x2c051:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.251206:0:166112:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180307 count 1 00010000:00010000:1.0:1651529917.251209:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.251209:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.251210:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c55916 lrc: 3/0,1 mode: PW/PW res: [0x2c051:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.251211:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c053:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.251213:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c5591d lrc: 3/0,1 mode: --/PW res: [0x2c053:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251214:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c55916 lrc: 3/0,1 mode: PW/PW res: [0x2c051:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251217:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c55916 lrc: 3/0,1 mode: PW/PW res: [0x2c051:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251217:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.251217:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.251218:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c5591d lrc: 3/0,1 mode: PW/PW res: [0x2c053:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251219:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c55916 lrc: 2/0,0 mode: PW/PW res: [0x2c051:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251247:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c5591d lrc: 3/0,1 mode: PW/PW res: [0x2c053:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251251:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c5591d lrc: 3/0,1 mode: PW/PW res: [0x2c053:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251253:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c5591d lrc: 2/0,0 mode: PW/PW res: [0x2c053:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.251277:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000035f3f4bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+260:39030:x1731745946834240:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 81us (276us total) trans 21474837233 rc 0/0 00000100:00100000:1.0:1651529917.251281:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 782 00000100:00100000:0.0:1651529917.251292:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+259:39029:x1731745946834368:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 89us (286us total) trans 21474837234 rc 0/0 00000100:00100000:0.0:1651529917.251295:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 783 00000100:00100000:1.0:1651529917.251296:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.251301:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946834624 00000100:00100000:0.0:1651529917.251306:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 784 00000100:00100000:0.0:1651529917.251307:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017e3b33f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+259:39029:x1731745946834624:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529917.251310:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529917.251312:0:166112:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180308 count 1 00002000:00010000:0.0:1651529917.251317:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c054:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.251318:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c55924 lrc: 3/0,1 mode: --/PW res: [0x2c054:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251322:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.251322:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.251323:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c55924 lrc: 3/0,1 mode: PW/PW res: [0x2c054:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251327:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c55924 lrc: 3/0,1 mode: PW/PW res: [0x2c054:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251330:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c55924 lrc: 3/0,1 mode: PW/PW res: [0x2c054:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251332:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c55924 lrc: 2/0,0 mode: PW/PW res: [0x2c054:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251357:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c558fa lrc: 2/0,0 mode: PW/PW res: [0x2c050:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251361:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f3240ce7 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.251362:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c558fa lrc: 2/0,0 mode: PW/PW res: [0x2c050:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.251368:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017e3b33f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+260:39029:x1731745946834624:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 59us (71us total) trans 21474837235 rc 0/0 00010000:00010000:1.0:1651529917.251370:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c558fa lrc: 3/0,0 mode: PW/PW res: [0x2c050:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.251372:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 784 00010000:00010000:1.0:1651529917.251376:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c558fa lrc: 1/0,0 mode: --/PW res: [0x2c050:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.251377:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946834688 00010000:00010000:1.0:1651529917.251379:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c558fa lrc: 0/0,0 mode: --/PW res: [0x2c050:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.251381:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 785 00000100:00100000:0.0:1651529917.251382:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e30915ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+260:39029:x1731745946834688:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529917.251383:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c55901 lrc: 2/0,0 mode: PW/PW res: [0x2c052:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251386:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e270377c already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.251387:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c55901 lrc: 2/0,0 mode: PW/PW res: [0x2c052:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.251387:0:166112:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180309 count 1 00010000:00010000:1.0:1651529917.251390:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c55901 lrc: 3/0,0 mode: PW/PW res: [0x2c052:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.251392:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c055:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.251393:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c55901 lrc: 1/0,0 mode: --/PW res: [0x2c052:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251394:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c5592b lrc: 3/0,1 mode: --/PW res: [0x2c055:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251396:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c55901 lrc: 0/0,0 mode: --/PW res: [0x2c052:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251397:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.251398:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.251399:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ba8c2cb/0x3234de053c55908 lrc: 2/0,0 mode: PW/PW res: [0x2c04d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251399:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c5592b lrc: 3/0,1 mode: PW/PW res: [0x2c055:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251402:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007ba8c2cb already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.251402:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ba8c2cb/0x3234de053c55908 lrc: 2/0,0 mode: PW/PW res: [0x2c04d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251402:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c5592b lrc: 3/0,1 mode: PW/PW res: [0x2c055:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251405:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ba8c2cb/0x3234de053c55908 lrc: 3/0,0 mode: PW/PW res: [0x2c04d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251405:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c5592b lrc: 3/0,1 mode: PW/PW res: [0x2c055:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251408:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ba8c2cb/0x3234de053c55908 lrc: 1/0,0 mode: --/PW res: [0x2c04d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251411:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ba8c2cb/0x3234de053c55908 lrc: 0/0,0 mode: --/PW res: [0x2c04d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251414:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c5590f lrc: 2/0,0 mode: PW/PW res: [0x2c04f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251416:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000721302df already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.251417:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c5590f lrc: 2/0,0 mode: PW/PW res: [0x2c04f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251420:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c5590f lrc: 3/0,0 mode: PW/PW res: [0x2c04f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251423:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c5590f lrc: 1/0,0 mode: --/PW res: [0x2c04f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251424:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c5592b lrc: 2/0,0 mode: PW/PW res: [0x2c055:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251426:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c5590f lrc: 0/0,0 mode: --/PW res: [0x2c04f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251429:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c55916 lrc: 2/0,0 mode: PW/PW res: [0x2c051:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251431:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d6999e11 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.251432:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c55916 lrc: 2/0,0 mode: PW/PW res: [0x2c051:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251435:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c55916 lrc: 3/0,0 mode: PW/PW res: [0x2c051:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251438:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c55916 lrc: 1/0,0 mode: --/PW res: [0x2c051:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251440:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c55916 lrc: 0/0,0 mode: --/PW res: [0x2c051:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251443:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c5591d lrc: 2/0,0 mode: PW/PW res: [0x2c053:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251446:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c660975a already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.251447:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c5591d lrc: 2/0,0 mode: PW/PW res: [0x2c053:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251450:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c5591d lrc: 3/0,0 mode: PW/PW res: [0x2c053:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251453:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c5591d lrc: 1/0,0 mode: --/PW res: [0x2c053:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251455:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c5591d lrc: 0/0,0 mode: --/PW res: [0x2c053:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.251458:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e30915ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+261:39029:x1731745946834688:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 75us (148us total) trans 21474837236 rc 0/0 00010000:00010000:1.0:1651529917.251459:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c55924 lrc: 2/0,0 mode: PW/PW res: [0x2c054:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251461:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000215144f2 already unused, calling callback (0000000049fddea7) 00000100:00100000:0.0:1651529917.251461:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 785 00010000:00010000:1.0:1651529917.251462:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c55924 lrc: 2/0,0 mode: PW/PW res: [0x2c054:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251464:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c55924 lrc: 3/0,0 mode: PW/PW res: [0x2c054:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251467:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c55924 lrc: 1/0,0 mode: --/PW res: [0x2c054:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251468:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c5592b lrc: 2/0,0 mode: PW/PW res: [0x2c055:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251470:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c55924 lrc: 0/0,0 mode: --/PW res: [0x2c054:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251472:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a032e9d0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.251473:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c5592b lrc: 2/0,0 mode: PW/PW res: [0x2c055:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251476:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c5592b lrc: 3/0,0 mode: PW/PW res: [0x2c055:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251480:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c5592b lrc: 1/0,0 mode: --/PW res: [0x2c055:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251483:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c5592b lrc: 0/0,0 mode: --/PW res: [0x2c055:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.251679:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.251688:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.251697:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.251698:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946835072 00000100:00100000:1.0:1651529917.251706:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.251714:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.251720:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946835328 00000100:00100000:1.0:1651529917.251725:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946835136 00000100:00100000:0.0:1651529917.251729:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946835200 00000100:00100000:0.0:1651529917.251733:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946835264 00000100:00100000:1.0:1651529917.251735:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 786 00000100:00100000:1.0:1651529917.251737:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000b25168e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+265:39030:x1731745946835072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.251742:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180310 count 1 00000100:00100000:0.0:1651529917.251746:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 787 00002000:00010000:1.0:1651529917.251747:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c056:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1651529917.251748:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+265:39030:x1731745946835328:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529917.251749:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55932 lrc: 3/0,1 mode: --/PW res: [0x2c056:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251753:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.251753:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.251754:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55932 lrc: 3/0,1 mode: PW/PW res: [0x2c056:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.251754:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180314 count 1 00010000:00010000:1.0:1651529917.251758:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55932 lrc: 3/0,1 mode: PW/PW res: [0x2c056:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251761:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55932 lrc: 3/0,1 mode: PW/PW res: [0x2c056:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251763:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55932 lrc: 2/0,0 mode: PW/PW res: [0x2c056:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.251769:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c05a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.251771:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c55939 lrc: 3/0,1 mode: --/PW res: [0x2c05a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251775:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.251775:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.251776:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c55939 lrc: 3/0,1 mode: PW/PW res: [0x2c05a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251782:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c55939 lrc: 3/0,1 mode: PW/PW res: [0x2c05a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251785:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c55939 lrc: 3/0,1 mode: PW/PW res: [0x2c05a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251788:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c55939 lrc: 2/0,0 mode: PW/PW res: [0x2c05a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.251805:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000b25168e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+267:39030:x1731745946835072:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 67us (126us total) trans 21474837237 rc 0/0 00000100:00100000:1.0:1651529917.251808:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 786 00000100:00100000:1.0:1651529917.251824:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 788 00000100:00100000:1.0:1651529917.251826:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+266:39030:x1731745946835200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529917.251826:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+266:39030:x1731745946835328:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 77us (128us total) trans 21474837238 rc 0/0 00000100:00100000:0.0:1651529917.251829:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 787 00002000:00080000:1.0:1651529917.251831:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180312 count 1 00002000:00010000:1.0:1651529917.251835:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c058:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1651529917.251835:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 789 00000100:00100000:0.0:1651529917.251836:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078c6e720 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+265:39029:x1731745946835136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529917.251837:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c55940 lrc: 3/0,1 mode: --/PW res: [0x2c058:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251840:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.251841:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:0.0:1651529917.251841:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180311 count 1 00010000:00010000:1.0:1651529917.251842:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c55940 lrc: 3/0,1 mode: PW/PW res: [0x2c058:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.251845:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c057:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.251846:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c55940 lrc: 3/0,1 mode: PW/PW res: [0x2c058:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251847:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c55947 lrc: 3/0,1 mode: --/PW res: [0x2c057:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251849:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c55940 lrc: 3/0,1 mode: PW/PW res: [0x2c058:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251850:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.251851:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c55940 lrc: 2/0,0 mode: PW/PW res: [0x2c058:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251851:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.251852:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c55947 lrc: 3/0,1 mode: PW/PW res: [0x2c057:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251856:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c55947 lrc: 3/0,1 mode: PW/PW res: [0x2c057:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251869:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c55947 lrc: 3/0,1 mode: PW/PW res: [0x2c057:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251872:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c55947 lrc: 2/0,0 mode: PW/PW res: [0x2c057:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.251892:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+267:39030:x1731745946835200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 65us (204us total) trans 21474837239 rc 0/0 00000100:00100000:1.0:1651529917.251896:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 788 00000100:00100000:1.0:1651529917.251901:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 790 00000100:00100000:1.0:1651529917.251903:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b3d379fe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+266:39029:x1731745946835264:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529917.251906:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078c6e720 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+266:39029:x1731745946835136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 68us (200us total) trans 21474837240 rc 0/0 00002000:00080000:1.0:1651529917.251907:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180313 count 1 00000100:00100000:0.0:1651529917.251909:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 789 00002000:00010000:1.0:1651529917.251912:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c059:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.251913:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c5594e lrc: 3/0,1 mode: --/PW res: [0x2c059:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251916:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55932 lrc: 2/0,0 mode: PW/PW res: [0x2c056:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251917:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.251917:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.251918:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c5594e lrc: 3/0,1 mode: PW/PW res: [0x2c059:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251919:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000092ad010c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.251920:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55932 lrc: 2/0,0 mode: PW/PW res: [0x2c056:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251922:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c5594e lrc: 3/0,1 mode: PW/PW res: [0x2c059:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251923:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55932 lrc: 3/0,0 mode: PW/PW res: [0x2c056:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251925:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c5594e lrc: 3/0,1 mode: PW/PW res: [0x2c059:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.251927:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c5594e lrc: 2/0,0 mode: PW/PW res: [0x2c059:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251928:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55932 lrc: 1/0,0 mode: --/PW res: [0x2c056:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251931:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55932 lrc: 0/0,0 mode: --/PW res: [0x2c056:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251935:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c55939 lrc: 2/0,0 mode: PW/PW res: [0x2c05a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251938:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d37a9fd1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.251939:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c55939 lrc: 2/0,0 mode: PW/PW res: [0x2c05a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251942:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c55939 lrc: 3/0,0 mode: PW/PW res: [0x2c05a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251945:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c55939 lrc: 1/0,0 mode: --/PW res: [0x2c05a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251947:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c55939 lrc: 0/0,0 mode: --/PW res: [0x2c05a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251951:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c55940 lrc: 2/0,0 mode: PW/PW res: [0x2c058:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251953:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d09e97cf already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.251954:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c55940 lrc: 2/0,0 mode: PW/PW res: [0x2c058:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251957:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c55940 lrc: 3/0,0 mode: PW/PW res: [0x2c058:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.251958:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b3d379fe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+266:39029:x1731745946835264:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 54us (243us total) trans 21474837241 rc 0/0 00000100:00100000:1.0:1651529917.251960:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 790 00010000:00010000:0.0:1651529917.251960:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c55940 lrc: 1/0,0 mode: --/PW res: [0x2c058:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251963:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c55940 lrc: 0/0,0 mode: --/PW res: [0x2c058:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251966:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c55947 lrc: 2/0,0 mode: PW/PW res: [0x2c057:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251969:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001d04fb0a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.251970:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c55947 lrc: 2/0,0 mode: PW/PW res: [0x2c057:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251972:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c55947 lrc: 3/0,0 mode: PW/PW res: [0x2c057:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251975:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c55947 lrc: 1/0,0 mode: --/PW res: [0x2c057:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251978:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c55947 lrc: 0/0,0 mode: --/PW res: [0x2c057:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251981:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c5594e lrc: 2/0,0 mode: PW/PW res: [0x2c059:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251984:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b232c9bb already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.251984:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c5594e lrc: 2/0,0 mode: PW/PW res: [0x2c059:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251987:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c5594e lrc: 3/0,0 mode: PW/PW res: [0x2c059:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251990:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c5594e lrc: 1/0,0 mode: --/PW res: [0x2c059:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.251993:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c5594e lrc: 0/0,0 mode: --/PW res: [0x2c059:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.251994:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.252000:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946835584 00000100:00100000:0.0:1651529917.252006:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 791 00000100:00100000:0.0:1651529917.252008:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ab440250 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+266:39030:x1731745946835584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529917.252009:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529917.252012:0:166112:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180316 count 1 00002000:00010000:0.0:1651529917.252017:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c05c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1651529917.252018:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.252018:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c55955 lrc: 3/0,1 mode: --/PW res: [0x2c05c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252022:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.252022:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.252023:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c55955 lrc: 3/0,1 mode: PW/PW res: [0x2c05c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252027:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c55955 lrc: 3/0,1 mode: PW/PW res: [0x2c05c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252030:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c55955 lrc: 3/0,1 mode: PW/PW res: [0x2c05c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252032:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c55955 lrc: 2/0,0 mode: PW/PW res: [0x2c05c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252079:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c55955 lrc: 2/0,0 mode: PW/PW res: [0x2c05c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.252085:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ab440250 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+267:39030:x1731745946835584:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 76us (90us total) trans 21474837242 rc 0/0 00000100:00100000:0.0:1651529917.252090:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 791 00010000:00010000:1.0:1651529917.252093:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d1167ce5 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.252094:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c55955 lrc: 2/0,0 mode: PW/PW res: [0x2c05c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.252095:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946835520 00010000:00010000:1.0:1651529917.252098:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c55955 lrc: 3/0,0 mode: PW/PW res: [0x2c05c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.252099:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946835648 00000100:00100000:0.0:1651529917.252102:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 792 00010000:00010000:1.0:1651529917.252103:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c55955 lrc: 1/0,0 mode: --/PW res: [0x2c05c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.252103:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+268:39029:x1731745946835520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529917.252106:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c55955 lrc: 0/0,0 mode: --/PW res: [0x2c05c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.252108:0:166112:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180315 count 1 00002000:00010000:0.0:1651529917.252112:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c05b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.252114:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c5595c lrc: 3/0,1 mode: --/PW res: [0x2c05b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252117:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.252118:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.252119:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c5595c lrc: 3/0,1 mode: PW/PW res: [0x2c05b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252122:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c5595c lrc: 3/0,1 mode: PW/PW res: [0x2c05b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252125:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c5595c lrc: 3/0,1 mode: PW/PW res: [0x2c05b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252128:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c5595c lrc: 2/0,0 mode: PW/PW res: [0x2c05b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.252139:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 793 00000100:00100000:1.0:1651529917.252141:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+268:39029:x1731745946835648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.252148:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180317 count 1 00002000:00010000:1.0:1651529917.252152:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c05d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.252154:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c55963 lrc: 3/0,1 mode: --/PW res: [0x2c05d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252157:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.252158:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.252159:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c55963 lrc: 3/0,1 mode: PW/PW res: [0x2c05d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.252168:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+269:39029:x1731745946835520:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 63us (158us total) trans 21474837243 rc 0/0 00010000:00010000:1.0:1651529917.252171:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c55963 lrc: 3/0,1 mode: PW/PW res: [0x2c05d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252175:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c55963 lrc: 3/0,1 mode: PW/PW res: [0x2c05d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252177:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c55963 lrc: 2/0,0 mode: PW/PW res: [0x2c05d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.252186:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 792 00010000:00010000:0.0:1651529917.252194:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c5595c lrc: 2/0,0 mode: PW/PW res: [0x2c05b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252198:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e4f40ecf already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.252199:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c5595c lrc: 2/0,0 mode: PW/PW res: [0x2c05b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252202:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c5595c lrc: 3/0,0 mode: PW/PW res: [0x2c05b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252206:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c5595c lrc: 1/0,0 mode: --/PW res: [0x2c05b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252209:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c5595c lrc: 0/0,0 mode: --/PW res: [0x2c05b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.252214:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+269:39029:x1731745946835648:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 72us (196us total) trans 21474837244 rc 0/0 00010000:00010000:0.0:1651529917.252214:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c55963 lrc: 2/0,0 mode: PW/PW res: [0x2c05d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252216:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a9b4b5b4 already unused, calling callback (0000000049fddea7) 00000100:00100000:1.0:1651529917.252217:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 793 00010000:00010000:0.0:1651529917.252217:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c55963 lrc: 2/0,0 mode: PW/PW res: [0x2c05d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252220:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c55963 lrc: 3/0,0 mode: PW/PW res: [0x2c05d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252235:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c55963 lrc: 1/0,0 mode: --/PW res: [0x2c05d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252245:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c55963 lrc: 0/0,0 mode: --/PW res: [0x2c05d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.252454:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.252464:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.252464:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946836160 00000100:00100000:1.0:1651529917.252473:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.252485:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946836096 00000100:00100000:1.0:1651529917.252489:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946836224 00000100:00100000:1.0:1651529917.252495:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 794 00000100:00100000:1.0:1651529917.252497:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+271:39029:x1731745946836160:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529917.252503:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 795 00000100:00100000:0.0:1651529917.252505:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+271:39030:x1731745946836096:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.252508:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180319 count 1 00002000:00010000:1.0:1651529917.252513:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c05f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.252514:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c5596a lrc: 3/0,1 mode: --/PW res: [0x2c05f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252518:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.252519:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00002000:00080000:0.0:1651529917.252519:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180318 count 1 00010000:00010000:1.0:1651529917.252520:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c5596a lrc: 3/0,1 mode: PW/PW res: [0x2c05f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252524:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c5596a lrc: 3/0,1 mode: PW/PW res: [0x2c05f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.252524:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c05e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.252526:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c55971 lrc: 3/0,1 mode: --/PW res: [0x2c05e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252527:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c5596a lrc: 3/0,1 mode: PW/PW res: [0x2c05f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252529:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c5596a lrc: 2/0,0 mode: PW/PW res: [0x2c05f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252544:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.252545:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.252546:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c55971 lrc: 3/0,1 mode: PW/PW res: [0x2c05e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252550:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c55971 lrc: 3/0,1 mode: PW/PW res: [0x2c05e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252553:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c55971 lrc: 3/0,1 mode: PW/PW res: [0x2c05e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252565:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c55971 lrc: 2/0,0 mode: PW/PW res: [0x2c05e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.252572:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+272:39029:x1731745946836160:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 74us (118us total) trans 21474837245 rc 0/0 00000100:00100000:1.0:1651529917.252575:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 794 00000100:00100000:1.0:1651529917.252580:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 796 00000100:00100000:1.0:1651529917.252582:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+272:39030:x1731745946836224:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.252586:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180320 count 1 00002000:00010000:1.0:1651529917.252591:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c060:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.252592:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c55978 lrc: 3/0,1 mode: --/PW res: [0x2c060:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252596:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.252596:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.252597:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c55978 lrc: 3/0,1 mode: PW/PW res: [0x2c060:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252601:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c55978 lrc: 3/0,1 mode: PW/PW res: [0x2c060:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252606:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c55978 lrc: 3/0,1 mode: PW/PW res: [0x2c060:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252609:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c55978 lrc: 2/0,0 mode: PW/PW res: [0x2c060:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.252615:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+272:39030:x1731745946836096:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 110us (150us total) trans 21474837246 rc 0/0 00000100:00100000:0.0:1651529917.252619:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 795 00010000:00010000:0.0:1651529917.252627:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c5596a lrc: 2/0,0 mode: PW/PW res: [0x2c05f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252630:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f1a88dd0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.252631:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c5596a lrc: 2/0,0 mode: PW/PW res: [0x2c05f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252634:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c5596a lrc: 3/0,0 mode: PW/PW res: [0x2c05f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252639:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c5596a lrc: 1/0,0 mode: --/PW res: [0x2c05f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.252642:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+272:39030:x1731745946836224:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 60us (169us total) trans 21474837247 rc 0/0 00010000:00010000:0.0:1651529917.252642:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c5596a lrc: 0/0,0 mode: --/PW res: [0x2c05f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.252645:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 796 00010000:00010000:0.0:1651529917.252646:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c55971 lrc: 2/0,0 mode: PW/PW res: [0x2c05e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252649:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ac14729e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.252650:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c55971 lrc: 2/0,0 mode: PW/PW res: [0x2c05e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252652:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c55971 lrc: 3/0,0 mode: PW/PW res: [0x2c05e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252658:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c55971 lrc: 1/0,0 mode: --/PW res: [0x2c05e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252661:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c55971 lrc: 0/0,0 mode: --/PW res: [0x2c05e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252664:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c55978 lrc: 2/0,0 mode: PW/PW res: [0x2c060:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252667:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027775c45 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.252667:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c55978 lrc: 2/0,0 mode: PW/PW res: [0x2c060:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252670:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c55978 lrc: 3/0,0 mode: PW/PW res: [0x2c060:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252673:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c55978 lrc: 1/0,0 mode: --/PW res: [0x2c060:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252676:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c55978 lrc: 0/0,0 mode: --/PW res: [0x2c060:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.252679:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.252684:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946836352 00000100:00100000:0.0:1651529917.252690:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 797 00000100:00100000:0.0:1651529917.252691:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+272:39030:x1731745946836352:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529917.252692:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00080000:0.0:1651529917.252696:0:166112:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180321 count 1 00000100:00100000:1.0:1651529917.252700:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00010000:0.0:1651529917.252701:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c061:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.252702:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c5597f lrc: 3/0,1 mode: --/PW res: [0x2c061:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252705:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.252706:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.252707:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c5597f lrc: 3/0,1 mode: PW/PW res: [0x2c061:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252710:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c5597f lrc: 3/0,1 mode: PW/PW res: [0x2c061:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252713:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c5597f lrc: 3/0,1 mode: PW/PW res: [0x2c061:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252716:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c5597f lrc: 2/0,0 mode: PW/PW res: [0x2c061:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.252725:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.252731:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529917.252737:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c5597f lrc: 2/0,0 mode: PW/PW res: [0x2c061:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252740:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009fff0bd3 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.252742:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c5597f lrc: 2/0,0 mode: PW/PW res: [0x2c061:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252745:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c5597f lrc: 3/0,0 mode: PW/PW res: [0x2c061:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252750:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c5597f lrc: 1/0,0 mode: --/PW res: [0x2c061:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.252758:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+273:39030:x1731745946836352:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 66us (79us total) trans 21474837248 rc 0/0 00010000:00010000:1.0:1651529917.252761:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c5597f lrc: 0/0,0 mode: --/PW res: [0x2c061:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.252761:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 797 00000100:00100000:0.0:1651529917.252777:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946836480 00000100:00100000:0.0:1651529917.252781:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946836416 00000100:00100000:0.0:1651529917.252784:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946836608 00000100:00100000:0.0:1651529917.252786:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946836544 00000100:00100000:0.0:1651529917.252789:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 798 00000100:00100000:0.0:1651529917.252790:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+276:39030:x1731745946836480:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.252795:0:166112:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180323 count 1 00000100:00100000:1.0:1651529917.252797:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 799 00000100:00100000:1.0:1651529917.252799:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+276:39029:x1731745946836416:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00010000:0.0:1651529917.252800:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c063:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.252801:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c55986 lrc: 3/0,1 mode: --/PW res: [0x2c063:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.252805:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180322 count 1 00010000:00010000:0.0:1651529917.252805:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.252805:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.252806:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c55986 lrc: 3/0,1 mode: PW/PW res: [0x2c063:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.252809:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c062:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.252810:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c55986 lrc: 3/0,1 mode: PW/PW res: [0x2c063:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252811:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c5598d lrc: 3/0,1 mode: --/PW res: [0x2c062:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252813:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c55986 lrc: 3/0,1 mode: PW/PW res: [0x2c063:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252815:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.252815:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.252816:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c5598d lrc: 3/0,1 mode: PW/PW res: [0x2c062:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252816:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c55986 lrc: 2/0,0 mode: PW/PW res: [0x2c063:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252820:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c5598d lrc: 3/0,1 mode: PW/PW res: [0x2c062:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252823:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c5598d lrc: 3/0,1 mode: PW/PW res: [0x2c062:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252826:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c5598d lrc: 2/0,0 mode: PW/PW res: [0x2c062:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.252861:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+278:39030:x1731745946836480:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 69us (168us total) trans 21474837249 rc 0/0 00000100:00100000:0.0:1651529917.252864:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 798 00000100:00100000:0.0:1651529917.252869:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 800 00000100:00100000:0.0:1651529917.252870:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+277:39030:x1731745946836608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529917.252873:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+277:39029:x1731745946836416:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 73us (173us total) trans 21474837250 rc 0/0 00002000:00080000:0.0:1651529917.252875:0:166112:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180325 count 1 00000100:00100000:1.0:1651529917.252878:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 799 00002000:00010000:0.0:1651529917.252880:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c065:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.252881:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c55994 lrc: 3/0,1 mode: --/PW res: [0x2c065:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.252883:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 801 00000100:00100000:1.0:1651529917.252885:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000035de0fa0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+276:39029:x1731745946836544:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529917.252885:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.252886:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.252887:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c55994 lrc: 3/0,1 mode: PW/PW res: [0x2c065:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.252889:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180324 count 1 00010000:00010000:0.0:1651529917.252890:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c55994 lrc: 3/0,1 mode: PW/PW res: [0x2c065:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252893:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c55994 lrc: 3/0,1 mode: PW/PW res: [0x2c065:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.252894:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c064:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.252896:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c5599b lrc: 3/0,1 mode: --/PW res: [0x2c064:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252896:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c55994 lrc: 2/0,0 mode: PW/PW res: [0x2c065:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252899:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.252900:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.252901:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c5599b lrc: 3/0,1 mode: PW/PW res: [0x2c064:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252904:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c5599b lrc: 3/0,1 mode: PW/PW res: [0x2c064:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252907:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c5599b lrc: 3/0,1 mode: PW/PW res: [0x2c064:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252910:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c5599b lrc: 2/0,0 mode: PW/PW res: [0x2c064:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.252952:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000035de0fa0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+278:39029:x1731745946836544:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 66us (220us total) trans 21474837251 rc 0/0 00000100:00100000:1.0:1651529917.252954:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 801 00010000:00010000:1.0:1651529917.252961:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c55986 lrc: 2/0,0 mode: PW/PW res: [0x2c063:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.252962:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+277:39030:x1731745946836608:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 90us (236us total) trans 21474837252 rc 0/0 00000100:00100000:0.0:1651529917.252965:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 800 00010000:00010000:1.0:1651529917.252967:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cde7e11a already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.252968:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c55986 lrc: 2/0,0 mode: PW/PW res: [0x2c063:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252971:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c55986 lrc: 3/0,0 mode: PW/PW res: [0x2c063:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252973:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c5598d lrc: 2/0,0 mode: PW/PW res: [0x2c062:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252976:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c55986 lrc: 1/0,0 mode: --/PW res: [0x2c063:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252976:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c5d6b959 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.252977:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c5598d lrc: 2/0,0 mode: PW/PW res: [0x2c062:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252979:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c55986 lrc: 0/0,0 mode: --/PW res: [0x2c063:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252980:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c5598d lrc: 3/0,0 mode: PW/PW res: [0x2c062:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252983:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c5599b lrc: 2/0,0 mode: PW/PW res: [0x2c064:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252985:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c5598d lrc: 1/0,0 mode: --/PW res: [0x2c062:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252986:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000337d9d20 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.252987:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c5599b lrc: 2/0,0 mode: PW/PW res: [0x2c064:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252989:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c5599b lrc: 3/0,0 mode: PW/PW res: [0x2c064:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252990:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c5598d lrc: 0/0,0 mode: --/PW res: [0x2c062:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252993:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c5599b lrc: 1/0,0 mode: --/PW res: [0x2c064:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.252995:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c5599b lrc: 0/0,0 mode: --/PW res: [0x2c064:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252995:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c55994 lrc: 2/0,0 mode: PW/PW res: [0x2c065:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.252997:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002d7487dc already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.252998:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c55994 lrc: 2/0,0 mode: PW/PW res: [0x2c065:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253001:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c55994 lrc: 3/0,0 mode: PW/PW res: [0x2c065:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253004:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c55994 lrc: 1/0,0 mode: --/PW res: [0x2c065:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253007:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c55994 lrc: 0/0,0 mode: --/PW res: [0x2c065:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.253029:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.253048:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946836928 00000100:00100000:1.0:1651529917.253052:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.253061:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946836992 00000100:00100000:1.0:1651529917.253065:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.253073:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946837120 00000100:00100000:0.0:1651529917.253077:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 802 00000100:00100000:0.0:1651529917.253079:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a8bb9985 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+279:39030:x1731745946836928:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.253084:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180326 count 1 00002000:00010000:0.0:1651529917.253089:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c066:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.253090:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c559a2 lrc: 3/0,1 mode: --/PW res: [0x2c066:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253094:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.253095:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.253095:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c559a2 lrc: 3/0,1 mode: PW/PW res: [0x2c066:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253099:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c559a2 lrc: 3/0,1 mode: PW/PW res: [0x2c066:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.253101:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.253102:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c559a2 lrc: 3/0,1 mode: PW/PW res: [0x2c066:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253105:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c559a2 lrc: 2/0,0 mode: PW/PW res: [0x2c066:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253127:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c559a2 lrc: 2/0,0 mode: PW/PW res: [0x2c066:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253131:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009882f227 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.253132:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c559a2 lrc: 2/0,0 mode: PW/PW res: [0x2c066:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253135:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c559a2 lrc: 3/0,0 mode: PW/PW res: [0x2c066:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253140:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c559a2 lrc: 1/0,0 mode: --/PW res: [0x2c066:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253143:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c559a2 lrc: 0/0,0 mode: --/PW res: [0x2c066:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.253147:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a8bb9985 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+280:39030:x1731745946836928:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 68us (118us total) trans 21474837253 rc 0/0 00000100:00100000:0.0:1651529917.253150:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 802 00000100:00100000:0.0:1651529917.253156:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946837056 00000100:00100000:0.0:1651529917.253160:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 803 00000100:00100000:0.0:1651529917.253177:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003ffbc5dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+280:39030:x1731745946836992:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529917.253179:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 804 00000100:00100000:1.0:1651529917.253181:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000567318ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+280:39030:x1731745946837120:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.253183:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180327 count 1 00002000:00080000:1.0:1651529917.253186:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180329 count 1 00002000:00010000:0.0:1651529917.253188:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c067:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.253189:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c559a9 lrc: 3/0,1 mode: --/PW res: [0x2c067:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.253191:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c069:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.253193:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c559b0 lrc: 3/0,1 mode: --/PW res: [0x2c069:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253193:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.253194:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.253195:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c559a9 lrc: 3/0,1 mode: PW/PW res: [0x2c067:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253197:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.253197:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.253198:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c559b0 lrc: 3/0,1 mode: PW/PW res: [0x2c069:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253198:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c559a9 lrc: 3/0,1 mode: PW/PW res: [0x2c067:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253201:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c559a9 lrc: 3/0,1 mode: PW/PW res: [0x2c067:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253202:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c559b0 lrc: 3/0,1 mode: PW/PW res: [0x2c069:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253204:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c559a9 lrc: 2/0,0 mode: PW/PW res: [0x2c067:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253205:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c559b0 lrc: 3/0,1 mode: PW/PW res: [0x2c069:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253208:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c559b0 lrc: 2/0,0 mode: PW/PW res: [0x2c069:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.253264:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000567318ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+282:39030:x1731745946837120:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 82us (199us total) trans 21474837254 rc 0/0 00000100:00100000:1.0:1651529917.253267:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 804 00000100:00100000:0.0:1651529917.253267:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003ffbc5dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+282:39030:x1731745946836992:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 89us (215us total) trans 21474837255 rc 0/0 00000100:00100000:0.0:1651529917.253270:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 803 00000100:00100000:1.0:1651529917.253273:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 805 00000100:00100000:1.0:1651529917.253274:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004c5dc988 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+280:39030:x1731745946837056:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:0.0:1651529917.253278:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c559a9 lrc: 2/0,0 mode: PW/PW res: [0x2c067:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651529917.253279:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180328 count 1 00010000:00010000:0.0:1651529917.253282:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002731c8d2 already unused, calling callback (0000000049fddea7) 00002000:00010000:1.0:1651529917.253283:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c068:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.253283:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c559a9 lrc: 2/0,0 mode: PW/PW res: [0x2c067:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253285:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c559b7 lrc: 3/0,1 mode: --/PW res: [0x2c068:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253286:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c559a9 lrc: 3/0,0 mode: PW/PW res: [0x2c067:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253288:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.253289:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.253290:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c559b7 lrc: 3/0,1 mode: PW/PW res: [0x2c068:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253291:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c559a9 lrc: 1/0,0 mode: --/PW res: [0x2c067:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253294:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c559b7 lrc: 3/0,1 mode: PW/PW res: [0x2c068:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253296:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002731c8d2/0x3234de053c559a9 lrc: 0/0,0 mode: --/PW res: [0x2c067:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253297:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c559b7 lrc: 3/0,1 mode: PW/PW res: [0x2c068:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253299:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c559b7 lrc: 2/0,0 mode: PW/PW res: [0x2c068:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253300:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c559b0 lrc: 2/0,0 mode: PW/PW res: [0x2c069:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253302:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d571c418 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.253303:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c559b0 lrc: 2/0,0 mode: PW/PW res: [0x2c069:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253335:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c559b0 lrc: 3/0,0 mode: PW/PW res: [0x2c069:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253341:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c559b0 lrc: 1/0,0 mode: --/PW res: [0x2c069:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.253342:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004c5dc988 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+281:39030:x1731745946837056:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 66us (241us total) trans 21474837256 rc 0/0 00010000:00010000:0.0:1651529917.253343:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c559b0 lrc: 0/0,0 mode: --/PW res: [0x2c069:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.253344:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 805 00010000:00010000:0.0:1651529917.253348:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c559b7 lrc: 2/0,0 mode: PW/PW res: [0x2c068:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253351:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000033d777ce already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.253352:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c559b7 lrc: 2/0,0 mode: PW/PW res: [0x2c068:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253357:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c559b7 lrc: 3/0,0 mode: PW/PW res: [0x2c068:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253360:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c559b7 lrc: 1/0,0 mode: --/PW res: [0x2c068:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253363:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c559b7 lrc: 0/0,0 mode: --/PW res: [0x2c068:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.253378:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.253389:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946837760 00000100:00100000:1.0:1651529917.253394:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.253396:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 806 00000100:00100000:0.0:1651529917.253397:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+281:39030:x1731745946837760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.253402:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180331 count 1 00000100:00100000:1.0:1651529917.253404:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00002000:00010000:0.0:1651529917.253413:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c06b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.253415:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c559be lrc: 3/0,1 mode: --/PW res: [0x2c06b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253419:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.253419:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.253420:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c559be lrc: 3/0,1 mode: PW/PW res: [0x2c06b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253424:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c559be lrc: 3/0,1 mode: PW/PW res: [0x2c06b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253427:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c559be lrc: 3/0,1 mode: PW/PW res: [0x2c06b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253432:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c559be lrc: 2/0,0 mode: PW/PW res: [0x2c06b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.253433:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529917.253438:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c559be lrc: 2/0,0 mode: PW/PW res: [0x2c06b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253442:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000041a7efd7 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.253443:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c559be lrc: 2/0,0 mode: PW/PW res: [0x2c06b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253446:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c559be lrc: 3/0,0 mode: PW/PW res: [0x2c06b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253454:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c559be lrc: 1/0,0 mode: --/PW res: [0x2c06b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253457:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041a7efd7/0x3234de053c559be lrc: 0/0,0 mode: --/PW res: [0x2c06b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.253475:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.253480:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946837696 00000100:00100000:1.0:1651529917.253486:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946837888 00000100:00100000:1.0:1651529917.253488:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946837824 00000100:00100000:0.0:1651529917.253492:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+285:39030:x1731745946837760:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 93us (113us total) trans 21474837257 rc 0/0 00000100:00100000:0.0:1651529917.253495:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 806 00000100:00100000:1.0:1651529917.253497:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946837952 00000100:00100000:0.0:1651529917.253501:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 807 00000100:00100000:0.0:1651529917.253502:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+285:39029:x1731745946837696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529917.253503:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 808 00000100:00100000:1.0:1651529917.253504:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+285:39030:x1731745946837888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.253507:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180330 count 1 00002000:00080000:1.0:1651529917.253509:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180333 count 1 00002000:00010000:0.0:1651529917.253512:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c06a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.253513:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c559c5 lrc: 3/0,1 mode: --/PW res: [0x2c06a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.253514:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c06d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.253516:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c559cc lrc: 3/0,1 mode: --/PW res: [0x2c06d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253517:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.253518:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.253519:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.253519:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c559c5 lrc: 3/0,1 mode: PW/PW res: [0x2c06a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253520:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.253521:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c559cc lrc: 3/0,1 mode: PW/PW res: [0x2c06d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253522:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c559c5 lrc: 3/0,1 mode: PW/PW res: [0x2c06a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253524:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c559cc lrc: 3/0,1 mode: PW/PW res: [0x2c06d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253527:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c559cc lrc: 3/0,1 mode: PW/PW res: [0x2c06d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253530:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c559cc lrc: 2/0,0 mode: PW/PW res: [0x2c06d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253546:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c559c5 lrc: 3/0,1 mode: PW/PW res: [0x2c06a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253549:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c559c5 lrc: 2/0,0 mode: PW/PW res: [0x2c06a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.253580:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+287:39030:x1731745946837888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 75us (175us total) trans 21474837258 rc 0/0 00000100:00100000:1.0:1651529917.253583:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 808 00000100:00100000:1.0:1651529917.253588:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 809 00000100:00100000:1.0:1651529917.253589:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+286:39029:x1731745946837824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529917.253591:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+286:39029:x1731745946837696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 88us (197us total) trans 21474837259 rc 0/0 00002000:00080000:1.0:1651529917.253593:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180332 count 1 00000100:00100000:0.0:1651529917.253595:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 807 00002000:00010000:1.0:1651529917.253598:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c06c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.253600:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c559d3 lrc: 3/0,1 mode: --/PW res: [0x2c06c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.253600:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 810 00000100:00100000:0.0:1651529917.253602:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+285:39029:x1731745946837952:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529917.253603:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.253604:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.253605:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c559d3 lrc: 3/0,1 mode: PW/PW res: [0x2c06c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.253606:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180334 count 1 00010000:00010000:1.0:1651529917.253609:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c559d3 lrc: 3/0,1 mode: PW/PW res: [0x2c06c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.253611:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c06e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.253612:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c559d3 lrc: 3/0,1 mode: PW/PW res: [0x2c06c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253613:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c559da lrc: 3/0,1 mode: --/PW res: [0x2c06e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253614:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c559d3 lrc: 2/0,0 mode: PW/PW res: [0x2c06c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253616:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.253617:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.253617:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c559da lrc: 3/0,1 mode: PW/PW res: [0x2c06e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253621:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c559da lrc: 3/0,1 mode: PW/PW res: [0x2c06e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253624:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c559da lrc: 3/0,1 mode: PW/PW res: [0x2c06e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253627:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c559da lrc: 2/0,0 mode: PW/PW res: [0x2c06e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.253648:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+287:39029:x1731745946837824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 58us (216us total) trans 21474837260 rc 0/0 00000100:00100000:1.0:1651529917.253651:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 809 00000100:00100000:0.0:1651529917.253658:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+286:39029:x1731745946837952:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 56us (184us total) trans 21474837261 rc 0/0 00000100:00100000:0.0:1651529917.253663:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 810 00010000:00010000:0.0:1651529917.253706:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c559cc lrc: 2/0,0 mode: PW/PW res: [0x2c06d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253710:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000037a4f3dc already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.253711:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c559cc lrc: 2/0,0 mode: PW/PW res: [0x2c06d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253714:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c559cc lrc: 3/0,0 mode: PW/PW res: [0x2c06d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253719:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c559cc lrc: 1/0,0 mode: --/PW res: [0x2c06d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253722:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c559cc lrc: 0/0,0 mode: --/PW res: [0x2c06d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253726:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c559c5 lrc: 2/0,0 mode: PW/PW res: [0x2c06a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253729:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d2b9655c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.253730:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c559c5 lrc: 2/0,0 mode: PW/PW res: [0x2c06a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253733:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c559c5 lrc: 3/0,0 mode: PW/PW res: [0x2c06a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253738:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c559c5 lrc: 1/0,0 mode: --/PW res: [0x2c06a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253741:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2b9655c/0x3234de053c559c5 lrc: 0/0,0 mode: --/PW res: [0x2c06a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253744:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c559d3 lrc: 2/0,0 mode: PW/PW res: [0x2c06c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.253747:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.253747:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b9e4c5a0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.253747:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c559d3 lrc: 2/0,0 mode: PW/PW res: [0x2c06c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253750:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c559d3 lrc: 3/0,0 mode: PW/PW res: [0x2c06c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.253758:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.253760:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c559d3 lrc: 1/0,0 mode: --/PW res: [0x2c06c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253762:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c559d3 lrc: 0/0,0 mode: --/PW res: [0x2c06c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.253765:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.253766:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c559da lrc: 2/0,0 mode: PW/PW res: [0x2c06e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253768:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032eb11d3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.253769:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c559da lrc: 2/0,0 mode: PW/PW res: [0x2c06e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253772:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c559da lrc: 3/0,0 mode: PW/PW res: [0x2c06e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.253773:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946838272 00010000:00010000:0.0:1651529917.253775:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c559da lrc: 1/0,0 mode: --/PW res: [0x2c06e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.253777:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946838208 00010000:00010000:0.0:1651529917.253778:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c559da lrc: 0/0,0 mode: --/PW res: [0x2c06e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.253780:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946838336 00000100:00100000:1.0:1651529917.253783:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 811 00000100:00100000:1.0:1651529917.253784:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ffcc974c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+288:39030:x1731745946838272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529917.253786:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 812 00002000:00080000:1.0:1651529917.253789:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180336 count 1 00002000:00010000:1.0:1651529917.253794:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c070:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.253796:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c559e1 lrc: 3/0,1 mode: --/PW res: [0x2c070:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253800:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.253800:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.253801:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c559e1 lrc: 3/0,1 mode: PW/PW res: [0x2c070:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.253803:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9e74b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+288:39029:x1731745946838208:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529917.253805:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c559e1 lrc: 3/0,1 mode: PW/PW res: [0x2c070:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253808:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c559e1 lrc: 3/0,1 mode: PW/PW res: [0x2c070:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.253809:0:166112:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180335 count 1 00010000:00010000:1.0:1651529917.253813:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c559e1 lrc: 2/0,0 mode: PW/PW res: [0x2c070:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.253813:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c06f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.253815:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c559e8 lrc: 3/0,1 mode: --/PW res: [0x2c06f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253818:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.253819:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.253819:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c559e8 lrc: 3/0,1 mode: PW/PW res: [0x2c06f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253823:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c559e8 lrc: 3/0,1 mode: PW/PW res: [0x2c06f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253826:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c559e8 lrc: 3/0,1 mode: PW/PW res: [0x2c06f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253829:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c559e8 lrc: 2/0,0 mode: PW/PW res: [0x2c06f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.253853:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ffcc974c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+290:39030:x1731745946838272:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 68us (106us total) trans 21474837262 rc 0/0 00000100:00100000:1.0:1651529917.253856:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 811 00000100:00100000:1.0:1651529917.253861:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 813 00000100:00100000:1.0:1651529917.253863:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057d84ac9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+289:39029:x1731745946838336:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.253867:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180337 count 1 00000100:00100000:0.0:1651529917.253867:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9e74b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+289:39029:x1731745946838208:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 78us (108us total) trans 21474837263 rc 0/0 00000100:00100000:0.0:1651529917.253870:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 812 00002000:00010000:1.0:1651529917.253871:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c071:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.253873:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c559ef lrc: 3/0,1 mode: --/PW res: [0x2c071:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253876:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.253877:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.253877:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c559e1 lrc: 2/0,0 mode: PW/PW res: [0x2c070:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253878:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c559ef lrc: 3/0,1 mode: PW/PW res: [0x2c071:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253880:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006512b8a0 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.253881:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c559ef lrc: 3/0,1 mode: PW/PW res: [0x2c071:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253881:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c559e1 lrc: 2/0,0 mode: PW/PW res: [0x2c070:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253884:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c559ef lrc: 3/0,1 mode: PW/PW res: [0x2c071:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253884:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c559e1 lrc: 3/0,0 mode: PW/PW res: [0x2c070:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.253887:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c559ef lrc: 2/0,0 mode: PW/PW res: [0x2c071:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253889:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c559e1 lrc: 1/0,0 mode: --/PW res: [0x2c070:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253891:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c559e1 lrc: 0/0,0 mode: --/PW res: [0x2c070:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253903:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c559e8 lrc: 2/0,0 mode: PW/PW res: [0x2c06f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253906:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000820e2b3d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.253907:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c559e8 lrc: 2/0,0 mode: PW/PW res: [0x2c06f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253910:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c559e8 lrc: 3/0,0 mode: PW/PW res: [0x2c06f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253914:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c559e8 lrc: 1/0,0 mode: --/PW res: [0x2c06f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253916:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c559e8 lrc: 0/0,0 mode: --/PW res: [0x2c06f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253920:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c559ef lrc: 2/0,0 mode: PW/PW res: [0x2c071:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253922:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000589cc6c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.253923:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c559ef lrc: 2/0,0 mode: PW/PW res: [0x2c071:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.253926:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c559ef lrc: 3/0,0 mode: PW/PW res: [0x2c071:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.253927:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057d84ac9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+289:39029:x1731745946838336:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 64us (161us total) trans 21474837264 rc 0/0 00010000:00010000:0.0:1651529917.253929:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c559ef lrc: 1/0,0 mode: --/PW res: [0x2c071:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.253930:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 813 00010000:00010000:0.0:1651529917.253932:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c559ef lrc: 0/0,0 mode: --/PW res: [0x2c071:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.254017:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.254028:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946838656 00000100:00100000:1.0:1651529917.254029:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.254050:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946838720 00000100:00100000:1.0:1651529917.254054:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 814 00000100:00100000:0.0:1651529917.254056:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 815 00000100:00100000:1.0:1651529917.254057:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054ed0749 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+290:39030:x1731745946838656:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529917.254058:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d50fdfc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+290:39029:x1731745946838720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.254062:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180338 count 1 00002000:00080000:0.0:1651529917.254063:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180339 count 1 00002000:00010000:1.0:1651529917.254068:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c072:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:0.0:1651529917.254069:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c073:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.254070:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c559f6 lrc: 3/0,1 mode: --/PW res: [0x2c072:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254071:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c559fd lrc: 3/0,1 mode: --/PW res: [0x2c073:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254073:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.254074:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.254074:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.254075:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c559f6 lrc: 3/0,1 mode: PW/PW res: [0x2c072:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254075:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.254076:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c559fd lrc: 3/0,1 mode: PW/PW res: [0x2c073:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254079:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c559f6 lrc: 3/0,1 mode: PW/PW res: [0x2c072:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254079:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c559fd lrc: 3/0,1 mode: PW/PW res: [0x2c073:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254082:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c559f6 lrc: 3/0,1 mode: PW/PW res: [0x2c072:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254082:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c559fd lrc: 3/0,1 mode: PW/PW res: [0x2c073:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254084:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c559f6 lrc: 2/0,0 mode: PW/PW res: [0x2c072:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254085:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c559fd lrc: 2/0,0 mode: PW/PW res: [0x2c073:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.254135:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054ed0749 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+292:39030:x1731745946838656:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 78us (118us total) trans 21474837265 rc 0/0 00000100:00100000:1.0:1651529917.254139:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 814 00000100:00100000:0.0:1651529917.254145:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d50fdfc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+291:39029:x1731745946838720:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 86us (116us total) trans 21474837266 rc 0/0 00010000:00010000:1.0:1651529917.254146:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c559f6 lrc: 2/0,0 mode: PW/PW res: [0x2c072:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.254148:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 815 00010000:00010000:1.0:1651529917.254149:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000baeec0a3 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.254150:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c559f6 lrc: 2/0,0 mode: PW/PW res: [0x2c072:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254153:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c559f6 lrc: 3/0,0 mode: PW/PW res: [0x2c072:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254158:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c559f6 lrc: 1/0,0 mode: --/PW res: [0x2c072:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254160:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c559f6 lrc: 0/0,0 mode: --/PW res: [0x2c072:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254165:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c559fd lrc: 2/0,0 mode: PW/PW res: [0x2c073:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254167:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000029e40f3d already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.254168:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c559fd lrc: 2/0,0 mode: PW/PW res: [0x2c073:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254173:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c559fd lrc: 3/0,0 mode: PW/PW res: [0x2c073:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254177:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c559fd lrc: 1/0,0 mode: --/PW res: [0x2c073:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254179:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c559fd lrc: 0/0,0 mode: --/PW res: [0x2c073:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.254281:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.254292:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.254292:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946838848 00000100:00100000:0.0:1651529917.254303:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946838912 00000100:00100000:0.0:1651529917.254311:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 816 00000100:00100000:0.0:1651529917.254312:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000035de0fa0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+292:39030:x1731745946838848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1651529917.254314:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 817 00000100:00100000:1.0:1651529917.254316:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a8bb9985 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+292:39030:x1731745946838912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.254318:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180340 count 1 00002000:00080000:1.0:1651529917.254322:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180341 count 1 00002000:00010000:0.0:1651529917.254323:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c074:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.254325:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c55a04 lrc: 3/0,1 mode: --/PW res: [0x2c074:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529917.254327:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c075:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.254328:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c55a0b lrc: 3/0,1 mode: --/PW res: [0x2c075:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254332:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.254332:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.254333:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c55a0b lrc: 3/0,1 mode: PW/PW res: [0x2c075:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254337:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c55a0b lrc: 3/0,1 mode: PW/PW res: [0x2c075:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254340:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c55a0b lrc: 3/0,1 mode: PW/PW res: [0x2c075:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254343:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c55a0b lrc: 2/0,0 mode: PW/PW res: [0x2c075:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254367:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.254368:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.254369:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c55a04 lrc: 3/0,1 mode: PW/PW res: [0x2c074:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254373:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c55a04 lrc: 3/0,1 mode: PW/PW res: [0x2c074:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254376:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c55a04 lrc: 3/0,1 mode: PW/PW res: [0x2c074:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254379:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c55a04 lrc: 2/0,0 mode: PW/PW res: [0x2c074:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.254398:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a8bb9985 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+294:39030:x1731745946838912:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 82us (106us total) trans 21474837267 rc 0/0 00000100:00100000:1.0:1651529917.254401:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 817 00000100:00100000:0.0:1651529917.254431:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000035de0fa0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+293:39030:x1731745946838848:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 118us (150us total) trans 21474837268 rc 0/0 00000100:00100000:1.0:1651529917.254439:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.254445:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 816 00000100:00100000:0.0:1651529917.254450:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946838976 00000100:00100000:1.0:1651529917.254453:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.254454:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946839296 00000100:00100000:0.0:1651529917.254457:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 818 00000100:00100000:0.0:1651529917.254459:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000567318ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+294:39030:x1731745946838976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.254464:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180342 count 1 00002000:00010000:0.0:1651529917.254469:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c076:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.254470:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c55a12 lrc: 3/0,1 mode: --/PW res: [0x2c076:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254474:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.254475:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.254475:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c55a12 lrc: 3/0,1 mode: PW/PW res: [0x2c076:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.254478:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.254479:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c55a12 lrc: 3/0,1 mode: PW/PW res: [0x2c076:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254482:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c55a12 lrc: 3/0,1 mode: PW/PW res: [0x2c076:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.254483:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:0.0:1651529917.254485:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c55a12 lrc: 2/0,0 mode: PW/PW res: [0x2c076:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.254488:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.254499:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00010000:00010000:1.0:1651529917.254505:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c55a0b lrc: 2/0,0 mode: PW/PW res: [0x2c075:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254508:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004f367ded already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.254509:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c55a0b lrc: 2/0,0 mode: PW/PW res: [0x2c075:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254512:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c55a0b lrc: 3/0,0 mode: PW/PW res: [0x2c075:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254517:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c55a0b lrc: 1/0,0 mode: --/PW res: [0x2c075:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254520:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c55a0b lrc: 0/0,0 mode: --/PW res: [0x2c075:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.254528:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000567318ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+295:39030:x1731745946838976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 68us (90us total) trans 21474837269 rc 0/0 00010000:00010000:1.0:1651529917.254530:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c55a04 lrc: 2/0,0 mode: PW/PW res: [0x2c074:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.254531:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 818 00010000:00010000:1.0:1651529917.254533:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054295afd already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.254534:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c55a04 lrc: 2/0,0 mode: PW/PW res: [0x2c074:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.254536:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946839232 00010000:00010000:1.0:1651529917.254537:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c55a04 lrc: 3/0,0 mode: PW/PW res: [0x2c074:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.254539:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946839360 00010000:00010000:1.0:1651529917.254540:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c55a04 lrc: 1/0,0 mode: --/PW res: [0x2c074:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.254542:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946839424 00010000:00010000:1.0:1651529917.254543:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c55a04 lrc: 0/0,0 mode: --/PW res: [0x2c074:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.254544:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946839488 00010000:00010000:1.0:1651529917.254547:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c55a12 lrc: 2/0,0 mode: PW/PW res: [0x2c076:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.254547:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 819 00000100:00100000:0.0:1651529917.254548:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003ffbc5dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+298:39030:x1731745946839296:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529917.254549:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005532ef34 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.254550:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c55a12 lrc: 2/0,0 mode: PW/PW res: [0x2c076:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254552:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c55a12 lrc: 3/0,0 mode: PW/PW res: [0x2c076:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.254552:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180344 count 1 00010000:00010000:1.0:1651529917.254556:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c55a12 lrc: 1/0,0 mode: --/PW res: [0x2c076:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.254557:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c078:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.254559:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c55a12 lrc: 0/0,0 mode: --/PW res: [0x2c076:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254559:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c55a19 lrc: 3/0,1 mode: --/PW res: [0x2c078:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254562:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.254563:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.254564:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c55a19 lrc: 3/0,1 mode: PW/PW res: [0x2c078:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254567:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c55a19 lrc: 3/0,1 mode: PW/PW res: [0x2c078:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254570:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c55a19 lrc: 3/0,1 mode: PW/PW res: [0x2c078:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254573:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c55a19 lrc: 2/0,0 mode: PW/PW res: [0x2c078:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.254595:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 820 00000100:00100000:1.0:1651529917.254597:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004c5dc988 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+299:39030:x1731745946839232:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.254602:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180343 count 1 00002000:00010000:1.0:1651529917.254607:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c077:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.254609:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c55a20 lrc: 3/0,1 mode: --/PW res: [0x2c077:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.254614:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003ffbc5dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+299:39030:x1731745946839296:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 64us (160us total) trans 21474837270 rc 0/0 00000100:00100000:0.0:1651529917.254617:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 819 00010000:00010000:1.0:1651529917.254618:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.254619:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.254620:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c55a20 lrc: 3/0,1 mode: PW/PW res: [0x2c077:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.254622:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 821 00010000:00010000:1.0:1651529917.254624:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c55a20 lrc: 3/0,1 mode: PW/PW res: [0x2c077:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.254624:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+298:39030:x1731745946839360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529917.254627:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c55a20 lrc: 3/0,1 mode: PW/PW res: [0x2c077:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254630:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c55a20 lrc: 2/0,0 mode: PW/PW res: [0x2c077:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.254643:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180345 count 1 00002000:00010000:0.0:1651529917.254648:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c079:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.254650:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c55a27 lrc: 3/0,1 mode: --/PW res: [0x2c079:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254654:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.254654:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.254655:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c55a27 lrc: 3/0,1 mode: PW/PW res: [0x2c079:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254659:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c55a27 lrc: 3/0,1 mode: PW/PW res: [0x2c079:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254662:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c55a27 lrc: 3/0,1 mode: PW/PW res: [0x2c079:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.254665:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004c5dc988 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+299:39030:x1731745946839232:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 67us (186us total) trans 21474837271 rc 0/0 00010000:00010000:0.0:1651529917.254665:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c55a27 lrc: 2/0,0 mode: PW/PW res: [0x2c079:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.254669:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 820 00000100:00100000:1.0:1651529917.254675:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 822 00000100:00100000:1.0:1651529917.254676:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+298:39030:x1731745946839424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.254682:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180346 count 1 00002000:00010000:1.0:1651529917.254686:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c07a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.254687:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55a2e lrc: 3/0,1 mode: --/PW res: [0x2c07a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254691:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.254691:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.254692:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55a2e lrc: 3/0,1 mode: PW/PW res: [0x2c07a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254696:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55a2e lrc: 3/0,1 mode: PW/PW res: [0x2c07a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.254698:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+299:39030:x1731745946839360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 73us (214us total) trans 21474837272 rc 0/0 00010000:00010000:1.0:1651529917.254699:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55a2e lrc: 3/0,1 mode: PW/PW res: [0x2c07a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.254700:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 821 00010000:00010000:1.0:1651529917.254702:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55a2e lrc: 2/0,0 mode: PW/PW res: [0x2c07a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.254706:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 823 00000100:00100000:0.0:1651529917.254707:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+298:39029:x1731745946839488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.254731:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180347 count 1 00002000:00010000:0.0:1651529917.254737:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c07b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.254738:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c55a35 lrc: 3/0,1 mode: --/PW res: [0x2c07b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.254742:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+299:39030:x1731745946839424:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 64us (253us total) trans 21474837273 rc 0/0 00010000:00010000:0.0:1651529917.254742:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.254742:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.254743:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c55a35 lrc: 3/0,1 mode: PW/PW res: [0x2c07b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.254745:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 822 00010000:00010000:0.0:1651529917.254747:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c55a35 lrc: 3/0,1 mode: PW/PW res: [0x2c07b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254752:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c55a35 lrc: 3/0,1 mode: PW/PW res: [0x2c07b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254755:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c55a35 lrc: 2/0,0 mode: PW/PW res: [0x2c07b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.254778:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.254790:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+299:39029:x1731745946839488:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 82us (291us total) trans 21474837274 rc 0/0 00000100:00100000:1.0:1651529917.254793:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.254793:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 823 00000100:00100000:0.0:1651529917.254798:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946839808 00000100:00100000:1.0:1651529917.254801:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.254802:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946839872 00000100:00100000:0.0:1651529917.254804:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946839936 00000100:00100000:0.0:1651529917.254807:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 824 00000100:00100000:0.0:1651529917.254808:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+301:39030:x1731745946839808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.254812:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180348 count 1 00002000:00010000:0.0:1651529917.254817:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c07c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.254818:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c55a3c lrc: 3/0,1 mode: --/PW res: [0x2c07c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254822:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.254822:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.254823:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c55a3c lrc: 3/0,1 mode: PW/PW res: [0x2c07c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254827:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c55a3c lrc: 3/0,1 mode: PW/PW res: [0x2c07c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254832:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c55a3c lrc: 3/0,1 mode: PW/PW res: [0x2c07c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254835:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c55a3c lrc: 2/0,0 mode: PW/PW res: [0x2c07c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254843:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c55a19 lrc: 2/0,0 mode: PW/PW res: [0x2c078:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254847:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fcafd1a already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.254848:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c55a19 lrc: 2/0,0 mode: PW/PW res: [0x2c078:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254851:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c55a19 lrc: 3/0,0 mode: PW/PW res: [0x2c078:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254856:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c55a19 lrc: 1/0,0 mode: --/PW res: [0x2c078:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254858:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c55a19 lrc: 0/0,0 mode: --/PW res: [0x2c078:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254863:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c55a20 lrc: 2/0,0 mode: PW/PW res: [0x2c077:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254866:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007c1cad42 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.254867:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c55a20 lrc: 2/0,0 mode: PW/PW res: [0x2c077:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.254873:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+302:39030:x1731745946839808:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 63us (95us total) trans 21474837275 rc 0/0 00010000:00010000:1.0:1651529917.254874:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c55a20 lrc: 3/0,0 mode: PW/PW res: [0x2c077:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.254876:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 824 00010000:00010000:1.0:1651529917.254878:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c55a20 lrc: 1/0,0 mode: --/PW res: [0x2c077:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254881:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c55a20 lrc: 0/0,0 mode: --/PW res: [0x2c077:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.254881:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 825 00000100:00100000:0.0:1651529917.254882:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+301:39029:x1731745946839872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00010000:00010000:1.0:1651529917.254885:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c55a27 lrc: 2/0,0 mode: PW/PW res: [0x2c079:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1651529917.254886:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180349 count 1 00010000:00010000:1.0:1651529917.254888:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eca832be already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.254889:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c55a27 lrc: 2/0,0 mode: PW/PW res: [0x2c079:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254891:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c55a27 lrc: 3/0,0 mode: PW/PW res: [0x2c079:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254894:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c55a27 lrc: 1/0,0 mode: --/PW res: [0x2c079:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254897:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c55a27 lrc: 0/0,0 mode: --/PW res: [0x2c079:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254900:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55a2e lrc: 2/0,0 mode: PW/PW res: [0x2c07a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254903:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001ea46bb1 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.254904:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55a2e lrc: 2/0,0 mode: PW/PW res: [0x2c07a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.254907:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c07d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.254909:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55a2e lrc: 3/0,0 mode: PW/PW res: [0x2c07a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254909:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c55a43 lrc: 3/0,1 mode: --/PW res: [0x2c07d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254912:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55a2e lrc: 1/0,0 mode: --/PW res: [0x2c07a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254912:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.254913:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.254914:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c55a43 lrc: 3/0,1 mode: PW/PW res: [0x2c07d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254915:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55a2e lrc: 0/0,0 mode: --/PW res: [0x2c07a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254917:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c55a43 lrc: 3/0,1 mode: PW/PW res: [0x2c07d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254918:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c55a35 lrc: 2/0,0 mode: PW/PW res: [0x2c07b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254920:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b5173ced already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.254920:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c55a43 lrc: 3/0,1 mode: PW/PW res: [0x2c07d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254921:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c55a35 lrc: 2/0,0 mode: PW/PW res: [0x2c07b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254924:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c55a35 lrc: 3/0,0 mode: PW/PW res: [0x2c07b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254926:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c55a43 lrc: 2/0,0 mode: PW/PW res: [0x2c07d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254927:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c55a35 lrc: 1/0,0 mode: --/PW res: [0x2c07b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254929:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c55a35 lrc: 0/0,0 mode: --/PW res: [0x2c07b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254933:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c55a3c lrc: 2/0,0 mode: PW/PW res: [0x2c07c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254936:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004cff9fc3 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.254937:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c55a3c lrc: 2/0,0 mode: PW/PW res: [0x2c07c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254939:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c55a3c lrc: 3/0,0 mode: PW/PW res: [0x2c07c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254942:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c55a3c lrc: 1/0,0 mode: --/PW res: [0x2c07c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254945:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c55a3c lrc: 0/0,0 mode: --/PW res: [0x2c07c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254948:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c55a43 lrc: 2/0,0 mode: PW/PW res: [0x2c07d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254951:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000d8e6a5e already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.254951:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c55a43 lrc: 2/0,0 mode: PW/PW res: [0x2c07d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254954:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c55a43 lrc: 3/0,0 mode: PW/PW res: [0x2c07d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.254957:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c55a43 lrc: 1/0,0 mode: --/PW res: [0x2c07d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.254957:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+302:39029:x1731745946839872:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 74us (164us total) trans 21474837276 rc 0/0 00010000:00010000:1.0:1651529917.254960:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c55a43 lrc: 0/0,0 mode: --/PW res: [0x2c07d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.254960:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 825 00000100:00100000:0.0:1651529917.254965:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 826 00000100:00100000:0.0:1651529917.254967:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ffcc974c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+301:39030:x1731745946839936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651529917.254971:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180350 count 1 00002000:00010000:0.0:1651529917.254975:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c07e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.254976:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c55a4a lrc: 3/0,1 mode: --/PW res: [0x2c07e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254980:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.254981:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.254982:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c55a4a lrc: 3/0,1 mode: PW/PW res: [0x2c07e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254985:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c55a4a lrc: 3/0,1 mode: PW/PW res: [0x2c07e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254988:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c55a4a lrc: 3/0,1 mode: PW/PW res: [0x2c07e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.254991:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c55a4a lrc: 2/0,0 mode: PW/PW res: [0x2c07e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.255004:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c55a4a lrc: 2/0,0 mode: PW/PW res: [0x2c07e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.255008:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008393c644 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.255009:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c55a4a lrc: 2/0,0 mode: PW/PW res: [0x2c07e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.255013:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c55a4a lrc: 3/0,0 mode: PW/PW res: [0x2c07e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.255017:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c55a4a lrc: 1/0,0 mode: --/PW res: [0x2c07e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.255020:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c55a4a lrc: 0/0,0 mode: --/PW res: [0x2c07e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529917.255054:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ffcc974c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+302:39030:x1731745946839936:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 86us (252us total) trans 21474837277 rc 0/0 00000100:00100000:0.0:1651529917.255057:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 826 00000100:00100000:1.0:1651529917.255092:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529917.255103:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.255103:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946840256 00000100:00100000:1.0:1651529917.255112:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529917.255115:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946840320 00000100:00100000:0.0:1651529917.255118:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946840384 00000100:00100000:1.0:1651529917.255120:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 827 00000100:00100000:1.0:1651529917.255122:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9e74b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+304:39029:x1731745946840256:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529917.255123:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 828 00000100:00100000:0.0:1651529917.255124:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057d84ac9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+304:39030:x1731745946840320:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.255128:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180351 count 1 00002000:00080000:0.0:1651529917.255129:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180352 count 1 00002000:00010000:1.0:1651529917.255133:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c07f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529917.255134:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c55a51 lrc: 3/0,1 mode: --/PW res: [0x2c07f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.255140:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.255141:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.255142:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c55a51 lrc: 3/0,1 mode: PW/PW res: [0x2c07f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.255145:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c55a51 lrc: 3/0,1 mode: PW/PW res: [0x2c07f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.255148:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c55a51 lrc: 3/0,1 mode: PW/PW res: [0x2c07f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529917.255148:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c080:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529917.255150:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55a58 lrc: 3/0,1 mode: --/PW res: [0x2c080:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.255151:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c55a51 lrc: 2/0,0 mode: PW/PW res: [0x2c07f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255154:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.255154:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529917.255155:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55a58 lrc: 3/0,1 mode: PW/PW res: [0x2c080:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255159:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55a58 lrc: 3/0,1 mode: PW/PW res: [0x2c080:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255162:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55a58 lrc: 3/0,1 mode: PW/PW res: [0x2c080:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255164:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55a58 lrc: 2/0,0 mode: PW/PW res: [0x2c080:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.255189:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9e74b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+306:39029:x1731745946840256:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 67us (97us total) trans 21474837278 rc 0/0 00000100:00100000:1.0:1651529917.255192:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 827 00000100:00100000:1.0:1651529917.255198:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 829 00000100:00100000:1.0:1651529917.255199:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054ed0749 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+305:39029:x1731745946840384:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529917.255204:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180353 count 1 00000100:00100000:0.0:1651529917.255204:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057d84ac9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+305:39030:x1731745946840320:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 79us (101us total) trans 21474837279 rc 0/0 00002000:00010000:1.0:1651529917.255208:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c081:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1651529917.255208:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 828 00010000:00010000:1.0:1651529917.255210:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55a5f lrc: 3/0,1 mode: --/PW res: [0x2c081:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.255213:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.255214:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529917.255215:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55a5f lrc: 3/0,1 mode: PW/PW res: [0x2c081:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255215:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c55a51 lrc: 2/0,0 mode: PW/PW res: [0x2c07f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255218:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000003af78ab already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529917.255219:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55a5f lrc: 3/0,1 mode: PW/PW res: [0x2c081:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255219:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c55a51 lrc: 2/0,0 mode: PW/PW res: [0x2c07f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255234:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c55a51 lrc: 3/0,0 mode: PW/PW res: [0x2c07f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.255238:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55a5f lrc: 3/0,1 mode: PW/PW res: [0x2c081:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529917.255242:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55a5f lrc: 2/0,0 mode: PW/PW res: [0x2c081:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255244:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c55a51 lrc: 1/0,0 mode: --/PW res: [0x2c07f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255251:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c55a51 lrc: 0/0,0 mode: --/PW res: [0x2c07f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255256:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55a58 lrc: 2/0,0 mode: PW/PW res: [0x2c080:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255259:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b1b8f74 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.255260:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55a58 lrc: 2/0,0 mode: PW/PW res: [0x2c080:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255265:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55a58 lrc: 3/0,0 mode: PW/PW res: [0x2c080:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255269:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55a58 lrc: 1/0,0 mode: --/PW res: [0x2c080:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255271:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55a58 lrc: 0/0,0 mode: --/PW res: [0x2c080:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255275:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55a5f lrc: 2/0,0 mode: PW/PW res: [0x2c081:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255277:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000062f8a534 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529917.255278:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55a5f lrc: 2/0,0 mode: PW/PW res: [0x2c081:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.255279:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054ed0749 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+305:39029:x1731745946840384:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 78us (166us total) trans 21474837280 rc 0/0 00010000:00010000:0.0:1651529917.255281:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55a5f lrc: 3/0,0 mode: PW/PW res: [0x2c081:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529917.255282:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 829 00010000:00010000:0.0:1651529917.255284:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55a5f lrc: 1/0,0 mode: --/PW res: [0x2c081:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529917.255287:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55a5f lrc: 0/0,0 mode: --/PW res: [0x2c081:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000400:00000080:1.0:1651529918.039946:0:168118:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651529918.039948:0:168118:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 140: Check reasonable stack depth (shouldn't LBUG) ============================================================== 22:18:36 (1651529916) 00000100:00100000:1.0:1651529918.136130:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529918.136163:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754352881088 00000100:00100000:0.0:1651529918.136182:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 830 00000100:00100000:0.0:1651529918.136185:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:438145:x1731754352881088:12345-10.240.43.64@tcp:8:cp.0 00010000:00080000:0.0:1651529918.136199:0:167632:0:(ldlm_lib.c:1365:target_handle_connect()) lustre-OST0001: connection from ec96cd77-f6e5-48c2-876b-61a646cc1c34@10.240.43.64@tcp t0 exp 0000000055bfac58 cur 20576 last 0 00000020:00000080:0.0:1651529918.136212:0:167632:0:(genops.c:1359:class_connect()) connect: client ec96cd77-f6e5-48c2-876b-61a646cc1c34, cookie 0x3234de053c55a66 00002000:00100000:0.0:1651529918.136217:0:167632:0:(ofd_obd.c:150:ofd_parse_connect_data()) lustre-OST0001: cli ec96cd77-f6e5-48c2-876b-61a646cc1c34/00000000d61107c9 ocd_connect_flags: 0xa0465af2e3640078 ocd_version: 20f0000 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1651529918.136240:0:167632:0:(ofd_obd.c:249:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000020:01000000:0.0:1651529918.136271:0:167632:0:(lprocfs_status_server.c:544:lprocfs_exp_setup()) using hash 00000000427049c0 00002000:00080000:0.0:1651529918.136274:0:167632:0:(ofd_obd.c:391:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1651529918.136286:0:167632:0:(import.c:85:import_set_state_nolock()) 000000005a6b7f5e ãFÖà”ÿÿ: changing import state from RECOVER to FULL 00000100:00100000:0.0:1651529918.136317:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec96cd77-f6e5-48c2-876b-61a646cc1c34+6:438145:x1731754352881088:12345-10.240.43.64@tcp:8:cp.0 Request processed in 132us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529918.136321:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 830 00000100:00100000:1.0:1651529918.136647:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529918.136658:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754352881152 00000100:00100000:0.0:1651529918.136672:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 831 00000100:00100000:0.0:1651529918.136674:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec96cd77-f6e5-48c2-876b-61a646cc1c34+6:0:x1731754352881152:12345-10.240.43.64@tcp:101:cp.0 00010000:00010000:0.0:1651529918.136678:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529918.136688:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55a6d lrc: 2/0,0 mode: --/PR res: [0x2c082:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db2f2dad expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529918.136698:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c082:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651529918.136705:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529918.136706:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529918.136710:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55a6d lrc: 3/0,0 mode: PR/PR res: [0x2c082:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f2dad expref: 7 pid: 167632 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529918.136718:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55a6d lrc: 3/0,0 mode: PR/PR res: [0x2c082:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f2dad expref: 7 pid: 167632 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529918.136724:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b1b8f74, rc 0) 00000100:00100000:0.0:1651529918.136740:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec96cd77-f6e5-48c2-876b-61a646cc1c34+7:0:x1731754352881152:12345-10.240.43.64@tcp:101:cp.0 Request processed in 65us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529918.136743:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 831 00000100:00100000:1.0:1651529918.137418:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529918.137435:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754352881216 00000100:00100000:0.0:1651529918.137448:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 832 00000100:00100000:0.0:1651529918.137450:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec96cd77-f6e5-48c2-876b-61a646cc1c34+7:450358:x1731754352881216:12345-10.240.43.64@tcp:101:cp.0 00010000:00010000:0.0:1651529918.137454:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529918.137458:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55a74 lrc: 2/0,0 mode: --/PW res: [0x2c082:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db2f2db4 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529918.137466:0:167632:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55a6d lrc: 2/0,0 mode: PR/PR res: [0x2c082:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f2dad expref: 8 pid: 167632 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529918.137469:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529918.137470:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529918.137471:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55a74 lrc: 4/0,0 mode: --/PW res: [0x2c082:0x0:0x0].0x0 rrc: 3 type: EXT [0->90111] (req 0->90111) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f2db4 expref: 8 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529918.137483:0:167632:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55a6d lrc: 3/0,0 mode: PR/PR res: [0x2c082:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f2dad expref: 8 pid: 167632 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529918.137487:0:167632:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55a6d lrc: 4/0,0 mode: PR/PR res: [0x2c082:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f2dad expref: 8 pid: 167632 timeout: 20726 lvb_type: 1 00000100:00100000:0.0:1651529918.137493:0:167632:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005440bf0f pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:167632:1731745997085824:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529918.137527:0:167632:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bf0ef3c9 going to sleep for 11 seconds 00000100:00100000:1.0:1651529918.137990:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529918.138004:0:167632:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005440bf0f pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:167632:1731745997085824:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529918.138012:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55a74 lrc: 3/0,0 mode: --/PW res: [0x2c082:0x0:0x0].0x0 rrc: 3 type: EXT [0->90111] (req 0->90111) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f2db4 expref: 8 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529918.138017:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000092ad010c, rc 0) 00000100:00100000:0.0:1651529918.138033:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec96cd77-f6e5-48c2-876b-61a646cc1c34+8:450358:x1731754352881216:12345-10.240.43.64@tcp:101:cp.0 Request processed in 582us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529918.138043:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 832 00000100:00100000:0.0:1651529918.138057:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754352881280 00010000:00010000:0.0:1651529918.138063:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55a6d lrc: 4/0,0 mode: PR/PR res: [0x2c082:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f2dad expref: 8 pid: 167632 timeout: 20726 lvb_type: 1 00000100:00100000:0.0:1651529918.138072:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 0 00000100:00100000:0.0:1651529918.138074:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec96cd77-f6e5-48c2-876b-61a646cc1c34+8:438147:x1731754352881280:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529918.138077:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529918.138082:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55a6d lrc: 4/0,0 mode: PR/PR res: [0x2c082:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f2dad expref: 8 pid: 167632 timeout: 20726 lvb_type: 1 00010000:00010000:0.0:1651529918.138086:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55a6d lrc: 3/0,0 mode: PR/PR res: [0x2c082:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f2dad expref: 8 pid: 167632 timeout: 20726 lvb_type: 1 00010000:00010000:0.0:1651529918.138093:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55a6d lrc: 0/0,0 mode: --/PR res: [0x2c082:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f2dad expref: 8 pid: 167632 timeout: 20726 lvb_type: 1 00010000:00010000:0.0:1651529918.138097:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529918.138098:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529918.138100:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55a74 lrc: 2/0,0 mode: PW/PW res: [0x2c082:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f2db4 expref: 7 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529918.138103:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55a74 lrc: 3/0,0 mode: PW/PW res: [0x2c082:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f2db4 expref: 7 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529918.138112:0:166104:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55a74 lrc: 3/0,0 mode: PW/PW res: [0x2c082:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f2db4 expref: 7 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529918.138116:0:166104:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005440bf0f pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:166104:1731745997085888:10.240.43.64@tcp:105: 00000100:00100000:0.0:1651529918.138133:0:166104:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bf0ef3c9 going to sleep for 6 seconds 00000100:00100000:0.0:1651529918.138413:0:166104:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005440bf0f pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:166104:1731745997085888:10.240.43.64@tcp:105: 00010000:00010000:0.0:1651529918.138418:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529918.138432:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec96cd77-f6e5-48c2-876b-61a646cc1c34+7:438147:x1731754352881280:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 357us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529918.138435:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 0 00000100:00100000:1.0:1651529919.712164:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529919.712195:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946841536 00000100:00100000:0.0:1651529919.712232:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 4 00000100:00100000:0.0:1651529919.712235:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+305:39029:x1731745946841536:12345-10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:0.0:1651529919.712274:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+305:39029:x1731745946841536:12345-10.240.43.61@tcp:400:kworker/u4:0.0 Request processed in 39us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529919.712277:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 4 00000400:00000080:0.0:1651529921.414640:0:168336:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651529921.414642:0:168336:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 150a: truncate/append tests =============== 22:18:41 (1651529921) 00000100:00100000:1.0:1651529921.494565:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529921.494599:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353148544 00002000:00100000:0.0:1651529921.494621:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c082:0x0] (0->88199) req@000000002db8a000 x1731754353148544/t0(0) o4->ec96cd77-f6e5-48c2-876b-61a646cc1c34@10.240.43.64@tcp:652/0 lens 488/0 e 0 to 0 dl 1651529932 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cp.0' 00002000:00100000:0.0:1651529921.494627:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002db8a000 with x1731754353148544 ext(0->88199) 00002000:00010000:0.0:1651529921.494630:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000002db8a000 00000100:00100000:0.0:1651529921.494641:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 0 00000100:00100000:0.0:1651529921.494644:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002db8a000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec96cd77-f6e5-48c2-876b-61a646cc1c34+7:438148:x1731754353148544:12345-10.240.43.64@tcp:4:cp.0 00000001:00100000:1.0:1651529921.608837:0:166098:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ec96cd77-f6e5-48c2-876b-61a646cc1c34 00000001:00080000:1.0:1651529921.608842:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474837280 is committed 00000100:00100000:0.0:1651529921.621915:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002db8a000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ec96cd77-f6e5-48c2-876b-61a646cc1c34+8:438148:x1731754353148544:12345-10.240.43.64@tcp:4:cp.0 Request processed in 127269us (127352us total) trans 21474837281 rc 0/0 00000100:00100000:0.0:1651529921.621920:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 0 00002000:00100000:0.0:1651529921.621924:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c082:0x0] (0->88199) req@000000002db8a000 x1731754353148544/t21474837281(0) o4->ec96cd77-f6e5-48c2-876b-61a646cc1c34@10.240.43.64@tcp:652/0 lens 488/448 e 0 to 0 dl 1651529932 ref 1 fl Complete:/0/0 rc 0/0 job:'cp.0' 00002000:00100000:0.0:1651529921.621929:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002db8a000 with x1731754353148544 ext(0->88199) 00002000:00010000:0.0:1651529921.621930:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000002db8a000 00000100:00100000:1.0:1651529921.623087:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529921.623112:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353148608 00000100:00100000:0.0:1651529921.623126:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 0 00000100:00100000:0.0:1651529921.623128:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009f35d921 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec96cd77-f6e5-48c2-876b-61a646cc1c34+8:439094:x1731754353148608:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529921.623133:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1651529921.623138:0:166104:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2c082:0x0] updating lvb size from disk: 0 -> 88200 00002000:00010000:0.0:1651529921.623140:0:166104:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2c082:0x0] updating lvb mtime from disk: 0 -> 1651529918 00002000:00010000:0.0:1651529921.623141:0:166104:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2c082:0x0] updating lvb ctime from disk: 0 -> 1651529918 00002000:00010000:0.0:1651529921.623142:0:166104:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2c082:0x0] updating lvb blocks from disk: 0 -> 176 00010000:00010000:0.0:1651529921.623152:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55a74 lrc: 0/0,0 mode: --/PW res: [0x2c082:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->90111) gid 0 flags: 0x44801000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f2db4 expref: 8 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529921.623161:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529921.623177:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009f35d921 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec96cd77-f6e5-48c2-876b-61a646cc1c34+7:439094:x1731754353148608:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 48us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529921.623180:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 0 00000100:00100000:1.0:1651529921.760150:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529921.760174:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946841728 00000100:00100000:0.0:1651529921.760185:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 50 00000100:00100000:0.0:1651529921.760187:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946841728:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651529921.760194:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 17132224 pending 114688 free 81309134848 avail 77138423808 00000100:00100000:0.0:1651529921.760213:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946841728:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 25us (63us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529921.760216:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 50 00000100:00100000:1.0:1651529921.898971:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529921.898996:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353149632 00000100:00100000:0.0:1651529921.899011:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 833 00000100:00100000:0.0:1651529921.899013:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec96cd77-f6e5-48c2-876b-61a646cc1c34+7:451137:x1731754353149632:12345-10.240.43.64@tcp:9:umount.0 00000020:00000080:0.0:1651529921.899022:0:167632:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0x3234de053c55a66 00000100:00080000:0.0:1651529921.899025:0:167632:0:(import.c:85:import_set_state_nolock()) 000000005a6b7f5e ¶×à”ÿÿ: changing import state from FULL to CLOSED 00000001:00000004:0.0:1651529921.899052:0:167632:0:(tgt_lastrcvd.c:701:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 5, last_transno is 21474837281 00000100:00100000:0.0:1651529921.899093:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec96cd77-f6e5-48c2-876b-61a646cc1c34+4:451137:x1731754353149632:12345-10.240.43.64@tcp:9:umount.0 Request processed in 79us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529921.899096:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 833 00000100:00100000:1.0:1651529921.988156:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529921.988178:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353154368 00000100:00100000:0.0:1651529921.988190:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 834 00000100:00100000:0.0:1651529921.988191:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:438145:x1731754353154368:12345-10.240.43.64@tcp:8:mount.lustre.0 00010000:00080000:0.0:1651529921.988200:0:167632:0:(ldlm_lib.c:1365:target_handle_connect()) lustre-OST0001: connection from cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp t0 exp 0000000055bfac58 cur 20580 last 0 00000020:00000080:0.0:1651529921.988218:0:167632:0:(genops.c:1359:class_connect()) connect: client cccc371e-feb6-4a45-b229-8d88a861b48a, cookie 0x3234de053c55a7b 00002000:00100000:0.0:1651529921.988221:0:167632:0:(ofd_obd.c:150:ofd_parse_connect_data()) lustre-OST0001: cli cccc371e-feb6-4a45-b229-8d88a861b48a/000000006d60c1ab ocd_connect_flags: 0xa0465af2e3640078 ocd_version: 20f0000 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1651529921.988236:0:167632:0:(ofd_obd.c:249:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000020:01000000:0.0:1651529921.988248:0:167632:0:(lprocfs_status_server.c:544:lprocfs_exp_setup()) using hash 00000000427049c0 00002000:00080000:0.0:1651529921.988251:0:167632:0:(ofd_obd.c:391:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1651529921.988260:0:167632:0:(import.c:85:import_set_state_nolock()) 000000000934284c ¶×à”ÿÿ: changing import state from RECOVER to FULL 00000100:00100000:0.0:1651529921.988279:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438145:x1731754353154368:12345-10.240.43.64@tcp:8:mount.lustre.0 Request processed in 86us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529921.988282:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 834 00000100:00100000:1.0:1651529922.021116:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529922.021139:0:166115:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353154688 00000100:00100000:0.0:1651529922.021149:0:166115:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 51 00000100:00100000:0.0:1651529922.021151:0:166115:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000035f3f4bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cccc371e-feb6-4a45-b229-8d88a861b48a+6:451194:x1731754353154688:12345-10.240.43.64@tcp:13:df.0 00002000:00000024:0.0:1651529922.021155:0:166115:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8809152 pending 114688 free 81309134848 avail 77138423808 00000100:00100000:0.0:1651529922.021176:0:166115:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000035f3f4bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cccc371e-feb6-4a45-b229-8d88a861b48a+6:451194:x1731754353154688:12345-10.240.43.64@tcp:13:df.0 Request processed in 25us (60us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529922.021179:0:166115:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 51 00000100:00100000:1.0:1651529926.880216:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529926.880250:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946842176 00000100:00100000:0.0:1651529926.880276:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 52 00000100:00100000:0.0:1651529926.880278:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946842176:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651529926.880297:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8809152 pending 114688 free 81309044736 avail 77138333696 00000100:00100000:0.0:1651529926.880330:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946842176:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 51us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529926.880333:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 52 00000001:00100000:1.0:1651529927.318009:0:166098:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cccc371e-feb6-4a45-b229-8d88a861b48a 00000001:00100000:1.0:1651529927.318012:0:166098:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ec96cd77-f6e5-48c2-876b-61a646cc1c34 00000001:00080000:1.0:1651529927.318015:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474837281 is committed 00000020:00000080:1.0:1651529927.318018:0:166098:0:(genops.c:985:class_export_put()) final put 00000000d61107c9/ec96cd77-f6e5-48c2-876b-61a646cc1c34 00000020:00000080:0.0:1651529927.318039:0:153568:0:(genops.c:944:class_export_destroy()) destroying export 00000000d61107c9/ec96cd77-f6e5-48c2-876b-61a646cc1c34 for lustre-OST0001 00000020:00000080:0.0:1651529927.318069:0:153568:0:(genops.c:1164:obd_zombie_import_free()) destroying import 000000005a6b7f5e for lustre-OST0001 00000100:00100000:1.0:1651529932.000181:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529932.000213:0:166115:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946842368 00000100:00100000:0.0:1651529932.000250:0:166115:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 53 00000100:00100000:0.0:1651529932.000253:0:166115:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017e3b33f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946842368:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651529932.000271:0:166115:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8694464 pending 0 free 81309044736 avail 77138333696 00000100:00100000:0.0:1651529932.000304:0:166115:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017e3b33f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946842368:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 51us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529932.000308:0:166115:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 53 00000400:00000080:1.0:1651529932.905820:0:168554:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651529932.905823:0:168554:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 150b: Verify fallocate (prealloc) functionality ========================================================== 22:18:52 (1651529932) 00000100:00100000:1.0:1651529933.159476:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529933.159507:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353159168 00000100:00100000:0.0:1651529933.159533:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 835 00000100:00100000:0.0:1651529933.159535:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e30915ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+5:438147:x1731754353159168:12345-10.240.43.64@tcp:2:touch.0 00000100:00100000:0.0:1651529933.159647:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e30915ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438147:x1731754353159168:12345-10.240.43.64@tcp:2:touch.0 Request processed in 111us (174us total) trans 21474837282 rc 0/0 00000100:00100000:0.0:1651529933.159651:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 835 00000100:00100000:1.0:1651529933.167675:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529933.167697:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353159616 00000100:00100000:0.0:1651529933.167709:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 836 00000100:00100000:0.0:1651529933.167711:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c782cfa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438147:x1731754353159616:12345-10.240.43.64@tcp:101:check_fallocate.0 00010000:00010000:0.0:1651529933.167716:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529933.167725:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55a82 lrc: 2/0,0 mode: --/PR res: [0x2c083:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db2f783e expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651529933.167733:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c083:0x0] initial LVB size: 0, mtime: 0x627058cd, atime: 0x627058cd, ctime: 0x627058cd, blocks: 0x0 00010000:00010000:0.0:1651529933.167741:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529933.167742:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529933.167746:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55a82 lrc: 3/0,0 mode: PR/PR res: [0x2c083:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f783e expref: 7 pid: 167632 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529933.167754:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55a82 lrc: 3/0,0 mode: PR/PR res: [0x2c083:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f783e expref: 7 pid: 167632 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529933.167760:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000092ad010c, rc 0) 00000100:00100000:0.0:1651529933.167776:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c782cfa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438147:x1731754353159616:12345-10.240.43.64@tcp:101:check_fallocate.0 Request processed in 64us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529933.167779:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 836 00000100:00100000:1.0:1651529933.171188:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529933.171211:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353159680 00000100:00100000:0.0:1651529933.171233:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 837 00000100:00100000:0.0:1651529933.171235:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000da591860 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+7:452246:x1731754353159680:12345-10.240.43.64@tcp:101:check_fallocate.0 00010000:00010000:0.0:1651529933.171238:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651529933.171242:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55a89 lrc: 2/0,0 mode: --/PW res: [0x2c083:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db2f7845 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529933.171250:0:167632:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55a82 lrc: 2/0,0 mode: PR/PR res: [0x2c083:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f783e expref: 8 pid: 167632 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529933.171254:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529933.171254:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529933.171255:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55a89 lrc: 4/0,0 mode: --/PW res: [0x2c083:0x0:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7845 expref: 8 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529933.171268:0:167632:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55a82 lrc: 3/0,0 mode: PR/PR res: [0x2c083:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f783e expref: 8 pid: 167632 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651529933.171273:0:167632:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55a82 lrc: 4/0,0 mode: PR/PR res: [0x2c083:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f783e expref: 8 pid: 167632 timeout: 20741 lvb_type: 1 00000100:00100000:0.0:1651529933.171278:0:167632:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005440bf0f pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:167632:1731745997085952:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529933.171303:0:167632:0:(client.c:2492:ptlrpc_set_wait()) set 000000007336a63a going to sleep for 11 seconds 00000100:00100000:0.0:1651529933.171518:0:167632:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005440bf0f pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:167632:1731745997085952:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529933.171526:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55a89 lrc: 3/0,0 mode: --/PW res: [0x2c083:0x0:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7845 expref: 8 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529933.171531:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b1b8f74, rc 0) 00000100:00100000:0.0:1651529933.171544:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000da591860 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+8:452246:x1731754353159680:12345-10.240.43.64@tcp:101:check_fallocate.0 Request processed in 309us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529933.171558:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 837 00000100:00100000:1.0:1651529933.171583:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529933.171595:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353159744 00010000:00010000:0.0:1651529933.171601:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55a82 lrc: 4/0,0 mode: PR/PR res: [0x2c083:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f783e expref: 8 pid: 167632 timeout: 20741 lvb_type: 1 00000100:00100000:0.0:1651529933.171611:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1 00000100:00100000:0.0:1651529933.171612:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005590f790 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438149:x1731754353159744:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529933.171616:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529933.171620:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55a82 lrc: 4/0,0 mode: PR/PR res: [0x2c083:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f783e expref: 8 pid: 167632 timeout: 20741 lvb_type: 1 00010000:00010000:0.0:1651529933.171625:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55a82 lrc: 3/0,0 mode: PR/PR res: [0x2c083:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f783e expref: 8 pid: 167632 timeout: 20741 lvb_type: 1 00010000:00010000:0.0:1651529933.171632:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55a82 lrc: 0/0,0 mode: --/PR res: [0x2c083:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f783e expref: 8 pid: 167632 timeout: 20741 lvb_type: 1 00010000:00010000:0.0:1651529933.171636:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529933.171637:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529933.171639:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55a89 lrc: 2/0,0 mode: PW/PW res: [0x2c083:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7845 expref: 7 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529933.171646:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55a89 lrc: 3/0,0 mode: PW/PW res: [0x2c083:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7845 expref: 7 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529933.171654:0:166103:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55a89 lrc: 3/0,0 mode: PW/PW res: [0x2c083:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7845 expref: 7 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529933.171658:0:166103:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005440bf0f pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:166103:1731745997086016:10.240.43.64@tcp:105: 00000100:00100000:0.0:1651529933.171676:0:166103:0:(client.c:2492:ptlrpc_set_wait()) set 000000007336a63a going to sleep for 6 seconds 00000100:00100000:0.0:1651529933.171928:0:166103:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005440bf0f pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:166103:1731745997086016:10.240.43.64@tcp:105: 00010000:00010000:0.0:1651529933.171933:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529933.171945:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005590f790 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438149:x1731754353159744:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 332us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529933.171948:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1 00000100:00100000:1.0:1651529933.190385:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529933.190409:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353159936 00002000:00100000:0.0:1651529933.190419:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (0->4194303) req@0000000073bc121d x1731754353159936/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:664/0 lens 488/0 e 0 to 0 dl 1651529944 ref 1 fl New:/0/ffffffff rc 0/-1 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.190425:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000073bc121d with x1731754353159936 ext(0->4194303) 00002000:00010000:0.0:1651529933.190427:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000073bc121d 00000100:00100000:0.0:1651529933.190434:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1 00000100:00100000:0.0:1651529933.190435:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000073bc121d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438146:x1731754353159936:12345-10.240.43.64@tcp:4:check_fallocate.0 00000100:00100000:0.0:1651529933.204062:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000073bc121d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438146:x1731754353159936:12345-10.240.43.64@tcp:4:check_fallocate.0 Request processed in 13623us (13675us total) trans 21474837283 rc 0/0 00000100:00100000:0.0:1651529933.204068:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1 00002000:00100000:0.0:1651529933.204073:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (0->4194303) req@0000000073bc121d x1731754353159936/t21474837283(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:664/0 lens 488/448 e 0 to 0 dl 1651529944 ref 1 fl Complete:/0/0 rc 0/0 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.204078:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000073bc121d with x1731754353159936 ext(0->4194303) 00002000:00010000:0.0:1651529933.204080:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000073bc121d 00000100:00100000:1.0:1651529933.210395:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529933.210419:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353160064 00002000:00100000:0.0:1651529933.210430:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (4194304->8388607) req@00000000da71a327 x1731754353160064/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/0 e 0 to 0 dl 1651529939 ref 1 fl New:/0/ffffffff rc 0/-1 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.210434:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000da71a327 with x1731754353160064 ext(4194304->8388607) 00002000:00010000:0.0:1651529933.210436:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000da71a327 00000100:00100000:0.0:1651529933.210443:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2 00000100:00100000:0.0:1651529933.210445:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000da71a327 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438148:x1731754353160064:12345-10.240.43.64@tcp:4:check_fallocate.0 00000100:00100000:0.0:1651529933.216253:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000da71a327 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+11:438148:x1731754353160064:12345-10.240.43.64@tcp:4:check_fallocate.0 Request processed in 5805us (5857us total) trans 21474837284 rc 0/0 00000100:00100000:0.0:1651529933.216259:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2 00002000:00100000:0.0:1651529933.216263:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (4194304->8388607) req@00000000da71a327 x1731754353160064/t21474837284(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/448 e 0 to 0 dl 1651529939 ref 1 fl Complete:/0/0 rc 0/0 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.216267:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000da71a327 with x1731754353160064 ext(4194304->8388607) 00002000:00010000:0.0:1651529933.216269:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000da71a327 00000100:00100000:1.0:1651529933.236842:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529933.236865:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353160192 00002000:00100000:0.0:1651529933.236875:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (8388608->12582911) req@000000003a823031 x1731754353160192/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/0 e 0 to 0 dl 1651529939 ref 1 fl New:/0/ffffffff rc 0/-1 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.236879:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003a823031 with x1731754353160192 ext(8388608->12582911) 00002000:00010000:0.0:1651529933.236880:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000003a823031 00000100:00100000:0.0:1651529933.236888:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3 00000100:00100000:0.0:1651529933.236890:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003a823031 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+11:438148:x1731754353160192:12345-10.240.43.64@tcp:4:check_fallocate.0 00000100:00100000:0.0:1651529933.248970:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003a823031 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+13:438148:x1731754353160192:12345-10.240.43.64@tcp:4:check_fallocate.0 Request processed in 12078us (12127us total) trans 21474837285 rc 0/0 00000100:00100000:0.0:1651529933.248975:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3 00002000:00100000:0.0:1651529933.248980:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (8388608->12582911) req@000000003a823031 x1731754353160192/t21474837285(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/448 e 0 to 0 dl 1651529939 ref 1 fl Complete:/0/0 rc 0/0 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.248984:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003a823031 with x1731754353160192 ext(8388608->12582911) 00002000:00010000:0.0:1651529933.248987:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000003a823031 00000100:00100000:1.0:1651529933.255750:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529933.255773:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353160320 00002000:00100000:0.0:1651529933.255783:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (12582912->16777215) req@000000002133b09c x1731754353160320/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/0 e 0 to 0 dl 1651529939 ref 1 fl New:/0/ffffffff rc 0/-1 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.255787:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002133b09c with x1731754353160320 ext(12582912->16777215) 00002000:00010000:0.0:1651529933.255788:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000002133b09c 00000100:00100000:0.0:1651529933.255799:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4 00000100:00100000:0.0:1651529933.255801:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002133b09c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+13:438148:x1731754353160320:12345-10.240.43.64@tcp:4:check_fallocate.0 00000100:00100000:0.0:1651529933.260872:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002133b09c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+15:438148:x1731754353160320:12345-10.240.43.64@tcp:4:check_fallocate.0 Request processed in 5069us (5122us total) trans 21474837286 rc 0/0 00000100:00100000:0.0:1651529933.260877:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4 00002000:00100000:0.0:1651529933.260881:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (12582912->16777215) req@000000002133b09c x1731754353160320/t21474837286(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/448 e 0 to 0 dl 1651529939 ref 1 fl Complete:/0/0 rc 0/0 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.260885:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002133b09c with x1731754353160320 ext(12582912->16777215) 00002000:00010000:0.0:1651529933.260887:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000002133b09c 00000100:00100000:1.0:1651529933.280852:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529933.280874:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353160448 00002000:00100000:0.0:1651529933.280883:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (16777216->20971519) req@000000001e2d7e40 x1731754353160448/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/0 e 0 to 0 dl 1651529939 ref 1 fl New:/0/ffffffff rc 0/-1 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.280887:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001e2d7e40 with x1731754353160448 ext(16777216->20971519) 00002000:00010000:0.0:1651529933.280889:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000001e2d7e40 00000100:00100000:0.0:1651529933.280898:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5 00000100:00100000:0.0:1651529933.280900:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001e2d7e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+15:438148:x1731754353160448:12345-10.240.43.64@tcp:4:check_fallocate.0 00000100:00100000:0.0:1651529933.293487:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001e2d7e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+17:438148:x1731754353160448:12345-10.240.43.64@tcp:4:check_fallocate.0 Request processed in 12584us (12634us total) trans 21474837287 rc 0/0 00000100:00100000:0.0:1651529933.293493:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5 00002000:00100000:0.0:1651529933.293497:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (16777216->20971519) req@000000001e2d7e40 x1731754353160448/t21474837287(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/448 e 0 to 0 dl 1651529939 ref 1 fl Complete:/0/0 rc 0/0 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.293502:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001e2d7e40 with x1731754353160448 ext(16777216->20971519) 00002000:00010000:0.0:1651529933.293504:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000001e2d7e40 00000100:00100000:1.0:1651529933.309406:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529933.309430:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353160576 00002000:00100000:0.0:1651529933.309442:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (20971520->25165823) req@00000000236a2bac x1731754353160576/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/0 e 0 to 0 dl 1651529939 ref 1 fl New:/0/ffffffff rc 0/-1 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.309446:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000236a2bac with x1731754353160576 ext(20971520->25165823) 00002000:00010000:0.0:1651529933.309447:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000236a2bac 00000100:00100000:0.0:1651529933.309458:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6 00000100:00100000:0.0:1651529933.309460:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000236a2bac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+17:438148:x1731754353160576:12345-10.240.43.64@tcp:4:check_fallocate.0 00000100:00100000:0.0:1651529933.317333:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000236a2bac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+19:438148:x1731754353160576:12345-10.240.43.64@tcp:4:check_fallocate.0 Request processed in 7870us (7926us total) trans 21474837288 rc 0/0 00000100:00100000:0.0:1651529933.317338:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6 00002000:00100000:0.0:1651529933.317342:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (20971520->25165823) req@00000000236a2bac x1731754353160576/t21474837288(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/448 e 0 to 0 dl 1651529939 ref 1 fl Complete:/0/0 rc 0/0 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.317347:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000236a2bac with x1731754353160576 ext(20971520->25165823) 00002000:00010000:0.0:1651529933.317349:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000236a2bac 00000100:00100000:1.0:1651529933.335380:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529933.335402:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353160704 00002000:00100000:0.0:1651529933.335412:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (25165824->29360127) req@000000004e27828d x1731754353160704/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/0 e 0 to 0 dl 1651529939 ref 1 fl New:/0/ffffffff rc 0/-1 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.335416:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004e27828d with x1731754353160704 ext(25165824->29360127) 00002000:00010000:0.0:1651529933.335417:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000004e27828d 00000100:00100000:0.0:1651529933.335428:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 7 00000100:00100000:0.0:1651529933.335430:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004e27828d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+19:438148:x1731754353160704:12345-10.240.43.64@tcp:4:check_fallocate.0 00000100:00100000:0.0:1651529933.341756:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004e27828d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+21:438148:x1731754353160704:12345-10.240.43.64@tcp:4:check_fallocate.0 Request processed in 6325us (6376us total) trans 21474837289 rc 0/0 00000100:00100000:0.0:1651529933.341761:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 7 00002000:00100000:0.0:1651529933.341765:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (25165824->29360127) req@000000004e27828d x1731754353160704/t21474837289(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/448 e 0 to 0 dl 1651529939 ref 1 fl Complete:/0/0 rc 0/0 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.341769:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004e27828d with x1731754353160704 ext(25165824->29360127) 00002000:00010000:0.0:1651529933.341771:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000004e27828d 00000100:00100000:1.0:1651529933.353719:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529933.353740:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353160832 00002000:00100000:0.0:1651529933.353749:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (29360128->33554431) req@00000000fbfcbb60 x1731754353160832/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/0 e 0 to 0 dl 1651529939 ref 1 fl New:/0/ffffffff rc 0/-1 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.353753:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000fbfcbb60 with x1731754353160832 ext(29360128->33554431) 00002000:00010000:0.0:1651529933.353754:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000fbfcbb60 00000100:00100000:0.0:1651529933.353765:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 8 00000100:00100000:0.0:1651529933.353767:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fbfcbb60 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+21:438148:x1731754353160832:12345-10.240.43.64@tcp:4:check_fallocate.0 00000100:00100000:0.0:1651529933.359916:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fbfcbb60 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+23:438148:x1731754353160832:12345-10.240.43.64@tcp:4:check_fallocate.0 Request processed in 6146us (6196us total) trans 21474837290 rc 0/0 00000100:00100000:0.0:1651529933.359921:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 8 00002000:00100000:0.0:1651529933.359924:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (29360128->33554431) req@00000000fbfcbb60 x1731754353160832/t21474837290(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/448 e 0 to 0 dl 1651529939 ref 1 fl Complete:/0/0 rc 0/0 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.359928:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000fbfcbb60 with x1731754353160832 ext(29360128->33554431) 00002000:00010000:0.0:1651529933.359931:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000fbfcbb60 00000100:00100000:1.0:1651529933.384418:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529933.384439:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353160960 00002000:00100000:0.0:1651529933.384448:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (33554432->37748735) req@00000000fe07abd6 x1731754353160960/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/0 e 0 to 0 dl 1651529939 ref 1 fl New:/0/ffffffff rc 0/-1 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.384452:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000fe07abd6 with x1731754353160960 ext(33554432->37748735) 00002000:00010000:0.0:1651529933.384453:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000fe07abd6 00000100:00100000:0.0:1651529933.384464:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 9 00000100:00100000:0.0:1651529933.384466:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe07abd6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+23:438148:x1731754353160960:12345-10.240.43.64@tcp:4:check_fallocate.0 00000100:00100000:0.0:1651529933.391652:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe07abd6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+25:438148:x1731754353160960:12345-10.240.43.64@tcp:4:check_fallocate.0 Request processed in 7184us (7233us total) trans 21474837291 rc 0/0 00000100:00100000:0.0:1651529933.391656:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 9 00002000:00100000:0.0:1651529933.391660:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (33554432->37748735) req@00000000fe07abd6 x1731754353160960/t21474837291(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/448 e 0 to 0 dl 1651529939 ref 1 fl Complete:/0/0 rc 0/0 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.391664:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000fe07abd6 with x1731754353160960 ext(33554432->37748735) 00002000:00010000:0.0:1651529933.391666:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000fe07abd6 00000100:00100000:1.0:1651529933.398700:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529933.398717:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529933.398729:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353161152 00000100:00100000:1.0:1651529933.398736:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353161088 00002000:00100000:0.0:1651529933.398741:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (37748736->41943039) req@00000000b3e6d6ec x1731754353161152/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/0 e 0 to 0 dl 1651529939 ref 1 fl New:/0/ffffffff rc 0/-1 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.398745:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b3e6d6ec with x1731754353161152 ext(37748736->41943039) 00002000:00010000:0.0:1651529933.398747:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000b3e6d6ec 00000100:00100000:1.0:1651529933.398750:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 838 00000100:00100000:0.0:1651529933.398756:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10 00000100:00100000:1.0:1651529933.398758:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059681820 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+26:438148:x1731754353161088:12345-10.240.43.64@tcp:22:check_fallocate.0 00000100:00100000:0.0:1651529933.398758:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b3e6d6ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+26:438148:x1731754353161152:12345-10.240.43.64@tcp:4:check_fallocate.0 00002000:00010000:1.0:1651529933.399321:0:167632:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2c083:0x0] updating lvb size from disk: 0 -> 46137344 00002000:00010000:1.0:1651529933.399323:0:167632:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2c083:0x0] updating lvb mtime from disk: 1651529933 -> 1651529933 00002000:00010000:1.0:1651529933.399324:0:167632:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2c083:0x0] updating lvb atime from disk: 1651529933 -> 1651529933 00002000:00010000:1.0:1651529933.399325:0:167632:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2c083:0x0] updating lvb ctime from disk: 1651529933 -> 1651529933 00002000:00010000:1.0:1651529933.399326:0:167632:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2c083:0x0] updating lvb blocks from disk: 0 -> 81920 00000100:00100000:1.0:1651529933.399350:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059681820 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+28:438148:x1731754353161088:12345-10.240.43.64@tcp:22:check_fallocate.0 Request processed in 591us (632us total) trans 21474837292 rc 0/0 00000100:00100000:1.0:1651529933.399354:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 838 00000100:00100000:0.0:1651529933.405484:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b3e6d6ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+28:438148:x1731754353161152:12345-10.240.43.64@tcp:4:check_fallocate.0 Request processed in 6723us (6782us total) trans 21474837293 rc 0/0 00000100:00100000:0.0:1651529933.405489:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10 00002000:00100000:0.0:1651529933.405493:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (37748736->41943039) req@00000000b3e6d6ec x1731754353161152/t21474837293(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/448 e 0 to 0 dl 1651529939 ref 1 fl Complete:/0/0 rc 0/0 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.405497:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b3e6d6ec with x1731754353161152 ext(37748736->41943039) 00002000:00010000:0.0:1651529933.405499:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000b3e6d6ec 00000100:00100000:1.0:1651529933.406075:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529933.406095:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353161344 00002000:00010000:0.0:1651529933.406103:0:166118:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 180355/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529933.406104:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000059e5b3a2 with x1731754353161344 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529933.406109:0:166118:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000059e5b3a2. 00000100:00100000:0.0:1651529933.406121:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11 00000100:00100000:0.0:1651529933.406123:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059e5b3a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+28:438149:x1731754353161344:12345-10.240.43.64@tcp:10:check_fallocate.0 00002000:00010000:0.0:1651529933.409186:0:166118:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2c083:0x0] updating lvb size from disk: 46137344 -> 0 00002000:00010000:0.0:1651529933.409188:0:166118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2c083:0x0] updating lvb mtime from disk: 1651529933 -> 1651529933 00002000:00010000:0.0:1651529933.409189:0:166118:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2c083:0x0] updating lvb atime from disk: 1651529933 -> 1651529933 00002000:00010000:0.0:1651529933.409190:0:166118:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2c083:0x0] updating lvb ctime from disk: 1651529933 -> 1651529933 00002000:00010000:0.0:1651529933.409191:0:166118:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2c083:0x0] updating lvb blocks from disk: 81920 -> 0 00000100:00100000:0.0:1651529933.409205:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059e5b3a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+29:438149:x1731754353161344:12345-10.240.43.64@tcp:10:check_fallocate.0 Request processed in 3081us (3131us total) trans 21474837294 rc 0/0 00000100:00100000:0.0:1651529933.409209:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11 00002000:00010000:0.0:1651529933.409210:0:166118:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 180355/0 (0->18446744073709551615) 00002000:00100000:0.0:1651529933.409211:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000059e5b3a2 with x1731754353161344 ext(0->18446744073709551615) 00002000:00010000:0.0:1651529933.409213:0:166118:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000059e5b3a2. 00000100:00100000:1.0:1651529933.440406:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529933.440430:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353161472 00002000:00100000:0.0:1651529933.440441:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (0->4194303) req@000000006e255cae x1731754353161472/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/0 e 0 to 0 dl 1651529939 ref 1 fl New:/0/ffffffff rc 0/-1 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.440445:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006e255cae with x1731754353161472 ext(0->4194303) 00002000:00010000:0.0:1651529933.440447:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000006e255cae 00000100:00100000:0.0:1651529933.440457:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12 00000100:00100000:0.0:1651529933.440459:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+29:438148:x1731754353161472:12345-10.240.43.64@tcp:4:check_fallocate.0 00000100:00100000:0.0:1651529933.452238:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+31:438148:x1731754353161472:12345-10.240.43.64@tcp:4:check_fallocate.0 Request processed in 11776us (11830us total) trans 21474837295 rc 0/0 00000100:00100000:0.0:1651529933.452244:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12 00002000:00100000:0.0:1651529933.452249:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (0->4194303) req@000000006e255cae x1731754353161472/t21474837295(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/448 e 0 to 0 dl 1651529939 ref 1 fl Complete:/0/0 rc 0/0 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.452253:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006e255cae with x1731754353161472 ext(0->4194303) 00002000:00010000:0.0:1651529933.452256:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000006e255cae 00000100:00100000:0.0:1651529933.471839:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529933.471848:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353161600 00002000:00100000:0.0:1651529933.471859:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (4194304->8388607) req@000000005440bf0f x1731754353161600/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/0 e 0 to 0 dl 1651529939 ref 1 fl New:/0/ffffffff rc 0/-1 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.471866:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005440bf0f with x1731754353161600 ext(4194304->8388607) 00002000:00010000:0.0:1651529933.471867:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000005440bf0f 00000100:00100000:0.0:1651529933.471880:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13 00000100:00100000:0.0:1651529933.471882:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005440bf0f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+31:438148:x1731754353161600:12345-10.240.43.64@tcp:4:check_fallocate.0 00000100:00100000:0.0:1651529933.483796:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005440bf0f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+33:438148:x1731754353161600:12345-10.240.43.64@tcp:4:check_fallocate.0 Request processed in 11911us (11956us total) trans 21474837296 rc 0/0 00000100:00100000:0.0:1651529933.483802:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13 00002000:00100000:0.0:1651529933.483807:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (4194304->8388607) req@000000005440bf0f x1731754353161600/t21474837296(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/448 e 0 to 0 dl 1651529939 ref 1 fl Complete:/0/0 rc 0/0 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.483811:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005440bf0f with x1731754353161600 ext(4194304->8388607) 00002000:00010000:0.0:1651529933.483814:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000005440bf0f 00000100:00100000:0.0:1651529933.500414:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529933.500424:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353161728 00002000:00100000:0.0:1651529933.500434:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (8388608->12582911) req@0000000078f9a278 x1731754353161728/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/0 e 0 to 0 dl 1651529939 ref 1 fl New:/0/ffffffff rc 0/-1 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.500439:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000078f9a278 with x1731754353161728 ext(8388608->12582911) 00002000:00010000:0.0:1651529933.500440:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000078f9a278 00000100:00100000:0.0:1651529933.500452:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 14 00000100:00100000:0.0:1651529933.500454:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+33:438148:x1731754353161728:12345-10.240.43.64@tcp:4:check_fallocate.0 00000100:00100000:0.0:1651529933.506062:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078f9a278 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+35:438148:x1731754353161728:12345-10.240.43.64@tcp:4:check_fallocate.0 Request processed in 5605us (5647us total) trans 21474837297 rc 0/0 00000100:00100000:0.0:1651529933.506068:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 14 00002000:00100000:0.0:1651529933.506072:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (8388608->12582911) req@0000000078f9a278 x1731754353161728/t21474837297(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/448 e 0 to 0 dl 1651529939 ref 1 fl Complete:/0/0 rc 0/0 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.506076:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000078f9a278 with x1731754353161728 ext(8388608->12582911) 00002000:00010000:0.0:1651529933.506078:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000078f9a278 00000100:00100000:1.0:1651529933.524838:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529933.524862:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353161856 00002000:00100000:0.0:1651529933.524872:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (12582912->16777215) req@00000000c0b460ab x1731754353161856/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/0 e 0 to 0 dl 1651529939 ref 1 fl New:/0/ffffffff rc 0/-1 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.524876:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c0b460ab with x1731754353161856 ext(12582912->16777215) 00002000:00010000:0.0:1651529933.524877:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000c0b460ab 00000100:00100000:0.0:1651529933.524887:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15 00000100:00100000:0.0:1651529933.524889:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c0b460ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+35:438148:x1731754353161856:12345-10.240.43.64@tcp:4:check_fallocate.0 00000100:00100000:0.0:1651529933.530385:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c0b460ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+37:438148:x1731754353161856:12345-10.240.43.64@tcp:4:check_fallocate.0 Request processed in 5493us (5546us total) trans 21474837298 rc 0/0 00000100:00100000:0.0:1651529933.530390:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15 00002000:00100000:0.0:1651529933.530394:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (12582912->16777215) req@00000000c0b460ab x1731754353161856/t21474837298(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/448 e 0 to 0 dl 1651529939 ref 1 fl Complete:/0/0 rc 0/0 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.530398:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c0b460ab with x1731754353161856 ext(12582912->16777215) 00002000:00010000:0.0:1651529933.530400:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000c0b460ab 00000100:00100000:0.0:1651529933.543395:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529933.543405:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353161984 00002000:00100000:0.0:1651529933.543414:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (16777216->20971519) req@000000004a6776b5 x1731754353161984/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/0 e 0 to 0 dl 1651529939 ref 1 fl New:/0/ffffffff rc 0/-1 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.543418:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004a6776b5 with x1731754353161984 ext(16777216->20971519) 00002000:00010000:0.0:1651529933.543419:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000004a6776b5 00000100:00100000:0.0:1651529933.543431:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 16 00000100:00100000:0.0:1651529933.543433:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+37:438148:x1731754353161984:12345-10.240.43.64@tcp:4:check_fallocate.0 00000100:00100000:0.0:1651529933.549005:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a6776b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+39:438148:x1731754353161984:12345-10.240.43.64@tcp:4:check_fallocate.0 Request processed in 5569us (5609us total) trans 21474837299 rc 0/0 00000100:00100000:0.0:1651529933.549010:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 16 00002000:00100000:0.0:1651529933.549013:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (16777216->20971519) req@000000004a6776b5 x1731754353161984/t21474837299(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/448 e 0 to 0 dl 1651529939 ref 1 fl Complete:/0/0 rc 0/0 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.549018:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004a6776b5 with x1731754353161984 ext(16777216->20971519) 00002000:00010000:0.0:1651529933.549020:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000004a6776b5 00000100:00100000:0.0:1651529933.563373:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529933.563382:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353162112 00002000:00100000:0.0:1651529933.563390:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (20971520->25165823) req@0000000014f8af45 x1731754353162112/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/0 e 0 to 0 dl 1651529939 ref 1 fl New:/0/ffffffff rc 0/-1 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.563394:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000014f8af45 with x1731754353162112 ext(20971520->25165823) 00002000:00010000:0.0:1651529933.563395:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000014f8af45 00000100:00100000:0.0:1651529933.563406:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 17 00000100:00100000:0.0:1651529933.563408:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+39:438148:x1731754353162112:12345-10.240.43.64@tcp:4:check_fallocate.0 00000100:00100000:0.0:1651529933.568904:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000014f8af45 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+41:438148:x1731754353162112:12345-10.240.43.64@tcp:4:check_fallocate.0 Request processed in 5493us (5529us total) trans 21474837300 rc 0/0 00000100:00100000:0.0:1651529933.568909:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 17 00002000:00100000:0.0:1651529933.568914:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (20971520->25165823) req@0000000014f8af45 x1731754353162112/t21474837300(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/448 e 0 to 0 dl 1651529939 ref 1 fl Complete:/0/0 rc 0/0 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.568919:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000014f8af45 with x1731754353162112 ext(20971520->25165823) 00002000:00010000:0.0:1651529933.568921:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000014f8af45 00000100:00100000:0.0:1651529933.587371:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529933.587381:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353162240 00002000:00100000:0.0:1651529933.587390:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (25165824->29360127) req@00000000ea0220b6 x1731754353162240/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/0 e 0 to 0 dl 1651529939 ref 1 fl New:/0/ffffffff rc 0/-1 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.587395:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ea0220b6 with x1731754353162240 ext(25165824->29360127) 00002000:00010000:0.0:1651529933.587396:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000ea0220b6 00000100:00100000:0.0:1651529933.587407:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18 00000100:00100000:0.0:1651529933.587409:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+41:438148:x1731754353162240:12345-10.240.43.64@tcp:4:check_fallocate.0 00000100:00100000:0.0:1651529933.592796:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea0220b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+43:438148:x1731754353162240:12345-10.240.43.64@tcp:4:check_fallocate.0 Request processed in 5385us (5424us total) trans 21474837301 rc 0/0 00000100:00100000:0.0:1651529933.592802:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18 00002000:00100000:0.0:1651529933.592805:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (25165824->29360127) req@00000000ea0220b6 x1731754353162240/t21474837301(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/448 e 0 to 0 dl 1651529939 ref 1 fl Complete:/0/0 rc 0/0 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.592809:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ea0220b6 with x1731754353162240 ext(25165824->29360127) 00002000:00010000:0.0:1651529933.592811:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000ea0220b6 00000100:00100000:0.0:1651529933.612382:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529933.612391:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353162368 00002000:00100000:0.0:1651529933.612399:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (29360128->33554431) req@0000000089d7f5d6 x1731754353162368/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/0 e 0 to 0 dl 1651529939 ref 1 fl New:/0/ffffffff rc 0/-1 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.612403:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000089d7f5d6 with x1731754353162368 ext(29360128->33554431) 00002000:00010000:0.0:1651529933.612405:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000089d7f5d6 00000100:00100000:0.0:1651529933.612416:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 19 00000100:00100000:0.0:1651529933.612417:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+43:438148:x1731754353162368:12345-10.240.43.64@tcp:4:check_fallocate.0 00000100:00100000:0.0:1651529933.617937:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089d7f5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+45:438148:x1731754353162368:12345-10.240.43.64@tcp:4:check_fallocate.0 Request processed in 5518us (5554us total) trans 21474837302 rc 0/0 00000100:00100000:0.0:1651529933.617942:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 19 00002000:00100000:0.0:1651529933.617945:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (29360128->33554431) req@0000000089d7f5d6 x1731754353162368/t21474837302(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/448 e 0 to 0 dl 1651529939 ref 1 fl Complete:/0/0 rc 0/0 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.617950:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000089d7f5d6 with x1731754353162368 ext(29360128->33554431) 00002000:00010000:0.0:1651529933.617952:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000089d7f5d6 00000100:00100000:0.0:1651529933.636373:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529933.636382:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353162496 00002000:00100000:0.0:1651529933.636390:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (33554432->37748735) req@000000002a957ba7 x1731754353162496/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/0 e 0 to 0 dl 1651529939 ref 1 fl New:/0/ffffffff rc 0/-1 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.636394:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002a957ba7 with x1731754353162496 ext(33554432->37748735) 00002000:00010000:0.0:1651529933.636396:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000002a957ba7 00000100:00100000:0.0:1651529933.636407:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 20 00000100:00100000:0.0:1651529933.636409:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+45:438148:x1731754353162496:12345-10.240.43.64@tcp:4:check_fallocate.0 00000100:00100000:0.0:1651529933.641938:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002a957ba7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+47:438148:x1731754353162496:12345-10.240.43.64@tcp:4:check_fallocate.0 Request processed in 5526us (5563us total) trans 21474837303 rc 0/0 00000100:00100000:0.0:1651529933.641943:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 20 00002000:00100000:0.0:1651529933.641946:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (33554432->37748735) req@000000002a957ba7 x1731754353162496/t21474837303(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/448 e 0 to 0 dl 1651529939 ref 1 fl Complete:/0/0 rc 0/0 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.641950:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002a957ba7 with x1731754353162496 ext(33554432->37748735) 00002000:00010000:0.0:1651529933.641952:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000002a957ba7 00000100:00100000:0.0:1651529933.660377:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529933.660386:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353162624 00002000:00100000:0.0:1651529933.660394:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (37748736->41943039) req@000000004089c807 x1731754353162624/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/0 e 0 to 0 dl 1651529939 ref 1 fl New:/0/ffffffff rc 0/-1 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.660398:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004089c807 with x1731754353162624 ext(37748736->41943039) 00002000:00010000:0.0:1651529933.660399:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000004089c807 00000100:00100000:0.0:1651529933.660411:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 21 00000100:00100000:0.0:1651529933.660412:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+47:438148:x1731754353162624:12345-10.240.43.64@tcp:4:check_fallocate.0 00000100:00100000:0.0:1651529933.665859:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004089c807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+49:438148:x1731754353162624:12345-10.240.43.64@tcp:4:check_fallocate.0 Request processed in 5444us (5481us total) trans 21474837304 rc 0/0 00000100:00100000:0.0:1651529933.665864:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 21 00002000:00100000:0.0:1651529933.665867:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (37748736->41943039) req@000000004089c807 x1731754353162624/t21474837304(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/448 e 0 to 0 dl 1651529939 ref 1 fl Complete:/0/0 rc 0/0 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.665872:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004089c807 with x1731754353162624 ext(37748736->41943039) 00002000:00010000:0.0:1651529933.665874:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000004089c807 00000100:00100000:0.0:1651529933.685385:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529933.685395:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353162752 00002000:00100000:0.0:1651529933.685404:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (83886080->88080383) req@00000000703c0db9 x1731754353162752/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/0 e 0 to 0 dl 1651529939 ref 1 fl New:/0/ffffffff rc 0/-1 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.685408:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000703c0db9 with x1731754353162752 ext(83886080->88080383) 00002000:00010000:0.0:1651529933.685409:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000703c0db9 00000100:00100000:0.0:1651529933.685421:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 22 00000100:00100000:0.0:1651529933.685423:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+49:438148:x1731754353162752:12345-10.240.43.64@tcp:4:check_fallocate.0 00000100:00100000:0.0:1651529933.691070:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000703c0db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+51:438148:x1731754353162752:12345-10.240.43.64@tcp:4:check_fallocate.0 Request processed in 5644us (5684us total) trans 21474837305 rc 0/0 00000100:00100000:0.0:1651529933.691077:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 22 00002000:00100000:0.0:1651529933.691081:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (83886080->88080383) req@00000000703c0db9 x1731754353162752/t21474837305(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/448 e 0 to 0 dl 1651529939 ref 1 fl Complete:/0/0 rc 0/0 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.691086:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000703c0db9 with x1731754353162752 ext(83886080->88080383) 00002000:00010000:0.0:1651529933.691088:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000703c0db9 00000100:00100000:0.0:1651529933.709372:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529933.709381:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353162880 00002000:00100000:0.0:1651529933.709389:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (88080384->92274687) req@0000000078c6e720 x1731754353162880/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/0 e 0 to 0 dl 1651529939 ref 1 fl New:/0/ffffffff rc 0/-1 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.709393:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000078c6e720 with x1731754353162880 ext(88080384->92274687) 00002000:00010000:0.0:1651529933.709394:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000078c6e720 00000100:00100000:0.0:1651529933.709405:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 23 00000100:00100000:0.0:1651529933.709407:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000078c6e720 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+51:438148:x1731754353162880:12345-10.240.43.64@tcp:4:check_fallocate.0 00000100:00100000:0.0:1651529933.716658:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000078c6e720 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+53:438148:x1731754353162880:12345-10.240.43.64@tcp:4:check_fallocate.0 Request processed in 7248us (7285us total) trans 21474837306 rc 0/0 00000100:00100000:0.0:1651529933.716664:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 23 00002000:00100000:0.0:1651529933.716667:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (88080384->92274687) req@0000000078c6e720 x1731754353162880/t21474837306(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/448 e 0 to 0 dl 1651529939 ref 1 fl Complete:/0/0 rc 0/0 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.716671:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000078c6e720 with x1731754353162880 ext(88080384->92274687) 00002000:00010000:0.0:1651529933.716673:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000078c6e720 00000100:00100000:1.0:1651529933.734368:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529933.734390:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353163008 00002000:00100000:0.0:1651529933.734399:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (92274688->96468991) req@0000000071f18c6a x1731754353163008/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/0 e 0 to 0 dl 1651529939 ref 1 fl New:/0/ffffffff rc 0/-1 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.734407:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000071f18c6a with x1731754353163008 ext(92274688->96468991) 00002000:00010000:0.0:1651529933.734408:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000071f18c6a 00000100:00100000:0.0:1651529933.734418:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 24 00000100:00100000:0.0:1651529933.734420:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+53:438148:x1731754353163008:12345-10.240.43.64@tcp:4:check_fallocate.0 00000100:00100000:0.0:1651529933.740027:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f18c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+55:438148:x1731754353163008:12345-10.240.43.64@tcp:4:check_fallocate.0 Request processed in 5605us (5660us total) trans 21474837307 rc 0/0 00000100:00100000:0.0:1651529933.740032:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 24 00002000:00100000:0.0:1651529933.740035:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (92274688->96468991) req@0000000071f18c6a x1731754353163008/t21474837307(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/448 e 0 to 0 dl 1651529939 ref 1 fl Complete:/0/0 rc 0/0 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.740039:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000071f18c6a with x1731754353163008 ext(92274688->96468991) 00002000:00010000:0.0:1651529933.740041:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000071f18c6a 00000100:00100000:0.0:1651529933.758378:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529933.758387:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353163136 00002000:00100000:0.0:1651529933.758395:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (96468992->100663295) req@00000000b3d379fe x1731754353163136/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/0 e 0 to 0 dl 1651529939 ref 1 fl New:/0/ffffffff rc 0/-1 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.758400:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b3d379fe with x1731754353163136 ext(96468992->100663295) 00002000:00010000:0.0:1651529933.758401:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000b3d379fe 00000100:00100000:0.0:1651529933.758412:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 25 00000100:00100000:0.0:1651529933.758414:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b3d379fe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+55:438148:x1731754353163136:12345-10.240.43.64@tcp:4:check_fallocate.0 00000100:00100000:0.0:1651529933.764240:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b3d379fe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+57:438148:x1731754353163136:12345-10.240.43.64@tcp:4:check_fallocate.0 Request processed in 5823us (5861us total) trans 21474837308 rc 0/0 00000100:00100000:0.0:1651529933.764246:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 25 00002000:00100000:0.0:1651529933.764250:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (96468992->100663295) req@00000000b3d379fe x1731754353163136/t21474837308(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/448 e 0 to 0 dl 1651529939 ref 1 fl Complete:/0/0 rc 0/0 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.764254:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b3d379fe with x1731754353163136 ext(96468992->100663295) 00002000:00010000:0.0:1651529933.764256:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000b3d379fe 00000100:00100000:0.0:1651529933.782382:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529933.782392:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353163264 00002000:00100000:0.0:1651529933.782402:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (100663296->104857599) req@00000000ab440250 x1731754353163264/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/0 e 0 to 0 dl 1651529939 ref 1 fl New:/0/ffffffff rc 0/-1 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.782406:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ab440250 with x1731754353163264 ext(100663296->104857599) 00002000:00010000:0.0:1651529933.782408:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000ab440250 00000100:00100000:0.0:1651529933.782420:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 26 00000100:00100000:0.0:1651529933.782422:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ab440250 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+57:438148:x1731754353163264:12345-10.240.43.64@tcp:4:check_fallocate.0 00000100:00100000:0.0:1651529933.788034:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ab440250 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+59:438148:x1731754353163264:12345-10.240.43.64@tcp:4:check_fallocate.0 Request processed in 5609us (5652us total) trans 21474837309 rc 0/0 00000100:00100000:0.0:1651529933.788039:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 26 00002000:00100000:0.0:1651529933.788043:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (100663296->104857599) req@00000000ab440250 x1731754353163264/t21474837309(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/448 e 0 to 0 dl 1651529939 ref 1 fl Complete:/0/0 rc 0/0 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.788056:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ab440250 with x1731754353163264 ext(100663296->104857599) 00002000:00010000:0.0:1651529933.788058:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000ab440250 00000100:00100000:0.0:1651529933.807371:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529933.807380:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353163392 00002000:00100000:0.0:1651529933.807389:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (104857600->109051903) req@0000000050bbb886 x1731754353163392/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/0 e 0 to 0 dl 1651529939 ref 1 fl New:/0/ffffffff rc 0/-1 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.807393:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000050bbb886 with x1731754353163392 ext(104857600->109051903) 00002000:00010000:0.0:1651529933.807394:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000050bbb886 00000100:00100000:0.0:1651529933.807405:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 27 00000100:00100000:0.0:1651529933.807407:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+59:438148:x1731754353163392:12345-10.240.43.64@tcp:4:check_fallocate.0 00000100:00100000:0.0:1651529933.813017:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050bbb886 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+61:438148:x1731754353163392:12345-10.240.43.64@tcp:4:check_fallocate.0 Request processed in 5608us (5644us total) trans 21474837310 rc 0/0 00000100:00100000:0.0:1651529933.813022:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 27 00002000:00100000:0.0:1651529933.813025:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (104857600->109051903) req@0000000050bbb886 x1731754353163392/t21474837310(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/448 e 0 to 0 dl 1651529939 ref 1 fl Complete:/0/0 rc 0/0 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.813030:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000050bbb886 with x1731754353163392 ext(104857600->109051903) 00002000:00010000:0.0:1651529933.813031:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000050bbb886 00000100:00100000:0.0:1651529933.831373:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529933.831382:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353163520 00002000:00100000:0.0:1651529933.831390:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (109051904->113246207) req@0000000007fba516 x1731754353163520/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/0 e 0 to 0 dl 1651529939 ref 1 fl New:/0/ffffffff rc 0/-1 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.831394:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000007fba516 with x1731754353163520 ext(109051904->113246207) 00002000:00010000:0.0:1651529933.831395:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000007fba516 00000100:00100000:0.0:1651529933.831407:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 28 00000100:00100000:0.0:1651529933.831409:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+61:438148:x1731754353163520:12345-10.240.43.64@tcp:4:check_fallocate.0 00000100:00100000:0.0:1651529933.838312:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007fba516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+63:438148:x1731754353163520:12345-10.240.43.64@tcp:4:check_fallocate.0 Request processed in 6900us (6937us total) trans 21474837311 rc 0/0 00000100:00100000:0.0:1651529933.838316:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 28 00002000:00100000:0.0:1651529933.838320:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (109051904->113246207) req@0000000007fba516 x1731754353163520/t21474837311(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/448 e 0 to 0 dl 1651529939 ref 1 fl Complete:/0/0 rc 0/0 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.838328:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000007fba516 with x1731754353163520 ext(109051904->113246207) 00002000:00010000:0.0:1651529933.838329:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000007fba516 00000100:00100000:1.0:1651529933.856392:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529933.856415:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353163648 00002000:00100000:0.0:1651529933.856425:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (113246208->117440511) req@000000007d5b6cdf x1731754353163648/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/0 e 0 to 0 dl 1651529939 ref 1 fl New:/0/ffffffff rc 0/-1 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.856428:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000007d5b6cdf with x1731754353163648 ext(113246208->117440511) 00002000:00010000:0.0:1651529933.856430:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000007d5b6cdf 00000100:00100000:0.0:1651529933.856440:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 29 00000100:00100000:0.0:1651529933.856441:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+63:438148:x1731754353163648:12345-10.240.43.64@tcp:4:check_fallocate.0 00000100:00100000:0.0:1651529933.862091:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d5b6cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+65:438148:x1731754353163648:12345-10.240.43.64@tcp:4:check_fallocate.0 Request processed in 5647us (5699us total) trans 21474837312 rc 0/0 00000100:00100000:0.0:1651529933.862096:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 29 00002000:00100000:0.0:1651529933.862099:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (113246208->117440511) req@000000007d5b6cdf x1731754353163648/t21474837312(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/448 e 0 to 0 dl 1651529939 ref 1 fl Complete:/0/0 rc 0/0 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.862103:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000007d5b6cdf with x1731754353163648 ext(113246208->117440511) 00002000:00010000:0.0:1651529933.862105:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000007d5b6cdf 00000100:00100000:0.0:1651529933.880373:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529933.880383:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353163776 00002000:00100000:0.0:1651529933.880392:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (117440512->121634815) req@0000000029d739c8 x1731754353163776/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/0 e 0 to 0 dl 1651529939 ref 1 fl New:/0/ffffffff rc 0/-1 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.880397:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000029d739c8 with x1731754353163776 ext(117440512->121634815) 00002000:00010000:0.0:1651529933.880398:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000029d739c8 00000100:00100000:0.0:1651529933.880411:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 30 00000100:00100000:0.0:1651529933.880412:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+65:438148:x1731754353163776:12345-10.240.43.64@tcp:4:check_fallocate.0 00000100:00100000:0.0:1651529933.886021:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029d739c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+67:438148:x1731754353163776:12345-10.240.43.64@tcp:4:check_fallocate.0 Request processed in 5606us (5647us total) trans 21474837313 rc 0/0 00000100:00100000:0.0:1651529933.886025:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 30 00002000:00100000:0.0:1651529933.886029:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (117440512->121634815) req@0000000029d739c8 x1731754353163776/t21474837313(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/448 e 0 to 0 dl 1651529939 ref 1 fl Complete:/0/0 rc 0/0 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.886034:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000029d739c8 with x1731754353163776 ext(117440512->121634815) 00002000:00010000:0.0:1651529933.886035:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000029d739c8 00000100:00100000:0.0:1651529933.904382:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529933.904391:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353163904 00002000:00100000:0.0:1651529933.904398:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (121634816->125829119) req@0000000004be0190 x1731754353163904/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/0 e 0 to 0 dl 1651529939 ref 1 fl New:/0/ffffffff rc 0/-1 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.904402:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000004be0190 with x1731754353163904 ext(121634816->125829119) 00002000:00010000:0.0:1651529933.904404:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000004be0190 00000100:00100000:0.0:1651529933.904415:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 31 00000100:00100000:0.0:1651529933.904417:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+67:438148:x1731754353163904:12345-10.240.43.64@tcp:4:check_fallocate.0 00000100:00100000:1.0:1651529933.905405:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529933.905417:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353164032 00000100:00100000:1.0:1651529933.905438:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 839 00000100:00100000:1.0:1651529933.905440:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+69:438149:x1731754353164032:12345-10.240.43.64@tcp:22:check_fallocate.0 00002000:00010000:1.0:1651529933.905530:0:167632:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2c083:0x0] updating lvb size from disk: 0 -> 121634816 00002000:00010000:1.0:1651529933.905532:0:167632:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2c083:0x0] updating lvb mtime from disk: 1651529933 -> 1651529933 00002000:00010000:1.0:1651529933.905533:0:167632:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2c083:0x0] updating lvb atime from disk: 1651529933 -> 1651529933 00002000:00010000:1.0:1651529933.905534:0:167632:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2c083:0x0] updating lvb ctime from disk: 1651529933 -> 1651529933 00002000:00010000:1.0:1651529933.905535:0:167632:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2c083:0x0] updating lvb blocks from disk: 0 -> 163840 00000100:00100000:1.0:1651529933.905554:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+70:438149:x1731754353164032:12345-10.240.43.64@tcp:22:check_fallocate.0 Request processed in 113us (150us total) trans 21474837314 rc 0/0 00000100:00100000:1.0:1651529933.905557:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 839 00000100:00100000:0.0:1651529933.910002:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000004be0190 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+70:438148:x1731754353163904:12345-10.240.43.64@tcp:4:check_fallocate.0 Request processed in 5582us (5619us total) trans 21474837315 rc 0/0 00000100:00100000:0.0:1651529933.910007:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 31 00002000:00100000:0.0:1651529933.910011:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c083:0x0] (121634816->125829119) req@0000000004be0190 x1731754353163904/t21474837315(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:659/0 lens 488/448 e 0 to 0 dl 1651529939 ref 1 fl Complete:/0/0 rc 0/0 job:'check_fallocate.0' 00002000:00100000:0.0:1651529933.910016:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000004be0190 with x1731754353163904 ext(121634816->125829119) 00002000:00010000:0.0:1651529933.910018:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000004be0190 00000100:00100000:0.0:1651529936.603411:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529936.603443:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946842560 00000100:00100000:1.0:1651529936.603470:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 840 00000100:00100000:1.0:1651529936.603473:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946842560:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529936.603489:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180355 count 1 00010000:00010000:1.0:1651529936.603504:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55a90 lrc: 3/0,1 mode: --/PW res: [0x2c083:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529936.603514:0:167632:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55a89 lrc: 2/0,0 mode: PW/PW res: [0x2c083:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7845 expref: 69 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529936.603519:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529936.603520:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529936.603521:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55a90 lrc: 4/0,1 mode: --/PW res: [0x2c083:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529936.603535:0:167632:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55a89 lrc: 3/0,0 mode: PW/PW res: [0x2c083:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000030020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7845 expref: 69 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529936.603541:0:167632:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55a89 lrc: 4/0,0 mode: PW/PW res: [0x2c083:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x70000400030020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7845 expref: 69 pid: 167632 timeout: 20745 lvb_type: 0 00000100:00100000:1.0:1651529936.603547:0:167632:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:167632:1731745997086080:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529936.603577:0:167632:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c4c86f6c going to sleep for 6 seconds 00000100:00100000:0.0:1651529936.603991:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529936.604002:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353164352 00000100:00100000:1.0:1651529936.604006:0:167632:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000977ca576 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:167632:1731745997086080:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651529936.604012:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55a89 lrc: 4/0,0 mode: PW/PW res: [0x2c083:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400030020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7845 expref: 70 pid: 167632 timeout: 20745 lvb_type: 0 00010000:00010000:1.0:1651529936.604013:0:167632:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55a90 lrc: 3/0,1 mode: --/PW res: [0x2c083:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529936.604025:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2 00000100:00100000:0.0:1651529936.604027:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+70:438146:x1731754353164352:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529936.604031:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529936.604033:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55a89 lrc: 4/0,0 mode: PW/PW res: [0x2c083:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400030020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7845 expref: 70 pid: 167632 timeout: 20745 lvb_type: 0 00010000:00010000:0.0:1651529936.604038:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55a89 lrc: 3/0,0 mode: PW/PW res: [0x2c083:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000400030020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7845 expref: 70 pid: 167632 timeout: 20745 lvb_type: 0 00010000:00010000:0.0:1651529936.604064:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55a89 lrc: 0/0,0 mode: --/PW res: [0x2c083:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x44801400030020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7845 expref: 70 pid: 167632 timeout: 20745 lvb_type: 0 00010000:00010000:0.0:1651529936.604069:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529936.604070:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529936.604071:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55a90 lrc: 3/0,1 mode: PW/PW res: [0x2c083:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529936.604075:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55a90 lrc: 4/0,1 mode: PW/PW res: [0x2c083:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529936.604088:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529936.604103:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+69:438146:x1731754353164352:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 75us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529936.604106:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2 00010000:00010000:1.0:1651529936.604134:0:167632:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55a90 lrc: 3/0,1 mode: PW/PW res: [0x2c083:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529936.604139:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55a90 lrc: 3/0,1 mode: PW/PW res: [0x2c083:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529936.604143:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55a90 lrc: 3/0,1 mode: PW/PW res: [0x2c083:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529936.604146:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55a90 lrc: 2/0,0 mode: PW/PW res: [0x2c083:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529936.604170:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55a90 lrc: 2/0,0 mode: PW/PW res: [0x2c083:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529936.604174:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001ea46bb1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529936.604175:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55a90 lrc: 2/0,0 mode: PW/PW res: [0x2c083:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529936.604179:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55a90 lrc: 3/0,0 mode: PW/PW res: [0x2c083:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529936.604184:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55a90 lrc: 1/0,0 mode: --/PW res: [0x2c083:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529936.604187:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55a90 lrc: 0/0,0 mode: --/PW res: [0x2c083:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529936.610209:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946842560:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 6735us (6801us total) trans 21474837316 rc 0/0 00000100:00100000:1.0:1651529936.610213:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 840 00000100:00100000:1.0:1651529937.120218:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529937.120255:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946842688 00000100:00100000:0.0:1651529937.120278:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 54 00000100:00100000:0.0:1651529937.120281:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946842688:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651529937.120299:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 261827264 pending 126566400 free 81309044736 avail 77138333696 00000100:00100000:0.0:1651529937.120327:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946842688:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 46us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529937.120330:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 54 00000001:00080000:1.0:1651529939.092917:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474837316 is committed 00000001:00080000:1.0:1651529939.092923:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474837315 is committed 00000100:00100000:0.0:1651529941.629344:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9063caa-b124-4cb6-99ef-d01a735595c3:39100:1731745997086144:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:1.0:1651529941.629353:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a9b051f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:39099:1731745997086208:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:0.0:1651529941.629973:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9063caa-b124-4cb6-99ef-d01a735595c3:39100:1731745997086144:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:1.0:1651529941.629981:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a9b051f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:39099:1731745997086208:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:1.0:1651529942.240183:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529942.240215:0:166115:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946842816 00000100:00100000:0.0:1651529942.240250:0:166115:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 55 00000100:00100000:0.0:1651529942.240252:0:166115:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946842816:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651529942.240270:0:166115:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 135260864 pending 0 free 81309044736 avail 77138333696 00000100:00100000:0.0:1651529942.240295:0:166115:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946842816:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 42us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529942.240299:0:166115:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 55 00000400:00000080:0.0:1651529944.547695:0:168772:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651529944.547698:0:168772:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 150bb: Verify fallocate modes both zero space ========================================================== 22:19:04 (1651529944) 00000100:00100000:1.0:1651529947.329281:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529947.329300:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353168768 00000100:00100000:1.0:1651529947.329325:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5 00000100:00100000:1.0:1651529947.329328:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+5:438146:x1731754353168768:12345-10.240.43.64@tcp:400:kworker/u4:1.0 00000100:00100000:1.0:1651529947.329363:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+5:438146:x1731754353168768:12345-10.240.43.64@tcp:400:kworker/u4:1.0 Request processed in 35us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529947.329369:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5 00000100:00100000:1.0:1651529947.360206:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529947.360248:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946843136 00000100:00100000:1.0:1651529947.360267:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 56 00000100:00100000:1.0:1651529947.360270:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946843136:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651529947.360285:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 135260864 pending 0 free 81309044736 avail 77138333696 00000100:00100000:1.0:1651529947.360310:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946843136:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 40us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529947.360314:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 56 00000100:00100000:1.0:1651529952.480207:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529952.480249:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946843456 00000100:00100000:1.0:1651529952.480273:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 57 00000100:00100000:1.0:1651529952.480275:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946843456:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651529952.480293:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 135260864 pending 0 free 81309044736 avail 77138333696 00000100:00100000:1.0:1651529952.480323:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946843456:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 47us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529952.480327:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 57 00000100:00100000:1.0:1651529957.600286:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529957.600306:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946843584 00000100:00100000:1.0:1651529957.600335:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 58 00000100:00100000:1.0:1651529957.600337:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7fc4ed7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946843584:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651529957.600361:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 135260864 pending 0 free 81309044736 avail 77138333696 00000100:00100000:1.0:1651529957.600391:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7fc4ed7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946843584:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 53us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529957.600397:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 58 00000400:00000080:1.0:1651529960.031133:0:169099:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651529960.031136:0:169099:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 150c: Verify fallocate Size and Blocks ==== 22:19:19 (1651529959) 00000100:00100000:1.0:1651529960.286583:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529960.286601:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353170048 00000100:00100000:1.0:1651529960.286625:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 841 00000100:00100000:1.0:1651529960.286628:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d5b9490 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+5:454473:x1731754353170048:12345-10.240.43.64@tcp:101:fallocate.0 00010000:00010000:1.0:1651529960.286637:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529960.286649:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c55a97 lrc: 2/0,0 mode: --/PW res: [0x2c084:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db2f78b5 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529960.286660:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c084:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529960.286670:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529960.286671:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529960.286676:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c55a97 lrc: 3/0,0 mode: PW/PW res: [0x2c084:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78b5 expref: 6 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529960.286684:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c55a97 lrc: 3/0,0 mode: PW/PW res: [0x2c084:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78b5 expref: 6 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529960.286690:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007c1cad42, rc 0) 00000100:00100000:1.0:1651529960.286716:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d5b9490 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+6:454473:x1731754353170048:12345-10.240.43.64@tcp:101:fallocate.0 Request processed in 88us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529960.286720:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 841 00000100:00100000:1.0:1651529960.287004:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529960.287012:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353170176 00000100:00100000:1.0:1651529960.287022:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 842 00000100:00100000:1.0:1651529960.287024:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438149:x1731754353170176:12345-10.240.43.64@tcp:22:fallocate.0 00002000:00010000:1.0:1651529960.287151:0:167632:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2c084:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:1.0:1651529960.287153:0:167632:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2c084:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1651529960.287154:0:167632:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2c084:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529960.287155:0:167632:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2c084:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1651529960.287156:0:167632:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2c084:0x0] updating lvb blocks from disk: 0 -> 2048 00000100:00100000:1.0:1651529960.287173:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438149:x1731754353170176:12345-10.240.43.64@tcp:22:fallocate.0 Request processed in 148us (169us total) trans 21474837317 rc 0/0 00000100:00100000:1.0:1651529960.287176:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 842 00000100:00100000:1.0:1651529960.318101:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529960.318109:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353170368 00000100:00100000:1.0:1651529960.318121:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 843 00000100:00100000:1.0:1651529960.318123:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438149:x1731754353170368:12345-10.240.43.64@tcp:16:fallocate.0 00000001:00080000:1.0:1651529960.351320:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474837317 is committed 00000100:00100000:1.0:1651529960.351346:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438149:x1731754353170368:12345-10.240.43.64@tcp:16:fallocate.0 Request processed in 33223us (33245us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529960.351350:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 843 00000100:00100000:1.0:1651529960.367358:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529960.367366:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353171648 00000100:00100000:1.0:1651529960.367380:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 844 00000100:00100000:1.0:1651529960.367382:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008ce5f676 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+6:454477:x1731754353171648:12345-10.240.43.64@tcp:101:fallocate.0 00010000:00010000:1.0:1651529960.367385:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529960.367390:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c55a9e lrc: 2/0,0 mode: --/PW res: [0x2c085:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db2f78e6 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529960.367397:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c085:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529960.367401:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529960.367402:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529960.367404:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c55a9e lrc: 3/0,0 mode: PW/PW res: [0x2c085:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78e6 expref: 7 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529960.367410:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c55a9e lrc: 3/0,0 mode: PW/PW res: [0x2c085:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78e6 expref: 7 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529960.367414:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004f367ded, rc 0) 00000100:00100000:1.0:1651529960.367428:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008ce5f676 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+7:454477:x1731754353171648:12345-10.240.43.64@tcp:101:fallocate.0 Request processed in 46us (71us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529960.367431:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 844 00000100:00100000:1.0:1651529960.367979:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529960.367987:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353171776 00000100:00100000:1.0:1651529960.367998:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 845 00000100:00100000:1.0:1651529960.368000:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006dd920d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+7:454477:x1731754353171776:12345-10.240.43.64@tcp:101:fallocate.0 00010000:00010000:1.0:1651529960.368003:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529960.368008:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c55aa5 lrc: 2/0,0 mode: --/PW res: [0x2c086:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db2f78f4 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529960.368013:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c086:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529960.368017:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529960.368017:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529960.368019:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c55aa5 lrc: 3/0,0 mode: PW/PW res: [0x2c086:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8388607) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78f4 expref: 8 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529960.368024:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c55aa5 lrc: 3/0,0 mode: PW/PW res: [0x2c086:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8388607) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78f4 expref: 8 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529960.368031:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000baeec0a3, rc 0) 00000100:00100000:1.0:1651529960.368044:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006dd920d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+8:454477:x1731754353171776:12345-10.240.43.64@tcp:101:fallocate.0 Request processed in 43us (65us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529960.368047:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 845 00000100:00100000:1.0:1651529960.368274:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529960.368281:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353171840 00000100:00100000:1.0:1651529960.368290:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 846 00000100:00100000:1.0:1651529960.368292:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000712b8830 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+8:454477:x1731754353171840:12345-10.240.43.64@tcp:101:fallocate.0 00010000:00010000:1.0:1651529960.368295:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529960.368299:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55aac lrc: 2/0,0 mode: --/PW res: [0x2c087:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db2f78fb expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529960.368305:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c087:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529960.368308:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529960.368309:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529960.368311:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55aac lrc: 3/0,0 mode: PW/PW res: [0x2c087:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 8388608->268435455) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78fb expref: 9 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529960.368315:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55aac lrc: 3/0,0 mode: PW/PW res: [0x2c087:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 8388608->268435455) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78fb expref: 9 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529960.368319:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c2d8d18b, rc 0) 00000100:00100000:1.0:1651529960.368331:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000712b8830 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+9:454477:x1731754353171840:12345-10.240.43.64@tcp:101:fallocate.0 Request processed in 38us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529960.368334:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 846 00000100:00100000:1.0:1651529960.368927:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529960.368936:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529960.368951:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529960.368959:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353171968 00000100:00100000:0.0:1651529960.368961:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353172096 00000100:00100000:1.0:1651529960.368968:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353172160 00000100:00100000:1.0:1651529960.368972:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 847 00000100:00100000:1.0:1651529960.368974:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eb5b784a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+11:438149:x1731754353171968:12345-10.240.43.64@tcp:22:fallocate.0 00000100:00100000:0.0:1651529960.368979:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 848 00000100:00100000:0.0:1651529960.368982:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000687b7ae8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+11:438149:x1731754353172160:12345-10.240.43.64@tcp:22:fallocate.0 00002000:00010000:1.0:1651529960.369025:0:166111:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2c085:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:1.0:1651529960.369026:0:166111:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2c085:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1651529960.369027:0:166111:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2c085:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529960.369028:0:166111:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2c085:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1651529960.369029:0:166111:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2c085:0x0] updating lvb blocks from disk: 0 -> 2048 00000100:00100000:1.0:1651529960.369044:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eb5b784a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+12:438149:x1731754353171968:12345-10.240.43.64@tcp:22:fallocate.0 Request processed in 69us (117us total) trans 21474837318 rc 0/0 00000100:00100000:1.0:1651529960.369047:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 847 00000100:00100000:1.0:1651529960.369052:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 849 00000100:00100000:1.0:1651529960.369054:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a202dd67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+11:438149:x1731754353172096:12345-10.240.43.64@tcp:22:fallocate.0 00002000:00010000:0.0:1651529960.369099:0:166112:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2c087:0x0] updating lvb size from disk: 0 -> 268435456 00002000:00010000:0.0:1651529960.369101:0:166112:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2c087:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1651529960.369102:0:166112:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2c087:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651529960.369102:0:166112:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2c087:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1651529960.369103:0:166111:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2c086:0x0] updating lvb size from disk: 0 -> 8388608 00002000:00010000:0.0:1651529960.369103:0:166112:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2c087:0x0] updating lvb blocks from disk: 0 -> 507904 00002000:00010000:1.0:1651529960.369104:0:166111:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2c086:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1651529960.369105:0:166111:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2c086:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529960.369106:0:166111:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2c086:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1651529960.369107:0:166111:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2c086:0x0] updating lvb blocks from disk: 0 -> 16384 00000100:00100000:0.0:1651529960.369115:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000687b7ae8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+13:438149:x1731754353172160:12345-10.240.43.64@tcp:22:fallocate.0 Request processed in 133us (164us total) trans 21474837319 rc 0/0 00000100:00100000:1.0:1651529960.369116:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a202dd67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+13:438149:x1731754353172096:12345-10.240.43.64@tcp:22:fallocate.0 Request processed in 61us (179us total) trans 21474837320 rc 0/0 00000100:00100000:1.0:1651529960.369119:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 849 00000100:00100000:0.0:1651529960.369121:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 848 00000100:00100000:1.0:1651529960.392033:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529960.392041:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946843904 00000100:00100000:1.0:1651529960.392049:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 850 00000100:00100000:1.0:1651529960.392050:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008ce5f676 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946843904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529960.392057:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180356 count 1 00010000:00010000:1.0:1651529960.392072:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55ab3 lrc: 3/0,1 mode: --/PW res: [0x2c084:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529960.392077:0:167632:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c55a97 lrc: 2/0,0 mode: PW/PW res: [0x2c084:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78b5 expref: 11 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529960.392081:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529960.392082:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529960.392083:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55ab3 lrc: 4/0,1 mode: --/PW res: [0x2c084:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529960.392094:0:167632:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c55a97 lrc: 3/0,0 mode: PW/PW res: [0x2c084:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78b5 expref: 11 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529960.392099:0:167632:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c55a97 lrc: 4/0,0 mode: PW/PW res: [0x2c084:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78b5 expref: 11 pid: 167632 timeout: 20769 lvb_type: 0 00000100:00100000:1.0:1651529960.392105:0:167632:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006dd920d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:167632:1731745997086272:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529960.392127:0:167632:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dc2fce04 going to sleep for 6 seconds 00000100:00100000:1.0:1651529960.392254:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529960.392262:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529960.392275:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529960.392282:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353172352 00000100:00100000:0.0:1651529960.392286:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353172480 00000100:00100000:1.0:1651529960.392287:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353172544 00000100:00100000:1.0:1651529960.392291:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 851 00000100:00100000:1.0:1651529960.392293:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000712b8830 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+14:438148:x1731754353172352:12345-10.240.43.64@tcp:16:fallocate.0 00000100:00100000:0.0:1651529960.392488:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529960.392498:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353172672 00010000:00010000:0.0:1651529960.392505:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c55a97 lrc: 5/0,0 mode: PW/PW res: [0x2c084:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78b5 expref: 15 pid: 167632 timeout: 20769 lvb_type: 0 00000100:00100000:0.0:1651529960.392516:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3 00000100:00100000:1.0:1651529960.392518:0:167632:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006dd920d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:167632:1731745997086272:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529960.392518:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+15:438146:x1731754353172672:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651529960.392523:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529960.392524:0:167632:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55ab3 lrc: 3/0,1 mode: --/PW res: [0x2c084:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529960.392525:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c55a97 lrc: 4/0,0 mode: PW/PW res: [0x2c084:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78b5 expref: 15 pid: 167632 timeout: 20769 lvb_type: 0 00010000:00010000:0.0:1651529960.392530:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c55a97 lrc: 3/0,0 mode: PW/PW res: [0x2c084:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78b5 expref: 15 pid: 167632 timeout: 20769 lvb_type: 0 00010000:00010000:0.0:1651529960.392538:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c55a97 lrc: 0/0,0 mode: --/PW res: [0x2c084:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78b5 expref: 15 pid: 167632 timeout: 20769 lvb_type: 0 00010000:00010000:0.0:1651529960.392543:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529960.392543:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529960.392544:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55ab3 lrc: 3/0,1 mode: PW/PW res: [0x2c084:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529960.392548:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55ab3 lrc: 4/0,1 mode: PW/PW res: [0x2c084:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529960.392558:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529960.392564:0:167632:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55ab3 lrc: 3/0,1 mode: PW/PW res: [0x2c084:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529960.392570:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+14:438146:x1731754353172672:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 51us (82us total) trans 0 rc 0/0 00010000:00010000:1.0:1651529960.392572:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55ab3 lrc: 3/0,1 mode: PW/PW res: [0x2c084:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529960.392573:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3 00010000:00010000:1.0:1651529960.392577:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55ab3 lrc: 3/0,1 mode: PW/PW res: [0x2c084:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529960.392580:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55ab3 lrc: 2/0,0 mode: PW/PW res: [0x2c084:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529960.392595:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55ab3 lrc: 2/0,0 mode: PW/PW res: [0x2c084:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529960.392599:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004678bff1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529960.392601:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55ab3 lrc: 2/0,0 mode: PW/PW res: [0x2c084:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529960.392604:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55ab3 lrc: 3/0,0 mode: PW/PW res: [0x2c084:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529960.392610:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55ab3 lrc: 1/0,0 mode: --/PW res: [0x2c084:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529960.392613:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55ab3 lrc: 0/0,0 mode: --/PW res: [0x2c084:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529960.392659:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008ce5f676 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946843904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 608us (626us total) trans 21474837321 rc 0/0 00000100:00100000:1.0:1651529960.392663:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 850 00000100:00100000:1.0:1651529960.392669:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 852 00000100:00100000:1.0:1651529960.392670:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b810a5d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+13:438148:x1731754353172544:12345-10.240.43.64@tcp:16:fallocate.0 00000001:00080000:1.0:1651529960.416800:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474837320 is committed 00000100:00100000:1.0:1651529960.416822:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000712b8830 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+10:438148:x1731754353172352:12345-10.240.43.64@tcp:16:fallocate.0 Request processed in 24527us (24567us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529960.416827:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 851 00000100:00100000:1.0:1651529960.416832:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 853 00000100:00100000:1.0:1651529960.416834:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eb5b784a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438148:x1731754353172480:12345-10.240.43.64@tcp:16:fallocate.0 00000100:00100000:1.0:1651529960.416845:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eb5b784a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438148:x1731754353172480:12345-10.240.43.64@tcp:16:fallocate.0 Request processed in 11us (24583us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529960.416848:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 853 00000100:00100000:1.0:1651529960.417820:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b810a5d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438148:x1731754353172544:12345-10.240.43.64@tcp:16:fallocate.0 Request processed in 25148us (25544us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529960.417823:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 852 00000100:00100000:1.0:1651529961.825850:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529961.825864:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529961.825872:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529961.825891:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946844160 00000100:00100000:0.0:1651529961.825900:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946844224 00000100:00100000:1.0:1651529961.825912:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946844288 00000100:00100000:1.0:1651529961.825918:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 854 00000100:00100000:1.0:1651529961.825921:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006dd920d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946844160:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651529961.825924:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 855 00000100:00100000:0.0:1651529961.825926:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008f7d6b7b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946844224:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529961.825937:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180357 count 1 00002000:00080000:0.0:1651529961.825937:0:166112:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180358 count 1 00010000:00010000:1.0:1651529961.825950:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c55ac1 lrc: 3/0,1 mode: --/PW res: [0x2c085:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529961.825950:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55aba lrc: 3/0,1 mode: --/PW res: [0x2c086:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529961.825960:0:166111:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c55a9e lrc: 2/0,0 mode: PW/PW res: [0x2c085:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78e6 expref: 7 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529961.825960:0:166112:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c55aa5 lrc: 2/0,0 mode: PW/PW res: [0x2c086:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8388607) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78f4 expref: 7 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529961.825964:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529961.825965:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529961.825965:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651529961.825965:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529961.825967:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c55ac1 lrc: 4/0,1 mode: --/PW res: [0x2c085:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529961.825967:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55aba lrc: 4/0,1 mode: --/PW res: [0x2c086:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529961.825981:0:166111:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c55a9e lrc: 3/0,0 mode: PW/PW res: [0x2c085:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78e6 expref: 7 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529961.825982:0:166112:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c55aa5 lrc: 3/0,0 mode: PW/PW res: [0x2c086:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8388607) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78f4 expref: 7 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529961.825987:0:166111:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c55a9e lrc: 4/0,0 mode: PW/PW res: [0x2c085:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78e6 expref: 7 pid: 167632 timeout: 20770 lvb_type: 0 00010000:00010000:0.0:1651529961.825987:0:166112:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c55aa5 lrc: 4/0,0 mode: PW/PW res: [0x2c086:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8388607) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78f4 expref: 7 pid: 167632 timeout: 20770 lvb_type: 0 00000100:00100000:1.0:1651529961.825993:0:166111:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007053091c pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:166111:1731745997086336:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529961.825993:0:166112:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005b3c5aba pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997086400:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529961.826024:0:166111:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c733e7e6 going to sleep for 6 seconds 00000100:00100000:0.0:1651529961.826028:0:166112:0:(client.c:2492:ptlrpc_set_wait()) set 000000006ea0e913 going to sleep for 6 seconds 00000100:00100000:1.0:1651529961.826320:0:166111:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007053091c pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:166111:1731745997086336:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651529961.826323:0:166112:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005b3c5aba pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997086400:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529961.826328:0:166111:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c55ac1 lrc: 3/0,1 mode: --/PW res: [0x2c085:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529961.826329:0:166112:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55aba lrc: 3/0,1 mode: --/PW res: [0x2c086:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529961.826372:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529961.826383:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529961.826397:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353173248 00010000:00010000:0.0:1651529961.826404:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c55a9e lrc: 4/0,0 mode: PW/PW res: [0x2c085:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78e6 expref: 8 pid: 167632 timeout: 20770 lvb_type: 0 00000100:00100000:1.0:1651529961.826407:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353173312 00010000:00010000:1.0:1651529961.826414:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c55aa5 lrc: 4/0,0 mode: PW/PW res: [0x2c086:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8388607) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78f4 expref: 9 pid: 167632 timeout: 20770 lvb_type: 0 00000100:00100000:0.0:1651529961.826415:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4 00000100:00100000:0.0:1651529961.826417:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438148:x1731754353173248:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1651529961.826420:0:166103:0:(service.c:3189:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 40 00010000:00010000:0.0:1651529961.826421:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529961.826422:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c55a9e lrc: 4/0,0 mode: PW/PW res: [0x2c085:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78e6 expref: 9 pid: 167632 timeout: 20770 lvb_type: 0 00000100:00100000:1.0:1651529961.826423:0:166103:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1651529961.826427:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c55a9e lrc: 3/0,0 mode: PW/PW res: [0x2c085:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78e6 expref: 9 pid: 167632 timeout: 20770 lvb_type: 0 00010000:00010000:0.0:1651529961.826437:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c55a9e lrc: 0/0,0 mode: --/PW res: [0x2c085:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78e6 expref: 9 pid: 167632 timeout: 20770 lvb_type: 0 00010000:00010000:0.0:1651529961.826442:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529961.826442:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529961.826444:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c55ac1 lrc: 3/0,1 mode: PW/PW res: [0x2c085:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529961.826448:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c55ac1 lrc: 4/0,1 mode: PW/PW res: [0x2c085:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529961.826458:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651529961.826471:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438148:x1731754353173248:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 54us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529961.826474:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4 00000100:00100000:0.0:1651529961.826487:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5 00000100:00100000:0.0:1651529961.826489:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b27b58b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438148:x1731754353173312:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651529961.826492:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651529961.826494:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c55aa5 lrc: 4/0,0 mode: PW/PW res: [0x2c086:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8388607) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78f4 expref: 7 pid: 167632 timeout: 20770 lvb_type: 0 00010000:00010000:0.0:1651529961.826497:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c55aa5 lrc: 3/0,0 mode: PW/PW res: [0x2c086:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8388607) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78f4 expref: 7 pid: 167632 timeout: 20770 lvb_type: 0 00010000:00010000:0.0:1651529961.826503:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c55aa5 lrc: 0/0,0 mode: --/PW res: [0x2c086:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8388607) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78f4 expref: 7 pid: 167632 timeout: 20770 lvb_type: 0 00010000:00010000:0.0:1651529961.826509:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529961.826509:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651529961.826510:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55aba lrc: 3/0,1 mode: PW/PW res: [0x2c086:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529961.826513:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55aba lrc: 4/0,1 mode: PW/PW res: [0x2c086:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529961.826518:0:166111:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c55ac1 lrc: 3/0,1 mode: PW/PW res: [0x2c085:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529961.826519:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651529961.826522:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c55ac1 lrc: 3/0,1 mode: PW/PW res: [0x2c085:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529961.826526:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c55ac1 lrc: 3/0,1 mode: PW/PW res: [0x2c085:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529961.826527:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b27b58b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438148:x1731754353173312:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 37us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529961.826529:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5 00010000:00010000:1.0:1651529961.826533:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c55ac1 lrc: 2/0,0 mode: PW/PW res: [0x2c085:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529961.826552:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c55ac1 lrc: 2/0,0 mode: PW/PW res: [0x2c085:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529961.826556:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c0de17df already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529961.826558:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c55ac1 lrc: 2/0,0 mode: PW/PW res: [0x2c085:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529961.826561:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c55ac1 lrc: 3/0,0 mode: PW/PW res: [0x2c085:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529961.826566:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c55ac1 lrc: 1/0,0 mode: --/PW res: [0x2c085:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529961.826569:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c55ac1 lrc: 0/0,0 mode: --/PW res: [0x2c085:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529961.826601:0:166112:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55aba lrc: 3/0,1 mode: PW/PW res: [0x2c086:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529961.826605:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55aba lrc: 3/0,1 mode: PW/PW res: [0x2c086:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529961.826608:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55aba lrc: 3/0,1 mode: PW/PW res: [0x2c086:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529961.826611:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55aba lrc: 2/0,0 mode: PW/PW res: [0x2c086:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529961.826669:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006dd920d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745946844160:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 748us (824us total) trans 21474837322 rc 0/0 00000100:00100000:1.0:1651529961.826673:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 854 00000100:00100000:1.0:1651529961.826679:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 856 00000100:00100000:1.0:1651529961.826681:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007af72033 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946844288:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529961.826686:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180359 count 1 00010000:00010000:1.0:1651529961.826691:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c55ac8 lrc: 3/0,1 mode: --/PW res: [0x2c087:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529961.826696:0:166111:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55aac lrc: 2/0,0 mode: PW/PW res: [0x2c087:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8388608->268435455) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78fb expref: 5 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529961.826699:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529961.826700:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529961.826700:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c55ac8 lrc: 4/0,1 mode: --/PW res: [0x2c087:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529961.826701:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008f7d6b7b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745946844224:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 774us (836us total) trans 21474837323 rc 0/0 00000100:00100000:0.0:1651529961.826705:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 855 00010000:00010000:1.0:1651529961.826707:0:166111:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55aac lrc: 3/0,0 mode: PW/PW res: [0x2c087:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8388608->268435455) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78fb expref: 5 pid: 167632 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529961.826711:0:166111:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55aac lrc: 4/0,0 mode: PW/PW res: [0x2c087:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8388608->268435455) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78fb expref: 5 pid: 167632 timeout: 20770 lvb_type: 0 00000100:00100000:1.0:1651529961.826719:0:166111:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007053091c pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:166111:1731745997086464:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529961.826735:0:166111:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dc2fce04 going to sleep for 6 seconds 00010000:00010000:1.0:1651529961.826741:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55aba lrc: 2/0,0 mode: PW/PW res: [0x2c086:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529961.826744:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009b1b8f74 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651529961.826746:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55aba lrc: 2/0,0 mode: PW/PW res: [0x2c086:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529961.826749:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55aba lrc: 3/0,0 mode: PW/PW res: [0x2c086:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529961.826754:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55aba lrc: 1/0,0 mode: --/PW res: [0x2c086:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529961.826757:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55aba lrc: 0/0,0 mode: --/PW res: [0x2c086:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651529961.827319:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529961.827329:0:166111:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007053091c pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:166111:1731745997086464:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529961.827334:0:166111:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c55ac8 lrc: 3/0,1 mode: --/PW res: [0x2c087:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529961.827342:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353173376 00010000:00010000:1.0:1651529961.827347:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55aac lrc: 4/0,0 mode: PW/PW res: [0x2c087:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8388608->268435455) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78fb expref: 6 pid: 167632 timeout: 20770 lvb_type: 0 00000100:00100000:1.0:1651529961.827362:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6 00000100:00100000:1.0:1651529961.827364:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438147:x1731754353173376:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529961.827367:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529961.827369:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55aac lrc: 4/0,0 mode: PW/PW res: [0x2c087:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8388608->268435455) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78fb expref: 6 pid: 167632 timeout: 20770 lvb_type: 0 00010000:00010000:1.0:1651529961.827373:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55aac lrc: 3/0,0 mode: PW/PW res: [0x2c087:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8388608->268435455) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78fb expref: 6 pid: 167632 timeout: 20770 lvb_type: 0 00010000:00010000:1.0:1651529961.827378:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55aac lrc: 0/0,0 mode: --/PW res: [0x2c087:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8388608->268435455) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f78fb expref: 6 pid: 167632 timeout: 20770 lvb_type: 0 00010000:00010000:1.0:1651529961.827382:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529961.827383:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529961.827384:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c55ac8 lrc: 3/0,1 mode: PW/PW res: [0x2c087:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529961.827387:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c55ac8 lrc: 4/0,1 mode: PW/PW res: [0x2c087:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529961.827393:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529961.827403:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+5:438147:x1731754353173376:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 38us (85us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529961.827405:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6 00010000:00010000:1.0:1651529961.827439:0:166111:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c55ac8 lrc: 3/0,1 mode: PW/PW res: [0x2c087:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529961.827446:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c55ac8 lrc: 3/0,1 mode: PW/PW res: [0x2c087:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529961.827449:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c55ac8 lrc: 3/0,1 mode: PW/PW res: [0x2c087:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529961.827452:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c55ac8 lrc: 2/0,0 mode: PW/PW res: [0x2c087:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529961.827474:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c55ac8 lrc: 2/0,0 mode: PW/PW res: [0x2c087:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529961.827478:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2a86deb already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529961.827479:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c55ac8 lrc: 2/0,0 mode: PW/PW res: [0x2c087:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529961.827483:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c55ac8 lrc: 3/0,0 mode: PW/PW res: [0x2c087:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529961.827491:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c55ac8 lrc: 1/0,0 mode: --/PW res: [0x2c087:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529961.827494:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c55ac8 lrc: 0/0,0 mode: --/PW res: [0x2c087:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529961.827527:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007af72033 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946844288:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 845us (1654us total) trans 21474837324 rc 0/0 00000100:00100000:1.0:1651529961.827530:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 856 00000100:00100000:1.0:1651529962.720214:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529962.720245:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946844416 00000100:00100000:0.0:1651529962.720269:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 59 00000100:00100000:0.0:1651529962.720272:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007053091c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946844416:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651529962.720290:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 135260864 pending 0 free 81309044736 avail 77138333696 00000100:00100000:0.0:1651529962.720317:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007053091c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946844416:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 44us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529962.720320:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 59 00000001:00080000:1.0:1651529966.234114:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474837324 is committed 00000100:00100000:0.0:1651529966.717301:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9063caa-b124-4cb6-99ef-d01a735595c3:39100:1731745997086528:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:1.0:1651529966.717315:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005b3c5aba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:39099:1731745997086592:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:0.0:1651529966.717749:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002b1deba8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9063caa-b124-4cb6-99ef-d01a735595c3:39100:1731745997086528:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:1.0:1651529966.717776:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005b3c5aba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:39099:1731745997086592:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:1.0:1651529967.840244:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529967.840276:0:166115:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946844480 00000100:00100000:0.0:1651529967.840300:0:166115:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 60 00000100:00100000:0.0:1651529967.840302:0:166115:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e85686f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946844480:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651529967.840319:0:166115:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 135260864 pending 0 free 81309044736 avail 77138333696 00000100:00100000:0.0:1651529967.840346:0:166115:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e85686f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946844480:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 43us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529967.840350:0:166115:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 60 00000400:00000080:1.0:1651529969.758921:0:169318:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651529969.758924:0:169318:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 150d: Verify fallocate Size and Blocks - Non zero start ========================================================== 22:19:29 (1651529969) 00000100:00100000:1.0:1651529970.019978:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529970.019996:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353174336 00000100:00100000:1.0:1651529970.020019:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 857 00000100:00100000:1.0:1651529970.020021:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001faa7f64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+5:455478:x1731754353174336:12345-10.240.43.64@tcp:101:fallocate.0 00010000:00010000:1.0:1651529970.020031:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529970.020042:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55acf lrc: 2/0,0 mode: --/PW res: [0x2c089:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db2f7933 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529970.020053:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c089:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529970.020074:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529970.020075:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529970.020080:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55acf lrc: 3/0,0 mode: PW/PW res: [0x2c089:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 536870912->537919487) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7933 expref: 6 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529970.020088:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55acf lrc: 3/0,0 mode: PW/PW res: [0x2c089:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 536870912->537919487) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7933 expref: 6 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529970.020094:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c2d8d18b, rc 0) 00000100:00100000:1.0:1651529970.020120:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001faa7f64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+6:455478:x1731754353174336:12345-10.240.43.64@tcp:101:fallocate.0 Request processed in 98us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529970.020123:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 857 00000100:00100000:1.0:1651529970.020972:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529970.020980:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353174464 00000100:00100000:1.0:1651529970.020993:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 858 00000100:00100000:1.0:1651529970.020995:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047d5dd29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438146:x1731754353174464:12345-10.240.43.64@tcp:22:fallocate.0 00002000:00010000:1.0:1651529970.021114:0:166111:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2c089:0x0] updating lvb size from disk: 0 -> 537919488 00002000:00010000:1.0:1651529970.021116:0:166111:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2c089:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1651529970.021117:0:166111:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2c089:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529970.021117:0:166111:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2c089:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1651529970.021118:0:166111:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2c089:0x0] updating lvb blocks from disk: 0 -> 2048 00000100:00100000:1.0:1651529970.021136:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047d5dd29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438146:x1731754353174464:12345-10.240.43.64@tcp:22:fallocate.0 Request processed in 140us (164us total) trans 21474837325 rc 0/0 00000100:00100000:1.0:1651529970.021141:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 858 00000100:00100000:1.0:1651529970.045944:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529970.045954:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353174720 00000100:00100000:1.0:1651529970.045967:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 859 00000100:00100000:1.0:1651529970.045969:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000583639e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438146:x1731754353174720:12345-10.240.43.64@tcp:16:fallocate.0 00000001:00080000:1.0:1651529970.077661:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474837325 is committed 00000100:00100000:1.0:1651529970.077689:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000583639e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438146:x1731754353174720:12345-10.240.43.64@tcp:16:fallocate.0 Request processed in 31719us (31745us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529970.077693:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 859 00000400:00000080:0.0:1651529972.808904:0:169536:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651529972.808907:0:169536:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 150e: Verify 60% of available OST space consumed by fallocate ========================================================== 22:19:32 (1651529972) 00000100:00100000:1.0:1651529972.960150:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529972.960182:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946844736 00000100:00100000:0.0:1651529972.960203:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 61 00000100:00100000:0.0:1651529972.960206:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000315faada pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946844736:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651529972.960238:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 135260864 pending 0 free 81307996160 avail 77137285120 00000100:00100000:0.0:1651529972.960266:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000315faada pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946844736:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 59us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529972.960269:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 61 00000100:00100000:1.0:1651529973.053442:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529973.053461:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353175424 00000100:00100000:0.0:1651529973.053477:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 62 00000100:00100000:0.0:1651529973.053479:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a8bb9985 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cccc371e-feb6-4a45-b229-8d88a861b48a+6:456200:x1731754353175424:12345-10.240.43.64@tcp:13:lfs.0 00002000:00000024:0.0:1651529973.053484:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 135260864 pending 0 free 81307996160 avail 77137285120 00000100:00100000:0.0:1651529973.053502:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a8bb9985 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cccc371e-feb6-4a45-b229-8d88a861b48a+6:456200:x1731754353175424:12345-10.240.43.64@tcp:13:lfs.0 Request processed in 23us (61us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529973.053505:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 62 00000100:00100000:1.0:1651529973.078586:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529973.078596:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353176320 00000100:00100000:1.0:1651529973.078613:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 860 00000100:00100000:1.0:1651529973.078615:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000035de0fa0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+6:456209:x1731754353176320:12345-10.240.43.64@tcp:101:fallocate.0 00010000:00010000:1.0:1651529973.078621:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651529973.078630:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c55ad6 lrc: 2/0,0 mode: --/PW res: [0x2c08a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db2f7980 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651529973.078641:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c08a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651529973.078650:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529973.078651:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529973.078656:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c55ad6 lrc: 3/0,0 mode: PW/PW res: [0x2c08a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7980 expref: 7 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529973.078662:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c55ad6 lrc: 3/0,0 mode: PW/PW res: [0x2c08a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7980 expref: 7 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529973.078668:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d84ad17b, rc 0) 00000100:00100000:1.0:1651529973.078685:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000035de0fa0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+7:456209:x1731754353176320:12345-10.240.43.64@tcp:101:fallocate.0 Request processed in 69us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529973.078688:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 860 00000100:00100000:1.0:1651529973.078982:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529973.078991:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353176448 00000100:00100000:1.0:1651529973.079004:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 861 00000100:00100000:1.0:1651529973.079005:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000567318ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438149:x1731754353176448:12345-10.240.43.64@tcp:22:fallocate.0 00002000:00010000:1.0:1651529973.079140:0:166111:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2c08a:0x0] updating lvb size from disk: 0 -> 104857600 00002000:00010000:1.0:1651529973.079142:0:166111:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2c08a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1651529973.079143:0:166111:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2c08a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651529973.079144:0:166111:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2c08a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1651529973.079145:0:166111:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2c08a:0x0] updating lvb blocks from disk: 0 -> 204800 00000100:00100000:1.0:1651529973.079162:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000567318ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438149:x1731754353176448:12345-10.240.43.64@tcp:22:fallocate.0 Request processed in 155us (180us total) trans 21474837326 rc 0/0 00000100:00100000:1.0:1651529973.079166:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 861 00000100:00100000:1.0:1651529973.148393:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529973.148402:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353176640 00000100:00100000:1.0:1651529973.148416:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 862 00000100:00100000:1.0:1651529973.148418:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003ffbc5dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438149:x1731754353176640:12345-10.240.43.64@tcp:16:fallocate.0 00000001:00080000:1.0:1651529973.181383:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474837326 is committed 00000100:00100000:1.0:1651529973.181412:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003ffbc5dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438149:x1731754353176640:12345-10.240.43.64@tcp:16:fallocate.0 Request processed in 32993us (33020us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529973.181416:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 862 00000100:00100000:1.0:1651529975.195900:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651529975.195925:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353177024 00000100:00100000:0.0:1651529975.195941:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 63 00000100:00100000:0.0:1651529975.195943:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004c5dc988 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cccc371e-feb6-4a45-b229-8d88a861b48a+7:456213:x1731754353177024:12345-10.240.43.64@tcp:13:lfs.0 00002000:00000024:0.0:1651529975.195951:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 135260864 pending 0 free 81203138560 avail 77032427520 00000100:00100000:0.0:1651529975.195966:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004c5dc988 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cccc371e-feb6-4a45-b229-8d88a861b48a+7:456213:x1731754353177024:12345-10.240.43.64@tcp:13:lfs.0 Request processed in 22us (68us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529975.195969:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 63 00000100:00100000:1.0:1651529975.714504:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529975.714524:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946844928 00000100:00100000:1.0:1651529975.714550:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 863 00000100:00100000:1.0:1651529975.714553:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946844928:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651529975.714570:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180362 count 1 00010000:00010000:1.0:1651529975.714584:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55add lrc: 3/0,1 mode: --/PW res: [0x2c08a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529975.714595:0:166111:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c55ad6 lrc: 2/0,0 mode: PW/PW res: [0x2c08a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7980 expref: 6 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529975.714599:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529975.714600:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651529975.714602:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55add lrc: 4/0,1 mode: --/PW res: [0x2c08a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529975.714617:0:166111:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c55ad6 lrc: 3/0,0 mode: PW/PW res: [0x2c08a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7980 expref: 6 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529975.714622:0:166111:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c55ad6 lrc: 4/0,0 mode: PW/PW res: [0x2c08a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7980 expref: 6 pid: 166111 timeout: 20784 lvb_type: 0 00000100:00100000:1.0:1651529975.714629:0:166111:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d6486d55 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:166111:1731745997086656:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651529975.714661:0:166111:0:(client.c:2492:ptlrpc_set_wait()) set 00000000382cf590 going to sleep for 6 seconds 00000100:00100000:1.0:1651529975.715025:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529975.715035:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353177280 00010000:00010000:1.0:1651529975.715042:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c55ad6 lrc: 5/0,0 mode: PW/PW res: [0x2c08a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7980 expref: 7 pid: 166111 timeout: 20784 lvb_type: 0 00000100:00100000:1.0:1651529975.715055:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 7 00000100:00100000:1.0:1651529975.715057:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438149:x1731754353177280:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651529975.715062:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651529975.715064:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c55ad6 lrc: 5/0,0 mode: PW/PW res: [0x2c08a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7980 expref: 7 pid: 166111 timeout: 20784 lvb_type: 0 00010000:00010000:1.0:1651529975.715079:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c55ad6 lrc: 4/0,0 mode: PW/PW res: [0x2c08a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7980 expref: 7 pid: 166111 timeout: 20784 lvb_type: 0 00010000:00010000:1.0:1651529975.715090:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529975.715091:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651529975.715092:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55add lrc: 3/0,1 mode: PW/PW res: [0x2c08a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529975.715096:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55add lrc: 4/0,1 mode: PW/PW res: [0x2c08a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529975.715103:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651529975.715120:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438149:x1731754353177280:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 61us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529975.715125:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 7 00010000:00010000:1.0:1651529975.715146:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c55ad6 lrc: 0/0,0 mode: --/PW res: [0x2c08a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7980 expref: 6 pid: 166111 timeout: 20784 lvb_type: 0 00000100:00100000:1.0:1651529975.715154:0:166111:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d6486d55 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:166111:1731745997086656:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651529975.715161:0:166111:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55add lrc: 3/0,1 mode: PW/PW res: [0x2c08a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529975.715177:0:166111:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55add lrc: 3/0,1 mode: PW/PW res: [0x2c08a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529975.715180:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55add lrc: 3/0,1 mode: PW/PW res: [0x2c08a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529975.715184:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55add lrc: 3/0,1 mode: PW/PW res: [0x2c08a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651529975.715187:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55add lrc: 2/0,0 mode: PW/PW res: [0x2c08a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529975.715249:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55add lrc: 2/0,0 mode: PW/PW res: [0x2c08a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529975.715259:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000029b2a516 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651529975.715261:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55add lrc: 2/0,0 mode: PW/PW res: [0x2c08a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529975.715265:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55add lrc: 3/0,0 mode: PW/PW res: [0x2c08a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529975.715272:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55add lrc: 1/0,0 mode: --/PW res: [0x2c08a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651529975.715275:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55add lrc: 0/0,0 mode: --/PW res: [0x2c08a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651529975.715343:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946844928:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 789us (844us total) trans 21474837327 rc 0/0 00000100:00100000:1.0:1651529975.715347:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 863 00000100:00100000:0.0:1651529978.080162:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529978.080180:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946845120 00000100:00100000:0.0:1651529978.080206:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 64 00000100:00100000:0.0:1651529978.080209:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946845120:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651529978.080241:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 135260864 pending 0 free 81307996160 avail 77137285120 00000100:00100000:0.0:1651529978.080271:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946845120:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 61us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529978.080274:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 64 00000001:00080000:1.0:1651529981.078051:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474837327 is committed 00000100:00100000:0.0:1651529983.200277:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651529983.200297:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529983.200310:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946845312 00000100:00100000:0.0:1651529983.200310:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946845376 00000100:00100000:0.0:1651529983.200337:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 65 00000100:00100000:1.0:1651529983.200338:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 6 00000100:00100000:0.0:1651529983.200340:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946845376:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00000100:00100000:1.0:1651529983.200341:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946845312:12345-10.240.43.61@tcp:400:kworker/u4:0.0 00002000:00000024:0.0:1651529983.200358:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 135260864 pending 0 free 81307996160 avail 77137285120 00000100:00100000:1.0:1651529983.200375:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946845312:12345-10.240.43.61@tcp:400:kworker/u4:0.0 Request processed in 34us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1651529983.200378:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946845376:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 38us (81us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529983.200379:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 6 00000100:00100000:0.0:1651529983.200382:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 65 00000100:00100000:0.0:1651529984.559370:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651529984.559406:0:166115:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353177472 00000100:00100000:1.0:1651529984.559433:0:166115:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 66 00000100:00100000:1.0:1651529984.559435:0:166115:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cccc371e-feb6-4a45-b229-8d88a861b48a+6:456622:x1731754353177472:12345-10.240.43.64@tcp:13:lfs.0 00002000:00000024:1.0:1651529984.559454:0:166115:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 135260864 pending 0 free 81307996160 avail 77137285120 00000100:00100000:1.0:1651529984.559485:0:166115:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cccc371e-feb6-4a45-b229-8d88a861b48a+6:456622:x1731754353177472:12345-10.240.43.64@tcp:13:lfs.0 Request processed in 49us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529984.559488:0:166115:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 66 00000400:00000080:1.0:1651529987.298655:0:169755:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651529987.298658:0:169755:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 150f: Verify fallocate punch functionality ========================================================== 22:19:47 (1651529987) 00000100:00100000:0.0:1651529988.320200:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529988.320238:0:166115:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946845632 00000100:00100000:1.0:1651529988.320263:0:166115:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 67 00000100:00100000:1.0:1651529988.320266:0:166115:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0bff89e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946845632:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651529988.320283:0:166115:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 135260864 pending 0 free 81307996160 avail 77137285120 00000100:00100000:1.0:1651529988.320310:0:166115:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0bff89e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946845632:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 44us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529988.320314:0:166115:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 67 00000100:00100000:0.0:1651529991.805318:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000fe04db9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9063caa-b124-4cb6-99ef-d01a735595c3:39100:1731745997086720:10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00100000:1.0:1651529991.805323:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000056e45ef2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:39099:1731745997086784:10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00100000:1.0:1651529991.807300:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000056e45ef2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:39099:1731745997086784:10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00100000:0.0:1651529991.807305:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000fe04db9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9063caa-b124-4cb6-99ef-d01a735595c3:39100:1731745997086720:10.240.43.61@tcp:400:kworker/u4:1.0 00000100:00100000:0.0:1651529993.440187:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529993.440233:0:166115:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946845824 00000100:00100000:1.0:1651529993.440259:0:166115:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 68 00000100:00100000:1.0:1651529993.440262:0:166115:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dbfb14b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946845824:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651529993.440280:0:166115:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 135260864 pending 0 free 81307996160 avail 77137285120 00000100:00100000:1.0:1651529993.440309:0:166115:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dbfb14b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946845824:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 47us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529993.440313:0:166115:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 68 00000100:00100000:0.0:1651529998.560172:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651529998.560215:0:166115:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946846080 00000100:00100000:1.0:1651529998.560254:0:166115:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 69 00000100:00100000:1.0:1651529998.560257:0:166115:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000fe04db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946846080:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651529998.560275:0:166115:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 135260864 pending 0 free 81307996160 avail 77137285120 00000100:00100000:1.0:1651529998.560305:0:166115:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000fe04db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946846080:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 48us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1651529998.560309:0:166115:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 69 00000400:00000080:0.0:1651530000.818982:0:169973:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530000.818984:0:169973:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 150g: Verify fallocate punch on large range ========================================================== 22:20:00 (1651530000) 00000100:00100000:0.0:1651530001.085363:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530001.085380:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353181312 00000100:00100000:0.0:1651530001.085406:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 864 00000100:00100000:0.0:1651530001.085408:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000020362888 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+6:458480:x1731754353181312:12345-10.240.43.64@tcp:101:fallocate.0 00010000:00010000:0.0:1651530001.085418:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651530001.085429:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55ae4 lrc: 2/0,0 mode: --/PW res: [0x2c08b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db2f79f7 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651530001.085441:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c08b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651530001.085450:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530001.085451:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530001.085457:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55ae4 lrc: 3/0,0 mode: PW/PW res: [0x2c08b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f79f7 expref: 7 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530001.085467:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55ae4 lrc: 3/0,0 mode: PW/PW res: [0x2c08b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f79f7 expref: 7 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530001.085473:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000092ad010c, rc 0) 00000100:00100000:0.0:1651530001.085498:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000020362888 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+7:458480:x1731754353181312:12345-10.240.43.64@tcp:101:fallocate.0 Request processed in 89us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530001.085502:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 864 00000100:00100000:0.0:1651530001.085814:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530001.085823:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353181440 00000100:00100000:0.0:1651530001.085835:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 865 00000100:00100000:0.0:1651530001.085837:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068b6c75f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438149:x1731754353181440:12345-10.240.43.64@tcp:22:fallocate.0 00002000:00010000:0.0:1651530001.085954:0:166112:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2c08b:0x0] updating lvb size from disk: 0 -> 104857600 00002000:00010000:0.0:1651530001.085956:0:166112:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2c08b:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1651530001.085957:0:166112:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2c08b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651530001.085958:0:166112:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2c08b:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1651530001.085959:0:166112:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2c08b:0x0] updating lvb blocks from disk: 0 -> 204800 00000100:00100000:0.0:1651530001.085977:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068b6c75f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438149:x1731754353181440:12345-10.240.43.64@tcp:22:fallocate.0 Request processed in 138us (162us total) trans 21474837328 rc 0/0 00000100:00100000:0.0:1651530001.085980:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 865 00000100:00100000:0.0:1651530001.112898:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530001.112907:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353181632 00000100:00100000:0.0:1651530001.112921:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 866 00000100:00100000:0.0:1651530001.112923:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5ebc6ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438149:x1731754353181632:12345-10.240.43.64@tcp:16:fallocate.0 00000001:00080000:0.0:1651530001.145895:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474837328 is committed 00000100:00100000:0.0:1651530001.145923:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5ebc6ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438149:x1731754353181632:12345-10.240.43.64@tcp:16:fallocate.0 Request processed in 32998us (33025us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530001.145927:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 866 00000100:00100000:0.0:1651530001.150563:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530001.150573:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353182208 00002000:00010000:0.0:1651530001.150580:0:166118:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 180363/0 (0->18446744073709551615) 00002000:00100000:0.0:1651530001.150581:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000597d93ff with x1731754353182208 ext(0->18446744073709551615) 00002000:00010000:0.0:1651530001.150585:0:166118:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000597d93ff. 00000100:00100000:0.0:1651530001.150598:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 32 00000100:00100000:0.0:1651530001.150600:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000597d93ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438149:x1731754353182208:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651530001.150659:0:166118:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2c08b:0x0] updating lvb size from disk: 104857600 -> 0 00002000:00010000:0.0:1651530001.150660:0:166118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2c08b:0x0] updating lvb mtime from disk: 0 -> 1651530001 00002000:00010000:0.0:1651530001.150661:0:166118:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2c08b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651530001.150662:0:166118:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2c08b:0x0] updating lvb ctime from disk: 0 -> 1651530001 00002000:00010000:0.0:1651530001.150663:0:166118:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2c08b:0x0] updating lvb blocks from disk: 204800 -> 0 00000100:00100000:0.0:1651530001.150681:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000597d93ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438149:x1731754353182208:12345-10.240.43.64@tcp:10:dd.0 Request processed in 79us (118us total) trans 21474837329 rc 0/0 00000100:00100000:0.0:1651530001.150684:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 32 00002000:00010000:0.0:1651530001.150685:0:166118:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 180363/0 (0->18446744073709551615) 00002000:00100000:0.0:1651530001.150686:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000597d93ff with x1731754353182208 ext(0->18446744073709551615) 00002000:00010000:0.0:1651530001.150688:0:166118:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000597d93ff. 00000100:00100000:0.0:1651530001.183418:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530001.183426:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353182464 00002000:00010000:0.0:1651530001.183432:0:166118:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 180363/0 (103809024->18446744073709551615) 00002000:00100000:0.0:1651530001.183433:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000dabd64d3 with x1731754353182464 ext(103809024->18446744073709551615) 00002000:00010000:0.0:1651530001.183435:0:166118:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000dabd64d3. 00000100:00100000:0.0:1651530001.183447:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 33 00000100:00100000:0.0:1651530001.183449:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dabd64d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438147:x1731754353182464:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651530001.183476:0:166118:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2c08b:0x0] updating lvb size from disk: 0 -> 103809024 00002000:00010000:0.0:1651530001.183477:0:166118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2c08b:0x0] updating lvb mtime from disk: 1651530001 -> 1651530001 00002000:00010000:0.0:1651530001.183478:0:166118:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2c08b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651530001.183479:0:166118:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2c08b:0x0] updating lvb ctime from disk: 1651530001 -> 1651530001 00002000:00010000:0.0:1651530001.183480:0:166118:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2c08b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651530001.183497:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dabd64d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438147:x1731754353182464:12345-10.240.43.64@tcp:10:dd.0 Request processed in 47us (80us total) trans 21474837330 rc 0/0 00000100:00100000:0.0:1651530001.183500:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 33 00002000:00010000:0.0:1651530001.183501:0:166118:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 180363/0 (103809024->18446744073709551615) 00002000:00100000:0.0:1651530001.183502:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000dabd64d3 with x1731754353182464 ext(103809024->18446744073709551615) 00002000:00010000:0.0:1651530001.183504:0:166118:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000dabd64d3. 00000100:00100000:0.0:1651530001.214354:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530001.214362:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353182720 00002000:00010000:0.0:1651530001.214367:0:166118:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 180363/0 (52428800->18446744073709551615) 00002000:00100000:0.0:1651530001.214368:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000eff08db4 with x1731754353182720 ext(52428800->18446744073709551615) 00002000:00010000:0.0:1651530001.214371:0:166118:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000eff08db4. 00000100:00100000:0.0:1651530001.214382:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 34 00000100:00100000:0.0:1651530001.214383:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eff08db4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438149:x1731754353182720:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651530001.214410:0:166118:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2c08b:0x0] updating lvb size from disk: 103809024 -> 52428800 00002000:00010000:0.0:1651530001.214411:0:166118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2c08b:0x0] updating lvb mtime from disk: 1651530001 -> 1651530001 00002000:00010000:0.0:1651530001.214412:0:166118:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2c08b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651530001.214413:0:166118:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2c08b:0x0] updating lvb ctime from disk: 1651530001 -> 1651530001 00002000:00010000:0.0:1651530001.214414:0:166118:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2c08b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651530001.214431:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eff08db4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+10:438149:x1731754353182720:12345-10.240.43.64@tcp:10:dd.0 Request processed in 46us (77us total) trans 21474837331 rc 0/0 00000100:00100000:0.0:1651530001.214434:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 34 00002000:00010000:0.0:1651530001.214435:0:166118:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 180363/0 (52428800->18446744073709551615) 00002000:00100000:0.0:1651530001.214436:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000eff08db4 with x1731754353182720 ext(52428800->18446744073709551615) 00002000:00010000:0.0:1651530001.214438:0:166118:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000eff08db4. 00000100:00100000:0.0:1651530001.343017:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530001.343025:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353183360 00002000:00100000:0.0:1651530001.343034:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c08b:0x0] (52428800->54525951) req@00000000df603127 x1731754353183360/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:727/0 lens 488/0 e 0 to 0 dl 1651530007 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651530001.343038:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000df603127 with x1731754353183360 ext(52428800->54525951) 00002000:00010000:0.0:1651530001.343040:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000df603127 00000100:00100000:0.0:1651530001.343052:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 35 00000100:00100000:0.0:1651530001.343053:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df603127 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+10:438149:x1731754353183360:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651530001.347119:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df603127 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+12:438149:x1731754353183360:12345-10.240.43.64@tcp:4:dd.0 Request processed in 4063us (4101us total) trans 21474837332 rc 0/0 00000100:00100000:0.0:1651530001.347123:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 35 00002000:00100000:0.0:1651530001.347127:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c08b:0x0] (52428800->54525951) req@00000000df603127 x1731754353183360/t21474837332(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:727/0 lens 488/448 e 0 to 0 dl 1651530007 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651530001.347131:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000df603127 with x1731754353183360 ext(52428800->54525951) 00002000:00010000:0.0:1651530001.347133:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000df603127 00000100:00100000:0.0:1651530001.347971:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530001.347980:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353183424 00000100:00100000:0.0:1651530001.347994:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 867 00000100:00100000:0.0:1651530001.347996:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005529fd8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+12:438149:x1731754353183424:12345-10.240.43.64@tcp:22:fallocate.0 00002000:00010000:0.0:1651530001.348266:0:166112:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2c08b:0x0] updating lvb size from disk: 52428800 -> 54525952 00002000:00010000:0.0:1651530001.348268:0:166112:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2c08b:0x0] updating lvb mtime from disk: 1651530001 -> 1651530001 00002000:00010000:0.0:1651530001.348269:0:166112:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2c08b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651530001.348270:0:166112:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2c08b:0x0] updating lvb ctime from disk: 1651530001 -> 1651530001 00002000:00010000:0.0:1651530001.348271:0:166112:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2c08b:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1651530001.348288:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005529fd8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+13:438149:x1731754353183424:12345-10.240.43.64@tcp:22:fallocate.0 Request processed in 291us (318us total) trans 21474837333 rc 0/0 00000100:00100000:0.0:1651530001.348291:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 867 00000100:00100000:0.0:1651530001.348931:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530001.348939:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353183616 00000100:00100000:0.0:1651530001.348953:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 868 00000100:00100000:0.0:1651530001.348955:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003132c0c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+13:438148:x1731754353183616:12345-10.240.43.64@tcp:16:fallocate.0 00000001:00080000:0.0:1651530001.528200:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474837333 is committed 00000100:00100000:0.0:1651530001.528241:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003132c0c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438148:x1731754353183616:12345-10.240.43.64@tcp:16:fallocate.0 Request processed in 179285us (179309us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530001.528245:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 868 00000100:00100000:0.0:1651530001.539688:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530001.539696:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353184128 00000100:00100000:0.0:1651530001.539709:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 869 00000100:00100000:0.0:1651530001.539711:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9b0314b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438147:x1731754353184128:12345-10.240.43.64@tcp:23:lseek_test.0 00000100:00100000:0.0:1651530001.539750:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9b0314b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438147:x1731754353184128:12345-10.240.43.64@tcp:23:lseek_test.0 Request processed in 38us (63us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530001.539753:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 869 00000100:00100000:0.0:1651530001.542200:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530001.542208:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353184256 00000100:00100000:0.0:1651530001.542236:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 870 00000100:00100000:0.0:1651530001.542238:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0bff89e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438147:x1731754353184256:12345-10.240.43.64@tcp:23:lseek_test.0 00000100:00100000:0.0:1651530001.542261:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0bff89e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438147:x1731754353184256:12345-10.240.43.64@tcp:23:lseek_test.0 Request processed in 23us (61us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530001.542264:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 870 00000100:00100000:0.0:1651530002.939859:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651530002.939879:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946846464 00000100:00100000:0.0:1651530002.939907:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 871 00000100:00100000:0.0:1651530002.939909:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000056e45ef2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946846464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651530002.939927:0:166112:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180363 count 1 00010000:00010000:0.0:1651530002.939941:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c55aeb lrc: 3/0,1 mode: --/PW res: [0x2c08b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530002.939952:0:166112:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55ae4 lrc: 2/0,0 mode: PW/PW res: [0x2c08b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f79f7 expref: 6 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530002.939956:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651530002.939957:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651530002.939958:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c55aeb lrc: 4/0,1 mode: --/PW res: [0x2c08b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530002.939974:0:166112:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55ae4 lrc: 3/0,0 mode: PW/PW res: [0x2c08b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f79f7 expref: 6 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530002.939979:0:166112:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55ae4 lrc: 4/0,0 mode: PW/PW res: [0x2c08b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f79f7 expref: 6 pid: 166112 timeout: 20811 lvb_type: 0 00000100:00100000:0.0:1651530002.939985:0:166112:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d9e38e3b pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997086848:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651530002.940019:0:166112:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bd9ed213 going to sleep for 6 seconds 00000100:00100000:0.0:1651530002.940396:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530002.940416:0:166112:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d9e38e3b pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997086848:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651530002.940423:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353184640 00010000:00010000:0.0:1651530002.940424:0:166112:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c55aeb lrc: 3/0,1 mode: --/PW res: [0x2c08b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530002.940435:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55ae4 lrc: 4/0,0 mode: PW/PW res: [0x2c08b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f79f7 expref: 7 pid: 166112 timeout: 20811 lvb_type: 0 00000100:00100000:1.0:1651530002.940451:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 8 00000100:00100000:1.0:1651530002.940453:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008cca9da pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438147:x1731754353184640:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651530002.940458:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651530002.940460:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55ae4 lrc: 4/0,0 mode: PW/PW res: [0x2c08b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f79f7 expref: 7 pid: 166112 timeout: 20811 lvb_type: 0 00010000:00010000:1.0:1651530002.940465:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55ae4 lrc: 3/0,0 mode: PW/PW res: [0x2c08b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f79f7 expref: 7 pid: 166112 timeout: 20811 lvb_type: 0 00010000:00010000:1.0:1651530002.940475:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55ae4 lrc: 0/0,0 mode: --/PW res: [0x2c08b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->104857599) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f79f7 expref: 7 pid: 166112 timeout: 20811 lvb_type: 0 00010000:00010000:1.0:1651530002.940480:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530002.940481:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530002.940482:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c55aeb lrc: 3/0,1 mode: PW/PW res: [0x2c08b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530002.940489:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c55aeb lrc: 4/0,1 mode: PW/PW res: [0x2c08b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530002.940502:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651530002.940514:0:166112:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c55aeb lrc: 3/0,1 mode: PW/PW res: [0x2c08b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530002.940516:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008cca9da pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438147:x1731754353184640:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 63us (121us total) trans 0 rc 0/0 00010000:00010000:0.0:1651530002.940518:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c55aeb lrc: 3/0,1 mode: PW/PW res: [0x2c08b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530002.940520:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 8 00010000:00010000:0.0:1651530002.940522:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c55aeb lrc: 3/0,1 mode: PW/PW res: [0x2c08b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530002.940525:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c55aeb lrc: 2/0,0 mode: PW/PW res: [0x2c08b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530002.940566:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c55aeb lrc: 2/0,0 mode: PW/PW res: [0x2c08b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530002.940571:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002082f759 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651530002.940572:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c55aeb lrc: 2/0,0 mode: PW/PW res: [0x2c08b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530002.940576:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c55aeb lrc: 3/0,0 mode: PW/PW res: [0x2c08b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530002.940581:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c55aeb lrc: 1/0,0 mode: --/PW res: [0x2c08b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530002.940584:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c55aeb lrc: 0/0,0 mode: --/PW res: [0x2c08b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651530002.940662:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000056e45ef2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946846464:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 751us (807us total) trans 21474837334 rc 0/0 00000100:00100000:0.0:1651530002.940666:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 871 00000100:00100000:1.0:1651530003.680217:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651530003.680264:0:166115:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946846592 00000100:00100000:0.0:1651530003.680287:0:166115:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 70 00000100:00100000:0.0:1651530003.680290:0:166115:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a8bb9985 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946846592:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651530003.680307:0:166115:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140503744 pending 0 free 81307996160 avail 77137285120 00000100:00100000:0.0:1651530003.680334:0:166115:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a8bb9985 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946846592:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 44us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530003.680338:0:166115:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 70 00000001:00080000:0.0:1651530008.216284:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474837334 is committed 00000100:00100000:1.0:1651530008.800221:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651530008.800262:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946846720 00000100:00100000:0.0:1651530008.800285:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 71 00000100:00100000:0.0:1651530008.800287:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004c5dc988 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946846720:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651530008.800304:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140503744 pending 0 free 81307996160 avail 77137285120 00000100:00100000:0.0:1651530008.800332:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004c5dc988 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946846720:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 44us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530008.800336:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 71 00000400:00000080:1.0:1651530010.885916:0:170191:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651530010.885919:0:170191:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 151: test cache on oss and controls ========================================================================================= 22:20:10 (1651530010) 00000100:00100000:1.0:1651530012.159276:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530012.159294:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353185984 00000100:00100000:1.0:1651530012.159325:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 1 00000100:00100000:1.0:1651530012.159328:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+6:451155:x1731754353185984:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651530012.159341:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651530012.159366:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55acf lrc: 0/0,0 mode: --/PW res: [0x2c089:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 536870912->537919487) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7933 expref: 6 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530012.159380:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651530012.159406:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+5:451155:x1731754353185984:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 77us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530012.159409:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 1 00000100:00100000:1.0:1651530012.411200:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530012.411237:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353187264 00000100:00100000:0.0:1651530012.411259:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 872 00000100:00100000:0.0:1651530012.411261:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+5:459764:x1731754353187264:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651530012.411271:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651530012.411282:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c55af2 lrc: 2/0,0 mode: --/PW res: [0x2c08c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db2f7a6e expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651530012.411293:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c08c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651530012.411302:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530012.411303:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530012.411309:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c55af2 lrc: 3/0,0 mode: PW/PW res: [0x2c08c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7a6e expref: 6 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530012.411326:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c55af2 lrc: 3/0,0 mode: PW/PW res: [0x2c08c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7a6e expref: 6 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530012.411332:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008119f3a8, rc 0) 00000100:00100000:0.0:1651530012.411355:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+6:459764:x1731754353187264:12345-10.240.43.64@tcp:101:dd.0 Request processed in 93us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530012.411358:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 872 00000100:00100000:0.0:1651530012.645754:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530012.645781:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353187520 00002000:00100000:0.0:1651530012.645801:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c08c:0x0] (0->16383) req@00000000d9e38e3b x1731754353187520/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:738/0 lens 16872/0 e 0 to 0 dl 1651530018 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651530012.645807:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d9e38e3b with x1731754353187520 ext(0->16383) 00002000:00010000:0.0:1651530012.645810:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000d9e38e3b 00000100:00100000:0.0:1651530012.645825:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 36 00000100:00100000:0.0:1651530012.645827:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9e38e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438147:x1731754353187520:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651530012.646241:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9e38e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438147:x1731754353187520:12345-10.240.43.64@tcp:4:dd.0 Request processed in 412us (488us total) trans 21474837335 rc 0/0 00000100:00100000:0.0:1651530012.646246:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 36 00002000:00100000:0.0:1651530012.646249:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c08c:0x0] (0->16383) req@00000000d9e38e3b x1731754353187520/t21474837335(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:738/0 lens 16872/448 e 0 to 0 dl 1651530018 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651530012.646254:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d9e38e3b with x1731754353187520 ext(0->16383) 00002000:00010000:0.0:1651530012.646255:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000d9e38e3b 00000100:00100000:0.0:1651530012.646519:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530012.646530:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353187584 00000100:00100000:0.0:1651530012.646546:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 2 00000100:00100000:0.0:1651530012.646548:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001832a3d0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+8:451155:x1731754353187584:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651530012.646553:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1651530012.646558:0:166102:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2c08c:0x0] updating lvb size from disk: 0 -> 16384 00002000:00010000:0.0:1651530012.646559:0:166102:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2c08c:0x0] updating lvb mtime from disk: 0 -> 1651530012 00002000:00010000:0.0:1651530012.646560:0:166102:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2c08c:0x0] updating lvb ctime from disk: 0 -> 1651530012 00002000:00010000:0.0:1651530012.646561:0:166102:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2c08c:0x0] updating lvb blocks from disk: 0 -> 32 00010000:00010000:0.0:1651530012.646571:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c55af2 lrc: 0/0,0 mode: --/PW res: [0x2c08c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7a6e expref: 8 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530012.646580:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651530012.646591:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001832a3d0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+7:451155:x1731754353187584:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 42us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530012.646594:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 2 00000100:00100000:0.0:1651530012.654534:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530012.654544:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353187904 00000100:00100000:0.0:1651530012.654558:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 873 00000100:00100000:0.0:1651530012.654560:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095f2cd7b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438149:x1731754353187904:12345-10.240.43.64@tcp:101:cat.0 00010000:00010000:0.0:1651530012.654564:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651530012.654569:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c55af9 lrc: 2/0,0 mode: --/PR res: [0x2c08c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db2f7a83 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651530012.654576:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c08c:0x0] initial LVB size: 16384, mtime: 0x6270591c, atime: 0x0, ctime: 0x6270591c, blocks: 0x20 00010000:00010000:0.0:1651530012.654582:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530012.654583:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530012.654586:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c55af9 lrc: 3/0,0 mode: PR/PR res: [0x2c08c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7a83 expref: 8 pid: 166112 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530012.654592:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c55af9 lrc: 3/0,0 mode: PR/PR res: [0x2c08c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7a83 expref: 8 pid: 166112 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530012.654597:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008119f3a8, rc 0) 00000100:00100000:0.0:1651530012.654608:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095f2cd7b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438149:x1731754353187904:12345-10.240.43.64@tcp:101:cat.0 Request processed in 48us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530012.654611:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 873 00000100:00100000:0.0:1651530012.656535:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530012.656543:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353188032 00002000:00100000:0.0:1651530012.656551:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c08c:0x0] (0->4194303) req@00000000a4b08118 x1731754353188032/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:738/0 lens 488/0 e 0 to 0 dl 1651530018 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cat.0' 00002000:00100000:0.0:1651530012.656555:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a4b08118 with x1731754353188032 ext(0->4194303) 00002000:00010000:0.0:1651530012.656556:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000a4b08118 00000100:00100000:0.0:1651530012.656567:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 37 00000100:00100000:0.0:1651530012.656569:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a4b08118 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438148:x1731754353188032:12345-10.240.43.64@tcp:3:cat.0 00000100:00100000:0.0:1651530012.657407:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a4b08118 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438148:x1731754353188032:12345-10.240.43.64@tcp:3:cat.0 Request processed in 837us (872us total) trans 0 rc 16384/16384 00000100:00100000:0.0:1651530012.657411:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 37 00002000:00100000:0.0:1651530012.657414:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c08c:0x0] (0->4194303) req@00000000a4b08118 x1731754353188032/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:738/0 lens 488/440 e 0 to 0 dl 1651530018 ref 1 fl Complete:/0/0 rc 16384/16384 job:'cat.0' 00002000:00100000:0.0:1651530012.657418:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a4b08118 with x1731754353188032 ext(0->4194303) 00002000:00010000:0.0:1651530012.657420:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000a4b08118 00000100:00100000:0.0:1651530013.385535:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530013.385552:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353189312 00000100:00100000:0.0:1651530013.385582:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 3 00000100:00100000:0.0:1651530013.385585:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d6be6ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+8:454981:x1731754353189312:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651530013.385593:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651530013.385614:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c55af9 lrc: 0/0,0 mode: --/PR res: [0x2c08c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7a83 expref: 8 pid: 166112 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530013.385626:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651530013.385646:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d6be6ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+7:454981:x1731754353189312:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 60us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530013.385649:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 3 00000100:00100000:0.0:1651530013.920316:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651530013.920334:0:166115:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946846848 00000100:00100000:0.0:1651530013.920353:0:166115:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 72 00000100:00100000:0.0:1651530013.920355:0:166115:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004cb25697 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946846848:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651530013.920369:0:166115:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 148941504 pending 40960 free 81307996160 avail 77137285120 00000100:00100000:0.0:1651530013.920392:0:166115:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004cb25697 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946846848:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 37us (80us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530013.920396:0:166115:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 72 00000100:00100000:1.0:1651530013.942656:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530013.943259:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946847040 00000100:00100000:1.0:1651530013.943272:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 874 00000100:00100000:1.0:1651530013.943275:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946847040:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651530013.943285:0:166112:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180364 count 1 00002000:00010000:1.0:1651530013.943300:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c08c:0x0] initial LVB size: 16384, mtime: 0x6270591c, atime: 0x0, ctime: 0x6270591c, blocks: 0x20 00010000:00010000:1.0:1651530013.943303:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55b00 lrc: 3/0,1 mode: --/PW res: [0x2c08c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530013.943311:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530013.943312:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530013.943314:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55b00 lrc: 3/0,1 mode: PW/PW res: [0x2c08c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530013.943324:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55b00 lrc: 3/0,1 mode: PW/PW res: [0x2c08c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530013.943328:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55b00 lrc: 3/0,1 mode: PW/PW res: [0x2c08c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530013.943331:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55b00 lrc: 2/0,0 mode: PW/PW res: [0x2c08c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530013.943822:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946847040:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 546us (1168us total) trans 21474837336 rc 0/0 00000100:00100000:1.0:1651530013.943826:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 874 00010000:00010000:1.0:1651530013.943838:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55b00 lrc: 2/0,0 mode: PW/PW res: [0x2c08c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530013.943842:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2d8d18b already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651530013.943843:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55b00 lrc: 2/0,0 mode: PW/PW res: [0x2c08c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530013.943847:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55b00 lrc: 3/0,0 mode: PW/PW res: [0x2c08c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530013.943854:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55b00 lrc: 1/0,0 mode: --/PW res: [0x2c08c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530013.943857:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55b00 lrc: 0/0,0 mode: --/PW res: [0x2c08c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651530016.893313:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000387f378b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9063caa-b124-4cb6-99ef-d01a735595c3:39100:1731745997086912:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:0.0:1651530016.893370:0:39100:0:(ptlrpcd.c:414:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1651530016.893373:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005cc6463a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997086976:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:0.0:1651530016.893886:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005cc6463a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997086976:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:0.0:1651530016.893892:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000387f378b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9063caa-b124-4cb6-99ef-d01a735595c3:39100:1731745997086912:10.240.43.61@tcp:400:kworker/u4:2.0 00000001:00080000:0.0:1651530018.460481:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474837336 is committed 00000001:00080000:0.0:1651530018.460486:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474837335 is committed 00000100:00100000:1.0:1651530019.040283:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530019.040309:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946847104 00000100:00100000:1.0:1651530019.040330:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 73 00000100:00100000:1.0:1651530019.040332:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ffcc974c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946847104:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651530019.040349:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 148900544 pending 0 free 81307996160 avail 77137285120 00000100:00100000:1.0:1651530019.040374:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ffcc974c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946847104:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 41us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530019.040378:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 73 00000100:00100000:1.0:1651530020.545033:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530020.545050:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353191296 00000100:00100000:1.0:1651530020.545068:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 7 00000100:00100000:1.0:1651530020.545071:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9e74b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+5:438149:x1731754353191296:12345-10.240.43.64@tcp:400:kworker/u4:1.0 00000100:00100000:1.0:1651530020.545114:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9e74b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+5:438149:x1731754353191296:12345-10.240.43.64@tcp:400:kworker/u4:1.0 Request processed in 42us (84us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530020.545117:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 7 00000400:00000080:1.0:1651530021.344072:0:171330:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651530021.344078:0:171330:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 152: test read/write with enomem ====================================================================================== 22:20:19 (1651530019) 00000100:00100000:1.0:1651530021.372961:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530021.372979:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353191680 00000100:00100000:1.0:1651530021.372997:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 875 00000100:00100000:1.0:1651530021.372999:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057d84ac9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+5:438149:x1731754353191680:12345-10.240.43.64@tcp:101:cp.0 00010000:00010000:1.0:1651530021.373009:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651530021.373019:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55b07 lrc: 2/0,0 mode: --/PR res: [0x2c08d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db2f7af3 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530021.373031:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c08d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530021.373040:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530021.373041:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530021.373045:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55b07 lrc: 3/0,0 mode: PR/PR res: [0x2c08d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7af3 expref: 6 pid: 166112 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530021.373054:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55b07 lrc: 3/0,0 mode: PR/PR res: [0x2c08d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7af3 expref: 6 pid: 166112 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530021.373059:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c2d8d18b, rc 0) 00000100:00100000:1.0:1651530021.373080:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057d84ac9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438149:x1731754353191680:12345-10.240.43.64@tcp:101:cp.0 Request processed in 80us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530021.373084:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 875 00000100:00100000:1.0:1651530021.373497:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530021.373505:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353191744 00000100:00100000:1.0:1651530021.373512:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 876 00000100:00100000:1.0:1651530021.373514:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054ed0749 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+6:460894:x1731754353191744:12345-10.240.43.64@tcp:101:cp.0 00010000:00010000:1.0:1651530021.373518:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651530021.373522:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c55b0e lrc: 2/0,0 mode: --/PW res: [0x2c08d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db2f7afa expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530021.373530:0:166111:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55b07 lrc: 2/0,0 mode: PR/PR res: [0x2c08d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7af3 expref: 7 pid: 166112 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530021.373534:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530021.373534:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530021.373536:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c55b0e lrc: 4/0,0 mode: --/PW res: [0x2c08d:0x0:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7afa expref: 7 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530021.373548:0:166111:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55b07 lrc: 3/0,0 mode: PR/PR res: [0x2c08d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7af3 expref: 7 pid: 166112 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530021.373554:0:166111:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55b07 lrc: 4/0,0 mode: PR/PR res: [0x2c08d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7af3 expref: 7 pid: 166112 timeout: 20830 lvb_type: 1 00000100:00100000:1.0:1651530021.373559:0:166111:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000053ee5af1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:166111:1731745997087040:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651530021.373577:0:166111:0:(client.c:2492:ptlrpc_set_wait()) set 00000000382cf590 going to sleep for 6 seconds 00000100:00100000:1.0:1651530021.373859:0:166111:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000053ee5af1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:166111:1731745997087040:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651530021.373867:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c55b0e lrc: 3/0,0 mode: --/PW res: [0x2c08d:0x0:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7afa expref: 7 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530021.373873:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d84ad17b, rc 0) 00000100:00100000:1.0:1651530021.373882:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054ed0749 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+7:460894:x1731754353191744:12345-10.240.43.64@tcp:101:cp.0 Request processed in 367us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530021.373885:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 876 00000100:00100000:1.0:1651530021.373931:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530021.373953:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353191808 00010000:00010000:0.0:1651530021.373965:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55b07 lrc: 4/0,0 mode: PR/PR res: [0x2c08d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7af3 expref: 7 pid: 166112 timeout: 20830 lvb_type: 1 00000100:00100000:0.0:1651530021.373986:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 9 00000100:00100000:0.0:1651530021.373988:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d0ff310 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438148:x1731754353191808:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651530021.373993:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651530021.373999:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55b07 lrc: 4/0,0 mode: PR/PR res: [0x2c08d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7af3 expref: 7 pid: 166112 timeout: 20830 lvb_type: 1 00010000:00010000:0.0:1651530021.374004:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55b07 lrc: 3/0,0 mode: PR/PR res: [0x2c08d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7af3 expref: 7 pid: 166112 timeout: 20830 lvb_type: 1 00010000:00010000:0.0:1651530021.374013:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55b07 lrc: 0/0,0 mode: --/PR res: [0x2c08d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7af3 expref: 7 pid: 166112 timeout: 20830 lvb_type: 1 00010000:00010000:0.0:1651530021.374017:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530021.374018:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530021.374020:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c55b0e lrc: 2/0,0 mode: PW/PW res: [0x2c08d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7afa expref: 6 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530021.374024:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c55b0e lrc: 3/0,0 mode: PW/PW res: [0x2c08d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7afa expref: 6 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530021.374034:0:166102:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c55b0e lrc: 3/0,0 mode: PW/PW res: [0x2c08d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7afa expref: 6 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651530021.374038:0:166102:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000387f378b pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:166102:1731745997087104:10.240.43.64@tcp:105: 00000100:00100000:0.0:1651530021.374059:0:166102:0:(client.c:2492:ptlrpc_set_wait()) set 00000000365f1450 going to sleep for 6 seconds 00000100:00100000:0.0:1651530021.374308:0:166102:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000387f378b pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:166102:1731745997087104:10.240.43.64@tcp:105: 00010000:00010000:0.0:1651530021.374313:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651530021.374327:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d0ff310 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438148:x1731754353191808:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 338us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530021.374331:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 9 00000100:00100000:1.0:1651530021.377596:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530021.377617:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353192064 00002000:00100000:0.0:1651530021.377629:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c08d:0x0] (0->6095) req@0000000053ee5af1 x1731754353192064/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:747/0 lens 6584/0 e 0 to 0 dl 1651530027 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cp.0' 00002000:00100000:0.0:1651530021.377634:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000053ee5af1 with x1731754353192064 ext(0->6095) 00002000:00010000:0.0:1651530021.377636:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000053ee5af1 00000100:00100000:0.0:1651530021.377647:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 38 00000100:00100000:0.0:1651530021.377649:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438147:x1731754353192064:12345-10.240.43.64@tcp:4:cp.0 00000100:00100000:0.0:1651530021.377992:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053ee5af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438147:x1731754353192064:12345-10.240.43.64@tcp:4:cp.0 Request processed in 341us (396us total) trans 21474837337 rc 0/0 00000100:00100000:0.0:1651530021.377996:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 38 00002000:00100000:0.0:1651530021.377998:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c08d:0x0] (0->6095) req@0000000053ee5af1 x1731754353192064/t21474837337(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:747/0 lens 6584/448 e 0 to 0 dl 1651530027 ref 1 fl Complete:/0/0 rc 0/0 job:'cp.0' 00002000:00100000:0.0:1651530021.378002:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000053ee5af1 with x1731754353192064 ext(0->6095) 00002000:00010000:0.0:1651530021.378004:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000053ee5af1 00000100:00100000:1.0:1651530021.416250:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530021.416274:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353192192 00000100:00100000:0.0:1651530021.416288:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4 00000100:00100000:0.0:1651530021.416290:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+8:454981:x1731754353192192:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651530021.416294:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1651530021.416297:0:166102:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2c08d:0x0] updating lvb size from disk: 0 -> 6096 00002000:00010000:0.0:1651530021.416298:0:166102:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2c08d:0x0] updating lvb mtime from disk: 0 -> 1651530021 00002000:00010000:0.0:1651530021.416300:0:166102:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2c08d:0x0] updating lvb ctime from disk: 0 -> 1651530021 00002000:00010000:0.0:1651530021.416301:0:166102:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2c08d:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:0.0:1651530021.416306:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c55b0e lrc: 0/0,0 mode: --/PW res: [0x2c08d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7afa expref: 8 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530021.416312:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651530021.416327:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+7:454981:x1731754353192192:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 36us (77us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530021.416329:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4 00000100:00100000:1.0:1651530021.426116:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530021.426125:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353192384 00000100:00100000:1.0:1651530021.426133:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 877 00000100:00100000:1.0:1651530021.426135:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438149:x1731754353192384:12345-10.240.43.64@tcp:101:cmp.0 00010000:00010000:1.0:1651530021.426139:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651530021.426143:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c55b15 lrc: 2/0,0 mode: --/PR res: [0x2c08d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db2f7b0f expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530021.426149:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c08d:0x0] initial LVB size: 6096, mtime: 0x62705925, atime: 0x0, ctime: 0x62705925, blocks: 0x10 00010000:00010000:1.0:1651530021.426153:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530021.426154:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530021.426156:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c55b15 lrc: 3/0,0 mode: PR/PR res: [0x2c08d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7b0f expref: 8 pid: 166111 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530021.426161:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c55b15 lrc: 3/0,0 mode: PR/PR res: [0x2c08d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7b0f expref: 8 pid: 166111 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530021.426164:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ba070658, rc 0) 00000100:00100000:1.0:1651530021.426175:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438149:x1731754353192384:12345-10.240.43.64@tcp:101:cmp.0 Request processed in 39us (59us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530021.426177:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 877 00000100:00100000:1.0:1651530021.428083:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530021.428108:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353192512 00002000:00100000:0.0:1651530021.428116:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c08d:0x0] (0->4194303) req@0000000007e1f45a x1731754353192512/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:747/0 lens 488/0 e 0 to 0 dl 1651530027 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cmp.0' 00002000:00100000:0.0:1651530021.428120:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000007e1f45a with x1731754353192512 ext(0->4194303) 00002000:00010000:0.0:1651530021.428121:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000007e1f45a 00000100:00100000:0.0:1651530021.428131:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 39 00000100:00100000:0.0:1651530021.428132:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007e1f45a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438148:x1731754353192512:12345-10.240.43.64@tcp:3:cmp.0 00000100:00100000:0.0:1651530021.429049:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007e1f45a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438148:x1731754353192512:12345-10.240.43.64@tcp:3:cmp.0 Request processed in 915us (966us total) trans 0 rc 8192/8192 00000100:00100000:0.0:1651530021.429053:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 39 00002000:00100000:0.0:1651530021.429056:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c08d:0x0] (0->4194303) req@0000000007e1f45a x1731754353192512/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:747/0 lens 488/440 e 0 to 0 dl 1651530027 ref 1 fl Complete:/0/0 rc 8192/8192 job:'cmp.0' 00002000:00100000:0.0:1651530021.429060:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000007e1f45a with x1731754353192512 ext(0->4194303) 00002000:00010000:0.0:1651530021.429061:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000007e1f45a 00000400:00000080:0.0:1651530022.692859:0:171548:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530022.692861:0:171548:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 153: test if fdatasync does not crash ================================================================================= 22:20:22 (1651530022) 00000400:00000080:0.0:1651530024.031624:0:171766:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530024.031627:0:171766:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 154A: lfs path2fid and fid2path basic checks ========================================================== 22:20:23 (1651530023) 00000100:00100000:0.0:1651530024.061143:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530024.061175:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353193472 00000100:00100000:1.0:1651530024.061196:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 878 00000100:00100000:1.0:1651530024.061199:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008cca9da pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438148:x1731754353193472:12345-10.240.43.64@tcp:2:touch.0 00000100:00100000:1.0:1651530024.061324:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008cca9da pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438148:x1731754353193472:12345-10.240.43.64@tcp:2:touch.0 Request processed in 124us (183us total) trans 21474837338 rc 0/0 00000100:00100000:1.0:1651530024.061328:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 878 00000100:00100000:0.0:1651530024.160141:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651530024.160152:0:166115:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946847360 00000100:00100000:0.0:1651530024.160170:0:166115:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 74 00000100:00100000:0.0:1651530024.160172:0:166115:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001832a3d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946847360:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651530024.160183:0:166115:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 157338304 pending 32768 free 81307987968 avail 77137276928 00000100:00100000:0.0:1651530024.160202:0:166115:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001832a3d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946847360:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 29us (62us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530024.160205:0:166115:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 74 00000400:00000080:1.0:1651530025.331953:0:171984:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651530025.331956:0:171984:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 154B: verify the ll_decode_linkea tool ==== 22:20:25 (1651530025) 00000400:00000080:1.0:1651530026.643907:0:172202:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651530026.643910:0:172202:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 154a: Open-by-FID ========================= 22:20:26 (1651530026) 00000100:00100000:0.0:1651530026.729917:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530026.729947:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353195904 00000100:00100000:1.0:1651530026.729972:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 879 00000100:00100000:1.0:1651530026.729975:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d6be6ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438146:x1731754353195904:12345-10.240.43.64@tcp:101:cp.0 00010000:00010000:1.0:1651530026.729985:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651530026.729996:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae57075e/0x3234de053c55b1c lrc: 2/0,0 mode: --/PR res: [0x2c08f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db2f7b71 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530026.730008:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c08f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530026.730017:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530026.730018:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530026.730022:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae57075e/0x3234de053c55b1c lrc: 3/0,0 mode: PR/PR res: [0x2c08f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7b71 expref: 10 pid: 166112 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530026.730031:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ae57075e/0x3234de053c55b1c lrc: 3/0,0 mode: PR/PR res: [0x2c08f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7b71 expref: 10 pid: 166112 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530026.730036:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ae57075e, rc 0) 00000100:00100000:1.0:1651530026.730060:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d6be6ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+10:438146:x1731754353195904:12345-10.240.43.64@tcp:101:cp.0 Request processed in 85us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530026.730064:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 879 00000100:00100000:0.0:1651530026.730871:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530026.730893:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353196032 00000100:00100000:1.0:1651530026.730906:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 880 00000100:00100000:1.0:1651530026.730908:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000387f378b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+10:463287:x1731754353196032:12345-10.240.43.64@tcp:101:cp.0 00010000:00010000:1.0:1651530026.730912:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651530026.730916:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c55b23 lrc: 2/0,0 mode: --/PW res: [0x2c08f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db2f7b7f expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530026.730927:0:166112:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ae57075e/0x3234de053c55b1c lrc: 2/0,0 mode: PR/PR res: [0x2c08f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7b71 expref: 11 pid: 166112 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530026.730931:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530026.730931:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530026.730932:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c55b23 lrc: 4/0,0 mode: --/PW res: [0x2c08f:0x0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7b7f expref: 11 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530026.730945:0:166112:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ae57075e/0x3234de053c55b1c lrc: 3/0,0 mode: PR/PR res: [0x2c08f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7b71 expref: 11 pid: 166112 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530026.730949:0:166112:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ae57075e/0x3234de053c55b1c lrc: 4/0,0 mode: PR/PR res: [0x2c08f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7b71 expref: 11 pid: 166112 timeout: 20835 lvb_type: 1 00000100:00100000:1.0:1651530026.730955:0:166112:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003b5b65d3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997087168:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651530026.730974:0:166112:0:(client.c:2492:ptlrpc_set_wait()) set 0000000044f68e5a going to sleep for 6 seconds 00000100:00100000:0.0:1651530026.731330:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530026.731340:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353196096 00000100:00100000:1.0:1651530026.731344:0:166112:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003b5b65d3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997087168:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651530026.731350:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ae57075e/0x3234de053c55b1c lrc: 4/0,0 mode: PR/PR res: [0x2c08f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7b71 expref: 12 pid: 166112 timeout: 20835 lvb_type: 1 00010000:00010000:1.0:1651530026.731352:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c55b23 lrc: 3/0,0 mode: --/PW res: [0x2c08f:0x0:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7b7f expref: 12 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530026.731357:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d84ad17b, rc 0) 00000100:00100000:0.0:1651530026.731365:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10 00000100:00100000:0.0:1651530026.731367:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+12:438147:x1731754353196096:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651530026.731372:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1651530026.731373:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000387f378b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+12:463287:x1731754353196032:12345-10.240.43.64@tcp:101:cp.0 Request processed in 464us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530026.731376:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 880 00010000:00010000:0.0:1651530026.731378:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ae57075e/0x3234de053c55b1c lrc: 4/0,0 mode: PR/PR res: [0x2c08f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7b71 expref: 12 pid: 166112 timeout: 20835 lvb_type: 1 00010000:00010000:0.0:1651530026.731384:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ae57075e/0x3234de053c55b1c lrc: 3/0,0 mode: PR/PR res: [0x2c08f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7b71 expref: 11 pid: 166112 timeout: 20835 lvb_type: 1 00010000:00010000:0.0:1651530026.731392:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae57075e/0x3234de053c55b1c lrc: 0/0,0 mode: --/PR res: [0x2c08f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7b71 expref: 11 pid: 166112 timeout: 20835 lvb_type: 1 00010000:00010000:0.0:1651530026.731397:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530026.731398:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530026.731400:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c55b23 lrc: 2/0,0 mode: PW/PW res: [0x2c08f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7b7f expref: 10 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530026.731404:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c55b23 lrc: 3/0,0 mode: PW/PW res: [0x2c08f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7b7f expref: 10 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530026.731414:0:166102:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c55b23 lrc: 3/0,0 mode: PW/PW res: [0x2c08f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7b7f expref: 10 pid: 166112 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651530026.731418:0:166102:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f9050c71 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:166102:1731745997087232:10.240.43.64@tcp:105: 00000100:00100000:0.0:1651530026.731433:0:166102:0:(client.c:2492:ptlrpc_set_wait()) set 00000000bd9ed213 going to sleep for 6 seconds 00000100:00100000:0.0:1651530026.731675:0:166102:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f9050c71 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:166102:1731745997087232:10.240.43.64@tcp:105: 00010000:00010000:0.0:1651530026.731680:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651530026.731690:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+10:438147:x1731754353196096:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 322us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530026.731694:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10 00000100:00100000:1.0:1651530026.764075:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530026.764084:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353197312 00000100:00100000:1.0:1651530026.764103:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 881 00000100:00100000:1.0:1651530026.764105:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b5b65d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+10:438148:x1731754353197312:12345-10.240.43.64@tcp:2:touch.0 00002000:00010000:1.0:1651530026.764171:0:166112:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2c08f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651530026.764172:0:166112:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2c08f:0x0] updating lvb mtime from disk: 0 -> 1651530026 00002000:00010000:1.0:1651530026.764173:0:166112:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2c08f:0x0] updating lvb atime from disk: 0 -> 1651530026 00002000:00010000:1.0:1651530026.764174:0:166112:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2c08f:0x0] updating lvb ctime from disk: 0 -> 1651530026 00002000:00010000:1.0:1651530026.764175:0:166112:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2c08f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651530026.764189:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b5b65d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+11:438148:x1731754353197312:12345-10.240.43.64@tcp:2:touch.0 Request processed in 83us (114us total) trans 21474837339 rc 0/0 00000100:00100000:1.0:1651530026.764192:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 881 00000100:00100000:1.0:1651530026.767786:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530026.767811:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353197888 00002000:00010000:0.0:1651530026.767820:0:166118:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 180367/0 (0->18446744073709551615) 00002000:00100000:0.0:1651530026.767822:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000065ccb4ef with x1731754353197888 ext(0->18446744073709551615) 00002000:00010000:0.0:1651530026.767825:0:166118:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000065ccb4ef. 00000100:00100000:0.0:1651530026.767837:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 40 00000100:00100000:0.0:1651530026.767839:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065ccb4ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+11:438146:x1731754353197888:12345-10.240.43.64@tcp:10:bash.0 00002000:00010000:0.0:1651530026.767875:0:166118:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2c08f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651530026.767876:0:166118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2c08f:0x0] updating lvb mtime from disk: 1651530026 -> 1651530026 00002000:00010000:0.0:1651530026.767877:0:166118:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2c08f:0x0] updating lvb atime from disk: 1651530026 -> 1651530026 00002000:00010000:0.0:1651530026.767878:0:166118:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2c08f:0x0] updating lvb ctime from disk: 1651530026 -> 1651530026 00002000:00010000:0.0:1651530026.767879:0:166118:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2c08f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651530026.767896:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065ccb4ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+12:438146:x1731754353197888:12345-10.240.43.64@tcp:10:bash.0 Request processed in 57us (110us total) trans 21474837340 rc 0/0 00000100:00100000:0.0:1651530026.767900:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 40 00002000:00010000:0.0:1651530026.767901:0:166118:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 180367/0 (0->18446744073709551615) 00002000:00100000:0.0:1651530026.767902:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000065ccb4ef with x1731754353197888 ext(0->18446744073709551615) 00002000:00010000:0.0:1651530026.767904:0:166118:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000065ccb4ef. 00000001:00080000:0.0:1651530026.805113:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474837339 is committed 00000100:00100000:1.0:1651530026.805216:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530026.805245:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353201536 00002000:00010000:0.0:1651530026.805252:0:166118:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 180367/0 (777->18446744073709551615) 00002000:00100000:0.0:1651530026.805253:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f7286103 with x1731754353201536 ext(777->18446744073709551615) 00002000:00010000:0.0:1651530026.805256:0:166118:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f7286103. 00000100:00100000:0.0:1651530026.805264:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 41 00000100:00100000:0.0:1651530026.805266:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7286103 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438149:x1731754353201536:12345-10.240.43.64@tcp:10:truncate.0 00002000:00010000:0.0:1651530026.805308:0:166118:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2c08f:0x0] updating lvb size from disk: 0 -> 777 00002000:00010000:0.0:1651530026.805309:0:166118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2c08f:0x0] updating lvb mtime from disk: 1651530026 -> 1651530026 00002000:00010000:0.0:1651530026.805310:0:166118:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2c08f:0x0] updating lvb atime from disk: 1651530026 -> 1651530026 00002000:00010000:0.0:1651530026.805311:0:166118:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2c08f:0x0] updating lvb ctime from disk: 1651530026 -> 1651530026 00002000:00010000:0.0:1651530026.805312:0:166118:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2c08f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651530026.805330:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7286103 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438149:x1731754353201536:12345-10.240.43.64@tcp:10:truncate.0 Request processed in 63us (115us total) trans 21474837341 rc 0/0 00000100:00100000:0.0:1651530026.805334:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 41 00002000:00010000:0.0:1651530026.805335:0:166118:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 180367/0 (777->18446744073709551615) 00002000:00100000:0.0:1651530026.805336:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f7286103 with x1731754353201536 ext(777->18446744073709551615) 00002000:00010000:0.0:1651530026.805338:0:166118:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f7286103. 00000100:00100000:1.0:1651530026.856288:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530026.856297:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353204608 00000100:00100000:1.0:1651530026.856312:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 882 00000100:00100000:1.0:1651530026.856314:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438149:x1731754353204608:12345-10.240.43.64@tcp:2:touch.0 00000100:00100000:1.0:1651530026.856353:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+10:438149:x1731754353204608:12345-10.240.43.64@tcp:2:touch.0 Request processed in 38us (66us total) trans 21474837342 rc 0/0 00000100:00100000:1.0:1651530026.856356:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 882 00000100:00100000:1.0:1651530026.958555:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530026.958564:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353209920 00000100:00100000:1.0:1651530026.958577:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 883 00000100:00100000:1.0:1651530026.958579:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+10:463332:x1731754353209920:12345-10.240.43.64@tcp:101:cp.0 00010000:00010000:1.0:1651530026.958584:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651530026.958589:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55b2a lrc: 2/0,0 mode: --/PW res: [0x2c091:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db2f7d93 expref: -99 pid: 166112 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530026.958596:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c091:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530026.958601:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530026.958602:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530026.958604:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55b2a lrc: 3/0,0 mode: PW/PW res: [0x2c091:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7d93 expref: 11 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530026.958610:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55b2a lrc: 3/0,0 mode: PW/PW res: [0x2c091:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7d93 expref: 11 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530026.958614:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c2d8d18b, rc 0) 00000100:00100000:1.0:1651530026.958625:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+11:463332:x1731754353209920:12345-10.240.43.64@tcp:101:cp.0 Request processed in 45us (71us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530026.958628:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 883 00000100:00100000:1.0:1651530026.958898:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530026.958914:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353209984 00002000:00010000:0.0:1651530026.958920:0:166118:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 180369/0 (0->18446744073709551615) 00002000:00100000:0.0:1651530026.958921:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003562cf4d with x1731754353209984 ext(0->18446744073709551615) 00002000:00010000:0.0:1651530026.958923:0:166118:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000003562cf4d. 00000100:00100000:0.0:1651530026.958933:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 42 00000100:00100000:0.0:1651530026.958935:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+11:438149:x1731754353209984:12345-10.240.43.64@tcp:10:cp.0 00002000:00010000:0.0:1651530026.958961:0:166118:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2c091:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651530026.958962:0:166118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2c091:0x0] updating lvb mtime from disk: 0 -> 1651530026 00002000:00010000:0.0:1651530026.958963:0:166118:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2c091:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651530026.958964:0:166118:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2c091:0x0] updating lvb ctime from disk: 0 -> 1651530026 00002000:00010000:0.0:1651530026.958965:0:166118:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2c091:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651530026.958982:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+12:438149:x1731754353209984:12345-10.240.43.64@tcp:10:cp.0 Request processed in 46us (83us total) trans 21474837343 rc 0/0 00000100:00100000:0.0:1651530026.958985:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 42 00002000:00010000:0.0:1651530026.958986:0:166118:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 180369/0 (0->18446744073709551615) 00002000:00100000:0.0:1651530026.958987:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003562cf4d with x1731754353209984 ext(0->18446744073709551615) 00002000:00010000:0.0:1651530026.958989:0:166118:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000003562cf4d. 00000100:00100000:1.0:1651530026.964727:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530026.964749:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353210688 00002000:00010000:0.0:1651530026.964755:0:166118:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 180369/0 (0->18446744073709551615) 00002000:00100000:0.0:1651530026.964756:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f7006631 with x1731754353210688 ext(0->18446744073709551615) 00002000:00010000:0.0:1651530026.964758:0:166118:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f7006631. 00000100:00100000:0.0:1651530026.964768:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 43 00000100:00100000:0.0:1651530026.964769:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+12:438149:x1731754353210688:12345-10.240.43.64@tcp:10:cp.0 00002000:00010000:0.0:1651530026.964789:0:166118:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2c091:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651530026.964790:0:166118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2c091:0x0] updating lvb mtime from disk: 1651530026 -> 1651530026 00002000:00010000:0.0:1651530026.964791:0:166118:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2c091:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651530026.964792:0:166118:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2c091:0x0] updating lvb ctime from disk: 1651530026 -> 1651530026 00002000:00010000:0.0:1651530026.964793:0:166118:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2c091:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651530026.964809:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+13:438149:x1731754353210688:12345-10.240.43.64@tcp:10:cp.0 Request processed in 39us (82us total) trans 21474837344 rc 0/0 00000100:00100000:0.0:1651530026.964812:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 43 00002000:00010000:0.0:1651530026.964813:0:166118:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 180369/0 (0->18446744073709551615) 00002000:00100000:0.0:1651530026.964814:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f7006631 with x1731754353210688 ext(0->18446744073709551615) 00002000:00010000:0.0:1651530026.964815:0:166118:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f7006631. 00000400:00000080:1.0:1651530028.262897:0:172420:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651530028.262900:0:172420:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 154b: Open-by-FID for remote directory ==== 22:20:27 (1651530027) 00000400:00000080:0.0:1651530028.567503:0:172474:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530028.567505:0:172474:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity test_154b needs >= 2 MDTs 00000400:00000080:0.0:1651530028.901646:0:172528:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530028.901649:0:172528:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 154c: lfs path2fid and fid2path multiple arguments ========================================================== 22:20:28 (1651530028) 00000100:00100000:1.0:1651530028.928883:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530028.928901:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946848576 00000100:00100000:1.0:1651530028.928926:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 884 00000100:00100000:1.0:1651530028.928929:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b2355651 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:209978:x1731745946848576:12345-10.240.43.61@tcp:5:osp-pre-1-0.0 00002000:00080000:1.0:1651530028.928950:0:166112:0:(ofd_dev.c:1706:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x0 at 180386 00000100:00100000:1.0:1651530028.929373:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530028.929393:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353215040 00000100:00100000:1.0:1651530028.929417:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 885 00000100:00100000:1.0:1651530028.929420:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009c4c564 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+13:438149:x1731754353215040:12345-10.240.43.64@tcp:2:touch.0 00000100:00100000:1.0:1651530028.929510:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009c4c564 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+14:438149:x1731754353215040:12345-10.240.43.64@tcp:2:touch.0 Request processed in 90us (138us total) trans 21474837345 rc 0/0 00000100:00100000:1.0:1651530028.929515:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 885 00000100:00100000:1.0:1651530028.934985:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b2355651 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:209978:x1731745946848576:12345-10.240.43.61@tcp:5:osp-pre-1-0.0 Request processed in 6055us (6104us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530028.934990:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 884 00000100:00100000:1.0:1651530029.280172:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530029.280190:0:166115:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946848640 00000100:00100000:1.0:1651530029.280207:0:166115:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 75 00000100:00100000:1.0:1651530029.280210:0:166115:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946848640:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651530029.280234:0:166115:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 157304640 pending 0 free 81307987968 avail 77137276928 00000100:00100000:1.0:1651530029.280259:0:166115:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946848640:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 48us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530029.280262:0:166115:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 75 00000400:00000080:0.0:1651530030.217252:0:172746:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530030.217254:0:172746:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 154d: Verify open file fid ================ 22:20:29 (1651530029) 00000100:00100000:1.0:1651530030.316559:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530030.316577:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353216384 00000100:00100000:1.0:1651530030.316596:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 886 00000100:00100000:1.0:1651530030.316598:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+14:438149:x1731754353216384:12345-10.240.43.64@tcp:2:touch.0 00000100:00100000:1.0:1651530030.316691:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+15:438149:x1731754353216384:12345-10.240.43.64@tcp:2:touch.0 Request processed in 92us (135us total) trans 21474837346 rc 0/0 00000100:00100000:1.0:1651530030.316695:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 886 00000001:00080000:0.0:1651530032.285176:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474837346 is committed 00000100:00100000:1.0:1651530032.377005:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530032.377018:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530032.377031:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946848768 00000100:00100000:1.0:1651530032.377052:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946848832 00000100:00100000:1.0:1651530032.377060:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 887 00000100:00100000:1.0:1651530032.377062:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000021359a0e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946848768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651530032.377070:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 888 00000100:00100000:0.0:1651530032.377074:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ee473ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946848832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651530032.377078:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180369 count 1 00002000:00080000:0.0:1651530032.377083:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180367 count 1 00010000:00010000:0.0:1651530032.377100:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c55b38 lrc: 3/0,1 mode: --/PW res: [0x2c08f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530032.377111:0:166111:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c55b23 lrc: 2/0,0 mode: PW/PW res: [0x2c08f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7b7f expref: 7 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530032.377115:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1651530032.377116:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651530032.377117:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55b31 lrc: 3/0,1 mode: --/PW res: [0x2c091:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530032.377117:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c55b38 lrc: 4/0,1 mode: --/PW res: [0x2c08f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530032.377125:0:166113:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55b2a lrc: 2/0,0 mode: PW/PW res: [0x2c091:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7d93 expref: 7 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530032.377129:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651530032.377130:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1651530032.377131:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55b31 lrc: 4/0,1 mode: --/PW res: [0x2c091:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530032.377133:0:166111:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c55b23 lrc: 3/0,0 mode: PW/PW res: [0x2c08f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7b7f expref: 7 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530032.377138:0:166111:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c55b23 lrc: 4/0,0 mode: PW/PW res: [0x2c08f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7b7f expref: 7 pid: 166112 timeout: 20841 lvb_type: 0 00010000:00010000:1.0:1651530032.377140:0:166113:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55b2a lrc: 3/0,0 mode: PW/PW res: [0x2c091:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7d93 expref: 7 pid: 166112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530032.377144:0:166113:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55b2a lrc: 4/0,0 mode: PW/PW res: [0x2c091:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7d93 expref: 7 pid: 166112 timeout: 20841 lvb_type: 0 00000100:00100000:0.0:1651530032.377144:0:166111:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f9050c71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:166111:1731745997087296:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651530032.377149:0:166113:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004a8f4906 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997087360:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651530032.377172:0:166113:0:(client.c:2492:ptlrpc_set_wait()) set 00000000e5623bab going to sleep for 6 seconds 00000100:00100000:0.0:1651530032.377172:0:166111:0:(client.c:2492:ptlrpc_set_wait()) set 00000000da6544bb going to sleep for 6 seconds 00000100:00100000:1.0:1651530032.379461:0:166113:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004a8f4906 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997087360:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651530032.379468:0:166113:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55b31 lrc: 3/0,1 mode: --/PW res: [0x2c091:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651530032.379469:0:166111:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f9050c71 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:166111:1731745997087296:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651530032.379475:0:166111:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c55b38 lrc: 3/0,1 mode: --/PW res: [0x2c08f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530032.380899:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530032.380909:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530032.380917:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353216704 00010000:00010000:1.0:1651530032.380925:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55b2a lrc: 4/0,0 mode: PW/PW res: [0x2c091:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7d93 expref: 8 pid: 166112 timeout: 20841 lvb_type: 0 00000100:00100000:1.0:1651530032.380938:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353216768 00010000:00010000:1.0:1651530032.380941:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c55b23 lrc: 4/0,0 mode: PW/PW res: [0x2c08f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7b7f expref: 9 pid: 166112 timeout: 20841 lvb_type: 0 00000100:00100000:1.0:1651530032.380947:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11 00000100:00100000:1.0:1651530032.380949:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a8f4906 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438148:x1731754353216704:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651530032.380954:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651530032.380955:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55b2a lrc: 4/0,0 mode: PW/PW res: [0x2c091:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7d93 expref: 9 pid: 166112 timeout: 20841 lvb_type: 0 00000100:00100000:0.0:1651530032.380955:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12 00000100:00100000:0.0:1651530032.380958:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4ea889e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438148:x1731754353216768:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651530032.380960:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55b2a lrc: 3/0,0 mode: PW/PW res: [0x2c091:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7d93 expref: 9 pid: 166112 timeout: 20841 lvb_type: 0 00010000:00010000:0.0:1651530032.380963:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651530032.380965:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c55b23 lrc: 4/0,0 mode: PW/PW res: [0x2c08f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7b7f expref: 9 pid: 166112 timeout: 20841 lvb_type: 0 00010000:00010000:1.0:1651530032.380969:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55b2a lrc: 0/0,0 mode: --/PW res: [0x2c091:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7d93 expref: 9 pid: 166112 timeout: 20841 lvb_type: 0 00010000:00010000:0.0:1651530032.380972:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c55b23 lrc: 3/0,0 mode: PW/PW res: [0x2c08f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7b7f expref: 9 pid: 166112 timeout: 20841 lvb_type: 0 00010000:00010000:1.0:1651530032.380974:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530032.380974:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530032.380976:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55b31 lrc: 3/0,1 mode: PW/PW res: [0x2c091:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530032.380980:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55b31 lrc: 4/0,1 mode: PW/PW res: [0x2c091:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530032.380980:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c55b23 lrc: 0/0,0 mode: --/PW res: [0x2c08f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7b7f expref: 8 pid: 166112 timeout: 20841 lvb_type: 0 00010000:00010000:0.0:1651530032.380983:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530032.380984:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530032.380985:0:169267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c55b38 lrc: 3/0,1 mode: PW/PW res: [0x2c08f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530032.380989:0:169267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c55b38 lrc: 4/0,1 mode: PW/PW res: [0x2c08f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530032.380990:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1651530032.380996:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651530032.381000:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a8f4906 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438148:x1731754353216704:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 50us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530032.381003:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11 00000100:00100000:0.0:1651530032.381005:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4ea889e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438148:x1731754353216768:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 47us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530032.381008:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12 00010000:00010000:0.0:1651530032.381029:0:166111:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c55b38 lrc: 3/0,1 mode: PW/PW res: [0x2c08f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530032.381033:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c55b38 lrc: 3/0,1 mode: PW/PW res: [0x2c08f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530032.381037:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c55b38 lrc: 3/0,1 mode: PW/PW res: [0x2c08f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530032.381043:0:166113:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55b31 lrc: 3/0,1 mode: PW/PW res: [0x2c091:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530032.381043:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c55b38 lrc: 2/0,0 mode: PW/PW res: [0x2c08f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530032.381047:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55b31 lrc: 3/0,1 mode: PW/PW res: [0x2c091:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530032.381056:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55b31 lrc: 3/0,1 mode: PW/PW res: [0x2c091:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530032.381059:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55b31 lrc: 2/0,0 mode: PW/PW res: [0x2c091:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530032.381134:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c55b38 lrc: 2/0,0 mode: PW/PW res: [0x2c08f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530032.381138:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008119f3a8 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651530032.381140:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c55b38 lrc: 2/0,0 mode: PW/PW res: [0x2c08f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530032.381143:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c55b38 lrc: 3/0,0 mode: PW/PW res: [0x2c08f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530032.381149:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c55b38 lrc: 1/0,0 mode: --/PW res: [0x2c08f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530032.381152:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c55b38 lrc: 0/0,0 mode: --/PW res: [0x2c08f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530032.381156:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55b31 lrc: 2/0,0 mode: PW/PW res: [0x2c091:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530032.381160:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000029b2a516 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530032.381162:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55b31 lrc: 2/0,0 mode: PW/PW res: [0x2c091:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530032.381165:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55b31 lrc: 3/0,0 mode: PW/PW res: [0x2c091:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530032.381170:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55b31 lrc: 1/0,0 mode: --/PW res: [0x2c091:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530032.381173:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55b31 lrc: 0/0,0 mode: --/PW res: [0x2c091:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530032.381328:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000021359a0e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946848768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 4264us (4326us total) trans 21474837348 rc 0/0 00000100:00100000:0.0:1651530032.381328:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ee473ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946848832:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 4253us (4309us total) trans 21474837347 rc 0/0 00000100:00100000:1.0:1651530032.381332:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 887 00000100:00100000:0.0:1651530032.381333:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 888 00000400:00000080:0.0:1651530032.967614:0:172964:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530032.967617:0:172964:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 154e: .lustre is not returned by readdir == 22:20:32 (1651530032) 00000400:00000080:0.0:1651530034.333941:0:173182:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530034.333943:0:173182:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 154f: get parent fids by reading link ea == 22:20:34 (1651530034) 00000100:00100000:1.0:1651530034.383408:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530034.383439:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353219200 00000100:00100000:0.0:1651530034.383464:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 889 00000100:00100000:0.0:1651530034.383466:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c683c211 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438146:x1731754353219200:12345-10.240.43.64@tcp:2:touch.0 00000100:00100000:0.0:1651530034.383567:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c683c211 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438146:x1731754353219200:12345-10.240.43.64@tcp:2:touch.0 Request processed in 100us (161us total) trans 21474837349 rc 0/0 00000100:00100000:0.0:1651530034.383571:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 889 00000100:00100000:1.0:1651530034.400111:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530034.400123:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946849024 00000100:00100000:1.0:1651530034.400135:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 76 00000100:00100000:1.0:1651530034.400137:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946849024:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651530034.400147:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 157304640 pending 0 free 81307987968 avail 77137276928 00000100:00100000:1.0:1651530034.400161:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946849024:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 24us (50us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530034.400164:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 76 00000100:00100000:1.0:1651530034.498421:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530034.498444:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353223296 00000100:00100000:0.0:1651530034.498457:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 890 00000100:00100000:0.0:1651530034.498459:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000020362888 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438147:x1731754353223296:12345-10.240.43.64@tcp:101:rm.0 00010000:00010000:0.0:1651530034.498464:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651530034.498473:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c55b3f lrc: 2/0,0 mode: --/PR res: [0x2c094:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db2f7f84 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651530034.498482:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c094:0x0] initial LVB size: 0, mtime: 0x62705932, atime: 0x62705932, ctime: 0x62705932, blocks: 0x0 00010000:00010000:0.0:1651530034.498489:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530034.498490:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530034.498494:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c55b3f lrc: 3/0,0 mode: PR/PR res: [0x2c094:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7f84 expref: 8 pid: 166111 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530034.498502:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c55b3f lrc: 3/0,0 mode: PR/PR res: [0x2c094:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7f84 expref: 8 pid: 166111 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530034.498507:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008119f3a8, rc 0) 00000100:00100000:0.0:1651530034.498523:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000020362888 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438147:x1731754353223296:12345-10.240.43.64@tcp:101:rm.0 Request processed in 63us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530034.498526:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 890 00000400:00000080:0.0:1651530035.780105:0:173400:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530035.780107:0:173400:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 154g: various llapi FID tests ============= 22:20:35 (1651530035) 00000001:00080000:0.0:1651530038.497142:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474837349 is committed 00000001:00080000:0.0:1651530038.497149:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474837348 is committed 00000100:00100000:1.0:1651530039.520204:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530039.520233:0:166115:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946849216 00000100:00100000:1.0:1651530039.520254:0:166115:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 77 00000100:00100000:1.0:1651530039.520256:0:166115:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000068b6c75f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946849216:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651530039.520274:0:166115:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 157304640 pending 0 free 81307987968 avail 77137276928 00000100:00100000:1.0:1651530039.520299:0:166115:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000068b6c75f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946849216:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 43us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530039.520303:0:166115:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 77 00000100:00100000:1.0:1651530039.534677:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530039.534692:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530039.534703:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946849344 00000100:00100000:0.0:1651530039.534704:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946849408 00000100:00100000:1.0:1651530039.534721:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 891 00000100:00100000:1.0:1651530039.534723:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5ebc6ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946849344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651530039.534724:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 892 00000100:00100000:0.0:1651530039.534727:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005529fd8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946849408:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651530039.534733:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180372 count 1 00002000:00080000:0.0:1651530039.534734:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180373 count 1 00010000:00010000:1.0:1651530039.534746:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55b46 lrc: 3/0,1 mode: --/PW res: [0x2c094:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651530039.534748:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c095:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651530039.534751:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c55b4d lrc: 3/0,1 mode: --/PW res: [0x2c095:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530039.534756:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530039.534758:0:166113:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c55b3f lrc: 2/0,0 mode: PR/PR res: [0x2c094:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7f84 expref: 6 pid: 166111 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530039.534758:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530039.534760:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c55b4d lrc: 3/0,1 mode: PW/PW res: [0x2c095:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530039.534762:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530039.534762:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530039.534764:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55b46 lrc: 4/0,1 mode: --/PW res: [0x2c094:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530039.534767:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c55b4d lrc: 3/0,1 mode: PW/PW res: [0x2c095:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530039.534772:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c55b4d lrc: 3/0,1 mode: PW/PW res: [0x2c095:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530039.534775:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c55b4d lrc: 2/0,0 mode: PW/PW res: [0x2c095:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530039.534777:0:166113:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c55b3f lrc: 3/0,0 mode: PR/PR res: [0x2c094:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7f84 expref: 6 pid: 166111 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530039.534789:0:166113:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c55b3f lrc: 4/0,0 mode: PR/PR res: [0x2c094:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7f84 expref: 6 pid: 166111 timeout: 20848 lvb_type: 1 00000100:00100000:1.0:1651530039.534796:0:166113:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003132c0c7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997087424:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651530039.534817:0:166113:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023dae93b going to sleep for 6 seconds 00010000:00010000:1.0:1651530039.534828:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c55b4d lrc: 2/0,0 mode: PW/PW res: [0x2c095:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530039.534834:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002082f759 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651530039.534836:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c55b4d lrc: 2/0,0 mode: PW/PW res: [0x2c095:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530039.534839:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c55b4d lrc: 3/0,0 mode: PW/PW res: [0x2c095:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530039.534847:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c55b4d lrc: 1/0,0 mode: --/PW res: [0x2c095:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530039.534850:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002082f759/0x3234de053c55b4d lrc: 0/0,0 mode: --/PW res: [0x2c095:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651530039.535029:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005529fd8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745946849408:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 301us (336us total) trans 21474837350 rc 0/0 00000100:00100000:0.0:1651530039.535033:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 892 00000100:00100000:1.0:1651530039.535108:0:166113:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003132c0c7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997087424:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651530039.535114:0:166113:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55b46 lrc: 3/0,1 mode: --/PW res: [0x2c094:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530039.535199:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530039.535220:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353504896 00010000:00010000:0.0:1651530039.535240:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c55b3f lrc: 4/0,0 mode: PR/PR res: [0x2c094:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7f84 expref: 7 pid: 166111 timeout: 20848 lvb_type: 1 00000100:00100000:0.0:1651530039.535251:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13 00000100:00100000:0.0:1651530039.535253:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003132c0c7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438148:x1731754353504896:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651530039.535257:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651530039.535259:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c55b3f lrc: 4/0,0 mode: PR/PR res: [0x2c094:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7f84 expref: 7 pid: 166111 timeout: 20848 lvb_type: 1 00010000:00010000:0.0:1651530039.535263:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c55b3f lrc: 3/0,0 mode: PR/PR res: [0x2c094:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7f84 expref: 7 pid: 166111 timeout: 20848 lvb_type: 1 00010000:00010000:0.0:1651530039.535271:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c55b3f lrc: 0/0,0 mode: --/PR res: [0x2c094:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7f84 expref: 7 pid: 166111 timeout: 20848 lvb_type: 1 00010000:00010000:0.0:1651530039.535274:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530039.535275:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530039.535276:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55b46 lrc: 3/0,1 mode: PW/PW res: [0x2c094:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530039.535279:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55b46 lrc: 4/0,1 mode: PW/PW res: [0x2c094:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530039.535291:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1651530039.535300:0:166113:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55b46 lrc: 3/0,1 mode: PW/PW res: [0x2c094:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651530039.535304:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003132c0c7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438148:x1731754353504896:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 50us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530039.535307:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13 00010000:00010000:1.0:1651530039.535309:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55b46 lrc: 3/0,1 mode: PW/PW res: [0x2c094:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530039.535313:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55b46 lrc: 3/0,1 mode: PW/PW res: [0x2c094:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530039.535318:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55b46 lrc: 2/0,0 mode: PW/PW res: [0x2c094:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530039.535332:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55b46 lrc: 2/0,0 mode: PW/PW res: [0x2c094:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530039.535336:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2d8d18b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530039.535337:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55b46 lrc: 2/0,0 mode: PW/PW res: [0x2c094:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530039.535340:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55b46 lrc: 3/0,0 mode: PW/PW res: [0x2c094:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530039.535345:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55b46 lrc: 1/0,0 mode: --/PW res: [0x2c094:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530039.535348:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55b46 lrc: 0/0,0 mode: --/PW res: [0x2c094:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530039.535466:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5ebc6ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946849344:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 742us (790us total) trans 21474837351 rc 0/0 00000100:00100000:1.0:1651530039.535470:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 891 00000100:00100000:0.0:1651530041.981277:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f9050c71 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9063caa-b124-4cb6-99ef-d01a735595c3:39100:1731745997087488:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:0.0:1651530041.981323:0:39100:0:(ptlrpcd.c:414:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1651530041.981326:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004be7c06d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997087552:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:0.0:1651530041.981651:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004be7c06d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997087552:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:0.0:1651530041.981655:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f9050c71 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9063caa-b124-4cb6-99ef-d01a735595c3:39100:1731745997087488:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:1.0:1651530044.640159:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530044.640179:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946849600 00000100:00100000:1.0:1651530044.640199:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 78 00000100:00100000:1.0:1651530044.640202:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9b0314b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946849600:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651530044.640220:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 157304640 pending 0 free 81307987968 avail 77137276928 00000100:00100000:1.0:1651530044.640265:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9b0314b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946849600:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 63us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530044.640269:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 78 00000001:00080000:0.0:1651530045.075728:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474837351 is committed 00000100:00100000:1.0:1651530047.168952:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530047.168984:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754353795456 00000100:00100000:0.0:1651530047.169009:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 8 00000100:00100000:0.0:1651530047.169012:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0bff89e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438149:x1731754353795456:12345-10.240.43.64@tcp:400:kworker/u4:1.0 00000100:00100000:0.0:1651530047.169052:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0bff89e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438149:x1731754353795456:12345-10.240.43.64@tcp:400:kworker/u4:1.0 Request processed in 40us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530047.169055:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 8 00000100:00100000:1.0:1651530049.760168:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530049.760187:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946849792 00000100:00100000:1.0:1651530049.760213:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 79 00000100:00100000:1.0:1651530049.760216:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000056e45ef2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946849792:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651530049.760247:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 157304640 pending 0 free 81307987968 avail 77137276928 00000100:00100000:1.0:1651530049.760274:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000056e45ef2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946849792:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 57us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530049.760277:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 79 00000100:00100000:1.0:1651530054.880157:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530054.880176:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946849920 00000100:00100000:1.0:1651530054.880202:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 80 00000100:00100000:1.0:1651530054.880205:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946849920:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651530054.880238:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 157304640 pending 0 free 81307987968 avail 77137276928 00000100:00100000:1.0:1651530054.880265:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c4168d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946849920:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 60us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530054.880269:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 80 00000100:00100000:1.0:1651530060.000149:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530060.000169:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946850048 00000100:00100000:1.0:1651530060.000195:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 81 00000100:00100000:1.0:1651530060.000198:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b5b65d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946850048:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651530060.000217:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 157304640 pending 0 free 81307987968 avail 77137276928 00000100:00100000:1.0:1651530060.000257:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b5b65d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946850048:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 58us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530060.000261:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 81 00000100:00100000:1.0:1651530065.121195:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530065.121215:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946850176 00000100:00100000:1.0:1651530065.121255:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 82 00000100:00100000:1.0:1651530065.121257:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000687b7ae8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946850176:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651530065.121276:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 157304640 pending 0 free 81307987968 avail 77137276928 00000100:00100000:1.0:1651530065.121301:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000687b7ae8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946850176:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 43us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530065.121305:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 82 00000100:00100000:0.0:1651530067.069312:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004be7c06d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:39099:1731745997087680:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:0.0:1651530067.069363:0:39099:0:(ptlrpcd.c:414:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1651530067.069366:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f9050c71 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997087616:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:0.0:1651530067.069712:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f9050c71 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997087616:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:0.0:1651530067.069740:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004be7c06d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:39099:1731745997087680:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:1.0:1651530067.649010:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530067.649041:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754355599552 00000100:00100000:0.0:1651530067.649066:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 9 00000100:00100000:0.0:1651530067.649069:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008ce5f676 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438146:x1731754355599552:12345-10.240.43.64@tcp:400:kworker/u4:1.0 00000100:00100000:0.0:1651530067.649116:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008ce5f676 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438146:x1731754355599552:12345-10.240.43.64@tcp:400:kworker/u4:1.0 Request processed in 38us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530067.649120:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 9 00000100:00100000:1.0:1651530069.671436:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530069.671469:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356078080 00000100:00100000:0.0:1651530069.671494:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 893 00000100:00100000:0.0:1651530069.671497:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000712b8830 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438149:x1731754356078080:12345-10.240.43.64@tcp:101:rm.0 00010000:00010000:0.0:1651530069.671506:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651530069.671518:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c55b54 lrc: 2/0,0 mode: --/PR res: [0x2c097:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db30b0c1 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651530069.671531:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c097:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651530069.671541:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530069.671543:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530069.671547:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c55b54 lrc: 3/0,0 mode: PR/PR res: [0x2c097:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30b0c1 expref: 7 pid: 166113 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530069.671555:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c55b54 lrc: 3/0,0 mode: PR/PR res: [0x2c097:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30b0c1 expref: 7 pid: 166113 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530069.671561:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008119f3a8, rc 0) 00000100:00100000:0.0:1651530069.671591:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000712b8830 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438149:x1731754356078080:12345-10.240.43.64@tcp:101:rm.0 Request processed in 94us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530069.671595:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 893 00000100:00100000:1.0:1651530070.240164:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530070.240183:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946850304 00000100:00100000:1.0:1651530070.240209:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 83 00000100:00100000:1.0:1651530070.240211:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eb5b784a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946850304:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651530070.240249:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 157304640 pending 0 free 81307987968 avail 77137276928 00000100:00100000:1.0:1651530070.240275:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eb5b784a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946850304:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 63us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530070.240278:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 83 00000400:00000080:0.0:1651530071.553712:0:173618:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530071.553714:0:173618:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 155a: Verify small file correctness: read cache:on write_cache:on ========================================================== 22:21:11 (1651530071) 00000100:00100000:1.0:1651530072.252919:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530072.253012:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356237696 00000100:00100000:0.0:1651530072.253176:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5 00000100:00100000:0.0:1651530072.253183:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b810a5d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+7:451155:x1731754356237696:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651530072.253220:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1651530072.253314:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c55b54 lrc: 0/0,0 mode: --/PR res: [0x2c097:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30b0c1 expref: 7 pid: 166113 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530072.253351:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c55b15 lrc: 0/0,0 mode: --/PR res: [0x2c08d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db2f7b0f expref: 6 pid: 166111 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530072.253356:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651530072.253407:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b810a5d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+5:451155:x1731754356237696:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 224us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530072.253415:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5 00000100:00100000:1.0:1651530072.529702:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530072.529728:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356238080 00000100:00100000:1.0:1651530072.529757:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 894 00000100:00100000:1.0:1651530072.529759:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006dd920d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+5:438149:x1731754356238080:12345-10.240.43.64@tcp:101:cp.0 00010000:00010000:1.0:1651530072.529801:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651530072.529823:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c55b5b lrc: 2/0,0 mode: --/PR res: [0x2c098:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db30c52e expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530072.529840:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c098:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530072.529856:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530072.529861:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530072.529865:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c55b5b lrc: 3/0,0 mode: PR/PR res: [0x2c098:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c52e expref: 6 pid: 166111 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530072.529877:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c55b5b lrc: 3/0,0 mode: PR/PR res: [0x2c098:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c52e expref: 6 pid: 166111 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530072.529883:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c2a86deb, rc 0) 00000100:00100000:1.0:1651530072.529909:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006dd920d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438149:x1731754356238080:12345-10.240.43.64@tcp:101:cp.0 Request processed in 149us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530072.529913:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 894 00000100:00100000:1.0:1651530072.530283:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530072.530291:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356238144 00000100:00100000:1.0:1651530072.530304:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 895 00000100:00100000:1.0:1651530072.530306:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008f7d6b7b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+6:471543:x1731754356238144:12345-10.240.43.64@tcp:101:cp.0 00010000:00010000:1.0:1651530072.530310:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651530072.530314:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c55b62 lrc: 2/0,0 mode: --/PW res: [0x2c098:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db30c535 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530072.530336:0:166111:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c55b5b lrc: 2/0,0 mode: PR/PR res: [0x2c098:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c52e expref: 7 pid: 166111 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530072.530340:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530072.530341:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530072.530342:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c55b62 lrc: 4/0,0 mode: --/PW res: [0x2c098:0x0:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c535 expref: 7 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530072.530393:0:166111:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c55b5b lrc: 3/0,0 mode: PR/PR res: [0x2c098:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c52e expref: 7 pid: 166111 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530072.530405:0:166111:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c55b5b lrc: 4/0,0 mode: PR/PR res: [0x2c098:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c52e expref: 7 pid: 166111 timeout: 20881 lvb_type: 1 00000100:00100000:1.0:1651530072.530422:0:166111:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007af72033 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:166111:1731745997087744:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651530072.530465:0:166111:0:(client.c:2492:ptlrpc_set_wait()) set 000000004feb0064 going to sleep for 6 seconds 00000100:00100000:1.0:1651530072.530834:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530072.530855:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356238208 00000100:00100000:1.0:1651530072.530862:0:166111:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007af72033 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:166111:1731745997087744:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651530072.530870:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c55b62 lrc: 3/0,0 mode: --/PW res: [0x2c098:0x0:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c535 expref: 8 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530072.530875:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c0de17df, rc 0) 00010000:00010000:0.0:1651530072.530875:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c55b5b lrc: 4/0,0 mode: PR/PR res: [0x2c098:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c52e expref: 8 pid: 166111 timeout: 20881 lvb_type: 1 00000100:00100000:1.0:1651530072.530885:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008f7d6b7b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+8:471543:x1731754356238144:12345-10.240.43.64@tcp:101:cp.0 Request processed in 579us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530072.530888:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 895 00000100:00100000:0.0:1651530072.530895:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 14 00000100:00100000:0.0:1651530072.530897:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b511a08e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438147:x1731754356238208:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651530072.530902:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651530072.530908:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c55b5b lrc: 4/0,0 mode: PR/PR res: [0x2c098:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c52e expref: 7 pid: 166111 timeout: 20881 lvb_type: 1 00010000:00010000:0.0:1651530072.530913:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c55b5b lrc: 3/0,0 mode: PR/PR res: [0x2c098:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c52e expref: 7 pid: 166111 timeout: 20881 lvb_type: 1 00010000:00010000:0.0:1651530072.530922:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c55b5b lrc: 0/0,0 mode: --/PR res: [0x2c098:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c52e expref: 7 pid: 166111 timeout: 20881 lvb_type: 1 00010000:00010000:0.0:1651530072.530927:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530072.530928:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530072.530930:0:169267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c55b62 lrc: 2/0,0 mode: PW/PW res: [0x2c098:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c535 expref: 6 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530072.530934:0:169267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c55b62 lrc: 3/0,0 mode: PW/PW res: [0x2c098:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c535 expref: 6 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530072.530943:0:169267:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c55b62 lrc: 3/0,0 mode: PW/PW res: [0x2c098:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c535 expref: 6 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651530072.530948:0:169267:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004be7c06d pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:169267:1731745997087808:10.240.43.64@tcp:105: 00000100:00100000:0.0:1651530072.530975:0:169267:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e3ae16a going to sleep for 6 seconds 00000100:00100000:0.0:1651530072.531217:0:169267:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004be7c06d pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:169267:1731745997087808:10.240.43.64@tcp:105: 00010000:00010000:0.0:1651530072.531232:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651530072.531247:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b511a08e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438147:x1731754356238208:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 349us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530072.531251:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 14 00000100:00100000:1.0:1651530072.535501:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530072.535523:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356238464 00002000:00100000:0.0:1651530072.535564:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c098:0x0] (0->6095) req@000000007af72033 x1731754356238464/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:43/0 lens 6584/0 e 0 to 0 dl 1651530078 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cp.0' 00002000:00100000:0.0:1651530072.535574:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000007af72033 with x1731754356238464 ext(0->6095) 00002000:00010000:0.0:1651530072.535576:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000007af72033 00000100:00100000:0.0:1651530072.535591:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44 00000100:00100000:0.0:1651530072.535593:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007af72033 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438148:x1731754356238464:12345-10.240.43.64@tcp:4:cp.0 00000100:00100000:0.0:1651530072.536091:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007af72033 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438148:x1731754356238464:12345-10.240.43.64@tcp:4:cp.0 Request processed in 496us (589us total) trans 21474837352 rc 0/0 00000100:00100000:0.0:1651530072.536095:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44 00002000:00100000:0.0:1651530072.536098:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c098:0x0] (0->6095) req@000000007af72033 x1731754356238464/t21474837352(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:43/0 lens 6584/448 e 0 to 0 dl 1651530078 ref 1 fl Complete:/0/0 rc 0/0 job:'cp.0' 00002000:00100000:0.0:1651530072.536102:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000007af72033 with x1731754356238464 ext(0->6095) 00002000:00010000:0.0:1651530072.536103:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000007af72033 00000100:00100000:1.0:1651530072.536380:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530072.536391:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356238528 00000100:00100000:0.0:1651530072.536406:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6 00000100:00100000:0.0:1651530072.536408:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001faa7f64 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+8:451154:x1731754356238528:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651530072.536411:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1651530072.536421:0:169267:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2c098:0x0] updating lvb size from disk: 0 -> 6096 00002000:00010000:0.0:1651530072.536422:0:169267:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2c098:0x0] updating lvb mtime from disk: 0 -> 1651530072 00002000:00010000:0.0:1651530072.536423:0:169267:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2c098:0x0] updating lvb ctime from disk: 0 -> 1651530072 00002000:00010000:0.0:1651530072.536424:0:169267:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2c098:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:0.0:1651530072.536429:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c55b62 lrc: 0/0,0 mode: --/PW res: [0x2c098:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c535 expref: 8 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530072.536435:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651530072.536451:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001faa7f64 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+7:451154:x1731754356238528:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (71us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530072.536454:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6 00000100:00100000:1.0:1651530072.543247:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530072.543254:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356238720 00000100:00100000:1.0:1651530072.543267:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 896 00000100:00100000:1.0:1651530072.543269:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047d5dd29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438149:x1731754356238720:12345-10.240.43.64@tcp:101:cmp.0 00010000:00010000:1.0:1651530072.543273:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651530072.543277:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c55b69 lrc: 2/0,0 mode: --/PR res: [0x2c098:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db30c54a expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530072.543282:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c098:0x0] initial LVB size: 6096, mtime: 0x62705958, atime: 0x0, ctime: 0x62705958, blocks: 0x10 00010000:00010000:1.0:1651530072.543286:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530072.543287:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530072.543289:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c55b69 lrc: 3/0,0 mode: PR/PR res: [0x2c098:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c54a expref: 8 pid: 166111 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530072.543293:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c55b69 lrc: 3/0,0 mode: PR/PR res: [0x2c098:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c54a expref: 8 pid: 166111 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530072.543297:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000baeec0a3, rc 0) 00000100:00100000:1.0:1651530072.543308:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047d5dd29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438149:x1731754356238720:12345-10.240.43.64@tcp:101:cmp.0 Request processed in 38us (62us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530072.543311:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 896 00000100:00100000:1.0:1651530072.545260:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530072.545277:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356238848 00002000:00100000:0.0:1651530072.545285:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c098:0x0] (0->4194303) req@00000000583639e1 x1731754356238848/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:43/0 lens 488/0 e 0 to 0 dl 1651530078 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cmp.0' 00002000:00100000:0.0:1651530072.545289:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000583639e1 with x1731754356238848 ext(0->4194303) 00002000:00010000:0.0:1651530072.545291:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000583639e1 00000100:00100000:0.0:1651530072.545301:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 45 00000100:00100000:0.0:1651530072.545303:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000583639e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438148:x1731754356238848:12345-10.240.43.64@tcp:3:cmp.0 00000100:00100000:0.0:1651530072.546171:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000583639e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438148:x1731754356238848:12345-10.240.43.64@tcp:3:cmp.0 Request processed in 867us (911us total) trans 0 rc 8192/8192 00000100:00100000:0.0:1651530072.546175:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 45 00002000:00100000:0.0:1651530072.546178:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c098:0x0] (0->4194303) req@00000000583639e1 x1731754356238848/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:43/0 lens 488/440 e 0 to 0 dl 1651530078 ref 1 fl Complete:/0/0 rc 8192/8192 job:'cmp.0' 00002000:00100000:0.0:1651530072.546182:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000583639e1 with x1731754356238848 ext(0->4194303) 00002000:00010000:0.0:1651530072.546184:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000583639e1 00000100:00100000:0.0:1651530072.552649:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530072.552672:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356239040 00000100:00100000:1.0:1651530072.552685:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 897 00000100:00100000:1.0:1651530072.552687:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+8:471549:x1731754356239040:12345-10.240.43.64@tcp:101:truncate.0 00010000:00010000:1.0:1651530072.552690:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651530072.552694:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c55b70 lrc: 2/0,0 mode: --/PW res: [0x2c098:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db30c551 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530072.552701:0:166111:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c55b69 lrc: 2/0,0 mode: PR/PR res: [0x2c098:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c54a expref: 9 pid: 166111 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530072.552704:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530072.552705:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530072.552705:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c55b70 lrc: 4/0,0 mode: --/PW res: [0x2c098:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c551 expref: 9 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530072.552713:0:166111:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c55b69 lrc: 3/0,0 mode: PR/PR res: [0x2c098:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c54a expref: 9 pid: 166111 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530072.552716:0:166111:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c55b69 lrc: 4/0,0 mode: PR/PR res: [0x2c098:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c54a expref: 9 pid: 166111 timeout: 20881 lvb_type: 1 00000100:00100000:1.0:1651530072.552721:0:166111:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007053091c pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:166111:1731745997087872:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651530072.552733:0:166111:0:(client.c:2492:ptlrpc_set_wait()) set 000000004feb0064 going to sleep for 6 seconds 00000100:00100000:1.0:1651530072.552925:0:166111:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007053091c pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:166111:1731745997087872:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651530072.552930:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c55b70 lrc: 3/0,0 mode: --/PW res: [0x2c098:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c551 expref: 9 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530072.552935:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004f367ded, rc 0) 00000100:00100000:1.0:1651530072.552945:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+9:471549:x1731754356239040:12345-10.240.43.64@tcp:101:truncate.0 Request processed in 258us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530072.552948:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 897 00000100:00100000:0.0:1651530072.554020:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530072.554027:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356239104 00010000:00010000:0.0:1651530072.554033:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c55b69 lrc: 4/0,0 mode: PR/PR res: [0x2c098:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c54a expref: 9 pid: 166111 timeout: 20881 lvb_type: 1 00000100:00100000:0.0:1651530072.554049:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15 00000100:00100000:0.0:1651530072.554050:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004be7c06d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438148:x1731754356239104:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651530072.554054:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651530072.554058:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c55b69 lrc: 4/0,0 mode: PR/PR res: [0x2c098:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c54a expref: 9 pid: 166111 timeout: 20881 lvb_type: 1 00010000:00010000:0.0:1651530072.554062:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c55b69 lrc: 3/0,0 mode: PR/PR res: [0x2c098:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c54a expref: 9 pid: 166111 timeout: 20881 lvb_type: 1 00010000:00010000:0.0:1651530072.554068:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c55b69 lrc: 0/0,0 mode: --/PR res: [0x2c098:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c54a expref: 9 pid: 166111 timeout: 20881 lvb_type: 1 00010000:00010000:0.0:1651530072.554072:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530072.554073:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530072.554074:0:169267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c55b70 lrc: 2/0,0 mode: PW/PW res: [0x2c098:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c551 expref: 8 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530072.554077:0:169267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c55b70 lrc: 3/0,0 mode: PW/PW res: [0x2c098:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c551 expref: 8 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530072.554086:0:169267:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c55b70 lrc: 3/0,0 mode: PW/PW res: [0x2c098:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c551 expref: 8 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651530072.554092:0:169267:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f9050c71 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:169267:1731745997087936:10.240.43.64@tcp:105: 00000100:00100000:0.0:1651530072.554109:0:169267:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e3ae16a going to sleep for 6 seconds 00000100:00100000:0.0:1651530072.554334:0:169267:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f9050c71 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:169267:1731745997087936:10.240.43.64@tcp:105: 00010000:00010000:0.0:1651530072.554339:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651530072.554353:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004be7c06d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438148:x1731754356239104:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 302us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530072.554356:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15 00000100:00100000:0.0:1651530072.554432:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530072.554439:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356239168 00002000:00010000:0.0:1651530072.554445:0:166118:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 180376/0 (6000->18446744073709551615) 00002000:00100000:0.0:1651530072.554446:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f9050c71 with x1731754356239168 ext(6000->18446744073709551615) 00002000:00010000:0.0:1651530072.554449:0:166118:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f9050c71. 00000100:00100000:0.0:1651530072.554461:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 46 00000100:00100000:0.0:1651530072.554462:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438146:x1731754356239168:12345-10.240.43.64@tcp:10:truncate.0 00002000:00010000:0.0:1651530072.554865:0:166118:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2c098:0x0] updating lvb size from disk: 6096 -> 6000 00002000:00010000:0.0:1651530072.554866:0:166118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2c098:0x0] updating lvb mtime from disk: 1651530072 -> 1651530072 00002000:00010000:0.0:1651530072.554867:0:166118:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2c098:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651530072.554868:0:166118:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2c098:0x0] updating lvb ctime from disk: 1651530072 -> 1651530072 00002000:00010000:0.0:1651530072.554869:0:166118:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2c098:0x0] updating lvb blocks from disk: 16 -> 16 00000100:00100000:0.0:1651530072.554886:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9050c71 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438146:x1731754356239168:12345-10.240.43.64@tcp:10:truncate.0 Request processed in 423us (454us total) trans 21474837353 rc 0/0 00000100:00100000:0.0:1651530072.554889:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 46 00002000:00010000:0.0:1651530072.554890:0:166118:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 180376/0 (6000->18446744073709551615) 00002000:00100000:0.0:1651530072.554892:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f9050c71 with x1731754356239168 ext(6000->18446744073709551615) 00002000:00010000:0.0:1651530072.554894:0:166118:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f9050c71. 00000100:00100000:0.0:1651530072.559903:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530072.559911:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356239680 00002000:00100000:0.0:1651530072.559918:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c098:0x0] (0->4194303) req@000000004972eb27 x1731754356239680/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:43/0 lens 488/0 e 0 to 0 dl 1651530078 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cmp.0' 00002000:00100000:0.0:1651530072.559922:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004972eb27 with x1731754356239680 ext(0->4194303) 00002000:00010000:0.0:1651530072.559923:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000004972eb27 00000100:00100000:0.0:1651530072.559935:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 47 00000100:00100000:0.0:1651530072.559937:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438149:x1731754356239680:12345-10.240.43.64@tcp:3:cmp.0 00000100:00100000:0.0:1651530072.560730:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004972eb27 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438149:x1731754356239680:12345-10.240.43.64@tcp:3:cmp.0 Request processed in 791us (826us total) trans 0 rc 8192/8192 00000100:00100000:0.0:1651530072.560733:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 47 00002000:00100000:0.0:1651530072.560736:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c098:0x0] (0->4194303) req@000000004972eb27 x1731754356239680/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:43/0 lens 488/440 e 0 to 0 dl 1651530078 ref 1 fl Complete:/0/0 rc 8192/8192 job:'cmp.0' 00002000:00100000:0.0:1651530072.560740:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004972eb27 with x1731754356239680 ext(0->4194303) 00002000:00010000:0.0:1651530072.560741:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000004972eb27 00000400:00000080:1.0:1651530074.222616:0:174056:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651530074.222618:0:174056:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 155b: Verify small file correctness: read cache:on write_cache:off ========================================================== 22:21:13 (1651530073) 00000100:00100000:1.0:1651530074.907566:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530074.907592:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356240960 00000100:00100000:0.0:1651530074.907624:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 7 00000100:00100000:0.0:1651530074.907627:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007053091c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+9:454981:x1731754356240960:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651530074.907635:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651530074.907656:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c55b70 lrc: 0/0,0 mode: --/PW res: [0x2c098:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c551 expref: 9 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530074.907665:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651530074.907688:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007053091c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+8:454981:x1731754356240960:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 61us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530074.907692:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 7 00000100:00100000:1.0:1651530075.260442:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530075.260456:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530075.260470:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530075.260483:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946851136 00000100:00100000:0.0:1651530075.260484:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946851264 00000100:00100000:1.0:1651530075.260510:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946851200 00000100:00100000:1.0:1651530075.260515:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 898 00000100:00100000:1.0:1651530075.260518:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e85686f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946851136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00000100:00100000:0.0:1651530075.260519:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 899 00000100:00100000:0.0:1651530075.260521:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000315faada pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745946851264:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651530075.260533:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180374 count 1 00002000:00080000:0.0:1651530075.260533:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180376 count 1 00002000:00010000:1.0:1651530075.260548:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c096:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:0.0:1651530075.260548:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c098:0x0] initial LVB size: 6000, mtime: 0x62705958, atime: 0x0, ctime: 0x62705958, blocks: 0x10 00010000:00010000:1.0:1651530075.260552:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55b7e lrc: 3/0,1 mode: --/PW res: [0x2c096:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530075.260552:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c55b77 lrc: 3/0,1 mode: --/PW res: [0x2c098:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530075.260559:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530075.260559:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530075.260560:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530075.260560:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530075.260562:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55b7e lrc: 3/0,1 mode: PW/PW res: [0x2c096:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530075.260562:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c55b77 lrc: 3/0,1 mode: PW/PW res: [0x2c098:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530075.260579:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55b7e lrc: 3/0,1 mode: PW/PW res: [0x2c096:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530075.260579:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c55b77 lrc: 3/0,1 mode: PW/PW res: [0x2c098:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530075.260583:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55b7e lrc: 3/0,1 mode: PW/PW res: [0x2c096:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530075.260583:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c55b77 lrc: 3/0,1 mode: PW/PW res: [0x2c098:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530075.260587:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55b7e lrc: 2/0,0 mode: PW/PW res: [0x2c096:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530075.260587:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c55b77 lrc: 2/0,0 mode: PW/PW res: [0x2c098:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530075.260699:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c55b77 lrc: 2/0,0 mode: PW/PW res: [0x2c098:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530075.260704:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008119f3a8 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530075.260704:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55b7e lrc: 2/0,0 mode: PW/PW res: [0x2c096:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530075.260709:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c55b77 lrc: 2/0,0 mode: PW/PW res: [0x2c098:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530075.260709:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004678bff1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530075.260710:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55b7e lrc: 2/0,0 mode: PW/PW res: [0x2c096:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530075.260720:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c55b77 lrc: 3/0,0 mode: PW/PW res: [0x2c098:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530075.260720:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55b7e lrc: 3/0,0 mode: PW/PW res: [0x2c096:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530075.260728:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c55b77 lrc: 1/0,0 mode: --/PW res: [0x2c098:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530075.260728:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55b7e lrc: 1/0,0 mode: --/PW res: [0x2c096:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530075.260731:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008119f3a8/0x3234de053c55b77 lrc: 0/0,0 mode: --/PW res: [0x2c098:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530075.260731:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55b7e lrc: 0/0,0 mode: --/PW res: [0x2c096:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530075.260901:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e85686f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946851136:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 382us (461us total) trans 21474837354 rc 0/0 00000100:00100000:1.0:1651530075.260905:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 898 00000100:00100000:1.0:1651530075.260913:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 900 00000100:00100000:1.0:1651530075.260915:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b810a5d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946851200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651530075.260920:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180375 count 1 00002000:00010000:1.0:1651530075.260926:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c097:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530075.260928:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c55b85 lrc: 3/0,1 mode: --/PW res: [0x2c097:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530075.260932:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530075.260933:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530075.260934:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c55b85 lrc: 3/0,1 mode: PW/PW res: [0x2c097:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530075.260938:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c55b85 lrc: 3/0,1 mode: PW/PW res: [0x2c097:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530075.260941:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c55b85 lrc: 3/0,1 mode: PW/PW res: [0x2c097:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530075.260944:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c55b85 lrc: 2/0,0 mode: PW/PW res: [0x2c097:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530075.260990:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c55b85 lrc: 2/0,0 mode: PW/PW res: [0x2c097:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530075.260993:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007c1cad42 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651530075.260995:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c55b85 lrc: 2/0,0 mode: PW/PW res: [0x2c097:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530075.260998:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c55b85 lrc: 3/0,0 mode: PW/PW res: [0x2c097:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530075.261003:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c55b85 lrc: 1/0,0 mode: --/PW res: [0x2c097:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530075.261006:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c55b85 lrc: 0/0,0 mode: --/PW res: [0x2c097:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530075.261093:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b810a5d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745946851200:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 177us (623us total) trans 21474837356 rc 0/0 00000100:00100000:1.0:1651530075.261097:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 900 00000100:00100000:0.0:1651530075.261319:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000315faada pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745946851264:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 796us (862us total) trans 21474837355 rc 0/0 00000100:00100000:0.0:1651530075.261323:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 899 00000100:00100000:1.0:1651530075.360098:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530075.360127:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946851328 00000100:00100000:1.0:1651530075.360149:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 84 00000100:00100000:1.0:1651530075.360151:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946851328:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651530075.360164:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 165627712 pending 32768 free 81307987968 avail 77137276928 00000100:00100000:1.0:1651530075.360178:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005b3c5aba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:39029:x1731745946851328:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 27us (81us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530075.360181:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 84 00000400:00000080:0.0:1651530076.895914:0:174494:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530076.895916:0:174494:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 155c: Verify small file correctness: read cache:off write_cache:on ========================================================== 22:21:16 (1651530076) 00000100:00100000:1.0:1651530077.859750:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530077.859779:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356244544 00000100:00100000:0.0:1651530077.859805:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 901 00000100:00100000:0.0:1651530077.859816:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438149:x1731754356244544:12345-10.240.43.64@tcp:101:cp.0 00010000:00010000:0.0:1651530077.859825:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651530077.859836:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55b8c lrc: 2/0,0 mode: --/PR res: [0x2c099:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db30c60e expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651530077.859848:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c099:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651530077.859857:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530077.859858:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530077.859863:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55b8c lrc: 3/0,0 mode: PR/PR res: [0x2c099:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c60e expref: 9 pid: 166113 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530077.859871:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55b8c lrc: 3/0,0 mode: PR/PR res: [0x2c099:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c60e expref: 9 pid: 166113 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530077.859877:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000092ad010c, rc 0) 00000100:00100000:0.0:1651530077.859904:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438149:x1731754356244544:12345-10.240.43.64@tcp:101:cp.0 Request processed in 96us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530077.859908:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 901 00000100:00100000:1.0:1651530077.860255:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530077.860277:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356244608 00000100:00100000:0.0:1651530077.860289:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 902 00000100:00100000:0.0:1651530077.860291:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+9:473093:x1731754356244608:12345-10.240.43.64@tcp:101:cp.0 00010000:00010000:0.0:1651530077.860294:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651530077.860299:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55b93 lrc: 2/0,0 mode: --/PW res: [0x2c099:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db30c615 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530077.860306:0:166113:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55b8c lrc: 2/0,0 mode: PR/PR res: [0x2c099:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c60e expref: 10 pid: 166113 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530077.860310:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530077.860311:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530077.860312:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55b93 lrc: 4/0,0 mode: --/PW res: [0x2c099:0x0:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c615 expref: 10 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530077.860324:0:166113:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55b8c lrc: 3/0,0 mode: PR/PR res: [0x2c099:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c60e expref: 10 pid: 166113 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530077.860332:0:166113:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55b8c lrc: 4/0,0 mode: PR/PR res: [0x2c099:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c60e expref: 10 pid: 166113 timeout: 20886 lvb_type: 1 00000100:00100000:0.0:1651530077.860337:0:166113:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003e3f0f77 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997088000:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651530077.860361:0:166113:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b1b3d0f8 going to sleep for 6 seconds 00000100:00100000:0.0:1651530077.860600:0:166113:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003e3f0f77 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997088000:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651530077.860608:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55b93 lrc: 3/0,0 mode: --/PW res: [0x2c099:0x0:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c615 expref: 10 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530077.860613:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b1b8f74, rc 0) 00000100:00100000:1.0:1651530077.860619:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530077.860631:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+10:473093:x1731754356244608:12345-10.240.43.64@tcp:101:cp.0 Request processed in 339us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530077.860634:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 902 00000100:00100000:0.0:1651530077.860644:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356244672 00010000:00010000:0.0:1651530077.860650:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55b8c lrc: 4/0,0 mode: PR/PR res: [0x2c099:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c60e expref: 10 pid: 166113 timeout: 20886 lvb_type: 1 00000100:00100000:0.0:1651530077.860658:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 16 00000100:00100000:0.0:1651530077.860660:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+10:438148:x1731754356244672:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1651530077.860664:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651530077.860668:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55b8c lrc: 4/0,0 mode: PR/PR res: [0x2c099:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c60e expref: 10 pid: 166113 timeout: 20886 lvb_type: 1 00010000:00010000:0.0:1651530077.860673:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55b8c lrc: 3/0,0 mode: PR/PR res: [0x2c099:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c60e expref: 10 pid: 166113 timeout: 20886 lvb_type: 1 00010000:00010000:0.0:1651530077.860680:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55b8c lrc: 0/0,0 mode: --/PR res: [0x2c099:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c60e expref: 10 pid: 166113 timeout: 20886 lvb_type: 1 00010000:00010000:0.0:1651530077.860684:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530077.860685:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530077.860687:0:169267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55b93 lrc: 2/0,0 mode: PW/PW res: [0x2c099:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c615 expref: 9 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530077.860690:0:169267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55b93 lrc: 3/0,0 mode: PW/PW res: [0x2c099:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c615 expref: 9 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530077.860699:0:169267:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55b93 lrc: 3/0,0 mode: PW/PW res: [0x2c099:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c615 expref: 9 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651530077.860703:0:169267:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003e3f0f77 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:169267:1731745997088064:10.240.43.64@tcp:105: 00000100:00100000:0.0:1651530077.860721:0:169267:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b1b3d0f8 going to sleep for 6 seconds 00000100:00100000:0.0:1651530077.860928:0:169267:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003e3f0f77 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:169267:1731745997088064:10.240.43.64@tcp:105: 00010000:00010000:0.0:1651530077.860932:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651530077.860945:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438148:x1731754356244672:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 284us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530077.860948:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 16 00000100:00100000:1.0:1651530077.865699:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530077.865724:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356244928 00002000:00100000:0.0:1651530077.865736:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c099:0x0] (0->6095) req@000000001a9b051f x1731754356244928/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:48/0 lens 6584/0 e 0 to 0 dl 1651530083 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cp.0' 00002000:00100000:0.0:1651530077.865741:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001a9b051f with x1731754356244928 ext(0->6095) 00002000:00010000:0.0:1651530077.865743:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000001a9b051f 00000100:00100000:0.0:1651530077.865754:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 48 00000100:00100000:0.0:1651530077.865756:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438149:x1731754356244928:12345-10.240.43.64@tcp:4:cp.0 00000100:00100000:0.0:1651530077.866105:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a9b051f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+11:438149:x1731754356244928:12345-10.240.43.64@tcp:4:cp.0 Request processed in 348us (406us total) trans 21474837357 rc 0/0 00000100:00100000:0.0:1651530077.866109:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 48 00002000:00100000:0.0:1651530077.866120:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c099:0x0] (0->6095) req@000000001a9b051f x1731754356244928/t21474837357(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:48/0 lens 6584/448 e 0 to 0 dl 1651530083 ref 1 fl Complete:/0/0 rc 0/0 job:'cp.0' 00002000:00100000:0.0:1651530077.866140:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001a9b051f with x1731754356244928 ext(0->6095) 00002000:00010000:0.0:1651530077.866142:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000001a9b051f 00000100:00100000:1.0:1651530077.866397:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530077.866412:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356244992 00000100:00100000:0.0:1651530077.866425:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 8 00000100:00100000:0.0:1651530077.866426:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+11:451155:x1731754356244992:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651530077.866430:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1651530077.866433:0:169267:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2c099:0x0] updating lvb size from disk: 0 -> 6096 00002000:00010000:0.0:1651530077.866434:0:169267:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2c099:0x0] updating lvb mtime from disk: 0 -> 1651530077 00002000:00010000:0.0:1651530077.866435:0:169267:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2c099:0x0] updating lvb ctime from disk: 0 -> 1651530077 00002000:00010000:0.0:1651530077.866436:0:169267:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2c099:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:0.0:1651530077.866442:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55b93 lrc: 0/0,0 mode: --/PW res: [0x2c099:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c615 expref: 11 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530077.866447:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651530077.866460:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+10:451155:x1731754356244992:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 33us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530077.866463:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 8 00000100:00100000:1.0:1651530077.873319:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530077.873341:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356245184 00000100:00100000:0.0:1651530077.873353:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 903 00000100:00100000:0.0:1651530077.873355:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000035f3f4bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+10:438146:x1731754356245184:12345-10.240.43.64@tcp:101:cmp.0 00010000:00010000:0.0:1651530077.873358:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651530077.873363:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55b9a lrc: 2/0,0 mode: --/PR res: [0x2c099:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db30c62a expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651530077.873368:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c099:0x0] initial LVB size: 6096, mtime: 0x6270595d, atime: 0x0, ctime: 0x6270595d, blocks: 0x10 00010000:00010000:0.0:1651530077.873372:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530077.873373:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530077.873374:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55b9a lrc: 3/0,0 mode: PR/PR res: [0x2c099:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c62a expref: 11 pid: 166113 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530077.873379:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55b9a lrc: 3/0,0 mode: PR/PR res: [0x2c099:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c62a expref: 11 pid: 166113 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530077.873383:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b1b8f74, rc 0) 00000100:00100000:0.0:1651530077.873398:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000035f3f4bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+11:438146:x1731754356245184:12345-10.240.43.64@tcp:101:cmp.0 Request processed in 42us (80us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530077.873401:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 903 00000100:00100000:1.0:1651530077.875304:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530077.875326:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356245312 00002000:00100000:0.0:1651530077.875334:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c099:0x0] (0->4194303) req@00000000e7f02909 x1731754356245312/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:48/0 lens 488/0 e 0 to 0 dl 1651530083 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cmp.0' 00002000:00100000:0.0:1651530077.875338:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e7f02909 with x1731754356245312 ext(0->4194303) 00002000:00010000:0.0:1651530077.875339:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000e7f02909 00000100:00100000:0.0:1651530077.875348:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 49 00000100:00100000:0.0:1651530077.875350:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+11:438147:x1731754356245312:12345-10.240.43.64@tcp:3:cmp.0 00000100:00100000:0.0:1651530077.875988:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f02909 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+11:438147:x1731754356245312:12345-10.240.43.64@tcp:3:cmp.0 Request processed in 637us (684us total) trans 0 rc 8192/8192 00000100:00100000:0.0:1651530077.875992:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 49 00002000:00100000:0.0:1651530077.875994:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c099:0x0] (0->4194303) req@00000000e7f02909 x1731754356245312/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:48/0 lens 488/440 e 0 to 0 dl 1651530083 ref 1 fl Complete:/0/0 rc 8192/8192 job:'cmp.0' 00002000:00100000:0.0:1651530077.875998:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e7f02909 with x1731754356245312 ext(0->4194303) 00002000:00010000:0.0:1651530077.875999:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000e7f02909 00000100:00100000:1.0:1651530077.881374:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530077.881396:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356245504 00000100:00100000:0.0:1651530077.881410:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 904 00000100:00100000:0.0:1651530077.881411:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017e3b33f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+11:473099:x1731754356245504:12345-10.240.43.64@tcp:101:truncate.0 00010000:00010000:0.0:1651530077.881415:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651530077.881419:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55ba1 lrc: 2/0,0 mode: --/PW res: [0x2c099:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db30c631 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530077.881426:0:166113:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55b9a lrc: 2/0,0 mode: PR/PR res: [0x2c099:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c62a expref: 12 pid: 166113 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530077.881429:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530077.881430:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530077.881431:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55ba1 lrc: 4/0,0 mode: --/PW res: [0x2c099:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c631 expref: 12 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530077.881438:0:166113:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55b9a lrc: 3/0,0 mode: PR/PR res: [0x2c099:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c62a expref: 12 pid: 166113 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530077.881442:0:166113:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55b9a lrc: 4/0,0 mode: PR/PR res: [0x2c099:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c62a expref: 12 pid: 166113 timeout: 20886 lvb_type: 1 00000100:00100000:0.0:1651530077.881447:0:166113:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003e3f0f77 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997088128:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651530077.881465:0:166113:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b1b3d0f8 going to sleep for 6 seconds 00000100:00100000:1.0:1651530077.882745:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530077.882755:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356245568 00010000:00010000:0.0:1651530077.882762:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55b9a lrc: 5/0,0 mode: PR/PR res: [0x2c099:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c62a expref: 13 pid: 166113 timeout: 20886 lvb_type: 1 00000100:00100000:0.0:1651530077.882774:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 17 00000100:00100000:0.0:1651530077.882775:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+13:438146:x1731754356245568:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651530077.882779:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651530077.882783:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55b9a lrc: 5/0,0 mode: PR/PR res: [0x2c099:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c62a expref: 13 pid: 166113 timeout: 20886 lvb_type: 1 00010000:00010000:0.0:1651530077.882787:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55b9a lrc: 4/0,0 mode: PR/PR res: [0x2c099:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c62a expref: 13 pid: 166113 timeout: 20886 lvb_type: 1 00010000:00010000:0.0:1651530077.882793:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530077.882793:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530077.882794:0:169267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55ba1 lrc: 3/0,0 mode: PW/PW res: [0x2c099:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c631 expref: 13 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530077.882804:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b1b8f74/0x3234de053c55b9a lrc: 0/0,0 mode: --/PR res: [0x2c099:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c62a expref: 13 pid: 166113 timeout: 20886 lvb_type: 1 00010000:00010000:0.0:1651530077.882805:0:169267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55ba1 lrc: 4/0,0 mode: PW/PW res: [0x2c099:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c631 expref: 13 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530077.882812:0:166113:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003e3f0f77 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997088128:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651530077.882814:0:169267:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55ba1 lrc: 4/0,0 mode: PW/PW res: [0x2c099:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c631 expref: 12 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530077.882818:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55ba1 lrc: 4/0,0 mode: PW/PW res: [0x2c099:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c631 expref: 12 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651530077.882821:0:169267:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000088fa78f8 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:169267:1731745997088192:10.240.43.64@tcp:105: 00010000:00010000:1.0:1651530077.882823:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000092ad010c, rc 0) 00000100:00100000:0.0:1651530077.882836:0:169267:0:(client.c:2492:ptlrpc_set_wait()) set 0000000080004f0a going to sleep for 6 seconds 00000100:00100000:1.0:1651530077.882842:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017e3b33f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+12:473099:x1731754356245504:12345-10.240.43.64@tcp:101:truncate.0 Request processed in 1430us (1468us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530077.882846:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 904 00000100:00100000:0.0:1651530077.883093:0:169267:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000088fa78f8 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:169267:1731745997088192:10.240.43.64@tcp:105: 00010000:00010000:0.0:1651530077.883097:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651530077.883109:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+11:438146:x1731754356245568:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 333us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530077.883121:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 17 00000100:00100000:1.0:1651530077.883127:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530077.883153:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356245632 00002000:00010000:1.0:1651530077.883174:0:166118:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 180377/0 (6000->18446744073709551615) 00002000:00100000:1.0:1651530077.883175:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009f35d921 with x1731754356245632 ext(6000->18446744073709551615) 00002000:00010000:1.0:1651530077.883179:0:166118:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000009f35d921. 00000100:00100000:1.0:1651530077.883185:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 50 00000100:00100000:1.0:1651530077.883187:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009f35d921 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+11:438148:x1731754356245632:12345-10.240.43.64@tcp:10:truncate.0 00002000:00010000:1.0:1651530077.883294:0:166118:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2c099:0x0] updating lvb size from disk: 6096 -> 6000 00002000:00010000:1.0:1651530077.883296:0:166118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2c099:0x0] updating lvb mtime from disk: 1651530077 -> 1651530077 00002000:00010000:1.0:1651530077.883297:0:166118:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2c099:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651530077.883298:0:166118:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2c099:0x0] updating lvb ctime from disk: 1651530077 -> 1651530077 00002000:00010000:1.0:1651530077.883299:0:166118:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2c099:0x0] updating lvb blocks from disk: 16 -> 16 00000100:00100000:1.0:1651530077.883316:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009f35d921 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+12:438148:x1731754356245632:12345-10.240.43.64@tcp:10:truncate.0 Request processed in 128us (189us total) trans 21474837358 rc 0/0 00000100:00100000:1.0:1651530077.883320:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 50 00002000:00010000:1.0:1651530077.883321:0:166118:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 180377/0 (6000->18446744073709551615) 00002000:00100000:1.0:1651530077.883322:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009f35d921 with x1731754356245632 ext(6000->18446744073709551615) 00002000:00010000:1.0:1651530077.883324:0:166118:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000009f35d921. 00000100:00100000:0.0:1651530077.888231:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530077.888244:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356246144 00002000:00100000:1.0:1651530077.888253:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c099:0x0] (0->4194303) req@0000000088fa78f8 x1731754356246144/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:48/0 lens 488/0 e 0 to 0 dl 1651530083 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cmp.0' 00002000:00100000:1.0:1651530077.888257:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000088fa78f8 with x1731754356246144 ext(0->4194303) 00002000:00010000:1.0:1651530077.888259:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000088fa78f8 00000100:00100000:1.0:1651530077.888269:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 51 00000100:00100000:1.0:1651530077.888271:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+12:438148:x1731754356246144:12345-10.240.43.64@tcp:3:cmp.0 00000001:00080000:0.0:1651530077.890958:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474837357 is committed 00000001:00080000:0.0:1651530077.890965:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474837356 is committed 00000100:00100000:1.0:1651530077.891048:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088fa78f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438148:x1731754356246144:12345-10.240.43.64@tcp:3:cmp.0 Request processed in 2775us (2826us total) trans 0 rc 8192/8192 00000100:00100000:1.0:1651530077.891051:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 51 00002000:00100000:1.0:1651530077.891054:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c099:0x0] (0->4194303) req@0000000088fa78f8 x1731754356246144/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:48/0 lens 488/440 e 0 to 0 dl 1651530083 ref 1 fl Complete:/0/0 rc 8192/8192 job:'cmp.0' 00002000:00100000:1.0:1651530077.891058:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000088fa78f8 with x1731754356246144 ext(0->4194303) 00002000:00010000:1.0:1651530077.891060:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000088fa78f8 00000400:00000080:0.0:1651530079.544058:0:174932:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530079.544061:0:174932:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 155d: Verify small file correctness: read cache:off write_cache:off ========================================================== 22:21:19 (1651530079) 00000100:00100000:0.0:1651530080.219609:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530080.219627:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356247360 00000100:00100000:0.0:1651530080.219663:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 9 00000100:00100000:0.0:1651530080.219666:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000002830b34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+7:454981:x1731754356247360:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651530080.219675:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651530080.219696:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55ba1 lrc: 0/0,0 mode: --/PW res: [0x2c099:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c631 expref: 7 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530080.219705:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651530080.219727:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000002830b34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+6:454981:x1731754356247360:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 60us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530080.219731:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 9 00000100:00100000:1.0:1651530080.483686:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530080.483704:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946851776 00000100:00100000:1.0:1651530080.483727:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 85 00000100:00100000:1.0:1651530080.483729:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946851776:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651530080.483746:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 173971264 pending 0 free 81307979776 avail 77137268736 00000100:00100000:1.0:1651530080.483770:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000066de8c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946851776:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 40us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530080.483773:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 85 00000100:00100000:1.0:1651530080.519835:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530080.519845:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946851904 00000100:00100000:1.0:1651530080.519856:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 905 00000100:00100000:1.0:1651530080.519858:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946851904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651530080.519867:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180377 count 1 00002000:00010000:1.0:1651530080.519882:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c099:0x0] initial LVB size: 6000, mtime: 0x6270595d, atime: 0x0, ctime: 0x6270595d, blocks: 0x10 00010000:00010000:1.0:1651530080.519886:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c55ba8 lrc: 3/0,1 mode: --/PW res: [0x2c099:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530080.519893:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530080.519894:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530080.519897:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c55ba8 lrc: 3/0,1 mode: PW/PW res: [0x2c099:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530080.519903:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c55ba8 lrc: 3/0,1 mode: PW/PW res: [0x2c099:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530080.519907:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c55ba8 lrc: 3/0,1 mode: PW/PW res: [0x2c099:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530080.519910:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c55ba8 lrc: 2/0,0 mode: PW/PW res: [0x2c099:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530080.519941:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c55ba8 lrc: 2/0,0 mode: PW/PW res: [0x2c099:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530080.519948:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007c1cad42 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530080.519950:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c55ba8 lrc: 2/0,0 mode: PW/PW res: [0x2c099:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530080.519954:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c55ba8 lrc: 3/0,0 mode: PW/PW res: [0x2c099:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530080.519963:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c55ba8 lrc: 1/0,0 mode: --/PW res: [0x2c099:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530080.519966:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c55ba8 lrc: 0/0,0 mode: --/PW res: [0x2c099:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530080.520214:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946851904:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 354us (379us total) trans 21474837359 rc 0/0 00000100:00100000:1.0:1651530080.520218:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 905 00000400:00000080:1.0:1651530082.185434:0:175370:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651530082.185436:0:175370:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 155e: Verify big file correctness: read cache:on write_cache:on ========================================================== 22:21:21 (1651530081) 00000001:00080000:0.0:1651530083.526781:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474837359 is committed 00000001:00080000:0.0:1651530083.526788:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474837358 is committed 00000100:00100000:1.0:1651530085.057560:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530085.057579:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356250688 00000100:00100000:1.0:1651530085.057616:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10 00000100:00100000:1.0:1651530085.057619:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+5:438149:x1731754356250688:12345-10.240.43.64@tcp:400:kworker/u4:2.0 00000100:00100000:1.0:1651530085.057657:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+5:438149:x1731754356250688:12345-10.240.43.64@tcp:400:kworker/u4:2.0 Request processed in 38us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530085.057661:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10 00000100:00100000:1.0:1651530085.600194:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651530085.600236:0:166115:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946852352 00000100:00100000:0.0:1651530085.600263:0:166115:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 86 00000100:00100000:0.0:1651530085.600266:0:166115:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946852352:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651530085.600284:0:166115:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 173971264 pending 0 free 81307987968 avail 77137276928 00000100:00100000:0.0:1651530085.600316:0:166115:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d28c414b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946852352:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 50us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530085.600320:0:166115:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 86 00000100:00100000:1.0:1651530090.720187:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651530090.720220:0:166115:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946852544 00000100:00100000:0.0:1651530090.720257:0:166115:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 87 00000100:00100000:0.0:1651530090.720259:0:166115:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946852544:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651530090.720279:0:166115:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 173971264 pending 0 free 81307987968 avail 77137276928 00000100:00100000:0.0:1651530090.720311:0:166115:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000822949b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946852544:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 51us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530090.720315:0:166115:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 87 00000100:00100000:0.0:1651530092.157366:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004be7c06d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9063caa-b124-4cb6-99ef-d01a735595c3:39100:1731745997088256:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:0.0:1651530092.157419:0:39100:0:(ptlrpcd.c:414:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1651530092.157422:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003e3f0f77 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997088320:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:0.0:1651530092.157802:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003e3f0f77 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997088320:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:0.0:1651530092.157807:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004be7c06d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9063caa-b124-4cb6-99ef-d01a735595c3:39100:1731745997088256:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:1.0:1651530092.647257:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530092.647281:0:166115:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356250944 00000100:00100000:0.0:1651530092.647302:0:166115:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 88 00000100:00100000:0.0:1651530092.647304:0:166115:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cccc371e-feb6-4a45-b229-8d88a861b48a+5:475074:x1731754356250944:12345-10.240.43.64@tcp:13:lctl.0 00002000:00000024:0.0:1651530092.647320:0:166115:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 173971264 pending 0 free 81307987968 avail 77137276928 00000100:00100000:0.0:1651530092.647347:0:166115:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000064719963 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cccc371e-feb6-4a45-b229-8d88a861b48a+5:475074:x1731754356250944:12345-10.240.43.64@tcp:13:lctl.0 Request processed in 42us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530092.647351:0:166115:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 88 00000100:00100000:1.0:1651530093.074069:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530093.074087:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356251712 00000100:00100000:1.0:1651530093.074111:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 906 00000100:00100000:1.0:1651530093.074113:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e30915ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+5:438149:x1731754356251712:12345-10.240.43.64@tcp:101:cp.0 00010000:00010000:1.0:1651530093.074131:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651530093.074150:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55baf lrc: 2/0,0 mode: --/PR res: [0x2c09a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db30c6ee expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530093.074162:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c09a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530093.074172:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530093.074173:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530093.074177:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55baf lrc: 3/0,0 mode: PR/PR res: [0x2c09a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c6ee expref: 6 pid: 166113 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530093.074185:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55baf lrc: 3/0,0 mode: PR/PR res: [0x2c09a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c6ee expref: 6 pid: 166113 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530093.074191:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001ea46bb1, rc 0) 00000100:00100000:1.0:1651530093.074213:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e30915ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438149:x1731754356251712:12345-10.240.43.64@tcp:101:cp.0 Request processed in 99us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530093.074216:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 906 00000100:00100000:1.0:1651530093.075847:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530093.075855:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356252096 00000100:00100000:1.0:1651530093.075868:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 907 00000100:00100000:1.0:1651530093.075869:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:475085:x1731754356252096:12345-10.240.43.64@tcp:101:cp.0 00010000:00010000:1.0:1651530093.075873:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651530093.075878:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55bb6 lrc: 2/0,0 mode: --/PW res: [0x2c09a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db30c703 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530093.075886:0:166113:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55baf lrc: 2/0,0 mode: PR/PR res: [0x2c09a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c6ee expref: 7 pid: 166113 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530093.075890:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530093.075890:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530093.075892:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55bb6 lrc: 4/0,0 mode: --/PW res: [0x2c09a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c703 expref: 7 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530093.075906:0:166113:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55baf lrc: 3/0,0 mode: PR/PR res: [0x2c09a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c6ee expref: 7 pid: 166113 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530093.075911:0:166113:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55baf lrc: 4/0,0 mode: PR/PR res: [0x2c09a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c6ee expref: 7 pid: 166113 timeout: 20901 lvb_type: 1 00000100:00100000:1.0:1651530093.075917:0:166113:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005fb0ec6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997088384:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651530093.075935:0:166113:0:(client.c:2492:ptlrpc_set_wait()) set 0000000044f68e5a going to sleep for 6 seconds 00000100:00100000:1.0:1651530093.076160:0:166113:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005fb0ec6a pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997088384:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651530093.076167:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55bb6 lrc: 3/0,0 mode: --/PW res: [0x2c09a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c703 expref: 7 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530093.076172:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000062f8a534, rc 0) 00000100:00100000:1.0:1651530093.076189:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+7:475085:x1731754356252096:12345-10.240.43.64@tcp:101:cp.0 Request processed in 319us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530093.076192:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 907 00000100:00100000:1.0:1651530093.076242:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530093.076276:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356252160 00010000:00010000:1.0:1651530093.076283:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55baf lrc: 4/0,0 mode: PR/PR res: [0x2c09a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c6ee expref: 7 pid: 166113 timeout: 20901 lvb_type: 1 00000100:00100000:1.0:1651530093.076305:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18 00000100:00100000:1.0:1651530093.076307:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438148:x1731754356252160:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651530093.076311:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651530093.076313:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55baf lrc: 4/0,0 mode: PR/PR res: [0x2c09a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c6ee expref: 7 pid: 166113 timeout: 20901 lvb_type: 1 00010000:00010000:1.0:1651530093.076317:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55baf lrc: 3/0,0 mode: PR/PR res: [0x2c09a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c6ee expref: 7 pid: 166113 timeout: 20901 lvb_type: 1 00010000:00010000:1.0:1651530093.076325:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55baf lrc: 0/0,0 mode: --/PR res: [0x2c09a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c6ee expref: 7 pid: 166113 timeout: 20901 lvb_type: 1 00010000:00010000:1.0:1651530093.076329:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530093.076330:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530093.076331:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55bb6 lrc: 2/0,0 mode: PW/PW res: [0x2c09a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c703 expref: 6 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530093.076334:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55bb6 lrc: 3/0,0 mode: PW/PW res: [0x2c09a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c703 expref: 6 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530093.076344:0:166104:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55bb6 lrc: 3/0,0 mode: PW/PW res: [0x2c09a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c703 expref: 6 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530093.076348:0:166104:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005590f790 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:166104:1731745997088448:10.240.43.64@tcp:105: 00000100:00100000:1.0:1651530093.076360:0:166104:0:(client.c:2492:ptlrpc_set_wait()) set 0000000044f68e5a going to sleep for 6 seconds 00000100:00100000:1.0:1651530093.076557:0:166104:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005590f790 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:166104:1731745997088448:10.240.43.64@tcp:105: 00010000:00010000:1.0:1651530093.076562:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651530093.076570:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438148:x1731754356252160:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 263us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530093.076573:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18 00000100:00100000:1.0:1651530093.076604:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530093.076638:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356252224 00002000:00010000:1.0:1651530093.076647:0:166118:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 180378/0 (0->18446744073709551615) 00002000:00100000:1.0:1651530093.076649:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005590f790 with x1731754356252224 ext(0->18446744073709551615) 00002000:00010000:1.0:1651530093.076652:0:166118:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000005590f790. 00000100:00100000:1.0:1651530093.076662:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 52 00000100:00100000:1.0:1651530093.076664:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005590f790 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438149:x1731754356252224:12345-10.240.43.64@tcp:10:cp.0 00002000:00010000:1.0:1651530093.076726:0:166118:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2c09a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651530093.076728:0:166118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2c09a:0x0] updating lvb mtime from disk: 0 -> 1651530093 00002000:00010000:1.0:1651530093.076729:0:166118:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2c09a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651530093.076730:0:166118:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2c09a:0x0] updating lvb ctime from disk: 0 -> 1651530093 00002000:00010000:1.0:1651530093.076731:0:166118:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2c09a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651530093.076742:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005590f790 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438149:x1731754356252224:12345-10.240.43.64@tcp:10:cp.0 Request processed in 78us (138us total) trans 21474837360 rc 0/0 00000100:00100000:1.0:1651530093.076745:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 52 00002000:00010000:1.0:1651530093.076746:0:166118:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 180378/0 (0->18446744073709551615) 00002000:00100000:1.0:1651530093.076747:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005590f790 with x1731754356252224 ext(0->18446744073709551615) 00002000:00010000:1.0:1651530093.076749:0:166118:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000005590f790. 00000100:00100000:1.0:1651530093.101422:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530093.101430:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356252416 00002000:00100000:1.0:1651530093.101438:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c09a:0x0] (0->4194303) req@000000006c782cfa x1731754356252416/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:64/0 lens 488/0 e 0 to 0 dl 1651530099 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cp.0' 00002000:00100000:1.0:1651530093.101443:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006c782cfa with x1731754356252416 ext(0->4194303) 00002000:00010000:1.0:1651530093.101444:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000006c782cfa 00000100:00100000:1.0:1651530093.101455:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 53 00000100:00100000:1.0:1651530093.101457:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c782cfa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438148:x1731754356252416:12345-10.240.43.64@tcp:4:cp.0 00000100:00100000:1.0:1651530093.109843:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c782cfa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438148:x1731754356252416:12345-10.240.43.64@tcp:4:cp.0 Request processed in 8382us (8419us total) trans 21474837361 rc 0/0 00000100:00100000:1.0:1651530093.109849:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 53 00002000:00100000:1.0:1651530093.109854:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c09a:0x0] (0->4194303) req@000000006c782cfa x1731754356252416/t21474837361(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:64/0 lens 488/448 e 0 to 0 dl 1651530099 ref 1 fl Complete:/0/0 rc 0/0 job:'cp.0' 00002000:00100000:1.0:1651530093.109858:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006c782cfa with x1731754356252416 ext(0->4194303) 00002000:00010000:1.0:1651530093.109861:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000006c782cfa 00000100:00100000:1.0:1651530093.126420:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530093.126430:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356252544 00002000:00100000:1.0:1651530093.126440:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c09a:0x0] (4194304->8388607) req@00000000da591860 x1731754356252544/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:64/0 lens 488/0 e 0 to 0 dl 1651530099 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cp.0' 00002000:00100000:1.0:1651530093.126444:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000da591860 with x1731754356252544 ext(4194304->8388607) 00002000:00010000:1.0:1651530093.126446:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000da591860 00000100:00100000:1.0:1651530093.126458:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 54 00000100:00100000:1.0:1651530093.126460:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000da591860 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438148:x1731754356252544:12345-10.240.43.64@tcp:4:cp.0 00000100:00100000:1.0:1651530093.135388:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000da591860 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+11:438148:x1731754356252544:12345-10.240.43.64@tcp:4:cp.0 Request processed in 8925us (8967us total) trans 21474837362 rc 0/0 00000100:00100000:1.0:1651530093.135394:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 54 00002000:00100000:1.0:1651530093.135398:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c09a:0x0] (4194304->8388607) req@00000000da591860 x1731754356252544/t21474837362(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:64/0 lens 488/448 e 0 to 0 dl 1651530099 ref 1 fl Complete:/0/0 rc 0/0 job:'cp.0' 00002000:00100000:1.0:1651530093.135403:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000da591860 with x1731754356252544 ext(4194304->8388607) 00002000:00010000:1.0:1651530093.135406:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000da591860 00000100:00100000:1.0:1651530093.151424:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530093.151434:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356252672 00002000:00100000:1.0:1651530093.151446:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c09a:0x0] (8388608->12582911) req@0000000059681820 x1731754356252672/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:64/0 lens 488/0 e 0 to 0 dl 1651530099 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cp.0' 00002000:00100000:1.0:1651530093.151450:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000059681820 with x1731754356252672 ext(8388608->12582911) 00002000:00010000:1.0:1651530093.151451:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000059681820 00000100:00100000:1.0:1651530093.151463:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 55 00000100:00100000:1.0:1651530093.151465:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059681820 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+11:438147:x1731754356252672:12345-10.240.43.64@tcp:4:cp.0 00000100:00100000:1.0:1651530093.163521:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059681820 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+13:438147:x1731754356252672:12345-10.240.43.64@tcp:4:cp.0 Request processed in 12053us (12096us total) trans 21474837363 rc 0/0 00000100:00100000:1.0:1651530093.163527:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 55 00002000:00100000:1.0:1651530093.163531:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c09a:0x0] (8388608->12582911) req@0000000059681820 x1731754356252672/t21474837363(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:64/0 lens 488/448 e 0 to 0 dl 1651530099 ref 1 fl Complete:/0/0 rc 0/0 job:'cp.0' 00002000:00100000:1.0:1651530093.163536:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000059681820 with x1731754356252672 ext(8388608->12582911) 00002000:00010000:1.0:1651530093.163538:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000059681820 00000100:00100000:1.0:1651530093.172108:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530093.172117:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356252928 00002000:00100000:1.0:1651530093.172135:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c09a:0x0] (12582912->16777215) req@00000000dfef64e7 x1731754356252928/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:64/0 lens 488/0 e 0 to 0 dl 1651530099 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cp.0' 00002000:00100000:1.0:1651530093.172139:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000dfef64e7 with x1731754356252928 ext(12582912->16777215) 00002000:00010000:1.0:1651530093.172140:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000dfef64e7 00000100:00100000:1.0:1651530093.172151:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 56 00000100:00100000:1.0:1651530093.172153:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+13:438148:x1731754356252928:12345-10.240.43.64@tcp:4:cp.0 00000100:00100000:1.0:1651530093.178072:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfef64e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+15:438148:x1731754356252928:12345-10.240.43.64@tcp:4:cp.0 Request processed in 5917us (5963us total) trans 21474837364 rc 0/0 00000100:00100000:1.0:1651530093.178077:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 56 00002000:00100000:1.0:1651530093.178081:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c09a:0x0] (12582912->16777215) req@00000000dfef64e7 x1731754356252928/t21474837364(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:64/0 lens 488/448 e 0 to 0 dl 1651530099 ref 1 fl Complete:/0/0 rc 0/0 job:'cp.0' 00002000:00100000:1.0:1651530093.178085:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000dfef64e7 with x1731754356252928 ext(12582912->16777215) 00002000:00010000:1.0:1651530093.178087:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000dfef64e7 00000100:00100000:1.0:1651530093.186296:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530093.186307:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356253056 00000100:00100000:1.0:1651530093.186325:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10 00000100:00100000:1.0:1651530093.186327:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008dcef4b8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+15:451155:x1731754356253056:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651530093.186333:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1651530093.186339:0:166104:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2c09a:0x0] updating lvb size from disk: 0 -> 16777216 00002000:00010000:1.0:1651530093.186341:0:166104:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2c09a:0x0] updating lvb blocks from disk: 0 -> 32768 00010000:00010000:1.0:1651530093.186351:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55bb6 lrc: 0/0,0 mode: --/PW res: [0x2c09a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c703 expref: 15 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530093.186361:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651530093.186371:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008dcef4b8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+14:451155:x1731754356253056:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 43us (76us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530093.186374:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10 00000100:00100000:1.0:1651530093.192857:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530093.192868:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356253248 00000100:00100000:1.0:1651530093.192881:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 908 00000100:00100000:1.0:1651530093.192883:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+14:438147:x1731754356253248:12345-10.240.43.64@tcp:101:cmp.0 00010000:00010000:1.0:1651530093.192888:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651530093.192894:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55bbd lrc: 2/0,0 mode: --/PR res: [0x2c09a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db30c718 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530093.192903:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c09a:0x0] initial LVB size: 16777216, mtime: 0x6270596d, atime: 0x0, ctime: 0x6270596d, blocks: 0x8000 00010000:00010000:1.0:1651530093.192909:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530093.192910:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530093.192913:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55bbd lrc: 3/0,0 mode: PR/PR res: [0x2c09a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c718 expref: 15 pid: 166113 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530093.192920:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55bbd lrc: 3/0,0 mode: PR/PR res: [0x2c09a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c718 expref: 15 pid: 166113 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530093.192925:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000062f8a534, rc 0) 00000100:00100000:1.0:1651530093.192935:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+15:438147:x1731754356253248:12345-10.240.43.64@tcp:101:cmp.0 Request processed in 51us (79us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530093.192938:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 908 00000100:00100000:1.0:1651530093.196611:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530093.196619:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356253376 00002000:00100000:1.0:1651530093.196626:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c09a:0x0] (0->4194303) req@00000000a1adbe91 x1731754356253376/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:64/0 lens 488/0 e 0 to 0 dl 1651530099 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cmp.0' 00002000:00100000:1.0:1651530093.196630:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a1adbe91 with x1731754356253376 ext(0->4194303) 00002000:00010000:1.0:1651530093.196632:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000a1adbe91 00000100:00100000:1.0:1651530093.196642:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 57 00000100:00100000:1.0:1651530093.196643:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+15:438146:x1731754356253376:12345-10.240.43.64@tcp:3:cmp.0 00000100:00100000:1.0:1651530093.203184:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1adbe91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+15:438146:x1731754356253376:12345-10.240.43.64@tcp:3:cmp.0 Request processed in 6538us (6572us total) trans 0 rc 4194304/4194304 00000100:00100000:1.0:1651530093.203188:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 57 00002000:00100000:1.0:1651530093.203192:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c09a:0x0] (0->4194303) req@00000000a1adbe91 x1731754356253376/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:64/0 lens 488/440 e 0 to 0 dl 1651530099 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'cmp.0' 00002000:00100000:1.0:1651530093.203196:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a1adbe91 with x1731754356253376 ext(0->4194303) 00002000:00010000:1.0:1651530093.203197:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000a1adbe91 00000100:00100000:1.0:1651530093.216813:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530093.216822:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530093.216835:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530093.216844:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356253568 00000100:00100000:0.0:1651530093.216851:0:166117:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356253504 00002000:00100000:1.0:1651530093.216852:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c09a:0x0] (8388608->12582911) req@0000000011ef1a28 x1731754356253568/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:64/0 lens 488/0 e 0 to 0 dl 1651530099 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cmp.0' 00002000:00100000:1.0:1651530093.216856:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000011ef1a28 with x1731754356253568 ext(8388608->12582911) 00002000:00010000:1.0:1651530093.216858:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000011ef1a28 00000100:00100000:1.0:1651530093.216861:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356253632 00002000:00100000:1.0:1651530093.216864:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c09a:0x0] (12582912->16777215) req@00000000b7fc4ed7 x1731754356253632/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:64/0 lens 488/0 e 0 to 0 dl 1651530099 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cmp.0' 00002000:00100000:1.0:1651530093.216868:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b7fc4ed7 with x1731754356253632 ext(12582912->16777215) 00002000:00010000:1.0:1651530093.216869:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000b7fc4ed7 00000100:00100000:1.0:1651530093.216871:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 58 00002000:00100000:0.0:1651530093.216872:0:166117:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x100010000:0x2c09a:0x0] (4194304->8388607) req@0000000006c4043a x1731754356253504/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:64/0 lens 488/0 e 0 to 0 dl 1651530099 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cmp.0' 00000100:00100000:1.0:1651530093.216873:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+17:438146:x1731754356253568:12345-10.240.43.64@tcp:3:cmp.0 00002000:00100000:0.0:1651530093.216878:0:166117:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000006c4043a with x1731754356253504 ext(4194304->8388607) 00002000:00010000:0.0:1651530093.216880:0:166117:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000006c4043a 00000100:00100000:1.0:1651530093.222683:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000011ef1a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+17:438146:x1731754356253568:12345-10.240.43.64@tcp:3:cmp.0 Request processed in 5808us (5876us total) trans 0 rc 4194304/4194304 00000100:00100000:1.0:1651530093.222687:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 58 00002000:00100000:1.0:1651530093.222690:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c09a:0x0] (8388608->12582911) req@0000000011ef1a28 x1731754356253568/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:64/0 lens 488/440 e 0 to 0 dl 1651530099 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'cmp.0' 00002000:00100000:1.0:1651530093.222694:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000011ef1a28 with x1731754356253568 ext(8388608->12582911) 00002000:00010000:1.0:1651530093.222696:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000011ef1a28 00000100:00100000:1.0:1651530093.222702:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 59 00000100:00100000:1.0:1651530093.222704:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b7fc4ed7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+16:438146:x1731754356253632:12345-10.240.43.64@tcp:3:cmp.0 00000100:00100000:1.0:1651530093.227977:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b7fc4ed7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+16:438146:x1731754356253632:12345-10.240.43.64@tcp:3:cmp.0 Request processed in 5271us (11141us total) trans 0 rc 4194304/4194304 00000100:00100000:1.0:1651530093.227981:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 59 00002000:00100000:1.0:1651530093.227984:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c09a:0x0] (12582912->16777215) req@00000000b7fc4ed7 x1731754356253632/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:64/0 lens 488/440 e 0 to 0 dl 1651530099 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'cmp.0' 00002000:00100000:1.0:1651530093.227988:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b7fc4ed7 with x1731754356253632 ext(12582912->16777215) 00002000:00010000:1.0:1651530093.227989:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000b7fc4ed7 00000100:00100000:1.0:1651530093.227995:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 60 00000100:00100000:1.0:1651530093.227997:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+15:438146:x1731754356253504:12345-10.240.43.64@tcp:3:cmp.0 00000100:00100000:1.0:1651530093.233255:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006c4043a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+15:438146:x1731754356253504:12345-10.240.43.64@tcp:3:cmp.0 Request processed in 5256us (16431us total) trans 0 rc 4194304/4194304 00000100:00100000:1.0:1651530093.233259:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 60 00002000:00100000:1.0:1651530093.233262:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c09a:0x0] (4194304->8388607) req@0000000006c4043a x1731754356253504/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:64/0 lens 488/440 e 0 to 0 dl 1651530099 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'cmp.0' 00002000:00100000:1.0:1651530093.233266:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000006c4043a with x1731754356253504 ext(4194304->8388607) 00002000:00010000:1.0:1651530093.233268:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000006c4043a 00000400:00000080:1.0:1651530094.877302:0:175862:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651530094.877305:0:175862:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 155f: Verify big file correctness: read cache:on write_cache:off ========================================================== 22:21:34 (1651530094) 00000100:00100000:1.0:1651530095.555470:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530095.555488:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356254016 00000100:00100000:1.0:1651530095.555518:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11 00000100:00100000:1.0:1651530095.555521:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+15:451154:x1731754356254016:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651530095.555528:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651530095.555550:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55bbd lrc: 0/0,0 mode: --/PR res: [0x2c09a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c718 expref: 15 pid: 166113 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530095.555560:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651530095.555584:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+14:451154:x1731754356254016:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 63us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530095.555587:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11 00000100:00100000:1.0:1651530095.840270:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651530095.840301:0:166115:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946852864 00000100:00100000:0.0:1651530095.840326:0:166115:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 89 00000100:00100000:0.0:1651530095.840328:0:166115:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946852864:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651530095.840345:0:166115:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 207693632 pending 16875520 free 81291210752 avail 77120499712 00000100:00100000:0.0:1651530095.840371:0:166115:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b8db73b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946852864:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 42us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530095.840375:0:166115:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 89 00000100:00100000:1.0:1651530096.321918:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530096.321938:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946852928 00000100:00100000:1.0:1651530096.321965:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 909 00000100:00100000:1.0:1651530096.321967:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d5b9490 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946852928:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651530096.321984:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180378 count 1 00002000:00010000:1.0:1651530096.322002:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c09a:0x0] initial LVB size: 16777216, mtime: 0x6270596d, atime: 0x0, ctime: 0x6270596d, blocks: 0x8000 00010000:00010000:1.0:1651530096.322006:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55bc4 lrc: 3/0,1 mode: --/PW res: [0x2c09a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530096.322014:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530096.322015:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530096.322017:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55bc4 lrc: 3/0,1 mode: PW/PW res: [0x2c09a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530096.322024:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55bc4 lrc: 3/0,1 mode: PW/PW res: [0x2c09a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530096.322031:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55bc4 lrc: 3/0,1 mode: PW/PW res: [0x2c09a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530096.322034:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55bc4 lrc: 2/0,0 mode: PW/PW res: [0x2c09a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530096.322153:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55bc4 lrc: 2/0,0 mode: PW/PW res: [0x2c09a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530096.322157:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000062f8a534 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651530096.322158:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55bc4 lrc: 2/0,0 mode: PW/PW res: [0x2c09a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530096.322162:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55bc4 lrc: 3/0,0 mode: PW/PW res: [0x2c09a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530096.322170:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55bc4 lrc: 1/0,0 mode: --/PW res: [0x2c09a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530096.322172:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55bc4 lrc: 0/0,0 mode: --/PW res: [0x2c09a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530096.323698:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d5b9490 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946852928:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1729us (1784us total) trans 21474837365 rc 0/0 00000100:00100000:1.0:1651530096.323702:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 909 00000001:00080000:0.0:1651530099.349210:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474837365 is committed 00000001:00080000:0.0:1651530099.349217:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474837364 is committed 00000100:00100000:1.0:1651530100.960255:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651530100.960285:0:166115:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946852992 00000100:00100000:0.0:1651530100.960310:0:166115:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 90 00000100:00100000:0.0:1651530100.960313:0:166115:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946852992:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651530100.960330:0:166115:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 190818112 pending 0 free 81307987968 avail 77137276928 00000100:00100000:0.0:1651530100.960359:0:166115:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006026725b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946852992:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 46us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530100.960362:0:166115:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 90 00000100:00100000:1.0:1651530102.698360:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530102.698387:0:166115:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356254144 00000100:00100000:0.0:1651530102.698413:0:166115:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 91 00000100:00100000:0.0:1651530102.698415:0:166115:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cccc371e-feb6-4a45-b229-8d88a861b48a+5:476209:x1731754356254144:12345-10.240.43.64@tcp:13:lctl.0 00002000:00000024:0.0:1651530102.698433:0:166115:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 190818112 pending 0 free 81307987968 avail 77137276928 00000100:00100000:0.0:1651530102.698465:0:166115:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a4b486d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cccc371e-feb6-4a45-b229-8d88a861b48a+5:476209:x1731754356254144:12345-10.240.43.64@tcp:13:lctl.0 Request processed in 49us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530102.698469:0:166115:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 91 00000100:00100000:1.0:1651530102.987527:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530102.987546:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356254912 00000100:00100000:1.0:1651530102.987570:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 910 00000100:00100000:1.0:1651530102.987573:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+5:438149:x1731754356254912:12345-10.240.43.64@tcp:101:cp.0 00010000:00010000:1.0:1651530102.987583:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651530102.987593:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55bcb lrc: 2/0,0 mode: --/PR res: [0x2c09b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db30c73b expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530102.987604:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c09b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530102.987613:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530102.987614:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530102.987619:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55bcb lrc: 3/0,0 mode: PR/PR res: [0x2c09b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c73b expref: 6 pid: 166113 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530102.987627:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55bcb lrc: 3/0,0 mode: PR/PR res: [0x2c09b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c73b expref: 6 pid: 166113 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530102.987633:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000062f8a534, rc 0) 00000100:00100000:1.0:1651530102.987659:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438149:x1731754356254912:12345-10.240.43.64@tcp:101:cp.0 Request processed in 86us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530102.987663:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 910 00000100:00100000:1.0:1651530102.989677:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530102.989685:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356255360 00000100:00100000:1.0:1651530102.989697:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 911 00000100:00100000:1.0:1651530102.989699:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003132c0c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:476220:x1731754356255360:12345-10.240.43.64@tcp:101:cp.0 00010000:00010000:1.0:1651530102.989703:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651530102.989707:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55bd2 lrc: 2/0,0 mode: --/PW res: [0x2c09b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db30c750 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530102.989716:0:166113:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55bcb lrc: 2/0,0 mode: PR/PR res: [0x2c09b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c73b expref: 7 pid: 166113 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530102.989720:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530102.989721:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530102.989722:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55bd2 lrc: 4/0,0 mode: --/PW res: [0x2c09b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c750 expref: 7 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530102.989734:0:166113:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55bcb lrc: 3/0,0 mode: PR/PR res: [0x2c09b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c73b expref: 7 pid: 166113 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530102.989739:0:166113:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55bcb lrc: 4/0,0 mode: PR/PR res: [0x2c09b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c73b expref: 7 pid: 166113 timeout: 20911 lvb_type: 1 00000100:00100000:1.0:1651530102.989745:0:166113:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004a8f4906 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997088512:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651530102.989768:0:166113:0:(client.c:2492:ptlrpc_set_wait()) set 000000009a859015 going to sleep for 6 seconds 00000100:00100000:1.0:1651530102.989953:0:166113:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004a8f4906 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997088512:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651530102.989960:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55bd2 lrc: 3/0,0 mode: --/PW res: [0x2c09b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c750 expref: 7 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530102.989966:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001ea46bb1, rc 0) 00000100:00100000:1.0:1651530102.989975:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003132c0c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+7:476220:x1731754356255360:12345-10.240.43.64@tcp:101:cp.0 Request processed in 276us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530102.989978:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 911 00000100:00100000:0.0:1651530102.989991:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530102.990035:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356255424 00010000:00010000:1.0:1651530102.990042:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55bcb lrc: 4/0,0 mode: PR/PR res: [0x2c09b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c73b expref: 7 pid: 166113 timeout: 20911 lvb_type: 1 00000100:00100000:1.0:1651530102.990054:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 19 00000100:00100000:1.0:1651530102.990056:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004be7c06d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438149:x1731754356255424:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651530102.990060:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651530102.990062:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55bcb lrc: 4/0,0 mode: PR/PR res: [0x2c09b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c73b expref: 7 pid: 166113 timeout: 20911 lvb_type: 1 00010000:00010000:1.0:1651530102.990066:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55bcb lrc: 3/0,0 mode: PR/PR res: [0x2c09b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c73b expref: 7 pid: 166113 timeout: 20911 lvb_type: 1 00010000:00010000:1.0:1651530102.990074:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55bcb lrc: 0/0,0 mode: --/PR res: [0x2c09b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c73b expref: 7 pid: 166113 timeout: 20911 lvb_type: 1 00010000:00010000:1.0:1651530102.990077:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530102.990078:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530102.990079:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55bd2 lrc: 2/0,0 mode: PW/PW res: [0x2c09b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c750 expref: 6 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530102.990083:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55bd2 lrc: 3/0,0 mode: PW/PW res: [0x2c09b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c750 expref: 6 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530102.990091:0:166104:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55bd2 lrc: 3/0,0 mode: PW/PW res: [0x2c09b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c750 expref: 6 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530102.990095:0:166104:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004a8f4906 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:166104:1731745997088576:10.240.43.64@tcp:105: 00000100:00100000:1.0:1651530102.990112:0:166104:0:(client.c:2492:ptlrpc_set_wait()) set 000000009a859015 going to sleep for 6 seconds 00000100:00100000:1.0:1651530102.990341:0:166104:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004a8f4906 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:166104:1731745997088576:10.240.43.64@tcp:105: 00010000:00010000:1.0:1651530102.990346:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651530102.990354:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004be7c06d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438149:x1731754356255424:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 297us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530102.990357:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 19 00000100:00100000:0.0:1651530102.990399:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530102.990411:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356255488 00002000:00010000:1.0:1651530102.990419:0:166118:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 180379/0 (0->18446744073709551615) 00002000:00100000:1.0:1651530102.990421:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003e3f0f77 with x1731754356255488 ext(0->18446744073709551615) 00002000:00010000:1.0:1651530102.990424:0:166118:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000003e3f0f77. 00000100:00100000:1.0:1651530102.990433:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 61 00000100:00100000:1.0:1651530102.990435:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438148:x1731754356255488:12345-10.240.43.64@tcp:10:cp.0 00002000:00010000:1.0:1651530102.990497:0:166118:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2c09b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1651530102.990499:0:166118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2c09b:0x0] updating lvb mtime from disk: 0 -> 1651530102 00002000:00010000:1.0:1651530102.990500:0:166118:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2c09b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1651530102.990501:0:166118:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2c09b:0x0] updating lvb ctime from disk: 0 -> 1651530102 00002000:00010000:1.0:1651530102.990502:0:166118:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2c09b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1651530102.990514:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e3f0f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438148:x1731754356255488:12345-10.240.43.64@tcp:10:cp.0 Request processed in 78us (116us total) trans 21474837366 rc 0/0 00000100:00100000:1.0:1651530102.990517:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 61 00002000:00010000:1.0:1651530102.990518:0:166118:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 180379/0 (0->18446744073709551615) 00002000:00100000:1.0:1651530102.990519:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003e3f0f77 with x1731754356255488 ext(0->18446744073709551615) 00002000:00010000:1.0:1651530102.990521:0:166118:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000003e3f0f77. 00000100:00100000:0.0:1651530103.009405:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530103.009428:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356255744 00002000:00100000:1.0:1651530103.009438:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c09b:0x0] (0->4194303) req@0000000095f2cd7b x1731754356255744/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:74/0 lens 488/0 e 0 to 0 dl 1651530109 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cp.0' 00002000:00100000:1.0:1651530103.009446:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000095f2cd7b with x1731754356255744 ext(0->4194303) 00002000:00010000:1.0:1651530103.009447:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000095f2cd7b 00000100:00100000:1.0:1651530103.009457:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 62 00000100:00100000:1.0:1651530103.009459:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000095f2cd7b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438148:x1731754356255744:12345-10.240.43.64@tcp:4:cp.0 00000100:00100000:1.0:1651530103.016927:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000095f2cd7b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438148:x1731754356255744:12345-10.240.43.64@tcp:4:cp.0 Request processed in 7464us (7519us total) trans 21474837367 rc 0/0 00000100:00100000:1.0:1651530103.016933:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 62 00002000:00100000:1.0:1651530103.016938:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c09b:0x0] (0->4194303) req@0000000095f2cd7b x1731754356255744/t21474837367(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:74/0 lens 488/448 e 0 to 0 dl 1651530109 ref 1 fl Complete:/0/0 rc 0/0 job:'cp.0' 00002000:00100000:1.0:1651530103.016943:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000095f2cd7b with x1731754356255744 ext(0->4194303) 00002000:00010000:1.0:1651530103.016946:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000095f2cd7b 00000100:00100000:0.0:1651530103.036851:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530103.036881:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356255872 00002000:00100000:1.0:1651530103.036895:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c09b:0x0] (4194304->8388607) req@0000000008cca9da x1731754356255872/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:74/0 lens 488/0 e 0 to 0 dl 1651530109 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cp.0' 00002000:00100000:1.0:1651530103.036899:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000008cca9da with x1731754356255872 ext(4194304->8388607) 00002000:00010000:1.0:1651530103.036900:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000008cca9da 00000100:00100000:1.0:1651530103.036913:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 63 00000100:00100000:1.0:1651530103.036915:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008cca9da pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438148:x1731754356255872:12345-10.240.43.64@tcp:4:cp.0 00000100:00100000:1.0:1651530103.049962:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530103.049995:0:166116:0:(service.c:3189:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 80 00000100:00100000:0.0:1651530103.050003:0:166116:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1651530103.050405:0:166116:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356256000 00002000:00100000:0.0:1651530103.050417:0:166116:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x100010000:0x2c09b:0x0] (8388608->12582911) req@000000004a8f4906 x1731754356256000/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:74/0 lens 488/0 e 0 to 0 dl 1651530109 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cp.0' 00002000:00100000:0.0:1651530103.050424:0:166116:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004a8f4906 with x1731754356256000 ext(8388608->12582911) 00002000:00010000:0.0:1651530103.050426:0:166116:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000004a8f4906 00000100:00100000:1.0:1651530103.050631:0:176086:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 64 00000100:00100000:1.0:1651530103.050634:0:176086:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a8f4906 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+13:438146:x1731754356256000:12345-10.240.43.64@tcp:4:cp.0 00000100:00100000:1.0:1651530103.052101:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008cca9da pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+13:438148:x1731754356255872:12345-10.240.43.64@tcp:4:cp.0 Request processed in 15185us (15251us total) trans 21474837368 rc 0/0 00000100:00100000:1.0:1651530103.052107:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 63 00002000:00100000:1.0:1651530103.052111:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c09b:0x0] (4194304->8388607) req@0000000008cca9da x1731754356255872/t21474837368(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:74/0 lens 488/448 e 0 to 0 dl 1651530109 ref 1 fl Complete:/0/0 rc 0/0 job:'cp.0' 00002000:00100000:1.0:1651530103.052116:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000008cca9da with x1731754356255872 ext(4194304->8388607) 00002000:00010000:1.0:1651530103.052118:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000008cca9da 00000100:00100000:1.0:1651530103.055335:0:176086:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a8f4906 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+13:438146:x1731754356256000:12345-10.240.43.64@tcp:4:cp.0 Request processed in 4700us (5373us total) trans 21474837369 rc 0/0 00000100:00100000:1.0:1651530103.055340:0:176086:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 64 00002000:00100000:1.0:1651530103.055343:0:176086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2c09b:0x0] (8388608->12582911) req@000000004a8f4906 x1731754356256000/t21474837369(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:74/0 lens 488/448 e 0 to 0 dl 1651530109 ref 1 fl Complete:/0/0 rc 0/0 job:'cp.0' 00002000:00100000:1.0:1651530103.055347:0:176086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004a8f4906 with x1731754356256000 ext(8388608->12582911) 00002000:00010000:1.0:1651530103.055349:0:176086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000004a8f4906 00000100:00100000:0.0:1651530103.062400:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530103.062434:0:176086:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356256256 00002000:00100000:1.0:1651530103.062447:0:176086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2c09b:0x0] (12582912->16777215) req@000000001d6be6ef x1731754356256256/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:74/0 lens 488/0 e 0 to 0 dl 1651530109 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cp.0' 00002000:00100000:1.0:1651530103.062451:0:176086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001d6be6ef with x1731754356256256 ext(12582912->16777215) 00002000:00010000:1.0:1651530103.062453:0:176086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000001d6be6ef 00000100:00100000:1.0:1651530103.062460:0:176086:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 65 00000100:00100000:1.0:1651530103.062462:0:176086:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001d6be6ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+13:438149:x1731754356256256:12345-10.240.43.64@tcp:4:cp.0 00000100:00100000:1.0:1651530103.066586:0:176086:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001d6be6ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+15:438149:x1731754356256256:12345-10.240.43.64@tcp:4:cp.0 Request processed in 4122us (4187us total) trans 21474837370 rc 0/0 00000100:00100000:1.0:1651530103.066592:0:176086:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 65 00002000:00100000:1.0:1651530103.066595:0:176086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2c09b:0x0] (12582912->16777215) req@000000001d6be6ef x1731754356256256/t21474837370(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:74/0 lens 488/448 e 0 to 0 dl 1651530109 ref 1 fl Complete:/0/0 rc 0/0 job:'cp.0' 00002000:00100000:1.0:1651530103.066600:0:176086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001d6be6ef with x1731754356256256 ext(12582912->16777215) 00002000:00010000:1.0:1651530103.066602:0:176086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000001d6be6ef 00000100:00100000:0.0:1651530103.075002:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530103.075026:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356256384 00000100:00100000:1.0:1651530103.075045:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12 00000100:00100000:1.0:1651530103.075047:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000387f378b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+15:451154:x1731754356256384:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651530103.075053:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1651530103.075059:0:166104:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2c09b:0x0] updating lvb size from disk: 0 -> 16777216 00002000:00010000:1.0:1651530103.075060:0:166104:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2c09b:0x0] updating lvb mtime from disk: 1651530102 -> 1651530103 00002000:00010000:1.0:1651530103.075061:0:166104:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2c09b:0x0] updating lvb ctime from disk: 1651530102 -> 1651530103 00002000:00010000:1.0:1651530103.075062:0:166104:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2c09b:0x0] updating lvb blocks from disk: 0 -> 32768 00010000:00010000:1.0:1651530103.075073:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55bd2 lrc: 0/0,0 mode: --/PW res: [0x2c09b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c750 expref: 15 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530103.075083:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651530103.075095:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000387f378b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+14:451154:x1731754356256384:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 47us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530103.075098:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12 00000100:00100000:0.0:1651530103.081618:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530103.081649:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356256576 00000100:00100000:1.0:1651530103.081664:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 912 00000100:00100000:1.0:1651530103.081666:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001faa7f64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+14:438149:x1731754356256576:12345-10.240.43.64@tcp:101:cmp.0 00010000:00010000:1.0:1651530103.081671:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651530103.081677:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55bd9 lrc: 2/0,0 mode: --/PR res: [0x2c09b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db30c765 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530103.081684:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c09b:0x0] initial LVB size: 16777216, mtime: 0x62705977, atime: 0x0, ctime: 0x62705977, blocks: 0x8000 00010000:00010000:1.0:1651530103.081690:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530103.081691:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530103.081694:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55bd9 lrc: 3/0,0 mode: PR/PR res: [0x2c09b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c765 expref: 15 pid: 166113 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530103.081700:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55bd9 lrc: 3/0,0 mode: PR/PR res: [0x2c09b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c765 expref: 15 pid: 166113 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530103.081705:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001ea46bb1, rc 0) 00000100:00100000:1.0:1651530103.081717:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001faa7f64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+15:438149:x1731754356256576:12345-10.240.43.64@tcp:101:cmp.0 Request processed in 49us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530103.081719:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 912 00000100:00100000:0.0:1651530103.085719:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530103.085741:0:176086:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356256704 00002000:00100000:1.0:1651530103.085750:0:176086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2c09b:0x0] (0->4194303) req@000000007053091c x1731754356256704/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:74/0 lens 488/0 e 0 to 0 dl 1651530109 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cmp.0' 00002000:00100000:1.0:1651530103.085754:0:176086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000007053091c with x1731754356256704 ext(0->4194303) 00002000:00010000:1.0:1651530103.085756:0:176086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000007053091c 00000100:00100000:1.0:1651530103.085762:0:176086:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 66 00000100:00100000:1.0:1651530103.085763:0:176086:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007053091c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+15:438148:x1731754356256704:12345-10.240.43.64@tcp:3:cmp.0 00000100:00100000:1.0:1651530103.089811:0:176086:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007053091c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+15:438148:x1731754356256704:12345-10.240.43.64@tcp:3:cmp.0 Request processed in 4044us (4090us total) trans 0 rc 4194304/4194304 00000100:00100000:1.0:1651530103.089817:0:176086:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 66 00002000:00100000:1.0:1651530103.089821:0:176086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2c09b:0x0] (0->4194303) req@000000007053091c x1731754356256704/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:74/0 lens 488/440 e 0 to 0 dl 1651530109 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'cmp.0' 00002000:00100000:1.0:1651530103.089825:0:176086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000007053091c with x1731754356256704 ext(0->4194303) 00002000:00010000:1.0:1651530103.089828:0:176086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000007053091c 00000100:00100000:0.0:1651530103.098610:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530103.098621:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530103.098629:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530103.098634:0:176086:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356256896 00000100:00100000:0.0:1651530103.098639:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356256832 00002000:00100000:1.0:1651530103.098645:0:176086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2c09b:0x0] (8388608->12582911) req@000000007ac35c6a x1731754356256896/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:74/0 lens 488/0 e 0 to 0 dl 1651530109 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cmp.0' 00002000:00100000:1.0:1651530103.098649:0:176086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000007ac35c6a with x1731754356256896 ext(8388608->12582911) 00002000:00100000:0.0:1651530103.098649:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c09b:0x0] (4194304->8388607) req@0000000035de0fa0 x1731754356256832/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:74/0 lens 488/0 e 0 to 0 dl 1651530109 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cmp.0' 00002000:00010000:1.0:1651530103.098651:0:176086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000007ac35c6a 00002000:00100000:0.0:1651530103.098654:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000035de0fa0 with x1731754356256832 ext(4194304->8388607) 00002000:00010000:0.0:1651530103.098655:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000035de0fa0 00000100:00100000:1.0:1651530103.098659:0:176086:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356256960 00002000:00100000:1.0:1651530103.098664:0:176086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2c09b:0x0] (12582912->16777215) req@00000000567318ba x1731754356256960/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:74/0 lens 488/0 e 0 to 0 dl 1651530109 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cmp.0' 00002000:00100000:1.0:1651530103.098667:0:176086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000567318ba with x1731754356256960 ext(12582912->16777215) 00002000:00010000:1.0:1651530103.098668:0:176086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000567318ba 00000100:00100000:0.0:1651530103.098668:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 67 00000100:00100000:0.0:1651530103.098670:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+17:438148:x1731754356256896:12345-10.240.43.64@tcp:3:cmp.0 00000100:00100000:1.0:1651530103.098671:0:176086:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 68 00000100:00100000:1.0:1651530103.098673:0:176086:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000035de0fa0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+17:438148:x1731754356256832:12345-10.240.43.64@tcp:3:cmp.0 00000100:00100000:0.0:1651530103.103265:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ac35c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+18:438148:x1731754356256896:12345-10.240.43.64@tcp:3:cmp.0 Request processed in 4591us (4653us total) trans 0 rc 4194304/4194304 00000100:00100000:0.0:1651530103.103273:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 67 00002000:00100000:0.0:1651530103.103280:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c09b:0x0] (8388608->12582911) req@000000007ac35c6a x1731754356256896/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:74/0 lens 488/440 e 0 to 0 dl 1651530109 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'cmp.0' 00002000:00100000:0.0:1651530103.103289:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000007ac35c6a with x1731754356256896 ext(8388608->12582911) 00002000:00010000:0.0:1651530103.103293:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000007ac35c6a 00000100:00100000:0.0:1651530103.103305:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 69 00000100:00100000:0.0:1651530103.103308:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000567318ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+17:438148:x1731754356256960:12345-10.240.43.64@tcp:3:cmp.0 00000100:00100000:1.0:1651530103.104858:0:176086:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000035de0fa0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+17:438148:x1731754356256832:12345-10.240.43.64@tcp:3:cmp.0 Request processed in 6181us (6233us total) trans 0 rc 4194304/4194304 00000100:00100000:1.0:1651530103.104863:0:176086:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 68 00002000:00100000:1.0:1651530103.104867:0:176086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2c09b:0x0] (4194304->8388607) req@0000000035de0fa0 x1731754356256832/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:74/0 lens 488/440 e 0 to 0 dl 1651530109 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'cmp.0' 00002000:00100000:1.0:1651530103.104872:0:176086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000035de0fa0 with x1731754356256832 ext(4194304->8388607) 00002000:00010000:1.0:1651530103.104874:0:176086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000035de0fa0 00000100:00100000:0.0:1651530103.107885:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000567318ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+15:438148:x1731754356256960:12345-10.240.43.64@tcp:3:cmp.0 Request processed in 4576us (9254us total) trans 0 rc 4194304/4194304 00000100:00100000:0.0:1651530103.107890:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 69 00002000:00100000:0.0:1651530103.107894:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c09b:0x0] (12582912->16777215) req@00000000567318ba x1731754356256960/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:74/0 lens 488/440 e 0 to 0 dl 1651530109 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'cmp.0' 00002000:00100000:0.0:1651530103.107899:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000567318ba with x1731754356256960 ext(12582912->16777215) 00002000:00010000:0.0:1651530103.107900:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000567318ba 00000400:00000080:0.0:1651530104.758135:0:176355:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530104.758137:0:176355:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 155g: Verify big file correctness: read cache:off write_cache:on ========================================================== 22:21:44 (1651530104) 00000100:00100000:0.0:1651530105.430963:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530105.430993:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356257344 00000100:00100000:1.0:1651530105.431024:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13 00000100:00100000:1.0:1651530105.431027:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003ffbc5dc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+15:454981:x1731754356257344:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651530105.431035:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651530105.431056:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55bd9 lrc: 0/0,0 mode: --/PR res: [0x2c09b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c765 expref: 15 pid: 166113 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530105.431065:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651530105.431088:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003ffbc5dc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+14:454981:x1731754356257344:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 60us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530105.431091:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13 00000100:00100000:0.0:1651530106.080280:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530106.080316:0:166115:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946853376 00000100:00100000:1.0:1651530106.080341:0:166115:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 92 00000100:00100000:1.0:1651530106.080344:0:166115:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946853376:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651530106.080363:0:166115:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 224569152 pending 16875520 free 81291210752 avail 77120499712 00000100:00100000:1.0:1651530106.080392:0:166115:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946853376:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 48us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530106.080396:0:166115:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 92 00000100:00100000:0.0:1651530106.109732:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530106.109756:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946853440 00000100:00100000:1.0:1651530106.109771:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 913 00000100:00100000:1.0:1651530106.109773:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946853440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651530106.109782:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180379 count 1 00002000:00010000:1.0:1651530106.109797:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c09b:0x0] initial LVB size: 16777216, mtime: 0x62705977, atime: 0x0, ctime: 0x62705977, blocks: 0x8000 00010000:00010000:1.0:1651530106.109801:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55be0 lrc: 3/0,1 mode: --/PW res: [0x2c09b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530106.109808:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530106.109809:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530106.109811:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55be0 lrc: 3/0,1 mode: PW/PW res: [0x2c09b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530106.109820:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55be0 lrc: 3/0,1 mode: PW/PW res: [0x2c09b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530106.109824:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55be0 lrc: 3/0,1 mode: PW/PW res: [0x2c09b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530106.109827:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55be0 lrc: 2/0,0 mode: PW/PW res: [0x2c09b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530106.109909:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55be0 lrc: 2/0,0 mode: PW/PW res: [0x2c09b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530106.109913:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001ea46bb1 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651530106.109914:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55be0 lrc: 2/0,0 mode: PW/PW res: [0x2c09b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530106.109918:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55be0 lrc: 3/0,0 mode: PW/PW res: [0x2c09b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530106.109925:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55be0 lrc: 1/0,0 mode: --/PW res: [0x2c09b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530106.109928:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55be0 lrc: 0/0,0 mode: --/PW res: [0x2c09b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530106.111485:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946853440:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1711us (1753us total) trans 21474837371 rc 0/0 00000100:00100000:1.0:1651530106.111489:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 913 00000001:00080000:0.0:1651530108.571011:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474837371 is committed 00000001:00080000:0.0:1651530108.571017:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474837370 is committed 00000100:00100000:0.0:1651530110.657005:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530110.657045:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356257536 00000100:00100000:1.0:1651530110.657073:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11 00000100:00100000:1.0:1651530110.657076:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+5:438149:x1731754356257536:12345-10.240.43.64@tcp:400:kworker/u4:2.0 00000100:00100000:1.0:1651530110.657112:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+5:438149:x1731754356257536:12345-10.240.43.64@tcp:400:kworker/u4:2.0 Request processed in 36us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530110.657115:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11 00000100:00100000:0.0:1651530111.201644:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530111.201690:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946853504 00000100:00100000:1.0:1651530111.201712:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 93 00000100:00100000:1.0:1651530111.201714:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9e74b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946853504:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651530111.201732:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 207693632 pending 0 free 81307987968 avail 77137276928 00000100:00100000:1.0:1651530111.201758:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9e74b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946853504:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 44us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530111.201762:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 93 00000100:00100000:0.0:1651530112.570553:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530112.570590:0:166115:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356257664 00000100:00100000:1.0:1651530112.570613:0:166115:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 94 00000100:00100000:1.0:1651530112.570615:0:166115:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000057d84ac9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cccc371e-feb6-4a45-b229-8d88a861b48a+5:477305:x1731754356257664:12345-10.240.43.64@tcp:13:lctl.0 00002000:00000024:1.0:1651530112.570633:0:166115:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 207693632 pending 0 free 81307987968 avail 77137276928 00000100:00100000:1.0:1651530112.570664:0:166115:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000057d84ac9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cccc371e-feb6-4a45-b229-8d88a861b48a+5:477305:x1731754356257664:12345-10.240.43.64@tcp:13:lctl.0 Request processed in 48us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530112.570668:0:166115:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 94 00000100:00100000:0.0:1651530112.862280:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530112.862309:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356258432 00000100:00100000:1.0:1651530112.862334:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 914 00000100:00100000:1.0:1651530112.862336:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054ed0749 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+5:438149:x1731754356258432:12345-10.240.43.64@tcp:101:cp.0 00010000:00010000:1.0:1651530112.862346:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651530112.862357:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55be7 lrc: 2/0,0 mode: --/PR res: [0x2c09c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db30c788 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530112.862368:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c09c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530112.862377:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530112.862378:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530112.862383:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55be7 lrc: 3/0,0 mode: PR/PR res: [0x2c09c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c788 expref: 6 pid: 166113 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530112.862391:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55be7 lrc: 3/0,0 mode: PR/PR res: [0x2c09c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c788 expref: 6 pid: 166113 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530112.862397:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001ea46bb1, rc 0) 00000100:00100000:1.0:1651530112.862421:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054ed0749 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438149:x1731754356258432:12345-10.240.43.64@tcp:101:cp.0 Request processed in 84us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530112.862424:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 914 00000100:00100000:0.0:1651530112.864384:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530112.864405:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356258880 00000100:00100000:1.0:1651530112.864418:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 915 00000100:00100000:1.0:1651530112.864420:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:477316:x1731754356258880:12345-10.240.43.64@tcp:101:cp.0 00010000:00010000:1.0:1651530112.864424:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651530112.864428:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55bee lrc: 2/0,0 mode: --/PW res: [0x2c09c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db30c79d expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530112.864436:0:166113:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55be7 lrc: 2/0,0 mode: PR/PR res: [0x2c09c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c788 expref: 7 pid: 166113 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530112.864442:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530112.864443:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530112.864444:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55bee lrc: 4/0,0 mode: --/PW res: [0x2c09c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c79d expref: 7 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530112.864456:0:166113:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55be7 lrc: 3/0,0 mode: PR/PR res: [0x2c09c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c788 expref: 7 pid: 166113 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530112.864461:0:166113:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55be7 lrc: 4/0,0 mode: PR/PR res: [0x2c09c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c788 expref: 7 pid: 166113 timeout: 20921 lvb_type: 1 00000100:00100000:1.0:1651530112.864466:0:166113:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c4ea889e pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997088640:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651530112.864486:0:166113:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023dae93b going to sleep for 6 seconds 00000100:00100000:1.0:1651530112.864687:0:166113:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c4ea889e pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997088640:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651530112.864699:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55bee lrc: 3/0,0 mode: --/PW res: [0x2c09c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c79d expref: 7 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530112.864704:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000062f8a534, rc 0) 00000100:00100000:1.0:1651530112.864718:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+7:477316:x1731754356258880:12345-10.240.43.64@tcp:101:cp.0 Request processed in 297us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530112.864721:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 915 00000100:00100000:0.0:1651530112.864746:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530112.864767:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356258944 00010000:00010000:1.0:1651530112.864773:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55be7 lrc: 4/0,0 mode: PR/PR res: [0x2c09c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c788 expref: 7 pid: 166113 timeout: 20921 lvb_type: 1 00000100:00100000:1.0:1651530112.864791:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 20 00000100:00100000:1.0:1651530112.864793:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b3339927 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438149:x1731754356258944:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651530112.864797:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651530112.864798:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55be7 lrc: 4/0,0 mode: PR/PR res: [0x2c09c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c788 expref: 7 pid: 166113 timeout: 20921 lvb_type: 1 00010000:00010000:1.0:1651530112.864802:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55be7 lrc: 3/0,0 mode: PR/PR res: [0x2c09c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c788 expref: 7 pid: 166113 timeout: 20921 lvb_type: 1 00010000:00010000:1.0:1651530112.864810:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55be7 lrc: 0/0,0 mode: --/PR res: [0x2c09c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c788 expref: 7 pid: 166113 timeout: 20921 lvb_type: 1 00010000:00010000:1.0:1651530112.864814:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530112.864815:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530112.864816:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55bee lrc: 2/0,0 mode: PW/PW res: [0x2c09c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c79d expref: 6 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530112.864819:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55bee lrc: 3/0,0 mode: PW/PW res: [0x2c09c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c79d expref: 6 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530112.864828:0:166104:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55bee lrc: 3/0,0 mode: PW/PW res: [0x2c09c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c79d expref: 6 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530112.864831:0:166104:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c4ea889e pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:166104:1731745997088704:10.240.43.64@tcp:105: 00000100:00100000:1.0:1651530112.864841:0:166104:0:(client.c:2492:ptlrpc_set_wait()) set 0000000023dae93b going to sleep for 6 seconds 00000100:00100000:1.0:1651530112.865051:0:166104:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c4ea889e pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:166104:1731745997088704:10.240.43.64@tcp:105: 00010000:00010000:1.0:1651530112.865060:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651530112.865072:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b3339927 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438149:x1731754356258944:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 279us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530112.865075:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 20 00000100:00100000:0.0:1651530112.865096:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530112.865108:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356259008 00002000:00010000:0.0:1651530112.865124:0:166118:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 180380/0 (0->18446744073709551615) 00002000:00100000:0.0:1651530112.865134:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d6486d55 with x1731754356259008 ext(0->18446744073709551615) 00002000:00010000:0.0:1651530112.865139:0:166118:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000d6486d55. 00000100:00100000:0.0:1651530112.865149:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 70 00000100:00100000:0.0:1651530112.865151:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438148:x1731754356259008:12345-10.240.43.64@tcp:10:cp.0 00002000:00010000:0.0:1651530112.865212:0:166118:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2c09c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651530112.865214:0:166118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2c09c:0x0] updating lvb mtime from disk: 0 -> 1651530112 00002000:00010000:0.0:1651530112.865215:0:166118:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2c09c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651530112.865216:0:166118:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2c09c:0x0] updating lvb ctime from disk: 0 -> 1651530112 00002000:00010000:0.0:1651530112.865217:0:166118:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2c09c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651530112.865249:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438148:x1731754356259008:12345-10.240.43.64@tcp:10:cp.0 Request processed in 97us (153us total) trans 21474837372 rc 0/0 00000100:00100000:0.0:1651530112.865252:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 70 00002000:00010000:0.0:1651530112.865254:0:166118:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 180380/0 (0->18446744073709551615) 00002000:00100000:0.0:1651530112.865255:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d6486d55 with x1731754356259008 ext(0->18446744073709551615) 00002000:00010000:0.0:1651530112.865257:0:166118:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000d6486d55. 00000100:00100000:1.0:1651530112.884420:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530112.884443:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356259264 00002000:00100000:0.0:1651530112.884453:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c09c:0x0] (0->4194303) req@00000000c4ea889e x1731754356259264/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:83/0 lens 488/0 e 0 to 0 dl 1651530118 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cp.0' 00002000:00100000:0.0:1651530112.884457:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c4ea889e with x1731754356259264 ext(0->4194303) 00002000:00010000:0.0:1651530112.884459:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000c4ea889e 00000100:00100000:0.0:1651530112.884469:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 71 00000100:00100000:0.0:1651530112.884470:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4ea889e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438148:x1731754356259264:12345-10.240.43.64@tcp:4:cp.0 00000100:00100000:0.0:1651530112.889533:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4ea889e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438148:x1731754356259264:12345-10.240.43.64@tcp:4:cp.0 Request processed in 5060us (5111us total) trans 21474837373 rc 0/0 00000100:00100000:0.0:1651530112.889539:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 71 00002000:00100000:0.0:1651530112.889543:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c09c:0x0] (0->4194303) req@00000000c4ea889e x1731754356259264/t21474837373(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:83/0 lens 488/448 e 0 to 0 dl 1651530118 ref 1 fl Complete:/0/0 rc 0/0 job:'cp.0' 00002000:00100000:0.0:1651530112.889548:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c4ea889e with x1731754356259264 ext(0->4194303) 00002000:00010000:0.0:1651530112.889550:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000c4ea889e 00000100:00100000:0.0:1651530112.902409:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530112.902418:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356259392 00002000:00100000:0.0:1651530112.902427:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c09c:0x0] (4194304->8388607) req@000000003ffbc5dc x1731754356259392/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:83/0 lens 488/0 e 0 to 0 dl 1651530118 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cp.0' 00002000:00100000:0.0:1651530112.902431:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003ffbc5dc with x1731754356259392 ext(4194304->8388607) 00002000:00010000:0.0:1651530112.902432:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000003ffbc5dc 00000100:00100000:0.0:1651530112.902444:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 72 00000100:00100000:0.0:1651530112.902446:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003ffbc5dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438148:x1731754356259392:12345-10.240.43.64@tcp:4:cp.0 00000100:00100000:0.0:1651530112.906998:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003ffbc5dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+11:438148:x1731754356259392:12345-10.240.43.64@tcp:4:cp.0 Request processed in 4549us (4588us total) trans 21474837374 rc 0/0 00000100:00100000:0.0:1651530112.907004:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 72 00002000:00100000:0.0:1651530112.907008:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c09c:0x0] (4194304->8388607) req@000000003ffbc5dc x1731754356259392/t21474837374(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:83/0 lens 488/448 e 0 to 0 dl 1651530118 ref 1 fl Complete:/0/0 rc 0/0 job:'cp.0' 00002000:00100000:0.0:1651530112.907013:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003ffbc5dc with x1731754356259392 ext(4194304->8388607) 00002000:00010000:0.0:1651530112.907015:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000003ffbc5dc 00000100:00100000:0.0:1651530112.920394:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530112.920404:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356259520 00002000:00100000:0.0:1651530112.920413:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c09c:0x0] (8388608->12582911) req@00000000946e402f x1731754356259520/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:83/0 lens 488/0 e 0 to 0 dl 1651530118 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cp.0' 00002000:00100000:0.0:1651530112.920418:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000946e402f with x1731754356259520 ext(8388608->12582911) 00002000:00010000:0.0:1651530112.920419:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000946e402f 00000100:00100000:0.0:1651530112.920430:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 73 00000100:00100000:0.0:1651530112.920432:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000946e402f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+11:438148:x1731754356259520:12345-10.240.43.64@tcp:4:cp.0 00000100:00100000:0.0:1651530112.925014:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000946e402f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+13:438148:x1731754356259520:12345-10.240.43.64@tcp:4:cp.0 Request processed in 4579us (4619us total) trans 21474837375 rc 0/0 00000100:00100000:0.0:1651530112.925019:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 73 00002000:00100000:0.0:1651530112.925024:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c09c:0x0] (8388608->12582911) req@00000000946e402f x1731754356259520/t21474837375(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:83/0 lens 488/448 e 0 to 0 dl 1651530118 ref 1 fl Complete:/0/0 rc 0/0 job:'cp.0' 00002000:00100000:0.0:1651530112.925028:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000946e402f with x1731754356259520 ext(8388608->12582911) 00002000:00010000:0.0:1651530112.925030:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000946e402f 00000100:00100000:0.0:1651530112.936763:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530112.936773:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356259776 00002000:00100000:0.0:1651530112.936782:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c09c:0x0] (12582912->16777215) req@00000000dd71124e x1731754356259776/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:83/0 lens 488/0 e 0 to 0 dl 1651530118 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cp.0' 00002000:00100000:0.0:1651530112.936786:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000dd71124e with x1731754356259776 ext(12582912->16777215) 00002000:00010000:0.0:1651530112.936788:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000dd71124e 00000100:00100000:0.0:1651530112.936800:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 74 00000100:00100000:0.0:1651530112.936802:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dd71124e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+13:438148:x1731754356259776:12345-10.240.43.64@tcp:4:cp.0 00000100:00100000:0.0:1651530112.941979:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dd71124e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+15:438148:x1731754356259776:12345-10.240.43.64@tcp:4:cp.0 Request processed in 5175us (5214us total) trans 21474837376 rc 0/0 00000100:00100000:0.0:1651530112.941983:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 74 00002000:00100000:0.0:1651530112.941988:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c09c:0x0] (12582912->16777215) req@00000000dd71124e x1731754356259776/t21474837376(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:83/0 lens 488/448 e 0 to 0 dl 1651530118 ref 1 fl Complete:/0/0 rc 0/0 job:'cp.0' 00002000:00100000:0.0:1651530112.941993:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000dd71124e with x1731754356259776 ext(12582912->16777215) 00002000:00010000:0.0:1651530112.941995:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000dd71124e 00000100:00100000:1.0:1651530112.950424:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530112.950436:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356259904 00000100:00100000:1.0:1651530112.950456:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 14 00000100:00100000:1.0:1651530112.950458:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+15:451155:x1731754356259904:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651530112.950464:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1651530112.950471:0:166104:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2c09c:0x0] updating lvb size from disk: 0 -> 16777216 00002000:00010000:1.0:1651530112.950472:0:166104:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2c09c:0x0] updating lvb blocks from disk: 0 -> 32768 00010000:00010000:1.0:1651530112.950483:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55bee lrc: 0/0,0 mode: --/PW res: [0x2c09c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c79d expref: 15 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530112.950493:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651530112.950508:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+14:451155:x1731754356259904:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 49us (85us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530112.950511:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 14 00000100:00100000:1.0:1651530112.957041:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530112.957051:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356260096 00000100:00100000:1.0:1651530112.957065:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 916 00000100:00100000:1.0:1651530112.957066:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008dcef4b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+14:438148:x1731754356260096:12345-10.240.43.64@tcp:101:cmp.0 00010000:00010000:1.0:1651530112.957071:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651530112.957077:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55bf5 lrc: 2/0,0 mode: --/PR res: [0x2c09c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db30c7b2 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530112.957083:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c09c:0x0] initial LVB size: 16777216, mtime: 0x62705980, atime: 0x0, ctime: 0x62705980, blocks: 0x8000 00010000:00010000:1.0:1651530112.957089:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530112.957090:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530112.957094:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55bf5 lrc: 3/0,0 mode: PR/PR res: [0x2c09c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c7b2 expref: 15 pid: 166113 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530112.957100:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55bf5 lrc: 3/0,0 mode: PR/PR res: [0x2c09c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c7b2 expref: 15 pid: 166113 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530112.957104:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000062f8a534, rc 0) 00000100:00100000:1.0:1651530112.957118:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008dcef4b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+15:438148:x1731754356260096:12345-10.240.43.64@tcp:101:cmp.0 Request processed in 51us (78us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530112.957121:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 916 00000100:00100000:1.0:1651530112.961200:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530112.961230:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356260224 00002000:00100000:0.0:1651530112.961239:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c09c:0x0] (0->4194303) req@000000009ef7d105 x1731754356260224/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:83/0 lens 488/0 e 0 to 0 dl 1651530118 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cmp.0' 00002000:00100000:0.0:1651530112.961244:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009ef7d105 with x1731754356260224 ext(0->4194303) 00002000:00010000:0.0:1651530112.961245:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000009ef7d105 00000100:00100000:0.0:1651530112.961255:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 75 00000100:00100000:0.0:1651530112.961257:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+15:438149:x1731754356260224:12345-10.240.43.64@tcp:3:cmp.0 00000100:00100000:0.0:1651530112.964041:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ef7d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+15:438149:x1731754356260224:12345-10.240.43.64@tcp:3:cmp.0 Request processed in 2782us (2841us total) trans 0 rc 4194304/4194304 00000100:00100000:0.0:1651530112.964046:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 75 00002000:00100000:0.0:1651530112.964049:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c09c:0x0] (0->4194303) req@000000009ef7d105 x1731754356260224/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:83/0 lens 488/440 e 0 to 0 dl 1651530118 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'cmp.0' 00002000:00100000:0.0:1651530112.964053:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009ef7d105 with x1731754356260224 ext(0->4194303) 00002000:00010000:0.0:1651530112.964055:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000009ef7d105 00000100:00100000:1.0:1651530112.972476:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530112.972489:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530112.972499:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356260416 00000100:00100000:1.0:1651530112.972501:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530112.972512:0:176086:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356260352 00002000:00100000:0.0:1651530112.972514:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c09c:0x0] (8388608->12582911) req@000000004be7c06d x1731754356260416/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:83/0 lens 488/0 e 0 to 0 dl 1651530118 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cmp.0' 00002000:00100000:0.0:1651530112.972518:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004be7c06d with x1731754356260416 ext(8388608->12582911) 00002000:00010000:0.0:1651530112.972519:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000004be7c06d 00002000:00100000:1.0:1651530112.972521:0:176086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2c09c:0x0] (4194304->8388607) req@00000000387f378b x1731754356260352/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:83/0 lens 488/0 e 0 to 0 dl 1651530118 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cmp.0' 00000100:00100000:0.0:1651530112.972525:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356260480 00002000:00100000:1.0:1651530112.972526:0:176086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000387f378b with x1731754356260352 ext(4194304->8388607) 00002000:00010000:1.0:1651530112.972527:0:176086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000387f378b 00002000:00100000:0.0:1651530112.972529:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c09c:0x0] (12582912->16777215) req@00000000f7096c29 x1731754356260480/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:83/0 lens 488/0 e 0 to 0 dl 1651530118 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cmp.0' 00000100:00100000:1.0:1651530112.972532:0:176086:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 76 00002000:00100000:0.0:1651530112.972532:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f7096c29 with x1731754356260480 ext(12582912->16777215) 00002000:00010000:0.0:1651530112.972533:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f7096c29 00000100:00100000:1.0:1651530112.972534:0:176086:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004be7c06d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+17:438149:x1731754356260416:12345-10.240.43.64@tcp:3:cmp.0 00000100:00100000:0.0:1651530112.972536:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 77 00000100:00100000:0.0:1651530112.972538:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000387f378b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+17:438149:x1731754356260352:12345-10.240.43.64@tcp:3:cmp.0 00000100:00100000:0.0:1651530112.976620:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000387f378b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+18:438149:x1731754356260352:12345-10.240.43.64@tcp:3:cmp.0 Request processed in 4080us (4129us total) trans 0 rc 4194304/4194304 00000100:00100000:0.0:1651530112.976625:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 77 00002000:00100000:0.0:1651530112.976629:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c09c:0x0] (4194304->8388607) req@00000000387f378b x1731754356260352/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:83/0 lens 488/440 e 0 to 0 dl 1651530118 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'cmp.0' 00002000:00100000:0.0:1651530112.976633:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000387f378b with x1731754356260352 ext(4194304->8388607) 00002000:00010000:0.0:1651530112.976635:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000387f378b 00000100:00100000:0.0:1651530112.976642:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 78 00000100:00100000:0.0:1651530112.976645:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7096c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+17:438149:x1731754356260480:12345-10.240.43.64@tcp:3:cmp.0 00000100:00100000:1.0:1651530112.976925:0:176086:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004be7c06d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+17:438149:x1731754356260416:12345-10.240.43.64@tcp:3:cmp.0 Request processed in 4390us (4449us total) trans 0 rc 4194304/4194304 00000100:00100000:1.0:1651530112.976929:0:176086:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 76 00002000:00100000:1.0:1651530112.976932:0:176086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2c09c:0x0] (8388608->12582911) req@000000004be7c06d x1731754356260416/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:83/0 lens 488/440 e 0 to 0 dl 1651530118 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'cmp.0' 00002000:00100000:1.0:1651530112.976937:0:176086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004be7c06d with x1731754356260416 ext(8388608->12582911) 00002000:00010000:1.0:1651530112.976938:0:176086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000004be7c06d 00000100:00100000:0.0:1651530112.979158:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7096c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+15:438149:x1731754356260480:12345-10.240.43.64@tcp:3:cmp.0 Request processed in 2512us (6656us total) trans 0 rc 4194304/4194304 00000100:00100000:0.0:1651530112.979162:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 78 00002000:00100000:0.0:1651530112.979165:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c09c:0x0] (12582912->16777215) req@00000000f7096c29 x1731754356260480/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:83/0 lens 488/440 e 0 to 0 dl 1651530118 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'cmp.0' 00002000:00100000:0.0:1651530112.979169:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f7096c29 with x1731754356260480 ext(12582912->16777215) 00002000:00010000:0.0:1651530112.979171:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f7096c29 00000400:00000080:0.0:1651530114.634053:0:176847:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530114.634055:0:176847:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 155h: Verify big file correctness: read cache:off write_cache:off ========================================================== 22:21:54 (1651530114) 00000100:00100000:1.0:1651530115.315660:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530115.315678:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356260864 00000100:00100000:1.0:1651530115.315708:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15 00000100:00100000:1.0:1651530115.315711:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004237e3f1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+15:451155:x1731754356260864:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651530115.315718:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651530115.315740:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55bf5 lrc: 0/0,0 mode: --/PR res: [0x2c09c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c7b2 expref: 15 pid: 166113 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530115.315749:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651530115.315772:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004237e3f1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+14:451155:x1731754356260864:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 61us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530115.315776:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15 00000100:00100000:1.0:1651530116.084640:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530116.084660:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946853824 00000100:00100000:1.0:1651530116.084694:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 917 00000100:00100000:1.0:1651530116.084697:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008e0501d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946853824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651530116.084715:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180380 count 1 00002000:00010000:1.0:1651530116.084733:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c09c:0x0] initial LVB size: 16777216, mtime: 0x62705980, atime: 0x0, ctime: 0x62705980, blocks: 0x8000 00010000:00010000:1.0:1651530116.084737:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55bfc lrc: 3/0,1 mode: --/PW res: [0x2c09c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530116.084745:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530116.084746:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530116.084748:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55bfc lrc: 3/0,1 mode: PW/PW res: [0x2c09c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530116.084755:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55bfc lrc: 3/0,1 mode: PW/PW res: [0x2c09c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530116.084760:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55bfc lrc: 3/0,1 mode: PW/PW res: [0x2c09c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530116.084763:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55bfc lrc: 2/0,0 mode: PW/PW res: [0x2c09c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530116.084869:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55bfc lrc: 2/0,0 mode: PW/PW res: [0x2c09c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530116.084873:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000062f8a534 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651530116.084875:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55bfc lrc: 2/0,0 mode: PW/PW res: [0x2c09c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530116.084879:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55bfc lrc: 3/0,0 mode: PW/PW res: [0x2c09c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530116.084886:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55bfc lrc: 1/0,0 mode: --/PW res: [0x2c09c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530116.084893:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55bfc lrc: 0/0,0 mode: --/PW res: [0x2c09c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530116.086417:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008e0501d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946853824:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1719us (1781us total) trans 21474837377 rc 0/0 00000100:00100000:1.0:1651530116.086422:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 917 00000100:00100000:1.0:1651530116.322478:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530116.322499:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946853952 00000100:00100000:1.0:1651530116.322519:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 95 00000100:00100000:1.0:1651530116.322521:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000f4bed26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946853952:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651530116.322539:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 241444672 pending 16875520 free 81307987968 avail 77137276928 00000100:00100000:1.0:1651530116.322570:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000f4bed26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946853952:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 48us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530116.322573:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 95 00000100:00100000:0.0:1651530117.245308:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cebf7380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:39099:1731745997088832:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:0.0:1651530117.245342:0:39099:0:(ptlrpcd.c:414:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1651530117.245344:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000043b0f16d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997088768:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:0.0:1651530117.245624:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000043b0f16d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997088768:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:0.0:1651530117.245630:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cebf7380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:39099:1731745997088832:10.240.43.61@tcp:400:kworker/u4:0.0 00000001:00080000:0.0:1651530118.292753:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474837377 is committed 00000001:00080000:0.0:1651530118.292760:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474837376 is committed 00000100:00100000:1.0:1651530121.440300:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530121.440322:0:166115:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946854208 00000100:00100000:1.0:1651530121.440344:0:166115:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 96 00000100:00100000:1.0:1651530121.440347:0:166115:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005821f828 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946854208:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651530121.440365:0:166115:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 224569152 pending 0 free 81307987968 avail 77137276928 00000100:00100000:1.0:1651530121.440401:0:166115:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005821f828 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946854208:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 53us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530121.440405:0:166115:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 96 00000100:00100000:1.0:1651530123.708565:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530123.708583:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356260992 00000100:00100000:1.0:1651530123.708603:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 97 00000100:00100000:1.0:1651530123.708606:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001e61ed2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cccc371e-feb6-4a45-b229-8d88a861b48a+5:478479:x1731754356260992:12345-10.240.43.64@tcp:13:lctl.0 00002000:00000024:1.0:1651530123.708624:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 224569152 pending 0 free 81307987968 avail 77137276928 00000100:00100000:1.0:1651530123.708658:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001e61ed2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cccc371e-feb6-4a45-b229-8d88a861b48a+5:478479:x1731754356260992:12345-10.240.43.64@tcp:13:lctl.0 Request processed in 51us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530123.708661:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 97 00000100:00100000:1.0:1651530124.003121:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530124.003152:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356261760 00000100:00100000:1.0:1651530124.003176:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 918 00000100:00100000:1.0:1651530124.003178:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000b1a9136 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+5:438149:x1731754356261760:12345-10.240.43.64@tcp:101:cp.0 00010000:00010000:1.0:1651530124.003188:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651530124.003208:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55c03 lrc: 2/0,0 mode: --/PR res: [0x2c09d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db30c7d5 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530124.003220:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c09d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530124.003242:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530124.003243:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530124.003248:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55c03 lrc: 3/0,0 mode: PR/PR res: [0x2c09d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c7d5 expref: 6 pid: 166113 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530124.003256:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55c03 lrc: 3/0,0 mode: PR/PR res: [0x2c09d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c7d5 expref: 6 pid: 166113 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530124.003262:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000062f8a534, rc 0) 00000100:00100000:1.0:1651530124.003289:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000b1a9136 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438149:x1731754356261760:12345-10.240.43.64@tcp:101:cp.0 Request processed in 110us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530124.003292:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 918 00000100:00100000:1.0:1651530124.005262:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530124.005270:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356262208 00000100:00100000:1.0:1651530124.005283:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 919 00000100:00100000:1.0:1651530124.005284:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007b76f7f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:478490:x1731754356262208:12345-10.240.43.64@tcp:101:cp.0 00010000:00010000:1.0:1651530124.005288:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651530124.005292:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55c0a lrc: 2/0,0 mode: --/PW res: [0x2c09d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db30c7ea expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530124.005300:0:166113:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55c03 lrc: 2/0,0 mode: PR/PR res: [0x2c09d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c7d5 expref: 7 pid: 166113 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530124.005304:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530124.005305:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530124.005306:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55c0a lrc: 4/0,0 mode: --/PW res: [0x2c09d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c7ea expref: 7 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530124.005317:0:166113:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55c03 lrc: 3/0,0 mode: PR/PR res: [0x2c09d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c7d5 expref: 7 pid: 166113 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530124.005322:0:166113:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55c03 lrc: 4/0,0 mode: PR/PR res: [0x2c09d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c7d5 expref: 7 pid: 166113 timeout: 20932 lvb_type: 1 00000100:00100000:1.0:1651530124.005328:0:166113:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000052cf3c08 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997088896:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651530124.005350:0:166113:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c733e7e6 going to sleep for 6 seconds 00000100:00100000:1.0:1651530124.005535:0:166113:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000052cf3c08 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997088896:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651530124.005542:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55c0a lrc: 3/0,0 mode: --/PW res: [0x2c09d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c7ea expref: 7 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530124.005550:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001ea46bb1, rc 0) 00000100:00100000:1.0:1651530124.005560:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007b76f7f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+7:478490:x1731754356262208:12345-10.240.43.64@tcp:101:cp.0 Request processed in 274us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530124.005563:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 919 00000100:00100000:0.0:1651530124.005586:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530124.005602:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356262272 00010000:00010000:1.0:1651530124.005609:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55c03 lrc: 4/0,0 mode: PR/PR res: [0x2c09d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c7d5 expref: 7 pid: 166113 timeout: 20932 lvb_type: 1 00000100:00100000:1.0:1651530124.005621:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 21 00000100:00100000:1.0:1651530124.005623:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000471073f9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438149:x1731754356262272:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651530124.005626:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651530124.005628:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55c03 lrc: 4/0,0 mode: PR/PR res: [0x2c09d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c7d5 expref: 7 pid: 166113 timeout: 20932 lvb_type: 1 00010000:00010000:1.0:1651530124.005632:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55c03 lrc: 3/0,0 mode: PR/PR res: [0x2c09d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c7d5 expref: 7 pid: 166113 timeout: 20932 lvb_type: 1 00010000:00010000:1.0:1651530124.005640:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55c03 lrc: 0/0,0 mode: --/PR res: [0x2c09d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c7d5 expref: 7 pid: 166113 timeout: 20932 lvb_type: 1 00010000:00010000:1.0:1651530124.005644:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530124.005644:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530124.005646:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55c0a lrc: 2/0,0 mode: PW/PW res: [0x2c09d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c7ea expref: 6 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530124.005652:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55c0a lrc: 3/0,0 mode: PW/PW res: [0x2c09d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c7ea expref: 6 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530124.005660:0:166104:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55c0a lrc: 3/0,0 mode: PW/PW res: [0x2c09d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c7ea expref: 6 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530124.005664:0:166104:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000052cf3c08 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:166104:1731745997088960:10.240.43.64@tcp:105: 00000100:00100000:1.0:1651530124.005674:0:166104:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c733e7e6 going to sleep for 6 seconds 00000100:00100000:1.0:1651530124.005957:0:166104:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000052cf3c08 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:166104:1731745997088960:10.240.43.64@tcp:105: 00010000:00010000:1.0:1651530124.005962:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651530124.005971:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530124.005982:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000471073f9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438149:x1731754356262272:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 358us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530124.005985:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 21 00000100:00100000:0.0:1651530124.005999:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356262336 00002000:00010000:0.0:1651530124.006010:0:166118:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 180381/0 (0->18446744073709551615) 00002000:00100000:0.0:1651530124.006012:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000fd6d3f0c with x1731754356262336 ext(0->18446744073709551615) 00002000:00010000:0.0:1651530124.006016:0:166118:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000fd6d3f0c. 00000100:00100000:0.0:1651530124.006028:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 79 00000100:00100000:0.0:1651530124.006030:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fd6d3f0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438148:x1731754356262336:12345-10.240.43.64@tcp:10:cp.0 00002000:00010000:0.0:1651530124.006089:0:166118:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2c09d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1651530124.006091:0:166118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2c09d:0x0] updating lvb mtime from disk: 0 -> 1651530124 00002000:00010000:0.0:1651530124.006092:0:166118:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2c09d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651530124.006093:0:166118:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2c09d:0x0] updating lvb ctime from disk: 0 -> 1651530124 00002000:00010000:0.0:1651530124.006094:0:166118:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2c09d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1651530124.006107:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fd6d3f0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438148:x1731754356262336:12345-10.240.43.64@tcp:10:cp.0 Request processed in 77us (137us total) trans 21474837378 rc 0/0 00000100:00100000:0.0:1651530124.006111:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 79 00002000:00010000:0.0:1651530124.006112:0:166118:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 180381/0 (0->18446744073709551615) 00002000:00100000:0.0:1651530124.006113:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000fd6d3f0c with x1731754356262336 ext(0->18446744073709551615) 00002000:00010000:0.0:1651530124.006115:0:166118:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000fd6d3f0c. 00000100:00100000:1.0:1651530124.025426:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530124.025447:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356262592 00002000:00100000:0.0:1651530124.025457:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c09d:0x0] (0->4194303) req@0000000052cf3c08 x1731754356262592/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:95/0 lens 488/0 e 0 to 0 dl 1651530130 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cp.0' 00002000:00100000:0.0:1651530124.025462:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000052cf3c08 with x1731754356262592 ext(0->4194303) 00002000:00010000:0.0:1651530124.025463:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000052cf3c08 00000100:00100000:0.0:1651530124.025474:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 80 00000100:00100000:0.0:1651530124.025475:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052cf3c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438148:x1731754356262592:12345-10.240.43.64@tcp:4:cp.0 00000100:00100000:0.0:1651530124.030259:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052cf3c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438148:x1731754356262592:12345-10.240.43.64@tcp:4:cp.0 Request processed in 4780us (4831us total) trans 21474837379 rc 0/0 00000100:00100000:0.0:1651530124.030264:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 80 00002000:00100000:0.0:1651530124.030269:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c09d:0x0] (0->4194303) req@0000000052cf3c08 x1731754356262592/t21474837379(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:95/0 lens 488/448 e 0 to 0 dl 1651530130 ref 1 fl Complete:/0/0 rc 0/0 job:'cp.0' 00002000:00100000:0.0:1651530124.030274:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000052cf3c08 with x1731754356262592 ext(0->4194303) 00002000:00010000:0.0:1651530124.030276:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000052cf3c08 00000100:00100000:0.0:1651530124.053436:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530124.053446:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356262720 00002000:00100000:0.0:1651530124.053456:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c09d:0x0] (4194304->8388607) req@000000008b7a4fe3 x1731754356262720/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:95/0 lens 488/0 e 0 to 0 dl 1651530130 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cp.0' 00002000:00100000:0.0:1651530124.053460:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000008b7a4fe3 with x1731754356262720 ext(4194304->8388607) 00002000:00010000:0.0:1651530124.053461:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000008b7a4fe3 00000100:00100000:0.0:1651530124.053473:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 81 00000100:00100000:0.0:1651530124.053475:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438146:x1731754356262720:12345-10.240.43.64@tcp:4:cp.0 00000100:00100000:0.0:1651530124.065880:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530124.065889:0:176086:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356262848 00002000:00100000:1.0:1651530124.065900:0:176086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2c09d:0x0] (8388608->12582911) req@000000004de851bb x1731754356262848/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:95/0 lens 488/0 e 0 to 0 dl 1651530130 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cp.0' 00002000:00100000:1.0:1651530124.065905:0:176086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004de851bb with x1731754356262848 ext(8388608->12582911) 00002000:00010000:1.0:1651530124.065907:0:176086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000004de851bb 00000100:00100000:1.0:1651530124.065922:0:176086:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 82 00000100:00100000:1.0:1651530124.065924:0:176086:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004de851bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+11:438146:x1731754356262848:12345-10.240.43.64@tcp:4:cp.0 00000100:00100000:0.0:1651530124.067770:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b7a4fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+13:438146:x1731754356262720:12345-10.240.43.64@tcp:4:cp.0 Request processed in 14293us (14333us total) trans 21474837380 rc 0/0 00000100:00100000:0.0:1651530124.067775:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 81 00002000:00100000:0.0:1651530124.067779:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x2c09d:0x0] (4194304->8388607) req@000000008b7a4fe3 x1731754356262720/t21474837380(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:95/0 lens 488/448 e 0 to 0 dl 1651530130 ref 1 fl Complete:/0/0 rc 0/0 job:'cp.0' 00002000:00100000:0.0:1651530124.067784:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000008b7a4fe3 with x1731754356262720 ext(4194304->8388607) 00002000:00010000:0.0:1651530124.067785:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000008b7a4fe3 00000100:00100000:1.0:1651530124.071351:0:176086:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004de851bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+13:438146:x1731754356262848:12345-10.240.43.64@tcp:4:cp.0 Request processed in 5424us (5469us total) trans 21474837381 rc 0/0 00000100:00100000:1.0:1651530124.071358:0:176086:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 82 00002000:00100000:1.0:1651530124.071362:0:176086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2c09d:0x0] (8388608->12582911) req@000000004de851bb x1731754356262848/t21474837381(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:95/0 lens 488/448 e 0 to 0 dl 1651530130 ref 1 fl Complete:/0/0 rc 0/0 job:'cp.0' 00002000:00100000:1.0:1651530124.071367:0:176086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004de851bb with x1731754356262848 ext(8388608->12582911) 00002000:00010000:1.0:1651530124.071369:0:176086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000004de851bb 00000100:00100000:0.0:1651530124.079002:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530124.079036:0:176086:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356263104 00002000:00100000:1.0:1651530124.079049:0:176086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2c09d:0x0] (12582912->16777215) req@00000000a6ed4a31 x1731754356263104/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:95/0 lens 488/0 e 0 to 0 dl 1651530130 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cp.0' 00002000:00100000:1.0:1651530124.079053:0:176086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a6ed4a31 with x1731754356263104 ext(12582912->16777215) 00002000:00010000:1.0:1651530124.079055:0:176086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000a6ed4a31 00000100:00100000:1.0:1651530124.079067:0:176086:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 83 00000100:00100000:1.0:1651530124.079069:0:176086:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+13:438148:x1731754356263104:12345-10.240.43.64@tcp:4:cp.0 00000100:00100000:1.0:1651530124.083123:0:176086:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6ed4a31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+15:438148:x1731754356263104:12345-10.240.43.64@tcp:4:cp.0 Request processed in 4052us (4121us total) trans 21474837382 rc 0/0 00000100:00100000:1.0:1651530124.083128:0:176086:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 83 00002000:00100000:1.0:1651530124.083142:0:176086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2c09d:0x0] (12582912->16777215) req@00000000a6ed4a31 x1731754356263104/t21474837382(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:95/0 lens 488/448 e 0 to 0 dl 1651530130 ref 1 fl Complete:/0/0 rc 0/0 job:'cp.0' 00002000:00100000:1.0:1651530124.083147:0:176086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a6ed4a31 with x1731754356263104 ext(12582912->16777215) 00002000:00010000:1.0:1651530124.083149:0:176086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000a6ed4a31 00000100:00100000:0.0:1651530124.091667:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530124.091692:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356263232 00000100:00100000:1.0:1651530124.091710:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 16 00000100:00100000:1.0:1651530124.091712:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091d23b68 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+15:451155:x1731754356263232:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651530124.091718:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1651530124.091724:0:166104:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2c09d:0x0] updating lvb size from disk: 0 -> 16777216 00002000:00010000:1.0:1651530124.091725:0:166104:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2c09d:0x0] updating lvb blocks from disk: 0 -> 32768 00010000:00010000:1.0:1651530124.091735:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55c0a lrc: 0/0,0 mode: --/PW res: [0x2c09d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c7ea expref: 15 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530124.091744:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651530124.091756:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091d23b68 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+14:451155:x1731754356263232:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 43us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530124.091759:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 16 00000100:00100000:0.0:1651530124.098353:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530124.098377:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356263424 00000100:00100000:1.0:1651530124.098391:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 920 00000100:00100000:1.0:1651530124.098393:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d87e5801 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+14:438148:x1731754356263424:12345-10.240.43.64@tcp:101:cmp.0 00010000:00010000:1.0:1651530124.098397:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651530124.098403:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55c11 lrc: 2/0,0 mode: --/PR res: [0x2c09d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db30c7ff expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530124.098409:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c09d:0x0] initial LVB size: 16777216, mtime: 0x6270598c, atime: 0x0, ctime: 0x6270598c, blocks: 0x8000 00010000:00010000:1.0:1651530124.098415:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530124.098416:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530124.098419:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55c11 lrc: 3/0,0 mode: PR/PR res: [0x2c09d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c7ff expref: 15 pid: 166113 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530124.098425:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55c11 lrc: 3/0,0 mode: PR/PR res: [0x2c09d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c7ff expref: 15 pid: 166113 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530124.098430:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001ea46bb1, rc 0) 00000100:00100000:1.0:1651530124.098441:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d87e5801 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+15:438148:x1731754356263424:12345-10.240.43.64@tcp:101:cmp.0 Request processed in 48us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530124.098444:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 920 00000100:00100000:0.0:1651530124.102437:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530124.102457:0:176086:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356263552 00002000:00100000:1.0:1651530124.102466:0:176086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2c09d:0x0] (0->4194303) req@0000000041d3f4d5 x1731754356263552/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:95/0 lens 488/0 e 0 to 0 dl 1651530130 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cmp.0' 00002000:00100000:1.0:1651530124.102470:0:176086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000041d3f4d5 with x1731754356263552 ext(0->4194303) 00002000:00010000:1.0:1651530124.102471:0:176086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000041d3f4d5 00000100:00100000:1.0:1651530124.102481:0:176086:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 84 00000100:00100000:1.0:1651530124.102483:0:176086:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000041d3f4d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+15:438149:x1731754356263552:12345-10.240.43.64@tcp:3:cmp.0 00000100:00100000:1.0:1651530124.105715:0:176086:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000041d3f4d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+15:438149:x1731754356263552:12345-10.240.43.64@tcp:3:cmp.0 Request processed in 3229us (3276us total) trans 0 rc 4194304/4194304 00000100:00100000:1.0:1651530124.105720:0:176086:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 84 00002000:00100000:1.0:1651530124.105725:0:176086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2c09d:0x0] (0->4194303) req@0000000041d3f4d5 x1731754356263552/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:95/0 lens 488/440 e 0 to 0 dl 1651530130 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'cmp.0' 00002000:00100000:1.0:1651530124.105729:0:176086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000041d3f4d5 with x1731754356263552 ext(0->4194303) 00002000:00010000:1.0:1651530124.105731:0:176086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000041d3f4d5 00000100:00100000:0.0:1651530124.114455:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530124.114466:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530124.114475:0:176086:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356263744 00000100:00100000:0.0:1651530124.114475:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530124.114484:0:166117:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356263680 00002000:00100000:1.0:1651530124.114486:0:176086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2c09d:0x0] (8388608->12582911) req@000000000f756e73 x1731754356263744/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:95/0 lens 488/0 e 0 to 0 dl 1651530130 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cmp.0' 00002000:00100000:1.0:1651530124.114490:0:176086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000f756e73 with x1731754356263744 ext(8388608->12582911) 00002000:00010000:1.0:1651530124.114491:0:176086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000000f756e73 00002000:00100000:0.0:1651530124.114494:0:166117:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x100010000:0x2c09d:0x0] (4194304->8388607) req@00000000c7657c6f x1731754356263680/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:95/0 lens 488/0 e 0 to 0 dl 1651530130 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cmp.0' 00000100:00100000:1.0:1651530124.114500:0:176086:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356263808 00002000:00100000:1.0:1651530124.114504:0:176086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2c09d:0x0] (12582912->16777215) req@0000000020f0e0b5 x1731754356263808/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:95/0 lens 488/0 e 0 to 0 dl 1651530130 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cmp.0' 00002000:00100000:0.0:1651530124.114506:0:166117:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c7657c6f with x1731754356263680 ext(4194304->8388607) 00002000:00100000:1.0:1651530124.114507:0:176086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000020f0e0b5 with x1731754356263808 ext(12582912->16777215) 00002000:00010000:1.0:1651530124.114508:0:176086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000020f0e0b5 00002000:00010000:0.0:1651530124.114508:0:166117:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000c7657c6f 00000100:00100000:1.0:1651530124.114512:0:176086:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 85 00000100:00100000:1.0:1651530124.114514:0:176086:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000f756e73 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+17:438149:x1731754356263744:12345-10.240.43.64@tcp:3:cmp.0 00000100:00100000:0.0:1651530124.114515:0:166117:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 86 00000100:00100000:0.0:1651530124.114517:0:166117:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+17:438149:x1731754356263680:12345-10.240.43.64@tcp:3:cmp.0 00000100:00100000:1.0:1651530124.117804:0:176086:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000f756e73 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+18:438149:x1731754356263744:12345-10.240.43.64@tcp:3:cmp.0 Request processed in 3285us (3346us total) trans 0 rc 4194304/4194304 00000100:00100000:1.0:1651530124.117812:0:176086:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 85 00002000:00100000:1.0:1651530124.117819:0:176086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2c09d:0x0] (8388608->12582911) req@000000000f756e73 x1731754356263744/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:95/0 lens 488/440 e 0 to 0 dl 1651530130 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'cmp.0' 00002000:00100000:1.0:1651530124.117825:0:176086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000f756e73 with x1731754356263744 ext(8388608->12582911) 00002000:00010000:1.0:1651530124.117828:0:176086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000000f756e73 00000100:00100000:1.0:1651530124.117840:0:176086:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 87 00000100:00100000:1.0:1651530124.117842:0:176086:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000020f0e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+17:438149:x1731754356263808:12345-10.240.43.64@tcp:3:cmp.0 00000100:00100000:0.0:1651530124.119877:0:166117:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7657c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cccc371e-feb6-4a45-b229-8d88a861b48a+17:438149:x1731754356263680:12345-10.240.43.64@tcp:3:cmp.0 Request processed in 5356us (5407us total) trans 0 rc 4194304/4194304 00000100:00100000:0.0:1651530124.119884:0:166117:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 86 00002000:00100000:0.0:1651530124.119889:0:166117:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x100010000:0x2c09d:0x0] (4194304->8388607) req@00000000c7657c6f x1731754356263680/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:95/0 lens 488/440 e 0 to 0 dl 1651530130 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'cmp.0' 00002000:00100000:0.0:1651530124.119894:0:166117:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c7657c6f with x1731754356263680 ext(4194304->8388607) 00002000:00010000:0.0:1651530124.119896:0:166117:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000c7657c6f 00000100:00100000:1.0:1651530124.121437:0:176086:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000020f0e0b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+15:438149:x1731754356263808:12345-10.240.43.64@tcp:3:cmp.0 Request processed in 3593us (6961us total) trans 0 rc 4194304/4194304 00000100:00100000:1.0:1651530124.121442:0:176086:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 87 00002000:00100000:1.0:1651530124.121445:0:176086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2c09d:0x0] (12582912->16777215) req@0000000020f0e0b5 x1731754356263808/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:95/0 lens 488/440 e 0 to 0 dl 1651530130 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'cmp.0' 00002000:00100000:1.0:1651530124.121449:0:176086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000020f0e0b5 with x1731754356263808 ext(12582912->16777215) 00002000:00010000:1.0:1651530124.121451:0:176086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000020f0e0b5 00000400:00000080:0.0:1651530125.774509:0:177339:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530125.774512:0:177339:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 156: Verification of tunables ============= 22:22:05 (1651530125) 00000100:00100000:1.0:1651530126.517190:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530126.517217:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356265408 00000100:00100000:1.0:1651530126.517254:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 17 00000100:00100000:1.0:1651530126.517256:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008e0501d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+15:451154:x1731754356265408:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651530126.517266:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651530126.517287:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55c11 lrc: 0/0,0 mode: --/PR res: [0x2c09d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c7ff expref: 15 pid: 166113 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530126.517298:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651530126.517319:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008e0501d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+14:451154:x1731754356265408:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 62us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530126.517323:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 17 00000100:00100000:1.0:1651530126.560153:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530126.560164:0:166115:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946854464 00000100:00100000:1.0:1651530126.560174:0:166115:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 98 00000100:00100000:1.0:1651530126.560176:0:166115:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000b1a9136 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946854464:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651530126.560189:0:166115:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 258320192 pending 16875520 free 81291210752 avail 77120499712 00000100:00100000:1.0:1651530126.560203:0:166115:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000b1a9136 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946854464:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 26us (51us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530126.560206:0:166115:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 98 00000100:00100000:1.0:1651530126.644683:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530126.644915:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946854592 00000100:00100000:1.0:1651530126.644934:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 921 00000100:00100000:1.0:1651530126.644937:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007b76f7f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946854592:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651530126.644951:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180381 count 1 00002000:00010000:1.0:1651530126.644966:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c09d:0x0] initial LVB size: 16777216, mtime: 0x6270598c, atime: 0x0, ctime: 0x6270598c, blocks: 0x8000 00010000:00010000:1.0:1651530126.644969:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55c18 lrc: 3/0,1 mode: --/PW res: [0x2c09d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530126.644977:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530126.644978:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530126.644981:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55c18 lrc: 3/0,1 mode: PW/PW res: [0x2c09d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530126.644987:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55c18 lrc: 3/0,1 mode: PW/PW res: [0x2c09d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530126.644991:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55c18 lrc: 3/0,1 mode: PW/PW res: [0x2c09d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530126.644994:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55c18 lrc: 2/0,0 mode: PW/PW res: [0x2c09d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530126.645066:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55c18 lrc: 2/0,0 mode: PW/PW res: [0x2c09d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530126.645070:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001ea46bb1 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651530126.645071:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55c18 lrc: 2/0,0 mode: PW/PW res: [0x2c09d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530126.645075:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55c18 lrc: 3/0,0 mode: PW/PW res: [0x2c09d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530126.645082:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55c18 lrc: 1/0,0 mode: --/PW res: [0x2c09d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530126.645085:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55c18 lrc: 0/0,0 mode: --/PW res: [0x2c09d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530126.645299:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007b76f7f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946854592:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 361us (618us total) trans 21474837383 rc 0/0 00000100:00100000:1.0:1651530126.645303:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 921 00000100:00100000:1.0:1651530126.764973:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530126.765003:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356266688 00000100:00100000:0.0:1651530126.765025:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 922 00000100:00100000:0.0:1651530126.765028:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000077d7b3f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+14:479273:x1731754356266688:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651530126.765036:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651530126.765045:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55c1f lrc: 2/0,0 mode: --/PW res: [0x2c09e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db30c84c expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651530126.765056:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c09e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651530126.765065:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530126.765066:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530126.765070:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55c1f lrc: 3/0,0 mode: PW/PW res: [0x2c09e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c84c expref: 15 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530126.765077:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55c1f lrc: 3/0,0 mode: PW/PW res: [0x2c09e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c84c expref: 15 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530126.765083:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000092ad010c, rc 0) 00000100:00100000:0.0:1651530126.765108:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000077d7b3f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+15:479273:x1731754356266688:12345-10.240.43.64@tcp:101:dd.0 Request processed in 80us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530126.765112:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 922 00000100:00100000:0.0:1651530126.996276:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530126.996771:0:176086:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356266944 00002000:00100000:1.0:1651530126.996793:0:176086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2c09e:0x0] (0->16383) req@000000000c84c6c8 x1731754356266944/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:97/0 lens 16872/0 e 0 to 0 dl 1651530132 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:1.0:1651530126.996800:0:176086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000c84c6c8 with x1731754356266944 ext(0->16383) 00002000:00010000:1.0:1651530126.996802:0:176086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000000c84c6c8 00000100:00100000:1.0:1651530126.996819:0:176086:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 88 00000100:00100000:1.0:1651530126.996822:0:176086:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000c84c6c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+15:438149:x1731754356266944:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:1.0:1651530126.997314:0:176086:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000c84c6c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+17:438149:x1731754356266944:12345-10.240.43.64@tcp:4:dd.0 Request processed in 491us (1040us total) trans 21474837384 rc 0/0 00000100:00100000:1.0:1651530126.997319:0:176086:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 88 00002000:00100000:1.0:1651530126.997322:0:176086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2c09e:0x0] (0->16383) req@000000000c84c6c8 x1731754356266944/t21474837384(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:97/0 lens 16872/448 e 0 to 0 dl 1651530132 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:1.0:1651530126.997327:0:176086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000c84c6c8 with x1731754356266944 ext(0->16383) 00002000:00010000:1.0:1651530126.997329:0:176086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000000c84c6c8 00000100:00100000:0.0:1651530126.997603:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530126.997627:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356267008 00000100:00100000:1.0:1651530126.997641:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 18 00000100:00100000:1.0:1651530126.997643:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051722b91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+17:451154:x1731754356267008:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651530126.997648:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1651530126.997653:0:169267:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2c09e:0x0] updating lvb size from disk: 0 -> 16384 00002000:00010000:1.0:1651530126.997655:0:169267:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2c09e:0x0] updating lvb mtime from disk: 0 -> 1651530126 00002000:00010000:1.0:1651530126.997656:0:169267:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2c09e:0x0] updating lvb ctime from disk: 0 -> 1651530126 00002000:00010000:1.0:1651530126.997657:0:169267:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2c09e:0x0] updating lvb blocks from disk: 0 -> 32 00010000:00010000:1.0:1651530126.997667:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092ad010c/0x3234de053c55c1f lrc: 0/0,0 mode: --/PW res: [0x2c09e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c84c expref: 17 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530126.997676:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651530126.997687:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051722b91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+16:451154:x1731754356267008:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 44us (85us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530126.997690:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 18 00000100:00100000:0.0:1651530127.004974:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530127.004985:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356267328 00000100:00100000:0.0:1651530127.005003:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 923 00000100:00100000:0.0:1651530127.005006:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+16:438147:x1731754356267328:12345-10.240.43.64@tcp:101:cat.0 00010000:00010000:0.0:1651530127.005011:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651530127.005018:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c55c26 lrc: 2/0,0 mode: --/PR res: [0x2c09e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db30c861 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651530127.005026:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c09e:0x0] initial LVB size: 16384, mtime: 0x6270598e, atime: 0x0, ctime: 0x6270598e, blocks: 0x20 00010000:00010000:0.0:1651530127.005032:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530127.005033:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530127.005037:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c55c26 lrc: 3/0,0 mode: PR/PR res: [0x2c09e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c861 expref: 17 pid: 166111 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530127.005044:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c55c26 lrc: 3/0,0 mode: PR/PR res: [0x2c09e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c861 expref: 17 pid: 166111 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530127.005049:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008393c644, rc 0) 00000100:00100000:0.0:1651530127.005066:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097928145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+17:438147:x1731754356267328:12345-10.240.43.64@tcp:101:cat.0 Request processed in 59us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530127.005069:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 923 00000100:00100000:0.0:1651530127.007049:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530127.007069:0:176086:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356267456 00002000:00100000:1.0:1651530127.007077:0:176086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2c09e:0x0] (0->4194303) req@000000002b1deba8 x1731754356267456/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:98/0 lens 488/0 e 0 to 0 dl 1651530133 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cat.0' 00002000:00100000:1.0:1651530127.007082:0:176086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002b1deba8 with x1731754356267456 ext(0->4194303) 00002000:00010000:1.0:1651530127.007083:0:176086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000002b1deba8 00000100:00100000:1.0:1651530127.007094:0:176086:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 89 00000100:00100000:1.0:1651530127.007096:0:176086:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+17:438146:x1731754356267456:12345-10.240.43.64@tcp:3:cat.0 00000100:00100000:1.0:1651530127.007515:0:176086:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002b1deba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+17:438146:x1731754356267456:12345-10.240.43.64@tcp:3:cat.0 Request processed in 418us (465us total) trans 0 rc 16384/16384 00000100:00100000:1.0:1651530127.007519:0:176086:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 89 00002000:00100000:1.0:1651530127.007521:0:176086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2c09e:0x0] (0->4194303) req@000000002b1deba8 x1731754356267456/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:98/0 lens 488/440 e 0 to 0 dl 1651530133 ref 1 fl Complete:/0/0 rc 16384/16384 job:'cat.0' 00002000:00100000:1.0:1651530127.007525:0:176086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002b1deba8 with x1731754356267456 ext(0->4194303) 00002000:00010000:1.0:1651530127.007527:0:176086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000002b1deba8 00000400:00000080:1.0:1651530127.536675:0:177667:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651530127.536678:0:177667:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: Turn on read and write cache 00000100:00100000:1.0:1651530127.815557:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530127.815575:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356268288 00000100:00100000:1.0:1651530127.815599:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 19 00000100:00100000:1.0:1651530127.815601:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008f80e18b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+17:454981:x1731754356268288:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651530127.815609:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651530127.815630:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008393c644/0x3234de053c55c26 lrc: 0/0,0 mode: --/PR res: [0x2c09e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c861 expref: 17 pid: 166111 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530127.815640:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651530127.815663:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008f80e18b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+16:454981:x1731754356268288:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 61us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530127.815667:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 19 00000400:00000080:0.0:1651530128.380165:0:177829:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530128.380168:0:177829:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: Write data and read it back. 00000400:00000080:0.0:1651530128.831079:0:177883:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530128.831082:0:177883:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: Read should be satisfied from the cache. 00000100:00100000:1.0:1651530128.852293:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530128.852336:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356268480 00000100:00100000:0.0:1651530128.852386:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 924 00000100:00100000:0.0:1651530128.852389:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004237e3f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+16:479915:x1731754356268480:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651530128.852403:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651530128.852433:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c55c2d lrc: 2/0,0 mode: --/PW res: [0x2c09f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db30c87d expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651530128.852463:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c09f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651530128.852474:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530128.852475:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530128.852480:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c55c2d lrc: 3/0,0 mode: PW/PW res: [0x2c09f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c87d expref: 17 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530128.852489:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c55c2d lrc: 3/0,0 mode: PW/PW res: [0x2c09f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c87d expref: 17 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530128.852494:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000d8e6a5e, rc 0) 00000100:00100000:0.0:1651530128.852518:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004237e3f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+17:479915:x1731754356268480:12345-10.240.43.64@tcp:101:dd.0 Request processed in 129us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530128.852522:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 924 00000100:00100000:1.0:1651530129.124531:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530129.124563:0:176086:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356268672 00002000:00100000:0.0:1651530129.124598:0:176086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2c09f:0x0] (0->12287) req@0000000008e0501d x1731754356268672/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:100/0 lens 12776/0 e 0 to 0 dl 1651530135 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651530129.124608:0:176086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000008e0501d with x1731754356268672 ext(0->12287) 00002000:00010000:0.0:1651530129.124611:0:176086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000008e0501d 00000100:00100000:0.0:1651530129.124623:0:176086:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 90 00000100:00100000:0.0:1651530129.124626:0:176086:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008e0501d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+17:438149:x1731754356268672:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651530129.125085:0:176086:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008e0501d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+19:438149:x1731754356268672:12345-10.240.43.64@tcp:4:dd.0 Request processed in 458us (556us total) trans 21474837385 rc 0/0 00000100:00100000:0.0:1651530129.125097:0:176086:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 90 00002000:00100000:0.0:1651530129.125101:0:176086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2c09f:0x0] (0->12287) req@0000000008e0501d x1731754356268672/t21474837385(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:100/0 lens 12776/448 e 0 to 0 dl 1651530135 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651530129.125105:0:176086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000008e0501d with x1731754356268672 ext(0->12287) 00002000:00010000:0.0:1651530129.125106:0:176086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000008e0501d 00000100:00100000:1.0:1651530129.125423:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530129.125434:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356268736 00000100:00100000:1.0:1651530129.125470:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 20 00000100:00100000:1.0:1651530129.125472:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f99d9ea1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+19:451154:x1731754356268736:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651530129.125478:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1651530129.125489:0:169267:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2c09f:0x0] updating lvb size from disk: 0 -> 12288 00002000:00010000:1.0:1651530129.125490:0:169267:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2c09f:0x0] updating lvb mtime from disk: 0 -> 1651530128 00002000:00010000:1.0:1651530129.125491:0:169267:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2c09f:0x0] updating lvb ctime from disk: 0 -> 1651530128 00002000:00010000:1.0:1651530129.125492:0:169267:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2c09f:0x0] updating lvb blocks from disk: 0 -> 24 00010000:00010000:1.0:1651530129.125504:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d8e6a5e/0x3234de053c55c2d lrc: 0/0,0 mode: --/PW res: [0x2c09f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c87d expref: 19 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530129.125513:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651530129.125527:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f99d9ea1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+18:451154:x1731754356268736:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 54us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530129.125531:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 20 00000100:00100000:1.0:1651530129.132830:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530129.132857:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356269056 00000100:00100000:0.0:1651530129.132872:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 925 00000100:00100000:0.0:1651530129.132874:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bf4022bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+18:438146:x1731754356269056:12345-10.240.43.64@tcp:101:cat.0 00010000:00010000:0.0:1651530129.132879:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651530129.132894:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c55c34 lrc: 2/0,0 mode: --/PR res: [0x2c09f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db30c892 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651530129.132901:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c09f:0x0] initial LVB size: 12288, mtime: 0x62705990, atime: 0x0, ctime: 0x62705990, blocks: 0x18 00010000:00010000:0.0:1651530129.132907:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530129.132908:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530129.132911:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c55c34 lrc: 3/0,0 mode: PR/PR res: [0x2c09f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c892 expref: 19 pid: 166111 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530129.132918:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c55c34 lrc: 3/0,0 mode: PR/PR res: [0x2c09f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c892 expref: 19 pid: 166111 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530129.132923:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004cff9fc3, rc 0) 00000100:00100000:0.0:1651530129.132936:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bf4022bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+19:438146:x1731754356269056:12345-10.240.43.64@tcp:101:cat.0 Request processed in 61us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530129.132939:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 925 00000100:00100000:1.0:1651530129.134859:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530129.134882:0:176086:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356269184 00002000:00100000:0.0:1651530129.134891:0:176086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2c09f:0x0] (0->4194303) req@00000000cebf7380 x1731754356269184/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:100/0 lens 488/0 e 0 to 0 dl 1651530135 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cat.0' 00002000:00100000:0.0:1651530129.134895:0:176086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000cebf7380 with x1731754356269184 ext(0->4194303) 00002000:00010000:0.0:1651530129.134896:0:176086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000cebf7380 00000100:00100000:0.0:1651530129.134902:0:176086:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 91 00000100:00100000:0.0:1651530129.134904:0:176086:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cebf7380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+19:438147:x1731754356269184:12345-10.240.43.64@tcp:3:cat.0 00000100:00100000:0.0:1651530129.135692:0:176086:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cebf7380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+19:438147:x1731754356269184:12345-10.240.43.64@tcp:3:cat.0 Request processed in 786us (833us total) trans 0 rc 12288/12288 00000100:00100000:0.0:1651530129.135696:0:176086:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 91 00002000:00100000:0.0:1651530129.135698:0:176086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2c09f:0x0] (0->4194303) req@00000000cebf7380 x1731754356269184/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:100/0 lens 488/440 e 0 to 0 dl 1651530135 ref 1 fl Complete:/0/0 rc 12288/12288 job:'cat.0' 00002000:00100000:0.0:1651530129.135702:0:176086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000cebf7380 with x1731754356269184 ext(0->4194303) 00002000:00010000:0.0:1651530129.135704:0:176086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000cebf7380 00000001:00080000:0.0:1651530129.149446:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474837385 is committed 00000001:00080000:0.0:1651530129.149455:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474837383 is committed 00000400:00000080:1.0:1651530129.689710:0:178045:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651530129.689713:0:178045:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: cache hits: before: 8237, after: 8240 00000400:00000080:0.0:1651530129.998121:0:178099:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530129.998124:0:178099:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: Read again; it should be satisfied from the cache. 00000100:00100000:0.0:1651530130.019174:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530130.019201:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356269376 00000100:00100000:1.0:1651530130.019251:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 21 00000100:00100000:1.0:1651530130.019254:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:454981:x1731754356269376:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651530130.019262:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651530130.019284:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cff9fc3/0x3234de053c55c34 lrc: 0/0,0 mode: --/PR res: [0x2c09f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c892 expref: 6 pid: 166111 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530130.019294:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651530130.019316:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+5:454981:x1731754356269376:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 62us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530130.019320:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 21 00000100:00100000:0.0:1651530130.026207:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530130.026220:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356269568 00000100:00100000:0.0:1651530130.026249:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 926 00000100:00100000:0.0:1651530130.026252:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000035f3f4bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+5:438149:x1731754356269568:12345-10.240.43.64@tcp:101:cat.0 00010000:00010000:0.0:1651530130.026259:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651530130.026267:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c55c3b lrc: 2/0,0 mode: --/PR res: [0x2c09f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db30c8a0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651530130.026285:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c09f:0x0] initial LVB size: 12288, mtime: 0x62705990, atime: 0x0, ctime: 0x62705990, blocks: 0x18 00010000:00010000:0.0:1651530130.026292:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530130.026293:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530130.026296:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c55c3b lrc: 3/0,0 mode: PR/PR res: [0x2c09f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c8a0 expref: 6 pid: 166111 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530130.026303:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c55c3b lrc: 3/0,0 mode: PR/PR res: [0x2c09f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c8a0 expref: 6 pid: 166111 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530130.026309:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b5173ced, rc 0) 00000100:00100000:0.0:1651530130.026333:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000035f3f4bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438149:x1731754356269568:12345-10.240.43.64@tcp:101:cat.0 Request processed in 79us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530130.026336:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 926 00000100:00100000:0.0:1651530130.029406:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530130.029416:0:176086:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356269760 00002000:00100000:0.0:1651530130.029427:0:176086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2c09f:0x0] (0->4194303) req@0000000017e3b33f x1731754356269760/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:101/0 lens 488/0 e 0 to 0 dl 1651530136 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cat.0' 00002000:00100000:0.0:1651530130.029432:0:176086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000017e3b33f with x1731754356269760 ext(0->4194303) 00002000:00010000:0.0:1651530130.029434:0:176086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000017e3b33f 00000100:00100000:0.0:1651530130.029446:0:176086:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 92 00000100:00100000:0.0:1651530130.029448:0:176086:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017e3b33f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438148:x1731754356269760:12345-10.240.43.64@tcp:3:cat.0 00000100:00100000:0.0:1651530130.029952:0:176086:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017e3b33f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438148:x1731754356269760:12345-10.240.43.64@tcp:3:cat.0 Request processed in 502us (545us total) trans 0 rc 12288/12288 00000100:00100000:0.0:1651530130.029955:0:176086:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 92 00002000:00100000:0.0:1651530130.029958:0:176086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2c09f:0x0] (0->4194303) req@0000000017e3b33f x1731754356269760/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:101/0 lens 488/440 e 0 to 0 dl 1651530136 ref 1 fl Complete:/0/0 rc 12288/12288 job:'cat.0' 00002000:00100000:0.0:1651530130.029962:0:176086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000017e3b33f with x1731754356269760 ext(0->4194303) 00002000:00010000:0.0:1651530130.029964:0:176086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000017e3b33f 00000100:00100000:1.0:1651530131.681292:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530131.681317:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946854720 00000100:00100000:1.0:1651530131.681343:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 99 00000100:00100000:1.0:1651530131.681345:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b0f16d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946854720:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651530131.681367:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 258242368 pending 0 free 81307959296 avail 77137248256 00000100:00100000:1.0:1651530131.681405:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b0f16d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946854720:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 59us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530131.681409:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 99 00000400:00000080:0.0:1651530131.790638:0:178207:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530131.790640:0:178207:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: cache hits:: before: 8240, after: 8243 00000400:00000080:0.0:1651530132.095479:0:178261:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530132.095481:0:178261:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: Turn off the read cache and turn on the write cache 00000100:00100000:1.0:1651530132.377331:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530132.377350:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356269952 00000100:00100000:1.0:1651530132.377379:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 22 00000100:00100000:1.0:1651530132.377381:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000471073f9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:451155:x1731754356269952:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1651530132.377389:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651530132.377410:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5173ced/0x3234de053c55c3b lrc: 0/0,0 mode: --/PR res: [0x2c09f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c8a0 expref: 6 pid: 166111 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530132.377419:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651530132.377443:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000471073f9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+5:451155:x1731754356269952:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 61us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530132.377447:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 22 00000400:00000080:1.0:1651530132.941120:0:178423:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651530132.941122:0:178423:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: Read again; it should be satisfied from the cache. 00000100:00100000:1.0:1651530133.239107:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530133.239142:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356270208 00000100:00100000:0.0:1651530133.239168:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 927 00000100:00100000:0.0:1651530133.239171:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091d23b68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+5:438147:x1731754356270208:12345-10.240.43.64@tcp:101:cat.0 00010000:00010000:0.0:1651530133.239181:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651530133.239192:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c55c42 lrc: 2/0,0 mode: --/PR res: [0x2c09f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db30c8ae expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651530133.239203:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c09f:0x0] initial LVB size: 12288, mtime: 0x62705990, atime: 0x0, ctime: 0x62705990, blocks: 0x18 00010000:00010000:0.0:1651530133.239212:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530133.239213:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530133.239217:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c55c42 lrc: 3/0,0 mode: PR/PR res: [0x2c09f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c8ae expref: 6 pid: 166111 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530133.239240:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c55c42 lrc: 3/0,0 mode: PR/PR res: [0x2c09f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c8ae expref: 6 pid: 166111 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530133.239246:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000eca832be, rc 0) 00000100:00100000:0.0:1651530133.239270:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091d23b68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438147:x1731754356270208:12345-10.240.43.64@tcp:101:cat.0 Request processed in 99us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530133.239273:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 927 00000100:00100000:1.0:1651530133.241324:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530133.241344:0:176086:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356270336 00002000:00100000:0.0:1651530133.241357:0:176086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2c09f:0x0] (0->4194303) req@0000000051722b91 x1731754356270336/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:104/0 lens 488/0 e 0 to 0 dl 1651530139 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cat.0' 00002000:00100000:0.0:1651530133.241362:0:176086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000051722b91 with x1731754356270336 ext(0->4194303) 00002000:00010000:0.0:1651530133.241364:0:176086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000051722b91 00000100:00100000:0.0:1651530133.241377:0:176086:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 93 00000100:00100000:0.0:1651530133.241378:0:176086:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051722b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438146:x1731754356270336:12345-10.240.43.64@tcp:3:cat.0 00000100:00100000:0.0:1651530133.241865:0:176086:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051722b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438146:x1731754356270336:12345-10.240.43.64@tcp:3:cat.0 Request processed in 485us (542us total) trans 0 rc 12288/12288 00000100:00100000:0.0:1651530133.241870:0:176086:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 93 00002000:00100000:0.0:1651530133.241872:0:176086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2c09f:0x0] (0->4194303) req@0000000051722b91 x1731754356270336/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:104/0 lens 488/440 e 0 to 0 dl 1651530139 ref 1 fl Complete:/0/0 rc 12288/12288 job:'cat.0' 00002000:00100000:0.0:1651530133.241877:0:176086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000051722b91 with x1731754356270336 ext(0->4194303) 00002000:00010000:0.0:1651530133.241878:0:176086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000051722b91 00000400:00000080:0.0:1651530133.800652:0:178585:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530133.800655:0:178585:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: cache hits:: before: 8243, after: 8246 00000400:00000080:1.0:1651530134.110726:0:178639:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651530134.110729:0:178639:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: Write data and read it back. 00000400:00000080:0.0:1651530134.412569:0:178693:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530134.412572:0:178693:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: Read should be satisfied from the cache. 00000100:00100000:0.0:1651530134.432462:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530134.432480:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356271040 00000100:00100000:0.0:1651530134.432504:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 928 00000100:00100000:0.0:1651530134.432507:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+6:481534:x1731754356271040:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:0.0:1651530134.432517:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651530134.432527:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c55c49 lrc: 2/0,0 mode: --/PW res: [0x2c09f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db30c8c3 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530134.432553:0:166111:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c55c42 lrc: 2/0,0 mode: PR/PR res: [0x2c09f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c8ae expref: 7 pid: 166111 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530134.432557:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530134.432558:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530134.432559:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c55c49 lrc: 4/0,0 mode: --/PW res: [0x2c09f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c8c3 expref: 7 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530134.432578:0:166111:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c55c42 lrc: 3/0,0 mode: PR/PR res: [0x2c09f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c8ae expref: 7 pid: 166111 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530134.432583:0:166111:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c55c42 lrc: 4/0,0 mode: PR/PR res: [0x2c09f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c8ae expref: 7 pid: 166111 timeout: 20943 lvb_type: 1 00000100:00100000:0.0:1651530134.432589:0:166111:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000076d5f96b pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:166111:1731745997089024:10.240.43.64@tcp:104: 00000100:00100000:0.0:1651530134.432620:0:166111:0:(client.c:2492:ptlrpc_set_wait()) set 0000000084fc8fcf going to sleep for 6 seconds 00000100:00100000:0.0:1651530134.432849:0:166111:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000076d5f96b pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:166111:1731745997089024:10.240.43.64@tcp:104: 00010000:00010000:0.0:1651530134.432857:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c55c49 lrc: 3/0,0 mode: --/PW res: [0x2c09f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c8c3 expref: 7 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530134.432864:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d6999e11, rc 0) 00000100:00100000:0.0:1651530134.432883:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004534b316 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+7:481534:x1731754356271040:12345-10.240.43.64@tcp:101:dd.0 Request processed in 375us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530134.432887:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 928 00000100:00100000:0.0:1651530134.434077:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530134.434099:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356271104 00010000:00010000:1.0:1651530134.434110:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c55c42 lrc: 4/0,0 mode: PR/PR res: [0x2c09f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c8ae expref: 7 pid: 166111 timeout: 20943 lvb_type: 1 00000100:00100000:1.0:1651530134.434129:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 22 00000100:00100000:1.0:1651530134.434131:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438149:x1731754356271104:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1651530134.434143:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1651530134.434146:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c55c42 lrc: 4/0,0 mode: PR/PR res: [0x2c09f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c8ae expref: 7 pid: 166111 timeout: 20943 lvb_type: 1 00010000:00010000:1.0:1651530134.434154:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c55c42 lrc: 3/0,0 mode: PR/PR res: [0x2c09f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c8ae expref: 7 pid: 166111 timeout: 20943 lvb_type: 1 00010000:00010000:1.0:1651530134.434164:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eca832be/0x3234de053c55c42 lrc: 0/0,0 mode: --/PR res: [0x2c09f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c8ae expref: 7 pid: 166111 timeout: 20943 lvb_type: 1 00010000:00010000:1.0:1651530134.434169:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530134.434170:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530134.434171:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c55c49 lrc: 2/0,0 mode: PW/PW res: [0x2c09f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c8c3 expref: 6 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530134.434175:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c55c49 lrc: 3/0,0 mode: PW/PW res: [0x2c09f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c8c3 expref: 6 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530134.434200:0:166104:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c55c49 lrc: 3/0,0 mode: PW/PW res: [0x2c09f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c8c3 expref: 6 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530134.434204:0:166104:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000009c4c564 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:166104:1731745997089088:10.240.43.64@tcp:105: 00000100:00100000:1.0:1651530134.434221:0:166104:0:(client.c:2492:ptlrpc_set_wait()) set 000000004feb0064 going to sleep for 6 seconds 00000100:00100000:1.0:1651530134.434470:0:166104:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000009c4c564 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:166104:1731745997089088:10.240.43.64@tcp:105: 00010000:00010000:1.0:1651530134.434476:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651530134.434486:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438149:x1731754356271104:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 354us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530134.434489:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 22 00000100:00100000:0.0:1651530134.434552:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530134.434562:0:176086:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356271168 00002000:00010000:0.0:1651530134.434571:0:176086:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 180383/0 (0->18446744073709551615) 00002000:00100000:0.0:1651530134.434572:0:176086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e30915ad with x1731754356271168 ext(0->18446744073709551615) 00002000:00010000:0.0:1651530134.434576:0:176086:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000e30915ad. 00000100:00100000:0.0:1651530134.434589:0:176086:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 94 00000100:00100000:0.0:1651530134.434591:0:176086:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e30915ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438146:x1731754356271168:12345-10.240.43.64@tcp:10:dd.0 00002000:00010000:0.0:1651530134.435013:0:176086:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2c09f:0x0] updating lvb size from disk: 12288 -> 0 00002000:00010000:0.0:1651530134.435015:0:176086:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2c09f:0x0] updating lvb mtime from disk: 1651530128 -> 1651530134 00002000:00010000:0.0:1651530134.435016:0:176086:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x2c09f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1651530134.435017:0:176086:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2c09f:0x0] updating lvb ctime from disk: 1651530128 -> 1651530134 00002000:00010000:0.0:1651530134.435018:0:176086:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2c09f:0x0] updating lvb blocks from disk: 24 -> 0 00000100:00100000:0.0:1651530134.435036:0:176086:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e30915ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438146:x1731754356271168:12345-10.240.43.64@tcp:10:dd.0 Request processed in 444us (485us total) trans 21474837386 rc 0/0 00000100:00100000:0.0:1651530134.435039:0:176086:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 94 00002000:00010000:0.0:1651530134.435041:0:176086:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 180383/0 (0->18446744073709551615) 00002000:00100000:0.0:1651530134.435042:0:176086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e30915ad with x1731754356271168 ext(0->18446744073709551615) 00002000:00010000:0.0:1651530134.435044:0:176086:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000e30915ad. 00000100:00100000:0.0:1651530134.710104:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530134.710122:0:176086:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356271232 00002000:00100000:0.0:1651530134.710154:0:176086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2c09f:0x0] (0->12287) req@00000000be0ace91 x1731754356271232/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:105/0 lens 12776/0 e 0 to 0 dl 1651530140 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651530134.710160:0:176086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000be0ace91 with x1731754356271232 ext(0->12287) 00002000:00010000:0.0:1651530134.710163:0:176086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000be0ace91 00000100:00100000:0.0:1651530134.710178:0:176086:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 95 00000100:00100000:0.0:1651530134.710180:0:176086:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438148:x1731754356271232:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651530134.710535:0:176086:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be0ace91 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438148:x1731754356271232:12345-10.240.43.64@tcp:4:dd.0 Request processed in 353us (433us total) trans 21474837387 rc 0/0 00000100:00100000:0.0:1651530134.710540:0:176086:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 95 00002000:00100000:0.0:1651530134.710543:0:176086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2c09f:0x0] (0->12287) req@00000000be0ace91 x1731754356271232/t21474837387(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:105/0 lens 12776/448 e 0 to 0 dl 1651530140 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651530134.710548:0:176086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000be0ace91 with x1731754356271232 ext(0->12287) 00002000:00010000:0.0:1651530134.710549:0:176086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000be0ace91 00000100:00100000:0.0:1651530134.710876:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530134.710897:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356271296 00000100:00100000:1.0:1651530134.710919:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 23 00000100:00100000:1.0:1651530134.710921:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+9:451154:x1731754356271296:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1651530134.710927:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1651530134.710933:0:166104:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2c09f:0x0] updating lvb size from disk: 0 -> 12288 00002000:00010000:1.0:1651530134.710934:0:166104:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2c09f:0x0] updating lvb blocks from disk: 0 -> 24 00010000:00010000:1.0:1651530134.710946:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6999e11/0x3234de053c55c49 lrc: 0/0,0 mode: --/PW res: [0x2c09f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c8c3 expref: 9 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530134.710955:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1651530134.710968:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+8:451154:x1731754356271296:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 47us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530134.710971:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 23 00000100:00100000:0.0:1651530134.719055:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530134.719065:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356271744 00000100:00100000:0.0:1651530134.719081:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 929 00000100:00100000:0.0:1651530134.719083:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000020362888 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438148:x1731754356271744:12345-10.240.43.64@tcp:101:cat.0 00010000:00010000:0.0:1651530134.719088:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651530134.719095:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c55c50 lrc: 2/0,0 mode: --/PR res: [0x2c09f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db30c8d8 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651530134.719102:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c09f:0x0] initial LVB size: 12288, mtime: 0x62705996, atime: 0x0, ctime: 0x62705996, blocks: 0x18 00010000:00010000:0.0:1651530134.719109:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530134.719110:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530134.719113:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c55c50 lrc: 3/0,0 mode: PR/PR res: [0x2c09f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c8d8 expref: 9 pid: 166111 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530134.719120:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c55c50 lrc: 3/0,0 mode: PR/PR res: [0x2c09f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c8d8 expref: 9 pid: 166111 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530134.719125:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000721302df, rc 0) 00000100:00100000:0.0:1651530134.719148:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000020362888 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438148:x1731754356271744:12345-10.240.43.64@tcp:101:cat.0 Request processed in 63us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530134.719151:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 929 00000100:00100000:0.0:1651530134.721003:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530134.721011:0:176086:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356271872 00002000:00100000:0.0:1651530134.721019:0:176086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2c09f:0x0] (0->4194303) req@000000005529fd8d x1731754356271872/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:105/0 lens 488/0 e 0 to 0 dl 1651530140 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cat.0' 00002000:00100000:0.0:1651530134.721023:0:176086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005529fd8d with x1731754356271872 ext(0->4194303) 00002000:00010000:0.0:1651530134.721025:0:176086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000005529fd8d 00000100:00100000:0.0:1651530134.721036:0:176086:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 96 00000100:00100000:0.0:1651530134.721038:0:176086:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005529fd8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438149:x1731754356271872:12345-10.240.43.64@tcp:3:cat.0 00000100:00100000:0.0:1651530134.721501:0:176086:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005529fd8d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438149:x1731754356271872:12345-10.240.43.64@tcp:3:cat.0 Request processed in 462us (498us total) trans 0 rc 12288/12288 00000100:00100000:0.0:1651530134.721506:0:176086:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 96 00002000:00100000:0.0:1651530134.721508:0:176086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2c09f:0x0] (0->4194303) req@000000005529fd8d x1731754356271872/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:105/0 lens 488/440 e 0 to 0 dl 1651530140 ref 1 fl Complete:/0/0 rc 12288/12288 job:'cat.0' 00002000:00100000:0.0:1651530134.721512:0:176086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005529fd8d with x1731754356271872 ext(0->4194303) 00002000:00010000:0.0:1651530134.721514:0:176086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000005529fd8d 00000400:00000080:1.0:1651530135.279710:0:178855:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651530135.279713:0:178855:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: cache hits:: before: 8246, after: 8249 00000400:00000080:0.0:1651530135.594634:0:178909:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530135.594636:0:178909:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: Turn off read and write cache 00000100:00100000:0.0:1651530135.873401:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530135.873418:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356271936 00000100:00100000:0.0:1651530135.873440:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 24 00000100:00100000:0.0:1651530135.873442:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5ebc6ba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+9:454981:x1731754356271936:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651530135.873450:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651530135.873481:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c55c50 lrc: 0/0,0 mode: --/PR res: [0x2c09f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c8d8 expref: 9 pid: 166111 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530135.873491:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651530135.873516:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5ebc6ba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+8:454981:x1731754356271936:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 73us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530135.873520:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 24 00000400:00000080:0.0:1651530136.434931:0:179071:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530136.434934:0:179071:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: Write data and read it back 00000400:00000080:0.0:1651530136.743154:0:179125:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530136.743157:0:179125:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: It should not be satisfied from the cache. 00000100:00100000:0.0:1651530136.765078:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530136.765095:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356272000 00000100:00100000:0.0:1651530136.765119:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 930 00000100:00100000:0.0:1651530136.765122:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0bff89e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438149:x1731754356272000:12345-10.240.43.64@tcp:101:rm.0 00010000:00010000:0.0:1651530136.765132:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651530136.765151:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c55c57 lrc: 2/0,0 mode: --/PR res: [0x2c09f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db30c8df expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651530136.765164:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c09f:0x0] initial LVB size: 12288, mtime: 0x62705996, atime: 0x0, ctime: 0x62705996, blocks: 0x18 00010000:00010000:0.0:1651530136.765173:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530136.765174:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530136.765179:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c55c57 lrc: 3/0,0 mode: PR/PR res: [0x2c09f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c8df expref: 9 pid: 166111 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530136.765187:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c55c57 lrc: 3/0,0 mode: PR/PR res: [0x2c09f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c8df expref: 9 pid: 166111 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530136.765206:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000721302df, rc 0) 00000100:00100000:0.0:1651530136.765240:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0bff89e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438149:x1731754356272000:12345-10.240.43.64@tcp:101:rm.0 Request processed in 117us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530136.765244:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 930 00000100:00100000:0.0:1651530136.775662:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530136.775673:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356272768 00000100:00100000:0.0:1651530136.775685:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 25 00000100:00100000:0.0:1651530136.775687:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ca77fad9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+9:451155:x1731754356272768:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651530136.775692:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651530136.775702:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c55c57 lrc: 0/0,0 mode: --/PR res: [0x2c09f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c8df expref: 9 pid: 166111 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530136.775708:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651530136.775725:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ca77fad9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+8:451155:x1731754356272768:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 37us (64us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530136.775728:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 25 00000100:00100000:0.0:1651530136.792203:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651530136.792212:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946854976 00000100:00100000:0.0:1651530136.792239:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 931 00000100:00100000:0.0:1651530136.792240:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5ebc6ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946854976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651530136.792250:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180382 count 1 00002000:00010000:0.0:1651530136.792271:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c09e:0x0] initial LVB size: 16384, mtime: 0x6270598e, atime: 0x0, ctime: 0x6270598e, blocks: 0x20 00010000:00010000:0.0:1651530136.792274:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c55c5e lrc: 3/0,1 mode: --/PW res: [0x2c09e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530136.792282:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530136.792282:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530136.792283:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c55c5e lrc: 3/0,1 mode: PW/PW res: [0x2c09e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530136.792288:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c55c5e lrc: 3/0,1 mode: PW/PW res: [0x2c09e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530136.792292:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c55c5e lrc: 3/0,1 mode: PW/PW res: [0x2c09e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530136.792295:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c55c5e lrc: 2/0,0 mode: PW/PW res: [0x2c09e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530136.792321:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c55c5e lrc: 2/0,0 mode: PW/PW res: [0x2c09e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530136.792328:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000721302df already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651530136.792329:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c55c5e lrc: 2/0,0 mode: PW/PW res: [0x2c09e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530136.792334:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c55c5e lrc: 3/0,0 mode: PW/PW res: [0x2c09e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530136.792341:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c55c5e lrc: 1/0,0 mode: --/PW res: [0x2c09e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530136.792344:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000721302df/0x3234de053c55c5e lrc: 0/0,0 mode: --/PW res: [0x2c09e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651530136.792624:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5ebc6ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946854976:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 382us (421us total) trans 21474837388 rc 0/0 00000100:00100000:0.0:1651530136.792628:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 931 00000100:00100000:0.0:1651530136.800232:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530136.800273:0:166115:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946855040 00000100:00100000:1.0:1651530136.800296:0:166115:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 100 00000100:00100000:1.0:1651530136.800298:0:166115:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003132c0c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946855040:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651530136.800309:0:166115:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 266680128 pending 36864 free 81307975680 avail 77137264640 00000100:00100000:1.0:1651530136.800325:0:166115:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003132c0c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946855040:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 26us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530136.800328:0:166115:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 100 00000400:00000080:0.0:1651530137.610609:0:179287:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530137.610612:0:179287:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: cache hits:: before: 8249, after: 8249 00000400:00000080:0.0:1651530137.912607:0:179341:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530137.912610:0:179341:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: Turn on the read cache and turn off the write cache 00000400:00000080:1.0:1651530138.753771:0:179503:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651530138.753774:0:179503:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: Write data and read it back 00000400:00000080:0.0:1651530139.066935:0:179557:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530139.066938:0:179557:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: It should not be satisfied from the cache. 00000100:00100000:0.0:1651530139.084565:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530139.084591:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356273792 00000100:00100000:1.0:1651530139.084613:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 932 00000100:00100000:1.0:1651530139.084615:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f99d9ea1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+8:483217:x1731754356273792:12345-10.240.43.64@tcp:101:dd.0 00010000:00010000:1.0:1651530139.084625:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651530139.084658:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55c65 lrc: 2/0,0 mode: --/PW res: [0x2c0a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db30c917 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530139.084670:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0a0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530139.084680:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530139.084681:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530139.084686:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55c65 lrc: 3/0,0 mode: PW/PW res: [0x2c0a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c917 expref: 9 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530139.084694:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55c65 lrc: 3/0,0 mode: PW/PW res: [0x2c0a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c917 expref: 9 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530139.084700:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001ea46bb1, rc 0) 00000100:00100000:1.0:1651530139.084724:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f99d9ea1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+9:483217:x1731754356273792:12345-10.240.43.64@tcp:101:dd.0 Request processed in 108us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530139.084728:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 932 00000001:00080000:0.0:1651530140.467073:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474837388 is committed 00000001:00080000:0.0:1651530140.467078:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474837387 is committed 00000100:00100000:0.0:1651530140.563317:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530140.563334:0:176086:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356274048 00002000:00100000:0.0:1651530140.563355:0:176086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2c0a0:0x0] (0->12287) req@00000000471073f9 x1731754356274048/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:111/0 lens 12776/0 e 0 to 0 dl 1651530146 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0' 00002000:00100000:0.0:1651530140.563362:0:176086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000471073f9 with x1731754356274048 ext(0->12287) 00002000:00010000:0.0:1651530140.563364:0:176086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000471073f9 00000100:00100000:0.0:1651530140.563380:0:176086:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 97 00000100:00100000:0.0:1651530140.563382:0:176086:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000471073f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438149:x1731754356274048:12345-10.240.43.64@tcp:4:dd.0 00000100:00100000:0.0:1651530140.563713:0:176086:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000471073f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438149:x1731754356274048:12345-10.240.43.64@tcp:4:dd.0 Request processed in 329us (397us total) trans 21474837389 rc 0/0 00000100:00100000:0.0:1651530140.563717:0:176086:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 97 00002000:00100000:0.0:1651530140.563720:0:176086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2c0a0:0x0] (0->12287) req@00000000471073f9 x1731754356274048/t21474837389(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:111/0 lens 12776/448 e 0 to 0 dl 1651530146 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0' 00002000:00100000:0.0:1651530140.563725:0:176086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000471073f9 with x1731754356274048 ext(0->12287) 00002000:00010000:0.0:1651530140.563727:0:176086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000471073f9 00000100:00100000:0.0:1651530140.563999:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530140.564010:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356274112 00000100:00100000:0.0:1651530140.564022:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 26 00000100:00100000:0.0:1651530140.564024:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+8:454981:x1731754356274112:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651530140.564029:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1651530140.564034:0:166104:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x2c0a0:0x0] updating lvb size from disk: 0 -> 12288 00002000:00010000:0.0:1651530140.564035:0:166104:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x2c0a0:0x0] updating lvb mtime from disk: 0 -> 1651530139 00002000:00010000:0.0:1651530140.564036:0:166104:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x2c0a0:0x0] updating lvb ctime from disk: 0 -> 1651530139 00002000:00010000:0.0:1651530140.564037:0:166104:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x2c0a0:0x0] updating lvb blocks from disk: 0 -> 24 00010000:00010000:0.0:1651530140.564048:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55c65 lrc: 0/0,0 mode: --/PW res: [0x2c0a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c917 expref: 8 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530140.564060:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651530140.564076:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fb0ec6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+7:454981:x1731754356274112:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 51us (78us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530140.564079:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 26 00000100:00100000:0.0:1651530140.571438:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530140.571458:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356274432 00000100:00100000:1.0:1651530140.571473:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 933 00000100:00100000:1.0:1651530140.571475:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438148:x1731754356274432:12345-10.240.43.64@tcp:101:cat.0 00010000:00010000:1.0:1651530140.571480:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651530140.571487:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55c6c lrc: 2/0,0 mode: --/PR res: [0x2c0a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db30c92c expref: -99 pid: 166113 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530140.571495:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0a0:0x0] initial LVB size: 12288, mtime: 0x6270599b, atime: 0x0, ctime: 0x6270599b, blocks: 0x18 00010000:00010000:1.0:1651530140.571502:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530140.571503:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530140.571506:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55c6c lrc: 3/0,0 mode: PR/PR res: [0x2c0a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c92c expref: 8 pid: 166113 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530140.571513:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55c6c lrc: 3/0,0 mode: PR/PR res: [0x2c0a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c92c expref: 8 pid: 166113 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530140.571518:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000062f8a534, rc 0) 00000100:00100000:1.0:1651530140.571532:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000076d5f96b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438148:x1731754356274432:12345-10.240.43.64@tcp:101:cat.0 Request processed in 56us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530140.571535:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 933 00000100:00100000:0.0:1651530140.573466:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530140.573474:0:176086:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356274560 00002000:00100000:0.0:1651530140.573481:0:176086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2c0a0:0x0] (0->4194303) req@0000000059363096 x1731754356274560/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:111/0 lens 488/0 e 0 to 0 dl 1651530146 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cat.0' 00002000:00100000:0.0:1651530140.573486:0:176086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000059363096 with x1731754356274560 ext(0->4194303) 00002000:00010000:0.0:1651530140.573487:0:176086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000059363096 00000100:00100000:0.0:1651530140.573498:0:176086:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 98 00000100:00100000:0.0:1651530140.573500:0:176086:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438148:x1731754356274560:12345-10.240.43.64@tcp:3:cat.0 00000100:00100000:0.0:1651530140.574451:0:176086:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059363096 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438148:x1731754356274560:12345-10.240.43.64@tcp:3:cat.0 Request processed in 950us (985us total) trans 0 rc 12288/12288 00000100:00100000:0.0:1651530140.574455:0:176086:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 98 00002000:00100000:0.0:1651530140.574458:0:176086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2c0a0:0x0] (0->4194303) req@0000000059363096 x1731754356274560/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:111/0 lens 488/440 e 0 to 0 dl 1651530146 ref 1 fl Complete:/0/0 rc 12288/12288 job:'cat.0' 00002000:00100000:0.0:1651530140.574462:0:176086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000059363096 with x1731754356274560 ext(0->4194303) 00002000:00010000:0.0:1651530140.574464:0:176086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000059363096 00000400:00000080:1.0:1651530141.130339:0:179719:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651530141.130342:0:179719:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: cache hits:: before: 8249, after: 8249 00000400:00000080:1.0:1651530141.438978:0:179773:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651530141.438981:0:179773:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: Read again; it should be satisfied from the cache. 00000100:00100000:1.0:1651530141.723276:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530141.723302:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356274752 00000100:00100000:0.0:1651530141.723328:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 27 00000100:00100000:0.0:1651530141.723330:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009c4c564 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+8:451155:x1731754356274752:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1651530141.723339:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651530141.723361:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55c6c lrc: 0/0,0 mode: --/PR res: [0x2c0a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c92c expref: 8 pid: 166113 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530141.723370:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651530141.723391:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009c4c564 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+7:451155:x1731754356274752:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 61us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530141.723395:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 27 00000100:00100000:1.0:1651530141.730331:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530141.730351:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356275008 00000100:00100000:0.0:1651530141.730367:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 934 00000100:00100000:0.0:1651530141.730369:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438146:x1731754356275008:12345-10.240.43.64@tcp:101:cat.0 00010000:00010000:0.0:1651530141.730376:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1651530141.730382:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c55c73 lrc: 2/0,0 mode: --/PR res: [0x2c0a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db30c93a expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1651530141.730389:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0a0:0x0] initial LVB size: 12288, mtime: 0x6270599b, atime: 0x0, ctime: 0x6270599b, blocks: 0x18 00010000:00010000:0.0:1651530141.730395:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530141.730396:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530141.730399:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c55c73 lrc: 3/0,0 mode: PR/PR res: [0x2c0a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c93a expref: 8 pid: 166111 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530141.730405:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c55c73 lrc: 3/0,0 mode: PR/PR res: [0x2c0a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c93a expref: 8 pid: 166111 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1651530141.730410:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e270377c, rc 0) 00000100:00100000:0.0:1651530141.730423:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438146:x1731754356275008:12345-10.240.43.64@tcp:101:cat.0 Request processed in 53us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530141.730436:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 934 00000100:00100000:1.0:1651530141.732292:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530141.732312:0:176086:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356275136 00002000:00100000:0.0:1651530141.732324:0:176086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2c0a0:0x0] (0->4194303) req@0000000021359a0e x1731754356275136/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:112/0 lens 488/0 e 0 to 0 dl 1651530147 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cat.0' 00002000:00100000:0.0:1651530141.732329:0:176086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000021359a0e with x1731754356275136 ext(0->4194303) 00002000:00010000:0.0:1651530141.732331:0:176086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000021359a0e 00000100:00100000:0.0:1651530141.732342:0:176086:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 99 00000100:00100000:0.0:1651530141.732344:0:176086:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000021359a0e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438147:x1731754356275136:12345-10.240.43.64@tcp:3:cat.0 00000100:00100000:0.0:1651530141.732773:0:176086:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000021359a0e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438147:x1731754356275136:12345-10.240.43.64@tcp:3:cat.0 Request processed in 428us (481us total) trans 0 rc 12288/12288 00000100:00100000:0.0:1651530141.732777:0:176086:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 99 00002000:00100000:0.0:1651530141.732780:0:176086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2c0a0:0x0] (0->4194303) req@0000000021359a0e x1731754356275136/t0(0) o3->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:112/0 lens 488/440 e 0 to 0 dl 1651530147 ref 1 fl Complete:/0/0 rc 12288/12288 job:'cat.0' 00002000:00100000:0.0:1651530141.732784:0:176086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000021359a0e with x1731754356275136 ext(0->4194303) 00002000:00010000:0.0:1651530141.732785:0:176086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000021359a0e 00000100:00100000:1.0:1651530141.920416:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530141.920433:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946855168 00000100:00100000:1.0:1651530141.920451:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 101 00000100:00100000:1.0:1651530141.920453:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ee473ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946855168:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651530141.920466:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 275081024 pending 36864 free 81307975680 avail 77137264640 00000100:00100000:1.0:1651530141.920496:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ee473ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946855168:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 42us (83us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530141.920500:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 101 00000100:00100000:1.0:1651530141.951727:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651530141.951821:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946855360 00000100:00100000:0.0:1651530141.951837:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 935 00000100:00100000:0.0:1651530141.951839:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c683c211 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946855360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:0.0:1651530141.951850:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180383 count 1 00002000:00010000:0.0:1651530141.951864:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c09f:0x0] initial LVB size: 12288, mtime: 0x62705996, atime: 0x0, ctime: 0x62705996, blocks: 0x18 00010000:00010000:0.0:1651530141.951867:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c55c7a lrc: 3/0,1 mode: --/PW res: [0x2c09f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530141.951874:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530141.951885:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530141.951887:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c55c7a lrc: 3/0,1 mode: PW/PW res: [0x2c09f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530141.951893:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c55c7a lrc: 3/0,1 mode: PW/PW res: [0x2c09f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530141.951897:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c55c7a lrc: 3/0,1 mode: PW/PW res: [0x2c09f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530141.951901:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c55c7a lrc: 2/0,0 mode: PW/PW res: [0x2c09f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530141.952044:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c55c7a lrc: 2/0,0 mode: PW/PW res: [0x2c09f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530141.952049:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cb70d261 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530141.952050:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c55c7a lrc: 2/0,0 mode: PW/PW res: [0x2c09f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530141.952054:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c55c7a lrc: 3/0,0 mode: PW/PW res: [0x2c09f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530141.952062:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c55c7a lrc: 1/0,0 mode: --/PW res: [0x2c09f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530141.952065:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb70d261/0x3234de053c55c7a lrc: 0/0,0 mode: --/PW res: [0x2c09f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651530141.952240:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c683c211 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946855360:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 399us (514us total) trans 21474837390 rc 0/0 00000100:00100000:0.0:1651530141.952244:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 935 00000400:00000080:0.0:1651530142.290113:0:179935:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530142.290115:0:179935:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: cache hits:: before: 8249, after: 8252 00000100:00100000:1.0:1651530142.333302:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008ce5f676 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:39099:1731745997089216:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:0.0:1651530142.333302:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005cc6463a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9063caa-b124-4cb6-99ef-d01a735595c3:39100:1731745997089152:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:0.0:1651530142.333688:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005cc6463a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9063caa-b124-4cb6-99ef-d01a735595c3:39100:1731745997089152:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:1.0:1651530142.333691:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008ce5f676 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:39099:1731745997089216:10.240.43.61@tcp:400:kworker/u4:2.0 00000400:00000080:1.0:1651530143.941612:0:180207:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651530143.941614:0:180207:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 160a: changelog sanity ==================== 22:22:23 (1651530143) 00000100:00100000:1.0:1651530144.785749:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530144.785770:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356277568 00000100:00100000:1.0:1651530144.785797:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 936 00000100:00100000:1.0:1651530144.785800:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008ce5f676 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438148:x1731754356277568:12345-10.240.43.64@tcp:101:cp.0 00010000:00010000:1.0:1651530144.785810:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651530144.785840:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c55c81 lrc: 2/0,0 mode: --/PR res: [0x2c0a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db30c9a3 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530144.785854:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0a1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530144.785864:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530144.785865:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530144.785870:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c55c81 lrc: 3/0,0 mode: PR/PR res: [0x2c0a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c9a3 expref: 9 pid: 166111 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530144.785879:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c55c81 lrc: 3/0,0 mode: PR/PR res: [0x2c0a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c9a3 expref: 9 pid: 166111 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530144.785885:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000003af78ab, rc 0) 00000100:00100000:1.0:1651530144.785919:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008ce5f676 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438148:x1731754356277568:12345-10.240.43.64@tcp:101:cp.0 Request processed in 118us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530144.785923:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 936 00000100:00100000:1.0:1651530144.786681:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530144.786689:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356277696 00000100:00100000:1.0:1651530144.786701:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 937 00000100:00100000:1.0:1651530144.786703:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000712b8830 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+9:484602:x1731754356277696:12345-10.240.43.64@tcp:101:cp.0 00010000:00010000:1.0:1651530144.786707:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1651530144.786712:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55c88 lrc: 2/0,0 mode: --/PW res: [0x2c0a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db30c9b1 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530144.786720:0:166111:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c55c81 lrc: 2/0,0 mode: PR/PR res: [0x2c0a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c9a3 expref: 10 pid: 166111 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530144.786724:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530144.786724:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530144.786725:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55c88 lrc: 4/0,0 mode: --/PW res: [0x2c0a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c9b1 expref: 10 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530144.786738:0:166111:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c55c81 lrc: 3/0,0 mode: PR/PR res: [0x2c0a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c9a3 expref: 10 pid: 166111 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530144.786743:0:166111:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c55c81 lrc: 4/0,0 mode: PR/PR res: [0x2c0a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c9a3 expref: 10 pid: 166111 timeout: 20953 lvb_type: 1 00000100:00100000:1.0:1651530144.786749:0:166111:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006dd920d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:166111:1731745997089280:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651530144.786771:0:166111:0:(client.c:2492:ptlrpc_set_wait()) set 000000004feb0064 going to sleep for 6 seconds 00000100:00100000:1.0:1651530144.787003:0:166111:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006dd920d5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:166111:1731745997089280:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651530144.787010:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55c88 lrc: 3/0,0 mode: --/PW res: [0x2c0a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c9b1 expref: 10 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530144.787015:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000062f8a534, rc 0) 00000100:00100000:1.0:1651530144.787025:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000712b8830 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+10:484602:x1731754356277696:12345-10.240.43.64@tcp:101:cp.0 Request processed in 321us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530144.787028:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 937 00000100:00100000:0.0:1651530144.787046:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530144.787064:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356277760 00010000:00010000:0.0:1651530144.787074:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c55c81 lrc: 4/0,0 mode: PR/PR res: [0x2c0a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c9a3 expref: 10 pid: 166111 timeout: 20953 lvb_type: 1 00000100:00100000:0.0:1651530144.787086:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 23 00000100:00100000:0.0:1651530144.787088:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+10:438149:x1731754356277760:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651530144.787092:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651530144.787098:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c55c81 lrc: 4/0,0 mode: PR/PR res: [0x2c0a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c9a3 expref: 10 pid: 166111 timeout: 20953 lvb_type: 1 00010000:00010000:0.0:1651530144.787103:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c55c81 lrc: 3/0,0 mode: PR/PR res: [0x2c0a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c9a3 expref: 10 pid: 166111 timeout: 20953 lvb_type: 1 00010000:00010000:0.0:1651530144.787112:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c55c81 lrc: 0/0,0 mode: --/PR res: [0x2c0a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c9a3 expref: 10 pid: 166111 timeout: 20953 lvb_type: 1 00010000:00010000:0.0:1651530144.787129:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530144.787130:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530144.787132:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55c88 lrc: 2/0,0 mode: PW/PW res: [0x2c0a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c9b1 expref: 9 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530144.787136:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55c88 lrc: 3/0,0 mode: PW/PW res: [0x2c0a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c9b1 expref: 9 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530144.787157:0:166104:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000062f8a534/0x3234de053c55c88 lrc: 3/0,0 mode: PW/PW res: [0x2c0a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c9b1 expref: 9 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651530144.787162:0:166104:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003e8ef62e pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:166104:1731745997089344:10.240.43.64@tcp:105: 00000100:00100000:0.0:1651530144.787181:0:166104:0:(client.c:2492:ptlrpc_set_wait()) set 000000001e3ae16a going to sleep for 6 seconds 00000100:00100000:0.0:1651530144.787424:0:166104:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003e8ef62e pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:166104:1731745997089344:10.240.43.64@tcp:105: 00010000:00010000:0.0:1651530144.787429:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651530144.787439:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005cc6463a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+9:438149:x1731754356277760:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 351us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530144.787443:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 23 00000001:00080000:0.0:1651530146.484675:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474837390 is committed 00000001:00080000:0.0:1651530146.484682:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474837389 is committed 00000100:00100000:1.0:1651530147.041269:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530147.041289:0:166115:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946855616 00000100:00100000:1.0:1651530147.041310:0:166115:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 102 00000100:00100000:1.0:1651530147.041313:0:166115:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006dd920d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946855616:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651530147.041331:0:166115:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 275044160 pending 0 free 81307975680 avail 77137264640 00000100:00100000:1.0:1651530147.041362:0:166115:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006dd920d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946855616:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 48us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530147.041365:0:166115:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 102 00000100:00100000:1.0:1651530148.687654:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530148.687673:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946856128 00000100:00100000:1.0:1651530148.687699:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 938 00000100:00100000:1.0:1651530148.687711:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008f7d6b7b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946856128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651530148.687729:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180384 count 1 00010000:00010000:1.0:1651530148.687743:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55c8f lrc: 3/0,1 mode: --/PW res: [0x2c0a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530148.687755:0:166111:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c55c73 lrc: 2/0,0 mode: PR/PR res: [0x2c0a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c93a expref: 6 pid: 166111 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530148.687759:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530148.687760:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530148.687761:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55c8f lrc: 4/0,1 mode: --/PW res: [0x2c0a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530148.687776:0:166111:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c55c73 lrc: 3/0,0 mode: PR/PR res: [0x2c0a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c93a expref: 6 pid: 166111 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1651530148.687782:0:166111:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c55c73 lrc: 4/0,0 mode: PR/PR res: [0x2c0a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c93a expref: 6 pid: 166111 timeout: 20957 lvb_type: 1 00000100:00100000:1.0:1651530148.687788:0:166111:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047d5dd29 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:166111:1731745997089408:10.240.43.64@tcp:104: 00000100:00100000:1.0:1651530148.687820:0:166111:0:(client.c:2492:ptlrpc_set_wait()) set 000000004feb0064 going to sleep for 6 seconds 00000100:00100000:1.0:1651530148.688113:0:166111:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047d5dd29 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:166111:1731745997089408:10.240.43.64@tcp:104: 00010000:00010000:1.0:1651530148.688120:0:166111:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55c8f lrc: 3/0,1 mode: --/PW res: [0x2c0a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651530148.688194:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530148.688208:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356283648 00010000:00010000:0.0:1651530148.688218:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c55c73 lrc: 4/0,0 mode: PR/PR res: [0x2c0a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c93a expref: 7 pid: 166111 timeout: 20957 lvb_type: 1 00000100:00100000:0.0:1651530148.688244:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 24 00000100:00100000:0.0:1651530148.688247:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+7:438149:x1731754356283648:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1651530148.688252:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1651530148.688253:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c55c73 lrc: 4/0,0 mode: PR/PR res: [0x2c0a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c93a expref: 7 pid: 166111 timeout: 20957 lvb_type: 1 00010000:00010000:0.0:1651530148.688259:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c55c73 lrc: 3/0,0 mode: PR/PR res: [0x2c0a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c93a expref: 7 pid: 166111 timeout: 20957 lvb_type: 1 00010000:00010000:0.0:1651530148.688270:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e270377c/0x3234de053c55c73 lrc: 0/0,0 mode: --/PR res: [0x2c0a0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db30c93a expref: 7 pid: 166111 timeout: 20957 lvb_type: 1 00010000:00010000:0.0:1651530148.688275:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530148.688276:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530148.688277:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55c8f lrc: 3/0,1 mode: PW/PW res: [0x2c0a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530148.688281:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55c8f lrc: 4/0,1 mode: PW/PW res: [0x2c0a0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530148.688294:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1651530148.688308:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003e8ef62e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438149:x1731754356283648:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 61us (116us total) trans 0 rc 0/0 00010000:00010000:1.0:1651530148.688310:0:166111:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55c8f lrc: 3/0,1 mode: PW/PW res: [0x2c0a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651530148.688311:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 24 00010000:00010000:1.0:1651530148.688325:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55c8f lrc: 3/0,1 mode: PW/PW res: [0x2c0a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530148.688329:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55c8f lrc: 3/0,1 mode: PW/PW res: [0x2c0a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530148.688332:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55c8f lrc: 2/0,0 mode: PW/PW res: [0x2c0a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530148.688828:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008f7d6b7b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946856128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1116us (1178us total) trans 21474837391 rc 0/0 00000100:00100000:1.0:1651530148.688832:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 938 00010000:00010000:1.0:1651530148.688842:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55c8f lrc: 2/0,0 mode: PW/PW res: [0x2c0a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530148.688846:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001ea46bb1 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651530148.688848:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55c8f lrc: 2/0,0 mode: PW/PW res: [0x2c0a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530148.688851:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55c8f lrc: 3/0,0 mode: PW/PW res: [0x2c0a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530148.688863:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55c8f lrc: 1/0,0 mode: --/PW res: [0x2c0a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530148.688867:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55c8f lrc: 0/0,0 mode: --/PW res: [0x2c0a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651530148.689438:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530148.689456:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946856256 00000100:00100000:1.0:1651530148.689471:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 939 00000100:00100000:1.0:1651530148.689473:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:243454:x1731745946856256:12345-10.240.43.61@tcp:9:umount.0 00000020:00000080:1.0:1651530148.689494:0:166111:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0x3234de053c5439f 00000100:00080000:1.0:1651530148.689504:0:166111:0:(import.c:85:import_set_state_nolock()) 00000000e4bcd31c ¶×à”ÿÿ: changing import state from FULL to CLOSED 00000001:00000004:1.0:1651530148.689541:0:166111:0:(tgt_lastrcvd.c:701:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 5, last_transno is 21474837391 00000100:00100000:1.0:1651530148.689774:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086eaa330 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+3:243454:x1731745946856256:12345-10.240.43.61@tcp:9:umount.0 Request processed in 299us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530148.689777:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 939 00000100:00100000:0.0:1651530151.616983:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530151.617015:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356283840 00000100:00100000:1.0:1651530151.617041:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12 00000100:00100000:1.0:1651530151.617044:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054ed0749 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438147:x1731754356283840:12345-10.240.43.64@tcp:400:kworker/u4:1.0 00000100:00100000:1.0:1651530151.617081:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054ed0749 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438147:x1731754356283840:12345-10.240.43.64@tcp:400:kworker/u4:1.0 Request processed in 37us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530151.617085:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12 00000001:00100000:0.0:1651530154.143691:0:166098:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1651530154.143696:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474837391 is committed 00000020:00000080:0.0:1651530154.143698:0:166098:0:(genops.c:985:class_export_put()) final put 00000000c3f67b84/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1651530154.143705:0:159543:0:(genops.c:944:class_export_destroy()) destroying export 00000000c3f67b84/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1651530154.143739:0:159543:0:(genops.c:1164:obd_zombie_import_free()) destroying import 00000000e4bcd31c for lustre-OST0001 00000100:00100000:0.0:1651530157.662770:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530157.662810:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946857152 00000100:00100000:1.0:1651530157.662846:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 940 00000100:00100000:1.0:1651530157.662849:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:39028:x1731745946857152:12345-10.240.43.61@tcp:8:llog_process_th.0 00010000:00080000:1.0:1651530157.662878:0:166111:0:(ldlm_lib.c:1365:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@10.240.43.61@tcp t0 exp 0000000055bfac58 cur 20816 last 0 00000020:00000080:1.0:1651530157.662903:0:166111:0:(genops.c:1359:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3234de053c55c96 00002000:00100000:1.0:1651530157.662919:0:166111:0:(ofd_obd.c:150:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/0000000068bfeb88 ocd_connect_flags: 0x2044401443000066 ocd_version: 20f0000 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1651530157.662921:0:166111:0:(ofd_obd.c:168:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1651530157.662922:0:166111:0:(ofd_obd.c:257:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000020:01000000:1.0:1651530157.662964:0:166111:0:(lprocfs_status_server.c:544:lprocfs_exp_setup()) using hash 00000000427049c0 00002000:00080000:1.0:1651530157.662968:0:166111:0:(ofd_obd.c:391:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1651530157.663003:0:166111:0:(import.c:85:import_set_state_nolock()) 0000000021d824d5 ¶×à”ÿÿ: changing import state from RECOVER to FULL 00000100:00100000:1.0:1651530157.663050:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:39028:x1731745946857152:12345-10.240.43.61@tcp:8:llog_process_th.0 Request processed in 200us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530157.663054:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 940 00000100:00100000:0.0:1651530157.663300:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530157.663325:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946857280 00000100:00100000:1.0:1651530157.663336:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 103 00000100:00100000:1.0:1651530157.663338:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946857280:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651530157.663351:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 275044160 pending 0 free 81307987968 avail 77137276928 00000100:00100000:1.0:1651530157.663373:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000977ca576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946857280:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 34us (73us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530157.663379:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 103 00000100:00100000:0.0:1651530157.675420:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530157.675459:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946857408 00000100:00100000:1.0:1651530157.675480:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 941 00000100:00100000:1.0:1651530157.675482:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d5b9490 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946857408:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1651530157.675492:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:180384 count 1 00000100:00100000:1.0:1651530157.675538:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d5b9490 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946857408:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 56us (119us total) trans 0 rc -2/-2 00000100:00100000:1.0:1651530157.675542:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 941 00000100:00100000:0.0:1651530158.878261:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530158.878303:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946859008 00000100:00100000:1.0:1651530158.878333:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 942 00000100:00100000:1.0:1651530158.878336:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008dcef4b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:244002:x1731745946859008:12345-10.240.43.61@tcp:5:osp-pre-1-0.0 00002000:00080000:1.0:1651530158.878353:0:166111:0:(ofd_dev.c:1586:ofd_create_hdl()) ofd_last_id() = 180417 -> diff = -32 00002000:02000040:1.0:1651530158.878355:0:166111:0:(ofd_dev.c:1442:ofd_orphans_destroy()) lustre-OST0001: deleting orphan objects from 0x0:180386 to 0x0:180417 00002000:00010000:1.0:1651530158.880050:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.880060:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55c9d lrc: 3/0,1 mode: --/PW res: [0x2c0c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880068:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.880069:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.880072:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55c9d lrc: 3/0,1 mode: PW/PW res: [0x2c0c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880079:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55c9d lrc: 3/0,1 mode: PW/PW res: [0x2c0c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880084:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55c9d lrc: 3/0,1 mode: PW/PW res: [0x2c0c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880087:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55c9d lrc: 2/0,0 mode: PW/PW res: [0x2c0c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.880200:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.880202:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c55ca4 lrc: 3/0,1 mode: --/PW res: [0x2c0c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880206:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.880206:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.880207:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c55ca4 lrc: 3/0,1 mode: PW/PW res: [0x2c0c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880211:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c55ca4 lrc: 3/0,1 mode: PW/PW res: [0x2c0c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880214:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c55ca4 lrc: 3/0,1 mode: PW/PW res: [0x2c0c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880241:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c55ca4 lrc: 2/0,0 mode: PW/PW res: [0x2c0c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.880284:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.880286:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55cab lrc: 3/0,1 mode: --/PW res: [0x2c0bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880290:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.880290:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.880291:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55cab lrc: 3/0,1 mode: PW/PW res: [0x2c0bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880295:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55cab lrc: 3/0,1 mode: PW/PW res: [0x2c0bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880298:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55cab lrc: 3/0,1 mode: PW/PW res: [0x2c0bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880300:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55cab lrc: 2/0,0 mode: PW/PW res: [0x2c0bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.880341:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.880343:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c55cb2 lrc: 3/0,1 mode: --/PW res: [0x2c0be:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880347:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.880347:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.880348:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c55cb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880356:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c55cb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880359:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c55cb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880362:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c55cb2 lrc: 2/0,0 mode: PW/PW res: [0x2c0be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.880386:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.880388:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c55cb9 lrc: 3/0,1 mode: --/PW res: [0x2c0bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880391:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.880392:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.880392:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c55cb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880396:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c55cb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880398:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c55cb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880401:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c55cb9 lrc: 2/0,0 mode: PW/PW res: [0x2c0bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880442:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55c9d lrc: 2/0,0 mode: PW/PW res: [0x2c0c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.880448:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651530158.880448:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001ea46bb1 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651530158.880450:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c55cc0 lrc: 3/0,1 mode: --/PW res: [0x2c0bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880450:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55c9d lrc: 2/0,0 mode: PW/PW res: [0x2c0c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880453:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.880453:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.880454:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c55cc0 lrc: 3/0,1 mode: PW/PW res: [0x2c0bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880455:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55c9d lrc: 3/0,0 mode: PW/PW res: [0x2c0c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880457:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c55cc0 lrc: 3/0,1 mode: PW/PW res: [0x2c0bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880460:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c55cc0 lrc: 3/0,1 mode: PW/PW res: [0x2c0bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880463:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c55cc0 lrc: 2/0,0 mode: PW/PW res: [0x2c0bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880464:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55c9d lrc: 1/0,0 mode: --/PW res: [0x2c0c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880467:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ea46bb1/0x3234de053c55c9d lrc: 0/0,0 mode: --/PW res: [0x2c0c1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880473:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c55ca4 lrc: 2/0,0 mode: PW/PW res: [0x2c0c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880476:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007c1cad42 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530158.880477:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c55ca4 lrc: 2/0,0 mode: PW/PW res: [0x2c0c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.880498:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651530158.880499:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c55ca4 lrc: 3/0,0 mode: PW/PW res: [0x2c0c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880500:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c55cc7 lrc: 3/0,1 mode: --/PW res: [0x2c0bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880503:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530158.880503:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c55ca4 lrc: 1/0,0 mode: --/PW res: [0x2c0c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880504:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.880504:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c55cc7 lrc: 3/0,1 mode: PW/PW res: [0x2c0bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880506:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c1cad42/0x3234de053c55ca4 lrc: 0/0,0 mode: --/PW res: [0x2c0c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880507:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c55cc7 lrc: 3/0,1 mode: PW/PW res: [0x2c0bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880510:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55cab lrc: 2/0,0 mode: PW/PW res: [0x2c0bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880512:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004678bff1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530158.880513:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55cab lrc: 2/0,0 mode: PW/PW res: [0x2c0bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880515:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c55cc7 lrc: 3/0,1 mode: PW/PW res: [0x2c0bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880516:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55cab lrc: 3/0,0 mode: PW/PW res: [0x2c0bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880518:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c55cc7 lrc: 2/0,0 mode: PW/PW res: [0x2c0bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880519:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55cab lrc: 1/0,0 mode: --/PW res: [0x2c0bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880521:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004678bff1/0x3234de053c55cab lrc: 0/0,0 mode: --/PW res: [0x2c0bf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880525:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c55cb2 lrc: 2/0,0 mode: PW/PW res: [0x2c0be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880533:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004f367ded already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530158.880534:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c55cb2 lrc: 2/0,0 mode: PW/PW res: [0x2c0be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880536:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c55cb2 lrc: 3/0,0 mode: PW/PW res: [0x2c0be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880540:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c55cb2 lrc: 1/0,0 mode: --/PW res: [0x2c0be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.880542:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651530158.880542:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f367ded/0x3234de053c55cb2 lrc: 0/0,0 mode: --/PW res: [0x2c0be:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880544:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c55cce lrc: 3/0,1 mode: --/PW res: [0x2c0ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880546:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c55cb9 lrc: 2/0,0 mode: PW/PW res: [0x2c0bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880547:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.880547:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.880548:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c55cce lrc: 3/0,1 mode: PW/PW res: [0x2c0ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880548:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000baeec0a3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530158.880549:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c55cb9 lrc: 2/0,0 mode: PW/PW res: [0x2c0bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880551:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c55cce lrc: 3/0,1 mode: PW/PW res: [0x2c0ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880552:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c55cb9 lrc: 3/0,0 mode: PW/PW res: [0x2c0bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880554:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c55cce lrc: 3/0,1 mode: PW/PW res: [0x2c0ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880555:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c55cb9 lrc: 1/0,0 mode: --/PW res: [0x2c0bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880557:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c55cce lrc: 2/0,0 mode: PW/PW res: [0x2c0ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880557:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000baeec0a3/0x3234de053c55cb9 lrc: 0/0,0 mode: --/PW res: [0x2c0bd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880561:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c55cc0 lrc: 2/0,0 mode: PW/PW res: [0x2c0bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880564:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c0de17df already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530158.880564:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c55cc0 lrc: 2/0,0 mode: PW/PW res: [0x2c0bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880567:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c55cc0 lrc: 3/0,0 mode: PW/PW res: [0x2c0bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880570:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c55cc0 lrc: 1/0,0 mode: --/PW res: [0x2c0bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880572:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0de17df/0x3234de053c55cc0 lrc: 0/0,0 mode: --/PW res: [0x2c0bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880576:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c55cc7 lrc: 2/0,0 mode: PW/PW res: [0x2c0bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880578:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2a86deb already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530158.880579:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c55cc7 lrc: 2/0,0 mode: PW/PW res: [0x2c0bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880582:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c55cc7 lrc: 3/0,0 mode: PW/PW res: [0x2c0bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880585:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c55cc7 lrc: 1/0,0 mode: --/PW res: [0x2c0bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880588:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2a86deb/0x3234de053c55cc7 lrc: 0/0,0 mode: --/PW res: [0x2c0bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880591:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c55cce lrc: 2/0,0 mode: PW/PW res: [0x2c0ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880594:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ba070658 already unused, calling callback (0000000049fddea7) 00002000:00010000:1.0:1651530158.880595:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651530158.880595:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c55cce lrc: 2/0,0 mode: PW/PW res: [0x2c0ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880597:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55cd5 lrc: 3/0,1 mode: --/PW res: [0x2c0b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880597:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c55cce lrc: 3/0,0 mode: PW/PW res: [0x2c0ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880600:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c55cce lrc: 1/0,0 mode: --/PW res: [0x2c0ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880603:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba070658/0x3234de053c55cce lrc: 0/0,0 mode: --/PW res: [0x2c0ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880607:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.880607:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.880608:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55cd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880611:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55cd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880614:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55cd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880617:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55cd5 lrc: 2/0,0 mode: PW/PW res: [0x2c0b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880631:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55cd5 lrc: 2/0,0 mode: PW/PW res: [0x2c0b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880635:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2d8d18b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530158.880635:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55cd5 lrc: 2/0,0 mode: PW/PW res: [0x2c0b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.880646:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.880647:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55cdc lrc: 3/0,1 mode: --/PW res: [0x2c0b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880647:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55cd5 lrc: 3/0,0 mode: PW/PW res: [0x2c0b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880651:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.880651:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530158.880651:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55cd5 lrc: 1/0,0 mode: --/PW res: [0x2c0b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880652:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55cdc lrc: 3/0,1 mode: PW/PW res: [0x2c0b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880654:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2d8d18b/0x3234de053c55cd5 lrc: 0/0,0 mode: --/PW res: [0x2c0b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880655:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55cdc lrc: 3/0,1 mode: PW/PW res: [0x2c0b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880658:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55cdc lrc: 3/0,1 mode: PW/PW res: [0x2c0b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880670:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55cdc lrc: 2/0,0 mode: PW/PW res: [0x2c0b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880689:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55cdc lrc: 2/0,0 mode: PW/PW res: [0x2c0b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880693:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000029b2a516 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530158.880694:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55cdc lrc: 2/0,0 mode: PW/PW res: [0x2c0b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880697:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55cdc lrc: 3/0,0 mode: PW/PW res: [0x2c0b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880701:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55cdc lrc: 1/0,0 mode: --/PW res: [0x2c0b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880704:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029b2a516/0x3234de053c55cdc lrc: 0/0,0 mode: --/PW res: [0x2c0b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.880706:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.880707:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c55ce3 lrc: 3/0,1 mode: --/PW res: [0x2c0b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880711:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.880711:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.880712:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c55ce3 lrc: 3/0,1 mode: PW/PW res: [0x2c0b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880715:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c55ce3 lrc: 3/0,1 mode: PW/PW res: [0x2c0b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880718:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c55ce3 lrc: 3/0,1 mode: PW/PW res: [0x2c0b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880721:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c55ce3 lrc: 2/0,0 mode: PW/PW res: [0x2c0b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880738:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c55ce3 lrc: 2/0,0 mode: PW/PW res: [0x2c0b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880742:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d84ad17b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530158.880743:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c55ce3 lrc: 2/0,0 mode: PW/PW res: [0x2c0b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880746:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c55ce3 lrc: 3/0,0 mode: PW/PW res: [0x2c0b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880750:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c55ce3 lrc: 1/0,0 mode: --/PW res: [0x2c0b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880753:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d84ad17b/0x3234de053c55ce3 lrc: 0/0,0 mode: --/PW res: [0x2c0b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.880756:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.880758:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae57075e/0x3234de053c55cea lrc: 3/0,1 mode: --/PW res: [0x2c0b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880761:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.880762:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.880762:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae57075e/0x3234de053c55cea lrc: 3/0,1 mode: PW/PW res: [0x2c0b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880770:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae57075e/0x3234de053c55cea lrc: 3/0,1 mode: PW/PW res: [0x2c0b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880773:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae57075e/0x3234de053c55cea lrc: 3/0,1 mode: PW/PW res: [0x2c0b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880776:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae57075e/0x3234de053c55cea lrc: 2/0,0 mode: PW/PW res: [0x2c0b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880792:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae57075e/0x3234de053c55cea lrc: 2/0,0 mode: PW/PW res: [0x2c0b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880795:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ae57075e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530158.880796:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae57075e/0x3234de053c55cea lrc: 2/0,0 mode: PW/PW res: [0x2c0b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880799:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae57075e/0x3234de053c55cea lrc: 3/0,0 mode: PW/PW res: [0x2c0b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880803:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae57075e/0x3234de053c55cea lrc: 1/0,0 mode: --/PW res: [0x2c0b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880805:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae57075e/0x3234de053c55cea lrc: 0/0,0 mode: --/PW res: [0x2c0b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.880813:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.880815:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c55cf1 lrc: 3/0,1 mode: --/PW res: [0x2c0b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880819:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.880819:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.880820:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c55cf1 lrc: 3/0,1 mode: PW/PW res: [0x2c0b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880823:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c55cf1 lrc: 3/0,1 mode: PW/PW res: [0x2c0b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880826:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c55cf1 lrc: 3/0,1 mode: PW/PW res: [0x2c0b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880829:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c55cf1 lrc: 2/0,0 mode: PW/PW res: [0x2c0b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880846:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c55cf1 lrc: 2/0,0 mode: PW/PW res: [0x2c0b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880849:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000003af78ab already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530158.880850:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c55cf1 lrc: 2/0,0 mode: PW/PW res: [0x2c0b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880853:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c55cf1 lrc: 3/0,0 mode: PW/PW res: [0x2c0b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880857:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c55cf1 lrc: 1/0,0 mode: --/PW res: [0x2c0b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880859:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003af78ab/0x3234de053c55cf1 lrc: 0/0,0 mode: --/PW res: [0x2c0b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.880879:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.880881:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c55cf8 lrc: 3/0,1 mode: --/PW res: [0x2c0b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880884:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.880885:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.880885:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c55cf8 lrc: 3/0,1 mode: PW/PW res: [0x2c0b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880888:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c55cf8 lrc: 3/0,1 mode: PW/PW res: [0x2c0b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880891:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c55cf8 lrc: 3/0,1 mode: PW/PW res: [0x2c0b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880894:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c55cf8 lrc: 2/0,0 mode: PW/PW res: [0x2c0b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880903:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c55cf8 lrc: 2/0,0 mode: PW/PW res: [0x2c0b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880906:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000820e2b3d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530158.880907:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c55cf8 lrc: 2/0,0 mode: PW/PW res: [0x2c0b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880910:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c55cf8 lrc: 3/0,0 mode: PW/PW res: [0x2c0b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880913:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c55cf8 lrc: 1/0,0 mode: --/PW res: [0x2c0b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880916:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820e2b3d/0x3234de053c55cf8 lrc: 0/0,0 mode: --/PW res: [0x2c0b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.880930:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.880932:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c55cff lrc: 3/0,1 mode: --/PW res: [0x2c0b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880935:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.880936:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.880936:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c55cff lrc: 3/0,1 mode: PW/PW res: [0x2c0b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880939:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c55cff lrc: 3/0,1 mode: PW/PW res: [0x2c0b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880947:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c55cff lrc: 3/0,1 mode: PW/PW res: [0x2c0b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.880950:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c55cff lrc: 2/0,0 mode: PW/PW res: [0x2c0b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880959:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c55cff lrc: 2/0,0 mode: PW/PW res: [0x2c0b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880962:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032eb11d3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530158.880963:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c55cff lrc: 2/0,0 mode: PW/PW res: [0x2c0b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880965:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c55cff lrc: 3/0,0 mode: PW/PW res: [0x2c0b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880969:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c55cff lrc: 1/0,0 mode: --/PW res: [0x2c0b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.880972:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032eb11d3/0x3234de053c55cff lrc: 0/0,0 mode: --/PW res: [0x2c0b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.880995:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.880996:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c55d06 lrc: 3/0,1 mode: --/PW res: [0x2c0b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881000:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.881000:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.881001:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c55d06 lrc: 3/0,1 mode: PW/PW res: [0x2c0b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881004:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c55d06 lrc: 3/0,1 mode: PW/PW res: [0x2c0b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881007:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c55d06 lrc: 3/0,1 mode: PW/PW res: [0x2c0b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881009:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c55d06 lrc: 2/0,0 mode: PW/PW res: [0x2c0b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881019:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c55d06 lrc: 2/0,0 mode: PW/PW res: [0x2c0b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881022:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001fcafd1a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530158.881022:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c55d06 lrc: 2/0,0 mode: PW/PW res: [0x2c0b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881028:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c55d06 lrc: 3/0,0 mode: PW/PW res: [0x2c0b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881031:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c55d06 lrc: 1/0,0 mode: --/PW res: [0x2c0b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881034:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fcafd1a/0x3234de053c55d06 lrc: 0/0,0 mode: --/PW res: [0x2c0b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.881046:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.881048:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c55d0d lrc: 3/0,1 mode: --/PW res: [0x2c0b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881058:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.881059:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.881060:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c55d0d lrc: 3/0,1 mode: PW/PW res: [0x2c0b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881063:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c55d0d lrc: 3/0,1 mode: PW/PW res: [0x2c0b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881066:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c55d0d lrc: 3/0,1 mode: PW/PW res: [0x2c0b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881068:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c55d0d lrc: 2/0,0 mode: PW/PW res: [0x2c0b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881078:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c55d0d lrc: 2/0,0 mode: PW/PW res: [0x2c0b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881081:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005532ef34 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530158.881081:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c55d0d lrc: 2/0,0 mode: PW/PW res: [0x2c0b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881084:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c55d0d lrc: 3/0,0 mode: PW/PW res: [0x2c0b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881088:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c55d0d lrc: 1/0,0 mode: --/PW res: [0x2c0b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881090:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005532ef34/0x3234de053c55d0d lrc: 0/0,0 mode: --/PW res: [0x2c0b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.881106:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.881108:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c55d14 lrc: 3/0,1 mode: --/PW res: [0x2c0b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881111:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.881112:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.881113:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c55d14 lrc: 3/0,1 mode: PW/PW res: [0x2c0b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881116:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c55d14 lrc: 3/0,1 mode: PW/PW res: [0x2c0b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881119:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c55d14 lrc: 3/0,1 mode: PW/PW res: [0x2c0b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881128:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c55d14 lrc: 2/0,0 mode: PW/PW res: [0x2c0b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881137:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c55d14 lrc: 2/0,0 mode: PW/PW res: [0x2c0b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881141:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000054295afd already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530158.881142:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c55d14 lrc: 2/0,0 mode: PW/PW res: [0x2c0b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881158:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c55d14 lrc: 3/0,0 mode: PW/PW res: [0x2c0b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881161:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c55d14 lrc: 1/0,0 mode: --/PW res: [0x2c0b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881164:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054295afd/0x3234de053c55d14 lrc: 0/0,0 mode: --/PW res: [0x2c0b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.881171:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.881173:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c55d1b lrc: 3/0,1 mode: --/PW res: [0x2c0af:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881176:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.881177:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.881178:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c55d1b lrc: 3/0,1 mode: PW/PW res: [0x2c0af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881181:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c55d1b lrc: 3/0,1 mode: PW/PW res: [0x2c0af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881184:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c55d1b lrc: 3/0,1 mode: PW/PW res: [0x2c0af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881187:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c55d1b lrc: 2/0,0 mode: PW/PW res: [0x2c0af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881196:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c55d1b lrc: 2/0,0 mode: PW/PW res: [0x2c0af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881200:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000029e40f3d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530158.881200:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c55d1b lrc: 2/0,0 mode: PW/PW res: [0x2c0af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881203:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c55d1b lrc: 3/0,0 mode: PW/PW res: [0x2c0af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881207:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c55d1b lrc: 1/0,0 mode: --/PW res: [0x2c0af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881210:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029e40f3d/0x3234de053c55d1b lrc: 0/0,0 mode: --/PW res: [0x2c0af:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.881220:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.881234:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ba8c2cb/0x3234de053c55d22 lrc: 3/0,1 mode: --/PW res: [0x2c0ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881238:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.881239:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.881239:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ba8c2cb/0x3234de053c55d22 lrc: 3/0,1 mode: PW/PW res: [0x2c0ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881249:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ba8c2cb/0x3234de053c55d22 lrc: 3/0,1 mode: PW/PW res: [0x2c0ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881252:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ba8c2cb/0x3234de053c55d22 lrc: 3/0,1 mode: PW/PW res: [0x2c0ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881255:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ba8c2cb/0x3234de053c55d22 lrc: 2/0,0 mode: PW/PW res: [0x2c0ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881264:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ba8c2cb/0x3234de053c55d22 lrc: 2/0,0 mode: PW/PW res: [0x2c0ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881268:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000007ba8c2cb already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530158.881269:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ba8c2cb/0x3234de053c55d22 lrc: 2/0,0 mode: PW/PW res: [0x2c0ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881271:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ba8c2cb/0x3234de053c55d22 lrc: 3/0,0 mode: PW/PW res: [0x2c0ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881276:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ba8c2cb/0x3234de053c55d22 lrc: 1/0,0 mode: --/PW res: [0x2c0ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881278:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ba8c2cb/0x3234de053c55d22 lrc: 0/0,0 mode: --/PW res: [0x2c0ae:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.881294:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.881295:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c55d29 lrc: 3/0,1 mode: --/PW res: [0x2c0ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881299:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.881299:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.881300:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c55d29 lrc: 3/0,1 mode: PW/PW res: [0x2c0ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881303:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c55d29 lrc: 3/0,1 mode: PW/PW res: [0x2c0ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881306:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c55d29 lrc: 3/0,1 mode: PW/PW res: [0x2c0ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881309:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c55d29 lrc: 2/0,0 mode: PW/PW res: [0x2c0ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881325:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c55d29 lrc: 2/0,0 mode: PW/PW res: [0x2c0ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881328:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f3240ce7 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530158.881329:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c55d29 lrc: 2/0,0 mode: PW/PW res: [0x2c0ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881332:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c55d29 lrc: 3/0,0 mode: PW/PW res: [0x2c0ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881335:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c55d29 lrc: 1/0,0 mode: --/PW res: [0x2c0ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881339:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3240ce7/0x3234de053c55d29 lrc: 0/0,0 mode: --/PW res: [0x2c0ad:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.881353:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.881355:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c55d30 lrc: 3/0,1 mode: --/PW res: [0x2c0ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881358:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.881359:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.881359:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c55d30 lrc: 3/0,1 mode: PW/PW res: [0x2c0ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881363:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c55d30 lrc: 3/0,1 mode: PW/PW res: [0x2c0ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881366:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c55d30 lrc: 3/0,1 mode: PW/PW res: [0x2c0ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881368:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c55d30 lrc: 2/0,0 mode: PW/PW res: [0x2c0ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881377:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c55d30 lrc: 2/0,0 mode: PW/PW res: [0x2c0ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881380:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ee128d1f already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530158.881381:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c55d30 lrc: 2/0,0 mode: PW/PW res: [0x2c0ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881384:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c55d30 lrc: 3/0,0 mode: PW/PW res: [0x2c0ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881387:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c55d30 lrc: 1/0,0 mode: --/PW res: [0x2c0ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881390:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee128d1f/0x3234de053c55d30 lrc: 0/0,0 mode: --/PW res: [0x2c0ac:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.881394:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.881396:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c55d37 lrc: 3/0,1 mode: --/PW res: [0x2c0ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881399:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.881399:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.881400:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c55d37 lrc: 3/0,1 mode: PW/PW res: [0x2c0ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881403:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c55d37 lrc: 3/0,1 mode: PW/PW res: [0x2c0ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881412:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c55d37 lrc: 3/0,1 mode: PW/PW res: [0x2c0ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881415:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c55d37 lrc: 2/0,0 mode: PW/PW res: [0x2c0ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881424:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c55d37 lrc: 2/0,0 mode: PW/PW res: [0x2c0ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881427:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000005c863cd2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530158.881428:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c55d37 lrc: 2/0,0 mode: PW/PW res: [0x2c0ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881433:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c55d37 lrc: 3/0,0 mode: PW/PW res: [0x2c0ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881437:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c55d37 lrc: 1/0,0 mode: --/PW res: [0x2c0ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881439:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c863cd2/0x3234de053c55d37 lrc: 0/0,0 mode: --/PW res: [0x2c0ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.881448:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.881450:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c55d3e lrc: 3/0,1 mode: --/PW res: [0x2c0aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881453:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.881454:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.881454:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c55d3e lrc: 3/0,1 mode: PW/PW res: [0x2c0aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881457:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c55d3e lrc: 3/0,1 mode: PW/PW res: [0x2c0aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881460:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c55d3e lrc: 3/0,1 mode: PW/PW res: [0x2c0aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881463:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c55d3e lrc: 2/0,0 mode: PW/PW res: [0x2c0aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881472:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c55d3e lrc: 2/0,0 mode: PW/PW res: [0x2c0aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881475:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001644aaad already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530158.881475:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c55d3e lrc: 2/0,0 mode: PW/PW res: [0x2c0aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881478:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c55d3e lrc: 3/0,0 mode: PW/PW res: [0x2c0aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881482:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c55d3e lrc: 1/0,0 mode: --/PW res: [0x2c0aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881485:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001644aaad/0x3234de053c55d3e lrc: 0/0,0 mode: --/PW res: [0x2c0aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.881496:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.881498:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c55d45 lrc: 3/0,1 mode: --/PW res: [0x2c0a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881508:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.881509:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.881510:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c55d45 lrc: 3/0,1 mode: PW/PW res: [0x2c0a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881513:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c55d45 lrc: 3/0,1 mode: PW/PW res: [0x2c0a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881516:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c55d45 lrc: 3/0,1 mode: PW/PW res: [0x2c0a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881519:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c55d45 lrc: 2/0,0 mode: PW/PW res: [0x2c0a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881528:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c55d45 lrc: 2/0,0 mode: PW/PW res: [0x2c0a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881537:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000087f212ed already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530158.881538:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c55d45 lrc: 2/0,0 mode: PW/PW res: [0x2c0a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881541:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c55d45 lrc: 3/0,0 mode: PW/PW res: [0x2c0a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881545:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c55d45 lrc: 1/0,0 mode: --/PW res: [0x2c0a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881547:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087f212ed/0x3234de053c55d45 lrc: 0/0,0 mode: --/PW res: [0x2c0a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.881552:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.881553:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c55d4c lrc: 3/0,1 mode: --/PW res: [0x2c0a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881557:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.881557:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.881558:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c55d4c lrc: 3/0,1 mode: PW/PW res: [0x2c0a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881561:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c55d4c lrc: 3/0,1 mode: PW/PW res: [0x2c0a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881564:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c55d4c lrc: 3/0,1 mode: PW/PW res: [0x2c0a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881574:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c55d4c lrc: 2/0,0 mode: PW/PW res: [0x2c0a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881583:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c55d4c lrc: 2/0,0 mode: PW/PW res: [0x2c0a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881586:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f10dea8 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530158.881587:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c55d4c lrc: 2/0,0 mode: PW/PW res: [0x2c0a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881590:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c55d4c lrc: 3/0,0 mode: PW/PW res: [0x2c0a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881594:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c55d4c lrc: 1/0,0 mode: --/PW res: [0x2c0a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881596:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f10dea8/0x3234de053c55d4c lrc: 0/0,0 mode: --/PW res: [0x2c0a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.881606:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.881608:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c55d53 lrc: 3/0,1 mode: --/PW res: [0x2c0a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881611:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.881612:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.881612:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c55d53 lrc: 3/0,1 mode: PW/PW res: [0x2c0a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881616:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c55d53 lrc: 3/0,1 mode: PW/PW res: [0x2c0a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881619:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c55d53 lrc: 3/0,1 mode: PW/PW res: [0x2c0a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881621:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c55d53 lrc: 2/0,0 mode: PW/PW res: [0x2c0a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881630:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c55d53 lrc: 2/0,0 mode: PW/PW res: [0x2c0a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881634:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f149aa4b already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530158.881634:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c55d53 lrc: 2/0,0 mode: PW/PW res: [0x2c0a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881637:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c55d53 lrc: 3/0,0 mode: PW/PW res: [0x2c0a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881641:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c55d53 lrc: 1/0,0 mode: --/PW res: [0x2c0a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881643:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f149aa4b/0x3234de053c55d53 lrc: 0/0,0 mode: --/PW res: [0x2c0a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.881653:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.881655:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c55d5a lrc: 3/0,1 mode: --/PW res: [0x2c0a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881658:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.881659:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.881659:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c55d5a lrc: 3/0,1 mode: PW/PW res: [0x2c0a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881667:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c55d5a lrc: 3/0,1 mode: PW/PW res: [0x2c0a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881670:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c55d5a lrc: 3/0,1 mode: PW/PW res: [0x2c0a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881673:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c55d5a lrc: 2/0,0 mode: PW/PW res: [0x2c0a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881682:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c55d5a lrc: 2/0,0 mode: PW/PW res: [0x2c0a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881685:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000589cc6c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530158.881686:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c55d5a lrc: 2/0,0 mode: PW/PW res: [0x2c0a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881688:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c55d5a lrc: 3/0,0 mode: PW/PW res: [0x2c0a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881692:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c55d5a lrc: 1/0,0 mode: --/PW res: [0x2c0a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881701:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c55d5a lrc: 0/0,0 mode: --/PW res: [0x2c0a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.881705:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.881707:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c55d61 lrc: 3/0,1 mode: --/PW res: [0x2c0a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881710:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.881711:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.881711:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c55d61 lrc: 3/0,1 mode: PW/PW res: [0x2c0a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881715:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c55d61 lrc: 3/0,1 mode: PW/PW res: [0x2c0a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881717:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c55d61 lrc: 3/0,1 mode: PW/PW res: [0x2c0a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881720:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c55d61 lrc: 2/0,0 mode: PW/PW res: [0x2c0a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881737:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c55d61 lrc: 2/0,0 mode: PW/PW res: [0x2c0a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881740:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006512b8a0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530158.881741:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c55d61 lrc: 2/0,0 mode: PW/PW res: [0x2c0a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881744:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c55d61 lrc: 3/0,0 mode: PW/PW res: [0x2c0a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881748:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c55d61 lrc: 1/0,0 mode: --/PW res: [0x2c0a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881751:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c55d61 lrc: 0/0,0 mode: --/PW res: [0x2c0a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.881765:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.881767:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c55d68 lrc: 3/0,1 mode: --/PW res: [0x2c0a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881771:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.881771:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.881772:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c55d68 lrc: 3/0,1 mode: PW/PW res: [0x2c0a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881775:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c55d68 lrc: 3/0,1 mode: PW/PW res: [0x2c0a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881778:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c55d68 lrc: 3/0,1 mode: PW/PW res: [0x2c0a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881781:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c55d68 lrc: 2/0,0 mode: PW/PW res: [0x2c0a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881790:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c55d68 lrc: 2/0,0 mode: PW/PW res: [0x2c0a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881793:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b9e4c5a0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530158.881793:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c55d68 lrc: 2/0,0 mode: PW/PW res: [0x2c0a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881804:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c55d68 lrc: 3/0,0 mode: PW/PW res: [0x2c0a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881808:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c55d68 lrc: 1/0,0 mode: --/PW res: [0x2c0a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881811:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c55d68 lrc: 0/0,0 mode: --/PW res: [0x2c0a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.881817:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.881819:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c55d6f lrc: 3/0,1 mode: --/PW res: [0x2c0a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881822:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.881822:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.881823:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c55d6f lrc: 3/0,1 mode: PW/PW res: [0x2c0a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881826:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c55d6f lrc: 3/0,1 mode: PW/PW res: [0x2c0a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881834:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c55d6f lrc: 3/0,1 mode: PW/PW res: [0x2c0a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881837:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c55d6f lrc: 2/0,0 mode: PW/PW res: [0x2c0a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881846:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c55d6f lrc: 2/0,0 mode: PW/PW res: [0x2c0a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881849:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000037a4f3dc already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530158.881850:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c55d6f lrc: 2/0,0 mode: PW/PW res: [0x2c0a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881852:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c55d6f lrc: 3/0,0 mode: PW/PW res: [0x2c0a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881856:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c55d6f lrc: 1/0,0 mode: --/PW res: [0x2c0a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881859:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c55d6f lrc: 0/0,0 mode: --/PW res: [0x2c0a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530158.881864:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0a2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530158.881865:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c55d76 lrc: 3/0,1 mode: --/PW res: [0x2c0a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881868:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.881869:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530158.881870:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c55d76 lrc: 3/0,1 mode: PW/PW res: [0x2c0a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881873:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c55d76 lrc: 3/0,1 mode: PW/PW res: [0x2c0a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881876:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c55d76 lrc: 3/0,1 mode: PW/PW res: [0x2c0a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530158.881878:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c55d76 lrc: 2/0,0 mode: PW/PW res: [0x2c0a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881887:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c55d76 lrc: 2/0,0 mode: PW/PW res: [0x2c0a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881891:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000033d777ce already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530158.881892:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c55d76 lrc: 2/0,0 mode: PW/PW res: [0x2c0a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881894:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c55d76 lrc: 3/0,0 mode: PW/PW res: [0x2c0a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881898:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c55d76 lrc: 1/0,0 mode: --/PW res: [0x2c0a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530158.881901:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c55d76 lrc: 0/0,0 mode: --/PW res: [0x2c0a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651530158.881907:0:166111:0:(ofd_dev.c:1469:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x0:180385 00000100:00100000:1.0:1651530158.881942:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008dcef4b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:244002:x1731745946859008:12345-10.240.43.61@tcp:5:osp-pre-1-0.0 Request processed in 3606us (3685us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530158.881952:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 942 00000100:00100000:0.0:1651530158.883559:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530158.883578:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946859072 00000100:00100000:1.0:1651530158.883591:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 943 00000100:00100000:1.0:1651530158.883593:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e4821faf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:244002:x1731745946859072:12345-10.240.43.61@tcp:5:osp-pre-1-0.0 00002000:00080000:1.0:1651530158.883612:0:166111:0:(ofd_dev.c:1706:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x0 at 180418 00000100:00100000:1.0:1651530158.885988:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e4821faf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:244002:x1731745946859072:12345-10.240.43.61@tcp:5:osp-pre-1-0.0 Request processed in 2393us (2429us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530158.885992:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 943 00000400:00000080:0.0:1651530162.276070:0:180425:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530162.276072:0:180425:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 160b: Verify that very long rename doesn't crash in changelog ========================================================== 22:22:41 (1651530161) 00000100:00100000:0.0:1651530162.912213:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530162.912260:0:166115:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946859328 00000100:00100000:1.0:1651530162.912286:0:166115:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 104 00000100:00100000:1.0:1651530162.912289:0:166115:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e32549a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946859328:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651530162.912308:0:166115:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 275043264 pending 0 free 81307987968 avail 77137276928 00000100:00100000:1.0:1651530162.912343:0:166115:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e32549a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745946859328:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 53us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530162.912346:0:166115:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 104 00000001:00100000:0.0:1651530163.383774:0:166098:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000400:00000080:1.0:1651530166.209198:0:180643:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651530166.209200:0:180643:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 160c: verify that changelog log catch the truncate event ========================================================== 22:22:45 (1651530165) 00000100:00100000:0.0:1651530167.421303:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d0a10f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9063caa-b124-4cb6-99ef-d01a735595c3:39100:1731745997089472:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:1.0:1651530167.421306:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004918d6ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:39099:1731745997089536:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00080000:0.0:1651530167.421667:0:39100:0:(recover.c:232:ptlrpc_request_handle_notconn()) import MGC10.240.43.61@tcp of MGS@10.240.43.61@tcp abruptly disconnected: reconnecting 00000100:00080000:0.0:1651530167.421669:0:39100:0:(import.c:85:import_set_state_nolock()) 000000000aba9d44 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1651530167.421672:0:39100:0:(import.c:205:ptlrpc_set_import_discon()) 166-1: MGC10.240.43.61@tcp: Connection to MGS (at 10.240.43.61@tcp) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1651530167.421677:0:39099:0:(recover.c:232:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@10.240.43.61@tcp abruptly disconnected: reconnecting 00000100:00080000:1.0:1651530167.421679:0:39099:0:(import.c:85:import_set_state_nolock()) 0000000070a36139 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1651530167.421682:0:39099:0:(import.c:199:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 10.240.43.61@tcp) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1651530167.424310:0:39100:0:(import.c:211:ptlrpc_set_import_discon()) import MGS@10.240.43.61@tcp for MGC10.240.43.61@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1651530167.424311:0:39100:0:(import.c:156:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1651530167.424324:0:39100:0:(client.c:3319:ptlrpc_abort_inflight()) @@@ inflight req@000000003d0a10f8 x1731745997089472/t0(0) o400->MGC10.240.43.61@tcp@10.240.43.61@tcp:26/25 lens 224/224 e 0 to 0 dl 1651530174 ref 1 fl Rpc:RNQU/0/0 rc 0/-107 job:'kworker/u4:2.0' 10000000:01000000:0.0:1651530167.424343:0:39100:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1651530167.424344:0:39100:0:(pinger.c:214:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1651530167.424345:0:39100:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1651530167.424350:0:39100:0:(import.c:85:import_set_state_nolock()) 000000000aba9d44 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1651530167.424356:0:39100:0:(import.c:533:import_select_connection()) MGC10.240.43.61@tcp: connect to NID 10.240.43.61@tcp last attempt 20321 00000100:00080000:0.0:1651530167.424360:0:39100:0:(import.c:614:import_select_connection()) MGC10.240.43.61@tcp: import 000000000aba9d44 using connection MGC10.240.43.61@tcp_0/10.240.43.61@tcp 00000100:00100000:0.0:1651530167.424371:0:39100:0:(import.c:806:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000061ce0fb1 x1731745997089600/t0(0) o250->MGC10.240.43.61@tcp@10.240.43.61@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1651530167.424380:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d0a10f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9063caa-b124-4cb6-99ef-d01a735595c3:39100:1731745997089472:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:0.0:1651530167.424391:0:39098:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000061ce0fb1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9063caa-b124-4cb6-99ef-d01a735595c3:39098:1731745997089600:10.240.43.61@tcp:250:ptlrpcd_00_01.0 00000100:00080000:0.0:1651530167.424680:0:39098:0:(import.c:1073:ptlrpc_connect_interpret()) MGC10.240.43.61@tcp: connect to target with instance 0 10000000:01000000:0.0:1651530167.424688:0:39098:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808005 00000100:02000400:0.0:1651530167.424689:0:39098:0:(import.c:1233:ptlrpc_connect_interpret()) Evicted from MGS (at 10.240.43.61@tcp) after server handle changed from 0x7e7b158553dd6298 to 0x7e7b158553e60190 00000100:00080000:1.0:1651530167.427273:0:39099:0:(import.c:85:import_set_state_nolock()) 0000000070a36139 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1651530167.427276:0:39099:0:(import.c:533:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 10.240.43.61@tcp last attempt 20321 00000100:00080000:1.0:1651530167.427292:0:39099:0:(import.c:614:import_select_connection()) lustre-MDT0000-lwp-OST0001: import 0000000070a36139 using connection 10.240.43.61@tcp/10.240.43.61@tcp 00000100:00100000:1.0:1651530167.427305:0:39099:0:(import.c:806:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000047d5dd29 x1731745997089664/t0(0) o38->lustre-MDT0000-lwp-OST0001@10.240.43.61@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1651530167.427312:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004918d6ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:39099:1731745997089536:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00080000:0.0:1651530167.429458:0:39098:0:(import.c:85:import_set_state_nolock()) 000000000aba9d44 MGS: changing import state from CONNECTING to EVICTED 00000100:00080000:0.0:1651530167.429461:0:39098:0:(import.c:1572:ptlrpc_import_recovery_state_machine()) evicted from MGS@10.240.43.61@tcp; invalidating 00000100:00100000:0.0:1651530167.429530:0:39098:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000061ce0fb1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9063caa-b124-4cb6-99ef-d01a735595c3:39098:1731745997089600:10.240.43.61@tcp:250:ptlrpcd_00_01.0 00000100:00100000:0.0:1651530167.429538:0:39098:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047d5dd29 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:39098:1731745997089664:10.240.43.61@tcp:38:ptlrpcd_00_00.0 00000100:00080000:0.0:1651530167.429576:0:180647:0:(import.c:1512:ptlrpc_invalidate_import_thread()) thread invalidate import MGC10.240.43.61@tcp to MGS@10.240.43.61@tcp 00000100:00100000:0.0:1651530167.429578:0:180647:0:(import.c:338:ptlrpc_invalidate_import()) Sleeping 100s for inflight to error out 10000000:01000000:0.0:1651530167.429579:0:180647:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808003 00010000:00010000:0.0:1651530167.429593:0:180647:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 0000000045fe8361/0x3234de053c54359 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x7e7b158553dd62a6 expref: -99 pid: 166096 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1651530167.429607:0:180647:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 0000000045fe8361/0x3234de053c54359 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x7e7b158553dd62a6 expref: -99 pid: 166096 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1651530167.429616:0:180647:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1651530167.429631:0:180647:0:(ldlm_request.c:1250:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1651530167.429635:0:180647:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 0000000045fe8361/0x3234de053c54359 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x7e7b158553dd62a6 expref: -99 pid: 166096 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530167.429641:0:180647:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 00000000b65e0a0d/0x3234de053c54352 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x7e7b158553dd629f expref: -99 pid: 166096 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1651530167.429643:0:180647:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 00000000b65e0a0d/0x3234de053c54352 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x7e7b158553dd629f expref: -99 pid: 166096 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1651530167.429646:0:180647:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1651530167.429647:0:180647:0:(ldlm_request.c:1250:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1651530167.429647:0:180647:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 00000000b65e0a0d/0x3234de053c54352 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x7e7b158553dd629f expref: -99 pid: 166096 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530167.429650:0:180647:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 000000003c5315da/0x3234de053c54360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x7e7b158553dd62ad expref: -99 pid: 166096 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1651530167.429653:0:180647:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 000000003c5315da/0x3234de053c54360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x7e7b158553dd62ad expref: -99 pid: 166096 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1651530167.429655:0:180647:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1651530167.429656:0:180647:0:(ldlm_request.c:1250:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1651530167.429656:0:180647:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 000000003c5315da/0x3234de053c54360 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x7e7b158553dd62ad expref: -99 pid: 166096 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530167.429659:0:180647:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 00000000e35b0bde/0x3234de053c5437c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x7e7b158553dd62bb expref: -99 pid: 166096 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1651530167.429661:0:180647:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 00000000e35b0bde/0x3234de053c5437c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x7e7b158553dd62bb expref: -99 pid: 166096 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1651530167.429663:0:180647:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1651530167.429664:0:180647:0:(ldlm_request.c:1250:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1651530167.429665:0:180647:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 00000000e35b0bde/0x3234de053c5437c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x7e7b158553dd62bb expref: -99 pid: 166096 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530167.429668:0:180647:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 00000000294488b6/0x3234de053c54398 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x7e7b158553dd631d expref: -99 pid: 166108 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1651530167.429671:0:180647:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 00000000294488b6/0x3234de053c54398 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x7e7b158553dd631d expref: -99 pid: 166108 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1651530167.429673:0:180647:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1651530167.429674:0:180647:0:(ldlm_request.c:1250:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1651530167.429674:0:180647:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 00000000294488b6/0x3234de053c54398 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x7e7b158553dd631d expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1651530167.429678:0:180647:0:(import.c:85:import_set_state_nolock()) 000000000aba9d44 MGS: changing import state from EVICTED to RECOVER 00000100:00080000:0.0:1651530167.429680:0:180647:0:(import.c:85:import_set_state_nolock()) 000000000aba9d44 MGS: changing import state from RECOVER to FULL 10000000:01000000:0.0:1651530167.429681:0:180647:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1651530167.429681:0:180647:0:(pinger.c:207:ptlrpc_pinger_ir_up()) IR up 00000100:02000000:0.0:1651530167.429683:0:180647:0:(import.c:1642:ptlrpc_import_recovery_state_machine()) MGC10.240.43.61@tcp: Connection restored to 10.240.43.61@tcp (at 10.240.43.61@tcp) 00000100:00080000:0.0:1651530167.432487:0:39098:0:(import.c:1073:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 9 00000100:00080000:0.0:1651530167.434657:0:39098:0:(import.c:1279:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@0000000047d5dd29 x1731745997089664/t0(0) o38->lustre-MDT0000-lwp-OST0001@10.240.43.61@tcp:12/10 lens 520/416 e 0 to 0 dl 1651530173 ref 1 fl Interpret:RNQU/0/0 rc 0/0 job:'ptlrpcd_00_00.0' 00000100:00080000:0.0:1651530167.434662:0:39098:0:(import.c:85:import_set_state_nolock()) 0000000070a36139 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1651530167.434663:0:39098:0:(import.c:85:import_set_state_nolock()) 0000000070a36139 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1651530167.434664:0:39098:0:(import.c:1642:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 10.240.43.61@tcp (at 10.240.43.61@tcp) 00000100:00100000:0.0:1651530167.434666:0:39098:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047d5dd29 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:39098:1731745997089664:10.240.43.61@tcp:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1651530168.032211:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530168.032249:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946859584 00000100:00100000:1.0:1651530168.032270:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 105 00000100:00100000:1.0:1651530168.032273:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000061ce0fb1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946859584:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1651530168.032289:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 275043264 pending 0 free 81307987968 avail 77137276928 00000100:00100000:1.0:1651530168.032322:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000061ce0fb1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946859584:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 48us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530168.032326:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 105 10000000:01000000:0.0:1651530169.150247:0:166108:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1651530169.150250:0:166108:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff94e0d279b000 from 205 10000000:01000000:0.0:1651530169.150252:0:166108:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1651530169.150284:0:166108:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 00000000e270377c/0x3234de053c55d7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530169.150290:0:166108:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 00000000e270377c/0x3234de053c55d7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530169.150295:0:166108:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 00000000e270377c/0x3234de053c55d7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651530169.150306:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d0a10f8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997089728:10.240.43.61@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1651530169.150341:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 000000008dbebba1 going to sleep for 6 seconds 00000100:00100000:0.0:1651530169.151903:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d0a10f8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997089728:10.240.43.61@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1651530169.151921:0:166108:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 00000000e270377c/0x3234de053c55d7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e6019e expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530169.151931:0:166108:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 00000000e270377c/0x3234de053c55d7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553e6019e expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651530169.151966:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d0a10f8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997089792:10.240.43.61@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1651530169.151978:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 000000008dbebba1 going to sleep for 6 seconds 00000100:00100000:0.0:1651530169.153284:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d0a10f8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997089792:10.240.43.61@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1651530169.153297:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d0a10f8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997089856:10.240.43.61@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1651530169.153311:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 000000008dbebba1 going to sleep for 6 seconds 00000100:00100000:0.0:1651530169.153604:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d0a10f8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997089856:10.240.43.61@tcp:503:ll_cfg_requeue.0 00000040:00080000:1.0:1651530169.154468:0:180842:0:(llog.c:768:llog_process_thread()) stop processing plain 0x3:10:0 index 64768 count 201 00000020:01000000:0.0:1651530169.154946:0:166108:0:(obd_config.c:2042:class_config_parse_llog()) Processed log lustre-client gen 205-204 (rc=0) 10000000:01000000:0.0:1651530169.154955:0:166108:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1651530169.154957:0:166108:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000e270377c/0x3234de053c55d7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e6019e expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530169.154962:0:166108:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 00000000e270377c/0x3234de053c55d7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e6019e expref: -99 pid: 166108 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1651530169.154966:0:166108:0:(mgc_request.c:609:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1651530169.154967:0:166108:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1651530169.154968:0:166108:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1651530169.154974:0:166108:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 00000000cb70d261/0x3234de053c55d84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530169.154977:0:166108:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 00000000cb70d261/0x3234de053c55d84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530169.154981:0:166108:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 00000000cb70d261/0x3234de053c55d84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651530169.154987:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d0a10f8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997089920:10.240.43.61@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1651530169.155001:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 000000009973ad87 going to sleep for 6 seconds 00000100:00100000:0.0:1651530169.155485:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d0a10f8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997089920:10.240.43.61@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1651530169.155491:0:166108:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 00000000cb70d261/0x3234de053c55d84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e601a5 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530169.155495:0:166108:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 00000000cb70d261/0x3234de053c55d84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553e601a5 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651530169.155525:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d0a10f8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997089984:10.240.43.61@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1651530169.155537:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 000000009973ad87 going to sleep for 6 seconds 00000100:00100000:0.0:1651530169.155914:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d0a10f8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997089984:10.240.43.61@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1651530169.155924:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d0a10f8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997090048:10.240.43.61@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1651530169.155936:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 000000009973ad87 going to sleep for 6 seconds 00000100:00100000:0.0:1651530169.158243:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d0a10f8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997090048:10.240.43.61@tcp:503:ll_cfg_requeue.0 00000040:00080000:0.0:1651530169.158762:0:180847:0:(llog.c:768:llog_process_thread()) stop processing plain 0x9:10:0 index 64768 count 8 00000020:01000000:0.0:1651530169.158794:0:166108:0:(obd_config.c:2042:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-7 (rc=0) 10000000:01000000:0.0:1651530169.158799:0:166108:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1651530169.158801:0:166108:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000cb70d261/0x3234de053c55d84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e601a5 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530169.158806:0:166108:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 00000000cb70d261/0x3234de053c55d84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e601a5 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1651530169.158809:0:166108:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:0.0:1651530169.158810:0:166108:0:(mgc_request.c:2064:mgc_process_log()) Process log params-ffff94e0d279b000 from 19 10000000:01000000:0.0:1651530169.158811:0:166108:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1651530169.158818:0:166108:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 000000004926c34d/0x3234de053c55d8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530169.158820:0:166108:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 000000004926c34d/0x3234de053c55d8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530169.158824:0:166108:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 000000004926c34d/0x3234de053c55d8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651530169.158832:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d0a10f8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997090112:10.240.43.61@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1651530169.158846:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 0000000080004f0a going to sleep for 6 seconds 00000100:00100000:0.0:1651530169.160138:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d0a10f8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997090112:10.240.43.61@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1651530169.160143:0:166108:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 000000004926c34d/0x3234de053c55d8b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e601ac expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530169.160147:0:166108:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 000000004926c34d/0x3234de053c55d8b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553e601ac expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651530169.160173:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d0a10f8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997090176:10.240.43.61@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1651530169.160185:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 0000000080004f0a going to sleep for 6 seconds 00000100:00100000:0.0:1651530169.160380:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d0a10f8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997090176:10.240.43.61@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1651530169.160390:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d0a10f8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997090240:10.240.43.61@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1651530169.160403:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 0000000080004f0a going to sleep for 6 seconds 00000100:00100000:0.0:1651530169.160620:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d0a10f8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997090240:10.240.43.61@tcp:503:ll_cfg_requeue.0 00000040:00080000:0.0:1651530169.161108:0:180848:0:(llog.c:768:llog_process_thread()) stop processing plain 0x2:10:0 index 64768 count 19 00000020:01000000:0.0:1651530169.161140:0:166108:0:(obd_config.c:2042:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:0.0:1651530169.161146:0:166108:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1651530169.161148:0:166108:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 000000004926c34d/0x3234de053c55d8b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e601ac expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530169.161162:0:166108:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 000000004926c34d/0x3234de053c55d8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e601ac expref: -99 pid: 166108 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1651530169.161166:0:166108:0:(mgc_request.c:609:do_requeue()) updating log nodemap 10000000:01000000:0.0:1651530169.161167:0:166108:0:(mgc_request.c:2064:mgc_process_log()) Process log nodemap-ffff94e0b53b8000 from 1 10000000:01000000:0.0:1651530169.161168:0:166108:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1651530169.161175:0:166108:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 00000000721302df/0x3234de053c55d92 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530169.161178:0:166108:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 00000000721302df/0x3234de053c55d92 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530169.161181:0:166108:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 00000000721302df/0x3234de053c55d92 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651530169.161186:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d0a10f8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997090304:10.240.43.61@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1651530169.161200:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b1b3d0f8 going to sleep for 6 seconds 00000100:00100000:0.0:1651530169.161410:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d0a10f8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997090304:10.240.43.61@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1651530169.161415:0:166108:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 00000000721302df/0x3234de053c55d92 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e601b3 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530169.161419:0:166108:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 00000000721302df/0x3234de053c55d92 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553e601b3 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651530169.161493:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d0a10f8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997090368:10.240.43.61@tcp:256:ll_cfg_requeue.0 00000100:00100000:0.0:1651530169.161507:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 00000000da6544bb going to sleep for 6 seconds 00000100:00100000:0.0:1651530169.162086:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d0a10f8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997090368:10.240.43.61@tcp:256:ll_cfg_requeue.0 00080000:10000000:0.0:1651530169.163419:0:166108:0:(osd_handler.c:5198:osd_index_try()) lustre-OST0001: index object [0x200000003:0x12:0x0] (8/32) registered 10000000:01000000:0.0:1651530169.163476:0:166108:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1651530169.163479:0:166108:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000721302df/0x3234de053c55d92 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e601b3 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530169.163483:0:166108:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 00000000721302df/0x3234de053c55d92 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e601b3 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1651530169.163493:0:166108:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1651530169.163493:0:166108:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff94e0b53b8000 from 1 10000000:01000000:0.0:1651530169.163494:0:166108:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1651530169.163501:0:166108:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 00000000d6999e11/0x3234de053c55d99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530169.163503:0:166108:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 00000000d6999e11/0x3234de053c55d99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530169.163507:0:166108:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 00000000d6999e11/0x3234de053c55d99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651530169.163513:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d0a10f8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997090432:10.240.43.61@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1651530169.163527:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 000000009973ad87 going to sleep for 6 seconds 00000100:00100000:0.0:1651530169.163764:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d0a10f8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997090432:10.240.43.61@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1651530169.163769:0:166108:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 00000000d6999e11/0x3234de053c55d99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e601ba expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530169.163773:0:166108:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 00000000d6999e11/0x3234de053c55d99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553e601ba expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1651530169.163788:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d0a10f8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997090496:10.240.43.61@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1651530169.163798:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 000000009973ad87 going to sleep for 6 seconds 00000100:00100000:0.0:1651530169.163965:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d0a10f8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997090496:10.240.43.61@tcp:501:ll_cfg_requeue.0 10000000:01000000:0.0:1651530169.163973:0:166108:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1651530169.163975:0:166108:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000d6999e11/0x3234de053c55d99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e601ba expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530169.163990:0:166108:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 00000000d6999e11/0x3234de053c55d99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e601ba expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00000400:00000080:0.0:1651530169.235159:0:180865:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530169.235162:0:180865:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 160d: verify that changelog log catch the migrate event ========================================================== 22:22:48 (1651530168) 00000400:00000080:0.0:1651530169.573186:0:180919:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530169.573188:0:180919:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity test_160d needs >= 2 MDTs 00000400:00000080:0.0:1651530169.910035:0:180973:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530169.910038:0:180973:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 160e: changelog negative testing (should return errors) ========================================================== 22:22:49 (1651530169) 00000400:00000080:1.0:1651530172.718916:0:181191:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651530172.718918:0:181191:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 160f: changelog garbage collect (timestamped users) ========================================================== 22:22:52 (1651530172) 00000100:00100000:0.0:1651530173.152250:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651530173.152270:0:166115:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946859712 00000100:00100000:0.0:1651530173.152295:0:166115:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 106 00000100:00100000:0.0:1651530173.152298:0:166115:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d0a10f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946859712:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651530173.152316:0:166115:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 275043264 pending 0 free 81307987968 avail 77137276928 00000100:00100000:0.0:1651530173.152342:0:166115:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d0a10f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946859712:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 44us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530173.152346:0:166115:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 106 00000400:00000080:1.0:1651530174.230775:0:181245:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651530174.230778:0:181245:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: 1651530173: creating first files 00000100:00100000:0.0:1651530175.681090:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:0.0:1651530175.681110:0:176086:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356295424 00002000:00100000:0.0:1651530175.681135:0:176086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2c0a1:0x0] (0->157) req@00000000f9cddebc x1731754356295424/t0(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:146/0 lens 648/0 e 0 to 0 dl 1651530181 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cp.0' 00002000:00100000:0.0:1651530175.681141:0:176086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f9cddebc with x1731754356295424 ext(0->157) 00002000:00010000:0.0:1651530175.681144:0:176086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f9cddebc 00000100:00100000:0.0:1651530175.681172:0:176086:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 100 00000100:00100000:0.0:1651530175.681174:0:176086:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f9cddebc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438149:x1731754356295424:12345-10.240.43.64@tcp:4:cp.0 00000100:00100000:0.0:1651530175.681569:0:176086:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f9cddebc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cccc371e-feb6-4a45-b229-8d88a861b48a+8:438149:x1731754356295424:12345-10.240.43.64@tcp:4:cp.0 Request processed in 393us (483us total) trans 21474837392 rc 0/0 00000100:00100000:0.0:1651530175.681573:0:176086:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 100 00002000:00100000:0.0:1651530175.681576:0:176086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x2c0a1:0x0] (0->157) req@00000000f9cddebc x1731754356295424/t21474837392(0) o4->cccc371e-feb6-4a45-b229-8d88a861b48a@10.240.43.64@tcp:146/0 lens 648/448 e 0 to 0 dl 1651530181 ref 1 fl Complete:/0/0 rc 0/0 job:'cp.0' 00002000:00100000:0.0:1651530175.681581:0:176086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f9cddebc with x1731754356295424 ext(0->157) 00002000:00010000:0.0:1651530175.681582:0:176086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f9cddebc 00000100:00100000:0.0:1651530178.272207:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651530178.272247:0:166115:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946859776 00000100:00100000:0.0:1651530178.272274:0:166115:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 107 00000100:00100000:0.0:1651530178.272276:0:166115:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a2199fb1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946859776:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651530178.272294:0:166115:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 283481024 pending 28672 free 81307983872 avail 77137272832 00000100:00100000:0.0:1651530178.272319:0:166115:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a2199fb1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946859776:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 43us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530178.272323:0:166115:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 107 00000001:00080000:0.0:1651530181.275514:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474837392 is committed 00000100:00100000:0.0:1651530181.313002:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530181.313037:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356295616 00000100:00100000:1.0:1651530181.313066:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13 00000100:00100000:1.0:1651530181.313068:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b2e24dbc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438149:x1731754356295616:12345-10.240.43.64@tcp:400:kworker/u4:2.0 00000100:00100000:1.0:1651530181.313109:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b2e24dbc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438149:x1731754356295616:12345-10.240.43.64@tcp:400:kworker/u4:2.0 Request processed in 40us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530181.313112:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13 00000100:00100000:0.0:1651530183.392197:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651530183.392216:0:166115:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946860096 00000100:00100000:0.0:1651530183.392254:0:166115:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 108 00000100:00100000:0.0:1651530183.392257:0:166115:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e3949a42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946860096:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651530183.392275:0:166115:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 283452352 pending 0 free 81307983872 avail 77137272832 00000100:00100000:0.0:1651530183.392302:0:166115:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e3949a42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946860096:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 44us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530183.392305:0:166115:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 108 00000100:00100000:0.0:1651530188.512242:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651530188.512263:0:166115:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946860160 00000100:00100000:0.0:1651530188.512289:0:166115:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 109 00000100:00100000:0.0:1651530188.512292:0:166115:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000004d017c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946860160:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651530188.512311:0:166115:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 283452352 pending 0 free 81307983872 avail 77137272832 00000100:00100000:0.0:1651530188.512337:0:166115:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000004d017c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946860160:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 45us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530188.512341:0:166115:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 109 00000400:00000080:1.0:1651530189.845805:0:181463:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651530189.845807:0:181463:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 160g: changelog garbage collect on idle records ========================================================== 22:23:09 (1651530189) 00000100:00100000:1.0:1651530192.509329:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009b810a5d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:39099:1731745997090624:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:0.0:1651530192.509383:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e85686f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9063caa-b124-4cb6-99ef-d01a735595c3:39100:1731745997090560:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:0.0:1651530192.513836:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e85686f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9063caa-b124-4cb6-99ef-d01a735595c3:39100:1731745997090560:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:1.0:1651530192.513837:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009b810a5d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:39099:1731745997090624:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:1.0:1651530193.632209:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651530193.632254:0:166115:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946860288 00000100:00100000:0.0:1651530193.632280:0:166115:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 110 00000100:00100000:0.0:1651530193.632283:0:166115:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b810a5d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946860288:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651530193.632301:0:166115:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 283452352 pending 0 free 81307983872 avail 77137272832 00000100:00100000:0.0:1651530193.632329:0:166115:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b810a5d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946860288:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 46us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530193.632333:0:166115:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 110 00000100:00100000:1.0:1651530198.753780:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651530198.753815:0:166115:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946860416 00000100:00100000:0.0:1651530198.753848:0:166115:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 111 00000100:00100000:0.0:1651530198.753851:0:166115:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000315faada pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946860416:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651530198.753873:0:166115:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 283452352 pending 0 free 81307983872 avail 77137272832 00000100:00100000:0.0:1651530198.753903:0:166115:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000315faada pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946860416:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 52us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530198.753907:0:166115:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 111 00000400:00000080:1.0:1651530199.257791:0:181681:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651530199.257793:0:181681:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 160h: changelog gc thread stop upon umount, orphan records delete ========================================================== 22:23:18 (1651530198) 00000100:00100000:1.0:1651530203.872216:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651530203.872271:0:166115:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946860672 00000100:00100000:0.0:1651530203.872298:0:166115:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 112 00000100:00100000:0.0:1651530203.872301:0:166115:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001faa7f64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946860672:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651530203.872318:0:166115:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 283452352 pending 0 free 81307983872 avail 77137272832 00000100:00100000:0.0:1651530203.872345:0:166115:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001faa7f64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946860672:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 44us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530203.872348:0:166115:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 112 00000100:00100000:1.0:1651530205.889016:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530205.889028:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356301248 00000100:00100000:1.0:1651530205.889045:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 14 00000100:00100000:1.0:1651530205.889047:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e85686f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438146:x1731754356301248:12345-10.240.43.64@tcp:400:kworker/u4:2.0 00000100:00100000:1.0:1651530205.889066:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e85686f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438146:x1731754356301248:12345-10.240.43.64@tcp:400:kworker/u4:2.0 Request processed in 18us (51us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530205.889069:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 14 00000100:00100000:1.0:1651530208.992093:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651530208.992118:0:166115:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946860800 00000100:00100000:0.0:1651530208.992134:0:166115:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 113 00000100:00100000:0.0:1651530208.992136:0:166115:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047d5dd29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946860800:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651530208.992146:0:166115:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 283452352 pending 0 free 81307983872 avail 77137272832 00000100:00100000:0.0:1651530208.992160:0:166115:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047d5dd29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745946860800:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 23us (69us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530208.992164:0:166115:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 113 00000100:00100000:1.0:1651530214.113074:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651530214.113107:0:166115:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946860992 00000100:00100000:0.0:1651530214.113134:0:166115:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 114 00000100:00100000:0.0:1651530214.113137:0:166115:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2e9b0c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946860992:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651530214.113156:0:166115:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 283452352 pending 0 free 81307983872 avail 77137272832 00000100:00100000:0.0:1651530214.113196:0:166115:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2e9b0c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946860992:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 58us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530214.113200:0:166115:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 114 00000100:00100000:1.0:1651530214.638996:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530214.639017:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946861504 00000100:00100000:1.0:1651530214.639042:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 944 00000100:00100000:1.0:1651530214.639045:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000007e6c323 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:251973:x1731745946861504:12345-10.240.43.61@tcp:9:umount.0 00000020:00000080:1.0:1651530214.639064:0:166111:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0x3234de053c55c96 00000100:00080000:1.0:1651530214.639067:0:166111:0:(import.c:85:import_set_state_nolock()) 0000000021d824d5 ¶×à”ÿÿ: changing import state from FULL to CLOSED 00000001:00000004:1.0:1651530214.639087:0:166111:0:(tgt_lastrcvd.c:701:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 5, last_transno is 21474837392 00000100:00100000:1.0:1651530214.639162:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000007e6c323 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:251973:x1731745946861504:12345-10.240.43.61@tcp:9:umount.0 Request processed in 116us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530214.639166:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 944 00000100:00100000:0.0:1651530217.597302:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000086faad8f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9063caa-b124-4cb6-99ef-d01a735595c3:39100:1731745997090688:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:1.0:1651530217.597308:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006625e28d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:39099:1731745997090752:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00080000:1.0:1651530217.597630:0:39099:0:(recover.c:232:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@10.240.43.61@tcp abruptly disconnected: reconnecting 00000100:00080000:1.0:1651530217.597633:0:39099:0:(import.c:85:import_set_state_nolock()) 0000000070a36139 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1651530217.597635:0:39099:0:(import.c:199:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 10.240.43.61@tcp) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1651530217.600719:0:39099:0:(import.c:85:import_set_state_nolock()) 0000000070a36139 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1651530217.600722:0:39099:0:(import.c:533:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 10.240.43.61@tcp last attempt 20826 00000100:00080000:1.0:1651530217.600725:0:39099:0:(import.c:614:import_select_connection()) lustre-MDT0000-lwp-OST0001: import 0000000070a36139 using connection 10.240.43.61@tcp/10.240.43.61@tcp 00000100:00100000:1.0:1651530217.600736:0:39099:0:(import.c:806:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b17a3a78 x1731745997090816/t0(0) o38->lustre-MDT0000-lwp-OST0001@10.240.43.61@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1651530217.600750:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006625e28d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:39099:1731745997090752:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:0.0:1651530217.600766:0:39098:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b17a3a78 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:39098:1731745997090816:10.240.43.61@tcp:38:ptlrpcd_00_00.0 00000100:00080000:0.0:1651530217.601051:0:39098:0:(import.c:85:import_set_state_nolock()) 0000000070a36139 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1651530217.601055:0:39098:0:(import.c:1428:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 10.240.43.61@tcp failed (-19) 00000100:00100000:0.0:1651530217.601057:0:39098:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b17a3a78 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:39098:1731745997090816:10.240.43.61@tcp:38:ptlrpcd_00_00.0 00000001:00100000:0.0:1651530220.179373:0:166098:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1651530220.179376:0:166098:0:(genops.c:985:class_export_put()) final put 0000000068bfeb88/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1651530220.179384:0:159543:0:(genops.c:944:class_export_destroy()) destroying export 0000000068bfeb88/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1651530220.179399:0:159543:0:(genops.c:1164:obd_zombie_import_free()) destroying import 0000000021d824d5 for lustre-OST0001 00000100:00100000:1.0:1651530224.015395:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530224.015416:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946862400 00000100:00100000:1.0:1651530224.015441:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 945 00000100:00100000:1.0:1651530224.015443:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a547dc4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:39028:x1731745946862400:12345-10.240.43.61@tcp:8:llog_process_th.0 00010000:00080000:1.0:1651530224.015459:0:166111:0:(ldlm_lib.c:1365:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@10.240.43.61@tcp t0 exp 0000000055bfac58 cur 20882 last 0 00000020:00000080:1.0:1651530224.015472:0:166111:0:(genops.c:1359:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3234de053c55da0 00002000:00100000:1.0:1651530224.015477:0:166111:0:(ofd_obd.c:150:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/000000002c06d95b ocd_connect_flags: 0x2044401443000066 ocd_version: 20f0000 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1651530224.015479:0:166111:0:(ofd_obd.c:168:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1651530224.015480:0:166111:0:(ofd_obd.c:257:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000020:01000000:1.0:1651530224.015513:0:166111:0:(lprocfs_status_server.c:544:lprocfs_exp_setup()) using hash 00000000427049c0 00002000:00080000:1.0:1651530224.015517:0:166111:0:(ofd_obd.c:391:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1651530224.015529:0:166111:0:(import.c:85:import_set_state_nolock()) 000000004330fa25 ¶×à”ÿÿ: changing import state from RECOVER to FULL 00000100:00100000:1.0:1651530224.015561:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a547dc4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:39028:x1731745946862400:12345-10.240.43.61@tcp:8:llog_process_th.0 Request processed in 117us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530224.015576:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 945 00000100:00100000:1.0:1651530224.015861:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651530224.015880:0:166115:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946862528 00000100:00100000:0.0:1651530224.015899:0:166115:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 115 00000100:00100000:0.0:1651530224.015901:0:166115:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000090e7bd5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946862528:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651530224.015912:0:166115:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 283452352 pending 0 free 81307983872 avail 77137272832 00000100:00100000:0.0:1651530224.015929:0:166115:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000090e7bd5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946862528:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 28us (69us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530224.015933:0:166115:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 115 00000100:00000400:0.0:1651530224.765255:0:39100:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1651530217/real 1651530217] req@0000000086faad8f x1731745997090688/t0(0) o400->MGC10.240.43.61@tcp@10.240.43.61@tcp:26/25 lens 224/224 e 0 to 1 dl 1651530224 ref 1 fl Rpc:XNQr/0/ffffffff rc 0/-1 job:'kworker/u4:2.0' 00000100:00100000:0.0:1651530224.770737:0:39100:0:(client.c:2339:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@0000000086faad8f x1731745997090688/t0(0) o400->MGC10.240.43.61@tcp@10.240.43.61@tcp:26/25 lens 224/224 e 0 to 1 dl 1651530224 ref 1 fl Rpc:XNQU/0/ffffffff rc 0/-1 job:'kworker/u4:2.0' 00000100:00080000:0.0:1651530224.770742:0:39100:0:(import.c:85:import_set_state_nolock()) 000000000aba9d44 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1651530224.770744:0:39100:0:(import.c:205:ptlrpc_set_import_discon()) 166-1: MGC10.240.43.61@tcp: Connection to MGS (at 10.240.43.61@tcp) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1651530224.773238:0:39100:0:(import.c:211:ptlrpc_set_import_discon()) import MGS@10.240.43.61@tcp for MGC10.240.43.61@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1651530224.773240:0:39100:0:(import.c:156:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1651530224.773242:0:39100:0:(client.c:3319:ptlrpc_abort_inflight()) @@@ inflight req@0000000086faad8f x1731745997090688/t0(0) o400->MGC10.240.43.61@tcp@10.240.43.61@tcp:26/25 lens 224/224 e 0 to 1 dl 1651530224 ref 1 fl Rpc:XNQU/0/ffffffff rc 0/-1 job:'kworker/u4:2.0' 00000100:00080000:1.0:1651530224.773250:0:153568:0:(pinger.c:250:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 10000000:01000000:0.0:1651530224.773250:0:39100:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1651530224.773251:0:39100:0:(pinger.c:214:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1651530224.773252:0:39100:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1651530224.773253:0:39100:0:(import.c:433:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00080000:1.0:1651530224.773254:0:153568:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1651530224.773256:0:153568:0:(import.c:85:import_set_state_nolock()) 0000000070a36139 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1651530224.773260:0:153568:0:(import.c:533:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 10.240.43.61@tcp last attempt 20876 00000100:00080000:1.0:1651530224.773261:0:153568:0:(import.c:580:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 6s 00000100:00080000:1.0:1651530224.773265:0:153568:0:(import.c:614:import_select_connection()) lustre-MDT0000-lwp-OST0001: import 0000000070a36139 using connection 10.240.43.61@tcp/10.240.43.61@tcp 00000100:00100000:0.0:1651530224.773271:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000086faad8f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9063caa-b124-4cb6-99ef-d01a735595c3:39100:1731745997090688:10.240.43.61@tcp:400:kworker/u4:2.0 00000100:00100000:1.0:1651530224.773281:0:153568:0:(import.c:806:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000615d6d1e x1731745997090880/t0(0) o38->lustre-MDT0000-lwp-OST0001@10.240.43.61@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:1.0:1651530224.773295:0:153568:0:(pinger.c:250:ptlrpc_pinger_process_import()) c9063caa-b124-4cb6-99ef-d01a735595c3->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1651530224.773296:0:153568:0:(recover.c:57:ptlrpc_initiate_recovery()) MGS: starting recovery 00000100:00080000:1.0:1651530224.773297:0:153568:0:(import.c:85:import_set_state_nolock()) 000000000aba9d44 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1651530224.773298:0:153568:0:(import.c:533:import_select_connection()) MGC10.240.43.61@tcp: connect to NID 10.240.43.61@tcp last attempt 20826 00000100:00080000:1.0:1651530224.773300:0:153568:0:(import.c:614:import_select_connection()) MGC10.240.43.61@tcp: import 000000000aba9d44 using connection MGC10.240.43.61@tcp_0/10.240.43.61@tcp 00000100:00100000:1.0:1651530224.773303:0:153568:0:(import.c:806:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000001a688b8 x1731745997090944/t0(0) o250->MGC10.240.43.61@tcp@10.240.43.61@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1651530224.773318:0:39098:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000615d6d1e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:39098:1731745997090880:10.240.43.61@tcp:38:kworker/u4:0.0 00000100:00100000:1.0:1651530224.773354:0:39098:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000001a688b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9063caa-b124-4cb6-99ef-d01a735595c3:39098:1731745997090944:10.240.43.61@tcp:250:kworker/u4:0.0 00010000:00080000:1.0:1651530224.776081:0:39098:0:(ldlm_request.c:1448:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@00000000615d6d1e x1731745997090880/t0(0) o38->lustre-MDT0000-lwp-OST0001@10.240.43.61@tcp:12/10 lens 520/416 e 0 to 0 dl 1651530235 ref 1 fl Rpc:RNQU/0/0 rc 0/0 job:'kworker/u4:0.0' 00000100:00080000:1.0:1651530224.776088:0:39098:0:(import.c:1073:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 10 00000100:00080000:1.0:1651530224.777813:0:39098:0:(import.c:1279:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@00000000615d6d1e x1731745997090880/t0(0) o38->lustre-MDT0000-lwp-OST0001@10.240.43.61@tcp:12/10 lens 520/416 e 0 to 0 dl 1651530235 ref 1 fl Interpret:RNQU/0/0 rc 0/0 job:'kworker/u4:0.0' 00000100:00080000:1.0:1651530224.777825:0:39098:0:(import.c:85:import_set_state_nolock()) 0000000070a36139 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1651530224.777827:0:39098:0:(import.c:85:import_set_state_nolock()) 0000000070a36139 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1651530224.777829:0:39098:0:(import.c:1642:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 10.240.43.61@tcp (at 10.240.43.61@tcp) 00000100:00100000:1.0:1651530224.780714:0:39098:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000615d6d1e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:39098:1731745997090880:10.240.43.61@tcp:38:kworker/u4:0.0 00000100:00080000:1.0:1651530224.780722:0:39098:0:(import.c:1073:ptlrpc_connect_interpret()) MGC10.240.43.61@tcp: connect to target with instance 0 10000000:01000000:1.0:1651530224.780725:0:39098:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808005 00000100:02000400:1.0:1651530224.780726:0:39098:0:(import.c:1233:ptlrpc_connect_interpret()) Evicted from MGS (at 10.240.43.61@tcp) after server handle changed from 0x7e7b158553e60190 to 0x7e7b158553e6062f 00000100:00080000:1.0:1651530224.782886:0:39098:0:(import.c:85:import_set_state_nolock()) 000000000aba9d44 MGS: changing import state from CONNECTING to EVICTED 00000100:00080000:1.0:1651530224.782888:0:39098:0:(import.c:1572:ptlrpc_import_recovery_state_machine()) evicted from MGS@10.240.43.61@tcp; invalidating 00000100:00100000:1.0:1651530224.782975:0:39098:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000001a688b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9063caa-b124-4cb6-99ef-d01a735595c3:39098:1731745997090944:10.240.43.61@tcp:250:kworker/u4:0.0 00000100:00080000:1.0:1651530224.782984:0:181685:0:(import.c:1512:ptlrpc_invalidate_import_thread()) thread invalidate import MGC10.240.43.61@tcp to MGS@10.240.43.61@tcp 00000100:00100000:1.0:1651530224.782986:0:181685:0:(import.c:338:ptlrpc_invalidate_import()) Sleeping 100s for inflight to error out 10000000:01000000:1.0:1651530224.782987:0:181685:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808003 00010000:00010000:1.0:1651530224.782993:0:181685:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 00000000721302df/0x3234de053c55d92 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x7e7b158553e601b3 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1651530224.782999:0:181685:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 00000000721302df/0x3234de053c55d92 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x7e7b158553e601b3 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651530224.783001:0:181685:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1651530224.783008:0:181685:0:(ldlm_request.c:1250:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1651530224.783011:0:181685:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 00000000721302df/0x3234de053c55d92 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x7e7b158553e601b3 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530224.783016:0:181685:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 00000000e270377c/0x3234de053c55d7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x7e7b158553e6019e expref: -99 pid: 166108 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1651530224.783032:0:181685:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 00000000e270377c/0x3234de053c55d7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x7e7b158553e6019e expref: -99 pid: 166108 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651530224.783035:0:181685:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1651530224.783036:0:181685:0:(ldlm_request.c:1250:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1651530224.783037:0:181685:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 00000000e270377c/0x3234de053c55d7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x7e7b158553e6019e expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530224.783040:0:181685:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 00000000cb70d261/0x3234de053c55d84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x7e7b158553e601a5 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1651530224.783042:0:181685:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 00000000cb70d261/0x3234de053c55d84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x7e7b158553e601a5 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651530224.783044:0:181685:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1651530224.783045:0:181685:0:(ldlm_request.c:1250:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1651530224.783046:0:181685:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 00000000cb70d261/0x3234de053c55d84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x7e7b158553e601a5 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530224.783049:0:181685:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 00000000d6999e11/0x3234de053c55d99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x7e7b158553e601ba expref: -99 pid: 166108 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1651530224.783051:0:181685:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 00000000d6999e11/0x3234de053c55d99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x7e7b158553e601ba expref: -99 pid: 166108 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651530224.783053:0:181685:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1651530224.783054:0:181685:0:(ldlm_request.c:1250:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1651530224.783054:0:181685:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 00000000d6999e11/0x3234de053c55d99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x7e7b158553e601ba expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530224.783058:0:181685:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 000000004926c34d/0x3234de053c55d8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x7e7b158553e601ac expref: -99 pid: 166108 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1651530224.783067:0:181685:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 000000004926c34d/0x3234de053c55d8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x7e7b158553e601ac expref: -99 pid: 166108 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651530224.783070:0:181685:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1651530224.783071:0:181685:0:(ldlm_request.c:1250:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1651530224.783071:0:181685:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 000000004926c34d/0x3234de053c55d8b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x7e7b158553e601ac expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00000100:00080000:1.0:1651530224.783076:0:181685:0:(import.c:85:import_set_state_nolock()) 000000000aba9d44 MGS: changing import state from EVICTED to RECOVER 00000100:00080000:1.0:1651530224.783077:0:181685:0:(import.c:85:import_set_state_nolock()) 000000000aba9d44 MGS: changing import state from RECOVER to FULL 10000000:01000000:1.0:1651530224.783077:0:181685:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1651530224.783078:0:181685:0:(pinger.c:207:ptlrpc_pinger_ir_up()) IR up 00000100:02000000:1.0:1651530224.783079:0:181685:0:(import.c:1642:ptlrpc_import_recovery_state_machine()) MGC10.240.43.61@tcp: Connection restored to 10.240.43.61@tcp (at 10.240.43.61@tcp) 00000100:00100000:1.0:1651530225.425379:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530225.425402:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946864256 00000100:00100000:1.0:1651530225.425429:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 946 00000100:00100000:1.0:1651530225.425432:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000001a688b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:252764:x1731745946864256:12345-10.240.43.61@tcp:5:osp-pre-1-0.0 00002000:00080000:1.0:1651530225.425450:0:166111:0:(ofd_dev.c:1586:ofd_create_hdl()) ofd_last_id() = 180449 -> diff = -64 00002000:02000040:1.0:1651530225.425452:0:166111:0:(ofd_dev.c:1442:ofd_orphans_destroy()) lustre-OST0001: deleting orphan objects from 0x0:180386 to 0x0:180449 00002000:00010000:1.0:1651530225.427190:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.427194:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c55da7 lrc: 3/0,1 mode: --/PW res: [0x2c0e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427202:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427203:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427206:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c55da7 lrc: 3/0,1 mode: PW/PW res: [0x2c0e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427213:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c55da7 lrc: 3/0,1 mode: PW/PW res: [0x2c0e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427245:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c55da7 lrc: 3/0,1 mode: PW/PW res: [0x2c0e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427248:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c55da7 lrc: 2/0,0 mode: PW/PW res: [0x2c0e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.427350:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.427352:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c55dae lrc: 3/0,1 mode: --/PW res: [0x2c0e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427355:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427356:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427357:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c55dae lrc: 3/0,1 mode: PW/PW res: [0x2c0e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427361:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c55dae lrc: 3/0,1 mode: PW/PW res: [0x2c0e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427364:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c55dae lrc: 3/0,1 mode: PW/PW res: [0x2c0e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427366:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c55dae lrc: 2/0,0 mode: PW/PW res: [0x2c0e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.427397:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.427399:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c55db5 lrc: 3/0,1 mode: --/PW res: [0x2c0df:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427411:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427412:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427413:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c55db5 lrc: 3/0,1 mode: PW/PW res: [0x2c0df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427417:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c55db5 lrc: 3/0,1 mode: PW/PW res: [0x2c0df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427419:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c55db5 lrc: 3/0,1 mode: PW/PW res: [0x2c0df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427422:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c55db5 lrc: 2/0,0 mode: PW/PW res: [0x2c0df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427448:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c55da7 lrc: 2/0,0 mode: PW/PW res: [0x2c0e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.427452:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.427453:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c55dbc lrc: 3/0,1 mode: --/PW res: [0x2c0de:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427455:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d571c418 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651530225.427456:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427457:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530225.427457:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c55da7 lrc: 2/0,0 mode: PW/PW res: [0x2c0e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427458:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c55dbc lrc: 3/0,1 mode: PW/PW res: [0x2c0de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427461:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c55dbc lrc: 3/0,1 mode: PW/PW res: [0x2c0de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427461:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c55da7 lrc: 3/0,0 mode: PW/PW res: [0x2c0e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427464:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c55dbc lrc: 3/0,1 mode: PW/PW res: [0x2c0de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427469:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c55dbc lrc: 2/0,0 mode: PW/PW res: [0x2c0de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427471:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c55da7 lrc: 1/0,0 mode: --/PW res: [0x2c0e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427474:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d571c418/0x3234de053c55da7 lrc: 0/0,0 mode: --/PW res: [0x2c0e1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427480:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c55dae lrc: 2/0,0 mode: PW/PW res: [0x2c0e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427483:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c5d6b959 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530225.427484:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c55dae lrc: 2/0,0 mode: PW/PW res: [0x2c0e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427487:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c55dae lrc: 3/0,0 mode: PW/PW res: [0x2c0e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427493:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c55dae lrc: 1/0,0 mode: --/PW res: [0x2c0e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427496:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5d6b959/0x3234de053c55dae lrc: 0/0,0 mode: --/PW res: [0x2c0e0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.427498:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651530225.427499:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c55db5 lrc: 2/0,0 mode: PW/PW res: [0x2c0df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427500:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c55dc3 lrc: 3/0,1 mode: --/PW res: [0x2c0dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427502:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000027775c45 already unused, calling callback (0000000049fddea7) 00010000:00010000:1.0:1651530225.427503:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427503:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530225.427503:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c55db5 lrc: 2/0,0 mode: PW/PW res: [0x2c0df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427504:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c55dc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427505:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c55db5 lrc: 3/0,0 mode: PW/PW res: [0x2c0df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427507:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c55dc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427509:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c55db5 lrc: 1/0,0 mode: --/PW res: [0x2c0df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427510:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c55dc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427511:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027775c45/0x3234de053c55db5 lrc: 0/0,0 mode: --/PW res: [0x2c0df:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427513:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c55dc3 lrc: 2/0,0 mode: PW/PW res: [0x2c0dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427515:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c55dbc lrc: 2/0,0 mode: PW/PW res: [0x2c0de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427517:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f1a88dd0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530225.427528:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c55dbc lrc: 2/0,0 mode: PW/PW res: [0x2c0de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427531:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c55dbc lrc: 3/0,0 mode: PW/PW res: [0x2c0de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427535:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c55dbc lrc: 1/0,0 mode: --/PW res: [0x2c0de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427537:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1a88dd0/0x3234de053c55dbc lrc: 0/0,0 mode: --/PW res: [0x2c0de:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427541:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c55dc3 lrc: 2/0,0 mode: PW/PW res: [0x2c0dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427544:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000337d9d20 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530225.427545:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c55dc3 lrc: 2/0,0 mode: PW/PW res: [0x2c0dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.427547:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651530225.427547:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c55dc3 lrc: 3/0,0 mode: PW/PW res: [0x2c0dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427549:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c55dca lrc: 3/0,1 mode: --/PW res: [0x2c0dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427551:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c55dc3 lrc: 1/0,0 mode: --/PW res: [0x2c0dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427552:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427553:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427553:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c55dca lrc: 3/0,1 mode: PW/PW res: [0x2c0dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427553:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000337d9d20/0x3234de053c55dc3 lrc: 0/0,0 mode: --/PW res: [0x2c0dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427557:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c55dca lrc: 3/0,1 mode: PW/PW res: [0x2c0dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427560:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c55dca lrc: 3/0,1 mode: PW/PW res: [0x2c0dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427563:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c55dca lrc: 2/0,0 mode: PW/PW res: [0x2c0dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427574:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c55dca lrc: 2/0,0 mode: PW/PW res: [0x2c0dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427584:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a9b4b5b4 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530225.427585:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c55dca lrc: 2/0,0 mode: PW/PW res: [0x2c0dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427588:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c55dca lrc: 3/0,0 mode: PW/PW res: [0x2c0dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.427591:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.427592:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c55dd1 lrc: 3/0,1 mode: --/PW res: [0x2c0db:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427592:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c55dca lrc: 1/0,0 mode: --/PW res: [0x2c0dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427595:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1651530225.427595:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9b4b5b4/0x3234de053c55dca lrc: 0/0,0 mode: --/PW res: [0x2c0dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427596:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427596:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c55dd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427600:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c55dd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427602:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c55dd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427605:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c55dd1 lrc: 2/0,0 mode: PW/PW res: [0x2c0db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427627:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c55dd1 lrc: 2/0,0 mode: PW/PW res: [0x2c0db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427631:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b232c9bb already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530225.427632:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c55dd1 lrc: 2/0,0 mode: PW/PW res: [0x2c0db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427634:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c55dd1 lrc: 3/0,0 mode: PW/PW res: [0x2c0db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427639:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c55dd1 lrc: 1/0,0 mode: --/PW res: [0x2c0db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427641:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b232c9bb/0x3234de053c55dd1 lrc: 0/0,0 mode: --/PW res: [0x2c0db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.427644:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.427646:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c55dd8 lrc: 3/0,1 mode: --/PW res: [0x2c0da:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427650:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427650:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427651:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c55dd8 lrc: 3/0,1 mode: PW/PW res: [0x2c0da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427654:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c55dd8 lrc: 3/0,1 mode: PW/PW res: [0x2c0da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427657:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c55dd8 lrc: 3/0,1 mode: PW/PW res: [0x2c0da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427660:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c55dd8 lrc: 2/0,0 mode: PW/PW res: [0x2c0da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427669:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c55dd8 lrc: 2/0,0 mode: PW/PW res: [0x2c0da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427672:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d09e97cf already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530225.427673:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c55dd8 lrc: 2/0,0 mode: PW/PW res: [0x2c0da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427676:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c55dd8 lrc: 3/0,0 mode: PW/PW res: [0x2c0da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427680:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c55dd8 lrc: 1/0,0 mode: --/PW res: [0x2c0da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427683:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d09e97cf/0x3234de053c55dd8 lrc: 0/0,0 mode: --/PW res: [0x2c0da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.427688:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.427690:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006317cd4c/0x3234de053c55ddf lrc: 3/0,1 mode: --/PW res: [0x2c0d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427693:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427693:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427694:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006317cd4c/0x3234de053c55ddf lrc: 3/0,1 mode: PW/PW res: [0x2c0d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427697:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006317cd4c/0x3234de053c55ddf lrc: 3/0,1 mode: PW/PW res: [0x2c0d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427700:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006317cd4c/0x3234de053c55ddf lrc: 3/0,1 mode: PW/PW res: [0x2c0d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427703:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006317cd4c/0x3234de053c55ddf lrc: 2/0,0 mode: PW/PW res: [0x2c0d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427720:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006317cd4c/0x3234de053c55ddf lrc: 2/0,0 mode: PW/PW res: [0x2c0d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427723:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006317cd4c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530225.427724:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006317cd4c/0x3234de053c55ddf lrc: 2/0,0 mode: PW/PW res: [0x2c0d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427727:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006317cd4c/0x3234de053c55ddf lrc: 3/0,0 mode: PW/PW res: [0x2c0d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.427731:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1651530225.427731:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006317cd4c/0x3234de053c55ddf lrc: 1/0,0 mode: --/PW res: [0x2c0d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427733:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c55de6 lrc: 3/0,1 mode: --/PW res: [0x2c0d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427736:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427737:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427737:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c55de6 lrc: 3/0,1 mode: PW/PW res: [0x2c0d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427740:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c55de6 lrc: 3/0,1 mode: PW/PW res: [0x2c0d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427740:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006317cd4c/0x3234de053c55ddf lrc: 0/0,0 mode: --/PW res: [0x2c0d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427743:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c55de6 lrc: 3/0,1 mode: PW/PW res: [0x2c0d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427746:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c55de6 lrc: 2/0,0 mode: PW/PW res: [0x2c0d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427755:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c55de6 lrc: 2/0,0 mode: PW/PW res: [0x2c0d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427758:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000033d777ce already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530225.427759:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c55de6 lrc: 2/0,0 mode: PW/PW res: [0x2c0d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427762:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c55de6 lrc: 3/0,0 mode: PW/PW res: [0x2c0d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427766:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c55de6 lrc: 1/0,0 mode: --/PW res: [0x2c0d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427768:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033d777ce/0x3234de053c55de6 lrc: 0/0,0 mode: --/PW res: [0x2c0d8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.427782:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.427784:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c55ded lrc: 3/0,1 mode: --/PW res: [0x2c0d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427789:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427790:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427791:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c55ded lrc: 3/0,1 mode: PW/PW res: [0x2c0d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427794:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c55ded lrc: 3/0,1 mode: PW/PW res: [0x2c0d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427797:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c55ded lrc: 3/0,1 mode: PW/PW res: [0x2c0d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427800:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c55ded lrc: 2/0,0 mode: PW/PW res: [0x2c0d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427817:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c55ded lrc: 2/0,0 mode: PW/PW res: [0x2c0d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427820:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000037a4f3dc already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530225.427821:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c55ded lrc: 2/0,0 mode: PW/PW res: [0x2c0d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427827:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c55ded lrc: 3/0,0 mode: PW/PW res: [0x2c0d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427831:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c55ded lrc: 1/0,0 mode: --/PW res: [0x2c0d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427833:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037a4f3dc/0x3234de053c55ded lrc: 0/0,0 mode: --/PW res: [0x2c0d7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.427836:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.427838:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c55df4 lrc: 3/0,1 mode: --/PW res: [0x2c0d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427841:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427842:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427842:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c55df4 lrc: 3/0,1 mode: PW/PW res: [0x2c0d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427846:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c55df4 lrc: 3/0,1 mode: PW/PW res: [0x2c0d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427849:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c55df4 lrc: 3/0,1 mode: PW/PW res: [0x2c0d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427854:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c55df4 lrc: 2/0,0 mode: PW/PW res: [0x2c0d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427863:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c55df4 lrc: 2/0,0 mode: PW/PW res: [0x2c0d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427866:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b9e4c5a0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530225.427867:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c55df4 lrc: 2/0,0 mode: PW/PW res: [0x2c0d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427870:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c55df4 lrc: 3/0,0 mode: PW/PW res: [0x2c0d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427874:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c55df4 lrc: 1/0,0 mode: --/PW res: [0x2c0d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427876:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9e4c5a0/0x3234de053c55df4 lrc: 0/0,0 mode: --/PW res: [0x2c0d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.427882:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.427883:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c55dfb lrc: 3/0,1 mode: --/PW res: [0x2c0d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427886:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427887:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427888:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c55dfb lrc: 3/0,1 mode: PW/PW res: [0x2c0d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427891:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c55dfb lrc: 3/0,1 mode: PW/PW res: [0x2c0d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427894:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c55dfb lrc: 3/0,1 mode: PW/PW res: [0x2c0d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427896:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c55dfb lrc: 2/0,0 mode: PW/PW res: [0x2c0d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427905:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c55dfb lrc: 2/0,0 mode: PW/PW res: [0x2c0d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427909:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006512b8a0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530225.427910:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c55dfb lrc: 2/0,0 mode: PW/PW res: [0x2c0d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427912:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c55dfb lrc: 3/0,0 mode: PW/PW res: [0x2c0d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427916:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c55dfb lrc: 1/0,0 mode: --/PW res: [0x2c0d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427919:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006512b8a0/0x3234de053c55dfb lrc: 0/0,0 mode: --/PW res: [0x2c0d5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.427933:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.427935:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c55e02 lrc: 3/0,1 mode: --/PW res: [0x2c0d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427938:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427939:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427939:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c55e02 lrc: 3/0,1 mode: PW/PW res: [0x2c0d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427943:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c55e02 lrc: 3/0,1 mode: PW/PW res: [0x2c0d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427946:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c55e02 lrc: 3/0,1 mode: PW/PW res: [0x2c0d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427949:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c55e02 lrc: 2/0,0 mode: PW/PW res: [0x2c0d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427957:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c55e02 lrc: 2/0,0 mode: PW/PW res: [0x2c0d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427960:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000589cc6c already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530225.427961:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c55e02 lrc: 2/0,0 mode: PW/PW res: [0x2c0d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427964:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c55e02 lrc: 3/0,0 mode: PW/PW res: [0x2c0d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427968:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c55e02 lrc: 1/0,0 mode: --/PW res: [0x2c0d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.427970:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000589cc6c/0x3234de053c55e02 lrc: 0/0,0 mode: --/PW res: [0x2c0d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.427985:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.427987:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c55e09 lrc: 3/0,1 mode: --/PW res: [0x2c0d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427990:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427991:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.427992:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c55e09 lrc: 3/0,1 mode: PW/PW res: [0x2c0d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427995:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c55e09 lrc: 3/0,1 mode: PW/PW res: [0x2c0d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.427998:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c55e09 lrc: 3/0,1 mode: PW/PW res: [0x2c0d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428000:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c55e09 lrc: 2/0,0 mode: PW/PW res: [0x2c0d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428012:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c55e09 lrc: 2/0,0 mode: PW/PW res: [0x2c0d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428015:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002d7487dc already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530225.428016:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c55e09 lrc: 2/0,0 mode: PW/PW res: [0x2c0d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428019:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c55e09 lrc: 3/0,0 mode: PW/PW res: [0x2c0d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428022:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c55e09 lrc: 1/0,0 mode: --/PW res: [0x2c0d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428025:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d7487dc/0x3234de053c55e09 lrc: 0/0,0 mode: --/PW res: [0x2c0d3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.428031:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.428033:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c55e10 lrc: 3/0,1 mode: --/PW res: [0x2c0d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428036:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428037:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428038:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c55e10 lrc: 3/0,1 mode: PW/PW res: [0x2c0d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428041:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c55e10 lrc: 3/0,1 mode: PW/PW res: [0x2c0d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428043:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c55e10 lrc: 3/0,1 mode: PW/PW res: [0x2c0d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428046:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c55e10 lrc: 2/0,0 mode: PW/PW res: [0x2c0d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428055:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c55e10 lrc: 2/0,0 mode: PW/PW res: [0x2c0d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428058:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ac14729e already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530225.428059:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c55e10 lrc: 2/0,0 mode: PW/PW res: [0x2c0d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428061:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c55e10 lrc: 3/0,0 mode: PW/PW res: [0x2c0d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428065:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c55e10 lrc: 1/0,0 mode: --/PW res: [0x2c0d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428074:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac14729e/0x3234de053c55e10 lrc: 0/0,0 mode: --/PW res: [0x2c0d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.428085:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.428086:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c55e17 lrc: 3/0,1 mode: --/PW res: [0x2c0d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428090:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428090:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428091:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c55e17 lrc: 3/0,1 mode: PW/PW res: [0x2c0d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428094:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c55e17 lrc: 3/0,1 mode: PW/PW res: [0x2c0d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428097:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c55e17 lrc: 3/0,1 mode: PW/PW res: [0x2c0d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428100:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c55e17 lrc: 2/0,0 mode: PW/PW res: [0x2c0d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428109:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c55e17 lrc: 2/0,0 mode: PW/PW res: [0x2c0d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428112:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009882f227 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530225.428113:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c55e17 lrc: 2/0,0 mode: PW/PW res: [0x2c0d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428116:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c55e17 lrc: 3/0,0 mode: PW/PW res: [0x2c0d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428120:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c55e17 lrc: 1/0,0 mode: --/PW res: [0x2c0d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428122:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009882f227/0x3234de053c55e17 lrc: 0/0,0 mode: --/PW res: [0x2c0d1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.428133:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.428134:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c55e1e lrc: 3/0,1 mode: --/PW res: [0x2c0d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428138:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428138:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428139:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c55e1e lrc: 3/0,1 mode: PW/PW res: [0x2c0d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428142:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c55e1e lrc: 3/0,1 mode: PW/PW res: [0x2c0d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428145:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c55e1e lrc: 3/0,1 mode: PW/PW res: [0x2c0d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428148:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c55e1e lrc: 2/0,0 mode: PW/PW res: [0x2c0d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428157:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c55e1e lrc: 2/0,0 mode: PW/PW res: [0x2c0d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428160:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cde7e11a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530225.428161:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c55e1e lrc: 2/0,0 mode: PW/PW res: [0x2c0d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428166:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c55e1e lrc: 3/0,0 mode: PW/PW res: [0x2c0d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428170:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c55e1e lrc: 1/0,0 mode: --/PW res: [0x2c0d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428172:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cde7e11a/0x3234de053c55e1e lrc: 0/0,0 mode: --/PW res: [0x2c0d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.428183:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.428185:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c55e25 lrc: 3/0,1 mode: --/PW res: [0x2c0cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428190:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428191:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428192:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c55e25 lrc: 3/0,1 mode: PW/PW res: [0x2c0cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428195:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c55e25 lrc: 3/0,1 mode: PW/PW res: [0x2c0cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428198:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c55e25 lrc: 3/0,1 mode: PW/PW res: [0x2c0cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428200:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c55e25 lrc: 2/0,0 mode: PW/PW res: [0x2c0cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428210:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c55e25 lrc: 2/0,0 mode: PW/PW res: [0x2c0cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428213:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009fff0bd3 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530225.428214:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c55e25 lrc: 2/0,0 mode: PW/PW res: [0x2c0cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428217:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c55e25 lrc: 3/0,0 mode: PW/PW res: [0x2c0cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428221:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c55e25 lrc: 1/0,0 mode: --/PW res: [0x2c0cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428237:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fff0bd3/0x3234de053c55e25 lrc: 0/0,0 mode: --/PW res: [0x2c0cf:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.428241:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.428243:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c55e2c lrc: 3/0,1 mode: --/PW res: [0x2c0ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428246:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428247:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428248:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c55e2c lrc: 3/0,1 mode: PW/PW res: [0x2c0ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428251:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c55e2c lrc: 3/0,1 mode: PW/PW res: [0x2c0ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428254:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c55e2c lrc: 3/0,1 mode: PW/PW res: [0x2c0ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428259:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c55e2c lrc: 2/0,0 mode: PW/PW res: [0x2c0ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428269:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c55e2c lrc: 2/0,0 mode: PW/PW res: [0x2c0ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428272:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d1167ce5 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530225.428273:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c55e2c lrc: 2/0,0 mode: PW/PW res: [0x2c0ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428276:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c55e2c lrc: 3/0,0 mode: PW/PW res: [0x2c0ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428280:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c55e2c lrc: 1/0,0 mode: --/PW res: [0x2c0ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428282:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1167ce5/0x3234de053c55e2c lrc: 0/0,0 mode: --/PW res: [0x2c0ce:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.428286:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.428288:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c55e33 lrc: 3/0,1 mode: --/PW res: [0x2c0cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428291:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428291:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428292:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c55e33 lrc: 3/0,1 mode: PW/PW res: [0x2c0cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428295:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c55e33 lrc: 3/0,1 mode: PW/PW res: [0x2c0cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428298:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c55e33 lrc: 3/0,1 mode: PW/PW res: [0x2c0cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428301:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c55e33 lrc: 2/0,0 mode: PW/PW res: [0x2c0cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428310:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c55e33 lrc: 2/0,0 mode: PW/PW res: [0x2c0cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428313:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000215144f2 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530225.428314:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c55e33 lrc: 2/0,0 mode: PW/PW res: [0x2c0cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428316:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c55e33 lrc: 3/0,0 mode: PW/PW res: [0x2c0cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428320:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c55e33 lrc: 1/0,0 mode: --/PW res: [0x2c0cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428322:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000215144f2/0x3234de053c55e33 lrc: 0/0,0 mode: --/PW res: [0x2c0cd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.428326:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.428327:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c55e3a lrc: 3/0,1 mode: --/PW res: [0x2c0cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428330:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428331:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428332:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c55e3a lrc: 3/0,1 mode: PW/PW res: [0x2c0cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428335:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c55e3a lrc: 3/0,1 mode: PW/PW res: [0x2c0cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428338:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c55e3a lrc: 3/0,1 mode: PW/PW res: [0x2c0cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428340:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c55e3a lrc: 2/0,0 mode: PW/PW res: [0x2c0cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428350:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c55e3a lrc: 2/0,0 mode: PW/PW res: [0x2c0cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428353:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c660975a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530225.428354:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c55e3a lrc: 2/0,0 mode: PW/PW res: [0x2c0cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428357:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c55e3a lrc: 3/0,0 mode: PW/PW res: [0x2c0cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428360:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c55e3a lrc: 1/0,0 mode: --/PW res: [0x2c0cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428363:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c660975a/0x3234de053c55e3a lrc: 0/0,0 mode: --/PW res: [0x2c0cc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.428372:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.428374:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c55e41 lrc: 3/0,1 mode: --/PW res: [0x2c0cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428377:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428377:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428378:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c55e41 lrc: 3/0,1 mode: PW/PW res: [0x2c0cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428381:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c55e41 lrc: 3/0,1 mode: PW/PW res: [0x2c0cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428384:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c55e41 lrc: 3/0,1 mode: PW/PW res: [0x2c0cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428387:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c55e41 lrc: 2/0,0 mode: PW/PW res: [0x2c0cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428399:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c55e41 lrc: 2/0,0 mode: PW/PW res: [0x2c0cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428402:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e4f40ecf already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530225.428403:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c55e41 lrc: 2/0,0 mode: PW/PW res: [0x2c0cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428406:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c55e41 lrc: 3/0,0 mode: PW/PW res: [0x2c0cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428409:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c55e41 lrc: 1/0,0 mode: --/PW res: [0x2c0cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428418:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4f40ecf/0x3234de053c55e41 lrc: 0/0,0 mode: --/PW res: [0x2c0cb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.428425:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.428426:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c55e48 lrc: 3/0,1 mode: --/PW res: [0x2c0ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428430:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428430:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428431:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c55e48 lrc: 3/0,1 mode: PW/PW res: [0x2c0ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428434:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c55e48 lrc: 3/0,1 mode: PW/PW res: [0x2c0ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428438:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c55e48 lrc: 3/0,1 mode: PW/PW res: [0x2c0ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428440:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c55e48 lrc: 2/0,0 mode: PW/PW res: [0x2c0ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428450:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c55e48 lrc: 2/0,0 mode: PW/PW res: [0x2c0ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428453:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001d04fb0a already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530225.428453:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c55e48 lrc: 2/0,0 mode: PW/PW res: [0x2c0ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428456:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c55e48 lrc: 3/0,0 mode: PW/PW res: [0x2c0ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428460:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c55e48 lrc: 1/0,0 mode: --/PW res: [0x2c0ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428463:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d04fb0a/0x3234de053c55e48 lrc: 0/0,0 mode: --/PW res: [0x2c0ca:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.428473:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.428475:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c55e4f lrc: 3/0,1 mode: --/PW res: [0x2c0c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428478:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428478:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428479:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c55e4f lrc: 3/0,1 mode: PW/PW res: [0x2c0c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428482:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c55e4f lrc: 3/0,1 mode: PW/PW res: [0x2c0c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428485:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c55e4f lrc: 3/0,1 mode: PW/PW res: [0x2c0c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428488:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c55e4f lrc: 2/0,0 mode: PW/PW res: [0x2c0c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428497:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c55e4f lrc: 2/0,0 mode: PW/PW res: [0x2c0c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428500:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d37a9fd1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530225.428501:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c55e4f lrc: 2/0,0 mode: PW/PW res: [0x2c0c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428506:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c55e4f lrc: 3/0,0 mode: PW/PW res: [0x2c0c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428510:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c55e4f lrc: 1/0,0 mode: --/PW res: [0x2c0c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428513:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d37a9fd1/0x3234de053c55e4f lrc: 0/0,0 mode: --/PW res: [0x2c0c9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.428521:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.428523:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c55e56 lrc: 3/0,1 mode: --/PW res: [0x2c0c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428526:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428527:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428527:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c55e56 lrc: 3/0,1 mode: PW/PW res: [0x2c0c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428531:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c55e56 lrc: 3/0,1 mode: PW/PW res: [0x2c0c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428534:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c55e56 lrc: 3/0,1 mode: PW/PW res: [0x2c0c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428536:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c55e56 lrc: 2/0,0 mode: PW/PW res: [0x2c0c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428545:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c55e56 lrc: 2/0,0 mode: PW/PW res: [0x2c0c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428548:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a032e9d0 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530225.428549:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c55e56 lrc: 2/0,0 mode: PW/PW res: [0x2c0c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428552:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c55e56 lrc: 3/0,0 mode: PW/PW res: [0x2c0c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428555:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c55e56 lrc: 1/0,0 mode: --/PW res: [0x2c0c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428558:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a032e9d0/0x3234de053c55e56 lrc: 0/0,0 mode: --/PW res: [0x2c0c8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.428568:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.428570:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c55e5d lrc: 3/0,1 mode: --/PW res: [0x2c0c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428575:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428576:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428577:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c55e5d lrc: 3/0,1 mode: PW/PW res: [0x2c0c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428580:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c55e5d lrc: 3/0,1 mode: PW/PW res: [0x2c0c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428583:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c55e5d lrc: 3/0,1 mode: PW/PW res: [0x2c0c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428585:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c55e5d lrc: 2/0,0 mode: PW/PW res: [0x2c0c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428594:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c55e5d lrc: 2/0,0 mode: PW/PW res: [0x2c0c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428598:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f56810a1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530225.428599:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c55e5d lrc: 2/0,0 mode: PW/PW res: [0x2c0c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428602:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c55e5d lrc: 3/0,0 mode: PW/PW res: [0x2c0c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428605:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c55e5d lrc: 1/0,0 mode: --/PW res: [0x2c0c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428608:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f56810a1/0x3234de053c55e5d lrc: 0/0,0 mode: --/PW res: [0x2c0c7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.428621:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.428623:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c55e64 lrc: 3/0,1 mode: --/PW res: [0x2c0c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428626:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428627:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428628:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c55e64 lrc: 3/0,1 mode: PW/PW res: [0x2c0c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428631:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c55e64 lrc: 3/0,1 mode: PW/PW res: [0x2c0c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428634:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c55e64 lrc: 3/0,1 mode: PW/PW res: [0x2c0c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428639:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c55e64 lrc: 2/0,0 mode: PW/PW res: [0x2c0c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428648:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c55e64 lrc: 2/0,0 mode: PW/PW res: [0x2c0c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428651:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000f18bca1 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530225.428652:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c55e64 lrc: 2/0,0 mode: PW/PW res: [0x2c0c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428655:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c55e64 lrc: 3/0,0 mode: PW/PW res: [0x2c0c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428658:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c55e64 lrc: 1/0,0 mode: --/PW res: [0x2c0c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428661:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f18bca1/0x3234de053c55e64 lrc: 0/0,0 mode: --/PW res: [0x2c0c6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.428666:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.428668:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c55e6b lrc: 3/0,1 mode: --/PW res: [0x2c0c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428671:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428671:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428672:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c55e6b lrc: 3/0,1 mode: PW/PW res: [0x2c0c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428675:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c55e6b lrc: 3/0,1 mode: PW/PW res: [0x2c0c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428678:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c55e6b lrc: 3/0,1 mode: PW/PW res: [0x2c0c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428681:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c55e6b lrc: 2/0,0 mode: PW/PW res: [0x2c0c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428690:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c55e6b lrc: 2/0,0 mode: PW/PW res: [0x2c0c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428693:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000294488b6 already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530225.428694:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c55e6b lrc: 2/0,0 mode: PW/PW res: [0x2c0c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428697:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c55e6b lrc: 3/0,0 mode: PW/PW res: [0x2c0c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428700:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c55e6b lrc: 1/0,0 mode: --/PW res: [0x2c0c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428703:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000294488b6/0x3234de053c55e6b lrc: 0/0,0 mode: --/PW res: [0x2c0c5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.428720:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.428722:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c55e72 lrc: 3/0,1 mode: --/PW res: [0x2c0c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428725:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428726:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428727:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c55e72 lrc: 3/0,1 mode: PW/PW res: [0x2c0c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428730:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c55e72 lrc: 3/0,1 mode: PW/PW res: [0x2c0c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428733:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c55e72 lrc: 3/0,1 mode: PW/PW res: [0x2c0c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428736:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c55e72 lrc: 2/0,0 mode: PW/PW res: [0x2c0c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428745:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c55e72 lrc: 2/0,0 mode: PW/PW res: [0x2c0c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428748:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e35b0bde already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530225.428749:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c55e72 lrc: 2/0,0 mode: PW/PW res: [0x2c0c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428752:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c55e72 lrc: 3/0,0 mode: PW/PW res: [0x2c0c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428755:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c55e72 lrc: 1/0,0 mode: --/PW res: [0x2c0c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428758:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e35b0bde/0x3234de053c55e72 lrc: 0/0,0 mode: --/PW res: [0x2c0c4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.428769:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.428771:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c55e79 lrc: 3/0,1 mode: --/PW res: [0x2c0c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428774:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428774:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428775:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c55e79 lrc: 3/0,1 mode: PW/PW res: [0x2c0c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428778:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c55e79 lrc: 3/0,1 mode: PW/PW res: [0x2c0c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428781:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c55e79 lrc: 3/0,1 mode: PW/PW res: [0x2c0c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428784:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c55e79 lrc: 2/0,0 mode: PW/PW res: [0x2c0c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428795:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c55e79 lrc: 2/0,0 mode: PW/PW res: [0x2c0c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428798:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003c5315da already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530225.428799:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c55e79 lrc: 2/0,0 mode: PW/PW res: [0x2c0c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428802:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c55e79 lrc: 3/0,0 mode: PW/PW res: [0x2c0c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428806:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c55e79 lrc: 1/0,0 mode: --/PW res: [0x2c0c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428808:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c5315da/0x3234de053c55e79 lrc: 0/0,0 mode: --/PW res: [0x2c0c3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1651530225.428814:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x2c0c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1651530225.428815:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c55e80 lrc: 3/0,1 mode: --/PW res: [0x2c0c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428819:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428819:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1651530225.428820:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c55e80 lrc: 3/0,1 mode: PW/PW res: [0x2c0c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428823:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c55e80 lrc: 3/0,1 mode: PW/PW res: [0x2c0c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428826:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c55e80 lrc: 3/0,1 mode: PW/PW res: [0x2c0c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.428828:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c55e80 lrc: 2/0,0 mode: PW/PW res: [0x2c0c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428838:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c55e80 lrc: 2/0,0 mode: PW/PW res: [0x2c0c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428841:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b65e0a0d already unused, calling callback (0000000049fddea7) 00010000:00010000:0.0:1651530225.428841:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c55e80 lrc: 2/0,0 mode: PW/PW res: [0x2c0c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428847:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c55e80 lrc: 3/0,0 mode: PW/PW res: [0x2c0c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428850:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c55e80 lrc: 1/0,0 mode: --/PW res: [0x2c0c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1651530225.428853:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b65e0a0d/0x3234de053c55e80 lrc: 0/0,0 mode: --/PW res: [0x2c0c2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1651530225.428966:0:166111:0:(ofd_dev.c:1469:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x0:180385 00000100:00100000:1.0:1651530225.428998:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000001a688b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:252764:x1731745946864256:12345-10.240.43.61@tcp:5:osp-pre-1-0.0 Request processed in 3564us (3623us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530225.429002:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 946 00000100:00100000:1.0:1651530225.429672:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:1.0:1651530225.429680:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946864384 00000100:00100000:1.0:1651530225.429695:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 947 00000100:00100000:1.0:1651530225.429697:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000615d6d1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:252764:x1731745946864384:12345-10.240.43.61@tcp:5:osp-pre-1-0.0 00002000:00080000:1.0:1651530225.429709:0:166111:0:(ofd_dev.c:1706:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x0 at 180450 00000100:00100000:1.0:1651530225.431303:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000615d6d1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:252764:x1731745946864384:12345-10.240.43.61@tcp:5:osp-pre-1-0.0 Request processed in 1605us (1631us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530225.431307:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 947 10000000:01000000:1.0:1651530225.853269:0:166108:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1651530225.853272:0:166108:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff94e0d279b000 from 205 10000000:01000000:1.0:1651530225.853274:0:166108:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1651530225.853299:0:166108:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 0000000045fe8361/0x3234de053c55e87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.853305:0:166108:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 0000000045fe8361/0x3234de053c55e87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.853311:0:166108:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 0000000045fe8361/0x3234de053c55e87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530225.853323:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006ef847c9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997091008:10.240.43.61@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1651530225.853359:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a022c132 going to sleep for 6 seconds 00000100:00100000:1.0:1651530225.856300:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006ef847c9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997091008:10.240.43.61@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1651530225.856309:0:166108:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 0000000045fe8361/0x3234de053c55e87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e60716 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.856313:0:166108:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 0000000045fe8361/0x3234de053c55e87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553e60716 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530225.856341:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006ef847c9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997091072:10.240.43.61@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1651530225.856353:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a022c132 going to sleep for 6 seconds 00000100:00100000:1.0:1651530225.856809:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006ef847c9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997091072:10.240.43.61@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1651530225.856824:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006ef847c9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997091136:10.240.43.61@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1651530225.856846:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a022c132 going to sleep for 6 seconds 00000100:00100000:1.0:1651530225.857499:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006ef847c9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997091136:10.240.43.61@tcp:503:ll_cfg_requeue.0 00000040:00080000:1.0:1651530225.857833:0:181686:0:(llog.c:768:llog_process_thread()) stop processing plain 0x3:10:0 index 64768 count 201 00000020:01000000:1.0:1651530225.857871:0:166108:0:(obd_config.c:2042:class_config_parse_llog()) Processed log lustre-client gen 205-204 (rc=0) 10000000:01000000:1.0:1651530225.857877:0:166108:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1651530225.857879:0:166108:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 0000000045fe8361/0x3234de053c55e87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e60716 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.857884:0:166108:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 0000000045fe8361/0x3234de053c55e87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e60716 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651530225.857887:0:166108:0:(mgc_request.c:609:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1651530225.857888:0:166108:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1651530225.857889:0:166108:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1651530225.857894:0:166108:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 00000000d2b9655c/0x3234de053c55e8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.857897:0:166108:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 00000000d2b9655c/0x3234de053c55e8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.857900:0:166108:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 00000000d2b9655c/0x3234de053c55e8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530225.857905:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006ef847c9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997091200:10.240.43.61@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1651530225.857917:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d4d9125d going to sleep for 6 seconds 00000100:00100000:1.0:1651530225.858169:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006ef847c9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997091200:10.240.43.61@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1651530225.858174:0:166108:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 00000000d2b9655c/0x3234de053c55e8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e6071d expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.858188:0:166108:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 00000000d2b9655c/0x3234de053c55e8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553e6071d expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530225.858203:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006ef847c9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997091264:10.240.43.61@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1651530225.858215:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d4d9125d going to sleep for 6 seconds 00000100:00100000:1.0:1651530225.858449:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006ef847c9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997091264:10.240.43.61@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1651530225.858459:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006ef847c9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997091328:10.240.43.61@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1651530225.858472:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d4d9125d going to sleep for 6 seconds 00000100:00100000:1.0:1651530225.858949:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006ef847c9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997091328:10.240.43.61@tcp:503:ll_cfg_requeue.0 00000040:00080000:1.0:1651530225.859267:0:181687:0:(llog.c:768:llog_process_thread()) stop processing plain 0x9:10:0 index 64768 count 8 00000020:01000000:1.0:1651530225.859292:0:166108:0:(obd_config.c:2042:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-7 (rc=0) 10000000:01000000:1.0:1651530225.859297:0:166108:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1651530225.859299:0:166108:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000d2b9655c/0x3234de053c55e8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e6071d expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.859303:0:166108:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 00000000d2b9655c/0x3234de053c55e8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e6071d expref: -99 pid: 166108 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651530225.859306:0:166108:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:1.0:1651530225.859306:0:166108:0:(mgc_request.c:2064:mgc_process_log()) Process log params-ffff94e0d279b000 from 19 10000000:01000000:1.0:1651530225.859307:0:166108:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1651530225.859313:0:166108:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 000000002731c8d2/0x3234de053c55e95 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.859316:0:166108:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 000000002731c8d2/0x3234de053c55e95 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.859321:0:166108:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 000000002731c8d2/0x3234de053c55e95 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530225.859326:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006ef847c9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997091392:10.240.43.61@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1651530225.859338:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 0000000044f68e5a going to sleep for 6 seconds 00000100:00100000:1.0:1651530225.859574:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006ef847c9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997091392:10.240.43.61@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1651530225.859579:0:166108:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 000000002731c8d2/0x3234de053c55e95 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e60724 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.859582:0:166108:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 000000002731c8d2/0x3234de053c55e95 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553e60724 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530225.859596:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006ef847c9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997091456:10.240.43.61@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1651530225.859607:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 0000000044f68e5a going to sleep for 6 seconds 00000100:00100000:1.0:1651530225.859814:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006ef847c9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997091456:10.240.43.61@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1651530225.859824:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006ef847c9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997091520:10.240.43.61@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1651530225.859836:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 0000000044f68e5a going to sleep for 6 seconds 00000100:00100000:1.0:1651530225.860083:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006ef847c9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997091520:10.240.43.61@tcp:503:ll_cfg_requeue.0 00000040:00080000:1.0:1651530225.860388:0:181688:0:(llog.c:768:llog_process_thread()) stop processing plain 0x2:10:0 index 64768 count 19 00000020:01000000:1.0:1651530225.860412:0:166108:0:(obd_config.c:2042:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:1.0:1651530225.860417:0:166108:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1651530225.860419:0:166108:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 000000002731c8d2/0x3234de053c55e95 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e60724 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.860422:0:166108:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 000000002731c8d2/0x3234de053c55e95 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e60724 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651530225.860425:0:166108:0:(mgc_request.c:609:do_requeue()) updating log nodemap 10000000:01000000:1.0:1651530225.860426:0:166108:0:(mgc_request.c:2064:mgc_process_log()) Process log nodemap-ffff94e0b53b8000 from 1 10000000:01000000:1.0:1651530225.860427:0:166108:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1651530225.860432:0:166108:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 0000000041a7efd7/0x3234de053c55e9c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.860435:0:166108:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 0000000041a7efd7/0x3234de053c55e9c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.860438:0:166108:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 0000000041a7efd7/0x3234de053c55e9c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530225.860443:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006ef847c9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997091584:10.240.43.61@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1651530225.860454:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c733e7e6 going to sleep for 6 seconds 00000100:00100000:1.0:1651530225.860681:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006ef847c9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997091584:10.240.43.61@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1651530225.860686:0:166108:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 0000000041a7efd7/0x3234de053c55e9c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e6072b expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.860689:0:166108:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 0000000041a7efd7/0x3234de053c55e9c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553e6072b expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530225.860749:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006ef847c9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997091648:10.240.43.61@tcp:256:ll_cfg_requeue.0 00000100:00100000:1.0:1651530225.860762:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 00000000382cf590 going to sleep for 6 seconds 00000100:00100000:1.0:1651530225.861246:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006ef847c9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997091648:10.240.43.61@tcp:256:ll_cfg_requeue.0 00080000:10000000:1.0:1651530225.861494:0:166108:0:(osd_handler.c:5198:osd_index_try()) lustre-OST0001: index object [0x200000003:0x13:0x0] (8/32) registered 10000000:01000000:1.0:1651530225.861550:0:166108:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1651530225.861552:0:166108:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 0000000041a7efd7/0x3234de053c55e9c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e6072b expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.861556:0:166108:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 0000000041a7efd7/0x3234de053c55e9c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e6072b expref: -99 pid: 166108 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1651530225.861559:0:166108:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1651530225.861560:0:166108:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff94e0b53b8000 from 1 10000000:01000000:1.0:1651530225.861561:0:166108:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1651530225.861566:0:166108:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 000000001b109cb1/0x3234de053c55ea3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.861569:0:166108:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 000000001b109cb1/0x3234de053c55ea3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.861572:0:166108:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 000000001b109cb1/0x3234de053c55ea3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530225.861577:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006ef847c9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997091712:10.240.43.61@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1651530225.861595:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 00000000382cf590 going to sleep for 6 seconds 00000100:00100000:1.0:1651530225.861825:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006ef847c9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997091712:10.240.43.61@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1651530225.861830:0:166108:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 000000001b109cb1/0x3234de053c55ea3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e60732 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.861834:0:166108:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 000000001b109cb1/0x3234de053c55ea3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b158553e60732 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1651530225.861848:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006ef847c9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997091776:10.240.43.61@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1651530225.861864:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 00000000382cf590 going to sleep for 6 seconds 00000100:00100000:1.0:1651530225.862460:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006ef847c9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997091776:10.240.43.61@tcp:501:ll_cfg_requeue.0 10000000:01000000:1.0:1651530225.862479:0:166108:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1651530225.862480:0:166108:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 000000001b109cb1/0x3234de053c55ea3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e60732 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1651530225.862483:0:166108:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 000000001b109cb1/0x3234de053c55ea3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b158553e60732 expref: -99 pid: 166108 timeout: 0 lvb_type: 0 00000400:00000080:0.0:1651530229.294748:0:181903:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530229.294750:0:181903:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 160i: changelog user register/unregister race ========================================================== 22:23:49 (1651530229) 00000100:00100000:0.0:1651530229.472247:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651530229.472279:0:166115:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946864512 00000100:00100000:0.0:1651530229.472329:0:166115:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 116 00000100:00100000:0.0:1651530229.472332:0:166115:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086faad8f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946864512:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1651530229.472368:0:166115:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 283451456 pending 0 free 81307983872 avail 77137272832 00000100:00100000:0.0:1651530229.472410:0:166115:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086faad8f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745946864512:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 77us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530229.472414:0:166115:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 116 00000001:00100000:0.0:1651530229.593747:0:166098:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1651530229.885322:0:39099:0:(ptlrpcd.c:414:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1651530229.885345:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006ef847c9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:39099:1731745997091840:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:1.0:1651530229.886159:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006ef847c9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:39099:1731745997091840:10.240.43.61@tcp:400:kworker/u4:0.0 00000100:00100000:0.0:1651530230.464988:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp) 00000100:00100000:1.0:1651530230.465048:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754356305024 00000100:00100000:1.0:1651530230.465087:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 15 00000100:00100000:1.0:1651530230.465089:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002715f296 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438148:x1731754356305024:12345-10.240.43.64@tcp:400:kworker/u4:1.0 00000100:00100000:1.0:1651530230.465144:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002715f296 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cccc371e-feb6-4a45-b229-8d88a861b48a+6:438148:x1731754356305024:12345-10.240.43.64@tcp:400:kworker/u4:1.0 Request processed in 55us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1651530230.465148:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 15 00000100:00100000:0.0:1651530234.593178:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp) 00000100:00100000:0.0:1651530234.593208:0:166115:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745946864704 00000100:00100000:0.0:1651530234.593247:0:166115:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 117 00000100:00100000:0.0:1651530234.593250:0:166115:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dceb6c9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946864704:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 00000100:00100000:1.0:1651530234.593256:0:166114:0:(service.c:3189:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 10 00000100:00100000:1.0:1651530234.593261:0:166114:0:(service.c:3248:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:0.0:1651530234.593277:0:166115:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 283451456 pending 0 free 81307983872 avail 77137272832 00000100:00100000:0.0:1651530234.593307:0:166115:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dceb6c9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745946864704:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 56us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1651530234.593317:0:166115:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 117 00000400:00000080:0.0:1651530235.788994:0:182122:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1651530235.788997:0:182122:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 160j: client can be umounted while its chanangelog is being used ========================================================== 22:23:55 (1651530235) 00000400:00000080:1.0:1651530236.184901:0:182176:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1651530236.184904:0:182176:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity test_160j: @@@@@@ FAIL: mount_client on /mnt/lustre2 failed Debug log: 141384 lines, 141384 kept, 0 dropped, 0 bad.